-- Logs begin at Sun 2022-08-07 00:10:40 UTC, end at Sun 2022-08-07 02:51:40 UTC. -- Aug 07 00:57:47.256196 n-d-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Aug 07 00:57:47.267909 n-d-master-1 devstack@n-api.service[104129]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 07 00:57:47.271083 n-d-master-1 devstack@n-api.service[104129]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Aug 7 00:57:47 2022] *** Aug 07 00:57:47.271282 n-d-master-1 devstack@n-api.service[104129]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 07 00:57:47.271418 n-d-master-1 devstack@n-api.service[104129]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 07 00:57:47.271526 n-d-master-1 devstack@n-api.service[104129]: nodename: n-d-master-1 Aug 07 00:57:47.271654 n-d-master-1 devstack@n-api.service[104129]: machine: x86_64 Aug 07 00:57:47.271654 n-d-master-1 devstack@n-api.service[104129]: clock source: unix Aug 07 00:57:47.271654 n-d-master-1 devstack@n-api.service[104129]: pcre jit disabled Aug 07 00:57:47.271654 n-d-master-1 devstack@n-api.service[104129]: detected number of CPU cores: 4 Aug 07 00:57:47.271654 n-d-master-1 devstack@n-api.service[104129]: current working directory: / Aug 07 00:57:47.271654 n-d-master-1 devstack@n-api.service[104129]: detected binary path: /usr/bin/uwsgi-core Aug 07 00:57:47.271654 n-d-master-1 devstack@n-api.service[104129]: your processes number limit is 47680 Aug 07 00:57:47.271654 n-d-master-1 devstack@n-api.service[104129]: your memory page size is 4096 bytes Aug 07 00:57:47.271654 n-d-master-1 devstack@n-api.service[104129]: detected max file descriptor number: 2048 Aug 07 00:57:47.271654 n-d-master-1 devstack@n-api.service[104129]: lock engine: pthread robust mutexes Aug 07 00:57:47.272321 n-d-master-1 devstack@n-api.service[104129]: thunder lock: enabled Aug 07 00:57:47.272321 n-d-master-1 devstack@n-api.service[104129]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 07 00:57:47.272321 n-d-master-1 devstack@n-api.service[104129]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 07 00:57:47.311374 n-d-master-1 devstack@n-api.service[104129]: Python main interpreter initialized at 0x5646ba4f89c0 Aug 07 00:57:47.311374 n-d-master-1 devstack@n-api.service[104129]: python threads support enabled Aug 07 00:57:47.311374 n-d-master-1 devstack@n-api.service[104129]: your server socket listen backlog is limited to 100 connections Aug 07 00:57:47.311374 n-d-master-1 devstack@n-api.service[104129]: your mercy for graceful operations on workers is 90 seconds Aug 07 00:57:47.311798 n-d-master-1 devstack@n-api.service[104129]: mapped 403077 bytes (393 KB) for 2 cores Aug 07 00:57:47.311798 n-d-master-1 devstack@n-api.service[104129]: *** Operational MODE: preforking *** Aug 07 00:57:47.312080 n-d-master-1 devstack@n-api.service[104129]: *** uWSGI is running in multiple interpreter mode *** Aug 07 00:57:47.312080 n-d-master-1 devstack@n-api.service[104129]: spawned uWSGI master process (pid: 104129) Aug 07 00:57:47.312294 n-d-master-1 systemd[1]: Started Devstack devstack@n-api.service. Aug 07 00:57:47.313892 n-d-master-1 devstack@n-api.service[104129]: spawned uWSGI worker 1 (pid: 104130, cores: 1) Aug 07 00:57:47.313892 n-d-master-1 devstack@n-api.service[104129]: spawned uWSGI worker 2 (pid: 104131, cores: 1) Aug 07 00:57:47.313892 n-d-master-1 devstack@n-api.service[104129]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 07 00:57:47.978404 n-d-master-1 devstack@n-api.service[104131]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 07 00:57:47.981105 n-d-master-1 devstack@n-api.service[104130]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 07 00:57:49.074420 n-d-master-1 devstack@n-api.service[104130]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 00:57:49.074420 n-d-master-1 devstack@n-api.service[104130]: from cryptography.utils import int_from_bytes Aug 07 00:57:49.075123 n-d-master-1 devstack@n-api.service[104131]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 00:57:49.075123 n-d-master-1 devstack@n-api.service[104131]: from cryptography.utils import int_from_bytes Aug 07 00:57:49.075123 n-d-master-1 devstack@n-api.service[104131]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 00:57:49.075123 n-d-master-1 devstack@n-api.service[104131]: from cryptography.utils import int_from_bytes Aug 07 00:57:49.075675 n-d-master-1 devstack@n-api.service[104130]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 00:57:49.075675 n-d-master-1 devstack@n-api.service[104130]: from cryptography.utils import int_from_bytes Aug 07 00:57:51.569091 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 00:57:51.569759 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 00:57:51.569851 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 00:57:51.569987 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 00:57:51.570350 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 00:57:51.570436 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 00:57:51.570529 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 00:57:51.570758 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 00:57:51.570850 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.571087 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.571190 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 00:57:51.571351 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 00:57:51.571448 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.571700 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.571801 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.572045 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.572142 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.572351 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.572471 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.572661 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.572785 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.572970 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.573073 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.573271 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.573363 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.573530 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.573615 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.573867 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.573956 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.574185 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.574285 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.574464 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.574551 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.574776 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.574869 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.575079 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.575172 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.575386 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.575472 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.575684 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.575772 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.576012 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.576179 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.576310 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.576404 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.576609 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.576790 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.576906 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.577930 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.578096 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.578096 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.578296 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.578405 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.578493 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.578579 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.578667 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.578747 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.578837 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.578944 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.579025 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.579154 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.579248 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.579344 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.579485 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.579630 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.579802 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.579925 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.580149 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.580313 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.580467 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.580629 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.580777 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.580930 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.581169 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.581303 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.581483 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.581627 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.581794 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.581897 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.582105 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.582213 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.582521 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.582609 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.582807 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.582952 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.583107 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.583193 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.583419 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.583512 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.583729 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.583828 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.584065 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.584173 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.584380 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.584479 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.584675 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.584774 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.584978 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.585076 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.585279 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.585373 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.585575 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.585668 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.585876 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.585966 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.586173 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.586269 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.586418 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.586516 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.586720 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.586815 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.587034 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.587121 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.587282 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.587376 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.587585 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.587680 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.587877 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.588053 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.588148 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.588230 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.588446 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.588537 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.588759 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.588857 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.589003 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.589097 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.589944 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.590064 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.590172 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.590362 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.590462 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.590545 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.590754 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.590843 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.591056 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.591144 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.591355 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.591441 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.591656 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.591771 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.592012 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.592114 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.592303 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.592400 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.592601 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.592703 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.592904 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.592997 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.593214 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.593300 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.593601 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.593696 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.593848 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.593934 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.594149 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.594235 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.594481 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.594611 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.594792 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.594940 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.595092 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.595189 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.595404 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.595501 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.595718 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.595811 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.596044 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.596150 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.596376 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.596474 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.596646 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.596748 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.596965 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.597087 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.597259 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.597360 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.597559 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.597646 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.597805 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.597891 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.598101 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.598195 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.598398 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.598485 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.598695 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.598779 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.598993 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.599096 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.599293 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.599397 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.599588 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.599676 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.599898 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.600009 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.600200 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.600300 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.600495 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.600601 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.600788 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.600881 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.601085 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.601192 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.601384 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.601478 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.601680 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.601773 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.601975 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.602126 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.602273 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.602368 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.602570 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.602663 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.602873 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.602960 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.603176 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.603276 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.603474 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.603559 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.603773 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.603858 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.604096 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.604186 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.604395 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.604483 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.604693 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.604779 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.605042 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.605678 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.605839 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.605933 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.606149 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.606236 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.606449 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.606542 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.606748 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.606833 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.607059 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.607158 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.607356 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.607451 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.607652 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.607738 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.607983 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.608087 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.608278 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.608369 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.608577 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.608663 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.608889 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.608976 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.609183 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.609272 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.609481 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.609570 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.609778 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.609866 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.610075 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.610169 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.610370 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.610458 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.610666 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.610752 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.610963 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.611049 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.611258 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.611350 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.611547 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.611642 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.611844 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.611945 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.612169 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.612268 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.612463 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.612558 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.612760 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.612846 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.613058 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.613146 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.613363 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.613464 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.613665 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.613760 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.613964 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.614050 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.614273 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:57:51.614369 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.614603 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.614695 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.614926 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.615030 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.615250 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.615344 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.615555 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.615640 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.615859 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.616023 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.616188 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.616304 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.616738 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.616878 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.616996 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.617193 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.617294 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.617376 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.617454 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.617538 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.617686 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.617783 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.617991 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.618076 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.618345 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.618452 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.618605 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.618702 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.618915 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.619003 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.619225 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.619310 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.619527 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.619615 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.619834 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.619953 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.620170 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.620304 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.620476 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.620612 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.620806 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.620892 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.621123 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.621218 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.621437 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.621545 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.621741 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.621828 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.622062 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.622155 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.622382 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.622477 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.622687 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.622775 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.622990 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.623076 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.623295 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.623402 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.623598 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.623685 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.623943 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.624036 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.624230 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.624320 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.624542 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.624627 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.624846 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.624934 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.625150 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.625245 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.625454 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.625541 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.625756 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.625847 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.626059 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.626147 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.626364 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.626460 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.626670 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.626759 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.626975 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.627061 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.627281 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.627391 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.627589 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.627688 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.627901 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.627991 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.628214 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.628302 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.628515 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.628615 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.628817 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.628914 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.629112 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.629200 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.629409 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.629506 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.629705 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.629808 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.629998 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.630092 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.630303 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.630482 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.630592 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.630687 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.630889 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.630983 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.631204 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.631292 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.631499 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.631586 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.631805 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.631924 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.632129 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.632231 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.632431 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.632525 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.632727 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.632814 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.633030 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.633118 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.633331 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.633425 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.633627 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.633720 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.633934 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.634022 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.634235 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.634320 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.634529 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.634622 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.634842 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.634929 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.635139 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.635225 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.635434 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.635529 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.635738 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.635826 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.636060 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.636148 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.636390 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.636531 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.636696 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.636808 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.636996 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.637087 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.637310 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.637407 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.637614 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.637713 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.637916 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.638005 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.638227 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.638316 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.638532 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.638619 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.638836 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.639219 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.639430 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.639522 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.639754 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.639855 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.640077 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.640168 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.640384 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.640479 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.640681 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.640787 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.640983 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.641081 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.641282 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.641377 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.641579 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.641666 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.641877 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.641979 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.642173 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.642268 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.642524 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.642624 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.642761 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.642858 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.643055 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.643144 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.643348 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.643435 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.643644 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.643741 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.643963 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.644057 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.644263 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.644363 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.644559 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.644655 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.644859 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.644978 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.645160 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.645248 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.645457 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.645554 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.645755 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.645844 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.646089 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.646186 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.646390 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.646480 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.646711 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.646803 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.647018 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.647106 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.647327 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.647416 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.647632 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.647729 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.647956 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.648058 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.648265 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.648363 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.648570 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.648658 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.648878 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.648972 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.649181 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.649270 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.649486 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.649581 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.649793 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.649910 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.650099 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.650197 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.650406 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.650510 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.650712 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.650819 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.651005 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.651092 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.651315 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.651402 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.651627 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.651723 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.652481 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.652659 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.652773 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.652869 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.653104 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.653200 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.653416 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.653504 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.653726 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.653811 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.654029 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.654117 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.654332 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.654425 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.654636 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.654724 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.654942 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.655037 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.655245 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.655332 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.655548 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.655644 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.655896 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.656008 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.656176 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.656271 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.656479 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.656564 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.656785 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.656884 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.657085 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.657172 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.657379 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.657465 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.657692 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.657794 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.657998 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.658084 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.658295 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.658391 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.658603 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.658691 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.658911 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.658997 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.659225 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.659395 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.659528 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.659614 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.659829 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.659974 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.660159 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.660312 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.660449 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.660584 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.660750 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.660881 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.661016 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.661160 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.661323 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.661458 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.661614 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.661754 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.661896 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.662033 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.662195 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.662340 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.662497 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.662639 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.662781 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.662923 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.663067 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.663202 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.663347 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.663482 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.663652 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.663790 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.663975 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.664109 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.664277 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.664415 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.664580 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.664717 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.664890 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.665032 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.665187 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.665342 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.665476 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.665609 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.665782 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.665915 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.666082 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.666226 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.666380 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.666515 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.666677 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.666814 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.666974 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.667119 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.667264 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.667404 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.668184 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.668339 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.668478 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.668625 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.668762 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.668894 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.669048 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.669184 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.669333 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.669468 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.669644 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.669790 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.669945 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.670031 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.670235 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.670370 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.670540 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.670681 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.670844 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.670975 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.671144 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.671288 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.671447 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.671584 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.671751 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.671905 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.672077 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.672210 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.672382 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.672518 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.672685 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.672831 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.672979 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.673111 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.673273 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.673410 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.673564 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.673710 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.673845 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.673980 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.674144 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.674281 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.674449 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.674600 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.674739 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.675018 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.675150 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.675337 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.675468 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.675651 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.675930 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.676069 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.676252 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.676424 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.676575 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.676728 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.676861 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.676995 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.677178 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.677322 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.677493 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.677637 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.677817 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.677962 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.678123 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.678258 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.678422 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.678563 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.678727 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.678877 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.679016 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.679157 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.679319 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.679455 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.679606 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.679746 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.679923 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.680058 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.680234 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.680353 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.680528 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.680622 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.680827 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.680943 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.681122 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.681217 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.681418 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.681515 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.681717 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.681812 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.682011 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.682098 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.682307 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.682395 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.682602 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.682689 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.682899 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.683207 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.683304 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.683386 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.683520 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.683669 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.683833 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.684025 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.684163 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.684296 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.684429 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.684560 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.684737 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.684884 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.685020 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.685155 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.685359 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.685517 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.685684 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.685830 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.685983 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.686118 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.686281 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.686412 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.686641 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.687549 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.687697 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.687835 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.688006 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.688167 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.688307 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.688455 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.688599 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.688743 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.688878 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.689019 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.689168 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.689318 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.689453 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.689586 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.689728 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.689860 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.690014 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.690155 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.690288 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.690419 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.690553 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.690696 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.690829 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.690961 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.691122 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.691256 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.691391 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.691535 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.691666 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.691809 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.691956 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.692086 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.692225 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.692375 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.692509 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.692650 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.692782 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.692915 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.693047 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.693190 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.693322 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.693458 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.693599 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.693740 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.693842 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.693923 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.694013 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.694093 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.694171 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.694249 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.694335 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.694422 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.694501 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.694633 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.694722 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.694932 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.695028 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.695228 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.695314 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.695534 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.695679 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.695832 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.696015 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.696155 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.696314 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.696457 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.696630 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.696757 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.696955 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.697055 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.697308 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.697385 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.697629 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.697726 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.697952 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.698027 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.698249 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.698337 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.698548 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.698643 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.699385 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.699472 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.699688 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.699774 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.700007 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.700112 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.700312 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.700439 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.700609 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.700701 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.700908 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.701004 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.701203 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.701304 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.701498 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.701593 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.701795 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.701884 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.702109 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.702196 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.702408 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.702494 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.702707 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.702793 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.703005 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.703090 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.703302 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.703387 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.703618 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.703705 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.703944 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.704038 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.704250 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.704351 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.704552 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.704639 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.704853 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.704941 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.705177 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.705271 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.705483 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.705569 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.705787 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.705873 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.706095 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.706191 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.706395 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.706490 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.706704 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.706791 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.707007 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.707106 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.707314 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.707400 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.707611 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.707698 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.707923 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.708026 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.708240 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.708326 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.708541 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.708674 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.708844 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.708933 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.709142 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.709228 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.709442 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.709530 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.709764 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.709852 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.710061 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.710147 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.710363 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.710457 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.710665 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.710757 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.710966 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.711061 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.711275 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.711398 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.711570 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.711656 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.711861 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.711976 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.712187 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.712295 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.712489 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.712585 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.712791 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.712888 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.713093 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.713201 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.713393 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.713491 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.713695 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.713792 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.713996 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.714104 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.714292 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.714423 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.715151 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.715247 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.715456 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.715564 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.715753 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.715874 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.716078 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.716177 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.716379 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.716475 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.716679 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.716775 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.716975 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.717079 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.717271 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.717400 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.717573 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.717704 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.717870 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.718008 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.718173 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.718305 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.718470 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.718609 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.718891 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.719031 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.719198 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.719331 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.719489 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.719634 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.719768 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.719960 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.720107 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.720202 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.720412 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.720499 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.720719 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.720816 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.721024 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.721111 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.721323 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.721466 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.721635 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.721732 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.721935 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.722023 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.722249 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.722336 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.722544 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.722640 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.722840 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.722926 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.723135 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.723222 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.723447 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.723541 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.723740 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.723834 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.724072 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.724170 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.724366 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.724469 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.724661 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.724756 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.724972 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.725059 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.725274 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.725443 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.725585 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.725748 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.725990 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.726084 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.726294 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.726383 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.726591 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.726681 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.726951 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.727052 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.727249 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.727335 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.727556 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.727643 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.727858 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.727983 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.728190 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.728296 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.728501 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.728601 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.728799 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.728888 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.729105 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.729201 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.729406 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.729492 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.729719 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.729808 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.730057 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.730161 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.730364 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.730451 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.730671 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.730799 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.730967 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.731064 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.731280 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.731376 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.731588 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.731745 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.731906 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.731999 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.732230 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.732327 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.732563 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.732658 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.732862 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.732951 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.733164 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.733253 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.733461 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.733557 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.733760 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.733849 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.734079 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.734196 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.734378 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.734480 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.734682 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.734781 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.734977 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.735079 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.735277 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.735386 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.735571 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.735677 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.735867 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.736064 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.736198 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.736292 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.736493 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.736595 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.736795 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.736890 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.737092 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.737190 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.737391 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.737480 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.737701 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.737787 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.737996 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.738091 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.738307 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.738394 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.738609 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.738697 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.738909 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.739017 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.739211 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.739300 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.739508 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.739604 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.739823 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.739938 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.740152 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.740248 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.740451 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.740538 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.740752 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.740842 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.741053 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.741143 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.741364 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.741458 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.741676 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.741768 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.741989 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.742080 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.742295 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.742396 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.742606 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.742695 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.742913 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.743003 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.743205 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.743311 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.743501 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.743589 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.743802 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.743917 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.744121 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.744241 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.744425 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.744532 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.744720 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.744809 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.745021 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.745110 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.745314 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.745401 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.745635 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.745726 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.745932 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.746030 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.746228 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.746324 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.746527 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.746613 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.746821 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.746915 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.747120 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.747208 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.747415 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.747508 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.747714 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.747814 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.748031 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.748121 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.748344 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.748441 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.748647 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.748734 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.748945 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.749080 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.749246 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.749389 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.749544 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.749633 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.749854 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.749940 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.750161 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.750294 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.750466 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.750553 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.750772 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.750866 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.751078 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.751182 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.751383 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.751471 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.751689 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.751821 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.752012 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.752112 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.752321 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.752407 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.752628 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.752714 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.752931 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.753026 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.753240 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.753479 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.753566 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.753798 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.753898 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.754106 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.754195 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.754413 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.754557 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.754718 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.754954 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.755042 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.755282 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.755369 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.755591 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.755686 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.755908 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.755997 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.756216 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.756310 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.756517 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.756617 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.756821 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.756908 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.757124 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.757211 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.757427 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.757593 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.757731 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.757828 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.758033 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.758120 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.758345 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.758433 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.758651 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.758738 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.758957 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.759051 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.759281 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.759376 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.759590 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.759677 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.759905 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.760045 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.760217 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.760308 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.760525 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.760620 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.760829 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.760924 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.761135 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.761734 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.761951 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.762056 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.762258 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.762355 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.762565 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.762654 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.762870 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.762965 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.763174 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.763262 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.763479 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.763565 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.763785 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.763871 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.764385 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.764476 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.764695 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.764783 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.765002 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.765089 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.765308 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.765397 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.765615 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.765702 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.765926 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.766075 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.766260 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.766434 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.766559 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.766741 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.766868 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.767064 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.767160 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.767381 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.767480 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.767729 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.767994 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.768100 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.768306 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.768396 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.768628 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.768715 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.768925 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.769015 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.769220 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.769316 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.769525 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.769620 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.769833 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.769923 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.770129 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.770217 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.770434 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.770520 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.770734 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.770823 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.771029 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.771116 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.771330 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.771419 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.771628 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.771717 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.771974 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.772180 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.772279 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.772524 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.772613 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.772836 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.772933 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.773155 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.773243 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.773473 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.773680 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.773788 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.774024 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.774113 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.774335 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.774432 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.774656 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.774793 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.774969 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.775066 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.775278 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.775374 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.775583 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.775669 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.775934 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.776025 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.776199 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.776290 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.776499 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.776663 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.776822 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.777017 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.777153 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.777249 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.777452 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.777555 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.777751 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.777854 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.778055 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.778145 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.778361 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.778450 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.778658 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.778753 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.778953 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.779042 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.779251 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.779338 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.779548 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.779644 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.779852 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.779971 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.780176 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.780273 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.780473 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.780575 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.780775 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.780863 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.781073 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.781162 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.781373 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.781484 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.781665 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.781753 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.781962 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.782064 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.782257 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.782363 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.782553 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.782641 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.782850 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.782950 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.783143 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.783232 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.783445 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.783534 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.783742 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.783830 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.784070 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.784176 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.784367 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.784456 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.784685 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.784788 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.784987 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.785096 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.785286 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.785381 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.785625 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.785713 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.785930 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.786019 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.786246 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.786467 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.786753 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.786856 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.787065 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.787152 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.787405 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.787494 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.787715 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.787816 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.788039 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.788292 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.788436 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.788624 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.788766 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.788925 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.789062 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.789234 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.789354 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.789534 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.789624 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.789843 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.789934 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.790146 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.790234 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.790445 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.790543 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.790746 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.790834 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.791051 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.791140 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.791355 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.791467 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.791657 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.791753 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.791979 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.792096 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.792283 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.792390 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.793099 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.793200 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.793401 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.793497 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.793703 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.793793 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.794008 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.794097 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.794312 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.794401 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.794616 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.794708 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.794920 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.795023 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.795228 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.795332 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.795533 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.795622 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.795835 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.795940 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.796162 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.796269 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.796464 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.796570 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.796765 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.796854 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.797070 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.797168 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.797392 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.797521 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.797700 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.797790 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.797998 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.798095 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.798315 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.798403 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.798618 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.798707 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.798926 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.799023 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.799249 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.799347 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.799558 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.799647 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.799858 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.800003 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.800215 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.800304 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.800520 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.800611 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.800836 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.800933 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.801141 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.801229 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.801460 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.801585 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.801780 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.801869 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.802096 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.802184 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.802403 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.802503 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.802702 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.802790 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.802999 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.803110 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.803300 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.803410 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.803598 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.803688 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.803929 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.804034 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.804236 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.804339 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.804534 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.804624 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.804830 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.804927 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.805125 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.805273 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.805425 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.805543 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.805724 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.805825 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.806020 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.806119 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.806317 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.806412 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.806614 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.806723 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.806907 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.807004 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.807202 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.807307 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.807495 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.807597 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.807791 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.807908 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.808171 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.808269 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.808476 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.808582 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.808770 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.808875 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.809065 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.809160 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.809358 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.809462 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.809654 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.809749 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.809951 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.810058 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.810244 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.810349 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.810545 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.810642 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.810843 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.810939 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.811142 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.811260 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.811438 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.811535 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.811735 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.811838 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.812056 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.812161 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.812370 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.812473 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.812684 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.812782 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.812989 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.813127 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.813295 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.813439 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.813595 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.813682 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.813908 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.814005 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.814210 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.814296 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.814516 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.814613 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.814823 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.814918 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.815128 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.815388 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.815483 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.815619 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.815720 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.815803 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.816045 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.816136 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.816374 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.816490 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.816680 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.816783 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.816957 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.817052 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.817260 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.817358 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.817564 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.817651 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.817872 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.817966 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.818179 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.818268 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.818475 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.818569 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.818790 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.818890 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.819142 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.819238 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.819398 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.819487 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.819701 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.819788 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.820027 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.820118 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.820342 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.820428 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.820645 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.820743 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.820948 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.821035 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.821252 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.821340 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.821557 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.821654 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.821861 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.821949 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.822169 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.822257 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.822470 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.822638 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.822773 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.822868 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.823083 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.823171 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.823393 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.823523 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.824241 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.824339 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.824563 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.824662 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.824869 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.824959 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.825184 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.825269 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.825493 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.825593 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.825790 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.825890 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.826030 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 00:57:51.826118 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.826444 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.826777 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.827086 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.827393 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.827693 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:57:51.827954 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 00:57:51.979041 n-d-master-1 devstack@n-api.service[104130]: INFO dbcounter [None req-995466cb-1a5c-4ffc-ad63-f4d39c9b507e None None] Registered counter for database nova_api Aug 07 00:57:51.983398 n-d-master-1 devstack@n-api.service[104131]: INFO dbcounter [None req-2ce5bed0-498b-494b-b4d9-ca5f4f13ed37 None None] Registered counter for database nova_api Aug 07 00:57:52.000059 n-d-master-1 devstack@n-api.service[104130]: DEBUG oslo_db.sqlalchemy.engines [None req-995466cb-1a5c-4ffc-ad63-f4d39c9b507e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104130) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 00:57:52.003132 n-d-master-1 devstack@n-api.service[104131]: DEBUG oslo_db.sqlalchemy.engines [None req-2ce5bed0-498b-494b-b4d9-ca5f4f13ed37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104131) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 00:57:52.006580 n-d-master-1 devstack@n-api.service[104130]: DEBUG dbcounter [-] [104130] Writer thread running {{(pid=104130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 00:57:52.009787 n-d-master-1 devstack@n-api.service[104131]: DEBUG dbcounter [-] [104131] Writer thread running {{(pid=104131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 00:57:52.063152 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.context [None req-995466cb-1a5c-4ffc-ad63-f4d39c9b507e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),946acc3b-7b72-45d6-9151-44f3ad85fe4f(cell1) {{(pid=104130) load_cells /opt/stack/nova/nova/context.py:464}} Aug 07 00:57:52.066711 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.context [None req-2ce5bed0-498b-494b-b4d9-ca5f4f13ed37 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),946acc3b-7b72-45d6-9151-44f3ad85fe4f(cell1) {{(pid=104131) load_cells /opt/stack/nova/nova/context.py:464}} Aug 07 00:57:52.067074 n-d-master-1 devstack@n-api.service[104130]: DEBUG oslo_concurrency.lockutils [None req-995466cb-1a5c-4ffc-ad63-f4d39c9b507e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 00:57:52.067547 n-d-master-1 devstack@n-api.service[104130]: DEBUG oslo_concurrency.lockutils [None req-995466cb-1a5c-4ffc-ad63-f4d39c9b507e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 00:57:52.069107 n-d-master-1 devstack@n-api.service[104130]: DEBUG oslo_concurrency.lockutils [None req-995466cb-1a5c-4ffc-ad63-f4d39c9b507e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 00:57:52.069889 n-d-master-1 devstack@n-api.service[104130]: DEBUG oslo_concurrency.lockutils [None req-995466cb-1a5c-4ffc-ad63-f4d39c9b507e None None] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 00:57:52.070271 n-d-master-1 devstack@n-api.service[104130]: DEBUG oslo_concurrency.lockutils [None req-995466cb-1a5c-4ffc-ad63-f4d39c9b507e None None] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 00:57:52.070608 n-d-master-1 devstack@n-api.service[104131]: DEBUG oslo_concurrency.lockutils [None req-2ce5bed0-498b-494b-b4d9-ca5f4f13ed37 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 00:57:52.071087 n-d-master-1 devstack@n-api.service[104131]: DEBUG oslo_concurrency.lockutils [None req-2ce5bed0-498b-494b-b4d9-ca5f4f13ed37 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 00:57:52.072256 n-d-master-1 devstack@n-api.service[104130]: DEBUG oslo_concurrency.lockutils [None req-995466cb-1a5c-4ffc-ad63-f4d39c9b507e None None] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 00:57:52.072656 n-d-master-1 devstack@n-api.service[104131]: DEBUG oslo_concurrency.lockutils [None req-2ce5bed0-498b-494b-b4d9-ca5f4f13ed37 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 00:57:52.073389 n-d-master-1 devstack@n-api.service[104131]: DEBUG oslo_concurrency.lockutils [None req-2ce5bed0-498b-494b-b4d9-ca5f4f13ed37 None None] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 00:57:52.073896 n-d-master-1 devstack@n-api.service[104131]: DEBUG oslo_concurrency.lockutils [None req-2ce5bed0-498b-494b-b4d9-ca5f4f13ed37 None None] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 00:57:52.074265 n-d-master-1 devstack@n-api.service[104130]: INFO dbcounter [None req-995466cb-1a5c-4ffc-ad63-f4d39c9b507e None None] Registered counter for database nova_cell0 Aug 07 00:57:52.075865 n-d-master-1 devstack@n-api.service[104131]: DEBUG oslo_concurrency.lockutils [None req-2ce5bed0-498b-494b-b4d9-ca5f4f13ed37 None None] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 00:57:52.077897 n-d-master-1 devstack@n-api.service[104131]: INFO dbcounter [None req-2ce5bed0-498b-494b-b4d9-ca5f4f13ed37 None None] Registered counter for database nova_cell0 Aug 07 00:57:52.079713 n-d-master-1 devstack@n-api.service[104130]: INFO dbcounter [None req-995466cb-1a5c-4ffc-ad63-f4d39c9b507e None None] Registered counter for database nova_cell1 Aug 07 00:57:52.083391 n-d-master-1 devstack@n-api.service[104131]: INFO dbcounter [None req-2ce5bed0-498b-494b-b4d9-ca5f4f13ed37 None None] Registered counter for database nova_cell1 Aug 07 00:57:52.088900 n-d-master-1 devstack@n-api.service[104130]: DEBUG oslo_db.sqlalchemy.engines [None req-995466cb-1a5c-4ffc-ad63-f4d39c9b507e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104130) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 00:57:52.091178 n-d-master-1 devstack@n-api.service[104130]: DEBUG oslo_db.sqlalchemy.engines [None req-995466cb-1a5c-4ffc-ad63-f4d39c9b507e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104130) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 00:57:52.091312 n-d-master-1 devstack@n-api.service[104131]: DEBUG oslo_db.sqlalchemy.engines [None req-2ce5bed0-498b-494b-b4d9-ca5f4f13ed37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104131) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 00:57:52.095188 n-d-master-1 devstack@n-api.service[104131]: DEBUG oslo_db.sqlalchemy.engines [None req-2ce5bed0-498b-494b-b4d9-ca5f4f13ed37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104131) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 00:57:52.096785 n-d-master-1 devstack@n-api.service[104131]: DEBUG dbcounter [-] [104131] Writer thread running {{(pid=104131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 00:57:52.097366 n-d-master-1 devstack@n-api.service[104130]: DEBUG dbcounter [-] [104130] Writer thread running {{(pid=104130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 00:57:52.099567 n-d-master-1 devstack@n-api.service[104130]: DEBUG dbcounter [-] [104130] Writer thread running {{(pid=104130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 00:57:52.238459 n-d-master-1 devstack@n-api.service[104131]: DEBUG dbcounter [-] [104131] Writer thread running {{(pid=104131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 00:57:52.243638 n-d-master-1 devstack@n-api.service[104130]: INFO dbcounter [None req-995466cb-1a5c-4ffc-ad63-f4d39c9b507e None None] Registered counter for database nova_cell0 Aug 07 00:57:52.247303 n-d-master-1 devstack@n-api.service[104131]: INFO dbcounter [None req-2ce5bed0-498b-494b-b4d9-ca5f4f13ed37 None None] Registered counter for database nova_cell0 Aug 07 00:57:52.253069 n-d-master-1 devstack@n-api.service[104130]: DEBUG oslo_db.sqlalchemy.engines [None req-995466cb-1a5c-4ffc-ad63-f4d39c9b507e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104130) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 00:57:52.256902 n-d-master-1 devstack@n-api.service[104131]: DEBUG oslo_db.sqlalchemy.engines [None req-2ce5bed0-498b-494b-b4d9-ca5f4f13ed37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104131) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 00:57:52.257668 n-d-master-1 devstack@n-api.service[104130]: DEBUG dbcounter [-] [104130] Writer thread running {{(pid=104130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 00:57:52.263762 n-d-master-1 devstack@n-api.service[104131]: DEBUG dbcounter [-] [104131] Writer thread running {{(pid=104131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 00:57:52.592164 n-d-master-1 devstack@n-api.service[104130]: WARNING keystonemiddleware.auth_token [None req-995466cb-1a5c-4ffc-ad63-f4d39c9b507e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 00:57:52.599361 n-d-master-1 devstack@n-api.service[104130]: WARNING keystonemiddleware.auth_token [None req-995466cb-1a5c-4ffc-ad63-f4d39c9b507e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 00:57:52.600128 n-d-master-1 devstack@n-api.service[104131]: WARNING keystonemiddleware.auth_token [None req-2ce5bed0-498b-494b-b4d9-ca5f4f13ed37 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 00:57:52.607954 n-d-master-1 devstack@n-api.service[104131]: WARNING keystonemiddleware.auth_token [None req-2ce5bed0-498b-494b-b4d9-ca5f4f13ed37 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 00:57:52.938608 n-d-master-1 devstack@n-api.service[104130]: WARNING keystonemiddleware.auth_token [None req-995466cb-1a5c-4ffc-ad63-f4d39c9b507e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 00:57:52.944480 n-d-master-1 devstack@n-api.service[104130]: WARNING keystonemiddleware.auth_token [None req-995466cb-1a5c-4ffc-ad63-f4d39c9b507e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 00:57:52.949192 n-d-master-1 devstack@n-api.service[104131]: WARNING keystonemiddleware.auth_token [None req-2ce5bed0-498b-494b-b4d9-ca5f4f13ed37 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 00:57:52.949728 n-d-master-1 devstack@n-api.service[104130]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5646ba4f89c0 pid: 104130 (default app) Aug 07 00:57:52.951792 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-995466cb-1a5c-4ffc-ad63-f4d39c9b507e None None] Calling method '>' {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 00:57:52.952992 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.requestlog [None req-995466cb-1a5c-4ffc-ad63-f4d39c9b507e None None] 10.222.0.39 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001758 Aug 07 00:57:52.953406 n-d-master-1 devstack@n-api.service[104130]: [pid: 104130|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 788 bytes} [Sun Aug 7 00:57:52 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 00:57:52.955128 n-d-master-1 devstack@n-api.service[104131]: WARNING keystonemiddleware.auth_token [None req-2ce5bed0-498b-494b-b4d9-ca5f4f13ed37 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 00:57:52.960410 n-d-master-1 devstack@n-api.service[104131]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5646ba4f89c0 pid: 104131 (default app) Aug 07 00:59:15.811043 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-995466cb-1a5c-4ffc-ad63-f4d39c9b507e None None] Calling method '>' {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 00:59:15.813888 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.requestlog [None req-995466cb-1a5c-4ffc-ad63-f4d39c9b507e None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003744 Aug 07 00:59:15.822144 n-d-master-1 devstack@n-api.service[104130]: [pid: 104130|app: 0|req: 2/2] 10.222.0.39 () {54 vars in 931 bytes} [Sun Aug 7 00:59:15 2022] GET /compute/v2.1 => generated 388 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 00:59:15.835859 n-d-master-1 devstack@n-api.service[104131]: DEBUG dbcounter [-] [104131] Writing DB stats nova_api:SELECT=3 {{(pid=104131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:15.838450 n-d-master-1 devstack@n-api.service[104131]: DEBUG dbcounter [-] [104131] Writing DB stats nova_cell0:SELECT=3 {{(pid=104131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:15.839837 n-d-master-1 devstack@n-api.service[104131]: DEBUG dbcounter [-] [104131] Writing DB stats nova_cell1:SELECT=3 {{(pid=104131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:15.841413 n-d-master-1 devstack@n-api.service[104131]: DEBUG dbcounter [-] [104131] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:17.352576 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-71884493-0c30-4c9d-b734-461d4d2d9a9a admin admin] Calling method '>' {{(pid=104131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 00:59:17.389648 n-d-master-1 devstack@n-api.service[104131]: INFO nova.api.openstack.requestlog [None req-71884493-0c30-4c9d-b734-461d4d2d9a9a admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.562670 Aug 07 00:59:17.390676 n-d-master-1 devstack@n-api.service[104131]: [pid: 104131|app: 0|req: 1/3] 10.222.0.39 () {60 vars in 1292 bytes} [Sun Aug 7 00:59:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 00:59:20.344128 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-995466cb-1a5c-4ffc-ad63-f4d39c9b507e None None] Calling method '>' {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 00:59:20.345327 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.requestlog [None req-995466cb-1a5c-4ffc-ad63-f4d39c9b507e None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001700 Aug 07 00:59:20.346067 n-d-master-1 devstack@n-api.service[104130]: [pid: 104130|app: 0|req: 3/4] 10.222.0.39 () {54 vars in 931 bytes} [Sun Aug 7 00:59:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 00:59:21.201734 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-2263fd87-8986-4751-a7c0-2c1bd3950971 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "vcpus": 1, "name": "cirros256", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "disk": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=104131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 00:59:21.233218 n-d-master-1 devstack@n-api.service[104131]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 00:59:21.233218 n-d-master-1 devstack@n-api.service[104131]: warnings.warn(msg) Aug 07 00:59:21.279224 n-d-master-1 devstack@n-api.service[104131]: INFO nova.api.openstack.requestlog [None req-2263fd87-8986-4751-a7c0-2c1bd3950971 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.921680 Aug 07 00:59:21.280313 n-d-master-1 devstack@n-api.service[104131]: [pid: 104131|app: 0|req: 2/5] 10.222.0.39 () {64 vars in 1283 bytes} [Sun Aug 7 00:59:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 00:59:21.302215 n-d-master-1 devstack@n-api.service[104130]: DEBUG dbcounter [-] [104130] Writing DB stats nova_api:SELECT=3 {{(pid=104130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:21.303578 n-d-master-1 devstack@n-api.service[104130]: DEBUG dbcounter [-] [104130] Writing DB stats nova_cell0:SELECT=3 {{(pid=104130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:21.305979 n-d-master-1 devstack@n-api.service[104130]: DEBUG dbcounter [-] [104130] Writing DB stats nova_cell1:SELECT=3 {{(pid=104130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:21.307992 n-d-master-1 devstack@n-api.service[104130]: DEBUG dbcounter [-] [104130] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:21.672319 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-b7d0f495-0ae5-4423-9a6d-9422cd51541f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 00:59:21.680425 n-d-master-1 devstack@n-api.service[104130]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 00:59:21.680425 n-d-master-1 devstack@n-api.service[104130]: warnings.warn(msg) Aug 07 00:59:21.776509 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.requestlog [None req-b7d0f495-0ae5-4423-9a6d-9422cd51541f admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.484017 Aug 07 00:59:21.777485 n-d-master-1 devstack@n-api.service[104130]: [pid: 104130|app: 0|req: 4/6] 10.222.0.39 () {64 vars in 1336 bytes} [Sun Aug 7 00:59:21 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 00:59:25.067159 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-2263fd87-8986-4751-a7c0-2c1bd3950971 admin admin] Calling method '>' {{(pid=104131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 00:59:25.069240 n-d-master-1 devstack@n-api.service[104131]: INFO nova.api.openstack.requestlog [None req-2263fd87-8986-4751-a7c0-2c1bd3950971 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002682 Aug 07 00:59:25.070470 n-d-master-1 devstack@n-api.service[104131]: [pid: 104131|app: 0|req: 3/7] 10.222.0.39 () {54 vars in 931 bytes} [Sun Aug 7 00:59:25 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 00:59:26.348581 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-ed27e088-7bdf-4f1d-9a00-126e8b743a1e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds512M", "ram": 512, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 5}} {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 00:59:26.374398 n-d-master-1 devstack@n-api.service[104130]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 00:59:26.374398 n-d-master-1 devstack@n-api.service[104130]: warnings.warn(msg) Aug 07 00:59:26.413063 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.requestlog [None req-ed27e088-7bdf-4f1d-9a00-126e8b743a1e admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.333796 Aug 07 00:59:26.414258 n-d-master-1 devstack@n-api.service[104130]: [pid: 104130|app: 0|req: 5/8] 10.222.0.39 () {64 vars in 1283 bytes} [Sun Aug 7 00:59:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 00:59:26.447539 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-82366b17-b745-4807-a14f-6bd88e78b0a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 00:59:26.453278 n-d-master-1 devstack@n-api.service[104131]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 00:59:26.453278 n-d-master-1 devstack@n-api.service[104131]: warnings.warn(msg) Aug 07 00:59:26.523865 n-d-master-1 devstack@n-api.service[104131]: INFO nova.api.openstack.requestlog [None req-82366b17-b745-4807-a14f-6bd88e78b0a0 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092004 Aug 07 00:59:26.525267 n-d-master-1 devstack@n-api.service[104131]: [pid: 104131|app: 0|req: 4/9] 10.222.0.39 () {64 vars in 1336 bytes} [Sun Aug 7 00:59:26 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 00:59:30.470673 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-ed27e088-7bdf-4f1d-9a00-126e8b743a1e admin admin] Calling method '>' {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 00:59:30.473298 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.requestlog [None req-ed27e088-7bdf-4f1d-9a00-126e8b743a1e admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003295 Aug 07 00:59:30.482415 n-d-master-1 devstack@n-api.service[104130]: [pid: 104130|app: 0|req: 6/10] 10.222.0.39 () {54 vars in 931 bytes} [Sun Aug 7 00:59:30 2022] GET /compute/v2.1 => generated 388 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 00:59:31.295804 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-09f19e31-1825-4c80-a0b0-e3e2f5c8551a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "disk": 10, "swap": 0, "name": "ds1G", "id": "d2", "ram": 1024, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 00:59:31.353941 n-d-master-1 devstack@n-api.service[104131]: INFO nova.api.openstack.requestlog [None req-09f19e31-1825-4c80-a0b0-e3e2f5c8551a admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.866997 Aug 07 00:59:31.363501 n-d-master-1 devstack@n-api.service[104131]: [pid: 104131|app: 0|req: 5/11] 10.222.0.39 () {64 vars in 1283 bytes} [Sun Aug 7 00:59:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 00:59:31.378508 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-30bbfd56-cdd8-463f-8a64-1073c122e1f8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 00:59:31.425709 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.requestlog [None req-30bbfd56-cdd8-463f-8a64-1073c122e1f8 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.053507 Aug 07 00:59:31.426827 n-d-master-1 devstack@n-api.service[104130]: [pid: 104130|app: 0|req: 7/12] 10.222.0.39 () {64 vars in 1336 bytes} [Sun Aug 7 00:59:31 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 00:59:35.020327 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-09f19e31-1825-4c80-a0b0-e3e2f5c8551a admin admin] Calling method '>' {{(pid=104131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 00:59:35.021935 n-d-master-1 devstack@n-api.service[104131]: INFO nova.api.openstack.requestlog [None req-09f19e31-1825-4c80-a0b0-e3e2f5c8551a admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002407 Aug 07 00:59:35.023055 n-d-master-1 devstack@n-api.service[104131]: [pid: 104131|app: 0|req: 6/13] 10.222.0.39 () {54 vars in 931 bytes} [Sun Aug 7 00:59:35 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 00:59:36.122306 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-0e40c9b5-e43b-4847-8246-f3d44758c3b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "swap": 0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3"}} {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 00:59:36.158495 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.requestlog [None req-0e40c9b5-e43b-4847-8246-f3d44758c3b4 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.124589 Aug 07 00:59:36.159625 n-d-master-1 devstack@n-api.service[104130]: [pid: 104130|app: 0|req: 8/14] 10.222.0.39 () {64 vars in 1283 bytes} [Sun Aug 7 00:59:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 00:59:36.182840 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-f21ea4da-1172-4848-a867-29d6b1a38e43 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 00:59:36.231300 n-d-master-1 devstack@n-api.service[104131]: INFO nova.api.openstack.requestlog [None req-f21ea4da-1172-4848-a867-29d6b1a38e43 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.057127 Aug 07 00:59:36.234212 n-d-master-1 devstack@n-api.service[104131]: [pid: 104131|app: 0|req: 7/15] 10.222.0.39 () {64 vars in 1336 bytes} [Sun Aug 7 00:59:36 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 00:59:39.414139 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-0e40c9b5-e43b-4847-8246-f3d44758c3b4 admin admin] Calling method '>' {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 00:59:39.416299 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.requestlog [None req-0e40c9b5-e43b-4847-8246-f3d44758c3b4 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002850 Aug 07 00:59:39.416853 n-d-master-1 devstack@n-api.service[104130]: [pid: 104130|app: 0|req: 9/16] 10.222.0.39 () {54 vars in 931 bytes} [Sun Aug 7 00:59:39 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 00:59:40.128364 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-db7ca503-8db1-48e5-9d7b-14f08c8cfabd admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "rxtx_factor": 1.0, "id": "d4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "disk": 20, "os-flavor-access:is_public": true, "name": "ds4G"}} {{(pid=104131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 00:59:40.157202 n-d-master-1 devstack@n-api.service[104131]: INFO nova.api.openstack.requestlog [None req-db7ca503-8db1-48e5-9d7b-14f08c8cfabd admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.732355 Aug 07 00:59:40.158283 n-d-master-1 devstack@n-api.service[104131]: [pid: 104131|app: 0|req: 8/17] 10.222.0.39 () {64 vars in 1283 bytes} [Sun Aug 7 00:59:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 00:59:40.181964 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-411bcdb1-d820-4819-8f69-727de4050e80 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 00:59:40.250202 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.requestlog [None req-411bcdb1-d820-4819-8f69-727de4050e80 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.076328 Aug 07 00:59:40.250805 n-d-master-1 devstack@n-api.service[104130]: [pid: 104130|app: 0|req: 10/18] 10.222.0.39 () {64 vars in 1336 bytes} [Sun Aug 7 00:59:40 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 00:59:43.222076 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-db7ca503-8db1-48e5-9d7b-14f08c8cfabd admin admin] Calling method '>' {{(pid=104131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 00:59:43.223966 n-d-master-1 devstack@n-api.service[104131]: INFO nova.api.openstack.requestlog [None req-db7ca503-8db1-48e5-9d7b-14f08c8cfabd admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002205 Aug 07 00:59:43.237341 n-d-master-1 devstack@n-api.service[104131]: [pid: 104131|app: 0|req: 9/19] 10.222.0.39 () {54 vars in 931 bytes} [Sun Aug 7 00:59:43 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 00:59:43.817555 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-bd157486-06fd-4ffb-bde5-59434486c4cb admin admin] Calling method '>' {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 00:59:43.845495 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.requestlog [None req-bd157486-06fd-4ffb-bde5-59434486c4cb admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.613120 Aug 07 00:59:43.856350 n-d-master-1 devstack@n-api.service[104130]: [pid: 104130|app: 0|req: 11/20] 10.222.0.39 () {60 vars in 1292 bytes} [Sun Aug 7 00:59:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 00:59:46.757345 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-db7ca503-8db1-48e5-9d7b-14f08c8cfabd admin admin] Calling method '>' {{(pid=104131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 00:59:46.758366 n-d-master-1 devstack@n-api.service[104131]: INFO nova.api.openstack.requestlog [None req-db7ca503-8db1-48e5-9d7b-14f08c8cfabd admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 07 00:59:46.758806 n-d-master-1 devstack@n-api.service[104131]: [pid: 104131|app: 0|req: 10/21] 10.222.0.39 () {54 vars in 931 bytes} [Sun Aug 7 00:59:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 00:59:47.454530 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-224e888a-092f-40ae-8a1e-825d3ce2cdcd admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "id": "1", "name": "m1.tiny", "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 00:59:47.483743 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.requestlog [None req-224e888a-092f-40ae-8a1e-825d3ce2cdcd admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.716167 Aug 07 00:59:47.484737 n-d-master-1 devstack@n-api.service[104130]: [pid: 104130|app: 0|req: 12/22] 10.222.0.39 () {64 vars in 1283 bytes} [Sun Aug 7 00:59:46 2022] POST /compute/v2.1/flavors => generated 402 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 00:59:47.509032 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-a006e405-1ae5-4817-bc65-0da758898735 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 00:59:47.521250 n-d-master-1 devstack@n-api.service[104131]: DEBUG dbcounter [-] [104131] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=5,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=104131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:47.575441 n-d-master-1 devstack@n-api.service[104131]: INFO nova.api.openstack.requestlog [None req-a006e405-1ae5-4817-bc65-0da758898735 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.076020 Aug 07 00:59:47.577024 n-d-master-1 devstack@n-api.service[104131]: [pid: 104131|app: 0|req: 11/23] 10.222.0.39 () {64 vars in 1333 bytes} [Sun Aug 7 00:59:47 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 00:59:50.341726 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-224e888a-092f-40ae-8a1e-825d3ce2cdcd admin admin] Calling method '>' {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 00:59:50.342796 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.requestlog [None req-224e888a-092f-40ae-8a1e-825d3ce2cdcd admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 07 00:59:50.343369 n-d-master-1 devstack@n-api.service[104130]: [pid: 104130|app: 0|req: 13/24] 10.222.0.39 () {54 vars in 931 bytes} [Sun Aug 7 00:59:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 00:59:50.871216 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-122c88e4-8438-46aa-9e4d-eff3ba644bc0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "name": "m1.small", "vcpus": 1, "ram": 2048, "os-flavor-access:is_public": true, "swap": 0, "disk": 20}} {{(pid=104131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 00:59:50.898580 n-d-master-1 devstack@n-api.service[104131]: INFO nova.api.openstack.requestlog [None req-122c88e4-8438-46aa-9e4d-eff3ba644bc0 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.547059 Aug 07 00:59:50.901088 n-d-master-1 devstack@n-api.service[104131]: [pid: 104131|app: 0|req: 12/25] 10.222.0.39 () {64 vars in 1283 bytes} [Sun Aug 7 00:59:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 00:59:50.914120 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-7dc6cec0-019a-4699-9006-b1c0d536216b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 00:59:50.947480 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.requestlog [None req-7dc6cec0-019a-4699-9006-b1c0d536216b admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036010 Aug 07 00:59:50.949355 n-d-master-1 devstack@n-api.service[104130]: [pid: 104130|app: 0|req: 14/26] 10.222.0.39 () {64 vars in 1333 bytes} [Sun Aug 7 00:59:50 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 00:59:53.347169 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-122c88e4-8438-46aa-9e4d-eff3ba644bc0 admin admin] Calling method '>' {{(pid=104131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 00:59:53.348746 n-d-master-1 devstack@n-api.service[104131]: INFO nova.api.openstack.requestlog [None req-122c88e4-8438-46aa-9e4d-eff3ba644bc0 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002115 Aug 07 00:59:53.349637 n-d-master-1 devstack@n-api.service[104131]: [pid: 104131|app: 0|req: 13/27] 10.222.0.39 () {54 vars in 931 bytes} [Sun Aug 7 00:59:53 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 00:59:53.822718 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-a9ffbc43-4687-4b04-b003-6b9b7a273a6c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "id": "3", "ram": 4096, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "swap": 0, "name": "m1.medium"}} {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 00:59:53.829739 n-d-master-1 devstack@n-api.service[104130]: DEBUG dbcounter [-] [104130] Writing DB stats nova_api:SELECT=36,nova_api:SAVEPOINT=4,nova_api:INSERT=7,nova_api:RELEASE=4 {{(pid=104130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:53.849580 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.requestlog [None req-a9ffbc43-4687-4b04-b003-6b9b7a273a6c admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.492886 Aug 07 00:59:53.850146 n-d-master-1 devstack@n-api.service[104130]: [pid: 104130|app: 0|req: 15/28] 10.222.0.39 () {64 vars in 1283 bytes} [Sun Aug 7 00:59:53 2022] POST /compute/v2.1/flavors => generated 406 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 00:59:53.863391 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-282d4687-04f0-4dce-a041-a888058122ba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 00:59:53.895035 n-d-master-1 devstack@n-api.service[104131]: INFO nova.api.openstack.requestlog [None req-282d4687-04f0-4dce-a041-a888058122ba admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035056 Aug 07 00:59:53.896181 n-d-master-1 devstack@n-api.service[104131]: [pid: 104131|app: 0|req: 14/29] 10.222.0.39 () {64 vars in 1333 bytes} [Sun Aug 7 00:59:53 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 00:59:56.398676 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-a9ffbc43-4687-4b04-b003-6b9b7a273a6c admin admin] Calling method '>' {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 00:59:56.400352 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.requestlog [None req-a9ffbc43-4687-4b04-b003-6b9b7a273a6c admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 07 00:59:56.400757 n-d-master-1 devstack@n-api.service[104130]: [pid: 104130|app: 0|req: 16/30] 10.222.0.39 () {54 vars in 931 bytes} [Sun Aug 7 00:59:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 00:59:56.912831 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-d21abe06-7710-4e09-aef4-ec4f704419f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "ram": 8192, "name": "m1.large", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "id": "4", "swap": 0}} {{(pid=104131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 00:59:56.937237 n-d-master-1 devstack@n-api.service[104131]: INFO nova.api.openstack.requestlog [None req-d21abe06-7710-4e09-aef4-ec4f704419f1 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.529934 Aug 07 00:59:56.937711 n-d-master-1 devstack@n-api.service[104131]: [pid: 104131|app: 0|req: 15/31] 10.222.0.39 () {64 vars in 1283 bytes} [Sun Aug 7 00:59:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 00:59:56.950867 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-71633a32-3986-4ee7-b3ec-bd6782702420 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 00:59:56.995583 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.requestlog [None req-71633a32-3986-4ee7-b3ec-bd6782702420 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049145 Aug 07 00:59:56.996814 n-d-master-1 devstack@n-api.service[104130]: [pid: 104130|app: 0|req: 17/32] 10.222.0.39 () {64 vars in 1333 bytes} [Sun Aug 7 00:59:56 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 00:59:59.721078 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-d21abe06-7710-4e09-aef4-ec4f704419f1 admin admin] Calling method '>' {{(pid=104131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 00:59:59.722743 n-d-master-1 devstack@n-api.service[104131]: INFO nova.api.openstack.requestlog [None req-d21abe06-7710-4e09-aef4-ec4f704419f1 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002109 Aug 07 00:59:59.728256 n-d-master-1 devstack@n-api.service[104131]: [pid: 104131|app: 0|req: 16/33] 10.222.0.39 () {54 vars in 931 bytes} [Sun Aug 7 00:59:59 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:00:00.416116 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-8705a183-e4cf-436f-91c6-d5518cbf37f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 16384, "name": "m1.xlarge", "vcpus": 8, "swap": 0, "os-flavor-access:is_public": true, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5"}} {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:00:00.443607 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.requestlog [None req-8705a183-e4cf-436f-91c6-d5518cbf37f2 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.713232 Aug 07 01:00:00.456401 n-d-master-1 devstack@n-api.service[104130]: [pid: 104130|app: 0|req: 18/34] 10.222.0.39 () {64 vars in 1283 bytes} [Sun Aug 7 00:59:59 2022] POST /compute/v2.1/flavors => generated 408 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 01:00:00.465504 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-c23a3eb4-3545-4e3b-8388-7c2630428196 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:00:00.501721 n-d-master-1 devstack@n-api.service[104131]: INFO nova.api.openstack.requestlog [None req-c23a3eb4-3545-4e3b-8388-7c2630428196 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041744 Aug 07 01:00:00.502520 n-d-master-1 devstack@n-api.service[104131]: [pid: 104131|app: 0|req: 17/35] 10.222.0.39 () {64 vars in 1333 bytes} [Sun Aug 7 01:00:00 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:00:25.288012 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-8705a183-e4cf-436f-91c6-d5518cbf37f2 admin admin] Calling method '>' {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:00:25.289063 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.requestlog [None req-8705a183-e4cf-436f-91c6-d5518cbf37f2 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Aug 07 01:00:25.289460 n-d-master-1 devstack@n-api.service[104130]: [pid: 104130|app: 0|req: 19/36] 10.222.0.39 () {54 vars in 931 bytes} [Sun Aug 7 01:00:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:00:25.300854 n-d-master-1 devstack@n-api.service[104131]: DEBUG dbcounter [-] [104131] Writing DB stats nova_api:SELECT=23,nova_api:SAVEPOINT=3,nova_api:INSERT=5,nova_api:RELEASE=3 {{(pid=104131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:25.703718 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-232844b1-91b3-4dec-8c82-eb2378978c1b admin admin] Calling method '>' {{(pid=104131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:00:25.722222 n-d-master-1 devstack@n-api.service[104131]: INFO nova.api.openstack.requestlog [None req-232844b1-91b3-4dec-8c82-eb2378978c1b admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.425649 Aug 07 01:00:25.722700 n-d-master-1 devstack@n-api.service[104131]: [pid: 104131|app: 0|req: 18/37] 10.222.0.39 () {60 vars in 1292 bytes} [Sun Aug 7 01:00:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:00:26.858191 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-8705a183-e4cf-436f-91c6-d5518cbf37f2 admin admin] Calling method '>' {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:00:26.859204 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.requestlog [None req-8705a183-e4cf-436f-91c6-d5518cbf37f2 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 07 01:00:26.859630 n-d-master-1 devstack@n-api.service[104130]: [pid: 104130|app: 0|req: 20/38] 10.222.0.39 () {56 vars in 1074 bytes} [Sun Aug 7 01:00:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:00:27.464480 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-802946bc-0342-45e2-bf80-f48e22241d6a admin admin] Calling method '>' {{(pid=104131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:00:27.470188 n-d-master-1 devstack@n-api.service[104131]: INFO nova.api.openstack.wsgi [None req-802946bc-0342-45e2-bf80-f48e22241d6a admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 07 01:00:27.473483 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-802946bc-0342-45e2-bf80-f48e22241d6a admin admin] Request method failure captured: Aug 07 01:00:27.473483 n-d-master-1 devstack@n-api.service[104131]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 07 01:00:27.473483 n-d-master-1 devstack@n-api.service[104131]: Accept: application/json Aug 07 01:00:27.473483 n-d-master-1 devstack@n-api.service[104131]: Accept-Encoding: gzip, deflate Aug 07 01:00:27.473483 n-d-master-1 devstack@n-api.service[104131]: Connection: keep-alive Aug 07 01:00:27.473483 n-d-master-1 devstack@n-api.service[104131]: Content-Length: 0 Aug 07 01:00:27.473483 n-d-master-1 devstack@n-api.service[104131]: Host: 10.222.0.39 Aug 07 01:00:27.473483 n-d-master-1 devstack@n-api.service[104131]: Openstack-Api-Version: compute 2.90 Aug 07 01:00:27.473483 n-d-master-1 devstack@n-api.service[104131]: Openstack-System-Scope: None Aug 07 01:00:27.473483 n-d-master-1 devstack@n-api.service[104131]: User-Agent: python-novaclient Aug 07 01:00:27.473483 n-d-master-1 devstack@n-api.service[104131]: X-Auth-Token: gAAAAABi7w6qK2cBS30TtREyFTA3KG3skjxCDlAOrJPCPR9z71155nhsNIFTIPqSBJcni9EyglQCIe-IDTG0s8RUlQ_UKMxEtNgbY6x6bj2u2eVKb8HTKIVeyzdvpmzNFPePfNI54FRiFHnVx7UBIHplYQBgccyVWmuKStMgKQCCg8UZ2ysaapE Aug 07 01:00:27.473483 n-d-master-1 devstack@n-api.service[104131]: X-Domain-Id: None Aug 07 01:00:27.473483 n-d-master-1 devstack@n-api.service[104131]: X-Domain-Name: None Aug 07 01:00:27.473483 n-d-master-1 devstack@n-api.service[104131]: X-Identity-Status: Confirmed Aug 07 01:00:27.473483 n-d-master-1 devstack@n-api.service[104131]: X-Is-Admin-Project: True Aug 07 01:00:27.473483 n-d-master-1 devstack@n-api.service[104131]: X-Openstack-Nova-Api-Version: 2.90 Aug 07 01:00:27.473483 n-d-master-1 devstack@n-api.service[104131]: X-Project-Domain-Id: default Aug 07 01:00:27.473483 n-d-master-1 devstack@n-api.service[104131]: X-Project-Domain-Name: Default Aug 07 01:00:27.473483 n-d-master-1 devstack@n-api.service[104131]: X-Project-Id: 62e0ba2ccef34e34b7ab3788b1ce6bb8 Aug 07 01:00:27.473483 n-d-master-1 devstack@n-api.service[104131]: X-Project-Name: admin Aug 07 01:00:27.473483 n-d-master-1 devstack@n-api.service[104131]: X-Role: reader,admin,member Aug 07 01:00:27.473483 n-d-master-1 devstack@n-api.service[104131]: X-Roles: reader,admin,member Aug 07 01:00:27.475503 n-d-master-1 devstack@n-api.service[104131]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/62e0ba2ccef34e34b7ab3788b1ce6bb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_62e0ba2ccef34e34b7ab3788b1ce6bb8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/62e0ba2ccef34e34b7ab3788b1ce6bb8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/62e0ba2ccef34e34b7ab3788b1ce6bb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:00:27.475503 n-d-master-1 devstack@n-api.service[104131]: X-Tenant: admin Aug 07 01:00:27.475503 n-d-master-1 devstack@n-api.service[104131]: X-Tenant-Id: 62e0ba2ccef34e34b7ab3788b1ce6bb8 Aug 07 01:00:27.475503 n-d-master-1 devstack@n-api.service[104131]: X-Tenant-Name: admin Aug 07 01:00:27.475503 n-d-master-1 devstack@n-api.service[104131]: X-User: admin Aug 07 01:00:27.475503 n-d-master-1 devstack@n-api.service[104131]: X-User-Domain-Id: default Aug 07 01:00:27.475503 n-d-master-1 devstack@n-api.service[104131]: X-User-Domain-Name: Default Aug 07 01:00:27.475503 n-d-master-1 devstack@n-api.service[104131]: X-User-Id: e6bf2139d86940dda0c8934f84df710d Aug 07 01:00:27.475503 n-d-master-1 devstack@n-api.service[104131]: X-User-Name: admin Aug 07 01:00:27.475503 n-d-master-1 devstack@n-api.service[104131]: method: > Aug 07 01:00:27.475503 n-d-master-1 devstack@n-api.service[104131]: exception: Flavor 42 could not be found. Aug 07 01:00:27.475503 n-d-master-1 devstack@n-api.service[104131]: action_args: {'id': '42'} Aug 07 01:00:27.475503 n-d-master-1 devstack@n-api.service[104131]: {{(pid=104131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:00:27.475503 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:00:27.476920 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 07 01:00:27.476920 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 07 01:00:27.476920 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 01:00:27.476920 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 01:00:27.476920 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:00:27.476920 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:00:27.476920 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 01:00:27.476920 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 01:00:27.476920 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 01:00:27.476920 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:00:27.476920 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 01:00:27.476920 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 01:00:27.476920 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 07 01:00:27.476920 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi Aug 07 01:00:27.476920 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:00:27.476920 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi Aug 07 01:00:27.476920 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:00:27.476920 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:00:27.476920 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:00:27.478281 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:00:27.478281 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:00:27.478281 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:00:27.478281 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:00:27.478281 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 07 01:00:27.478281 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:00:27.478281 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 07 01:00:27.478281 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi Aug 07 01:00:27.478281 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:00:27.478281 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi Aug 07 01:00:27.478281 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:00:27.478281 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:00:27.478281 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:00:27.478281 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:00:27.478281 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:00:27.478281 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 07 01:00:27.478281 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi Aug 07 01:00:27.478281 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-802946bc-0342-45e2-bf80-f48e22241d6a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:00:27.479612 n-d-master-1 devstack@n-api.service[104131]: INFO nova.api.openstack.requestlog [None req-802946bc-0342-45e2-bf80-f48e22241d6a admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.450707 Aug 07 01:00:27.479612 n-d-master-1 devstack@n-api.service[104131]: [pid: 104131|app: 0|req: 19/39] 10.222.0.39 () {60 vars in 1190 bytes} [Sun Aug 7 01:00:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 452 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 07 01:00:27.485122 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-2ae44511-d50b-459c-80e2-6b564a14d62f admin admin] Calling method '>' {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:00:27.489363 n-d-master-1 devstack@n-api.service[104130]: DEBUG dbcounter [-] [104130] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=11,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=104130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:27.511160 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.requestlog [None req-2ae44511-d50b-459c-80e2-6b564a14d62f admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028247 Aug 07 01:00:27.511160 n-d-master-1 devstack@n-api.service[104130]: [pid: 104130|app: 0|req: 21/40] 10.222.0.39 () {60 vars in 1210 bytes} [Sun Aug 7 01:00:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:00:27.521489 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-7a486f33-9f43-4fb4-beef-04189278a53f admin admin] Calling method '>' {{(pid=104131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:00:27.546293 n-d-master-1 devstack@n-api.service[104131]: INFO nova.api.openstack.requestlog [None req-7a486f33-9f43-4fb4-beef-04189278a53f admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028592 Aug 07 01:00:27.546865 n-d-master-1 devstack@n-api.service[104131]: [pid: 104131|app: 0|req: 20/41] 10.222.0.39 () {60 vars in 1210 bytes} [Sun Aug 7 01:00:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:00:27.557655 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-3f6b4db9-c723-42ab-8e87-ed930b6ae319 admin admin] Calling method '>' {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:00:27.563910 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.wsgi [None req-3f6b4db9-c723-42ab-8e87-ed930b6ae319 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 07 01:00:27.567481 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-3f6b4db9-c723-42ab-8e87-ed930b6ae319 admin admin] Request method failure captured: Aug 07 01:00:27.567481 n-d-master-1 devstack@n-api.service[104130]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 07 01:00:27.567481 n-d-master-1 devstack@n-api.service[104130]: Accept: application/json Aug 07 01:00:27.567481 n-d-master-1 devstack@n-api.service[104130]: Accept-Encoding: gzip, deflate Aug 07 01:00:27.567481 n-d-master-1 devstack@n-api.service[104130]: Connection: keep-alive Aug 07 01:00:27.567481 n-d-master-1 devstack@n-api.service[104130]: Content-Length: 0 Aug 07 01:00:27.567481 n-d-master-1 devstack@n-api.service[104130]: Host: 10.222.0.39 Aug 07 01:00:27.567481 n-d-master-1 devstack@n-api.service[104130]: Openstack-Api-Version: compute 2.90 Aug 07 01:00:27.567481 n-d-master-1 devstack@n-api.service[104130]: Openstack-System-Scope: None Aug 07 01:00:27.567481 n-d-master-1 devstack@n-api.service[104130]: User-Agent: python-novaclient Aug 07 01:00:27.567481 n-d-master-1 devstack@n-api.service[104130]: X-Auth-Token: gAAAAABi7w6qK2cBS30TtREyFTA3KG3skjxCDlAOrJPCPR9z71155nhsNIFTIPqSBJcni9EyglQCIe-IDTG0s8RUlQ_UKMxEtNgbY6x6bj2u2eVKb8HTKIVeyzdvpmzNFPePfNI54FRiFHnVx7UBIHplYQBgccyVWmuKStMgKQCCg8UZ2ysaapE Aug 07 01:00:27.567481 n-d-master-1 devstack@n-api.service[104130]: X-Domain-Id: None Aug 07 01:00:27.567481 n-d-master-1 devstack@n-api.service[104130]: X-Domain-Name: None Aug 07 01:00:27.567481 n-d-master-1 devstack@n-api.service[104130]: X-Identity-Status: Confirmed Aug 07 01:00:27.567481 n-d-master-1 devstack@n-api.service[104130]: X-Is-Admin-Project: True Aug 07 01:00:27.567481 n-d-master-1 devstack@n-api.service[104130]: X-Openstack-Nova-Api-Version: 2.90 Aug 07 01:00:27.567481 n-d-master-1 devstack@n-api.service[104130]: X-Project-Domain-Id: default Aug 07 01:00:27.567481 n-d-master-1 devstack@n-api.service[104130]: X-Project-Domain-Name: Default Aug 07 01:00:27.567481 n-d-master-1 devstack@n-api.service[104130]: X-Project-Id: 62e0ba2ccef34e34b7ab3788b1ce6bb8 Aug 07 01:00:27.567481 n-d-master-1 devstack@n-api.service[104130]: X-Project-Name: admin Aug 07 01:00:27.567481 n-d-master-1 devstack@n-api.service[104130]: X-Role: reader,admin,member Aug 07 01:00:27.567481 n-d-master-1 devstack@n-api.service[104130]: X-Roles: reader,admin,member Aug 07 01:00:27.570381 n-d-master-1 devstack@n-api.service[104130]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/62e0ba2ccef34e34b7ab3788b1ce6bb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_62e0ba2ccef34e34b7ab3788b1ce6bb8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/62e0ba2ccef34e34b7ab3788b1ce6bb8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/62e0ba2ccef34e34b7ab3788b1ce6bb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:00:27.570381 n-d-master-1 devstack@n-api.service[104130]: X-Tenant: admin Aug 07 01:00:27.570381 n-d-master-1 devstack@n-api.service[104130]: X-Tenant-Id: 62e0ba2ccef34e34b7ab3788b1ce6bb8 Aug 07 01:00:27.570381 n-d-master-1 devstack@n-api.service[104130]: X-Tenant-Name: admin Aug 07 01:00:27.570381 n-d-master-1 devstack@n-api.service[104130]: X-User: admin Aug 07 01:00:27.570381 n-d-master-1 devstack@n-api.service[104130]: X-User-Domain-Id: default Aug 07 01:00:27.570381 n-d-master-1 devstack@n-api.service[104130]: X-User-Domain-Name: Default Aug 07 01:00:27.570381 n-d-master-1 devstack@n-api.service[104130]: X-User-Id: e6bf2139d86940dda0c8934f84df710d Aug 07 01:00:27.570381 n-d-master-1 devstack@n-api.service[104130]: X-User-Name: admin Aug 07 01:00:27.570381 n-d-master-1 devstack@n-api.service[104130]: method: > Aug 07 01:00:27.570381 n-d-master-1 devstack@n-api.service[104130]: exception: Flavor 42 could not be found. Aug 07 01:00:27.570381 n-d-master-1 devstack@n-api.service[104130]: action_args: {'id': '42'} Aug 07 01:00:27.570381 n-d-master-1 devstack@n-api.service[104130]: {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:00:27.570381 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:00:27.571704 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 07 01:00:27.571704 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 07 01:00:27.571704 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 01:00:27.571704 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 01:00:27.571704 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:00:27.571704 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:00:27.571704 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 01:00:27.571704 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 01:00:27.571704 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 01:00:27.571704 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:00:27.571704 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 01:00:27.571704 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 01:00:27.571704 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 07 01:00:27.571704 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi Aug 07 01:00:27.571704 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:00:27.571704 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi Aug 07 01:00:27.571704 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:00:27.571704 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:00:27.571704 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:00:27.574211 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:00:27.574211 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:00:27.574211 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:00:27.574211 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:00:27.574211 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 07 01:00:27.574211 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:00:27.574211 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 07 01:00:27.574211 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi Aug 07 01:00:27.574211 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:00:27.574211 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi Aug 07 01:00:27.574211 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:00:27.574211 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:00:27.574211 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:00:27.574211 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:00:27.574211 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:00:27.574211 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 07 01:00:27.574211 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi Aug 07 01:00:27.574211 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-3f6b4db9-c723-42ab-8e87-ed930b6ae319 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:00:27.576201 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.requestlog [None req-3f6b4db9-c723-42ab-8e87-ed930b6ae319 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016146 Aug 07 01:00:27.576201 n-d-master-1 devstack@n-api.service[104130]: [pid: 104130|app: 0|req: 22/42] 10.222.0.39 () {60 vars in 1190 bytes} [Sun Aug 7 01:00:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 07 01:00:28.569312 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-7a486f33-9f43-4fb4-beef-04189278a53f admin admin] Calling method '>' {{(pid=104131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:00:28.570315 n-d-master-1 devstack@n-api.service[104131]: INFO nova.api.openstack.requestlog [None req-7a486f33-9f43-4fb4-beef-04189278a53f admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 07 01:00:28.570705 n-d-master-1 devstack@n-api.service[104131]: [pid: 104131|app: 0|req: 21/43] 10.222.0.39 () {56 vars in 1074 bytes} [Sun Aug 7 01:00:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:00:29.161478 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-3a3f9dcc-34de-4eb9-9f1c-0b14bc0b61a2 admin admin] Calling method '>' {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:00:29.169753 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.wsgi [None req-3a3f9dcc-34de-4eb9-9f1c-0b14bc0b61a2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 07 01:00:29.171409 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-3a3f9dcc-34de-4eb9-9f1c-0b14bc0b61a2 admin admin] Request method failure captured: Aug 07 01:00:29.171409 n-d-master-1 devstack@n-api.service[104130]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 07 01:00:29.171409 n-d-master-1 devstack@n-api.service[104130]: Accept: application/json Aug 07 01:00:29.171409 n-d-master-1 devstack@n-api.service[104130]: Accept-Encoding: gzip, deflate Aug 07 01:00:29.171409 n-d-master-1 devstack@n-api.service[104130]: Connection: keep-alive Aug 07 01:00:29.171409 n-d-master-1 devstack@n-api.service[104130]: Content-Length: 0 Aug 07 01:00:29.171409 n-d-master-1 devstack@n-api.service[104130]: Host: 10.222.0.39 Aug 07 01:00:29.171409 n-d-master-1 devstack@n-api.service[104130]: Openstack-Api-Version: compute 2.90 Aug 07 01:00:29.171409 n-d-master-1 devstack@n-api.service[104130]: Openstack-System-Scope: None Aug 07 01:00:29.171409 n-d-master-1 devstack@n-api.service[104130]: User-Agent: python-novaclient Aug 07 01:00:29.171409 n-d-master-1 devstack@n-api.service[104130]: X-Auth-Token: gAAAAABi7w6s0n7RZVUaLMrt0sE9YTY2Ji6B5fv3qI0glHU3JXLXvoqM3KcpWM-eNLmaGhY3njGYQPadAppHpes3lD_2pCCcjj8QxDKimBX-jOjX-67bFGIld0Lp_yxhDP9lQQnHHKkVrDovKOgy80bfHSI0CaxmdPTW-PWdZ5N8mQp-1FWZfdo Aug 07 01:00:29.171409 n-d-master-1 devstack@n-api.service[104130]: X-Domain-Id: None Aug 07 01:00:29.171409 n-d-master-1 devstack@n-api.service[104130]: X-Domain-Name: None Aug 07 01:00:29.171409 n-d-master-1 devstack@n-api.service[104130]: X-Identity-Status: Confirmed Aug 07 01:00:29.171409 n-d-master-1 devstack@n-api.service[104130]: X-Is-Admin-Project: True Aug 07 01:00:29.171409 n-d-master-1 devstack@n-api.service[104130]: X-Openstack-Nova-Api-Version: 2.90 Aug 07 01:00:29.171409 n-d-master-1 devstack@n-api.service[104130]: X-Project-Domain-Id: default Aug 07 01:00:29.171409 n-d-master-1 devstack@n-api.service[104130]: X-Project-Domain-Name: Default Aug 07 01:00:29.171409 n-d-master-1 devstack@n-api.service[104130]: X-Project-Id: 62e0ba2ccef34e34b7ab3788b1ce6bb8 Aug 07 01:00:29.171409 n-d-master-1 devstack@n-api.service[104130]: X-Project-Name: admin Aug 07 01:00:29.171409 n-d-master-1 devstack@n-api.service[104130]: X-Role: reader,admin,member Aug 07 01:00:29.171409 n-d-master-1 devstack@n-api.service[104130]: X-Roles: reader,admin,member Aug 07 01:00:29.173375 n-d-master-1 devstack@n-api.service[104130]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/62e0ba2ccef34e34b7ab3788b1ce6bb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_62e0ba2ccef34e34b7ab3788b1ce6bb8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/62e0ba2ccef34e34b7ab3788b1ce6bb8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/62e0ba2ccef34e34b7ab3788b1ce6bb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:00:29.173375 n-d-master-1 devstack@n-api.service[104130]: X-Tenant: admin Aug 07 01:00:29.173375 n-d-master-1 devstack@n-api.service[104130]: X-Tenant-Id: 62e0ba2ccef34e34b7ab3788b1ce6bb8 Aug 07 01:00:29.173375 n-d-master-1 devstack@n-api.service[104130]: X-Tenant-Name: admin Aug 07 01:00:29.173375 n-d-master-1 devstack@n-api.service[104130]: X-User: admin Aug 07 01:00:29.173375 n-d-master-1 devstack@n-api.service[104130]: X-User-Domain-Id: default Aug 07 01:00:29.173375 n-d-master-1 devstack@n-api.service[104130]: X-User-Domain-Name: Default Aug 07 01:00:29.173375 n-d-master-1 devstack@n-api.service[104130]: X-User-Id: e6bf2139d86940dda0c8934f84df710d Aug 07 01:00:29.173375 n-d-master-1 devstack@n-api.service[104130]: X-User-Name: admin Aug 07 01:00:29.173375 n-d-master-1 devstack@n-api.service[104130]: method: > Aug 07 01:00:29.173375 n-d-master-1 devstack@n-api.service[104130]: exception: Flavor 84 could not be found. Aug 07 01:00:29.173375 n-d-master-1 devstack@n-api.service[104130]: action_args: {'id': '84'} Aug 07 01:00:29.173375 n-d-master-1 devstack@n-api.service[104130]: {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:00:29.173375 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:00:29.174433 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 07 01:00:29.174433 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 07 01:00:29.174433 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 01:00:29.174433 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 01:00:29.174433 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:00:29.174433 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:00:29.174433 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 01:00:29.174433 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 01:00:29.174433 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 01:00:29.174433 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:00:29.174433 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 01:00:29.174433 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 01:00:29.174433 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 07 01:00:29.174433 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi Aug 07 01:00:29.174433 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:00:29.174433 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi Aug 07 01:00:29.174433 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:00:29.174433 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:00:29.174433 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:00:29.175628 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:00:29.175628 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:00:29.175628 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:00:29.175628 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:00:29.175628 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 07 01:00:29.175628 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:00:29.175628 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 07 01:00:29.175628 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi Aug 07 01:00:29.175628 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:00:29.175628 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi Aug 07 01:00:29.175628 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:00:29.175628 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:00:29.175628 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:00:29.175628 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:00:29.175628 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:00:29.175628 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 07 01:00:29.175628 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi Aug 07 01:00:29.175628 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-3a3f9dcc-34de-4eb9-9f1c-0b14bc0b61a2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:00:29.177069 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.requestlog [None req-3a3f9dcc-34de-4eb9-9f1c-0b14bc0b61a2 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.462065 Aug 07 01:00:29.177069 n-d-master-1 devstack@n-api.service[104130]: [pid: 104130|app: 0|req: 23/44] 10.222.0.39 () {60 vars in 1190 bytes} [Sun Aug 7 01:00:28 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 463 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 07 01:00:29.183765 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-ebb8bbbe-f0cb-4708-bb94-a06512c8c053 admin admin] Calling method '>' {{(pid=104131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:00:29.200333 n-d-master-1 devstack@n-api.service[104131]: INFO nova.api.openstack.requestlog [None req-ebb8bbbe-f0cb-4708-bb94-a06512c8c053 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020606 Aug 07 01:00:29.200911 n-d-master-1 devstack@n-api.service[104131]: [pid: 104131|app: 0|req: 22/45] 10.222.0.39 () {60 vars in 1210 bytes} [Sun Aug 7 01:00:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:00:29.211764 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-b4f45bf4-e104-49a8-8952-98f1679ff7cf admin admin] Calling method '>' {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:00:29.229873 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.requestlog [None req-b4f45bf4-e104-49a8-8952-98f1679ff7cf admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021420 Aug 07 01:00:29.230452 n-d-master-1 devstack@n-api.service[104130]: [pid: 104130|app: 0|req: 24/46] 10.222.0.39 () {60 vars in 1210 bytes} [Sun Aug 7 01:00:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:00:29.244144 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-5915de7f-2640-46e1-af0c-4d0d639d3239 admin admin] Calling method '>' {{(pid=104131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:00:29.250952 n-d-master-1 devstack@n-api.service[104131]: INFO nova.api.openstack.wsgi [None req-5915de7f-2640-46e1-af0c-4d0d639d3239 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 07 01:00:29.253306 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-5915de7f-2640-46e1-af0c-4d0d639d3239 admin admin] Request method failure captured: Aug 07 01:00:29.253306 n-d-master-1 devstack@n-api.service[104131]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 07 01:00:29.253306 n-d-master-1 devstack@n-api.service[104131]: Accept: application/json Aug 07 01:00:29.253306 n-d-master-1 devstack@n-api.service[104131]: Accept-Encoding: gzip, deflate Aug 07 01:00:29.253306 n-d-master-1 devstack@n-api.service[104131]: Connection: keep-alive Aug 07 01:00:29.253306 n-d-master-1 devstack@n-api.service[104131]: Content-Length: 0 Aug 07 01:00:29.253306 n-d-master-1 devstack@n-api.service[104131]: Host: 10.222.0.39 Aug 07 01:00:29.253306 n-d-master-1 devstack@n-api.service[104131]: Openstack-Api-Version: compute 2.90 Aug 07 01:00:29.253306 n-d-master-1 devstack@n-api.service[104131]: Openstack-System-Scope: None Aug 07 01:00:29.253306 n-d-master-1 devstack@n-api.service[104131]: User-Agent: python-novaclient Aug 07 01:00:29.253306 n-d-master-1 devstack@n-api.service[104131]: X-Auth-Token: gAAAAABi7w6s0n7RZVUaLMrt0sE9YTY2Ji6B5fv3qI0glHU3JXLXvoqM3KcpWM-eNLmaGhY3njGYQPadAppHpes3lD_2pCCcjj8QxDKimBX-jOjX-67bFGIld0Lp_yxhDP9lQQnHHKkVrDovKOgy80bfHSI0CaxmdPTW-PWdZ5N8mQp-1FWZfdo Aug 07 01:00:29.253306 n-d-master-1 devstack@n-api.service[104131]: X-Domain-Id: None Aug 07 01:00:29.253306 n-d-master-1 devstack@n-api.service[104131]: X-Domain-Name: None Aug 07 01:00:29.253306 n-d-master-1 devstack@n-api.service[104131]: X-Identity-Status: Confirmed Aug 07 01:00:29.253306 n-d-master-1 devstack@n-api.service[104131]: X-Is-Admin-Project: True Aug 07 01:00:29.253306 n-d-master-1 devstack@n-api.service[104131]: X-Openstack-Nova-Api-Version: 2.90 Aug 07 01:00:29.253306 n-d-master-1 devstack@n-api.service[104131]: X-Project-Domain-Id: default Aug 07 01:00:29.253306 n-d-master-1 devstack@n-api.service[104131]: X-Project-Domain-Name: Default Aug 07 01:00:29.253306 n-d-master-1 devstack@n-api.service[104131]: X-Project-Id: 62e0ba2ccef34e34b7ab3788b1ce6bb8 Aug 07 01:00:29.253306 n-d-master-1 devstack@n-api.service[104131]: X-Project-Name: admin Aug 07 01:00:29.253306 n-d-master-1 devstack@n-api.service[104131]: X-Role: reader,admin,member Aug 07 01:00:29.253306 n-d-master-1 devstack@n-api.service[104131]: X-Roles: reader,admin,member Aug 07 01:00:29.255074 n-d-master-1 devstack@n-api.service[104131]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/62e0ba2ccef34e34b7ab3788b1ce6bb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_62e0ba2ccef34e34b7ab3788b1ce6bb8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/62e0ba2ccef34e34b7ab3788b1ce6bb8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/62e0ba2ccef34e34b7ab3788b1ce6bb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:00:29.255074 n-d-master-1 devstack@n-api.service[104131]: X-Tenant: admin Aug 07 01:00:29.255074 n-d-master-1 devstack@n-api.service[104131]: X-Tenant-Id: 62e0ba2ccef34e34b7ab3788b1ce6bb8 Aug 07 01:00:29.255074 n-d-master-1 devstack@n-api.service[104131]: X-Tenant-Name: admin Aug 07 01:00:29.255074 n-d-master-1 devstack@n-api.service[104131]: X-User: admin Aug 07 01:00:29.255074 n-d-master-1 devstack@n-api.service[104131]: X-User-Domain-Id: default Aug 07 01:00:29.255074 n-d-master-1 devstack@n-api.service[104131]: X-User-Domain-Name: Default Aug 07 01:00:29.255074 n-d-master-1 devstack@n-api.service[104131]: X-User-Id: e6bf2139d86940dda0c8934f84df710d Aug 07 01:00:29.255074 n-d-master-1 devstack@n-api.service[104131]: X-User-Name: admin Aug 07 01:00:29.255074 n-d-master-1 devstack@n-api.service[104131]: method: > Aug 07 01:00:29.255074 n-d-master-1 devstack@n-api.service[104131]: exception: Flavor 84 could not be found. Aug 07 01:00:29.255074 n-d-master-1 devstack@n-api.service[104131]: action_args: {'id': '84'} Aug 07 01:00:29.255074 n-d-master-1 devstack@n-api.service[104131]: {{(pid=104131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:00:29.255074 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:00:29.256059 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 07 01:00:29.256059 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 07 01:00:29.256059 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 01:00:29.256059 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 01:00:29.256059 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:00:29.256059 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:00:29.256059 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 01:00:29.256059 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 01:00:29.256059 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 01:00:29.256059 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:00:29.256059 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 01:00:29.256059 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 01:00:29.256059 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 07 01:00:29.256059 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi Aug 07 01:00:29.256059 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:00:29.256059 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi Aug 07 01:00:29.256059 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:00:29.256059 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:00:29.256059 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:00:29.257129 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:00:29.257129 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:00:29.257129 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:00:29.257129 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:00:29.257129 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 07 01:00:29.257129 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:00:29.257129 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 07 01:00:29.257129 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi Aug 07 01:00:29.257129 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:00:29.257129 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi Aug 07 01:00:29.257129 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:00:29.257129 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:00:29.257129 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:00:29.257129 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:00:29.257129 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:00:29.257129 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 07 01:00:29.257129 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi Aug 07 01:00:29.257129 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-5915de7f-2640-46e1-af0c-4d0d639d3239 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:00:29.258118 n-d-master-1 devstack@n-api.service[104131]: INFO nova.api.openstack.requestlog [None req-5915de7f-2640-46e1-af0c-4d0d639d3239 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.015442 Aug 07 01:00:29.258118 n-d-master-1 devstack@n-api.service[104131]: [pid: 104131|app: 0|req: 23/47] 10.222.0.39 () {60 vars in 1190 bytes} [Sun Aug 7 01:00:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 07 01:00:30.303810 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-b4f45bf4-e104-49a8-8952-98f1679ff7cf admin admin] Calling method '>' {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:00:30.305275 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.requestlog [None req-b4f45bf4-e104-49a8-8952-98f1679ff7cf admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001885 Aug 07 01:00:30.305685 n-d-master-1 devstack@n-api.service[104130]: [pid: 104130|app: 0|req: 25/48] 10.222.0.39 () {56 vars in 1074 bytes} [Sun Aug 7 01:00:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:00:30.896561 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-90cf2f3a-f705-483a-9692-5931f95b540a admin admin] Calling method '>' {{(pid=104131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:00:30.903254 n-d-master-1 devstack@n-api.service[104131]: INFO nova.api.openstack.wsgi [None req-90cf2f3a-f705-483a-9692-5931f95b540a admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 07 01:00:30.904895 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-90cf2f3a-f705-483a-9692-5931f95b540a admin admin] Request method failure captured: Aug 07 01:00:30.904895 n-d-master-1 devstack@n-api.service[104131]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 07 01:00:30.904895 n-d-master-1 devstack@n-api.service[104131]: Accept: application/json Aug 07 01:00:30.904895 n-d-master-1 devstack@n-api.service[104131]: Accept-Encoding: gzip, deflate Aug 07 01:00:30.904895 n-d-master-1 devstack@n-api.service[104131]: Connection: keep-alive Aug 07 01:00:30.904895 n-d-master-1 devstack@n-api.service[104131]: Content-Length: 0 Aug 07 01:00:30.904895 n-d-master-1 devstack@n-api.service[104131]: Host: 10.222.0.39 Aug 07 01:00:30.904895 n-d-master-1 devstack@n-api.service[104131]: Openstack-Api-Version: compute 2.90 Aug 07 01:00:30.904895 n-d-master-1 devstack@n-api.service[104131]: Openstack-System-Scope: None Aug 07 01:00:30.904895 n-d-master-1 devstack@n-api.service[104131]: User-Agent: python-novaclient Aug 07 01:00:30.904895 n-d-master-1 devstack@n-api.service[104131]: X-Auth-Token: gAAAAABi7w6urbl_6RmM-C1-uAPrhS1ME36n7_CzGndRb8Pvvg6WGkR-Zi5b71Cy3CAXq2Rii0rR_a-qxGhn_xG59d1dmEU_3VOM0e-fuVe3e1x9Tr-KilvS64HSpbCx1J9KV_aH2R1j1I7ODhf8-lsatJAsFZFoSDMbNKTTzuef8ZTI0n2kOWk Aug 07 01:00:30.904895 n-d-master-1 devstack@n-api.service[104131]: X-Domain-Id: None Aug 07 01:00:30.904895 n-d-master-1 devstack@n-api.service[104131]: X-Domain-Name: None Aug 07 01:00:30.904895 n-d-master-1 devstack@n-api.service[104131]: X-Identity-Status: Confirmed Aug 07 01:00:30.904895 n-d-master-1 devstack@n-api.service[104131]: X-Is-Admin-Project: True Aug 07 01:00:30.904895 n-d-master-1 devstack@n-api.service[104131]: X-Openstack-Nova-Api-Version: 2.90 Aug 07 01:00:30.904895 n-d-master-1 devstack@n-api.service[104131]: X-Project-Domain-Id: default Aug 07 01:00:30.904895 n-d-master-1 devstack@n-api.service[104131]: X-Project-Domain-Name: Default Aug 07 01:00:30.904895 n-d-master-1 devstack@n-api.service[104131]: X-Project-Id: 62e0ba2ccef34e34b7ab3788b1ce6bb8 Aug 07 01:00:30.904895 n-d-master-1 devstack@n-api.service[104131]: X-Project-Name: admin Aug 07 01:00:30.904895 n-d-master-1 devstack@n-api.service[104131]: X-Role: reader,admin,member Aug 07 01:00:30.904895 n-d-master-1 devstack@n-api.service[104131]: X-Roles: reader,admin,member Aug 07 01:00:30.906566 n-d-master-1 devstack@n-api.service[104131]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/62e0ba2ccef34e34b7ab3788b1ce6bb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_62e0ba2ccef34e34b7ab3788b1ce6bb8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/62e0ba2ccef34e34b7ab3788b1ce6bb8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/62e0ba2ccef34e34b7ab3788b1ce6bb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:00:30.906566 n-d-master-1 devstack@n-api.service[104131]: X-Tenant: admin Aug 07 01:00:30.906566 n-d-master-1 devstack@n-api.service[104131]: X-Tenant-Id: 62e0ba2ccef34e34b7ab3788b1ce6bb8 Aug 07 01:00:30.906566 n-d-master-1 devstack@n-api.service[104131]: X-Tenant-Name: admin Aug 07 01:00:30.906566 n-d-master-1 devstack@n-api.service[104131]: X-User: admin Aug 07 01:00:30.906566 n-d-master-1 devstack@n-api.service[104131]: X-User-Domain-Id: default Aug 07 01:00:30.906566 n-d-master-1 devstack@n-api.service[104131]: X-User-Domain-Name: Default Aug 07 01:00:30.906566 n-d-master-1 devstack@n-api.service[104131]: X-User-Id: e6bf2139d86940dda0c8934f84df710d Aug 07 01:00:30.906566 n-d-master-1 devstack@n-api.service[104131]: X-User-Name: admin Aug 07 01:00:30.906566 n-d-master-1 devstack@n-api.service[104131]: method: > Aug 07 01:00:30.906566 n-d-master-1 devstack@n-api.service[104131]: exception: Flavor 451 could not be found. Aug 07 01:00:30.906566 n-d-master-1 devstack@n-api.service[104131]: action_args: {'id': '451'} Aug 07 01:00:30.906566 n-d-master-1 devstack@n-api.service[104131]: {{(pid=104131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:00:30.906566 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:00:30.907619 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 07 01:00:30.907619 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 07 01:00:30.907619 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 01:00:30.907619 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 01:00:30.907619 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:00:30.907619 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:00:30.907619 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 01:00:30.907619 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 01:00:30.907619 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 01:00:30.907619 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:00:30.907619 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 01:00:30.907619 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 01:00:30.907619 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 07 01:00:30.907619 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi Aug 07 01:00:30.907619 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:00:30.907619 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi Aug 07 01:00:30.907619 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:00:30.907619 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:00:30.907619 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:00:30.909025 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:00:30.909025 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:00:30.909025 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:00:30.909025 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:00:30.909025 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 07 01:00:30.909025 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:00:30.909025 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 07 01:00:30.909025 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi Aug 07 01:00:30.909025 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:00:30.909025 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi Aug 07 01:00:30.909025 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:00:30.909025 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:00:30.909025 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:00:30.909025 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:00:30.909025 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:00:30.909025 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 07 01:00:30.909025 n-d-master-1 devstack@n-api.service[104131]: ERROR nova.api.openstack.wsgi Aug 07 01:00:30.909025 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-90cf2f3a-f705-483a-9692-5931f95b540a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:00:30.910263 n-d-master-1 devstack@n-api.service[104131]: INFO nova.api.openstack.requestlog [None req-90cf2f3a-f705-483a-9692-5931f95b540a admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.448005 Aug 07 01:00:30.910263 n-d-master-1 devstack@n-api.service[104131]: [pid: 104131|app: 0|req: 24/49] 10.222.0.39 () {60 vars in 1193 bytes} [Sun Aug 7 01:00:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 449 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 07 01:00:30.916023 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-9d474d71-7b69-4b63-85be-dc1e985acc60 admin admin] Calling method '>' {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:00:30.931857 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.requestlog [None req-9d474d71-7b69-4b63-85be-dc1e985acc60 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019315 Aug 07 01:00:30.932550 n-d-master-1 devstack@n-api.service[104130]: [pid: 104130|app: 0|req: 26/50] 10.222.0.39 () {60 vars in 1210 bytes} [Sun Aug 7 01:00:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:00:30.944875 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-aabb47ff-4273-43bf-a6b4-408ef6aaa49b admin admin] Calling method '>' {{(pid=104131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:00:30.961335 n-d-master-1 devstack@n-api.service[104131]: INFO nova.api.openstack.requestlog [None req-aabb47ff-4273-43bf-a6b4-408ef6aaa49b admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022000 Aug 07 01:00:30.961911 n-d-master-1 devstack@n-api.service[104131]: [pid: 104131|app: 0|req: 25/51] 10.222.0.39 () {60 vars in 1210 bytes} [Sun Aug 7 01:00:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:00:30.972154 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-ea88e312-77cb-4906-8363-1abb6455897b admin admin] Calling method '>' {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:00:30.978010 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.wsgi [None req-ea88e312-77cb-4906-8363-1abb6455897b admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 07 01:00:30.980249 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-ea88e312-77cb-4906-8363-1abb6455897b admin admin] Request method failure captured: Aug 07 01:00:30.980249 n-d-master-1 devstack@n-api.service[104130]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 07 01:00:30.980249 n-d-master-1 devstack@n-api.service[104130]: Accept: application/json Aug 07 01:00:30.980249 n-d-master-1 devstack@n-api.service[104130]: Accept-Encoding: gzip, deflate Aug 07 01:00:30.980249 n-d-master-1 devstack@n-api.service[104130]: Connection: keep-alive Aug 07 01:00:30.980249 n-d-master-1 devstack@n-api.service[104130]: Content-Length: 0 Aug 07 01:00:30.980249 n-d-master-1 devstack@n-api.service[104130]: Host: 10.222.0.39 Aug 07 01:00:30.980249 n-d-master-1 devstack@n-api.service[104130]: Openstack-Api-Version: compute 2.90 Aug 07 01:00:30.980249 n-d-master-1 devstack@n-api.service[104130]: Openstack-System-Scope: None Aug 07 01:00:30.980249 n-d-master-1 devstack@n-api.service[104130]: User-Agent: python-novaclient Aug 07 01:00:30.980249 n-d-master-1 devstack@n-api.service[104130]: X-Auth-Token: gAAAAABi7w6urbl_6RmM-C1-uAPrhS1ME36n7_CzGndRb8Pvvg6WGkR-Zi5b71Cy3CAXq2Rii0rR_a-qxGhn_xG59d1dmEU_3VOM0e-fuVe3e1x9Tr-KilvS64HSpbCx1J9KV_aH2R1j1I7ODhf8-lsatJAsFZFoSDMbNKTTzuef8ZTI0n2kOWk Aug 07 01:00:30.980249 n-d-master-1 devstack@n-api.service[104130]: X-Domain-Id: None Aug 07 01:00:30.980249 n-d-master-1 devstack@n-api.service[104130]: X-Domain-Name: None Aug 07 01:00:30.980249 n-d-master-1 devstack@n-api.service[104130]: X-Identity-Status: Confirmed Aug 07 01:00:30.980249 n-d-master-1 devstack@n-api.service[104130]: X-Is-Admin-Project: True Aug 07 01:00:30.980249 n-d-master-1 devstack@n-api.service[104130]: X-Openstack-Nova-Api-Version: 2.90 Aug 07 01:00:30.980249 n-d-master-1 devstack@n-api.service[104130]: X-Project-Domain-Id: default Aug 07 01:00:30.980249 n-d-master-1 devstack@n-api.service[104130]: X-Project-Domain-Name: Default Aug 07 01:00:30.980249 n-d-master-1 devstack@n-api.service[104130]: X-Project-Id: 62e0ba2ccef34e34b7ab3788b1ce6bb8 Aug 07 01:00:30.980249 n-d-master-1 devstack@n-api.service[104130]: X-Project-Name: admin Aug 07 01:00:30.980249 n-d-master-1 devstack@n-api.service[104130]: X-Role: reader,admin,member Aug 07 01:00:30.980249 n-d-master-1 devstack@n-api.service[104130]: X-Roles: reader,admin,member Aug 07 01:00:30.981793 n-d-master-1 devstack@n-api.service[104130]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/62e0ba2ccef34e34b7ab3788b1ce6bb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_62e0ba2ccef34e34b7ab3788b1ce6bb8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/62e0ba2ccef34e34b7ab3788b1ce6bb8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/62e0ba2ccef34e34b7ab3788b1ce6bb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:00:30.981793 n-d-master-1 devstack@n-api.service[104130]: X-Tenant: admin Aug 07 01:00:30.981793 n-d-master-1 devstack@n-api.service[104130]: X-Tenant-Id: 62e0ba2ccef34e34b7ab3788b1ce6bb8 Aug 07 01:00:30.981793 n-d-master-1 devstack@n-api.service[104130]: X-Tenant-Name: admin Aug 07 01:00:30.981793 n-d-master-1 devstack@n-api.service[104130]: X-User: admin Aug 07 01:00:30.981793 n-d-master-1 devstack@n-api.service[104130]: X-User-Domain-Id: default Aug 07 01:00:30.981793 n-d-master-1 devstack@n-api.service[104130]: X-User-Domain-Name: Default Aug 07 01:00:30.981793 n-d-master-1 devstack@n-api.service[104130]: X-User-Id: e6bf2139d86940dda0c8934f84df710d Aug 07 01:00:30.981793 n-d-master-1 devstack@n-api.service[104130]: X-User-Name: admin Aug 07 01:00:30.981793 n-d-master-1 devstack@n-api.service[104130]: method: > Aug 07 01:00:30.981793 n-d-master-1 devstack@n-api.service[104130]: exception: Flavor 451 could not be found. Aug 07 01:00:30.981793 n-d-master-1 devstack@n-api.service[104130]: action_args: {'id': '451'} Aug 07 01:00:30.981793 n-d-master-1 devstack@n-api.service[104130]: {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:00:30.981793 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:00:30.984292 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 07 01:00:30.984292 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 07 01:00:30.984292 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 01:00:30.984292 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 01:00:30.984292 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:00:30.984292 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:00:30.984292 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 01:00:30.984292 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 01:00:30.984292 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 01:00:30.984292 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:00:30.984292 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 01:00:30.984292 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 01:00:30.984292 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 07 01:00:30.984292 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi Aug 07 01:00:30.984292 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:00:30.984292 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi Aug 07 01:00:30.984292 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:00:30.984292 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:00:30.984292 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:00:30.986735 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:00:30.986735 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:00:30.986735 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:00:30.986735 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:00:30.986735 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 07 01:00:30.986735 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:00:30.986735 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 07 01:00:30.986735 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi Aug 07 01:00:30.986735 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:00:30.986735 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi Aug 07 01:00:30.986735 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:00:30.986735 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:00:30.986735 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:00:30.986735 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:00:30.986735 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:00:30.986735 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 07 01:00:30.986735 n-d-master-1 devstack@n-api.service[104130]: ERROR nova.api.openstack.wsgi Aug 07 01:00:30.986735 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-ea88e312-77cb-4906-8363-1abb6455897b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:00:30.989899 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.requestlog [None req-ea88e312-77cb-4906-8363-1abb6455897b admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013124 Aug 07 01:00:30.989899 n-d-master-1 devstack@n-api.service[104130]: [pid: 104130|app: 0|req: 27/52] 10.222.0.39 () {60 vars in 1193 bytes} [Sun Aug 7 01:00:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 07 01:00:32.004519 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-aabb47ff-4273-43bf-a6b4-408ef6aaa49b admin admin] Calling method '>' {{(pid=104131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:00:32.006303 n-d-master-1 devstack@n-api.service[104131]: INFO nova.api.openstack.requestlog [None req-aabb47ff-4273-43bf-a6b4-408ef6aaa49b admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002516 Aug 07 01:00:32.007047 n-d-master-1 devstack@n-api.service[104131]: [pid: 104131|app: 0|req: 26/53] 10.222.0.39 () {56 vars in 1074 bytes} [Sun Aug 7 01:00:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:00:32.585938 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-68c1aa9e-1d1d-43d6-8c5c-7186b0c4a5cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:00:32.605027 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.requestlog [None req-68c1aa9e-1d1d-43d6-8c5c-7186b0c4a5cc admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.433204 Aug 07 01:00:32.605565 n-d-master-1 devstack@n-api.service[104130]: [pid: 104130|app: 0|req: 28/54] 10.222.0.39 () {64 vars in 1235 bytes} [Sun Aug 7 01:00:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:00:33.777303 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-aabb47ff-4273-43bf-a6b4-408ef6aaa49b admin admin] Calling method '>' {{(pid=104131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:00:33.778397 n-d-master-1 devstack@n-api.service[104131]: INFO nova.api.openstack.requestlog [None req-aabb47ff-4273-43bf-a6b4-408ef6aaa49b admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002104 Aug 07 01:00:33.778903 n-d-master-1 devstack@n-api.service[104131]: [pid: 104131|app: 0|req: 27/55] 10.222.0.39 () {56 vars in 1074 bytes} [Sun Aug 7 01:00:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:00:34.501659 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-e9d4e2ed-4501-4c6c-9ff4-bc68255ecdc7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:00:34.524550 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.requestlog [None req-e9d4e2ed-4501-4c6c-9ff4-bc68255ecdc7 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.599661 Aug 07 01:00:34.525093 n-d-master-1 devstack@n-api.service[104130]: [pid: 104130|app: 0|req: 29/56] 10.222.0.39 () {64 vars in 1235 bytes} [Sun Aug 7 01:00:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:00:35.593931 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-aabb47ff-4273-43bf-a6b4-408ef6aaa49b admin admin] Calling method '>' {{(pid=104131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:00:35.595732 n-d-master-1 devstack@n-api.service[104131]: INFO nova.api.openstack.requestlog [None req-aabb47ff-4273-43bf-a6b4-408ef6aaa49b admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002946 Aug 07 01:00:35.596509 n-d-master-1 devstack@n-api.service[104131]: [pid: 104131|app: 0|req: 28/57] 10.222.0.39 () {56 vars in 1074 bytes} [Sun Aug 7 01:00:35 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:00:36.313120 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-ba283a17-0165-4ea3-81a7-cb761fee2f88 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:00:36.339304 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.requestlog [None req-ba283a17-0165-4ea3-81a7-cb761fee2f88 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.483232 Aug 07 01:00:36.340695 n-d-master-1 devstack@n-api.service[104130]: [pid: 104130|app: 0|req: 30/58] 10.222.0.39 () {64 vars in 1235 bytes} [Sun Aug 7 01:00:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:00:37.371505 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-aabb47ff-4273-43bf-a6b4-408ef6aaa49b admin admin] Calling method '>' {{(pid=104131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:00:37.372555 n-d-master-1 devstack@n-api.service[104131]: INFO nova.api.openstack.requestlog [None req-aabb47ff-4273-43bf-a6b4-408ef6aaa49b admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Aug 07 01:00:37.372953 n-d-master-1 devstack@n-api.service[104131]: [pid: 104131|app: 0|req: 29/59] 10.222.0.39 () {56 vars in 1074 bytes} [Sun Aug 7 01:00:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:00:37.945817 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-ada7e0a5-0484-4824-aab0-d74218be0645 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:00:37.966422 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.requestlog [None req-ada7e0a5-0484-4824-aab0-d74218be0645 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.454796 Aug 07 01:00:37.967652 n-d-master-1 devstack@n-api.service[104130]: [pid: 104130|app: 0|req: 31/60] 10.222.0.39 () {64 vars in 1235 bytes} [Sun Aug 7 01:00:37 2022] POST /compute/v2.1/flavors => generated 409 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:00:38.974709 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-aabb47ff-4273-43bf-a6b4-408ef6aaa49b admin admin] Calling method '>' {{(pid=104131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:00:38.975711 n-d-master-1 devstack@n-api.service[104131]: INFO nova.api.openstack.requestlog [None req-aabb47ff-4273-43bf-a6b4-408ef6aaa49b admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Aug 07 01:00:38.976164 n-d-master-1 devstack@n-api.service[104131]: [pid: 104131|app: 0|req: 30/61] 10.222.0.39 () {56 vars in 1074 bytes} [Sun Aug 7 01:00:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:00:39.561317 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-9fbb4e56-c1e2-4cb2-a41f-504c1dd3524e admin admin] Calling method '>' {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:00:39.581281 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.requestlog [None req-9fbb4e56-c1e2-4cb2-a41f-504c1dd3524e admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.464197 Aug 07 01:00:39.581819 n-d-master-1 devstack@n-api.service[104130]: [pid: 104130|app: 0|req: 32/62] 10.222.0.39 () {60 vars in 1202 bytes} [Sun Aug 7 01:00:39 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:01:47.895619 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-aabb47ff-4273-43bf-a6b4-408ef6aaa49b admin admin] Calling method '>' {{(pid=104131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:01:47.897028 n-d-master-1 devstack@n-api.service[104131]: INFO nova.api.openstack.requestlog [None req-aabb47ff-4273-43bf-a6b4-408ef6aaa49b admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001677 Aug 07 01:01:47.897580 n-d-master-1 devstack@n-api.service[104131]: [pid: 104131|app: 0|req: 31/63] 10.222.0.39 () {54 vars in 931 bytes} [Sun Aug 7 01:01:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:01:47.911543 n-d-master-1 devstack@n-api.service[104130]: DEBUG dbcounter [-] [104130] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=104130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:01:48.553220 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-5d476df2-e2b2-4c9f-b323-e23e4faa5d85 admin admin] Calling method '>' {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:01:48.577685 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.requestlog [None req-5d476df2-e2b2-4c9f-b323-e23e4faa5d85 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.668656 Aug 07 01:01:48.578397 n-d-master-1 devstack@n-api.service[104130]: [pid: 104130|app: 0|req: 33/64] 10.222.0.39 () {60 vars in 1292 bytes} [Sun Aug 7 01:01:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:01:48.607231 n-d-master-1 devstack@n-api.service[104131]: DEBUG dbcounter [-] [104131] Writing DB stats nova_api:SELECT=14 {{(pid=104131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:01:48.615474 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-a4a5d192-37ed-45a2-ae34-02141657d92c admin admin] Calling method '>' {{(pid=104131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:01:48.630942 n-d-master-1 devstack@n-api.service[104131]: INFO nova.api.openstack.requestlog [None req-a4a5d192-37ed-45a2-ae34-02141657d92c admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.029762 Aug 07 01:01:48.632011 n-d-master-1 devstack@n-api.service[104131]: [pid: 104131|app: 0|req: 32/65] 10.222.0.39 () {60 vars in 1283 bytes} [Sun Aug 7 01:01:48 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:01:48.650569 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-13cbcb13-d6d9-407f-8b7a-02ebe43e12d7 admin admin] Calling method '>' {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:01:48.660740 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.requestlog [None req-13cbcb13-d6d9-407f-8b7a-02ebe43e12d7 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014305 Aug 07 01:01:48.661442 n-d-master-1 devstack@n-api.service[104130]: [pid: 104130|app: 0|req: 34/66] 10.222.0.39 () {60 vars in 1286 bytes} [Sun Aug 7 01:01:48 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:01:48.674746 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-e5e27939-a7c2-4378-b030-d25e3361041a admin admin] Calling method '>' {{(pid=104131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:01:48.686357 n-d-master-1 devstack@n-api.service[104131]: INFO nova.api.openstack.requestlog [None req-e5e27939-a7c2-4378-b030-d25e3361041a admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015034 Aug 07 01:01:48.687157 n-d-master-1 devstack@n-api.service[104131]: [pid: 104131|app: 0|req: 33/67] 10.222.0.39 () {60 vars in 1286 bytes} [Sun Aug 7 01:01:48 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:01:48.708525 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-b9f2dfcb-8e3e-4b0b-837b-1ef23ee1b3c0 admin admin] Calling method '>' {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:01:48.722917 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.requestlog [None req-b9f2dfcb-8e3e-4b0b-837b-1ef23ee1b3c0 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.020874 Aug 07 01:01:48.723952 n-d-master-1 devstack@n-api.service[104130]: [pid: 104130|app: 0|req: 35/68] 10.222.0.39 () {60 vars in 1283 bytes} [Sun Aug 7 01:01:48 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:07:44.394538 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-e5e27939-a7c2-4378-b030-d25e3361041a admin admin] Calling method '>' {{(pid=104131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:07:44.395560 n-d-master-1 devstack@n-api.service[104131]: INFO nova.api.openstack.requestlog [None req-e5e27939-a7c2-4378-b030-d25e3361041a admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 07 01:07:44.396288 n-d-master-1 devstack@n-api.service[104131]: [pid: 104131|app: 0|req: 34/69] 10.222.0.39 () {56 vars in 1074 bytes} [Sun Aug 7 01:07:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:07:44.542228 n-d-master-1 devstack@n-api.service[104130]: DEBUG dbcounter [-] [104130] Writing DB stats nova_api:SELECT=6 {{(pid=104130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:44.707208 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-fae2cebb-1d26-419b-8cb8-a46b39fc8ede admin admin] Calling method '>' {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:07:44.709880 n-d-master-1 devstack@n-api.service[104130]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:07:44.709880 n-d-master-1 devstack@n-api.service[104130]: warnings.warn(msg) Aug 07 01:07:44.711109 n-d-master-1 devstack@n-api.service[104130]: DEBUG oslo_concurrency.lockutils [None req-fae2cebb-1d26-419b-8cb8-a46b39fc8ede admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:07:44.711591 n-d-master-1 devstack@n-api.service[104130]: DEBUG oslo_concurrency.lockutils [None req-fae2cebb-1d26-419b-8cb8-a46b39fc8ede admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:07:44.712051 n-d-master-1 devstack@n-api.service[104130]: DEBUG oslo_concurrency.lockutils [None req-fae2cebb-1d26-419b-8cb8-a46b39fc8ede admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:07:44.712772 n-d-master-1 devstack@n-api.service[104130]: DEBUG oslo_concurrency.lockutils [None req-fae2cebb-1d26-419b-8cb8-a46b39fc8ede admin admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:07:44.713215 n-d-master-1 devstack@n-api.service[104130]: DEBUG oslo_concurrency.lockutils [None req-fae2cebb-1d26-419b-8cb8-a46b39fc8ede admin admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:07:44.713630 n-d-master-1 devstack@n-api.service[104130]: DEBUG oslo_concurrency.lockutils [None req-fae2cebb-1d26-419b-8cb8-a46b39fc8ede admin admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:07:44.756932 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.requestlog [None req-fae2cebb-1d26-419b-8cb8-a46b39fc8ede admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.216138 Aug 07 01:07:44.757525 n-d-master-1 devstack@n-api.service[104130]: [pid: 104130|app: 0|req: 36/70] 10.222.0.39 () {60 vars in 1193 bytes} [Sun Aug 7 01:07:44 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:07:45.959556 n-d-master-1 devstack@n-api.service[104131]: DEBUG nova.api.openstack.wsgi [None req-e5e27939-a7c2-4378-b030-d25e3361041a admin admin] Calling method '>' {{(pid=104131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:07:45.961101 n-d-master-1 devstack@n-api.service[104131]: INFO nova.api.openstack.requestlog [None req-e5e27939-a7c2-4378-b030-d25e3361041a admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002024 Aug 07 01:07:45.961585 n-d-master-1 devstack@n-api.service[104131]: [pid: 104131|app: 0|req: 35/71] 10.222.0.39 () {56 vars in 1074 bytes} [Sun Aug 7 01:07:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:07:46.187165 n-d-master-1 devstack@n-api.service[104130]: DEBUG nova.api.openstack.wsgi [None req-2db62d6e-7bbd-4672-86c1-ec1789bdf473 admin admin] Calling method '>' {{(pid=104130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:07:46.190320 n-d-master-1 devstack@n-api.service[104130]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:07:46.190320 n-d-master-1 devstack@n-api.service[104130]: warnings.warn(msg) Aug 07 01:07:46.192368 n-d-master-1 devstack@n-api.service[104130]: DEBUG oslo_concurrency.lockutils [None req-2db62d6e-7bbd-4672-86c1-ec1789bdf473 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:07:46.193046 n-d-master-1 devstack@n-api.service[104130]: DEBUG oslo_concurrency.lockutils [None req-2db62d6e-7bbd-4672-86c1-ec1789bdf473 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:07:46.193585 n-d-master-1 devstack@n-api.service[104130]: DEBUG oslo_concurrency.lockutils [None req-2db62d6e-7bbd-4672-86c1-ec1789bdf473 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=104130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:07:46.194829 n-d-master-1 devstack@n-api.service[104130]: DEBUG oslo_concurrency.lockutils [None req-2db62d6e-7bbd-4672-86c1-ec1789bdf473 admin admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:07:46.195380 n-d-master-1 devstack@n-api.service[104130]: DEBUG oslo_concurrency.lockutils [None req-2db62d6e-7bbd-4672-86c1-ec1789bdf473 admin admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:07:46.195921 n-d-master-1 devstack@n-api.service[104130]: DEBUG oslo_concurrency.lockutils [None req-2db62d6e-7bbd-4672-86c1-ec1789bdf473 admin admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:07:46.227125 n-d-master-1 devstack@n-api.service[104130]: INFO nova.api.openstack.requestlog [None req-2db62d6e-7bbd-4672-86c1-ec1789bdf473 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.123155 Aug 07 01:07:46.228223 n-d-master-1 devstack@n-api.service[104130]: [pid: 104130|app: 0|req: 37/72] 10.222.0.39 () {60 vars in 1193 bytes} [Sun Aug 7 01:07:46 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:08:33.490331 n-d-master-1 devstack@n-api.service[104129]: Sun Aug 7 01:08:33 2022 - graceful shutdown triggered... Aug 07 01:08:33.490916 n-d-master-1 devstack@n-api.service[104131]: Gracefully killing worker 2 (pid: 104131)... Aug 07 01:08:33.491306 n-d-master-1 devstack@n-api.service[104130]: Gracefully killing worker 1 (pid: 104130)... Aug 07 01:08:33.493786 n-d-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 07 01:08:34.491504 n-d-master-1 devstack@n-api.service[104129]: worker 1 buried after 1 seconds Aug 07 01:08:34.491504 n-d-master-1 devstack@n-api.service[104129]: worker 2 buried after 1 seconds Aug 07 01:08:34.491504 n-d-master-1 devstack@n-api.service[104129]: goodbye to uWSGI. Aug 07 01:08:34.493193 n-d-master-1 systemd[1]: devstack@n-api.service: Succeeded. Aug 07 01:08:34.493771 n-d-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 07 01:08:34.496555 n-d-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Aug 07 01:08:34.511779 n-d-master-1 devstack@n-api.service[119500]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 07 01:08:34.514452 n-d-master-1 devstack@n-api.service[119500]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Aug 7 01:08:34 2022] *** Aug 07 01:08:34.514452 n-d-master-1 devstack@n-api.service[119500]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 07 01:08:34.514452 n-d-master-1 devstack@n-api.service[119500]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 07 01:08:34.514452 n-d-master-1 devstack@n-api.service[119500]: nodename: n-d-master-1 Aug 07 01:08:34.514452 n-d-master-1 devstack@n-api.service[119500]: machine: x86_64 Aug 07 01:08:34.514452 n-d-master-1 devstack@n-api.service[119500]: clock source: unix Aug 07 01:08:34.514452 n-d-master-1 devstack@n-api.service[119500]: pcre jit disabled Aug 07 01:08:34.514452 n-d-master-1 devstack@n-api.service[119500]: detected number of CPU cores: 4 Aug 07 01:08:34.514452 n-d-master-1 devstack@n-api.service[119500]: current working directory: / Aug 07 01:08:34.514452 n-d-master-1 devstack@n-api.service[119500]: detected binary path: /usr/bin/uwsgi-core Aug 07 01:08:34.514452 n-d-master-1 devstack@n-api.service[119500]: your processes number limit is 47680 Aug 07 01:08:34.514452 n-d-master-1 devstack@n-api.service[119500]: your memory page size is 4096 bytes Aug 07 01:08:34.514452 n-d-master-1 devstack@n-api.service[119500]: detected max file descriptor number: 2048 Aug 07 01:08:34.515462 n-d-master-1 devstack@n-api.service[119500]: lock engine: pthread robust mutexes Aug 07 01:08:34.515462 n-d-master-1 devstack@n-api.service[119500]: thunder lock: enabled Aug 07 01:08:34.515462 n-d-master-1 devstack@n-api.service[119500]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 07 01:08:34.515462 n-d-master-1 devstack@n-api.service[119500]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 07 01:08:34.558698 n-d-master-1 devstack@n-api.service[119500]: Python main interpreter initialized at 0x561b7a6689c0 Aug 07 01:08:34.558698 n-d-master-1 devstack@n-api.service[119500]: python threads support enabled Aug 07 01:08:34.558698 n-d-master-1 devstack@n-api.service[119500]: your server socket listen backlog is limited to 100 connections Aug 07 01:08:34.558698 n-d-master-1 devstack@n-api.service[119500]: your mercy for graceful operations on workers is 90 seconds Aug 07 01:08:34.559154 n-d-master-1 devstack@n-api.service[119500]: mapped 403077 bytes (393 KB) for 2 cores Aug 07 01:08:34.559292 n-d-master-1 devstack@n-api.service[119500]: *** Operational MODE: preforking *** Aug 07 01:08:34.560131 n-d-master-1 devstack@n-api.service[119500]: *** uWSGI is running in multiple interpreter mode *** Aug 07 01:08:34.560387 n-d-master-1 devstack@n-api.service[119500]: spawned uWSGI master process (pid: 119500) Aug 07 01:08:34.560950 n-d-master-1 systemd[1]: Started Devstack devstack@n-api.service. Aug 07 01:08:34.562798 n-d-master-1 devstack@n-api.service[119500]: spawned uWSGI worker 1 (pid: 119516, cores: 1) Aug 07 01:08:34.563522 n-d-master-1 devstack@n-api.service[119500]: spawned uWSGI worker 2 (pid: 119517, cores: 1) Aug 07 01:08:34.564115 n-d-master-1 devstack@n-api.service[119500]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 07 01:08:35.250929 n-d-master-1 devstack@n-api.service[119516]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 07 01:08:35.268167 n-d-master-1 devstack@n-api.service[119517]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 07 01:08:36.445974 n-d-master-1 devstack@n-api.service[119516]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 01:08:36.445974 n-d-master-1 devstack@n-api.service[119516]: from cryptography.utils import int_from_bytes Aug 07 01:08:36.446635 n-d-master-1 devstack@n-api.service[119516]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 01:08:36.446635 n-d-master-1 devstack@n-api.service[119516]: from cryptography.utils import int_from_bytes Aug 07 01:08:36.457829 n-d-master-1 devstack@n-api.service[119517]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 01:08:36.457829 n-d-master-1 devstack@n-api.service[119517]: from cryptography.utils import int_from_bytes Aug 07 01:08:36.458449 n-d-master-1 devstack@n-api.service[119517]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 01:08:36.458449 n-d-master-1 devstack@n-api.service[119517]: from cryptography.utils import int_from_bytes Aug 07 01:08:38.903427 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 01:08:38.904340 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 01:08:38.904340 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 01:08:38.904620 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 01:08:38.905081 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 01:08:38.905378 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.905636 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.905932 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.906257 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.906694 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.907095 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.908222 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.908222 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.908222 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.908670 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.908670 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.909177 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.909483 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.909790 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.910071 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.910394 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.910727 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.911063 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.911471 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.912022 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.913893 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.913893 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.913893 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.913893 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.915461 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.915461 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.915461 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.915461 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.916936 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.916936 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.916936 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.916936 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.916936 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.918699 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.918699 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.918699 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.918699 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.918699 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.920254 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.920254 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.920254 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.920254 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.921241 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.921241 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.921241 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.921935 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.921935 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.922390 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.925030 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.925030 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.925030 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.925030 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.925030 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.925030 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.925030 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.926760 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.926760 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.926760 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.926760 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.926760 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.926760 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.926760 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.928507 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.928507 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.928507 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.928507 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.928507 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.928507 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.928507 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.930042 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.930042 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.930042 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.930042 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.930042 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.931192 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.931192 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.931192 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.932058 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.932058 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.932058 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.932755 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.932755 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.934286 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.934286 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.934286 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.934286 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.934286 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.935737 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.935737 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.935737 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.935737 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.935737 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.937377 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.937377 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.937377 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.937377 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.938271 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.938271 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.938271 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.939012 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.939012 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.939457 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.939457 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.939942 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.940192 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.940446 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.940758 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.941070 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.941380 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.941702 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.942013 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.942322 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.942648 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.942998 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.944385 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.944385 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.944385 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.944385 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.945317 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.945317 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.945317 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.946367 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.946367 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.946367 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.947071 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.947071 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.947071 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.947760 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.947760 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.948292 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.948292 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.948806 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.949056 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.949299 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.949529 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.949792 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.950115 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:38.950457 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.950873 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.951164 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.951484 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.951819 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.952242 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.952566 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.952881 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.953284 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.954692 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.954692 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.954692 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.954692 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.956639 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.956639 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.956639 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.956639 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.956639 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.956639 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.957439 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.957439 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.957439 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.957894 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.958083 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.959943 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.959943 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.959943 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.959943 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.959943 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.959943 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.961426 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.961426 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.961426 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.961426 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.962318 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.962318 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.962318 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.963005 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.963005 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.963480 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.963760 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.965345 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.965345 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.965345 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.965345 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.965345 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.966466 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.966466 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.966466 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.966466 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.967341 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.967341 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.967341 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.969024 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.969024 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.969024 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.969024 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.969944 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.969944 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.969944 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.970599 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.970837 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.971076 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.971326 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.971651 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.972008 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.972343 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.972658 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.972964 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.973324 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.973703 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.974014 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.975558 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.975558 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.975558 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.975558 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.976581 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.976581 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.976581 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.976581 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.977497 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.977497 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.977497 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.978161 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.978161 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.979113 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.979113 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.979113 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.979793 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.979793 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.980294 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.980294 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.980760 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.981001 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.981327 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.981635 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.981942 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.982273 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.982625 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.982939 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.983284 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.983715 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.984101 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.985679 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.985679 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.985679 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.985679 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.985679 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.986941 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.986941 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.986941 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.987640 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.987640 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.988148 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.988148 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.988630 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.988630 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.989498 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.989498 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.989933 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.989933 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.990398 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.990629 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.990995 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.991344 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.991666 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.992017 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.992332 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.992649 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.992964 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.993277 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.993589 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.994002 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.994325 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.995671 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.995671 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.995671 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.995671 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.996936 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.996936 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.996936 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.996936 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.997849 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.997849 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.997849 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.998485 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.998485 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.999807 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.999807 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:38.999807 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.000517 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.000517 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.000967 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.001212 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.001448 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.001665 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.001936 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.002255 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.002564 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.002875 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.003180 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.003492 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.003818 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.004171 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.004494 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.005035 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.005883 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.005883 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.005883 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.006916 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.006916 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.006916 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.006916 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.007831 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.007831 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.007831 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.008564 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.008564 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.009050 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.009050 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.009624 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.011222 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.011222 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.011222 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.011222 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.011222 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.011222 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.012904 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.012904 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.012904 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.012904 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.012904 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.014084 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.014084 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.014084 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.014084 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.015538 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.015538 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.015538 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.017188 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.017188 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.017188 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.017188 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.017188 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.018379 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.018379 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.018379 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.018379 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.019314 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.019314 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.019314 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.020537 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.020537 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.020537 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.020537 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.021505 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.021505 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.021985 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.021985 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.022451 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.022687 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.022910 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.023202 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.023516 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.024093 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.024349 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.024578 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.024893 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.025478 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.025745 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.027078 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.027078 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.027078 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.027078 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.028098 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.028098 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.028098 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.028751 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.028751 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.029210 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.029210 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.029700 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.029700 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.031133 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.031133 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.031619 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 01:08:39.032514 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.032796 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 01:08:39.033054 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.033054 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.033514 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 01:08:39.033758 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.033758 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.033758 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.034498 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 01:08:39.034742 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.034999 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 01:08:39.035258 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.035258 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.036099 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.036383 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.036383 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.037748 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.038010 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.038010 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.038676 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.038942 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.038942 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.039432 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.039695 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.039695 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.041556 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.041823 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.041823 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.042327 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.042587 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.042836 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.043083 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.043083 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.043597 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.043915 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.043915 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.044408 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.044669 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.044669 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.045134 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.045399 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.045399 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.046186 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.046452 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.046452 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.047975 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.048259 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.048259 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.048879 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.050182 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.050182 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.050672 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.050924 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.051188 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.052176 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.052176 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.052667 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.052945 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.052945 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.053451 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.053710 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.053710 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.054189 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.054448 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.054448 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.054938 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.055187 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.055187 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.055187 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.055868 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.056437 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.056697 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.056944 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.056944 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.058386 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.058662 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.058662 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.059306 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.059554 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.059554 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.060070 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.060418 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.060418 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.060900 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.061153 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.061976 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.062683 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.062683 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.063184 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.063431 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.063431 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.065638 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.065906 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.065906 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.066477 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.066741 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.066992 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.067588 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.067588 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.068233 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.068547 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.068547 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.069062 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.069370 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.069370 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.070215 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.070540 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.070809 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.071061 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.071061 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.071061 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.071500 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.071658 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.071658 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.071983 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.072152 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.072324 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.072509 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.072509 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.072831 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.072984 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.072984 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.073389 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.073542 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.073542 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.073839 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.074002 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.074002 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.074308 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.074470 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.074470 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.074750 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.074915 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.074915 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.075233 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.075387 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.075551 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.075704 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.075704 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.076040 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.076208 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.076208 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.076499 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.076653 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.076653 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.077021 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.077215 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.077374 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.077530 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.077665 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.077826 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.077975 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.078125 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.078125 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.078416 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.078582 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.078582 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.078893 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.079046 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.079046 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.079339 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.079487 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.079654 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.080267 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.080267 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.080637 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.080821 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.080821 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.081118 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.081280 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.081432 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.081582 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.081582 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.081904 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.082069 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.082233 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.082399 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.082399 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.082757 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.082908 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.082908 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.083175 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.083325 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.083325 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.083707 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.083858 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.084045 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.084196 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.084196 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.084476 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.084646 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.084646 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.084924 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.085086 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.085249 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.085423 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.085423 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.085723 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.085876 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.085876 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.086188 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.086354 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.086354 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.086634 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.086798 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.086963 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.087126 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.087126 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.087424 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.087627 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.087627 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.088011 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.088164 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.088164 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.088482 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.088633 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.088784 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.088935 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.088935 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.089243 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.089407 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.089407 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.089407 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.089407 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.090284 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.090503 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.090503 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.090865 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.091030 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.091030 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.091372 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.091533 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.091533 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.091840 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.092026 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.092026 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.092343 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.092505 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.092505 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.092829 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.092991 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.093158 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.093326 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.093326 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.093680 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.093838 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.093838 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.094146 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.094349 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.094349 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.094648 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.094800 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.095007 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.095214 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.095214 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.095590 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.095791 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.095791 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.096102 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.096283 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.096449 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.096601 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.096601 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.096861 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.097006 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.097006 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.097296 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.097444 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.097444 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.097701 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.097852 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.097852 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.098601 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.098751 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.098751 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.098998 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.099156 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.099294 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.099429 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.099429 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.099696 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.099839 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.099839 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.100310 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.100446 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.100446 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.100924 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.101208 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.101208 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.102614 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.102776 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.102776 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.103141 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.103310 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.103464 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.103599 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.103599 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.103944 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.104257 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.104257 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.104646 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.104850 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.104850 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.105202 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.105353 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.105584 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.105724 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.105724 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.106034 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.106201 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.106375 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.106375 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.106375 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.106796 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.106961 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.107124 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.107124 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.107431 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.107594 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.107594 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.107921 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.107921 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.108745 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.108907 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.109061 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.109061 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.109364 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.109364 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.109364 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.109830 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.109830 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.110197 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.110363 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.110363 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.110643 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.110828 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.111297 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.111499 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.111499 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.111912 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.112069 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.112069 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.112374 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.112540 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.112540 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.112834 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.112998 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.113153 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.113324 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.113492 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.113648 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.113811 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.113975 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.113975 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.114267 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.114429 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.114598 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.114752 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.114752 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.115051 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.115204 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.115204 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.115486 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.115637 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.115637 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.115995 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.116149 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.116306 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.116456 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.116456 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.116754 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.116908 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.116908 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.117212 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.117377 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.117377 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.117704 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.117857 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.118020 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.118184 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.118184 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.118497 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 01:08:39.118774 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.118774 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.119069 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.119234 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.119397 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.119558 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.119558 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.119864 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.120053 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.120053 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.120336 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.120510 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.120510 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.120799 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.120953 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.121179 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.121512 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.121512 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.121932 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.122155 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.122155 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.122462 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.122629 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.122629 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.122939 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.123078 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.123078 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.123381 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.123541 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.123694 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.123845 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.123845 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.124317 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.124474 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.124641 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.124806 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.124806 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.125102 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.125277 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.125277 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.125582 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.125736 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.125736 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.126030 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.126195 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.126195 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.126493 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.126661 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.126826 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.126991 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.126991 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.127290 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.127444 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.127591 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.127726 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.127726 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.128065 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.128230 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.128230 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.128525 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.128679 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.128679 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.128957 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.129124 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.129284 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.129436 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.129436 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.129729 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.129881 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.129881 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.130176 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.130328 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.130328 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.130608 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.130781 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.130781 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.131062 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.131228 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.131228 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.131749 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.131943 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.131943 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.132194 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.132360 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.132360 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.132639 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.132805 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.132972 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.133134 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.133134 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.133416 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.133568 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.133568 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.133877 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.134031 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.134183 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.134344 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.134344 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.134709 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.134864 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.134864 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.135156 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.135320 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.135501 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.135666 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.135819 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.135994 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.135994 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.136294 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.136461 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.136626 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.136779 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.136779 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.137069 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.137217 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.137217 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.137518 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.137767 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.137767 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.138137 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.138348 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.138348 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.138709 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.138865 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.139029 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.139195 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.139369 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.140224 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.140393 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.140611 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.140785 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.141090 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.141264 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.141485 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.141716 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.141919 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.142176 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.142394 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.142605 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.142772 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.142935 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.143097 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.143261 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.143419 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.143604 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.143819 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.144030 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.144263 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.144419 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.144586 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.144889 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.145063 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.145218 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.145429 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.145591 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.145806 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.146013 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.146174 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.146422 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.146579 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.146757 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.147046 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.147209 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.147378 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.147590 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.147751 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.148110 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.148274 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.148444 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.148665 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.148827 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.149067 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.149238 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.149402 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.149694 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.149869 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.150035 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.150241 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.150401 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.150612 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.151060 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.151234 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.151555 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.151827 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.152071 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.152208 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.152346 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.152685 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.152835 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.152989 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.153127 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.153292 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.153527 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.153745 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.153903 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.154143 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.154316 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.154482 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.154771 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.154996 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.155226 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.155440 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.155615 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.155824 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.156139 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.156320 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.156498 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.156700 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.156980 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.157220 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.157511 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.157730 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.158033 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.158231 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.158493 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.158791 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.159008 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.159221 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.159399 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.159555 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.159825 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.160035 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.160226 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.160466 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.160758 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.160974 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.161121 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.161376 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.161529 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.161699 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.161987 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.162161 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.162339 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.162549 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.162778 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.163176 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.163382 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.163594 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.163755 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.163941 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.164096 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.164268 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.164424 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.164629 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.164784 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.164970 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.165242 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.165421 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.165587 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.165791 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.165953 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.166178 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.166348 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.166502 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.166789 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.166962 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.167141 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.167348 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.167524 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.167718 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.167957 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.168121 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.168378 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.168566 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.168721 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.171521 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.171726 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.171726 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.172159 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.172346 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.172346 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.172706 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.172923 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.172923 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.173509 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.173720 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.173720 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.174065 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.174235 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.174235 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.174552 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.174716 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.174716 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.175013 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.175178 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.175352 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.175562 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.175562 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.175862 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.176058 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.176232 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.176400 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.176400 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.176701 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.176867 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.176867 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.177187 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.177343 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.177496 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.177651 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.177651 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.177934 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.178117 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.178283 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.178437 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.178437 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.178741 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.178895 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.178895 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 01:08:39.179210 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.179210 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.179671 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.180168 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.180600 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.181043 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.181454 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.181888 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.182342 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.182836 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.183347 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.184011 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.184411 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.184849 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.185275 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.185694 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.186153 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.186672 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.187111 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.187535 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.188015 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.188438 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.188885 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.189312 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.189736 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.190145 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.190598 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.191052 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.191514 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.191973 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.192395 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.192834 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.193259 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.193724 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.194239 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.194677 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.195093 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.195508 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.195960 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.196423 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.196841 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.197252 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.197682 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.198094 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.198505 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.198930 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.199352 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.199812 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.200307 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.200755 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.201201 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.201623 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.202630 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.203643 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.241836 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.241836 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.241836 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.241836 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.241836 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.241836 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.241836 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.241836 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.243935 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.243935 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.243935 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.243935 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.243935 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.243935 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.243935 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.243935 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.250291 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.250291 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.250291 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.250291 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.250291 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.250291 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.250291 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.250291 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.251700 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.251700 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.251700 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.251700 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.251700 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.251700 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.251700 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.251700 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.253107 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.253107 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.253107 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.253107 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.253107 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.253107 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.253107 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.253107 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.254173 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.254173 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.254173 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.254173 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.254173 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.254173 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.254173 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.254173 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.255332 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.255332 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.255332 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.255332 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.255332 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.255332 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.255332 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.255332 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.255833 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.255833 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.255833 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.255833 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.255833 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.255833 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.255833 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.255833 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.256310 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.256310 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.256310 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.256310 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.256310 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.256310 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.256310 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.256310 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.256681 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.256681 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.256681 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.256681 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.256681 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.256681 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.256681 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.256681 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.257038 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.257093 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.257423 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.257879 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.258190 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.258828 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.259288 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.259846 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.260528 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.261343 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.261343 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.262000 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.262410 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.262992 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.263204 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.263481 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.263877 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.264259 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.265166 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.265751 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.266284 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.266284 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.266647 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.266845 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.267181 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.267498 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.267811 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.268163 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.268481 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.269564 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.269900 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.270220 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.270538 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.271474 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.271474 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.271474 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.271817 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.272136 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.272454 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.272883 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.273228 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.273568 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.273891 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.274265 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.274612 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.274947 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.275281 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.275662 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.276372 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.276738 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.277081 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.277439 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.277790 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.278175 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.278648 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.278967 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.279308 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.279630 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.279980 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.280388 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.280725 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.281203 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.281767 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.281897 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.282161 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.282519 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.283008 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.283366 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.283697 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.284045 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.284462 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.284789 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.285113 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.285435 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.285795 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.286152 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.286964 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.287327 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.287707 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.288086 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.288411 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.288759 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.289201 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.289664 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.290135 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.290461 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.290849 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.291325 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.291910 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.292330 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.292673 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.293196 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.293685 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.294189 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.294576 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.294988 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.295362 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.296390 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.296739 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.297127 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.297501 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.297823 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.298143 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.298467 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.298986 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.299338 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.299998 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.300650 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.301012 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.301438 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.301967 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.302211 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.302559 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.302898 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.303331 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.303757 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.304124 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.304461 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.304787 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.305123 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.305458 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.305822 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.306136 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.306449 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.306795 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.307128 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.307452 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.307784 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.308260 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.308755 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.308993 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.309416 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.309864 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.310163 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.310598 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.310952 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.311271 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.311665 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.313093 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.313627 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.314084 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.314361 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.315081 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.315278 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.315482 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.315818 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.316239 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.316573 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.317014 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.317337 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.317676 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.317995 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.318334 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.319026 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.319258 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.319615 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.320039 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.320529 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.320851 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.321191 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.321647 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.321999 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.322389 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.322989 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.323622 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.324242 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.324762 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.325345 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.325912 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.326469 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.327667 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.328178 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.328730 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.329314 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.329822 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.330374 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.330927 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.331462 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.332245 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.332777 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.333344 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.333925 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.334491 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.335055 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.335597 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.336268 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.336813 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.337419 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.337975 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.338560 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.339138 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.339700 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.340298 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.340859 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.341428 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.341993 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.342556 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.343192 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.343743 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.344462 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.344890 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.345864 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.346450 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.347016 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.347590 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.348192 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.348756 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.349315 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.349836 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.350386 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.351012 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.351632 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.352315 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.352977 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.353601 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.354249 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.354966 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.355612 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.356314 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.357484 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.358718 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.359219 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.359726 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.360315 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.360876 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.361429 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.361980 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.362537 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.363103 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.363665 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.364271 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.364822 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.365356 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.365989 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.366722 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.367553 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.367952 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.368507 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.368958 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.369592 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.370687 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.371279 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.371758 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.372167 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.372566 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.372903 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.373241 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.373595 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.373981 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.374305 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.374632 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.374956 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.375274 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.375614 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.375960 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.376354 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.376692 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.377017 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.377608 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.377964 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.378301 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.378753 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.379096 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.379430 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.379749 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.380193 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.380513 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.380826 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.381156 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.381480 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.381945 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.382350 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.382676 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.382999 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.383316 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.383795 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.384156 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.384334 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.384696 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.384931 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.385246 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.385566 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.385882 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.386001 n-d-master-1 devstack@n-api.service[119516]: INFO dbcounter [None req-c5ca167a-f04d-43b1-b286-b256d3881f09 None None] Registered counter for database nova_api Aug 07 01:08:39.386194 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.386518 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.386832 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.387156 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.387473 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.387785 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.388121 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.388442 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.388762 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.389073 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.389387 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.390344 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.390572 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.390933 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.391313 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.391593 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.392077 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.392276 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.392599 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.392959 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.393286 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.395008 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.395008 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.395008 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.395008 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.395926 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.395926 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.395926 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.396528 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.396528 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.396921 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.397128 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.397425 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.397781 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.398085 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.398472 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.399027 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.399501 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.400171 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.400443 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.401198 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.401642 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.402118 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.402623 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.403138 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.403644 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.404132 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.404602 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.405442 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.405885 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.406320 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.406627 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.406950 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.407275 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.407605 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.407977 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.408365 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.408969 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.409191 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.409523 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.409853 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.410198 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.410758 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.411097 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.411316 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_db.sqlalchemy.engines [None req-c5ca167a-f04d-43b1-b286-b256d3881f09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119516) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 01:08:39.411457 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.411744 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.412108 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.412431 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.412767 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.413116 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.413455 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.413788 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.414103 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.414433 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.414767 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.415029 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.415362 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.415679 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.416013 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.416326 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.416647 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.416956 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.417271 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.417618 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.417919 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.418333 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.418534 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.418819 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.419127 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.419432 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.419744 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.420080 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.420401 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.420741 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.421569 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.421881 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.422199 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.422534 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.423578 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.423578 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.423848 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writer thread running {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 01:08:39.424084 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.424084 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.424505 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.425030 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.425471 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.425904 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.426336 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.426761 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.427271 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.428128 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.428779 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.429256 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.429641 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.430011 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.430385 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.430785 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.431222 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.431647 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.432106 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.432696 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.433355 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.433791 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.434214 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.434636 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.435043 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.435484 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.435989 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.436539 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.436830 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.437303 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.437724 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.438107 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.438497 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.439128 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.439618 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.440097 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.440526 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.440967 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.441393 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.441809 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.444384 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.444384 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.444384 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.444384 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.444384 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.444384 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.444384 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 01:08:39.445183 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 01:08:39.522689 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.context [None req-c5ca167a-f04d-43b1-b286-b256d3881f09 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),946acc3b-7b72-45d6-9151-44f3ad85fe4f(cell1) {{(pid=119516) load_cells /opt/stack/nova/nova/context.py:464}} Aug 07 01:08:39.530920 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c5ca167a-f04d-43b1-b286-b256d3881f09 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:08:39.531741 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c5ca167a-f04d-43b1-b286-b256d3881f09 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:08:39.534251 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c5ca167a-f04d-43b1-b286-b256d3881f09 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:08:39.535561 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c5ca167a-f04d-43b1-b286-b256d3881f09 None None] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:08:39.536359 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c5ca167a-f04d-43b1-b286-b256d3881f09 None None] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:08:39.540252 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c5ca167a-f04d-43b1-b286-b256d3881f09 None None] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:08:39.543360 n-d-master-1 devstack@n-api.service[119516]: INFO dbcounter [None req-c5ca167a-f04d-43b1-b286-b256d3881f09 None None] Registered counter for database nova_cell0 Aug 07 01:08:39.549071 n-d-master-1 devstack@n-api.service[119516]: INFO dbcounter [None req-c5ca167a-f04d-43b1-b286-b256d3881f09 None None] Registered counter for database nova_cell1 Aug 07 01:08:39.560692 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_db.sqlalchemy.engines [None req-c5ca167a-f04d-43b1-b286-b256d3881f09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119516) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 01:08:39.564675 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_db.sqlalchemy.engines [None req-c5ca167a-f04d-43b1-b286-b256d3881f09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119516) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 01:08:39.572900 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writer thread running {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 01:08:39.611420 n-d-master-1 devstack@n-api.service[119517]: INFO dbcounter [None req-9c9c32bf-b22e-4f18-8710-f3c3da69d96d None None] Registered counter for database nova_api Aug 07 01:08:39.637070 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_db.sqlalchemy.engines [None req-9c9c32bf-b22e-4f18-8710-f3c3da69d96d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 01:08:39.648992 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writer thread running {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 01:08:39.719620 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.context [None req-9c9c32bf-b22e-4f18-8710-f3c3da69d96d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),946acc3b-7b72-45d6-9151-44f3ad85fe4f(cell1) {{(pid=119517) load_cells /opt/stack/nova/nova/context.py:464}} Aug 07 01:08:39.723989 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9c9c32bf-b22e-4f18-8710-f3c3da69d96d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:08:39.724483 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9c9c32bf-b22e-4f18-8710-f3c3da69d96d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:08:39.726811 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9c9c32bf-b22e-4f18-8710-f3c3da69d96d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:08:39.727026 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9c9c32bf-b22e-4f18-8710-f3c3da69d96d None None] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:08:39.727433 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9c9c32bf-b22e-4f18-8710-f3c3da69d96d None None] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:08:39.729618 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9c9c32bf-b22e-4f18-8710-f3c3da69d96d None None] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:08:39.730642 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writer thread running {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 01:08:39.731749 n-d-master-1 devstack@n-api.service[119517]: INFO dbcounter [None req-9c9c32bf-b22e-4f18-8710-f3c3da69d96d None None] Registered counter for database nova_cell0 Aug 07 01:08:39.737173 n-d-master-1 devstack@n-api.service[119517]: INFO dbcounter [None req-9c9c32bf-b22e-4f18-8710-f3c3da69d96d None None] Registered counter for database nova_cell1 Aug 07 01:08:39.745470 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_db.sqlalchemy.engines [None req-9c9c32bf-b22e-4f18-8710-f3c3da69d96d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 01:08:39.747625 n-d-master-1 devstack@n-api.service[119516]: INFO dbcounter [None req-c5ca167a-f04d-43b1-b286-b256d3881f09 None None] Registered counter for database nova_cell0 Aug 07 01:08:39.752191 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writer thread running {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 01:08:39.757593 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_db.sqlalchemy.engines [None req-9c9c32bf-b22e-4f18-8710-f3c3da69d96d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 01:08:39.758905 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_db.sqlalchemy.engines [None req-c5ca167a-f04d-43b1-b286-b256d3881f09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119516) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 01:08:39.767474 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writer thread running {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 01:08:39.912777 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writer thread running {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 01:08:39.923771 n-d-master-1 devstack@n-api.service[119517]: INFO dbcounter [None req-9c9c32bf-b22e-4f18-8710-f3c3da69d96d None None] Registered counter for database nova_cell0 Aug 07 01:08:39.931251 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_db.sqlalchemy.engines [None req-9c9c32bf-b22e-4f18-8710-f3c3da69d96d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 01:08:39.936353 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writer thread running {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 01:08:40.243374 n-d-master-1 devstack@n-api.service[119516]: WARNING keystonemiddleware.auth_token [None req-c5ca167a-f04d-43b1-b286-b256d3881f09 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 01:08:40.245862 n-d-master-1 devstack@n-api.service[119516]: WARNING keystonemiddleware.auth_token [None req-c5ca167a-f04d-43b1-b286-b256d3881f09 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 01:08:40.391986 n-d-master-1 devstack@n-api.service[119517]: WARNING keystonemiddleware.auth_token [None req-9c9c32bf-b22e-4f18-8710-f3c3da69d96d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 01:08:40.399718 n-d-master-1 devstack@n-api.service[119517]: WARNING keystonemiddleware.auth_token [None req-9c9c32bf-b22e-4f18-8710-f3c3da69d96d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 01:08:40.610203 n-d-master-1 devstack@n-api.service[119516]: WARNING keystonemiddleware.auth_token [None req-c5ca167a-f04d-43b1-b286-b256d3881f09 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 01:08:40.617539 n-d-master-1 devstack@n-api.service[119516]: WARNING keystonemiddleware.auth_token [None req-c5ca167a-f04d-43b1-b286-b256d3881f09 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 01:08:40.625141 n-d-master-1 devstack@n-api.service[119516]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561b7a6689c0 pid: 119516 (default app) Aug 07 01:08:40.763575 n-d-master-1 devstack@n-api.service[119517]: WARNING keystonemiddleware.auth_token [None req-9c9c32bf-b22e-4f18-8710-f3c3da69d96d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 01:08:40.770451 n-d-master-1 devstack@n-api.service[119517]: WARNING keystonemiddleware.auth_token [None req-9c9c32bf-b22e-4f18-8710-f3c3da69d96d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 01:08:40.777265 n-d-master-1 devstack@n-api.service[119517]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561b7a6689c0 pid: 119517 (default app) Aug 07 01:09:23.629475 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:23.632280 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:23.634186 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:23.636063 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:24.507670 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:24.508711 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:24.509468 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:24.510196 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:25.167894 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d99036d3-04ad-4020-9f75-75a693a42cfe tempest-AZAdminNegativeTestJSON-1452412003 tempest-AZAdminNegativeTestJSON-1452412003-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:25.169580 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:25.169580 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:09:25.170523 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d99036d3-04ad-4020-9f75-75a693a42cfe tempest-AZAdminNegativeTestJSON-1452412003 tempest-AZAdminNegativeTestJSON-1452412003-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'ffa98b97de414051938bcbce678fcb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ca0eceda6241cea90089c9a5f6dbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:25.173466 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d99036d3-04ad-4020-9f75-75a693a42cfe tempest-AZAdminNegativeTestJSON-1452412003 tempest-AZAdminNegativeTestJSON-1452412003-project] Request method failure captured: Aug 07 01:09:25.173466 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 07 01:09:25.173466 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:09:25.173466 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:09:25.173466 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:09:25.173466 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:09:25.173466 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:09:25.173466 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:09:25.173466 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:09:25.173466 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:09:25.173466 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xDAozLy0A1q6WEPXOyvROBq_RHVU_2_yampyy-3_iCt45m49Hwvc9CHKZq80JDfzEQC3a95s-2kvbZfxmsfMNckScsSiVhGx0Y20vaCSM03jmVGdIjku6VrMZrAafNdSGaHcOnKvSI2o2R-LtWgksfaqVGMvfoeBBZtr-7WXWZnC0s Aug 07 01:09:25.173466 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:09:25.173466 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:09:25.173466 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:09:25.173466 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:09:25.173466 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:09:25.173466 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:09:25.173466 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: a0ca0eceda6241cea90089c9a5f6dbcd Aug 07 01:09:25.173466 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1452412003 Aug 07 01:09:25.173466 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:09:25.173466 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:09:25.174796 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a0ca0eceda6241cea90089c9a5f6dbcd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a0ca0eceda6241cea90089c9a5f6dbcd", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a0ca0eceda6241cea90089c9a5f6dbcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a0ca0eceda6241cea90089c9a5f6dbcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:09:25.174796 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-AZAdminNegativeTestJSON-1452412003 Aug 07 01:09:25.174796 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: a0ca0eceda6241cea90089c9a5f6dbcd Aug 07 01:09:25.174796 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1452412003 Aug 07 01:09:25.174796 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-AZAdminNegativeTestJSON-1452412003-project Aug 07 01:09:25.174796 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:09:25.174796 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:09:25.174796 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: ffa98b97de414051938bcbce678fcb27 Aug 07 01:09:25.174796 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-AZAdminNegativeTestJSON-1452412003-project Aug 07 01:09:25.174796 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:09:25.174796 n-d-master-1 devstack@n-api.service[119516]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 07 01:09:25.174796 n-d-master-1 devstack@n-api.service[119516]: action_args: {} Aug 07 01:09:25.175623 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:09:25.175623 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:25.175623 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:25.175623 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:25.175623 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:09:25.175623 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:09:25.175623 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:09:25.175623 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:09:25.175623 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 07 01:09:25.175623 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 07 01:09:25.175623 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 07 01:09:25.175623 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 07 01:09:25.175623 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 07 01:09:25.175623 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 07 01:09:25.175623 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:09:25.175623 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:09:25.175623 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:09:25.175623 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:09:25.175623 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 07 01:09:25.177081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 07 01:09:25.177081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 07 01:09:25.177081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 07 01:09:25.177081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 07 01:09:25.177081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 07 01:09:25.177081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 07 01:09:25.177081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:25.177081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:09:25.177081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:25.177081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:25.177081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:25.177081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:25.177081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 07 01:09:25.177081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 07 01:09:25.177081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 07 01:09:25.177081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:25.177081 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d99036d3-04ad-4020-9f75-75a693a42cfe tempest-AZAdminNegativeTestJSON-1452412003 tempest-AZAdminNegativeTestJSON-1452412003-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:09:25.178080 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d99036d3-04ad-4020-9f75-75a693a42cfe tempest-AZAdminNegativeTestJSON-1452412003 tempest-AZAdminNegativeTestJSON-1452412003-project] 10.222.0.39 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 1.555705 Aug 07 01:09:25.178080 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1/1] 10.222.0.39 () {58 vars in 1185 bytes} [Sun Aug 7 01:09:23 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 1559 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:09:26.273916 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-73faf749-fa41-4de7-8d50-e2f63c41ee0c tempest-FlavorsExtraSpecsNegativeTestJSON-31760689 tempest-FlavorsExtraSpecsNegativeTestJSON-31760689-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1342389338", "ram": 512, "vcpus": 1, "disk": 10, "id": 613429221, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:26.295913 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:26.295913 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:09:26.339781 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-73faf749-fa41-4de7-8d50-e2f63c41ee0c tempest-FlavorsExtraSpecsNegativeTestJSON-31760689 tempest-FlavorsExtraSpecsNegativeTestJSON-31760689-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 1.837505 Aug 07 01:09:26.350051 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1/2] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:09:24 2022] POST /compute/v2.1/flavors => generated 413 bytes in 1849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:26.539358 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7e42fa91-4b97-4644-90da-1e66d69e606f tempest-AZAdminV2TestJSON-2040599173 tempest-AZAdminV2TestJSON-2040599173-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:26.541223 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e42fa91-4b97-4644-90da-1e66d69e606f tempest-AZAdminV2TestJSON-2040599173 tempest-AZAdminV2TestJSON-2040599173-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:26.541709 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e42fa91-4b97-4644-90da-1e66d69e606f tempest-AZAdminV2TestJSON-2040599173 tempest-AZAdminV2TestJSON-2040599173-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:26.542148 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e42fa91-4b97-4644-90da-1e66d69e606f tempest-AZAdminV2TestJSON-2040599173 tempest-AZAdminV2TestJSON-2040599173-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:26.542883 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e42fa91-4b97-4644-90da-1e66d69e606f tempest-AZAdminV2TestJSON-2040599173 tempest-AZAdminV2TestJSON-2040599173-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:26.543414 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e42fa91-4b97-4644-90da-1e66d69e606f tempest-AZAdminV2TestJSON-2040599173 tempest-AZAdminV2TestJSON-2040599173-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:26.543844 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e42fa91-4b97-4644-90da-1e66d69e606f tempest-AZAdminV2TestJSON-2040599173 tempest-AZAdminV2TestJSON-2040599173-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:26.607700 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7e42fa91-4b97-4644-90da-1e66d69e606f tempest-AZAdminV2TestJSON-2040599173 tempest-AZAdminV2TestJSON-2040599173-project-admin] 10.222.0.39 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.890524 Aug 07 01:09:26.608814 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2/3] 10.222.0.39 () {58 vars in 1164 bytes} [Sun Aug 7 01:09:25 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 07 01:09:26.687068 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e2ab3d52-216a-4ac2-a350-29109cb9a96d tempest-FlavorsExtraSpecsTestJSON-2113030613 tempest-FlavorsExtraSpecsTestJSON-2113030613-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1805027655", "ram": 512, "vcpus": 1, "disk": 10, "id": 714712554, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:26.717904 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e2ab3d52-216a-4ac2-a350-29109cb9a96d tempest-FlavorsExtraSpecsTestJSON-2113030613 tempest-FlavorsExtraSpecsTestJSON-2113030613-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.366231 Aug 07 01:09:26.719533 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2/4] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:09:26 2022] POST /compute/v2.1/flavors => generated 413 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:27.029642 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bd7661c7-c022-487b-bf58-74ab31f3ffdf tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:27.034463 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:27.034463 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:09:27.037179 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd7661c7-c022-487b-bf58-74ab31f3ffdf tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:27.038969 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd7661c7-c022-487b-bf58-74ab31f3ffdf tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:27.039679 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd7661c7-c022-487b-bf58-74ab31f3ffdf tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:27.040774 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd7661c7-c022-487b-bf58-74ab31f3ffdf tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:27.041488 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd7661c7-c022-487b-bf58-74ab31f3ffdf tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:27.042029 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd7661c7-c022-487b-bf58-74ab31f3ffdf tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:27.092493 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bd7661c7-c022-487b-bf58-74ab31f3ffdf tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.479798 Aug 07 01:09:27.094383 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3/5] 10.222.0.39 () {58 vars in 1176 bytes} [Sun Aug 7 01:09:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:27.160983 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-805a4960-3092-456d-a352-2eaea8b76d84 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Calling method '.version_select at 0x7f9e26fd5e50>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:27.163561 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:27.163561 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:09:27.174974 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-805a4960-3092-456d-a352-2eaea8b76d84 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),946acc3b-7b72-45d6-9151-44f3ad85fe4f(cell1) {{(pid=119517) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 07 01:09:27.176451 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-805a4960-3092-456d-a352-2eaea8b76d84 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:27.177491 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-805a4960-3092-456d-a352-2eaea8b76d84 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:27.178597 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-805a4960-3092-456d-a352-2eaea8b76d84 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:27.227362 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-805a4960-3092-456d-a352-2eaea8b76d84 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:27.228222 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-805a4960-3092-456d-a352-2eaea8b76d84 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:27.229176 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-805a4960-3092-456d-a352-2eaea8b76d84 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:27.261243 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-805a4960-3092-456d-a352-2eaea8b76d84 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:27.262734 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-805a4960-3092-456d-a352-2eaea8b76d84 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:27.263477 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-805a4960-3092-456d-a352-2eaea8b76d84 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:27.274969 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-805a4960-3092-456d-a352-2eaea8b76d84 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.553294 Aug 07 01:09:27.288838 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3/6] 10.222.0.39 () {58 vars in 1167 bytes} [Sun Aug 7 01:09:26 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:27.329354 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c653fcc7-c454-4f64-8822-87acbc6e97c7 tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549 tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:27.360404 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-c653fcc7-c454-4f64-8822-87acbc6e97c7 tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549 tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549-project] HTTP exception thrown: Flavor 613429221 has no extra specs with key hw:cpu_thread_policy. Aug 07 01:09:27.362104 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c653fcc7-c454-4f64-8822-87acbc6e97c7 tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549 tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549-project] Request method failure captured: Aug 07 01:09:27.362104 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/flavors/613429221/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 07 01:09:27.362104 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:09:27.362104 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:09:27.362104 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:09:27.362104 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:09:27.362104 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:09:27.362104 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:09:27.362104 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:09:27.362104 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:09:27.362104 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xDBxaoBg_WL5yp8pLGGmF2Xb-orq3wo_q1-wdnCYPBQ9smeNtduq4dHc24uaF-aIsmo_i7jLlWhjC_nWZxHofj2vqKgMv_6LjMh-jjgxHjEAemgOKyeRxJD-69BiwYBKaeY0YwvgsicOEwyuV8-aubgw1WOxPwolTqutDBUnJDtuOs Aug 07 01:09:27.362104 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:09:27.362104 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:09:27.362104 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:09:27.362104 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:09:27.362104 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:09:27.362104 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:09:27.362104 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 0771943ca95c463998e2c2321dfc3685 Aug 07 01:09:27.362104 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549 Aug 07 01:09:27.362104 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:09:27.362104 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:09:27.364305 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0771943ca95c463998e2c2321dfc3685"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0771943ca95c463998e2c2321dfc3685", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0771943ca95c463998e2c2321dfc3685"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0771943ca95c463998e2c2321dfc3685"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:09:27.364305 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549 Aug 07 01:09:27.364305 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 0771943ca95c463998e2c2321dfc3685 Aug 07 01:09:27.364305 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549 Aug 07 01:09:27.364305 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549-project Aug 07 01:09:27.364305 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:09:27.364305 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:09:27.364305 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: b734b820694444fcb1a4dffda0547775 Aug 07 01:09:27.364305 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549-project Aug 07 01:09:27.364305 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:09:27.364305 n-d-master-1 devstack@n-api.service[119516]: exception: Flavor 613429221 has no extra specs with key hw:cpu_thread_policy. Aug 07 01:09:27.365492 n-d-master-1 devstack@n-api.service[119516]: action_args: {'flavor_id': '613429221', 'id': 'hw:cpu_thread_policy'} Aug 07 01:09:27.365492 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:09:27.365492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:27.365492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 07 01:09:27.365492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 07 01:09:27.365492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 07 01:09:27.365492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:27.365492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:09:27.365492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:27.365492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:27.365492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:27.365492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:27.365492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:09:27.365492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:09:27.365492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:09:27.365492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:09:27.365492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 07 01:09:27.365492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 07 01:09:27.365492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 613429221 has no extra specs with key hw:cpu_thread_policy. Aug 07 01:09:27.365492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:27.365492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:09:27.365492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:27.367728 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:27.367728 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:27.367728 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:27.367728 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:09:27.367728 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:09:27.367728 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 613429221 has no extra specs with key hw:cpu_thread_policy. Aug 07 01:09:27.367728 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:27.369854 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c653fcc7-c454-4f64-8822-87acbc6e97c7 tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549 tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549-project] Returning 404 to user: Flavor 613429221 has no extra specs with key hw:cpu_thread_policy. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:09:27.371655 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c653fcc7-c454-4f64-8822-87acbc6e97c7 tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549 tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549-project] 10.222.0.39 "GET /compute/v2.1/flavors/613429221/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.275633 Aug 07 01:09:27.373131 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4/7] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Aug 7 01:09:27 2022] GET /compute/v2.1/flavors/613429221/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 278 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:09:27.377846 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bcbd53fd-4c5a-4594-b5a8-794ee71117dc tempest-AZAdminV2TestJSON-2040599173 tempest-AZAdminV2TestJSON-2040599173-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:27.378797 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:27.378797 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:09:27.380136 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bcbd53fd-4c5a-4594-b5a8-794ee71117dc tempest-AZAdminV2TestJSON-2040599173 tempest-AZAdminV2TestJSON-2040599173-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:27.380810 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bcbd53fd-4c5a-4594-b5a8-794ee71117dc tempest-AZAdminV2TestJSON-2040599173 tempest-AZAdminV2TestJSON-2040599173-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:27.381445 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bcbd53fd-4c5a-4594-b5a8-794ee71117dc tempest-AZAdminV2TestJSON-2040599173 tempest-AZAdminV2TestJSON-2040599173-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:27.382214 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bcbd53fd-4c5a-4594-b5a8-794ee71117dc tempest-AZAdminV2TestJSON-2040599173 tempest-AZAdminV2TestJSON-2040599173-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:27.382670 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bcbd53fd-4c5a-4594-b5a8-794ee71117dc tempest-AZAdminV2TestJSON-2040599173 tempest-AZAdminV2TestJSON-2040599173-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:27.383097 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bcbd53fd-4c5a-4594-b5a8-794ee71117dc tempest-AZAdminV2TestJSON-2040599173 tempest-AZAdminV2TestJSON-2040599173-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:27.411229 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bcbd53fd-4c5a-4594-b5a8-794ee71117dc tempest-AZAdminV2TestJSON-2040599173 tempest-AZAdminV2TestJSON-2040599173-project-admin] 10.222.0.39 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.035314 Aug 07 01:09:27.416485 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 5/8] 10.222.0.39 () {58 vars in 1185 bytes} [Sun Aug 7 01:09:27 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:27.429879 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-58cc009b-8959-42c2-bde5-439e38e9dc67 tempest-FlavorsExtraSpecsTestJSON-2113030613 tempest-FlavorsExtraSpecsTestJSON-2113030613-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:27.436181 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:27.436181 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:09:27.494181 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-58cc009b-8959-42c2-bde5-439e38e9dc67 tempest-FlavorsExtraSpecsTestJSON-2113030613 tempest-FlavorsExtraSpecsTestJSON-2113030613-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/714712554/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.075147 Aug 07 01:09:27.494781 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 6/9] 10.222.0.39 () {60 vars in 1221 bytes} [Sun Aug 7 01:09:27 2022] POST /compute/v2.1/flavors/714712554/os-extra_specs => generated 66 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:09:27.508304 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b5e34550-061b-4c5e-8df0-c478ca392f67 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1413450782"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:27.528668 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:27.528668 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:09:27.529706 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.aggregate [None req-b5e34550-061b-4c5e-8df0-c478ca392f67 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Generated uuid 867c71fd-b1f3-4e0c-941c-ba9f872e6d69 for aggregate {{(pid=119516) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 07 01:09:27.605373 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b5e34550-061b-4c5e-8df0-c478ca392f67 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.109070 Aug 07 01:09:27.619938 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 7/10] 10.222.0.39 () {60 vars in 1164 bytes} [Sun Aug 7 01:09:27 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:27.626383 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0c749336-ca8e-4d59-8f30-ee5445559505 tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549 tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:27.631379 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:27.631379 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:09:27.632820 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0c749336-ca8e-4d59-8f30-ee5445559505 tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549 tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'b734b820694444fcb1a4dffda0547775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0771943ca95c463998e2c2321dfc3685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:27.637059 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0c749336-ca8e-4d59-8f30-ee5445559505 tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549 tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549-project] Request method failure captured: Aug 07 01:09:27.637059 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/flavors/613429221/os-extra_specs HTTP/1.1 Aug 07 01:09:27.637059 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:09:27.637059 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:09:27.637059 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:09:27.637059 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 66 Aug 07 01:09:27.637059 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:09:27.637059 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:09:27.637059 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:09:27.637059 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:09:27.637059 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xDBxaoBg_WL5yp8pLGGmF2Xb-orq3wo_q1-wdnCYPBQ9smeNtduq4dHc24uaF-aIsmo_i7jLlWhjC_nWZxHofj2vqKgMv_6LjMh-jjgxHjEAemgOKyeRxJD-69BiwYBKaeY0YwvgsicOEwyuV8-aubgw1WOxPwolTqutDBUnJDtuOs Aug 07 01:09:27.637059 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:09:27.637059 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:09:27.637059 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:09:27.637059 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:09:27.637059 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:09:27.637059 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:09:27.637059 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 0771943ca95c463998e2c2321dfc3685 Aug 07 01:09:27.637059 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549 Aug 07 01:09:27.637059 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:09:27.637059 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:09:27.638918 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0771943ca95c463998e2c2321dfc3685"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0771943ca95c463998e2c2321dfc3685", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0771943ca95c463998e2c2321dfc3685"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0771943ca95c463998e2c2321dfc3685"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:09:27.638918 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549 Aug 07 01:09:27.638918 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 0771943ca95c463998e2c2321dfc3685 Aug 07 01:09:27.638918 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549 Aug 07 01:09:27.638918 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549-project Aug 07 01:09:27.638918 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:09:27.638918 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:09:27.638918 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: b734b820694444fcb1a4dffda0547775 Aug 07 01:09:27.638918 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549-project Aug 07 01:09:27.638918 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:09:27.638918 n-d-master-1 devstack@n-api.service[119516]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 07 01:09:27.638918 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:09:27.640171 n-d-master-1 devstack@n-api.service[119516]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 07 01:09:27.640171 n-d-master-1 devstack@n-api.service[119516]: action_args: {'flavor_id': '613429221', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 07 01:09:27.640171 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:09:27.640171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:27.640171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:27.640171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:27.640171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:09:27.640171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:09:27.640171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:09:27.640171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:09:27.640171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:09:27.640171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:09:27.640171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 07 01:09:27.640171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 07 01:09:27.640171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 07 01:09:27.640171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 07 01:09:27.640171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 07 01:09:27.640171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 07 01:09:27.640171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:09:27.647739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:09:27.647739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:09:27.647739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:09:27.647739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 07 01:09:27.647739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 07 01:09:27.647739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 07 01:09:27.647739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 07 01:09:27.647739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 07 01:09:27.647739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 07 01:09:27.647739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 07 01:09:27.647739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:27.647739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:09:27.647739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:27.647739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:27.647739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:27.647739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:27.647739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 07 01:09:27.647739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 07 01:09:27.647739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 07 01:09:27.647739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:27.649125 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0c749336-ca8e-4d59-8f30-ee5445559505 tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549 tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:09:27.649125 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0c749336-ca8e-4d59-8f30-ee5445559505 tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549 tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549-project] 10.222.0.39 "POST /compute/v2.1/flavors/613429221/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.017658 Aug 07 01:09:27.649125 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 8/11] 10.222.0.39 () {60 vars in 1221 bytes} [Sun Aug 7 01:09:27 2022] POST /compute/v2.1/flavors/613429221/os-extra_specs => generated 124 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:09:27.649455 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fd334069-b2de-4c08-b873-a567ba47d845 tempest-AggregatesAdminTestV241-307471853 tempest-AggregatesAdminTestV241-307471853-project-admin] Calling method '.version_select at 0x7f9e26feb430>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:27.649455 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:27.649455 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:09:27.651028 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd334069-b2de-4c08-b873-a567ba47d845 tempest-AggregatesAdminTestV241-307471853 tempest-AggregatesAdminTestV241-307471853-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:27.651202 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd334069-b2de-4c08-b873-a567ba47d845 tempest-AggregatesAdminTestV241-307471853 tempest-AggregatesAdminTestV241-307471853-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:27.651652 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd334069-b2de-4c08-b873-a567ba47d845 tempest-AggregatesAdminTestV241-307471853 tempest-AggregatesAdminTestV241-307471853-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:27.670752 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd334069-b2de-4c08-b873-a567ba47d845 tempest-AggregatesAdminTestV241-307471853 tempest-AggregatesAdminTestV241-307471853-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:27.671289 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd334069-b2de-4c08-b873-a567ba47d845 tempest-AggregatesAdminTestV241-307471853 tempest-AggregatesAdminTestV241-307471853-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:27.671679 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd334069-b2de-4c08-b873-a567ba47d845 tempest-AggregatesAdminTestV241-307471853 tempest-AggregatesAdminTestV241-307471853-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:27.685614 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd334069-b2de-4c08-b873-a567ba47d845 tempest-AggregatesAdminTestV241-307471853 tempest-AggregatesAdminTestV241-307471853-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:27.685614 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd334069-b2de-4c08-b873-a567ba47d845 tempest-AggregatesAdminTestV241-307471853 tempest-AggregatesAdminTestV241-307471853-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:27.686222 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd334069-b2de-4c08-b873-a567ba47d845 tempest-AggregatesAdminTestV241-307471853 tempest-AggregatesAdminTestV241-307471853-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:27.692766 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fd334069-b2de-4c08-b873-a567ba47d845 tempest-AggregatesAdminTestV241-307471853 tempest-AggregatesAdminTestV241-307471853-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.402416 Aug 07 01:09:27.694554 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 4/12] 10.222.0.39 () {60 vars in 1208 bytes} [Sun Aug 7 01:09:27 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:09:27.710069 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a4708773-684f-430a-823c-c576639532c4 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:27.713579 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:27.713579 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:09:27.751449 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4708773-684f-430a-823c-c576639532c4 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:27.752575 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4708773-684f-430a-823c-c576639532c4 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:27.753360 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4708773-684f-430a-823c-c576639532c4 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:28.099345 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b5805c95-426b-48c4-81d2-484427c68508 tempest-FlavorsExtraSpecsTestJSON-1682358274 tempest-FlavorsExtraSpecsTestJSON-1682358274-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:28.112408 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b5805c95-426b-48c4-81d2-484427c68508 tempest-FlavorsExtraSpecsTestJSON-1682358274 tempest-FlavorsExtraSpecsTestJSON-1682358274-project] 10.222.0.39 "GET /compute/v2.1/flavors/714712554/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.469885 Aug 07 01:09:28.113382 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 9/13] 10.222.0.39 () {58 vars in 1200 bytes} [Sun Aug 7 01:09:27 2022] GET /compute/v2.1/flavors/714712554/os-extra_specs => generated 66 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:09:28.124486 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a5b163bb-4394-4efb-b15b-305ea7f5b211 tempest-FlavorsExtraSpecsNegativeTestJSON-31760689 tempest-FlavorsExtraSpecsNegativeTestJSON-31760689-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:28.163851 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a5b163bb-4394-4efb-b15b-305ea7f5b211 tempest-FlavorsExtraSpecsNegativeTestJSON-31760689 tempest-FlavorsExtraSpecsNegativeTestJSON-31760689-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/613429221/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.048670 Aug 07 01:09:28.167145 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 10/14] 10.222.0.39 () {60 vars in 1221 bytes} [Sun Aug 7 01:09:28 2022] POST /compute/v2.1/flavors/613429221/os-extra_specs => generated 66 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:09:28.174247 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0e9feca6-aaf5-4a1a-a326-3235c1817aea tempest-FlavorsExtraSpecsTestJSON-2113030613 tempest-FlavorsExtraSpecsTestJSON-2113030613-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:28.203275 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0e9feca6-aaf5-4a1a-a326-3235c1817aea tempest-FlavorsExtraSpecsTestJSON-2113030613 tempest-FlavorsExtraSpecsTestJSON-2113030613-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/714712554/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.033045 Aug 07 01:09:28.204447 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 11/15] 10.222.0.39 () {60 vars in 1221 bytes} [Sun Aug 7 01:09:28 2022] POST /compute/v2.1/flavors/714712554/os-extra_specs => generated 66 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:09:28.209833 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a1b6495f-5a58-403e-b0a9-95387f3199f8 tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549 tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:28.211082 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:28.211082 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:09:28.212653 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a1b6495f-5a58-403e-b0a9-95387f3199f8 tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549 tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'b734b820694444fcb1a4dffda0547775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0771943ca95c463998e2c2321dfc3685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:28.216354 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a1b6495f-5a58-403e-b0a9-95387f3199f8 tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549 tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549-project] Request method failure captured: Aug 07 01:09:28.216354 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/flavors/613429221/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 07 01:09:28.216354 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:09:28.216354 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:09:28.216354 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:09:28.216354 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:09:28.216354 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:09:28.216354 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:09:28.216354 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:09:28.216354 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:09:28.216354 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xDBxaoBg_WL5yp8pLGGmF2Xb-orq3wo_q1-wdnCYPBQ9smeNtduq4dHc24uaF-aIsmo_i7jLlWhjC_nWZxHofj2vqKgMv_6LjMh-jjgxHjEAemgOKyeRxJD-69BiwYBKaeY0YwvgsicOEwyuV8-aubgw1WOxPwolTqutDBUnJDtuOs Aug 07 01:09:28.216354 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:09:28.216354 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:09:28.216354 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:09:28.216354 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:09:28.216354 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:09:28.216354 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:09:28.216354 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 0771943ca95c463998e2c2321dfc3685 Aug 07 01:09:28.216354 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549 Aug 07 01:09:28.216354 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:09:28.216354 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:09:28.218191 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0771943ca95c463998e2c2321dfc3685"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0771943ca95c463998e2c2321dfc3685", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0771943ca95c463998e2c2321dfc3685"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0771943ca95c463998e2c2321dfc3685"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:09:28.218191 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549 Aug 07 01:09:28.218191 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 0771943ca95c463998e2c2321dfc3685 Aug 07 01:09:28.218191 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549 Aug 07 01:09:28.218191 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549-project Aug 07 01:09:28.218191 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:09:28.218191 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:09:28.218191 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: b734b820694444fcb1a4dffda0547775 Aug 07 01:09:28.218191 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549-project Aug 07 01:09:28.218191 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:09:28.218191 n-d-master-1 devstack@n-api.service[119516]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 07 01:09:28.218829 n-d-master-1 devstack@n-api.service[119516]: action_args: {'flavor_id': '613429221', 'id': 'hw:numa_nodes'} Aug 07 01:09:28.218829 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:09:28.218829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:28.218829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:28.218829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:28.218829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:09:28.218829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:09:28.218829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:09:28.218829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:09:28.218829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 07 01:09:28.218829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 07 01:09:28.218829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 07 01:09:28.218829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 07 01:09:28.218829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 07 01:09:28.218829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 07 01:09:28.218829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:09:28.218829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:09:28.218829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:09:28.218829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:09:28.218829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 07 01:09:28.219878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 07 01:09:28.219878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 07 01:09:28.219878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 07 01:09:28.219878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 07 01:09:28.219878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 07 01:09:28.219878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 07 01:09:28.219878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:28.219878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:09:28.219878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:28.219878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:28.219878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:28.219878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:28.219878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 07 01:09:28.219878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 07 01:09:28.219878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 07 01:09:28.219878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:28.222510 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a1b6495f-5a58-403e-b0a9-95387f3199f8 tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549 tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:09:28.223562 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a1b6495f-5a58-403e-b0a9-95387f3199f8 tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549 tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549-project] 10.222.0.39 "DELETE /compute/v2.1/flavors/613429221/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.017977 Aug 07 01:09:28.224661 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 12/16] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Aug 7 01:09:28 2022] DELETE /compute/v2.1/flavors/613429221/os-extra_specs/hw:numa_nodes => generated 124 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:09:28.229810 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-32d19f34-f561-47e9-85d3-26c009bf2576 tempest-FlavorsExtraSpecsTestJSON-1682358274 tempest-FlavorsExtraSpecsTestJSON-1682358274-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:28.243877 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-32d19f34-f561-47e9-85d3-26c009bf2576 tempest-FlavorsExtraSpecsTestJSON-1682358274 tempest-FlavorsExtraSpecsTestJSON-1682358274-project] 10.222.0.39 "GET /compute/v2.1/flavors/714712554/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.017962 Aug 07 01:09:28.245192 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 13/17] 10.222.0.39 () {58 vars in 1242 bytes} [Sun Aug 7 01:09:28 2022] GET /compute/v2.1/flavors/714712554/os-extra_specs/hw:numa_nodes => generated 22 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:09:28.252516 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e5b27f46-bc0a-46d1-8d8d-0b60d3b735c3 tempest-FlavorsExtraSpecsNegativeTestJSON-31760689 tempest-FlavorsExtraSpecsNegativeTestJSON-31760689-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:28.285486 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e5b27f46-bc0a-46d1-8d8d-0b60d3b735c3 tempest-FlavorsExtraSpecsNegativeTestJSON-31760689 tempest-FlavorsExtraSpecsNegativeTestJSON-31760689-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/613429221/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.039030 Aug 07 01:09:28.286385 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 14/18] 10.222.0.39 () {60 vars in 1221 bytes} [Sun Aug 7 01:09:28 2022] POST /compute/v2.1/flavors/613429221/os-extra_specs => generated 66 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:09:28.292417 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5ad612c9-1da2-4928-bfa6-88db9d22420f tempest-FlavorsExtraSpecsTestJSON-2113030613 tempest-FlavorsExtraSpecsTestJSON-2113030613-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:28.326609 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5ad612c9-1da2-4928-bfa6-88db9d22420f tempest-FlavorsExtraSpecsTestJSON-2113030613 tempest-FlavorsExtraSpecsTestJSON-2113030613-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/714712554/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.038892 Aug 07 01:09:28.328232 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 15/19] 10.222.0.39 () {60 vars in 1221 bytes} [Sun Aug 7 01:09:28 2022] POST /compute/v2.1/flavors/714712554/os-extra_specs => generated 66 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:09:28.333917 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bc777beb-4e38-49e5-8608-3006e64a650e tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549 tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:28.336974 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:28.336974 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:09:28.338244 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bc777beb-4e38-49e5-8608-3006e64a650e tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549 tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'b734b820694444fcb1a4dffda0547775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0771943ca95c463998e2c2321dfc3685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:28.340436 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bc777beb-4e38-49e5-8608-3006e64a650e tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549 tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549-project] Request method failure captured: Aug 07 01:09:28.340436 n-d-master-1 devstack@n-api.service[119516]: request: PUT /compute/v2.1/flavors/613429221/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 07 01:09:28.340436 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:09:28.340436 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:09:28.340436 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:09:28.340436 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 22 Aug 07 01:09:28.340436 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:09:28.340436 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:09:28.340436 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:09:28.340436 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:09:28.340436 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xDBxaoBg_WL5yp8pLGGmF2Xb-orq3wo_q1-wdnCYPBQ9smeNtduq4dHc24uaF-aIsmo_i7jLlWhjC_nWZxHofj2vqKgMv_6LjMh-jjgxHjEAemgOKyeRxJD-69BiwYBKaeY0YwvgsicOEwyuV8-aubgw1WOxPwolTqutDBUnJDtuOs Aug 07 01:09:28.340436 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:09:28.340436 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:09:28.340436 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:09:28.340436 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:09:28.340436 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:09:28.340436 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:09:28.340436 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 0771943ca95c463998e2c2321dfc3685 Aug 07 01:09:28.340436 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549 Aug 07 01:09:28.340436 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:09:28.340436 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:09:28.341817 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0771943ca95c463998e2c2321dfc3685"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0771943ca95c463998e2c2321dfc3685", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0771943ca95c463998e2c2321dfc3685"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0771943ca95c463998e2c2321dfc3685"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:09:28.341817 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549 Aug 07 01:09:28.341817 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 0771943ca95c463998e2c2321dfc3685 Aug 07 01:09:28.341817 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549 Aug 07 01:09:28.341817 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549-project Aug 07 01:09:28.341817 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:09:28.341817 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:09:28.341817 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: b734b820694444fcb1a4dffda0547775 Aug 07 01:09:28.341817 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549-project Aug 07 01:09:28.341817 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:09:28.341817 n-d-master-1 devstack@n-api.service[119516]: {"hw:numa_nodes": "1"} Aug 07 01:09:28.341817 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:09:28.341817 n-d-master-1 devstack@n-api.service[119516]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 07 01:09:28.342628 n-d-master-1 devstack@n-api.service[119516]: action_args: {'flavor_id': '613429221', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 07 01:09:28.342628 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:09:28.342628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:28.342628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:28.342628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:28.342628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:09:28.342628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:09:28.342628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:09:28.342628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:09:28.342628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:09:28.342628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:09:28.342628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 07 01:09:28.342628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 07 01:09:28.342628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 07 01:09:28.342628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 07 01:09:28.342628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 07 01:09:28.342628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 07 01:09:28.342628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:09:28.342628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:09:28.343753 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:09:28.343753 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:09:28.343753 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 07 01:09:28.343753 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 07 01:09:28.343753 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 07 01:09:28.343753 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 07 01:09:28.343753 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 07 01:09:28.343753 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 07 01:09:28.343753 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 07 01:09:28.343753 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:28.343753 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:09:28.343753 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:28.343753 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:28.343753 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:28.343753 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:28.343753 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 07 01:09:28.343753 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 07 01:09:28.343753 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 07 01:09:28.343753 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:28.345692 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bc777beb-4e38-49e5-8608-3006e64a650e tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549 tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:09:28.346680 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bc777beb-4e38-49e5-8608-3006e64a650e tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549 tempest-FlavorsExtraSpecsNegativeTestJSON-1846677549-project] 10.222.0.39 "PUT /compute/v2.1/flavors/613429221/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.017133 Aug 07 01:09:28.347688 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 16/20] 10.222.0.39 () {60 vars in 1262 bytes} [Sun Aug 7 01:09:28 2022] PUT /compute/v2.1/flavors/613429221/os-extra_specs/hw:numa_nodes => generated 124 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:09:28.353086 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e4eb28e5-c727-4f3e-b44e-3f6d3b3d5e80 tempest-FlavorsExtraSpecsTestJSON-2113030613 tempest-FlavorsExtraSpecsTestJSON-2113030613-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:28.367374 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e4eb28e5-c727-4f3e-b44e-3f6d3b3d5e80 tempest-FlavorsExtraSpecsTestJSON-2113030613 tempest-FlavorsExtraSpecsTestJSON-2113030613-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/714712554/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.018579 Aug 07 01:09:28.374396 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 17/21] 10.222.0.39 () {58 vars in 1200 bytes} [Sun Aug 7 01:09:28 2022] GET /compute/v2.1/flavors/714712554/os-extra_specs => generated 66 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:09:28.379320 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fa2fd151-ab80-42cd-b686-76b431f7dadd tempest-FlavorsExtraSpecsNegativeTestJSON-31760689 tempest-FlavorsExtraSpecsNegativeTestJSON-31760689-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:28.388691 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-fa2fd151-ab80-42cd-b686-76b431f7dadd tempest-FlavorsExtraSpecsNegativeTestJSON-31760689 tempest-FlavorsExtraSpecsNegativeTestJSON-31760689-project-admin] HTTP exception thrown: Flavor 613429221 has no extra specs with key hw:cpu_thread_policy. Aug 07 01:09:28.390459 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fa2fd151-ab80-42cd-b686-76b431f7dadd tempest-FlavorsExtraSpecsNegativeTestJSON-31760689 tempest-FlavorsExtraSpecsNegativeTestJSON-31760689-project-admin] Request method failure captured: Aug 07 01:09:28.390459 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/flavors/613429221/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 07 01:09:28.390459 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:09:28.390459 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:09:28.390459 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:09:28.390459 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:09:28.390459 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:09:28.390459 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:09:28.390459 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:09:28.390459 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:09:28.390459 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xDE2tBIYtXMjEfO156U-zn5fbgpz7a8JUc9J4aUJf528U9OFOrFjJClXMd56-SoQw48tR_G2PvJp0WY2wAWs8NJ60szCaG7r-khGgqfF5zy4kuTSmJ2sxMf-1p2S5CaOd1hceYD4EF_IPV1l1ljWzzNguOn-Tn7FeS7ozAXzzMG_TU Aug 07 01:09:28.390459 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:09:28.390459 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:09:28.390459 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:09:28.390459 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:09:28.390459 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:09:28.390459 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:09:28.390459 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 27d4c8103087466ebf02d5402b6edb35 Aug 07 01:09:28.390459 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-31760689 Aug 07 01:09:28.390459 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,admin,member Aug 07 01:09:28.390459 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,admin,member Aug 07 01:09:28.392082 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/27d4c8103087466ebf02d5402b6edb35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_27d4c8103087466ebf02d5402b6edb35", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/27d4c8103087466ebf02d5402b6edb35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/27d4c8103087466ebf02d5402b6edb35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:09:28.392082 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-31760689 Aug 07 01:09:28.392082 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 27d4c8103087466ebf02d5402b6edb35 Aug 07 01:09:28.392082 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-31760689 Aug 07 01:09:28.392082 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-31760689-project-admin Aug 07 01:09:28.392082 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:09:28.392082 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:09:28.392082 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 72b47c4daf644a7eab24521c2f41dfdb Aug 07 01:09:28.392082 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-31760689-project-admin Aug 07 01:09:28.392082 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:09:28.392082 n-d-master-1 devstack@n-api.service[119516]: exception: Flavor 613429221 has no extra specs with key hw:cpu_thread_policy. Aug 07 01:09:28.392804 n-d-master-1 devstack@n-api.service[119516]: action_args: {'flavor_id': '613429221', 'id': 'hw:cpu_thread_policy'} Aug 07 01:09:28.392804 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:09:28.392804 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:28.392804 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 07 01:09:28.392804 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 07 01:09:28.392804 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 07 01:09:28.392804 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:28.392804 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:09:28.392804 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:28.392804 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:28.392804 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:28.392804 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:28.392804 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:09:28.392804 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:09:28.392804 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:09:28.392804 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:09:28.392804 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 07 01:09:28.392804 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 07 01:09:28.392804 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 613429221 has no extra specs with key hw:cpu_thread_policy. Aug 07 01:09:28.392804 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:28.392804 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:09:28.392804 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:28.394130 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:28.394130 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:28.394130 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:28.394130 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:09:28.394130 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:09:28.394130 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 613429221 has no extra specs with key hw:cpu_thread_policy. Aug 07 01:09:28.394130 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:28.394577 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fa2fd151-ab80-42cd-b686-76b431f7dadd tempest-FlavorsExtraSpecsNegativeTestJSON-31760689 tempest-FlavorsExtraSpecsNegativeTestJSON-31760689-project-admin] Returning 404 to user: Flavor 613429221 has no extra specs with key hw:cpu_thread_policy. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:09:28.396446 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fa2fd151-ab80-42cd-b686-76b431f7dadd tempest-FlavorsExtraSpecsNegativeTestJSON-31760689 tempest-FlavorsExtraSpecsNegativeTestJSON-31760689-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/613429221/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.023062 Aug 07 01:09:28.398355 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 18/22] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Aug 7 01:09:28 2022] DELETE /compute/v2.1/flavors/613429221/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:09:28.407846 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4c14cc4c-177d-4557-a352-b32f8a54a29f tempest-FlavorsExtraSpecsTestJSON-2113030613 tempest-FlavorsExtraSpecsTestJSON-2113030613-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:28.485852 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4c14cc4c-177d-4557-a352-b32f8a54a29f tempest-FlavorsExtraSpecsTestJSON-2113030613 tempest-FlavorsExtraSpecsTestJSON-2113030613-project-admin] 10.222.0.39 "PUT /compute/v2.1/flavors/714712554/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.084102 Aug 07 01:09:28.486826 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 19/23] 10.222.0.39 () {60 vars in 1262 bytes} [Sun Aug 7 01:09:28 2022] PUT /compute/v2.1/flavors/714712554/os-extra_specs/hw:numa_nodes => generated 22 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:09:28.497516 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-be67ed98-0e27-48b7-9a8e-5a333f2871df tempest-FlavorsExtraSpecsNegativeTestJSON-31760689 tempest-FlavorsExtraSpecsNegativeTestJSON-31760689-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:28.502565 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-be67ed98-0e27-48b7-9a8e-5a333f2871df tempest-FlavorsExtraSpecsNegativeTestJSON-31760689 tempest-FlavorsExtraSpecsNegativeTestJSON-31760689-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 07 01:09:28.504913 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-be67ed98-0e27-48b7-9a8e-5a333f2871df tempest-FlavorsExtraSpecsNegativeTestJSON-31760689 tempest-FlavorsExtraSpecsNegativeTestJSON-31760689-project-admin] Request method failure captured: Aug 07 01:09:28.504913 n-d-master-1 devstack@n-api.service[119516]: request: PUT /compute/v2.1/flavors/613429221/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 07 01:09:28.504913 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:09:28.504913 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:09:28.504913 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:09:28.504913 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 27 Aug 07 01:09:28.504913 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:09:28.504913 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:09:28.504913 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:09:28.504913 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:09:28.504913 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xDE2tBIYtXMjEfO156U-zn5fbgpz7a8JUc9J4aUJf528U9OFOrFjJClXMd56-SoQw48tR_G2PvJp0WY2wAWs8NJ60szCaG7r-khGgqfF5zy4kuTSmJ2sxMf-1p2S5CaOd1hceYD4EF_IPV1l1ljWzzNguOn-Tn7FeS7ozAXzzMG_TU Aug 07 01:09:28.504913 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:09:28.504913 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:09:28.504913 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:09:28.504913 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:09:28.504913 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:09:28.504913 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:09:28.504913 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 27d4c8103087466ebf02d5402b6edb35 Aug 07 01:09:28.504913 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-31760689 Aug 07 01:09:28.504913 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,admin,member Aug 07 01:09:28.504913 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,admin,member Aug 07 01:09:28.506351 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/27d4c8103087466ebf02d5402b6edb35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_27d4c8103087466ebf02d5402b6edb35", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/27d4c8103087466ebf02d5402b6edb35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/27d4c8103087466ebf02d5402b6edb35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:09:28.506351 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-31760689 Aug 07 01:09:28.506351 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 27d4c8103087466ebf02d5402b6edb35 Aug 07 01:09:28.506351 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-31760689 Aug 07 01:09:28.506351 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-31760689-project-admin Aug 07 01:09:28.506351 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:09:28.506351 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:09:28.506351 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 72b47c4daf644a7eab24521c2f41dfdb Aug 07 01:09:28.506351 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-31760689-project-admin Aug 07 01:09:28.506351 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:09:28.506351 n-d-master-1 devstack@n-api.service[119516]: {"hw:cpu_policy": "shared"} Aug 07 01:09:28.506351 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:09:28.506351 n-d-master-1 devstack@n-api.service[119516]: exception: Request body and URI mismatch Aug 07 01:09:28.507133 n-d-master-1 devstack@n-api.service[119516]: action_args: {'flavor_id': '613429221', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 07 01:09:28.507133 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:09:28.507133 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:28.507133 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:28.507133 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:28.507133 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:09:28.507133 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:09:28.507133 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:09:28.507133 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:09:28.507133 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:09:28.507133 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:09:28.507133 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 07 01:09:28.507133 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 07 01:09:28.507133 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 07 01:09:28.507133 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:28.507133 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:09:28.507133 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:28.507133 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:28.507133 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:28.507133 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:28.508496 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:09:28.508496 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:09:28.508496 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 07 01:09:28.508496 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:28.514074 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-be67ed98-0e27-48b7-9a8e-5a333f2871df tempest-FlavorsExtraSpecsNegativeTestJSON-31760689 tempest-FlavorsExtraSpecsNegativeTestJSON-31760689-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:09:28.515021 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-be67ed98-0e27-48b7-9a8e-5a333f2871df tempest-FlavorsExtraSpecsNegativeTestJSON-31760689 tempest-FlavorsExtraSpecsNegativeTestJSON-31760689-project-admin] 10.222.0.39 "PUT /compute/v2.1/flavors/613429221/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.026920 Aug 07 01:09:28.517951 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 20/24] 10.222.0.39 () {60 vars in 1262 bytes} [Sun Aug 7 01:09:28 2022] PUT /compute/v2.1/flavors/613429221/os-extra_specs/hw:numa_nodes => generated 73 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:28.533913 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-85b18d11-ffa1-4e79-88c6-aa7a131a9f69 tempest-FlavorsExtraSpecsTestJSON-2113030613 tempest-FlavorsExtraSpecsTestJSON-2113030613-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:28.560575 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-85b18d11-ffa1-4e79-88c6-aa7a131a9f69 tempest-FlavorsExtraSpecsTestJSON-2113030613 tempest-FlavorsExtraSpecsTestJSON-2113030613-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/714712554/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.041375 Aug 07 01:09:28.561411 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 21/25] 10.222.0.39 () {58 vars in 1200 bytes} [Sun Aug 7 01:09:28 2022] GET /compute/v2.1/flavors/714712554/os-extra_specs => generated 66 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:09:28.585969 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ed93a296-c152-4209-b987-d720254e4103 tempest-FlavorsExtraSpecsNegativeTestJSON-31760689 tempest-FlavorsExtraSpecsNegativeTestJSON-31760689-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:28.593501 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ed93a296-c152-4209-b987-d720254e4103 tempest-FlavorsExtraSpecsNegativeTestJSON-31760689 tempest-FlavorsExtraSpecsNegativeTestJSON-31760689-project-admin] Request method failure captured: Aug 07 01:09:28.593501 n-d-master-1 devstack@n-api.service[119516]: request: PUT /compute/v2.1/flavors/613429221/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 07 01:09:28.593501 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:09:28.593501 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:09:28.593501 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:09:28.593501 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 49 Aug 07 01:09:28.593501 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:09:28.593501 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:09:28.593501 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:09:28.593501 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:09:28.593501 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xDE2tBIYtXMjEfO156U-zn5fbgpz7a8JUc9J4aUJf528U9OFOrFjJClXMd56-SoQw48tR_G2PvJp0WY2wAWs8NJ60szCaG7r-khGgqfF5zy4kuTSmJ2sxMf-1p2S5CaOd1hceYD4EF_IPV1l1ljWzzNguOn-Tn7FeS7ozAXzzMG_TU Aug 07 01:09:28.593501 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:09:28.593501 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:09:28.593501 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:09:28.593501 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:09:28.593501 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:09:28.593501 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:09:28.593501 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 27d4c8103087466ebf02d5402b6edb35 Aug 07 01:09:28.593501 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-31760689 Aug 07 01:09:28.593501 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,admin,member Aug 07 01:09:28.593501 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,admin,member Aug 07 01:09:28.594857 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/27d4c8103087466ebf02d5402b6edb35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_27d4c8103087466ebf02d5402b6edb35", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/27d4c8103087466ebf02d5402b6edb35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/27d4c8103087466ebf02d5402b6edb35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:09:28.594857 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-31760689 Aug 07 01:09:28.594857 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 27d4c8103087466ebf02d5402b6edb35 Aug 07 01:09:28.594857 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-31760689 Aug 07 01:09:28.594857 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-31760689-project-admin Aug 07 01:09:28.594857 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:09:28.594857 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:09:28.594857 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 72b47c4daf644a7eab24521c2f41dfdb Aug 07 01:09:28.594857 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-31760689-project-admin Aug 07 01:09:28.594857 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:09:28.594857 n-d-master-1 devstack@n-api.service[119516]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 07 01:09:28.594857 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:09:28.595687 n-d-master-1 devstack@n-api.service[119516]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 07 01:09:28.595687 n-d-master-1 devstack@n-api.service[119516]: action_args: {'flavor_id': '613429221', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 07 01:09:28.595687 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:09:28.595687 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:28.595687 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:09:28.595687 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:09:28.595687 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:09:28.595687 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:09:28.595687 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 07 01:09:28.595687 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:28.595687 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 07 01:09:28.595687 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 07 01:09:28.595687 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 07 01:09:28.595687 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 07 01:09:28.595687 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 07 01:09:28.595687 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 07 01:09:28.595687 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 07 01:09:28.595687 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 07 01:09:28.595687 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:28.595687 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi On instance: Aug 07 01:09:28.595687 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 07 01:09:28.595687 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:28.597081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:09:28.597081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:28.597081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:28.597081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:28.597081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:28.597081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:09:28.597081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:09:28.597081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:09:28.597081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:09:28.597081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:09:28.597081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:09:28.597081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:09:28.597081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:09:28.597081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:09:28.597081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:09:28.597081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 07 01:09:28.597081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:28.597081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:09:28.597081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:28.597081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:28.598316 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:28.598316 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:28.598316 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:09:28.598316 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:09:28.598316 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 07 01:09:28.598316 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:28.598316 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ed93a296-c152-4209-b987-d720254e4103 tempest-FlavorsExtraSpecsNegativeTestJSON-31760689 tempest-FlavorsExtraSpecsNegativeTestJSON-31760689-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:09:28.598316 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ed93a296-c152-4209-b987-d720254e4103 tempest-FlavorsExtraSpecsNegativeTestJSON-31760689 tempest-FlavorsExtraSpecsNegativeTestJSON-31760689-project-admin] 10.222.0.39 "PUT /compute/v2.1/flavors/613429221/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.033207 Aug 07 01:09:28.604635 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 22/26] 10.222.0.39 () {60 vars in 1262 bytes} [Sun Aug 7 01:09:28 2022] PUT /compute/v2.1/flavors/613429221/os-extra_specs/hw:numa_nodes => generated 117 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:09:28.613019 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e4982df9-fdc3-4a2b-842a-6866c8ad2bef tempest-FlavorsExtraSpecsTestJSON-2113030613 tempest-FlavorsExtraSpecsTestJSON-2113030613-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:28.635782 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=68,nova_api:SAVEPOINT=13,nova_api:INSERT=5,nova_api:RELEASE=13,nova_api:UPDATE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:28.661391 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e4982df9-fdc3-4a2b-842a-6866c8ad2bef tempest-FlavorsExtraSpecsTestJSON-2113030613 tempest-FlavorsExtraSpecsTestJSON-2113030613-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/714712554/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.053761 Aug 07 01:09:28.662353 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 23/27] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Aug 7 01:09:28 2022] DELETE /compute/v2.1/flavors/714712554/os-extra_specs/hw:numa_nodes => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 07 01:09:28.672721 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-81951a14-35d0-4981-8436-80ca0657bc4c tempest-FlavorsExtraSpecsNegativeTestJSON-31760689 tempest-FlavorsExtraSpecsNegativeTestJSON-31760689-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:28.674103 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:28.674103 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:09:28.717257 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-81951a14-35d0-4981-8436-80ca0657bc4c tempest-FlavorsExtraSpecsNegativeTestJSON-31760689 tempest-FlavorsExtraSpecsNegativeTestJSON-31760689-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/613429221" status: 202 len: 0 microversion: 2.1 time: 0.046824 Aug 07 01:09:28.718043 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 24/28] 10.222.0.39 () {58 vars in 1158 bytes} [Sun Aug 7 01:09:28 2022] DELETE /compute/v2.1/flavors/613429221 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:09:28.724822 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-af9cbbe8-0872-4879-9ebd-264f0345938b tempest-FlavorsExtraSpecsTestJSON-2113030613 tempest-FlavorsExtraSpecsTestJSON-2113030613-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:28.756822 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-af9cbbe8-0872-4879-9ebd-264f0345938b tempest-FlavorsExtraSpecsTestJSON-2113030613 tempest-FlavorsExtraSpecsTestJSON-2113030613-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/714712554/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.036889 Aug 07 01:09:28.763578 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 25/29] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Aug 7 01:09:28 2022] DELETE /compute/v2.1/flavors/714712554/os-extra_specs/hw:cpu_policy => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 07 01:09:28.768474 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6f646572-3fb6-476a-ac31-a58a3abdeea1 tempest-FlavorsExtraSpecsNegativeTestJSON-31760689 tempest-FlavorsExtraSpecsNegativeTestJSON-31760689-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:28.813837 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6f646572-3fb6-476a-ac31-a58a3abdeea1 tempest-FlavorsExtraSpecsNegativeTestJSON-31760689 tempest-FlavorsExtraSpecsNegativeTestJSON-31760689-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.048424 Aug 07 01:09:28.815985 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 26/30] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:09:28 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:28.823328 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-05a9a69b-1abd-4a12-87e4-b137f849ffea tempest-FlavorsExtraSpecsTestJSON-2113030613 tempest-FlavorsExtraSpecsTestJSON-2113030613-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:28.837417 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-05a9a69b-1abd-4a12-87e4-b137f849ffea tempest-FlavorsExtraSpecsTestJSON-2113030613 tempest-FlavorsExtraSpecsTestJSON-2113030613-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/714712554/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.019809 Aug 07 01:09:28.838350 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a4708773-684f-430a-823c-c576639532c4 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 242 microversion: 2.1 time: 1.139479 Aug 07 01:09:28.840794 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 5/31] 10.222.0.39 () {60 vars in 1191 bytes} [Sun Aug 7 01:09:27 2022] POST /compute/v2.1/os-aggregates/1/action => generated 242 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:28.856063 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a559954b-0b71-4c3e-a2e1-d3243c37b1ff tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:28.860551 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 27/32] 10.222.0.39 () {58 vars in 1200 bytes} [Sun Aug 7 01:09:28 2022] GET /compute/v2.1/flavors/714712554/os-extra_specs => generated 19 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:09:28.866789 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:28.866789 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:09:28.876075 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7568b877-ee7e-43d6-a106-d5339c18f382 tempest-FlavorsExtraSpecsTestJSON-2113030613 tempest-FlavorsExtraSpecsTestJSON-2113030613-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:28.898702 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a559954b-0b71-4c3e-a2e1-d3243c37b1ff tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:28.899499 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a559954b-0b71-4c3e-a2e1-d3243c37b1ff tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:28.901760 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a559954b-0b71-4c3e-a2e1-d3243c37b1ff tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:28.901970 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7568b877-ee7e-43d6-a106-d5339c18f382 tempest-FlavorsExtraSpecsTestJSON-2113030613 tempest-FlavorsExtraSpecsTestJSON-2113030613-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/714712554" status: 202 len: 0 microversion: 2.1 time: 0.039073 Aug 07 01:09:28.908977 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 28/33] 10.222.0.39 () {58 vars in 1158 bytes} [Sun Aug 7 01:09:28 2022] DELETE /compute/v2.1/flavors/714712554 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:09:28.915589 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7320fd93-1aad-4b98-abf6-d40e16cf5e35 tempest-FlavorsExtraSpecsTestJSON-2113030613 tempest-FlavorsExtraSpecsTestJSON-2113030613-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:28.944159 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7320fd93-1aad-4b98-abf6-d40e16cf5e35 tempest-FlavorsExtraSpecsTestJSON-2113030613 tempest-FlavorsExtraSpecsTestJSON-2113030613-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033137 Aug 07 01:09:28.956902 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 29/34] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:09:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:28.968635 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-a559954b-0b71-4c3e-a2e1-d3243c37b1ff tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h2-master-1. Aug 07 01:09:28.987487 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a559954b-0b71-4c3e-a2e1-d3243c37b1ff tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Request method failure captured: Aug 07 01:09:28.987487 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Aug 07 01:09:28.987487 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:09:28.987487 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:09:28.987487 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:09:28.987487 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 39 Aug 07 01:09:28.987487 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:09:28.987487 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:09:28.987487 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:09:28.987487 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:09:28.987487 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xDGUZ9RmTbqVfLxECOboo71CWMacBANAin_k2Tk3x3trxWuxylgw0uAn9i777Wm834ATlBkxDkgh8NRkqKsVvKxzV58qc5rV87jpI7xsTCrig69NZ8KuGw7Wy5BPQKSTg6Zi0lQlPGdVBG55TSjF6PxOj6A_Ludtfx-OEOB4lam0XQ Aug 07 01:09:28.987487 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:09:28.987487 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:09:28.987487 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:09:28.987487 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:09:28.987487 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:09:28.987487 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:09:28.987487 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 60b8430a79264d20b633391ab7bc6790 Aug 07 01:09:28.987487 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-957597285 Aug 07 01:09:28.987487 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,admin,member Aug 07 01:09:28.987487 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,admin,member Aug 07 01:09:28.988942 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/60b8430a79264d20b633391ab7bc6790"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_60b8430a79264d20b633391ab7bc6790", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/60b8430a79264d20b633391ab7bc6790"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/60b8430a79264d20b633391ab7bc6790"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:09:28.988942 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-957597285 Aug 07 01:09:28.988942 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 60b8430a79264d20b633391ab7bc6790 Aug 07 01:09:28.988942 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-957597285 Aug 07 01:09:28.988942 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin Aug 07 01:09:28.988942 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:09:28.988942 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:09:28.988942 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: c7f69d5acc5547dba7f05bd2ea205e71 Aug 07 01:09:28.988942 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin Aug 07 01:09:28.988942 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:09:28.988942 n-d-master-1 devstack@n-api.service[119517]: {"add_host": {"host": "n-h2-master-1"}} Aug 07 01:09:28.988942 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:09:28.988942 n-d-master-1 devstack@n-api.service[119517]: exception: Aggregate 1 already has host n-h2-master-1. Aug 07 01:09:28.989789 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h2-master-1'}}} Aug 07 01:09:28.989789 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:09:28.989789 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:28.989789 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 01:09:28.989789 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 07 01:09:28.989789 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 01:09:28.989789 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 07 01:09:28.989789 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 01:09:28.989789 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 07 01:09:28.989789 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 01:09:28.989789 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 07 01:09:28.989789 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 01:09:28.989789 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 01:09:28.989789 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 01:09:28.989789 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result.read() Aug 07 01:09:28.989789 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 01:09:28.989789 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 07 01:09:28.989789 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 01:09:28.989789 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 07 01:09:28.990832 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 01:09:28.990832 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 07 01:09:28.990832 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 01:09:28.990832 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 07 01:09:28.990832 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-master-1-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 07 01:09:28.990832 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:09:28.990832 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 07 01:09:28.990832 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:09:28.990832 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:28.990832 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 07 01:09:28.990832 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 07 01:09:28.990832 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 07 01:09:28.990832 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi session.flush() Aug 07 01:09:28.990832 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 07 01:09:28.990832 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 07 01:09:28.990832 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 07 01:09:28.990832 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 07 01:09:28.990832 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 07 01:09:28.990832 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 07 01:09:28.991810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 01:09:28.991810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception Aug 07 01:09:28.991810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 07 01:09:28.991810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 07 01:09:28.991810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 07 01:09:28.991810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 07 01:09:28.991810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 07 01:09:28.991810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 07 01:09:28.991810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 07 01:09:28.991810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 07 01:09:28.991810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 07 01:09:28.991810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 07 01:09:28.991810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 07 01:09:28.991810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 07 01:09:28.991810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 07 01:09:28.991810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 07 01:09:28.991810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 07 01:09:28.991810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 07 01:09:28.992810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 07 01:09:28.992810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 07 01:09:28.992810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 07 01:09:28.992810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 07 01:09:28.992810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 01:09:28.992810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception Aug 07 01:09:28.992810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 01:09:28.992810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 07 01:09:28.992810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 01:09:28.992810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 07 01:09:28.992810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 01:09:28.992810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 07 01:09:28.992810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 01:09:28.992810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 07 01:09:28.992810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 01:09:28.992810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 01:09:28.992810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 01:09:28.992810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result.read() Aug 07 01:09:28.994004 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 01:09:28.994004 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 07 01:09:28.994004 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 01:09:28.994004 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 07 01:09:28.994004 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 01:09:28.994004 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 07 01:09:28.994004 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 01:09:28.994004 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 07 01:09:28.994004 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-master-1-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 07 01:09:28.994004 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 07 01:09:28.994004 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 7, 1, 9, 28, 945527), 'updated_at': None, 'host': 'n-h2-master-1', 'aggregate_id': 1}] Aug 07 01:09:28.994004 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 07 01:09:28.994004 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:09:28.994004 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:09:28.994004 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:09:28.994004 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:28.994004 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 07 01:09:28.994989 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 07 01:09:28.994989 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 07 01:09:28.994989 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 07 01:09:28.994989 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:09:28.994989 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:09:28.994989 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:09:28.994989 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:09:28.994989 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 07 01:09:28.994989 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 07 01:09:28.994989 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6594, in add_host_to_aggregate Aug 07 01:09:28.994989 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 07 01:09:28.994989 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 07 01:09:28.994989 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 07 01:09:28.994989 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 07 01:09:28.994989 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 07 01:09:28.994989 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 07 01:09:28.994989 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 07 01:09:28.994989 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h2-master-1. Aug 07 01:09:28.994989 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:09:28.994989 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:09:28.996819 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:09:28.996819 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:28.996819 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:28.996819 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:28.996819 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:09:28.996819 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:09:28.996819 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:09:28.996819 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:09:28.996819 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:09:28.996819 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:09:28.996819 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 07 01:09:28.996819 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 07 01:09:28.996819 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h2-master-1. Aug 07 01:09:28.996819 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:09:28.996819 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:09:28.996819 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:09:28.996819 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:28.996819 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:28.996819 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:28.996819 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:09:28.996819 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:09:28.998022 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h2-master-1. Aug 07 01:09:28.998022 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:09:28.998022 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a559954b-0b71-4c3e-a2e1-d3243c37b1ff tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Returning 409 to user: Aggregate 1 already has host n-h2-master-1. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:09:28.998022 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a559954b-0b71-4c3e-a2e1-d3243c37b1ff tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.138772 Aug 07 01:09:28.998022 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 6/35] 10.222.0.39 () {60 vars in 1191 bytes} [Sun Aug 7 01:09:28 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Aug 07 01:09:29.004459 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-47bae026-e80c-4602-85b0-355b06e6dfe6 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:29.008596 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:29.008596 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:09:29.024879 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-47bae026-e80c-4602-85b0-355b06e6dfe6 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:29.026044 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-47bae026-e80c-4602-85b0-355b06e6dfe6 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:29.026651 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-47bae026-e80c-4602-85b0-355b06e6dfe6 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:30.315389 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-47bae026-e80c-4602-85b0-355b06e6dfe6 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 227 microversion: 2.1 time: 1.315258 Aug 07 01:09:30.317751 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 30/36] 10.222.0.39 () {60 vars in 1191 bytes} [Sun Aug 7 01:09:28 2022] POST /compute/v2.1/os-aggregates/1/action => generated 227 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:30.332737 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ed74ec96-5669-4856-aa87-6ab01a2fbcfe tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:30.335589 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:30.335589 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:09:30.376061 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ed74ec96-5669-4856-aa87-6ab01a2fbcfe tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.049802 Aug 07 01:09:30.377045 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 7/37] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Aug 7 01:09:30 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 07 01:09:30.390692 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-26fbd95b-1c45-4f13-aa5f-10d2e3ec4171 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1749548598"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:30.394632 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:30.394632 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:09:30.396190 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.aggregate [None req-26fbd95b-1c45-4f13-aa5f-10d2e3ec4171 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Generated uuid d0a5d381-ecbe-4ccf-bce6-9fc42be1e6a2 for aggregate {{(pid=119516) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 07 01:09:30.428362 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-26fbd95b-1c45-4f13-aa5f-10d2e3ec4171 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.043681 Aug 07 01:09:30.429566 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 31/38] 10.222.0.39 () {60 vars in 1164 bytes} [Sun Aug 7 01:09:30 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:30.464284 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ab666a8b-efe1-41bd-99a8-8e6244c43c10 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1790419660", "name": "tempest-test_aggregate-1666583193"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:30.488461 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:30.488461 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:09:30.489812 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.aggregate [None req-ab666a8b-efe1-41bd-99a8-8e6244c43c10 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Generated uuid 1c2be222-248d-43c0-a0e1-4aaf5777f7ab for aggregate {{(pid=119516) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 07 01:09:30.524360 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ab666a8b-efe1-41bd-99a8-8e6244c43c10 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.064094 Aug 07 01:09:30.533047 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 32/39] 10.222.0.39 () {60 vars in 1165 bytes} [Sun Aug 7 01:09:30 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:09:30.539541 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c44cfe15-707a-4256-b902-f21f0790ae5e tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:30.540902 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:30.540902 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:09:30.558065 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c44cfe15-707a-4256-b902-f21f0790ae5e tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates" status: 200 len: 517 microversion: 2.1 time: 0.023519 Aug 07 01:09:30.558810 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 33/40] 10.222.0.39 () {58 vars in 1143 bytes} [Sun Aug 7 01:09:30 2022] GET /compute/v2.1/os-aggregates => generated 517 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:30.575363 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f0093eab-b696-4b9e-b9e7-4ed6de1cbf75 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:30.588970 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:30.588970 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:09:30.599078 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f0093eab-b696-4b9e-b9e7-4ed6de1cbf75 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:30.600585 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f0093eab-b696-4b9e-b9e7-4ed6de1cbf75 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:30.601438 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f0093eab-b696-4b9e-b9e7-4ed6de1cbf75 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:30.865085 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f0093eab-b696-4b9e-b9e7-4ed6de1cbf75 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 315 microversion: 2.1 time: 0.295214 Aug 07 01:09:30.865734 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 34/41] 10.222.0.39 () {60 vars in 1191 bytes} [Sun Aug 7 01:09:30 2022] POST /compute/v2.1/os-aggregates/3/action => generated 315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:31.132499 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-060a71ff-2478-4cdd-acb8-87789c42e21c tempest-AggregatesAdminNegativeTestJSON-519114725 tempest-AggregatesAdminNegativeTestJSON-519114725-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:31.137483 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:31.137483 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:09:31.138986 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-060a71ff-2478-4cdd-acb8-87789c42e21c tempest-AggregatesAdminNegativeTestJSON-519114725 tempest-AggregatesAdminNegativeTestJSON-519114725-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '60d4f703c4d6468e853b2a27d64df026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e2243d5a54a9d94e8452fe43680c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:31.142107 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-060a71ff-2478-4cdd-acb8-87789c42e21c tempest-AggregatesAdminNegativeTestJSON-519114725 tempest-AggregatesAdminNegativeTestJSON-519114725-project] Request method failure captured: Aug 07 01:09:31.142107 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Aug 07 01:09:31.142107 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:09:31.142107 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:09:31.142107 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:09:31.142107 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 39 Aug 07 01:09:31.142107 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:09:31.142107 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:09:31.142107 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:09:31.142107 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:09:31.142107 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xDCF2oIkE0dKXHC8LC9F2vrw1NTw8uU8jf7G7GkahkDO96Sn7drWmOKYoa3JN4msYUOM2XKl1lx-sVVYtZ31Segcq85iuyK0x05ZIMM04GB04NGeSRniHQurTJ-NsEYHLgCzzH5OvOJL0IQh5xIZnIGc-x4-dN_qavJYW7NiP6gXnE Aug 07 01:09:31.142107 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:09:31.142107 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:09:31.142107 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:09:31.142107 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:09:31.142107 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:09:31.142107 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:09:31.142107 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 248e2243d5a54a9d94e8452fe43680c8 Aug 07 01:09:31.142107 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-519114725 Aug 07 01:09:31.142107 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:09:31.142107 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:09:31.143612 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/248e2243d5a54a9d94e8452fe43680c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_248e2243d5a54a9d94e8452fe43680c8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/248e2243d5a54a9d94e8452fe43680c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/248e2243d5a54a9d94e8452fe43680c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:09:31.143612 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-519114725 Aug 07 01:09:31.143612 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 248e2243d5a54a9d94e8452fe43680c8 Aug 07 01:09:31.143612 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-519114725 Aug 07 01:09:31.143612 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-AggregatesAdminNegativeTestJSON-519114725-project Aug 07 01:09:31.143612 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:09:31.143612 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:09:31.143612 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 60d4f703c4d6468e853b2a27d64df026 Aug 07 01:09:31.143612 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-519114725-project Aug 07 01:09:31.143612 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:09:31.143612 n-d-master-1 devstack@n-api.service[119517]: {"add_host": {"host": "n-h2-master-1"}} Aug 07 01:09:31.143612 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:09:31.143612 n-d-master-1 devstack@n-api.service[119517]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 07 01:09:31.144645 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h2-master-1'}}} Aug 07 01:09:31.144645 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:09:31.144645 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:31.144645 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:31.144645 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:31.144645 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:09:31.144645 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:09:31.144645 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:09:31.144645 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:09:31.144645 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:09:31.144645 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:09:31.144645 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 07 01:09:31.144645 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 07 01:09:31.144645 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 07 01:09:31.144645 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 07 01:09:31.144645 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 07 01:09:31.144645 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 07 01:09:31.144645 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:09:31.144645 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:09:31.146199 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:09:31.146199 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:09:31.146199 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 07 01:09:31.146199 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 07 01:09:31.146199 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 07 01:09:31.146199 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 07 01:09:31.146199 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 07 01:09:31.146199 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 07 01:09:31.146199 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 07 01:09:31.146199 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:09:31.146199 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:09:31.146199 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:09:31.146199 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:31.146199 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:31.146199 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:31.146199 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 07 01:09:31.146199 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 07 01:09:31.146199 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 07 01:09:31.146199 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:09:31.148673 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-060a71ff-2478-4cdd-acb8-87789c42e21c tempest-AggregatesAdminNegativeTestJSON-519114725 tempest-AggregatesAdminNegativeTestJSON-519114725-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:09:31.149742 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-060a71ff-2478-4cdd-acb8-87789c42e21c tempest-AggregatesAdminNegativeTestJSON-519114725 tempest-AggregatesAdminNegativeTestJSON-519114725-project] 10.222.0.39 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.711718 Aug 07 01:09:31.151245 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 8/42] 10.222.0.39 () {60 vars in 1191 bytes} [Sun Aug 7 01:09:30 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 714 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:09:31.162324 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-447b41f8-5d7f-4277-9f5f-611c3e968539 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:31.163272 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:31.163272 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:09:31.213718 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-447b41f8-5d7f-4277-9f5f-611c3e968539 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.056481 Aug 07 01:09:31.214718 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 35/43] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Aug 7 01:09:31 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 07 01:09:31.228811 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1d06961b-e84b-45ed-8320-25401922c171 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1301442248"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:31.237067 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:31.237067 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:09:31.240488 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.aggregate [None req-1d06961b-e84b-45ed-8320-25401922c171 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Generated uuid ce9e04d9-5ed2-4e92-aba8-8a53a9a07817 for aggregate {{(pid=119517) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 07 01:09:31.294478 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1d06961b-e84b-45ed-8320-25401922c171 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.073373 Aug 07 01:09:31.295801 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 9/44] 10.222.0.39 () {60 vars in 1164 bytes} [Sun Aug 7 01:09:31 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:31.306768 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0e3a0d5b-07c4-4e97-834e-1e5158bb293b tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1271669234"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:31.310396 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:31.310396 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:09:31.331728 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0e3a0d5b-07c4-4e97-834e-1e5158bb293b tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),946acc3b-7b72-45d6-9151-44f3ad85fe4f(cell1) {{(pid=119516) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 07 01:09:31.332571 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0e3a0d5b-07c4-4e97-834e-1e5158bb293b tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:31.333059 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0e3a0d5b-07c4-4e97-834e-1e5158bb293b tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:31.333601 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0e3a0d5b-07c4-4e97-834e-1e5158bb293b tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:31.349955 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0e3a0d5b-07c4-4e97-834e-1e5158bb293b tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:31.352030 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0e3a0d5b-07c4-4e97-834e-1e5158bb293b tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:31.354315 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0e3a0d5b-07c4-4e97-834e-1e5158bb293b tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:31.377029 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-0e3a0d5b-07c4-4e97-834e-1e5158bb293b tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1271669234 could not be found. Aug 07 01:09:31.384835 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0e3a0d5b-07c4-4e97-834e-1e5158bb293b tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Request method failure captured: Aug 07 01:09:31.384835 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Aug 07 01:09:31.384835 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:09:31.384835 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:09:31.384835 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:09:31.384835 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 58 Aug 07 01:09:31.384835 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:09:31.384835 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:09:31.384835 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:09:31.384835 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:09:31.384835 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xDGUZ9RmTbqVfLxECOboo71CWMacBANAin_k2Tk3x3trxWuxylgw0uAn9i777Wm834ATlBkxDkgh8NRkqKsVvKxzV58qc5rV87jpI7xsTCrig69NZ8KuGw7Wy5BPQKSTg6Zi0lQlPGdVBG55TSjF6PxOj6A_Ludtfx-OEOB4lam0XQ Aug 07 01:09:31.384835 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:09:31.384835 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:09:31.384835 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:09:31.384835 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:09:31.384835 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:09:31.384835 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:09:31.384835 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 60b8430a79264d20b633391ab7bc6790 Aug 07 01:09:31.384835 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-957597285 Aug 07 01:09:31.384835 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,admin,member Aug 07 01:09:31.384835 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,admin,member Aug 07 01:09:31.386402 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/60b8430a79264d20b633391ab7bc6790"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_60b8430a79264d20b633391ab7bc6790", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/60b8430a79264d20b633391ab7bc6790"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/60b8430a79264d20b633391ab7bc6790"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:09:31.386402 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-957597285 Aug 07 01:09:31.386402 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 60b8430a79264d20b633391ab7bc6790 Aug 07 01:09:31.386402 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-957597285 Aug 07 01:09:31.386402 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin Aug 07 01:09:31.386402 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:09:31.386402 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:09:31.386402 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: c7f69d5acc5547dba7f05bd2ea205e71 Aug 07 01:09:31.386402 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin Aug 07 01:09:31.386402 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:09:31.386402 n-d-master-1 devstack@n-api.service[119516]: {"add_host": {"host": "tempest-nonexist_host-1271669234"}} Aug 07 01:09:31.386402 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:09:31.386402 n-d-master-1 devstack@n-api.service[119516]: exception: Compute host tempest-nonexist_host-1271669234 could not be found. Aug 07 01:09:31.387700 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-1271669234'}}} Aug 07 01:09:31.387700 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:09:31.387700 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:31.387700 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5949, in _get_service_in_cell_by_host Aug 07 01:09:31.387700 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 07 01:09:31.387700 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:09:31.387700 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:09:31.387700 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 07 01:09:31.387700 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 07 01:09:31.387700 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 07 01:09:31.387700 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 07 01:09:31.387700 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 07 01:09:31.387700 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 07 01:09:31.387700 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1271669234' is not mapped to any cell Aug 07 01:09:31.387700 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:31.387700 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:09:31.387700 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:31.387700 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:31.387700 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5955, in _get_service_in_cell_by_host Aug 07 01:09:31.389152 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 07 01:09:31.389152 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 07 01:09:31.389152 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 07 01:09:31.389152 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 07 01:09:31.389152 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:31.389152 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:09:31.389152 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:31.389152 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:31.389152 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 07 01:09:31.389152 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 07 01:09:31.389152 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 07 01:09:31.389152 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 07 01:09:31.389152 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:09:31.389152 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:09:31.389152 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:09:31.389152 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:09:31.389152 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 07 01:09:31.389152 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 07 01:09:31.389152 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6574, in add_host_to_aggregate Aug 07 01:09:31.389152 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 07 01:09:31.390542 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5957, in _get_service_in_cell_by_host Aug 07 01:09:31.390542 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 07 01:09:31.390542 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1271669234 could not be found. Aug 07 01:09:31.390542 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:31.390542 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:09:31.390542 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:31.390542 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:31.390542 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:31.390542 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:31.390542 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:09:31.390542 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:09:31.390542 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:09:31.390542 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:09:31.390542 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:09:31.390542 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:09:31.390542 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 07 01:09:31.390542 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:09:31.390542 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1271669234 could not be found. Aug 07 01:09:31.390542 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:31.390542 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:09:31.390542 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:31.392413 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:31.392413 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:31.392413 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:31.392413 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:09:31.392413 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:09:31.392413 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1271669234 could not be found. Aug 07 01:09:31.392413 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:31.394446 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0e3a0d5b-07c4-4e97-834e-1e5158bb293b tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1271669234 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:09:31.395479 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0e3a0d5b-07c4-4e97-834e-1e5158bb293b tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 111 microversion: 2.1 time: 0.092454 Aug 07 01:09:31.396687 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 36/45] 10.222.0.39 () {60 vars in 1191 bytes} [Sun Aug 7 01:09:31 2022] POST /compute/v2.1/os-aggregates/4/action => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:09:31.407945 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dee31db7-b1f5-4895-bc62-a0e8d01a724f tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:31.410314 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:31.410314 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:09:31.444071 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-dee31db7-b1f5-4895-bc62-a0e8d01a724f tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.042247 Aug 07 01:09:31.445016 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 37/46] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Aug 7 01:09:31 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 07 01:09:31.456426 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-69e11d5d-8cd0-4be4-a579-14ed7a399d52 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:31.461094 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-69e11d5d-8cd0-4be4-a579-14ed7a399d52 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Request method failure captured: Aug 07 01:09:31.461094 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 07 01:09:31.461094 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:09:31.461094 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:09:31.461094 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:09:31.461094 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 283 Aug 07 01:09:31.461094 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:09:31.461094 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:09:31.461094 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:09:31.461094 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:09:31.461094 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xDGUZ9RmTbqVfLxECOboo71CWMacBANAin_k2Tk3x3trxWuxylgw0uAn9i777Wm834ATlBkxDkgh8NRkqKsVvKxzV58qc5rV87jpI7xsTCrig69NZ8KuGw7Wy5BPQKSTg6Zi0lQlPGdVBG55TSjF6PxOj6A_Ludtfx-OEOB4lam0XQ Aug 07 01:09:31.461094 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:09:31.461094 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:09:31.461094 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:09:31.461094 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:09:31.461094 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:09:31.461094 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:09:31.461094 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 60b8430a79264d20b633391ab7bc6790 Aug 07 01:09:31.461094 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-957597285 Aug 07 01:09:31.461094 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,admin,member Aug 07 01:09:31.461094 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,admin,member Aug 07 01:09:31.462519 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/60b8430a79264d20b633391ab7bc6790"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_60b8430a79264d20b633391ab7bc6790", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/60b8430a79264d20b633391ab7bc6790"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/60b8430a79264d20b633391ab7bc6790"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:09:31.462519 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-957597285 Aug 07 01:09:31.462519 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 60b8430a79264d20b633391ab7bc6790 Aug 07 01:09:31.462519 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-957597285 Aug 07 01:09:31.462519 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin Aug 07 01:09:31.462519 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:09:31.462519 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:09:31.462519 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: c7f69d5acc5547dba7f05bd2ea205e71 Aug 07 01:09:31.462519 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin Aug 07 01:09:31.462519 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:09:31.463153 n-d-master-1 devstack@n-api.service[119516]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 07 01:09:31.463153 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:09:31.463153 n-d-master-1 devstack@n-api.service[119516]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 07 01:09:31.463153 n-d-master-1 devstack@n-api.service[119516]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 07 01:09:31.463153 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:09:31.463153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:31.463153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:09:31.463153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:09:31.463153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:09:31.463153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:09:31.463843 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 07 01:09:31.463843 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:31.463843 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 07 01:09:31.463843 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 07 01:09:31.463843 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:31.463843 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 07 01:09:31.463843 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 07 01:09:31.463843 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:31.463843 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:09:31.463843 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:31.463843 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:31.463843 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:31.463843 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:31.463843 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:09:31.463843 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:09:31.463843 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:09:31.463843 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:09:31.465116 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:09:31.465116 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:09:31.465116 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:09:31.465116 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:09:31.465116 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:09:31.465116 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:09:31.465116 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:09:31.465116 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:09:31.465116 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 07 01:09:31.465116 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:31.465116 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:09:31.465116 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:31.465116 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:31.465116 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:31.465116 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:31.466098 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:09:31.466098 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:09:31.466098 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 07 01:09:31.466098 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:31.467381 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-69e11d5d-8cd0-4be4-a579-14ed7a399d52 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:09:31.468535 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-69e11d5d-8cd0-4be4-a579-14ed7a399d52 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.017697 Aug 07 01:09:31.469858 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 38/47] 10.222.0.39 () {60 vars in 1165 bytes} [Sun Aug 7 01:09:31 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:09:31.479833 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-48231013-8e2e-4d6c-ad82-706f799d0062 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:31.485348 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-48231013-8e2e-4d6c-ad82-706f799d0062 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Request method failure captured: Aug 07 01:09:31.485348 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 07 01:09:31.485348 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:09:31.485348 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:09:31.485348 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:09:31.485348 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 27 Aug 07 01:09:31.485348 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:09:31.485348 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:09:31.485348 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:09:31.485348 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:09:31.485348 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xDGUZ9RmTbqVfLxECOboo71CWMacBANAin_k2Tk3x3trxWuxylgw0uAn9i777Wm834ATlBkxDkgh8NRkqKsVvKxzV58qc5rV87jpI7xsTCrig69NZ8KuGw7Wy5BPQKSTg6Zi0lQlPGdVBG55TSjF6PxOj6A_Ludtfx-OEOB4lam0XQ Aug 07 01:09:31.485348 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:09:31.485348 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:09:31.485348 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:09:31.485348 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:09:31.485348 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:09:31.485348 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:09:31.485348 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 60b8430a79264d20b633391ab7bc6790 Aug 07 01:09:31.485348 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-957597285 Aug 07 01:09:31.485348 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,admin,member Aug 07 01:09:31.485348 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,admin,member Aug 07 01:09:31.486460 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/60b8430a79264d20b633391ab7bc6790"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_60b8430a79264d20b633391ab7bc6790", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/60b8430a79264d20b633391ab7bc6790"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/60b8430a79264d20b633391ab7bc6790"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:09:31.486460 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-957597285 Aug 07 01:09:31.486460 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 60b8430a79264d20b633391ab7bc6790 Aug 07 01:09:31.486460 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-957597285 Aug 07 01:09:31.486460 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin Aug 07 01:09:31.486460 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:09:31.486460 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:09:31.486460 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: c7f69d5acc5547dba7f05bd2ea205e71 Aug 07 01:09:31.486460 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin Aug 07 01:09:31.486460 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:09:31.486460 n-d-master-1 devstack@n-api.service[119516]: {"aggregate": {"name": ""}} Aug 07 01:09:31.486460 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:09:31.486460 n-d-master-1 devstack@n-api.service[119516]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 07 01:09:31.487282 n-d-master-1 devstack@n-api.service[119516]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 07 01:09:31.487282 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:09:31.487282 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:31.487282 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:09:31.487282 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:09:31.487282 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:09:31.487282 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:09:31.487282 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 07 01:09:31.487282 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:31.487282 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 07 01:09:31.487282 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 07 01:09:31.487282 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:31.487282 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 07 01:09:31.487282 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi '' Aug 07 01:09:31.487282 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:31.487282 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:09:31.487282 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:31.487282 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:31.487282 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:31.487282 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:31.487282 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:09:31.487282 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:09:31.487282 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:09:31.494049 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:09:31.494049 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:09:31.494049 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:09:31.494049 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:09:31.494049 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:09:31.494049 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:09:31.494049 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:09:31.494049 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:09:31.494049 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:09:31.494049 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 07 01:09:31.494049 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:31.494049 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:09:31.494049 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:31.494049 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:31.494049 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:31.494049 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:31.494049 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:09:31.494049 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:09:31.494049 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 07 01:09:31.494049 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:31.495552 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-48231013-8e2e-4d6c-ad82-706f799d0062 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:09:31.495552 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-48231013-8e2e-4d6c-ad82-706f799d0062 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.011919 Aug 07 01:09:31.495552 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 39/48] 10.222.0.39 () {60 vars in 1164 bytes} [Sun Aug 7 01:09:31 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 07 01:09:31.501461 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d8fbaa81-843a-4c4c-b7cf-cd1916dbdb54 tempest-AggregatesAdminNegativeTestJSON-519114725 tempest-AggregatesAdminNegativeTestJSON-519114725-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-772733257"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:31.504842 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:31.504842 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:09:31.506008 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d8fbaa81-843a-4c4c-b7cf-cd1916dbdb54 tempest-AggregatesAdminNegativeTestJSON-519114725 tempest-AggregatesAdminNegativeTestJSON-519114725-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '60d4f703c4d6468e853b2a27d64df026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e2243d5a54a9d94e8452fe43680c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:31.508025 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d8fbaa81-843a-4c4c-b7cf-cd1916dbdb54 tempest-AggregatesAdminNegativeTestJSON-519114725 tempest-AggregatesAdminNegativeTestJSON-519114725-project] Request method failure captured: Aug 07 01:09:31.508025 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 07 01:09:31.508025 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:09:31.508025 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:09:31.508025 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:09:31.508025 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 59 Aug 07 01:09:31.508025 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:09:31.508025 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:09:31.508025 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:09:31.508025 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:09:31.508025 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xDCF2oIkE0dKXHC8LC9F2vrw1NTw8uU8jf7G7GkahkDO96Sn7drWmOKYoa3JN4msYUOM2XKl1lx-sVVYtZ31Segcq85iuyK0x05ZIMM04GB04NGeSRniHQurTJ-NsEYHLgCzzH5OvOJL0IQh5xIZnIGc-x4-dN_qavJYW7NiP6gXnE Aug 07 01:09:31.508025 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:09:31.508025 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:09:31.508025 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:09:31.508025 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:09:31.508025 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:09:31.508025 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:09:31.508025 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 248e2243d5a54a9d94e8452fe43680c8 Aug 07 01:09:31.508025 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-519114725 Aug 07 01:09:31.508025 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:09:31.508025 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:09:31.509653 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/248e2243d5a54a9d94e8452fe43680c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_248e2243d5a54a9d94e8452fe43680c8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/248e2243d5a54a9d94e8452fe43680c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/248e2243d5a54a9d94e8452fe43680c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:09:31.509653 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-519114725 Aug 07 01:09:31.509653 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 248e2243d5a54a9d94e8452fe43680c8 Aug 07 01:09:31.509653 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-519114725 Aug 07 01:09:31.509653 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-AggregatesAdminNegativeTestJSON-519114725-project Aug 07 01:09:31.509653 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:09:31.509653 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:09:31.509653 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 60d4f703c4d6468e853b2a27d64df026 Aug 07 01:09:31.509653 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-519114725-project Aug 07 01:09:31.509653 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:09:31.509653 n-d-master-1 devstack@n-api.service[119516]: {"aggregate": {"name": "tempest-test_aggregate-772733257"}} Aug 07 01:09:31.509653 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:09:31.509653 n-d-master-1 devstack@n-api.service[119516]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 07 01:09:31.510564 n-d-master-1 devstack@n-api.service[119516]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-772733257'}}} Aug 07 01:09:31.510564 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:09:31.510564 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:31.510564 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:31.510564 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:31.510564 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:09:31.510564 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:09:31.510564 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:09:31.510564 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:09:31.510564 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:09:31.510564 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:09:31.510564 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:09:31.510564 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:09:31.510564 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 07 01:09:31.510564 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 07 01:09:31.510564 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 07 01:09:31.510564 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 07 01:09:31.510564 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 07 01:09:31.510564 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 07 01:09:31.512650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:09:31.512650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:09:31.512650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:09:31.512650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:09:31.512650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 07 01:09:31.512650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 07 01:09:31.512650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 07 01:09:31.512650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 07 01:09:31.512650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 07 01:09:31.512650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 07 01:09:31.512650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 07 01:09:31.512650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:31.512650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:09:31.512650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:31.512650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:31.512650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:31.512650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:31.512650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 07 01:09:31.512650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 07 01:09:31.512650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 07 01:09:31.514384 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:31.514384 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d8fbaa81-843a-4c4c-b7cf-cd1916dbdb54 tempest-AggregatesAdminNegativeTestJSON-519114725 tempest-AggregatesAdminNegativeTestJSON-519114725-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:09:31.514384 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d8fbaa81-843a-4c4c-b7cf-cd1916dbdb54 tempest-AggregatesAdminNegativeTestJSON-519114725 tempest-AggregatesAdminNegativeTestJSON-519114725-project] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.015523 Aug 07 01:09:31.514384 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 40/49] 10.222.0.39 () {60 vars in 1164 bytes} [Sun Aug 7 01:09:31 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:09:31.525233 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a2274f7e-fc94-4f1b-8e37-0dad38b6efa7 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1132363565"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:31.530128 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.aggregate [None req-a2274f7e-fc94-4f1b-8e37-0dad38b6efa7 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Generated uuid 9a2a17cb-23b6-4f74-a026-aba1e22f57b1 for aggregate {{(pid=119516) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 07 01:09:31.560100 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a2274f7e-fc94-4f1b-8e37-0dad38b6efa7 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.040957 Aug 07 01:09:31.561771 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 41/50] 10.222.0.39 () {60 vars in 1164 bytes} [Sun Aug 7 01:09:31 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:31.576383 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-863121af-94a9-4342-a087-e4e6504ab67e tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1132363565"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:31.580369 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:31.580369 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:09:31.582016 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.aggregate [None req-863121af-94a9-4342-a087-e4e6504ab67e tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Generated uuid 51b162ab-bf22-4d38-a2b0-a2b604146e5a for aggregate {{(pid=119516) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 07 01:09:31.606207 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-863121af-94a9-4342-a087-e4e6504ab67e tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1132363565 already exists. Aug 07 01:09:31.614859 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-863121af-94a9-4342-a087-e4e6504ab67e tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Request method failure captured: Aug 07 01:09:31.614859 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 07 01:09:31.614859 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:09:31.614859 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:09:31.614859 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:09:31.614859 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 60 Aug 07 01:09:31.614859 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:09:31.614859 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:09:31.614859 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:09:31.614859 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:09:31.614859 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xDGUZ9RmTbqVfLxECOboo71CWMacBANAin_k2Tk3x3trxWuxylgw0uAn9i777Wm834ATlBkxDkgh8NRkqKsVvKxzV58qc5rV87jpI7xsTCrig69NZ8KuGw7Wy5BPQKSTg6Zi0lQlPGdVBG55TSjF6PxOj6A_Ludtfx-OEOB4lam0XQ Aug 07 01:09:31.614859 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:09:31.614859 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:09:31.614859 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:09:31.614859 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:09:31.614859 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:09:31.614859 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:09:31.614859 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 60b8430a79264d20b633391ab7bc6790 Aug 07 01:09:31.614859 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-957597285 Aug 07 01:09:31.614859 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,admin,member Aug 07 01:09:31.614859 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,admin,member Aug 07 01:09:31.617392 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/60b8430a79264d20b633391ab7bc6790"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_60b8430a79264d20b633391ab7bc6790", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/60b8430a79264d20b633391ab7bc6790"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/60b8430a79264d20b633391ab7bc6790"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:09:31.617392 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-957597285 Aug 07 01:09:31.617392 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 60b8430a79264d20b633391ab7bc6790 Aug 07 01:09:31.617392 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-957597285 Aug 07 01:09:31.617392 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin Aug 07 01:09:31.617392 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:09:31.617392 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:09:31.617392 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: c7f69d5acc5547dba7f05bd2ea205e71 Aug 07 01:09:31.617392 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin Aug 07 01:09:31.617392 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:09:31.617392 n-d-master-1 devstack@n-api.service[119516]: {"aggregate": {"name": "tempest-test_aggregate-1132363565"}} Aug 07 01:09:31.617392 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:09:31.617392 n-d-master-1 devstack@n-api.service[119516]: exception: Aggregate tempest-test_aggregate-1132363565 already exists. Aug 07 01:09:31.618643 n-d-master-1 devstack@n-api.service[119516]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1132363565'}}} Aug 07 01:09:31.618643 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:09:31.618643 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:31.618643 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 07 01:09:31.618643 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 07 01:09:31.618643 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 07 01:09:31.618643 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 07 01:09:31.618643 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:09:31.618643 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:09:31.618643 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:09:31.618643 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:09:31.618643 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 07 01:09:31.618643 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 07 01:09:31.618643 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6411, in create_aggregate Aug 07 01:09:31.618643 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 07 01:09:31.618643 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 07 01:09:31.618643 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 07 01:09:31.618643 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 07 01:09:31.618643 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 07 01:09:31.620743 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 07 01:09:31.620743 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 07 01:09:31.620743 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 07 01:09:31.620743 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 07 01:09:31.620743 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1132363565 already exists. Aug 07 01:09:31.620743 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:31.620743 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:09:31.620743 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:31.620743 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:31.620743 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:31.620743 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:31.620743 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:09:31.620743 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:09:31.620743 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:09:31.620743 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:09:31.620743 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:09:31.620743 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:09:31.620743 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:09:31.620743 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:09:31.620743 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 07 01:09:31.624172 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 07 01:09:31.624172 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1132363565 already exists. Aug 07 01:09:31.624172 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:31.624172 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:09:31.624172 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:31.624172 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:31.624172 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:31.624172 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:31.624172 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:09:31.624172 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:09:31.624172 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1132363565 already exists. Aug 07 01:09:31.624172 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:31.624172 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-863121af-94a9-4342-a087-e4e6504ab67e tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1132363565 already exists. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:09:31.624172 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-863121af-94a9-4342-a087-e4e6504ab67e tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.050367 Aug 07 01:09:31.627189 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 42/51] 10.222.0.39 () {60 vars in 1164 bytes} [Sun Aug 7 01:09:31 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:09:31.641081 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-77ab3317-4edd-4ed2-9800-6010f64a19fb tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:31.642037 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:31.642037 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:09:31.693888 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-77ab3317-4edd-4ed2-9800-6010f64a19fb tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.063910 Aug 07 01:09:31.694820 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 43/52] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Aug 7 01:09:31 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 07 01:09:32.007364 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ad6b7379-4695-4603-8dde-17550f7b17a0 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-353728046", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "availability_zone": "tempest-test_az-1790419660"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:32.062838 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad6b7379-4695-4603-8dde-17550f7b17a0 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:32.065319 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad6b7379-4695-4603-8dde-17550f7b17a0 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:32.067078 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad6b7379-4695-4603-8dde-17550f7b17a0 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:32.070287 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad6b7379-4695-4603-8dde-17550f7b17a0 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:32.072077 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad6b7379-4695-4603-8dde-17550f7b17a0 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:32.072816 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad6b7379-4695-4603-8dde-17550f7b17a0 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:32.153057 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e3ecbe6a-6fd6-4308-9ce9-2b5735b210e6 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-644624570", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:33.151932 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-ad6b7379-4695-4603-8dde-17550f7b17a0 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] validate_networks() for None {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:09:33.192004 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-e3ecbe6a-6fd6-4308-9ce9-2b5735b210e6 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] validate_networks() for None {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:09:33.501385 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e3ecbe6a-6fd6-4308-9ce9-2b5735b210e6 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:09:33.501808 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e3ecbe6a-6fd6-4308-9ce9-2b5735b210e6 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:09:33.502358 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e3ecbe6a-6fd6-4308-9ce9-2b5735b210e6 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:09:33.502685 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e3ecbe6a-6fd6-4308-9ce9-2b5735b210e6 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:09:33.503098 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e3ecbe6a-6fd6-4308-9ce9-2b5735b210e6 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:09:33.519137 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3ecbe6a-6fd6-4308-9ce9-2b5735b210e6 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:33.520470 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3ecbe6a-6fd6-4308-9ce9-2b5735b210e6 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:33.521284 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3ecbe6a-6fd6-4308-9ce9-2b5735b210e6 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:33.522076 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3ecbe6a-6fd6-4308-9ce9-2b5735b210e6 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:33.522553 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3ecbe6a-6fd6-4308-9ce9-2b5735b210e6 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:33.523572 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3ecbe6a-6fd6-4308-9ce9-2b5735b210e6 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:33.542051 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-ad6b7379-4695-4603-8dde-17550f7b17a0 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:09:33.542482 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-ad6b7379-4695-4603-8dde-17550f7b17a0 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:09:33.543540 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-ad6b7379-4695-4603-8dde-17550f7b17a0 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:09:33.544060 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-ad6b7379-4695-4603-8dde-17550f7b17a0 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:09:33.544667 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-ad6b7379-4695-4603-8dde-17550f7b17a0 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:09:33.560362 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad6b7379-4695-4603-8dde-17550f7b17a0 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:33.560850 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad6b7379-4695-4603-8dde-17550f7b17a0 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:33.561296 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad6b7379-4695-4603-8dde-17550f7b17a0 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:33.562063 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad6b7379-4695-4603-8dde-17550f7b17a0 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:33.563102 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad6b7379-4695-4603-8dde-17550f7b17a0 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:33.563992 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad6b7379-4695-4603-8dde-17550f7b17a0 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:33.569090 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-e3ecbe6a-6fd6-4308-9ce9-2b5735b210e6 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Getting quotas for project 8d0af4ec538f41868c10700c90e816d6. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:09:33.579208 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-e3ecbe6a-6fd6-4308-9ce9-2b5735b210e6 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Getting quotas for user 2e60f068764c4a259771662a83663cb9 and project 8d0af4ec538f41868c10700c90e816d6. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:09:33.594737 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=15,nova_api:INSERT=5 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:33.596910 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e3ecbe6a-6fd6-4308-9ce9-2b5735b210e6 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:09:33.600247 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e3ecbe6a-6fd6-4308-9ce9-2b5735b210e6 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] [instance: e40f1306-cb41-4d73-94a2-aeea34eb0f0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:09:33.607871 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-ad6b7379-4695-4603-8dde-17550f7b17a0 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Getting quotas for project c15e7e61e7eb4c9490b7632bde85d2cd. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:09:33.617109 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-ad6b7379-4695-4603-8dde-17550f7b17a0 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Getting quotas for user 37a892781ecd4300b6dd10b9c235e263 and project c15e7e61e7eb4c9490b7632bde85d2cd. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:09:33.636091 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ad6b7379-4695-4603-8dde-17550f7b17a0 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:09:33.648909 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ad6b7379-4695-4603-8dde-17550f7b17a0 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] [instance: 7028fed0-c1db-491a-b46f-345ead213c7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:09:33.683392 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e3ecbe6a-6fd6-4308-9ce9-2b5735b210e6 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.980912 Aug 07 01:09:33.696802 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 44/53] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:09:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:09:33.706818 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3126ca0c-158e-4577-918f-eadb8b0cfc0a tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-529098774"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:33.711682 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:33.711682 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:09:33.713126 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.aggregate [None req-3126ca0c-158e-4577-918f-eadb8b0cfc0a tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Generated uuid 628afeb7-53d4-4d68-9dc9-9d22d1024d6a for aggregate {{(pid=119516) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 07 01:09:33.723296 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ad6b7379-4695-4603-8dde-17550f7b17a0 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.394077 Aug 07 01:09:33.725467 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 10/54] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:09:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2398 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 07 01:09:33.732057 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b8ca345c-3fee-4470-ac30-1a8fa31719da tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:33.733046 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b8ca345c-3fee-4470-ac30-1a8fa31719da tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] [instance: e40f1306-cb41-4d73-94a2-aeea34eb0f0c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:33.764629 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3126ca0c-158e-4577-918f-eadb8b0cfc0a tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.065804 Aug 07 01:09:33.769158 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 45/55] 10.222.0.39 () {60 vars in 1164 bytes} [Sun Aug 7 01:09:33 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:33.780910 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-70df96c6-5467-48b6-9c66-59096bfd9e59 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:33.782032 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-70df96c6-5467-48b6-9c66-59096bfd9e59 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] [instance: 7028fed0-c1db-491a-b46f-345ead213c7a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:33.898020 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b8ca345c-3fee-4470-ac30-1a8fa31719da tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e60f068764c4a259771662a83663cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0af4ec538f41868c10700c90e816d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:33.925044 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-70df96c6-5467-48b6-9c66-59096bfd9e59 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a892781ecd4300b6dd10b9c235e263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e7e61e7eb4c9490b7632bde85d2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:33.926323 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b8ca345c-3fee-4470-ac30-1a8fa31719da tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] 10.222.0.39 "GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c" status: 200 len: 1213 microversion: 2.1 time: 0.198259 Aug 07 01:09:33.936278 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 11/56] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:33 2022] GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c => generated 1213 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:33.936278 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c9985980-3674-480f-a737-bdd4508360e8 tempest-AggregatesAdminNegativeTestJSON-519114725 tempest-AggregatesAdminNegativeTestJSON-519114725-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:33.936278 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:33.936278 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:09:33.936278 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c9985980-3674-480f-a737-bdd4508360e8 tempest-AggregatesAdminNegativeTestJSON-519114725 tempest-AggregatesAdminNegativeTestJSON-519114725-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '60d4f703c4d6468e853b2a27d64df026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e2243d5a54a9d94e8452fe43680c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:33.938005 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c9985980-3674-480f-a737-bdd4508360e8 tempest-AggregatesAdminNegativeTestJSON-519114725 tempest-AggregatesAdminNegativeTestJSON-519114725-project] Request method failure captured: Aug 07 01:09:33.938005 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Aug 07 01:09:33.938005 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:09:33.938005 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:09:33.938005 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:09:33.938005 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:09:33.938005 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:09:33.938005 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:09:33.938005 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:09:33.938005 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:09:33.938005 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xDCF2oIkE0dKXHC8LC9F2vrw1NTw8uU8jf7G7GkahkDO96Sn7drWmOKYoa3JN4msYUOM2XKl1lx-sVVYtZ31Segcq85iuyK0x05ZIMM04GB04NGeSRniHQurTJ-NsEYHLgCzzH5OvOJL0IQh5xIZnIGc-x4-dN_qavJYW7NiP6gXnE Aug 07 01:09:33.938005 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:09:33.938005 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:09:33.938005 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:09:33.938005 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:09:33.938005 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:09:33.938005 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:09:33.938005 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 248e2243d5a54a9d94e8452fe43680c8 Aug 07 01:09:33.938005 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-519114725 Aug 07 01:09:33.938005 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:09:33.938005 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:09:33.939212 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/248e2243d5a54a9d94e8452fe43680c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_248e2243d5a54a9d94e8452fe43680c8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/248e2243d5a54a9d94e8452fe43680c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/248e2243d5a54a9d94e8452fe43680c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:09:33.939212 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-519114725 Aug 07 01:09:33.939212 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 248e2243d5a54a9d94e8452fe43680c8 Aug 07 01:09:33.939212 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-519114725 Aug 07 01:09:33.939212 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-AggregatesAdminNegativeTestJSON-519114725-project Aug 07 01:09:33.939212 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:09:33.939212 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:09:33.939212 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 60d4f703c4d6468e853b2a27d64df026 Aug 07 01:09:33.939212 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-519114725-project Aug 07 01:09:33.939212 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:09:33.939212 n-d-master-1 devstack@n-api.service[119517]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 07 01:09:33.939212 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '6'} Aug 07 01:09:33.939822 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:09:33.939822 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:33.939822 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:33.939822 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:33.939822 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:09:33.939822 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:09:33.939822 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:09:33.939822 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:09:33.939822 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 07 01:09:33.939822 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 07 01:09:33.939822 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 07 01:09:33.939822 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 07 01:09:33.939822 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 07 01:09:33.939822 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 07 01:09:33.939822 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:09:33.939822 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:09:33.939822 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:09:33.939822 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:09:33.939822 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 07 01:09:33.940785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 07 01:09:33.940785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 07 01:09:33.940785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 07 01:09:33.940785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 07 01:09:33.940785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 07 01:09:33.940785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 07 01:09:33.940785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:09:33.940785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:09:33.940785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:09:33.940785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:33.940785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:33.940785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:33.940785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 07 01:09:33.940785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 07 01:09:33.940785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 07 01:09:33.940785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:09:33.940785 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c9985980-3674-480f-a737-bdd4508360e8 tempest-AggregatesAdminNegativeTestJSON-519114725 tempest-AggregatesAdminNegativeTestJSON-519114725-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:09:33.941806 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c9985980-3674-480f-a737-bdd4508360e8 tempest-AggregatesAdminNegativeTestJSON-519114725 tempest-AggregatesAdminNegativeTestJSON-519114725-project] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.011050 Aug 07 01:09:33.941806 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 12/57] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Aug 7 01:09:33 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:09:33.950474 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-70df96c6-5467-48b6-9c66-59096bfd9e59 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] 10.222.0.39 "GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a" status: 200 len: 1242 microversion: 2.1 time: 0.180031 Aug 07 01:09:33.953243 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-11c08d90-4e42-4c6c-b751-b8180df52ccd tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:33.963637 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 46/58] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:33 2022] GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a => generated 1242 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:33.997573 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-11c08d90-4e42-4c6c-b751-b8180df52ccd tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.048925 Aug 07 01:09:33.998302 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 13/59] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Aug 7 01:09:33 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 07 01:09:34.010891 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-61fdbb3c-6aff-46f9-b075-d96317e83c42 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:34.012170 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:34.012170 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:09:34.030521 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-61fdbb3c-6aff-46f9-b075-d96317e83c42 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 07 01:09:34.033282 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-61fdbb3c-6aff-46f9-b075-d96317e83c42 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Request method failure captured: Aug 07 01:09:34.033282 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 07 01:09:34.033282 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:09:34.033282 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:09:34.033282 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:09:34.033282 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:09:34.033282 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:09:34.033282 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:09:34.033282 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:09:34.033282 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:09:34.033282 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xDGUZ9RmTbqVfLxECOboo71CWMacBANAin_k2Tk3x3trxWuxylgw0uAn9i777Wm834ATlBkxDkgh8NRkqKsVvKxzV58qc5rV87jpI7xsTCrig69NZ8KuGw7Wy5BPQKSTg6Zi0lQlPGdVBG55TSjF6PxOj6A_Ludtfx-OEOB4lam0XQ Aug 07 01:09:34.033282 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:09:34.033282 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:09:34.033282 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:09:34.033282 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:09:34.033282 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:09:34.033282 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:09:34.033282 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 60b8430a79264d20b633391ab7bc6790 Aug 07 01:09:34.033282 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-957597285 Aug 07 01:09:34.033282 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,admin,member Aug 07 01:09:34.033282 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,admin,member Aug 07 01:09:34.035509 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/60b8430a79264d20b633391ab7bc6790"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_60b8430a79264d20b633391ab7bc6790", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/60b8430a79264d20b633391ab7bc6790"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/60b8430a79264d20b633391ab7bc6790"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:09:34.035509 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-957597285 Aug 07 01:09:34.035509 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 60b8430a79264d20b633391ab7bc6790 Aug 07 01:09:34.035509 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-957597285 Aug 07 01:09:34.035509 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin Aug 07 01:09:34.035509 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:09:34.035509 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:09:34.035509 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: c7f69d5acc5547dba7f05bd2ea205e71 Aug 07 01:09:34.035509 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin Aug 07 01:09:34.035509 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:09:34.035509 n-d-master-1 devstack@n-api.service[119516]: exception: Aggregate -1 could not be found. Aug 07 01:09:34.035509 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '-1'} Aug 07 01:09:34.036777 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:09:34.036777 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:34.036777 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 07 01:09:34.036777 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 07 01:09:34.036777 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 07 01:09:34.036777 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 07 01:09:34.036777 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:09:34.036777 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:09:34.036777 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:09:34.036777 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:09:34.036777 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 07 01:09:34.036777 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 07 01:09:34.036777 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6470, in delete_aggregate Aug 07 01:09:34.036777 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 07 01:09:34.036777 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:09:34.036777 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:09:34.036777 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 07 01:09:34.036777 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 07 01:09:34.036777 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 07 01:09:34.038573 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 07 01:09:34.038573 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 07 01:09:34.038573 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 07 01:09:34.038573 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 07 01:09:34.038573 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:34.038573 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:09:34.038573 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:34.038573 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:34.038573 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:34.038573 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:34.038573 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:09:34.038573 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:09:34.038573 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:09:34.038573 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:09:34.038573 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 07 01:09:34.038573 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:09:34.038573 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 07 01:09:34.038573 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:34.038573 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:09:34.038573 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:34.038573 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:34.040668 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:34.040668 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:34.040668 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:09:34.040668 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:09:34.040668 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 07 01:09:34.040668 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:34.040668 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-61fdbb3c-6aff-46f9-b075-d96317e83c42 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:09:34.040668 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-61fdbb3c-6aff-46f9-b075-d96317e83c42 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.029892 Aug 07 01:09:34.044591 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 47/60] 10.222.0.39 () {58 vars in 1155 bytes} [Sun Aug 7 01:09:34 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:09:34.048382 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fb7350e0-3dfc-422c-9a4d-0eaf52c180cd tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-734963212"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:34.053090 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:34.053090 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:09:34.054426 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.aggregate [None req-fb7350e0-3dfc-422c-9a4d-0eaf52c180cd tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Generated uuid 6f81b58f-5512-4dc9-b349-e9419659f2ee for aggregate {{(pid=119517) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 07 01:09:34.082037 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fb7350e0-3dfc-422c-9a4d-0eaf52c180cd tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.037511 Aug 07 01:09:34.083801 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 14/61] 10.222.0.39 () {60 vars in 1164 bytes} [Sun Aug 7 01:09:34 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:34.103425 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2a2b8384-6777-40ed-adfb-1ed60cb585d2 tempest-AggregatesAdminNegativeTestJSON-519114725 tempest-AggregatesAdminNegativeTestJSON-519114725-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:34.104366 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:34.104366 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:09:34.105322 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2a2b8384-6777-40ed-adfb-1ed60cb585d2 tempest-AggregatesAdminNegativeTestJSON-519114725 tempest-AggregatesAdminNegativeTestJSON-519114725-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '60d4f703c4d6468e853b2a27d64df026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e2243d5a54a9d94e8452fe43680c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:34.106957 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2a2b8384-6777-40ed-adfb-1ed60cb585d2 tempest-AggregatesAdminNegativeTestJSON-519114725 tempest-AggregatesAdminNegativeTestJSON-519114725-project] Request method failure captured: Aug 07 01:09:34.106957 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 07 01:09:34.106957 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:09:34.106957 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:09:34.106957 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:09:34.106957 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:09:34.106957 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:09:34.106957 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:09:34.106957 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:09:34.106957 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:09:34.106957 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xDCF2oIkE0dKXHC8LC9F2vrw1NTw8uU8jf7G7GkahkDO96Sn7drWmOKYoa3JN4msYUOM2XKl1lx-sVVYtZ31Segcq85iuyK0x05ZIMM04GB04NGeSRniHQurTJ-NsEYHLgCzzH5OvOJL0IQh5xIZnIGc-x4-dN_qavJYW7NiP6gXnE Aug 07 01:09:34.106957 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:09:34.106957 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:09:34.106957 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:09:34.106957 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:09:34.106957 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:09:34.106957 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:09:34.106957 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 248e2243d5a54a9d94e8452fe43680c8 Aug 07 01:09:34.106957 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-519114725 Aug 07 01:09:34.106957 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:09:34.106957 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:09:34.109172 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/248e2243d5a54a9d94e8452fe43680c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_248e2243d5a54a9d94e8452fe43680c8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/248e2243d5a54a9d94e8452fe43680c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/248e2243d5a54a9d94e8452fe43680c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:09:34.109172 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-519114725 Aug 07 01:09:34.109172 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 248e2243d5a54a9d94e8452fe43680c8 Aug 07 01:09:34.109172 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-519114725 Aug 07 01:09:34.109172 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-AggregatesAdminNegativeTestJSON-519114725-project Aug 07 01:09:34.109172 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:09:34.109172 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:09:34.109172 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 60d4f703c4d6468e853b2a27d64df026 Aug 07 01:09:34.109172 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-519114725-project Aug 07 01:09:34.109172 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:09:34.109172 n-d-master-1 devstack@n-api.service[119516]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 07 01:09:34.109172 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '7'} Aug 07 01:09:34.110706 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:09:34.110706 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:34.110706 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:34.110706 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:34.110706 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:09:34.110706 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:09:34.110706 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:09:34.110706 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:09:34.110706 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 07 01:09:34.110706 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 07 01:09:34.110706 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 07 01:09:34.110706 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 07 01:09:34.110706 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 07 01:09:34.110706 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 07 01:09:34.110706 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:09:34.110706 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:09:34.110706 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:09:34.110706 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:09:34.110706 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 07 01:09:34.116698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 07 01:09:34.116698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 07 01:09:34.116698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 07 01:09:34.116698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 07 01:09:34.116698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 07 01:09:34.116698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 07 01:09:34.116698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:34.116698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:09:34.116698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:34.116698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:34.116698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:34.116698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:34.116698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 07 01:09:34.116698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 07 01:09:34.116698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 07 01:09:34.116698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:34.116698 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2a2b8384-6777-40ed-adfb-1ed60cb585d2 tempest-AggregatesAdminNegativeTestJSON-519114725 tempest-AggregatesAdminNegativeTestJSON-519114725-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:09:34.117937 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2a2b8384-6777-40ed-adfb-1ed60cb585d2 tempest-AggregatesAdminNegativeTestJSON-519114725 tempest-AggregatesAdminNegativeTestJSON-519114725-project] 10.222.0.39 "GET /compute/v2.1/os-aggregates/7" status: 403 len: 114 microversion: 2.1 time: 0.012433 Aug 07 01:09:34.117937 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 48/62] 10.222.0.39 () {58 vars in 1149 bytes} [Sun Aug 7 01:09:34 2022] GET /compute/v2.1/os-aggregates/7 => generated 114 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:09:34.122899 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-74f60504-4cbf-40fd-85a8-3467d2017008 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:34.123707 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:34.123707 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:09:34.149779 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-74f60504-4cbf-40fd-85a8-3467d2017008 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.031307 Aug 07 01:09:34.150665 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 15/63] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Aug 7 01:09:34 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 07 01:09:34.162413 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-33ddfb7b-b502-45c9-ab34-a76951357a69 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:34.172442 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-33ddfb7b-b502-45c9-ab34-a76951357a69 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 07 01:09:34.174049 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-33ddfb7b-b502-45c9-ab34-a76951357a69 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Request method failure captured: Aug 07 01:09:34.174049 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 07 01:09:34.174049 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:09:34.174049 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:09:34.174049 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:09:34.174049 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:09:34.174049 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:09:34.174049 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:09:34.174049 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:09:34.174049 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:09:34.174049 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xDGUZ9RmTbqVfLxECOboo71CWMacBANAin_k2Tk3x3trxWuxylgw0uAn9i777Wm834ATlBkxDkgh8NRkqKsVvKxzV58qc5rV87jpI7xsTCrig69NZ8KuGw7Wy5BPQKSTg6Zi0lQlPGdVBG55TSjF6PxOj6A_Ludtfx-OEOB4lam0XQ Aug 07 01:09:34.174049 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:09:34.174049 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:09:34.174049 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:09:34.174049 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:09:34.174049 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:09:34.174049 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:09:34.174049 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 60b8430a79264d20b633391ab7bc6790 Aug 07 01:09:34.174049 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-957597285 Aug 07 01:09:34.174049 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,admin,member Aug 07 01:09:34.174049 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,admin,member Aug 07 01:09:34.175159 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/60b8430a79264d20b633391ab7bc6790"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_60b8430a79264d20b633391ab7bc6790", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/60b8430a79264d20b633391ab7bc6790"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/60b8430a79264d20b633391ab7bc6790"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:09:34.175159 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-957597285 Aug 07 01:09:34.175159 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 60b8430a79264d20b633391ab7bc6790 Aug 07 01:09:34.175159 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-957597285 Aug 07 01:09:34.175159 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin Aug 07 01:09:34.175159 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:09:34.175159 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:09:34.175159 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: c7f69d5acc5547dba7f05bd2ea205e71 Aug 07 01:09:34.175159 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin Aug 07 01:09:34.175159 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:09:34.175159 n-d-master-1 devstack@n-api.service[119516]: exception: Aggregate -1 could not be found. Aug 07 01:09:34.175159 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '-1'} Aug 07 01:09:34.175776 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:09:34.175776 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:34.175776 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 07 01:09:34.175776 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 07 01:09:34.175776 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6417, in get_aggregate Aug 07 01:09:34.175776 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 07 01:09:34.175776 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:09:34.175776 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:09:34.175776 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 07 01:09:34.175776 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 07 01:09:34.175776 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 07 01:09:34.175776 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 07 01:09:34.175776 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 07 01:09:34.175776 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 07 01:09:34.175776 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 07 01:09:34.175776 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:34.175776 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:09:34.175776 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:34.175776 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:34.175776 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:34.176839 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:34.176839 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:09:34.176839 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:09:34.176839 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:09:34.176839 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:09:34.176839 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 07 01:09:34.176839 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:09:34.176839 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 07 01:09:34.176839 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:34.176839 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:09:34.176839 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:34.176839 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:34.176839 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:34.176839 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:34.176839 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:09:34.176839 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:09:34.176839 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 07 01:09:34.176839 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:09:34.177845 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-33ddfb7b-b502-45c9-ab34-a76951357a69 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:09:34.178226 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-33ddfb7b-b502-45c9-ab34-a76951357a69 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.021284 Aug 07 01:09:34.182606 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 49/64] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Aug 7 01:09:34 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:09:34.189325 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ca22b431-8b8e-4cef-9247-864674a48b73 tempest-AggregatesAdminNegativeTestJSON-519114725 tempest-AggregatesAdminNegativeTestJSON-519114725-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:34.190186 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:34.190186 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:09:34.191348 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ca22b431-8b8e-4cef-9247-864674a48b73 tempest-AggregatesAdminNegativeTestJSON-519114725 tempest-AggregatesAdminNegativeTestJSON-519114725-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '60d4f703c4d6468e853b2a27d64df026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e2243d5a54a9d94e8452fe43680c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:34.193045 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ca22b431-8b8e-4cef-9247-864674a48b73 tempest-AggregatesAdminNegativeTestJSON-519114725 tempest-AggregatesAdminNegativeTestJSON-519114725-project] Request method failure captured: Aug 07 01:09:34.193045 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 07 01:09:34.193045 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:09:34.193045 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:09:34.193045 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:09:34.193045 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:09:34.193045 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:09:34.193045 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:09:34.193045 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:09:34.193045 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:09:34.193045 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xDCF2oIkE0dKXHC8LC9F2vrw1NTw8uU8jf7G7GkahkDO96Sn7drWmOKYoa3JN4msYUOM2XKl1lx-sVVYtZ31Segcq85iuyK0x05ZIMM04GB04NGeSRniHQurTJ-NsEYHLgCzzH5OvOJL0IQh5xIZnIGc-x4-dN_qavJYW7NiP6gXnE Aug 07 01:09:34.193045 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:09:34.193045 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:09:34.193045 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:09:34.193045 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:09:34.193045 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:09:34.193045 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:09:34.193045 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 248e2243d5a54a9d94e8452fe43680c8 Aug 07 01:09:34.193045 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-519114725 Aug 07 01:09:34.193045 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:09:34.193045 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:09:34.194141 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/248e2243d5a54a9d94e8452fe43680c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_248e2243d5a54a9d94e8452fe43680c8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/248e2243d5a54a9d94e8452fe43680c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/248e2243d5a54a9d94e8452fe43680c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:09:34.194141 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-519114725 Aug 07 01:09:34.194141 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 248e2243d5a54a9d94e8452fe43680c8 Aug 07 01:09:34.194141 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-519114725 Aug 07 01:09:34.194141 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-AggregatesAdminNegativeTestJSON-519114725-project Aug 07 01:09:34.194141 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:09:34.194141 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:09:34.194141 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 60d4f703c4d6468e853b2a27d64df026 Aug 07 01:09:34.194141 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-519114725-project Aug 07 01:09:34.194141 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:09:34.194141 n-d-master-1 devstack@n-api.service[119517]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 07 01:09:34.194141 n-d-master-1 devstack@n-api.service[119517]: action_args: {} Aug 07 01:09:34.194776 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:09:34.194776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:34.194776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:34.194776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:34.194776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:09:34.194776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:09:34.194776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:09:34.194776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:09:34.194776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 07 01:09:34.194776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 07 01:09:34.194776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 07 01:09:34.194776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 07 01:09:34.194776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 07 01:09:34.194776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 07 01:09:34.194776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:09:34.194776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:09:34.194776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:09:34.194776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:09:34.194776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 07 01:09:34.195958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 07 01:09:34.195958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 07 01:09:34.195958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 07 01:09:34.195958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 07 01:09:34.195958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 07 01:09:34.195958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 07 01:09:34.195958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:09:34.195958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:09:34.195958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:09:34.195958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:34.195958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:34.195958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:34.195958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 07 01:09:34.195958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 07 01:09:34.195958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 07 01:09:34.195958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:09:34.195958 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ca22b431-8b8e-4cef-9247-864674a48b73 tempest-AggregatesAdminNegativeTestJSON-519114725 tempest-AggregatesAdminNegativeTestJSON-519114725-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:09:34.197006 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ca22b431-8b8e-4cef-9247-864674a48b73 tempest-AggregatesAdminNegativeTestJSON-519114725 tempest-AggregatesAdminNegativeTestJSON-519114725-project] 10.222.0.39 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.009849 Aug 07 01:09:34.197006 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 16/65] 10.222.0.39 () {58 vars in 1143 bytes} [Sun Aug 7 01:09:34 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:09:34.951856 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c3afceef-2e89-42d7-9e42-b89e8b74d634 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:34.953398 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c3afceef-2e89-42d7-9e42-b89e8b74d634 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] [instance: e40f1306-cb41-4d73-94a2-aeea34eb0f0c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:34.974177 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e281b8f3-7fcc-449d-916c-405502d4b810 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:34.974936 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e281b8f3-7fcc-449d-916c-405502d4b810 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] [instance: 7028fed0-c1db-491a-b46f-345ead213c7a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:35.036677 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c3afceef-2e89-42d7-9e42-b89e8b74d634 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e60f068764c4a259771662a83663cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0af4ec538f41868c10700c90e816d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:35.048114 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c3afceef-2e89-42d7-9e42-b89e8b74d634 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] 10.222.0.39 "GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c" status: 200 len: 1213 microversion: 2.1 time: 0.098642 Aug 07 01:09:35.049414 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 50/66] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:34 2022] GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c => generated 1213 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:35.076030 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e281b8f3-7fcc-449d-916c-405502d4b810 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a892781ecd4300b6dd10b9c235e263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e7e61e7eb4c9490b7632bde85d2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:35.090536 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e281b8f3-7fcc-449d-916c-405502d4b810 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] 10.222.0.39 "GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a" status: 200 len: 1242 microversion: 2.1 time: 0.121273 Aug 07 01:09:35.091536 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 17/67] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:34 2022] GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a => generated 1242 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:09:35.557596 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2d5691f0-2f73-4c69-8b5a-d9512312b6d8 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-278795657", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:35.628805 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-2d5691f0-2f73-4c69-8b5a-d9512312b6d8 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] validate_networks() for None {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:09:36.083420 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-2d5691f0-2f73-4c69-8b5a-d9512312b6d8 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:09:36.084871 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-2d5691f0-2f73-4c69-8b5a-d9512312b6d8 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:09:36.085621 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-2d5691f0-2f73-4c69-8b5a-d9512312b6d8 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:09:36.086173 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-2d5691f0-2f73-4c69-8b5a-d9512312b6d8 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:09:36.086650 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-2d5691f0-2f73-4c69-8b5a-d9512312b6d8 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:09:36.098277 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2d5691f0-2f73-4c69-8b5a-d9512312b6d8 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:36.098769 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2d5691f0-2f73-4c69-8b5a-d9512312b6d8 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:36.099214 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2d5691f0-2f73-4c69-8b5a-d9512312b6d8 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:36.100142 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2d5691f0-2f73-4c69-8b5a-d9512312b6d8 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:36.100610 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2d5691f0-2f73-4c69-8b5a-d9512312b6d8 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:36.101168 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2d5691f0-2f73-4c69-8b5a-d9512312b6d8 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:36.127947 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-2d5691f0-2f73-4c69-8b5a-d9512312b6d8 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Getting quotas for project 010ea68aed824d6bac970360d34ab747. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:09:36.133221 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-2d5691f0-2f73-4c69-8b5a-d9512312b6d8 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Getting quotas for user 909b8165f015473c9977ef92aaf0741b and project 010ea68aed824d6bac970360d34ab747. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:09:36.147676 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2d5691f0-2f73-4c69-8b5a-d9512312b6d8 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:09:36.156099 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-dd85bbcd-f014-45a1-80fc-06c95b0a172b tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2086669137", "id": 2076153587, "os-flavor-access:is_public": "True"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:36.161909 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:36.161909 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:09:36.163045 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2d5691f0-2f73-4c69-8b5a-d9512312b6d8 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: f11385ef-0cd8-406a-b905-81a8a6512ebe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:09:36.201585 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-dd85bbcd-f014-45a1-80fc-06c95b0a172b tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.507867 Aug 07 01:09:36.202649 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 18/68] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:09:35 2022] POST /compute/v2.1/flavors => generated 430 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:09:36.215296 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e5c3df00-b6c6-42f7-a932-38495a93c9f2 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:36.217943 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e5c3df00-b6c6-42f7-a932-38495a93c9f2 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] [instance: e40f1306-cb41-4d73-94a2-aeea34eb0f0c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:36.293052 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2d5691f0-2f73-4c69-8b5a-d9512312b6d8 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.202877 Aug 07 01:09:36.304960 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 51/69] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:09:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1211 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 07 01:09:36.309331 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e162ecf0-3ec9-4105-b651-d44f5b683d56 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:36.332464 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e162ecf0-3ec9-4105-b651-d44f5b683d56 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] [instance: 7028fed0-c1db-491a-b46f-345ead213c7a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:36.338757 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e5c3df00-b6c6-42f7-a932-38495a93c9f2 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e60f068764c4a259771662a83663cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0af4ec538f41868c10700c90e816d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:36.351971 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e162ecf0-3ec9-4105-b651-d44f5b683d56 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:36.355405 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e5c3df00-b6c6-42f7-a932-38495a93c9f2 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] 10.222.0.39 "GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c" status: 200 len: 1213 microversion: 2.1 time: 0.147362 Aug 07 01:09:36.357909 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e162ecf0-3ec9-4105-b651-d44f5b683d56 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:36.359152 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 19/70] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:36 2022] GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c => generated 1213 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:36.360179 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e162ecf0-3ec9-4105-b651-d44f5b683d56 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:36.361205 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e162ecf0-3ec9-4105-b651-d44f5b683d56 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:36.361896 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e162ecf0-3ec9-4105-b651-d44f5b683d56 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:36.362542 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e162ecf0-3ec9-4105-b651-d44f5b683d56 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:36.379228 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f5ce2e0b-faab-432f-940a-38ef6a66b007 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:36.380380 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:36.380380 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:09:36.434193 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=10,nova_api:DELETE=9 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:36.440246 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f5ce2e0b-faab-432f-940a-38ef6a66b007 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/2076153587" status: 202 len: 0 microversion: 2.1 time: 0.077630 Aug 07 01:09:36.444298 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 20/71] 10.222.0.39 () {58 vars in 1161 bytes} [Sun Aug 7 01:09:36 2022] DELETE /compute/v2.1/flavors/2076153587 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:09:36.475752 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9b6fb0ba-dbf8-4179-9597-6866dda1a17f tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:36.476691 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9b6fb0ba-dbf8-4179-9597-6866dda1a17f tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: f11385ef-0cd8-406a-b905-81a8a6512ebe] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:36.641556 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9b6fb0ba-dbf8-4179-9597-6866dda1a17f tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909b8165f015473c9977ef92aaf0741b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010ea68aed824d6bac970360d34ab747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:36.651375 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9b6fb0ba-dbf8-4179-9597-6866dda1a17f tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe" status: 200 len: 1219 microversion: 2.1 time: 0.204791 Aug 07 01:09:36.660343 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 21/72] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:36 2022] GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe => generated 1219 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:36.669402 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b96f6475-0ae0-4203-9649-1b5f27a85a08 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:36.762129 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b96f6475-0ae0-4203-9649-1b5f27a85a08 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.098620 Aug 07 01:09:36.762749 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 22/73] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:09:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:36.821513 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e162ecf0-3ec9-4105-b651-d44f5b683d56 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a892781ecd4300b6dd10b9c235e263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e7e61e7eb4c9490b7632bde85d2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:36.844248 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e162ecf0-3ec9-4105-b651-d44f5b683d56 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] 10.222.0.39 "GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a" status: 200 len: 1298 microversion: 2.1 time: 0.539478 Aug 07 01:09:36.845764 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 52/74] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:36 2022] GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a => generated 1298 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:36.853463 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-660f5ae1-c963-4ece-86d7-cc55b2949945 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-479887619", "id": 1451433447, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:36.879368 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:36.879368 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:09:36.911061 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-660f5ae1-c963-4ece-86d7-cc55b2949945 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.063384 Aug 07 01:09:36.912414 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 53/75] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:09:36 2022] POST /compute/v2.1/flavors => generated 416 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:36.934633 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8b249779-7fe2-4772-a43c-cc7ad2af175f tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:36.961267 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8b249779-7fe2-4772-a43c-cc7ad2af175f tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.037050 Aug 07 01:09:36.962512 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 54/76] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:09:36 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:37.009852 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-51baf9af-54a7-4636-9ae2-6fe512e1cb74 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:37.011185 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:37.011185 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:09:37.043646 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-51baf9af-54a7-4636-9ae2-6fe512e1cb74 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1451433447" status: 202 len: 0 microversion: 2.1 time: 0.049259 Aug 07 01:09:37.048881 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 55/77] 10.222.0.39 () {58 vars in 1161 bytes} [Sun Aug 7 01:09:36 2022] DELETE /compute/v2.1/flavors/1451433447 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:09:37.057889 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b1760b0c-0e07-4cdc-a687-bc6688132a4d tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:37.088066 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b1760b0c-0e07-4cdc-a687-bc6688132a4d tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037208 Aug 07 01:09:37.104852 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 56/78] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:09:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:37.106912 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b1760b0c-0e07-4cdc-a687-bc6688132a4d tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:37.108492 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b1760b0c-0e07-4cdc-a687-bc6688132a4d tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001677 Aug 07 01:09:37.108964 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 57/79] 10.222.0.39 () {56 vars in 886 bytes} [Sun Aug 7 01:09:37 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 07 01:09:37.114852 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4c776e8e-0474-4f54-a768-8e701473cd4f tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-963315481", "id": 1002914465, "os-flavor-access:is_public": "True"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:37.150554 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4c776e8e-0474-4f54-a768-8e701473cd4f tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.034759 Aug 07 01:09:37.162747 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 58/80] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:09:37 2022] POST /compute/v2.1/flavors => generated 428 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:37.169446 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5a9dce78-a61e-4225-948f-b2b8ad0bbfac tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:37.193799 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ba0fca76-3609-4ee5-b072-ae757dda0359 tempest-FlavorsV255TestJSON-407552419 tempest-FlavorsV255TestJSON-407552419-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1483758592", "id": 398897276, "os-flavor-access:is_public": "True"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:37.197045 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:37.197045 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:09:37.197387 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5a9dce78-a61e-4225-948f-b2b8ad0bbfac tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1002914465" status: 202 len: 0 microversion: 2.1 time: 0.031379 Aug 07 01:09:37.200399 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 59/81] 10.222.0.39 () {58 vars in 1161 bytes} [Sun Aug 7 01:09:37 2022] DELETE /compute/v2.1/flavors/1002914465 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:09:37.217285 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0fc2b75e-067b-4e28-965b-db0f59d4cf30 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:37.230720 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ba0fca76-3609-4ee5-b072-ae757dda0359 tempest-FlavorsV255TestJSON-407552419 tempest-FlavorsV255TestJSON-407552419-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.446389 Aug 07 01:09:37.231877 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 23/82] 10.222.0.39 () {62 vars in 1188 bytes} [Sun Aug 7 01:09:36 2022] POST /compute/v2.1/flavors => generated 446 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:09:37.304257 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0fc2b75e-067b-4e28-965b-db0f59d4cf30 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.097908 Aug 07 01:09:37.305274 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 60/83] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:09:37 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:37.339417 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3b6764c2-120d-4abf-878e-1310900b15fa tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-809311393", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:37.391963 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3b6764c2-120d-4abf-878e-1310900b15fa tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.057605 Aug 07 01:09:37.397142 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 61/84] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:09:37 2022] POST /compute/v2.1/flavors => generated 506 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:37.406821 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b1941eba-e904-4b31-9db9-6f9ccb3887ee tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:37.408377 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b1941eba-e904-4b31-9db9-6f9ccb3887ee tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] [instance: e40f1306-cb41-4d73-94a2-aeea34eb0f0c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:37.420122 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b1941eba-e904-4b31-9db9-6f9ccb3887ee tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:37.421315 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b1941eba-e904-4b31-9db9-6f9ccb3887ee tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:37.430776 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b1941eba-e904-4b31-9db9-6f9ccb3887ee tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:37.432834 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b1941eba-e904-4b31-9db9-6f9ccb3887ee tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:37.434275 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b1941eba-e904-4b31-9db9-6f9ccb3887ee tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:37.435221 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b1941eba-e904-4b31-9db9-6f9ccb3887ee tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:37.606038 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b1941eba-e904-4b31-9db9-6f9ccb3887ee tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e60f068764c4a259771662a83663cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0af4ec538f41868c10700c90e816d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:37.622696 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b1941eba-e904-4b31-9db9-6f9ccb3887ee tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] 10.222.0.39 "GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c" status: 200 len: 1287 microversion: 2.1 time: 0.223093 Aug 07 01:09:37.624308 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 62/85] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:37 2022] GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c => generated 1287 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:37.633155 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-013cb669-536c-463d-9763-8b58ceefba72 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:37.635321 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:37.635321 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:09:37.669228 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-013cb669-536c-463d-9763-8b58ceefba72 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/bb0d70c6-b499-437d-8701-550e25ea36d0" status: 202 len: 0 microversion: 2.1 time: 0.042077 Aug 07 01:09:37.671013 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 63/86] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:09:37 2022] DELETE /compute/v2.1/flavors/bb0d70c6-b499-437d-8701-550e25ea36d0 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:09:37.683548 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dc364086-81e5-4ffe-b5ac-935d045d0ea0 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:37.685942 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-dc364086-81e5-4ffe-b5ac-935d045d0ea0 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: f11385ef-0cd8-406a-b905-81a8a6512ebe] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:37.698899 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc364086-81e5-4ffe-b5ac-935d045d0ea0 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:37.699487 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc364086-81e5-4ffe-b5ac-935d045d0ea0 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:37.702535 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc364086-81e5-4ffe-b5ac-935d045d0ea0 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:37.703656 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc364086-81e5-4ffe-b5ac-935d045d0ea0 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:37.705752 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc364086-81e5-4ffe-b5ac-935d045d0ea0 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:37.709382 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc364086-81e5-4ffe-b5ac-935d045d0ea0 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:37.717598 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d1379d3e-57c6-4821-a82b-eee8a3a53275 tempest-FlavorsV255TestJSON-1422940503 tempest-FlavorsV255TestJSON-1422940503-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:37.732180 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d1379d3e-57c6-4821-a82b-eee8a3a53275 tempest-FlavorsV255TestJSON-1422940503 tempest-FlavorsV255TestJSON-1422940503-project] 10.222.0.39 "GET /compute/v2.1/flavors/398897276" status: 200 len: 446 microversion: 2.55 time: 0.490430 Aug 07 01:09:37.743061 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 24/87] 10.222.0.39 () {60 vars in 1196 bytes} [Sun Aug 7 01:09:37 2022] GET /compute/v2.1/flavors/398897276 => generated 446 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:09:37.751299 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6bab1b54-979d-47b3-866d-78308b056743 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:37.786235 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6bab1b54-979d-47b3-866d-78308b056743 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.039999 Aug 07 01:09:37.787069 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 25/88] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:09:37 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:37.793295 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-39b450ab-da69-4782-b784-0710c8a809ae tempest-FlavorsV255TestJSON-407552419 tempest-FlavorsV255TestJSON-407552419-project-admin] Action: 'update', calling method: .version_select at 0x7f9e27535b80>, body: {"flavor": {"description": "new"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:37.806246 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:37.806246 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:09:37.854895 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-39b450ab-da69-4782-b784-0710c8a809ae tempest-FlavorsV255TestJSON-407552419 tempest-FlavorsV255TestJSON-407552419-project-admin] 10.222.0.39 "PUT /compute/v2.1/flavors/398897276" status: 200 len: 447 microversion: 2.55 time: 0.065900 Aug 07 01:09:37.865283 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 26/89] 10.222.0.39 () {62 vars in 1216 bytes} [Sun Aug 7 01:09:37 2022] PUT /compute/v2.1/flavors/398897276 => generated 447 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:09:37.873387 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c2ebd5b0-705c-4ef4-a5b4-f34d4054c64a tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-926052514", "id": "fdcbd181-4a09-48f5-a853-0723bf9f812d", "os-flavor-access:is_public": "True"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:37.914394 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c2ebd5b0-705c-4ef4-a5b4-f34d4054c64a tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.045776 Aug 07 01:09:37.917268 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 27/90] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:09:37 2022] POST /compute/v2.1/flavors => generated 506 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:37.924246 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2e6d7775-3bce-451d-8970-8754370e2e5b tempest-FlavorsV255TestJSON-1422940503 tempest-FlavorsV255TestJSON-1422940503-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:37.972063 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2e6d7775-3bce-451d-8970-8754370e2e5b tempest-FlavorsV255TestJSON-1422940503 tempest-FlavorsV255TestJSON-1422940503-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 6239 microversion: 2.55 time: 0.051296 Aug 07 01:09:37.992983 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 28/91] 10.222.0.39 () {60 vars in 1187 bytes} [Sun Aug 7 01:09:37 2022] GET /compute/v2.1/flavors/detail => generated 6239 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:09:38.001839 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-adacf561-3204-4f2f-b3bc-73558bb8fb9c tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:38.001839 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-adacf561-3204-4f2f-b3bc-73558bb8fb9c tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] [instance: 7028fed0-c1db-491a-b46f-345ead213c7a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:38.012223 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-adacf561-3204-4f2f-b3bc-73558bb8fb9c tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:38.014051 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-adacf561-3204-4f2f-b3bc-73558bb8fb9c tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:38.015405 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-adacf561-3204-4f2f-b3bc-73558bb8fb9c tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:38.015405 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-adacf561-3204-4f2f-b3bc-73558bb8fb9c tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:38.015785 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-adacf561-3204-4f2f-b3bc-73558bb8fb9c tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:38.016281 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-adacf561-3204-4f2f-b3bc-73558bb8fb9c tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:38.050543 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-dc364086-81e5-4ffe-b5ac-935d045d0ea0 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909b8165f015473c9977ef92aaf0741b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010ea68aed824d6bac970360d34ab747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:38.065369 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-dc364086-81e5-4ffe-b5ac-935d045d0ea0 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe" status: 200 len: 1271 microversion: 2.1 time: 0.388699 Aug 07 01:09:38.066327 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 64/92] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:37 2022] GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe => generated 1271 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:38.085987 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d3377f6a-8bba-41a0-aa8e-970ca2a54b63 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:38.086964 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:38.086964 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:09:38.119654 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d3377f6a-8bba-41a0-aa8e-970ca2a54b63 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/fdcbd181-4a09-48f5-a853-0723bf9f812d" status: 202 len: 0 microversion: 2.1 time: 0.038183 Aug 07 01:09:38.121629 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 65/93] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:09:38 2022] DELETE /compute/v2.1/flavors/fdcbd181-4a09-48f5-a853-0723bf9f812d => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:09:38.132642 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ebe8158c-bf0c-4b6b-9ccd-b9d4f0f4deda tempest-FlavorsV255TestJSON-1422940503 tempest-FlavorsV255TestJSON-1422940503-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:38.211649 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ebe8158c-bf0c-4b6b-9ccd-b9d4f0f4deda tempest-FlavorsV255TestJSON-1422940503 tempest-FlavorsV255TestJSON-1422940503-project] 10.222.0.39 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.55 time: 0.088398 Aug 07 01:09:38.229442 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 66/94] 10.222.0.39 () {60 vars in 1166 bytes} [Sun Aug 7 01:09:38 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:09:38.239266 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bd04200b-2fac-497c-a872-49e1c7626ef1 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:38.265393 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bd04200b-2fac-497c-a872-49e1c7626ef1 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.034070 Aug 07 01:09:38.279944 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 67/95] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:09:38 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:38.294405 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3a0d2cc4-301d-4364-820e-3d6c56f18478 tempest-FlavorsV255TestJSON-407552419 tempest-FlavorsV255TestJSON-407552419-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:38.330585 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=10,nova_api:DELETE=14 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:38.338254 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3a0d2cc4-301d-4364-820e-3d6c56f18478 tempest-FlavorsV255TestJSON-407552419 tempest-FlavorsV255TestJSON-407552419-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/398897276" status: 202 len: 0 microversion: 2.55 time: 0.056231 Aug 07 01:09:38.342760 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 68/96] 10.222.0.39 () {60 vars in 1199 bytes} [Sun Aug 7 01:09:38 2022] DELETE /compute/v2.1/flavors/398897276 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:09:38.353180 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b6251026-b06e-444c-b16a-8185b42c9a23 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1909094297", "id": 2068750298, "os-flavor-access:is_public": "True"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:38.379088 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:38.379088 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:09:38.399424 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-adacf561-3204-4f2f-b3bc-73558bb8fb9c tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a892781ecd4300b6dd10b9c235e263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e7e61e7eb4c9490b7632bde85d2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:38.411399 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b6251026-b06e-444c-b16a-8185b42c9a23 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.062385 Aug 07 01:09:38.420392 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-adacf561-3204-4f2f-b3bc-73558bb8fb9c tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] 10.222.0.39 "GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a" status: 200 len: 1296 microversion: 2.1 time: 0.424166 Aug 07 01:09:38.421396 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 69/97] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:09:38 2022] POST /compute/v2.1/flavors => generated 414 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:38.432236 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 29/98] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:37 2022] GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a => generated 1296 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:38.445005 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-182985fd-7df9-41e7-b9a5-20169bf70573 tempest-FlavorsV255TestJSON-407552419 tempest-FlavorsV255TestJSON-407552419-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:38.447021 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-64fe625e-ee57-4c22-ad85-34a7ee5e7ea8 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:38.485202 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-64fe625e-ee57-4c22-ad85-34a7ee5e7ea8 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/2068750298" status: 200 len: 414 microversion: 2.1 time: 0.050157 Aug 07 01:09:38.487569 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 30/99] 10.222.0.39 () {58 vars in 1158 bytes} [Sun Aug 7 01:09:38 2022] GET /compute/v2.1/flavors/2068750298 => generated 414 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:38.550071 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-182985fd-7df9-41e7-b9a5-20169bf70573 tempest-FlavorsV255TestJSON-407552419 tempest-FlavorsV255TestJSON-407552419-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5710 microversion: 2.55 time: 0.127156 Aug 07 01:09:38.567847 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 70/100] 10.222.0.39 () {60 vars in 1187 bytes} [Sun Aug 7 01:09:38 2022] GET /compute/v2.1/flavors/detail => generated 5710 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:09:38.665004 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e6445d84-12cb-45f3-ac20-e0ec02d3ce82 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:38.666123 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e6445d84-12cb-45f3-ac20-e0ec02d3ce82 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] [instance: e40f1306-cb41-4d73-94a2-aeea34eb0f0c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:38.684904 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6445d84-12cb-45f3-ac20-e0ec02d3ce82 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:38.689845 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6445d84-12cb-45f3-ac20-e0ec02d3ce82 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:38.693405 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6445d84-12cb-45f3-ac20-e0ec02d3ce82 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:38.697150 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6445d84-12cb-45f3-ac20-e0ec02d3ce82 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:38.703209 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6445d84-12cb-45f3-ac20-e0ec02d3ce82 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:38.704987 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6445d84-12cb-45f3-ac20-e0ec02d3ce82 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:39.000178 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-acf6bb03-9c7c-43ab-8648-eff06847e63d tempest-FlavorsAdminTestJSON-653189493 tempest-FlavorsAdminTestJSON-653189493-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:39.050528 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-acf6bb03-9c7c-43ab-8648-eff06847e63d tempest-FlavorsAdminTestJSON-653189493 tempest-FlavorsAdminTestJSON-653189493-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.547475 Aug 07 01:09:39.068262 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 31/101] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:09:38 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:39.078133 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-00ce23af-4141-4cc7-92d1-33c365767370 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:39.079089 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:39.079089 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:09:39.140087 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-00ce23af-4141-4cc7-92d1-33c365767370 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/2068750298" status: 202 len: 0 microversion: 2.1 time: 0.070375 Aug 07 01:09:39.140768 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 32/102] 10.222.0.39 () {58 vars in 1161 bytes} [Sun Aug 7 01:09:39 2022] DELETE /compute/v2.1/flavors/2068750298 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:09:39.157613 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a2fbf639-3c57-4df4-b73c-aae6845d2872 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:39.158288 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a2fbf639-3c57-4df4-b73c-aae6845d2872 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: f11385ef-0cd8-406a-b905-81a8a6512ebe] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:39.178463 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2fbf639-3c57-4df4-b73c-aae6845d2872 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:39.179452 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2fbf639-3c57-4df4-b73c-aae6845d2872 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:39.180019 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2fbf639-3c57-4df4-b73c-aae6845d2872 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:39.181032 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2fbf639-3c57-4df4-b73c-aae6845d2872 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:39.181633 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2fbf639-3c57-4df4-b73c-aae6845d2872 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:39.182304 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2fbf639-3c57-4df4-b73c-aae6845d2872 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:39.563996 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e6445d84-12cb-45f3-ac20-e0ec02d3ce82 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e60f068764c4a259771662a83663cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0af4ec538f41868c10700c90e816d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:39.596756 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e6445d84-12cb-45f3-ac20-e0ec02d3ce82 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] 10.222.0.39 "GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c" status: 200 len: 1293 microversion: 2.1 time: 0.938852 Aug 07 01:09:39.598859 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 71/103] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:38 2022] GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c => generated 1293 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:39.617174 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2ef17bf1-b33d-4746-a590-4e4f549bd8db tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:39.721077 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2ef17bf1-b33d-4746-a590-4e4f549bd8db tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.117550 Aug 07 01:09:39.725513 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 72/104] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:09:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:39.742438 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-524ae307-d265-44a3-8755-19adb4cee658 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:39.743483 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-524ae307-d265-44a3-8755-19adb4cee658 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] [instance: 7028fed0-c1db-491a-b46f-345ead213c7a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:39.762008 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-524ae307-d265-44a3-8755-19adb4cee658 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:39.762507 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-524ae307-d265-44a3-8755-19adb4cee658 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:39.762957 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-524ae307-d265-44a3-8755-19adb4cee658 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:39.763659 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-524ae307-d265-44a3-8755-19adb4cee658 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:39.774101 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-524ae307-d265-44a3-8755-19adb4cee658 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:39.774593 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-524ae307-d265-44a3-8755-19adb4cee658 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:39.917847 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a2fbf639-3c57-4df4-b73c-aae6845d2872 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909b8165f015473c9977ef92aaf0741b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010ea68aed824d6bac970360d34ab747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:39.962677 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a2fbf639-3c57-4df4-b73c-aae6845d2872 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe" status: 200 len: 1277 microversion: 2.1 time: 0.818646 Aug 07 01:09:39.979624 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 33/105] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:39 2022] GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe => generated 1277 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:40.006422 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-68818e29-fc7e-45ee-aff5-9cf752d0a5e2 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-17422901", "id": 2124715292, "os-flavor-access:is_public": "False"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:40.018035 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:40.018035 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:09:40.053111 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-68818e29-fc7e-45ee-aff5-9cf752d0a5e2 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.057500 Aug 07 01:09:40.069388 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 34/106] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:09:39 2022] POST /compute/v2.1/flavors => generated 428 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:40.082480 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3f7b9598-9c81-46a1-9afc-f42bd74ed811 tempest-FlavorsAdminTestJSON-653189493 tempest-FlavorsAdminTestJSON-653189493-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "2124715292"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:40.110433 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-3f7b9598-9c81-46a1-9afc-f42bd74ed811 tempest-FlavorsAdminTestJSON-653189493 tempest-FlavorsAdminTestJSON-653189493-project] HTTP exception thrown: Flavor 2124715292 could not be found. Aug 07 01:09:40.122698 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3f7b9598-9c81-46a1-9afc-f42bd74ed811 tempest-FlavorsAdminTestJSON-653189493 tempest-FlavorsAdminTestJSON-653189493-project] Request method failure captured: Aug 07 01:09:40.122698 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 07 01:09:40.122698 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:09:40.122698 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:09:40.122698 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:09:40.122698 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 107 Aug 07 01:09:40.122698 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:09:40.122698 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:09:40.122698 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:09:40.122698 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:09:40.122698 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xDNIRlzrdcgNUbeyu2qp2Xl5dz6rRFZz16Jkd8T3dObuAhvpu2dDw4yVzxK7yliKNQB9jtYPI9mAilBf-LW5uDUmAbTViPuuepGZ5NTw4OpieGOFQ7Q64u06uts5l-3PVMC7zS7Rpd25rCQ5uzEf5jnsEfe0Nb3apwnMuZwQmHv1L0 Aug 07 01:09:40.122698 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:09:40.122698 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:09:40.122698 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:09:40.122698 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:09:40.122698 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:09:40.122698 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:09:40.122698 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: e69f58f3b72e47a18d2e2ac28b6b4b0c Aug 07 01:09:40.122698 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-FlavorsAdminTestJSON-653189493 Aug 07 01:09:40.122698 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:09:40.122698 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:09:40.125163 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e69f58f3b72e47a18d2e2ac28b6b4b0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e69f58f3b72e47a18d2e2ac28b6b4b0c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e69f58f3b72e47a18d2e2ac28b6b4b0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e69f58f3b72e47a18d2e2ac28b6b4b0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:09:40.125163 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-FlavorsAdminTestJSON-653189493 Aug 07 01:09:40.125163 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: e69f58f3b72e47a18d2e2ac28b6b4b0c Aug 07 01:09:40.125163 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-653189493 Aug 07 01:09:40.125163 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-FlavorsAdminTestJSON-653189493-project Aug 07 01:09:40.125163 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:09:40.125163 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:09:40.125163 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: dcb338858f314453b2cc3a1cc701b453 Aug 07 01:09:40.125163 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-FlavorsAdminTestJSON-653189493-project Aug 07 01:09:40.125163 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:09:40.125163 n-d-master-1 devstack@n-api.service[119517]: {"server": {"name": "test", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "2124715292"}} Aug 07 01:09:40.125163 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:09:40.125163 n-d-master-1 devstack@n-api.service[119517]: exception: Flavor 2124715292 could not be found. Aug 07 01:09:40.126898 n-d-master-1 devstack@n-api.service[119517]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'e825bd61-bf05-4bd4-aa72-78daf2231731', 'flavorRef': '2124715292'}}} Aug 07 01:09:40.126898 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:09:40.126898 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:40.126898 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 07 01:09:40.126898 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 07 01:09:40.126898 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 01:09:40.126898 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 01:09:40.126898 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:09:40.126898 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:09:40.126898 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 01:09:40.126898 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 01:09:40.126898 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 01:09:40.126898 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:09:40.126898 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 01:09:40.126898 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 01:09:40.126898 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 2124715292 could not be found. Aug 07 01:09:40.126898 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:09:40.126898 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:09:40.126898 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:09:40.126898 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:40.133685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:40.133685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:40.133685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:09:40.133685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:09:40.133685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:09:40.133685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:09:40.133685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:09:40.133685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:09:40.133685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:09:40.133685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:09:40.133685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:09:40.133685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:09:40.133685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 07 01:09:40.133685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 07 01:09:40.133685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 07 01:09:40.133685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 2124715292 could not be found. Aug 07 01:09:40.133685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:09:40.133685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:09:40.133685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:09:40.133685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:09:40.133685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:09:40.139337 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:09:40.139337 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:09:40.139337 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:09:40.139337 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2124715292 could not be found. Aug 07 01:09:40.139337 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:09:40.139337 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3f7b9598-9c81-46a1-9afc-f42bd74ed811 tempest-FlavorsAdminTestJSON-653189493 tempest-FlavorsAdminTestJSON-653189493-project] Returning 400 to user: Flavor 2124715292 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:09:40.139337 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3f7b9598-9c81-46a1-9afc-f42bd74ed811 tempest-FlavorsAdminTestJSON-653189493 tempest-FlavorsAdminTestJSON-653189493-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.060076 Aug 07 01:09:40.139337 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 35/107] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:09:40 2022] POST /compute/v2.1/servers => generated 81 bytes in 62 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:40.145689 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-399cbb9e-97fb-4eba-8ff2-381f5dd0f7b7 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:40.146672 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:40.146672 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:09:40.185756 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-399cbb9e-97fb-4eba-8ff2-381f5dd0f7b7 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/2124715292" status: 202 len: 0 microversion: 2.1 time: 0.049382 Aug 07 01:09:40.186423 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 36/108] 10.222.0.39 () {58 vars in 1161 bytes} [Sun Aug 7 01:09:40 2022] DELETE /compute/v2.1/flavors/2124715292 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 01:09:40.196460 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bbc82b9f-436a-4774-a103-46ee48c789eb tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:40.251743 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bbc82b9f-436a-4774-a103-46ee48c789eb tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059023 Aug 07 01:09:40.276551 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 37/109] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:09:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:40.282439 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c8ed8523-8270-45c8-a155-958bdbe12a72 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2086658945", "id": 1356764496, "os-flavor-access:is_public": "False"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:40.334520 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c8ed8523-8270-45c8-a155-958bdbe12a72 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.056073 Aug 07 01:09:40.344043 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 38/110] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:09:40 2022] POST /compute/v2.1/flavors => generated 415 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:40.350287 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-898943a2-9247-4f4c-aa9e-b44d5ba1b928 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-391612711", "id": 239439739, "os-flavor-access:is_public": "True"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:40.416742 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-524ae307-d265-44a3-8755-19adb4cee658 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a892781ecd4300b6dd10b9c235e263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e7e61e7eb4c9490b7632bde85d2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:40.430468 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-524ae307-d265-44a3-8755-19adb4cee658 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] 10.222.0.39 "GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a" status: 200 len: 1338 microversion: 2.1 time: 0.701861 Aug 07 01:09:40.432382 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 73/111] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:39 2022] GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a => generated 1338 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:40.449795 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-898943a2-9247-4f4c-aa9e-b44d5ba1b928 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.098118 Aug 07 01:09:40.465488 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b3db9160-f462-435f-9095-7fe1c06c6d51 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:40.467689 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 39/112] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:09:40 2022] POST /compute/v2.1/flavors => generated 410 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:40.521167 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b3db9160-f462-435f-9095-7fe1c06c6d51 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.061338 Aug 07 01:09:40.536502 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 74/113] 10.222.0.39 () {58 vars in 1169 bytes} [Sun Aug 7 01:09:40 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:40.540649 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2817ff8f-facc-41c1-afac-fd9b08141a82 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:40.604592 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2817ff8f-facc-41c1-afac-fd9b08141a82 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.067173 Aug 07 01:09:40.605769 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 40/114] 10.222.0.39 () {58 vars in 1177 bytes} [Sun Aug 7 01:09:40 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:40.620302 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9775fe63-2f12-4d64-9680-8e865bc6da8e tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:40.657277 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8fe25b3a-3bb4-47a7-a886-d10b0cb48d35 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:40.660972 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8fe25b3a-3bb4-47a7-a886-d10b0cb48d35 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] [instance: e40f1306-cb41-4d73-94a2-aeea34eb0f0c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:40.665855 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9775fe63-2f12-4d64-9680-8e865bc6da8e tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.049998 Aug 07 01:09:40.671246 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 75/115] 10.222.0.39 () {58 vars in 1171 bytes} [Sun Aug 7 01:09:40 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:40.675257 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8fe25b3a-3bb4-47a7-a886-d10b0cb48d35 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:40.676012 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8fe25b3a-3bb4-47a7-a886-d10b0cb48d35 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:40.676608 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8fe25b3a-3bb4-47a7-a886-d10b0cb48d35 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:40.682964 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-233b59f1-625c-4c52-b04e-33cb2e851d75 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:40.684567 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8fe25b3a-3bb4-47a7-a886-d10b0cb48d35 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:40.685299 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8fe25b3a-3bb4-47a7-a886-d10b0cb48d35 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:40.687007 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8fe25b3a-3bb4-47a7-a886-d10b0cb48d35 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:40.721005 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-233b59f1-625c-4c52-b04e-33cb2e851d75 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.042294 Aug 07 01:09:40.722157 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 76/116] 10.222.0.39 () {58 vars in 1169 bytes} [Sun Aug 7 01:09:40 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:40.741139 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-686e9934-767a-4821-a45a-f600bab1eab8 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:40.783877 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-686e9934-767a-4821-a45a-f600bab1eab8 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5391 microversion: 2.1 time: 0.047463 Aug 07 01:09:40.795450 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 77/117] 10.222.0.39 () {58 vars in 1169 bytes} [Sun Aug 7 01:09:40 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5391 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:40.811413 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-19094622-e177-4410-ba4a-4918ec7a38ce tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:40.857090 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-19094622-e177-4410-ba4a-4918ec7a38ce tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5391 microversion: 2.1 time: 0.047789 Aug 07 01:09:40.857735 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 78/118] 10.222.0.39 () {58 vars in 1175 bytes} [Sun Aug 7 01:09:40 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5391 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:40.882287 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-493f0be6-d995-43ec-a317-122e853c2706 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:40.926869 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8fe25b3a-3bb4-47a7-a886-d10b0cb48d35 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e60f068764c4a259771662a83663cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0af4ec538f41868c10700c90e816d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:40.938009 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-493f0be6-d995-43ec-a317-122e853c2706 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5391 microversion: 2.1 time: 0.060299 Aug 07 01:09:40.942443 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 79/119] 10.222.0.39 () {58 vars in 1173 bytes} [Sun Aug 7 01:09:40 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5391 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:40.946748 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8fe25b3a-3bb4-47a7-a886-d10b0cb48d35 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] 10.222.0.39 "GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c" status: 200 len: 1293 microversion: 2.1 time: 0.312382 Aug 07 01:09:40.964834 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 41/120] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:40 2022] GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c => generated 1293 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:40.968871 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-678f69be-841b-4bf6-8485-0f79f8bf23e9 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:41.008465 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b801b428-b5d1-4dbd-a331-feb0070d16a8 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:41.010063 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b801b428-b5d1-4dbd-a331-feb0070d16a8 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: f11385ef-0cd8-406a-b905-81a8a6512ebe] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:41.023318 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-678f69be-841b-4bf6-8485-0f79f8bf23e9 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5391 microversion: 2.1 time: 0.066167 Aug 07 01:09:41.025250 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 80/121] 10.222.0.39 () {58 vars in 1169 bytes} [Sun Aug 7 01:09:40 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5391 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:41.029972 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b801b428-b5d1-4dbd-a331-feb0070d16a8 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:41.033854 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b801b428-b5d1-4dbd-a331-feb0070d16a8 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:41.034429 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b801b428-b5d1-4dbd-a331-feb0070d16a8 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:41.036156 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b801b428-b5d1-4dbd-a331-feb0070d16a8 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:41.039325 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b801b428-b5d1-4dbd-a331-feb0070d16a8 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:41.039859 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b801b428-b5d1-4dbd-a331-feb0070d16a8 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:41.053565 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e801cf0f-cd08-4f97-a16e-67603d35f070 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:41.054449 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:41.054449 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:09:41.111974 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e801cf0f-cd08-4f97-a16e-67603d35f070 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/239439739" status: 202 len: 0 microversion: 2.1 time: 0.064787 Aug 07 01:09:41.112873 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 81/122] 10.222.0.39 () {58 vars in 1158 bytes} [Sun Aug 7 01:09:41 2022] DELETE /compute/v2.1/flavors/239439739 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 01:09:41.120968 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2e220921-76f6-4d30-afb3-b7e336b051b8 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:41.184330 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2e220921-76f6-4d30-afb3-b7e336b051b8 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.067113 Aug 07 01:09:41.186069 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 82/123] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:09:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:41.215652 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a7ac1c9b-a321-4031-8de6-cba08a1dfe63 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:41.247568 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a7ac1c9b-a321-4031-8de6-cba08a1dfe63 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1356764496" status: 202 len: 0 microversion: 2.1 time: 0.045860 Aug 07 01:09:41.249804 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 83/124] 10.222.0.39 () {58 vars in 1161 bytes} [Sun Aug 7 01:09:41 2022] DELETE /compute/v2.1/flavors/1356764496 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:09:41.265913 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6cf505a0-1bb8-4422-93a6-85f8158e2182 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:41.282444 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b801b428-b5d1-4dbd-a331-feb0070d16a8 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909b8165f015473c9977ef92aaf0741b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010ea68aed824d6bac970360d34ab747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:41.300839 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6cf505a0-1bb8-4422-93a6-85f8158e2182 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045293 Aug 07 01:09:41.302621 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 84/125] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:09:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:41.328010 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4b9c21d8-21d1-433c-830c-332de4230d70 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2103869717", "id": 270612584, "os-flavor-access:is_public": "False"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:41.331906 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:41.331906 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:09:41.341155 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b801b428-b5d1-4dbd-a331-feb0070d16a8 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe" status: 200 len: 1277 microversion: 2.1 time: 0.343483 Aug 07 01:09:41.343337 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 42/126] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:40 2022] GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe => generated 1277 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:41.391797 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4b9c21d8-21d1-433c-830c-332de4230d70 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.068873 Aug 07 01:09:41.392857 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 85/127] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:09:41 2022] POST /compute/v2.1/flavors => generated 412 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:41.408445 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8009bc2e-6687-4236-b78a-1e621cce513d tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:41.462027 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bbefe74d-cf0d-49b2-af06-c46000bb3ad3 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:41.463456 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bbefe74d-cf0d-49b2-af06-c46000bb3ad3 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] [instance: 7028fed0-c1db-491a-b46f-345ead213c7a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:41.500344 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bbefe74d-cf0d-49b2-af06-c46000bb3ad3 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:41.505083 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bbefe74d-cf0d-49b2-af06-c46000bb3ad3 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:41.506227 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8009bc2e-6687-4236-b78a-1e621cce513d tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.101820 Aug 07 01:09:41.508604 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bbefe74d-cf0d-49b2-af06-c46000bb3ad3 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:41.508784 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bbefe74d-cf0d-49b2-af06-c46000bb3ad3 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:41.511934 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 43/128] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:09:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:41.516414 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bbefe74d-cf0d-49b2-af06-c46000bb3ad3 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:41.519970 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bbefe74d-cf0d-49b2-af06-c46000bb3ad3 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:41.539536 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bc8c0119-55c9-4325-bc83-1e97d12868e5 tempest-FlavorsAdminTestJSON-653189493 tempest-FlavorsAdminTestJSON-653189493-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:41.605752 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bc8c0119-55c9-4325-bc83-1e97d12868e5 tempest-FlavorsAdminTestJSON-653189493 tempest-FlavorsAdminTestJSON-653189493-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.079012 Aug 07 01:09:41.607434 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 44/129] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:09:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:09:41.631342 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7704b4b2-9c8e-4444-a115-de4d0bbd8f2d tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:41.637044 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:41.637044 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:09:41.730851 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7704b4b2-9c8e-4444-a115-de4d0bbd8f2d tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/270612584" status: 202 len: 0 microversion: 2.1 time: 0.109292 Aug 07 01:09:41.732828 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 45/130] 10.222.0.39 () {58 vars in 1158 bytes} [Sun Aug 7 01:09:41 2022] DELETE /compute/v2.1/flavors/270612584 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 01:09:41.751105 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-35e2f0e7-9898-4a59-8112-49785cd92bf7 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:41.799095 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-35e2f0e7-9898-4a59-8112-49785cd92bf7 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056229 Aug 07 01:09:41.800650 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 46/131] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:09:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:41.831324 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7520a12c-30f6-41a8-aa8c-316d18c92615 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-363960986", "id": 1089216400, "os-flavor-access:is_public": "True"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:41.836669 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:41.836669 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:09:41.888791 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7520a12c-30f6-41a8-aa8c-316d18c92615 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.049093 Aug 07 01:09:41.888791 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 47/132] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:09:41 2022] POST /compute/v2.1/flavors => generated 413 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:41.898836 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-61f95cc1-7d78-4934-bd95-1b29257abb0b tempest-FlavorsAdminTestJSON-653189493 tempest-FlavorsAdminTestJSON-653189493-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:41.971030 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bbefe74d-cf0d-49b2-af06-c46000bb3ad3 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a892781ecd4300b6dd10b9c235e263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e7e61e7eb4c9490b7632bde85d2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:41.986280 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bbefe74d-cf0d-49b2-af06-c46000bb3ad3 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] 10.222.0.39 "GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a" status: 200 len: 1338 microversion: 2.1 time: 0.534848 Aug 07 01:09:41.992873 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 86/133] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:41 2022] GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a => generated 1338 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:41.999742 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-682061ec-4e49-4749-b846-c755e9926289 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:42.006120 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-682061ec-4e49-4749-b846-c755e9926289 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] [instance: e40f1306-cb41-4d73-94a2-aeea34eb0f0c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:42.024604 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-682061ec-4e49-4749-b846-c755e9926289 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:42.030663 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-682061ec-4e49-4749-b846-c755e9926289 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:42.031665 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-682061ec-4e49-4749-b846-c755e9926289 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:42.033998 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-682061ec-4e49-4749-b846-c755e9926289 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:42.036627 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-61f95cc1-7d78-4934-bd95-1b29257abb0b tempest-FlavorsAdminTestJSON-653189493 tempest-FlavorsAdminTestJSON-653189493-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.145326 Aug 07 01:09:42.037940 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 48/134] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:09:41 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:42.038786 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-682061ec-4e49-4749-b846-c755e9926289 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:42.040968 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-682061ec-4e49-4749-b846-c755e9926289 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:42.068314 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-58248f97-9896-49f1-9e8c-e863764bc112 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:42.126035 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-58248f97-9896-49f1-9e8c-e863764bc112 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1089216400" status: 202 len: 0 microversion: 2.1 time: 0.061249 Aug 07 01:09:42.127947 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 49/135] 10.222.0.39 () {58 vars in 1161 bytes} [Sun Aug 7 01:09:42 2022] DELETE /compute/v2.1/flavors/1089216400 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:09:42.135337 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bfab2d1f-68a0-44e1-8195-330905764ca3 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:42.168173 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bfab2d1f-68a0-44e1-8195-330905764ca3 tempest-FlavorsAdminTestJSON-1970079331 tempest-FlavorsAdminTestJSON-1970079331-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036907 Aug 07 01:09:42.183674 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 50/136] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:09:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:42.216515 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-682061ec-4e49-4749-b846-c755e9926289 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e60f068764c4a259771662a83663cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0af4ec538f41868c10700c90e816d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:42.232525 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-682061ec-4e49-4749-b846-c755e9926289 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] 10.222.0.39 "GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c" status: 200 len: 1293 microversion: 2.1 time: 0.235564 Aug 07 01:09:42.235237 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 87/137] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:41 2022] GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c => generated 1293 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:42.397012 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f3c7f8ff-9557-4b46-bff9-a80c20fcab41 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:42.403067 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f3c7f8ff-9557-4b46-bff9-a80c20fcab41 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: f11385ef-0cd8-406a-b905-81a8a6512ebe] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:42.438826 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=12 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:42.451998 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f3c7f8ff-9557-4b46-bff9-a80c20fcab41 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:42.453330 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f3c7f8ff-9557-4b46-bff9-a80c20fcab41 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:42.459257 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f3c7f8ff-9557-4b46-bff9-a80c20fcab41 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:42.461352 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f3c7f8ff-9557-4b46-bff9-a80c20fcab41 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:42.462557 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f3c7f8ff-9557-4b46-bff9-a80c20fcab41 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:42.465948 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f3c7f8ff-9557-4b46-bff9-a80c20fcab41 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:43.003293 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f3c7f8ff-9557-4b46-bff9-a80c20fcab41 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909b8165f015473c9977ef92aaf0741b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010ea68aed824d6bac970360d34ab747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:43.029724 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-750019bc-c811-4f13-b240-f269b4b7c3c2 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:43.031192 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-750019bc-c811-4f13-b240-f269b4b7c3c2 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] [instance: 7028fed0-c1db-491a-b46f-345ead213c7a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:43.033324 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f3c7f8ff-9557-4b46-bff9-a80c20fcab41 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe" status: 200 len: 1277 microversion: 2.1 time: 0.644787 Aug 07 01:09:43.044126 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 51/138] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:42 2022] GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe => generated 1277 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:43.057868 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-750019bc-c811-4f13-b240-f269b4b7c3c2 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:43.059478 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-750019bc-c811-4f13-b240-f269b4b7c3c2 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:43.060218 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-750019bc-c811-4f13-b240-f269b4b7c3c2 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:43.061090 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-750019bc-c811-4f13-b240-f269b4b7c3c2 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:43.061673 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-750019bc-c811-4f13-b240-f269b4b7c3c2 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:43.062213 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-750019bc-c811-4f13-b240-f269b4b7c3c2 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:43.271872 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e4a47918-0045-4548-bd17-fa4cf2abda55 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:43.273582 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e4a47918-0045-4548-bd17-fa4cf2abda55 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] [instance: e40f1306-cb41-4d73-94a2-aeea34eb0f0c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:43.335483 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4a47918-0045-4548-bd17-fa4cf2abda55 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:43.340825 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4a47918-0045-4548-bd17-fa4cf2abda55 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:43.342116 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4a47918-0045-4548-bd17-fa4cf2abda55 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:43.349375 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4a47918-0045-4548-bd17-fa4cf2abda55 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:43.355534 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4a47918-0045-4548-bd17-fa4cf2abda55 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:43.355534 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4a47918-0045-4548-bd17-fa4cf2abda55 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:43.583813 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=4 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:44.058396 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-750019bc-c811-4f13-b240-f269b4b7c3c2 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a892781ecd4300b6dd10b9c235e263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e7e61e7eb4c9490b7632bde85d2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:44.104330 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-750019bc-c811-4f13-b240-f269b4b7c3c2 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] 10.222.0.39 "GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a" status: 200 len: 1338 microversion: 2.1 time: 1.078576 Aug 07 01:09:44.110431 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 88/139] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:43 2022] GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a => generated 1338 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:09:44.170896 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7b1d0c2f-9897-4ea7-93f6-23663c8a0e34 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:44.177015 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7b1d0c2f-9897-4ea7-93f6-23663c8a0e34 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: f11385ef-0cd8-406a-b905-81a8a6512ebe] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:44.226449 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b1d0c2f-9897-4ea7-93f6-23663c8a0e34 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:44.232810 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b1d0c2f-9897-4ea7-93f6-23663c8a0e34 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:44.236010 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b1d0c2f-9897-4ea7-93f6-23663c8a0e34 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:44.245179 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b1d0c2f-9897-4ea7-93f6-23663c8a0e34 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:44.247247 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b1d0c2f-9897-4ea7-93f6-23663c8a0e34 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:44.254930 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b1d0c2f-9897-4ea7-93f6-23663c8a0e34 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:45.074522 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e4a47918-0045-4548-bd17-fa4cf2abda55 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e60f068764c4a259771662a83663cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0af4ec538f41868c10700c90e816d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:45.125451 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e4a47918-0045-4548-bd17-fa4cf2abda55 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] 10.222.0.39 "GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c" status: 200 len: 1335 microversion: 2.1 time: 1.860159 Aug 07 01:09:45.127970 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 52/140] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:43 2022] GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c => generated 1335 bytes in 1864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:09:45.144013 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-37c7e114-da7e-4896-a164-5b677603a14f tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:45.146132 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-37c7e114-da7e-4896-a164-5b677603a14f tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] [instance: 7028fed0-c1db-491a-b46f-345ead213c7a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:45.199521 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37c7e114-da7e-4896-a164-5b677603a14f tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:45.209291 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37c7e114-da7e-4896-a164-5b677603a14f tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:45.210891 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37c7e114-da7e-4896-a164-5b677603a14f tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:45.213107 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37c7e114-da7e-4896-a164-5b677603a14f tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:45.215175 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37c7e114-da7e-4896-a164-5b677603a14f tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:45.219439 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37c7e114-da7e-4896-a164-5b677603a14f tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:45.324113 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7b1d0c2f-9897-4ea7-93f6-23663c8a0e34 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909b8165f015473c9977ef92aaf0741b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010ea68aed824d6bac970360d34ab747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:45.367594 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7b1d0c2f-9897-4ea7-93f6-23663c8a0e34 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe" status: 200 len: 1277 microversion: 2.1 time: 1.252614 Aug 07 01:09:45.397702 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 89/141] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:44 2022] GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe => generated 1277 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:46.110576 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-37c7e114-da7e-4896-a164-5b677603a14f tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a892781ecd4300b6dd10b9c235e263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e7e61e7eb4c9490b7632bde85d2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:46.139741 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-37c7e114-da7e-4896-a164-5b677603a14f tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] 10.222.0.39 "GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a" status: 200 len: 1338 microversion: 2.1 time: 1.009376 Aug 07 01:09:46.142683 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 53/142] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:45 2022] GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a => generated 1338 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:46.172754 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-98eac85b-ae62-4952-9308-3daa860b3350 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:46.180090 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-98eac85b-ae62-4952-9308-3daa860b3350 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] [instance: e40f1306-cb41-4d73-94a2-aeea34eb0f0c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:46.194025 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=12 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:46.202661 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=16 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:46.241719 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-98eac85b-ae62-4952-9308-3daa860b3350 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:46.251398 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-98eac85b-ae62-4952-9308-3daa860b3350 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:46.255991 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-98eac85b-ae62-4952-9308-3daa860b3350 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:46.283010 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-98eac85b-ae62-4952-9308-3daa860b3350 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:46.283010 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-98eac85b-ae62-4952-9308-3daa860b3350 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:46.283010 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-98eac85b-ae62-4952-9308-3daa860b3350 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:46.430077 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6c27c7dd-6055-4b1c-b334-3ef7d9570efc tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:46.432502 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6c27c7dd-6055-4b1c-b334-3ef7d9570efc tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: f11385ef-0cd8-406a-b905-81a8a6512ebe] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:46.507650 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c27c7dd-6055-4b1c-b334-3ef7d9570efc tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:46.508913 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c27c7dd-6055-4b1c-b334-3ef7d9570efc tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:46.516956 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c27c7dd-6055-4b1c-b334-3ef7d9570efc tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:46.518617 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c27c7dd-6055-4b1c-b334-3ef7d9570efc tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:46.519680 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c27c7dd-6055-4b1c-b334-3ef7d9570efc tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:46.520702 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c27c7dd-6055-4b1c-b334-3ef7d9570efc tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:46.649659 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=14 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:47.954044 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-98eac85b-ae62-4952-9308-3daa860b3350 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e60f068764c4a259771662a83663cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0af4ec538f41868c10700c90e816d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:48.014639 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-98eac85b-ae62-4952-9308-3daa860b3350 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] 10.222.0.39 "GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c" status: 200 len: 1335 microversion: 2.1 time: 1.853132 Aug 07 01:09:48.034829 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 90/143] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:46 2022] GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c => generated 1335 bytes in 1877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:48.080659 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3c211d6b-0927-476d-be9f-be763a88fd16 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:48.093771 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3c211d6b-0927-476d-be9f-be763a88fd16 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] [instance: 7028fed0-c1db-491a-b46f-345ead213c7a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:48.149171 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c211d6b-0927-476d-be9f-be763a88fd16 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:48.153310 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c211d6b-0927-476d-be9f-be763a88fd16 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:48.154536 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c211d6b-0927-476d-be9f-be763a88fd16 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:48.157281 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c211d6b-0927-476d-be9f-be763a88fd16 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:48.159657 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c211d6b-0927-476d-be9f-be763a88fd16 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:48.161133 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c211d6b-0927-476d-be9f-be763a88fd16 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:48.689793 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6c27c7dd-6055-4b1c-b334-3ef7d9570efc tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909b8165f015473c9977ef92aaf0741b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010ea68aed824d6bac970360d34ab747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:48.714119 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6c27c7dd-6055-4b1c-b334-3ef7d9570efc tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe" status: 200 len: 1319 microversion: 2.1 time: 2.298936 Aug 07 01:09:48.714774 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 54/144] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:46 2022] GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe => generated 1319 bytes in 2301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:49.203031 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-2fe0e028-b1dc-4db0-ab28-8f2e986d554c req-d56848d7-6dec-4261-91c0-b408254740d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7028fed0-c1db-491a-b46f-345ead213c7a", "tag": "e0121c8a-524d-48f2-a161-6a2525d23956"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:49.250552 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-2fe0e028-b1dc-4db0-ab28-8f2e986d554c req-d56848d7-6dec-4261-91c0-b408254740d0 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:49.251319 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-2fe0e028-b1dc-4db0-ab28-8f2e986d554c req-d56848d7-6dec-4261-91c0-b408254740d0 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:49.252031 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-2fe0e028-b1dc-4db0-ab28-8f2e986d554c req-d56848d7-6dec-4261-91c0-b408254740d0 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:49.357385 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-2fe0e028-b1dc-4db0-ab28-8f2e986d554c req-d56848d7-6dec-4261-91c0-b408254740d0 service nova] Creating event network-changed:e0121c8a-524d-48f2-a161-6a2525d23956 for instance 7028fed0-c1db-491a-b46f-345ead213c7a on n-h2-master-1 Aug 07 01:09:49.361645 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-2fe0e028-b1dc-4db0-ab28-8f2e986d554c req-d56848d7-6dec-4261-91c0-b408254740d0 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=119517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 07 01:09:49.362758 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-2fe0e028-b1dc-4db0-ab28-8f2e986d554c req-d56848d7-6dec-4261-91c0-b408254740d0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 07 01:09:49.367417 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2994e03f-6420-4b7d-80cc-dff21b95ea17 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:49.375840 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2994e03f-6420-4b7d-80cc-dff21b95ea17 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:49.378236 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2994e03f-6420-4b7d-80cc-dff21b95ea17 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:49.382765 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2994e03f-6420-4b7d-80cc-dff21b95ea17 None None] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:49.389554 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2994e03f-6420-4b7d-80cc-dff21b95ea17 None None] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:49.392913 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2994e03f-6420-4b7d-80cc-dff21b95ea17 None None] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:49.469590 n-d-master-1 devstack@n-api.service[119517]: INFO nova.compute.rpcapi [None req-2994e03f-6420-4b7d-80cc-dff21b95ea17 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 07 01:09:49.471455 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2994e03f-6420-4b7d-80cc-dff21b95ea17 None None] Releasing lock "compute-rpcapi-router" {{(pid=119517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 07 01:09:49.562028 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2994e03f-6420-4b7d-80cc-dff21b95ea17 None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.835009 Aug 07 01:09:49.563949 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 55/145] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:49.583798 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b2827406-e195-44bd-b215-098d8dfa8293 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:49.591511 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b2827406-e195-44bd-b215-098d8dfa8293 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] [instance: e40f1306-cb41-4d73-94a2-aeea34eb0f0c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:49.640923 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2827406-e195-44bd-b215-098d8dfa8293 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:49.645523 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2827406-e195-44bd-b215-098d8dfa8293 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:49.648880 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2827406-e195-44bd-b215-098d8dfa8293 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:49.655247 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2827406-e195-44bd-b215-098d8dfa8293 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:49.660578 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2827406-e195-44bd-b215-098d8dfa8293 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:49.664180 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2827406-e195-44bd-b215-098d8dfa8293 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:50.437774 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3c211d6b-0927-476d-be9f-be763a88fd16 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a892781ecd4300b6dd10b9c235e263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e7e61e7eb4c9490b7632bde85d2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:50.463621 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3c211d6b-0927-476d-be9f-be763a88fd16 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] 10.222.0.39 "GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a" status: 200 len: 1338 microversion: 2.1 time: 2.422712 Aug 07 01:09:50.466090 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 91/146] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:48 2022] GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a => generated 1338 bytes in 2430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:50.476431 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9f513aa8-88a7-43b9-946a-41b21d7aeab7 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:50.478238 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9f513aa8-88a7-43b9-946a-41b21d7aeab7 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: f11385ef-0cd8-406a-b905-81a8a6512ebe] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:50.491641 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f513aa8-88a7-43b9-946a-41b21d7aeab7 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:50.493042 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f513aa8-88a7-43b9-946a-41b21d7aeab7 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:50.494709 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f513aa8-88a7-43b9-946a-41b21d7aeab7 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:50.497046 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f513aa8-88a7-43b9-946a-41b21d7aeab7 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:50.498417 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f513aa8-88a7-43b9-946a-41b21d7aeab7 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:50.500658 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f513aa8-88a7-43b9-946a-41b21d7aeab7 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:51.848410 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9f513aa8-88a7-43b9-946a-41b21d7aeab7 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909b8165f015473c9977ef92aaf0741b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010ea68aed824d6bac970360d34ab747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:51.893147 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9f513aa8-88a7-43b9-946a-41b21d7aeab7 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe" status: 200 len: 1319 microversion: 2.1 time: 1.424497 Aug 07 01:09:51.904875 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 92/147] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:50 2022] GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe => generated 1319 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:52.045917 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b2827406-e195-44bd-b215-098d8dfa8293 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e60f068764c4a259771662a83663cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0af4ec538f41868c10700c90e816d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:52.070317 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b2827406-e195-44bd-b215-098d8dfa8293 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] 10.222.0.39 "GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c" status: 200 len: 1335 microversion: 2.1 time: 2.501220 Aug 07 01:09:52.074344 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 56/148] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:49 2022] GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c => generated 1335 bytes in 2509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:52.646554 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-eefae0fa-8088-488c-8909-f8af6f290762 req-a57120a1-ec83-44c3-81cf-a3c1b45446ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e40f1306-cb41-4d73-94a2-aeea34eb0f0c", "tag": "3f47ad93-5e2c-4dd6-9b85-b3bb64cf5de3"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:52.674148 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-eefae0fa-8088-488c-8909-f8af6f290762 req-a57120a1-ec83-44c3-81cf-a3c1b45446ac service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:52.674970 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-eefae0fa-8088-488c-8909-f8af6f290762 req-a57120a1-ec83-44c3-81cf-a3c1b45446ac service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:52.677756 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-eefae0fa-8088-488c-8909-f8af6f290762 req-a57120a1-ec83-44c3-81cf-a3c1b45446ac service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:52.717916 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-eefae0fa-8088-488c-8909-f8af6f290762 req-a57120a1-ec83-44c3-81cf-a3c1b45446ac service nova] Creating event network-changed:3f47ad93-5e2c-4dd6-9b85-b3bb64cf5de3 for instance e40f1306-cb41-4d73-94a2-aeea34eb0f0c on n-h2-master-1 Aug 07 01:09:52.751789 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-eefae0fa-8088-488c-8909-f8af6f290762 req-a57120a1-ec83-44c3-81cf-a3c1b45446ac service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.670072 Aug 07 01:09:52.754482 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5e720aef-237f-4da1-b3a8-deef1dce2293 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] Calling method '.version_select at 0x7f9e25345670>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:52.756984 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:52.756984 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:09:52.757931 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 57/149] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:52.763936 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e720aef-237f-4da1-b3a8-deef1dce2293 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:52.773055 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e720aef-237f-4da1-b3a8-deef1dce2293 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:52.777956 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cba15f00-0efd-4d5f-b561-26bc1b036b65 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:52.778564 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e720aef-237f-4da1-b3a8-deef1dce2293 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:52.780734 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-cba15f00-0efd-4d5f-b561-26bc1b036b65 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] [instance: 7028fed0-c1db-491a-b46f-345ead213c7a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:52.800434 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cba15f00-0efd-4d5f-b561-26bc1b036b65 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:52.801147 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cba15f00-0efd-4d5f-b561-26bc1b036b65 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:52.804168 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cba15f00-0efd-4d5f-b561-26bc1b036b65 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:52.807262 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cba15f00-0efd-4d5f-b561-26bc1b036b65 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:52.808598 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cba15f00-0efd-4d5f-b561-26bc1b036b65 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:52.810159 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cba15f00-0efd-4d5f-b561-26bc1b036b65 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:52.894492 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e720aef-237f-4da1-b3a8-deef1dce2293 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:52.901371 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e720aef-237f-4da1-b3a8-deef1dce2293 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:52.902141 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e720aef-237f-4da1-b3a8-deef1dce2293 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:52.952208 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e720aef-237f-4da1-b3a8-deef1dce2293 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:52.953054 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e720aef-237f-4da1-b3a8-deef1dce2293 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:52.953835 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e720aef-237f-4da1-b3a8-deef1dce2293 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:52.991053 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5e720aef-237f-4da1-b3a8-deef1dce2293 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.084516 Aug 07 01:09:53.001605 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 93/150] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:09:51 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:53.058423 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ba89ebd5-f88c-4555-bd85-743a2d8f6c73 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:53.059976 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ba89ebd5-f88c-4555-bd85-743a2d8f6c73 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: f11385ef-0cd8-406a-b905-81a8a6512ebe] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:53.084721 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ba89ebd5-f88c-4555-bd85-743a2d8f6c73 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:53.091120 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ba89ebd5-f88c-4555-bd85-743a2d8f6c73 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:53.092828 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ba89ebd5-f88c-4555-bd85-743a2d8f6c73 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:53.099525 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ba89ebd5-f88c-4555-bd85-743a2d8f6c73 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:53.104141 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ba89ebd5-f88c-4555-bd85-743a2d8f6c73 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:53.105962 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ba89ebd5-f88c-4555-bd85-743a2d8f6c73 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:53.182199 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:53.655237 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ba89ebd5-f88c-4555-bd85-743a2d8f6c73 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909b8165f015473c9977ef92aaf0741b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010ea68aed824d6bac970360d34ab747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:53.686294 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ba89ebd5-f88c-4555-bd85-743a2d8f6c73 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe" status: 200 len: 1319 microversion: 2.1 time: 0.660150 Aug 07 01:09:53.687868 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 94/151] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:53 2022] GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe => generated 1319 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:53.709033 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7e68f377-b94f-429a-aff3-18b4e6bc2319 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] Calling method '.version_select at 0x7f9e25396670>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:53.710874 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:53.710874 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:09:53.713079 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e68f377-b94f-429a-aff3-18b4e6bc2319 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:53.714484 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e68f377-b94f-429a-aff3-18b4e6bc2319 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:53.715316 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e68f377-b94f-429a-aff3-18b4e6bc2319 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:53.818474 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e68f377-b94f-429a-aff3-18b4e6bc2319 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:53.821033 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e68f377-b94f-429a-aff3-18b4e6bc2319 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:53.823934 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e68f377-b94f-429a-aff3-18b4e6bc2319 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:53.948542 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e68f377-b94f-429a-aff3-18b4e6bc2319 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:53.949749 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e68f377-b94f-429a-aff3-18b4e6bc2319 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:53.950561 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e68f377-b94f-429a-aff3-18b4e6bc2319 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:53.962321 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7e68f377-b94f-429a-aff3-18b4e6bc2319 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/n-h2-master-1/servers" status: 200 len: 275 microversion: 2.1 time: 0.268806 Aug 07 01:09:53.963797 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 95/152] 10.222.0.39 () {58 vars in 1212 bytes} [Sun Aug 7 01:09:53 2022] GET /compute/v2.1/os-hypervisors/n-h2-master-1/servers => generated 275 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:53.970454 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5d8c40bd-8f75-43b6-8b4f-39b1b2f298f8 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:53.971428 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5d8c40bd-8f75-43b6-8b4f-39b1b2f298f8 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] [instance: e40f1306-cb41-4d73-94a2-aeea34eb0f0c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:53.997119 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5d8c40bd-8f75-43b6-8b4f-39b1b2f298f8 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:54.002430 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5d8c40bd-8f75-43b6-8b4f-39b1b2f298f8 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:54.005331 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5d8c40bd-8f75-43b6-8b4f-39b1b2f298f8 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:54.012307 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5d8c40bd-8f75-43b6-8b4f-39b1b2f298f8 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:54.016122 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5d8c40bd-8f75-43b6-8b4f-39b1b2f298f8 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:54.017950 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5d8c40bd-8f75-43b6-8b4f-39b1b2f298f8 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:54.191624 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-cba15f00-0efd-4d5f-b561-26bc1b036b65 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a892781ecd4300b6dd10b9c235e263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e7e61e7eb4c9490b7632bde85d2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:54.218854 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cba15f00-0efd-4d5f-b561-26bc1b036b65 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] 10.222.0.39 "GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a" status: 200 len: 1338 microversion: 2.1 time: 1.455399 Aug 07 01:09:54.220255 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 58/153] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:52 2022] GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a => generated 1338 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:54.229656 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-562a8420-f2da-458e-96a2-4d2848711520 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] Calling method '.version_select at 0x7f9e25281790>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:54.231426 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:54.231426 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:09:54.233325 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-562a8420-f2da-458e-96a2-4d2848711520 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:54.235773 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-562a8420-f2da-458e-96a2-4d2848711520 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:54.236743 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-562a8420-f2da-458e-96a2-4d2848711520 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:54.336627 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-562a8420-f2da-458e-96a2-4d2848711520 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:54.338283 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-562a8420-f2da-458e-96a2-4d2848711520 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:54.340057 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-562a8420-f2da-458e-96a2-4d2848711520 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:54.389568 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-562a8420-f2da-458e-96a2-4d2848711520 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:54.391815 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-562a8420-f2da-458e-96a2-4d2848711520 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:54.397130 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-562a8420-f2da-458e-96a2-4d2848711520 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:54.428186 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-562a8420-f2da-458e-96a2-4d2848711520 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.205818 Aug 07 01:09:54.435710 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 59/154] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:09:54 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:54.459940 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c8e16984-017d-4255-84d3-f5cc7efd1f69 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] Calling method '.version_select at 0x7f9e25212af0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:54.463318 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:54.463318 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:09:54.468949 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c8e16984-017d-4255-84d3-f5cc7efd1f69 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:54.475516 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c8e16984-017d-4255-84d3-f5cc7efd1f69 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:54.477176 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c8e16984-017d-4255-84d3-f5cc7efd1f69 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:54.558873 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5d8c40bd-8f75-43b6-8b4f-39b1b2f298f8 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e60f068764c4a259771662a83663cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0af4ec538f41868c10700c90e816d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:54.586353 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c8e16984-017d-4255-84d3-f5cc7efd1f69 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:54.586978 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5d8c40bd-8f75-43b6-8b4f-39b1b2f298f8 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] 10.222.0.39 "GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c" status: 200 len: 1335 microversion: 2.1 time: 0.618656 Aug 07 01:09:54.588400 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 96/155] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:53 2022] GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c => generated 1335 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:54.589982 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c8e16984-017d-4255-84d3-f5cc7efd1f69 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:54.591146 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c8e16984-017d-4255-84d3-f5cc7efd1f69 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:54.596779 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=97 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:54.603434 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c8e16984-017d-4255-84d3-f5cc7efd1f69 tempest-HypervisorAdminUnderV252Test-957861930 tempest-HypervisorAdminUnderV252Test-957861930-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/n-h2-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.158767 Aug 07 01:09:54.612750 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 60/156] 10.222.0.39 () {58 vars in 1209 bytes} [Sun Aug 7 01:09:54 2022] GET /compute/v2.1/os-hypervisors/n-h2-master-1/search => generated 104 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:09:54.734565 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4bdacdfd-8062-4b69-b1bc-233c9740b561 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:54.735807 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4bdacdfd-8062-4b69-b1bc-233c9740b561 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: f11385ef-0cd8-406a-b905-81a8a6512ebe] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:54.751004 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4bdacdfd-8062-4b69-b1bc-233c9740b561 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:54.752830 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4bdacdfd-8062-4b69-b1bc-233c9740b561 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:54.754803 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4bdacdfd-8062-4b69-b1bc-233c9740b561 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:54.762700 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4bdacdfd-8062-4b69-b1bc-233c9740b561 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:54.764038 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4bdacdfd-8062-4b69-b1bc-233c9740b561 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:54.765501 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4bdacdfd-8062-4b69-b1bc-233c9740b561 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:54.816079 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-12548203-6210-4a98-860c-9626a9979662 req-c7e3b820-4069-49bf-8078-5da94483b01b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f11385ef-0cd8-406a-b905-81a8a6512ebe", "tag": "302a0481-97d0-493a-923a-e1b6154f7cd1"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:54.849241 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-12548203-6210-4a98-860c-9626a9979662 req-c7e3b820-4069-49bf-8078-5da94483b01b service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:54.850422 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-12548203-6210-4a98-860c-9626a9979662 req-c7e3b820-4069-49bf-8078-5da94483b01b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:54.850952 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-12548203-6210-4a98-860c-9626a9979662 req-c7e3b820-4069-49bf-8078-5da94483b01b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:54.915983 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-12548203-6210-4a98-860c-9626a9979662 req-c7e3b820-4069-49bf-8078-5da94483b01b service nova] Creating event network-changed:302a0481-97d0-493a-923a-e1b6154f7cd1 for instance f11385ef-0cd8-406a-b905-81a8a6512ebe on n-h1-master-1 Aug 07 01:09:54.933668 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-12548203-6210-4a98-860c-9626a9979662 req-c7e3b820-4069-49bf-8078-5da94483b01b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126210 Aug 07 01:09:54.934974 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 61/157] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:09:55.209907 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4bdacdfd-8062-4b69-b1bc-233c9740b561 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909b8165f015473c9977ef92aaf0741b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010ea68aed824d6bac970360d34ab747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:55.220597 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4bdacdfd-8062-4b69-b1bc-233c9740b561 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe" status: 200 len: 1319 microversion: 2.1 time: 0.492375 Aug 07 01:09:55.241506 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 97/158] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:54 2022] GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe => generated 1319 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:55.265971 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fb88230d-1c0d-4e85-a907-817f3442b2fb tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:55.271867 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fb88230d-1c0d-4e85-a907-817f3442b2fb tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] [instance: 7028fed0-c1db-491a-b46f-345ead213c7a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:55.319372 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb88230d-1c0d-4e85-a907-817f3442b2fb tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:55.332467 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb88230d-1c0d-4e85-a907-817f3442b2fb tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:55.336552 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb88230d-1c0d-4e85-a907-817f3442b2fb tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:55.340566 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb88230d-1c0d-4e85-a907-817f3442b2fb tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:55.343772 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb88230d-1c0d-4e85-a907-817f3442b2fb tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:55.349509 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb88230d-1c0d-4e85-a907-817f3442b2fb tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:55.653238 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c50e3ac7-e870-4c2b-9006-31bb7c20e4f7 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:55.656290 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c50e3ac7-e870-4c2b-9006-31bb7c20e4f7 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] [instance: e40f1306-cb41-4d73-94a2-aeea34eb0f0c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:55.695412 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c50e3ac7-e870-4c2b-9006-31bb7c20e4f7 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:55.699075 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c50e3ac7-e870-4c2b-9006-31bb7c20e4f7 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:55.701451 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c50e3ac7-e870-4c2b-9006-31bb7c20e4f7 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:55.706177 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c50e3ac7-e870-4c2b-9006-31bb7c20e4f7 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:55.711865 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c50e3ac7-e870-4c2b-9006-31bb7c20e4f7 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:55.713064 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c50e3ac7-e870-4c2b-9006-31bb7c20e4f7 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:56.259756 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c50e3ac7-e870-4c2b-9006-31bb7c20e4f7 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e60f068764c4a259771662a83663cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0af4ec538f41868c10700c90e816d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:56.307211 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c50e3ac7-e870-4c2b-9006-31bb7c20e4f7 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] 10.222.0.39 "GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c" status: 200 len: 1335 microversion: 2.1 time: 0.675898 Aug 07 01:09:56.310480 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 98/159] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:55 2022] GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c => generated 1335 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:56.610775 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fb88230d-1c0d-4e85-a907-817f3442b2fb tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a892781ecd4300b6dd10b9c235e263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e7e61e7eb4c9490b7632bde85d2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:56.647742 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fb88230d-1c0d-4e85-a907-817f3442b2fb tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] 10.222.0.39 "GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a" status: 200 len: 1338 microversion: 2.1 time: 1.389882 Aug 07 01:09:56.652708 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 62/160] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:55 2022] GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a => generated 1338 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:56.675296 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4e5ebdaf-3e3a-4c5a-b17f-03c1985da5f3 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:56.679397 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4e5ebdaf-3e3a-4c5a-b17f-03c1985da5f3 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: f11385ef-0cd8-406a-b905-81a8a6512ebe] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:56.712107 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4e5ebdaf-3e3a-4c5a-b17f-03c1985da5f3 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:56.714019 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4e5ebdaf-3e3a-4c5a-b17f-03c1985da5f3 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:56.718460 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4e5ebdaf-3e3a-4c5a-b17f-03c1985da5f3 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:56.722893 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4e5ebdaf-3e3a-4c5a-b17f-03c1985da5f3 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:56.726467 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4e5ebdaf-3e3a-4c5a-b17f-03c1985da5f3 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:56.727755 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4e5ebdaf-3e3a-4c5a-b17f-03c1985da5f3 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:57.288607 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6cb193a2-ca18-41a2-94a8-c52cc333d0a1 tempest-HypervisorAdminV228Test-507306871 tempest-HypervisorAdminV228Test-507306871-project-admin] Calling method '.version_select at 0x7f9e253f3940>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:57.290695 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:57.290695 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:09:57.293109 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cb193a2-ca18-41a2-94a8-c52cc333d0a1 tempest-HypervisorAdminV228Test-507306871 tempest-HypervisorAdminV228Test-507306871-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:57.293977 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cb193a2-ca18-41a2-94a8-c52cc333d0a1 tempest-HypervisorAdminV228Test-507306871 tempest-HypervisorAdminV228Test-507306871-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:57.294773 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cb193a2-ca18-41a2-94a8-c52cc333d0a1 tempest-HypervisorAdminV228Test-507306871 tempest-HypervisorAdminV228Test-507306871-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:57.358833 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cb193a2-ca18-41a2-94a8-c52cc333d0a1 tempest-HypervisorAdminV228Test-507306871 tempest-HypervisorAdminV228Test-507306871-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:57.361582 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cb193a2-ca18-41a2-94a8-c52cc333d0a1 tempest-HypervisorAdminV228Test-507306871 tempest-HypervisorAdminV228Test-507306871-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:57.367245 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cb193a2-ca18-41a2-94a8-c52cc333d0a1 tempest-HypervisorAdminV228Test-507306871 tempest-HypervisorAdminV228Test-507306871-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:57.412065 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cb193a2-ca18-41a2-94a8-c52cc333d0a1 tempest-HypervisorAdminV228Test-507306871 tempest-HypervisorAdminV228Test-507306871-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:57.413847 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cb193a2-ca18-41a2-94a8-c52cc333d0a1 tempest-HypervisorAdminV228Test-507306871 tempest-HypervisorAdminV228Test-507306871-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:57.415005 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cb193a2-ca18-41a2-94a8-c52cc333d0a1 tempest-HypervisorAdminV228Test-507306871 tempest-HypervisorAdminV228Test-507306871-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:57.451107 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6cb193a2-ca18-41a2-94a8-c52cc333d0a1 tempest-HypervisorAdminV228Test-507306871 tempest-HypervisorAdminV228Test-507306871-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 1.136277 Aug 07 01:09:57.473095 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 99/161] 10.222.0.39 () {60 vars in 1187 bytes} [Sun Aug 7 01:09:56 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:09:57.526721 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4e5ebdaf-3e3a-4c5a-b17f-03c1985da5f3 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909b8165f015473c9977ef92aaf0741b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010ea68aed824d6bac970360d34ab747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:57.537058 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4e5ebdaf-3e3a-4c5a-b17f-03c1985da5f3 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe" status: 200 len: 1319 microversion: 2.1 time: 0.880152 Aug 07 01:09:57.538601 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 63/162] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:56 2022] GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe => generated 1319 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:57.544704 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b518a22f-d368-461a-aa8b-f7219ba1a437 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:57.545886 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b518a22f-d368-461a-aa8b-f7219ba1a437 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] [instance: e40f1306-cb41-4d73-94a2-aeea34eb0f0c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:57.554426 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b518a22f-d368-461a-aa8b-f7219ba1a437 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:57.555377 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b518a22f-d368-461a-aa8b-f7219ba1a437 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:57.556180 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b518a22f-d368-461a-aa8b-f7219ba1a437 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:57.557223 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b518a22f-d368-461a-aa8b-f7219ba1a437 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:57.557927 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b518a22f-d368-461a-aa8b-f7219ba1a437 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:57.558567 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b518a22f-d368-461a-aa8b-f7219ba1a437 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:58.034606 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f0e476d2-d424-4922-8b4d-1e5c106ccb11 tempest-FlavorsAccessTestJSON-700592258 tempest-FlavorsAccessTestJSON-700592258-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-2067221992", "id": 2016440534, "os-flavor-access:is_public": "False"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:58.041388 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:58.041388 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:09:58.075028 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f0e476d2-d424-4922-8b4d-1e5c106ccb11 tempest-FlavorsAccessTestJSON-700592258 tempest-FlavorsAccessTestJSON-700592258-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.598870 Aug 07 01:09:58.078222 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 100/163] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:09:57 2022] POST /compute/v2.1/flavors => generated 431 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:09:58.089810 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5ee15fff-34fe-495f-987d-57f6d7243d4c tempest-HypervisorAdminV228Test-507306871 tempest-HypervisorAdminV228Test-507306871-project-admin] Calling method '.version_select at 0x7f9e2537b0d0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:58.092035 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:58.092035 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:09:58.098865 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5ee15fff-34fe-495f-987d-57f6d7243d4c tempest-HypervisorAdminV228Test-507306871 tempest-HypervisorAdminV228Test-507306871-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:58.100759 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5ee15fff-34fe-495f-987d-57f6d7243d4c tempest-HypervisorAdminV228Test-507306871 tempest-HypervisorAdminV228Test-507306871-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:58.102614 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5ee15fff-34fe-495f-987d-57f6d7243d4c tempest-HypervisorAdminV228Test-507306871 tempest-HypervisorAdminV228Test-507306871-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:58.132480 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5ee15fff-34fe-495f-987d-57f6d7243d4c tempest-HypervisorAdminV228Test-507306871 tempest-HypervisorAdminV228Test-507306871-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:58.133178 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5ee15fff-34fe-495f-987d-57f6d7243d4c tempest-HypervisorAdminV228Test-507306871 tempest-HypervisorAdminV228Test-507306871-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:58.134364 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5ee15fff-34fe-495f-987d-57f6d7243d4c tempest-HypervisorAdminV228Test-507306871 tempest-HypervisorAdminV228Test-507306871-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:58.142498 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5ee15fff-34fe-495f-987d-57f6d7243d4c tempest-HypervisorAdminV228Test-507306871 tempest-HypervisorAdminV228Test-507306871-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.062165 Aug 07 01:09:58.156014 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 101/164] 10.222.0.39 () {60 vars in 1193 bytes} [Sun Aug 7 01:09:58 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:09:58.156014 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-625544c7-f241-4e7e-b775-311faf9ece8f tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:58.156014 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-625544c7-f241-4e7e-b775-311faf9ece8f tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] [instance: 7028fed0-c1db-491a-b46f-345ead213c7a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:58.174147 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-625544c7-f241-4e7e-b775-311faf9ece8f tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:58.174870 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-625544c7-f241-4e7e-b775-311faf9ece8f tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:58.175219 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-625544c7-f241-4e7e-b775-311faf9ece8f tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:58.176186 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-625544c7-f241-4e7e-b775-311faf9ece8f tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:58.176794 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-625544c7-f241-4e7e-b775-311faf9ece8f tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:58.177531 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-625544c7-f241-4e7e-b775-311faf9ece8f tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:58.391549 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b518a22f-d368-461a-aa8b-f7219ba1a437 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e60f068764c4a259771662a83663cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0af4ec538f41868c10700c90e816d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:58.404485 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b518a22f-d368-461a-aa8b-f7219ba1a437 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] 10.222.0.39 "GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c" status: 200 len: 1335 microversion: 2.1 time: 0.864002 Aug 07 01:09:58.405784 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 64/165] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:57 2022] GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c => generated 1335 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:58.422658 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-121d782d-1d5f-4718-b839-bf025c499997 tempest-FlavorsAccessTestJSON-700592258 tempest-FlavorsAccessTestJSON-700592258-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "5b93d58fe82b4d6bb4d4865c492dbaad"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:58.430376 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:58.430376 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:09:58.474952 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-625544c7-f241-4e7e-b775-311faf9ece8f tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a892781ecd4300b6dd10b9c235e263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e7e61e7eb4c9490b7632bde85d2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:58.513792 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-625544c7-f241-4e7e-b775-311faf9ece8f tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] 10.222.0.39 "GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a" status: 200 len: 1338 microversion: 2.1 time: 0.368775 Aug 07 01:09:58.514664 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 102/166] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:58 2022] GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a => generated 1338 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:58.581388 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-805b00b9-8612-4e3f-b221-329fd70d2404 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:58.582334 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-805b00b9-8612-4e3f-b221-329fd70d2404 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: f11385ef-0cd8-406a-b905-81a8a6512ebe] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:58.596451 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-805b00b9-8612-4e3f-b221-329fd70d2404 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:58.597522 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-805b00b9-8612-4e3f-b221-329fd70d2404 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:58.598190 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-805b00b9-8612-4e3f-b221-329fd70d2404 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:58.600943 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-805b00b9-8612-4e3f-b221-329fd70d2404 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:58.601425 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-805b00b9-8612-4e3f-b221-329fd70d2404 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:58.601868 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-805b00b9-8612-4e3f-b221-329fd70d2404 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:58.900385 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-121d782d-1d5f-4718-b839-bf025c499997 tempest-FlavorsAccessTestJSON-700592258 tempest-FlavorsAccessTestJSON-700592258-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/2016440534/action" status: 200 len: 97 microversion: 2.1 time: 0.492495 Aug 07 01:09:58.901603 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 65/167] 10.222.0.39 () {60 vars in 1200 bytes} [Sun Aug 7 01:09:58 2022] POST /compute/v2.1/flavors/2016440534/action => generated 97 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:09:58.945161 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-805b00b9-8612-4e3f-b221-329fd70d2404 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909b8165f015473c9977ef92aaf0741b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010ea68aed824d6bac970360d34ab747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:58.960840 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-805b00b9-8612-4e3f-b221-329fd70d2404 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe" status: 200 len: 1319 microversion: 2.1 time: 0.384012 Aug 07 01:09:58.974788 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 103/168] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:58 2022] GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe => generated 1319 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:09:59.189328 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b1119e5c-7988-4272-9f35-e9eb6e6ea256 tempest-FlavorsAccessTestJSON-1762863933 tempest-FlavorsAccessTestJSON-1762863933-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:59.227069 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b1119e5c-7988-4272-9f35-e9eb6e6ea256 tempest-FlavorsAccessTestJSON-1762863933 tempest-FlavorsAccessTestJSON-1762863933-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5412 microversion: 2.1 time: 0.314348 Aug 07 01:09:59.228556 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 66/169] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:09:58 2022] GET /compute/v2.1/flavors/detail => generated 5412 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:09:59.263067 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-064020ce-fc91-4321-bf0f-937b53458e0e tempest-FlavorsAccessTestJSON-700592258 tempest-FlavorsAccessTestJSON-700592258-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "5b93d58fe82b4d6bb4d4865c492dbaad"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:09:59.267390 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:59.267390 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:09:59.454016 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-90598ede-5d62-405f-b8c7-3f79442c3087 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:59.456195 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-90598ede-5d62-405f-b8c7-3f79442c3087 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] [instance: e40f1306-cb41-4d73-94a2-aeea34eb0f0c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:59.476504 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:59.503816 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90598ede-5d62-405f-b8c7-3f79442c3087 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:59.504787 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90598ede-5d62-405f-b8c7-3f79442c3087 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:59.505375 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90598ede-5d62-405f-b8c7-3f79442c3087 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:59.506499 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90598ede-5d62-405f-b8c7-3f79442c3087 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:59.507291 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90598ede-5d62-405f-b8c7-3f79442c3087 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:59.508043 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90598ede-5d62-405f-b8c7-3f79442c3087 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:59.649261 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-064020ce-fc91-4321-bf0f-937b53458e0e tempest-FlavorsAccessTestJSON-700592258 tempest-FlavorsAccessTestJSON-700592258-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/2016440534/action" status: 200 len: 21 microversion: 2.1 time: 0.393907 Aug 07 01:09:59.650657 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 104/170] 10.222.0.39 () {60 vars in 1200 bytes} [Sun Aug 7 01:09:59 2022] POST /compute/v2.1/flavors/2016440534/action => generated 21 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:09:59.666152 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-318602c2-0edf-4be0-b709-dff091ed7c8a tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:59.667812 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-318602c2-0edf-4be0-b709-dff091ed7c8a tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] [instance: 7028fed0-c1db-491a-b46f-345ead213c7a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:09:59.677940 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:DELETE=8,nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:59.681320 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-318602c2-0edf-4be0-b709-dff091ed7c8a tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:59.682736 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-318602c2-0edf-4be0-b709-dff091ed7c8a tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:59.684166 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-318602c2-0edf-4be0-b709-dff091ed7c8a tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:59.685692 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-318602c2-0edf-4be0-b709-dff091ed7c8a tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:09:59.686731 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-318602c2-0edf-4be0-b709-dff091ed7c8a tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:09:59.687620 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-318602c2-0edf-4be0-b709-dff091ed7c8a tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:09:59.781903 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-90598ede-5d62-405f-b8c7-3f79442c3087 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e60f068764c4a259771662a83663cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0af4ec538f41868c10700c90e816d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:59.797197 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-90598ede-5d62-405f-b8c7-3f79442c3087 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] 10.222.0.39 "GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c" status: 200 len: 1335 microversion: 2.1 time: 0.357039 Aug 07 01:09:59.797955 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 67/171] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:59 2022] GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c => generated 1335 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:59.808512 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-39a5cc64-9d09-456b-88c7-cb7772a2aab2 tempest-FlavorsAccessTestJSON-1762863933 tempest-FlavorsAccessTestJSON-1762863933-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:59.867357 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-39a5cc64-9d09-456b-88c7-cb7772a2aab2 tempest-FlavorsAccessTestJSON-1762863933 tempest-FlavorsAccessTestJSON-1762863933-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.066623 Aug 07 01:09:59.868451 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 68/172] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:09:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:09:59.901499 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a6b08cf2-bf0f-4a60-a0bf-23341e7e57e4 tempest-FlavorsAccessTestJSON-700592258 tempest-FlavorsAccessTestJSON-700592258-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:59.903775 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:59.903775 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:09:59.942492 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a6b08cf2-bf0f-4a60-a0bf-23341e7e57e4 tempest-FlavorsAccessTestJSON-700592258 tempest-FlavorsAccessTestJSON-700592258-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/2016440534" status: 202 len: 0 microversion: 2.1 time: 0.050817 Aug 07 01:09:59.943229 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 69/173] 10.222.0.39 () {58 vars in 1161 bytes} [Sun Aug 7 01:09:59 2022] DELETE /compute/v2.1/flavors/2016440534 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:09:59.960218 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3bf58f06-20e3-422a-9a3f-a66b797801b2 tempest-FlavorsAccessTestJSON-700592258 tempest-FlavorsAccessTestJSON-700592258-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:09:59.976043 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-318602c2-0edf-4be0-b709-dff091ed7c8a tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a892781ecd4300b6dd10b9c235e263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e7e61e7eb4c9490b7632bde85d2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:09:59.986856 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3bf58f06-20e3-422a-9a3f-a66b797801b2 tempest-FlavorsAccessTestJSON-700592258 tempest-FlavorsAccessTestJSON-700592258-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036680 Aug 07 01:09:59.988123 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 70/174] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:09:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:09:59.997000 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-318602c2-0edf-4be0-b709-dff091ed7c8a tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] 10.222.0.39 "GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a" status: 200 len: 1338 microversion: 2.1 time: 0.336022 Aug 07 01:09:59.997586 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 105/175] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:09:59 2022] GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a => generated 1338 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:00.025102 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2df5fa36-273d-4934-8e30-aea6c38a628c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:00.026062 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-92561a43-f2da-4c63-a763-a9ebf8d39a58 tempest-FlavorsAccessTestJSON-700592258 tempest-FlavorsAccessTestJSON-700592258-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1076635657", "id": 1497103868, "os-flavor-access:is_public": "False"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:00.026446 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2df5fa36-273d-4934-8e30-aea6c38a628c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: f11385ef-0cd8-406a-b905-81a8a6512ebe] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:00.031170 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:00.031170 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:00.034826 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2df5fa36-273d-4934-8e30-aea6c38a628c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:00.035649 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2df5fa36-273d-4934-8e30-aea6c38a628c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:00.036369 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2df5fa36-273d-4934-8e30-aea6c38a628c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:00.037093 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2df5fa36-273d-4934-8e30-aea6c38a628c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:00.038209 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2df5fa36-273d-4934-8e30-aea6c38a628c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:00.038209 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2df5fa36-273d-4934-8e30-aea6c38a628c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:00.066419 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-92561a43-f2da-4c63-a763-a9ebf8d39a58 tempest-FlavorsAccessTestJSON-700592258 tempest-FlavorsAccessTestJSON-700592258-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.047192 Aug 07 01:10:00.069148 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 71/176] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:10:00 2022] POST /compute/v2.1/flavors => generated 431 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:00.086821 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-54d18b55-dcfc-4275-8854-fa154d913d04 tempest-FlavorsAccessTestJSON-700592258 tempest-FlavorsAccessTestJSON-700592258-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:00.088246 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:00.088246 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:00.105850 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-54d18b55-dcfc-4275-8854-fa154d913d04 tempest-FlavorsAccessTestJSON-700592258 tempest-FlavorsAccessTestJSON-700592258-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/1497103868/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.026188 Aug 07 01:10:00.106711 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 72/177] 10.222.0.39 () {58 vars in 1209 bytes} [Sun Aug 7 01:10:00 2022] GET /compute/v2.1/flavors/1497103868/os-flavor-access => generated 21 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:10:00.118363 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-72b2c9c7-42a2-4c98-972b-0d06ab7bf77b tempest-FlavorsAccessTestJSON-700592258 tempest-FlavorsAccessTestJSON-700592258-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:00.142966 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-72b2c9c7-42a2-4c98-972b-0d06ab7bf77b tempest-FlavorsAccessTestJSON-700592258 tempest-FlavorsAccessTestJSON-700592258-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1497103868" status: 202 len: 0 microversion: 2.1 time: 0.028989 Aug 07 01:10:00.144400 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 73/178] 10.222.0.39 () {58 vars in 1161 bytes} [Sun Aug 7 01:10:00 2022] DELETE /compute/v2.1/flavors/1497103868 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:10:00.154315 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-961aa790-7c90-4881-91a7-a0d0acb30992 tempest-FlavorsAccessTestJSON-700592258 tempest-FlavorsAccessTestJSON-700592258-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:00.182818 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-961aa790-7c90-4881-91a7-a0d0acb30992 tempest-FlavorsAccessTestJSON-700592258 tempest-FlavorsAccessTestJSON-700592258-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032285 Aug 07 01:10:00.185045 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 74/179] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:10:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:00.376681 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2df5fa36-273d-4934-8e30-aea6c38a628c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909b8165f015473c9977ef92aaf0741b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010ea68aed824d6bac970360d34ab747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:00.405734 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2df5fa36-273d-4934-8e30-aea6c38a628c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe" status: 200 len: 1319 microversion: 2.1 time: 0.385017 Aug 07 01:10:00.407235 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 106/180] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:00 2022] GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe => generated 1319 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:00.831051 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e4fae188-c7df-43fa-bc66-864b2e3c7b4f tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:00.831968 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e4fae188-c7df-43fa-bc66-864b2e3c7b4f tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] [instance: e40f1306-cb41-4d73-94a2-aeea34eb0f0c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:00.838577 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4fae188-c7df-43fa-bc66-864b2e3c7b4f tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:00.839397 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4fae188-c7df-43fa-bc66-864b2e3c7b4f tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:00.839833 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4fae188-c7df-43fa-bc66-864b2e3c7b4f tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:00.840617 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4fae188-c7df-43fa-bc66-864b2e3c7b4f tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:00.841218 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4fae188-c7df-43fa-bc66-864b2e3c7b4f tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:00.841804 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4fae188-c7df-43fa-bc66-864b2e3c7b4f tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:01.041247 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-44b60b63-e763-4abc-b32c-d20f1696f725 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:01.041247 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-44b60b63-e763-4abc-b32c-d20f1696f725 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] [instance: 7028fed0-c1db-491a-b46f-345ead213c7a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:01.067488 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-44b60b63-e763-4abc-b32c-d20f1696f725 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:01.068453 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-44b60b63-e763-4abc-b32c-d20f1696f725 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:01.069275 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-44b60b63-e763-4abc-b32c-d20f1696f725 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:01.075940 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-44b60b63-e763-4abc-b32c-d20f1696f725 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:01.082233 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-44b60b63-e763-4abc-b32c-d20f1696f725 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:01.083492 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-44b60b63-e763-4abc-b32c-d20f1696f725 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:01.105825 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e4fae188-c7df-43fa-bc66-864b2e3c7b4f tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e60f068764c4a259771662a83663cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0af4ec538f41868c10700c90e816d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:01.139401 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e4fae188-c7df-43fa-bc66-864b2e3c7b4f tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] 10.222.0.39 "GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c" status: 200 len: 1335 microversion: 2.1 time: 0.311760 Aug 07 01:10:01.141786 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 75/181] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:00 2022] GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c => generated 1335 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:10:01.444425 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d37c6af1-a59c-4882-b158-be72e56f51fb tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:01.445505 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d37c6af1-a59c-4882-b158-be72e56f51fb tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: f11385ef-0cd8-406a-b905-81a8a6512ebe] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:01.469664 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d37c6af1-a59c-4882-b158-be72e56f51fb tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:01.477909 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d37c6af1-a59c-4882-b158-be72e56f51fb tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:01.479372 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d37c6af1-a59c-4882-b158-be72e56f51fb tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:01.480768 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d37c6af1-a59c-4882-b158-be72e56f51fb tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:01.481434 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d37c6af1-a59c-4882-b158-be72e56f51fb tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:01.482191 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d37c6af1-a59c-4882-b158-be72e56f51fb tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:01.639625 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-44b60b63-e763-4abc-b32c-d20f1696f725 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a892781ecd4300b6dd10b9c235e263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e7e61e7eb4c9490b7632bde85d2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:01.676682 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-44b60b63-e763-4abc-b32c-d20f1696f725 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] 10.222.0.39 "GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a" status: 200 len: 1338 microversion: 2.1 time: 0.647247 Aug 07 01:10:01.699937 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 107/182] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:01 2022] GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a => generated 1338 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:10:01.794258 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d37c6af1-a59c-4882-b158-be72e56f51fb tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909b8165f015473c9977ef92aaf0741b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010ea68aed824d6bac970360d34ab747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:01.818121 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d37c6af1-a59c-4882-b158-be72e56f51fb tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe" status: 200 len: 1319 microversion: 2.1 time: 0.378156 Aug 07 01:10:01.820861 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 76/183] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:01 2022] GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe => generated 1319 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:02.176857 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-47438665-f2d8-4f5d-9c25-06b892fd7880 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:02.180454 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-47438665-f2d8-4f5d-9c25-06b892fd7880 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] [instance: e40f1306-cb41-4d73-94a2-aeea34eb0f0c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:02.202774 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-47438665-f2d8-4f5d-9c25-06b892fd7880 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:02.204661 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-47438665-f2d8-4f5d-9c25-06b892fd7880 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:02.206297 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-47438665-f2d8-4f5d-9c25-06b892fd7880 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:02.210866 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-47438665-f2d8-4f5d-9c25-06b892fd7880 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:02.212037 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-47438665-f2d8-4f5d-9c25-06b892fd7880 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:02.212868 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-47438665-f2d8-4f5d-9c25-06b892fd7880 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:02.517887 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-47438665-f2d8-4f5d-9c25-06b892fd7880 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e60f068764c4a259771662a83663cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0af4ec538f41868c10700c90e816d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:02.529033 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-47438665-f2d8-4f5d-9c25-06b892fd7880 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] 10.222.0.39 "GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c" status: 200 len: 1335 microversion: 2.1 time: 0.363403 Aug 07 01:10:02.530251 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 108/184] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:02 2022] GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c => generated 1335 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:02.722445 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d9238435-7481-4bdf-b139-049048cf03a3 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:02.723631 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d9238435-7481-4bdf-b139-049048cf03a3 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] [instance: 7028fed0-c1db-491a-b46f-345ead213c7a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:02.763097 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9238435-7481-4bdf-b139-049048cf03a3 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:02.767179 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9238435-7481-4bdf-b139-049048cf03a3 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:02.770168 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9238435-7481-4bdf-b139-049048cf03a3 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:02.774661 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9238435-7481-4bdf-b139-049048cf03a3 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:02.777623 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9238435-7481-4bdf-b139-049048cf03a3 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:02.784399 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9238435-7481-4bdf-b139-049048cf03a3 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:02.842491 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dbc7e178-c4b9-49bf-90c6-79b3a0df0d69 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:02.843236 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-dbc7e178-c4b9-49bf-90c6-79b3a0df0d69 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: f11385ef-0cd8-406a-b905-81a8a6512ebe] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:02.855578 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dbc7e178-c4b9-49bf-90c6-79b3a0df0d69 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:02.856605 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dbc7e178-c4b9-49bf-90c6-79b3a0df0d69 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:02.858999 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dbc7e178-c4b9-49bf-90c6-79b3a0df0d69 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:02.861414 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dbc7e178-c4b9-49bf-90c6-79b3a0df0d69 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:02.863049 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dbc7e178-c4b9-49bf-90c6-79b3a0df0d69 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:02.864696 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dbc7e178-c4b9-49bf-90c6-79b3a0df0d69 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:03.181880 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-dbc7e178-c4b9-49bf-90c6-79b3a0df0d69 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909b8165f015473c9977ef92aaf0741b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010ea68aed824d6bac970360d34ab747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:03.195479 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-dbc7e178-c4b9-49bf-90c6-79b3a0df0d69 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe" status: 200 len: 1319 microversion: 2.1 time: 0.357275 Aug 07 01:10:03.196891 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 109/185] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:02 2022] GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe => generated 1319 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:10:03.316020 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d9238435-7481-4bdf-b139-049048cf03a3 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a892781ecd4300b6dd10b9c235e263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e7e61e7eb4c9490b7632bde85d2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:03.342679 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d9238435-7481-4bdf-b139-049048cf03a3 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] 10.222.0.39 "GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a" status: 200 len: 1338 microversion: 2.1 time: 0.628064 Aug 07 01:10:03.360854 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 77/186] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:02 2022] GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a => generated 1338 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:03.571669 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a6fedc08-a2a1-42a5-8796-4668d0b39983 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:03.573374 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a6fedc08-a2a1-42a5-8796-4668d0b39983 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] [instance: e40f1306-cb41-4d73-94a2-aeea34eb0f0c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:03.584425 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a6fedc08-a2a1-42a5-8796-4668d0b39983 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:03.585272 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a6fedc08-a2a1-42a5-8796-4668d0b39983 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:03.586401 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a6fedc08-a2a1-42a5-8796-4668d0b39983 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:03.588004 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a6fedc08-a2a1-42a5-8796-4668d0b39983 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:03.589186 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a6fedc08-a2a1-42a5-8796-4668d0b39983 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:03.589967 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a6fedc08-a2a1-42a5-8796-4668d0b39983 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:03.675733 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9e2a1caf-dfdd-4fee-bb65-bf488c739998 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Action: 'update', calling method: .version_select at 0x7f9e25283d30>, body: {"quota_set": {"ram": "5120"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:03.933475 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e2a1caf-dfdd-4fee-bb65-bf488c739998 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:03.934585 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e2a1caf-dfdd-4fee-bb65-bf488c739998 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:03.935632 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e2a1caf-dfdd-4fee-bb65-bf488c739998 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:03.940193 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e2a1caf-dfdd-4fee-bb65-bf488c739998 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:03.940671 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e2a1caf-dfdd-4fee-bb65-bf488c739998 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:03.945465 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e2a1caf-dfdd-4fee-bb65-bf488c739998 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:03.956901 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a6fedc08-a2a1-42a5-8796-4668d0b39983 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e60f068764c4a259771662a83663cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0af4ec538f41868c10700c90e816d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:03.986928 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a6fedc08-a2a1-42a5-8796-4668d0b39983 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] 10.222.0.39 "GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c" status: 200 len: 1335 microversion: 2.1 time: 0.419009 Aug 07 01:10:04.003992 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 78/187] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:03 2022] GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c => generated 1335 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:10:04.152509 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9e2a1caf-dfdd-4fee-bb65-bf488c739998 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/aebbd95a13394dc6b6b7585e5f3dbc20" status: 200 len: 240 microversion: 2.36 time: 0.953437 Aug 07 01:10:04.153936 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 110/188] 10.222.0.39 () {62 vars in 1303 bytes} [Sun Aug 7 01:10:03 2022] PUT /compute/v2.1/os-quota-sets/aebbd95a13394dc6b6b7585e5f3dbc20 => generated 240 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:10:04.168583 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-aed41ad7-42f5-4a69-ac03-7bd8da5c97af tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Calling method '.version_select at 0x7f9e25116820>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:04.234667 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6440de2a-0ade-4809-9838-747188b1a267 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:04.235931 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6440de2a-0ade-4809-9838-747188b1a267 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: f11385ef-0cd8-406a-b905-81a8a6512ebe] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:04.250360 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6440de2a-0ade-4809-9838-747188b1a267 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:04.250524 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6440de2a-0ade-4809-9838-747188b1a267 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:04.251351 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6440de2a-0ade-4809-9838-747188b1a267 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:04.253194 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6440de2a-0ade-4809-9838-747188b1a267 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:04.254673 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6440de2a-0ade-4809-9838-747188b1a267 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:04.256319 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6440de2a-0ade-4809-9838-747188b1a267 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:04.569059 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aed41ad7-42f5-4a69-ac03-7bd8da5c97af tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:04.570848 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aed41ad7-42f5-4a69-ac03-7bd8da5c97af tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:04.572002 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aed41ad7-42f5-4a69-ac03-7bd8da5c97af tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:04.574790 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aed41ad7-42f5-4a69-ac03-7bd8da5c97af tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:04.576561 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aed41ad7-42f5-4a69-ac03-7bd8da5c97af tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:04.578293 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aed41ad7-42f5-4a69-ac03-7bd8da5c97af tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:04.639359 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-aed41ad7-42f5-4a69-ac03-7bd8da5c97af tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/aebbd95a13394dc6b6b7585e5f3dbc20/detail" status: 200 len: 672 microversion: 2.36 time: 0.476069 Aug 07 01:10:04.646953 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 79/189] 10.222.0.39 () {60 vars in 1304 bytes} [Sun Aug 7 01:10:04 2022] GET /compute/v2.1/os-quota-sets/aebbd95a13394dc6b6b7585e5f3dbc20/detail => generated 672 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:10:04.687254 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6440de2a-0ade-4809-9838-747188b1a267 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909b8165f015473c9977ef92aaf0741b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010ea68aed824d6bac970360d34ab747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:04.703670 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6440de2a-0ade-4809-9838-747188b1a267 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe" status: 200 len: 1319 microversion: 2.1 time: 0.476953 Aug 07 01:10:04.705706 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 111/190] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:04 2022] GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe => generated 1319 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:04.716825 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-67e897d8-e3ab-447e-8831-39d5c47340c3 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:04.718487 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-67e897d8-e3ab-447e-8831-39d5c47340c3 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] [instance: 7028fed0-c1db-491a-b46f-345ead213c7a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:04.731107 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67e897d8-e3ab-447e-8831-39d5c47340c3 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:04.732315 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67e897d8-e3ab-447e-8831-39d5c47340c3 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:04.733390 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67e897d8-e3ab-447e-8831-39d5c47340c3 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:04.734749 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67e897d8-e3ab-447e-8831-39d5c47340c3 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:04.735606 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67e897d8-e3ab-447e-8831-39d5c47340c3 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:04.736452 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67e897d8-e3ab-447e-8831-39d5c47340c3 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:05.037301 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-67e897d8-e3ab-447e-8831-39d5c47340c3 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a892781ecd4300b6dd10b9c235e263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e7e61e7eb4c9490b7632bde85d2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:05.053943 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-67e897d8-e3ab-447e-8831-39d5c47340c3 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] 10.222.0.39 "GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a" status: 200 len: 1338 microversion: 2.1 time: 0.345926 Aug 07 01:10:05.055265 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 112/191] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:04 2022] GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a => generated 1338 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:05.065468 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b11e0160-0f46-4f02-86a1-85c40042a753 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:05.067040 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b11e0160-0f46-4f02-86a1-85c40042a753 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] [instance: e40f1306-cb41-4d73-94a2-aeea34eb0f0c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:05.109074 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b11e0160-0f46-4f02-86a1-85c40042a753 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:05.110373 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b11e0160-0f46-4f02-86a1-85c40042a753 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:05.115598 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b11e0160-0f46-4f02-86a1-85c40042a753 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:05.118490 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b11e0160-0f46-4f02-86a1-85c40042a753 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:05.119676 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b11e0160-0f46-4f02-86a1-85c40042a753 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:05.121078 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b11e0160-0f46-4f02-86a1-85c40042a753 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:05.170503 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-d9e904ee-6ed8-4ea5-bb9c-89af0b503b86 req-af7ec835-f5e6-486f-bf7a-308d322419fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f11385ef-0cd8-406a-b905-81a8a6512ebe", "name": "network-vif-plugged", "status": "completed", "tag": "302a0481-97d0-493a-923a-e1b6154f7cd1"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:05.177893 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:05.204011 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d9e904ee-6ed8-4ea5-bb9c-89af0b503b86 req-af7ec835-f5e6-486f-bf7a-308d322419fb service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:05.204843 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d9e904ee-6ed8-4ea5-bb9c-89af0b503b86 req-af7ec835-f5e6-486f-bf7a-308d322419fb service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:05.216116 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d9e904ee-6ed8-4ea5-bb9c-89af0b503b86 req-af7ec835-f5e6-486f-bf7a-308d322419fb service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:05.253723 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-d9e904ee-6ed8-4ea5-bb9c-89af0b503b86 req-af7ec835-f5e6-486f-bf7a-308d322419fb service nova] Creating event network-vif-plugged:302a0481-97d0-493a-923a-e1b6154f7cd1 for instance f11385ef-0cd8-406a-b905-81a8a6512ebe on n-h1-master-1 Aug 07 01:10:05.274780 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-d9e904ee-6ed8-4ea5-bb9c-89af0b503b86 req-af7ec835-f5e6-486f-bf7a-308d322419fb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.623495 Aug 07 01:10:05.282796 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 80/192] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:05.326336 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b4e21ff2-29ca-4276-8e3c-6970debfbdfd tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Action: 'update', calling method: .version_select at 0x7f9e251169d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:05.825543 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b4e21ff2-29ca-4276-8e3c-6970debfbdfd tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:05.827083 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b4e21ff2-29ca-4276-8e3c-6970debfbdfd tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:05.827785 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b4e21ff2-29ca-4276-8e3c-6970debfbdfd tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:05.829652 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b4e21ff2-29ca-4276-8e3c-6970debfbdfd tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:05.831355 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b4e21ff2-29ca-4276-8e3c-6970debfbdfd tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:05.832787 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b4e21ff2-29ca-4276-8e3c-6970debfbdfd tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:05.930153 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b4e21ff2-29ca-4276-8e3c-6970debfbdfd tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:05.931926 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b4e21ff2-29ca-4276-8e3c-6970debfbdfd tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:05.933524 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b4e21ff2-29ca-4276-8e3c-6970debfbdfd tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:05.935333 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b4e21ff2-29ca-4276-8e3c-6970debfbdfd tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:05.937021 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b4e21ff2-29ca-4276-8e3c-6970debfbdfd tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:05.938046 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b4e21ff2-29ca-4276-8e3c-6970debfbdfd tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:06.054125 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:DELETE=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:06.096152 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b11e0160-0f46-4f02-86a1-85c40042a753 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e60f068764c4a259771662a83663cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0af4ec538f41868c10700c90e816d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:06.101645 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b4e21ff2-29ca-4276-8e3c-6970debfbdfd tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/aebbd95a13394dc6b6b7585e5f3dbc20?user_id=bf43921711e143768552e82fc078435c" status: 200 len: 240 microversion: 2.36 time: 0.784461 Aug 07 01:10:06.104940 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 81/193] 10.222.0.39 () {62 vars in 1384 bytes} [Sun Aug 7 01:10:05 2022] PUT /compute/v2.1/os-quota-sets/aebbd95a13394dc6b6b7585e5f3dbc20?user_id=bf43921711e143768552e82fc078435c => generated 240 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:10:06.111108 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-15f82a71-1c86-4873-b099-6c0a7509a9d3 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:06.112502 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-15f82a71-1c86-4873-b099-6c0a7509a9d3 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: f11385ef-0cd8-406a-b905-81a8a6512ebe] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:06.119396 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b11e0160-0f46-4f02-86a1-85c40042a753 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] 10.222.0.39 "GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c" status: 200 len: 1335 microversion: 2.1 time: 1.061140 Aug 07 01:10:06.121077 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15f82a71-1c86-4873-b099-6c0a7509a9d3 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:06.121918 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15f82a71-1c86-4873-b099-6c0a7509a9d3 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:06.122922 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15f82a71-1c86-4873-b099-6c0a7509a9d3 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:06.123060 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 113/194] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:05 2022] GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c => generated 1335 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:06.124422 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15f82a71-1c86-4873-b099-6c0a7509a9d3 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:06.125215 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15f82a71-1c86-4873-b099-6c0a7509a9d3 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:06.126565 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15f82a71-1c86-4873-b099-6c0a7509a9d3 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:06.133072 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bbaf4752-65c8-41b0-8cac-8a1f3870a8f1 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:06.136967 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bbaf4752-65c8-41b0-8cac-8a1f3870a8f1 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] [instance: 7028fed0-c1db-491a-b46f-345ead213c7a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:06.157923 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bbaf4752-65c8-41b0-8cac-8a1f3870a8f1 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:06.158811 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bbaf4752-65c8-41b0-8cac-8a1f3870a8f1 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:06.159509 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bbaf4752-65c8-41b0-8cac-8a1f3870a8f1 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:06.160485 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bbaf4752-65c8-41b0-8cac-8a1f3870a8f1 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:06.161192 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bbaf4752-65c8-41b0-8cac-8a1f3870a8f1 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:06.161799 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bbaf4752-65c8-41b0-8cac-8a1f3870a8f1 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:06.358355 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-15f82a71-1c86-4873-b099-6c0a7509a9d3 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909b8165f015473c9977ef92aaf0741b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010ea68aed824d6bac970360d34ab747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:06.377225 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-15f82a71-1c86-4873-b099-6c0a7509a9d3 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe" status: 200 len: 1319 microversion: 2.1 time: 0.270008 Aug 07 01:10:06.388785 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 82/195] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:06 2022] GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:06.422763 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-85efd570-c2d9-4c9a-bedf-9221c24091fc tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Calling method '.version_select at 0x7f9e250d4af0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:06.627842 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bbaf4752-65c8-41b0-8cac-8a1f3870a8f1 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a892781ecd4300b6dd10b9c235e263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e7e61e7eb4c9490b7632bde85d2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:06.656291 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bbaf4752-65c8-41b0-8cac-8a1f3870a8f1 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] 10.222.0.39 "GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a" status: 200 len: 1338 microversion: 2.1 time: 0.531663 Aug 07 01:10:06.661203 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 114/196] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:06 2022] GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a => generated 1338 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:07.097643 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-85efd570-c2d9-4c9a-bedf-9221c24091fc tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/aebbd95a13394dc6b6b7585e5f3dbc20?user_id=bf43921711e143768552e82fc078435c" status: 200 len: 282 microversion: 2.36 time: 0.706281 Aug 07 01:10:07.098710 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 83/197] 10.222.0.39 () {60 vars in 1364 bytes} [Sun Aug 7 01:10:06 2022] GET /compute/v2.1/os-quota-sets/aebbd95a13394dc6b6b7585e5f3dbc20?user_id=bf43921711e143768552e82fc078435c => generated 282 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:10:07.163760 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-35070845-268f-4bf4-becb-a0aecedf0b28 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:07.166597 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-35070845-268f-4bf4-becb-a0aecedf0b28 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] [instance: e40f1306-cb41-4d73-94a2-aeea34eb0f0c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:07.173875 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-35070845-268f-4bf4-becb-a0aecedf0b28 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:07.174795 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-35070845-268f-4bf4-becb-a0aecedf0b28 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:07.182663 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-35070845-268f-4bf4-becb-a0aecedf0b28 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:07.185126 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-35070845-268f-4bf4-becb-a0aecedf0b28 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:07.188773 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-35070845-268f-4bf4-becb-a0aecedf0b28 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:07.193183 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-35070845-268f-4bf4-becb-a0aecedf0b28 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:07.307633 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-b4ed8b71-b4d3-4cd0-8c47-776d645687a2 req-2a0722ab-571f-4efb-985b-53f65a421bae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e40f1306-cb41-4d73-94a2-aeea34eb0f0c", "name": "network-vif-plugged", "status": "completed", "tag": "3f47ad93-5e2c-4dd6-9b85-b3bb64cf5de3"}, {"server_uuid": "7028fed0-c1db-491a-b46f-345ead213c7a", "name": "network-vif-plugged", "status": "completed", "tag": "e0121c8a-524d-48f2-a161-6a2525d23956"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:07.346673 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b4ed8b71-b4d3-4cd0-8c47-776d645687a2 req-2a0722ab-571f-4efb-985b-53f65a421bae service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:07.347488 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b4ed8b71-b4d3-4cd0-8c47-776d645687a2 req-2a0722ab-571f-4efb-985b-53f65a421bae service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:07.348910 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b4ed8b71-b4d3-4cd0-8c47-776d645687a2 req-2a0722ab-571f-4efb-985b-53f65a421bae service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:07.411391 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-b4ed8b71-b4d3-4cd0-8c47-776d645687a2 req-2a0722ab-571f-4efb-985b-53f65a421bae service nova] Creating event network-vif-plugged:3f47ad93-5e2c-4dd6-9b85-b3bb64cf5de3 for instance e40f1306-cb41-4d73-94a2-aeea34eb0f0c on n-h2-master-1 Aug 07 01:10:07.411391 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-b4ed8b71-b4d3-4cd0-8c47-776d645687a2 req-2a0722ab-571f-4efb-985b-53f65a421bae service nova] Creating event network-vif-plugged:e0121c8a-524d-48f2-a161-6a2525d23956 for instance 7028fed0-c1db-491a-b46f-345ead213c7a on n-h2-master-1 Aug 07 01:10:07.434363 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-b4ed8b71-b4d3-4cd0-8c47-776d645687a2 req-2a0722ab-571f-4efb-985b-53f65a421bae service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.132845 Aug 07 01:10:07.435503 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 84/198] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:07.471499 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a9288649-5ab6-4fa3-ba3a-f901ade40e62 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:07.473383 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a9288649-5ab6-4fa3-ba3a-f901ade40e62 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: f11385ef-0cd8-406a-b905-81a8a6512ebe] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:07.498698 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a9288649-5ab6-4fa3-ba3a-f901ade40e62 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:07.499454 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a9288649-5ab6-4fa3-ba3a-f901ade40e62 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:07.501129 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a9288649-5ab6-4fa3-ba3a-f901ade40e62 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:07.502574 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a9288649-5ab6-4fa3-ba3a-f901ade40e62 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:07.503436 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a9288649-5ab6-4fa3-ba3a-f901ade40e62 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:07.504397 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a9288649-5ab6-4fa3-ba3a-f901ade40e62 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:08.040678 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a9288649-5ab6-4fa3-ba3a-f901ade40e62 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909b8165f015473c9977ef92aaf0741b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010ea68aed824d6bac970360d34ab747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:08.058213 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a9288649-5ab6-4fa3-ba3a-f901ade40e62 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe" status: 200 len: 1319 microversion: 2.1 time: 0.612287 Aug 07 01:10:08.076628 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 85/199] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:07 2022] GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe => generated 1319 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:08.105652 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-28f5ab74-2ba2-44a8-9576-61081b4708e8 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:08.111079 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-28f5ab74-2ba2-44a8-9576-61081b4708e8 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] [instance: 7028fed0-c1db-491a-b46f-345ead213c7a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:08.135372 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28f5ab74-2ba2-44a8-9576-61081b4708e8 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:08.136673 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28f5ab74-2ba2-44a8-9576-61081b4708e8 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:08.137887 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28f5ab74-2ba2-44a8-9576-61081b4708e8 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:08.139687 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28f5ab74-2ba2-44a8-9576-61081b4708e8 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:08.140548 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28f5ab74-2ba2-44a8-9576-61081b4708e8 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:08.141301 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28f5ab74-2ba2-44a8-9576-61081b4708e8 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:08.327044 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-35070845-268f-4bf4-becb-a0aecedf0b28 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e60f068764c4a259771662a83663cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0af4ec538f41868c10700c90e816d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:08.356191 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-35070845-268f-4bf4-becb-a0aecedf0b28 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] 10.222.0.39 "GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c" status: 200 len: 1335 microversion: 2.1 time: 1.196737 Aug 07 01:10:08.359404 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 115/200] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:07 2022] GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c => generated 1335 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:08.506253 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-28f5ab74-2ba2-44a8-9576-61081b4708e8 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a892781ecd4300b6dd10b9c235e263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e7e61e7eb4c9490b7632bde85d2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:08.552068 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-28f5ab74-2ba2-44a8-9576-61081b4708e8 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] 10.222.0.39 "GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a" status: 200 len: 1338 microversion: 2.1 time: 0.469184 Aug 07 01:10:08.554491 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 86/201] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:08 2022] GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a => generated 1338 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:08.920237 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bc2a4bce-42ad-4103-bacc-f4bb915df18a tempest-QuotaClassesAdminTestJSON-609232695 tempest-QuotaClassesAdminTestJSON-609232695-project-admin] Calling method '.version_select at 0x7f9e252593a0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:08.921270 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:08.921270 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:10:08.942772 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bc2a4bce-42ad-4103-bacc-f4bb915df18a tempest-QuotaClassesAdminTestJSON-609232695 tempest-QuotaClassesAdminTestJSON-609232695-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.578218 Aug 07 01:10:08.944686 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 116/202] 10.222.0.39 () {58 vars in 1185 bytes} [Sun Aug 7 01:10:08 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:08.977093 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-dcfd6348-71ed-471a-abfa-409ee52688ae tempest-QuotaClassesAdminTestJSON-609232695 tempest-QuotaClassesAdminTestJSON-609232695-project-admin] Action: 'update', calling method: .version_select at 0x7f9e25116ca0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:08.985149 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:08.985149 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:09.090973 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7006721d-0a6d-4940-b030-814c719b047b tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:09.092683 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7006721d-0a6d-4940-b030-814c719b047b tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: f11385ef-0cd8-406a-b905-81a8a6512ebe] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:09.114961 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7006721d-0a6d-4940-b030-814c719b047b tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:09.116718 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7006721d-0a6d-4940-b030-814c719b047b tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:09.118124 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7006721d-0a6d-4940-b030-814c719b047b tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:09.120260 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7006721d-0a6d-4940-b030-814c719b047b tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:09.121517 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7006721d-0a6d-4940-b030-814c719b047b tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:09.122710 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7006721d-0a6d-4940-b030-814c719b047b tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:09.616275 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7006721d-0a6d-4940-b030-814c719b047b tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909b8165f015473c9977ef92aaf0741b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010ea68aed824d6bac970360d34ab747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:09.630419 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7006721d-0a6d-4940-b030-814c719b047b tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe" status: 200 len: 1469 microversion: 2.1 time: 0.547857 Aug 07 01:10:09.632226 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 117/203] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:09 2022] GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe => generated 1469 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:09.644963 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5098fba8-c7d9-4987-aca4-cb82d7fe6f36 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:09.646277 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5098fba8-c7d9-4987-aca4-cb82d7fe6f36 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] [instance: e40f1306-cb41-4d73-94a2-aeea34eb0f0c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:09.670671 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5098fba8-c7d9-4987-aca4-cb82d7fe6f36 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:09.671774 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5098fba8-c7d9-4987-aca4-cb82d7fe6f36 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:09.674551 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5098fba8-c7d9-4987-aca4-cb82d7fe6f36 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:09.675769 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5098fba8-c7d9-4987-aca4-cb82d7fe6f36 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:09.678000 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5098fba8-c7d9-4987-aca4-cb82d7fe6f36 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:09.679489 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5098fba8-c7d9-4987-aca4-cb82d7fe6f36 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:09.737918 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-dcfd6348-71ed-471a-abfa-409ee52688ae tempest-QuotaClassesAdminTestJSON-609232695 tempest-QuotaClassesAdminTestJSON-609232695-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.778841 Aug 07 01:10:09.746904 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 87/204] 10.222.0.39 () {60 vars in 1206 bytes} [Sun Aug 7 01:10:08 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:09.776040 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7089c6dc-6f66-468c-b37e-15d240073bdf tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:09.777144 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7089c6dc-6f66-468c-b37e-15d240073bdf tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] [instance: 7028fed0-c1db-491a-b46f-345ead213c7a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:09.809697 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7089c6dc-6f66-468c-b37e-15d240073bdf tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:09.814082 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7089c6dc-6f66-468c-b37e-15d240073bdf tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:09.819551 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7089c6dc-6f66-468c-b37e-15d240073bdf tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:09.820807 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7089c6dc-6f66-468c-b37e-15d240073bdf tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:09.821646 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7089c6dc-6f66-468c-b37e-15d240073bdf tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:09.822957 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7089c6dc-6f66-468c-b37e-15d240073bdf tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:10.448625 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5098fba8-c7d9-4987-aca4-cb82d7fe6f36 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e60f068764c4a259771662a83663cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0af4ec538f41868c10700c90e816d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:10.484473 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5098fba8-c7d9-4987-aca4-cb82d7fe6f36 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] 10.222.0.39 "GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c" status: 200 len: 1335 microversion: 2.1 time: 0.850111 Aug 07 01:10:10.486258 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 118/205] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:09 2022] GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c => generated 1335 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:10.513107 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7089c6dc-6f66-468c-b37e-15d240073bdf tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a892781ecd4300b6dd10b9c235e263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e7e61e7eb4c9490b7632bde85d2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:10.525538 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7089c6dc-6f66-468c-b37e-15d240073bdf tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] 10.222.0.39 "GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a" status: 200 len: 1338 microversion: 2.1 time: 0.762445 Aug 07 01:10:10.526974 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 88/206] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:09 2022] GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a => generated 1338 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:10.547346 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d950d8a8-c171-426c-86d8-8e28bea76e4e tempest-QuotaClassesAdminTestJSON-609232695 tempest-QuotaClassesAdminTestJSON-609232695-project-admin] Calling method '.version_select at 0x7f9e25116d30>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:10.549160 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:10.549160 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:10.601443 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d950d8a8-c171-426c-86d8-8e28bea76e4e tempest-QuotaClassesAdminTestJSON-609232695 tempest-QuotaClassesAdminTestJSON-609232695-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.071869 Aug 07 01:10:10.620129 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 89/207] 10.222.0.39 () {58 vars in 1185 bytes} [Sun Aug 7 01:10:10 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:10.633010 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-15196db7-f3d9-4335-93b5-60c7caeba424 tempest-QuotaClassesAdminTestJSON-609232695 tempest-QuotaClassesAdminTestJSON-609232695-project-admin] Action: 'update', calling method: .version_select at 0x7f9e2504d430>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:10.640886 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:10.640886 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:10.762768 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=19,nova_api:INSERT=12 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:10.923001 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-15196db7-f3d9-4335-93b5-60c7caeba424 tempest-QuotaClassesAdminTestJSON-609232695 tempest-QuotaClassesAdminTestJSON-609232695-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.300235 Aug 07 01:10:10.924358 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 90/208] 10.222.0.39 () {60 vars in 1206 bytes} [Sun Aug 7 01:10:10 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:11.232901 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-684320ff-4ee3-4b53-b2b7-5ebc10a5b849 tempest-DeleteServersAdminTestJSON-1140258782 tempest-DeleteServersAdminTestJSON-1140258782-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:11.236197 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-684320ff-4ee3-4b53-b2b7-5ebc10a5b849 tempest-DeleteServersAdminTestJSON-1140258782 tempest-DeleteServersAdminTestJSON-1140258782-project-admin] [instance: f11385ef-0cd8-406a-b905-81a8a6512ebe] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:11.270528 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-684320ff-4ee3-4b53-b2b7-5ebc10a5b849 tempest-DeleteServersAdminTestJSON-1140258782 tempest-DeleteServersAdminTestJSON-1140258782-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:11.273436 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-684320ff-4ee3-4b53-b2b7-5ebc10a5b849 tempest-DeleteServersAdminTestJSON-1140258782 tempest-DeleteServersAdminTestJSON-1140258782-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:11.276409 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-684320ff-4ee3-4b53-b2b7-5ebc10a5b849 tempest-DeleteServersAdminTestJSON-1140258782 tempest-DeleteServersAdminTestJSON-1140258782-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:11.276409 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-684320ff-4ee3-4b53-b2b7-5ebc10a5b849 tempest-DeleteServersAdminTestJSON-1140258782 tempest-DeleteServersAdminTestJSON-1140258782-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:11.277848 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-684320ff-4ee3-4b53-b2b7-5ebc10a5b849 tempest-DeleteServersAdminTestJSON-1140258782 tempest-DeleteServersAdminTestJSON-1140258782-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:11.278800 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-684320ff-4ee3-4b53-b2b7-5ebc10a5b849 tempest-DeleteServersAdminTestJSON-1140258782 tempest-DeleteServersAdminTestJSON-1140258782-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:11.440893 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-684320ff-4ee3-4b53-b2b7-5ebc10a5b849 tempest-DeleteServersAdminTestJSON-1140258782 tempest-DeleteServersAdminTestJSON-1140258782-project-admin] [instance: f11385ef-0cd8-406a-b905-81a8a6512ebe] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:10:11.532086 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-dad4db17-c560-461d-90eb-19261ccfd6df tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:11.533105 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-dad4db17-c560-461d-90eb-19261ccfd6df tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] [instance: e40f1306-cb41-4d73-94a2-aeea34eb0f0c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:11.560418 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dad4db17-c560-461d-90eb-19261ccfd6df tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:11.564845 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dad4db17-c560-461d-90eb-19261ccfd6df tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:11.565652 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dad4db17-c560-461d-90eb-19261ccfd6df tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:11.567518 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dad4db17-c560-461d-90eb-19261ccfd6df tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:11.568461 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dad4db17-c560-461d-90eb-19261ccfd6df tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:11.570219 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dad4db17-c560-461d-90eb-19261ccfd6df tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:11.875637 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-684320ff-4ee3-4b53-b2b7-5ebc10a5b849 tempest-DeleteServersAdminTestJSON-1140258782 tempest-DeleteServersAdminTestJSON-1140258782-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=119516) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 07 01:10:11.877109 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-684320ff-4ee3-4b53-b2b7-5ebc10a5b849 tempest-DeleteServersAdminTestJSON-1140258782 tempest-DeleteServersAdminTestJSON-1140258782-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=119516) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 07 01:10:11.878938 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd0af86c-a2ca-4375-bd16-3da184101faa None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:11.879794 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd0af86c-a2ca-4375-bd16-3da184101faa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:11.880453 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd0af86c-a2ca-4375-bd16-3da184101faa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:11.881917 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd0af86c-a2ca-4375-bd16-3da184101faa None None] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:11.882588 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd0af86c-a2ca-4375-bd16-3da184101faa None None] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:11.883261 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd0af86c-a2ca-4375-bd16-3da184101faa None None] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:11.903107 n-d-master-1 devstack@n-api.service[119516]: INFO nova.compute.rpcapi [None req-cd0af86c-a2ca-4375-bd16-3da184101faa None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 07 01:10:11.904667 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd0af86c-a2ca-4375-bd16-3da184101faa None None] Releasing lock "compute-rpcapi-router" {{(pid=119516) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 07 01:10:11.981578 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cd0af86c-a2ca-4375-bd16-3da184101faa None None] 10.222.0.39 "DELETE /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe" status: 204 len: 0 microversion: 2.1 time: 1.491266 Aug 07 01:10:11.982784 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 119/209] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:10:10 2022] DELETE /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe => generated 0 bytes in 1496 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:10:12.006568 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-eb5c038a-3465-43f5-90f6-112405106be5 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:12.008929 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-eb5c038a-3465-43f5-90f6-112405106be5 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] [instance: 7028fed0-c1db-491a-b46f-345ead213c7a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:12.029121 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb5c038a-3465-43f5-90f6-112405106be5 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:12.033477 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb5c038a-3465-43f5-90f6-112405106be5 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:12.035296 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb5c038a-3465-43f5-90f6-112405106be5 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:12.039028 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb5c038a-3465-43f5-90f6-112405106be5 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:12.040292 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb5c038a-3465-43f5-90f6-112405106be5 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:12.041575 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb5c038a-3465-43f5-90f6-112405106be5 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:12.050883 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-dad4db17-c560-461d-90eb-19261ccfd6df tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e60f068764c4a259771662a83663cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0af4ec538f41868c10700c90e816d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:12.077742 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-dad4db17-c560-461d-90eb-19261ccfd6df tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] 10.222.0.39 "GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c" status: 200 len: 1485 microversion: 2.1 time: 0.554727 Aug 07 01:10:12.078812 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 91/210] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:11 2022] GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c => generated 1485 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:10:12.097914 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5f82a6e3-de09-4db9-8597-95b0d9ef26ec tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:12.099481 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5f82a6e3-de09-4db9-8597-95b0d9ef26ec tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: f11385ef-0cd8-406a-b905-81a8a6512ebe] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:12.123721 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f82a6e3-de09-4db9-8597-95b0d9ef26ec tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:12.133052 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f82a6e3-de09-4db9-8597-95b0d9ef26ec tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:12.134404 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f82a6e3-de09-4db9-8597-95b0d9ef26ec tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:12.137008 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f82a6e3-de09-4db9-8597-95b0d9ef26ec tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:12.137883 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f82a6e3-de09-4db9-8597-95b0d9ef26ec tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:12.138681 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f82a6e3-de09-4db9-8597-95b0d9ef26ec tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:12.409461 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-eb5c038a-3465-43f5-90f6-112405106be5 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a892781ecd4300b6dd10b9c235e263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e7e61e7eb4c9490b7632bde85d2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:12.442917 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-eb5c038a-3465-43f5-90f6-112405106be5 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] 10.222.0.39 "GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a" status: 200 len: 1488 microversion: 2.1 time: 0.458077 Aug 07 01:10:12.457134 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 120/211] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:11 2022] GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a => generated 1488 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:12.594354 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5f82a6e3-de09-4db9-8597-95b0d9ef26ec tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909b8165f015473c9977ef92aaf0741b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010ea68aed824d6bac970360d34ab747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:12.638352 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5f82a6e3-de09-4db9-8597-95b0d9ef26ec tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe" status: 200 len: 1475 microversion: 2.1 time: 0.546728 Aug 07 01:10:12.639508 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 92/212] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:12 2022] GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe => generated 1475 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:12.657788 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fdfcc1e8-c4d6-484e-992a-5d716b12b8fb tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:12.669022 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fdfcc1e8-c4d6-484e-992a-5d716b12b8fb tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] [instance: 7028fed0-c1db-491a-b46f-345ead213c7a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:12.691917 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fdfcc1e8-c4d6-484e-992a-5d716b12b8fb tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:12.692771 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fdfcc1e8-c4d6-484e-992a-5d716b12b8fb tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:12.693546 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fdfcc1e8-c4d6-484e-992a-5d716b12b8fb tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:12.694816 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fdfcc1e8-c4d6-484e-992a-5d716b12b8fb tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:12.701136 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fdfcc1e8-c4d6-484e-992a-5d716b12b8fb tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:12.701955 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fdfcc1e8-c4d6-484e-992a-5d716b12b8fb tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:12.978892 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:13.347794 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0851ef54-9c8c-44bb-b0b4-97bc22540c11 tempest-TenantUsagesTestJSON-1499582112 tempest-TenantUsagesTestJSON-1499582112-project-admin] Calling method '.version_select at 0x7f9e25259c10>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:13.373194 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0851ef54-9c8c-44bb-b0b4-97bc22540c11 tempest-TenantUsagesTestJSON-1499582112 tempest-TenantUsagesTestJSON-1499582112-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:13.374500 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0851ef54-9c8c-44bb-b0b4-97bc22540c11 tempest-TenantUsagesTestJSON-1499582112 tempest-TenantUsagesTestJSON-1499582112-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:13.375605 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0851ef54-9c8c-44bb-b0b4-97bc22540c11 tempest-TenantUsagesTestJSON-1499582112 tempest-TenantUsagesTestJSON-1499582112-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:13.425605 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0851ef54-9c8c-44bb-b0b4-97bc22540c11 tempest-TenantUsagesTestJSON-1499582112 tempest-TenantUsagesTestJSON-1499582112-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:13.427725 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0851ef54-9c8c-44bb-b0b4-97bc22540c11 tempest-TenantUsagesTestJSON-1499582112 tempest-TenantUsagesTestJSON-1499582112-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:13.428859 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0851ef54-9c8c-44bb-b0b4-97bc22540c11 tempest-TenantUsagesTestJSON-1499582112 tempest-TenantUsagesTestJSON-1499582112-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:13.469760 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0851ef54-9c8c-44bb-b0b4-97bc22540c11 tempest-TenantUsagesTestJSON-1499582112 tempest-TenantUsagesTestJSON-1499582112-project-admin] 10.222.0.39 "GET /compute/v2.1/os-simple-tenant-usage/8d0af4ec538f41868c10700c90e816d6?start=2022-08-06T01%3A10%3A12.106493&end=2022-08-08T01%3A10%3A12.106493" status: 200 len: 694 microversion: 2.1 time: 1.009250 Aug 07 01:10:13.471848 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 121/213] 10.222.0.39 () {58 vars in 1412 bytes} [Sun Aug 7 01:10:12 2022] GET /compute/v2.1/os-simple-tenant-usage/8d0af4ec538f41868c10700c90e816d6?start=2022-08-06T01%3A10%3A12.106493&end=2022-08-08T01%3A10%3A12.106493 => generated 694 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:13.501555 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-aecbbb3b-b35d-44d9-b511-bef392e81dfc tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Calling method '.version_select at 0x7f9e25611940>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:13.532308 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aecbbb3b-b35d-44d9-b511-bef392e81dfc tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:13.537370 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aecbbb3b-b35d-44d9-b511-bef392e81dfc tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:13.537977 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aecbbb3b-b35d-44d9-b511-bef392e81dfc tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:13.590614 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aecbbb3b-b35d-44d9-b511-bef392e81dfc tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:13.593964 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aecbbb3b-b35d-44d9-b511-bef392e81dfc tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:13.594840 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aecbbb3b-b35d-44d9-b511-bef392e81dfc tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:13.630883 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-aecbbb3b-b35d-44d9-b511-bef392e81dfc tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] 10.222.0.39 "GET /compute/v2.1/os-simple-tenant-usage/8d0af4ec538f41868c10700c90e816d6?start=2022-08-06T01%3A10%3A12.106493&end=2022-08-08T01%3A10%3A12.106493" status: 200 len: 694 microversion: 2.1 time: 0.137078 Aug 07 01:10:13.632502 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 122/214] 10.222.0.39 () {58 vars in 1412 bytes} [Sun Aug 7 01:10:13 2022] GET /compute/v2.1/os-simple-tenant-usage/8d0af4ec538f41868c10700c90e816d6?start=2022-08-06T01%3A10%3A12.106493&end=2022-08-08T01%3A10%3A12.106493 => generated 694 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:10:13.693583 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bb3dc3a6-cdfb-4d2d-b496-188bd0e54ad3 tempest-TenantUsagesTestJSON-1499582112 tempest-TenantUsagesTestJSON-1499582112-project-admin] Calling method '.version_select at 0x7f9e2537be50>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:13.728892 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb3dc3a6-cdfb-4d2d-b496-188bd0e54ad3 tempest-TenantUsagesTestJSON-1499582112 tempest-TenantUsagesTestJSON-1499582112-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:13.739082 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb3dc3a6-cdfb-4d2d-b496-188bd0e54ad3 tempest-TenantUsagesTestJSON-1499582112 tempest-TenantUsagesTestJSON-1499582112-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:13.744667 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb3dc3a6-cdfb-4d2d-b496-188bd0e54ad3 tempest-TenantUsagesTestJSON-1499582112 tempest-TenantUsagesTestJSON-1499582112-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:13.841718 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb3dc3a6-cdfb-4d2d-b496-188bd0e54ad3 tempest-TenantUsagesTestJSON-1499582112 tempest-TenantUsagesTestJSON-1499582112-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:13.844856 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb3dc3a6-cdfb-4d2d-b496-188bd0e54ad3 tempest-TenantUsagesTestJSON-1499582112 tempest-TenantUsagesTestJSON-1499582112-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:13.845872 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb3dc3a6-cdfb-4d2d-b496-188bd0e54ad3 tempest-TenantUsagesTestJSON-1499582112 tempest-TenantUsagesTestJSON-1499582112-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:13.862070 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fdfcc1e8-c4d6-484e-992a-5d716b12b8fb tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a" status: 200 len: 1639 microversion: 2.1 time: 1.220096 Aug 07 01:10:13.896673 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 93/215] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:12 2022] GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a => generated 1639 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:13.920781 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0cd5ab4f-a7ab-40dd-95b2-bc4dab742393 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:13.922537 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0cd5ab4f-a7ab-40dd-95b2-bc4dab742393 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: f11385ef-0cd8-406a-b905-81a8a6512ebe] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:13.953672 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0cd5ab4f-a7ab-40dd-95b2-bc4dab742393 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:13.955130 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0cd5ab4f-a7ab-40dd-95b2-bc4dab742393 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:13.958540 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0cd5ab4f-a7ab-40dd-95b2-bc4dab742393 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:13.968740 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0cd5ab4f-a7ab-40dd-95b2-bc4dab742393 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:13.969308 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0cd5ab4f-a7ab-40dd-95b2-bc4dab742393 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:13.969918 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0cd5ab4f-a7ab-40dd-95b2-bc4dab742393 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:14.028456 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bb3dc3a6-cdfb-4d2d-b496-188bd0e54ad3 tempest-TenantUsagesTestJSON-1499582112 tempest-TenantUsagesTestJSON-1499582112-project-admin] 10.222.0.39 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-06T01%3A10%3A12.106493&end=2022-08-08T01%3A10%3A12.106493&detailed=1" status: 200 len: 2016 microversion: 2.1 time: 0.373899 Aug 07 01:10:14.029594 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 123/216] 10.222.0.39 () {58 vars in 1335 bytes} [Sun Aug 7 01:10:13 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-06T01%3A10%3A12.106493&end=2022-08-08T01%3A10%3A12.106493&detailed=1 => generated 2016 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:14.043364 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-940a0247-cdf5-4bf2-bc99-57d8e2eb05c5 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:14.044770 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-940a0247-cdf5-4bf2-bc99-57d8e2eb05c5 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] [instance: 7028fed0-c1db-491a-b46f-345ead213c7a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:14.069647 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-940a0247-cdf5-4bf2-bc99-57d8e2eb05c5 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:14.082552 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-940a0247-cdf5-4bf2-bc99-57d8e2eb05c5 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:14.084793 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-940a0247-cdf5-4bf2-bc99-57d8e2eb05c5 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:14.096661 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-940a0247-cdf5-4bf2-bc99-57d8e2eb05c5 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:14.098375 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-940a0247-cdf5-4bf2-bc99-57d8e2eb05c5 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:14.100013 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-940a0247-cdf5-4bf2-bc99-57d8e2eb05c5 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:14.178600 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-940a0247-cdf5-4bf2-bc99-57d8e2eb05c5 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] [instance: 7028fed0-c1db-491a-b46f-345ead213c7a] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:10:14.620793 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-940a0247-cdf5-4bf2-bc99-57d8e2eb05c5 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a" status: 204 len: 0 microversion: 2.1 time: 0.585078 Aug 07 01:10:14.626770 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 124/217] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:10:14 2022] DELETE /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a => generated 0 bytes in 596 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:10:14.658441 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1a78c6d9-df49-4e1b-b834-7ab5285413a3 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:14.660740 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1a78c6d9-df49-4e1b-b834-7ab5285413a3 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] [instance: e40f1306-cb41-4d73-94a2-aeea34eb0f0c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:14.668953 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0cd5ab4f-a7ab-40dd-95b2-bc4dab742393 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909b8165f015473c9977ef92aaf0741b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010ea68aed824d6bac970360d34ab747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:14.680699 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1a78c6d9-df49-4e1b-b834-7ab5285413a3 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:14.682885 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1a78c6d9-df49-4e1b-b834-7ab5285413a3 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:14.685228 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0cd5ab4f-a7ab-40dd-95b2-bc4dab742393 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe" status: 200 len: 1475 microversion: 2.1 time: 0.781228 Aug 07 01:10:14.686615 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1a78c6d9-df49-4e1b-b834-7ab5285413a3 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:14.695872 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1a78c6d9-df49-4e1b-b834-7ab5285413a3 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:14.699154 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1a78c6d9-df49-4e1b-b834-7ab5285413a3 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:14.700816 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1a78c6d9-df49-4e1b-b834-7ab5285413a3 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:14.701216 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 94/218] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:13 2022] GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe => generated 1475 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:14.720261 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4eb8aa4b-1180-4fed-bac1-4a576ee431bf tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:14.724848 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4eb8aa4b-1180-4fed-bac1-4a576ee431bf tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] [instance: 7028fed0-c1db-491a-b46f-345ead213c7a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:14.757029 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4eb8aa4b-1180-4fed-bac1-4a576ee431bf tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:14.757651 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4eb8aa4b-1180-4fed-bac1-4a576ee431bf tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:14.759492 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4eb8aa4b-1180-4fed-bac1-4a576ee431bf tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:14.761315 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4eb8aa4b-1180-4fed-bac1-4a576ee431bf tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:14.762388 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4eb8aa4b-1180-4fed-bac1-4a576ee431bf tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:14.763170 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4eb8aa4b-1180-4fed-bac1-4a576ee431bf tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:14.772788 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1a78c6d9-df49-4e1b-b834-7ab5285413a3 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] [instance: e40f1306-cb41-4d73-94a2-aeea34eb0f0c] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:10:15.025274 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1a78c6d9-df49-4e1b-b834-7ab5285413a3 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c" status: 204 len: 0 microversion: 2.1 time: 0.394242 Aug 07 01:10:15.026478 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 125/219] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:10:14 2022] DELETE /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:10:15.046091 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3d5918a0-a175-4b25-a157-7033a9a2c34a tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:15.046831 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3d5918a0-a175-4b25-a157-7033a9a2c34a tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] [instance: e40f1306-cb41-4d73-94a2-aeea34eb0f0c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:15.070160 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3d5918a0-a175-4b25-a157-7033a9a2c34a tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:15.072951 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3d5918a0-a175-4b25-a157-7033a9a2c34a tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:15.074428 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3d5918a0-a175-4b25-a157-7033a9a2c34a tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:15.075938 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3d5918a0-a175-4b25-a157-7033a9a2c34a tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:15.078497 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3d5918a0-a175-4b25-a157-7033a9a2c34a tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:15.079575 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3d5918a0-a175-4b25-a157-7033a9a2c34a tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:15.246976 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4eb8aa4b-1180-4fed-bac1-4a576ee431bf tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a892781ecd4300b6dd10b9c235e263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e7e61e7eb4c9490b7632bde85d2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:15.266659 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4eb8aa4b-1180-4fed-bac1-4a576ee431bf tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] 10.222.0.39 "GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a" status: 200 len: 1494 microversion: 2.1 time: 0.561141 Aug 07 01:10:15.269180 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 95/220] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:14 2022] GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a => generated 1494 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:15.456572 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3d5918a0-a175-4b25-a157-7033a9a2c34a tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e60f068764c4a259771662a83663cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0af4ec538f41868c10700c90e816d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:15.473143 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3d5918a0-a175-4b25-a157-7033a9a2c34a tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] 10.222.0.39 "GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c" status: 200 len: 1491 microversion: 2.1 time: 0.438276 Aug 07 01:10:15.476141 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 126/221] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:15 2022] GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c => generated 1491 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:15.716412 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d52fcd80-f9dc-46b4-a1c5-d8a300b8e271 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:15.718113 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d52fcd80-f9dc-46b4-a1c5-d8a300b8e271 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: f11385ef-0cd8-406a-b905-81a8a6512ebe] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:15.733645 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d52fcd80-f9dc-46b4-a1c5-d8a300b8e271 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:15.735717 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d52fcd80-f9dc-46b4-a1c5-d8a300b8e271 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:15.736889 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d52fcd80-f9dc-46b4-a1c5-d8a300b8e271 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:15.738533 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d52fcd80-f9dc-46b4-a1c5-d8a300b8e271 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:15.739648 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d52fcd80-f9dc-46b4-a1c5-d8a300b8e271 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:15.741646 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d52fcd80-f9dc-46b4-a1c5-d8a300b8e271 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:15.982546 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=7 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:16.124275 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-28b372ce-d914-4ed1-8360-9f22524c6d73 req-6771a873-faa4-4a65-ac18-b2a4a3500908 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f11385ef-0cd8-406a-b905-81a8a6512ebe", "name": "network-vif-deleted", "tag": "302a0481-97d0-493a-923a-e1b6154f7cd1"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:16.166746 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-28b372ce-d914-4ed1-8360-9f22524c6d73 req-6771a873-faa4-4a65-ac18-b2a4a3500908 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:16.167482 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-28b372ce-d914-4ed1-8360-9f22524c6d73 req-6771a873-faa4-4a65-ac18-b2a4a3500908 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:16.168370 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-28b372ce-d914-4ed1-8360-9f22524c6d73 req-6771a873-faa4-4a65-ac18-b2a4a3500908 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:16.199361 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d52fcd80-f9dc-46b4-a1c5-d8a300b8e271 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909b8165f015473c9977ef92aaf0741b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010ea68aed824d6bac970360d34ab747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:16.247624 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d52fcd80-f9dc-46b4-a1c5-d8a300b8e271 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe" status: 200 len: 1433 microversion: 2.1 time: 0.536597 Aug 07 01:10:16.248516 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-28b372ce-d914-4ed1-8360-9f22524c6d73 req-6771a873-faa4-4a65-ac18-b2a4a3500908 service nova] Creating event network-vif-deleted:302a0481-97d0-493a-923a-e1b6154f7cd1 for instance f11385ef-0cd8-406a-b905-81a8a6512ebe on n-h1-master-1 Aug 07 01:10:16.250624 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 96/222] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:15 2022] GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe => generated 1433 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:10:16.271478 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-28b372ce-d914-4ed1-8360-9f22524c6d73 req-6771a873-faa4-4a65-ac18-b2a4a3500908 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154170 Aug 07 01:10:16.277502 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 127/223] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:16.314637 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-23d2cdab-6faa-43df-b1ba-d1794f269a08 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:16.317202 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-23d2cdab-6faa-43df-b1ba-d1794f269a08 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] [instance: 7028fed0-c1db-491a-b46f-345ead213c7a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:16.365330 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23d2cdab-6faa-43df-b1ba-d1794f269a08 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:16.374275 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23d2cdab-6faa-43df-b1ba-d1794f269a08 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:16.375537 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23d2cdab-6faa-43df-b1ba-d1794f269a08 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:16.376766 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23d2cdab-6faa-43df-b1ba-d1794f269a08 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:16.377431 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23d2cdab-6faa-43df-b1ba-d1794f269a08 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:16.377971 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23d2cdab-6faa-43df-b1ba-d1794f269a08 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:16.521216 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b74951df-425f-44d5-a5de-06d9f61f277f tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:16.530172 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b74951df-425f-44d5-a5de-06d9f61f277f tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] [instance: e40f1306-cb41-4d73-94a2-aeea34eb0f0c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:16.557960 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b74951df-425f-44d5-a5de-06d9f61f277f tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:16.584940 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b74951df-425f-44d5-a5de-06d9f61f277f tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:16.586473 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b74951df-425f-44d5-a5de-06d9f61f277f tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:16.588609 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b74951df-425f-44d5-a5de-06d9f61f277f tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:16.589633 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b74951df-425f-44d5-a5de-06d9f61f277f tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:16.590945 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b74951df-425f-44d5-a5de-06d9f61f277f tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:16.680483 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-23d2cdab-6faa-43df-b1ba-d1794f269a08 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a892781ecd4300b6dd10b9c235e263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e7e61e7eb4c9490b7632bde85d2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:16.680795 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:16.716176 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-23d2cdab-6faa-43df-b1ba-d1794f269a08 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] 10.222.0.39 "GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a" status: 200 len: 1494 microversion: 2.1 time: 0.409960 Aug 07 01:10:16.721478 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 97/224] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:16 2022] GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a => generated 1494 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:16.952676 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b74951df-425f-44d5-a5de-06d9f61f277f tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e60f068764c4a259771662a83663cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0af4ec538f41868c10700c90e816d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:16.982458 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b74951df-425f-44d5-a5de-06d9f61f277f tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] 10.222.0.39 "GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c" status: 200 len: 1491 microversion: 2.1 time: 0.477433 Aug 07 01:10:17.002060 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 128/225] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:16 2022] GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c => generated 1491 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:17.276243 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a8ac8362-00c0-46ca-9684-a295ff2d45b6 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:17.277229 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a8ac8362-00c0-46ca-9684-a295ff2d45b6 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: f11385ef-0cd8-406a-b905-81a8a6512ebe] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:17.299221 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a8ac8362-00c0-46ca-9684-a295ff2d45b6 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:17.300961 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a8ac8362-00c0-46ca-9684-a295ff2d45b6 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:17.302532 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a8ac8362-00c0-46ca-9684-a295ff2d45b6 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:17.305544 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a8ac8362-00c0-46ca-9684-a295ff2d45b6 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:17.308590 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a8ac8362-00c0-46ca-9684-a295ff2d45b6 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:17.310918 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a8ac8362-00c0-46ca-9684-a295ff2d45b6 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:17.740891 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-81cce5cc-575f-4b9d-8ce7-6dca6476bbe0 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:17.742707 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-81cce5cc-575f-4b9d-8ce7-6dca6476bbe0 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] [instance: 7028fed0-c1db-491a-b46f-345ead213c7a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:17.760617 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-81cce5cc-575f-4b9d-8ce7-6dca6476bbe0 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:17.761715 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-81cce5cc-575f-4b9d-8ce7-6dca6476bbe0 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:17.762527 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-81cce5cc-575f-4b9d-8ce7-6dca6476bbe0 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:17.765293 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-81cce5cc-575f-4b9d-8ce7-6dca6476bbe0 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:17.767633 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-81cce5cc-575f-4b9d-8ce7-6dca6476bbe0 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:17.773586 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-81cce5cc-575f-4b9d-8ce7-6dca6476bbe0 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:17.838906 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-a8ac8362-00c0-46ca-9684-a295ff2d45b6 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] HTTP exception thrown: Instance f11385ef-0cd8-406a-b905-81a8a6512ebe could not be found. Aug 07 01:10:17.848399 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a8ac8362-00c0-46ca-9684-a295ff2d45b6 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Request method failure captured: Aug 07 01:10:17.848399 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe HTTP/1.1 Aug 07 01:10:17.848399 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:10:17.848399 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:10:17.848399 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:10:17.848399 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:10:17.848399 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:10:17.848399 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:10:17.848399 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:10:17.848399 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:17.848399 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xDMrB5sW_jCj6yEHfXgRfpkPNRZlz8KeTmDaGz_lSyfZYqetKyiW_zrxvysqMSss0UVN_I7g5FxCtQIziR1yrWUCFUO79-2SbZhlRuflLXizITdCWnjIGaG_6AVuHEP_Mcep1lp9grpHsUXD_83xXw90LL_gN3ChBbIL3YzAJRNtJs Aug 07 01:10:17.848399 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:10:17.848399 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:10:17.848399 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:10:17.848399 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:10:17.848399 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:10:17.848399 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:10:17.848399 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 010ea68aed824d6bac970360d34ab747 Aug 07 01:10:17.848399 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1461254374 Aug 07 01:10:17.848399 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:10:17.848399 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:10:17.851106 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/010ea68aed824d6bac970360d34ab747"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_010ea68aed824d6bac970360d34ab747", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/010ea68aed824d6bac970360d34ab747"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/010ea68aed824d6bac970360d34ab747"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:17.851106 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-DeleteServersAdminTestJSON-1461254374 Aug 07 01:10:17.851106 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 010ea68aed824d6bac970360d34ab747 Aug 07 01:10:17.851106 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1461254374 Aug 07 01:10:17.851106 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-DeleteServersAdminTestJSON-1461254374-project Aug 07 01:10:17.851106 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:10:17.851106 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:10:17.851106 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 909b8165f015473c9977ef92aaf0741b Aug 07 01:10:17.851106 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-DeleteServersAdminTestJSON-1461254374-project Aug 07 01:10:17.851106 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:10:17.851106 n-d-master-1 devstack@n-api.service[119517]: exception: Instance f11385ef-0cd8-406a-b905-81a8a6512ebe could not be found. Aug 07 01:10:17.851106 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'f11385ef-0cd8-406a-b905-81a8a6512ebe'} Aug 07 01:10:17.853651 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:17.853651 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:17.853651 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:10:17.853651 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:10:17.853651 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:10:17.853651 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:10:17.853651 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:10:17.853651 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:10:17.853651 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:10:17.853651 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:10:17.853651 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f11385ef-0cd8-406a-b905-81a8a6512ebe could not be found. Aug 07 01:10:17.853651 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:17.853651 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:17.853651 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:17.853651 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:17.853651 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:17.853651 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:17.853651 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:17.853651 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:17.853651 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:17.856231 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:17.856231 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:10:17.856231 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:10:17.856231 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:10:17.856231 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:10:17.856231 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:10:17.856231 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:10:17.856231 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f11385ef-0cd8-406a-b905-81a8a6512ebe could not be found. Aug 07 01:10:17.856231 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:17.856231 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:17.856231 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:17.856231 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:17.856231 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:17.856231 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:17.856231 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:10:17.856231 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:10:17.856231 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f11385ef-0cd8-406a-b905-81a8a6512ebe could not be found. Aug 07 01:10:17.856231 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:17.858508 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a8ac8362-00c0-46ca-9684-a295ff2d45b6 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Returning 404 to user: Instance f11385ef-0cd8-406a-b905-81a8a6512ebe could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:17.858508 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a8ac8362-00c0-46ca-9684-a295ff2d45b6 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe" status: 404 len: 111 microversion: 2.1 time: 0.588311 Aug 07 01:10:17.875905 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 98/226] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:17 2022] GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe => generated 111 bytes in 599 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:10:18.047598 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7e7edfd4-968d-45ba-88b4-d1a871589f8f tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:18.060065 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7e7edfd4-968d-45ba-88b4-d1a871589f8f tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] [instance: e40f1306-cb41-4d73-94a2-aeea34eb0f0c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:18.094793 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e7edfd4-968d-45ba-88b4-d1a871589f8f tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:18.095633 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e7edfd4-968d-45ba-88b4-d1a871589f8f tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:18.108760 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e7edfd4-968d-45ba-88b4-d1a871589f8f tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:18.110091 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e7edfd4-968d-45ba-88b4-d1a871589f8f tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:18.110966 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e7edfd4-968d-45ba-88b4-d1a871589f8f tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:18.111523 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e7edfd4-968d-45ba-88b4-d1a871589f8f tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:18.651003 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-81cce5cc-575f-4b9d-8ce7-6dca6476bbe0 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a892781ecd4300b6dd10b9c235e263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e7e61e7eb4c9490b7632bde85d2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:18.674969 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-81cce5cc-575f-4b9d-8ce7-6dca6476bbe0 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] 10.222.0.39 "GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a" status: 200 len: 1494 microversion: 2.1 time: 0.929926 Aug 07 01:10:18.676553 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 129/227] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:17 2022] GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a => generated 1494 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:18.696911 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7389fcda-e7ee-4351-9aea-739833c0b77f tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-506511518", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:18.823629 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-7389fcda-e7ee-4351-9aea-739833c0b77f tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] validate_networks() for None {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:10:18.938566 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=10 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:19.432444 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-7389fcda-e7ee-4351-9aea-739833c0b77f tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:10:19.433264 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-7389fcda-e7ee-4351-9aea-739833c0b77f tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:10:19.434348 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-7389fcda-e7ee-4351-9aea-739833c0b77f tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:10:19.434997 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-7389fcda-e7ee-4351-9aea-739833c0b77f tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:10:19.435599 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-7389fcda-e7ee-4351-9aea-739833c0b77f tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:10:19.460359 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7389fcda-e7ee-4351-9aea-739833c0b77f tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:19.461691 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7389fcda-e7ee-4351-9aea-739833c0b77f tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:19.463137 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7389fcda-e7ee-4351-9aea-739833c0b77f tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:19.465022 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7389fcda-e7ee-4351-9aea-739833c0b77f tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:19.466632 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7389fcda-e7ee-4351-9aea-739833c0b77f tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:19.467697 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7389fcda-e7ee-4351-9aea-739833c0b77f tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:19.510316 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-7389fcda-e7ee-4351-9aea-739833c0b77f tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Getting quotas for project 010ea68aed824d6bac970360d34ab747. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:10:19.538293 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-7389fcda-e7ee-4351-9aea-739833c0b77f tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Getting quotas for user 909b8165f015473c9977ef92aaf0741b and project 010ea68aed824d6bac970360d34ab747. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:10:19.568029 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7389fcda-e7ee-4351-9aea-739833c0b77f tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:10:19.574963 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7389fcda-e7ee-4351-9aea-739833c0b77f tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: 1d21a372-3326-418d-9a1f-eb2a2720fca1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:10:19.710113 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7e7edfd4-968d-45ba-88b4-d1a871589f8f tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e60f068764c4a259771662a83663cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0af4ec538f41868c10700c90e816d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:19.726213 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7e7edfd4-968d-45ba-88b4-d1a871589f8f tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] 10.222.0.39 "GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c" status: 200 len: 1491 microversion: 2.1 time: 1.692212 Aug 07 01:10:19.742536 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 99/228] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:18 2022] GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c => generated 1491 bytes in 1710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:10:19.748548 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7389fcda-e7ee-4351-9aea-739833c0b77f tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.067865 Aug 07 01:10:19.752242 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 130/229] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:10:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:10:19.761997 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0eadfc99-5079-4dcc-8bc1-d159719f8edf tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:19.762658 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0eadfc99-5079-4dcc-8bc1-d159719f8edf tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] [instance: 7028fed0-c1db-491a-b46f-345ead213c7a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:19.764122 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7b4c85d6-912e-432a-97d0-46b428d025c3 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:19.767334 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7b4c85d6-912e-432a-97d0-46b428d025c3 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: 1d21a372-3326-418d-9a1f-eb2a2720fca1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:19.782850 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0eadfc99-5079-4dcc-8bc1-d159719f8edf tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:19.783632 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0eadfc99-5079-4dcc-8bc1-d159719f8edf tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:19.784453 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0eadfc99-5079-4dcc-8bc1-d159719f8edf tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:19.785478 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0eadfc99-5079-4dcc-8bc1-d159719f8edf tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:19.788986 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0eadfc99-5079-4dcc-8bc1-d159719f8edf tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:19.789929 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0eadfc99-5079-4dcc-8bc1-d159719f8edf tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:19.920812 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7b4c85d6-912e-432a-97d0-46b428d025c3 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909b8165f015473c9977ef92aaf0741b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010ea68aed824d6bac970360d34ab747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:19.950168 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7b4c85d6-912e-432a-97d0-46b428d025c3 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1" status: 200 len: 1219 microversion: 2.1 time: 0.189332 Aug 07 01:10:19.953999 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 131/230] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:19 2022] GET /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1 => generated 1219 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:20.446876 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0eadfc99-5079-4dcc-8bc1-d159719f8edf tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a892781ecd4300b6dd10b9c235e263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e7e61e7eb4c9490b7632bde85d2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:20.459134 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0eadfc99-5079-4dcc-8bc1-d159719f8edf tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] 10.222.0.39 "GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a" status: 200 len: 1494 microversion: 2.1 time: 0.708761 Aug 07 01:10:20.459794 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 100/231] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:19 2022] GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a => generated 1494 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:20.509682 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3f9e3e66-26c0-47f7-84b7-78d62bfe6f23 tempest-ServicesAdminTestJSON-2012715761 tempest-ServicesAdminTestJSON-2012715761-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:20.529855 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:20.529855 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:10:20.535784 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f9e3e66-26c0-47f7-84b7-78d62bfe6f23 tempest-ServicesAdminTestJSON-2012715761 tempest-ServicesAdminTestJSON-2012715761-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:20.537106 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f9e3e66-26c0-47f7-84b7-78d62bfe6f23 tempest-ServicesAdminTestJSON-2012715761 tempest-ServicesAdminTestJSON-2012715761-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:20.538307 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f9e3e66-26c0-47f7-84b7-78d62bfe6f23 tempest-ServicesAdminTestJSON-2012715761 tempest-ServicesAdminTestJSON-2012715761-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:20.540152 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f9e3e66-26c0-47f7-84b7-78d62bfe6f23 tempest-ServicesAdminTestJSON-2012715761 tempest-ServicesAdminTestJSON-2012715761-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:20.541990 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f9e3e66-26c0-47f7-84b7-78d62bfe6f23 tempest-ServicesAdminTestJSON-2012715761 tempest-ServicesAdminTestJSON-2012715761-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:20.543285 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f9e3e66-26c0-47f7-84b7-78d62bfe6f23 tempest-ServicesAdminTestJSON-2012715761 tempest-ServicesAdminTestJSON-2012715761-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:20.572150 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:20.611526 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3f9e3e66-26c0-47f7-84b7-78d62bfe6f23 tempest-ServicesAdminTestJSON-2012715761 tempest-ServicesAdminTestJSON-2012715761-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 966 microversion: 2.1 time: 0.553685 Aug 07 01:10:20.612985 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 132/232] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Aug 7 01:10:20 2022] GET /compute/v2.1/os-services => generated 966 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:10:20.634497 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6f9313d4-709b-47b8-9ca4-30f9367cd4e5 tempest-ServicesAdminTestJSON-2012715761 tempest-ServicesAdminTestJSON-2012715761-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:20.637933 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:20.637933 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:20.640960 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f9313d4-709b-47b8-9ca4-30f9367cd4e5 tempest-ServicesAdminTestJSON-2012715761 tempest-ServicesAdminTestJSON-2012715761-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:20.642941 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f9313d4-709b-47b8-9ca4-30f9367cd4e5 tempest-ServicesAdminTestJSON-2012715761 tempest-ServicesAdminTestJSON-2012715761-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:20.643873 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f9313d4-709b-47b8-9ca4-30f9367cd4e5 tempest-ServicesAdminTestJSON-2012715761 tempest-ServicesAdminTestJSON-2012715761-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:20.650610 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f9313d4-709b-47b8-9ca4-30f9367cd4e5 tempest-ServicesAdminTestJSON-2012715761 tempest-ServicesAdminTestJSON-2012715761-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:20.652827 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f9313d4-709b-47b8-9ca4-30f9367cd4e5 tempest-ServicesAdminTestJSON-2012715761 tempest-ServicesAdminTestJSON-2012715761-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:20.655369 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f9313d4-709b-47b8-9ca4-30f9367cd4e5 tempest-ServicesAdminTestJSON-2012715761 tempest-ServicesAdminTestJSON-2012715761-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:20.706555 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6f9313d4-709b-47b8-9ca4-30f9367cd4e5 tempest-ServicesAdminTestJSON-2012715761 tempest-ServicesAdminTestJSON-2012715761-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?host=n-d-master-1" status: 200 len: 578 microversion: 2.1 time: 0.076305 Aug 07 01:10:20.714773 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 101/233] 10.222.0.39 () {58 vars in 1172 bytes} [Sun Aug 7 01:10:20 2022] GET /compute/v2.1/os-services?host=n-d-master-1 => generated 578 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:20.734997 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-73db7493-9cbc-4825-bd31-02b767bdc80b tempest-ServicesAdminTestJSON-2012715761 tempest-ServicesAdminTestJSON-2012715761-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:20.738396 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:20.738396 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:10:20.748264 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73db7493-9cbc-4825-bd31-02b767bdc80b tempest-ServicesAdminTestJSON-2012715761 tempest-ServicesAdminTestJSON-2012715761-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:20.749988 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73db7493-9cbc-4825-bd31-02b767bdc80b tempest-ServicesAdminTestJSON-2012715761 tempest-ServicesAdminTestJSON-2012715761-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:20.750848 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73db7493-9cbc-4825-bd31-02b767bdc80b tempest-ServicesAdminTestJSON-2012715761 tempest-ServicesAdminTestJSON-2012715761-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:20.752641 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73db7493-9cbc-4825-bd31-02b767bdc80b tempest-ServicesAdminTestJSON-2012715761 tempest-ServicesAdminTestJSON-2012715761-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:20.753620 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73db7493-9cbc-4825-bd31-02b767bdc80b tempest-ServicesAdminTestJSON-2012715761 tempest-ServicesAdminTestJSON-2012715761-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:20.756063 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73db7493-9cbc-4825-bd31-02b767bdc80b tempest-ServicesAdminTestJSON-2012715761 tempest-ServicesAdminTestJSON-2012715761-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:20.758039 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-beb1e9d9-3c68-4025-ab0e-ec6d5d2d519c tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:20.759093 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-beb1e9d9-3c68-4025-ab0e-ec6d5d2d519c tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] [instance: e40f1306-cb41-4d73-94a2-aeea34eb0f0c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:20.772384 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-beb1e9d9-3c68-4025-ab0e-ec6d5d2d519c tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:20.773032 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-beb1e9d9-3c68-4025-ab0e-ec6d5d2d519c tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:20.773489 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-beb1e9d9-3c68-4025-ab0e-ec6d5d2d519c tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:20.774509 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-beb1e9d9-3c68-4025-ab0e-ec6d5d2d519c tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:20.775503 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-beb1e9d9-3c68-4025-ab0e-ec6d5d2d519c tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:20.776098 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-beb1e9d9-3c68-4025-ab0e-ec6d5d2d519c tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:20.836010 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-73db7493-9cbc-4825-bd31-02b767bdc80b tempest-ServicesAdminTestJSON-2012715761 tempest-ServicesAdminTestJSON-2012715761-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 402 microversion: 2.1 time: 0.103580 Aug 07 01:10:20.848679 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 133/234] 10.222.0.39 () {58 vars in 1176 bytes} [Sun Aug 7 01:10:20 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 402 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:20.861540 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7fbb8b64-4376-436d-904f-a4d7aaa58f7a tempest-ServicesAdminTestJSON-2012715761 tempest-ServicesAdminTestJSON-2012715761-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:20.864164 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:20.864164 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:10:20.866112 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7fbb8b64-4376-436d-904f-a4d7aaa58f7a tempest-ServicesAdminTestJSON-2012715761 tempest-ServicesAdminTestJSON-2012715761-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:20.866706 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7fbb8b64-4376-436d-904f-a4d7aaa58f7a tempest-ServicesAdminTestJSON-2012715761 tempest-ServicesAdminTestJSON-2012715761-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:20.867552 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7fbb8b64-4376-436d-904f-a4d7aaa58f7a tempest-ServicesAdminTestJSON-2012715761 tempest-ServicesAdminTestJSON-2012715761-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:20.869127 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7fbb8b64-4376-436d-904f-a4d7aaa58f7a tempest-ServicesAdminTestJSON-2012715761 tempest-ServicesAdminTestJSON-2012715761-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:20.870600 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7fbb8b64-4376-436d-904f-a4d7aaa58f7a tempest-ServicesAdminTestJSON-2012715761 tempest-ServicesAdminTestJSON-2012715761-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:20.871522 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7fbb8b64-4376-436d-904f-a4d7aaa58f7a tempest-ServicesAdminTestJSON-2012715761 tempest-ServicesAdminTestJSON-2012715761-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:20.911727 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7fbb8b64-4376-436d-904f-a4d7aaa58f7a tempest-ServicesAdminTestJSON-2012715761 tempest-ServicesAdminTestJSON-2012715761-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 966 microversion: 2.1 time: 0.055900 Aug 07 01:10:20.913468 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 134/235] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Aug 7 01:10:20 2022] GET /compute/v2.1/os-services => generated 966 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:20.921870 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=60,nova_cell0:UPDATE=12 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:20.979181 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-33e0fe48-83a0-40d6-820b-2108de46fc92 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:20.980631 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-33e0fe48-83a0-40d6-820b-2108de46fc92 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: 1d21a372-3326-418d-9a1f-eb2a2720fca1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:20.996380 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33e0fe48-83a0-40d6-820b-2108de46fc92 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:20.997090 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33e0fe48-83a0-40d6-820b-2108de46fc92 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:20.997758 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33e0fe48-83a0-40d6-820b-2108de46fc92 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:20.999087 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33e0fe48-83a0-40d6-820b-2108de46fc92 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:21.000093 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33e0fe48-83a0-40d6-820b-2108de46fc92 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:21.001402 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33e0fe48-83a0-40d6-820b-2108de46fc92 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:21.129083 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-33e0fe48-83a0-40d6-820b-2108de46fc92 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909b8165f015473c9977ef92aaf0741b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010ea68aed824d6bac970360d34ab747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:21.141740 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-33e0fe48-83a0-40d6-820b-2108de46fc92 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1" status: 200 len: 1223 microversion: 2.1 time: 0.168979 Aug 07 01:10:21.158692 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 135/236] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:20 2022] GET /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1 => generated 1223 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:21.495682 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d23c3956-f839-4403-8f70-82898e8f8566 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:21.498824 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d23c3956-f839-4403-8f70-82898e8f8566 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] [instance: 7028fed0-c1db-491a-b46f-345ead213c7a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:21.536505 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d23c3956-f839-4403-8f70-82898e8f8566 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:21.537600 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d23c3956-f839-4403-8f70-82898e8f8566 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:21.539072 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d23c3956-f839-4403-8f70-82898e8f8566 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:21.541815 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d23c3956-f839-4403-8f70-82898e8f8566 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:21.542847 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d23c3956-f839-4403-8f70-82898e8f8566 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:21.543823 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d23c3956-f839-4403-8f70-82898e8f8566 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:21.737236 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-beb1e9d9-3c68-4025-ab0e-ec6d5d2d519c tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e60f068764c4a259771662a83663cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0af4ec538f41868c10700c90e816d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:21.779803 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-beb1e9d9-3c68-4025-ab0e-ec6d5d2d519c tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] 10.222.0.39 "GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c" status: 200 len: 1491 microversion: 2.1 time: 1.026017 Aug 07 01:10:21.781378 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 102/237] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:20 2022] GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c => generated 1491 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:21.884236 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-4ac50fed-56a5-49eb-892a-a6c9b84c4d7c req-0dc32787-257e-475b-9538-67dba3623baa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7028fed0-c1db-491a-b46f-345ead213c7a", "name": "network-vif-deleted", "tag": "e0121c8a-524d-48f2-a161-6a2525d23956"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:21.927410 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-4ac50fed-56a5-49eb-892a-a6c9b84c4d7c req-0dc32787-257e-475b-9538-67dba3623baa service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:21.928293 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-4ac50fed-56a5-49eb-892a-a6c9b84c4d7c req-0dc32787-257e-475b-9538-67dba3623baa service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:21.934270 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-4ac50fed-56a5-49eb-892a-a6c9b84c4d7c req-0dc32787-257e-475b-9538-67dba3623baa service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:21.999915 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d23c3956-f839-4403-8f70-82898e8f8566 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a892781ecd4300b6dd10b9c235e263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e7e61e7eb4c9490b7632bde85d2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:22.020162 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-4ac50fed-56a5-49eb-892a-a6c9b84c4d7c req-0dc32787-257e-475b-9538-67dba3623baa service nova] Creating event network-vif-deleted:e0121c8a-524d-48f2-a161-6a2525d23956 for instance 7028fed0-c1db-491a-b46f-345ead213c7a on n-h2-master-1 Aug 07 01:10:22.035955 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d23c3956-f839-4403-8f70-82898e8f8566 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] 10.222.0.39 "GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a" status: 200 len: 1452 microversion: 2.1 time: 0.554041 Aug 07 01:10:22.036971 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 136/238] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:21 2022] GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a => generated 1452 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:22.045610 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-4ac50fed-56a5-49eb-892a-a6c9b84c4d7c req-0dc32787-257e-475b-9538-67dba3623baa service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165325 Aug 07 01:10:22.048265 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 103/239] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:22.182405 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e8fb4c09-8c86-4c64-badd-7c6856e65206 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:22.186222 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e8fb4c09-8c86-4c64-badd-7c6856e65206 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: 1d21a372-3326-418d-9a1f-eb2a2720fca1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:22.217672 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e8fb4c09-8c86-4c64-badd-7c6856e65206 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:22.225463 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e8fb4c09-8c86-4c64-badd-7c6856e65206 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:22.227101 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e8fb4c09-8c86-4c64-badd-7c6856e65206 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:22.230665 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e8fb4c09-8c86-4c64-badd-7c6856e65206 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:22.241226 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e8fb4c09-8c86-4c64-badd-7c6856e65206 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:22.242452 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e8fb4c09-8c86-4c64-badd-7c6856e65206 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:22.738585 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e8fb4c09-8c86-4c64-badd-7c6856e65206 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909b8165f015473c9977ef92aaf0741b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010ea68aed824d6bac970360d34ab747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:22.771872 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e8fb4c09-8c86-4c64-badd-7c6856e65206 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1" status: 200 len: 1279 microversion: 2.1 time: 0.604723 Aug 07 01:10:22.777192 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 137/240] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:22 2022] GET /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1 => generated 1279 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:22.825959 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e9559d27-a0d9-4780-8dcb-e783acb41259 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:22.828267 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e9559d27-a0d9-4780-8dcb-e783acb41259 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] [instance: e40f1306-cb41-4d73-94a2-aeea34eb0f0c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:22.847283 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9559d27-a0d9-4780-8dcb-e783acb41259 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:22.857908 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9559d27-a0d9-4780-8dcb-e783acb41259 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:22.861012 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9559d27-a0d9-4780-8dcb-e783acb41259 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:22.862305 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9559d27-a0d9-4780-8dcb-e783acb41259 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:22.865201 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9559d27-a0d9-4780-8dcb-e783acb41259 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:22.866112 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9559d27-a0d9-4780-8dcb-e783acb41259 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:23.013963 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9559d27-a0d9-4780-8dcb-e783acb41259 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:23.020593 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9559d27-a0d9-4780-8dcb-e783acb41259 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:23.022901 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9559d27-a0d9-4780-8dcb-e783acb41259 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:23.028363 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-e9559d27-a0d9-4780-8dcb-e783acb41259 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lazy-loading 'fault' on Instance uuid e40f1306-cb41-4d73-94a2-aeea34eb0f0c {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:10:23.077654 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-628cad41-b50e-4c37-a08c-a3c98da83234 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:23.079265 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-628cad41-b50e-4c37-a08c-a3c98da83234 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] [instance: 7028fed0-c1db-491a-b46f-345ead213c7a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:23.117351 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-628cad41-b50e-4c37-a08c-a3c98da83234 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:23.120033 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-628cad41-b50e-4c37-a08c-a3c98da83234 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:23.126314 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-628cad41-b50e-4c37-a08c-a3c98da83234 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:23.135569 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-628cad41-b50e-4c37-a08c-a3c98da83234 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:23.136877 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-628cad41-b50e-4c37-a08c-a3c98da83234 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:23.137821 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-628cad41-b50e-4c37-a08c-a3c98da83234 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:23.227485 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-628cad41-b50e-4c37-a08c-a3c98da83234 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:23.229210 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-628cad41-b50e-4c37-a08c-a3c98da83234 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:23.230513 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-628cad41-b50e-4c37-a08c-a3c98da83234 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:23.245655 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-628cad41-b50e-4c37-a08c-a3c98da83234 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lazy-loading 'fault' on Instance uuid 7028fed0-c1db-491a-b46f-345ead213c7a {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:10:23.249026 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e9559d27-a0d9-4780-8dcb-e783acb41259 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e60f068764c4a259771662a83663cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0af4ec538f41868c10700c90e816d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:23.293008 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e9559d27-a0d9-4780-8dcb-e783acb41259 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] 10.222.0.39 "GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c" status: 200 len: 1325 microversion: 2.1 time: 0.470702 Aug 07 01:10:23.315587 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 104/241] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:22 2022] GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c => generated 1325 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:10:23.517955 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-628cad41-b50e-4c37-a08c-a3c98da83234 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a892781ecd4300b6dd10b9c235e263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15e7e61e7eb4c9490b7632bde85d2cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:23.543823 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-628cad41-b50e-4c37-a08c-a3c98da83234 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] 10.222.0.39 "GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a" status: 200 len: 1328 microversion: 2.1 time: 0.470446 Aug 07 01:10:23.549435 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 138/242] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:23 2022] GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a => generated 1328 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:23.816391 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c40bd5ea-9917-4269-b915-0bf26290d4e5 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:23.824139 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c40bd5ea-9917-4269-b915-0bf26290d4e5 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: 1d21a372-3326-418d-9a1f-eb2a2720fca1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:23.851003 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c40bd5ea-9917-4269-b915-0bf26290d4e5 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:23.857544 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c40bd5ea-9917-4269-b915-0bf26290d4e5 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:23.858525 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c40bd5ea-9917-4269-b915-0bf26290d4e5 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:23.861634 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c40bd5ea-9917-4269-b915-0bf26290d4e5 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:23.866478 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c40bd5ea-9917-4269-b915-0bf26290d4e5 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:23.867732 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c40bd5ea-9917-4269-b915-0bf26290d4e5 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:24.172230 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-02689830-e4e2-4bc4-8d56-71fc9071345b req-a3009ccf-a5e7-40ae-90ca-fe82b4ccf0bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e40f1306-cb41-4d73-94a2-aeea34eb0f0c", "name": "network-vif-deleted", "tag": "3f47ad93-5e2c-4dd6-9b85-b3bb64cf5de3"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:24.221072 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-02689830-e4e2-4bc4-8d56-71fc9071345b req-a3009ccf-a5e7-40ae-90ca-fe82b4ccf0bb service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:24.222527 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-02689830-e4e2-4bc4-8d56-71fc9071345b req-a3009ccf-a5e7-40ae-90ca-fe82b4ccf0bb service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:24.223536 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-02689830-e4e2-4bc4-8d56-71fc9071345b req-a3009ccf-a5e7-40ae-90ca-fe82b4ccf0bb service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:24.281902 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-02689830-e4e2-4bc4-8d56-71fc9071345b req-a3009ccf-a5e7-40ae-90ca-fe82b4ccf0bb service nova] Creating event network-vif-deleted:3f47ad93-5e2c-4dd6-9b85-b3bb64cf5de3 for instance e40f1306-cb41-4d73-94a2-aeea34eb0f0c on n-h2-master-1 Aug 07 01:10:24.286239 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c40bd5ea-9917-4269-b915-0bf26290d4e5 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909b8165f015473c9977ef92aaf0741b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010ea68aed824d6bac970360d34ab747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:24.297284 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-02689830-e4e2-4bc4-8d56-71fc9071345b req-a3009ccf-a5e7-40ae-90ca-fe82b4ccf0bb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130761 Aug 07 01:10:24.303331 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 139/243] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:24.321789 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c40bd5ea-9917-4269-b915-0bf26290d4e5 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1" status: 200 len: 1277 microversion: 2.1 time: 0.512332 Aug 07 01:10:24.324079 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 105/244] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:23 2022] GET /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1 => generated 1277 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:24.367105 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b3a91f04-caa4-479c-b8ca-59cb79c4e673 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:24.385175 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b3a91f04-caa4-479c-b8ca-59cb79c4e673 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] [instance: e40f1306-cb41-4d73-94a2-aeea34eb0f0c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:24.419873 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b3a91f04-caa4-479c-b8ca-59cb79c4e673 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:24.420306 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b3a91f04-caa4-479c-b8ca-59cb79c4e673 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:24.421082 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b3a91f04-caa4-479c-b8ca-59cb79c4e673 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:24.426109 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b3a91f04-caa4-479c-b8ca-59cb79c4e673 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:24.426978 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b3a91f04-caa4-479c-b8ca-59cb79c4e673 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:24.427741 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b3a91f04-caa4-479c-b8ca-59cb79c4e673 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:24.503186 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-b3a91f04-caa4-479c-b8ca-59cb79c4e673 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] HTTP exception thrown: Instance e40f1306-cb41-4d73-94a2-aeea34eb0f0c could not be found. Aug 07 01:10:24.509075 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b3a91f04-caa4-479c-b8ca-59cb79c4e673 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Request method failure captured: Aug 07 01:10:24.509075 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c HTTP/1.1 Aug 07 01:10:24.509075 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:10:24.509075 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:10:24.509075 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:10:24.509075 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:10:24.509075 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:10:24.509075 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:10:24.509075 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:10:24.509075 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:24.509075 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xDIa7beMM1GWB87_heichvW93J69mYVdNhU_10p556Iyt5XLeY84qGily1oXXcnwMs0WpfFJaHZDEvvf7YwWayP9_D4AKC92WEyAsWDv3mR0IFQcJkYwcRFnbPX651-QFQ32sEkmnwhdTX066DAzqgIgAUAdh81b0-JbK3bgc3YuO0 Aug 07 01:10:24.509075 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:10:24.509075 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:10:24.509075 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:10:24.509075 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:10:24.509075 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:10:24.509075 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:10:24.509075 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 8d0af4ec538f41868c10700c90e816d6 Aug 07 01:10:24.509075 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-TenantUsagesTestJSON-192866763 Aug 07 01:10:24.509075 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:10:24.509075 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:10:24.511613 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8d0af4ec538f41868c10700c90e816d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8d0af4ec538f41868c10700c90e816d6", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8d0af4ec538f41868c10700c90e816d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8d0af4ec538f41868c10700c90e816d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:24.511613 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-TenantUsagesTestJSON-192866763 Aug 07 01:10:24.511613 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 8d0af4ec538f41868c10700c90e816d6 Aug 07 01:10:24.511613 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-TenantUsagesTestJSON-192866763 Aug 07 01:10:24.511613 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-TenantUsagesTestJSON-192866763-project Aug 07 01:10:24.511613 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:10:24.511613 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:10:24.511613 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 2e60f068764c4a259771662a83663cb9 Aug 07 01:10:24.511613 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-TenantUsagesTestJSON-192866763-project Aug 07 01:10:24.511613 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:10:24.511613 n-d-master-1 devstack@n-api.service[119516]: exception: Instance e40f1306-cb41-4d73-94a2-aeea34eb0f0c could not be found. Aug 07 01:10:24.511613 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'e40f1306-cb41-4d73-94a2-aeea34eb0f0c'} Aug 07 01:10:24.513026 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:24.513026 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:24.513026 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:10:24.513026 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:10:24.513026 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:10:24.513026 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:10:24.513026 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:10:24.513026 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:10:24.513026 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:10:24.513026 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:10:24.513026 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e40f1306-cb41-4d73-94a2-aeea34eb0f0c could not be found. Aug 07 01:10:24.513026 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:24.513026 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:24.513026 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:24.513026 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:24.513026 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:24.513026 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:24.513026 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:24.513026 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:24.513026 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:24.515302 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:24.515302 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:10:24.515302 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:10:24.515302 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:10:24.515302 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:10:24.515302 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:10:24.515302 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:10:24.515302 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e40f1306-cb41-4d73-94a2-aeea34eb0f0c could not be found. Aug 07 01:10:24.515302 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:24.515302 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:24.515302 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:24.515302 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:24.515302 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:24.515302 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:24.515302 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:10:24.515302 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:10:24.515302 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e40f1306-cb41-4d73-94a2-aeea34eb0f0c could not be found. Aug 07 01:10:24.515302 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:24.517737 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b3a91f04-caa4-479c-b8ca-59cb79c4e673 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] Returning 404 to user: Instance e40f1306-cb41-4d73-94a2-aeea34eb0f0c could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:24.517737 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b3a91f04-caa4-479c-b8ca-59cb79c4e673 tempest-TenantUsagesTestJSON-192866763 tempest-TenantUsagesTestJSON-192866763-project] 10.222.0.39 "GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c" status: 404 len: 111 microversion: 2.1 time: 0.161649 Aug 07 01:10:24.517737 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 140/245] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:24 2022] GET /compute/v2.1/servers/e40f1306-cb41-4d73-94a2-aeea34eb0f0c => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:10:24.593488 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-23ff6485-25be-4fdc-b68e-4f8973332d00 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:24.595093 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-23ff6485-25be-4fdc-b68e-4f8973332d00 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] [instance: 7028fed0-c1db-491a-b46f-345ead213c7a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:24.614659 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23ff6485-25be-4fdc-b68e-4f8973332d00 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:24.616029 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23ff6485-25be-4fdc-b68e-4f8973332d00 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:24.617193 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23ff6485-25be-4fdc-b68e-4f8973332d00 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:24.620414 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23ff6485-25be-4fdc-b68e-4f8973332d00 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:24.623804 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23ff6485-25be-4fdc-b68e-4f8973332d00 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:24.629230 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23ff6485-25be-4fdc-b68e-4f8973332d00 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:24.668928 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-23ff6485-25be-4fdc-b68e-4f8973332d00 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] HTTP exception thrown: Instance 7028fed0-c1db-491a-b46f-345ead213c7a could not be found. Aug 07 01:10:24.673860 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-23ff6485-25be-4fdc-b68e-4f8973332d00 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Request method failure captured: Aug 07 01:10:24.673860 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a HTTP/1.1 Aug 07 01:10:24.673860 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:10:24.673860 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:10:24.673860 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:10:24.673860 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:10:24.673860 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:10:24.673860 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:10:24.673860 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:10:24.673860 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:24.673860 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xDDWm0a8ry-gKjmNwEPUQK59BE4cVud7DVSV_Jx7MD-3gvK0uQtoJ2J9The9na-lEHEDa6W5PD0G_Wfr7mrOCu9tlQ6l00XWqImSL9rvvj2p4osh6grgg8h1_X8uZWOiObCg_Kx_eubU-R7GgR6DDmJUESf97hNwOPLTcPMqNdAnw8 Aug 07 01:10:24.673860 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:10:24.673860 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:10:24.673860 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:10:24.673860 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:10:24.673860 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:10:24.673860 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:10:24.673860 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: c15e7e61e7eb4c9490b7632bde85d2cd Aug 07 01:10:24.673860 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-AggregatesAdminTestJSON-417248441 Aug 07 01:10:24.673860 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:10:24.673860 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:10:24.676397 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c15e7e61e7eb4c9490b7632bde85d2cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c15e7e61e7eb4c9490b7632bde85d2cd", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c15e7e61e7eb4c9490b7632bde85d2cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c15e7e61e7eb4c9490b7632bde85d2cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:24.676397 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-AggregatesAdminTestJSON-417248441 Aug 07 01:10:24.676397 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: c15e7e61e7eb4c9490b7632bde85d2cd Aug 07 01:10:24.676397 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-417248441 Aug 07 01:10:24.676397 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-AggregatesAdminTestJSON-417248441-project Aug 07 01:10:24.676397 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:10:24.676397 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:10:24.676397 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 37a892781ecd4300b6dd10b9c235e263 Aug 07 01:10:24.676397 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-AggregatesAdminTestJSON-417248441-project Aug 07 01:10:24.676397 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:10:24.676397 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 7028fed0-c1db-491a-b46f-345ead213c7a could not be found. Aug 07 01:10:24.676397 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '7028fed0-c1db-491a-b46f-345ead213c7a'} Aug 07 01:10:24.677761 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:24.677761 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:24.677761 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:10:24.677761 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:10:24.677761 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:10:24.677761 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:10:24.677761 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:10:24.677761 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:10:24.677761 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:10:24.677761 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:10:24.677761 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7028fed0-c1db-491a-b46f-345ead213c7a could not be found. Aug 07 01:10:24.677761 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:24.677761 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:24.677761 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:24.677761 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:24.677761 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:24.677761 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:24.677761 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:24.677761 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:24.677761 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:24.679924 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:24.679924 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:10:24.679924 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:10:24.679924 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:10:24.679924 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:10:24.679924 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:10:24.679924 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:10:24.679924 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7028fed0-c1db-491a-b46f-345ead213c7a could not be found. Aug 07 01:10:24.679924 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:24.679924 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:24.679924 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:24.679924 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:24.679924 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:24.679924 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:24.679924 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:10:24.679924 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:10:24.679924 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7028fed0-c1db-491a-b46f-345ead213c7a could not be found. Aug 07 01:10:24.679924 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:24.684648 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-23ff6485-25be-4fdc-b68e-4f8973332d00 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Returning 404 to user: Instance 7028fed0-c1db-491a-b46f-345ead213c7a could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:24.686774 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-23ff6485-25be-4fdc-b68e-4f8973332d00 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] 10.222.0.39 "GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a" status: 404 len: 111 microversion: 2.1 time: 0.102196 Aug 07 01:10:24.688899 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 106/246] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:24 2022] GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:10:24.707095 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ba1f2ae6-5557-493f-9ec3-25fd5c8e7bb7 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:24.718764 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:24.718764 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:10:24.745521 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ba1f2ae6-5557-493f-9ec3-25fd5c8e7bb7 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:24.746878 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ba1f2ae6-5557-493f-9ec3-25fd5c8e7bb7 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:24.747918 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ba1f2ae6-5557-493f-9ec3-25fd5c8e7bb7 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:25.115426 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ba1f2ae6-5557-493f-9ec3-25fd5c8e7bb7 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 300 microversion: 2.1 time: 0.420759 Aug 07 01:10:25.117764 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 141/247] 10.222.0.39 () {60 vars in 1191 bytes} [Sun Aug 7 01:10:24 2022] POST /compute/v2.1/os-aggregates/3/action => generated 300 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:10:25.146004 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7afa53aa-11a1-4213-9fac-f76d80327bbd tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:25.150822 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:25.150822 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:25.236996 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7afa53aa-11a1-4213-9fac-f76d80327bbd tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.105503 Aug 07 01:10:25.240319 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 107/248] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Aug 7 01:10:25 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 07 01:10:25.280238 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-35f742c2-4539-4267-8839-d9511ae52e57 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1827193111"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:25.297001 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:25.297001 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:10:25.302474 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.aggregate [None req-35f742c2-4539-4267-8839-d9511ae52e57 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Generated uuid 459cd57f-2098-47c1-97f2-b80b022bb325 for aggregate {{(pid=119516) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 07 01:10:25.367657 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d7f4835a-36ad-46b5-8b27-deaa630e94b8 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:25.371020 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d7f4835a-36ad-46b5-8b27-deaa630e94b8 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: 1d21a372-3326-418d-9a1f-eb2a2720fca1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:25.413089 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7f4835a-36ad-46b5-8b27-deaa630e94b8 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:25.421120 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7f4835a-36ad-46b5-8b27-deaa630e94b8 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:25.425163 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7f4835a-36ad-46b5-8b27-deaa630e94b8 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:25.426514 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7f4835a-36ad-46b5-8b27-deaa630e94b8 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:25.427295 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-35f742c2-4539-4267-8839-d9511ae52e57 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.161518 Aug 07 01:10:25.427452 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7f4835a-36ad-46b5-8b27-deaa630e94b8 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:25.428091 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7f4835a-36ad-46b5-8b27-deaa630e94b8 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:25.428922 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 142/249] 10.222.0.39 () {60 vars in 1164 bytes} [Sun Aug 7 01:10:25 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:25.453267 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e8430b42-d7fb-44ea-819b-ae85cf05dd6a tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:25.468802 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:25.468802 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:10:25.503451 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e8430b42-d7fb-44ea-819b-ae85cf05dd6a tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:25.505666 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e8430b42-d7fb-44ea-819b-ae85cf05dd6a tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:25.506251 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e8430b42-d7fb-44ea-819b-ae85cf05dd6a tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:26.080626 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e8430b42-d7fb-44ea-819b-ae85cf05dd6a tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 242 microversion: 2.1 time: 0.636973 Aug 07 01:10:26.082925 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 143/250] 10.222.0.39 () {60 vars in 1191 bytes} [Sun Aug 7 01:10:25 2022] POST /compute/v2.1/os-aggregates/8/action => generated 242 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:26.109919 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0ca45fda-9347-4932-83c7-91f0d9824366 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:26.115248 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:26.115248 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:10:26.157381 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0ca45fda-9347-4932-83c7-91f0d9824366 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 242 microversion: 2.1 time: 0.061482 Aug 07 01:10:26.162197 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 144/251] 10.222.0.39 () {58 vars in 1149 bytes} [Sun Aug 7 01:10:26 2022] GET /compute/v2.1/os-aggregates/8 => generated 242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:26.181583 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-417c1f2d-ffae-4e4a-b26d-12ed21432211 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:26.191326 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:26.191326 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:10:26.229644 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-417c1f2d-ffae-4e4a-b26d-12ed21432211 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:26.230481 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-417c1f2d-ffae-4e4a-b26d-12ed21432211 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:26.235192 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-417c1f2d-ffae-4e4a-b26d-12ed21432211 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:26.365944 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d7f4835a-36ad-46b5-8b27-deaa630e94b8 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909b8165f015473c9977ef92aaf0741b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010ea68aed824d6bac970360d34ab747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:26.395830 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d7f4835a-36ad-46b5-8b27-deaa630e94b8 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1" status: 200 len: 1319 microversion: 2.1 time: 1.034112 Aug 07 01:10:26.398070 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 108/252] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:25 2022] GET /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1 => generated 1319 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:26.604732 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-417c1f2d-ffae-4e4a-b26d-12ed21432211 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 227 microversion: 2.1 time: 0.435949 Aug 07 01:10:26.609560 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 145/253] 10.222.0.39 () {60 vars in 1191 bytes} [Sun Aug 7 01:10:26 2022] POST /compute/v2.1/os-aggregates/8/action => generated 227 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:10:26.638853 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0ece5fc8-598b-45b9-9014-cd4389e59eff tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:26.642886 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:26.642886 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:26.741018 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0ece5fc8-598b-45b9-9014-cd4389e59eff tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.112798 Aug 07 01:10:26.745484 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 109/254] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Aug 7 01:10:26 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 07 01:10:26.772038 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a8d329d9-71a1-4d5b-9685-92d838b93e44 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-344302588"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:26.779215 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:26.779215 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:10:26.781445 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.aggregate [None req-a8d329d9-71a1-4d5b-9685-92d838b93e44 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Generated uuid e7b72102-b338-4232-8fb2-5d16309faa55 for aggregate {{(pid=119516) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 07 01:10:26.870054 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a8d329d9-71a1-4d5b-9685-92d838b93e44 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.100085 Aug 07 01:10:26.881315 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 146/255] 10.222.0.39 () {60 vars in 1164 bytes} [Sun Aug 7 01:10:26 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:26.902513 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6b0169e6-342f-43f0-a442-bd4fad47e562 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:26.909205 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:26.909205 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:26.938485 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6b0169e6-342f-43f0-a442-bd4fad47e562 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:26.939659 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6b0169e6-342f-43f0-a442-bd4fad47e562 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:26.940753 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6b0169e6-342f-43f0-a442-bd4fad47e562 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:27.205682 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6b0169e6-342f-43f0-a442-bd4fad47e562 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 241 microversion: 2.1 time: 0.319243 Aug 07 01:10:27.208018 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 110/256] 10.222.0.39 () {60 vars in 1191 bytes} [Sun Aug 7 01:10:26 2022] POST /compute/v2.1/os-aggregates/9/action => generated 241 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:27.225756 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-07c09cf3-7509-4cd2-874d-ac65fe1de6da tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:27.227620 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:27.227620 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:10:27.253920 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-07c09cf3-7509-4cd2-874d-ac65fe1de6da tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.035771 Aug 07 01:10:27.264005 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 147/257] 10.222.0.39 () {58 vars in 1143 bytes} [Sun Aug 7 01:10:27 2022] GET /compute/v2.1/os-aggregates => generated 244 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:27.287248 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f19ae692-d484-4a89-81b6-4ec4fb1561c5 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:27.301936 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:27.301936 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:27.335016 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f19ae692-d484-4a89-81b6-4ec4fb1561c5 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:27.336080 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f19ae692-d484-4a89-81b6-4ec4fb1561c5 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:27.337725 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f19ae692-d484-4a89-81b6-4ec4fb1561c5 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:27.438050 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-548a1d1b-990d-4888-887f-d7598867449a tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:27.439274 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-548a1d1b-990d-4888-887f-d7598867449a tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: 1d21a372-3326-418d-9a1f-eb2a2720fca1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:27.470314 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-548a1d1b-990d-4888-887f-d7598867449a tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:27.471224 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-548a1d1b-990d-4888-887f-d7598867449a tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:27.472080 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-548a1d1b-990d-4888-887f-d7598867449a tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:27.473686 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-548a1d1b-990d-4888-887f-d7598867449a tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:27.474567 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-548a1d1b-990d-4888-887f-d7598867449a tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:27.475339 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-548a1d1b-990d-4888-887f-d7598867449a tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:27.679852 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f19ae692-d484-4a89-81b6-4ec4fb1561c5 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.400073 Aug 07 01:10:27.693963 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 111/258] 10.222.0.39 () {60 vars in 1191 bytes} [Sun Aug 7 01:10:27 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:27.712766 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-efcf4ea5-0be8-4502-81b8-b3ce46c25b28 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:27.716291 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:27.716291 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:27.828344 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-efcf4ea5-0be8-4502-81b8-b3ce46c25b28 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.121381 Aug 07 01:10:27.831021 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 112/259] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Aug 7 01:10:27 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 07 01:10:27.856719 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9092b74e-eeb6-4c0e-9a42-9d2b48d0469f tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1905622089"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:27.871116 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:27.871116 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:27.872532 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.aggregate [None req-9092b74e-eeb6-4c0e-9a42-9d2b48d0469f tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Generated uuid 7c09dc3e-e98f-4108-9b59-c554c0374c1f for aggregate {{(pid=119517) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 07 01:10:27.914305 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9092b74e-eeb6-4c0e-9a42-9d2b48d0469f tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.068433 Aug 07 01:10:27.916574 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 113/260] 10.222.0.39 () {60 vars in 1164 bytes} [Sun Aug 7 01:10:27 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:27.935619 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7eec98c0-a870-43eb-96d9-46828d181a21 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:27.939780 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:27.939780 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:27.964449 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7eec98c0-a870-43eb-96d9-46828d181a21 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:27.965035 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7eec98c0-a870-43eb-96d9-46828d181a21 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:27.965568 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7eec98c0-a870-43eb-96d9-46828d181a21 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:28.366000 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7eec98c0-a870-43eb-96d9-46828d181a21 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 243 microversion: 2.1 time: 0.432645 Aug 07 01:10:28.367655 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 114/261] 10.222.0.39 () {60 vars in 1194 bytes} [Sun Aug 7 01:10:27 2022] POST /compute/v2.1/os-aggregates/10/action => generated 243 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:10:28.385030 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-548a1d1b-990d-4888-887f-d7598867449a tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909b8165f015473c9977ef92aaf0741b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010ea68aed824d6bac970360d34ab747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:28.407591 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b0b83c5f-7a11-4762-a99c-be678d3a4475 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:28.414066 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:28.414066 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:28.433621 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-548a1d1b-990d-4888-887f-d7598867449a tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1" status: 200 len: 1319 microversion: 2.1 time: 1.003238 Aug 07 01:10:28.437027 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 148/262] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:27 2022] GET /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1 => generated 1319 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:10:28.439856 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b0b83c5f-7a11-4762-a99c-be678d3a4475 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:28.441188 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b0b83c5f-7a11-4762-a99c-be678d3a4475 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:28.442494 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b0b83c5f-7a11-4762-a99c-be678d3a4475 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:28.766199 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b0b83c5f-7a11-4762-a99c-be678d3a4475 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.378359 Aug 07 01:10:28.768273 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 115/263] 10.222.0.39 () {60 vars in 1194 bytes} [Sun Aug 7 01:10:28 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:28.797700 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-a605ea6d-061d-40d5-b03c-ffa0a778ba8c req-a5810899-17b6-46e8-ae9a-4d4b66dfae04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d21a372-3326-418d-9a1f-eb2a2720fca1", "tag": "f1bb27b1-13ea-4573-84fe-d5cfd64ac3a9"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:28.811198 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=5,nova_api:DELETE=8,nova_api:INSERT=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:28.819736 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6b3ff71e-db20-4035-983b-617950c6c7e3 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:28.823365 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:28.823365 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:10:28.835577 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a605ea6d-061d-40d5-b03c-ffa0a778ba8c req-a5810899-17b6-46e8-ae9a-4d4b66dfae04 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:28.838451 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a605ea6d-061d-40d5-b03c-ffa0a778ba8c req-a5810899-17b6-46e8-ae9a-4d4b66dfae04 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:28.839534 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a605ea6d-061d-40d5-b03c-ffa0a778ba8c req-a5810899-17b6-46e8-ae9a-4d4b66dfae04 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:28.887514 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6b3ff71e-db20-4035-983b-617950c6c7e3 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.102465 Aug 07 01:10:28.888438 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 149/264] 10.222.0.39 () {58 vars in 1155 bytes} [Sun Aug 7 01:10:28 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 07 01:10:28.898492 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-a605ea6d-061d-40d5-b03c-ffa0a778ba8c req-a5810899-17b6-46e8-ae9a-4d4b66dfae04 service nova] Creating event network-changed:f1bb27b1-13ea-4573-84fe-d5cfd64ac3a9 for instance 1d21a372-3326-418d-9a1f-eb2a2720fca1 on n-h1-master-1 Aug 07 01:10:28.913476 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-31dff0c6-0634-4b69-bffb-42be41ca6dab tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-49658990"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:28.920966 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:28.920966 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:10:28.921392 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-a605ea6d-061d-40d5-b03c-ffa0a778ba8c req-a5810899-17b6-46e8-ae9a-4d4b66dfae04 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133230 Aug 07 01:10:28.926196 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 116/265] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:10:28.934255 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.aggregate [None req-31dff0c6-0634-4b69-bffb-42be41ca6dab tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Generated uuid eef6201a-289c-4cca-996e-aa6460419955 for aggregate {{(pid=119516) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 07 01:10:28.946683 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2de0c968-0c16-40bf-a46b-547ad88ba35f tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-70484913"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:28.958151 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:28.958151 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:28.961361 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.aggregate [None req-2de0c968-0c16-40bf-a46b-547ad88ba35f tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Generated uuid 4a97555e-2c14-4e9f-83d5-be56f3db14ff for aggregate {{(pid=119517) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 07 01:10:28.999241 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-31dff0c6-0634-4b69-bffb-42be41ca6dab tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.095539 Aug 07 01:10:29.030525 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 150/266] 10.222.0.39 () {60 vars in 1164 bytes} [Sun Aug 7 01:10:28 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:29.043188 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2de0c968-0c16-40bf-a46b-547ad88ba35f tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.111084 Aug 07 01:10:29.044299 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 117/267] 10.222.0.39 () {60 vars in 1164 bytes} [Sun Aug 7 01:10:28 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:29.058003 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a320ca01-3c02-4ce1-b8e8-0c85bac7e765 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:29.060635 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:29.060635 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:10:29.063626 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-568402b6-fea1-45de-aaef-302a76300510 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:29.074318 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:29.074318 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:29.096879 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-568402b6-fea1-45de-aaef-302a76300510 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:29.097526 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-568402b6-fea1-45de-aaef-302a76300510 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:29.098077 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-568402b6-fea1-45de-aaef-302a76300510 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:29.121268 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a320ca01-3c02-4ce1-b8e8-0c85bac7e765 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.087667 Aug 07 01:10:29.122394 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 151/268] 10.222.0.39 () {58 vars in 1155 bytes} [Sun Aug 7 01:10:29 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 07 01:10:29.138817 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-232835d4-4e4e-4d95-ad84-8c9bb8a6f2e3 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:29.141468 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:29.141468 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:10:29.156949 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-232835d4-4e4e-4d95-ad84-8c9bb8a6f2e3 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Aug 07 01:10:29.162379 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-232835d4-4e4e-4d95-ad84-8c9bb8a6f2e3 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Request method failure captured: Aug 07 01:10:29.162379 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/os-aggregates/11 HTTP/1.1 Aug 07 01:10:29.162379 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:10:29.162379 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:10:29.162379 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:10:29.162379 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:10:29.162379 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:10:29.162379 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:10:29.162379 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:10:29.162379 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:29.162379 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xDG8GHxFXRPK7YfRJXdBhHMmsc-ayQpRZphlSpnqCHaiWs9rx4iit-uvd4wRWDoZ-jPBQFM_oxVnSI7ml56vPTR61Fy_qvY0yJwanooDZZCO3MzxXEJUTd4b2aJkBCRJWQwBDbfeljSHkdLZ-5--ylvvUmhALckFt6LqaXBbx0OFiM Aug 07 01:10:29.162379 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:10:29.162379 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:10:29.162379 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:10:29.162379 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:10:29.162379 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:10:29.162379 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:10:29.162379 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 5990c8b61fe5439fb2ae91810d353225 Aug 07 01:10:29.162379 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-AggregatesAdminTestJSON-1450509288 Aug 07 01:10:29.162379 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,admin,member Aug 07 01:10:29.162379 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,admin,member Aug 07 01:10:29.165756 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5990c8b61fe5439fb2ae91810d353225"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5990c8b61fe5439fb2ae91810d353225", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5990c8b61fe5439fb2ae91810d353225"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5990c8b61fe5439fb2ae91810d353225"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:29.165756 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-AggregatesAdminTestJSON-1450509288 Aug 07 01:10:29.165756 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 5990c8b61fe5439fb2ae91810d353225 Aug 07 01:10:29.165756 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1450509288 Aug 07 01:10:29.165756 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-AggregatesAdminTestJSON-1450509288-project-admin Aug 07 01:10:29.165756 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:10:29.165756 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:10:29.165756 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: e8b354f4536d40d3adedc0c10609d467 Aug 07 01:10:29.165756 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-AggregatesAdminTestJSON-1450509288-project-admin Aug 07 01:10:29.165756 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:10:29.165756 n-d-master-1 devstack@n-api.service[119516]: exception: Aggregate 11 could not be found. Aug 07 01:10:29.165756 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '11'} Aug 07 01:10:29.165756 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:29.167413 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:29.167413 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 07 01:10:29.167413 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 07 01:10:29.167413 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6417, in get_aggregate Aug 07 01:10:29.167413 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 07 01:10:29.167413 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:10:29.167413 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:10:29.167413 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 07 01:10:29.167413 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 07 01:10:29.167413 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 07 01:10:29.167413 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 07 01:10:29.167413 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 07 01:10:29.167413 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 07 01:10:29.167413 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Aug 07 01:10:29.167413 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:29.167413 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:29.167413 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:29.167413 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:29.167413 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:29.169468 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:29.169468 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:29.169468 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:29.169468 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:29.169468 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:29.169468 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 07 01:10:29.169468 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:10:29.169468 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Aug 07 01:10:29.169468 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:29.169468 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:29.169468 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:29.169468 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:29.169468 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:29.169468 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:29.169468 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:10:29.169468 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:10:29.169468 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Aug 07 01:10:29.169468 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:29.174505 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-232835d4-4e4e-4d95-ad84-8c9bb8a6f2e3 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:29.176550 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-232835d4-4e4e-4d95-ad84-8c9bb8a6f2e3 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.044960 Aug 07 01:10:29.183640 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 152/269] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Aug 7 01:10:29 2022] GET /compute/v2.1/os-aggregates/11 => generated 78 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:10:29.194333 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1e371b18-37cd-49f7-a2c8-8b0f8a1bb65f tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:29.196657 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:29.196657 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:10:29.222943 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-1e371b18-37cd-49f7-a2c8-8b0f8a1bb65f tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Aug 07 01:10:29.228680 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1e371b18-37cd-49f7-a2c8-8b0f8a1bb65f tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Request method failure captured: Aug 07 01:10:29.228680 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/os-aggregates/11 HTTP/1.1 Aug 07 01:10:29.228680 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:10:29.228680 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:10:29.228680 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:10:29.228680 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:10:29.228680 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:10:29.228680 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:10:29.228680 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:10:29.228680 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:29.228680 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xDG8GHxFXRPK7YfRJXdBhHMmsc-ayQpRZphlSpnqCHaiWs9rx4iit-uvd4wRWDoZ-jPBQFM_oxVnSI7ml56vPTR61Fy_qvY0yJwanooDZZCO3MzxXEJUTd4b2aJkBCRJWQwBDbfeljSHkdLZ-5--ylvvUmhALckFt6LqaXBbx0OFiM Aug 07 01:10:29.228680 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:10:29.228680 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:10:29.228680 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:10:29.228680 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:10:29.228680 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:10:29.228680 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:10:29.228680 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 5990c8b61fe5439fb2ae91810d353225 Aug 07 01:10:29.228680 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-AggregatesAdminTestJSON-1450509288 Aug 07 01:10:29.228680 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,admin,member Aug 07 01:10:29.228680 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,admin,member Aug 07 01:10:29.231442 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5990c8b61fe5439fb2ae91810d353225"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5990c8b61fe5439fb2ae91810d353225", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5990c8b61fe5439fb2ae91810d353225"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5990c8b61fe5439fb2ae91810d353225"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:29.231442 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-AggregatesAdminTestJSON-1450509288 Aug 07 01:10:29.231442 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 5990c8b61fe5439fb2ae91810d353225 Aug 07 01:10:29.231442 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1450509288 Aug 07 01:10:29.231442 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-AggregatesAdminTestJSON-1450509288-project-admin Aug 07 01:10:29.231442 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:10:29.231442 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:10:29.231442 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: e8b354f4536d40d3adedc0c10609d467 Aug 07 01:10:29.231442 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-AggregatesAdminTestJSON-1450509288-project-admin Aug 07 01:10:29.231442 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:10:29.231442 n-d-master-1 devstack@n-api.service[119516]: exception: Aggregate 11 could not be found. Aug 07 01:10:29.231442 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '11'} Aug 07 01:10:29.231442 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:29.233016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:29.233016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 07 01:10:29.233016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 07 01:10:29.233016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 07 01:10:29.233016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 07 01:10:29.233016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:10:29.233016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:10:29.233016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:10:29.233016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:10:29.233016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 07 01:10:29.233016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 07 01:10:29.233016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6470, in delete_aggregate Aug 07 01:10:29.233016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 07 01:10:29.233016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:10:29.233016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:10:29.233016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 07 01:10:29.233016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 07 01:10:29.233016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 07 01:10:29.233016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 07 01:10:29.236123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 07 01:10:29.236123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 07 01:10:29.236123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Aug 07 01:10:29.236123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:29.236123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:29.236123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:29.236123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:29.236123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:29.236123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:29.236123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:29.236123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:29.236123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:29.236123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:29.236123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 07 01:10:29.236123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:10:29.236123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Aug 07 01:10:29.236123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:29.236123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:29.236123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:29.236123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:29.236123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:29.244095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:29.244095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:10:29.244095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:10:29.244095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Aug 07 01:10:29.244095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:29.244095 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1e371b18-37cd-49f7-a2c8-8b0f8a1bb65f tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:29.244095 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1e371b18-37cd-49f7-a2c8-8b0f8a1bb65f tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.046725 Aug 07 01:10:29.250071 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 153/270] 10.222.0.39 () {58 vars in 1155 bytes} [Sun Aug 7 01:10:29 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 78 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:10:29.261830 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b5e78dd8-fbf1-4c8e-a6e1-c6f3f57f78b0 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-613827580", "name": "tempest-test_aggregate-540608206"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:29.267181 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:29.267181 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:10:29.270395 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.aggregate [None req-b5e78dd8-fbf1-4c8e-a6e1-c6f3f57f78b0 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Generated uuid 0954ff27-1bdb-4a72-8f9e-850ea7154d77 for aggregate {{(pid=119516) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 07 01:10:29.343695 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b5e78dd8-fbf1-4c8e-a6e1-c6f3f57f78b0 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.089581 Aug 07 01:10:29.359447 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 154/271] 10.222.0.39 () {60 vars in 1165 bytes} [Sun Aug 7 01:10:29 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:29.369970 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1a02d1a5-33d3-4f2b-97a7-56b353b5910f tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:29.371574 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:29.371574 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:10:29.373197 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-568402b6-fea1-45de-aaef-302a76300510 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 241 microversion: 2.1 time: 0.314384 Aug 07 01:10:29.375948 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 118/272] 10.222.0.39 () {60 vars in 1194 bytes} [Sun Aug 7 01:10:29 2022] POST /compute/v2.1/os-aggregates/12/action => generated 241 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:10:29.398345 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-215d1043-9168-4ca2-8927-8aef3d9d6044 tempest-AggregatesAdminNegativeTestJSON-519114725 tempest-AggregatesAdminNegativeTestJSON-519114725-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:29.403964 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:29.403964 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:29.406986 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-215d1043-9168-4ca2-8927-8aef3d9d6044 tempest-AggregatesAdminNegativeTestJSON-519114725 tempest-AggregatesAdminNegativeTestJSON-519114725-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '60d4f703c4d6468e853b2a27d64df026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e2243d5a54a9d94e8452fe43680c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:29.412355 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-215d1043-9168-4ca2-8927-8aef3d9d6044 tempest-AggregatesAdminNegativeTestJSON-519114725 tempest-AggregatesAdminNegativeTestJSON-519114725-project] Request method failure captured: Aug 07 01:10:29.412355 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Aug 07 01:10:29.412355 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:10:29.412355 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:10:29.412355 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:10:29.412355 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 42 Aug 07 01:10:29.412355 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:10:29.412355 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:10:29.412355 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:10:29.412355 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:29.412355 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xDCF2oIkE0dKXHC8LC9F2vrw1NTw8uU8jf7G7GkahkDO96Sn7drWmOKYoa3JN4msYUOM2XKl1lx-sVVYtZ31Segcq85iuyK0x05ZIMM04GB04NGeSRniHQurTJ-NsEYHLgCzzH5OvOJL0IQh5xIZnIGc-x4-dN_qavJYW7NiP6gXnE Aug 07 01:10:29.412355 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:10:29.412355 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:10:29.412355 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:10:29.412355 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:10:29.412355 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:10:29.412355 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:10:29.412355 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 248e2243d5a54a9d94e8452fe43680c8 Aug 07 01:10:29.412355 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-519114725 Aug 07 01:10:29.412355 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:10:29.412355 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:10:29.415381 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/248e2243d5a54a9d94e8452fe43680c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_248e2243d5a54a9d94e8452fe43680c8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/248e2243d5a54a9d94e8452fe43680c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/248e2243d5a54a9d94e8452fe43680c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:29.415381 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-519114725 Aug 07 01:10:29.415381 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 248e2243d5a54a9d94e8452fe43680c8 Aug 07 01:10:29.415381 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-519114725 Aug 07 01:10:29.415381 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-AggregatesAdminNegativeTestJSON-519114725-project Aug 07 01:10:29.415381 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:10:29.415381 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:10:29.415381 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 60d4f703c4d6468e853b2a27d64df026 Aug 07 01:10:29.415381 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-519114725-project Aug 07 01:10:29.415381 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:10:29.415381 n-d-master-1 devstack@n-api.service[119517]: {"remove_host": {"host": "n-h2-master-1"}} Aug 07 01:10:29.415381 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:10:29.415381 n-d-master-1 devstack@n-api.service[119517]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 07 01:10:29.417326 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '12', 'body': {'remove_host': {'host': 'n-h2-master-1'}}} Aug 07 01:10:29.417326 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:29.417326 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:29.417326 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:29.417326 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:29.417326 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:29.417326 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:29.417326 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:29.417326 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:29.417326 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:10:29.417326 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:10:29.417326 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 07 01:10:29.417326 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 07 01:10:29.417326 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 07 01:10:29.417326 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 07 01:10:29.417326 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 07 01:10:29.417326 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 07 01:10:29.417326 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:10:29.417326 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:10:29.420872 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:10:29.420872 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:10:29.420872 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 07 01:10:29.420872 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 07 01:10:29.420872 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 07 01:10:29.420872 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 07 01:10:29.420872 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 07 01:10:29.420872 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 07 01:10:29.420872 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 07 01:10:29.420872 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:29.420872 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:29.420872 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:29.420872 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:29.420872 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:29.420872 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:29.420872 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 07 01:10:29.420872 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 07 01:10:29.420872 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 07 01:10:29.420872 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:29.432444 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-215d1043-9168-4ca2-8927-8aef3d9d6044 tempest-AggregatesAdminNegativeTestJSON-519114725 tempest-AggregatesAdminNegativeTestJSON-519114725-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:29.432634 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1a02d1a5-33d3-4f2b-97a7-56b353b5910f tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.065490 Aug 07 01:10:29.432634 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 155/273] 10.222.0.39 () {58 vars in 1155 bytes} [Sun Aug 7 01:10:29 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 07 01:10:29.433812 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-215d1043-9168-4ca2-8927-8aef3d9d6044 tempest-AggregatesAdminNegativeTestJSON-519114725 tempest-AggregatesAdminNegativeTestJSON-519114725-project] 10.222.0.39 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 121 microversion: 2.1 time: 0.038618 Aug 07 01:10:29.440766 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 119/274] 10.222.0.39 () {60 vars in 1194 bytes} [Sun Aug 7 01:10:29 2022] POST /compute/v2.1/os-aggregates/12/action => generated 121 bytes in 52 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:10:29.445074 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-abd47002-9a27-4f5e-bd05-3fa53d488040 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:29.446807 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:29.446807 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:10:29.453435 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-251820ce-77e5-4481-8e00-9123634570be tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:29.469632 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-abd47002-9a27-4f5e-bd05-3fa53d488040 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Aug 07 01:10:29.472352 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-abd47002-9a27-4f5e-bd05-3fa53d488040 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Request method failure captured: Aug 07 01:10:29.472352 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/os-aggregates/13 HTTP/1.1 Aug 07 01:10:29.472352 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:10:29.472352 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:10:29.472352 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:10:29.472352 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:10:29.472352 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:10:29.472352 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:10:29.472352 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:10:29.472352 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:29.472352 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xDG8GHxFXRPK7YfRJXdBhHMmsc-ayQpRZphlSpnqCHaiWs9rx4iit-uvd4wRWDoZ-jPBQFM_oxVnSI7ml56vPTR61Fy_qvY0yJwanooDZZCO3MzxXEJUTd4b2aJkBCRJWQwBDbfeljSHkdLZ-5--ylvvUmhALckFt6LqaXBbx0OFiM Aug 07 01:10:29.472352 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:10:29.472352 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:10:29.472352 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:10:29.472352 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:10:29.472352 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:10:29.472352 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:10:29.472352 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 5990c8b61fe5439fb2ae91810d353225 Aug 07 01:10:29.472352 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-AggregatesAdminTestJSON-1450509288 Aug 07 01:10:29.472352 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,admin,member Aug 07 01:10:29.472352 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,admin,member Aug 07 01:10:29.474136 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5990c8b61fe5439fb2ae91810d353225"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5990c8b61fe5439fb2ae91810d353225", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5990c8b61fe5439fb2ae91810d353225"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5990c8b61fe5439fb2ae91810d353225"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:29.474136 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-AggregatesAdminTestJSON-1450509288 Aug 07 01:10:29.474136 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 5990c8b61fe5439fb2ae91810d353225 Aug 07 01:10:29.474136 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1450509288 Aug 07 01:10:29.474136 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-AggregatesAdminTestJSON-1450509288-project-admin Aug 07 01:10:29.474136 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:10:29.474136 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:10:29.474136 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: e8b354f4536d40d3adedc0c10609d467 Aug 07 01:10:29.474136 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-AggregatesAdminTestJSON-1450509288-project-admin Aug 07 01:10:29.474136 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:10:29.474136 n-d-master-1 devstack@n-api.service[119516]: exception: Aggregate 13 could not be found. Aug 07 01:10:29.474136 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '13'} Aug 07 01:10:29.474136 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:29.475058 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:29.475058 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 07 01:10:29.475058 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 07 01:10:29.475058 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6417, in get_aggregate Aug 07 01:10:29.475058 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 07 01:10:29.475058 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:10:29.475058 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:10:29.475058 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 07 01:10:29.475058 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 07 01:10:29.475058 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 07 01:10:29.475058 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 07 01:10:29.475058 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 07 01:10:29.475058 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 07 01:10:29.475058 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Aug 07 01:10:29.475058 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:29.475058 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:29.475058 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:29.475058 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:29.475058 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:29.476406 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:29.476406 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:29.476406 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:29.476406 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:29.476406 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:29.476406 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 07 01:10:29.476406 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:10:29.476406 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Aug 07 01:10:29.476406 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:29.476406 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:29.476406 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:29.476406 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:29.476406 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:29.476406 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:29.476406 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:10:29.476406 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:10:29.476406 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Aug 07 01:10:29.476406 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:29.479620 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-abd47002-9a27-4f5e-bd05-3fa53d488040 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:29.481648 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-abd47002-9a27-4f5e-bd05-3fa53d488040 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.046287 Aug 07 01:10:29.482910 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 156/275] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Aug 7 01:10:29 2022] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:10:29.488890 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-251820ce-77e5-4481-8e00-9123634570be tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:29.489944 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-251820ce-77e5-4481-8e00-9123634570be tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:29.490847 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-251820ce-77e5-4481-8e00-9123634570be tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:29.495754 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a3176f31-d747-44d9-aded-d276be1d873d tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:29.496966 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a3176f31-d747-44d9-aded-d276be1d873d tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: 1d21a372-3326-418d-9a1f-eb2a2720fca1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:29.506394 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=8,nova_api:INSERT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:29.509633 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3176f31-d747-44d9-aded-d276be1d873d tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:29.512418 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3176f31-d747-44d9-aded-d276be1d873d tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:29.513466 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3176f31-d747-44d9-aded-d276be1d873d tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:29.514627 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3176f31-d747-44d9-aded-d276be1d873d tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:29.517212 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3176f31-d747-44d9-aded-d276be1d873d tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:29.518104 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3176f31-d747-44d9-aded-d276be1d873d tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:29.527737 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:29.736057 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-251820ce-77e5-4481-8e00-9123634570be tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 226 microversion: 2.1 time: 0.293087 Aug 07 01:10:29.746053 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 120/276] 10.222.0.39 () {60 vars in 1194 bytes} [Sun Aug 7 01:10:29 2022] POST /compute/v2.1/os-aggregates/12/action => generated 226 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:29.756479 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-48ec42b5-f0dd-41bd-837e-af34b8cee462 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:29.758827 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:29.758827 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:29.785934 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-48ec42b5-f0dd-41bd-837e-af34b8cee462 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Aug 07 01:10:29.789927 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-48ec42b5-f0dd-41bd-837e-af34b8cee462 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Request method failure captured: Aug 07 01:10:29.789927 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/os-aggregates/13 HTTP/1.1 Aug 07 01:10:29.789927 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:10:29.789927 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:10:29.789927 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:10:29.789927 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:10:29.789927 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:10:29.789927 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:10:29.789927 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:10:29.789927 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:29.789927 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xDG8GHxFXRPK7YfRJXdBhHMmsc-ayQpRZphlSpnqCHaiWs9rx4iit-uvd4wRWDoZ-jPBQFM_oxVnSI7ml56vPTR61Fy_qvY0yJwanooDZZCO3MzxXEJUTd4b2aJkBCRJWQwBDbfeljSHkdLZ-5--ylvvUmhALckFt6LqaXBbx0OFiM Aug 07 01:10:29.789927 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:10:29.789927 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:10:29.789927 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:10:29.789927 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:10:29.789927 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:10:29.789927 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:10:29.789927 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 5990c8b61fe5439fb2ae91810d353225 Aug 07 01:10:29.789927 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-AggregatesAdminTestJSON-1450509288 Aug 07 01:10:29.789927 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,admin,member Aug 07 01:10:29.789927 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,admin,member Aug 07 01:10:29.792608 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5990c8b61fe5439fb2ae91810d353225"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5990c8b61fe5439fb2ae91810d353225", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5990c8b61fe5439fb2ae91810d353225"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5990c8b61fe5439fb2ae91810d353225"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:29.792608 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-AggregatesAdminTestJSON-1450509288 Aug 07 01:10:29.792608 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 5990c8b61fe5439fb2ae91810d353225 Aug 07 01:10:29.792608 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1450509288 Aug 07 01:10:29.792608 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-AggregatesAdminTestJSON-1450509288-project-admin Aug 07 01:10:29.792608 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:10:29.792608 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:10:29.792608 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: e8b354f4536d40d3adedc0c10609d467 Aug 07 01:10:29.792608 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-AggregatesAdminTestJSON-1450509288-project-admin Aug 07 01:10:29.792608 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:10:29.792608 n-d-master-1 devstack@n-api.service[119517]: exception: Aggregate 13 could not be found. Aug 07 01:10:29.792608 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '13'} Aug 07 01:10:29.792608 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:29.805154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:29.805154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 07 01:10:29.805154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 07 01:10:29.805154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 07 01:10:29.805154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 07 01:10:29.805154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:10:29.805154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:10:29.805154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:10:29.805154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:10:29.805154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 07 01:10:29.805154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 07 01:10:29.805154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6470, in delete_aggregate Aug 07 01:10:29.805154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 07 01:10:29.805154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:10:29.805154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:10:29.805154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 07 01:10:29.805154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 07 01:10:29.805154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 07 01:10:29.805154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 07 01:10:29.808117 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 07 01:10:29.808117 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 07 01:10:29.808117 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Aug 07 01:10:29.808117 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:29.808117 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:29.808117 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:29.808117 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:29.808117 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:29.808117 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:29.808117 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:29.808117 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:29.808117 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:29.808117 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:29.808117 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 07 01:10:29.808117 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:10:29.808117 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Aug 07 01:10:29.808117 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:29.808117 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:29.808117 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:29.808117 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:29.808117 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:29.813974 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:29.813974 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:10:29.813974 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:10:29.813974 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Aug 07 01:10:29.813974 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:29.813974 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-48ec42b5-f0dd-41bd-837e-af34b8cee462 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:29.813974 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-48ec42b5-f0dd-41bd-837e-af34b8cee462 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.043536 Aug 07 01:10:29.813974 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 121/277] 10.222.0.39 () {58 vars in 1155 bytes} [Sun Aug 7 01:10:29 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:10:29.813974 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b9cf046d-4b91-4421-970d-172e78d3bec5 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:29.852778 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b9cf046d-4b91-4421-970d-172e78d3bec5 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.057525 Aug 07 01:10:29.854075 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 122/278] 10.222.0.39 () {58 vars in 1155 bytes} [Sun Aug 7 01:10:29 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 07 01:10:29.874842 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ce4df7a5-a6b5-4bcd-a8a8-94700637d9d8 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-64692668"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:29.887276 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:29.887276 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:29.891609 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.aggregate [None req-ce4df7a5-a6b5-4bcd-a8a8-94700637d9d8 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Generated uuid f52e8e39-69d0-4699-be7b-0e930d6c4387 for aggregate {{(pid=119517) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 07 01:10:29.933676 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=8 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:29.981757 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ce4df7a5-a6b5-4bcd-a8a8-94700637d9d8 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.125391 Aug 07 01:10:29.987764 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 123/279] 10.222.0.39 () {60 vars in 1164 bytes} [Sun Aug 7 01:10:29 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:29.997710 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-92b24f16-c4ec-4bc5-9488-ca10dee8d21a tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1541747257"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:30.005215 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:30.005215 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:30.007281 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.aggregate [None req-92b24f16-c4ec-4bc5-9488-ca10dee8d21a tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Generated uuid 7c4a9bca-db86-41a1-bae3-3f9d3df1eba0 for aggregate {{(pid=119517) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 07 01:10:30.059668 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-92b24f16-c4ec-4bc5-9488-ca10dee8d21a tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.069762 Aug 07 01:10:30.061285 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 124/280] 10.222.0.39 () {60 vars in 1164 bytes} [Sun Aug 7 01:10:29 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:30.068703 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a3176f31-d747-44d9-aded-d276be1d873d tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909b8165f015473c9977ef92aaf0741b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010ea68aed824d6bac970360d34ab747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:30.071485 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f7f2e268-4cdf-4ffa-a1d4-6143ba5f8fb5 tempest-AggregatesAdminTestV241-307471853 tempest-AggregatesAdminTestV241-307471853-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-503874775"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:30.077243 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:30.077243 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:30.079000 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.aggregate [None req-f7f2e268-4cdf-4ffa-a1d4-6143ba5f8fb5 tempest-AggregatesAdminTestV241-307471853 tempest-AggregatesAdminTestV241-307471853-project-admin] Generated uuid 3efa1dcd-d068-4abd-a2c5-d92344a4191f for aggregate {{(pid=119517) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 07 01:10:30.087083 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a3176f31-d747-44d9-aded-d276be1d873d tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1" status: 200 len: 1319 microversion: 2.1 time: 0.600548 Aug 07 01:10:30.089379 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 157/281] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:29 2022] GET /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1 => generated 1319 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:30.126786 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f7f2e268-4cdf-4ffa-a1d4-6143ba5f8fb5 tempest-AggregatesAdminTestV241-307471853 tempest-AggregatesAdminTestV241-307471853-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.063383 Aug 07 01:10:30.128660 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 125/282] 10.222.0.39 () {62 vars in 1205 bytes} [Sun Aug 7 01:10:30 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:10:30.130692 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0d25ef77-adcc-4c34-9c1e-8e35c26f76d5 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:30.138147 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:30.138147 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:10:30.153946 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3ef6c6cd-1b45-4051-a313-0f1b3b820185 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:30.162560 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:30.162560 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:30.170799 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0d25ef77-adcc-4c34-9c1e-8e35c26f76d5 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 226 microversion: 2.1 time: 0.066888 Aug 07 01:10:30.175666 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 158/283] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Aug 7 01:10:30 2022] GET /compute/v2.1/os-aggregates/14 => generated 226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:30.202730 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ef6c6cd-1b45-4051-a313-0f1b3b820185 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:30.204410 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ef6c6cd-1b45-4051-a313-0f1b3b820185 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:30.205714 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ef6c6cd-1b45-4051-a313-0f1b3b820185 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:30.210575 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-820a2fba-b172-4c11-8cbc-58bb7b8ff200 tempest-AggregatesAdminTestV241-307471853 tempest-AggregatesAdminTestV241-307471853-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1936119042"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:30.222822 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ef6c6cd-1b45-4051-a313-0f1b3b820185 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:30.224315 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ef6c6cd-1b45-4051-a313-0f1b3b820185 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:30.225795 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ef6c6cd-1b45-4051-a313-0f1b3b820185 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:30.245267 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.compute.aggregates [None req-3ef6c6cd-1b45-4051-a313-0f1b3b820185 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Failed to remove host nonexist_host from aggregate 15. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 07 01:10:30.248169 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-3ef6c6cd-1b45-4051-a313-0f1b3b820185 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 15 Aug 07 01:10:30.252934 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3ef6c6cd-1b45-4051-a313-0f1b3b820185 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Request method failure captured: Aug 07 01:10:30.252934 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Aug 07 01:10:30.252934 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:10:30.252934 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:10:30.252934 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:10:30.252934 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 42 Aug 07 01:10:30.252934 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:10:30.252934 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:10:30.252934 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:10:30.252934 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:30.252934 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xDGUZ9RmTbqVfLxECOboo71CWMacBANAin_k2Tk3x3trxWuxylgw0uAn9i777Wm834ATlBkxDkgh8NRkqKsVvKxzV58qc5rV87jpI7xsTCrig69NZ8KuGw7Wy5BPQKSTg6Zi0lQlPGdVBG55TSjF6PxOj6A_Ludtfx-OEOB4lam0XQ Aug 07 01:10:30.252934 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:10:30.252934 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:10:30.252934 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:10:30.252934 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:10:30.252934 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:10:30.252934 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:10:30.252934 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 60b8430a79264d20b633391ab7bc6790 Aug 07 01:10:30.252934 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-957597285 Aug 07 01:10:30.252934 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,admin,member Aug 07 01:10:30.252934 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,admin,member Aug 07 01:10:30.255297 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/60b8430a79264d20b633391ab7bc6790"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_60b8430a79264d20b633391ab7bc6790", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/60b8430a79264d20b633391ab7bc6790"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/60b8430a79264d20b633391ab7bc6790"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:30.255297 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-957597285 Aug 07 01:10:30.255297 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 60b8430a79264d20b633391ab7bc6790 Aug 07 01:10:30.255297 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-957597285 Aug 07 01:10:30.255297 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin Aug 07 01:10:30.255297 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:10:30.255297 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:10:30.255297 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: c7f69d5acc5547dba7f05bd2ea205e71 Aug 07 01:10:30.255297 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin Aug 07 01:10:30.255297 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:10:30.255297 n-d-master-1 devstack@n-api.service[119517]: {"remove_host": {"host": "nonexist_host"}} Aug 07 01:10:30.255297 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:10:30.255297 n-d-master-1 devstack@n-api.service[119517]: exception: Cannot remove host nonexist_host in aggregate 15 Aug 07 01:10:30.257257 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 07 01:10:30.257257 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:30.257257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:30.257257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5949, in _get_service_in_cell_by_host Aug 07 01:10:30.257257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 07 01:10:30.257257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:10:30.257257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:10:30.257257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 07 01:10:30.257257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 07 01:10:30.257257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 07 01:10:30.257257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 07 01:10:30.257257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 07 01:10:30.257257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 07 01:10:30.257257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 07 01:10:30.257257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:30.257257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:30.257257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:30.257257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:30.257257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5955, in _get_service_in_cell_by_host Aug 07 01:10:30.257257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 07 01:10:30.262489 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 07 01:10:30.262489 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 07 01:10:30.262489 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 07 01:10:30.262489 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:30.262489 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:30.262489 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:30.262489 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:30.262489 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 07 01:10:30.262489 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 07 01:10:30.262489 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 07 01:10:30.262489 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 07 01:10:30.262489 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:10:30.262489 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:10:30.262489 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:10:30.262489 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:10:30.262489 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 07 01:10:30.262489 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 07 01:10:30.262489 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6636, in remove_host_from_aggregate Aug 07 01:10:30.262489 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 07 01:10:30.262489 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5957, in _get_service_in_cell_by_host Aug 07 01:10:30.278097 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 07 01:10:30.278097 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 07 01:10:30.278097 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:30.278097 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:30.278097 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:30.278097 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:30.278097 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:30.278097 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:30.278097 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:30.278097 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:30.278097 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:30.278097 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:30.278097 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:10:30.278097 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:10:30.278097 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 07 01:10:30.278097 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 07 01:10:30.278097 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 15 Aug 07 01:10:30.278097 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:30.278097 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:30.278097 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:30.278097 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:30.282572 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:30.282572 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:30.282572 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:10:30.282572 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:10:30.282572 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 15 Aug 07 01:10:30.282572 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:30.282572 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3ef6c6cd-1b45-4051-a313-0f1b3b820185 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 15 {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:30.282572 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3ef6c6cd-1b45-4051-a313-0f1b3b820185 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/15/action" status: 404 len: 94 microversion: 2.1 time: 0.133092 Aug 07 01:10:30.282572 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 126/284] 10.222.0.39 () {60 vars in 1194 bytes} [Sun Aug 7 01:10:30 2022] POST /compute/v2.1/os-aggregates/15/action => generated 94 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:10:30.292651 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-dee7e657-8595-4a6d-88fa-c36952a39952 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:30.297563 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:30.297563 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:30.376916 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-dee7e657-8595-4a6d-88fa-c36952a39952 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/14/action" status: 200 len: 264 microversion: 2.1 time: 0.099168 Aug 07 01:10:30.377852 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 127/285] 10.222.0.39 () {60 vars in 1194 bytes} [Sun Aug 7 01:10:30 2022] POST /compute/v2.1/os-aggregates/14/action => generated 264 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:30.391810 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a73476b6-dbfd-4a66-bb9f-f2b59e117fc4 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:30.395158 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:30.395158 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:30.397775 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:30.397775 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:10:30.472036 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a73476b6-dbfd-4a66-bb9f-f2b59e117fc4 tempest-AggregatesAdminNegativeTestJSON-957597285 tempest-AggregatesAdminNegativeTestJSON-957597285-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.092518 Aug 07 01:10:30.489188 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 128/286] 10.222.0.39 () {58 vars in 1155 bytes} [Sun Aug 7 01:10:30 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 07 01:10:30.502983 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-91679f44-de52-43c5-bf71-9fd2331cc88f tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:30.509413 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:30.509413 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:30.529341 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-820a2fba-b172-4c11-8cbc-58bb7b8ff200 tempest-AggregatesAdminTestV241-307471853 tempest-AggregatesAdminTestV241-307471853-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-aggregates/16" status: 200 len: 300 microversion: 2.41 time: 0.351854 Aug 07 01:10:30.536189 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 159/287] 10.222.0.39 () {62 vars in 1213 bytes} [Sun Aug 7 01:10:30 2022] PUT /compute/v2.1/os-aggregates/16 => generated 300 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:10:30.551500 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-91679f44-de52-43c5-bf71-9fd2331cc88f tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 240 microversion: 2.1 time: 0.060937 Aug 07 01:10:30.558886 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a59b2729-9f3e-4d57-80f1-e2026da02935 tempest-AggregatesAdminTestV241-307471853 tempest-AggregatesAdminTestV241-307471853-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:30.563706 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 129/288] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Aug 7 01:10:30 2022] GET /compute/v2.1/os-aggregates/14 => generated 240 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:30.564112 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:30.564112 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:10:30.593440 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-44e94a11-0661-4dd4-9ea6-b77f2fd5026f tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:30.597850 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:30.597850 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:30.617017 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a59b2729-9f3e-4d57-80f1-e2026da02935 tempest-AggregatesAdminTestV241-307471853 tempest-AggregatesAdminTestV241-307471853-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 300 microversion: 2.41 time: 0.063372 Aug 07 01:10:30.617639 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 160/289] 10.222.0.39 () {60 vars in 1193 bytes} [Sun Aug 7 01:10:30 2022] GET /compute/v2.1/os-aggregates/16 => generated 300 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 01:10:30.642623 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-faef85f7-8c82-4874-a952-92137b7d261b tempest-AggregatesAdminTestV241-307471853 tempest-AggregatesAdminTestV241-307471853-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:30.660860 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:30.660860 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:10:30.709953 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-faef85f7-8c82-4874-a952-92137b7d261b tempest-AggregatesAdminTestV241-307471853 tempest-AggregatesAdminTestV241-307471853-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:30.710753 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-44e94a11-0661-4dd4-9ea6-b77f2fd5026f tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.128126 Aug 07 01:10:30.711511 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 130/290] 10.222.0.39 () {58 vars in 1155 bytes} [Sun Aug 7 01:10:30 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 07 01:10:30.712539 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-faef85f7-8c82-4874-a952-92137b7d261b tempest-AggregatesAdminTestV241-307471853 tempest-AggregatesAdminTestV241-307471853-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:30.713208 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-faef85f7-8c82-4874-a952-92137b7d261b tempest-AggregatesAdminTestV241-307471853 tempest-AggregatesAdminTestV241-307471853-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:30.736366 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d3028469-f140-47ce-85f5-5a76bb85b079 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1769901032", "availability_zone": "tempest-test_az-981808568"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:30.816784 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:30.816784 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:30.823215 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.aggregate [None req-d3028469-f140-47ce-85f5-5a76bb85b079 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Generated uuid da0a8e55-c7fa-4ca0-bf5c-8af306e532a4 for aggregate {{(pid=119517) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 07 01:10:30.882640 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=18 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:30.947650 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d3028469-f140-47ce-85f5-5a76bb85b079 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.222471 Aug 07 01:10:30.952660 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 131/291] 10.222.0.39 () {60 vars in 1165 bytes} [Sun Aug 7 01:10:30 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:10:30.989795 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-100322b4-4ac8-4018-9ec5-800603ab166d tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1769901032_new", "availability_zone": "tempest-test_az-981808568_new"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:31.117250 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:31.117250 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:31.131725 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-faef85f7-8c82-4874-a952-92137b7d261b tempest-AggregatesAdminTestV241-307471853 tempest-AggregatesAdminTestV241-307471853-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 315 microversion: 2.41 time: 0.494747 Aug 07 01:10:31.134033 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 161/292] 10.222.0.39 () {62 vars in 1235 bytes} [Sun Aug 7 01:10:30 2022] POST /compute/v2.1/os-aggregates/16/action => generated 315 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:10:31.147618 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2f5e76a9-e897-4fca-ab64-d4b42227e939 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:31.152499 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2f5e76a9-e897-4fca-ab64-d4b42227e939 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: 1d21a372-3326-418d-9a1f-eb2a2720fca1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:31.172607 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f5e76a9-e897-4fca-ab64-d4b42227e939 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:31.177972 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f5e76a9-e897-4fca-ab64-d4b42227e939 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:31.179058 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f5e76a9-e897-4fca-ab64-d4b42227e939 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:31.180512 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f5e76a9-e897-4fca-ab64-d4b42227e939 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:31.184755 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f5e76a9-e897-4fca-ab64-d4b42227e939 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:31.185798 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f5e76a9-e897-4fca-ab64-d4b42227e939 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:31.253979 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-100322b4-4ac8-4018-9ec5-800603ab166d tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:31.257487 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-100322b4-4ac8-4018-9ec5-800603ab166d tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:31.259920 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-100322b4-4ac8-4018-9ec5-800603ab166d tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:31.383844 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-100322b4-4ac8-4018-9ec5-800603ab166d tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 335 microversion: 2.1 time: 0.396588 Aug 07 01:10:31.389350 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 132/293] 10.222.0.39 () {60 vars in 1173 bytes} [Sun Aug 7 01:10:30 2022] PUT /compute/v2.1/os-aggregates/17 => generated 335 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:31.397668 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6e57c364-b49b-4357-9fea-eba96d7a75d8 tempest-AggregatesAdminTestV241-307471853 tempest-AggregatesAdminTestV241-307471853-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:31.401510 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:31.401510 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:31.415360 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6e57c364-b49b-4357-9fea-eba96d7a75d8 tempest-AggregatesAdminTestV241-307471853 tempest-AggregatesAdminTestV241-307471853-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:31.416650 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6e57c364-b49b-4357-9fea-eba96d7a75d8 tempest-AggregatesAdminTestV241-307471853 tempest-AggregatesAdminTestV241-307471853-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:31.417675 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6e57c364-b49b-4357-9fea-eba96d7a75d8 tempest-AggregatesAdminTestV241-307471853 tempest-AggregatesAdminTestV241-307471853-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:31.838060 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6e57c364-b49b-4357-9fea-eba96d7a75d8 tempest-AggregatesAdminTestV241-307471853 tempest-AggregatesAdminTestV241-307471853-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 300 microversion: 2.41 time: 0.439896 Aug 07 01:10:31.842231 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 133/294] 10.222.0.39 () {62 vars in 1235 bytes} [Sun Aug 7 01:10:31 2022] POST /compute/v2.1/os-aggregates/16/action => generated 300 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:10:31.862345 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-46932977-4b88-4254-923c-cf3f8b19d80b tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:31.869408 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:31.869408 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:31.925424 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-46932977-4b88-4254-923c-cf3f8b19d80b tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates" status: 200 len: 577 microversion: 2.1 time: 0.081044 Aug 07 01:10:31.927328 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 134/295] 10.222.0.39 () {58 vars in 1143 bytes} [Sun Aug 7 01:10:31 2022] GET /compute/v2.1/os-aggregates => generated 577 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:31.955268 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3a468519-7400-4b79-9d8d-799f2fb3fa93 tempest-AggregatesAdminTestV241-307471853 tempest-AggregatesAdminTestV241-307471853-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:31.957397 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:31.957397 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:32.068552 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3a468519-7400-4b79-9d8d-799f2fb3fa93 tempest-AggregatesAdminTestV241-307471853 tempest-AggregatesAdminTestV241-307471853-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.41 time: 0.136529 Aug 07 01:10:32.072734 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 135/296] 10.222.0.39 () {60 vars in 1196 bytes} [Sun Aug 7 01:10:31 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:32.104134 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8c2eabd9-f511-443d-9ccb-0c990dcc2dfb tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:32.106003 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:32.106003 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:32.213625 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8c2eabd9-f511-443d-9ccb-0c990dcc2dfb tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.135710 Aug 07 01:10:32.214493 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 136/297] 10.222.0.39 () {58 vars in 1155 bytes} [Sun Aug 7 01:10:32 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 07 01:10:32.235051 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b8972f4e-388e-45d1-808c-c7c185ca1bda tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2041905206"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:32.243263 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:32.243263 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:32.244514 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.aggregate [None req-b8972f4e-388e-45d1-808c-c7c185ca1bda tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Generated uuid 87b90336-4dae-4eb8-83bc-ff9000e1022f for aggregate {{(pid=119517) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 07 01:10:32.251699 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2f5e76a9-e897-4fca-ab64-d4b42227e939 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909b8165f015473c9977ef92aaf0741b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010ea68aed824d6bac970360d34ab747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:32.279842 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2f5e76a9-e897-4fca-ab64-d4b42227e939 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1" status: 200 len: 1319 microversion: 2.1 time: 1.141986 Aug 07 01:10:32.285792 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=8,nova_api:DELETE=12,nova_api:UPDATE=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:32.289048 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 162/298] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:31 2022] GET /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1 => generated 1319 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:32.329912 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b8972f4e-388e-45d1-808c-c7c185ca1bda tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.106425 Aug 07 01:10:32.337769 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 137/299] 10.222.0.39 () {60 vars in 1164 bytes} [Sun Aug 7 01:10:32 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:32.346246 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e745d217-cc42-4995-b15f-1236a4df5597 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:32.347666 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:32.347666 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:10:32.361755 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e745d217-cc42-4995-b15f-1236a4df5597 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.021094 Aug 07 01:10:32.370981 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 163/300] 10.222.0.39 () {58 vars in 1143 bytes} [Sun Aug 7 01:10:32 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:32.380358 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-12e6eddf-534f-4ead-b625-e241c8e8ee94 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:32.381975 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:32.381975 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:32.454641 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-12e6eddf-534f-4ead-b625-e241c8e8ee94 tempest-AggregatesAdminTestJSON-1450509288 tempest-AggregatesAdminTestJSON-1450509288-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.079734 Aug 07 01:10:32.456173 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 138/301] 10.222.0.39 () {58 vars in 1155 bytes} [Sun Aug 7 01:10:32 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 07 01:10:32.468582 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5e5bb81c-b68c-40c5-bf70-2f054c355d93 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:32.469102 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5e5bb81c-b68c-40c5-bf70-2f054c355d93 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] [instance: 7028fed0-c1db-491a-b46f-345ead213c7a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:32.488691 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e5bb81c-b68c-40c5-bf70-2f054c355d93 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:32.489213 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e5bb81c-b68c-40c5-bf70-2f054c355d93 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:32.489666 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e5bb81c-b68c-40c5-bf70-2f054c355d93 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:32.490438 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e5bb81c-b68c-40c5-bf70-2f054c355d93 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:32.497876 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e5bb81c-b68c-40c5-bf70-2f054c355d93 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:32.498732 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e5bb81c-b68c-40c5-bf70-2f054c355d93 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:32.574528 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-5e5bb81c-b68c-40c5-bf70-2f054c355d93 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] HTTP exception thrown: Instance 7028fed0-c1db-491a-b46f-345ead213c7a could not be found. Aug 07 01:10:32.581961 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5e5bb81c-b68c-40c5-bf70-2f054c355d93 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Request method failure captured: Aug 07 01:10:32.581961 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a HTTP/1.1 Aug 07 01:10:32.581961 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:10:32.581961 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:10:32.581961 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:10:32.581961 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:10:32.581961 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:10:32.581961 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:10:32.581961 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:10:32.581961 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:32.581961 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xDDWm0a8ry-gKjmNwEPUQK59BE4cVud7DVSV_Jx7MD-3gvK0uQtoJ2J9The9na-lEHEDa6W5PD0G_Wfr7mrOCu9tlQ6l00XWqImSL9rvvj2p4osh6grgg8h1_X8uZWOiObCg_Kx_eubU-R7GgR6DDmJUESf97hNwOPLTcPMqNdAnw8 Aug 07 01:10:32.581961 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:10:32.581961 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:10:32.581961 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:10:32.581961 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:10:32.581961 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:10:32.581961 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:10:32.581961 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: c15e7e61e7eb4c9490b7632bde85d2cd Aug 07 01:10:32.581961 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-AggregatesAdminTestJSON-417248441 Aug 07 01:10:32.581961 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:10:32.581961 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:10:32.584212 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c15e7e61e7eb4c9490b7632bde85d2cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c15e7e61e7eb4c9490b7632bde85d2cd", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c15e7e61e7eb4c9490b7632bde85d2cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c15e7e61e7eb4c9490b7632bde85d2cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:32.584212 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-AggregatesAdminTestJSON-417248441 Aug 07 01:10:32.584212 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: c15e7e61e7eb4c9490b7632bde85d2cd Aug 07 01:10:32.584212 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-417248441 Aug 07 01:10:32.584212 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-AggregatesAdminTestJSON-417248441-project Aug 07 01:10:32.584212 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:10:32.584212 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:10:32.584212 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 37a892781ecd4300b6dd10b9c235e263 Aug 07 01:10:32.584212 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-AggregatesAdminTestJSON-417248441-project Aug 07 01:10:32.584212 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:10:32.584212 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 7028fed0-c1db-491a-b46f-345ead213c7a could not be found. Aug 07 01:10:32.584212 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '7028fed0-c1db-491a-b46f-345ead213c7a'} Aug 07 01:10:32.585380 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:32.585380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:32.585380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:10:32.585380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:10:32.585380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:10:32.585380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:10:32.585380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:10:32.585380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:10:32.585380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:10:32.585380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:10:32.585380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7028fed0-c1db-491a-b46f-345ead213c7a could not be found. Aug 07 01:10:32.585380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:32.585380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:32.585380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:32.585380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:32.585380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:32.585380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:32.585380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:32.585380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:32.585380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:32.590822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:32.590822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:10:32.590822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:10:32.590822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:10:32.590822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:10:32.590822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:10:32.590822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:10:32.590822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:10:32.590822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:10:32.590822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7028fed0-c1db-491a-b46f-345ead213c7a could not be found. Aug 07 01:10:32.590822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:32.590822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:32.590822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:32.590822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:32.590822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:32.590822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:32.590822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:10:32.590822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:10:32.590822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7028fed0-c1db-491a-b46f-345ead213c7a could not be found. Aug 07 01:10:32.590822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:32.599297 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5e5bb81c-b68c-40c5-bf70-2f054c355d93 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Returning 404 to user: Instance 7028fed0-c1db-491a-b46f-345ead213c7a could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:32.599297 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5e5bb81c-b68c-40c5-bf70-2f054c355d93 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a" status: 404 len: 111 microversion: 2.1 time: 0.136194 Aug 07 01:10:32.601102 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 164/302] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:10:32 2022] DELETE /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:10:32.619102 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f9b1426a-084d-4807-9581-51962df63281 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:32.629661 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f9b1426a-084d-4807-9581-51962df63281 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] [instance: 7028fed0-c1db-491a-b46f-345ead213c7a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:32.653997 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f9b1426a-084d-4807-9581-51962df63281 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:32.656005 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f9b1426a-084d-4807-9581-51962df63281 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:32.660047 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f9b1426a-084d-4807-9581-51962df63281 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:32.662272 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f9b1426a-084d-4807-9581-51962df63281 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:32.664605 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f9b1426a-084d-4807-9581-51962df63281 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:32.672919 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f9b1426a-084d-4807-9581-51962df63281 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:32.751200 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-f9b1426a-084d-4807-9581-51962df63281 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] HTTP exception thrown: Instance 7028fed0-c1db-491a-b46f-345ead213c7a could not be found. Aug 07 01:10:32.758140 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f9b1426a-084d-4807-9581-51962df63281 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Request method failure captured: Aug 07 01:10:32.758140 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a HTTP/1.1 Aug 07 01:10:32.758140 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:10:32.758140 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:10:32.758140 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:10:32.758140 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:10:32.758140 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:10:32.758140 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:10:32.758140 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:10:32.758140 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:32.758140 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xDDWm0a8ry-gKjmNwEPUQK59BE4cVud7DVSV_Jx7MD-3gvK0uQtoJ2J9The9na-lEHEDa6W5PD0G_Wfr7mrOCu9tlQ6l00XWqImSL9rvvj2p4osh6grgg8h1_X8uZWOiObCg_Kx_eubU-R7GgR6DDmJUESf97hNwOPLTcPMqNdAnw8 Aug 07 01:10:32.758140 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:10:32.758140 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:10:32.758140 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:10:32.758140 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:10:32.758140 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:10:32.758140 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:10:32.758140 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: c15e7e61e7eb4c9490b7632bde85d2cd Aug 07 01:10:32.758140 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-AggregatesAdminTestJSON-417248441 Aug 07 01:10:32.758140 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:10:32.758140 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:10:32.760772 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c15e7e61e7eb4c9490b7632bde85d2cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c15e7e61e7eb4c9490b7632bde85d2cd", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c15e7e61e7eb4c9490b7632bde85d2cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c15e7e61e7eb4c9490b7632bde85d2cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:32.760772 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-AggregatesAdminTestJSON-417248441 Aug 07 01:10:32.760772 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: c15e7e61e7eb4c9490b7632bde85d2cd Aug 07 01:10:32.760772 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-417248441 Aug 07 01:10:32.760772 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-AggregatesAdminTestJSON-417248441-project Aug 07 01:10:32.760772 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:10:32.760772 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:10:32.760772 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 37a892781ecd4300b6dd10b9c235e263 Aug 07 01:10:32.760772 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-AggregatesAdminTestJSON-417248441-project Aug 07 01:10:32.760772 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:10:32.760772 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 7028fed0-c1db-491a-b46f-345ead213c7a could not be found. Aug 07 01:10:32.760772 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '7028fed0-c1db-491a-b46f-345ead213c7a'} Aug 07 01:10:32.762912 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:32.762912 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:32.762912 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:10:32.762912 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:10:32.762912 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:10:32.762912 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:10:32.762912 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:10:32.762912 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:10:32.762912 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:10:32.762912 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:10:32.762912 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7028fed0-c1db-491a-b46f-345ead213c7a could not be found. Aug 07 01:10:32.762912 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:32.762912 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:32.762912 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:32.762912 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:32.762912 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:32.762912 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:32.762912 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:32.762912 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:32.762912 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:32.767286 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:32.767286 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:10:32.767286 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:10:32.767286 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:10:32.767286 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:10:32.767286 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:10:32.767286 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:10:32.767286 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7028fed0-c1db-491a-b46f-345ead213c7a could not be found. Aug 07 01:10:32.767286 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:32.767286 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:32.767286 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:32.767286 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:32.767286 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:32.767286 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:32.767286 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:10:32.767286 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:10:32.767286 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7028fed0-c1db-491a-b46f-345ead213c7a could not be found. Aug 07 01:10:32.767286 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:32.773207 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f9b1426a-084d-4807-9581-51962df63281 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] Returning 404 to user: Instance 7028fed0-c1db-491a-b46f-345ead213c7a could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:32.776125 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f9b1426a-084d-4807-9581-51962df63281 tempest-AggregatesAdminTestJSON-417248441 tempest-AggregatesAdminTestJSON-417248441-project] 10.222.0.39 "GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a" status: 404 len: 111 microversion: 2.1 time: 0.168948 Aug 07 01:10:32.777925 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 139/303] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:32 2022] GET /compute/v2.1/servers/7028fed0-c1db-491a-b46f-345ead213c7a => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:10:33.316370 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d387a692-4b47-41af-bd7f-faf34a831714 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:33.318451 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d387a692-4b47-41af-bd7f-faf34a831714 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: 1d21a372-3326-418d-9a1f-eb2a2720fca1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:33.332126 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d387a692-4b47-41af-bd7f-faf34a831714 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:33.334734 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d387a692-4b47-41af-bd7f-faf34a831714 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:33.338503 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d387a692-4b47-41af-bd7f-faf34a831714 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:33.342308 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d387a692-4b47-41af-bd7f-faf34a831714 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:33.346653 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d387a692-4b47-41af-bd7f-faf34a831714 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:33.348816 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d387a692-4b47-41af-bd7f-faf34a831714 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:34.366930 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d387a692-4b47-41af-bd7f-faf34a831714 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909b8165f015473c9977ef92aaf0741b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010ea68aed824d6bac970360d34ab747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:34.380259 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d387a692-4b47-41af-bd7f-faf34a831714 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1" status: 200 len: 1319 microversion: 2.1 time: 1.066003 Aug 07 01:10:34.381129 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 165/304] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:33 2022] GET /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1 => generated 1319 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:35.424715 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4bc8b15a-74ab-4fb2-90bf-1bd40aef9a2f tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:35.425844 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4bc8b15a-74ab-4fb2-90bf-1bd40aef9a2f tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: 1d21a372-3326-418d-9a1f-eb2a2720fca1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:35.452173 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4bc8b15a-74ab-4fb2-90bf-1bd40aef9a2f tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:35.453070 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4bc8b15a-74ab-4fb2-90bf-1bd40aef9a2f tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:35.453878 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4bc8b15a-74ab-4fb2-90bf-1bd40aef9a2f tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:35.462211 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4bc8b15a-74ab-4fb2-90bf-1bd40aef9a2f tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:35.463296 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4bc8b15a-74ab-4fb2-90bf-1bd40aef9a2f tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:35.464129 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4bc8b15a-74ab-4fb2-90bf-1bd40aef9a2f tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:35.965732 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4bc8b15a-74ab-4fb2-90bf-1bd40aef9a2f tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909b8165f015473c9977ef92aaf0741b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010ea68aed824d6bac970360d34ab747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:35.986874 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4bc8b15a-74ab-4fb2-90bf-1bd40aef9a2f tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1" status: 200 len: 1319 microversion: 2.1 time: 0.570560 Aug 07 01:10:36.008145 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 140/305] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:35 2022] GET /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1 => generated 1319 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:10:36.512270 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-8e19071c-6eea-4dc9-8e0d-024bb1cc9102 req-4ab87795-6504-4d7c-8e49-5c4b3eb28112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d21a372-3326-418d-9a1f-eb2a2720fca1", "name": "network-vif-plugged", "status": "completed", "tag": "f1bb27b1-13ea-4573-84fe-d5cfd64ac3a9"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:36.576484 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-8e19071c-6eea-4dc9-8e0d-024bb1cc9102 req-4ab87795-6504-4d7c-8e49-5c4b3eb28112 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:36.578861 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-8e19071c-6eea-4dc9-8e0d-024bb1cc9102 req-4ab87795-6504-4d7c-8e49-5c4b3eb28112 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:36.580921 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-8e19071c-6eea-4dc9-8e0d-024bb1cc9102 req-4ab87795-6504-4d7c-8e49-5c4b3eb28112 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:36.615378 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-8e19071c-6eea-4dc9-8e0d-024bb1cc9102 req-4ab87795-6504-4d7c-8e49-5c4b3eb28112 service nova] Creating event network-vif-plugged:f1bb27b1-13ea-4573-84fe-d5cfd64ac3a9 for instance 1d21a372-3326-418d-9a1f-eb2a2720fca1 on n-h1-master-1 Aug 07 01:10:36.630555 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-8e19071c-6eea-4dc9-8e0d-024bb1cc9102 req-4ab87795-6504-4d7c-8e49-5c4b3eb28112 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127458 Aug 07 01:10:36.635267 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 141/306] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:37.016466 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-05de0262-d6e4-4390-9ef9-737d3653c4f3 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:37.026099 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-05de0262-d6e4-4390-9ef9-737d3653c4f3 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: 1d21a372-3326-418d-9a1f-eb2a2720fca1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:37.047911 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05de0262-d6e4-4390-9ef9-737d3653c4f3 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:37.053917 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05de0262-d6e4-4390-9ef9-737d3653c4f3 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:37.062717 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05de0262-d6e4-4390-9ef9-737d3653c4f3 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:37.064342 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05de0262-d6e4-4390-9ef9-737d3653c4f3 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:37.066632 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b711c2ad-1a22-4d8c-8bdf-4b6dfa8b66f6 tempest-FlavorsV2NegativeTest-1880134873 tempest-FlavorsV2NegativeTest-1880134873-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:37.072809 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05de0262-d6e4-4390-9ef9-737d3653c4f3 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:37.074576 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05de0262-d6e4-4390-9ef9-737d3653c4f3 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:37.109347 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b711c2ad-1a22-4d8c-8bdf-4b6dfa8b66f6 tempest-FlavorsV2NegativeTest-1880134873 tempest-FlavorsV2NegativeTest-1880134873-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 1.527134 Aug 07 01:10:37.110501 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 166/307] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Aug 7 01:10:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:37.635924 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-05de0262-d6e4-4390-9ef9-737d3653c4f3 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909b8165f015473c9977ef92aaf0741b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010ea68aed824d6bac970360d34ab747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:37.669871 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-05de0262-d6e4-4390-9ef9-737d3653c4f3 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1" status: 200 len: 1319 microversion: 2.1 time: 0.656119 Aug 07 01:10:37.675905 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 142/308] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:37 2022] GET /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1 => generated 1319 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:10:38.700820 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b2daf68b-5aea-4790-8857-5c922d80da2c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:38.701729 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b2daf68b-5aea-4790-8857-5c922d80da2c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: 1d21a372-3326-418d-9a1f-eb2a2720fca1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:38.723679 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b2daf68b-5aea-4790-8857-5c922d80da2c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:38.729908 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b2daf68b-5aea-4790-8857-5c922d80da2c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:38.730778 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b2daf68b-5aea-4790-8857-5c922d80da2c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:38.732146 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b2daf68b-5aea-4790-8857-5c922d80da2c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:38.743353 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b2daf68b-5aea-4790-8857-5c922d80da2c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:38.745073 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b2daf68b-5aea-4790-8857-5c922d80da2c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:39.606332 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b2daf68b-5aea-4790-8857-5c922d80da2c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909b8165f015473c9977ef92aaf0741b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010ea68aed824d6bac970360d34ab747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:39.618157 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b2daf68b-5aea-4790-8857-5c922d80da2c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1" status: 200 len: 1468 microversion: 2.1 time: 0.923528 Aug 07 01:10:39.619371 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 167/309] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:38 2022] GET /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1 => generated 1468 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:39.663723 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b6d30798-f4c7-4670-a0ad-3764dcc2c567 tempest-DeleteServersAdminTestJSON-1140258782 tempest-DeleteServersAdminTestJSON-1140258782-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:39.673652 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b6d30798-f4c7-4670-a0ad-3764dcc2c567 tempest-DeleteServersAdminTestJSON-1140258782 tempest-DeleteServersAdminTestJSON-1140258782-project-admin] [instance: 1d21a372-3326-418d-9a1f-eb2a2720fca1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:39.685619 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b6d30798-f4c7-4670-a0ad-3764dcc2c567 tempest-DeleteServersAdminTestJSON-1140258782 tempest-DeleteServersAdminTestJSON-1140258782-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:39.686921 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b6d30798-f4c7-4670-a0ad-3764dcc2c567 tempest-DeleteServersAdminTestJSON-1140258782 tempest-DeleteServersAdminTestJSON-1140258782-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:39.688154 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b6d30798-f4c7-4670-a0ad-3764dcc2c567 tempest-DeleteServersAdminTestJSON-1140258782 tempest-DeleteServersAdminTestJSON-1140258782-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:39.691576 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b6d30798-f4c7-4670-a0ad-3764dcc2c567 tempest-DeleteServersAdminTestJSON-1140258782 tempest-DeleteServersAdminTestJSON-1140258782-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:39.694259 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b6d30798-f4c7-4670-a0ad-3764dcc2c567 tempest-DeleteServersAdminTestJSON-1140258782 tempest-DeleteServersAdminTestJSON-1140258782-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:39.695677 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b6d30798-f4c7-4670-a0ad-3764dcc2c567 tempest-DeleteServersAdminTestJSON-1140258782 tempest-DeleteServersAdminTestJSON-1140258782-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:40.139205 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b6d30798-f4c7-4670-a0ad-3764dcc2c567 tempest-DeleteServersAdminTestJSON-1140258782 tempest-DeleteServersAdminTestJSON-1140258782-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1/action" status: 202 len: 0 microversion: 2.1 time: 0.484427 Aug 07 01:10:40.150889 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 143/310] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:10:39 2022] POST /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:10:40.167045 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d55c584d-bd97-40d0-ae7e-f8d17ee2c53c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:40.169762 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d55c584d-bd97-40d0-ae7e-f8d17ee2c53c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: 1d21a372-3326-418d-9a1f-eb2a2720fca1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:40.210252 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d55c584d-bd97-40d0-ae7e-f8d17ee2c53c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:40.211266 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d55c584d-bd97-40d0-ae7e-f8d17ee2c53c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:40.213120 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d55c584d-bd97-40d0-ae7e-f8d17ee2c53c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:40.215726 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d55c584d-bd97-40d0-ae7e-f8d17ee2c53c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:40.228767 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d55c584d-bd97-40d0-ae7e-f8d17ee2c53c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:40.228767 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d55c584d-bd97-40d0-ae7e-f8d17ee2c53c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:40.398459 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d55c584d-bd97-40d0-ae7e-f8d17ee2c53c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:40.399802 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d55c584d-bd97-40d0-ae7e-f8d17ee2c53c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:40.400530 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d55c584d-bd97-40d0-ae7e-f8d17ee2c53c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:40.401203 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-d55c584d-bd97-40d0-ae7e-f8d17ee2c53c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lazy-loading 'fault' on Instance uuid 1d21a372-3326-418d-9a1f-eb2a2720fca1 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:10:40.406005 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:40.578938 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-dde685e4-cde8-4509-8b42-22ff29f65470 tempest-FlavorsV2NegativeTest-1880134873 tempest-FlavorsV2NegativeTest-1880134873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1396436453", "imageRef": "1b0d4ec4-e39f-44d8-a22c-d536f4c0bd7a", "flavorRef": "452"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:40.630125 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=4 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:40.775954 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-dde685e4-cde8-4509-8b42-22ff29f65470 tempest-FlavorsV2NegativeTest-1880134873 tempest-FlavorsV2NegativeTest-1880134873-project] validate_networks() for None {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:10:41.541074 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-dde685e4-cde8-4509-8b42-22ff29f65470 tempest-FlavorsV2NegativeTest-1880134873 tempest-FlavorsV2NegativeTest-1880134873-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 07 01:10:41.545044 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-dde685e4-cde8-4509-8b42-22ff29f65470 tempest-FlavorsV2NegativeTest-1880134873 tempest-FlavorsV2NegativeTest-1880134873-project] Request method failure captured: Aug 07 01:10:41.545044 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 07 01:10:41.545044 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:10:41.545044 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:10:41.545044 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:10:41.545044 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 143 Aug 07 01:10:41.545044 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:10:41.545044 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:10:41.545044 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:10:41.545044 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:41.545044 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xELUTyzD2FoBNpJ69fMH5BObLuGa3_Kic7UZzFI6eEB-UpKMQOUZbypkn8tAn3xf8eodoCdR4GmVxIVnbD5mwiM9UoDrq-bbGAhar7AEqx9D-niwQzwOM6W2_oNR3ji61pW6C2exx9b04Ev_tqJEocr6xVKb0A12bfLH8gRVm25iXM Aug 07 01:10:41.545044 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:10:41.545044 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:10:41.545044 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:10:41.545044 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:10:41.545044 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:10:41.545044 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:10:41.545044 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 5705e5a01af14bb6add2b1da39636196 Aug 07 01:10:41.545044 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-FlavorsV2NegativeTest-1880134873 Aug 07 01:10:41.545044 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:10:41.545044 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:10:41.546479 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5705e5a01af14bb6add2b1da39636196"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5705e5a01af14bb6add2b1da39636196", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5705e5a01af14bb6add2b1da39636196"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5705e5a01af14bb6add2b1da39636196"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:41.546479 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-FlavorsV2NegativeTest-1880134873 Aug 07 01:10:41.546479 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 5705e5a01af14bb6add2b1da39636196 Aug 07 01:10:41.546479 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1880134873 Aug 07 01:10:41.546479 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-FlavorsV2NegativeTest-1880134873-project Aug 07 01:10:41.546479 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:10:41.546479 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:10:41.546479 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 40fc46029deb4b92819a6c76a6eaae32 Aug 07 01:10:41.546479 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-FlavorsV2NegativeTest-1880134873-project Aug 07 01:10:41.546479 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:10:41.546479 n-d-master-1 devstack@n-api.service[119517]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1396436453", "imageRef": "1b0d4ec4-e39f-44d8-a22c-d536f4c0bd7a", "flavorRef": "452"}} Aug 07 01:10:41.546479 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:10:41.547272 n-d-master-1 devstack@n-api.service[119517]: exception: Flavor's memory is too small for requested image. Aug 07 01:10:41.547272 n-d-master-1 devstack@n-api.service[119517]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1396436453', 'imageRef': '1b0d4ec4-e39f-44d8-a22c-d536f4c0bd7a', 'flavorRef': '452'}}} Aug 07 01:10:41.547272 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:41.547272 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:41.547272 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 07 01:10:41.547272 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 07 01:10:41.547272 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 07 01:10:41.547272 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 07 01:10:41.547272 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 07 01:10:41.547272 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 07 01:10:41.547272 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1007, in _checks_for_create_and_rebuild Aug 07 01:10:41.547272 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 07 01:10:41.547272 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 671, in _validate_flavor_image Aug 07 01:10:41.547272 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 07 01:10:41.547272 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 739, in _validate_flavor_image_nostatus Aug 07 01:10:41.547272 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 07 01:10:41.547272 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 07 01:10:41.547272 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:41.547272 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:41.547272 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:41.548600 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:41.548600 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:41.548600 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:41.548600 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:41.548600 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:41.548600 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:41.548600 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:41.548600 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:10:41.548600 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:10:41.548600 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:10:41.548600 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:10:41.548600 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:10:41.548600 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:10:41.548600 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 07 01:10:41.548600 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 07 01:10:41.548600 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 07 01:10:41.548600 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 07 01:10:41.548600 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:41.548600 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:41.548600 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:41.548600 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:41.555838 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:41.555838 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:41.555838 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:10:41.555838 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:10:41.555838 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 07 01:10:41.555838 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:41.555838 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-dde685e4-cde8-4509-8b42-22ff29f65470 tempest-FlavorsV2NegativeTest-1880134873 tempest-FlavorsV2NegativeTest-1880134873-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:41.555838 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-dde685e4-cde8-4509-8b42-22ff29f65470 tempest-FlavorsV2NegativeTest-1880134873 tempest-FlavorsV2NegativeTest-1880134873-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.977266 Aug 07 01:10:41.555838 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 144/311] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:10:40 2022] POST /compute/v2.1/servers => generated 93 bytes in 979 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:41.921149 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d55c584d-bd97-40d0-ae7e-f8d17ee2c53c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909b8165f015473c9977ef92aaf0741b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010ea68aed824d6bac970360d34ab747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:41.961962 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d55c584d-bd97-40d0-ae7e-f8d17ee2c53c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1" status: 200 len: 1451 microversion: 2.1 time: 1.808723 Aug 07 01:10:41.965380 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 168/312] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:40 2022] GET /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1 => generated 1451 bytes in 1815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:42.016272 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cbee72b0-e745-4514-b5df-d68645907394 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:42.018119 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cbee72b0-e745-4514-b5df-d68645907394 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: 1d21a372-3326-418d-9a1f-eb2a2720fca1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:42.052298 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cbee72b0-e745-4514-b5df-d68645907394 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:42.053574 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cbee72b0-e745-4514-b5df-d68645907394 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:42.054609 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cbee72b0-e745-4514-b5df-d68645907394 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:42.056842 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cbee72b0-e745-4514-b5df-d68645907394 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:42.058011 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cbee72b0-e745-4514-b5df-d68645907394 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:42.061130 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cbee72b0-e745-4514-b5df-d68645907394 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:42.152419 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cbee72b0-e745-4514-b5df-d68645907394 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: 1d21a372-3326-418d-9a1f-eb2a2720fca1] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:10:42.335656 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cbee72b0-e745-4514-b5df-d68645907394 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1" status: 204 len: 0 microversion: 2.1 time: 0.331456 Aug 07 01:10:42.340342 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 169/313] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:10:42 2022] DELETE /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 07 01:10:42.352748 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-20776e6e-f772-471e-ac26-8a7f573a6a00 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:42.353886 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-20776e6e-f772-471e-ac26-8a7f573a6a00 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: 1d21a372-3326-418d-9a1f-eb2a2720fca1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:42.362294 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20776e6e-f772-471e-ac26-8a7f573a6a00 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:42.363350 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20776e6e-f772-471e-ac26-8a7f573a6a00 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:42.364101 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20776e6e-f772-471e-ac26-8a7f573a6a00 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:42.365676 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20776e6e-f772-471e-ac26-8a7f573a6a00 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:42.366425 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20776e6e-f772-471e-ac26-8a7f573a6a00 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:42.367364 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20776e6e-f772-471e-ac26-8a7f573a6a00 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:42.429638 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20776e6e-f772-471e-ac26-8a7f573a6a00 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:42.431328 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20776e6e-f772-471e-ac26-8a7f573a6a00 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:42.433664 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20776e6e-f772-471e-ac26-8a7f573a6a00 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:42.434596 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-20776e6e-f772-471e-ac26-8a7f573a6a00 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lazy-loading 'fault' on Instance uuid 1d21a372-3326-418d-9a1f-eb2a2720fca1 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:10:42.666373 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4d4c8cf0-a240-40f3-b510-13424ba5d974 tempest-TenantUsagesNegativeTestJSON-1914670052 tempest-TenantUsagesNegativeTestJSON-1914670052-project-admin] 10.222.0.39 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-06T01%3A10%3A41.517804&end=2022-08-08T01%3A10%3A41.517804" status: 404 len: 112 microversion: - time: 1.093795 Aug 07 01:10:42.667487 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 145/314] 10.222.0.39 () {58 vars in 1316 bytes} [Sun Aug 7 01:10:41 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-06T01%3A10%3A41.517804&end=2022-08-08T01%3A10%3A41.517804 => generated 112 bytes in 1118 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 07 01:10:42.700907 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fb4d882c-1a1d-4784-bd57-15a737d62958 tempest-TenantUsagesNegativeTestJSON-1914670052 tempest-TenantUsagesNegativeTestJSON-1914670052-project-admin] Calling method '.version_select at 0x7f9e24fa9670>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:42.719255 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-fb4d882c-1a1d-4784-bd57-15a737d62958 tempest-TenantUsagesNegativeTestJSON-1914670052 tempest-TenantUsagesNegativeTestJSON-1914670052-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 07 01:10:42.739957 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fb4d882c-1a1d-4784-bd57-15a737d62958 tempest-TenantUsagesNegativeTestJSON-1914670052 tempest-TenantUsagesNegativeTestJSON-1914670052-project-admin] Request method failure captured: Aug 07 01:10:42.739957 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/os-simple-tenant-usage/5f58ed0fcf42424596a5a06cc32a064e?start=2022-08-08T01%3A10%3A41.517804&end=2022-08-06T01%3A10%3A41.517804 HTTP/1.1 Aug 07 01:10:42.739957 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:10:42.739957 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:10:42.739957 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:10:42.739957 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:10:42.739957 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:10:42.739957 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:10:42.739957 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:10:42.739957 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:42.739957 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xERYA9frYSogUVANGwS1LvT5u1cj5Iitj9HMBHik96Lv_GRr4u0uCmck8Ks2LP-aGMr80L1xOv2lc__zEHbCTXXWtrSeRVYiEhvaEtkgN8Hcw_MGy8H9BaPl_3O6tCiEvADS24ETqCaiGmGtIwiHwe1-SE-mQsP5KAbkXg80M3I2ps Aug 07 01:10:42.739957 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:10:42.739957 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:10:42.739957 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:10:42.739957 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:10:42.739957 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:10:42.739957 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:10:42.739957 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 950b69a484c14cea9e621e7409e72fbc Aug 07 01:10:42.739957 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1914670052 Aug 07 01:10:42.739957 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,admin,member Aug 07 01:10:42.739957 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,admin,member Aug 07 01:10:42.742686 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/950b69a484c14cea9e621e7409e72fbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_950b69a484c14cea9e621e7409e72fbc", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/950b69a484c14cea9e621e7409e72fbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/950b69a484c14cea9e621e7409e72fbc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:42.742686 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1914670052 Aug 07 01:10:42.742686 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 950b69a484c14cea9e621e7409e72fbc Aug 07 01:10:42.742686 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1914670052 Aug 07 01:10:42.742686 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-TenantUsagesNegativeTestJSON-1914670052-project-admin Aug 07 01:10:42.742686 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:10:42.742686 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:10:42.742686 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: be556fbd71b04f408dac0c12c6de69b8 Aug 07 01:10:42.742686 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1914670052-project-admin Aug 07 01:10:42.742686 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:10:42.742686 n-d-master-1 devstack@n-api.service[119517]: exception: Invalid start time. The start time cannot occur after the end time. Aug 07 01:10:42.742686 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '5f58ed0fcf42424596a5a06cc32a064e'} Aug 07 01:10:42.744228 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:42.744228 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:42.744228 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:42.744228 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:42.744228 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:42.744228 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:42.744228 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:10:42.744228 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:10:42.744228 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 07 01:10:42.744228 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:10:42.744228 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:42.744228 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:42.744228 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 07 01:10:42.744228 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 07 01:10:42.744228 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 07 01:10:42.744228 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 07 01:10:42.744228 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 07 01:10:42.744228 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 07 01:10:42.744228 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 07 01:10:42.746819 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:42.746819 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:42.746819 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:42.746819 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:42.746819 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:42.746819 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:42.746819 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:10:42.746819 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:10:42.746819 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 07 01:10:42.746819 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:42.752643 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fb4d882c-1a1d-4784-bd57-15a737d62958 tempest-TenantUsagesNegativeTestJSON-1914670052 tempest-TenantUsagesNegativeTestJSON-1914670052-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:42.753814 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fb4d882c-1a1d-4784-bd57-15a737d62958 tempest-TenantUsagesNegativeTestJSON-1914670052 tempest-TenantUsagesNegativeTestJSON-1914670052-project-admin] 10.222.0.39 "GET /compute/v2.1/os-simple-tenant-usage/5f58ed0fcf42424596a5a06cc32a064e?start=2022-08-08T01%3A10%3A41.517804&end=2022-08-06T01%3A10%3A41.517804" status: 400 len: 111 microversion: 2.1 time: 0.078628 Aug 07 01:10:42.756281 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 146/315] 10.222.0.39 () {58 vars in 1412 bytes} [Sun Aug 7 01:10:42 2022] GET /compute/v2.1/os-simple-tenant-usage/5f58ed0fcf42424596a5a06cc32a064e?start=2022-08-08T01%3A10%3A41.517804&end=2022-08-06T01%3A10%3A41.517804 => generated 111 bytes in 82 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 07 01:10:43.335424 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-20776e6e-f772-471e-ac26-8a7f573a6a00 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909b8165f015473c9977ef92aaf0741b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010ea68aed824d6bac970360d34ab747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:43.357499 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-20776e6e-f772-471e-ac26-8a7f573a6a00 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1" status: 200 len: 1457 microversion: 2.1 time: 1.009459 Aug 07 01:10:43.359955 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 170/316] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:42 2022] GET /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1 => generated 1457 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:43.550574 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b535d422-78c4-4db0-92ce-aeff72b00a62 tempest-TenantUsagesNegativeTestJSON-1297498671 tempest-TenantUsagesNegativeTestJSON-1297498671-project] Calling method '.version_select at 0x7f9e24f03670>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:43.558862 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b535d422-78c4-4db0-92ce-aeff72b00a62 tempest-TenantUsagesNegativeTestJSON-1297498671 tempest-TenantUsagesNegativeTestJSON-1297498671-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '600c5ba5ceed46f195a8a97325f0ac96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f58ed0fcf42424596a5a06cc32a064e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:43.563689 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b535d422-78c4-4db0-92ce-aeff72b00a62 tempest-TenantUsagesNegativeTestJSON-1297498671 tempest-TenantUsagesNegativeTestJSON-1297498671-project] Request method failure captured: Aug 07 01:10:43.563689 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-06T01%3A10%3A41.517804&end=2022-08-08T01%3A10%3A41.517804&detailed=1 HTTP/1.1 Aug 07 01:10:43.563689 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:10:43.563689 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:10:43.563689 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:10:43.563689 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:10:43.563689 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:10:43.563689 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:10:43.563689 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:10:43.563689 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:43.563689 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xEMoTeinxzQ39z0C1eOIjkIg9bdxSoppoWUnBT3aWexLKquApr83t4yi1q1dt3zfPDy_IhjAXh2V-sYy5PkcK-OUG45l-C8UOuQle0nZH8K0cuRdwGoFURqlMjvDSKgMyRYB8Heh7hNyQB-g2CZBiB5C3xuO4kGsOH_PgcKu7AhgXo Aug 07 01:10:43.563689 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:10:43.563689 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:10:43.563689 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:10:43.563689 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:10:43.563689 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:10:43.563689 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:10:43.563689 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 5f58ed0fcf42424596a5a06cc32a064e Aug 07 01:10:43.563689 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1297498671 Aug 07 01:10:43.563689 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:10:43.563689 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:10:43.565953 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5f58ed0fcf42424596a5a06cc32a064e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5f58ed0fcf42424596a5a06cc32a064e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5f58ed0fcf42424596a5a06cc32a064e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5f58ed0fcf42424596a5a06cc32a064e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:43.565953 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1297498671 Aug 07 01:10:43.565953 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 5f58ed0fcf42424596a5a06cc32a064e Aug 07 01:10:43.565953 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1297498671 Aug 07 01:10:43.565953 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-TenantUsagesNegativeTestJSON-1297498671-project Aug 07 01:10:43.565953 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:10:43.565953 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:10:43.565953 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 600c5ba5ceed46f195a8a97325f0ac96 Aug 07 01:10:43.565953 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1297498671-project Aug 07 01:10:43.565953 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:10:43.565953 n-d-master-1 devstack@n-api.service[119517]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 07 01:10:43.565953 n-d-master-1 devstack@n-api.service[119517]: action_args: {} Aug 07 01:10:43.565953 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:43.567801 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:43.567801 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:43.567801 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:43.567801 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:43.567801 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:43.567801 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:10:43.567801 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:10:43.567801 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 07 01:10:43.567801 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:10:43.567801 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:43.567801 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:43.567801 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 07 01:10:43.567801 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 07 01:10:43.567801 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 07 01:10:43.567801 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 07 01:10:43.567801 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 07 01:10:43.567801 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 07 01:10:43.567801 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 07 01:10:43.567801 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 07 01:10:43.573387 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:10:43.573387 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:10:43.573387 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:10:43.573387 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:10:43.573387 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 07 01:10:43.573387 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 07 01:10:43.573387 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 07 01:10:43.573387 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 07 01:10:43.573387 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 07 01:10:43.573387 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 07 01:10:43.573387 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 07 01:10:43.573387 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:43.573387 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:43.573387 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:43.573387 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:43.573387 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:43.573387 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:43.573387 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 07 01:10:43.573387 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 07 01:10:43.576704 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 07 01:10:43.576704 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:43.576704 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b535d422-78c4-4db0-92ce-aeff72b00a62 tempest-TenantUsagesNegativeTestJSON-1297498671 tempest-TenantUsagesNegativeTestJSON-1297498671-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:43.576704 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b535d422-78c4-4db0-92ce-aeff72b00a62 tempest-TenantUsagesNegativeTestJSON-1297498671 tempest-TenantUsagesNegativeTestJSON-1297498671-project] 10.222.0.39 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-06T01%3A10%3A41.517804&end=2022-08-08T01%3A10%3A41.517804&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.796077 Aug 07 01:10:43.576704 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 147/317] 10.222.0.39 () {58 vars in 1335 bytes} [Sun Aug 7 01:10:42 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-06T01%3A10%3A41.517804&end=2022-08-08T01%3A10%3A41.517804&detailed=1 => generated 123 bytes in 801 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:10:44.395959 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ddf45e93-8175-456d-a376-e4dad66c3a56 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:44.399596 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ddf45e93-8175-456d-a376-e4dad66c3a56 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: 1d21a372-3326-418d-9a1f-eb2a2720fca1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:44.424685 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddf45e93-8175-456d-a376-e4dad66c3a56 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:44.425432 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddf45e93-8175-456d-a376-e4dad66c3a56 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:44.426232 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddf45e93-8175-456d-a376-e4dad66c3a56 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:44.427546 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddf45e93-8175-456d-a376-e4dad66c3a56 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:44.440633 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddf45e93-8175-456d-a376-e4dad66c3a56 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:44.441504 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddf45e93-8175-456d-a376-e4dad66c3a56 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:44.572387 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddf45e93-8175-456d-a376-e4dad66c3a56 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:44.573007 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddf45e93-8175-456d-a376-e4dad66c3a56 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:44.577903 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddf45e93-8175-456d-a376-e4dad66c3a56 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:44.578615 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-ddf45e93-8175-456d-a376-e4dad66c3a56 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lazy-loading 'fault' on Instance uuid 1d21a372-3326-418d-9a1f-eb2a2720fca1 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:10:45.155089 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ddf45e93-8175-456d-a376-e4dad66c3a56 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909b8165f015473c9977ef92aaf0741b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010ea68aed824d6bac970360d34ab747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:45.171181 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ddf45e93-8175-456d-a376-e4dad66c3a56 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1" status: 200 len: 1457 microversion: 2.1 time: 0.782285 Aug 07 01:10:45.172300 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 171/318] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:44 2022] GET /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1 => generated 1457 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:45.689815 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-e4942a74-6ff6-401b-a2e7-fd540f36d6ed req-37b049f1-15c0-4895-97ff-68646ce746ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d21a372-3326-418d-9a1f-eb2a2720fca1", "name": "network-vif-deleted", "tag": "f1bb27b1-13ea-4573-84fe-d5cfd64ac3a9"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:45.719222 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e4942a74-6ff6-401b-a2e7-fd540f36d6ed req-37b049f1-15c0-4895-97ff-68646ce746ae service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:45.721803 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e4942a74-6ff6-401b-a2e7-fd540f36d6ed req-37b049f1-15c0-4895-97ff-68646ce746ae service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:45.725012 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e4942a74-6ff6-401b-a2e7-fd540f36d6ed req-37b049f1-15c0-4895-97ff-68646ce746ae service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:45.763506 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-e4942a74-6ff6-401b-a2e7-fd540f36d6ed req-37b049f1-15c0-4895-97ff-68646ce746ae service nova] Creating event network-vif-deleted:f1bb27b1-13ea-4573-84fe-d5cfd64ac3a9 for instance 1d21a372-3326-418d-9a1f-eb2a2720fca1 on n-h1-master-1 Aug 07 01:10:45.782029 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-e4942a74-6ff6-401b-a2e7-fd540f36d6ed req-37b049f1-15c0-4895-97ff-68646ce746ae service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095386 Aug 07 01:10:45.787379 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 172/319] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:46.221364 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-96d3c4d5-5a3f-4076-97af-cd8d6350cd54 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:46.225654 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-96d3c4d5-5a3f-4076-97af-cd8d6350cd54 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: 1d21a372-3326-418d-9a1f-eb2a2720fca1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:46.272287 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-96d3c4d5-5a3f-4076-97af-cd8d6350cd54 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:46.279221 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-96d3c4d5-5a3f-4076-97af-cd8d6350cd54 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:46.295959 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-96d3c4d5-5a3f-4076-97af-cd8d6350cd54 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:46.298564 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-96d3c4d5-5a3f-4076-97af-cd8d6350cd54 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:46.311574 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-96d3c4d5-5a3f-4076-97af-cd8d6350cd54 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:46.313817 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-96d3c4d5-5a3f-4076-97af-cd8d6350cd54 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:46.513805 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-96d3c4d5-5a3f-4076-97af-cd8d6350cd54 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:46.514865 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-96d3c4d5-5a3f-4076-97af-cd8d6350cd54 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:46.515683 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-96d3c4d5-5a3f-4076-97af-cd8d6350cd54 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:46.516528 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-96d3c4d5-5a3f-4076-97af-cd8d6350cd54 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lazy-loading 'fault' on Instance uuid 1d21a372-3326-418d-9a1f-eb2a2720fca1 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:10:46.627001 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-67d4303d-c98b-497e-8ded-33ba398ddd86 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-877240717", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "e53f1978-9541-49df-ae99-30274357a59f"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:46.736986 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-96d3c4d5-5a3f-4076-97af-cd8d6350cd54 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909b8165f015473c9977ef92aaf0741b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010ea68aed824d6bac970360d34ab747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:46.787110 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-96d3c4d5-5a3f-4076-97af-cd8d6350cd54 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1" status: 200 len: 1309 microversion: 2.1 time: 0.573827 Aug 07 01:10:46.805924 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 173/320] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:46 2022] GET /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1 => generated 1309 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:10:46.825387 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-67d4303d-c98b-497e-8ded-33ba398ddd86 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] validate_networks() for [('e53f1978-9541-49df-ae99-30274357a59f', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:10:47.842629 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a05434f7-8085-44a1-92f5-ed4454052239 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:47.843815 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a05434f7-8085-44a1-92f5-ed4454052239 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: 1d21a372-3326-418d-9a1f-eb2a2720fca1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:47.870642 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a05434f7-8085-44a1-92f5-ed4454052239 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:47.871937 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a05434f7-8085-44a1-92f5-ed4454052239 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:47.872948 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a05434f7-8085-44a1-92f5-ed4454052239 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:47.874487 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a05434f7-8085-44a1-92f5-ed4454052239 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:47.884274 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a05434f7-8085-44a1-92f5-ed4454052239 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:47.885384 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a05434f7-8085-44a1-92f5-ed4454052239 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:47.961242 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-a05434f7-8085-44a1-92f5-ed4454052239 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] HTTP exception thrown: Instance 1d21a372-3326-418d-9a1f-eb2a2720fca1 could not be found. Aug 07 01:10:47.975929 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a05434f7-8085-44a1-92f5-ed4454052239 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Request method failure captured: Aug 07 01:10:47.975929 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1 HTTP/1.1 Aug 07 01:10:47.975929 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:10:47.975929 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:10:47.975929 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:10:47.975929 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:10:47.975929 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:10:47.975929 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:10:47.975929 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:10:47.975929 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:47.975929 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xDMrB5sW_jCj6yEHfXgRfpkPNRZlz8KeTmDaGz_lSyfZYqetKyiW_zrxvysqMSss0UVN_I7g5FxCtQIziR1yrWUCFUO79-2SbZhlRuflLXizITdCWnjIGaG_6AVuHEP_Mcep1lp9grpHsUXD_83xXw90LL_gN3ChBbIL3YzAJRNtJs Aug 07 01:10:47.975929 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:10:47.975929 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:10:47.975929 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:10:47.975929 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:10:47.975929 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:10:47.975929 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:10:47.975929 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 010ea68aed824d6bac970360d34ab747 Aug 07 01:10:47.975929 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1461254374 Aug 07 01:10:47.975929 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:10:47.975929 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:10:47.979065 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/010ea68aed824d6bac970360d34ab747"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_010ea68aed824d6bac970360d34ab747", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/010ea68aed824d6bac970360d34ab747"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/010ea68aed824d6bac970360d34ab747"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:47.979065 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-DeleteServersAdminTestJSON-1461254374 Aug 07 01:10:47.979065 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 010ea68aed824d6bac970360d34ab747 Aug 07 01:10:47.979065 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1461254374 Aug 07 01:10:47.979065 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-DeleteServersAdminTestJSON-1461254374-project Aug 07 01:10:47.979065 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:10:47.979065 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:10:47.979065 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 909b8165f015473c9977ef92aaf0741b Aug 07 01:10:47.979065 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-DeleteServersAdminTestJSON-1461254374-project Aug 07 01:10:47.979065 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:10:47.979065 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 1d21a372-3326-418d-9a1f-eb2a2720fca1 could not be found. Aug 07 01:10:47.979065 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '1d21a372-3326-418d-9a1f-eb2a2720fca1'} Aug 07 01:10:47.980632 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:47.980632 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:47.980632 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:10:47.980632 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:10:47.980632 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:10:47.980632 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:10:47.980632 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:10:47.980632 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:10:47.980632 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:10:47.980632 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:10:47.980632 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d21a372-3326-418d-9a1f-eb2a2720fca1 could not be found. Aug 07 01:10:47.980632 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:47.980632 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:47.980632 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:47.980632 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:47.980632 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:47.980632 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:47.980632 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:47.980632 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:47.980632 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:47.983084 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:47.983084 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:10:47.983084 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:10:47.983084 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:10:47.983084 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:10:47.983084 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:10:47.983084 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:10:47.983084 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d21a372-3326-418d-9a1f-eb2a2720fca1 could not be found. Aug 07 01:10:47.983084 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:47.983084 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:47.983084 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:47.983084 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:47.983084 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:47.983084 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:47.983084 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:10:47.983084 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:10:47.983084 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d21a372-3326-418d-9a1f-eb2a2720fca1 could not be found. Aug 07 01:10:47.983084 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:47.990587 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a05434f7-8085-44a1-92f5-ed4454052239 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Returning 404 to user: Instance 1d21a372-3326-418d-9a1f-eb2a2720fca1 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:47.995470 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a05434f7-8085-44a1-92f5-ed4454052239 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1" status: 404 len: 111 microversion: 2.1 time: 0.162484 Aug 07 01:10:48.001819 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 174/321] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:47 2022] GET /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1 => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:10:48.025419 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-79253bfd-24d7-418d-a330-4a49a9a0f4a5 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:48.028412 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-79253bfd-24d7-418d-a330-4a49a9a0f4a5 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: 1d21a372-3326-418d-9a1f-eb2a2720fca1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:48.048260 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-79253bfd-24d7-418d-a330-4a49a9a0f4a5 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:48.059223 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-79253bfd-24d7-418d-a330-4a49a9a0f4a5 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:48.060424 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-79253bfd-24d7-418d-a330-4a49a9a0f4a5 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:48.062133 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-79253bfd-24d7-418d-a330-4a49a9a0f4a5 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:48.068536 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-79253bfd-24d7-418d-a330-4a49a9a0f4a5 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:48.069603 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-79253bfd-24d7-418d-a330-4a49a9a0f4a5 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:48.121220 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-79253bfd-24d7-418d-a330-4a49a9a0f4a5 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] HTTP exception thrown: Instance 1d21a372-3326-418d-9a1f-eb2a2720fca1 could not be found. Aug 07 01:10:48.131397 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-79253bfd-24d7-418d-a330-4a49a9a0f4a5 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Request method failure captured: Aug 07 01:10:48.131397 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1 HTTP/1.1 Aug 07 01:10:48.131397 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:10:48.131397 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:10:48.131397 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:10:48.131397 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:10:48.131397 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:10:48.131397 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:10:48.131397 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:10:48.131397 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:48.131397 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xDMrB5sW_jCj6yEHfXgRfpkPNRZlz8KeTmDaGz_lSyfZYqetKyiW_zrxvysqMSss0UVN_I7g5FxCtQIziR1yrWUCFUO79-2SbZhlRuflLXizITdCWnjIGaG_6AVuHEP_Mcep1lp9grpHsUXD_83xXw90LL_gN3ChBbIL3YzAJRNtJs Aug 07 01:10:48.131397 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:10:48.131397 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:10:48.131397 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:10:48.131397 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:10:48.131397 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:10:48.131397 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:10:48.131397 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 010ea68aed824d6bac970360d34ab747 Aug 07 01:10:48.131397 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1461254374 Aug 07 01:10:48.131397 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:10:48.131397 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:10:48.133976 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/010ea68aed824d6bac970360d34ab747"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_010ea68aed824d6bac970360d34ab747", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/010ea68aed824d6bac970360d34ab747"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/010ea68aed824d6bac970360d34ab747"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:48.133976 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-DeleteServersAdminTestJSON-1461254374 Aug 07 01:10:48.133976 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 010ea68aed824d6bac970360d34ab747 Aug 07 01:10:48.133976 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1461254374 Aug 07 01:10:48.133976 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-DeleteServersAdminTestJSON-1461254374-project Aug 07 01:10:48.133976 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:10:48.133976 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:10:48.133976 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 909b8165f015473c9977ef92aaf0741b Aug 07 01:10:48.133976 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-DeleteServersAdminTestJSON-1461254374-project Aug 07 01:10:48.133976 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:10:48.133976 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 1d21a372-3326-418d-9a1f-eb2a2720fca1 could not be found. Aug 07 01:10:48.133976 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '1d21a372-3326-418d-9a1f-eb2a2720fca1'} Aug 07 01:10:48.134647 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:48.134647 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:48.134647 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:10:48.134647 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:10:48.134647 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:10:48.134647 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:10:48.134647 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:10:48.134647 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:10:48.134647 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:10:48.134647 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:10:48.134647 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d21a372-3326-418d-9a1f-eb2a2720fca1 could not be found. Aug 07 01:10:48.134647 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:48.134647 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:48.134647 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:48.134647 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:48.134647 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:48.134647 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:48.134647 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:48.134647 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:48.134647 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:48.135858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:48.135858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:10:48.135858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:10:48.135858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:10:48.135858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:10:48.135858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:10:48.135858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:10:48.135858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:10:48.135858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:10:48.135858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d21a372-3326-418d-9a1f-eb2a2720fca1 could not be found. Aug 07 01:10:48.135858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:48.135858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:48.135858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:48.135858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:48.135858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:48.135858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:48.135858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:10:48.135858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:10:48.135858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d21a372-3326-418d-9a1f-eb2a2720fca1 could not be found. Aug 07 01:10:48.135858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:48.138267 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-79253bfd-24d7-418d-a330-4a49a9a0f4a5 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Returning 404 to user: Instance 1d21a372-3326-418d-9a1f-eb2a2720fca1 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:48.139374 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-79253bfd-24d7-418d-a330-4a49a9a0f4a5 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1" status: 404 len: 111 microversion: 2.1 time: 0.127319 Aug 07 01:10:48.140623 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 175/322] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:10:48 2022] DELETE /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:10:48.153400 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a6af4062-223c-4852-bb12-9508931ee97c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:48.158893 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a6af4062-223c-4852-bb12-9508931ee97c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: 1d21a372-3326-418d-9a1f-eb2a2720fca1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:48.182015 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a6af4062-223c-4852-bb12-9508931ee97c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:48.184249 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a6af4062-223c-4852-bb12-9508931ee97c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:48.186064 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a6af4062-223c-4852-bb12-9508931ee97c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:48.187449 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a6af4062-223c-4852-bb12-9508931ee97c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:48.189826 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a6af4062-223c-4852-bb12-9508931ee97c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:48.191451 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a6af4062-223c-4852-bb12-9508931ee97c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:48.244346 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-a6af4062-223c-4852-bb12-9508931ee97c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] HTTP exception thrown: Instance 1d21a372-3326-418d-9a1f-eb2a2720fca1 could not be found. Aug 07 01:10:48.247549 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a6af4062-223c-4852-bb12-9508931ee97c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Request method failure captured: Aug 07 01:10:48.247549 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1 HTTP/1.1 Aug 07 01:10:48.247549 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:10:48.247549 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:10:48.247549 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:10:48.247549 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:10:48.247549 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:10:48.247549 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:10:48.247549 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:10:48.247549 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:48.247549 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xDMrB5sW_jCj6yEHfXgRfpkPNRZlz8KeTmDaGz_lSyfZYqetKyiW_zrxvysqMSss0UVN_I7g5FxCtQIziR1yrWUCFUO79-2SbZhlRuflLXizITdCWnjIGaG_6AVuHEP_Mcep1lp9grpHsUXD_83xXw90LL_gN3ChBbIL3YzAJRNtJs Aug 07 01:10:48.247549 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:10:48.247549 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:10:48.247549 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:10:48.247549 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:10:48.247549 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:10:48.247549 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:10:48.247549 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 010ea68aed824d6bac970360d34ab747 Aug 07 01:10:48.247549 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1461254374 Aug 07 01:10:48.247549 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:10:48.247549 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:10:48.250229 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/010ea68aed824d6bac970360d34ab747"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_010ea68aed824d6bac970360d34ab747", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/010ea68aed824d6bac970360d34ab747"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/010ea68aed824d6bac970360d34ab747"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:48.250229 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-DeleteServersAdminTestJSON-1461254374 Aug 07 01:10:48.250229 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 010ea68aed824d6bac970360d34ab747 Aug 07 01:10:48.250229 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1461254374 Aug 07 01:10:48.250229 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-DeleteServersAdminTestJSON-1461254374-project Aug 07 01:10:48.250229 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:10:48.250229 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:10:48.250229 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 909b8165f015473c9977ef92aaf0741b Aug 07 01:10:48.250229 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-DeleteServersAdminTestJSON-1461254374-project Aug 07 01:10:48.250229 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:10:48.250229 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 1d21a372-3326-418d-9a1f-eb2a2720fca1 could not be found. Aug 07 01:10:48.250229 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '1d21a372-3326-418d-9a1f-eb2a2720fca1'} Aug 07 01:10:48.251608 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:48.251608 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:48.251608 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:10:48.251608 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:10:48.251608 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:10:48.251608 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:10:48.251608 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:10:48.251608 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:10:48.251608 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:10:48.251608 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:10:48.251608 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d21a372-3326-418d-9a1f-eb2a2720fca1 could not be found. Aug 07 01:10:48.251608 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:48.251608 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:48.251608 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:48.251608 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:48.251608 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:48.251608 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:48.251608 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:48.251608 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:48.251608 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:48.253899 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:48.253899 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:10:48.253899 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:10:48.253899 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:10:48.253899 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:10:48.253899 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:10:48.253899 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:10:48.253899 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d21a372-3326-418d-9a1f-eb2a2720fca1 could not be found. Aug 07 01:10:48.253899 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:48.253899 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:48.253899 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:48.253899 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:48.253899 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:48.253899 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:48.253899 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:10:48.253899 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:10:48.253899 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d21a372-3326-418d-9a1f-eb2a2720fca1 could not be found. Aug 07 01:10:48.253899 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:48.257219 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a6af4062-223c-4852-bb12-9508931ee97c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Returning 404 to user: Instance 1d21a372-3326-418d-9a1f-eb2a2720fca1 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:48.264432 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a6af4062-223c-4852-bb12-9508931ee97c tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1" status: 404 len: 111 microversion: 2.1 time: 0.108964 Aug 07 01:10:48.266438 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 176/323] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:48 2022] GET /compute/v2.1/servers/1d21a372-3326-418d-9a1f-eb2a2720fca1 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:10:48.280846 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6b721e4f-51e4-49bb-906d-717df0287930 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:48.285941 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6b721e4f-51e4-49bb-906d-717df0287930 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: f11385ef-0cd8-406a-b905-81a8a6512ebe] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:48.299582 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b721e4f-51e4-49bb-906d-717df0287930 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:48.310751 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b721e4f-51e4-49bb-906d-717df0287930 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:48.311380 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b721e4f-51e4-49bb-906d-717df0287930 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:48.312231 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b721e4f-51e4-49bb-906d-717df0287930 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:48.312884 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b721e4f-51e4-49bb-906d-717df0287930 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:48.313210 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b721e4f-51e4-49bb-906d-717df0287930 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:48.341264 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-6b721e4f-51e4-49bb-906d-717df0287930 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] HTTP exception thrown: Instance f11385ef-0cd8-406a-b905-81a8a6512ebe could not be found. Aug 07 01:10:48.343311 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6b721e4f-51e4-49bb-906d-717df0287930 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Request method failure captured: Aug 07 01:10:48.343311 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe HTTP/1.1 Aug 07 01:10:48.343311 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:10:48.343311 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:10:48.343311 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:10:48.343311 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:10:48.343311 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:10:48.343311 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:10:48.343311 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:10:48.343311 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:48.343311 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xDMrB5sW_jCj6yEHfXgRfpkPNRZlz8KeTmDaGz_lSyfZYqetKyiW_zrxvysqMSss0UVN_I7g5FxCtQIziR1yrWUCFUO79-2SbZhlRuflLXizITdCWnjIGaG_6AVuHEP_Mcep1lp9grpHsUXD_83xXw90LL_gN3ChBbIL3YzAJRNtJs Aug 07 01:10:48.343311 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:10:48.343311 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:10:48.343311 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:10:48.343311 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:10:48.343311 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:10:48.343311 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:10:48.343311 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 010ea68aed824d6bac970360d34ab747 Aug 07 01:10:48.343311 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1461254374 Aug 07 01:10:48.343311 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:10:48.343311 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:10:48.345055 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/010ea68aed824d6bac970360d34ab747"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_010ea68aed824d6bac970360d34ab747", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/010ea68aed824d6bac970360d34ab747"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/010ea68aed824d6bac970360d34ab747"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:48.345055 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-DeleteServersAdminTestJSON-1461254374 Aug 07 01:10:48.345055 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 010ea68aed824d6bac970360d34ab747 Aug 07 01:10:48.345055 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1461254374 Aug 07 01:10:48.345055 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-DeleteServersAdminTestJSON-1461254374-project Aug 07 01:10:48.345055 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:10:48.345055 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:10:48.345055 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 909b8165f015473c9977ef92aaf0741b Aug 07 01:10:48.345055 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-DeleteServersAdminTestJSON-1461254374-project Aug 07 01:10:48.345055 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:10:48.345055 n-d-master-1 devstack@n-api.service[119516]: exception: Instance f11385ef-0cd8-406a-b905-81a8a6512ebe could not be found. Aug 07 01:10:48.345055 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'f11385ef-0cd8-406a-b905-81a8a6512ebe'} Aug 07 01:10:48.345894 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:48.345894 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:48.345894 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:10:48.345894 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:10:48.345894 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:10:48.345894 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:10:48.345894 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:10:48.345894 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:10:48.345894 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:10:48.345894 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:10:48.345894 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f11385ef-0cd8-406a-b905-81a8a6512ebe could not be found. Aug 07 01:10:48.345894 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:48.345894 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:48.345894 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:48.345894 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:48.345894 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:48.345894 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:48.345894 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:48.345894 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:48.345894 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:48.347227 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:48.347227 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:10:48.347227 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:10:48.347227 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:10:48.347227 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:10:48.347227 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:10:48.347227 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:10:48.347227 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:10:48.347227 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:10:48.347227 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f11385ef-0cd8-406a-b905-81a8a6512ebe could not be found. Aug 07 01:10:48.347227 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:48.347227 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:48.347227 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:48.347227 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:48.347227 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:48.347227 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:48.347227 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:10:48.347227 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:10:48.347227 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f11385ef-0cd8-406a-b905-81a8a6512ebe could not be found. Aug 07 01:10:48.347227 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:48.351096 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6b721e4f-51e4-49bb-906d-717df0287930 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Returning 404 to user: Instance f11385ef-0cd8-406a-b905-81a8a6512ebe could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:48.353020 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6b721e4f-51e4-49bb-906d-717df0287930 tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe" status: 404 len: 111 microversion: 2.1 time: 0.080309 Aug 07 01:10:48.354373 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 177/324] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:10:48 2022] DELETE /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:10:48.378069 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3d976aaf-77e1-4ce9-930f-74e1e49654ed tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:48.379177 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3d976aaf-77e1-4ce9-930f-74e1e49654ed tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] [instance: f11385ef-0cd8-406a-b905-81a8a6512ebe] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:48.399162 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3d976aaf-77e1-4ce9-930f-74e1e49654ed tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:48.400227 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3d976aaf-77e1-4ce9-930f-74e1e49654ed tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:48.401117 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3d976aaf-77e1-4ce9-930f-74e1e49654ed tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:48.402301 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3d976aaf-77e1-4ce9-930f-74e1e49654ed tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:48.402984 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3d976aaf-77e1-4ce9-930f-74e1e49654ed tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:48.403788 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3d976aaf-77e1-4ce9-930f-74e1e49654ed tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:48.434728 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-3d976aaf-77e1-4ce9-930f-74e1e49654ed tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] HTTP exception thrown: Instance f11385ef-0cd8-406a-b905-81a8a6512ebe could not be found. Aug 07 01:10:48.438050 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3d976aaf-77e1-4ce9-930f-74e1e49654ed tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Request method failure captured: Aug 07 01:10:48.438050 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe HTTP/1.1 Aug 07 01:10:48.438050 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:10:48.438050 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:10:48.438050 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:10:48.438050 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:10:48.438050 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:10:48.438050 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:10:48.438050 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:10:48.438050 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:48.438050 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xDMrB5sW_jCj6yEHfXgRfpkPNRZlz8KeTmDaGz_lSyfZYqetKyiW_zrxvysqMSss0UVN_I7g5FxCtQIziR1yrWUCFUO79-2SbZhlRuflLXizITdCWnjIGaG_6AVuHEP_Mcep1lp9grpHsUXD_83xXw90LL_gN3ChBbIL3YzAJRNtJs Aug 07 01:10:48.438050 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:10:48.438050 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:10:48.438050 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:10:48.438050 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:10:48.438050 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:10:48.438050 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:10:48.438050 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 010ea68aed824d6bac970360d34ab747 Aug 07 01:10:48.438050 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1461254374 Aug 07 01:10:48.438050 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:10:48.438050 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:10:48.439769 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/010ea68aed824d6bac970360d34ab747"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_010ea68aed824d6bac970360d34ab747", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/010ea68aed824d6bac970360d34ab747"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/010ea68aed824d6bac970360d34ab747"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:48.439769 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-DeleteServersAdminTestJSON-1461254374 Aug 07 01:10:48.439769 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 010ea68aed824d6bac970360d34ab747 Aug 07 01:10:48.439769 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1461254374 Aug 07 01:10:48.439769 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-DeleteServersAdminTestJSON-1461254374-project Aug 07 01:10:48.439769 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:10:48.439769 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:10:48.439769 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 909b8165f015473c9977ef92aaf0741b Aug 07 01:10:48.439769 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-DeleteServersAdminTestJSON-1461254374-project Aug 07 01:10:48.439769 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:10:48.439769 n-d-master-1 devstack@n-api.service[119516]: exception: Instance f11385ef-0cd8-406a-b905-81a8a6512ebe could not be found. Aug 07 01:10:48.439769 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'f11385ef-0cd8-406a-b905-81a8a6512ebe'} Aug 07 01:10:48.440665 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:48.440665 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:48.440665 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:10:48.440665 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:10:48.440665 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:10:48.440665 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:10:48.440665 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:10:48.440665 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:10:48.440665 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:10:48.440665 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:10:48.440665 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f11385ef-0cd8-406a-b905-81a8a6512ebe could not be found. Aug 07 01:10:48.440665 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:48.440665 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:48.440665 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:48.440665 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:48.440665 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:48.440665 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:48.440665 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:48.440665 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:48.440665 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:48.442024 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:48.442024 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:10:48.442024 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:10:48.442024 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:10:48.442024 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:10:48.442024 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:10:48.442024 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:10:48.442024 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f11385ef-0cd8-406a-b905-81a8a6512ebe could not be found. Aug 07 01:10:48.442024 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:48.442024 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:48.442024 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:48.442024 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:48.442024 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:48.442024 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:48.442024 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:10:48.442024 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:10:48.442024 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f11385ef-0cd8-406a-b905-81a8a6512ebe could not be found. Aug 07 01:10:48.442024 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:48.446708 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3d976aaf-77e1-4ce9-930f-74e1e49654ed tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] Returning 404 to user: Instance f11385ef-0cd8-406a-b905-81a8a6512ebe could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:48.448796 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3d976aaf-77e1-4ce9-930f-74e1e49654ed tempest-DeleteServersAdminTestJSON-1461254374 tempest-DeleteServersAdminTestJSON-1461254374-project] 10.222.0.39 "GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe" status: 404 len: 111 microversion: 2.1 time: 0.086237 Aug 07 01:10:48.452225 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 178/325] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:48 2022] GET /compute/v2.1/servers/f11385ef-0cd8-406a-b905-81a8a6512ebe => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:10:50.097268 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=36,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:51.250436 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-67d4303d-c98b-497e-8ded-33ba398ddd86 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:10:51.251618 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-67d4303d-c98b-497e-8ded-33ba398ddd86 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:10:51.252721 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-67d4303d-c98b-497e-8ded-33ba398ddd86 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:10:51.253524 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-67d4303d-c98b-497e-8ded-33ba398ddd86 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:10:51.256265 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-67d4303d-c98b-497e-8ded-33ba398ddd86 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:10:51.298445 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-67d4303d-c98b-497e-8ded-33ba398ddd86 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:51.300463 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-67d4303d-c98b-497e-8ded-33ba398ddd86 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:51.301547 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-67d4303d-c98b-497e-8ded-33ba398ddd86 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:51.303409 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-67d4303d-c98b-497e-8ded-33ba398ddd86 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:51.305273 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-67d4303d-c98b-497e-8ded-33ba398ddd86 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:51.306461 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-67d4303d-c98b-497e-8ded-33ba398ddd86 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:51.360873 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-67d4303d-c98b-497e-8ded-33ba398ddd86 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Getting quotas for project ba9e7a1c1fe14f47b5a5acf2fe8893b5. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:10:51.374329 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-67d4303d-c98b-497e-8ded-33ba398ddd86 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Getting quotas for user 0327f14a188e45fba98a58e5fd061248 and project ba9e7a1c1fe14f47b5a5acf2fe8893b5. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:10:51.408418 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-67d4303d-c98b-497e-8ded-33ba398ddd86 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:10:51.414538 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-67d4303d-c98b-497e-8ded-33ba398ddd86 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:10:51.637840 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-67d4303d-c98b-497e-8ded-33ba398ddd86 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.415845 Aug 07 01:10:51.646003 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 148/326] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:10:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 6425 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 07 01:10:51.672641 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f9531760-f9ea-4793-bb80-52a34fd53058 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:51.677912 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f9531760-f9ea-4793-bb80-52a34fd53058 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:52.588748 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d2f707cf-6e49-4214-b62c-0ae7c93fb0c4 tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] Calling method '.version_select at 0x7f9e2504d550>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:52.603713 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:52.603713 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:52.617996 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2f707cf-6e49-4214-b62c-0ae7c93fb0c4 tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:52.619196 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2f707cf-6e49-4214-b62c-0ae7c93fb0c4 tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:52.620245 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2f707cf-6e49-4214-b62c-0ae7c93fb0c4 tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:52.623811 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2f707cf-6e49-4214-b62c-0ae7c93fb0c4 tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:52.628933 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2f707cf-6e49-4214-b62c-0ae7c93fb0c4 tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:52.630130 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2f707cf-6e49-4214-b62c-0ae7c93fb0c4 tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:52.905193 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d2f707cf-6e49-4214-b62c-0ae7c93fb0c4 tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 1.210363 Aug 07 01:10:52.906225 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 149/327] 10.222.0.39 () {58 vars in 1128 bytes} [Sun Aug 7 01:10:51 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:10:53.045840 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f9531760-f9ea-4793-bb80-52a34fd53058 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:53.087437 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f9531760-f9ea-4793-bb80-52a34fd53058 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0" status: 200 len: 1210 microversion: 2.1 time: 1.424688 Aug 07 01:10:53.118895 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 179/328] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:51 2022] GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 => generated 1210 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:54.033616 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d41603bb-4114-468b-aee7-67f41775721d tempest-HostsAdminNegativeTestJSON-1292933496 tempest-HostsAdminNegativeTestJSON-1292933496-project] Calling method '.version_select at 0x7f9e2504d790>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:54.036264 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:54.036264 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:54.037613 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d41603bb-4114-468b-aee7-67f41775721d tempest-HostsAdminNegativeTestJSON-1292933496 tempest-HostsAdminNegativeTestJSON-1292933496-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '8e897f44489c4006a81baa41ca1d5a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cb02b703124a7bb199b9a798f1beb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:54.050731 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d41603bb-4114-468b-aee7-67f41775721d tempest-HostsAdminNegativeTestJSON-1292933496 tempest-HostsAdminNegativeTestJSON-1292933496-project] Request method failure captured: Aug 07 01:10:54.050731 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 07 01:10:54.050731 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:10:54.050731 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:10:54.050731 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:10:54.050731 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:10:54.050731 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:10:54.050731 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:10:54.050731 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:10:54.050731 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:54.050731 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xEWkbdM4TSw7V7VKetOYbupRPFbfnqw9n5MWDQi6fXC_FcT_a1gfBDdH48y-Pmsq9VdCgkQMjO7mhwVdXcmmljpx9ZOup-5qu8bzhzXknNtW2IfkkC3i0bA0iAt0ndrO2TrbFPpA1wgog0U1cnqvTyY4WwMjIAPrPgX_l3-brh5Yz0 Aug 07 01:10:54.050731 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:10:54.050731 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:10:54.050731 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:10:54.050731 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:10:54.050731 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:10:54.050731 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:10:54.050731 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: f7cb02b703124a7bb199b9a798f1beb0 Aug 07 01:10:54.050731 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1292933496 Aug 07 01:10:54.050731 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:10:54.050731 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:10:54.052475 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f7cb02b703124a7bb199b9a798f1beb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f7cb02b703124a7bb199b9a798f1beb0", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f7cb02b703124a7bb199b9a798f1beb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f7cb02b703124a7bb199b9a798f1beb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:54.052475 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1292933496 Aug 07 01:10:54.052475 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: f7cb02b703124a7bb199b9a798f1beb0 Aug 07 01:10:54.052475 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1292933496 Aug 07 01:10:54.052475 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-HostsAdminNegativeTestJSON-1292933496-project Aug 07 01:10:54.052475 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:10:54.052475 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:10:54.052475 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 8e897f44489c4006a81baa41ca1d5a1e Aug 07 01:10:54.052475 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1292933496-project Aug 07 01:10:54.052475 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:10:54.052475 n-d-master-1 devstack@n-api.service[119517]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 07 01:10:54.052475 n-d-master-1 devstack@n-api.service[119517]: action_args: {} Aug 07 01:10:54.052475 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:54.053257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:54.053257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:54.053257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:54.053257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:54.053257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:54.053257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:10:54.053257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:10:54.053257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 07 01:10:54.053257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:10:54.053257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:54.053257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:54.053257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 07 01:10:54.053257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 07 01:10:54.053257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 07 01:10:54.053257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 07 01:10:54.053257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 07 01:10:54.053257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 07 01:10:54.053257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:10:54.053257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:10:54.054886 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:10:54.054886 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:10:54.054886 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 07 01:10:54.054886 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 07 01:10:54.054886 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 07 01:10:54.054886 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 07 01:10:54.054886 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 07 01:10:54.054886 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 07 01:10:54.054886 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 07 01:10:54.054886 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.054886 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:54.054886 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.054886 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:54.054886 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:54.054886 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:54.054886 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 07 01:10:54.054886 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 07 01:10:54.054886 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 07 01:10:54.054886 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.060870 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d41603bb-4114-468b-aee7-67f41775721d tempest-HostsAdminNegativeTestJSON-1292933496 tempest-HostsAdminNegativeTestJSON-1292933496-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:54.064302 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d41603bb-4114-468b-aee7-67f41775721d tempest-HostsAdminNegativeTestJSON-1292933496 tempest-HostsAdminNegativeTestJSON-1292933496-project] 10.222.0.39 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 1.141407 Aug 07 01:10:54.071467 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 150/329] 10.222.0.39 () {58 vars in 1128 bytes} [Sun Aug 7 01:10:52 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 1150 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:10:54.079107 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6183670e-18c7-4c92-9a19-40c73b347afc tempest-HostsAdminNegativeTestJSON-1292933496 tempest-HostsAdminNegativeTestJSON-1292933496-project] Calling method '.version_select at 0x7f9e250ba940>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:54.081122 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:54.081122 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:10:54.085233 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6183670e-18c7-4c92-9a19-40c73b347afc tempest-HostsAdminNegativeTestJSON-1292933496 tempest-HostsAdminNegativeTestJSON-1292933496-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '8e897f44489c4006a81baa41ca1d5a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cb02b703124a7bb199b9a798f1beb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:54.097867 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6183670e-18c7-4c92-9a19-40c73b347afc tempest-HostsAdminNegativeTestJSON-1292933496 tempest-HostsAdminNegativeTestJSON-1292933496-project] Request method failure captured: Aug 07 01:10:54.097867 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/os-hosts/n-d-master-1/reboot HTTP/1.1 Aug 07 01:10:54.097867 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:10:54.097867 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:10:54.097867 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:10:54.097867 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:10:54.097867 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:10:54.097867 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:10:54.097867 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:10:54.097867 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:54.097867 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xEWkbdM4TSw7V7VKetOYbupRPFbfnqw9n5MWDQi6fXC_FcT_a1gfBDdH48y-Pmsq9VdCgkQMjO7mhwVdXcmmljpx9ZOup-5qu8bzhzXknNtW2IfkkC3i0bA0iAt0ndrO2TrbFPpA1wgog0U1cnqvTyY4WwMjIAPrPgX_l3-brh5Yz0 Aug 07 01:10:54.097867 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:10:54.097867 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:10:54.097867 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:10:54.097867 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:10:54.097867 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:10:54.097867 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:10:54.097867 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: f7cb02b703124a7bb199b9a798f1beb0 Aug 07 01:10:54.097867 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1292933496 Aug 07 01:10:54.097867 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:10:54.097867 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:10:54.099510 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f7cb02b703124a7bb199b9a798f1beb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f7cb02b703124a7bb199b9a798f1beb0", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f7cb02b703124a7bb199b9a798f1beb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f7cb02b703124a7bb199b9a798f1beb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:54.099510 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1292933496 Aug 07 01:10:54.099510 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: f7cb02b703124a7bb199b9a798f1beb0 Aug 07 01:10:54.099510 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1292933496 Aug 07 01:10:54.099510 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-HostsAdminNegativeTestJSON-1292933496-project Aug 07 01:10:54.099510 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:10:54.099510 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:10:54.099510 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 8e897f44489c4006a81baa41ca1d5a1e Aug 07 01:10:54.099510 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1292933496-project Aug 07 01:10:54.099510 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:10:54.099510 n-d-master-1 devstack@n-api.service[119516]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 07 01:10:54.099510 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'n-d-master-1'} Aug 07 01:10:54.099510 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:54.100506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:54.100506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:54.100506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:54.100506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:54.100506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:54.100506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:10:54.100506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:10:54.100506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:54.100506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:54.100506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 07 01:10:54.100506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 07 01:10:54.100506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 07 01:10:54.100506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 07 01:10:54.100506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 07 01:10:54.100506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 07 01:10:54.100506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:10:54.100506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:10:54.100506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:10:54.100506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:10:54.101607 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 07 01:10:54.101607 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 07 01:10:54.101607 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 07 01:10:54.101607 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 07 01:10:54.101607 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 07 01:10:54.101607 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 07 01:10:54.101607 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 07 01:10:54.101607 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.101607 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:54.101607 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.101607 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:54.101607 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:54.101607 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:54.101607 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 07 01:10:54.101607 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 07 01:10:54.101607 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 07 01:10:54.101607 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.103554 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6183670e-18c7-4c92-9a19-40c73b347afc tempest-HostsAdminNegativeTestJSON-1292933496 tempest-HostsAdminNegativeTestJSON-1292933496-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:54.103554 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6183670e-18c7-4c92-9a19-40c73b347afc tempest-HostsAdminNegativeTestJSON-1292933496 tempest-HostsAdminNegativeTestJSON-1292933496-project] 10.222.0.39 "GET /compute/v2.1/os-hosts/n-d-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.027771 Aug 07 01:10:54.115703 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 180/330] 10.222.0.39 () {58 vars in 1188 bytes} [Sun Aug 7 01:10:54 2022] GET /compute/v2.1/os-hosts/n-d-master-1/reboot => generated 111 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:10:54.126519 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a2b86622-cf5b-4970-88c7-c925e4764bff tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] Calling method '.version_select at 0x7f9e24f180d0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:54.127932 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:54.127932 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:54.130532 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-aeaef3af-79ba-4fd3-bdbb-7b63b3f1a9bd tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:54.131555 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-aeaef3af-79ba-4fd3-bdbb-7b63b3f1a9bd tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:54.144396 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-a2b86622-cf5b-4970-88c7-c925e4764bff tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 07 01:10:54.147487 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a2b86622-cf5b-4970-88c7-c925e4764bff tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] Request method failure captured: Aug 07 01:10:54.147487 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 07 01:10:54.147487 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:10:54.147487 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:10:54.147487 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:10:54.147487 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:10:54.147487 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:10:54.147487 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:10:54.147487 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:10:54.147487 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:54.147487 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xEbaPIWX29gq1W2DJqBBA5NBz4-9m-W9_eJZJQlqaNvNwytptm5Gsgj31FYZfyWYyCFL0pu-ph_ihkwV_5rd2tUUp0AN_Lu2SWxy4rKBUtmznrjv7t0QgkNrgoRi6ctoDa1GglJrkD-OSO1XcvMEemEHbWo442wlHwCZ8-Vndkwff0 Aug 07 01:10:54.147487 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:10:54.147487 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:10:54.147487 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:10:54.147487 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:10:54.147487 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:10:54.147487 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:10:54.147487 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 47b1fddf09644b6680321adadf6833fe Aug 07 01:10:54.147487 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1917977865 Aug 07 01:10:54.147487 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,admin,member Aug 07 01:10:54.147487 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,admin,member Aug 07 01:10:54.149333 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/47b1fddf09644b6680321adadf6833fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_47b1fddf09644b6680321adadf6833fe", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/47b1fddf09644b6680321adadf6833fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/47b1fddf09644b6680321adadf6833fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:54.149333 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1917977865 Aug 07 01:10:54.149333 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 47b1fddf09644b6680321adadf6833fe Aug 07 01:10:54.149333 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1917977865 Aug 07 01:10:54.149333 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-HostsAdminNegativeTestJSON-1917977865-project-admin Aug 07 01:10:54.149333 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:10:54.149333 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:10:54.149333 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 5f63191ef3b9460aa302dbd56324e94f Aug 07 01:10:54.149333 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1917977865-project-admin Aug 07 01:10:54.149333 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:10:54.149333 n-d-master-1 devstack@n-api.service[119517]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 07 01:10:54.149333 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'nonexistent_hostname'} Aug 07 01:10:54.149333 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:54.150234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:54.150234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 07 01:10:54.150234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 07 01:10:54.150234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 07 01:10:54.150234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 07 01:10:54.150234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:10:54.150234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:10:54.150234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:10:54.150234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:10:54.150234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 07 01:10:54.150234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 07 01:10:54.150234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 07 01:10:54.150234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 07 01:10:54.150234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:10:54.150234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:10:54.150234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 07 01:10:54.150234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 07 01:10:54.150234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 07 01:10:54.150234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 07 01:10:54.151570 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 07 01:10:54.151570 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 07 01:10:54.151570 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 07 01:10:54.151570 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.151570 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:54.151570 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.151570 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:54.151570 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:54.151570 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:54.151570 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:54.151570 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:54.151570 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:10:54.151570 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:10:54.151570 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:54.151570 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:54.151570 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 07 01:10:54.151570 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 07 01:10:54.151570 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 07 01:10:54.151570 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:10:54.152791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 07 01:10:54.152791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.152791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:54.152791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.152791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:54.152791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:54.152791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:54.152791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:10:54.152791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:10:54.152791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 07 01:10:54.152791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.155493 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a2b86622-cf5b-4970-88c7-c925e4764bff tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:54.157082 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a2b86622-cf5b-4970-88c7-c925e4764bff tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.045586 Aug 07 01:10:54.158133 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 151/331] 10.222.0.39 () {58 vars in 1212 bytes} [Sun Aug 7 01:10:54 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:10:54.173993 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aeaef3af-79ba-4fd3-bdbb-7b63b3f1a9bd tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:54.174945 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aeaef3af-79ba-4fd3-bdbb-7b63b3f1a9bd tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:54.177350 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aeaef3af-79ba-4fd3-bdbb-7b63b3f1a9bd tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:54.180462 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aeaef3af-79ba-4fd3-bdbb-7b63b3f1a9bd tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:54.181564 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aeaef3af-79ba-4fd3-bdbb-7b63b3f1a9bd tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:54.182447 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aeaef3af-79ba-4fd3-bdbb-7b63b3f1a9bd tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:54.191690 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d2482ac5-d90a-4406-880c-4c45586e5cde tempest-HostsAdminNegativeTestJSON-1292933496 tempest-HostsAdminNegativeTestJSON-1292933496-project] Calling method '.version_select at 0x7f9e24fa9ee0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:54.196871 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:54.196871 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:54.199276 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d2482ac5-d90a-4406-880c-4c45586e5cde tempest-HostsAdminNegativeTestJSON-1292933496 tempest-HostsAdminNegativeTestJSON-1292933496-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '8e897f44489c4006a81baa41ca1d5a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cb02b703124a7bb199b9a798f1beb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:54.202171 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d2482ac5-d90a-4406-880c-4c45586e5cde tempest-HostsAdminNegativeTestJSON-1292933496 tempest-HostsAdminNegativeTestJSON-1292933496-project] Request method failure captured: Aug 07 01:10:54.202171 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Aug 07 01:10:54.202171 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:10:54.202171 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:10:54.202171 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:10:54.202171 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:10:54.202171 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:10:54.202171 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:10:54.202171 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:10:54.202171 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:54.202171 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xEWkbdM4TSw7V7VKetOYbupRPFbfnqw9n5MWDQi6fXC_FcT_a1gfBDdH48y-Pmsq9VdCgkQMjO7mhwVdXcmmljpx9ZOup-5qu8bzhzXknNtW2IfkkC3i0bA0iAt0ndrO2TrbFPpA1wgog0U1cnqvTyY4WwMjIAPrPgX_l3-brh5Yz0 Aug 07 01:10:54.202171 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:10:54.202171 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:10:54.202171 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:10:54.202171 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:10:54.202171 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:10:54.202171 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:10:54.202171 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: f7cb02b703124a7bb199b9a798f1beb0 Aug 07 01:10:54.202171 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1292933496 Aug 07 01:10:54.202171 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:10:54.202171 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:10:54.203590 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f7cb02b703124a7bb199b9a798f1beb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f7cb02b703124a7bb199b9a798f1beb0", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f7cb02b703124a7bb199b9a798f1beb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f7cb02b703124a7bb199b9a798f1beb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:54.203590 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1292933496 Aug 07 01:10:54.203590 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: f7cb02b703124a7bb199b9a798f1beb0 Aug 07 01:10:54.203590 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1292933496 Aug 07 01:10:54.203590 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-HostsAdminNegativeTestJSON-1292933496-project Aug 07 01:10:54.203590 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:10:54.203590 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:10:54.203590 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 8e897f44489c4006a81baa41ca1d5a1e Aug 07 01:10:54.203590 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1292933496-project Aug 07 01:10:54.203590 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:10:54.203590 n-d-master-1 devstack@n-api.service[119517]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 07 01:10:54.203590 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'n-d-master-1'} Aug 07 01:10:54.203590 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:54.204407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:54.204407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:54.204407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:54.204407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:54.204407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:54.204407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:10:54.204407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:10:54.204407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:54.204407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:54.204407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 07 01:10:54.204407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 07 01:10:54.204407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 07 01:10:54.204407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 07 01:10:54.204407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 07 01:10:54.204407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 07 01:10:54.204407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:10:54.204407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:10:54.204407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:10:54.204407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:10:54.205423 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 07 01:10:54.205423 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 07 01:10:54.205423 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 07 01:10:54.205423 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 07 01:10:54.205423 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 07 01:10:54.205423 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 07 01:10:54.205423 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 07 01:10:54.205423 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.205423 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:54.205423 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.205423 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:54.205423 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:54.205423 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:54.205423 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 07 01:10:54.205423 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 07 01:10:54.205423 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 07 01:10:54.205423 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.206374 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d2482ac5-d90a-4406-880c-4c45586e5cde tempest-HostsAdminNegativeTestJSON-1292933496 tempest-HostsAdminNegativeTestJSON-1292933496-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:54.213612 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d2482ac5-d90a-4406-880c-4c45586e5cde tempest-HostsAdminNegativeTestJSON-1292933496 tempest-HostsAdminNegativeTestJSON-1292933496-project] 10.222.0.39 "GET /compute/v2.1/os-hosts/n-d-master-1" status: 403 len: 109 microversion: 2.1 time: 0.034065 Aug 07 01:10:54.216469 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 152/332] 10.222.0.39 () {58 vars in 1167 bytes} [Sun Aug 7 01:10:54 2022] GET /compute/v2.1/os-hosts/n-d-master-1 => generated 109 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:10:54.229012 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9ab8c14f-f27b-4501-8801-34e254dedb43 tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] Calling method '.version_select at 0x7f9e24f03ca0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:54.245541 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-9ab8c14f-f27b-4501-8801-34e254dedb43 tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 07 01:10:54.248441 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9ab8c14f-f27b-4501-8801-34e254dedb43 tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] Request method failure captured: Aug 07 01:10:54.248441 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 07 01:10:54.248441 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:10:54.248441 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:10:54.248441 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:10:54.248441 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:10:54.248441 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:10:54.248441 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:10:54.248441 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:10:54.248441 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:54.248441 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xEbaPIWX29gq1W2DJqBBA5NBz4-9m-W9_eJZJQlqaNvNwytptm5Gsgj31FYZfyWYyCFL0pu-ph_ihkwV_5rd2tUUp0AN_Lu2SWxy4rKBUtmznrjv7t0QgkNrgoRi6ctoDa1GglJrkD-OSO1XcvMEemEHbWo442wlHwCZ8-Vndkwff0 Aug 07 01:10:54.248441 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:10:54.248441 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:10:54.248441 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:10:54.248441 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:10:54.248441 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:10:54.248441 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:10:54.248441 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 47b1fddf09644b6680321adadf6833fe Aug 07 01:10:54.248441 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1917977865 Aug 07 01:10:54.248441 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,admin,member Aug 07 01:10:54.248441 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,admin,member Aug 07 01:10:54.250906 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/47b1fddf09644b6680321adadf6833fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_47b1fddf09644b6680321adadf6833fe", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/47b1fddf09644b6680321adadf6833fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/47b1fddf09644b6680321adadf6833fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:54.250906 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1917977865 Aug 07 01:10:54.250906 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 47b1fddf09644b6680321adadf6833fe Aug 07 01:10:54.250906 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1917977865 Aug 07 01:10:54.250906 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-HostsAdminNegativeTestJSON-1917977865-project-admin Aug 07 01:10:54.250906 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:10:54.250906 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:10:54.250906 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 5f63191ef3b9460aa302dbd56324e94f Aug 07 01:10:54.250906 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1917977865-project-admin Aug 07 01:10:54.250906 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:10:54.250906 n-d-master-1 devstack@n-api.service[119517]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 07 01:10:54.250906 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'nonexistent_hostname'} Aug 07 01:10:54.250906 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:54.252491 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:54.252491 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 07 01:10:54.252491 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 07 01:10:54.252491 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:10:54.252491 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:10:54.252491 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 07 01:10:54.252491 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 07 01:10:54.252491 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 07 01:10:54.252491 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 07 01:10:54.252491 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 07 01:10:54.252491 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 07 01:10:54.252491 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 07 01:10:54.252491 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.252491 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:54.252491 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.252491 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:54.252491 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:54.252491 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:54.252491 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:54.262346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:54.262346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:10:54.262346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:10:54.262346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:54.262346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:54.262346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 07 01:10:54.262346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:10:54.262346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 07 01:10:54.262346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.262346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:54.262346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.262346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:54.262346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:54.262346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:54.262346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:10:54.262346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:10:54.262346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 07 01:10:54.262346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.265683 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9ab8c14f-f27b-4501-8801-34e254dedb43 tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:54.265683 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9ab8c14f-f27b-4501-8801-34e254dedb43 tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.030507 Aug 07 01:10:54.265683 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 153/333] 10.222.0.39 () {58 vars in 1191 bytes} [Sun Aug 7 01:10:54 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:10:54.275545 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b3d35373-8d4b-41d2-9ef4-7f8413dc93c4 tempest-HostsAdminNegativeTestJSON-1292933496 tempest-HostsAdminNegativeTestJSON-1292933496-project] Calling method '.version_select at 0x7f9e24fa9b80>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:54.277197 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:54.277197 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:54.279392 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b3d35373-8d4b-41d2-9ef4-7f8413dc93c4 tempest-HostsAdminNegativeTestJSON-1292933496 tempest-HostsAdminNegativeTestJSON-1292933496-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '8e897f44489c4006a81baa41ca1d5a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cb02b703124a7bb199b9a798f1beb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:54.294712 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b3d35373-8d4b-41d2-9ef4-7f8413dc93c4 tempest-HostsAdminNegativeTestJSON-1292933496 tempest-HostsAdminNegativeTestJSON-1292933496-project] Request method failure captured: Aug 07 01:10:54.294712 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/os-hosts/n-d-master-1/shutdown HTTP/1.1 Aug 07 01:10:54.294712 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:10:54.294712 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:10:54.294712 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:10:54.294712 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:10:54.294712 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:10:54.294712 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:10:54.294712 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:10:54.294712 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:54.294712 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xEWkbdM4TSw7V7VKetOYbupRPFbfnqw9n5MWDQi6fXC_FcT_a1gfBDdH48y-Pmsq9VdCgkQMjO7mhwVdXcmmljpx9ZOup-5qu8bzhzXknNtW2IfkkC3i0bA0iAt0ndrO2TrbFPpA1wgog0U1cnqvTyY4WwMjIAPrPgX_l3-brh5Yz0 Aug 07 01:10:54.294712 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:10:54.294712 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:10:54.294712 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:10:54.294712 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:10:54.294712 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:10:54.294712 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:10:54.294712 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: f7cb02b703124a7bb199b9a798f1beb0 Aug 07 01:10:54.294712 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1292933496 Aug 07 01:10:54.294712 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:10:54.294712 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:10:54.296170 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f7cb02b703124a7bb199b9a798f1beb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f7cb02b703124a7bb199b9a798f1beb0", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f7cb02b703124a7bb199b9a798f1beb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f7cb02b703124a7bb199b9a798f1beb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:54.296170 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1292933496 Aug 07 01:10:54.296170 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: f7cb02b703124a7bb199b9a798f1beb0 Aug 07 01:10:54.296170 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1292933496 Aug 07 01:10:54.296170 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-HostsAdminNegativeTestJSON-1292933496-project Aug 07 01:10:54.296170 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:10:54.296170 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:10:54.296170 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 8e897f44489c4006a81baa41ca1d5a1e Aug 07 01:10:54.296170 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1292933496-project Aug 07 01:10:54.296170 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:10:54.296170 n-d-master-1 devstack@n-api.service[119517]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 07 01:10:54.296170 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'n-d-master-1'} Aug 07 01:10:54.296170 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:54.296963 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:54.296963 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:54.296963 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:54.296963 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:54.296963 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:54.296963 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:10:54.296963 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:10:54.296963 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:54.296963 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:54.296963 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 07 01:10:54.296963 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 07 01:10:54.296963 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 07 01:10:54.296963 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 07 01:10:54.296963 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 07 01:10:54.296963 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 07 01:10:54.296963 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:10:54.296963 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:10:54.296963 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:10:54.296963 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:10:54.298614 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 07 01:10:54.298614 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 07 01:10:54.298614 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 07 01:10:54.298614 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 07 01:10:54.298614 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 07 01:10:54.298614 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 07 01:10:54.298614 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 07 01:10:54.298614 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.298614 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:54.298614 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.298614 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:54.298614 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:54.298614 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:54.298614 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 07 01:10:54.298614 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 07 01:10:54.298614 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 07 01:10:54.298614 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.299685 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b3d35373-8d4b-41d2-9ef4-7f8413dc93c4 tempest-HostsAdminNegativeTestJSON-1292933496 tempest-HostsAdminNegativeTestJSON-1292933496-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:54.299685 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b3d35373-8d4b-41d2-9ef4-7f8413dc93c4 tempest-HostsAdminNegativeTestJSON-1292933496 tempest-HostsAdminNegativeTestJSON-1292933496-project] 10.222.0.39 "GET /compute/v2.1/os-hosts/n-d-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.033582 Aug 07 01:10:54.312467 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 154/334] 10.222.0.39 () {58 vars in 1194 bytes} [Sun Aug 7 01:10:54 2022] GET /compute/v2.1/os-hosts/n-d-master-1/shutdown => generated 113 bytes in 50 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:10:54.340658 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-911f3e5b-22fc-479c-b821-3846162b92c8 tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] Calling method '.version_select at 0x7f9e24f030d0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:54.387126 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-911f3e5b-22fc-479c-b821-3846162b92c8 tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 07 01:10:54.397003 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-911f3e5b-22fc-479c-b821-3846162b92c8 tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] Request method failure captured: Aug 07 01:10:54.397003 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 07 01:10:54.397003 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:10:54.397003 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:10:54.397003 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:10:54.397003 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:10:54.397003 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:10:54.397003 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:10:54.397003 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:10:54.397003 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:54.397003 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xEbaPIWX29gq1W2DJqBBA5NBz4-9m-W9_eJZJQlqaNvNwytptm5Gsgj31FYZfyWYyCFL0pu-ph_ihkwV_5rd2tUUp0AN_Lu2SWxy4rKBUtmznrjv7t0QgkNrgoRi6ctoDa1GglJrkD-OSO1XcvMEemEHbWo442wlHwCZ8-Vndkwff0 Aug 07 01:10:54.397003 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:10:54.397003 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:10:54.397003 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:10:54.397003 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:10:54.397003 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:10:54.397003 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:10:54.397003 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 47b1fddf09644b6680321adadf6833fe Aug 07 01:10:54.397003 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1917977865 Aug 07 01:10:54.397003 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,admin,member Aug 07 01:10:54.397003 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,admin,member Aug 07 01:10:54.399717 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/47b1fddf09644b6680321adadf6833fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_47b1fddf09644b6680321adadf6833fe", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/47b1fddf09644b6680321adadf6833fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/47b1fddf09644b6680321adadf6833fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:54.399717 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1917977865 Aug 07 01:10:54.399717 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 47b1fddf09644b6680321adadf6833fe Aug 07 01:10:54.399717 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1917977865 Aug 07 01:10:54.399717 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-HostsAdminNegativeTestJSON-1917977865-project-admin Aug 07 01:10:54.399717 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:10:54.399717 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:10:54.399717 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 5f63191ef3b9460aa302dbd56324e94f Aug 07 01:10:54.399717 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1917977865-project-admin Aug 07 01:10:54.399717 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:10:54.399717 n-d-master-1 devstack@n-api.service[119517]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 07 01:10:54.399717 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'nonexistent_hostname'} Aug 07 01:10:54.399717 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:54.401675 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:54.401675 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 07 01:10:54.401675 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 07 01:10:54.401675 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 07 01:10:54.401675 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 07 01:10:54.401675 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:10:54.401675 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:10:54.401675 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:10:54.401675 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:10:54.401675 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 07 01:10:54.401675 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 07 01:10:54.401675 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 07 01:10:54.401675 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 07 01:10:54.401675 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:10:54.401675 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:10:54.401675 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 07 01:10:54.401675 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 07 01:10:54.401675 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 07 01:10:54.401675 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 07 01:10:54.405988 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 07 01:10:54.405988 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 07 01:10:54.405988 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 07 01:10:54.405988 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.405988 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:54.405988 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.405988 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:54.405988 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:54.405988 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:54.405988 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:54.405988 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:54.405988 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:10:54.405988 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:10:54.405988 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:54.405988 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:54.405988 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 07 01:10:54.405988 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 07 01:10:54.405988 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 07 01:10:54.405988 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:10:54.411023 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 07 01:10:54.411023 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.411023 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:54.411023 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.411023 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:54.411023 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:54.411023 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:54.411023 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:10:54.411023 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:10:54.411023 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 07 01:10:54.411023 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.415982 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-911f3e5b-22fc-479c-b821-3846162b92c8 tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:54.415982 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-911f3e5b-22fc-479c-b821-3846162b92c8 tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.101331 Aug 07 01:10:54.417681 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 155/335] 10.222.0.39 () {58 vars in 1218 bytes} [Sun Aug 7 01:10:54 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:10:54.425404 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-aeaef3af-79ba-4fd3-bdbb-7b63b3f1a9bd tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:54.447325 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c5a87494-a6a2-4649-9b3b-95ea933b8203 tempest-HostsAdminNegativeTestJSON-1292933496 tempest-HostsAdminNegativeTestJSON-1292933496-project] Calling method '.version_select at 0x7f9e24fa99d0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:54.457934 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:54.457934 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:54.461208 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-aeaef3af-79ba-4fd3-bdbb-7b63b3f1a9bd tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0" status: 200 len: 1262 microversion: 2.1 time: 0.332292 Aug 07 01:10:54.462587 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c5a87494-a6a2-4649-9b3b-95ea933b8203 tempest-HostsAdminNegativeTestJSON-1292933496 tempest-HostsAdminNegativeTestJSON-1292933496-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '8e897f44489c4006a81baa41ca1d5a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cb02b703124a7bb199b9a798f1beb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:54.476352 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 181/336] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:54 2022] GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 => generated 1262 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:10:54.494023 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c5a87494-a6a2-4649-9b3b-95ea933b8203 tempest-HostsAdminNegativeTestJSON-1292933496 tempest-HostsAdminNegativeTestJSON-1292933496-project] Request method failure captured: Aug 07 01:10:54.494023 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/os-hosts/n-d-master-1/startup HTTP/1.1 Aug 07 01:10:54.494023 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:10:54.494023 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:10:54.494023 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:10:54.494023 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:10:54.494023 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:10:54.494023 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:10:54.494023 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:10:54.494023 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:54.494023 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xEWkbdM4TSw7V7VKetOYbupRPFbfnqw9n5MWDQi6fXC_FcT_a1gfBDdH48y-Pmsq9VdCgkQMjO7mhwVdXcmmljpx9ZOup-5qu8bzhzXknNtW2IfkkC3i0bA0iAt0ndrO2TrbFPpA1wgog0U1cnqvTyY4WwMjIAPrPgX_l3-brh5Yz0 Aug 07 01:10:54.494023 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:10:54.494023 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:10:54.494023 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:10:54.494023 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:10:54.494023 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:10:54.494023 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:10:54.494023 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: f7cb02b703124a7bb199b9a798f1beb0 Aug 07 01:10:54.494023 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1292933496 Aug 07 01:10:54.494023 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:10:54.494023 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:10:54.496466 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f7cb02b703124a7bb199b9a798f1beb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f7cb02b703124a7bb199b9a798f1beb0", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f7cb02b703124a7bb199b9a798f1beb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f7cb02b703124a7bb199b9a798f1beb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:54.496466 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1292933496 Aug 07 01:10:54.496466 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: f7cb02b703124a7bb199b9a798f1beb0 Aug 07 01:10:54.496466 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1292933496 Aug 07 01:10:54.496466 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-HostsAdminNegativeTestJSON-1292933496-project Aug 07 01:10:54.496466 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:10:54.496466 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:10:54.496466 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 8e897f44489c4006a81baa41ca1d5a1e Aug 07 01:10:54.496466 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1292933496-project Aug 07 01:10:54.496466 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:10:54.496466 n-d-master-1 devstack@n-api.service[119517]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 07 01:10:54.496466 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'n-d-master-1'} Aug 07 01:10:54.496466 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:54.497844 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:54.497844 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:54.497844 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:54.497844 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:54.497844 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:54.497844 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:10:54.497844 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:10:54.497844 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:54.497844 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:54.497844 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 07 01:10:54.497844 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 07 01:10:54.497844 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 07 01:10:54.497844 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 07 01:10:54.497844 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 07 01:10:54.497844 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 07 01:10:54.497844 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:10:54.497844 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:10:54.497844 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:10:54.497844 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:10:54.499808 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 07 01:10:54.499808 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 07 01:10:54.499808 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 07 01:10:54.499808 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 07 01:10:54.499808 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 07 01:10:54.499808 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 07 01:10:54.499808 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 07 01:10:54.499808 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.499808 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:54.499808 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.499808 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:54.499808 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:54.499808 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:54.499808 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 07 01:10:54.499808 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 07 01:10:54.499808 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 07 01:10:54.499808 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.508360 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c5a87494-a6a2-4649-9b3b-95ea933b8203 tempest-HostsAdminNegativeTestJSON-1292933496 tempest-HostsAdminNegativeTestJSON-1292933496-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:54.508687 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c5a87494-a6a2-4649-9b3b-95ea933b8203 tempest-HostsAdminNegativeTestJSON-1292933496 tempest-HostsAdminNegativeTestJSON-1292933496-project] 10.222.0.39 "GET /compute/v2.1/os-hosts/n-d-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.073696 Aug 07 01:10:54.510597 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 156/337] 10.222.0.39 () {58 vars in 1191 bytes} [Sun Aug 7 01:10:54 2022] GET /compute/v2.1/os-hosts/n-d-master-1/startup => generated 110 bytes in 78 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:10:54.522290 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e30e2eec-fe18-4e7e-b13f-2a8c72ec2673 tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] Calling method '.version_select at 0x7f9e2516ddc0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:54.524409 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:54.524409 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:10:54.557118 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-e30e2eec-fe18-4e7e-b13f-2a8c72ec2673 tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 07 01:10:54.570372 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e30e2eec-fe18-4e7e-b13f-2a8c72ec2673 tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] Request method failure captured: Aug 07 01:10:54.570372 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 07 01:10:54.570372 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:10:54.570372 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:10:54.570372 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:10:54.570372 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:10:54.570372 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:10:54.570372 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:10:54.570372 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:10:54.570372 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:54.570372 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xEbaPIWX29gq1W2DJqBBA5NBz4-9m-W9_eJZJQlqaNvNwytptm5Gsgj31FYZfyWYyCFL0pu-ph_ihkwV_5rd2tUUp0AN_Lu2SWxy4rKBUtmznrjv7t0QgkNrgoRi6ctoDa1GglJrkD-OSO1XcvMEemEHbWo442wlHwCZ8-Vndkwff0 Aug 07 01:10:54.570372 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:10:54.570372 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:10:54.570372 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:10:54.570372 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:10:54.570372 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:10:54.570372 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:10:54.570372 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 47b1fddf09644b6680321adadf6833fe Aug 07 01:10:54.570372 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1917977865 Aug 07 01:10:54.570372 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,admin,member Aug 07 01:10:54.570372 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,admin,member Aug 07 01:10:54.571662 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/47b1fddf09644b6680321adadf6833fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_47b1fddf09644b6680321adadf6833fe", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/47b1fddf09644b6680321adadf6833fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/47b1fddf09644b6680321adadf6833fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:54.571662 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1917977865 Aug 07 01:10:54.571662 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 47b1fddf09644b6680321adadf6833fe Aug 07 01:10:54.571662 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1917977865 Aug 07 01:10:54.571662 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-HostsAdminNegativeTestJSON-1917977865-project-admin Aug 07 01:10:54.571662 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:10:54.571662 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:10:54.571662 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 5f63191ef3b9460aa302dbd56324e94f Aug 07 01:10:54.571662 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1917977865-project-admin Aug 07 01:10:54.571662 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:10:54.571662 n-d-master-1 devstack@n-api.service[119516]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 07 01:10:54.571662 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'nonexistent_hostname'} Aug 07 01:10:54.571662 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:54.572871 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:54.572871 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 07 01:10:54.572871 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 07 01:10:54.572871 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 07 01:10:54.572871 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 07 01:10:54.572871 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:10:54.572871 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:10:54.572871 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:10:54.572871 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:10:54.572871 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 07 01:10:54.572871 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 07 01:10:54.572871 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 07 01:10:54.572871 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 07 01:10:54.572871 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:10:54.572871 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:10:54.572871 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 07 01:10:54.572871 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 07 01:10:54.572871 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 07 01:10:54.572871 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 07 01:10:54.574317 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 07 01:10:54.574317 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 07 01:10:54.574317 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 07 01:10:54.574317 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.574317 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:54.574317 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.574317 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:54.574317 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:54.574317 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:54.574317 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:54.574317 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:54.574317 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:10:54.574317 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:10:54.574317 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:54.574317 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:54.574317 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 07 01:10:54.574317 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 07 01:10:54.574317 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 07 01:10:54.574317 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:10:54.575615 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 07 01:10:54.575615 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.575615 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:54.575615 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.575615 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:54.575615 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:54.575615 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:54.575615 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:10:54.575615 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:10:54.575615 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 07 01:10:54.575615 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.575615 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e30e2eec-fe18-4e7e-b13f-2a8c72ec2673 tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:54.579315 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e30e2eec-fe18-4e7e-b13f-2a8c72ec2673 tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.059059 Aug 07 01:10:54.582201 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 182/338] 10.222.0.39 () {58 vars in 1215 bytes} [Sun Aug 7 01:10:54 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:10:54.604972 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e2216383-9586-4162-8730-796d7f8cb163 tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] Action: 'update', calling method: .version_select at 0x7f9e2508f9d0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:54.625987 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e2216383-9586-4162-8730-796d7f8cb163 tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] Request method failure captured: Aug 07 01:10:54.625987 n-d-master-1 devstack@n-api.service[119516]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Aug 07 01:10:54.625987 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:10:54.625987 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:10:54.625987 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:10:54.625987 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 51 Aug 07 01:10:54.625987 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:10:54.625987 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:10:54.625987 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:10:54.625987 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:54.625987 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xEbaPIWX29gq1W2DJqBBA5NBz4-9m-W9_eJZJQlqaNvNwytptm5Gsgj31FYZfyWYyCFL0pu-ph_ihkwV_5rd2tUUp0AN_Lu2SWxy4rKBUtmznrjv7t0QgkNrgoRi6ctoDa1GglJrkD-OSO1XcvMEemEHbWo442wlHwCZ8-Vndkwff0 Aug 07 01:10:54.625987 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:10:54.625987 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:10:54.625987 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:10:54.625987 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:10:54.625987 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:10:54.625987 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:10:54.625987 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 47b1fddf09644b6680321adadf6833fe Aug 07 01:10:54.625987 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1917977865 Aug 07 01:10:54.625987 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,admin,member Aug 07 01:10:54.625987 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,admin,member Aug 07 01:10:54.627362 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/47b1fddf09644b6680321adadf6833fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_47b1fddf09644b6680321adadf6833fe", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/47b1fddf09644b6680321adadf6833fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/47b1fddf09644b6680321adadf6833fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:54.627362 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1917977865 Aug 07 01:10:54.627362 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 47b1fddf09644b6680321adadf6833fe Aug 07 01:10:54.627362 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1917977865 Aug 07 01:10:54.627362 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-HostsAdminNegativeTestJSON-1917977865-project-admin Aug 07 01:10:54.627362 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:10:54.627362 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:10:54.627362 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 5f63191ef3b9460aa302dbd56324e94f Aug 07 01:10:54.627362 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1917977865-project-admin Aug 07 01:10:54.627362 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:10:54.627362 n-d-master-1 devstack@n-api.service[119516]: {"status": "enable", "maintenance_mode": "invalid"} Aug 07 01:10:54.627362 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:10:54.627362 n-d-master-1 devstack@n-api.service[119516]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 07 01:10:54.628603 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 07 01:10:54.628603 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:54.628603 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:54.628603 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:10:54.628603 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:10:54.628603 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:10:54.628603 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:10:54.628603 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 07 01:10:54.628603 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.628603 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 07 01:10:54.628603 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 07 01:10:54.628603 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'disable', Aug 07 01:10:54.628603 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'Enable', Aug 07 01:10:54.628603 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'Disable', Aug 07 01:10:54.628603 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 07 01:10:54.628603 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 07 01:10:54.628603 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 07 01:10:54.628603 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.628603 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi On instance: Aug 07 01:10:54.628603 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'invalid' Aug 07 01:10:54.628603 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.628603 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:54.628603 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.628603 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:54.628603 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:54.630567 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:54.630567 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:54.630567 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:54.630567 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:10:54.630567 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:10:54.630567 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:54.630567 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:54.630567 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:10:54.630567 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:10:54.630567 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:10:54.630567 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:10:54.630567 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:10:54.630567 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:10:54.630567 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 07 01:10:54.630567 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.630567 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:54.630567 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.630567 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:54.630567 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:54.632924 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:54.632924 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:10:54.632924 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:10:54.632924 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 07 01:10:54.632924 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.632924 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e2216383-9586-4162-8730-796d7f8cb163 tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:54.632924 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e2216383-9586-4162-8730-796d7f8cb163 tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 199 microversion: 2.1 time: 0.032370 Aug 07 01:10:54.636721 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 183/339] 10.222.0.39 () {60 vars in 1187 bytes} [Sun Aug 7 01:10:54 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 199 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 07 01:10:54.664143 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4b614ef7-5161-44b8-8027-006b2367562a tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] Action: 'update', calling method: .version_select at 0x7f9e24fc4d30>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:54.684965 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4b614ef7-5161-44b8-8027-006b2367562a tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] Request method failure captured: Aug 07 01:10:54.684965 n-d-master-1 devstack@n-api.service[119516]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Aug 07 01:10:54.684965 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:10:54.684965 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:10:54.684965 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:10:54.684965 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 51 Aug 07 01:10:54.684965 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:10:54.684965 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:10:54.684965 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:10:54.684965 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:54.684965 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xEbaPIWX29gq1W2DJqBBA5NBz4-9m-W9_eJZJQlqaNvNwytptm5Gsgj31FYZfyWYyCFL0pu-ph_ihkwV_5rd2tUUp0AN_Lu2SWxy4rKBUtmznrjv7t0QgkNrgoRi6ctoDa1GglJrkD-OSO1XcvMEemEHbWo442wlHwCZ8-Vndkwff0 Aug 07 01:10:54.684965 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:10:54.684965 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:10:54.684965 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:10:54.684965 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:10:54.684965 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:10:54.684965 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:10:54.684965 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 47b1fddf09644b6680321adadf6833fe Aug 07 01:10:54.684965 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1917977865 Aug 07 01:10:54.684965 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,admin,member Aug 07 01:10:54.684965 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,admin,member Aug 07 01:10:54.687656 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/47b1fddf09644b6680321adadf6833fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_47b1fddf09644b6680321adadf6833fe", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/47b1fddf09644b6680321adadf6833fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/47b1fddf09644b6680321adadf6833fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:54.687656 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1917977865 Aug 07 01:10:54.687656 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 47b1fddf09644b6680321adadf6833fe Aug 07 01:10:54.687656 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1917977865 Aug 07 01:10:54.687656 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-HostsAdminNegativeTestJSON-1917977865-project-admin Aug 07 01:10:54.687656 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:10:54.687656 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:10:54.687656 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 5f63191ef3b9460aa302dbd56324e94f Aug 07 01:10:54.687656 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1917977865-project-admin Aug 07 01:10:54.687656 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:10:54.687656 n-d-master-1 devstack@n-api.service[119516]: {"status": "invalid", "maintenance_mode": "enable"} Aug 07 01:10:54.687656 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:10:54.687656 n-d-master-1 devstack@n-api.service[119516]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 07 01:10:54.689318 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 07 01:10:54.689318 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:54.689318 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:54.689318 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:10:54.689318 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:10:54.689318 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:10:54.689318 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:10:54.689318 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 07 01:10:54.689318 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.689318 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 07 01:10:54.689318 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 07 01:10:54.689318 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'disable', Aug 07 01:10:54.689318 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'Enable', Aug 07 01:10:54.689318 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'Disable', Aug 07 01:10:54.689318 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 07 01:10:54.689318 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 07 01:10:54.689318 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 07 01:10:54.689318 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.689318 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi On instance: Aug 07 01:10:54.689318 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'invalid' Aug 07 01:10:54.689318 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.689318 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:54.689318 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.689318 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:54.689318 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:54.692267 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:54.692267 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:54.692267 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:54.692267 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:10:54.692267 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:10:54.692267 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:54.692267 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:54.692267 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:10:54.692267 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:10:54.692267 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:10:54.692267 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:10:54.692267 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:10:54.692267 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:10:54.692267 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 07 01:10:54.692267 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.692267 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:54.692267 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.692267 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:54.692267 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:54.694906 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:54.694906 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:10:54.694906 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:10:54.694906 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 07 01:10:54.694906 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.694906 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4b614ef7-5161-44b8-8027-006b2367562a tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:54.699969 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4b614ef7-5161-44b8-8027-006b2367562a tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 189 microversion: 2.1 time: 0.044734 Aug 07 01:10:54.699969 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 184/340] 10.222.0.39 () {60 vars in 1187 bytes} [Sun Aug 7 01:10:54 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 189 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 07 01:10:54.722061 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cd97a7b1-b024-4ff6-8018-e362e85cf456 tempest-HostsAdminNegativeTestJSON-1292933496 tempest-HostsAdminNegativeTestJSON-1292933496-project] Action: 'update', calling method: .version_select at 0x7f9e2508fee0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:54.728857 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:54.728857 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:10:54.730325 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cd97a7b1-b024-4ff6-8018-e362e85cf456 tempest-HostsAdminNegativeTestJSON-1292933496 tempest-HostsAdminNegativeTestJSON-1292933496-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '8e897f44489c4006a81baa41ca1d5a1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7cb02b703124a7bb199b9a798f1beb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:54.738395 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cd97a7b1-b024-4ff6-8018-e362e85cf456 tempest-HostsAdminNegativeTestJSON-1292933496 tempest-HostsAdminNegativeTestJSON-1292933496-project] Request method failure captured: Aug 07 01:10:54.738395 n-d-master-1 devstack@n-api.service[119516]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Aug 07 01:10:54.738395 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:10:54.738395 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:10:54.738395 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:10:54.738395 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 50 Aug 07 01:10:54.738395 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:10:54.738395 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:10:54.738395 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:10:54.738395 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:54.738395 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xEWkbdM4TSw7V7VKetOYbupRPFbfnqw9n5MWDQi6fXC_FcT_a1gfBDdH48y-Pmsq9VdCgkQMjO7mhwVdXcmmljpx9ZOup-5qu8bzhzXknNtW2IfkkC3i0bA0iAt0ndrO2TrbFPpA1wgog0U1cnqvTyY4WwMjIAPrPgX_l3-brh5Yz0 Aug 07 01:10:54.738395 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:10:54.738395 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:10:54.738395 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:10:54.738395 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:10:54.738395 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:10:54.738395 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:10:54.738395 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: f7cb02b703124a7bb199b9a798f1beb0 Aug 07 01:10:54.738395 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1292933496 Aug 07 01:10:54.738395 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:10:54.738395 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:10:54.741098 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f7cb02b703124a7bb199b9a798f1beb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f7cb02b703124a7bb199b9a798f1beb0", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f7cb02b703124a7bb199b9a798f1beb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f7cb02b703124a7bb199b9a798f1beb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:54.741098 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1292933496 Aug 07 01:10:54.741098 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: f7cb02b703124a7bb199b9a798f1beb0 Aug 07 01:10:54.741098 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1292933496 Aug 07 01:10:54.741098 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-HostsAdminNegativeTestJSON-1292933496-project Aug 07 01:10:54.741098 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:10:54.741098 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:10:54.741098 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 8e897f44489c4006a81baa41ca1d5a1e Aug 07 01:10:54.741098 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1292933496-project Aug 07 01:10:54.741098 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:10:54.741098 n-d-master-1 devstack@n-api.service[119516]: {"status": "enable", "maintenance_mode": "enable"} Aug 07 01:10:54.741098 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:10:54.741098 n-d-master-1 devstack@n-api.service[119516]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 07 01:10:54.741098 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 07 01:10:54.742875 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:54.742875 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:54.742875 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:54.742875 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:54.742875 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:54.742875 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:54.742875 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:10:54.742875 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:10:54.742875 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:54.742875 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:54.742875 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:10:54.742875 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:10:54.742875 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 07 01:10:54.742875 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 07 01:10:54.742875 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 07 01:10:54.742875 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 07 01:10:54.742875 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 07 01:10:54.742875 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 07 01:10:54.742875 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:10:54.742875 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:10:54.745083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:10:54.745083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:10:54.745083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 07 01:10:54.745083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 07 01:10:54.745083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 07 01:10:54.745083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 07 01:10:54.745083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 07 01:10:54.745083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 07 01:10:54.745083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 07 01:10:54.745083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.745083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:54.745083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.745083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:54.745083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:54.745083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:54.745083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 07 01:10:54.745083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 07 01:10:54.745083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 07 01:10:54.745083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.747063 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cd97a7b1-b024-4ff6-8018-e362e85cf456 tempest-HostsAdminNegativeTestJSON-1292933496 tempest-HostsAdminNegativeTestJSON-1292933496-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:54.747063 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cd97a7b1-b024-4ff6-8018-e362e85cf456 tempest-HostsAdminNegativeTestJSON-1292933496 tempest-HostsAdminNegativeTestJSON-1292933496-project] 10.222.0.39 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 403 len: 111 microversion: 2.1 time: 0.035497 Aug 07 01:10:54.749300 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 185/341] 10.222.0.39 () {60 vars in 1187 bytes} [Sun Aug 7 01:10:54 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 111 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:10:54.766916 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ae4b5814-606b-4d31-816b-f864784f7ef3 tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] Action: 'update', calling method: .version_select at 0x7f9e25013820>, body: {"status": null, "maintenance_mode": null} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:54.782738 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ae4b5814-606b-4d31-816b-f864784f7ef3 tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] Request method failure captured: Aug 07 01:10:54.782738 n-d-master-1 devstack@n-api.service[119516]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Aug 07 01:10:54.782738 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:10:54.782738 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:10:54.782738 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:10:54.782738 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 42 Aug 07 01:10:54.782738 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:10:54.782738 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:10:54.782738 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:10:54.782738 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:54.782738 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xEbaPIWX29gq1W2DJqBBA5NBz4-9m-W9_eJZJQlqaNvNwytptm5Gsgj31FYZfyWYyCFL0pu-ph_ihkwV_5rd2tUUp0AN_Lu2SWxy4rKBUtmznrjv7t0QgkNrgoRi6ctoDa1GglJrkD-OSO1XcvMEemEHbWo442wlHwCZ8-Vndkwff0 Aug 07 01:10:54.782738 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:10:54.782738 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:10:54.782738 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:10:54.782738 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:10:54.782738 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:10:54.782738 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:10:54.782738 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 47b1fddf09644b6680321adadf6833fe Aug 07 01:10:54.782738 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1917977865 Aug 07 01:10:54.782738 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,admin,member Aug 07 01:10:54.782738 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,admin,member Aug 07 01:10:54.785543 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/47b1fddf09644b6680321adadf6833fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_47b1fddf09644b6680321adadf6833fe", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/47b1fddf09644b6680321adadf6833fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/47b1fddf09644b6680321adadf6833fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:54.785543 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1917977865 Aug 07 01:10:54.785543 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 47b1fddf09644b6680321adadf6833fe Aug 07 01:10:54.785543 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1917977865 Aug 07 01:10:54.785543 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-HostsAdminNegativeTestJSON-1917977865-project-admin Aug 07 01:10:54.785543 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:10:54.785543 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:10:54.785543 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 5f63191ef3b9460aa302dbd56324e94f Aug 07 01:10:54.785543 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1917977865-project-admin Aug 07 01:10:54.785543 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:10:54.785543 n-d-master-1 devstack@n-api.service[119516]: {"status": null, "maintenance_mode": null} Aug 07 01:10:54.785543 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:10:54.785543 n-d-master-1 devstack@n-api.service[119516]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 07 01:10:54.785543 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'n-d-master-1', 'body': {'status': None, 'maintenance_mode': None}} Aug 07 01:10:54.787018 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:54.787018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:54.787018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:10:54.787018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:10:54.787018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:10:54.787018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:10:54.787018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 07 01:10:54.787018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.787018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 07 01:10:54.787018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 07 01:10:54.787018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'disable', Aug 07 01:10:54.787018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'Enable', Aug 07 01:10:54.787018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'Disable', Aug 07 01:10:54.787018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 07 01:10:54.787018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 07 01:10:54.787018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 07 01:10:54.787018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.787018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi On instance: Aug 07 01:10:54.787018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi None Aug 07 01:10:54.787018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.787018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:54.787018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.787018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:54.787018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:54.787018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:54.790246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:54.790246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:54.790246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:10:54.790246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:10:54.790246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:54.790246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:54.790246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:10:54.790246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:10:54.790246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:10:54.790246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:10:54.790246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:10:54.790246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:10:54.790246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 07 01:10:54.790246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.790246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:54.790246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.790246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:54.790246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:54.790246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:54.792176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:10:54.792176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:10:54.792176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 07 01:10:54.792176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.792176 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ae4b5814-606b-4d31-816b-f864784f7ef3 tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:54.792176 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ae4b5814-606b-4d31-816b-f864784f7ef3 tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 127 microversion: 2.1 time: 0.031384 Aug 07 01:10:54.792176 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 186/342] 10.222.0.39 () {60 vars in 1187 bytes} [Sun Aug 7 01:10:54 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 127 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:10:54.813079 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-293cd17a-9465-4be6-8d8e-66bbb611189f tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] Action: 'update', calling method: .version_select at 0x7f9e2516d160>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:54.827452 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.hosts [None req-293cd17a-9465-4be6-8d8e-66bbb611189f tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] Enabling host nonexistent_hostname. Aug 07 01:10:54.848091 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-293cd17a-9465-4be6-8d8e-66bbb611189f tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 07 01:10:54.857438 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-293cd17a-9465-4be6-8d8e-66bbb611189f tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] Request method failure captured: Aug 07 01:10:54.857438 n-d-master-1 devstack@n-api.service[119516]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 07 01:10:54.857438 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:10:54.857438 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:10:54.857438 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:10:54.857438 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 50 Aug 07 01:10:54.857438 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:10:54.857438 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:10:54.857438 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:10:54.857438 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:54.857438 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xEbaPIWX29gq1W2DJqBBA5NBz4-9m-W9_eJZJQlqaNvNwytptm5Gsgj31FYZfyWYyCFL0pu-ph_ihkwV_5rd2tUUp0AN_Lu2SWxy4rKBUtmznrjv7t0QgkNrgoRi6ctoDa1GglJrkD-OSO1XcvMEemEHbWo442wlHwCZ8-Vndkwff0 Aug 07 01:10:54.857438 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:10:54.857438 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:10:54.857438 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:10:54.857438 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:10:54.857438 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:10:54.857438 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:10:54.857438 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 47b1fddf09644b6680321adadf6833fe Aug 07 01:10:54.857438 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1917977865 Aug 07 01:10:54.857438 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,admin,member Aug 07 01:10:54.857438 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,admin,member Aug 07 01:10:54.859849 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/47b1fddf09644b6680321adadf6833fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_47b1fddf09644b6680321adadf6833fe", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/47b1fddf09644b6680321adadf6833fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/47b1fddf09644b6680321adadf6833fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:54.859849 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1917977865 Aug 07 01:10:54.859849 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 47b1fddf09644b6680321adadf6833fe Aug 07 01:10:54.859849 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1917977865 Aug 07 01:10:54.859849 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-HostsAdminNegativeTestJSON-1917977865-project-admin Aug 07 01:10:54.859849 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:10:54.859849 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:10:54.859849 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 5f63191ef3b9460aa302dbd56324e94f Aug 07 01:10:54.859849 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1917977865-project-admin Aug 07 01:10:54.859849 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:10:54.859849 n-d-master-1 devstack@n-api.service[119516]: {"status": "enable", "maintenance_mode": "enable"} Aug 07 01:10:54.859849 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:10:54.859849 n-d-master-1 devstack@n-api.service[119516]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 07 01:10:54.859849 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 07 01:10:54.861341 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:54.861341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:54.861341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 07 01:10:54.861341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 07 01:10:54.861341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 07 01:10:54.861341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 07 01:10:54.861341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:10:54.861341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:10:54.861341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:10:54.861341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:10:54.861341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 07 01:10:54.861341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 07 01:10:54.861341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 07 01:10:54.861341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 07 01:10:54.861341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:10:54.861341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:10:54.861341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 07 01:10:54.861341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 07 01:10:54.871763 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 07 01:10:54.871763 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 07 01:10:54.871763 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 07 01:10:54.871763 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 07 01:10:54.871763 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 07 01:10:54.871763 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.871763 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:54.871763 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.871763 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:54.871763 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:54.871763 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:54.871763 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:54.871763 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:54.871763 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:10:54.871763 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:10:54.871763 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:54.871763 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:54.871763 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:10:54.871763 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:10:54.871763 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 07 01:10:54.876569 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 07 01:10:54.876569 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 07 01:10:54.876569 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:10:54.876569 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 07 01:10:54.876569 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.876569 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:54.876569 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.876569 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:54.876569 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:54.876569 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:54.876569 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:10:54.876569 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:10:54.876569 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 07 01:10:54.876569 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:54.876569 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-293cd17a-9465-4be6-8d8e-66bbb611189f tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:54.879451 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-293cd17a-9465-4be6-8d8e-66bbb611189f tempest-HostsAdminNegativeTestJSON-1917977865 tempest-HostsAdminNegativeTestJSON-1917977865-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.059990 Aug 07 01:10:54.879451 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 187/343] 10.222.0.39 () {60 vars in 1211 bytes} [Sun Aug 7 01:10:54 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:10:55.442007 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3db2aeda-157b-4bf8-a7c0-978fc0ad029c tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1266989057", "id": 1969937548, "os-flavor-access:is_public": "False"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:55.452283 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:55.452283 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:55.504013 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3db2aeda-157b-4bf8-a7c0-978fc0ad029c tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.967700 Aug 07 01:10:55.516053 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 157/344] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:10:54 2022] POST /compute/v2.1/flavors => generated 439 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:10:55.516278 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-176368b8-8eba-4603-a4a8-68617a100268 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:55.516278 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-176368b8-8eba-4603-a4a8-68617a100268 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:55.526774 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-af2ff437-f85b-43ee-b62d-57c47dd7ad90 tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "01a04222bcde49e59e746386b54d90a0"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:55.540192 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:55.540192 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:55.566305 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-176368b8-8eba-4603-a4a8-68617a100268 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:55.572744 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-176368b8-8eba-4603-a4a8-68617a100268 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:55.577251 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-176368b8-8eba-4603-a4a8-68617a100268 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:55.578499 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-176368b8-8eba-4603-a4a8-68617a100268 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:55.579115 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-176368b8-8eba-4603-a4a8-68617a100268 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:55.579673 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-176368b8-8eba-4603-a4a8-68617a100268 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:55.907133 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-176368b8-8eba-4603-a4a8-68617a100268 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:55.948625 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-176368b8-8eba-4603-a4a8-68617a100268 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0" status: 200 len: 1268 microversion: 2.1 time: 0.445369 Aug 07 01:10:55.949742 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 188/345] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:55 2022] GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 => generated 1268 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:10:56.753489 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b4af9b9b-328b-43cd-b5ba-eeaeddba7f32 tempest-ImagesMetadataNegativeTestJSON-1221389494 tempest-ImagesMetadataNegativeTestJSON-1221389494-project] Calling method '.version_select at 0x7f9e250ba0d0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:56.841322 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-b4af9b9b-328b-43cd-b5ba-eeaeddba7f32 tempest-ImagesMetadataNegativeTestJSON-1221389494 tempest-ImagesMetadataNegativeTestJSON-1221389494-project] HTTP exception thrown: Image not found. Aug 07 01:10:56.858450 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b4af9b9b-328b-43cd-b5ba-eeaeddba7f32 tempest-ImagesMetadataNegativeTestJSON-1221389494 tempest-ImagesMetadataNegativeTestJSON-1221389494-project] Request method failure captured: Aug 07 01:10:56.858450 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/images/d88d004e-748e-4625-8629-05944a9f3942/metadata/os_distro HTTP/1.1 Aug 07 01:10:56.858450 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:10:56.858450 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:10:56.858450 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:10:56.858450 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:10:56.858450 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:10:56.858450 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:10:56.858450 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:10:56.858450 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:56.858450 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xEf3l-cZkb84D4X5Be8VZLcpa130FggZemJ73PVWfzk-p9GHywXJjYKndfxh_LhR49ELkBDWm11JgnFJdzJ5oT9AUAzMj7EklWVWSWAGrdarXbHWrwRvMy2DVLpCmV3dD_77vStnQ_-s9aQUKa6XWlj65n_dC3_ps5aE1SAfr8ddrw Aug 07 01:10:56.858450 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:10:56.858450 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:10:56.858450 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:10:56.858450 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:10:56.858450 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:10:56.858450 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:10:56.858450 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 49d7d246942240b3a406be0ccfdec120 Aug 07 01:10:56.858450 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1221389494 Aug 07 01:10:56.858450 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:10:56.858450 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:10:56.861612 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/49d7d246942240b3a406be0ccfdec120"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_49d7d246942240b3a406be0ccfdec120", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/49d7d246942240b3a406be0ccfdec120"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/49d7d246942240b3a406be0ccfdec120"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:56.861612 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1221389494 Aug 07 01:10:56.861612 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 49d7d246942240b3a406be0ccfdec120 Aug 07 01:10:56.861612 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1221389494 Aug 07 01:10:56.861612 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ImagesMetadataNegativeTestJSON-1221389494-project Aug 07 01:10:56.861612 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:10:56.861612 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:10:56.861612 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 9dec618a8f8f4d26b2ddaf5d9d8d8a4c Aug 07 01:10:56.861612 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1221389494-project Aug 07 01:10:56.861612 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:10:56.861612 n-d-master-1 devstack@n-api.service[119516]: exception: Image not found. Aug 07 01:10:56.861612 n-d-master-1 devstack@n-api.service[119516]: action_args: {'image_id': 'd88d004e-748e-4625-8629-05944a9f3942', 'id': 'os_distro'} Aug 07 01:10:56.861612 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:56.863316 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:56.863316 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 07 01:10:56.863316 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 07 01:10:56.863316 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 07 01:10:56.863316 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 07 01:10:56.863316 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 07 01:10:56.863316 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 07 01:10:56.863316 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 07 01:10:56.863316 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 07 01:10:56.863316 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 07 01:10:56.863316 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 07 01:10:56.863316 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 07 01:10:56.863316 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 07 01:10:56.863316 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 07 01:10:56.863316 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 07 01:10:56.863316 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 07 01:10:56.863316 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 07 01:10:56.863316 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d88d004e-748e-4625-8629-05944a9f3942 Aug 07 01:10:56.867401 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:56.867401 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:56.867401 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:56.867401 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:56.867401 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 07 01:10:56.867401 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 07 01:10:56.867401 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 07 01:10:56.867401 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 07 01:10:56.867401 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 07 01:10:56.867401 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 07 01:10:56.867401 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 07 01:10:56.867401 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 07 01:10:56.867401 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 07 01:10:56.867401 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 07 01:10:56.867401 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 07 01:10:56.867401 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 07 01:10:56.867401 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 07 01:10:56.867401 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 07 01:10:56.867401 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 07 01:10:56.867401 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 07 01:10:56.872841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 07 01:10:56.872841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 07 01:10:56.872841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 07 01:10:56.872841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 07 01:10:56.872841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 07 01:10:56.872841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 07 01:10:56.872841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 07 01:10:56.872841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 07 01:10:56.872841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d88d004e-748e-4625-8629-05944a9f3942 could not be found. Aug 07 01:10:56.872841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:56.872841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:56.872841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:56.872841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:56.872841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:56.872841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:56.872841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:56.872841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:56.872841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:10:56.872841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:10:56.874323 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:56.874323 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:56.874323 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 07 01:10:56.874323 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 07 01:10:56.874323 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 07 01:10:56.874323 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 07 01:10:56.874323 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 07 01:10:56.874323 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:56.874323 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:56.874323 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:56.874323 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:56.874323 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:56.874323 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:56.874323 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:10:56.874323 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:10:56.874323 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 07 01:10:56.874323 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:56.874323 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b4af9b9b-328b-43cd-b5ba-eeaeddba7f32 tempest-ImagesMetadataNegativeTestJSON-1221389494 tempest-ImagesMetadataNegativeTestJSON-1221389494-project] Returning 404 to user: Image not found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:56.875988 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b4af9b9b-328b-43cd-b5ba-eeaeddba7f32 tempest-ImagesMetadataNegativeTestJSON-1221389494 tempest-ImagesMetadataNegativeTestJSON-1221389494-project] 10.222.0.39 "DELETE /compute/v2.1/images/d88d004e-748e-4625-8629-05944a9f3942/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.911242 Aug 07 01:10:56.875988 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 189/346] 10.222.0.39 () {58 vars in 1293 bytes} [Sun Aug 7 01:10:55 2022] DELETE /compute/v2.1/images/d88d004e-748e-4625-8629-05944a9f3942/metadata/os_distro => generated 62 bytes in 917 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:10:56.918787 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fa310f8a-c504-45ba-9f8b-018c89a6d833 tempest-ImagesMetadataNegativeTestJSON-1221389494 tempest-ImagesMetadataNegativeTestJSON-1221389494-project] Calling method '.version_select at 0x7f9e25013a60>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:57.052848 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-fa310f8a-c504-45ba-9f8b-018c89a6d833 tempest-ImagesMetadataNegativeTestJSON-1221389494 tempest-ImagesMetadataNegativeTestJSON-1221389494-project] HTTP exception thrown: Image not found. Aug 07 01:10:57.062457 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fa310f8a-c504-45ba-9f8b-018c89a6d833 tempest-ImagesMetadataNegativeTestJSON-1221389494 tempest-ImagesMetadataNegativeTestJSON-1221389494-project] Request method failure captured: Aug 07 01:10:57.062457 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/images/dfa75d90-799e-4da6-be04-cc987b0b7d71/metadata/os_version HTTP/1.1 Aug 07 01:10:57.062457 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:10:57.062457 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:10:57.062457 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:10:57.062457 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:10:57.062457 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:10:57.062457 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:10:57.062457 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:10:57.062457 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:57.062457 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xEf3l-cZkb84D4X5Be8VZLcpa130FggZemJ73PVWfzk-p9GHywXJjYKndfxh_LhR49ELkBDWm11JgnFJdzJ5oT9AUAzMj7EklWVWSWAGrdarXbHWrwRvMy2DVLpCmV3dD_77vStnQ_-s9aQUKa6XWlj65n_dC3_ps5aE1SAfr8ddrw Aug 07 01:10:57.062457 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:10:57.062457 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:10:57.062457 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:10:57.062457 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:10:57.062457 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:10:57.062457 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:10:57.062457 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 49d7d246942240b3a406be0ccfdec120 Aug 07 01:10:57.062457 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1221389494 Aug 07 01:10:57.062457 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:10:57.062457 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:10:57.065087 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/49d7d246942240b3a406be0ccfdec120"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_49d7d246942240b3a406be0ccfdec120", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/49d7d246942240b3a406be0ccfdec120"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/49d7d246942240b3a406be0ccfdec120"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:57.065087 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1221389494 Aug 07 01:10:57.065087 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 49d7d246942240b3a406be0ccfdec120 Aug 07 01:10:57.065087 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1221389494 Aug 07 01:10:57.065087 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ImagesMetadataNegativeTestJSON-1221389494-project Aug 07 01:10:57.065087 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:10:57.065087 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:10:57.065087 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 9dec618a8f8f4d26b2ddaf5d9d8d8a4c Aug 07 01:10:57.065087 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1221389494-project Aug 07 01:10:57.065087 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:10:57.065087 n-d-master-1 devstack@n-api.service[119516]: exception: Image not found. Aug 07 01:10:57.065087 n-d-master-1 devstack@n-api.service[119516]: action_args: {'image_id': 'dfa75d90-799e-4da6-be04-cc987b0b7d71', 'id': 'os_version'} Aug 07 01:10:57.065087 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:57.066721 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:57.066721 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 07 01:10:57.066721 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 07 01:10:57.066721 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 07 01:10:57.066721 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 07 01:10:57.066721 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 07 01:10:57.066721 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 07 01:10:57.066721 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 07 01:10:57.066721 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 07 01:10:57.066721 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 07 01:10:57.066721 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 07 01:10:57.066721 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 07 01:10:57.066721 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 07 01:10:57.066721 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 07 01:10:57.066721 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 07 01:10:57.066721 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 07 01:10:57.066721 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 07 01:10:57.066721 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID dfa75d90-799e-4da6-be04-cc987b0b7d71 Aug 07 01:10:57.068936 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:57.068936 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:57.068936 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:57.068936 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:57.068936 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 07 01:10:57.068936 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 07 01:10:57.068936 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 07 01:10:57.068936 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 07 01:10:57.068936 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 07 01:10:57.068936 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 07 01:10:57.068936 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 07 01:10:57.068936 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 07 01:10:57.068936 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 07 01:10:57.068936 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 07 01:10:57.068936 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 07 01:10:57.068936 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 07 01:10:57.068936 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 07 01:10:57.068936 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 07 01:10:57.068936 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 07 01:10:57.068936 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 07 01:10:57.071812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 07 01:10:57.071812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 07 01:10:57.071812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 07 01:10:57.071812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 07 01:10:57.071812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 07 01:10:57.071812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 07 01:10:57.071812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 07 01:10:57.071812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 07 01:10:57.071812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image dfa75d90-799e-4da6-be04-cc987b0b7d71 could not be found. Aug 07 01:10:57.071812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:57.071812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:57.071812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:57.071812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:57.071812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:57.071812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:57.071812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:57.071812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:57.071812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:10:57.071812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:10:57.077012 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:57.077012 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:57.077012 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 07 01:10:57.077012 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 07 01:10:57.077012 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 07 01:10:57.077012 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 07 01:10:57.077012 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 07 01:10:57.077012 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:57.077012 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:57.077012 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:57.077012 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:57.077012 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:57.077012 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:57.077012 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:10:57.077012 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:10:57.077012 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 07 01:10:57.077012 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:57.077012 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fa310f8a-c504-45ba-9f8b-018c89a6d833 tempest-ImagesMetadataNegativeTestJSON-1221389494 tempest-ImagesMetadataNegativeTestJSON-1221389494-project] Returning 404 to user: Image not found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:57.079272 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fa310f8a-c504-45ba-9f8b-018c89a6d833 tempest-ImagesMetadataNegativeTestJSON-1221389494 tempest-ImagesMetadataNegativeTestJSON-1221389494-project] 10.222.0.39 "GET /compute/v2.1/images/dfa75d90-799e-4da6-be04-cc987b0b7d71/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.184833 Aug 07 01:10:57.079272 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 190/347] 10.222.0.39 () {58 vars in 1293 bytes} [Sun Aug 7 01:10:56 2022] GET /compute/v2.1/images/dfa75d90-799e-4da6-be04-cc987b0b7d71/metadata/os_version => generated 62 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:10:57.092877 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d326a8c7-0fe2-434c-984e-6f79a006da8f tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:57.094067 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d326a8c7-0fe2-434c-984e-6f79a006da8f tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:57.128428 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d326a8c7-0fe2-434c-984e-6f79a006da8f tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:57.133959 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d326a8c7-0fe2-434c-984e-6f79a006da8f tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:57.135524 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d326a8c7-0fe2-434c-984e-6f79a006da8f tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:57.142466 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d326a8c7-0fe2-434c-984e-6f79a006da8f tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:57.143421 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d326a8c7-0fe2-434c-984e-6f79a006da8f tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:57.156164 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d326a8c7-0fe2-434c-984e-6f79a006da8f tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:57.533475 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d326a8c7-0fe2-434c-984e-6f79a006da8f tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:57.567759 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-af2ff437-f85b-43ee-b62d-57c47dd7ad90 tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/1969937548/action" status: 200 len: 97 microversion: 2.1 time: 2.045345 Aug 07 01:10:57.574884 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 158/348] 10.222.0.39 () {60 vars in 1200 bytes} [Sun Aug 7 01:10:55 2022] POST /compute/v2.1/flavors/1969937548/action => generated 97 bytes in 2053 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:10:57.592861 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d326a8c7-0fe2-434c-984e-6f79a006da8f tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0" status: 200 len: 1268 microversion: 2.1 time: 0.519964 Aug 07 01:10:57.596418 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 191/349] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:57 2022] GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 => generated 1268 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:57.605810 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4f497d51-def1-4705-bb2c-6b93dfdd9626 tempest-ImagesMetadataNegativeTestJSON-1221389494 tempest-ImagesMetadataNegativeTestJSON-1221389494-project] Calling method '.version_select at 0x7f9e24f035e0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:57.617032 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9a5203a2-af94-45f4-9906-a4d84494190c tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "01a04222bcde49e59e746386b54d90a0"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:57.639764 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:57.639764 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:10:57.713264 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-4f497d51-def1-4705-bb2c-6b93dfdd9626 tempest-ImagesMetadataNegativeTestJSON-1221389494 tempest-ImagesMetadataNegativeTestJSON-1221389494-project] HTTP exception thrown: Image not found. Aug 07 01:10:57.727477 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4f497d51-def1-4705-bb2c-6b93dfdd9626 tempest-ImagesMetadataNegativeTestJSON-1221389494 tempest-ImagesMetadataNegativeTestJSON-1221389494-project] Request method failure captured: Aug 07 01:10:57.727477 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/images/1e14f960-19f5-4f23-a62b-c201f8908c6a/metadata HTTP/1.1 Aug 07 01:10:57.727477 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:10:57.727477 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:10:57.727477 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:10:57.727477 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:10:57.727477 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:10:57.727477 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:10:57.727477 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:10:57.727477 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:57.727477 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xEf3l-cZkb84D4X5Be8VZLcpa130FggZemJ73PVWfzk-p9GHywXJjYKndfxh_LhR49ELkBDWm11JgnFJdzJ5oT9AUAzMj7EklWVWSWAGrdarXbHWrwRvMy2DVLpCmV3dD_77vStnQ_-s9aQUKa6XWlj65n_dC3_ps5aE1SAfr8ddrw Aug 07 01:10:57.727477 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:10:57.727477 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:10:57.727477 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:10:57.727477 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:10:57.727477 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:10:57.727477 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:10:57.727477 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 49d7d246942240b3a406be0ccfdec120 Aug 07 01:10:57.727477 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1221389494 Aug 07 01:10:57.727477 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:10:57.727477 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:10:57.730199 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/49d7d246942240b3a406be0ccfdec120"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_49d7d246942240b3a406be0ccfdec120", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/49d7d246942240b3a406be0ccfdec120"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/49d7d246942240b3a406be0ccfdec120"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:57.730199 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1221389494 Aug 07 01:10:57.730199 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 49d7d246942240b3a406be0ccfdec120 Aug 07 01:10:57.730199 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1221389494 Aug 07 01:10:57.730199 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ImagesMetadataNegativeTestJSON-1221389494-project Aug 07 01:10:57.730199 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:10:57.730199 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:10:57.730199 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 9dec618a8f8f4d26b2ddaf5d9d8d8a4c Aug 07 01:10:57.730199 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1221389494-project Aug 07 01:10:57.730199 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:10:57.730199 n-d-master-1 devstack@n-api.service[119517]: exception: Image not found. Aug 07 01:10:57.730199 n-d-master-1 devstack@n-api.service[119517]: action_args: {'image_id': '1e14f960-19f5-4f23-a62b-c201f8908c6a'} Aug 07 01:10:57.730199 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:57.731612 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:57.731612 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 07 01:10:57.731612 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 07 01:10:57.731612 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 07 01:10:57.731612 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 07 01:10:57.731612 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 07 01:10:57.731612 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 07 01:10:57.731612 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 07 01:10:57.731612 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 07 01:10:57.731612 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 07 01:10:57.731612 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 07 01:10:57.731612 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 07 01:10:57.731612 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 07 01:10:57.731612 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 07 01:10:57.731612 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 07 01:10:57.731612 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 07 01:10:57.731612 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 07 01:10:57.731612 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1e14f960-19f5-4f23-a62b-c201f8908c6a Aug 07 01:10:57.733129 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:57.733129 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:57.733129 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:57.733129 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:57.733129 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 07 01:10:57.733129 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 07 01:10:57.733129 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 07 01:10:57.733129 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 07 01:10:57.733129 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 07 01:10:57.733129 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 07 01:10:57.733129 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 07 01:10:57.733129 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 07 01:10:57.733129 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 07 01:10:57.733129 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 07 01:10:57.733129 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 07 01:10:57.733129 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 07 01:10:57.733129 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 07 01:10:57.733129 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 07 01:10:57.733129 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 07 01:10:57.733129 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 07 01:10:57.735051 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 07 01:10:57.735051 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 07 01:10:57.735051 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 07 01:10:57.735051 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 07 01:10:57.735051 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 07 01:10:57.735051 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 07 01:10:57.735051 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 07 01:10:57.735051 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 07 01:10:57.735051 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1e14f960-19f5-4f23-a62b-c201f8908c6a could not be found. Aug 07 01:10:57.735051 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:57.735051 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:57.735051 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:57.735051 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:57.735051 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:57.735051 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:57.735051 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:57.735051 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:57.735051 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:10:57.735051 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:10:57.747684 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:57.747684 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:57.747684 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 07 01:10:57.747684 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 07 01:10:57.747684 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 07 01:10:57.747684 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 07 01:10:57.747684 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 07 01:10:57.747684 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:57.747684 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:57.747684 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:57.747684 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:57.747684 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:57.747684 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:57.747684 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:10:57.747684 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:10:57.747684 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 07 01:10:57.747684 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:57.747684 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4f497d51-def1-4705-bb2c-6b93dfdd9626 tempest-ImagesMetadataNegativeTestJSON-1221389494 tempest-ImagesMetadataNegativeTestJSON-1221389494-project] Returning 404 to user: Image not found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:57.753979 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4f497d51-def1-4705-bb2c-6b93dfdd9626 tempest-ImagesMetadataNegativeTestJSON-1221389494 tempest-ImagesMetadataNegativeTestJSON-1221389494-project] 10.222.0.39 "GET /compute/v2.1/images/1e14f960-19f5-4f23-a62b-c201f8908c6a/metadata" status: 404 len: 62 microversion: 2.1 time: 0.159391 Aug 07 01:10:57.753979 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 159/350] 10.222.0.39 () {58 vars in 1260 bytes} [Sun Aug 7 01:10:57 2022] GET /compute/v2.1/images/1e14f960-19f5-4f23-a62b-c201f8908c6a/metadata => generated 62 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:10:57.772318 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-49fb5c6e-8576-4939-b322-bdc2f27f127f tempest-ImagesMetadataNegativeTestJSON-1221389494 tempest-ImagesMetadataNegativeTestJSON-1221389494-project] Action: 'update_all', calling method: .version_select at 0x7f9e25228280>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:57.825394 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-49fb5c6e-8576-4939-b322-bdc2f27f127f tempest-ImagesMetadataNegativeTestJSON-1221389494 tempest-ImagesMetadataNegativeTestJSON-1221389494-project] HTTP exception thrown: Image not found. Aug 07 01:10:57.833819 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-49fb5c6e-8576-4939-b322-bdc2f27f127f tempest-ImagesMetadataNegativeTestJSON-1221389494 tempest-ImagesMetadataNegativeTestJSON-1221389494-project] Request method failure captured: Aug 07 01:10:57.833819 n-d-master-1 devstack@n-api.service[119517]: request: PUT /compute/v2.1/images/38c1e60c-3666-41fa-a9e8-03fefb9ee461/metadata HTTP/1.1 Aug 07 01:10:57.833819 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:10:57.833819 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:10:57.833819 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:10:57.833819 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 57 Aug 07 01:10:57.833819 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:10:57.833819 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:10:57.833819 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:10:57.833819 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:57.833819 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xEf3l-cZkb84D4X5Be8VZLcpa130FggZemJ73PVWfzk-p9GHywXJjYKndfxh_LhR49ELkBDWm11JgnFJdzJ5oT9AUAzMj7EklWVWSWAGrdarXbHWrwRvMy2DVLpCmV3dD_77vStnQ_-s9aQUKa6XWlj65n_dC3_ps5aE1SAfr8ddrw Aug 07 01:10:57.833819 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:10:57.833819 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:10:57.833819 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:10:57.833819 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:10:57.833819 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:10:57.833819 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:10:57.833819 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 49d7d246942240b3a406be0ccfdec120 Aug 07 01:10:57.833819 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1221389494 Aug 07 01:10:57.833819 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:10:57.833819 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:10:57.837447 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/49d7d246942240b3a406be0ccfdec120"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_49d7d246942240b3a406be0ccfdec120", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/49d7d246942240b3a406be0ccfdec120"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/49d7d246942240b3a406be0ccfdec120"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:57.837447 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1221389494 Aug 07 01:10:57.837447 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 49d7d246942240b3a406be0ccfdec120 Aug 07 01:10:57.837447 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1221389494 Aug 07 01:10:57.837447 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ImagesMetadataNegativeTestJSON-1221389494-project Aug 07 01:10:57.837447 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:10:57.837447 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:10:57.837447 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 9dec618a8f8f4d26b2ddaf5d9d8d8a4c Aug 07 01:10:57.837447 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1221389494-project Aug 07 01:10:57.837447 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:10:57.837447 n-d-master-1 devstack@n-api.service[119517]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 07 01:10:57.837447 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:10:57.837447 n-d-master-1 devstack@n-api.service[119517]: exception: Image not found. Aug 07 01:10:57.841427 n-d-master-1 devstack@n-api.service[119517]: action_args: {'image_id': '38c1e60c-3666-41fa-a9e8-03fefb9ee461', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 07 01:10:57.841427 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:57.841427 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:57.841427 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 07 01:10:57.841427 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 07 01:10:57.841427 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 07 01:10:57.841427 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 07 01:10:57.841427 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 07 01:10:57.841427 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 07 01:10:57.841427 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 07 01:10:57.841427 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 07 01:10:57.841427 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 07 01:10:57.841427 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 07 01:10:57.841427 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 07 01:10:57.841427 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 07 01:10:57.841427 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 07 01:10:57.841427 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 07 01:10:57.841427 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 07 01:10:57.844532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 07 01:10:57.844532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 38c1e60c-3666-41fa-a9e8-03fefb9ee461 Aug 07 01:10:57.844532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:57.844532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:57.844532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:57.844532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:57.844532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 07 01:10:57.844532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 07 01:10:57.844532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 07 01:10:57.844532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 07 01:10:57.844532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 07 01:10:57.844532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 07 01:10:57.844532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 07 01:10:57.844532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 07 01:10:57.844532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 07 01:10:57.844532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 07 01:10:57.844532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 07 01:10:57.844532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 07 01:10:57.844532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 07 01:10:57.844532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 07 01:10:57.849829 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 07 01:10:57.849829 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 07 01:10:57.849829 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 07 01:10:57.849829 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 07 01:10:57.849829 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 07 01:10:57.849829 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 07 01:10:57.849829 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 07 01:10:57.849829 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 07 01:10:57.849829 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 07 01:10:57.849829 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 07 01:10:57.849829 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 38c1e60c-3666-41fa-a9e8-03fefb9ee461 could not be found. Aug 07 01:10:57.849829 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:57.849829 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:57.849829 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:57.849829 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:57.849829 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:57.849829 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:57.849829 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:57.849829 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:57.853834 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:10:57.853834 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:10:57.853834 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:57.853834 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:57.853834 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:10:57.853834 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:10:57.853834 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 07 01:10:57.853834 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 07 01:10:57.853834 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 07 01:10:57.853834 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 07 01:10:57.853834 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 07 01:10:57.853834 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:57.853834 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:57.853834 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:57.853834 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:57.853834 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:57.853834 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:57.853834 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:10:57.853834 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:10:57.853834 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 07 01:10:57.853834 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:57.858537 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-49fb5c6e-8576-4939-b322-bdc2f27f127f tempest-ImagesMetadataNegativeTestJSON-1221389494 tempest-ImagesMetadataNegativeTestJSON-1221389494-project] Returning 404 to user: Image not found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:57.860895 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-49fb5c6e-8576-4939-b322-bdc2f27f127f tempest-ImagesMetadataNegativeTestJSON-1221389494 tempest-ImagesMetadataNegativeTestJSON-1221389494-project] 10.222.0.39 "PUT /compute/v2.1/images/38c1e60c-3666-41fa-a9e8-03fefb9ee461/metadata" status: 404 len: 62 microversion: 2.1 time: 0.095715 Aug 07 01:10:57.871571 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 160/351] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Aug 7 01:10:57 2022] PUT /compute/v2.1/images/38c1e60c-3666-41fa-a9e8-03fefb9ee461/metadata => generated 62 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:10:57.881682 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a94ac669-8a98-4e2f-99b3-def5d4077b04 tempest-ImagesMetadataNegativeTestJSON-1221389494 tempest-ImagesMetadataNegativeTestJSON-1221389494-project] Action: 'update', calling method: .version_select at 0x7f9e24f03790>, body: {"meta": {"os_distro": "alt"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:57.928221 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-a94ac669-8a98-4e2f-99b3-def5d4077b04 tempest-ImagesMetadataNegativeTestJSON-1221389494 tempest-ImagesMetadataNegativeTestJSON-1221389494-project] HTTP exception thrown: Image not found. Aug 07 01:10:57.933702 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a94ac669-8a98-4e2f-99b3-def5d4077b04 tempest-ImagesMetadataNegativeTestJSON-1221389494 tempest-ImagesMetadataNegativeTestJSON-1221389494-project] Request method failure captured: Aug 07 01:10:57.933702 n-d-master-1 devstack@n-api.service[119517]: request: PUT /compute/v2.1/images/2d305900-6c8e-43c2-a876-e4f906ea49bd/metadata/os_distro HTTP/1.1 Aug 07 01:10:57.933702 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:10:57.933702 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:10:57.933702 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:10:57.933702 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 30 Aug 07 01:10:57.933702 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:10:57.933702 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:10:57.933702 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:10:57.933702 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:57.933702 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xEf3l-cZkb84D4X5Be8VZLcpa130FggZemJ73PVWfzk-p9GHywXJjYKndfxh_LhR49ELkBDWm11JgnFJdzJ5oT9AUAzMj7EklWVWSWAGrdarXbHWrwRvMy2DVLpCmV3dD_77vStnQ_-s9aQUKa6XWlj65n_dC3_ps5aE1SAfr8ddrw Aug 07 01:10:57.933702 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:10:57.933702 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:10:57.933702 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:10:57.933702 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:10:57.933702 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:10:57.933702 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:10:57.933702 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 49d7d246942240b3a406be0ccfdec120 Aug 07 01:10:57.933702 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1221389494 Aug 07 01:10:57.933702 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:10:57.933702 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:10:57.935076 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/49d7d246942240b3a406be0ccfdec120"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_49d7d246942240b3a406be0ccfdec120", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/49d7d246942240b3a406be0ccfdec120"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/49d7d246942240b3a406be0ccfdec120"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:57.935076 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1221389494 Aug 07 01:10:57.935076 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 49d7d246942240b3a406be0ccfdec120 Aug 07 01:10:57.935076 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1221389494 Aug 07 01:10:57.935076 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ImagesMetadataNegativeTestJSON-1221389494-project Aug 07 01:10:57.935076 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:10:57.935076 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:10:57.935076 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 9dec618a8f8f4d26b2ddaf5d9d8d8a4c Aug 07 01:10:57.935076 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1221389494-project Aug 07 01:10:57.935076 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:10:57.935076 n-d-master-1 devstack@n-api.service[119517]: {"meta": {"os_distro": "alt"}} Aug 07 01:10:57.935076 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:10:57.935076 n-d-master-1 devstack@n-api.service[119517]: exception: Image not found. Aug 07 01:10:57.935076 n-d-master-1 devstack@n-api.service[119517]: action_args: {'image_id': '2d305900-6c8e-43c2-a876-e4f906ea49bd', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 07 01:10:57.935874 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:57.935874 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:57.935874 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 07 01:10:57.935874 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 07 01:10:57.935874 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 07 01:10:57.935874 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 07 01:10:57.935874 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 07 01:10:57.935874 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 07 01:10:57.935874 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 07 01:10:57.935874 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 07 01:10:57.935874 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 07 01:10:57.935874 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 07 01:10:57.935874 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 07 01:10:57.935874 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 07 01:10:57.935874 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 07 01:10:57.935874 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 07 01:10:57.935874 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 07 01:10:57.935874 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 07 01:10:57.937520 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2d305900-6c8e-43c2-a876-e4f906ea49bd Aug 07 01:10:57.937520 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:57.937520 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:57.937520 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:57.937520 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:57.937520 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 07 01:10:57.937520 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 07 01:10:57.937520 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 07 01:10:57.937520 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 07 01:10:57.937520 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 07 01:10:57.937520 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 07 01:10:57.937520 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 07 01:10:57.937520 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 07 01:10:57.937520 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 07 01:10:57.937520 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 07 01:10:57.937520 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 07 01:10:57.937520 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 07 01:10:57.937520 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 07 01:10:57.937520 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 07 01:10:57.939840 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 07 01:10:57.939840 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 07 01:10:57.939840 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 07 01:10:57.939840 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 07 01:10:57.939840 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 07 01:10:57.939840 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 07 01:10:57.939840 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 07 01:10:57.939840 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 07 01:10:57.939840 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 07 01:10:57.939840 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 07 01:10:57.939840 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2d305900-6c8e-43c2-a876-e4f906ea49bd could not be found. Aug 07 01:10:57.939840 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:57.939840 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:57.939840 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:57.939840 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:57.939840 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:57.939840 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:57.939840 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:57.939840 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:57.942115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:10:57.942115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:10:57.942115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:57.942115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:57.942115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:10:57.942115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:10:57.942115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 07 01:10:57.942115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 07 01:10:57.942115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 07 01:10:57.942115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 07 01:10:57.942115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 07 01:10:57.942115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:57.942115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:57.942115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:57.942115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:57.942115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:57.942115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:57.942115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:10:57.942115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:10:57.942115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 07 01:10:57.942115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:57.946868 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a94ac669-8a98-4e2f-99b3-def5d4077b04 tempest-ImagesMetadataNegativeTestJSON-1221389494 tempest-ImagesMetadataNegativeTestJSON-1221389494-project] Returning 404 to user: Image not found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:57.952790 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a94ac669-8a98-4e2f-99b3-def5d4077b04 tempest-ImagesMetadataNegativeTestJSON-1221389494 tempest-ImagesMetadataNegativeTestJSON-1221389494-project] 10.222.0.39 "PUT /compute/v2.1/images/2d305900-6c8e-43c2-a876-e4f906ea49bd/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.078031 Aug 07 01:10:57.959992 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 161/352] 10.222.0.39 () {60 vars in 1310 bytes} [Sun Aug 7 01:10:57 2022] PUT /compute/v2.1/images/2d305900-6c8e-43c2-a876-e4f906ea49bd/metadata/os_distro => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:10:57.997303 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-33f89b30-7e94-4cea-a236-f4674329347a tempest-ImagesMetadataNegativeTestJSON-1221389494 tempest-ImagesMetadataNegativeTestJSON-1221389494-project] Action: 'create', calling method: .version_select at 0x7f9e24f184c0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:58.095166 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-33f89b30-7e94-4cea-a236-f4674329347a tempest-ImagesMetadataNegativeTestJSON-1221389494 tempest-ImagesMetadataNegativeTestJSON-1221389494-project] HTTP exception thrown: Image not found. Aug 07 01:10:58.103327 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-33f89b30-7e94-4cea-a236-f4674329347a tempest-ImagesMetadataNegativeTestJSON-1221389494 tempest-ImagesMetadataNegativeTestJSON-1221389494-project] Request method failure captured: Aug 07 01:10:58.103327 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/images/3d196c4e-2393-4aa7-8f52-674421f627d8/metadata HTTP/1.1 Aug 07 01:10:58.103327 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:10:58.103327 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:10:58.103327 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:10:58.103327 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 57 Aug 07 01:10:58.103327 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:10:58.103327 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:10:58.103327 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:10:58.103327 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:58.103327 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xEf3l-cZkb84D4X5Be8VZLcpa130FggZemJ73PVWfzk-p9GHywXJjYKndfxh_LhR49ELkBDWm11JgnFJdzJ5oT9AUAzMj7EklWVWSWAGrdarXbHWrwRvMy2DVLpCmV3dD_77vStnQ_-s9aQUKa6XWlj65n_dC3_ps5aE1SAfr8ddrw Aug 07 01:10:58.103327 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:10:58.103327 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:10:58.103327 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:10:58.103327 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:10:58.103327 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:10:58.103327 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:10:58.103327 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 49d7d246942240b3a406be0ccfdec120 Aug 07 01:10:58.103327 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1221389494 Aug 07 01:10:58.103327 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:10:58.103327 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:10:58.105536 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/49d7d246942240b3a406be0ccfdec120"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_49d7d246942240b3a406be0ccfdec120", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/49d7d246942240b3a406be0ccfdec120"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/49d7d246942240b3a406be0ccfdec120"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:58.105536 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1221389494 Aug 07 01:10:58.105536 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 49d7d246942240b3a406be0ccfdec120 Aug 07 01:10:58.105536 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1221389494 Aug 07 01:10:58.105536 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ImagesMetadataNegativeTestJSON-1221389494-project Aug 07 01:10:58.105536 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:10:58.105536 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:10:58.105536 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 9dec618a8f8f4d26b2ddaf5d9d8d8a4c Aug 07 01:10:58.105536 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1221389494-project Aug 07 01:10:58.105536 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:10:58.105536 n-d-master-1 devstack@n-api.service[119517]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 07 01:10:58.105536 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:10:58.105536 n-d-master-1 devstack@n-api.service[119517]: exception: Image not found. Aug 07 01:10:58.105536 n-d-master-1 devstack@n-api.service[119517]: action_args: {'image_id': '3d196c4e-2393-4aa7-8f52-674421f627d8', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 07 01:10:58.106979 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:58.106979 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:58.106979 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 07 01:10:58.106979 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 07 01:10:58.106979 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 07 01:10:58.106979 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 07 01:10:58.106979 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 07 01:10:58.106979 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 07 01:10:58.106979 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 07 01:10:58.106979 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 07 01:10:58.106979 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 07 01:10:58.106979 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 07 01:10:58.106979 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 07 01:10:58.106979 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 07 01:10:58.106979 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 07 01:10:58.106979 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 07 01:10:58.106979 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 07 01:10:58.106979 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 07 01:10:58.111041 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3d196c4e-2393-4aa7-8f52-674421f627d8 Aug 07 01:10:58.111041 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:58.111041 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:58.111041 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:58.111041 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:58.111041 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 07 01:10:58.111041 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 07 01:10:58.111041 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 07 01:10:58.111041 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 07 01:10:58.111041 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 07 01:10:58.111041 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 07 01:10:58.111041 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 07 01:10:58.111041 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 07 01:10:58.111041 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 07 01:10:58.111041 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 07 01:10:58.111041 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 07 01:10:58.111041 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 07 01:10:58.111041 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 07 01:10:58.111041 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 07 01:10:58.114408 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 07 01:10:58.114408 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 07 01:10:58.114408 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 07 01:10:58.114408 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 07 01:10:58.114408 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 07 01:10:58.114408 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 07 01:10:58.114408 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 07 01:10:58.114408 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 07 01:10:58.114408 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 07 01:10:58.114408 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 07 01:10:58.114408 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3d196c4e-2393-4aa7-8f52-674421f627d8 could not be found. Aug 07 01:10:58.114408 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:58.114408 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:58.114408 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:58.114408 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:58.114408 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:58.114408 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:58.114408 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:58.114408 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:58.120733 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:10:58.120733 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:10:58.120733 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:58.120733 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:58.120733 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:10:58.120733 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:10:58.120733 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 07 01:10:58.120733 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 07 01:10:58.120733 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 07 01:10:58.120733 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 07 01:10:58.120733 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 07 01:10:58.120733 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:58.120733 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:58.120733 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:58.120733 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:58.120733 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:58.120733 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:58.120733 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:10:58.120733 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:10:58.120733 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 07 01:10:58.120733 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:10:58.124534 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-33f89b30-7e94-4cea-a236-f4674329347a tempest-ImagesMetadataNegativeTestJSON-1221389494 tempest-ImagesMetadataNegativeTestJSON-1221389494-project] Returning 404 to user: Image not found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:58.124534 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-33f89b30-7e94-4cea-a236-f4674329347a tempest-ImagesMetadataNegativeTestJSON-1221389494 tempest-ImagesMetadataNegativeTestJSON-1221389494-project] 10.222.0.39 "POST /compute/v2.1/images/3d196c4e-2393-4aa7-8f52-674421f627d8/metadata" status: 404 len: 62 microversion: 2.1 time: 0.138260 Aug 07 01:10:58.124534 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 162/353] 10.222.0.39 () {60 vars in 1281 bytes} [Sun Aug 7 01:10:57 2022] POST /compute/v2.1/images/3d196c4e-2393-4aa7-8f52-674421f627d8/metadata => generated 62 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:10:58.574622 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-9a5203a2-af94-45f4-9906-a4d84494190c tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] HTTP exception thrown: Flavor access already exists for flavor 31 and project 01a04222bcde49e59e746386b54d90a0 combination. Aug 07 01:10:58.620323 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9a5203a2-af94-45f4-9906-a4d84494190c tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] Request method failure captured: Aug 07 01:10:58.620323 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/flavors/1969937548/action HTTP/1.1 Aug 07 01:10:58.620323 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:10:58.620323 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:10:58.620323 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:10:58.620323 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 67 Aug 07 01:10:58.620323 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:10:58.620323 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:10:58.620323 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:10:58.620323 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:58.620323 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xEapYY0l1H-nQIHEqCeUTgODlFS2ZdfJqno1-E3Mid-WzqzMBHcB-b0nG4V8m6ZauK1OM7XN0Mtp7MtuY-DGsMV7p2LCmQIVFMjhQCr4699bQmpAbMufggQCYyB5mgirvFyx2WiTyjF136ckfuCiptgG9pLNOG1X_S_ORcFNkVctGU Aug 07 01:10:58.620323 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:10:58.620323 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:10:58.620323 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:10:58.620323 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:10:58.620323 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:10:58.620323 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:10:58.620323 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: ffca783753d8464da99a508374e3551c Aug 07 01:10:58.620323 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-149643226 Aug 07 01:10:58.620323 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,admin,member Aug 07 01:10:58.620323 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,admin,member Aug 07 01:10:58.623155 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ffca783753d8464da99a508374e3551c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ffca783753d8464da99a508374e3551c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ffca783753d8464da99a508374e3551c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ffca783753d8464da99a508374e3551c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:58.623155 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-149643226 Aug 07 01:10:58.623155 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: ffca783753d8464da99a508374e3551c Aug 07 01:10:58.623155 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-149643226 Aug 07 01:10:58.623155 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin Aug 07 01:10:58.623155 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:10:58.623155 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:10:58.623155 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 1d41b32b2deb4713841afe180277b8f3 Aug 07 01:10:58.623155 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin Aug 07 01:10:58.623155 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:10:58.623155 n-d-master-1 devstack@n-api.service[119516]: {"addTenantAccess": {"tenant": "01a04222bcde49e59e746386b54d90a0"}} Aug 07 01:10:58.623155 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:10:58.624903 n-d-master-1 devstack@n-api.service[119516]: exception: Flavor access already exists for flavor 31 and project 01a04222bcde49e59e746386b54d90a0 combination. Aug 07 01:10:58.624903 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '1969937548', 'body': {'addTenantAccess': {'tenant': '01a04222bcde49e59e746386b54d90a0'}}} Aug 07 01:10:58.624903 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:58.624903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:58.624903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 01:10:58.624903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 07 01:10:58.624903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 01:10:58.624903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 07 01:10:58.624903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 01:10:58.624903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 07 01:10:58.624903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 01:10:58.624903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 07 01:10:58.624903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 01:10:58.624903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 01:10:58.624903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 01:10:58.624903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result.read() Aug 07 01:10:58.624903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 01:10:58.624903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 07 01:10:58.629420 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 01:10:58.629420 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 07 01:10:58.629420 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 01:10:58.629420 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 07 01:10:58.629420 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 01:10:58.629420 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 07 01:10:58.629420 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '31-01a04222bcde49e59e746386b54d90a0' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 07 01:10:58.629420 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:58.629420 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 07 01:10:58.629420 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:58.629420 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:58.629420 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 07 01:10:58.629420 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 07 01:10:58.629420 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 07 01:10:58.629420 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi session.flush() Aug 07 01:10:58.629420 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 07 01:10:58.629420 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 07 01:10:58.629420 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 07 01:10:58.629420 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 07 01:10:58.633708 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 07 01:10:58.633708 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 07 01:10:58.633708 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 01:10:58.633708 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception Aug 07 01:10:58.633708 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 07 01:10:58.633708 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 07 01:10:58.633708 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 07 01:10:58.633708 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 07 01:10:58.633708 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 07 01:10:58.633708 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 07 01:10:58.633708 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 07 01:10:58.633708 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 07 01:10:58.633708 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 07 01:10:58.633708 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 07 01:10:58.633708 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 07 01:10:58.633708 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 07 01:10:58.633708 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 07 01:10:58.633708 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 07 01:10:58.638642 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 07 01:10:58.638642 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 07 01:10:58.638642 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 07 01:10:58.638642 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 07 01:10:58.638642 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 07 01:10:58.638642 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 07 01:10:58.638642 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 01:10:58.638642 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception Aug 07 01:10:58.638642 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 01:10:58.638642 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 07 01:10:58.638642 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 01:10:58.638642 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 07 01:10:58.638642 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 01:10:58.638642 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 07 01:10:58.638642 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 01:10:58.638642 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 07 01:10:58.638642 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 01:10:58.638642 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 01:10:58.642738 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 01:10:58.642738 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result.read() Aug 07 01:10:58.642738 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 01:10:58.642738 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 07 01:10:58.642738 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 01:10:58.642738 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 07 01:10:58.642738 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 01:10:58.642738 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 07 01:10:58.642738 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 01:10:58.642738 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 07 01:10:58.642738 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '31-01a04222bcde49e59e746386b54d90a0' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 07 01:10:58.642738 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 07 01:10:58.642738 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 7, 1, 10, 58, 558172), 'updated_at': None, 'flavor_id': 31, 'project_id': '01a04222bcde49e59e746386b54d90a0'}] Aug 07 01:10:58.642738 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 07 01:10:58.642738 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:58.642738 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:58.642738 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:58.646715 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:58.646715 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 07 01:10:58.646715 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 07 01:10:58.646715 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 07 01:10:58.646715 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 07 01:10:58.646715 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 07 01:10:58.646715 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 07 01:10:58.646715 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 07 01:10:58.646715 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 07 01:10:58.646715 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 07 01:10:58.646715 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 07 01:10:58.646715 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 07 01:10:58.646715 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 07 01:10:58.646715 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 07 01:10:58.646715 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 07 01:10:58.646715 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 31 and project 01a04222bcde49e59e746386b54d90a0 combination. Aug 07 01:10:58.646715 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:58.646715 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:58.646715 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:58.653551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:58.653551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:58.653551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:58.653551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:58.653551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:58.653551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:58.653551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:58.653551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:10:58.653551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:10:58.653551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 07 01:10:58.653551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 07 01:10:58.653551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 31 and project 01a04222bcde49e59e746386b54d90a0 combination. Aug 07 01:10:58.653551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:58.653551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:58.653551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:58.653551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:58.653551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:58.653551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:58.653551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:10:58.653551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:10:58.658463 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 31 and project 01a04222bcde49e59e746386b54d90a0 combination. Aug 07 01:10:58.658463 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:58.658463 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9a5203a2-af94-45f4-9906-a4d84494190c tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] Returning 409 to user: Flavor access already exists for flavor 31 and project 01a04222bcde49e59e746386b54d90a0 combination. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:58.659766 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9a5203a2-af94-45f4-9906-a4d84494190c tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/1969937548/action" status: 409 len: 152 microversion: 2.1 time: 1.051603 Aug 07 01:10:58.670335 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 192/354] 10.222.0.39 () {60 vars in 1200 bytes} [Sun Aug 7 01:10:57 2022] POST /compute/v2.1/flavors/1969937548/action => generated 152 bytes in 1073 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:10:58.684145 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b7e166b9-db2a-484a-a27b-cf8ab8d00deb tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:58.685939 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b7e166b9-db2a-484a-a27b-cf8ab8d00deb tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:10:58.701562 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7e166b9-db2a-484a-a27b-cf8ab8d00deb tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:58.704265 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7e166b9-db2a-484a-a27b-cf8ab8d00deb tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:58.706929 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7e166b9-db2a-484a-a27b-cf8ab8d00deb tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:58.711964 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7e166b9-db2a-484a-a27b-cf8ab8d00deb tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:10:58.713806 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7e166b9-db2a-484a-a27b-cf8ab8d00deb tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:10:58.715000 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7e166b9-db2a-484a-a27b-cf8ab8d00deb tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:10:58.716593 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1b9752cf-2958-406b-aac7-ea7de25d457c tempest-FlavorsV2TestJSON-226172311 tempest-FlavorsV2TestJSON-226172311-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:58.768208 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1b9752cf-2958-406b-aac7-ea7de25d457c tempest-FlavorsV2TestJSON-226172311 tempest-FlavorsV2TestJSON-226172311-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.501184 Aug 07 01:10:58.774425 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 163/355] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Aug 7 01:10:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:58.801229 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cd671fc5-8b75-4f63-9a8b-477e8fc15a5e tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "01a04222bcde49e59e746386b54d90a0"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:58.822595 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:58.822595 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:59.052376 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cd671fc5-8b75-4f63-9a8b-477e8fc15a5e tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/1969937548/action" status: 200 len: 21 microversion: 2.1 time: 0.275881 Aug 07 01:10:59.055351 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 164/356] 10.222.0.39 () {60 vars in 1200 bytes} [Sun Aug 7 01:10:58 2022] POST /compute/v2.1/flavors/1969937548/action => generated 21 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:10:59.063671 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-af7fa7b4-da8a-4ca0-937c-9896f1621055 tempest-FlavorsV2TestJSON-226172311 tempest-FlavorsV2TestJSON-226172311-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:59.114250 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-af7fa7b4-da8a-4ca0-937c-9896f1621055 tempest-FlavorsV2TestJSON-226172311 tempest-FlavorsV2TestJSON-226172311-project] 10.222.0.39 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.057026 Aug 07 01:10:59.115481 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 165/357] 10.222.0.39 () {58 vars in 1125 bytes} [Sun Aug 7 01:10:59 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:59.125455 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c5db6644-8fd3-4e23-a4b3-e55d36287a70 tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:59.127541 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:59.127541 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:10:59.142028 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b7e166b9-db2a-484a-a27b-cf8ab8d00deb tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:10:59.183950 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b7e166b9-db2a-484a-a27b-cf8ab8d00deb tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0" status: 200 len: 1268 microversion: 2.1 time: 0.508986 Aug 07 01:10:59.184677 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c5db6644-8fd3-4e23-a4b3-e55d36287a70 tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1969937548" status: 202 len: 0 microversion: 2.1 time: 0.067058 Aug 07 01:10:59.185770 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 166/358] 10.222.0.39 () {58 vars in 1161 bytes} [Sun Aug 7 01:10:59 2022] DELETE /compute/v2.1/flavors/1969937548 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:10:59.194202 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 193/359] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:10:58 2022] GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 => generated 1268 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:59.214190 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-eb859fba-d57b-4851-91aa-9be7c1298e18 tempest-FlavorsV2TestJSON-226172311 tempest-FlavorsV2TestJSON-226172311-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:59.230286 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b2999fbc-633d-4278-a1d4-07a55ee610c0 tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:59.275355 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-eb859fba-d57b-4851-91aa-9be7c1298e18 tempest-FlavorsV2TestJSON-226172311 tempest-FlavorsV2TestJSON-226172311-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.080277 Aug 07 01:10:59.276646 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 167/360] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Aug 7 01:10:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:59.337586 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-44db74b4-3e50-4438-aee1-ed98cd02349f tempest-FlavorsV2TestJSON-226172311 tempest-FlavorsV2TestJSON-226172311-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:59.390839 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-44db74b4-3e50-4438-aee1-ed98cd02349f tempest-FlavorsV2TestJSON-226172311 tempest-FlavorsV2TestJSON-226172311-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.088189 Aug 07 01:10:59.418232 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 168/361] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Aug 7 01:10:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:59.438544 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d0b7962b-0d2f-46f5-99b0-d3004fc82f54 tempest-FlavorsV2TestJSON-226172311 tempest-FlavorsV2TestJSON-226172311-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:59.447334 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b2999fbc-633d-4278-a1d4-07a55ee610c0 tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.237741 Aug 07 01:10:59.448490 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 194/362] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:10:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:59.512898 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d0b7962b-0d2f-46f5-99b0-d3004fc82f54 tempest-FlavorsV2TestJSON-226172311 tempest-FlavorsV2TestJSON-226172311-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.092106 Aug 07 01:10:59.513192 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-775daac5-dbab-449a-af63-f946509e8f43 tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1348150302", "id": 834435946, "os-flavor-access:is_public": "True"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:10:59.515408 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 169/363] 10.222.0.39 () {58 vars in 1165 bytes} [Sun Aug 7 01:10:59 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:10:59.527948 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:59.527948 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:10:59.571599 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:59.571967 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f1022c3d-b971-466a-94a2-feb0451c5fd4 tempest-FlavorsV2TestJSON-226172311 tempest-FlavorsV2TestJSON-226172311-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:59.613615 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f1022c3d-b971-466a-94a2-feb0451c5fd4 tempest-FlavorsV2TestJSON-226172311 tempest-FlavorsV2TestJSON-226172311-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.064429 Aug 07 01:10:59.625068 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 170/364] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Aug 7 01:10:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:10:59.643653 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-775daac5-dbab-449a-af63-f946509e8f43 tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.150708 Aug 07 01:10:59.649573 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3afc37de-713a-4bd1-ac9c-4b9dae021793 tempest-FlavorsV2TestJSON-226172311 tempest-FlavorsV2TestJSON-226172311-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:59.650826 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 195/365] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:10:59 2022] POST /compute/v2.1/flavors => generated 435 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:10:59.687463 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c3d9fe08-a1dc-47c1-829b-fdc8a96f688b tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:59.690279 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:59.690279 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:10:59.705826 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-c3d9fe08-a1dc-47c1-829b-fdc8a96f688b tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 07 01:10:59.709027 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c3d9fe08-a1dc-47c1-829b-fdc8a96f688b tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] Request method failure captured: Aug 07 01:10:59.709027 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/flavors/834435946/os-flavor-access HTTP/1.1 Aug 07 01:10:59.709027 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:10:59.709027 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:10:59.709027 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:10:59.709027 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:10:59.709027 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:10:59.709027 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:10:59.709027 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:10:59.709027 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:10:59.709027 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xEapYY0l1H-nQIHEqCeUTgODlFS2ZdfJqno1-E3Mid-WzqzMBHcB-b0nG4V8m6ZauK1OM7XN0Mtp7MtuY-DGsMV7p2LCmQIVFMjhQCr4699bQmpAbMufggQCYyB5mgirvFyx2WiTyjF136ckfuCiptgG9pLNOG1X_S_ORcFNkVctGU Aug 07 01:10:59.709027 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:10:59.709027 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:10:59.709027 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:10:59.709027 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:10:59.709027 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:10:59.709027 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:10:59.709027 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: ffca783753d8464da99a508374e3551c Aug 07 01:10:59.709027 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-149643226 Aug 07 01:10:59.709027 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,admin,member Aug 07 01:10:59.709027 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,admin,member Aug 07 01:10:59.711971 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ffca783753d8464da99a508374e3551c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ffca783753d8464da99a508374e3551c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ffca783753d8464da99a508374e3551c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ffca783753d8464da99a508374e3551c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:10:59.711971 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-149643226 Aug 07 01:10:59.711971 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: ffca783753d8464da99a508374e3551c Aug 07 01:10:59.711971 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-149643226 Aug 07 01:10:59.711971 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin Aug 07 01:10:59.711971 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:10:59.711971 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:10:59.711971 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 1d41b32b2deb4713841afe180277b8f3 Aug 07 01:10:59.711971 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin Aug 07 01:10:59.711971 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:10:59.711971 n-d-master-1 devstack@n-api.service[119516]: exception: Access list not available for public flavors. Aug 07 01:10:59.711971 n-d-master-1 devstack@n-api.service[119516]: action_args: {'flavor_id': '834435946'} Aug 07 01:10:59.713746 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:10:59.713746 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:59.713746 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:59.713746 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:59.713746 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:10:59.713746 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:10:59.713746 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:10:59.713746 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:10:59.713746 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 07 01:10:59.713746 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 07 01:10:59.713746 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 07 01:10:59.713746 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:59.713746 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:10:59.713746 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:59.713746 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:10:59.713746 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:10:59.713746 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:10:59.713746 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:10:59.713746 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:10:59.713746 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 07 01:10:59.713746 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:10:59.718080 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c3d9fe08-a1dc-47c1-829b-fdc8a96f688b tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:10:59.720287 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c3d9fe08-a1dc-47c1-829b-fdc8a96f688b tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/834435946/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.053673 Aug 07 01:10:59.729132 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 196/366] 10.222.0.39 () {58 vars in 1206 bytes} [Sun Aug 7 01:10:59 2022] GET /compute/v2.1/flavors/834435946/os-flavor-access => generated 91 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 07 01:10:59.742101 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9475c263-34dd-46be-85b0-7af52632c6fb tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:59.744531 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:10:59.744531 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:10:59.755417 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3afc37de-713a-4bd1-ac9c-4b9dae021793 tempest-FlavorsV2TestJSON-226172311 tempest-FlavorsV2TestJSON-226172311-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.114275 Aug 07 01:10:59.763976 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 171/367] 10.222.0.39 () {58 vars in 1169 bytes} [Sun Aug 7 01:10:59 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:10:59.793587 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d6f1f9c4-7aec-474b-9a8a-818cbb310799 tempest-FlavorsV2TestJSON-226172311 tempest-FlavorsV2TestJSON-226172311-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:59.817473 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9475c263-34dd-46be-85b0-7af52632c6fb tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/834435946" status: 202 len: 0 microversion: 2.1 time: 0.084421 Aug 07 01:10:59.818265 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 197/368] 10.222.0.39 () {58 vars in 1158 bytes} [Sun Aug 7 01:10:59 2022] DELETE /compute/v2.1/flavors/834435946 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:10:59.840266 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-42b061da-d32b-42b7-ab56-d0e033bf61e8 tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:59.860867 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d6f1f9c4-7aec-474b-9a8a-818cbb310799 tempest-FlavorsV2TestJSON-226172311 tempest-FlavorsV2TestJSON-226172311-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.077168 Aug 07 01:10:59.863844 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 172/369] 10.222.0.39 () {58 vars in 1161 bytes} [Sun Aug 7 01:10:59 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:59.895872 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0d7f035b-6210-4ce4-92a1-11992b59d2b6 tempest-FlavorsV2TestJSON-226172311 tempest-FlavorsV2TestJSON-226172311-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:10:59.934647 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0d7f035b-6210-4ce4-92a1-11992b59d2b6 tempest-FlavorsV2TestJSON-226172311 tempest-FlavorsV2TestJSON-226172311-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.052949 Aug 07 01:10:59.938999 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-42b061da-d32b-42b7-ab56-d0e033bf61e8 tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.113546 Aug 07 01:10:59.942209 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 173/370] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Aug 7 01:10:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:10:59.974621 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 198/371] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:10:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:11:00.018667 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-77fb8709-4695-46ac-b81a-ea4f8d253bcd tempest-FlavorsV2TestJSON-226172311 tempest-FlavorsV2TestJSON-226172311-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:00.042066 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-40d7dd69-e879-4de4-8e86-96fe9baf7764 tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-982977538", "id": 715371936, "os-flavor-access:is_public": "False"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:11:00.112611 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-77fb8709-4695-46ac-b81a-ea4f8d253bcd tempest-FlavorsV2TestJSON-226172311 tempest-FlavorsV2TestJSON-226172311-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.160485 Aug 07 01:11:00.113526 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 174/372] 10.222.0.39 () {58 vars in 1167 bytes} [Sun Aug 7 01:10:59 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:11:00.118494 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-40d7dd69-e879-4de4-8e86-96fe9baf7764 tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.110897 Aug 07 01:11:00.148685 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-91eab046-80b6-423b-afd9-a0a9188f6501 tempest-FlavorsV2TestJSON-226172311 tempest-FlavorsV2TestJSON-226172311-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:00.150976 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 199/373] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:11:00 2022] POST /compute/v2.1/flavors => generated 435 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:11:00.171086 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-91eab046-80b6-423b-afd9-a0a9188f6501 tempest-FlavorsV2TestJSON-226172311 tempest-FlavorsV2TestJSON-226172311-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028810 Aug 07 01:11:00.172186 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 175/374] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Aug 7 01:11:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:11:00.190687 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-82665301-d7f0-4c1e-8417-399b8568c7c4 tempest-FlavorsV2TestJSON-226172311 tempest-FlavorsV2TestJSON-226172311-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:00.236578 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-82665301-d7f0-4c1e-8417-399b8568c7c4 tempest-FlavorsV2TestJSON-226172311 tempest-FlavorsV2TestJSON-226172311-project] 10.222.0.39 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.043544 Aug 07 01:11:00.237759 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 176/375] 10.222.0.39 () {58 vars in 1144 bytes} [Sun Aug 7 01:11:00 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:00.247042 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-313e58fd-6f86-48c6-a3cb-a1410bfdc95b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:00.247687 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-313e58fd-6f86-48c6-a3cb-a1410bfdc95b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:00.280881 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-313e58fd-6f86-48c6-a3cb-a1410bfdc95b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:00.281544 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-313e58fd-6f86-48c6-a3cb-a1410bfdc95b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:00.283036 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-313e58fd-6f86-48c6-a3cb-a1410bfdc95b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:00.284346 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-313e58fd-6f86-48c6-a3cb-a1410bfdc95b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:00.285068 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-313e58fd-6f86-48c6-a3cb-a1410bfdc95b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:00.285727 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-313e58fd-6f86-48c6-a3cb-a1410bfdc95b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:01.144820 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e4b4ad32-4017-40f1-9d3a-5c0ec0209895 tempest-FlavorsAccessNegativeTestJSON-70191556 tempest-FlavorsAccessNegativeTestJSON-70191556-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "01a04222bcde49e59e746386b54d90a0"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:11:01.153836 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:11:01.153836 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:11:01.156151 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e4b4ad32-4017-40f1-9d3a-5c0ec0209895 tempest-FlavorsAccessNegativeTestJSON-70191556 tempest-FlavorsAccessNegativeTestJSON-70191556-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '852b7ed92928432db151af35a713a77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a04222bcde49e59e746386b54d90a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:01.160185 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e4b4ad32-4017-40f1-9d3a-5c0ec0209895 tempest-FlavorsAccessNegativeTestJSON-70191556 tempest-FlavorsAccessNegativeTestJSON-70191556-project] Request method failure captured: Aug 07 01:11:01.160185 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/flavors/715371936/action HTTP/1.1 Aug 07 01:11:01.160185 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:11:01.160185 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:11:01.160185 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:11:01.160185 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 67 Aug 07 01:11:01.160185 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:11:01.160185 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:11:01.160185 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:11:01.160185 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:11:01.160185 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xEVfs57eB7XuqTmJFVaJzsdNSCYePwCs-yDTv87mSSIGzvx1CxT3GVzMSAMl9djDW_bNTWdhNBBYFDC2ZgUJca50y6MKlx7d703NsEe-9XkDJlDPWIwRh4t5xpQmZsOnJaeZl-tWTEn8RXcUrokZPVdxD0aOmIRd4ebxEGRy9KTWYI Aug 07 01:11:01.160185 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:11:01.160185 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:11:01.160185 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:11:01.160185 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:11:01.160185 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:11:01.160185 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:11:01.160185 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 01a04222bcde49e59e746386b54d90a0 Aug 07 01:11:01.160185 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-70191556 Aug 07 01:11:01.160185 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:11:01.160185 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:11:01.162789 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/01a04222bcde49e59e746386b54d90a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_01a04222bcde49e59e746386b54d90a0", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/01a04222bcde49e59e746386b54d90a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/01a04222bcde49e59e746386b54d90a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:11:01.162789 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-70191556 Aug 07 01:11:01.162789 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 01a04222bcde49e59e746386b54d90a0 Aug 07 01:11:01.162789 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-70191556 Aug 07 01:11:01.162789 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-FlavorsAccessNegativeTestJSON-70191556-project Aug 07 01:11:01.162789 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:11:01.162789 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:11:01.162789 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 852b7ed92928432db151af35a713a77b Aug 07 01:11:01.162789 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-70191556-project Aug 07 01:11:01.162789 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:11:01.162789 n-d-master-1 devstack@n-api.service[119516]: {"addTenantAccess": {"tenant": "01a04222bcde49e59e746386b54d90a0"}} Aug 07 01:11:01.162789 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:11:01.164868 n-d-master-1 devstack@n-api.service[119516]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 07 01:11:01.164868 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '715371936', 'body': {'addTenantAccess': {'tenant': '01a04222bcde49e59e746386b54d90a0'}}} Aug 07 01:11:01.164868 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:11:01.164868 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:01.164868 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:11:01.164868 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:11:01.164868 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:11:01.164868 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:11:01.164868 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:11:01.164868 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:11:01.164868 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:11:01.164868 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:11:01.164868 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 07 01:11:01.164868 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 07 01:11:01.164868 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 07 01:11:01.164868 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 07 01:11:01.164868 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 07 01:11:01.164868 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 07 01:11:01.164868 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:11:01.169415 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:11:01.169415 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:11:01.169415 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:11:01.169415 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 07 01:11:01.169415 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 07 01:11:01.169415 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 07 01:11:01.169415 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 07 01:11:01.169415 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 07 01:11:01.169415 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 07 01:11:01.169415 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 07 01:11:01.169415 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:01.169415 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:11:01.169415 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:01.169415 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:01.169415 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:11:01.169415 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:11:01.169415 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 07 01:11:01.169415 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 07 01:11:01.169415 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 07 01:11:01.169415 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:01.182560 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e4b4ad32-4017-40f1-9d3a-5c0ec0209895 tempest-FlavorsAccessNegativeTestJSON-70191556 tempest-FlavorsAccessNegativeTestJSON-70191556-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:11:01.186389 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e4b4ad32-4017-40f1-9d3a-5c0ec0209895 tempest-FlavorsAccessNegativeTestJSON-70191556 tempest-FlavorsAccessNegativeTestJSON-70191556-project] 10.222.0.39 "POST /compute/v2.1/flavors/715371936/action" status: 403 len: 130 microversion: 2.1 time: 1.031871 Aug 07 01:11:01.195446 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 200/376] 10.222.0.39 () {60 vars in 1197 bytes} [Sun Aug 7 01:11:00 2022] POST /compute/v2.1/flavors/715371936/action => generated 130 bytes in 1044 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:11:01.218848 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c1428cb1-44c8-4e1d-8582-66ea57431713 tempest-FlavorsV2TestJSON-226172311 tempest-FlavorsV2TestJSON-226172311-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:01.250816 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c1428cb1-44c8-4e1d-8582-66ea57431713 tempest-FlavorsV2TestJSON-226172311 tempest-FlavorsV2TestJSON-226172311-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.052294 Aug 07 01:11:01.252257 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 201/377] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Aug 7 01:11:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:11:01.286324 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a5670e6e-2967-4902-aa6d-f61629f2c79b tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:01.338620 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a5670e6e-2967-4902-aa6d-f61629f2c79b tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/715371936" status: 202 len: 0 microversion: 2.1 time: 0.081372 Aug 07 01:11:01.346373 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 202/378] 10.222.0.39 () {58 vars in 1158 bytes} [Sun Aug 7 01:11:01 2022] DELETE /compute/v2.1/flavors/715371936 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:11:01.357819 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-45a0a353-4fe2-4cec-acba-cf18e985e68a tempest-FlavorsV2TestJSON-226172311 tempest-FlavorsV2TestJSON-226172311-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:01.391808 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:01.446907 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-45a0a353-4fe2-4cec-acba-cf18e985e68a tempest-FlavorsV2TestJSON-226172311 tempest-FlavorsV2TestJSON-226172311-project] 10.222.0.39 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.098258 Aug 07 01:11:01.460636 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 203/379] 10.222.0.39 () {58 vars in 1148 bytes} [Sun Aug 7 01:11:01 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:01.467974 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-adb283f2-af90-402e-8c77-5aa6cc25a5bc tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:01.522128 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-adb283f2-af90-402e-8c77-5aa6cc25a5bc tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060067 Aug 07 01:11:01.535924 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 204/380] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:11:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:01.535924 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e0631dd0-2cef-4433-92c4-fbb43d76ab7b tempest-FlavorsV2TestJSON-226172311 tempest-FlavorsV2TestJSON-226172311-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:01.562334 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e0631dd0-2cef-4433-92c4-fbb43d76ab7b tempest-FlavorsV2TestJSON-226172311 tempest-FlavorsV2TestJSON-226172311-project] 10.222.0.39 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.036453 Aug 07 01:11:01.572684 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 205/381] 10.222.0.39 () {58 vars in 1140 bytes} [Sun Aug 7 01:11:01 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:11:01.578648 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-333927cc-6bdc-4ec6-b58b-de3205e22493 tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-935256744", "id": 537607951, "os-flavor-access:is_public": "False"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:11:01.611783 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-333927cc-6bdc-4ec6-b58b-de3205e22493 tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.037268 Aug 07 01:11:01.613765 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 206/382] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:11:01 2022] POST /compute/v2.1/flavors => generated 435 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:11:01.620910 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-aab55022-3c8d-4221-a72f-88ecd6d7a6c2 tempest-FlavorsV2TestJSON-226172311 tempest-FlavorsV2TestJSON-226172311-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:01.653672 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-aab55022-3c8d-4221-a72f-88ecd6d7a6c2 tempest-FlavorsV2TestJSON-226172311 tempest-FlavorsV2TestJSON-226172311-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.037976 Aug 07 01:11:01.654666 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 207/383] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Aug 7 01:11:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:11:01.662726 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3e8b6120-6a5a-4af0-bdeb-88e23690bc5b tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "01a04222bcde49e59e746386b54d90a0"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:11:01.707319 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-313e58fd-6f86-48c6-a3cb-a1410bfdc95b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:01.746366 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-313e58fd-6f86-48c6-a3cb-a1410bfdc95b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0" status: 200 len: 1310 microversion: 2.1 time: 1.506980 Aug 07 01:11:01.749940 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 177/384] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:00 2022] GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 => generated 1310 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:01.781006 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0c1993b1-5bbd-432e-bd60-25f1e53b9bd7 tempest-FlavorsV2TestJSON-226172311 tempest-FlavorsV2TestJSON-226172311-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:01.924877 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0c1993b1-5bbd-432e-bd60-25f1e53b9bd7 tempest-FlavorsV2TestJSON-226172311 tempest-FlavorsV2TestJSON-226172311-project] 10.222.0.39 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.170511 Aug 07 01:11:01.932106 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 178/385] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:11:01 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:01.961717 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f385aeef-af84-48ba-97d6-8962a6f84fd7 tempest-FlavorsV2TestJSON-226172311 tempest-FlavorsV2TestJSON-226172311-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:01.998209 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=88,nova_api:DELETE=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:02.108286 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f385aeef-af84-48ba-97d6-8962a6f84fd7 tempest-FlavorsV2TestJSON-226172311 tempest-FlavorsV2TestJSON-226172311-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.154104 Aug 07 01:11:02.113253 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 179/386] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:11:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:02.153198 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2aa7ac76-87ca-4060-90c7-70f2648f885a tempest-FlavorsV2TestJSON-226172311 tempest-FlavorsV2TestJSON-226172311-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:02.199181 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2aa7ac76-87ca-4060-90c7-70f2648f885a tempest-FlavorsV2TestJSON-226172311 tempest-FlavorsV2TestJSON-226172311-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.057943 Aug 07 01:11:02.200122 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 180/387] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Aug 7 01:11:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:11:02.797143 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-882dd78c-a966-4d37-a6bc-450e67309a29 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:02.800943 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-882dd78c-a966-4d37-a6bc-450e67309a29 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:02.817247 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=4 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:02.857656 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-882dd78c-a966-4d37-a6bc-450e67309a29 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:02.858592 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-882dd78c-a966-4d37-a6bc-450e67309a29 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:02.875081 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-882dd78c-a966-4d37-a6bc-450e67309a29 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:02.881365 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-882dd78c-a966-4d37-a6bc-450e67309a29 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:02.883709 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-882dd78c-a966-4d37-a6bc-450e67309a29 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:02.889042 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-882dd78c-a966-4d37-a6bc-450e67309a29 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:03.065274 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:03.276320 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3e8b6120-6a5a-4af0-bdeb-88e23690bc5b tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/537607951/action" status: 200 len: 96 microversion: 2.1 time: 1.618751 Aug 07 01:11:03.277027 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 208/388] 10.222.0.39 () {60 vars in 1197 bytes} [Sun Aug 7 01:11:01 2022] POST /compute/v2.1/flavors/537607951/action => generated 96 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:11:03.295742 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-60351fff-4144-48ae-a021-a7dce9ddbae8 tempest-FlavorsAccessNegativeTestJSON-70191556 tempest-FlavorsAccessNegativeTestJSON-70191556-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "01a04222bcde49e59e746386b54d90a0"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:11:03.306577 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:11:03.306577 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:11:03.310224 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-60351fff-4144-48ae-a021-a7dce9ddbae8 tempest-FlavorsAccessNegativeTestJSON-70191556 tempest-FlavorsAccessNegativeTestJSON-70191556-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '852b7ed92928432db151af35a713a77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a04222bcde49e59e746386b54d90a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:03.316344 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-60351fff-4144-48ae-a021-a7dce9ddbae8 tempest-FlavorsAccessNegativeTestJSON-70191556 tempest-FlavorsAccessNegativeTestJSON-70191556-project] Request method failure captured: Aug 07 01:11:03.316344 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/flavors/537607951/action HTTP/1.1 Aug 07 01:11:03.316344 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:11:03.316344 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:11:03.316344 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:11:03.316344 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 70 Aug 07 01:11:03.316344 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:11:03.316344 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:11:03.316344 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:11:03.316344 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:11:03.316344 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xEVfs57eB7XuqTmJFVaJzsdNSCYePwCs-yDTv87mSSIGzvx1CxT3GVzMSAMl9djDW_bNTWdhNBBYFDC2ZgUJca50y6MKlx7d703NsEe-9XkDJlDPWIwRh4t5xpQmZsOnJaeZl-tWTEn8RXcUrokZPVdxD0aOmIRd4ebxEGRy9KTWYI Aug 07 01:11:03.316344 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:11:03.316344 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:11:03.316344 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:11:03.316344 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:11:03.316344 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:11:03.316344 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:11:03.316344 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 01a04222bcde49e59e746386b54d90a0 Aug 07 01:11:03.316344 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-70191556 Aug 07 01:11:03.316344 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:11:03.316344 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:11:03.318716 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/01a04222bcde49e59e746386b54d90a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_01a04222bcde49e59e746386b54d90a0", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/01a04222bcde49e59e746386b54d90a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/01a04222bcde49e59e746386b54d90a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:11:03.318716 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-70191556 Aug 07 01:11:03.318716 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 01a04222bcde49e59e746386b54d90a0 Aug 07 01:11:03.318716 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-70191556 Aug 07 01:11:03.318716 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-FlavorsAccessNegativeTestJSON-70191556-project Aug 07 01:11:03.318716 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:11:03.318716 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:11:03.318716 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 852b7ed92928432db151af35a713a77b Aug 07 01:11:03.318716 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-70191556-project Aug 07 01:11:03.318716 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:11:03.318716 n-d-master-1 devstack@n-api.service[119516]: {"removeTenantAccess": {"tenant": "01a04222bcde49e59e746386b54d90a0"}} Aug 07 01:11:03.318716 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:11:03.320153 n-d-master-1 devstack@n-api.service[119516]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 07 01:11:03.320153 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '537607951', 'body': {'removeTenantAccess': {'tenant': '01a04222bcde49e59e746386b54d90a0'}}} Aug 07 01:11:03.320153 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:11:03.320153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:03.320153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:11:03.320153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:11:03.320153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:11:03.320153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:11:03.320153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:11:03.320153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:11:03.320153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:11:03.320153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:11:03.320153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 07 01:11:03.320153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi context.can( Aug 07 01:11:03.320153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 07 01:11:03.320153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 07 01:11:03.320153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 07 01:11:03.320153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 07 01:11:03.320153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:11:03.320153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:11:03.322308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:11:03.322308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:11:03.322308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 07 01:11:03.322308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 07 01:11:03.322308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 07 01:11:03.322308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 07 01:11:03.322308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 07 01:11:03.322308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 07 01:11:03.322308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 07 01:11:03.322308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:03.322308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:11:03.322308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:03.322308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:03.322308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:11:03.322308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:11:03.322308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 07 01:11:03.322308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 07 01:11:03.322308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 07 01:11:03.322308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:03.327196 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-60351fff-4144-48ae-a021-a7dce9ddbae8 tempest-FlavorsAccessNegativeTestJSON-70191556 tempest-FlavorsAccessNegativeTestJSON-70191556-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:11:03.327196 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-60351fff-4144-48ae-a021-a7dce9ddbae8 tempest-FlavorsAccessNegativeTestJSON-70191556 tempest-FlavorsAccessNegativeTestJSON-70191556-project] 10.222.0.39 "POST /compute/v2.1/flavors/537607951/action" status: 403 len: 133 microversion: 2.1 time: 0.032444 Aug 07 01:11:03.332069 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 209/389] 10.222.0.39 () {60 vars in 1197 bytes} [Sun Aug 7 01:11:03 2022] POST /compute/v2.1/flavors/537607951/action => generated 133 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:11:03.348911 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8767d5e9-dba1-4c73-beea-63aa0e614f1a tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "01a04222bcde49e59e746386b54d90a0"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:11:04.298291 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8767d5e9-dba1-4c73-beea-63aa0e614f1a tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/537607951/action" status: 200 len: 21 microversion: 2.1 time: 0.963440 Aug 07 01:11:04.301270 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 210/390] 10.222.0.39 () {60 vars in 1197 bytes} [Sun Aug 7 01:11:03 2022] POST /compute/v2.1/flavors/537607951/action => generated 21 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:11:04.327556 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-98e9555f-471a-4b65-af1c-04d4fab0338a tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:04.378400 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-98e9555f-471a-4b65-af1c-04d4fab0338a tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/537607951" status: 202 len: 0 microversion: 2.1 time: 0.065846 Aug 07 01:11:04.380812 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 211/391] 10.222.0.39 () {58 vars in 1158 bytes} [Sun Aug 7 01:11:04 2022] DELETE /compute/v2.1/flavors/537607951 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:11:04.410942 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b6fe6703-9d98-40cf-94aa-feb200187719 tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:04.515586 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b6fe6703-9d98-40cf-94aa-feb200187719 tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.127851 Aug 07 01:11:04.525328 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 212/392] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:11:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:04.553156 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bd59e8f2-65e1-466f-8f5d-0edad18be2bb tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-79078861", "id": 456520508, "os-flavor-access:is_public": "False"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:11:04.637580 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bd59e8f2-65e1-466f-8f5d-0edad18be2bb tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.095445 Aug 07 01:11:04.646553 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 213/393] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:11:04 2022] POST /compute/v2.1/flavors => generated 434 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:11:04.661741 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dc0dd1a2-f470-4a68-a3d1-3b124ad81fe7 tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "bc6cabea74704570a310547c7077b366"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:11:04.976120 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-882dd78c-a966-4d37-a6bc-450e67309a29 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:04.990253 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-882dd78c-a966-4d37-a6bc-450e67309a29 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0" status: 200 len: 1310 microversion: 2.1 time: 2.204154 Aug 07 01:11:05.000343 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 181/394] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:02 2022] GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 => generated 1310 bytes in 2215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:05.623836 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-6814031c-9ff6-46e7-a841-36e3ba5622ba req-db922e47-0da2-4702-938e-35538baf8071 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a06b411-f5fe-46fa-9e79-d208fd6dcbf0", "tag": "d903aed3-3bb4-4c2d-bd4a-d9b615524a34"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:11:05.685384 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6814031c-9ff6-46e7-a841-36e3ba5622ba req-db922e47-0da2-4702-938e-35538baf8071 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:05.690466 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6814031c-9ff6-46e7-a841-36e3ba5622ba req-db922e47-0da2-4702-938e-35538baf8071 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:05.692523 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6814031c-9ff6-46e7-a841-36e3ba5622ba req-db922e47-0da2-4702-938e-35538baf8071 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:05.711594 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-dc0dd1a2-f470-4a68-a3d1-3b124ad81fe7 tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] HTTP exception thrown: Flavor access not found for 35 / bc6cabea74704570a310547c7077b366 combination. Aug 07 01:11:05.714747 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dc0dd1a2-f470-4a68-a3d1-3b124ad81fe7 tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] Request method failure captured: Aug 07 01:11:05.714747 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/flavors/456520508/action HTTP/1.1 Aug 07 01:11:05.714747 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:11:05.714747 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:11:05.714747 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:11:05.714747 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 70 Aug 07 01:11:05.714747 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:11:05.714747 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:11:05.714747 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:11:05.714747 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:11:05.714747 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xEapYY0l1H-nQIHEqCeUTgODlFS2ZdfJqno1-E3Mid-WzqzMBHcB-b0nG4V8m6ZauK1OM7XN0Mtp7MtuY-DGsMV7p2LCmQIVFMjhQCr4699bQmpAbMufggQCYyB5mgirvFyx2WiTyjF136ckfuCiptgG9pLNOG1X_S_ORcFNkVctGU Aug 07 01:11:05.714747 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:11:05.714747 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:11:05.714747 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:11:05.714747 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:11:05.714747 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:11:05.714747 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:11:05.714747 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: ffca783753d8464da99a508374e3551c Aug 07 01:11:05.714747 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-149643226 Aug 07 01:11:05.714747 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,admin,member Aug 07 01:11:05.714747 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,admin,member Aug 07 01:11:05.717289 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ffca783753d8464da99a508374e3551c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ffca783753d8464da99a508374e3551c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ffca783753d8464da99a508374e3551c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ffca783753d8464da99a508374e3551c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:11:05.717289 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-149643226 Aug 07 01:11:05.717289 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: ffca783753d8464da99a508374e3551c Aug 07 01:11:05.717289 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-149643226 Aug 07 01:11:05.717289 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin Aug 07 01:11:05.717289 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:11:05.717289 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:11:05.717289 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 1d41b32b2deb4713841afe180277b8f3 Aug 07 01:11:05.717289 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin Aug 07 01:11:05.717289 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:11:05.717289 n-d-master-1 devstack@n-api.service[119516]: {"removeTenantAccess": {"tenant": "bc6cabea74704570a310547c7077b366"}} Aug 07 01:11:05.717289 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:11:05.718663 n-d-master-1 devstack@n-api.service[119516]: exception: Flavor access not found for 35 / bc6cabea74704570a310547c7077b366 combination. Aug 07 01:11:05.718663 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '456520508', 'body': {'removeTenantAccess': {'tenant': 'bc6cabea74704570a310547c7077b366'}}} Aug 07 01:11:05.718663 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:11:05.718663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:05.718663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 07 01:11:05.718663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 07 01:11:05.718663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 07 01:11:05.718663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 07 01:11:05.718663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 07 01:11:05.718663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 07 01:11:05.718663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 07 01:11:05.718663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 07 01:11:05.718663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 07 01:11:05.718663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 07 01:11:05.718663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 07 01:11:05.718663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 07 01:11:05.718663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 07 01:11:05.718663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 07 01:11:05.720742 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 35 / bc6cabea74704570a310547c7077b366 combination. Aug 07 01:11:05.720742 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:05.720742 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:11:05.720742 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:05.720742 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:05.720742 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:11:05.720742 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:11:05.720742 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:11:05.720742 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:11:05.720742 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:11:05.720742 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:11:05.720742 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:11:05.720742 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:11:05.720742 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 07 01:11:05.720742 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:11:05.720742 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 35 / bc6cabea74704570a310547c7077b366 combination. Aug 07 01:11:05.720742 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:05.720742 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:11:05.720742 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:05.720742 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:05.722371 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:11:05.722371 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:11:05.722371 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:11:05.722371 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:11:05.722371 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 35 / bc6cabea74704570a310547c7077b366 combination. Aug 07 01:11:05.722371 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:05.722371 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dc0dd1a2-f470-4a68-a3d1-3b124ad81fe7 tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] Returning 404 to user: Flavor access not found for 35 / bc6cabea74704570a310547c7077b366 combination. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:11:05.722371 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-dc0dd1a2-f470-4a68-a3d1-3b124ad81fe7 tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/456520508/action" status: 404 len: 124 microversion: 2.1 time: 1.067511 Aug 07 01:11:05.730547 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 214/395] 10.222.0.39 () {60 vars in 1197 bytes} [Sun Aug 7 01:11:04 2022] POST /compute/v2.1/flavors/456520508/action => generated 124 bytes in 1078 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:11:05.730868 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-6814031c-9ff6-46e7-a841-36e3ba5622ba req-db922e47-0da2-4702-938e-35538baf8071 service nova] Creating event network-changed:d903aed3-3bb4-4c2d-bd4a-d9b615524a34 for instance 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 on n-h2-master-1 Aug 07 01:11:05.741802 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1e04240a-b6ac-4537-a517-f246b5c269a7 tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:05.745753 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-6814031c-9ff6-46e7-a841-36e3ba5622ba req-db922e47-0da2-4702-938e-35538baf8071 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131976 Aug 07 01:11:05.748618 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 182/396] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:11:05.837403 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1e04240a-b6ac-4537-a517-f246b5c269a7 tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/456520508" status: 202 len: 0 microversion: 2.1 time: 0.102862 Aug 07 01:11:05.839206 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 215/397] 10.222.0.39 () {58 vars in 1158 bytes} [Sun Aug 7 01:11:05 2022] DELETE /compute/v2.1/flavors/456520508 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:11:05.859026 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-67a3a8dd-d5a7-4ec6-af80-0d0694cc2ac7 tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:06.012265 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-67a3a8dd-d5a7-4ec6-af80-0d0694cc2ac7 tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.166107 Aug 07 01:11:06.013912 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 183/398] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:11:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:06.045847 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2b936cc7-0e2a-491f-b230-e9bd19704889 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:06.066881 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2b936cc7-0e2a-491f-b230-e9bd19704889 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:06.095291 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2b936cc7-0e2a-491f-b230-e9bd19704889 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:06.095971 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2b936cc7-0e2a-491f-b230-e9bd19704889 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:06.096552 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2b936cc7-0e2a-491f-b230-e9bd19704889 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:06.097506 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2b936cc7-0e2a-491f-b230-e9bd19704889 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:06.110311 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2b936cc7-0e2a-491f-b230-e9bd19704889 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:06.111168 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2b936cc7-0e2a-491f-b230-e9bd19704889 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:06.912390 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2b936cc7-0e2a-491f-b230-e9bd19704889 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:06.931473 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2b936cc7-0e2a-491f-b230-e9bd19704889 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0" status: 200 len: 1310 microversion: 2.1 time: 0.892663 Aug 07 01:11:06.932380 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 216/399] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:06 2022] GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 => generated 1310 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:07.990075 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e3dd5b6c-c67f-4ab7-b6e1-3838a56c7d9e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:07.992753 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e3dd5b6c-c67f-4ab7-b6e1-3838a56c7d9e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:08.008845 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3dd5b6c-c67f-4ab7-b6e1-3838a56c7d9e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:08.009967 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3dd5b6c-c67f-4ab7-b6e1-3838a56c7d9e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:08.010970 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3dd5b6c-c67f-4ab7-b6e1-3838a56c7d9e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:08.012049 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3dd5b6c-c67f-4ab7-b6e1-3838a56c7d9e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:08.012780 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3dd5b6c-c67f-4ab7-b6e1-3838a56c7d9e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:08.013652 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3dd5b6c-c67f-4ab7-b6e1-3838a56c7d9e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:09.136406 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e3dd5b6c-c67f-4ab7-b6e1-3838a56c7d9e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:09.176461 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e3dd5b6c-c67f-4ab7-b6e1-3838a56c7d9e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0" status: 200 len: 1310 microversion: 2.1 time: 1.191336 Aug 07 01:11:09.177376 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 184/400] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:07 2022] GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 => generated 1310 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:09.366366 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-044b8779-e505-4859-808f-d5f6770c6688 tempest-FlavorMetadataValidation-1814668906 tempest-FlavorMetadataValidation-1814668906-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-924345340", "id": 1302680331, "os-flavor-access:is_public": "True"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:11:09.419132 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:11:09.419132 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:11:09.469152 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-044b8779-e505-4859-808f-d5f6770c6688 tempest-FlavorMetadataValidation-1814668906 tempest-FlavorMetadataValidation-1814668906-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 1.301098 Aug 07 01:11:09.483697 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 217/401] 10.222.0.39 () {62 vars in 1188 bytes} [Sun Aug 7 01:11:08 2022] POST /compute/v2.1/flavors => generated 470 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 01:11:09.487058 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f3827913-7020-4676-b400-93cff6d4b765 tempest-FlavorMetadataValidation-1814668906 tempest-FlavorMetadataValidation-1814668906-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:11:09.490080 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:11:09.490080 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:11:10.219545 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-daec7c7a-9495-4bc6-8f83-8a0575e9fc6c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:10.220363 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-daec7c7a-9495-4bc6-8f83-8a0575e9fc6c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:10.251598 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-daec7c7a-9495-4bc6-8f83-8a0575e9fc6c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:10.252702 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-daec7c7a-9495-4bc6-8f83-8a0575e9fc6c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:10.254598 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-daec7c7a-9495-4bc6-8f83-8a0575e9fc6c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:10.257003 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-daec7c7a-9495-4bc6-8f83-8a0575e9fc6c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:10.260991 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-daec7c7a-9495-4bc6-8f83-8a0575e9fc6c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:10.265140 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-daec7c7a-9495-4bc6-8f83-8a0575e9fc6c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:10.291551 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f3827913-7020-4676-b400-93cff6d4b765 tempest-FlavorMetadataValidation-1814668906 tempest-FlavorMetadataValidation-1814668906-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/1302680331/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.808110 Aug 07 01:11:10.295371 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 185/402] 10.222.0.39 () {62 vars in 1265 bytes} [Sun Aug 7 01:11:09 2022] POST /compute/v2.1/flavors/1302680331/os-extra_specs => generated 62 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:10.320597 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e89b9d2e-2b9f-41e7-bb11-a4726cfffb06 tempest-FlavorMetadataValidation-1814668906 tempest-FlavorMetadataValidation-1814668906-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:10.324171 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:11:10.324171 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:11:10.371549 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e89b9d2e-2b9f-41e7-bb11-a4726cfffb06 tempest-FlavorMetadataValidation-1814668906 tempest-FlavorMetadataValidation-1814668906-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1302680331" status: 202 len: 0 microversion: 2.86 time: 0.061449 Aug 07 01:11:10.373416 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 186/403] 10.222.0.39 () {60 vars in 1202 bytes} [Sun Aug 7 01:11:10 2022] DELETE /compute/v2.1/flavors/1302680331 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:11:10.449737 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-371dd91d-fcbd-4f84-a418-3704a15e6d98 tempest-FlavorMetadataValidation-1814668906 tempest-FlavorMetadataValidation-1814668906-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:10.520611 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-371dd91d-fcbd-4f84-a418-3704a15e6d98 tempest-FlavorMetadataValidation-1814668906 tempest-FlavorMetadataValidation-1814668906-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.103925 Aug 07 01:11:10.522597 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 187/404] 10.222.0.39 () {60 vars in 1187 bytes} [Sun Aug 7 01:11:10 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:11:12.242488 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-daec7c7a-9495-4bc6-8f83-8a0575e9fc6c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:12.245514 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:12.266237 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-daec7c7a-9495-4bc6-8f83-8a0575e9fc6c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0" status: 200 len: 1310 microversion: 2.1 time: 2.052839 Aug 07 01:11:12.267374 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 218/405] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:10 2022] GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 => generated 1310 bytes in 2055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:13.306054 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a2ef78bb-2a5d-4359-a451-09466291bad6 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:13.308143 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a2ef78bb-2a5d-4359-a451-09466291bad6 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:13.336251 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2ef78bb-2a5d-4359-a451-09466291bad6 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:13.339815 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2ef78bb-2a5d-4359-a451-09466291bad6 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:13.345316 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2ef78bb-2a5d-4359-a451-09466291bad6 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:13.347286 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2ef78bb-2a5d-4359-a451-09466291bad6 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:13.349522 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2ef78bb-2a5d-4359-a451-09466291bad6 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:13.354310 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2ef78bb-2a5d-4359-a451-09466291bad6 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:13.802503 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6b1f255a-4140-47c4-b00d-9af3e680914d tempest-HypervisorAdminNegativeTestJSON-1011672514 tempest-HypervisorAdminNegativeTestJSON-1011672514-project] Calling method '.version_select at 0x7f9e250130d0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:13.804605 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:11:13.804605 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:11:13.808152 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6b1f255a-4140-47c4-b00d-9af3e680914d tempest-HypervisorAdminNegativeTestJSON-1011672514 tempest-HypervisorAdminNegativeTestJSON-1011672514-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '8a3f540f769a484cbe719b17ff8aa0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632a206a638349cbb3414d6356182761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:13.816206 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6b1f255a-4140-47c4-b00d-9af3e680914d tempest-HypervisorAdminNegativeTestJSON-1011672514 tempest-HypervisorAdminNegativeTestJSON-1011672514-project] Request method failure captured: Aug 07 01:11:13.816206 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 07 01:11:13.816206 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:11:13.816206 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:11:13.816206 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:11:13.816206 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:11:13.816206 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:11:13.816206 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:11:13.816206 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:11:13.816206 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:11:13.816206 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xEu1gyyde7vrMjOeBxBCRBER9oGTeYq0RFh2x8HvZnYhJMETPR5nSSJdhM-1xj5dUMPjBeULCP3pm83sJ-WLYn6bpJcQtkBjxkI-1QOyvlSHKQYWfCCZejW9TQTneD88QA1f31vVSVH5dhXf_772kgkktRu-M2-xyHsexCS-KR8ekw Aug 07 01:11:13.816206 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:11:13.816206 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:11:13.816206 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:11:13.816206 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:11:13.816206 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:11:13.816206 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:11:13.816206 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 632a206a638349cbb3414d6356182761 Aug 07 01:11:13.816206 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1011672514 Aug 07 01:11:13.816206 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:11:13.816206 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:11:13.818159 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/632a206a638349cbb3414d6356182761"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_632a206a638349cbb3414d6356182761", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/632a206a638349cbb3414d6356182761"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/632a206a638349cbb3414d6356182761"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:11:13.818159 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1011672514 Aug 07 01:11:13.818159 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 632a206a638349cbb3414d6356182761 Aug 07 01:11:13.818159 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1011672514 Aug 07 01:11:13.818159 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-HypervisorAdminNegativeTestJSON-1011672514-project Aug 07 01:11:13.818159 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:11:13.818159 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:11:13.818159 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 8a3f540f769a484cbe719b17ff8aa0a2 Aug 07 01:11:13.818159 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1011672514-project Aug 07 01:11:13.818159 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:11:13.818159 n-d-master-1 devstack@n-api.service[119516]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 07 01:11:13.818159 n-d-master-1 devstack@n-api.service[119516]: action_args: {} Aug 07 01:11:13.818159 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:11:13.819667 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:13.819667 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:11:13.819667 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:11:13.819667 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:11:13.819667 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:11:13.819667 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:11:13.819667 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:11:13.819667 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:11:13.819667 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:11:13.819667 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 07 01:11:13.819667 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 07 01:11:13.819667 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 07 01:11:13.819667 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 07 01:11:13.819667 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 07 01:11:13.819667 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 07 01:11:13.819667 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 07 01:11:13.819667 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 07 01:11:13.819667 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:11:13.819667 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:11:13.822694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:11:13.822694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:11:13.822694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 07 01:11:13.822694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 07 01:11:13.822694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 07 01:11:13.822694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 07 01:11:13.822694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 07 01:11:13.822694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 07 01:11:13.822694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 07 01:11:13.822694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:13.822694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:11:13.822694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:13.822694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:13.822694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:11:13.822694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:11:13.822694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 07 01:11:13.822694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 07 01:11:13.822694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 07 01:11:13.822694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:13.828288 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6b1f255a-4140-47c4-b00d-9af3e680914d tempest-HypervisorAdminNegativeTestJSON-1011672514 tempest-HypervisorAdminNegativeTestJSON-1011672514-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:11:13.829660 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6b1f255a-4140-47c4-b00d-9af3e680914d tempest-HypervisorAdminNegativeTestJSON-1011672514 tempest-HypervisorAdminNegativeTestJSON-1011672514-project] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.399256 Aug 07 01:11:13.830894 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 219/406] 10.222.0.39 () {58 vars in 1167 bytes} [Sun Aug 7 01:11:13 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 401 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:11:13.845329 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d3152d20-101b-48bb-9316-66c733727da9 tempest-HypervisorAdminNegativeTestJSON-1011672514 tempest-HypervisorAdminNegativeTestJSON-1011672514-project] Calling method '.version_select at 0x7f9e2507ce50>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:13.847185 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:11:13.847185 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:11:13.850550 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d3152d20-101b-48bb-9316-66c733727da9 tempest-HypervisorAdminNegativeTestJSON-1011672514 tempest-HypervisorAdminNegativeTestJSON-1011672514-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '8a3f540f769a484cbe719b17ff8aa0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632a206a638349cbb3414d6356182761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:13.854344 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d3152d20-101b-48bb-9316-66c733727da9 tempest-HypervisorAdminNegativeTestJSON-1011672514 tempest-HypervisorAdminNegativeTestJSON-1011672514-project] Request method failure captured: Aug 07 01:11:13.854344 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 07 01:11:13.854344 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:11:13.854344 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:11:13.854344 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:11:13.854344 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:11:13.854344 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:11:13.854344 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:11:13.854344 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:11:13.854344 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:11:13.854344 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xEu1gyyde7vrMjOeBxBCRBER9oGTeYq0RFh2x8HvZnYhJMETPR5nSSJdhM-1xj5dUMPjBeULCP3pm83sJ-WLYn6bpJcQtkBjxkI-1QOyvlSHKQYWfCCZejW9TQTneD88QA1f31vVSVH5dhXf_772kgkktRu-M2-xyHsexCS-KR8ekw Aug 07 01:11:13.854344 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:11:13.854344 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:11:13.854344 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:11:13.854344 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:11:13.854344 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:11:13.854344 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:11:13.854344 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 632a206a638349cbb3414d6356182761 Aug 07 01:11:13.854344 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1011672514 Aug 07 01:11:13.854344 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:11:13.854344 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:11:13.856686 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/632a206a638349cbb3414d6356182761"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_632a206a638349cbb3414d6356182761", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/632a206a638349cbb3414d6356182761"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/632a206a638349cbb3414d6356182761"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:11:13.856686 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1011672514 Aug 07 01:11:13.856686 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 632a206a638349cbb3414d6356182761 Aug 07 01:11:13.856686 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1011672514 Aug 07 01:11:13.856686 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-HypervisorAdminNegativeTestJSON-1011672514-project Aug 07 01:11:13.856686 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:11:13.856686 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:11:13.856686 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 8a3f540f769a484cbe719b17ff8aa0a2 Aug 07 01:11:13.856686 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1011672514-project Aug 07 01:11:13.856686 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:11:13.856686 n-d-master-1 devstack@n-api.service[119516]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 07 01:11:13.856686 n-d-master-1 devstack@n-api.service[119516]: action_args: {} Aug 07 01:11:13.856686 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:11:13.858890 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:13.858890 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:11:13.858890 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:11:13.858890 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:11:13.858890 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:11:13.858890 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:11:13.858890 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:11:13.858890 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:11:13.858890 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:11:13.858890 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 07 01:11:13.858890 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 07 01:11:13.858890 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 07 01:11:13.858890 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 07 01:11:13.858890 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 07 01:11:13.858890 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 07 01:11:13.858890 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 07 01:11:13.858890 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 07 01:11:13.858890 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:11:13.858890 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:11:13.863018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:11:13.863018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:11:13.863018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 07 01:11:13.863018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 07 01:11:13.863018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 07 01:11:13.863018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 07 01:11:13.863018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 07 01:11:13.863018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 07 01:11:13.863018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 07 01:11:13.863018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:13.863018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:11:13.863018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:13.863018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:13.863018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:11:13.863018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:11:13.863018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 07 01:11:13.863018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 07 01:11:13.863018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 07 01:11:13.863018 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:13.866805 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d3152d20-101b-48bb-9316-66c733727da9 tempest-HypervisorAdminNegativeTestJSON-1011672514 tempest-HypervisorAdminNegativeTestJSON-1011672514-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:11:13.866805 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d3152d20-101b-48bb-9316-66c733727da9 tempest-HypervisorAdminNegativeTestJSON-1011672514 tempest-HypervisorAdminNegativeTestJSON-1011672514-project] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.018800 Aug 07 01:11:13.866805 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 220/407] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:11:13 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:11:13.879229 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-155df437-2821-47ed-85f5-43aaffc467f1 tempest-HypervisorAdminNegativeTestJSON-1011672514 tempest-HypervisorAdminNegativeTestJSON-1011672514-project] Calling method '.version_select at 0x7f9e2507ce50>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:13.881959 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:11:13.881959 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:11:13.884618 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-155df437-2821-47ed-85f5-43aaffc467f1 tempest-HypervisorAdminNegativeTestJSON-1011672514 tempest-HypervisorAdminNegativeTestJSON-1011672514-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '8a3f540f769a484cbe719b17ff8aa0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632a206a638349cbb3414d6356182761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:13.888427 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-155df437-2821-47ed-85f5-43aaffc467f1 tempest-HypervisorAdminNegativeTestJSON-1011672514 tempest-HypervisorAdminNegativeTestJSON-1011672514-project] Request method failure captured: Aug 07 01:11:13.888427 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 07 01:11:13.888427 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:11:13.888427 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:11:13.888427 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:11:13.888427 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:11:13.888427 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:11:13.888427 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:11:13.888427 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:11:13.888427 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:11:13.888427 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xEu1gyyde7vrMjOeBxBCRBER9oGTeYq0RFh2x8HvZnYhJMETPR5nSSJdhM-1xj5dUMPjBeULCP3pm83sJ-WLYn6bpJcQtkBjxkI-1QOyvlSHKQYWfCCZejW9TQTneD88QA1f31vVSVH5dhXf_772kgkktRu-M2-xyHsexCS-KR8ekw Aug 07 01:11:13.888427 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:11:13.888427 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:11:13.888427 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:11:13.888427 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:11:13.888427 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:11:13.888427 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:11:13.888427 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 632a206a638349cbb3414d6356182761 Aug 07 01:11:13.888427 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1011672514 Aug 07 01:11:13.888427 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:11:13.888427 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:11:13.890844 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/632a206a638349cbb3414d6356182761"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_632a206a638349cbb3414d6356182761", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/632a206a638349cbb3414d6356182761"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/632a206a638349cbb3414d6356182761"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:11:13.890844 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1011672514 Aug 07 01:11:13.890844 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 632a206a638349cbb3414d6356182761 Aug 07 01:11:13.890844 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1011672514 Aug 07 01:11:13.890844 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-HypervisorAdminNegativeTestJSON-1011672514-project Aug 07 01:11:13.890844 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:11:13.890844 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:11:13.890844 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 8a3f540f769a484cbe719b17ff8aa0a2 Aug 07 01:11:13.890844 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1011672514-project Aug 07 01:11:13.890844 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:11:13.890844 n-d-master-1 devstack@n-api.service[119516]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 07 01:11:13.890844 n-d-master-1 devstack@n-api.service[119516]: action_args: {} Aug 07 01:11:13.890844 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:11:13.893400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:13.893400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:11:13.893400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:11:13.893400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:11:13.893400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:11:13.893400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:11:13.893400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:11:13.893400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:11:13.893400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:11:13.893400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 07 01:11:13.893400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 07 01:11:13.893400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 07 01:11:13.893400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 07 01:11:13.893400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 07 01:11:13.893400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 07 01:11:13.893400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:11:13.893400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:11:13.893400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:11:13.893400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:11:13.900618 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 07 01:11:13.900618 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 07 01:11:13.900618 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 07 01:11:13.900618 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 07 01:11:13.900618 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 07 01:11:13.900618 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 07 01:11:13.900618 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 07 01:11:13.900618 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:13.900618 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:11:13.900618 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:13.900618 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:13.900618 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:11:13.900618 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:11:13.900618 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 07 01:11:13.900618 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 07 01:11:13.900618 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 07 01:11:13.900618 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:13.904199 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-155df437-2821-47ed-85f5-43aaffc467f1 tempest-HypervisorAdminNegativeTestJSON-1011672514 tempest-HypervisorAdminNegativeTestJSON-1011672514-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:11:13.905758 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-155df437-2821-47ed-85f5-43aaffc467f1 tempest-HypervisorAdminNegativeTestJSON-1011672514 tempest-HypervisorAdminNegativeTestJSON-1011672514-project] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.037631 Aug 07 01:11:13.908436 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 221/408] 10.222.0.39 () {58 vars in 1179 bytes} [Sun Aug 7 01:11:13 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:11:14.080701 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cb07c82f-4b2c-4905-80dc-2cfd1a705de4 tempest-HypervisorAdminNegativeTestJSON-1628463166 tempest-HypervisorAdminNegativeTestJSON-1628463166-project-admin] Calling method '.version_select at 0x7f9e253829d0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:14.086841 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb07c82f-4b2c-4905-80dc-2cfd1a705de4 tempest-HypervisorAdminNegativeTestJSON-1628463166 tempest-HypervisorAdminNegativeTestJSON-1628463166-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:14.088302 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb07c82f-4b2c-4905-80dc-2cfd1a705de4 tempest-HypervisorAdminNegativeTestJSON-1628463166 tempest-HypervisorAdminNegativeTestJSON-1628463166-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:14.090331 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb07c82f-4b2c-4905-80dc-2cfd1a705de4 tempest-HypervisorAdminNegativeTestJSON-1628463166 tempest-HypervisorAdminNegativeTestJSON-1628463166-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:14.123834 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb07c82f-4b2c-4905-80dc-2cfd1a705de4 tempest-HypervisorAdminNegativeTestJSON-1628463166 tempest-HypervisorAdminNegativeTestJSON-1628463166-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:14.125589 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb07c82f-4b2c-4905-80dc-2cfd1a705de4 tempest-HypervisorAdminNegativeTestJSON-1628463166 tempest-HypervisorAdminNegativeTestJSON-1628463166-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:14.126731 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb07c82f-4b2c-4905-80dc-2cfd1a705de4 tempest-HypervisorAdminNegativeTestJSON-1628463166 tempest-HypervisorAdminNegativeTestJSON-1628463166-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:14.158255 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb07c82f-4b2c-4905-80dc-2cfd1a705de4 tempest-HypervisorAdminNegativeTestJSON-1628463166 tempest-HypervisorAdminNegativeTestJSON-1628463166-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:14.160635 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb07c82f-4b2c-4905-80dc-2cfd1a705de4 tempest-HypervisorAdminNegativeTestJSON-1628463166 tempest-HypervisorAdminNegativeTestJSON-1628463166-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:14.162093 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb07c82f-4b2c-4905-80dc-2cfd1a705de4 tempest-HypervisorAdminNegativeTestJSON-1628463166 tempest-HypervisorAdminNegativeTestJSON-1628463166-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:14.178947 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cb07c82f-4b2c-4905-80dc-2cfd1a705de4 tempest-HypervisorAdminNegativeTestJSON-1628463166 tempest-HypervisorAdminNegativeTestJSON-1628463166-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.264076 Aug 07 01:11:14.185409 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 222/409] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:11:13 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:11:14.212528 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-aa672320-eea5-41ff-aca6-c978b705b6f9 tempest-HypervisorAdminNegativeTestJSON-1011672514 tempest-HypervisorAdminNegativeTestJSON-1011672514-project] Calling method '.version_select at 0x7f9e2507c310>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:14.215357 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:11:14.215357 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:11:14.218990 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-aa672320-eea5-41ff-aca6-c978b705b6f9 tempest-HypervisorAdminNegativeTestJSON-1011672514 tempest-HypervisorAdminNegativeTestJSON-1011672514-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '8a3f540f769a484cbe719b17ff8aa0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632a206a638349cbb3414d6356182761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:14.224581 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-aa672320-eea5-41ff-aca6-c978b705b6f9 tempest-HypervisorAdminNegativeTestJSON-1011672514 tempest-HypervisorAdminNegativeTestJSON-1011672514-project] Request method failure captured: Aug 07 01:11:14.224581 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 07 01:11:14.224581 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:11:14.224581 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:11:14.224581 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:11:14.224581 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:11:14.224581 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:11:14.224581 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:11:14.224581 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:11:14.224581 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:11:14.224581 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xEu1gyyde7vrMjOeBxBCRBER9oGTeYq0RFh2x8HvZnYhJMETPR5nSSJdhM-1xj5dUMPjBeULCP3pm83sJ-WLYn6bpJcQtkBjxkI-1QOyvlSHKQYWfCCZejW9TQTneD88QA1f31vVSVH5dhXf_772kgkktRu-M2-xyHsexCS-KR8ekw Aug 07 01:11:14.224581 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:11:14.224581 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:11:14.224581 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:11:14.224581 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:11:14.224581 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:11:14.224581 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:11:14.224581 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 632a206a638349cbb3414d6356182761 Aug 07 01:11:14.224581 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1011672514 Aug 07 01:11:14.224581 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:11:14.224581 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:11:14.227615 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/632a206a638349cbb3414d6356182761"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_632a206a638349cbb3414d6356182761", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/632a206a638349cbb3414d6356182761"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/632a206a638349cbb3414d6356182761"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:11:14.227615 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1011672514 Aug 07 01:11:14.227615 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 632a206a638349cbb3414d6356182761 Aug 07 01:11:14.227615 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1011672514 Aug 07 01:11:14.227615 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-HypervisorAdminNegativeTestJSON-1011672514-project Aug 07 01:11:14.227615 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:11:14.227615 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:11:14.227615 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 8a3f540f769a484cbe719b17ff8aa0a2 Aug 07 01:11:14.227615 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1011672514-project Aug 07 01:11:14.227615 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:11:14.227615 n-d-master-1 devstack@n-api.service[119516]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 07 01:11:14.227615 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '1'} Aug 07 01:11:14.227615 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:11:14.232250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:14.232250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:11:14.232250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:11:14.232250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:11:14.232250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:11:14.232250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:11:14.232250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:11:14.232250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:11:14.232250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:11:14.232250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 07 01:11:14.232250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 07 01:11:14.232250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 07 01:11:14.232250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 07 01:11:14.232250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 07 01:11:14.232250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 07 01:11:14.232250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:11:14.232250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:11:14.232250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:11:14.232250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:11:14.234334 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 07 01:11:14.234334 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 07 01:11:14.234334 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 07 01:11:14.234334 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 07 01:11:14.234334 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 07 01:11:14.234334 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 07 01:11:14.234334 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 07 01:11:14.234334 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:14.234334 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:11:14.234334 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:14.234334 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:14.234334 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:11:14.234334 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:11:14.234334 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 07 01:11:14.234334 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 07 01:11:14.234334 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 07 01:11:14.234334 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:14.241707 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-aa672320-eea5-41ff-aca6-c978b705b6f9 tempest-HypervisorAdminNegativeTestJSON-1011672514 tempest-HypervisorAdminNegativeTestJSON-1011672514-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:11:14.244243 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-aa672320-eea5-41ff-aca6-c978b705b6f9 tempest-HypervisorAdminNegativeTestJSON-1011672514 tempest-HypervisorAdminNegativeTestJSON-1011672514-project] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.045883 Aug 07 01:11:14.247107 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 223/410] 10.222.0.39 () {58 vars in 1173 bytes} [Sun Aug 7 01:11:14 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 50 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:11:14.263410 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d9c54ee2-af7d-4177-a117-f47ccea25c10 tempest-HypervisorAdminNegativeTestJSON-1628463166 tempest-HypervisorAdminNegativeTestJSON-1628463166-project-admin] Calling method '.version_select at 0x7f9e24e00ee0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:14.268260 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-d9c54ee2-af7d-4177-a117-f47ccea25c10 tempest-HypervisorAdminNegativeTestJSON-1628463166 tempest-HypervisorAdminNegativeTestJSON-1628463166-project-admin] HTTP exception thrown: Hypervisor with ID 'f51c93c8-f0ad-43e0-9807-9649e04f68ce' could not be found. Aug 07 01:11:14.280321 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d9c54ee2-af7d-4177-a117-f47ccea25c10 tempest-HypervisorAdminNegativeTestJSON-1628463166 tempest-HypervisorAdminNegativeTestJSON-1628463166-project-admin] Request method failure captured: Aug 07 01:11:14.280321 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/os-hypervisors/f51c93c8-f0ad-43e0-9807-9649e04f68ce/uptime HTTP/1.1 Aug 07 01:11:14.280321 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:11:14.280321 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:11:14.280321 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:11:14.280321 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:11:14.280321 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:11:14.280321 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:11:14.280321 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:11:14.280321 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:11:14.280321 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xExoMYpWL-WywLzta7BTCNRsIzBQMCKDHm1DE82Cn40z4jz8wuf1KCaOyivctouW4Ku_jcMPoZKhKEW8bP4AcgSzUkbGJwIlmrUmD0RGpNxhTsrGjPyeihbpqmAXHiSW9uTXMhuALiMOXyGrSrCwFWMU3JwLKdEbe66Nanbpqc3dcs Aug 07 01:11:14.280321 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:11:14.280321 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:11:14.280321 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:11:14.280321 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:11:14.280321 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:11:14.280321 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:11:14.280321 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 80ff574e4abe47cb8b202df05e3ebd8d Aug 07 01:11:14.280321 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1628463166 Aug 07 01:11:14.280321 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,admin,member Aug 07 01:11:14.280321 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,admin,member Aug 07 01:11:14.282938 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/80ff574e4abe47cb8b202df05e3ebd8d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_80ff574e4abe47cb8b202df05e3ebd8d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/80ff574e4abe47cb8b202df05e3ebd8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/80ff574e4abe47cb8b202df05e3ebd8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:11:14.282938 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1628463166 Aug 07 01:11:14.282938 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 80ff574e4abe47cb8b202df05e3ebd8d Aug 07 01:11:14.282938 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1628463166 Aug 07 01:11:14.282938 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-HypervisorAdminNegativeTestJSON-1628463166-project-admin Aug 07 01:11:14.282938 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:11:14.282938 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:11:14.282938 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 8dff39efa9e544708bba668923a74e26 Aug 07 01:11:14.282938 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1628463166-project-admin Aug 07 01:11:14.282938 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:11:14.282938 n-d-master-1 devstack@n-api.service[119516]: exception: Hypervisor with ID 'f51c93c8-f0ad-43e0-9807-9649e04f68ce' could not be found. Aug 07 01:11:14.282938 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'f51c93c8-f0ad-43e0-9807-9649e04f68ce'} Aug 07 01:11:14.287356 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:11:14.287356 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:14.287356 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 07 01:11:14.287356 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 07 01:11:14.287356 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'f51c93c8-f0ad-43e0-9807-9649e04f68ce' Aug 07 01:11:14.287356 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:14.287356 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:11:14.287356 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:14.287356 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:14.287356 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 07 01:11:14.287356 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 07 01:11:14.287356 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 07 01:11:14.287356 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 07 01:11:14.287356 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 07 01:11:14.287356 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:14.287356 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:11:14.287356 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:14.287356 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:14.287356 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 07 01:11:14.287356 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 07 01:11:14.287356 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 07 01:11:14.287356 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 07 01:11:14.290694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 07 01:11:14.290694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:14.290694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:11:14.290694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:14.290694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:14.290694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:11:14.290694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:11:14.290694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:11:14.290694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:11:14.290694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:11:14.290694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:11:14.290694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:11:14.290694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:11:14.290694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 07 01:11:14.290694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 07 01:11:14.290694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 07 01:11:14.290694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 07 01:11:14.290694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'f51c93c8-f0ad-43e0-9807-9649e04f68ce' could not be found. Aug 07 01:11:14.290694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:14.290694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:11:14.290694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:14.300245 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:14.300245 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:11:14.300245 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:11:14.300245 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:11:14.300245 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:11:14.300245 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'f51c93c8-f0ad-43e0-9807-9649e04f68ce' could not be found. Aug 07 01:11:14.300245 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:14.300245 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d9c54ee2-af7d-4177-a117-f47ccea25c10 tempest-HypervisorAdminNegativeTestJSON-1628463166 tempest-HypervisorAdminNegativeTestJSON-1628463166-project-admin] Returning 404 to user: Hypervisor with ID 'f51c93c8-f0ad-43e0-9807-9649e04f68ce' could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:11:14.300245 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d9c54ee2-af7d-4177-a117-f47ccea25c10 tempest-HypervisorAdminNegativeTestJSON-1628463166 tempest-HypervisorAdminNegativeTestJSON-1628463166-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/f51c93c8-f0ad-43e0-9807-9649e04f68ce/uptime" status: 404 len: 123 microversion: 2.1 time: 0.042552 Aug 07 01:11:14.305960 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 224/411] 10.222.0.39 () {58 vars in 1278 bytes} [Sun Aug 7 01:11:14 2022] GET /compute/v2.1/os-hypervisors/f51c93c8-f0ad-43e0-9807-9649e04f68ce/uptime => generated 123 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:11:14.315085 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5f87d510-a9c1-48b2-9e40-08ac11b93d89 tempest-HypervisorAdminNegativeTestJSON-1628463166 tempest-HypervisorAdminNegativeTestJSON-1628463166-project-admin] Calling method '.version_select at 0x7f9e250135e0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:14.317939 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:11:14.317939 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:11:14.319689 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f87d510-a9c1-48b2-9e40-08ac11b93d89 tempest-HypervisorAdminNegativeTestJSON-1628463166 tempest-HypervisorAdminNegativeTestJSON-1628463166-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:14.322105 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f87d510-a9c1-48b2-9e40-08ac11b93d89 tempest-HypervisorAdminNegativeTestJSON-1628463166 tempest-HypervisorAdminNegativeTestJSON-1628463166-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:14.322601 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f87d510-a9c1-48b2-9e40-08ac11b93d89 tempest-HypervisorAdminNegativeTestJSON-1628463166 tempest-HypervisorAdminNegativeTestJSON-1628463166-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:14.341593 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f87d510-a9c1-48b2-9e40-08ac11b93d89 tempest-HypervisorAdminNegativeTestJSON-1628463166 tempest-HypervisorAdminNegativeTestJSON-1628463166-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:14.342955 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f87d510-a9c1-48b2-9e40-08ac11b93d89 tempest-HypervisorAdminNegativeTestJSON-1628463166 tempest-HypervisorAdminNegativeTestJSON-1628463166-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:14.343700 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f87d510-a9c1-48b2-9e40-08ac11b93d89 tempest-HypervisorAdminNegativeTestJSON-1628463166 tempest-HypervisorAdminNegativeTestJSON-1628463166-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:14.360931 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f87d510-a9c1-48b2-9e40-08ac11b93d89 tempest-HypervisorAdminNegativeTestJSON-1628463166 tempest-HypervisorAdminNegativeTestJSON-1628463166-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:14.361866 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f87d510-a9c1-48b2-9e40-08ac11b93d89 tempest-HypervisorAdminNegativeTestJSON-1628463166 tempest-HypervisorAdminNegativeTestJSON-1628463166-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:14.362632 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f87d510-a9c1-48b2-9e40-08ac11b93d89 tempest-HypervisorAdminNegativeTestJSON-1628463166 tempest-HypervisorAdminNegativeTestJSON-1628463166-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:14.372212 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5f87d510-a9c1-48b2-9e40-08ac11b93d89 tempest-HypervisorAdminNegativeTestJSON-1628463166 tempest-HypervisorAdminNegativeTestJSON-1628463166-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.062341 Aug 07 01:11:14.381042 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 225/412] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:11:14 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:11:14.391877 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-81d3e7cc-b809-4fc4-950f-26fa6589698c tempest-HypervisorAdminNegativeTestJSON-1011672514 tempest-HypervisorAdminNegativeTestJSON-1011672514-project] Calling method '.version_select at 0x7f9e2507cc10>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:14.394069 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:11:14.394069 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:11:14.398504 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-81d3e7cc-b809-4fc4-950f-26fa6589698c tempest-HypervisorAdminNegativeTestJSON-1011672514 tempest-HypervisorAdminNegativeTestJSON-1011672514-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '8a3f540f769a484cbe719b17ff8aa0a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632a206a638349cbb3414d6356182761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:14.402071 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-81d3e7cc-b809-4fc4-950f-26fa6589698c tempest-HypervisorAdminNegativeTestJSON-1011672514 tempest-HypervisorAdminNegativeTestJSON-1011672514-project] Request method failure captured: Aug 07 01:11:14.402071 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 07 01:11:14.402071 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:11:14.402071 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:11:14.402071 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:11:14.402071 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:11:14.402071 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:11:14.402071 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:11:14.402071 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:11:14.402071 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:11:14.402071 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xEu1gyyde7vrMjOeBxBCRBER9oGTeYq0RFh2x8HvZnYhJMETPR5nSSJdhM-1xj5dUMPjBeULCP3pm83sJ-WLYn6bpJcQtkBjxkI-1QOyvlSHKQYWfCCZejW9TQTneD88QA1f31vVSVH5dhXf_772kgkktRu-M2-xyHsexCS-KR8ekw Aug 07 01:11:14.402071 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:11:14.402071 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:11:14.402071 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:11:14.402071 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:11:14.402071 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:11:14.402071 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:11:14.402071 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 632a206a638349cbb3414d6356182761 Aug 07 01:11:14.402071 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1011672514 Aug 07 01:11:14.402071 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:11:14.402071 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:11:14.403638 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/632a206a638349cbb3414d6356182761"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_632a206a638349cbb3414d6356182761", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/632a206a638349cbb3414d6356182761"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/632a206a638349cbb3414d6356182761"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:11:14.403638 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1011672514 Aug 07 01:11:14.403638 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 632a206a638349cbb3414d6356182761 Aug 07 01:11:14.403638 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1011672514 Aug 07 01:11:14.403638 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-HypervisorAdminNegativeTestJSON-1011672514-project Aug 07 01:11:14.403638 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:11:14.403638 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:11:14.403638 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 8a3f540f769a484cbe719b17ff8aa0a2 Aug 07 01:11:14.403638 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1011672514-project Aug 07 01:11:14.403638 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:11:14.403638 n-d-master-1 devstack@n-api.service[119516]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 07 01:11:14.403638 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '1'} Aug 07 01:11:14.403638 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:11:14.404482 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:14.404482 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:11:14.404482 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:11:14.404482 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:11:14.404482 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:11:14.404482 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:11:14.404482 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:11:14.404482 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:11:14.404482 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:11:14.404482 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 07 01:11:14.404482 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 07 01:11:14.404482 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 07 01:11:14.404482 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 07 01:11:14.404482 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 07 01:11:14.404482 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 07 01:11:14.404482 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 07 01:11:14.404482 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 07 01:11:14.404482 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:11:14.404482 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:11:14.407617 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:11:14.407617 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:11:14.407617 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 07 01:11:14.407617 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 07 01:11:14.407617 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 07 01:11:14.407617 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 07 01:11:14.407617 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 07 01:11:14.407617 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 07 01:11:14.407617 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 07 01:11:14.407617 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:14.407617 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:11:14.407617 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:14.407617 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:14.407617 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:11:14.407617 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:11:14.407617 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 07 01:11:14.407617 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 07 01:11:14.407617 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 07 01:11:14.407617 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:14.414087 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-81d3e7cc-b809-4fc4-950f-26fa6589698c tempest-HypervisorAdminNegativeTestJSON-1011672514 tempest-HypervisorAdminNegativeTestJSON-1011672514-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:11:14.414422 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a2ef78bb-2a5d-4359-a451-09466291bad6 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:14.416022 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-81d3e7cc-b809-4fc4-950f-26fa6589698c tempest-HypervisorAdminNegativeTestJSON-1011672514 tempest-HypervisorAdminNegativeTestJSON-1011672514-project] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.033381 Aug 07 01:11:14.422584 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 226/413] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Aug 7 01:11:14 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:11:14.428813 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e280bac9-be0f-464b-92ad-0ca82ae9ca52 tempest-HypervisorAdminNegativeTestJSON-1628463166 tempest-HypervisorAdminNegativeTestJSON-1628463166-project-admin] Calling method '.version_select at 0x7f9e24fcf790>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:14.432165 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-e280bac9-be0f-464b-92ad-0ca82ae9ca52 tempest-HypervisorAdminNegativeTestJSON-1628463166 tempest-HypervisorAdminNegativeTestJSON-1628463166-project-admin] HTTP exception thrown: Hypervisor with ID 'aef54381-e7b8-48fe-b236-5003f31243b1' could not be found. Aug 07 01:11:14.434816 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e280bac9-be0f-464b-92ad-0ca82ae9ca52 tempest-HypervisorAdminNegativeTestJSON-1628463166 tempest-HypervisorAdminNegativeTestJSON-1628463166-project-admin] Request method failure captured: Aug 07 01:11:14.434816 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/os-hypervisors/aef54381-e7b8-48fe-b236-5003f31243b1 HTTP/1.1 Aug 07 01:11:14.434816 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:11:14.434816 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:11:14.434816 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:11:14.434816 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:11:14.434816 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:11:14.434816 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:11:14.434816 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:11:14.434816 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:11:14.434816 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xExoMYpWL-WywLzta7BTCNRsIzBQMCKDHm1DE82Cn40z4jz8wuf1KCaOyivctouW4Ku_jcMPoZKhKEW8bP4AcgSzUkbGJwIlmrUmD0RGpNxhTsrGjPyeihbpqmAXHiSW9uTXMhuALiMOXyGrSrCwFWMU3JwLKdEbe66Nanbpqc3dcs Aug 07 01:11:14.434816 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:11:14.434816 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:11:14.434816 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:11:14.434816 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:11:14.434816 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:11:14.434816 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:11:14.434816 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 80ff574e4abe47cb8b202df05e3ebd8d Aug 07 01:11:14.434816 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1628463166 Aug 07 01:11:14.434816 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,admin,member Aug 07 01:11:14.434816 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,admin,member Aug 07 01:11:14.436349 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/80ff574e4abe47cb8b202df05e3ebd8d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_80ff574e4abe47cb8b202df05e3ebd8d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/80ff574e4abe47cb8b202df05e3ebd8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/80ff574e4abe47cb8b202df05e3ebd8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:11:14.436349 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1628463166 Aug 07 01:11:14.436349 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 80ff574e4abe47cb8b202df05e3ebd8d Aug 07 01:11:14.436349 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1628463166 Aug 07 01:11:14.436349 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-HypervisorAdminNegativeTestJSON-1628463166-project-admin Aug 07 01:11:14.436349 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:11:14.436349 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:11:14.436349 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 8dff39efa9e544708bba668923a74e26 Aug 07 01:11:14.436349 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1628463166-project-admin Aug 07 01:11:14.436349 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:11:14.436349 n-d-master-1 devstack@n-api.service[119516]: exception: Hypervisor with ID 'aef54381-e7b8-48fe-b236-5003f31243b1' could not be found. Aug 07 01:11:14.436349 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'aef54381-e7b8-48fe-b236-5003f31243b1'} Aug 07 01:11:14.437113 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:11:14.437113 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:14.437113 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 07 01:11:14.437113 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 07 01:11:14.437113 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'aef54381-e7b8-48fe-b236-5003f31243b1' Aug 07 01:11:14.437113 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:14.437113 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:11:14.437113 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:14.437113 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:14.437113 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 07 01:11:14.437113 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 07 01:11:14.437113 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 07 01:11:14.437113 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 07 01:11:14.437113 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 07 01:11:14.437113 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:14.437113 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:11:14.437113 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:14.437113 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:14.437113 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 07 01:11:14.437113 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 07 01:11:14.437113 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 07 01:11:14.437113 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 07 01:11:14.438332 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 07 01:11:14.438332 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:14.438332 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:11:14.438332 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:14.438332 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:14.438332 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:11:14.438332 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:11:14.438332 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:11:14.438332 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:11:14.438332 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:11:14.438332 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:11:14.438332 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:11:14.438332 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:11:14.438332 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 07 01:11:14.438332 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 07 01:11:14.438332 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 07 01:11:14.438332 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 07 01:11:14.438332 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 07 01:11:14.438332 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 07 01:11:14.438332 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'aef54381-e7b8-48fe-b236-5003f31243b1' could not be found. Aug 07 01:11:14.439553 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:14.439553 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:11:14.439553 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:14.439553 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:14.439553 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:11:14.439553 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:11:14.439553 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:11:14.439553 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:11:14.439553 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'aef54381-e7b8-48fe-b236-5003f31243b1' could not be found. Aug 07 01:11:14.439553 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:14.442388 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e280bac9-be0f-464b-92ad-0ca82ae9ca52 tempest-HypervisorAdminNegativeTestJSON-1628463166 tempest-HypervisorAdminNegativeTestJSON-1628463166-project-admin] Returning 404 to user: Hypervisor with ID 'aef54381-e7b8-48fe-b236-5003f31243b1' could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:11:14.442388 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e280bac9-be0f-464b-92ad-0ca82ae9ca52 tempest-HypervisorAdminNegativeTestJSON-1628463166 tempest-HypervisorAdminNegativeTestJSON-1628463166-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/aef54381-e7b8-48fe-b236-5003f31243b1" status: 404 len: 123 microversion: 2.1 time: 0.017645 Aug 07 01:11:14.446433 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a2ef78bb-2a5d-4359-a451-09466291bad6 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0" status: 200 len: 1310 microversion: 2.1 time: 1.144442 Aug 07 01:11:14.448114 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 188/414] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:13 2022] GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 => generated 1310 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:14.461770 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 227/415] 10.222.0.39 () {58 vars in 1257 bytes} [Sun Aug 7 01:11:14 2022] GET /compute/v2.1/os-hypervisors/aef54381-e7b8-48fe-b236-5003f31243b1 => generated 123 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:11:15.499068 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f3450229-2681-48d8-b1fd-d66ac0a90c60 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:15.500928 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f3450229-2681-48d8-b1fd-d66ac0a90c60 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:15.551291 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f3450229-2681-48d8-b1fd-d66ac0a90c60 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:15.552307 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f3450229-2681-48d8-b1fd-d66ac0a90c60 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:15.564242 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f3450229-2681-48d8-b1fd-d66ac0a90c60 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:15.566212 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f3450229-2681-48d8-b1fd-d66ac0a90c60 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:15.567411 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f3450229-2681-48d8-b1fd-d66ac0a90c60 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:15.568520 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f3450229-2681-48d8-b1fd-d66ac0a90c60 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:15.707127 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-07cfd188-d71d-419f-99e1-8083cb1d95b1 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Action: 'create', calling method: .version_select at 0x7f9e24e770d0>, body: {"keypair": {"name": "tempest-keypair-340230674", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYIrnrI9oK6sx+KPL23Ph2bl80ovmeQRtC3/vb2Pd5S0MKOjui3xqZppBFy+5lCnfb+MqTPwf/zDCIPfJtF8GJq+zvZX3y8N6Kng+fsLt28gc9lEyp9YMpp9L7wob6eWg=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:11:15.862226 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-07cfd188-d71d-419f-99e1-8083cb1d95b1 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Getting quotas for project 3e6d319a0452448485aa65b7cf1c5b0e. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:11:15.881466 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-07cfd188-d71d-419f-99e1-8083cb1d95b1 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Getting quotas for user 7e9dce42ff994d81b1ad6d6c05356c37 and project 3e6d319a0452448485aa65b7cf1c5b0e. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:11:15.928540 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-07cfd188-d71d-419f-99e1-8083cb1d95b1 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.879546 Aug 07 01:11:15.930075 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 189/416] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:11:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:11:16.362893 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f3450229-2681-48d8-b1fd-d66ac0a90c60 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:16.387051 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f3450229-2681-48d8-b1fd-d66ac0a90c60 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0" status: 200 len: 1310 microversion: 2.1 time: 0.900564 Aug 07 01:11:16.387676 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 228/417] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:15 2022] GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 => generated 1310 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:17.410872 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f89ff478-1821-45fe-9c89-6b7f2273bf3b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:17.412572 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f89ff478-1821-45fe-9c89-6b7f2273bf3b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:17.426240 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f89ff478-1821-45fe-9c89-6b7f2273bf3b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:17.430887 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f89ff478-1821-45fe-9c89-6b7f2273bf3b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:17.431856 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f89ff478-1821-45fe-9c89-6b7f2273bf3b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:17.433079 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f89ff478-1821-45fe-9c89-6b7f2273bf3b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:17.433895 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f89ff478-1821-45fe-9c89-6b7f2273bf3b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:17.435412 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f89ff478-1821-45fe-9c89-6b7f2273bf3b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:18.050955 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f89ff478-1821-45fe-9c89-6b7f2273bf3b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:18.061214 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f89ff478-1821-45fe-9c89-6b7f2273bf3b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0" status: 200 len: 1310 microversion: 2.1 time: 0.655091 Aug 07 01:11:18.066725 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 190/418] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:17 2022] GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 => generated 1310 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:11:19.109206 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f9705341-2d6e-46ef-a0ec-8bd56645dcf7 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:19.110296 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f9705341-2d6e-46ef-a0ec-8bd56645dcf7 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:19.130342 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f9705341-2d6e-46ef-a0ec-8bd56645dcf7 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:19.131057 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f9705341-2d6e-46ef-a0ec-8bd56645dcf7 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:19.131531 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f9705341-2d6e-46ef-a0ec-8bd56645dcf7 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:19.132338 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f9705341-2d6e-46ef-a0ec-8bd56645dcf7 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:19.132814 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f9705341-2d6e-46ef-a0ec-8bd56645dcf7 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:19.133261 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f9705341-2d6e-46ef-a0ec-8bd56645dcf7 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:19.765599 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f9705341-2d6e-46ef-a0ec-8bd56645dcf7 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:19.837512 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f9705341-2d6e-46ef-a0ec-8bd56645dcf7 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0" status: 200 len: 1310 microversion: 2.1 time: 0.731661 Aug 07 01:11:19.846388 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 229/419] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:19 2022] GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 => generated 1310 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:20.898988 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-54d67c6e-84c0-468b-8af1-80d437dc3439 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:20.901545 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-54d67c6e-84c0-468b-8af1-80d437dc3439 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:20.949649 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54d67c6e-84c0-468b-8af1-80d437dc3439 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:20.956836 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54d67c6e-84c0-468b-8af1-80d437dc3439 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:20.961893 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54d67c6e-84c0-468b-8af1-80d437dc3439 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:20.963218 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54d67c6e-84c0-468b-8af1-80d437dc3439 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:20.967691 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54d67c6e-84c0-468b-8af1-80d437dc3439 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:20.970716 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54d67c6e-84c0-468b-8af1-80d437dc3439 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:20.981550 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=37 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:22.336465 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-54d67c6e-84c0-468b-8af1-80d437dc3439 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:22.353600 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-54d67c6e-84c0-468b-8af1-80d437dc3439 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0" status: 200 len: 1310 microversion: 2.1 time: 1.465766 Aug 07 01:11:22.377284 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 191/420] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:20 2022] GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 => generated 1310 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:11:22.608780 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-4b31ea5a-495e-44e8-ba91-59f1cf1c800e req-e28750ed-4bb6-45c2-83f8-028a051240c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a06b411-f5fe-46fa-9e79-d208fd6dcbf0", "name": "network-vif-plugged", "status": "completed", "tag": "d903aed3-3bb4-4c2d-bd4a-d9b615524a34"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:11:22.669497 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4b31ea5a-495e-44e8-ba91-59f1cf1c800e req-e28750ed-4bb6-45c2-83f8-028a051240c2 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:22.671268 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4b31ea5a-495e-44e8-ba91-59f1cf1c800e req-e28750ed-4bb6-45c2-83f8-028a051240c2 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:22.681557 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4b31ea5a-495e-44e8-ba91-59f1cf1c800e req-e28750ed-4bb6-45c2-83f8-028a051240c2 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:22.736005 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-4b31ea5a-495e-44e8-ba91-59f1cf1c800e req-e28750ed-4bb6-45c2-83f8-028a051240c2 service nova] Creating event network-vif-plugged:d903aed3-3bb4-4c2d-bd4a-d9b615524a34 for instance 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 on n-h2-master-1 Aug 07 01:11:22.750145 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-4b31ea5a-495e-44e8-ba91-59f1cf1c800e req-e28750ed-4bb6-45c2-83f8-028a051240c2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148915 Aug 07 01:11:22.753144 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 230/421] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:11:23.423831 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0b3ab06c-7fc6-4d69-a90a-5669fb23ce28 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:23.444539 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0b3ab06c-7fc6-4d69-a90a-5669fb23ce28 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:23.509433 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b3ab06c-7fc6-4d69-a90a-5669fb23ce28 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:23.517516 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b3ab06c-7fc6-4d69-a90a-5669fb23ce28 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:23.520214 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b3ab06c-7fc6-4d69-a90a-5669fb23ce28 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:23.534545 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b3ab06c-7fc6-4d69-a90a-5669fb23ce28 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:23.537238 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b3ab06c-7fc6-4d69-a90a-5669fb23ce28 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:23.546670 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b3ab06c-7fc6-4d69-a90a-5669fb23ce28 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:24.042037 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-21860bb7-6606-4d81-8bb5-23f1a8780fd7 tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Calling method '.version_select at 0x7f9e24e26820>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:24.054847 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:11:24.054847 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:11:24.067002 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21860bb7-6606-4d81-8bb5-23f1a8780fd7 tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:24.070149 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21860bb7-6606-4d81-8bb5-23f1a8780fd7 tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:24.071393 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21860bb7-6606-4d81-8bb5-23f1a8780fd7 tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:24.120199 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21860bb7-6606-4d81-8bb5-23f1a8780fd7 tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:24.121110 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21860bb7-6606-4d81-8bb5-23f1a8780fd7 tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:24.121659 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21860bb7-6606-4d81-8bb5-23f1a8780fd7 tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:24.256257 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21860bb7-6606-4d81-8bb5-23f1a8780fd7 tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:24.256937 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21860bb7-6606-4d81-8bb5-23f1a8780fd7 tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:24.257482 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21860bb7-6606-4d81-8bb5-23f1a8780fd7 tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:24.323085 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21860bb7-6606-4d81-8bb5-23f1a8780fd7 tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:24.324686 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21860bb7-6606-4d81-8bb5-23f1a8780fd7 tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:24.328510 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21860bb7-6606-4d81-8bb5-23f1a8780fd7 tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:24.400649 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21860bb7-6606-4d81-8bb5-23f1a8780fd7 tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:24.403823 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21860bb7-6606-4d81-8bb5-23f1a8780fd7 tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:24.404673 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21860bb7-6606-4d81-8bb5-23f1a8780fd7 tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:24.443371 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-21860bb7-6606-4d81-8bb5-23f1a8780fd7 tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1664 microversion: 2.53 time: 1.196224 Aug 07 01:11:24.449287 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 192/422] 10.222.0.39 () {60 vars in 1243 bytes} [Sun Aug 7 01:11:23 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1664 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:11:24.476426 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d48dd33e-6ce8-419e-bf83-4eaeff47da02 tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Calling method '.version_select at 0x7f9e24e26280>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:24.479197 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:11:24.479197 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:11:24.488953 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d48dd33e-6ce8-419e-bf83-4eaeff47da02 tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:24.489454 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d48dd33e-6ce8-419e-bf83-4eaeff47da02 tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:24.490082 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d48dd33e-6ce8-419e-bf83-4eaeff47da02 tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:24.555424 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d48dd33e-6ce8-419e-bf83-4eaeff47da02 tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:24.564817 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d48dd33e-6ce8-419e-bf83-4eaeff47da02 tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:24.569459 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d48dd33e-6ce8-419e-bf83-4eaeff47da02 tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:24.705849 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d48dd33e-6ce8-419e-bf83-4eaeff47da02 tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:24.713389 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d48dd33e-6ce8-419e-bf83-4eaeff47da02 tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:24.715048 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d48dd33e-6ce8-419e-bf83-4eaeff47da02 tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:24.763980 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d48dd33e-6ce8-419e-bf83-4eaeff47da02 tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:24.765087 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d48dd33e-6ce8-419e-bf83-4eaeff47da02 tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:24.766165 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d48dd33e-6ce8-419e-bf83-4eaeff47da02 tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:24.847169 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d48dd33e-6ce8-419e-bf83-4eaeff47da02 tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:24.848755 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d48dd33e-6ce8-419e-bf83-4eaeff47da02 tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:24.850695 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d48dd33e-6ce8-419e-bf83-4eaeff47da02 tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:24.882854 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d48dd33e-6ce8-419e-bf83-4eaeff47da02 tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 357 microversion: 2.53 time: 0.411000 Aug 07 01:11:24.891556 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 193/423] 10.222.0.39 () {60 vars in 1222 bytes} [Sun Aug 7 01:11:24 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 357 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 01:11:24.928707 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-76c1f156-e3b3-4763-b23f-b95f0eeff89d tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Calling method '.version_select at 0x7f9e24e264c0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:24.938187 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:11:24.938187 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:11:24.948658 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76c1f156-e3b3-4763-b23f-b95f0eeff89d tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:24.950333 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76c1f156-e3b3-4763-b23f-b95f0eeff89d tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:24.959910 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76c1f156-e3b3-4763-b23f-b95f0eeff89d tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:24.997028 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0b3ab06c-7fc6-4d69-a90a-5669fb23ce28 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:25.032720 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0b3ab06c-7fc6-4d69-a90a-5669fb23ce28 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0" status: 200 len: 1310 microversion: 2.1 time: 1.647972 Aug 07 01:11:25.035702 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 231/424] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:23 2022] GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 => generated 1310 bytes in 1653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:25.058693 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76c1f156-e3b3-4763-b23f-b95f0eeff89d tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:25.059906 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76c1f156-e3b3-4763-b23f-b95f0eeff89d tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:25.061182 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76c1f156-e3b3-4763-b23f-b95f0eeff89d tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:25.092327 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-76c1f156-e3b3-4763-b23f-b95f0eeff89d tempest-HypervisorAdminV253TestBase-1094523132 tempest-HypervisorAdminV253TestBase-1094523132-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/e217a019-771f-4851-a5d4-8c29f31abac3" status: 200 len: 792 microversion: 2.53 time: 0.179756 Aug 07 01:11:25.096748 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 194/425] 10.222.0.39 () {60 vars in 1298 bytes} [Sun Aug 7 01:11:24 2022] GET /compute/v2.1/os-hypervisors/e217a019-771f-4851-a5d4-8c29f31abac3 => generated 792 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 01:11:26.078357 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fa14b3bc-57e7-4b39-8cec-c04bfee7f931 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:26.079029 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fa14b3bc-57e7-4b39-8cec-c04bfee7f931 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:26.101186 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=14,nova_api:INSERT=5 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:26.105326 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa14b3bc-57e7-4b39-8cec-c04bfee7f931 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:26.107006 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa14b3bc-57e7-4b39-8cec-c04bfee7f931 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:26.108121 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa14b3bc-57e7-4b39-8cec-c04bfee7f931 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:26.109237 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa14b3bc-57e7-4b39-8cec-c04bfee7f931 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:26.109902 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa14b3bc-57e7-4b39-8cec-c04bfee7f931 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:26.112997 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa14b3bc-57e7-4b39-8cec-c04bfee7f931 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:26.551196 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=4 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:27.102362 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fa14b3bc-57e7-4b39-8cec-c04bfee7f931 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:27.115384 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fa14b3bc-57e7-4b39-8cec-c04bfee7f931 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0" status: 200 len: 1493 microversion: 2.1 time: 1.040930 Aug 07 01:11:27.119386 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 232/426] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:26 2022] GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 => generated 1493 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:27.317346 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fb384379-488f-46b1-a849-33369be7246f tempest-InstanceUsageAuditLogTestJSON-1295122856 tempest-InstanceUsageAuditLogTestJSON-1295122856-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:27.319811 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:11:27.319811 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:11:27.456602 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fb384379-488f-46b1-a849-33369be7246f tempest-InstanceUsageAuditLogTestJSON-1295122856 tempest-InstanceUsageAuditLogTestJSON-1295122856-project-admin] 10.222.0.39 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-07 01:11:26" status: 200 len: 318 microversion: 2.1 time: 0.914777 Aug 07 01:11:27.457236 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 195/427] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Aug 7 01:11:26 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-07%2001%3A11%3A26 => generated 318 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:11:27.482656 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-11c398a1-d482-4975-add6-b7787d9ab7f0 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1224988217", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "cf70f379-7573-4a22-8d03-15664460decc"}], "security_groups": [{"name": "tempest-securitygroup--456451582"}], "key_name": "tempest-keypair-340230674", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:11:27.890306 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2f9641cd-161b-4f25-bc5a-a5c344fb6c79 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:27.896517 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2f9641cd-161b-4f25-bc5a-a5c344fb6c79 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] [instance: 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:27.929841 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f9641cd-161b-4f25-bc5a-a5c344fb6c79 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:27.931336 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f9641cd-161b-4f25-bc5a-a5c344fb6c79 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:27.932653 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f9641cd-161b-4f25-bc5a-a5c344fb6c79 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:27.936545 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f9641cd-161b-4f25-bc5a-a5c344fb6c79 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:27.939621 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f9641cd-161b-4f25-bc5a-a5c344fb6c79 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:27.941662 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f9641cd-161b-4f25-bc5a-a5c344fb6c79 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:28.448046 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-11c398a1-d482-4975-add6-b7787d9ab7f0 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] validate_networks() for [('cf70f379-7573-4a22-8d03-15664460decc', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:11:29.485730 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2f9641cd-161b-4f25-bc5a-a5c344fb6c79 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0" status: 200 len: 1644 microversion: 2.1 time: 2.328955 Aug 07 01:11:29.501610 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 233/428] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:27 2022] GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 => generated 1644 bytes in 2348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:11:29.526356 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-400450dc-5d9c-46db-9b3f-3a38b6db396f tempest-InstanceUsageAuditLogTestJSON-1295122856 tempest-InstanceUsageAuditLogTestJSON-1295122856-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:29.528483 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:11:29.528483 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:11:29.652309 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-400450dc-5d9c-46db-9b3f-3a38b6db396f tempest-InstanceUsageAuditLogTestJSON-1295122856 tempest-InstanceUsageAuditLogTestJSON-1295122856-project-admin] 10.222.0.39 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.142601 Aug 07 01:11:29.653392 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 234/429] 10.222.0.39 () {58 vars in 1185 bytes} [Sun Aug 7 01:11:29 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:11:30.580891 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-11c398a1-d482-4975-add6-b7787d9ab7f0 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:11:30.581608 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-11c398a1-d482-4975-add6-b7787d9ab7f0 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:11:30.582137 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-11c398a1-d482-4975-add6-b7787d9ab7f0 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:11:30.582547 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-11c398a1-d482-4975-add6-b7787d9ab7f0 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:11:30.583280 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-11c398a1-d482-4975-add6-b7787d9ab7f0 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:11:30.617580 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-11c398a1-d482-4975-add6-b7787d9ab7f0 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:30.618371 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-11c398a1-d482-4975-add6-b7787d9ab7f0 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:30.618977 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-11c398a1-d482-4975-add6-b7787d9ab7f0 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:30.620072 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-11c398a1-d482-4975-add6-b7787d9ab7f0 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:30.624501 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-11c398a1-d482-4975-add6-b7787d9ab7f0 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:30.625300 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-11c398a1-d482-4975-add6-b7787d9ab7f0 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:30.713393 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-11c398a1-d482-4975-add6-b7787d9ab7f0 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Getting quotas for project 3e6d319a0452448485aa65b7cf1c5b0e. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:11:30.729687 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-11c398a1-d482-4975-add6-b7787d9ab7f0 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Getting quotas for user 7e9dce42ff994d81b1ad6d6c05356c37 and project 3e6d319a0452448485aa65b7cf1c5b0e. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:11:30.805643 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-11c398a1-d482-4975-add6-b7787d9ab7f0 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:11:30.821511 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-11c398a1-d482-4975-add6-b7787d9ab7f0 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: 5777df19-f308-48d1-8f53-fdbf073a4ef2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:11:31.108412 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-11c398a1-d482-4975-add6-b7787d9ab7f0 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.636326 Aug 07 01:11:31.115060 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 196/430] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:11:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 3644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:11:31.138244 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-310af3ee-1119-4769-953e-901582877361 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:31.140747 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-310af3ee-1119-4769-953e-901582877361 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] [instance: 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:31.171131 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-310af3ee-1119-4769-953e-901582877361 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:31.172640 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-310af3ee-1119-4769-953e-901582877361 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:31.173297 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-310af3ee-1119-4769-953e-901582877361 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:31.176082 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-310af3ee-1119-4769-953e-901582877361 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:31.180057 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-310af3ee-1119-4769-953e-901582877361 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:31.181018 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-310af3ee-1119-4769-953e-901582877361 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:31.191757 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bccbb461-ba80-4738-a7d8-0a516edfa5be tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-916650472", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": "none"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:11:31.393137 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-bccbb461-ba80-4738-a7d8-0a516edfa5be tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:11:31.403756 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-bccbb461-ba80-4738-a7d8-0a516edfa5be tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:11:31.406550 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-bccbb461-ba80-4738-a7d8-0a516edfa5be tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:11:31.414091 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-bccbb461-ba80-4738-a7d8-0a516edfa5be tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:11:31.415248 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-bccbb461-ba80-4738-a7d8-0a516edfa5be tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:11:31.459759 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bccbb461-ba80-4738-a7d8-0a516edfa5be tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:31.468729 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bccbb461-ba80-4738-a7d8-0a516edfa5be tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:31.469229 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bccbb461-ba80-4738-a7d8-0a516edfa5be tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:31.470090 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bccbb461-ba80-4738-a7d8-0a516edfa5be tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:31.470687 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bccbb461-ba80-4738-a7d8-0a516edfa5be tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:31.471163 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bccbb461-ba80-4738-a7d8-0a516edfa5be tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:31.628575 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-bccbb461-ba80-4738-a7d8-0a516edfa5be tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Getting quotas for project b525a2b221d843c0b1ec95a81acc0159. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:11:31.742618 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-bccbb461-ba80-4738-a7d8-0a516edfa5be tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Getting quotas for user 96da5d25cbbd4653b222290714febb05 and project b525a2b221d843c0b1ec95a81acc0159. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:11:31.921040 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bccbb461-ba80-4738-a7d8-0a516edfa5be tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:11:31.934374 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bccbb461-ba80-4738-a7d8-0a516edfa5be tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:11:32.201022 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bccbb461-ba80-4738-a7d8-0a516edfa5be tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 2.539903 Aug 07 01:11:32.208350 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 235/431] 10.222.0.39 () {62 vars in 1188 bytes} [Sun Aug 7 01:11:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2554 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 07 01:11:32.221440 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ed26f4d8-78bf-49e8-8466-70c90ae44c53 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:32.223968 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ed26f4d8-78bf-49e8-8466-70c90ae44c53 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: 5777df19-f308-48d1-8f53-fdbf073a4ef2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:32.694082 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ed26f4d8-78bf-49e8-8466-70c90ae44c53 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dce42ff994d81b1ad6d6c05356c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6d319a0452448485aa65b7cf1c5b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:32.709455 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ed26f4d8-78bf-49e8-8466-70c90ae44c53 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2" status: 200 len: 1241 microversion: 2.1 time: 0.496727 Aug 07 01:11:32.728204 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 236/432] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:32 2022] GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2 => generated 1241 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:32.745905 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-636323de-2949-45c7-8a47-b6c4e1ad1c65 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:11:32.752794 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-636323de-2949-45c7-8a47-b6c4e1ad1c65 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:32.946146 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-310af3ee-1119-4769-953e-901582877361 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0" status: 200 len: 1644 microversion: 2.1 time: 1.829823 Aug 07 01:11:32.971822 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 197/433] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:31 2022] GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 => generated 1644 bytes in 1856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:32.991333 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fd12a442-0826-4e0b-a6d8-6b2025270e16 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:32.994272 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:11:32.994272 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:11:33.001423 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd12a442-0826-4e0b-a6d8-6b2025270e16 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:33.003817 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd12a442-0826-4e0b-a6d8-6b2025270e16 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:33.009718 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd12a442-0826-4e0b-a6d8-6b2025270e16 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:33.015587 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd12a442-0826-4e0b-a6d8-6b2025270e16 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:33.017698 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd12a442-0826-4e0b-a6d8-6b2025270e16 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:33.019319 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd12a442-0826-4e0b-a6d8-6b2025270e16 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:33.054189 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=76,nova_api:SAVEPOINT=2,nova_api:INSERT=6,nova_api:RELEASE=2,nova_api:DELETE=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:33.097735 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-636323de-2949-45c7-8a47-b6c4e1ad1c65 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:33.132463 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-636323de-2949-45c7-8a47-b6c4e1ad1c65 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:33.150198 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-636323de-2949-45c7-8a47-b6c4e1ad1c65 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:33.162477 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fd12a442-0826-4e0b-a6d8-6b2025270e16 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.176224 Aug 07 01:11:33.163519 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 198/434] 10.222.0.39 () {58 vars in 1176 bytes} [Sun Aug 7 01:11:32 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:11:33.186250 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e0539b40-73cd-48c5-8df3-ac87a3ab1d53 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:11:33.195716 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e0539b40-73cd-48c5-8df3-ac87a3ab1d53 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] [instance: 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:33.205987 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-636323de-2949-45c7-8a47-b6c4e1ad1c65 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] 10.222.0.39 "PUT /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1358 microversion: 2.75 time: 0.471068 Aug 07 01:11:33.212271 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 237/435] 10.222.0.39 () {62 vars in 1297 bytes} [Sun Aug 7 01:11:32 2022] PUT /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1358 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:11:33.225056 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e0539b40-73cd-48c5-8df3-ac87a3ab1d53 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:33.225991 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e0539b40-73cd-48c5-8df3-ac87a3ab1d53 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:33.230995 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e0539b40-73cd-48c5-8df3-ac87a3ab1d53 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:33.232452 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e0539b40-73cd-48c5-8df3-ac87a3ab1d53 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:33.240196 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e0539b40-73cd-48c5-8df3-ac87a3ab1d53 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:33.242049 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e0539b40-73cd-48c5-8df3-ac87a3ab1d53 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:33.268978 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-38ad5159-5618-4335-baca-93ee9b5e9d86 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:33.281933 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-38ad5159-5618-4335-baca-93ee9b5e9d86 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:33.741145 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-e0539b40-73cd-48c5-8df3-ac87a3ab1d53 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lazy-loading 'flavor' on Instance uuid 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:11:33.893510 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e0539b40-73cd-48c5-8df3-ac87a3ab1d53 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] [instance: 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0] Going to try to live migrate instance to n-h1-master-1 {{(pid=119517) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 07 01:11:34.607057 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-38ad5159-5618-4335-baca-93ee9b5e9d86 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:34.617627 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-38ad5159-5618-4335-baca-93ee9b5e9d86 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:34.622210 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-38ad5159-5618-4335-baca-93ee9b5e9d86 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:34.634988 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-38ad5159-5618-4335-baca-93ee9b5e9d86 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1358 microversion: 2.75 time: 1.375090 Aug 07 01:11:34.644077 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 238/436] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:11:33 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1358 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:11:34.650290 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-65e0aa16-e321-43e4-bca0-bdc44d777325 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:34.653837 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-65e0aa16-e321-43e4-bca0-bdc44d777325 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: 5777df19-f308-48d1-8f53-fdbf073a4ef2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:34.669634 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-65e0aa16-e321-43e4-bca0-bdc44d777325 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:34.670470 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-65e0aa16-e321-43e4-bca0-bdc44d777325 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:34.672541 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-65e0aa16-e321-43e4-bca0-bdc44d777325 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:34.673649 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-65e0aa16-e321-43e4-bca0-bdc44d777325 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:34.675560 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-65e0aa16-e321-43e4-bca0-bdc44d777325 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:34.679078 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-65e0aa16-e321-43e4-bca0-bdc44d777325 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:35.211685 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-65e0aa16-e321-43e4-bca0-bdc44d777325 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dce42ff994d81b1ad6d6c05356c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6d319a0452448485aa65b7cf1c5b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:35.222575 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-65e0aa16-e321-43e4-bca0-bdc44d777325 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2" status: 200 len: 1293 microversion: 2.1 time: 0.576793 Aug 07 01:11:35.226328 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 239/437] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:34 2022] GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2 => generated 1293 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:36.197061 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-38cbc9df-2be6-4a70-8bf4-3644a960851c tempest-FloatingIPsNegativeTestJSON-1330546428 tempest-FloatingIPsNegativeTestJSON-1330546428-project] Calling method '.version_select at 0x7f9e25013a60>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:36.689618 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-38cbc9df-2be6-4a70-8bf4-3644a960851c tempest-FloatingIPsNegativeTestJSON-1330546428 tempest-FloatingIPsNegativeTestJSON-1330546428-project] 10.222.0.39 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 1.461124 Aug 07 01:11:36.691442 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 240/438] 10.222.0.39 () {58 vars in 1149 bytes} [Sun Aug 7 01:11:35 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:11:36.699118 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b1d37d69-d1fb-4d6c-8a3e-91ea37393896 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:36.705270 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b1d37d69-d1fb-4d6c-8a3e-91ea37393896 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:36.737033 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b1d37d69-d1fb-4d6c-8a3e-91ea37393896 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:36.739020 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b1d37d69-d1fb-4d6c-8a3e-91ea37393896 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:36.743585 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b1d37d69-d1fb-4d6c-8a3e-91ea37393896 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:36.745526 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b1d37d69-d1fb-4d6c-8a3e-91ea37393896 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:36.746883 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b1d37d69-d1fb-4d6c-8a3e-91ea37393896 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:36.747989 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b1d37d69-d1fb-4d6c-8a3e-91ea37393896 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:37.314229 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b1d37d69-d1fb-4d6c-8a3e-91ea37393896 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:37.348385 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b1d37d69-d1fb-4d6c-8a3e-91ea37393896 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:37.359382 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b1d37d69-d1fb-4d6c-8a3e-91ea37393896 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:37.386714 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b1d37d69-d1fb-4d6c-8a3e-91ea37393896 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1416 microversion: 2.75 time: 0.693231 Aug 07 01:11:37.391236 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 241/439] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:11:36 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1416 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:11:37.457647 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3b464381-dbad-4b3c-b82b-97bf0dccd03f tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:37.462420 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3b464381-dbad-4b3c-b82b-97bf0dccd03f tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: 5777df19-f308-48d1-8f53-fdbf073a4ef2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:37.490595 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b464381-dbad-4b3c-b82b-97bf0dccd03f tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:37.510310 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b464381-dbad-4b3c-b82b-97bf0dccd03f tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:37.511444 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b464381-dbad-4b3c-b82b-97bf0dccd03f tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:37.517535 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b464381-dbad-4b3c-b82b-97bf0dccd03f tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:37.521690 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b464381-dbad-4b3c-b82b-97bf0dccd03f tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:37.525136 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b464381-dbad-4b3c-b82b-97bf0dccd03f tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:37.919389 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3b464381-dbad-4b3c-b82b-97bf0dccd03f tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dce42ff994d81b1ad6d6c05356c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6d319a0452448485aa65b7cf1c5b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:37.932399 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3b464381-dbad-4b3c-b82b-97bf0dccd03f tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2" status: 200 len: 1299 microversion: 2.1 time: 0.512436 Aug 07 01:11:37.933630 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 242/440] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:37 2022] GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2 => generated 1299 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:37.947380 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d60bc6b6-268c-4727-9a85-3681e971515b tempest-FloatingIPsNegativeTestJSON-1330546428 tempest-FloatingIPsNegativeTestJSON-1330546428-project] Action: 'create', calling method: .version_select at 0x7f9e2507c670>, body: {"pool": "non_exist_pool"} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:11:38.871626 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-d60bc6b6-268c-4727-9a85-3681e971515b tempest-FloatingIPsNegativeTestJSON-1330546428 tempest-FloatingIPsNegativeTestJSON-1330546428-project] HTTP exception thrown: Floating IP pool not found. Aug 07 01:11:38.876940 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d60bc6b6-268c-4727-9a85-3681e971515b tempest-FloatingIPsNegativeTestJSON-1330546428 tempest-FloatingIPsNegativeTestJSON-1330546428-project] Request method failure captured: Aug 07 01:11:38.876940 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 07 01:11:38.876940 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:11:38.876940 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:11:38.876940 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:11:38.876940 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 26 Aug 07 01:11:38.876940 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:11:38.876940 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:11:38.876940 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:11:38.876940 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:11:38.876940 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xFGtrv_oq5aD0lmr6V93ij74W-gXxDpsQBYN7dd59aFF4H9Xqqe0ASGilfcR3oDpVBzuemBlhWFnstfnMoFyeY8xuxZWb1Ze97OsPm1noEWmL9XidIufobtI3rjFEhXdjO4PjRJi635RPZVzPkU2FgeuUVJNSEf4vrZ1I4NZpT3Y5A Aug 07 01:11:38.876940 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:11:38.876940 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:11:38.876940 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:11:38.876940 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:11:38.876940 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:11:38.876940 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:11:38.876940 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 7c2c9ff9beef426785b22ee0e2876c08 Aug 07 01:11:38.876940 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1330546428 Aug 07 01:11:38.876940 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:11:38.876940 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:11:38.878533 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7c2c9ff9beef426785b22ee0e2876c08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7c2c9ff9beef426785b22ee0e2876c08", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7c2c9ff9beef426785b22ee0e2876c08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7c2c9ff9beef426785b22ee0e2876c08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:11:38.878533 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1330546428 Aug 07 01:11:38.878533 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 7c2c9ff9beef426785b22ee0e2876c08 Aug 07 01:11:38.878533 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1330546428 Aug 07 01:11:38.878533 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-FloatingIPsNegativeTestJSON-1330546428-project Aug 07 01:11:38.878533 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:11:38.878533 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:11:38.878533 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: aaaa793a840141369476d821307497c0 Aug 07 01:11:38.878533 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1330546428-project Aug 07 01:11:38.878533 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:11:38.878533 n-d-master-1 devstack@n-api.service[119516]: {"pool": "non_exist_pool"} Aug 07 01:11:38.878533 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:11:38.878533 n-d-master-1 devstack@n-api.service[119516]: exception: Floating IP pool not found. Aug 07 01:11:38.878533 n-d-master-1 devstack@n-api.service[119516]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 07 01:11:38.878533 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:11:38.879730 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:38.879730 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 07 01:11:38.879730 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 07 01:11:38.879730 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Aug 07 01:11:38.879730 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 07 01:11:38.879730 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Aug 07 01:11:38.879730 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 07 01:11:38.879730 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 07 01:11:38.879730 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:38.879730 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:11:38.879730 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:38.879730 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:38.879730 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:11:38.879730 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:11:38.879730 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:11:38.879730 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:11:38.879730 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:11:38.879730 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:11:38.879730 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:11:38.879730 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:11:38.881491 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 07 01:11:38.881491 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:11:38.881491 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 07 01:11:38.881491 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:38.881491 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:11:38.881491 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:38.881491 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:38.881491 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:11:38.881491 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:11:38.881491 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:11:38.881491 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:11:38.881491 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 07 01:11:38.881491 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:38.884005 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d60bc6b6-268c-4727-9a85-3681e971515b tempest-FloatingIPsNegativeTestJSON-1330546428 tempest-FloatingIPsNegativeTestJSON-1330546428-project] Returning 404 to user: Floating IP pool not found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:11:38.887627 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d60bc6b6-268c-4727-9a85-3681e971515b tempest-FloatingIPsNegativeTestJSON-1330546428 tempest-FloatingIPsNegativeTestJSON-1330546428-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.952165 Aug 07 01:11:38.899024 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 243/441] 10.222.0.39 () {60 vars in 1170 bytes} [Sun Aug 7 01:11:37 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 964 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:11:39.585678 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a24d045c-99de-4c8f-a475-71cc94f63f12 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-734922474", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "a36c95a7-f5a6-4689-9476-42d2c17376f3"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:11:39.710107 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-a24d045c-99de-4c8f-a475-71cc94f63f12 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] validate_networks() for [('a36c95a7-f5a6-4689-9476-42d2c17376f3', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:11:40.766072 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=10 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:41.508693 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:41.621747 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e0539b40-73cd-48c5-8df3-ac87a3ab1d53 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0/action" status: 202 len: 0 microversion: 2.1 time: 8.447516 Aug 07 01:11:41.623170 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 199/442] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:11:33 2022] POST /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0/action => generated 0 bytes in 8451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:11:41.643130 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6b48f71b-3cc8-49b5-b88a-fd75df6e4ddc tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:41.647183 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6b48f71b-3cc8-49b5-b88a-fd75df6e4ddc tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:41.685205 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6b48f71b-3cc8-49b5-b88a-fd75df6e4ddc tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:41.690180 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6b48f71b-3cc8-49b5-b88a-fd75df6e4ddc tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:41.691337 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6b48f71b-3cc8-49b5-b88a-fd75df6e4ddc tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:41.694355 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6b48f71b-3cc8-49b5-b88a-fd75df6e4ddc tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:41.696617 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6b48f71b-3cc8-49b5-b88a-fd75df6e4ddc tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:41.701752 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6b48f71b-3cc8-49b5-b88a-fd75df6e4ddc tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:42.030965 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6b48f71b-3cc8-49b5-b88a-fd75df6e4ddc tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:42.071223 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6b48f71b-3cc8-49b5-b88a-fd75df6e4ddc tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:42.075273 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6b48f71b-3cc8-49b5-b88a-fd75df6e4ddc tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:42.106794 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6b48f71b-3cc8-49b5-b88a-fd75df6e4ddc tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1437 microversion: 2.75 time: 0.481332 Aug 07 01:11:42.120315 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 200/443] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:11:41 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1437 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:11:42.130207 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1e91191c-667b-441d-bba4-821418d186b2 tempest-FloatingIPsNegativeTestJSON-1330546428 tempest-FloatingIPsNegativeTestJSON-1330546428-project] Calling method '.version_select at 0x7f9e24c66670>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:42.200127 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-a24d045c-99de-4c8f-a475-71cc94f63f12 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:11:42.201778 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-a24d045c-99de-4c8f-a475-71cc94f63f12 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:11:42.203580 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-a24d045c-99de-4c8f-a475-71cc94f63f12 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:11:42.204668 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-a24d045c-99de-4c8f-a475-71cc94f63f12 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:11:42.205839 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-a24d045c-99de-4c8f-a475-71cc94f63f12 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:11:42.231402 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a24d045c-99de-4c8f-a475-71cc94f63f12 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:42.233080 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a24d045c-99de-4c8f-a475-71cc94f63f12 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:42.234708 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a24d045c-99de-4c8f-a475-71cc94f63f12 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:42.236661 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a24d045c-99de-4c8f-a475-71cc94f63f12 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:42.237867 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a24d045c-99de-4c8f-a475-71cc94f63f12 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:42.238982 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a24d045c-99de-4c8f-a475-71cc94f63f12 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:42.318444 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-a24d045c-99de-4c8f-a475-71cc94f63f12 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Getting quotas for project 4e443158f15b42a3a795950a7c409a38. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:11:42.336491 n-d-master-1 devstack@n-api.service[119517]: DEBUG neutronclient.v2_0.client [None req-1e91191c-667b-441d-bba4-821418d186b2 tempest-FloatingIPsNegativeTestJSON-1330546428 tempest-FloatingIPsNegativeTestJSON-1330546428-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 22c4f8cf-29c3-4f22-9028-b586c5b200c4 could not be found", "detail": ""}} {{(pid=119517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 07 01:11:42.341417 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-1e91191c-667b-441d-bba4-821418d186b2 tempest-FloatingIPsNegativeTestJSON-1330546428 tempest-FloatingIPsNegativeTestJSON-1330546428-project] HTTP exception thrown: Floating IP not found for ID 22c4f8cf-29c3-4f22-9028-b586c5b200c4 Aug 07 01:11:42.347192 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-a24d045c-99de-4c8f-a475-71cc94f63f12 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Getting quotas for user c135ba135fd946149ace9a86c7c52e80 and project 4e443158f15b42a3a795950a7c409a38. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:11:42.360247 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1e91191c-667b-441d-bba4-821418d186b2 tempest-FloatingIPsNegativeTestJSON-1330546428 tempest-FloatingIPsNegativeTestJSON-1330546428-project] Request method failure captured: Aug 07 01:11:42.360247 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/os-floating-ips/22c4f8cf-29c3-4f22-9028-b586c5b200c4 HTTP/1.1 Aug 07 01:11:42.360247 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:11:42.360247 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:11:42.360247 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:11:42.360247 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:11:42.360247 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:11:42.360247 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:11:42.360247 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:11:42.360247 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:11:42.360247 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xFGtrv_oq5aD0lmr6V93ij74W-gXxDpsQBYN7dd59aFF4H9Xqqe0ASGilfcR3oDpVBzuemBlhWFnstfnMoFyeY8xuxZWb1Ze97OsPm1noEWmL9XidIufobtI3rjFEhXdjO4PjRJi635RPZVzPkU2FgeuUVJNSEf4vrZ1I4NZpT3Y5A Aug 07 01:11:42.360247 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:11:42.360247 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:11:42.360247 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:11:42.360247 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:11:42.360247 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:11:42.360247 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:11:42.360247 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 7c2c9ff9beef426785b22ee0e2876c08 Aug 07 01:11:42.360247 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1330546428 Aug 07 01:11:42.360247 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:11:42.360247 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:11:42.362201 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7c2c9ff9beef426785b22ee0e2876c08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7c2c9ff9beef426785b22ee0e2876c08", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7c2c9ff9beef426785b22ee0e2876c08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7c2c9ff9beef426785b22ee0e2876c08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:11:42.362201 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1330546428 Aug 07 01:11:42.362201 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 7c2c9ff9beef426785b22ee0e2876c08 Aug 07 01:11:42.362201 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1330546428 Aug 07 01:11:42.362201 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-FloatingIPsNegativeTestJSON-1330546428-project Aug 07 01:11:42.362201 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:11:42.362201 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:11:42.362201 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: aaaa793a840141369476d821307497c0 Aug 07 01:11:42.362201 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1330546428-project Aug 07 01:11:42.362201 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:11:42.362201 n-d-master-1 devstack@n-api.service[119517]: exception: Floating IP not found for ID 22c4f8cf-29c3-4f22-9028-b586c5b200c4 Aug 07 01:11:42.362201 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '22c4f8cf-29c3-4f22-9028-b586c5b200c4'} Aug 07 01:11:42.362201 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:11:42.363227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:42.363227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 07 01:11:42.363227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 07 01:11:42.363227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:11:42.363227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:11:42.363227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 07 01:11:42.363227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 07 01:11:42.363227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:11:42.363227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:11:42.363227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 07 01:11:42.363227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 07 01:11:42.363227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:11:42.363227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:11:42.363227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 07 01:11:42.363227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 07 01:11:42.363227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:11:42.363227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:11:42.363227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 07 01:11:42.363227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 07 01:11:42.364596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:11:42.364596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:11:42.364596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 07 01:11:42.364596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 07 01:11:42.364596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 07 01:11:42.364596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 07 01:11:42.364596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 22c4f8cf-29c3-4f22-9028-b586c5b200c4 could not be found Aug 07 01:11:42.364596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9170ad56-9a89-40e9-b082-f12697293773'] Aug 07 01:11:42.364596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:11:42.364596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:11:42.364596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:11:42.364596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:42.364596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 07 01:11:42.364596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 07 01:11:42.364596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 07 01:11:42.364596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 07 01:11:42.364596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 22c4f8cf-29c3-4f22-9028-b586c5b200c4. Aug 07 01:11:42.364596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:11:42.364596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:11:42.364596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:11:42.366106 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:42.366106 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:11:42.366106 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:11:42.366106 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:11:42.366106 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:11:42.366106 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:11:42.366106 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:11:42.366106 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:11:42.366106 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:11:42.366106 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 07 01:11:42.366106 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 07 01:11:42.366106 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 22c4f8cf-29c3-4f22-9028-b586c5b200c4 Aug 07 01:11:42.366106 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:11:42.366106 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:11:42.366106 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:11:42.366106 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:42.366106 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:11:42.366106 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:11:42.366106 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:11:42.366106 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:11:42.367529 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 22c4f8cf-29c3-4f22-9028-b586c5b200c4 Aug 07 01:11:42.367529 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:11:42.371006 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1e91191c-667b-441d-bba4-821418d186b2 tempest-FloatingIPsNegativeTestJSON-1330546428 tempest-FloatingIPsNegativeTestJSON-1330546428-project] Returning 404 to user: Floating IP not found for ID 22c4f8cf-29c3-4f22-9028-b586c5b200c4 {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:11:42.374862 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1e91191c-667b-441d-bba4-821418d186b2 tempest-FloatingIPsNegativeTestJSON-1330546428 tempest-FloatingIPsNegativeTestJSON-1330546428-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/22c4f8cf-29c3-4f22-9028-b586c5b200c4" status: 404 len: 111 microversion: 2.1 time: 0.252581 Aug 07 01:11:42.381732 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 201/444] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Aug 7 01:11:42 2022] DELETE /compute/v2.1/os-floating-ips/22c4f8cf-29c3-4f22-9028-b586c5b200c4 => generated 111 bytes in 261 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:11:42.388003 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a24d045c-99de-4c8f-a475-71cc94f63f12 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:11:42.391810 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a24d045c-99de-4c8f-a475-71cc94f63f12 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 2125f4ff-9031-486f-8b5f-85082bf81588] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:11:42.403599 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-252f82be-4ffe-4ccf-965a-53ced0daf8b9 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:42.404316 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-252f82be-4ffe-4ccf-965a-53ced0daf8b9 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: 5777df19-f308-48d1-8f53-fdbf073a4ef2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:42.451176 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-252f82be-4ffe-4ccf-965a-53ced0daf8b9 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:42.451586 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-252f82be-4ffe-4ccf-965a-53ced0daf8b9 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:42.452080 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-252f82be-4ffe-4ccf-965a-53ced0daf8b9 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:42.452844 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-252f82be-4ffe-4ccf-965a-53ced0daf8b9 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:42.453327 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-252f82be-4ffe-4ccf-965a-53ced0daf8b9 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:42.453757 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-252f82be-4ffe-4ccf-965a-53ced0daf8b9 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:42.494862 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a24d045c-99de-4c8f-a475-71cc94f63f12 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.593829 Aug 07 01:11:42.501354 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 244/445] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:11:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 3601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:11:43.025638 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=4 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:43.201699 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d2a04c0e-a2cb-41fd-acda-08bdf64ac523 tempest-KeyPairsV210TestJSON-862818296 tempest-KeyPairsV210TestJSON-862818296-project-admin] Action: 'create', calling method: .version_select at 0x7f9e24ca7e50>, body: {"keypair": {"name": "tempest-keypair-285157577", "type": "ssh", "user_id": "2e66778890e8464f9912b5b120ba94a3", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD13i5XUfH4JQvj+C3QcGv0qcMmmcTqPHcXAK8qvYJL3KdhfHEIKE0YeVAw915P/eXvibReJ8wOVW41WKv36gs08C+VqVycRAaregpFz2jTa3QjnzWC76Kz5BofFp0znyg=="}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:11:43.245619 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-252f82be-4ffe-4ccf-965a-53ced0daf8b9 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dce42ff994d81b1ad6d6c05356c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6d319a0452448485aa65b7cf1c5b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:43.291103 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-252f82be-4ffe-4ccf-965a-53ced0daf8b9 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2" status: 200 len: 1366 microversion: 2.1 time: 0.902613 Aug 07 01:11:43.292529 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 202/446] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:42 2022] GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2 => generated 1366 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:43.301999 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-0f01eb08-177a-44df-807c-ed1c26f78719 req-a8e905e6-4aa1-4886-8116-5756eccb0789 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5777df19-f308-48d1-8f53-fdbf073a4ef2", "tag": "62317124-fa59-401f-9d70-b70b34f142b9"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:11:43.329061 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-d2a04c0e-a2cb-41fd-acda-08bdf64ac523 tempest-KeyPairsV210TestJSON-862818296 tempest-KeyPairsV210TestJSON-862818296-project-admin] Getting quotas for project d914ab3076e844818aadc1a1314ec043. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:11:43.338854 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0f01eb08-177a-44df-807c-ed1c26f78719 req-a8e905e6-4aa1-4886-8116-5756eccb0789 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:43.338854 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0f01eb08-177a-44df-807c-ed1c26f78719 req-a8e905e6-4aa1-4886-8116-5756eccb0789 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:43.339206 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0f01eb08-177a-44df-807c-ed1c26f78719 req-a8e905e6-4aa1-4886-8116-5756eccb0789 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:43.353093 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-d2a04c0e-a2cb-41fd-acda-08bdf64ac523 tempest-KeyPairsV210TestJSON-862818296 tempest-KeyPairsV210TestJSON-862818296-project-admin] Getting quotas for user 7773115ae92a4b7b9bee60a87457c572 and project d914ab3076e844818aadc1a1314ec043. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:11:43.462277 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-0f01eb08-177a-44df-807c-ed1c26f78719 req-a8e905e6-4aa1-4886-8116-5756eccb0789 service nova] Creating event network-changed:62317124-fa59-401f-9d70-b70b34f142b9 for instance 5777df19-f308-48d1-8f53-fdbf073a4ef2 on n-h1-master-1 Aug 07 01:11:43.482221 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-0f01eb08-177a-44df-807c-ed1c26f78719 req-a8e905e6-4aa1-4886-8116-5756eccb0789 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186336 Aug 07 01:11:43.490238 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 203/447] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:11:43.564644 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d2a04c0e-a2cb-41fd-acda-08bdf64ac523 tempest-KeyPairsV210TestJSON-862818296 tempest-KeyPairsV210TestJSON-862818296-project-admin] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 1.062553 Aug 07 01:11:43.577168 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 245/448] 10.222.0.39 () {62 vars in 1200 bytes} [Sun Aug 7 01:11:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1076 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 07 01:11:43.582493 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-342775a7-d555-4541-97e5-ebb3347afcde tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:43.583113 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-342775a7-d555-4541-97e5-ebb3347afcde tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:43.616328 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-342775a7-d555-4541-97e5-ebb3347afcde tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:43.617769 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-342775a7-d555-4541-97e5-ebb3347afcde tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:43.624961 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-342775a7-d555-4541-97e5-ebb3347afcde tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:43.625993 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-342775a7-d555-4541-97e5-ebb3347afcde tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:43.626807 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-342775a7-d555-4541-97e5-ebb3347afcde tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:43.628140 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-342775a7-d555-4541-97e5-ebb3347afcde tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:43.640891 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=68 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:44.387979 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c30bfd10-78e0-48c9-a67f-1fb18c65cd7f tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:44.437487 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c30bfd10-78e0-48c9-a67f-1fb18c65cd7f tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.944962 Aug 07 01:11:44.452983 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 204/449] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Aug 7 01:11:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:11:44.463398 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-471da7ce-90a9-4111-9afa-381aa88c9926 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:11:44.471404 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-471da7ce-90a9-4111-9afa-381aa88c9926 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:44.492852 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-471da7ce-90a9-4111-9afa-381aa88c9926 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:44.495547 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-471da7ce-90a9-4111-9afa-381aa88c9926 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:44.496437 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-471da7ce-90a9-4111-9afa-381aa88c9926 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:44.497760 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-471da7ce-90a9-4111-9afa-381aa88c9926 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:44.499758 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-471da7ce-90a9-4111-9afa-381aa88c9926 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:44.500903 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-471da7ce-90a9-4111-9afa-381aa88c9926 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:44.725661 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-471da7ce-90a9-4111-9afa-381aa88c9926 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:11:44.729078 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-471da7ce-90a9-4111-9afa-381aa88c9926 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:11:44.730167 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-471da7ce-90a9-4111-9afa-381aa88c9926 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:11:44.731428 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-471da7ce-90a9-4111-9afa-381aa88c9926 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:11:44.732546 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-471da7ce-90a9-4111-9afa-381aa88c9926 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:11:45.076247 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-342775a7-d555-4541-97e5-ebb3347afcde tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:45.097440 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-342775a7-d555-4541-97e5-ebb3347afcde tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0" status: 200 len: 1503 microversion: 2.1 time: 1.518571 Aug 07 01:11:45.102678 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 246/450] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:43 2022] GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 => generated 1503 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:45.119357 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1d7f3052-2c5a-4476-abcd-d578fda13faa tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:45.121378 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1d7f3052-2c5a-4476-abcd-d578fda13faa tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 2125f4ff-9031-486f-8b5f-85082bf81588] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:45.133334 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d7f3052-2c5a-4476-abcd-d578fda13faa tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:45.134192 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d7f3052-2c5a-4476-abcd-d578fda13faa tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:45.134860 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d7f3052-2c5a-4476-abcd-d578fda13faa tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:45.135856 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d7f3052-2c5a-4476-abcd-d578fda13faa tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:45.136589 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d7f3052-2c5a-4476-abcd-d578fda13faa tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:45.137306 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d7f3052-2c5a-4476-abcd-d578fda13faa tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:45.165797 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-471da7ce-90a9-4111-9afa-381aa88c9926 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:45.216758 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-471da7ce-90a9-4111-9afa-381aa88c9926 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:45.234242 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-471da7ce-90a9-4111-9afa-381aa88c9926 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:45.236264 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-471da7ce-90a9-4111-9afa-381aa88c9926 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:45.241293 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-471da7ce-90a9-4111-9afa-381aa88c9926 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:45.249776 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-471da7ce-90a9-4111-9afa-381aa88c9926 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:45.250917 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-471da7ce-90a9-4111-9afa-381aa88c9926 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:45.595210 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-471da7ce-90a9-4111-9afa-381aa88c9926 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:45.600820 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1d7f3052-2c5a-4476-abcd-d578fda13faa tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:45.612814 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1d7f3052-2c5a-4476-abcd-d578fda13faa tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588" status: 200 len: 1276 microversion: 2.1 time: 0.505101 Aug 07 01:11:45.614694 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 247/451] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:45 2022] GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588 => generated 1276 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:45.640460 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-df71e45e-c5ec-4051-a3b9-2640eec2212b tempest-KeyPairsV210TestJSON-862818296 tempest-KeyPairsV210TestJSON-862818296-project-admin] Action: 'create', calling method: .version_select at 0x7f9e24c6c0d0>, body: {"keypair": {"name": "tempest-keypair-1746590606", "type": "ssh", "user_id": "2e66778890e8464f9912b5b120ba94a3", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFe9rqqya7gYx/JYlPPZkz2Py5yoJQELb/EibjrAxDogIyVjmJrN/ecbH1ylFFY+d8tkeWipDuFVLWXWRMpC3AMrIKGBCQhUs1NwmKdxkGWEfjLU6Uj4YFbLzGT5hEa+Qw=="}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:11:45.643184 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-471da7ce-90a9-4111-9afa-381aa88c9926 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:45.693515 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-471da7ce-90a9-4111-9afa-381aa88c9926 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:45.730516 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-471da7ce-90a9-4111-9afa-381aa88c9926 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] 10.222.0.39 "POST /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698/action" status: 202 len: 1494 microversion: 2.75 time: 1.266066 Aug 07 01:11:45.731296 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 205/452] 10.222.0.39 () {62 vars in 1319 bytes} [Sun Aug 7 01:11:44 2022] POST /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698/action => generated 1494 bytes in 1277 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 07 01:11:45.754787 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-df71e45e-c5ec-4051-a3b9-2640eec2212b tempest-KeyPairsV210TestJSON-862818296 tempest-KeyPairsV210TestJSON-862818296-project-admin] Getting quotas for project d914ab3076e844818aadc1a1314ec043. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:11:45.765055 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-df71e45e-c5ec-4051-a3b9-2640eec2212b tempest-KeyPairsV210TestJSON-862818296 tempest-KeyPairsV210TestJSON-862818296-project-admin] Getting quotas for user 7773115ae92a4b7b9bee60a87457c572 and project d914ab3076e844818aadc1a1314ec043. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:11:45.858355 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-df71e45e-c5ec-4051-a3b9-2640eec2212b tempest-KeyPairsV210TestJSON-862818296 tempest-KeyPairsV210TestJSON-862818296-project-admin] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.241461 Aug 07 01:11:45.860282 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 248/453] 10.222.0.39 () {62 vars in 1200 bytes} [Sun Aug 7 01:11:45 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 244 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 07 01:11:45.871259 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d3186856-a177-4c29-88c7-99fef9cdd5fc tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:45.873215 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d3186856-a177-4c29-88c7-99fef9cdd5fc tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: 5777df19-f308-48d1-8f53-fdbf073a4ef2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:45.886445 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3186856-a177-4c29-88c7-99fef9cdd5fc tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:45.889725 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3186856-a177-4c29-88c7-99fef9cdd5fc tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:45.891089 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3186856-a177-4c29-88c7-99fef9cdd5fc tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:45.893116 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3186856-a177-4c29-88c7-99fef9cdd5fc tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:45.894429 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3186856-a177-4c29-88c7-99fef9cdd5fc tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:45.895814 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3186856-a177-4c29-88c7-99fef9cdd5fc tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:45.896882 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b5781d47-8740-4390-938d-70b12bfaf476 tempest-InstanceUsageAuditLogNegativeTestJSON-705251316 tempest-InstanceUsageAuditLogNegativeTestJSON-705251316-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:45.898259 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:11:45.898259 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:11:45.899353 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-b5781d47-8740-4390-938d-70b12bfaf476 tempest-InstanceUsageAuditLogNegativeTestJSON-705251316 tempest-InstanceUsageAuditLogNegativeTestJSON-705251316-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 07 01:11:45.914326 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b5781d47-8740-4390-938d-70b12bfaf476 tempest-InstanceUsageAuditLogNegativeTestJSON-705251316 tempest-InstanceUsageAuditLogNegativeTestJSON-705251316-project-admin] Request method failure captured: Aug 07 01:11:45.914326 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 07 01:11:45.914326 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:11:45.914326 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:11:45.914326 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:11:45.914326 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:11:45.914326 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:11:45.914326 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:11:45.914326 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:11:45.914326 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:11:45.914326 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xFP2MH8kGmm6632Dga5WMMJueEGnP-tQpEYPDeR1xLx4W5mHnl-JcZ3ltJt-B72SoWeEA45RcIGuBZaJLZikyU5WhDXH5-h5lPxtMvCpjcqL1QKVLamthEfc3ZHbRY1h-ywLo7Pj6U6hktcHzajW43a4V4mBQt8cBMP2Hgin_VD4uk Aug 07 01:11:45.914326 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:11:45.914326 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:11:45.914326 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:11:45.914326 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:11:45.914326 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:11:45.914326 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:11:45.914326 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: edee02f16b3146ba97237a4ebf1a9622 Aug 07 01:11:45.914326 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-705251316 Aug 07 01:11:45.914326 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,admin,member Aug 07 01:11:45.914326 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,admin,member Aug 07 01:11:45.917243 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/edee02f16b3146ba97237a4ebf1a9622"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_edee02f16b3146ba97237a4ebf1a9622", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/edee02f16b3146ba97237a4ebf1a9622"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/edee02f16b3146ba97237a4ebf1a9622"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:11:45.917243 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-705251316 Aug 07 01:11:45.917243 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: edee02f16b3146ba97237a4ebf1a9622 Aug 07 01:11:45.917243 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-705251316 Aug 07 01:11:45.917243 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-705251316-project-admin Aug 07 01:11:45.917243 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:11:45.917243 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:11:45.917243 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 8847c18cb4a0446c9fa97bef15014fdb Aug 07 01:11:45.917243 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-705251316-project-admin Aug 07 01:11:45.917243 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:11:45.917243 n-d-master-1 devstack@n-api.service[119517]: exception: Invalid timestamp for date invalid_time Aug 07 01:11:45.920985 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'invalid_time'} Aug 07 01:11:45.920985 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:11:45.920985 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:45.920985 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 07 01:11:45.920985 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 07 01:11:45.920985 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 07 01:11:45.920985 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 07 01:11:45.920985 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 07 01:11:45.920985 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 07 01:11:45.920985 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 07 01:11:45.920985 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:11:45.920985 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:11:45.920985 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:11:45.920985 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:45.920985 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:11:45.920985 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:11:45.920985 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:11:45.920985 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:11:45.920985 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:11:45.920985 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:11:45.925502 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 07 01:11:45.925502 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 07 01:11:45.925502 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 07 01:11:45.925502 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:11:45.925502 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:11:45.925502 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:11:45.925502 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:45.925502 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:11:45.925502 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:11:45.925502 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:11:45.925502 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:11:45.925502 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 07 01:11:45.925502 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:11:45.925502 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b5781d47-8740-4390-938d-70b12bfaf476 tempest-InstanceUsageAuditLogNegativeTestJSON-705251316 tempest-InstanceUsageAuditLogNegativeTestJSON-705251316-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:11:45.934545 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b5781d47-8740-4390-938d-70b12bfaf476 tempest-InstanceUsageAuditLogNegativeTestJSON-705251316 tempest-InstanceUsageAuditLogNegativeTestJSON-705251316-project-admin] 10.222.0.39 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.188956 Aug 07 01:11:45.950539 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 206/454] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:11:45 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 218 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:46.350102 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e92b57ab-3644-47d8-b0a9-e3ed4892cd95 tempest-ServersWithSpecificFlavorTestJSON-1728416995 tempest-ServersWithSpecificFlavorTestJSON-1728416995-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-24111903", "id": 1028827470, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:11:46.370961 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:11:46.370961 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:11:46.422328 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e92b57ab-3644-47d8-b0a9-e3ed4892cd95 tempest-ServersWithSpecificFlavorTestJSON-1728416995 tempest-ServersWithSpecificFlavorTestJSON-1728416995-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 423 microversion: 2.1 time: 0.462661 Aug 07 01:11:46.425233 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 207/455] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:11:45 2022] POST /compute/v2.1/flavors => generated 423 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:11:46.445603 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1e87f1a8-8550-46ef-a648-2ab1b4fc9105 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:46.447092 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1e87f1a8-8550-46ef-a648-2ab1b4fc9105 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:46.459278 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e87f1a8-8550-46ef-a648-2ab1b4fc9105 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:46.460587 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e87f1a8-8550-46ef-a648-2ab1b4fc9105 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:46.461708 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e87f1a8-8550-46ef-a648-2ab1b4fc9105 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:46.463276 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e87f1a8-8550-46ef-a648-2ab1b4fc9105 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:46.464444 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e87f1a8-8550-46ef-a648-2ab1b4fc9105 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:46.465422 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e87f1a8-8550-46ef-a648-2ab1b4fc9105 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:46.670858 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d3186856-a177-4c29-88c7-99fef9cdd5fc tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dce42ff994d81b1ad6d6c05356c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6d319a0452448485aa65b7cf1c5b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:46.699054 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d3186856-a177-4c29-88c7-99fef9cdd5fc tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2" status: 200 len: 1366 microversion: 2.1 time: 0.835252 Aug 07 01:11:46.711117 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 249/456] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:45 2022] GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2 => generated 1366 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:46.743527 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6a103dba-c982-4740-98cf-da627801cc20 tempest-KeyPairsV210TestJSON-862818296 tempest-KeyPairsV210TestJSON-862818296-project-admin] Calling method '.version_select at 0x7f9e24ca7ca0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:46.773177 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6a103dba-c982-4740-98cf-da627801cc20 tempest-KeyPairsV210TestJSON-862818296 tempest-KeyPairsV210TestJSON-862818296-project-admin] 10.222.0.39 "GET /compute/v2.1/os-keypairs/tempest-keypair-285157577?user_id=2e66778890e8464f9912b5b120ba94a3" status: 200 len: 511 microversion: 2.10 time: 0.068634 Aug 07 01:11:46.777248 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 250/457] 10.222.0.39 () {60 vars in 1337 bytes} [Sun Aug 7 01:11:46 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-285157577?user_id=2e66778890e8464f9912b5b120ba94a3 => generated 511 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:11:46.817542 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1e87f1a8-8550-46ef-a648-2ab1b4fc9105 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:46.842587 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:46.856789 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1e87f1a8-8550-46ef-a648-2ab1b4fc9105 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:46.862429 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1e87f1a8-8550-46ef-a648-2ab1b4fc9105 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:46.902311 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1e87f1a8-8550-46ef-a648-2ab1b4fc9105 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1446 microversion: 2.75 time: 0.470300 Aug 07 01:11:46.913531 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 208/458] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:11:46 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1446 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:11:46.930994 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c25677bd-fd24-4cf7-a468-3ed869b13f67 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:46.932624 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c25677bd-fd24-4cf7-a468-3ed869b13f67 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:46.956823 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c25677bd-fd24-4cf7-a468-3ed869b13f67 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:46.958891 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c25677bd-fd24-4cf7-a468-3ed869b13f67 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:46.960355 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c25677bd-fd24-4cf7-a468-3ed869b13f67 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:46.974849 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c25677bd-fd24-4cf7-a468-3ed869b13f67 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:46.976604 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c25677bd-fd24-4cf7-a468-3ed869b13f67 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:46.978062 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c25677bd-fd24-4cf7-a468-3ed869b13f67 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:47.169299 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9aaee531-eecd-4cac-88f5-dab837270b15 tempest-InstanceUsageAuditLogNegativeTestJSON-1437931704 tempest-InstanceUsageAuditLogNegativeTestJSON-1437931704-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:47.174267 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:11:47.174267 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:11:47.179267 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9aaee531-eecd-4cac-88f5-dab837270b15 tempest-InstanceUsageAuditLogNegativeTestJSON-1437931704 tempest-InstanceUsageAuditLogNegativeTestJSON-1437931704-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '0f52af6ab5924b1d8834a49af0c9b7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5583649e1e4c6188e30de4b17fee1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:47.189218 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9aaee531-eecd-4cac-88f5-dab837270b15 tempest-InstanceUsageAuditLogNegativeTestJSON-1437931704 tempest-InstanceUsageAuditLogNegativeTestJSON-1437931704-project] Request method failure captured: Aug 07 01:11:47.189218 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 07 01:11:47.189218 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:11:47.189218 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:11:47.189218 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:11:47.189218 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:11:47.189218 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:11:47.189218 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:11:47.189218 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:11:47.189218 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:11:47.189218 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xFN1IOGbHz9acPrpBYf4TVYvQo-ELfPCaNbWFiWUTUE8Wj_MvwrEZsJJTjuGHRMq8XlsJGsG-PFNXHcPesG8ymtO01ZS3m4pCYcd-a6p75LGpQ1MSlf-GxjXfW7czHfL1vl5TqNqBTY68S_xG0Jsg6g1V3IrVHnDkk9DIGiPwNtEJ4 Aug 07 01:11:47.189218 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:11:47.189218 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:11:47.189218 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:11:47.189218 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:11:47.189218 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:11:47.189218 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:11:47.189218 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 1e5583649e1e4c6188e30de4b17fee1f Aug 07 01:11:47.189218 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1437931704 Aug 07 01:11:47.189218 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:11:47.189218 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:11:47.192794 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1e5583649e1e4c6188e30de4b17fee1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1e5583649e1e4c6188e30de4b17fee1f", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1e5583649e1e4c6188e30de4b17fee1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1e5583649e1e4c6188e30de4b17fee1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:11:47.192794 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1437931704 Aug 07 01:11:47.192794 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 1e5583649e1e4c6188e30de4b17fee1f Aug 07 01:11:47.192794 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1437931704 Aug 07 01:11:47.192794 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1437931704-project Aug 07 01:11:47.192794 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:11:47.192794 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:11:47.192794 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 0f52af6ab5924b1d8834a49af0c9b7d8 Aug 07 01:11:47.192794 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1437931704-project Aug 07 01:11:47.192794 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:11:47.194115 n-d-master-1 devstack@n-api.service[119516]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 07 01:11:47.194115 n-d-master-1 devstack@n-api.service[119516]: action_args: {} Aug 07 01:11:47.194115 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:11:47.194115 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:47.194115 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:11:47.194115 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:11:47.194115 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:11:47.194115 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:11:47.194115 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:11:47.194115 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:11:47.194115 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 07 01:11:47.194115 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 07 01:11:47.194115 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 07 01:11:47.194115 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 07 01:11:47.194115 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 07 01:11:47.194115 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 07 01:11:47.194115 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:11:47.194115 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:11:47.194115 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:11:47.194115 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:11:47.196924 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 07 01:11:47.196924 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 07 01:11:47.196924 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 07 01:11:47.196924 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 07 01:11:47.196924 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 07 01:11:47.196924 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 07 01:11:47.196924 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 07 01:11:47.196924 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:47.196924 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:11:47.196924 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:47.196924 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:47.196924 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:11:47.196924 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:11:47.196924 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 07 01:11:47.196924 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 07 01:11:47.196924 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 07 01:11:47.196924 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:47.201126 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9aaee531-eecd-4cac-88f5-dab837270b15 tempest-InstanceUsageAuditLogNegativeTestJSON-1437931704 tempest-InstanceUsageAuditLogNegativeTestJSON-1437931704-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:11:47.201126 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9aaee531-eecd-4cac-88f5-dab837270b15 tempest-InstanceUsageAuditLogNegativeTestJSON-1437931704 tempest-InstanceUsageAuditLogNegativeTestJSON-1437931704-project] 10.222.0.39 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.416889 Aug 07 01:11:47.201126 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 251/459] 10.222.0.39 () {58 vars in 1185 bytes} [Sun Aug 7 01:11:46 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 419 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:11:47.225571 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-03f16e51-8738-4a91-883d-b0d6c8a3d591 tempest-ServersWithSpecificFlavorTestJSON-1728416995 tempest-ServersWithSpecificFlavorTestJSON-1728416995-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:47.239851 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-03f16e51-8738-4a91-883d-b0d6c8a3d591 tempest-ServersWithSpecificFlavorTestJSON-1728416995 tempest-ServersWithSpecificFlavorTestJSON-1728416995-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.036491 Aug 07 01:11:47.247477 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 252/460] 10.222.0.39 () {58 vars in 1182 bytes} [Sun Aug 7 01:11:47 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:11:47.249784 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a86af0e5-6a4a-4506-9e6b-12ae4c9cdbfe tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:47.252140 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a86af0e5-6a4a-4506-9e6b-12ae4c9cdbfe tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 2125f4ff-9031-486f-8b5f-85082bf81588] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:47.273472 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a86af0e5-6a4a-4506-9e6b-12ae4c9cdbfe tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:47.274439 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a86af0e5-6a4a-4506-9e6b-12ae4c9cdbfe tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:47.279810 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a86af0e5-6a4a-4506-9e6b-12ae4c9cdbfe tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:47.281817 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a86af0e5-6a4a-4506-9e6b-12ae4c9cdbfe tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:47.283133 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a86af0e5-6a4a-4506-9e6b-12ae4c9cdbfe tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:47.284399 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a86af0e5-6a4a-4506-9e6b-12ae4c9cdbfe tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:47.429323 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a86af0e5-6a4a-4506-9e6b-12ae4c9cdbfe tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:47.441405 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a86af0e5-6a4a-4506-9e6b-12ae4c9cdbfe tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588" status: 200 len: 1282 microversion: 2.1 time: 0.198895 Aug 07 01:11:47.457841 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 253/461] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:47 2022] GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588 => generated 1282 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:47.481853 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-60feb381-cbb7-4897-8ec0-3546fcaf1789 tempest-KeyPairsV210TestJSON-862818296 tempest-KeyPairsV210TestJSON-862818296-project-admin] Action: 'create', calling method: .version_select at 0x7f9e24cbb5e0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1576152603", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHXBakH/DzkdmiO9TmFma84RLubeL8MZZW2rWRZpJBWMs6wCsPFW1sBBBbxs9lqzgUUV5o9McDG4f8bzR3NomYJT+Pm19Enqk6lHwXVG+8rngixKzlpB/3rSLlJKXnPsw=="}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:11:47.494991 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:47.511976 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-60feb381-cbb7-4897-8ec0-3546fcaf1789 tempest-KeyPairsV210TestJSON-862818296 tempest-KeyPairsV210TestJSON-862818296-project-admin] Getting quotas for project d914ab3076e844818aadc1a1314ec043. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:11:47.519604 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-60feb381-cbb7-4897-8ec0-3546fcaf1789 tempest-KeyPairsV210TestJSON-862818296 tempest-KeyPairsV210TestJSON-862818296-project-admin] Getting quotas for user 7773115ae92a4b7b9bee60a87457c572 and project d914ab3076e844818aadc1a1314ec043. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:11:47.566908 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-60feb381-cbb7-4897-8ec0-3546fcaf1789 tempest-KeyPairsV210TestJSON-862818296 tempest-KeyPairsV210TestJSON-862818296-project-admin] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.090349 Aug 07 01:11:47.569554 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 254/462] 10.222.0.39 () {62 vars in 1200 bytes} [Sun Aug 7 01:11:47 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 111 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 07 01:11:47.582428 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bd161221-6a3e-40af-b809-6489ee9a4991 tempest-InstanceUsageAuditLogNegativeTestJSON-1437931704 tempest-InstanceUsageAuditLogNegativeTestJSON-1437931704-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:47.586442 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:11:47.586442 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:11:47.589338 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bd161221-6a3e-40af-b809-6489ee9a4991 tempest-InstanceUsageAuditLogNegativeTestJSON-1437931704 tempest-InstanceUsageAuditLogNegativeTestJSON-1437931704-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '0f52af6ab5924b1d8834a49af0c9b7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5583649e1e4c6188e30de4b17fee1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:47.596867 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bd161221-6a3e-40af-b809-6489ee9a4991 tempest-InstanceUsageAuditLogNegativeTestJSON-1437931704 tempest-InstanceUsageAuditLogNegativeTestJSON-1437931704-project] Request method failure captured: Aug 07 01:11:47.596867 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-07%2001:11:47 HTTP/1.1 Aug 07 01:11:47.596867 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:11:47.596867 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:11:47.596867 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:11:47.596867 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:11:47.596867 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:11:47.596867 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:11:47.596867 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:11:47.596867 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:11:47.596867 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xFN1IOGbHz9acPrpBYf4TVYvQo-ELfPCaNbWFiWUTUE8Wj_MvwrEZsJJTjuGHRMq8XlsJGsG-PFNXHcPesG8ymtO01ZS3m4pCYcd-a6p75LGpQ1MSlf-GxjXfW7czHfL1vl5TqNqBTY68S_xG0Jsg6g1V3IrVHnDkk9DIGiPwNtEJ4 Aug 07 01:11:47.596867 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:11:47.596867 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:11:47.596867 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:11:47.596867 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:11:47.596867 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:11:47.596867 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:11:47.596867 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 1e5583649e1e4c6188e30de4b17fee1f Aug 07 01:11:47.596867 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1437931704 Aug 07 01:11:47.596867 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:11:47.596867 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:11:47.599445 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1e5583649e1e4c6188e30de4b17fee1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1e5583649e1e4c6188e30de4b17fee1f", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1e5583649e1e4c6188e30de4b17fee1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1e5583649e1e4c6188e30de4b17fee1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:11:47.599445 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1437931704 Aug 07 01:11:47.599445 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 1e5583649e1e4c6188e30de4b17fee1f Aug 07 01:11:47.599445 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1437931704 Aug 07 01:11:47.599445 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1437931704-project Aug 07 01:11:47.599445 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:11:47.599445 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:11:47.599445 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 0f52af6ab5924b1d8834a49af0c9b7d8 Aug 07 01:11:47.599445 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1437931704-project Aug 07 01:11:47.599445 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:11:47.600307 n-d-master-1 devstack@n-api.service[119516]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 07 01:11:47.600307 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '2022-08-07 01:11:47'} Aug 07 01:11:47.600307 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:11:47.600307 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:47.600307 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:11:47.600307 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:11:47.600307 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:11:47.600307 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:11:47.600307 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:11:47.600307 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:11:47.600307 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 07 01:11:47.600307 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 07 01:11:47.600307 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 07 01:11:47.600307 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 07 01:11:47.600307 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 07 01:11:47.600307 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 07 01:11:47.600307 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:11:47.600307 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:11:47.600307 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:11:47.600307 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:11:47.602120 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 07 01:11:47.602120 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 07 01:11:47.602120 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 07 01:11:47.602120 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 07 01:11:47.602120 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 07 01:11:47.602120 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 07 01:11:47.602120 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 07 01:11:47.602120 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:47.602120 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:11:47.602120 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:47.602120 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:11:47.602120 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:11:47.602120 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:11:47.602120 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 07 01:11:47.602120 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 07 01:11:47.602120 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 07 01:11:47.602120 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:11:47.603386 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bd161221-6a3e-40af-b809-6489ee9a4991 tempest-InstanceUsageAuditLogNegativeTestJSON-1437931704 tempest-InstanceUsageAuditLogNegativeTestJSON-1437931704-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:11:47.603386 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bd161221-6a3e-40af-b809-6489ee9a4991 tempest-InstanceUsageAuditLogNegativeTestJSON-1437931704 tempest-InstanceUsageAuditLogNegativeTestJSON-1437931704-project] 10.222.0.39 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-07 01:11:47" status: 403 len: 128 microversion: 2.1 time: 0.030296 Aug 07 01:11:47.609727 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 255/463] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Aug 7 01:11:47 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-07%2001%3A11%3A47 => generated 128 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:11:47.639338 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8044cb40-3d2c-45d0-9d28-ebe6a27055e1 tempest-ServersWithSpecificFlavorTestJSON-1728416995 tempest-ServersWithSpecificFlavorTestJSON-1728416995-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1888132943", "id": 1498852823, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:11:47.651852 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:11:47.651852 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:11:47.719495 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8044cb40-3d2c-45d0-9d28-ebe6a27055e1 tempest-ServersWithSpecificFlavorTestJSON-1728416995 tempest-ServersWithSpecificFlavorTestJSON-1728416995-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.107322 Aug 07 01:11:47.721183 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 256/464] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:11:47 2022] POST /compute/v2.1/flavors => generated 425 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:11:47.742313 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-72ec140d-61a8-4c2e-999a-8d2c6313f0d2 tempest-KeyPairsV210TestJSON-862818296 tempest-KeyPairsV210TestJSON-862818296-project-admin] Calling method '.version_select at 0x7f9e24c6cb80>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:47.752483 n-d-master-1 devstack@n-api.service[119516]: WARNING oslo_db.sqlalchemy.utils [None req-72ec140d-61a8-4c2e-999a-8d2c6313f0d2 tempest-KeyPairsV210TestJSON-862818296 tempest-KeyPairsV210TestJSON-862818296-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 07 01:11:47.765996 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-72ec140d-61a8-4c2e-999a-8d2c6313f0d2 tempest-KeyPairsV210TestJSON-862818296 tempest-KeyPairsV210TestJSON-862818296-project-admin] 10.222.0.39 "GET /compute/v2.1/os-keypairs?user_id=2e66778890e8464f9912b5b120ba94a3" status: 200 len: 725 microversion: 2.10 time: 0.042878 Aug 07 01:11:47.767638 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 257/465] 10.222.0.39 () {60 vars in 1259 bytes} [Sun Aug 7 01:11:47 2022] GET /compute/v2.1/os-keypairs?user_id=2e66778890e8464f9912b5b120ba94a3 => generated 725 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:11:47.770523 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c25677bd-fd24-4cf7-a468-3ed869b13f67 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:47.779842 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c25677bd-fd24-4cf7-a468-3ed869b13f67 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0" status: 200 len: 1503 microversion: 2.1 time: 0.864271 Aug 07 01:11:47.782048 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5554fcaf-e15a-4f29-9cdd-dc4e5b04b27d tempest-ServersWithSpecificFlavorTestJSON-1728416995 tempest-ServersWithSpecificFlavorTestJSON-1728416995-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:47.787535 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 209/466] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:46 2022] GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 => generated 1503 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:47.798150 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9ae5d3ff-0362-41ab-bb83-dad900302199 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:47.802083 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5554fcaf-e15a-4f29-9cdd-dc4e5b04b27d tempest-ServersWithSpecificFlavorTestJSON-1728416995 tempest-ServersWithSpecificFlavorTestJSON-1728416995-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.030490 Aug 07 01:11:47.803345 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9ae5d3ff-0362-41ab-bb83-dad900302199 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: 5777df19-f308-48d1-8f53-fdbf073a4ef2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:47.803878 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 258/467] 10.222.0.39 () {58 vars in 1182 bytes} [Sun Aug 7 01:11:47 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:11:47.814133 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c2a1ab39-1416-4bea-8a20-b621933b56b7 tempest-KeyPairsV210TestJSON-862818296 tempest-KeyPairsV210TestJSON-862818296-project-admin] Calling method '.version_select at 0x7f9e24cbb4c0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:47.816528 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ae5d3ff-0362-41ab-bb83-dad900302199 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:47.817266 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ae5d3ff-0362-41ab-bb83-dad900302199 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:47.817701 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ae5d3ff-0362-41ab-bb83-dad900302199 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:47.819400 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ae5d3ff-0362-41ab-bb83-dad900302199 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:47.826067 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ae5d3ff-0362-41ab-bb83-dad900302199 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:47.826749 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ae5d3ff-0362-41ab-bb83-dad900302199 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:47.874894 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c2a1ab39-1416-4bea-8a20-b621933b56b7 tempest-KeyPairsV210TestJSON-862818296 tempest-KeyPairsV210TestJSON-862818296-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1576152603" status: 204 len: 0 microversion: 2.10 time: 0.068751 Aug 07 01:11:47.877060 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 259/468] 10.222.0.39 () {60 vars in 1325 bytes} [Sun Aug 7 01:11:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1576152603 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 01:11:47.904286 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d2be56e4-081e-438b-9e9c-300af545ed3f tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Action: 'create', calling method: .version_select at 0x7f9e24cbb700>, body: {"keypair": {"name": "tempest-keypair-151177983", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoi/eeWxcvyn4y80TQLLcnHMNTY7aXqS+TjWC7Vdkym/yae9ASktIfF+i+9IUbFe77CTHYEWid3l5AiUlmfeiDNEwSika1mPMlsjI7Dq5gN8l+8UVqKspsEn4yaFUwcNg=="}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:11:47.968171 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-d2be56e4-081e-438b-9e9c-300af545ed3f tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Getting quotas for project 6a06211ba44e4f6d88f9095969001aab. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:11:47.979927 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-d2be56e4-081e-438b-9e9c-300af545ed3f tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Getting quotas for user 96d08a2479f847b4b06d6690f1aedb18 and project 6a06211ba44e4f6d88f9095969001aab. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:11:48.043483 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d2be56e4-081e-438b-9e9c-300af545ed3f tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.161643 Aug 07 01:11:48.044514 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 260/469] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:11:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:11:48.073596 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-000f45e4-f9b1-4fc8-80ce-52a71e3c6989 tempest-KeyPairsV210TestJSON-862818296 tempest-KeyPairsV210TestJSON-862818296-project-admin] Calling method '.version_select at 0x7f9e24c6c040>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:48.138423 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-000f45e4-f9b1-4fc8-80ce-52a71e3c6989 tempest-KeyPairsV210TestJSON-862818296 tempest-KeyPairsV210TestJSON-862818296-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1746590606?user_id=2e66778890e8464f9912b5b120ba94a3" status: 204 len: 0 microversion: 2.10 time: 0.087100 Aug 07 01:11:48.139794 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 261/470] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Aug 7 01:11:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1746590606?user_id=2e66778890e8464f9912b5b120ba94a3 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 01:11:48.148507 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8cac59a2-b1e6-4e50-947e-7589e38cd23b tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:48.149706 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8cac59a2-b1e6-4e50-947e-7589e38cd23b tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:48.170946 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8cac59a2-b1e6-4e50-947e-7589e38cd23b tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:48.172098 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8cac59a2-b1e6-4e50-947e-7589e38cd23b tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:48.172865 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8cac59a2-b1e6-4e50-947e-7589e38cd23b tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:48.173932 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8cac59a2-b1e6-4e50-947e-7589e38cd23b tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:48.174619 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8cac59a2-b1e6-4e50-947e-7589e38cd23b tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:48.178094 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8cac59a2-b1e6-4e50-947e-7589e38cd23b tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:48.532139 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8cac59a2-b1e6-4e50-947e-7589e38cd23b tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:48.572568 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8cac59a2-b1e6-4e50-947e-7589e38cd23b tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:48.587611 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8cac59a2-b1e6-4e50-947e-7589e38cd23b tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:48.605615 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9ae5d3ff-0362-41ab-bb83-dad900302199 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dce42ff994d81b1ad6d6c05356c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6d319a0452448485aa65b7cf1c5b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:48.619093 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9ae5d3ff-0362-41ab-bb83-dad900302199 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2" status: 200 len: 1366 microversion: 2.1 time: 0.830193 Aug 07 01:11:48.628235 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8cac59a2-b1e6-4e50-947e-7589e38cd23b tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1446 microversion: 2.75 time: 0.486976 Aug 07 01:11:48.629335 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 210/471] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:47 2022] GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2 => generated 1366 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:48.630353 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 262/472] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:11:48 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1446 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:11:48.645871 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-28295354-ea98-4fc2-8012-09bcc44de148 req-dfd21b25-8f58-4ae5-b601-475f4aa61b90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a06b411-f5fe-46fa-9e79-d208fd6dcbf0", "name": "network-vif-unplugged", "status": "completed", "tag": "d903aed3-3bb4-4c2d-bd4a-d9b615524a34"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:11:48.650391 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9919a2ec-c632-4fb7-8480-df0976ff3315 tempest-KeyPairsV210TestJSON-862818296 tempest-KeyPairsV210TestJSON-862818296-project-admin] Calling method '.version_select at 0x7f9e24c66430>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:48.683190 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-28295354-ea98-4fc2-8012-09bcc44de148 req-dfd21b25-8f58-4ae5-b601-475f4aa61b90 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:48.690855 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-28295354-ea98-4fc2-8012-09bcc44de148 req-dfd21b25-8f58-4ae5-b601-475f4aa61b90 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:48.692984 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-28295354-ea98-4fc2-8012-09bcc44de148 req-dfd21b25-8f58-4ae5-b601-475f4aa61b90 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:48.720185 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9919a2ec-c632-4fb7-8480-df0976ff3315 tempest-KeyPairsV210TestJSON-862818296 tempest-KeyPairsV210TestJSON-862818296-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-285157577?user_id=2e66778890e8464f9912b5b120ba94a3" status: 204 len: 0 microversion: 2.10 time: 0.088257 Aug 07 01:11:48.726990 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 211/473] 10.222.0.39 () {60 vars in 1340 bytes} [Sun Aug 7 01:11:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-285157577?user_id=2e66778890e8464f9912b5b120ba94a3 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 01:11:48.751095 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-28295354-ea98-4fc2-8012-09bcc44de148 req-dfd21b25-8f58-4ae5-b601-475f4aa61b90 service nova] Creating event network-vif-unplugged:d903aed3-3bb4-4c2d-bd4a-d9b615524a34 for instance 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 on n-h2-master-1 Aug 07 01:11:48.756785 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8186962b-3b71-45d6-99a0-7d6bc4a8bc66 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:48.758305 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8186962b-3b71-45d6-99a0-7d6bc4a8bc66 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 2125f4ff-9031-486f-8b5f-85082bf81588] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:48.768212 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-28295354-ea98-4fc2-8012-09bcc44de148 req-dfd21b25-8f58-4ae5-b601-475f4aa61b90 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.135156 Aug 07 01:11:48.777669 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8186962b-3b71-45d6-99a0-7d6bc4a8bc66 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:48.780536 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 263/474] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:11:48.784274 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8186962b-3b71-45d6-99a0-7d6bc4a8bc66 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:48.784927 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8186962b-3b71-45d6-99a0-7d6bc4a8bc66 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:48.786045 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8186962b-3b71-45d6-99a0-7d6bc4a8bc66 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:48.788781 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8186962b-3b71-45d6-99a0-7d6bc4a8bc66 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:48.789633 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8186962b-3b71-45d6-99a0-7d6bc4a8bc66 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:48.842448 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-99de7eba-7145-402e-9cea-c6a9d23bedbf tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:48.843801 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-99de7eba-7145-402e-9cea-c6a9d23bedbf tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:48.853526 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99de7eba-7145-402e-9cea-c6a9d23bedbf tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:48.854427 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99de7eba-7145-402e-9cea-c6a9d23bedbf tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:48.855099 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99de7eba-7145-402e-9cea-c6a9d23bedbf tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:48.856271 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99de7eba-7145-402e-9cea-c6a9d23bedbf tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:48.857204 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99de7eba-7145-402e-9cea-c6a9d23bedbf tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:48.857827 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99de7eba-7145-402e-9cea-c6a9d23bedbf tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:49.382209 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8186962b-3b71-45d6-99a0-7d6bc4a8bc66 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:49.394710 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8186962b-3b71-45d6-99a0-7d6bc4a8bc66 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588" status: 200 len: 1282 microversion: 2.1 time: 0.657935 Aug 07 01:11:49.408380 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 212/475] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:48 2022] GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588 => generated 1282 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:49.683483 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fc65ac9e-9f63-4d95-946f-ca4eab4638c3 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:49.686819 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fc65ac9e-9f63-4d95-946f-ca4eab4638c3 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: 5777df19-f308-48d1-8f53-fdbf073a4ef2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:49.754871 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-99de7eba-7145-402e-9cea-c6a9d23bedbf tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:49.759751 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fc65ac9e-9f63-4d95-946f-ca4eab4638c3 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:49.760516 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fc65ac9e-9f63-4d95-946f-ca4eab4638c3 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:49.760972 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fc65ac9e-9f63-4d95-946f-ca4eab4638c3 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:49.761865 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fc65ac9e-9f63-4d95-946f-ca4eab4638c3 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:49.762294 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fc65ac9e-9f63-4d95-946f-ca4eab4638c3 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:49.763056 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fc65ac9e-9f63-4d95-946f-ca4eab4638c3 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:49.767157 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-99de7eba-7145-402e-9cea-c6a9d23bedbf tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0" status: 200 len: 1503 microversion: 2.1 time: 0.932866 Aug 07 01:11:49.773120 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 264/476] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:48 2022] GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 => generated 1503 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:49.803638 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8422536c-fd34-4819-9626-8a5316f583ba tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:49.805283 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8422536c-fd34-4819-9626-8a5316f583ba tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:49.825220 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8422536c-fd34-4819-9626-8a5316f583ba tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:49.826176 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8422536c-fd34-4819-9626-8a5316f583ba tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:49.827498 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8422536c-fd34-4819-9626-8a5316f583ba tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:49.828673 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8422536c-fd34-4819-9626-8a5316f583ba tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:49.846257 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8422536c-fd34-4819-9626-8a5316f583ba tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:49.850519 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8422536c-fd34-4819-9626-8a5316f583ba tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:50.149763 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8422536c-fd34-4819-9626-8a5316f583ba tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:50.159115 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8422536c-fd34-4819-9626-8a5316f583ba tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:50.167611 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8422536c-fd34-4819-9626-8a5316f583ba tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:50.180637 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8422536c-fd34-4819-9626-8a5316f583ba tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1446 microversion: 2.75 time: 0.405330 Aug 07 01:11:50.184765 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 265/477] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:11:49 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1446 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:11:50.426609 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3c05ab4d-7a8b-4da9-a914-4b1eefd22314 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:50.427695 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3c05ab4d-7a8b-4da9-a914-4b1eefd22314 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 2125f4ff-9031-486f-8b5f-85082bf81588] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:50.450757 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c05ab4d-7a8b-4da9-a914-4b1eefd22314 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:50.451665 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c05ab4d-7a8b-4da9-a914-4b1eefd22314 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:50.452461 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c05ab4d-7a8b-4da9-a914-4b1eefd22314 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:50.455465 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c05ab4d-7a8b-4da9-a914-4b1eefd22314 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:50.456275 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c05ab4d-7a8b-4da9-a914-4b1eefd22314 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:50.456735 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c05ab4d-7a8b-4da9-a914-4b1eefd22314 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:50.735516 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3c05ab4d-7a8b-4da9-a914-4b1eefd22314 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:50.749829 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3c05ab4d-7a8b-4da9-a914-4b1eefd22314 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588" status: 200 len: 1324 microversion: 2.1 time: 0.330286 Aug 07 01:11:50.753322 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 266/478] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:50 2022] GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588 => generated 1324 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:50.810972 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-458791ab-192a-4644-a5e7-d11db71c5b98 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:50.817514 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-458791ab-192a-4644-a5e7-d11db71c5b98 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:50.834198 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-458791ab-192a-4644-a5e7-d11db71c5b98 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:50.835232 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-458791ab-192a-4644-a5e7-d11db71c5b98 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:50.835915 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-458791ab-192a-4644-a5e7-d11db71c5b98 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:50.836941 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-458791ab-192a-4644-a5e7-d11db71c5b98 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:50.837635 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-458791ab-192a-4644-a5e7-d11db71c5b98 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:50.838329 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-458791ab-192a-4644-a5e7-d11db71c5b98 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:51.155314 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-458791ab-192a-4644-a5e7-d11db71c5b98 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:51.195395 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-458791ab-192a-4644-a5e7-d11db71c5b98 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0" status: 200 len: 1503 microversion: 2.1 time: 0.390938 Aug 07 01:11:51.200571 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 267/479] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:50 2022] GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 => generated 1503 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:51.232783 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-aadc7e35-f3a2-411d-82b6-4c55c7ba4784 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:51.233750 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-aadc7e35-f3a2-411d-82b6-4c55c7ba4784 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:51.246725 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fc65ac9e-9f63-4d95-946f-ca4eab4638c3 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dce42ff994d81b1ad6d6c05356c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6d319a0452448485aa65b7cf1c5b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:51.259234 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aadc7e35-f3a2-411d-82b6-4c55c7ba4784 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:51.259701 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aadc7e35-f3a2-411d-82b6-4c55c7ba4784 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:51.262232 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fc65ac9e-9f63-4d95-946f-ca4eab4638c3 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2" status: 200 len: 1366 microversion: 2.1 time: 1.592020 Aug 07 01:11:51.278702 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aadc7e35-f3a2-411d-82b6-4c55c7ba4784 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:51.280514 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aadc7e35-f3a2-411d-82b6-4c55c7ba4784 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:51.285745 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aadc7e35-f3a2-411d-82b6-4c55c7ba4784 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:51.289067 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 213/480] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:49 2022] GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2 => generated 1366 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:51.290511 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aadc7e35-f3a2-411d-82b6-4c55c7ba4784 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:51.427591 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-f6eefbef-c8aa-4f29-9330-efbc4699b024 req-91d69859-6518-4182-b099-380a9e56e8d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a06b411-f5fe-46fa-9e79-d208fd6dcbf0", "tag": "d903aed3-3bb4-4c2d-bd4a-d9b615524a34"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:11:51.457663 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f6eefbef-c8aa-4f29-9330-efbc4699b024 req-91d69859-6518-4182-b099-380a9e56e8d7 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:51.458168 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f6eefbef-c8aa-4f29-9330-efbc4699b024 req-91d69859-6518-4182-b099-380a9e56e8d7 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:51.458618 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f6eefbef-c8aa-4f29-9330-efbc4699b024 req-91d69859-6518-4182-b099-380a9e56e8d7 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:51.489659 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-f6eefbef-c8aa-4f29-9330-efbc4699b024 req-91d69859-6518-4182-b099-380a9e56e8d7 service nova] Creating event network-changed:d903aed3-3bb4-4c2d-bd4a-d9b615524a34 for instance 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 on n-h2-master-1 Aug 07 01:11:51.503949 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-f6eefbef-c8aa-4f29-9330-efbc4699b024 req-91d69859-6518-4182-b099-380a9e56e8d7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081665 Aug 07 01:11:51.509489 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 214/481] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:11:51.524515 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-aadc7e35-f3a2-411d-82b6-4c55c7ba4784 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:51.544642 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-aadc7e35-f3a2-411d-82b6-4c55c7ba4784 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:51.548770 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-aadc7e35-f3a2-411d-82b6-4c55c7ba4784 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:51.571447 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-aadc7e35-f3a2-411d-82b6-4c55c7ba4784 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1446 microversion: 2.75 time: 0.344871 Aug 07 01:11:51.572329 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 268/482] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:11:51 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1446 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:11:51.786553 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f644637a-b024-45b9-8770-83c2dfacc445 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:51.787813 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f644637a-b024-45b9-8770-83c2dfacc445 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 2125f4ff-9031-486f-8b5f-85082bf81588] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:51.822788 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f644637a-b024-45b9-8770-83c2dfacc445 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:51.824368 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f644637a-b024-45b9-8770-83c2dfacc445 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:51.825731 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f644637a-b024-45b9-8770-83c2dfacc445 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:51.827814 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f644637a-b024-45b9-8770-83c2dfacc445 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:51.829210 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f644637a-b024-45b9-8770-83c2dfacc445 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:51.832231 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f644637a-b024-45b9-8770-83c2dfacc445 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:52.165332 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a3ef29c1-6558-4df7-98d1-ad54bae6445f tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1541349120", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "1498852823", "adminPass": "***", "networks": [{"uuid": "8fec5c86-3d8a-423c-b1ed-bdb1c1ca90c2"}], "security_groups": [{"name": "tempest-securitygroup--164389640"}], "key_name": "tempest-keypair-151177983", "user_data": "}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:11:52.259275 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:52.534127 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-a3ef29c1-6558-4df7-98d1-ad54bae6445f tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] validate_networks() for [('8fec5c86-3d8a-423c-b1ed-bdb1c1ca90c2', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:11:52.800845 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f644637a-b024-45b9-8770-83c2dfacc445 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:52.817557 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f644637a-b024-45b9-8770-83c2dfacc445 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588" status: 200 len: 1324 microversion: 2.1 time: 1.035600 Aug 07 01:11:52.818662 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 215/483] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:51 2022] GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588 => generated 1324 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:52.826107 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1f9d2781-1c9b-4ecd-95c7-8fd8daa0892e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:52.827190 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1f9d2781-1c9b-4ecd-95c7-8fd8daa0892e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:52.834627 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1f9d2781-1c9b-4ecd-95c7-8fd8daa0892e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:52.836029 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1f9d2781-1c9b-4ecd-95c7-8fd8daa0892e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:52.837196 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1f9d2781-1c9b-4ecd-95c7-8fd8daa0892e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:52.838929 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1f9d2781-1c9b-4ecd-95c7-8fd8daa0892e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:52.840142 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1f9d2781-1c9b-4ecd-95c7-8fd8daa0892e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:52.841320 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1f9d2781-1c9b-4ecd-95c7-8fd8daa0892e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:53.652376 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1f9d2781-1c9b-4ecd-95c7-8fd8daa0892e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:53.670260 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1f9d2781-1c9b-4ecd-95c7-8fd8daa0892e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0" status: 200 len: 1503 microversion: 2.1 time: 0.849582 Aug 07 01:11:53.689242 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 216/484] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:52 2022] GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 => generated 1503 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:53.701533 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-569294ee-aea5-45c8-b020-81fa2c7aa512 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:53.703215 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-569294ee-aea5-45c8-b020-81fa2c7aa512 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: 5777df19-f308-48d1-8f53-fdbf073a4ef2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:53.719153 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-569294ee-aea5-45c8-b020-81fa2c7aa512 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:53.719953 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-569294ee-aea5-45c8-b020-81fa2c7aa512 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:53.720673 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-569294ee-aea5-45c8-b020-81fa2c7aa512 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:53.721446 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-569294ee-aea5-45c8-b020-81fa2c7aa512 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:53.721825 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-569294ee-aea5-45c8-b020-81fa2c7aa512 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:53.722336 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-569294ee-aea5-45c8-b020-81fa2c7aa512 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:53.727626 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-a3ef29c1-6558-4df7-98d1-ad54bae6445f tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:11:53.730809 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-a3ef29c1-6558-4df7-98d1-ad54bae6445f tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:11:53.730809 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-a3ef29c1-6558-4df7-98d1-ad54bae6445f tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:11:53.730809 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-a3ef29c1-6558-4df7-98d1-ad54bae6445f tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:11:53.730809 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-a3ef29c1-6558-4df7-98d1-ad54bae6445f tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:11:53.760426 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=39 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:53.762262 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3ef29c1-6558-4df7-98d1-ad54bae6445f tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:53.763158 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3ef29c1-6558-4df7-98d1-ad54bae6445f tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:53.764003 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3ef29c1-6558-4df7-98d1-ad54bae6445f tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:53.765115 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3ef29c1-6558-4df7-98d1-ad54bae6445f tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:53.765748 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3ef29c1-6558-4df7-98d1-ad54bae6445f tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:53.766337 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3ef29c1-6558-4df7-98d1-ad54bae6445f tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:53.790276 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-a3ef29c1-6558-4df7-98d1-ad54bae6445f tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Getting quotas for project 6a06211ba44e4f6d88f9095969001aab. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:11:53.801557 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-a3ef29c1-6558-4df7-98d1-ad54bae6445f tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Getting quotas for user 96d08a2479f847b4b06d6690f1aedb18 and project 6a06211ba44e4f6d88f9095969001aab. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:11:53.822035 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a3ef29c1-6558-4df7-98d1-ad54bae6445f tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:11:53.826012 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a3ef29c1-6558-4df7-98d1-ad54bae6445f tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 7ab29f8e-4b84-4038-a60f-efc93d0358ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:11:53.940003 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a3ef29c1-6558-4df7-98d1-ad54bae6445f tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.784780 Aug 07 01:11:53.943670 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 269/485] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:11:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 1791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 07 01:11:53.953696 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-db418c00-00cc-45f9-8655-4a2038c90b5c req-0825291c-549e-4c24-842e-c71c1c2fef7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5777df19-f308-48d1-8f53-fdbf073a4ef2", "name": "network-vif-plugged", "status": "completed", "tag": "62317124-fa59-401f-9d70-b70b34f142b9"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:11:53.969775 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-db418c00-00cc-45f9-8655-4a2038c90b5c req-0825291c-549e-4c24-842e-c71c1c2fef7a service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:53.970417 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-db418c00-00cc-45f9-8655-4a2038c90b5c req-0825291c-549e-4c24-842e-c71c1c2fef7a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:53.971012 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-db418c00-00cc-45f9-8655-4a2038c90b5c req-0825291c-549e-4c24-842e-c71c1c2fef7a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:53.993135 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-db418c00-00cc-45f9-8655-4a2038c90b5c req-0825291c-549e-4c24-842e-c71c1c2fef7a service nova] Creating event network-vif-plugged:62317124-fa59-401f-9d70-b70b34f142b9 for instance 5777df19-f308-48d1-8f53-fdbf073a4ef2 on n-h1-master-1 Aug 07 01:11:54.000974 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-db418c00-00cc-45f9-8655-4a2038c90b5c req-0825291c-549e-4c24-842e-c71c1c2fef7a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055057 Aug 07 01:11:54.008086 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 270/486] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:11:54.017433 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8232a1a9-1ea0-4f7c-96f8-5a052bffd1cf tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:54.018454 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8232a1a9-1ea0-4f7c-96f8-5a052bffd1cf tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:54.030016 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8232a1a9-1ea0-4f7c-96f8-5a052bffd1cf tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:54.031116 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8232a1a9-1ea0-4f7c-96f8-5a052bffd1cf tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:54.032084 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8232a1a9-1ea0-4f7c-96f8-5a052bffd1cf tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:54.033142 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8232a1a9-1ea0-4f7c-96f8-5a052bffd1cf tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:54.034487 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8232a1a9-1ea0-4f7c-96f8-5a052bffd1cf tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:54.035671 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8232a1a9-1ea0-4f7c-96f8-5a052bffd1cf tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:54.167766 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8232a1a9-1ea0-4f7c-96f8-5a052bffd1cf tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:54.189471 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8232a1a9-1ea0-4f7c-96f8-5a052bffd1cf tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:54.192238 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8232a1a9-1ea0-4f7c-96f8-5a052bffd1cf tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:54.205727 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8232a1a9-1ea0-4f7c-96f8-5a052bffd1cf tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1446 microversion: 2.75 time: 0.195444 Aug 07 01:11:54.206320 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 271/487] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:11:54 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1446 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:11:54.218888 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-27613685-f507-4907-a525-f6318673f2f4 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:54.227324 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-27613685-f507-4907-a525-f6318673f2f4 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 2125f4ff-9031-486f-8b5f-85082bf81588] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:54.247763 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27613685-f507-4907-a525-f6318673f2f4 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:54.252933 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27613685-f507-4907-a525-f6318673f2f4 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:54.257895 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27613685-f507-4907-a525-f6318673f2f4 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:54.259774 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27613685-f507-4907-a525-f6318673f2f4 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:54.262331 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27613685-f507-4907-a525-f6318673f2f4 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:54.263462 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27613685-f507-4907-a525-f6318673f2f4 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:54.752620 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-27613685-f507-4907-a525-f6318673f2f4 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:54.788643 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-27613685-f507-4907-a525-f6318673f2f4 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588" status: 200 len: 1324 microversion: 2.1 time: 0.572695 Aug 07 01:11:54.795165 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 272/488] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:54 2022] GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588 => generated 1324 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:54.831155 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-16691827-7995-4b14-bfcc-4b39737f7dee tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:54.833734 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-16691827-7995-4b14-bfcc-4b39737f7dee tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 7ab29f8e-4b84-4038-a60f-efc93d0358ce] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:55.004231 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-16691827-7995-4b14-bfcc-4b39737f7dee tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d08a2479f847b4b06d6690f1aedb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06211ba44e4f6d88f9095969001aab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:55.018798 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-16691827-7995-4b14-bfcc-4b39737f7dee tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "GET /compute/v2.1/servers/7ab29f8e-4b84-4038-a60f-efc93d0358ce" status: 200 len: 1264 microversion: 2.1 time: 0.195733 Aug 07 01:11:55.020208 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 273/489] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:54 2022] GET /compute/v2.1/servers/7ab29f8e-4b84-4038-a60f-efc93d0358ce => generated 1264 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:55.037321 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-feb64be3-41c4-46fc-a31e-d329eaa7bd45 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:55.040051 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-feb64be3-41c4-46fc-a31e-d329eaa7bd45 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:55.051253 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-feb64be3-41c4-46fc-a31e-d329eaa7bd45 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:55.051767 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-feb64be3-41c4-46fc-a31e-d329eaa7bd45 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:55.060606 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-feb64be3-41c4-46fc-a31e-d329eaa7bd45 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:55.061514 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-feb64be3-41c4-46fc-a31e-d329eaa7bd45 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:55.062017 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-feb64be3-41c4-46fc-a31e-d329eaa7bd45 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:55.062477 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-feb64be3-41c4-46fc-a31e-d329eaa7bd45 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:55.390951 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-feb64be3-41c4-46fc-a31e-d329eaa7bd45 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:55.423087 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-feb64be3-41c4-46fc-a31e-d329eaa7bd45 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0" status: 200 len: 1503 microversion: 2.1 time: 0.400226 Aug 07 01:11:55.425300 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 274/490] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:55 2022] GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 => generated 1503 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:55.456213 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-18ecedd0-aa70-44bf-ae34-879c6943095d tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:55.462212 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-18ecedd0-aa70-44bf-ae34-879c6943095d tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:55.474594 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-18ecedd0-aa70-44bf-ae34-879c6943095d tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:55.484164 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-18ecedd0-aa70-44bf-ae34-879c6943095d tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:55.485586 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-18ecedd0-aa70-44bf-ae34-879c6943095d tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:55.496874 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-18ecedd0-aa70-44bf-ae34-879c6943095d tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:55.499811 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-18ecedd0-aa70-44bf-ae34-879c6943095d tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:55.501175 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-18ecedd0-aa70-44bf-ae34-879c6943095d tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:55.639778 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-18ecedd0-aa70-44bf-ae34-879c6943095d tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:55.653795 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-18ecedd0-aa70-44bf-ae34-879c6943095d tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:55.656268 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-18ecedd0-aa70-44bf-ae34-879c6943095d tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:55.664017 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-18ecedd0-aa70-44bf-ae34-879c6943095d tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1446 microversion: 2.75 time: 0.237115 Aug 07 01:11:55.666119 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 275/491] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:11:55 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1446 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:11:55.672814 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-a511c71e-a208-4c98-bb1e-9409b4da1b3d req-5dd09048-b249-4b57-a148-00bcb14fa991 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2125f4ff-9031-486f-8b5f-85082bf81588", "tag": "1f8f9f06-bbaf-4b4c-afb2-b98cdf738a8d"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:11:55.686841 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a511c71e-a208-4c98-bb1e-9409b4da1b3d req-5dd09048-b249-4b57-a148-00bcb14fa991 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:55.687727 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a511c71e-a208-4c98-bb1e-9409b4da1b3d req-5dd09048-b249-4b57-a148-00bcb14fa991 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:55.688556 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a511c71e-a208-4c98-bb1e-9409b4da1b3d req-5dd09048-b249-4b57-a148-00bcb14fa991 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:55.729564 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-a511c71e-a208-4c98-bb1e-9409b4da1b3d req-5dd09048-b249-4b57-a148-00bcb14fa991 service nova] Creating event network-changed:1f8f9f06-bbaf-4b4c-afb2-b98cdf738a8d for instance 2125f4ff-9031-486f-8b5f-85082bf81588 on n-h2-master-1 Aug 07 01:11:55.740515 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-a511c71e-a208-4c98-bb1e-9409b4da1b3d req-5dd09048-b249-4b57-a148-00bcb14fa991 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071786 Aug 07 01:11:55.742231 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 276/492] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:11:55.851372 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8b22ea95-7bb0-42c2-9cb4-82b414dadf1b tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:55.852743 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8b22ea95-7bb0-42c2-9cb4-82b414dadf1b tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 2125f4ff-9031-486f-8b5f-85082bf81588] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:55.875137 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b22ea95-7bb0-42c2-9cb4-82b414dadf1b tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:55.879609 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b22ea95-7bb0-42c2-9cb4-82b414dadf1b tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:55.885319 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b22ea95-7bb0-42c2-9cb4-82b414dadf1b tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:55.889815 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b22ea95-7bb0-42c2-9cb4-82b414dadf1b tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:55.898186 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b22ea95-7bb0-42c2-9cb4-82b414dadf1b tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:55.899529 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b22ea95-7bb0-42c2-9cb4-82b414dadf1b tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:56.154086 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-569294ee-aea5-45c8-b020-81fa2c7aa512 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dce42ff994d81b1ad6d6c05356c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6d319a0452448485aa65b7cf1c5b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:56.188974 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-569294ee-aea5-45c8-b020-81fa2c7aa512 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2" status: 200 len: 1366 microversion: 2.1 time: 2.495053 Aug 07 01:11:56.193859 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 217/493] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:53 2022] GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2 => generated 1366 bytes in 2504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:56.211139 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b21c8062-e302-4de4-82c7-4c420048ae79 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:56.214170 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b21c8062-e302-4de4-82c7-4c420048ae79 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 7ab29f8e-4b84-4038-a60f-efc93d0358ce] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:56.235135 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b21c8062-e302-4de4-82c7-4c420048ae79 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:56.236011 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b21c8062-e302-4de4-82c7-4c420048ae79 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:56.236777 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b21c8062-e302-4de4-82c7-4c420048ae79 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:56.238125 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b21c8062-e302-4de4-82c7-4c420048ae79 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:56.238990 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b21c8062-e302-4de4-82c7-4c420048ae79 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:56.239785 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b21c8062-e302-4de4-82c7-4c420048ae79 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:56.413629 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8b22ea95-7bb0-42c2-9cb4-82b414dadf1b tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:56.426867 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8b22ea95-7bb0-42c2-9cb4-82b414dadf1b tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588" status: 200 len: 1324 microversion: 2.1 time: 0.589346 Aug 07 01:11:56.428423 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 277/494] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:55 2022] GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588 => generated 1324 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:56.454025 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b21c8062-e302-4de4-82c7-4c420048ae79 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d08a2479f847b4b06d6690f1aedb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06211ba44e4f6d88f9095969001aab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:56.465473 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-aa3cd50c-b806-48bf-8782-912130c9f536 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:56.466323 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-aa3cd50c-b806-48bf-8782-912130c9f536 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:56.470158 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b21c8062-e302-4de4-82c7-4c420048ae79 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "GET /compute/v2.1/servers/7ab29f8e-4b84-4038-a60f-efc93d0358ce" status: 200 len: 1316 microversion: 2.1 time: 0.274469 Aug 07 01:11:56.472713 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 218/495] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:56 2022] GET /compute/v2.1/servers/7ab29f8e-4b84-4038-a60f-efc93d0358ce => generated 1316 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:56.476483 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:56.495457 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa3cd50c-b806-48bf-8782-912130c9f536 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:56.496896 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa3cd50c-b806-48bf-8782-912130c9f536 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:56.498962 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa3cd50c-b806-48bf-8782-912130c9f536 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:56.501018 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa3cd50c-b806-48bf-8782-912130c9f536 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:56.502721 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa3cd50c-b806-48bf-8782-912130c9f536 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:56.504727 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa3cd50c-b806-48bf-8782-912130c9f536 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:56.595681 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:56.711511 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8b3b6375-3b40-43d7-88a4-c2f95870cdfb tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:56.712030 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8b3b6375-3b40-43d7-88a4-c2f95870cdfb tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:56.721367 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8b3b6375-3b40-43d7-88a4-c2f95870cdfb tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:56.724695 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8b3b6375-3b40-43d7-88a4-c2f95870cdfb tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:56.729726 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8b3b6375-3b40-43d7-88a4-c2f95870cdfb tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:56.730824 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8b3b6375-3b40-43d7-88a4-c2f95870cdfb tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:56.731510 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8b3b6375-3b40-43d7-88a4-c2f95870cdfb tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:56.732290 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8b3b6375-3b40-43d7-88a4-c2f95870cdfb tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:56.945824 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8b3b6375-3b40-43d7-88a4-c2f95870cdfb tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:56.955854 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8b3b6375-3b40-43d7-88a4-c2f95870cdfb tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:56.958966 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8b3b6375-3b40-43d7-88a4-c2f95870cdfb tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:56.982181 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8b3b6375-3b40-43d7-88a4-c2f95870cdfb tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1446 microversion: 2.75 time: 0.275312 Aug 07 01:11:56.982795 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 219/496] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:11:56 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1446 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:11:57.234889 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c5018c44-5e21-42ab-9992-f384d0d14efa tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:57.238762 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c5018c44-5e21-42ab-9992-f384d0d14efa tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: 5777df19-f308-48d1-8f53-fdbf073a4ef2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:57.293148 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c5018c44-5e21-42ab-9992-f384d0d14efa tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:57.302529 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c5018c44-5e21-42ab-9992-f384d0d14efa tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:57.306274 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c5018c44-5e21-42ab-9992-f384d0d14efa tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:57.311739 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c5018c44-5e21-42ab-9992-f384d0d14efa tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:57.317885 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c5018c44-5e21-42ab-9992-f384d0d14efa tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:57.322690 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c5018c44-5e21-42ab-9992-f384d0d14efa tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:57.752357 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-aa3cd50c-b806-48bf-8782-912130c9f536 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:57.774191 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-aa3cd50c-b806-48bf-8782-912130c9f536 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0" status: 200 len: 1503 microversion: 2.1 time: 1.317361 Aug 07 01:11:57.782256 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c5018c44-5e21-42ab-9992-f384d0d14efa tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dce42ff994d81b1ad6d6c05356c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6d319a0452448485aa65b7cf1c5b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:57.788443 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 278/497] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:56 2022] GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 => generated 1503 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:57.801196 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c5018c44-5e21-42ab-9992-f384d0d14efa tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2" status: 200 len: 1366 microversion: 2.1 time: 0.579322 Aug 07 01:11:57.803752 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 220/498] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:57 2022] GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2 => generated 1366 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:57.819182 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1934c68c-4b6f-476a-8976-4b82a33f6179 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:57.820755 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1934c68c-4b6f-476a-8976-4b82a33f6179 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 2125f4ff-9031-486f-8b5f-85082bf81588] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:57.825498 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8f76a055-1c62-47f2-b685-36470ef716f6 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:57.833556 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8f76a055-1c62-47f2-b685-36470ef716f6 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 7ab29f8e-4b84-4038-a60f-efc93d0358ce] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:57.850956 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1934c68c-4b6f-476a-8976-4b82a33f6179 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:57.851956 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1934c68c-4b6f-476a-8976-4b82a33f6179 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:57.852785 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1934c68c-4b6f-476a-8976-4b82a33f6179 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:57.854116 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1934c68c-4b6f-476a-8976-4b82a33f6179 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:57.854985 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1934c68c-4b6f-476a-8976-4b82a33f6179 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:57.855739 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1934c68c-4b6f-476a-8976-4b82a33f6179 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:57.867088 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f76a055-1c62-47f2-b685-36470ef716f6 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:57.868022 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f76a055-1c62-47f2-b685-36470ef716f6 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:57.868847 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f76a055-1c62-47f2-b685-36470ef716f6 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:57.870191 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f76a055-1c62-47f2-b685-36470ef716f6 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:57.871058 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f76a055-1c62-47f2-b685-36470ef716f6 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:57.871840 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f76a055-1c62-47f2-b685-36470ef716f6 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:58.343877 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8f76a055-1c62-47f2-b685-36470ef716f6 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d08a2479f847b4b06d6690f1aedb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06211ba44e4f6d88f9095969001aab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:58.364736 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8f76a055-1c62-47f2-b685-36470ef716f6 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "GET /compute/v2.1/servers/7ab29f8e-4b84-4038-a60f-efc93d0358ce" status: 200 len: 1322 microversion: 2.1 time: 0.556753 Aug 07 01:11:58.368091 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 221/499] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:57 2022] GET /compute/v2.1/servers/7ab29f8e-4b84-4038-a60f-efc93d0358ce => generated 1322 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:58.378460 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5d927b0a-7c6c-4d8d-ace9-cdfb73f197ba tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:58.384418 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5d927b0a-7c6c-4d8d-ace9-cdfb73f197ba tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:58.402876 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d927b0a-7c6c-4d8d-ace9-cdfb73f197ba tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:58.404490 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d927b0a-7c6c-4d8d-ace9-cdfb73f197ba tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:58.408417 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d927b0a-7c6c-4d8d-ace9-cdfb73f197ba tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:58.414482 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d927b0a-7c6c-4d8d-ace9-cdfb73f197ba tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:58.417497 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d927b0a-7c6c-4d8d-ace9-cdfb73f197ba tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:58.422230 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d927b0a-7c6c-4d8d-ace9-cdfb73f197ba tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:58.452385 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1934c68c-4b6f-476a-8976-4b82a33f6179 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:58.481928 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1934c68c-4b6f-476a-8976-4b82a33f6179 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588" status: 200 len: 1324 microversion: 2.1 time: 0.672756 Aug 07 01:11:58.483402 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 279/500] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:57 2022] GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588 => generated 1324 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:58.678556 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5d927b0a-7c6c-4d8d-ace9-cdfb73f197ba tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:58.702368 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5d927b0a-7c6c-4d8d-ace9-cdfb73f197ba tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:58.705910 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5d927b0a-7c6c-4d8d-ace9-cdfb73f197ba tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:58.716583 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5d927b0a-7c6c-4d8d-ace9-cdfb73f197ba tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1446 microversion: 2.75 time: 0.346209 Aug 07 01:11:58.732503 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 222/501] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:11:58 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1446 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:11:58.835071 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-481e79c2-016b-4f14-96d5-283f9491bb8d tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:58.837472 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-481e79c2-016b-4f14-96d5-283f9491bb8d tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:58.847073 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5fb3e7e8-bf53-471f-9589-50e4d270ba3d tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:11:58.847788 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5fb3e7e8-bf53-471f-9589-50e4d270ba3d tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: 5777df19-f308-48d1-8f53-fdbf073a4ef2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:11:58.857316 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-481e79c2-016b-4f14-96d5-283f9491bb8d tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:58.857900 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-481e79c2-016b-4f14-96d5-283f9491bb8d tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:58.861381 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5fb3e7e8-bf53-471f-9589-50e4d270ba3d tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:58.861616 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-481e79c2-016b-4f14-96d5-283f9491bb8d tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:58.862445 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5fb3e7e8-bf53-471f-9589-50e4d270ba3d tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:58.864693 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-481e79c2-016b-4f14-96d5-283f9491bb8d tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:58.865542 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-481e79c2-016b-4f14-96d5-283f9491bb8d tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:58.868215 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5fb3e7e8-bf53-471f-9589-50e4d270ba3d tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:58.868215 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5fb3e7e8-bf53-471f-9589-50e4d270ba3d tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:11:58.868623 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5fb3e7e8-bf53-471f-9589-50e4d270ba3d tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:11:58.869234 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5fb3e7e8-bf53-471f-9589-50e4d270ba3d tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:58.870898 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-481e79c2-016b-4f14-96d5-283f9491bb8d tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:11:59.493421 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5fb3e7e8-bf53-471f-9589-50e4d270ba3d tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dce42ff994d81b1ad6d6c05356c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6d319a0452448485aa65b7cf1c5b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:59.507547 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5fb3e7e8-bf53-471f-9589-50e4d270ba3d tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2" status: 200 len: 1556 microversion: 2.1 time: 0.662889 Aug 07 01:11:59.521325 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 223/502] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:58 2022] GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2 => generated 1556 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:11:59.950858 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-481e79c2-016b-4f14-96d5-283f9491bb8d tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:11:59.986385 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-481e79c2-016b-4f14-96d5-283f9491bb8d tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0" status: 200 len: 1503 microversion: 2.1 time: 1.169743 Aug 07 01:11:59.988896 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 280/503] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:11:58 2022] GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 => generated 1503 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:00.078186 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b6730066-a96e-46bc-b143-9dd9c425fdee tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1949922271", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:00.241590 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-b6730066-a96e-46bc-b143-9dd9c425fdee tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] validate_networks() for None {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:12:00.321916 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2618d248-21ad-437a-9a11-e06e6753a34c tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Calling method '.version_select at 0x7f9e24cbb4c0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:00.478769 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2618d248-21ad-437a-9a11-e06e6753a34c tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/2f29ba2f6ff743bf983f4d3ca9c29173" status: 200 len: 371 microversion: 2.1 time: 0.487960 Aug 07 01:12:00.491928 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 281/504] 10.222.0.39 () {58 vars in 1242 bytes} [Sun Aug 7 01:11:59 2022] GET /compute/v2.1/os-quota-sets/2f29ba2f6ff743bf983f4d3ca9c29173 => generated 371 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:00.513028 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ef2bcf56-e1f9-465b-ab05-0c9c11826766 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:00.516191 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ef2bcf56-e1f9-465b-ab05-0c9c11826766 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 7ab29f8e-4b84-4038-a60f-efc93d0358ce] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:00.533636 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef2bcf56-e1f9-465b-ab05-0c9c11826766 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:00.537501 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef2bcf56-e1f9-465b-ab05-0c9c11826766 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:00.540211 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef2bcf56-e1f9-465b-ab05-0c9c11826766 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:00.544101 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef2bcf56-e1f9-465b-ab05-0c9c11826766 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:00.544766 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef2bcf56-e1f9-465b-ab05-0c9c11826766 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:00.545530 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef2bcf56-e1f9-465b-ab05-0c9c11826766 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:00.867490 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ef2bcf56-e1f9-465b-ab05-0c9c11826766 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d08a2479f847b4b06d6690f1aedb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06211ba44e4f6d88f9095969001aab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:00.903859 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ef2bcf56-e1f9-465b-ab05-0c9c11826766 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "GET /compute/v2.1/servers/7ab29f8e-4b84-4038-a60f-efc93d0358ce" status: 200 len: 1389 microversion: 2.1 time: 0.416589 Aug 07 01:12:00.906181 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 282/505] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:00 2022] GET /compute/v2.1/servers/7ab29f8e-4b84-4038-a60f-efc93d0358ce => generated 1389 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:00.934823 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d24561d2-121d-48c6-94b9-960797e2461d tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:00.939410 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d24561d2-121d-48c6-94b9-960797e2461d tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 2125f4ff-9031-486f-8b5f-85082bf81588] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:00.966208 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d24561d2-121d-48c6-94b9-960797e2461d tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:00.968692 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d24561d2-121d-48c6-94b9-960797e2461d tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:00.970856 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d24561d2-121d-48c6-94b9-960797e2461d tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:00.974157 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d24561d2-121d-48c6-94b9-960797e2461d tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:00.975717 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d24561d2-121d-48c6-94b9-960797e2461d tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:00.977032 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d24561d2-121d-48c6-94b9-960797e2461d tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:01.329443 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d24561d2-121d-48c6-94b9-960797e2461d tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:01.348917 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d24561d2-121d-48c6-94b9-960797e2461d tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588" status: 200 len: 1324 microversion: 2.1 time: 0.437933 Aug 07 01:12:01.368835 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 283/506] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:00 2022] GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588 => generated 1324 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:01.393620 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-b6730066-a96e-46bc-b143-9dd9c425fdee tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:12:01.395482 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-b6730066-a96e-46bc-b143-9dd9c425fdee tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:12:01.395679 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8b2af4eb-e3e2-4bef-bc7f-ecca4a596b92 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:01.396240 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8b2af4eb-e3e2-4bef-bc7f-ecca4a596b92 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: 5777df19-f308-48d1-8f53-fdbf073a4ef2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:01.396933 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-b6730066-a96e-46bc-b143-9dd9c425fdee tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:12:01.397930 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-b6730066-a96e-46bc-b143-9dd9c425fdee tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:12:01.398880 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-b6730066-a96e-46bc-b143-9dd9c425fdee tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:12:01.405764 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b2af4eb-e3e2-4bef-bc7f-ecca4a596b92 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:01.407289 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b2af4eb-e3e2-4bef-bc7f-ecca4a596b92 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:01.409314 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b2af4eb-e3e2-4bef-bc7f-ecca4a596b92 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:01.410470 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b2af4eb-e3e2-4bef-bc7f-ecca4a596b92 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:01.411420 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b2af4eb-e3e2-4bef-bc7f-ecca4a596b92 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:01.412322 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b2af4eb-e3e2-4bef-bc7f-ecca4a596b92 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:01.435486 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b6730066-a96e-46bc-b143-9dd9c425fdee tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:01.436358 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b6730066-a96e-46bc-b143-9dd9c425fdee tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:01.437144 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b6730066-a96e-46bc-b143-9dd9c425fdee tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:01.438545 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b6730066-a96e-46bc-b143-9dd9c425fdee tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:01.439373 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b6730066-a96e-46bc-b143-9dd9c425fdee tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:01.440174 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b6730066-a96e-46bc-b143-9dd9c425fdee tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:01.525269 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-b6730066-a96e-46bc-b143-9dd9c425fdee tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Getting quotas for project 6a7279db9d4f497b8430fd45280b5da4. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:12:01.541470 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8b2af4eb-e3e2-4bef-bc7f-ecca4a596b92 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.151545 Aug 07 01:12:01.549819 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-b6730066-a96e-46bc-b143-9dd9c425fdee tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Getting quotas for user cc0200a0753e46399d0b212c665aebce and project 6a7279db9d4f497b8430fd45280b5da4. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:12:01.551923 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 284/507] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Aug 7 01:12:01 2022] GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2/os-interface => generated 285 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:01.557242 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-42219aee-1fec-404a-981a-b51f695fe704 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:01.558159 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-42219aee-1fec-404a-981a-b51f695fe704 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:01.575691 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42219aee-1fec-404a-981a-b51f695fe704 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:01.579063 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42219aee-1fec-404a-981a-b51f695fe704 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:01.579741 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42219aee-1fec-404a-981a-b51f695fe704 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:01.582238 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42219aee-1fec-404a-981a-b51f695fe704 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:01.583041 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42219aee-1fec-404a-981a-b51f695fe704 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:01.585563 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42219aee-1fec-404a-981a-b51f695fe704 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:01.600651 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b6730066-a96e-46bc-b143-9dd9c425fdee tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:12:01.610732 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b6730066-a96e-46bc-b143-9dd9c425fdee tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: b8d0c259-b533-4396-b916-8861a321b930] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:12:01.700477 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b6730066-a96e-46bc-b143-9dd9c425fdee tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.188547 Aug 07 01:12:01.702087 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 224/508] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:11:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2192 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:12:01.736836 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c1971641-47b1-4c18-a784-5ed7957ddfc3 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Action: 'update', calling method: .version_select at 0x7f9e24b52040>, body: {"quota_set": {"ram": "5120"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:02.327202 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-42219aee-1fec-404a-981a-b51f695fe704 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:02.390059 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-42219aee-1fec-404a-981a-b51f695fe704 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:02.399568 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-42219aee-1fec-404a-981a-b51f695fe704 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:02.416610 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-42219aee-1fec-404a-981a-b51f695fe704 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1446 microversion: 2.75 time: 0.863214 Aug 07 01:12:02.419724 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 285/509] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:12:01 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1446 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:12:02.438120 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-34f4add0-e8f5-4bff-bc3c-24f8be51dc0a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:02.442337 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-34f4add0-e8f5-4bff-bc3c-24f8be51dc0a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:02.451813 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34f4add0-e8f5-4bff-bc3c-24f8be51dc0a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:02.453304 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34f4add0-e8f5-4bff-bc3c-24f8be51dc0a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:02.454062 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34f4add0-e8f5-4bff-bc3c-24f8be51dc0a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:02.455163 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34f4add0-e8f5-4bff-bc3c-24f8be51dc0a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:02.456048 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34f4add0-e8f5-4bff-bc3c-24f8be51dc0a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:02.456681 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34f4add0-e8f5-4bff-bc3c-24f8be51dc0a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:02.580997 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c1971641-47b1-4c18-a784-5ed7957ddfc3 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:02.587614 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c1971641-47b1-4c18-a784-5ed7957ddfc3 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:02.588929 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c1971641-47b1-4c18-a784-5ed7957ddfc3 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:02.595665 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c1971641-47b1-4c18-a784-5ed7957ddfc3 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:02.596649 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c1971641-47b1-4c18-a784-5ed7957ddfc3 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:02.604667 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c1971641-47b1-4c18-a784-5ed7957ddfc3 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:02.739273 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c1971641-47b1-4c18-a784-5ed7957ddfc3 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/2f29ba2f6ff743bf983f4d3ca9c29173" status: 200 len: 328 microversion: 2.1 time: 1.034016 Aug 07 01:12:02.741118 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 225/510] 10.222.0.39 () {60 vars in 1262 bytes} [Sun Aug 7 01:12:01 2022] PUT /compute/v2.1/os-quota-sets/2f29ba2f6ff743bf983f4d3ca9c29173 => generated 328 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:02.768413 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-60584425-9a72-4fd9-bfa8-b9bfbbdf1d49 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:02.770585 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-60584425-9a72-4fd9-bfa8-b9bfbbdf1d49 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: b8d0c259-b533-4396-b916-8861a321b930] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:02.774725 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:02.789048 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-60584425-9a72-4fd9-bfa8-b9bfbbdf1d49 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:02.791625 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-60584425-9a72-4fd9-bfa8-b9bfbbdf1d49 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:02.792491 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-60584425-9a72-4fd9-bfa8-b9bfbbdf1d49 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:02.793669 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-60584425-9a72-4fd9-bfa8-b9bfbbdf1d49 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:02.794848 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-60584425-9a72-4fd9-bfa8-b9bfbbdf1d49 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:02.796542 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-60584425-9a72-4fd9-bfa8-b9bfbbdf1d49 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:03.086345 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-60584425-9a72-4fd9-bfa8-b9bfbbdf1d49 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0200a0753e46399d0b212c665aebce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7279db9d4f497b8430fd45280b5da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:03.106816 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-60584425-9a72-4fd9-bfa8-b9bfbbdf1d49 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] 10.222.0.39 "GET /compute/v2.1/servers/b8d0c259-b533-4396-b916-8861a321b930" status: 200 len: 1223 microversion: 2.1 time: 0.361713 Aug 07 01:12:03.107798 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 226/511] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:02 2022] GET /compute/v2.1/servers/b8d0c259-b533-4396-b916-8861a321b930 => generated 1223 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:03.115591 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7ab241a0-4cbf-4c48-bffa-5d73a293a316 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:03.117480 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7ab241a0-4cbf-4c48-bffa-5d73a293a316 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 7ab29f8e-4b84-4038-a60f-efc93d0358ce] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:03.137864 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ab241a0-4cbf-4c48-bffa-5d73a293a316 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:03.139206 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ab241a0-4cbf-4c48-bffa-5d73a293a316 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:03.140312 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ab241a0-4cbf-4c48-bffa-5d73a293a316 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:03.142436 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ab241a0-4cbf-4c48-bffa-5d73a293a316 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:03.143606 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ab241a0-4cbf-4c48-bffa-5d73a293a316 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:03.144736 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ab241a0-4cbf-4c48-bffa-5d73a293a316 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:03.488298 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7ab241a0-4cbf-4c48-bffa-5d73a293a316 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d08a2479f847b4b06d6690f1aedb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06211ba44e4f6d88f9095969001aab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:03.510292 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7ab241a0-4cbf-4c48-bffa-5d73a293a316 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "GET /compute/v2.1/servers/7ab29f8e-4b84-4038-a60f-efc93d0358ce" status: 200 len: 1389 microversion: 2.1 time: 0.400727 Aug 07 01:12:03.513551 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 227/512] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:03 2022] GET /compute/v2.1/servers/7ab29f8e-4b84-4038-a60f-efc93d0358ce => generated 1389 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:03.525000 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ed880776-9f3b-4a1c-8676-ae9d041e935c tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:03.529284 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ed880776-9f3b-4a1c-8676-ae9d041e935c tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 2125f4ff-9031-486f-8b5f-85082bf81588] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:03.542522 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed880776-9f3b-4a1c-8676-ae9d041e935c tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:03.544077 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed880776-9f3b-4a1c-8676-ae9d041e935c tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:03.545041 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed880776-9f3b-4a1c-8676-ae9d041e935c tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:03.546972 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed880776-9f3b-4a1c-8676-ae9d041e935c tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:03.548220 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed880776-9f3b-4a1c-8676-ae9d041e935c tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:03.549534 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed880776-9f3b-4a1c-8676-ae9d041e935c tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:03.608567 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:03.778018 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:03.906374 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ed880776-9f3b-4a1c-8676-ae9d041e935c tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:03.916185 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ed880776-9f3b-4a1c-8676-ae9d041e935c tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588" status: 200 len: 1324 microversion: 2.1 time: 0.400509 Aug 07 01:12:03.932613 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 228/513] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:03 2022] GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588 => generated 1324 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:03.939395 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-944ff81b-51a0-400d-a5ae-63ceffbd2fbd req-9916d775-edb4-482e-a604-96a7dbb03692 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ab29f8e-4b84-4038-a60f-efc93d0358ce", "tag": "3a899aee-00e7-47c8-925e-16279648d5d3"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:03.954080 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-944ff81b-51a0-400d-a5ae-63ceffbd2fbd req-9916d775-edb4-482e-a604-96a7dbb03692 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:03.954963 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-944ff81b-51a0-400d-a5ae-63ceffbd2fbd req-9916d775-edb4-482e-a604-96a7dbb03692 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:03.955654 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-944ff81b-51a0-400d-a5ae-63ceffbd2fbd req-9916d775-edb4-482e-a604-96a7dbb03692 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:03.977078 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-944ff81b-51a0-400d-a5ae-63ceffbd2fbd req-9916d775-edb4-482e-a604-96a7dbb03692 service nova] Creating event network-changed:3a899aee-00e7-47c8-925e-16279648d5d3 for instance 7ab29f8e-4b84-4038-a60f-efc93d0358ce on n-h2-master-1 Aug 07 01:12:03.990499 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-944ff81b-51a0-400d-a5ae-63ceffbd2fbd req-9916d775-edb4-482e-a604-96a7dbb03692 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056144 Aug 07 01:12:03.992041 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 229/514] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:03.998234 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-736ed1e9-4882-4a62-9ab5-2ca81fbec1c5 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:04.014995 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-736ed1e9-4882-4a62-9ab5-2ca81fbec1c5 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-quota-sets/2f29ba2f6ff743bf983f4d3ca9c29173" status: 202 len: 0 microversion: 2.1 time: 0.020913 Aug 07 01:12:04.017654 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 230/515] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Aug 7 01:12:03 2022] DELETE /compute/v2.1/os-quota-sets/2f29ba2f6ff743bf983f4d3ca9c29173 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:12:04.179085 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-34f4add0-e8f5-4bff-bc3c-24f8be51dc0a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:04.210392 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-34f4add0-e8f5-4bff-bc3c-24f8be51dc0a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0" status: 200 len: 1503 microversion: 2.1 time: 1.786865 Aug 07 01:12:04.212018 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 286/516] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:02 2022] GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 => generated 1503 bytes in 1791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:04.224774 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-3473ef11-50e1-4d97-ad52-c70d57708a74 req-1f86c238-bf70-4859-8450-c0992ee9fa23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2125f4ff-9031-486f-8b5f-85082bf81588", "name": "network-vif-plugged", "status": "completed", "tag": "1f8f9f06-bbaf-4b4c-afb2-b98cdf738a8d"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:04.270793 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3473ef11-50e1-4d97-ad52-c70d57708a74 req-1f86c238-bf70-4859-8450-c0992ee9fa23 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:04.272253 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3473ef11-50e1-4d97-ad52-c70d57708a74 req-1f86c238-bf70-4859-8450-c0992ee9fa23 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:04.273223 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3473ef11-50e1-4d97-ad52-c70d57708a74 req-1f86c238-bf70-4859-8450-c0992ee9fa23 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:04.294862 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-3473ef11-50e1-4d97-ad52-c70d57708a74 req-1f86c238-bf70-4859-8450-c0992ee9fa23 service nova] Creating event network-vif-plugged:1f8f9f06-bbaf-4b4c-afb2-b98cdf738a8d for instance 2125f4ff-9031-486f-8b5f-85082bf81588 on n-h2-master-1 Aug 07 01:12:04.302039 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-3473ef11-50e1-4d97-ad52-c70d57708a74 req-1f86c238-bf70-4859-8450-c0992ee9fa23 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087862 Aug 07 01:12:04.303026 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 287/517] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:04.307038 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f48f6d87-6e2a-4baf-87ea-8e1339810f2c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1291932177", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:04.311938 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4fe859db-b55b-47c5-90a7-df2354044922 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:04.313555 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4fe859db-b55b-47c5-90a7-df2354044922 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:04.324023 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4fe859db-b55b-47c5-90a7-df2354044922 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:04.324824 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4fe859db-b55b-47c5-90a7-df2354044922 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:04.326942 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4fe859db-b55b-47c5-90a7-df2354044922 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:04.328251 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4fe859db-b55b-47c5-90a7-df2354044922 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:04.329725 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4fe859db-b55b-47c5-90a7-df2354044922 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:04.330811 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4fe859db-b55b-47c5-90a7-df2354044922 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:04.445031 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-f48f6d87-6e2a-4baf-87ea-8e1339810f2c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] validate_networks() for None {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:12:04.481484 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4fe859db-b55b-47c5-90a7-df2354044922 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:04.501011 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4fe859db-b55b-47c5-90a7-df2354044922 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:04.505954 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4fe859db-b55b-47c5-90a7-df2354044922 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:04.522448 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4fe859db-b55b-47c5-90a7-df2354044922 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1446 microversion: 2.75 time: 0.214012 Aug 07 01:12:04.522448 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 288/518] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:12:04 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1446 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:12:04.530194 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b25bb4e4-2c1d-4610-a29c-776fe1838e96 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Calling method '.version_select at 0x7f9e24cbbc10>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:04.765067 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b25bb4e4-2c1d-4610-a29c-776fe1838e96 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/2f29ba2f6ff743bf983f4d3ca9c29173" status: 200 len: 371 microversion: 2.1 time: 0.241395 Aug 07 01:12:04.778222 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 289/519] 10.222.0.39 () {58 vars in 1242 bytes} [Sun Aug 7 01:12:04 2022] GET /compute/v2.1/os-quota-sets/2f29ba2f6ff743bf983f4d3ca9c29173 => generated 371 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:04.795595 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-af4ea86e-41ae-49ca-8913-86ad82d6825e tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:04.805615 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-af4ea86e-41ae-49ca-8913-86ad82d6825e tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: b8d0c259-b533-4396-b916-8861a321b930] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:04.831287 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af4ea86e-41ae-49ca-8913-86ad82d6825e tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:04.836392 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af4ea86e-41ae-49ca-8913-86ad82d6825e tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:04.839172 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af4ea86e-41ae-49ca-8913-86ad82d6825e tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:04.843799 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af4ea86e-41ae-49ca-8913-86ad82d6825e tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:04.848286 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af4ea86e-41ae-49ca-8913-86ad82d6825e tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:04.850123 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af4ea86e-41ae-49ca-8913-86ad82d6825e tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:05.004685 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-af4ea86e-41ae-49ca-8913-86ad82d6825e tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0200a0753e46399d0b212c665aebce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7279db9d4f497b8430fd45280b5da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:05.037252 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-af4ea86e-41ae-49ca-8913-86ad82d6825e tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] 10.222.0.39 "GET /compute/v2.1/servers/b8d0c259-b533-4396-b916-8861a321b930" status: 200 len: 1277 microversion: 2.1 time: 0.257069 Aug 07 01:12:05.043148 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 290/520] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:04 2022] GET /compute/v2.1/servers/b8d0c259-b533-4396-b916-8861a321b930 => generated 1277 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:05.061556 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2fd0032e-0dc1-4c56-9e7f-6993a24514d1 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:05.062697 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2fd0032e-0dc1-4c56-9e7f-6993a24514d1 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 7ab29f8e-4b84-4038-a60f-efc93d0358ce] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:05.071869 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2fd0032e-0dc1-4c56-9e7f-6993a24514d1 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:05.072588 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2fd0032e-0dc1-4c56-9e7f-6993a24514d1 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:05.076806 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2fd0032e-0dc1-4c56-9e7f-6993a24514d1 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:05.077763 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2fd0032e-0dc1-4c56-9e7f-6993a24514d1 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:05.078316 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2fd0032e-0dc1-4c56-9e7f-6993a24514d1 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:05.078856 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2fd0032e-0dc1-4c56-9e7f-6993a24514d1 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:05.388562 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2fd0032e-0dc1-4c56-9e7f-6993a24514d1 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d08a2479f847b4b06d6690f1aedb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06211ba44e4f6d88f9095969001aab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:05.405237 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2fd0032e-0dc1-4c56-9e7f-6993a24514d1 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "GET /compute/v2.1/servers/7ab29f8e-4b84-4038-a60f-efc93d0358ce" status: 200 len: 1389 microversion: 2.1 time: 0.365054 Aug 07 01:12:05.407970 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 291/521] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:05 2022] GET /compute/v2.1/servers/7ab29f8e-4b84-4038-a60f-efc93d0358ce => generated 1389 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:05.418100 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-31e965bb-8802-42e3-9d12-47491db6993a req-a6d6d52b-ffe1-4717-8e5f-9e0dbb0ec588 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5777df19-f308-48d1-8f53-fdbf073a4ef2", "tag": "62317124-fa59-401f-9d70-b70b34f142b9"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:05.439097 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-31e965bb-8802-42e3-9d12-47491db6993a req-a6d6d52b-ffe1-4717-8e5f-9e0dbb0ec588 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:05.440142 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-31e965bb-8802-42e3-9d12-47491db6993a req-a6d6d52b-ffe1-4717-8e5f-9e0dbb0ec588 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:05.441550 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-31e965bb-8802-42e3-9d12-47491db6993a req-a6d6d52b-ffe1-4717-8e5f-9e0dbb0ec588 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:05.473120 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-31e965bb-8802-42e3-9d12-47491db6993a req-a6d6d52b-ffe1-4717-8e5f-9e0dbb0ec588 service nova] Creating event network-changed:62317124-fa59-401f-9d70-b70b34f142b9 for instance 5777df19-f308-48d1-8f53-fdbf073a4ef2 on n-h1-master-1 Aug 07 01:12:05.478764 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-f48f6d87-6e2a-4baf-87ea-8e1339810f2c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:12:05.479658 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-f48f6d87-6e2a-4baf-87ea-8e1339810f2c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:12:05.479658 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-f48f6d87-6e2a-4baf-87ea-8e1339810f2c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:12:05.480091 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-f48f6d87-6e2a-4baf-87ea-8e1339810f2c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:12:05.481094 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-f48f6d87-6e2a-4baf-87ea-8e1339810f2c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:12:05.483568 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-31e965bb-8802-42e3-9d12-47491db6993a req-a6d6d52b-ffe1-4717-8e5f-9e0dbb0ec588 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072381 Aug 07 01:12:05.485137 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 292/522] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:05.495725 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bd563906-321c-4dd4-99f9-c631199e0772 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:05.497055 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bd563906-321c-4dd4-99f9-c631199e0772 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 2125f4ff-9031-486f-8b5f-85082bf81588] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:05.504373 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f48f6d87-6e2a-4baf-87ea-8e1339810f2c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:05.509118 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd563906-321c-4dd4-99f9-c631199e0772 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:05.509118 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd563906-321c-4dd4-99f9-c631199e0772 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:05.509118 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd563906-321c-4dd4-99f9-c631199e0772 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:05.509689 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd563906-321c-4dd4-99f9-c631199e0772 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:05.510221 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd563906-321c-4dd4-99f9-c631199e0772 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:05.510984 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd563906-321c-4dd4-99f9-c631199e0772 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:05.511508 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f48f6d87-6e2a-4baf-87ea-8e1339810f2c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:05.512607 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f48f6d87-6e2a-4baf-87ea-8e1339810f2c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:05.514471 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f48f6d87-6e2a-4baf-87ea-8e1339810f2c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:05.515421 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f48f6d87-6e2a-4baf-87ea-8e1339810f2c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:05.517817 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f48f6d87-6e2a-4baf-87ea-8e1339810f2c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:05.558271 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-f48f6d87-6e2a-4baf-87ea-8e1339810f2c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Getting quotas for project dc5c39a06e41406a8c6c99d2e84ab282. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:12:05.571862 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-f48f6d87-6e2a-4baf-87ea-8e1339810f2c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Getting quotas for user 1d0d09d844bf453cb3e2637d630614ff and project dc5c39a06e41406a8c6c99d2e84ab282. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:12:05.602782 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f48f6d87-6e2a-4baf-87ea-8e1339810f2c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:12:05.613187 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f48f6d87-6e2a-4baf-87ea-8e1339810f2c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] [instance: a038208d-dae8-432d-97e5-2a58ea093e12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:12:05.732569 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f48f6d87-6e2a-4baf-87ea-8e1339810f2c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.711560 Aug 07 01:12:05.745481 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 231/523] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:12:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:12:05.757368 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6f45de8a-d1e8-4a64-aec4-4408fa4d5ae6 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Calling method '.version_select at 0x7f9e24bafca0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:05.884051 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bd563906-321c-4dd4-99f9-c631199e0772 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:05.901166 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bd563906-321c-4dd4-99f9-c631199e0772 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588" status: 200 len: 1324 microversion: 2.1 time: 0.413676 Aug 07 01:12:05.902928 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 293/524] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:05 2022] GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588 => generated 1324 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:05.928977 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-da10f012-732e-44ab-8c4a-ac9d73957db9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:05.930729 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-da10f012-732e-44ab-8c4a-ac9d73957db9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:05.945509 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da10f012-732e-44ab-8c4a-ac9d73957db9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:05.946803 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da10f012-732e-44ab-8c4a-ac9d73957db9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:05.947842 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da10f012-732e-44ab-8c4a-ac9d73957db9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:05.949729 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da10f012-732e-44ab-8c4a-ac9d73957db9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:05.950857 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da10f012-732e-44ab-8c4a-ac9d73957db9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:05.951849 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da10f012-732e-44ab-8c4a-ac9d73957db9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:06.350103 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-da10f012-732e-44ab-8c4a-ac9d73957db9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:06.363872 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-da10f012-732e-44ab-8c4a-ac9d73957db9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0" status: 200 len: 1493 microversion: 2.1 time: 0.458860 Aug 07 01:12:06.364695 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 294/525] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:05 2022] GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 => generated 1493 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:06.372958 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-93a05830-99f5-42fb-a4e4-c5d481403314 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:06.374915 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-93a05830-99f5-42fb-a4e4-c5d481403314 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:06.389138 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93a05830-99f5-42fb-a4e4-c5d481403314 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:06.390548 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93a05830-99f5-42fb-a4e4-c5d481403314 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:06.391667 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93a05830-99f5-42fb-a4e4-c5d481403314 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:06.393301 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93a05830-99f5-42fb-a4e4-c5d481403314 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:06.394407 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93a05830-99f5-42fb-a4e4-c5d481403314 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:06.395087 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93a05830-99f5-42fb-a4e4-c5d481403314 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:06.443333 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6f45de8a-d1e8-4a64-aec4-4408fa4d5ae6 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/4651068d5dc542b3aee65535e104867b/defaults" status: 200 len: 371 microversion: 2.1 time: 0.695550 Aug 07 01:12:06.444366 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 232/526] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Aug 7 01:12:05 2022] GET /compute/v2.1/os-quota-sets/4651068d5dc542b3aee65535e104867b/defaults => generated 371 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:06.456820 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ca24706d-b569-40ba-bf5d-df95f6c69c5f tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:06.458098 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ca24706d-b569-40ba-bf5d-df95f6c69c5f tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] [instance: a038208d-dae8-432d-97e5-2a58ea093e12] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:06.573526 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-93a05830-99f5-42fb-a4e4-c5d481403314 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:06.598310 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-93a05830-99f5-42fb-a4e4-c5d481403314 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:06.603544 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-93a05830-99f5-42fb-a4e4-c5d481403314 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:06.629167 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-93a05830-99f5-42fb-a4e4-c5d481403314 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1446 microversion: 2.75 time: 0.262097 Aug 07 01:12:06.632585 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 295/527] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:12:06 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1446 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:12:06.643762 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3638e2c2-60eb-4f54-9494-560a9c19760e tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:06.647511 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3638e2c2-60eb-4f54-9494-560a9c19760e tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: b8d0c259-b533-4396-b916-8861a321b930] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:06.655945 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3638e2c2-60eb-4f54-9494-560a9c19760e tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:06.656738 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3638e2c2-60eb-4f54-9494-560a9c19760e tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:06.657567 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3638e2c2-60eb-4f54-9494-560a9c19760e tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:06.658509 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3638e2c2-60eb-4f54-9494-560a9c19760e tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:06.659364 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3638e2c2-60eb-4f54-9494-560a9c19760e tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:06.660145 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3638e2c2-60eb-4f54-9494-560a9c19760e tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:06.742862 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ca24706d-b569-40ba-bf5d-df95f6c69c5f tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0d09d844bf453cb3e2637d630614ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5c39a06e41406a8c6c99d2e84ab282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:06.772434 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ca24706d-b569-40ba-bf5d-df95f6c69c5f tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12" status: 200 len: 1217 microversion: 2.1 time: 0.323837 Aug 07 01:12:06.774398 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 233/528] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:06 2022] GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12 => generated 1217 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:06.803077 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-db4d3617-9aee-4e5d-97c0-288d09b5f502 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Calling method '.version_select at 0x7f9e24b35c10>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:06.807921 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db4d3617-9aee-4e5d-97c0-288d09b5f502 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:06.808428 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db4d3617-9aee-4e5d-97c0-288d09b5f502 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:06.813286 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db4d3617-9aee-4e5d-97c0-288d09b5f502 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:06.829240 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3638e2c2-60eb-4f54-9494-560a9c19760e tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0200a0753e46399d0b212c665aebce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7279db9d4f497b8430fd45280b5da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:06.858978 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3638e2c2-60eb-4f54-9494-560a9c19760e tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] 10.222.0.39 "GET /compute/v2.1/servers/b8d0c259-b533-4396-b916-8861a321b930" status: 200 len: 1277 microversion: 2.1 time: 0.222447 Aug 07 01:12:06.872386 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 296/529] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:06 2022] GET /compute/v2.1/servers/b8d0c259-b533-4396-b916-8861a321b930 => generated 1277 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:06.896478 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fe289802-491f-41e7-8121-82002c5dcf8d tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:06.900128 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fe289802-491f-41e7-8121-82002c5dcf8d tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 7ab29f8e-4b84-4038-a60f-efc93d0358ce] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:06.915805 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-db4d3617-9aee-4e5d-97c0-288d09b5f502 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 400 microversion: 2.1 time: 0.133346 Aug 07 01:12:06.919728 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 234/530] 10.222.0.39 () {58 vars in 1143 bytes} [Sun Aug 7 01:12:06 2022] GET /compute/v2.1/os-migrations => generated 400 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:06.934517 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe289802-491f-41e7-8121-82002c5dcf8d tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:06.937059 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe289802-491f-41e7-8121-82002c5dcf8d tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:06.938062 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-95bd9390-01e2-4534-a431-53e1168d451a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:06.938851 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe289802-491f-41e7-8121-82002c5dcf8d tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:06.943306 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-95bd9390-01e2-4534-a431-53e1168d451a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 2125f4ff-9031-486f-8b5f-85082bf81588] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:06.944599 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe289802-491f-41e7-8121-82002c5dcf8d tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:06.947359 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe289802-491f-41e7-8121-82002c5dcf8d tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:06.949658 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe289802-491f-41e7-8121-82002c5dcf8d tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:06.979689 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-95bd9390-01e2-4534-a431-53e1168d451a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:06.986041 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-95bd9390-01e2-4534-a431-53e1168d451a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:06.989966 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-95bd9390-01e2-4534-a431-53e1168d451a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:06.997787 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-95bd9390-01e2-4534-a431-53e1168d451a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:07.002504 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-95bd9390-01e2-4534-a431-53e1168d451a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:07.004364 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-95bd9390-01e2-4534-a431-53e1168d451a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:07.385780 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fe289802-491f-41e7-8121-82002c5dcf8d tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d08a2479f847b4b06d6690f1aedb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06211ba44e4f6d88f9095969001aab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:07.419849 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fe289802-491f-41e7-8121-82002c5dcf8d tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "GET /compute/v2.1/servers/7ab29f8e-4b84-4038-a60f-efc93d0358ce" status: 200 len: 1389 microversion: 2.1 time: 0.545350 Aug 07 01:12:07.437403 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 297/531] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:06 2022] GET /compute/v2.1/servers/7ab29f8e-4b84-4038-a60f-efc93d0358ce => generated 1389 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:07.458622 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ce8a6aaf-7720-4e3c-9183-59e7b2ca5618 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:07.463644 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ce8a6aaf-7720-4e3c-9183-59e7b2ca5618 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] [instance: 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:07.490319 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce8a6aaf-7720-4e3c-9183-59e7b2ca5618 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:07.499440 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce8a6aaf-7720-4e3c-9183-59e7b2ca5618 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:07.500286 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce8a6aaf-7720-4e3c-9183-59e7b2ca5618 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:07.510185 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce8a6aaf-7720-4e3c-9183-59e7b2ca5618 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:07.511278 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce8a6aaf-7720-4e3c-9183-59e7b2ca5618 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:07.512321 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce8a6aaf-7720-4e3c-9183-59e7b2ca5618 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:07.706181 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-95bd9390-01e2-4534-a431-53e1168d451a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:07.714474 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-95bd9390-01e2-4534-a431-53e1168d451a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588" status: 200 len: 1324 microversion: 2.1 time: 0.790123 Aug 07 01:12:07.715072 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 235/532] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:06 2022] GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588 => generated 1324 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:07.733361 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-42ceb69d-1668-46dc-a562-af4423f33111 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Action: 'update', calling method: .version_select at 0x7f9e24b35dc0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:07.805904 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:07.817310 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ce8a6aaf-7720-4e3c-9183-59e7b2ca5618 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0" status: 200 len: 1644 microversion: 2.1 time: 0.376007 Aug 07 01:12:07.819050 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 298/533] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:07 2022] GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 => generated 1644 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:07.829306 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5dfdf6a4-75db-493a-82a8-47575f151b28 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:07.830348 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5dfdf6a4-75db-493a-82a8-47575f151b28 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:07.841574 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5dfdf6a4-75db-493a-82a8-47575f151b28 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:07.842478 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5dfdf6a4-75db-493a-82a8-47575f151b28 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:07.863081 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5dfdf6a4-75db-493a-82a8-47575f151b28 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:07.868433 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5dfdf6a4-75db-493a-82a8-47575f151b28 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:07.870078 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5dfdf6a4-75db-493a-82a8-47575f151b28 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:07.871010 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5dfdf6a4-75db-493a-82a8-47575f151b28 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:08.159147 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5dfdf6a4-75db-493a-82a8-47575f151b28 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:08.235113 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5dfdf6a4-75db-493a-82a8-47575f151b28 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:08.239668 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5dfdf6a4-75db-493a-82a8-47575f151b28 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:08.286980 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-42ceb69d-1668-46dc-a562-af4423f33111 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:08.287726 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-42ceb69d-1668-46dc-a562-af4423f33111 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:08.287726 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-42ceb69d-1668-46dc-a562-af4423f33111 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:08.288076 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5dfdf6a4-75db-493a-82a8-47575f151b28 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1446 microversion: 2.75 time: 0.463127 Aug 07 01:12:08.289206 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 299/534] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:12:07 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1446 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:12:08.292487 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-42ceb69d-1668-46dc-a562-af4423f33111 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:08.293060 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-42ceb69d-1668-46dc-a562-af4423f33111 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:08.293505 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-42ceb69d-1668-46dc-a562-af4423f33111 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:08.298423 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c921fb3c-ac48-4b2a-9bf7-44d5e737c680 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:08.299073 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c921fb3c-ac48-4b2a-9bf7-44d5e737c680 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] [instance: a038208d-dae8-432d-97e5-2a58ea093e12] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:08.316795 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c921fb3c-ac48-4b2a-9bf7-44d5e737c680 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:08.317408 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c921fb3c-ac48-4b2a-9bf7-44d5e737c680 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:08.317911 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c921fb3c-ac48-4b2a-9bf7-44d5e737c680 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:08.318650 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c921fb3c-ac48-4b2a-9bf7-44d5e737c680 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:08.319112 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c921fb3c-ac48-4b2a-9bf7-44d5e737c680 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:08.319655 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c921fb3c-ac48-4b2a-9bf7-44d5e737c680 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:08.414950 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-42ceb69d-1668-46dc-a562-af4423f33111 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/cc27df5d850c4a258e9476177a0e0490" status: 200 len: 328 microversion: 2.1 time: 0.685520 Aug 07 01:12:08.422212 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 236/535] 10.222.0.39 () {60 vars in 1262 bytes} [Sun Aug 7 01:12:07 2022] PUT /compute/v2.1/os-quota-sets/cc27df5d850c4a258e9476177a0e0490 => generated 328 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:08.428770 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bd75ea5f-f444-46dc-b064-ab5189e02784 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:08.429771 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bd75ea5f-f444-46dc-b064-ab5189e02784 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: b8d0c259-b533-4396-b916-8861a321b930] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:08.441321 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bd75ea5f-f444-46dc-b064-ab5189e02784 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:08.441878 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bd75ea5f-f444-46dc-b064-ab5189e02784 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:08.442705 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bd75ea5f-f444-46dc-b064-ab5189e02784 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:08.443472 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bd75ea5f-f444-46dc-b064-ab5189e02784 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:08.444232 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bd75ea5f-f444-46dc-b064-ab5189e02784 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:08.445177 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bd75ea5f-f444-46dc-b064-ab5189e02784 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:08.493189 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c921fb3c-ac48-4b2a-9bf7-44d5e737c680 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0d09d844bf453cb3e2637d630614ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5c39a06e41406a8c6c99d2e84ab282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:08.507686 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c921fb3c-ac48-4b2a-9bf7-44d5e737c680 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12" status: 200 len: 1269 microversion: 2.1 time: 0.216998 Aug 07 01:12:08.527931 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 300/536] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:08 2022] GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12 => generated 1269 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:08.527931 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2d94671f-e97e-42ac-8564-e5e9bbc93787 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1454353858", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "e53f1978-9541-49df-ae99-30274357a59f"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:08.629657 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-2d94671f-e97e-42ac-8564-e5e9bbc93787 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] validate_networks() for [('e53f1978-9541-49df-ae99-30274357a59f', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:12:08.955557 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bd75ea5f-f444-46dc-b064-ab5189e02784 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0200a0753e46399d0b212c665aebce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7279db9d4f497b8430fd45280b5da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:08.989234 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bd75ea5f-f444-46dc-b064-ab5189e02784 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] 10.222.0.39 "GET /compute/v2.1/servers/b8d0c259-b533-4396-b916-8861a321b930" status: 200 len: 1319 microversion: 2.1 time: 0.565081 Aug 07 01:12:09.004505 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 237/537] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:08 2022] GET /compute/v2.1/servers/b8d0c259-b533-4396-b916-8861a321b930 => generated 1319 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:09.032055 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4f9d8161-0018-4f05-b5da-04374dc1bf44 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Calling method '.version_select at 0x7f9e24b35d30>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:09.150915 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f9d8161-0018-4f05-b5da-04374dc1bf44 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:09.151760 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f9d8161-0018-4f05-b5da-04374dc1bf44 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:09.152563 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f9d8161-0018-4f05-b5da-04374dc1bf44 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:09.153739 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f9d8161-0018-4f05-b5da-04374dc1bf44 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:09.154213 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f9d8161-0018-4f05-b5da-04374dc1bf44 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:09.154702 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f9d8161-0018-4f05-b5da-04374dc1bf44 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:09.240884 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4f9d8161-0018-4f05-b5da-04374dc1bf44 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/cc27df5d850c4a258e9476177a0e0490/detail" status: 200 len: 916 microversion: 2.1 time: 0.233744 Aug 07 01:12:09.260862 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 238/538] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Aug 7 01:12:09 2022] GET /compute/v2.1/os-quota-sets/cc27df5d850c4a258e9476177a0e0490/detail => generated 916 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:09.305412 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5c35cb12-8ea7-49a4-a0fc-a81fd6303e71 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:09.306606 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5c35cb12-8ea7-49a4-a0fc-a81fd6303e71 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 7ab29f8e-4b84-4038-a60f-efc93d0358ce] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:09.335781 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c35cb12-8ea7-49a4-a0fc-a81fd6303e71 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:09.340339 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c35cb12-8ea7-49a4-a0fc-a81fd6303e71 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:09.341139 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c35cb12-8ea7-49a4-a0fc-a81fd6303e71 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:09.353893 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c35cb12-8ea7-49a4-a0fc-a81fd6303e71 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:09.354784 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c35cb12-8ea7-49a4-a0fc-a81fd6303e71 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:09.355598 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c35cb12-8ea7-49a4-a0fc-a81fd6303e71 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:09.468303 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-2d94671f-e97e-42ac-8564-e5e9bbc93787 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:12:09.469199 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-2d94671f-e97e-42ac-8564-e5e9bbc93787 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:12:09.470206 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-2d94671f-e97e-42ac-8564-e5e9bbc93787 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:12:09.471290 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-2d94671f-e97e-42ac-8564-e5e9bbc93787 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:12:09.473051 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-2d94671f-e97e-42ac-8564-e5e9bbc93787 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:12:09.498920 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2d94671f-e97e-42ac-8564-e5e9bbc93787 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:09.500521 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2d94671f-e97e-42ac-8564-e5e9bbc93787 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:09.503030 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2d94671f-e97e-42ac-8564-e5e9bbc93787 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:09.507064 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2d94671f-e97e-42ac-8564-e5e9bbc93787 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:09.508648 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2d94671f-e97e-42ac-8564-e5e9bbc93787 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:09.510225 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2d94671f-e97e-42ac-8564-e5e9bbc93787 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:09.575336 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-2d94671f-e97e-42ac-8564-e5e9bbc93787 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Getting quotas for project ba9e7a1c1fe14f47b5a5acf2fe8893b5. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:12:09.608879 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-2d94671f-e97e-42ac-8564-e5e9bbc93787 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Getting quotas for user 0327f14a188e45fba98a58e5fd061248 and project ba9e7a1c1fe14f47b5a5acf2fe8893b5. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:12:09.650851 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2d94671f-e97e-42ac-8564-e5e9bbc93787 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:12:09.658658 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2d94671f-e97e-42ac-8564-e5e9bbc93787 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:12:09.744231 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2d94671f-e97e-42ac-8564-e5e9bbc93787 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.228042 Aug 07 01:12:09.745863 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 301/539] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:12:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1231 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:12:09.755653 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c4341d5a-082d-4359-bc56-e04035f00d3a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:09.757194 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c4341d5a-082d-4359-bc56-e04035f00d3a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 2125f4ff-9031-486f-8b5f-85082bf81588] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:09.769363 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c4341d5a-082d-4359-bc56-e04035f00d3a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:09.770600 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c4341d5a-082d-4359-bc56-e04035f00d3a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:09.771675 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c4341d5a-082d-4359-bc56-e04035f00d3a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:09.773507 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c4341d5a-082d-4359-bc56-e04035f00d3a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:09.775264 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c4341d5a-082d-4359-bc56-e04035f00d3a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:09.776613 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c4341d5a-082d-4359-bc56-e04035f00d3a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:09.887411 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5c35cb12-8ea7-49a4-a0fc-a81fd6303e71 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d08a2479f847b4b06d6690f1aedb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06211ba44e4f6d88f9095969001aab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:09.914013 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5c35cb12-8ea7-49a4-a0fc-a81fd6303e71 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "GET /compute/v2.1/servers/7ab29f8e-4b84-4038-a60f-efc93d0358ce" status: 200 len: 1389 microversion: 2.1 time: 0.642359 Aug 07 01:12:09.915151 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 239/540] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:09 2022] GET /compute/v2.1/servers/7ab29f8e-4b84-4038-a60f-efc93d0358ce => generated 1389 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:09.923167 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b78785aa-5757-42d5-97a9-b9df7bc78afd tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:09.924338 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b78785aa-5757-42d5-97a9-b9df7bc78afd tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:09.934889 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b78785aa-5757-42d5-97a9-b9df7bc78afd tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:09.936793 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b78785aa-5757-42d5-97a9-b9df7bc78afd tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:09.937865 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b78785aa-5757-42d5-97a9-b9df7bc78afd tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:09.939394 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b78785aa-5757-42d5-97a9-b9df7bc78afd tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:09.940808 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b78785aa-5757-42d5-97a9-b9df7bc78afd tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:09.941856 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b78785aa-5757-42d5-97a9-b9df7bc78afd tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:10.062231 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c4341d5a-082d-4359-bc56-e04035f00d3a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:10.076580 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c4341d5a-082d-4359-bc56-e04035f00d3a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588" status: 200 len: 1520 microversion: 2.1 time: 0.329019 Aug 07 01:12:10.078080 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 302/541] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:09 2022] GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588 => generated 1520 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:10.088583 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-0d476b39-ac4c-41a7-9c43-a6eccb2e500f req-222fd317-b533-418b-81ac-e67b39689c5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ab29f8e-4b84-4038-a60f-efc93d0358ce", "name": "network-vif-plugged", "status": "completed", "tag": "3a899aee-00e7-47c8-925e-16279648d5d3"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:10.116448 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0d476b39-ac4c-41a7-9c43-a6eccb2e500f req-222fd317-b533-418b-81ac-e67b39689c5a service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:10.117406 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0d476b39-ac4c-41a7-9c43-a6eccb2e500f req-222fd317-b533-418b-81ac-e67b39689c5a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:10.118262 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0d476b39-ac4c-41a7-9c43-a6eccb2e500f req-222fd317-b533-418b-81ac-e67b39689c5a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:10.141718 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-0d476b39-ac4c-41a7-9c43-a6eccb2e500f req-222fd317-b533-418b-81ac-e67b39689c5a service nova] Creating event network-vif-plugged:3a899aee-00e7-47c8-925e-16279648d5d3 for instance 7ab29f8e-4b84-4038-a60f-efc93d0358ce on n-h2-master-1 Aug 07 01:12:10.152099 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-0d476b39-ac4c-41a7-9c43-a6eccb2e500f req-222fd317-b533-418b-81ac-e67b39689c5a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070877 Aug 07 01:12:10.154639 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 303/542] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:10.166460 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-76cdd366-ad85-4360-b892-f0af245bd62b tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:10.167378 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-76cdd366-ad85-4360-b892-f0af245bd62b tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] [instance: a038208d-dae8-432d-97e5-2a58ea093e12] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:10.179174 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-76cdd366-ad85-4360-b892-f0af245bd62b tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:10.180100 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-76cdd366-ad85-4360-b892-f0af245bd62b tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:10.180928 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-76cdd366-ad85-4360-b892-f0af245bd62b tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:10.182231 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-76cdd366-ad85-4360-b892-f0af245bd62b tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:10.183094 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-76cdd366-ad85-4360-b892-f0af245bd62b tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:10.183874 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-76cdd366-ad85-4360-b892-f0af245bd62b tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:10.287384 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-76cdd366-ad85-4360-b892-f0af245bd62b tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0d09d844bf453cb3e2637d630614ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5c39a06e41406a8c6c99d2e84ab282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:10.296644 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-76cdd366-ad85-4360-b892-f0af245bd62b tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12" status: 200 len: 1275 microversion: 2.1 time: 0.139618 Aug 07 01:12:10.297255 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 304/543] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:10 2022] GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12 => generated 1275 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:10.302676 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b45f2e5d-108d-4194-8bf7-f3a4d550a927 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Action: 'update', calling method: .version_select at 0x7f9e24dab820>, body: {"quota_set": {"ram": "2048"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:10.411379 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b45f2e5d-108d-4194-8bf7-f3a4d550a927 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:10.412125 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b45f2e5d-108d-4194-8bf7-f3a4d550a927 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:10.412841 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b45f2e5d-108d-4194-8bf7-f3a4d550a927 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:10.413999 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b45f2e5d-108d-4194-8bf7-f3a4d550a927 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:10.414626 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b45f2e5d-108d-4194-8bf7-f3a4d550a927 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:10.415377 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b45f2e5d-108d-4194-8bf7-f3a4d550a927 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:10.478651 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b45f2e5d-108d-4194-8bf7-f3a4d550a927 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:10.481477 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b45f2e5d-108d-4194-8bf7-f3a4d550a927 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:10.482191 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b45f2e5d-108d-4194-8bf7-f3a4d550a927 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:10.484212 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b45f2e5d-108d-4194-8bf7-f3a4d550a927 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:10.484727 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b45f2e5d-108d-4194-8bf7-f3a4d550a927 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:10.485165 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b45f2e5d-108d-4194-8bf7-f3a4d550a927 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:10.547951 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b78785aa-5757-42d5-97a9-b9df7bc78afd tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:10.578192 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:10.584159 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b78785aa-5757-42d5-97a9-b9df7bc78afd tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:10.587578 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b45f2e5d-108d-4194-8bf7-f3a4d550a927 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/cc27df5d850c4a258e9476177a0e0490?user_id=e8399b1beb35424eab48124850ef4f42" status: 200 len: 328 microversion: 2.1 time: 0.288936 Aug 07 01:12:10.589319 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 305/544] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Aug 7 01:12:10 2022] PUT /compute/v2.1/os-quota-sets/cc27df5d850c4a258e9476177a0e0490?user_id=e8399b1beb35424eab48124850ef4f42 => generated 328 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:10.590291 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b78785aa-5757-42d5-97a9-b9df7bc78afd tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:10.599377 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1b045294-ee13-4f18-84bb-c424c30d93ad tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:10.600524 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1b045294-ee13-4f18-84bb-c424c30d93ad tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:10.607324 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b78785aa-5757-42d5-97a9-b9df7bc78afd tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1452 microversion: 2.75 time: 0.690385 Aug 07 01:12:10.609139 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 240/545] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:12:09 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1452 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:12:10.616161 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b045294-ee13-4f18-84bb-c424c30d93ad tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:10.618365 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b045294-ee13-4f18-84bb-c424c30d93ad tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:10.619189 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b045294-ee13-4f18-84bb-c424c30d93ad tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:10.620656 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b045294-ee13-4f18-84bb-c424c30d93ad tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:10.621771 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b045294-ee13-4f18-84bb-c424c30d93ad tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:10.622407 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-88c9d275-4674-4b7f-90ea-6afcb32e7991 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:10.622580 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b045294-ee13-4f18-84bb-c424c30d93ad tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:10.624394 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-88c9d275-4674-4b7f-90ea-6afcb32e7991 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: b8d0c259-b533-4396-b916-8861a321b930] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:10.638646 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-88c9d275-4674-4b7f-90ea-6afcb32e7991 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:10.640091 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-88c9d275-4674-4b7f-90ea-6afcb32e7991 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:10.641073 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-88c9d275-4674-4b7f-90ea-6afcb32e7991 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:10.642673 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-88c9d275-4674-4b7f-90ea-6afcb32e7991 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:10.644789 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-88c9d275-4674-4b7f-90ea-6afcb32e7991 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:10.645894 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-88c9d275-4674-4b7f-90ea-6afcb32e7991 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:10.775185 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1b045294-ee13-4f18-84bb-c424c30d93ad tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:10.785323 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1b045294-ee13-4f18-84bb-c424c30d93ad tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79" status: 200 len: 1215 microversion: 2.1 time: 0.193993 Aug 07 01:12:10.786454 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 306/546] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:10 2022] GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79 => generated 1215 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:10.794870 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ca465305-2aaf-4532-9b14-9cb38f6f729d tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:10.796155 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ca465305-2aaf-4532-9b14-9cb38f6f729d tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 2125f4ff-9031-486f-8b5f-85082bf81588] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:10.805157 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca465305-2aaf-4532-9b14-9cb38f6f729d tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:10.805424 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca465305-2aaf-4532-9b14-9cb38f6f729d tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:10.805957 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca465305-2aaf-4532-9b14-9cb38f6f729d tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:10.806806 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca465305-2aaf-4532-9b14-9cb38f6f729d tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:10.807421 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca465305-2aaf-4532-9b14-9cb38f6f729d tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:10.808023 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca465305-2aaf-4532-9b14-9cb38f6f729d tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:11.069108 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ca465305-2aaf-4532-9b14-9cb38f6f729d tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:11.085325 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ca465305-2aaf-4532-9b14-9cb38f6f729d tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588" status: 200 len: 1520 microversion: 2.1 time: 0.296671 Aug 07 01:12:11.085888 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 307/547] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:10 2022] GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588 => generated 1520 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:11.093827 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-54a9baf0-e07a-4512-91ba-bb55f9162f5e tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Calling method '.version_select at 0x7f9e24bd2940>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:11.126804 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-88c9d275-4674-4b7f-90ea-6afcb32e7991 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0200a0753e46399d0b212c665aebce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7279db9d4f497b8430fd45280b5da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:11.139389 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-88c9d275-4674-4b7f-90ea-6afcb32e7991 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] 10.222.0.39 "GET /compute/v2.1/servers/b8d0c259-b533-4396-b916-8861a321b930" status: 200 len: 1319 microversion: 2.1 time: 0.528371 Aug 07 01:12:11.141633 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 241/548] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:10 2022] GET /compute/v2.1/servers/b8d0c259-b533-4396-b916-8861a321b930 => generated 1319 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:11.149493 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5cba705e-2eed-494b-b77b-c0025b2991d3 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:11.150142 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5cba705e-2eed-494b-b77b-c0025b2991d3 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 7ab29f8e-4b84-4038-a60f-efc93d0358ce] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:11.165192 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5cba705e-2eed-494b-b77b-c0025b2991d3 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:11.166611 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5cba705e-2eed-494b-b77b-c0025b2991d3 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:11.167986 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5cba705e-2eed-494b-b77b-c0025b2991d3 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:11.170913 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5cba705e-2eed-494b-b77b-c0025b2991d3 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:11.171794 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5cba705e-2eed-494b-b77b-c0025b2991d3 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:11.172546 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5cba705e-2eed-494b-b77b-c0025b2991d3 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:11.248713 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-54a9baf0-e07a-4512-91ba-bb55f9162f5e tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/cc27df5d850c4a258e9476177a0e0490?user_id=e8399b1beb35424eab48124850ef4f42" status: 200 len: 370 microversion: 2.1 time: 0.160845 Aug 07 01:12:11.250190 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 308/549] 10.222.0.39 () {58 vars in 1323 bytes} [Sun Aug 7 01:12:11 2022] GET /compute/v2.1/os-quota-sets/cc27df5d850c4a258e9476177a0e0490?user_id=e8399b1beb35424eab48124850ef4f42 => generated 370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:11.260409 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7a0d1994-ee5d-4525-89e9-7424ca493fca tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1347598380", "metadata": {"": ""}}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:11.269398 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7a0d1994-ee5d-4525-89e9-7424ca493fca tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Request method failure captured: Aug 07 01:12:11.269398 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588/action HTTP/1.1 Aug 07 01:12:11.269398 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:12:11.269398 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:12:11.269398 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:12:11.269398 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 107 Aug 07 01:12:11.269398 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:12:11.269398 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:12:11.269398 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:12:11.269398 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:12:11.269398 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xFJvA8aViwvAloPsDf2VckLIvT0ef2dFkqEzqRHcsoXzKL-UrjSbgq9qrhn-Kr0K6IWORgsxpa0ZC6p7prEjOQjpXXrO_P6Q36zbcHdiXbdtz0b1lfjcwupDS07IycJWoRXidnJpp03pTzYbxhgdiNsodOZkAAXZnRnVK8CHn-Gq7M Aug 07 01:12:11.269398 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:12:11.269398 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:12:11.269398 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:12:11.269398 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:12:11.269398 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:12:11.269398 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:12:11.269398 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 4e443158f15b42a3a795950a7c409a38 Aug 07 01:12:11.269398 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:12:11.269398 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:12:11.269398 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:12:11.271006 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4e443158f15b42a3a795950a7c409a38", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:12:11.271006 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:12:11.271006 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 4e443158f15b42a3a795950a7c409a38 Aug 07 01:12:11.271006 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:12:11.271006 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ImagesOneServerNegativeTestJSON-439364583-project Aug 07 01:12:11.271006 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:12:11.271006 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:12:11.271006 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: c135ba135fd946149ace9a86c7c52e80 Aug 07 01:12:11.271006 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-439364583-project Aug 07 01:12:11.271006 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:12:11.271006 n-d-master-1 devstack@n-api.service[119516]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1347598380", "metadata": {"": ""}}} Aug 07 01:12:11.271006 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:12:11.272110 n-d-master-1 devstack@n-api.service[119516]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 07 01:12:11.272110 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '2125f4ff-9031-486f-8b5f-85082bf81588', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1347598380', 'metadata': {'': ''}}}} Aug 07 01:12:11.272110 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:12:11.272110 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:12:11.272110 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:12:11.272110 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:12:11.272110 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:12:11.272110 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:12:11.272110 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 07 01:12:11.272110 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:11.272110 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 07 01:12:11.272110 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 07 01:12:11.272110 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 07 01:12:11.272110 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 07 01:12:11.272110 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 07 01:12:11.272110 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:11.272110 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 07 01:12:11.272110 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi {'': ''} Aug 07 01:12:11.272110 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:11.272110 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:12:11.272110 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:11.273405 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:12:11.273405 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:12:11.273405 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:12:11.273405 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:12:11.273405 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:12:11.273405 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:12:11.273405 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:12:11.273405 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:12:11.273405 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:12:11.273405 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:12:11.273405 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:12:11.273405 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:12:11.273405 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:12:11.273405 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:12:11.273405 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:12:11.273405 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 07 01:12:11.273405 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:11.273405 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:12:11.273405 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:11.273405 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:12:11.274916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:12:11.274916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:12:11.274916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:12:11.274916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:12:11.274916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 07 01:12:11.274916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:11.274916 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7a0d1994-ee5d-4525-89e9-7424ca493fca tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:12:11.274916 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7a0d1994-ee5d-4525-89e9-7424ca493fca tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "POST /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588/action" status: 400 len: 170 microversion: 2.1 time: 0.020188 Aug 07 01:12:11.274916 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 309/550] 10.222.0.39 () {60 vars in 1279 bytes} [Sun Aug 7 01:12:11 2022] POST /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588/action => generated 170 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:12:11.282838 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-0baf0b19-c95d-4e3d-9c7a-76d84bb4cc61 req-ecff9ae8-152e-440d-a1ae-7de9b603c689 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8d0c259-b533-4396-b916-8861a321b930", "tag": "fdb8dc2b-c46d-407e-98a9-a59700aa7ef9"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:11.301582 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0baf0b19-c95d-4e3d-9c7a-76d84bb4cc61 req-ecff9ae8-152e-440d-a1ae-7de9b603c689 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:11.302261 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0baf0b19-c95d-4e3d-9c7a-76d84bb4cc61 req-ecff9ae8-152e-440d-a1ae-7de9b603c689 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:11.303030 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0baf0b19-c95d-4e3d-9c7a-76d84bb4cc61 req-ecff9ae8-152e-440d-a1ae-7de9b603c689 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:11.332125 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-0baf0b19-c95d-4e3d-9c7a-76d84bb4cc61 req-ecff9ae8-152e-440d-a1ae-7de9b603c689 service nova] Creating event network-changed:fdb8dc2b-c46d-407e-98a9-a59700aa7ef9 for instance b8d0c259-b533-4396-b916-8861a321b930 on n-h1-master-1 Aug 07 01:12:11.343957 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-0baf0b19-c95d-4e3d-9c7a-76d84bb4cc61 req-ecff9ae8-152e-440d-a1ae-7de9b603c689 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066474 Aug 07 01:12:11.345600 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 310/551] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:11.365237 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ef982a80-6f82-46ff-9d8e-b8f76bbd7e37 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:11.367085 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ef982a80-6f82-46ff-9d8e-b8f76bbd7e37 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 2125f4ff-9031-486f-8b5f-85082bf81588] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:11.380814 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef982a80-6f82-46ff-9d8e-b8f76bbd7e37 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:11.382317 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef982a80-6f82-46ff-9d8e-b8f76bbd7e37 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:11.383276 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef982a80-6f82-46ff-9d8e-b8f76bbd7e37 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:11.385051 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef982a80-6f82-46ff-9d8e-b8f76bbd7e37 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:11.386292 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef982a80-6f82-46ff-9d8e-b8f76bbd7e37 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:11.387191 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef982a80-6f82-46ff-9d8e-b8f76bbd7e37 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:11.601541 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5cba705e-2eed-494b-b77b-c0025b2991d3 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d08a2479f847b4b06d6690f1aedb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06211ba44e4f6d88f9095969001aab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:11.621375 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5cba705e-2eed-494b-b77b-c0025b2991d3 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "GET /compute/v2.1/servers/7ab29f8e-4b84-4038-a60f-efc93d0358ce" status: 200 len: 1389 microversion: 2.1 time: 0.479445 Aug 07 01:12:11.622848 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 242/552] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:11 2022] GET /compute/v2.1/servers/7ab29f8e-4b84-4038-a60f-efc93d0358ce => generated 1389 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:11.632041 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b4146cec-d7a1-43bc-ab28-49b13ea820e5 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:11.633004 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b4146cec-d7a1-43bc-ab28-49b13ea820e5 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] [instance: a038208d-dae8-432d-97e5-2a58ea093e12] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:11.650157 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b4146cec-d7a1-43bc-ab28-49b13ea820e5 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:11.651094 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b4146cec-d7a1-43bc-ab28-49b13ea820e5 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:11.651908 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b4146cec-d7a1-43bc-ab28-49b13ea820e5 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:11.652998 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b4146cec-d7a1-43bc-ab28-49b13ea820e5 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:11.653659 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b4146cec-d7a1-43bc-ab28-49b13ea820e5 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:11.654091 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b4146cec-d7a1-43bc-ab28-49b13ea820e5 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:11.660265 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ef982a80-6f82-46ff-9d8e-b8f76bbd7e37 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:11.672887 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ef982a80-6f82-46ff-9d8e-b8f76bbd7e37 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588" status: 200 len: 1520 microversion: 2.1 time: 0.324634 Aug 07 01:12:11.685155 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 311/553] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:11 2022] GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588 => generated 1520 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:11.698243 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3b4bcf33-310b-4027-89c0-59f1136bd5ca tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:11.699061 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3b4bcf33-310b-4027-89c0-59f1136bd5ca tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:11.715753 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b4bcf33-310b-4027-89c0-59f1136bd5ca tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:11.716428 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b4bcf33-310b-4027-89c0-59f1136bd5ca tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:11.716935 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b4bcf33-310b-4027-89c0-59f1136bd5ca tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:11.718197 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b4bcf33-310b-4027-89c0-59f1136bd5ca tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:11.718913 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b4bcf33-310b-4027-89c0-59f1136bd5ca tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:11.719455 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b4bcf33-310b-4027-89c0-59f1136bd5ca tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:11.818068 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3b4bcf33-310b-4027-89c0-59f1136bd5ca tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:11.835407 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3b4bcf33-310b-4027-89c0-59f1136bd5ca tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:11.837240 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3b4bcf33-310b-4027-89c0-59f1136bd5ca tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:11.844640 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3b4bcf33-310b-4027-89c0-59f1136bd5ca tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1437 microversion: 2.75 time: 0.157904 Aug 07 01:12:11.845587 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 312/554] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:12:11 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1437 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:12:11.851138 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-47fbd2a7-1d49-4550-98b1-79d04018984b tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:11.851752 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-47fbd2a7-1d49-4550-98b1-79d04018984b tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 2125f4ff-9031-486f-8b5f-85082bf81588] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:11.865528 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-47fbd2a7-1d49-4550-98b1-79d04018984b tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:11.866303 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-47fbd2a7-1d49-4550-98b1-79d04018984b tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:11.866912 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-47fbd2a7-1d49-4550-98b1-79d04018984b tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:11.869709 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-47fbd2a7-1d49-4550-98b1-79d04018984b tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:11.870322 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-47fbd2a7-1d49-4550-98b1-79d04018984b tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:11.870952 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-47fbd2a7-1d49-4550-98b1-79d04018984b tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:12.062040 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-47fbd2a7-1d49-4550-98b1-79d04018984b tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:12.079482 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-47fbd2a7-1d49-4550-98b1-79d04018984b tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588" status: 200 len: 1520 microversion: 2.1 time: 0.230077 Aug 07 01:12:12.080420 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 313/555] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:11 2022] GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588 => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:12.097589 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-646493e3-d6dd-4f33-a4e7-1650d7305281 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Calling method '.version_select at 0x7f9e24c13790>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:12.143043 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b4146cec-d7a1-43bc-ab28-49b13ea820e5 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0d09d844bf453cb3e2637d630614ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5c39a06e41406a8c6c99d2e84ab282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:12.148801 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b4146cec-d7a1-43bc-ab28-49b13ea820e5 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12" status: 200 len: 1317 microversion: 2.1 time: 0.524228 Aug 07 01:12:12.149396 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 243/556] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:11 2022] GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12 => generated 1317 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:12.165094 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4a0ec44e-6c65-446d-8dd4-498cf7ef6f2a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:12.166933 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4a0ec44e-6c65-446d-8dd4-498cf7ef6f2a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:12.185526 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4a0ec44e-6c65-446d-8dd4-498cf7ef6f2a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:12.186134 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4a0ec44e-6c65-446d-8dd4-498cf7ef6f2a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:12.188132 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4a0ec44e-6c65-446d-8dd4-498cf7ef6f2a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:12.191204 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4a0ec44e-6c65-446d-8dd4-498cf7ef6f2a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:12.192243 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4a0ec44e-6c65-446d-8dd4-498cf7ef6f2a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:12.193207 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4a0ec44e-6c65-446d-8dd4-498cf7ef6f2a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:12.387853 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-646493e3-d6dd-4f33-a4e7-1650d7305281 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/4651068d5dc542b3aee65535e104867b/defaults" status: 200 len: 371 microversion: 2.1 time: 0.301622 Aug 07 01:12:12.388473 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 314/557] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Aug 7 01:12:12 2022] GET /compute/v2.1/os-quota-sets/4651068d5dc542b3aee65535e104867b/defaults => generated 371 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:12.442105 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4a0ec44e-6c65-446d-8dd4-498cf7ef6f2a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:12.453272 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4a0ec44e-6c65-446d-8dd4-498cf7ef6f2a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79" status: 200 len: 1271 microversion: 2.1 time: 0.296423 Aug 07 01:12:12.453902 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 244/558] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:12 2022] GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79 => generated 1271 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:12.478175 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4270f23a-2a7d-43df-86af-3c43e8e4f9ab tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1360059461", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:12.497765 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4270f23a-2a7d-43df-86af-3c43e8e4f9ab tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Request method failure captured: Aug 07 01:12:12.497765 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588/action HTTP/1.1 Aug 07 01:12:12.497765 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:12:12.497765 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:12:12.497765 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:12:12.497765 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 619 Aug 07 01:12:12.497765 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:12:12.497765 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:12:12.497765 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:12:12.497765 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:12:12.497765 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xFJvA8aViwvAloPsDf2VckLIvT0ef2dFkqEzqRHcsoXzKL-UrjSbgq9qrhn-Kr0K6IWORgsxpa0ZC6p7prEjOQjpXXrO_P6Q36zbcHdiXbdtz0b1lfjcwupDS07IycJWoRXidnJpp03pTzYbxhgdiNsodOZkAAXZnRnVK8CHn-Gq7M Aug 07 01:12:12.497765 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:12:12.497765 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:12:12.497765 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:12:12.497765 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:12:12.497765 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:12:12.497765 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:12:12.497765 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 4e443158f15b42a3a795950a7c409a38 Aug 07 01:12:12.497765 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:12:12.497765 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:12:12.497765 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:12:12.500853 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4e443158f15b42a3a795950a7c409a38", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:12:12.500853 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:12:12.500853 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 4e443158f15b42a3a795950a7c409a38 Aug 07 01:12:12.500853 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:12:12.500853 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ImagesOneServerNegativeTestJSON-439364583-project Aug 07 01:12:12.500853 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:12:12.500853 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:12:12.500853 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: c135ba135fd946149ace9a86c7c52e80 Aug 07 01:12:12.500853 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-439364583-project Aug 07 01:12:12.500853 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:12:12.501984 n-d-master-1 devstack@n-api.service[119517]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1360059461", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 07 01:12:12.501984 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:12:12.501984 n-d-master-1 devstack@n-api.service[119517]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 07 01:12:12.502399 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '2125f4ff-9031-486f-8b5f-85082bf81588', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1360059461', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 07 01:12:12.502399 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:12:12.502399 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:12:12.502399 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:12:12.502399 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:12:12.502399 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:12:12.502399 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:12:12.502399 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 07 01:12:12.502399 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:12:12.502399 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 07 01:12:12.502399 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 07 01:12:12.504195 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 07 01:12:12.504195 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 07 01:12:12.504195 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 07 01:12:12.504195 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:12:12.504195 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 07 01:12:12.504195 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 07 01:12:12.504195 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:12:12.504195 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:12:12.504195 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:12:12.504195 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:12:12.504195 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:12:12.504195 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:12:12.504195 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:12:12.504195 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:12:12.504195 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:12:12.504195 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:12:12.504195 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:12:12.506273 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:12:12.506273 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:12:12.506273 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:12:12.506273 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:12:12.506273 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:12:12.506273 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:12:12.506273 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:12:12.506273 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 07 01:12:12.506273 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:12:12.506273 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:12:12.506273 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:12:12.506273 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:12:12.507590 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:12:12.507590 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:12:12.507590 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:12:12.507590 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:12:12.507590 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 07 01:12:12.507590 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:12:12.512758 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4270f23a-2a7d-43df-86af-3c43e8e4f9ab tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:12:12.513173 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4270f23a-2a7d-43df-86af-3c43e8e4f9ab tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "POST /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588/action" status: 400 len: 938 microversion: 2.1 time: 0.048205 Aug 07 01:12:12.514235 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 245/559] 10.222.0.39 () {60 vars in 1279 bytes} [Sun Aug 7 01:12:12 2022] POST /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588/action => generated 938 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:12:12.521604 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0d2331fb-ad62-41da-9cdf-a45cb5259ae1 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:12.523025 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0d2331fb-ad62-41da-9cdf-a45cb5259ae1 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: b8d0c259-b533-4396-b916-8861a321b930] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:12.532388 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d2331fb-ad62-41da-9cdf-a45cb5259ae1 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:12.533001 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d2331fb-ad62-41da-9cdf-a45cb5259ae1 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:12.533975 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d2331fb-ad62-41da-9cdf-a45cb5259ae1 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:12.534703 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d2331fb-ad62-41da-9cdf-a45cb5259ae1 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:12.535451 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d2331fb-ad62-41da-9cdf-a45cb5259ae1 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:12.535996 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d2331fb-ad62-41da-9cdf-a45cb5259ae1 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:12.592025 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ac48fef5-9cec-4ce9-9f71-a92146ec6eb6 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:12.597621 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ac48fef5-9cec-4ce9-9f71-a92146ec6eb6 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:12.610575 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac48fef5-9cec-4ce9-9f71-a92146ec6eb6 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:12.611492 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac48fef5-9cec-4ce9-9f71-a92146ec6eb6 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:12.613174 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac48fef5-9cec-4ce9-9f71-a92146ec6eb6 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:12.614549 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac48fef5-9cec-4ce9-9f71-a92146ec6eb6 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:12.615411 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac48fef5-9cec-4ce9-9f71-a92146ec6eb6 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:12.616252 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac48fef5-9cec-4ce9-9f71-a92146ec6eb6 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:12.771421 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-ac48fef5-9cec-4ce9-9f71-a92146ec6eb6 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:12:12.772515 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-ac48fef5-9cec-4ce9-9f71-a92146ec6eb6 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:12:12.773574 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-ac48fef5-9cec-4ce9-9f71-a92146ec6eb6 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:12:12.774500 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-ac48fef5-9cec-4ce9-9f71-a92146ec6eb6 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:12:12.775279 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-ac48fef5-9cec-4ce9-9f71-a92146ec6eb6 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:12:12.894060 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ac48fef5-9cec-4ce9-9f71-a92146ec6eb6 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:12.910636 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac48fef5-9cec-4ce9-9f71-a92146ec6eb6 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:12.911851 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac48fef5-9cec-4ce9-9f71-a92146ec6eb6 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:12.912976 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac48fef5-9cec-4ce9-9f71-a92146ec6eb6 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:12.916166 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac48fef5-9cec-4ce9-9f71-a92146ec6eb6 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:12.916166 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac48fef5-9cec-4ce9-9f71-a92146ec6eb6 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:12.917031 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac48fef5-9cec-4ce9-9f71-a92146ec6eb6 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:12.989747 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0d2331fb-ad62-41da-9cdf-a45cb5259ae1 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0200a0753e46399d0b212c665aebce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7279db9d4f497b8430fd45280b5da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:13.004394 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0d2331fb-ad62-41da-9cdf-a45cb5259ae1 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] 10.222.0.39 "GET /compute/v2.1/servers/b8d0c259-b533-4396-b916-8861a321b930" status: 200 len: 1319 microversion: 2.1 time: 0.488719 Aug 07 01:12:13.005381 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 246/560] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:12 2022] GET /compute/v2.1/servers/b8d0c259-b533-4396-b916-8861a321b930 => generated 1319 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:13.012882 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8385768a-3f2b-497a-888d-46625d3181b0 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Action: 'update', calling method: .version_select at 0x7f9e24a46ee0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:13.130469 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-ac48fef5-9cec-4ce9-9f71-a92146ec6eb6 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lazy-loading 'services' on Instance uuid 2a4de302-ab36-4e7a-90b5-d72d3dc5d698 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:12:13.140903 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8385768a-3f2b-497a-888d-46625d3181b0 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:13.141618 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8385768a-3f2b-497a-888d-46625d3181b0 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:13.142578 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8385768a-3f2b-497a-888d-46625d3181b0 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:13.144028 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8385768a-3f2b-497a-888d-46625d3181b0 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:13.145239 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8385768a-3f2b-497a-888d-46625d3181b0 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:13.145941 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8385768a-3f2b-497a-888d-46625d3181b0 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:13.260782 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ac48fef5-9cec-4ce9-9f71-a92146ec6eb6 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698/action" status: 202 len: 1940 microversion: 2.75 time: 0.870655 Aug 07 01:12:13.279932 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 315/561] 10.222.0.39 () {62 vars in 1319 bytes} [Sun Aug 7 01:12:12 2022] POST /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698/action => generated 1940 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 07 01:12:13.279932 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cfc3a404-60d1-48d6-8a9c-8ed0c989f485 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:13.279932 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cfc3a404-60d1-48d6-8a9c-8ed0c989f485 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 2125f4ff-9031-486f-8b5f-85082bf81588] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:13.283620 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfc3a404-60d1-48d6-8a9c-8ed0c989f485 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:13.285177 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfc3a404-60d1-48d6-8a9c-8ed0c989f485 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:13.285919 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfc3a404-60d1-48d6-8a9c-8ed0c989f485 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:13.287127 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfc3a404-60d1-48d6-8a9c-8ed0c989f485 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:13.287952 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfc3a404-60d1-48d6-8a9c-8ed0c989f485 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:13.288667 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfc3a404-60d1-48d6-8a9c-8ed0c989f485 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:13.441284 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=2,nova_api:INSERT=14 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:13.509840 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cfc3a404-60d1-48d6-8a9c-8ed0c989f485 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:13.527097 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cfc3a404-60d1-48d6-8a9c-8ed0c989f485 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588" status: 200 len: 1520 microversion: 2.1 time: 0.262849 Aug 07 01:12:13.541847 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 316/562] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:13 2022] GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588 => generated 1520 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:13.553688 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-418f76b5-21e3-493a-8f80-781dd3072e77 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:13.554330 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-418f76b5-21e3-493a-8f80-781dd3072e77 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 7ab29f8e-4b84-4038-a60f-efc93d0358ce] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:13.576465 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-418f76b5-21e3-493a-8f80-781dd3072e77 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:13.577807 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-418f76b5-21e3-493a-8f80-781dd3072e77 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:13.578191 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8385768a-3f2b-497a-888d-46625d3181b0 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/4651068d5dc542b3aee65535e104867b" status: 200 len: 329 microversion: 2.1 time: 0.571215 Aug 07 01:12:13.579372 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-418f76b5-21e3-493a-8f80-781dd3072e77 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:13.579710 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 247/563] 10.222.0.39 () {60 vars in 1263 bytes} [Sun Aug 7 01:12:13 2022] PUT /compute/v2.1/os-quota-sets/4651068d5dc542b3aee65535e104867b => generated 329 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:13.581573 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-418f76b5-21e3-493a-8f80-781dd3072e77 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:13.582428 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-418f76b5-21e3-493a-8f80-781dd3072e77 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:13.583133 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-418f76b5-21e3-493a-8f80-781dd3072e77 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:13.587537 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-92608df0-4c20-4029-a697-0853912b534a tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:13.588236 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-92608df0-4c20-4029-a697-0853912b534a tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] [instance: a038208d-dae8-432d-97e5-2a58ea093e12] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:13.599543 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-92608df0-4c20-4029-a697-0853912b534a tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:13.600472 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-92608df0-4c20-4029-a697-0853912b534a tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:13.607005 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-92608df0-4c20-4029-a697-0853912b534a tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:13.607005 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-92608df0-4c20-4029-a697-0853912b534a tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:13.607005 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-92608df0-4c20-4029-a697-0853912b534a tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:13.607005 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-92608df0-4c20-4029-a697-0853912b534a tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:13.848371 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-418f76b5-21e3-493a-8f80-781dd3072e77 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d08a2479f847b4b06d6690f1aedb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06211ba44e4f6d88f9095969001aab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:13.855610 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:13.866399 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-418f76b5-21e3-493a-8f80-781dd3072e77 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "GET /compute/v2.1/servers/7ab29f8e-4b84-4038-a60f-efc93d0358ce" status: 200 len: 1589 microversion: 2.1 time: 0.323052 Aug 07 01:12:13.867437 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 317/564] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:13 2022] GET /compute/v2.1/servers/7ab29f8e-4b84-4038-a60f-efc93d0358ce => generated 1589 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:13.876632 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9f9cfd1b-7023-46d6-9273-218feda2778d tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:13.877446 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9f9cfd1b-7023-46d6-9273-218feda2778d tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:13.885533 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f9cfd1b-7023-46d6-9273-218feda2778d tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:13.886069 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f9cfd1b-7023-46d6-9273-218feda2778d tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:13.886746 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f9cfd1b-7023-46d6-9273-218feda2778d tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:13.887402 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f9cfd1b-7023-46d6-9273-218feda2778d tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:13.887991 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f9cfd1b-7023-46d6-9273-218feda2778d tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:13.888575 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f9cfd1b-7023-46d6-9273-218feda2778d tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:14.008303 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-9f9cfd1b-7023-46d6-9273-218feda2778d tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lazy-loading 'services' on Instance uuid 2a4de302-ab36-4e7a-90b5-d72d3dc5d698 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:12:14.046596 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9f9cfd1b-7023-46d6-9273-218feda2778d tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1927 microversion: 2.75 time: 0.176265 Aug 07 01:12:14.047872 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 318/565] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:12:13 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1927 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:12:14.057236 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bb0f62fd-2a9d-4f4d-a5fa-160ab1a17bd5 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:14.058403 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bb0f62fd-2a9d-4f4d-a5fa-160ab1a17bd5 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:14.069354 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb0f62fd-2a9d-4f4d-a5fa-160ab1a17bd5 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:14.070068 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb0f62fd-2a9d-4f4d-a5fa-160ab1a17bd5 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:14.070607 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb0f62fd-2a9d-4f4d-a5fa-160ab1a17bd5 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:14.071334 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb0f62fd-2a9d-4f4d-a5fa-160ab1a17bd5 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:14.072056 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb0f62fd-2a9d-4f4d-a5fa-160ab1a17bd5 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:14.072527 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb0f62fd-2a9d-4f4d-a5fa-160ab1a17bd5 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:14.148288 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bb0f62fd-2a9d-4f4d-a5fa-160ab1a17bd5 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:14.162420 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bb0f62fd-2a9d-4f4d-a5fa-160ab1a17bd5 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79" status: 200 len: 1269 microversion: 2.1 time: 0.113065 Aug 07 01:12:14.163026 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 319/566] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:14 2022] GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79 => generated 1269 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:14.168629 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8d490ad2-8da2-4d6c-9c76-249d1fd44d12 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:14.169377 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8d490ad2-8da2-4d6c-9c76-249d1fd44d12 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 2125f4ff-9031-486f-8b5f-85082bf81588] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:14.176595 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d490ad2-8da2-4d6c-9c76-249d1fd44d12 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:14.177220 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d490ad2-8da2-4d6c-9c76-249d1fd44d12 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:14.177737 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d490ad2-8da2-4d6c-9c76-249d1fd44d12 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:14.178589 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d490ad2-8da2-4d6c-9c76-249d1fd44d12 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:14.179347 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d490ad2-8da2-4d6c-9c76-249d1fd44d12 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:14.179527 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d490ad2-8da2-4d6c-9c76-249d1fd44d12 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:14.342863 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8d490ad2-8da2-4d6c-9c76-249d1fd44d12 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:14.351803 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8d490ad2-8da2-4d6c-9c76-249d1fd44d12 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588" status: 200 len: 1520 microversion: 2.1 time: 0.187709 Aug 07 01:12:14.355476 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 320/567] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:14 2022] GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:14.357354 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-03d64ecd-650a-4473-9230-58e8a1279086 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Action: 'update', calling method: .version_select at 0x7f9e24af8f70>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:14.427265 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-03d64ecd-650a-4473-9230-58e8a1279086 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:14.427767 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-03d64ecd-650a-4473-9230-58e8a1279086 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:14.428244 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-03d64ecd-650a-4473-9230-58e8a1279086 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:14.429009 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-03d64ecd-650a-4473-9230-58e8a1279086 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:14.429482 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-03d64ecd-650a-4473-9230-58e8a1279086 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:14.429903 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-03d64ecd-650a-4473-9230-58e8a1279086 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:14.459669 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-92608df0-4c20-4029-a697-0853912b534a tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0d09d844bf453cb3e2637d630614ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5c39a06e41406a8c6c99d2e84ab282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:14.469010 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-92608df0-4c20-4029-a697-0853912b534a tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12" status: 200 len: 1317 microversion: 2.1 time: 0.887776 Aug 07 01:12:14.470142 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 248/568] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:13 2022] GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12 => generated 1317 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:14.475320 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-029c442c-e1f9-4417-9230-4e5f8b8c33bd tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:14.475731 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-029c442c-e1f9-4417-9230-4e5f8b8c33bd tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 7ab29f8e-4b84-4038-a60f-efc93d0358ce] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:14.483875 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-029c442c-e1f9-4417-9230-4e5f8b8c33bd tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:14.484513 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-029c442c-e1f9-4417-9230-4e5f8b8c33bd tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:14.484961 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-029c442c-e1f9-4417-9230-4e5f8b8c33bd tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:14.485690 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-029c442c-e1f9-4417-9230-4e5f8b8c33bd tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:14.486153 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-029c442c-e1f9-4417-9230-4e5f8b8c33bd tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:14.486633 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-029c442c-e1f9-4417-9230-4e5f8b8c33bd tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:14.720087 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-029c442c-e1f9-4417-9230-4e5f8b8c33bd tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "GET /compute/v2.1/servers/7ab29f8e-4b84-4038-a60f-efc93d0358ce/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.248391 Aug 07 01:12:14.724645 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 249/569] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Aug 7 01:12:14 2022] GET /compute/v2.1/servers/7ab29f8e-4b84-4038-a60f-efc93d0358ce/os-interface => generated 285 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:14.738426 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-57fbb6a4-8a7f-4263-9aeb-633414ec04fa tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:14.739384 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-57fbb6a4-8a7f-4263-9aeb-633414ec04fa tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: b8d0c259-b533-4396-b916-8861a321b930] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:14.748908 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-57fbb6a4-8a7f-4263-9aeb-633414ec04fa tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:14.750667 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-57fbb6a4-8a7f-4263-9aeb-633414ec04fa tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:14.751659 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-57fbb6a4-8a7f-4263-9aeb-633414ec04fa tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:14.753164 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-57fbb6a4-8a7f-4263-9aeb-633414ec04fa tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:14.753922 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-57fbb6a4-8a7f-4263-9aeb-633414ec04fa tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:14.754536 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-57fbb6a4-8a7f-4263-9aeb-633414ec04fa tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:14.810856 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=12,nova_api:UPDATE=12 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:14.896666 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-03d64ecd-650a-4473-9230-58e8a1279086 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/4651068d5dc542b3aee65535e104867b" status: 200 len: 329 microversion: 2.1 time: 0.542436 Aug 07 01:12:14.904309 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 321/570] 10.222.0.39 () {60 vars in 1263 bytes} [Sun Aug 7 01:12:14 2022] PUT /compute/v2.1/os-quota-sets/4651068d5dc542b3aee65535e104867b => generated 329 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:14.920078 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-fdd4c04c-df78-4cf4-9174-3a643e78ef81 req-2f550032-16fa-4eb1-b803-5d98708e4f9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a038208d-dae8-432d-97e5-2a58ea093e12", "tag": "34e132f0-6845-4fef-bc5f-494eced57c6a"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:14.941984 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-fdd4c04c-df78-4cf4-9174-3a643e78ef81 req-2f550032-16fa-4eb1-b803-5d98708e4f9b service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:14.943971 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-fdd4c04c-df78-4cf4-9174-3a643e78ef81 req-2f550032-16fa-4eb1-b803-5d98708e4f9b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:14.947211 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-fdd4c04c-df78-4cf4-9174-3a643e78ef81 req-2f550032-16fa-4eb1-b803-5d98708e4f9b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:14.972610 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-fdd4c04c-df78-4cf4-9174-3a643e78ef81 req-2f550032-16fa-4eb1-b803-5d98708e4f9b service nova] Creating event network-changed:34e132f0-6845-4fef-bc5f-494eced57c6a for instance a038208d-dae8-432d-97e5-2a58ea093e12 on n-h2-master-1 Aug 07 01:12:14.988201 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-fdd4c04c-df78-4cf4-9174-3a643e78ef81 req-2f550032-16fa-4eb1-b803-5d98708e4f9b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084646 Aug 07 01:12:14.988960 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 322/571] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:15.001759 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9659c4b3-e883-4b80-bd3d-5d8cbf10ad4f tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:15.015379 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9659c4b3-e883-4b80-bd3d-5d8cbf10ad4f tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Request method failure captured: Aug 07 01:12:15.015379 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588/action HTTP/1.1 Aug 07 01:12:15.015379 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:12:15.015379 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:12:15.015379 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:12:15.015379 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 285 Aug 07 01:12:15.015379 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:12:15.015379 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:12:15.015379 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:12:15.015379 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:12:15.015379 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xFJvA8aViwvAloPsDf2VckLIvT0ef2dFkqEzqRHcsoXzKL-UrjSbgq9qrhn-Kr0K6IWORgsxpa0ZC6p7prEjOQjpXXrO_P6Q36zbcHdiXbdtz0b1lfjcwupDS07IycJWoRXidnJpp03pTzYbxhgdiNsodOZkAAXZnRnVK8CHn-Gq7M Aug 07 01:12:15.015379 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:12:15.015379 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:12:15.015379 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:12:15.015379 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:12:15.015379 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:12:15.015379 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:12:15.015379 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 4e443158f15b42a3a795950a7c409a38 Aug 07 01:12:15.015379 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:12:15.015379 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:12:15.015379 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:12:15.017095 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4e443158f15b42a3a795950a7c409a38", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:12:15.017095 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:12:15.017095 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 4e443158f15b42a3a795950a7c409a38 Aug 07 01:12:15.017095 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:12:15.017095 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ImagesOneServerNegativeTestJSON-439364583-project Aug 07 01:12:15.017095 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:12:15.017095 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:12:15.017095 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: c135ba135fd946149ace9a86c7c52e80 Aug 07 01:12:15.017095 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-439364583-project Aug 07 01:12:15.017095 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:12:15.017095 n-d-master-1 devstack@n-api.service[119516]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 07 01:12:15.017877 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:12:15.017877 n-d-master-1 devstack@n-api.service[119516]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 07 01:12:15.017877 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '2125f4ff-9031-486f-8b5f-85082bf81588', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 07 01:12:15.017877 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:12:15.017877 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:12:15.017877 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:12:15.017877 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:12:15.017877 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:12:15.017877 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:12:15.017877 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 07 01:12:15.018652 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:15.018652 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 07 01:12:15.018652 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 07 01:12:15.018652 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:15.018652 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 07 01:12:15.018652 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 07 01:12:15.018652 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:15.018652 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:12:15.018652 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:15.018652 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:12:15.018652 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:12:15.018652 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:12:15.018652 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:12:15.018652 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:12:15.018652 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:12:15.018652 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:12:15.018652 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:12:15.018652 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:12:15.018652 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:12:15.018652 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:12:15.020059 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:12:15.020059 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:12:15.020059 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:12:15.020059 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:12:15.020059 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 07 01:12:15.020059 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:15.020059 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:12:15.020059 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:15.020059 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:12:15.020059 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:12:15.020059 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:12:15.020059 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:12:15.020059 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:12:15.021272 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 07 01:12:15.021272 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:15.021272 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9659c4b3-e883-4b80-bd3d-5d8cbf10ad4f tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:12:15.021272 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9659c4b3-e883-4b80-bd3d-5d8cbf10ad4f tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "POST /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588/action" status: 400 len: 619 microversion: 2.1 time: 0.025388 Aug 07 01:12:15.022715 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 323/572] 10.222.0.39 () {60 vars in 1279 bytes} [Sun Aug 7 01:12:14 2022] POST /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588/action => generated 619 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:12:15.031684 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-98c8da9b-dad3-49ab-bd68-b6d97a92cf9c tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:15.032695 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-98c8da9b-dad3-49ab-bd68-b6d97a92cf9c tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 2125f4ff-9031-486f-8b5f-85082bf81588] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:15.050252 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-98c8da9b-dad3-49ab-bd68-b6d97a92cf9c tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:15.050724 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-98c8da9b-dad3-49ab-bd68-b6d97a92cf9c tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:15.051183 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-98c8da9b-dad3-49ab-bd68-b6d97a92cf9c tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:15.052023 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-98c8da9b-dad3-49ab-bd68-b6d97a92cf9c tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:15.052516 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-98c8da9b-dad3-49ab-bd68-b6d97a92cf9c tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:15.053007 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-98c8da9b-dad3-49ab-bd68-b6d97a92cf9c tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:15.298553 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-98c8da9b-dad3-49ab-bd68-b6d97a92cf9c tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:15.310208 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-98c8da9b-dad3-49ab-bd68-b6d97a92cf9c tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588" status: 200 len: 1520 microversion: 2.1 time: 0.282362 Aug 07 01:12:15.311149 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 324/573] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:15 2022] GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588 => generated 1520 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:15.334752 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-faf0c953-2c35-4757-a7e6-2d8a02a099a7 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:15.335371 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-faf0c953-2c35-4757-a7e6-2d8a02a099a7 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:15.341528 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-faf0c953-2c35-4757-a7e6-2d8a02a099a7 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:15.342015 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-faf0c953-2c35-4757-a7e6-2d8a02a099a7 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:15.342447 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-faf0c953-2c35-4757-a7e6-2d8a02a099a7 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:15.343171 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-faf0c953-2c35-4757-a7e6-2d8a02a099a7 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:15.343763 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-faf0c953-2c35-4757-a7e6-2d8a02a099a7 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:15.344584 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-faf0c953-2c35-4757-a7e6-2d8a02a099a7 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:15.443964 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-faf0c953-2c35-4757-a7e6-2d8a02a099a7 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lazy-loading 'services' on Instance uuid 2a4de302-ab36-4e7a-90b5-d72d3dc5d698 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:12:15.465350 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-faf0c953-2c35-4757-a7e6-2d8a02a099a7 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1927 microversion: 2.75 time: 0.139579 Aug 07 01:12:15.475941 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 325/574] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:12:15 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1927 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:12:15.475941 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-eb7a95f4-f561-4ba3-a4a2-8bcee301cf61 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:15.475941 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-eb7a95f4-f561-4ba3-a4a2-8bcee301cf61 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:15.486514 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb7a95f4-f561-4ba3-a4a2-8bcee301cf61 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:15.486887 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb7a95f4-f561-4ba3-a4a2-8bcee301cf61 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:15.489771 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb7a95f4-f561-4ba3-a4a2-8bcee301cf61 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:15.489771 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb7a95f4-f561-4ba3-a4a2-8bcee301cf61 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:15.489771 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb7a95f4-f561-4ba3-a4a2-8bcee301cf61 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:15.490089 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb7a95f4-f561-4ba3-a4a2-8bcee301cf61 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:15.524947 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-57fbb6a4-8a7f-4263-9aeb-633414ec04fa tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0200a0753e46399d0b212c665aebce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7279db9d4f497b8430fd45280b5da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:15.541219 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-57fbb6a4-8a7f-4263-9aeb-633414ec04fa tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] 10.222.0.39 "GET /compute/v2.1/servers/b8d0c259-b533-4396-b916-8861a321b930" status: 200 len: 1319 microversion: 2.1 time: 0.813047 Aug 07 01:12:15.542866 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 250/575] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:14 2022] GET /compute/v2.1/servers/b8d0c259-b533-4396-b916-8861a321b930 => generated 1319 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:15.555376 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-44f4826b-4326-4e97-9065-086aa47819c0 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:15.556704 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-44f4826b-4326-4e97-9065-086aa47819c0 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 2125f4ff-9031-486f-8b5f-85082bf81588] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:15.569437 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44f4826b-4326-4e97-9065-086aa47819c0 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:15.570470 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44f4826b-4326-4e97-9065-086aa47819c0 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:15.571390 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44f4826b-4326-4e97-9065-086aa47819c0 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:15.572664 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44f4826b-4326-4e97-9065-086aa47819c0 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:15.573380 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44f4826b-4326-4e97-9065-086aa47819c0 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:15.573886 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44f4826b-4326-4e97-9065-086aa47819c0 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:15.728666 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-eb7a95f4-f561-4ba3-a4a2-8bcee301cf61 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:15.746849 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-eb7a95f4-f561-4ba3-a4a2-8bcee301cf61 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79" status: 200 len: 1311 microversion: 2.1 time: 0.276782 Aug 07 01:12:15.747978 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 326/576] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:15 2022] GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79 => generated 1311 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:15.754859 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1c17e09c-695c-4fed-b7c9-0c6c50f0e70d tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:15.755653 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1c17e09c-695c-4fed-b7c9-0c6c50f0e70d tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] [instance: a038208d-dae8-432d-97e5-2a58ea093e12] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:15.773177 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c17e09c-695c-4fed-b7c9-0c6c50f0e70d tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:15.773655 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c17e09c-695c-4fed-b7c9-0c6c50f0e70d tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:15.774453 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c17e09c-695c-4fed-b7c9-0c6c50f0e70d tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:15.775389 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c17e09c-695c-4fed-b7c9-0c6c50f0e70d tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:15.776061 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c17e09c-695c-4fed-b7c9-0c6c50f0e70d tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:15.776613 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c17e09c-695c-4fed-b7c9-0c6c50f0e70d tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:16.107212 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1c17e09c-695c-4fed-b7c9-0c6c50f0e70d tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0d09d844bf453cb3e2637d630614ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5c39a06e41406a8c6c99d2e84ab282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:16.131015 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1c17e09c-695c-4fed-b7c9-0c6c50f0e70d tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12" status: 200 len: 1317 microversion: 2.1 time: 0.380455 Aug 07 01:12:16.133847 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 327/577] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:15 2022] GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12 => generated 1317 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:16.508280 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-aa8e2cfd-9caa-47e4-98be-f4e974769750 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:16.510668 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-aa8e2cfd-9caa-47e4-98be-f4e974769750 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:16.533437 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa8e2cfd-9caa-47e4-98be-f4e974769750 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:16.534548 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa8e2cfd-9caa-47e4-98be-f4e974769750 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:16.535575 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa8e2cfd-9caa-47e4-98be-f4e974769750 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:16.537015 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa8e2cfd-9caa-47e4-98be-f4e974769750 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:16.537871 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa8e2cfd-9caa-47e4-98be-f4e974769750 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:16.538640 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa8e2cfd-9caa-47e4-98be-f4e974769750 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:16.649710 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-44f4826b-4326-4e97-9065-086aa47819c0 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:16.676559 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-44f4826b-4326-4e97-9065-086aa47819c0 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588" status: 200 len: 1520 microversion: 2.1 time: 1.131844 Aug 07 01:12:16.691024 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 251/578] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:15 2022] GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588 => generated 1520 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:16.710712 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-23b32de5-2ee0-454c-9ecd-62665ccd22d4 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:16.716681 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-23b32de5-2ee0-454c-9ecd-62665ccd22d4 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: b8d0c259-b533-4396-b916-8861a321b930] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:16.739919 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23b32de5-2ee0-454c-9ecd-62665ccd22d4 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:16.741583 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23b32de5-2ee0-454c-9ecd-62665ccd22d4 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:16.744461 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23b32de5-2ee0-454c-9ecd-62665ccd22d4 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:16.745462 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23b32de5-2ee0-454c-9ecd-62665ccd22d4 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:16.746065 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23b32de5-2ee0-454c-9ecd-62665ccd22d4 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:16.747778 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23b32de5-2ee0-454c-9ecd-62665ccd22d4 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:16.750094 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-aa8e2cfd-9caa-47e4-98be-f4e974769750 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lazy-loading 'services' on Instance uuid 2a4de302-ab36-4e7a-90b5-d72d3dc5d698 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:12:16.796671 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-aa8e2cfd-9caa-47e4-98be-f4e974769750 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1927 microversion: 2.75 time: 0.298266 Aug 07 01:12:16.802022 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 328/579] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:12:16 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1927 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:12:16.807351 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d90b123e-2d2e-4cc0-ba81-f8d789df1ef7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1943499783"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:16.814693 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d90b123e-2d2e-4cc0-ba81-f8d789df1ef7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 2125f4ff-9031-486f-8b5f-85082bf81588] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:16.829679 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d90b123e-2d2e-4cc0-ba81-f8d789df1ef7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:16.830178 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d90b123e-2d2e-4cc0-ba81-f8d789df1ef7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:16.830699 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d90b123e-2d2e-4cc0-ba81-f8d789df1ef7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:16.831467 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d90b123e-2d2e-4cc0-ba81-f8d789df1ef7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:16.831945 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d90b123e-2d2e-4cc0-ba81-f8d789df1ef7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:16.832414 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d90b123e-2d2e-4cc0-ba81-f8d789df1ef7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:17.175484 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d90b123e-2d2e-4cc0-ba81-f8d789df1ef7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "POST /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588/action" status: 202 len: 0 microversion: 2.1 time: 0.371918 Aug 07 01:12:17.178407 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 329/580] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:12:16 2022] POST /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 07 01:12:17.188613 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2c14d20e-14df-4530-b554-3df10c15fa33 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:17.190736 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2c14d20e-14df-4530-b554-3df10c15fa33 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:17.208720 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c14d20e-14df-4530-b554-3df10c15fa33 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:17.209096 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c14d20e-14df-4530-b554-3df10c15fa33 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:17.209542 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c14d20e-14df-4530-b554-3df10c15fa33 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:17.210282 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c14d20e-14df-4530-b554-3df10c15fa33 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:17.210984 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c14d20e-14df-4530-b554-3df10c15fa33 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:17.211416 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c14d20e-14df-4530-b554-3df10c15fa33 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:17.290391 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-23b32de5-2ee0-454c-9ecd-62665ccd22d4 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0200a0753e46399d0b212c665aebce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7279db9d4f497b8430fd45280b5da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:17.308348 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-23b32de5-2ee0-454c-9ecd-62665ccd22d4 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] 10.222.0.39 "GET /compute/v2.1/servers/b8d0c259-b533-4396-b916-8861a321b930" status: 200 len: 1319 microversion: 2.1 time: 0.614709 Aug 07 01:12:17.314172 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 252/581] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:16 2022] GET /compute/v2.1/servers/b8d0c259-b533-4396-b916-8861a321b930 => generated 1319 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:17.326978 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a3059d39-006b-4858-9d99-6fc3c9af788b tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:17.329101 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a3059d39-006b-4858-9d99-6fc3c9af788b tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] [instance: a038208d-dae8-432d-97e5-2a58ea093e12] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:17.350314 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3059d39-006b-4858-9d99-6fc3c9af788b tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:17.351457 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3059d39-006b-4858-9d99-6fc3c9af788b tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:17.352417 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3059d39-006b-4858-9d99-6fc3c9af788b tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:17.354279 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3059d39-006b-4858-9d99-6fc3c9af788b tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:17.355701 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3059d39-006b-4858-9d99-6fc3c9af788b tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:17.356430 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3059d39-006b-4858-9d99-6fc3c9af788b tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:17.378320 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:17.422543 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2c14d20e-14df-4530-b554-3df10c15fa33 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:17.431419 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2c14d20e-14df-4530-b554-3df10c15fa33 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79" status: 200 len: 1311 microversion: 2.1 time: 0.251188 Aug 07 01:12:17.432248 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 330/582] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:17 2022] GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79 => generated 1311 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:17.438068 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a6d003a6-963f-41b9-8f8d-6b296cfba673 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2060854333"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:17.441227 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a6d003a6-963f-41b9-8f8d-6b296cfba673 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 2125f4ff-9031-486f-8b5f-85082bf81588] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:17.452155 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a6d003a6-963f-41b9-8f8d-6b296cfba673 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:17.452827 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a6d003a6-963f-41b9-8f8d-6b296cfba673 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:17.453275 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a6d003a6-963f-41b9-8f8d-6b296cfba673 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:17.454190 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a6d003a6-963f-41b9-8f8d-6b296cfba673 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:17.454722 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a6d003a6-963f-41b9-8f8d-6b296cfba673 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:17.455154 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a6d003a6-963f-41b9-8f8d-6b296cfba673 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:17.503879 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-a6d003a6-963f-41b9-8f8d-6b296cfba673 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] HTTP exception thrown: Cannot 'createImage' instance 2125f4ff-9031-486f-8b5f-85082bf81588 while it is in task_state image_snapshot_pending Aug 07 01:12:17.507238 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a6d003a6-963f-41b9-8f8d-6b296cfba673 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Request method failure captured: Aug 07 01:12:17.507238 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588/action HTTP/1.1 Aug 07 01:12:17.507238 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:12:17.507238 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:12:17.507238 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:12:17.507238 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 85 Aug 07 01:12:17.507238 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:12:17.507238 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:12:17.507238 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:12:17.507238 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:12:17.507238 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xFJvA8aViwvAloPsDf2VckLIvT0ef2dFkqEzqRHcsoXzKL-UrjSbgq9qrhn-Kr0K6IWORgsxpa0ZC6p7prEjOQjpXXrO_P6Q36zbcHdiXbdtz0b1lfjcwupDS07IycJWoRXidnJpp03pTzYbxhgdiNsodOZkAAXZnRnVK8CHn-Gq7M Aug 07 01:12:17.507238 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:12:17.507238 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:12:17.507238 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:12:17.507238 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:12:17.507238 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:12:17.507238 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:12:17.507238 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 4e443158f15b42a3a795950a7c409a38 Aug 07 01:12:17.507238 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:12:17.507238 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:12:17.507238 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:12:17.509983 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4e443158f15b42a3a795950a7c409a38", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:12:17.509983 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:12:17.509983 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 4e443158f15b42a3a795950a7c409a38 Aug 07 01:12:17.509983 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:12:17.509983 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ImagesOneServerNegativeTestJSON-439364583-project Aug 07 01:12:17.509983 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:12:17.509983 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:12:17.509983 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: c135ba135fd946149ace9a86c7c52e80 Aug 07 01:12:17.509983 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-439364583-project Aug 07 01:12:17.509983 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:12:17.509983 n-d-master-1 devstack@n-api.service[119516]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2060854333"}} Aug 07 01:12:17.509983 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:12:17.511381 n-d-master-1 devstack@n-api.service[119516]: exception: Cannot 'createImage' instance 2125f4ff-9031-486f-8b5f-85082bf81588 while it is in task_state image_snapshot_pending Aug 07 01:12:17.511381 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '2125f4ff-9031-486f-8b5f-85082bf81588', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2060854333'}}} Aug 07 01:12:17.511381 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:12:17.511381 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:12:17.511381 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Aug 07 01:12:17.511381 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 07 01:12:17.511381 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Aug 07 01:12:17.511381 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 07 01:12:17.511381 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2125f4ff-9031-486f-8b5f-85082bf81588 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Aug 07 01:12:17.511381 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:17.511381 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:12:17.511381 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:17.511381 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:12:17.511381 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:12:17.511381 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:12:17.511381 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:12:17.511381 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:12:17.511381 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:12:17.511381 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:12:17.513826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:12:17.513826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:12:17.513826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:12:17.513826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:12:17.513826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Aug 07 01:12:17.513826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 07 01:12:17.513826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 07 01:12:17.513826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 07 01:12:17.513826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 2125f4ff-9031-486f-8b5f-85082bf81588 while it is in task_state image_snapshot_pending Aug 07 01:12:17.513826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:17.513826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:12:17.513826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:17.513826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:12:17.513826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:12:17.513826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:12:17.513826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:12:17.513826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:12:17.513826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 2125f4ff-9031-486f-8b5f-85082bf81588 while it is in task_state image_snapshot_pending Aug 07 01:12:17.513826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:17.516174 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a6d003a6-963f-41b9-8f8d-6b296cfba673 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Returning 409 to user: Cannot 'createImage' instance 2125f4ff-9031-486f-8b5f-85082bf81588 while it is in task_state image_snapshot_pending {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:12:17.516174 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a6d003a6-963f-41b9-8f8d-6b296cfba673 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "POST /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588/action" status: 409 len: 167 microversion: 2.1 time: 0.077398 Aug 07 01:12:17.516174 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 331/583] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:12:17 2022] POST /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588/action => generated 167 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:12:17.526011 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-669ab5ed-5dec-4404-bffd-a3dcafa92f0b tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '.version_select at 0x7f9e24cbbee0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:17.771118 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-669ab5ed-5dec-4404-bffd-a3dcafa92f0b tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "DELETE /compute/v2.1/images/58f27597-89c2-4bf5-961f-7df1ae655cf8" status: 204 len: 0 microversion: 2.1 time: 0.251914 Aug 07 01:12:17.773538 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 332/584] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:17 2022] DELETE /compute/v2.1/images/58f27597-89c2-4bf5-961f-7df1ae655cf8 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:12:17.787481 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4aad1dbe-8690-4bd9-bfb9-5a31820abc3c tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:17.790802 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4aad1dbe-8690-4bd9-bfb9-5a31820abc3c tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 2125f4ff-9031-486f-8b5f-85082bf81588] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:17.808923 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4aad1dbe-8690-4bd9-bfb9-5a31820abc3c tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:17.809942 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4aad1dbe-8690-4bd9-bfb9-5a31820abc3c tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:17.810616 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4aad1dbe-8690-4bd9-bfb9-5a31820abc3c tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:17.811605 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4aad1dbe-8690-4bd9-bfb9-5a31820abc3c tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:17.812883 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4aad1dbe-8690-4bd9-bfb9-5a31820abc3c tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:17.813728 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4aad1dbe-8690-4bd9-bfb9-5a31820abc3c tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:18.063040 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a3059d39-006b-4858-9d99-6fc3c9af788b tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0d09d844bf453cb3e2637d630614ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5c39a06e41406a8c6c99d2e84ab282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:18.077007 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a3059d39-006b-4858-9d99-6fc3c9af788b tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12" status: 200 len: 1317 microversion: 2.1 time: 0.760949 Aug 07 01:12:18.077873 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 253/585] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:17 2022] GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12 => generated 1317 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:18.109195 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4aad1dbe-8690-4bd9-bfb9-5a31820abc3c tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:18.113446 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9300138c-b9c1-484e-bf54-5ef75d68c5e1 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:18.114597 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9300138c-b9c1-484e-bf54-5ef75d68c5e1 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:18.120343 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4aad1dbe-8690-4bd9-bfb9-5a31820abc3c tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588" status: 200 len: 1540 microversion: 2.1 time: 0.341918 Aug 07 01:12:18.121305 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 333/586] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:17 2022] GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588 => generated 1540 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:12:18.130225 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-15cd93db-c9a3-4e4b-922c-7560d3e8f123 req-131afee8-2728-4b2b-8bc5-c913650d3a24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8d0c259-b533-4396-b916-8861a321b930", "name": "network-vif-plugged", "status": "completed", "tag": "fdb8dc2b-c46d-407e-98a9-a59700aa7ef9"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:18.137812 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9300138c-b9c1-484e-bf54-5ef75d68c5e1 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:18.138562 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9300138c-b9c1-484e-bf54-5ef75d68c5e1 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:18.138916 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9300138c-b9c1-484e-bf54-5ef75d68c5e1 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:18.140355 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9300138c-b9c1-484e-bf54-5ef75d68c5e1 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:18.141257 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9300138c-b9c1-484e-bf54-5ef75d68c5e1 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:18.142032 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9300138c-b9c1-484e-bf54-5ef75d68c5e1 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:18.146904 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-15cd93db-c9a3-4e4b-922c-7560d3e8f123 req-131afee8-2728-4b2b-8bc5-c913650d3a24 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:18.147797 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-15cd93db-c9a3-4e4b-922c-7560d3e8f123 req-131afee8-2728-4b2b-8bc5-c913650d3a24 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:18.148507 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-15cd93db-c9a3-4e4b-922c-7560d3e8f123 req-131afee8-2728-4b2b-8bc5-c913650d3a24 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:18.176074 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-15cd93db-c9a3-4e4b-922c-7560d3e8f123 req-131afee8-2728-4b2b-8bc5-c913650d3a24 service nova] Creating event network-vif-plugged:fdb8dc2b-c46d-407e-98a9-a59700aa7ef9 for instance b8d0c259-b533-4396-b916-8861a321b930 on n-h1-master-1 Aug 07 01:12:18.196405 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-15cd93db-c9a3-4e4b-922c-7560d3e8f123 req-131afee8-2728-4b2b-8bc5-c913650d3a24 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073431 Aug 07 01:12:18.198654 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 334/587] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:18.227088 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-fa229371-f3fa-4e8b-9a48-b77ebf9d8eb8 req-762181e4-c241-452d-b6be-5415b29d851b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06b38422-fb09-4331-b7cb-3d5f99cc2e79", "tag": "d5cc418b-ee3e-4a9b-b03a-2585f8a9e3b3"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:18.262056 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-fa229371-f3fa-4e8b-9a48-b77ebf9d8eb8 req-762181e4-c241-452d-b6be-5415b29d851b service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:18.262954 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-fa229371-f3fa-4e8b-9a48-b77ebf9d8eb8 req-762181e4-c241-452d-b6be-5415b29d851b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:18.263576 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-fa229371-f3fa-4e8b-9a48-b77ebf9d8eb8 req-762181e4-c241-452d-b6be-5415b29d851b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:18.283227 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-fa229371-f3fa-4e8b-9a48-b77ebf9d8eb8 req-762181e4-c241-452d-b6be-5415b29d851b service nova] Creating event network-changed:d5cc418b-ee3e-4a9b-b03a-2585f8a9e3b3 for instance 06b38422-fb09-4331-b7cb-3d5f99cc2e79 on n-h2-master-1 Aug 07 01:12:18.301933 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-fa229371-f3fa-4e8b-9a48-b77ebf9d8eb8 req-762181e4-c241-452d-b6be-5415b29d851b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088260 Aug 07 01:12:18.302774 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 335/588] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:18.346453 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-72891657-18a4-4ae9-861a-d39ad63b24d9 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:18.347169 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-72891657-18a4-4ae9-861a-d39ad63b24d9 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: b8d0c259-b533-4396-b916-8861a321b930] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:18.355842 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72891657-18a4-4ae9-861a-d39ad63b24d9 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:18.358671 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72891657-18a4-4ae9-861a-d39ad63b24d9 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:18.359337 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72891657-18a4-4ae9-861a-d39ad63b24d9 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:18.360173 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72891657-18a4-4ae9-861a-d39ad63b24d9 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:18.360641 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72891657-18a4-4ae9-861a-d39ad63b24d9 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:18.361121 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72891657-18a4-4ae9-861a-d39ad63b24d9 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:18.605305 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-9300138c-b9c1-484e-bf54-5ef75d68c5e1 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lazy-loading 'services' on Instance uuid 2a4de302-ab36-4e7a-90b5-d72d3dc5d698 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:12:18.644425 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-72891657-18a4-4ae9-861a-d39ad63b24d9 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0200a0753e46399d0b212c665aebce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7279db9d4f497b8430fd45280b5da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:18.659291 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:18.675043 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9300138c-b9c1-484e-bf54-5ef75d68c5e1 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1927 microversion: 2.75 time: 0.580193 Aug 07 01:12:18.676387 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 254/589] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:12:18 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1927 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:12:18.686496 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-72891657-18a4-4ae9-861a-d39ad63b24d9 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] 10.222.0.39 "GET /compute/v2.1/servers/b8d0c259-b533-4396-b916-8861a321b930" status: 200 len: 1319 microversion: 2.1 time: 0.343750 Aug 07 01:12:18.695980 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 336/590] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:18 2022] GET /compute/v2.1/servers/b8d0c259-b533-4396-b916-8861a321b930 => generated 1319 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:12:18.696241 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7a5706b7-d9a1-4cd0-8432-8d84881a5322 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:18.696241 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7a5706b7-d9a1-4cd0-8432-8d84881a5322 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:18.712825 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a5706b7-d9a1-4cd0-8432-8d84881a5322 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:18.713860 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a5706b7-d9a1-4cd0-8432-8d84881a5322 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:18.714418 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a5706b7-d9a1-4cd0-8432-8d84881a5322 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:18.715329 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a5706b7-d9a1-4cd0-8432-8d84881a5322 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:18.715805 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a5706b7-d9a1-4cd0-8432-8d84881a5322 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:18.716426 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a5706b7-d9a1-4cd0-8432-8d84881a5322 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:19.122310 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-da65ca4b-f72d-42c3-b3b4-66f0a097bbe5 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:19.131094 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-da65ca4b-f72d-42c3-b3b4-66f0a097bbe5 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] [instance: a038208d-dae8-432d-97e5-2a58ea093e12] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:19.141465 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da65ca4b-f72d-42c3-b3b4-66f0a097bbe5 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:19.142277 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da65ca4b-f72d-42c3-b3b4-66f0a097bbe5 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:19.142926 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da65ca4b-f72d-42c3-b3b4-66f0a097bbe5 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:19.144014 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da65ca4b-f72d-42c3-b3b4-66f0a097bbe5 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:19.144718 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da65ca4b-f72d-42c3-b3b4-66f0a097bbe5 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:19.145422 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da65ca4b-f72d-42c3-b3b4-66f0a097bbe5 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:19.467553 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-da65ca4b-f72d-42c3-b3b4-66f0a097bbe5 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0d09d844bf453cb3e2637d630614ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5c39a06e41406a8c6c99d2e84ab282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:19.475992 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-da65ca4b-f72d-42c3-b3b4-66f0a097bbe5 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12" status: 200 len: 1317 microversion: 2.1 time: 0.360514 Aug 07 01:12:19.476579 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 337/591] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:19 2022] GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12 => generated 1317 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:19.490139 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8af083f1-f0e9-47a2-81a1-77eb4d52dc31 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:19.491462 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8af083f1-f0e9-47a2-81a1-77eb4d52dc31 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 2125f4ff-9031-486f-8b5f-85082bf81588] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:19.505503 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8af083f1-f0e9-47a2-81a1-77eb4d52dc31 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:19.506750 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8af083f1-f0e9-47a2-81a1-77eb4d52dc31 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:19.507606 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8af083f1-f0e9-47a2-81a1-77eb4d52dc31 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:19.509229 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8af083f1-f0e9-47a2-81a1-77eb4d52dc31 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:19.510059 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8af083f1-f0e9-47a2-81a1-77eb4d52dc31 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:19.510845 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8af083f1-f0e9-47a2-81a1-77eb4d52dc31 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:19.651262 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7a5706b7-d9a1-4cd0-8432-8d84881a5322 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:19.661872 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7a5706b7-d9a1-4cd0-8432-8d84881a5322 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79" status: 200 len: 1311 microversion: 2.1 time: 0.983874 Aug 07 01:12:19.677078 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 255/592] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:18 2022] GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79 => generated 1311 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:19.713554 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-303a8dc0-91de-4bbb-a917-12736cf90157 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:19.714911 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-303a8dc0-91de-4bbb-a917-12736cf90157 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:19.744094 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8af083f1-f0e9-47a2-81a1-77eb4d52dc31 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:19.744349 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-303a8dc0-91de-4bbb-a917-12736cf90157 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:19.745128 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-303a8dc0-91de-4bbb-a917-12736cf90157 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:19.745924 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-303a8dc0-91de-4bbb-a917-12736cf90157 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:19.755464 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-303a8dc0-91de-4bbb-a917-12736cf90157 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:19.756274 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8af083f1-f0e9-47a2-81a1-77eb4d52dc31 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588" status: 200 len: 1538 microversion: 2.1 time: 0.277714 Aug 07 01:12:19.756573 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-303a8dc0-91de-4bbb-a917-12736cf90157 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:19.757751 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 338/593] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:19 2022] GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588 => generated 1538 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:19.763043 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-eb0f3a7a-41b0-430e-a1fb-a9be0c2b82d9 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:19.764169 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-eb0f3a7a-41b0-430e-a1fb-a9be0c2b82d9 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: b8d0c259-b533-4396-b916-8861a321b930] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:19.771494 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb0f3a7a-41b0-430e-a1fb-a9be0c2b82d9 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:19.772631 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb0f3a7a-41b0-430e-a1fb-a9be0c2b82d9 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:19.773263 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb0f3a7a-41b0-430e-a1fb-a9be0c2b82d9 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:19.774220 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb0f3a7a-41b0-430e-a1fb-a9be0c2b82d9 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:19.774891 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb0f3a7a-41b0-430e-a1fb-a9be0c2b82d9 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:19.775515 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb0f3a7a-41b0-430e-a1fb-a9be0c2b82d9 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:19.781431 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-303a8dc0-91de-4bbb-a917-12736cf90157 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:20.062529 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-303a8dc0-91de-4bbb-a917-12736cf90157 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lazy-loading 'services' on Instance uuid 2a4de302-ab36-4e7a-90b5-d72d3dc5d698 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:12:20.070528 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-eb0f3a7a-41b0-430e-a1fb-a9be0c2b82d9 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0200a0753e46399d0b212c665aebce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7279db9d4f497b8430fd45280b5da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:20.080753 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-eb0f3a7a-41b0-430e-a1fb-a9be0c2b82d9 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] 10.222.0.39 "GET /compute/v2.1/servers/b8d0c259-b533-4396-b916-8861a321b930" status: 200 len: 1319 microversion: 2.1 time: 0.319333 Aug 07 01:12:20.081401 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 339/594] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:19 2022] GET /compute/v2.1/servers/b8d0c259-b533-4396-b916-8861a321b930 => generated 1319 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:20.092069 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-77ebcaf6-7997-4da1-946e-605aebdd4dcf tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:20.092697 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-77ebcaf6-7997-4da1-946e-605aebdd4dcf tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 7ab29f8e-4b84-4038-a60f-efc93d0358ce] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:20.105209 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-303a8dc0-91de-4bbb-a917-12736cf90157 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1927 microversion: 2.75 time: 0.405066 Aug 07 01:12:20.107854 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 256/595] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:12:19 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1927 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:12:20.114053 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77ebcaf6-7997-4da1-946e-605aebdd4dcf tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:20.114762 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77ebcaf6-7997-4da1-946e-605aebdd4dcf tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:20.114980 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77ebcaf6-7997-4da1-946e-605aebdd4dcf tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:20.115714 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77ebcaf6-7997-4da1-946e-605aebdd4dcf tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:20.116282 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77ebcaf6-7997-4da1-946e-605aebdd4dcf tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:20.116716 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77ebcaf6-7997-4da1-946e-605aebdd4dcf tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:20.399460 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-77ebcaf6-7997-4da1-946e-605aebdd4dcf tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d08a2479f847b4b06d6690f1aedb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06211ba44e4f6d88f9095969001aab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:20.426846 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-0571706e-d309-4d7c-8ce6-7d68ba612bbc req-b10127ec-1750-4f8f-9621-0496fab213cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ab29f8e-4b84-4038-a60f-efc93d0358ce", "tag": "3a899aee-00e7-47c8-925e-16279648d5d3"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:20.438361 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-77ebcaf6-7997-4da1-946e-605aebdd4dcf tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "GET /compute/v2.1/servers/7ab29f8e-4b84-4038-a60f-efc93d0358ce" status: 200 len: 1589 microversion: 2.1 time: 0.354226 Aug 07 01:12:20.446501 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 340/596] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:20 2022] GET /compute/v2.1/servers/7ab29f8e-4b84-4038-a60f-efc93d0358ce => generated 1589 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:20.467318 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0571706e-d309-4d7c-8ce6-7d68ba612bbc req-b10127ec-1750-4f8f-9621-0496fab213cb service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:20.468105 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0571706e-d309-4d7c-8ce6-7d68ba612bbc req-b10127ec-1750-4f8f-9621-0496fab213cb service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:20.468721 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0571706e-d309-4d7c-8ce6-7d68ba612bbc req-b10127ec-1750-4f8f-9621-0496fab213cb service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:20.485826 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-0571706e-d309-4d7c-8ce6-7d68ba612bbc req-b10127ec-1750-4f8f-9621-0496fab213cb service nova] Creating event network-changed:3a899aee-00e7-47c8-925e-16279648d5d3 for instance 7ab29f8e-4b84-4038-a60f-efc93d0358ce on n-h2-master-1 Aug 07 01:12:20.502332 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-0571706e-d309-4d7c-8ce6-7d68ba612bbc req-b10127ec-1750-4f8f-9621-0496fab213cb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079351 Aug 07 01:12:20.504279 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 257/597] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:12:20.512772 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4de64e76-1aa0-42b7-8747-f39a3047b353 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:20.522267 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4de64e76-1aa0-42b7-8747-f39a3047b353 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] [instance: a038208d-dae8-432d-97e5-2a58ea093e12] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:20.538766 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4de64e76-1aa0-42b7-8747-f39a3047b353 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:20.539860 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4de64e76-1aa0-42b7-8747-f39a3047b353 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:20.541266 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4de64e76-1aa0-42b7-8747-f39a3047b353 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:20.542713 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4de64e76-1aa0-42b7-8747-f39a3047b353 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:20.543682 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4de64e76-1aa0-42b7-8747-f39a3047b353 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:20.544440 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4de64e76-1aa0-42b7-8747-f39a3047b353 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:20.683852 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-81a29e6c-961d-4bec-9b4f-db4c84b1ccc3 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:20.684781 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-81a29e6c-961d-4bec-9b4f-db4c84b1ccc3 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:20.707971 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-81a29e6c-961d-4bec-9b4f-db4c84b1ccc3 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:20.710987 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-81a29e6c-961d-4bec-9b4f-db4c84b1ccc3 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:20.713650 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-81a29e6c-961d-4bec-9b4f-db4c84b1ccc3 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:20.717273 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-81a29e6c-961d-4bec-9b4f-db4c84b1ccc3 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:20.719479 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-81a29e6c-961d-4bec-9b4f-db4c84b1ccc3 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:20.721584 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-81a29e6c-961d-4bec-9b4f-db4c84b1ccc3 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:20.878825 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4de64e76-1aa0-42b7-8747-f39a3047b353 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0d09d844bf453cb3e2637d630614ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5c39a06e41406a8c6c99d2e84ab282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:20.905807 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4de64e76-1aa0-42b7-8747-f39a3047b353 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12" status: 200 len: 1317 microversion: 2.1 time: 0.395170 Aug 07 01:12:20.923504 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 341/598] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:20 2022] GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12 => generated 1317 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:20.946614 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bbee9e19-f799-4ccf-bf44-242b07dc7e87 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:20.949476 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bbee9e19-f799-4ccf-bf44-242b07dc7e87 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 2125f4ff-9031-486f-8b5f-85082bf81588] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:20.969234 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bbee9e19-f799-4ccf-bf44-242b07dc7e87 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:20.987596 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bbee9e19-f799-4ccf-bf44-242b07dc7e87 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:20.988714 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bbee9e19-f799-4ccf-bf44-242b07dc7e87 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:20.990622 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bbee9e19-f799-4ccf-bf44-242b07dc7e87 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:20.992790 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bbee9e19-f799-4ccf-bf44-242b07dc7e87 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:20.992790 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bbee9e19-f799-4ccf-bf44-242b07dc7e87 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:21.226366 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bbee9e19-f799-4ccf-bf44-242b07dc7e87 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:21.239379 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bbee9e19-f799-4ccf-bf44-242b07dc7e87 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588" status: 200 len: 1533 microversion: 2.1 time: 0.314178 Aug 07 01:12:21.253276 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 342/599] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:20 2022] GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588 => generated 1533 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:21.267355 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-360ad17e-d3d7-4af2-8736-ec79df9b998c tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:21.268470 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-360ad17e-d3d7-4af2-8736-ec79df9b998c tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: b8d0c259-b533-4396-b916-8861a321b930] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:21.287625 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-360ad17e-d3d7-4af2-8736-ec79df9b998c tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:21.288469 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-360ad17e-d3d7-4af2-8736-ec79df9b998c tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:21.289080 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-360ad17e-d3d7-4af2-8736-ec79df9b998c tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:21.290750 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-360ad17e-d3d7-4af2-8736-ec79df9b998c tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:21.291437 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-360ad17e-d3d7-4af2-8736-ec79df9b998c tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:21.292162 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-360ad17e-d3d7-4af2-8736-ec79df9b998c tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:21.338693 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-81a29e6c-961d-4bec-9b4f-db4c84b1ccc3 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:21.347829 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-81a29e6c-961d-4bec-9b4f-db4c84b1ccc3 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79" status: 200 len: 1311 microversion: 2.1 time: 0.668407 Aug 07 01:12:21.365151 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 258/600] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:20 2022] GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79 => generated 1311 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:21.381494 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1554413c-76e9-440b-9fc8-a6b8fbd40651 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:21.381930 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1554413c-76e9-440b-9fc8-a6b8fbd40651 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:21.394231 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1554413c-76e9-440b-9fc8-a6b8fbd40651 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:21.394681 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1554413c-76e9-440b-9fc8-a6b8fbd40651 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:21.396329 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1554413c-76e9-440b-9fc8-a6b8fbd40651 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:21.397536 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1554413c-76e9-440b-9fc8-a6b8fbd40651 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:21.402303 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1554413c-76e9-440b-9fc8-a6b8fbd40651 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:21.403262 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1554413c-76e9-440b-9fc8-a6b8fbd40651 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:21.564029 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-360ad17e-d3d7-4af2-8736-ec79df9b998c tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0200a0753e46399d0b212c665aebce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7279db9d4f497b8430fd45280b5da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:21.586797 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-360ad17e-d3d7-4af2-8736-ec79df9b998c tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] 10.222.0.39 "GET /compute/v2.1/servers/b8d0c259-b533-4396-b916-8861a321b930" status: 200 len: 1468 microversion: 2.1 time: 0.331669 Aug 07 01:12:21.594291 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 343/601] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:21 2022] GET /compute/v2.1/servers/b8d0c259-b533-4396-b916-8861a321b930 => generated 1468 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:21.617272 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-1554413c-76e9-440b-9fc8-a6b8fbd40651 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lazy-loading 'services' on Instance uuid 2a4de302-ab36-4e7a-90b5-d72d3dc5d698 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:12:21.653242 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1554413c-76e9-440b-9fc8-a6b8fbd40651 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1927 microversion: 2.75 time: 0.286891 Aug 07 01:12:21.668578 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 259/602] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:12:21 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1927 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:12:22.229039 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-dd272eae-8ae7-49d1-b09d-6551fe116351 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Action: 'update', calling method: .version_select at 0x7f9e24a72ca0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:22.336933 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-08471dc7-d1ae-4681-95a8-f67a6254b0b2 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1962397411", "block_migration": true, "disk_over_commit": false}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:22.345844 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-08471dc7-d1ae-4681-95a8-f67a6254b0b2 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] [instance: b8d0c259-b533-4396-b916-8861a321b930] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:22.354562 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd272eae-8ae7-49d1-b09d-6551fe116351 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:22.355858 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd272eae-8ae7-49d1-b09d-6551fe116351 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:22.357002 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd272eae-8ae7-49d1-b09d-6551fe116351 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:22.358624 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd272eae-8ae7-49d1-b09d-6551fe116351 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:22.360546 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd272eae-8ae7-49d1-b09d-6551fe116351 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:22.362341 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd272eae-8ae7-49d1-b09d-6551fe116351 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:22.378624 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08471dc7-d1ae-4681-95a8-f67a6254b0b2 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:22.379345 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08471dc7-d1ae-4681-95a8-f67a6254b0b2 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:22.386233 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08471dc7-d1ae-4681-95a8-f67a6254b0b2 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:22.393162 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08471dc7-d1ae-4681-95a8-f67a6254b0b2 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:22.394052 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08471dc7-d1ae-4681-95a8-f67a6254b0b2 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:22.394883 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08471dc7-d1ae-4681-95a8-f67a6254b0b2 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:22.506373 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-dd272eae-8ae7-49d1-b09d-6551fe116351 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/83da20dfe5d04940b1e1895997513baf" status: 200 len: 148 microversion: 2.57 time: 0.667007 Aug 07 01:12:22.510397 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 260/603] 10.222.0.39 () {62 vars in 1303 bytes} [Sun Aug 7 01:12:21 2022] PUT /compute/v2.1/os-quota-sets/83da20dfe5d04940b1e1895997513baf => generated 148 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:12:22.526561 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e29b603e-460a-4d2d-b762-333b22bd6c72 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:22.528068 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e29b603e-460a-4d2d-b762-333b22bd6c72 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] [instance: a038208d-dae8-432d-97e5-2a58ea093e12] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:22.544666 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e29b603e-460a-4d2d-b762-333b22bd6c72 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:22.546483 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e29b603e-460a-4d2d-b762-333b22bd6c72 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:22.547999 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e29b603e-460a-4d2d-b762-333b22bd6c72 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:22.550283 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e29b603e-460a-4d2d-b762-333b22bd6c72 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:22.551421 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e29b603e-460a-4d2d-b762-333b22bd6c72 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:22.552847 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e29b603e-460a-4d2d-b762-333b22bd6c72 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:22.557610 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-08471dc7-d1ae-4681-95a8-f67a6254b0b2 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Lazy-loading 'flavor' on Instance uuid b8d0c259-b533-4396-b916-8861a321b930 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:12:22.613021 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-08471dc7-d1ae-4681-95a8-f67a6254b0b2 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] [instance: b8d0c259-b533-4396-b916-8861a321b930] Going to try to live migrate instance to tempest-host-1962397411 {{(pid=119516) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 07 01:12:22.620941 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-08471dc7-d1ae-4681-95a8-f67a6254b0b2 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] HTTP exception thrown: Compute host tempest-host-1962397411 could not be found. Aug 07 01:12:22.625183 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-08471dc7-d1ae-4681-95a8-f67a6254b0b2 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Request method failure captured: Aug 07 01:12:22.625183 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers/b8d0c259-b533-4396-b916-8861a321b930/action HTTP/1.1 Aug 07 01:12:22.625183 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:12:22.625183 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:12:22.625183 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:12:22.625183 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 107 Aug 07 01:12:22.625183 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:12:22.625183 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:12:22.625183 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:12:22.625183 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:12:22.625183 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xFeKjj-zhemXaBOOIj-jtbbDoeVnqJxZRtuHmW8bqGv4uDrUiDPsum6ztNi7QhXN-7mn48ETdNquMaov6XMGLHL5_Wje13Mt7XSHMF915EwCG7N53qNCNSEbGfQkJ8ShkIkBrAmAGpsPXDEzSocSkDlZ0f0fnxTh8T5clrktV4Seks Aug 07 01:12:22.625183 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:12:22.625183 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:12:22.625183 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:12:22.625183 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:12:22.625183 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:12:22.625183 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:12:22.625183 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: eb582d220421404ba7f60af09d58fe62 Aug 07 01:12:22.625183 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-LiveMigrationNegativeTest-550618707 Aug 07 01:12:22.625183 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,admin,member Aug 07 01:12:22.625183 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,admin,member Aug 07 01:12:22.629984 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/eb582d220421404ba7f60af09d58fe62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_eb582d220421404ba7f60af09d58fe62", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/eb582d220421404ba7f60af09d58fe62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/eb582d220421404ba7f60af09d58fe62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:12:22.629984 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-LiveMigrationNegativeTest-550618707 Aug 07 01:12:22.629984 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: eb582d220421404ba7f60af09d58fe62 Aug 07 01:12:22.629984 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-550618707 Aug 07 01:12:22.629984 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-LiveMigrationNegativeTest-550618707-project-admin Aug 07 01:12:22.629984 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:12:22.629984 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:12:22.629984 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 423b935e72ae42d9a49b9b8390ab20d6 Aug 07 01:12:22.629984 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-LiveMigrationNegativeTest-550618707-project-admin Aug 07 01:12:22.629984 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:12:22.629984 n-d-master-1 devstack@n-api.service[119516]: {"os-migrateLive": {"host": "tempest-host-1962397411", "block_migration": true, "disk_over_commit": false}} Aug 07 01:12:22.629984 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:12:22.632395 n-d-master-1 devstack@n-api.service[119516]: exception: Compute host tempest-host-1962397411 could not be found. Aug 07 01:12:22.632395 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'b8d0c259-b533-4396-b916-8861a321b930', 'body': {'os-migrateLive': {'host': 'tempest-host-1962397411', 'block_migration': True, 'disk_over_commit': False}}} Aug 07 01:12:22.632395 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:12:22.632395 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:12:22.632395 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 07 01:12:22.632395 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 07 01:12:22.632395 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 07 01:12:22.632395 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 01:12:22.632395 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 07 01:12:22.632395 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 07 01:12:22.632395 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 07 01:12:22.632395 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 07 01:12:22.632395 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 07 01:12:22.632395 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 07 01:12:22.632395 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 07 01:12:22.632395 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 07 01:12:22.632395 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 07 01:12:22.632395 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 07 01:12:22.632395 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 01:12:22.633663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 01:12:22.633663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 07 01:12:22.633663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 07 01:12:22.633663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5436, in live_migrate Aug 07 01:12:22.633663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 07 01:12:22.633663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:12:22.633663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:12:22.633663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 07 01:12:22.633663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 07 01:12:22.633663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 07 01:12:22.633663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:12:22.633663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 07 01:12:22.633663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 07 01:12:22.633663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 07 01:12:22.633663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 07 01:12:22.633663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 07 01:12:22.633663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 07 01:12:22.633663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1962397411 could not be found. Aug 07 01:12:22.633663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:22.635069 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:12:22.635069 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:22.635069 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:12:22.635069 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:12:22.635069 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:12:22.635069 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:12:22.635069 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:12:22.635069 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:12:22.635069 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:12:22.635069 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:12:22.635069 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:12:22.635069 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:12:22.635069 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:12:22.635069 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:12:22.635069 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:12:22.635069 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 07 01:12:22.635069 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 07 01:12:22.635069 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 07 01:12:22.635069 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1962397411 could not be found. Aug 07 01:12:22.635069 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:22.636456 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:12:22.636456 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:22.636456 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:12:22.636456 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:12:22.636456 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:12:22.636456 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:12:22.636456 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:12:22.636456 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1962397411 could not be found. Aug 07 01:12:22.636456 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:22.636456 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-08471dc7-d1ae-4681-95a8-f67a6254b0b2 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Returning 400 to user: Compute host tempest-host-1962397411 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:12:22.636456 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-08471dc7-d1ae-4681-95a8-f67a6254b0b2 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/b8d0c259-b533-4396-b916-8861a321b930/action" status: 400 len: 100 microversion: 2.1 time: 1.021819 Aug 07 01:12:22.640505 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 344/604] 10.222.0.39 () {60 vars in 1279 bytes} [Sun Aug 7 01:12:21 2022] POST /compute/v2.1/servers/b8d0c259-b533-4396-b916-8861a321b930/action => generated 100 bytes in 1025 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 07 01:12:22.646951 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-567819f3-b0fa-4f8e-9e5d-2119912af3c3 req-6ab2db23-37c1-46cf-bfde-c02f30fcd8b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a038208d-dae8-432d-97e5-2a58ea093e12", "name": "network-vif-plugged", "status": "completed", "tag": "34e132f0-6845-4fef-bc5f-494eced57c6a"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:22.664326 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-567819f3-b0fa-4f8e-9e5d-2119912af3c3 req-6ab2db23-37c1-46cf-bfde-c02f30fcd8b9 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:22.665239 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-567819f3-b0fa-4f8e-9e5d-2119912af3c3 req-6ab2db23-37c1-46cf-bfde-c02f30fcd8b9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:22.665895 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-567819f3-b0fa-4f8e-9e5d-2119912af3c3 req-6ab2db23-37c1-46cf-bfde-c02f30fcd8b9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:22.688808 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-567819f3-b0fa-4f8e-9e5d-2119912af3c3 req-6ab2db23-37c1-46cf-bfde-c02f30fcd8b9 service nova] Creating event network-vif-plugged:34e132f0-6845-4fef-bc5f-494eced57c6a for instance a038208d-dae8-432d-97e5-2a58ea093e12 on n-h2-master-1 Aug 07 01:12:22.700497 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-567819f3-b0fa-4f8e-9e5d-2119912af3c3 req-6ab2db23-37c1-46cf-bfde-c02f30fcd8b9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060730 Aug 07 01:12:22.701513 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 345/605] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:22.710659 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-facfd6f1-5158-487d-93a9-20c7cc6b22f0 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:22.711776 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-facfd6f1-5158-487d-93a9-20c7cc6b22f0 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 2125f4ff-9031-486f-8b5f-85082bf81588] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:22.722920 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-facfd6f1-5158-487d-93a9-20c7cc6b22f0 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:22.723812 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-facfd6f1-5158-487d-93a9-20c7cc6b22f0 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:22.724672 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-facfd6f1-5158-487d-93a9-20c7cc6b22f0 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:22.725928 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-facfd6f1-5158-487d-93a9-20c7cc6b22f0 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:22.726760 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-facfd6f1-5158-487d-93a9-20c7cc6b22f0 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:22.727468 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-facfd6f1-5158-487d-93a9-20c7cc6b22f0 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:23.149130 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e29b603e-460a-4d2d-b762-333b22bd6c72 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0d09d844bf453cb3e2637d630614ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5c39a06e41406a8c6c99d2e84ab282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:23.208949 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e29b603e-460a-4d2d-b762-333b22bd6c72 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12" status: 200 len: 1317 microversion: 2.1 time: 0.693624 Aug 07 01:12:23.212235 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 261/606] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:22 2022] GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12 => generated 1317 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:23.229090 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3e64eb02-cb84-4894-acf5-293d51cf0a8c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:23.231113 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3e64eb02-cb84-4894-acf5-293d51cf0a8c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:23.249977 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3e64eb02-cb84-4894-acf5-293d51cf0a8c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:23.251305 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3e64eb02-cb84-4894-acf5-293d51cf0a8c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:23.252826 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3e64eb02-cb84-4894-acf5-293d51cf0a8c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:23.255175 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3e64eb02-cb84-4894-acf5-293d51cf0a8c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:23.256967 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3e64eb02-cb84-4894-acf5-293d51cf0a8c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:23.258526 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3e64eb02-cb84-4894-acf5-293d51cf0a8c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:23.305554 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-facfd6f1-5158-487d-93a9-20c7cc6b22f0 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:23.329610 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-facfd6f1-5158-487d-93a9-20c7cc6b22f0 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588" status: 200 len: 1520 microversion: 2.1 time: 0.626045 Aug 07 01:12:23.344461 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 346/607] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:22 2022] GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588 => generated 1520 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:23.358812 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d32cee74-b0a6-4e89-a428-e0f1351d485f tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Calling method '.version_select at 0x7f9e24a4c160>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:23.477872 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d32cee74-b0a6-4e89-a428-e0f1351d485f tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:23.478790 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d32cee74-b0a6-4e89-a428-e0f1351d485f tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:23.479594 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d32cee74-b0a6-4e89-a428-e0f1351d485f tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:23.481091 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d32cee74-b0a6-4e89-a428-e0f1351d485f tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:23.482292 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d32cee74-b0a6-4e89-a428-e0f1351d485f tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:23.483567 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d32cee74-b0a6-4e89-a428-e0f1351d485f tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:23.527445 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d32cee74-b0a6-4e89-a428-e0f1351d485f tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/83da20dfe5d04940b1e1895997513baf/detail" status: 200 len: 463 microversion: 2.57 time: 0.180917 Aug 07 01:12:23.528832 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 347/608] 10.222.0.39 () {60 vars in 1304 bytes} [Sun Aug 7 01:12:23 2022] GET /compute/v2.1/os-quota-sets/83da20dfe5d04940b1e1895997513baf/detail => generated 463 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:12:23.539944 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b5b82946-57e2-4849-95fe-f9a6ad3cfc4f tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:23.549858 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b5b82946-57e2-4849-95fe-f9a6ad3cfc4f tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: b8d0c259-b533-4396-b916-8861a321b930] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:23.567421 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b5b82946-57e2-4849-95fe-f9a6ad3cfc4f tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:23.568231 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b5b82946-57e2-4849-95fe-f9a6ad3cfc4f tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:23.569065 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b5b82946-57e2-4849-95fe-f9a6ad3cfc4f tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:23.570829 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b5b82946-57e2-4849-95fe-f9a6ad3cfc4f tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:23.571830 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b5b82946-57e2-4849-95fe-f9a6ad3cfc4f tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:23.572670 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b5b82946-57e2-4849-95fe-f9a6ad3cfc4f tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:23.863153 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b5b82946-57e2-4849-95fe-f9a6ad3cfc4f tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0200a0753e46399d0b212c665aebce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7279db9d4f497b8430fd45280b5da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:23.875493 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b5b82946-57e2-4849-95fe-f9a6ad3cfc4f tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] 10.222.0.39 "GET /compute/v2.1/servers/b8d0c259-b533-4396-b916-8861a321b930" status: 200 len: 1468 microversion: 2.1 time: 0.344909 Aug 07 01:12:23.876135 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 348/609] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:23 2022] GET /compute/v2.1/servers/b8d0c259-b533-4396-b916-8861a321b930 => generated 1468 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:23.884049 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-77c89995-a5fd-415c-aa2a-e2dd0056f27b tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:23.884830 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-77c89995-a5fd-415c-aa2a-e2dd0056f27b tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:23.888809 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3e64eb02-cb84-4894-acf5-293d51cf0a8c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:23.895030 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77c89995-a5fd-415c-aa2a-e2dd0056f27b tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:23.896079 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77c89995-a5fd-415c-aa2a-e2dd0056f27b tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:23.896771 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77c89995-a5fd-415c-aa2a-e2dd0056f27b tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:23.897538 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77c89995-a5fd-415c-aa2a-e2dd0056f27b tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:23.898158 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77c89995-a5fd-415c-aa2a-e2dd0056f27b tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:23.898770 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77c89995-a5fd-415c-aa2a-e2dd0056f27b tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:23.900902 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3e64eb02-cb84-4894-acf5-293d51cf0a8c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79" status: 200 len: 1311 microversion: 2.1 time: 0.686079 Aug 07 01:12:23.901594 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 262/610] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:23 2022] GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79 => generated 1311 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:23.910791 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fd66c2fb-0bb0-4036-a913-4b042a9b1c50 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:23.911737 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fd66c2fb-0bb0-4036-a913-4b042a9b1c50 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 2125f4ff-9031-486f-8b5f-85082bf81588] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:23.922720 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd66c2fb-0bb0-4036-a913-4b042a9b1c50 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:23.924765 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd66c2fb-0bb0-4036-a913-4b042a9b1c50 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:23.925357 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd66c2fb-0bb0-4036-a913-4b042a9b1c50 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:23.926552 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd66c2fb-0bb0-4036-a913-4b042a9b1c50 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:23.927630 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd66c2fb-0bb0-4036-a913-4b042a9b1c50 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:23.928493 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd66c2fb-0bb0-4036-a913-4b042a9b1c50 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:23.984682 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fd66c2fb-0bb0-4036-a913-4b042a9b1c50 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 2125f4ff-9031-486f-8b5f-85082bf81588] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:12:24.008731 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-77c89995-a5fd-415c-aa2a-e2dd0056f27b tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lazy-loading 'services' on Instance uuid 2a4de302-ab36-4e7a-90b5-d72d3dc5d698 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:12:24.030233 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-77c89995-a5fd-415c-aa2a-e2dd0056f27b tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1927 microversion: 2.75 time: 0.152863 Aug 07 01:12:24.036025 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 349/611] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:12:23 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1927 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:12:24.036517 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fd74eaf2-84df-42e1-8778-f896b7d29301 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Action: 'update', calling method: .version_select at 0x7f9e24fc49d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:24.107726 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fd66c2fb-0bb0-4036-a913-4b042a9b1c50 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588" status: 204 len: 0 microversion: 2.1 time: 0.204360 Aug 07 01:12:24.108568 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 263/612] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:12:23 2022] DELETE /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:12:24.114334 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=70 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:24.116244 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-91dd7b86-337a-4320-983d-a6fed3281067 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-902840464", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:24.117917 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd74eaf2-84df-42e1-8778-f896b7d29301 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:24.118406 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd74eaf2-84df-42e1-8778-f896b7d29301 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:24.118858 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd74eaf2-84df-42e1-8778-f896b7d29301 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:24.119600 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd74eaf2-84df-42e1-8778-f896b7d29301 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:24.120295 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd74eaf2-84df-42e1-8778-f896b7d29301 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:24.120534 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd74eaf2-84df-42e1-8778-f896b7d29301 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:24.161288 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd74eaf2-84df-42e1-8778-f896b7d29301 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:24.162317 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd74eaf2-84df-42e1-8778-f896b7d29301 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:24.162826 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd74eaf2-84df-42e1-8778-f896b7d29301 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:24.163632 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd74eaf2-84df-42e1-8778-f896b7d29301 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:24.164119 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd74eaf2-84df-42e1-8778-f896b7d29301 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:24.164553 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd74eaf2-84df-42e1-8778-f896b7d29301 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:24.184570 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-91dd7b86-337a-4320-983d-a6fed3281067 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] validate_networks() for None {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:12:24.241191 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fd74eaf2-84df-42e1-8778-f896b7d29301 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/83da20dfe5d04940b1e1895997513baf?user_id=3fd6d55b125c4e17bed6aa3f2e1de358" status: 200 len: 148 microversion: 2.57 time: 0.208441 Aug 07 01:12:24.244957 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 350/613] 10.222.0.39 () {62 vars in 1384 bytes} [Sun Aug 7 01:12:24 2022] PUT /compute/v2.1/os-quota-sets/83da20dfe5d04940b1e1895997513baf?user_id=3fd6d55b125c4e17bed6aa3f2e1de358 => generated 148 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:12:24.251102 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a3ff2bb7-bf1c-46d0-9dde-9ebcd30980c3 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:24.252471 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a3ff2bb7-bf1c-46d0-9dde-9ebcd30980c3 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 2125f4ff-9031-486f-8b5f-85082bf81588] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:24.260564 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3ff2bb7-bf1c-46d0-9dde-9ebcd30980c3 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:24.261265 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3ff2bb7-bf1c-46d0-9dde-9ebcd30980c3 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:24.261773 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3ff2bb7-bf1c-46d0-9dde-9ebcd30980c3 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:24.262621 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3ff2bb7-bf1c-46d0-9dde-9ebcd30980c3 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:24.263150 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3ff2bb7-bf1c-46d0-9dde-9ebcd30980c3 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:24.263716 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3ff2bb7-bf1c-46d0-9dde-9ebcd30980c3 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:24.480933 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a3ff2bb7-bf1c-46d0-9dde-9ebcd30980c3 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:24.488035 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-91dd7b86-337a-4320-983d-a6fed3281067 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:12:24.488870 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-91dd7b86-337a-4320-983d-a6fed3281067 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:12:24.489941 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-91dd7b86-337a-4320-983d-a6fed3281067 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:12:24.490709 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-91dd7b86-337a-4320-983d-a6fed3281067 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:12:24.491434 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-91dd7b86-337a-4320-983d-a6fed3281067 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:12:24.492480 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a3ff2bb7-bf1c-46d0-9dde-9ebcd30980c3 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588" status: 200 len: 1526 microversion: 2.1 time: 0.248390 Aug 07 01:12:24.493380 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 351/614] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:24 2022] GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588 => generated 1526 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:24.503257 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5cf81261-48f1-4585-a1c1-3939ed027b2e tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:24.504348 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5cf81261-48f1-4585-a1c1-3939ed027b2e tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] [instance: a038208d-dae8-432d-97e5-2a58ea093e12] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:24.508916 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=95,nova_api:UPDATE=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:24.515499 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-91dd7b86-337a-4320-983d-a6fed3281067 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:24.516473 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cf81261-48f1-4585-a1c1-3939ed027b2e tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:24.516601 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-91dd7b86-337a-4320-983d-a6fed3281067 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:24.517515 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cf81261-48f1-4585-a1c1-3939ed027b2e tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:24.518392 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-91dd7b86-337a-4320-983d-a6fed3281067 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:24.518781 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cf81261-48f1-4585-a1c1-3939ed027b2e tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:24.519566 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-91dd7b86-337a-4320-983d-a6fed3281067 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:24.520436 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cf81261-48f1-4585-a1c1-3939ed027b2e tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:24.521037 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-91dd7b86-337a-4320-983d-a6fed3281067 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:24.521277 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cf81261-48f1-4585-a1c1-3939ed027b2e tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:24.522299 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cf81261-48f1-4585-a1c1-3939ed027b2e tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:24.522927 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-91dd7b86-337a-4320-983d-a6fed3281067 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:24.540123 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=15 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:24.561427 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-91dd7b86-337a-4320-983d-a6fed3281067 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Getting quotas for project 6a7279db9d4f497b8430fd45280b5da4. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:12:24.572653 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-91dd7b86-337a-4320-983d-a6fed3281067 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Getting quotas for user cc0200a0753e46399d0b212c665aebce and project 6a7279db9d4f497b8430fd45280b5da4. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:12:24.593675 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-91dd7b86-337a-4320-983d-a6fed3281067 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:12:24.597801 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-91dd7b86-337a-4320-983d-a6fed3281067 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: f083dc9e-4251-4249-bd6b-12028028484c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:12:24.660414 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-91dd7b86-337a-4320-983d-a6fed3281067 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.549909 Aug 07 01:12:24.661606 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 264/615] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:12:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:12:24.671579 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a39883dd-7210-46b2-99d2-0f8b3d0a2b4c tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Calling method '.version_select at 0x7f9e24bb3e50>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:24.774396 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5cf81261-48f1-4585-a1c1-3939ed027b2e tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0d09d844bf453cb3e2637d630614ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5c39a06e41406a8c6c99d2e84ab282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:24.789010 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5cf81261-48f1-4585-a1c1-3939ed027b2e tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12" status: 200 len: 1317 microversion: 2.1 time: 0.293683 Aug 07 01:12:24.790352 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 352/616] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:24 2022] GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12 => generated 1317 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:24.799039 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c7843a5f-20c9-4546-82d3-4b09831140b5 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:24.800506 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c7843a5f-20c9-4546-82d3-4b09831140b5 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: f083dc9e-4251-4249-bd6b-12028028484c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:24.802572 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a39883dd-7210-46b2-99d2-0f8b3d0a2b4c tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/83da20dfe5d04940b1e1895997513baf?user_id=3fd6d55b125c4e17bed6aa3f2e1de358" status: 200 len: 190 microversion: 2.57 time: 0.139406 Aug 07 01:12:24.803872 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 265/617] 10.222.0.39 () {60 vars in 1364 bytes} [Sun Aug 7 01:12:24 2022] GET /compute/v2.1/os-quota-sets/83da20dfe5d04940b1e1895997513baf?user_id=3fd6d55b125c4e17bed6aa3f2e1de358 => generated 190 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:12:24.810165 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-82cf1564-7713-4a82-b6cb-5276fad4c82c req-45f627b4-b189-4299-bcd8-947e82afdf40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2125f4ff-9031-486f-8b5f-85082bf81588", "name": "network-vif-plugged", "status": "completed", "tag": "1f8f9f06-bbaf-4b4c-afb2-b98cdf738a8d"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:24.825327 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-82cf1564-7713-4a82-b6cb-5276fad4c82c req-45f627b4-b189-4299-bcd8-947e82afdf40 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:24.827329 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-82cf1564-7713-4a82-b6cb-5276fad4c82c req-45f627b4-b189-4299-bcd8-947e82afdf40 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:24.828142 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-82cf1564-7713-4a82-b6cb-5276fad4c82c req-45f627b4-b189-4299-bcd8-947e82afdf40 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:24.847125 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-82cf1564-7713-4a82-b6cb-5276fad4c82c req-45f627b4-b189-4299-bcd8-947e82afdf40 service nova] Creating event network-vif-plugged:1f8f9f06-bbaf-4b4c-afb2-b98cdf738a8d for instance 2125f4ff-9031-486f-8b5f-85082bf81588 on n-h2-master-1 Aug 07 01:12:24.856386 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-82cf1564-7713-4a82-b6cb-5276fad4c82c req-45f627b4-b189-4299-bcd8-947e82afdf40 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048925 Aug 07 01:12:24.857844 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 266/618] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:24.924460 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c7843a5f-20c9-4546-82d3-4b09831140b5 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0200a0753e46399d0b212c665aebce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7279db9d4f497b8430fd45280b5da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:24.942993 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-daa6b784-a06f-4551-87ec-e6d7ffa649a9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:24.944365 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-daa6b784-a06f-4551-87ec-e6d7ffa649a9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:24.946360 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c7843a5f-20c9-4546-82d3-4b09831140b5 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] 10.222.0.39 "GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c" status: 200 len: 1218 microversion: 2.1 time: 0.153752 Aug 07 01:12:24.948671 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 353/619] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:24 2022] GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c => generated 1218 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:24.957276 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-daa6b784-a06f-4551-87ec-e6d7ffa649a9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:24.959248 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-daa6b784-a06f-4551-87ec-e6d7ffa649a9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:24.961278 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-daa6b784-a06f-4551-87ec-e6d7ffa649a9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:24.962625 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-daa6b784-a06f-4551-87ec-e6d7ffa649a9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:24.963480 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-daa6b784-a06f-4551-87ec-e6d7ffa649a9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:24.964445 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-daa6b784-a06f-4551-87ec-e6d7ffa649a9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:25.069519 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8f821b2e-7d87-400b-a7a5-450b96641291 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:25.071125 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8f821b2e-7d87-400b-a7a5-450b96641291 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:25.088215 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8f821b2e-7d87-400b-a7a5-450b96641291 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:25.090519 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8f821b2e-7d87-400b-a7a5-450b96641291 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:25.091476 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8f821b2e-7d87-400b-a7a5-450b96641291 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:25.094244 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8f821b2e-7d87-400b-a7a5-450b96641291 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:25.097424 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8f821b2e-7d87-400b-a7a5-450b96641291 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:25.099302 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8f821b2e-7d87-400b-a7a5-450b96641291 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:25.280671 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-8f821b2e-7d87-400b-a7a5-450b96641291 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lazy-loading 'services' on Instance uuid 2a4de302-ab36-4e7a-90b5-d72d3dc5d698 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:12:25.316486 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-daa6b784-a06f-4551-87ec-e6d7ffa649a9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:25.321519 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8f821b2e-7d87-400b-a7a5-450b96641291 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1927 microversion: 2.75 time: 0.259357 Aug 07 01:12:25.323697 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 354/620] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:12:25 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1927 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:12:25.331668 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-daa6b784-a06f-4551-87ec-e6d7ffa649a9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79" status: 200 len: 1311 microversion: 2.1 time: 0.409042 Aug 07 01:12:25.333242 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 267/621] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:24 2022] GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79 => generated 1311 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:25.524251 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f3eab8d3-a377-4f1c-9df4-17fb1dad7a09 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:25.526668 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f3eab8d3-a377-4f1c-9df4-17fb1dad7a09 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 2125f4ff-9031-486f-8b5f-85082bf81588] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:25.541568 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f3eab8d3-a377-4f1c-9df4-17fb1dad7a09 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:25.542305 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f3eab8d3-a377-4f1c-9df4-17fb1dad7a09 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:25.543306 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f3eab8d3-a377-4f1c-9df4-17fb1dad7a09 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:25.545372 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f3eab8d3-a377-4f1c-9df4-17fb1dad7a09 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:25.546280 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f3eab8d3-a377-4f1c-9df4-17fb1dad7a09 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:25.547321 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f3eab8d3-a377-4f1c-9df4-17fb1dad7a09 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:25.556554 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:25.770239 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f3eab8d3-a377-4f1c-9df4-17fb1dad7a09 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:25.784390 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f3eab8d3-a377-4f1c-9df4-17fb1dad7a09 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588" status: 200 len: 1526 microversion: 2.1 time: 0.266892 Aug 07 01:12:25.785406 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 355/622] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:25 2022] GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588 => generated 1526 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:25.826908 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c29d76a8-5d19-47ed-873e-263896e5a6d5 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:25.827719 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c29d76a8-5d19-47ed-873e-263896e5a6d5 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] [instance: a038208d-dae8-432d-97e5-2a58ea093e12] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:25.841027 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c29d76a8-5d19-47ed-873e-263896e5a6d5 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:25.841861 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c29d76a8-5d19-47ed-873e-263896e5a6d5 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:25.842498 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c29d76a8-5d19-47ed-873e-263896e5a6d5 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:25.843480 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c29d76a8-5d19-47ed-873e-263896e5a6d5 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:25.844360 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c29d76a8-5d19-47ed-873e-263896e5a6d5 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:25.844920 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c29d76a8-5d19-47ed-873e-263896e5a6d5 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:25.989046 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f10a77d7-18d3-47b5-b28f-137ed64438a6 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:25.991289 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f10a77d7-18d3-47b5-b28f-137ed64438a6 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: f083dc9e-4251-4249-bd6b-12028028484c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:26.007821 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f10a77d7-18d3-47b5-b28f-137ed64438a6 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:26.008879 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f10a77d7-18d3-47b5-b28f-137ed64438a6 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:26.009939 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f10a77d7-18d3-47b5-b28f-137ed64438a6 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:26.011268 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f10a77d7-18d3-47b5-b28f-137ed64438a6 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:26.012147 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f10a77d7-18d3-47b5-b28f-137ed64438a6 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:26.013171 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f10a77d7-18d3-47b5-b28f-137ed64438a6 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:26.110250 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c29d76a8-5d19-47ed-873e-263896e5a6d5 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0d09d844bf453cb3e2637d630614ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5c39a06e41406a8c6c99d2e84ab282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:26.121138 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c29d76a8-5d19-47ed-873e-263896e5a6d5 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12" status: 200 len: 1317 microversion: 2.1 time: 0.301049 Aug 07 01:12:26.128214 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 268/623] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:25 2022] GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12 => generated 1317 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:26.190417 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f10a77d7-18d3-47b5-b28f-137ed64438a6 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0200a0753e46399d0b212c665aebce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7279db9d4f497b8430fd45280b5da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:26.204396 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f10a77d7-18d3-47b5-b28f-137ed64438a6 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] 10.222.0.39 "GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c" status: 200 len: 1270 microversion: 2.1 time: 0.224786 Aug 07 01:12:26.206129 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 356/624] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:25 2022] GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c => generated 1270 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:26.367653 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7d4b55e3-4e58-4fe4-a47f-4f7cf45eb89f tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:26.368558 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7d4b55e3-4e58-4fe4-a47f-4f7cf45eb89f tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:26.376373 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-90c1a049-994d-44d0-a493-14b3d0ba8fb0 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:26.376663 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7d4b55e3-4e58-4fe4-a47f-4f7cf45eb89f tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:26.377735 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7d4b55e3-4e58-4fe4-a47f-4f7cf45eb89f tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:26.378423 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7d4b55e3-4e58-4fe4-a47f-4f7cf45eb89f tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:26.379383 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7d4b55e3-4e58-4fe4-a47f-4f7cf45eb89f tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:26.379645 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-90c1a049-994d-44d0-a493-14b3d0ba8fb0 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:26.379871 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7d4b55e3-4e58-4fe4-a47f-4f7cf45eb89f tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:26.380338 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7d4b55e3-4e58-4fe4-a47f-4f7cf45eb89f tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:26.393295 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90c1a049-994d-44d0-a493-14b3d0ba8fb0 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:26.394145 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90c1a049-994d-44d0-a493-14b3d0ba8fb0 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:26.395136 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90c1a049-994d-44d0-a493-14b3d0ba8fb0 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:26.397147 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90c1a049-994d-44d0-a493-14b3d0ba8fb0 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:26.398016 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90c1a049-994d-44d0-a493-14b3d0ba8fb0 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:26.399303 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90c1a049-994d-44d0-a493-14b3d0ba8fb0 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:26.617737 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-90c1a049-994d-44d0-a493-14b3d0ba8fb0 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:26.627167 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-90c1a049-994d-44d0-a493-14b3d0ba8fb0 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79" status: 200 len: 1311 microversion: 2.1 time: 0.262787 Aug 07 01:12:26.628005 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 357/625] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:26 2022] GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79 => generated 1311 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:26.655572 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-7d4b55e3-4e58-4fe4-a47f-4f7cf45eb89f tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lazy-loading 'services' on Instance uuid 2a4de302-ab36-4e7a-90b5-d72d3dc5d698 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:12:26.672932 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:26.678375 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7d4b55e3-4e58-4fe4-a47f-4f7cf45eb89f tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1927 microversion: 2.75 time: 0.314822 Aug 07 01:12:26.679137 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 269/626] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:12:26 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1927 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:12:26.814938 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-abbfe8c5-dcee-435f-902d-8e70b6e0145a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:26.816126 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-abbfe8c5-dcee-435f-902d-8e70b6e0145a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 2125f4ff-9031-486f-8b5f-85082bf81588] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:26.828178 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-abbfe8c5-dcee-435f-902d-8e70b6e0145a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:26.829066 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-abbfe8c5-dcee-435f-902d-8e70b6e0145a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:26.830430 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-abbfe8c5-dcee-435f-902d-8e70b6e0145a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:26.831767 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-abbfe8c5-dcee-435f-902d-8e70b6e0145a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:26.832597 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-abbfe8c5-dcee-435f-902d-8e70b6e0145a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:26.833393 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-abbfe8c5-dcee-435f-902d-8e70b6e0145a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:27.098270 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-abbfe8c5-dcee-435f-902d-8e70b6e0145a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:27.115375 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-abbfe8c5-dcee-435f-902d-8e70b6e0145a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588" status: 200 len: 1526 microversion: 2.1 time: 0.308050 Aug 07 01:12:27.128864 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 358/627] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:26 2022] GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588 => generated 1526 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:27.157635 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7ae15974-3d01-4ab7-bc97-6dea5aecfc09 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:27.158933 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7ae15974-3d01-4ab7-bc97-6dea5aecfc09 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] [instance: a038208d-dae8-432d-97e5-2a58ea093e12] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:27.170030 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ae15974-3d01-4ab7-bc97-6dea5aecfc09 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:27.170576 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ae15974-3d01-4ab7-bc97-6dea5aecfc09 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:27.171031 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ae15974-3d01-4ab7-bc97-6dea5aecfc09 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:27.172032 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ae15974-3d01-4ab7-bc97-6dea5aecfc09 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:27.172515 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ae15974-3d01-4ab7-bc97-6dea5aecfc09 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:27.173328 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ae15974-3d01-4ab7-bc97-6dea5aecfc09 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:27.231843 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-65ec7056-a46b-4150-b6be-5a27a7664846 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:27.232996 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-65ec7056-a46b-4150-b6be-5a27a7664846 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: f083dc9e-4251-4249-bd6b-12028028484c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:27.242054 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-65ec7056-a46b-4150-b6be-5a27a7664846 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:27.242930 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-65ec7056-a46b-4150-b6be-5a27a7664846 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:27.243572 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-65ec7056-a46b-4150-b6be-5a27a7664846 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:27.245270 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-65ec7056-a46b-4150-b6be-5a27a7664846 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:27.245998 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-65ec7056-a46b-4150-b6be-5a27a7664846 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:27.246705 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-65ec7056-a46b-4150-b6be-5a27a7664846 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:27.377642 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-65ec7056-a46b-4150-b6be-5a27a7664846 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0200a0753e46399d0b212c665aebce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7279db9d4f497b8430fd45280b5da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:27.390404 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-65ec7056-a46b-4150-b6be-5a27a7664846 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] 10.222.0.39 "GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c" status: 200 len: 1276 microversion: 2.1 time: 0.162609 Aug 07 01:12:27.392174 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 359/628] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:27 2022] GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c => generated 1276 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:12:27.402301 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-ff9efaaa-a054-4418-836e-b028e0055f8f req-d8e111f7-79be-491e-91e7-2a2116c07b79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06b38422-fb09-4331-b7cb-3d5f99cc2e79", "name": "network-vif-plugged", "status": "completed", "tag": "d5cc418b-ee3e-4a9b-b03a-2585f8a9e3b3"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:27.419348 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-ff9efaaa-a054-4418-836e-b028e0055f8f req-d8e111f7-79be-491e-91e7-2a2116c07b79 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:27.420268 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-ff9efaaa-a054-4418-836e-b028e0055f8f req-d8e111f7-79be-491e-91e7-2a2116c07b79 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:27.421445 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-ff9efaaa-a054-4418-836e-b028e0055f8f req-d8e111f7-79be-491e-91e7-2a2116c07b79 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:27.457161 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-ff9efaaa-a054-4418-836e-b028e0055f8f req-d8e111f7-79be-491e-91e7-2a2116c07b79 service nova] Creating event network-vif-plugged:d5cc418b-ee3e-4a9b-b03a-2585f8a9e3b3 for instance 06b38422-fb09-4331-b7cb-3d5f99cc2e79 on n-h2-master-1 Aug 07 01:12:27.469864 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-ff9efaaa-a054-4418-836e-b028e0055f8f req-d8e111f7-79be-491e-91e7-2a2116c07b79 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071712 Aug 07 01:12:27.471697 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 360/629] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:27.580524 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7ae15974-3d01-4ab7-bc97-6dea5aecfc09 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0d09d844bf453cb3e2637d630614ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5c39a06e41406a8c6c99d2e84ab282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:27.584737 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:27.619852 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7ae15974-3d01-4ab7-bc97-6dea5aecfc09 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12" status: 200 len: 1466 microversion: 2.1 time: 0.479166 Aug 07 01:12:27.624506 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 270/630] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:27 2022] GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12 => generated 1466 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:27.653415 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d2ac58fa-1d39-4589-ae2e-2b54729c9631 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:27.655471 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d2ac58fa-1d39-4589-ae2e-2b54729c9631 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:27.666285 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cc0784f3-047a-437b-84cd-2e49f779c5fc tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-693193868", "metadata": {"image_type": "test"}}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:27.667909 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2ac58fa-1d39-4589-ae2e-2b54729c9631 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:27.669987 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2ac58fa-1d39-4589-ae2e-2b54729c9631 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:27.672165 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-cc0784f3-047a-437b-84cd-2e49f779c5fc tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] [instance: a038208d-dae8-432d-97e5-2a58ea093e12] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:27.672402 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2ac58fa-1d39-4589-ae2e-2b54729c9631 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:27.673214 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2ac58fa-1d39-4589-ae2e-2b54729c9631 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:27.673890 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2ac58fa-1d39-4589-ae2e-2b54729c9631 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:27.675360 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2ac58fa-1d39-4589-ae2e-2b54729c9631 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:27.686462 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc0784f3-047a-437b-84cd-2e49f779c5fc tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:27.688116 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc0784f3-047a-437b-84cd-2e49f779c5fc tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:27.689584 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc0784f3-047a-437b-84cd-2e49f779c5fc tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:27.691761 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc0784f3-047a-437b-84cd-2e49f779c5fc tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:27.693068 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc0784f3-047a-437b-84cd-2e49f779c5fc tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:27.694187 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc0784f3-047a-437b-84cd-2e49f779c5fc tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:27.791686 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-cc0784f3-047a-437b-84cd-2e49f779c5fc tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Getting quotas for project dc5c39a06e41406a8c6c99d2e84ab282. Resources: dict_keys(['metadata_items']) {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:12:27.803908 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-cc0784f3-047a-437b-84cd-2e49f779c5fc tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Getting quotas for user 1d0d09d844bf453cb3e2637d630614ff and project dc5c39a06e41406a8c6c99d2e84ab282. Resources: dict_keys(['metadata_items']) {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:12:27.990959 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d2ac58fa-1d39-4589-ae2e-2b54729c9631 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:28.009561 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d2ac58fa-1d39-4589-ae2e-2b54729c9631 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79" status: 200 len: 1311 microversion: 2.1 time: 0.362922 Aug 07 01:12:28.011281 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 361/631] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:27 2022] GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79 => generated 1311 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:28.041226 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bd1fde68-465c-4e71-8971-99e535cf5ac7 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:28.042641 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bd1fde68-465c-4e71-8971-99e535cf5ac7 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:28.056293 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd1fde68-465c-4e71-8971-99e535cf5ac7 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:28.057330 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd1fde68-465c-4e71-8971-99e535cf5ac7 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:28.058366 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd1fde68-465c-4e71-8971-99e535cf5ac7 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:28.059783 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd1fde68-465c-4e71-8971-99e535cf5ac7 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:28.060799 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd1fde68-465c-4e71-8971-99e535cf5ac7 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:28.061715 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd1fde68-465c-4e71-8971-99e535cf5ac7 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:28.315070 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-bd1fde68-465c-4e71-8971-99e535cf5ac7 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lazy-loading 'services' on Instance uuid 2a4de302-ab36-4e7a-90b5-d72d3dc5d698 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:12:28.327871 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cc0784f3-047a-437b-84cd-2e49f779c5fc tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "POST /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12/action" status: 202 len: 0 microversion: 2.1 time: 0.671202 Aug 07 01:12:28.329118 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 271/632] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:12:27 2022] POST /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12/action => generated 0 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 07 01:12:28.342029 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-3dfacbc2-6460-467f-ad21-b45b0afaa89a req-19c84f27-31bf-4d0a-862e-dd34c2c68dd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2125f4ff-9031-486f-8b5f-85082bf81588", "name": "network-vif-deleted", "tag": "1f8f9f06-bbaf-4b4c-afb2-b98cdf738a8d"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:28.355533 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bd1fde68-465c-4e71-8971-99e535cf5ac7 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1927 microversion: 2.75 time: 0.342061 Aug 07 01:12:28.356156 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3dfacbc2-6460-467f-ad21-b45b0afaa89a req-19c84f27-31bf-4d0a-862e-dd34c2c68dd8 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:28.356156 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3dfacbc2-6460-467f-ad21-b45b0afaa89a req-19c84f27-31bf-4d0a-862e-dd34c2c68dd8 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:28.357209 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3dfacbc2-6460-467f-ad21-b45b0afaa89a req-19c84f27-31bf-4d0a-862e-dd34c2c68dd8 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:28.373376 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 362/633] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:12:28 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1927 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:12:28.374259 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-3dfacbc2-6460-467f-ad21-b45b0afaa89a req-19c84f27-31bf-4d0a-862e-dd34c2c68dd8 service nova] Creating event network-vif-deleted:1f8f9f06-bbaf-4b4c-afb2-b98cdf738a8d for instance 2125f4ff-9031-486f-8b5f-85082bf81588 on n-h2-master-1 Aug 07 01:12:28.380189 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-3dfacbc2-6460-467f-ad21-b45b0afaa89a req-19c84f27-31bf-4d0a-862e-dd34c2c68dd8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048282 Aug 07 01:12:28.380858 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 272/634] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:28.382410 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dd0ad761-a64c-4c28-849f-23a74cdf509f tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:28.383231 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-dd0ad761-a64c-4c28-849f-23a74cdf509f tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 2125f4ff-9031-486f-8b5f-85082bf81588] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:28.386547 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-420bfccb-41d2-45c4-b3c0-98ec6cd53ac4 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e24904ca0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:28.391037 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd0ad761-a64c-4c28-849f-23a74cdf509f tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:28.391667 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd0ad761-a64c-4c28-849f-23a74cdf509f tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:28.392859 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd0ad761-a64c-4c28-849f-23a74cdf509f tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:28.393569 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd0ad761-a64c-4c28-849f-23a74cdf509f tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:28.394547 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd0ad761-a64c-4c28-849f-23a74cdf509f tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:28.395256 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd0ad761-a64c-4c28-849f-23a74cdf509f tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:28.441455 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-420bfccb-41d2-45c4-b3c0-98ec6cd53ac4 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d" status: 200 len: 1423 microversion: 2.1 time: 0.059095 Aug 07 01:12:28.443320 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 273/635] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:12:28 2022] GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d => generated 1423 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:28.459945 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ca8477e7-5cd2-4276-ae0f-5743a54a7f8e tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:28.461048 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ca8477e7-5cd2-4276-ae0f-5743a54a7f8e tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: f083dc9e-4251-4249-bd6b-12028028484c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:28.468726 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca8477e7-5cd2-4276-ae0f-5743a54a7f8e tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:28.469591 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca8477e7-5cd2-4276-ae0f-5743a54a7f8e tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:28.470239 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca8477e7-5cd2-4276-ae0f-5743a54a7f8e tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:28.471866 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca8477e7-5cd2-4276-ae0f-5743a54a7f8e tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:28.472591 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca8477e7-5cd2-4276-ae0f-5743a54a7f8e tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:28.473167 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca8477e7-5cd2-4276-ae0f-5743a54a7f8e tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:28.479683 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-dd0ad761-a64c-4c28-849f-23a74cdf509f tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:28.490052 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-dd0ad761-a64c-4c28-849f-23a74cdf509f tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588" status: 200 len: 1309 microversion: 2.1 time: 0.114689 Aug 07 01:12:28.491081 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 363/636] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:28 2022] GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588 => generated 1309 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:28.621261 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ca8477e7-5cd2-4276-ae0f-5743a54a7f8e tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0200a0753e46399d0b212c665aebce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7279db9d4f497b8430fd45280b5da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:28.630736 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ca8477e7-5cd2-4276-ae0f-5743a54a7f8e tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] 10.222.0.39 "GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c" status: 200 len: 1276 microversion: 2.1 time: 0.185469 Aug 07 01:12:28.631334 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 274/637] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:28 2022] GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c => generated 1276 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:29.038441 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-45ce82ba-343a-4d3a-9096-814a2705264c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:29.039530 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-45ce82ba-343a-4d3a-9096-814a2705264c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:29.055373 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-45ce82ba-343a-4d3a-9096-814a2705264c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:29.056528 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-45ce82ba-343a-4d3a-9096-814a2705264c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:29.057600 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-45ce82ba-343a-4d3a-9096-814a2705264c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:29.059162 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-45ce82ba-343a-4d3a-9096-814a2705264c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:29.060530 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-45ce82ba-343a-4d3a-9096-814a2705264c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:29.061530 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-45ce82ba-343a-4d3a-9096-814a2705264c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:29.304033 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-45ce82ba-343a-4d3a-9096-814a2705264c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:29.319935 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-45ce82ba-343a-4d3a-9096-814a2705264c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79" status: 200 len: 1311 microversion: 2.1 time: 0.288766 Aug 07 01:12:29.322110 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 364/638] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:29 2022] GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79 => generated 1311 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:12:29.385362 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fa07e511-c798-4b7a-84c6-e2e45fe49a0b tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:29.386220 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fa07e511-c798-4b7a-84c6-e2e45fe49a0b tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:29.399186 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa07e511-c798-4b7a-84c6-e2e45fe49a0b tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:29.400232 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa07e511-c798-4b7a-84c6-e2e45fe49a0b tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:29.400941 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa07e511-c798-4b7a-84c6-e2e45fe49a0b tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:29.402660 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa07e511-c798-4b7a-84c6-e2e45fe49a0b tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:29.403740 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa07e511-c798-4b7a-84c6-e2e45fe49a0b tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:29.405109 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa07e511-c798-4b7a-84c6-e2e45fe49a0b tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:29.462873 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b1e3511d-f682-4881-8953-34ad858be8fb tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e24966f70>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:29.530578 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b1e3511d-f682-4881-8953-34ad858be8fb tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d" status: 200 len: 1423 microversion: 2.1 time: 0.072618 Aug 07 01:12:29.531440 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 365/639] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:12:29 2022] GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d => generated 1423 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:29.537331 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bf2899d7-fc61-4259-810d-14ff6f4752c8 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:29.538368 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bf2899d7-fc61-4259-810d-14ff6f4752c8 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 2125f4ff-9031-486f-8b5f-85082bf81588] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:29.548108 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bf2899d7-fc61-4259-810d-14ff6f4752c8 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:29.549107 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bf2899d7-fc61-4259-810d-14ff6f4752c8 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:29.549781 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bf2899d7-fc61-4259-810d-14ff6f4752c8 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:29.551618 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bf2899d7-fc61-4259-810d-14ff6f4752c8 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:29.552496 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bf2899d7-fc61-4259-810d-14ff6f4752c8 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:29.553099 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bf2899d7-fc61-4259-810d-14ff6f4752c8 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:29.593675 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bf2899d7-fc61-4259-810d-14ff6f4752c8 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:29.594548 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bf2899d7-fc61-4259-810d-14ff6f4752c8 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:29.595160 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bf2899d7-fc61-4259-810d-14ff6f4752c8 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:29.595821 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-bf2899d7-fc61-4259-810d-14ff6f4752c8 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lazy-loading 'fault' on Instance uuid 2125f4ff-9031-486f-8b5f-85082bf81588 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:12:29.661213 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-fa07e511-c798-4b7a-84c6-e2e45fe49a0b tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lazy-loading 'services' on Instance uuid 2a4de302-ab36-4e7a-90b5-d72d3dc5d698 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:12:29.667013 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bf2899d7-fc61-4259-810d-14ff6f4752c8 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:29.686401 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bf2899d7-fc61-4259-810d-14ff6f4752c8 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588" status: 200 len: 1314 microversion: 2.1 time: 0.152156 Aug 07 01:12:29.690937 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 366/640] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:29 2022] GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:29.705443 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-88f04f3f-00b1-455a-ae99-ff097ac2e742 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:29.706753 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-88f04f3f-00b1-455a-ae99-ff097ac2e742 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: f083dc9e-4251-4249-bd6b-12028028484c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:29.718545 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-88f04f3f-00b1-455a-ae99-ff097ac2e742 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:29.719735 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-88f04f3f-00b1-455a-ae99-ff097ac2e742 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:29.721302 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-88f04f3f-00b1-455a-ae99-ff097ac2e742 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:29.722842 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-88f04f3f-00b1-455a-ae99-ff097ac2e742 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:29.723830 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-88f04f3f-00b1-455a-ae99-ff097ac2e742 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:29.724922 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-88f04f3f-00b1-455a-ae99-ff097ac2e742 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:29.734840 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fa07e511-c798-4b7a-84c6-e2e45fe49a0b tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1927 microversion: 2.75 time: 0.354215 Aug 07 01:12:29.748946 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 275/641] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:12:29 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1927 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:12:30.016683 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-88f04f3f-00b1-455a-ae99-ff097ac2e742 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0200a0753e46399d0b212c665aebce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7279db9d4f497b8430fd45280b5da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:30.033121 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-88f04f3f-00b1-455a-ae99-ff097ac2e742 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] 10.222.0.39 "GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c" status: 200 len: 1318 microversion: 2.1 time: 0.337969 Aug 07 01:12:30.034928 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 367/642] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:29 2022] GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c => generated 1318 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:30.351171 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-22b2c6b4-92d9-4c8e-8671-2dad6df53086 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:30.352821 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-22b2c6b4-92d9-4c8e-8671-2dad6df53086 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:30.364483 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22b2c6b4-92d9-4c8e-8671-2dad6df53086 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:30.366071 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22b2c6b4-92d9-4c8e-8671-2dad6df53086 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:30.367444 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22b2c6b4-92d9-4c8e-8671-2dad6df53086 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:30.369969 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22b2c6b4-92d9-4c8e-8671-2dad6df53086 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:30.371200 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22b2c6b4-92d9-4c8e-8671-2dad6df53086 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:30.372479 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22b2c6b4-92d9-4c8e-8671-2dad6df53086 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:30.431833 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-f4cde59a-2886-404e-9591-5e468c43641f req-e15226c3-abe7-4c3c-9313-162d6eddf56a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f083dc9e-4251-4249-bd6b-12028028484c", "tag": "046e68ae-d096-484f-bea5-0248b5d25686"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:30.474287 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f4cde59a-2886-404e-9591-5e468c43641f req-e15226c3-abe7-4c3c-9313-162d6eddf56a service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:30.475014 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f4cde59a-2886-404e-9591-5e468c43641f req-e15226c3-abe7-4c3c-9313-162d6eddf56a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:30.479107 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f4cde59a-2886-404e-9591-5e468c43641f req-e15226c3-abe7-4c3c-9313-162d6eddf56a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:30.510202 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-f4cde59a-2886-404e-9591-5e468c43641f req-e15226c3-abe7-4c3c-9313-162d6eddf56a service nova] Creating event network-changed:046e68ae-d096-484f-bea5-0248b5d25686 for instance f083dc9e-4251-4249-bd6b-12028028484c on n-h1-master-1 Aug 07 01:12:30.522565 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-f4cde59a-2886-404e-9591-5e468c43641f req-e15226c3-abe7-4c3c-9313-162d6eddf56a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100170 Aug 07 01:12:30.525148 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 368/643] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:12:30.558474 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dc38c1d7-72c6-49d2-8c28-fe7db04cac81 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e24ba4310>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:30.671871 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-dc38c1d7-72c6-49d2-8c28-fe7db04cac81 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d" status: 200 len: 1423 microversion: 2.1 time: 0.119504 Aug 07 01:12:30.686467 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 369/644] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:12:30 2022] GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d => generated 1423 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:30.746047 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d54339bb-b207-434b-95bb-02c55c344618 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:30.750726 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d54339bb-b207-434b-95bb-02c55c344618 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 2125f4ff-9031-486f-8b5f-85082bf81588] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:30.763979 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d54339bb-b207-434b-95bb-02c55c344618 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:30.764883 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d54339bb-b207-434b-95bb-02c55c344618 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:30.765530 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d54339bb-b207-434b-95bb-02c55c344618 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:30.768763 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d54339bb-b207-434b-95bb-02c55c344618 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:30.771658 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d54339bb-b207-434b-95bb-02c55c344618 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:30.772914 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d54339bb-b207-434b-95bb-02c55c344618 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:30.806448 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-d54339bb-b207-434b-95bb-02c55c344618 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] HTTP exception thrown: Instance 2125f4ff-9031-486f-8b5f-85082bf81588 could not be found. Aug 07 01:12:30.816138 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d54339bb-b207-434b-95bb-02c55c344618 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Request method failure captured: Aug 07 01:12:30.816138 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588 HTTP/1.1 Aug 07 01:12:30.816138 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:12:30.816138 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:12:30.816138 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:12:30.816138 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:12:30.816138 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:12:30.816138 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:12:30.816138 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:12:30.816138 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:12:30.816138 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xFJvA8aViwvAloPsDf2VckLIvT0ef2dFkqEzqRHcsoXzKL-UrjSbgq9qrhn-Kr0K6IWORgsxpa0ZC6p7prEjOQjpXXrO_P6Q36zbcHdiXbdtz0b1lfjcwupDS07IycJWoRXidnJpp03pTzYbxhgdiNsodOZkAAXZnRnVK8CHn-Gq7M Aug 07 01:12:30.816138 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:12:30.816138 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:12:30.816138 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:12:30.816138 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:12:30.816138 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:12:30.816138 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:12:30.816138 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 4e443158f15b42a3a795950a7c409a38 Aug 07 01:12:30.816138 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:12:30.816138 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:12:30.816138 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:12:30.819236 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4e443158f15b42a3a795950a7c409a38", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:12:30.819236 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:12:30.819236 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 4e443158f15b42a3a795950a7c409a38 Aug 07 01:12:30.819236 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:12:30.819236 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ImagesOneServerNegativeTestJSON-439364583-project Aug 07 01:12:30.819236 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:12:30.819236 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:12:30.819236 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: c135ba135fd946149ace9a86c7c52e80 Aug 07 01:12:30.819236 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-439364583-project Aug 07 01:12:30.819236 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:12:30.819236 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 2125f4ff-9031-486f-8b5f-85082bf81588 could not be found. Aug 07 01:12:30.819236 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '2125f4ff-9031-486f-8b5f-85082bf81588'} Aug 07 01:12:30.820952 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:12:30.820952 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:12:30.820952 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:12:30.820952 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:12:30.820952 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:12:30.820952 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:12:30.820952 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:12:30.820952 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:12:30.820952 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:12:30.820952 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:12:30.820952 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2125f4ff-9031-486f-8b5f-85082bf81588 could not be found. Aug 07 01:12:30.820952 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:30.820952 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:12:30.820952 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:30.820952 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:12:30.820952 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:12:30.820952 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:12:30.820952 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:12:30.820952 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:12:30.820952 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:12:30.823500 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:12:30.823500 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:12:30.823500 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:12:30.823500 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:12:30.823500 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:12:30.823500 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:12:30.823500 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:12:30.823500 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2125f4ff-9031-486f-8b5f-85082bf81588 could not be found. Aug 07 01:12:30.823500 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:30.823500 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:12:30.823500 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:30.823500 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:12:30.823500 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:12:30.823500 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:12:30.823500 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:12:30.823500 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:12:30.823500 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2125f4ff-9031-486f-8b5f-85082bf81588 could not be found. Aug 07 01:12:30.823500 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:30.832825 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d54339bb-b207-434b-95bb-02c55c344618 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Returning 404 to user: Instance 2125f4ff-9031-486f-8b5f-85082bf81588 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:12:30.835125 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d54339bb-b207-434b-95bb-02c55c344618 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588" status: 404 len: 111 microversion: 2.1 time: 0.104673 Aug 07 01:12:30.839588 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 370/645] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:30 2022] GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:12:30.851118 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-86a3e066-c795-4e1f-99be-05eb798a1b8d tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:30.853019 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-86a3e066-c795-4e1f-99be-05eb798a1b8d tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:30.859450 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-22b2c6b4-92d9-4c8e-8671-2dad6df53086 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:30.870223 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86a3e066-c795-4e1f-99be-05eb798a1b8d tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:30.871537 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86a3e066-c795-4e1f-99be-05eb798a1b8d tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:30.872562 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86a3e066-c795-4e1f-99be-05eb798a1b8d tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:30.874142 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86a3e066-c795-4e1f-99be-05eb798a1b8d tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:30.875187 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86a3e066-c795-4e1f-99be-05eb798a1b8d tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:30.878554 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86a3e066-c795-4e1f-99be-05eb798a1b8d tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:30.880716 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-22b2c6b4-92d9-4c8e-8671-2dad6df53086 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79" status: 200 len: 1495 microversion: 2.1 time: 0.538091 Aug 07 01:12:30.881678 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 276/646] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:30 2022] GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79 => generated 1495 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:12:30.890784 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5daacab1-e7bb-49f9-a1ab-bee2dfc2e5a9 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Action: 'create', calling method: .version_select at 0x7f9e2491f670>, body: {"keypair": {"name": "tempest-keypair-2080171021", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSk1Bq7/69IYRnHWqdaQndnFTt/2uxVvCQATZOUB+7RfbrZxtB4jCx0dhiZIrH+iEdqGRKOqW/XHHyB+4mT83o7Lyocx6c4uYtcPRcJIp9CHZPdW++0kjf/jFvrVqcOzw=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:30.935600 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=85 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:30.941282 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-5daacab1-e7bb-49f9-a1ab-bee2dfc2e5a9 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Getting quotas for project 4e443158f15b42a3a795950a7c409a38. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:12:30.976485 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-5daacab1-e7bb-49f9-a1ab-bee2dfc2e5a9 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Getting quotas for user c135ba135fd946149ace9a86c7c52e80 and project 4e443158f15b42a3a795950a7c409a38. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:12:31.043094 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-86a3e066-c795-4e1f-99be-05eb798a1b8d tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lazy-loading 'services' on Instance uuid 2a4de302-ab36-4e7a-90b5-d72d3dc5d698 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:12:31.078289 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5daacab1-e7bb-49f9-a1ab-bee2dfc2e5a9 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.195009 Aug 07 01:12:31.079415 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 277/647] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:12:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:31.083707 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-86a3e066-c795-4e1f-99be-05eb798a1b8d tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1927 microversion: 2.75 time: 0.242081 Aug 07 01:12:31.084370 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 371/648] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:12:30 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1927 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:12:31.118461 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5f1a416b-77fc-4d43-bb62-ac2bc4fc0077 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:31.118712 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3a01e472-bb7d-4610-9cd5-66aec3d193fa tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:31.119300 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3a01e472-bb7d-4610-9cd5-66aec3d193fa tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: f083dc9e-4251-4249-bd6b-12028028484c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:31.123111 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5f1a416b-77fc-4d43-bb62-ac2bc4fc0077 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:31.140601 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f1a416b-77fc-4d43-bb62-ac2bc4fc0077 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:31.141215 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f1a416b-77fc-4d43-bb62-ac2bc4fc0077 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:31.143844 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f1a416b-77fc-4d43-bb62-ac2bc4fc0077 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:31.145680 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a01e472-bb7d-4610-9cd5-66aec3d193fa tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:31.147859 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f1a416b-77fc-4d43-bb62-ac2bc4fc0077 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:31.148935 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f1a416b-77fc-4d43-bb62-ac2bc4fc0077 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:31.151249 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a01e472-bb7d-4610-9cd5-66aec3d193fa tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:31.152242 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f1a416b-77fc-4d43-bb62-ac2bc4fc0077 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:31.154146 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a01e472-bb7d-4610-9cd5-66aec3d193fa tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:31.154961 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a01e472-bb7d-4610-9cd5-66aec3d193fa tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:31.161851 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a01e472-bb7d-4610-9cd5-66aec3d193fa tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:31.163629 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a01e472-bb7d-4610-9cd5-66aec3d193fa tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:31.541805 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3a01e472-bb7d-4610-9cd5-66aec3d193fa tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0200a0753e46399d0b212c665aebce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7279db9d4f497b8430fd45280b5da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:31.582763 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5f1a416b-77fc-4d43-bb62-ac2bc4fc0077 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79" status: 200 len: 1646 microversion: 2.1 time: 0.476846 Aug 07 01:12:31.591978 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 278/649] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:31 2022] GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79 => generated 1646 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:31.592313 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3a01e472-bb7d-4610-9cd5-66aec3d193fa tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] 10.222.0.39 "GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c" status: 200 len: 1318 microversion: 2.1 time: 0.478754 Aug 07 01:12:31.592313 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 372/650] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:31 2022] GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c => generated 1318 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:31.616728 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f1e45455-c96b-48e5-a1cc-af2ea8b5c658 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:31.617933 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f1e45455-c96b-48e5-a1cc-af2ea8b5c658 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:31.637774 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1e45455-c96b-48e5-a1cc-af2ea8b5c658 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:31.639645 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1e45455-c96b-48e5-a1cc-af2ea8b5c658 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:31.640009 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1e45455-c96b-48e5-a1cc-af2ea8b5c658 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:31.641882 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1e45455-c96b-48e5-a1cc-af2ea8b5c658 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:31.643145 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1e45455-c96b-48e5-a1cc-af2ea8b5c658 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:31.643680 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1e45455-c96b-48e5-a1cc-af2ea8b5c658 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:31.705900 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2737f6c5-2d54-41f4-a861-2d0ad418426d tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e24966ee0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:31.840180 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2737f6c5-2d54-41f4-a861-2d0ad418426d tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d" status: 200 len: 1423 microversion: 2.1 time: 0.147505 Aug 07 01:12:31.841671 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 373/651] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:12:31 2022] GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d => generated 1423 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:12:31.960737 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f1e45455-c96b-48e5-a1cc-af2ea8b5c658 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79" status: 200 len: 1646 microversion: 2.1 time: 0.339807 Aug 07 01:12:31.962030 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 279/652] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:31 2022] GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79 => generated 1646 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:31.995500 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-36a5dc68-0a93-42f9-8ae6-e57bd3cfd38f tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:32.009211 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:12:32.009211 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:12:32.011412 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-36a5dc68-0a93-42f9-8ae6-e57bd3cfd38f tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:32.017018 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-36a5dc68-0a93-42f9-8ae6-e57bd3cfd38f tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:32.019595 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-36a5dc68-0a93-42f9-8ae6-e57bd3cfd38f tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:32.022037 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-36a5dc68-0a93-42f9-8ae6-e57bd3cfd38f tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:32.023068 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-36a5dc68-0a93-42f9-8ae6-e57bd3cfd38f tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:32.023960 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-36a5dc68-0a93-42f9-8ae6-e57bd3cfd38f tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:32.084084 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-36a5dc68-0a93-42f9-8ae6-e57bd3cfd38f tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.097099 Aug 07 01:12:32.086126 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 374/653] 10.222.0.39 () {58 vars in 1176 bytes} [Sun Aug 7 01:12:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:32.102417 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-75b04f3a-94f5-4c06-98f9-ba23aeef7c89 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:32.103669 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-75b04f3a-94f5-4c06-98f9-ba23aeef7c89 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:32.117920 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75b04f3a-94f5-4c06-98f9-ba23aeef7c89 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:32.118632 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75b04f3a-94f5-4c06-98f9-ba23aeef7c89 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:32.119324 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75b04f3a-94f5-4c06-98f9-ba23aeef7c89 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:32.120587 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75b04f3a-94f5-4c06-98f9-ba23aeef7c89 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:32.122069 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75b04f3a-94f5-4c06-98f9-ba23aeef7c89 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:32.123063 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75b04f3a-94f5-4c06-98f9-ba23aeef7c89 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:32.126943 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fc4db523-1a31-425c-8ffc-f3f0701f6cff tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:32.127566 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fc4db523-1a31-425c-8ffc-f3f0701f6cff tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:32.161621 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc4db523-1a31-425c-8ffc-f3f0701f6cff tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:32.162455 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc4db523-1a31-425c-8ffc-f3f0701f6cff tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:32.163038 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc4db523-1a31-425c-8ffc-f3f0701f6cff tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:32.164088 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc4db523-1a31-425c-8ffc-f3f0701f6cff tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:32.165458 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc4db523-1a31-425c-8ffc-f3f0701f6cff tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:32.166345 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc4db523-1a31-425c-8ffc-f3f0701f6cff tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:32.290315 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-75b04f3a-94f5-4c06-98f9-ba23aeef7c89 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79/action" status: 202 len: 0 microversion: 2.1 time: 0.195254 Aug 07 01:12:32.295665 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 280/654] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:12:32 2022] POST /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:12:32.303932 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3f4c262a-5ca7-4bf0-96c3-8085f67cc43e tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:32.305019 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3f4c262a-5ca7-4bf0-96c3-8085f67cc43e tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:32.315984 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3f4c262a-5ca7-4bf0-96c3-8085f67cc43e tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:32.316851 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3f4c262a-5ca7-4bf0-96c3-8085f67cc43e tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:32.317428 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3f4c262a-5ca7-4bf0-96c3-8085f67cc43e tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:32.323527 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3f4c262a-5ca7-4bf0-96c3-8085f67cc43e tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:32.323527 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3f4c262a-5ca7-4bf0-96c3-8085f67cc43e tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:32.323527 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3f4c262a-5ca7-4bf0-96c3-8085f67cc43e tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:32.401427 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-fc4db523-1a31-425c-8ffc-f3f0701f6cff tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lazy-loading 'services' on Instance uuid 2a4de302-ab36-4e7a-90b5-d72d3dc5d698 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:12:32.452623 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fc4db523-1a31-425c-8ffc-f3f0701f6cff tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1927 microversion: 2.75 time: 0.329318 Aug 07 01:12:32.455001 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 375/655] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:12:32 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1927 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:12:32.632899 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-51bb8388-5d59-4f2c-898f-1d9bb36694cb tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:32.633949 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-51bb8388-5d59-4f2c-898f-1d9bb36694cb tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: f083dc9e-4251-4249-bd6b-12028028484c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:32.654070 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51bb8388-5d59-4f2c-898f-1d9bb36694cb tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:32.655021 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51bb8388-5d59-4f2c-898f-1d9bb36694cb tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:32.655709 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51bb8388-5d59-4f2c-898f-1d9bb36694cb tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:32.658950 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51bb8388-5d59-4f2c-898f-1d9bb36694cb tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:32.662163 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51bb8388-5d59-4f2c-898f-1d9bb36694cb tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:32.665680 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51bb8388-5d59-4f2c-898f-1d9bb36694cb tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:32.688944 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:33.007496 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-51bb8388-5d59-4f2c-898f-1d9bb36694cb tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0200a0753e46399d0b212c665aebce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7279db9d4f497b8430fd45280b5da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:33.035814 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-51bb8388-5d59-4f2c-898f-1d9bb36694cb tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] 10.222.0.39 "GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c" status: 200 len: 1318 microversion: 2.1 time: 0.411654 Aug 07 01:12:33.037927 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 376/656] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:32 2022] GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c => generated 1318 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:33.057862 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4022be7b-9eb9-4ed2-bffe-0b810933881c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e24966b80>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:33.195977 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4022be7b-9eb9-4ed2-bffe-0b810933881c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d" status: 200 len: 1423 microversion: 2.1 time: 0.155822 Aug 07 01:12:33.199615 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 377/657] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:12:33 2022] GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d => generated 1423 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:33.266767 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3f4c262a-5ca7-4bf0-96c3-8085f67cc43e tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79" status: 200 len: 1651 microversion: 2.1 time: 0.969344 Aug 07 01:12:33.268384 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 281/658] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:32 2022] GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79 => generated 1651 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:33.495490 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-05158c9e-75a8-41a1-b9aa-19bc10fdd4e2 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:33.496201 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-05158c9e-75a8-41a1-b9aa-19bc10fdd4e2 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:33.516318 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05158c9e-75a8-41a1-b9aa-19bc10fdd4e2 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:33.518987 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05158c9e-75a8-41a1-b9aa-19bc10fdd4e2 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:33.519496 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05158c9e-75a8-41a1-b9aa-19bc10fdd4e2 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:33.520370 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05158c9e-75a8-41a1-b9aa-19bc10fdd4e2 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:33.524294 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05158c9e-75a8-41a1-b9aa-19bc10fdd4e2 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:33.528221 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05158c9e-75a8-41a1-b9aa-19bc10fdd4e2 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:33.671824 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-05158c9e-75a8-41a1-b9aa-19bc10fdd4e2 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lazy-loading 'services' on Instance uuid 2a4de302-ab36-4e7a-90b5-d72d3dc5d698 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:12:33.782314 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-05158c9e-75a8-41a1-b9aa-19bc10fdd4e2 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1927 microversion: 2.75 time: 0.290679 Aug 07 01:12:33.784649 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 378/659] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:12:33 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1927 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:12:33.909606 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-225b5894-cac1-4134-a242-706bef0376ad tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1783379545", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:34.042892 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-225b5894-cac1-4134-a242-706bef0376ad tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] validate_networks() for None {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:12:34.083096 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a79782eb-a1ac-48aa-9e0f-bd9b36a48c90 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:34.084344 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a79782eb-a1ac-48aa-9e0f-bd9b36a48c90 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: f083dc9e-4251-4249-bd6b-12028028484c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:34.098823 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a79782eb-a1ac-48aa-9e0f-bd9b36a48c90 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:34.099853 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a79782eb-a1ac-48aa-9e0f-bd9b36a48c90 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:34.100832 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a79782eb-a1ac-48aa-9e0f-bd9b36a48c90 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:34.102183 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a79782eb-a1ac-48aa-9e0f-bd9b36a48c90 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:34.103195 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a79782eb-a1ac-48aa-9e0f-bd9b36a48c90 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:34.104165 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a79782eb-a1ac-48aa-9e0f-bd9b36a48c90 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:34.425776 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a79782eb-a1ac-48aa-9e0f-bd9b36a48c90 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0200a0753e46399d0b212c665aebce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7279db9d4f497b8430fd45280b5da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:34.444485 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a79782eb-a1ac-48aa-9e0f-bd9b36a48c90 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] 10.222.0.39 "GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c" status: 200 len: 1318 microversion: 2.1 time: 0.370575 Aug 07 01:12:34.459970 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 379/660] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:34 2022] GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c => generated 1318 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:12:34.466824 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ab9da4ac-e849-4c05-a672-be90925dfb13 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e249aadc0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:34.549381 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:34.558163 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ab9da4ac-e849-4c05-a672-be90925dfb13 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d" status: 200 len: 1423 microversion: 2.1 time: 0.107341 Aug 07 01:12:34.559394 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 380/661] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:12:34 2022] GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d => generated 1423 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:34.568435 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d109c11d-7ef9-4d40-97f4-5a6adb92cca4 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:34.569853 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d109c11d-7ef9-4d40-97f4-5a6adb92cca4 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:34.589515 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d109c11d-7ef9-4d40-97f4-5a6adb92cca4 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:34.605540 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d109c11d-7ef9-4d40-97f4-5a6adb92cca4 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:34.606437 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d109c11d-7ef9-4d40-97f4-5a6adb92cca4 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:34.608317 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d109c11d-7ef9-4d40-97f4-5a6adb92cca4 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:34.609360 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d109c11d-7ef9-4d40-97f4-5a6adb92cca4 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:34.610538 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d109c11d-7ef9-4d40-97f4-5a6adb92cca4 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:34.890881 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d109c11d-7ef9-4d40-97f4-5a6adb92cca4 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79" status: 200 len: 1631 microversion: 2.1 time: 0.288979 Aug 07 01:12:34.890881 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 381/662] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:34 2022] GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79 => generated 1631 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:34.890881 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6a80fdb7-3f72-4d2b-b661-635d8d653eb4 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:34.890881 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6a80fdb7-3f72-4d2b-b661-635d8d653eb4 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:34.890881 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a80fdb7-3f72-4d2b-b661-635d8d653eb4 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:34.898970 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a80fdb7-3f72-4d2b-b661-635d8d653eb4 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:34.898970 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a80fdb7-3f72-4d2b-b661-635d8d653eb4 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:34.898970 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a80fdb7-3f72-4d2b-b661-635d8d653eb4 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:34.898970 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a80fdb7-3f72-4d2b-b661-635d8d653eb4 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:34.899740 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a80fdb7-3f72-4d2b-b661-635d8d653eb4 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:34.939787 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=13 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:35.002955 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-6a80fdb7-3f72-4d2b-b661-635d8d653eb4 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lazy-loading 'services' on Instance uuid 2a4de302-ab36-4e7a-90b5-d72d3dc5d698 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:12:35.038587 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6a80fdb7-3f72-4d2b-b661-635d8d653eb4 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1927 microversion: 2.75 time: 0.186800 Aug 07 01:12:35.039946 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 382/663] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:12:34 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1927 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:12:35.047793 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-867a06b2-2ca8-44ea-ab7f-b1bb067d88aa tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:35.053111 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-867a06b2-2ca8-44ea-ab7f-b1bb067d88aa tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:35.065474 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-867a06b2-2ca8-44ea-ab7f-b1bb067d88aa tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:35.066667 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-867a06b2-2ca8-44ea-ab7f-b1bb067d88aa tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:35.067710 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-867a06b2-2ca8-44ea-ab7f-b1bb067d88aa tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:35.069059 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-867a06b2-2ca8-44ea-ab7f-b1bb067d88aa tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:35.069870 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-867a06b2-2ca8-44ea-ab7f-b1bb067d88aa tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:35.070499 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-867a06b2-2ca8-44ea-ab7f-b1bb067d88aa tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:35.123280 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-867a06b2-2ca8-44ea-ab7f-b1bb067d88aa tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lazy-loading 'flavor' on Instance uuid 06b38422-fb09-4331-b7cb-3d5f99cc2e79 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:12:35.149835 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-867a06b2-2ca8-44ea-ab7f-b1bb067d88aa tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] Going to try to live migrate instance to n-h1-master-1 {{(pid=119516) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 07 01:12:35.224442 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-225b5894-cac1-4134-a242-706bef0376ad tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:12:35.225287 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-225b5894-cac1-4134-a242-706bef0376ad tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:12:35.225976 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-225b5894-cac1-4134-a242-706bef0376ad tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:12:35.226596 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-225b5894-cac1-4134-a242-706bef0376ad tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:12:35.227326 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-225b5894-cac1-4134-a242-706bef0376ad tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:12:35.250609 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-225b5894-cac1-4134-a242-706bef0376ad tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:35.251676 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-225b5894-cac1-4134-a242-706bef0376ad tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:35.254948 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-225b5894-cac1-4134-a242-706bef0376ad tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:35.257512 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-225b5894-cac1-4134-a242-706bef0376ad tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:35.261186 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-225b5894-cac1-4134-a242-706bef0376ad tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:35.262014 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-225b5894-cac1-4134-a242-706bef0376ad tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:35.320944 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-225b5894-cac1-4134-a242-706bef0376ad tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Getting quotas for project 380ac8cbc5d64648b03ab13bce91cfe4. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:12:35.339860 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-225b5894-cac1-4134-a242-706bef0376ad tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Getting quotas for user 80ec78e02379498e884758d48f5454fd and project 380ac8cbc5d64648b03ab13bce91cfe4. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:12:35.377691 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-225b5894-cac1-4134-a242-706bef0376ad tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:12:35.381362 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-225b5894-cac1-4134-a242-706bef0376ad tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] [instance: 3c514622-f3bf-43c5-9713-bd993d6d291c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:12:35.471550 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-225b5894-cac1-4134-a242-706bef0376ad tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.925787 Aug 07 01:12:35.472438 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 282/664] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:12:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 07 01:12:35.503232 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7681d60f-d88a-4b02-be0e-d67f6abb0382 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:35.503232 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7681d60f-d88a-4b02-be0e-d67f6abb0382 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: f083dc9e-4251-4249-bd6b-12028028484c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:35.514155 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7681d60f-d88a-4b02-be0e-d67f6abb0382 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:35.514659 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7681d60f-d88a-4b02-be0e-d67f6abb0382 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:35.515097 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7681d60f-d88a-4b02-be0e-d67f6abb0382 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:35.515831 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7681d60f-d88a-4b02-be0e-d67f6abb0382 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:35.516324 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7681d60f-d88a-4b02-be0e-d67f6abb0382 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:35.522938 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7681d60f-d88a-4b02-be0e-d67f6abb0382 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:35.862925 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7681d60f-d88a-4b02-be0e-d67f6abb0382 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0200a0753e46399d0b212c665aebce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7279db9d4f497b8430fd45280b5da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:35.877502 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7681d60f-d88a-4b02-be0e-d67f6abb0382 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] 10.222.0.39 "GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c" status: 200 len: 1318 microversion: 2.1 time: 0.391914 Aug 07 01:12:35.893135 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 283/665] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:35 2022] GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c => generated 1318 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:35.909830 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-92030922-d30d-41f5-9347-4863651136e1 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:35.910703 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-92030922-d30d-41f5-9347-4863651136e1 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] [instance: 3c514622-f3bf-43c5-9713-bd993d6d291c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:36.005268 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-92030922-d30d-41f5-9347-4863651136e1 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ec78e02379498e884758d48f5454fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ac8cbc5d64648b03ab13bce91cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:36.016189 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-92030922-d30d-41f5-9347-4863651136e1 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] 10.222.0.39 "GET /compute/v2.1/servers/3c514622-f3bf-43c5-9713-bd993d6d291c" status: 200 len: 1223 microversion: 2.1 time: 0.113173 Aug 07 01:12:36.028938 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 284/666] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:35 2022] GET /compute/v2.1/servers/3c514622-f3bf-43c5-9713-bd993d6d291c => generated 1223 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:36.044324 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-c9dbd5db-b1de-4b55-9183-37ddd8a1e7d7 req-d145415a-b1a4-4a38-827c-a833f7fd8bdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a038208d-dae8-432d-97e5-2a58ea093e12", "name": "network-vif-plugged", "status": "completed", "tag": "34e132f0-6845-4fef-bc5f-494eced57c6a"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:36.059213 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c9dbd5db-b1de-4b55-9183-37ddd8a1e7d7 req-d145415a-b1a4-4a38-827c-a833f7fd8bdb service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:36.060156 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c9dbd5db-b1de-4b55-9183-37ddd8a1e7d7 req-d145415a-b1a4-4a38-827c-a833f7fd8bdb service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:36.060758 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c9dbd5db-b1de-4b55-9183-37ddd8a1e7d7 req-d145415a-b1a4-4a38-827c-a833f7fd8bdb service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:36.087068 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-c9dbd5db-b1de-4b55-9183-37ddd8a1e7d7 req-d145415a-b1a4-4a38-827c-a833f7fd8bdb service nova] Creating event network-vif-plugged:34e132f0-6845-4fef-bc5f-494eced57c6a for instance a038208d-dae8-432d-97e5-2a58ea093e12 on n-h2-master-1 Aug 07 01:12:36.096979 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-c9dbd5db-b1de-4b55-9183-37ddd8a1e7d7 req-d145415a-b1a4-4a38-827c-a833f7fd8bdb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065352 Aug 07 01:12:36.097970 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 285/667] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:36.106010 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-61b1a4b2-ab19-4df9-90e1-abd92414f7ab tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e2491f550>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:36.177170 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-61b1a4b2-ab19-4df9-90e1-abd92414f7ab tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d" status: 200 len: 1423 microversion: 2.1 time: 0.077036 Aug 07 01:12:36.178496 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 286/668] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:12:36 2022] GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d => generated 1423 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:36.186413 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7ec2af12-1818-419b-aafa-07af0d3db3ee tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1567902593", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:36.290181 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-7ec2af12-1818-419b-aafa-07af0d3db3ee tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] validate_networks() for [('a36c95a7-f5a6-4689-9476-42d2c17376f3', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:12:37.444506 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-7ec2af12-1818-419b-aafa-07af0d3db3ee tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:12:37.450569 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-7ec2af12-1818-419b-aafa-07af0d3db3ee tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:12:37.451448 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-7ec2af12-1818-419b-aafa-07af0d3db3ee tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:12:37.452634 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-7ec2af12-1818-419b-aafa-07af0d3db3ee tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:12:37.453442 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-7ec2af12-1818-419b-aafa-07af0d3db3ee tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:12:37.489820 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ec2af12-1818-419b-aafa-07af0d3db3ee tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:37.490646 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ec2af12-1818-419b-aafa-07af0d3db3ee tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:37.491399 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ec2af12-1818-419b-aafa-07af0d3db3ee tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:37.492597 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ec2af12-1818-419b-aafa-07af0d3db3ee tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:37.493210 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ec2af12-1818-419b-aafa-07af0d3db3ee tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:37.493731 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ec2af12-1818-419b-aafa-07af0d3db3ee tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:37.587083 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-7ec2af12-1818-419b-aafa-07af0d3db3ee tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Getting quotas for project 4e443158f15b42a3a795950a7c409a38. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:12:37.613753 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-7ec2af12-1818-419b-aafa-07af0d3db3ee tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Getting quotas for user c135ba135fd946149ace9a86c7c52e80 and project 4e443158f15b42a3a795950a7c409a38. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:12:37.667518 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7ec2af12-1818-419b-aafa-07af0d3db3ee tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:12:37.688020 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7ec2af12-1818-419b-aafa-07af0d3db3ee tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 8a19ce68-d784-44a2-b20c-77de1180aba3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:12:37.926259 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7ec2af12-1818-419b-aafa-07af0d3db3ee tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.741386 Aug 07 01:12:37.935360 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 287/669] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:12:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 1750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:12:37.953517 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-243b825f-9442-4cb5-a296-d3000ae93425 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:37.957510 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-243b825f-9442-4cb5-a296-d3000ae93425 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:37.994585 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-243b825f-9442-4cb5-a296-d3000ae93425 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:37.998352 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-243b825f-9442-4cb5-a296-d3000ae93425 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:38.000437 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-243b825f-9442-4cb5-a296-d3000ae93425 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:38.004732 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-243b825f-9442-4cb5-a296-d3000ae93425 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:38.006942 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-243b825f-9442-4cb5-a296-d3000ae93425 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:38.010595 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-243b825f-9442-4cb5-a296-d3000ae93425 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:38.464411 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-243b825f-9442-4cb5-a296-d3000ae93425 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lazy-loading 'services' on Instance uuid 2a4de302-ab36-4e7a-90b5-d72d3dc5d698 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:12:38.552728 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-243b825f-9442-4cb5-a296-d3000ae93425 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1927 microversion: 2.75 time: 0.617322 Aug 07 01:12:38.556706 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 288/670] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:12:37 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1927 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:12:38.587855 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b9b3185b-4fe2-4620-90b6-f4d0ab9d4dd6 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:38.593418 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b9b3185b-4fe2-4620-90b6-f4d0ab9d4dd6 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: f083dc9e-4251-4249-bd6b-12028028484c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:38.630145 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9b3185b-4fe2-4620-90b6-f4d0ab9d4dd6 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:38.633789 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9b3185b-4fe2-4620-90b6-f4d0ab9d4dd6 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:38.635058 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9b3185b-4fe2-4620-90b6-f4d0ab9d4dd6 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:38.640772 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9b3185b-4fe2-4620-90b6-f4d0ab9d4dd6 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:38.654799 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9b3185b-4fe2-4620-90b6-f4d0ab9d4dd6 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:38.658378 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9b3185b-4fe2-4620-90b6-f4d0ab9d4dd6 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:39.433575 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b9b3185b-4fe2-4620-90b6-f4d0ab9d4dd6 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0200a0753e46399d0b212c665aebce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7279db9d4f497b8430fd45280b5da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:39.453238 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b9b3185b-4fe2-4620-90b6-f4d0ab9d4dd6 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] 10.222.0.39 "GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c" status: 200 len: 1318 microversion: 2.1 time: 0.892707 Aug 07 01:12:39.454496 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 289/671] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:38 2022] GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c => generated 1318 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:39.502971 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-446cc399-c0f4-4694-ab75-eded80a39b2e tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:39.504107 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-446cc399-c0f4-4694-ab75-eded80a39b2e tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] [instance: 3c514622-f3bf-43c5-9713-bd993d6d291c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:39.517519 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-446cc399-c0f4-4694-ab75-eded80a39b2e tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:39.518455 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-446cc399-c0f4-4694-ab75-eded80a39b2e tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:39.519089 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-446cc399-c0f4-4694-ab75-eded80a39b2e tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:39.521965 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-446cc399-c0f4-4694-ab75-eded80a39b2e tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:39.525294 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-446cc399-c0f4-4694-ab75-eded80a39b2e tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:39.526077 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-446cc399-c0f4-4694-ab75-eded80a39b2e tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:39.569869 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:39.753993 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-446cc399-c0f4-4694-ab75-eded80a39b2e tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ec78e02379498e884758d48f5454fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ac8cbc5d64648b03ab13bce91cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:39.790801 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-446cc399-c0f4-4694-ab75-eded80a39b2e tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] 10.222.0.39 "GET /compute/v2.1/servers/3c514622-f3bf-43c5-9713-bd993d6d291c" status: 200 len: 1281 microversion: 2.1 time: 0.302817 Aug 07 01:12:39.794263 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 290/672] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:39 2022] GET /compute/v2.1/servers/3c514622-f3bf-43c5-9713-bd993d6d291c => generated 1281 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:39.816470 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e5f7f888-0713-46d7-a8fa-b118f77f22d5 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e2491fdc0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:39.941215 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e5f7f888-0713-46d7-a8fa-b118f77f22d5 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d" status: 200 len: 1423 microversion: 2.1 time: 0.140229 Aug 07 01:12:39.944142 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 291/673] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:12:39 2022] GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d => generated 1423 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:39.965925 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a114c786-e209-4684-be7a-070c902188a1 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:39.973394 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a114c786-e209-4684-be7a-070c902188a1 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 8a19ce68-d784-44a2-b20c-77de1180aba3] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:40.025683 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a114c786-e209-4684-be7a-070c902188a1 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:40.026429 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a114c786-e209-4684-be7a-070c902188a1 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:40.027207 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a114c786-e209-4684-be7a-070c902188a1 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:40.037259 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a114c786-e209-4684-be7a-070c902188a1 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:40.038356 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a114c786-e209-4684-be7a-070c902188a1 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:40.039165 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a114c786-e209-4684-be7a-070c902188a1 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:40.483258 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a114c786-e209-4684-be7a-070c902188a1 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:40.522756 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a114c786-e209-4684-be7a-070c902188a1 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3" status: 200 len: 1221 microversion: 2.1 time: 0.567939 Aug 07 01:12:40.523826 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 292/674] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:39 2022] GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3 => generated 1221 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:40.571722 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-867a06b2-2ca8-44ea-ab7f-b1bb067d88aa tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79/action" status: 202 len: 0 microversion: 2.1 time: 5.528469 Aug 07 01:12:40.574002 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 383/675] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:12:35 2022] POST /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79/action => generated 0 bytes in 5533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:12:40.592831 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7ea6358b-06f4-4520-9b4b-6407429eae6b tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:40.597454 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7ea6358b-06f4-4520-9b4b-6407429eae6b tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:40.643106 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-523f750b-bec6-48f8-816b-5ee2992754cf req-ca9e4b35-1f9d-4384-a9dc-3ce206172154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f083dc9e-4251-4249-bd6b-12028028484c", "name": "network-vif-plugged", "status": "completed", "tag": "046e68ae-d096-484f-bea5-0248b5d25686"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:40.660340 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ea6358b-06f4-4520-9b4b-6407429eae6b tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:40.661688 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ea6358b-06f4-4520-9b4b-6407429eae6b tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:40.662783 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ea6358b-06f4-4520-9b4b-6407429eae6b tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:40.664707 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ea6358b-06f4-4520-9b4b-6407429eae6b tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:40.665917 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ea6358b-06f4-4520-9b4b-6407429eae6b tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:40.667017 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ea6358b-06f4-4520-9b4b-6407429eae6b tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:40.723823 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-523f750b-bec6-48f8-816b-5ee2992754cf req-ca9e4b35-1f9d-4384-a9dc-3ce206172154 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:40.744426 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-523f750b-bec6-48f8-816b-5ee2992754cf req-ca9e4b35-1f9d-4384-a9dc-3ce206172154 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:40.745326 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-523f750b-bec6-48f8-816b-5ee2992754cf req-ca9e4b35-1f9d-4384-a9dc-3ce206172154 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:40.820190 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-523f750b-bec6-48f8-816b-5ee2992754cf req-ca9e4b35-1f9d-4384-a9dc-3ce206172154 service nova] Creating event network-vif-plugged:046e68ae-d096-484f-bea5-0248b5d25686 for instance f083dc9e-4251-4249-bd6b-12028028484c on n-h1-master-1 Aug 07 01:12:40.843136 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-523f750b-bec6-48f8-816b-5ee2992754cf req-ca9e4b35-1f9d-4384-a9dc-3ce206172154 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.277281 Aug 07 01:12:40.858388 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 293/676] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:40.867300 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-362050d9-8d63-4d2b-9a23-3d384ed16f1a tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:40.869215 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-362050d9-8d63-4d2b-9a23-3d384ed16f1a tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: f083dc9e-4251-4249-bd6b-12028028484c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:40.894151 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-362050d9-8d63-4d2b-9a23-3d384ed16f1a tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:40.895427 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-362050d9-8d63-4d2b-9a23-3d384ed16f1a tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:40.898034 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-362050d9-8d63-4d2b-9a23-3d384ed16f1a tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:40.900962 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-362050d9-8d63-4d2b-9a23-3d384ed16f1a tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:40.910971 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-362050d9-8d63-4d2b-9a23-3d384ed16f1a tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:40.914117 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-362050d9-8d63-4d2b-9a23-3d384ed16f1a tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:41.008007 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-7ea6358b-06f4-4520-9b4b-6407429eae6b tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lazy-loading 'services' on Instance uuid 2a4de302-ab36-4e7a-90b5-d72d3dc5d698 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:12:41.060969 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7ea6358b-06f4-4520-9b4b-6407429eae6b tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1927 microversion: 2.75 time: 0.482914 Aug 07 01:12:41.067827 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 384/677] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:12:40 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1927 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:12:41.093971 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dd651223-f2c0-4131-9a6d-1880991a6812 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:41.095745 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-dd651223-f2c0-4131-9a6d-1880991a6812 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:41.117383 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd651223-f2c0-4131-9a6d-1880991a6812 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:41.118277 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd651223-f2c0-4131-9a6d-1880991a6812 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:41.123488 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd651223-f2c0-4131-9a6d-1880991a6812 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:41.125016 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd651223-f2c0-4131-9a6d-1880991a6812 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:41.125957 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd651223-f2c0-4131-9a6d-1880991a6812 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:41.127250 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd651223-f2c0-4131-9a6d-1880991a6812 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:41.511327 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-dd651223-f2c0-4131-9a6d-1880991a6812 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:41.534413 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-dd651223-f2c0-4131-9a6d-1880991a6812 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79" status: 200 len: 1505 microversion: 2.1 time: 0.457289 Aug 07 01:12:41.536361 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 385/678] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:41 2022] GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79 => generated 1505 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:41.547418 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d39bc5ec-7cde-4db1-b40a-133f08a9d8fb tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:41.549167 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d39bc5ec-7cde-4db1-b40a-133f08a9d8fb tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] [instance: 3c514622-f3bf-43c5-9713-bd993d6d291c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:41.562269 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d39bc5ec-7cde-4db1-b40a-133f08a9d8fb tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:41.564137 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d39bc5ec-7cde-4db1-b40a-133f08a9d8fb tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:41.567034 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d39bc5ec-7cde-4db1-b40a-133f08a9d8fb tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:41.568757 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d39bc5ec-7cde-4db1-b40a-133f08a9d8fb tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:41.569569 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d39bc5ec-7cde-4db1-b40a-133f08a9d8fb tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:41.570333 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d39bc5ec-7cde-4db1-b40a-133f08a9d8fb tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:41.579870 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-362050d9-8d63-4d2b-9a23-3d384ed16f1a tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0200a0753e46399d0b212c665aebce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7279db9d4f497b8430fd45280b5da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:41.615559 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-362050d9-8d63-4d2b-9a23-3d384ed16f1a tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] 10.222.0.39 "GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c" status: 200 len: 1318 microversion: 2.1 time: 0.755980 Aug 07 01:12:41.616942 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 294/679] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:40 2022] GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c => generated 1318 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:41.634595 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c6e8bf2c-071f-4e9d-98ec-1656f920c048 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e248c6820>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:41.823639 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d39bc5ec-7cde-4db1-b40a-133f08a9d8fb tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ec78e02379498e884758d48f5454fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ac8cbc5d64648b03ab13bce91cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:41.843553 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d39bc5ec-7cde-4db1-b40a-133f08a9d8fb tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] 10.222.0.39 "GET /compute/v2.1/servers/3c514622-f3bf-43c5-9713-bd993d6d291c" status: 200 len: 1281 microversion: 2.1 time: 0.305017 Aug 07 01:12:41.849110 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 386/680] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:41 2022] GET /compute/v2.1/servers/3c514622-f3bf-43c5-9713-bd993d6d291c => generated 1281 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:41.871337 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d7b677e4-7b42-47e5-86a5-27a8f554dee2 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:41.872902 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d7b677e4-7b42-47e5-86a5-27a8f554dee2 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 8a19ce68-d784-44a2-b20c-77de1180aba3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:41.889554 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c6e8bf2c-071f-4e9d-98ec-1656f920c048 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d" status: 200 len: 1423 microversion: 2.1 time: 0.270462 Aug 07 01:12:41.901254 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d7b677e4-7b42-47e5-86a5-27a8f554dee2 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:41.903505 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d7b677e4-7b42-47e5-86a5-27a8f554dee2 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:41.904734 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 295/681] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:12:41 2022] GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d => generated 1423 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:41.907936 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d7b677e4-7b42-47e5-86a5-27a8f554dee2 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:41.909299 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d7b677e4-7b42-47e5-86a5-27a8f554dee2 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:41.911664 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d7b677e4-7b42-47e5-86a5-27a8f554dee2 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:41.913923 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d7b677e4-7b42-47e5-86a5-27a8f554dee2 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:42.039395 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=18 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:42.121047 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0fcf8116-d97e-4ecc-89f0-32feca1bde73 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:42.122552 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0fcf8116-d97e-4ecc-89f0-32feca1bde73 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:42.145752 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0fcf8116-d97e-4ecc-89f0-32feca1bde73 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:42.150859 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0fcf8116-d97e-4ecc-89f0-32feca1bde73 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:42.152027 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0fcf8116-d97e-4ecc-89f0-32feca1bde73 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:42.160346 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0fcf8116-d97e-4ecc-89f0-32feca1bde73 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:42.161510 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0fcf8116-d97e-4ecc-89f0-32feca1bde73 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:42.166223 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d7b677e4-7b42-47e5-86a5-27a8f554dee2 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:42.167599 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0fcf8116-d97e-4ecc-89f0-32feca1bde73 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:42.216281 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d7b677e4-7b42-47e5-86a5-27a8f554dee2 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3" status: 200 len: 1285 microversion: 2.1 time: 0.364671 Aug 07 01:12:42.227963 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 387/682] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:41 2022] GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3 => generated 1285 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:42.583507 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a2ac4b6c-62b5-4b2f-80ce-42f9a5682326 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:42.584174 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a2ac4b6c-62b5-4b2f-80ce-42f9a5682326 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:42.584591 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-0fcf8116-d97e-4ecc-89f0-32feca1bde73 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lazy-loading 'services' on Instance uuid 2a4de302-ab36-4e7a-90b5-d72d3dc5d698 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:12:42.601570 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2ac4b6c-62b5-4b2f-80ce-42f9a5682326 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:42.602096 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2ac4b6c-62b5-4b2f-80ce-42f9a5682326 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:42.612778 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2ac4b6c-62b5-4b2f-80ce-42f9a5682326 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:42.619454 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2ac4b6c-62b5-4b2f-80ce-42f9a5682326 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:42.622525 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2ac4b6c-62b5-4b2f-80ce-42f9a5682326 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:42.628826 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2ac4b6c-62b5-4b2f-80ce-42f9a5682326 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:42.645924 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:42.660949 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0fcf8116-d97e-4ecc-89f0-32feca1bde73 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1927 microversion: 2.75 time: 0.544146 Aug 07 01:12:42.693301 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 296/683] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:12:42 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1927 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:12:42.720826 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b799cd98-1c43-4cdd-bf02-15fb663a1542 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:42.721912 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b799cd98-1c43-4cdd-bf02-15fb663a1542 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: f083dc9e-4251-4249-bd6b-12028028484c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:42.742155 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b799cd98-1c43-4cdd-bf02-15fb663a1542 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:42.742831 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b799cd98-1c43-4cdd-bf02-15fb663a1542 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:42.743614 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b799cd98-1c43-4cdd-bf02-15fb663a1542 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:42.744890 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b799cd98-1c43-4cdd-bf02-15fb663a1542 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:42.749966 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b799cd98-1c43-4cdd-bf02-15fb663a1542 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:42.750769 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b799cd98-1c43-4cdd-bf02-15fb663a1542 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:43.285692 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a2ac4b6c-62b5-4b2f-80ce-42f9a5682326 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:43.302114 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a2ac4b6c-62b5-4b2f-80ce-42f9a5682326 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79" status: 200 len: 1505 microversion: 2.1 time: 0.724542 Aug 07 01:12:43.314079 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 388/684] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:42 2022] GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79 => generated 1505 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:43.323034 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9926a6e0-991e-476c-a9c1-bb2b63d53795 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:43.329980 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9926a6e0-991e-476c-a9c1-bb2b63d53795 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] [instance: 3c514622-f3bf-43c5-9713-bd993d6d291c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:43.356797 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9926a6e0-991e-476c-a9c1-bb2b63d53795 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:43.358120 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9926a6e0-991e-476c-a9c1-bb2b63d53795 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:43.361464 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9926a6e0-991e-476c-a9c1-bb2b63d53795 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:43.367381 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9926a6e0-991e-476c-a9c1-bb2b63d53795 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:43.368831 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9926a6e0-991e-476c-a9c1-bb2b63d53795 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:43.373335 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9926a6e0-991e-476c-a9c1-bb2b63d53795 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:43.524763 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b799cd98-1c43-4cdd-bf02-15fb663a1542 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0200a0753e46399d0b212c665aebce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7279db9d4f497b8430fd45280b5da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:43.535484 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b799cd98-1c43-4cdd-bf02-15fb663a1542 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] 10.222.0.39 "GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c" status: 200 len: 1318 microversion: 2.1 time: 0.840415 Aug 07 01:12:43.552026 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 297/685] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:42 2022] GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c => generated 1318 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:43.560781 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6f0319dc-9b9c-4f5d-9397-2003870a19d7 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e248c6d30>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:43.729721 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6f0319dc-9b9c-4f5d-9397-2003870a19d7 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d" status: 200 len: 1423 microversion: 2.1 time: 0.175308 Aug 07 01:12:43.736921 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 298/686] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:12:43 2022] GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d => generated 1423 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:43.776590 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cb031755-bef4-4c6d-ad87-87834500f478 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:43.778057 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-cb031755-bef4-4c6d-ad87-87834500f478 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 8a19ce68-d784-44a2-b20c-77de1180aba3] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:43.826958 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cb031755-bef4-4c6d-ad87-87834500f478 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:43.827839 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cb031755-bef4-4c6d-ad87-87834500f478 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:43.834638 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cb031755-bef4-4c6d-ad87-87834500f478 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:43.841656 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cb031755-bef4-4c6d-ad87-87834500f478 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:43.842578 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cb031755-bef4-4c6d-ad87-87834500f478 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:43.843381 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cb031755-bef4-4c6d-ad87-87834500f478 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:44.112525 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9926a6e0-991e-476c-a9c1-bb2b63d53795 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ec78e02379498e884758d48f5454fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ac8cbc5d64648b03ab13bce91cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:44.129553 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9926a6e0-991e-476c-a9c1-bb2b63d53795 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] 10.222.0.39 "GET /compute/v2.1/servers/3c514622-f3bf-43c5-9713-bd993d6d291c" status: 200 len: 1323 microversion: 2.1 time: 0.813311 Aug 07 01:12:44.136641 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 389/687] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:43 2022] GET /compute/v2.1/servers/3c514622-f3bf-43c5-9713-bd993d6d291c => generated 1323 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:44.148256 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6eab6236-efbf-4c9c-9f9d-e83cf9de95f3 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:44.148832 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6eab6236-efbf-4c9c-9f9d-e83cf9de95f3 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:44.165993 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6eab6236-efbf-4c9c-9f9d-e83cf9de95f3 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:44.167066 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6eab6236-efbf-4c9c-9f9d-e83cf9de95f3 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:44.168043 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6eab6236-efbf-4c9c-9f9d-e83cf9de95f3 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:44.169144 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6eab6236-efbf-4c9c-9f9d-e83cf9de95f3 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:44.169795 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6eab6236-efbf-4c9c-9f9d-e83cf9de95f3 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:44.170416 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6eab6236-efbf-4c9c-9f9d-e83cf9de95f3 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:44.366071 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-6eab6236-efbf-4c9c-9f9d-e83cf9de95f3 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lazy-loading 'services' on Instance uuid 2a4de302-ab36-4e7a-90b5-d72d3dc5d698 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:12:44.415804 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6eab6236-efbf-4c9c-9f9d-e83cf9de95f3 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1927 microversion: 2.75 time: 0.275324 Aug 07 01:12:44.423761 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 390/688] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:12:44 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1927 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:12:44.429713 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8edc9f5d-399e-445c-8a79-92315d63d6f6 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d277332-74a2-4dbb-a888-cc8ab920b44f"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:44.441398 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8edc9f5d-399e-445c-8a79-92315d63d6f6 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: 5777df19-f308-48d1-8f53-fdbf073a4ef2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:44.457791 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8edc9f5d-399e-445c-8a79-92315d63d6f6 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:44.465062 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8edc9f5d-399e-445c-8a79-92315d63d6f6 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:44.465801 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8edc9f5d-399e-445c-8a79-92315d63d6f6 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:44.466857 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8edc9f5d-399e-445c-8a79-92315d63d6f6 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:44.467531 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8edc9f5d-399e-445c-8a79-92315d63d6f6 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:44.468255 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8edc9f5d-399e-445c-8a79-92315d63d6f6 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:44.496737 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:45.116687 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-cb031755-bef4-4c6d-ad87-87834500f478 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:45.133501 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cb031755-bef4-4c6d-ad87-87834500f478 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3" status: 200 len: 1325 microversion: 2.1 time: 1.394694 Aug 07 01:12:45.164588 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 299/689] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:43 2022] GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3 => generated 1325 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:45.172569 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-82bb243f-7d2b-47ea-b304-2bfa91da8ef9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:45.173980 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-82bb243f-7d2b-47ea-b304-2bfa91da8ef9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:45.182019 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-82bb243f-7d2b-47ea-b304-2bfa91da8ef9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:45.182877 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-82bb243f-7d2b-47ea-b304-2bfa91da8ef9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:45.183502 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-82bb243f-7d2b-47ea-b304-2bfa91da8ef9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:45.184440 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-82bb243f-7d2b-47ea-b304-2bfa91da8ef9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:45.185155 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-82bb243f-7d2b-47ea-b304-2bfa91da8ef9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:45.185740 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-82bb243f-7d2b-47ea-b304-2bfa91da8ef9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:45.870875 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-82bb243f-7d2b-47ea-b304-2bfa91da8ef9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:45.908370 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-82bb243f-7d2b-47ea-b304-2bfa91da8ef9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79" status: 200 len: 1505 microversion: 2.1 time: 0.739996 Aug 07 01:12:45.933937 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 300/690] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:45 2022] GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79 => generated 1505 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:45.961241 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1ea13f22-253b-47bf-8618-29f9a4a3b6d2 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:45.962616 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1ea13f22-253b-47bf-8618-29f9a4a3b6d2 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: f083dc9e-4251-4249-bd6b-12028028484c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:46.007995 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ea13f22-253b-47bf-8618-29f9a4a3b6d2 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:46.015637 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ea13f22-253b-47bf-8618-29f9a4a3b6d2 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:46.018223 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ea13f22-253b-47bf-8618-29f9a4a3b6d2 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:46.025457 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ea13f22-253b-47bf-8618-29f9a4a3b6d2 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:46.026672 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ea13f22-253b-47bf-8618-29f9a4a3b6d2 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:46.027561 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ea13f22-253b-47bf-8618-29f9a4a3b6d2 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:46.150094 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8edc9f5d-399e-445c-8a79-92315d63d6f6 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "POST /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.724438 Aug 07 01:12:46.156454 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 391/691] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Aug 7 01:12:44 2022] POST /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2/os-volume_attachments => generated 194 bytes in 1732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:46.163735 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ebd76d38-2984-4356-8413-f6e35c6c8319 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e24919940>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:46.247923 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ebd76d38-2984-4356-8413-f6e35c6c8319 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d" status: 200 len: 1423 microversion: 2.1 time: 0.088658 Aug 07 01:12:46.249410 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 392/692] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:12:46 2022] GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d => generated 1423 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:46.255681 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6b214317-ea20-4554-9a5e-7546ce9ccf09 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:46.256622 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6b214317-ea20-4554-9a5e-7546ce9ccf09 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] [instance: 3c514622-f3bf-43c5-9713-bd993d6d291c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:46.265182 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b214317-ea20-4554-9a5e-7546ce9ccf09 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:46.266037 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b214317-ea20-4554-9a5e-7546ce9ccf09 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:46.267280 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b214317-ea20-4554-9a5e-7546ce9ccf09 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:46.268561 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b214317-ea20-4554-9a5e-7546ce9ccf09 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:46.269442 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b214317-ea20-4554-9a5e-7546ce9ccf09 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:46.270175 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b214317-ea20-4554-9a5e-7546ce9ccf09 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:46.483190 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1ea13f22-253b-47bf-8618-29f9a4a3b6d2 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0200a0753e46399d0b212c665aebce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7279db9d4f497b8430fd45280b5da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:46.511065 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1ea13f22-253b-47bf-8618-29f9a4a3b6d2 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] 10.222.0.39 "GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c" status: 200 len: 1468 microversion: 2.1 time: 0.561408 Aug 07 01:12:46.533064 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 301/693] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:45 2022] GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c => generated 1468 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:46.573695 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-b296da94-d8f1-49ed-a8ee-28fe5293605d req-455024fd-f3fa-47a2-8c69-b20c733dd618 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a19ce68-d784-44a2-b20c-77de1180aba3", "tag": "bb072379-0a62-4d26-a5df-c2124b2d9757"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:46.614906 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b296da94-d8f1-49ed-a8ee-28fe5293605d req-455024fd-f3fa-47a2-8c69-b20c733dd618 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:46.615740 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b296da94-d8f1-49ed-a8ee-28fe5293605d req-455024fd-f3fa-47a2-8c69-b20c733dd618 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:46.616549 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b296da94-d8f1-49ed-a8ee-28fe5293605d req-455024fd-f3fa-47a2-8c69-b20c733dd618 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:46.671605 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-b296da94-d8f1-49ed-a8ee-28fe5293605d req-455024fd-f3fa-47a2-8c69-b20c733dd618 service nova] Creating event network-changed:bb072379-0a62-4d26-a5df-c2124b2d9757 for instance 8a19ce68-d784-44a2-b20c-77de1180aba3 on n-h1-master-1 Aug 07 01:12:46.703067 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6b214317-ea20-4554-9a5e-7546ce9ccf09 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ec78e02379498e884758d48f5454fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ac8cbc5d64648b03ab13bce91cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:46.707664 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-b296da94-d8f1-49ed-a8ee-28fe5293605d req-455024fd-f3fa-47a2-8c69-b20c733dd618 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159452 Aug 07 01:12:46.713425 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 302/694] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:46.730471 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6b214317-ea20-4554-9a5e-7546ce9ccf09 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] 10.222.0.39 "GET /compute/v2.1/servers/3c514622-f3bf-43c5-9713-bd993d6d291c" status: 200 len: 1323 microversion: 2.1 time: 0.478874 Aug 07 01:12:46.732010 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 393/695] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:46 2022] GET /compute/v2.1/servers/3c514622-f3bf-43c5-9713-bd993d6d291c => generated 1323 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:46.734153 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e1342566-b919-4e87-b0c8-ea6217e8fe89 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:46.736253 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e1342566-b919-4e87-b0c8-ea6217e8fe89 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:46.743825 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e3f17397-98d7-4695-b294-4352bb27ad37 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:46.746815 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e3f17397-98d7-4695-b294-4352bb27ad37 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 8a19ce68-d784-44a2-b20c-77de1180aba3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:46.756765 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1342566-b919-4e87-b0c8-ea6217e8fe89 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:46.758359 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1342566-b919-4e87-b0c8-ea6217e8fe89 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:46.759369 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1342566-b919-4e87-b0c8-ea6217e8fe89 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:46.760051 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3f17397-98d7-4695-b294-4352bb27ad37 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:46.760622 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1342566-b919-4e87-b0c8-ea6217e8fe89 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:46.761401 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1342566-b919-4e87-b0c8-ea6217e8fe89 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:46.761693 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3f17397-98d7-4695-b294-4352bb27ad37 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:46.762689 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3f17397-98d7-4695-b294-4352bb27ad37 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:46.762874 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1342566-b919-4e87-b0c8-ea6217e8fe89 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:46.764427 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3f17397-98d7-4695-b294-4352bb27ad37 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:46.765579 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3f17397-98d7-4695-b294-4352bb27ad37 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:46.766850 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3f17397-98d7-4695-b294-4352bb27ad37 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:47.098246 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-e1342566-b919-4e87-b0c8-ea6217e8fe89 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lazy-loading 'services' on Instance uuid 2a4de302-ab36-4e7a-90b5-d72d3dc5d698 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:12:47.146625 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e1342566-b919-4e87-b0c8-ea6217e8fe89 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1933 microversion: 2.75 time: 0.429102 Aug 07 01:12:47.166093 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 303/696] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:12:46 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1933 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:12:47.200134 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d0c2414b-503d-44e3-82db-a7ed007c2134 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:47.201065 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d0c2414b-503d-44e3-82db-a7ed007c2134 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] [instance: f083dc9e-4251-4249-bd6b-12028028484c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:47.231501 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d0c2414b-503d-44e3-82db-a7ed007c2134 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:47.232608 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d0c2414b-503d-44e3-82db-a7ed007c2134 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:47.233429 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d0c2414b-503d-44e3-82db-a7ed007c2134 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:47.236493 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d0c2414b-503d-44e3-82db-a7ed007c2134 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:47.237458 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d0c2414b-503d-44e3-82db-a7ed007c2134 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:47.238244 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d0c2414b-503d-44e3-82db-a7ed007c2134 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:47.256838 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e3f17397-98d7-4695-b294-4352bb27ad37 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:47.289888 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e3f17397-98d7-4695-b294-4352bb27ad37 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3" status: 200 len: 1325 microversion: 2.1 time: 0.555513 Aug 07 01:12:47.295984 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 394/697] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:46 2022] GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3 => generated 1325 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:47.323282 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-8048b199-e3ac-42f0-95b6-278ed2ed072b req-8c734dba-14b9-4da7-9d27-5820ab459392 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c514622-f3bf-43c5-9713-bd993d6d291c", "tag": "a6de2a45-89e2-4f14-b114-b29b2c1379cf"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:47.347377 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-8048b199-e3ac-42f0-95b6-278ed2ed072b req-8c734dba-14b9-4da7-9d27-5820ab459392 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:47.348129 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-8048b199-e3ac-42f0-95b6-278ed2ed072b req-8c734dba-14b9-4da7-9d27-5820ab459392 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:47.349158 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-8048b199-e3ac-42f0-95b6-278ed2ed072b req-8c734dba-14b9-4da7-9d27-5820ab459392 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:47.365120 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-d0c2414b-503d-44e3-82db-a7ed007c2134 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Lazy-loading 'flavor' on Instance uuid f083dc9e-4251-4249-bd6b-12028028484c {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:12:47.400842 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-8048b199-e3ac-42f0-95b6-278ed2ed072b req-8c734dba-14b9-4da7-9d27-5820ab459392 service nova] Creating event network-changed:a6de2a45-89e2-4f14-b114-b29b2c1379cf for instance 3c514622-f3bf-43c5-9713-bd993d6d291c on n-h2-master-1 Aug 07 01:12:47.421662 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-8048b199-e3ac-42f0-95b6-278ed2ed072b req-8c734dba-14b9-4da7-9d27-5820ab459392 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122227 Aug 07 01:12:47.423169 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 395/698] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:47.436463 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d53c15ab-6bec-41d2-8e90-bba184760833 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:47.442033 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d53c15ab-6bec-41d2-8e90-bba184760833 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:47.456190 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:47.509363 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d53c15ab-6bec-41d2-8e90-bba184760833 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:47.510939 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d53c15ab-6bec-41d2-8e90-bba184760833 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:47.511787 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d53c15ab-6bec-41d2-8e90-bba184760833 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:47.522635 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d53c15ab-6bec-41d2-8e90-bba184760833 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:47.524195 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d53c15ab-6bec-41d2-8e90-bba184760833 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:47.528733 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d53c15ab-6bec-41d2-8e90-bba184760833 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:47.573832 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=4 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:47.627127 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d0c2414b-503d-44e3-82db-a7ed007c2134 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c/action" status: 202 len: 0 microversion: 2.1 time: 0.456136 Aug 07 01:12:47.633020 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 304/699] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:12:47 2022] POST /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:12:47.654569 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-36c07dd8-492f-4805-9e09-4605db946468 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e248c64c0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:47.670440 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=17 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:47.784144 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-36c07dd8-492f-4805-9e09-4605db946468 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d" status: 200 len: 1423 microversion: 2.1 time: 0.150242 Aug 07 01:12:47.788170 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 305/700] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:12:47 2022] GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d => generated 1423 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:47.797267 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a65883c7-2294-40e3-8f41-f2465f7bd70b tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:47.797267 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a65883c7-2294-40e3-8f41-f2465f7bd70b tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: f083dc9e-4251-4249-bd6b-12028028484c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:47.818684 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a65883c7-2294-40e3-8f41-f2465f7bd70b tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:47.820953 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a65883c7-2294-40e3-8f41-f2465f7bd70b tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:47.821724 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a65883c7-2294-40e3-8f41-f2465f7bd70b tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:47.823017 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a65883c7-2294-40e3-8f41-f2465f7bd70b tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:47.825328 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a65883c7-2294-40e3-8f41-f2465f7bd70b tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:47.826320 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a65883c7-2294-40e3-8f41-f2465f7bd70b tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:48.303427 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d53c15ab-6bec-41d2-8e90-bba184760833 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:48.319820 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d53c15ab-6bec-41d2-8e90-bba184760833 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79" status: 200 len: 1505 microversion: 2.1 time: 0.894203 Aug 07 01:12:48.321740 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 396/701] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:47 2022] GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79 => generated 1505 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:48.334686 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7ae400ff-b0ac-4e7f-b9f7-1c31c77c2b91 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:48.336437 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7ae400ff-b0ac-4e7f-b9f7-1c31c77c2b91 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] [instance: 3c514622-f3bf-43c5-9713-bd993d6d291c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:48.361738 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ae400ff-b0ac-4e7f-b9f7-1c31c77c2b91 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:48.362548 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ae400ff-b0ac-4e7f-b9f7-1c31c77c2b91 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:48.363465 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ae400ff-b0ac-4e7f-b9f7-1c31c77c2b91 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:48.364971 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ae400ff-b0ac-4e7f-b9f7-1c31c77c2b91 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:48.365531 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ae400ff-b0ac-4e7f-b9f7-1c31c77c2b91 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:48.368068 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ae400ff-b0ac-4e7f-b9f7-1c31c77c2b91 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:48.528682 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a65883c7-2294-40e3-8f41-f2465f7bd70b tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0200a0753e46399d0b212c665aebce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7279db9d4f497b8430fd45280b5da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:48.561220 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a65883c7-2294-40e3-8f41-f2465f7bd70b tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] 10.222.0.39 "GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c" status: 200 len: 1476 microversion: 2.1 time: 0.773525 Aug 07 01:12:48.564606 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 306/702] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:47 2022] GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c => generated 1476 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:48.576160 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a550a86a-284f-4985-93e1-4449c266ae95 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:48.578685 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a550a86a-284f-4985-93e1-4449c266ae95 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:48.600588 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a550a86a-284f-4985-93e1-4449c266ae95 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:48.606830 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a550a86a-284f-4985-93e1-4449c266ae95 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:48.608929 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a550a86a-284f-4985-93e1-4449c266ae95 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:48.613686 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a550a86a-284f-4985-93e1-4449c266ae95 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:48.614992 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a550a86a-284f-4985-93e1-4449c266ae95 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:48.620222 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a550a86a-284f-4985-93e1-4449c266ae95 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:48.819568 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7ae400ff-b0ac-4e7f-b9f7-1c31c77c2b91 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ec78e02379498e884758d48f5454fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ac8cbc5d64648b03ab13bce91cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:48.832752 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-a550a86a-284f-4985-93e1-4449c266ae95 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lazy-loading 'services' on Instance uuid 2a4de302-ab36-4e7a-90b5-d72d3dc5d698 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:12:48.850135 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7ae400ff-b0ac-4e7f-b9f7-1c31c77c2b91 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] 10.222.0.39 "GET /compute/v2.1/servers/3c514622-f3bf-43c5-9713-bd993d6d291c" status: 200 len: 1323 microversion: 2.1 time: 0.526170 Aug 07 01:12:48.855745 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 397/703] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:48 2022] GET /compute/v2.1/servers/3c514622-f3bf-43c5-9713-bd993d6d291c => generated 1323 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:48.871155 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a550a86a-284f-4985-93e1-4449c266ae95 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1933 microversion: 2.75 time: 0.303341 Aug 07 01:12:48.883652 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 307/704] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:12:48 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1933 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:12:48.883652 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4f2f28cd-12d2-4b5d-81bd-7707b23b0246 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e24b95670>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:48.884095 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b2c44ec5-0a48-4c8b-afeb-50c1c8c2bda7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:48.884095 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b2c44ec5-0a48-4c8b-afeb-50c1c8c2bda7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 8a19ce68-d784-44a2-b20c-77de1180aba3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:48.917903 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b2c44ec5-0a48-4c8b-afeb-50c1c8c2bda7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:48.921563 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b2c44ec5-0a48-4c8b-afeb-50c1c8c2bda7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:48.922239 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b2c44ec5-0a48-4c8b-afeb-50c1c8c2bda7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:48.925682 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b2c44ec5-0a48-4c8b-afeb-50c1c8c2bda7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:48.928170 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b2c44ec5-0a48-4c8b-afeb-50c1c8c2bda7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:48.928853 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b2c44ec5-0a48-4c8b-afeb-50c1c8c2bda7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:48.972488 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4f2f28cd-12d2-4b5d-81bd-7707b23b0246 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d" status: 200 len: 1423 microversion: 2.1 time: 0.097338 Aug 07 01:12:48.973900 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 308/705] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:12:48 2022] GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d => generated 1423 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:49.242317 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b2c44ec5-0a48-4c8b-afeb-50c1c8c2bda7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:49.263365 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b2c44ec5-0a48-4c8b-afeb-50c1c8c2bda7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3" status: 200 len: 1325 microversion: 2.1 time: 0.403500 Aug 07 01:12:49.264611 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 398/706] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:48 2022] GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3 => generated 1325 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:49.352566 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c8aa1b17-5798-42f3-8055-6662522f4a67 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:49.354100 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c8aa1b17-5798-42f3-8055-6662522f4a67 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:49.367717 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c8aa1b17-5798-42f3-8055-6662522f4a67 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:49.368165 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c8aa1b17-5798-42f3-8055-6662522f4a67 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:49.368866 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c8aa1b17-5798-42f3-8055-6662522f4a67 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:49.369970 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c8aa1b17-5798-42f3-8055-6662522f4a67 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:49.370803 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c8aa1b17-5798-42f3-8055-6662522f4a67 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:49.371521 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c8aa1b17-5798-42f3-8055-6662522f4a67 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:49.588334 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-95bef0e2-06c0-418c-84d3-5ab71c45605b tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:49.589184 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-95bef0e2-06c0-418c-84d3-5ab71c45605b tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: f083dc9e-4251-4249-bd6b-12028028484c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:49.601558 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-95bef0e2-06c0-418c-84d3-5ab71c45605b tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:49.602467 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-95bef0e2-06c0-418c-84d3-5ab71c45605b tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:49.603498 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-95bef0e2-06c0-418c-84d3-5ab71c45605b tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:49.604601 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-95bef0e2-06c0-418c-84d3-5ab71c45605b tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:49.605326 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-95bef0e2-06c0-418c-84d3-5ab71c45605b tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:49.606045 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-95bef0e2-06c0-418c-84d3-5ab71c45605b tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:50.000523 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c8aa1b17-5798-42f3-8055-6662522f4a67 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:50.027766 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c8aa1b17-5798-42f3-8055-6662522f4a67 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79" status: 200 len: 1505 microversion: 2.1 time: 0.686745 Aug 07 01:12:50.036915 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 309/707] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:49 2022] GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79 => generated 1505 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:50.052824 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c35e4ef3-e9dd-4749-8141-fa024a7424b3 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:50.059329 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c35e4ef3-e9dd-4749-8141-fa024a7424b3 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] [instance: 3c514622-f3bf-43c5-9713-bd993d6d291c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:50.079498 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c35e4ef3-e9dd-4749-8141-fa024a7424b3 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:50.085095 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c35e4ef3-e9dd-4749-8141-fa024a7424b3 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:50.086363 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c35e4ef3-e9dd-4749-8141-fa024a7424b3 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:50.093545 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c35e4ef3-e9dd-4749-8141-fa024a7424b3 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:50.095482 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c35e4ef3-e9dd-4749-8141-fa024a7424b3 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:50.096638 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c35e4ef3-e9dd-4749-8141-fa024a7424b3 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:50.193526 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-95bef0e2-06c0-418c-84d3-5ab71c45605b tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0200a0753e46399d0b212c665aebce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7279db9d4f497b8430fd45280b5da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:50.238410 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-95bef0e2-06c0-418c-84d3-5ab71c45605b tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] 10.222.0.39 "GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c" status: 200 len: 1459 microversion: 2.1 time: 0.654697 Aug 07 01:12:50.239202 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 399/708] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:49 2022] GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c => generated 1459 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:12:50.293142 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-f3be43c5-dcf1-4d5b-8926-ab706c006cfe req-fd18e88a-b10f-4a93-9444-c4e30152e1b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06b38422-fb09-4331-b7cb-3d5f99cc2e79", "name": "network-vif-unplugged", "status": "completed", "tag": "d5cc418b-ee3e-4a9b-b03a-2585f8a9e3b3"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:50.364386 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f3be43c5-dcf1-4d5b-8926-ab706c006cfe req-fd18e88a-b10f-4a93-9444-c4e30152e1b7 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:50.369420 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f3be43c5-dcf1-4d5b-8926-ab706c006cfe req-fd18e88a-b10f-4a93-9444-c4e30152e1b7 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:50.380325 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f3be43c5-dcf1-4d5b-8926-ab706c006cfe req-fd18e88a-b10f-4a93-9444-c4e30152e1b7 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:50.518975 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-f3be43c5-dcf1-4d5b-8926-ab706c006cfe req-fd18e88a-b10f-4a93-9444-c4e30152e1b7 service nova] Creating event network-vif-unplugged:d5cc418b-ee3e-4a9b-b03a-2585f8a9e3b3 for instance 06b38422-fb09-4331-b7cb-3d5f99cc2e79 on n-h2-master-1 Aug 07 01:12:50.544656 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-f3be43c5-dcf1-4d5b-8926-ab706c006cfe req-fd18e88a-b10f-4a93-9444-c4e30152e1b7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.270905 Aug 07 01:12:50.548623 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 400/709] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:50.580158 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-322e8749-1b1c-4f3b-be9a-7dbd7e16e5b7 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:50.584823 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-322e8749-1b1c-4f3b-be9a-7dbd7e16e5b7 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:50.622782 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-322e8749-1b1c-4f3b-be9a-7dbd7e16e5b7 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:50.623601 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-322e8749-1b1c-4f3b-be9a-7dbd7e16e5b7 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:50.624445 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-322e8749-1b1c-4f3b-be9a-7dbd7e16e5b7 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:50.634361 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-322e8749-1b1c-4f3b-be9a-7dbd7e16e5b7 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:50.636722 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-322e8749-1b1c-4f3b-be9a-7dbd7e16e5b7 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:50.641215 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-322e8749-1b1c-4f3b-be9a-7dbd7e16e5b7 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:50.642947 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c35e4ef3-e9dd-4749-8141-fa024a7424b3 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ec78e02379498e884758d48f5454fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ac8cbc5d64648b03ab13bce91cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:50.646979 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:50.685847 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c35e4ef3-e9dd-4749-8141-fa024a7424b3 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] 10.222.0.39 "GET /compute/v2.1/servers/3c514622-f3bf-43c5-9713-bd993d6d291c" status: 200 len: 1323 microversion: 2.1 time: 0.646223 Aug 07 01:12:50.689006 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 310/710] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:50 2022] GET /compute/v2.1/servers/3c514622-f3bf-43c5-9713-bd993d6d291c => generated 1323 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:50.705842 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-821e1505-8589-44e6-95d0-2ee6220fad45 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e248c6ee0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:50.871187 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-821e1505-8589-44e6-95d0-2ee6220fad45 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d" status: 200 len: 1423 microversion: 2.1 time: 0.180187 Aug 07 01:12:50.874443 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 311/711] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:12:50 2022] GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d => generated 1423 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:50.886549 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1929afb4-a345-4d3e-86e3-da72c411ccd1 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:50.887587 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1929afb4-a345-4d3e-86e3-da72c411ccd1 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] [instance: f083dc9e-4251-4249-bd6b-12028028484c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:50.903123 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1929afb4-a345-4d3e-86e3-da72c411ccd1 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:50.904043 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1929afb4-a345-4d3e-86e3-da72c411ccd1 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:50.906328 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1929afb4-a345-4d3e-86e3-da72c411ccd1 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:50.906328 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1929afb4-a345-4d3e-86e3-da72c411ccd1 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:50.907604 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1929afb4-a345-4d3e-86e3-da72c411ccd1 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:50.941096 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1929afb4-a345-4d3e-86e3-da72c411ccd1 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:51.026742 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-322e8749-1b1c-4f3b-be9a-7dbd7e16e5b7 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] Lazy-loading 'services' on Instance uuid 2a4de302-ab36-4e7a-90b5-d72d3dc5d698 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:12:51.121453 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-322e8749-1b1c-4f3b-be9a-7dbd7e16e5b7 tempest-ServersAdmin275Test-1958335905 tempest-ServersAdmin275Test-1958335905-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1918 microversion: 2.75 time: 0.569348 Aug 07 01:12:51.123265 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 401/712] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:12:50 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1918 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:12:51.133070 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-40aedff0-c514-4b0c-be93-cc2b127b3f7a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:51.134482 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-40aedff0-c514-4b0c-be93-cc2b127b3f7a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 8a19ce68-d784-44a2-b20c-77de1180aba3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:51.154459 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-40aedff0-c514-4b0c-be93-cc2b127b3f7a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:51.158555 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-40aedff0-c514-4b0c-be93-cc2b127b3f7a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:51.159525 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-40aedff0-c514-4b0c-be93-cc2b127b3f7a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:51.161945 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-40aedff0-c514-4b0c-be93-cc2b127b3f7a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:51.163666 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-40aedff0-c514-4b0c-be93-cc2b127b3f7a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:51.165129 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-40aedff0-c514-4b0c-be93-cc2b127b3f7a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:51.749018 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-40aedff0-c514-4b0c-be93-cc2b127b3f7a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:51.767119 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-40aedff0-c514-4b0c-be93-cc2b127b3f7a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3" status: 200 len: 1325 microversion: 2.1 time: 0.639941 Aug 07 01:12:51.769142 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 402/713] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:51 2022] GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3 => generated 1325 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:51.781537 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bf3dabfa-6802-4c9b-a50b-4a229acc7019 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:51.782559 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bf3dabfa-6802-4c9b-a50b-4a229acc7019 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:51.799639 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bf3dabfa-6802-4c9b-a50b-4a229acc7019 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:51.800726 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bf3dabfa-6802-4c9b-a50b-4a229acc7019 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:51.801434 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bf3dabfa-6802-4c9b-a50b-4a229acc7019 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:51.802553 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bf3dabfa-6802-4c9b-a50b-4a229acc7019 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:51.803261 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bf3dabfa-6802-4c9b-a50b-4a229acc7019 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:51.803969 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bf3dabfa-6802-4c9b-a50b-4a229acc7019 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:52.145046 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bf3dabfa-6802-4c9b-a50b-4a229acc7019 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:52.174987 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bf3dabfa-6802-4c9b-a50b-4a229acc7019 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79" status: 200 len: 1505 microversion: 2.1 time: 0.402527 Aug 07 01:12:52.175931 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 403/714] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:51 2022] GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79 => generated 1505 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:52.216813 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-34b80aa8-c2c5-44df-87c2-5756bcca1429 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:52.221759 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-34b80aa8-c2c5-44df-87c2-5756bcca1429 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:52.250872 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34b80aa8-c2c5-44df-87c2-5756bcca1429 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:52.258882 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34b80aa8-c2c5-44df-87c2-5756bcca1429 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:52.261117 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34b80aa8-c2c5-44df-87c2-5756bcca1429 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:52.264984 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34b80aa8-c2c5-44df-87c2-5756bcca1429 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:52.271498 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34b80aa8-c2c5-44df-87c2-5756bcca1429 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:52.275241 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34b80aa8-c2c5-44df-87c2-5756bcca1429 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:52.366375 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-34b80aa8-c2c5-44df-87c2-5756bcca1429 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:12:52.501317 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1929afb4-a345-4d3e-86e3-da72c411ccd1 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c" status: 200 len: 1610 microversion: 2.1 time: 1.624795 Aug 07 01:12:52.509255 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 312/715] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:50 2022] GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c => generated 1610 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:52.536070 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d7ca1971-706c-4d2e-99cf-46e87041fccd tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:52.537476 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d7ca1971-706c-4d2e-99cf-46e87041fccd tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] [instance: 3c514622-f3bf-43c5-9713-bd993d6d291c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:52.546645 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7ca1971-706c-4d2e-99cf-46e87041fccd tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:52.547654 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7ca1971-706c-4d2e-99cf-46e87041fccd tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:52.549224 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7ca1971-706c-4d2e-99cf-46e87041fccd tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:52.550347 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7ca1971-706c-4d2e-99cf-46e87041fccd tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:52.551543 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7ca1971-706c-4d2e-99cf-46e87041fccd tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:52.552658 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7ca1971-706c-4d2e-99cf-46e87041fccd tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:52.619800 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-34b80aa8-c2c5-44df-87c2-5756bcca1429 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 204 len: 0 microversion: 2.75 time: 0.420604 Aug 07 01:12:52.621195 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 404/716] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Aug 7 01:12:52 2022] DELETE /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 01:12:52.631586 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-55003d2f-f252-4036-abb6-a21f0639c154 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e24d529d0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:52.702112 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-55003d2f-f252-4036-abb6-a21f0639c154 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d" status: 200 len: 1423 microversion: 2.1 time: 0.078773 Aug 07 01:12:52.703291 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 405/717] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:12:52 2022] GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d => generated 1423 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:52.708708 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0ff6d02a-b9da-41e3-9e08-61cb86b24ca4 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:52.712492 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:12:52.712492 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:12:52.714308 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ff6d02a-b9da-41e3-9e08-61cb86b24ca4 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:52.715311 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ff6d02a-b9da-41e3-9e08-61cb86b24ca4 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:52.716077 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ff6d02a-b9da-41e3-9e08-61cb86b24ca4 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:52.717252 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ff6d02a-b9da-41e3-9e08-61cb86b24ca4 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:52.717966 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ff6d02a-b9da-41e3-9e08-61cb86b24ca4 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:52.718765 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ff6d02a-b9da-41e3-9e08-61cb86b24ca4 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:52.787180 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0ff6d02a-b9da-41e3-9e08-61cb86b24ca4 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.082420 Aug 07 01:12:52.788886 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 406/718] 10.222.0.39 () {58 vars in 1176 bytes} [Sun Aug 7 01:12:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:52.802062 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-7dea1847-2033-4c03-936e-77e012b388df req-da3f935c-59e2-46c0-a3b3-285e4b8eff26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06b38422-fb09-4331-b7cb-3d5f99cc2e79", "tag": "d5cc418b-ee3e-4a9b-b03a-2585f8a9e3b3"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:52.813602 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-7dea1847-2033-4c03-936e-77e012b388df req-da3f935c-59e2-46c0-a3b3-285e4b8eff26 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:52.814530 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-7dea1847-2033-4c03-936e-77e012b388df req-da3f935c-59e2-46c0-a3b3-285e4b8eff26 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:52.815281 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-7dea1847-2033-4c03-936e-77e012b388df req-da3f935c-59e2-46c0-a3b3-285e4b8eff26 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:52.845142 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-7dea1847-2033-4c03-936e-77e012b388df req-da3f935c-59e2-46c0-a3b3-285e4b8eff26 service nova] Creating event network-changed:d5cc418b-ee3e-4a9b-b03a-2585f8a9e3b3 for instance 06b38422-fb09-4331-b7cb-3d5f99cc2e79 on n-h2-master-1 Aug 07 01:12:52.853291 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-7dea1847-2033-4c03-936e-77e012b388df req-da3f935c-59e2-46c0-a3b3-285e4b8eff26 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055228 Aug 07 01:12:52.863363 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 407/719] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:52.870091 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7439af29-2d14-4106-840e-9a800dd917fa tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:52.871841 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7439af29-2d14-4106-840e-9a800dd917fa tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:52.885303 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7439af29-2d14-4106-840e-9a800dd917fa tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:52.886527 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7439af29-2d14-4106-840e-9a800dd917fa tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:52.888069 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7439af29-2d14-4106-840e-9a800dd917fa tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:52.889711 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7439af29-2d14-4106-840e-9a800dd917fa tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:52.890554 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7439af29-2d14-4106-840e-9a800dd917fa tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:52.891800 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7439af29-2d14-4106-840e-9a800dd917fa tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:53.137770 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7439af29-2d14-4106-840e-9a800dd917fa tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:53.151536 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7439af29-2d14-4106-840e-9a800dd917fa tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:53.154100 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7439af29-2d14-4106-840e-9a800dd917fa tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:53.162313 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7439af29-2d14-4106-840e-9a800dd917fa tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1443 microversion: 2.75 time: 0.296045 Aug 07 01:12:53.163866 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 408/720] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:12:52 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1443 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:12:53.173348 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d7ca1971-706c-4d2e-99cf-46e87041fccd tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ec78e02379498e884758d48f5454fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ac8cbc5d64648b03ab13bce91cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:53.178169 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b48ae3ad-9975-47a7-8c02-e133dd4f3f00 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:53.185913 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b48ae3ad-9975-47a7-8c02-e133dd4f3f00 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] [instance: f083dc9e-4251-4249-bd6b-12028028484c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:53.188953 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d7ca1971-706c-4d2e-99cf-46e87041fccd tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] 10.222.0.39 "GET /compute/v2.1/servers/3c514622-f3bf-43c5-9713-bd993d6d291c" status: 200 len: 1323 microversion: 2.1 time: 0.662749 Aug 07 01:12:53.204085 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 313/721] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:52 2022] GET /compute/v2.1/servers/3c514622-f3bf-43c5-9713-bd993d6d291c => generated 1323 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:53.248931 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ec0292d5-269a-4c8c-b4c2-e033f653dfef tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:53.253229 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ec0292d5-269a-4c8c-b4c2-e033f653dfef tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 8a19ce68-d784-44a2-b20c-77de1180aba3] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:53.259763 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b48ae3ad-9975-47a7-8c02-e133dd4f3f00 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:53.262288 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b48ae3ad-9975-47a7-8c02-e133dd4f3f00 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:53.263183 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b48ae3ad-9975-47a7-8c02-e133dd4f3f00 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:53.274258 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b48ae3ad-9975-47a7-8c02-e133dd4f3f00 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:53.275281 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b48ae3ad-9975-47a7-8c02-e133dd4f3f00 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:53.281955 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b48ae3ad-9975-47a7-8c02-e133dd4f3f00 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:53.294392 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ec0292d5-269a-4c8c-b4c2-e033f653dfef tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:53.295287 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ec0292d5-269a-4c8c-b4c2-e033f653dfef tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:53.305240 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ec0292d5-269a-4c8c-b4c2-e033f653dfef tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:53.309101 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ec0292d5-269a-4c8c-b4c2-e033f653dfef tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:53.313186 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ec0292d5-269a-4c8c-b4c2-e033f653dfef tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:53.318461 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ec0292d5-269a-4c8c-b4c2-e033f653dfef tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:53.378081 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:53.438780 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-b48ae3ad-9975-47a7-8c02-e133dd4f3f00 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Lazy-loading 'flavor' on Instance uuid f083dc9e-4251-4249-bd6b-12028028484c {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:12:53.493728 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-b48ae3ad-9975-47a7-8c02-e133dd4f3f00 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance f083dc9e-4251-4249-bd6b-12028028484c while it is in vm_state suspended Aug 07 01:12:53.506581 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b48ae3ad-9975-47a7-8c02-e133dd4f3f00 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Request method failure captured: Aug 07 01:12:53.506581 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c/action HTTP/1.1 Aug 07 01:12:53.506581 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:12:53.506581 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:12:53.506581 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:12:53.506581 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 97 Aug 07 01:12:53.506581 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:12:53.506581 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:12:53.506581 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:12:53.506581 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:12:53.506581 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xFeKjj-zhemXaBOOIj-jtbbDoeVnqJxZRtuHmW8bqGv4uDrUiDPsum6ztNi7QhXN-7mn48ETdNquMaov6XMGLHL5_Wje13Mt7XSHMF915EwCG7N53qNCNSEbGfQkJ8ShkIkBrAmAGpsPXDEzSocSkDlZ0f0fnxTh8T5clrktV4Seks Aug 07 01:12:53.506581 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:12:53.506581 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:12:53.506581 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:12:53.506581 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:12:53.506581 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:12:53.506581 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:12:53.506581 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: eb582d220421404ba7f60af09d58fe62 Aug 07 01:12:53.506581 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-LiveMigrationNegativeTest-550618707 Aug 07 01:12:53.506581 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,admin,member Aug 07 01:12:53.506581 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,admin,member Aug 07 01:12:53.510250 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/eb582d220421404ba7f60af09d58fe62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_eb582d220421404ba7f60af09d58fe62", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/eb582d220421404ba7f60af09d58fe62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/eb582d220421404ba7f60af09d58fe62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:12:53.510250 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-LiveMigrationNegativeTest-550618707 Aug 07 01:12:53.510250 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: eb582d220421404ba7f60af09d58fe62 Aug 07 01:12:53.510250 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-550618707 Aug 07 01:12:53.510250 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-LiveMigrationNegativeTest-550618707-project-admin Aug 07 01:12:53.510250 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:12:53.510250 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:12:53.510250 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 423b935e72ae42d9a49b9b8390ab20d6 Aug 07 01:12:53.510250 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-LiveMigrationNegativeTest-550618707-project-admin Aug 07 01:12:53.510250 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:12:53.510250 n-d-master-1 devstack@n-api.service[119516]: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": true, "disk_over_commit": false}} Aug 07 01:12:53.510250 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:12:53.514041 n-d-master-1 devstack@n-api.service[119516]: exception: Cannot 'os-migrateLive' instance f083dc9e-4251-4249-bd6b-12028028484c while it is in vm_state suspended Aug 07 01:12:53.514041 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'f083dc9e-4251-4249-bd6b-12028028484c', 'body': {'os-migrateLive': {'host': 'n-h2-master-1', 'block_migration': True, 'disk_over_commit': False}}} Aug 07 01:12:53.514041 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:12:53.514041 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:12:53.514041 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 07 01:12:53.514041 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 07 01:12:53.514041 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 07 01:12:53.514041 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 01:12:53.514041 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 07 01:12:53.514041 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 07 01:12:53.514041 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 07 01:12:53.514041 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 07 01:12:53.514041 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 07 01:12:53.514041 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 07 01:12:53.514041 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 07 01:12:53.514041 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 07 01:12:53.514041 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 07 01:12:53.514041 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 07 01:12:53.518948 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 01:12:53.518948 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 01:12:53.518948 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 07 01:12:53.518948 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 07 01:12:53.518948 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f083dc9e-4251-4249-bd6b-12028028484c in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 07 01:12:53.518948 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:53.518948 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:12:53.518948 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:53.518948 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:12:53.518948 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:12:53.518948 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:12:53.518948 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:12:53.518948 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:12:53.518948 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:12:53.518948 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:12:53.518948 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:12:53.518948 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:12:53.518948 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:12:53.518948 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:12:53.518948 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:12:53.527723 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:12:53.527723 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 07 01:12:53.527723 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 07 01:12:53.527723 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 07 01:12:53.527723 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 07 01:12:53.527723 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 07 01:12:53.527723 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance f083dc9e-4251-4249-bd6b-12028028484c while it is in vm_state suspended Aug 07 01:12:53.527723 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:53.527723 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:12:53.527723 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:53.527723 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:12:53.527723 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:12:53.527723 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:12:53.527723 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:12:53.527723 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:12:53.527723 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance f083dc9e-4251-4249-bd6b-12028028484c while it is in vm_state suspended Aug 07 01:12:53.527723 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:53.531022 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b48ae3ad-9975-47a7-8c02-e133dd4f3f00 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance f083dc9e-4251-4249-bd6b-12028028484c while it is in vm_state suspended {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:12:53.531022 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b48ae3ad-9975-47a7-8c02-e133dd4f3f00 tempest-LiveMigrationNegativeTest-550618707 tempest-LiveMigrationNegativeTest-550618707-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c/action" status: 409 len: 155 microversion: 2.1 time: 0.343881 Aug 07 01:12:53.531022 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 409/722] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:12:53 2022] POST /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c/action => generated 155 bytes in 348 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:12:53.538141 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0b2d8ef2-02f0-47b6-8667-b007516fb8f3 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:53.539256 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0b2d8ef2-02f0-47b6-8667-b007516fb8f3 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:53.568790 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b2d8ef2-02f0-47b6-8667-b007516fb8f3 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:53.569743 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b2d8ef2-02f0-47b6-8667-b007516fb8f3 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:53.570585 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b2d8ef2-02f0-47b6-8667-b007516fb8f3 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:53.572052 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b2d8ef2-02f0-47b6-8667-b007516fb8f3 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:53.572962 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b2d8ef2-02f0-47b6-8667-b007516fb8f3 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:53.579218 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b2d8ef2-02f0-47b6-8667-b007516fb8f3 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:53.801431 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ec0292d5-269a-4c8c-b4c2-e033f653dfef tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:53.818875 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ec0292d5-269a-4c8c-b4c2-e033f653dfef tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3" status: 200 len: 1325 microversion: 2.1 time: 0.618014 Aug 07 01:12:53.826542 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 314/723] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:53 2022] GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3 => generated 1325 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:53.851058 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bc6ac554-0af3-4374-b973-c62b5a4c628f tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:53.857441 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bc6ac554-0af3-4374-b973-c62b5a4c628f tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: f083dc9e-4251-4249-bd6b-12028028484c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:53.879631 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc6ac554-0af3-4374-b973-c62b5a4c628f tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:53.885002 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc6ac554-0af3-4374-b973-c62b5a4c628f tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:53.886036 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc6ac554-0af3-4374-b973-c62b5a4c628f tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:53.887383 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc6ac554-0af3-4374-b973-c62b5a4c628f tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:53.891811 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc6ac554-0af3-4374-b973-c62b5a4c628f tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:53.893957 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc6ac554-0af3-4374-b973-c62b5a4c628f tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:54.021444 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bc6ac554-0af3-4374-b973-c62b5a4c628f tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: f083dc9e-4251-4249-bd6b-12028028484c] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:12:54.228096 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bc6ac554-0af3-4374-b973-c62b5a4c628f tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c" status: 204 len: 0 microversion: 2.1 time: 0.392675 Aug 07 01:12:54.229123 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 315/724] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:12:53 2022] DELETE /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:12:54.238987 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4d3a7ca8-827b-4a6e-b797-8a5c235625d0 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e249049d0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:54.361911 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4d3a7ca8-827b-4a6e-b797-8a5c235625d0 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d" status: 200 len: 1423 microversion: 2.1 time: 0.130976 Aug 07 01:12:54.367947 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 316/725] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:12:54 2022] GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d => generated 1423 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:54.400404 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1609c1b0-e969-499b-a2bd-c3454f2b482e tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:54.405541 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1609c1b0-e969-499b-a2bd-c3454f2b482e tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:54.427832 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1609c1b0-e969-499b-a2bd-c3454f2b482e tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:54.428994 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0b2d8ef2-02f0-47b6-8667-b007516fb8f3 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:54.436714 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1609c1b0-e969-499b-a2bd-c3454f2b482e tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:54.437916 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1609c1b0-e969-499b-a2bd-c3454f2b482e tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:54.439461 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1609c1b0-e969-499b-a2bd-c3454f2b482e tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:54.440517 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1609c1b0-e969-499b-a2bd-c3454f2b482e tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:54.447535 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0b2d8ef2-02f0-47b6-8667-b007516fb8f3 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79" status: 200 len: 1505 microversion: 2.1 time: 0.932910 Aug 07 01:12:54.449686 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 410/726] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:53 2022] GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79 => generated 1505 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:54.460747 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1609c1b0-e969-499b-a2bd-c3454f2b482e tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:54.462244 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d991c6f8-e6f4-4729-b850-6914e2c9c5e7 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:54.471063 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d991c6f8-e6f4-4729-b850-6914e2c9c5e7 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] [instance: 3c514622-f3bf-43c5-9713-bd993d6d291c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:54.488113 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d991c6f8-e6f4-4729-b850-6914e2c9c5e7 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:54.488888 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d991c6f8-e6f4-4729-b850-6914e2c9c5e7 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:54.489607 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d991c6f8-e6f4-4729-b850-6914e2c9c5e7 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:54.493202 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d991c6f8-e6f4-4729-b850-6914e2c9c5e7 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:54.496205 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d991c6f8-e6f4-4729-b850-6914e2c9c5e7 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:54.497055 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d991c6f8-e6f4-4729-b850-6914e2c9c5e7 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:54.994558 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d991c6f8-e6f4-4729-b850-6914e2c9c5e7 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ec78e02379498e884758d48f5454fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ac8cbc5d64648b03ab13bce91cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:55.025047 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d991c6f8-e6f4-4729-b850-6914e2c9c5e7 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] 10.222.0.39 "GET /compute/v2.1/servers/3c514622-f3bf-43c5-9713-bd993d6d291c" status: 200 len: 1323 microversion: 2.1 time: 0.573773 Aug 07 01:12:55.027154 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 411/727] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:54 2022] GET /compute/v2.1/servers/3c514622-f3bf-43c5-9713-bd993d6d291c => generated 1323 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:55.062129 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-42654302-116e-4916-81bc-c20bfbda53c6 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:55.062830 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-42654302-116e-4916-81bc-c20bfbda53c6 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: f083dc9e-4251-4249-bd6b-12028028484c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:55.078603 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42654302-116e-4916-81bc-c20bfbda53c6 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:55.079125 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42654302-116e-4916-81bc-c20bfbda53c6 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:55.084345 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42654302-116e-4916-81bc-c20bfbda53c6 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:55.085227 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42654302-116e-4916-81bc-c20bfbda53c6 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:55.085720 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42654302-116e-4916-81bc-c20bfbda53c6 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:55.086389 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42654302-116e-4916-81bc-c20bfbda53c6 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:55.217670 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1609c1b0-e969-499b-a2bd-c3454f2b482e tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:55.259157 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1609c1b0-e969-499b-a2bd-c3454f2b482e tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:55.264148 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1609c1b0-e969-499b-a2bd-c3454f2b482e tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:55.288289 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1609c1b0-e969-499b-a2bd-c3454f2b482e tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1443 microversion: 2.75 time: 0.903162 Aug 07 01:12:55.289763 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 317/728] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:12:54 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1443 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:12:55.302849 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2d93bdff-fff3-415a-a53d-604a38d751bf tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:55.308621 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2d93bdff-fff3-415a-a53d-604a38d751bf tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 7ab29f8e-4b84-4038-a60f-efc93d0358ce] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:55.317182 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d93bdff-fff3-415a-a53d-604a38d751bf tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:55.318004 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d93bdff-fff3-415a-a53d-604a38d751bf tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:55.318751 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d93bdff-fff3-415a-a53d-604a38d751bf tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:55.319750 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d93bdff-fff3-415a-a53d-604a38d751bf tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:55.320457 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d93bdff-fff3-415a-a53d-604a38d751bf tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:55.321093 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d93bdff-fff3-415a-a53d-604a38d751bf tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:55.370227 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2d93bdff-fff3-415a-a53d-604a38d751bf tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 7ab29f8e-4b84-4038-a60f-efc93d0358ce] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:12:55.392789 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-42654302-116e-4916-81bc-c20bfbda53c6 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0200a0753e46399d0b212c665aebce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7279db9d4f497b8430fd45280b5da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:55.409618 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-42654302-116e-4916-81bc-c20bfbda53c6 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] 10.222.0.39 "GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c" status: 200 len: 1465 microversion: 2.1 time: 0.361604 Aug 07 01:12:55.411141 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 412/729] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:55 2022] GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c => generated 1465 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:55.420145 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8bc2bb4e-7519-4c46-9643-6792f8008ee0 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:55.421360 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8bc2bb4e-7519-4c46-9643-6792f8008ee0 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 8a19ce68-d784-44a2-b20c-77de1180aba3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:55.433664 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8bc2bb4e-7519-4c46-9643-6792f8008ee0 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:55.434606 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8bc2bb4e-7519-4c46-9643-6792f8008ee0 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:55.435447 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8bc2bb4e-7519-4c46-9643-6792f8008ee0 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:55.437877 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8bc2bb4e-7519-4c46-9643-6792f8008ee0 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:55.439122 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8bc2bb4e-7519-4c46-9643-6792f8008ee0 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:55.440600 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8bc2bb4e-7519-4c46-9643-6792f8008ee0 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:55.546155 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2d93bdff-fff3-415a-a53d-604a38d751bf tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7ab29f8e-4b84-4038-a60f-efc93d0358ce" status: 204 len: 0 microversion: 2.1 time: 0.249576 Aug 07 01:12:55.548229 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 318/730] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:12:55 2022] DELETE /compute/v2.1/servers/7ab29f8e-4b84-4038-a60f-efc93d0358ce => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:12:55.555405 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-4e21df3d-9444-4699-8891-5d9ce6f2fe96 req-bfbfd1a7-68a1-4df2-ab37-c3d0c8ccd090 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c514622-f3bf-43c5-9713-bd993d6d291c", "name": "network-vif-plugged", "status": "completed", "tag": "a6de2a45-89e2-4f14-b114-b29b2c1379cf"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:55.568931 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-4e21df3d-9444-4699-8891-5d9ce6f2fe96 req-bfbfd1a7-68a1-4df2-ab37-c3d0c8ccd090 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:55.569563 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-4e21df3d-9444-4699-8891-5d9ce6f2fe96 req-bfbfd1a7-68a1-4df2-ab37-c3d0c8ccd090 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:55.570195 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-4e21df3d-9444-4699-8891-5d9ce6f2fe96 req-bfbfd1a7-68a1-4df2-ab37-c3d0c8ccd090 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:55.589788 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-4e21df3d-9444-4699-8891-5d9ce6f2fe96 req-bfbfd1a7-68a1-4df2-ab37-c3d0c8ccd090 service nova] Creating event network-vif-plugged:a6de2a45-89e2-4f14-b114-b29b2c1379cf for instance 3c514622-f3bf-43c5-9713-bd993d6d291c on n-h2-master-1 Aug 07 01:12:55.596890 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-4e21df3d-9444-4699-8891-5d9ce6f2fe96 req-bfbfd1a7-68a1-4df2-ab37-c3d0c8ccd090 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046668 Aug 07 01:12:55.598315 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 319/731] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:55.604696 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-47cf0c9d-5335-4d8e-ac26-742ba5f699e8 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e248e9280>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:55.664938 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-47cf0c9d-5335-4d8e-ac26-742ba5f699e8 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d" status: 200 len: 1423 microversion: 2.1 time: 0.064637 Aug 07 01:12:55.666517 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 320/732] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:12:55 2022] GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d => generated 1423 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:55.672674 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6ae40fdb-400f-4e5b-8d33-b9e6d61caff8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:55.674134 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6ae40fdb-400f-4e5b-8d33-b9e6d61caff8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:55.681931 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ae40fdb-400f-4e5b-8d33-b9e6d61caff8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:55.682828 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ae40fdb-400f-4e5b-8d33-b9e6d61caff8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:55.683617 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ae40fdb-400f-4e5b-8d33-b9e6d61caff8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:55.684887 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ae40fdb-400f-4e5b-8d33-b9e6d61caff8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:55.685638 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ae40fdb-400f-4e5b-8d33-b9e6d61caff8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:55.686319 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ae40fdb-400f-4e5b-8d33-b9e6d61caff8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:55.861902 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8bc2bb4e-7519-4c46-9643-6792f8008ee0 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:55.882099 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8bc2bb4e-7519-4c46-9643-6792f8008ee0 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3" status: 200 len: 1325 microversion: 2.1 time: 0.468882 Aug 07 01:12:55.890299 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 413/733] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:55 2022] GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3 => generated 1325 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:55.923017 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-10e35bed-4dde-4c0c-842e-24580e679d67 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-348706822", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "1028827470", "adminPass": "***", "networks": [{"uuid": "8fec5c86-3d8a-423c-b1ed-bdb1c1ca90c2"}], "security_groups": [{"name": "tempest-securitygroup--164389640"}], "key_name": "tempest-keypair-151177983", "user_data": "}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:56.062085 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-10e35bed-4dde-4c0c-842e-24580e679d67 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] validate_networks() for [('8fec5c86-3d8a-423c-b1ed-bdb1c1ca90c2', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:12:56.482516 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6ae40fdb-400f-4e5b-8d33-b9e6d61caff8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:56.536146 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6ae40fdb-400f-4e5b-8d33-b9e6d61caff8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79" status: 200 len: 1505 microversion: 2.1 time: 0.868200 Aug 07 01:12:56.552013 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 321/734] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:55 2022] GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79 => generated 1505 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:56.552013 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-50e939a1-d97d-4c19-90af-5c0efd81d878 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:56.552013 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-50e939a1-d97d-4c19-90af-5c0efd81d878 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] [instance: 3c514622-f3bf-43c5-9713-bd993d6d291c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:56.607591 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-50e939a1-d97d-4c19-90af-5c0efd81d878 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:56.608563 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-50e939a1-d97d-4c19-90af-5c0efd81d878 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:56.610570 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-50e939a1-d97d-4c19-90af-5c0efd81d878 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:56.613358 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-50e939a1-d97d-4c19-90af-5c0efd81d878 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:56.614460 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-50e939a1-d97d-4c19-90af-5c0efd81d878 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:56.615240 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-50e939a1-d97d-4c19-90af-5c0efd81d878 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:56.816816 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-10e35bed-4dde-4c0c-842e-24580e679d67 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:12:56.816816 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-10e35bed-4dde-4c0c-842e-24580e679d67 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:12:56.816816 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-10e35bed-4dde-4c0c-842e-24580e679d67 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:12:56.816816 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-10e35bed-4dde-4c0c-842e-24580e679d67 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:12:56.816816 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-10e35bed-4dde-4c0c-842e-24580e679d67 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:12:56.841365 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10e35bed-4dde-4c0c-842e-24580e679d67 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:56.845332 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10e35bed-4dde-4c0c-842e-24580e679d67 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:56.849597 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10e35bed-4dde-4c0c-842e-24580e679d67 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:56.851908 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10e35bed-4dde-4c0c-842e-24580e679d67 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:56.854794 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10e35bed-4dde-4c0c-842e-24580e679d67 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:56.856561 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10e35bed-4dde-4c0c-842e-24580e679d67 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:56.946093 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-10e35bed-4dde-4c0c-842e-24580e679d67 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Getting quotas for project 6a06211ba44e4f6d88f9095969001aab. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:12:56.964443 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-10e35bed-4dde-4c0c-842e-24580e679d67 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Getting quotas for user 96d08a2479f847b4b06d6690f1aedb18 and project 6a06211ba44e4f6d88f9095969001aab. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:12:57.030767 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-10e35bed-4dde-4c0c-842e-24580e679d67 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:12:57.051287 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-10e35bed-4dde-4c0c-842e-24580e679d67 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:12:57.230685 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-50e939a1-d97d-4c19-90af-5c0efd81d878 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ec78e02379498e884758d48f5454fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ac8cbc5d64648b03ab13bce91cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:57.251521 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-50e939a1-d97d-4c19-90af-5c0efd81d878 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] 10.222.0.39 "GET /compute/v2.1/servers/3c514622-f3bf-43c5-9713-bd993d6d291c" status: 200 len: 1323 microversion: 2.1 time: 0.704122 Aug 07 01:12:57.272584 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 322/735] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:56 2022] GET /compute/v2.1/servers/3c514622-f3bf-43c5-9713-bd993d6d291c => generated 1323 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:57.289627 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-74d43364-3e42-40c9-8709-7812cba986e5 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:57.293202 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-74d43364-3e42-40c9-8709-7812cba986e5 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:57.294000 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-10e35bed-4dde-4c0c-842e-24580e679d67 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.391213 Aug 07 01:12:57.303094 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 414/736] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:12:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 1402 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:12:57.319238 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-74d43364-3e42-40c9-8709-7812cba986e5 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:57.319636 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e9b44c97-5af5-4298-ad5e-7b97924573a9 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:57.319795 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-74d43364-3e42-40c9-8709-7812cba986e5 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:57.320401 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-74d43364-3e42-40c9-8709-7812cba986e5 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:57.320902 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e9b44c97-5af5-4298-ad5e-7b97924573a9 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: f083dc9e-4251-4249-bd6b-12028028484c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:57.321133 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-74d43364-3e42-40c9-8709-7812cba986e5 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:57.321596 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-74d43364-3e42-40c9-8709-7812cba986e5 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:57.322021 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-74d43364-3e42-40c9-8709-7812cba986e5 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:57.345271 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9b44c97-5af5-4298-ad5e-7b97924573a9 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:57.346350 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9b44c97-5af5-4298-ad5e-7b97924573a9 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:57.347184 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9b44c97-5af5-4298-ad5e-7b97924573a9 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:57.362748 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9b44c97-5af5-4298-ad5e-7b97924573a9 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:57.367779 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9b44c97-5af5-4298-ad5e-7b97924573a9 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:57.368801 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9b44c97-5af5-4298-ad5e-7b97924573a9 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:57.417650 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-74d43364-3e42-40c9-8709-7812cba986e5 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:57.420547 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-74d43364-3e42-40c9-8709-7812cba986e5 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:57.421065 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-74d43364-3e42-40c9-8709-7812cba986e5 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:57.421584 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-74d43364-3e42-40c9-8709-7812cba986e5 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lazy-loading 'fault' on Instance uuid 2a4de302-ab36-4e7a-90b5-d72d3dc5d698 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:12:57.545913 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-74d43364-3e42-40c9-8709-7812cba986e5 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:57.559594 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-74d43364-3e42-40c9-8709-7812cba986e5 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:57.566014 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-74d43364-3e42-40c9-8709-7812cba986e5 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96da5d25cbbd4653b222290714febb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b525a2b221d843c0b1ec95a81acc0159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:57.580430 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-74d43364-3e42-40c9-8709-7812cba986e5 tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 200 len: 1448 microversion: 2.75 time: 0.306588 Aug 07 01:12:57.581734 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 323/737] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:12:57 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 1448 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:12:57.590072 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ff3be9d4-ad8b-40aa-8621-e67187b02cf2 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e2491f550>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:57.705599 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ff3be9d4-ad8b-40aa-8621-e67187b02cf2 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d" status: 200 len: 1423 microversion: 2.1 time: 0.122442 Aug 07 01:12:57.713541 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 324/738] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:12:57 2022] GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d => generated 1423 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:57.725445 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-18a484f6-ed5c-4776-8625-178cf97a3d32 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:57.726148 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-18a484f6-ed5c-4776-8625-178cf97a3d32 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 8a19ce68-d784-44a2-b20c-77de1180aba3] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:57.749020 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-18a484f6-ed5c-4776-8625-178cf97a3d32 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:57.749525 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-18a484f6-ed5c-4776-8625-178cf97a3d32 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:57.754179 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-18a484f6-ed5c-4776-8625-178cf97a3d32 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:57.755794 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-18a484f6-ed5c-4776-8625-178cf97a3d32 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:57.758883 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-18a484f6-ed5c-4776-8625-178cf97a3d32 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:57.762085 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-18a484f6-ed5c-4776-8625-178cf97a3d32 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:57.879465 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e9b44c97-5af5-4298-ad5e-7b97924573a9 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0200a0753e46399d0b212c665aebce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7279db9d4f497b8430fd45280b5da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:57.893409 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e9b44c97-5af5-4298-ad5e-7b97924573a9 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] 10.222.0.39 "GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c" status: 200 len: 1465 microversion: 2.1 time: 0.588449 Aug 07 01:12:57.909270 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 415/739] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:57 2022] GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c => generated 1465 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:57.917537 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ba688b1c-9a30-43b2-a8b0-4a8b9089cacd tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:57.918732 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ba688b1c-9a30-43b2-a8b0-4a8b9089cacd tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:58.051288 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ba688b1c-9a30-43b2-a8b0-4a8b9089cacd tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d08a2479f847b4b06d6690f1aedb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06211ba44e4f6d88f9095969001aab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:58.063129 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ba688b1c-9a30-43b2-a8b0-4a8b9089cacd tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31" status: 200 len: 1263 microversion: 2.1 time: 0.152278 Aug 07 01:12:58.068248 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 416/740] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:57 2022] GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:58.080373 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4561afd8-c544-4a26-bb5a-51ecb7cf7f71 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:58.096901 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4561afd8-c544-4a26-bb5a-51ecb7cf7f71 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:58.130410 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4561afd8-c544-4a26-bb5a-51ecb7cf7f71 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:58.131161 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4561afd8-c544-4a26-bb5a-51ecb7cf7f71 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:58.132061 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4561afd8-c544-4a26-bb5a-51ecb7cf7f71 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:58.133056 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4561afd8-c544-4a26-bb5a-51ecb7cf7f71 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:58.133695 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4561afd8-c544-4a26-bb5a-51ecb7cf7f71 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:58.134327 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4561afd8-c544-4a26-bb5a-51ecb7cf7f71 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:58.920409 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4561afd8-c544-4a26-bb5a-51ecb7cf7f71 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:58.950697 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-18a484f6-ed5c-4776-8625-178cf97a3d32 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:58.953007 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4561afd8-c544-4a26-bb5a-51ecb7cf7f71 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79" status: 200 len: 1505 microversion: 2.1 time: 0.880686 Aug 07 01:12:58.956490 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 417/741] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:58 2022] GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79 => generated 1505 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:58.965170 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-18a484f6-ed5c-4776-8625-178cf97a3d32 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3" status: 200 len: 1325 microversion: 2.1 time: 1.256802 Aug 07 01:12:58.969064 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-d906fc9f-e25d-4384-bcf3-d041e42c4b36 req-9770733c-747f-4a85-a32f-7100e81ca7f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a19ce68-d784-44a2-b20c-77de1180aba3", "name": "network-vif-plugged", "status": "completed", "tag": "bb072379-0a62-4d26-a5df-c2124b2d9757"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:58.980824 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 325/742] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:57 2022] GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3 => generated 1325 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:58.987309 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-069486aa-8c76-44f3-8eeb-a5c0597889d7 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:58.992977 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-069486aa-8c76-44f3-8eeb-a5c0597889d7 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] [instance: 3c514622-f3bf-43c5-9713-bd993d6d291c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:59.007294 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-069486aa-8c76-44f3-8eeb-a5c0597889d7 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:59.010458 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-069486aa-8c76-44f3-8eeb-a5c0597889d7 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:59.012573 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-069486aa-8c76-44f3-8eeb-a5c0597889d7 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:59.013350 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-069486aa-8c76-44f3-8eeb-a5c0597889d7 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:59.014245 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-069486aa-8c76-44f3-8eeb-a5c0597889d7 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:59.014245 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-069486aa-8c76-44f3-8eeb-a5c0597889d7 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:59.026059 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d906fc9f-e25d-4384-bcf3-d041e42c4b36 req-9770733c-747f-4a85-a32f-7100e81ca7f9 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:59.026880 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d906fc9f-e25d-4384-bcf3-d041e42c4b36 req-9770733c-747f-4a85-a32f-7100e81ca7f9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:59.027483 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d906fc9f-e25d-4384-bcf3-d041e42c4b36 req-9770733c-747f-4a85-a32f-7100e81ca7f9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:59.054578 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-d906fc9f-e25d-4384-bcf3-d041e42c4b36 req-9770733c-747f-4a85-a32f-7100e81ca7f9 service nova] Creating event network-vif-plugged:bb072379-0a62-4d26-a5df-c2124b2d9757 for instance 8a19ce68-d784-44a2-b20c-77de1180aba3 on n-h1-master-1 Aug 07 01:12:59.060943 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-d906fc9f-e25d-4384-bcf3-d041e42c4b36 req-9770733c-747f-4a85-a32f-7100e81ca7f9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101864 Aug 07 01:12:59.065736 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 418/743] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:59.076530 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4fbb0f26-0b75-4b16-9236-90c746d61ddc tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:59.078062 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4fbb0f26-0b75-4b16-9236-90c746d61ddc tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] [instance: 2a4de302-ab36-4e7a-90b5-d72d3dc5d698] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:59.095151 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4fbb0f26-0b75-4b16-9236-90c746d61ddc tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:59.095916 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4fbb0f26-0b75-4b16-9236-90c746d61ddc tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:59.097154 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4fbb0f26-0b75-4b16-9236-90c746d61ddc tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:59.100763 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4fbb0f26-0b75-4b16-9236-90c746d61ddc tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:59.101519 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4fbb0f26-0b75-4b16-9236-90c746d61ddc tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:59.102128 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4fbb0f26-0b75-4b16-9236-90c746d61ddc tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:59.122244 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-4fbb0f26-0b75-4b16-9236-90c746d61ddc tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] HTTP exception thrown: Instance 2a4de302-ab36-4e7a-90b5-d72d3dc5d698 could not be found. Aug 07 01:12:59.124265 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4fbb0f26-0b75-4b16-9236-90c746d61ddc tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Request method failure captured: Aug 07 01:12:59.124265 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 HTTP/1.1 Aug 07 01:12:59.124265 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:12:59.124265 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:12:59.124265 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:12:59.124265 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:12:59.124265 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:12:59.124265 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:12:59.124265 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:12:59.124265 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:12:59.124265 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xE84VILes2Sb5GK_dpbf6HEwcYfrzldpc1wgaXUys9jS9teIwMJ-k8KBHWUuhtijApM5YC33QkfHRIWzrELTCTUuuWiHSEZz7zM2fUqr974N7uRgX2EinrSGB_CVaau_Xi9uqYvnxrC8s3sW76ND9c0CNlJgSWD4euF30324HZTBIo Aug 07 01:12:59.124265 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:12:59.124265 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:12:59.124265 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:12:59.124265 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:12:59.124265 n-d-master-1 devstack@n-api.service[119516]: X-Openstack-Nova-Api-Version: 2.75 Aug 07 01:12:59.124265 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:12:59.124265 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:12:59.124265 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: b525a2b221d843c0b1ec95a81acc0159 Aug 07 01:12:59.124265 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersAdmin275Test-772925319 Aug 07 01:12:59.124265 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:12:59.124265 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:12:59.126416 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b525a2b221d843c0b1ec95a81acc0159"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b525a2b221d843c0b1ec95a81acc0159", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b525a2b221d843c0b1ec95a81acc0159"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b525a2b221d843c0b1ec95a81acc0159"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:12:59.126416 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersAdmin275Test-772925319 Aug 07 01:12:59.126416 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: b525a2b221d843c0b1ec95a81acc0159 Aug 07 01:12:59.126416 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersAdmin275Test-772925319 Aug 07 01:12:59.126416 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersAdmin275Test-772925319-project Aug 07 01:12:59.126416 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:12:59.126416 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:12:59.126416 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 96da5d25cbbd4653b222290714febb05 Aug 07 01:12:59.126416 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersAdmin275Test-772925319-project Aug 07 01:12:59.126416 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:12:59.126416 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 2a4de302-ab36-4e7a-90b5-d72d3dc5d698 could not be found. Aug 07 01:12:59.126416 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '2a4de302-ab36-4e7a-90b5-d72d3dc5d698'} Aug 07 01:12:59.127158 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:12:59.127158 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:12:59.127158 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:12:59.127158 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:12:59.127158 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:12:59.127158 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:12:59.127158 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:12:59.127158 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:12:59.127158 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:12:59.127158 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:12:59.127158 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a4de302-ab36-4e7a-90b5-d72d3dc5d698 could not be found. Aug 07 01:12:59.127158 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:59.127158 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:12:59.127158 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:59.127158 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:12:59.127158 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:12:59.127158 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:12:59.127158 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:12:59.127158 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:12:59.127158 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:12:59.129694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:12:59.129694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:12:59.129694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:12:59.129694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:12:59.129694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:12:59.129694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:12:59.129694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:12:59.129694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a4de302-ab36-4e7a-90b5-d72d3dc5d698 could not be found. Aug 07 01:12:59.129694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:59.129694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:12:59.129694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:59.129694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:12:59.129694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:12:59.129694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:12:59.129694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:12:59.129694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:12:59.129694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a4de302-ab36-4e7a-90b5-d72d3dc5d698 could not be found. Aug 07 01:12:59.129694 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:12:59.133788 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4fbb0f26-0b75-4b16-9236-90c746d61ddc tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] Returning 404 to user: Instance 2a4de302-ab36-4e7a-90b5-d72d3dc5d698 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:12:59.135269 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4fbb0f26-0b75-4b16-9236-90c746d61ddc tempest-ServersAdmin275Test-772925319 tempest-ServersAdmin275Test-772925319-project] 10.222.0.39 "GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698" status: 404 len: 111 microversion: 2.75 time: 0.067820 Aug 07 01:12:59.138111 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 419/744] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:12:59 2022] GET /compute/v2.1/servers/2a4de302-ab36-4e7a-90b5-d72d3dc5d698 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:12:59.145559 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f0d35844-a93d-48c3-bbd6-f03821df7250 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e24901310>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:59.245522 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f0d35844-a93d-48c3-bbd6-f03821df7250 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d" status: 200 len: 1432 microversion: 2.1 time: 0.097666 Aug 07 01:12:59.246651 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 420/745] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:12:59 2022] GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d => generated 1432 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:59.266767 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-1fed9ae8-7cf4-40a7-880e-6fe6f20094f4 req-00b195b4-6023-4a19-8555-5a360057e5d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f083dc9e-4251-4249-bd6b-12028028484c", "name": "network-vif-deleted", "tag": "046e68ae-d096-484f-bea5-0248b5d25686"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:12:59.295136 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-1fed9ae8-7cf4-40a7-880e-6fe6f20094f4 req-00b195b4-6023-4a19-8555-5a360057e5d7 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:59.296055 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-1fed9ae8-7cf4-40a7-880e-6fe6f20094f4 req-00b195b4-6023-4a19-8555-5a360057e5d7 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:59.297403 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-1fed9ae8-7cf4-40a7-880e-6fe6f20094f4 req-00b195b4-6023-4a19-8555-5a360057e5d7 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:59.346335 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-1fed9ae8-7cf4-40a7-880e-6fe6f20094f4 req-00b195b4-6023-4a19-8555-5a360057e5d7 service nova] Creating event network-vif-deleted:046e68ae-d096-484f-bea5-0248b5d25686 for instance f083dc9e-4251-4249-bd6b-12028028484c on n-h1-master-1 Aug 07 01:12:59.367717 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-1fed9ae8-7cf4-40a7-880e-6fe6f20094f4 req-00b195b4-6023-4a19-8555-5a360057e5d7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118216 Aug 07 01:12:59.368707 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 421/746] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:12:59.388883 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b6cf4a2d-a1cf-4f9d-9e4c-66064e6a1e84 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:59.389942 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b6cf4a2d-a1cf-4f9d-9e4c-66064e6a1e84 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: f083dc9e-4251-4249-bd6b-12028028484c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:59.411586 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b6cf4a2d-a1cf-4f9d-9e4c-66064e6a1e84 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:59.414947 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b6cf4a2d-a1cf-4f9d-9e4c-66064e6a1e84 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:59.415577 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b6cf4a2d-a1cf-4f9d-9e4c-66064e6a1e84 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:59.416378 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b6cf4a2d-a1cf-4f9d-9e4c-66064e6a1e84 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:59.416966 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b6cf4a2d-a1cf-4f9d-9e4c-66064e6a1e84 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:59.417421 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b6cf4a2d-a1cf-4f9d-9e4c-66064e6a1e84 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:59.503204 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b6cf4a2d-a1cf-4f9d-9e4c-66064e6a1e84 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:59.503698 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b6cf4a2d-a1cf-4f9d-9e4c-66064e6a1e84 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:59.504200 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b6cf4a2d-a1cf-4f9d-9e4c-66064e6a1e84 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:59.504721 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-b6cf4a2d-a1cf-4f9d-9e4c-66064e6a1e84 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lazy-loading 'fault' on Instance uuid f083dc9e-4251-4249-bd6b-12028028484c {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:12:59.556940 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b6cf4a2d-a1cf-4f9d-9e4c-66064e6a1e84 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0200a0753e46399d0b212c665aebce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7279db9d4f497b8430fd45280b5da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:59.582076 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b6cf4a2d-a1cf-4f9d-9e4c-66064e6a1e84 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] 10.222.0.39 "GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c" status: 200 len: 1308 microversion: 2.1 time: 0.211716 Aug 07 01:12:59.584182 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 422/747] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:59 2022] GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c => generated 1308 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:59.598755 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dfcf29d6-aaa6-46db-b036-7bffd23c96ba tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:59.599648 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-dfcf29d6-aaa6-46db-b036-7bffd23c96ba tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:59.621001 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dfcf29d6-aaa6-46db-b036-7bffd23c96ba tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:59.623390 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dfcf29d6-aaa6-46db-b036-7bffd23c96ba tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:59.629869 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dfcf29d6-aaa6-46db-b036-7bffd23c96ba tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:59.633849 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dfcf29d6-aaa6-46db-b036-7bffd23c96ba tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:59.634813 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dfcf29d6-aaa6-46db-b036-7bffd23c96ba tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:59.636594 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dfcf29d6-aaa6-46db-b036-7bffd23c96ba tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:59.739728 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-069486aa-8c76-44f3-8eeb-a5c0597889d7 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ec78e02379498e884758d48f5454fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ac8cbc5d64648b03ab13bce91cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:12:59.764775 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-069486aa-8c76-44f3-8eeb-a5c0597889d7 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] 10.222.0.39 "GET /compute/v2.1/servers/3c514622-f3bf-43c5-9713-bd993d6d291c" status: 200 len: 1323 microversion: 2.1 time: 0.781647 Aug 07 01:12:59.769893 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 326/748] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:58 2022] GET /compute/v2.1/servers/3c514622-f3bf-43c5-9713-bd993d6d291c => generated 1323 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:59.782311 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d1b8d5f1-fe53-4c5d-b824-fdeb33babb2a tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e2491f280>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:59.870058 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d1b8d5f1-fe53-4c5d-b824-fdeb33babb2a tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d" status: 200 len: 1432 microversion: 2.1 time: 0.097644 Aug 07 01:12:59.881054 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 327/749] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:12:59 2022] GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d => generated 1432 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:12:59.902157 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-80e9167f-51af-430b-b458-d74316ff21d7 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:12:59.902809 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-80e9167f-51af-430b-b458-d74316ff21d7 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] [instance: a038208d-dae8-432d-97e5-2a58ea093e12] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:12:59.915422 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-80e9167f-51af-430b-b458-d74316ff21d7 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:59.917008 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-80e9167f-51af-430b-b458-d74316ff21d7 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:59.917741 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-80e9167f-51af-430b-b458-d74316ff21d7 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:59.918605 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-80e9167f-51af-430b-b458-d74316ff21d7 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:12:59.919449 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-80e9167f-51af-430b-b458-d74316ff21d7 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:12:59.920264 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-80e9167f-51af-430b-b458-d74316ff21d7 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:12:59.922094 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-dfcf29d6-aaa6-46db-b036-7bffd23c96ba tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d08a2479f847b4b06d6690f1aedb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06211ba44e4f6d88f9095969001aab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:00.003816 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-dfcf29d6-aaa6-46db-b036-7bffd23c96ba tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31" status: 200 len: 1315 microversion: 2.1 time: 0.413218 Aug 07 01:13:00.008935 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 423/750] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:59 2022] GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 => generated 1315 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:00.042347 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f6eee673-9e48-4e8d-a565-893737568c34 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:00.044844 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f6eee673-9e48-4e8d-a565-893737568c34 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 8a19ce68-d784-44a2-b20c-77de1180aba3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:00.064159 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f6eee673-9e48-4e8d-a565-893737568c34 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:00.065462 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f6eee673-9e48-4e8d-a565-893737568c34 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:00.069631 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f6eee673-9e48-4e8d-a565-893737568c34 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:00.070832 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f6eee673-9e48-4e8d-a565-893737568c34 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:00.071555 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f6eee673-9e48-4e8d-a565-893737568c34 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:00.077034 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f6eee673-9e48-4e8d-a565-893737568c34 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:00.491763 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f6eee673-9e48-4e8d-a565-893737568c34 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:00.506293 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f6eee673-9e48-4e8d-a565-893737568c34 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3" status: 200 len: 1325 microversion: 2.1 time: 0.489130 Aug 07 01:13:00.506914 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 424/751] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:00 2022] GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3 => generated 1325 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:00.512742 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7dab1e26-42bd-46ef-a100-c4f870d79a7c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:00.516314 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7dab1e26-42bd-46ef-a100-c4f870d79a7c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:00.533672 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7dab1e26-42bd-46ef-a100-c4f870d79a7c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:00.535072 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7dab1e26-42bd-46ef-a100-c4f870d79a7c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:00.535872 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7dab1e26-42bd-46ef-a100-c4f870d79a7c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:00.538095 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7dab1e26-42bd-46ef-a100-c4f870d79a7c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:00.538819 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7dab1e26-42bd-46ef-a100-c4f870d79a7c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:00.539577 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7dab1e26-42bd-46ef-a100-c4f870d79a7c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:00.791325 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-80e9167f-51af-430b-b458-d74316ff21d7 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0d09d844bf453cb3e2637d630614ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5c39a06e41406a8c6c99d2e84ab282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:00.802187 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-80e9167f-51af-430b-b458-d74316ff21d7 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12" status: 200 len: 1466 microversion: 2.1 time: 0.904985 Aug 07 01:13:00.821310 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 328/752] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:12:59 2022] GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12 => generated 1466 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:13:00.821310 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fa0f6ac0-33e6-4711-a393-820a835f2602 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:00.821310 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fa0f6ac0-33e6-4711-a393-820a835f2602 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: f083dc9e-4251-4249-bd6b-12028028484c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:00.839549 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa0f6ac0-33e6-4711-a393-820a835f2602 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:00.840545 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa0f6ac0-33e6-4711-a393-820a835f2602 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:00.841206 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa0f6ac0-33e6-4711-a393-820a835f2602 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:00.845720 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa0f6ac0-33e6-4711-a393-820a835f2602 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:00.846687 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa0f6ac0-33e6-4711-a393-820a835f2602 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:00.847371 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa0f6ac0-33e6-4711-a393-820a835f2602 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:00.882680 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-fa0f6ac0-33e6-4711-a393-820a835f2602 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] HTTP exception thrown: Instance f083dc9e-4251-4249-bd6b-12028028484c could not be found. Aug 07 01:13:00.886800 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fa0f6ac0-33e6-4711-a393-820a835f2602 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Request method failure captured: Aug 07 01:13:00.886800 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c HTTP/1.1 Aug 07 01:13:00.886800 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:13:00.886800 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:13:00.886800 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:13:00.886800 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:13:00.886800 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:13:00.886800 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:13:00.886800 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:13:00.886800 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:13:00.886800 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xFckBwmEIOALuPkIpYYAkDTwU6lYRvpbDB6FtSj8Sg7lFkIH7TnF3X0kFI6keg6KHVKixmDgybdU5CSPpRMRnjrKcY2sWqy8Bfsv4wJWyLfeTV1EeAaCNlBNIe0sy1bdi1HyEYWw6GpxvEnsWqjAIiNvzr9-QyANPXE6HK7H6tnbrE Aug 07 01:13:00.886800 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:13:00.886800 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:13:00.886800 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:13:00.886800 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:13:00.886800 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:13:00.886800 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:13:00.886800 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 6a7279db9d4f497b8430fd45280b5da4 Aug 07 01:13:00.886800 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-LiveMigrationNegativeTest-371220328 Aug 07 01:13:00.886800 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:13:00.886800 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:13:00.888311 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6a7279db9d4f497b8430fd45280b5da4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6a7279db9d4f497b8430fd45280b5da4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6a7279db9d4f497b8430fd45280b5da4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6a7279db9d4f497b8430fd45280b5da4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:13:00.888311 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-LiveMigrationNegativeTest-371220328 Aug 07 01:13:00.888311 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 6a7279db9d4f497b8430fd45280b5da4 Aug 07 01:13:00.888311 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-371220328 Aug 07 01:13:00.888311 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-LiveMigrationNegativeTest-371220328-project Aug 07 01:13:00.888311 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:13:00.888311 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:13:00.888311 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: cc0200a0753e46399d0b212c665aebce Aug 07 01:13:00.888311 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-LiveMigrationNegativeTest-371220328-project Aug 07 01:13:00.888311 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:13:00.888311 n-d-master-1 devstack@n-api.service[119517]: exception: Instance f083dc9e-4251-4249-bd6b-12028028484c could not be found. Aug 07 01:13:00.888311 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'f083dc9e-4251-4249-bd6b-12028028484c'} Aug 07 01:13:00.889121 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:13:00.889121 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:00.889121 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:13:00.889121 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:13:00.889121 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:13:00.889121 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:13:00.889121 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:13:00.889121 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:13:00.889121 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:13:00.889121 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:13:00.889121 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f083dc9e-4251-4249-bd6b-12028028484c could not be found. Aug 07 01:13:00.889121 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:00.889121 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:13:00.889121 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:00.889121 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:00.889121 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:13:00.889121 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:13:00.889121 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:13:00.889121 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:13:00.889121 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:13:00.890713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:13:00.890713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:13:00.890713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:13:00.890713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:13:00.890713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:13:00.890713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:13:00.890713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:13:00.890713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f083dc9e-4251-4249-bd6b-12028028484c could not be found. Aug 07 01:13:00.890713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:00.890713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:13:00.890713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:00.890713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:00.890713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:13:00.890713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:13:00.890713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:13:00.890713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:13:00.890713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f083dc9e-4251-4249-bd6b-12028028484c could not be found. Aug 07 01:13:00.890713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:00.897631 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fa0f6ac0-33e6-4711-a393-820a835f2602 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Returning 404 to user: Instance f083dc9e-4251-4249-bd6b-12028028484c could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:13:00.902801 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fa0f6ac0-33e6-4711-a393-820a835f2602 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] 10.222.0.39 "GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c" status: 404 len: 111 microversion: 2.1 time: 0.090564 Aug 07 01:13:00.906976 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 329/753] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:00 2022] GET /compute/v2.1/servers/f083dc9e-4251-4249-bd6b-12028028484c => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:13:00.915168 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-383e5528-532e-4e05-9d64-48eded49b28d tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:00.920397 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-383e5528-532e-4e05-9d64-48eded49b28d tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] [instance: 3c514622-f3bf-43c5-9713-bd993d6d291c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:00.937971 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-383e5528-532e-4e05-9d64-48eded49b28d tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:00.938933 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-383e5528-532e-4e05-9d64-48eded49b28d tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:00.939727 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-383e5528-532e-4e05-9d64-48eded49b28d tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:00.940815 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-383e5528-532e-4e05-9d64-48eded49b28d tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:00.941523 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-383e5528-532e-4e05-9d64-48eded49b28d tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:00.943747 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-383e5528-532e-4e05-9d64-48eded49b28d tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:00.964608 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:01.059964 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7dab1e26-42bd-46ef-a100-c4f870d79a7c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:01.075048 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7dab1e26-42bd-46ef-a100-c4f870d79a7c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79" status: 200 len: 1505 microversion: 2.1 time: 0.566383 Aug 07 01:13:01.076975 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 425/754] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:00 2022] GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79 => generated 1505 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:01.091106 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cd6ac75f-ed97-4eef-b92e-e90142b97a6d tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e2508f3a0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:01.180218 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cd6ac75f-ed97-4eef-b92e-e90142b97a6d tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/e825bd61-bf05-4bd4-aa72-78daf2231731" status: 200 len: 784 microversion: 2.1 time: 0.101776 Aug 07 01:13:01.182390 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 426/755] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:13:01 2022] GET /compute/v2.1/images/e825bd61-bf05-4bd4-aa72-78daf2231731 => generated 784 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:13:01.188452 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2425e508-981b-4a87-9271-d1ba7c909835 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:01.189359 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2425e508-981b-4a87-9271-d1ba7c909835 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: b8d0c259-b533-4396-b916-8861a321b930] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:01.214971 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2425e508-981b-4a87-9271-d1ba7c909835 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:01.215816 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2425e508-981b-4a87-9271-d1ba7c909835 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:01.217604 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2425e508-981b-4a87-9271-d1ba7c909835 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:01.218726 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2425e508-981b-4a87-9271-d1ba7c909835 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:01.219369 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2425e508-981b-4a87-9271-d1ba7c909835 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:01.219983 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2425e508-981b-4a87-9271-d1ba7c909835 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:01.286317 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2425e508-981b-4a87-9271-d1ba7c909835 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: b8d0c259-b533-4396-b916-8861a321b930] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:13:01.573095 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2425e508-981b-4a87-9271-d1ba7c909835 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b8d0c259-b533-4396-b916-8861a321b930" status: 204 len: 0 microversion: 2.1 time: 0.385596 Aug 07 01:13:01.575898 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 427/756] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:13:01 2022] DELETE /compute/v2.1/servers/b8d0c259-b533-4396-b916-8861a321b930 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:13:01.591379 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cbcb216a-ece4-4212-b050-2c04eb781363 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:01.597378 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cbcb216a-ece4-4212-b050-2c04eb781363 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:01.619779 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cbcb216a-ece4-4212-b050-2c04eb781363 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:01.621746 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cbcb216a-ece4-4212-b050-2c04eb781363 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:01.623470 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cbcb216a-ece4-4212-b050-2c04eb781363 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:01.625807 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cbcb216a-ece4-4212-b050-2c04eb781363 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:01.627225 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cbcb216a-ece4-4212-b050-2c04eb781363 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:01.628637 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cbcb216a-ece4-4212-b050-2c04eb781363 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:01.748707 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cbcb216a-ece4-4212-b050-2c04eb781363 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d08a2479f847b4b06d6690f1aedb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06211ba44e4f6d88f9095969001aab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:01.767558 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cbcb216a-ece4-4212-b050-2c04eb781363 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31" status: 200 len: 1321 microversion: 2.1 time: 0.189546 Aug 07 01:13:01.768991 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 428/757] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:01 2022] GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:01.778918 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b718db82-264c-4417-b23a-a35d19daf1b8 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:01.795380 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b718db82-264c-4417-b23a-a35d19daf1b8 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024349 Aug 07 01:13:01.808480 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 429/758] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Aug 7 01:13:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:13:01.815143 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0da619ed-62d2-41a5-838e-59d39b660e96 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:01.816265 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0da619ed-62d2-41a5-838e-59d39b660e96 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 8a19ce68-d784-44a2-b20c-77de1180aba3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:01.827603 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:01.831567 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0da619ed-62d2-41a5-838e-59d39b660e96 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:01.832973 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0da619ed-62d2-41a5-838e-59d39b660e96 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:01.834024 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0da619ed-62d2-41a5-838e-59d39b660e96 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:01.835950 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0da619ed-62d2-41a5-838e-59d39b660e96 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:01.836877 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0da619ed-62d2-41a5-838e-59d39b660e96 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:01.838086 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0da619ed-62d2-41a5-838e-59d39b660e96 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:02.453793 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-383e5528-532e-4e05-9d64-48eded49b28d tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ec78e02379498e884758d48f5454fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ac8cbc5d64648b03ab13bce91cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:02.493846 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-383e5528-532e-4e05-9d64-48eded49b28d tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] 10.222.0.39 "GET /compute/v2.1/servers/3c514622-f3bf-43c5-9713-bd993d6d291c" status: 200 len: 1473 microversion: 2.1 time: 1.584864 Aug 07 01:13:02.496298 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 330/759] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:00 2022] GET /compute/v2.1/servers/3c514622-f3bf-43c5-9713-bd993d6d291c => generated 1473 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:02.515254 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-04317f29-082e-407b-9b8c-03ff54a81dc7 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:02.517331 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-04317f29-082e-407b-9b8c-03ff54a81dc7 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: b8d0c259-b533-4396-b916-8861a321b930] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:02.531039 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-04317f29-082e-407b-9b8c-03ff54a81dc7 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:02.532552 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-04317f29-082e-407b-9b8c-03ff54a81dc7 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:02.533912 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-04317f29-082e-407b-9b8c-03ff54a81dc7 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:02.535629 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-04317f29-082e-407b-9b8c-03ff54a81dc7 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:02.536771 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-04317f29-082e-407b-9b8c-03ff54a81dc7 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:02.537401 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-04317f29-082e-407b-9b8c-03ff54a81dc7 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:02.673082 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0da619ed-62d2-41a5-838e-59d39b660e96 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:02.677833 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:02.697294 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0da619ed-62d2-41a5-838e-59d39b660e96 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3" status: 200 len: 1521 microversion: 2.1 time: 0.896651 Aug 07 01:13:02.701374 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 430/760] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:01 2022] GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3 => generated 1521 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:02.716930 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-11935b72-1e6d-46d1-a0c0-25ca01d552f3 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e249aa5e0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:03.180325 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-04317f29-082e-407b-9b8c-03ff54a81dc7 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0200a0753e46399d0b212c665aebce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7279db9d4f497b8430fd45280b5da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:03.194517 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-04317f29-082e-407b-9b8c-03ff54a81dc7 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] 10.222.0.39 "GET /compute/v2.1/servers/b8d0c259-b533-4396-b916-8861a321b930" status: 200 len: 1474 microversion: 2.1 time: 0.695972 Aug 07 01:13:03.200435 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 331/761] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:02 2022] GET /compute/v2.1/servers/b8d0c259-b533-4396-b916-8861a321b930 => generated 1474 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:03.213612 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-71fcf27b-dafb-4d18-8d9a-54d2f23c05be tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:03.214367 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-71fcf27b-dafb-4d18-8d9a-54d2f23c05be tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:03.257044 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-71fcf27b-dafb-4d18-8d9a-54d2f23c05be tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:03.257961 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-71fcf27b-dafb-4d18-8d9a-54d2f23c05be tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:03.259300 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-71fcf27b-dafb-4d18-8d9a-54d2f23c05be tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:03.260557 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-71fcf27b-dafb-4d18-8d9a-54d2f23c05be tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:03.261321 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-71fcf27b-dafb-4d18-8d9a-54d2f23c05be tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:03.262047 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-71fcf27b-dafb-4d18-8d9a-54d2f23c05be tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:04.558697 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-11935b72-1e6d-46d1-a0c0-25ca01d552f3 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "DELETE /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d" status: 204 len: 0 microversion: 2.1 time: 1.855685 Aug 07 01:13:04.559346 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 431/762] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:02 2022] DELETE /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d => generated 0 bytes in 1857 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:13:04.569913 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-8c8e7329-b08b-4689-89c5-7c37fe849029 req-34e7cb79-edaa-4181-a657-0efb8299f485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ab29f8e-4b84-4038-a60f-efc93d0358ce", "name": "network-vif-deleted", "tag": "3a899aee-00e7-47c8-925e-16279648d5d3"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:04.584620 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-8c8e7329-b08b-4689-89c5-7c37fe849029 req-34e7cb79-edaa-4181-a657-0efb8299f485 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:04.585216 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-8c8e7329-b08b-4689-89c5-7c37fe849029 req-34e7cb79-edaa-4181-a657-0efb8299f485 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:04.585778 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-8c8e7329-b08b-4689-89c5-7c37fe849029 req-34e7cb79-edaa-4181-a657-0efb8299f485 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:04.617612 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-8c8e7329-b08b-4689-89c5-7c37fe849029 req-34e7cb79-edaa-4181-a657-0efb8299f485 service nova] Creating event network-vif-deleted:3a899aee-00e7-47c8-925e-16279648d5d3 for instance 7ab29f8e-4b84-4038-a60f-efc93d0358ce on n-h2-master-1 Aug 07 01:13:04.630319 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-8c8e7329-b08b-4689-89c5-7c37fe849029 req-34e7cb79-edaa-4181-a657-0efb8299f485 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065024 Aug 07 01:13:04.634296 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 432/763] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:13:04.652138 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-af051e89-45e0-44e8-a70d-7d40a7fb98f4 req-d9747eda-c402-478e-ae64-4d8951c9d86f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a038208d-dae8-432d-97e5-2a58ea093e12", "name": "network-vif-unplugged", "status": "completed", "tag": "34e132f0-6845-4fef-bc5f-494eced57c6a"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:04.667994 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-af051e89-45e0-44e8-a70d-7d40a7fb98f4 req-d9747eda-c402-478e-ae64-4d8951c9d86f service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:04.668421 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-af051e89-45e0-44e8-a70d-7d40a7fb98f4 req-d9747eda-c402-478e-ae64-4d8951c9d86f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:04.668950 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-af051e89-45e0-44e8-a70d-7d40a7fb98f4 req-d9747eda-c402-478e-ae64-4d8951c9d86f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:04.691251 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-71fcf27b-dafb-4d18-8d9a-54d2f23c05be tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:04.701425 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-af051e89-45e0-44e8-a70d-7d40a7fb98f4 req-d9747eda-c402-478e-ae64-4d8951c9d86f service nova] Creating event network-vif-unplugged:34e132f0-6845-4fef-bc5f-494eced57c6a for instance a038208d-dae8-432d-97e5-2a58ea093e12 on n-h2-master-1 Aug 07 01:13:04.714150 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-af051e89-45e0-44e8-a70d-7d40a7fb98f4 req-d9747eda-c402-478e-ae64-4d8951c9d86f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070777 Aug 07 01:13:04.716000 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 433/764] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:13:04.725280 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1d9ef840-3187-4503-a4ba-ca5412f3cf12 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:04.726237 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1d9ef840-3187-4503-a4ba-ca5412f3cf12 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] [instance: 3c514622-f3bf-43c5-9713-bd993d6d291c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:04.730669 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-71fcf27b-dafb-4d18-8d9a-54d2f23c05be tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79" status: 200 len: 1505 microversion: 2.1 time: 1.528844 Aug 07 01:13:04.731287 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 332/765] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:03 2022] GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79 => generated 1505 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:04.735171 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d9ef840-3187-4503-a4ba-ca5412f3cf12 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:04.736106 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d9ef840-3187-4503-a4ba-ca5412f3cf12 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:04.736512 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d9ef840-3187-4503-a4ba-ca5412f3cf12 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:04.737239 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d9ef840-3187-4503-a4ba-ca5412f3cf12 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:04.737700 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d9ef840-3187-4503-a4ba-ca5412f3cf12 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:04.738127 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d9ef840-3187-4503-a4ba-ca5412f3cf12 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:04.755947 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f29fe57e-9bc0-4139-83e9-ce796f2366eb tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:04.766541 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f29fe57e-9bc0-4139-83e9-ce796f2366eb tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 8a19ce68-d784-44a2-b20c-77de1180aba3] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:04.785076 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f29fe57e-9bc0-4139-83e9-ce796f2366eb tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:04.786159 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f29fe57e-9bc0-4139-83e9-ce796f2366eb tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:04.786826 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f29fe57e-9bc0-4139-83e9-ce796f2366eb tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:04.787866 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f29fe57e-9bc0-4139-83e9-ce796f2366eb tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:04.788593 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f29fe57e-9bc0-4139-83e9-ce796f2366eb tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:04.789228 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f29fe57e-9bc0-4139-83e9-ce796f2366eb tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:04.815322 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1d9ef840-3187-4503-a4ba-ca5412f3cf12 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '80ec78e02379498e884758d48f5454fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ac8cbc5d64648b03ab13bce91cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:04.829011 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1d9ef840-3187-4503-a4ba-ca5412f3cf12 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Request method failure captured: Aug 07 01:13:04.829011 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/3c514622-f3bf-43c5-9713-bd993d6d291c/diagnostics HTTP/1.1 Aug 07 01:13:04.829011 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:13:04.829011 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:13:04.829011 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:13:04.829011 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:13:04.829011 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:13:04.829011 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:13:04.829011 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:13:04.829011 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:13:04.829011 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xF_0oWtRjIDdI9Vg2pZqjAt40mWQrxILJYSXfT9p8TxTk0xD_g08CYsw2H08qmy-ckokcWtnnaJXM179_sU3OpBXqm0qfWfmBwn6XhkYtfHhdjY7vgA5hsr3pyXrGv8fD-X5JqTYPj0fr4b4Njd7wkbXKanObNCdLxax7-YWojimdM Aug 07 01:13:04.829011 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:13:04.829011 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:13:04.829011 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:13:04.829011 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:13:04.829011 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:13:04.829011 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:13:04.829011 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 380ac8cbc5d64648b03ab13bce91cfe4 Aug 07 01:13:04.829011 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-497448315 Aug 07 01:13:04.829011 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:13:04.829011 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:13:04.830525 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/380ac8cbc5d64648b03ab13bce91cfe4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_380ac8cbc5d64648b03ab13bce91cfe4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/380ac8cbc5d64648b03ab13bce91cfe4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/380ac8cbc5d64648b03ab13bce91cfe4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:13:04.830525 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-497448315 Aug 07 01:13:04.830525 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 380ac8cbc5d64648b03ab13bce91cfe4 Aug 07 01:13:04.830525 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-497448315 Aug 07 01:13:04.830525 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServerDiagnosticsNegativeTest-497448315-project Aug 07 01:13:04.830525 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:13:04.830525 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:13:04.830525 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 80ec78e02379498e884758d48f5454fd Aug 07 01:13:04.830525 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-497448315-project Aug 07 01:13:04.830525 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:13:04.830525 n-d-master-1 devstack@n-api.service[119516]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 07 01:13:04.831326 n-d-master-1 devstack@n-api.service[119516]: action_args: {'server_id': '3c514622-f3bf-43c5-9713-bd993d6d291c'} Aug 07 01:13:04.831326 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:13:04.831326 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:04.831326 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:13:04.831326 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:13:04.831326 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:13:04.831326 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:13:04.831326 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:13:04.831326 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:13:04.831326 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 07 01:13:04.831326 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 07 01:13:04.831326 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 07 01:13:04.831326 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 07 01:13:04.831326 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 07 01:13:04.831326 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 07 01:13:04.831326 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:13:04.831326 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:13:04.831326 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:13:04.831326 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:13:04.831326 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 07 01:13:04.833575 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 07 01:13:04.833575 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 07 01:13:04.833575 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 07 01:13:04.833575 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 07 01:13:04.833575 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 07 01:13:04.833575 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 07 01:13:04.833575 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:13:04.833575 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:13:04.833575 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:13:04.833575 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:04.833575 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:13:04.833575 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:13:04.833575 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 07 01:13:04.833575 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 07 01:13:04.833575 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 07 01:13:04.833575 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:13:04.847574 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1d9ef840-3187-4503-a4ba-ca5412f3cf12 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:13:04.848790 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1d9ef840-3187-4503-a4ba-ca5412f3cf12 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] 10.222.0.39 "GET /compute/v2.1/servers/3c514622-f3bf-43c5-9713-bd993d6d291c/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.130684 Aug 07 01:13:04.851746 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 434/766] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:13:04 2022] GET /compute/v2.1/servers/3c514622-f3bf-43c5-9713-bd993d6d291c/diagnostics => generated 117 bytes in 135 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:13:04.856745 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8b2ff8b3-4271-4158-8483-e7c9f48e75b8 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:04.857607 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8b2ff8b3-4271-4158-8483-e7c9f48e75b8 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:04.867072 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b2ff8b3-4271-4158-8483-e7c9f48e75b8 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:04.867798 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b2ff8b3-4271-4158-8483-e7c9f48e75b8 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:04.868462 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b2ff8b3-4271-4158-8483-e7c9f48e75b8 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:04.869399 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b2ff8b3-4271-4158-8483-e7c9f48e75b8 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:04.870049 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b2ff8b3-4271-4158-8483-e7c9f48e75b8 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:04.870678 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b2ff8b3-4271-4158-8483-e7c9f48e75b8 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:05.067186 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8b2ff8b3-4271-4158-8483-e7c9f48e75b8 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d08a2479f847b4b06d6690f1aedb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06211ba44e4f6d88f9095969001aab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:05.077571 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8b2ff8b3-4271-4158-8483-e7c9f48e75b8 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31" status: 200 len: 1388 microversion: 2.1 time: 0.224383 Aug 07 01:13:05.078463 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 435/767] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:04 2022] GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 => generated 1388 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:05.083301 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2bac6cfd-8823-4d95-8df4-da13ef929dfb tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:05.084208 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2bac6cfd-8823-4d95-8df4-da13ef929dfb tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: b8d0c259-b533-4396-b916-8861a321b930] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:05.091266 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2bac6cfd-8823-4d95-8df4-da13ef929dfb tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:05.092111 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2bac6cfd-8823-4d95-8df4-da13ef929dfb tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:05.092749 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2bac6cfd-8823-4d95-8df4-da13ef929dfb tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:05.093713 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2bac6cfd-8823-4d95-8df4-da13ef929dfb tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:05.094543 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2bac6cfd-8823-4d95-8df4-da13ef929dfb tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:05.095128 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2bac6cfd-8823-4d95-8df4-da13ef929dfb tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:05.174271 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2bac6cfd-8823-4d95-8df4-da13ef929dfb tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:05.180208 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2bac6cfd-8823-4d95-8df4-da13ef929dfb tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:05.181089 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2bac6cfd-8823-4d95-8df4-da13ef929dfb tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:05.182364 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-2bac6cfd-8823-4d95-8df4-da13ef929dfb tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lazy-loading 'fault' on Instance uuid b8d0c259-b533-4396-b916-8861a321b930 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:13:05.266710 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2bac6cfd-8823-4d95-8df4-da13ef929dfb tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc0200a0753e46399d0b212c665aebce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7279db9d4f497b8430fd45280b5da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:05.283677 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2bac6cfd-8823-4d95-8df4-da13ef929dfb tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] 10.222.0.39 "GET /compute/v2.1/servers/b8d0c259-b533-4396-b916-8861a321b930" status: 200 len: 1309 microversion: 2.1 time: 0.203915 Aug 07 01:13:05.284831 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 436/768] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:05 2022] GET /compute/v2.1/servers/b8d0c259-b533-4396-b916-8861a321b930 => generated 1309 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:05.295407 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-226532e6-bb1a-491a-a55d-f512ae52e27b req-986e2d01-2305-40a3-bcb7-cf71875a3eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8d0c259-b533-4396-b916-8861a321b930", "name": "network-vif-deleted", "tag": "fdb8dc2b-c46d-407e-98a9-a59700aa7ef9"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:05.321012 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f29fe57e-9bc0-4139-83e9-ce796f2366eb tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:05.332604 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-226532e6-bb1a-491a-a55d-f512ae52e27b req-986e2d01-2305-40a3-bcb7-cf71875a3eb9 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:05.333791 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-226532e6-bb1a-491a-a55d-f512ae52e27b req-986e2d01-2305-40a3-bcb7-cf71875a3eb9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:05.334766 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-226532e6-bb1a-491a-a55d-f512ae52e27b req-986e2d01-2305-40a3-bcb7-cf71875a3eb9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:05.336377 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f29fe57e-9bc0-4139-83e9-ce796f2366eb tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3" status: 200 len: 1521 microversion: 2.1 time: 0.591894 Aug 07 01:13:05.338698 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 333/769] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:04 2022] GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3 => generated 1521 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:05.350354 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-15ebe6d9-a0ae-47be-affd-509bb0fe73d4 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e24a72670>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:05.369896 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-226532e6-bb1a-491a-a55d-f512ae52e27b req-986e2d01-2305-40a3-bcb7-cf71875a3eb9 service nova] Creating event network-vif-deleted:fdb8dc2b-c46d-407e-98a9-a59700aa7ef9 for instance b8d0c259-b533-4396-b916-8861a321b930 on n-h1-master-1 Aug 07 01:13:05.379207 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-226532e6-bb1a-491a-a55d-f512ae52e27b req-986e2d01-2305-40a3-bcb7-cf71875a3eb9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092675 Aug 07 01:13:05.380164 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 437/770] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:13:05.386951 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-591f87bb-633c-4db4-a104-0b16222923b4 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:05.387559 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-591f87bb-633c-4db4-a104-0b16222923b4 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] [instance: 3c514622-f3bf-43c5-9713-bd993d6d291c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:05.399630 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-591f87bb-633c-4db4-a104-0b16222923b4 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:05.400164 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-591f87bb-633c-4db4-a104-0b16222923b4 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:05.400609 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-591f87bb-633c-4db4-a104-0b16222923b4 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:05.403435 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-591f87bb-633c-4db4-a104-0b16222923b4 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:05.404558 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-591f87bb-633c-4db4-a104-0b16222923b4 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:05.405041 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-591f87bb-633c-4db4-a104-0b16222923b4 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:05.421028 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-15ebe6d9-a0ae-47be-affd-509bb0fe73d4 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] HTTP exception thrown: Image not found. Aug 07 01:13:05.424886 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-15ebe6d9-a0ae-47be-affd-509bb0fe73d4 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Request method failure captured: Aug 07 01:13:05.424886 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d HTTP/1.1 Aug 07 01:13:05.424886 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:13:05.424886 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:13:05.424886 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:13:05.424886 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:13:05.424886 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:13:05.424886 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:13:05.424886 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:13:05.424886 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:13:05.424886 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xFjz4u4j5u9kNswDo-D12DJ8tRiIswFGL9PG7hQ7y2ZFN6Er5kEWktOXjnXtVLm8ktdGL6AIsQYTMefhxRIvRTmxaDH0DH1hwYIs4Age2C7TaE2eHvKZlZATBVV_Va54W7xobEYT-s4D7jcR6KLjG1DePdsxZd6CDImLQRSswYzXh4 Aug 07 01:13:05.424886 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:13:05.424886 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:13:05.424886 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:13:05.424886 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:13:05.424886 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:13:05.424886 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:13:05.424886 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: dc5c39a06e41406a8c6c99d2e84ab282 Aug 07 01:13:05.424886 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ImagesOneServerTestJSON-1061526834 Aug 07 01:13:05.424886 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:13:05.424886 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:13:05.426300 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/dc5c39a06e41406a8c6c99d2e84ab282"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_dc5c39a06e41406a8c6c99d2e84ab282", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/dc5c39a06e41406a8c6c99d2e84ab282"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/dc5c39a06e41406a8c6c99d2e84ab282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:13:05.426300 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ImagesOneServerTestJSON-1061526834 Aug 07 01:13:05.426300 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: dc5c39a06e41406a8c6c99d2e84ab282 Aug 07 01:13:05.426300 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1061526834 Aug 07 01:13:05.426300 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ImagesOneServerTestJSON-1061526834-project Aug 07 01:13:05.426300 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:13:05.426300 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:13:05.426300 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 1d0d09d844bf453cb3e2637d630614ff Aug 07 01:13:05.426300 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ImagesOneServerTestJSON-1061526834-project Aug 07 01:13:05.426300 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:13:05.426300 n-d-master-1 devstack@n-api.service[119517]: exception: Image not found. Aug 07 01:13:05.426300 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '0fd54428-9fef-4317-9bc2-59cb9a0c807d'} Aug 07 01:13:05.426300 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:13:05.427136 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:05.427136 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 07 01:13:05.427136 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 07 01:13:05.427136 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 07 01:13:05.427136 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 07 01:13:05.427136 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 07 01:13:05.427136 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 07 01:13:05.427136 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 07 01:13:05.427136 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 07 01:13:05.427136 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 07 01:13:05.427136 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 07 01:13:05.427136 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 07 01:13:05.427136 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 07 01:13:05.427136 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 07 01:13:05.427136 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 07 01:13:05.427136 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 07 01:13:05.427136 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 07 01:13:05.427136 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0fd54428-9fef-4317-9bc2-59cb9a0c807d Aug 07 01:13:05.428238 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:05.428238 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:13:05.428238 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:05.428238 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:05.428238 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 07 01:13:05.428238 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 07 01:13:05.428238 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 07 01:13:05.428238 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 07 01:13:05.428238 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 07 01:13:05.428238 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 07 01:13:05.428238 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 07 01:13:05.428238 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 07 01:13:05.428238 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 07 01:13:05.428238 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 07 01:13:05.428238 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 07 01:13:05.428238 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 07 01:13:05.428238 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 07 01:13:05.428238 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 07 01:13:05.428238 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 07 01:13:05.428238 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 07 01:13:05.431642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 07 01:13:05.431642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 07 01:13:05.431642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 07 01:13:05.431642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 07 01:13:05.431642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 07 01:13:05.431642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 07 01:13:05.431642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 07 01:13:05.431642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 07 01:13:05.431642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0fd54428-9fef-4317-9bc2-59cb9a0c807d could not be found. Aug 07 01:13:05.431642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:05.431642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:13:05.431642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:05.431642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:05.431642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:13:05.431642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:13:05.431642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:13:05.431642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:13:05.431642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:13:05.431642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:13:05.434315 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:13:05.434315 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:13:05.434315 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 07 01:13:05.434315 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 07 01:13:05.434315 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 07 01:13:05.434315 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:05.434315 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:13:05.434315 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:05.434315 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:05.434315 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:13:05.434315 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:13:05.434315 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:13:05.434315 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:13:05.434315 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 07 01:13:05.434315 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:05.437566 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-15ebe6d9-a0ae-47be-affd-509bb0fe73d4 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Returning 404 to user: Image not found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:13:05.440155 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-15ebe6d9-a0ae-47be-affd-509bb0fe73d4 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d" status: 404 len: 62 microversion: 2.1 time: 0.098440 Aug 07 01:13:05.452203 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 334/771] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:13:05 2022] GET /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d => generated 62 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:13:05.454921 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-591f87bb-633c-4db4-a104-0b16222923b4 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] [instance: 3c514622-f3bf-43c5-9713-bd993d6d291c] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:13:05.466475 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-94b1231d-8567-45d6-9efb-a241338ef049 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-737654775"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:05.470021 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-94b1231d-8567-45d6-9efb-a241338ef049 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 8a19ce68-d784-44a2-b20c-77de1180aba3] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:05.482907 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94b1231d-8567-45d6-9efb-a241338ef049 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:05.484355 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94b1231d-8567-45d6-9efb-a241338ef049 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:05.485067 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94b1231d-8567-45d6-9efb-a241338ef049 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:05.486141 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94b1231d-8567-45d6-9efb-a241338ef049 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:05.486840 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94b1231d-8567-45d6-9efb-a241338ef049 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:05.487488 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94b1231d-8567-45d6-9efb-a241338ef049 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:05.650607 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-591f87bb-633c-4db4-a104-0b16222923b4 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3c514622-f3bf-43c5-9713-bd993d6d291c" status: 204 len: 0 microversion: 2.1 time: 0.268765 Aug 07 01:13:05.651784 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 438/772] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:13:05 2022] DELETE /compute/v2.1/servers/3c514622-f3bf-43c5-9713-bd993d6d291c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:13:05.665476 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ded9d519-28b4-42a5-bf83-eb04378eb56f tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1618867832"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:05.669363 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ded9d519-28b4-42a5-bf83-eb04378eb56f tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] [instance: a038208d-dae8-432d-97e5-2a58ea093e12] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:05.697263 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ded9d519-28b4-42a5-bf83-eb04378eb56f tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:05.698942 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ded9d519-28b4-42a5-bf83-eb04378eb56f tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:05.699608 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ded9d519-28b4-42a5-bf83-eb04378eb56f tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:05.700610 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ded9d519-28b4-42a5-bf83-eb04378eb56f tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:05.703117 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ded9d519-28b4-42a5-bf83-eb04378eb56f tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:05.704205 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ded9d519-28b4-42a5-bf83-eb04378eb56f tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:05.825339 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-94b1231d-8567-45d6-9efb-a241338ef049 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "POST /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3/action" status: 202 len: 0 microversion: 2.1 time: 0.372216 Aug 07 01:13:05.826352 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 335/773] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:13:05 2022] POST /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3/action => generated 0 bytes in 377 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 07 01:13:05.835228 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d1599e33-0741-4628-98cb-c1d60b8ad855 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:05.836019 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d1599e33-0741-4628-98cb-c1d60b8ad855 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] [instance: 3c514622-f3bf-43c5-9713-bd993d6d291c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:05.847656 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1599e33-0741-4628-98cb-c1d60b8ad855 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:05.848498 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1599e33-0741-4628-98cb-c1d60b8ad855 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:05.849666 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1599e33-0741-4628-98cb-c1d60b8ad855 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:05.851074 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1599e33-0741-4628-98cb-c1d60b8ad855 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:05.851981 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1599e33-0741-4628-98cb-c1d60b8ad855 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:05.852735 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1599e33-0741-4628-98cb-c1d60b8ad855 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:06.015796 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ded9d519-28b4-42a5-bf83-eb04378eb56f tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "POST /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12/action" status: 202 len: 0 microversion: 2.1 time: 0.362107 Aug 07 01:13:06.016489 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 439/774] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:13:05 2022] POST /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12/action => generated 0 bytes in 364 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 07 01:13:06.023326 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-94e80709-eedd-425a-9d8a-8d2280b2ac28 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:06.025612 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-94e80709-eedd-425a-9d8a-8d2280b2ac28 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:06.038267 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94e80709-eedd-425a-9d8a-8d2280b2ac28 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:06.039383 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94e80709-eedd-425a-9d8a-8d2280b2ac28 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:06.040402 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94e80709-eedd-425a-9d8a-8d2280b2ac28 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:06.041904 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94e80709-eedd-425a-9d8a-8d2280b2ac28 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:06.042669 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94e80709-eedd-425a-9d8a-8d2280b2ac28 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:06.043305 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94e80709-eedd-425a-9d8a-8d2280b2ac28 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:06.177290 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d1599e33-0741-4628-98cb-c1d60b8ad855 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ec78e02379498e884758d48f5454fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ac8cbc5d64648b03ab13bce91cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:06.188606 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d1599e33-0741-4628-98cb-c1d60b8ad855 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] 10.222.0.39 "GET /compute/v2.1/servers/3c514622-f3bf-43c5-9713-bd993d6d291c" status: 200 len: 1479 microversion: 2.1 time: 0.360920 Aug 07 01:13:06.202093 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 336/775] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:05 2022] GET /compute/v2.1/servers/3c514622-f3bf-43c5-9713-bd993d6d291c => generated 1479 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:06.207319 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ca3c7f37-1304-45b7-9321-732a552e1173 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '.version_select at 0x7f9e24900040>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:06.239148 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-94e80709-eedd-425a-9d8a-8d2280b2ac28 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:06.245875 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-94e80709-eedd-425a-9d8a-8d2280b2ac28 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79" status: 200 len: 1480 microversion: 2.1 time: 0.227924 Aug 07 01:13:06.246753 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 440/776] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:06 2022] GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79 => generated 1480 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:06.264264 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-af8e799d-5916-46de-8f8c-7f13b6550962 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e24919d30>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:06.359345 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-af8e799d-5916-46de-8f8c-7f13b6550962 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/44b163c4-972b-45e4-b79b-00e80eb0b2da" status: 200 len: 1429 microversion: 2.1 time: 0.111054 Aug 07 01:13:06.361609 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 441/777] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:13:06 2022] GET /compute/v2.1/images/44b163c4-972b-45e4-b79b-00e80eb0b2da => generated 1429 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:06.377199 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2cd4458b-9518-460e-a385-21465ceb3718 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:06.378952 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2cd4458b-9518-460e-a385-21465ceb3718 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:06.386758 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2cd4458b-9518-460e-a385-21465ceb3718 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:06.387911 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2cd4458b-9518-460e-a385-21465ceb3718 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:06.388574 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2cd4458b-9518-460e-a385-21465ceb3718 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:06.390146 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2cd4458b-9518-460e-a385-21465ceb3718 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:06.390846 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2cd4458b-9518-460e-a385-21465ceb3718 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:06.391720 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2cd4458b-9518-460e-a385-21465ceb3718 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:06.498403 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ca3c7f37-1304-45b7-9321-732a552e1173 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "DELETE /compute/v2.1/images/2a7f0cf4-0b12-4420-b96f-08be56c9fe71" status: 204 len: 0 microversion: 2.1 time: 0.294276 Aug 07 01:13:06.500166 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 337/778] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:06 2022] DELETE /compute/v2.1/images/2a7f0cf4-0b12-4420-b96f-08be56c9fe71 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:13:06.509533 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-201aa637-579b-4e86-9daf-f26c78c4cdd7 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Calling method '.version_select at 0x7f9e24aa7940>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:06.518389 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-201aa637-579b-4e86-9daf-f26c78c4cdd7 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:06.519225 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-201aa637-579b-4e86-9daf-f26c78c4cdd7 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:06.521314 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-201aa637-579b-4e86-9daf-f26c78c4cdd7 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:06.540024 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-201aa637-579b-4e86-9daf-f26c78c4cdd7 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 782 microversion: 2.1 time: 0.037699 Aug 07 01:13:06.541953 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 338/779] 10.222.0.39 () {58 vars in 1143 bytes} [Sun Aug 7 01:13:06 2022] GET /compute/v2.1/os-migrations => generated 782 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:13:06.557426 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-15c0370f-f4b9-45ff-b772-97038b0ec405 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:06.558586 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-15c0370f-f4b9-45ff-b772-97038b0ec405 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] [instance: b8d0c259-b533-4396-b916-8861a321b930] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:06.561799 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2cd4458b-9518-460e-a385-21465ceb3718 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d08a2479f847b4b06d6690f1aedb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06211ba44e4f6d88f9095969001aab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:06.569990 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15c0370f-f4b9-45ff-b772-97038b0ec405 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:06.570644 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15c0370f-f4b9-45ff-b772-97038b0ec405 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:06.570839 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2cd4458b-9518-460e-a385-21465ceb3718 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31" status: 200 len: 1388 microversion: 2.1 time: 0.199559 Aug 07 01:13:06.571331 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15c0370f-f4b9-45ff-b772-97038b0ec405 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:06.571531 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 442/780] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:06 2022] GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 => generated 1388 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:06.572520 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15c0370f-f4b9-45ff-b772-97038b0ec405 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:06.573345 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15c0370f-f4b9-45ff-b772-97038b0ec405 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:06.574275 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15c0370f-f4b9-45ff-b772-97038b0ec405 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:06.594312 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-15c0370f-f4b9-45ff-b772-97038b0ec405 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] HTTP exception thrown: Instance b8d0c259-b533-4396-b916-8861a321b930 could not be found. Aug 07 01:13:06.598166 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-15c0370f-f4b9-45ff-b772-97038b0ec405 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Request method failure captured: Aug 07 01:13:06.598166 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/b8d0c259-b533-4396-b916-8861a321b930 HTTP/1.1 Aug 07 01:13:06.598166 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:13:06.598166 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:13:06.598166 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:13:06.598166 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:13:06.598166 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:13:06.598166 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:13:06.598166 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:13:06.598166 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:13:06.598166 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xFckBwmEIOALuPkIpYYAkDTwU6lYRvpbDB6FtSj8Sg7lFkIH7TnF3X0kFI6keg6KHVKixmDgybdU5CSPpRMRnjrKcY2sWqy8Bfsv4wJWyLfeTV1EeAaCNlBNIe0sy1bdi1HyEYWw6GpxvEnsWqjAIiNvzr9-QyANPXE6HK7H6tnbrE Aug 07 01:13:06.598166 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:13:06.598166 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:13:06.598166 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:13:06.598166 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:13:06.598166 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:13:06.598166 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:13:06.598166 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 6a7279db9d4f497b8430fd45280b5da4 Aug 07 01:13:06.598166 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-LiveMigrationNegativeTest-371220328 Aug 07 01:13:06.598166 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:13:06.598166 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:13:06.601224 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6a7279db9d4f497b8430fd45280b5da4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6a7279db9d4f497b8430fd45280b5da4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6a7279db9d4f497b8430fd45280b5da4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6a7279db9d4f497b8430fd45280b5da4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:13:06.601224 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-LiveMigrationNegativeTest-371220328 Aug 07 01:13:06.601224 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 6a7279db9d4f497b8430fd45280b5da4 Aug 07 01:13:06.601224 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-371220328 Aug 07 01:13:06.601224 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-LiveMigrationNegativeTest-371220328-project Aug 07 01:13:06.601224 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:13:06.601224 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:13:06.601224 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: cc0200a0753e46399d0b212c665aebce Aug 07 01:13:06.601224 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-LiveMigrationNegativeTest-371220328-project Aug 07 01:13:06.601224 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:13:06.601224 n-d-master-1 devstack@n-api.service[119517]: exception: Instance b8d0c259-b533-4396-b916-8861a321b930 could not be found. Aug 07 01:13:06.601224 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'b8d0c259-b533-4396-b916-8861a321b930'} Aug 07 01:13:06.602686 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:13:06.602686 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:06.602686 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:13:06.602686 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:13:06.602686 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:13:06.602686 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:13:06.602686 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:13:06.602686 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:13:06.602686 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:13:06.602686 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:13:06.602686 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8d0c259-b533-4396-b916-8861a321b930 could not be found. Aug 07 01:13:06.602686 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:06.602686 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:13:06.602686 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:06.602686 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:06.602686 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:13:06.602686 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:13:06.602686 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:13:06.602686 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:13:06.602686 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:13:06.605200 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:13:06.605200 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:13:06.605200 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:13:06.605200 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:13:06.605200 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:13:06.605200 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:13:06.605200 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:13:06.605200 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8d0c259-b533-4396-b916-8861a321b930 could not be found. Aug 07 01:13:06.605200 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:06.605200 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:13:06.605200 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:06.605200 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:06.605200 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:13:06.605200 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:13:06.605200 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:13:06.605200 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:13:06.605200 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8d0c259-b533-4396-b916-8861a321b930 could not be found. Aug 07 01:13:06.605200 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:06.607407 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-15c0370f-f4b9-45ff-b772-97038b0ec405 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] Returning 404 to user: Instance b8d0c259-b533-4396-b916-8861a321b930 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:13:06.607407 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-15c0370f-f4b9-45ff-b772-97038b0ec405 tempest-LiveMigrationNegativeTest-371220328 tempest-LiveMigrationNegativeTest-371220328-project] 10.222.0.39 "GET /compute/v2.1/servers/b8d0c259-b533-4396-b916-8861a321b930" status: 404 len: 111 microversion: 2.1 time: 0.059576 Aug 07 01:13:06.607407 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 339/781] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:06 2022] GET /compute/v2.1/servers/b8d0c259-b533-4396-b916-8861a321b930 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:13:06.625630 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7301f4fa-40ef-4ea8-8458-607ac1bb8a53 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '.version_select at 0x7f9e24aa7dc0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:06.649299 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-7301f4fa-40ef-4ea8-8458-607ac1bb8a53 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] HTTP exception thrown: Image not found. Aug 07 01:13:06.651339 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7301f4fa-40ef-4ea8-8458-607ac1bb8a53 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Request method failure captured: Aug 07 01:13:06.651339 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/images/2a7f0cf4-0b12-4420-b96f-08be56c9fe71 HTTP/1.1 Aug 07 01:13:06.651339 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:13:06.651339 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:13:06.651339 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:13:06.651339 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:13:06.651339 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:13:06.651339 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:13:06.651339 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:13:06.651339 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:13:06.651339 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xFJvA8aViwvAloPsDf2VckLIvT0ef2dFkqEzqRHcsoXzKL-UrjSbgq9qrhn-Kr0K6IWORgsxpa0ZC6p7prEjOQjpXXrO_P6Q36zbcHdiXbdtz0b1lfjcwupDS07IycJWoRXidnJpp03pTzYbxhgdiNsodOZkAAXZnRnVK8CHn-Gq7M Aug 07 01:13:06.651339 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:13:06.651339 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:13:06.651339 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:13:06.651339 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:13:06.651339 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:13:06.651339 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:13:06.651339 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 4e443158f15b42a3a795950a7c409a38 Aug 07 01:13:06.651339 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:13:06.651339 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:13:06.651339 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:13:06.654828 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4e443158f15b42a3a795950a7c409a38", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:13:06.654828 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:13:06.654828 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 4e443158f15b42a3a795950a7c409a38 Aug 07 01:13:06.654828 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:13:06.654828 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ImagesOneServerNegativeTestJSON-439364583-project Aug 07 01:13:06.654828 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:13:06.654828 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:13:06.654828 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: c135ba135fd946149ace9a86c7c52e80 Aug 07 01:13:06.654828 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-439364583-project Aug 07 01:13:06.654828 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:13:06.654828 n-d-master-1 devstack@n-api.service[119517]: exception: Image not found. Aug 07 01:13:06.654828 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '2a7f0cf4-0b12-4420-b96f-08be56c9fe71'} Aug 07 01:13:06.654828 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:13:06.657729 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:06.657729 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 07 01:13:06.657729 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 07 01:13:06.657729 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 07 01:13:06.657729 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 07 01:13:06.657729 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 07 01:13:06.657729 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 07 01:13:06.657729 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 07 01:13:06.657729 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 07 01:13:06.657729 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 07 01:13:06.657729 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 07 01:13:06.657729 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 07 01:13:06.657729 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 07 01:13:06.657729 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 07 01:13:06.657729 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 07 01:13:06.657729 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 07 01:13:06.657729 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 07 01:13:06.657729 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2a7f0cf4-0b12-4420-b96f-08be56c9fe71 Aug 07 01:13:06.661226 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:06.661226 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:13:06.661226 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:06.661226 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:06.661226 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 07 01:13:06.661226 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 07 01:13:06.661226 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 07 01:13:06.661226 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 07 01:13:06.661226 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 07 01:13:06.661226 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 07 01:13:06.661226 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 07 01:13:06.661226 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 07 01:13:06.661226 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 07 01:13:06.661226 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 07 01:13:06.661226 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 07 01:13:06.661226 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 07 01:13:06.661226 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 07 01:13:06.661226 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 07 01:13:06.661226 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 07 01:13:06.661226 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 07 01:13:06.665364 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 07 01:13:06.665364 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 07 01:13:06.665364 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 07 01:13:06.665364 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 07 01:13:06.665364 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 07 01:13:06.665364 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 07 01:13:06.665364 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 07 01:13:06.665364 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 07 01:13:06.665364 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2a7f0cf4-0b12-4420-b96f-08be56c9fe71 could not be found. Aug 07 01:13:06.665364 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:06.665364 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:13:06.665364 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:06.665364 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:06.665364 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:13:06.665364 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:13:06.665364 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:13:06.665364 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:13:06.665364 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:13:06.665364 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:13:06.668223 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:13:06.668223 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:13:06.668223 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 07 01:13:06.668223 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 07 01:13:06.668223 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 07 01:13:06.668223 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:06.668223 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:13:06.668223 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:06.668223 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:06.668223 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:13:06.668223 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:13:06.668223 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:13:06.668223 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:13:06.668223 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 07 01:13:06.668223 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:06.668223 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7301f4fa-40ef-4ea8-8458-607ac1bb8a53 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Returning 404 to user: Image not found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:13:06.672692 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7301f4fa-40ef-4ea8-8458-607ac1bb8a53 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/images/2a7f0cf4-0b12-4420-b96f-08be56c9fe71" status: 404 len: 62 microversion: 2.1 time: 0.047364 Aug 07 01:13:06.672692 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 340/782] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:13:06 2022] GET /compute/v2.1/images/2a7f0cf4-0b12-4420-b96f-08be56c9fe71 => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:13:06.672692 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4336976a-77b6-4e20-b2c8-ac379402328d tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:06.672692 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4336976a-77b6-4e20-b2c8-ac379402328d tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:06.672692 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4336976a-77b6-4e20-b2c8-ac379402328d tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:06.673536 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4336976a-77b6-4e20-b2c8-ac379402328d tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:06.673536 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4336976a-77b6-4e20-b2c8-ac379402328d tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:06.673536 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4336976a-77b6-4e20-b2c8-ac379402328d tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:06.673536 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4336976a-77b6-4e20-b2c8-ac379402328d tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:06.674073 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4336976a-77b6-4e20-b2c8-ac379402328d tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:06.848925 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-299f6f43-db87-4735-b25a-a779f9fc696f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-824317390", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:06.898204 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=4 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:06.946327 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-299f6f43-db87-4735-b25a-a779f9fc696f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] validate_networks() for None {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:13:07.083423 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4336976a-77b6-4e20-b2c8-ac379402328d tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79" status: 200 len: 1631 microversion: 2.1 time: 0.428093 Aug 07 01:13:07.085149 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 341/783] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:06 2022] GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79 => generated 1631 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:07.090833 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-cd1e77b1-4d0b-46db-a44f-11b74853a4e3 req-c6806db0-67c7-4eeb-b01f-8b0241095d6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81ae2aca-ae4d-4dc3-8c29-4da2460bcc31", "tag": "56265c55-bdaf-4051-ad48-6b3b5662fe2f"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:07.110216 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-cd1e77b1-4d0b-46db-a44f-11b74853a4e3 req-c6806db0-67c7-4eeb-b01f-8b0241095d6e service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:07.111310 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-cd1e77b1-4d0b-46db-a44f-11b74853a4e3 req-c6806db0-67c7-4eeb-b01f-8b0241095d6e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:07.112033 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-cd1e77b1-4d0b-46db-a44f-11b74853a4e3 req-c6806db0-67c7-4eeb-b01f-8b0241095d6e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:07.133465 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-cd1e77b1-4d0b-46db-a44f-11b74853a4e3 req-c6806db0-67c7-4eeb-b01f-8b0241095d6e service nova] Creating event network-changed:56265c55-bdaf-4051-ad48-6b3b5662fe2f for instance 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 on n-h1-master-1 Aug 07 01:13:07.160966 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-cd1e77b1-4d0b-46db-a44f-11b74853a4e3 req-c6806db0-67c7-4eeb-b01f-8b0241095d6e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067613 Aug 07 01:13:07.160966 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 342/784] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:13:07.180760 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-27b8c4bf-e8a8-4709-aa78-b8a278f75e6d tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:07.181637 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-27b8c4bf-e8a8-4709-aa78-b8a278f75e6d tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 8a19ce68-d784-44a2-b20c-77de1180aba3] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:07.205171 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27b8c4bf-e8a8-4709-aa78-b8a278f75e6d tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:07.205825 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27b8c4bf-e8a8-4709-aa78-b8a278f75e6d tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:07.206367 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27b8c4bf-e8a8-4709-aa78-b8a278f75e6d tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:07.207235 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27b8c4bf-e8a8-4709-aa78-b8a278f75e6d tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:07.207714 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27b8c4bf-e8a8-4709-aa78-b8a278f75e6d tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:07.208182 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27b8c4bf-e8a8-4709-aa78-b8a278f75e6d tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:07.246868 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-299f6f43-db87-4735-b25a-a779f9fc696f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:13:07.247717 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-299f6f43-db87-4735-b25a-a779f9fc696f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:13:07.248709 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-299f6f43-db87-4735-b25a-a779f9fc696f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:13:07.250093 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-299f6f43-db87-4735-b25a-a779f9fc696f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:13:07.251345 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-299f6f43-db87-4735-b25a-a779f9fc696f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:13:07.270944 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-299f6f43-db87-4735-b25a-a779f9fc696f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:07.272250 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-299f6f43-db87-4735-b25a-a779f9fc696f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:07.273387 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-299f6f43-db87-4735-b25a-a779f9fc696f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:07.274945 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-299f6f43-db87-4735-b25a-a779f9fc696f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:07.276242 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-299f6f43-db87-4735-b25a-a779f9fc696f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:07.277439 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-299f6f43-db87-4735-b25a-a779f9fc696f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:07.319052 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-299f6f43-db87-4735-b25a-a779f9fc696f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Getting quotas for project d08d010c14a64f759887be0d2364c6e4. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:13:07.331820 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-299f6f43-db87-4735-b25a-a779f9fc696f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Getting quotas for user 32fc1959d8aa41eabcead217b9d7bc47 and project d08d010c14a64f759887be0d2364c6e4. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:13:07.355519 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-299f6f43-db87-4735-b25a-a779f9fc696f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:13:07.362038 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-299f6f43-db87-4735-b25a-a779f9fc696f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 8511418d-b773-43fd-adc1-bc8862f82015] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:13:07.427606 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-27b8c4bf-e8a8-4709-aa78-b8a278f75e6d tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:07.437438 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-27b8c4bf-e8a8-4709-aa78-b8a278f75e6d tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3" status: 200 len: 1539 microversion: 2.1 time: 0.278632 Aug 07 01:13:07.438851 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 343/785] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:07 2022] GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3 => generated 1539 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:07.445270 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-41bf4fda-c3f0-4053-a739-c366912e2ca4 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Action: 'create', calling method: .version_select at 0x7f9e24aa7700>, body: {"keypair": {"name": "tempest-keypair-1610917116", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOCTgNJPNUYxENjIPLN+5WTLz3CJKBlftRbrjcr/2uOI7HYK24B8QXsXNR/iwi3okEEh8b9BV9e35ROJt/rv8VFUDjQlaP/HwvFH7YlTDBufmLsU6CNlXgsZ0DaVUDCWg=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:07.450896 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-299f6f43-db87-4735-b25a-a779f9fc696f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.878099 Aug 07 01:13:07.457842 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 443/786] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:13:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:13:07.465599 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c81ccf4d-1284-43a9-8899-5c18923f3e54 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:07.466465 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c81ccf4d-1284-43a9-8899-5c18923f3e54 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] [instance: 3c514622-f3bf-43c5-9713-bd993d6d291c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:07.474985 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c81ccf4d-1284-43a9-8899-5c18923f3e54 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:07.475581 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c81ccf4d-1284-43a9-8899-5c18923f3e54 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:07.476138 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c81ccf4d-1284-43a9-8899-5c18923f3e54 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:07.476943 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c81ccf4d-1284-43a9-8899-5c18923f3e54 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:07.477477 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c81ccf4d-1284-43a9-8899-5c18923f3e54 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:07.478142 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c81ccf4d-1284-43a9-8899-5c18923f3e54 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:07.496227 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-41bf4fda-c3f0-4053-a739-c366912e2ca4 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Getting quotas for project ba9e7a1c1fe14f47b5a5acf2fe8893b5. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:13:07.510621 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-41bf4fda-c3f0-4053-a739-c366912e2ca4 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Getting quotas for user 0327f14a188e45fba98a58e5fd061248 and project ba9e7a1c1fe14f47b5a5acf2fe8893b5. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:13:07.537751 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:07.611744 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-41bf4fda-c3f0-4053-a739-c366912e2ca4 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.171142 Aug 07 01:13:07.627035 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 344/787] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:13:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:13:07.637607 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c30c089c-9db9-49ec-aac0-a735fd9d102d tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e2491f1f0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:07.763680 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c30c089c-9db9-49ec-aac0-a735fd9d102d tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/44b163c4-972b-45e4-b79b-00e80eb0b2da" status: 200 len: 1429 microversion: 2.1 time: 0.134536 Aug 07 01:13:07.769492 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 345/788] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:13:07 2022] GET /compute/v2.1/images/44b163c4-972b-45e4-b79b-00e80eb0b2da => generated 1429 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:07.789404 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6ea4d4cd-18bd-4613-a2f3-89bebde553cc tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:07.793769 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6ea4d4cd-18bd-4613-a2f3-89bebde553cc tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 8511418d-b773-43fd-adc1-bc8862f82015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:07.839252 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c81ccf4d-1284-43a9-8899-5c18923f3e54 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ec78e02379498e884758d48f5454fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ac8cbc5d64648b03ab13bce91cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:07.853264 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c81ccf4d-1284-43a9-8899-5c18923f3e54 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] 10.222.0.39 "GET /compute/v2.1/servers/3c514622-f3bf-43c5-9713-bd993d6d291c" status: 200 len: 1479 microversion: 2.1 time: 0.398656 Aug 07 01:13:07.875936 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 444/789] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:07 2022] GET /compute/v2.1/servers/3c514622-f3bf-43c5-9713-bd993d6d291c => generated 1479 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:07.875936 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-eadc16f6-4bdd-414a-bf33-ad3466f19871 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:07.876479 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-eadc16f6-4bdd-414a-bf33-ad3466f19871 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:07.889178 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eadc16f6-4bdd-414a-bf33-ad3466f19871 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:07.891159 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eadc16f6-4bdd-414a-bf33-ad3466f19871 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:07.892020 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eadc16f6-4bdd-414a-bf33-ad3466f19871 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:07.893696 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eadc16f6-4bdd-414a-bf33-ad3466f19871 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:07.894508 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eadc16f6-4bdd-414a-bf33-ad3466f19871 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:07.895124 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eadc16f6-4bdd-414a-bf33-ad3466f19871 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:07.941981 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6ea4d4cd-18bd-4613-a2f3-89bebde553cc tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:07.993598 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6ea4d4cd-18bd-4613-a2f3-89bebde553cc tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/8511418d-b773-43fd-adc1-bc8862f82015" status: 200 len: 1216 microversion: 2.1 time: 0.214134 Aug 07 01:13:07.994446 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 346/790] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:07 2022] GET /compute/v2.1/servers/8511418d-b773-43fd-adc1-bc8862f82015 => generated 1216 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:08.245893 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-eadc16f6-4bdd-414a-bf33-ad3466f19871 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d08a2479f847b4b06d6690f1aedb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06211ba44e4f6d88f9095969001aab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:08.265774 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-eadc16f6-4bdd-414a-bf33-ad3466f19871 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31" status: 200 len: 1388 microversion: 2.1 time: 0.401840 Aug 07 01:13:08.267279 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 445/791] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:07 2022] GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 => generated 1388 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:08.475927 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3ba040d1-2763-469b-8dd7-cb06647b4116 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:08.487089 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3ba040d1-2763-469b-8dd7-cb06647b4116 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 8a19ce68-d784-44a2-b20c-77de1180aba3] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:08.507936 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ba040d1-2763-469b-8dd7-cb06647b4116 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:08.508823 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ba040d1-2763-469b-8dd7-cb06647b4116 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:08.509631 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ba040d1-2763-469b-8dd7-cb06647b4116 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:08.510939 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ba040d1-2763-469b-8dd7-cb06647b4116 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:08.519719 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ba040d1-2763-469b-8dd7-cb06647b4116 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:08.520781 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ba040d1-2763-469b-8dd7-cb06647b4116 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:08.795190 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-66648e44-1a79-4ba4-8c6a-07678bd3bb47 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e24901700>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:08.866096 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3ba040d1-2763-469b-8dd7-cb06647b4116 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:08.910815 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3ba040d1-2763-469b-8dd7-cb06647b4116 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3" status: 200 len: 1539 microversion: 2.1 time: 0.440494 Aug 07 01:13:08.911404 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 347/792] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:08 2022] GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3 => generated 1539 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:08.916090 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-66648e44-1a79-4ba4-8c6a-07678bd3bb47 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/44b163c4-972b-45e4-b79b-00e80eb0b2da" status: 200 len: 1429 microversion: 2.1 time: 0.128458 Aug 07 01:13:08.917247 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 446/793] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:13:08 2022] GET /compute/v2.1/images/44b163c4-972b-45e4-b79b-00e80eb0b2da => generated 1429 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:08.919978 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ad771a05-89e9-4a1c-954b-4d4366cdf619 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:08.921020 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ad771a05-89e9-4a1c-954b-4d4366cdf619 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] [instance: 3c514622-f3bf-43c5-9713-bd993d6d291c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:08.943508 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad771a05-89e9-4a1c-954b-4d4366cdf619 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:08.944131 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad771a05-89e9-4a1c-954b-4d4366cdf619 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:08.944695 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad771a05-89e9-4a1c-954b-4d4366cdf619 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:08.945574 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad771a05-89e9-4a1c-954b-4d4366cdf619 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:08.946093 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad771a05-89e9-4a1c-954b-4d4366cdf619 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:08.946800 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad771a05-89e9-4a1c-954b-4d4366cdf619 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:09.011275 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad771a05-89e9-4a1c-954b-4d4366cdf619 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:09.012083 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad771a05-89e9-4a1c-954b-4d4366cdf619 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:09.012858 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad771a05-89e9-4a1c-954b-4d4366cdf619 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:09.013533 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-ad771a05-89e9-4a1c-954b-4d4366cdf619 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lazy-loading 'fault' on Instance uuid 3c514622-f3bf-43c5-9713-bd993d6d291c {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:13:09.019927 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f746e8c0-62df-48fe-94b6-8f94696f5ae2 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:09.020937 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f746e8c0-62df-48fe-94b6-8f94696f5ae2 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 8511418d-b773-43fd-adc1-bc8862f82015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:09.040911 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f746e8c0-62df-48fe-94b6-8f94696f5ae2 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:09.042152 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f746e8c0-62df-48fe-94b6-8f94696f5ae2 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:09.043135 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f746e8c0-62df-48fe-94b6-8f94696f5ae2 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:09.044807 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f746e8c0-62df-48fe-94b6-8f94696f5ae2 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:09.045881 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f746e8c0-62df-48fe-94b6-8f94696f5ae2 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:09.047115 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f746e8c0-62df-48fe-94b6-8f94696f5ae2 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:09.130065 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ad771a05-89e9-4a1c-954b-4d4366cdf619 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80ec78e02379498e884758d48f5454fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380ac8cbc5d64648b03ab13bce91cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:09.159619 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ad771a05-89e9-4a1c-954b-4d4366cdf619 tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] 10.222.0.39 "GET /compute/v2.1/servers/3c514622-f3bf-43c5-9713-bd993d6d291c" status: 200 len: 1313 microversion: 2.1 time: 0.245163 Aug 07 01:13:09.160349 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 348/794] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:08 2022] GET /compute/v2.1/servers/3c514622-f3bf-43c5-9713-bd993d6d291c => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:09.204022 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f746e8c0-62df-48fe-94b6-8f94696f5ae2 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:09.233942 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f746e8c0-62df-48fe-94b6-8f94696f5ae2 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/8511418d-b773-43fd-adc1-bc8862f82015" status: 200 len: 1212 microversion: 2.1 time: 0.217906 Aug 07 01:13:09.237165 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 447/795] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:09 2022] GET /compute/v2.1/servers/8511418d-b773-43fd-adc1-bc8862f82015 => generated 1212 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:09.238021 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-258ac203-f09e-46e3-b8d4-63a1999bb183 req-f550f42f-c34c-4e4f-bad6-a7891a04e687 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c514622-f3bf-43c5-9713-bd993d6d291c", "name": "network-vif-deleted", "tag": "a6de2a45-89e2-4f14-b114-b29b2c1379cf"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:09.261411 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-258ac203-f09e-46e3-b8d4-63a1999bb183 req-f550f42f-c34c-4e4f-bad6-a7891a04e687 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:09.261901 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-258ac203-f09e-46e3-b8d4-63a1999bb183 req-f550f42f-c34c-4e4f-bad6-a7891a04e687 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:09.262505 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-258ac203-f09e-46e3-b8d4-63a1999bb183 req-f550f42f-c34c-4e4f-bad6-a7891a04e687 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:09.293175 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-258ac203-f09e-46e3-b8d4-63a1999bb183 req-f550f42f-c34c-4e4f-bad6-a7891a04e687 service nova] Creating event network-vif-deleted:a6de2a45-89e2-4f14-b114-b29b2c1379cf for instance 3c514622-f3bf-43c5-9713-bd993d6d291c on n-h2-master-1 Aug 07 01:13:09.305122 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-62c9109b-686a-446a-8d4f-bb271dfef219 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:09.306390 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-62c9109b-686a-446a-8d4f-bb271dfef219 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:09.309061 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-258ac203-f09e-46e3-b8d4-63a1999bb183 req-f550f42f-c34c-4e4f-bad6-a7891a04e687 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075905 Aug 07 01:13:09.310277 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 349/796] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:13:09.333738 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62c9109b-686a-446a-8d4f-bb271dfef219 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:09.334803 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62c9109b-686a-446a-8d4f-bb271dfef219 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:09.336481 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62c9109b-686a-446a-8d4f-bb271dfef219 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:09.340108 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62c9109b-686a-446a-8d4f-bb271dfef219 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:09.341077 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62c9109b-686a-446a-8d4f-bb271dfef219 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:09.343688 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62c9109b-686a-446a-8d4f-bb271dfef219 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:09.626257 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-62c9109b-686a-446a-8d4f-bb271dfef219 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d08a2479f847b4b06d6690f1aedb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06211ba44e4f6d88f9095969001aab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:09.637688 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-62c9109b-686a-446a-8d4f-bb271dfef219 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31" status: 200 len: 1388 microversion: 2.1 time: 0.338657 Aug 07 01:13:09.639132 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 448/797] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:09 2022] GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 => generated 1388 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:13:09.939819 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6a979aa8-3806-47be-92e1-dbe2f5b8dd6e tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e24901430>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:09.945612 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-658a153b-11f1-42b0-9d0c-a35b6fa92215 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:09.956288 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-658a153b-11f1-42b0-9d0c-a35b6fa92215 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 8a19ce68-d784-44a2-b20c-77de1180aba3] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:10.007787 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-658a153b-11f1-42b0-9d0c-a35b6fa92215 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:10.009181 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-658a153b-11f1-42b0-9d0c-a35b6fa92215 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:10.010229 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-658a153b-11f1-42b0-9d0c-a35b6fa92215 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:10.022266 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-658a153b-11f1-42b0-9d0c-a35b6fa92215 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:10.023107 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-658a153b-11f1-42b0-9d0c-a35b6fa92215 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:10.023864 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-658a153b-11f1-42b0-9d0c-a35b6fa92215 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:10.034122 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6a979aa8-3806-47be-92e1-dbe2f5b8dd6e tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/44b163c4-972b-45e4-b79b-00e80eb0b2da" status: 200 len: 1429 microversion: 2.1 time: 0.099042 Aug 07 01:13:10.034714 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 449/798] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:13:09 2022] GET /compute/v2.1/images/44b163c4-972b-45e4-b79b-00e80eb0b2da => generated 1429 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:13:10.193087 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3a7e2519-0b37-4e99-b30c-82923203e8dd tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:10.193758 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3a7e2519-0b37-4e99-b30c-82923203e8dd tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] [instance: 3c514622-f3bf-43c5-9713-bd993d6d291c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:10.223085 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a7e2519-0b37-4e99-b30c-82923203e8dd tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:10.227805 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a7e2519-0b37-4e99-b30c-82923203e8dd tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:10.228908 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a7e2519-0b37-4e99-b30c-82923203e8dd tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:10.230543 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a7e2519-0b37-4e99-b30c-82923203e8dd tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:10.232706 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a7e2519-0b37-4e99-b30c-82923203e8dd tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:10.233875 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a7e2519-0b37-4e99-b30c-82923203e8dd tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:10.261783 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-3a7e2519-0b37-4e99-b30c-82923203e8dd tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] HTTP exception thrown: Instance 3c514622-f3bf-43c5-9713-bd993d6d291c could not be found. Aug 07 01:13:10.264433 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3a7e2519-0b37-4e99-b30c-82923203e8dd tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Request method failure captured: Aug 07 01:13:10.264433 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/3c514622-f3bf-43c5-9713-bd993d6d291c HTTP/1.1 Aug 07 01:13:10.264433 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:13:10.264433 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:13:10.264433 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:13:10.264433 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:13:10.264433 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:13:10.264433 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:13:10.264433 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:13:10.264433 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:13:10.264433 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xF_0oWtRjIDdI9Vg2pZqjAt40mWQrxILJYSXfT9p8TxTk0xD_g08CYsw2H08qmy-ckokcWtnnaJXM179_sU3OpBXqm0qfWfmBwn6XhkYtfHhdjY7vgA5hsr3pyXrGv8fD-X5JqTYPj0fr4b4Njd7wkbXKanObNCdLxax7-YWojimdM Aug 07 01:13:10.264433 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:13:10.264433 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:13:10.264433 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:13:10.264433 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:13:10.264433 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:13:10.264433 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:13:10.264433 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 380ac8cbc5d64648b03ab13bce91cfe4 Aug 07 01:13:10.264433 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-497448315 Aug 07 01:13:10.264433 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:13:10.264433 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:13:10.266328 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/380ac8cbc5d64648b03ab13bce91cfe4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_380ac8cbc5d64648b03ab13bce91cfe4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/380ac8cbc5d64648b03ab13bce91cfe4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/380ac8cbc5d64648b03ab13bce91cfe4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:13:10.266328 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-497448315 Aug 07 01:13:10.266328 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 380ac8cbc5d64648b03ab13bce91cfe4 Aug 07 01:13:10.266328 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-497448315 Aug 07 01:13:10.266328 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServerDiagnosticsNegativeTest-497448315-project Aug 07 01:13:10.266328 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:13:10.266328 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:13:10.266328 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 80ec78e02379498e884758d48f5454fd Aug 07 01:13:10.266328 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-497448315-project Aug 07 01:13:10.266328 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:13:10.266328 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 3c514622-f3bf-43c5-9713-bd993d6d291c could not be found. Aug 07 01:13:10.266328 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '3c514622-f3bf-43c5-9713-bd993d6d291c'} Aug 07 01:13:10.267550 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:13:10.267550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:10.267550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:13:10.267550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:13:10.267550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:13:10.267550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:13:10.267550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:13:10.267550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:13:10.267550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:13:10.267550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:13:10.267550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c514622-f3bf-43c5-9713-bd993d6d291c could not be found. Aug 07 01:13:10.267550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:13:10.267550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:13:10.267550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:13:10.267550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:10.267550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:13:10.267550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:13:10.267550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:13:10.267550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:13:10.267550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:13:10.269044 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:13:10.269044 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:13:10.269044 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:13:10.269044 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:13:10.269044 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:13:10.269044 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:13:10.269044 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:13:10.269044 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c514622-f3bf-43c5-9713-bd993d6d291c could not be found. Aug 07 01:13:10.269044 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:13:10.269044 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:13:10.269044 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:13:10.269044 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:10.269044 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:13:10.269044 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:13:10.269044 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:13:10.269044 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:13:10.269044 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c514622-f3bf-43c5-9713-bd993d6d291c could not be found. Aug 07 01:13:10.269044 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:13:10.271834 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3a7e2519-0b37-4e99-b30c-82923203e8dd tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] Returning 404 to user: Instance 3c514622-f3bf-43c5-9713-bd993d6d291c could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:13:10.273416 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3a7e2519-0b37-4e99-b30c-82923203e8dd tempest-ServerDiagnosticsNegativeTest-497448315 tempest-ServerDiagnosticsNegativeTest-497448315-project] 10.222.0.39 "GET /compute/v2.1/servers/3c514622-f3bf-43c5-9713-bd993d6d291c" status: 404 len: 111 microversion: 2.1 time: 0.090434 Aug 07 01:13:10.275822 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 450/799] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:10 2022] GET /compute/v2.1/servers/3c514622-f3bf-43c5-9713-bd993d6d291c => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:13:10.299306 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0de1a339-04d2-408e-97e9-24929da8054f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:10.299966 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0de1a339-04d2-408e-97e9-24929da8054f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 8511418d-b773-43fd-adc1-bc8862f82015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:10.314341 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0de1a339-04d2-408e-97e9-24929da8054f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:10.314844 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0de1a339-04d2-408e-97e9-24929da8054f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:10.315288 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0de1a339-04d2-408e-97e9-24929da8054f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:10.316053 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0de1a339-04d2-408e-97e9-24929da8054f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:10.316514 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0de1a339-04d2-408e-97e9-24929da8054f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:10.316949 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0de1a339-04d2-408e-97e9-24929da8054f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:10.446966 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0de1a339-04d2-408e-97e9-24929da8054f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:10.451230 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:10.463181 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0de1a339-04d2-408e-97e9-24929da8054f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/8511418d-b773-43fd-adc1-bc8862f82015" status: 200 len: 1274 microversion: 2.1 time: 0.173399 Aug 07 01:13:10.479376 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 451/800] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:10 2022] GET /compute/v2.1/servers/8511418d-b773-43fd-adc1-bc8862f82015 => generated 1274 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:10.668823 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0fb6dc6b-18f1-44f3-a595-5496c1296917 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:10.669984 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0fb6dc6b-18f1-44f3-a595-5496c1296917 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:10.684219 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0fb6dc6b-18f1-44f3-a595-5496c1296917 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:10.685453 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0fb6dc6b-18f1-44f3-a595-5496c1296917 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:10.686262 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0fb6dc6b-18f1-44f3-a595-5496c1296917 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:10.687399 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0fb6dc6b-18f1-44f3-a595-5496c1296917 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:10.690248 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0fb6dc6b-18f1-44f3-a595-5496c1296917 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:10.692021 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0fb6dc6b-18f1-44f3-a595-5496c1296917 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:10.778509 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-658a153b-11f1-42b0-9d0c-a35b6fa92215 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:10.795086 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-658a153b-11f1-42b0-9d0c-a35b6fa92215 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3" status: 200 len: 1539 microversion: 2.1 time: 0.864772 Aug 07 01:13:10.796038 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 350/801] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:09 2022] GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3 => generated 1539 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:10.986717 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0fb6dc6b-18f1-44f3-a595-5496c1296917 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d08a2479f847b4b06d6690f1aedb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06211ba44e4f6d88f9095969001aab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:11.006099 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0fb6dc6b-18f1-44f3-a595-5496c1296917 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31" status: 200 len: 1388 microversion: 2.1 time: 0.341406 Aug 07 01:13:11.007566 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 452/802] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:10 2022] GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 => generated 1388 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:11.062445 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-70d3c06e-f6b4-48e3-9d07-5dd19efae3ce tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e249000d0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:11.149354 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-70d3c06e-f6b4-48e3-9d07-5dd19efae3ce tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/44b163c4-972b-45e4-b79b-00e80eb0b2da" status: 200 len: 1429 microversion: 2.1 time: 0.094369 Aug 07 01:13:11.151343 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 351/803] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:13:11 2022] GET /compute/v2.1/images/44b163c4-972b-45e4-b79b-00e80eb0b2da => generated 1429 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:11.504288 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-37ad78ea-b73b-4ed7-91c4-f3b799a8c286 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:11.505647 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-37ad78ea-b73b-4ed7-91c4-f3b799a8c286 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 8511418d-b773-43fd-adc1-bc8862f82015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:11.525468 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37ad78ea-b73b-4ed7-91c4-f3b799a8c286 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:11.526017 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37ad78ea-b73b-4ed7-91c4-f3b799a8c286 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:11.533450 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37ad78ea-b73b-4ed7-91c4-f3b799a8c286 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:11.534863 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37ad78ea-b73b-4ed7-91c4-f3b799a8c286 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:11.536365 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37ad78ea-b73b-4ed7-91c4-f3b799a8c286 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:11.539492 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37ad78ea-b73b-4ed7-91c4-f3b799a8c286 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:11.935571 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4a629b7c-dc41-4c15-a38b-7d32fbadff34 tempest-VolumesAdminNegativeTest-1453158014 tempest-VolumesAdminNegativeTest-1453158014-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "3db6aa14-7593-4acc-a689-652dc85a44af"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:11.942664 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4a629b7c-dc41-4c15-a38b-7d32fbadff34 tempest-VolumesAdminNegativeTest-1453158014 tempest-VolumesAdminNegativeTest-1453158014-project-admin] [instance: 5777df19-f308-48d1-8f53-fdbf073a4ef2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:11.957559 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a629b7c-dc41-4c15-a38b-7d32fbadff34 tempest-VolumesAdminNegativeTest-1453158014 tempest-VolumesAdminNegativeTest-1453158014-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:11.958506 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a629b7c-dc41-4c15-a38b-7d32fbadff34 tempest-VolumesAdminNegativeTest-1453158014 tempest-VolumesAdminNegativeTest-1453158014-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:11.959604 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a629b7c-dc41-4c15-a38b-7d32fbadff34 tempest-VolumesAdminNegativeTest-1453158014 tempest-VolumesAdminNegativeTest-1453158014-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:11.972911 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a629b7c-dc41-4c15-a38b-7d32fbadff34 tempest-VolumesAdminNegativeTest-1453158014 tempest-VolumesAdminNegativeTest-1453158014-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:11.974258 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a629b7c-dc41-4c15-a38b-7d32fbadff34 tempest-VolumesAdminNegativeTest-1453158014 tempest-VolumesAdminNegativeTest-1453158014-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:11.976196 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a629b7c-dc41-4c15-a38b-7d32fbadff34 tempest-VolumesAdminNegativeTest-1453158014 tempest-VolumesAdminNegativeTest-1453158014-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:12.166907 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-37ad78ea-b73b-4ed7-91c4-f3b799a8c286 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:12.183394 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-37ad78ea-b73b-4ed7-91c4-f3b799a8c286 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/8511418d-b773-43fd-adc1-bc8862f82015" status: 200 len: 1274 microversion: 2.1 time: 0.684458 Aug 07 01:13:12.185417 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 352/804] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:11 2022] GET /compute/v2.1/servers/8511418d-b773-43fd-adc1-bc8862f82015 => generated 1274 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:12.217929 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-add949e7-d41e-4f1a-a091-d7aa64c901c9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1754596364", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "e53f1978-9541-49df-ae99-30274357a59f"}], "security_groups": [{"name": "tempest-securitygroup--628358086"}], "key_name": "tempest-keypair-1610917116", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:12.425810 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-4a629b7c-dc41-4c15-a38b-7d32fbadff34 tempest-VolumesAdminNegativeTest-1453158014 tempest-VolumesAdminNegativeTest-1453158014-project-admin] HTTP exception thrown: Volume 3db6aa14-7593-4acc-a689-652dc85a44af could not be found. Aug 07 01:13:12.442727 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4a629b7c-dc41-4c15-a38b-7d32fbadff34 tempest-VolumesAdminNegativeTest-1453158014 tempest-VolumesAdminNegativeTest-1453158014-project-admin] Request method failure captured: Aug 07 01:13:12.442727 n-d-master-1 devstack@n-api.service[119516]: request: PUT /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2/os-volume_attachments/9d277332-74a2-4dbb-a888-cc8ab920b44f HTTP/1.1 Aug 07 01:13:12.442727 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:13:12.442727 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:13:12.442727 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:13:12.442727 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 74 Aug 07 01:13:12.442727 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:13:12.442727 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:13:12.442727 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:13:12.442727 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:13:12.442727 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xEyam_wgc0SDpYGC8jFIq_EOR42GBaiOfziZRFzPIVvEsV4ERDLrXIaVitWyP450cBMxelEECxHvI4Pt0KIOjzhFfqc4DRnOkKaa-y7FGgklAZSWA5FdqfNcPS7mb95STB0g4qjA_7TorND69R1cOy9yvzR0P8rIPUszQHmHl_aGqE Aug 07 01:13:12.442727 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:13:12.442727 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:13:12.442727 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:13:12.442727 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:13:12.442727 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:13:12.442727 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:13:12.442727 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: d5ea429307984908b718fa99c7391fb4 Aug 07 01:13:12.442727 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-VolumesAdminNegativeTest-1453158014 Aug 07 01:13:12.442727 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,admin,member Aug 07 01:13:12.442727 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,admin,member Aug 07 01:13:12.446320 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d5ea429307984908b718fa99c7391fb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d5ea429307984908b718fa99c7391fb4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d5ea429307984908b718fa99c7391fb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d5ea429307984908b718fa99c7391fb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:13:12.446320 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-VolumesAdminNegativeTest-1453158014 Aug 07 01:13:12.446320 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: d5ea429307984908b718fa99c7391fb4 Aug 07 01:13:12.446320 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1453158014 Aug 07 01:13:12.446320 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-VolumesAdminNegativeTest-1453158014-project-admin Aug 07 01:13:12.446320 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:13:12.446320 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:13:12.446320 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 48ba57d381ee4569b9bce256d01bc5c6 Aug 07 01:13:12.446320 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-VolumesAdminNegativeTest-1453158014-project-admin Aug 07 01:13:12.446320 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:13:12.446320 n-d-master-1 devstack@n-api.service[119516]: {"volumeAttachment": {"volumeId": "3db6aa14-7593-4acc-a689-652dc85a44af"}} Aug 07 01:13:12.446320 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:13:12.446320 n-d-master-1 devstack@n-api.service[119516]: exception: Volume 3db6aa14-7593-4acc-a689-652dc85a44af could not be found. Aug 07 01:13:12.447675 n-d-master-1 devstack@n-api.service[119516]: action_args: {'server_id': '5777df19-f308-48d1-8f53-fdbf073a4ef2', 'id': '9d277332-74a2-4dbb-a888-cc8ab920b44f', 'body': {'volumeAttachment': {'volumeId': '3db6aa14-7593-4acc-a689-652dc85a44af'}}} Aug 07 01:13:12.447675 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:13:12.447675 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:12.447675 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 01:13:12.447675 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 01:13:12.447675 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 01:13:12.447675 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 01:13:12.447675 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 01:13:12.447675 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 01:13:12.447675 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 01:13:12.447675 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 01:13:12.447675 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 01:13:12.447675 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 01:13:12.447675 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 01:13:12.447675 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 01:13:12.447675 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 01:13:12.447675 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 01:13:12.449143 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3db6aa14-7593-4acc-a689-652dc85a44af could not be found. (HTTP 404) (Request-ID: req-548d028b-797b-4cae-bf27-5f46f263c42a) Aug 07 01:13:12.449143 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:13:12.449143 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:13:12.449143 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:13:12.449143 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:12.449143 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 07 01:13:12.449143 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 07 01:13:12.449143 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 01:13:12.449143 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 01:13:12.449143 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 01:13:12.449143 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 01:13:12.449143 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 01:13:12.449143 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 01:13:12.449143 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 01:13:12.449143 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 01:13:12.449143 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 01:13:12.449143 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 01:13:12.449143 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 01:13:12.449143 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 01:13:12.450372 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 01:13:12.450372 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 01:13:12.450372 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 01:13:12.450372 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 01:13:12.450372 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 01:13:12.450372 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 01:13:12.450372 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 01:13:12.450372 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 01:13:12.450372 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3db6aa14-7593-4acc-a689-652dc85a44af could not be found. Aug 07 01:13:12.450372 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:13:12.450372 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:13:12.450372 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:13:12.450372 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:12.450372 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:13:12.450372 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:13:12.450372 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:13:12.450372 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:13:12.450372 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:13:12.450372 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:13:12.451548 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:13:12.451548 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:13:12.451548 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:13:12.451548 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:13:12.451548 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 07 01:13:12.451548 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 07 01:13:12.451548 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 07 01:13:12.451548 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 07 01:13:12.451548 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 3db6aa14-7593-4acc-a689-652dc85a44af could not be found. Aug 07 01:13:12.451548 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:13:12.451548 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:13:12.451548 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:13:12.451548 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:12.451548 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:13:12.451548 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:13:12.451548 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:13:12.451548 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:13:12.451548 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3db6aa14-7593-4acc-a689-652dc85a44af could not be found. Aug 07 01:13:12.451548 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:13:12.457433 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4a629b7c-dc41-4c15-a38b-7d32fbadff34 tempest-VolumesAdminNegativeTest-1453158014 tempest-VolumesAdminNegativeTest-1453158014-project-admin] Returning 400 to user: Volume 3db6aa14-7593-4acc-a689-652dc85a44af could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:13:12.457433 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4a629b7c-dc41-4c15-a38b-7d32fbadff34 tempest-VolumesAdminNegativeTest-1453158014 tempest-VolumesAdminNegativeTest-1453158014-project-admin] 10.222.0.39 "PUT /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2/os-volume_attachments/9d277332-74a2-4dbb-a888-cc8ab920b44f" status: 400 len: 107 microversion: 2.1 time: 1.026911 Aug 07 01:13:12.457433 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 453/805] 10.222.0.39 () {60 vars in 1433 bytes} [Sun Aug 7 01:13:11 2022] PUT /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2/os-volume_attachments/9d277332-74a2-4dbb-a888-cc8ab920b44f => generated 107 bytes in 1031 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:13:12.468203 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8c156a19-dc55-4b79-93fe-f5e3cb8ed933 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:12.468864 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8c156a19-dc55-4b79-93fe-f5e3cb8ed933 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 8a19ce68-d784-44a2-b20c-77de1180aba3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:12.479582 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8c156a19-dc55-4b79-93fe-f5e3cb8ed933 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:12.480104 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8c156a19-dc55-4b79-93fe-f5e3cb8ed933 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:12.480823 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8c156a19-dc55-4b79-93fe-f5e3cb8ed933 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:12.481744 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8c156a19-dc55-4b79-93fe-f5e3cb8ed933 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:12.482380 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8c156a19-dc55-4b79-93fe-f5e3cb8ed933 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:12.483023 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8c156a19-dc55-4b79-93fe-f5e3cb8ed933 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:12.943226 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8c156a19-dc55-4b79-93fe-f5e3cb8ed933 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:12.979943 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-add949e7-d41e-4f1a-a091-d7aa64c901c9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] validate_networks() for [('e53f1978-9541-49df-ae99-30274357a59f', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:13:12.997281 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8c156a19-dc55-4b79-93fe-f5e3cb8ed933 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3" status: 200 len: 1521 microversion: 2.1 time: 0.544067 Aug 07 01:13:12.998359 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 454/806] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:12 2022] GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3 => generated 1521 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:13.029404 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7d763bb4-4cd4-4d45-8018-3c6b16b0b0e3 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:13.038865 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7d763bb4-4cd4-4d45-8018-3c6b16b0b0e3 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:13.069145 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d763bb4-4cd4-4d45-8018-3c6b16b0b0e3 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:13.073245 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d763bb4-4cd4-4d45-8018-3c6b16b0b0e3 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:13.075342 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d763bb4-4cd4-4d45-8018-3c6b16b0b0e3 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:13.077929 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d763bb4-4cd4-4d45-8018-3c6b16b0b0e3 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:13.083764 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d763bb4-4cd4-4d45-8018-3c6b16b0b0e3 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:13.085087 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d763bb4-4cd4-4d45-8018-3c6b16b0b0e3 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:13.525252 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7d763bb4-4cd4-4d45-8018-3c6b16b0b0e3 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d08a2479f847b4b06d6690f1aedb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06211ba44e4f6d88f9095969001aab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:13.537040 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7d763bb4-4cd4-4d45-8018-3c6b16b0b0e3 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31" status: 200 len: 1388 microversion: 2.1 time: 0.529894 Aug 07 01:13:13.538337 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 455/807] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:13 2022] GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 => generated 1388 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:13.544635 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-60581e89-efea-4fa8-91a6-87916aa5d645 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e248ab430>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:13.629930 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-60581e89-efea-4fa8-91a6-87916aa5d645 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/44b163c4-972b-45e4-b79b-00e80eb0b2da" status: 200 len: 1429 microversion: 2.1 time: 0.090284 Aug 07 01:13:13.631382 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 456/808] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:13:13 2022] GET /compute/v2.1/images/44b163c4-972b-45e4-b79b-00e80eb0b2da => generated 1429 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:13.637022 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7917f89c-72f8-4790-9e1c-86446593e536 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:13.638155 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7917f89c-72f8-4790-9e1c-86446593e536 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: 5777df19-f308-48d1-8f53-fdbf073a4ef2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:13.651727 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7917f89c-72f8-4790-9e1c-86446593e536 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:13.652864 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7917f89c-72f8-4790-9e1c-86446593e536 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:13.653701 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7917f89c-72f8-4790-9e1c-86446593e536 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:13.654791 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7917f89c-72f8-4790-9e1c-86446593e536 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:13.656078 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7917f89c-72f8-4790-9e1c-86446593e536 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:13.657229 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7917f89c-72f8-4790-9e1c-86446593e536 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:13.941910 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-7917f89c-72f8-4790-9e1c-86446593e536 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lazy-loading 'services' on Instance uuid 5777df19-f308-48d1-8f53-fdbf073a4ef2 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:13:14.417259 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-add949e7-d41e-4f1a-a091-d7aa64c901c9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:13:14.419305 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-add949e7-d41e-4f1a-a091-d7aa64c901c9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:13:14.420914 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-add949e7-d41e-4f1a-a091-d7aa64c901c9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:13:14.422577 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-add949e7-d41e-4f1a-a091-d7aa64c901c9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:13:14.423632 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-add949e7-d41e-4f1a-a091-d7aa64c901c9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:13:14.436767 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7917f89c-72f8-4790-9e1c-86446593e536 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2/os-volume_attachments/9d277332-74a2-4dbb-a888-cc8ab920b44f" status: 202 len: 0 microversion: 2.1 time: 0.803221 Aug 07 01:13:14.444895 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 457/809] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Aug 7 01:13:13 2022] DELETE /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2/os-volume_attachments/9d277332-74a2-4dbb-a888-cc8ab920b44f => generated 0 bytes in 813 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:13:14.510085 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-add949e7-d41e-4f1a-a091-d7aa64c901c9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:14.511687 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-add949e7-d41e-4f1a-a091-d7aa64c901c9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:14.516703 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-add949e7-d41e-4f1a-a091-d7aa64c901c9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:14.521692 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-add949e7-d41e-4f1a-a091-d7aa64c901c9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:14.528495 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-add949e7-d41e-4f1a-a091-d7aa64c901c9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:14.532133 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-add949e7-d41e-4f1a-a091-d7aa64c901c9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:14.637649 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-add949e7-d41e-4f1a-a091-d7aa64c901c9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Getting quotas for project ba9e7a1c1fe14f47b5a5acf2fe8893b5. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:13:14.664846 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-add949e7-d41e-4f1a-a091-d7aa64c901c9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Getting quotas for user 0327f14a188e45fba98a58e5fd061248 and project ba9e7a1c1fe14f47b5a5acf2fe8893b5. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:13:14.705223 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-add949e7-d41e-4f1a-a091-d7aa64c901c9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:13:14.711906 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-add949e7-d41e-4f1a-a091-d7aa64c901c9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:13:14.888241 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-add949e7-d41e-4f1a-a091-d7aa64c901c9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.694710 Aug 07 01:13:14.924855 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 353/810] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:13:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 2738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:13:14.968877 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0ef50d8e-bd7d-489b-88ac-c5f9e16865e7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:14.975621 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0ef50d8e-bd7d-489b-88ac-c5f9e16865e7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 8a19ce68-d784-44a2-b20c-77de1180aba3] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:15.013389 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ef50d8e-bd7d-489b-88ac-c5f9e16865e7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:15.018367 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ef50d8e-bd7d-489b-88ac-c5f9e16865e7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:15.019559 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ef50d8e-bd7d-489b-88ac-c5f9e16865e7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:15.024355 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ef50d8e-bd7d-489b-88ac-c5f9e16865e7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:15.029895 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ef50d8e-bd7d-489b-88ac-c5f9e16865e7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:15.038281 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ef50d8e-bd7d-489b-88ac-c5f9e16865e7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:15.161218 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0ef50d8e-bd7d-489b-88ac-c5f9e16865e7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 8a19ce68-d784-44a2-b20c-77de1180aba3] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:13:15.222138 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:15.445598 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0ef50d8e-bd7d-489b-88ac-c5f9e16865e7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3" status: 204 len: 0 microversion: 2.1 time: 0.516261 Aug 07 01:13:15.447289 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 354/811] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:13:14 2022] DELETE /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:13:15.454267 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0b456cc9-e69e-4714-875e-a27211ad4f4d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:15.455459 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0b456cc9-e69e-4714-875e-a27211ad4f4d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 8511418d-b773-43fd-adc1-bc8862f82015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:15.463325 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b456cc9-e69e-4714-875e-a27211ad4f4d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:15.464329 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b456cc9-e69e-4714-875e-a27211ad4f4d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:15.465173 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b456cc9-e69e-4714-875e-a27211ad4f4d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:15.466427 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b456cc9-e69e-4714-875e-a27211ad4f4d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:15.467217 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b456cc9-e69e-4714-875e-a27211ad4f4d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:15.467962 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b456cc9-e69e-4714-875e-a27211ad4f4d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:15.631297 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-977bb4dc-0931-480e-9d14-169fa40ddbb9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-789744264", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:15.770766 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-977bb4dc-0931-480e-9d14-169fa40ddbb9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] validate_networks() for None {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:13:16.073657 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0b456cc9-e69e-4714-875e-a27211ad4f4d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:16.115831 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0b456cc9-e69e-4714-875e-a27211ad4f4d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/8511418d-b773-43fd-adc1-bc8862f82015" status: 200 len: 1316 microversion: 2.1 time: 0.666742 Aug 07 01:13:16.117713 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 355/812] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:15 2022] GET /compute/v2.1/servers/8511418d-b773-43fd-adc1-bc8862f82015 => generated 1316 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:16.152972 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7b50dadf-8894-47b8-8b53-7a6326e27f09 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:16.167733 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7b50dadf-8894-47b8-8b53-7a6326e27f09 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: 5777df19-f308-48d1-8f53-fdbf073a4ef2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:16.213820 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b50dadf-8894-47b8-8b53-7a6326e27f09 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:16.219509 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b50dadf-8894-47b8-8b53-7a6326e27f09 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:16.224279 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b50dadf-8894-47b8-8b53-7a6326e27f09 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:16.231413 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b50dadf-8894-47b8-8b53-7a6326e27f09 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:16.237399 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b50dadf-8894-47b8-8b53-7a6326e27f09 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:16.238207 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b50dadf-8894-47b8-8b53-7a6326e27f09 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:16.375722 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7b50dadf-8894-47b8-8b53-7a6326e27f09 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.255615 Aug 07 01:13:16.377047 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 356/813] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:13:16 2022] GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2/os-volume_attachments => generated 197 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:13:16.386816 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5111b5a3-5788-4e38-a34b-da1435b44ed1 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:16.391832 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5111b5a3-5788-4e38-a34b-da1435b44ed1 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:16.410272 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5111b5a3-5788-4e38-a34b-da1435b44ed1 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:16.412941 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5111b5a3-5788-4e38-a34b-da1435b44ed1 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:16.414242 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5111b5a3-5788-4e38-a34b-da1435b44ed1 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:16.415582 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5111b5a3-5788-4e38-a34b-da1435b44ed1 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:16.418118 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5111b5a3-5788-4e38-a34b-da1435b44ed1 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:16.419634 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5111b5a3-5788-4e38-a34b-da1435b44ed1 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:16.426076 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-977bb4dc-0931-480e-9d14-169fa40ddbb9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:13:16.426661 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-977bb4dc-0931-480e-9d14-169fa40ddbb9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:13:16.427719 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-977bb4dc-0931-480e-9d14-169fa40ddbb9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:13:16.428279 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-977bb4dc-0931-480e-9d14-169fa40ddbb9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:13:16.428950 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-977bb4dc-0931-480e-9d14-169fa40ddbb9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:13:16.464409 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-977bb4dc-0931-480e-9d14-169fa40ddbb9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:16.468716 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-977bb4dc-0931-480e-9d14-169fa40ddbb9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:16.469495 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-977bb4dc-0931-480e-9d14-169fa40ddbb9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:16.470717 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-977bb4dc-0931-480e-9d14-169fa40ddbb9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:16.471524 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-977bb4dc-0931-480e-9d14-169fa40ddbb9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:16.472570 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-977bb4dc-0931-480e-9d14-169fa40ddbb9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:16.534631 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-977bb4dc-0931-480e-9d14-169fa40ddbb9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Getting quotas for project 1911abc893ef4c01aa80ca9079dea6e9. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:13:16.566830 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-977bb4dc-0931-480e-9d14-169fa40ddbb9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Getting quotas for user b945db9a6f7a4143a544b76be5e9af9f and project 1911abc893ef4c01aa80ca9079dea6e9. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:13:16.626022 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-977bb4dc-0931-480e-9d14-169fa40ddbb9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:13:16.636113 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-977bb4dc-0931-480e-9d14-169fa40ddbb9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:13:16.870366 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-977bb4dc-0931-480e-9d14-169fa40ddbb9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.419522 Aug 07 01:13:16.878329 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 458/814] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:13:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:13:16.907602 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-98fb9fe6-8735-425f-8bf1-c8c7e5acc428 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e24884b80>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:17.022958 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-98fb9fe6-8735-425f-8bf1-c8c7e5acc428 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/44b163c4-972b-45e4-b79b-00e80eb0b2da" status: 200 len: 1429 microversion: 2.1 time: 0.140770 Aug 07 01:13:17.024573 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 459/815] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:13:16 2022] GET /compute/v2.1/images/44b163c4-972b-45e4-b79b-00e80eb0b2da => generated 1429 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:17.040007 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-f508d13a-6a60-4246-b5db-80b973e8cc8a req-37b10181-effb-4652-aea8-b5a6d5e79ac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a038208d-dae8-432d-97e5-2a58ea093e12", "name": "network-vif-plugged", "status": "completed", "tag": "34e132f0-6845-4fef-bc5f-494eced57c6a"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:17.057722 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f508d13a-6a60-4246-b5db-80b973e8cc8a req-37b10181-effb-4652-aea8-b5a6d5e79ac9 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:17.059524 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f508d13a-6a60-4246-b5db-80b973e8cc8a req-37b10181-effb-4652-aea8-b5a6d5e79ac9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:17.061588 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f508d13a-6a60-4246-b5db-80b973e8cc8a req-37b10181-effb-4652-aea8-b5a6d5e79ac9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:17.113127 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-f508d13a-6a60-4246-b5db-80b973e8cc8a req-37b10181-effb-4652-aea8-b5a6d5e79ac9 service nova] Creating event network-vif-plugged:34e132f0-6845-4fef-bc5f-494eced57c6a for instance a038208d-dae8-432d-97e5-2a58ea093e12 on n-h2-master-1 Aug 07 01:13:17.142976 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-f508d13a-6a60-4246-b5db-80b973e8cc8a req-37b10181-effb-4652-aea8-b5a6d5e79ac9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115357 Aug 07 01:13:17.149474 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 460/816] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:13:17.163093 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5111b5a3-5788-4e38-a34b-da1435b44ed1 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d08a2479f847b4b06d6690f1aedb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06211ba44e4f6d88f9095969001aab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:17.169259 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1862a879-f1f6-4bd0-b74d-bd6d5bc3d157 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:17.174420 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1862a879-f1f6-4bd0-b74d-bd6d5bc3d157 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:17.184345 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5111b5a3-5788-4e38-a34b-da1435b44ed1 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31" status: 200 len: 1388 microversion: 2.1 time: 0.805156 Aug 07 01:13:17.192386 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 357/817] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:16 2022] GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 => generated 1388 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:17.213996 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-80dfaff0-93da-43b6-bddc-17502a993b9a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:17.215496 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-80dfaff0-93da-43b6-bddc-17502a993b9a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 8a19ce68-d784-44a2-b20c-77de1180aba3] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:17.234848 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1862a879-f1f6-4bd0-b74d-bd6d5bc3d157 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:17.235354 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1862a879-f1f6-4bd0-b74d-bd6d5bc3d157 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:17.235803 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1862a879-f1f6-4bd0-b74d-bd6d5bc3d157 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:17.249713 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1862a879-f1f6-4bd0-b74d-bd6d5bc3d157 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:17.252208 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1862a879-f1f6-4bd0-b74d-bd6d5bc3d157 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:17.253751 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1862a879-f1f6-4bd0-b74d-bd6d5bc3d157 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:17.265261 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-80dfaff0-93da-43b6-bddc-17502a993b9a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:17.266160 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-80dfaff0-93da-43b6-bddc-17502a993b9a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:17.267226 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-80dfaff0-93da-43b6-bddc-17502a993b9a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:17.269426 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-80dfaff0-93da-43b6-bddc-17502a993b9a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:17.276946 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-80dfaff0-93da-43b6-bddc-17502a993b9a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:17.278151 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-80dfaff0-93da-43b6-bddc-17502a993b9a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:17.489719 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1862a879-f1f6-4bd0-b74d-bd6d5bc3d157 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:17.505628 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1862a879-f1f6-4bd0-b74d-bd6d5bc3d157 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 200 len: 1287 microversion: 2.1 time: 0.353033 Aug 07 01:13:17.509033 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 461/818] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:17 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 1287 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:17.523816 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-78923231-5ebf-4755-a991-c75229800495 req-45894130-4752-4fb3-ae5a-95b5e72d4c2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8511418d-b773-43fd-adc1-bc8862f82015", "tag": "371f66e7-8f41-4b10-8ddc-d37b54c9607d"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:17.540285 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-78923231-5ebf-4755-a991-c75229800495 req-45894130-4752-4fb3-ae5a-95b5e72d4c2a service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:17.542042 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-78923231-5ebf-4755-a991-c75229800495 req-45894130-4752-4fb3-ae5a-95b5e72d4c2a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:17.542757 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-78923231-5ebf-4755-a991-c75229800495 req-45894130-4752-4fb3-ae5a-95b5e72d4c2a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:17.562192 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-78923231-5ebf-4755-a991-c75229800495 req-45894130-4752-4fb3-ae5a-95b5e72d4c2a service nova] Creating event network-changed:371f66e7-8f41-4b10-8ddc-d37b54c9607d for instance 8511418d-b773-43fd-adc1-bc8862f82015 on n-h2-master-1 Aug 07 01:13:17.570086 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-78923231-5ebf-4755-a991-c75229800495 req-45894130-4752-4fb3-ae5a-95b5e72d4c2a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058731 Aug 07 01:13:17.571564 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 462/819] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:13:17.578357 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-025be03a-59e3-4144-9d4a-09f640013216 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:17.579929 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-025be03a-59e3-4144-9d4a-09f640013216 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:17.789419 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-025be03a-59e3-4144-9d4a-09f640013216 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:17.823902 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-025be03a-59e3-4144-9d4a-09f640013216 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1212 microversion: 2.1 time: 0.247225 Aug 07 01:13:17.827564 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 463/820] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:17 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1212 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:17.850705 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-592574fe-4bf6-415b-b15a-b8ad64983344 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:17.854310 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-592574fe-4bf6-415b-b15a-b8ad64983344 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 8511418d-b773-43fd-adc1-bc8862f82015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:17.887298 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-592574fe-4bf6-415b-b15a-b8ad64983344 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:17.904117 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-592574fe-4bf6-415b-b15a-b8ad64983344 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:17.912190 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-592574fe-4bf6-415b-b15a-b8ad64983344 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:17.925145 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-592574fe-4bf6-415b-b15a-b8ad64983344 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:17.929596 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-592574fe-4bf6-415b-b15a-b8ad64983344 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:17.932908 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-592574fe-4bf6-415b-b15a-b8ad64983344 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:18.378446 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-592574fe-4bf6-415b-b15a-b8ad64983344 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:18.406833 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-592574fe-4bf6-415b-b15a-b8ad64983344 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/8511418d-b773-43fd-adc1-bc8862f82015" status: 200 len: 1316 microversion: 2.1 time: 0.574389 Aug 07 01:13:18.420146 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 464/821] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:17 2022] GET /compute/v2.1/servers/8511418d-b773-43fd-adc1-bc8862f82015 => generated 1316 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:18.433520 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9bc24020-eaab-4483-98e0-d8ede0386624 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:18.436918 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9bc24020-eaab-4483-98e0-d8ede0386624 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: 5777df19-f308-48d1-8f53-fdbf073a4ef2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:18.444718 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9bc24020-eaab-4483-98e0-d8ede0386624 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:18.447925 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9bc24020-eaab-4483-98e0-d8ede0386624 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:18.449054 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9bc24020-eaab-4483-98e0-d8ede0386624 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:18.450058 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9bc24020-eaab-4483-98e0-d8ede0386624 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:18.450747 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9bc24020-eaab-4483-98e0-d8ede0386624 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:18.451382 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9bc24020-eaab-4483-98e0-d8ede0386624 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:18.561196 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9bc24020-eaab-4483-98e0-d8ede0386624 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146466 Aug 07 01:13:18.566458 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 465/822] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:13:18 2022] GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:13:18.580389 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5c5c08d4-00a4-48f5-909f-7982797011b0 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e24901b80>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:18.694538 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5c5c08d4-00a4-48f5-909f-7982797011b0 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/44b163c4-972b-45e4-b79b-00e80eb0b2da" status: 200 len: 1429 microversion: 2.1 time: 0.121495 Aug 07 01:13:18.697428 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 466/823] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:13:18 2022] GET /compute/v2.1/images/44b163c4-972b-45e4-b79b-00e80eb0b2da => generated 1429 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:18.702620 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fe732687-99f7-4973-b268-f5e8ca5bb5ef tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:18.720698 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fe732687-99f7-4973-b268-f5e8ca5bb5ef tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:18.749208 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe732687-99f7-4973-b268-f5e8ca5bb5ef tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:18.750320 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe732687-99f7-4973-b268-f5e8ca5bb5ef tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:18.751374 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe732687-99f7-4973-b268-f5e8ca5bb5ef tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:18.753219 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe732687-99f7-4973-b268-f5e8ca5bb5ef tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:18.754236 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe732687-99f7-4973-b268-f5e8ca5bb5ef tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:18.754991 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe732687-99f7-4973-b268-f5e8ca5bb5ef tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:19.296137 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-80dfaff0-93da-43b6-bddc-17502a993b9a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:19.309522 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fe732687-99f7-4973-b268-f5e8ca5bb5ef tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d08a2479f847b4b06d6690f1aedb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06211ba44e4f6d88f9095969001aab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:19.422663 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-80dfaff0-93da-43b6-bddc-17502a993b9a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3" status: 200 len: 1527 microversion: 2.1 time: 2.225493 Aug 07 01:13:19.428790 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fe732687-99f7-4973-b268-f5e8ca5bb5ef tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31" status: 200 len: 1388 microversion: 2.1 time: 0.729577 Aug 07 01:13:19.430697 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 358/824] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:17 2022] GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3 => generated 1527 bytes in 2237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:19.463960 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 467/825] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:18 2022] GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 => generated 1388 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:19.479811 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e1180851-7dcd-46ce-ba29-ed407facdb1a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:19.481056 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e1180851-7dcd-46ce-ba29-ed407facdb1a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:19.481447 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-584b9b9a-309e-4ec0-a34a-9f2f2964fdd7 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:19.482740 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-584b9b9a-309e-4ec0-a34a-9f2f2964fdd7 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:19.488925 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:19.499333 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-584b9b9a-309e-4ec0-a34a-9f2f2964fdd7 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:19.500696 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-584b9b9a-309e-4ec0-a34a-9f2f2964fdd7 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:19.501810 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-584b9b9a-309e-4ec0-a34a-9f2f2964fdd7 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:19.503676 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-584b9b9a-309e-4ec0-a34a-9f2f2964fdd7 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:19.505733 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-584b9b9a-309e-4ec0-a34a-9f2f2964fdd7 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:19.506857 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-584b9b9a-309e-4ec0-a34a-9f2f2964fdd7 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:19.507369 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1180851-7dcd-46ce-ba29-ed407facdb1a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:19.517791 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1180851-7dcd-46ce-ba29-ed407facdb1a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:19.518621 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1180851-7dcd-46ce-ba29-ed407facdb1a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:19.521721 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1180851-7dcd-46ce-ba29-ed407facdb1a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:19.524004 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1180851-7dcd-46ce-ba29-ed407facdb1a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:19.525832 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1180851-7dcd-46ce-ba29-ed407facdb1a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:19.672611 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-584b9b9a-309e-4ec0-a34a-9f2f2964fdd7 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:19.686785 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-584b9b9a-309e-4ec0-a34a-9f2f2964fdd7 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1208 microversion: 2.1 time: 0.218979 Aug 07 01:13:19.690702 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 468/826] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:19 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1208 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:19.717983 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-1d818ee9-a9ad-433c-a6a1-67e95f75e737 req-a1056212-8e1b-4a45-a254-f357eb57f3d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81ae2aca-ae4d-4dc3-8c29-4da2460bcc31", "name": "network-vif-plugged", "status": "completed", "tag": "56265c55-bdaf-4051-ad48-6b3b5662fe2f"}, {"server_uuid": "8a19ce68-d784-44a2-b20c-77de1180aba3", "name": "network-vif-plugged", "status": "completed", "tag": "bb072379-0a62-4d26-a5df-c2124b2d9757"}, {"server_uuid": "8a19ce68-d784-44a2-b20c-77de1180aba3", "name": "network-vif-unplugged", "status": "completed", "tag": "bb072379-0a62-4d26-a5df-c2124b2d9757"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:19.752598 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-1d818ee9-a9ad-433c-a6a1-67e95f75e737 req-a1056212-8e1b-4a45-a254-f357eb57f3d3 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:19.753232 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-1d818ee9-a9ad-433c-a6a1-67e95f75e737 req-a1056212-8e1b-4a45-a254-f357eb57f3d3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:19.753913 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-1d818ee9-a9ad-433c-a6a1-67e95f75e737 req-a1056212-8e1b-4a45-a254-f357eb57f3d3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:19.808534 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-1d818ee9-a9ad-433c-a6a1-67e95f75e737 req-a1056212-8e1b-4a45-a254-f357eb57f3d3 service nova] Creating event network-vif-plugged:56265c55-bdaf-4051-ad48-6b3b5662fe2f for instance 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 on n-h1-master-1 Aug 07 01:13:19.809478 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-1d818ee9-a9ad-433c-a6a1-67e95f75e737 req-a1056212-8e1b-4a45-a254-f357eb57f3d3 service nova] Creating event network-vif-plugged:bb072379-0a62-4d26-a5df-c2124b2d9757 for instance 8a19ce68-d784-44a2-b20c-77de1180aba3 on n-h1-master-1 Aug 07 01:13:19.810717 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-1d818ee9-a9ad-433c-a6a1-67e95f75e737 req-a1056212-8e1b-4a45-a254-f357eb57f3d3 service nova] Creating event network-vif-unplugged:bb072379-0a62-4d26-a5df-c2124b2d9757 for instance 8a19ce68-d784-44a2-b20c-77de1180aba3 on n-h1-master-1 Aug 07 01:13:19.842092 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-1d818ee9-a9ad-433c-a6a1-67e95f75e737 req-a1056212-8e1b-4a45-a254-f357eb57f3d3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.147316 Aug 07 01:13:19.844107 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 469/827] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:13:19.853723 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-22fafabf-88b9-4b20-a8ae-fdde96e8ff69 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:19.854733 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-22fafabf-88b9-4b20-a8ae-fdde96e8ff69 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 8511418d-b773-43fd-adc1-bc8862f82015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:19.864083 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22fafabf-88b9-4b20-a8ae-fdde96e8ff69 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:19.864961 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22fafabf-88b9-4b20-a8ae-fdde96e8ff69 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:19.866064 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22fafabf-88b9-4b20-a8ae-fdde96e8ff69 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:19.867383 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22fafabf-88b9-4b20-a8ae-fdde96e8ff69 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:19.868331 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22fafabf-88b9-4b20-a8ae-fdde96e8ff69 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:19.869072 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22fafabf-88b9-4b20-a8ae-fdde96e8ff69 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:20.042710 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e1180851-7dcd-46ce-ba29-ed407facdb1a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:20.060359 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e1180851-7dcd-46ce-ba29-ed407facdb1a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 200 len: 1293 microversion: 2.1 time: 0.606363 Aug 07 01:13:20.063165 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 359/828] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:19 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 1293 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:20.072534 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a2f6388d-e60c-4cb7-9237-a32ae8f4aafd tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:20.075573 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a2f6388d-e60c-4cb7-9237-a32ae8f4aafd tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: 5777df19-f308-48d1-8f53-fdbf073a4ef2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:20.083837 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2f6388d-e60c-4cb7-9237-a32ae8f4aafd tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:20.084813 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2f6388d-e60c-4cb7-9237-a32ae8f4aafd tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:20.085433 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2f6388d-e60c-4cb7-9237-a32ae8f4aafd tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:20.086427 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2f6388d-e60c-4cb7-9237-a32ae8f4aafd tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:20.087069 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2f6388d-e60c-4cb7-9237-a32ae8f4aafd tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:20.087673 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2f6388d-e60c-4cb7-9237-a32ae8f4aafd tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:20.161694 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a2f6388d-e60c-4cb7-9237-a32ae8f4aafd tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096051 Aug 07 01:13:20.162741 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 360/829] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:13:20 2022] GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:13:20.168549 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8d87b7d5-adcc-4b16-88b2-bf140e7a7b44 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e24900040>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:20.255332 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8d87b7d5-adcc-4b16-88b2-bf140e7a7b44 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/44b163c4-972b-45e4-b79b-00e80eb0b2da" status: 200 len: 1429 microversion: 2.1 time: 0.090933 Aug 07 01:13:20.260494 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 361/830] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:13:20 2022] GET /compute/v2.1/images/44b163c4-972b-45e4-b79b-00e80eb0b2da => generated 1429 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:20.441211 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-22fafabf-88b9-4b20-a8ae-fdde96e8ff69 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:20.458530 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-22fafabf-88b9-4b20-a8ae-fdde96e8ff69 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/8511418d-b773-43fd-adc1-bc8862f82015" status: 200 len: 1316 microversion: 2.1 time: 0.611763 Aug 07 01:13:20.469836 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 470/831] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:19 2022] GET /compute/v2.1/servers/8511418d-b773-43fd-adc1-bc8862f82015 => generated 1316 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:20.496826 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0231bc17-3391-4c6f-9614-68a83b207e49 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:20.502324 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0231bc17-3391-4c6f-9614-68a83b207e49 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 8a19ce68-d784-44a2-b20c-77de1180aba3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:20.550968 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0231bc17-3391-4c6f-9614-68a83b207e49 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:20.557591 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0231bc17-3391-4c6f-9614-68a83b207e49 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:20.558964 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0231bc17-3391-4c6f-9614-68a83b207e49 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:20.560467 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0231bc17-3391-4c6f-9614-68a83b207e49 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:20.570281 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0231bc17-3391-4c6f-9614-68a83b207e49 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:20.573363 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0231bc17-3391-4c6f-9614-68a83b207e49 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:20.908375 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0231bc17-3391-4c6f-9614-68a83b207e49 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:20.947952 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0231bc17-3391-4c6f-9614-68a83b207e49 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3" status: 200 len: 1485 microversion: 2.1 time: 0.470923 Aug 07 01:13:20.955264 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 471/832] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:20 2022] GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3 => generated 1485 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:20.978776 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dba1b437-066f-49c6-9176-48cbc3943c74 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:20.981496 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-dba1b437-066f-49c6-9176-48cbc3943c74 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:20.989008 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2ba9b5a0-e77f-4e43-b949-41e913a5549c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1441487876", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:21.012637 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dba1b437-066f-49c6-9176-48cbc3943c74 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:21.013869 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dba1b437-066f-49c6-9176-48cbc3943c74 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:21.022122 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dba1b437-066f-49c6-9176-48cbc3943c74 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:21.024213 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dba1b437-066f-49c6-9176-48cbc3943c74 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:21.026633 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dba1b437-066f-49c6-9176-48cbc3943c74 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:21.041803 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dba1b437-066f-49c6-9176-48cbc3943c74 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:21.150955 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-2ba9b5a0-e77f-4e43-b949-41e913a5549c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] validate_networks() for None {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:13:21.305253 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-dba1b437-066f-49c6-9176-48cbc3943c74 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d08a2479f847b4b06d6690f1aedb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06211ba44e4f6d88f9095969001aab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:21.320980 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-dba1b437-066f-49c6-9176-48cbc3943c74 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31" status: 200 len: 1388 microversion: 2.1 time: 0.363486 Aug 07 01:13:21.321944 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 472/833] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:20 2022] GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 => generated 1388 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:21.329049 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-b09116f6-7511-4949-9b9f-71d8df37238b req-3b11c3ce-0930-4f4b-953b-4152f002ce62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a19ce68-d784-44a2-b20c-77de1180aba3", "name": "network-vif-deleted", "tag": "bb072379-0a62-4d26-a5df-c2124b2d9757"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:21.356416 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b09116f6-7511-4949-9b9f-71d8df37238b req-3b11c3ce-0930-4f4b-953b-4152f002ce62 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:21.358887 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b09116f6-7511-4949-9b9f-71d8df37238b req-3b11c3ce-0930-4f4b-953b-4152f002ce62 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:21.360106 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b09116f6-7511-4949-9b9f-71d8df37238b req-3b11c3ce-0930-4f4b-953b-4152f002ce62 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:21.391709 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-b09116f6-7511-4949-9b9f-71d8df37238b req-3b11c3ce-0930-4f4b-953b-4152f002ce62 service nova] Creating event network-vif-deleted:bb072379-0a62-4d26-a5df-c2124b2d9757 for instance 8a19ce68-d784-44a2-b20c-77de1180aba3 on n-h1-master-1 Aug 07 01:13:21.462174 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-b09116f6-7511-4949-9b9f-71d8df37238b req-3b11c3ce-0930-4f4b-953b-4152f002ce62 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134114 Aug 07 01:13:21.466301 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 473/834] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:13:21.493583 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-33b137d6-d855-40c8-b6a7-a03cecec43fa tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:21.497477 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-33b137d6-d855-40c8-b6a7-a03cecec43fa tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:21.536430 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33b137d6-d855-40c8-b6a7-a03cecec43fa tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:21.543170 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33b137d6-d855-40c8-b6a7-a03cecec43fa tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:21.544651 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33b137d6-d855-40c8-b6a7-a03cecec43fa tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:21.547515 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33b137d6-d855-40c8-b6a7-a03cecec43fa tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:21.548960 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33b137d6-d855-40c8-b6a7-a03cecec43fa tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:21.550248 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33b137d6-d855-40c8-b6a7-a03cecec43fa tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:22.471127 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-2ba9b5a0-e77f-4e43-b949-41e913a5549c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:13:22.475036 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-2ba9b5a0-e77f-4e43-b949-41e913a5549c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:13:22.475966 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-2ba9b5a0-e77f-4e43-b949-41e913a5549c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:13:22.476610 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-2ba9b5a0-e77f-4e43-b949-41e913a5549c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:13:22.484971 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-2ba9b5a0-e77f-4e43-b949-41e913a5549c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:13:22.523322 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2ba9b5a0-e77f-4e43-b949-41e913a5549c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:22.524213 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2ba9b5a0-e77f-4e43-b949-41e913a5549c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:22.524999 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2ba9b5a0-e77f-4e43-b949-41e913a5549c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:22.526242 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2ba9b5a0-e77f-4e43-b949-41e913a5549c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:22.526943 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2ba9b5a0-e77f-4e43-b949-41e913a5549c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:22.527567 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2ba9b5a0-e77f-4e43-b949-41e913a5549c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:22.595870 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-2ba9b5a0-e77f-4e43-b949-41e913a5549c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Getting quotas for project 76537752718449e19d6ad94c8e3bc973. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:13:22.611401 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-2ba9b5a0-e77f-4e43-b949-41e913a5549c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Getting quotas for user 26994bfd2e094415bb9b6e265d52eeae and project 76537752718449e19d6ad94c8e3bc973. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:13:22.660870 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2ba9b5a0-e77f-4e43-b949-41e913a5549c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:13:22.671349 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2ba9b5a0-e77f-4e43-b949-41e913a5549c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:13:22.791561 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2ba9b5a0-e77f-4e43-b949-41e913a5549c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.528542 Aug 07 01:13:22.792530 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 362/835] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:13:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:13:22.809529 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-01284f27-cd99-4950-8ac4-5f28634e03f1 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:22.810337 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-01284f27-cd99-4950-8ac4-5f28634e03f1 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:22.821039 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-01284f27-cd99-4950-8ac4-5f28634e03f1 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:22.829422 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-01284f27-cd99-4950-8ac4-5f28634e03f1 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:22.830096 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-01284f27-cd99-4950-8ac4-5f28634e03f1 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:22.830889 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-01284f27-cd99-4950-8ac4-5f28634e03f1 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:22.831379 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-01284f27-cd99-4950-8ac4-5f28634e03f1 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:22.832243 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-01284f27-cd99-4950-8ac4-5f28634e03f1 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:23.309434 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-33b137d6-d855-40c8-b6a7-a03cecec43fa tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:23.337069 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-33b137d6-d855-40c8-b6a7-a03cecec43fa tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1312 microversion: 2.1 time: 1.868506 Aug 07 01:13:23.345113 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 474/836] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:21 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1312 bytes in 1878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:23.400560 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d844b453-ea61-4b94-8dab-3b865dddd459 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:23.413839 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d844b453-ea61-4b94-8dab-3b865dddd459 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: 5777df19-f308-48d1-8f53-fdbf073a4ef2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:23.450186 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d844b453-ea61-4b94-8dab-3b865dddd459 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:23.456789 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d844b453-ea61-4b94-8dab-3b865dddd459 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:23.457805 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d844b453-ea61-4b94-8dab-3b865dddd459 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:23.459221 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d844b453-ea61-4b94-8dab-3b865dddd459 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:23.460284 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d844b453-ea61-4b94-8dab-3b865dddd459 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:23.464908 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d844b453-ea61-4b94-8dab-3b865dddd459 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:23.530656 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:23.579097 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d844b453-ea61-4b94-8dab-3b865dddd459 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.215694 Aug 07 01:13:23.582029 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 475/837] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:13:23 2022] GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2/os-volume_attachments => generated 197 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:13:23.597650 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fbb70a4d-a203-402f-829b-3a35c3a9713d tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e24877c10>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:23.697070 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fbb70a4d-a203-402f-829b-3a35c3a9713d tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/44b163c4-972b-45e4-b79b-00e80eb0b2da" status: 200 len: 1429 microversion: 2.1 time: 0.103312 Aug 07 01:13:23.719705 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 476/838] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:13:23 2022] GET /compute/v2.1/images/44b163c4-972b-45e4-b79b-00e80eb0b2da => generated 1429 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:23.724428 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-adb8f234-10f4-40b5-8b00-3a9dcb78f8e9 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:23.725276 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-adb8f234-10f4-40b5-8b00-3a9dcb78f8e9 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 8511418d-b773-43fd-adc1-bc8862f82015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:23.758960 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-adb8f234-10f4-40b5-8b00-3a9dcb78f8e9 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:23.767803 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-adb8f234-10f4-40b5-8b00-3a9dcb78f8e9 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:23.768389 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-adb8f234-10f4-40b5-8b00-3a9dcb78f8e9 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:23.769163 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-adb8f234-10f4-40b5-8b00-3a9dcb78f8e9 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:23.769646 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-adb8f234-10f4-40b5-8b00-3a9dcb78f8e9 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:23.770324 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-adb8f234-10f4-40b5-8b00-3a9dcb78f8e9 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:24.097058 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-01284f27-cd99-4950-8ac4-5f28634e03f1 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:24.150362 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-01284f27-cd99-4950-8ac4-5f28634e03f1 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 200 len: 1360 microversion: 2.1 time: 1.351382 Aug 07 01:13:24.175878 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 363/839] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:22 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 1360 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:24.191931 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0b0d07d9-b943-47ac-980c-aadc643e41db tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:24.193508 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0b0d07d9-b943-47ac-980c-aadc643e41db tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 8a19ce68-d784-44a2-b20c-77de1180aba3] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:24.209758 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b0d07d9-b943-47ac-980c-aadc643e41db tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:24.210644 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b0d07d9-b943-47ac-980c-aadc643e41db tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:24.211309 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b0d07d9-b943-47ac-980c-aadc643e41db tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:24.212463 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b0d07d9-b943-47ac-980c-aadc643e41db tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:24.213414 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b0d07d9-b943-47ac-980c-aadc643e41db tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:24.215767 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b0d07d9-b943-47ac-980c-aadc643e41db tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:24.237220 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-0b0d07d9-b943-47ac-980c-aadc643e41db tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] HTTP exception thrown: Instance 8a19ce68-d784-44a2-b20c-77de1180aba3 could not be found. Aug 07 01:13:24.239665 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0b0d07d9-b943-47ac-980c-aadc643e41db tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Request method failure captured: Aug 07 01:13:24.239665 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3 HTTP/1.1 Aug 07 01:13:24.239665 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:13:24.239665 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:13:24.239665 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:13:24.239665 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:13:24.239665 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:13:24.239665 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:13:24.239665 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:13:24.239665 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:13:24.239665 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xFJvA8aViwvAloPsDf2VckLIvT0ef2dFkqEzqRHcsoXzKL-UrjSbgq9qrhn-Kr0K6IWORgsxpa0ZC6p7prEjOQjpXXrO_P6Q36zbcHdiXbdtz0b1lfjcwupDS07IycJWoRXidnJpp03pTzYbxhgdiNsodOZkAAXZnRnVK8CHn-Gq7M Aug 07 01:13:24.239665 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:13:24.239665 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:13:24.239665 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:13:24.239665 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:13:24.239665 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:13:24.239665 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:13:24.239665 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 4e443158f15b42a3a795950a7c409a38 Aug 07 01:13:24.239665 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:13:24.239665 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:13:24.239665 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:13:24.241237 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4e443158f15b42a3a795950a7c409a38", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:13:24.241237 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:13:24.241237 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 4e443158f15b42a3a795950a7c409a38 Aug 07 01:13:24.241237 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:13:24.241237 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ImagesOneServerNegativeTestJSON-439364583-project Aug 07 01:13:24.241237 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:13:24.241237 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:13:24.241237 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: c135ba135fd946149ace9a86c7c52e80 Aug 07 01:13:24.241237 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-439364583-project Aug 07 01:13:24.241237 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:13:24.241237 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 8a19ce68-d784-44a2-b20c-77de1180aba3 could not be found. Aug 07 01:13:24.241237 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '8a19ce68-d784-44a2-b20c-77de1180aba3'} Aug 07 01:13:24.241980 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:13:24.241980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:24.241980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:13:24.241980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:13:24.241980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:13:24.241980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:13:24.241980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:13:24.241980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:13:24.241980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:13:24.241980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:13:24.241980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a19ce68-d784-44a2-b20c-77de1180aba3 could not be found. Aug 07 01:13:24.241980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:24.241980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:13:24.241980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:24.241980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:24.241980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:13:24.241980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:13:24.241980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:13:24.241980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:13:24.241980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:13:24.243216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:13:24.243216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:13:24.243216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:13:24.243216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:13:24.243216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:13:24.243216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:13:24.243216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:13:24.243216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a19ce68-d784-44a2-b20c-77de1180aba3 could not be found. Aug 07 01:13:24.243216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:24.243216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:13:24.243216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:24.243216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:24.243216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:13:24.243216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:13:24.243216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:13:24.243216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:13:24.243216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a19ce68-d784-44a2-b20c-77de1180aba3 could not be found. Aug 07 01:13:24.243216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:24.245261 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0b0d07d9-b943-47ac-980c-aadc643e41db tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Returning 404 to user: Instance 8a19ce68-d784-44a2-b20c-77de1180aba3 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:13:24.246296 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0b0d07d9-b943-47ac-980c-aadc643e41db tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3" status: 404 len: 111 microversion: 2.1 time: 0.068836 Aug 07 01:13:24.260191 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 364/840] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:24 2022] GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:13:24.266855 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8e1450fd-8910-4197-9f52-263787eb59f5 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:24.267820 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8e1450fd-8910-4197-9f52-263787eb59f5 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:24.282149 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8e1450fd-8910-4197-9f52-263787eb59f5 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:24.283546 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8e1450fd-8910-4197-9f52-263787eb59f5 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:24.285699 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8e1450fd-8910-4197-9f52-263787eb59f5 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:24.288117 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8e1450fd-8910-4197-9f52-263787eb59f5 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:24.288857 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8e1450fd-8910-4197-9f52-263787eb59f5 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:24.291557 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8e1450fd-8910-4197-9f52-263787eb59f5 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:24.993132 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-adb8f234-10f4-40b5-8b00-3a9dcb78f8e9 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:25.016464 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-adb8f234-10f4-40b5-8b00-3a9dcb78f8e9 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/8511418d-b773-43fd-adc1-bc8862f82015" status: 200 len: 1316 microversion: 2.1 time: 1.293384 Aug 07 01:13:25.017423 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 477/841] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:23 2022] GET /compute/v2.1/servers/8511418d-b773-43fd-adc1-bc8862f82015 => generated 1316 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:25.029238 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-922918c5-400c-43d8-bcad-07b78ae41508 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1788325491", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:25.146530 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-922918c5-400c-43d8-bcad-07b78ae41508 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] validate_networks() for None {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:13:25.197754 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8e1450fd-8910-4197-9f52-263787eb59f5 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d08a2479f847b4b06d6690f1aedb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06211ba44e4f6d88f9095969001aab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:25.213083 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8e1450fd-8910-4197-9f52-263787eb59f5 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31" status: 200 len: 1587 microversion: 2.1 time: 0.950180 Aug 07 01:13:25.235463 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 365/842] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:24 2022] GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 => generated 1587 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:25.241913 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f1c8bdc4-0ccd-43a0-9adb-0381de60590b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:25.248159 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f1c8bdc4-0ccd-43a0-9adb-0381de60590b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:25.264991 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1c8bdc4-0ccd-43a0-9adb-0381de60590b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:25.282761 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1c8bdc4-0ccd-43a0-9adb-0381de60590b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:25.283677 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1c8bdc4-0ccd-43a0-9adb-0381de60590b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:25.289151 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1c8bdc4-0ccd-43a0-9adb-0381de60590b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:25.290070 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1c8bdc4-0ccd-43a0-9adb-0381de60590b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:25.290692 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1c8bdc4-0ccd-43a0-9adb-0381de60590b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:25.648336 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-922918c5-400c-43d8-bcad-07b78ae41508 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:13:25.649979 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-922918c5-400c-43d8-bcad-07b78ae41508 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:13:25.659877 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-922918c5-400c-43d8-bcad-07b78ae41508 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:13:25.663977 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-922918c5-400c-43d8-bcad-07b78ae41508 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:13:25.665105 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-922918c5-400c-43d8-bcad-07b78ae41508 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:13:25.684775 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=23 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:25.695709 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-922918c5-400c-43d8-bcad-07b78ae41508 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:25.699113 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-922918c5-400c-43d8-bcad-07b78ae41508 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:25.701437 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-922918c5-400c-43d8-bcad-07b78ae41508 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:25.705443 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-922918c5-400c-43d8-bcad-07b78ae41508 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:25.706425 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-922918c5-400c-43d8-bcad-07b78ae41508 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:25.708501 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-922918c5-400c-43d8-bcad-07b78ae41508 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:25.767317 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-922918c5-400c-43d8-bcad-07b78ae41508 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Getting quotas for project 76537752718449e19d6ad94c8e3bc973. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:13:25.779483 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-922918c5-400c-43d8-bcad-07b78ae41508 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Getting quotas for user 26994bfd2e094415bb9b6e265d52eeae and project 76537752718449e19d6ad94c8e3bc973. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:13:25.804273 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-922918c5-400c-43d8-bcad-07b78ae41508 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:13:25.807585 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-922918c5-400c-43d8-bcad-07b78ae41508 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 5637b619-e3c0-47a9-beb1-2adf3e5ad29c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:13:25.908541 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-922918c5-400c-43d8-bcad-07b78ae41508 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.882872 Aug 07 01:13:25.909553 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 478/843] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:13:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:13:25.932020 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0493d349-b0db-44bb-acb8-bd785fab5774 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:25.935158 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0493d349-b0db-44bb-acb8-bd785fab5774 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: 5777df19-f308-48d1-8f53-fdbf073a4ef2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:25.946197 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0493d349-b0db-44bb-acb8-bd785fab5774 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:25.946698 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0493d349-b0db-44bb-acb8-bd785fab5774 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:25.947152 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0493d349-b0db-44bb-acb8-bd785fab5774 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:25.948407 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0493d349-b0db-44bb-acb8-bd785fab5774 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:25.948894 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0493d349-b0db-44bb-acb8-bd785fab5774 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:25.957158 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0493d349-b0db-44bb-acb8-bd785fab5774 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:26.059464 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0493d349-b0db-44bb-acb8-bd785fab5774 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142446 Aug 07 01:13:26.068580 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 479/844] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:13:25 2022] GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:13:26.088601 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c239653d-ba2b-407a-8313-f0192e9d8dea tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-507574410", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:26.254597 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-c239653d-ba2b-407a-8313-f0192e9d8dea tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] validate_networks() for [('a36c95a7-f5a6-4689-9476-42d2c17376f3', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:13:26.439962 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f1c8bdc4-0ccd-43a0-9adb-0381de60590b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:26.457220 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f1c8bdc4-0ccd-43a0-9adb-0381de60590b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1312 microversion: 2.1 time: 1.220073 Aug 07 01:13:26.461486 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 366/845] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:25 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1312 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:26.477795 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-56899a7c-920e-41f4-8681-6fb56590f3d9 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e24971790>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:26.621625 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-56899a7c-920e-41f4-8681-6fb56590f3d9 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/44b163c4-972b-45e4-b79b-00e80eb0b2da" status: 200 len: 1429 microversion: 2.1 time: 0.154994 Aug 07 01:13:26.630647 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 367/846] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:13:26 2022] GET /compute/v2.1/images/44b163c4-972b-45e4-b79b-00e80eb0b2da => generated 1429 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:26.636380 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f4d79975-19a7-4ad6-8fee-8a06d54d3374 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:26.648468 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f4d79975-19a7-4ad6-8fee-8a06d54d3374 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:26.656610 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4d79975-19a7-4ad6-8fee-8a06d54d3374 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:26.668372 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4d79975-19a7-4ad6-8fee-8a06d54d3374 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:26.669069 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4d79975-19a7-4ad6-8fee-8a06d54d3374 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:26.676965 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4d79975-19a7-4ad6-8fee-8a06d54d3374 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:26.677566 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4d79975-19a7-4ad6-8fee-8a06d54d3374 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:26.678105 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4d79975-19a7-4ad6-8fee-8a06d54d3374 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:27.853684 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f4d79975-19a7-4ad6-8fee-8a06d54d3374 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:27.869091 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f4d79975-19a7-4ad6-8fee-8a06d54d3374 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 200 len: 1360 microversion: 2.1 time: 1.236514 Aug 07 01:13:27.872607 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 368/847] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:26 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 1360 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:27.884828 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-c239653d-ba2b-407a-8313-f0192e9d8dea tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:13:27.887827 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-c239653d-ba2b-407a-8313-f0192e9d8dea tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:13:27.889198 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-c239653d-ba2b-407a-8313-f0192e9d8dea tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:13:27.890290 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-c239653d-ba2b-407a-8313-f0192e9d8dea tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:13:27.892254 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-c239653d-ba2b-407a-8313-f0192e9d8dea tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:13:27.893458 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-dbc2507e-5235-445a-9be6-dff962897b51 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:27.894022 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-dbc2507e-5235-445a-9be6-dff962897b51 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:27.914840 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dbc2507e-5235-445a-9be6-dff962897b51 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:27.915409 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dbc2507e-5235-445a-9be6-dff962897b51 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:27.915860 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dbc2507e-5235-445a-9be6-dff962897b51 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:27.916844 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dbc2507e-5235-445a-9be6-dff962897b51 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:27.917527 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dbc2507e-5235-445a-9be6-dff962897b51 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:27.918173 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dbc2507e-5235-445a-9be6-dff962897b51 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:27.936959 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c239653d-ba2b-407a-8313-f0192e9d8dea tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:27.939031 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c239653d-ba2b-407a-8313-f0192e9d8dea tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:27.939962 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c239653d-ba2b-407a-8313-f0192e9d8dea tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:27.941121 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c239653d-ba2b-407a-8313-f0192e9d8dea tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:27.941830 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c239653d-ba2b-407a-8313-f0192e9d8dea tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:27.942520 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c239653d-ba2b-407a-8313-f0192e9d8dea tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:27.998985 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-c239653d-ba2b-407a-8313-f0192e9d8dea tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Getting quotas for project 4e443158f15b42a3a795950a7c409a38. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:13:28.008197 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-c239653d-ba2b-407a-8313-f0192e9d8dea tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Getting quotas for user c135ba135fd946149ace9a86c7c52e80 and project 4e443158f15b42a3a795950a7c409a38. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:13:28.042892 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c239653d-ba2b-407a-8313-f0192e9d8dea tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:13:28.046257 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c239653d-ba2b-407a-8313-f0192e9d8dea tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 4515975d-ef4b-4f5b-95b7-4b1775b20b81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:13:28.148765 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c239653d-ba2b-407a-8313-f0192e9d8dea tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.078645 Aug 07 01:13:28.155522 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 480/848] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:13:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 2086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:13:28.172769 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-51e7ec66-7ecd-48fa-8994-adf5e36485e1 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:28.173419 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-51e7ec66-7ecd-48fa-8994-adf5e36485e1 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 5637b619-e3c0-47a9-beb1-2adf3e5ad29c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:28.183963 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-dbc2507e-5235-445a-9be6-dff962897b51 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.306154 Aug 07 01:13:28.184691 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 369/849] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Aug 7 01:13:27 2022] GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31/os-interface => generated 284 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:13:28.190494 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6b00974a-8971-497b-ba33-4d29f0e5c8f2 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:28.191124 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6b00974a-8971-497b-ba33-4d29f0e5c8f2 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 8511418d-b773-43fd-adc1-bc8862f82015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:28.194822 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51e7ec66-7ecd-48fa-8994-adf5e36485e1 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:28.195326 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51e7ec66-7ecd-48fa-8994-adf5e36485e1 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:28.195769 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51e7ec66-7ecd-48fa-8994-adf5e36485e1 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:28.196554 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51e7ec66-7ecd-48fa-8994-adf5e36485e1 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:28.197080 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51e7ec66-7ecd-48fa-8994-adf5e36485e1 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:28.197438 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51e7ec66-7ecd-48fa-8994-adf5e36485e1 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:28.214739 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6b00974a-8971-497b-ba33-4d29f0e5c8f2 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:28.219429 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6b00974a-8971-497b-ba33-4d29f0e5c8f2 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:28.223044 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6b00974a-8971-497b-ba33-4d29f0e5c8f2 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:28.224224 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6b00974a-8971-497b-ba33-4d29f0e5c8f2 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:28.230262 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6b00974a-8971-497b-ba33-4d29f0e5c8f2 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:28.234026 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6b00974a-8971-497b-ba33-4d29f0e5c8f2 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:28.609443 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-51e7ec66-7ecd-48fa-8994-adf5e36485e1 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:28.636208 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-51e7ec66-7ecd-48fa-8994-adf5e36485e1 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/5637b619-e3c0-47a9-beb1-2adf3e5ad29c" status: 200 len: 1266 microversion: 2.1 time: 0.478911 Aug 07 01:13:28.637357 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 481/850] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:28 2022] GET /compute/v2.1/servers/5637b619-e3c0-47a9-beb1-2adf3e5ad29c => generated 1266 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:28.670833 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-63527509-e20a-4e33-8d48-d26215f7358a req-c536fcfe-3d75-46ca-87d1-b1427606d0ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08028949-8eca-4017-8cb2-04ab2b9213ae", "tag": "7606e7d3-c5a2-4fdd-b3b8-464769ea2e7b"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:28.730665 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-63527509-e20a-4e33-8d48-d26215f7358a req-c536fcfe-3d75-46ca-87d1-b1427606d0ef service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:28.733650 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-63527509-e20a-4e33-8d48-d26215f7358a req-c536fcfe-3d75-46ca-87d1-b1427606d0ef service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:28.739315 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-63527509-e20a-4e33-8d48-d26215f7358a req-c536fcfe-3d75-46ca-87d1-b1427606d0ef service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:28.802122 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-63527509-e20a-4e33-8d48-d26215f7358a req-c536fcfe-3d75-46ca-87d1-b1427606d0ef service nova] Creating event network-changed:7606e7d3-c5a2-4fdd-b3b8-464769ea2e7b for instance 08028949-8eca-4017-8cb2-04ab2b9213ae on n-h2-master-1 Aug 07 01:13:28.835162 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-63527509-e20a-4e33-8d48-d26215f7358a req-c536fcfe-3d75-46ca-87d1-b1427606d0ef service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193459 Aug 07 01:13:28.845017 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 482/851] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:13:28.861595 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-eaf38f51-e1e1-4a50-910d-420b4403bf07 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:28.867910 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6b00974a-8971-497b-ba33-4d29f0e5c8f2 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:28.869853 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-eaf38f51-e1e1-4a50-910d-420b4403bf07 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: 5777df19-f308-48d1-8f53-fdbf073a4ef2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:28.880109 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6b00974a-8971-497b-ba33-4d29f0e5c8f2 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/8511418d-b773-43fd-adc1-bc8862f82015" status: 200 len: 1316 microversion: 2.1 time: 0.691684 Aug 07 01:13:28.882301 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 370/852] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:28 2022] GET /compute/v2.1/servers/8511418d-b773-43fd-adc1-bc8862f82015 => generated 1316 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:28.893871 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-a4b4a768-8328-49ba-9b33-f95a77a74f08 req-0dd8f5d4-adc2-4106-8a10-2cd3e540d887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8511418d-b773-43fd-adc1-bc8862f82015", "name": "network-vif-plugged", "status": "completed", "tag": "371f66e7-8f41-4b10-8ddc-d37b54c9607d"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:28.907353 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a4b4a768-8328-49ba-9b33-f95a77a74f08 req-0dd8f5d4-adc2-4106-8a10-2cd3e540d887 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:28.908272 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a4b4a768-8328-49ba-9b33-f95a77a74f08 req-0dd8f5d4-adc2-4106-8a10-2cd3e540d887 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:28.912813 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eaf38f51-e1e1-4a50-910d-420b4403bf07 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:28.914846 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eaf38f51-e1e1-4a50-910d-420b4403bf07 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:28.916011 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eaf38f51-e1e1-4a50-910d-420b4403bf07 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:28.917427 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a4b4a768-8328-49ba-9b33-f95a77a74f08 req-0dd8f5d4-adc2-4106-8a10-2cd3e540d887 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:28.918513 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eaf38f51-e1e1-4a50-910d-420b4403bf07 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:28.920400 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eaf38f51-e1e1-4a50-910d-420b4403bf07 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:28.921820 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eaf38f51-e1e1-4a50-910d-420b4403bf07 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:28.950882 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-a4b4a768-8328-49ba-9b33-f95a77a74f08 req-0dd8f5d4-adc2-4106-8a10-2cd3e540d887 service nova] Creating event network-vif-plugged:371f66e7-8f41-4b10-8ddc-d37b54c9607d for instance 8511418d-b773-43fd-adc1-bc8862f82015 on n-h2-master-1 Aug 07 01:13:28.965471 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-a4b4a768-8328-49ba-9b33-f95a77a74f08 req-0dd8f5d4-adc2-4106-8a10-2cd3e540d887 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081509 Aug 07 01:13:28.969150 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 371/853] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:13:28.998329 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-f8a04f2d-bd5a-42d9-bb4c-68accc16a674 req-0669b6dc-b5a4-47a2-a2dd-8d2b9760c175 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "459c9fac-af66-443f-acd3-22587f83ca6e", "tag": "920a50d8-b45c-480e-aaf9-c42f7d1e925e"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:29.019589 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-eaf38f51-e1e1-4a50-910d-420b4403bf07 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.172179 Aug 07 01:13:29.038074 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f8a04f2d-bd5a-42d9-bb4c-68accc16a674 req-0669b6dc-b5a4-47a2-a2dd-8d2b9760c175 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:29.046099 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 483/854] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:13:28 2022] GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2/os-volume_attachments => generated 25 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:13:29.046427 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f8a04f2d-bd5a-42d9-bb4c-68accc16a674 req-0669b6dc-b5a4-47a2-a2dd-8d2b9760c175 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:29.047391 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f8a04f2d-bd5a-42d9-bb4c-68accc16a674 req-0669b6dc-b5a4-47a2-a2dd-8d2b9760c175 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:29.060451 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-21c0634d-ef19-4dce-8dd7-62bf9279a9f3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:29.065511 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-21c0634d-ef19-4dce-8dd7-62bf9279a9f3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:29.084066 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-f8a04f2d-bd5a-42d9-bb4c-68accc16a674 req-0669b6dc-b5a4-47a2-a2dd-8d2b9760c175 service nova] Creating event network-changed:920a50d8-b45c-480e-aaf9-c42f7d1e925e for instance 459c9fac-af66-443f-acd3-22587f83ca6e on n-h2-master-1 Aug 07 01:13:29.089358 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21c0634d-ef19-4dce-8dd7-62bf9279a9f3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:29.093111 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21c0634d-ef19-4dce-8dd7-62bf9279a9f3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:29.096409 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21c0634d-ef19-4dce-8dd7-62bf9279a9f3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:29.097762 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21c0634d-ef19-4dce-8dd7-62bf9279a9f3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:29.098537 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21c0634d-ef19-4dce-8dd7-62bf9279a9f3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:29.099250 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-f8a04f2d-bd5a-42d9-bb4c-68accc16a674 req-0669b6dc-b5a4-47a2-a2dd-8d2b9760c175 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125159 Aug 07 01:13:29.099377 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21c0634d-ef19-4dce-8dd7-62bf9279a9f3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:29.115170 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 372/855] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:13:29.128904 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8fb9df74-2236-4cea-a748-0148c40b8eb2 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e24a46310>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:29.329917 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8fb9df74-2236-4cea-a748-0148c40b8eb2 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/44b163c4-972b-45e4-b79b-00e80eb0b2da" status: 200 len: 1429 microversion: 2.1 time: 0.213206 Aug 07 01:13:29.330881 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 373/856] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:13:29 2022] GET /compute/v2.1/images/44b163c4-972b-45e4-b79b-00e80eb0b2da => generated 1429 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:29.347101 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a5ee22ca-f3c9-4ab5-8021-13a1f2b6bad5 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:29.348566 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a5ee22ca-f3c9-4ab5-8021-13a1f2b6bad5 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 4515975d-ef4b-4f5b-95b7-4b1775b20b81] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:29.557273 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a5ee22ca-f3c9-4ab5-8021-13a1f2b6bad5 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:29.560080 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=19 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:29.571456 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a5ee22ca-f3c9-4ab5-8021-13a1f2b6bad5 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/4515975d-ef4b-4f5b-95b7-4b1775b20b81" status: 200 len: 1224 microversion: 2.1 time: 0.238646 Aug 07 01:13:29.574241 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 374/857] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:29 2022] GET /compute/v2.1/servers/4515975d-ef4b-4f5b-95b7-4b1775b20b81 => generated 1224 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:29.593834 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-826cf08d-7c45-4ef5-8eb6-aff4219050f6 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:29.599492 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-826cf08d-7c45-4ef5-8eb6-aff4219050f6 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:29.616145 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-826cf08d-7c45-4ef5-8eb6-aff4219050f6 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:29.618990 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-826cf08d-7c45-4ef5-8eb6-aff4219050f6 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:29.620031 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-826cf08d-7c45-4ef5-8eb6-aff4219050f6 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:29.628275 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-826cf08d-7c45-4ef5-8eb6-aff4219050f6 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:29.628976 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-826cf08d-7c45-4ef5-8eb6-aff4219050f6 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:29.629678 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-826cf08d-7c45-4ef5-8eb6-aff4219050f6 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:30.041596 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-21c0634d-ef19-4dce-8dd7-62bf9279a9f3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:30.064744 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-21c0634d-ef19-4dce-8dd7-62bf9279a9f3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1312 microversion: 2.1 time: 1.015671 Aug 07 01:13:30.075759 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 484/858] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:29 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1312 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:30.085166 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e30943a6-fd4b-4249-b18f-be65dbecc047 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-203460291", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "cf70f379-7573-4a22-8d03-15664460decc"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:30.175276 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-e30943a6-fd4b-4249-b18f-be65dbecc047 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] validate_networks() for [('cf70f379-7573-4a22-8d03-15664460decc', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:13:31.237627 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-826cf08d-7c45-4ef5-8eb6-aff4219050f6 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:31.251858 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-826cf08d-7c45-4ef5-8eb6-aff4219050f6 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 200 len: 1360 microversion: 2.1 time: 1.672012 Aug 07 01:13:31.255818 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 375/859] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:29 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 1360 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:31.269822 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8bbb03f8-b85c-4092-8e20-b54b28062d14 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:31.273702 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8bbb03f8-b85c-4092-8e20-b54b28062d14 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 5637b619-e3c0-47a9-beb1-2adf3e5ad29c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:31.285998 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:31.293487 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8bbb03f8-b85c-4092-8e20-b54b28062d14 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:31.298466 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8bbb03f8-b85c-4092-8e20-b54b28062d14 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:31.305310 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8bbb03f8-b85c-4092-8e20-b54b28062d14 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:31.306356 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8bbb03f8-b85c-4092-8e20-b54b28062d14 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:31.306851 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8bbb03f8-b85c-4092-8e20-b54b28062d14 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:31.307301 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8bbb03f8-b85c-4092-8e20-b54b28062d14 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:31.473866 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8bbb03f8-b85c-4092-8e20-b54b28062d14 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:31.486518 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8bbb03f8-b85c-4092-8e20-b54b28062d14 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/5637b619-e3c0-47a9-beb1-2adf3e5ad29c" status: 200 len: 1272 microversion: 2.1 time: 0.228536 Aug 07 01:13:31.494507 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 376/860] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:31 2022] GET /compute/v2.1/servers/5637b619-e3c0-47a9-beb1-2adf3e5ad29c => generated 1272 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:31.500460 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-69aace23-36fe-4807-bbdc-c7fbfee5197f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:31.506802 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-69aace23-36fe-4807-bbdc-c7fbfee5197f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 8511418d-b773-43fd-adc1-bc8862f82015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:31.523808 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-69aace23-36fe-4807-bbdc-c7fbfee5197f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:31.535671 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-69aace23-36fe-4807-bbdc-c7fbfee5197f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:31.536457 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-69aace23-36fe-4807-bbdc-c7fbfee5197f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:31.537405 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-69aace23-36fe-4807-bbdc-c7fbfee5197f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:31.538100 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-69aace23-36fe-4807-bbdc-c7fbfee5197f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:31.538744 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-69aace23-36fe-4807-bbdc-c7fbfee5197f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:31.588159 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:31.870561 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e30943a6-fd4b-4249-b18f-be65dbecc047 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:13:31.873914 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e30943a6-fd4b-4249-b18f-be65dbecc047 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:13:31.875194 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e30943a6-fd4b-4249-b18f-be65dbecc047 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:13:31.876297 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e30943a6-fd4b-4249-b18f-be65dbecc047 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:13:31.877282 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e30943a6-fd4b-4249-b18f-be65dbecc047 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:13:31.916482 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e30943a6-fd4b-4249-b18f-be65dbecc047 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:31.917961 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e30943a6-fd4b-4249-b18f-be65dbecc047 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:31.919070 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e30943a6-fd4b-4249-b18f-be65dbecc047 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:31.926529 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e30943a6-fd4b-4249-b18f-be65dbecc047 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:31.927770 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e30943a6-fd4b-4249-b18f-be65dbecc047 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:31.941136 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e30943a6-fd4b-4249-b18f-be65dbecc047 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:32.026431 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-e30943a6-fd4b-4249-b18f-be65dbecc047 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Getting quotas for project 3e6d319a0452448485aa65b7cf1c5b0e. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:13:32.051202 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-e30943a6-fd4b-4249-b18f-be65dbecc047 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Getting quotas for user 7e9dce42ff994d81b1ad6d6c05356c37 and project 3e6d319a0452448485aa65b7cf1c5b0e. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:13:32.110837 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e30943a6-fd4b-4249-b18f-be65dbecc047 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:13:32.115234 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e30943a6-fd4b-4249-b18f-be65dbecc047 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:13:32.245662 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e30943a6-fd4b-4249-b18f-be65dbecc047 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.168330 Aug 07 01:13:32.251077 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 485/861] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:13:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:13:32.293481 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-82ca3338-15f5-41f2-a3a7-bf8a29d09a66 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e24b8f0d0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:32.434611 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-82ca3338-15f5-41f2-a3a7-bf8a29d09a66 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/44b163c4-972b-45e4-b79b-00e80eb0b2da" status: 200 len: 1429 microversion: 2.1 time: 0.165562 Aug 07 01:13:32.441108 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 486/862] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:13:32 2022] GET /compute/v2.1/images/44b163c4-972b-45e4-b79b-00e80eb0b2da => generated 1429 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:32.456134 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-43237d33-44c4-4ca0-b657-ed022c056524 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:32.469486 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-43237d33-44c4-4ca0-b657-ed022c056524 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 4515975d-ef4b-4f5b-95b7-4b1775b20b81] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:32.487608 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43237d33-44c4-4ca0-b657-ed022c056524 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:32.501386 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43237d33-44c4-4ca0-b657-ed022c056524 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:32.502620 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43237d33-44c4-4ca0-b657-ed022c056524 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:32.504314 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43237d33-44c4-4ca0-b657-ed022c056524 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:32.505429 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43237d33-44c4-4ca0-b657-ed022c056524 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:32.506496 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43237d33-44c4-4ca0-b657-ed022c056524 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:32.565175 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=4 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:32.790644 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-43237d33-44c4-4ca0-b657-ed022c056524 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:32.811306 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-43237d33-44c4-4ca0-b657-ed022c056524 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/4515975d-ef4b-4f5b-95b7-4b1775b20b81" status: 200 len: 1282 microversion: 2.1 time: 0.365727 Aug 07 01:13:32.812229 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 487/863] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:32 2022] GET /compute/v2.1/servers/4515975d-ef4b-4f5b-95b7-4b1775b20b81 => generated 1282 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:32.824470 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-59e6c87c-21a4-4b01-a41b-88b6c01a7979 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:32.825124 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-59e6c87c-21a4-4b01-a41b-88b6c01a7979 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:32.840879 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-59e6c87c-21a4-4b01-a41b-88b6c01a7979 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:32.847919 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-59e6c87c-21a4-4b01-a41b-88b6c01a7979 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:32.849786 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-59e6c87c-21a4-4b01-a41b-88b6c01a7979 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:32.862364 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-59e6c87c-21a4-4b01-a41b-88b6c01a7979 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:32.864212 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-59e6c87c-21a4-4b01-a41b-88b6c01a7979 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:32.864741 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-59e6c87c-21a4-4b01-a41b-88b6c01a7979 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:33.755268 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-59e6c87c-21a4-4b01-a41b-88b6c01a7979 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:33.772816 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-59e6c87c-21a4-4b01-a41b-88b6c01a7979 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1312 microversion: 2.1 time: 0.958086 Aug 07 01:13:33.789581 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 488/864] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:32 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1312 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:33.818836 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7ac553ad-8afd-4326-926e-caad6e3460cc tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:33.820235 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7ac553ad-8afd-4326-926e-caad6e3460cc tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:33.831413 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ac553ad-8afd-4326-926e-caad6e3460cc tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:33.831928 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ac553ad-8afd-4326-926e-caad6e3460cc tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:33.832516 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ac553ad-8afd-4326-926e-caad6e3460cc tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:33.833142 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ac553ad-8afd-4326-926e-caad6e3460cc tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:33.833643 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ac553ad-8afd-4326-926e-caad6e3460cc tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:33.834194 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ac553ad-8afd-4326-926e-caad6e3460cc tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:33.883871 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-69aace23-36fe-4807-bbdc-c7fbfee5197f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:33.892855 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-69aace23-36fe-4807-bbdc-c7fbfee5197f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/8511418d-b773-43fd-adc1-bc8862f82015" status: 200 len: 1316 microversion: 2.1 time: 2.396843 Aug 07 01:13:33.894012 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 377/865] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:31 2022] GET /compute/v2.1/servers/8511418d-b773-43fd-adc1-bc8862f82015 => generated 1316 bytes in 2399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:33.911940 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c6ac25ca-7cdd-4074-9194-a30bd03ad837 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:33.922142 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c6ac25ca-7cdd-4074-9194-a30bd03ad837 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:33.933529 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6ac25ca-7cdd-4074-9194-a30bd03ad837 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:33.934107 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6ac25ca-7cdd-4074-9194-a30bd03ad837 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:33.934686 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6ac25ca-7cdd-4074-9194-a30bd03ad837 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:33.939300 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6ac25ca-7cdd-4074-9194-a30bd03ad837 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:33.940308 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6ac25ca-7cdd-4074-9194-a30bd03ad837 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:33.941093 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6ac25ca-7cdd-4074-9194-a30bd03ad837 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:34.063022 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7ac553ad-8afd-4326-926e-caad6e3460cc tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dce42ff994d81b1ad6d6c05356c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6d319a0452448485aa65b7cf1c5b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:34.079797 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7ac553ad-8afd-4326-926e-caad6e3460cc tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6" status: 200 len: 1221 microversion: 2.1 time: 0.282331 Aug 07 01:13:34.081083 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 489/866] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:33 2022] GET /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6 => generated 1221 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:34.089384 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a25347cb-68ad-4ad4-8930-6658fbe2e2e9 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:34.090377 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a25347cb-68ad-4ad4-8930-6658fbe2e2e9 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 5637b619-e3c0-47a9-beb1-2adf3e5ad29c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:34.100130 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a25347cb-68ad-4ad4-8930-6658fbe2e2e9 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:34.101076 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a25347cb-68ad-4ad4-8930-6658fbe2e2e9 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:34.101763 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a25347cb-68ad-4ad4-8930-6658fbe2e2e9 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:34.102715 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a25347cb-68ad-4ad4-8930-6658fbe2e2e9 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:34.105900 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a25347cb-68ad-4ad4-8930-6658fbe2e2e9 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:34.106802 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a25347cb-68ad-4ad4-8930-6658fbe2e2e9 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:34.358780 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a25347cb-68ad-4ad4-8930-6658fbe2e2e9 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:34.368848 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a25347cb-68ad-4ad4-8930-6658fbe2e2e9 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/5637b619-e3c0-47a9-beb1-2adf3e5ad29c" status: 200 len: 1314 microversion: 2.1 time: 0.284386 Aug 07 01:13:34.369668 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 490/867] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:34 2022] GET /compute/v2.1/servers/5637b619-e3c0-47a9-beb1-2adf3e5ad29c => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:34.376526 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0275e092-014c-4eab-9b81-53c61fc5dd01 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:34.377221 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0275e092-014c-4eab-9b81-53c61fc5dd01 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:34.398997 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0275e092-014c-4eab-9b81-53c61fc5dd01 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:34.399705 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0275e092-014c-4eab-9b81-53c61fc5dd01 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:34.400202 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0275e092-014c-4eab-9b81-53c61fc5dd01 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:34.401339 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0275e092-014c-4eab-9b81-53c61fc5dd01 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:34.401871 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0275e092-014c-4eab-9b81-53c61fc5dd01 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:34.402311 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0275e092-014c-4eab-9b81-53c61fc5dd01 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:34.987272 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0275e092-014c-4eab-9b81-53c61fc5dd01 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d08a2479f847b4b06d6690f1aedb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06211ba44e4f6d88f9095969001aab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:35.024600 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0275e092-014c-4eab-9b81-53c61fc5dd01 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31" status: 200 len: 1587 microversion: 2.1 time: 0.653034 Aug 07 01:13:35.048455 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 491/868] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:34 2022] GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 => generated 1587 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:35.066889 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-fdd15cac-a0c7-46b6-b7cc-2969291b3760 req-42d4bc2a-8d3f-4701-9205-aed0119e7b0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81ae2aca-ae4d-4dc3-8c29-4da2460bcc31", "tag": "56265c55-bdaf-4051-ad48-6b3b5662fe2f"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:35.090860 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-fdd15cac-a0c7-46b6-b7cc-2969291b3760 req-42d4bc2a-8d3f-4701-9205-aed0119e7b0f service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:35.107327 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-fdd15cac-a0c7-46b6-b7cc-2969291b3760 req-42d4bc2a-8d3f-4701-9205-aed0119e7b0f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:35.109356 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-fdd15cac-a0c7-46b6-b7cc-2969291b3760 req-42d4bc2a-8d3f-4701-9205-aed0119e7b0f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:35.140975 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c6ac25ca-7cdd-4074-9194-a30bd03ad837 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:35.152520 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c6ac25ca-7cdd-4074-9194-a30bd03ad837 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 200 len: 1360 microversion: 2.1 time: 1.256940 Aug 07 01:13:35.166224 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 378/869] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:33 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 1360 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:35.184304 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-fdd15cac-a0c7-46b6-b7cc-2969291b3760 req-42d4bc2a-8d3f-4701-9205-aed0119e7b0f service nova] Creating event network-changed:56265c55-bdaf-4051-ad48-6b3b5662fe2f for instance 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 on n-h1-master-1 Aug 07 01:13:35.188674 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f422a4c0-7f89-4ab6-a5ec-6eff4a4f324b tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e249043a0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:35.209275 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-fdd15cac-a0c7-46b6-b7cc-2969291b3760 req-42d4bc2a-8d3f-4701-9205-aed0119e7b0f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156729 Aug 07 01:13:35.215123 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 492/870] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:13:35.236062 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2bc11e24-e563-4b9c-9155-2462619a38db tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:35.241113 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2bc11e24-e563-4b9c-9155-2462619a38db tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 4515975d-ef4b-4f5b-95b7-4b1775b20b81] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:35.279622 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2bc11e24-e563-4b9c-9155-2462619a38db tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:35.280745 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2bc11e24-e563-4b9c-9155-2462619a38db tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:35.285085 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2bc11e24-e563-4b9c-9155-2462619a38db tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:35.286872 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2bc11e24-e563-4b9c-9155-2462619a38db tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:35.287178 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f422a4c0-7f89-4ab6-a5ec-6eff4a4f324b tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/44b163c4-972b-45e4-b79b-00e80eb0b2da" status: 200 len: 1429 microversion: 2.1 time: 0.116663 Aug 07 01:13:35.287969 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 379/871] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:13:35 2022] GET /compute/v2.1/images/44b163c4-972b-45e4-b79b-00e80eb0b2da => generated 1429 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:35.290255 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2bc11e24-e563-4b9c-9155-2462619a38db tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:35.291274 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2bc11e24-e563-4b9c-9155-2462619a38db tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:35.313821 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0b08a869-de52-4628-9a44-e2d3455767c4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:35.317529 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0b08a869-de52-4628-9a44-e2d3455767c4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:35.336735 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b08a869-de52-4628-9a44-e2d3455767c4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:35.338700 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b08a869-de52-4628-9a44-e2d3455767c4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:35.340412 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b08a869-de52-4628-9a44-e2d3455767c4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:35.345290 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b08a869-de52-4628-9a44-e2d3455767c4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:35.345975 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b08a869-de52-4628-9a44-e2d3455767c4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:35.347128 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b08a869-de52-4628-9a44-e2d3455767c4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:35.668264 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2bc11e24-e563-4b9c-9155-2462619a38db tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:35.695573 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2bc11e24-e563-4b9c-9155-2462619a38db tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/4515975d-ef4b-4f5b-95b7-4b1775b20b81" status: 200 len: 1282 microversion: 2.1 time: 0.477168 Aug 07 01:13:35.696667 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 493/872] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:35 2022] GET /compute/v2.1/servers/4515975d-ef4b-4f5b-95b7-4b1775b20b81 => generated 1282 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:35.742390 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c3950cb6-cec9-4640-b593-ec2e5a1596cd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:35.743519 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c3950cb6-cec9-4640-b593-ec2e5a1596cd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 8511418d-b773-43fd-adc1-bc8862f82015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:35.770733 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3950cb6-cec9-4640-b593-ec2e5a1596cd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:35.771623 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3950cb6-cec9-4640-b593-ec2e5a1596cd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:35.772478 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3950cb6-cec9-4640-b593-ec2e5a1596cd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:35.773807 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3950cb6-cec9-4640-b593-ec2e5a1596cd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:35.774648 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3950cb6-cec9-4640-b593-ec2e5a1596cd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:35.775445 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3950cb6-cec9-4640-b593-ec2e5a1596cd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:36.547607 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c3950cb6-cec9-4640-b593-ec2e5a1596cd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:36.564961 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c3950cb6-cec9-4640-b593-ec2e5a1596cd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/8511418d-b773-43fd-adc1-bc8862f82015" status: 200 len: 1465 microversion: 2.1 time: 0.834867 Aug 07 01:13:36.567462 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 494/873] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:35 2022] GET /compute/v2.1/servers/8511418d-b773-43fd-adc1-bc8862f82015 => generated 1465 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:36.581369 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-73415394-d0ff-4ae5-8e38-49112d39ea1a tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:36.582167 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-73415394-d0ff-4ae5-8e38-49112d39ea1a tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:36.594615 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73415394-d0ff-4ae5-8e38-49112d39ea1a tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:36.598448 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73415394-d0ff-4ae5-8e38-49112d39ea1a tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:36.601683 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73415394-d0ff-4ae5-8e38-49112d39ea1a tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:36.609186 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73415394-d0ff-4ae5-8e38-49112d39ea1a tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:36.610397 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73415394-d0ff-4ae5-8e38-49112d39ea1a tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:36.611441 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73415394-d0ff-4ae5-8e38-49112d39ea1a tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:37.008030 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-73415394-d0ff-4ae5-8e38-49112d39ea1a tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dce42ff994d81b1ad6d6c05356c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6d319a0452448485aa65b7cf1c5b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:37.022197 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-73415394-d0ff-4ae5-8e38-49112d39ea1a tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6" status: 200 len: 1275 microversion: 2.1 time: 0.452685 Aug 07 01:13:37.036545 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 495/874] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:36 2022] GET /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6 => generated 1275 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:37.050382 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d64afe50-95d4-4a9a-8d26-eff0340db30b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:37.051068 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d64afe50-95d4-4a9a-8d26-eff0340db30b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 5637b619-e3c0-47a9-beb1-2adf3e5ad29c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:37.081792 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d64afe50-95d4-4a9a-8d26-eff0340db30b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:37.085626 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d64afe50-95d4-4a9a-8d26-eff0340db30b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:37.086881 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d64afe50-95d4-4a9a-8d26-eff0340db30b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:37.088699 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d64afe50-95d4-4a9a-8d26-eff0340db30b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:37.089535 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d64afe50-95d4-4a9a-8d26-eff0340db30b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:37.090426 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d64afe50-95d4-4a9a-8d26-eff0340db30b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:37.130160 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0b08a869-de52-4628-9a44-e2d3455767c4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:37.152445 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0b08a869-de52-4628-9a44-e2d3455767c4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1312 microversion: 2.1 time: 1.862066 Aug 07 01:13:37.169984 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 380/875] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:35 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1312 bytes in 1879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:37.189311 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8bc6ad56-09ea-4914-b624-422d59406355 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:37.190440 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8bc6ad56-09ea-4914-b624-422d59406355 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:37.203600 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8bc6ad56-09ea-4914-b624-422d59406355 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:37.205048 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8bc6ad56-09ea-4914-b624-422d59406355 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:37.206107 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8bc6ad56-09ea-4914-b624-422d59406355 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:37.208594 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8bc6ad56-09ea-4914-b624-422d59406355 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:37.209592 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8bc6ad56-09ea-4914-b624-422d59406355 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:37.210599 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8bc6ad56-09ea-4914-b624-422d59406355 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:37.600157 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d64afe50-95d4-4a9a-8d26-eff0340db30b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:37.647586 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d64afe50-95d4-4a9a-8d26-eff0340db30b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/5637b619-e3c0-47a9-beb1-2adf3e5ad29c" status: 200 len: 1314 microversion: 2.1 time: 0.605438 Aug 07 01:13:37.665506 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 496/876] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:37 2022] GET /compute/v2.1/servers/5637b619-e3c0-47a9-beb1-2adf3e5ad29c => generated 1314 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:37.686704 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e90b47f1-1494-4ae0-9db3-044ce9491a01 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e248338b0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:37.836892 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e90b47f1-1494-4ae0-9db3-044ce9491a01 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/44b163c4-972b-45e4-b79b-00e80eb0b2da" status: 200 len: 1429 microversion: 2.1 time: 0.163559 Aug 07 01:13:37.837505 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 497/877] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:13:37 2022] GET /compute/v2.1/images/44b163c4-972b-45e4-b79b-00e80eb0b2da => generated 1429 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:38.273295 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c5d7041d-c91c-4f9d-827d-cae83c6db37c tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:38.274433 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c5d7041d-c91c-4f9d-827d-cae83c6db37c tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] [instance: 8511418d-b773-43fd-adc1-bc8862f82015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:38.313348 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c5d7041d-c91c-4f9d-827d-cae83c6db37c tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:38.314229 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c5d7041d-c91c-4f9d-827d-cae83c6db37c tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:38.314691 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c5d7041d-c91c-4f9d-827d-cae83c6db37c tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:38.315468 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c5d7041d-c91c-4f9d-827d-cae83c6db37c tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:38.316065 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c5d7041d-c91c-4f9d-827d-cae83c6db37c tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:38.316859 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c5d7041d-c91c-4f9d-827d-cae83c6db37c tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:38.396593 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:38.933919 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8bc6ad56-09ea-4914-b624-422d59406355 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:38.961808 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8bc6ad56-09ea-4914-b624-422d59406355 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 200 len: 1360 microversion: 2.1 time: 1.788288 Aug 07 01:13:38.964740 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 381/878] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:37 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 1360 bytes in 1794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:38.986647 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-8a23c087-500a-44dd-81a6-5cd62a2575e8 req-070da52b-0da6-4c03-b838-9089ba92a731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08028949-8eca-4017-8cb2-04ab2b9213ae", "name": "network-vif-plugged", "status": "completed", "tag": "7606e7d3-c5a2-4fdd-b3b8-464769ea2e7b"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:39.007636 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-8a23c087-500a-44dd-81a6-5cd62a2575e8 req-070da52b-0da6-4c03-b838-9089ba92a731 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:39.008970 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-8a23c087-500a-44dd-81a6-5cd62a2575e8 req-070da52b-0da6-4c03-b838-9089ba92a731 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:39.010038 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-8a23c087-500a-44dd-81a6-5cd62a2575e8 req-070da52b-0da6-4c03-b838-9089ba92a731 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:39.043151 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-8a23c087-500a-44dd-81a6-5cd62a2575e8 req-070da52b-0da6-4c03-b838-9089ba92a731 service nova] Creating event network-vif-plugged:7606e7d3-c5a2-4fdd-b3b8-464769ea2e7b for instance 08028949-8eca-4017-8cb2-04ab2b9213ae on n-h2-master-1 Aug 07 01:13:39.057445 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-8a23c087-500a-44dd-81a6-5cd62a2575e8 req-070da52b-0da6-4c03-b838-9089ba92a731 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081656 Aug 07 01:13:39.059445 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 382/879] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:13:39.072213 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9bac2f82-6546-495a-a2db-34fb5f7d438f tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:39.073988 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9bac2f82-6546-495a-a2db-34fb5f7d438f tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 4515975d-ef4b-4f5b-95b7-4b1775b20b81] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:39.087789 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9bac2f82-6546-495a-a2db-34fb5f7d438f tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:39.089092 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9bac2f82-6546-495a-a2db-34fb5f7d438f tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:39.090167 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9bac2f82-6546-495a-a2db-34fb5f7d438f tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:39.094283 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9bac2f82-6546-495a-a2db-34fb5f7d438f tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:39.096348 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9bac2f82-6546-495a-a2db-34fb5f7d438f tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:39.097578 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9bac2f82-6546-495a-a2db-34fb5f7d438f tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:39.100798 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c5d7041d-c91c-4f9d-827d-cae83c6db37c tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/8511418d-b773-43fd-adc1-bc8862f82015" status: 200 len: 1616 microversion: 2.1 time: 1.249484 Aug 07 01:13:39.102207 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 498/880] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:37 2022] GET /compute/v2.1/servers/8511418d-b773-43fd-adc1-bc8862f82015 => generated 1616 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:39.150491 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-2d3cf39e-2034-4eb0-84d2-893b91ad72bb req-b15ac55c-3340-4033-8e89-1e04a2089e67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "766de05a-a562-4045-bdf9-c49050382e1a", "tag": "a4899c9a-669a-4c98-bfc8-6b6f7b2c3f93"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:39.174019 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2d3cf39e-2034-4eb0-84d2-893b91ad72bb req-b15ac55c-3340-4033-8e89-1e04a2089e67 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:39.174985 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2d3cf39e-2034-4eb0-84d2-893b91ad72bb req-b15ac55c-3340-4033-8e89-1e04a2089e67 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:39.176069 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2d3cf39e-2034-4eb0-84d2-893b91ad72bb req-b15ac55c-3340-4033-8e89-1e04a2089e67 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:39.230612 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-2d3cf39e-2034-4eb0-84d2-893b91ad72bb req-b15ac55c-3340-4033-8e89-1e04a2089e67 service nova] Creating event network-changed:a4899c9a-669a-4c98-bfc8-6b6f7b2c3f93 for instance 766de05a-a562-4045-bdf9-c49050382e1a on n-h1-master-1 Aug 07 01:13:39.259975 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-2d3cf39e-2034-4eb0-84d2-893b91ad72bb req-b15ac55c-3340-4033-8e89-1e04a2089e67 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135808 Aug 07 01:13:39.261611 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 499/881] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:13:39.268938 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4e588339-513a-4fab-b783-35e1745d761a tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:39.270349 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4e588339-513a-4fab-b783-35e1745d761a tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:39.274879 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:39.280399 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4e588339-513a-4fab-b783-35e1745d761a tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:39.281358 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4e588339-513a-4fab-b783-35e1745d761a tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:39.282033 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4e588339-513a-4fab-b783-35e1745d761a tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:39.283127 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4e588339-513a-4fab-b783-35e1745d761a tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:39.283823 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4e588339-513a-4fab-b783-35e1745d761a tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:39.285489 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4e588339-513a-4fab-b783-35e1745d761a tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:39.571066 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:39.758142 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4e588339-513a-4fab-b783-35e1745d761a tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dce42ff994d81b1ad6d6c05356c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6d319a0452448485aa65b7cf1c5b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:39.787653 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4e588339-513a-4fab-b783-35e1745d761a tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6" status: 200 len: 1317 microversion: 2.1 time: 0.524081 Aug 07 01:13:39.805359 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 500/882] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:39 2022] GET /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6 => generated 1317 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:39.827917 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5b9d1db5-ebfa-413d-a275-2d50d07b0bb0 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:39.829226 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5b9d1db5-ebfa-413d-a275-2d50d07b0bb0 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:39.841023 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5b9d1db5-ebfa-413d-a275-2d50d07b0bb0 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:39.841726 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5b9d1db5-ebfa-413d-a275-2d50d07b0bb0 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:39.842205 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5b9d1db5-ebfa-413d-a275-2d50d07b0bb0 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:39.843043 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5b9d1db5-ebfa-413d-a275-2d50d07b0bb0 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:39.843522 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5b9d1db5-ebfa-413d-a275-2d50d07b0bb0 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:39.849032 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5b9d1db5-ebfa-413d-a275-2d50d07b0bb0 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:40.161300 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9bac2f82-6546-495a-a2db-34fb5f7d438f tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:40.170982 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9bac2f82-6546-495a-a2db-34fb5f7d438f tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/4515975d-ef4b-4f5b-95b7-4b1775b20b81" status: 200 len: 1324 microversion: 2.1 time: 1.108248 Aug 07 01:13:40.172313 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 383/883] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:39 2022] GET /compute/v2.1/servers/4515975d-ef4b-4f5b-95b7-4b1775b20b81 => generated 1324 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:40.182280 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-14e4beb0-a659-4699-94ed-d40661bf1fd3 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:40.183308 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-14e4beb0-a659-4699-94ed-d40661bf1fd3 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 5637b619-e3c0-47a9-beb1-2adf3e5ad29c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:40.191782 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-14e4beb0-a659-4699-94ed-d40661bf1fd3 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:40.192701 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-14e4beb0-a659-4699-94ed-d40661bf1fd3 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:40.193469 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-14e4beb0-a659-4699-94ed-d40661bf1fd3 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:40.194535 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-14e4beb0-a659-4699-94ed-d40661bf1fd3 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:40.195277 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-14e4beb0-a659-4699-94ed-d40661bf1fd3 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:40.196023 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-14e4beb0-a659-4699-94ed-d40661bf1fd3 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:40.289210 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5b9d1db5-ebfa-413d-a275-2d50d07b0bb0 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:40.310194 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5b9d1db5-ebfa-413d-a275-2d50d07b0bb0 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1312 microversion: 2.1 time: 0.503346 Aug 07 01:13:40.311598 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 501/884] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:39 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1312 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:40.319170 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fabfb4f9-120c-441e-b764-017c2cfd2a8a tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e247d4940>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:40.386787 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fabfb4f9-120c-441e-b764-017c2cfd2a8a tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/44b163c4-972b-45e4-b79b-00e80eb0b2da" status: 200 len: 1438 microversion: 2.1 time: 0.073573 Aug 07 01:13:40.387493 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 502/885] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:13:40 2022] GET /compute/v2.1/images/44b163c4-972b-45e4-b79b-00e80eb0b2da => generated 1438 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:40.392676 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8f9c656e-7f00-4287-a689-b9cbb2edb598 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Action: 'create', calling method: .version_select at 0x7f9e248339d0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1290752908", "policies": ["affinity"]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:40.428821 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-8f9c656e-7f00-4287-a689-b9cbb2edb598 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Getting quotas for project d08d010c14a64f759887be0d2364c6e4. Resources: {'server_groups'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:13:40.436186 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-8f9c656e-7f00-4287-a689-b9cbb2edb598 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Getting quotas for user 32fc1959d8aa41eabcead217b9d7bc47 and project d08d010c14a64f759887be0d2364c6e4. Resources: {'server_groups'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:13:40.507875 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-8f9c656e-7f00-4287-a689-b9cbb2edb598 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Getting quotas for project d08d010c14a64f759887be0d2364c6e4. Resources: {'server_groups'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:13:40.516541 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-8f9c656e-7f00-4287-a689-b9cbb2edb598 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Getting quotas for user 32fc1959d8aa41eabcead217b9d7bc47 and project d08d010c14a64f759887be0d2364c6e4. Resources: {'server_groups'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:13:40.536516 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8f9c656e-7f00-4287-a689-b9cbb2edb598 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.147306 Aug 07 01:13:40.537773 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 503/886] 10.222.0.39 () {60 vars in 1174 bytes} [Sun Aug 7 01:13:40 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:13:40.544584 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3fea89b2-806a-489e-8f15-6dc68d21e1df tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:40.545788 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3fea89b2-806a-489e-8f15-6dc68d21e1df tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:40.553235 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fea89b2-806a-489e-8f15-6dc68d21e1df tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:40.554151 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fea89b2-806a-489e-8f15-6dc68d21e1df tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:40.554658 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fea89b2-806a-489e-8f15-6dc68d21e1df tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:40.555809 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fea89b2-806a-489e-8f15-6dc68d21e1df tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:40.556924 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fea89b2-806a-489e-8f15-6dc68d21e1df tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:40.557538 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fea89b2-806a-489e-8f15-6dc68d21e1df tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:40.709722 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-14e4beb0-a659-4699-94ed-d40661bf1fd3 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:40.720342 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-14e4beb0-a659-4699-94ed-d40661bf1fd3 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/5637b619-e3c0-47a9-beb1-2adf3e5ad29c" status: 200 len: 1314 microversion: 2.1 time: 0.546599 Aug 07 01:13:40.732413 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 384/887] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:40 2022] GET /compute/v2.1/servers/5637b619-e3c0-47a9-beb1-2adf3e5ad29c => generated 1314 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:40.732413 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-f1763f7b-7064-45e7-8274-d057d5649fed req-176e98ef-6a4b-47a9-8011-2ac1e13032ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6", "tag": "86c30725-b72b-49bf-9799-0396a8d1f229"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:40.739982 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f1763f7b-7064-45e7-8274-d057d5649fed req-176e98ef-6a4b-47a9-8011-2ac1e13032ad service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:40.741053 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f1763f7b-7064-45e7-8274-d057d5649fed req-176e98ef-6a4b-47a9-8011-2ac1e13032ad service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:40.741849 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f1763f7b-7064-45e7-8274-d057d5649fed req-176e98ef-6a4b-47a9-8011-2ac1e13032ad service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:40.760450 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-f1763f7b-7064-45e7-8274-d057d5649fed req-176e98ef-6a4b-47a9-8011-2ac1e13032ad service nova] Creating event network-changed:86c30725-b72b-49bf-9799-0396a8d1f229 for instance aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6 on n-h1-master-1 Aug 07 01:13:40.766785 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-f1763f7b-7064-45e7-8274-d057d5649fed req-176e98ef-6a4b-47a9-8011-2ac1e13032ad service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043778 Aug 07 01:13:40.770677 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 385/888] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:13:40.777241 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-eea82636-0c9a-4132-9cc8-de31c6c7ff9d tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e24aa7820>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:40.779203 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3fea89b2-806a-489e-8f15-6dc68d21e1df tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:40.796007 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3fea89b2-806a-489e-8f15-6dc68d21e1df tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 200 len: 1360 microversion: 2.1 time: 0.256364 Aug 07 01:13:40.797205 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 504/889] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:40 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 1360 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:40.809367 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-50426bc1-3bd7-48e7-b3c6-88bc9df95b79 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2126116339", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "3ca9bf80-25d0-438c-8b41-d7d92142db5c"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:40.855802 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-eea82636-0c9a-4132-9cc8-de31c6c7ff9d tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/images/44b163c4-972b-45e4-b79b-00e80eb0b2da" status: 200 len: 1438 microversion: 2.1 time: 0.083756 Aug 07 01:13:40.867498 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 386/890] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:13:40 2022] GET /compute/v2.1/images/44b163c4-972b-45e4-b79b-00e80eb0b2da => generated 1438 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:40.867498 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4df5c5ce-4bea-4daa-9bcf-bed00a3fdb46 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:40.867838 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4df5c5ce-4bea-4daa-9bcf-bed00a3fdb46 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:40.883846 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4df5c5ce-4bea-4daa-9bcf-bed00a3fdb46 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:40.884948 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4df5c5ce-4bea-4daa-9bcf-bed00a3fdb46 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:40.885710 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4df5c5ce-4bea-4daa-9bcf-bed00a3fdb46 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:40.887015 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4df5c5ce-4bea-4daa-9bcf-bed00a3fdb46 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:40.888626 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4df5c5ce-4bea-4daa-9bcf-bed00a3fdb46 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:40.889886 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4df5c5ce-4bea-4daa-9bcf-bed00a3fdb46 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:40.902354 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-50426bc1-3bd7-48e7-b3c6-88bc9df95b79 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] validate_networks() for None {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:13:41.163663 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4df5c5ce-4bea-4daa-9bcf-bed00a3fdb46 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dce42ff994d81b1ad6d6c05356c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6d319a0452448485aa65b7cf1c5b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:41.172300 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4df5c5ce-4bea-4daa-9bcf-bed00a3fdb46 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6" status: 200 len: 1317 microversion: 2.1 time: 0.311961 Aug 07 01:13:41.173004 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 387/891] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:40 2022] GET /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6 => generated 1317 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:41.178436 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9dcd8873-fe57-473d-a06c-8266da8d2ccd tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:41.179209 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9dcd8873-fe57-473d-a06c-8266da8d2ccd tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] [instance: a038208d-dae8-432d-97e5-2a58ea093e12] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:41.188920 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9dcd8873-fe57-473d-a06c-8266da8d2ccd tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:41.189982 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9dcd8873-fe57-473d-a06c-8266da8d2ccd tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:41.191314 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9dcd8873-fe57-473d-a06c-8266da8d2ccd tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:41.192380 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9dcd8873-fe57-473d-a06c-8266da8d2ccd tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:41.193108 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9dcd8873-fe57-473d-a06c-8266da8d2ccd tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:41.193616 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9dcd8873-fe57-473d-a06c-8266da8d2ccd tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:41.319968 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-50426bc1-3bd7-48e7-b3c6-88bc9df95b79 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:13:41.321004 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-50426bc1-3bd7-48e7-b3c6-88bc9df95b79 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:13:41.321492 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-50426bc1-3bd7-48e7-b3c6-88bc9df95b79 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:13:41.321915 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-50426bc1-3bd7-48e7-b3c6-88bc9df95b79 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:13:41.322331 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-50426bc1-3bd7-48e7-b3c6-88bc9df95b79 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:13:41.358408 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-50426bc1-3bd7-48e7-b3c6-88bc9df95b79 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:41.358916 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-50426bc1-3bd7-48e7-b3c6-88bc9df95b79 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:41.359374 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-50426bc1-3bd7-48e7-b3c6-88bc9df95b79 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:41.360183 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-50426bc1-3bd7-48e7-b3c6-88bc9df95b79 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:41.360642 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-50426bc1-3bd7-48e7-b3c6-88bc9df95b79 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:41.361116 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-50426bc1-3bd7-48e7-b3c6-88bc9df95b79 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:41.369201 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=11 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:41.385165 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-50426bc1-3bd7-48e7-b3c6-88bc9df95b79 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Getting quotas for project d08d010c14a64f759887be0d2364c6e4. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:13:41.392211 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-50426bc1-3bd7-48e7-b3c6-88bc9df95b79 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Getting quotas for user 32fc1959d8aa41eabcead217b9d7bc47 and project d08d010c14a64f759887be0d2364c6e4. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:13:41.409315 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-50426bc1-3bd7-48e7-b3c6-88bc9df95b79 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Going to run 2 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:13:41.411928 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-50426bc1-3bd7-48e7-b3c6-88bc9df95b79 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 9a4ced25-d85e-4469-95b6-5e666731a714] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:13:41.453770 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-50426bc1-3bd7-48e7-b3c6-88bc9df95b79 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119516) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 07 01:13:41.481260 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-50426bc1-3bd7-48e7-b3c6-88bc9df95b79 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Getting quotas for project d08d010c14a64f759887be0d2364c6e4. Resources: {'server_group_members'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:13:41.488010 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-50426bc1-3bd7-48e7-b3c6-88bc9df95b79 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Getting quotas for user 32fc1959d8aa41eabcead217b9d7bc47 and project d08d010c14a64f759887be0d2364c6e4. Resources: {'server_group_members'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:13:41.515877 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9dcd8873-fe57-473d-a06c-8266da8d2ccd tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0d09d844bf453cb3e2637d630614ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5c39a06e41406a8c6c99d2e84ab282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:41.533098 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9dcd8873-fe57-473d-a06c-8266da8d2ccd tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12" status: 200 len: 1466 microversion: 2.1 time: 0.358507 Aug 07 01:13:41.534650 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 388/892] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:41 2022] GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12 => generated 1466 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:41.543315 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-381003cf-03ab-4733-b35b-76f926eaa5b8 req-2e0ff7ed-8711-4026-b8cb-f0d261c908a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "459c9fac-af66-443f-acd3-22587f83ca6e", "name": "network-vif-plugged", "status": "completed", "tag": "920a50d8-b45c-480e-aaf9-c42f7d1e925e"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:41.559762 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-381003cf-03ab-4733-b35b-76f926eaa5b8 req-2e0ff7ed-8711-4026-b8cb-f0d261c908a8 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:41.562071 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-381003cf-03ab-4733-b35b-76f926eaa5b8 req-2e0ff7ed-8711-4026-b8cb-f0d261c908a8 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:41.563139 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-381003cf-03ab-4733-b35b-76f926eaa5b8 req-2e0ff7ed-8711-4026-b8cb-f0d261c908a8 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:41.563571 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-50426bc1-3bd7-48e7-b3c6-88bc9df95b79 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Getting quotas for project d08d010c14a64f759887be0d2364c6e4. Resources: {'server_group_members'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:13:41.569471 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-50426bc1-3bd7-48e7-b3c6-88bc9df95b79 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Getting quotas for user 32fc1959d8aa41eabcead217b9d7bc47 and project d08d010c14a64f759887be0d2364c6e4. Resources: {'server_group_members'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:13:41.589644 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-381003cf-03ab-4733-b35b-76f926eaa5b8 req-2e0ff7ed-8711-4026-b8cb-f0d261c908a8 service nova] Creating event network-vif-plugged:920a50d8-b45c-480e-aaf9-c42f7d1e925e for instance 459c9fac-af66-443f-acd3-22587f83ca6e on n-h2-master-1 Aug 07 01:13:41.595758 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-50426bc1-3bd7-48e7-b3c6-88bc9df95b79 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: fb8bf657-63c6-4cea-8571-e9449c5ee529] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=9a4ced25-d85e-4469-95b6-5e666731a714,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:13:41.601928 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-381003cf-03ab-4733-b35b-76f926eaa5b8 req-2e0ff7ed-8711-4026-b8cb-f0d261c908a8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065166 Aug 07 01:13:41.602915 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 389/893] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:13:41.610775 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4d48715b-1a68-4778-ac2a-8b05cea624c1 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:41.611614 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4d48715b-1a68-4778-ac2a-8b05cea624c1 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 4515975d-ef4b-4f5b-95b7-4b1775b20b81] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:41.619401 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d48715b-1a68-4778-ac2a-8b05cea624c1 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:41.620125 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d48715b-1a68-4778-ac2a-8b05cea624c1 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:41.621178 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d48715b-1a68-4778-ac2a-8b05cea624c1 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:41.623272 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d48715b-1a68-4778-ac2a-8b05cea624c1 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:41.624377 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d48715b-1a68-4778-ac2a-8b05cea624c1 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:41.624377 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d48715b-1a68-4778-ac2a-8b05cea624c1 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:41.704682 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-50426bc1-3bd7-48e7-b3c6-88bc9df95b79 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Getting quotas for project d08d010c14a64f759887be0d2364c6e4. Resources: {'server_group_members'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:13:41.723682 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-50426bc1-3bd7-48e7-b3c6-88bc9df95b79 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Getting quotas for user 32fc1959d8aa41eabcead217b9d7bc47 and project d08d010c14a64f759887be0d2364c6e4. Resources: {'server_group_members'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:13:41.776511 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-50426bc1-3bd7-48e7-b3c6-88bc9df95b79 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Getting quotas for project d08d010c14a64f759887be0d2364c6e4. Resources: {'server_group_members'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:13:41.783330 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-50426bc1-3bd7-48e7-b3c6-88bc9df95b79 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Getting quotas for user 32fc1959d8aa41eabcead217b9d7bc47 and project d08d010c14a64f759887be0d2364c6e4. Resources: {'server_group_members'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:13:41.788372 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:41.869108 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-50426bc1-3bd7-48e7-b3c6-88bc9df95b79 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.069704 Aug 07 01:13:41.870616 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 505/894] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:13:40 2022] POST /compute/v2.1/servers => generated 32 bytes in 1072 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 07 01:13:41.880076 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-4ad12138-8a67-4b48-b28e-7a966d2c4a47 req-1a89c3f1-7220-40e3-8cef-e4cb2a2b47d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5637b619-e3c0-47a9-beb1-2adf3e5ad29c", "tag": "f04fc253-b892-46a9-a3b1-750cdbd6561d"}, {"name": "network-changed", "server_uuid": "4515975d-ef4b-4f5b-95b7-4b1775b20b81", "tag": "3965c7e9-9460-47fd-b5eb-2099a28f3ccf"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:41.901667 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4ad12138-8a67-4b48-b28e-7a966d2c4a47 req-1a89c3f1-7220-40e3-8cef-e4cb2a2b47d5 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:41.902301 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4ad12138-8a67-4b48-b28e-7a966d2c4a47 req-1a89c3f1-7220-40e3-8cef-e4cb2a2b47d5 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:41.904348 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4ad12138-8a67-4b48-b28e-7a966d2c4a47 req-1a89c3f1-7220-40e3-8cef-e4cb2a2b47d5 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:41.928983 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-4ad12138-8a67-4b48-b28e-7a966d2c4a47 req-1a89c3f1-7220-40e3-8cef-e4cb2a2b47d5 service nova] Creating event network-changed:f04fc253-b892-46a9-a3b1-750cdbd6561d for instance 5637b619-e3c0-47a9-beb1-2adf3e5ad29c on n-h1-master-1 Aug 07 01:13:41.930121 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-4ad12138-8a67-4b48-b28e-7a966d2c4a47 req-1a89c3f1-7220-40e3-8cef-e4cb2a2b47d5 service nova] Creating event network-changed:3965c7e9-9460-47fd-b5eb-2099a28f3ccf for instance 4515975d-ef4b-4f5b-95b7-4b1775b20b81 on n-h2-master-1 Aug 07 01:13:41.945975 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-4ad12138-8a67-4b48-b28e-7a966d2c4a47 req-1a89c3f1-7220-40e3-8cef-e4cb2a2b47d5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.072961 Aug 07 01:13:41.947457 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 506/895] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:13:41.956435 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cc8937b9-5e59-47ea-90c8-4b52630cb7c9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:41.957311 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cc8937b9-5e59-47ea-90c8-4b52630cb7c9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:41.966524 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc8937b9-5e59-47ea-90c8-4b52630cb7c9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:41.966524 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc8937b9-5e59-47ea-90c8-4b52630cb7c9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:41.966963 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc8937b9-5e59-47ea-90c8-4b52630cb7c9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:41.967492 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc8937b9-5e59-47ea-90c8-4b52630cb7c9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:41.967990 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc8937b9-5e59-47ea-90c8-4b52630cb7c9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:41.968422 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc8937b9-5e59-47ea-90c8-4b52630cb7c9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:42.176173 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4d48715b-1a68-4778-ac2a-8b05cea624c1 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:42.184711 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4d48715b-1a68-4778-ac2a-8b05cea624c1 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/4515975d-ef4b-4f5b-95b7-4b1775b20b81" status: 200 len: 1324 microversion: 2.1 time: 0.580099 Aug 07 01:13:42.191187 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cc8937b9-5e59-47ea-90c8-4b52630cb7c9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:42.196322 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 390/896] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:41 2022] GET /compute/v2.1/servers/4515975d-ef4b-4f5b-95b7-4b1775b20b81 => generated 1324 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:42.206154 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-561909b8-11a0-460f-af4e-f82b83827d7b tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e24900430>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:42.209696 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cc8937b9-5e59-47ea-90c8-4b52630cb7c9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1462 microversion: 2.1 time: 0.260055 Aug 07 01:13:42.210772 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 507/897] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:41 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1462 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:42.221017 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5cbc50d7-7953-4c1f-a99b-de3bd403fed2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:42.223745 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5cbc50d7-7953-4c1f-a99b-de3bd403fed2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 5637b619-e3c0-47a9-beb1-2adf3e5ad29c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:42.244231 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cbc50d7-7953-4c1f-a99b-de3bd403fed2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:42.245154 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cbc50d7-7953-4c1f-a99b-de3bd403fed2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:42.246088 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cbc50d7-7953-4c1f-a99b-de3bd403fed2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:42.247454 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cbc50d7-7953-4c1f-a99b-de3bd403fed2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:42.248508 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cbc50d7-7953-4c1f-a99b-de3bd403fed2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:42.249265 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cbc50d7-7953-4c1f-a99b-de3bd403fed2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:42.845387 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5cbc50d7-7953-4c1f-a99b-de3bd403fed2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:42.863008 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5cbc50d7-7953-4c1f-a99b-de3bd403fed2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/5637b619-e3c0-47a9-beb1-2adf3e5ad29c" status: 200 len: 1314 microversion: 2.1 time: 0.650382 Aug 07 01:13:42.864407 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 508/898] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:42 2022] GET /compute/v2.1/servers/5637b619-e3c0-47a9-beb1-2adf3e5ad29c => generated 1314 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:42.874029 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-29f94129-82e0-4747-ad95-dc9a962b2135 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:42.875529 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-29f94129-82e0-4747-ad95-dc9a962b2135 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:42.893493 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-29f94129-82e0-4747-ad95-dc9a962b2135 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:42.895099 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-29f94129-82e0-4747-ad95-dc9a962b2135 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:42.896056 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-29f94129-82e0-4747-ad95-dc9a962b2135 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:42.897484 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-29f94129-82e0-4747-ad95-dc9a962b2135 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:42.898237 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-29f94129-82e0-4747-ad95-dc9a962b2135 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:42.898894 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-29f94129-82e0-4747-ad95-dc9a962b2135 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:43.175591 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-29f94129-82e0-4747-ad95-dc9a962b2135 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:43.187648 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-561909b8-11a0-460f-af4e-f82b83827d7b tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "DELETE /compute/v2.1/images/44b163c4-972b-45e4-b79b-00e80eb0b2da" status: 204 len: 0 microversion: 2.1 time: 0.990038 Aug 07 01:13:43.188485 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 391/899] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:42 2022] DELETE /compute/v2.1/images/44b163c4-972b-45e4-b79b-00e80eb0b2da => generated 0 bytes in 991 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:13:43.189532 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-29f94129-82e0-4747-ad95-dc9a962b2135 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 200 len: 1360 microversion: 2.1 time: 0.323165 Aug 07 01:13:43.190856 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 509/900] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:42 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 1360 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:43.200427 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0964fe01-46ac-47fe-a0fd-5637038739e6 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:43.202046 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0964fe01-46ac-47fe-a0fd-5637038739e6 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:43.215410 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0964fe01-46ac-47fe-a0fd-5637038739e6 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:43.216711 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0964fe01-46ac-47fe-a0fd-5637038739e6 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:43.217297 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9c8b5e2c-7215-4f14-9db6-b128ce745455 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:43.217485 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0964fe01-46ac-47fe-a0fd-5637038739e6 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:43.218220 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0964fe01-46ac-47fe-a0fd-5637038739e6 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:43.218825 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0964fe01-46ac-47fe-a0fd-5637038739e6 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:43.219377 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0964fe01-46ac-47fe-a0fd-5637038739e6 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:43.223090 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9c8b5e2c-7215-4f14-9db6-b128ce745455 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:43.223921 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9c8b5e2c-7215-4f14-9db6-b128ce745455 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Searching by: {'deleted': False, 'project_id': 'd08d010c14a64f759887be0d2364c6e4'} {{(pid=119517) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:13:43.232148 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9c8b5e2c-7215-4f14-9db6-b128ce745455 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:43.232752 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9c8b5e2c-7215-4f14-9db6-b128ce745455 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:43.233254 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9c8b5e2c-7215-4f14-9db6-b128ce745455 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:43.234064 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9c8b5e2c-7215-4f14-9db6-b128ce745455 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:43.234579 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9c8b5e2c-7215-4f14-9db6-b128ce745455 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:43.235204 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9c8b5e2c-7215-4f14-9db6-b128ce745455 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:43.350498 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.multi_cell_list [None req-9c8b5e2c-7215-4f14-9db6-b128ce745455 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 01:13:43.415182 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0964fe01-46ac-47fe-a0fd-5637038739e6 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dce42ff994d81b1ad6d6c05356c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6d319a0452448485aa65b7cf1c5b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:43.427946 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0964fe01-46ac-47fe-a0fd-5637038739e6 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6" status: 200 len: 1317 microversion: 2.1 time: 0.234906 Aug 07 01:13:43.428998 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 510/901] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:43 2022] GET /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6 => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:43.461889 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9c8b5e2c-7215-4f14-9db6-b128ce745455 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.272545 Aug 07 01:13:43.462496 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 392/902] 10.222.0.39 () {58 vars in 1125 bytes} [Sun Aug 7 01:13:43 2022] GET /compute/v2.1/servers => generated 1003 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:43.468524 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4224554d-c594-46e3-b708-f8eba7f52a20 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '.version_select at 0x7f9e24aa7940>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:43.519211 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-4224554d-c594-46e3-b708-f8eba7f52a20 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] HTTP exception thrown: Image not found. Aug 07 01:13:43.521422 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4224554d-c594-46e3-b708-f8eba7f52a20 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Request method failure captured: Aug 07 01:13:43.521422 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d HTTP/1.1 Aug 07 01:13:43.521422 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:13:43.521422 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:13:43.521422 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:13:43.521422 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:13:43.521422 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:13:43.521422 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:13:43.521422 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:13:43.521422 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:13:43.521422 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xFjz4u4j5u9kNswDo-D12DJ8tRiIswFGL9PG7hQ7y2ZFN6Er5kEWktOXjnXtVLm8ktdGL6AIsQYTMefhxRIvRTmxaDH0DH1hwYIs4Age2C7TaE2eHvKZlZATBVV_Va54W7xobEYT-s4D7jcR6KLjG1DePdsxZd6CDImLQRSswYzXh4 Aug 07 01:13:43.521422 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:13:43.521422 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:13:43.521422 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:13:43.521422 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:13:43.521422 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:13:43.521422 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:13:43.521422 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: dc5c39a06e41406a8c6c99d2e84ab282 Aug 07 01:13:43.521422 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ImagesOneServerTestJSON-1061526834 Aug 07 01:13:43.521422 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:13:43.521422 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:13:43.524399 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/dc5c39a06e41406a8c6c99d2e84ab282"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_dc5c39a06e41406a8c6c99d2e84ab282", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/dc5c39a06e41406a8c6c99d2e84ab282"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/dc5c39a06e41406a8c6c99d2e84ab282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:13:43.524399 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ImagesOneServerTestJSON-1061526834 Aug 07 01:13:43.524399 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: dc5c39a06e41406a8c6c99d2e84ab282 Aug 07 01:13:43.524399 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1061526834 Aug 07 01:13:43.524399 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ImagesOneServerTestJSON-1061526834-project Aug 07 01:13:43.524399 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:13:43.524399 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:13:43.524399 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 1d0d09d844bf453cb3e2637d630614ff Aug 07 01:13:43.524399 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ImagesOneServerTestJSON-1061526834-project Aug 07 01:13:43.524399 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:13:43.524399 n-d-master-1 devstack@n-api.service[119517]: exception: Image not found. Aug 07 01:13:43.524399 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '0fd54428-9fef-4317-9bc2-59cb9a0c807d'} Aug 07 01:13:43.524399 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:13:43.525998 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:43.525998 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 07 01:13:43.525998 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 07 01:13:43.525998 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 07 01:13:43.525998 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 07 01:13:43.525998 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 07 01:13:43.525998 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 07 01:13:43.525998 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 07 01:13:43.525998 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 07 01:13:43.525998 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 07 01:13:43.525998 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 07 01:13:43.525998 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 07 01:13:43.525998 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 07 01:13:43.525998 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 07 01:13:43.525998 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 07 01:13:43.525998 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0fd54428-9fef-4317-9bc2-59cb9a0c807d to delete Aug 07 01:13:43.525998 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:43.525998 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:13:43.525998 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:43.528685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:43.528685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 07 01:13:43.528685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 07 01:13:43.528685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 07 01:13:43.528685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 07 01:13:43.528685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 07 01:13:43.528685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 07 01:13:43.528685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0fd54428-9fef-4317-9bc2-59cb9a0c807d could not be found. Aug 07 01:13:43.528685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:43.528685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:13:43.528685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:43.528685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:43.528685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:13:43.528685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:13:43.528685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:13:43.528685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:13:43.528685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:13:43.528685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:13:43.528685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:13:43.528685 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:13:43.532094 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 07 01:13:43.532094 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 07 01:13:43.532094 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 07 01:13:43.532094 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:43.532094 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:13:43.532094 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:43.532094 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:43.532094 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:13:43.532094 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:13:43.532094 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:13:43.532094 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:13:43.532094 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 07 01:13:43.532094 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:43.532094 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4224554d-c594-46e3-b708-f8eba7f52a20 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Returning 404 to user: Image not found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:13:43.532094 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4224554d-c594-46e3-b708-f8eba7f52a20 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "DELETE /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d" status: 404 len: 62 microversion: 2.1 time: 0.059433 Aug 07 01:13:43.534427 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 393/903] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:43 2022] DELETE /compute/v2.1/images/0fd54428-9fef-4317-9bc2-59cb9a0c807d => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:13:43.534427 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6f9c616d-fdce-45e9-bb13-52092dc161bb tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:43.534427 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6f9c616d-fdce-45e9-bb13-52092dc161bb tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 4515975d-ef4b-4f5b-95b7-4b1775b20b81] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:43.536364 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f9c616d-fdce-45e9-bb13-52092dc161bb tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:43.536858 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f9c616d-fdce-45e9-bb13-52092dc161bb tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:43.537293 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f9c616d-fdce-45e9-bb13-52092dc161bb tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:43.538010 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f9c616d-fdce-45e9-bb13-52092dc161bb tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:43.538473 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f9c616d-fdce-45e9-bb13-52092dc161bb tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:43.538897 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f9c616d-fdce-45e9-bb13-52092dc161bb tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:43.600794 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ecd16636-971e-4184-a289-8e790e8b1959 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:43.601411 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ecd16636-971e-4184-a289-8e790e8b1959 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:43.608219 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecd16636-971e-4184-a289-8e790e8b1959 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:43.608715 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecd16636-971e-4184-a289-8e790e8b1959 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:43.609153 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecd16636-971e-4184-a289-8e790e8b1959 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:43.609884 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecd16636-971e-4184-a289-8e790e8b1959 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:43.610344 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecd16636-971e-4184-a289-8e790e8b1959 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:43.610776 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecd16636-971e-4184-a289-8e790e8b1959 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:43.706103 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6f9c616d-fdce-45e9-bb13-52092dc161bb tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:43.714003 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6f9c616d-fdce-45e9-bb13-52092dc161bb tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/4515975d-ef4b-4f5b-95b7-4b1775b20b81" status: 200 len: 1324 microversion: 2.1 time: 0.189069 Aug 07 01:13:43.714583 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 394/904] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:43 2022] GET /compute/v2.1/servers/4515975d-ef4b-4f5b-95b7-4b1775b20b81 => generated 1324 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:43.721338 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-dbafc97e-7da3-4c0c-ba04-355be214f4f8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:43.721864 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-dbafc97e-7da3-4c0c-ba04-355be214f4f8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 9a4ced25-d85e-4469-95b6-5e666731a714] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:43.728551 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dbafc97e-7da3-4c0c-ba04-355be214f4f8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:43.729045 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dbafc97e-7da3-4c0c-ba04-355be214f4f8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:43.729474 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dbafc97e-7da3-4c0c-ba04-355be214f4f8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:43.730198 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dbafc97e-7da3-4c0c-ba04-355be214f4f8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:43.730767 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dbafc97e-7da3-4c0c-ba04-355be214f4f8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:43.731205 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dbafc97e-7da3-4c0c-ba04-355be214f4f8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:43.854382 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-dbafc97e-7da3-4c0c-ba04-355be214f4f8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:43.864335 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-dbafc97e-7da3-4c0c-ba04-355be214f4f8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714" status: 200 len: 1223 microversion: 2.1 time: 0.148364 Aug 07 01:13:43.867049 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 395/905] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:43 2022] GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714 => generated 1223 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:43.895761 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b1aea4f6-7367-4264-ab17-c9bc620c9232 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:43.896668 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b1aea4f6-7367-4264-ab17-c9bc620c9232 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] [instance: a038208d-dae8-432d-97e5-2a58ea093e12] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:43.904071 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b1aea4f6-7367-4264-ab17-c9bc620c9232 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:43.904888 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b1aea4f6-7367-4264-ab17-c9bc620c9232 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:43.905554 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b1aea4f6-7367-4264-ab17-c9bc620c9232 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:43.906557 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b1aea4f6-7367-4264-ab17-c9bc620c9232 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:43.907259 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b1aea4f6-7367-4264-ab17-c9bc620c9232 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:43.907945 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b1aea4f6-7367-4264-ab17-c9bc620c9232 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:43.939470 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b1aea4f6-7367-4264-ab17-c9bc620c9232 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] [instance: a038208d-dae8-432d-97e5-2a58ea093e12] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:13:44.031073 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ecd16636-971e-4184-a289-8e790e8b1959 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1613 microversion: 2.1 time: 0.600323 Aug 07 01:13:44.032890 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 511/906] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:43 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1613 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:44.038464 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ee1a5c85-9262-4f1f-a3b9-aea30ae335ad tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:44.039511 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ee1a5c85-9262-4f1f-a3b9-aea30ae335ad tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 5637b619-e3c0-47a9-beb1-2adf3e5ad29c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:44.051046 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee1a5c85-9262-4f1f-a3b9-aea30ae335ad tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:44.052081 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee1a5c85-9262-4f1f-a3b9-aea30ae335ad tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:44.052748 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee1a5c85-9262-4f1f-a3b9-aea30ae335ad tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:44.053907 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee1a5c85-9262-4f1f-a3b9-aea30ae335ad tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:44.054717 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee1a5c85-9262-4f1f-a3b9-aea30ae335ad tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:44.055434 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee1a5c85-9262-4f1f-a3b9-aea30ae335ad tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:44.099589 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b1aea4f6-7367-4264-ab17-c9bc620c9232 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12" status: 204 len: 0 microversion: 2.1 time: 0.208377 Aug 07 01:13:44.100587 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 396/907] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:13:43 2022] DELETE /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:13:44.107411 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f2b7d688-86bb-40ff-bee1-b077f347b2d4 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:44.108085 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f2b7d688-86bb-40ff-bee1-b077f347b2d4 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:44.115054 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f2b7d688-86bb-40ff-bee1-b077f347b2d4 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:44.115542 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f2b7d688-86bb-40ff-bee1-b077f347b2d4 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:44.116108 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f2b7d688-86bb-40ff-bee1-b077f347b2d4 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:44.116865 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f2b7d688-86bb-40ff-bee1-b077f347b2d4 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:44.117320 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f2b7d688-86bb-40ff-bee1-b077f347b2d4 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:44.117744 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f2b7d688-86bb-40ff-bee1-b077f347b2d4 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:44.271588 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f2b7d688-86bb-40ff-bee1-b077f347b2d4 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'fd62e88119574de6b8a03ace83572773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57856e905c9940819ef8a5bac1a1f66f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:44.272648 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f2b7d688-86bb-40ff-bee1-b077f347b2d4 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] flavor_id is None. Assuming migration. {{(pid=119517) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 07 01:13:44.273608 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f2b7d688-86bb-40ff-bee1-b077f347b2d4 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119517) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 07 01:13:44.514395 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ee1a5c85-9262-4f1f-a3b9-aea30ae335ad tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:44.523753 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ee1a5c85-9262-4f1f-a3b9-aea30ae335ad tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/5637b619-e3c0-47a9-beb1-2adf3e5ad29c" status: 200 len: 1314 microversion: 2.1 time: 0.489321 Aug 07 01:13:44.524392 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 512/908] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:44 2022] GET /compute/v2.1/servers/5637b619-e3c0-47a9-beb1-2adf3e5ad29c => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:44.541566 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-45b34be4-3f8a-4903-aa06-b16863d7957c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:44.542075 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-45b34be4-3f8a-4903-aa06-b16863d7957c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] [instance: a038208d-dae8-432d-97e5-2a58ea093e12] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:44.562577 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-45b34be4-3f8a-4903-aa06-b16863d7957c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:44.564463 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-45b34be4-3f8a-4903-aa06-b16863d7957c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:44.565207 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-45b34be4-3f8a-4903-aa06-b16863d7957c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:44.568512 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-45b34be4-3f8a-4903-aa06-b16863d7957c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:44.569271 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-45b34be4-3f8a-4903-aa06-b16863d7957c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:44.570623 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-45b34be4-3f8a-4903-aa06-b16863d7957c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:44.793965 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:44.969839 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f2b7d688-86bb-40ff-bee1-b077f347b2d4 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae/action" status: 202 len: 0 microversion: 2.1 time: 0.865783 Aug 07 01:13:44.970506 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 397/909] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:13:44 2022] POST /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae/action => generated 0 bytes in 869 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:13:44.976150 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ef701d7c-e32f-4545-b4c7-4acd43bb8fbc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:44.978802 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ef701d7c-e32f-4545-b4c7-4acd43bb8fbc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:44.987927 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ef701d7c-e32f-4545-b4c7-4acd43bb8fbc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:44.989165 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ef701d7c-e32f-4545-b4c7-4acd43bb8fbc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:44.989974 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ef701d7c-e32f-4545-b4c7-4acd43bb8fbc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:44.991081 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ef701d7c-e32f-4545-b4c7-4acd43bb8fbc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:44.991735 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ef701d7c-e32f-4545-b4c7-4acd43bb8fbc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:44.992462 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ef701d7c-e32f-4545-b4c7-4acd43bb8fbc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:45.149195 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-45b34be4-3f8a-4903-aa06-b16863d7957c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0d09d844bf453cb3e2637d630614ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5c39a06e41406a8c6c99d2e84ab282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:45.172097 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-45b34be4-3f8a-4903-aa06-b16863d7957c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12" status: 200 len: 1472 microversion: 2.1 time: 0.638566 Aug 07 01:13:45.178614 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 513/910] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:44 2022] GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12 => generated 1472 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:45.200035 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5e166290-74d5-4297-b722-fc6fd799ce8a tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:45.202617 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5e166290-74d5-4297-b722-fc6fd799ce8a tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:45.217532 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e166290-74d5-4297-b722-fc6fd799ce8a tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:45.221158 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e166290-74d5-4297-b722-fc6fd799ce8a tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:45.221986 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e166290-74d5-4297-b722-fc6fd799ce8a tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:45.225531 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e166290-74d5-4297-b722-fc6fd799ce8a tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:45.229095 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e166290-74d5-4297-b722-fc6fd799ce8a tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:45.233145 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e166290-74d5-4297-b722-fc6fd799ce8a tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:45.414525 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ef701d7c-e32f-4545-b4c7-4acd43bb8fbc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:45.424885 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ef701d7c-e32f-4545-b4c7-4acd43bb8fbc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 200 len: 1543 microversion: 2.1 time: 0.452756 Aug 07 01:13:45.426262 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 398/911] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:44 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 1543 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:45.433452 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-49bc1300-b8b6-4cdf-8ed6-01306b9f3cc4 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:45.434549 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-49bc1300-b8b6-4cdf-8ed6-01306b9f3cc4 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 4515975d-ef4b-4f5b-95b7-4b1775b20b81] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:45.451374 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49bc1300-b8b6-4cdf-8ed6-01306b9f3cc4 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:45.452474 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49bc1300-b8b6-4cdf-8ed6-01306b9f3cc4 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:45.453413 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49bc1300-b8b6-4cdf-8ed6-01306b9f3cc4 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:45.454923 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49bc1300-b8b6-4cdf-8ed6-01306b9f3cc4 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:45.455774 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49bc1300-b8b6-4cdf-8ed6-01306b9f3cc4 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:45.456503 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49bc1300-b8b6-4cdf-8ed6-01306b9f3cc4 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:45.596318 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5e166290-74d5-4297-b722-fc6fd799ce8a tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dce42ff994d81b1ad6d6c05356c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6d319a0452448485aa65b7cf1c5b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:45.607783 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5e166290-74d5-4297-b722-fc6fd799ce8a tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6" status: 200 len: 1317 microversion: 2.1 time: 0.425285 Aug 07 01:13:45.608799 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 514/912] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:45 2022] GET /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6 => generated 1317 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:45.625009 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8c537565-31b2-44d0-b54b-49602ea4a536 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:45.626275 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8c537565-31b2-44d0-b54b-49602ea4a536 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 9a4ced25-d85e-4469-95b6-5e666731a714] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:45.635837 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8c537565-31b2-44d0-b54b-49602ea4a536 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:45.636742 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8c537565-31b2-44d0-b54b-49602ea4a536 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:45.637425 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8c537565-31b2-44d0-b54b-49602ea4a536 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:45.638314 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8c537565-31b2-44d0-b54b-49602ea4a536 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:45.639082 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8c537565-31b2-44d0-b54b-49602ea4a536 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:45.639637 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8c537565-31b2-44d0-b54b-49602ea4a536 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:45.741518 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8c537565-31b2-44d0-b54b-49602ea4a536 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:45.762461 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8c537565-31b2-44d0-b54b-49602ea4a536 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714" status: 200 len: 1271 microversion: 2.1 time: 0.150750 Aug 07 01:13:45.780035 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-49bc1300-b8b6-4cdf-8ed6-01306b9f3cc4 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:45.780728 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 515/913] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:45 2022] GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714 => generated 1271 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:45.780728 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cfd89cea-3345-407b-91ea-b341bb008d6d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:45.780728 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cfd89cea-3345-407b-91ea-b341bb008d6d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:45.781106 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-49bc1300-b8b6-4cdf-8ed6-01306b9f3cc4 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/4515975d-ef4b-4f5b-95b7-4b1775b20b81" status: 200 len: 1324 microversion: 2.1 time: 0.348029 Aug 07 01:13:45.781106 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 399/914] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:45 2022] GET /compute/v2.1/servers/4515975d-ef4b-4f5b-95b7-4b1775b20b81 => generated 1324 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:45.781383 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfd89cea-3345-407b-91ea-b341bb008d6d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:45.781751 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfd89cea-3345-407b-91ea-b341bb008d6d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:45.782442 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfd89cea-3345-407b-91ea-b341bb008d6d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:45.783308 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfd89cea-3345-407b-91ea-b341bb008d6d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:45.783941 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfd89cea-3345-407b-91ea-b341bb008d6d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:45.784532 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfd89cea-3345-407b-91ea-b341bb008d6d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:45.789425 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-059a68be-09a3-40d0-8a94-d366b750ea1d tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:45.790404 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-059a68be-09a3-40d0-8a94-d366b750ea1d tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:45.798190 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-059a68be-09a3-40d0-8a94-d366b750ea1d tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:45.799014 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-059a68be-09a3-40d0-8a94-d366b750ea1d tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:45.799771 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-059a68be-09a3-40d0-8a94-d366b750ea1d tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:45.800721 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-059a68be-09a3-40d0-8a94-d366b750ea1d tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:45.801275 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-059a68be-09a3-40d0-8a94-d366b750ea1d tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:45.801855 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-059a68be-09a3-40d0-8a94-d366b750ea1d tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:45.937956 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-059a68be-09a3-40d0-8a94-d366b750ea1d tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.160398 Aug 07 01:13:45.938795 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 400/915] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Aug 7 01:13:45 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e/os-interface => generated 284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:13:45.945129 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7448ffd2-fe1d-4672-9584-2857fd35b37f tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:45.946134 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7448ffd2-fe1d-4672-9584-2857fd35b37f tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 5637b619-e3c0-47a9-beb1-2adf3e5ad29c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:45.954646 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7448ffd2-fe1d-4672-9584-2857fd35b37f tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:45.955575 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7448ffd2-fe1d-4672-9584-2857fd35b37f tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:45.956510 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7448ffd2-fe1d-4672-9584-2857fd35b37f tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:45.957443 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7448ffd2-fe1d-4672-9584-2857fd35b37f tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:45.958080 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7448ffd2-fe1d-4672-9584-2857fd35b37f tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:45.959089 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7448ffd2-fe1d-4672-9584-2857fd35b37f tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:46.030811 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cfd89cea-3345-407b-91ea-b341bb008d6d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:46.039444 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cfd89cea-3345-407b-91ea-b341bb008d6d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1471 microversion: 2.1 time: 0.270766 Aug 07 01:13:46.040086 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 516/916] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:45 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1471 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:46.204676 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8c6483b6-49ee-45a6-b90f-a7283f737f8e tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:46.208232 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8c6483b6-49ee-45a6-b90f-a7283f737f8e tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] [instance: a038208d-dae8-432d-97e5-2a58ea093e12] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:46.236599 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8c6483b6-49ee-45a6-b90f-a7283f737f8e tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:46.239717 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8c6483b6-49ee-45a6-b90f-a7283f737f8e tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:46.244321 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8c6483b6-49ee-45a6-b90f-a7283f737f8e tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:46.246466 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8c6483b6-49ee-45a6-b90f-a7283f737f8e tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:46.248520 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8c6483b6-49ee-45a6-b90f-a7283f737f8e tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:46.249671 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8c6483b6-49ee-45a6-b90f-a7283f737f8e tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:46.362126 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7448ffd2-fe1d-4672-9584-2857fd35b37f tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:46.375553 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7448ffd2-fe1d-4672-9584-2857fd35b37f tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/5637b619-e3c0-47a9-beb1-2adf3e5ad29c" status: 200 len: 1314 microversion: 2.1 time: 0.435109 Aug 07 01:13:46.388088 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 401/917] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:45 2022] GET /compute/v2.1/servers/5637b619-e3c0-47a9-beb1-2adf3e5ad29c => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:46.547841 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8c6483b6-49ee-45a6-b90f-a7283f737f8e tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0d09d844bf453cb3e2637d630614ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5c39a06e41406a8c6c99d2e84ab282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:46.559976 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8c6483b6-49ee-45a6-b90f-a7283f737f8e tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12" status: 200 len: 1472 microversion: 2.1 time: 0.364699 Aug 07 01:13:46.563947 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 517/918] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:46 2022] GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12 => generated 1472 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:46.644172 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-36385e6c-0790-4278-b71a-014db82ee3d9 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:46.645038 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-36385e6c-0790-4278-b71a-014db82ee3d9 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:46.652944 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36385e6c-0790-4278-b71a-014db82ee3d9 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:46.654982 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36385e6c-0790-4278-b71a-014db82ee3d9 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:46.660355 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36385e6c-0790-4278-b71a-014db82ee3d9 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:46.661490 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36385e6c-0790-4278-b71a-014db82ee3d9 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:46.662246 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36385e6c-0790-4278-b71a-014db82ee3d9 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:46.662869 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36385e6c-0790-4278-b71a-014db82ee3d9 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:46.801542 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8e1db8ce-2246-469e-986f-a7291b71140b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:46.803019 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8e1db8ce-2246-469e-986f-a7291b71140b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 9a4ced25-d85e-4469-95b6-5e666731a714] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:46.815538 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8e1db8ce-2246-469e-986f-a7291b71140b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:46.816461 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8e1db8ce-2246-469e-986f-a7291b71140b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:46.817155 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8e1db8ce-2246-469e-986f-a7291b71140b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:46.818369 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8e1db8ce-2246-469e-986f-a7291b71140b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:46.819699 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8e1db8ce-2246-469e-986f-a7291b71140b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:46.822429 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8e1db8ce-2246-469e-986f-a7291b71140b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:46.938574 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8e1db8ce-2246-469e-986f-a7291b71140b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:46.952728 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8e1db8ce-2246-469e-986f-a7291b71140b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714" status: 200 len: 1271 microversion: 2.1 time: 0.156834 Aug 07 01:13:46.953682 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 518/919] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:46 2022] GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714 => generated 1271 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:46.979058 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-773e4d5a-d403-4386-a852-1a12077c39d3 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:46.986883 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-773e4d5a-d403-4386-a852-1a12077c39d3 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 4515975d-ef4b-4f5b-95b7-4b1775b20b81] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:47.022894 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-773e4d5a-d403-4386-a852-1a12077c39d3 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:47.030790 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-773e4d5a-d403-4386-a852-1a12077c39d3 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:47.031742 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-773e4d5a-d403-4386-a852-1a12077c39d3 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:47.032582 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-773e4d5a-d403-4386-a852-1a12077c39d3 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:47.033075 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-773e4d5a-d403-4386-a852-1a12077c39d3 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:47.036376 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-773e4d5a-d403-4386-a852-1a12077c39d3 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:47.039831 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:47.432054 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-773e4d5a-d403-4386-a852-1a12077c39d3 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:47.453735 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-773e4d5a-d403-4386-a852-1a12077c39d3 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/4515975d-ef4b-4f5b-95b7-4b1775b20b81" status: 200 len: 1324 microversion: 2.1 time: 0.498392 Aug 07 01:13:47.455697 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 519/920] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:46 2022] GET /compute/v2.1/servers/4515975d-ef4b-4f5b-95b7-4b1775b20b81 => generated 1324 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:47.460984 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9fdc93f7-2c0f-4205-b002-8882f7026ef9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:47.461882 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9fdc93f7-2c0f-4205-b002-8882f7026ef9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:47.479309 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9fdc93f7-2c0f-4205-b002-8882f7026ef9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:47.480127 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9fdc93f7-2c0f-4205-b002-8882f7026ef9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:47.480895 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9fdc93f7-2c0f-4205-b002-8882f7026ef9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:47.482165 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9fdc93f7-2c0f-4205-b002-8882f7026ef9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:47.482948 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9fdc93f7-2c0f-4205-b002-8882f7026ef9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:47.483491 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9fdc93f7-2c0f-4205-b002-8882f7026ef9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:47.918319 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-36385e6c-0790-4278-b71a-014db82ee3d9 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dce42ff994d81b1ad6d6c05356c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6d319a0452448485aa65b7cf1c5b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:47.929519 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-36385e6c-0790-4278-b71a-014db82ee3d9 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6" status: 200 len: 1317 microversion: 2.1 time: 1.289731 Aug 07 01:13:47.930732 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 402/921] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:46 2022] GET /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6 => generated 1317 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:13:47.933542 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9fdc93f7-2c0f-4205-b002-8882f7026ef9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:47.937314 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-69f31c43-cd9e-4ed5-85fa-0cbc9a964b91 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:47.938803 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-69f31c43-cd9e-4ed5-85fa-0cbc9a964b91 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 5637b619-e3c0-47a9-beb1-2adf3e5ad29c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:47.945447 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-69f31c43-cd9e-4ed5-85fa-0cbc9a964b91 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:47.946250 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-69f31c43-cd9e-4ed5-85fa-0cbc9a964b91 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:47.946855 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-69f31c43-cd9e-4ed5-85fa-0cbc9a964b91 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:47.947772 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-69f31c43-cd9e-4ed5-85fa-0cbc9a964b91 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:47.948451 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-69f31c43-cd9e-4ed5-85fa-0cbc9a964b91 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:47.949050 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-69f31c43-cd9e-4ed5-85fa-0cbc9a964b91 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:47.966111 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9fdc93f7-2c0f-4205-b002-8882f7026ef9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1471 microversion: 2.1 time: 0.503172 Aug 07 01:13:47.966111 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 520/922] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:47 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1471 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:47.975610 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-49a3d8a0-c4f2-4199-95e0-aa87248dbb30 req-8b9858ec-593c-429f-83f9-83f8b23b48ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4515975d-ef4b-4f5b-95b7-4b1775b20b81", "name": "network-vif-plugged", "status": "completed", "tag": "3965c7e9-9460-47fd-b5eb-2099a28f3ccf"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:48.002836 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-49a3d8a0-c4f2-4199-95e0-aa87248dbb30 req-8b9858ec-593c-429f-83f9-83f8b23b48ad service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:48.003843 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-49a3d8a0-c4f2-4199-95e0-aa87248dbb30 req-8b9858ec-593c-429f-83f9-83f8b23b48ad service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:48.004377 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-49a3d8a0-c4f2-4199-95e0-aa87248dbb30 req-8b9858ec-593c-429f-83f9-83f8b23b48ad service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:48.018758 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-49a3d8a0-c4f2-4199-95e0-aa87248dbb30 req-8b9858ec-593c-429f-83f9-83f8b23b48ad service nova] Creating event network-vif-plugged:3965c7e9-9460-47fd-b5eb-2099a28f3ccf for instance 4515975d-ef4b-4f5b-95b7-4b1775b20b81 on n-h2-master-1 Aug 07 01:13:48.027055 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-49a3d8a0-c4f2-4199-95e0-aa87248dbb30 req-8b9858ec-593c-429f-83f9-83f8b23b48ad service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062918 Aug 07 01:13:48.029051 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 521/923] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:13:48.035630 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-af2afbbc-4a12-4860-aaa9-bbf01c6c846c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:48.036435 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-af2afbbc-4a12-4860-aaa9-bbf01c6c846c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] [instance: a038208d-dae8-432d-97e5-2a58ea093e12] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:48.043350 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af2afbbc-4a12-4860-aaa9-bbf01c6c846c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:48.044569 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af2afbbc-4a12-4860-aaa9-bbf01c6c846c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:48.045109 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af2afbbc-4a12-4860-aaa9-bbf01c6c846c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:48.045964 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af2afbbc-4a12-4860-aaa9-bbf01c6c846c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:48.046519 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af2afbbc-4a12-4860-aaa9-bbf01c6c846c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:48.047036 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af2afbbc-4a12-4860-aaa9-bbf01c6c846c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:48.143455 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-af2afbbc-4a12-4860-aaa9-bbf01c6c846c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0d09d844bf453cb3e2637d630614ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5c39a06e41406a8c6c99d2e84ab282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:48.159635 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-af2afbbc-4a12-4860-aaa9-bbf01c6c846c tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12" status: 200 len: 1430 microversion: 2.1 time: 0.128953 Aug 07 01:13:48.160350 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 522/924] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:48 2022] GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12 => generated 1430 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:48.180623 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7796a2f5-dba9-42d5-b9fd-a8f9358c72ae tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:48.181248 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7796a2f5-dba9-42d5-b9fd-a8f9358c72ae tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 9a4ced25-d85e-4469-95b6-5e666731a714] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:48.193963 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7796a2f5-dba9-42d5-b9fd-a8f9358c72ae tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:48.194535 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7796a2f5-dba9-42d5-b9fd-a8f9358c72ae tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:48.195050 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7796a2f5-dba9-42d5-b9fd-a8f9358c72ae tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:48.195821 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7796a2f5-dba9-42d5-b9fd-a8f9358c72ae tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:48.196414 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7796a2f5-dba9-42d5-b9fd-a8f9358c72ae tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:48.196847 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7796a2f5-dba9-42d5-b9fd-a8f9358c72ae tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:48.343352 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7796a2f5-dba9-42d5-b9fd-a8f9358c72ae tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:48.363374 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7796a2f5-dba9-42d5-b9fd-a8f9358c72ae tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714" status: 200 len: 1277 microversion: 2.1 time: 0.186676 Aug 07 01:13:48.372983 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 523/925] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:48 2022] GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714 => generated 1277 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:48.384172 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-893f3dca-ff4c-416a-89ae-4e0f99702312 req-f88ab057-9ac0-49f6-b54b-d90d1d72cf33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a038208d-dae8-432d-97e5-2a58ea093e12", "name": "network-vif-deleted", "tag": "34e132f0-6845-4fef-bc5f-494eced57c6a"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:48.407928 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-893f3dca-ff4c-416a-89ae-4e0f99702312 req-f88ab057-9ac0-49f6-b54b-d90d1d72cf33 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:48.413901 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-893f3dca-ff4c-416a-89ae-4e0f99702312 req-f88ab057-9ac0-49f6-b54b-d90d1d72cf33 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:48.413901 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-893f3dca-ff4c-416a-89ae-4e0f99702312 req-f88ab057-9ac0-49f6-b54b-d90d1d72cf33 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:48.441029 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-893f3dca-ff4c-416a-89ae-4e0f99702312 req-f88ab057-9ac0-49f6-b54b-d90d1d72cf33 service nova] Creating event network-vif-deleted:34e132f0-6845-4fef-bc5f-494eced57c6a for instance a038208d-dae8-432d-97e5-2a58ea093e12 on n-h2-master-1 Aug 07 01:13:48.457498 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-893f3dca-ff4c-416a-89ae-4e0f99702312 req-f88ab057-9ac0-49f6-b54b-d90d1d72cf33 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080954 Aug 07 01:13:48.459111 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 524/926] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:13:48.494323 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fc2b68ef-92bb-4ce4-a5fe-4bb6062219d9 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:48.495046 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fc2b68ef-92bb-4ce4-a5fe-4bb6062219d9 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 4515975d-ef4b-4f5b-95b7-4b1775b20b81] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:48.504348 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc2b68ef-92bb-4ce4-a5fe-4bb6062219d9 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:48.504748 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc2b68ef-92bb-4ce4-a5fe-4bb6062219d9 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:48.505161 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc2b68ef-92bb-4ce4-a5fe-4bb6062219d9 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:48.506054 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc2b68ef-92bb-4ce4-a5fe-4bb6062219d9 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:48.506543 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc2b68ef-92bb-4ce4-a5fe-4bb6062219d9 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:48.507026 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc2b68ef-92bb-4ce4-a5fe-4bb6062219d9 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:48.705915 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fc2b68ef-92bb-4ce4-a5fe-4bb6062219d9 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:48.715065 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fc2b68ef-92bb-4ce4-a5fe-4bb6062219d9 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/4515975d-ef4b-4f5b-95b7-4b1775b20b81" status: 200 len: 1324 microversion: 2.1 time: 0.233592 Aug 07 01:13:48.715661 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 525/927] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:48 2022] GET /compute/v2.1/servers/4515975d-ef4b-4f5b-95b7-4b1775b20b81 => generated 1324 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:48.792493 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-69f31c43-cd9e-4ed5-85fa-0cbc9a964b91 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:48.802115 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-69f31c43-cd9e-4ed5-85fa-0cbc9a964b91 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/5637b619-e3c0-47a9-beb1-2adf3e5ad29c" status: 200 len: 1314 microversion: 2.1 time: 0.869963 Aug 07 01:13:48.811215 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 403/928] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:47 2022] GET /compute/v2.1/servers/5637b619-e3c0-47a9-beb1-2adf3e5ad29c => generated 1314 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:48.958304 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-19e4a555-e998-4f3c-b056-73b4794385ff tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:48.958938 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-19e4a555-e998-4f3c-b056-73b4794385ff tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:48.968054 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-19e4a555-e998-4f3c-b056-73b4794385ff tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:48.968825 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-19e4a555-e998-4f3c-b056-73b4794385ff tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:48.969489 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-19e4a555-e998-4f3c-b056-73b4794385ff tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:48.970430 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-19e4a555-e998-4f3c-b056-73b4794385ff tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:48.971061 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-19e4a555-e998-4f3c-b056-73b4794385ff tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:48.971708 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-19e4a555-e998-4f3c-b056-73b4794385ff tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:48.983376 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-832ca406-44cb-4d9c-9781-1c5a7870bee9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:48.985304 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-832ca406-44cb-4d9c-9781-1c5a7870bee9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:48.997935 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-832ca406-44cb-4d9c-9781-1c5a7870bee9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:49.000903 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-832ca406-44cb-4d9c-9781-1c5a7870bee9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:49.001363 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-832ca406-44cb-4d9c-9781-1c5a7870bee9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:49.002108 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-832ca406-44cb-4d9c-9781-1c5a7870bee9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:49.008032 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-832ca406-44cb-4d9c-9781-1c5a7870bee9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:49.008773 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-832ca406-44cb-4d9c-9781-1c5a7870bee9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:49.178797 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-19e4a555-e998-4f3c-b056-73b4794385ff tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dce42ff994d81b1ad6d6c05356c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6d319a0452448485aa65b7cf1c5b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:49.189573 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-19e4a555-e998-4f3c-b056-73b4794385ff tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6" status: 200 len: 1317 microversion: 2.1 time: 0.235967 Aug 07 01:13:49.190469 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 526/929] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:48 2022] GET /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6 => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:49.195375 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6fd763be-c309-4c82-8f0a-779b750c3e6f tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:49.197031 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6fd763be-c309-4c82-8f0a-779b750c3e6f tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] [instance: a038208d-dae8-432d-97e5-2a58ea093e12] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:49.204391 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6fd763be-c309-4c82-8f0a-779b750c3e6f tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:49.204887 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6fd763be-c309-4c82-8f0a-779b750c3e6f tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:49.205324 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6fd763be-c309-4c82-8f0a-779b750c3e6f tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:49.206076 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6fd763be-c309-4c82-8f0a-779b750c3e6f tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:49.206530 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6fd763be-c309-4c82-8f0a-779b750c3e6f tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:49.206963 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6fd763be-c309-4c82-8f0a-779b750c3e6f tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:49.279225 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6fd763be-c309-4c82-8f0a-779b750c3e6f tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:49.279971 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6fd763be-c309-4c82-8f0a-779b750c3e6f tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:49.281323 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6fd763be-c309-4c82-8f0a-779b750c3e6f tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:49.281936 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-6fd763be-c309-4c82-8f0a-779b750c3e6f tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lazy-loading 'fault' on Instance uuid a038208d-dae8-432d-97e5-2a58ea093e12 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:13:49.296647 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-832ca406-44cb-4d9c-9781-1c5a7870bee9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:49.311303 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-832ca406-44cb-4d9c-9781-1c5a7870bee9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1471 microversion: 2.1 time: 0.332473 Aug 07 01:13:49.312098 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 404/930] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:48 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1471 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:49.318270 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-235c9f38-499f-4a67-9a1e-7e9dec7b2f3c req-c10107ce-bbcb-4a3e-95f5-3cc630f6bf4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "459c9fac-af66-443f-acd3-22587f83ca6e", "tag": "920a50d8-b45c-480e-aaf9-c42f7d1e925e"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:49.343656 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-235c9f38-499f-4a67-9a1e-7e9dec7b2f3c req-c10107ce-bbcb-4a3e-95f5-3cc630f6bf4e service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:49.344532 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-235c9f38-499f-4a67-9a1e-7e9dec7b2f3c req-c10107ce-bbcb-4a3e-95f5-3cc630f6bf4e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:49.345180 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-235c9f38-499f-4a67-9a1e-7e9dec7b2f3c req-c10107ce-bbcb-4a3e-95f5-3cc630f6bf4e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:49.369067 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6fd763be-c309-4c82-8f0a-779b750c3e6f tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0d09d844bf453cb3e2637d630614ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5c39a06e41406a8c6c99d2e84ab282', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:49.373558 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-235c9f38-499f-4a67-9a1e-7e9dec7b2f3c req-c10107ce-bbcb-4a3e-95f5-3cc630f6bf4e service nova] Creating event network-changed:920a50d8-b45c-480e-aaf9-c42f7d1e925e for instance 459c9fac-af66-443f-acd3-22587f83ca6e on n-h2-master-1 Aug 07 01:13:49.380486 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-235c9f38-499f-4a67-9a1e-7e9dec7b2f3c req-c10107ce-bbcb-4a3e-95f5-3cc630f6bf4e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065701 Aug 07 01:13:49.381039 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6fd763be-c309-4c82-8f0a-779b750c3e6f tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12" status: 200 len: 1307 microversion: 2.1 time: 0.189160 Aug 07 01:13:49.381618 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 405/931] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:13:49.382048 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 527/932] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:49 2022] GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12 => generated 1307 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:49.403728 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fa1b37b9-b479-45b9-ae1f-fe84c57e63e0 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:49.404775 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fa1b37b9-b479-45b9-ae1f-fe84c57e63e0 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 9a4ced25-d85e-4469-95b6-5e666731a714] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:49.412241 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa1b37b9-b479-45b9-ae1f-fe84c57e63e0 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:49.413012 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa1b37b9-b479-45b9-ae1f-fe84c57e63e0 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:49.413620 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa1b37b9-b479-45b9-ae1f-fe84c57e63e0 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:49.414649 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa1b37b9-b479-45b9-ae1f-fe84c57e63e0 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:49.415325 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa1b37b9-b479-45b9-ae1f-fe84c57e63e0 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:49.416087 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa1b37b9-b479-45b9-ae1f-fe84c57e63e0 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:49.547864 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fa1b37b9-b479-45b9-ae1f-fe84c57e63e0 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:49.558372 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fa1b37b9-b479-45b9-ae1f-fe84c57e63e0 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714" status: 200 len: 1277 microversion: 2.1 time: 0.160759 Aug 07 01:13:49.560040 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 406/933] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:49 2022] GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714 => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:49.745301 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c393b3e2-fae2-4005-ba53-44987c2f2765 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:49.746506 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c393b3e2-fae2-4005-ba53-44987c2f2765 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 4515975d-ef4b-4f5b-95b7-4b1775b20b81] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:49.771900 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c393b3e2-fae2-4005-ba53-44987c2f2765 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:49.772693 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c393b3e2-fae2-4005-ba53-44987c2f2765 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:49.773328 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c393b3e2-fae2-4005-ba53-44987c2f2765 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:49.774348 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c393b3e2-fae2-4005-ba53-44987c2f2765 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:49.774990 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c393b3e2-fae2-4005-ba53-44987c2f2765 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:49.775608 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c393b3e2-fae2-4005-ba53-44987c2f2765 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:49.834262 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1c43fca5-76a9-4e89-a442-7052dce9951d tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:49.835658 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1c43fca5-76a9-4e89-a442-7052dce9951d tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 5637b619-e3c0-47a9-beb1-2adf3e5ad29c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:49.853451 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c43fca5-76a9-4e89-a442-7052dce9951d tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:49.853952 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c43fca5-76a9-4e89-a442-7052dce9951d tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:49.854391 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c43fca5-76a9-4e89-a442-7052dce9951d tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:49.855117 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c43fca5-76a9-4e89-a442-7052dce9951d tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:49.855577 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c43fca5-76a9-4e89-a442-7052dce9951d tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:49.856882 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c43fca5-76a9-4e89-a442-7052dce9951d tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:50.131848 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c393b3e2-fae2-4005-ba53-44987c2f2765 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:50.140888 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c393b3e2-fae2-4005-ba53-44987c2f2765 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/4515975d-ef4b-4f5b-95b7-4b1775b20b81" status: 200 len: 1324 microversion: 2.1 time: 0.406868 Aug 07 01:13:50.142086 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 528/934] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:49 2022] GET /compute/v2.1/servers/4515975d-ef4b-4f5b-95b7-4b1775b20b81 => generated 1324 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:50.202822 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-12a38600-66c1-460e-999c-de75805bd88c req-0b4267e7-8239-4866-96b3-723b78dc3fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a038208d-dae8-432d-97e5-2a58ea093e12", "name": "network-vif-unplugged", "status": "completed", "tag": "34e132f0-6845-4fef-bc5f-494eced57c6a"}, {"server_uuid": "aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6", "name": "network-vif-plugged", "status": "completed", "tag": "86c30725-b72b-49bf-9799-0396a8d1f229"}, {"server_uuid": "766de05a-a562-4045-bdf9-c49050382e1a", "name": "network-vif-plugged", "status": "completed", "tag": "a4899c9a-669a-4c98-bfc8-6b6f7b2c3f93"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:50.246707 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-12a38600-66c1-460e-999c-de75805bd88c req-0b4267e7-8239-4866-96b3-723b78dc3fb3 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:50.247207 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-12a38600-66c1-460e-999c-de75805bd88c req-0b4267e7-8239-4866-96b3-723b78dc3fb3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:50.247700 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-12a38600-66c1-460e-999c-de75805bd88c req-0b4267e7-8239-4866-96b3-723b78dc3fb3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:50.265106 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-12a38600-66c1-460e-999c-de75805bd88c req-0b4267e7-8239-4866-96b3-723b78dc3fb3 service nova] Creating event network-vif-unplugged:34e132f0-6845-4fef-bc5f-494eced57c6a for instance a038208d-dae8-432d-97e5-2a58ea093e12 on n-h2-master-1 Aug 07 01:13:50.265936 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-12a38600-66c1-460e-999c-de75805bd88c req-0b4267e7-8239-4866-96b3-723b78dc3fb3 service nova] Creating event network-vif-plugged:86c30725-b72b-49bf-9799-0396a8d1f229 for instance aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6 on n-h1-master-1 Aug 07 01:13:50.266716 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-12a38600-66c1-460e-999c-de75805bd88c req-0b4267e7-8239-4866-96b3-723b78dc3fb3 service nova] Creating event network-vif-plugged:a4899c9a-669a-4c98-bfc8-6b6f7b2c3f93 for instance 766de05a-a562-4045-bdf9-c49050382e1a on n-h1-master-1 Aug 07 01:13:50.280267 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-12a38600-66c1-460e-999c-de75805bd88c req-0b4267e7-8239-4866-96b3-723b78dc3fb3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.087034 Aug 07 01:13:50.281564 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 529/935] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:13:50.287330 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0729f82f-e197-4cc1-90d9-e25125d48b8c tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:50.288363 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0729f82f-e197-4cc1-90d9-e25125d48b8c tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:50.294269 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1c43fca5-76a9-4e89-a442-7052dce9951d tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:50.296525 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0729f82f-e197-4cc1-90d9-e25125d48b8c tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:50.297047 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0729f82f-e197-4cc1-90d9-e25125d48b8c tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:50.298429 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0729f82f-e197-4cc1-90d9-e25125d48b8c tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:50.299331 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0729f82f-e197-4cc1-90d9-e25125d48b8c tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:50.300121 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0729f82f-e197-4cc1-90d9-e25125d48b8c tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:50.300587 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0729f82f-e197-4cc1-90d9-e25125d48b8c tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:50.310912 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1c43fca5-76a9-4e89-a442-7052dce9951d tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/5637b619-e3c0-47a9-beb1-2adf3e5ad29c" status: 200 len: 1314 microversion: 2.1 time: 0.488945 Aug 07 01:13:50.316675 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 407/936] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:49 2022] GET /compute/v2.1/servers/5637b619-e3c0-47a9-beb1-2adf3e5ad29c => generated 1314 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:50.353518 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5c904dc8-284d-4743-9c4d-c3ab58681655 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:50.355030 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5c904dc8-284d-4743-9c4d-c3ab58681655 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:50.370084 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c904dc8-284d-4743-9c4d-c3ab58681655 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:50.377797 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c904dc8-284d-4743-9c4d-c3ab58681655 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:50.379506 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c904dc8-284d-4743-9c4d-c3ab58681655 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:50.380520 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c904dc8-284d-4743-9c4d-c3ab58681655 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:50.383432 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c904dc8-284d-4743-9c4d-c3ab58681655 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:50.385503 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c904dc8-284d-4743-9c4d-c3ab58681655 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:50.681732 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0729f82f-e197-4cc1-90d9-e25125d48b8c tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dce42ff994d81b1ad6d6c05356c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6d319a0452448485aa65b7cf1c5b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:50.691855 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0729f82f-e197-4cc1-90d9-e25125d48b8c tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6" status: 200 len: 1317 microversion: 2.1 time: 0.408790 Aug 07 01:13:50.705290 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 530/937] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:50 2022] GET /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6 => generated 1317 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:50.714638 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5b005e67-0441-46df-8743-a3cb892b4251 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:50.716735 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5b005e67-0441-46df-8743-a3cb892b4251 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] [instance: a038208d-dae8-432d-97e5-2a58ea093e12] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:50.725114 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5b005e67-0441-46df-8743-a3cb892b4251 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:50.726389 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5b005e67-0441-46df-8743-a3cb892b4251 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:50.727065 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5b005e67-0441-46df-8743-a3cb892b4251 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:50.728064 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5b005e67-0441-46df-8743-a3cb892b4251 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:50.728752 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5b005e67-0441-46df-8743-a3cb892b4251 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:50.729416 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5b005e67-0441-46df-8743-a3cb892b4251 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:50.744996 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-5b005e67-0441-46df-8743-a3cb892b4251 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] HTTP exception thrown: Instance a038208d-dae8-432d-97e5-2a58ea093e12 could not be found. Aug 07 01:13:50.747635 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5b005e67-0441-46df-8743-a3cb892b4251 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Request method failure captured: Aug 07 01:13:50.747635 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12 HTTP/1.1 Aug 07 01:13:50.747635 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:13:50.747635 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:13:50.747635 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:13:50.747635 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:13:50.747635 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:13:50.747635 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:13:50.747635 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:13:50.747635 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:13:50.747635 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xFjz4u4j5u9kNswDo-D12DJ8tRiIswFGL9PG7hQ7y2ZFN6Er5kEWktOXjnXtVLm8ktdGL6AIsQYTMefhxRIvRTmxaDH0DH1hwYIs4Age2C7TaE2eHvKZlZATBVV_Va54W7xobEYT-s4D7jcR6KLjG1DePdsxZd6CDImLQRSswYzXh4 Aug 07 01:13:50.747635 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:13:50.747635 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:13:50.747635 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:13:50.747635 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:13:50.747635 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:13:50.747635 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:13:50.747635 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: dc5c39a06e41406a8c6c99d2e84ab282 Aug 07 01:13:50.747635 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ImagesOneServerTestJSON-1061526834 Aug 07 01:13:50.747635 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:13:50.747635 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:13:50.749694 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/dc5c39a06e41406a8c6c99d2e84ab282"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_dc5c39a06e41406a8c6c99d2e84ab282", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/dc5c39a06e41406a8c6c99d2e84ab282"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/dc5c39a06e41406a8c6c99d2e84ab282"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:13:50.749694 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ImagesOneServerTestJSON-1061526834 Aug 07 01:13:50.749694 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: dc5c39a06e41406a8c6c99d2e84ab282 Aug 07 01:13:50.749694 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1061526834 Aug 07 01:13:50.749694 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ImagesOneServerTestJSON-1061526834-project Aug 07 01:13:50.749694 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:13:50.749694 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:13:50.749694 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 1d0d09d844bf453cb3e2637d630614ff Aug 07 01:13:50.749694 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ImagesOneServerTestJSON-1061526834-project Aug 07 01:13:50.749694 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:13:50.749694 n-d-master-1 devstack@n-api.service[119516]: exception: Instance a038208d-dae8-432d-97e5-2a58ea093e12 could not be found. Aug 07 01:13:50.749694 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'a038208d-dae8-432d-97e5-2a58ea093e12'} Aug 07 01:13:50.750478 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:13:50.750478 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:50.750478 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:13:50.750478 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:13:50.750478 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:13:50.750478 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:13:50.750478 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:13:50.750478 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:13:50.750478 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:13:50.750478 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:13:50.750478 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a038208d-dae8-432d-97e5-2a58ea093e12 could not be found. Aug 07 01:13:50.750478 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:13:50.750478 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:13:50.750478 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:13:50.750478 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:50.750478 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:13:50.750478 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:13:50.750478 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:13:50.750478 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:13:50.750478 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:13:50.753846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:13:50.753846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:13:50.753846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:13:50.753846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:13:50.753846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:13:50.753846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:13:50.753846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:13:50.753846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a038208d-dae8-432d-97e5-2a58ea093e12 could not be found. Aug 07 01:13:50.753846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:13:50.753846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:13:50.753846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:13:50.753846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:50.753846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:13:50.753846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:13:50.753846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:13:50.753846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:13:50.753846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a038208d-dae8-432d-97e5-2a58ea093e12 could not be found. Aug 07 01:13:50.753846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:13:50.759199 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5b005e67-0441-46df-8743-a3cb892b4251 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] Returning 404 to user: Instance a038208d-dae8-432d-97e5-2a58ea093e12 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:13:50.760380 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5b005e67-0441-46df-8743-a3cb892b4251 tempest-ImagesOneServerTestJSON-1061526834 tempest-ImagesOneServerTestJSON-1061526834-project] 10.222.0.39 "GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12" status: 404 len: 111 microversion: 2.1 time: 0.053606 Aug 07 01:13:50.761560 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 531/938] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:50 2022] GET /compute/v2.1/servers/a038208d-dae8-432d-97e5-2a58ea093e12 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:13:50.770079 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c470df17-d2ce-4c71-a894-50a3f7945085 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:50.770828 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c470df17-d2ce-4c71-a894-50a3f7945085 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 9a4ced25-d85e-4469-95b6-5e666731a714] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:50.780531 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c470df17-d2ce-4c71-a894-50a3f7945085 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:50.781192 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c470df17-d2ce-4c71-a894-50a3f7945085 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:50.781743 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c470df17-d2ce-4c71-a894-50a3f7945085 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:50.782599 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c470df17-d2ce-4c71-a894-50a3f7945085 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:50.783177 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c470df17-d2ce-4c71-a894-50a3f7945085 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:50.783950 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c470df17-d2ce-4c71-a894-50a3f7945085 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:50.881167 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c470df17-d2ce-4c71-a894-50a3f7945085 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:50.892408 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c470df17-d2ce-4c71-a894-50a3f7945085 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714" status: 200 len: 1277 microversion: 2.1 time: 0.128675 Aug 07 01:13:50.908686 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 532/939] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:50 2022] GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714 => generated 1277 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:51.148455 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5c904dc8-284d-4743-9c4d-c3ab58681655 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:51.164715 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-461a138b-1f17-4c27-8abc-f0da5ea8e1c7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:51.165327 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-461a138b-1f17-4c27-8abc-f0da5ea8e1c7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 4515975d-ef4b-4f5b-95b7-4b1775b20b81] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:51.171379 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5c904dc8-284d-4743-9c4d-c3ab58681655 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1471 microversion: 2.1 time: 0.825938 Aug 07 01:13:51.175872 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 408/940] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:50 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1471 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:51.182590 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-461a138b-1f17-4c27-8abc-f0da5ea8e1c7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:51.183598 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-461a138b-1f17-4c27-8abc-f0da5ea8e1c7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:51.184958 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-461a138b-1f17-4c27-8abc-f0da5ea8e1c7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:51.185923 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-461a138b-1f17-4c27-8abc-f0da5ea8e1c7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:51.186719 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-461a138b-1f17-4c27-8abc-f0da5ea8e1c7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:51.188084 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-461a138b-1f17-4c27-8abc-f0da5ea8e1c7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:51.341364 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e157786d-f305-4046-8afa-0e0884772235 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:51.343251 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e157786d-f305-4046-8afa-0e0884772235 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 5637b619-e3c0-47a9-beb1-2adf3e5ad29c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:51.353411 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e157786d-f305-4046-8afa-0e0884772235 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:51.354632 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e157786d-f305-4046-8afa-0e0884772235 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:51.358177 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e157786d-f305-4046-8afa-0e0884772235 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:51.361289 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e157786d-f305-4046-8afa-0e0884772235 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:51.362490 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e157786d-f305-4046-8afa-0e0884772235 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:51.363581 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e157786d-f305-4046-8afa-0e0884772235 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:51.376966 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:51.509031 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-461a138b-1f17-4c27-8abc-f0da5ea8e1c7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:51.519170 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-461a138b-1f17-4c27-8abc-f0da5ea8e1c7 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/4515975d-ef4b-4f5b-95b7-4b1775b20b81" status: 200 len: 1520 microversion: 2.1 time: 0.359540 Aug 07 01:13:51.520545 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 533/941] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:51 2022] GET /compute/v2.1/servers/4515975d-ef4b-4f5b-95b7-4b1775b20b81 => generated 1520 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:51.544279 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-86aa8333-8da5-49b0-9923-65bc50ce035a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:51.545034 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-86aa8333-8da5-49b0-9923-65bc50ce035a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 4515975d-ef4b-4f5b-95b7-4b1775b20b81] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:51.552785 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86aa8333-8da5-49b0-9923-65bc50ce035a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:51.553603 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86aa8333-8da5-49b0-9923-65bc50ce035a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:51.554584 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86aa8333-8da5-49b0-9923-65bc50ce035a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:51.555530 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86aa8333-8da5-49b0-9923-65bc50ce035a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:51.556248 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86aa8333-8da5-49b0-9923-65bc50ce035a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:51.556882 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86aa8333-8da5-49b0-9923-65bc50ce035a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:51.604739 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-86aa8333-8da5-49b0-9923-65bc50ce035a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 4515975d-ef4b-4f5b-95b7-4b1775b20b81] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:13:51.768145 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-86aa8333-8da5-49b0-9923-65bc50ce035a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4515975d-ef4b-4f5b-95b7-4b1775b20b81" status: 204 len: 0 microversion: 2.1 time: 0.226949 Aug 07 01:13:51.771603 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 534/942] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:13:51 2022] DELETE /compute/v2.1/servers/4515975d-ef4b-4f5b-95b7-4b1775b20b81 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:13:51.780218 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c9c6dfba-42a2-44c1-bde4-12a0a7a7e497 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:51.780949 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c9c6dfba-42a2-44c1-bde4-12a0a7a7e497 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:51.794174 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c9c6dfba-42a2-44c1-bde4-12a0a7a7e497 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:51.794664 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c9c6dfba-42a2-44c1-bde4-12a0a7a7e497 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:51.799702 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c9c6dfba-42a2-44c1-bde4-12a0a7a7e497 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:51.800522 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c9c6dfba-42a2-44c1-bde4-12a0a7a7e497 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:51.802422 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c9c6dfba-42a2-44c1-bde4-12a0a7a7e497 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:51.802778 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c9c6dfba-42a2-44c1-bde4-12a0a7a7e497 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:51.806025 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=47 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:51.999167 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e157786d-f305-4046-8afa-0e0884772235 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:52.023389 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e157786d-f305-4046-8afa-0e0884772235 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/5637b619-e3c0-47a9-beb1-2adf3e5ad29c" status: 200 len: 1314 microversion: 2.1 time: 0.689266 Aug 07 01:13:52.023628 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c9c6dfba-42a2-44c1-bde4-12a0a7a7e497 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dce42ff994d81b1ad6d6c05356c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6d319a0452448485aa65b7cf1c5b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:52.034106 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c9c6dfba-42a2-44c1-bde4-12a0a7a7e497 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6" status: 200 len: 1317 microversion: 2.1 time: 0.260846 Aug 07 01:13:52.047919 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 535/943] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:51 2022] GET /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6 => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:52.047919 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c65eb6b0-6ce8-48be-8846-e4def2a412ca tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:52.047919 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c65eb6b0-6ce8-48be-8846-e4def2a412ca tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 4515975d-ef4b-4f5b-95b7-4b1775b20b81] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:52.049521 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c65eb6b0-6ce8-48be-8846-e4def2a412ca tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:52.049909 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 409/944] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:51 2022] GET /compute/v2.1/servers/5637b619-e3c0-47a9-beb1-2adf3e5ad29c => generated 1314 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:52.050169 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c65eb6b0-6ce8-48be-8846-e4def2a412ca tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:52.050635 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c65eb6b0-6ce8-48be-8846-e4def2a412ca tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:52.051452 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c65eb6b0-6ce8-48be-8846-e4def2a412ca tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:52.052045 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c65eb6b0-6ce8-48be-8846-e4def2a412ca tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:52.052487 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c65eb6b0-6ce8-48be-8846-e4def2a412ca tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:52.059740 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7a2e6754-1162-451a-b7b0-c920b53d7515 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:52.060925 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7a2e6754-1162-451a-b7b0-c920b53d7515 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 9a4ced25-d85e-4469-95b6-5e666731a714] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:52.071548 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a2e6754-1162-451a-b7b0-c920b53d7515 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:52.072460 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a2e6754-1162-451a-b7b0-c920b53d7515 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:52.073308 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a2e6754-1162-451a-b7b0-c920b53d7515 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:52.074081 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:52.074529 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a2e6754-1162-451a-b7b0-c920b53d7515 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:52.075696 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a2e6754-1162-451a-b7b0-c920b53d7515 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:52.077732 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a2e6754-1162-451a-b7b0-c920b53d7515 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:52.234704 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7a2e6754-1162-451a-b7b0-c920b53d7515 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:52.235302 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c65eb6b0-6ce8-48be-8846-e4def2a412ca tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:52.262670 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c65eb6b0-6ce8-48be-8846-e4def2a412ca tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/4515975d-ef4b-4f5b-95b7-4b1775b20b81" status: 200 len: 1526 microversion: 2.1 time: 0.226252 Aug 07 01:13:52.263802 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 536/945] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:52 2022] GET /compute/v2.1/servers/4515975d-ef4b-4f5b-95b7-4b1775b20b81 => generated 1526 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:52.268984 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-84e34d66-4fbf-40a6-84db-55467b332c93 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:52.270129 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-84e34d66-4fbf-40a6-84db-55467b332c93 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:52.279533 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7a2e6754-1162-451a-b7b0-c920b53d7515 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714" status: 200 len: 1277 microversion: 2.1 time: 0.227925 Aug 07 01:13:52.291912 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84e34d66-4fbf-40a6-84db-55467b332c93 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:52.291912 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84e34d66-4fbf-40a6-84db-55467b332c93 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:52.291912 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84e34d66-4fbf-40a6-84db-55467b332c93 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:52.291912 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84e34d66-4fbf-40a6-84db-55467b332c93 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:52.292415 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84e34d66-4fbf-40a6-84db-55467b332c93 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:52.292415 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84e34d66-4fbf-40a6-84db-55467b332c93 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:52.292926 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 410/946] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:52 2022] GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714 => generated 1277 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:52.367521 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-3c732dcd-4fd2-47cb-89a3-c3bdb577e3ca req-48d083e5-ad8d-4f94-ba4b-ce381abf9f87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5637b619-e3c0-47a9-beb1-2adf3e5ad29c", "name": "network-vif-plugged", "status": "completed", "tag": "f04fc253-b892-46a9-a3b1-750cdbd6561d"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:52.383394 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3c732dcd-4fd2-47cb-89a3-c3bdb577e3ca req-48d083e5-ad8d-4f94-ba4b-ce381abf9f87 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:52.384260 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3c732dcd-4fd2-47cb-89a3-c3bdb577e3ca req-48d083e5-ad8d-4f94-ba4b-ce381abf9f87 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:52.386579 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3c732dcd-4fd2-47cb-89a3-c3bdb577e3ca req-48d083e5-ad8d-4f94-ba4b-ce381abf9f87 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:52.400319 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-3c732dcd-4fd2-47cb-89a3-c3bdb577e3ca req-48d083e5-ad8d-4f94-ba4b-ce381abf9f87 service nova] Creating event network-vif-plugged:f04fc253-b892-46a9-a3b1-750cdbd6561d for instance 5637b619-e3c0-47a9-beb1-2adf3e5ad29c on n-h1-master-1 Aug 07 01:13:52.407578 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-3c732dcd-4fd2-47cb-89a3-c3bdb577e3ca req-48d083e5-ad8d-4f94-ba4b-ce381abf9f87 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045203 Aug 07 01:13:52.411625 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 411/947] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:13:52.543369 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-84e34d66-4fbf-40a6-84db-55467b332c93 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:52.561384 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-84e34d66-4fbf-40a6-84db-55467b332c93 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1476 microversion: 2.1 time: 0.295347 Aug 07 01:13:52.562382 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 537/948] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:52 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1476 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:53.057316 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0996cf2e-7911-4ee9-aeb0-c8e9b427d4a6 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:53.058036 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0996cf2e-7911-4ee9-aeb0-c8e9b427d4a6 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:53.064747 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d966dcd9-3558-4bb5-a9fe-50e86a8d6104 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:53.065659 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d966dcd9-3558-4bb5-a9fe-50e86a8d6104 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 5637b619-e3c0-47a9-beb1-2adf3e5ad29c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:53.070108 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0996cf2e-7911-4ee9-aeb0-c8e9b427d4a6 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:53.070833 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0996cf2e-7911-4ee9-aeb0-c8e9b427d4a6 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:53.071429 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0996cf2e-7911-4ee9-aeb0-c8e9b427d4a6 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:53.072365 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0996cf2e-7911-4ee9-aeb0-c8e9b427d4a6 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:53.073009 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0996cf2e-7911-4ee9-aeb0-c8e9b427d4a6 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:53.073592 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0996cf2e-7911-4ee9-aeb0-c8e9b427d4a6 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:53.100111 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d966dcd9-3558-4bb5-a9fe-50e86a8d6104 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:53.100650 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d966dcd9-3558-4bb5-a9fe-50e86a8d6104 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:53.101101 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d966dcd9-3558-4bb5-a9fe-50e86a8d6104 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:53.104581 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d966dcd9-3558-4bb5-a9fe-50e86a8d6104 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:53.108849 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d966dcd9-3558-4bb5-a9fe-50e86a8d6104 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:53.109368 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d966dcd9-3558-4bb5-a9fe-50e86a8d6104 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:53.278220 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:53.409647 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0996cf2e-7911-4ee9-aeb0-c8e9b427d4a6 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dce42ff994d81b1ad6d6c05356c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6d319a0452448485aa65b7cf1c5b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:53.412240 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d966dcd9-3558-4bb5-a9fe-50e86a8d6104 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:53.420454 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d966dcd9-3558-4bb5-a9fe-50e86a8d6104 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/5637b619-e3c0-47a9-beb1-2adf3e5ad29c" status: 200 len: 1314 microversion: 2.1 time: 0.365507 Aug 07 01:13:53.420674 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0996cf2e-7911-4ee9-aeb0-c8e9b427d4a6 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6" status: 200 len: 1317 microversion: 2.1 time: 0.368059 Aug 07 01:13:53.421582 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 538/949] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:53 2022] GET /compute/v2.1/servers/5637b619-e3c0-47a9-beb1-2adf3e5ad29c => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:53.426420 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c3ad5442-5847-4f86-9f55-eb3070ad6ec1 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:53.427316 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c3ad5442-5847-4f86-9f55-eb3070ad6ec1 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 4515975d-ef4b-4f5b-95b7-4b1775b20b81] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:53.433959 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3ad5442-5847-4f86-9f55-eb3070ad6ec1 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:53.434703 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3ad5442-5847-4f86-9f55-eb3070ad6ec1 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:53.435388 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3ad5442-5847-4f86-9f55-eb3070ad6ec1 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:53.436321 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3ad5442-5847-4f86-9f55-eb3070ad6ec1 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:53.436937 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3ad5442-5847-4f86-9f55-eb3070ad6ec1 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:53.437521 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3ad5442-5847-4f86-9f55-eb3070ad6ec1 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:53.440627 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 412/950] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:53 2022] GET /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6 => generated 1317 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:53.457946 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-aee32b9c-0149-438a-819b-14256a8d7f7d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:53.458833 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-aee32b9c-0149-438a-819b-14256a8d7f7d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 9a4ced25-d85e-4469-95b6-5e666731a714] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:53.467011 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aee32b9c-0149-438a-819b-14256a8d7f7d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:53.467937 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aee32b9c-0149-438a-819b-14256a8d7f7d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:53.468592 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aee32b9c-0149-438a-819b-14256a8d7f7d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:53.469538 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aee32b9c-0149-438a-819b-14256a8d7f7d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:53.470191 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aee32b9c-0149-438a-819b-14256a8d7f7d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:53.470788 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aee32b9c-0149-438a-819b-14256a8d7f7d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:53.685090 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c3ad5442-5847-4f86-9f55-eb3070ad6ec1 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:53.703094 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c3ad5442-5847-4f86-9f55-eb3070ad6ec1 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/4515975d-ef4b-4f5b-95b7-4b1775b20b81" status: 200 len: 1526 microversion: 2.1 time: 0.279989 Aug 07 01:13:53.704998 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 539/951] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:53 2022] GET /compute/v2.1/servers/4515975d-ef4b-4f5b-95b7-4b1775b20b81 => generated 1526 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:53.711790 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d92e6b2e-362a-4912-99cb-a359de7205d5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:53.712759 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d92e6b2e-362a-4912-99cb-a359de7205d5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:53.723089 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d92e6b2e-362a-4912-99cb-a359de7205d5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:53.724051 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d92e6b2e-362a-4912-99cb-a359de7205d5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:53.724760 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d92e6b2e-362a-4912-99cb-a359de7205d5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:53.725865 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d92e6b2e-362a-4912-99cb-a359de7205d5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:53.726274 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d92e6b2e-362a-4912-99cb-a359de7205d5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:53.726711 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d92e6b2e-362a-4912-99cb-a359de7205d5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:53.892714 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d92e6b2e-362a-4912-99cb-a359de7205d5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:53.904305 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d92e6b2e-362a-4912-99cb-a359de7205d5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1476 microversion: 2.1 time: 0.196794 Aug 07 01:13:53.905010 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 540/952] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:53 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1476 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:53.924391 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-31f7f193-eaa2-4b4d-b3ae-25bd98a6bcd0 req-8052fbdb-3862-4d26-b6d4-711af111aa76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb8bf657-63c6-4cea-8571-e9449c5ee529", "tag": "1681a453-c8a8-46bc-aef4-5ce8cc192252"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:53.935673 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-31f7f193-eaa2-4b4d-b3ae-25bd98a6bcd0 req-8052fbdb-3862-4d26-b6d4-711af111aa76 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:53.936397 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-31f7f193-eaa2-4b4d-b3ae-25bd98a6bcd0 req-8052fbdb-3862-4d26-b6d4-711af111aa76 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:53.936777 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-31f7f193-eaa2-4b4d-b3ae-25bd98a6bcd0 req-8052fbdb-3862-4d26-b6d4-711af111aa76 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:53.949309 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-31f7f193-eaa2-4b4d-b3ae-25bd98a6bcd0 req-8052fbdb-3862-4d26-b6d4-711af111aa76 service nova] Creating event network-changed:1681a453-c8a8-46bc-aef4-5ce8cc192252 for instance fb8bf657-63c6-4cea-8571-e9449c5ee529 on n-h2-master-1 Aug 07 01:13:53.955955 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-31f7f193-eaa2-4b4d-b3ae-25bd98a6bcd0 req-8052fbdb-3862-4d26-b6d4-711af111aa76 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049508 Aug 07 01:13:53.956670 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 541/953] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:13:54.029386 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-aee32b9c-0149-438a-819b-14256a8d7f7d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:54.037620 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-aee32b9c-0149-438a-819b-14256a8d7f7d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714" status: 200 len: 1319 microversion: 2.1 time: 0.595759 Aug 07 01:13:54.038214 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 413/954] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:53 2022] GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714 => generated 1319 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:54.460077 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-60534b88-8ff9-4b9f-8af3-6e0af34af9d5 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:54.461053 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-60534b88-8ff9-4b9f-8af3-6e0af34af9d5 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 5637b619-e3c0-47a9-beb1-2adf3e5ad29c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:54.462265 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-956b5516-8eff-4ade-ab1c-c548b4e9185e tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:54.463548 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-956b5516-8eff-4ade-ab1c-c548b4e9185e tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:54.468482 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60534b88-8ff9-4b9f-8af3-6e0af34af9d5 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:54.468975 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60534b88-8ff9-4b9f-8af3-6e0af34af9d5 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:54.469414 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60534b88-8ff9-4b9f-8af3-6e0af34af9d5 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:54.470127 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60534b88-8ff9-4b9f-8af3-6e0af34af9d5 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:54.470578 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60534b88-8ff9-4b9f-8af3-6e0af34af9d5 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:54.471002 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60534b88-8ff9-4b9f-8af3-6e0af34af9d5 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:54.472462 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-956b5516-8eff-4ade-ab1c-c548b4e9185e tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:54.473151 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-956b5516-8eff-4ade-ab1c-c548b4e9185e tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:54.473728 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-956b5516-8eff-4ade-ab1c-c548b4e9185e tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:54.474657 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-956b5516-8eff-4ade-ab1c-c548b4e9185e tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:54.475286 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-956b5516-8eff-4ade-ab1c-c548b4e9185e tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:54.476653 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-956b5516-8eff-4ade-ab1c-c548b4e9185e tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:54.629547 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-60534b88-8ff9-4b9f-8af3-6e0af34af9d5 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:54.638017 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-60534b88-8ff9-4b9f-8af3-6e0af34af9d5 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/5637b619-e3c0-47a9-beb1-2adf3e5ad29c" status: 200 len: 1314 microversion: 2.1 time: 0.183053 Aug 07 01:13:54.638598 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 542/955] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:54 2022] GET /compute/v2.1/servers/5637b619-e3c0-47a9-beb1-2adf3e5ad29c => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:54.729421 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5c1a738d-aba8-418a-a332-932bc577de8b tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:54.730181 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5c1a738d-aba8-418a-a332-932bc577de8b tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 4515975d-ef4b-4f5b-95b7-4b1775b20b81] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:54.736325 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5c1a738d-aba8-418a-a332-932bc577de8b tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:54.736798 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5c1a738d-aba8-418a-a332-932bc577de8b tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:54.737236 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5c1a738d-aba8-418a-a332-932bc577de8b tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:54.737945 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5c1a738d-aba8-418a-a332-932bc577de8b tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:54.738399 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5c1a738d-aba8-418a-a332-932bc577de8b tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:54.738824 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5c1a738d-aba8-418a-a332-932bc577de8b tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:54.905769 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5c1a738d-aba8-418a-a332-932bc577de8b tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:54.913866 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5c1a738d-aba8-418a-a332-932bc577de8b tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/4515975d-ef4b-4f5b-95b7-4b1775b20b81" status: 200 len: 1526 microversion: 2.1 time: 0.188918 Aug 07 01:13:54.914452 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 543/956] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:54 2022] GET /compute/v2.1/servers/4515975d-ef4b-4f5b-95b7-4b1775b20b81 => generated 1526 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:13:54.935851 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dd51d27d-c22f-4b4b-a2c9-fe481ab80b40 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:54.936524 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-dd51d27d-c22f-4b4b-a2c9-fe481ab80b40 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:54.943299 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd51d27d-c22f-4b4b-a2c9-fe481ab80b40 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:54.943795 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd51d27d-c22f-4b4b-a2c9-fe481ab80b40 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:54.944262 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd51d27d-c22f-4b4b-a2c9-fe481ab80b40 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:54.944977 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd51d27d-c22f-4b4b-a2c9-fe481ab80b40 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:54.945471 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd51d27d-c22f-4b4b-a2c9-fe481ab80b40 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:54.945885 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd51d27d-c22f-4b4b-a2c9-fe481ab80b40 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:55.091593 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-dd51d27d-c22f-4b4b-a2c9-fe481ab80b40 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:55.100442 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-dd51d27d-c22f-4b4b-a2c9-fe481ab80b40 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1476 microversion: 2.1 time: 0.173469 Aug 07 01:13:55.102919 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 544/957] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:54 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1476 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:55.109129 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7bb27b3d-296d-4b29-8067-2d2b58683fa7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:55.110010 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7bb27b3d-296d-4b29-8067-2d2b58683fa7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 9a4ced25-d85e-4469-95b6-5e666731a714] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:55.117233 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7bb27b3d-296d-4b29-8067-2d2b58683fa7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:55.118831 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7bb27b3d-296d-4b29-8067-2d2b58683fa7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:55.119372 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7bb27b3d-296d-4b29-8067-2d2b58683fa7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:55.120570 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7bb27b3d-296d-4b29-8067-2d2b58683fa7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:55.121117 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7bb27b3d-296d-4b29-8067-2d2b58683fa7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:55.122126 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7bb27b3d-296d-4b29-8067-2d2b58683fa7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:55.274267 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-956b5516-8eff-4ade-ab1c-c548b4e9185e tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dce42ff994d81b1ad6d6c05356c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6d319a0452448485aa65b7cf1c5b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:55.278426 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:55.290000 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-956b5516-8eff-4ade-ab1c-c548b4e9185e tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6" status: 200 len: 1506 microversion: 2.1 time: 0.832214 Aug 07 01:13:55.290896 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 414/958] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:54 2022] GET /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6 => generated 1506 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:13:55.314973 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7bb27b3d-296d-4b29-8067-2d2b58683fa7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:55.324187 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7bb27b3d-296d-4b29-8067-2d2b58683fa7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714" status: 200 len: 1319 microversion: 2.1 time: 0.219830 Aug 07 01:13:55.328818 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 545/959] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:55 2022] GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:55.660938 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ab990ce2-8d3a-4c57-929d-fd7db050d73c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:55.664642 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ab990ce2-8d3a-4c57-929d-fd7db050d73c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 5637b619-e3c0-47a9-beb1-2adf3e5ad29c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:55.678222 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab990ce2-8d3a-4c57-929d-fd7db050d73c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:55.678915 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab990ce2-8d3a-4c57-929d-fd7db050d73c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:55.679645 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab990ce2-8d3a-4c57-929d-fd7db050d73c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:55.680609 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab990ce2-8d3a-4c57-929d-fd7db050d73c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:55.681217 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab990ce2-8d3a-4c57-929d-fd7db050d73c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:55.681826 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab990ce2-8d3a-4c57-929d-fd7db050d73c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:55.902141 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ab990ce2-8d3a-4c57-929d-fd7db050d73c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:55.916807 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ab990ce2-8d3a-4c57-929d-fd7db050d73c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/5637b619-e3c0-47a9-beb1-2adf3e5ad29c" status: 200 len: 1463 microversion: 2.1 time: 0.261084 Aug 07 01:13:55.932717 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 415/960] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:55 2022] GET /compute/v2.1/servers/5637b619-e3c0-47a9-beb1-2adf3e5ad29c => generated 1463 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:55.940038 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c0a6acfe-030d-45d6-98cc-64494597cba5 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:55.940643 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c0a6acfe-030d-45d6-98cc-64494597cba5 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 4515975d-ef4b-4f5b-95b7-4b1775b20b81] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:55.951979 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c0a6acfe-030d-45d6-98cc-64494597cba5 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:55.952624 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8d9e52b9-cd11-43eb-b349-c9d74ab0faf8 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:55.952915 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c0a6acfe-030d-45d6-98cc-64494597cba5 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:55.953244 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8d9e52b9-cd11-43eb-b349-c9d74ab0faf8 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:55.953703 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c0a6acfe-030d-45d6-98cc-64494597cba5 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:55.954577 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c0a6acfe-030d-45d6-98cc-64494597cba5 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:55.955192 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c0a6acfe-030d-45d6-98cc-64494597cba5 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:55.955981 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c0a6acfe-030d-45d6-98cc-64494597cba5 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:55.976165 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8d9e52b9-cd11-43eb-b349-c9d74ab0faf8 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:55.985722 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8d9e52b9-cd11-43eb-b349-c9d74ab0faf8 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:55.986290 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8d9e52b9-cd11-43eb-b349-c9d74ab0faf8 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:55.987674 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8d9e52b9-cd11-43eb-b349-c9d74ab0faf8 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:55.988811 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8d9e52b9-cd11-43eb-b349-c9d74ab0faf8 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:55.990806 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8d9e52b9-cd11-43eb-b349-c9d74ab0faf8 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:56.003497 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c0a6acfe-030d-45d6-98cc-64494597cba5 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:56.004275 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c0a6acfe-030d-45d6-98cc-64494597cba5 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:56.004867 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c0a6acfe-030d-45d6-98cc-64494597cba5 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:56.005475 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-c0a6acfe-030d-45d6-98cc-64494597cba5 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lazy-loading 'fault' on Instance uuid 4515975d-ef4b-4f5b-95b7-4b1775b20b81 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:13:56.105386 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c0a6acfe-030d-45d6-98cc-64494597cba5 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:56.122282 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c0a6acfe-030d-45d6-98cc-64494597cba5 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/4515975d-ef4b-4f5b-95b7-4b1775b20b81" status: 200 len: 1314 microversion: 2.1 time: 0.185572 Aug 07 01:13:56.124650 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 546/961] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:55 2022] GET /compute/v2.1/servers/4515975d-ef4b-4f5b-95b7-4b1775b20b81 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:56.146704 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-baa69fac-5442-46c3-8a60-3de1787b3c06 req-1cfea0f6-e7cb-459d-be0e-ad4fd1e55f8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4515975d-ef4b-4f5b-95b7-4b1775b20b81", "name": "network-vif-deleted", "tag": "3965c7e9-9460-47fd-b5eb-2099a28f3ccf"}, {"name": "network-changed", "server_uuid": "9a4ced25-d85e-4469-95b6-5e666731a714", "tag": "0e4b319a-2574-4b38-a31e-4942cb5bda7f"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:56.164614 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-baa69fac-5442-46c3-8a60-3de1787b3c06 req-1cfea0f6-e7cb-459d-be0e-ad4fd1e55f8d service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:56.166235 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-baa69fac-5442-46c3-8a60-3de1787b3c06 req-1cfea0f6-e7cb-459d-be0e-ad4fd1e55f8d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:56.166915 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-baa69fac-5442-46c3-8a60-3de1787b3c06 req-1cfea0f6-e7cb-459d-be0e-ad4fd1e55f8d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:56.200589 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-baa69fac-5442-46c3-8a60-3de1787b3c06 req-1cfea0f6-e7cb-459d-be0e-ad4fd1e55f8d service nova] Creating event network-vif-deleted:3965c7e9-9460-47fd-b5eb-2099a28f3ccf for instance 4515975d-ef4b-4f5b-95b7-4b1775b20b81 on n-h2-master-1 Aug 07 01:13:56.201579 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-baa69fac-5442-46c3-8a60-3de1787b3c06 req-1cfea0f6-e7cb-459d-be0e-ad4fd1e55f8d service nova] Creating event network-changed:0e4b319a-2574-4b38-a31e-4942cb5bda7f for instance 9a4ced25-d85e-4469-95b6-5e666731a714 on n-h2-master-1 Aug 07 01:13:56.211545 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8d9e52b9-cd11-43eb-b349-c9d74ab0faf8 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:56.213940 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-baa69fac-5442-46c3-8a60-3de1787b3c06 req-1cfea0f6-e7cb-459d-be0e-ad4fd1e55f8d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.087032 Aug 07 01:13:56.214809 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 547/962] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:13:56.222116 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8d9e52b9-cd11-43eb-b349-c9d74ab0faf8 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1463 microversion: 2.1 time: 0.273745 Aug 07 01:13:56.226221 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-172bb1e6-fee8-40e0-a245-62b02186c218 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:56.226419 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 416/963] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:55 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1463 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:13:56.227907 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-172bb1e6-fee8-40e0-a245-62b02186c218 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:56.257727 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-172bb1e6-fee8-40e0-a245-62b02186c218 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:56.258230 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-172bb1e6-fee8-40e0-a245-62b02186c218 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:56.258672 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-172bb1e6-fee8-40e0-a245-62b02186c218 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:56.267046 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-172bb1e6-fee8-40e0-a245-62b02186c218 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:56.267606 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-172bb1e6-fee8-40e0-a245-62b02186c218 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:56.268078 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-172bb1e6-fee8-40e0-a245-62b02186c218 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:56.356368 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-26b887ae-090c-430f-8c3e-944b3c7fd5e6 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:56.357753 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-26b887ae-090c-430f-8c3e-944b3c7fd5e6 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 9a4ced25-d85e-4469-95b6-5e666731a714] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:56.380259 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-26b887ae-090c-430f-8c3e-944b3c7fd5e6 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:56.383105 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-26b887ae-090c-430f-8c3e-944b3c7fd5e6 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:56.384305 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-26b887ae-090c-430f-8c3e-944b3c7fd5e6 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:56.385220 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-26b887ae-090c-430f-8c3e-944b3c7fd5e6 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:56.388530 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-26b887ae-090c-430f-8c3e-944b3c7fd5e6 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:56.389177 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-26b887ae-090c-430f-8c3e-944b3c7fd5e6 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:56.634349 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-26b887ae-090c-430f-8c3e-944b3c7fd5e6 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:56.643985 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-26b887ae-090c-430f-8c3e-944b3c7fd5e6 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714" status: 200 len: 1319 microversion: 2.1 time: 0.295150 Aug 07 01:13:56.657847 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 417/964] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:56 2022] GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714 => generated 1319 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:56.657847 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-949e6bd2-6081-479a-8f51-fdc3cdad9b3a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2067534954", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "766de05a-a562-4045-bdf9-c49050382e1a"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:56.744051 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-949e6bd2-6081-479a-8f51-fdc3cdad9b3a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] validate_networks() for None {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:13:57.216554 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-172bb1e6-fee8-40e0-a245-62b02186c218 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:57.235393 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-172bb1e6-fee8-40e0-a245-62b02186c218 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1476 microversion: 2.1 time: 1.013908 Aug 07 01:13:57.240797 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 548/965] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:56 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1476 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:57.248793 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c3fc978e-38f4-4254-a482-f01f802f07a3 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:57.254954 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c3fc978e-38f4-4254-a482-f01f802f07a3 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 4515975d-ef4b-4f5b-95b7-4b1775b20b81] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:57.283251 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:57.287494 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3fc978e-38f4-4254-a482-f01f802f07a3 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:57.288270 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3fc978e-38f4-4254-a482-f01f802f07a3 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:57.288838 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3fc978e-38f4-4254-a482-f01f802f07a3 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:57.289686 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3fc978e-38f4-4254-a482-f01f802f07a3 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:57.290424 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3fc978e-38f4-4254-a482-f01f802f07a3 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:57.291103 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3fc978e-38f4-4254-a482-f01f802f07a3 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:57.366996 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3fc978e-38f4-4254-a482-f01f802f07a3 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:57.368910 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3fc978e-38f4-4254-a482-f01f802f07a3 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:57.369642 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3fc978e-38f4-4254-a482-f01f802f07a3 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:57.374323 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-c3fc978e-38f4-4254-a482-f01f802f07a3 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lazy-loading 'fault' on Instance uuid 4515975d-ef4b-4f5b-95b7-4b1775b20b81 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:13:57.443596 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c3fc978e-38f4-4254-a482-f01f802f07a3 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c135ba135fd946149ace9a86c7c52e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e443158f15b42a3a795950a7c409a38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:57.458188 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c3fc978e-38f4-4254-a482-f01f802f07a3 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/4515975d-ef4b-4f5b-95b7-4b1775b20b81" status: 200 len: 1314 microversion: 2.1 time: 0.215522 Aug 07 01:13:57.459183 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 549/966] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:57 2022] GET /compute/v2.1/servers/4515975d-ef4b-4f5b-95b7-4b1775b20b81 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:57.669052 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-36b5032f-a41e-4bd1-8022-91ac23b94c33 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:57.669961 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-36b5032f-a41e-4bd1-8022-91ac23b94c33 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 9a4ced25-d85e-4469-95b6-5e666731a714] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:57.679779 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-36b5032f-a41e-4bd1-8022-91ac23b94c33 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:57.680556 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-36b5032f-a41e-4bd1-8022-91ac23b94c33 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:57.681204 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-36b5032f-a41e-4bd1-8022-91ac23b94c33 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:57.682333 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-36b5032f-a41e-4bd1-8022-91ac23b94c33 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:57.683048 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-36b5032f-a41e-4bd1-8022-91ac23b94c33 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:57.684204 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-36b5032f-a41e-4bd1-8022-91ac23b94c33 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:57.739216 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-949e6bd2-6081-479a-8f51-fdc3cdad9b3a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:13:57.739927 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-949e6bd2-6081-479a-8f51-fdc3cdad9b3a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:13:57.740381 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-949e6bd2-6081-479a-8f51-fdc3cdad9b3a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:13:57.740795 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-949e6bd2-6081-479a-8f51-fdc3cdad9b3a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:13:57.741222 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-949e6bd2-6081-479a-8f51-fdc3cdad9b3a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:13:57.766484 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-949e6bd2-6081-479a-8f51-fdc3cdad9b3a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:57.767269 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-949e6bd2-6081-479a-8f51-fdc3cdad9b3a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:57.768313 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-949e6bd2-6081-479a-8f51-fdc3cdad9b3a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:57.775033 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-949e6bd2-6081-479a-8f51-fdc3cdad9b3a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:57.775830 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-949e6bd2-6081-479a-8f51-fdc3cdad9b3a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:57.776555 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-949e6bd2-6081-479a-8f51-fdc3cdad9b3a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:57.816187 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-949e6bd2-6081-479a-8f51-fdc3cdad9b3a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Getting quotas for project 76537752718449e19d6ad94c8e3bc973. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:13:57.823743 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-949e6bd2-6081-479a-8f51-fdc3cdad9b3a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Getting quotas for user 26994bfd2e094415bb9b6e265d52eeae and project 76537752718449e19d6ad94c8e3bc973. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:13:57.855689 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-949e6bd2-6081-479a-8f51-fdc3cdad9b3a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:13:57.868383 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-949e6bd2-6081-479a-8f51-fdc3cdad9b3a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 1e845e5c-f730-47a0-a5a9-8e0666de0d10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:13:57.925129 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-949e6bd2-6081-479a-8f51-fdc3cdad9b3a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.278656 Aug 07 01:13:57.926506 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 418/967] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:13:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1281 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:13:57.947441 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a2282d60-879e-47e0-bbdb-5a0e05e088e9 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:57.948706 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a2282d60-879e-47e0-bbdb-5a0e05e088e9 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 1e845e5c-f730-47a0-a5a9-8e0666de0d10] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:57.954558 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:58.091874 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a2282d60-879e-47e0-bbdb-5a0e05e088e9 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:58.101905 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a2282d60-879e-47e0-bbdb-5a0e05e088e9 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10" status: 200 len: 1214 microversion: 2.1 time: 0.165816 Aug 07 01:13:58.103426 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 419/968] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:57 2022] GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10 => generated 1214 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:58.110087 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1086ecd9-1694-44f3-8b86-cbeee479de8d tempest-VolumesAdminNegativeTest-1453158014 tempest-VolumesAdminNegativeTest-1453158014-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "c601d4e7-641a-4957-992a-2e1e9ce5742e"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:13:58.113893 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1086ecd9-1694-44f3-8b86-cbeee479de8d tempest-VolumesAdminNegativeTest-1453158014 tempest-VolumesAdminNegativeTest-1453158014-project-admin] [instance: aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:58.120877 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1086ecd9-1694-44f3-8b86-cbeee479de8d tempest-VolumesAdminNegativeTest-1453158014 tempest-VolumesAdminNegativeTest-1453158014-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:58.121955 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1086ecd9-1694-44f3-8b86-cbeee479de8d tempest-VolumesAdminNegativeTest-1453158014 tempest-VolumesAdminNegativeTest-1453158014-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:58.122644 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1086ecd9-1694-44f3-8b86-cbeee479de8d tempest-VolumesAdminNegativeTest-1453158014 tempest-VolumesAdminNegativeTest-1453158014-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:58.124203 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1086ecd9-1694-44f3-8b86-cbeee479de8d tempest-VolumesAdminNegativeTest-1453158014 tempest-VolumesAdminNegativeTest-1453158014-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:58.125047 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1086ecd9-1694-44f3-8b86-cbeee479de8d tempest-VolumesAdminNegativeTest-1453158014 tempest-VolumesAdminNegativeTest-1453158014-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:58.125583 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1086ecd9-1694-44f3-8b86-cbeee479de8d tempest-VolumesAdminNegativeTest-1453158014 tempest-VolumesAdminNegativeTest-1453158014-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:58.229521 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-1086ecd9-1694-44f3-8b86-cbeee479de8d tempest-VolumesAdminNegativeTest-1453158014 tempest-VolumesAdminNegativeTest-1453158014-project-admin] HTTP exception thrown: Volume 67af8490-942b-4c5d-aa16-b7f70592f591 could not be found. Aug 07 01:13:58.243332 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-36b5032f-a41e-4bd1-8022-91ac23b94c33 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:58.244106 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1086ecd9-1694-44f3-8b86-cbeee479de8d tempest-VolumesAdminNegativeTest-1453158014 tempest-VolumesAdminNegativeTest-1453158014-project-admin] Request method failure captured: Aug 07 01:13:58.244106 n-d-master-1 devstack@n-api.service[119517]: request: PUT /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6/os-volume_attachments/67af8490-942b-4c5d-aa16-b7f70592f591 HTTP/1.1 Aug 07 01:13:58.244106 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:13:58.244106 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:13:58.244106 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:13:58.244106 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 74 Aug 07 01:13:58.244106 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:13:58.244106 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:13:58.244106 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:13:58.244106 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:13:58.244106 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xEyam_wgc0SDpYGC8jFIq_EOR42GBaiOfziZRFzPIVvEsV4ERDLrXIaVitWyP450cBMxelEECxHvI4Pt0KIOjzhFfqc4DRnOkKaa-y7FGgklAZSWA5FdqfNcPS7mb95STB0g4qjA_7TorND69R1cOy9yvzR0P8rIPUszQHmHl_aGqE Aug 07 01:13:58.244106 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:13:58.244106 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:13:58.244106 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:13:58.244106 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:13:58.244106 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:13:58.244106 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:13:58.244106 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: d5ea429307984908b718fa99c7391fb4 Aug 07 01:13:58.244106 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-VolumesAdminNegativeTest-1453158014 Aug 07 01:13:58.244106 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,admin,member Aug 07 01:13:58.244106 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,admin,member Aug 07 01:13:58.246619 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d5ea429307984908b718fa99c7391fb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d5ea429307984908b718fa99c7391fb4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d5ea429307984908b718fa99c7391fb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d5ea429307984908b718fa99c7391fb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:13:58.246619 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-VolumesAdminNegativeTest-1453158014 Aug 07 01:13:58.246619 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: d5ea429307984908b718fa99c7391fb4 Aug 07 01:13:58.246619 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1453158014 Aug 07 01:13:58.246619 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-VolumesAdminNegativeTest-1453158014-project-admin Aug 07 01:13:58.246619 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:13:58.246619 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:13:58.246619 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 48ba57d381ee4569b9bce256d01bc5c6 Aug 07 01:13:58.246619 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-VolumesAdminNegativeTest-1453158014-project-admin Aug 07 01:13:58.246619 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:13:58.246619 n-d-master-1 devstack@n-api.service[119517]: {"volumeAttachment": {"volumeId": "c601d4e7-641a-4957-992a-2e1e9ce5742e"}} Aug 07 01:13:58.246619 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:13:58.246619 n-d-master-1 devstack@n-api.service[119517]: exception: Volume 67af8490-942b-4c5d-aa16-b7f70592f591 could not be found. Aug 07 01:13:58.249045 n-d-master-1 devstack@n-api.service[119517]: action_args: {'server_id': 'aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6', 'id': '67af8490-942b-4c5d-aa16-b7f70592f591', 'body': {'volumeAttachment': {'volumeId': 'c601d4e7-641a-4957-992a-2e1e9ce5742e'}}} Aug 07 01:13:58.249045 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:13:58.249045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:58.249045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 01:13:58.249045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 01:13:58.249045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 01:13:58.249045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 01:13:58.249045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 01:13:58.249045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 01:13:58.249045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 01:13:58.249045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 01:13:58.249045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 01:13:58.249045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 01:13:58.249045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 01:13:58.249045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 01:13:58.249045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 01:13:58.249045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 01:13:58.253412 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 67af8490-942b-4c5d-aa16-b7f70592f591 could not be found. (HTTP 404) (Request-ID: req-e5f26806-ab1b-414c-afc5-58650d8d6f0b) Aug 07 01:13:58.253412 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:58.253412 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:13:58.253412 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:58.253412 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:58.253412 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 07 01:13:58.253412 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 07 01:13:58.253412 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 01:13:58.253412 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 01:13:58.253412 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 01:13:58.253412 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 01:13:58.253412 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 01:13:58.253412 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 01:13:58.253412 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 01:13:58.253412 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 01:13:58.253412 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 01:13:58.253412 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 01:13:58.253412 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 01:13:58.253412 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 01:13:58.257168 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 01:13:58.257168 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 01:13:58.257168 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 01:13:58.257168 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 01:13:58.257168 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 01:13:58.257168 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 01:13:58.257168 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 01:13:58.257168 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 01:13:58.257168 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 67af8490-942b-4c5d-aa16-b7f70592f591 could not be found. Aug 07 01:13:58.257168 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:58.257168 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:13:58.257168 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:58.257168 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:58.257168 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:13:58.257168 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:13:58.257168 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:13:58.257168 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:13:58.257168 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:13:58.257168 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:13:58.258666 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:13:58.258666 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:13:58.258666 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:13:58.258666 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:13:58.258666 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 07 01:13:58.258666 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 07 01:13:58.258666 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 07 01:13:58.258666 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:13:58.258666 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 67af8490-942b-4c5d-aa16-b7f70592f591 could not be found. Aug 07 01:13:58.258666 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:58.258666 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:13:58.258666 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:58.258666 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:58.258666 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:13:58.258666 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:13:58.258666 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:13:58.258666 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:13:58.258666 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 67af8490-942b-4c5d-aa16-b7f70592f591 could not be found. Aug 07 01:13:58.258666 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:58.260437 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1086ecd9-1694-44f3-8b86-cbeee479de8d tempest-VolumesAdminNegativeTest-1453158014 tempest-VolumesAdminNegativeTest-1453158014-project-admin] Returning 404 to user: Volume 67af8490-942b-4c5d-aa16-b7f70592f591 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:13:58.260437 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1086ecd9-1694-44f3-8b86-cbeee479de8d tempest-VolumesAdminNegativeTest-1453158014 tempest-VolumesAdminNegativeTest-1453158014-project-admin] 10.222.0.39 "PUT /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6/os-volume_attachments/67af8490-942b-4c5d-aa16-b7f70592f591" status: 404 len: 109 microversion: 2.1 time: 0.142816 Aug 07 01:13:58.264415 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-36b5032f-a41e-4bd1-8022-91ac23b94c33 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714" status: 200 len: 1319 microversion: 2.1 time: 0.601259 Aug 07 01:13:58.264647 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 420/969] 10.222.0.39 () {60 vars in 1433 bytes} [Sun Aug 7 01:13:58 2022] PUT /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6/os-volume_attachments/67af8490-942b-4c5d-aa16-b7f70592f591 => generated 109 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:13:58.267637 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 550/970] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:57 2022] GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714 => generated 1319 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:13:58.273744 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4009fddc-e896-4cc3-94b4-5750c71736f9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:58.274780 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4009fddc-e896-4cc3-94b4-5750c71736f9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:58.304292 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4009fddc-e896-4cc3-94b4-5750c71736f9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:58.305050 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4009fddc-e896-4cc3-94b4-5750c71736f9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:58.305725 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4009fddc-e896-4cc3-94b4-5750c71736f9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:58.306860 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4009fddc-e896-4cc3-94b4-5750c71736f9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:58.307586 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4009fddc-e896-4cc3-94b4-5750c71736f9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:58.327621 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4009fddc-e896-4cc3-94b4-5750c71736f9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:58.487111 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d3befdb8-6a7a-430c-9d83-0b1aafd9ac62 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:58.488065 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d3befdb8-6a7a-430c-9d83-0b1aafd9ac62 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 4515975d-ef4b-4f5b-95b7-4b1775b20b81] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:58.503879 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3befdb8-6a7a-430c-9d83-0b1aafd9ac62 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:58.505832 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3befdb8-6a7a-430c-9d83-0b1aafd9ac62 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:58.507601 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3befdb8-6a7a-430c-9d83-0b1aafd9ac62 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:58.509016 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3befdb8-6a7a-430c-9d83-0b1aafd9ac62 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:58.511574 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3befdb8-6a7a-430c-9d83-0b1aafd9ac62 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:58.516310 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3befdb8-6a7a-430c-9d83-0b1aafd9ac62 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:58.547679 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-d3befdb8-6a7a-430c-9d83-0b1aafd9ac62 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] HTTP exception thrown: Instance 4515975d-ef4b-4f5b-95b7-4b1775b20b81 could not be found. Aug 07 01:13:58.554366 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d3befdb8-6a7a-430c-9d83-0b1aafd9ac62 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Request method failure captured: Aug 07 01:13:58.554366 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/4515975d-ef4b-4f5b-95b7-4b1775b20b81 HTTP/1.1 Aug 07 01:13:58.554366 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:13:58.554366 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:13:58.554366 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:13:58.554366 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:13:58.554366 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:13:58.554366 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:13:58.554366 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:13:58.554366 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:13:58.554366 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xFJvA8aViwvAloPsDf2VckLIvT0ef2dFkqEzqRHcsoXzKL-UrjSbgq9qrhn-Kr0K6IWORgsxpa0ZC6p7prEjOQjpXXrO_P6Q36zbcHdiXbdtz0b1lfjcwupDS07IycJWoRXidnJpp03pTzYbxhgdiNsodOZkAAXZnRnVK8CHn-Gq7M Aug 07 01:13:58.554366 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:13:58.554366 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:13:58.554366 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:13:58.554366 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:13:58.554366 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:13:58.554366 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:13:58.554366 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 4e443158f15b42a3a795950a7c409a38 Aug 07 01:13:58.554366 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:13:58.554366 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:13:58.554366 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:13:58.555854 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4e443158f15b42a3a795950a7c409a38", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:13:58.555854 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:13:58.555854 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 4e443158f15b42a3a795950a7c409a38 Aug 07 01:13:58.555854 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:13:58.555854 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ImagesOneServerNegativeTestJSON-439364583-project Aug 07 01:13:58.555854 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:13:58.555854 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:13:58.555854 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: c135ba135fd946149ace9a86c7c52e80 Aug 07 01:13:58.555854 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-439364583-project Aug 07 01:13:58.555854 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:13:58.555854 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 4515975d-ef4b-4f5b-95b7-4b1775b20b81 could not be found. Aug 07 01:13:58.555854 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '4515975d-ef4b-4f5b-95b7-4b1775b20b81'} Aug 07 01:13:58.557114 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:13:58.557114 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:58.557114 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:13:58.557114 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:13:58.557114 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:13:58.557114 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:13:58.557114 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:13:58.557114 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:13:58.557114 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:13:58.557114 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:13:58.557114 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4515975d-ef4b-4f5b-95b7-4b1775b20b81 could not be found. Aug 07 01:13:58.557114 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:13:58.557114 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:13:58.557114 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:13:58.557114 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:58.557114 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:13:58.557114 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:13:58.557114 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:13:58.557114 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:13:58.557114 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:13:58.558375 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:13:58.558375 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:13:58.558375 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:13:58.558375 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:13:58.558375 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:13:58.558375 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:13:58.558375 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:13:58.558375 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4515975d-ef4b-4f5b-95b7-4b1775b20b81 could not be found. Aug 07 01:13:58.558375 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:13:58.558375 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:13:58.558375 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:13:58.558375 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:58.558375 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:13:58.558375 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:13:58.558375 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:13:58.558375 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:13:58.558375 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4515975d-ef4b-4f5b-95b7-4b1775b20b81 could not be found. Aug 07 01:13:58.558375 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:13:58.568817 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d3befdb8-6a7a-430c-9d83-0b1aafd9ac62 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Returning 404 to user: Instance 4515975d-ef4b-4f5b-95b7-4b1775b20b81 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:13:58.569916 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d3befdb8-6a7a-430c-9d83-0b1aafd9ac62 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/4515975d-ef4b-4f5b-95b7-4b1775b20b81" status: 404 len: 111 microversion: 2.1 time: 0.093066 Aug 07 01:13:58.574271 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 551/971] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:58 2022] GET /compute/v2.1/servers/4515975d-ef4b-4f5b-95b7-4b1775b20b81 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:13:58.581062 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-05ccd8f8-2419-4ac0-a884-e487d658ea8f tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '.version_select at 0x7f9e24711790>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:58.691588 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4009fddc-e896-4cc3-94b4-5750c71736f9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:58.697357 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-05ccd8f8-2419-4ac0-a884-e487d658ea8f tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] HTTP exception thrown: Image not found. Aug 07 01:13:58.699666 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-05ccd8f8-2419-4ac0-a884-e487d658ea8f tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Request method failure captured: Aug 07 01:13:58.699666 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/images/2a7f0cf4-0b12-4420-b96f-08be56c9fe71 HTTP/1.1 Aug 07 01:13:58.699666 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:13:58.699666 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:13:58.699666 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:13:58.699666 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:13:58.699666 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:13:58.699666 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:13:58.699666 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:13:58.699666 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:13:58.699666 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xFJvA8aViwvAloPsDf2VckLIvT0ef2dFkqEzqRHcsoXzKL-UrjSbgq9qrhn-Kr0K6IWORgsxpa0ZC6p7prEjOQjpXXrO_P6Q36zbcHdiXbdtz0b1lfjcwupDS07IycJWoRXidnJpp03pTzYbxhgdiNsodOZkAAXZnRnVK8CHn-Gq7M Aug 07 01:13:58.699666 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:13:58.699666 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:13:58.699666 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:13:58.699666 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:13:58.699666 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:13:58.699666 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:13:58.699666 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 4e443158f15b42a3a795950a7c409a38 Aug 07 01:13:58.699666 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:13:58.699666 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:13:58.699666 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:13:58.702452 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4e443158f15b42a3a795950a7c409a38", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:13:58.702452 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:13:58.702452 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 4e443158f15b42a3a795950a7c409a38 Aug 07 01:13:58.702452 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:13:58.702452 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ImagesOneServerNegativeTestJSON-439364583-project Aug 07 01:13:58.702452 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:13:58.702452 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:13:58.702452 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: c135ba135fd946149ace9a86c7c52e80 Aug 07 01:13:58.702452 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-439364583-project Aug 07 01:13:58.702452 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:13:58.702452 n-d-master-1 devstack@n-api.service[119516]: exception: Image not found. Aug 07 01:13:58.702452 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '2a7f0cf4-0b12-4420-b96f-08be56c9fe71'} Aug 07 01:13:58.702452 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:13:58.704222 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:58.704222 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 07 01:13:58.704222 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 07 01:13:58.704222 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 07 01:13:58.704222 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 07 01:13:58.704222 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 07 01:13:58.704222 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 07 01:13:58.704222 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 07 01:13:58.704222 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 07 01:13:58.704222 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 07 01:13:58.704222 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 07 01:13:58.704222 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 07 01:13:58.704222 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 07 01:13:58.704222 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 07 01:13:58.704222 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 07 01:13:58.704222 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2a7f0cf4-0b12-4420-b96f-08be56c9fe71 to delete Aug 07 01:13:58.704222 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:13:58.704222 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:13:58.704222 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:13:58.707145 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:58.707145 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 07 01:13:58.707145 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 07 01:13:58.707145 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 07 01:13:58.707145 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 07 01:13:58.707145 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 07 01:13:58.707145 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 07 01:13:58.707145 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2a7f0cf4-0b12-4420-b96f-08be56c9fe71 could not be found. Aug 07 01:13:58.707145 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:13:58.707145 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:13:58.707145 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:13:58.707145 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:58.707145 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:13:58.707145 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:13:58.707145 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:13:58.707145 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:13:58.707145 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:13:58.707145 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:13:58.707145 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:13:58.707145 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:13:58.716250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 07 01:13:58.716250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 07 01:13:58.716250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 07 01:13:58.716250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:13:58.716250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:13:58.716250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:13:58.716250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:58.716250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:13:58.716250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:13:58.716250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:13:58.716250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:13:58.716250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 07 01:13:58.716250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:13:58.716250 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-05ccd8f8-2419-4ac0-a884-e487d658ea8f tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Returning 404 to user: Image not found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:13:58.716250 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-05ccd8f8-2419-4ac0-a884-e487d658ea8f tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "DELETE /compute/v2.1/images/2a7f0cf4-0b12-4420-b96f-08be56c9fe71" status: 404 len: 62 microversion: 2.1 time: 0.125389 Aug 07 01:13:58.718830 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 552/972] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:58 2022] DELETE /compute/v2.1/images/2a7f0cf4-0b12-4420-b96f-08be56c9fe71 => generated 62 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:13:58.718830 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b63db8b9-b1ba-4565-a3ee-7d72ae51526a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:58.719943 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4009fddc-e896-4cc3-94b4-5750c71736f9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1476 microversion: 2.1 time: 0.451812 Aug 07 01:13:58.720589 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 421/973] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:58 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1476 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:13:58.721824 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b63db8b9-b1ba-4565-a3ee-7d72ae51526a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 8a19ce68-d784-44a2-b20c-77de1180aba3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:58.729873 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b63db8b9-b1ba-4565-a3ee-7d72ae51526a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:58.730529 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b63db8b9-b1ba-4565-a3ee-7d72ae51526a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:58.731595 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b63db8b9-b1ba-4565-a3ee-7d72ae51526a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:58.732431 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b63db8b9-b1ba-4565-a3ee-7d72ae51526a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:58.732901 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b63db8b9-b1ba-4565-a3ee-7d72ae51526a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:58.733481 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b63db8b9-b1ba-4565-a3ee-7d72ae51526a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:58.751608 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-b63db8b9-b1ba-4565-a3ee-7d72ae51526a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] HTTP exception thrown: Instance 8a19ce68-d784-44a2-b20c-77de1180aba3 could not be found. Aug 07 01:13:58.754003 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b63db8b9-b1ba-4565-a3ee-7d72ae51526a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Request method failure captured: Aug 07 01:13:58.754003 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3 HTTP/1.1 Aug 07 01:13:58.754003 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:13:58.754003 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:13:58.754003 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:13:58.754003 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:13:58.754003 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:13:58.754003 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:13:58.754003 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:13:58.754003 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:13:58.754003 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xFJvA8aViwvAloPsDf2VckLIvT0ef2dFkqEzqRHcsoXzKL-UrjSbgq9qrhn-Kr0K6IWORgsxpa0ZC6p7prEjOQjpXXrO_P6Q36zbcHdiXbdtz0b1lfjcwupDS07IycJWoRXidnJpp03pTzYbxhgdiNsodOZkAAXZnRnVK8CHn-Gq7M Aug 07 01:13:58.754003 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:13:58.754003 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:13:58.754003 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:13:58.754003 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:13:58.754003 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:13:58.754003 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:13:58.754003 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 4e443158f15b42a3a795950a7c409a38 Aug 07 01:13:58.754003 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:13:58.754003 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:13:58.754003 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:13:58.756837 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4e443158f15b42a3a795950a7c409a38", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:13:58.756837 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:13:58.756837 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 4e443158f15b42a3a795950a7c409a38 Aug 07 01:13:58.756837 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:13:58.756837 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ImagesOneServerNegativeTestJSON-439364583-project Aug 07 01:13:58.756837 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:13:58.756837 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:13:58.756837 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: c135ba135fd946149ace9a86c7c52e80 Aug 07 01:13:58.756837 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-439364583-project Aug 07 01:13:58.756837 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:13:58.756837 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 8a19ce68-d784-44a2-b20c-77de1180aba3 could not be found. Aug 07 01:13:58.756837 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '8a19ce68-d784-44a2-b20c-77de1180aba3'} Aug 07 01:13:58.758417 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:13:58.758417 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:58.758417 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:13:58.758417 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:13:58.758417 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:13:58.758417 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:13:58.758417 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:13:58.758417 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:13:58.758417 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:13:58.758417 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:13:58.758417 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a19ce68-d784-44a2-b20c-77de1180aba3 could not be found. Aug 07 01:13:58.758417 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:13:58.758417 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:13:58.758417 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:13:58.758417 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:58.758417 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:13:58.758417 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:13:58.758417 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:13:58.758417 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:13:58.758417 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:13:58.761391 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:13:58.761391 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:13:58.761391 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:13:58.761391 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:13:58.761391 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:13:58.761391 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:13:58.761391 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:13:58.761391 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:13:58.761391 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:13:58.761391 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a19ce68-d784-44a2-b20c-77de1180aba3 could not be found. Aug 07 01:13:58.761391 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:13:58.761391 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:13:58.761391 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:13:58.761391 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:58.761391 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:13:58.761391 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:13:58.761391 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:13:58.761391 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:13:58.761391 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a19ce68-d784-44a2-b20c-77de1180aba3 could not be found. Aug 07 01:13:58.761391 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:13:58.764444 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b63db8b9-b1ba-4565-a3ee-7d72ae51526a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Returning 404 to user: Instance 8a19ce68-d784-44a2-b20c-77de1180aba3 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:13:58.764444 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b63db8b9-b1ba-4565-a3ee-7d72ae51526a tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3" status: 404 len: 111 microversion: 2.1 time: 0.046025 Aug 07 01:13:58.767546 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d764d56a-9ad7-4f9b-a611-bec9f445cee5 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:58.768291 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d764d56a-9ad7-4f9b-a611-bec9f445cee5 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 8a19ce68-d784-44a2-b20c-77de1180aba3] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:58.772467 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 553/974] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:13:58 2022] DELETE /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:13:58.776534 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d764d56a-9ad7-4f9b-a611-bec9f445cee5 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:58.777039 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d764d56a-9ad7-4f9b-a611-bec9f445cee5 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:58.777650 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d764d56a-9ad7-4f9b-a611-bec9f445cee5 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:58.779061 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d764d56a-9ad7-4f9b-a611-bec9f445cee5 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:58.779495 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d764d56a-9ad7-4f9b-a611-bec9f445cee5 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:58.780361 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d764d56a-9ad7-4f9b-a611-bec9f445cee5 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:58.799518 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-d764d56a-9ad7-4f9b-a611-bec9f445cee5 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] HTTP exception thrown: Instance 8a19ce68-d784-44a2-b20c-77de1180aba3 could not be found. Aug 07 01:13:58.802228 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d764d56a-9ad7-4f9b-a611-bec9f445cee5 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Request method failure captured: Aug 07 01:13:58.802228 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3 HTTP/1.1 Aug 07 01:13:58.802228 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:13:58.802228 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:13:58.802228 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:13:58.802228 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:13:58.802228 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:13:58.802228 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:13:58.802228 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:13:58.802228 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:13:58.802228 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xFJvA8aViwvAloPsDf2VckLIvT0ef2dFkqEzqRHcsoXzKL-UrjSbgq9qrhn-Kr0K6IWORgsxpa0ZC6p7prEjOQjpXXrO_P6Q36zbcHdiXbdtz0b1lfjcwupDS07IycJWoRXidnJpp03pTzYbxhgdiNsodOZkAAXZnRnVK8CHn-Gq7M Aug 07 01:13:58.802228 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:13:58.802228 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:13:58.802228 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:13:58.802228 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:13:58.802228 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:13:58.802228 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:13:58.802228 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 4e443158f15b42a3a795950a7c409a38 Aug 07 01:13:58.802228 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:13:58.802228 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:13:58.802228 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:13:58.803790 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4e443158f15b42a3a795950a7c409a38", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:13:58.803790 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:13:58.803790 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 4e443158f15b42a3a795950a7c409a38 Aug 07 01:13:58.803790 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:13:58.803790 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ImagesOneServerNegativeTestJSON-439364583-project Aug 07 01:13:58.803790 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:13:58.803790 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:13:58.803790 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: c135ba135fd946149ace9a86c7c52e80 Aug 07 01:13:58.803790 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-439364583-project Aug 07 01:13:58.803790 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:13:58.803790 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 8a19ce68-d784-44a2-b20c-77de1180aba3 could not be found. Aug 07 01:13:58.803790 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '8a19ce68-d784-44a2-b20c-77de1180aba3'} Aug 07 01:13:58.804698 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:13:58.804698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:58.804698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:13:58.804698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:13:58.804698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:13:58.804698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:13:58.804698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:13:58.804698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:13:58.804698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:13:58.804698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:13:58.804698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a19ce68-d784-44a2-b20c-77de1180aba3 could not be found. Aug 07 01:13:58.804698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:58.804698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:13:58.804698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:58.804698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:58.804698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:13:58.804698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:13:58.804698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:13:58.804698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:13:58.804698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:13:58.805917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:13:58.805917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:13:58.805917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:13:58.805917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:13:58.805917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:13:58.805917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:13:58.805917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:13:58.805917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a19ce68-d784-44a2-b20c-77de1180aba3 could not be found. Aug 07 01:13:58.805917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:58.805917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:13:58.805917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:58.805917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:13:58.805917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:13:58.805917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:13:58.805917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:13:58.805917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:13:58.805917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a19ce68-d784-44a2-b20c-77de1180aba3 could not be found. Aug 07 01:13:58.805917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:13:58.808453 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d764d56a-9ad7-4f9b-a611-bec9f445cee5 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Returning 404 to user: Instance 8a19ce68-d784-44a2-b20c-77de1180aba3 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:13:58.809635 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d764d56a-9ad7-4f9b-a611-bec9f445cee5 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3" status: 404 len: 111 microversion: 2.1 time: 0.047968 Aug 07 01:13:58.819509 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-db6d74d5-5076-4a07-a40c-69d2d3d81af1 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '.version_select at 0x7f9e24723160>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:58.825385 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 422/975] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:58 2022] GET /compute/v2.1/servers/8a19ce68-d784-44a2-b20c-77de1180aba3 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:13:58.850304 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-db6d74d5-5076-4a07-a40c-69d2d3d81af1 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2080171021" status: 202 len: 0 microversion: 2.1 time: 0.034532 Aug 07 01:13:58.851301 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 554/976] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Aug 7 01:13:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2080171021 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:13:59.129864 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3343d14e-0c78-4f0f-bbf7-122d5cf5f7e7 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:59.131146 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3343d14e-0c78-4f0f-bbf7-122d5cf5f7e7 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 1e845e5c-f730-47a0-a5a9-8e0666de0d10] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:59.155645 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3343d14e-0c78-4f0f-bbf7-122d5cf5f7e7 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:59.156857 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3343d14e-0c78-4f0f-bbf7-122d5cf5f7e7 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:59.157318 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3343d14e-0c78-4f0f-bbf7-122d5cf5f7e7 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:59.162520 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3343d14e-0c78-4f0f-bbf7-122d5cf5f7e7 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:59.162814 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3343d14e-0c78-4f0f-bbf7-122d5cf5f7e7 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:59.164345 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3343d14e-0c78-4f0f-bbf7-122d5cf5f7e7 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:59.293691 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bec18607-ea25-4ff6-8cdc-550f7170719a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:59.294851 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bec18607-ea25-4ff6-8cdc-550f7170719a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 9a4ced25-d85e-4469-95b6-5e666731a714] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:59.313170 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bec18607-ea25-4ff6-8cdc-550f7170719a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:59.313694 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bec18607-ea25-4ff6-8cdc-550f7170719a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:59.316194 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bec18607-ea25-4ff6-8cdc-550f7170719a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:59.317581 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bec18607-ea25-4ff6-8cdc-550f7170719a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:59.321545 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bec18607-ea25-4ff6-8cdc-550f7170719a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:59.322630 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bec18607-ea25-4ff6-8cdc-550f7170719a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:59.338814 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3343d14e-0c78-4f0f-bbf7-122d5cf5f7e7 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:13:59.400041 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3343d14e-0c78-4f0f-bbf7-122d5cf5f7e7 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10" status: 200 len: 1218 microversion: 2.1 time: 0.262527 Aug 07 01:13:59.401604 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 423/977] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:59 2022] GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10 => generated 1218 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:13:59.759822 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ff84bda2-064b-4aa6-b303-695e88a014de tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:13:59.767337 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ff84bda2-064b-4aa6-b303-695e88a014de tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:13:59.790669 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ff84bda2-064b-4aa6-b303-695e88a014de tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:59.793281 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ff84bda2-064b-4aa6-b303-695e88a014de tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:59.797770 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ff84bda2-064b-4aa6-b303-695e88a014de tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:13:59.801486 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ff84bda2-064b-4aa6-b303-695e88a014de tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:13:59.803095 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ff84bda2-064b-4aa6-b303-695e88a014de tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:13:59.811961 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ff84bda2-064b-4aa6-b303-695e88a014de tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:00.546920 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bec18607-ea25-4ff6-8cdc-550f7170719a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:00.551779 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ff84bda2-064b-4aa6-b303-695e88a014de tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:00.566546 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ff84bda2-064b-4aa6-b303-695e88a014de tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1476 microversion: 2.1 time: 0.813956 Aug 07 01:14:00.577204 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 424/978] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:59 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1476 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:00.582353 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bec18607-ea25-4ff6-8cdc-550f7170719a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714" status: 200 len: 1319 microversion: 2.1 time: 1.285705 Aug 07 01:14:00.582353 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 555/979] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:13:59 2022] GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714 => generated 1319 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:00.597301 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-84a49744-977e-4a9c-a05b-e65451396a6c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:00.608837 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-84a49744-977e-4a9c-a05b-e65451396a6c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 1e845e5c-f730-47a0-a5a9-8e0666de0d10] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:00.619215 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-84a49744-977e-4a9c-a05b-e65451396a6c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:00.619772 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-84a49744-977e-4a9c-a05b-e65451396a6c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:00.620687 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-84a49744-977e-4a9c-a05b-e65451396a6c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:00.622401 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-84a49744-977e-4a9c-a05b-e65451396a6c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:00.623184 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-84a49744-977e-4a9c-a05b-e65451396a6c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:00.624421 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-84a49744-977e-4a9c-a05b-e65451396a6c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:00.746807 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-84a49744-977e-4a9c-a05b-e65451396a6c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:00.768932 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-84a49744-977e-4a9c-a05b-e65451396a6c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10" status: 200 len: 1272 microversion: 2.1 time: 0.199740 Aug 07 01:14:00.771697 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 425/980] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:00 2022] GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10 => generated 1272 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:01.456616 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2956a20a-cf2f-495b-83ba-cb500e553093 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '.version_select at 0x7f9e24711550>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:01.534895 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-2956a20a-cf2f-495b-83ba-cb500e553093 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] HTTP exception thrown: Image not found. Aug 07 01:14:01.538852 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2956a20a-cf2f-495b-83ba-cb500e553093 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Request method failure captured: Aug 07 01:14:01.538852 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/images/58f27597-89c2-4bf5-961f-7df1ae655cf8 HTTP/1.1 Aug 07 01:14:01.538852 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:14:01.538852 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:14:01.538852 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:14:01.538852 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:14:01.538852 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:14:01.538852 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:14:01.538852 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:14:01.538852 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:14:01.538852 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xFJvA8aViwvAloPsDf2VckLIvT0ef2dFkqEzqRHcsoXzKL-UrjSbgq9qrhn-Kr0K6IWORgsxpa0ZC6p7prEjOQjpXXrO_P6Q36zbcHdiXbdtz0b1lfjcwupDS07IycJWoRXidnJpp03pTzYbxhgdiNsodOZkAAXZnRnVK8CHn-Gq7M Aug 07 01:14:01.538852 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:14:01.538852 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:14:01.538852 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:14:01.538852 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:14:01.538852 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:14:01.538852 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:14:01.538852 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 4e443158f15b42a3a795950a7c409a38 Aug 07 01:14:01.538852 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:14:01.538852 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:14:01.538852 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:14:01.541447 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4e443158f15b42a3a795950a7c409a38", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:14:01.541447 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:14:01.541447 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 4e443158f15b42a3a795950a7c409a38 Aug 07 01:14:01.541447 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:14:01.541447 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ImagesOneServerNegativeTestJSON-439364583-project Aug 07 01:14:01.541447 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:14:01.541447 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:14:01.541447 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: c135ba135fd946149ace9a86c7c52e80 Aug 07 01:14:01.541447 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-439364583-project Aug 07 01:14:01.541447 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:14:01.541447 n-d-master-1 devstack@n-api.service[119516]: exception: Image not found. Aug 07 01:14:01.541447 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '58f27597-89c2-4bf5-961f-7df1ae655cf8'} Aug 07 01:14:01.541447 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:14:01.543668 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:01.543668 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 07 01:14:01.543668 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 07 01:14:01.543668 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 07 01:14:01.543668 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 07 01:14:01.543668 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 07 01:14:01.543668 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 07 01:14:01.543668 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 07 01:14:01.543668 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 07 01:14:01.543668 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 07 01:14:01.543668 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 07 01:14:01.543668 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 07 01:14:01.543668 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 07 01:14:01.543668 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 07 01:14:01.543668 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 07 01:14:01.543668 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 58f27597-89c2-4bf5-961f-7df1ae655cf8 to delete Aug 07 01:14:01.543668 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:01.543668 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:01.543668 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:01.549380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:01.549380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 07 01:14:01.549380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 07 01:14:01.549380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 07 01:14:01.549380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 07 01:14:01.549380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 07 01:14:01.549380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 07 01:14:01.549380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 58f27597-89c2-4bf5-961f-7df1ae655cf8 could not be found. Aug 07 01:14:01.549380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:01.549380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:01.549380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:01.549380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:01.549380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:01.549380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:01.549380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:14:01.549380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:14:01.549380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:14:01.549380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:14:01.549380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:14:01.549380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:14:01.555768 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 07 01:14:01.555768 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 07 01:14:01.555768 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 07 01:14:01.555768 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:01.555768 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:01.555768 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:01.555768 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:01.555768 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:01.555768 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:01.555768 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:14:01.555768 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:14:01.555768 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 07 01:14:01.555768 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:01.555768 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2956a20a-cf2f-495b-83ba-cb500e553093 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Returning 404 to user: Image not found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:14:01.562609 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2956a20a-cf2f-495b-83ba-cb500e553093 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "DELETE /compute/v2.1/images/58f27597-89c2-4bf5-961f-7df1ae655cf8" status: 404 len: 62 microversion: 2.1 time: 0.100359 Aug 07 01:14:01.570463 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 556/981] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:01 2022] DELETE /compute/v2.1/images/58f27597-89c2-4bf5-961f-7df1ae655cf8 => generated 62 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:14:01.586865 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f13a4b3d-488e-42b4-99cb-a8869f1ca545 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:01.602346 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f13a4b3d-488e-42b4-99cb-a8869f1ca545 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 2125f4ff-9031-486f-8b5f-85082bf81588] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:01.628681 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-23e86333-a5f7-442b-8f00-9d1123845ff5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:01.632543 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-23e86333-a5f7-442b-8f00-9d1123845ff5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:01.642951 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f13a4b3d-488e-42b4-99cb-a8869f1ca545 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:01.644607 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f13a4b3d-488e-42b4-99cb-a8869f1ca545 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:01.647345 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f13a4b3d-488e-42b4-99cb-a8869f1ca545 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:01.651387 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f13a4b3d-488e-42b4-99cb-a8869f1ca545 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:01.653269 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f13a4b3d-488e-42b4-99cb-a8869f1ca545 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:01.654505 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f13a4b3d-488e-42b4-99cb-a8869f1ca545 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:01.656450 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-23e86333-a5f7-442b-8f00-9d1123845ff5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:01.662654 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-23e86333-a5f7-442b-8f00-9d1123845ff5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:01.665937 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-23e86333-a5f7-442b-8f00-9d1123845ff5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:01.666972 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-23e86333-a5f7-442b-8f00-9d1123845ff5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:01.670979 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-23e86333-a5f7-442b-8f00-9d1123845ff5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:01.675994 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-23e86333-a5f7-442b-8f00-9d1123845ff5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:01.706259 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-f13a4b3d-488e-42b4-99cb-a8869f1ca545 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] HTTP exception thrown: Instance 2125f4ff-9031-486f-8b5f-85082bf81588 could not be found. Aug 07 01:14:01.710741 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f13a4b3d-488e-42b4-99cb-a8869f1ca545 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Request method failure captured: Aug 07 01:14:01.710741 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588 HTTP/1.1 Aug 07 01:14:01.710741 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:14:01.710741 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:14:01.710741 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:14:01.710741 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:14:01.710741 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:14:01.710741 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:14:01.710741 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:14:01.710741 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:14:01.710741 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xFJvA8aViwvAloPsDf2VckLIvT0ef2dFkqEzqRHcsoXzKL-UrjSbgq9qrhn-Kr0K6IWORgsxpa0ZC6p7prEjOQjpXXrO_P6Q36zbcHdiXbdtz0b1lfjcwupDS07IycJWoRXidnJpp03pTzYbxhgdiNsodOZkAAXZnRnVK8CHn-Gq7M Aug 07 01:14:01.710741 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:14:01.710741 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:14:01.710741 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:14:01.710741 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:14:01.710741 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:14:01.710741 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:14:01.710741 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 4e443158f15b42a3a795950a7c409a38 Aug 07 01:14:01.710741 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:14:01.710741 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:14:01.710741 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:14:01.713287 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4e443158f15b42a3a795950a7c409a38", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:14:01.713287 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:14:01.713287 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 4e443158f15b42a3a795950a7c409a38 Aug 07 01:14:01.713287 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:14:01.713287 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ImagesOneServerNegativeTestJSON-439364583-project Aug 07 01:14:01.713287 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:14:01.713287 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:14:01.713287 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: c135ba135fd946149ace9a86c7c52e80 Aug 07 01:14:01.713287 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-439364583-project Aug 07 01:14:01.713287 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:14:01.713287 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 2125f4ff-9031-486f-8b5f-85082bf81588 could not be found. Aug 07 01:14:01.713287 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '2125f4ff-9031-486f-8b5f-85082bf81588'} Aug 07 01:14:01.715291 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:14:01.715291 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:01.715291 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:14:01.715291 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:14:01.715291 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:14:01.715291 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:14:01.715291 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:14:01.715291 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:14:01.715291 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:14:01.715291 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:14:01.715291 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2125f4ff-9031-486f-8b5f-85082bf81588 could not be found. Aug 07 01:14:01.715291 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:01.715291 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:01.715291 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:01.715291 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:01.715291 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:01.715291 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:01.715291 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:14:01.715291 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:14:01.715291 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:14:01.720794 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:14:01.720794 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:14:01.720794 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:14:01.720794 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:14:01.720794 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:14:01.720794 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:14:01.720794 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:14:01.720794 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:14:01.720794 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:14:01.720794 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2125f4ff-9031-486f-8b5f-85082bf81588 could not be found. Aug 07 01:14:01.720794 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:01.720794 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:01.720794 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:01.720794 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:01.720794 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:01.720794 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:01.720794 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:14:01.720794 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:14:01.720794 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2125f4ff-9031-486f-8b5f-85082bf81588 could not be found. Aug 07 01:14:01.720794 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:01.727556 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f13a4b3d-488e-42b4-99cb-a8869f1ca545 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Returning 404 to user: Instance 2125f4ff-9031-486f-8b5f-85082bf81588 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:14:01.733563 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f13a4b3d-488e-42b4-99cb-a8869f1ca545 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588" status: 404 len: 111 microversion: 2.1 time: 0.155928 Aug 07 01:14:01.737432 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 426/982] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:14:01 2022] DELETE /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:14:01.741260 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-68cdcf1c-5c84-45da-b44d-8706ed816bcf tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:01.742316 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-68cdcf1c-5c84-45da-b44d-8706ed816bcf tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 9a4ced25-d85e-4469-95b6-5e666731a714] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:01.765185 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68cdcf1c-5c84-45da-b44d-8706ed816bcf tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:01.766118 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68cdcf1c-5c84-45da-b44d-8706ed816bcf tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:01.766890 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68cdcf1c-5c84-45da-b44d-8706ed816bcf tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:01.767952 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68cdcf1c-5c84-45da-b44d-8706ed816bcf tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:01.769841 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68cdcf1c-5c84-45da-b44d-8706ed816bcf tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:01.770543 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68cdcf1c-5c84-45da-b44d-8706ed816bcf tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:02.114259 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-23e86333-a5f7-442b-8f00-9d1123845ff5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:02.125201 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-23e86333-a5f7-442b-8f00-9d1123845ff5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1476 microversion: 2.1 time: 0.535000 Aug 07 01:14:02.128254 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 557/983] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:01 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1476 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:02.142639 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1c2a8ef2-a1f0-4c4d-9fe0-d3eb54a304b9 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:02.143839 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1c2a8ef2-a1f0-4c4d-9fe0-d3eb54a304b9 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] [instance: 2125f4ff-9031-486f-8b5f-85082bf81588] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:02.159727 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c2a8ef2-a1f0-4c4d-9fe0-d3eb54a304b9 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:02.161364 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c2a8ef2-a1f0-4c4d-9fe0-d3eb54a304b9 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:02.164539 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-68cdcf1c-5c84-45da-b44d-8706ed816bcf tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:02.165235 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c2a8ef2-a1f0-4c4d-9fe0-d3eb54a304b9 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:02.166995 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c2a8ef2-a1f0-4c4d-9fe0-d3eb54a304b9 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:02.169354 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c2a8ef2-a1f0-4c4d-9fe0-d3eb54a304b9 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:02.171513 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c2a8ef2-a1f0-4c4d-9fe0-d3eb54a304b9 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:02.180138 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-68cdcf1c-5c84-45da-b44d-8706ed816bcf tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714" status: 200 len: 1319 microversion: 2.1 time: 0.442902 Aug 07 01:14:02.182238 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:02.183180 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 427/984] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:01 2022] GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714 => generated 1319 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:02.203555 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-aec0882b-9614-489a-9e93-24803b0c4694 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:02.205212 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-aec0882b-9614-489a-9e93-24803b0c4694 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 1e845e5c-f730-47a0-a5a9-8e0666de0d10] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:02.221043 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-1c2a8ef2-a1f0-4c4d-9fe0-d3eb54a304b9 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] HTTP exception thrown: Instance 2125f4ff-9031-486f-8b5f-85082bf81588 could not be found. Aug 07 01:14:02.222802 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aec0882b-9614-489a-9e93-24803b0c4694 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:02.223757 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aec0882b-9614-489a-9e93-24803b0c4694 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:02.225019 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aec0882b-9614-489a-9e93-24803b0c4694 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:02.226190 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aec0882b-9614-489a-9e93-24803b0c4694 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:02.226670 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1c2a8ef2-a1f0-4c4d-9fe0-d3eb54a304b9 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Request method failure captured: Aug 07 01:14:02.226670 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588 HTTP/1.1 Aug 07 01:14:02.226670 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:14:02.226670 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:14:02.226670 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:14:02.226670 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:14:02.226670 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:14:02.226670 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:14:02.226670 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:14:02.226670 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:14:02.226670 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xFJvA8aViwvAloPsDf2VckLIvT0ef2dFkqEzqRHcsoXzKL-UrjSbgq9qrhn-Kr0K6IWORgsxpa0ZC6p7prEjOQjpXXrO_P6Q36zbcHdiXbdtz0b1lfjcwupDS07IycJWoRXidnJpp03pTzYbxhgdiNsodOZkAAXZnRnVK8CHn-Gq7M Aug 07 01:14:02.226670 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:14:02.226670 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:14:02.226670 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:14:02.226670 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:14:02.226670 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:14:02.226670 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:14:02.226670 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 4e443158f15b42a3a795950a7c409a38 Aug 07 01:14:02.226670 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:14:02.226670 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:14:02.226670 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:14:02.229071 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4e443158f15b42a3a795950a7c409a38", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4e443158f15b42a3a795950a7c409a38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:14:02.229071 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:14:02.229071 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 4e443158f15b42a3a795950a7c409a38 Aug 07 01:14:02.229071 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-439364583 Aug 07 01:14:02.229071 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ImagesOneServerNegativeTestJSON-439364583-project Aug 07 01:14:02.229071 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:14:02.229071 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:14:02.229071 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: c135ba135fd946149ace9a86c7c52e80 Aug 07 01:14:02.229071 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-439364583-project Aug 07 01:14:02.229071 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:14:02.229071 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 2125f4ff-9031-486f-8b5f-85082bf81588 could not be found. Aug 07 01:14:02.229071 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '2125f4ff-9031-486f-8b5f-85082bf81588'} Aug 07 01:14:02.229822 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:14:02.229822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:02.229822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:14:02.229822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:14:02.229822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:14:02.229822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:14:02.229822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:14:02.229822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:14:02.229822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:14:02.229822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:14:02.229822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2125f4ff-9031-486f-8b5f-85082bf81588 could not be found. Aug 07 01:14:02.229822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:02.229822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:02.229822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:02.229822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:02.229822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:02.229822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:02.229822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:14:02.229822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:14:02.229822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:14:02.231285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:14:02.231285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:14:02.231285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:14:02.231285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:14:02.231285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:14:02.231285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:14:02.231285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:14:02.231285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2125f4ff-9031-486f-8b5f-85082bf81588 could not be found. Aug 07 01:14:02.231285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:02.231285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:02.231285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:02.231285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:02.231285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:02.231285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:02.231285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:14:02.231285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:14:02.231285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2125f4ff-9031-486f-8b5f-85082bf81588 could not be found. Aug 07 01:14:02.231285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:02.232921 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aec0882b-9614-489a-9e93-24803b0c4694 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:02.232921 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aec0882b-9614-489a-9e93-24803b0c4694 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:02.238295 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1c2a8ef2-a1f0-4c4d-9fe0-d3eb54a304b9 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] Returning 404 to user: Instance 2125f4ff-9031-486f-8b5f-85082bf81588 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:14:02.239619 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1c2a8ef2-a1f0-4c4d-9fe0-d3eb54a304b9 tempest-ImagesOneServerNegativeTestJSON-439364583 tempest-ImagesOneServerNegativeTestJSON-439364583-project] 10.222.0.39 "GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588" status: 404 len: 111 microversion: 2.1 time: 0.109730 Aug 07 01:14:02.245076 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 558/985] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:02 2022] GET /compute/v2.1/servers/2125f4ff-9031-486f-8b5f-85082bf81588 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:14:03.157800 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-df59f0f8-52f3-4bac-926f-22828c6cae9b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:03.159618 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-df59f0f8-52f3-4bac-926f-22828c6cae9b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:03.175202 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df59f0f8-52f3-4bac-926f-22828c6cae9b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:03.176533 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df59f0f8-52f3-4bac-926f-22828c6cae9b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:03.185551 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df59f0f8-52f3-4bac-926f-22828c6cae9b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:03.188530 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df59f0f8-52f3-4bac-926f-22828c6cae9b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:03.189065 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df59f0f8-52f3-4bac-926f-22828c6cae9b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:03.189546 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df59f0f8-52f3-4bac-926f-22828c6cae9b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:03.204871 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-aec0882b-9614-489a-9e93-24803b0c4694 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:03.220352 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-aec0882b-9614-489a-9e93-24803b0c4694 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10" status: 200 len: 1314 microversion: 2.1 time: 1.026129 Aug 07 01:14:03.221535 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 428/986] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:02 2022] GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10 => generated 1314 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:03.239700 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-aa427713-84f9-47f5-be93-9009b771da60 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:03.240286 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-aa427713-84f9-47f5-be93-9009b771da60 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:03.268109 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa427713-84f9-47f5-be93-9009b771da60 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:03.268600 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa427713-84f9-47f5-be93-9009b771da60 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:03.269031 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa427713-84f9-47f5-be93-9009b771da60 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:03.269998 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa427713-84f9-47f5-be93-9009b771da60 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:03.270446 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa427713-84f9-47f5-be93-9009b771da60 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:03.270866 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa427713-84f9-47f5-be93-9009b771da60 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:03.320727 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-aa427713-84f9-47f5-be93-9009b771da60 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:14:03.544221 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-aa427713-84f9-47f5-be93-9009b771da60 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "DELETE /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6" status: 204 len: 0 microversion: 2.1 time: 0.320010 Aug 07 01:14:03.546395 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 429/987] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:14:03 2022] DELETE /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:14:03.561184 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7ed19ed4-4d00-47b6-b09e-dfed8c5ffdda tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:03.564522 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7ed19ed4-4d00-47b6-b09e-dfed8c5ffdda tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 9a4ced25-d85e-4469-95b6-5e666731a714] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:03.587769 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ed19ed4-4d00-47b6-b09e-dfed8c5ffdda tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:03.590165 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ed19ed4-4d00-47b6-b09e-dfed8c5ffdda tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:03.590803 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ed19ed4-4d00-47b6-b09e-dfed8c5ffdda tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:03.592179 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-df59f0f8-52f3-4bac-926f-22828c6cae9b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:03.593940 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ed19ed4-4d00-47b6-b09e-dfed8c5ffdda tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:03.594425 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ed19ed4-4d00-47b6-b09e-dfed8c5ffdda tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:03.594860 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ed19ed4-4d00-47b6-b09e-dfed8c5ffdda tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:03.606105 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-df59f0f8-52f3-4bac-926f-22828c6cae9b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1476 microversion: 2.1 time: 0.451489 Aug 07 01:14:03.607331 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 559/988] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:03 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1476 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:14:03.618871 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-58d48f46-1c3f-4fe4-a604-a461e07465d3 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:03.620175 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-58d48f46-1c3f-4fe4-a604-a461e07465d3 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:03.632852 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-58d48f46-1c3f-4fe4-a604-a461e07465d3 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:03.636121 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-58d48f46-1c3f-4fe4-a604-a461e07465d3 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:03.637439 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-58d48f46-1c3f-4fe4-a604-a461e07465d3 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:03.638327 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-58d48f46-1c3f-4fe4-a604-a461e07465d3 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:03.640292 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-58d48f46-1c3f-4fe4-a604-a461e07465d3 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:03.640920 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-58d48f46-1c3f-4fe4-a604-a461e07465d3 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:04.123109 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7ed19ed4-4d00-47b6-b09e-dfed8c5ffdda tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:04.137061 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7ed19ed4-4d00-47b6-b09e-dfed8c5ffdda tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714" status: 200 len: 1319 microversion: 2.1 time: 0.588878 Aug 07 01:14:04.155914 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 430/989] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:03 2022] GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714 => generated 1319 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:04.155914 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-3313ca57-19e6-427e-9390-8bbc76f97c6e req-cde51def-0f52-469d-8521-fce64b8ade41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb8bf657-63c6-4cea-8571-e9449c5ee529", "name": "network-vif-plugged", "status": "completed", "tag": "1681a453-c8a8-46bc-aef4-5ce8cc192252"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:04.187471 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3313ca57-19e6-427e-9390-8bbc76f97c6e req-cde51def-0f52-469d-8521-fce64b8ade41 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:04.190969 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3313ca57-19e6-427e-9390-8bbc76f97c6e req-cde51def-0f52-469d-8521-fce64b8ade41 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:04.193591 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3313ca57-19e6-427e-9390-8bbc76f97c6e req-cde51def-0f52-469d-8521-fce64b8ade41 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:04.234260 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-3313ca57-19e6-427e-9390-8bbc76f97c6e req-cde51def-0f52-469d-8521-fce64b8ade41 service nova] Creating event network-vif-plugged:1681a453-c8a8-46bc-aef4-5ce8cc192252 for instance fb8bf657-63c6-4cea-8571-e9449c5ee529 on n-h2-master-1 Aug 07 01:14:04.243970 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-3313ca57-19e6-427e-9390-8bbc76f97c6e req-cde51def-0f52-469d-8521-fce64b8ade41 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098444 Aug 07 01:14:04.252878 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 431/990] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:14:04.274646 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-60b73bb7-967f-4e75-b414-e7c4bd69bf23 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:04.275795 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-60b73bb7-967f-4e75-b414-e7c4bd69bf23 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 1e845e5c-f730-47a0-a5a9-8e0666de0d10] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:04.288503 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-60b73bb7-967f-4e75-b414-e7c4bd69bf23 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:04.289413 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-60b73bb7-967f-4e75-b414-e7c4bd69bf23 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:04.290138 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-60b73bb7-967f-4e75-b414-e7c4bd69bf23 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:04.291697 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-60b73bb7-967f-4e75-b414-e7c4bd69bf23 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:04.293190 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-60b73bb7-967f-4e75-b414-e7c4bd69bf23 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:04.294091 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-60b73bb7-967f-4e75-b414-e7c4bd69bf23 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:04.549908 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-58d48f46-1c3f-4fe4-a604-a461e07465d3 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dce42ff994d81b1ad6d6c05356c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6d319a0452448485aa65b7cf1c5b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:04.571740 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-58d48f46-1c3f-4fe4-a604-a461e07465d3 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6" status: 200 len: 1512 microversion: 2.1 time: 0.962991 Aug 07 01:14:04.573335 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 560/991] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:03 2022] GET /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6 => generated 1512 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:04.630334 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8217bb71-9d6d-47c2-8de7-5946d14e4d5e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:04.631095 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8217bb71-9d6d-47c2-8de7-5946d14e4d5e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:04.640006 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8217bb71-9d6d-47c2-8de7-5946d14e4d5e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:04.640614 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8217bb71-9d6d-47c2-8de7-5946d14e4d5e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:04.641211 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8217bb71-9d6d-47c2-8de7-5946d14e4d5e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:04.645651 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8217bb71-9d6d-47c2-8de7-5946d14e4d5e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:04.646234 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8217bb71-9d6d-47c2-8de7-5946d14e4d5e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:04.646867 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8217bb71-9d6d-47c2-8de7-5946d14e4d5e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:04.937188 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8217bb71-9d6d-47c2-8de7-5946d14e4d5e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:04.947481 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8217bb71-9d6d-47c2-8de7-5946d14e4d5e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1476 microversion: 2.1 time: 0.321191 Aug 07 01:14:04.949453 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 561/992] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:04 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1476 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:05.078946 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-60b73bb7-967f-4e75-b414-e7c4bd69bf23 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:05.098094 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-60b73bb7-967f-4e75-b414-e7c4bd69bf23 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10" status: 200 len: 1314 microversion: 2.1 time: 0.842678 Aug 07 01:14:05.108790 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 432/993] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:04 2022] GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10 => generated 1314 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:05.174409 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5d089f65-d06c-4167-82be-17ea2a56ceae tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:05.175267 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5d089f65-d06c-4167-82be-17ea2a56ceae tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 9a4ced25-d85e-4469-95b6-5e666731a714] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:05.186730 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d089f65-d06c-4167-82be-17ea2a56ceae tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:05.187507 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d089f65-d06c-4167-82be-17ea2a56ceae tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:05.188705 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d089f65-d06c-4167-82be-17ea2a56ceae tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:05.191290 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d089f65-d06c-4167-82be-17ea2a56ceae tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:05.192050 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d089f65-d06c-4167-82be-17ea2a56ceae tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:05.192773 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d089f65-d06c-4167-82be-17ea2a56ceae tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:05.295488 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-14377e1d-75a7-464f-b9a8-572af63a397c tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Action: 'create', calling method: .version_select at 0x7f9e24723700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-893069770", "description": "tempest-description-742146401"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:05.624863 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5d089f65-d06c-4167-82be-17ea2a56ceae tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:05.660341 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:05.674404 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5d089f65-d06c-4167-82be-17ea2a56ceae tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714" status: 200 len: 1319 microversion: 2.1 time: 0.508687 Aug 07 01:14:05.675768 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 433/994] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:05 2022] GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714 => generated 1319 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:14:05.682900 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-27e3daf2-bb03-457a-a424-79214516d2c2 req-f58f0a1d-be43-4049-b4e0-49090556c1d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e845e5c-f730-47a0-a5a9-8e0666de0d10", "tag": "3ad18655-1a28-4922-a4bc-cdbb210261c4"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:05.706768 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-27e3daf2-bb03-457a-a424-79214516d2c2 req-f58f0a1d-be43-4049-b4e0-49090556c1d4 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:05.708624 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-27e3daf2-bb03-457a-a424-79214516d2c2 req-f58f0a1d-be43-4049-b4e0-49090556c1d4 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:05.709293 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-27e3daf2-bb03-457a-a424-79214516d2c2 req-f58f0a1d-be43-4049-b4e0-49090556c1d4 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:05.744920 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-27e3daf2-bb03-457a-a424-79214516d2c2 req-f58f0a1d-be43-4049-b4e0-49090556c1d4 service nova] Creating event network-changed:3ad18655-1a28-4922-a4bc-cdbb210261c4 for instance 1e845e5c-f730-47a0-a5a9-8e0666de0d10 on n-h1-master-1 Aug 07 01:14:05.751518 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-14377e1d-75a7-464f-b9a8-572af63a397c tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.758504 Aug 07 01:14:05.752636 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 562/995] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Aug 7 01:14:04 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:14:05.758028 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-27e3daf2-bb03-457a-a424-79214516d2c2 req-f58f0a1d-be43-4049-b4e0-49090556c1d4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079779 Aug 07 01:14:05.759061 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 434/996] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:14:05.773736 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-354b6ad6-8ffc-420f-a5c8-c810ade7a30c tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:05.775175 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-354b6ad6-8ffc-420f-a5c8-c810ade7a30c tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:05.788702 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ca9c6cc6-cbfd-4c1f-8027-bf8239588b3a tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Action: 'create', calling method: .version_select at 0x7f9e24719820>, body: {"security_group_rule": {"parent_group_id": "85f26678-a416-4170-9d03-22e2748bd362", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:05.801912 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-354b6ad6-8ffc-420f-a5c8-c810ade7a30c tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:05.802691 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-354b6ad6-8ffc-420f-a5c8-c810ade7a30c tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:05.803565 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-354b6ad6-8ffc-420f-a5c8-c810ade7a30c tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:05.804634 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-354b6ad6-8ffc-420f-a5c8-c810ade7a30c tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:05.807505 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-354b6ad6-8ffc-420f-a5c8-c810ade7a30c tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:05.808020 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-354b6ad6-8ffc-420f-a5c8-c810ade7a30c tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:06.279092 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ca9c6cc6-cbfd-4c1f-8027-bf8239588b3a tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.504854 Aug 07 01:14:06.280962 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 563/997] 10.222.0.39 () {60 vars in 1195 bytes} [Sun Aug 7 01:14:05 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:14:06.296372 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e026ba5f-d54f-4747-a370-4505f08bb515 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:06.299536 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e026ba5f-d54f-4747-a370-4505f08bb515 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:06.321501 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-354b6ad6-8ffc-420f-a5c8-c810ade7a30c tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dce42ff994d81b1ad6d6c05356c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6d319a0452448485aa65b7cf1c5b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:06.322343 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e026ba5f-d54f-4747-a370-4505f08bb515 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:06.322842 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e026ba5f-d54f-4747-a370-4505f08bb515 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:06.323275 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e026ba5f-d54f-4747-a370-4505f08bb515 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:06.324569 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e026ba5f-d54f-4747-a370-4505f08bb515 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:06.325033 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e026ba5f-d54f-4747-a370-4505f08bb515 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:06.325481 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e026ba5f-d54f-4747-a370-4505f08bb515 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:06.336548 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-354b6ad6-8ffc-420f-a5c8-c810ade7a30c tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6" status: 200 len: 1512 microversion: 2.1 time: 0.574809 Aug 07 01:14:06.338292 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 435/998] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:05 2022] GET /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6 => generated 1512 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:06.398746 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4f9e2ad6-7c06-4b6b-a251-f41733f6fa10 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:06.399435 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4f9e2ad6-7c06-4b6b-a251-f41733f6fa10 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:06.451267 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f9e2ad6-7c06-4b6b-a251-f41733f6fa10 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:06.451764 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f9e2ad6-7c06-4b6b-a251-f41733f6fa10 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:06.452397 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f9e2ad6-7c06-4b6b-a251-f41733f6fa10 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:06.456465 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f9e2ad6-7c06-4b6b-a251-f41733f6fa10 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:06.457253 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f9e2ad6-7c06-4b6b-a251-f41733f6fa10 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:06.470469 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f9e2ad6-7c06-4b6b-a251-f41733f6fa10 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:06.524048 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e026ba5f-d54f-4747-a370-4505f08bb515 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:14:06.766765 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e026ba5f-d54f-4747-a370-4505f08bb515 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "DELETE /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31" status: 204 len: 0 microversion: 2.1 time: 0.484188 Aug 07 01:14:06.767814 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 564/999] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:14:06 2022] DELETE /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:14:06.783864 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9cbd6014-444b-4988-959f-3e00f40dfe3b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:06.788636 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9cbd6014-444b-4988-959f-3e00f40dfe3b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 1e845e5c-f730-47a0-a5a9-8e0666de0d10] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:06.803187 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9cbd6014-444b-4988-959f-3e00f40dfe3b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:06.803704 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9cbd6014-444b-4988-959f-3e00f40dfe3b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:06.804645 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9cbd6014-444b-4988-959f-3e00f40dfe3b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:06.806365 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9cbd6014-444b-4988-959f-3e00f40dfe3b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:06.806953 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9cbd6014-444b-4988-959f-3e00f40dfe3b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:06.807496 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9cbd6014-444b-4988-959f-3e00f40dfe3b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:07.065971 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9cbd6014-444b-4988-959f-3e00f40dfe3b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:07.076429 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9cbd6014-444b-4988-959f-3e00f40dfe3b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10" status: 200 len: 1314 microversion: 2.1 time: 0.306870 Aug 07 01:14:07.077197 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 565/1000] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:06 2022] GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:07.083251 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-e77242c3-f2b7-439b-be7c-377e4cbb0135 req-4b1d74af-88f1-4291-a449-cef993ab2533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a4ced25-d85e-4469-95b6-5e666731a714", "name": "network-vif-plugged", "status": "completed", "tag": "0e4b319a-2574-4b38-a31e-4942cb5bda7f"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:07.095658 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e77242c3-f2b7-439b-be7c-377e4cbb0135 req-4b1d74af-88f1-4291-a449-cef993ab2533 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:07.096681 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e77242c3-f2b7-439b-be7c-377e4cbb0135 req-4b1d74af-88f1-4291-a449-cef993ab2533 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:07.097575 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e77242c3-f2b7-439b-be7c-377e4cbb0135 req-4b1d74af-88f1-4291-a449-cef993ab2533 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:07.115350 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-e77242c3-f2b7-439b-be7c-377e4cbb0135 req-4b1d74af-88f1-4291-a449-cef993ab2533 service nova] Creating event network-vif-plugged:0e4b319a-2574-4b38-a31e-4942cb5bda7f for instance 9a4ced25-d85e-4469-95b6-5e666731a714 on n-h2-master-1 Aug 07 01:14:07.122092 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-e77242c3-f2b7-439b-be7c-377e4cbb0135 req-4b1d74af-88f1-4291-a449-cef993ab2533 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043193 Aug 07 01:14:07.125219 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 566/1001] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:14:07.136609 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4b7b142c-cd72-418e-be07-e8527b260a0d tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Action: 'create', calling method: .version_select at 0x7f9e248f3820>, body: {"security_group_rule": {"parent_group_id": "85f26678-a416-4170-9d03-22e2748bd362", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:07.226142 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-4b7b142c-cd72-418e-be07-e8527b260a0d tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] HTTP exception thrown: This rule already exists in group 85f26678-a416-4170-9d03-22e2748bd362 Aug 07 01:14:07.228587 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4b7b142c-cd72-418e-be07-e8527b260a0d tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Request method failure captured: Aug 07 01:14:07.228587 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 07 01:14:07.228587 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:14:07.228587 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:14:07.228587 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:14:07.228587 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 138 Aug 07 01:14:07.228587 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:14:07.228587 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:14:07.228587 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:14:07.228587 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:14:07.228587 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xHcpatqY-ikoXaDQlKAw1KYULNWST5eT6lLI85TUgP-Ef1lFPqJ1aj3DcAEhG5YIOz_gSwQovSJJ4zP4gmgr7QsSvRf4HBtQuY1r_BMzqil_-qwazoLkMWF7_9xghzj6h3oIFEAM2dvHXSuV5ktfyzLraxzt5oKVauCTqH-dzomIk0 Aug 07 01:14:07.228587 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:14:07.228587 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:14:07.228587 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:14:07.228587 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:14:07.228587 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:14:07.228587 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:14:07.228587 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: c7ad37611d074f0e989d14d4d02cf4af Aug 07 01:14:07.228587 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-281651563 Aug 07 01:14:07.228587 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:14:07.228587 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:14:07.230860 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c7ad37611d074f0e989d14d4d02cf4af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c7ad37611d074f0e989d14d4d02cf4af", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c7ad37611d074f0e989d14d4d02cf4af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c7ad37611d074f0e989d14d4d02cf4af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:14:07.230860 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-281651563 Aug 07 01:14:07.230860 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: c7ad37611d074f0e989d14d4d02cf4af Aug 07 01:14:07.230860 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-281651563 Aug 07 01:14:07.230860 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-281651563-project Aug 07 01:14:07.230860 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:14:07.230860 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:14:07.230860 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 72ffacc6ff884be9b0e38e0afd244362 Aug 07 01:14:07.230860 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-281651563-project Aug 07 01:14:07.230860 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:14:07.230860 n-d-master-1 devstack@n-api.service[119516]: {"security_group_rule": {"parent_group_id": "85f26678-a416-4170-9d03-22e2748bd362", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 07 01:14:07.230860 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:14:07.231857 n-d-master-1 devstack@n-api.service[119516]: exception: This rule already exists in group 85f26678-a416-4170-9d03-22e2748bd362 Aug 07 01:14:07.231857 n-d-master-1 devstack@n-api.service[119516]: action_args: {'body': {'security_group_rule': {'parent_group_id': '85f26678-a416-4170-9d03-22e2748bd362', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 07 01:14:07.231857 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:14:07.231857 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:07.231857 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 07 01:14:07.231857 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 07 01:14:07.231857 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 07 01:14:07.231857 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 07 01:14:07.231857 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 85f26678-a416-4170-9d03-22e2748bd362 Aug 07 01:14:07.231857 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:07.231857 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:07.231857 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:07.231857 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:07.231857 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:07.231857 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:07.231857 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:14:07.231857 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:14:07.231857 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:14:07.231857 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:14:07.231857 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:14:07.233646 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:14:07.233646 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 07 01:14:07.233646 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 07 01:14:07.233646 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 85f26678-a416-4170-9d03-22e2748bd362 Aug 07 01:14:07.233646 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:07.233646 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:07.233646 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:07.233646 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:07.233646 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:07.233646 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:07.233646 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:14:07.233646 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:14:07.233646 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 85f26678-a416-4170-9d03-22e2748bd362 Aug 07 01:14:07.233646 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:07.237612 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4b7b142c-cd72-418e-be07-e8527b260a0d tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Returning 400 to user: This rule already exists in group 85f26678-a416-4170-9d03-22e2748bd362 {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:14:07.239222 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4b7b142c-cd72-418e-be07-e8527b260a0d tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.111969 Aug 07 01:14:07.240760 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 567/1002] 10.222.0.39 () {60 vars in 1195 bytes} [Sun Aug 7 01:14:07 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:14:07.271341 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-cb46f2d0-ea9b-480d-9cec-24fa27e51ba6 req-23464715-a504-45cb-8dea-c12ee98bd17d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6", "name": "network-vif-deleted", "tag": "86c30725-b72b-49bf-9799-0396a8d1f229"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:07.293506 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-cb46f2d0-ea9b-480d-9cec-24fa27e51ba6 req-23464715-a504-45cb-8dea-c12ee98bd17d service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:07.295389 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-cb46f2d0-ea9b-480d-9cec-24fa27e51ba6 req-23464715-a504-45cb-8dea-c12ee98bd17d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:07.296234 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-cb46f2d0-ea9b-480d-9cec-24fa27e51ba6 req-23464715-a504-45cb-8dea-c12ee98bd17d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:07.328040 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-cb46f2d0-ea9b-480d-9cec-24fa27e51ba6 req-23464715-a504-45cb-8dea-c12ee98bd17d service nova] Creating event network-vif-deleted:86c30725-b72b-49bf-9799-0396a8d1f229 for instance aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6 on n-h1-master-1 Aug 07 01:14:07.329746 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4f9e2ad6-7c06-4b6b-a251-f41733f6fa10 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:07.341207 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-cb46f2d0-ea9b-480d-9cec-24fa27e51ba6 req-23464715-a504-45cb-8dea-c12ee98bd17d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079463 Aug 07 01:14:07.347579 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 568/1003] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:14:07.351491 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4f9e2ad6-7c06-4b6b-a251-f41733f6fa10 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1476 microversion: 2.1 time: 1.009968 Aug 07 01:14:07.352568 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 436/1004] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:06 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1476 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:07.358597 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d18e88a3-0b1d-4cd9-9da9-c34761e09fb5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:07.359722 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d18e88a3-0b1d-4cd9-9da9-c34761e09fb5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 9a4ced25-d85e-4469-95b6-5e666731a714] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:07.368809 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d18e88a3-0b1d-4cd9-9da9-c34761e09fb5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:07.369723 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d18e88a3-0b1d-4cd9-9da9-c34761e09fb5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:07.370394 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d18e88a3-0b1d-4cd9-9da9-c34761e09fb5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:07.371907 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d18e88a3-0b1d-4cd9-9da9-c34761e09fb5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:07.372879 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d18e88a3-0b1d-4cd9-9da9-c34761e09fb5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:07.373961 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d18e88a3-0b1d-4cd9-9da9-c34761e09fb5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:07.402902 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1122481d-d7bf-486a-8dbf-5b9aabafbbc3 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:07.404134 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1122481d-d7bf-486a-8dbf-5b9aabafbbc3 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:07.425920 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1122481d-d7bf-486a-8dbf-5b9aabafbbc3 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:07.426742 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1122481d-d7bf-486a-8dbf-5b9aabafbbc3 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:07.427446 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1122481d-d7bf-486a-8dbf-5b9aabafbbc3 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:07.428636 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1122481d-d7bf-486a-8dbf-5b9aabafbbc3 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:07.429441 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1122481d-d7bf-486a-8dbf-5b9aabafbbc3 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:07.429952 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1122481d-d7bf-486a-8dbf-5b9aabafbbc3 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:07.706421 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d18e88a3-0b1d-4cd9-9da9-c34761e09fb5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:07.723686 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d18e88a3-0b1d-4cd9-9da9-c34761e09fb5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714" status: 200 len: 1319 microversion: 2.1 time: 0.373647 Aug 07 01:14:07.725049 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 569/1005] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:07 2022] GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714 => generated 1319 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:07.762265 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-987c0339-0132-4cab-ab77-5ac35a0d8fb3 tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Calling method '.version_select at 0x7f9e24723ca0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:07.803329 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:07.940244 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1122481d-d7bf-486a-8dbf-5b9aabafbbc3 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d08a2479f847b4b06d6690f1aedb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06211ba44e4f6d88f9095969001aab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:07.961212 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1122481d-d7bf-486a-8dbf-5b9aabafbbc3 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31" status: 200 len: 1711 microversion: 2.1 time: 0.605769 Aug 07 01:14:07.962782 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 437/1006] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:07 2022] GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 => generated 1711 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:07.975255 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a4e2f405-b00a-43f1-8528-2abc523c80fd tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:07.976498 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a4e2f405-b00a-43f1-8528-2abc523c80fd tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:07.993074 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4e2f405-b00a-43f1-8528-2abc523c80fd tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:07.994071 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4e2f405-b00a-43f1-8528-2abc523c80fd tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:07.994916 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4e2f405-b00a-43f1-8528-2abc523c80fd tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:07.997180 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4e2f405-b00a-43f1-8528-2abc523c80fd tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:07.998113 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4e2f405-b00a-43f1-8528-2abc523c80fd tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:07.998930 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4e2f405-b00a-43f1-8528-2abc523c80fd tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:08.037071 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-987c0339-0132-4cab-ab77-5ac35a0d8fb3 tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-group-rules/fb7e48b5-01d6-49eb-ac31-7ad318fd1455" status: 202 len: 0 microversion: 2.1 time: 0.293422 Aug 07 01:14:08.038725 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 570/1007] 10.222.0.39 () {58 vars in 1287 bytes} [Sun Aug 7 01:14:07 2022] DELETE /compute/v2.1/os-security-group-rules/fb7e48b5-01d6-49eb-ac31-7ad318fd1455 => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:14:08.053902 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-55ffc950-ead7-4200-9eeb-85574cd4aa75 tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Action: 'create', calling method: .version_select at 0x7f9e248f3310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2084395611", "description": "tempest-description-844141596"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:08.062579 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4e2f405-b00a-43f1-8528-2abc523c80fd tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:08.063063 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4e2f405-b00a-43f1-8528-2abc523c80fd tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:08.063501 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4e2f405-b00a-43f1-8528-2abc523c80fd tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:08.063983 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-a4e2f405-b00a-43f1-8528-2abc523c80fd tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lazy-loading 'fault' on Instance uuid aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:14:08.097630 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=8 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:08.147624 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a4e2f405-b00a-43f1-8528-2abc523c80fd tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dce42ff994d81b1ad6d6c05356c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6d319a0452448485aa65b7cf1c5b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:08.164677 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a4e2f405-b00a-43f1-8528-2abc523c80fd tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6" status: 200 len: 1307 microversion: 2.1 time: 0.199823 Aug 07 01:14:08.166185 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 438/1008] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:07 2022] GET /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6 => generated 1307 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:08.176296 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ec0b2d36-b987-45c3-b414-5afe632f1523 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:08.177769 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ec0b2d36-b987-45c3-b414-5afe632f1523 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 1e845e5c-f730-47a0-a5a9-8e0666de0d10] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:08.190138 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ec0b2d36-b987-45c3-b414-5afe632f1523 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:08.191366 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ec0b2d36-b987-45c3-b414-5afe632f1523 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:08.192427 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ec0b2d36-b987-45c3-b414-5afe632f1523 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:08.193988 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ec0b2d36-b987-45c3-b414-5afe632f1523 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:08.195077 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ec0b2d36-b987-45c3-b414-5afe632f1523 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:08.195955 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ec0b2d36-b987-45c3-b414-5afe632f1523 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:08.378320 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-55ffc950-ead7-4200-9eeb-85574cd4aa75 tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.331422 Aug 07 01:14:08.389639 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 571/1009] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Aug 7 01:14:08 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:14:08.400058 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a03ccf88-14bc-47e6-b5c6-805b4efc7e0f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:08.401308 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a03ccf88-14bc-47e6-b5c6-805b4efc7e0f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:08.414636 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a03ccf88-14bc-47e6-b5c6-805b4efc7e0f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:08.415985 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a03ccf88-14bc-47e6-b5c6-805b4efc7e0f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:08.417104 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a03ccf88-14bc-47e6-b5c6-805b4efc7e0f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:08.418489 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a03ccf88-14bc-47e6-b5c6-805b4efc7e0f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:08.419436 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a03ccf88-14bc-47e6-b5c6-805b4efc7e0f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:08.420336 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a03ccf88-14bc-47e6-b5c6-805b4efc7e0f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:08.536657 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ec0b2d36-b987-45c3-b414-5afe632f1523 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:08.553920 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ec0b2d36-b987-45c3-b414-5afe632f1523 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10" status: 200 len: 1314 microversion: 2.1 time: 0.385467 Aug 07 01:14:08.554572 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 439/1010] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:08 2022] GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10 => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:08.561281 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f5fef69b-8846-42e0-a73f-12432cb2a222 tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Action: 'create', calling method: .version_select at 0x7f9e24642040>, body: {"security_group_rule": {"parent_group_id": "5a7f5e6d-d92f-4342-b781-6d831e627e60", "ip_protocol": "tcp", "from_port": 1352056042, "to_port": 22}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:08.643825 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-f5fef69b-8846-42e0-a73f-12432cb2a222 tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] HTTP exception thrown: Invalid port range 1352056042:22. Former value cannot be greater than the later Aug 07 01:14:08.650387 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f5fef69b-8846-42e0-a73f-12432cb2a222 tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Request method failure captured: Aug 07 01:14:08.650387 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 07 01:14:08.650387 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:14:08.650387 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:14:08.650387 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:14:08.650387 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 146 Aug 07 01:14:08.650387 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:14:08.650387 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:14:08.650387 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:14:08.650387 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:14:08.650387 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xHcpatqY-ikoXaDQlKAw1KYULNWST5eT6lLI85TUgP-Ef1lFPqJ1aj3DcAEhG5YIOz_gSwQovSJJ4zP4gmgr7QsSvRf4HBtQuY1r_BMzqil_-qwazoLkMWF7_9xghzj6h3oIFEAM2dvHXSuV5ktfyzLraxzt5oKVauCTqH-dzomIk0 Aug 07 01:14:08.650387 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:14:08.650387 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:14:08.650387 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:14:08.650387 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:14:08.650387 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:14:08.650387 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:14:08.650387 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: c7ad37611d074f0e989d14d4d02cf4af Aug 07 01:14:08.650387 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-281651563 Aug 07 01:14:08.650387 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:14:08.650387 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:14:08.655622 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c7ad37611d074f0e989d14d4d02cf4af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c7ad37611d074f0e989d14d4d02cf4af", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c7ad37611d074f0e989d14d4d02cf4af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c7ad37611d074f0e989d14d4d02cf4af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:14:08.655622 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-281651563 Aug 07 01:14:08.655622 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: c7ad37611d074f0e989d14d4d02cf4af Aug 07 01:14:08.655622 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-281651563 Aug 07 01:14:08.655622 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-281651563-project Aug 07 01:14:08.655622 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:14:08.655622 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:14:08.655622 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 72ffacc6ff884be9b0e38e0afd244362 Aug 07 01:14:08.655622 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-281651563-project Aug 07 01:14:08.655622 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:14:08.655622 n-d-master-1 devstack@n-api.service[119517]: {"security_group_rule": {"parent_group_id": "5a7f5e6d-d92f-4342-b781-6d831e627e60", "ip_protocol": "tcp", "from_port": 1352056042, "to_port": 22}} Aug 07 01:14:08.655622 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:14:08.659821 n-d-master-1 devstack@n-api.service[119517]: exception: Invalid port range 1352056042:22. Former value cannot be greater than the later Aug 07 01:14:08.659821 n-d-master-1 devstack@n-api.service[119517]: action_args: {'body': {'security_group_rule': {'parent_group_id': '5a7f5e6d-d92f-4342-b781-6d831e627e60', 'ip_protocol': 'tcp', 'from_port': 1352056042, 'to_port': 22}}} Aug 07 01:14:08.659821 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:14:08.659821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:08.659821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 07 01:14:08.659821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 07 01:14:08.659821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 07 01:14:08.659821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 07 01:14:08.659821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 07 01:14:08.659821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 07 01:14:08.659821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 07 01:14:08.659821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 07 01:14:08.659821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1352056042:22. Former value cannot be greater than the later Aug 07 01:14:08.659821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:08.659821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:08.659821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:08.659821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:08.659821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:08.659821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:08.669637 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:14:08.669637 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:14:08.669637 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:14:08.669637 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:14:08.669637 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:14:08.669637 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:14:08.669637 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 07 01:14:08.669637 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 07 01:14:08.669637 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1352056042:22. Former value cannot be greater than the later Aug 07 01:14:08.669637 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:08.669637 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:08.669637 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:08.669637 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:08.669637 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:08.669637 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:08.669637 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:14:08.669637 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:14:08.669637 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1352056042:22. Former value cannot be greater than the later Aug 07 01:14:08.669637 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:08.674867 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f5fef69b-8846-42e0-a73f-12432cb2a222 tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Returning 400 to user: Invalid port range 1352056042:22. Former value cannot be greater than the later {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:14:08.677984 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f5fef69b-8846-42e0-a73f-12432cb2a222 tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.120676 Aug 07 01:14:08.679736 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 440/1011] 10.222.0.39 () {60 vars in 1195 bytes} [Sun Aug 7 01:14:08 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:14:08.696413 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-01743216-0528-47ca-8dfc-a4cadc8a25b3 tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Action: 'create', calling method: .version_select at 0x7f9e248c6040>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1274805405", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:08.701130 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-01743216-0528-47ca-8dfc-a4cadc8a25b3 tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] HTTP exception thrown: Security group id should be uuid Aug 07 01:14:08.705241 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-01743216-0528-47ca-8dfc-a4cadc8a25b3 tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Request method failure captured: Aug 07 01:14:08.705241 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 07 01:14:08.705241 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:14:08.705241 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:14:08.705241 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:14:08.705241 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 131 Aug 07 01:14:08.705241 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:14:08.705241 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:14:08.705241 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:14:08.705241 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:14:08.705241 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xHcpatqY-ikoXaDQlKAw1KYULNWST5eT6lLI85TUgP-Ef1lFPqJ1aj3DcAEhG5YIOz_gSwQovSJJ4zP4gmgr7QsSvRf4HBtQuY1r_BMzqil_-qwazoLkMWF7_9xghzj6h3oIFEAM2dvHXSuV5ktfyzLraxzt5oKVauCTqH-dzomIk0 Aug 07 01:14:08.705241 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:14:08.705241 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:14:08.705241 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:14:08.705241 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:14:08.705241 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:14:08.705241 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:14:08.705241 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: c7ad37611d074f0e989d14d4d02cf4af Aug 07 01:14:08.705241 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-281651563 Aug 07 01:14:08.705241 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:14:08.705241 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:14:08.706822 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c7ad37611d074f0e989d14d4d02cf4af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c7ad37611d074f0e989d14d4d02cf4af", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c7ad37611d074f0e989d14d4d02cf4af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c7ad37611d074f0e989d14d4d02cf4af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:14:08.706822 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-281651563 Aug 07 01:14:08.706822 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: c7ad37611d074f0e989d14d4d02cf4af Aug 07 01:14:08.706822 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-281651563 Aug 07 01:14:08.706822 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-281651563-project Aug 07 01:14:08.706822 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:14:08.706822 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:14:08.706822 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 72ffacc6ff884be9b0e38e0afd244362 Aug 07 01:14:08.706822 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-281651563-project Aug 07 01:14:08.706822 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:14:08.706822 n-d-master-1 devstack@n-api.service[119517]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1274805405", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 07 01:14:08.706822 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:14:08.706822 n-d-master-1 devstack@n-api.service[119517]: exception: Security group id should be uuid Aug 07 01:14:08.707964 n-d-master-1 devstack@n-api.service[119517]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1274805405', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 07 01:14:08.707964 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:14:08.707964 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:08.707964 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 07 01:14:08.707964 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 07 01:14:08.707964 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 07 01:14:08.707964 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 07 01:14:08.707964 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 07 01:14:08.707964 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:08.707964 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:08.707964 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:08.707964 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:08.707964 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:08.707964 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:08.707964 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:14:08.707964 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:14:08.707964 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:14:08.707964 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:14:08.707964 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:14:08.707964 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:14:08.711390 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 07 01:14:08.711390 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 07 01:14:08.711390 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 07 01:14:08.711390 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:08.711390 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:08.711390 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:08.711390 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:08.711390 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:08.711390 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:08.711390 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:14:08.711390 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:14:08.711390 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 07 01:14:08.711390 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:08.715935 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-01743216-0528-47ca-8dfc-a4cadc8a25b3 tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Returning 400 to user: Security group id should be uuid {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:14:08.717661 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-01743216-0528-47ca-8dfc-a4cadc8a25b3 tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.029358 Aug 07 01:14:08.719013 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 441/1012] 10.222.0.39 () {60 vars in 1195 bytes} [Sun Aug 7 01:14:08 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 07 01:14:08.736038 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d5e9f197-28d5-4347-a17b-0ac98674fec3 tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Action: 'create', calling method: .version_select at 0x7f9e24bafdc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1138769969", "description": "tempest-description-1178337611"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:08.819303 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a03ccf88-14bc-47e6-b5c6-805b4efc7e0f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:08.843036 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a03ccf88-14bc-47e6-b5c6-805b4efc7e0f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1476 microversion: 2.1 time: 0.450439 Aug 07 01:14:08.844857 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 572/1013] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:08 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1476 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:08.851026 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b52879b5-2116-4f28-b622-28b404ad58de tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:08.851948 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b52879b5-2116-4f28-b622-28b404ad58de tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 9a4ced25-d85e-4469-95b6-5e666731a714] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:08.869682 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b52879b5-2116-4f28-b622-28b404ad58de tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:08.870174 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b52879b5-2116-4f28-b622-28b404ad58de tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:08.870685 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b52879b5-2116-4f28-b622-28b404ad58de tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:08.871417 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b52879b5-2116-4f28-b622-28b404ad58de tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:08.871877 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b52879b5-2116-4f28-b622-28b404ad58de tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:08.872343 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b52879b5-2116-4f28-b622-28b404ad58de tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:09.094065 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d5e9f197-28d5-4347-a17b-0ac98674fec3 tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.366990 Aug 07 01:14:09.099131 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 442/1014] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Aug 7 01:14:08 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:14:09.132348 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-22f8f743-1db1-4def-be13-df2b95126736 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:09.133562 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-22f8f743-1db1-4def-be13-df2b95126736 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:09.173399 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22f8f743-1db1-4def-be13-df2b95126736 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:09.177277 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22f8f743-1db1-4def-be13-df2b95126736 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:09.178126 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22f8f743-1db1-4def-be13-df2b95126736 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:09.179141 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22f8f743-1db1-4def-be13-df2b95126736 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:09.179817 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22f8f743-1db1-4def-be13-df2b95126736 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:09.180498 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22f8f743-1db1-4def-be13-df2b95126736 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:09.235351 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b52879b5-2116-4f28-b622-28b404ad58de tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:09.278692 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b52879b5-2116-4f28-b622-28b404ad58de tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714" status: 200 len: 1319 microversion: 2.1 time: 0.432407 Aug 07 01:14:09.279300 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 573/1015] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:08 2022] GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714 => generated 1319 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:09.301129 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-50f61cac-2f91-4c4f-b367-87981c260bdf tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Action: 'create', calling method: .version_select at 0x7f9e24723430>, body: {"security_group_rule": {"parent_group_id": "eb6f0b23-8daf-4e17-bf8a-69efd1db31d5", "ip_protocol": "tempest-999-2108928415", "from_port": 22, "to_port": 22}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:09.511798 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-22f8f743-1db1-4def-be13-df2b95126736 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d08a2479f847b4b06d6690f1aedb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06211ba44e4f6d88f9095969001aab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:09.523402 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-22f8f743-1db1-4def-be13-df2b95126736 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31" status: 200 len: 1711 microversion: 2.1 time: 0.421307 Aug 07 01:14:09.524405 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 443/1016] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:09 2022] GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 => generated 1711 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:09.530167 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3f296fc0-8686-413c-8ec4-3d17a4e305d0 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:09.531143 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3f296fc0-8686-413c-8ec4-3d17a4e305d0 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:09.538267 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3f296fc0-8686-413c-8ec4-3d17a4e305d0 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:09.539829 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3f296fc0-8686-413c-8ec4-3d17a4e305d0 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:09.540528 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3f296fc0-8686-413c-8ec4-3d17a4e305d0 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:09.541488 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3f296fc0-8686-413c-8ec4-3d17a4e305d0 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:09.542782 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3f296fc0-8686-413c-8ec4-3d17a4e305d0 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:09.543560 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3f296fc0-8686-413c-8ec4-3d17a4e305d0 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:09.554562 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-50f61cac-2f91-4c4f-b367-87981c260bdf tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] HTTP exception thrown: Invalid IP protocol tempest-999-2108928415. Aug 07 01:14:09.556299 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-50f61cac-2f91-4c4f-b367-87981c260bdf tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Request method failure captured: Aug 07 01:14:09.556299 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 07 01:14:09.556299 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:14:09.556299 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:14:09.556299 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:14:09.556299 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 157 Aug 07 01:14:09.556299 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:14:09.556299 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:14:09.556299 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:14:09.556299 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:14:09.556299 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xHcpatqY-ikoXaDQlKAw1KYULNWST5eT6lLI85TUgP-Ef1lFPqJ1aj3DcAEhG5YIOz_gSwQovSJJ4zP4gmgr7QsSvRf4HBtQuY1r_BMzqil_-qwazoLkMWF7_9xghzj6h3oIFEAM2dvHXSuV5ktfyzLraxzt5oKVauCTqH-dzomIk0 Aug 07 01:14:09.556299 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:14:09.556299 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:14:09.556299 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:14:09.556299 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:14:09.556299 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:14:09.556299 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:14:09.556299 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: c7ad37611d074f0e989d14d4d02cf4af Aug 07 01:14:09.556299 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-281651563 Aug 07 01:14:09.556299 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:14:09.556299 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:14:09.557616 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c7ad37611d074f0e989d14d4d02cf4af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c7ad37611d074f0e989d14d4d02cf4af", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c7ad37611d074f0e989d14d4d02cf4af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c7ad37611d074f0e989d14d4d02cf4af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:14:09.557616 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-281651563 Aug 07 01:14:09.557616 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: c7ad37611d074f0e989d14d4d02cf4af Aug 07 01:14:09.557616 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-281651563 Aug 07 01:14:09.557616 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-281651563-project Aug 07 01:14:09.557616 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:14:09.557616 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:14:09.557616 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 72ffacc6ff884be9b0e38e0afd244362 Aug 07 01:14:09.557616 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-281651563-project Aug 07 01:14:09.557616 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:14:09.557616 n-d-master-1 devstack@n-api.service[119516]: {"security_group_rule": {"parent_group_id": "eb6f0b23-8daf-4e17-bf8a-69efd1db31d5", "ip_protocol": "tempest-999-2108928415", "from_port": 22, "to_port": 22}} Aug 07 01:14:09.557616 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:14:09.559386 n-d-master-1 devstack@n-api.service[119516]: exception: Invalid IP protocol tempest-999-2108928415. Aug 07 01:14:09.559386 n-d-master-1 devstack@n-api.service[119516]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'eb6f0b23-8daf-4e17-bf8a-69efd1db31d5', 'ip_protocol': 'tempest-999-2108928415', 'from_port': 22, 'to_port': 22}}} Aug 07 01:14:09.559386 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:14:09.559386 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:09.559386 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 07 01:14:09.559386 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 07 01:14:09.559386 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 07 01:14:09.559386 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 07 01:14:09.559386 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 07 01:14:09.559386 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 07 01:14:09.559386 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 07 01:14:09.559386 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 07 01:14:09.559386 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-2108928415. Aug 07 01:14:09.559386 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:09.559386 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:09.559386 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:09.559386 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:09.559386 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:09.559386 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:09.560778 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:14:09.560778 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:14:09.560778 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:14:09.560778 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:14:09.560778 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:14:09.560778 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:14:09.560778 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 07 01:14:09.560778 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 07 01:14:09.560778 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-2108928415. Aug 07 01:14:09.560778 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:09.560778 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:09.560778 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:09.560778 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:09.560778 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:09.560778 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:09.560778 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:14:09.560778 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:14:09.560778 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-2108928415. Aug 07 01:14:09.560778 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:09.562042 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-50f61cac-2f91-4c4f-b367-87981c260bdf tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Returning 400 to user: Invalid IP protocol tempest-999-2108928415. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:14:09.562042 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-50f61cac-2f91-4c4f-b367-87981c260bdf tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.274788 Aug 07 01:14:09.562042 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 574/1017] 10.222.0.39 () {60 vars in 1195 bytes} [Sun Aug 7 01:14:09 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 279 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 07 01:14:09.568848 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3d574f34-dfb2-4934-babf-b80a70a2cdc2 tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Action: 'create', calling method: .version_select at 0x7f9e247191f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1656878072", "description": "tempest-description-145122963"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:09.631972 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3f296fc0-8686-413c-8ec4-3d17a4e305d0 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:09.632961 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3f296fc0-8686-413c-8ec4-3d17a4e305d0 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:09.633646 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3f296fc0-8686-413c-8ec4-3d17a4e305d0 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:09.634375 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-3f296fc0-8686-413c-8ec4-3d17a4e305d0 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lazy-loading 'fault' on Instance uuid aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:14:09.701033 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3f296fc0-8686-413c-8ec4-3d17a4e305d0 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dce42ff994d81b1ad6d6c05356c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6d319a0452448485aa65b7cf1c5b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:09.717853 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3f296fc0-8686-413c-8ec4-3d17a4e305d0 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6" status: 200 len: 1307 microversion: 2.1 time: 0.192024 Aug 07 01:14:09.718749 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 444/1018] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:09 2022] GET /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6 => generated 1307 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:09.730522 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-caff44ed-129a-443e-86ae-4f576070fa53 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:09.734073 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-caff44ed-129a-443e-86ae-4f576070fa53 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 1e845e5c-f730-47a0-a5a9-8e0666de0d10] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:09.746604 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-caff44ed-129a-443e-86ae-4f576070fa53 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:09.748001 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-caff44ed-129a-443e-86ae-4f576070fa53 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:09.749158 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-caff44ed-129a-443e-86ae-4f576070fa53 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:09.750861 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-caff44ed-129a-443e-86ae-4f576070fa53 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:09.751771 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-caff44ed-129a-443e-86ae-4f576070fa53 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:09.753398 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-caff44ed-129a-443e-86ae-4f576070fa53 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:09.893549 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3d574f34-dfb2-4934-babf-b80a70a2cdc2 tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.328123 Aug 07 01:14:09.895861 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 575/1019] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Aug 7 01:14:09 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:14:09.918109 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-334e6fa3-da07-4283-87e6-01573fa6f222 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:09.919464 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-334e6fa3-da07-4283-87e6-01573fa6f222 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:09.992054 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-334e6fa3-da07-4283-87e6-01573fa6f222 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:09.997871 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-334e6fa3-da07-4283-87e6-01573fa6f222 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:09.999489 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-334e6fa3-da07-4283-87e6-01573fa6f222 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:10.002124 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-334e6fa3-da07-4283-87e6-01573fa6f222 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:10.008383 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-334e6fa3-da07-4283-87e6-01573fa6f222 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:10.012065 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-334e6fa3-da07-4283-87e6-01573fa6f222 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:10.369804 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-caff44ed-129a-443e-86ae-4f576070fa53 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:10.423246 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-caff44ed-129a-443e-86ae-4f576070fa53 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10" status: 200 len: 1314 microversion: 2.1 time: 0.702664 Aug 07 01:14:10.424322 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 445/1020] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:09 2022] GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10 => generated 1314 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:10.439122 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0760190b-bcaa-44c0-ba0d-eb5f14f5f76d tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Action: 'create', calling method: .version_select at 0x7f9e248c63a0>, body: {"security_group_rule": {"parent_group_id": "9bcca9d2-7758-4b32-9a00-a9af5d43321a", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:10.624549 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-0760190b-bcaa-44c0-ba0d-eb5f14f5f76d tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 07 01:14:10.635705 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0760190b-bcaa-44c0-ba0d-eb5f14f5f76d tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Request method failure captured: Aug 07 01:14:10.635705 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 07 01:14:10.635705 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:14:10.635705 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:14:10.635705 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:14:10.635705 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 138 Aug 07 01:14:10.635705 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:14:10.635705 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:14:10.635705 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:14:10.635705 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:14:10.635705 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xHcpatqY-ikoXaDQlKAw1KYULNWST5eT6lLI85TUgP-Ef1lFPqJ1aj3DcAEhG5YIOz_gSwQovSJJ4zP4gmgr7QsSvRf4HBtQuY1r_BMzqil_-qwazoLkMWF7_9xghzj6h3oIFEAM2dvHXSuV5ktfyzLraxzt5oKVauCTqH-dzomIk0 Aug 07 01:14:10.635705 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:14:10.635705 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:14:10.635705 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:14:10.635705 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:14:10.635705 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:14:10.635705 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:14:10.635705 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: c7ad37611d074f0e989d14d4d02cf4af Aug 07 01:14:10.635705 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-281651563 Aug 07 01:14:10.635705 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:14:10.635705 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:14:10.638359 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c7ad37611d074f0e989d14d4d02cf4af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c7ad37611d074f0e989d14d4d02cf4af", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c7ad37611d074f0e989d14d4d02cf4af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c7ad37611d074f0e989d14d4d02cf4af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:14:10.638359 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-281651563 Aug 07 01:14:10.638359 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: c7ad37611d074f0e989d14d4d02cf4af Aug 07 01:14:10.638359 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-281651563 Aug 07 01:14:10.638359 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-281651563-project Aug 07 01:14:10.638359 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:14:10.638359 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:14:10.638359 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 72ffacc6ff884be9b0e38e0afd244362 Aug 07 01:14:10.638359 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-281651563-project Aug 07 01:14:10.638359 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:14:10.638359 n-d-master-1 devstack@n-api.service[119517]: {"security_group_rule": {"parent_group_id": "9bcca9d2-7758-4b32-9a00-a9af5d43321a", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 07 01:14:10.638359 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:14:10.639174 n-d-master-1 devstack@n-api.service[119517]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 07 01:14:10.639174 n-d-master-1 devstack@n-api.service[119517]: action_args: {'body': {'security_group_rule': {'parent_group_id': '9bcca9d2-7758-4b32-9a00-a9af5d43321a', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 07 01:14:10.639174 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:14:10.639174 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:10.639174 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 07 01:14:10.639174 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 07 01:14:10.639174 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 07 01:14:10.639174 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 07 01:14:10.639174 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 07 01:14:10.639174 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 07 01:14:10.639174 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 07 01:14:10.639174 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 07 01:14:10.639174 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 07 01:14:10.639174 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:10.639174 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:10.639174 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:10.639174 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:10.639174 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:10.639174 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:10.640656 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:14:10.640656 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:14:10.640656 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:14:10.640656 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:14:10.640656 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:14:10.640656 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:14:10.640656 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 07 01:14:10.640656 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 07 01:14:10.640656 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 07 01:14:10.640656 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:10.640656 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:10.640656 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:10.640656 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:10.640656 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:10.640656 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:10.640656 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:14:10.640656 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:14:10.640656 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 07 01:14:10.640656 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:10.642332 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0760190b-bcaa-44c0-ba0d-eb5f14f5f76d tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:14:10.642332 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0760190b-bcaa-44c0-ba0d-eb5f14f5f76d tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.209089 Aug 07 01:14:10.642332 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 446/1021] 10.222.0.39 () {60 vars in 1195 bytes} [Sun Aug 7 01:14:10 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 211 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:14:10.651100 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-334e6fa3-da07-4283-87e6-01573fa6f222 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:10.657226 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-83439401-b497-4f1d-8572-7d1ff39c4262 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:10.665100 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-83439401-b497-4f1d-8572-7d1ff39c4262 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 9a4ced25-d85e-4469-95b6-5e666731a714] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:10.673243 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-334e6fa3-da07-4283-87e6-01573fa6f222 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1476 microversion: 2.1 time: 0.772548 Aug 07 01:14:10.679749 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 576/1022] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:09 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1476 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:10.691046 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8ef57a2a-86f9-4b06-8195-7d53f939b7fc tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:10.692726 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8ef57a2a-86f9-4b06-8195-7d53f939b7fc tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:10.700710 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-83439401-b497-4f1d-8572-7d1ff39c4262 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:10.702732 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-83439401-b497-4f1d-8572-7d1ff39c4262 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:10.704189 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-83439401-b497-4f1d-8572-7d1ff39c4262 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:10.710124 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-83439401-b497-4f1d-8572-7d1ff39c4262 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:10.710673 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-83439401-b497-4f1d-8572-7d1ff39c4262 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:10.711125 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-83439401-b497-4f1d-8572-7d1ff39c4262 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:10.719599 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8ef57a2a-86f9-4b06-8195-7d53f939b7fc tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:10.720298 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8ef57a2a-86f9-4b06-8195-7d53f939b7fc tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:10.720875 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8ef57a2a-86f9-4b06-8195-7d53f939b7fc tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:10.726675 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8ef57a2a-86f9-4b06-8195-7d53f939b7fc tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:10.729445 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8ef57a2a-86f9-4b06-8195-7d53f939b7fc tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:10.740054 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8ef57a2a-86f9-4b06-8195-7d53f939b7fc tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:11.094636 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-83439401-b497-4f1d-8572-7d1ff39c4262 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:11.107005 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-83439401-b497-4f1d-8572-7d1ff39c4262 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714" status: 200 len: 1469 microversion: 2.1 time: 0.467285 Aug 07 01:14:11.109109 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 447/1023] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:10 2022] GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714 => generated 1469 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:11.114746 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b5549484-1667-4c02-ac40-7ea580ade97f tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Action: 'create', calling method: .version_select at 0x7f9e2461c940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-407359147", "description": "tempest-description-1817349117"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:11.240219 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8ef57a2a-86f9-4b06-8195-7d53f939b7fc tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d08a2479f847b4b06d6690f1aedb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06211ba44e4f6d88f9095969001aab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:11.287309 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8ef57a2a-86f9-4b06-8195-7d53f939b7fc tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31" status: 200 len: 1711 microversion: 2.1 time: 0.605387 Aug 07 01:14:11.304518 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 577/1024] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:10 2022] GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 => generated 1711 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:11.325339 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4f2748b7-a873-4064-9152-93302f0e36de tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:11.326852 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4f2748b7-a873-4064-9152-93302f0e36de tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:11.340878 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f2748b7-a873-4064-9152-93302f0e36de tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:11.342409 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f2748b7-a873-4064-9152-93302f0e36de tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:11.343465 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f2748b7-a873-4064-9152-93302f0e36de tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:11.345547 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f2748b7-a873-4064-9152-93302f0e36de tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:11.346614 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f2748b7-a873-4064-9152-93302f0e36de tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:11.347604 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f2748b7-a873-4064-9152-93302f0e36de tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:11.387429 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-4f2748b7-a873-4064-9152-93302f0e36de tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] HTTP exception thrown: Instance aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6 could not be found. Aug 07 01:14:11.389041 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4f2748b7-a873-4064-9152-93302f0e36de tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Request method failure captured: Aug 07 01:14:11.389041 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6 HTTP/1.1 Aug 07 01:14:11.389041 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:14:11.389041 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:14:11.389041 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:14:11.389041 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:14:11.389041 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:14:11.389041 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:14:11.389041 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:14:11.389041 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:14:11.389041 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xEUV6cDl2zjf7X2Vlf0uJfSh3NVE4uRHTiKwG7Vw5ttOE0CHdyLfTeBcGzGImtqwsZDApoStu83aYO8CTIVKLvwGxAlSiwxoyNJBOWfKVKvAC-DXkT9S7iYGxwdDFSfrB4peKa0xlHCDxHbtn_T7ia7HWbTL0fWb49IP2Q3C0kJIpw Aug 07 01:14:11.389041 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:14:11.389041 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:14:11.389041 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:14:11.389041 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:14:11.389041 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:14:11.389041 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:14:11.389041 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 3e6d319a0452448485aa65b7cf1c5b0e Aug 07 01:14:11.389041 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-VolumesAdminNegativeTest-1236892433 Aug 07 01:14:11.389041 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:14:11.389041 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:14:11.391993 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3e6d319a0452448485aa65b7cf1c5b0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3e6d319a0452448485aa65b7cf1c5b0e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3e6d319a0452448485aa65b7cf1c5b0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3e6d319a0452448485aa65b7cf1c5b0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:14:11.391993 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-VolumesAdminNegativeTest-1236892433 Aug 07 01:14:11.391993 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 3e6d319a0452448485aa65b7cf1c5b0e Aug 07 01:14:11.391993 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1236892433 Aug 07 01:14:11.391993 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-VolumesAdminNegativeTest-1236892433-project Aug 07 01:14:11.391993 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:14:11.391993 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:14:11.391993 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 7e9dce42ff994d81b1ad6d6c05356c37 Aug 07 01:14:11.391993 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-VolumesAdminNegativeTest-1236892433-project Aug 07 01:14:11.391993 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:14:11.391993 n-d-master-1 devstack@n-api.service[119516]: exception: Instance aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6 could not be found. Aug 07 01:14:11.391993 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6'} Aug 07 01:14:11.393866 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:14:11.393866 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:11.393866 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:14:11.393866 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:14:11.393866 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:14:11.393866 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:14:11.393866 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:14:11.393866 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:14:11.393866 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:14:11.393866 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:14:11.393866 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6 could not be found. Aug 07 01:14:11.393866 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:11.393866 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:11.393866 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:11.393866 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:11.393866 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:11.393866 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:11.393866 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:14:11.393866 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:14:11.393866 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:14:11.396834 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:14:11.396834 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:14:11.396834 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:14:11.396834 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:14:11.396834 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:14:11.396834 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:14:11.396834 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:14:11.396834 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6 could not be found. Aug 07 01:14:11.396834 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:11.396834 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:11.396834 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:11.396834 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:11.396834 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:11.396834 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:11.396834 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:14:11.396834 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:14:11.396834 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6 could not be found. Aug 07 01:14:11.396834 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:11.399267 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4f2748b7-a873-4064-9152-93302f0e36de tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Returning 404 to user: Instance aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:14:11.399267 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4f2748b7-a873-4064-9152-93302f0e36de tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6" status: 404 len: 111 microversion: 2.1 time: 0.084461 Aug 07 01:14:11.399567 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b5549484-1667-4c02-ac40-7ea580ade97f tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.285362 Aug 07 01:14:11.399713 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 578/1025] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:11 2022] GET /compute/v2.1/servers/aa5e90f1-62a5-4db4-87df-9e1fe57cb8c6 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:14:11.405425 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 448/1026] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Aug 7 01:14:11 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:14:11.416014 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0e354e41-aca6-4b9c-b393-5f0bcb0c589f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:11.418296 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0e354e41-aca6-4b9c-b393-5f0bcb0c589f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: fb8bf657-63c6-4cea-8571-e9449c5ee529] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:11.427181 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-84c671fe-4850-4167-8ac4-2270827dd596 tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Action: 'create', calling method: .version_select at 0x7f9e246b7ca0>, body: {"security_group_rule": {"parent_group_id": "2e34e909-4951-4bcc-8990-5e4e9a8edc12", "ip_protocol": "tcp", "from_port": 22, "to_port": 189662303}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:11.435706 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0e354e41-aca6-4b9c-b393-5f0bcb0c589f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:11.436301 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0e354e41-aca6-4b9c-b393-5f0bcb0c589f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:11.436741 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0e354e41-aca6-4b9c-b393-5f0bcb0c589f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:11.437520 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0e354e41-aca6-4b9c-b393-5f0bcb0c589f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:11.438076 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0e354e41-aca6-4b9c-b393-5f0bcb0c589f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:11.438568 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0e354e41-aca6-4b9c-b393-5f0bcb0c589f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:11.582614 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-84c671fe-4850-4167-8ac4-2270827dd596 tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] HTTP exception thrown: Invalid port range 22:189662303. Valid TCP ports should be between 1-65535 Aug 07 01:14:11.587135 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-84c671fe-4850-4167-8ac4-2270827dd596 tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Request method failure captured: Aug 07 01:14:11.587135 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 07 01:14:11.587135 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:14:11.587135 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:14:11.587135 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:14:11.587135 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 145 Aug 07 01:14:11.587135 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:14:11.587135 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:14:11.587135 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:14:11.587135 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:14:11.587135 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xHcpatqY-ikoXaDQlKAw1KYULNWST5eT6lLI85TUgP-Ef1lFPqJ1aj3DcAEhG5YIOz_gSwQovSJJ4zP4gmgr7QsSvRf4HBtQuY1r_BMzqil_-qwazoLkMWF7_9xghzj6h3oIFEAM2dvHXSuV5ktfyzLraxzt5oKVauCTqH-dzomIk0 Aug 07 01:14:11.587135 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:14:11.587135 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:14:11.587135 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:14:11.587135 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:14:11.587135 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:14:11.587135 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:14:11.587135 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: c7ad37611d074f0e989d14d4d02cf4af Aug 07 01:14:11.587135 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-281651563 Aug 07 01:14:11.587135 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:14:11.587135 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:14:11.589860 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c7ad37611d074f0e989d14d4d02cf4af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c7ad37611d074f0e989d14d4d02cf4af", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c7ad37611d074f0e989d14d4d02cf4af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c7ad37611d074f0e989d14d4d02cf4af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:14:11.589860 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-281651563 Aug 07 01:14:11.589860 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: c7ad37611d074f0e989d14d4d02cf4af Aug 07 01:14:11.589860 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-281651563 Aug 07 01:14:11.589860 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-281651563-project Aug 07 01:14:11.589860 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:14:11.589860 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:14:11.589860 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 72ffacc6ff884be9b0e38e0afd244362 Aug 07 01:14:11.589860 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-281651563-project Aug 07 01:14:11.589860 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:14:11.589860 n-d-master-1 devstack@n-api.service[119517]: {"security_group_rule": {"parent_group_id": "2e34e909-4951-4bcc-8990-5e4e9a8edc12", "ip_protocol": "tcp", "from_port": 22, "to_port": 189662303}} Aug 07 01:14:11.589860 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:14:11.593277 n-d-master-1 devstack@n-api.service[119517]: exception: Invalid port range 22:189662303. Valid TCP ports should be between 1-65535 Aug 07 01:14:11.593277 n-d-master-1 devstack@n-api.service[119517]: action_args: {'body': {'security_group_rule': {'parent_group_id': '2e34e909-4951-4bcc-8990-5e4e9a8edc12', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 189662303}}} Aug 07 01:14:11.593277 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:14:11.593277 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:11.593277 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 07 01:14:11.593277 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 07 01:14:11.593277 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 07 01:14:11.593277 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 07 01:14:11.593277 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 07 01:14:11.593277 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 07 01:14:11.593277 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 07 01:14:11.593277 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 07 01:14:11.593277 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:189662303. Valid TCP ports should be between 1-65535 Aug 07 01:14:11.593277 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:11.593277 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:11.593277 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:11.593277 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:11.593277 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:11.593277 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:11.597207 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:14:11.597207 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:14:11.597207 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:14:11.597207 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:14:11.597207 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:14:11.597207 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:14:11.597207 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 07 01:14:11.597207 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 07 01:14:11.597207 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:189662303. Valid TCP ports should be between 1-65535 Aug 07 01:14:11.597207 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:11.597207 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:11.597207 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:11.597207 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:11.597207 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:11.597207 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:11.597207 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:14:11.597207 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:14:11.597207 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:189662303. Valid TCP ports should be between 1-65535 Aug 07 01:14:11.597207 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:11.605857 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-84c671fe-4850-4167-8ac4-2270827dd596 tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Returning 400 to user: Invalid port range 22:189662303. Valid TCP ports should be between 1-65535 {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:14:11.605857 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-84c671fe-4850-4167-8ac4-2270827dd596 tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.187092 Aug 07 01:14:11.608743 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 449/1027] 10.222.0.39 () {60 vars in 1195 bytes} [Sun Aug 7 01:14:11 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 195 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 07 01:14:11.616726 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9b7bc355-a394-4ddd-b06c-659d4f2c84f0 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:11.617583 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9b7bc355-a394-4ddd-b06c-659d4f2c84f0 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 1e845e5c-f730-47a0-a5a9-8e0666de0d10] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:11.632796 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9b7bc355-a394-4ddd-b06c-659d4f2c84f0 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:11.634077 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9b7bc355-a394-4ddd-b06c-659d4f2c84f0 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:11.636104 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9b7bc355-a394-4ddd-b06c-659d4f2c84f0 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:11.641267 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9b7bc355-a394-4ddd-b06c-659d4f2c84f0 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:11.642027 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9b7bc355-a394-4ddd-b06c-659d4f2c84f0 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:11.642705 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9b7bc355-a394-4ddd-b06c-659d4f2c84f0 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:11.893493 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9b7bc355-a394-4ddd-b06c-659d4f2c84f0 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:11.907019 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9b7bc355-a394-4ddd-b06c-659d4f2c84f0 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10" status: 200 len: 1314 microversion: 2.1 time: 0.294469 Aug 07 01:14:11.922782 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 450/1028] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:11 2022] GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:11.929187 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a65537b0-8f4a-4430-96da-b7356f61b9da tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Action: 'create', calling method: .version_select at 0x7f9e2500b790>, body: {"security_group_rule": {"parent_group_id": "628cf8b1-1067-4c17-b3d4-da400706bad3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:11.969406 n-d-master-1 devstack@n-api.service[119517]: DEBUG neutronclient.v2_0.client [None req-a65537b0-8f4a-4430-96da-b7356f61b9da tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 628cf8b1-1067-4c17-b3d4-da400706bad3 does not exist", "detail": ""}} {{(pid=119517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 07 01:14:11.970353 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.security_group_api [None req-a65537b0-8f4a-4430-96da-b7356f61b9da tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Neutron security group 628cf8b1-1067-4c17-b3d4-da400706bad3 not found {{(pid=119517) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 07 01:14:11.971078 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-a65537b0-8f4a-4430-96da-b7356f61b9da tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] HTTP exception thrown: Security group 628cf8b1-1067-4c17-b3d4-da400706bad3 does not exist Aug 07 01:14:11.971078 n-d-master-1 devstack@n-api.service[119517]: Neutron server returns request_ids: ['req-f4ca4a73-2963-42a1-867f-f2568eef13f2'] Aug 07 01:14:11.973774 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a65537b0-8f4a-4430-96da-b7356f61b9da tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Request method failure captured: Aug 07 01:14:11.973774 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 07 01:14:11.973774 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:14:11.973774 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:14:11.973774 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:14:11.973774 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 138 Aug 07 01:14:11.973774 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:14:11.973774 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:14:11.973774 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:14:11.973774 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:14:11.973774 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xHcpatqY-ikoXaDQlKAw1KYULNWST5eT6lLI85TUgP-Ef1lFPqJ1aj3DcAEhG5YIOz_gSwQovSJJ4zP4gmgr7QsSvRf4HBtQuY1r_BMzqil_-qwazoLkMWF7_9xghzj6h3oIFEAM2dvHXSuV5ktfyzLraxzt5oKVauCTqH-dzomIk0 Aug 07 01:14:11.973774 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:14:11.973774 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:14:11.973774 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:14:11.973774 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:14:11.973774 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:14:11.973774 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:14:11.973774 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: c7ad37611d074f0e989d14d4d02cf4af Aug 07 01:14:11.973774 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-281651563 Aug 07 01:14:11.973774 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:14:11.973774 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:14:11.975349 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c7ad37611d074f0e989d14d4d02cf4af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c7ad37611d074f0e989d14d4d02cf4af", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c7ad37611d074f0e989d14d4d02cf4af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c7ad37611d074f0e989d14d4d02cf4af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:14:11.975349 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-281651563 Aug 07 01:14:11.975349 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: c7ad37611d074f0e989d14d4d02cf4af Aug 07 01:14:11.975349 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-281651563 Aug 07 01:14:11.975349 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-281651563-project Aug 07 01:14:11.975349 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:14:11.975349 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:14:11.975349 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 72ffacc6ff884be9b0e38e0afd244362 Aug 07 01:14:11.975349 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-281651563-project Aug 07 01:14:11.975349 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:14:11.975349 n-d-master-1 devstack@n-api.service[119517]: {"security_group_rule": {"parent_group_id": "628cf8b1-1067-4c17-b3d4-da400706bad3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 07 01:14:11.975349 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:14:11.976301 n-d-master-1 devstack@n-api.service[119517]: exception: Security group 628cf8b1-1067-4c17-b3d4-da400706bad3 does not exist Aug 07 01:14:11.976301 n-d-master-1 devstack@n-api.service[119517]: Neutron server returns request_ids: ['req-f4ca4a73-2963-42a1-867f-f2568eef13f2'] Aug 07 01:14:11.976301 n-d-master-1 devstack@n-api.service[119517]: action_args: {'body': {'security_group_rule': {'parent_group_id': '628cf8b1-1067-4c17-b3d4-da400706bad3', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 07 01:14:11.976301 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:14:11.976301 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:11.976301 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 07 01:14:11.976301 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 07 01:14:11.976301 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:14:11.976301 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:14:11.976301 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 07 01:14:11.976301 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 07 01:14:11.976301 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:14:11.976301 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:14:11.976301 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 07 01:14:11.976301 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 07 01:14:11.976301 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:14:11.976301 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:14:11.976301 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 07 01:14:11.976301 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 07 01:14:11.977923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:14:11.977923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:14:11.977923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 07 01:14:11.977923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 07 01:14:11.977923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:14:11.977923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:14:11.977923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 07 01:14:11.977923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 07 01:14:11.977923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 07 01:14:11.977923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 07 01:14:11.977923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 628cf8b1-1067-4c17-b3d4-da400706bad3 does not exist Aug 07 01:14:11.977923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4ca4a73-2963-42a1-867f-f2568eef13f2'] Aug 07 01:14:11.977923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:11.977923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:11.977923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:11.977923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:11.977923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 07 01:14:11.977923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 07 01:14:11.977923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 07 01:14:11.979411 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 07 01:14:11.979411 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 628cf8b1-1067-4c17-b3d4-da400706bad3 does not exist Aug 07 01:14:11.979411 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4ca4a73-2963-42a1-867f-f2568eef13f2'] Aug 07 01:14:11.979411 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:11.979411 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:11.979411 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:11.979411 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:11.979411 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:11.979411 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:11.979411 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:14:11.979411 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:14:11.979411 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:14:11.979411 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:14:11.979411 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:14:11.979411 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:14:11.979411 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 07 01:14:11.979411 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 07 01:14:11.979411 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 628cf8b1-1067-4c17-b3d4-da400706bad3 does not exist Aug 07 01:14:11.979411 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4ca4a73-2963-42a1-867f-f2568eef13f2'] Aug 07 01:14:11.979411 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:11.981582 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:11.981582 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:11.981582 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:11.981582 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:11.981582 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:11.981582 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:14:11.981582 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:14:11.981582 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 628cf8b1-1067-4c17-b3d4-da400706bad3 does not exist Aug 07 01:14:11.981582 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4ca4a73-2963-42a1-867f-f2568eef13f2'] Aug 07 01:14:11.981582 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:11.989508 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a65537b0-8f4a-4430-96da-b7356f61b9da tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Returning 404 to user: Security group 628cf8b1-1067-4c17-b3d4-da400706bad3 does not exist Aug 07 01:14:11.989508 n-d-master-1 devstack@n-api.service[119517]: Neutron server returns request_ids: ['req-f4ca4a73-2963-42a1-867f-f2568eef13f2'] {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:14:11.990689 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a65537b0-8f4a-4430-96da-b7356f61b9da tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.066488 Aug 07 01:14:11.991452 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 451/1029] 10.222.0.39 () {60 vars in 1195 bytes} [Sun Aug 7 01:14:11 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:14:12.001429 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b13af108-ea6d-4708-88b0-72731638846f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:12.002928 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b13af108-ea6d-4708-88b0-72731638846f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:12.010953 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b13af108-ea6d-4708-88b0-72731638846f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:12.011829 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b13af108-ea6d-4708-88b0-72731638846f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:12.012351 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b13af108-ea6d-4708-88b0-72731638846f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:12.013246 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b13af108-ea6d-4708-88b0-72731638846f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:12.014099 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b13af108-ea6d-4708-88b0-72731638846f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:12.015211 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b13af108-ea6d-4708-88b0-72731638846f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:12.184041 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b13af108-ea6d-4708-88b0-72731638846f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:12.193292 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b13af108-ea6d-4708-88b0-72731638846f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1476 microversion: 2.1 time: 0.200546 Aug 07 01:14:12.195215 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 452/1030] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:11 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1476 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:12.200655 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-83d65b92-1cc2-4cb0-a6ba-016abc8c9cb5 tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Calling method '.version_select at 0x7f9e24694c10>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:12.219459 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0e354e41-aca6-4b9c-b393-5f0bcb0c589f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:12.232486 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0e354e41-aca6-4b9c-b393-5f0bcb0c589f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/fb8bf657-63c6-4cea-8571-e9449c5ee529" status: 200 len: 1468 microversion: 2.1 time: 0.834506 Aug 07 01:14:12.233423 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 579/1031] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:11 2022] GET /compute/v2.1/servers/fb8bf657-63c6-4cea-8571-e9449c5ee529 => generated 1468 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:12.248263 n-d-master-1 devstack@n-api.service[119517]: DEBUG neutronclient.v2_0.client [None req-83d65b92-1cc2-4cb0-a6ba-016abc8c9cb5 tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule a8ca7178-68bc-4845-a61e-a70f047bd763 does not exist", "detail": ""}} {{(pid=119517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 07 01:14:12.248958 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.security_group_api [None req-83d65b92-1cc2-4cb0-a6ba-016abc8c9cb5 tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Neutron security group rule a8ca7178-68bc-4845-a61e-a70f047bd763 not found {{(pid=119517) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 07 01:14:12.249568 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-83d65b92-1cc2-4cb0-a6ba-016abc8c9cb5 tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] HTTP exception thrown: Security group rule a8ca7178-68bc-4845-a61e-a70f047bd763 does not exist Aug 07 01:14:12.249568 n-d-master-1 devstack@n-api.service[119517]: Neutron server returns request_ids: ['req-d249085e-9560-441e-84cc-7c8f248def89'] Aug 07 01:14:12.252763 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-83d65b92-1cc2-4cb0-a6ba-016abc8c9cb5 tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Request method failure captured: Aug 07 01:14:12.252763 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/os-security-group-rules/a8ca7178-68bc-4845-a61e-a70f047bd763 HTTP/1.1 Aug 07 01:14:12.252763 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:14:12.252763 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:14:12.252763 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:14:12.252763 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:14:12.252763 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:14:12.252763 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:14:12.252763 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:14:12.252763 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:14:12.252763 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xHcpatqY-ikoXaDQlKAw1KYULNWST5eT6lLI85TUgP-Ef1lFPqJ1aj3DcAEhG5YIOz_gSwQovSJJ4zP4gmgr7QsSvRf4HBtQuY1r_BMzqil_-qwazoLkMWF7_9xghzj6h3oIFEAM2dvHXSuV5ktfyzLraxzt5oKVauCTqH-dzomIk0 Aug 07 01:14:12.252763 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:14:12.252763 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:14:12.252763 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:14:12.252763 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:14:12.252763 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:14:12.252763 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:14:12.252763 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: c7ad37611d074f0e989d14d4d02cf4af Aug 07 01:14:12.252763 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-281651563 Aug 07 01:14:12.252763 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:14:12.252763 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:14:12.255223 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c7ad37611d074f0e989d14d4d02cf4af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c7ad37611d074f0e989d14d4d02cf4af", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c7ad37611d074f0e989d14d4d02cf4af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c7ad37611d074f0e989d14d4d02cf4af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:14:12.255223 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-281651563 Aug 07 01:14:12.255223 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: c7ad37611d074f0e989d14d4d02cf4af Aug 07 01:14:12.255223 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-281651563 Aug 07 01:14:12.255223 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-281651563-project Aug 07 01:14:12.255223 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:14:12.255223 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:14:12.255223 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 72ffacc6ff884be9b0e38e0afd244362 Aug 07 01:14:12.255223 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-281651563-project Aug 07 01:14:12.255223 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:14:12.255223 n-d-master-1 devstack@n-api.service[119517]: exception: Security group rule a8ca7178-68bc-4845-a61e-a70f047bd763 does not exist Aug 07 01:14:12.255223 n-d-master-1 devstack@n-api.service[119517]: Neutron server returns request_ids: ['req-d249085e-9560-441e-84cc-7c8f248def89'] Aug 07 01:14:12.256372 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'a8ca7178-68bc-4845-a61e-a70f047bd763'} Aug 07 01:14:12.256372 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:14:12.256372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:12.256372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 07 01:14:12.256372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 07 01:14:12.256372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:14:12.256372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:14:12.256372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 07 01:14:12.256372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 07 01:14:12.256372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:14:12.256372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:14:12.256372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 07 01:14:12.256372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 07 01:14:12.256372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:14:12.256372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:14:12.256372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 07 01:14:12.256372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 07 01:14:12.256372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:14:12.256372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:14:12.257848 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 07 01:14:12.257848 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 07 01:14:12.257848 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:14:12.257848 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:14:12.257848 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 07 01:14:12.257848 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 07 01:14:12.257848 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 07 01:14:12.257848 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 07 01:14:12.257848 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule a8ca7178-68bc-4845-a61e-a70f047bd763 does not exist Aug 07 01:14:12.257848 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d249085e-9560-441e-84cc-7c8f248def89'] Aug 07 01:14:12.257848 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:12.257848 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:12.257848 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:12.257848 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:12.257848 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 07 01:14:12.257848 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 07 01:14:12.257848 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 07 01:14:12.257848 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 07 01:14:12.259180 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule a8ca7178-68bc-4845-a61e-a70f047bd763 does not exist Aug 07 01:14:12.259180 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d249085e-9560-441e-84cc-7c8f248def89'] Aug 07 01:14:12.259180 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:12.259180 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:12.259180 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:12.259180 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:12.259180 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:12.259180 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:12.259180 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:14:12.259180 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:14:12.259180 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:14:12.259180 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:14:12.259180 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:14:12.259180 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:14:12.259180 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 07 01:14:12.259180 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 07 01:14:12.259180 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule a8ca7178-68bc-4845-a61e-a70f047bd763 does not exist Aug 07 01:14:12.259180 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d249085e-9560-441e-84cc-7c8f248def89'] Aug 07 01:14:12.259180 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:12.259180 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:12.261488 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:12.261488 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:12.261488 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:12.261488 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:12.261488 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:14:12.261488 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:14:12.261488 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule a8ca7178-68bc-4845-a61e-a70f047bd763 does not exist Aug 07 01:14:12.261488 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d249085e-9560-441e-84cc-7c8f248def89'] Aug 07 01:14:12.261488 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:12.261488 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-83d65b92-1cc2-4cb0-a6ba-016abc8c9cb5 tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Returning 404 to user: Security group rule a8ca7178-68bc-4845-a61e-a70f047bd763 does not exist Aug 07 01:14:12.261488 n-d-master-1 devstack@n-api.service[119517]: Neutron server returns request_ids: ['req-d249085e-9560-441e-84cc-7c8f248def89'] {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:14:12.262972 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-589f29e4-714d-47ab-b8a6-a89ad03ed019 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:12.264923 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-83d65b92-1cc2-4cb0-a6ba-016abc8c9cb5 tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-group-rules/a8ca7178-68bc-4845-a61e-a70f047bd763" status: 404 len: 199 microversion: 2.1 time: 0.068249 Aug 07 01:14:12.265576 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 453/1032] 10.222.0.39 () {58 vars in 1287 bytes} [Sun Aug 7 01:14:12 2022] DELETE /compute/v2.1/os-security-group-rules/a8ca7178-68bc-4845-a61e-a70f047bd763 => generated 199 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:14:12.269947 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-589f29e4-714d-47ab-b8a6-a89ad03ed019 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:12.271289 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-589f29e4-714d-47ab-b8a6-a89ad03ed019 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Searching by: {'reservation_id': 'r-c9e1qh7s', 'deleted': False, 'project_id': 'd08d010c14a64f759887be0d2364c6e4'} {{(pid=119516) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:14:12.275346 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6c3fbf9b-68b4-4d84-baae-43c362a7bec0 tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Calling method '.version_select at 0x7f9e2461c940>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:12.295390 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-589f29e4-714d-47ab-b8a6-a89ad03ed019 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:12.296385 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-589f29e4-714d-47ab-b8a6-a89ad03ed019 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:12.297237 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-589f29e4-714d-47ab-b8a6-a89ad03ed019 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:12.298839 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-589f29e4-714d-47ab-b8a6-a89ad03ed019 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:12.299581 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-589f29e4-714d-47ab-b8a6-a89ad03ed019 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:12.300467 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-589f29e4-714d-47ab-b8a6-a89ad03ed019 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:12.553611 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.multi_cell_list [None req-589f29e4-714d-47ab-b8a6-a89ad03ed019 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 01:14:12.780108 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-589f29e4-714d-47ab-b8a6-a89ad03ed019 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:12.799738 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-589f29e4-714d-47ab-b8a6-a89ad03ed019 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:12.800581 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-589f29e4-714d-47ab-b8a6-a89ad03ed019 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:12.801218 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-589f29e4-714d-47ab-b8a6-a89ad03ed019 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:12.993333 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6c3fbf9b-68b4-4d84-baae-43c362a7bec0 tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/2e34e909-4951-4bcc-8990-5e4e9a8edc12" status: 202 len: 0 microversion: 2.1 time: 0.721697 Aug 07 01:14:12.998558 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 454/1033] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:14:12 2022] DELETE /compute/v2.1/os-security-groups/2e34e909-4951-4bcc-8990-5e4e9a8edc12 => generated 0 bytes in 727 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:14:13.015554 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8bb9ebe3-bcf9-4970-be90-c97ac2de8911 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:13.018095 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8bb9ebe3-bcf9-4970-be90-c97ac2de8911 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:13.031216 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8bb9ebe3-bcf9-4970-be90-c97ac2de8911 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:13.032170 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8bb9ebe3-bcf9-4970-be90-c97ac2de8911 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:13.032738 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8bb9ebe3-bcf9-4970-be90-c97ac2de8911 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:13.033750 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8bb9ebe3-bcf9-4970-be90-c97ac2de8911 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:13.034609 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8bb9ebe3-bcf9-4970-be90-c97ac2de8911 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:13.035685 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8bb9ebe3-bcf9-4970-be90-c97ac2de8911 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:13.154692 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8bb9ebe3-bcf9-4970-be90-c97ac2de8911 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d08a2479f847b4b06d6690f1aedb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06211ba44e4f6d88f9095969001aab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:13.157272 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-589f29e4-714d-47ab-b8a6-a89ad03ed019 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/detail?reservation_id=r-c9e1qh7s" status: 200 len: 2930 microversion: 2.1 time: 0.901975 Aug 07 01:14:13.159619 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 580/1034] 10.222.0.39 () {58 vars in 1197 bytes} [Sun Aug 7 01:14:12 2022] GET /compute/v2.1/servers/detail?reservation_id=r-c9e1qh7s => generated 2930 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:14:13.165299 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ee1012c5-75d3-4dbe-9626-5a57c43f4930 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:13.166458 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ee1012c5-75d3-4dbe-9626-5a57c43f4930 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 1e845e5c-f730-47a0-a5a9-8e0666de0d10] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:13.191437 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8bb9ebe3-bcf9-4970-be90-c97ac2de8911 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31" status: 200 len: 1644 microversion: 2.1 time: 0.191252 Aug 07 01:14:13.192044 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee1012c5-75d3-4dbe-9626-5a57c43f4930 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:13.192730 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee1012c5-75d3-4dbe-9626-5a57c43f4930 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:13.193373 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee1012c5-75d3-4dbe-9626-5a57c43f4930 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:13.195624 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee1012c5-75d3-4dbe-9626-5a57c43f4930 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:13.198631 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee1012c5-75d3-4dbe-9626-5a57c43f4930 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:13.200480 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee1012c5-75d3-4dbe-9626-5a57c43f4930 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:13.205226 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 455/1035] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:12 2022] GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 => generated 1644 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:13.220456 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e80b1aac-9452-461d-aa32-28494aafe2c9 tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Calling method '.version_select at 0x7f9e2461c3a0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:13.585594 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ee1012c5-75d3-4dbe-9626-5a57c43f4930 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:13.597435 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ee1012c5-75d3-4dbe-9626-5a57c43f4930 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10" status: 200 len: 1314 microversion: 2.1 time: 0.435666 Aug 07 01:14:13.598591 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 581/1036] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:13 2022] GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10 => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:13.603938 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d1533dde-9cbc-4804-bfc6-1084508f9f1c tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:13.621895 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.compute.server_groups [None req-d1533dde-9cbc-4804-bfc6-1084508f9f1c tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Querying cell 946acc3b-7b72-45d6-9151-44f3ad85fe4f(cell1) for 2 instances {{(pid=119516) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 07 01:14:13.623014 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d1533dde-9cbc-4804-bfc6-1084508f9f1c tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:13.623716 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d1533dde-9cbc-4804-bfc6-1084508f9f1c tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:13.624388 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d1533dde-9cbc-4804-bfc6-1084508f9f1c tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:13.640789 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:13.663810 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d1533dde-9cbc-4804-bfc6-1084508f9f1c tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups/3ca9bf80-25d0-438c-8b41-d7d92142db5c" status: 200 len: 266 microversion: 2.1 time: 0.063734 Aug 07 01:14:13.673911 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 582/1037] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Aug 7 01:14:13 2022] GET /compute/v2.1/os-server-groups/3ca9bf80-25d0-438c-8b41-d7d92142db5c => generated 266 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:14:13.679473 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e4096e01-384b-4e69-8e48-052914a995eb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:13.681030 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e4096e01-384b-4e69-8e48-052914a995eb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:13.702686 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4096e01-384b-4e69-8e48-052914a995eb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:13.703724 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4096e01-384b-4e69-8e48-052914a995eb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:13.704500 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4096e01-384b-4e69-8e48-052914a995eb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:13.705512 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4096e01-384b-4e69-8e48-052914a995eb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:13.709781 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4096e01-384b-4e69-8e48-052914a995eb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:13.710557 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4096e01-384b-4e69-8e48-052914a995eb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:13.959483 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e4096e01-384b-4e69-8e48-052914a995eb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:13.976690 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e4096e01-384b-4e69-8e48-052914a995eb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1476 microversion: 2.1 time: 0.301286 Aug 07 01:14:13.994081 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 583/1038] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:13 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1476 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:14.008829 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-93f8c10e-e13f-444c-8ae8-760eb7df3a09 req-1edc63dc-8848-4343-856b-261d6318c392 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81ae2aca-ae4d-4dc3-8c29-4da2460bcc31", "name": "network-vif-deleted", "tag": "56265c55-bdaf-4051-ad48-6b3b5662fe2f"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:14.031211 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-93f8c10e-e13f-444c-8ae8-760eb7df3a09 req-1edc63dc-8848-4343-856b-261d6318c392 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:14.050739 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-93f8c10e-e13f-444c-8ae8-760eb7df3a09 req-1edc63dc-8848-4343-856b-261d6318c392 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:14.053175 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-93f8c10e-e13f-444c-8ae8-760eb7df3a09 req-1edc63dc-8848-4343-856b-261d6318c392 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:14.128737 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-93f8c10e-e13f-444c-8ae8-760eb7df3a09 req-1edc63dc-8848-4343-856b-261d6318c392 service nova] Creating event network-vif-deleted:56265c55-bdaf-4051-ad48-6b3b5662fe2f for instance 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 on n-h1-master-1 Aug 07 01:14:14.140114 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-93f8c10e-e13f-444c-8ae8-760eb7df3a09 req-1edc63dc-8848-4343-856b-261d6318c392 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143441 Aug 07 01:14:14.143392 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 584/1039] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:14:14.156097 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2756f361-e6ae-4c1b-a325-b410d9eacd72 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:14.161491 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2756f361-e6ae-4c1b-a325-b410d9eacd72 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] [instance: 9a4ced25-d85e-4469-95b6-5e666731a714] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:14.181007 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2756f361-e6ae-4c1b-a325-b410d9eacd72 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:14.181515 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2756f361-e6ae-4c1b-a325-b410d9eacd72 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:14.181990 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2756f361-e6ae-4c1b-a325-b410d9eacd72 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:14.182704 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2756f361-e6ae-4c1b-a325-b410d9eacd72 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:14.183163 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2756f361-e6ae-4c1b-a325-b410d9eacd72 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:14.183595 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2756f361-e6ae-4c1b-a325-b410d9eacd72 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:14.219253 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e80b1aac-9452-461d-aa32-28494aafe2c9 tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/9bcca9d2-7758-4b32-9a00-a9af5d43321a" status: 202 len: 0 microversion: 2.1 time: 1.012411 Aug 07 01:14:14.219923 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 456/1040] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:14:13 2022] DELETE /compute/v2.1/os-security-groups/9bcca9d2-7758-4b32-9a00-a9af5d43321a => generated 0 bytes in 1014 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:14:14.225448 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ee6c7efd-0ab6-4501-b3df-580a0edf93e8 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:14.226332 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ee6c7efd-0ab6-4501-b3df-580a0edf93e8 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:14.250650 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee6c7efd-0ab6-4501-b3df-580a0edf93e8 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:14.252151 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee6c7efd-0ab6-4501-b3df-580a0edf93e8 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:14.256040 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee6c7efd-0ab6-4501-b3df-580a0edf93e8 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:14.257099 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee6c7efd-0ab6-4501-b3df-580a0edf93e8 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:14.260206 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee6c7efd-0ab6-4501-b3df-580a0edf93e8 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:14.260979 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee6c7efd-0ab6-4501-b3df-580a0edf93e8 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:14.346819 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee6c7efd-0ab6-4501-b3df-580a0edf93e8 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:14.349487 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee6c7efd-0ab6-4501-b3df-580a0edf93e8 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:14.350417 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee6c7efd-0ab6-4501-b3df-580a0edf93e8 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:14.350968 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-ee6c7efd-0ab6-4501-b3df-580a0edf93e8 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lazy-loading 'fault' on Instance uuid 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:14:14.449509 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ee6c7efd-0ab6-4501-b3df-580a0edf93e8 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d08a2479f847b4b06d6690f1aedb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a06211ba44e4f6d88f9095969001aab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:14.461544 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ee6c7efd-0ab6-4501-b3df-580a0edf93e8 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31" status: 200 len: 1353 microversion: 2.1 time: 0.240276 Aug 07 01:14:14.462152 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 457/1041] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:14 2022] GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 => generated 1353 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:14.489177 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6507a3bd-6726-4138-ad54-c69f010a058e tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Calling method '.version_select at 0x7f9e248c6550>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:14.590340 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2756f361-e6ae-4c1b-a325-b410d9eacd72 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714" status: 200 len: 1620 microversion: 2.1 time: 0.443638 Aug 07 01:14:14.605400 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 585/1042] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:14 2022] GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714 => generated 1620 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:14.621090 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ccb79cef-9296-4126-a6e0-a42421de1b7b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:14.621724 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ccb79cef-9296-4126-a6e0-a42421de1b7b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 1e845e5c-f730-47a0-a5a9-8e0666de0d10] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:14.647382 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ccb79cef-9296-4126-a6e0-a42421de1b7b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:14.648349 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ccb79cef-9296-4126-a6e0-a42421de1b7b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:14.648797 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ccb79cef-9296-4126-a6e0-a42421de1b7b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:14.649892 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ccb79cef-9296-4126-a6e0-a42421de1b7b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:14.650677 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ccb79cef-9296-4126-a6e0-a42421de1b7b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:14.651380 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ccb79cef-9296-4126-a6e0-a42421de1b7b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:14.931749 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6507a3bd-6726-4138-ad54-c69f010a058e tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/eb6f0b23-8daf-4e17-bf8a-69efd1db31d5" status: 202 len: 0 microversion: 2.1 time: 0.450098 Aug 07 01:14:14.933590 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 458/1043] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:14:14 2022] DELETE /compute/v2.1/os-security-groups/eb6f0b23-8daf-4e17-bf8a-69efd1db31d5 => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:14:14.940133 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-aaf1a374-1784-4936-a17d-1d70970a9a88 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:14.941077 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-aaf1a374-1784-4936-a17d-1d70970a9a88 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] [instance: fb8bf657-63c6-4cea-8571-e9449c5ee529] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:14.960428 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aaf1a374-1784-4936-a17d-1d70970a9a88 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:14.961205 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aaf1a374-1784-4936-a17d-1d70970a9a88 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:14.961876 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aaf1a374-1784-4936-a17d-1d70970a9a88 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:14.962814 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aaf1a374-1784-4936-a17d-1d70970a9a88 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:14.963451 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aaf1a374-1784-4936-a17d-1d70970a9a88 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:14.964768 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aaf1a374-1784-4936-a17d-1d70970a9a88 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:15.123593 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ccb79cef-9296-4126-a6e0-a42421de1b7b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:15.132392 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ccb79cef-9296-4126-a6e0-a42421de1b7b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10" status: 200 len: 1314 microversion: 2.1 time: 0.517219 Aug 07 01:14:15.133598 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 586/1044] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:14 2022] GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10 => generated 1314 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:15.139109 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ab5a5612-632e-422c-b521-9c05ab4d801b tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Calling method '.version_select at 0x7f9e245f30d0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:15.179358 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-aaf1a374-1784-4936-a17d-1d70970a9a88 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/fb8bf657-63c6-4cea-8571-e9449c5ee529" status: 200 len: 1619 microversion: 2.1 time: 0.243907 Aug 07 01:14:15.180489 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 459/1045] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:14 2022] GET /compute/v2.1/servers/fb8bf657-63c6-4cea-8571-e9449c5ee529 => generated 1619 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:15.185650 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2d7585f8-323f-450f-998b-1e4aebd9de50 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:15.186809 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2d7585f8-323f-450f-998b-1e4aebd9de50 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:15.195531 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d7585f8-323f-450f-998b-1e4aebd9de50 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:15.196462 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d7585f8-323f-450f-998b-1e4aebd9de50 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:15.197341 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d7585f8-323f-450f-998b-1e4aebd9de50 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:15.198418 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d7585f8-323f-450f-998b-1e4aebd9de50 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:15.199214 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d7585f8-323f-450f-998b-1e4aebd9de50 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:15.199877 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d7585f8-323f-450f-998b-1e4aebd9de50 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:15.498881 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2d7585f8-323f-450f-998b-1e4aebd9de50 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:15.527088 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2d7585f8-323f-450f-998b-1e4aebd9de50 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1476 microversion: 2.1 time: 0.341189 Aug 07 01:14:15.532800 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 460/1046] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:15 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1476 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:15.552390 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c07d7a5f-8f64-49b3-a22b-1c6fc4703af7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Action: 'create', calling method: .version_select at 0x7f9e24e80f70>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-761817200", "policies": ["anti-affinity"]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:15.583496 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ab5a5612-632e-422c-b521-9c05ab4d801b tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/5a7f5e6d-d92f-4342-b781-6d831e627e60" status: 202 len: 0 microversion: 2.1 time: 0.448472 Aug 07 01:14:15.584114 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 587/1047] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:14:15 2022] DELETE /compute/v2.1/os-security-groups/5a7f5e6d-d92f-4342-b781-6d831e627e60 => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:14:15.592701 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bf97c04e-1735-463a-9c79-a94fad51fa26 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:15.593607 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bf97c04e-1735-463a-9c79-a94fad51fa26 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:15.603818 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bf97c04e-1735-463a-9c79-a94fad51fa26 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:15.605599 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bf97c04e-1735-463a-9c79-a94fad51fa26 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:15.606624 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bf97c04e-1735-463a-9c79-a94fad51fa26 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:15.608003 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bf97c04e-1735-463a-9c79-a94fad51fa26 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:15.608658 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bf97c04e-1735-463a-9c79-a94fad51fa26 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:15.609253 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bf97c04e-1735-463a-9c79-a94fad51fa26 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:15.617407 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-c07d7a5f-8f64-49b3-a22b-1c6fc4703af7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Getting quotas for project d08d010c14a64f759887be0d2364c6e4. Resources: {'server_groups'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:14:15.630648 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-bf97c04e-1735-463a-9c79-a94fad51fa26 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] HTTP exception thrown: Instance 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 could not be found. Aug 07 01:14:15.632769 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bf97c04e-1735-463a-9c79-a94fad51fa26 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Request method failure captured: Aug 07 01:14:15.632769 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 HTTP/1.1 Aug 07 01:14:15.632769 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:14:15.632769 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:14:15.632769 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:14:15.632769 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:14:15.632769 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:14:15.632769 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:14:15.632769 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:14:15.632769 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:14:15.632769 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xEpT49AnTEZTP22SzRg0k1shKJo7mbhzQDrtQMgrEBZI_WVbqYmRv_cL4CpF54TRJO1DSQEprDUozPQKWTRWiZB2iV-XIA04z0Fj3kUISEpGBXa_ey51En9oEhAiTMkDCxba2eqk3rTscm7N9cI16hD9JzI48wBQfsHdo4ViybbiVw Aug 07 01:14:15.632769 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:14:15.632769 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:14:15.632769 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:14:15.632769 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:14:15.632769 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:14:15.632769 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:14:15.632769 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 6a06211ba44e4f6d88f9095969001aab Aug 07 01:14:15.632769 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1511266234 Aug 07 01:14:15.632769 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:14:15.632769 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:14:15.634129 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6a06211ba44e4f6d88f9095969001aab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6a06211ba44e4f6d88f9095969001aab", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6a06211ba44e4f6d88f9095969001aab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6a06211ba44e4f6d88f9095969001aab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:14:15.634129 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1511266234 Aug 07 01:14:15.634129 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 6a06211ba44e4f6d88f9095969001aab Aug 07 01:14:15.634129 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1511266234 Aug 07 01:14:15.634129 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1511266234-project Aug 07 01:14:15.634129 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:14:15.634129 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:14:15.634129 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 96d08a2479f847b4b06d6690f1aedb18 Aug 07 01:14:15.634129 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1511266234-project Aug 07 01:14:15.634129 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:14:15.634129 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 could not be found. Aug 07 01:14:15.634129 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '81ae2aca-ae4d-4dc3-8c29-4da2460bcc31'} Aug 07 01:14:15.634922 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:14:15.634922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:15.634922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:14:15.634922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:14:15.634922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:14:15.634922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:14:15.634922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:14:15.634922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:14:15.634922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:14:15.634922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:14:15.634922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 could not be found. Aug 07 01:14:15.634922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:15.634922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:15.634922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:15.634922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:15.634922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:15.634922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:15.634922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:14:15.634922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:14:15.634922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:14:15.636772 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:14:15.636772 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:14:15.636772 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:14:15.636772 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:14:15.636772 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:14:15.636772 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:14:15.636772 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:14:15.636772 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 could not be found. Aug 07 01:14:15.636772 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:15.636772 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:15.636772 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:15.636772 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:15.636772 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:15.636772 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:15.636772 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:14:15.636772 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:14:15.636772 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 could not be found. Aug 07 01:14:15.636772 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:15.637874 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-c07d7a5f-8f64-49b3-a22b-1c6fc4703af7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Getting quotas for user 32fc1959d8aa41eabcead217b9d7bc47 and project d08d010c14a64f759887be0d2364c6e4. Resources: {'server_groups'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:14:15.639571 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bf97c04e-1735-463a-9c79-a94fad51fa26 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Returning 404 to user: Instance 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:14:15.640694 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bf97c04e-1735-463a-9c79-a94fad51fa26 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31" status: 404 len: 111 microversion: 2.1 time: 0.052190 Aug 07 01:14:15.641794 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 588/1048] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:15 2022] GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:14:15.649919 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e51288f5-4a62-4c1c-a6de-42a4c8de6346 tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] Calling method '.version_select at 0x7f9e245f3310>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:15.753677 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-c07d7a5f-8f64-49b3-a22b-1c6fc4703af7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Getting quotas for project d08d010c14a64f759887be0d2364c6e4. Resources: {'server_groups'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:14:15.765391 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-c07d7a5f-8f64-49b3-a22b-1c6fc4703af7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Getting quotas for user 32fc1959d8aa41eabcead217b9d7bc47 and project d08d010c14a64f759887be0d2364c6e4. Resources: {'server_groups'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:14:15.776928 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:15.781787 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c07d7a5f-8f64-49b3-a22b-1c6fc4703af7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.245877 Aug 07 01:14:15.782400 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 461/1049] 10.222.0.39 () {60 vars in 1174 bytes} [Sun Aug 7 01:14:15 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:14:15.787757 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e70b24e5-f4b1-4fd0-a463-230ae42a2972 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:15.788289 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e70b24e5-f4b1-4fd0-a463-230ae42a2972 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 7ab29f8e-4b84-4038-a60f-efc93d0358ce] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:15.795025 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e70b24e5-f4b1-4fd0-a463-230ae42a2972 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:15.795496 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e70b24e5-f4b1-4fd0-a463-230ae42a2972 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:15.795968 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e70b24e5-f4b1-4fd0-a463-230ae42a2972 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:15.796734 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e70b24e5-f4b1-4fd0-a463-230ae42a2972 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:15.797164 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e70b24e5-f4b1-4fd0-a463-230ae42a2972 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:15.797605 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e70b24e5-f4b1-4fd0-a463-230ae42a2972 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:15.815324 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:15.817633 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-e70b24e5-f4b1-4fd0-a463-230ae42a2972 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] HTTP exception thrown: Instance 7ab29f8e-4b84-4038-a60f-efc93d0358ce could not be found. Aug 07 01:14:15.819456 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e70b24e5-f4b1-4fd0-a463-230ae42a2972 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Request method failure captured: Aug 07 01:14:15.819456 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/7ab29f8e-4b84-4038-a60f-efc93d0358ce HTTP/1.1 Aug 07 01:14:15.819456 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:14:15.819456 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:14:15.819456 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:14:15.819456 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:14:15.819456 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:14:15.819456 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:14:15.819456 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:14:15.819456 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:14:15.819456 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xEpT49AnTEZTP22SzRg0k1shKJo7mbhzQDrtQMgrEBZI_WVbqYmRv_cL4CpF54TRJO1DSQEprDUozPQKWTRWiZB2iV-XIA04z0Fj3kUISEpGBXa_ey51En9oEhAiTMkDCxba2eqk3rTscm7N9cI16hD9JzI48wBQfsHdo4ViybbiVw Aug 07 01:14:15.819456 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:14:15.819456 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:14:15.819456 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:14:15.819456 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:14:15.819456 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:14:15.819456 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:14:15.819456 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 6a06211ba44e4f6d88f9095969001aab Aug 07 01:14:15.819456 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1511266234 Aug 07 01:14:15.819456 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:14:15.819456 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:14:15.822808 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6a06211ba44e4f6d88f9095969001aab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6a06211ba44e4f6d88f9095969001aab", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6a06211ba44e4f6d88f9095969001aab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6a06211ba44e4f6d88f9095969001aab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:14:15.822808 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1511266234 Aug 07 01:14:15.822808 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 6a06211ba44e4f6d88f9095969001aab Aug 07 01:14:15.822808 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1511266234 Aug 07 01:14:15.822808 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1511266234-project Aug 07 01:14:15.822808 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:14:15.822808 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:14:15.822808 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 96d08a2479f847b4b06d6690f1aedb18 Aug 07 01:14:15.822808 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1511266234-project Aug 07 01:14:15.822808 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:14:15.822808 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 7ab29f8e-4b84-4038-a60f-efc93d0358ce could not be found. Aug 07 01:14:15.822808 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '7ab29f8e-4b84-4038-a60f-efc93d0358ce'} Aug 07 01:14:15.824813 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:14:15.824813 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:15.824813 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:14:15.824813 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:14:15.824813 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:14:15.824813 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:14:15.824813 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:14:15.824813 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:14:15.824813 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:14:15.824813 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:14:15.824813 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ab29f8e-4b84-4038-a60f-efc93d0358ce could not be found. Aug 07 01:14:15.824813 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:15.824813 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:15.824813 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:15.824813 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:15.824813 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:15.824813 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:15.824813 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:14:15.824813 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:14:15.824813 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:14:15.827124 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:14:15.827124 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:14:15.827124 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:14:15.827124 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:14:15.827124 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:14:15.827124 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:14:15.827124 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:14:15.827124 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:14:15.827124 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:14:15.827124 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ab29f8e-4b84-4038-a60f-efc93d0358ce could not be found. Aug 07 01:14:15.827124 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:15.827124 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:15.827124 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:15.827124 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:15.827124 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:15.827124 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:15.827124 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:14:15.827124 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:14:15.827124 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ab29f8e-4b84-4038-a60f-efc93d0358ce could not be found. Aug 07 01:14:15.827124 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:15.832403 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e70b24e5-f4b1-4fd0-a463-230ae42a2972 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Returning 404 to user: Instance 7ab29f8e-4b84-4038-a60f-efc93d0358ce could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:14:15.832403 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e70b24e5-f4b1-4fd0-a463-230ae42a2972 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7ab29f8e-4b84-4038-a60f-efc93d0358ce" status: 404 len: 111 microversion: 2.1 time: 0.037745 Aug 07 01:14:15.832403 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 462/1050] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:14:15 2022] DELETE /compute/v2.1/servers/7ab29f8e-4b84-4038-a60f-efc93d0358ce => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:14:15.833353 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-855987ea-5b98-43ed-ab63-11f9435aeb0e tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:15.834040 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-855987ea-5b98-43ed-ab63-11f9435aeb0e tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 7ab29f8e-4b84-4038-a60f-efc93d0358ce] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:15.856976 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-855987ea-5b98-43ed-ab63-11f9435aeb0e tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:15.861310 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-855987ea-5b98-43ed-ab63-11f9435aeb0e tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:15.861899 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-855987ea-5b98-43ed-ab63-11f9435aeb0e tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:15.862936 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-855987ea-5b98-43ed-ab63-11f9435aeb0e tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:15.863485 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-855987ea-5b98-43ed-ab63-11f9435aeb0e tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:15.864498 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-855987ea-5b98-43ed-ab63-11f9435aeb0e tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:15.906327 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-855987ea-5b98-43ed-ab63-11f9435aeb0e tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] HTTP exception thrown: Instance 7ab29f8e-4b84-4038-a60f-efc93d0358ce could not be found. Aug 07 01:14:15.910333 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-855987ea-5b98-43ed-ab63-11f9435aeb0e tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Request method failure captured: Aug 07 01:14:15.910333 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/7ab29f8e-4b84-4038-a60f-efc93d0358ce HTTP/1.1 Aug 07 01:14:15.910333 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:14:15.910333 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:14:15.910333 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:14:15.910333 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:14:15.910333 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:14:15.910333 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:14:15.910333 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:14:15.910333 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:14:15.910333 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xEpT49AnTEZTP22SzRg0k1shKJo7mbhzQDrtQMgrEBZI_WVbqYmRv_cL4CpF54TRJO1DSQEprDUozPQKWTRWiZB2iV-XIA04z0Fj3kUISEpGBXa_ey51En9oEhAiTMkDCxba2eqk3rTscm7N9cI16hD9JzI48wBQfsHdo4ViybbiVw Aug 07 01:14:15.910333 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:14:15.910333 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:14:15.910333 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:14:15.910333 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:14:15.910333 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:14:15.910333 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:14:15.910333 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 6a06211ba44e4f6d88f9095969001aab Aug 07 01:14:15.910333 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1511266234 Aug 07 01:14:15.910333 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:14:15.910333 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:14:15.912176 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6a06211ba44e4f6d88f9095969001aab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6a06211ba44e4f6d88f9095969001aab", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6a06211ba44e4f6d88f9095969001aab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6a06211ba44e4f6d88f9095969001aab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:14:15.912176 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1511266234 Aug 07 01:14:15.912176 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 6a06211ba44e4f6d88f9095969001aab Aug 07 01:14:15.912176 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1511266234 Aug 07 01:14:15.912176 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1511266234-project Aug 07 01:14:15.912176 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:14:15.912176 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:14:15.912176 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 96d08a2479f847b4b06d6690f1aedb18 Aug 07 01:14:15.912176 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1511266234-project Aug 07 01:14:15.912176 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:14:15.912176 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 7ab29f8e-4b84-4038-a60f-efc93d0358ce could not be found. Aug 07 01:14:15.912176 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '7ab29f8e-4b84-4038-a60f-efc93d0358ce'} Aug 07 01:14:15.913176 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:14:15.913176 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:15.913176 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:14:15.913176 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:14:15.913176 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:14:15.913176 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:14:15.913176 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:14:15.913176 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:14:15.913176 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:14:15.913176 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:14:15.913176 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ab29f8e-4b84-4038-a60f-efc93d0358ce could not be found. Aug 07 01:14:15.913176 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:15.913176 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:15.913176 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:15.913176 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:15.913176 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:15.913176 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:15.913176 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:14:15.913176 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:14:15.913176 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:14:15.917511 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:14:15.917511 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:14:15.917511 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:14:15.917511 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:14:15.917511 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:14:15.917511 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:14:15.917511 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:14:15.917511 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ab29f8e-4b84-4038-a60f-efc93d0358ce could not be found. Aug 07 01:14:15.917511 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:15.917511 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:15.917511 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:15.917511 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:15.917511 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:15.917511 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:15.917511 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:14:15.917511 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:14:15.917511 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ab29f8e-4b84-4038-a60f-efc93d0358ce could not be found. Aug 07 01:14:15.917511 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:14:15.924055 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-855987ea-5b98-43ed-ab63-11f9435aeb0e tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Returning 404 to user: Instance 7ab29f8e-4b84-4038-a60f-efc93d0358ce could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:14:15.924055 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-855987ea-5b98-43ed-ab63-11f9435aeb0e tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "GET /compute/v2.1/servers/7ab29f8e-4b84-4038-a60f-efc93d0358ce" status: 404 len: 111 microversion: 2.1 time: 0.089312 Aug 07 01:14:15.924055 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 463/1051] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:15 2022] GET /compute/v2.1/servers/7ab29f8e-4b84-4038-a60f-efc93d0358ce => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:14:15.937929 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-14c167f2-1951-440f-89e1-e399551464a6 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '.version_select at 0x7f9e24623940>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:15.991277 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-14c167f2-1951-440f-89e1-e399551464a6 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-151177983" status: 202 len: 0 microversion: 2.1 time: 0.064846 Aug 07 01:14:15.996770 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 464/1052] 10.222.0.39 () {58 vars in 1218 bytes} [Sun Aug 7 01:14:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-151177983 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:14:16.109333 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f670e605-fbfa-49a5-8447-151d443fe1c7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1458860629", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "f0c5c304-6e15-4031-b078-6cf8ea0f0c13"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:16.123418 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e51288f5-4a62-4c1c-a6de-42a4c8de6346 tempest-SecurityGroupRulesNegativeTestJSON-281651563 tempest-SecurityGroupRulesNegativeTestJSON-281651563-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/85f26678-a416-4170-9d03-22e2748bd362" status: 202 len: 0 microversion: 2.1 time: 0.479533 Aug 07 01:14:16.126722 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 589/1053] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:14:15 2022] DELETE /compute/v2.1/os-security-groups/85f26678-a416-4170-9d03-22e2748bd362 => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:14:16.179528 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9ab54c41-14a5-4faa-9238-48c64b85c7b2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:16.180982 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9ab54c41-14a5-4faa-9238-48c64b85c7b2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 1e845e5c-f730-47a0-a5a9-8e0666de0d10] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:16.199467 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9ab54c41-14a5-4faa-9238-48c64b85c7b2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:16.204326 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9ab54c41-14a5-4faa-9238-48c64b85c7b2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:16.206817 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9ab54c41-14a5-4faa-9238-48c64b85c7b2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:16.210746 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9ab54c41-14a5-4faa-9238-48c64b85c7b2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:16.213744 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9ab54c41-14a5-4faa-9238-48c64b85c7b2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:16.215066 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9ab54c41-14a5-4faa-9238-48c64b85c7b2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:16.219145 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-f670e605-fbfa-49a5-8447-151d443fe1c7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] validate_networks() for None {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:14:16.911376 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9ab54c41-14a5-4faa-9238-48c64b85c7b2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:16.918240 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-f670e605-fbfa-49a5-8447-151d443fe1c7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:14:16.919013 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-f670e605-fbfa-49a5-8447-151d443fe1c7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:14:16.919161 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-f670e605-fbfa-49a5-8447-151d443fe1c7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:14:16.919504 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-f670e605-fbfa-49a5-8447-151d443fe1c7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:14:16.921519 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-f670e605-fbfa-49a5-8447-151d443fe1c7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:14:16.923420 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9ab54c41-14a5-4faa-9238-48c64b85c7b2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10" status: 200 len: 1314 microversion: 2.1 time: 0.765494 Aug 07 01:14:16.924152 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 590/1054] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:16 2022] GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10 => generated 1314 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:16.929054 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4854118e-b3aa-4224-9d4b-e8fb0c021cb4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:16.935699 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4854118e-b3aa-4224-9d4b-e8fb0c021cb4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:16.953799 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4854118e-b3aa-4224-9d4b-e8fb0c021cb4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:16.957968 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4854118e-b3aa-4224-9d4b-e8fb0c021cb4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:16.958789 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4854118e-b3aa-4224-9d4b-e8fb0c021cb4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:16.960395 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4854118e-b3aa-4224-9d4b-e8fb0c021cb4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:16.961218 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4854118e-b3aa-4224-9d4b-e8fb0c021cb4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:16.963434 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4854118e-b3aa-4224-9d4b-e8fb0c021cb4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:16.979775 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f670e605-fbfa-49a5-8447-151d443fe1c7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:16.982603 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f670e605-fbfa-49a5-8447-151d443fe1c7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:16.983477 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f670e605-fbfa-49a5-8447-151d443fe1c7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:16.984606 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f670e605-fbfa-49a5-8447-151d443fe1c7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:16.991048 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f670e605-fbfa-49a5-8447-151d443fe1c7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:16.992110 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f670e605-fbfa-49a5-8447-151d443fe1c7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:17.045720 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-f670e605-fbfa-49a5-8447-151d443fe1c7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Getting quotas for project d08d010c14a64f759887be0d2364c6e4. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:14:17.066517 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-f670e605-fbfa-49a5-8447-151d443fe1c7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Getting quotas for user 32fc1959d8aa41eabcead217b9d7bc47 and project d08d010c14a64f759887be0d2364c6e4. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:14:17.087186 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f670e605-fbfa-49a5-8447-151d443fe1c7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Going to run 2 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:14:17.099775 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f670e605-fbfa-49a5-8447-151d443fe1c7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:14:17.192187 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-f670e605-fbfa-49a5-8447-151d443fe1c7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119517) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 07 01:14:17.237784 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-f670e605-fbfa-49a5-8447-151d443fe1c7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Getting quotas for project d08d010c14a64f759887be0d2364c6e4. Resources: {'server_group_members'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:14:17.256690 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-f670e605-fbfa-49a5-8447-151d443fe1c7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Getting quotas for user 32fc1959d8aa41eabcead217b9d7bc47 and project d08d010c14a64f759887be0d2364c6e4. Resources: {'server_group_members'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:14:17.353164 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-f670e605-fbfa-49a5-8447-151d443fe1c7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Getting quotas for project d08d010c14a64f759887be0d2364c6e4. Resources: {'server_group_members'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:14:17.368173 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-f670e605-fbfa-49a5-8447-151d443fe1c7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Getting quotas for user 32fc1959d8aa41eabcead217b9d7bc47 and project d08d010c14a64f759887be0d2364c6e4. Resources: {'server_group_members'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:14:17.407112 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f670e605-fbfa-49a5-8447-151d443fe1c7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: a95f871c-79e7-45bb-8f61-637cc588ee74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:14:17.502815 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-f670e605-fbfa-49a5-8447-151d443fe1c7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Getting quotas for project d08d010c14a64f759887be0d2364c6e4. Resources: {'server_group_members'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:14:17.509118 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-f670e605-fbfa-49a5-8447-151d443fe1c7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Getting quotas for user 32fc1959d8aa41eabcead217b9d7bc47 and project d08d010c14a64f759887be0d2364c6e4. Resources: {'server_group_members'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:14:17.569294 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-f670e605-fbfa-49a5-8447-151d443fe1c7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Getting quotas for project d08d010c14a64f759887be0d2364c6e4. Resources: {'server_group_members'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:14:17.578546 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-f670e605-fbfa-49a5-8447-151d443fe1c7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Getting quotas for user 32fc1959d8aa41eabcead217b9d7bc47 and project d08d010c14a64f759887be0d2364c6e4. Resources: {'server_group_members'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:14:17.643396 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f670e605-fbfa-49a5-8447-151d443fe1c7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.537634 Aug 07 01:14:17.648184 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 465/1055] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:14:16 2022] POST /compute/v2.1/servers => generated 32 bytes in 1542 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 07 01:14:17.660773 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-23523a3a-142c-48a7-8827-79e56b82a951 req-42b5276b-e2e0-45d2-84fe-ffedbb06852c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e845e5c-f730-47a0-a5a9-8e0666de0d10", "name": "network-vif-plugged", "status": "completed", "tag": "3ad18655-1a28-4922-a4bc-cdbb210261c4"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:17.663372 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4854118e-b3aa-4224-9d4b-e8fb0c021cb4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:17.677049 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4854118e-b3aa-4224-9d4b-e8fb0c021cb4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1476 microversion: 2.1 time: 0.750130 Aug 07 01:14:17.695042 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-23523a3a-142c-48a7-8827-79e56b82a951 req-42b5276b-e2e0-45d2-84fe-ffedbb06852c service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:17.695042 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-23523a3a-142c-48a7-8827-79e56b82a951 req-42b5276b-e2e0-45d2-84fe-ffedbb06852c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:17.695042 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-23523a3a-142c-48a7-8827-79e56b82a951 req-42b5276b-e2e0-45d2-84fe-ffedbb06852c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:17.697312 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 591/1056] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:16 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1476 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:17.709207 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6e6d5fab-0b84-430e-9d87-344fadc5ef5d tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:17.710292 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6e6d5fab-0b84-430e-9d87-344fadc5ef5d tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: 5777df19-f308-48d1-8f53-fdbf073a4ef2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:17.730940 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e6d5fab-0b84-430e-9d87-344fadc5ef5d tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:17.732086 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e6d5fab-0b84-430e-9d87-344fadc5ef5d tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:17.732804 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e6d5fab-0b84-430e-9d87-344fadc5ef5d tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:17.733890 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-23523a3a-142c-48a7-8827-79e56b82a951 req-42b5276b-e2e0-45d2-84fe-ffedbb06852c service nova] Creating event network-vif-plugged:3ad18655-1a28-4922-a4bc-cdbb210261c4 for instance 1e845e5c-f730-47a0-a5a9-8e0666de0d10 on n-h1-master-1 Aug 07 01:14:17.735264 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e6d5fab-0b84-430e-9d87-344fadc5ef5d tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:17.738509 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e6d5fab-0b84-430e-9d87-344fadc5ef5d tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:17.739327 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e6d5fab-0b84-430e-9d87-344fadc5ef5d tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:17.744336 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-23523a3a-142c-48a7-8827-79e56b82a951 req-42b5276b-e2e0-45d2-84fe-ffedbb06852c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096490 Aug 07 01:14:17.750523 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 466/1057] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:14:17.757081 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e485ab83-160d-401e-b4f2-07a5f01f3473 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:17.764578 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e485ab83-160d-401e-b4f2-07a5f01f3473 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:17.765792 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e485ab83-160d-401e-b4f2-07a5f01f3473 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Searching by: {'deleted': False, 'project_id': 'd08d010c14a64f759887be0d2364c6e4'} {{(pid=119517) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:14:17.791017 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e485ab83-160d-401e-b4f2-07a5f01f3473 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:17.791788 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e485ab83-160d-401e-b4f2-07a5f01f3473 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:17.793093 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e485ab83-160d-401e-b4f2-07a5f01f3473 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:17.794106 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e485ab83-160d-401e-b4f2-07a5f01f3473 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:17.794597 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e485ab83-160d-401e-b4f2-07a5f01f3473 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:17.805992 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e485ab83-160d-401e-b4f2-07a5f01f3473 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:17.831864 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6e6d5fab-0b84-430e-9d87-344fadc5ef5d tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: 5777df19-f308-48d1-8f53-fdbf073a4ef2] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:14:17.897486 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.multi_cell_list [None req-e485ab83-160d-401e-b4f2-07a5f01f3473 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=119517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 01:14:17.943162 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e485ab83-160d-401e-b4f2-07a5f01f3473 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 1665 microversion: 2.1 time: 0.190870 Aug 07 01:14:17.944194 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 467/1058] 10.222.0.39 () {58 vars in 1125 bytes} [Sun Aug 7 01:14:17 2022] GET /compute/v2.1/servers => generated 1665 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:17.949911 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6ded74be-966a-421e-b1e7-1ac9c79380ac tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:17.950658 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6ded74be-966a-421e-b1e7-1ac9c79380ac tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 1e845e5c-f730-47a0-a5a9-8e0666de0d10] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:17.962805 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ded74be-966a-421e-b1e7-1ac9c79380ac tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:17.963372 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ded74be-966a-421e-b1e7-1ac9c79380ac tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:17.964211 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ded74be-966a-421e-b1e7-1ac9c79380ac tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:17.965680 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ded74be-966a-421e-b1e7-1ac9c79380ac tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:17.966232 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ded74be-966a-421e-b1e7-1ac9c79380ac tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:17.968345 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ded74be-966a-421e-b1e7-1ac9c79380ac tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:18.057011 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6e6d5fab-0b84-430e-9d87-344fadc5ef5d tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2" status: 204 len: 0 microversion: 2.1 time: 0.356345 Aug 07 01:14:18.060695 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 592/1059] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:14:17 2022] DELETE /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:14:18.083075 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-70edbe5f-05af-4cb2-8cdf-fac6de75e5f7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:18.086316 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-70edbe5f-05af-4cb2-8cdf-fac6de75e5f7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: a95f871c-79e7-45bb-8f61-637cc588ee74] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:18.220033 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-70edbe5f-05af-4cb2-8cdf-fac6de75e5f7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:18.229845 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-70edbe5f-05af-4cb2-8cdf-fac6de75e5f7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/a95f871c-79e7-45bb-8f61-637cc588ee74" status: 200 len: 1219 microversion: 2.1 time: 0.167513 Aug 07 01:14:18.251225 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 593/1060] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:18 2022] GET /compute/v2.1/servers/a95f871c-79e7-45bb-8f61-637cc588ee74 => generated 1219 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:18.263432 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-25b43b71-3879-49b3-af03-be030feb3884 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:18.264821 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-25b43b71-3879-49b3-af03-be030feb3884 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: 5777df19-f308-48d1-8f53-fdbf073a4ef2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:18.277913 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-25b43b71-3879-49b3-af03-be030feb3884 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:18.278804 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-25b43b71-3879-49b3-af03-be030feb3884 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:18.279586 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-25b43b71-3879-49b3-af03-be030feb3884 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:18.297687 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-25b43b71-3879-49b3-af03-be030feb3884 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:18.298710 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-25b43b71-3879-49b3-af03-be030feb3884 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:18.299476 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-25b43b71-3879-49b3-af03-be030feb3884 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:18.706779 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-25b43b71-3879-49b3-af03-be030feb3884 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dce42ff994d81b1ad6d6c05356c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6d319a0452448485aa65b7cf1c5b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:18.717871 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-25b43b71-3879-49b3-af03-be030feb3884 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2" status: 200 len: 1681 microversion: 2.1 time: 0.464590 Aug 07 01:14:18.719308 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 594/1061] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:18 2022] GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2 => generated 1681 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:18.726239 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9445b42e-dd60-45ef-a463-63dbd48601dd tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:18.727322 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9445b42e-dd60-45ef-a463-63dbd48601dd tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:18.735782 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9445b42e-dd60-45ef-a463-63dbd48601dd tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:18.736784 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9445b42e-dd60-45ef-a463-63dbd48601dd tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:18.737455 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9445b42e-dd60-45ef-a463-63dbd48601dd tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:18.738418 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9445b42e-dd60-45ef-a463-63dbd48601dd tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:18.739123 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9445b42e-dd60-45ef-a463-63dbd48601dd tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:18.740010 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9445b42e-dd60-45ef-a463-63dbd48601dd tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:18.942345 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6ded74be-966a-421e-b1e7-1ac9c79380ac tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:18.954890 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6ded74be-966a-421e-b1e7-1ac9c79380ac tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10" status: 200 len: 1314 microversion: 2.1 time: 1.009866 Aug 07 01:14:18.958071 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 468/1062] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:17 2022] GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10 => generated 1314 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:19.014960 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e415a668-911a-4a2e-b319-b2cc6eb7b494 tempest-ServersWithSpecificFlavorTestJSON-1728416995 tempest-ServersWithSpecificFlavorTestJSON-1728416995-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:19.021473 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:14:19.021473 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:14:19.064456 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e415a668-911a-4a2e-b319-b2cc6eb7b494 tempest-ServersWithSpecificFlavorTestJSON-1728416995 tempest-ServersWithSpecificFlavorTestJSON-1728416995-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1498852823" status: 202 len: 0 microversion: 2.1 time: 0.057872 Aug 07 01:14:19.065500 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 469/1063] 10.222.0.39 () {58 vars in 1161 bytes} [Sun Aug 7 01:14:19 2022] DELETE /compute/v2.1/flavors/1498852823 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:14:19.076214 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-22d440e9-5417-471f-92ff-322271e544ca tempest-ServersWithSpecificFlavorTestJSON-1728416995 tempest-ServersWithSpecificFlavorTestJSON-1728416995-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:19.152403 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-22d440e9-5417-471f-92ff-322271e544ca tempest-ServersWithSpecificFlavorTestJSON-1728416995 tempest-ServersWithSpecificFlavorTestJSON-1728416995-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5404 microversion: 2.1 time: 0.079602 Aug 07 01:14:19.153911 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 470/1064] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:14:19 2022] GET /compute/v2.1/flavors/detail => generated 5404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:14:19.191796 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ad651ae2-9499-4d90-934f-482ab4426852 tempest-ServersWithSpecificFlavorTestJSON-1728416995 tempest-ServersWithSpecificFlavorTestJSON-1728416995-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:19.202482 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9445b42e-dd60-45ef-a463-63dbd48601dd tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:19.239518 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=6,nova_api:INSERT=8 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:19.241972 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9445b42e-dd60-45ef-a463-63dbd48601dd tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1476 microversion: 2.1 time: 0.520819 Aug 07 01:14:19.246397 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ad651ae2-9499-4d90-934f-482ab4426852 tempest-ServersWithSpecificFlavorTestJSON-1728416995 tempest-ServersWithSpecificFlavorTestJSON-1728416995-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1028827470" status: 202 len: 0 microversion: 2.1 time: 0.073798 Aug 07 01:14:19.249941 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 471/1065] 10.222.0.39 () {58 vars in 1161 bytes} [Sun Aug 7 01:14:19 2022] DELETE /compute/v2.1/flavors/1028827470 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:14:19.262206 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e8aa8248-6aa4-4c6b-b243-fbac6319d9a7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:19.263698 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 595/1066] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:18 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1476 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:19.267481 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e8aa8248-6aa4-4c6b-b243-fbac6319d9a7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: a95f871c-79e7-45bb-8f61-637cc588ee74] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:19.272506 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-79c31aa3-9d23-4374-8005-2d4b20b77cc0 tempest-ServersWithSpecificFlavorTestJSON-1728416995 tempest-ServersWithSpecificFlavorTestJSON-1728416995-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:19.289281 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e8aa8248-6aa4-4c6b-b243-fbac6319d9a7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:19.291917 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e8aa8248-6aa4-4c6b-b243-fbac6319d9a7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:19.292485 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e8aa8248-6aa4-4c6b-b243-fbac6319d9a7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:19.293335 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e8aa8248-6aa4-4c6b-b243-fbac6319d9a7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:19.295955 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e8aa8248-6aa4-4c6b-b243-fbac6319d9a7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:19.296596 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e8aa8248-6aa4-4c6b-b243-fbac6319d9a7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:19.318075 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-79c31aa3-9d23-4374-8005-2d4b20b77cc0 tempest-ServersWithSpecificFlavorTestJSON-1728416995 tempest-ServersWithSpecificFlavorTestJSON-1728416995-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052795 Aug 07 01:14:19.332208 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 596/1067] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:14:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:19.356833 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e86e3e6f-76a6-4b1a-982e-ecefa5a7aa19 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:19.357354 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e86e3e6f-76a6-4b1a-982e-ecefa5a7aa19 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:19.367367 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e86e3e6f-76a6-4b1a-982e-ecefa5a7aa19 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:19.368615 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e86e3e6f-76a6-4b1a-982e-ecefa5a7aa19 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:19.369171 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e86e3e6f-76a6-4b1a-982e-ecefa5a7aa19 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:19.369985 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e86e3e6f-76a6-4b1a-982e-ecefa5a7aa19 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:19.370461 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e86e3e6f-76a6-4b1a-982e-ecefa5a7aa19 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:19.370897 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e86e3e6f-76a6-4b1a-982e-ecefa5a7aa19 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:19.391848 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-e86e3e6f-76a6-4b1a-982e-ecefa5a7aa19 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] HTTP exception thrown: Instance 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 could not be found. Aug 07 01:14:19.394392 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e86e3e6f-76a6-4b1a-982e-ecefa5a7aa19 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Request method failure captured: Aug 07 01:14:19.394392 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 HTTP/1.1 Aug 07 01:14:19.394392 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:14:19.394392 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:14:19.394392 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:14:19.394392 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:14:19.394392 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:14:19.394392 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:14:19.394392 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:14:19.394392 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:14:19.394392 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xEpT49AnTEZTP22SzRg0k1shKJo7mbhzQDrtQMgrEBZI_WVbqYmRv_cL4CpF54TRJO1DSQEprDUozPQKWTRWiZB2iV-XIA04z0Fj3kUISEpGBXa_ey51En9oEhAiTMkDCxba2eqk3rTscm7N9cI16hD9JzI48wBQfsHdo4ViybbiVw Aug 07 01:14:19.394392 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:14:19.394392 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:14:19.394392 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:14:19.394392 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:14:19.394392 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:14:19.394392 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:14:19.394392 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 6a06211ba44e4f6d88f9095969001aab Aug 07 01:14:19.394392 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1511266234 Aug 07 01:14:19.394392 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:14:19.394392 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:14:19.395976 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6a06211ba44e4f6d88f9095969001aab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6a06211ba44e4f6d88f9095969001aab", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6a06211ba44e4f6d88f9095969001aab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6a06211ba44e4f6d88f9095969001aab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:14:19.395976 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1511266234 Aug 07 01:14:19.395976 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 6a06211ba44e4f6d88f9095969001aab Aug 07 01:14:19.395976 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1511266234 Aug 07 01:14:19.395976 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1511266234-project Aug 07 01:14:19.395976 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:14:19.395976 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:14:19.395976 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 96d08a2479f847b4b06d6690f1aedb18 Aug 07 01:14:19.395976 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1511266234-project Aug 07 01:14:19.395976 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:14:19.395976 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 could not be found. Aug 07 01:14:19.395976 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '81ae2aca-ae4d-4dc3-8c29-4da2460bcc31'} Aug 07 01:14:19.396973 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:14:19.396973 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:19.396973 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:14:19.396973 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:14:19.396973 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:14:19.396973 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:14:19.396973 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:14:19.396973 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:14:19.396973 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:14:19.396973 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:14:19.396973 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 could not be found. Aug 07 01:14:19.396973 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:19.396973 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:19.396973 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:19.396973 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:19.396973 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:19.396973 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:19.396973 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:14:19.396973 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:14:19.396973 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:14:19.398351 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:14:19.398351 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:14:19.398351 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:14:19.398351 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:14:19.398351 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:14:19.398351 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:14:19.398351 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:14:19.398351 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:14:19.398351 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:14:19.398351 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 could not be found. Aug 07 01:14:19.398351 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:19.398351 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:19.398351 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:19.398351 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:19.398351 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:19.398351 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:19.398351 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:14:19.398351 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:14:19.398351 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 could not be found. Aug 07 01:14:19.398351 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:19.401822 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e86e3e6f-76a6-4b1a-982e-ecefa5a7aa19 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Returning 404 to user: Instance 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:14:19.406217 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e86e3e6f-76a6-4b1a-982e-ecefa5a7aa19 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "DELETE /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31" status: 404 len: 111 microversion: 2.1 time: 0.055818 Aug 07 01:14:19.414905 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 597/1068] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:14:19 2022] DELETE /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:14:19.422349 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-42574dfc-6da4-45ad-bba7-eea859908f28 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:19.424413 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-42574dfc-6da4-45ad-bba7-eea859908f28 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:19.433038 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42574dfc-6da4-45ad-bba7-eea859908f28 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:19.434200 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42574dfc-6da4-45ad-bba7-eea859908f28 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:19.435161 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42574dfc-6da4-45ad-bba7-eea859908f28 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:19.436309 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42574dfc-6da4-45ad-bba7-eea859908f28 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:19.436960 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42574dfc-6da4-45ad-bba7-eea859908f28 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:19.437645 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42574dfc-6da4-45ad-bba7-eea859908f28 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:19.458555 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-42574dfc-6da4-45ad-bba7-eea859908f28 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] HTTP exception thrown: Instance 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 could not be found. Aug 07 01:14:19.460915 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-42574dfc-6da4-45ad-bba7-eea859908f28 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Request method failure captured: Aug 07 01:14:19.460915 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 HTTP/1.1 Aug 07 01:14:19.460915 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:14:19.460915 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:14:19.460915 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:14:19.460915 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:14:19.460915 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:14:19.460915 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:14:19.460915 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:14:19.460915 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:14:19.460915 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xEpT49AnTEZTP22SzRg0k1shKJo7mbhzQDrtQMgrEBZI_WVbqYmRv_cL4CpF54TRJO1DSQEprDUozPQKWTRWiZB2iV-XIA04z0Fj3kUISEpGBXa_ey51En9oEhAiTMkDCxba2eqk3rTscm7N9cI16hD9JzI48wBQfsHdo4ViybbiVw Aug 07 01:14:19.460915 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:14:19.460915 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:14:19.460915 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:14:19.460915 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:14:19.460915 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:14:19.460915 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:14:19.460915 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 6a06211ba44e4f6d88f9095969001aab Aug 07 01:14:19.460915 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1511266234 Aug 07 01:14:19.460915 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:14:19.460915 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:14:19.462759 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6a06211ba44e4f6d88f9095969001aab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6a06211ba44e4f6d88f9095969001aab", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6a06211ba44e4f6d88f9095969001aab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6a06211ba44e4f6d88f9095969001aab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:14:19.462759 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1511266234 Aug 07 01:14:19.462759 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 6a06211ba44e4f6d88f9095969001aab Aug 07 01:14:19.462759 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1511266234 Aug 07 01:14:19.462759 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1511266234-project Aug 07 01:14:19.462759 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:14:19.462759 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:14:19.462759 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 96d08a2479f847b4b06d6690f1aedb18 Aug 07 01:14:19.462759 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1511266234-project Aug 07 01:14:19.462759 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:14:19.462759 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 could not be found. Aug 07 01:14:19.462759 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '81ae2aca-ae4d-4dc3-8c29-4da2460bcc31'} Aug 07 01:14:19.464416 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:14:19.464416 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:19.464416 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:14:19.464416 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:14:19.464416 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:14:19.464416 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:14:19.464416 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:14:19.464416 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:14:19.464416 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:14:19.464416 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:14:19.464416 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 could not be found. Aug 07 01:14:19.464416 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:19.464416 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:19.464416 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:19.464416 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:19.464416 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:19.464416 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:19.464416 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:14:19.464416 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:14:19.464416 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:14:19.466756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:14:19.466756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:14:19.466756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:14:19.466756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:14:19.466756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:14:19.466756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:14:19.466756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:14:19.466756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 could not be found. Aug 07 01:14:19.466756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:19.466756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:19.466756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:19.466756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:19.466756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:19.466756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:19.466756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:14:19.466756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:14:19.466756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 could not be found. Aug 07 01:14:19.466756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:19.472009 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-42574dfc-6da4-45ad-bba7-eea859908f28 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Returning 404 to user: Instance 81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:14:19.473156 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-42574dfc-6da4-45ad-bba7-eea859908f28 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31" status: 404 len: 111 microversion: 2.1 time: 0.056915 Aug 07 01:14:19.475972 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 598/1069] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:19 2022] GET /compute/v2.1/servers/81ae2aca-ae4d-4dc3-8c29-4da2460bcc31 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:14:19.483951 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-97d0ac30-3cfc-4999-aa4d-d6600f792c89 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:19.485047 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-97d0ac30-3cfc-4999-aa4d-d6600f792c89 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 7ab29f8e-4b84-4038-a60f-efc93d0358ce] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:19.490989 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:19.505796 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-97d0ac30-3cfc-4999-aa4d-d6600f792c89 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:19.506657 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-97d0ac30-3cfc-4999-aa4d-d6600f792c89 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:19.507490 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-97d0ac30-3cfc-4999-aa4d-d6600f792c89 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:19.509432 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-97d0ac30-3cfc-4999-aa4d-d6600f792c89 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:19.510234 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-97d0ac30-3cfc-4999-aa4d-d6600f792c89 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:19.511526 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-97d0ac30-3cfc-4999-aa4d-d6600f792c89 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:19.540552 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-97d0ac30-3cfc-4999-aa4d-d6600f792c89 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] HTTP exception thrown: Instance 7ab29f8e-4b84-4038-a60f-efc93d0358ce could not be found. Aug 07 01:14:19.547379 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-97d0ac30-3cfc-4999-aa4d-d6600f792c89 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Request method failure captured: Aug 07 01:14:19.547379 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/servers/7ab29f8e-4b84-4038-a60f-efc93d0358ce HTTP/1.1 Aug 07 01:14:19.547379 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:14:19.547379 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:14:19.547379 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:14:19.547379 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:14:19.547379 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:14:19.547379 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:14:19.547379 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:14:19.547379 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:14:19.547379 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xEpT49AnTEZTP22SzRg0k1shKJo7mbhzQDrtQMgrEBZI_WVbqYmRv_cL4CpF54TRJO1DSQEprDUozPQKWTRWiZB2iV-XIA04z0Fj3kUISEpGBXa_ey51En9oEhAiTMkDCxba2eqk3rTscm7N9cI16hD9JzI48wBQfsHdo4ViybbiVw Aug 07 01:14:19.547379 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:14:19.547379 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:14:19.547379 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:14:19.547379 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:14:19.547379 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:14:19.547379 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:14:19.547379 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 6a06211ba44e4f6d88f9095969001aab Aug 07 01:14:19.547379 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1511266234 Aug 07 01:14:19.547379 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:14:19.547379 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:14:19.550202 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6a06211ba44e4f6d88f9095969001aab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6a06211ba44e4f6d88f9095969001aab", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6a06211ba44e4f6d88f9095969001aab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6a06211ba44e4f6d88f9095969001aab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:14:19.550202 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1511266234 Aug 07 01:14:19.550202 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 6a06211ba44e4f6d88f9095969001aab Aug 07 01:14:19.550202 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1511266234 Aug 07 01:14:19.550202 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1511266234-project Aug 07 01:14:19.550202 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:14:19.550202 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:14:19.550202 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 96d08a2479f847b4b06d6690f1aedb18 Aug 07 01:14:19.550202 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1511266234-project Aug 07 01:14:19.550202 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:14:19.550202 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 7ab29f8e-4b84-4038-a60f-efc93d0358ce could not be found. Aug 07 01:14:19.550202 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '7ab29f8e-4b84-4038-a60f-efc93d0358ce'} Aug 07 01:14:19.551634 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:14:19.551634 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:19.551634 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:14:19.551634 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:14:19.551634 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:14:19.551634 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:14:19.551634 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:14:19.551634 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:14:19.551634 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:14:19.551634 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:14:19.551634 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ab29f8e-4b84-4038-a60f-efc93d0358ce could not be found. Aug 07 01:14:19.551634 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:19.551634 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:19.551634 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:19.551634 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:19.551634 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:19.551634 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:19.551634 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:14:19.551634 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:14:19.551634 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:14:19.553992 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:14:19.553992 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:14:19.553992 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:14:19.553992 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:14:19.553992 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:14:19.553992 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:14:19.553992 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:14:19.553992 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:14:19.553992 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:14:19.553992 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ab29f8e-4b84-4038-a60f-efc93d0358ce could not be found. Aug 07 01:14:19.553992 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:19.553992 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:19.553992 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:19.553992 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:19.553992 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:19.553992 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:19.553992 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:14:19.553992 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:14:19.553992 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ab29f8e-4b84-4038-a60f-efc93d0358ce could not be found. Aug 07 01:14:19.553992 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:19.563203 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-97d0ac30-3cfc-4999-aa4d-d6600f792c89 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Returning 404 to user: Instance 7ab29f8e-4b84-4038-a60f-efc93d0358ce could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:14:19.566919 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e8aa8248-6aa4-4c6b-b243-fbac6319d9a7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:19.567239 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-97d0ac30-3cfc-4999-aa4d-d6600f792c89 tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7ab29f8e-4b84-4038-a60f-efc93d0358ce" status: 404 len: 111 microversion: 2.1 time: 0.071132 Aug 07 01:14:19.567239 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 599/1070] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:14:19 2022] DELETE /compute/v2.1/servers/7ab29f8e-4b84-4038-a60f-efc93d0358ce => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:14:19.567739 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e8aa8248-6aa4-4c6b-b243-fbac6319d9a7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/a95f871c-79e7-45bb-8f61-637cc588ee74" status: 200 len: 1223 microversion: 2.1 time: 0.312078 Aug 07 01:14:19.572841 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dd3b6115-6192-47a6-af76-713e40d42dbc tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:19.574091 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-dd3b6115-6192-47a6-af76-713e40d42dbc tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] [instance: 7ab29f8e-4b84-4038-a60f-efc93d0358ce] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:19.585071 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd3b6115-6192-47a6-af76-713e40d42dbc tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:19.585768 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd3b6115-6192-47a6-af76-713e40d42dbc tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:19.586262 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd3b6115-6192-47a6-af76-713e40d42dbc tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:19.587069 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd3b6115-6192-47a6-af76-713e40d42dbc tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:19.587515 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 472/1071] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:19 2022] GET /compute/v2.1/servers/a95f871c-79e7-45bb-8f61-637cc588ee74 => generated 1223 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:19.587751 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd3b6115-6192-47a6-af76-713e40d42dbc tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:19.588293 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd3b6115-6192-47a6-af76-713e40d42dbc tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:19.609920 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-dd3b6115-6192-47a6-af76-713e40d42dbc tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] HTTP exception thrown: Instance 7ab29f8e-4b84-4038-a60f-efc93d0358ce could not be found. Aug 07 01:14:19.612284 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dd3b6115-6192-47a6-af76-713e40d42dbc tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Request method failure captured: Aug 07 01:14:19.612284 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/7ab29f8e-4b84-4038-a60f-efc93d0358ce HTTP/1.1 Aug 07 01:14:19.612284 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:14:19.612284 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:14:19.612284 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:14:19.612284 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:14:19.612284 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:14:19.612284 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:14:19.612284 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:14:19.612284 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:14:19.612284 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xEpT49AnTEZTP22SzRg0k1shKJo7mbhzQDrtQMgrEBZI_WVbqYmRv_cL4CpF54TRJO1DSQEprDUozPQKWTRWiZB2iV-XIA04z0Fj3kUISEpGBXa_ey51En9oEhAiTMkDCxba2eqk3rTscm7N9cI16hD9JzI48wBQfsHdo4ViybbiVw Aug 07 01:14:19.612284 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:14:19.612284 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:14:19.612284 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:14:19.612284 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:14:19.612284 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:14:19.612284 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:14:19.612284 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 6a06211ba44e4f6d88f9095969001aab Aug 07 01:14:19.612284 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1511266234 Aug 07 01:14:19.612284 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:14:19.612284 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:14:19.615147 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6a06211ba44e4f6d88f9095969001aab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6a06211ba44e4f6d88f9095969001aab", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6a06211ba44e4f6d88f9095969001aab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6a06211ba44e4f6d88f9095969001aab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:14:19.615147 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1511266234 Aug 07 01:14:19.615147 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 6a06211ba44e4f6d88f9095969001aab Aug 07 01:14:19.615147 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1511266234 Aug 07 01:14:19.615147 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1511266234-project Aug 07 01:14:19.615147 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:14:19.615147 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:14:19.615147 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 96d08a2479f847b4b06d6690f1aedb18 Aug 07 01:14:19.615147 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1511266234-project Aug 07 01:14:19.615147 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:14:19.615147 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 7ab29f8e-4b84-4038-a60f-efc93d0358ce could not be found. Aug 07 01:14:19.615147 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '7ab29f8e-4b84-4038-a60f-efc93d0358ce'} Aug 07 01:14:19.617967 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:14:19.617967 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:19.617967 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:14:19.617967 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:14:19.617967 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:14:19.617967 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:14:19.617967 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:14:19.617967 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:14:19.617967 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:14:19.617967 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:14:19.617967 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ab29f8e-4b84-4038-a60f-efc93d0358ce could not be found. Aug 07 01:14:19.617967 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:19.617967 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:19.617967 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:19.617967 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:19.617967 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:19.617967 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:19.617967 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:14:19.617967 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:14:19.617967 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:14:19.621579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:14:19.621579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:14:19.621579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:14:19.621579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:14:19.621579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:14:19.621579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:14:19.621579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:14:19.621579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ab29f8e-4b84-4038-a60f-efc93d0358ce could not be found. Aug 07 01:14:19.621579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:19.621579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:19.621579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:19.621579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:19.621579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:19.621579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:19.621579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:14:19.621579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:14:19.621579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ab29f8e-4b84-4038-a60f-efc93d0358ce could not be found. Aug 07 01:14:19.621579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:19.623681 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dd3b6115-6192-47a6-af76-713e40d42dbc tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] Returning 404 to user: Instance 7ab29f8e-4b84-4038-a60f-efc93d0358ce could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:14:19.623681 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-dd3b6115-6192-47a6-af76-713e40d42dbc tempest-ServersWithSpecificFlavorTestJSON-1511266234 tempest-ServersWithSpecificFlavorTestJSON-1511266234-project] 10.222.0.39 "GET /compute/v2.1/servers/7ab29f8e-4b84-4038-a60f-efc93d0358ce" status: 404 len: 111 microversion: 2.1 time: 0.051283 Aug 07 01:14:19.623681 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 600/1072] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:19 2022] GET /compute/v2.1/servers/7ab29f8e-4b84-4038-a60f-efc93d0358ce => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:14:19.748922 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-77741791-c8de-49fc-92ce-ca1e2708ad27 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:19.749947 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-77741791-c8de-49fc-92ce-ca1e2708ad27 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: 5777df19-f308-48d1-8f53-fdbf073a4ef2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:19.759363 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-77741791-c8de-49fc-92ce-ca1e2708ad27 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:19.761039 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-77741791-c8de-49fc-92ce-ca1e2708ad27 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:19.762132 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-77741791-c8de-49fc-92ce-ca1e2708ad27 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:19.763976 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-77741791-c8de-49fc-92ce-ca1e2708ad27 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:19.765023 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-77741791-c8de-49fc-92ce-ca1e2708ad27 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:19.765915 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-77741791-c8de-49fc-92ce-ca1e2708ad27 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:19.986328 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-caa28920-40cd-4319-92cc-a0bef45f9836 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:19.986991 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-caa28920-40cd-4319-92cc-a0bef45f9836 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 1e845e5c-f730-47a0-a5a9-8e0666de0d10] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:20.001095 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-caa28920-40cd-4319-92cc-a0bef45f9836 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:20.003318 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-caa28920-40cd-4319-92cc-a0bef45f9836 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:20.004179 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-caa28920-40cd-4319-92cc-a0bef45f9836 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:20.004938 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-caa28920-40cd-4319-92cc-a0bef45f9836 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:20.005604 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-caa28920-40cd-4319-92cc-a0bef45f9836 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:20.006869 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-caa28920-40cd-4319-92cc-a0bef45f9836 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:20.270640 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-77741791-c8de-49fc-92ce-ca1e2708ad27 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dce42ff994d81b1ad6d6c05356c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6d319a0452448485aa65b7cf1c5b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:20.298691 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-77741791-c8de-49fc-92ce-ca1e2708ad27 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2" status: 200 len: 1681 microversion: 2.1 time: 0.557091 Aug 07 01:14:20.299542 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 473/1073] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:19 2022] GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2 => generated 1681 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:14:20.316721 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c844a96a-0d29-4e33-a1e4-7785427b18e5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:20.317933 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c844a96a-0d29-4e33-a1e4-7785427b18e5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:20.330018 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c844a96a-0d29-4e33-a1e4-7785427b18e5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:20.332609 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c844a96a-0d29-4e33-a1e4-7785427b18e5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:20.334443 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c844a96a-0d29-4e33-a1e4-7785427b18e5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:20.338007 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c844a96a-0d29-4e33-a1e4-7785427b18e5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:20.339775 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c844a96a-0d29-4e33-a1e4-7785427b18e5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:20.340582 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c844a96a-0d29-4e33-a1e4-7785427b18e5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:20.460573 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-caa28920-40cd-4319-92cc-a0bef45f9836 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:20.478271 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-caa28920-40cd-4319-92cc-a0bef45f9836 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10" status: 200 len: 1314 microversion: 2.1 time: 0.495747 Aug 07 01:14:20.498802 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 601/1074] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:19 2022] GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10 => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:14:20.598134 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0507911b-8b27-4468-8591-803b471e29d6 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:20.598827 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0507911b-8b27-4468-8591-803b471e29d6 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: a95f871c-79e7-45bb-8f61-637cc588ee74] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:20.614759 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0507911b-8b27-4468-8591-803b471e29d6 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:20.616902 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0507911b-8b27-4468-8591-803b471e29d6 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:20.617977 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0507911b-8b27-4468-8591-803b471e29d6 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:20.621748 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0507911b-8b27-4468-8591-803b471e29d6 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:20.625711 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0507911b-8b27-4468-8591-803b471e29d6 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:20.626724 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0507911b-8b27-4468-8591-803b471e29d6 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:21.030408 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0507911b-8b27-4468-8591-803b471e29d6 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:21.055085 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0507911b-8b27-4468-8591-803b471e29d6 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/a95f871c-79e7-45bb-8f61-637cc588ee74" status: 200 len: 1289 microversion: 2.1 time: 0.460734 Aug 07 01:14:21.069653 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 602/1075] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:20 2022] GET /compute/v2.1/servers/a95f871c-79e7-45bb-8f61-637cc588ee74 => generated 1289 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:14:21.092196 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c844a96a-0d29-4e33-a1e4-7785427b18e5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:21.101105 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c844a96a-0d29-4e33-a1e4-7785427b18e5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1476 microversion: 2.1 time: 0.800133 Aug 07 01:14:21.116212 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 474/1076] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:20 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1476 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:21.356619 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c1989d38-6f4a-4345-89a4-bb8a4406a10d tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:21.360595 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c1989d38-6f4a-4345-89a4-bb8a4406a10d tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: 5777df19-f308-48d1-8f53-fdbf073a4ef2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:21.391486 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1989d38-6f4a-4345-89a4-bb8a4406a10d tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:21.394674 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1989d38-6f4a-4345-89a4-bb8a4406a10d tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:21.395512 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1989d38-6f4a-4345-89a4-bb8a4406a10d tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:21.396959 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1989d38-6f4a-4345-89a4-bb8a4406a10d tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:21.401370 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1989d38-6f4a-4345-89a4-bb8a4406a10d tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:21.403610 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1989d38-6f4a-4345-89a4-bb8a4406a10d tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:21.507116 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6a152796-2032-4447-9ad2-543c0db7f3dc tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:21.508082 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6a152796-2032-4447-9ad2-543c0db7f3dc tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 1e845e5c-f730-47a0-a5a9-8e0666de0d10] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:21.522146 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a152796-2032-4447-9ad2-543c0db7f3dc tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:21.525608 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a152796-2032-4447-9ad2-543c0db7f3dc tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:21.527313 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a152796-2032-4447-9ad2-543c0db7f3dc tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:21.528528 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a152796-2032-4447-9ad2-543c0db7f3dc tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:21.532368 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a152796-2032-4447-9ad2-543c0db7f3dc tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:21.533439 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a152796-2032-4447-9ad2-543c0db7f3dc tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:22.238868 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c1989d38-6f4a-4345-89a4-bb8a4406a10d tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dce42ff994d81b1ad6d6c05356c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6d319a0452448485aa65b7cf1c5b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:22.267604 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c1989d38-6f4a-4345-89a4-bb8a4406a10d tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2" status: 200 len: 1681 microversion: 2.1 time: 0.925178 Aug 07 01:14:22.270712 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 603/1077] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:21 2022] GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2 => generated 1681 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:22.303204 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a43f53b4-0f86-45b2-9f19-ef7775fafe3d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:22.304166 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a43f53b4-0f86-45b2-9f19-ef7775fafe3d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: a95f871c-79e7-45bb-8f61-637cc588ee74] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:22.312009 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a43f53b4-0f86-45b2-9f19-ef7775fafe3d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:22.313090 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a43f53b4-0f86-45b2-9f19-ef7775fafe3d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:22.313760 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a43f53b4-0f86-45b2-9f19-ef7775fafe3d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:22.314698 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a43f53b4-0f86-45b2-9f19-ef7775fafe3d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:22.315339 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a43f53b4-0f86-45b2-9f19-ef7775fafe3d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:22.316083 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a43f53b4-0f86-45b2-9f19-ef7775fafe3d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:22.378861 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:22.486723 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a43f53b4-0f86-45b2-9f19-ef7775fafe3d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:22.499414 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a43f53b4-0f86-45b2-9f19-ef7775fafe3d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/a95f871c-79e7-45bb-8f61-637cc588ee74" status: 200 len: 1277 microversion: 2.1 time: 0.225710 Aug 07 01:14:22.500438 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 604/1078] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:22 2022] GET /compute/v2.1/servers/a95f871c-79e7-45bb-8f61-637cc588ee74 => generated 1277 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:22.507262 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-289de055-d2a4-4dfc-97b9-fadd77e8f067 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:22.508201 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-289de055-d2a4-4dfc-97b9-fadd77e8f067 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:22.522385 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-289de055-d2a4-4dfc-97b9-fadd77e8f067 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:22.523402 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-289de055-d2a4-4dfc-97b9-fadd77e8f067 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:22.524185 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-289de055-d2a4-4dfc-97b9-fadd77e8f067 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:22.525170 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-289de055-d2a4-4dfc-97b9-fadd77e8f067 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:22.525886 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-289de055-d2a4-4dfc-97b9-fadd77e8f067 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:22.526829 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-289de055-d2a4-4dfc-97b9-fadd77e8f067 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:22.561026 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:22.583757 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6a152796-2032-4447-9ad2-543c0db7f3dc tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:22.593768 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6a152796-2032-4447-9ad2-543c0db7f3dc tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10" status: 200 len: 1314 microversion: 2.1 time: 1.090721 Aug 07 01:14:22.595210 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 475/1079] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:21 2022] GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10 => generated 1314 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:23.084536 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-289de055-d2a4-4dfc-97b9-fadd77e8f067 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:23.100517 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-289de055-d2a4-4dfc-97b9-fadd77e8f067 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1476 microversion: 2.1 time: 0.597891 Aug 07 01:14:23.101429 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 605/1080] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:22 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1476 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:23.295273 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2c30927c-124c-4a3a-b05b-93898c92afd3 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:23.296098 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2c30927c-124c-4a3a-b05b-93898c92afd3 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: 5777df19-f308-48d1-8f53-fdbf073a4ef2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:23.313450 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c30927c-124c-4a3a-b05b-93898c92afd3 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:23.314826 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c30927c-124c-4a3a-b05b-93898c92afd3 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:23.315862 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c30927c-124c-4a3a-b05b-93898c92afd3 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:23.357048 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c30927c-124c-4a3a-b05b-93898c92afd3 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:23.357537 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c30927c-124c-4a3a-b05b-93898c92afd3 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:23.357980 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c30927c-124c-4a3a-b05b-93898c92afd3 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:23.531575 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-84321a7a-12b6-4e11-9f43-4f92edf19f7e tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:23.532441 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-84321a7a-12b6-4e11-9f43-4f92edf19f7e tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: a95f871c-79e7-45bb-8f61-637cc588ee74] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:23.543646 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84321a7a-12b6-4e11-9f43-4f92edf19f7e tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:23.544919 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84321a7a-12b6-4e11-9f43-4f92edf19f7e tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:23.546207 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84321a7a-12b6-4e11-9f43-4f92edf19f7e tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:23.548438 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84321a7a-12b6-4e11-9f43-4f92edf19f7e tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:23.549496 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84321a7a-12b6-4e11-9f43-4f92edf19f7e tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:23.550303 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84321a7a-12b6-4e11-9f43-4f92edf19f7e tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:23.586292 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2c30927c-124c-4a3a-b05b-93898c92afd3 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dce42ff994d81b1ad6d6c05356c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6d319a0452448485aa65b7cf1c5b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:23.624663 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2c30927c-124c-4a3a-b05b-93898c92afd3 tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2" status: 200 len: 1614 microversion: 2.1 time: 0.334285 Aug 07 01:14:23.626236 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 476/1081] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:23 2022] GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2 => generated 1614 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:23.645202 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f47d7ae5-ca69-4894-a8df-5cacf292cf4b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:23.646948 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f47d7ae5-ca69-4894-a8df-5cacf292cf4b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 1e845e5c-f730-47a0-a5a9-8e0666de0d10] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:23.654524 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f47d7ae5-ca69-4894-a8df-5cacf292cf4b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:23.655182 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f47d7ae5-ca69-4894-a8df-5cacf292cf4b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:23.655633 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f47d7ae5-ca69-4894-a8df-5cacf292cf4b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:23.666999 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f47d7ae5-ca69-4894-a8df-5cacf292cf4b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:23.668682 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f47d7ae5-ca69-4894-a8df-5cacf292cf4b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:23.668682 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f47d7ae5-ca69-4894-a8df-5cacf292cf4b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:23.749411 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-84321a7a-12b6-4e11-9f43-4f92edf19f7e tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:23.773739 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-84321a7a-12b6-4e11-9f43-4f92edf19f7e tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/a95f871c-79e7-45bb-8f61-637cc588ee74" status: 200 len: 1277 microversion: 2.1 time: 0.245901 Aug 07 01:14:23.785171 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 606/1082] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:23 2022] GET /compute/v2.1/servers/a95f871c-79e7-45bb-8f61-637cc588ee74 => generated 1277 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:14:24.082098 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-98678360-d732-417e-bb6f-7c6051983306 req-e3d794bd-67b9-4958-b6d1-33b61ef8b52b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5777df19-f308-48d1-8f53-fdbf073a4ef2", "name": "network-vif-deleted", "tag": "62317124-fa59-401f-9d70-b70b34f142b9"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:24.102069 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-98678360-d732-417e-bb6f-7c6051983306 req-e3d794bd-67b9-4958-b6d1-33b61ef8b52b service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:24.105476 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-98678360-d732-417e-bb6f-7c6051983306 req-e3d794bd-67b9-4958-b6d1-33b61ef8b52b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:24.110416 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-98678360-d732-417e-bb6f-7c6051983306 req-e3d794bd-67b9-4958-b6d1-33b61ef8b52b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:24.172589 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-98678360-d732-417e-bb6f-7c6051983306 req-e3d794bd-67b9-4958-b6d1-33b61ef8b52b service nova] Creating event network-vif-deleted:62317124-fa59-401f-9d70-b70b34f142b9 for instance 5777df19-f308-48d1-8f53-fdbf073a4ef2 on n-h1-master-1 Aug 07 01:14:24.195651 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-98678360-d732-417e-bb6f-7c6051983306 req-e3d794bd-67b9-4958-b6d1-33b61ef8b52b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111412 Aug 07 01:14:24.197269 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 607/1083] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:14:24.215971 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fa33c0cc-d4f6-41b2-95ca-a3f780e7284b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:24.217935 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fa33c0cc-d4f6-41b2-95ca-a3f780e7284b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:24.240824 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa33c0cc-d4f6-41b2-95ca-a3f780e7284b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:24.241683 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa33c0cc-d4f6-41b2-95ca-a3f780e7284b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:24.242471 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa33c0cc-d4f6-41b2-95ca-a3f780e7284b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:24.243748 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa33c0cc-d4f6-41b2-95ca-a3f780e7284b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:24.252551 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa33c0cc-d4f6-41b2-95ca-a3f780e7284b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:24.253217 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa33c0cc-d4f6-41b2-95ca-a3f780e7284b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:24.855174 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f47d7ae5-ca69-4894-a8df-5cacf292cf4b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:24.905483 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f47d7ae5-ca69-4894-a8df-5cacf292cf4b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10" status: 200 len: 1463 microversion: 2.1 time: 1.277505 Aug 07 01:14:24.916315 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 477/1084] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:23 2022] GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10 => generated 1463 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:24.916315 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0d353c80-de60-48b6-b46b-d8aade04b96f tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:24.917109 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0d353c80-de60-48b6-b46b-d8aade04b96f tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: 5777df19-f308-48d1-8f53-fdbf073a4ef2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:24.953559 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d353c80-de60-48b6-b46b-d8aade04b96f tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:24.955622 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d353c80-de60-48b6-b46b-d8aade04b96f tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:24.971535 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d353c80-de60-48b6-b46b-d8aade04b96f tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:24.976044 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d353c80-de60-48b6-b46b-d8aade04b96f tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:24.976960 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d353c80-de60-48b6-b46b-d8aade04b96f tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:24.977665 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d353c80-de60-48b6-b46b-d8aade04b96f tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:25.077532 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d353c80-de60-48b6-b46b-d8aade04b96f tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:25.078522 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d353c80-de60-48b6-b46b-d8aade04b96f tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:25.079239 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d353c80-de60-48b6-b46b-d8aade04b96f tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:25.080578 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-0d353c80-de60-48b6-b46b-d8aade04b96f tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lazy-loading 'fault' on Instance uuid 5777df19-f308-48d1-8f53-fdbf073a4ef2 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:14:25.340896 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fa33c0cc-d4f6-41b2-95ca-a3f780e7284b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:25.360417 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fa33c0cc-d4f6-41b2-95ca-a3f780e7284b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1475 microversion: 2.1 time: 1.161223 Aug 07 01:14:25.361666 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 608/1085] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:24 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1475 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:25.384575 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ea897eee-4435-4394-b644-484f8988d93f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:25.385527 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ea897eee-4435-4394-b644-484f8988d93f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: a95f871c-79e7-45bb-8f61-637cc588ee74] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:25.393131 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea897eee-4435-4394-b644-484f8988d93f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:25.394093 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea897eee-4435-4394-b644-484f8988d93f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:25.394690 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea897eee-4435-4394-b644-484f8988d93f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:25.395604 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea897eee-4435-4394-b644-484f8988d93f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:25.396280 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea897eee-4435-4394-b644-484f8988d93f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:25.396865 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea897eee-4435-4394-b644-484f8988d93f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:25.409475 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0d353c80-de60-48b6-b46b-d8aade04b96f tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dce42ff994d81b1ad6d6c05356c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e6d319a0452448485aa65b7cf1c5b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:25.421552 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0d353c80-de60-48b6-b46b-d8aade04b96f tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2" status: 200 len: 1331 microversion: 2.1 time: 0.509849 Aug 07 01:14:25.422779 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 478/1086] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:24 2022] GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2 => generated 1331 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:25.965413 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4b08ce12-99de-4532-9b5b-f3148fbd1f45 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:25.977995 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4b08ce12-99de-4532-9b5b-f3148fbd1f45 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Searching by: {'deleted': False, 'project_id': '74f742bd8b784b54a4829b141ad92a48'} {{(pid=119517) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:14:25.990886 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b08ce12-99de-4532-9b5b-f3148fbd1f45 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:25.991745 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b08ce12-99de-4532-9b5b-f3148fbd1f45 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:25.992452 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b08ce12-99de-4532-9b5b-f3148fbd1f45 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:25.993747 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b08ce12-99de-4532-9b5b-f3148fbd1f45 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:25.995131 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b08ce12-99de-4532-9b5b-f3148fbd1f45 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:25.996070 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b08ce12-99de-4532-9b5b-f3148fbd1f45 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:26.159080 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4b08ce12-99de-4532-9b5b-f3148fbd1f45 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.733968 Aug 07 01:14:26.172307 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 479/1087] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:14:25 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:14:26.192233 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1e0a25e4-9287-4080-af65-e5cab5ee2b6f tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:26.219268 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1e0a25e4-9287-4080-af65-e5cab5ee2b6f tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Searching by: {'deleted': False} {{(pid=119517) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:14:26.227660 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ea897eee-4435-4394-b644-484f8988d93f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:26.244060 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e0a25e4-9287-4080-af65-e5cab5ee2b6f tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:26.245402 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e0a25e4-9287-4080-af65-e5cab5ee2b6f tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:26.246239 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e0a25e4-9287-4080-af65-e5cab5ee2b6f tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:26.247482 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e0a25e4-9287-4080-af65-e5cab5ee2b6f tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:26.248686 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e0a25e4-9287-4080-af65-e5cab5ee2b6f tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:26.249674 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e0a25e4-9287-4080-af65-e5cab5ee2b6f tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:26.262930 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ea897eee-4435-4394-b644-484f8988d93f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/a95f871c-79e7-45bb-8f61-637cc588ee74" status: 200 len: 1319 microversion: 2.1 time: 0.884858 Aug 07 01:14:26.268987 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 609/1088] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:25 2022] GET /compute/v2.1/servers/a95f871c-79e7-45bb-8f61-637cc588ee74 => generated 1319 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:26.301130 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-663ee985-4f2d-475e-bac1-4ca8c58b0829 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:26.303811 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-663ee985-4f2d-475e-bac1-4ca8c58b0829 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:26.322095 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-663ee985-4f2d-475e-bac1-4ca8c58b0829 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:26.324256 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-663ee985-4f2d-475e-bac1-4ca8c58b0829 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:26.325429 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-663ee985-4f2d-475e-bac1-4ca8c58b0829 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:26.327050 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-663ee985-4f2d-475e-bac1-4ca8c58b0829 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:26.328307 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-663ee985-4f2d-475e-bac1-4ca8c58b0829 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:26.330540 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-663ee985-4f2d-475e-bac1-4ca8c58b0829 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:26.521463 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.multi_cell_list [None req-1e0a25e4-9287-4080-af65-e5cab5ee2b6f tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Listed batch of 12 results from cell out of 1000 limit. Returned 12 total so far. {{(pid=119517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 01:14:26.670479 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e0a25e4-9287-4080-af65-e5cab5ee2b6f tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:26.673757 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e0a25e4-9287-4080-af65-e5cab5ee2b6f tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:26.674462 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e0a25e4-9287-4080-af65-e5cab5ee2b6f tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:26.909574 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-663ee985-4f2d-475e-bac1-4ca8c58b0829 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 200 len: 1812 microversion: 2.1 time: 0.618913 Aug 07 01:14:26.911511 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 610/1089] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:26 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 1812 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:26.922545 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e3178fba-d077-40ac-a732-26f8f8dfe108 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:26.924489 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e3178fba-d077-40ac-a732-26f8f8dfe108 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:26.938674 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3178fba-d077-40ac-a732-26f8f8dfe108 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:26.940182 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3178fba-d077-40ac-a732-26f8f8dfe108 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:26.941349 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3178fba-d077-40ac-a732-26f8f8dfe108 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:26.943219 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3178fba-d077-40ac-a732-26f8f8dfe108 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:26.944623 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3178fba-d077-40ac-a732-26f8f8dfe108 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:26.946428 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3178fba-d077-40ac-a732-26f8f8dfe108 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:27.499176 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e3178fba-d077-40ac-a732-26f8f8dfe108 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:27.509685 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e3178fba-d077-40ac-a732-26f8f8dfe108 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1475 microversion: 2.1 time: 0.596351 Aug 07 01:14:27.511866 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 611/1090] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:26 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1475 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:27.551872 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2f7693e1-933b-4bc6-8a75-7a1fb2c1548e tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:27.553182 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2f7693e1-933b-4bc6-8a75-7a1fb2c1548e tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] [instance: 5777df19-f308-48d1-8f53-fdbf073a4ef2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:27.562013 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f7693e1-933b-4bc6-8a75-7a1fb2c1548e tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:27.562982 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f7693e1-933b-4bc6-8a75-7a1fb2c1548e tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:27.563677 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f7693e1-933b-4bc6-8a75-7a1fb2c1548e tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:27.564720 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f7693e1-933b-4bc6-8a75-7a1fb2c1548e tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:27.565906 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f7693e1-933b-4bc6-8a75-7a1fb2c1548e tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:27.583168 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f7693e1-933b-4bc6-8a75-7a1fb2c1548e tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:27.620863 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-2f7693e1-933b-4bc6-8a75-7a1fb2c1548e tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] HTTP exception thrown: Instance 5777df19-f308-48d1-8f53-fdbf073a4ef2 could not be found. Aug 07 01:14:27.626631 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2f7693e1-933b-4bc6-8a75-7a1fb2c1548e tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Request method failure captured: Aug 07 01:14:27.626631 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2 HTTP/1.1 Aug 07 01:14:27.626631 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:14:27.626631 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:14:27.626631 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:14:27.626631 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:14:27.626631 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:14:27.626631 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:14:27.626631 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:14:27.626631 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:14:27.626631 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xEUV6cDl2zjf7X2Vlf0uJfSh3NVE4uRHTiKwG7Vw5ttOE0CHdyLfTeBcGzGImtqwsZDApoStu83aYO8CTIVKLvwGxAlSiwxoyNJBOWfKVKvAC-DXkT9S7iYGxwdDFSfrB4peKa0xlHCDxHbtn_T7ia7HWbTL0fWb49IP2Q3C0kJIpw Aug 07 01:14:27.626631 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:14:27.626631 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:14:27.626631 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:14:27.626631 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:14:27.626631 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:14:27.626631 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:14:27.626631 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 3e6d319a0452448485aa65b7cf1c5b0e Aug 07 01:14:27.626631 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-VolumesAdminNegativeTest-1236892433 Aug 07 01:14:27.626631 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:14:27.626631 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:14:27.629884 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3e6d319a0452448485aa65b7cf1c5b0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3e6d319a0452448485aa65b7cf1c5b0e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3e6d319a0452448485aa65b7cf1c5b0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3e6d319a0452448485aa65b7cf1c5b0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:14:27.629884 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-VolumesAdminNegativeTest-1236892433 Aug 07 01:14:27.629884 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 3e6d319a0452448485aa65b7cf1c5b0e Aug 07 01:14:27.629884 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1236892433 Aug 07 01:14:27.629884 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-VolumesAdminNegativeTest-1236892433-project Aug 07 01:14:27.629884 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:14:27.629884 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:14:27.629884 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 7e9dce42ff994d81b1ad6d6c05356c37 Aug 07 01:14:27.629884 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-VolumesAdminNegativeTest-1236892433-project Aug 07 01:14:27.629884 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:14:27.629884 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 5777df19-f308-48d1-8f53-fdbf073a4ef2 could not be found. Aug 07 01:14:27.629884 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '5777df19-f308-48d1-8f53-fdbf073a4ef2'} Aug 07 01:14:27.636706 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:14:27.636706 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:27.636706 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:14:27.636706 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:14:27.636706 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:14:27.636706 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:14:27.636706 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:14:27.636706 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:14:27.636706 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:14:27.636706 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:14:27.636706 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5777df19-f308-48d1-8f53-fdbf073a4ef2 could not be found. Aug 07 01:14:27.636706 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:27.636706 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:27.636706 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:27.636706 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:27.636706 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:27.636706 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:27.636706 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:14:27.636706 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:14:27.636706 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:14:27.640271 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:14:27.640271 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:14:27.640271 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:14:27.640271 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:14:27.640271 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:14:27.640271 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:14:27.640271 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:14:27.640271 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5777df19-f308-48d1-8f53-fdbf073a4ef2 could not be found. Aug 07 01:14:27.640271 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:27.640271 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:14:27.640271 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:27.640271 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:14:27.640271 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:14:27.640271 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:14:27.640271 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:14:27.640271 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:14:27.640271 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5777df19-f308-48d1-8f53-fdbf073a4ef2 could not be found. Aug 07 01:14:27.640271 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:14:27.642849 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2f7693e1-933b-4bc6-8a75-7a1fb2c1548e tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Returning 404 to user: Instance 5777df19-f308-48d1-8f53-fdbf073a4ef2 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:14:27.642849 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2f7693e1-933b-4bc6-8a75-7a1fb2c1548e tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2" status: 404 len: 111 microversion: 2.1 time: 0.108829 Aug 07 01:14:27.647060 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 612/1091] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:27 2022] GET /compute/v2.1/servers/5777df19-f308-48d1-8f53-fdbf073a4ef2 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:14:27.656722 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8b7b692a-627b-4aa3-8e4c-94eae30b67f1 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:27.669458 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:14:27.669458 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:14:27.673063 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b7b692a-627b-4aa3-8e4c-94eae30b67f1 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:27.674222 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b7b692a-627b-4aa3-8e4c-94eae30b67f1 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:27.692770 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b7b692a-627b-4aa3-8e4c-94eae30b67f1 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:27.693933 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b7b692a-627b-4aa3-8e4c-94eae30b67f1 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:27.694802 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b7b692a-627b-4aa3-8e4c-94eae30b67f1 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:27.695628 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b7b692a-627b-4aa3-8e4c-94eae30b67f1 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:27.743463 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8b7b692a-627b-4aa3-8e4c-94eae30b67f1 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.094736 Aug 07 01:14:27.745001 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 613/1092] 10.222.0.39 () {58 vars in 1176 bytes} [Sun Aug 7 01:14:27 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:14:27.751480 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9c336cdc-bb5d-4ec5-95be-e91700a04a82 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:27.752567 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9c336cdc-bb5d-4ec5-95be-e91700a04a82 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: a95f871c-79e7-45bb-8f61-637cc588ee74] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:27.759397 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c336cdc-bb5d-4ec5-95be-e91700a04a82 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:27.774134 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c336cdc-bb5d-4ec5-95be-e91700a04a82 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:27.774940 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c336cdc-bb5d-4ec5-95be-e91700a04a82 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:27.775936 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c336cdc-bb5d-4ec5-95be-e91700a04a82 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:27.777752 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c336cdc-bb5d-4ec5-95be-e91700a04a82 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:27.778402 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c336cdc-bb5d-4ec5-95be-e91700a04a82 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:28.070349 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9c336cdc-bb5d-4ec5-95be-e91700a04a82 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:28.090812 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9c336cdc-bb5d-4ec5-95be-e91700a04a82 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/a95f871c-79e7-45bb-8f61-637cc588ee74" status: 200 len: 1319 microversion: 2.1 time: 0.343691 Aug 07 01:14:28.091781 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 614/1093] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:27 2022] GET /compute/v2.1/servers/a95f871c-79e7-45bb-8f61-637cc588ee74 => generated 1319 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:28.099645 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1dce740f-7383-4eeb-be75-dd2ecb3e4a2d tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] Calling method '.version_select at 0x7f9e245a8700>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:28.121562 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1e0a25e4-9287-4080-af65-e5cab5ee2b6f tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 19201 microversion: 2.1 time: 1.942583 Aug 07 01:14:28.123315 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 480/1094] 10.222.0.39 () {58 vars in 1171 bytes} [Sun Aug 7 01:14:26 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 19201 bytes in 1946 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:14:28.169157 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1dce740f-7383-4eeb-be75-dd2ecb3e4a2d tempest-VolumesAdminNegativeTest-1236892433 tempest-VolumesAdminNegativeTest-1236892433-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-340230674" status: 202 len: 0 microversion: 2.1 time: 0.074559 Aug 07 01:14:28.172415 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 615/1095] 10.222.0.39 () {58 vars in 1218 bytes} [Sun Aug 7 01:14:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-340230674 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:14:28.194738 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f924d40d-0c51-4c33-b68a-546e795c103e tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:28.199367 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f924d40d-0c51-4c33-b68a-546e795c103e tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Searching by: {'deleted': False, 'project_id': '74f742bd8b784b54a4829b141ad92a48'} {{(pid=119517) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:14:28.205435 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f924d40d-0c51-4c33-b68a-546e795c103e tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:28.206271 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f924d40d-0c51-4c33-b68a-546e795c103e tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:28.206974 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f924d40d-0c51-4c33-b68a-546e795c103e tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:28.207734 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f924d40d-0c51-4c33-b68a-546e795c103e tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:28.208393 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f924d40d-0c51-4c33-b68a-546e795c103e tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:28.209003 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f924d40d-0c51-4c33-b68a-546e795c103e tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:28.250471 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f924d40d-0c51-4c33-b68a-546e795c103e tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/detail?tenant_id=76537752718449e19d6ad94c8e3bc973" status: 200 len: 15 microversion: 2.1 time: 0.060400 Aug 07 01:14:28.251785 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 481/1096] 10.222.0.39 () {58 vars in 1231 bytes} [Sun Aug 7 01:14:28 2022] GET /compute/v2.1/servers/detail?tenant_id=76537752718449e19d6ad94c8e3bc973 => generated 15 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:14:28.273459 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6b22bf08-6723-4253-aab6-d9103d6d6a67 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:28.282467 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6b22bf08-6723-4253-aab6-d9103d6d6a67 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Searching by: {'tenant_id': '76537752718449e19d6ad94c8e3bc973', 'deleted': False} {{(pid=119516) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:14:28.292180 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=4 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:28.294404 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b22bf08-6723-4253-aab6-d9103d6d6a67 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:28.295381 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b22bf08-6723-4253-aab6-d9103d6d6a67 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:28.296077 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b22bf08-6723-4253-aab6-d9103d6d6a67 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:28.297014 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b22bf08-6723-4253-aab6-d9103d6d6a67 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:28.297665 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b22bf08-6723-4253-aab6-d9103d6d6a67 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:28.298279 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b22bf08-6723-4253-aab6-d9103d6d6a67 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:28.534911 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7c83498b-5620-4f96-b06c-5b9f9a23ba27 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:28.535760 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7c83498b-5620-4f96-b06c-5b9f9a23ba27 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:28.549096 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.multi_cell_list [None req-6b22bf08-6723-4253-aab6-d9103d6d6a67 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 01:14:28.550055 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7c83498b-5620-4f96-b06c-5b9f9a23ba27 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:28.550748 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7c83498b-5620-4f96-b06c-5b9f9a23ba27 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:28.552183 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7c83498b-5620-4f96-b06c-5b9f9a23ba27 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:28.553648 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7c83498b-5620-4f96-b06c-5b9f9a23ba27 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:28.555493 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7c83498b-5620-4f96-b06c-5b9f9a23ba27 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:28.557799 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7c83498b-5620-4f96-b06c-5b9f9a23ba27 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:28.687461 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b22bf08-6723-4253-aab6-d9103d6d6a67 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:28.688209 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b22bf08-6723-4253-aab6-d9103d6d6a67 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:28.689059 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b22bf08-6723-4253-aab6-d9103d6d6a67 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:29.363123 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6b22bf08-6723-4253-aab6-d9103d6d6a67 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=76537752718449e19d6ad94c8e3bc973" status: 200 len: 4825 microversion: 2.1 time: 1.092946 Aug 07 01:14:29.364288 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 616/1097] 10.222.0.39 () {58 vars in 1257 bytes} [Sun Aug 7 01:14:28 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=76537752718449e19d6ad94c8e3bc973 => generated 4825 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:29.371672 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-cee2a4f3-6097-4c81-8c40-2801509de5b0 req-4088a874-a728-4313-afc0-4d72b1e3443b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08028949-8eca-4017-8cb2-04ab2b9213ae", "name": "network-vif-unplugged", "status": "completed", "tag": "7606e7d3-c5a2-4fdd-b3b8-464769ea2e7b"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:29.398865 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-cee2a4f3-6097-4c81-8c40-2801509de5b0 req-4088a874-a728-4313-afc0-4d72b1e3443b service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:29.399564 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-cee2a4f3-6097-4c81-8c40-2801509de5b0 req-4088a874-a728-4313-afc0-4d72b1e3443b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:29.400196 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-cee2a4f3-6097-4c81-8c40-2801509de5b0 req-4088a874-a728-4313-afc0-4d72b1e3443b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:29.416177 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-cee2a4f3-6097-4c81-8c40-2801509de5b0 req-4088a874-a728-4313-afc0-4d72b1e3443b service nova] Creating event network-vif-unplugged:7606e7d3-c5a2-4fdd-b3b8-464769ea2e7b for instance 08028949-8eca-4017-8cb2-04ab2b9213ae on n-h1-master-1 Aug 07 01:14:29.480130 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [req-cee2a4f3-6097-4c81-8c40-2801509de5b0 req-4088a874-a728-4313-afc0-4d72b1e3443b service nova] Instance 08028949-8eca-4017-8cb2-04ab2b9213ae is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 01:14:29.518395 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-cee2a4f3-6097-4c81-8c40-2801509de5b0 req-4088a874-a728-4313-afc0-4d72b1e3443b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.152093 Aug 07 01:14:29.525593 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 617/1098] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:14:29.539009 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e85ed154-519b-4193-ba7c-15304ba77af8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:29.546100 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e85ed154-519b-4193-ba7c-15304ba77af8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: a95f871c-79e7-45bb-8f61-637cc588ee74] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:29.575282 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e85ed154-519b-4193-ba7c-15304ba77af8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:29.577411 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e85ed154-519b-4193-ba7c-15304ba77af8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:29.580680 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e85ed154-519b-4193-ba7c-15304ba77af8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:29.581750 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e85ed154-519b-4193-ba7c-15304ba77af8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:29.582555 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e85ed154-519b-4193-ba7c-15304ba77af8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:29.583214 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e85ed154-519b-4193-ba7c-15304ba77af8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:29.864475 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7c83498b-5620-4f96-b06c-5b9f9a23ba27 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:29.876609 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7c83498b-5620-4f96-b06c-5b9f9a23ba27 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1475 microversion: 2.1 time: 1.343646 Aug 07 01:14:29.877514 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 482/1099] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:28 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1475 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:29.890649 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-570d1244-594a-44ee-afa7-650336649147 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:29.908580 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-570d1244-594a-44ee-afa7-650336649147 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Searching by: {'tenant_id': '74f742bd8b784b54a4829b141ad92a48', 'deleted': False} {{(pid=119517) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:14:29.918194 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-570d1244-594a-44ee-afa7-650336649147 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:29.925776 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-570d1244-594a-44ee-afa7-650336649147 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:29.926261 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-570d1244-594a-44ee-afa7-650336649147 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:29.927296 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-570d1244-594a-44ee-afa7-650336649147 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:29.928038 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-570d1244-594a-44ee-afa7-650336649147 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:29.928802 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-570d1244-594a-44ee-afa7-650336649147 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:30.004097 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-570d1244-594a-44ee-afa7-650336649147 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=74f742bd8b784b54a4829b141ad92a48" status: 200 len: 15 microversion: 2.1 time: 0.124234 Aug 07 01:14:30.007137 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 483/1100] 10.222.0.39 () {58 vars in 1257 bytes} [Sun Aug 7 01:14:29 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=74f742bd8b784b54a4829b141ad92a48 => generated 15 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:14:30.034960 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9bca047b-1d44-4b16-9f24-64bec0cb737b tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:30.043807 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9bca047b-1d44-4b16-9f24-64bec0cb737b tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.012058 Aug 07 01:14:30.044450 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 484/1101] 10.222.0.39 () {58 vars in 1189 bytes} [Sun Aug 7 01:14:30 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 07 01:14:30.071594 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d55d22d5-7aee-402c-bb82-f63b07c298b2 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:30.075609 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d55d22d5-7aee-402c-bb82-f63b07c298b2 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:30.095767 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d55d22d5-7aee-402c-bb82-f63b07c298b2 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:30.096697 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d55d22d5-7aee-402c-bb82-f63b07c298b2 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:30.097854 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d55d22d5-7aee-402c-bb82-f63b07c298b2 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:30.102652 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d55d22d5-7aee-402c-bb82-f63b07c298b2 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:30.103361 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d55d22d5-7aee-402c-bb82-f63b07c298b2 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:30.104673 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d55d22d5-7aee-402c-bb82-f63b07c298b2 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:30.227591 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:30.243191 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d55d22d5-7aee-402c-bb82-f63b07c298b2 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a/action" status: 202 len: 0 microversion: 2.1 time: 0.175540 Aug 07 01:14:30.245478 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 485/1102] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:14:30 2022] POST /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 01:14:30.257205 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-86ea9f06-22cf-4731-8e9b-a67d0d3ecb76 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:30.269373 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-86ea9f06-22cf-4731-8e9b-a67d0d3ecb76 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:30.274776 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-86ea9f06-22cf-4731-8e9b-a67d0d3ecb76 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '76537752718449e19d6ad94c8e3bc973'} {{(pid=119517) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:14:30.293680 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-86ea9f06-22cf-4731-8e9b-a67d0d3ecb76 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:30.294430 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-86ea9f06-22cf-4731-8e9b-a67d0d3ecb76 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:30.295229 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-86ea9f06-22cf-4731-8e9b-a67d0d3ecb76 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:30.296261 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-86ea9f06-22cf-4731-8e9b-a67d0d3ecb76 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:30.297701 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-86ea9f06-22cf-4731-8e9b-a67d0d3ecb76 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:30.298324 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-86ea9f06-22cf-4731-8e9b-a67d0d3ecb76 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:30.439360 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.multi_cell_list [None req-86ea9f06-22cf-4731-8e9b-a67d0d3ecb76 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 01:14:30.539164 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-86ea9f06-22cf-4731-8e9b-a67d0d3ecb76 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.286562 Aug 07 01:14:30.541969 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 486/1103] 10.222.0.39 () {58 vars in 1150 bytes} [Sun Aug 7 01:14:30 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:14:30.553525 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d5637209-6b9c-45be-9871-d2f213c52dfa tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:30.561575 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d5637209-6b9c-45be-9871-d2f213c52dfa tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:30.579345 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d5637209-6b9c-45be-9871-d2f213c52dfa tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:30.579863 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d5637209-6b9c-45be-9871-d2f213c52dfa tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:30.580334 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d5637209-6b9c-45be-9871-d2f213c52dfa tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:30.581062 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d5637209-6b9c-45be-9871-d2f213c52dfa tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:30.581526 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d5637209-6b9c-45be-9871-d2f213c52dfa tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:30.581959 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d5637209-6b9c-45be-9871-d2f213c52dfa tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:30.750470 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d5637209-6b9c-45be-9871-d2f213c52dfa tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a/action" status: 202 len: 0 microversion: 2.1 time: 0.200815 Aug 07 01:14:30.754724 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 487/1104] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:14:30 2022] POST /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 01:14:30.761377 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-429f6f9c-4c85-448e-8898-7d35bce40bee tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "177d44ed-b273-4f30-8b90-baa4d614c354", "device": "/dev/xvdb"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:30.764229 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-429f6f9c-4c85-448e-8898-7d35bce40bee tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:30.776505 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-429f6f9c-4c85-448e-8898-7d35bce40bee tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:30.777221 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-429f6f9c-4c85-448e-8898-7d35bce40bee tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:30.778049 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-429f6f9c-4c85-448e-8898-7d35bce40bee tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:30.779033 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-429f6f9c-4c85-448e-8898-7d35bce40bee tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:30.780323 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-429f6f9c-4c85-448e-8898-7d35bce40bee tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:30.780984 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-429f6f9c-4c85-448e-8898-7d35bce40bee tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:30.924476 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e85ed154-519b-4193-ba7c-15304ba77af8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:30.935434 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e85ed154-519b-4193-ba7c-15304ba77af8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/a95f871c-79e7-45bb-8f61-637cc588ee74" status: 200 len: 1319 microversion: 2.1 time: 1.407372 Aug 07 01:14:30.942114 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 618/1105] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:29 2022] GET /compute/v2.1/servers/a95f871c-79e7-45bb-8f61-637cc588ee74 => generated 1319 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:30.950556 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2602f844-7418-48e4-a5a7-20f49edbd04d tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:30.953874 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2602f844-7418-48e4-a5a7-20f49edbd04d tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:30.974609 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2602f844-7418-48e4-a5a7-20f49edbd04d tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:30.975460 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2602f844-7418-48e4-a5a7-20f49edbd04d tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:30.984027 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2602f844-7418-48e4-a5a7-20f49edbd04d tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:30.984742 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2602f844-7418-48e4-a5a7-20f49edbd04d tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:30.985237 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2602f844-7418-48e4-a5a7-20f49edbd04d tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:30.985684 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2602f844-7418-48e4-a5a7-20f49edbd04d tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:31.311954 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-429f6f9c-4c85-448e-8898-7d35bce40bee tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "POST /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.555680 Aug 07 01:14:31.315936 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 488/1106] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Aug 7 01:14:30 2022] POST /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e/os-volume_attachments => generated 194 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:14:31.329888 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4b65492e-43a4-420d-9b09-819598d4a8ce tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:31.331362 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4b65492e-43a4-420d-9b09-819598d4a8ce tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:31.351329 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b65492e-43a4-420d-9b09-819598d4a8ce tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:31.354718 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b65492e-43a4-420d-9b09-819598d4a8ce tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:31.356253 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b65492e-43a4-420d-9b09-819598d4a8ce tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:31.357131 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b65492e-43a4-420d-9b09-819598d4a8ce tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:31.357700 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b65492e-43a4-420d-9b09-819598d4a8ce tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:31.358112 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b65492e-43a4-420d-9b09-819598d4a8ce tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:31.881523 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4b65492e-43a4-420d-9b09-819598d4a8ce tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:31.898008 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4b65492e-43a4-420d-9b09-819598d4a8ce tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1475 microversion: 2.1 time: 0.580536 Aug 07 01:14:31.911728 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 489/1107] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:31 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1475 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:31.911728 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-cadf6b7d-28d2-4ea0-802f-7a4469e3918d req-756facdc-84e0-4fb5-b08a-41ee5b9b8730 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a95f871c-79e7-45bb-8f61-637cc588ee74", "tag": "fc6ffea6-6329-42e5-9ee2-5abcc4ba9bfa"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:31.946868 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-cadf6b7d-28d2-4ea0-802f-7a4469e3918d req-756facdc-84e0-4fb5-b08a-41ee5b9b8730 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:31.947952 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-cadf6b7d-28d2-4ea0-802f-7a4469e3918d req-756facdc-84e0-4fb5-b08a-41ee5b9b8730 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:31.948390 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-cadf6b7d-28d2-4ea0-802f-7a4469e3918d req-756facdc-84e0-4fb5-b08a-41ee5b9b8730 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:31.986269 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-cadf6b7d-28d2-4ea0-802f-7a4469e3918d req-756facdc-84e0-4fb5-b08a-41ee5b9b8730 service nova] Creating event network-changed:fc6ffea6-6329-42e5-9ee2-5abcc4ba9bfa for instance a95f871c-79e7-45bb-8f61-637cc588ee74 on n-h2-master-1 Aug 07 01:14:31.995393 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-cadf6b7d-28d2-4ea0-802f-7a4469e3918d req-756facdc-84e0-4fb5-b08a-41ee5b9b8730 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094340 Aug 07 01:14:32.004125 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 490/1108] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:14:32.024789 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-45cc2fde-a3ad-4ef0-926f-d02ff21080e5 req-ec2b7f0f-6e2a-44ac-9850-ea12e25fc4e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08028949-8eca-4017-8cb2-04ab2b9213ae", "tag": "7606e7d3-c5a2-4fdd-b3b8-464769ea2e7b"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:32.055059 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-45cc2fde-a3ad-4ef0-926f-d02ff21080e5 req-ec2b7f0f-6e2a-44ac-9850-ea12e25fc4e8 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:32.055602 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-45cc2fde-a3ad-4ef0-926f-d02ff21080e5 req-ec2b7f0f-6e2a-44ac-9850-ea12e25fc4e8 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:32.059396 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-45cc2fde-a3ad-4ef0-926f-d02ff21080e5 req-ec2b7f0f-6e2a-44ac-9850-ea12e25fc4e8 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:32.077419 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-45cc2fde-a3ad-4ef0-926f-d02ff21080e5 req-ec2b7f0f-6e2a-44ac-9850-ea12e25fc4e8 service nova] Creating event network-changed:7606e7d3-c5a2-4fdd-b3b8-464769ea2e7b for instance 08028949-8eca-4017-8cb2-04ab2b9213ae on n-h1-master-1 Aug 07 01:14:32.087212 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [req-45cc2fde-a3ad-4ef0-926f-d02ff21080e5 req-ec2b7f0f-6e2a-44ac-9850-ea12e25fc4e8 service nova] Instance 08028949-8eca-4017-8cb2-04ab2b9213ae is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 01:14:32.116251 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-45cc2fde-a3ad-4ef0-926f-d02ff21080e5 req-ec2b7f0f-6e2a-44ac-9850-ea12e25fc4e8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108666 Aug 07 01:14:32.117465 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 491/1109] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:14:32.127562 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9e6d2606-836a-4ede-a66a-ae0c1797fc89 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:32.128304 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9e6d2606-836a-4ede-a66a-ae0c1797fc89 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: a95f871c-79e7-45bb-8f61-637cc588ee74] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:32.146415 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9e6d2606-836a-4ede-a66a-ae0c1797fc89 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:32.146926 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9e6d2606-836a-4ede-a66a-ae0c1797fc89 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:32.152108 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9e6d2606-836a-4ede-a66a-ae0c1797fc89 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:32.153814 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9e6d2606-836a-4ede-a66a-ae0c1797fc89 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:32.154756 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9e6d2606-836a-4ede-a66a-ae0c1797fc89 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:32.156695 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9e6d2606-836a-4ede-a66a-ae0c1797fc89 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:32.748571 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2602f844-7418-48e4-a5a7-20f49edbd04d tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1614 microversion: 2.1 time: 1.790771 Aug 07 01:14:32.754946 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 619/1110] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:30 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1614 bytes in 1812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:32.788163 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-06696342-c9c8-4e1c-8e34-61dd6a04c6cc tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:32.796351 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-06696342-c9c8-4e1c-8e34-61dd6a04c6cc tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:32.834562 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-06696342-c9c8-4e1c-8e34-61dd6a04c6cc tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:32.851222 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-06696342-c9c8-4e1c-8e34-61dd6a04c6cc tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:32.851222 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-06696342-c9c8-4e1c-8e34-61dd6a04c6cc tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:32.854447 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-06696342-c9c8-4e1c-8e34-61dd6a04c6cc tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:32.856772 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-06696342-c9c8-4e1c-8e34-61dd6a04c6cc tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:32.861189 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-06696342-c9c8-4e1c-8e34-61dd6a04c6cc tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:34.598514 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9e6d2606-836a-4ede-a66a-ae0c1797fc89 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:34.608109 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9e6d2606-836a-4ede-a66a-ae0c1797fc89 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/a95f871c-79e7-45bb-8f61-637cc588ee74" status: 200 len: 1319 microversion: 2.1 time: 2.489271 Aug 07 01:14:34.614250 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 492/1111] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:32 2022] GET /compute/v2.1/servers/a95f871c-79e7-45bb-8f61-637cc588ee74 => generated 1319 bytes in 2496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:34.622254 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-78f9f8cb-a99b-4680-9cb1-3fba442d845e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:34.622880 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-78f9f8cb-a99b-4680-9cb1-3fba442d845e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:34.631510 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78f9f8cb-a99b-4680-9cb1-3fba442d845e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:34.632265 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78f9f8cb-a99b-4680-9cb1-3fba442d845e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:34.632748 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78f9f8cb-a99b-4680-9cb1-3fba442d845e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:34.633484 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78f9f8cb-a99b-4680-9cb1-3fba442d845e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:34.634020 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78f9f8cb-a99b-4680-9cb1-3fba442d845e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:34.638369 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78f9f8cb-a99b-4680-9cb1-3fba442d845e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:34.795484 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-06696342-c9c8-4e1c-8e34-61dd6a04c6cc tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1614 microversion: 2.1 time: 2.021309 Aug 07 01:14:34.802078 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 620/1112] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:32 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1614 bytes in 2029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:34.825864 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b49da972-e445-479c-97df-3df403af0a52 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:34.843153 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b49da972-e445-479c-97df-3df403af0a52 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Searching by: {'host': 'n-h1-master-1', 'deleted': False} {{(pid=119516) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:14:34.854400 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b49da972-e445-479c-97df-3df403af0a52 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:34.855208 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b49da972-e445-479c-97df-3df403af0a52 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:34.855817 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b49da972-e445-479c-97df-3df403af0a52 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:34.862861 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b49da972-e445-479c-97df-3df403af0a52 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:34.863620 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b49da972-e445-479c-97df-3df403af0a52 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:34.873325 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b49da972-e445-479c-97df-3df403af0a52 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:35.082618 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.multi_cell_list [None req-b49da972-e445-479c-97df-3df403af0a52 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=119516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 01:14:35.192689 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b49da972-e445-479c-97df-3df403af0a52 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] 10.222.0.39 "GET /compute/v2.1/servers?host=n-h1-master-1&all_tenants=1" status: 200 len: 2291 microversion: 2.1 time: 0.371051 Aug 07 01:14:35.194825 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 621/1113] 10.222.0.39 () {58 vars in 1190 bytes} [Sun Aug 7 01:14:34 2022] GET /compute/v2.1/servers?host=n-h1-master-1&all_tenants=1 => generated 2291 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:14:35.200829 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-217f38a2-c188-4838-be88-9800222f932e req-8b6be8c3-8d57-4833-98d6-1d68032d95c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27", "tag": "c037c38e-6ec4-487b-8848-881d4d981f1f"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:35.211765 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-217f38a2-c188-4838-be88-9800222f932e req-8b6be8c3-8d57-4833-98d6-1d68032d95c3 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:35.213478 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-217f38a2-c188-4838-be88-9800222f932e req-8b6be8c3-8d57-4833-98d6-1d68032d95c3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:35.214185 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-217f38a2-c188-4838-be88-9800222f932e req-8b6be8c3-8d57-4833-98d6-1d68032d95c3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:35.227850 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-217f38a2-c188-4838-be88-9800222f932e req-8b6be8c3-8d57-4833-98d6-1d68032d95c3 service nova] Creating event network-changed:c037c38e-6ec4-487b-8848-881d4d981f1f for instance ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27 on n-h1-master-1 Aug 07 01:14:35.234467 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-217f38a2-c188-4838-be88-9800222f932e req-8b6be8c3-8d57-4833-98d6-1d68032d95c3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038161 Aug 07 01:14:35.236270 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 622/1114] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:14:35.242240 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ec6b9d5a-c1b5-42c7-8462-dd66d95dcfd8 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:35.249751 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ec6b9d5a-c1b5-42c7-8462-dd66d95dcfd8 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=119516) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:14:35.256923 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec6b9d5a-c1b5-42c7-8462-dd66d95dcfd8 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:35.258014 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec6b9d5a-c1b5-42c7-8462-dd66d95dcfd8 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:35.258687 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec6b9d5a-c1b5-42c7-8462-dd66d95dcfd8 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:35.259939 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec6b9d5a-c1b5-42c7-8462-dd66d95dcfd8 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:35.260662 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec6b9d5a-c1b5-42c7-8462-dd66d95dcfd8 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:35.261668 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec6b9d5a-c1b5-42c7-8462-dd66d95dcfd8 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:35.293959 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ec6b9d5a-c1b5-42c7-8462-dd66d95dcfd8 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] 10.222.0.39 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.055975 Aug 07 01:14:35.296349 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 623/1115] 10.222.0.39 () {58 vars in 1196 bytes} [Sun Aug 7 01:14:35 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:14:35.313053 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-22d67fb3-3767-4ded-92f8-e7c21c68699c tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:35.327684 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-22d67fb3-3767-4ded-92f8-e7c21c68699c tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:35.346791 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-78f9f8cb-a99b-4680-9cb1-3fba442d845e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:35.347722 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22d67fb3-3767-4ded-92f8-e7c21c68699c tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:35.349144 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22d67fb3-3767-4ded-92f8-e7c21c68699c tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:35.352117 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22d67fb3-3767-4ded-92f8-e7c21c68699c tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:35.353255 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22d67fb3-3767-4ded-92f8-e7c21c68699c tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:35.356930 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-78f9f8cb-a99b-4680-9cb1-3fba442d845e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1473 microversion: 2.1 time: 0.741034 Aug 07 01:14:35.357306 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22d67fb3-3767-4ded-92f8-e7c21c68699c tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:35.358131 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22d67fb3-3767-4ded-92f8-e7c21c68699c tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:35.358436 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 493/1116] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:34 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1473 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:35.540364 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:35.608904 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-22d67fb3-3767-4ded-92f8-e7c21c68699c tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a/action" status: 202 len: 0 microversion: 2.1 time: 0.300478 Aug 07 01:14:35.609585 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 624/1117] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:14:35 2022] POST /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 01:14:35.635504 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fd0ddf79-9991-45f0-bf3b-2cf5401b69d1 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:35.636540 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fd0ddf79-9991-45f0-bf3b-2cf5401b69d1 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: a95f871c-79e7-45bb-8f61-637cc588ee74] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:35.647684 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e00f71a4-0142-4e7b-8b20-64cf61ff2909 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:35.648888 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd0ddf79-9991-45f0-bf3b-2cf5401b69d1 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:35.649960 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd0ddf79-9991-45f0-bf3b-2cf5401b69d1 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:35.651309 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd0ddf79-9991-45f0-bf3b-2cf5401b69d1 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:35.652769 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd0ddf79-9991-45f0-bf3b-2cf5401b69d1 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:35.654742 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd0ddf79-9991-45f0-bf3b-2cf5401b69d1 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:35.656945 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd0ddf79-9991-45f0-bf3b-2cf5401b69d1 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:35.679832 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e00f71a4-0142-4e7b-8b20-64cf61ff2909 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:35.726458 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e00f71a4-0142-4e7b-8b20-64cf61ff2909 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:35.729394 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e00f71a4-0142-4e7b-8b20-64cf61ff2909 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:35.730012 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e00f71a4-0142-4e7b-8b20-64cf61ff2909 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:35.730911 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e00f71a4-0142-4e7b-8b20-64cf61ff2909 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:35.733363 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e00f71a4-0142-4e7b-8b20-64cf61ff2909 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:35.733974 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e00f71a4-0142-4e7b-8b20-64cf61ff2909 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:35.889469 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-e00f71a4-0142-4e7b-8b20-64cf61ff2909 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:14:35.889933 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-e00f71a4-0142-4e7b-8b20-64cf61ff2909 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:14:35.890411 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-e00f71a4-0142-4e7b-8b20-64cf61ff2909 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:14:35.895653 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-e00f71a4-0142-4e7b-8b20-64cf61ff2909 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:14:35.896699 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-e00f71a4-0142-4e7b-8b20-64cf61ff2909 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:14:36.051651 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e00f71a4-0142-4e7b-8b20-64cf61ff2909 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:36.084719 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e00f71a4-0142-4e7b-8b20-64cf61ff2909 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:36.085708 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e00f71a4-0142-4e7b-8b20-64cf61ff2909 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:36.087343 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e00f71a4-0142-4e7b-8b20-64cf61ff2909 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:36.090776 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e00f71a4-0142-4e7b-8b20-64cf61ff2909 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:36.093136 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e00f71a4-0142-4e7b-8b20-64cf61ff2909 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:36.093755 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e00f71a4-0142-4e7b-8b20-64cf61ff2909 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:36.170716 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e00f71a4-0142-4e7b-8b20-64cf61ff2909 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "POST /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a/action" status: 202 len: 1067 microversion: 2.1 time: 0.554385 Aug 07 01:14:36.173237 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 494/1118] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:14:35 2022] POST /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a/action => generated 1067 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 07 01:14:36.211000 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-76268631-5ff7-459d-9ff1-230c3b0ac80f tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:36.212593 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-76268631-5ff7-459d-9ff1-230c3b0ac80f tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:36.244483 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76268631-5ff7-459d-9ff1-230c3b0ac80f tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:36.248550 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76268631-5ff7-459d-9ff1-230c3b0ac80f tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:36.251752 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76268631-5ff7-459d-9ff1-230c3b0ac80f tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:36.256567 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76268631-5ff7-459d-9ff1-230c3b0ac80f tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:36.261393 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76268631-5ff7-459d-9ff1-230c3b0ac80f tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:36.262776 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76268631-5ff7-459d-9ff1-230c3b0ac80f tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:36.627080 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=32 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:36.667931 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-76268631-5ff7-459d-9ff1-230c3b0ac80f tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:36.692415 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-76268631-5ff7-459d-9ff1-230c3b0ac80f tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1471 microversion: 2.1 time: 0.501990 Aug 07 01:14:36.694108 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 495/1119] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:36 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1471 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:14:36.701278 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-db1781d9-bf3d-4138-894c-1f6f67698098 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:36.702309 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-db1781d9-bf3d-4138-894c-1f6f67698098 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:36.734031 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db1781d9-bf3d-4138-894c-1f6f67698098 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:36.734542 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db1781d9-bf3d-4138-894c-1f6f67698098 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:36.734984 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db1781d9-bf3d-4138-894c-1f6f67698098 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:36.735741 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db1781d9-bf3d-4138-894c-1f6f67698098 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:36.736244 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db1781d9-bf3d-4138-894c-1f6f67698098 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:36.736765 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db1781d9-bf3d-4138-894c-1f6f67698098 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:37.108117 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-db1781d9-bf3d-4138-894c-1f6f67698098 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:37.123824 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-db1781d9-bf3d-4138-894c-1f6f67698098 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1470 microversion: 2.1 time: 0.425938 Aug 07 01:14:37.125585 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 496/1120] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:36 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1470 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:37.156247 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bbe97799-29a5-4200-a2b3-43449fb9c2c4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:37.157536 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bbe97799-29a5-4200-a2b3-43449fb9c2c4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:37.161947 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fd0ddf79-9991-45f0-bf3b-2cf5401b69d1 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:37.172568 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbe97799-29a5-4200-a2b3-43449fb9c2c4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:37.173781 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbe97799-29a5-4200-a2b3-43449fb9c2c4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:37.175131 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbe97799-29a5-4200-a2b3-43449fb9c2c4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:37.179064 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbe97799-29a5-4200-a2b3-43449fb9c2c4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:37.180546 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbe97799-29a5-4200-a2b3-43449fb9c2c4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:37.181986 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fd0ddf79-9991-45f0-bf3b-2cf5401b69d1 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/a95f871c-79e7-45bb-8f61-637cc588ee74" status: 200 len: 1319 microversion: 2.1 time: 1.550379 Aug 07 01:14:37.193695 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 625/1121] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:35 2022] GET /compute/v2.1/servers/a95f871c-79e7-45bb-8f61-637cc588ee74 => generated 1319 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:37.194051 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbe97799-29a5-4200-a2b3-43449fb9c2c4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:37.288713 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:UPDATE=6,nova_cell1:SELECT=91,nova_cell1:INSERT=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:37.330136 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bbe97799-29a5-4200-a2b3-43449fb9c2c4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "POST /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae/action" status: 204 len: 0 microversion: 2.1 time: 0.183192 Aug 07 01:14:37.350589 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 497/1122] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:14:37 2022] POST /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae/action => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:14:37.369435 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-48c9d872-ad67-49b8-80df-bc943b377e9a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:37.373770 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-48c9d872-ad67-49b8-80df-bc943b377e9a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:37.423774 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48c9d872-ad67-49b8-80df-bc943b377e9a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:37.424298 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48c9d872-ad67-49b8-80df-bc943b377e9a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:37.424746 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48c9d872-ad67-49b8-80df-bc943b377e9a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:37.425472 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48c9d872-ad67-49b8-80df-bc943b377e9a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:37.425935 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48c9d872-ad67-49b8-80df-bc943b377e9a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:37.440619 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48c9d872-ad67-49b8-80df-bc943b377e9a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:37.735402 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2fd66e75-ff67-4d41-b477-d45d147d133a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:37.736742 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2fd66e75-ff67-4d41-b477-d45d147d133a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:37.746519 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2fd66e75-ff67-4d41-b477-d45d147d133a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:37.750948 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2fd66e75-ff67-4d41-b477-d45d147d133a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:37.751654 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2fd66e75-ff67-4d41-b477-d45d147d133a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:37.752600 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2fd66e75-ff67-4d41-b477-d45d147d133a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:37.755282 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2fd66e75-ff67-4d41-b477-d45d147d133a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:37.755961 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2fd66e75-ff67-4d41-b477-d45d147d133a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:38.316699 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-48c9d872-ad67-49b8-80df-bc943b377e9a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:38.327707 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-48c9d872-ad67-49b8-80df-bc943b377e9a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1470 microversion: 2.1 time: 0.985584 Aug 07 01:14:38.334484 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 626/1123] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:37 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1470 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:38.355819 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5e2608a9-7211-4218-a9c1-2d0e5067c417 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:38.356515 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5e2608a9-7211-4218-a9c1-2d0e5067c417 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: a95f871c-79e7-45bb-8f61-637cc588ee74] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:38.393992 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e2608a9-7211-4218-a9c1-2d0e5067c417 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:38.402034 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e2608a9-7211-4218-a9c1-2d0e5067c417 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:38.402501 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e2608a9-7211-4218-a9c1-2d0e5067c417 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:38.403289 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e2608a9-7211-4218-a9c1-2d0e5067c417 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:38.403775 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e2608a9-7211-4218-a9c1-2d0e5067c417 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:38.408675 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e2608a9-7211-4218-a9c1-2d0e5067c417 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:38.677408 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:38.762584 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2fd66e75-ff67-4d41-b477-d45d147d133a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:38.789843 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2fd66e75-ff67-4d41-b477-d45d147d133a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1471 microversion: 2.1 time: 1.058955 Aug 07 01:14:38.794500 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 498/1124] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:37 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1471 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:39.074910 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-4c8980e1-cb9f-42b5-b394-91c41859373b req-df2febf3-d06e-4d31-930e-00ba34f0475c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08028949-8eca-4017-8cb2-04ab2b9213ae", "name": "network-vif-plugged", "status": "completed", "tag": "7606e7d3-c5a2-4fdd-b3b8-464769ea2e7b"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:39.098136 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-4c8980e1-cb9f-42b5-b394-91c41859373b req-df2febf3-d06e-4d31-930e-00ba34f0475c service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:39.098945 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-4c8980e1-cb9f-42b5-b394-91c41859373b req-df2febf3-d06e-4d31-930e-00ba34f0475c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:39.099737 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-4c8980e1-cb9f-42b5-b394-91c41859373b req-df2febf3-d06e-4d31-930e-00ba34f0475c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:39.111909 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5e2608a9-7211-4218-a9c1-2d0e5067c417 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:39.138255 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-4c8980e1-cb9f-42b5-b394-91c41859373b req-df2febf3-d06e-4d31-930e-00ba34f0475c service nova] Creating event network-vif-plugged:7606e7d3-c5a2-4fdd-b3b8-464769ea2e7b for instance 08028949-8eca-4017-8cb2-04ab2b9213ae on n-h1-master-1 Aug 07 01:14:39.155547 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [req-4c8980e1-cb9f-42b5-b394-91c41859373b req-df2febf3-d06e-4d31-930e-00ba34f0475c service nova] Instance 08028949-8eca-4017-8cb2-04ab2b9213ae is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 01:14:39.160919 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5e2608a9-7211-4218-a9c1-2d0e5067c417 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/a95f871c-79e7-45bb-8f61-637cc588ee74" status: 200 len: 1319 microversion: 2.1 time: 0.824006 Aug 07 01:14:39.161570 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 627/1125] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:38 2022] GET /compute/v2.1/servers/a95f871c-79e7-45bb-8f61-637cc588ee74 => generated 1319 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:39.194035 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-4c8980e1-cb9f-42b5-b394-91c41859373b req-df2febf3-d06e-4d31-930e-00ba34f0475c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122480 Aug 07 01:14:39.200442 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 499/1126] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:14:39.359137 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cb195649-9d30-4407-97f5-b5b55142921c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:39.360358 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cb195649-9d30-4407-97f5-b5b55142921c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:39.392058 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb195649-9d30-4407-97f5-b5b55142921c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:39.404655 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb195649-9d30-4407-97f5-b5b55142921c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:39.405102 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb195649-9d30-4407-97f5-b5b55142921c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:39.406048 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb195649-9d30-4407-97f5-b5b55142921c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:39.426106 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb195649-9d30-4407-97f5-b5b55142921c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:39.431921 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb195649-9d30-4407-97f5-b5b55142921c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:39.951723 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-724dc1aa-67e0-41a1-a76d-885c92865c85 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1223122667", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "7ee5db72-95e2-4e1f-9da4-5671ad2df4f6"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:40.051632 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-724dc1aa-67e0-41a1-a76d-885c92865c85 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] validate_networks() for [('7ee5db72-95e2-4e1f-9da4-5671ad2df4f6', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:14:40.366969 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=14 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:40.517953 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cb195649-9d30-4407-97f5-b5b55142921c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:40.531012 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cb195649-9d30-4407-97f5-b5b55142921c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1470 microversion: 2.1 time: 1.179635 Aug 07 01:14:40.551496 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 628/1127] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:39 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1470 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:40.557847 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3d88174a-11de-4680-9f39-1d16e9b64721 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:40.558485 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3d88174a-11de-4680-9f39-1d16e9b64721 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:40.565190 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3d88174a-11de-4680-9f39-1d16e9b64721 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:40.565957 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3d88174a-11de-4680-9f39-1d16e9b64721 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:40.566927 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3d88174a-11de-4680-9f39-1d16e9b64721 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:40.567916 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3d88174a-11de-4680-9f39-1d16e9b64721 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:40.568569 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3d88174a-11de-4680-9f39-1d16e9b64721 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:40.569411 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3d88174a-11de-4680-9f39-1d16e9b64721 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:41.074357 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3d88174a-11de-4680-9f39-1d16e9b64721 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:41.093207 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3d88174a-11de-4680-9f39-1d16e9b64721 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1471 microversion: 2.1 time: 0.540321 Aug 07 01:14:41.108562 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 629/1128] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:40 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1471 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:41.118759 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c4ab51a3-5fba-4023-ae1b-1f3ca640fbcd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:41.119390 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c4ab51a3-5fba-4023-ae1b-1f3ca640fbcd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: a95f871c-79e7-45bb-8f61-637cc588ee74] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:41.125849 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c4ab51a3-5fba-4023-ae1b-1f3ca640fbcd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:41.126768 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c4ab51a3-5fba-4023-ae1b-1f3ca640fbcd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:41.127468 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c4ab51a3-5fba-4023-ae1b-1f3ca640fbcd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:41.128489 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c4ab51a3-5fba-4023-ae1b-1f3ca640fbcd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:41.129188 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c4ab51a3-5fba-4023-ae1b-1f3ca640fbcd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:41.129839 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c4ab51a3-5fba-4023-ae1b-1f3ca640fbcd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:41.468178 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-724dc1aa-67e0-41a1-a76d-885c92865c85 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:14:41.468735 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-724dc1aa-67e0-41a1-a76d-885c92865c85 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:14:41.469146 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-724dc1aa-67e0-41a1-a76d-885c92865c85 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:14:41.470287 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-724dc1aa-67e0-41a1-a76d-885c92865c85 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:14:41.471040 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-724dc1aa-67e0-41a1-a76d-885c92865c85 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:14:41.487760 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-724dc1aa-67e0-41a1-a76d-885c92865c85 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:41.488275 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-724dc1aa-67e0-41a1-a76d-885c92865c85 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:41.497355 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-724dc1aa-67e0-41a1-a76d-885c92865c85 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:41.500206 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-724dc1aa-67e0-41a1-a76d-885c92865c85 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:41.501226 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-724dc1aa-67e0-41a1-a76d-885c92865c85 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:41.503400 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-724dc1aa-67e0-41a1-a76d-885c92865c85 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:41.575561 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-724dc1aa-67e0-41a1-a76d-885c92865c85 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Getting quotas for project 45ac882e61ac45eb9abc60630e7337c3. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:14:41.594770 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-724dc1aa-67e0-41a1-a76d-885c92865c85 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Getting quotas for user ae4f4a7231e4431c89712c557c4fa1df and project 45ac882e61ac45eb9abc60630e7337c3. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:14:41.609042 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c4ab51a3-5fba-4023-ae1b-1f3ca640fbcd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:41.622457 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c4ab51a3-5fba-4023-ae1b-1f3ca640fbcd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/a95f871c-79e7-45bb-8f61-637cc588ee74" status: 200 len: 1319 microversion: 2.1 time: 0.512335 Aug 07 01:14:41.642710 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 630/1129] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:41 2022] GET /compute/v2.1/servers/a95f871c-79e7-45bb-8f61-637cc588ee74 => generated 1319 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:41.657770 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-0385c44e-8e62-4421-a86f-333998fe309a req-85754770-ab48-4ead-b159-a14ea5b118e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a95f871c-79e7-45bb-8f61-637cc588ee74", "name": "network-vif-plugged", "status": "completed", "tag": "fc6ffea6-6329-42e5-9ee2-5abcc4ba9bfa"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:41.668407 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-724dc1aa-67e0-41a1-a76d-885c92865c85 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Going to run 3 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:14:41.677744 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-724dc1aa-67e0-41a1-a76d-885c92865c85 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: e6920f55-726f-4258-bc23-2a794668d6bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:14:41.694267 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0385c44e-8e62-4421-a86f-333998fe309a req-85754770-ab48-4ead-b159-a14ea5b118e3 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:41.695283 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0385c44e-8e62-4421-a86f-333998fe309a req-85754770-ab48-4ead-b159-a14ea5b118e3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:41.695950 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0385c44e-8e62-4421-a86f-333998fe309a req-85754770-ab48-4ead-b159-a14ea5b118e3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:41.736945 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-0385c44e-8e62-4421-a86f-333998fe309a req-85754770-ab48-4ead-b159-a14ea5b118e3 service nova] Creating event network-vif-plugged:fc6ffea6-6329-42e5-9ee2-5abcc4ba9bfa for instance a95f871c-79e7-45bb-8f61-637cc588ee74 on n-h2-master-1 Aug 07 01:14:41.755644 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-0385c44e-8e62-4421-a86f-333998fe309a req-85754770-ab48-4ead-b159-a14ea5b118e3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107602 Aug 07 01:14:41.760812 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 631/1130] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:14:41.781895 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0df87c9d-98fb-486e-ad83-c15fa42f5714 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:41.784480 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0df87c9d-98fb-486e-ad83-c15fa42f5714 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:41.792130 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-724dc1aa-67e0-41a1-a76d-885c92865c85 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: 45de519b-ab33-4648-9aa0-b9da5e3f1ef3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=e6920f55-726f-4258-bc23-2a794668d6bb,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:14:41.815119 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0df87c9d-98fb-486e-ad83-c15fa42f5714 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:41.816055 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0df87c9d-98fb-486e-ad83-c15fa42f5714 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:41.816662 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0df87c9d-98fb-486e-ad83-c15fa42f5714 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:41.818215 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0df87c9d-98fb-486e-ad83-c15fa42f5714 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:41.822636 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0df87c9d-98fb-486e-ad83-c15fa42f5714 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:41.825475 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0df87c9d-98fb-486e-ad83-c15fa42f5714 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:41.902420 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-724dc1aa-67e0-41a1-a76d-885c92865c85 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: ea2ef6ca-2623-496d-a174-1d7cbaf80f85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=45de519b-ab33-4648-9aa0-b9da5e3f1ef3,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:14:42.057065 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-724dc1aa-67e0-41a1-a76d-885c92865c85 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.266189 Aug 07 01:14:42.057811 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 500/1131] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:14:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:14:42.074275 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a5c67add-d159-4e94-a64d-2adac4cc8d34 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:42.090183 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a5c67add-d159-4e94-a64d-2adac4cc8d34 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae4f4a7231e4431c89712c557c4fa1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ac882e61ac45eb9abc60630e7337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:42.091148 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a5c67add-d159-4e94-a64d-2adac4cc8d34 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Searching by: {'deleted': False, 'project_id': '45ac882e61ac45eb9abc60630e7337c3'} {{(pid=119517) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:14:42.138693 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a5c67add-d159-4e94-a64d-2adac4cc8d34 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:42.139183 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a5c67add-d159-4e94-a64d-2adac4cc8d34 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:42.139606 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a5c67add-d159-4e94-a64d-2adac4cc8d34 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:42.140375 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a5c67add-d159-4e94-a64d-2adac4cc8d34 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:42.141681 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a5c67add-d159-4e94-a64d-2adac4cc8d34 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:42.142280 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a5c67add-d159-4e94-a64d-2adac4cc8d34 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:42.173298 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a5c67add-d159-4e94-a64d-2adac4cc8d34 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.103188 Aug 07 01:14:42.174773 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 501/1132] 10.222.0.39 () {58 vars in 1125 bytes} [Sun Aug 7 01:14:42 2022] GET /compute/v2.1/servers => generated 1018 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:42.186006 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f8091c35-c55f-4284-ab9a-83085f24e079 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:42.186954 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f8091c35-c55f-4284-ab9a-83085f24e079 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:42.197379 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f8091c35-c55f-4284-ab9a-83085f24e079 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:42.199268 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f8091c35-c55f-4284-ab9a-83085f24e079 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:42.202181 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f8091c35-c55f-4284-ab9a-83085f24e079 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:42.203419 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f8091c35-c55f-4284-ab9a-83085f24e079 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:42.204132 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f8091c35-c55f-4284-ab9a-83085f24e079 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:42.204755 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f8091c35-c55f-4284-ab9a-83085f24e079 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:42.468153 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0df87c9d-98fb-486e-ad83-c15fa42f5714 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:42.476271 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0df87c9d-98fb-486e-ad83-c15fa42f5714 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1462 microversion: 2.1 time: 0.711633 Aug 07 01:14:42.476847 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 632/1133] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:41 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1462 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:42.487878 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-947d2474-1525-47e3-bd46-435e2c6971d3 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:42.498000 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-947d2474-1525-47e3-bd46-435e2c6971d3 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: ea2ef6ca-2623-496d-a174-1d7cbaf80f85] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:42.644309 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-947d2474-1525-47e3-bd46-435e2c6971d3 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f4a7231e4431c89712c557c4fa1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ac882e61ac45eb9abc60630e7337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:42.651867 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-947d2474-1525-47e3-bd46-435e2c6971d3 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85" status: 200 len: 1223 microversion: 2.1 time: 0.169605 Aug 07 01:14:42.652461 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 633/1134] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:42 2022] GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85 => generated 1223 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:42.659015 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cfe89c67-54ae-4cdc-b5b6-21fde6abac6e tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:42.659634 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cfe89c67-54ae-4cdc-b5b6-21fde6abac6e tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:42.679938 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfe89c67-54ae-4cdc-b5b6-21fde6abac6e tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:42.680461 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfe89c67-54ae-4cdc-b5b6-21fde6abac6e tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:42.681760 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfe89c67-54ae-4cdc-b5b6-21fde6abac6e tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:42.682647 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfe89c67-54ae-4cdc-b5b6-21fde6abac6e tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:42.697420 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfe89c67-54ae-4cdc-b5b6-21fde6abac6e tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:42.697879 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfe89c67-54ae-4cdc-b5b6-21fde6abac6e tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:42.910458 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f8091c35-c55f-4284-ab9a-83085f24e079 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:42.988393 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f8091c35-c55f-4284-ab9a-83085f24e079 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1471 microversion: 2.1 time: 0.810747 Aug 07 01:14:43.000182 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 502/1135] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:42 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1471 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:43.042739 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f45affb1-32aa-4b43-bcb0-8f2576f0c72a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:43.045009 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f45affb1-32aa-4b43-bcb0-8f2576f0c72a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: a95f871c-79e7-45bb-8f61-637cc588ee74] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:43.104030 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1,nova_api:INSERT=9 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:43.177304 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f45affb1-32aa-4b43-bcb0-8f2576f0c72a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:43.177768 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f45affb1-32aa-4b43-bcb0-8f2576f0c72a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:43.178219 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f45affb1-32aa-4b43-bcb0-8f2576f0c72a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:43.178965 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f45affb1-32aa-4b43-bcb0-8f2576f0c72a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:43.179422 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f45affb1-32aa-4b43-bcb0-8f2576f0c72a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:43.180128 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f45affb1-32aa-4b43-bcb0-8f2576f0c72a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:43.256905 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cfe89c67-54ae-4cdc-b5b6-21fde6abac6e tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1613 microversion: 2.1 time: 0.599308 Aug 07 01:14:43.258090 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 634/1136] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:42 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1613 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:43.304110 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d3373b5e-0481-4239-bb52-2508dc87c707 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Calling method '.version_select at 0x7f9e24389ee0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:43.309843 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3373b5e-0481-4239-bb52-2508dc87c707 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:43.310902 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3373b5e-0481-4239-bb52-2508dc87c707 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:43.311575 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3373b5e-0481-4239-bb52-2508dc87c707 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:43.329218 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d3373b5e-0481-4239-bb52-2508dc87c707 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 1177 microversion: 2.1 time: 0.030652 Aug 07 01:14:43.344722 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 635/1137] 10.222.0.39 () {58 vars in 1143 bytes} [Sun Aug 7 01:14:43 2022] GET /compute/v2.1/os-migrations => generated 1177 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:43.693300 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-20d6bac1-25fe-4cb6-920f-2efca690f2e9 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:43.700977 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-20d6bac1-25fe-4cb6-920f-2efca690f2e9 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: ea2ef6ca-2623-496d-a174-1d7cbaf80f85] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:43.878952 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f45affb1-32aa-4b43-bcb0-8f2576f0c72a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:43.888866 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f45affb1-32aa-4b43-bcb0-8f2576f0c72a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/a95f871c-79e7-45bb-8f61-637cc588ee74" status: 200 len: 1319 microversion: 2.1 time: 0.884857 Aug 07 01:14:43.889453 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 503/1138] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:43 2022] GET /compute/v2.1/servers/a95f871c-79e7-45bb-8f61-637cc588ee74 => generated 1319 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:43.917654 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5ed2edb9-4b08-4ec3-bc2f-b5835ad87b95 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1708460910", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:44.025093 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-5ed2edb9-4b08-4ec3-bc2f-b5835ad87b95 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] validate_networks() for None {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:14:44.085536 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-20d6bac1-25fe-4cb6-920f-2efca690f2e9 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f4a7231e4431c89712c557c4fa1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ac882e61ac45eb9abc60630e7337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:44.116517 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-20d6bac1-25fe-4cb6-920f-2efca690f2e9 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85" status: 200 len: 1223 microversion: 2.1 time: 0.435880 Aug 07 01:14:44.138036 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 636/1139] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:43 2022] GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85 => generated 1223 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:44.146211 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-da695f76-ed08-49f9-94a3-2e7d42e369ea req-3f116b6e-8a67-402c-9b13-78c27410035a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27", "name": "network-vif-plugged", "status": "completed", "tag": "c037c38e-6ec4-487b-8848-881d4d981f1f"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:44.178144 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-da695f76-ed08-49f9-94a3-2e7d42e369ea req-3f116b6e-8a67-402c-9b13-78c27410035a service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:44.180583 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-da695f76-ed08-49f9-94a3-2e7d42e369ea req-3f116b6e-8a67-402c-9b13-78c27410035a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:44.183736 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-da695f76-ed08-49f9-94a3-2e7d42e369ea req-3f116b6e-8a67-402c-9b13-78c27410035a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:44.198516 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-da695f76-ed08-49f9-94a3-2e7d42e369ea req-3f116b6e-8a67-402c-9b13-78c27410035a service nova] Creating event network-vif-plugged:c037c38e-6ec4-487b-8848-881d4d981f1f for instance ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27 on n-h1-master-1 Aug 07 01:14:44.207273 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-da695f76-ed08-49f9-94a3-2e7d42e369ea req-3f116b6e-8a67-402c-9b13-78c27410035a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067401 Aug 07 01:14:44.208862 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 637/1140] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:14:44.229510 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-713e2ea9-261f-45e4-8e14-0cfaab831bb7 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:44.233451 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-713e2ea9-261f-45e4-8e14-0cfaab831bb7 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:44.249494 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-713e2ea9-261f-45e4-8e14-0cfaab831bb7 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:44.252443 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-713e2ea9-261f-45e4-8e14-0cfaab831bb7 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:44.253247 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-713e2ea9-261f-45e4-8e14-0cfaab831bb7 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:44.256609 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-713e2ea9-261f-45e4-8e14-0cfaab831bb7 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:44.257388 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-713e2ea9-261f-45e4-8e14-0cfaab831bb7 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:44.258003 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-713e2ea9-261f-45e4-8e14-0cfaab831bb7 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:45.289432 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=8 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:45.655779 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-713e2ea9-261f-45e4-8e14-0cfaab831bb7 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:45.674788 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-713e2ea9-261f-45e4-8e14-0cfaab831bb7 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1471 microversion: 2.1 time: 1.461791 Aug 07 01:14:45.678799 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 638/1141] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:44 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1471 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:45.692270 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-da2e8060-d63c-4352-86e6-59971384850e tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:45.695291 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-da2e8060-d63c-4352-86e6-59971384850e tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: a95f871c-79e7-45bb-8f61-637cc588ee74] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:45.709531 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da2e8060-d63c-4352-86e6-59971384850e tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:45.714121 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da2e8060-d63c-4352-86e6-59971384850e tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:45.717126 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da2e8060-d63c-4352-86e6-59971384850e tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:45.718865 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da2e8060-d63c-4352-86e6-59971384850e tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:45.719589 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da2e8060-d63c-4352-86e6-59971384850e tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:45.725865 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da2e8060-d63c-4352-86e6-59971384850e tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:45.822280 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-5ed2edb9-4b08-4ec3-bc2f-b5835ad87b95 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:14:45.823252 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-5ed2edb9-4b08-4ec3-bc2f-b5835ad87b95 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:14:45.824456 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-5ed2edb9-4b08-4ec3-bc2f-b5835ad87b95 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:14:45.826912 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-5ed2edb9-4b08-4ec3-bc2f-b5835ad87b95 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:14:45.829227 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-5ed2edb9-4b08-4ec3-bc2f-b5835ad87b95 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:14:45.871922 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5ed2edb9-4b08-4ec3-bc2f-b5835ad87b95 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:45.874649 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5ed2edb9-4b08-4ec3-bc2f-b5835ad87b95 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:45.875572 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5ed2edb9-4b08-4ec3-bc2f-b5835ad87b95 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:45.888216 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5ed2edb9-4b08-4ec3-bc2f-b5835ad87b95 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:45.892342 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5ed2edb9-4b08-4ec3-bc2f-b5835ad87b95 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:45.893424 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5ed2edb9-4b08-4ec3-bc2f-b5835ad87b95 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:46.011717 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-5ed2edb9-4b08-4ec3-bc2f-b5835ad87b95 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Getting quotas for project 1911abc893ef4c01aa80ca9079dea6e9. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:14:46.042811 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-5ed2edb9-4b08-4ec3-bc2f-b5835ad87b95 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Getting quotas for user b945db9a6f7a4143a544b76be5e9af9f and project 1911abc893ef4c01aa80ca9079dea6e9. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:14:46.079415 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5ed2edb9-4b08-4ec3-bc2f-b5835ad87b95 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:14:46.082378 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5ed2edb9-4b08-4ec3-bc2f-b5835ad87b95 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:14:46.217209 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5ed2edb9-4b08-4ec3-bc2f-b5835ad87b95 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.321227 Aug 07 01:14:46.219355 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 504/1142] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:14:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2325 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:14:46.235562 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a7077909-5a74-4d93-83b1-25acb844ec9e tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:46.236237 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a7077909-5a74-4d93-83b1-25acb844ec9e tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: ea2ef6ca-2623-496d-a174-1d7cbaf80f85] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:46.253190 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a7077909-5a74-4d93-83b1-25acb844ec9e tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:46.253689 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a7077909-5a74-4d93-83b1-25acb844ec9e tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:46.259268 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a7077909-5a74-4d93-83b1-25acb844ec9e tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:46.277495 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a7077909-5a74-4d93-83b1-25acb844ec9e tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:46.278065 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a7077909-5a74-4d93-83b1-25acb844ec9e tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:46.278553 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a7077909-5a74-4d93-83b1-25acb844ec9e tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:46.553497 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a7077909-5a74-4d93-83b1-25acb844ec9e tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f4a7231e4431c89712c557c4fa1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ac882e61ac45eb9abc60630e7337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:46.666243 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a7077909-5a74-4d93-83b1-25acb844ec9e tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85" status: 200 len: 1219 microversion: 2.1 time: 0.435824 Aug 07 01:14:46.671376 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 505/1143] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:46 2022] GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85 => generated 1219 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:46.697781 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6c3f6ed3-edfc-4336-9140-c43c24eeca99 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:46.703847 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6c3f6ed3-edfc-4336-9140-c43c24eeca99 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:46.937486 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-da2e8060-d63c-4352-86e6-59971384850e tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:46.962491 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-da2e8060-d63c-4352-86e6-59971384850e tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/a95f871c-79e7-45bb-8f61-637cc588ee74" status: 200 len: 1468 microversion: 2.1 time: 1.280571 Aug 07 01:14:46.964661 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 639/1144] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:45 2022] GET /compute/v2.1/servers/a95f871c-79e7-45bb-8f61-637cc588ee74 => generated 1468 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:46.982076 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-40cbb67e-cdd8-4d11-a704-964703067aed tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:46.983421 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-40cbb67e-cdd8-4d11-a704-964703067aed tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:47.003779 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-40cbb67e-cdd8-4d11-a704-964703067aed tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:47.007008 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-40cbb67e-cdd8-4d11-a704-964703067aed tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:47.008341 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-40cbb67e-cdd8-4d11-a704-964703067aed tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:47.009612 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-40cbb67e-cdd8-4d11-a704-964703067aed tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:47.011456 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-40cbb67e-cdd8-4d11-a704-964703067aed tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:47.012396 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-40cbb67e-cdd8-4d11-a704-964703067aed tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:47.379245 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6c3f6ed3-edfc-4336-9140-c43c24eeca99 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:47.403113 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6c3f6ed3-edfc-4336-9140-c43c24eeca99 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1213 microversion: 2.1 time: 0.727041 Aug 07 01:14:47.405407 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 506/1145] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:46 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1213 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:47.436686 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a15fb331-3133-4d94-ac91-6600640ae7b1 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:47.438099 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a15fb331-3133-4d94-ac91-6600640ae7b1 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:47.502433 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a15fb331-3133-4d94-ac91-6600640ae7b1 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:47.509700 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a15fb331-3133-4d94-ac91-6600640ae7b1 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:47.511582 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a15fb331-3133-4d94-ac91-6600640ae7b1 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:47.517359 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a15fb331-3133-4d94-ac91-6600640ae7b1 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:47.519979 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a15fb331-3133-4d94-ac91-6600640ae7b1 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:47.521508 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a15fb331-3133-4d94-ac91-6600640ae7b1 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:48.531599 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a15fb331-3133-4d94-ac91-6600640ae7b1 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:48.544114 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a15fb331-3133-4d94-ac91-6600640ae7b1 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27" status: 200 len: 1469 microversion: 2.1 time: 1.129243 Aug 07 01:14:48.544737 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 507/1146] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:47 2022] GET /compute/v2.1/servers/ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27 => generated 1469 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:48.554794 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-584d8197-b82e-4bd9-a2e1-57e457907a38 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:48.559111 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-584d8197-b82e-4bd9-a2e1-57e457907a38 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: ea2ef6ca-2623-496d-a174-1d7cbaf80f85] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:48.585541 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-584d8197-b82e-4bd9-a2e1-57e457907a38 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:48.587180 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-584d8197-b82e-4bd9-a2e1-57e457907a38 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:48.588534 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-584d8197-b82e-4bd9-a2e1-57e457907a38 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:48.589491 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-584d8197-b82e-4bd9-a2e1-57e457907a38 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:48.591313 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-584d8197-b82e-4bd9-a2e1-57e457907a38 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:48.592902 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-584d8197-b82e-4bd9-a2e1-57e457907a38 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:48.826372 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-584d8197-b82e-4bd9-a2e1-57e457907a38 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f4a7231e4431c89712c557c4fa1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ac882e61ac45eb9abc60630e7337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:48.839206 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-584d8197-b82e-4bd9-a2e1-57e457907a38 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85" status: 200 len: 1281 microversion: 2.1 time: 0.292284 Aug 07 01:14:48.853787 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 508/1147] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:48 2022] GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85 => generated 1281 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:48.885561 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6493aa4a-0307-4a7b-a892-a10d9adeecdf tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:48.902313 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6493aa4a-0307-4a7b-a892-a10d9adeecdf tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:48.936626 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6493aa4a-0307-4a7b-a892-a10d9adeecdf tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:48.943211 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6493aa4a-0307-4a7b-a892-a10d9adeecdf tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:48.944923 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6493aa4a-0307-4a7b-a892-a10d9adeecdf tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:48.950666 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6493aa4a-0307-4a7b-a892-a10d9adeecdf tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:48.955089 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6493aa4a-0307-4a7b-a892-a10d9adeecdf tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:48.957768 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6493aa4a-0307-4a7b-a892-a10d9adeecdf tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:49.259777 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-40cbb67e-cdd8-4d11-a704-964703067aed tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:49.299707 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-40cbb67e-cdd8-4d11-a704-964703067aed tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1471 microversion: 2.1 time: 2.327342 Aug 07 01:14:49.306626 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 640/1148] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:46 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1471 bytes in 2341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:49.335150 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e10f52f0-8d22-40b4-becf-b25c8b515ceb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:49.360337 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e10f52f0-8d22-40b4-becf-b25c8b515ceb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:49.365964 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e10f52f0-8d22-40b4-becf-b25c8b515ceb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Searching by: {'reservation_id': 'r-g7wbse3g', 'deleted': False, 'project_id': 'd08d010c14a64f759887be0d2364c6e4'} {{(pid=119516) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:14:49.394510 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e10f52f0-8d22-40b4-becf-b25c8b515ceb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:49.395799 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e10f52f0-8d22-40b4-becf-b25c8b515ceb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:49.396797 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e10f52f0-8d22-40b4-becf-b25c8b515ceb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:49.402823 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e10f52f0-8d22-40b4-becf-b25c8b515ceb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:49.404107 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e10f52f0-8d22-40b4-becf-b25c8b515ceb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:49.404902 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e10f52f0-8d22-40b4-becf-b25c8b515ceb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:49.547293 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6493aa4a-0307-4a7b-a892-a10d9adeecdf tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:49.569278 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6493aa4a-0307-4a7b-a892-a10d9adeecdf tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1265 microversion: 2.1 time: 0.704746 Aug 07 01:14:49.570067 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 509/1149] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:48 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1265 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:49.725260 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.multi_cell_list [None req-e10f52f0-8d22-40b4-becf-b25c8b515ceb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 01:14:49.866040 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a05b7615-fe8f-41ce-a925-bb5af9e6336d tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:49.866671 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a05b7615-fe8f-41ce-a925-bb5af9e6336d tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: ea2ef6ca-2623-496d-a174-1d7cbaf80f85] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:49.878906 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a05b7615-fe8f-41ce-a925-bb5af9e6336d tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:49.879330 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a05b7615-fe8f-41ce-a925-bb5af9e6336d tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:49.879770 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a05b7615-fe8f-41ce-a925-bb5af9e6336d tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:49.880648 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a05b7615-fe8f-41ce-a925-bb5af9e6336d tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:49.880982 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a05b7615-fe8f-41ce-a925-bb5af9e6336d tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:49.886292 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a05b7615-fe8f-41ce-a925-bb5af9e6336d tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:49.927257 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e10f52f0-8d22-40b4-becf-b25c8b515ceb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:49.939875 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:49.948583 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e10f52f0-8d22-40b4-becf-b25c8b515ceb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:49.949452 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e10f52f0-8d22-40b4-becf-b25c8b515ceb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:49.950873 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e10f52f0-8d22-40b4-becf-b25c8b515ceb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:50.134018 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a05b7615-fe8f-41ce-a925-bb5af9e6336d tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f4a7231e4431c89712c557c4fa1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ac882e61ac45eb9abc60630e7337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:50.143338 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a05b7615-fe8f-41ce-a925-bb5af9e6336d tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85" status: 200 len: 1281 microversion: 2.1 time: 0.280868 Aug 07 01:14:50.158261 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 510/1150] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:49 2022] GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85 => generated 1281 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:14:50.351971 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5e9e57a1-b916-4e78-a5e0-c4cd2e35491d tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:50.352855 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5e9e57a1-b916-4e78-a5e0-c4cd2e35491d tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:50.360965 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e9e57a1-b916-4e78-a5e0-c4cd2e35491d tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:50.361652 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e9e57a1-b916-4e78-a5e0-c4cd2e35491d tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:50.362249 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e9e57a1-b916-4e78-a5e0-c4cd2e35491d tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:50.363157 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e9e57a1-b916-4e78-a5e0-c4cd2e35491d tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:50.363774 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e9e57a1-b916-4e78-a5e0-c4cd2e35491d tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:50.365062 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e9e57a1-b916-4e78-a5e0-c4cd2e35491d tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:50.433814 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e10f52f0-8d22-40b4-becf-b25c8b515ceb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/detail?reservation_id=r-g7wbse3g" status: 200 len: 2930 microversion: 2.1 time: 1.122957 Aug 07 01:14:50.437296 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 641/1151] 10.222.0.39 () {58 vars in 1197 bytes} [Sun Aug 7 01:14:49 2022] GET /compute/v2.1/servers/detail?reservation_id=r-g7wbse3g => generated 2930 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:50.499789 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3212597f-0f0e-4f19-9347-205110ffd32b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:50.558441 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.compute.server_groups [None req-3212597f-0f0e-4f19-9347-205110ffd32b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Querying cell 946acc3b-7b72-45d6-9151-44f3ad85fe4f(cell1) for 2 instances {{(pid=119516) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 07 01:14:50.570468 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3212597f-0f0e-4f19-9347-205110ffd32b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:50.571341 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3212597f-0f0e-4f19-9347-205110ffd32b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:50.572030 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3212597f-0f0e-4f19-9347-205110ffd32b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:50.605444 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3212597f-0f0e-4f19-9347-205110ffd32b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups/f0c5c304-6e15-4031-b078-6cf8ea0f0c13" status: 200 len: 270 microversion: 2.1 time: 0.148400 Aug 07 01:14:50.606813 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 642/1152] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Aug 7 01:14:50 2022] GET /compute/v2.1/os-server-groups/f0c5c304-6e15-4031-b078-6cf8ea0f0c13 => generated 270 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:14:50.612932 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e6986546-b7ff-4fc3-ae46-da40fe58125d tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:50.613932 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e6986546-b7ff-4fc3-ae46-da40fe58125d tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:50.622562 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6986546-b7ff-4fc3-ae46-da40fe58125d tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:50.623658 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6986546-b7ff-4fc3-ae46-da40fe58125d tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:50.624317 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6986546-b7ff-4fc3-ae46-da40fe58125d tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:50.625456 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6986546-b7ff-4fc3-ae46-da40fe58125d tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:50.626110 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6986546-b7ff-4fc3-ae46-da40fe58125d tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:50.626905 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6986546-b7ff-4fc3-ae46-da40fe58125d tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:50.900284 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e6986546-b7ff-4fc3-ae46-da40fe58125d tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 200 len: 1858 microversion: 2.1 time: 0.291940 Aug 07 01:14:50.915847 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 643/1153] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:50 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 1858 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:50.935720 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-507b809e-5e5b-4e22-8cff-4fa089bcab7b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:50.940078 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-507b809e-5e5b-4e22-8cff-4fa089bcab7b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:50.956769 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-507b809e-5e5b-4e22-8cff-4fa089bcab7b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:50.957364 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-507b809e-5e5b-4e22-8cff-4fa089bcab7b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:50.957798 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-507b809e-5e5b-4e22-8cff-4fa089bcab7b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:50.958619 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-507b809e-5e5b-4e22-8cff-4fa089bcab7b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:50.959452 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-507b809e-5e5b-4e22-8cff-4fa089bcab7b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:50.959629 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-507b809e-5e5b-4e22-8cff-4fa089bcab7b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:50.994548 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:51.083147 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-507b809e-5e5b-4e22-8cff-4fa089bcab7b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:51.116286 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-507b809e-5e5b-4e22-8cff-4fa089bcab7b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1271 microversion: 2.1 time: 0.200736 Aug 07 01:14:51.117145 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 644/1154] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:50 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1271 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:51.141801 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c2aea7dc-e40c-4c88-8bbd-a16374e94103 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:51.142251 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c2aea7dc-e40c-4c88-8bbd-a16374e94103 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] [instance: a95f871c-79e7-45bb-8f61-637cc588ee74] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:51.151595 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c2aea7dc-e40c-4c88-8bbd-a16374e94103 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:51.151595 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c2aea7dc-e40c-4c88-8bbd-a16374e94103 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:51.152225 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c2aea7dc-e40c-4c88-8bbd-a16374e94103 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:51.153203 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c2aea7dc-e40c-4c88-8bbd-a16374e94103 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:51.153791 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c2aea7dc-e40c-4c88-8bbd-a16374e94103 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:51.154205 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c2aea7dc-e40c-4c88-8bbd-a16374e94103 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:51.763620 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c2aea7dc-e40c-4c88-8bbd-a16374e94103 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/a95f871c-79e7-45bb-8f61-637cc588ee74" status: 200 len: 1619 microversion: 2.1 time: 0.645648 Aug 07 01:14:51.764317 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 645/1155] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:51 2022] GET /compute/v2.1/servers/a95f871c-79e7-45bb-8f61-637cc588ee74 => generated 1619 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:51.784711 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-825e1ba5-ee16-4aea-a68d-83a446d87c66 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:51.788842 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-825e1ba5-ee16-4aea-a68d-83a446d87c66 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:51.799468 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-825e1ba5-ee16-4aea-a68d-83a446d87c66 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:51.800565 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-825e1ba5-ee16-4aea-a68d-83a446d87c66 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:51.801504 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-825e1ba5-ee16-4aea-a68d-83a446d87c66 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:51.802565 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-825e1ba5-ee16-4aea-a68d-83a446d87c66 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:51.803217 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-825e1ba5-ee16-4aea-a68d-83a446d87c66 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:51.803792 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-825e1ba5-ee16-4aea-a68d-83a446d87c66 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:51.840975 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-825e1ba5-ee16-4aea-a68d-83a446d87c66 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lazy-loading 'flavor' on Instance uuid 459c9fac-af66-443f-acd3-22587f83ca6e {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:14:51.857858 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-825e1ba5-ee16-4aea-a68d-83a446d87c66 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Going to try to live migrate instance to n-h1-master-1 {{(pid=119516) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 07 01:14:51.886542 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5e9e57a1-b916-4e78-a5e0-c4cd2e35491d tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:51.913363 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5e9e57a1-b916-4e78-a5e0-c4cd2e35491d tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1471 microversion: 2.1 time: 1.565437 Aug 07 01:14:51.915415 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 511/1156] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:50 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1471 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:51.934071 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-807d0c29-d40c-4a00-9b53-fcb3880170e4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:51.935527 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-807d0c29-d40c-4a00-9b53-fcb3880170e4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: ea2ef6ca-2623-496d-a174-1d7cbaf80f85] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:51.954814 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-807d0c29-d40c-4a00-9b53-fcb3880170e4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:51.957652 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-807d0c29-d40c-4a00-9b53-fcb3880170e4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:51.958608 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-807d0c29-d40c-4a00-9b53-fcb3880170e4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:51.960011 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-807d0c29-d40c-4a00-9b53-fcb3880170e4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:51.961056 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-807d0c29-d40c-4a00-9b53-fcb3880170e4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:51.961802 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-807d0c29-d40c-4a00-9b53-fcb3880170e4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:52.646313 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-807d0c29-d40c-4a00-9b53-fcb3880170e4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f4a7231e4431c89712c557c4fa1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ac882e61ac45eb9abc60630e7337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:52.663653 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-807d0c29-d40c-4a00-9b53-fcb3880170e4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85" status: 200 len: 1281 microversion: 2.1 time: 0.746209 Aug 07 01:14:52.676526 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 512/1157] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:51 2022] GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85 => generated 1281 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:52.696368 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6c16e6f7-26b6-419a-8d13-b0c583fe1e57 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:52.697332 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6c16e6f7-26b6-419a-8d13-b0c583fe1e57 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] [instance: ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:52.717017 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c16e6f7-26b6-419a-8d13-b0c583fe1e57 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:52.717755 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c16e6f7-26b6-419a-8d13-b0c583fe1e57 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:52.718625 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c16e6f7-26b6-419a-8d13-b0c583fe1e57 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:52.719917 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c16e6f7-26b6-419a-8d13-b0c583fe1e57 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:52.720804 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c16e6f7-26b6-419a-8d13-b0c583fe1e57 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:52.728843 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c16e6f7-26b6-419a-8d13-b0c583fe1e57 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:53.677480 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6c16e6f7-26b6-419a-8d13-b0c583fe1e57 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27" status: 200 len: 1620 microversion: 2.1 time: 0.985920 Aug 07 01:14:53.678714 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 513/1158] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:52 2022] GET /compute/v2.1/servers/ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27 => generated 1620 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:53.685310 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-260a1e8e-c86c-4c2f-b21a-1c4552c11e4a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:53.686286 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-260a1e8e-c86c-4c2f-b21a-1c4552c11e4a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:53.695470 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-260a1e8e-c86c-4c2f-b21a-1c4552c11e4a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:53.696890 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-260a1e8e-c86c-4c2f-b21a-1c4552c11e4a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:53.697530 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-260a1e8e-c86c-4c2f-b21a-1c4552c11e4a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:53.698545 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-260a1e8e-c86c-4c2f-b21a-1c4552c11e4a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:53.699232 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-260a1e8e-c86c-4c2f-b21a-1c4552c11e4a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:53.699877 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-260a1e8e-c86c-4c2f-b21a-1c4552c11e4a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:53.851067 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-260a1e8e-c86c-4c2f-b21a-1c4552c11e4a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:53.868616 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-260a1e8e-c86c-4c2f-b21a-1c4552c11e4a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1271 microversion: 2.1 time: 0.187812 Aug 07 01:14:53.882099 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 514/1159] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:53 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1271 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:53.893335 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-eea2f769-17e4-4c89-b8c2-471a6a634a44 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:53.894364 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-eea2f769-17e4-4c89-b8c2-471a6a634a44 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:53.908026 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eea2f769-17e4-4c89-b8c2-471a6a634a44 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:53.909081 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eea2f769-17e4-4c89-b8c2-471a6a634a44 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:53.909840 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eea2f769-17e4-4c89-b8c2-471a6a634a44 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:53.911071 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eea2f769-17e4-4c89-b8c2-471a6a634a44 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:53.911787 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eea2f769-17e4-4c89-b8c2-471a6a634a44 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:53.912531 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eea2f769-17e4-4c89-b8c2-471a6a634a44 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:54.734666 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-eea2f769-17e4-4c89-b8c2-471a6a634a44 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:54.752728 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-eea2f769-17e4-4c89-b8c2-471a6a634a44 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1471 microversion: 2.1 time: 0.863650 Aug 07 01:14:54.753837 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 515/1160] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:53 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1471 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:54.787309 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1947dd08-d9b3-4e4e-9acc-94908e37f3e1 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:54.788426 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1947dd08-d9b3-4e4e-9acc-94908e37f3e1 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: ea2ef6ca-2623-496d-a174-1d7cbaf80f85] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:54.803469 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1947dd08-d9b3-4e4e-9acc-94908e37f3e1 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:54.804283 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1947dd08-d9b3-4e4e-9acc-94908e37f3e1 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:54.804958 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1947dd08-d9b3-4e4e-9acc-94908e37f3e1 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:54.808290 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1947dd08-d9b3-4e4e-9acc-94908e37f3e1 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:54.809227 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1947dd08-d9b3-4e4e-9acc-94908e37f3e1 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:54.810436 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1947dd08-d9b3-4e4e-9acc-94908e37f3e1 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:55.746537 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1947dd08-d9b3-4e4e-9acc-94908e37f3e1 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f4a7231e4431c89712c557c4fa1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ac882e61ac45eb9abc60630e7337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:55.753109 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:55.774480 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1947dd08-d9b3-4e4e-9acc-94908e37f3e1 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85" status: 200 len: 1323 microversion: 2.1 time: 1.003103 Aug 07 01:14:55.791476 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 516/1161] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:54 2022] GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85 => generated 1323 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:55.808155 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-825e1ba5-ee16-4aea-a68d-83a446d87c66 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e/action" status: 202 len: 0 microversion: 2.1 time: 4.026896 Aug 07 01:14:55.812825 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 646/1162] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:14:51 2022] POST /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e/action => generated 0 bytes in 4032 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:14:55.818991 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3b0cee12-4f98-4bd0-8b24-71e59e33e955 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:55.819753 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3b0cee12-4f98-4bd0-8b24-71e59e33e955 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:55.826629 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-07dd9c4e-4168-4236-8122-93f1c6185cfc tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1878795752", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "8511418d-b773-43fd-adc1-bc8862f82015"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:55.838134 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b0cee12-4f98-4bd0-8b24-71e59e33e955 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:55.849215 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b0cee12-4f98-4bd0-8b24-71e59e33e955 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:55.849678 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b0cee12-4f98-4bd0-8b24-71e59e33e955 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:55.850441 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b0cee12-4f98-4bd0-8b24-71e59e33e955 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:55.850909 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b0cee12-4f98-4bd0-8b24-71e59e33e955 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:55.851344 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b0cee12-4f98-4bd0-8b24-71e59e33e955 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:55.945216 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-07dd9c4e-4168-4236-8122-93f1c6185cfc tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] validate_networks() for None {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:14:55.957901 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:56.574905 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3b0cee12-4f98-4bd0-8b24-71e59e33e955 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:56.585406 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3b0cee12-4f98-4bd0-8b24-71e59e33e955 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1313 microversion: 2.1 time: 0.771111 Aug 07 01:14:56.586830 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 647/1163] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:55 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1313 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:56.593710 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e6d149e6-f141-4ff9-807b-c8e42fd4c275 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:56.594496 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e6d149e6-f141-4ff9-807b-c8e42fd4c275 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:56.604131 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6d149e6-f141-4ff9-807b-c8e42fd4c275 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:56.605547 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6d149e6-f141-4ff9-807b-c8e42fd4c275 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:56.606829 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6d149e6-f141-4ff9-807b-c8e42fd4c275 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:56.608416 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6d149e6-f141-4ff9-807b-c8e42fd4c275 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:56.609057 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6d149e6-f141-4ff9-807b-c8e42fd4c275 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:56.609648 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6d149e6-f141-4ff9-807b-c8e42fd4c275 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:56.928654 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-07dd9c4e-4168-4236-8122-93f1c6185cfc tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:14:56.929855 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-07dd9c4e-4168-4236-8122-93f1c6185cfc tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:14:56.930556 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-07dd9c4e-4168-4236-8122-93f1c6185cfc tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:14:56.931072 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-07dd9c4e-4168-4236-8122-93f1c6185cfc tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:14:56.931617 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-07dd9c4e-4168-4236-8122-93f1c6185cfc tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:14:56.947857 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-07dd9c4e-4168-4236-8122-93f1c6185cfc tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:56.948915 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-07dd9c4e-4168-4236-8122-93f1c6185cfc tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:56.949520 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-07dd9c4e-4168-4236-8122-93f1c6185cfc tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:56.951288 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-07dd9c4e-4168-4236-8122-93f1c6185cfc tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:56.951951 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-07dd9c4e-4168-4236-8122-93f1c6185cfc tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:56.952500 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-07dd9c4e-4168-4236-8122-93f1c6185cfc tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:56.989280 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-07dd9c4e-4168-4236-8122-93f1c6185cfc tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Getting quotas for project d08d010c14a64f759887be0d2364c6e4. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:14:56.996076 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-07dd9c4e-4168-4236-8122-93f1c6185cfc tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Getting quotas for user 32fc1959d8aa41eabcead217b9d7bc47 and project d08d010c14a64f759887be0d2364c6e4. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:14:57.014816 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-07dd9c4e-4168-4236-8122-93f1c6185cfc tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:14:57.018036 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-07dd9c4e-4168-4236-8122-93f1c6185cfc tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 2142aec1-a473-42c4-8676-84c497d613e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:14:57.079769 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-07dd9c4e-4168-4236-8122-93f1c6185cfc tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.286481 Aug 07 01:14:57.081810 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 517/1164] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:14:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1289 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:14:57.088489 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7205a31c-780f-474f-bc68-59428fad5160 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:57.089519 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7205a31c-780f-474f-bc68-59428fad5160 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:57.097694 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7205a31c-780f-474f-bc68-59428fad5160 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:57.098622 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7205a31c-780f-474f-bc68-59428fad5160 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:57.099337 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7205a31c-780f-474f-bc68-59428fad5160 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:57.100425 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7205a31c-780f-474f-bc68-59428fad5160 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:57.100947 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7205a31c-780f-474f-bc68-59428fad5160 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:57.101593 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7205a31c-780f-474f-bc68-59428fad5160 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:57.468571 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e6d149e6-f141-4ff9-807b-c8e42fd4c275 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:57.477419 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e6d149e6-f141-4ff9-807b-c8e42fd4c275 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1477 microversion: 2.1 time: 0.888622 Aug 07 01:14:57.478473 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 648/1165] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:56 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1477 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:57.501557 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7d6341bf-453e-4def-9fbc-3f96054d5f30 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:57.502400 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7d6341bf-453e-4def-9fbc-3f96054d5f30 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: ea2ef6ca-2623-496d-a174-1d7cbaf80f85] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:57.518054 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d6341bf-453e-4def-9fbc-3f96054d5f30 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:57.525942 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d6341bf-453e-4def-9fbc-3f96054d5f30 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:57.526680 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d6341bf-453e-4def-9fbc-3f96054d5f30 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:57.527658 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d6341bf-453e-4def-9fbc-3f96054d5f30 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:57.528527 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d6341bf-453e-4def-9fbc-3f96054d5f30 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:57.529131 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d6341bf-453e-4def-9fbc-3f96054d5f30 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:58.135286 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7d6341bf-453e-4def-9fbc-3f96054d5f30 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f4a7231e4431c89712c557c4fa1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ac882e61ac45eb9abc60630e7337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:58.147431 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7d6341bf-453e-4def-9fbc-3f96054d5f30 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85" status: 200 len: 1323 microversion: 2.1 time: 0.663101 Aug 07 01:14:58.148656 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 649/1166] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:57 2022] GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85 => generated 1323 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:58.172425 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6dc590f9-69e4-4450-aa7d-0a0d07cb8894 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:58.174919 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6dc590f9-69e4-4450-aa7d-0a0d07cb8894 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 2142aec1-a473-42c4-8676-84c497d613e3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:58.189817 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6dc590f9-69e4-4450-aa7d-0a0d07cb8894 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:58.193570 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6dc590f9-69e4-4450-aa7d-0a0d07cb8894 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:58.194459 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6dc590f9-69e4-4450-aa7d-0a0d07cb8894 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:58.198517 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6dc590f9-69e4-4450-aa7d-0a0d07cb8894 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:58.200486 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6dc590f9-69e4-4450-aa7d-0a0d07cb8894 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:58.201123 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6dc590f9-69e4-4450-aa7d-0a0d07cb8894 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:58.355281 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6dc590f9-69e4-4450-aa7d-0a0d07cb8894 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:58.374403 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6dc590f9-69e4-4450-aa7d-0a0d07cb8894 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3" status: 200 len: 1269 microversion: 2.1 time: 0.221385 Aug 07 01:14:58.375045 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 650/1167] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:58 2022] GET /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3 => generated 1269 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:58.614337 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7205a31c-780f-474f-bc68-59428fad5160 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:14:58.649402 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7205a31c-780f-474f-bc68-59428fad5160 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 200 len: 1717 microversion: 2.1 time: 1.565701 Aug 07 01:14:58.655521 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 518/1168] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:57 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 1717 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:14:58.686056 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c6396673-9533-4aab-a7d1-cd1ae9d1d1e9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:58.690977 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c6396673-9533-4aab-a7d1-cd1ae9d1d1e9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:58.707469 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6396673-9533-4aab-a7d1-cd1ae9d1d1e9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:58.708967 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6396673-9533-4aab-a7d1-cd1ae9d1d1e9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:58.712627 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6396673-9533-4aab-a7d1-cd1ae9d1d1e9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:58.713809 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6396673-9533-4aab-a7d1-cd1ae9d1d1e9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:58.716016 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6396673-9533-4aab-a7d1-cd1ae9d1d1e9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:58.718157 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6396673-9533-4aab-a7d1-cd1ae9d1d1e9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:58.798876 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-50dea792-c95e-40b8-b60a-af7367612994 req-757f5b51-332b-4d18-8d2e-596cee9f841e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45de519b-ab33-4648-9aa0-b9da5e3f1ef3", "tag": "473f3c7a-5b88-453d-a65c-373cab90ea67"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:58.829345 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-50dea792-c95e-40b8-b60a-af7367612994 req-757f5b51-332b-4d18-8d2e-596cee9f841e service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:58.837721 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-50dea792-c95e-40b8-b60a-af7367612994 req-757f5b51-332b-4d18-8d2e-596cee9f841e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:58.839037 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-50dea792-c95e-40b8-b60a-af7367612994 req-757f5b51-332b-4d18-8d2e-596cee9f841e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:58.887977 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-50dea792-c95e-40b8-b60a-af7367612994 req-757f5b51-332b-4d18-8d2e-596cee9f841e service nova] Creating event network-changed:473f3c7a-5b88-453d-a65c-373cab90ea67 for instance 45de519b-ab33-4648-9aa0-b9da5e3f1ef3 on n-h2-master-1 Aug 07 01:14:58.905847 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-50dea792-c95e-40b8-b60a-af7367612994 req-757f5b51-332b-4d18-8d2e-596cee9f841e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.527433 Aug 07 01:14:58.907971 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 651/1169] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:14:59.330453 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-bcf01256-e195-46b8-84ab-9773f218e8b6 req-4675b333-2ab3-4f1f-8e42-bf4947c4d9d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea2ef6ca-2623-496d-a174-1d7cbaf80f85", "tag": "cf46b89b-456e-4233-b0d8-40780fd11074"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:14:59.371387 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-bcf01256-e195-46b8-84ab-9773f218e8b6 req-4675b333-2ab3-4f1f-8e42-bf4947c4d9d7 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:59.375376 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-bcf01256-e195-46b8-84ab-9773f218e8b6 req-4675b333-2ab3-4f1f-8e42-bf4947c4d9d7 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:59.377836 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-bcf01256-e195-46b8-84ab-9773f218e8b6 req-4675b333-2ab3-4f1f-8e42-bf4947c4d9d7 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:59.433706 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-bcf01256-e195-46b8-84ab-9773f218e8b6 req-4675b333-2ab3-4f1f-8e42-bf4947c4d9d7 service nova] Creating event network-changed:cf46b89b-456e-4233-b0d8-40780fd11074 for instance ea2ef6ca-2623-496d-a174-1d7cbaf80f85 on n-h1-master-1 Aug 07 01:14:59.458502 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-bcf01256-e195-46b8-84ab-9773f218e8b6 req-4675b333-2ab3-4f1f-8e42-bf4947c4d9d7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.542191 Aug 07 01:14:59.459233 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 652/1170] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:14:59.475350 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1ccc31bc-3197-4a6b-b8df-b962a93906cf tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:14:59.481488 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1ccc31bc-3197-4a6b-b8df-b962a93906cf tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:14:59.504234 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ccc31bc-3197-4a6b-b8df-b962a93906cf tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:59.511423 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ccc31bc-3197-4a6b-b8df-b962a93906cf tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:59.518119 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ccc31bc-3197-4a6b-b8df-b962a93906cf tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:59.519071 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ccc31bc-3197-4a6b-b8df-b962a93906cf tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:14:59.521396 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ccc31bc-3197-4a6b-b8df-b962a93906cf tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:14:59.522156 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ccc31bc-3197-4a6b-b8df-b962a93906cf tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:14:59.619712 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:59.922828 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:00.132344 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c6396673-9533-4aab-a7d1-cd1ae9d1d1e9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:00.149886 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c6396673-9533-4aab-a7d1-cd1ae9d1d1e9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1313 microversion: 2.1 time: 1.475402 Aug 07 01:15:00.153192 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 519/1171] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:58 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1313 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:00.166599 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-dce36898-2bcc-4bb7-8f6d-b5f071f402c7 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:00.173718 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-dce36898-2bcc-4bb7-8f6d-b5f071f402c7 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: ea2ef6ca-2623-496d-a174-1d7cbaf80f85] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:00.190213 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dce36898-2bcc-4bb7-8f6d-b5f071f402c7 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:00.191354 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dce36898-2bcc-4bb7-8f6d-b5f071f402c7 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:00.196559 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dce36898-2bcc-4bb7-8f6d-b5f071f402c7 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:00.199913 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dce36898-2bcc-4bb7-8f6d-b5f071f402c7 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:00.200426 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dce36898-2bcc-4bb7-8f6d-b5f071f402c7 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:00.204267 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dce36898-2bcc-4bb7-8f6d-b5f071f402c7 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:00.862187 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1ccc31bc-3197-4a6b-b8df-b962a93906cf tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:00.872771 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1ccc31bc-3197-4a6b-b8df-b962a93906cf tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1477 microversion: 2.1 time: 1.409804 Aug 07 01:15:00.875397 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 653/1172] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:14:59 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1477 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:00.880586 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-3348f48a-ad56-4061-acc0-017f08db50ae req-e2d21069-c7bd-4fe4-8e0b-fc87a3727ac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "766de05a-a562-4045-bdf9-c49050382e1a", "name": "network-vif-unplugged", "status": "completed", "tag": "a4899c9a-669a-4c98-bfc8-6b6f7b2c3f93"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:15:00.894137 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3348f48a-ad56-4061-acc0-017f08db50ae req-e2d21069-c7bd-4fe4-8e0b-fc87a3727ac9 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:00.895873 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3348f48a-ad56-4061-acc0-017f08db50ae req-e2d21069-c7bd-4fe4-8e0b-fc87a3727ac9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:00.896654 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3348f48a-ad56-4061-acc0-017f08db50ae req-e2d21069-c7bd-4fe4-8e0b-fc87a3727ac9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:00.915329 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-3348f48a-ad56-4061-acc0-017f08db50ae req-e2d21069-c7bd-4fe4-8e0b-fc87a3727ac9 service nova] Creating event network-vif-unplugged:a4899c9a-669a-4c98-bfc8-6b6f7b2c3f93 for instance 766de05a-a562-4045-bdf9-c49050382e1a on n-h1-master-1 Aug 07 01:15:00.922836 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-3348f48a-ad56-4061-acc0-017f08db50ae req-e2d21069-c7bd-4fe4-8e0b-fc87a3727ac9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045915 Aug 07 01:15:00.925562 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 654/1173] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:00.933308 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-adef45e4-4123-45a9-9e7c-98d90d5c190e tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:00.934249 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-adef45e4-4123-45a9-9e7c-98d90d5c190e tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 2142aec1-a473-42c4-8676-84c497d613e3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:00.943232 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-adef45e4-4123-45a9-9e7c-98d90d5c190e tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:00.944447 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-adef45e4-4123-45a9-9e7c-98d90d5c190e tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:00.945247 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-adef45e4-4123-45a9-9e7c-98d90d5c190e tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:00.947052 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-adef45e4-4123-45a9-9e7c-98d90d5c190e tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:00.948606 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-adef45e4-4123-45a9-9e7c-98d90d5c190e tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:00.949244 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-adef45e4-4123-45a9-9e7c-98d90d5c190e tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:01.194960 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-adef45e4-4123-45a9-9e7c-98d90d5c190e tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:01.210623 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-adef45e4-4123-45a9-9e7c-98d90d5c190e tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3" status: 200 len: 1275 microversion: 2.1 time: 0.283111 Aug 07 01:15:01.218940 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 655/1174] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:00 2022] GET /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3 => generated 1275 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:01.227144 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-dce36898-2bcc-4bb7-8f6d-b5f071f402c7 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f4a7231e4431c89712c557c4fa1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ac882e61ac45eb9abc60630e7337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:01.251828 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-dce36898-2bcc-4bb7-8f6d-b5f071f402c7 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85" status: 200 len: 1323 microversion: 2.1 time: 1.085658 Aug 07 01:15:01.256032 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 520/1175] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:00 2022] GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85 => generated 1323 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:01.266807 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-97b7ad3b-f4ff-496d-abbe-a1c1ee507b23 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:01.267431 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-97b7ad3b-f4ff-496d-abbe-a1c1ee507b23 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:01.286217 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-97b7ad3b-f4ff-496d-abbe-a1c1ee507b23 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:01.286710 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-97b7ad3b-f4ff-496d-abbe-a1c1ee507b23 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:01.287145 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-97b7ad3b-f4ff-496d-abbe-a1c1ee507b23 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:01.287871 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-97b7ad3b-f4ff-496d-abbe-a1c1ee507b23 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:01.288354 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-97b7ad3b-f4ff-496d-abbe-a1c1ee507b23 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:01.288785 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-97b7ad3b-f4ff-496d-abbe-a1c1ee507b23 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:01.669202 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-faa271ba-3fc5-410c-ad0b-8331db52f038 tempest-SecurityGroupsNegativeTestJSON-2031332014 tempest-SecurityGroupsNegativeTestJSON-2031332014-project] Calling method '.version_select at 0x7f9e242dcdc0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:01.845142 n-d-master-1 devstack@n-api.service[119517]: DEBUG neutronclient.v2_0.client [None req-faa271ba-3fc5-410c-ad0b-8331db52f038 tempest-SecurityGroupsNegativeTestJSON-2031332014 tempest-SecurityGroupsNegativeTestJSON-2031332014-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3001728c-a1b2-4d33-bc39-88ad31cadf9a does not exist", "detail": ""}} {{(pid=119517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 07 01:15:01.845756 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.security_group_api [None req-faa271ba-3fc5-410c-ad0b-8331db52f038 tempest-SecurityGroupsNegativeTestJSON-2031332014 tempest-SecurityGroupsNegativeTestJSON-2031332014-project] Neutron security group 3001728c-a1b2-4d33-bc39-88ad31cadf9a not found {{(pid=119517) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 07 01:15:01.846283 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-faa271ba-3fc5-410c-ad0b-8331db52f038 tempest-SecurityGroupsNegativeTestJSON-2031332014 tempest-SecurityGroupsNegativeTestJSON-2031332014-project] HTTP exception thrown: Security group 3001728c-a1b2-4d33-bc39-88ad31cadf9a does not exist Aug 07 01:15:01.846283 n-d-master-1 devstack@n-api.service[119517]: Neutron server returns request_ids: ['req-83a2f8a9-06cb-4730-8f05-dfc75c30fa24'] Aug 07 01:15:01.848582 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-faa271ba-3fc5-410c-ad0b-8331db52f038 tempest-SecurityGroupsNegativeTestJSON-2031332014 tempest-SecurityGroupsNegativeTestJSON-2031332014-project] Request method failure captured: Aug 07 01:15:01.848582 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/os-security-groups/3001728c-a1b2-4d33-bc39-88ad31cadf9a HTTP/1.1 Aug 07 01:15:01.848582 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:15:01.848582 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:15:01.848582 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:15:01.848582 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:15:01.848582 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:15:01.848582 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:15:01.848582 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:15:01.848582 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:15:01.848582 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xITg51EZsrTANxBnLEupUp7ZZ6hvJdMmcpT-JOt2VkajnUBZ25LXp9rm7ogMB8zbK8vxEv9TNRFzYnk_vY6fZTb1Z26uGW4hMC-8ySW1ZqDZ8cKAKDgaFIEMAaVTDTjFaKQOh5BCK8taBMYAtT2logo1PofiSRDId3q5uRrbuHJF2k Aug 07 01:15:01.848582 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:15:01.848582 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:15:01.848582 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:15:01.848582 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:15:01.848582 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:15:01.848582 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:15:01.848582 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: dab3ac719e1b4d6c913fc593c388dc3d Aug 07 01:15:01.848582 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2031332014 Aug 07 01:15:01.848582 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:15:01.848582 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:15:01.851398 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/dab3ac719e1b4d6c913fc593c388dc3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_dab3ac719e1b4d6c913fc593c388dc3d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/dab3ac719e1b4d6c913fc593c388dc3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/dab3ac719e1b4d6c913fc593c388dc3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:15:01.851398 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2031332014 Aug 07 01:15:01.851398 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: dab3ac719e1b4d6c913fc593c388dc3d Aug 07 01:15:01.851398 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2031332014 Aug 07 01:15:01.851398 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-SecurityGroupsNegativeTestJSON-2031332014-project Aug 07 01:15:01.851398 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:15:01.851398 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:15:01.851398 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 21219c93625d4e6b802d8a99b3e520d6 Aug 07 01:15:01.851398 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2031332014-project Aug 07 01:15:01.851398 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:15:01.851398 n-d-master-1 devstack@n-api.service[119517]: exception: Security group 3001728c-a1b2-4d33-bc39-88ad31cadf9a does not exist Aug 07 01:15:01.851398 n-d-master-1 devstack@n-api.service[119517]: Neutron server returns request_ids: ['req-83a2f8a9-06cb-4730-8f05-dfc75c30fa24'] Aug 07 01:15:01.851398 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '3001728c-a1b2-4d33-bc39-88ad31cadf9a'} Aug 07 01:15:01.854212 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:15:01.854212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:01.854212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 07 01:15:01.854212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 07 01:15:01.854212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:15:01.854212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:15:01.854212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 07 01:15:01.854212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 07 01:15:01.854212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:15:01.854212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:15:01.854212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 07 01:15:01.854212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 07 01:15:01.854212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:15:01.854212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:15:01.854212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 07 01:15:01.854212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 07 01:15:01.854212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:15:01.854212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:15:01.854212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 07 01:15:01.856727 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 07 01:15:01.856727 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:15:01.856727 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:15:01.856727 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 07 01:15:01.856727 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 07 01:15:01.856727 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 07 01:15:01.856727 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 07 01:15:01.856727 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3001728c-a1b2-4d33-bc39-88ad31cadf9a does not exist Aug 07 01:15:01.856727 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-83a2f8a9-06cb-4730-8f05-dfc75c30fa24'] Aug 07 01:15:01.856727 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:15:01.856727 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:15:01.856727 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:15:01.856727 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:01.856727 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 07 01:15:01.856727 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 07 01:15:01.856727 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 07 01:15:01.856727 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 07 01:15:01.856727 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3001728c-a1b2-4d33-bc39-88ad31cadf9a does not exist Aug 07 01:15:01.859262 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-83a2f8a9-06cb-4730-8f05-dfc75c30fa24'] Aug 07 01:15:01.859262 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:15:01.859262 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:15:01.859262 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:15:01.859262 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:01.859262 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:15:01.859262 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:15:01.859262 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:15:01.859262 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:15:01.859262 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:15:01.859262 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:15:01.859262 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:15:01.859262 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:15:01.859262 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 07 01:15:01.859262 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 07 01:15:01.859262 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3001728c-a1b2-4d33-bc39-88ad31cadf9a does not exist Aug 07 01:15:01.859262 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-83a2f8a9-06cb-4730-8f05-dfc75c30fa24'] Aug 07 01:15:01.859262 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:15:01.859262 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:15:01.859262 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:15:01.859262 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:01.862209 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:15:01.862209 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:15:01.862209 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:15:01.862209 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:15:01.862209 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3001728c-a1b2-4d33-bc39-88ad31cadf9a does not exist Aug 07 01:15:01.862209 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-83a2f8a9-06cb-4730-8f05-dfc75c30fa24'] Aug 07 01:15:01.862209 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:15:01.862209 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-faa271ba-3fc5-410c-ad0b-8331db52f038 tempest-SecurityGroupsNegativeTestJSON-2031332014 tempest-SecurityGroupsNegativeTestJSON-2031332014-project] Returning 404 to user: Security group 3001728c-a1b2-4d33-bc39-88ad31cadf9a does not exist Aug 07 01:15:01.862209 n-d-master-1 devstack@n-api.service[119517]: Neutron server returns request_ids: ['req-83a2f8a9-06cb-4730-8f05-dfc75c30fa24'] {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:15:01.862209 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-faa271ba-3fc5-410c-ad0b-8331db52f038 tempest-SecurityGroupsNegativeTestJSON-2031332014 tempest-SecurityGroupsNegativeTestJSON-2031332014-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/3001728c-a1b2-4d33-bc39-88ad31cadf9a" status: 404 len: 194 microversion: 2.1 time: 0.596409 Aug 07 01:15:01.862209 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 521/1176] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:15:01 2022] DELETE /compute/v2.1/os-security-groups/3001728c-a1b2-4d33-bc39-88ad31cadf9a => generated 194 bytes in 597 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:15:01.863772 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-fdf59171-a1bd-4c23-b0b5-9acbbf8008f9 req-21c295f8-bcdd-4a1a-9608-0da9ea5aed27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "634a7ed6-84df-4292-bc38-5129fb0f57c9", "tag": "93ab5068-1c0e-4ec2-bb1a-06cc1c07f96e"}, {"name": "network-changed", "server_uuid": "e6920f55-726f-4258-bc23-2a794668d6bb", "tag": "1cf0c711-e914-4498-9f47-8e34535de7c7"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:15:01.894694 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-fdf59171-a1bd-4c23-b0b5-9acbbf8008f9 req-21c295f8-bcdd-4a1a-9608-0da9ea5aed27 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:01.896303 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-fdf59171-a1bd-4c23-b0b5-9acbbf8008f9 req-21c295f8-bcdd-4a1a-9608-0da9ea5aed27 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:01.896303 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-fdf59171-a1bd-4c23-b0b5-9acbbf8008f9 req-21c295f8-bcdd-4a1a-9608-0da9ea5aed27 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:01.922934 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-fdf59171-a1bd-4c23-b0b5-9acbbf8008f9 req-21c295f8-bcdd-4a1a-9608-0da9ea5aed27 service nova] Creating event network-changed:93ab5068-1c0e-4ec2-bb1a-06cc1c07f96e for instance 634a7ed6-84df-4292-bc38-5129fb0f57c9 on n-h1-master-1 Aug 07 01:15:01.923448 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-fdf59171-a1bd-4c23-b0b5-9acbbf8008f9 req-21c295f8-bcdd-4a1a-9608-0da9ea5aed27 service nova] Creating event network-changed:1cf0c711-e914-4498-9f47-8e34535de7c7 for instance e6920f55-726f-4258-bc23-2a794668d6bb on n-h1-master-1 Aug 07 01:15:01.945060 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-fdf59171-a1bd-4c23-b0b5-9acbbf8008f9 req-21c295f8-bcdd-4a1a-9608-0da9ea5aed27 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.086900 Aug 07 01:15:01.957297 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 522/1177] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:01.967159 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-dcb1c9b0-a24d-4cef-b87b-f061cd14eb87 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:01.970129 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-dcb1c9b0-a24d-4cef-b87b-f061cd14eb87 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:01.991397 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dcb1c9b0-a24d-4cef-b87b-f061cd14eb87 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:02.001706 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dcb1c9b0-a24d-4cef-b87b-f061cd14eb87 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:02.002438 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dcb1c9b0-a24d-4cef-b87b-f061cd14eb87 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:02.004046 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dcb1c9b0-a24d-4cef-b87b-f061cd14eb87 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:02.004535 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dcb1c9b0-a24d-4cef-b87b-f061cd14eb87 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:02.004979 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dcb1c9b0-a24d-4cef-b87b-f061cd14eb87 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:02.808792 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-dcb1c9b0-a24d-4cef-b87b-f061cd14eb87 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:02.828543 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-dcb1c9b0-a24d-4cef-b87b-f061cd14eb87 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1313 microversion: 2.1 time: 0.867324 Aug 07 01:15:02.830178 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 523/1178] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:01 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1313 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:02.852058 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-97b7ad3b-f4ff-496d-abbe-a1c1ee507b23 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:02.876776 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-97b7ad3b-f4ff-496d-abbe-a1c1ee507b23 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 200 len: 1717 microversion: 2.1 time: 1.626808 Aug 07 01:15:02.877789 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 656/1179] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:01 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 1717 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:02.886905 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cb414c40-7899-4e0d-9fae-2de80d1ae164 tempest-SecurityGroupsNegativeTestJSON-2031332014 tempest-SecurityGroupsNegativeTestJSON-2031332014-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.007399 Aug 07 01:15:02.899978 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 657/1180] 10.222.0.39 () {58 vars in 1164 bytes} [Sun Aug 7 01:15:02 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 21 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 07 01:15:02.907081 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c94e5b2b-68ed-447e-85d8-0129f1230ecf tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:02.908178 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c94e5b2b-68ed-447e-85d8-0129f1230ecf tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:02.916992 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c94e5b2b-68ed-447e-85d8-0129f1230ecf tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:02.918368 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c94e5b2b-68ed-447e-85d8-0129f1230ecf tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:02.922102 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c94e5b2b-68ed-447e-85d8-0129f1230ecf tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:02.923985 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c94e5b2b-68ed-447e-85d8-0129f1230ecf tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:02.924703 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c94e5b2b-68ed-447e-85d8-0129f1230ecf tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:02.929206 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c94e5b2b-68ed-447e-85d8-0129f1230ecf tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:02.976105 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1fb12377-9369-4135-89de-30e002cbd940 tempest-FlavorsV261TestJSON-721037942 tempest-FlavorsV261TestJSON-721037942-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1513748464", "id": 1663065491, "os-flavor-access:is_public": "True"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:15:02.981174 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:15:02.981174 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:15:03.014283 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1fb12377-9369-4135-89de-30e002cbd940 tempest-FlavorsV261TestJSON-721037942 tempest-FlavorsV261TestJSON-721037942-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.181442 Aug 07 01:15:03.015621 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 524/1181] 10.222.0.39 () {62 vars in 1188 bytes} [Sun Aug 7 01:15:02 2022] POST /compute/v2.1/flavors => generated 468 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:15:03.029860 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-15edb5b2-3373-4260-84ed-654431c43d23 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:03.031516 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-15edb5b2-3373-4260-84ed-654431c43d23 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 2142aec1-a473-42c4-8676-84c497d613e3] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:03.039846 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15edb5b2-3373-4260-84ed-654431c43d23 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:03.041338 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15edb5b2-3373-4260-84ed-654431c43d23 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:03.042059 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15edb5b2-3373-4260-84ed-654431c43d23 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:03.043202 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15edb5b2-3373-4260-84ed-654431c43d23 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:03.043914 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15edb5b2-3373-4260-84ed-654431c43d23 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:03.044563 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15edb5b2-3373-4260-84ed-654431c43d23 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:03.174402 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-15edb5b2-3373-4260-84ed-654431c43d23 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:03.183675 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-15edb5b2-3373-4260-84ed-654431c43d23 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3" status: 200 len: 1275 microversion: 2.1 time: 0.166476 Aug 07 01:15:03.200645 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 525/1182] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:03 2022] GET /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3 => generated 1275 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:03.210519 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-19209be6-6008-4add-a105-5613edf5eab8 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:03.212061 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-19209be6-6008-4add-a105-5613edf5eab8 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: ea2ef6ca-2623-496d-a174-1d7cbaf80f85] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:03.223379 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-19209be6-6008-4add-a105-5613edf5eab8 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:03.223906 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-19209be6-6008-4add-a105-5613edf5eab8 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:03.224369 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-19209be6-6008-4add-a105-5613edf5eab8 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:03.225144 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-19209be6-6008-4add-a105-5613edf5eab8 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:03.225664 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-19209be6-6008-4add-a105-5613edf5eab8 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:03.226165 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-19209be6-6008-4add-a105-5613edf5eab8 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:03.424727 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c94e5b2b-68ed-447e-85d8-0129f1230ecf tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:03.451115 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c94e5b2b-68ed-447e-85d8-0129f1230ecf tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1477 microversion: 2.1 time: 0.549224 Aug 07 01:15:03.453658 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 658/1183] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:02 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1477 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:03.462678 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7db388e5-5fa9-4ef1-b46c-a70cccb8bbaa tempest-SecurityGroupsNegativeTestJSON-2031332014 tempest-SecurityGroupsNegativeTestJSON-2031332014-project] Calling method '.version_select at 0x7f9e246e1940>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:03.496650 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-19209be6-6008-4add-a105-5613edf5eab8 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f4a7231e4431c89712c557c4fa1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ac882e61ac45eb9abc60630e7337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:03.516157 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-19209be6-6008-4add-a105-5613edf5eab8 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85" status: 200 len: 1323 microversion: 2.1 time: 0.313801 Aug 07 01:15:03.523934 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 526/1184] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:03 2022] GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85 => generated 1323 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:03.538250 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-b6053594-eb6c-4315-afd2-b8552d4310b1 req-fe585373-4d83-4135-b682-af3f432f74a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "766de05a-a562-4045-bdf9-c49050382e1a", "name": "network-vif-plugged", "status": "completed", "tag": "a4899c9a-669a-4c98-bfc8-6b6f7b2c3f93"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:15:03.560616 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b6053594-eb6c-4315-afd2-b8552d4310b1 req-fe585373-4d83-4135-b682-af3f432f74a9 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:03.561109 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b6053594-eb6c-4315-afd2-b8552d4310b1 req-fe585373-4d83-4135-b682-af3f432f74a9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:03.561555 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b6053594-eb6c-4315-afd2-b8552d4310b1 req-fe585373-4d83-4135-b682-af3f432f74a9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:03.586534 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-b6053594-eb6c-4315-afd2-b8552d4310b1 req-fe585373-4d83-4135-b682-af3f432f74a9 service nova] Creating event network-vif-plugged:a4899c9a-669a-4c98-bfc8-6b6f7b2c3f93 for instance 766de05a-a562-4045-bdf9-c49050382e1a on n-h1-master-1 Aug 07 01:15:03.605096 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-b6053594-eb6c-4315-afd2-b8552d4310b1 req-fe585373-4d83-4135-b682-af3f432f74a9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077319 Aug 07 01:15:03.605713 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 527/1185] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:03.851086 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-210815f1-a6c5-4899-a07b-60da8ccd19c0 tempest-FlavorsV261TestJSON-1984847673 tempest-FlavorsV261TestJSON-1984847673-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:03.879160 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-210815f1-a6c5-4899-a07b-60da8ccd19c0 tempest-FlavorsV261TestJSON-1984847673 tempest-FlavorsV261TestJSON-1984847673-project] 10.222.0.39 "GET /compute/v2.1/flavors/1663065491" status: 200 len: 468 microversion: 2.61 time: 0.268700 Aug 07 01:15:03.880276 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 528/1186] 10.222.0.39 () {60 vars in 1199 bytes} [Sun Aug 7 01:15:03 2022] GET /compute/v2.1/flavors/1663065491 => generated 468 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:15:03.886122 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d360e822-e176-4b8f-b6ce-806b598048d3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:03.887088 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d360e822-e176-4b8f-b6ce-806b598048d3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:03.897237 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d360e822-e176-4b8f-b6ce-806b598048d3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:03.897988 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d360e822-e176-4b8f-b6ce-806b598048d3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:03.899941 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d360e822-e176-4b8f-b6ce-806b598048d3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:03.902114 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d360e822-e176-4b8f-b6ce-806b598048d3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:03.902773 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d360e822-e176-4b8f-b6ce-806b598048d3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:03.903968 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d360e822-e176-4b8f-b6ce-806b598048d3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:04.117663 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7db388e5-5fa9-4ef1-b46c-a70cccb8bbaa tempest-SecurityGroupsNegativeTestJSON-2031332014 tempest-SecurityGroupsNegativeTestJSON-2031332014-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.662493 Aug 07 01:15:04.127072 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 659/1187] 10.222.0.39 () {58 vars in 1158 bytes} [Sun Aug 7 01:15:03 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:04.127072 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-24cf1910-5c85-4566-a5b0-fbf6f1e6a624 tempest-FlavorsV261TestJSON-721037942 tempest-FlavorsV261TestJSON-721037942-project-admin] Action: 'update', calling method: .version_select at 0x7f9e27531dc0>, body: {"flavor": {"description": "new"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:15:04.170646 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:15:04.170646 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:15:04.249088 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-24cf1910-5c85-4566-a5b0-fbf6f1e6a624 tempest-FlavorsV261TestJSON-721037942 tempest-FlavorsV261TestJSON-721037942-project-admin] 10.222.0.39 "PUT /compute/v2.1/flavors/1663065491" status: 200 len: 469 microversion: 2.61 time: 0.128096 Aug 07 01:15:04.253104 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 660/1188] 10.222.0.39 () {62 vars in 1219 bytes} [Sun Aug 7 01:15:04 2022] PUT /compute/v2.1/flavors/1663065491 => generated 469 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:15:04.264647 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-406e7455-fa3e-4c62-b4fa-054a678cd3cf tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:04.268699 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-406e7455-fa3e-4c62-b4fa-054a678cd3cf tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:04.287176 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-406e7455-fa3e-4c62-b4fa-054a678cd3cf tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:04.287814 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-406e7455-fa3e-4c62-b4fa-054a678cd3cf tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:04.290869 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-406e7455-fa3e-4c62-b4fa-054a678cd3cf tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:04.291848 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-406e7455-fa3e-4c62-b4fa-054a678cd3cf tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:04.292452 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-406e7455-fa3e-4c62-b4fa-054a678cd3cf tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:04.293845 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-406e7455-fa3e-4c62-b4fa-054a678cd3cf tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:04.418823 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d360e822-e176-4b8f-b6ce-806b598048d3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:04.433017 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d360e822-e176-4b8f-b6ce-806b598048d3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1313 microversion: 2.1 time: 0.551348 Aug 07 01:15:04.433702 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 529/1189] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:03 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1313 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:04.447485 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-90f7fecc-d004-4978-b12d-635db68f4680 tempest-SecurityGroupsNegativeTestJSON-2031332014 tempest-SecurityGroupsNegativeTestJSON-2031332014-project] Calling method '.version_select at 0x7f9e24359280>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:04.553325 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-406e7455-fa3e-4c62-b4fa-054a678cd3cf tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:04.568270 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-406e7455-fa3e-4c62-b4fa-054a678cd3cf tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 200 len: 1717 microversion: 2.1 time: 0.313657 Aug 07 01:15:04.583688 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 661/1190] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:04 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 1717 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:04.622611 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f3566ab1-0908-436e-a816-a273dbe349e5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:04.627744 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f3566ab1-0908-436e-a816-a273dbe349e5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 2142aec1-a473-42c4-8676-84c497d613e3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:04.636496 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f3566ab1-0908-436e-a816-a273dbe349e5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:04.637371 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f3566ab1-0908-436e-a816-a273dbe349e5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:04.650129 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f3566ab1-0908-436e-a816-a273dbe349e5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:04.651204 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f3566ab1-0908-436e-a816-a273dbe349e5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:04.651920 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f3566ab1-0908-436e-a816-a273dbe349e5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:04.652528 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f3566ab1-0908-436e-a816-a273dbe349e5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:04.825735 n-d-master-1 devstack@n-api.service[119517]: DEBUG neutronclient.v2_0.client [None req-90f7fecc-d004-4978-b12d-635db68f4680 tempest-SecurityGroupsNegativeTestJSON-2031332014 tempest-SecurityGroupsNegativeTestJSON-2031332014-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=119517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 07 01:15:04.826780 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-90f7fecc-d004-4978-b12d-635db68f4680 tempest-SecurityGroupsNegativeTestJSON-2031332014 tempest-SecurityGroupsNegativeTestJSON-2031332014-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 07 01:15:04.826780 n-d-master-1 devstack@n-api.service[119517]: Neutron server returns request_ids: ['req-3d2479ce-6d2e-48f6-8987-bfe698aba508'] Aug 07 01:15:04.830391 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-90f7fecc-d004-4978-b12d-635db68f4680 tempest-SecurityGroupsNegativeTestJSON-2031332014 tempest-SecurityGroupsNegativeTestJSON-2031332014-project] Request method failure captured: Aug 07 01:15:04.830391 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/os-security-groups/6d5fd5c1-7a2e-4938-9a4a-8e30893d3972 HTTP/1.1 Aug 07 01:15:04.830391 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:15:04.830391 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:15:04.830391 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:15:04.830391 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:15:04.830391 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:15:04.830391 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:15:04.830391 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:15:04.830391 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:15:04.830391 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xITg51EZsrTANxBnLEupUp7ZZ6hvJdMmcpT-JOt2VkajnUBZ25LXp9rm7ogMB8zbK8vxEv9TNRFzYnk_vY6fZTb1Z26uGW4hMC-8ySW1ZqDZ8cKAKDgaFIEMAaVTDTjFaKQOh5BCK8taBMYAtT2logo1PofiSRDId3q5uRrbuHJF2k Aug 07 01:15:04.830391 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:15:04.830391 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:15:04.830391 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:15:04.830391 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:15:04.830391 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:15:04.830391 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:15:04.830391 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: dab3ac719e1b4d6c913fc593c388dc3d Aug 07 01:15:04.830391 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2031332014 Aug 07 01:15:04.830391 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:15:04.830391 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:15:04.832323 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/dab3ac719e1b4d6c913fc593c388dc3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_dab3ac719e1b4d6c913fc593c388dc3d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/dab3ac719e1b4d6c913fc593c388dc3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/dab3ac719e1b4d6c913fc593c388dc3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:15:04.832323 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2031332014 Aug 07 01:15:04.832323 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: dab3ac719e1b4d6c913fc593c388dc3d Aug 07 01:15:04.832323 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2031332014 Aug 07 01:15:04.832323 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-SecurityGroupsNegativeTestJSON-2031332014-project Aug 07 01:15:04.832323 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:15:04.832323 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:15:04.832323 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 21219c93625d4e6b802d8a99b3e520d6 Aug 07 01:15:04.832323 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2031332014-project Aug 07 01:15:04.832323 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:15:04.832323 n-d-master-1 devstack@n-api.service[119517]: exception: Insufficient rights for removing default security group. Aug 07 01:15:04.832323 n-d-master-1 devstack@n-api.service[119517]: Neutron server returns request_ids: ['req-3d2479ce-6d2e-48f6-8987-bfe698aba508'] Aug 07 01:15:04.832323 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '6d5fd5c1-7a2e-4938-9a4a-8e30893d3972'} Aug 07 01:15:04.833266 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:15:04.833266 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:04.833266 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 07 01:15:04.833266 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 07 01:15:04.833266 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:15:04.833266 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:15:04.833266 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 07 01:15:04.833266 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 07 01:15:04.833266 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:15:04.833266 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:15:04.833266 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 07 01:15:04.833266 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 07 01:15:04.833266 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:15:04.833266 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:15:04.833266 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 07 01:15:04.833266 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 07 01:15:04.833266 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:15:04.833266 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:15:04.833266 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 07 01:15:04.834482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 07 01:15:04.834482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:15:04.834482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:15:04.834482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 07 01:15:04.834482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 07 01:15:04.834482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 07 01:15:04.834482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 07 01:15:04.834482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 07 01:15:04.834482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3d2479ce-6d2e-48f6-8987-bfe698aba508'] Aug 07 01:15:04.834482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:15:04.834482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:15:04.834482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:15:04.834482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:04.834482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 07 01:15:04.834482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 07 01:15:04.834482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 07 01:15:04.834482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 07 01:15:04.834482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 07 01:15:04.834482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3d2479ce-6d2e-48f6-8987-bfe698aba508'] Aug 07 01:15:04.836388 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:15:04.836388 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:15:04.836388 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:15:04.836388 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:04.836388 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:15:04.836388 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:15:04.836388 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:15:04.836388 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:15:04.836388 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:15:04.836388 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:15:04.836388 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:15:04.836388 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:15:04.836388 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 07 01:15:04.836388 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 07 01:15:04.836388 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 07 01:15:04.836388 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3d2479ce-6d2e-48f6-8987-bfe698aba508'] Aug 07 01:15:04.836388 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:15:04.836388 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:15:04.836388 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:15:04.836388 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:04.836388 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:15:04.837818 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:15:04.837818 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:15:04.837818 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:15:04.837818 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 07 01:15:04.837818 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3d2479ce-6d2e-48f6-8987-bfe698aba508'] Aug 07 01:15:04.837818 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:15:04.841507 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-90f7fecc-d004-4978-b12d-635db68f4680 tempest-SecurityGroupsNegativeTestJSON-2031332014 tempest-SecurityGroupsNegativeTestJSON-2031332014-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 07 01:15:04.841507 n-d-master-1 devstack@n-api.service[119517]: Neutron server returns request_ids: ['req-3d2479ce-6d2e-48f6-8987-bfe698aba508'] {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:15:04.842905 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-90f7fecc-d004-4978-b12d-635db68f4680 tempest-SecurityGroupsNegativeTestJSON-2031332014 tempest-SecurityGroupsNegativeTestJSON-2031332014-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/6d5fd5c1-7a2e-4938-9a4a-8e30893d3972" status: 400 len: 182 microversion: 2.1 time: 0.404876 Aug 07 01:15:04.844672 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 530/1191] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:15:04 2022] DELETE /compute/v2.1/os-security-groups/6d5fd5c1-7a2e-4938-9a4a-8e30893d3972 => generated 182 bytes in 410 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:15:04.859737 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cf9cdfbb-4ebe-41c8-b4a3-a9d59c495987 tempest-FlavorsV261TestJSON-1984847673 tempest-FlavorsV261TestJSON-1984847673-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:04.939532 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cf9cdfbb-4ebe-41c8-b4a3-a9d59c495987 tempest-FlavorsV261TestJSON-1984847673 tempest-FlavorsV261TestJSON-1984847673-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 6250 microversion: 2.61 time: 0.093368 Aug 07 01:15:04.941142 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 531/1192] 10.222.0.39 () {60 vars in 1187 bytes} [Sun Aug 7 01:15:04 2022] GET /compute/v2.1/flavors/detail => generated 6250 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:15:04.962273 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1052ded1-6ea2-4575-b721-5b9c7f585380 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:04.963333 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1052ded1-6ea2-4575-b721-5b9c7f585380 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:04.986797 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1052ded1-6ea2-4575-b721-5b9c7f585380 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:04.987856 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1052ded1-6ea2-4575-b721-5b9c7f585380 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:04.988609 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1052ded1-6ea2-4575-b721-5b9c7f585380 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:04.989630 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1052ded1-6ea2-4575-b721-5b9c7f585380 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:04.990376 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1052ded1-6ea2-4575-b721-5b9c7f585380 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:04.991035 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1052ded1-6ea2-4575-b721-5b9c7f585380 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:05.235642 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f3566ab1-0908-436e-a816-a273dbe349e5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:05.253705 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f3566ab1-0908-436e-a816-a273dbe349e5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3" status: 200 len: 1317 microversion: 2.1 time: 0.651748 Aug 07 01:15:05.254886 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 662/1193] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:04 2022] GET /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3 => generated 1317 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:05.341180 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6366a3c8-9961-42fa-bd06-a7e38480b134 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:05.346941 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6366a3c8-9961-42fa-bd06-a7e38480b134 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: ea2ef6ca-2623-496d-a174-1d7cbaf80f85] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:05.397776 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1052ded1-6ea2-4575-b721-5b9c7f585380 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:05.399329 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6366a3c8-9961-42fa-bd06-a7e38480b134 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:05.405404 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6366a3c8-9961-42fa-bd06-a7e38480b134 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:05.407202 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6366a3c8-9961-42fa-bd06-a7e38480b134 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:05.410500 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6366a3c8-9961-42fa-bd06-a7e38480b134 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:05.412007 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6366a3c8-9961-42fa-bd06-a7e38480b134 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:05.415691 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6366a3c8-9961-42fa-bd06-a7e38480b134 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:05.421238 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1052ded1-6ea2-4575-b721-5b9c7f585380 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1477 microversion: 2.1 time: 0.478143 Aug 07 01:15:05.426486 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 532/1194] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:04 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1477 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:05.443827 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d8f5a5d9-040b-4825-8d25-2bb03911589b tempest-SecurityGroupsNegativeTestJSON-2031332014 tempest-SecurityGroupsNegativeTestJSON-2031332014-project] Calling method '.version_select at 0x7f9e2433f160>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:05.513549 n-d-master-1 devstack@n-api.service[119517]: DEBUG neutronclient.v2_0.client [None req-d8f5a5d9-040b-4825-8d25-2bb03911589b tempest-SecurityGroupsNegativeTestJSON-2031332014 tempest-SecurityGroupsNegativeTestJSON-2031332014-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group eb875311-2818-41f5-81ed-ede14542ec96 does not exist", "detail": ""}} {{(pid=119517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 07 01:15:05.514329 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.security_group_api [None req-d8f5a5d9-040b-4825-8d25-2bb03911589b tempest-SecurityGroupsNegativeTestJSON-2031332014 tempest-SecurityGroupsNegativeTestJSON-2031332014-project] Neutron security group eb875311-2818-41f5-81ed-ede14542ec96 not found {{(pid=119517) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 07 01:15:05.515103 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-d8f5a5d9-040b-4825-8d25-2bb03911589b tempest-SecurityGroupsNegativeTestJSON-2031332014 tempest-SecurityGroupsNegativeTestJSON-2031332014-project] HTTP exception thrown: Security group eb875311-2818-41f5-81ed-ede14542ec96 does not exist Aug 07 01:15:05.515103 n-d-master-1 devstack@n-api.service[119517]: Neutron server returns request_ids: ['req-c57cc32b-8116-43f0-bc62-cdcc1879a259'] Aug 07 01:15:05.518453 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d8f5a5d9-040b-4825-8d25-2bb03911589b tempest-SecurityGroupsNegativeTestJSON-2031332014 tempest-SecurityGroupsNegativeTestJSON-2031332014-project] Request method failure captured: Aug 07 01:15:05.518453 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/os-security-groups/eb875311-2818-41f5-81ed-ede14542ec96 HTTP/1.1 Aug 07 01:15:05.518453 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:15:05.518453 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:15:05.518453 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:15:05.518453 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:15:05.518453 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:15:05.518453 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:15:05.518453 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:15:05.518453 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:15:05.518453 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xITg51EZsrTANxBnLEupUp7ZZ6hvJdMmcpT-JOt2VkajnUBZ25LXp9rm7ogMB8zbK8vxEv9TNRFzYnk_vY6fZTb1Z26uGW4hMC-8ySW1ZqDZ8cKAKDgaFIEMAaVTDTjFaKQOh5BCK8taBMYAtT2logo1PofiSRDId3q5uRrbuHJF2k Aug 07 01:15:05.518453 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:15:05.518453 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:15:05.518453 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:15:05.518453 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:15:05.518453 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:15:05.518453 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:15:05.518453 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: dab3ac719e1b4d6c913fc593c388dc3d Aug 07 01:15:05.518453 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2031332014 Aug 07 01:15:05.518453 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:15:05.518453 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:15:05.520745 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/dab3ac719e1b4d6c913fc593c388dc3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_dab3ac719e1b4d6c913fc593c388dc3d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/dab3ac719e1b4d6c913fc593c388dc3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/dab3ac719e1b4d6c913fc593c388dc3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:15:05.520745 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2031332014 Aug 07 01:15:05.520745 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: dab3ac719e1b4d6c913fc593c388dc3d Aug 07 01:15:05.520745 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2031332014 Aug 07 01:15:05.520745 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-SecurityGroupsNegativeTestJSON-2031332014-project Aug 07 01:15:05.520745 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:15:05.520745 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:15:05.520745 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 21219c93625d4e6b802d8a99b3e520d6 Aug 07 01:15:05.520745 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2031332014-project Aug 07 01:15:05.520745 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:15:05.520745 n-d-master-1 devstack@n-api.service[119517]: exception: Security group eb875311-2818-41f5-81ed-ede14542ec96 does not exist Aug 07 01:15:05.520745 n-d-master-1 devstack@n-api.service[119517]: Neutron server returns request_ids: ['req-c57cc32b-8116-43f0-bc62-cdcc1879a259'] Aug 07 01:15:05.520745 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'eb875311-2818-41f5-81ed-ede14542ec96'} Aug 07 01:15:05.523680 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:15:05.523680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:05.523680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 07 01:15:05.523680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 07 01:15:05.523680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:15:05.523680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:15:05.523680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 07 01:15:05.523680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 07 01:15:05.523680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:15:05.523680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:15:05.523680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 07 01:15:05.523680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 07 01:15:05.523680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:15:05.523680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:15:05.523680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 07 01:15:05.523680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 07 01:15:05.523680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:15:05.523680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:15:05.523680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 07 01:15:05.526938 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 07 01:15:05.526938 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:15:05.526938 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:15:05.526938 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 07 01:15:05.526938 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 07 01:15:05.526938 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 07 01:15:05.526938 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 07 01:15:05.526938 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group eb875311-2818-41f5-81ed-ede14542ec96 does not exist Aug 07 01:15:05.526938 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c57cc32b-8116-43f0-bc62-cdcc1879a259'] Aug 07 01:15:05.526938 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:15:05.526938 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:15:05.526938 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:15:05.526938 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:05.526938 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 07 01:15:05.526938 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 07 01:15:05.526938 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 07 01:15:05.526938 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 07 01:15:05.526938 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group eb875311-2818-41f5-81ed-ede14542ec96 does not exist Aug 07 01:15:05.530562 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c57cc32b-8116-43f0-bc62-cdcc1879a259'] Aug 07 01:15:05.530562 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:15:05.530562 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:15:05.530562 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:15:05.530562 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:05.530562 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:15:05.530562 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:15:05.530562 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:15:05.530562 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:15:05.530562 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:15:05.530562 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:15:05.530562 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:15:05.530562 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:15:05.530562 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 07 01:15:05.530562 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 07 01:15:05.530562 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group eb875311-2818-41f5-81ed-ede14542ec96 does not exist Aug 07 01:15:05.530562 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c57cc32b-8116-43f0-bc62-cdcc1879a259'] Aug 07 01:15:05.530562 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:15:05.530562 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:15:05.530562 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:15:05.530562 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:05.534736 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:15:05.534736 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:15:05.534736 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:15:05.534736 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:15:05.534736 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group eb875311-2818-41f5-81ed-ede14542ec96 does not exist Aug 07 01:15:05.534736 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c57cc32b-8116-43f0-bc62-cdcc1879a259'] Aug 07 01:15:05.534736 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:15:05.534736 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d8f5a5d9-040b-4825-8d25-2bb03911589b tempest-SecurityGroupsNegativeTestJSON-2031332014 tempest-SecurityGroupsNegativeTestJSON-2031332014-project] Returning 404 to user: Security group eb875311-2818-41f5-81ed-ede14542ec96 does not exist Aug 07 01:15:05.534736 n-d-master-1 devstack@n-api.service[119517]: Neutron server returns request_ids: ['req-c57cc32b-8116-43f0-bc62-cdcc1879a259'] {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:15:05.534736 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d8f5a5d9-040b-4825-8d25-2bb03911589b tempest-SecurityGroupsNegativeTestJSON-2031332014 tempest-SecurityGroupsNegativeTestJSON-2031332014-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups/eb875311-2818-41f5-81ed-ede14542ec96" status: 404 len: 194 microversion: 2.1 time: 0.093487 Aug 07 01:15:05.534736 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 533/1195] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Aug 7 01:15:05 2022] GET /compute/v2.1/os-security-groups/eb875311-2818-41f5-81ed-ede14542ec96 => generated 194 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:15:05.538342 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e763e20a-8ffb-4017-b983-ae249b849e19 tempest-FlavorsV261TestJSON-1984847673 tempest-FlavorsV261TestJSON-1984847673-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:05.592817 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e763e20a-8ffb-4017-b983-ae249b849e19 tempest-FlavorsV261TestJSON-1984847673 tempest-FlavorsV261TestJSON-1984847673-project] 10.222.0.39 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.61 time: 0.064703 Aug 07 01:15:05.593542 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 534/1196] 10.222.0.39 () {60 vars in 1166 bytes} [Sun Aug 7 01:15:05 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:15:05.609272 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2d6a60d2-c236-4270-8ac2-fe74353a46aa tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:05.610284 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2d6a60d2-c236-4270-8ac2-fe74353a46aa tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:05.627595 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d6a60d2-c236-4270-8ac2-fe74353a46aa tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:05.628255 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d6a60d2-c236-4270-8ac2-fe74353a46aa tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:05.628537 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d6a60d2-c236-4270-8ac2-fe74353a46aa tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:05.629665 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d6a60d2-c236-4270-8ac2-fe74353a46aa tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:05.630317 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d6a60d2-c236-4270-8ac2-fe74353a46aa tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:05.630926 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d6a60d2-c236-4270-8ac2-fe74353a46aa tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:06.003039 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6366a3c8-9961-42fa-bd06-a7e38480b134 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f4a7231e4431c89712c557c4fa1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ac882e61ac45eb9abc60630e7337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:06.018240 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6366a3c8-9961-42fa-bd06-a7e38480b134 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85" status: 200 len: 1323 microversion: 2.1 time: 0.704009 Aug 07 01:15:06.019073 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 663/1197] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:05 2022] GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85 => generated 1323 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:06.024815 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-57835e7d-4f6e-4b40-8462-5a85ff0508b2 tempest-SecurityGroupsNegativeTestJSON-2031332014 tempest-SecurityGroupsNegativeTestJSON-2031332014-project] Action: 'update', calling method: .version_select at 0x7f9e244143a0>, body: {"security_group": {"name": "tempest-sg-760962268", "description": "tempest-description-527254691"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:15:06.072566 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2d6a60d2-c236-4270-8ac2-fe74353a46aa tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:06.091522 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2d6a60d2-c236-4270-8ac2-fe74353a46aa tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1313 microversion: 2.1 time: 0.486176 Aug 07 01:15:06.092287 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 535/1198] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:05 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1313 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:06.099931 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fb3fd54a-468f-41bb-b549-c9398ed880a8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:06.106619 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fb3fd54a-468f-41bb-b549-c9398ed880a8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:06.140818 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb3fd54a-468f-41bb-b549-c9398ed880a8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:06.141779 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb3fd54a-468f-41bb-b549-c9398ed880a8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:06.142832 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb3fd54a-468f-41bb-b549-c9398ed880a8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:06.144234 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb3fd54a-468f-41bb-b549-c9398ed880a8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:06.145130 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb3fd54a-468f-41bb-b549-c9398ed880a8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:06.146012 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb3fd54a-468f-41bb-b549-c9398ed880a8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:06.208660 n-d-master-1 devstack@n-api.service[119516]: DEBUG neutronclient.v2_0.client [None req-57835e7d-4f6e-4b40-8462-5a85ff0508b2 tempest-SecurityGroupsNegativeTestJSON-2031332014 tempest-SecurityGroupsNegativeTestJSON-2031332014-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group be062051-873d-413b-af6a-587f6a4459eb does not exist", "detail": ""}} {{(pid=119516) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 07 01:15:06.209418 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.security_group_api [None req-57835e7d-4f6e-4b40-8462-5a85ff0508b2 tempest-SecurityGroupsNegativeTestJSON-2031332014 tempest-SecurityGroupsNegativeTestJSON-2031332014-project] Neutron security group be062051-873d-413b-af6a-587f6a4459eb not found {{(pid=119516) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 07 01:15:06.210319 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-57835e7d-4f6e-4b40-8462-5a85ff0508b2 tempest-SecurityGroupsNegativeTestJSON-2031332014 tempest-SecurityGroupsNegativeTestJSON-2031332014-project] HTTP exception thrown: Security group be062051-873d-413b-af6a-587f6a4459eb does not exist Aug 07 01:15:06.210319 n-d-master-1 devstack@n-api.service[119516]: Neutron server returns request_ids: ['req-e7b3ce65-9d47-429a-af43-e3a284ca7630'] Aug 07 01:15:06.214458 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-57835e7d-4f6e-4b40-8462-5a85ff0508b2 tempest-SecurityGroupsNegativeTestJSON-2031332014 tempest-SecurityGroupsNegativeTestJSON-2031332014-project] Request method failure captured: Aug 07 01:15:06.214458 n-d-master-1 devstack@n-api.service[119516]: request: PUT /compute/v2.1/os-security-groups/be062051-873d-413b-af6a-587f6a4459eb HTTP/1.1 Aug 07 01:15:06.214458 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:15:06.214458 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:15:06.214458 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:15:06.214458 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 100 Aug 07 01:15:06.214458 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:15:06.214458 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:15:06.214458 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:15:06.214458 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:15:06.214458 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xITg51EZsrTANxBnLEupUp7ZZ6hvJdMmcpT-JOt2VkajnUBZ25LXp9rm7ogMB8zbK8vxEv9TNRFzYnk_vY6fZTb1Z26uGW4hMC-8ySW1ZqDZ8cKAKDgaFIEMAaVTDTjFaKQOh5BCK8taBMYAtT2logo1PofiSRDId3q5uRrbuHJF2k Aug 07 01:15:06.214458 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:15:06.214458 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:15:06.214458 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:15:06.214458 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:15:06.214458 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:15:06.214458 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:15:06.214458 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: dab3ac719e1b4d6c913fc593c388dc3d Aug 07 01:15:06.214458 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2031332014 Aug 07 01:15:06.214458 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:15:06.214458 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:15:06.217172 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/dab3ac719e1b4d6c913fc593c388dc3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_dab3ac719e1b4d6c913fc593c388dc3d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/dab3ac719e1b4d6c913fc593c388dc3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/dab3ac719e1b4d6c913fc593c388dc3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:15:06.217172 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2031332014 Aug 07 01:15:06.217172 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: dab3ac719e1b4d6c913fc593c388dc3d Aug 07 01:15:06.217172 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2031332014 Aug 07 01:15:06.217172 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-SecurityGroupsNegativeTestJSON-2031332014-project Aug 07 01:15:06.217172 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:15:06.217172 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:15:06.217172 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 21219c93625d4e6b802d8a99b3e520d6 Aug 07 01:15:06.217172 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2031332014-project Aug 07 01:15:06.217172 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:15:06.217172 n-d-master-1 devstack@n-api.service[119516]: {"security_group": {"name": "tempest-sg-760962268", "description": "tempest-description-527254691"}} Aug 07 01:15:06.217172 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:15:06.217172 n-d-master-1 devstack@n-api.service[119516]: exception: Security group be062051-873d-413b-af6a-587f6a4459eb does not exist Aug 07 01:15:06.218654 n-d-master-1 devstack@n-api.service[119516]: Neutron server returns request_ids: ['req-e7b3ce65-9d47-429a-af43-e3a284ca7630'] Aug 07 01:15:06.218654 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'be062051-873d-413b-af6a-587f6a4459eb', 'body': {'security_group': {'name': 'tempest-sg-760962268', 'description': 'tempest-description-527254691'}}} Aug 07 01:15:06.218654 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:15:06.218654 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:06.218654 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 07 01:15:06.218654 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 07 01:15:06.218654 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:15:06.218654 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:15:06.218654 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 07 01:15:06.218654 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 07 01:15:06.218654 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:15:06.218654 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:15:06.218654 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 07 01:15:06.218654 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 07 01:15:06.218654 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:15:06.218654 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:15:06.218654 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 07 01:15:06.218654 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 07 01:15:06.220385 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:15:06.220385 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:15:06.220385 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 07 01:15:06.220385 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 07 01:15:06.220385 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:15:06.220385 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:15:06.220385 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 07 01:15:06.220385 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 07 01:15:06.220385 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 07 01:15:06.220385 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 07 01:15:06.220385 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group be062051-873d-413b-af6a-587f6a4459eb does not exist Aug 07 01:15:06.220385 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e7b3ce65-9d47-429a-af43-e3a284ca7630'] Aug 07 01:15:06.220385 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:06.220385 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:15:06.220385 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:06.220385 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:06.220385 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 07 01:15:06.220385 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 07 01:15:06.220385 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 07 01:15:06.222400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 07 01:15:06.222400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group be062051-873d-413b-af6a-587f6a4459eb does not exist Aug 07 01:15:06.222400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e7b3ce65-9d47-429a-af43-e3a284ca7630'] Aug 07 01:15:06.222400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:06.222400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:15:06.222400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:06.222400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:06.222400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:15:06.222400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:15:06.222400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:15:06.222400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:15:06.222400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:15:06.222400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:15:06.222400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:15:06.222400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:15:06.222400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 07 01:15:06.222400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 07 01:15:06.222400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group be062051-873d-413b-af6a-587f6a4459eb does not exist Aug 07 01:15:06.222400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e7b3ce65-9d47-429a-af43-e3a284ca7630'] Aug 07 01:15:06.222400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:06.227518 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:15:06.227518 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:06.227518 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:06.227518 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:15:06.227518 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:15:06.227518 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:15:06.227518 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:15:06.227518 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group be062051-873d-413b-af6a-587f6a4459eb does not exist Aug 07 01:15:06.227518 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e7b3ce65-9d47-429a-af43-e3a284ca7630'] Aug 07 01:15:06.227518 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:06.227518 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-57835e7d-4f6e-4b40-8462-5a85ff0508b2 tempest-SecurityGroupsNegativeTestJSON-2031332014 tempest-SecurityGroupsNegativeTestJSON-2031332014-project] Returning 404 to user: Security group be062051-873d-413b-af6a-587f6a4459eb does not exist Aug 07 01:15:06.227518 n-d-master-1 devstack@n-api.service[119516]: Neutron server returns request_ids: ['req-e7b3ce65-9d47-429a-af43-e3a284ca7630'] {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:15:06.227518 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-57835e7d-4f6e-4b40-8462-5a85ff0508b2 tempest-SecurityGroupsNegativeTestJSON-2031332014 tempest-SecurityGroupsNegativeTestJSON-2031332014-project] 10.222.0.39 "PUT /compute/v2.1/os-security-groups/be062051-873d-413b-af6a-587f6a4459eb" status: 404 len: 194 microversion: 2.1 time: 0.195874 Aug 07 01:15:06.230405 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 664/1199] 10.222.0.39 () {60 vars in 1290 bytes} [Sun Aug 7 01:15:06 2022] PUT /compute/v2.1/os-security-groups/be062051-873d-413b-af6a-587f6a4459eb => generated 194 bytes in 205 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:15:06.235493 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-576ee9ad-7014-4e5f-9be3-4c094ffba02a tempest-FlavorsV261TestJSON-721037942 tempest-FlavorsV261TestJSON-721037942-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:06.236775 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:15:06.236775 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:15:06.279858 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-576ee9ad-7014-4e5f-9be3-4c094ffba02a tempest-FlavorsV261TestJSON-721037942 tempest-FlavorsV261TestJSON-721037942-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1663065491" status: 202 len: 0 microversion: 2.61 time: 0.053948 Aug 07 01:15:06.280827 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 665/1200] 10.222.0.39 () {60 vars in 1202 bytes} [Sun Aug 7 01:15:06 2022] DELETE /compute/v2.1/flavors/1663065491 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:15:06.295611 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-14ac2f17-4ca0-4919-9aaf-70f825d36c8a tempest-FlavorsV261TestJSON-721037942 tempest-FlavorsV261TestJSON-721037942-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:06.342102 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-14ac2f17-4ca0-4919-9aaf-70f825d36c8a tempest-FlavorsV261TestJSON-721037942 tempest-FlavorsV261TestJSON-721037942-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.054086 Aug 07 01:15:06.343462 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 666/1201] 10.222.0.39 () {60 vars in 1187 bytes} [Sun Aug 7 01:15:06 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:15:06.349683 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-03cf1c90-4f4b-4b0e-aa28-3ad421369711 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:06.350639 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-03cf1c90-4f4b-4b0e-aa28-3ad421369711 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 2142aec1-a473-42c4-8676-84c497d613e3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:06.358382 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-03cf1c90-4f4b-4b0e-aa28-3ad421369711 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:06.359191 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-03cf1c90-4f4b-4b0e-aa28-3ad421369711 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:06.359821 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-03cf1c90-4f4b-4b0e-aa28-3ad421369711 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:06.360847 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-03cf1c90-4f4b-4b0e-aa28-3ad421369711 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:06.361530 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-03cf1c90-4f4b-4b0e-aa28-3ad421369711 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:06.362193 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-03cf1c90-4f4b-4b0e-aa28-3ad421369711 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:06.372463 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:06.970935 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:07.005111 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=20 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:07.211000 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-03cf1c90-4f4b-4b0e-aa28-3ad421369711 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:07.223148 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-03cf1c90-4f4b-4b0e-aa28-3ad421369711 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3" status: 200 len: 1317 microversion: 2.1 time: 0.877803 Aug 07 01:15:07.224803 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 667/1202] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:06 2022] GET /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3 => generated 1317 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:07.234290 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-787bb351-86d1-41ac-8388-397d89abc116 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:07.236806 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-787bb351-86d1-41ac-8388-397d89abc116 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:07.256766 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-787bb351-86d1-41ac-8388-397d89abc116 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:07.258698 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-787bb351-86d1-41ac-8388-397d89abc116 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:07.259395 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-787bb351-86d1-41ac-8388-397d89abc116 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:07.261163 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-787bb351-86d1-41ac-8388-397d89abc116 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:07.262413 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-787bb351-86d1-41ac-8388-397d89abc116 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:07.264004 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-787bb351-86d1-41ac-8388-397d89abc116 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:07.697876 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fb3fd54a-468f-41bb-b549-c9398ed880a8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:07.712914 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fb3fd54a-468f-41bb-b549-c9398ed880a8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 200 len: 1717 microversion: 2.1 time: 1.616077 Aug 07 01:15:07.721668 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 536/1203] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:06 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 1717 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:07.727390 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-05c6c748-eb56-4cc1-8c51-a1015d5cd7b5 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:07.728670 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-05c6c748-eb56-4cc1-8c51-a1015d5cd7b5 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: ea2ef6ca-2623-496d-a174-1d7cbaf80f85] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:07.736720 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05c6c748-eb56-4cc1-8c51-a1015d5cd7b5 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:07.738684 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05c6c748-eb56-4cc1-8c51-a1015d5cd7b5 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:07.739399 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05c6c748-eb56-4cc1-8c51-a1015d5cd7b5 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:07.740681 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05c6c748-eb56-4cc1-8c51-a1015d5cd7b5 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:07.741346 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05c6c748-eb56-4cc1-8c51-a1015d5cd7b5 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:07.742500 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05c6c748-eb56-4cc1-8c51-a1015d5cd7b5 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:07.794103 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-787bb351-86d1-41ac-8388-397d89abc116 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:07.812571 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-787bb351-86d1-41ac-8388-397d89abc116 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1477 microversion: 2.1 time: 0.584825 Aug 07 01:15:07.814109 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 668/1204] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:07 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1477 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:07.834517 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b4a72e47-69b9-4863-b845-8161557527ba tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:07.835135 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b4a72e47-69b9-4863-b845-8161557527ba tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:07.843739 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4a72e47-69b9-4863-b845-8161557527ba tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:07.845381 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4a72e47-69b9-4863-b845-8161557527ba tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:07.846080 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4a72e47-69b9-4863-b845-8161557527ba tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:07.847334 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4a72e47-69b9-4863-b845-8161557527ba tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:07.848430 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4a72e47-69b9-4863-b845-8161557527ba tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:07.849178 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4a72e47-69b9-4863-b845-8161557527ba tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:08.309160 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-05c6c748-eb56-4cc1-8c51-a1015d5cd7b5 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f4a7231e4431c89712c557c4fa1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ac882e61ac45eb9abc60630e7337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:08.327259 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-05c6c748-eb56-4cc1-8c51-a1015d5cd7b5 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85" status: 200 len: 1323 microversion: 2.1 time: 0.603870 Aug 07 01:15:08.337843 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 537/1205] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:07 2022] GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85 => generated 1323 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:08.357907 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-8a993555-b425-4ce3-a849-31e83d97a840 req-c7080e26-3fef-4079-88dc-39b2bf1d3fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2142aec1-a473-42c4-8676-84c497d613e3", "tag": "ef8dba12-291c-4f4b-95b1-f3f27fd5288b"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:15:08.394523 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-8a993555-b425-4ce3-a849-31e83d97a840 req-c7080e26-3fef-4079-88dc-39b2bf1d3fa7 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:08.396012 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-8a993555-b425-4ce3-a849-31e83d97a840 req-c7080e26-3fef-4079-88dc-39b2bf1d3fa7 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:08.397102 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-8a993555-b425-4ce3-a849-31e83d97a840 req-c7080e26-3fef-4079-88dc-39b2bf1d3fa7 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:08.425376 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-8a993555-b425-4ce3-a849-31e83d97a840 req-c7080e26-3fef-4079-88dc-39b2bf1d3fa7 service nova] Creating event network-changed:ef8dba12-291c-4f4b-95b1-f3f27fd5288b for instance 2142aec1-a473-42c4-8676-84c497d613e3 on n-h1-master-1 Aug 07 01:15:08.437602 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-8a993555-b425-4ce3-a849-31e83d97a840 req-c7080e26-3fef-4079-88dc-39b2bf1d3fa7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096976 Aug 07 01:15:08.439111 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 538/1206] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:08.451711 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-305d3940-7b53-4532-b853-1c42fd690bca tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:08.454475 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-305d3940-7b53-4532-b853-1c42fd690bca tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 2142aec1-a473-42c4-8676-84c497d613e3] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:08.468236 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-305d3940-7b53-4532-b853-1c42fd690bca tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:08.470003 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-305d3940-7b53-4532-b853-1c42fd690bca tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:08.470944 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-305d3940-7b53-4532-b853-1c42fd690bca tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:08.472557 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-305d3940-7b53-4532-b853-1c42fd690bca tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:08.474472 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-305d3940-7b53-4532-b853-1c42fd690bca tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:08.477196 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-305d3940-7b53-4532-b853-1c42fd690bca tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:08.671199 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b4a72e47-69b9-4863-b845-8161557527ba tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:08.691110 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b4a72e47-69b9-4863-b845-8161557527ba tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1313 microversion: 2.1 time: 0.875220 Aug 07 01:15:08.738169 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 669/1207] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:07 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1313 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:09.015700 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-305d3940-7b53-4532-b853-1c42fd690bca tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:09.029921 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-305d3940-7b53-4532-b853-1c42fd690bca tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3" status: 200 len: 1317 microversion: 2.1 time: 0.587133 Aug 07 01:15:09.045701 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 539/1208] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:08 2022] GET /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3 => generated 1317 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:09.084876 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d8633f4e-d185-44f6-9369-c92223ac65d7 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:09.086567 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d8633f4e-d185-44f6-9369-c92223ac65d7 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:09.107461 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:09.118371 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d8633f4e-d185-44f6-9369-c92223ac65d7 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:09.122036 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d8633f4e-d185-44f6-9369-c92223ac65d7 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:09.123733 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d8633f4e-d185-44f6-9369-c92223ac65d7 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:09.125070 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d8633f4e-d185-44f6-9369-c92223ac65d7 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:09.127768 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d8633f4e-d185-44f6-9369-c92223ac65d7 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:09.128612 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d8633f4e-d185-44f6-9369-c92223ac65d7 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:09.284809 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-fbf9a03f-c373-4003-a2be-e425be986369 req-ce33ff8f-5ad8-498c-a1bb-ce850fd29b2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45de519b-ab33-4648-9aa0-b9da5e3f1ef3", "name": "network-vif-plugged", "status": "completed", "tag": "473f3c7a-5b88-453d-a65c-373cab90ea67"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:15:09.332841 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-fbf9a03f-c373-4003-a2be-e425be986369 req-ce33ff8f-5ad8-498c-a1bb-ce850fd29b2e service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:09.337209 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-fbf9a03f-c373-4003-a2be-e425be986369 req-ce33ff8f-5ad8-498c-a1bb-ce850fd29b2e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:09.338072 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-fbf9a03f-c373-4003-a2be-e425be986369 req-ce33ff8f-5ad8-498c-a1bb-ce850fd29b2e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:09.383609 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-fbf9a03f-c373-4003-a2be-e425be986369 req-ce33ff8f-5ad8-498c-a1bb-ce850fd29b2e service nova] Creating event network-vif-plugged:473f3c7a-5b88-453d-a65c-373cab90ea67 for instance 45de519b-ab33-4648-9aa0-b9da5e3f1ef3 on n-h2-master-1 Aug 07 01:15:09.390072 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-fbf9a03f-c373-4003-a2be-e425be986369 req-ce33ff8f-5ad8-498c-a1bb-ce850fd29b2e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.650348 Aug 07 01:15:09.390768 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 670/1209] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:09.397160 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3fae4361-5eca-438e-b657-3709c8cce8a7 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:09.398804 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3fae4361-5eca-438e-b657-3709c8cce8a7 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:09.407301 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fae4361-5eca-438e-b657-3709c8cce8a7 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:09.408040 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fae4361-5eca-438e-b657-3709c8cce8a7 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:09.408719 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fae4361-5eca-438e-b657-3709c8cce8a7 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:09.409611 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fae4361-5eca-438e-b657-3709c8cce8a7 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:09.410075 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fae4361-5eca-438e-b657-3709c8cce8a7 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:09.410513 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fae4361-5eca-438e-b657-3709c8cce8a7 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:09.926914 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d8633f4e-d185-44f6-9369-c92223ac65d7 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:09.941954 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d8633f4e-d185-44f6-9369-c92223ac65d7 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 200 len: 1717 microversion: 2.1 time: 0.893517 Aug 07 01:15:09.942555 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 540/1210] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:09 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 1717 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:09.962761 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-59c22318-e0ff-41ce-8c52-3334b5b53855 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:09.963736 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-59c22318-e0ff-41ce-8c52-3334b5b53855 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: ea2ef6ca-2623-496d-a174-1d7cbaf80f85] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:09.992675 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59c22318-e0ff-41ce-8c52-3334b5b53855 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:09.994020 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59c22318-e0ff-41ce-8c52-3334b5b53855 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:09.995973 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59c22318-e0ff-41ce-8c52-3334b5b53855 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:09.998675 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59c22318-e0ff-41ce-8c52-3334b5b53855 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:09.999573 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59c22318-e0ff-41ce-8c52-3334b5b53855 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:10.001646 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59c22318-e0ff-41ce-8c52-3334b5b53855 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:10.078550 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3fae4361-5eca-438e-b657-3709c8cce8a7 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:10.089374 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3fae4361-5eca-438e-b657-3709c8cce8a7 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1463 microversion: 2.1 time: 0.697108 Aug 07 01:15:10.094492 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 671/1211] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:09 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1463 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:10.108696 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e7df2361-13c5-48f6-b70b-60fed1e79b37 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:10.109319 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e7df2361-13c5-48f6-b70b-60fed1e79b37 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:10.118064 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7df2361-13c5-48f6-b70b-60fed1e79b37 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:10.118890 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7df2361-13c5-48f6-b70b-60fed1e79b37 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:10.119662 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7df2361-13c5-48f6-b70b-60fed1e79b37 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:10.120585 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7df2361-13c5-48f6-b70b-60fed1e79b37 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:10.121070 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7df2361-13c5-48f6-b70b-60fed1e79b37 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:10.121506 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7df2361-13c5-48f6-b70b-60fed1e79b37 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:10.341651 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-59c22318-e0ff-41ce-8c52-3334b5b53855 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f4a7231e4431c89712c557c4fa1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ac882e61ac45eb9abc60630e7337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:10.352133 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-59c22318-e0ff-41ce-8c52-3334b5b53855 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85" status: 200 len: 1323 microversion: 2.1 time: 0.401599 Aug 07 01:15:10.368599 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 541/1212] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:09 2022] GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85 => generated 1323 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:10.374048 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e11aa6e7-5e93-4a20-bedd-120440437119 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:10.375659 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e11aa6e7-5e93-4a20-bedd-120440437119 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 2142aec1-a473-42c4-8676-84c497d613e3] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:10.385646 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e11aa6e7-5e93-4a20-bedd-120440437119 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:10.386510 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e11aa6e7-5e93-4a20-bedd-120440437119 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:10.387185 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e11aa6e7-5e93-4a20-bedd-120440437119 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:10.390047 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e11aa6e7-5e93-4a20-bedd-120440437119 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:10.390784 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e11aa6e7-5e93-4a20-bedd-120440437119 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:10.391419 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e11aa6e7-5e93-4a20-bedd-120440437119 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:10.950977 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e11aa6e7-5e93-4a20-bedd-120440437119 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:10.996988 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e11aa6e7-5e93-4a20-bedd-120440437119 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3" status: 200 len: 1317 microversion: 2.1 time: 0.606306 Aug 07 01:15:10.999186 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 542/1213] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:10 2022] GET /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3 => generated 1317 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:11.011371 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f061cf21-a40f-49a3-a198-6d76f1659abd tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:11.013075 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f061cf21-a40f-49a3-a198-6d76f1659abd tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:11.026322 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e7df2361-13c5-48f6-b70b-60fed1e79b37 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:11.027854 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f061cf21-a40f-49a3-a198-6d76f1659abd tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:11.029326 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f061cf21-a40f-49a3-a198-6d76f1659abd tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:11.030531 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f061cf21-a40f-49a3-a198-6d76f1659abd tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:11.032931 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f061cf21-a40f-49a3-a198-6d76f1659abd tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:11.034296 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f061cf21-a40f-49a3-a198-6d76f1659abd tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:11.035320 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f061cf21-a40f-49a3-a198-6d76f1659abd tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:11.043459 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:11.076866 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e7df2361-13c5-48f6-b70b-60fed1e79b37 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1313 microversion: 2.1 time: 0.980805 Aug 07 01:15:11.083021 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 672/1214] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:10 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1313 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:11.111386 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8402d293-2ee8-4ddb-81aa-07d1f93d64ec tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:11.119837 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8402d293-2ee8-4ddb-81aa-07d1f93d64ec tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:11.151647 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8402d293-2ee8-4ddb-81aa-07d1f93d64ec tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:11.152084 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8402d293-2ee8-4ddb-81aa-07d1f93d64ec tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:11.152544 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8402d293-2ee8-4ddb-81aa-07d1f93d64ec tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:11.153309 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8402d293-2ee8-4ddb-81aa-07d1f93d64ec tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:11.153893 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8402d293-2ee8-4ddb-81aa-07d1f93d64ec tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:11.154344 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8402d293-2ee8-4ddb-81aa-07d1f93d64ec tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:11.506065 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8402d293-2ee8-4ddb-81aa-07d1f93d64ec tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:11.527755 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8402d293-2ee8-4ddb-81aa-07d1f93d64ec tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 200 len: 1717 microversion: 2.1 time: 0.442043 Aug 07 01:15:11.547967 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 673/1215] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:11 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 1717 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:11.562443 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b6ffab17-8485-49fc-8681-dc3f81dd0e7b tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:11.564010 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b6ffab17-8485-49fc-8681-dc3f81dd0e7b tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: ea2ef6ca-2623-496d-a174-1d7cbaf80f85] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:11.597298 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b6ffab17-8485-49fc-8681-dc3f81dd0e7b tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:11.598399 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b6ffab17-8485-49fc-8681-dc3f81dd0e7b tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:11.601521 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b6ffab17-8485-49fc-8681-dc3f81dd0e7b tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:11.604826 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b6ffab17-8485-49fc-8681-dc3f81dd0e7b tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:11.606150 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b6ffab17-8485-49fc-8681-dc3f81dd0e7b tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:11.607539 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b6ffab17-8485-49fc-8681-dc3f81dd0e7b tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:11.772222 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f061cf21-a40f-49a3-a198-6d76f1659abd tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:11.801143 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f061cf21-a40f-49a3-a198-6d76f1659abd tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1463 microversion: 2.1 time: 0.797115 Aug 07 01:15:11.803830 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 543/1216] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:10 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1463 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:11.814470 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-230b1e60-cbc0-4bca-8ec5-11ff2e82d2cc req-41cfcd42-1f52-427b-b21f-f365b1dabd09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "634a7ed6-84df-4292-bc38-5129fb0f57c9", "name": "network-vif-plugged", "status": "completed", "tag": "93ab5068-1c0e-4ec2-bb1a-06cc1c07f96e"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:15:11.833274 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-230b1e60-cbc0-4bca-8ec5-11ff2e82d2cc req-41cfcd42-1f52-427b-b21f-f365b1dabd09 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:11.836397 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-230b1e60-cbc0-4bca-8ec5-11ff2e82d2cc req-41cfcd42-1f52-427b-b21f-f365b1dabd09 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:11.837502 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-230b1e60-cbc0-4bca-8ec5-11ff2e82d2cc req-41cfcd42-1f52-427b-b21f-f365b1dabd09 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:11.877624 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-230b1e60-cbc0-4bca-8ec5-11ff2e82d2cc req-41cfcd42-1f52-427b-b21f-f365b1dabd09 service nova] Creating event network-vif-plugged:93ab5068-1c0e-4ec2-bb1a-06cc1c07f96e for instance 634a7ed6-84df-4292-bc38-5129fb0f57c9 on n-h1-master-1 Aug 07 01:15:11.895595 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-230b1e60-cbc0-4bca-8ec5-11ff2e82d2cc req-41cfcd42-1f52-427b-b21f-f365b1dabd09 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088806 Aug 07 01:15:11.897153 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 544/1217] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:11.909501 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b6ffab17-8485-49fc-8681-dc3f81dd0e7b tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f4a7231e4431c89712c557c4fa1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ac882e61ac45eb9abc60630e7337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:11.912117 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-43d52fb6-c1fe-4e64-b604-702f5e7064cd tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:15:11.925316 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-43d52fb6-c1fe-4e64-b604-702f5e7064cd tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:11.926661 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b6ffab17-8485-49fc-8681-dc3f81dd0e7b tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85" status: 200 len: 1323 microversion: 2.1 time: 0.376815 Aug 07 01:15:11.938312 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-43d52fb6-c1fe-4e64-b604-702f5e7064cd tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:11.939307 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-43d52fb6-c1fe-4e64-b604-702f5e7064cd tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:11.940298 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-43d52fb6-c1fe-4e64-b604-702f5e7064cd tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:11.940849 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 674/1218] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:11 2022] GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85 => generated 1323 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:11.942596 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-43d52fb6-c1fe-4e64-b604-702f5e7064cd tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:11.946057 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-43d52fb6-c1fe-4e64-b604-702f5e7064cd tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:11.946807 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-43d52fb6-c1fe-4e64-b604-702f5e7064cd tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:12.030751 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-555a17dd-a585-4f9d-bf57-7cc4a5b7f092 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:12.036214 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-555a17dd-a585-4f9d-bf57-7cc4a5b7f092 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 2142aec1-a473-42c4-8676-84c497d613e3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:12.057547 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-555a17dd-a585-4f9d-bf57-7cc4a5b7f092 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:12.059007 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-555a17dd-a585-4f9d-bf57-7cc4a5b7f092 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:12.059007 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-555a17dd-a585-4f9d-bf57-7cc4a5b7f092 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:12.059422 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-555a17dd-a585-4f9d-bf57-7cc4a5b7f092 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:12.059709 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-555a17dd-a585-4f9d-bf57-7cc4a5b7f092 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:12.060182 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-555a17dd-a585-4f9d-bf57-7cc4a5b7f092 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:12.088779 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-43d52fb6-c1fe-4e64-b604-702f5e7064cd tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:15:12.095783 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-43d52fb6-c1fe-4e64-b604-702f5e7064cd tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:15:12.098211 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-43d52fb6-c1fe-4e64-b604-702f5e7064cd tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:15:12.099043 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-43d52fb6-c1fe-4e64-b604-702f5e7064cd tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:15:12.100245 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-43d52fb6-c1fe-4e64-b604-702f5e7064cd tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:15:12.216063 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-43d52fb6-c1fe-4e64-b604-702f5e7064cd tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:12.231026 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-43d52fb6-c1fe-4e64-b604-702f5e7064cd tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:12.232521 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-43d52fb6-c1fe-4e64-b604-702f5e7064cd tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:12.234252 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-43d52fb6-c1fe-4e64-b604-702f5e7064cd tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:12.238668 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-43d52fb6-c1fe-4e64-b604-702f5e7064cd tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:12.238973 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-43d52fb6-c1fe-4e64-b604-702f5e7064cd tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:12.239747 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-43d52fb6-c1fe-4e64-b604-702f5e7064cd tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:12.340661 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-43d52fb6-c1fe-4e64-b604-702f5e7064cd tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "POST /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a/action" status: 202 len: 1067 microversion: 2.1 time: 0.438089 Aug 07 01:15:12.344429 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 545/1219] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:15:11 2022] POST /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a/action => generated 1067 bytes in 445 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 07 01:15:12.393654 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-55266fb4-081d-4857-a7bd-296c2b8a3449 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:12.394388 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-55266fb4-081d-4857-a7bd-296c2b8a3449 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:12.403919 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-55266fb4-081d-4857-a7bd-296c2b8a3449 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:12.404992 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-55266fb4-081d-4857-a7bd-296c2b8a3449 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:12.405656 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-55266fb4-081d-4857-a7bd-296c2b8a3449 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:12.407296 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-55266fb4-081d-4857-a7bd-296c2b8a3449 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:12.408945 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-55266fb4-081d-4857-a7bd-296c2b8a3449 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:12.409908 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-55266fb4-081d-4857-a7bd-296c2b8a3449 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:12.757151 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-555a17dd-a585-4f9d-bf57-7cc4a5b7f092 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:12.780534 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-555a17dd-a585-4f9d-bf57-7cc4a5b7f092 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3" status: 200 len: 1317 microversion: 2.1 time: 0.757364 Aug 07 01:15:12.781455 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 675/1220] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:12 2022] GET /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3 => generated 1317 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:15:12.803249 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6c57d1ac-10d3-4226-9cdc-99f4d83d0c10 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:12.805526 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6c57d1ac-10d3-4226-9cdc-99f4d83d0c10 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:12.832527 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c57d1ac-10d3-4226-9cdc-99f4d83d0c10 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:12.837072 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c57d1ac-10d3-4226-9cdc-99f4d83d0c10 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:12.841141 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c57d1ac-10d3-4226-9cdc-99f4d83d0c10 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:12.844014 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c57d1ac-10d3-4226-9cdc-99f4d83d0c10 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:12.844289 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c57d1ac-10d3-4226-9cdc-99f4d83d0c10 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:12.847914 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c57d1ac-10d3-4226-9cdc-99f4d83d0c10 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:13.110837 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-55266fb4-081d-4857-a7bd-296c2b8a3449 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:13.131278 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-55266fb4-081d-4857-a7bd-296c2b8a3449 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1313 microversion: 2.1 time: 0.784610 Aug 07 01:15:13.132604 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 546/1221] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:12 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1313 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:13.137635 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-92268e0d-4162-4999-9021-a10bd07d431c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:13.138426 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-92268e0d-4162-4999-9021-a10bd07d431c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:13.159224 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-92268e0d-4162-4999-9021-a10bd07d431c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:13.160306 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-92268e0d-4162-4999-9021-a10bd07d431c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:13.161041 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-92268e0d-4162-4999-9021-a10bd07d431c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:13.162103 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-92268e0d-4162-4999-9021-a10bd07d431c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:13.162817 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-92268e0d-4162-4999-9021-a10bd07d431c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:13.164057 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-92268e0d-4162-4999-9021-a10bd07d431c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:13.465558 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-92268e0d-4162-4999-9021-a10bd07d431c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:13.484048 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-92268e0d-4162-4999-9021-a10bd07d431c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 200 len: 1717 microversion: 2.1 time: 0.349199 Aug 07 01:15:13.487394 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 547/1222] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:13 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 1717 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:13.531061 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ae6bcb87-f2f0-4e1e-b74f-85269a06a025 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:13.532038 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ae6bcb87-f2f0-4e1e-b74f-85269a06a025 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: ea2ef6ca-2623-496d-a174-1d7cbaf80f85] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:13.548024 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ae6bcb87-f2f0-4e1e-b74f-85269a06a025 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:13.548910 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ae6bcb87-f2f0-4e1e-b74f-85269a06a025 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:13.549619 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ae6bcb87-f2f0-4e1e-b74f-85269a06a025 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:13.550755 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ae6bcb87-f2f0-4e1e-b74f-85269a06a025 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:13.551680 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ae6bcb87-f2f0-4e1e-b74f-85269a06a025 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:13.553045 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ae6bcb87-f2f0-4e1e-b74f-85269a06a025 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:13.954124 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ae6bcb87-f2f0-4e1e-b74f-85269a06a025 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f4a7231e4431c89712c557c4fa1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ac882e61ac45eb9abc60630e7337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:13.970536 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ae6bcb87-f2f0-4e1e-b74f-85269a06a025 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85" status: 200 len: 1323 microversion: 2.1 time: 0.477376 Aug 07 01:15:13.983942 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 548/1223] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:13 2022] GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85 => generated 1323 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:13.983942 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ae835e59-d43f-4c3c-841f-e0e0a3b7805f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:13.984303 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ae835e59-d43f-4c3c-841f-e0e0a3b7805f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 2142aec1-a473-42c4-8676-84c497d613e3] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:13.997305 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ae835e59-d43f-4c3c-841f-e0e0a3b7805f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:14.014120 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ae835e59-d43f-4c3c-841f-e0e0a3b7805f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:14.014652 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ae835e59-d43f-4c3c-841f-e0e0a3b7805f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:14.015598 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ae835e59-d43f-4c3c-841f-e0e0a3b7805f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:14.016106 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ae835e59-d43f-4c3c-841f-e0e0a3b7805f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:14.016551 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ae835e59-d43f-4c3c-841f-e0e0a3b7805f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:14.130949 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6c57d1ac-10d3-4226-9cdc-99f4d83d0c10 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:14.160491 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6c57d1ac-10d3-4226-9cdc-99f4d83d0c10 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1472 microversion: 2.1 time: 1.374833 Aug 07 01:15:14.175919 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 676/1224] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:12 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1472 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:14.183337 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-d06a37a6-900f-4f45-9f30-ee1cfe623560 req-15dc65d6-7dad-4f70-b1a7-2d0672511337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea2ef6ca-2623-496d-a174-1d7cbaf80f85", "name": "network-vif-plugged", "status": "completed", "tag": "cf46b89b-456e-4233-b0d8-40780fd11074"}, {"server_uuid": "e6920f55-726f-4258-bc23-2a794668d6bb", "name": "network-vif-plugged", "status": "completed", "tag": "1cf0c711-e914-4498-9f47-8e34535de7c7"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:15:14.222358 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d06a37a6-900f-4f45-9f30-ee1cfe623560 req-15dc65d6-7dad-4f70-b1a7-2d0672511337 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:14.222857 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d06a37a6-900f-4f45-9f30-ee1cfe623560 req-15dc65d6-7dad-4f70-b1a7-2d0672511337 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:14.223298 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d06a37a6-900f-4f45-9f30-ee1cfe623560 req-15dc65d6-7dad-4f70-b1a7-2d0672511337 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:14.267962 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ae835e59-d43f-4c3c-841f-e0e0a3b7805f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:14.284209 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ae835e59-d43f-4c3c-841f-e0e0a3b7805f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3" status: 200 len: 1317 microversion: 2.1 time: 0.311439 Aug 07 01:15:14.294592 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-d06a37a6-900f-4f45-9f30-ee1cfe623560 req-15dc65d6-7dad-4f70-b1a7-2d0672511337 service nova] Creating event network-vif-plugged:cf46b89b-456e-4233-b0d8-40780fd11074 for instance ea2ef6ca-2623-496d-a174-1d7cbaf80f85 on n-h1-master-1 Aug 07 01:15:14.295870 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-d06a37a6-900f-4f45-9f30-ee1cfe623560 req-15dc65d6-7dad-4f70-b1a7-2d0672511337 service nova] Creating event network-vif-plugged:1cf0c711-e914-4498-9f47-8e34535de7c7 for instance e6920f55-726f-4258-bc23-2a794668d6bb on n-h1-master-1 Aug 07 01:15:14.305566 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 549/1225] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:13 2022] GET /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3 => generated 1317 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:14.313577 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-d06a37a6-900f-4f45-9f30-ee1cfe623560 req-15dc65d6-7dad-4f70-b1a7-2d0672511337 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.133891 Aug 07 01:15:14.315013 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 677/1226] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:14.321572 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5eb132ae-9b1e-481c-87d9-c3ae206765c5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:14.321572 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5eb132ae-9b1e-481c-87d9-c3ae206765c5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:14.338058 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5eb132ae-9b1e-481c-87d9-c3ae206765c5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:14.338520 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5eb132ae-9b1e-481c-87d9-c3ae206765c5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:14.341216 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5eb132ae-9b1e-481c-87d9-c3ae206765c5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:14.342535 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5eb132ae-9b1e-481c-87d9-c3ae206765c5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:14.343275 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5eb132ae-9b1e-481c-87d9-c3ae206765c5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:14.345054 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5eb132ae-9b1e-481c-87d9-c3ae206765c5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:14.514885 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c2c538fc-e122-4d1e-b341-cb15359da290 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:14.515690 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c2c538fc-e122-4d1e-b341-cb15359da290 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:14.527659 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c2c538fc-e122-4d1e-b341-cb15359da290 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:14.533218 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c2c538fc-e122-4d1e-b341-cb15359da290 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:14.534086 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c2c538fc-e122-4d1e-b341-cb15359da290 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:14.540190 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c2c538fc-e122-4d1e-b341-cb15359da290 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:14.541202 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c2c538fc-e122-4d1e-b341-cb15359da290 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:14.542031 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c2c538fc-e122-4d1e-b341-cb15359da290 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:14.905284 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5eb132ae-9b1e-481c-87d9-c3ae206765c5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:14.924953 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5eb132ae-9b1e-481c-87d9-c3ae206765c5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1313 microversion: 2.1 time: 0.618057 Aug 07 01:15:14.925682 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 550/1227] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:14 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1313 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:15.246037 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-75beaf26-dc1d-43bf-85ce-ab135df98802 tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Calling method '.version_select at 0x7f9e2433fa60>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:15.249733 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:15:15.249733 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:15:15.251020 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75beaf26-dc1d-43bf-85ce-ab135df98802 tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:15.252535 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75beaf26-dc1d-43bf-85ce-ab135df98802 tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:15.253151 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75beaf26-dc1d-43bf-85ce-ab135df98802 tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:15.254631 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75beaf26-dc1d-43bf-85ce-ab135df98802 tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:15.255099 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75beaf26-dc1d-43bf-85ce-ab135df98802 tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:15.255585 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75beaf26-dc1d-43bf-85ce-ab135df98802 tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:15.259709 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c2c538fc-e122-4d1e-b341-cb15359da290 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:15.272534 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c2c538fc-e122-4d1e-b341-cb15359da290 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 200 len: 1717 microversion: 2.1 time: 0.761363 Aug 07 01:15:15.273321 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 678/1228] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:14 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 1717 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:15.292700 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-75beaf26-dc1d-43bf-85ce-ab135df98802 tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.365796 Aug 07 01:15:15.293342 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 551/1229] 10.222.0.39 () {58 vars in 1128 bytes} [Sun Aug 7 01:15:14 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:15.304639 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9ec99a2d-02ab-4f76-a731-f3dca0b43348 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:15.305745 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9ec99a2d-02ab-4f76-a731-f3dca0b43348 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: ea2ef6ca-2623-496d-a174-1d7cbaf80f85] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:15.307698 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e9ed24ca-29dd-4290-a58a-2ba5b0bb4554 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:15.312265 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e9ed24ca-29dd-4290-a58a-2ba5b0bb4554 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:15.326483 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9ec99a2d-02ab-4f76-a731-f3dca0b43348 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:15.327538 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9ec99a2d-02ab-4f76-a731-f3dca0b43348 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:15.328416 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9ec99a2d-02ab-4f76-a731-f3dca0b43348 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:15.329483 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9ed24ca-29dd-4290-a58a-2ba5b0bb4554 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:15.329785 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9ec99a2d-02ab-4f76-a731-f3dca0b43348 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:15.330061 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9ed24ca-29dd-4290-a58a-2ba5b0bb4554 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:15.330550 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9ed24ca-29dd-4290-a58a-2ba5b0bb4554 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:15.330899 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9ec99a2d-02ab-4f76-a731-f3dca0b43348 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:15.331427 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9ed24ca-29dd-4290-a58a-2ba5b0bb4554 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:15.331669 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9ec99a2d-02ab-4f76-a731-f3dca0b43348 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:15.332168 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9ed24ca-29dd-4290-a58a-2ba5b0bb4554 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:15.332953 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9ed24ca-29dd-4290-a58a-2ba5b0bb4554 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:15.577747 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e9ed24ca-29dd-4290-a58a-2ba5b0bb4554 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:15.597918 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e9ed24ca-29dd-4290-a58a-2ba5b0bb4554 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1472 microversion: 2.1 time: 0.301942 Aug 07 01:15:15.613288 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 552/1230] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:15 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1472 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:15.643099 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1453e2a9-5715-4f0c-bfbc-12711ded8098 tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Calling method '.version_select at 0x7f9e2459f820>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:15.648217 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:15:15.648217 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:15:15.650499 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1453e2a9-5715-4f0c-bfbc-12711ded8098 tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:15.651431 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1453e2a9-5715-4f0c-bfbc-12711ded8098 tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:15.652244 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1453e2a9-5715-4f0c-bfbc-12711ded8098 tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:15.658799 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1453e2a9-5715-4f0c-bfbc-12711ded8098 tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:15.659718 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1453e2a9-5715-4f0c-bfbc-12711ded8098 tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:15.660563 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1453e2a9-5715-4f0c-bfbc-12711ded8098 tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:15.712672 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1453e2a9-5715-4f0c-bfbc-12711ded8098 tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.097648 Aug 07 01:15:15.716582 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 553/1231] 10.222.0.39 () {58 vars in 1139 bytes} [Sun Aug 7 01:15:15 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:15.722685 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2c10a7a5-0bc3-4f40-bb10-a40d5940757b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:15.723422 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2c10a7a5-0bc3-4f40-bb10-a40d5940757b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 2142aec1-a473-42c4-8676-84c497d613e3] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:15.738917 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c10a7a5-0bc3-4f40-bb10-a40d5940757b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:15.740237 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c10a7a5-0bc3-4f40-bb10-a40d5940757b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:15.741822 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c10a7a5-0bc3-4f40-bb10-a40d5940757b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:15.743197 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c10a7a5-0bc3-4f40-bb10-a40d5940757b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:15.744348 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c10a7a5-0bc3-4f40-bb10-a40d5940757b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:15.745370 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c10a7a5-0bc3-4f40-bb10-a40d5940757b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:16.076003 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9ec99a2d-02ab-4f76-a731-f3dca0b43348 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f4a7231e4431c89712c557c4fa1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ac882e61ac45eb9abc60630e7337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:16.089065 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9ec99a2d-02ab-4f76-a731-f3dca0b43348 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85" status: 200 len: 1323 microversion: 2.1 time: 0.797331 Aug 07 01:15:16.107927 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 679/1232] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:15 2022] GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85 => generated 1323 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:16.107927 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c70e5bc2-8208-469d-a9d0-43fdb816460b tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Calling method '.version_select at 0x7f9e245b70d0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:16.119404 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:15:16.119404 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:15:16.127199 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c70e5bc2-8208-469d-a9d0-43fdb816460b tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:16.129224 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c70e5bc2-8208-469d-a9d0-43fdb816460b tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:16.129762 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c70e5bc2-8208-469d-a9d0-43fdb816460b tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:16.130783 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c70e5bc2-8208-469d-a9d0-43fdb816460b tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:16.133739 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c70e5bc2-8208-469d-a9d0-43fdb816460b tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:16.134292 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c70e5bc2-8208-469d-a9d0-43fdb816460b tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:16.180271 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2c10a7a5-0bc3-4f40-bb10-a40d5940757b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:16.190469 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2c10a7a5-0bc3-4f40-bb10-a40d5940757b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3" status: 200 len: 1317 microversion: 2.1 time: 0.472472 Aug 07 01:15:16.196042 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 554/1233] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:15 2022] GET /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3 => generated 1317 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:16.206933 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-37f301ac-4ba6-454b-81d1-65820a6c49ae tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:16.208021 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-37f301ac-4ba6-454b-81d1-65820a6c49ae tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:16.226827 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37f301ac-4ba6-454b-81d1-65820a6c49ae tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:16.227533 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37f301ac-4ba6-454b-81d1-65820a6c49ae tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:16.228176 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37f301ac-4ba6-454b-81d1-65820a6c49ae tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:16.229042 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37f301ac-4ba6-454b-81d1-65820a6c49ae tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:16.229613 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37f301ac-4ba6-454b-81d1-65820a6c49ae tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:16.230145 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37f301ac-4ba6-454b-81d1-65820a6c49ae tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:16.249896 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c70e5bc2-8208-469d-a9d0-43fdb816460b tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.144237 Aug 07 01:15:16.251743 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 680/1234] 10.222.0.39 () {58 vars in 1145 bytes} [Sun Aug 7 01:15:16 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:15:16.265839 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-294efc58-12b9-43c6-85dc-b741460e716c tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Calling method '.version_select at 0x7f9e244f7310>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:16.269495 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:15:16.269495 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:15:16.271267 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-294efc58-12b9-43c6-85dc-b741460e716c tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:16.272366 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-294efc58-12b9-43c6-85dc-b741460e716c tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:16.273766 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-294efc58-12b9-43c6-85dc-b741460e716c tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:16.274981 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-294efc58-12b9-43c6-85dc-b741460e716c tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:16.275827 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-294efc58-12b9-43c6-85dc-b741460e716c tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:16.276630 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-294efc58-12b9-43c6-85dc-b741460e716c tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:16.311404 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-294efc58-12b9-43c6-85dc-b741460e716c tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.049585 Aug 07 01:15:16.315259 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 681/1235] 10.222.0.39 () {58 vars in 1128 bytes} [Sun Aug 7 01:15:16 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:16.342468 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5cf605e3-4610-44be-93d7-b107c175ebe5 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:16.343120 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5cf605e3-4610-44be-93d7-b107c175ebe5 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:16.368459 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cf605e3-4610-44be-93d7-b107c175ebe5 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:16.370138 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cf605e3-4610-44be-93d7-b107c175ebe5 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:16.371221 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cf605e3-4610-44be-93d7-b107c175ebe5 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:16.373824 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cf605e3-4610-44be-93d7-b107c175ebe5 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:16.374913 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cf605e3-4610-44be-93d7-b107c175ebe5 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:16.380843 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cf605e3-4610-44be-93d7-b107c175ebe5 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:16.755808 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-37f301ac-4ba6-454b-81d1-65820a6c49ae tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:16.784716 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5cf605e3-4610-44be-93d7-b107c175ebe5 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:16.785805 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-37f301ac-4ba6-454b-81d1-65820a6c49ae tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1463 microversion: 2.1 time: 0.587175 Aug 07 01:15:16.787077 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 555/1236] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:16 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1463 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:16.825608 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5cf605e3-4610-44be-93d7-b107c175ebe5 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 200 len: 1717 microversion: 2.1 time: 0.508431 Aug 07 01:15:16.826666 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 682/1237] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:16 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 1717 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:16.842849 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6131c139-99a7-4350-8f18-b1be6bd7e40e tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Calling method '.version_select at 0x7f9e243bd430>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:16.867697 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ac948ecd-4b87-454c-9c40-9b634648b6be tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:16.874873 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:15:16.874873 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:15:16.879424 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ac948ecd-4b87-454c-9c40-9b634648b6be tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:16.895293 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6131c139-99a7-4350-8f18-b1be6bd7e40e tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:16.896124 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6131c139-99a7-4350-8f18-b1be6bd7e40e tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:16.896843 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6131c139-99a7-4350-8f18-b1be6bd7e40e tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:16.898760 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac948ecd-4b87-454c-9c40-9b634648b6be tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:16.901600 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac948ecd-4b87-454c-9c40-9b634648b6be tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:16.902677 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6131c139-99a7-4350-8f18-b1be6bd7e40e tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:16.903524 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6131c139-99a7-4350-8f18-b1be6bd7e40e tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:16.904550 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac948ecd-4b87-454c-9c40-9b634648b6be tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:16.905232 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6131c139-99a7-4350-8f18-b1be6bd7e40e tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:16.907851 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac948ecd-4b87-454c-9c40-9b634648b6be tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:16.910019 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac948ecd-4b87-454c-9c40-9b634648b6be tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:16.911907 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac948ecd-4b87-454c-9c40-9b634648b6be tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:16.987030 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6131c139-99a7-4350-8f18-b1be6bd7e40e tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.196737 Aug 07 01:15:16.988167 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 556/1238] 10.222.0.39 () {58 vars in 1155 bytes} [Sun Aug 7 01:15:16 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:16.999057 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ce40b5c4-a575-4934-807e-ede11be369ea tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:15:17.003309 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ce40b5c4-a575-4934-807e-ede11be369ea tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:17.016175 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce40b5c4-a575-4934-807e-ede11be369ea tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:17.016822 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce40b5c4-a575-4934-807e-ede11be369ea tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:17.017788 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce40b5c4-a575-4934-807e-ede11be369ea tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:17.020321 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce40b5c4-a575-4934-807e-ede11be369ea tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:17.021839 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce40b5c4-a575-4934-807e-ede11be369ea tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:17.023358 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce40b5c4-a575-4934-807e-ede11be369ea tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:17.174113 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ce40b5c4-a575-4934-807e-ede11be369ea tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:17.187404 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ce40b5c4-a575-4934-807e-ede11be369ea tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Old instance type m1.heat2, new instance type m1.heat {{(pid=119517) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 07 01:15:17.213678 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-ce40b5c4-a575-4934-807e-ede11be369ea tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:15:17.216961 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-ce40b5c4-a575-4934-807e-ede11be369ea tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:15:17.217181 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-ce40b5c4-a575-4934-807e-ede11be369ea tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:15:17.217651 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-ce40b5c4-a575-4934-807e-ede11be369ea tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:15:17.217897 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-ce40b5c4-a575-4934-807e-ede11be369ea tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:15:17.333449 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ac948ecd-4b87-454c-9c40-9b634648b6be tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:17.361967 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ac948ecd-4b87-454c-9c40-9b634648b6be tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1472 microversion: 2.1 time: 0.501686 Aug 07 01:15:17.362631 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 683/1239] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:16 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1472 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:17.368317 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-66611b13-d59c-49a7-be26-08834c849ab6 tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Calling method '.version_select at 0x7f9e246d54c0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:17.373097 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:15:17.373097 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:15:17.375393 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-66611b13-d59c-49a7-be26-08834c849ab6 tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:17.376292 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-66611b13-d59c-49a7-be26-08834c849ab6 tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:17.381416 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-66611b13-d59c-49a7-be26-08834c849ab6 tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:17.383366 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-66611b13-d59c-49a7-be26-08834c849ab6 tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:17.400419 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-66611b13-d59c-49a7-be26-08834c849ab6 tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:17.401016 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-66611b13-d59c-49a7-be26-08834c849ab6 tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:17.434813 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:17.436886 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ce40b5c4-a575-4934-807e-ede11be369ea tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "POST /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9/action" status: 202 len: 0 microversion: 2.1 time: 0.446476 Aug 07 01:15:17.441017 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 557/1240] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:15:16 2022] POST /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:15:17.443069 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b1e65619-3d68-414f-b339-c8858e1bb2d9 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:17.443693 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b1e65619-3d68-414f-b339-c8858e1bb2d9 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: ea2ef6ca-2623-496d-a174-1d7cbaf80f85] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:17.451414 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b1e65619-3d68-414f-b339-c8858e1bb2d9 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:17.454910 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b1e65619-3d68-414f-b339-c8858e1bb2d9 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:17.454910 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b1e65619-3d68-414f-b339-c8858e1bb2d9 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:17.454910 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b1e65619-3d68-414f-b339-c8858e1bb2d9 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:17.454910 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b1e65619-3d68-414f-b339-c8858e1bb2d9 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:17.455457 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b1e65619-3d68-414f-b339-c8858e1bb2d9 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:17.502934 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-66611b13-d59c-49a7-be26-08834c849ab6 tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.139127 Aug 07 01:15:17.518631 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 684/1241] 10.222.0.39 () {58 vars in 1128 bytes} [Sun Aug 7 01:15:17 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:17.529542 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c8778c0f-0b7f-44c9-847b-8b8109d76597 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:17.540322 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c8778c0f-0b7f-44c9-847b-8b8109d76597 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 2142aec1-a473-42c4-8676-84c497d613e3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:17.571713 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c8778c0f-0b7f-44c9-847b-8b8109d76597 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:17.573096 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c8778c0f-0b7f-44c9-847b-8b8109d76597 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:17.574153 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c8778c0f-0b7f-44c9-847b-8b8109d76597 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:17.582012 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c8778c0f-0b7f-44c9-847b-8b8109d76597 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:17.583354 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c8778c0f-0b7f-44c9-847b-8b8109d76597 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:17.584367 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c8778c0f-0b7f-44c9-847b-8b8109d76597 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:18.071874 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c8778c0f-0b7f-44c9-847b-8b8109d76597 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:18.098840 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c8778c0f-0b7f-44c9-847b-8b8109d76597 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3" status: 200 len: 1317 microversion: 2.1 time: 0.578014 Aug 07 01:15:18.104000 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 685/1242] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:17 2022] GET /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3 => generated 1317 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:18.128960 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4d368c29-f755-477d-8f23-3154b6d6db45 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:18.130131 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4d368c29-f755-477d-8f23-3154b6d6db45 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:18.163506 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d368c29-f755-477d-8f23-3154b6d6db45 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:18.184188 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d368c29-f755-477d-8f23-3154b6d6db45 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:18.196101 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d368c29-f755-477d-8f23-3154b6d6db45 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:18.201355 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d368c29-f755-477d-8f23-3154b6d6db45 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:18.202613 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d368c29-f755-477d-8f23-3154b6d6db45 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:18.203643 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d368c29-f755-477d-8f23-3154b6d6db45 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:18.457053 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b1e65619-3d68-414f-b339-c8858e1bb2d9 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f4a7231e4431c89712c557c4fa1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ac882e61ac45eb9abc60630e7337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:18.472590 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b1e65619-3d68-414f-b339-c8858e1bb2d9 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85" status: 200 len: 1323 microversion: 2.1 time: 1.031275 Aug 07 01:15:18.473644 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 558/1243] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:17 2022] GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85 => generated 1323 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:18.487230 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5a79c9b4-64f2-4b21-aa33-7f4379c55eb0 tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Calling method '.version_select at 0x7f9e242d53a0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:18.497760 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:15:18.497760 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:15:18.553481 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a79c9b4-64f2-4b21-aa33-7f4379c55eb0 tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:18.555156 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a79c9b4-64f2-4b21-aa33-7f4379c55eb0 tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:18.556041 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a79c9b4-64f2-4b21-aa33-7f4379c55eb0 tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:18.582864 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:18.620172 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4d368c29-f755-477d-8f23-3154b6d6db45 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:18.634312 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4d368c29-f755-477d-8f23-3154b6d6db45 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1472 microversion: 2.1 time: 0.528420 Aug 07 01:15:18.640303 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 686/1244] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:18 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1472 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:18.660690 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a79c9b4-64f2-4b21-aa33-7f4379c55eb0 tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:18.661370 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-700631f8-9992-45f3-8509-42424702c9c9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:18.661589 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a79c9b4-64f2-4b21-aa33-7f4379c55eb0 tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:18.663496 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-700631f8-9992-45f3-8509-42424702c9c9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:18.668636 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a79c9b4-64f2-4b21-aa33-7f4379c55eb0 tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:18.682856 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-700631f8-9992-45f3-8509-42424702c9c9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:18.685229 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-700631f8-9992-45f3-8509-42424702c9c9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:18.688502 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-700631f8-9992-45f3-8509-42424702c9c9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:18.691493 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-700631f8-9992-45f3-8509-42424702c9c9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:18.692814 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-700631f8-9992-45f3-8509-42424702c9c9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:18.693953 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-700631f8-9992-45f3-8509-42424702c9c9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:18.709211 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:18.741843 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5a79c9b4-64f2-4b21-aa33-7f4379c55eb0 tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts/n-h2-master-1" status: 200 len: 729 microversion: 2.1 time: 0.258117 Aug 07 01:15:18.742786 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 559/1245] 10.222.0.39 () {58 vars in 1170 bytes} [Sun Aug 7 01:15:18 2022] GET /compute/v2.1/os-hosts/n-h2-master-1 => generated 729 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:18.752528 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6f2c81e4-9aff-4533-b2cb-ddc96a6f9535 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:18.753153 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6f2c81e4-9aff-4533-b2cb-ddc96a6f9535 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:18.773451 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f2c81e4-9aff-4533-b2cb-ddc96a6f9535 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:18.774025 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f2c81e4-9aff-4533-b2cb-ddc96a6f9535 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:18.775042 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f2c81e4-9aff-4533-b2cb-ddc96a6f9535 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:18.775995 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f2c81e4-9aff-4533-b2cb-ddc96a6f9535 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:18.776291 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f2c81e4-9aff-4533-b2cb-ddc96a6f9535 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:18.776721 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f2c81e4-9aff-4533-b2cb-ddc96a6f9535 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:19.223693 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-700631f8-9992-45f3-8509-42424702c9c9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:19.308988 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-700631f8-9992-45f3-8509-42424702c9c9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 200 len: 1717 microversion: 2.1 time: 0.664634 Aug 07 01:15:19.315605 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 687/1246] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:18 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 1717 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:19.325839 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-d5b92835-b53a-460b-aec9-805aee5186c7 req-dd7c1f51-88f0-42a2-ba4c-51f8aeb35f8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "459c9fac-af66-443f-acd3-22587f83ca6e", "name": "network-vif-unplugged", "status": "completed", "tag": "920a50d8-b45c-480e-aaf9-c42f7d1e925e"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:15:19.348970 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d5b92835-b53a-460b-aec9-805aee5186c7 req-dd7c1f51-88f0-42a2-ba4c-51f8aeb35f8d service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:19.350179 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d5b92835-b53a-460b-aec9-805aee5186c7 req-dd7c1f51-88f0-42a2-ba4c-51f8aeb35f8d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:19.351726 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d5b92835-b53a-460b-aec9-805aee5186c7 req-dd7c1f51-88f0-42a2-ba4c-51f8aeb35f8d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:19.385496 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-d5b92835-b53a-460b-aec9-805aee5186c7 req-dd7c1f51-88f0-42a2-ba4c-51f8aeb35f8d service nova] Creating event network-vif-unplugged:920a50d8-b45c-480e-aaf9-c42f7d1e925e for instance 459c9fac-af66-443f-acd3-22587f83ca6e on n-h2-master-1 Aug 07 01:15:19.429695 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-d5b92835-b53a-460b-aec9-805aee5186c7 req-dd7c1f51-88f0-42a2-ba4c-51f8aeb35f8d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110818 Aug 07 01:15:19.431443 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 688/1247] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:19.447611 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-392b58b0-b7dc-41d3-b554-6439faa30b8d tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Calling method '.version_select at 0x7f9e2475fd30>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:19.451027 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:15:19.451027 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:15:19.466434 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-392b58b0-b7dc-41d3-b554-6439faa30b8d tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:19.468928 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-392b58b0-b7dc-41d3-b554-6439faa30b8d tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:19.470070 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-392b58b0-b7dc-41d3-b554-6439faa30b8d tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:19.503684 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-392b58b0-b7dc-41d3-b554-6439faa30b8d tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:19.504767 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-392b58b0-b7dc-41d3-b554-6439faa30b8d tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:19.505517 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-392b58b0-b7dc-41d3-b554-6439faa30b8d tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:19.678358 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-392b58b0-b7dc-41d3-b554-6439faa30b8d tempest-HostsAdminTestJSON-974387822 tempest-HostsAdminTestJSON-974387822-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts/n-h1-master-1" status: 200 len: 997 microversion: 2.1 time: 0.242124 Aug 07 01:15:19.694799 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 689/1248] 10.222.0.39 () {58 vars in 1170 bytes} [Sun Aug 7 01:15:19 2022] GET /compute/v2.1/os-hosts/n-h1-master-1 => generated 997 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:19.705394 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b9850454-4101-4b10-8763-224b22c0ee56 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:19.706851 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b9850454-4101-4b10-8763-224b22c0ee56 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 2142aec1-a473-42c4-8676-84c497d613e3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:19.720268 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b9850454-4101-4b10-8763-224b22c0ee56 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:19.721138 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b9850454-4101-4b10-8763-224b22c0ee56 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:19.721973 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b9850454-4101-4b10-8763-224b22c0ee56 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:19.723982 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b9850454-4101-4b10-8763-224b22c0ee56 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:19.726979 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b9850454-4101-4b10-8763-224b22c0ee56 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:19.727953 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b9850454-4101-4b10-8763-224b22c0ee56 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:20.636534 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6f2c81e4-9aff-4533-b2cb-ddc96a6f9535 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:20.666758 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6f2c81e4-9aff-4533-b2cb-ddc96a6f9535 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1472 microversion: 2.1 time: 1.922422 Aug 07 01:15:20.694058 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 560/1249] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:18 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1472 bytes in 1950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:20.717779 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4078e190-156d-45fd-bba8-72d203166412 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:20.727229 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4078e190-156d-45fd-bba8-72d203166412 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: ea2ef6ca-2623-496d-a174-1d7cbaf80f85] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:20.750251 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4078e190-156d-45fd-bba8-72d203166412 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:20.752595 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4078e190-156d-45fd-bba8-72d203166412 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:20.753789 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4078e190-156d-45fd-bba8-72d203166412 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:20.755737 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4078e190-156d-45fd-bba8-72d203166412 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:20.757836 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4078e190-156d-45fd-bba8-72d203166412 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:20.758965 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4078e190-156d-45fd-bba8-72d203166412 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:21.206018 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b9850454-4101-4b10-8763-224b22c0ee56 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:21.234937 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b9850454-4101-4b10-8763-224b22c0ee56 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3" status: 200 len: 1317 microversion: 2.1 time: 1.536760 Aug 07 01:15:21.254923 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 690/1250] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:19 2022] GET /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3 => generated 1317 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:21.286034 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-692dc123-811d-4dba-a392-aa0966fa6b4d req-b6939b4c-9fd0-4159-81f5-b3b2cae03dcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2142aec1-a473-42c4-8676-84c497d613e3", "name": "network-vif-plugged", "status": "completed", "tag": "ef8dba12-291c-4f4b-95b1-f3f27fd5288b"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:15:21.344960 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-692dc123-811d-4dba-a392-aa0966fa6b4d req-b6939b4c-9fd0-4159-81f5-b3b2cae03dcc service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:21.350962 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-692dc123-811d-4dba-a392-aa0966fa6b4d req-b6939b4c-9fd0-4159-81f5-b3b2cae03dcc service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:21.352310 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-692dc123-811d-4dba-a392-aa0966fa6b4d req-b6939b4c-9fd0-4159-81f5-b3b2cae03dcc service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:21.393151 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-692dc123-811d-4dba-a392-aa0966fa6b4d req-b6939b4c-9fd0-4159-81f5-b3b2cae03dcc service nova] Creating event network-vif-plugged:ef8dba12-291c-4f4b-95b1-f3f27fd5288b for instance 2142aec1-a473-42c4-8676-84c497d613e3 on n-h1-master-1 Aug 07 01:15:21.402876 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-692dc123-811d-4dba-a392-aa0966fa6b4d req-b6939b4c-9fd0-4159-81f5-b3b2cae03dcc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132456 Aug 07 01:15:21.403987 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 691/1251] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:21.431401 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-72e42e95-95d7-4bbc-bb21-be801a3f0f44 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:21.433105 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-72e42e95-95d7-4bbc-bb21-be801a3f0f44 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:21.441925 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72e42e95-95d7-4bbc-bb21-be801a3f0f44 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:21.443508 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72e42e95-95d7-4bbc-bb21-be801a3f0f44 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:21.444555 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72e42e95-95d7-4bbc-bb21-be801a3f0f44 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:21.445885 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72e42e95-95d7-4bbc-bb21-be801a3f0f44 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:21.446689 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72e42e95-95d7-4bbc-bb21-be801a3f0f44 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:21.447369 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72e42e95-95d7-4bbc-bb21-be801a3f0f44 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:21.875669 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4078e190-156d-45fd-bba8-72d203166412 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f4a7231e4431c89712c557c4fa1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ac882e61ac45eb9abc60630e7337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:21.891855 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4078e190-156d-45fd-bba8-72d203166412 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85" status: 200 len: 1517 microversion: 2.1 time: 1.181919 Aug 07 01:15:21.893448 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 561/1252] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:20 2022] GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85 => generated 1517 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:21.902500 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b5a970a5-e089-4cf5-bd82-c9d861065d93 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:21.903814 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b5a970a5-e089-4cf5-bd82-c9d861065d93 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:21.915356 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5a970a5-e089-4cf5-bd82-c9d861065d93 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:21.918569 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5a970a5-e089-4cf5-bd82-c9d861065d93 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:21.920076 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5a970a5-e089-4cf5-bd82-c9d861065d93 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:21.922203 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5a970a5-e089-4cf5-bd82-c9d861065d93 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:21.924132 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5a970a5-e089-4cf5-bd82-c9d861065d93 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:21.924921 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5a970a5-e089-4cf5-bd82-c9d861065d93 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:22.250139 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-72e42e95-95d7-4bbc-bb21-be801a3f0f44 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:22.285036 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-72e42e95-95d7-4bbc-bb21-be801a3f0f44 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1472 microversion: 2.1 time: 0.875186 Aug 07 01:15:22.285699 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 692/1253] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:21 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1472 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:22.541208 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b5a970a5-e089-4cf5-bd82-c9d861065d93 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:22.551198 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5c77d866-246a-4e89-8f48-3c0ee7607e89 tempest-AZV2TestJSON-334172897 tempest-AZV2TestJSON-334172897-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:22.555085 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5c77d866-246a-4e89-8f48-3c0ee7607e89 tempest-AZV2TestJSON-334172897 tempest-AZV2TestJSON-334172897-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:22.556524 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5c77d866-246a-4e89-8f48-3c0ee7607e89 tempest-AZV2TestJSON-334172897 tempest-AZV2TestJSON-334172897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:22.557211 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5c77d866-246a-4e89-8f48-3c0ee7607e89 tempest-AZV2TestJSON-334172897 tempest-AZV2TestJSON-334172897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:22.558345 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5c77d866-246a-4e89-8f48-3c0ee7607e89 tempest-AZV2TestJSON-334172897 tempest-AZV2TestJSON-334172897-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:22.559172 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5c77d866-246a-4e89-8f48-3c0ee7607e89 tempest-AZV2TestJSON-334172897 tempest-AZV2TestJSON-334172897-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:22.559794 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5c77d866-246a-4e89-8f48-3c0ee7607e89 tempest-AZV2TestJSON-334172897 tempest-AZV2TestJSON-334172897-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:22.569876 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b5a970a5-e089-4cf5-bd82-c9d861065d93 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 200 len: 1717 microversion: 2.1 time: 0.668864 Aug 07 01:15:22.574084 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 562/1254] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:21 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 1717 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:22.598168 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8705f487-f199-49e4-9c40-f775050b7349 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:22.601876 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8705f487-f199-49e4-9c40-f775050b7349 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:22.616295 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5c77d866-246a-4e89-8f48-3c0ee7607e89 tempest-AZV2TestJSON-334172897 tempest-AZV2TestJSON-334172897-project] 10.222.0.39 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.329374 Aug 07 01:15:22.617595 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 693/1255] 10.222.0.39 () {58 vars in 1164 bytes} [Sun Aug 7 01:15:22 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:15:22.624194 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8705f487-f199-49e4-9c40-f775050b7349 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:22.625588 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8705f487-f199-49e4-9c40-f775050b7349 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:22.630938 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-58b33016-9011-4d28-8c15-4dceeb427eae req-4a204643-2cd1-4912-9cfa-e5dd599e2943 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "459c9fac-af66-443f-acd3-22587f83ca6e", "tag": "920a50d8-b45c-480e-aaf9-c42f7d1e925e"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:15:22.638325 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8705f487-f199-49e4-9c40-f775050b7349 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:22.640427 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8705f487-f199-49e4-9c40-f775050b7349 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:22.641379 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8705f487-f199-49e4-9c40-f775050b7349 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:22.642753 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8705f487-f199-49e4-9c40-f775050b7349 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:22.646584 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-58b33016-9011-4d28-8c15-4dceeb427eae req-4a204643-2cd1-4912-9cfa-e5dd599e2943 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:22.650649 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-58b33016-9011-4d28-8c15-4dceeb427eae req-4a204643-2cd1-4912-9cfa-e5dd599e2943 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:22.651496 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-58b33016-9011-4d28-8c15-4dceeb427eae req-4a204643-2cd1-4912-9cfa-e5dd599e2943 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:22.683050 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-58b33016-9011-4d28-8c15-4dceeb427eae req-4a204643-2cd1-4912-9cfa-e5dd599e2943 service nova] Creating event network-changed:920a50d8-b45c-480e-aaf9-c42f7d1e925e for instance 459c9fac-af66-443f-acd3-22587f83ca6e on n-h2-master-1 Aug 07 01:15:22.693417 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-58b33016-9011-4d28-8c15-4dceeb427eae req-4a204643-2cd1-4912-9cfa-e5dd599e2943 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073506 Aug 07 01:15:22.701476 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 694/1256] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:22.710250 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7d0c3adb-6288-4609-9ff7-9ee43fa5283d tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:22.711415 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7d0c3adb-6288-4609-9ff7-9ee43fa5283d tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: 45de519b-ab33-4648-9aa0-b9da5e3f1ef3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:22.721325 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d0c3adb-6288-4609-9ff7-9ee43fa5283d tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:22.722079 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d0c3adb-6288-4609-9ff7-9ee43fa5283d tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:22.722719 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d0c3adb-6288-4609-9ff7-9ee43fa5283d tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:22.723646 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d0c3adb-6288-4609-9ff7-9ee43fa5283d tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:22.724323 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d0c3adb-6288-4609-9ff7-9ee43fa5283d tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:22.724918 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d0c3adb-6288-4609-9ff7-9ee43fa5283d tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:23.046944 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8705f487-f199-49e4-9c40-f775050b7349 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:23.058734 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8705f487-f199-49e4-9c40-f775050b7349 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1472 microversion: 2.1 time: 0.482936 Aug 07 01:15:23.059503 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 563/1257] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:22 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1472 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:23.079264 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-61512f21-489d-4e38-bb71-e7b21d8738f0 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:23.082184 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-61512f21-489d-4e38-bb71-e7b21d8738f0 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 2142aec1-a473-42c4-8676-84c497d613e3] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:23.094593 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-61512f21-489d-4e38-bb71-e7b21d8738f0 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:23.096095 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-61512f21-489d-4e38-bb71-e7b21d8738f0 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:23.097019 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-61512f21-489d-4e38-bb71-e7b21d8738f0 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:23.097993 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-61512f21-489d-4e38-bb71-e7b21d8738f0 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:23.098648 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-61512f21-489d-4e38-bb71-e7b21d8738f0 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:23.099300 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-61512f21-489d-4e38-bb71-e7b21d8738f0 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:23.158544 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7d0c3adb-6288-4609-9ff7-9ee43fa5283d tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f4a7231e4431c89712c557c4fa1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ac882e61ac45eb9abc60630e7337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:23.186317 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7d0c3adb-6288-4609-9ff7-9ee43fa5283d tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers/45de519b-ab33-4648-9aa0-b9da5e3f1ef3" status: 200 len: 1516 microversion: 2.1 time: 0.482801 Aug 07 01:15:23.192449 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 695/1258] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:22 2022] GET /compute/v2.1/servers/45de519b-ab33-4648-9aa0-b9da5e3f1ef3 => generated 1516 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:23.212408 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-df5a1311-5ba6-4648-9360-60da35a886b3 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:23.218364 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-df5a1311-5ba6-4648-9360-60da35a886b3 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: e6920f55-726f-4258-bc23-2a794668d6bb] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:23.250411 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df5a1311-5ba6-4648-9360-60da35a886b3 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:23.251442 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df5a1311-5ba6-4648-9360-60da35a886b3 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:23.252275 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df5a1311-5ba6-4648-9360-60da35a886b3 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:23.256426 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df5a1311-5ba6-4648-9360-60da35a886b3 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:23.267674 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df5a1311-5ba6-4648-9360-60da35a886b3 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:23.268261 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df5a1311-5ba6-4648-9360-60da35a886b3 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:23.628615 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-61512f21-489d-4e38-bb71-e7b21d8738f0 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:23.654394 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-61512f21-489d-4e38-bb71-e7b21d8738f0 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3" status: 200 len: 1317 microversion: 2.1 time: 0.590605 Aug 07 01:15:23.655108 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 564/1259] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:23 2022] GET /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3 => generated 1317 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:23.670095 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bee59ecf-4de2-4dab-9bb8-895ba52dbd27 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:23.675022 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bee59ecf-4de2-4dab-9bb8-895ba52dbd27 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:23.708843 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bee59ecf-4de2-4dab-9bb8-895ba52dbd27 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:23.710798 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bee59ecf-4de2-4dab-9bb8-895ba52dbd27 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:23.712240 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bee59ecf-4de2-4dab-9bb8-895ba52dbd27 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:23.716610 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bee59ecf-4de2-4dab-9bb8-895ba52dbd27 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:23.717984 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bee59ecf-4de2-4dab-9bb8-895ba52dbd27 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:23.719488 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bee59ecf-4de2-4dab-9bb8-895ba52dbd27 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:24.045749 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-df5a1311-5ba6-4648-9360-60da35a886b3 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f4a7231e4431c89712c557c4fa1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ac882e61ac45eb9abc60630e7337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:24.056287 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-df5a1311-5ba6-4648-9360-60da35a886b3 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers/e6920f55-726f-4258-bc23-2a794668d6bb" status: 200 len: 1516 microversion: 2.1 time: 0.848364 Aug 07 01:15:24.092771 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 696/1260] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:23 2022] GET /compute/v2.1/servers/e6920f55-726f-4258-bc23-2a794668d6bb => generated 1516 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:24.098724 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a2f1d4f5-b6f4-4b83-a522-51c28a01153f tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:24.100038 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a2f1d4f5-b6f4-4b83-a522-51c28a01153f tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:24.121686 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2f1d4f5-b6f4-4b83-a522-51c28a01153f tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:24.122196 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2f1d4f5-b6f4-4b83-a522-51c28a01153f tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:24.122642 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2f1d4f5-b6f4-4b83-a522-51c28a01153f tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:24.123392 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2f1d4f5-b6f4-4b83-a522-51c28a01153f tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:24.123861 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2f1d4f5-b6f4-4b83-a522-51c28a01153f tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:24.124328 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2f1d4f5-b6f4-4b83-a522-51c28a01153f tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:24.395611 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bee59ecf-4de2-4dab-9bb8-895ba52dbd27 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:24.424081 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bee59ecf-4de2-4dab-9bb8-895ba52dbd27 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1472 microversion: 2.1 time: 0.766765 Aug 07 01:15:24.428072 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 565/1261] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:23 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1472 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:24.441990 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bac19be4-af46-4b51-9e83-25820672f9d5 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:24.449052 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bac19be4-af46-4b51-9e83-25820672f9d5 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:24.475964 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bac19be4-af46-4b51-9e83-25820672f9d5 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:24.478684 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bac19be4-af46-4b51-9e83-25820672f9d5 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:24.483738 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bac19be4-af46-4b51-9e83-25820672f9d5 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:24.485547 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bac19be4-af46-4b51-9e83-25820672f9d5 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:24.486787 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bac19be4-af46-4b51-9e83-25820672f9d5 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:24.487860 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bac19be4-af46-4b51-9e83-25820672f9d5 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:24.945074 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a2f1d4f5-b6f4-4b83-a522-51c28a01153f tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:24.968902 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a2f1d4f5-b6f4-4b83-a522-51c28a01153f tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 200 len: 1717 microversion: 2.1 time: 0.867462 Aug 07 01:15:24.970381 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 697/1262] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:24 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 1717 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:24.992475 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f2aa0e20-4cf4-44f5-8529-8a02a6a46092 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:24.993693 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f2aa0e20-4cf4-44f5-8529-8a02a6a46092 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: e6920f55-726f-4258-bc23-2a794668d6bb] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:25.009769 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2aa0e20-4cf4-44f5-8529-8a02a6a46092 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:25.010688 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2aa0e20-4cf4-44f5-8529-8a02a6a46092 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:25.012348 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2aa0e20-4cf4-44f5-8529-8a02a6a46092 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:25.013331 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2aa0e20-4cf4-44f5-8529-8a02a6a46092 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:25.014176 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2aa0e20-4cf4-44f5-8529-8a02a6a46092 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:25.014658 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2aa0e20-4cf4-44f5-8529-8a02a6a46092 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:25.039997 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bac19be4-af46-4b51-9e83-25820672f9d5 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:25.056427 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bac19be4-af46-4b51-9e83-25820672f9d5 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1472 microversion: 2.1 time: 0.621494 Aug 07 01:15:25.057811 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 566/1263] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:24 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1472 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:25.067985 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-76ef6b55-5c0e-417d-811c-4ddce9eed0b4 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:25.069426 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-76ef6b55-5c0e-417d-811c-4ddce9eed0b4 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 2142aec1-a473-42c4-8676-84c497d613e3] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:25.075924 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f2aa0e20-4cf4-44f5-8529-8a02a6a46092 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: e6920f55-726f-4258-bc23-2a794668d6bb] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:15:25.080493 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76ef6b55-5c0e-417d-811c-4ddce9eed0b4 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:25.081660 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76ef6b55-5c0e-417d-811c-4ddce9eed0b4 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:25.082588 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76ef6b55-5c0e-417d-811c-4ddce9eed0b4 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:25.084258 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76ef6b55-5c0e-417d-811c-4ddce9eed0b4 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:25.085285 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76ef6b55-5c0e-417d-811c-4ddce9eed0b4 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:25.086298 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76ef6b55-5c0e-417d-811c-4ddce9eed0b4 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:25.239128 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f2aa0e20-4cf4-44f5-8529-8a02a6a46092 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e6920f55-726f-4258-bc23-2a794668d6bb" status: 204 len: 0 microversion: 2.1 time: 0.266358 Aug 07 01:15:25.240686 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 698/1264] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:15:24 2022] DELETE /compute/v2.1/servers/e6920f55-726f-4258-bc23-2a794668d6bb => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:15:25.261299 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-565c90fa-db9f-4af5-a411-6bb242c7e95c tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:25.262823 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-565c90fa-db9f-4af5-a411-6bb242c7e95c tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: e6920f55-726f-4258-bc23-2a794668d6bb] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:25.275516 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-565c90fa-db9f-4af5-a411-6bb242c7e95c tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:25.276564 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-565c90fa-db9f-4af5-a411-6bb242c7e95c tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:25.277407 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-565c90fa-db9f-4af5-a411-6bb242c7e95c tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:25.278796 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-565c90fa-db9f-4af5-a411-6bb242c7e95c tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:25.279717 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-565c90fa-db9f-4af5-a411-6bb242c7e95c tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:25.280659 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-565c90fa-db9f-4af5-a411-6bb242c7e95c tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:25.500455 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-76ef6b55-5c0e-417d-811c-4ddce9eed0b4 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:25.511544 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-76ef6b55-5c0e-417d-811c-4ddce9eed0b4 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3" status: 200 len: 1466 microversion: 2.1 time: 0.451577 Aug 07 01:15:25.512904 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 567/1265] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:25 2022] GET /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3 => generated 1466 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:25.545910 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7b9d5b1c-e1cf-49dc-870d-ce81f67f383c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:25.551405 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7b9d5b1c-e1cf-49dc-870d-ce81f67f383c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:25.570982 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b9d5b1c-e1cf-49dc-870d-ce81f67f383c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:25.571858 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b9d5b1c-e1cf-49dc-870d-ce81f67f383c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:25.572677 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b9d5b1c-e1cf-49dc-870d-ce81f67f383c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:25.574280 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b9d5b1c-e1cf-49dc-870d-ce81f67f383c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:25.575123 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b9d5b1c-e1cf-49dc-870d-ce81f67f383c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:25.576240 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b9d5b1c-e1cf-49dc-870d-ce81f67f383c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:25.802120 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7b9d5b1c-e1cf-49dc-870d-ce81f67f383c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:25.810156 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7b9d5b1c-e1cf-49dc-870d-ce81f67f383c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1472 microversion: 2.1 time: 0.291069 Aug 07 01:15:25.824791 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 568/1266] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:25 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1472 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:25.830674 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c06636a9-545b-4f64-945a-93e1e72ee06c tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:25.831351 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c06636a9-545b-4f64-945a-93e1e72ee06c tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] [instance: 2142aec1-a473-42c4-8676-84c497d613e3] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:25.845365 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c06636a9-545b-4f64-945a-93e1e72ee06c tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:25.845872 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c06636a9-545b-4f64-945a-93e1e72ee06c tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:25.846320 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c06636a9-545b-4f64-945a-93e1e72ee06c tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:25.847070 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c06636a9-545b-4f64-945a-93e1e72ee06c tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:25.847535 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c06636a9-545b-4f64-945a-93e1e72ee06c tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:25.848024 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c06636a9-545b-4f64-945a-93e1e72ee06c tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:25.898740 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-565c90fa-db9f-4af5-a411-6bb242c7e95c tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f4a7231e4431c89712c557c4fa1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ac882e61ac45eb9abc60630e7337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:25.917030 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-565c90fa-db9f-4af5-a411-6bb242c7e95c tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers/e6920f55-726f-4258-bc23-2a794668d6bb" status: 200 len: 1522 microversion: 2.1 time: 0.669719 Aug 07 01:15:25.933830 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 699/1267] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:25 2022] GET /compute/v2.1/servers/e6920f55-726f-4258-bc23-2a794668d6bb => generated 1522 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:26.019791 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5d36f433-c1d2-4aac-94c8-dc7707aa335c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:26.020923 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5d36f433-c1d2-4aac-94c8-dc7707aa335c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:26.041965 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5d36f433-c1d2-4aac-94c8-dc7707aa335c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:26.044744 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5d36f433-c1d2-4aac-94c8-dc7707aa335c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:26.046202 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5d36f433-c1d2-4aac-94c8-dc7707aa335c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:26.048130 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5d36f433-c1d2-4aac-94c8-dc7707aa335c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:26.050556 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5d36f433-c1d2-4aac-94c8-dc7707aa335c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:26.052840 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5d36f433-c1d2-4aac-94c8-dc7707aa335c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:26.135395 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c06636a9-545b-4f64-945a-93e1e72ee06c tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3" status: 200 len: 1617 microversion: 2.1 time: 0.308992 Aug 07 01:15:26.136303 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 569/1268] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:25 2022] GET /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3 => generated 1617 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:26.143762 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-78971ad4-f35a-4e0a-8cfa-9c817f976d30 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:26.144520 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-78971ad4-f35a-4e0a-8cfa-9c817f976d30 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:26.164718 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78971ad4-f35a-4e0a-8cfa-9c817f976d30 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:26.165427 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78971ad4-f35a-4e0a-8cfa-9c817f976d30 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:26.166262 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78971ad4-f35a-4e0a-8cfa-9c817f976d30 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:26.169107 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78971ad4-f35a-4e0a-8cfa-9c817f976d30 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:26.180218 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78971ad4-f35a-4e0a-8cfa-9c817f976d30 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:26.186795 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78971ad4-f35a-4e0a-8cfa-9c817f976d30 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:26.500395 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5d36f433-c1d2-4aac-94c8-dc7707aa335c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:26.524048 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5d36f433-c1d2-4aac-94c8-dc7707aa335c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 200 len: 1717 microversion: 2.1 time: 0.511038 Aug 07 01:15:26.530767 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 700/1269] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:26 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 1717 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:15:26.548765 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-699997ce-9d05-4210-b9d7-368bc0577bf5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1658282338", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["8511418d-b773-43fd-adc1-bc8862f82015"]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:15:26.601651 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-78971ad4-f35a-4e0a-8cfa-9c817f976d30 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:26.631419 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-78971ad4-f35a-4e0a-8cfa-9c817f976d30 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1472 microversion: 2.1 time: 0.493789 Aug 07 01:15:26.644762 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 570/1270] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:26 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1472 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:26.671993 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-699997ce-9d05-4210-b9d7-368bc0577bf5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] validate_networks() for None {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:15:26.845560 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-df7560eb-9ef8-452b-b0cb-cb1ea3dc006b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:26.846727 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-df7560eb-9ef8-452b-b0cb-cb1ea3dc006b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:26.857743 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-df7560eb-9ef8-452b-b0cb-cb1ea3dc006b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:26.858651 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-df7560eb-9ef8-452b-b0cb-cb1ea3dc006b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:26.859306 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-df7560eb-9ef8-452b-b0cb-cb1ea3dc006b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:26.860676 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-df7560eb-9ef8-452b-b0cb-cb1ea3dc006b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:26.861415 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-df7560eb-9ef8-452b-b0cb-cb1ea3dc006b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:26.862062 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-df7560eb-9ef8-452b-b0cb-cb1ea3dc006b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:26.923390 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:27.078639 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-df7560eb-9ef8-452b-b0cb-cb1ea3dc006b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:27.088325 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-df7560eb-9ef8-452b-b0cb-cb1ea3dc006b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1472 microversion: 2.1 time: 0.246735 Aug 07 01:15:27.089310 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 571/1271] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:26 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1472 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:27.108201 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7a841fe1-3743-451b-b6cf-75b9a86abee3 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:27.109247 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7a841fe1-3743-451b-b6cf-75b9a86abee3 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: e6920f55-726f-4258-bc23-2a794668d6bb] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:27.117479 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a841fe1-3743-451b-b6cf-75b9a86abee3 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:27.118313 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a841fe1-3743-451b-b6cf-75b9a86abee3 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:27.119150 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a841fe1-3743-451b-b6cf-75b9a86abee3 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:27.120435 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a841fe1-3743-451b-b6cf-75b9a86abee3 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:27.121236 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a841fe1-3743-451b-b6cf-75b9a86abee3 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:27.121996 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a841fe1-3743-451b-b6cf-75b9a86abee3 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:27.383201 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7a841fe1-3743-451b-b6cf-75b9a86abee3 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f4a7231e4431c89712c557c4fa1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ac882e61ac45eb9abc60630e7337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:27.400309 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7a841fe1-3743-451b-b6cf-75b9a86abee3 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers/e6920f55-726f-4258-bc23-2a794668d6bb" status: 200 len: 1522 microversion: 2.1 time: 0.309199 Aug 07 01:15:27.402655 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 572/1272] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:27 2022] GET /compute/v2.1/servers/e6920f55-726f-4258-bc23-2a794668d6bb => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:27.565675 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-699997ce-9d05-4210-b9d7-368bc0577bf5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:15:27.566953 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-699997ce-9d05-4210-b9d7-368bc0577bf5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:15:27.567552 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-699997ce-9d05-4210-b9d7-368bc0577bf5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:15:27.568194 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-699997ce-9d05-4210-b9d7-368bc0577bf5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:15:27.569227 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-699997ce-9d05-4210-b9d7-368bc0577bf5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:15:27.581903 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-66fbbf9c-761c-4985-8b6c-22a104cc42f8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:27.582622 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-66fbbf9c-761c-4985-8b6c-22a104cc42f8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:27.590961 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-699997ce-9d05-4210-b9d7-368bc0577bf5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:27.591471 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-699997ce-9d05-4210-b9d7-368bc0577bf5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:27.591932 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-699997ce-9d05-4210-b9d7-368bc0577bf5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:27.592708 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-699997ce-9d05-4210-b9d7-368bc0577bf5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:27.593168 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-699997ce-9d05-4210-b9d7-368bc0577bf5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:27.593863 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-699997ce-9d05-4210-b9d7-368bc0577bf5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:27.610466 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-66fbbf9c-761c-4985-8b6c-22a104cc42f8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:27.610953 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-66fbbf9c-761c-4985-8b6c-22a104cc42f8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:27.611128 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-66fbbf9c-761c-4985-8b6c-22a104cc42f8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:27.615085 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-66fbbf9c-761c-4985-8b6c-22a104cc42f8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:27.618323 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-66fbbf9c-761c-4985-8b6c-22a104cc42f8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:27.620760 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-66fbbf9c-761c-4985-8b6c-22a104cc42f8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:27.635444 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-699997ce-9d05-4210-b9d7-368bc0577bf5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Getting quotas for project d08d010c14a64f759887be0d2364c6e4. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:15:27.650376 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-699997ce-9d05-4210-b9d7-368bc0577bf5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Getting quotas for user 32fc1959d8aa41eabcead217b9d7bc47 and project d08d010c14a64f759887be0d2364c6e4. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:15:27.683800 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-699997ce-9d05-4210-b9d7-368bc0577bf5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:15:27.686732 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-699997ce-9d05-4210-b9d7-368bc0577bf5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: a0c22e90-af12-4699-beb3-463ba9e81e65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:15:27.774371 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-699997ce-9d05-4210-b9d7-368bc0577bf5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.242584 Aug 07 01:15:27.789295 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 701/1273] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:15:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1258 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:15:27.795356 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a0483073-8683-4829-8fd6-dfbbd4084d04 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:27.796459 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a0483073-8683-4829-8fd6-dfbbd4084d04 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:27.815119 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a0483073-8683-4829-8fd6-dfbbd4084d04 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:27.816036 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a0483073-8683-4829-8fd6-dfbbd4084d04 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:27.816725 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a0483073-8683-4829-8fd6-dfbbd4084d04 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:27.817961 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a0483073-8683-4829-8fd6-dfbbd4084d04 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:27.818816 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a0483073-8683-4829-8fd6-dfbbd4084d04 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:27.819543 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a0483073-8683-4829-8fd6-dfbbd4084d04 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:28.083633 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-66fbbf9c-761c-4985-8b6c-22a104cc42f8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:28.101776 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-66fbbf9c-761c-4985-8b6c-22a104cc42f8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 200 len: 1717 microversion: 2.1 time: 0.536035 Aug 07 01:15:28.104090 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 573/1274] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:27 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 1717 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:28.145481 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d7d73d73-d9e5-4dd6-8c9f-43eed8321622 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:28.148745 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d7d73d73-d9e5-4dd6-8c9f-43eed8321622 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: a0c22e90-af12-4699-beb3-463ba9e81e65] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:28.250277 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a0483073-8683-4829-8fd6-dfbbd4084d04 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:28.260921 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a0483073-8683-4829-8fd6-dfbbd4084d04 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1472 microversion: 2.1 time: 0.470166 Aug 07 01:15:28.273647 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 702/1275] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:27 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1472 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:28.315556 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d7d73d73-d9e5-4dd6-8c9f-43eed8321622 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:28.331585 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d7d73d73-d9e5-4dd6-8c9f-43eed8321622 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/a0c22e90-af12-4699-beb3-463ba9e81e65" status: 200 len: 1217 microversion: 2.1 time: 0.225142 Aug 07 01:15:28.347856 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 574/1276] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:28 2022] GET /compute/v2.1/servers/a0c22e90-af12-4699-beb3-463ba9e81e65 => generated 1217 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:28.347856 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2233461e-f214-45a2-b1c2-d48f59d9f78b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:28.347856 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2233461e-f214-45a2-b1c2-d48f59d9f78b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:28.365356 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2233461e-f214-45a2-b1c2-d48f59d9f78b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:28.368410 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2233461e-f214-45a2-b1c2-d48f59d9f78b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:28.369758 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2233461e-f214-45a2-b1c2-d48f59d9f78b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:28.371081 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2233461e-f214-45a2-b1c2-d48f59d9f78b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:28.374780 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2233461e-f214-45a2-b1c2-d48f59d9f78b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:28.376739 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2233461e-f214-45a2-b1c2-d48f59d9f78b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:28.870852 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2233461e-f214-45a2-b1c2-d48f59d9f78b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:28.899613 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2233461e-f214-45a2-b1c2-d48f59d9f78b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1477 microversion: 2.1 time: 0.560076 Aug 07 01:15:28.904071 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 575/1277] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:28 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1477 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:28.921955 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-28411540-7dce-4661-ab85-bce51a77906b tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:28.922521 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-28411540-7dce-4661-ab85-bce51a77906b tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: e6920f55-726f-4258-bc23-2a794668d6bb] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:28.947052 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e6b1f836-2c2b-4f87-88ab-89ef8d4e5c80 tempest-FloatingIPDetailsTestJSON-243814326 tempest-FloatingIPDetailsTestJSON-243814326-project] Action: 'create', calling method: .version_select at 0x7f9e24719af0>, body: {"pool": null} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:15:28.951133 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28411540-7dce-4661-ab85-bce51a77906b tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:28.956441 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28411540-7dce-4661-ab85-bce51a77906b tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:28.956923 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28411540-7dce-4661-ab85-bce51a77906b tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:28.958250 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28411540-7dce-4661-ab85-bce51a77906b tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:28.958733 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28411540-7dce-4661-ab85-bce51a77906b tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:28.959300 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28411540-7dce-4661-ab85-bce51a77906b tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:29.319536 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-28411540-7dce-4661-ab85-bce51a77906b tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f4a7231e4431c89712c557c4fa1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ac882e61ac45eb9abc60630e7337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:29.324114 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:29.351104 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-28411540-7dce-4661-ab85-bce51a77906b tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers/e6920f55-726f-4258-bc23-2a794668d6bb" status: 200 len: 1522 microversion: 2.1 time: 0.445437 Aug 07 01:15:29.356191 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 576/1278] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:28 2022] GET /compute/v2.1/servers/e6920f55-726f-4258-bc23-2a794668d6bb => generated 1522 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:29.377929 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-49f8e47b-cb8b-4ab6-988e-73cac86e4b4f tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:29.378565 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-49f8e47b-cb8b-4ab6-988e-73cac86e4b4f tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:29.429460 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49f8e47b-cb8b-4ab6-988e-73cac86e4b4f tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:29.430188 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49f8e47b-cb8b-4ab6-988e-73cac86e4b4f tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:29.431224 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49f8e47b-cb8b-4ab6-988e-73cac86e4b4f tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:29.432504 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49f8e47b-cb8b-4ab6-988e-73cac86e4b4f tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:29.433215 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49f8e47b-cb8b-4ab6-988e-73cac86e4b4f tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:29.435209 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49f8e47b-cb8b-4ab6-988e-73cac86e4b4f tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:29.931236 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-49f8e47b-cb8b-4ab6-988e-73cac86e4b4f tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:29.974409 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-49f8e47b-cb8b-4ab6-988e-73cac86e4b4f tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 200 len: 1717 microversion: 2.1 time: 0.609390 Aug 07 01:15:29.991211 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 577/1279] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:29 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 1717 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:30.003442 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a390f689-ebb9-48e6-9804-acaff6a7ebb5 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:30.007973 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a390f689-ebb9-48e6-9804-acaff6a7ebb5 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:30.025707 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a390f689-ebb9-48e6-9804-acaff6a7ebb5 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:30.026546 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a390f689-ebb9-48e6-9804-acaff6a7ebb5 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:30.030336 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a390f689-ebb9-48e6-9804-acaff6a7ebb5 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:30.031334 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a390f689-ebb9-48e6-9804-acaff6a7ebb5 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:30.032466 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a390f689-ebb9-48e6-9804-acaff6a7ebb5 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:30.038042 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a390f689-ebb9-48e6-9804-acaff6a7ebb5 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:30.682220 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a390f689-ebb9-48e6-9804-acaff6a7ebb5 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:30.701105 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a390f689-ebb9-48e6-9804-acaff6a7ebb5 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1472 microversion: 2.1 time: 0.706095 Aug 07 01:15:30.701751 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 578/1280] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:29 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1472 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:30.718064 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5bffa8ec-4126-497d-9ce2-faf255e6459b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:30.718686 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5bffa8ec-4126-497d-9ce2-faf255e6459b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: a0c22e90-af12-4699-beb3-463ba9e81e65] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:30.748019 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5bffa8ec-4126-497d-9ce2-faf255e6459b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:30.748542 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5bffa8ec-4126-497d-9ce2-faf255e6459b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:30.748988 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5bffa8ec-4126-497d-9ce2-faf255e6459b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:30.749717 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5bffa8ec-4126-497d-9ce2-faf255e6459b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:30.750173 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5bffa8ec-4126-497d-9ce2-faf255e6459b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:30.756006 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5bffa8ec-4126-497d-9ce2-faf255e6459b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:31.063025 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5bffa8ec-4126-497d-9ce2-faf255e6459b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:31.075316 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5bffa8ec-4126-497d-9ce2-faf255e6459b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/a0c22e90-af12-4699-beb3-463ba9e81e65" status: 200 len: 1275 microversion: 2.1 time: 0.369870 Aug 07 01:15:31.081963 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 579/1281] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:30 2022] GET /compute/v2.1/servers/a0c22e90-af12-4699-beb3-463ba9e81e65 => generated 1275 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:31.421436 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-dd6d98c4-a414-4274-88d3-3664c717b4ee tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Calling method '.version_select at 0x7f9e2436a310>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:31.423925 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:15:31.423925 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:15:31.427015 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd6d98c4-a414-4274-88d3-3664c717b4ee tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:31.428252 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd6d98c4-a414-4274-88d3-3664c717b4ee tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:31.430648 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd6d98c4-a414-4274-88d3-3664c717b4ee tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:31.482463 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:31.487664 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd6d98c4-a414-4274-88d3-3664c717b4ee tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:31.491678 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd6d98c4-a414-4274-88d3-3664c717b4ee tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:31.494813 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd6d98c4-a414-4274-88d3-3664c717b4ee tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:31.540599 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd6d98c4-a414-4274-88d3-3664c717b4ee tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:31.541103 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd6d98c4-a414-4274-88d3-3664c717b4ee tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:31.541549 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd6d98c4-a414-4274-88d3-3664c717b4ee tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:31.556251 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-dd6d98c4-a414-4274-88d3-3664c717b4ee tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.472587 Aug 07 01:15:31.557371 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 580/1282] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:15:31 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:31.562703 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-38ee7042-71fa-4a13-9e9c-2eb6e1693264 req-253c64c4-b093-4730-a961-d2a329464232 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6920f55-726f-4258-bc23-2a794668d6bb", "name": "network-vif-deleted", "tag": "1cf0c711-e914-4498-9f47-8e34535de7c7"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:15:31.575392 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-38ee7042-71fa-4a13-9e9c-2eb6e1693264 req-253c64c4-b093-4730-a961-d2a329464232 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:31.575898 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-38ee7042-71fa-4a13-9e9c-2eb6e1693264 req-253c64c4-b093-4730-a961-d2a329464232 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:31.576340 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-38ee7042-71fa-4a13-9e9c-2eb6e1693264 req-253c64c4-b093-4730-a961-d2a329464232 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:31.589437 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-38ee7042-71fa-4a13-9e9c-2eb6e1693264 req-253c64c4-b093-4730-a961-d2a329464232 service nova] Creating event network-vif-deleted:1cf0c711-e914-4498-9f47-8e34535de7c7 for instance e6920f55-726f-4258-bc23-2a794668d6bb on n-h1-master-1 Aug 07 01:15:31.594954 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-38ee7042-71fa-4a13-9e9c-2eb6e1693264 req-253c64c4-b093-4730-a961-d2a329464232 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036042 Aug 07 01:15:31.595565 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 581/1283] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:31.602477 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cfa35394-71a6-4859-a972-8f549ce0fe04 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:31.603617 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-cfa35394-71a6-4859-a972-8f549ce0fe04 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:31.612605 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cfa35394-71a6-4859-a972-8f549ce0fe04 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:31.613103 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cfa35394-71a6-4859-a972-8f549ce0fe04 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:31.613545 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cfa35394-71a6-4859-a972-8f549ce0fe04 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:31.614331 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cfa35394-71a6-4859-a972-8f549ce0fe04 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:31.614791 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cfa35394-71a6-4859-a972-8f549ce0fe04 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:31.615733 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cfa35394-71a6-4859-a972-8f549ce0fe04 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:32.286764 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-cfa35394-71a6-4859-a972-8f549ce0fe04 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:32.304101 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cfa35394-71a6-4859-a972-8f549ce0fe04 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1477 microversion: 2.1 time: 0.707098 Aug 07 01:15:32.305129 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 582/1284] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:31 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1477 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:32.320274 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f6330d34-ebf8-468a-963b-bb1d767adcf4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:32.326804 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f6330d34-ebf8-468a-963b-bb1d767adcf4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: e6920f55-726f-4258-bc23-2a794668d6bb] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:32.341129 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f6330d34-ebf8-468a-963b-bb1d767adcf4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:32.344343 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f6330d34-ebf8-468a-963b-bb1d767adcf4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:32.345126 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f6330d34-ebf8-468a-963b-bb1d767adcf4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:32.346137 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f6330d34-ebf8-468a-963b-bb1d767adcf4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:32.350305 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f6330d34-ebf8-468a-963b-bb1d767adcf4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:32.351144 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f6330d34-ebf8-468a-963b-bb1d767adcf4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:32.385827 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-f6330d34-ebf8-468a-963b-bb1d767adcf4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] HTTP exception thrown: Instance e6920f55-726f-4258-bc23-2a794668d6bb could not be found. Aug 07 01:15:32.387568 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f6330d34-ebf8-468a-963b-bb1d767adcf4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Request method failure captured: Aug 07 01:15:32.387568 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/e6920f55-726f-4258-bc23-2a794668d6bb HTTP/1.1 Aug 07 01:15:32.387568 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:15:32.387568 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:15:32.387568 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:15:32.387568 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:15:32.387568 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:15:32.387568 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:15:32.387568 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:15:32.387568 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:15:32.387568 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xH_7heYCkV2-y0pNneGN4ZnDqbs4UmpJQTmK5saNuk5H0WyhR4p8FKNrWGv5t9UmFTbjW-ntOaSKUHzjZAArTCL_7x2Uwa1lfuWNi0MRrWbfTOLIoXB6XEN1mRKk4FXNp_uEqv_bhxSKtjhZMsFP1MHgSM_FhzIX5Da4H4U1Rw8NW4 Aug 07 01:15:32.387568 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:15:32.387568 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:15:32.387568 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:15:32.387568 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:15:32.387568 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:15:32.387568 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:15:32.387568 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 45ac882e61ac45eb9abc60630e7337c3 Aug 07 01:15:32.387568 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ListServersNegativeTestJSON-938780471 Aug 07 01:15:32.387568 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:15:32.387568 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:15:32.389277 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/45ac882e61ac45eb9abc60630e7337c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_45ac882e61ac45eb9abc60630e7337c3", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/45ac882e61ac45eb9abc60630e7337c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/45ac882e61ac45eb9abc60630e7337c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:15:32.389277 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ListServersNegativeTestJSON-938780471 Aug 07 01:15:32.389277 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 45ac882e61ac45eb9abc60630e7337c3 Aug 07 01:15:32.389277 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-938780471 Aug 07 01:15:32.389277 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ListServersNegativeTestJSON-938780471-project Aug 07 01:15:32.389277 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:15:32.389277 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:15:32.389277 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: ae4f4a7231e4431c89712c557c4fa1df Aug 07 01:15:32.389277 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ListServersNegativeTestJSON-938780471-project Aug 07 01:15:32.389277 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:15:32.389277 n-d-master-1 devstack@n-api.service[119517]: exception: Instance e6920f55-726f-4258-bc23-2a794668d6bb could not be found. Aug 07 01:15:32.389277 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'e6920f55-726f-4258-bc23-2a794668d6bb'} Aug 07 01:15:32.390114 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:15:32.390114 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:32.390114 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:15:32.390114 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:15:32.390114 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:15:32.390114 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:15:32.390114 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:15:32.390114 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:15:32.390114 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:15:32.390114 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:15:32.390114 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6920f55-726f-4258-bc23-2a794668d6bb could not be found. Aug 07 01:15:32.390114 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:15:32.390114 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:15:32.390114 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:15:32.390114 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:32.390114 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:15:32.390114 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:15:32.390114 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:15:32.390114 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:15:32.390114 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:15:32.391464 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:15:32.391464 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:15:32.391464 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:15:32.391464 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:15:32.391464 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:15:32.391464 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:15:32.391464 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:15:32.391464 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6920f55-726f-4258-bc23-2a794668d6bb could not be found. Aug 07 01:15:32.391464 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:15:32.391464 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:15:32.391464 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:15:32.391464 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:32.391464 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:15:32.391464 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:15:32.391464 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:15:32.391464 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:15:32.391464 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6920f55-726f-4258-bc23-2a794668d6bb could not be found. Aug 07 01:15:32.391464 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:15:32.396086 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f6330d34-ebf8-468a-963b-bb1d767adcf4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Returning 404 to user: Instance e6920f55-726f-4258-bc23-2a794668d6bb could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:15:32.396086 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f6330d34-ebf8-468a-963b-bb1d767adcf4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers/e6920f55-726f-4258-bc23-2a794668d6bb" status: 404 len: 111 microversion: 2.1 time: 0.081290 Aug 07 01:15:32.403341 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 583/1285] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:32 2022] GET /compute/v2.1/servers/e6920f55-726f-4258-bc23-2a794668d6bb => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:15:32.409133 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7b8c121a-4bf9-444e-a379-79af482075ff tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:32.409853 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7b8c121a-4bf9-444e-a379-79af482075ff tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:32.439627 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b8c121a-4bf9-444e-a379-79af482075ff tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:32.440208 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b8c121a-4bf9-444e-a379-79af482075ff tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:32.440665 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b8c121a-4bf9-444e-a379-79af482075ff tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:32.445002 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b8c121a-4bf9-444e-a379-79af482075ff tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:32.445616 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b8c121a-4bf9-444e-a379-79af482075ff tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:32.446108 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b8c121a-4bf9-444e-a379-79af482075ff tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:33.089023 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e6b1f836-2c2b-4f87-88ab-89ef8d4e5c80 tempest-FloatingIPDetailsTestJSON-243814326 tempest-FloatingIPDetailsTestJSON-243814326-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.813455 Aug 07 01:15:33.090108 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 703/1286] 10.222.0.39 () {60 vars in 1170 bytes} [Sun Aug 7 01:15:28 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4816 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:33.104893 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f64d8ea2-88f0-4655-9e29-27b33d18e49f tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Calling method '.version_select at 0x7f9e245f7dc0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:33.109579 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:15:33.109579 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:15:33.119189 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f64d8ea2-88f0-4655-9e29-27b33d18e49f tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:33.120399 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f64d8ea2-88f0-4655-9e29-27b33d18e49f tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:33.120910 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f64d8ea2-88f0-4655-9e29-27b33d18e49f tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:33.194396 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f64d8ea2-88f0-4655-9e29-27b33d18e49f tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:33.199836 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f64d8ea2-88f0-4655-9e29-27b33d18e49f tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:33.203202 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f64d8ea2-88f0-4655-9e29-27b33d18e49f tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:33.231663 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f64d8ea2-88f0-4655-9e29-27b33d18e49f tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:33.234854 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f64d8ea2-88f0-4655-9e29-27b33d18e49f tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:33.239537 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f64d8ea2-88f0-4655-9e29-27b33d18e49f tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:33.258133 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f64d8ea2-88f0-4655-9e29-27b33d18e49f tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.165642 Aug 07 01:15:33.275926 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 704/1287] 10.222.0.39 () {58 vars in 1167 bytes} [Sun Aug 7 01:15:33 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:33.275926 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-191a5369-0a78-4fc3-8ac9-e58306324ec1 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:33.277515 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-191a5369-0a78-4fc3-8ac9-e58306324ec1 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:33.296565 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-191a5369-0a78-4fc3-8ac9-e58306324ec1 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:33.299754 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-191a5369-0a78-4fc3-8ac9-e58306324ec1 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:33.301015 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-191a5369-0a78-4fc3-8ac9-e58306324ec1 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:33.306560 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-191a5369-0a78-4fc3-8ac9-e58306324ec1 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:33.307449 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-191a5369-0a78-4fc3-8ac9-e58306324ec1 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:33.309864 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-191a5369-0a78-4fc3-8ac9-e58306324ec1 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:33.696602 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-191a5369-0a78-4fc3-8ac9-e58306324ec1 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:33.704834 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-191a5369-0a78-4fc3-8ac9-e58306324ec1 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1472 microversion: 2.1 time: 0.441479 Aug 07 01:15:33.716590 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 705/1288] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:33 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1472 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:33.721826 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cfa1ed8a-2e85-4a1b-9391-bb4b8583db2b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:33.722445 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cfa1ed8a-2e85-4a1b-9391-bb4b8583db2b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: a0c22e90-af12-4699-beb3-463ba9e81e65] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:33.734121 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfa1ed8a-2e85-4a1b-9391-bb4b8583db2b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:33.734920 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfa1ed8a-2e85-4a1b-9391-bb4b8583db2b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:33.735600 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfa1ed8a-2e85-4a1b-9391-bb4b8583db2b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:33.741288 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfa1ed8a-2e85-4a1b-9391-bb4b8583db2b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:33.742079 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfa1ed8a-2e85-4a1b-9391-bb4b8583db2b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:33.742718 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfa1ed8a-2e85-4a1b-9391-bb4b8583db2b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:33.783822 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:33.853157 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7b8c121a-4bf9-444e-a379-79af482075ff tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:33.878662 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7b8c121a-4bf9-444e-a379-79af482075ff tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 200 len: 1717 microversion: 2.1 time: 1.468554 Aug 07 01:15:33.879370 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 584/1289] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:32 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 1717 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:33.911841 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1b3aabc1-81c3-4ffb-9a08-5a21e234f220 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:33.926497 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1b3aabc1-81c3-4ffb-9a08-5a21e234f220 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae4f4a7231e4431c89712c557c4fa1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ac882e61ac45eb9abc60630e7337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:33.927979 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1b3aabc1-81c3-4ffb-9a08-5a21e234f220 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '45ac882e61ac45eb9abc60630e7337c3'} {{(pid=119517) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:15:33.940244 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b3aabc1-81c3-4ffb-9a08-5a21e234f220 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:33.949656 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b3aabc1-81c3-4ffb-9a08-5a21e234f220 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:33.950423 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b3aabc1-81c3-4ffb-9a08-5a21e234f220 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:33.951449 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b3aabc1-81c3-4ffb-9a08-5a21e234f220 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:33.952646 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b3aabc1-81c3-4ffb-9a08-5a21e234f220 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:33.953508 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b3aabc1-81c3-4ffb-9a08-5a21e234f220 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:34.135601 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1b3aabc1-81c3-4ffb-9a08-5a21e234f220 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.236618 Aug 07 01:15:34.139525 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 585/1290] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:15:33 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:15:34.150098 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-572c4f4a-779a-4b46-b3d2-97a783656e83 tempest-FloatingIPDetailsTestJSON-243814326 tempest-FloatingIPDetailsTestJSON-243814326-project] Action: 'create', calling method: .version_select at 0x7f9e242c8790>, body: {"pool": null} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:15:34.291383 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cfa1ed8a-2e85-4a1b-9391-bb4b8583db2b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:34.302305 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cfa1ed8a-2e85-4a1b-9391-bb4b8583db2b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/a0c22e90-af12-4699-beb3-463ba9e81e65" status: 200 len: 1317 microversion: 2.1 time: 0.584196 Aug 07 01:15:34.322759 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 706/1291] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:33 2022] GET /compute/v2.1/servers/a0c22e90-af12-4699-beb3-463ba9e81e65 => generated 1317 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:34.327932 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f5b77666-c811-4181-8b98-126e11c07133 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Calling method '.version_select at 0x7f9e2482aaf0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:34.328837 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:15:34.328837 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:15:34.330385 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f5b77666-c811-4181-8b98-126e11c07133 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:34.330951 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f5b77666-c811-4181-8b98-126e11c07133 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:34.331465 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f5b77666-c811-4181-8b98-126e11c07133 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:34.369064 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f5b77666-c811-4181-8b98-126e11c07133 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:34.370026 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f5b77666-c811-4181-8b98-126e11c07133 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:34.370688 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f5b77666-c811-4181-8b98-126e11c07133 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:34.386489 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f5b77666-c811-4181-8b98-126e11c07133 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:34.387271 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f5b77666-c811-4181-8b98-126e11c07133 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:34.387877 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f5b77666-c811-4181-8b98-126e11c07133 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:34.421755 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f5b77666-c811-4181-8b98-126e11c07133 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.109372 Aug 07 01:15:34.432315 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 707/1292] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:15:34 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:34.467696 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c55c4655-a4dd-4280-a765-6b1f700411af tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:34.473174 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c55c4655-a4dd-4280-a765-6b1f700411af tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:34.491586 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c55c4655-a4dd-4280-a765-6b1f700411af tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:34.492342 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c55c4655-a4dd-4280-a765-6b1f700411af tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:34.492940 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c55c4655-a4dd-4280-a765-6b1f700411af tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:34.494136 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c55c4655-a4dd-4280-a765-6b1f700411af tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:34.494859 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c55c4655-a4dd-4280-a765-6b1f700411af tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:34.495482 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c55c4655-a4dd-4280-a765-6b1f700411af tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:34.808311 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c55c4655-a4dd-4280-a765-6b1f700411af tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:34.829285 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c55c4655-a4dd-4280-a765-6b1f700411af tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1477 microversion: 2.1 time: 0.395216 Aug 07 01:15:34.833434 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 708/1293] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:34 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1477 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:34.842262 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-df62aad8-3664-4e36-9492-0704adea5897 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:34.848276 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-df62aad8-3664-4e36-9492-0704adea5897 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Request method failure captured: Aug 07 01:15:34.848276 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 07 01:15:34.848276 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:15:34.848276 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:15:34.848276 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:15:34.848276 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:15:34.848276 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:15:34.848276 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:15:34.848276 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:15:34.848276 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:15:34.848276 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xH_7heYCkV2-y0pNneGN4ZnDqbs4UmpJQTmK5saNuk5H0WyhR4p8FKNrWGv5t9UmFTbjW-ntOaSKUHzjZAArTCL_7x2Uwa1lfuWNi0MRrWbfTOLIoXB6XEN1mRKk4FXNp_uEqv_bhxSKtjhZMsFP1MHgSM_FhzIX5Da4H4U1Rw8NW4 Aug 07 01:15:34.848276 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:15:34.848276 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:15:34.848276 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:15:34.848276 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:15:34.848276 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:15:34.848276 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:15:34.848276 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 45ac882e61ac45eb9abc60630e7337c3 Aug 07 01:15:34.848276 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ListServersNegativeTestJSON-938780471 Aug 07 01:15:34.848276 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:15:34.848276 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:15:34.850375 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/45ac882e61ac45eb9abc60630e7337c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_45ac882e61ac45eb9abc60630e7337c3", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/45ac882e61ac45eb9abc60630e7337c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/45ac882e61ac45eb9abc60630e7337c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:15:34.850375 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ListServersNegativeTestJSON-938780471 Aug 07 01:15:34.850375 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 45ac882e61ac45eb9abc60630e7337c3 Aug 07 01:15:34.850375 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-938780471 Aug 07 01:15:34.850375 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ListServersNegativeTestJSON-938780471-project Aug 07 01:15:34.850375 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:15:34.850375 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:15:34.850375 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: ae4f4a7231e4431c89712c557c4fa1df Aug 07 01:15:34.850375 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ListServersNegativeTestJSON-938780471-project Aug 07 01:15:34.850375 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:15:34.850375 n-d-master-1 devstack@n-api.service[119516]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 07 01:15:34.850375 n-d-master-1 devstack@n-api.service[119516]: action_args: {} Aug 07 01:15:34.851154 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:15:34.851154 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:34.851154 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:15:34.851154 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:15:34.851154 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:15:34.851154 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:15:34.851154 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 07 01:15:34.851154 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:34.851154 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 07 01:15:34.851154 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 07 01:15:34.851154 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:34.851154 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 07 01:15:34.851154 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 07 01:15:34.851154 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:34.851154 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:15:34.851154 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:34.851154 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:34.851154 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:15:34.851154 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:15:34.851154 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:15:34.851154 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:15:34.851154 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:15:34.851154 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:15:34.852781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 07 01:15:34.852781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:15:34.852781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 07 01:15:34.852781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:15:34.852781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 07 01:15:34.852781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:15:34.852781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 07 01:15:34.852781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 07 01:15:34.852781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 07 01:15:34.852781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:15:34.852781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:15:34.852781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:15:34.852781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:15:34.852781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 07 01:15:34.852781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:34.852781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:15:34.852781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:34.852781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:34.852781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:15:34.852781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:15:34.854372 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:15:34.854372 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:15:34.854372 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 07 01:15:34.854372 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:34.854372 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-df62aad8-3664-4e36-9492-0704adea5897 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:15:34.860787 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-df62aad8-3664-4e36-9492-0704adea5897 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.015401 Aug 07 01:15:34.861449 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 709/1294] 10.222.0.39 () {58 vars in 1182 bytes} [Sun Aug 7 01:15:34 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:15:34.868756 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-408e8ae9-9d7d-48ed-b257-76030f63b888 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Calling method '.version_select at 0x7f9e24833040>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:34.869904 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:15:34.869904 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:15:34.871369 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-408e8ae9-9d7d-48ed-b257-76030f63b888 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:34.872065 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-408e8ae9-9d7d-48ed-b257-76030f63b888 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:34.872695 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-408e8ae9-9d7d-48ed-b257-76030f63b888 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:34.904054 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-408e8ae9-9d7d-48ed-b257-76030f63b888 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:34.905062 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-408e8ae9-9d7d-48ed-b257-76030f63b888 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:34.906322 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-408e8ae9-9d7d-48ed-b257-76030f63b888 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:34.916588 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-408e8ae9-9d7d-48ed-b257-76030f63b888 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.053849 Aug 07 01:15:34.918232 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 710/1295] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Aug 7 01:15:34 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:34.924183 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-d7da7e28-1f3c-4ad7-a255-8903d9bb97a7 req-74186607-889b-4114-8514-138b21036121 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0c22e90-af12-4699-beb3-463ba9e81e65", "tag": "491053e5-fdac-48b2-90c6-30b5040e819b"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:15:34.942606 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d7da7e28-1f3c-4ad7-a255-8903d9bb97a7 req-74186607-889b-4114-8514-138b21036121 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:34.944112 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d7da7e28-1f3c-4ad7-a255-8903d9bb97a7 req-74186607-889b-4114-8514-138b21036121 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:34.944914 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d7da7e28-1f3c-4ad7-a255-8903d9bb97a7 req-74186607-889b-4114-8514-138b21036121 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:34.964595 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-d7da7e28-1f3c-4ad7-a255-8903d9bb97a7 req-74186607-889b-4114-8514-138b21036121 service nova] Creating event network-changed:491053e5-fdac-48b2-90c6-30b5040e819b for instance a0c22e90-af12-4699-beb3-463ba9e81e65 on n-h1-master-1 Aug 07 01:15:34.973961 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-d7da7e28-1f3c-4ad7-a255-8903d9bb97a7 req-74186607-889b-4114-8514-138b21036121 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053767 Aug 07 01:15:34.975579 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 711/1296] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:34.987852 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5bfe7c3a-d5aa-42fd-960b-bd3ee52d9d25 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:34.988939 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5bfe7c3a-d5aa-42fd-960b-bd3ee52d9d25 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:35.000461 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5bfe7c3a-d5aa-42fd-960b-bd3ee52d9d25 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:35.001789 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5bfe7c3a-d5aa-42fd-960b-bd3ee52d9d25 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:35.003540 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5bfe7c3a-d5aa-42fd-960b-bd3ee52d9d25 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:35.004713 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5bfe7c3a-d5aa-42fd-960b-bd3ee52d9d25 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:35.005502 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5bfe7c3a-d5aa-42fd-960b-bd3ee52d9d25 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:35.006905 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5bfe7c3a-d5aa-42fd-960b-bd3ee52d9d25 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:35.499354 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5bfe7c3a-d5aa-42fd-960b-bd3ee52d9d25 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:35.510409 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5bfe7c3a-d5aa-42fd-960b-bd3ee52d9d25 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1472 microversion: 2.1 time: 0.531786 Aug 07 01:15:35.524306 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 712/1297] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:34 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1472 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:35.524306 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-df226d2b-5aa6-4c1b-8627-bf8659238e05 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:35.524306 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-df226d2b-5aa6-4c1b-8627-bf8659238e05 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae4f4a7231e4431c89712c557c4fa1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ac882e61ac45eb9abc60630e7337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:35.524306 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-df226d2b-5aa6-4c1b-8627-bf8659238e05 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Searching by: {'deleted': False, 'project_id': '45ac882e61ac45eb9abc60630e7337c3'} {{(pid=119516) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:15:35.529797 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df226d2b-5aa6-4c1b-8627-bf8659238e05 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:35.530030 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df226d2b-5aa6-4c1b-8627-bf8659238e05 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:35.530466 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df226d2b-5aa6-4c1b-8627-bf8659238e05 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:35.531434 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df226d2b-5aa6-4c1b-8627-bf8659238e05 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:35.531756 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df226d2b-5aa6-4c1b-8627-bf8659238e05 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:35.532328 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df226d2b-5aa6-4c1b-8627-bf8659238e05 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:35.624316 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.multi_cell_list [None req-df226d2b-5aa6-4c1b-8627-bf8659238e05 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 01:15:35.695506 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-df226d2b-5aa6-4c1b-8627-bf8659238e05 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.183384 Aug 07 01:15:35.696553 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 713/1298] 10.222.0.39 () {58 vars in 1125 bytes} [Sun Aug 7 01:15:35 2022] GET /compute/v2.1/servers => generated 683 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:35.706798 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a6b62214-01ee-4ffd-af59-2c783dfffe75 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:35.707714 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a6b62214-01ee-4ffd-af59-2c783dfffe75 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:35.716309 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a6b62214-01ee-4ffd-af59-2c783dfffe75 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:35.716912 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a6b62214-01ee-4ffd-af59-2c783dfffe75 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:35.717426 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a6b62214-01ee-4ffd-af59-2c783dfffe75 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:35.718230 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a6b62214-01ee-4ffd-af59-2c783dfffe75 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:35.718697 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a6b62214-01ee-4ffd-af59-2c783dfffe75 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:35.719280 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a6b62214-01ee-4ffd-af59-2c783dfffe75 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:35.872461 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a6b62214-01ee-4ffd-af59-2c783dfffe75 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:35.881496 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a6b62214-01ee-4ffd-af59-2c783dfffe75 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 200 len: 1717 microversion: 2.1 time: 0.183252 Aug 07 01:15:35.882283 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 714/1299] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:35 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 1717 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:35.887143 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-93171140-d617-4396-aaab-d40e8a793880 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Calling method '.version_select at 0x7f9e24711550>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:35.888055 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:15:35.888055 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:15:35.889099 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93171140-d617-4396-aaab-d40e8a793880 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:35.889584 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93171140-d617-4396-aaab-d40e8a793880 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:35.890091 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93171140-d617-4396-aaab-d40e8a793880 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:35.909232 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-93171140-d617-4396-aaab-d40e8a793880 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 267 microversion: 2.1 time: 0.025712 Aug 07 01:15:35.909857 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 715/1300] 10.222.0.39 () {58 vars in 1179 bytes} [Sun Aug 7 01:15:35 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 267 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:35.914603 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-14268a6e-38f2-42f7-af7b-a71cb044f0a3 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:35.915445 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-14268a6e-38f2-42f7-af7b-a71cb044f0a3 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: a0c22e90-af12-4699-beb3-463ba9e81e65] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:35.921661 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-14268a6e-38f2-42f7-af7b-a71cb044f0a3 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:35.922260 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-14268a6e-38f2-42f7-af7b-a71cb044f0a3 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:35.922666 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-14268a6e-38f2-42f7-af7b-a71cb044f0a3 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:35.923382 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-14268a6e-38f2-42f7-af7b-a71cb044f0a3 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:35.923843 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-14268a6e-38f2-42f7-af7b-a71cb044f0a3 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:35.924298 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-14268a6e-38f2-42f7-af7b-a71cb044f0a3 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:36.076954 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-14268a6e-38f2-42f7-af7b-a71cb044f0a3 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:36.086625 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-14268a6e-38f2-42f7-af7b-a71cb044f0a3 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/a0c22e90-af12-4699-beb3-463ba9e81e65" status: 200 len: 1317 microversion: 2.1 time: 0.175677 Aug 07 01:15:36.087974 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 716/1301] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:35 2022] GET /compute/v2.1/servers/a0c22e90-af12-4699-beb3-463ba9e81e65 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:36.094473 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d0352642-a3de-4111-a39d-e0e73dddc3c1 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:36.100250 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d0352642-a3de-4111-a39d-e0e73dddc3c1 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae4f4a7231e4431c89712c557c4fa1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ac882e61ac45eb9abc60630e7337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:36.100958 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.compute.servers [None req-d0352642-a3de-4111-a39d-e0e73dddc3c1 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Removing options 'limit' from query {{(pid=119516) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 07 01:15:36.101692 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d0352642-a3de-4111-a39d-e0e73dddc3c1 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Searching by: {'deleted': False, 'project_id': '45ac882e61ac45eb9abc60630e7337c3'} {{(pid=119516) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:15:36.108176 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0352642-a3de-4111-a39d-e0e73dddc3c1 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:36.108723 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0352642-a3de-4111-a39d-e0e73dddc3c1 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:36.109338 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0352642-a3de-4111-a39d-e0e73dddc3c1 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:36.110527 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0352642-a3de-4111-a39d-e0e73dddc3c1 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:36.111332 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0352642-a3de-4111-a39d-e0e73dddc3c1 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:36.111952 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0352642-a3de-4111-a39d-e0e73dddc3c1 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:36.156496 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.multi_cell_list [None req-d0352642-a3de-4111-a39d-e0e73dddc3c1 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=119516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 01:15:36.200444 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d0352642-a3de-4111-a39d-e0e73dddc3c1 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.111076 Aug 07 01:15:36.212607 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 717/1302] 10.222.0.39 () {58 vars in 1144 bytes} [Sun Aug 7 01:15:36 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:36.220059 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e2c882bb-aa9b-46b7-98fa-60cb694cc582 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:36.221040 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e2c882bb-aa9b-46b7-98fa-60cb694cc582 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:36.229018 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e2c882bb-aa9b-46b7-98fa-60cb694cc582 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:36.229573 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e2c882bb-aa9b-46b7-98fa-60cb694cc582 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:36.230172 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e2c882bb-aa9b-46b7-98fa-60cb694cc582 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:36.231044 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e2c882bb-aa9b-46b7-98fa-60cb694cc582 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:36.231532 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e2c882bb-aa9b-46b7-98fa-60cb694cc582 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:36.232685 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e2c882bb-aa9b-46b7-98fa-60cb694cc582 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:36.413117 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e2c882bb-aa9b-46b7-98fa-60cb694cc582 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:36.421732 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e2c882bb-aa9b-46b7-98fa-60cb694cc582 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1477 microversion: 2.1 time: 0.207577 Aug 07 01:15:36.435981 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 718/1303] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:36 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1477 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:36.435981 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6d996b6c-00a9-4f30-abf3-326ecd5a7e9b tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Calling method '.version_select at 0x7f9e24481e50>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:36.435981 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:15:36.435981 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:15:36.435981 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6d996b6c-00a9-4f30-abf3-326ecd5a7e9b tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:36.435981 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6d996b6c-00a9-4f30-abf3-326ecd5a7e9b tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:36.436702 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6d996b6c-00a9-4f30-abf3-326ecd5a7e9b tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:36.452466 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6d996b6c-00a9-4f30-abf3-326ecd5a7e9b tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:36.452988 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6d996b6c-00a9-4f30-abf3-326ecd5a7e9b tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:36.453792 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6d996b6c-00a9-4f30-abf3-326ecd5a7e9b tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:36.468595 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6d996b6c-00a9-4f30-abf3-326ecd5a7e9b tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:36.469417 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6d996b6c-00a9-4f30-abf3-326ecd5a7e9b tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:36.469877 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6d996b6c-00a9-4f30-abf3-326ecd5a7e9b tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:36.483070 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6d996b6c-00a9-4f30-abf3-326ecd5a7e9b tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.058077 Aug 07 01:15:36.485188 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 719/1304] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:15:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:36.490948 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1ff23fc4-5a55-4970-8671-fd512cd85053 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:36.495651 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1ff23fc4-5a55-4970-8671-fd512cd85053 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Request method failure captured: Aug 07 01:15:36.495651 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 07 01:15:36.495651 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:15:36.495651 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:15:36.495651 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:15:36.495651 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:15:36.495651 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:15:36.495651 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:15:36.495651 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:15:36.495651 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:15:36.495651 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xH_7heYCkV2-y0pNneGN4ZnDqbs4UmpJQTmK5saNuk5H0WyhR4p8FKNrWGv5t9UmFTbjW-ntOaSKUHzjZAArTCL_7x2Uwa1lfuWNi0MRrWbfTOLIoXB6XEN1mRKk4FXNp_uEqv_bhxSKtjhZMsFP1MHgSM_FhzIX5Da4H4U1Rw8NW4 Aug 07 01:15:36.495651 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:15:36.495651 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:15:36.495651 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:15:36.495651 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:15:36.495651 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:15:36.495651 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:15:36.495651 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 45ac882e61ac45eb9abc60630e7337c3 Aug 07 01:15:36.495651 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ListServersNegativeTestJSON-938780471 Aug 07 01:15:36.495651 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:15:36.495651 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:15:36.497499 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/45ac882e61ac45eb9abc60630e7337c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_45ac882e61ac45eb9abc60630e7337c3", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/45ac882e61ac45eb9abc60630e7337c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/45ac882e61ac45eb9abc60630e7337c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:15:36.497499 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ListServersNegativeTestJSON-938780471 Aug 07 01:15:36.497499 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 45ac882e61ac45eb9abc60630e7337c3 Aug 07 01:15:36.497499 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-938780471 Aug 07 01:15:36.497499 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ListServersNegativeTestJSON-938780471-project Aug 07 01:15:36.497499 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:15:36.497499 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:15:36.497499 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: ae4f4a7231e4431c89712c557c4fa1df Aug 07 01:15:36.497499 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ListServersNegativeTestJSON-938780471-project Aug 07 01:15:36.497499 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:15:36.497499 n-d-master-1 devstack@n-api.service[119516]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 07 01:15:36.497499 n-d-master-1 devstack@n-api.service[119516]: action_args: {} Aug 07 01:15:36.498289 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:15:36.498289 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:36.498289 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:15:36.498289 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:15:36.498289 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:15:36.498289 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:15:36.498289 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 07 01:15:36.498289 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:36.498289 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 07 01:15:36.498289 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 07 01:15:36.498289 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 07 01:15:36.498289 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 07 01:15:36.498289 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 07 01:15:36.498289 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:36.498289 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 07 01:15:36.498289 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi '-1' Aug 07 01:15:36.498289 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:36.498289 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:15:36.498289 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:36.498289 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:36.498289 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:15:36.498289 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:15:36.498289 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:15:36.498289 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:15:36.501537 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:15:36.501537 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:15:36.501537 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 07 01:15:36.501537 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:15:36.501537 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 07 01:15:36.501537 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:15:36.501537 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 07 01:15:36.501537 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:15:36.501537 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 07 01:15:36.501537 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 07 01:15:36.501537 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 07 01:15:36.501537 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:15:36.501537 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:15:36.501537 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:15:36.501537 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:15:36.501537 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 07 01:15:36.501537 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:36.501537 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:15:36.501537 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:36.501537 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:36.504441 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:15:36.504441 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:15:36.504441 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:15:36.504441 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:15:36.504441 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 07 01:15:36.504441 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:36.504441 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1ff23fc4-5a55-4970-8671-fd512cd85053 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:15:36.504441 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1ff23fc4-5a55-4970-8671-fd512cd85053 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.010923 Aug 07 01:15:36.504441 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 720/1305] 10.222.0.39 () {58 vars in 1142 bytes} [Sun Aug 7 01:15:36 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:15:36.505868 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4ec7bd85-721d-419d-bddf-909fa1b37312 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Calling method '.version_select at 0x7f9e24833a60>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:36.505868 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:15:36.505868 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:15:36.506921 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4ec7bd85-721d-419d-bddf-909fa1b37312 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:36.506921 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4ec7bd85-721d-419d-bddf-909fa1b37312 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:36.507262 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4ec7bd85-721d-419d-bddf-909fa1b37312 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:36.526599 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4ec7bd85-721d-419d-bddf-909fa1b37312 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:36.528724 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4ec7bd85-721d-419d-bddf-909fa1b37312 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:36.528724 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4ec7bd85-721d-419d-bddf-909fa1b37312 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:36.538573 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4ec7bd85-721d-419d-bddf-909fa1b37312 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.039020 Aug 07 01:15:36.539578 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 721/1306] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Aug 7 01:15:36 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:36.546199 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b1de38f8-38fc-405a-9b5a-6c276075affd tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:36.550994 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b1de38f8-38fc-405a-9b5a-6c276075affd tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Request method failure captured: Aug 07 01:15:36.550994 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 07 01:15:36.550994 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:15:36.550994 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:15:36.550994 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:15:36.550994 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:15:36.550994 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:15:36.550994 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:15:36.550994 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:15:36.550994 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:15:36.550994 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xH_7heYCkV2-y0pNneGN4ZnDqbs4UmpJQTmK5saNuk5H0WyhR4p8FKNrWGv5t9UmFTbjW-ntOaSKUHzjZAArTCL_7x2Uwa1lfuWNi0MRrWbfTOLIoXB6XEN1mRKk4FXNp_uEqv_bhxSKtjhZMsFP1MHgSM_FhzIX5Da4H4U1Rw8NW4 Aug 07 01:15:36.550994 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:15:36.550994 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:15:36.550994 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:15:36.550994 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:15:36.550994 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:15:36.550994 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:15:36.550994 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 45ac882e61ac45eb9abc60630e7337c3 Aug 07 01:15:36.550994 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ListServersNegativeTestJSON-938780471 Aug 07 01:15:36.550994 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:15:36.550994 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:15:36.553247 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/45ac882e61ac45eb9abc60630e7337c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_45ac882e61ac45eb9abc60630e7337c3", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/45ac882e61ac45eb9abc60630e7337c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/45ac882e61ac45eb9abc60630e7337c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:15:36.553247 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ListServersNegativeTestJSON-938780471 Aug 07 01:15:36.553247 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 45ac882e61ac45eb9abc60630e7337c3 Aug 07 01:15:36.553247 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-938780471 Aug 07 01:15:36.553247 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ListServersNegativeTestJSON-938780471-project Aug 07 01:15:36.553247 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:15:36.553247 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:15:36.553247 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: ae4f4a7231e4431c89712c557c4fa1df Aug 07 01:15:36.553247 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ListServersNegativeTestJSON-938780471-project Aug 07 01:15:36.553247 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:15:36.553247 n-d-master-1 devstack@n-api.service[119516]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 07 01:15:36.553247 n-d-master-1 devstack@n-api.service[119516]: action_args: {} Aug 07 01:15:36.554515 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:15:36.554515 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:36.554515 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:15:36.554515 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:15:36.554515 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:15:36.554515 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:15:36.554515 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 07 01:15:36.554515 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:36.554515 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 07 01:15:36.554515 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 07 01:15:36.554515 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 07 01:15:36.554515 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 07 01:15:36.554515 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 07 01:15:36.554515 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:36.554515 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 07 01:15:36.554515 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'testing' Aug 07 01:15:36.554515 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:36.554515 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:15:36.554515 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:36.554515 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:36.554515 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:15:36.554515 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:15:36.554515 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:15:36.554515 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:15:36.557044 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:15:36.557044 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:15:36.557044 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 07 01:15:36.557044 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:15:36.557044 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 07 01:15:36.557044 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:15:36.557044 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 07 01:15:36.557044 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:15:36.557044 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 07 01:15:36.557044 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 07 01:15:36.557044 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 07 01:15:36.557044 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:15:36.557044 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:15:36.557044 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:15:36.557044 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:15:36.557044 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 07 01:15:36.557044 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:36.557044 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:15:36.557044 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:36.557044 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:36.560268 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:15:36.560268 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:15:36.560268 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:15:36.560268 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:15:36.560268 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 07 01:15:36.560268 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:36.560268 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b1de38f8-38fc-405a-9b5a-6c276075affd tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:15:36.560268 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b1de38f8-38fc-405a-9b5a-6c276075affd tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.012021 Aug 07 01:15:36.560268 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 722/1307] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Aug 7 01:15:36 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:15:36.561596 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e061e202-666b-4418-bd88-25395ac2f589 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:36.561751 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e061e202-666b-4418-bd88-25395ac2f589 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:36.570654 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e061e202-666b-4418-bd88-25395ac2f589 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:36.571164 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e061e202-666b-4418-bd88-25395ac2f589 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:36.571623 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e061e202-666b-4418-bd88-25395ac2f589 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:36.572541 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e061e202-666b-4418-bd88-25395ac2f589 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:36.573032 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e061e202-666b-4418-bd88-25395ac2f589 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:36.573475 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e061e202-666b-4418-bd88-25395ac2f589 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:36.737376 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e061e202-666b-4418-bd88-25395ac2f589 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:36.747613 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e061e202-666b-4418-bd88-25395ac2f589 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1472 microversion: 2.1 time: 0.191350 Aug 07 01:15:36.759914 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 723/1308] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:36 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1472 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:36.764286 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a0f98a67-95b8-445b-9223-e41a688acbd3 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Calling method '.version_select at 0x7f9e245b78b0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:36.765171 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:15:36.765171 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:15:36.767087 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a0f98a67-95b8-445b-9223-e41a688acbd3 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:36.768477 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a0f98a67-95b8-445b-9223-e41a688acbd3 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:36.768848 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a0f98a67-95b8-445b-9223-e41a688acbd3 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:36.784287 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:36.786688 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a0f98a67-95b8-445b-9223-e41a688acbd3 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:36.788038 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a0f98a67-95b8-445b-9223-e41a688acbd3 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:36.788972 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a0f98a67-95b8-445b-9223-e41a688acbd3 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:36.803000 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a0f98a67-95b8-445b-9223-e41a688acbd3 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 761 microversion: 2.1 time: 0.052679 Aug 07 01:15:36.803852 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 724/1309] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Aug 7 01:15:36 2022] GET /compute/v2.1/os-hypervisors/2 => generated 761 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:36.810308 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6a05754f-32ef-426f-8484-ffe36021895e tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:36.817101 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6a05754f-32ef-426f-8484-ffe36021895e tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae4f4a7231e4431c89712c557c4fa1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ac882e61ac45eb9abc60630e7337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:36.818268 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6a05754f-32ef-426f-8484-ffe36021895e tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '45ac882e61ac45eb9abc60630e7337c3'} {{(pid=119516) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:15:36.828599 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.compute.servers [None req-6a05754f-32ef-426f-8484-ffe36021895e tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Flavor 'non_existing_flavor' could not be found {{(pid=119516) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 07 01:15:36.830558 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6a05754f-32ef-426f-8484-ffe36021895e tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.025456 Aug 07 01:15:36.831569 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 725/1310] 10.222.0.39 () {58 vars in 1178 bytes} [Sun Aug 7 01:15:36 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:15:36.840621 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-efc73d65-0a70-4028-a1eb-7ab2910a6066 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Calling method '.version_select at 0x7f9e24481820>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:36.841578 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:15:36.841578 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:15:36.842946 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-efc73d65-0a70-4028-a1eb-7ab2910a6066 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:36.844090 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-efc73d65-0a70-4028-a1eb-7ab2910a6066 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:36.844293 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-efc73d65-0a70-4028-a1eb-7ab2910a6066 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:36.860418 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-efc73d65-0a70-4028-a1eb-7ab2910a6066 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:36.861216 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-efc73d65-0a70-4028-a1eb-7ab2910a6066 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:36.861772 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-efc73d65-0a70-4028-a1eb-7ab2910a6066 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:36.874319 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-efc73d65-0a70-4028-a1eb-7ab2910a6066 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:36.874910 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-efc73d65-0a70-4028-a1eb-7ab2910a6066 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:36.875482 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-efc73d65-0a70-4028-a1eb-7ab2910a6066 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:36.890714 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-efc73d65-0a70-4028-a1eb-7ab2910a6066 tempest-HypervisorAdminTestJSON-2135966348 tempest-HypervisorAdminTestJSON-2135966348-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.057759 Aug 07 01:15:36.891346 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 726/1311] 10.222.0.39 () {58 vars in 1173 bytes} [Sun Aug 7 01:15:36 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:36.903433 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fc57efd4-3158-42e8-af87-910d64abbad6 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:36.910201 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fc57efd4-3158-42e8-af87-910d64abbad6 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae4f4a7231e4431c89712c557c4fa1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ac882e61ac45eb9abc60630e7337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:36.911254 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fc57efd4-3158-42e8-af87-910d64abbad6 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '45ac882e61ac45eb9abc60630e7337c3'} {{(pid=119516) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:15:36.920329 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc57efd4-3158-42e8-af87-910d64abbad6 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:36.921274 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc57efd4-3158-42e8-af87-910d64abbad6 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:36.922015 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc57efd4-3158-42e8-af87-910d64abbad6 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:36.924336 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc57efd4-3158-42e8-af87-910d64abbad6 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:36.925411 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc57efd4-3158-42e8-af87-910d64abbad6 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:36.926219 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc57efd4-3158-42e8-af87-910d64abbad6 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:37.039468 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fc57efd4-3158-42e8-af87-910d64abbad6 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.146359 Aug 07 01:15:37.040311 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 727/1312] 10.222.0.39 () {58 vars in 1174 bytes} [Sun Aug 7 01:15:36 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:15:37.044788 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1b42fa46-1382-4c09-b8a7-766e7a7292ac tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:37.046639 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1b42fa46-1382-4c09-b8a7-766e7a7292ac tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:37.052791 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b42fa46-1382-4c09-b8a7-766e7a7292ac tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:37.053039 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b42fa46-1382-4c09-b8a7-766e7a7292ac tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:37.053466 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b42fa46-1382-4c09-b8a7-766e7a7292ac tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:37.054184 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b42fa46-1382-4c09-b8a7-766e7a7292ac tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:37.054635 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b42fa46-1382-4c09-b8a7-766e7a7292ac tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:37.055062 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b42fa46-1382-4c09-b8a7-766e7a7292ac tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:37.233431 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1b42fa46-1382-4c09-b8a7-766e7a7292ac tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:37.247660 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1b42fa46-1382-4c09-b8a7-766e7a7292ac tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 200 len: 1717 microversion: 2.1 time: 0.206485 Aug 07 01:15:37.248635 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 728/1313] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:37 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 1717 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:37.254644 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6062eae5-e08d-4706-b2a6-5f13b49ccf3f tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:37.284698 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6062eae5-e08d-4706-b2a6-5f13b49ccf3f tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae4f4a7231e4431c89712c557c4fa1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ac882e61ac45eb9abc60630e7337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:37.288428 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6062eae5-e08d-4706-b2a6-5f13b49ccf3f tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '45ac882e61ac45eb9abc60630e7337c3'} {{(pid=119516) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:15:37.308326 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6062eae5-e08d-4706-b2a6-5f13b49ccf3f tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:37.309155 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6062eae5-e08d-4706-b2a6-5f13b49ccf3f tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:37.309992 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6062eae5-e08d-4706-b2a6-5f13b49ccf3f tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:37.339728 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6062eae5-e08d-4706-b2a6-5f13b49ccf3f tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:37.340283 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6062eae5-e08d-4706-b2a6-5f13b49ccf3f tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:37.340731 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6062eae5-e08d-4706-b2a6-5f13b49ccf3f tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:37.465657 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6062eae5-e08d-4706-b2a6-5f13b49ccf3f tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.215922 Aug 07 01:15:37.481540 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 729/1314] 10.222.0.39 () {58 vars in 1184 bytes} [Sun Aug 7 01:15:37 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:15:37.489778 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-05472048-f424-4ce3-94a9-9f2f4198b558 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:37.491189 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-05472048-f424-4ce3-94a9-9f2f4198b558 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: a0c22e90-af12-4699-beb3-463ba9e81e65] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:37.499913 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05472048-f424-4ce3-94a9-9f2f4198b558 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:37.500580 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05472048-f424-4ce3-94a9-9f2f4198b558 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:37.500890 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05472048-f424-4ce3-94a9-9f2f4198b558 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:37.501569 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05472048-f424-4ce3-94a9-9f2f4198b558 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:37.502029 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05472048-f424-4ce3-94a9-9f2f4198b558 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:37.502461 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05472048-f424-4ce3-94a9-9f2f4198b558 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:37.540451 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:37.658993 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:37.740857 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-572c4f4a-779a-4b46-b3d2-97a783656e83 tempest-FloatingIPDetailsTestJSON-243814326 tempest-FloatingIPDetailsTestJSON-243814326-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.599955 Aug 07 01:15:37.742066 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 586/1315] 10.222.0.39 () {60 vars in 1170 bytes} [Sun Aug 7 01:15:34 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:37.747831 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-79acfd23-0ebf-47a3-8e23-6f025d32544b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:37.748667 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-79acfd23-0ebf-47a3-8e23-6f025d32544b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:37.756554 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-79acfd23-0ebf-47a3-8e23-6f025d32544b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:37.757040 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-79acfd23-0ebf-47a3-8e23-6f025d32544b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:37.760799 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-79acfd23-0ebf-47a3-8e23-6f025d32544b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:37.761784 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-79acfd23-0ebf-47a3-8e23-6f025d32544b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:37.762428 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-79acfd23-0ebf-47a3-8e23-6f025d32544b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:37.762862 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-79acfd23-0ebf-47a3-8e23-6f025d32544b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:37.809079 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-05472048-f424-4ce3-94a9-9f2f4198b558 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:37.816779 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-05472048-f424-4ce3-94a9-9f2f4198b558 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/a0c22e90-af12-4699-beb3-463ba9e81e65" status: 200 len: 1317 microversion: 2.1 time: 0.333982 Aug 07 01:15:37.817926 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 730/1316] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:37 2022] GET /compute/v2.1/servers/a0c22e90-af12-4699-beb3-463ba9e81e65 => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:37.823369 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-33e0d2c6-8a28-4749-932b-a86bc0b465de tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:37.828283 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-33e0d2c6-8a28-4749-932b-a86bc0b465de tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae4f4a7231e4431c89712c557c4fa1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ac882e61ac45eb9abc60630e7337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:37.829403 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-33e0d2c6-8a28-4749-932b-a86bc0b465de tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Searching by: {'deleted': False, 'project_id': '45ac882e61ac45eb9abc60630e7337c3'} {{(pid=119516) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:15:37.835159 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33e0d2c6-8a28-4749-932b-a86bc0b465de tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:37.835791 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33e0d2c6-8a28-4749-932b-a86bc0b465de tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:37.836517 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33e0d2c6-8a28-4749-932b-a86bc0b465de tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:37.837319 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33e0d2c6-8a28-4749-932b-a86bc0b465de tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:37.837819 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33e0d2c6-8a28-4749-932b-a86bc0b465de tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:37.838227 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33e0d2c6-8a28-4749-932b-a86bc0b465de tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:37.879846 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.multi_cell_list [None req-33e0d2c6-8a28-4749-932b-a86bc0b465de tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 01:15:37.938722 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-33e0d2c6-8a28-4749-932b-a86bc0b465de tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f4a7231e4431c89712c557c4fa1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ac882e61ac45eb9abc60630e7337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:37.959097 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33e0d2c6-8a28-4749-932b-a86bc0b465de tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:37.959670 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33e0d2c6-8a28-4749-932b-a86bc0b465de tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:37.960148 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33e0d2c6-8a28-4749-932b-a86bc0b465de tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:38.149198 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-79acfd23-0ebf-47a3-8e23-6f025d32544b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:38.168380 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-79acfd23-0ebf-47a3-8e23-6f025d32544b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1477 microversion: 2.1 time: 0.424972 Aug 07 01:15:38.171271 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 587/1317] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:37 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1477 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:38.206745 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6f3d7d6c-aa84-4a0b-8166-73c3ca4aed80 tempest-FloatingIPDetailsTestJSON-243814326 tempest-FloatingIPDetailsTestJSON-243814326-project] Action: 'create', calling method: .version_select at 0x7f9e244b6790>, body: {"pool": null} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:15:38.323777 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:38.533546 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-33e0d2c6-8a28-4749-932b-a86bc0b465de tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 0.712817 Aug 07 01:15:38.566053 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 731/1318] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:15:37 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:38.571389 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ec4a8d80-921d-46b9-94d2-e41d2fe1906c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:38.576283 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ec4a8d80-921d-46b9-94d2-e41d2fe1906c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:38.591023 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec4a8d80-921d-46b9-94d2-e41d2fe1906c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:38.591532 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec4a8d80-921d-46b9-94d2-e41d2fe1906c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:38.592046 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec4a8d80-921d-46b9-94d2-e41d2fe1906c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:38.601738 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec4a8d80-921d-46b9-94d2-e41d2fe1906c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:38.602300 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec4a8d80-921d-46b9-94d2-e41d2fe1906c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:38.602709 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec4a8d80-921d-46b9-94d2-e41d2fe1906c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:38.944086 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ec4a8d80-921d-46b9-94d2-e41d2fe1906c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:38.959239 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ec4a8d80-921d-46b9-94d2-e41d2fe1906c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1472 microversion: 2.1 time: 0.391566 Aug 07 01:15:38.990666 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 732/1319] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:38 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1472 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:38.999259 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9d66390c-c36f-4894-8c46-ecdc8fa6a57a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:39.003916 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9d66390c-c36f-4894-8c46-ecdc8fa6a57a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:39.013201 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d66390c-c36f-4894-8c46-ecdc8fa6a57a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:39.013696 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d66390c-c36f-4894-8c46-ecdc8fa6a57a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:39.020041 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d66390c-c36f-4894-8c46-ecdc8fa6a57a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:39.021606 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d66390c-c36f-4894-8c46-ecdc8fa6a57a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:39.026893 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d66390c-c36f-4894-8c46-ecdc8fa6a57a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:39.027525 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d66390c-c36f-4894-8c46-ecdc8fa6a57a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:39.374383 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9d66390c-c36f-4894-8c46-ecdc8fa6a57a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:39.403255 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9d66390c-c36f-4894-8c46-ecdc8fa6a57a tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 200 len: 1717 microversion: 2.1 time: 0.410678 Aug 07 01:15:39.404777 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 733/1320] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:38 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 1717 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:39.413370 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-24cd48de-b0f6-497a-9f9a-cc56864312d5 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:39.420763 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-24cd48de-b0f6-497a-9f9a-cc56864312d5 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae4f4a7231e4431c89712c557c4fa1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ac882e61ac45eb9abc60630e7337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:39.422190 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-24cd48de-b0f6-497a-9f9a-cc56864312d5 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.016175 Aug 07 01:15:39.424112 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 734/1321] 10.222.0.39 () {58 vars in 1178 bytes} [Sun Aug 7 01:15:39 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:15:39.453705 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cdf4e0f1-d8bf-4db3-98c6-1ea25a5ac671 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:39.456007 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cdf4e0f1-d8bf-4db3-98c6-1ea25a5ac671 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: a0c22e90-af12-4699-beb3-463ba9e81e65] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:39.470856 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cdf4e0f1-d8bf-4db3-98c6-1ea25a5ac671 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:39.471816 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cdf4e0f1-d8bf-4db3-98c6-1ea25a5ac671 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:39.473720 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cdf4e0f1-d8bf-4db3-98c6-1ea25a5ac671 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:39.474727 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cdf4e0f1-d8bf-4db3-98c6-1ea25a5ac671 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:39.475381 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cdf4e0f1-d8bf-4db3-98c6-1ea25a5ac671 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:39.476833 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cdf4e0f1-d8bf-4db3-98c6-1ea25a5ac671 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:39.785100 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cdf4e0f1-d8bf-4db3-98c6-1ea25a5ac671 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:39.797931 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cdf4e0f1-d8bf-4db3-98c6-1ea25a5ac671 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/a0c22e90-af12-4699-beb3-463ba9e81e65" status: 200 len: 1317 microversion: 2.1 time: 0.372048 Aug 07 01:15:39.804021 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 735/1322] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:39 2022] GET /compute/v2.1/servers/a0c22e90-af12-4699-beb3-463ba9e81e65 => generated 1317 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:39.811407 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9583d285-0e68-4406-b068-1e17aba2573f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:39.812007 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9583d285-0e68-4406-b068-1e17aba2573f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:39.822974 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9583d285-0e68-4406-b068-1e17aba2573f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:39.823673 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9583d285-0e68-4406-b068-1e17aba2573f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:39.824592 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9583d285-0e68-4406-b068-1e17aba2573f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:39.825147 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9583d285-0e68-4406-b068-1e17aba2573f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:39.825603 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9583d285-0e68-4406-b068-1e17aba2573f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:39.826658 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9583d285-0e68-4406-b068-1e17aba2573f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:40.194280 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9583d285-0e68-4406-b068-1e17aba2573f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:40.231641 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9583d285-0e68-4406-b068-1e17aba2573f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1477 microversion: 2.1 time: 0.428983 Aug 07 01:15:40.232863 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 736/1323] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:39 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1477 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:40.237939 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-437b41d1-1a84-41c0-b7ce-6d7411893f22 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:40.244135 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-437b41d1-1a84-41c0-b7ce-6d7411893f22 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ae4f4a7231e4431c89712c557c4fa1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ac882e61ac45eb9abc60630e7337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:40.245103 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-437b41d1-1a84-41c0-b7ce-6d7411893f22 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Searching by: {'deleted': False, 'project_id': '45ac882e61ac45eb9abc60630e7337c3'} {{(pid=119516) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:15:40.251271 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-437b41d1-1a84-41c0-b7ce-6d7411893f22 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:40.252103 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-437b41d1-1a84-41c0-b7ce-6d7411893f22 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:40.252718 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-437b41d1-1a84-41c0-b7ce-6d7411893f22 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:40.253642 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-437b41d1-1a84-41c0-b7ce-6d7411893f22 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:40.254268 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-437b41d1-1a84-41c0-b7ce-6d7411893f22 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:40.254880 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-437b41d1-1a84-41c0-b7ce-6d7411893f22 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:40.267431 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=21 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:40.286142 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.multi_cell_list [None req-437b41d1-1a84-41c0-b7ce-6d7411893f22 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 01:15:40.324378 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-437b41d1-1a84-41c0-b7ce-6d7411893f22 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.090280 Aug 07 01:15:40.333067 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 737/1324] 10.222.0.39 () {58 vars in 1125 bytes} [Sun Aug 7 01:15:40 2022] GET /compute/v2.1/servers => generated 683 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:40.338390 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c7900e80-eab9-487d-b7e6-7d4ee3d8fdd3 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:40.339268 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c7900e80-eab9-487d-b7e6-7d4ee3d8fdd3 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:40.346079 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c7900e80-eab9-487d-b7e6-7d4ee3d8fdd3 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:40.346841 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c7900e80-eab9-487d-b7e6-7d4ee3d8fdd3 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:40.347476 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c7900e80-eab9-487d-b7e6-7d4ee3d8fdd3 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:40.348575 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c7900e80-eab9-487d-b7e6-7d4ee3d8fdd3 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:40.349904 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c7900e80-eab9-487d-b7e6-7d4ee3d8fdd3 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:40.350672 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c7900e80-eab9-487d-b7e6-7d4ee3d8fdd3 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:40.581374 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c7900e80-eab9-487d-b7e6-7d4ee3d8fdd3 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:40.593945 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c7900e80-eab9-487d-b7e6-7d4ee3d8fdd3 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1472 microversion: 2.1 time: 0.258923 Aug 07 01:15:40.595435 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 738/1325] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:40 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1472 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:40.614760 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-80b4fc07-3b17-4074-bdd1-97bd35b59054 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:40.615338 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-80b4fc07-3b17-4074-bdd1-97bd35b59054 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: e6920f55-726f-4258-bc23-2a794668d6bb] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:40.622045 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80b4fc07-3b17-4074-bdd1-97bd35b59054 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:40.623348 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80b4fc07-3b17-4074-bdd1-97bd35b59054 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:40.623348 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80b4fc07-3b17-4074-bdd1-97bd35b59054 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:40.623692 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80b4fc07-3b17-4074-bdd1-97bd35b59054 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:40.624188 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80b4fc07-3b17-4074-bdd1-97bd35b59054 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:40.625300 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80b4fc07-3b17-4074-bdd1-97bd35b59054 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:40.646669 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-80b4fc07-3b17-4074-bdd1-97bd35b59054 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] HTTP exception thrown: Instance e6920f55-726f-4258-bc23-2a794668d6bb could not be found. Aug 07 01:15:40.649838 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-80b4fc07-3b17-4074-bdd1-97bd35b59054 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Request method failure captured: Aug 07 01:15:40.649838 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/servers/e6920f55-726f-4258-bc23-2a794668d6bb HTTP/1.1 Aug 07 01:15:40.649838 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:15:40.649838 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:15:40.649838 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:15:40.649838 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:15:40.649838 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:15:40.649838 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:15:40.649838 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:15:40.649838 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:15:40.649838 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xH_7heYCkV2-y0pNneGN4ZnDqbs4UmpJQTmK5saNuk5H0WyhR4p8FKNrWGv5t9UmFTbjW-ntOaSKUHzjZAArTCL_7x2Uwa1lfuWNi0MRrWbfTOLIoXB6XEN1mRKk4FXNp_uEqv_bhxSKtjhZMsFP1MHgSM_FhzIX5Da4H4U1Rw8NW4 Aug 07 01:15:40.649838 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:15:40.649838 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:15:40.649838 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:15:40.649838 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:15:40.649838 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:15:40.649838 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:15:40.649838 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 45ac882e61ac45eb9abc60630e7337c3 Aug 07 01:15:40.649838 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ListServersNegativeTestJSON-938780471 Aug 07 01:15:40.649838 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:15:40.649838 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:15:40.651376 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/45ac882e61ac45eb9abc60630e7337c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_45ac882e61ac45eb9abc60630e7337c3", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/45ac882e61ac45eb9abc60630e7337c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/45ac882e61ac45eb9abc60630e7337c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:15:40.651376 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ListServersNegativeTestJSON-938780471 Aug 07 01:15:40.651376 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 45ac882e61ac45eb9abc60630e7337c3 Aug 07 01:15:40.651376 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-938780471 Aug 07 01:15:40.651376 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ListServersNegativeTestJSON-938780471-project Aug 07 01:15:40.651376 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:15:40.651376 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:15:40.651376 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: ae4f4a7231e4431c89712c557c4fa1df Aug 07 01:15:40.651376 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ListServersNegativeTestJSON-938780471-project Aug 07 01:15:40.651376 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:15:40.651376 n-d-master-1 devstack@n-api.service[119516]: exception: Instance e6920f55-726f-4258-bc23-2a794668d6bb could not be found. Aug 07 01:15:40.651376 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'e6920f55-726f-4258-bc23-2a794668d6bb'} Aug 07 01:15:40.652176 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:15:40.652176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:40.652176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:15:40.652176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:15:40.652176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:15:40.652176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:15:40.652176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:15:40.652176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:15:40.652176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:15:40.652176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:15:40.652176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6920f55-726f-4258-bc23-2a794668d6bb could not be found. Aug 07 01:15:40.652176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:40.652176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:15:40.652176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:40.652176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:40.652176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:15:40.652176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:15:40.652176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:15:40.652176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:15:40.652176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:15:40.654251 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:15:40.654251 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:15:40.654251 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:15:40.654251 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:15:40.654251 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:15:40.654251 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:15:40.654251 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:15:40.654251 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:15:40.654251 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:15:40.654251 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6920f55-726f-4258-bc23-2a794668d6bb could not be found. Aug 07 01:15:40.654251 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:40.654251 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:15:40.654251 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:40.654251 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:40.654251 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:15:40.654251 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:15:40.654251 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:15:40.654251 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:15:40.654251 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6920f55-726f-4258-bc23-2a794668d6bb could not be found. Aug 07 01:15:40.654251 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:40.655528 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-80b4fc07-3b17-4074-bdd1-97bd35b59054 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Returning 404 to user: Instance e6920f55-726f-4258-bc23-2a794668d6bb could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:15:40.655528 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-80b4fc07-3b17-4074-bdd1-97bd35b59054 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e6920f55-726f-4258-bc23-2a794668d6bb" status: 404 len: 111 microversion: 2.1 time: 0.055924 Aug 07 01:15:40.655528 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 739/1326] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:15:40 2022] DELETE /compute/v2.1/servers/e6920f55-726f-4258-bc23-2a794668d6bb => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:15:40.665457 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a580cdd0-f9c2-41c2-b664-48b723d4f3ea tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:40.665457 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a580cdd0-f9c2-41c2-b664-48b723d4f3ea tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:40.679357 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a580cdd0-f9c2-41c2-b664-48b723d4f3ea tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:40.679998 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a580cdd0-f9c2-41c2-b664-48b723d4f3ea tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:40.680702 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a580cdd0-f9c2-41c2-b664-48b723d4f3ea tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:40.682379 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a580cdd0-f9c2-41c2-b664-48b723d4f3ea tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:40.683095 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a580cdd0-f9c2-41c2-b664-48b723d4f3ea tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:40.683736 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a580cdd0-f9c2-41c2-b664-48b723d4f3ea tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:40.872775 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a580cdd0-f9c2-41c2-b664-48b723d4f3ea tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:40.885165 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a580cdd0-f9c2-41c2-b664-48b723d4f3ea tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 200 len: 1707 microversion: 2.1 time: 0.230179 Aug 07 01:15:40.886415 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 740/1327] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:40 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 1707 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:40.891955 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9a965f4f-f2af-43e0-9eda-e64d023265dd tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:40.893181 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9a965f4f-f2af-43e0-9eda-e64d023265dd tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: 45de519b-ab33-4648-9aa0-b9da5e3f1ef3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:40.903373 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9a965f4f-f2af-43e0-9eda-e64d023265dd tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:40.905113 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9a965f4f-f2af-43e0-9eda-e64d023265dd tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:40.905850 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9a965f4f-f2af-43e0-9eda-e64d023265dd tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:40.907023 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9a965f4f-f2af-43e0-9eda-e64d023265dd tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:40.907928 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9a965f4f-f2af-43e0-9eda-e64d023265dd tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:40.908558 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9a965f4f-f2af-43e0-9eda-e64d023265dd tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:40.945650 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9a965f4f-f2af-43e0-9eda-e64d023265dd tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: 45de519b-ab33-4648-9aa0-b9da5e3f1ef3] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:15:41.094041 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9a965f4f-f2af-43e0-9eda-e64d023265dd tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "DELETE /compute/v2.1/servers/45de519b-ab33-4648-9aa0-b9da5e3f1ef3" status: 204 len: 0 microversion: 2.1 time: 0.205959 Aug 07 01:15:41.095362 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 741/1328] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:15:40 2022] DELETE /compute/v2.1/servers/45de519b-ab33-4648-9aa0-b9da5e3f1ef3 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:15:41.103441 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8055c102-0628-406a-9099-fb2e6cca9552 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:41.104482 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8055c102-0628-406a-9099-fb2e6cca9552 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: a0c22e90-af12-4699-beb3-463ba9e81e65] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:41.112998 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8055c102-0628-406a-9099-fb2e6cca9552 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:41.114205 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8055c102-0628-406a-9099-fb2e6cca9552 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:41.116426 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8055c102-0628-406a-9099-fb2e6cca9552 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:41.117781 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8055c102-0628-406a-9099-fb2e6cca9552 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:41.118498 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8055c102-0628-406a-9099-fb2e6cca9552 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:41.119498 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8055c102-0628-406a-9099-fb2e6cca9552 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:41.322891 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8055c102-0628-406a-9099-fb2e6cca9552 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:41.326607 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6f3d7d6c-aa84-4a0b-8166-73c3ca4aed80 tempest-FloatingIPDetailsTestJSON-243814326 tempest-FloatingIPDetailsTestJSON-243814326-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.133430 Aug 07 01:15:41.327585 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 588/1329] 10.222.0.39 () {60 vars in 1170 bytes} [Sun Aug 7 01:15:38 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:41.335600 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e0965d54-4d18-4c7e-9d16-bf03e8a8306f tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Calling method '.version_select at 0x7f9e245d9790>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:41.340188 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e0965d54-4d18-4c7e-9d16-bf03e8a8306f tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:41.340679 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e0965d54-4d18-4c7e-9d16-bf03e8a8306f tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:41.341123 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e0965d54-4d18-4c7e-9d16-bf03e8a8306f tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:41.346955 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8055c102-0628-406a-9099-fb2e6cca9552 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/a0c22e90-af12-4699-beb3-463ba9e81e65" status: 200 len: 1317 microversion: 2.1 time: 0.250062 Aug 07 01:15:41.348178 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 742/1330] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:41 2022] GET /compute/v2.1/servers/a0c22e90-af12-4699-beb3-463ba9e81e65 => generated 1317 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:41.356211 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ff9e0e83-7311-4714-9141-1d2608e03f40 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:41.360536 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ff9e0e83-7311-4714-9141-1d2608e03f40 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: ea2ef6ca-2623-496d-a174-1d7cbaf80f85] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:41.367789 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e0965d54-4d18-4c7e-9d16-bf03e8a8306f tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 1952 microversion: 2.1 time: 0.038978 Aug 07 01:15:41.371863 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 589/1331] 10.222.0.39 () {58 vars in 1143 bytes} [Sun Aug 7 01:15:41 2022] GET /compute/v2.1/os-migrations => generated 1952 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:41.372864 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ff9e0e83-7311-4714-9141-1d2608e03f40 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:41.374735 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ff9e0e83-7311-4714-9141-1d2608e03f40 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:41.377712 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ff9e0e83-7311-4714-9141-1d2608e03f40 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:41.378749 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ff9e0e83-7311-4714-9141-1d2608e03f40 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:41.379274 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ff9e0e83-7311-4714-9141-1d2608e03f40 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:41.379857 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ff9e0e83-7311-4714-9141-1d2608e03f40 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:41.415523 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ff9e0e83-7311-4714-9141-1d2608e03f40 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: ea2ef6ca-2623-496d-a174-1d7cbaf80f85] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:15:41.548545 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ff9e0e83-7311-4714-9141-1d2608e03f40 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85" status: 204 len: 0 microversion: 2.1 time: 0.197206 Aug 07 01:15:41.553034 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 743/1332] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:15:41 2022] DELETE /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:15:41.560904 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e0978f1c-74ce-4e0b-bf8f-12b61ef08eb9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:41.563915 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e0978f1c-74ce-4e0b-bf8f-12b61ef08eb9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:41.579306 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0978f1c-74ce-4e0b-bf8f-12b61ef08eb9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:41.579806 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0978f1c-74ce-4e0b-bf8f-12b61ef08eb9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:41.581988 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0978f1c-74ce-4e0b-bf8f-12b61ef08eb9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:41.582747 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0978f1c-74ce-4e0b-bf8f-12b61ef08eb9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:41.583578 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0978f1c-74ce-4e0b-bf8f-12b61ef08eb9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:41.585220 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0978f1c-74ce-4e0b-bf8f-12b61ef08eb9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:41.620200 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:41.832551 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b4ebebe9-59f8-4737-9f92-c42153afc53e tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Action: 'create', calling method: .version_select at 0x7f9e242c8160>, body: {"keypair": {"name": "tempest-keypair-1841217378", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuKOqXPHvn9Dv0ofKFCHQZPSG7QZHbIgokiMEhr8Ged7F3ebXjDo7uWIJhlmJIa7egD9XbKMXBKVXmejm8fgrHjWGB2Rc+QN36iClXG/m1FdozTN9sL/QUoZdmAsUpQ4g=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:15:41.842887 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e0978f1c-74ce-4e0b-bf8f-12b61ef08eb9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:41.859471 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-b4ebebe9-59f8-4737-9f92-c42153afc53e tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Getting quotas for project e1530b8294fc4dd4bc7e7b228ad2b95c. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:15:41.866010 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e0978f1c-74ce-4e0b-bf8f-12b61ef08eb9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1477 microversion: 2.1 time: 0.311491 Aug 07 01:15:41.866010 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 744/1333] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:41 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1477 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:41.876735 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f8e36fe7-d9d9-4ef6-a398-f0897fb1915b tempest-FloatingIPDetailsTestJSON-243814326 tempest-FloatingIPDetailsTestJSON-243814326-project] Action: 'create', calling method: .version_select at 0x7f9e24884040>, body: {"pool": null} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:15:41.884822 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-b4ebebe9-59f8-4737-9f92-c42153afc53e tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Getting quotas for user 065d8324da60445ea1e97e1dc892f183 and project e1530b8294fc4dd4bc7e7b228ad2b95c. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:15:41.925950 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b4ebebe9-59f8-4737-9f92-c42153afc53e tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.551752 Aug 07 01:15:41.926968 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 590/1334] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:15:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:41.936159 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ad9122a8-5ccd-4896-8435-7fbe1407db6f tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:41.936590 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ad9122a8-5ccd-4896-8435-7fbe1407db6f tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:41.944246 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad9122a8-5ccd-4896-8435-7fbe1407db6f tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:41.946296 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad9122a8-5ccd-4896-8435-7fbe1407db6f tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:41.946989 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad9122a8-5ccd-4896-8435-7fbe1407db6f tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:41.947985 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad9122a8-5ccd-4896-8435-7fbe1407db6f tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:41.948680 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad9122a8-5ccd-4896-8435-7fbe1407db6f tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:41.950192 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad9122a8-5ccd-4896-8435-7fbe1407db6f tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:42.297562 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ad9122a8-5ccd-4896-8435-7fbe1407db6f tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 200 len: 1858 microversion: 2.1 time: 0.368581 Aug 07 01:15:42.299123 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 591/1335] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:41 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 1858 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:42.304705 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-39fa5b79-c063-49c4-88a7-31ca321f73f4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:42.305335 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-39fa5b79-c063-49c4-88a7-31ca321f73f4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: e6920f55-726f-4258-bc23-2a794668d6bb] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:42.335576 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39fa5b79-c063-49c4-88a7-31ca321f73f4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:42.336806 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39fa5b79-c063-49c4-88a7-31ca321f73f4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:42.337429 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39fa5b79-c063-49c4-88a7-31ca321f73f4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:42.338320 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39fa5b79-c063-49c4-88a7-31ca321f73f4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:42.339554 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39fa5b79-c063-49c4-88a7-31ca321f73f4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:42.340236 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39fa5b79-c063-49c4-88a7-31ca321f73f4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:42.398607 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-39fa5b79-c063-49c4-88a7-31ca321f73f4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] HTTP exception thrown: Instance e6920f55-726f-4258-bc23-2a794668d6bb could not be found. Aug 07 01:15:42.402180 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-39fa5b79-c063-49c4-88a7-31ca321f73f4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Request method failure captured: Aug 07 01:15:42.402180 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/e6920f55-726f-4258-bc23-2a794668d6bb HTTP/1.1 Aug 07 01:15:42.402180 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:15:42.402180 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:15:42.402180 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:15:42.402180 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:15:42.402180 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:15:42.402180 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:15:42.402180 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:15:42.402180 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:15:42.402180 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xH_7heYCkV2-y0pNneGN4ZnDqbs4UmpJQTmK5saNuk5H0WyhR4p8FKNrWGv5t9UmFTbjW-ntOaSKUHzjZAArTCL_7x2Uwa1lfuWNi0MRrWbfTOLIoXB6XEN1mRKk4FXNp_uEqv_bhxSKtjhZMsFP1MHgSM_FhzIX5Da4H4U1Rw8NW4 Aug 07 01:15:42.402180 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:15:42.402180 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:15:42.402180 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:15:42.402180 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:15:42.402180 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:15:42.402180 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:15:42.402180 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 45ac882e61ac45eb9abc60630e7337c3 Aug 07 01:15:42.402180 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ListServersNegativeTestJSON-938780471 Aug 07 01:15:42.402180 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:15:42.402180 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:15:42.403905 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/45ac882e61ac45eb9abc60630e7337c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_45ac882e61ac45eb9abc60630e7337c3", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/45ac882e61ac45eb9abc60630e7337c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/45ac882e61ac45eb9abc60630e7337c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:15:42.403905 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ListServersNegativeTestJSON-938780471 Aug 07 01:15:42.403905 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 45ac882e61ac45eb9abc60630e7337c3 Aug 07 01:15:42.403905 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-938780471 Aug 07 01:15:42.403905 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ListServersNegativeTestJSON-938780471-project Aug 07 01:15:42.403905 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:15:42.403905 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:15:42.403905 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: ae4f4a7231e4431c89712c557c4fa1df Aug 07 01:15:42.403905 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ListServersNegativeTestJSON-938780471-project Aug 07 01:15:42.403905 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:15:42.403905 n-d-master-1 devstack@n-api.service[119517]: exception: Instance e6920f55-726f-4258-bc23-2a794668d6bb could not be found. Aug 07 01:15:42.403905 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'e6920f55-726f-4258-bc23-2a794668d6bb'} Aug 07 01:15:42.404856 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:15:42.404856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:42.404856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:15:42.404856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:15:42.404856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:15:42.404856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:15:42.404856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:15:42.404856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:15:42.404856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:15:42.404856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:15:42.404856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6920f55-726f-4258-bc23-2a794668d6bb could not be found. Aug 07 01:15:42.404856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:15:42.404856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:15:42.404856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:15:42.404856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:42.404856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:15:42.404856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:15:42.404856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:15:42.404856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:15:42.404856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:15:42.406413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:15:42.406413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:15:42.406413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:15:42.406413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:15:42.406413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:15:42.406413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:15:42.406413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:15:42.406413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6920f55-726f-4258-bc23-2a794668d6bb could not be found. Aug 07 01:15:42.406413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:15:42.406413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:15:42.406413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:15:42.406413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:42.406413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:15:42.406413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:15:42.406413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:15:42.406413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:15:42.406413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6920f55-726f-4258-bc23-2a794668d6bb could not be found. Aug 07 01:15:42.406413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:15:42.409745 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-39fa5b79-c063-49c4-88a7-31ca321f73f4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Returning 404 to user: Instance e6920f55-726f-4258-bc23-2a794668d6bb could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:15:42.410933 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-39fa5b79-c063-49c4-88a7-31ca321f73f4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers/e6920f55-726f-4258-bc23-2a794668d6bb" status: 404 len: 111 microversion: 2.1 time: 0.110775 Aug 07 01:15:42.415479 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 592/1336] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:42 2022] GET /compute/v2.1/servers/e6920f55-726f-4258-bc23-2a794668d6bb => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:15:42.419469 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-eb967175-b3a3-49b1-b1fe-38fa00154ee9 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:42.420186 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-eb967175-b3a3-49b1-b1fe-38fa00154ee9 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:42.428126 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb967175-b3a3-49b1-b1fe-38fa00154ee9 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:42.429166 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb967175-b3a3-49b1-b1fe-38fa00154ee9 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:42.429786 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb967175-b3a3-49b1-b1fe-38fa00154ee9 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:42.430780 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb967175-b3a3-49b1-b1fe-38fa00154ee9 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:42.431492 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb967175-b3a3-49b1-b1fe-38fa00154ee9 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:42.432203 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb967175-b3a3-49b1-b1fe-38fa00154ee9 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:42.607706 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-eb967175-b3a3-49b1-b1fe-38fa00154ee9 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:42.620873 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-eb967175-b3a3-49b1-b1fe-38fa00154ee9 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1472 microversion: 2.1 time: 0.206632 Aug 07 01:15:42.621749 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 593/1337] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:42 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1472 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:42.627666 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-da9cce6b-3b69-403b-a32c-5654ddcc4449 req-429cca1b-88a3-408b-a748-f09a22a379e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0c22e90-af12-4699-beb3-463ba9e81e65", "name": "network-vif-plugged", "status": "completed", "tag": "491053e5-fdac-48b2-90c6-30b5040e819b"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:15:42.641972 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-da9cce6b-3b69-403b-a32c-5654ddcc4449 req-429cca1b-88a3-408b-a748-f09a22a379e7 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:42.642920 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-da9cce6b-3b69-403b-a32c-5654ddcc4449 req-429cca1b-88a3-408b-a748-f09a22a379e7 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:42.643863 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-da9cce6b-3b69-403b-a32c-5654ddcc4449 req-429cca1b-88a3-408b-a748-f09a22a379e7 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:42.665166 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-da9cce6b-3b69-403b-a32c-5654ddcc4449 req-429cca1b-88a3-408b-a748-f09a22a379e7 service nova] Creating event network-vif-plugged:491053e5-fdac-48b2-90c6-30b5040e819b for instance a0c22e90-af12-4699-beb3-463ba9e81e65 on n-h1-master-1 Aug 07 01:15:42.675477 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-da9cce6b-3b69-403b-a32c-5654ddcc4449 req-429cca1b-88a3-408b-a748-f09a22a379e7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051660 Aug 07 01:15:42.676603 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 594/1338] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:42.683622 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-16ac6c32-96fc-42cb-a58e-656ea7bc7b27 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:42.684660 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-16ac6c32-96fc-42cb-a58e-656ea7bc7b27 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:42.693182 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16ac6c32-96fc-42cb-a58e-656ea7bc7b27 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:42.694983 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16ac6c32-96fc-42cb-a58e-656ea7bc7b27 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:42.695661 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16ac6c32-96fc-42cb-a58e-656ea7bc7b27 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:42.696730 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16ac6c32-96fc-42cb-a58e-656ea7bc7b27 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:42.697451 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16ac6c32-96fc-42cb-a58e-656ea7bc7b27 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:42.698145 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16ac6c32-96fc-42cb-a58e-656ea7bc7b27 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:43.136480 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-16ac6c32-96fc-42cb-a58e-656ea7bc7b27 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 200 len: 1858 microversion: 2.1 time: 0.457309 Aug 07 01:15:43.146595 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 595/1339] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:42 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 1858 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:43.160657 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b35c45cc-b920-43d9-9b0d-f0bf61407823 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:43.164739 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b35c45cc-b920-43d9-9b0d-f0bf61407823 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: a0c22e90-af12-4699-beb3-463ba9e81e65] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:43.172273 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b35c45cc-b920-43d9-9b0d-f0bf61407823 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:43.184113 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b35c45cc-b920-43d9-9b0d-f0bf61407823 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:43.185387 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b35c45cc-b920-43d9-9b0d-f0bf61407823 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:43.187589 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b35c45cc-b920-43d9-9b0d-f0bf61407823 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:43.190400 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b35c45cc-b920-43d9-9b0d-f0bf61407823 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:43.191485 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b35c45cc-b920-43d9-9b0d-f0bf61407823 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:43.581240 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b35c45cc-b920-43d9-9b0d-f0bf61407823 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:43.590860 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b35c45cc-b920-43d9-9b0d-f0bf61407823 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/a0c22e90-af12-4699-beb3-463ba9e81e65" status: 200 len: 1317 microversion: 2.1 time: 0.440833 Aug 07 01:15:43.591756 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 596/1340] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:43 2022] GET /compute/v2.1/servers/a0c22e90-af12-4699-beb3-463ba9e81e65 => generated 1317 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:43.598393 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ca1475b3-f9e7-4dea-b824-a42d564dca14 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:43.599464 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ca1475b3-f9e7-4dea-b824-a42d564dca14 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: 45de519b-ab33-4648-9aa0-b9da5e3f1ef3] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:43.616646 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca1475b3-f9e7-4dea-b824-a42d564dca14 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:43.618010 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca1475b3-f9e7-4dea-b824-a42d564dca14 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:43.618651 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca1475b3-f9e7-4dea-b824-a42d564dca14 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:43.619596 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca1475b3-f9e7-4dea-b824-a42d564dca14 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:43.620375 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca1475b3-f9e7-4dea-b824-a42d564dca14 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:43.621681 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca1475b3-f9e7-4dea-b824-a42d564dca14 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:43.768397 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ca1475b3-f9e7-4dea-b824-a42d564dca14 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f4a7231e4431c89712c557c4fa1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ac882e61ac45eb9abc60630e7337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:43.779628 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ca1475b3-f9e7-4dea-b824-a42d564dca14 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers/45de519b-ab33-4648-9aa0-b9da5e3f1ef3" status: 200 len: 1480 microversion: 2.1 time: 0.186455 Aug 07 01:15:43.781040 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 597/1341] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:43 2022] GET /compute/v2.1/servers/45de519b-ab33-4648-9aa0-b9da5e3f1ef3 => generated 1480 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:44.026008 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-76ffde55-059d-46ea-b038-3ad1fa2ddd35 tempest-HypervisorAdminNegativeUnderV252Test-181882262 tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin] Calling method '.version_select at 0x7f9e2459ff70>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:44.029794 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:15:44.029794 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:15:44.034201 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76ffde55-059d-46ea-b038-3ad1fa2ddd35 tempest-HypervisorAdminNegativeUnderV252Test-181882262 tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:44.034695 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76ffde55-059d-46ea-b038-3ad1fa2ddd35 tempest-HypervisorAdminNegativeUnderV252Test-181882262 tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:44.038962 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76ffde55-059d-46ea-b038-3ad1fa2ddd35 tempest-HypervisorAdminNegativeUnderV252Test-181882262 tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:44.049650 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:44.064808 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76ffde55-059d-46ea-b038-3ad1fa2ddd35 tempest-HypervisorAdminNegativeUnderV252Test-181882262 tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:44.065755 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76ffde55-059d-46ea-b038-3ad1fa2ddd35 tempest-HypervisorAdminNegativeUnderV252Test-181882262 tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:44.066601 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76ffde55-059d-46ea-b038-3ad1fa2ddd35 tempest-HypervisorAdminNegativeUnderV252Test-181882262 tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:44.094283 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76ffde55-059d-46ea-b038-3ad1fa2ddd35 tempest-HypervisorAdminNegativeUnderV252Test-181882262 tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:44.096759 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76ffde55-059d-46ea-b038-3ad1fa2ddd35 tempest-HypervisorAdminNegativeUnderV252Test-181882262 tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:44.099552 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76ffde55-059d-46ea-b038-3ad1fa2ddd35 tempest-HypervisorAdminNegativeUnderV252Test-181882262 tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:44.127785 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-76ffde55-059d-46ea-b038-3ad1fa2ddd35 tempest-HypervisorAdminNegativeUnderV252Test-181882262 tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.343265 Aug 07 01:15:44.128441 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 598/1342] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:15:43 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:44.144558 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-319fa7d8-b3d8-46f9-958b-f4a9a248bec2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:44.145504 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-319fa7d8-b3d8-46f9-958b-f4a9a248bec2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:44.173843 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-319fa7d8-b3d8-46f9-958b-f4a9a248bec2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:44.174838 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-319fa7d8-b3d8-46f9-958b-f4a9a248bec2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:44.178192 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-319fa7d8-b3d8-46f9-958b-f4a9a248bec2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:44.179548 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-319fa7d8-b3d8-46f9-958b-f4a9a248bec2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:44.180670 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-319fa7d8-b3d8-46f9-958b-f4a9a248bec2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:44.181539 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-319fa7d8-b3d8-46f9-958b-f4a9a248bec2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:44.481977 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-319fa7d8-b3d8-46f9-958b-f4a9a248bec2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:44.491615 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-319fa7d8-b3d8-46f9-958b-f4a9a248bec2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1477 microversion: 2.1 time: 0.359539 Aug 07 01:15:44.506409 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 599/1343] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:44 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1477 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:44.514757 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9990d50a-9b36-4a57-9199-0d27f3b9a90b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:44.515420 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9990d50a-9b36-4a57-9199-0d27f3b9a90b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:44.523169 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9990d50a-9b36-4a57-9199-0d27f3b9a90b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:44.524043 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9990d50a-9b36-4a57-9199-0d27f3b9a90b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:44.524739 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9990d50a-9b36-4a57-9199-0d27f3b9a90b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:44.525684 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9990d50a-9b36-4a57-9199-0d27f3b9a90b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:44.526419 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9990d50a-9b36-4a57-9199-0d27f3b9a90b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:44.527225 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9990d50a-9b36-4a57-9199-0d27f3b9a90b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:44.627779 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:44.637724 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f8e36fe7-d9d9-4ef6-a398-f0897fb1915b tempest-FloatingIPDetailsTestJSON-243814326 tempest-FloatingIPDetailsTestJSON-243814326-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.772312 Aug 07 01:15:44.638751 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 745/1344] 10.222.0.39 () {60 vars in 1170 bytes} [Sun Aug 7 01:15:41 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2774 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:44.655749 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5324c4ab-ad3b-41e5-ae92-84c7e8c17fb4 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:44.656526 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5324c4ab-ad3b-41e5-ae92-84c7e8c17fb4 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:44.668007 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5324c4ab-ad3b-41e5-ae92-84c7e8c17fb4 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:44.668506 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5324c4ab-ad3b-41e5-ae92-84c7e8c17fb4 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:44.675632 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5324c4ab-ad3b-41e5-ae92-84c7e8c17fb4 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:44.676638 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5324c4ab-ad3b-41e5-ae92-84c7e8c17fb4 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:44.677232 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5324c4ab-ad3b-41e5-ae92-84c7e8c17fb4 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:44.678324 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5324c4ab-ad3b-41e5-ae92-84c7e8c17fb4 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:44.720445 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-9990d50a-9b36-4a57-9199-0d27f3b9a90b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lazy-loading 'services' on Instance uuid 459c9fac-af66-443f-acd3-22587f83ca6e {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:15:44.861926 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9990d50a-9b36-4a57-9199-0d27f3b9a90b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "DELETE /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e/os-volume_attachments/177d44ed-b273-4f30-8b90-baa4d614c354" status: 202 len: 0 microversion: 2.1 time: 0.353551 Aug 07 01:15:44.864881 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 600/1345] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Aug 7 01:15:44 2022] DELETE /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e/os-volume_attachments/177d44ed-b273-4f30-8b90-baa4d614c354 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:15:44.870185 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-d3c7dba8-f09d-4bf1-8c63-fc2fa45829fd req-c26d16cc-677c-4971-9c7c-e200c9bbf7a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45de519b-ab33-4648-9aa0-b9da5e3f1ef3", "name": "network-vif-deleted", "tag": "473f3c7a-5b88-453d-a65c-373cab90ea67"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:15:44.880667 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d3c7dba8-f09d-4bf1-8c63-fc2fa45829fd req-c26d16cc-677c-4971-9c7c-e200c9bbf7a3 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:44.881147 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d3c7dba8-f09d-4bf1-8c63-fc2fa45829fd req-c26d16cc-677c-4971-9c7c-e200c9bbf7a3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:44.881572 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d3c7dba8-f09d-4bf1-8c63-fc2fa45829fd req-c26d16cc-677c-4971-9c7c-e200c9bbf7a3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:44.898823 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-d3c7dba8-f09d-4bf1-8c63-fc2fa45829fd req-c26d16cc-677c-4971-9c7c-e200c9bbf7a3 service nova] Creating event network-vif-deleted:473f3c7a-5b88-453d-a65c-373cab90ea67 for instance 45de519b-ab33-4648-9aa0-b9da5e3f1ef3 on n-h2-master-1 Aug 07 01:15:44.905098 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-d3c7dba8-f09d-4bf1-8c63-fc2fa45829fd req-c26d16cc-677c-4971-9c7c-e200c9bbf7a3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038293 Aug 07 01:15:44.905723 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 601/1346] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:44.970849 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5324c4ab-ad3b-41e5-ae92-84c7e8c17fb4 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:44.981271 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5324c4ab-ad3b-41e5-ae92-84c7e8c17fb4 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1472 microversion: 2.1 time: 0.341344 Aug 07 01:15:44.982727 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 746/1347] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:44 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1472 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:44.990067 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-01821e04-a1eb-4346-9e94-d437433f1f7d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:44.990985 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-01821e04-a1eb-4346-9e94-d437433f1f7d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: a0c22e90-af12-4699-beb3-463ba9e81e65] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:44.998561 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-01821e04-a1eb-4346-9e94-d437433f1f7d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:44.999295 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-01821e04-a1eb-4346-9e94-d437433f1f7d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:44.999939 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-01821e04-a1eb-4346-9e94-d437433f1f7d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:45.001046 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-01821e04-a1eb-4346-9e94-d437433f1f7d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:45.001827 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-01821e04-a1eb-4346-9e94-d437433f1f7d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:45.002758 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-01821e04-a1eb-4346-9e94-d437433f1f7d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:45.078500 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-97f39396-ed47-424c-9995-f37770661cce tempest-HypervisorAdminNegativeUnderV252Test-1425489740 tempest-HypervisorAdminNegativeUnderV252Test-1425489740-project] Calling method '.version_select at 0x7f9e2463cd30>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:45.079659 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:15:45.079659 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:15:45.081109 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-97f39396-ed47-424c-9995-f37770661cce tempest-HypervisorAdminNegativeUnderV252Test-1425489740 tempest-HypervisorAdminNegativeUnderV252Test-1425489740-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '1225eed7296f489383edbee588257620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857d9950e6fb4b2d88e69bd5a3a1764b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:45.083406 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-97f39396-ed47-424c-9995-f37770661cce tempest-HypervisorAdminNegativeUnderV252Test-1425489740 tempest-HypervisorAdminNegativeUnderV252Test-1425489740-project] Request method failure captured: Aug 07 01:15:45.083406 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/os-hypervisors/n-h2-master-1/search HTTP/1.1 Aug 07 01:15:45.083406 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:15:45.083406 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:15:45.083406 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:15:45.083406 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:15:45.083406 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:15:45.083406 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:15:45.083406 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:15:45.083406 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:15:45.083406 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xI9RCwn693-w-Z8CZpWGnj9Aw_x0ycDYcpzOSjWYx7IaMWF9FrjWGKZelxL7QkV2YJkN96qKa6HOtuS1Mn1auRRCZguJxMq8PadiQnHq4sZMaCWN3Raz1-9dH6zWH_Cs658rAZ5jZPypFtcgUZv3W-VsMUs435Awd7BFKcSbFXXZlQ Aug 07 01:15:45.083406 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:15:45.083406 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:15:45.083406 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:15:45.083406 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:15:45.083406 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:15:45.083406 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:15:45.083406 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 857d9950e6fb4b2d88e69bd5a3a1764b Aug 07 01:15:45.083406 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1425489740 Aug 07 01:15:45.083406 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:15:45.083406 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:15:45.084942 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/857d9950e6fb4b2d88e69bd5a3a1764b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_857d9950e6fb4b2d88e69bd5a3a1764b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/857d9950e6fb4b2d88e69bd5a3a1764b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/857d9950e6fb4b2d88e69bd5a3a1764b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:15:45.084942 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1425489740 Aug 07 01:15:45.084942 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 857d9950e6fb4b2d88e69bd5a3a1764b Aug 07 01:15:45.084942 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1425489740 Aug 07 01:15:45.084942 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1425489740-project Aug 07 01:15:45.084942 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:15:45.084942 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:15:45.084942 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 1225eed7296f489383edbee588257620 Aug 07 01:15:45.084942 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1425489740-project Aug 07 01:15:45.084942 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:15:45.084942 n-d-master-1 devstack@n-api.service[119517]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 07 01:15:45.084942 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'n-h2-master-1'} Aug 07 01:15:45.085712 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:15:45.085712 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:45.085712 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:15:45.085712 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:15:45.085712 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:15:45.085712 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:15:45.085712 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:15:45.085712 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:15:45.085712 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:15:45.085712 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:15:45.085712 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 07 01:15:45.085712 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 07 01:15:45.085712 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 07 01:15:45.085712 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 07 01:15:45.085712 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 07 01:15:45.085712 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 07 01:15:45.085712 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:15:45.085712 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:15:45.085712 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:15:45.086913 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:15:45.086913 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 07 01:15:45.086913 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 07 01:15:45.086913 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 07 01:15:45.086913 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 07 01:15:45.086913 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 07 01:15:45.086913 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 07 01:15:45.086913 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 07 01:15:45.086913 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:15:45.086913 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:15:45.086913 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:15:45.086913 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:45.086913 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:15:45.086913 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:15:45.086913 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 07 01:15:45.086913 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 07 01:15:45.086913 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 07 01:15:45.086913 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:15:45.088083 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-97f39396-ed47-424c-9995-f37770661cce tempest-HypervisorAdminNegativeUnderV252Test-1425489740 tempest-HypervisorAdminNegativeUnderV252Test-1425489740-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:15:45.088083 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-97f39396-ed47-424c-9995-f37770661cce tempest-HypervisorAdminNegativeUnderV252Test-1425489740 tempest-HypervisorAdminNegativeUnderV252Test-1425489740-project] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/n-h2-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.175092 Aug 07 01:15:45.088083 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 602/1348] 10.222.0.39 () {58 vars in 1209 bytes} [Sun Aug 7 01:15:44 2022] GET /compute/v2.1/os-hypervisors/n-h2-master-1/search => generated 117 bytes in 177 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:15:45.095702 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ff3a17ac-7282-419b-82a7-542d0c30a68b tempest-FloatingIPDetailsTestJSON-243814326 tempest-FloatingIPDetailsTestJSON-243814326-project] Calling method '.version_select at 0x7f9e24383040>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:45.259376 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-01821e04-a1eb-4346-9e94-d437433f1f7d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:45.268400 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-01821e04-a1eb-4346-9e94-d437433f1f7d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/a0c22e90-af12-4699-beb3-463ba9e81e65" status: 200 len: 1317 microversion: 2.1 time: 0.284285 Aug 07 01:15:45.268998 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 747/1349] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:44 2022] GET /compute/v2.1/servers/a0c22e90-af12-4699-beb3-463ba9e81e65 => generated 1317 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:45.278379 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-232c2549-a25e-4121-9043-0ec56fece513 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:45.280412 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-232c2549-a25e-4121-9043-0ec56fece513 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: 45de519b-ab33-4648-9aa0-b9da5e3f1ef3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:45.291357 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-232c2549-a25e-4121-9043-0ec56fece513 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:45.292013 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-232c2549-a25e-4121-9043-0ec56fece513 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:45.293679 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-232c2549-a25e-4121-9043-0ec56fece513 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:45.295231 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-232c2549-a25e-4121-9043-0ec56fece513 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:45.295231 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-232c2549-a25e-4121-9043-0ec56fece513 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:45.295582 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-232c2549-a25e-4121-9043-0ec56fece513 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:45.310113 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ff3a17ac-7282-419b-82a7-542d0c30a68b tempest-FloatingIPDetailsTestJSON-243814326 tempest-FloatingIPDetailsTestJSON-243814326-project] 10.222.0.39 "GET /compute/v2.1/os-floating-ips/351f3452-1322-4378-8b00-16aa5363b45b" status: 200 len: 141 microversion: 2.1 time: 0.222705 Aug 07 01:15:45.317887 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 603/1350] 10.222.0.39 () {58 vars in 1260 bytes} [Sun Aug 7 01:15:45 2022] GET /compute/v2.1/os-floating-ips/351f3452-1322-4378-8b00-16aa5363b45b => generated 141 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:45.317887 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4032a987-0649-419d-bf84-caab75c26d33 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:45.318268 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4032a987-0649-419d-bf84-caab75c26d33 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:45.325502 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-232c2549-a25e-4121-9043-0ec56fece513 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] HTTP exception thrown: Instance 45de519b-ab33-4648-9aa0-b9da5e3f1ef3 could not be found. Aug 07 01:15:45.327180 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-232c2549-a25e-4121-9043-0ec56fece513 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Request method failure captured: Aug 07 01:15:45.327180 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/45de519b-ab33-4648-9aa0-b9da5e3f1ef3 HTTP/1.1 Aug 07 01:15:45.327180 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:15:45.327180 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:15:45.327180 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:15:45.327180 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:15:45.327180 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:15:45.327180 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:15:45.327180 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:15:45.327180 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:15:45.327180 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xH_7heYCkV2-y0pNneGN4ZnDqbs4UmpJQTmK5saNuk5H0WyhR4p8FKNrWGv5t9UmFTbjW-ntOaSKUHzjZAArTCL_7x2Uwa1lfuWNi0MRrWbfTOLIoXB6XEN1mRKk4FXNp_uEqv_bhxSKtjhZMsFP1MHgSM_FhzIX5Da4H4U1Rw8NW4 Aug 07 01:15:45.327180 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:15:45.327180 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:15:45.327180 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:15:45.327180 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:15:45.327180 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:15:45.327180 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:15:45.327180 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 45ac882e61ac45eb9abc60630e7337c3 Aug 07 01:15:45.327180 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ListServersNegativeTestJSON-938780471 Aug 07 01:15:45.327180 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:15:45.327180 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:15:45.328759 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/45ac882e61ac45eb9abc60630e7337c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_45ac882e61ac45eb9abc60630e7337c3", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/45ac882e61ac45eb9abc60630e7337c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/45ac882e61ac45eb9abc60630e7337c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:15:45.328759 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ListServersNegativeTestJSON-938780471 Aug 07 01:15:45.328759 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 45ac882e61ac45eb9abc60630e7337c3 Aug 07 01:15:45.328759 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-938780471 Aug 07 01:15:45.328759 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ListServersNegativeTestJSON-938780471-project Aug 07 01:15:45.328759 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:15:45.328759 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:15:45.328759 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: ae4f4a7231e4431c89712c557c4fa1df Aug 07 01:15:45.328759 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ListServersNegativeTestJSON-938780471-project Aug 07 01:15:45.328759 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:15:45.328759 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 45de519b-ab33-4648-9aa0-b9da5e3f1ef3 could not be found. Aug 07 01:15:45.328759 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '45de519b-ab33-4648-9aa0-b9da5e3f1ef3'} Aug 07 01:15:45.329524 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:15:45.329524 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:45.329524 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:15:45.329524 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:15:45.329524 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:15:45.329524 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:15:45.329524 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:15:45.329524 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:15:45.329524 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:15:45.329524 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:15:45.329524 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45de519b-ab33-4648-9aa0-b9da5e3f1ef3 could not be found. Aug 07 01:15:45.329524 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:45.329524 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:15:45.329524 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:45.329524 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:45.329524 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:15:45.329524 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:15:45.329524 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:15:45.329524 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:15:45.329524 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:15:45.330783 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:15:45.330783 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:15:45.330783 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:15:45.330783 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:15:45.330783 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:15:45.330783 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:15:45.330783 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:15:45.330783 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45de519b-ab33-4648-9aa0-b9da5e3f1ef3 could not be found. Aug 07 01:15:45.330783 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:45.330783 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:15:45.330783 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:45.330783 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:45.330783 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:15:45.330783 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:15:45.330783 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:15:45.330783 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:15:45.330783 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45de519b-ab33-4648-9aa0-b9da5e3f1ef3 could not be found. Aug 07 01:15:45.330783 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:45.333314 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-232c2549-a25e-4121-9043-0ec56fece513 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Returning 404 to user: Instance 45de519b-ab33-4648-9aa0-b9da5e3f1ef3 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:15:45.333314 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-232c2549-a25e-4121-9043-0ec56fece513 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers/45de519b-ab33-4648-9aa0-b9da5e3f1ef3" status: 404 len: 111 microversion: 2.1 time: 0.058493 Aug 07 01:15:45.333625 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4032a987-0649-419d-bf84-caab75c26d33 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:45.333796 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 748/1351] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:45 2022] GET /compute/v2.1/servers/45de519b-ab33-4648-9aa0-b9da5e3f1ef3 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:15:45.333971 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4032a987-0649-419d-bf84-caab75c26d33 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:45.333971 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4032a987-0649-419d-bf84-caab75c26d33 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:45.333971 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4032a987-0649-419d-bf84-caab75c26d33 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:45.333971 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4032a987-0649-419d-bf84-caab75c26d33 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:45.334580 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b5777177-107a-4ce5-8cc5-58b0f7bcbfd4 tempest-HypervisorAdminNegativeUnderV252Test-181882262 tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin] Calling method '.version_select at 0x7f9e24882280>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:45.335203 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4032a987-0649-419d-bf84-caab75c26d33 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:45.335390 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:15:45.335390 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:15:45.337147 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b5777177-107a-4ce5-8cc5-58b0f7bcbfd4 tempest-HypervisorAdminNegativeUnderV252Test-181882262 tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:45.337768 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b5777177-107a-4ce5-8cc5-58b0f7bcbfd4 tempest-HypervisorAdminNegativeUnderV252Test-181882262 tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:45.338230 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b5777177-107a-4ce5-8cc5-58b0f7bcbfd4 tempest-HypervisorAdminNegativeUnderV252Test-181882262 tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:45.345109 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-b5777177-107a-4ce5-8cc5-58b0f7bcbfd4 tempest-HypervisorAdminNegativeUnderV252Test-181882262 tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 07 01:15:45.346490 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b5777177-107a-4ce5-8cc5-58b0f7bcbfd4 tempest-HypervisorAdminNegativeUnderV252Test-181882262 tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin] Request method failure captured: Aug 07 01:15:45.346490 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 07 01:15:45.346490 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:15:45.346490 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:15:45.346490 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:15:45.346490 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:15:45.346490 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:15:45.346490 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:15:45.346490 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:15:45.346490 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:15:45.346490 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xI-9Tt5W_vdtylJKlApAYjvmymVppEOjvoTaGbZ898WSzgzPbDD3rzuuKBqfwrLkhJPYsAzlApnv_UnjdAx_HXQNugHBB-LU6-QHzVP8BJ1GLMKKrwmHJL3KlZep84oj4zcBkk005x_D9byBwM8bzXFsu1c2jcTI_ws6NyNZ7Y9EFE Aug 07 01:15:45.346490 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:15:45.346490 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:15:45.346490 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:15:45.346490 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:15:45.346490 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:15:45.346490 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:15:45.346490 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: bfe98a2f33794cbeac55e1ed64947157 Aug 07 01:15:45.346490 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-181882262 Aug 07 01:15:45.346490 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,admin,member Aug 07 01:15:45.346490 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,admin,member Aug 07 01:15:45.350108 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bfe98a2f33794cbeac55e1ed64947157"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bfe98a2f33794cbeac55e1ed64947157", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bfe98a2f33794cbeac55e1ed64947157"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bfe98a2f33794cbeac55e1ed64947157"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:15:45.350108 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-181882262 Aug 07 01:15:45.350108 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: bfe98a2f33794cbeac55e1ed64947157 Aug 07 01:15:45.350108 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-181882262 Aug 07 01:15:45.350108 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin Aug 07 01:15:45.350108 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:15:45.350108 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:15:45.350108 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 0000ca500ed648b79c0e00a3ae9db120 Aug 07 01:15:45.350108 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin Aug 07 01:15:45.350108 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:15:45.350108 n-d-master-1 devstack@n-api.service[119516]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 07 01:15:45.350108 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 07 01:15:45.351755 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:15:45.351755 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:45.351755 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:15:45.351755 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:15:45.351755 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:15:45.351755 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:15:45.351755 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:15:45.351755 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:15:45.351755 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:15:45.351755 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:15:45.351755 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 07 01:15:45.351755 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 07 01:15:45.351755 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 07 01:15:45.351755 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 07 01:15:45.351755 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 07 01:15:45.351755 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:45.351755 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:15:45.351755 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:45.351755 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:45.351755 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:15:45.355661 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:15:45.355661 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:15:45.355661 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:15:45.355661 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 07 01:15:45.355661 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:45.355661 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b5777177-107a-4ce5-8cc5-58b0f7bcbfd4 tempest-HypervisorAdminNegativeUnderV252Test-181882262 tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:15:45.355661 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b5777177-107a-4ce5-8cc5-58b0f7bcbfd4 tempest-HypervisorAdminNegativeUnderV252Test-181882262 tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.017473 Aug 07 01:15:45.355661 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 749/1352] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Aug 7 01:15:45 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:15:45.359632 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-57082a3e-03cc-40c1-8059-27230918168b tempest-FloatingIPDetailsTestJSON-243814326 tempest-FloatingIPDetailsTestJSON-243814326-project] Calling method '.version_select at 0x7f9e24833dc0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:45.382696 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4032a987-0649-419d-bf84-caab75c26d33 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070910 Aug 07 01:15:45.383383 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 604/1353] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:15:45 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:45.388247 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7da10d9c-f3f2-44b0-8cab-9c96fe252e8d tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:45.388966 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7da10d9c-f3f2-44b0-8cab-9c96fe252e8d tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: ea2ef6ca-2623-496d-a174-1d7cbaf80f85] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:45.396178 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7da10d9c-f3f2-44b0-8cab-9c96fe252e8d tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:45.396750 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7da10d9c-f3f2-44b0-8cab-9c96fe252e8d tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:45.397254 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7da10d9c-f3f2-44b0-8cab-9c96fe252e8d tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:45.398250 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7da10d9c-f3f2-44b0-8cab-9c96fe252e8d tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:45.398705 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7da10d9c-f3f2-44b0-8cab-9c96fe252e8d tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:45.399129 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7da10d9c-f3f2-44b0-8cab-9c96fe252e8d tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:45.537864 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7da10d9c-f3f2-44b0-8cab-9c96fe252e8d tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f4a7231e4431c89712c557c4fa1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ac882e61ac45eb9abc60630e7337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:45.546562 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7da10d9c-f3f2-44b0-8cab-9c96fe252e8d tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85" status: 200 len: 1523 microversion: 2.1 time: 0.161943 Aug 07 01:15:45.547257 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 605/1354] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:45 2022] GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:45.552592 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2276f81b-df74-460e-b1c8-51d9e4b66798 tempest-HypervisorAdminNegativeUnderV252Test-181882262 tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin] Calling method '.version_select at 0x7f9e243833a0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:45.553807 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:15:45.553807 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:15:45.555160 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2276f81b-df74-460e-b1c8-51d9e4b66798 tempest-HypervisorAdminNegativeUnderV252Test-181882262 tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:45.555823 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2276f81b-df74-460e-b1c8-51d9e4b66798 tempest-HypervisorAdminNegativeUnderV252Test-181882262 tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:45.556616 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2276f81b-df74-460e-b1c8-51d9e4b66798 tempest-HypervisorAdminNegativeUnderV252Test-181882262 tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:45.575256 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2276f81b-df74-460e-b1c8-51d9e4b66798 tempest-HypervisorAdminNegativeUnderV252Test-181882262 tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:45.575966 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2276f81b-df74-460e-b1c8-51d9e4b66798 tempest-HypervisorAdminNegativeUnderV252Test-181882262 tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:45.576461 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2276f81b-df74-460e-b1c8-51d9e4b66798 tempest-HypervisorAdminNegativeUnderV252Test-181882262 tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:45.588685 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2276f81b-df74-460e-b1c8-51d9e4b66798 tempest-HypervisorAdminNegativeUnderV252Test-181882262 tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:45.589181 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2276f81b-df74-460e-b1c8-51d9e4b66798 tempest-HypervisorAdminNegativeUnderV252Test-181882262 tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:45.589654 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2276f81b-df74-460e-b1c8-51d9e4b66798 tempest-HypervisorAdminNegativeUnderV252Test-181882262 tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:45.596885 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2276f81b-df74-460e-b1c8-51d9e4b66798 tempest-HypervisorAdminNegativeUnderV252Test-181882262 tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.048519 Aug 07 01:15:45.597865 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 606/1355] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:15:45 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:45.603438 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c2127f42-f491-458e-bda4-350f9d2c859c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:45.604502 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c2127f42-f491-458e-bda4-350f9d2c859c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:45.612538 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2127f42-f491-458e-bda4-350f9d2c859c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:45.613239 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2127f42-f491-458e-bda4-350f9d2c859c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:45.613773 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2127f42-f491-458e-bda4-350f9d2c859c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:45.615933 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2127f42-f491-458e-bda4-350f9d2c859c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:45.616503 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2127f42-f491-458e-bda4-350f9d2c859c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:45.617981 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2127f42-f491-458e-bda4-350f9d2c859c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:45.769673 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c2127f42-f491-458e-bda4-350f9d2c859c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:45.778052 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c2127f42-f491-458e-bda4-350f9d2c859c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1477 microversion: 2.1 time: 0.178928 Aug 07 01:15:45.778852 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 607/1356] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:45 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1477 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:45.783282 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b1d9ec43-75a3-4e3b-8687-8557816566a5 tempest-HypervisorAdminNegativeUnderV252Test-1425489740 tempest-HypervisorAdminNegativeUnderV252Test-1425489740-project] Calling method '.version_select at 0x7f9e2463cd30>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:45.784199 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:15:45.784199 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:15:45.785201 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b1d9ec43-75a3-4e3b-8687-8557816566a5 tempest-HypervisorAdminNegativeUnderV252Test-1425489740 tempest-HypervisorAdminNegativeUnderV252Test-1425489740-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '1225eed7296f489383edbee588257620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '857d9950e6fb4b2d88e69bd5a3a1764b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:45.788085 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b1d9ec43-75a3-4e3b-8687-8557816566a5 tempest-HypervisorAdminNegativeUnderV252Test-1425489740 tempest-HypervisorAdminNegativeUnderV252Test-1425489740-project] Request method failure captured: Aug 07 01:15:45.788085 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 07 01:15:45.788085 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:15:45.788085 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:15:45.788085 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:15:45.788085 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:15:45.788085 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:15:45.788085 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:15:45.788085 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:15:45.788085 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:15:45.788085 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xI9RCwn693-w-Z8CZpWGnj9Aw_x0ycDYcpzOSjWYx7IaMWF9FrjWGKZelxL7QkV2YJkN96qKa6HOtuS1Mn1auRRCZguJxMq8PadiQnHq4sZMaCWN3Raz1-9dH6zWH_Cs658rAZ5jZPypFtcgUZv3W-VsMUs435Awd7BFKcSbFXXZlQ Aug 07 01:15:45.788085 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:15:45.788085 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:15:45.788085 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:15:45.788085 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:15:45.788085 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:15:45.788085 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:15:45.788085 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 857d9950e6fb4b2d88e69bd5a3a1764b Aug 07 01:15:45.788085 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1425489740 Aug 07 01:15:45.788085 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:15:45.788085 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:15:45.790749 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/857d9950e6fb4b2d88e69bd5a3a1764b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_857d9950e6fb4b2d88e69bd5a3a1764b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/857d9950e6fb4b2d88e69bd5a3a1764b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/857d9950e6fb4b2d88e69bd5a3a1764b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:15:45.790749 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1425489740 Aug 07 01:15:45.790749 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 857d9950e6fb4b2d88e69bd5a3a1764b Aug 07 01:15:45.790749 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1425489740 Aug 07 01:15:45.790749 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1425489740-project Aug 07 01:15:45.790749 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:15:45.790749 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:15:45.790749 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 1225eed7296f489383edbee588257620 Aug 07 01:15:45.790749 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1425489740-project Aug 07 01:15:45.790749 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:15:45.790749 n-d-master-1 devstack@n-api.service[119517]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 07 01:15:45.790749 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '1'} Aug 07 01:15:45.792241 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:15:45.792241 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:45.792241 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:15:45.792241 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:15:45.792241 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:15:45.792241 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:15:45.792241 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:15:45.792241 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:15:45.792241 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:15:45.792241 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:15:45.792241 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 07 01:15:45.792241 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 07 01:15:45.792241 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 07 01:15:45.792241 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 07 01:15:45.792241 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 07 01:15:45.792241 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 07 01:15:45.792241 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:15:45.792241 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:15:45.792241 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:15:45.794347 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:15:45.794347 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 07 01:15:45.794347 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 07 01:15:45.794347 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 07 01:15:45.794347 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 07 01:15:45.794347 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 07 01:15:45.794347 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 07 01:15:45.794347 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 07 01:15:45.794347 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:15:45.794347 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:15:45.794347 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:15:45.794347 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:45.794347 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:15:45.794347 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:15:45.794347 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 07 01:15:45.794347 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 07 01:15:45.794347 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 07 01:15:45.794347 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:15:45.795933 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b1d9ec43-75a3-4e3b-8687-8557816566a5 tempest-HypervisorAdminNegativeUnderV252Test-1425489740 tempest-HypervisorAdminNegativeUnderV252Test-1425489740-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:15:45.795933 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b1d9ec43-75a3-4e3b-8687-8557816566a5 tempest-HypervisorAdminNegativeUnderV252Test-1425489740 tempest-HypervisorAdminNegativeUnderV252Test-1425489740-project] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.010102 Aug 07 01:15:45.795933 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 608/1357] 10.222.0.39 () {58 vars in 1176 bytes} [Sun Aug 7 01:15:45 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:15:45.797313 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3119a5e9-aeff-44a1-a60d-bbe18e129ce1 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "70d05478-2d0e-4492-8de3-472b1fd07324"}], "security_groups": [{"name": "tempest-securitygroup--1417276965"}], "key_name": "tempest-keypair-1841217378", "user_data": "}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:15:45.922302 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-3119a5e9-aeff-44a1-a60d-bbe18e129ce1 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] validate_networks() for [('70d05478-2d0e-4492-8de3-472b1fd07324', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:15:46.409271 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-57082a3e-03cc-40c1-8059-27230918168b tempest-FloatingIPDetailsTestJSON-243814326 tempest-FloatingIPDetailsTestJSON-243814326-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/351f3452-1322-4378-8b00-16aa5363b45b" status: 202 len: 0 microversion: 2.1 time: 1.054273 Aug 07 01:15:46.414542 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 750/1358] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Aug 7 01:15:45 2022] DELETE /compute/v2.1/os-floating-ips/351f3452-1322-4378-8b00-16aa5363b45b => generated 0 bytes in 1060 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:15:46.420633 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e8d802e3-0281-4c06-ad1f-5dacc9f04454 tempest-HypervisorAdminNegativeUnderV252Test-181882262 tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin] Calling method '.version_select at 0x7f9e252598b0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:46.421445 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:15:46.421445 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:15:46.429276 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e8d802e3-0281-4c06-ad1f-5dacc9f04454 tempest-HypervisorAdminNegativeUnderV252Test-181882262 tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:46.430036 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e8d802e3-0281-4c06-ad1f-5dacc9f04454 tempest-HypervisorAdminNegativeUnderV252Test-181882262 tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:46.430689 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e8d802e3-0281-4c06-ad1f-5dacc9f04454 tempest-HypervisorAdminNegativeUnderV252Test-181882262 tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:46.449567 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-e8d802e3-0281-4c06-ad1f-5dacc9f04454 tempest-HypervisorAdminNegativeUnderV252Test-181882262 tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin] HTTP exception thrown: No hypervisor matching '1380d713-9911-413a-adff-a2b27b1e6063' could be found. Aug 07 01:15:46.451421 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e8d802e3-0281-4c06-ad1f-5dacc9f04454 tempest-HypervisorAdminNegativeUnderV252Test-181882262 tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin] Request method failure captured: Aug 07 01:15:46.451421 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/os-hypervisors/1380d713-9911-413a-adff-a2b27b1e6063/servers HTTP/1.1 Aug 07 01:15:46.451421 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:15:46.451421 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:15:46.451421 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:15:46.451421 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:15:46.451421 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:15:46.451421 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:15:46.451421 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:15:46.451421 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:15:46.451421 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xI-9Tt5W_vdtylJKlApAYjvmymVppEOjvoTaGbZ898WSzgzPbDD3rzuuKBqfwrLkhJPYsAzlApnv_UnjdAx_HXQNugHBB-LU6-QHzVP8BJ1GLMKKrwmHJL3KlZep84oj4zcBkk005x_D9byBwM8bzXFsu1c2jcTI_ws6NyNZ7Y9EFE Aug 07 01:15:46.451421 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:15:46.451421 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:15:46.451421 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:15:46.451421 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:15:46.451421 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:15:46.451421 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:15:46.451421 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: bfe98a2f33794cbeac55e1ed64947157 Aug 07 01:15:46.451421 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-181882262 Aug 07 01:15:46.451421 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,admin,member Aug 07 01:15:46.451421 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,admin,member Aug 07 01:15:46.453094 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bfe98a2f33794cbeac55e1ed64947157"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bfe98a2f33794cbeac55e1ed64947157", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bfe98a2f33794cbeac55e1ed64947157"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bfe98a2f33794cbeac55e1ed64947157"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:15:46.453094 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-181882262 Aug 07 01:15:46.453094 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: bfe98a2f33794cbeac55e1ed64947157 Aug 07 01:15:46.453094 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-181882262 Aug 07 01:15:46.453094 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin Aug 07 01:15:46.453094 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:15:46.453094 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:15:46.453094 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 0000ca500ed648b79c0e00a3ae9db120 Aug 07 01:15:46.453094 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin Aug 07 01:15:46.453094 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:15:46.453094 n-d-master-1 devstack@n-api.service[119516]: exception: No hypervisor matching '1380d713-9911-413a-adff-a2b27b1e6063' could be found. Aug 07 01:15:46.453094 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '1380d713-9911-413a-adff-a2b27b1e6063'} Aug 07 01:15:46.454049 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:15:46.454049 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:46.454049 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:15:46.454049 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:15:46.454049 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:15:46.454049 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:15:46.454049 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:15:46.454049 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:15:46.454049 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:15:46.454049 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:15:46.454049 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 07 01:15:46.454049 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 07 01:15:46.454049 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 07 01:15:46.454049 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 07 01:15:46.454049 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '1380d713-9911-413a-adff-a2b27b1e6063' could be found. Aug 07 01:15:46.454049 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:46.454049 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:15:46.454049 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:46.454049 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:46.455601 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:15:46.455601 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:15:46.455601 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:15:46.455601 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:15:46.455601 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '1380d713-9911-413a-adff-a2b27b1e6063' could be found. Aug 07 01:15:46.455601 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:46.457188 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e8d802e3-0281-4c06-ad1f-5dacc9f04454 tempest-HypervisorAdminNegativeUnderV252Test-181882262 tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin] Returning 404 to user: No hypervisor matching '1380d713-9911-413a-adff-a2b27b1e6063' could be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:15:46.457905 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e8d802e3-0281-4c06-ad1f-5dacc9f04454 tempest-HypervisorAdminNegativeUnderV252Test-181882262 tempest-HypervisorAdminNegativeUnderV252Test-181882262-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/1380d713-9911-413a-adff-a2b27b1e6063/servers" status: 404 len: 123 microversion: 2.1 time: 0.042302 Aug 07 01:15:46.463495 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 751/1359] 10.222.0.39 () {58 vars in 1281 bytes} [Sun Aug 7 01:15:46 2022] GET /compute/v2.1/os-hypervisors/1380d713-9911-413a-adff-a2b27b1e6063/servers => generated 123 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:15:46.471269 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e0d9bd29-93b2-4298-a580-7dc8c26b8ddb tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:46.472763 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e0d9bd29-93b2-4298-a580-7dc8c26b8ddb tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:46.486142 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0d9bd29-93b2-4298-a580-7dc8c26b8ddb tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:46.486909 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0d9bd29-93b2-4298-a580-7dc8c26b8ddb tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:46.487677 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0d9bd29-93b2-4298-a580-7dc8c26b8ddb tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:46.488637 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0d9bd29-93b2-4298-a580-7dc8c26b8ddb tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:46.489108 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0d9bd29-93b2-4298-a580-7dc8c26b8ddb tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:46.489574 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0d9bd29-93b2-4298-a580-7dc8c26b8ddb tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:46.574942 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-3119a5e9-aeff-44a1-a60d-bbe18e129ce1 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:15:46.575477 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-3119a5e9-aeff-44a1-a60d-bbe18e129ce1 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:15:46.575970 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-3119a5e9-aeff-44a1-a60d-bbe18e129ce1 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:15:46.576434 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-3119a5e9-aeff-44a1-a60d-bbe18e129ce1 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:15:46.576817 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-3119a5e9-aeff-44a1-a60d-bbe18e129ce1 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:15:46.611064 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3119a5e9-aeff-44a1-a60d-bbe18e129ce1 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:46.612068 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3119a5e9-aeff-44a1-a60d-bbe18e129ce1 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:46.612807 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3119a5e9-aeff-44a1-a60d-bbe18e129ce1 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:46.614830 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3119a5e9-aeff-44a1-a60d-bbe18e129ce1 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:46.616009 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3119a5e9-aeff-44a1-a60d-bbe18e129ce1 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:46.617026 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3119a5e9-aeff-44a1-a60d-bbe18e129ce1 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:46.650850 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-3119a5e9-aeff-44a1-a60d-bbe18e129ce1 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Getting quotas for project e1530b8294fc4dd4bc7e7b228ad2b95c. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:15:46.658604 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-3119a5e9-aeff-44a1-a60d-bbe18e129ce1 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Getting quotas for user 065d8324da60445ea1e97e1dc892f183 and project e1530b8294fc4dd4bc7e7b228ad2b95c. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:15:46.678416 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3119a5e9-aeff-44a1-a60d-bbe18e129ce1 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:15:46.683403 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3119a5e9-aeff-44a1-a60d-bbe18e129ce1 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] [instance: 91da23de-c338-4658-8620-831662a596b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:15:46.791768 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3119a5e9-aeff-44a1-a60d-bbe18e129ce1 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.999922 Aug 07 01:15:46.795926 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 609/1360] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:15:45 2022] POST /compute/v2.1/servers => generated 409 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:15:46.804499 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-41b6136f-7069-41f7-a13c-f55bcfc15f9c tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:46.805417 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-41b6136f-7069-41f7-a13c-f55bcfc15f9c tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: a0c22e90-af12-4699-beb3-463ba9e81e65] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:46.812062 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-41b6136f-7069-41f7-a13c-f55bcfc15f9c tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:46.812896 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-41b6136f-7069-41f7-a13c-f55bcfc15f9c tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:46.813548 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-41b6136f-7069-41f7-a13c-f55bcfc15f9c tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:46.814504 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-41b6136f-7069-41f7-a13c-f55bcfc15f9c tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:46.815351 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-41b6136f-7069-41f7-a13c-f55bcfc15f9c tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:46.816038 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-41b6136f-7069-41f7-a13c-f55bcfc15f9c tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:46.959900 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e0d9bd29-93b2-4298-a580-7dc8c26b8ddb tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:46.981906 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e0d9bd29-93b2-4298-a580-7dc8c26b8ddb tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1490 microversion: 2.1 time: 0.516019 Aug 07 01:15:47.000167 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 752/1361] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:46 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1490 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:47.000167 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-960c0b91-67c9-40d3-a788-4c7b7e133add tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:47.000167 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-960c0b91-67c9-40d3-a788-4c7b7e133add tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:47.023778 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-960c0b91-67c9-40d3-a788-4c7b7e133add tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:47.025499 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-960c0b91-67c9-40d3-a788-4c7b7e133add tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:47.026215 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-960c0b91-67c9-40d3-a788-4c7b7e133add tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:47.031926 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-960c0b91-67c9-40d3-a788-4c7b7e133add tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:47.032807 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-960c0b91-67c9-40d3-a788-4c7b7e133add tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:47.033392 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-960c0b91-67c9-40d3-a788-4c7b7e133add tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:47.060451 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-41b6136f-7069-41f7-a13c-f55bcfc15f9c tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:47.068585 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-41b6136f-7069-41f7-a13c-f55bcfc15f9c tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/a0c22e90-af12-4699-beb3-463ba9e81e65" status: 200 len: 1317 microversion: 2.1 time: 0.267967 Aug 07 01:15:47.082214 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-960c0b91-67c9-40d3-a788-4c7b7e133add tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091473 Aug 07 01:15:47.084427 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 753/1362] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:15:46 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:47.089628 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-90fae587-96b8-4216-838d-186706e632c9 tempest-FloatingIPDetailsTestJSON-243814326 tempest-FloatingIPDetailsTestJSON-243814326-project] Calling method '.version_select at 0x7f9e24d7aaf0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:47.101093 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 610/1363] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:46 2022] GET /compute/v2.1/servers/a0c22e90-af12-4699-beb3-463ba9e81e65 => generated 1317 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:47.109988 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cdbe3a32-9c78-47d8-80ad-29e655323a90 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:47.116865 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-cdbe3a32-9c78-47d8-80ad-29e655323a90 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: ea2ef6ca-2623-496d-a174-1d7cbaf80f85] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:47.134844 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cdbe3a32-9c78-47d8-80ad-29e655323a90 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:47.135671 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cdbe3a32-9c78-47d8-80ad-29e655323a90 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:47.136413 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cdbe3a32-9c78-47d8-80ad-29e655323a90 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:47.138035 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cdbe3a32-9c78-47d8-80ad-29e655323a90 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:47.138673 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cdbe3a32-9c78-47d8-80ad-29e655323a90 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:47.139261 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cdbe3a32-9c78-47d8-80ad-29e655323a90 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:47.470803 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-cdbe3a32-9c78-47d8-80ad-29e655323a90 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f4a7231e4431c89712c557c4fa1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ac882e61ac45eb9abc60630e7337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:47.483672 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cdbe3a32-9c78-47d8-80ad-29e655323a90 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85" status: 200 len: 1523 microversion: 2.1 time: 0.381329 Aug 07 01:15:47.490145 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 611/1364] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:47 2022] GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85 => generated 1523 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:47.507012 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-614b90ef-67fe-4600-8e28-308c6ee55b7f tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:47.508052 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-614b90ef-67fe-4600-8e28-308c6ee55b7f tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] [instance: 91da23de-c338-4658-8620-831662a596b9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:47.591828 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-90fae587-96b8-4216-838d-186706e632c9 tempest-FloatingIPDetailsTestJSON-243814326 tempest-FloatingIPDetailsTestJSON-243814326-project] 10.222.0.39 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.506201 Aug 07 01:15:47.593127 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 754/1365] 10.222.0.39 () {58 vars in 1164 bytes} [Sun Aug 7 01:15:47 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:15:47.598146 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f180dbbe-aa2d-423f-a7d4-d1077039ebed tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:47.599553 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f180dbbe-aa2d-423f-a7d4-d1077039ebed tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:47.607317 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f180dbbe-aa2d-423f-a7d4-d1077039ebed tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:47.607799 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f180dbbe-aa2d-423f-a7d4-d1077039ebed tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:47.608262 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f180dbbe-aa2d-423f-a7d4-d1077039ebed tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:47.608965 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f180dbbe-aa2d-423f-a7d4-d1077039ebed tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:47.609717 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f180dbbe-aa2d-423f-a7d4-d1077039ebed tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:47.610137 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f180dbbe-aa2d-423f-a7d4-d1077039ebed tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:47.681174 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-614b90ef-67fe-4600-8e28-308c6ee55b7f tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065d8324da60445ea1e97e1dc892f183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1530b8294fc4dd4bc7e7b228ad2b95c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:47.718214 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-614b90ef-67fe-4600-8e28-308c6ee55b7f tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] 10.222.0.39 "GET /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9" status: 200 len: 1226 microversion: 2.1 time: 0.226650 Aug 07 01:15:47.719441 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 612/1366] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:47 2022] GET /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9 => generated 1226 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:47.740047 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-640dcc3b-383c-410c-919d-9072e07824ff req-efae9659-5584-459b-bd90-ef7e0ae6a72b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea2ef6ca-2623-496d-a174-1d7cbaf80f85", "name": "network-vif-deleted", "tag": "cf46b89b-456e-4233-b0d8-40780fd11074"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:15:47.754251 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-640dcc3b-383c-410c-919d-9072e07824ff req-efae9659-5584-459b-bd90-ef7e0ae6a72b service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:47.755313 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-640dcc3b-383c-410c-919d-9072e07824ff req-efae9659-5584-459b-bd90-ef7e0ae6a72b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:47.755810 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-640dcc3b-383c-410c-919d-9072e07824ff req-efae9659-5584-459b-bd90-ef7e0ae6a72b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:47.771226 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-640dcc3b-383c-410c-919d-9072e07824ff req-efae9659-5584-459b-bd90-ef7e0ae6a72b service nova] Creating event network-vif-deleted:cf46b89b-456e-4233-b0d8-40780fd11074 for instance ea2ef6ca-2623-496d-a174-1d7cbaf80f85 on n-h1-master-1 Aug 07 01:15:47.782183 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-640dcc3b-383c-410c-919d-9072e07824ff req-efae9659-5584-459b-bd90-ef7e0ae6a72b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060023 Aug 07 01:15:47.783379 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 613/1367] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:47.791586 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c697bbf0-df67-4ca4-ae18-8109c7dbeccb tempest-FloatingIPDetailsTestJSON-243814326 tempest-FloatingIPDetailsTestJSON-243814326-project] Calling method '.version_select at 0x7f9e24b521f0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:47.823714 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f180dbbe-aa2d-423f-a7d4-d1077039ebed tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:47.831565 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f180dbbe-aa2d-423f-a7d4-d1077039ebed tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1476 microversion: 2.1 time: 0.237333 Aug 07 01:15:47.832596 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 755/1368] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:47 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1476 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:48.008086 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4cf6b205-2171-4791-9f00-49c1edd8ce7d tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:48.008989 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4cf6b205-2171-4791-9f00-49c1edd8ce7d tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:48.012331 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:48.022889 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4cf6b205-2171-4791-9f00-49c1edd8ce7d tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:48.023382 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4cf6b205-2171-4791-9f00-49c1edd8ce7d tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:48.023814 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4cf6b205-2171-4791-9f00-49c1edd8ce7d tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:48.024622 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4cf6b205-2171-4791-9f00-49c1edd8ce7d tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:48.025002 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4cf6b205-2171-4791-9f00-49c1edd8ce7d tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:48.025423 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4cf6b205-2171-4791-9f00-49c1edd8ce7d tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:48.180595 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c697bbf0-df67-4ca4-ae18-8109c7dbeccb tempest-FloatingIPDetailsTestJSON-243814326 tempest-FloatingIPDetailsTestJSON-243814326-project] 10.222.0.39 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.395651 Aug 07 01:15:48.191706 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 614/1369] 10.222.0.39 () {58 vars in 1149 bytes} [Sun Aug 7 01:15:47 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:48.191706 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-378c70d4-a9a1-4561-9229-478dcb0ed5d5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:48.191706 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-378c70d4-a9a1-4561-9229-478dcb0ed5d5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: a0c22e90-af12-4699-beb3-463ba9e81e65] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:48.196025 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-378c70d4-a9a1-4561-9229-478dcb0ed5d5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:48.196534 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-378c70d4-a9a1-4561-9229-478dcb0ed5d5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:48.196980 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-378c70d4-a9a1-4561-9229-478dcb0ed5d5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:48.197713 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-378c70d4-a9a1-4561-9229-478dcb0ed5d5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:48.198180 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-378c70d4-a9a1-4561-9229-478dcb0ed5d5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:48.198612 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-378c70d4-a9a1-4561-9229-478dcb0ed5d5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:48.216991 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4cf6b205-2171-4791-9f00-49c1edd8ce7d tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:48.236486 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4cf6b205-2171-4791-9f00-49c1edd8ce7d tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1478 microversion: 2.1 time: 0.233276 Aug 07 01:15:48.239128 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 756/1370] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:48 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1478 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:15:48.249156 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-83728ce7-08fe-4c22-87f6-8dc0b12d4ffb tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:48.255795 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-83728ce7-08fe-4c22-87f6-8dc0b12d4ffb tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:48.264977 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83728ce7-08fe-4c22-87f6-8dc0b12d4ffb tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:48.265582 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83728ce7-08fe-4c22-87f6-8dc0b12d4ffb tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:48.266293 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83728ce7-08fe-4c22-87f6-8dc0b12d4ffb tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:48.268037 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83728ce7-08fe-4c22-87f6-8dc0b12d4ffb tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:48.270199 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83728ce7-08fe-4c22-87f6-8dc0b12d4ffb tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:48.271603 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83728ce7-08fe-4c22-87f6-8dc0b12d4ffb tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:48.338242 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-83728ce7-08fe-4c22-87f6-8dc0b12d4ffb tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096167 Aug 07 01:15:48.343468 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 757/1371] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:15:48 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:48.351387 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9363cc44-6a42-4909-8134-72c5bcde6737 tempest-FloatingIPDetailsTestJSON-243814326 tempest-FloatingIPDetailsTestJSON-243814326-project] Calling method '.version_select at 0x7f9e24cbb940>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:48.633696 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-378c70d4-a9a1-4561-9229-478dcb0ed5d5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:48.646909 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-378c70d4-a9a1-4561-9229-478dcb0ed5d5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/a0c22e90-af12-4699-beb3-463ba9e81e65" status: 200 len: 1466 microversion: 2.1 time: 0.463228 Aug 07 01:15:48.656601 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 615/1372] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:48 2022] GET /compute/v2.1/servers/a0c22e90-af12-4699-beb3-463ba9e81e65 => generated 1466 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:48.663102 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-018dd5fa-a6ef-4b21-8ab1-3f3c3a809377 req-a16d763d-bd14-44d5-93ec-0dc492fbfcc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "634a7ed6-84df-4292-bc38-5129fb0f57c9", "name": "network-vif-unplugged", "status": "completed", "tag": "93ab5068-1c0e-4ec2-bb1a-06cc1c07f96e"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:15:48.675729 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-018dd5fa-a6ef-4b21-8ab1-3f3c3a809377 req-a16d763d-bd14-44d5-93ec-0dc492fbfcc1 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:48.676576 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-018dd5fa-a6ef-4b21-8ab1-3f3c3a809377 req-a16d763d-bd14-44d5-93ec-0dc492fbfcc1 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:48.677280 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-018dd5fa-a6ef-4b21-8ab1-3f3c3a809377 req-a16d763d-bd14-44d5-93ec-0dc492fbfcc1 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:48.690713 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-018dd5fa-a6ef-4b21-8ab1-3f3c3a809377 req-a16d763d-bd14-44d5-93ec-0dc492fbfcc1 service nova] Creating event network-vif-unplugged:93ab5068-1c0e-4ec2-bb1a-06cc1c07f96e for instance 634a7ed6-84df-4292-bc38-5129fb0f57c9 on n-h2-master-1 Aug 07 01:15:48.699530 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [req-018dd5fa-a6ef-4b21-8ab1-3f3c3a809377 req-a16d763d-bd14-44d5-93ec-0dc492fbfcc1 service nova] Instance 634a7ed6-84df-4292-bc38-5129fb0f57c9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 01:15:48.714485 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-018dd5fa-a6ef-4b21-8ab1-3f3c3a809377 req-a16d763d-bd14-44d5-93ec-0dc492fbfcc1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056258 Aug 07 01:15:48.715787 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 616/1373] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:48.722334 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0105a356-afac-4d76-aa67-66e7ea4a87e4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:48.723553 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0105a356-afac-4d76-aa67-66e7ea4a87e4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: ea2ef6ca-2623-496d-a174-1d7cbaf80f85] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:48.735612 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0105a356-afac-4d76-aa67-66e7ea4a87e4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:48.736671 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0105a356-afac-4d76-aa67-66e7ea4a87e4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:48.737332 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0105a356-afac-4d76-aa67-66e7ea4a87e4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:48.738574 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0105a356-afac-4d76-aa67-66e7ea4a87e4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:48.739289 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0105a356-afac-4d76-aa67-66e7ea4a87e4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:48.739966 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0105a356-afac-4d76-aa67-66e7ea4a87e4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:48.856037 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0105a356-afac-4d76-aa67-66e7ea4a87e4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4f4a7231e4431c89712c557c4fa1df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45ac882e61ac45eb9abc60630e7337c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:48.878382 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0105a356-afac-4d76-aa67-66e7ea4a87e4 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85" status: 200 len: 1308 microversion: 2.1 time: 0.161083 Aug 07 01:15:48.880897 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 617/1374] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:48 2022] GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85 => generated 1308 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:48.888981 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-12ab6141-6118-46cc-b5a4-8860e36aa290 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:48.890153 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-12ab6141-6118-46cc-b5a4-8860e36aa290 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] [instance: a0c22e90-af12-4699-beb3-463ba9e81e65] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:48.906430 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12ab6141-6118-46cc-b5a4-8860e36aa290 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:48.907311 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12ab6141-6118-46cc-b5a4-8860e36aa290 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:48.908165 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12ab6141-6118-46cc-b5a4-8860e36aa290 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:48.909077 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12ab6141-6118-46cc-b5a4-8860e36aa290 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:48.909738 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12ab6141-6118-46cc-b5a4-8860e36aa290 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:48.910318 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12ab6141-6118-46cc-b5a4-8860e36aa290 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:49.263244 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-12ab6141-6118-46cc-b5a4-8860e36aa290 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/a0c22e90-af12-4699-beb3-463ba9e81e65" status: 200 len: 1617 microversion: 2.1 time: 0.380881 Aug 07 01:15:49.264061 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 618/1375] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:48 2022] GET /compute/v2.1/servers/a0c22e90-af12-4699-beb3-463ba9e81e65 => generated 1617 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:49.269602 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2ce58f36-ee12-4d62-9a07-fe77261afc4c tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:49.271182 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2ce58f36-ee12-4d62-9a07-fe77261afc4c tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] [instance: 91da23de-c338-4658-8620-831662a596b9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:49.292675 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2ce58f36-ee12-4d62-9a07-fe77261afc4c tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:49.293252 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2ce58f36-ee12-4d62-9a07-fe77261afc4c tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:49.294020 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2ce58f36-ee12-4d62-9a07-fe77261afc4c tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:49.294998 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2ce58f36-ee12-4d62-9a07-fe77261afc4c tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:49.295566 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2ce58f36-ee12-4d62-9a07-fe77261afc4c tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:49.296170 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2ce58f36-ee12-4d62-9a07-fe77261afc4c tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:49.471327 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2ce58f36-ee12-4d62-9a07-fe77261afc4c tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065d8324da60445ea1e97e1dc892f183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1530b8294fc4dd4bc7e7b228ad2b95c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:49.488048 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2ce58f36-ee12-4d62-9a07-fe77261afc4c tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] 10.222.0.39 "GET /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9" status: 200 len: 1284 microversion: 2.1 time: 0.222527 Aug 07 01:15:49.491243 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 619/1376] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:49 2022] GET /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9 => generated 1284 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:49.506091 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5f410e93-4616-4ef1-b00e-a9f65971790e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:49.508518 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5f410e93-4616-4ef1-b00e-a9f65971790e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:49.527275 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:49.533341 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f410e93-4616-4ef1-b00e-a9f65971790e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:49.533930 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f410e93-4616-4ef1-b00e-a9f65971790e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:49.536454 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f410e93-4616-4ef1-b00e-a9f65971790e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:49.537400 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f410e93-4616-4ef1-b00e-a9f65971790e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:49.540301 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f410e93-4616-4ef1-b00e-a9f65971790e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:49.541329 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f410e93-4616-4ef1-b00e-a9f65971790e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:49.563203 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9363cc44-6a42-4909-8134-72c5bcde6737 tempest-FloatingIPDetailsTestJSON-243814326 tempest-FloatingIPDetailsTestJSON-243814326-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/9c32e934-7204-4e53-89b7-9fd124654d65" status: 202 len: 0 microversion: 2.1 time: 1.216989 Aug 07 01:15:49.563987 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 758/1377] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Aug 7 01:15:48 2022] DELETE /compute/v2.1/os-floating-ips/9c32e934-7204-4e53-89b7-9fd124654d65 => generated 0 bytes in 1218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:15:49.573841 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ef381acc-63cb-481c-aa5e-705f4598e31a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:49.574702 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ef381acc-63cb-481c-aa5e-705f4598e31a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:49.612049 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef381acc-63cb-481c-aa5e-705f4598e31a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:49.612968 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef381acc-63cb-481c-aa5e-705f4598e31a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:49.613591 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef381acc-63cb-481c-aa5e-705f4598e31a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:49.638436 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef381acc-63cb-481c-aa5e-705f4598e31a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:49.639403 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef381acc-63cb-481c-aa5e-705f4598e31a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:49.640152 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef381acc-63cb-481c-aa5e-705f4598e31a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:49.884450 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ef381acc-63cb-481c-aa5e-705f4598e31a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:49.897892 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ef381acc-63cb-481c-aa5e-705f4598e31a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1478 microversion: 2.1 time: 0.328019 Aug 07 01:15:49.899694 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 759/1378] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:49 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1478 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:49.916875 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9bd7b9d7-c6fc-42f2-90c6-ee2d90142305 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:49.920433 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9bd7b9d7-c6fc-42f2-90c6-ee2d90142305 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:49.928477 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9bd7b9d7-c6fc-42f2-90c6-ee2d90142305 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:49.929335 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9bd7b9d7-c6fc-42f2-90c6-ee2d90142305 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:49.930006 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9bd7b9d7-c6fc-42f2-90c6-ee2d90142305 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:49.930982 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9bd7b9d7-c6fc-42f2-90c6-ee2d90142305 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:49.931916 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9bd7b9d7-c6fc-42f2-90c6-ee2d90142305 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:49.932691 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9bd7b9d7-c6fc-42f2-90c6-ee2d90142305 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:49.987522 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9bd7b9d7-c6fc-42f2-90c6-ee2d90142305 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084576 Aug 07 01:15:49.988724 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 760/1379] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:15:49 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:49.995016 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-05d51ef6-e77e-45e0-99b7-9afd2fe8e4e8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-369027632", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "8511418d-b773-43fd-adc1-bc8862f82015"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:15:50.067273 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-05d51ef6-e77e-45e0-99b7-9afd2fe8e4e8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] validate_networks() for None {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:15:50.275212 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:50.301980 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5f410e93-4616-4ef1-b00e-a9f65971790e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:50.316429 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5f410e93-4616-4ef1-b00e-a9f65971790e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1476 microversion: 2.1 time: 0.822636 Aug 07 01:15:50.325070 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 620/1380] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:49 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1476 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:50.339139 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-287a3a19-054c-4c5a-b057-fe7a5d9d04b7 tempest-FloatingIPDetailsTestJSON-243814326 tempest-FloatingIPDetailsTestJSON-243814326-project] Calling method '.version_select at 0x7f9e2543c4c0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:50.498594 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-05d51ef6-e77e-45e0-99b7-9afd2fe8e4e8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:15:50.499231 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-05d51ef6-e77e-45e0-99b7-9afd2fe8e4e8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:15:50.500046 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-05d51ef6-e77e-45e0-99b7-9afd2fe8e4e8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:15:50.500560 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-05d51ef6-e77e-45e0-99b7-9afd2fe8e4e8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:15:50.502492 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-05d51ef6-e77e-45e0-99b7-9afd2fe8e4e8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:15:50.516039 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05d51ef6-e77e-45e0-99b7-9afd2fe8e4e8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:50.516982 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05d51ef6-e77e-45e0-99b7-9afd2fe8e4e8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:50.517596 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05d51ef6-e77e-45e0-99b7-9afd2fe8e4e8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:50.518764 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05d51ef6-e77e-45e0-99b7-9afd2fe8e4e8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:50.519378 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05d51ef6-e77e-45e0-99b7-9afd2fe8e4e8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:50.519810 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05d51ef6-e77e-45e0-99b7-9afd2fe8e4e8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:50.541437 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-05d51ef6-e77e-45e0-99b7-9afd2fe8e4e8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Getting quotas for project d08d010c14a64f759887be0d2364c6e4. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:15:50.549244 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-05d51ef6-e77e-45e0-99b7-9afd2fe8e4e8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Getting quotas for user 32fc1959d8aa41eabcead217b9d7bc47 and project d08d010c14a64f759887be0d2364c6e4. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:15:50.562086 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-05d51ef6-e77e-45e0-99b7-9afd2fe8e4e8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:15:50.565276 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-05d51ef6-e77e-45e0-99b7-9afd2fe8e4e8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 0890f070-088c-4cc8-96ec-e3b5cbe33a29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:15:50.621845 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-05d51ef6-e77e-45e0-99b7-9afd2fe8e4e8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.631719 Aug 07 01:15:50.628490 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 761/1381] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:15:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:15:50.628490 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-935d19d5-0a8d-480c-8e49-34493936d4e3 req-98c085b9-ffa0-477a-bc21-51878145f482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "766de05a-a562-4045-bdf9-c49050382e1a", "name": "network-vif-unplugged", "status": "completed", "tag": "a4899c9a-669a-4c98-bfc8-6b6f7b2c3f93"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:15:50.639348 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-935d19d5-0a8d-480c-8e49-34493936d4e3 req-98c085b9-ffa0-477a-bc21-51878145f482 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:50.640553 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-935d19d5-0a8d-480c-8e49-34493936d4e3 req-98c085b9-ffa0-477a-bc21-51878145f482 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:50.641820 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-935d19d5-0a8d-480c-8e49-34493936d4e3 req-98c085b9-ffa0-477a-bc21-51878145f482 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:50.657747 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-935d19d5-0a8d-480c-8e49-34493936d4e3 req-98c085b9-ffa0-477a-bc21-51878145f482 service nova] Creating event network-vif-unplugged:a4899c9a-669a-4c98-bfc8-6b6f7b2c3f93 for instance 766de05a-a562-4045-bdf9-c49050382e1a on n-h1-master-1 Aug 07 01:15:50.669653 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-935d19d5-0a8d-480c-8e49-34493936d4e3 req-98c085b9-ffa0-477a-bc21-51878145f482 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045215 Aug 07 01:15:50.670807 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 762/1382] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:50.682733 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e665234e-81df-4ef4-960c-27a1b53e5c95 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:50.684011 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e665234e-81df-4ef4-960c-27a1b53e5c95 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] [instance: ea2ef6ca-2623-496d-a174-1d7cbaf80f85] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:50.692995 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e665234e-81df-4ef4-960c-27a1b53e5c95 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:50.693619 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e665234e-81df-4ef4-960c-27a1b53e5c95 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:50.694173 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e665234e-81df-4ef4-960c-27a1b53e5c95 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:50.695161 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e665234e-81df-4ef4-960c-27a1b53e5c95 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:50.695691 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e665234e-81df-4ef4-960c-27a1b53e5c95 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:50.696395 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e665234e-81df-4ef4-960c-27a1b53e5c95 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:50.717733 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-e665234e-81df-4ef4-960c-27a1b53e5c95 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] HTTP exception thrown: Instance ea2ef6ca-2623-496d-a174-1d7cbaf80f85 could not be found. Aug 07 01:15:50.721164 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e665234e-81df-4ef4-960c-27a1b53e5c95 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Request method failure captured: Aug 07 01:15:50.721164 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85 HTTP/1.1 Aug 07 01:15:50.721164 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:15:50.721164 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:15:50.721164 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:15:50.721164 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:15:50.721164 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:15:50.721164 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:15:50.721164 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:15:50.721164 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:15:50.721164 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xH_7heYCkV2-y0pNneGN4ZnDqbs4UmpJQTmK5saNuk5H0WyhR4p8FKNrWGv5t9UmFTbjW-ntOaSKUHzjZAArTCL_7x2Uwa1lfuWNi0MRrWbfTOLIoXB6XEN1mRKk4FXNp_uEqv_bhxSKtjhZMsFP1MHgSM_FhzIX5Da4H4U1Rw8NW4 Aug 07 01:15:50.721164 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:15:50.721164 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:15:50.721164 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:15:50.721164 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:15:50.721164 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:15:50.721164 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:15:50.721164 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 45ac882e61ac45eb9abc60630e7337c3 Aug 07 01:15:50.721164 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ListServersNegativeTestJSON-938780471 Aug 07 01:15:50.721164 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:15:50.721164 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:15:50.722994 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/45ac882e61ac45eb9abc60630e7337c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_45ac882e61ac45eb9abc60630e7337c3", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/45ac882e61ac45eb9abc60630e7337c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/45ac882e61ac45eb9abc60630e7337c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:15:50.722994 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ListServersNegativeTestJSON-938780471 Aug 07 01:15:50.722994 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 45ac882e61ac45eb9abc60630e7337c3 Aug 07 01:15:50.722994 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-938780471 Aug 07 01:15:50.722994 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ListServersNegativeTestJSON-938780471-project Aug 07 01:15:50.722994 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:15:50.722994 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:15:50.722994 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: ae4f4a7231e4431c89712c557c4fa1df Aug 07 01:15:50.722994 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ListServersNegativeTestJSON-938780471-project Aug 07 01:15:50.722994 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:15:50.722994 n-d-master-1 devstack@n-api.service[119516]: exception: Instance ea2ef6ca-2623-496d-a174-1d7cbaf80f85 could not be found. Aug 07 01:15:50.722994 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'ea2ef6ca-2623-496d-a174-1d7cbaf80f85'} Aug 07 01:15:50.724366 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:15:50.724366 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:50.724366 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:15:50.724366 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:15:50.724366 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:15:50.724366 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:15:50.724366 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:15:50.724366 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:15:50.724366 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:15:50.724366 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:15:50.724366 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea2ef6ca-2623-496d-a174-1d7cbaf80f85 could not be found. Aug 07 01:15:50.724366 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:50.724366 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:15:50.724366 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:50.724366 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:50.724366 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:15:50.724366 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:15:50.724366 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:15:50.724366 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:15:50.724366 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:15:50.725819 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:15:50.725819 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:15:50.725819 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:15:50.725819 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:15:50.725819 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:15:50.725819 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:15:50.725819 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:15:50.725819 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea2ef6ca-2623-496d-a174-1d7cbaf80f85 could not be found. Aug 07 01:15:50.725819 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:50.725819 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:15:50.725819 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:50.725819 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:15:50.725819 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:15:50.725819 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:15:50.725819 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:15:50.725819 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:15:50.725819 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea2ef6ca-2623-496d-a174-1d7cbaf80f85 could not be found. Aug 07 01:15:50.725819 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:15:50.728959 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e665234e-81df-4ef4-960c-27a1b53e5c95 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] Returning 404 to user: Instance ea2ef6ca-2623-496d-a174-1d7cbaf80f85 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:15:50.730260 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e665234e-81df-4ef4-960c-27a1b53e5c95 tempest-ListServersNegativeTestJSON-938780471 tempest-ListServersNegativeTestJSON-938780471-project] 10.222.0.39 "GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85" status: 404 len: 111 microversion: 2.1 time: 0.058025 Aug 07 01:15:50.731233 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 763/1383] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:50 2022] GET /compute/v2.1/servers/ea2ef6ca-2623-496d-a174-1d7cbaf80f85 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:15:50.736965 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-edf78929-e1ce-4272-89ca-1be15870d9c7 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:50.737993 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-edf78929-e1ce-4272-89ca-1be15870d9c7 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] [instance: 91da23de-c338-4658-8620-831662a596b9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:50.747195 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-edf78929-e1ce-4272-89ca-1be15870d9c7 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:50.748157 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-edf78929-e1ce-4272-89ca-1be15870d9c7 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:50.748981 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-edf78929-e1ce-4272-89ca-1be15870d9c7 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:50.750304 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-edf78929-e1ce-4272-89ca-1be15870d9c7 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:50.751004 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-edf78929-e1ce-4272-89ca-1be15870d9c7 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:50.751834 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-edf78929-e1ce-4272-89ca-1be15870d9c7 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:50.979941 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-edf78929-e1ce-4272-89ca-1be15870d9c7 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065d8324da60445ea1e97e1dc892f183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1530b8294fc4dd4bc7e7b228ad2b95c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:50.990145 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-edf78929-e1ce-4272-89ca-1be15870d9c7 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] 10.222.0.39 "GET /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9" status: 200 len: 1284 microversion: 2.1 time: 0.257559 Aug 07 01:15:51.014510 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 764/1384] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:50 2022] GET /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9 => generated 1284 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:51.022642 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8432c7d6-4d14-4d05-a67d-60f595e031b1 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:51.027074 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8432c7d6-4d14-4d05-a67d-60f595e031b1 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 0890f070-088c-4cc8-96ec-e3b5cbe33a29] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:51.054344 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:51.750592 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8432c7d6-4d14-4d05-a67d-60f595e031b1 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:51.767091 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8432c7d6-4d14-4d05-a67d-60f595e031b1 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29" status: 200 len: 1216 microversion: 2.1 time: 0.749310 Aug 07 01:15:51.785269 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 765/1385] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:51 2022] GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29 => generated 1216 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:51.791592 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c61a76ff-9fda-4454-a8d8-b96d78924232 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:51.792512 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c61a76ff-9fda-4454-a8d8-b96d78924232 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:51.800022 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c61a76ff-9fda-4454-a8d8-b96d78924232 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:51.800805 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c61a76ff-9fda-4454-a8d8-b96d78924232 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:51.801800 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c61a76ff-9fda-4454-a8d8-b96d78924232 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:51.802021 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c61a76ff-9fda-4454-a8d8-b96d78924232 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:51.803008 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c61a76ff-9fda-4454-a8d8-b96d78924232 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:51.803118 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c61a76ff-9fda-4454-a8d8-b96d78924232 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:52.107524 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c61a76ff-9fda-4454-a8d8-b96d78924232 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:52.122062 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c61a76ff-9fda-4454-a8d8-b96d78924232 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1478 microversion: 2.1 time: 0.334569 Aug 07 01:15:52.123250 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 766/1386] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:51 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1478 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:52.129822 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-80afa601-eb9f-460b-b716-220324a3940e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:52.133425 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-80afa601-eb9f-460b-b716-220324a3940e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:52.145122 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80afa601-eb9f-460b-b716-220324a3940e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:52.147123 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80afa601-eb9f-460b-b716-220324a3940e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:52.148003 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80afa601-eb9f-460b-b716-220324a3940e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:52.148887 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80afa601-eb9f-460b-b716-220324a3940e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:52.150152 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80afa601-eb9f-460b-b716-220324a3940e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:52.150838 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80afa601-eb9f-460b-b716-220324a3940e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:52.202528 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-80afa601-eb9f-460b-b716-220324a3940e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076362 Aug 07 01:15:52.204291 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 767/1387] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:15:52 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:52.212347 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-24e95463-c123-4516-8ade-0172b7231d89 req-d63402d6-ff18-49c0-bc5a-3245e98ad5ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "634a7ed6-84df-4292-bc38-5129fb0f57c9", "tag": "93ab5068-1c0e-4ec2-bb1a-06cc1c07f96e"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:15:52.227790 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-24e95463-c123-4516-8ade-0172b7231d89 req-d63402d6-ff18-49c0-bc5a-3245e98ad5ba service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:52.228576 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-24e95463-c123-4516-8ade-0172b7231d89 req-d63402d6-ff18-49c0-bc5a-3245e98ad5ba service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:52.229551 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-24e95463-c123-4516-8ade-0172b7231d89 req-d63402d6-ff18-49c0-bc5a-3245e98ad5ba service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:52.285393 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-24e95463-c123-4516-8ade-0172b7231d89 req-d63402d6-ff18-49c0-bc5a-3245e98ad5ba service nova] Creating event network-changed:93ab5068-1c0e-4ec2-bb1a-06cc1c07f96e for instance 634a7ed6-84df-4292-bc38-5129fb0f57c9 on n-h2-master-1 Aug 07 01:15:52.303223 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [req-24e95463-c123-4516-8ade-0172b7231d89 req-d63402d6-ff18-49c0-bc5a-3245e98ad5ba service nova] Instance 634a7ed6-84df-4292-bc38-5129fb0f57c9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 01:15:52.347791 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-24e95463-c123-4516-8ade-0172b7231d89 req-d63402d6-ff18-49c0-bc5a-3245e98ad5ba service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141944 Aug 07 01:15:52.354580 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 768/1388] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:52.378210 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7b49e026-8ecc-4c0d-a023-acaaf037692e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:52.381166 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7b49e026-8ecc-4c0d-a023-acaaf037692e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:52.396975 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b49e026-8ecc-4c0d-a023-acaaf037692e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:52.402145 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b49e026-8ecc-4c0d-a023-acaaf037692e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:52.403252 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b49e026-8ecc-4c0d-a023-acaaf037692e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:52.404781 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b49e026-8ecc-4c0d-a023-acaaf037692e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:52.405267 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b49e026-8ecc-4c0d-a023-acaaf037692e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:52.405711 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b49e026-8ecc-4c0d-a023-acaaf037692e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:53.041943 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-287a3a19-054c-4c5a-b057-fe7a5d9d04b7 tempest-FloatingIPDetailsTestJSON-243814326 tempest-FloatingIPDetailsTestJSON-243814326-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/aca9d31f-7831-4437-9335-fc3fef2a01bb" status: 202 len: 0 microversion: 2.1 time: 2.714610 Aug 07 01:15:53.043046 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 621/1389] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Aug 7 01:15:50 2022] DELETE /compute/v2.1/os-floating-ips/aca9d31f-7831-4437-9335-fc3fef2a01bb => generated 0 bytes in 2717 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:15:53.050419 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5b164f2d-b182-4e50-9443-62b743fb9fd5 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:53.051544 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5b164f2d-b182-4e50-9443-62b743fb9fd5 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] [instance: 91da23de-c338-4658-8620-831662a596b9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:53.068950 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5b164f2d-b182-4e50-9443-62b743fb9fd5 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:53.069848 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5b164f2d-b182-4e50-9443-62b743fb9fd5 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:53.070788 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5b164f2d-b182-4e50-9443-62b743fb9fd5 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:53.073441 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5b164f2d-b182-4e50-9443-62b743fb9fd5 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:53.074909 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5b164f2d-b182-4e50-9443-62b743fb9fd5 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:53.077057 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5b164f2d-b182-4e50-9443-62b743fb9fd5 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:53.134032 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7b49e026-8ecc-4c0d-a023-acaaf037692e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:53.154183 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7b49e026-8ecc-4c0d-a023-acaaf037692e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1474 microversion: 2.1 time: 0.798181 Aug 07 01:15:53.155196 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 769/1390] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:52 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1474 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:53.174364 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-449da5d7-b229-4584-b968-6bf06bf7510d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:53.175385 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-449da5d7-b229-4584-b968-6bf06bf7510d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 0890f070-088c-4cc8-96ec-e3b5cbe33a29] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:53.184043 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-449da5d7-b229-4584-b968-6bf06bf7510d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:53.185004 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-449da5d7-b229-4584-b968-6bf06bf7510d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:53.185850 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-449da5d7-b229-4584-b968-6bf06bf7510d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:53.187122 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-449da5d7-b229-4584-b968-6bf06bf7510d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:53.188032 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-449da5d7-b229-4584-b968-6bf06bf7510d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:53.188714 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-449da5d7-b229-4584-b968-6bf06bf7510d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:53.203842 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:53.377704 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-449da5d7-b229-4584-b968-6bf06bf7510d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:53.392480 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-449da5d7-b229-4584-b968-6bf06bf7510d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29" status: 200 len: 1274 microversion: 2.1 time: 0.230065 Aug 07 01:15:53.394110 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 770/1391] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:53 2022] GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29 => generated 1274 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:53.425608 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2bc876d7-59cc-4b92-95f5-59e94575e471 tempest-FloatingIPDetailsTestJSON-243814326 tempest-FloatingIPDetailsTestJSON-243814326-project] Calling method '.version_select at 0x7f9e248f3ee0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:53.668834 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5b164f2d-b182-4e50-9443-62b743fb9fd5 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065d8324da60445ea1e97e1dc892f183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1530b8294fc4dd4bc7e7b228ad2b95c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:53.684854 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5b164f2d-b182-4e50-9443-62b743fb9fd5 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] 10.222.0.39 "GET /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9" status: 200 len: 1352 microversion: 2.1 time: 0.639578 Aug 07 01:15:53.685518 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 622/1392] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:53 2022] GET /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9 => generated 1352 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:53.695182 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-10005e1b-78d3-40e8-8c45-979053a53000 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:53.710945 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-10005e1b-78d3-40e8-8c45-979053a53000 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:53.719380 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10005e1b-78d3-40e8-8c45-979053a53000 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:53.721381 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10005e1b-78d3-40e8-8c45-979053a53000 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:53.722062 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10005e1b-78d3-40e8-8c45-979053a53000 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:53.723036 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10005e1b-78d3-40e8-8c45-979053a53000 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:53.724231 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10005e1b-78d3-40e8-8c45-979053a53000 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:53.729671 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10005e1b-78d3-40e8-8c45-979053a53000 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:54.309774 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-10005e1b-78d3-40e8-8c45-979053a53000 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:54.321548 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-10005e1b-78d3-40e8-8c45-979053a53000 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1478 microversion: 2.1 time: 0.634916 Aug 07 01:15:54.323788 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 623/1393] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:53 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1478 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:54.330371 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ea3f020b-63f0-4e3e-98a8-3faef5cff53e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:54.335055 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ea3f020b-63f0-4e3e-98a8-3faef5cff53e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:54.344564 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ea3f020b-63f0-4e3e-98a8-3faef5cff53e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:54.345406 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ea3f020b-63f0-4e3e-98a8-3faef5cff53e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:54.346022 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ea3f020b-63f0-4e3e-98a8-3faef5cff53e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:54.347142 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ea3f020b-63f0-4e3e-98a8-3faef5cff53e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:54.348054 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ea3f020b-63f0-4e3e-98a8-3faef5cff53e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:54.349465 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ea3f020b-63f0-4e3e-98a8-3faef5cff53e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:54.402341 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:54.410470 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ea3f020b-63f0-4e3e-98a8-3faef5cff53e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085272 Aug 07 01:15:54.411528 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 624/1394] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:15:54 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:54.416641 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-de896da1-baa8-496d-b5a3-63956979fb36 req-b11f5314-117e-4238-9c47-33cb426bbfc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "766de05a-a562-4045-bdf9-c49050382e1a", "name": "network-vif-plugged", "status": "completed", "tag": "a4899c9a-669a-4c98-bfc8-6b6f7b2c3f93"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:15:54.431762 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-de896da1-baa8-496d-b5a3-63956979fb36 req-b11f5314-117e-4238-9c47-33cb426bbfc4 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:54.432848 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-de896da1-baa8-496d-b5a3-63956979fb36 req-b11f5314-117e-4238-9c47-33cb426bbfc4 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:54.434269 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-de896da1-baa8-496d-b5a3-63956979fb36 req-b11f5314-117e-4238-9c47-33cb426bbfc4 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:54.452611 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-de896da1-baa8-496d-b5a3-63956979fb36 req-b11f5314-117e-4238-9c47-33cb426bbfc4 service nova] Creating event network-vif-plugged:a4899c9a-669a-4c98-bfc8-6b6f7b2c3f93 for instance 766de05a-a562-4045-bdf9-c49050382e1a on n-h1-master-1 Aug 07 01:15:54.461724 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-de896da1-baa8-496d-b5a3-63956979fb36 req-b11f5314-117e-4238-9c47-33cb426bbfc4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048428 Aug 07 01:15:54.464491 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 625/1395] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:54.477041 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5427f7c6-9cf3-4e13-83bf-410dcd79dc18 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:54.478250 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5427f7c6-9cf3-4e13-83bf-410dcd79dc18 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:54.487378 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5427f7c6-9cf3-4e13-83bf-410dcd79dc18 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:54.488234 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5427f7c6-9cf3-4e13-83bf-410dcd79dc18 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:54.488948 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5427f7c6-9cf3-4e13-83bf-410dcd79dc18 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:54.490164 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5427f7c6-9cf3-4e13-83bf-410dcd79dc18 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:54.490801 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5427f7c6-9cf3-4e13-83bf-410dcd79dc18 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:54.491708 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5427f7c6-9cf3-4e13-83bf-410dcd79dc18 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:55.026743 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5427f7c6-9cf3-4e13-83bf-410dcd79dc18 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:55.044902 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5427f7c6-9cf3-4e13-83bf-410dcd79dc18 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1471 microversion: 2.1 time: 0.577928 Aug 07 01:15:55.045859 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 626/1396] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:54 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1471 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:55.063338 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4689a2d8-c7d4-4c88-96f1-b471267bb986 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:55.064728 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4689a2d8-c7d4-4c88-96f1-b471267bb986 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 0890f070-088c-4cc8-96ec-e3b5cbe33a29] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:55.080239 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4689a2d8-c7d4-4c88-96f1-b471267bb986 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:55.081182 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4689a2d8-c7d4-4c88-96f1-b471267bb986 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:55.081866 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4689a2d8-c7d4-4c88-96f1-b471267bb986 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:55.083398 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4689a2d8-c7d4-4c88-96f1-b471267bb986 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:55.084138 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4689a2d8-c7d4-4c88-96f1-b471267bb986 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:55.084786 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4689a2d8-c7d4-4c88-96f1-b471267bb986 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:55.319772 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4689a2d8-c7d4-4c88-96f1-b471267bb986 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:55.332219 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4689a2d8-c7d4-4c88-96f1-b471267bb986 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29" status: 200 len: 1274 microversion: 2.1 time: 0.284987 Aug 07 01:15:55.337038 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 627/1397] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:55 2022] GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29 => generated 1274 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:55.348762 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-cece5c5a-a8ff-455e-ba1d-5ec94cc803b6 req-9981f878-bc3c-4d2e-9d01-1bb455953cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91da23de-c338-4658-8620-831662a596b9", "tag": "99794d9c-3897-4d04-8ca2-58aae35eb7f7"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:15:55.387694 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-cece5c5a-a8ff-455e-ba1d-5ec94cc803b6 req-9981f878-bc3c-4d2e-9d01-1bb455953cf7 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:55.388609 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-cece5c5a-a8ff-455e-ba1d-5ec94cc803b6 req-9981f878-bc3c-4d2e-9d01-1bb455953cf7 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:55.390621 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-cece5c5a-a8ff-455e-ba1d-5ec94cc803b6 req-9981f878-bc3c-4d2e-9d01-1bb455953cf7 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:55.447293 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-cece5c5a-a8ff-455e-ba1d-5ec94cc803b6 req-9981f878-bc3c-4d2e-9d01-1bb455953cf7 service nova] Creating event network-changed:99794d9c-3897-4d04-8ca2-58aae35eb7f7 for instance 91da23de-c338-4658-8620-831662a596b9 on n-h2-master-1 Aug 07 01:15:55.466373 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-cece5c5a-a8ff-455e-ba1d-5ec94cc803b6 req-9981f878-bc3c-4d2e-9d01-1bb455953cf7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127047 Aug 07 01:15:55.469406 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 628/1398] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:55.491339 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-59272974-bc10-4003-812e-02c171f8f65b tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:55.492820 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-59272974-bc10-4003-812e-02c171f8f65b tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] [instance: 91da23de-c338-4658-8620-831662a596b9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:55.517625 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59272974-bc10-4003-812e-02c171f8f65b tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:55.520451 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59272974-bc10-4003-812e-02c171f8f65b tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:55.520907 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59272974-bc10-4003-812e-02c171f8f65b tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:55.521764 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59272974-bc10-4003-812e-02c171f8f65b tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:55.524611 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59272974-bc10-4003-812e-02c171f8f65b tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:55.525070 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59272974-bc10-4003-812e-02c171f8f65b tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:55.700358 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2bc876d7-59cc-4b92-95f5-59e94575e471 tempest-FloatingIPDetailsTestJSON-243814326 tempest-FloatingIPDetailsTestJSON-243814326-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/c3072f17-5843-4217-94d1-debe81042e51" status: 202 len: 0 microversion: 2.1 time: 2.304499 Aug 07 01:15:55.707938 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 771/1399] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Aug 7 01:15:53 2022] DELETE /compute/v2.1/os-floating-ips/c3072f17-5843-4217-94d1-debe81042e51 => generated 0 bytes in 2313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:15:55.734387 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-614152a5-e814-4228-8b74-5f4202f1c9e9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:15:55.736780 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-614152a5-e814-4228-8b74-5f4202f1c9e9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:55.768628 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-614152a5-e814-4228-8b74-5f4202f1c9e9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:55.769859 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-614152a5-e814-4228-8b74-5f4202f1c9e9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:55.770935 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-614152a5-e814-4228-8b74-5f4202f1c9e9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:55.772966 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-614152a5-e814-4228-8b74-5f4202f1c9e9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:55.774101 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-614152a5-e814-4228-8b74-5f4202f1c9e9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:55.775235 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-614152a5-e814-4228-8b74-5f4202f1c9e9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:56.017453 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-614152a5-e814-4228-8b74-5f4202f1c9e9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "POST /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9/action" status: 204 len: 0 microversion: 2.1 time: 0.282352 Aug 07 01:15:56.024386 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 772/1400] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:15:55 2022] POST /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9/action => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:15:56.046350 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-eb021a64-21eb-4bf9-9b10-500cfa206422 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:56.048641 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-eb021a64-21eb-4bf9-9b10-500cfa206422 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:56.076321 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb021a64-21eb-4bf9-9b10-500cfa206422 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:56.078253 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb021a64-21eb-4bf9-9b10-500cfa206422 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:56.080312 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb021a64-21eb-4bf9-9b10-500cfa206422 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:56.080976 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb021a64-21eb-4bf9-9b10-500cfa206422 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:56.083659 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb021a64-21eb-4bf9-9b10-500cfa206422 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:56.084248 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb021a64-21eb-4bf9-9b10-500cfa206422 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:56.269090 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-59272974-bc10-4003-812e-02c171f8f65b tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065d8324da60445ea1e97e1dc892f183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1530b8294fc4dd4bc7e7b228ad2b95c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:56.289142 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-59272974-bc10-4003-812e-02c171f8f65b tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] 10.222.0.39 "GET /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9" status: 200 len: 1352 microversion: 2.1 time: 0.817310 Aug 07 01:15:56.292064 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 629/1401] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:55 2022] GET /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9 => generated 1352 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:56.303171 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e735e416-61fd-4747-a62f-49191be69516 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:56.310233 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e735e416-61fd-4747-a62f-49191be69516 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:56.324754 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e735e416-61fd-4747-a62f-49191be69516 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:56.327972 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e735e416-61fd-4747-a62f-49191be69516 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:56.329993 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e735e416-61fd-4747-a62f-49191be69516 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:56.331180 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e735e416-61fd-4747-a62f-49191be69516 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:56.343049 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e735e416-61fd-4747-a62f-49191be69516 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:56.343920 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e735e416-61fd-4747-a62f-49191be69516 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:56.412584 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e735e416-61fd-4747-a62f-49191be69516 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.118933 Aug 07 01:15:56.418331 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 630/1402] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:15:56 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e/os-volume_attachments => generated 25 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:15:56.447349 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e7acc51d-1d0b-4cfc-93d9-573780bc659c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:56.451914 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e7acc51d-1d0b-4cfc-93d9-573780bc659c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:56.483737 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7acc51d-1d0b-4cfc-93d9-573780bc659c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:56.484565 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7acc51d-1d0b-4cfc-93d9-573780bc659c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:56.485263 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7acc51d-1d0b-4cfc-93d9-573780bc659c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:56.486256 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7acc51d-1d0b-4cfc-93d9-573780bc659c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:56.489585 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7acc51d-1d0b-4cfc-93d9-573780bc659c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:56.490363 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7acc51d-1d0b-4cfc-93d9-573780bc659c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:56.638787 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:57.393363 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-eb021a64-21eb-4bf9-9b10-500cfa206422 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:57.412539 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-eb021a64-21eb-4bf9-9b10-500cfa206422 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1478 microversion: 2.1 time: 1.386073 Aug 07 01:15:57.413132 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 773/1403] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:56 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1478 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:57.424351 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f4c2284a-e7f7-49a2-a064-cb438b41914b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:57.425225 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f4c2284a-e7f7-49a2-a064-cb438b41914b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 0890f070-088c-4cc8-96ec-e3b5cbe33a29] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:57.443945 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f4c2284a-e7f7-49a2-a064-cb438b41914b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:57.444555 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f4c2284a-e7f7-49a2-a064-cb438b41914b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:57.445037 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f4c2284a-e7f7-49a2-a064-cb438b41914b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:57.445737 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f4c2284a-e7f7-49a2-a064-cb438b41914b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:57.446199 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f4c2284a-e7f7-49a2-a064-cb438b41914b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:57.446633 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f4c2284a-e7f7-49a2-a064-cb438b41914b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:57.493530 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e7acc51d-1d0b-4cfc-93d9-573780bc659c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:57.510434 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e7acc51d-1d0b-4cfc-93d9-573780bc659c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1471 microversion: 2.1 time: 1.089953 Aug 07 01:15:57.511541 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 631/1404] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:56 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1471 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:57.527728 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c3deda79-f237-487f-aa8a-f70a988ab9a7 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:57.529315 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c3deda79-f237-487f-aa8a-f70a988ab9a7 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] [instance: 91da23de-c338-4658-8620-831662a596b9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:57.546381 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3deda79-f237-487f-aa8a-f70a988ab9a7 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:57.548343 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3deda79-f237-487f-aa8a-f70a988ab9a7 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:57.549408 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3deda79-f237-487f-aa8a-f70a988ab9a7 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:57.549643 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3deda79-f237-487f-aa8a-f70a988ab9a7 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:57.550741 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3deda79-f237-487f-aa8a-f70a988ab9a7 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:57.551235 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3deda79-f237-487f-aa8a-f70a988ab9a7 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:57.717483 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=12 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:58.012851 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f4c2284a-e7f7-49a2-a064-cb438b41914b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:58.030569 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f4c2284a-e7f7-49a2-a064-cb438b41914b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29" status: 200 len: 1316 microversion: 2.1 time: 0.610562 Aug 07 01:15:58.035094 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 774/1405] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:57 2022] GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29 => generated 1316 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:58.052383 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-3da7ab01-3a5b-4b35-9cc6-0877664afe47 req-133dd13a-5cad-4398-8e6c-0f5cdce6e18b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "634a7ed6-84df-4292-bc38-5129fb0f57c9", "name": "network-vif-plugged", "status": "completed", "tag": "93ab5068-1c0e-4ec2-bb1a-06cc1c07f96e"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:15:58.099452 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3da7ab01-3a5b-4b35-9cc6-0877664afe47 req-133dd13a-5cad-4398-8e6c-0f5cdce6e18b service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:58.106559 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3da7ab01-3a5b-4b35-9cc6-0877664afe47 req-133dd13a-5cad-4398-8e6c-0f5cdce6e18b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:58.107276 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3da7ab01-3a5b-4b35-9cc6-0877664afe47 req-133dd13a-5cad-4398-8e6c-0f5cdce6e18b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:58.147362 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-3da7ab01-3a5b-4b35-9cc6-0877664afe47 req-133dd13a-5cad-4398-8e6c-0f5cdce6e18b service nova] Creating event network-vif-plugged:93ab5068-1c0e-4ec2-bb1a-06cc1c07f96e for instance 634a7ed6-84df-4292-bc38-5129fb0f57c9 on n-h2-master-1 Aug 07 01:15:58.190445 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [req-3da7ab01-3a5b-4b35-9cc6-0877664afe47 req-133dd13a-5cad-4398-8e6c-0f5cdce6e18b service nova] Instance 634a7ed6-84df-4292-bc38-5129fb0f57c9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 01:15:58.249723 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-3da7ab01-3a5b-4b35-9cc6-0877664afe47 req-133dd13a-5cad-4398-8e6c-0f5cdce6e18b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210435 Aug 07 01:15:58.270743 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 775/1406] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:15:58.436896 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bd32d4ca-dabe-419a-8682-fa855f6f6a1a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:58.437615 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bd32d4ca-dabe-419a-8682-fa855f6f6a1a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:58.444692 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd32d4ca-dabe-419a-8682-fa855f6f6a1a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:58.445193 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd32d4ca-dabe-419a-8682-fa855f6f6a1a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:58.445636 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd32d4ca-dabe-419a-8682-fa855f6f6a1a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:58.446434 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd32d4ca-dabe-419a-8682-fa855f6f6a1a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:58.446894 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd32d4ca-dabe-419a-8682-fa855f6f6a1a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:58.447331 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd32d4ca-dabe-419a-8682-fa855f6f6a1a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:58.843224 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c3deda79-f237-487f-aa8a-f70a988ab9a7 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065d8324da60445ea1e97e1dc892f183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1530b8294fc4dd4bc7e7b228ad2b95c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:58.857581 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c3deda79-f237-487f-aa8a-f70a988ab9a7 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] 10.222.0.39 "GET /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9" status: 200 len: 1352 microversion: 2.1 time: 1.342589 Aug 07 01:15:58.858737 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 632/1407] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:57 2022] GET /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9 => generated 1352 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:58.869384 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a4c2e28c-bf7b-4b33-b734-24b8f87abb6c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:58.872692 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a4c2e28c-bf7b-4b33-b734-24b8f87abb6c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:58.903639 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4c2e28c-bf7b-4b33-b734-24b8f87abb6c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:58.904204 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4c2e28c-bf7b-4b33-b734-24b8f87abb6c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:58.904860 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4c2e28c-bf7b-4b33-b734-24b8f87abb6c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:58.908451 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4c2e28c-bf7b-4b33-b734-24b8f87abb6c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:58.909263 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4c2e28c-bf7b-4b33-b734-24b8f87abb6c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:58.911553 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4c2e28c-bf7b-4b33-b734-24b8f87abb6c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:59.237773 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bd32d4ca-dabe-419a-8682-fa855f6f6a1a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:59.254800 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bd32d4ca-dabe-419a-8682-fa855f6f6a1a tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1463 microversion: 2.1 time: 0.822836 Aug 07 01:15:59.263091 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 776/1408] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:58 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1463 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:59.269223 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ddb6a99f-e30e-499c-97ba-0749d3d6abc5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:59.278807 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ddb6a99f-e30e-499c-97ba-0749d3d6abc5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 0890f070-088c-4cc8-96ec-e3b5cbe33a29] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:59.298953 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddb6a99f-e30e-499c-97ba-0749d3d6abc5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:59.302583 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddb6a99f-e30e-499c-97ba-0749d3d6abc5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:59.303505 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddb6a99f-e30e-499c-97ba-0749d3d6abc5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:59.304528 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddb6a99f-e30e-499c-97ba-0749d3d6abc5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:59.306937 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddb6a99f-e30e-499c-97ba-0749d3d6abc5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:59.307638 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddb6a99f-e30e-499c-97ba-0749d3d6abc5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:59.695444 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ddb6a99f-e30e-499c-97ba-0749d3d6abc5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:15:59.703946 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ddb6a99f-e30e-499c-97ba-0749d3d6abc5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29" status: 200 len: 1316 microversion: 2.1 time: 0.439223 Aug 07 01:15:59.716718 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 777/1409] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:59 2022] GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29 => generated 1316 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:15:59.722161 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c3062810-3979-454e-93d6-26762a9af821 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:15:59.724984 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c3062810-3979-454e-93d6-26762a9af821 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:59.746492 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3062810-3979-454e-93d6-26762a9af821 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:59.747328 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3062810-3979-454e-93d6-26762a9af821 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:59.748007 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3062810-3979-454e-93d6-26762a9af821 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:59.749403 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3062810-3979-454e-93d6-26762a9af821 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:59.750075 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3062810-3979-454e-93d6-26762a9af821 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:59.750712 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3062810-3979-454e-93d6-26762a9af821 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:59.942252 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c3062810-3979-454e-93d6-26762a9af821 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a/action" status: 202 len: 0 microversion: 2.1 time: 0.223953 Aug 07 01:15:59.946905 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 778/1410] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:15:59 2022] POST /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:15:59.952416 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-33e09788-1d7f-4fb2-a780-bd32b468258e tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:15:59.965044 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-33e09788-1d7f-4fb2-a780-bd32b468258e tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] [instance: 91da23de-c338-4658-8620-831662a596b9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:15:59.990000 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33e09788-1d7f-4fb2-a780-bd32b468258e tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:59.990886 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33e09788-1d7f-4fb2-a780-bd32b468258e tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:59.991630 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33e09788-1d7f-4fb2-a780-bd32b468258e tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:15:59.992744 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33e09788-1d7f-4fb2-a780-bd32b468258e tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:15:59.993733 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33e09788-1d7f-4fb2-a780-bd32b468258e tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:15:59.994658 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33e09788-1d7f-4fb2-a780-bd32b468258e tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:00.244750 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a4c2e28c-bf7b-4b33-b734-24b8f87abb6c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:00.254004 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a4c2e28c-bf7b-4b33-b734-24b8f87abb6c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1471 microversion: 2.1 time: 1.393884 Aug 07 01:16:00.255125 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 633/1411] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:58 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1471 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:00.271564 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9a78dc61-200d-47ee-9eb1-846d7a69b9b1 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:00.272716 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9a78dc61-200d-47ee-9eb1-846d7a69b9b1 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:00.289912 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a78dc61-200d-47ee-9eb1-846d7a69b9b1 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:00.290734 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a78dc61-200d-47ee-9eb1-846d7a69b9b1 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:00.291405 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a78dc61-200d-47ee-9eb1-846d7a69b9b1 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:00.292375 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a78dc61-200d-47ee-9eb1-846d7a69b9b1 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:00.293343 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a78dc61-200d-47ee-9eb1-846d7a69b9b1 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:00.293978 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a78dc61-200d-47ee-9eb1-846d7a69b9b1 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:00.443510 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a78dc61-200d-47ee-9eb1-846d7a69b9b1 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:00.445181 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a78dc61-200d-47ee-9eb1-846d7a69b9b1 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:00.446550 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a78dc61-200d-47ee-9eb1-846d7a69b9b1 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:00.448934 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-9a78dc61-200d-47ee-9eb1-846d7a69b9b1 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lazy-loading 'fault' on Instance uuid 766de05a-a562-4045-bdf9-c49050382e1a {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:16:00.532760 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:00.596147 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-33e09788-1d7f-4fb2-a780-bd32b468258e tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065d8324da60445ea1e97e1dc892f183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1530b8294fc4dd4bc7e7b228ad2b95c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:00.632130 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-33e09788-1d7f-4fb2-a780-bd32b468258e tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] 10.222.0.39 "GET /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9" status: 200 len: 1352 microversion: 2.1 time: 0.680924 Aug 07 01:16:00.661465 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 779/1412] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:15:59 2022] GET /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9 => generated 1352 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:00.741710 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dca4f3ab-b07a-4727-ba81-4faa443c2ee5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:00.742733 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-dca4f3ab-b07a-4727-ba81-4faa443c2ee5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 0890f070-088c-4cc8-96ec-e3b5cbe33a29] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:00.755728 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dca4f3ab-b07a-4727-ba81-4faa443c2ee5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:00.759815 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dca4f3ab-b07a-4727-ba81-4faa443c2ee5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:00.764113 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dca4f3ab-b07a-4727-ba81-4faa443c2ee5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:00.768450 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dca4f3ab-b07a-4727-ba81-4faa443c2ee5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:00.776949 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dca4f3ab-b07a-4727-ba81-4faa443c2ee5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:00.780196 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dca4f3ab-b07a-4727-ba81-4faa443c2ee5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:01.229989 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-dca4f3ab-b07a-4727-ba81-4faa443c2ee5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:01.250645 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9a78dc61-200d-47ee-9eb1-846d7a69b9b1 tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1597 microversion: 2.1 time: 0.979917 Aug 07 01:16:01.279621 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-dca4f3ab-b07a-4727-ba81-4faa443c2ee5 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29" status: 200 len: 1316 microversion: 2.1 time: 0.540153 Aug 07 01:16:01.287069 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 780/1413] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:00 2022] GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29 => generated 1316 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:01.287222 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 634/1414] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:00 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1597 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:01.309323 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f580f944-6839-453c-9332-1b8da73a8f1e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:01.312690 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f580f944-6839-453c-9332-1b8da73a8f1e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:01.329254 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-da664218-9ae3-44c2-b77e-c9df582e313c tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:16:01.341731 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-da664218-9ae3-44c2-b77e-c9df582e313c tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:01.342022 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f580f944-6839-453c-9332-1b8da73a8f1e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:01.346450 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f580f944-6839-453c-9332-1b8da73a8f1e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:01.352357 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f580f944-6839-453c-9332-1b8da73a8f1e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:01.355733 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f580f944-6839-453c-9332-1b8da73a8f1e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:01.356350 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f580f944-6839-453c-9332-1b8da73a8f1e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:01.356806 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f580f944-6839-453c-9332-1b8da73a8f1e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:01.371284 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da664218-9ae3-44c2-b77e-c9df582e313c tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:01.374941 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da664218-9ae3-44c2-b77e-c9df582e313c tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:01.375705 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da664218-9ae3-44c2-b77e-c9df582e313c tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:01.377025 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da664218-9ae3-44c2-b77e-c9df582e313c tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:01.385850 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da664218-9ae3-44c2-b77e-c9df582e313c tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:01.386985 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da664218-9ae3-44c2-b77e-c9df582e313c tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:01.534931 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-da664218-9ae3-44c2-b77e-c9df582e313c tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a/action" status: 202 len: 0 microversion: 2.1 time: 0.238584 Aug 07 01:16:01.538136 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 635/1415] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:16:01 2022] POST /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:16:01.571867 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1fadf716-0c85-4304-9d68-fbcd52aa7b4f tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:01.573794 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1fadf716-0c85-4304-9d68-fbcd52aa7b4f tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:01.594644 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1fadf716-0c85-4304-9d68-fbcd52aa7b4f tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:01.595966 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1fadf716-0c85-4304-9d68-fbcd52aa7b4f tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:01.597134 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1fadf716-0c85-4304-9d68-fbcd52aa7b4f tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:01.598954 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1fadf716-0c85-4304-9d68-fbcd52aa7b4f tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:01.599758 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1fadf716-0c85-4304-9d68-fbcd52aa7b4f tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:01.606596 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1fadf716-0c85-4304-9d68-fbcd52aa7b4f tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:01.762435 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=8 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:01.986071 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f580f944-6839-453c-9332-1b8da73a8f1e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:02.004575 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f580f944-6839-453c-9332-1b8da73a8f1e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1463 microversion: 2.1 time: 0.715583 Aug 07 01:16:02.005659 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 781/1416] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:01 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1463 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:16:02.010846 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1cd48300-8054-4820-a4f2-f97641a5c0e0 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:02.011867 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1cd48300-8054-4820-a4f2-f97641a5c0e0 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] [instance: 91da23de-c338-4658-8620-831662a596b9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:02.019005 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1cd48300-8054-4820-a4f2-f97641a5c0e0 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:02.021362 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1cd48300-8054-4820-a4f2-f97641a5c0e0 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:02.022507 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1cd48300-8054-4820-a4f2-f97641a5c0e0 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:02.023495 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1cd48300-8054-4820-a4f2-f97641a5c0e0 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:02.024263 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1cd48300-8054-4820-a4f2-f97641a5c0e0 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:02.025042 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1cd48300-8054-4820-a4f2-f97641a5c0e0 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:02.312792 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1fadf716-0c85-4304-9d68-fbcd52aa7b4f tempest-ServersAdminTestJSON-1320949807 tempest-ServersAdminTestJSON-1320949807-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1614 microversion: 2.1 time: 0.760675 Aug 07 01:16:02.329535 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 636/1417] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:01 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1614 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:02.335578 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-096dccee-49f0-4286-b9e3-f43a51a22f75 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:02.336323 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-096dccee-49f0-4286-b9e3-f43a51a22f75 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:02.358683 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-096dccee-49f0-4286-b9e3-f43a51a22f75 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:02.361096 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-096dccee-49f0-4286-b9e3-f43a51a22f75 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:02.361814 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-096dccee-49f0-4286-b9e3-f43a51a22f75 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:02.362595 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-096dccee-49f0-4286-b9e3-f43a51a22f75 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:02.366029 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-096dccee-49f0-4286-b9e3-f43a51a22f75 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:02.369029 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-096dccee-49f0-4286-b9e3-f43a51a22f75 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:02.415117 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1cd48300-8054-4820-a4f2-f97641a5c0e0 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065d8324da60445ea1e97e1dc892f183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1530b8294fc4dd4bc7e7b228ad2b95c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:02.430408 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1cd48300-8054-4820-a4f2-f97641a5c0e0 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] 10.222.0.39 "GET /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9" status: 200 len: 1352 microversion: 2.1 time: 0.423549 Aug 07 01:16:02.440814 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 782/1418] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:02 2022] GET /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9 => generated 1352 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:02.448672 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-86e79e8f-c63d-4a5f-83dd-da93cb45ab76 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:02.449372 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-86e79e8f-c63d-4a5f-83dd-da93cb45ab76 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 0890f070-088c-4cc8-96ec-e3b5cbe33a29] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:02.472666 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86e79e8f-c63d-4a5f-83dd-da93cb45ab76 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:02.473176 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86e79e8f-c63d-4a5f-83dd-da93cb45ab76 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:02.473656 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86e79e8f-c63d-4a5f-83dd-da93cb45ab76 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:02.474663 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86e79e8f-c63d-4a5f-83dd-da93cb45ab76 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:02.475147 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86e79e8f-c63d-4a5f-83dd-da93cb45ab76 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:02.475674 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86e79e8f-c63d-4a5f-83dd-da93cb45ab76 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:02.938984 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-86e79e8f-c63d-4a5f-83dd-da93cb45ab76 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:02.975594 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-86e79e8f-c63d-4a5f-83dd-da93cb45ab76 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29" status: 200 len: 1316 microversion: 2.1 time: 0.542805 Aug 07 01:16:02.977127 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 783/1419] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:02 2022] GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29 => generated 1316 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:02.994004 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-49ada9eb-2ee3-411d-a34c-78bea9a8aeb1 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:02.995578 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-49ada9eb-2ee3-411d-a34c-78bea9a8aeb1 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 1e845e5c-f730-47a0-a5a9-8e0666de0d10] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:03.027406 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-49ada9eb-2ee3-411d-a34c-78bea9a8aeb1 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:03.029017 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-49ada9eb-2ee3-411d-a34c-78bea9a8aeb1 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:03.030358 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-49ada9eb-2ee3-411d-a34c-78bea9a8aeb1 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:03.033819 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-49ada9eb-2ee3-411d-a34c-78bea9a8aeb1 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:03.036655 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-49ada9eb-2ee3-411d-a34c-78bea9a8aeb1 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:03.037344 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-49ada9eb-2ee3-411d-a34c-78bea9a8aeb1 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:03.092677 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-49ada9eb-2ee3-411d-a34c-78bea9a8aeb1 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 1e845e5c-f730-47a0-a5a9-8e0666de0d10] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:16:03.152812 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:03.285945 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-49ada9eb-2ee3-411d-a34c-78bea9a8aeb1 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10" status: 204 len: 0 microversion: 2.1 time: 0.306161 Aug 07 01:16:03.287408 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 784/1420] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:16:02 2022] DELETE /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:16:03.307364 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-d1088f4a-f034-4cec-a3c5-cc8e9cc04b5c req-0e1b4834-6594-4779-8a1e-bcb28338e725 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0890f070-088c-4cc8-96ec-e3b5cbe33a29", "tag": "9ac6f021-ad62-460a-85d5-81c012eec679"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:16:03.320339 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d1088f4a-f034-4cec-a3c5-cc8e9cc04b5c req-0e1b4834-6594-4779-8a1e-bcb28338e725 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:03.321092 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d1088f4a-f034-4cec-a3c5-cc8e9cc04b5c req-0e1b4834-6594-4779-8a1e-bcb28338e725 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:03.321744 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d1088f4a-f034-4cec-a3c5-cc8e9cc04b5c req-0e1b4834-6594-4779-8a1e-bcb28338e725 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:03.345691 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-d1088f4a-f034-4cec-a3c5-cc8e9cc04b5c req-0e1b4834-6594-4779-8a1e-bcb28338e725 service nova] Creating event network-changed:9ac6f021-ad62-460a-85d5-81c012eec679 for instance 0890f070-088c-4cc8-96ec-e3b5cbe33a29 on n-h2-master-1 Aug 07 01:16:03.357680 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-d1088f4a-f034-4cec-a3c5-cc8e9cc04b5c req-0e1b4834-6594-4779-8a1e-bcb28338e725 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067379 Aug 07 01:16:03.359671 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 785/1421] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:16:03.374911 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dddc3f8c-8ab2-445c-9702-c41a3b037939 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:03.377507 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-dddc3f8c-8ab2-445c-9702-c41a3b037939 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 1e845e5c-f730-47a0-a5a9-8e0666de0d10] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:03.391554 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dddc3f8c-8ab2-445c-9702-c41a3b037939 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:03.392943 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dddc3f8c-8ab2-445c-9702-c41a3b037939 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:03.393747 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dddc3f8c-8ab2-445c-9702-c41a3b037939 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:03.395375 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dddc3f8c-8ab2-445c-9702-c41a3b037939 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:03.396586 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dddc3f8c-8ab2-445c-9702-c41a3b037939 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:03.397629 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dddc3f8c-8ab2-445c-9702-c41a3b037939 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:03.455323 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-096dccee-49f0-4286-b9e3-f43a51a22f75 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:03.470936 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-096dccee-49f0-4286-b9e3-f43a51a22f75 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1463 microversion: 2.1 time: 1.139759 Aug 07 01:16:03.471532 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 637/1422] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:02 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1463 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:03.487224 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-7f4a2684-5884-4e95-870f-3178559c30a6 req-e35f7703-18c6-43a7-bda0-a974689f4ab8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91da23de-c338-4658-8620-831662a596b9", "name": "network-vif-plugged", "status": "completed", "tag": "99794d9c-3897-4d04-8ca2-58aae35eb7f7"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:16:03.509574 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-7f4a2684-5884-4e95-870f-3178559c30a6 req-e35f7703-18c6-43a7-bda0-a974689f4ab8 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:03.512340 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-7f4a2684-5884-4e95-870f-3178559c30a6 req-e35f7703-18c6-43a7-bda0-a974689f4ab8 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:03.513231 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-7f4a2684-5884-4e95-870f-3178559c30a6 req-e35f7703-18c6-43a7-bda0-a974689f4ab8 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:03.540408 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-7f4a2684-5884-4e95-870f-3178559c30a6 req-e35f7703-18c6-43a7-bda0-a974689f4ab8 service nova] Creating event network-vif-plugged:99794d9c-3897-4d04-8ca2-58aae35eb7f7 for instance 91da23de-c338-4658-8620-831662a596b9 on n-h2-master-1 Aug 07 01:16:03.549590 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-7f4a2684-5884-4e95-870f-3178559c30a6 req-e35f7703-18c6-43a7-bda0-a974689f4ab8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072005 Aug 07 01:16:03.553242 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 638/1423] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:16:03.561966 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8f86f048-6f31-493e-9d8a-5150076a3ff2 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:03.567565 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8f86f048-6f31-493e-9d8a-5150076a3ff2 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] [instance: 91da23de-c338-4658-8620-831662a596b9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:03.587482 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f86f048-6f31-493e-9d8a-5150076a3ff2 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:03.587932 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f86f048-6f31-493e-9d8a-5150076a3ff2 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:03.589650 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f86f048-6f31-493e-9d8a-5150076a3ff2 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:03.593388 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f86f048-6f31-493e-9d8a-5150076a3ff2 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:03.593883 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f86f048-6f31-493e-9d8a-5150076a3ff2 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:03.598889 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f86f048-6f31-493e-9d8a-5150076a3ff2 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:03.678146 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-dddc3f8c-8ab2-445c-9702-c41a3b037939 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:03.689327 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-dddc3f8c-8ab2-445c-9702-c41a3b037939 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10" status: 200 len: 1469 microversion: 2.1 time: 0.327502 Aug 07 01:16:03.690581 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 786/1424] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:03 2022] GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10 => generated 1469 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:03.695735 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a136175b-4a5d-4938-b598-f0c16e85e4de tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Action: 'create', calling method: .version_select at 0x7f9e24fcf430>, body: {"keypair": {"name": "tempest-keypair-298687927", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIDtktjGJ2oAmGIs+uUiMpE3OfmlRyZd8TjhIYNO9KnpmPzdW2UTvwe860AHJcHLZ1mQ+zI2k47MovgMfZKA7HrtTHwO/7P+r2SoRxeFZ6SnHKIcdvx687//poaXXx8PQA=="}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:16:03.715138 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-a136175b-4a5d-4938-b598-f0c16e85e4de tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Getting quotas for project 1911abc893ef4c01aa80ca9079dea6e9. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:16:03.725860 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-a136175b-4a5d-4938-b598-f0c16e85e4de tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Getting quotas for user b945db9a6f7a4143a544b76be5e9af9f and project 1911abc893ef4c01aa80ca9079dea6e9. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:16:03.775579 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a136175b-4a5d-4938-b598-f0c16e85e4de tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.083461 Aug 07 01:16:03.777133 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 787/1425] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:16:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:16:04.024371 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d2194103-6fc2-4c45-9aa2-bd53a6df1872 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:04.028484 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d2194103-6fc2-4c45-9aa2-bd53a6df1872 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 0890f070-088c-4cc8-96ec-e3b5cbe33a29] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:04.055946 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2194103-6fc2-4c45-9aa2-bd53a6df1872 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:04.057200 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2194103-6fc2-4c45-9aa2-bd53a6df1872 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:04.058588 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2194103-6fc2-4c45-9aa2-bd53a6df1872 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:04.061747 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2194103-6fc2-4c45-9aa2-bd53a6df1872 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:04.063346 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2194103-6fc2-4c45-9aa2-bd53a6df1872 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:04.064674 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2194103-6fc2-4c45-9aa2-bd53a6df1872 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:04.512504 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d2194103-6fc2-4c45-9aa2-bd53a6df1872 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:04.527579 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d2194103-6fc2-4c45-9aa2-bd53a6df1872 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29" status: 200 len: 1316 microversion: 2.1 time: 0.512005 Aug 07 01:16:04.530438 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 788/1426] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:04 2022] GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29 => generated 1316 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:16:04.711879 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-80262a39-b700-45d9-8e04-9eb3da783293 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:04.712631 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-80262a39-b700-45d9-8e04-9eb3da783293 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 1e845e5c-f730-47a0-a5a9-8e0666de0d10] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:04.727830 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80262a39-b700-45d9-8e04-9eb3da783293 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:04.730064 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80262a39-b700-45d9-8e04-9eb3da783293 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:04.731567 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80262a39-b700-45d9-8e04-9eb3da783293 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:04.733625 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80262a39-b700-45d9-8e04-9eb3da783293 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:04.737293 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80262a39-b700-45d9-8e04-9eb3da783293 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:04.739209 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80262a39-b700-45d9-8e04-9eb3da783293 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:05.135157 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-80262a39-b700-45d9-8e04-9eb3da783293 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:05.146983 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-80262a39-b700-45d9-8e04-9eb3da783293 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10" status: 200 len: 1469 microversion: 2.1 time: 0.439609 Aug 07 01:16:05.148552 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 789/1427] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:04 2022] GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10 => generated 1469 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:05.149188 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8f86f048-6f31-493e-9d8a-5150076a3ff2 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065d8324da60445ea1e97e1dc892f183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1530b8294fc4dd4bc7e7b228ad2b95c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:05.178176 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8f86f048-6f31-493e-9d8a-5150076a3ff2 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] 10.222.0.39 "GET /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9" status: 200 len: 1352 microversion: 2.1 time: 1.622798 Aug 07 01:16:05.179288 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 639/1428] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:03 2022] GET /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9 => generated 1352 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:05.560692 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ecdc89ac-f86f-4049-8c0c-367670b2992a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:05.564108 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ecdc89ac-f86f-4049-8c0c-367670b2992a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 0890f070-088c-4cc8-96ec-e3b5cbe33a29] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:05.592958 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecdc89ac-f86f-4049-8c0c-367670b2992a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:05.596960 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecdc89ac-f86f-4049-8c0c-367670b2992a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:05.598082 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecdc89ac-f86f-4049-8c0c-367670b2992a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:05.599730 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecdc89ac-f86f-4049-8c0c-367670b2992a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:05.600973 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecdc89ac-f86f-4049-8c0c-367670b2992a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:05.602159 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecdc89ac-f86f-4049-8c0c-367670b2992a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:06.187874 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-10d41598-d7cb-4b4b-8d45-cb085b4c1f5b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:06.189394 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-10d41598-d7cb-4b4b-8d45-cb085b4c1f5b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 1e845e5c-f730-47a0-a5a9-8e0666de0d10] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:06.195379 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ecdc89ac-f86f-4049-8c0c-367670b2992a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:06.201256 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10d41598-d7cb-4b4b-8d45-cb085b4c1f5b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:06.202791 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10d41598-d7cb-4b4b-8d45-cb085b4c1f5b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:06.204618 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10d41598-d7cb-4b4b-8d45-cb085b4c1f5b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:06.205948 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10d41598-d7cb-4b4b-8d45-cb085b4c1f5b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:06.207345 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10d41598-d7cb-4b4b-8d45-cb085b4c1f5b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:06.209675 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10d41598-d7cb-4b4b-8d45-cb085b4c1f5b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:06.225192 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ecdc89ac-f86f-4049-8c0c-367670b2992a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29" status: 200 len: 1316 microversion: 2.1 time: 0.676908 Aug 07 01:16:06.227115 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 790/1429] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:05 2022] GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29 => generated 1316 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:06.242527 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d7c25aa8-46de-4034-9a23-9e7fc8f6ba9c tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:06.244658 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d7c25aa8-46de-4034-9a23-9e7fc8f6ba9c tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] [instance: 91da23de-c338-4658-8620-831662a596b9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:06.264401 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d7c25aa8-46de-4034-9a23-9e7fc8f6ba9c tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:06.265726 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d7c25aa8-46de-4034-9a23-9e7fc8f6ba9c tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:06.267133 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d7c25aa8-46de-4034-9a23-9e7fc8f6ba9c tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:06.268257 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d7c25aa8-46de-4034-9a23-9e7fc8f6ba9c tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:06.268975 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d7c25aa8-46de-4034-9a23-9e7fc8f6ba9c tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:06.271156 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d7c25aa8-46de-4034-9a23-9e7fc8f6ba9c tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:06.614562 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-10d41598-d7cb-4b4b-8d45-cb085b4c1f5b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:06.647675 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-10d41598-d7cb-4b4b-8d45-cb085b4c1f5b tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10" status: 200 len: 1427 microversion: 2.1 time: 0.459389 Aug 07 01:16:06.650600 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 640/1430] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:06 2022] GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10 => generated 1427 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:07.268579 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-377f13b9-7ae2-4793-9d14-cc4bb6399e81 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:07.277186 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-377f13b9-7ae2-4793-9d14-cc4bb6399e81 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 0890f070-088c-4cc8-96ec-e3b5cbe33a29] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:07.311720 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-377f13b9-7ae2-4793-9d14-cc4bb6399e81 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:07.313113 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-377f13b9-7ae2-4793-9d14-cc4bb6399e81 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:07.314164 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-377f13b9-7ae2-4793-9d14-cc4bb6399e81 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:07.316743 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-377f13b9-7ae2-4793-9d14-cc4bb6399e81 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:07.319913 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-377f13b9-7ae2-4793-9d14-cc4bb6399e81 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:07.324764 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-377f13b9-7ae2-4793-9d14-cc4bb6399e81 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:07.884151 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d7c25aa8-46de-4034-9a23-9e7fc8f6ba9c tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065d8324da60445ea1e97e1dc892f183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1530b8294fc4dd4bc7e7b228ad2b95c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:07.910494 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d7c25aa8-46de-4034-9a23-9e7fc8f6ba9c tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] 10.222.0.39 "GET /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9" status: 200 len: 1352 microversion: 2.1 time: 1.679842 Aug 07 01:16:07.924993 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 791/1431] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:06 2022] GET /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9 => generated 1352 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:07.949965 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-95782bb6-5dd2-4732-ae2f-d3b69b334550 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:07.957976 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-95782bb6-5dd2-4732-ae2f-d3b69b334550 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 1e845e5c-f730-47a0-a5a9-8e0666de0d10] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:08.007055 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-95782bb6-5dd2-4732-ae2f-d3b69b334550 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:08.009583 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-95782bb6-5dd2-4732-ae2f-d3b69b334550 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:08.011094 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-95782bb6-5dd2-4732-ae2f-d3b69b334550 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:08.013799 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-95782bb6-5dd2-4732-ae2f-d3b69b334550 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:08.015132 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-95782bb6-5dd2-4732-ae2f-d3b69b334550 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:08.017161 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-95782bb6-5dd2-4732-ae2f-d3b69b334550 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:08.160783 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-95782bb6-5dd2-4732-ae2f-d3b69b334550 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:08.161742 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-95782bb6-5dd2-4732-ae2f-d3b69b334550 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:08.162779 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-95782bb6-5dd2-4732-ae2f-d3b69b334550 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:08.164134 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-95782bb6-5dd2-4732-ae2f-d3b69b334550 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lazy-loading 'fault' on Instance uuid 1e845e5c-f730-47a0-a5a9-8e0666de0d10 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:16:08.261117 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-95782bb6-5dd2-4732-ae2f-d3b69b334550 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:08.274307 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-95782bb6-5dd2-4732-ae2f-d3b69b334550 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10" status: 200 len: 1304 microversion: 2.1 time: 0.342620 Aug 07 01:16:08.275236 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 792/1432] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:07 2022] GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10 => generated 1304 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:08.281441 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-e4743dc8-1f0a-4fe1-84a7-19c4e0a2bd75 req-514db847-4c7c-48e8-882f-631c2d77d4af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e845e5c-f730-47a0-a5a9-8e0666de0d10", "name": "network-vif-deleted", "tag": "3ad18655-1a28-4922-a4bc-cdbb210261c4"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:16:08.301995 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e4743dc8-1f0a-4fe1-84a7-19c4e0a2bd75 req-514db847-4c7c-48e8-882f-631c2d77d4af service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:08.302759 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e4743dc8-1f0a-4fe1-84a7-19c4e0a2bd75 req-514db847-4c7c-48e8-882f-631c2d77d4af service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:08.303361 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e4743dc8-1f0a-4fe1-84a7-19c4e0a2bd75 req-514db847-4c7c-48e8-882f-631c2d77d4af service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:08.320620 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-e4743dc8-1f0a-4fe1-84a7-19c4e0a2bd75 req-514db847-4c7c-48e8-882f-631c2d77d4af service nova] Creating event network-vif-deleted:3ad18655-1a28-4922-a4bc-cdbb210261c4 for instance 1e845e5c-f730-47a0-a5a9-8e0666de0d10 on n-h1-master-1 Aug 07 01:16:08.332989 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-e4743dc8-1f0a-4fe1-84a7-19c4e0a2bd75 req-514db847-4c7c-48e8-882f-631c2d77d4af service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053418 Aug 07 01:16:08.333939 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 793/1433] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:16:08.983622 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-833ab1df-909a-4a59-bccb-59ad257c4951 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:08.989450 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-833ab1df-909a-4a59-bccb-59ad257c4951 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] [instance: 91da23de-c338-4658-8620-831662a596b9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:09.009157 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-833ab1df-909a-4a59-bccb-59ad257c4951 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:09.010190 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-833ab1df-909a-4a59-bccb-59ad257c4951 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:09.011048 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-833ab1df-909a-4a59-bccb-59ad257c4951 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:09.012422 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-833ab1df-909a-4a59-bccb-59ad257c4951 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:09.019066 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-833ab1df-909a-4a59-bccb-59ad257c4951 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:09.021951 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-833ab1df-909a-4a59-bccb-59ad257c4951 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:09.202358 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-377f13b9-7ae2-4793-9d14-cc4bb6399e81 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:09.228395 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:09.276446 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-377f13b9-7ae2-4793-9d14-cc4bb6399e81 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29" status: 200 len: 1316 microversion: 2.1 time: 2.025393 Aug 07 01:16:09.278981 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 641/1434] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:07 2022] GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29 => generated 1316 bytes in 2031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:09.318463 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8b5b1407-0387-459e-bd00-19482d6b32ff tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:09.319866 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8b5b1407-0387-459e-bd00-19482d6b32ff tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 1e845e5c-f730-47a0-a5a9-8e0666de0d10] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:09.332795 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8b5b1407-0387-459e-bd00-19482d6b32ff tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:09.333678 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8b5b1407-0387-459e-bd00-19482d6b32ff tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:09.334334 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8b5b1407-0387-459e-bd00-19482d6b32ff tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:09.335542 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8b5b1407-0387-459e-bd00-19482d6b32ff tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:09.336680 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8b5b1407-0387-459e-bd00-19482d6b32ff tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:09.337401 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8b5b1407-0387-459e-bd00-19482d6b32ff tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:09.364237 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-8b5b1407-0387-459e-bd00-19482d6b32ff tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] HTTP exception thrown: Instance 1e845e5c-f730-47a0-a5a9-8e0666de0d10 could not be found. Aug 07 01:16:09.366958 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8b5b1407-0387-459e-bd00-19482d6b32ff tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Request method failure captured: Aug 07 01:16:09.366958 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10 HTTP/1.1 Aug 07 01:16:09.366958 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:16:09.366958 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:16:09.366958 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:16:09.366958 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:16:09.366958 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:16:09.366958 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:16:09.366958 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:16:09.366958 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:16:09.366958 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xGt1JQCvU9d1G1NswZiu7GFSPw-oPdJNadTkH-DQYw6J8-uSwUjMv_FTuaztrI6mjWHUtFgq19-oB0UvdmwVwAhn-QBxCHH73LJxN301uEZigduhpKum34-oGsOcxRFMpJvrGupvEjAfnbpSO9GnEkQxcn_eV4EuI2llxcCUyWVvOw Aug 07 01:16:09.366958 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:16:09.366958 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:16:09.366958 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:16:09.366958 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:16:09.366958 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:16:09.366958 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:16:09.366958 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 76537752718449e19d6ad94c8e3bc973 Aug 07 01:16:09.366958 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersAdminTestJSON-40100731 Aug 07 01:16:09.366958 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:16:09.366958 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:16:09.368941 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/76537752718449e19d6ad94c8e3bc973"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_76537752718449e19d6ad94c8e3bc973", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/76537752718449e19d6ad94c8e3bc973"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/76537752718449e19d6ad94c8e3bc973"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:16:09.368941 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersAdminTestJSON-40100731 Aug 07 01:16:09.368941 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 76537752718449e19d6ad94c8e3bc973 Aug 07 01:16:09.368941 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersAdminTestJSON-40100731 Aug 07 01:16:09.368941 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersAdminTestJSON-40100731-project Aug 07 01:16:09.368941 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:16:09.368941 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:16:09.368941 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 26994bfd2e094415bb9b6e265d52eeae Aug 07 01:16:09.368941 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersAdminTestJSON-40100731-project Aug 07 01:16:09.368941 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:16:09.368941 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 1e845e5c-f730-47a0-a5a9-8e0666de0d10 could not be found. Aug 07 01:16:09.368941 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '1e845e5c-f730-47a0-a5a9-8e0666de0d10'} Aug 07 01:16:09.369988 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:16:09.369988 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:09.369988 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:16:09.369988 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:16:09.369988 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:16:09.369988 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:16:09.369988 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:16:09.369988 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:16:09.369988 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:16:09.369988 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:16:09.369988 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e845e5c-f730-47a0-a5a9-8e0666de0d10 could not be found. Aug 07 01:16:09.369988 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:16:09.369988 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:16:09.369988 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:16:09.369988 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:09.369988 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:16:09.369988 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:16:09.369988 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:16:09.369988 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:16:09.369988 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:16:09.372040 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:16:09.372040 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:16:09.372040 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:16:09.372040 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:16:09.372040 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:16:09.372040 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:16:09.372040 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:16:09.372040 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e845e5c-f730-47a0-a5a9-8e0666de0d10 could not be found. Aug 07 01:16:09.372040 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:16:09.372040 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:16:09.372040 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:16:09.372040 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:09.372040 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:16:09.372040 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:16:09.372040 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:16:09.372040 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:16:09.372040 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e845e5c-f730-47a0-a5a9-8e0666de0d10 could not be found. Aug 07 01:16:09.372040 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:16:09.374999 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8b5b1407-0387-459e-bd00-19482d6b32ff tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Returning 404 to user: Instance 1e845e5c-f730-47a0-a5a9-8e0666de0d10 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:16:09.376275 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8b5b1407-0387-459e-bd00-19482d6b32ff tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10" status: 404 len: 111 microversion: 2.1 time: 0.064797 Aug 07 01:16:09.377431 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 642/1435] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:09 2022] GET /compute/v2.1/servers/1e845e5c-f730-47a0-a5a9-8e0666de0d10 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:16:09.391446 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-474e01b6-3fc0-4f24-87d3-f429bf2429b2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:09.392022 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-474e01b6-3fc0-4f24-87d3-f429bf2429b2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 5637b619-e3c0-47a9-beb1-2adf3e5ad29c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:09.406261 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-474e01b6-3fc0-4f24-87d3-f429bf2429b2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:09.407196 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-474e01b6-3fc0-4f24-87d3-f429bf2429b2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:09.408253 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-474e01b6-3fc0-4f24-87d3-f429bf2429b2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:09.409653 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-474e01b6-3fc0-4f24-87d3-f429bf2429b2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:09.410501 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-474e01b6-3fc0-4f24-87d3-f429bf2429b2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:09.411507 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-474e01b6-3fc0-4f24-87d3-f429bf2429b2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:09.477820 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-833ab1df-909a-4a59-bccb-59ad257c4951 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065d8324da60445ea1e97e1dc892f183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1530b8294fc4dd4bc7e7b228ad2b95c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:09.512166 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-833ab1df-909a-4a59-bccb-59ad257c4951 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] 10.222.0.39 "GET /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9" status: 200 len: 1542 microversion: 2.1 time: 0.541995 Aug 07 01:16:09.515747 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 794/1436] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:08 2022] GET /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9 => generated 1542 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:16:09.531091 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-474e01b6-3fc0-4f24-87d3-f429bf2429b2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 5637b619-e3c0-47a9-beb1-2adf3e5ad29c] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:16:09.560632 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6718b9b5-a7cc-4b91-9729-8305058dadb6 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:09.564391 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6718b9b5-a7cc-4b91-9729-8305058dadb6 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] [instance: 91da23de-c338-4658-8620-831662a596b9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:09.607918 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6718b9b5-a7cc-4b91-9729-8305058dadb6 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:09.614700 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6718b9b5-a7cc-4b91-9729-8305058dadb6 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:09.625843 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6718b9b5-a7cc-4b91-9729-8305058dadb6 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:09.630870 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6718b9b5-a7cc-4b91-9729-8305058dadb6 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:09.633693 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6718b9b5-a7cc-4b91-9729-8305058dadb6 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:09.637059 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6718b9b5-a7cc-4b91-9729-8305058dadb6 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:09.849519 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-474e01b6-3fc0-4f24-87d3-f429bf2429b2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5637b619-e3c0-47a9-beb1-2adf3e5ad29c" status: 204 len: 0 microversion: 2.1 time: 0.463225 Aug 07 01:16:09.855310 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 643/1437] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:16:09 2022] DELETE /compute/v2.1/servers/5637b619-e3c0-47a9-beb1-2adf3e5ad29c => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:16:09.893141 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a91760f1-b02f-4978-96ed-a15c86c615b2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:09.894360 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6718b9b5-a7cc-4b91-9729-8305058dadb6 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] 10.222.0.39 "GET /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.341400 Aug 07 01:16:09.907484 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 795/1438] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Aug 7 01:16:09 2022] GET /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9/os-interface => generated 285 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:16:09.908761 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a91760f1-b02f-4978-96ed-a15c86c615b2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 5637b619-e3c0-47a9-beb1-2adf3e5ad29c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:09.942248 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a91760f1-b02f-4978-96ed-a15c86c615b2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:09.943099 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a91760f1-b02f-4978-96ed-a15c86c615b2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:09.944227 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a91760f1-b02f-4978-96ed-a15c86c615b2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:09.946613 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a91760f1-b02f-4978-96ed-a15c86c615b2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:09.947448 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a91760f1-b02f-4978-96ed-a15c86c615b2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:09.949238 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a91760f1-b02f-4978-96ed-a15c86c615b2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:10.308991 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dc67e85b-ae6a-4281-aeff-9e05e35287a8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:10.310849 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-dc67e85b-ae6a-4281-aeff-9e05e35287a8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 0890f070-088c-4cc8-96ec-e3b5cbe33a29] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:10.334775 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc67e85b-ae6a-4281-aeff-9e05e35287a8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:10.336486 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc67e85b-ae6a-4281-aeff-9e05e35287a8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:10.340567 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc67e85b-ae6a-4281-aeff-9e05e35287a8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:10.353570 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc67e85b-ae6a-4281-aeff-9e05e35287a8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:10.354456 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc67e85b-ae6a-4281-aeff-9e05e35287a8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:10.357829 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc67e85b-ae6a-4281-aeff-9e05e35287a8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:10.805860 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-dc67e85b-ae6a-4281-aeff-9e05e35287a8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:10.837703 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-dc67e85b-ae6a-4281-aeff-9e05e35287a8 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29" status: 200 len: 1316 microversion: 2.1 time: 0.537023 Aug 07 01:16:10.847267 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 796/1439] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:10 2022] GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29 => generated 1316 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:11.522072 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a91760f1-b02f-4978-96ed-a15c86c615b2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:11.553250 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a91760f1-b02f-4978-96ed-a15c86c615b2 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/5637b619-e3c0-47a9-beb1-2adf3e5ad29c" status: 200 len: 1469 microversion: 2.1 time: 1.689759 Aug 07 01:16:11.555169 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 644/1440] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:09 2022] GET /compute/v2.1/servers/5637b619-e3c0-47a9-beb1-2adf3e5ad29c => generated 1469 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:16:11.901725 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5c8ba7e3-c48b-4eef-b468-efb71a9c8ffe tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:11.921179 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5c8ba7e3-c48b-4eef-b468-efb71a9c8ffe tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 0890f070-088c-4cc8-96ec-e3b5cbe33a29] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:11.943165 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5c8ba7e3-c48b-4eef-b468-efb71a9c8ffe tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:11.944230 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5c8ba7e3-c48b-4eef-b468-efb71a9c8ffe tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:11.945305 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5c8ba7e3-c48b-4eef-b468-efb71a9c8ffe tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:11.949234 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5c8ba7e3-c48b-4eef-b468-efb71a9c8ffe tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:11.950571 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5c8ba7e3-c48b-4eef-b468-efb71a9c8ffe tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:11.951653 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5c8ba7e3-c48b-4eef-b468-efb71a9c8ffe tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:12.599012 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-563590c0-b327-4eff-ad1f-4e73717a3dae tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:12.601679 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-563590c0-b327-4eff-ad1f-4e73717a3dae tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 5637b619-e3c0-47a9-beb1-2adf3e5ad29c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:12.643773 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-563590c0-b327-4eff-ad1f-4e73717a3dae tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:12.645822 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-563590c0-b327-4eff-ad1f-4e73717a3dae tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:12.647936 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-563590c0-b327-4eff-ad1f-4e73717a3dae tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:12.653276 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-563590c0-b327-4eff-ad1f-4e73717a3dae tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:12.654209 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-563590c0-b327-4eff-ad1f-4e73717a3dae tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:12.654936 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-563590c0-b327-4eff-ad1f-4e73717a3dae tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:12.959374 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5c8ba7e3-c48b-4eef-b468-efb71a9c8ffe tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:12.985242 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5c8ba7e3-c48b-4eef-b468-efb71a9c8ffe tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29" status: 200 len: 1316 microversion: 2.1 time: 1.086883 Aug 07 01:16:12.985961 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 797/1441] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:11 2022] GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29 => generated 1316 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:12.995608 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-539c2ae2-aae4-4a6d-8488-d398db9e3c79 req-ad25af94-05b7-4559-a1c7-f20d06970fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0890f070-088c-4cc8-96ec-e3b5cbe33a29", "name": "network-vif-plugged", "status": "completed", "tag": "9ac6f021-ad62-460a-85d5-81c012eec679"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:16:13.031781 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-539c2ae2-aae4-4a6d-8488-d398db9e3c79 req-ad25af94-05b7-4559-a1c7-f20d06970fe2 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:13.032405 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-539c2ae2-aae4-4a6d-8488-d398db9e3c79 req-ad25af94-05b7-4559-a1c7-f20d06970fe2 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:13.033125 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-539c2ae2-aae4-4a6d-8488-d398db9e3c79 req-ad25af94-05b7-4559-a1c7-f20d06970fe2 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:13.068654 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-539c2ae2-aae4-4a6d-8488-d398db9e3c79 req-ad25af94-05b7-4559-a1c7-f20d06970fe2 service nova] Creating event network-vif-plugged:9ac6f021-ad62-460a-85d5-81c012eec679 for instance 0890f070-088c-4cc8-96ec-e3b5cbe33a29 on n-h2-master-1 Aug 07 01:16:13.114166 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-539c2ae2-aae4-4a6d-8488-d398db9e3c79 req-ad25af94-05b7-4559-a1c7-f20d06970fe2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120759 Aug 07 01:16:13.115787 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 798/1442] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:16:14.011224 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-720b5001-d496-469f-87c8-be0bb2f31f76 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:14.012082 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-720b5001-d496-469f-87c8-be0bb2f31f76 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 0890f070-088c-4cc8-96ec-e3b5cbe33a29] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:14.030747 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=4 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:14.036729 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-720b5001-d496-469f-87c8-be0bb2f31f76 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:14.037958 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-720b5001-d496-469f-87c8-be0bb2f31f76 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:14.040220 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-720b5001-d496-469f-87c8-be0bb2f31f76 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:14.041819 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-720b5001-d496-469f-87c8-be0bb2f31f76 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:14.042685 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-720b5001-d496-469f-87c8-be0bb2f31f76 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:14.043858 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-720b5001-d496-469f-87c8-be0bb2f31f76 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:14.518277 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-720b5001-d496-469f-87c8-be0bb2f31f76 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:14.562734 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-720b5001-d496-469f-87c8-be0bb2f31f76 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29" status: 200 len: 1316 microversion: 2.1 time: 0.551168 Aug 07 01:16:14.563991 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 799/1443] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:14 2022] GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29 => generated 1316 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:14.583368 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-275419eb-fc54-423e-8736-0748bca4e3e3 req-327e37dc-67cf-4f9d-af09-3c089f44461d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5637b619-e3c0-47a9-beb1-2adf3e5ad29c", "name": "network-vif-deleted", "tag": "f04fc253-b892-46a9-a3b1-750cdbd6561d"}, {"name": "network-changed", "server_uuid": "91da23de-c338-4658-8620-831662a596b9", "tag": "99794d9c-3897-4d04-8ca2-58aae35eb7f7"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:16:14.617886 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-275419eb-fc54-423e-8736-0748bca4e3e3 req-327e37dc-67cf-4f9d-af09-3c089f44461d service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:14.619119 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-275419eb-fc54-423e-8736-0748bca4e3e3 req-327e37dc-67cf-4f9d-af09-3c089f44461d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:14.620409 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-275419eb-fc54-423e-8736-0748bca4e3e3 req-327e37dc-67cf-4f9d-af09-3c089f44461d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:14.675630 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-275419eb-fc54-423e-8736-0748bca4e3e3 req-327e37dc-67cf-4f9d-af09-3c089f44461d service nova] Creating event network-vif-deleted:f04fc253-b892-46a9-a3b1-750cdbd6561d for instance 5637b619-e3c0-47a9-beb1-2adf3e5ad29c on n-h1-master-1 Aug 07 01:16:14.678820 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-275419eb-fc54-423e-8736-0748bca4e3e3 req-327e37dc-67cf-4f9d-af09-3c089f44461d service nova] Creating event network-changed:99794d9c-3897-4d04-8ca2-58aae35eb7f7 for instance 91da23de-c338-4658-8620-831662a596b9 on n-h2-master-1 Aug 07 01:16:14.706550 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-275419eb-fc54-423e-8736-0748bca4e3e3 req-327e37dc-67cf-4f9d-af09-3c089f44461d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.139894 Aug 07 01:16:14.715630 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 800/1444] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:16:15.032558 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-563590c0-b327-4eff-ad1f-4e73717a3dae tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:15.052577 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-563590c0-b327-4eff-ad1f-4e73717a3dae tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/5637b619-e3c0-47a9-beb1-2adf3e5ad29c" status: 200 len: 1469 microversion: 2.1 time: 2.464002 Aug 07 01:16:15.054510 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 645/1445] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:12 2022] GET /compute/v2.1/servers/5637b619-e3c0-47a9-beb1-2adf3e5ad29c => generated 1469 bytes in 2468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:15.579039 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-99870090-525f-4bc1-867f-94c11517b456 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Calling method '.version_select at 0x7f9e243eb700>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:15.591726 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99870090-525f-4bc1-867f-94c11517b456 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:15.594936 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99870090-525f-4bc1-867f-94c11517b456 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:15.596963 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99870090-525f-4bc1-867f-94c11517b456 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:15.609671 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-885f8f5c-0d58-49fd-99fc-5cf9d4c0378c tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:15.610332 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-885f8f5c-0d58-49fd-99fc-5cf9d4c0378c tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 0890f070-088c-4cc8-96ec-e3b5cbe33a29] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:15.632194 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-99870090-525f-4bc1-867f-94c11517b456 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 1954 microversion: 2.1 time: 0.065472 Aug 07 01:16:15.633509 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-885f8f5c-0d58-49fd-99fc-5cf9d4c0378c tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:15.634015 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-885f8f5c-0d58-49fd-99fc-5cf9d4c0378c tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:15.634633 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 801/1446] 10.222.0.39 () {58 vars in 1143 bytes} [Sun Aug 7 01:16:15 2022] GET /compute/v2.1/os-migrations => generated 1954 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:15.635086 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-885f8f5c-0d58-49fd-99fc-5cf9d4c0378c tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:15.635907 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-885f8f5c-0d58-49fd-99fc-5cf9d4c0378c tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:15.636380 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-885f8f5c-0d58-49fd-99fc-5cf9d4c0378c tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:15.636818 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-885f8f5c-0d58-49fd-99fc-5cf9d4c0378c tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:15.687941 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cd65c27d-ca87-4284-8f40-b5fbd8523d28 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:15.706120 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cd65c27d-ca87-4284-8f40-b5fbd8523d28 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.042519 Aug 07 01:16:15.708156 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 802/1447] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Aug 7 01:16:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:16:15.734101 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a5a4d1ea-c9ff-4682-97e6-edb96f9cb29d tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-597373442", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:16:15.749587 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:16:15.749587 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:16:15.821321 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a5a4d1ea-c9ff-4682-97e6-edb96f9cb29d tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.098856 Aug 07 01:16:15.830630 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 803/1448] 10.222.0.39 () {60 vars in 1146 bytes} [Sun Aug 7 01:16:15 2022] POST /compute/v2.1/flavors => generated 498 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:16:15.853682 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-07c2abc7-7735-42dc-8b1f-dd86e1b8da48 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:15.871649 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-07c2abc7-7735-42dc-8b1f-dd86e1b8da48 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.027567 Aug 07 01:16:15.872848 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 804/1449] 10.222.0.39 () {58 vars in 1182 bytes} [Sun Aug 7 01:16:15 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:16:16.084490 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3d9909c8-b147-4170-8b4b-88ff4812d04e tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:16.088669 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3d9909c8-b147-4170-8b4b-88ff4812d04e tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 5637b619-e3c0-47a9-beb1-2adf3e5ad29c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:16.110122 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3d9909c8-b147-4170-8b4b-88ff4812d04e tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:16.111139 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3d9909c8-b147-4170-8b4b-88ff4812d04e tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:16.111837 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3d9909c8-b147-4170-8b4b-88ff4812d04e tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:16.112885 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3d9909c8-b147-4170-8b4b-88ff4812d04e tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:16.113611 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3d9909c8-b147-4170-8b4b-88ff4812d04e tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:16.114348 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3d9909c8-b147-4170-8b4b-88ff4812d04e tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:16.148988 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-3d9909c8-b147-4170-8b4b-88ff4812d04e tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] HTTP exception thrown: Instance 5637b619-e3c0-47a9-beb1-2adf3e5ad29c could not be found. Aug 07 01:16:16.151301 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3d9909c8-b147-4170-8b4b-88ff4812d04e tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Request method failure captured: Aug 07 01:16:16.151301 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/5637b619-e3c0-47a9-beb1-2adf3e5ad29c HTTP/1.1 Aug 07 01:16:16.151301 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:16:16.151301 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:16:16.151301 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:16:16.151301 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:16:16.151301 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:16:16.151301 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:16:16.151301 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:16:16.151301 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:16:16.151301 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xGt1JQCvU9d1G1NswZiu7GFSPw-oPdJNadTkH-DQYw6J8-uSwUjMv_FTuaztrI6mjWHUtFgq19-oB0UvdmwVwAhn-QBxCHH73LJxN301uEZigduhpKum34-oGsOcxRFMpJvrGupvEjAfnbpSO9GnEkQxcn_eV4EuI2llxcCUyWVvOw Aug 07 01:16:16.151301 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:16:16.151301 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:16:16.151301 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:16:16.151301 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:16:16.151301 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:16:16.151301 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:16:16.151301 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 76537752718449e19d6ad94c8e3bc973 Aug 07 01:16:16.151301 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersAdminTestJSON-40100731 Aug 07 01:16:16.151301 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:16:16.151301 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:16:16.152802 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/76537752718449e19d6ad94c8e3bc973"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_76537752718449e19d6ad94c8e3bc973", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/76537752718449e19d6ad94c8e3bc973"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/76537752718449e19d6ad94c8e3bc973"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:16:16.152802 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersAdminTestJSON-40100731 Aug 07 01:16:16.152802 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 76537752718449e19d6ad94c8e3bc973 Aug 07 01:16:16.152802 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersAdminTestJSON-40100731 Aug 07 01:16:16.152802 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersAdminTestJSON-40100731-project Aug 07 01:16:16.152802 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:16:16.152802 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:16:16.152802 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 26994bfd2e094415bb9b6e265d52eeae Aug 07 01:16:16.152802 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersAdminTestJSON-40100731-project Aug 07 01:16:16.152802 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:16:16.152802 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 5637b619-e3c0-47a9-beb1-2adf3e5ad29c could not be found. Aug 07 01:16:16.152802 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '5637b619-e3c0-47a9-beb1-2adf3e5ad29c'} Aug 07 01:16:16.153619 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:16:16.153619 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:16.153619 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:16:16.153619 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:16:16.153619 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:16:16.153619 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:16:16.153619 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:16:16.153619 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:16:16.153619 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:16:16.153619 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:16:16.153619 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5637b619-e3c0-47a9-beb1-2adf3e5ad29c could not be found. Aug 07 01:16:16.153619 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:16:16.153619 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:16:16.153619 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:16:16.153619 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:16.153619 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:16:16.153619 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:16:16.153619 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:16:16.153619 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:16:16.153619 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:16:16.154879 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:16:16.154879 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:16:16.154879 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:16:16.154879 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:16:16.154879 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:16:16.154879 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:16:16.154879 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:16:16.154879 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5637b619-e3c0-47a9-beb1-2adf3e5ad29c could not be found. Aug 07 01:16:16.154879 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:16:16.154879 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:16:16.154879 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:16:16.154879 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:16.154879 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:16:16.154879 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:16:16.154879 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:16:16.154879 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:16:16.154879 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5637b619-e3c0-47a9-beb1-2adf3e5ad29c could not be found. Aug 07 01:16:16.154879 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:16:16.156085 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3d9909c8-b147-4170-8b4b-88ff4812d04e tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Returning 404 to user: Instance 5637b619-e3c0-47a9-beb1-2adf3e5ad29c could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:16:16.156085 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3d9909c8-b147-4170-8b4b-88ff4812d04e tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/5637b619-e3c0-47a9-beb1-2adf3e5ad29c" status: 404 len: 111 microversion: 2.1 time: 0.076801 Aug 07 01:16:16.160022 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 805/1450] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:16 2022] GET /compute/v2.1/servers/5637b619-e3c0-47a9-beb1-2adf3e5ad29c => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:16:16.170532 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e91752fa-2179-4a6f-95b2-23cb3e93aa0b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1575490811", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "9952423c-5f43-4e44-af82-6c069bfe067a"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:16:16.313987 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-e91752fa-2179-4a6f-95b2-23cb3e93aa0b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] validate_networks() for None {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:16:16.820115 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e91752fa-2179-4a6f-95b2-23cb3e93aa0b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:16:16.821767 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e91752fa-2179-4a6f-95b2-23cb3e93aa0b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:16:16.822976 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e91752fa-2179-4a6f-95b2-23cb3e93aa0b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:16:16.823711 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e91752fa-2179-4a6f-95b2-23cb3e93aa0b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:16:16.824664 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e91752fa-2179-4a6f-95b2-23cb3e93aa0b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:16:16.832877 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:16.846679 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e91752fa-2179-4a6f-95b2-23cb3e93aa0b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:16.848997 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e91752fa-2179-4a6f-95b2-23cb3e93aa0b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:16.850250 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e91752fa-2179-4a6f-95b2-23cb3e93aa0b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:16.852191 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e91752fa-2179-4a6f-95b2-23cb3e93aa0b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:16.853478 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e91752fa-2179-4a6f-95b2-23cb3e93aa0b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:16.854408 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e91752fa-2179-4a6f-95b2-23cb3e93aa0b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:16.888045 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-e91752fa-2179-4a6f-95b2-23cb3e93aa0b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Getting quotas for project 1911abc893ef4c01aa80ca9079dea6e9. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:16:16.896858 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-e91752fa-2179-4a6f-95b2-23cb3e93aa0b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Getting quotas for user b945db9a6f7a4143a544b76be5e9af9f and project 1911abc893ef4c01aa80ca9079dea6e9. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:16:16.914991 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e91752fa-2179-4a6f-95b2-23cb3e93aa0b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:16:16.918088 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e91752fa-2179-4a6f-95b2-23cb3e93aa0b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:16:17.013523 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e91752fa-2179-4a6f-95b2-23cb3e93aa0b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.851619 Aug 07 01:16:17.015754 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 806/1451] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:16:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:16:17.033243 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-74d4daef-680e-468a-80e1-fb47ea80be63 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:17.034144 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-74d4daef-680e-468a-80e1-fb47ea80be63 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:17.048311 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-74d4daef-680e-468a-80e1-fb47ea80be63 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:17.049563 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-74d4daef-680e-468a-80e1-fb47ea80be63 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:17.050134 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-74d4daef-680e-468a-80e1-fb47ea80be63 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:17.052096 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-74d4daef-680e-468a-80e1-fb47ea80be63 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:17.052937 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-74d4daef-680e-468a-80e1-fb47ea80be63 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:17.053723 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-74d4daef-680e-468a-80e1-fb47ea80be63 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:17.136340 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-74d4daef-680e-468a-80e1-fb47ea80be63 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:16:17.246783 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:17.325329 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-74d4daef-680e-468a-80e1-fb47ea80be63 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "DELETE /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 204 len: 0 microversion: 2.1 time: 0.304094 Aug 07 01:16:17.326535 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 807/1452] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:16:17 2022] DELETE /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:16:17.360011 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-83717f2e-1400-409d-825c-d7c5ebcab54c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:17.368342 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-83717f2e-1400-409d-825c-d7c5ebcab54c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:17.450794 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-885f8f5c-0d58-49fd-99fc-5cf9d4c0378c tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:17.508572 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-885f8f5c-0d58-49fd-99fc-5cf9d4c0378c tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29" status: 200 len: 1316 microversion: 2.1 time: 1.903258 Aug 07 01:16:17.509080 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 646/1453] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:15 2022] GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29 => generated 1316 bytes in 1905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:16:17.537541 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ba0faa21-b191-4a82-9078-42d35b2d9d19 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:17.538191 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ba0faa21-b191-4a82-9078-42d35b2d9d19 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:17.557337 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ba0faa21-b191-4a82-9078-42d35b2d9d19 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:17.561936 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ba0faa21-b191-4a82-9078-42d35b2d9d19 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:17.577945 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ba0faa21-b191-4a82-9078-42d35b2d9d19 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:17.579487 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ba0faa21-b191-4a82-9078-42d35b2d9d19 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:17.580032 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ba0faa21-b191-4a82-9078-42d35b2d9d19 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:17.580536 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ba0faa21-b191-4a82-9078-42d35b2d9d19 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:17.774115 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-83717f2e-1400-409d-825c-d7c5ebcab54c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:17.794701 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-83717f2e-1400-409d-825c-d7c5ebcab54c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1279 microversion: 2.1 time: 0.462961 Aug 07 01:16:17.799948 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 808/1454] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:17 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1279 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:18.537815 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-29220b2f-e562-4953-b227-928eb604b8e7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:18.538646 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-29220b2f-e562-4953-b227-928eb604b8e7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 0890f070-088c-4cc8-96ec-e3b5cbe33a29] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:18.589620 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-29220b2f-e562-4953-b227-928eb604b8e7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:18.593508 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-29220b2f-e562-4953-b227-928eb604b8e7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:18.595105 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-29220b2f-e562-4953-b227-928eb604b8e7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:18.606438 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-29220b2f-e562-4953-b227-928eb604b8e7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:18.619538 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-29220b2f-e562-4953-b227-928eb604b8e7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:18.621112 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-29220b2f-e562-4953-b227-928eb604b8e7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:18.949507 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ba0faa21-b191-4a82-9078-42d35b2d9d19 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:19.026765 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ba0faa21-b191-4a82-9078-42d35b2d9d19 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1469 microversion: 2.1 time: 1.489898 Aug 07 01:16:19.053409 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 647/1455] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:17 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1469 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:19.071488 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-427b03e5-887c-46e7-a25b-9b0e7832b93e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:19.073828 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-427b03e5-887c-46e7-a25b-9b0e7832b93e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:19.090966 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-427b03e5-887c-46e7-a25b-9b0e7832b93e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:19.092423 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-427b03e5-887c-46e7-a25b-9b0e7832b93e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:19.093830 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-427b03e5-887c-46e7-a25b-9b0e7832b93e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:19.096239 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-427b03e5-887c-46e7-a25b-9b0e7832b93e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:19.098251 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-427b03e5-887c-46e7-a25b-9b0e7832b93e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:19.099337 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-427b03e5-887c-46e7-a25b-9b0e7832b93e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:19.608051 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-427b03e5-887c-46e7-a25b-9b0e7832b93e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:19.646551 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-427b03e5-887c-46e7-a25b-9b0e7832b93e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1275 microversion: 2.1 time: 0.586007 Aug 07 01:16:19.648536 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 648/1456] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:19 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1275 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:19.764532 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-29220b2f-e562-4953-b227-928eb604b8e7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:19.785931 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-29220b2f-e562-4953-b227-928eb604b8e7 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29" status: 200 len: 1466 microversion: 2.1 time: 1.253195 Aug 07 01:16:19.830681 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 809/1457] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:18 2022] GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29 => generated 1466 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:19.852558 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cdffc3d7-aa13-4134-bd49-ef6773153859 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:19.857342 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-cdffc3d7-aa13-4134-bd49-ef6773153859 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] [instance: 0890f070-088c-4cc8-96ec-e3b5cbe33a29] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:19.891076 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:19.915171 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cdffc3d7-aa13-4134-bd49-ef6773153859 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:19.928232 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cdffc3d7-aa13-4134-bd49-ef6773153859 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:19.928964 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cdffc3d7-aa13-4134-bd49-ef6773153859 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:19.951504 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cdffc3d7-aa13-4134-bd49-ef6773153859 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:19.952814 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cdffc3d7-aa13-4134-bd49-ef6773153859 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:19.953523 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cdffc3d7-aa13-4134-bd49-ef6773153859 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:20.064822 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4bbc0eb0-94f3-40ca-acc6-64348deb37f4 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:20.066246 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4bbc0eb0-94f3-40ca-acc6-64348deb37f4 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:20.083436 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4bbc0eb0-94f3-40ca-acc6-64348deb37f4 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:20.084379 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4bbc0eb0-94f3-40ca-acc6-64348deb37f4 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:20.085172 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4bbc0eb0-94f3-40ca-acc6-64348deb37f4 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:20.086528 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4bbc0eb0-94f3-40ca-acc6-64348deb37f4 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:20.096404 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4bbc0eb0-94f3-40ca-acc6-64348deb37f4 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:20.097063 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4bbc0eb0-94f3-40ca-acc6-64348deb37f4 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:20.887218 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4bbc0eb0-94f3-40ca-acc6-64348deb37f4 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:20.901222 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4bbc0eb0-94f3-40ca-acc6-64348deb37f4 tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1469 microversion: 2.1 time: 0.842697 Aug 07 01:16:20.902232 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 810/1458] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:20 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1469 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:16:20.919448 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fa5dfe42-b1e4-44bb-a849-d02cf3282777 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:20.920117 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fa5dfe42-b1e4-44bb-a849-d02cf3282777 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:20.930975 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa5dfe42-b1e4-44bb-a849-d02cf3282777 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:20.932118 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa5dfe42-b1e4-44bb-a849-d02cf3282777 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:20.932839 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa5dfe42-b1e4-44bb-a849-d02cf3282777 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:20.935931 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa5dfe42-b1e4-44bb-a849-d02cf3282777 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:20.936769 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa5dfe42-b1e4-44bb-a849-d02cf3282777 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:20.937398 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa5dfe42-b1e4-44bb-a849-d02cf3282777 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:21.154821 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fa5dfe42-b1e4-44bb-a849-d02cf3282777 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:21.180811 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fa5dfe42-b1e4-44bb-a849-d02cf3282777 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1337 microversion: 2.1 time: 0.276465 Aug 07 01:16:21.184057 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 811/1459] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:20 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1337 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:21.537933 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-e2a8339b-a8b4-4c57-a21a-f76eac4b7fe7 req-b3e19027-ac01-4fed-a371-2affcf38594f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "766de05a-a562-4045-bdf9-c49050382e1a", "name": "network-vif-deleted", "tag": "a4899c9a-669a-4c98-bfc8-6b6f7b2c3f93"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:16:21.564808 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e2a8339b-a8b4-4c57-a21a-f76eac4b7fe7 req-b3e19027-ac01-4fed-a371-2affcf38594f service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:21.576313 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e2a8339b-a8b4-4c57-a21a-f76eac4b7fe7 req-b3e19027-ac01-4fed-a371-2affcf38594f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:21.580383 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e2a8339b-a8b4-4c57-a21a-f76eac4b7fe7 req-b3e19027-ac01-4fed-a371-2affcf38594f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:21.627041 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-e2a8339b-a8b4-4c57-a21a-f76eac4b7fe7 req-b3e19027-ac01-4fed-a371-2affcf38594f service nova] Creating event network-vif-deleted:a4899c9a-669a-4c98-bfc8-6b6f7b2c3f93 for instance 766de05a-a562-4045-bdf9-c49050382e1a on n-h1-master-1 Aug 07 01:16:21.646338 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-e2a8339b-a8b4-4c57-a21a-f76eac4b7fe7 req-b3e19027-ac01-4fed-a371-2affcf38594f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115772 Aug 07 01:16:21.652869 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 812/1460] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:16:21.806144 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cdffc3d7-aa13-4134-bd49-ef6773153859 tempest-ServersOnMultiNodesTest-845737912 tempest-ServersOnMultiNodesTest-845737912-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29" status: 200 len: 1617 microversion: 2.1 time: 1.960760 Aug 07 01:16:21.825411 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 649/1461] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:19 2022] GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29 => generated 1617 bytes in 1981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:21.849545 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2322b13f-9bfe-4e03-961f-4f017bac94a4 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:21.850839 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2322b13f-9bfe-4e03-961f-4f017bac94a4 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 0890f070-088c-4cc8-96ec-e3b5cbe33a29] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:21.865106 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2322b13f-9bfe-4e03-961f-4f017bac94a4 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:21.866158 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2322b13f-9bfe-4e03-961f-4f017bac94a4 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:21.866813 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2322b13f-9bfe-4e03-961f-4f017bac94a4 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:21.868081 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2322b13f-9bfe-4e03-961f-4f017bac94a4 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:21.870058 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2322b13f-9bfe-4e03-961f-4f017bac94a4 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:21.871285 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2322b13f-9bfe-4e03-961f-4f017bac94a4 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:21.945065 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-eef74b50-6aad-4b4a-b900-aa074703140f tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:21.952870 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-eef74b50-6aad-4b4a-b900-aa074703140f tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:21.958643 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2322b13f-9bfe-4e03-961f-4f017bac94a4 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 0890f070-088c-4cc8-96ec-e3b5cbe33a29] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:16:21.975766 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eef74b50-6aad-4b4a-b900-aa074703140f tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:21.977341 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eef74b50-6aad-4b4a-b900-aa074703140f tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:21.978384 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eef74b50-6aad-4b4a-b900-aa074703140f tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:21.980009 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eef74b50-6aad-4b4a-b900-aa074703140f tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:21.981060 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eef74b50-6aad-4b4a-b900-aa074703140f tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:21.982322 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eef74b50-6aad-4b4a-b900-aa074703140f tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:22.079264 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eef74b50-6aad-4b4a-b900-aa074703140f tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:22.081645 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eef74b50-6aad-4b4a-b900-aa074703140f tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:22.085163 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eef74b50-6aad-4b4a-b900-aa074703140f tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:22.086779 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-eef74b50-6aad-4b4a-b900-aa074703140f tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lazy-loading 'fault' on Instance uuid 766de05a-a562-4045-bdf9-c49050382e1a {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:16:22.188808 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-eef74b50-6aad-4b4a-b900-aa074703140f tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26994bfd2e094415bb9b6e265d52eeae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76537752718449e19d6ad94c8e3bc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:22.201503 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-eef74b50-6aad-4b4a-b900-aa074703140f tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 200 len: 1304 microversion: 2.1 time: 0.263926 Aug 07 01:16:22.212165 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 650/1462] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:21 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 1304 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:22.228030 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4894f602-8a71-4f1d-80f8-3d250ee8be58 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:22.229572 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4894f602-8a71-4f1d-80f8-3d250ee8be58 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:22.248078 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4894f602-8a71-4f1d-80f8-3d250ee8be58 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:22.261044 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2322b13f-9bfe-4e03-961f-4f017bac94a4 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29" status: 204 len: 0 microversion: 2.1 time: 0.404604 Aug 07 01:16:22.264669 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4894f602-8a71-4f1d-80f8-3d250ee8be58 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:22.265284 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 813/1463] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:16:21 2022] DELETE /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:16:22.265717 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4894f602-8a71-4f1d-80f8-3d250ee8be58 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:22.266948 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4894f602-8a71-4f1d-80f8-3d250ee8be58 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:22.267612 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4894f602-8a71-4f1d-80f8-3d250ee8be58 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:22.268083 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4894f602-8a71-4f1d-80f8-3d250ee8be58 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:22.293188 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1b300472-1652-40fa-96fc-66129b34b90f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:22.298367 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1b300472-1652-40fa-96fc-66129b34b90f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 0890f070-088c-4cc8-96ec-e3b5cbe33a29] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:22.368888 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b300472-1652-40fa-96fc-66129b34b90f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:22.369395 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b300472-1652-40fa-96fc-66129b34b90f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:22.382397 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b300472-1652-40fa-96fc-66129b34b90f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:22.383341 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b300472-1652-40fa-96fc-66129b34b90f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:22.383836 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b300472-1652-40fa-96fc-66129b34b90f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:22.384319 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b300472-1652-40fa-96fc-66129b34b90f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:22.597038 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4894f602-8a71-4f1d-80f8-3d250ee8be58 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:22.630133 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4894f602-8a71-4f1d-80f8-3d250ee8be58 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1337 microversion: 2.1 time: 0.411972 Aug 07 01:16:22.631827 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 651/1464] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:22 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1337 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:16:22.689660 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1b300472-1652-40fa-96fc-66129b34b90f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:22.709705 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1b300472-1652-40fa-96fc-66129b34b90f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29" status: 200 len: 1472 microversion: 2.1 time: 0.432699 Aug 07 01:16:22.712926 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 814/1465] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:22 2022] GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29 => generated 1472 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:23.257217 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a8bf30f5-dfb2-4094-98fa-217f3be6311c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:23.261268 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a8bf30f5-dfb2-4094-98fa-217f3be6311c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] [instance: 766de05a-a562-4045-bdf9-c49050382e1a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:23.296854 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a8bf30f5-dfb2-4094-98fa-217f3be6311c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:23.299747 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a8bf30f5-dfb2-4094-98fa-217f3be6311c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:23.301836 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a8bf30f5-dfb2-4094-98fa-217f3be6311c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:23.305365 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a8bf30f5-dfb2-4094-98fa-217f3be6311c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:23.312628 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a8bf30f5-dfb2-4094-98fa-217f3be6311c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:23.314580 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a8bf30f5-dfb2-4094-98fa-217f3be6311c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:23.370217 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-a8bf30f5-dfb2-4094-98fa-217f3be6311c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] HTTP exception thrown: Instance 766de05a-a562-4045-bdf9-c49050382e1a could not be found. Aug 07 01:16:23.373581 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a8bf30f5-dfb2-4094-98fa-217f3be6311c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Request method failure captured: Aug 07 01:16:23.373581 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a HTTP/1.1 Aug 07 01:16:23.373581 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:16:23.373581 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:16:23.373581 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:16:23.373581 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:16:23.373581 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:16:23.373581 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:16:23.373581 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:16:23.373581 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:16:23.373581 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xGt1JQCvU9d1G1NswZiu7GFSPw-oPdJNadTkH-DQYw6J8-uSwUjMv_FTuaztrI6mjWHUtFgq19-oB0UvdmwVwAhn-QBxCHH73LJxN301uEZigduhpKum34-oGsOcxRFMpJvrGupvEjAfnbpSO9GnEkQxcn_eV4EuI2llxcCUyWVvOw Aug 07 01:16:23.373581 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:16:23.373581 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:16:23.373581 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:16:23.373581 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:16:23.373581 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:16:23.373581 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:16:23.373581 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 76537752718449e19d6ad94c8e3bc973 Aug 07 01:16:23.373581 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersAdminTestJSON-40100731 Aug 07 01:16:23.373581 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:16:23.373581 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:16:23.376953 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/76537752718449e19d6ad94c8e3bc973"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_76537752718449e19d6ad94c8e3bc973", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/76537752718449e19d6ad94c8e3bc973"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/76537752718449e19d6ad94c8e3bc973"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:16:23.376953 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersAdminTestJSON-40100731 Aug 07 01:16:23.376953 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 76537752718449e19d6ad94c8e3bc973 Aug 07 01:16:23.376953 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersAdminTestJSON-40100731 Aug 07 01:16:23.376953 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersAdminTestJSON-40100731-project Aug 07 01:16:23.376953 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:16:23.376953 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:16:23.376953 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 26994bfd2e094415bb9b6e265d52eeae Aug 07 01:16:23.376953 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersAdminTestJSON-40100731-project Aug 07 01:16:23.376953 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:16:23.376953 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 766de05a-a562-4045-bdf9-c49050382e1a could not be found. Aug 07 01:16:23.376953 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '766de05a-a562-4045-bdf9-c49050382e1a'} Aug 07 01:16:23.379457 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:16:23.379457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:23.379457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:16:23.379457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:16:23.379457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:16:23.379457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:16:23.379457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:16:23.379457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:16:23.379457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:16:23.379457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:16:23.379457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 766de05a-a562-4045-bdf9-c49050382e1a could not be found. Aug 07 01:16:23.379457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:16:23.379457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:16:23.379457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:16:23.379457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:23.379457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:16:23.379457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:16:23.379457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:16:23.379457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:16:23.379457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:16:23.382532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:16:23.382532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:16:23.382532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:16:23.382532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:16:23.382532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:16:23.382532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:16:23.382532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:16:23.382532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 766de05a-a562-4045-bdf9-c49050382e1a could not be found. Aug 07 01:16:23.382532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:16:23.382532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:16:23.382532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:16:23.382532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:23.382532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:16:23.382532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:16:23.382532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:16:23.382532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:16:23.382532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 766de05a-a562-4045-bdf9-c49050382e1a could not be found. Aug 07 01:16:23.382532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:16:23.392060 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a8bf30f5-dfb2-4094-98fa-217f3be6311c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] Returning 404 to user: Instance 766de05a-a562-4045-bdf9-c49050382e1a could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:16:23.392060 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a8bf30f5-dfb2-4094-98fa-217f3be6311c tempest-ServersAdminTestJSON-40100731 tempest-ServersAdminTestJSON-40100731-project] 10.222.0.39 "GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a" status: 404 len: 111 microversion: 2.1 time: 0.142601 Aug 07 01:16:23.392060 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 652/1466] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:23 2022] GET /compute/v2.1/servers/766de05a-a562-4045-bdf9-c49050382e1a => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:16:23.676285 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f301d48f-f452-45b8-aa6c-fb789fab60af tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:23.677893 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f301d48f-f452-45b8-aa6c-fb789fab60af tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:23.692133 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f301d48f-f452-45b8-aa6c-fb789fab60af tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:23.694105 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f301d48f-f452-45b8-aa6c-fb789fab60af tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:23.695316 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f301d48f-f452-45b8-aa6c-fb789fab60af tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:23.697483 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f301d48f-f452-45b8-aa6c-fb789fab60af tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:23.698632 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f301d48f-f452-45b8-aa6c-fb789fab60af tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:23.700614 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f301d48f-f452-45b8-aa6c-fb789fab60af tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:23.763132 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9413ba6b-a43b-4e7a-9801-0f1a3114314f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:23.771782 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9413ba6b-a43b-4e7a-9801-0f1a3114314f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 0890f070-088c-4cc8-96ec-e3b5cbe33a29] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:23.793337 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9413ba6b-a43b-4e7a-9801-0f1a3114314f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:23.794827 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9413ba6b-a43b-4e7a-9801-0f1a3114314f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:23.796269 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9413ba6b-a43b-4e7a-9801-0f1a3114314f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:23.797956 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9413ba6b-a43b-4e7a-9801-0f1a3114314f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:23.799133 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9413ba6b-a43b-4e7a-9801-0f1a3114314f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:23.802166 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9413ba6b-a43b-4e7a-9801-0f1a3114314f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:23.903576 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f301d48f-f452-45b8-aa6c-fb789fab60af tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:23.923910 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f301d48f-f452-45b8-aa6c-fb789fab60af tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1337 microversion: 2.1 time: 0.255161 Aug 07 01:16:23.929306 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 815/1467] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:23 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1337 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:16:24.763617 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9413ba6b-a43b-4e7a-9801-0f1a3114314f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:24.781572 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9413ba6b-a43b-4e7a-9801-0f1a3114314f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29" status: 200 len: 1472 microversion: 2.1 time: 1.026897 Aug 07 01:16:24.782488 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 653/1468] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:23 2022] GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29 => generated 1472 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:24.963624 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f1955b11-610e-4837-b7fe-d2004c2fee66 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:24.965110 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f1955b11-610e-4837-b7fe-d2004c2fee66 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:24.987980 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f1955b11-610e-4837-b7fe-d2004c2fee66 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:24.989724 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f1955b11-610e-4837-b7fe-d2004c2fee66 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:24.990356 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f1955b11-610e-4837-b7fe-d2004c2fee66 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:24.991328 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f1955b11-610e-4837-b7fe-d2004c2fee66 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:24.992031 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f1955b11-610e-4837-b7fe-d2004c2fee66 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:24.992788 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f1955b11-610e-4837-b7fe-d2004c2fee66 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:25.292533 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f1955b11-610e-4837-b7fe-d2004c2fee66 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:25.305055 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f1955b11-610e-4837-b7fe-d2004c2fee66 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1337 microversion: 2.1 time: 0.345803 Aug 07 01:16:25.332398 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 816/1469] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:24 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1337 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:16:25.827230 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-298b2f6c-7277-4920-84c1-556b25eb565b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:25.828037 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-298b2f6c-7277-4920-84c1-556b25eb565b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 0890f070-088c-4cc8-96ec-e3b5cbe33a29] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:25.867331 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-298b2f6c-7277-4920-84c1-556b25eb565b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:25.875569 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-298b2f6c-7277-4920-84c1-556b25eb565b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:25.876675 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-298b2f6c-7277-4920-84c1-556b25eb565b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:25.878578 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-298b2f6c-7277-4920-84c1-556b25eb565b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:25.880363 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-298b2f6c-7277-4920-84c1-556b25eb565b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:25.881463 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-298b2f6c-7277-4920-84c1-556b25eb565b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:26.357518 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9e275e73-fb38-4c0b-9ec6-d3ba357408e5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:26.359778 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9e275e73-fb38-4c0b-9ec6-d3ba357408e5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:26.395119 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e275e73-fb38-4c0b-9ec6-d3ba357408e5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:26.413594 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e275e73-fb38-4c0b-9ec6-d3ba357408e5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:26.417383 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e275e73-fb38-4c0b-9ec6-d3ba357408e5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:26.428522 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e275e73-fb38-4c0b-9ec6-d3ba357408e5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:26.429940 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e275e73-fb38-4c0b-9ec6-d3ba357408e5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:26.431003 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e275e73-fb38-4c0b-9ec6-d3ba357408e5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:26.870173 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:26.998736 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9e275e73-fb38-4c0b-9ec6-d3ba357408e5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:27.014522 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9e275e73-fb38-4c0b-9ec6-d3ba357408e5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1379 microversion: 2.1 time: 0.663486 Aug 07 01:16:27.016066 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 817/1470] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:26 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1379 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:27.024359 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4287009e-d12a-42e2-ae3e-e234ab0c2e02 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e24af83a0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:27.141404 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4287009e-d12a-42e2-ae3e-e234ab0c2e02 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/8abad97a-a031-4524-97bc-f39c9adaefcd" status: 200 len: 662 microversion: 2.1 time: 0.123529 Aug 07 01:16:27.142685 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 818/1471] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:16:27 2022] GET /compute/v2.1/images/8abad97a-a031-4524-97bc-f39c9adaefcd => generated 662 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:16:27.172322 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b31e4058-1a9a-4844-a2f3-5763fc597729 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e24c6ce50>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:27.335721 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b31e4058-1a9a-4844-a2f3-5763fc597729 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/8abad97a-a031-4524-97bc-f39c9adaefcd" status: 200 len: 662 microversion: 2.1 time: 0.179452 Aug 07 01:16:27.336732 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 819/1472] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:16:27 2022] GET /compute/v2.1/images/8abad97a-a031-4524-97bc-f39c9adaefcd => generated 662 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:16:27.855699 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-6efb3ab0-335d-4b71-a6a0-246fd7f157e8 req-012bd455-5165-4cfc-ab3e-953f077625b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0890f070-088c-4cc8-96ec-e3b5cbe33a29", "name": "network-vif-deleted", "tag": "9ac6f021-ad62-460a-85d5-81c012eec679"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:16:27.872265 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=8 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:27.950855 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6efb3ab0-335d-4b71-a6a0-246fd7f157e8 req-012bd455-5165-4cfc-ab3e-953f077625b3 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:27.951634 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6efb3ab0-335d-4b71-a6a0-246fd7f157e8 req-012bd455-5165-4cfc-ab3e-953f077625b3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:27.952381 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6efb3ab0-335d-4b71-a6a0-246fd7f157e8 req-012bd455-5165-4cfc-ab3e-953f077625b3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:28.015316 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-6efb3ab0-335d-4b71-a6a0-246fd7f157e8 req-012bd455-5165-4cfc-ab3e-953f077625b3 service nova] Creating event network-vif-deleted:9ac6f021-ad62-460a-85d5-81c012eec679 for instance 0890f070-088c-4cc8-96ec-e3b5cbe33a29 on n-h2-master-1 Aug 07 01:16:28.028785 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-6efb3ab0-335d-4b71-a6a0-246fd7f157e8 req-012bd455-5165-4cfc-ab3e-953f077625b3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178614 Aug 07 01:16:28.043439 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 820/1473] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:16:28.066413 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d6166d5e-faf7-48f3-b0fe-c7fe568c72a9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:28.068319 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d6166d5e-faf7-48f3-b0fe-c7fe568c72a9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:28.099712 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6166d5e-faf7-48f3-b0fe-c7fe568c72a9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:28.116859 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6166d5e-faf7-48f3-b0fe-c7fe568c72a9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:28.120261 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6166d5e-faf7-48f3-b0fe-c7fe568c72a9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:28.125298 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6166d5e-faf7-48f3-b0fe-c7fe568c72a9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:28.126499 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6166d5e-faf7-48f3-b0fe-c7fe568c72a9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:28.127561 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6166d5e-faf7-48f3-b0fe-c7fe568c72a9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:28.518486 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d6166d5e-faf7-48f3-b0fe-c7fe568c72a9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:28.567693 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d6166d5e-faf7-48f3-b0fe-c7fe568c72a9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1379 microversion: 2.1 time: 0.507283 Aug 07 01:16:28.570780 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 821/1474] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:28 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1379 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:28.699923 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-298b2f6c-7277-4920-84c1-556b25eb565b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:28.727032 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-298b2f6c-7277-4920-84c1-556b25eb565b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29" status: 200 len: 1472 microversion: 2.1 time: 2.903125 Aug 07 01:16:28.728224 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 654/1475] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:25 2022] GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29 => generated 1472 bytes in 2909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:29.614550 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d58485ec-9493-4603-b26e-ed04eb5ef192 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:29.615904 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d58485ec-9493-4603-b26e-ed04eb5ef192 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:29.655236 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d58485ec-9493-4603-b26e-ed04eb5ef192 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:29.668572 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d58485ec-9493-4603-b26e-ed04eb5ef192 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:29.669499 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d58485ec-9493-4603-b26e-ed04eb5ef192 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:29.670808 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d58485ec-9493-4603-b26e-ed04eb5ef192 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:29.671565 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d58485ec-9493-4603-b26e-ed04eb5ef192 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:29.698760 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d58485ec-9493-4603-b26e-ed04eb5ef192 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:29.764464 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-15eddb18-a725-43d3-bb10-14854e105657 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:29.771532 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-15eddb18-a725-43d3-bb10-14854e105657 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 0890f070-088c-4cc8-96ec-e3b5cbe33a29] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:29.807128 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15eddb18-a725-43d3-bb10-14854e105657 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:29.808000 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15eddb18-a725-43d3-bb10-14854e105657 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:29.808754 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15eddb18-a725-43d3-bb10-14854e105657 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:29.809978 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15eddb18-a725-43d3-bb10-14854e105657 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:29.810814 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15eddb18-a725-43d3-bb10-14854e105657 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:29.822994 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15eddb18-a725-43d3-bb10-14854e105657 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:29.871265 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-15eddb18-a725-43d3-bb10-14854e105657 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] HTTP exception thrown: Instance 0890f070-088c-4cc8-96ec-e3b5cbe33a29 could not be found. Aug 07 01:16:29.876633 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-15eddb18-a725-43d3-bb10-14854e105657 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Request method failure captured: Aug 07 01:16:29.876633 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29 HTTP/1.1 Aug 07 01:16:29.876633 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:16:29.876633 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:16:29.876633 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:16:29.876633 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:16:29.876633 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:16:29.876633 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:16:29.876633 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:16:29.876633 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:16:29.876633 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xGgZk2s0TuGzjJ8Xb6l7TnV8b2-7iInqh8WC73CRWxSE0_rne48-_XKuRGb9kyv1AQzpFFJZcYYqYPMbhYC4_BIHJInCNDeosVwZHelUBKtqqVJND2DtGLIn9MgrQRQOOb_QIwQOiIjRrXCbSodF39r4CP0D2xvEnYTXsUUzANa4KA Aug 07 01:16:29.876633 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:16:29.876633 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:16:29.876633 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:16:29.876633 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:16:29.876633 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:16:29.876633 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:16:29.876633 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: d08d010c14a64f759887be0d2364c6e4 Aug 07 01:16:29.876633 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersOnMultiNodesTest-1089196105 Aug 07 01:16:29.876633 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:16:29.876633 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:16:29.878128 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d08d010c14a64f759887be0d2364c6e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d08d010c14a64f759887be0d2364c6e4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d08d010c14a64f759887be0d2364c6e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d08d010c14a64f759887be0d2364c6e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:16:29.878128 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersOnMultiNodesTest-1089196105 Aug 07 01:16:29.878128 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: d08d010c14a64f759887be0d2364c6e4 Aug 07 01:16:29.878128 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1089196105 Aug 07 01:16:29.878128 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersOnMultiNodesTest-1089196105-project Aug 07 01:16:29.878128 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:16:29.878128 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:16:29.878128 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 32fc1959d8aa41eabcead217b9d7bc47 Aug 07 01:16:29.878128 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersOnMultiNodesTest-1089196105-project Aug 07 01:16:29.878128 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:16:29.878128 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 0890f070-088c-4cc8-96ec-e3b5cbe33a29 could not be found. Aug 07 01:16:29.878128 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '0890f070-088c-4cc8-96ec-e3b5cbe33a29'} Aug 07 01:16:29.879756 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:16:29.879756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:29.879756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:16:29.879756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:16:29.879756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:16:29.879756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:16:29.879756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:16:29.879756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:16:29.879756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:16:29.879756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:16:29.879756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0890f070-088c-4cc8-96ec-e3b5cbe33a29 could not be found. Aug 07 01:16:29.879756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:16:29.879756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:16:29.879756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:16:29.879756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:29.879756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:16:29.879756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:16:29.879756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:16:29.879756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:16:29.879756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:16:29.883689 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:16:29.883689 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:16:29.883689 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:16:29.883689 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:16:29.883689 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:16:29.883689 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:16:29.883689 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:16:29.883689 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0890f070-088c-4cc8-96ec-e3b5cbe33a29 could not be found. Aug 07 01:16:29.883689 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:16:29.883689 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:16:29.883689 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:16:29.883689 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:29.883689 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:16:29.883689 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:16:29.883689 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:16:29.883689 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:16:29.883689 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0890f070-088c-4cc8-96ec-e3b5cbe33a29 could not be found. Aug 07 01:16:29.883689 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:16:29.895235 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-15eddb18-a725-43d3-bb10-14854e105657 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Returning 404 to user: Instance 0890f070-088c-4cc8-96ec-e3b5cbe33a29 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:16:29.897197 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-15eddb18-a725-43d3-bb10-14854e105657 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29" status: 404 len: 111 microversion: 2.1 time: 0.142383 Aug 07 01:16:29.900133 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 655/1476] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:29 2022] GET /compute/v2.1/servers/0890f070-088c-4cc8-96ec-e3b5cbe33a29 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:16:29.956162 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-50c4c040-6140-474f-b3f2-910751b525f0 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:29.958269 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-50c4c040-6140-474f-b3f2-910751b525f0 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: a0c22e90-af12-4699-beb3-463ba9e81e65] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:30.015976 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-50c4c040-6140-474f-b3f2-910751b525f0 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:30.031469 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-50c4c040-6140-474f-b3f2-910751b525f0 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:30.032398 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-50c4c040-6140-474f-b3f2-910751b525f0 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:30.033776 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-50c4c040-6140-474f-b3f2-910751b525f0 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:30.036118 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-50c4c040-6140-474f-b3f2-910751b525f0 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:30.037375 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-50c4c040-6140-474f-b3f2-910751b525f0 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:30.163160 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-50c4c040-6140-474f-b3f2-910751b525f0 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: a0c22e90-af12-4699-beb3-463ba9e81e65] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:16:30.220899 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d58485ec-9493-4603-b26e-ed04eb5ef192 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:30.238771 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d58485ec-9493-4603-b26e-ed04eb5ef192 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1379 microversion: 2.1 time: 0.632554 Aug 07 01:16:30.258008 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 822/1477] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:29 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1379 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:16:30.277627 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7e90debb-740f-46b7-8bd2-69ed7abafa06 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e24fcf5e0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:30.435112 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7e90debb-740f-46b7-8bd2-69ed7abafa06 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/14dcfc2b-064a-40e6-b55e-ad5252a4559d" status: 200 len: 661 microversion: 2.1 time: 0.175353 Aug 07 01:16:30.436208 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 823/1478] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:16:30 2022] GET /compute/v2.1/images/14dcfc2b-064a-40e6-b55e-ad5252a4559d => generated 661 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:16:30.458979 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:30.471312 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-771a20d1-e2eb-4fed-b7c6-81ddef84d0bb tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e243eb5e0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:30.585059 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-771a20d1-e2eb-4fed-b7c6-81ddef84d0bb tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/14dcfc2b-064a-40e6-b55e-ad5252a4559d" status: 200 len: 661 microversion: 2.1 time: 0.136534 Aug 07 01:16:30.586667 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-50c4c040-6140-474f-b3f2-910751b525f0 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a0c22e90-af12-4699-beb3-463ba9e81e65" status: 204 len: 0 microversion: 2.1 time: 0.675689 Aug 07 01:16:30.587910 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 824/1479] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:16:30 2022] GET /compute/v2.1/images/14dcfc2b-064a-40e6-b55e-ad5252a4559d => generated 661 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:16:30.599643 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 656/1480] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:16:29 2022] DELETE /compute/v2.1/servers/a0c22e90-af12-4699-beb3-463ba9e81e65 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:16:30.642134 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1918eb9f-e46f-459a-b95d-ea86cba28bfb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:30.664611 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1918eb9f-e46f-459a-b95d-ea86cba28bfb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: a0c22e90-af12-4699-beb3-463ba9e81e65] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:30.691738 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1918eb9f-e46f-459a-b95d-ea86cba28bfb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:30.709110 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1918eb9f-e46f-459a-b95d-ea86cba28bfb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:30.709987 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1918eb9f-e46f-459a-b95d-ea86cba28bfb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:30.711453 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1918eb9f-e46f-459a-b95d-ea86cba28bfb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:30.712516 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1918eb9f-e46f-459a-b95d-ea86cba28bfb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:30.713463 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1918eb9f-e46f-459a-b95d-ea86cba28bfb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:31.283379 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a8b0789d-5f07-45b4-b98f-e5373bfd6fd3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:31.284450 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a8b0789d-5f07-45b4-b98f-e5373bfd6fd3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:31.311641 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8b0789d-5f07-45b4-b98f-e5373bfd6fd3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:31.312178 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8b0789d-5f07-45b4-b98f-e5373bfd6fd3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:31.316056 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8b0789d-5f07-45b4-b98f-e5373bfd6fd3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:31.318534 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8b0789d-5f07-45b4-b98f-e5373bfd6fd3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:31.323462 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8b0789d-5f07-45b4-b98f-e5373bfd6fd3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:31.324081 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8b0789d-5f07-45b4-b98f-e5373bfd6fd3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:31.727744 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a8b0789d-5f07-45b4-b98f-e5373bfd6fd3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:31.758356 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a8b0789d-5f07-45b4-b98f-e5373bfd6fd3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1379 microversion: 2.1 time: 0.479693 Aug 07 01:16:31.781026 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 825/1481] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:31 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1379 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:16:31.795630 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1918eb9f-e46f-459a-b95d-ea86cba28bfb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:31.835374 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1918eb9f-e46f-459a-b95d-ea86cba28bfb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/a0c22e90-af12-4699-beb3-463ba9e81e65" status: 200 len: 1472 microversion: 2.1 time: 1.240407 Aug 07 01:16:31.845243 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 657/1482] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:30 2022] GET /compute/v2.1/servers/a0c22e90-af12-4699-beb3-463ba9e81e65 => generated 1472 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:32.794841 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9609b583-87f2-4b10-9ab1-bbe2a1702ccb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:32.795497 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9609b583-87f2-4b10-9ab1-bbe2a1702ccb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:32.832968 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9609b583-87f2-4b10-9ab1-bbe2a1702ccb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:32.833649 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9609b583-87f2-4b10-9ab1-bbe2a1702ccb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:32.834112 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9609b583-87f2-4b10-9ab1-bbe2a1702ccb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:32.834881 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9609b583-87f2-4b10-9ab1-bbe2a1702ccb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:32.854316 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9609b583-87f2-4b10-9ab1-bbe2a1702ccb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:32.855700 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9609b583-87f2-4b10-9ab1-bbe2a1702ccb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:32.892590 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-773f83c0-c554-4ac5-9235-cca9dbff07a1 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:32.893455 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-773f83c0-c554-4ac5-9235-cca9dbff07a1 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: a0c22e90-af12-4699-beb3-463ba9e81e65] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:32.946041 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-773f83c0-c554-4ac5-9235-cca9dbff07a1 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:32.947476 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-773f83c0-c554-4ac5-9235-cca9dbff07a1 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:32.952019 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-773f83c0-c554-4ac5-9235-cca9dbff07a1 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:32.955254 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-773f83c0-c554-4ac5-9235-cca9dbff07a1 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:32.956613 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-773f83c0-c554-4ac5-9235-cca9dbff07a1 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:32.960962 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-773f83c0-c554-4ac5-9235-cca9dbff07a1 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:33.587639 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9609b583-87f2-4b10-9ab1-bbe2a1702ccb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:33.624021 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9609b583-87f2-4b10-9ab1-bbe2a1702ccb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1379 microversion: 2.1 time: 0.834410 Aug 07 01:16:33.654770 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 826/1483] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:32 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1379 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:16:33.671107 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-25abf19b-09d9-4223-9ed4-0e31e2ff76de tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e243ebe50>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:33.859970 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-25abf19b-09d9-4223-9ed4-0e31e2ff76de tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/fb61e884-43f2-401a-a642-2bb83f6bbd9b" status: 200 len: 661 microversion: 2.1 time: 0.203116 Aug 07 01:16:33.867181 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 827/1484] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:16:33 2022] GET /compute/v2.1/images/fb61e884-43f2-401a-a642-2bb83f6bbd9b => generated 661 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:16:33.881994 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-937872c8-8a1f-4210-aaf1-f50b5e735144 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e24389a60>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:33.980697 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-937872c8-8a1f-4210-aaf1-f50b5e735144 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/fb61e884-43f2-401a-a642-2bb83f6bbd9b" status: 200 len: 661 microversion: 2.1 time: 0.103961 Aug 07 01:16:33.997750 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 828/1485] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:16:33 2022] GET /compute/v2.1/images/fb61e884-43f2-401a-a642-2bb83f6bbd9b => generated 661 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:16:34.460516 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9b85ab84-38a7-4967-bf64-b7fbace2a2c9 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-881554257", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:16:34.563297 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-773f83c0-c554-4ac5-9235-cca9dbff07a1 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:34.600924 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-773f83c0-c554-4ac5-9235-cca9dbff07a1 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/a0c22e90-af12-4699-beb3-463ba9e81e65" status: 200 len: 1472 microversion: 2.1 time: 1.711247 Aug 07 01:16:34.604704 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 658/1486] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:32 2022] GET /compute/v2.1/servers/a0c22e90-af12-4699-beb3-463ba9e81e65 => generated 1472 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:16:34.666451 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-25f08cd3-da58-4fb1-97e4-08dd164ef95c req-42926dad-a767-4951-be93-27de3593e597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0c22e90-af12-4699-beb3-463ba9e81e65", "name": "network-vif-deleted", "tag": "491053e5-fdac-48b2-90c6-30b5040e819b"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:16:34.666831 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-9b85ab84-38a7-4967-bf64-b7fbace2a2c9 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] validate_networks() for None {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:16:34.729278 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-25f08cd3-da58-4fb1-97e4-08dd164ef95c req-42926dad-a767-4951-be93-27de3593e597 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:34.740717 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-25f08cd3-da58-4fb1-97e4-08dd164ef95c req-42926dad-a767-4951-be93-27de3593e597 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:34.742314 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-25f08cd3-da58-4fb1-97e4-08dd164ef95c req-42926dad-a767-4951-be93-27de3593e597 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:34.803164 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-25f08cd3-da58-4fb1-97e4-08dd164ef95c req-42926dad-a767-4951-be93-27de3593e597 service nova] Creating event network-vif-deleted:491053e5-fdac-48b2-90c6-30b5040e819b for instance a0c22e90-af12-4699-beb3-463ba9e81e65 on n-h1-master-1 Aug 07 01:16:34.814151 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-25f08cd3-da58-4fb1-97e4-08dd164ef95c req-42926dad-a767-4951-be93-27de3593e597 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182374 Aug 07 01:16:34.817112 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 659/1487] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:16:34.828918 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-20300e24-40f5-44d8-a22e-3f95c325bafe tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:34.830886 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-20300e24-40f5-44d8-a22e-3f95c325bafe tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:34.850229 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-20300e24-40f5-44d8-a22e-3f95c325bafe tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:34.858830 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-20300e24-40f5-44d8-a22e-3f95c325bafe tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:34.860320 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-20300e24-40f5-44d8-a22e-3f95c325bafe tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:34.861931 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-20300e24-40f5-44d8-a22e-3f95c325bafe tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:34.863643 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-20300e24-40f5-44d8-a22e-3f95c325bafe tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:34.865301 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-20300e24-40f5-44d8-a22e-3f95c325bafe tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:35.392556 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-9b85ab84-38a7-4967-bf64-b7fbace2a2c9 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:16:35.393258 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-9b85ab84-38a7-4967-bf64-b7fbace2a2c9 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:16:35.395018 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-9b85ab84-38a7-4967-bf64-b7fbace2a2c9 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:16:35.396530 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-9b85ab84-38a7-4967-bf64-b7fbace2a2c9 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:16:35.397470 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-9b85ab84-38a7-4967-bf64-b7fbace2a2c9 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:16:35.444464 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b85ab84-38a7-4967-bf64-b7fbace2a2c9 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:35.445420 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b85ab84-38a7-4967-bf64-b7fbace2a2c9 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:35.446189 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b85ab84-38a7-4967-bf64-b7fbace2a2c9 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:35.464728 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b85ab84-38a7-4967-bf64-b7fbace2a2c9 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:35.465930 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b85ab84-38a7-4967-bf64-b7fbace2a2c9 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:35.467036 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b85ab84-38a7-4967-bf64-b7fbace2a2c9 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:35.539064 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-9b85ab84-38a7-4967-bf64-b7fbace2a2c9 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Getting quotas for project 614797cd26be4995b087ab864f35d235. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:16:35.558531 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-9b85ab84-38a7-4967-bf64-b7fbace2a2c9 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Getting quotas for user 786962988b754fb69bd48070c2992e13 and project 614797cd26be4995b087ab864f35d235. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:16:35.610332 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9b85ab84-38a7-4967-bf64-b7fbace2a2c9 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:16:35.617168 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9b85ab84-38a7-4967-bf64-b7fbace2a2c9 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] [instance: d2dbfd1a-efab-4943-b00a-6cdd1051489c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:16:35.801422 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9b85ab84-38a7-4967-bf64-b7fbace2a2c9 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.348825 Aug 07 01:16:35.803966 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 829/1488] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:16:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:16:35.813486 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9465a76a-a2c8-4128-aa1a-c40cd91dbed9 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:35.815459 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9465a76a-a2c8-4128-aa1a-c40cd91dbed9 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: a0c22e90-af12-4699-beb3-463ba9e81e65] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:35.849549 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9465a76a-a2c8-4128-aa1a-c40cd91dbed9 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:35.864195 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9465a76a-a2c8-4128-aa1a-c40cd91dbed9 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:35.871071 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9465a76a-a2c8-4128-aa1a-c40cd91dbed9 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:35.873491 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9465a76a-a2c8-4128-aa1a-c40cd91dbed9 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:35.874752 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9465a76a-a2c8-4128-aa1a-c40cd91dbed9 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:35.879739 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9465a76a-a2c8-4128-aa1a-c40cd91dbed9 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:35.941776 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-9465a76a-a2c8-4128-aa1a-c40cd91dbed9 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] HTTP exception thrown: Instance a0c22e90-af12-4699-beb3-463ba9e81e65 could not be found. Aug 07 01:16:35.948316 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9465a76a-a2c8-4128-aa1a-c40cd91dbed9 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Request method failure captured: Aug 07 01:16:35.948316 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/a0c22e90-af12-4699-beb3-463ba9e81e65 HTTP/1.1 Aug 07 01:16:35.948316 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:16:35.948316 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:16:35.948316 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:16:35.948316 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:16:35.948316 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:16:35.948316 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:16:35.948316 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:16:35.948316 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:16:35.948316 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xGgZk2s0TuGzjJ8Xb6l7TnV8b2-7iInqh8WC73CRWxSE0_rne48-_XKuRGb9kyv1AQzpFFJZcYYqYPMbhYC4_BIHJInCNDeosVwZHelUBKtqqVJND2DtGLIn9MgrQRQOOb_QIwQOiIjRrXCbSodF39r4CP0D2xvEnYTXsUUzANa4KA Aug 07 01:16:35.948316 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:16:35.948316 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:16:35.948316 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:16:35.948316 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:16:35.948316 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:16:35.948316 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:16:35.948316 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: d08d010c14a64f759887be0d2364c6e4 Aug 07 01:16:35.948316 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersOnMultiNodesTest-1089196105 Aug 07 01:16:35.948316 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:16:35.948316 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:16:35.951005 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d08d010c14a64f759887be0d2364c6e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d08d010c14a64f759887be0d2364c6e4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d08d010c14a64f759887be0d2364c6e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d08d010c14a64f759887be0d2364c6e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:16:35.951005 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersOnMultiNodesTest-1089196105 Aug 07 01:16:35.951005 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: d08d010c14a64f759887be0d2364c6e4 Aug 07 01:16:35.951005 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1089196105 Aug 07 01:16:35.951005 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersOnMultiNodesTest-1089196105-project Aug 07 01:16:35.951005 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:16:35.951005 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:16:35.951005 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 32fc1959d8aa41eabcead217b9d7bc47 Aug 07 01:16:35.951005 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersOnMultiNodesTest-1089196105-project Aug 07 01:16:35.951005 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:16:35.951005 n-d-master-1 devstack@n-api.service[119516]: exception: Instance a0c22e90-af12-4699-beb3-463ba9e81e65 could not be found. Aug 07 01:16:35.951005 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'a0c22e90-af12-4699-beb3-463ba9e81e65'} Aug 07 01:16:35.952505 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:16:35.952505 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:35.952505 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:16:35.952505 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:16:35.952505 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:16:35.952505 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:16:35.952505 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:16:35.952505 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:16:35.952505 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:16:35.952505 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:16:35.952505 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0c22e90-af12-4699-beb3-463ba9e81e65 could not be found. Aug 07 01:16:35.952505 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:16:35.952505 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:16:35.952505 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:16:35.952505 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:35.952505 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:16:35.952505 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:16:35.952505 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:16:35.952505 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:16:35.952505 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:16:35.955870 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:16:35.955870 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:16:35.955870 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:16:35.955870 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:16:35.955870 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:16:35.955870 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:16:35.955870 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:16:35.955870 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0c22e90-af12-4699-beb3-463ba9e81e65 could not be found. Aug 07 01:16:35.955870 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:16:35.955870 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:16:35.955870 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:16:35.955870 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:35.955870 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:16:35.955870 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:16:35.955870 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:16:35.955870 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:16:35.955870 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0c22e90-af12-4699-beb3-463ba9e81e65 could not be found. Aug 07 01:16:35.955870 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:16:35.963327 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9465a76a-a2c8-4128-aa1a-c40cd91dbed9 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Returning 404 to user: Instance a0c22e90-af12-4699-beb3-463ba9e81e65 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:16:35.971605 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9465a76a-a2c8-4128-aa1a-c40cd91dbed9 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/a0c22e90-af12-4699-beb3-463ba9e81e65" status: 404 len: 111 microversion: 2.1 time: 0.163610 Aug 07 01:16:35.974360 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 830/1489] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:35 2022] GET /compute/v2.1/servers/a0c22e90-af12-4699-beb3-463ba9e81e65 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:16:35.988733 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1d121910-d81c-4b2a-9446-eddbf3ad030d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:35.989976 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1d121910-d81c-4b2a-9446-eddbf3ad030d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 2142aec1-a473-42c4-8676-84c497d613e3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:36.020887 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d121910-d81c-4b2a-9446-eddbf3ad030d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:36.022368 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d121910-d81c-4b2a-9446-eddbf3ad030d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:36.023630 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d121910-d81c-4b2a-9446-eddbf3ad030d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:36.025603 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d121910-d81c-4b2a-9446-eddbf3ad030d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:36.027076 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d121910-d81c-4b2a-9446-eddbf3ad030d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:36.028204 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d121910-d81c-4b2a-9446-eddbf3ad030d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:36.136309 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1d121910-d81c-4b2a-9446-eddbf3ad030d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 2142aec1-a473-42c4-8676-84c497d613e3] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:16:36.254311 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:36.419077 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1d121910-d81c-4b2a-9446-eddbf3ad030d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3" status: 204 len: 0 microversion: 2.1 time: 0.436858 Aug 07 01:16:36.422326 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 831/1490] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:16:35 2022] DELETE /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:16:36.445242 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9c2754e8-2016-4b45-a276-b8e40f7012db tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-41335819", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:16:36.578752 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-9c2754e8-2016-4b45-a276-b8e40f7012db tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] validate_networks() for None {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:16:36.799053 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-20300e24-40f5-44d8-a22e-3f95c325bafe tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:36.833597 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-20300e24-40f5-44d8-a22e-3f95c325bafe tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1379 microversion: 2.1 time: 2.013442 Aug 07 01:16:36.836864 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 660/1491] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:34 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1379 bytes in 2017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:36.850779 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3fc4ed4c-ff29-4c22-a73c-a4ca31242bd3 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:36.861136 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3fc4ed4c-ff29-4c22-a73c-a4ca31242bd3 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 2142aec1-a473-42c4-8676-84c497d613e3] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:36.887596 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3fc4ed4c-ff29-4c22-a73c-a4ca31242bd3 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:36.888969 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3fc4ed4c-ff29-4c22-a73c-a4ca31242bd3 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:36.890255 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3fc4ed4c-ff29-4c22-a73c-a4ca31242bd3 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:36.890734 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3fc4ed4c-ff29-4c22-a73c-a4ca31242bd3 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:36.891620 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3fc4ed4c-ff29-4c22-a73c-a4ca31242bd3 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:36.892697 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3fc4ed4c-ff29-4c22-a73c-a4ca31242bd3 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:37.183683 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-9c2754e8-2016-4b45-a276-b8e40f7012db tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:16:37.185708 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-9c2754e8-2016-4b45-a276-b8e40f7012db tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:16:37.192827 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-9c2754e8-2016-4b45-a276-b8e40f7012db tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:16:37.194234 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-9c2754e8-2016-4b45-a276-b8e40f7012db tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:16:37.206329 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-9c2754e8-2016-4b45-a276-b8e40f7012db tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:16:37.239693 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c2754e8-2016-4b45-a276-b8e40f7012db tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:37.241009 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c2754e8-2016-4b45-a276-b8e40f7012db tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:37.241954 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c2754e8-2016-4b45-a276-b8e40f7012db tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:37.243630 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c2754e8-2016-4b45-a276-b8e40f7012db tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:37.244665 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c2754e8-2016-4b45-a276-b8e40f7012db tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:37.245658 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c2754e8-2016-4b45-a276-b8e40f7012db tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:37.296637 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-9c2754e8-2016-4b45-a276-b8e40f7012db tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Getting quotas for project 614797cd26be4995b087ab864f35d235. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:16:37.320138 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-9c2754e8-2016-4b45-a276-b8e40f7012db tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Getting quotas for user 786962988b754fb69bd48070c2992e13 and project 614797cd26be4995b087ab864f35d235. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:16:37.355059 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9c2754e8-2016-4b45-a276-b8e40f7012db tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:16:37.360775 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9c2754e8-2016-4b45-a276-b8e40f7012db tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] [instance: 9e2ae24f-8349-46d5-b091-876927d02b68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:16:37.467632 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=8,nova_api:UPDATE=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:37.566838 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9c2754e8-2016-4b45-a276-b8e40f7012db tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.141593 Aug 07 01:16:37.569235 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 832/1492] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:16:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1146 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:16:37.602381 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-b0fbcb79-88cf-4c43-9cb4-4db57de0e4c3 req-fc03c2f0-7971-4d4a-88cb-d24340555e6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd1e4cce-7a53-4200-a2c1-dcabbb7f9544", "tag": "ee124f30-41ef-4d88-b49e-4ad7cac50168"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:16:37.688370 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b0fbcb79-88cf-4c43-9cb4-4db57de0e4c3 req-fc03c2f0-7971-4d4a-88cb-d24340555e6f service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:37.689280 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b0fbcb79-88cf-4c43-9cb4-4db57de0e4c3 req-fc03c2f0-7971-4d4a-88cb-d24340555e6f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:37.689984 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b0fbcb79-88cf-4c43-9cb4-4db57de0e4c3 req-fc03c2f0-7971-4d4a-88cb-d24340555e6f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:37.726726 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-b0fbcb79-88cf-4c43-9cb4-4db57de0e4c3 req-fc03c2f0-7971-4d4a-88cb-d24340555e6f service nova] Creating event network-changed:ee124f30-41ef-4d88-b49e-4ad7cac50168 for instance dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 on n-h2-master-1 Aug 07 01:16:37.738821 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-b0fbcb79-88cf-4c43-9cb4-4db57de0e4c3 req-fc03c2f0-7971-4d4a-88cb-d24340555e6f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165699 Aug 07 01:16:37.741268 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 833/1493] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:16:37.776742 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-662befcf-5241-4d76-adf1-c4f6b33b45d4 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:37.780261 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-662befcf-5241-4d76-adf1-c4f6b33b45d4 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] [instance: 9e2ae24f-8349-46d5-b091-876927d02b68] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:37.917303 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-662befcf-5241-4d76-adf1-c4f6b33b45d4 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '786962988b754fb69bd48070c2992e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614797cd26be4995b087ab864f35d235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:37.943015 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-662befcf-5241-4d76-adf1-c4f6b33b45d4 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68" status: 200 len: 1216 microversion: 2.1 time: 0.191442 Aug 07 01:16:37.946566 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 834/1494] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:37 2022] GET /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68 => generated 1216 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:37.976211 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-33a0ef08-4cfe-44ed-bfca-b5b2e4677904 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:37.979992 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-33a0ef08-4cfe-44ed-bfca-b5b2e4677904 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:38.007765 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33a0ef08-4cfe-44ed-bfca-b5b2e4677904 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:38.015929 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33a0ef08-4cfe-44ed-bfca-b5b2e4677904 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:38.020343 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33a0ef08-4cfe-44ed-bfca-b5b2e4677904 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:38.042585 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33a0ef08-4cfe-44ed-bfca-b5b2e4677904 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:38.044978 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33a0ef08-4cfe-44ed-bfca-b5b2e4677904 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:38.046003 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33a0ef08-4cfe-44ed-bfca-b5b2e4677904 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:38.372302 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3fc4ed4c-ff29-4c22-a73c-a4ca31242bd3 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:38.398096 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3fc4ed4c-ff29-4c22-a73c-a4ca31242bd3 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3" status: 200 len: 1472 microversion: 2.1 time: 1.553183 Aug 07 01:16:38.416408 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 661/1495] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:36 2022] GET /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3 => generated 1472 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:38.989642 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-186c13c3-a6b8-4d13-ae07-6e8bf5365382 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:38.990771 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-186c13c3-a6b8-4d13-ae07-6e8bf5365382 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] [instance: 9e2ae24f-8349-46d5-b091-876927d02b68] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:39.029142 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-186c13c3-a6b8-4d13-ae07-6e8bf5365382 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:39.051797 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-186c13c3-a6b8-4d13-ae07-6e8bf5365382 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:39.052386 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-186c13c3-a6b8-4d13-ae07-6e8bf5365382 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:39.057946 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-186c13c3-a6b8-4d13-ae07-6e8bf5365382 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:39.058715 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-186c13c3-a6b8-4d13-ae07-6e8bf5365382 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:39.059463 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-186c13c3-a6b8-4d13-ae07-6e8bf5365382 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:39.467684 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-33a0ef08-4cfe-44ed-bfca-b5b2e4677904 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:39.482976 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-33a0ef08-4cfe-44ed-bfca-b5b2e4677904 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1379 microversion: 2.1 time: 1.533236 Aug 07 01:16:39.484885 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 835/1496] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:37 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1379 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:39.499854 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4db13630-5e2c-4697-97cb-e21ea3b0af27 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:39.501702 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4db13630-5e2c-4697-97cb-e21ea3b0af27 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 2142aec1-a473-42c4-8676-84c497d613e3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:39.533674 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4db13630-5e2c-4697-97cb-e21ea3b0af27 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:39.536531 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4db13630-5e2c-4697-97cb-e21ea3b0af27 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:39.548051 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4db13630-5e2c-4697-97cb-e21ea3b0af27 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:39.550080 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4db13630-5e2c-4697-97cb-e21ea3b0af27 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:39.551210 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4db13630-5e2c-4697-97cb-e21ea3b0af27 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:39.552296 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4db13630-5e2c-4697-97cb-e21ea3b0af27 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:39.757814 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-186c13c3-a6b8-4d13-ae07-6e8bf5365382 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '786962988b754fb69bd48070c2992e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614797cd26be4995b087ab864f35d235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:39.771105 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-186c13c3-a6b8-4d13-ae07-6e8bf5365382 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68" status: 200 len: 1220 microversion: 2.1 time: 0.798292 Aug 07 01:16:39.777171 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 662/1497] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:38 2022] GET /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68 => generated 1220 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:40.170189 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4db13630-5e2c-4697-97cb-e21ea3b0af27 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:40.183040 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4db13630-5e2c-4697-97cb-e21ea3b0af27 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3" status: 200 len: 1472 microversion: 2.1 time: 0.695300 Aug 07 01:16:40.192333 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 836/1498] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:39 2022] GET /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3 => generated 1472 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:40.315125 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-0b2275a8-4563-4db3-8d4d-7c2133ed70d7 req-b56c7739-5e3a-47d6-b72f-2896a402ec31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2142aec1-a473-42c4-8676-84c497d613e3", "name": "network-vif-deleted", "tag": "ef8dba12-291c-4f4b-95b1-f3f27fd5288b"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:16:40.350145 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0b2275a8-4563-4db3-8d4d-7c2133ed70d7 req-b56c7739-5e3a-47d6-b72f-2896a402ec31 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:40.364363 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0b2275a8-4563-4db3-8d4d-7c2133ed70d7 req-b56c7739-5e3a-47d6-b72f-2896a402ec31 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:40.366045 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0b2275a8-4563-4db3-8d4d-7c2133ed70d7 req-b56c7739-5e3a-47d6-b72f-2896a402ec31 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:40.418587 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-0b2275a8-4563-4db3-8d4d-7c2133ed70d7 req-b56c7739-5e3a-47d6-b72f-2896a402ec31 service nova] Creating event network-vif-deleted:ef8dba12-291c-4f4b-95b1-f3f27fd5288b for instance 2142aec1-a473-42c4-8676-84c497d613e3 on n-h1-master-1 Aug 07 01:16:40.424459 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-0b2275a8-4563-4db3-8d4d-7c2133ed70d7 req-b56c7739-5e3a-47d6-b72f-2896a402ec31 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113668 Aug 07 01:16:40.428224 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 663/1499] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:16:40.516176 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cc54de0d-21d9-4205-a58a-c64e57df53de tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:40.516846 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cc54de0d-21d9-4205-a58a-c64e57df53de tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:40.526274 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc54de0d-21d9-4205-a58a-c64e57df53de tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:40.526774 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc54de0d-21d9-4205-a58a-c64e57df53de tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:40.527438 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc54de0d-21d9-4205-a58a-c64e57df53de tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:40.531385 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc54de0d-21d9-4205-a58a-c64e57df53de tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:40.532859 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc54de0d-21d9-4205-a58a-c64e57df53de tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:40.533556 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc54de0d-21d9-4205-a58a-c64e57df53de tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:40.804417 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f5f43286-14bf-4eba-aeef-9b4bc85584e2 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:40.806252 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f5f43286-14bf-4eba-aeef-9b4bc85584e2 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] [instance: 9e2ae24f-8349-46d5-b091-876927d02b68] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:40.815498 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f5f43286-14bf-4eba-aeef-9b4bc85584e2 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:40.817991 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f5f43286-14bf-4eba-aeef-9b4bc85584e2 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:40.818799 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f5f43286-14bf-4eba-aeef-9b4bc85584e2 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:40.820155 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f5f43286-14bf-4eba-aeef-9b4bc85584e2 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:40.823081 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f5f43286-14bf-4eba-aeef-9b4bc85584e2 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:40.824189 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f5f43286-14bf-4eba-aeef-9b4bc85584e2 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:41.384449 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cc54de0d-21d9-4205-a58a-c64e57df53de tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:41.414152 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cc54de0d-21d9-4205-a58a-c64e57df53de tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1379 microversion: 2.1 time: 0.910603 Aug 07 01:16:41.428059 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 837/1500] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:40 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1379 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:41.428059 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-34bd80c5-cb68-461a-a4db-89f8c7dfa81f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:41.428901 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-34bd80c5-cb68-461a-a4db-89f8c7dfa81f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 2142aec1-a473-42c4-8676-84c497d613e3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:41.453769 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34bd80c5-cb68-461a-a4db-89f8c7dfa81f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:41.462304 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34bd80c5-cb68-461a-a4db-89f8c7dfa81f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:41.466100 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34bd80c5-cb68-461a-a4db-89f8c7dfa81f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:41.467159 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34bd80c5-cb68-461a-a4db-89f8c7dfa81f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:41.467820 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34bd80c5-cb68-461a-a4db-89f8c7dfa81f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:41.468476 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34bd80c5-cb68-461a-a4db-89f8c7dfa81f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:41.481649 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f5f43286-14bf-4eba-aeef-9b4bc85584e2 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '786962988b754fb69bd48070c2992e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614797cd26be4995b087ab864f35d235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:41.498278 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f5f43286-14bf-4eba-aeef-9b4bc85584e2 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68" status: 200 len: 1274 microversion: 2.1 time: 0.702876 Aug 07 01:16:41.500745 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 664/1501] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:40 2022] GET /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68 => generated 1274 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:41.527808 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b7547e30-a728-4a89-a5b8-f61e1e081e43 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1079017547", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "e53f1978-9541-49df-ae99-30274357a59f"}], "block_device_mapping_v2": [{"uuid": "1e96b930-c0bb-4120-9d25-9843c5c21533", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:16:41.539756 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-34bd80c5-cb68-461a-a4db-89f8c7dfa81f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] HTTP exception thrown: Instance 2142aec1-a473-42c4-8676-84c497d613e3 could not be found. Aug 07 01:16:41.547230 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-34bd80c5-cb68-461a-a4db-89f8c7dfa81f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Request method failure captured: Aug 07 01:16:41.547230 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3 HTTP/1.1 Aug 07 01:16:41.547230 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:16:41.547230 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:16:41.547230 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:16:41.547230 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:16:41.547230 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:16:41.547230 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:16:41.547230 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:16:41.547230 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:16:41.547230 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xGgZk2s0TuGzjJ8Xb6l7TnV8b2-7iInqh8WC73CRWxSE0_rne48-_XKuRGb9kyv1AQzpFFJZcYYqYPMbhYC4_BIHJInCNDeosVwZHelUBKtqqVJND2DtGLIn9MgrQRQOOb_QIwQOiIjRrXCbSodF39r4CP0D2xvEnYTXsUUzANa4KA Aug 07 01:16:41.547230 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:16:41.547230 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:16:41.547230 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:16:41.547230 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:16:41.547230 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:16:41.547230 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:16:41.547230 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: d08d010c14a64f759887be0d2364c6e4 Aug 07 01:16:41.547230 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersOnMultiNodesTest-1089196105 Aug 07 01:16:41.547230 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:16:41.547230 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:16:41.548978 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d08d010c14a64f759887be0d2364c6e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d08d010c14a64f759887be0d2364c6e4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d08d010c14a64f759887be0d2364c6e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d08d010c14a64f759887be0d2364c6e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:16:41.548978 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersOnMultiNodesTest-1089196105 Aug 07 01:16:41.548978 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: d08d010c14a64f759887be0d2364c6e4 Aug 07 01:16:41.548978 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1089196105 Aug 07 01:16:41.548978 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersOnMultiNodesTest-1089196105-project Aug 07 01:16:41.548978 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:16:41.548978 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:16:41.548978 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 32fc1959d8aa41eabcead217b9d7bc47 Aug 07 01:16:41.548978 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersOnMultiNodesTest-1089196105-project Aug 07 01:16:41.548978 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:16:41.548978 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 2142aec1-a473-42c4-8676-84c497d613e3 could not be found. Aug 07 01:16:41.548978 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '2142aec1-a473-42c4-8676-84c497d613e3'} Aug 07 01:16:41.549927 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:16:41.549927 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:41.549927 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:16:41.549927 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:16:41.549927 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:16:41.549927 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:16:41.549927 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:16:41.549927 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:16:41.549927 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:16:41.549927 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:16:41.549927 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2142aec1-a473-42c4-8676-84c497d613e3 could not be found. Aug 07 01:16:41.549927 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:16:41.549927 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:16:41.549927 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:16:41.549927 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:41.549927 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:16:41.549927 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:16:41.549927 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:16:41.549927 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:16:41.549927 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:16:41.552293 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:16:41.552293 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:16:41.552293 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:16:41.552293 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:16:41.552293 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:16:41.552293 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:16:41.552293 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:16:41.552293 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2142aec1-a473-42c4-8676-84c497d613e3 could not be found. Aug 07 01:16:41.552293 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:16:41.552293 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:16:41.552293 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:16:41.552293 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:41.552293 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:16:41.552293 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:16:41.552293 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:16:41.552293 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:16:41.552293 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2142aec1-a473-42c4-8676-84c497d613e3 could not be found. Aug 07 01:16:41.552293 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:16:41.560836 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-34bd80c5-cb68-461a-a4db-89f8c7dfa81f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Returning 404 to user: Instance 2142aec1-a473-42c4-8676-84c497d613e3 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:16:41.564613 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-34bd80c5-cb68-461a-a4db-89f8c7dfa81f tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3" status: 404 len: 111 microversion: 2.1 time: 0.145623 Aug 07 01:16:41.565531 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 838/1502] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:41 2022] GET /compute/v2.1/servers/2142aec1-a473-42c4-8676-84c497d613e3 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:16:41.581843 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7beb09cc-44cc-4e7d-a061-8af857f4f005 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:41.597874 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7beb09cc-44cc-4e7d-a061-8af857f4f005 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:41.679303 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7beb09cc-44cc-4e7d-a061-8af857f4f005 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:41.680628 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7beb09cc-44cc-4e7d-a061-8af857f4f005 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:41.681652 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7beb09cc-44cc-4e7d-a061-8af857f4f005 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:41.683220 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7beb09cc-44cc-4e7d-a061-8af857f4f005 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:41.684522 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7beb09cc-44cc-4e7d-a061-8af857f4f005 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:41.685517 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7beb09cc-44cc-4e7d-a061-8af857f4f005 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:41.781365 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7beb09cc-44cc-4e7d-a061-8af857f4f005 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:16:41.838382 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-b7547e30-a728-4a89-a5b8-f61e1e081e43 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] validate_networks() for [('e53f1978-9541-49df-ae99-30274357a59f', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:16:42.087399 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7beb09cc-44cc-4e7d-a061-8af857f4f005 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27" status: 204 len: 0 microversion: 2.1 time: 0.512023 Aug 07 01:16:42.088686 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 839/1503] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:16:41 2022] DELETE /compute/v2.1/servers/ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:16:42.103326 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6c4b9525-2d5f-4a05-96f5-d3076e2111eb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:42.105228 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6c4b9525-2d5f-4a05-96f5-d3076e2111eb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: a95f871c-79e7-45bb-8f61-637cc588ee74] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:42.115749 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c4b9525-2d5f-4a05-96f5-d3076e2111eb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:42.116657 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c4b9525-2d5f-4a05-96f5-d3076e2111eb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:42.117270 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c4b9525-2d5f-4a05-96f5-d3076e2111eb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:42.118187 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c4b9525-2d5f-4a05-96f5-d3076e2111eb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:42.118958 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c4b9525-2d5f-4a05-96f5-d3076e2111eb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:42.119556 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c4b9525-2d5f-4a05-96f5-d3076e2111eb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:42.159024 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6c4b9525-2d5f-4a05-96f5-d3076e2111eb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: a95f871c-79e7-45bb-8f61-637cc588ee74] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:16:42.304702 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6c4b9525-2d5f-4a05-96f5-d3076e2111eb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a95f871c-79e7-45bb-8f61-637cc588ee74" status: 204 len: 0 microversion: 2.1 time: 0.207884 Aug 07 01:16:42.305958 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 840/1504] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:16:42 2022] DELETE /compute/v2.1/servers/a95f871c-79e7-45bb-8f61-637cc588ee74 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:16:42.320354 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dfbc3c91-70d4-425c-bcf2-40c976b6a4cb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:42.322508 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-dfbc3c91-70d4-425c-bcf2-40c976b6a4cb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:42.332932 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dfbc3c91-70d4-425c-bcf2-40c976b6a4cb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:42.335868 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dfbc3c91-70d4-425c-bcf2-40c976b6a4cb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:42.337284 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dfbc3c91-70d4-425c-bcf2-40c976b6a4cb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:42.338733 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dfbc3c91-70d4-425c-bcf2-40c976b6a4cb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:42.340051 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dfbc3c91-70d4-425c-bcf2-40c976b6a4cb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:42.342661 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dfbc3c91-70d4-425c-bcf2-40c976b6a4cb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:42.786932 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-dfbc3c91-70d4-425c-bcf2-40c976b6a4cb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:42.801837 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-dfbc3c91-70d4-425c-bcf2-40c976b6a4cb tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27" status: 200 len: 1475 microversion: 2.1 time: 0.488598 Aug 07 01:16:42.803742 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 841/1505] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:42 2022] GET /compute/v2.1/servers/ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27 => generated 1475 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:42.810402 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8cc2f4a8-0303-47dc-b14e-12907322b8ff tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:42.812383 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8cc2f4a8-0303-47dc-b14e-12907322b8ff tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:42.822013 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8cc2f4a8-0303-47dc-b14e-12907322b8ff tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:42.823174 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8cc2f4a8-0303-47dc-b14e-12907322b8ff tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:42.823874 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8cc2f4a8-0303-47dc-b14e-12907322b8ff tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:42.824925 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8cc2f4a8-0303-47dc-b14e-12907322b8ff tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:42.826086 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8cc2f4a8-0303-47dc-b14e-12907322b8ff tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:42.827202 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8cc2f4a8-0303-47dc-b14e-12907322b8ff tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:43.116302 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8cc2f4a8-0303-47dc-b14e-12907322b8ff tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:43.129738 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8cc2f4a8-0303-47dc-b14e-12907322b8ff tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1379 microversion: 2.1 time: 0.324327 Aug 07 01:16:43.130987 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 842/1506] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:42 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1379 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:43.137934 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a64c66df-0b55-4143-8218-07a354ffc04f tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:43.138757 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a64c66df-0b55-4143-8218-07a354ffc04f tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] [instance: 9e2ae24f-8349-46d5-b091-876927d02b68] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:43.156616 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a64c66df-0b55-4143-8218-07a354ffc04f tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:43.157290 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a64c66df-0b55-4143-8218-07a354ffc04f tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:43.157817 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a64c66df-0b55-4143-8218-07a354ffc04f tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:43.158822 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a64c66df-0b55-4143-8218-07a354ffc04f tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:43.159376 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a64c66df-0b55-4143-8218-07a354ffc04f tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:43.160459 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a64c66df-0b55-4143-8218-07a354ffc04f tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:43.369441 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a64c66df-0b55-4143-8218-07a354ffc04f tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '786962988b754fb69bd48070c2992e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614797cd26be4995b087ab864f35d235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:43.390633 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a64c66df-0b55-4143-8218-07a354ffc04f tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68" status: 200 len: 1274 microversion: 2.1 time: 0.256690 Aug 07 01:16:43.394711 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 843/1507] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:43 2022] GET /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68 => generated 1274 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:43.844563 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3b5173be-8197-40bc-b59a-bfd2a90288c7 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1365232223", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "3229e702-5428-4117-9cf7-a872dfb904ff"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:16:44.011601 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-3b5173be-8197-40bc-b59a-bfd2a90288c7 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] validate_networks() for [('3229e702-5428-4117-9cf7-a872dfb904ff', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:16:46.118474 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-3b5173be-8197-40bc-b59a-bfd2a90288c7 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:16:46.120001 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-3b5173be-8197-40bc-b59a-bfd2a90288c7 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:16:46.121278 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-3b5173be-8197-40bc-b59a-bfd2a90288c7 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:16:46.122011 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-3b5173be-8197-40bc-b59a-bfd2a90288c7 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:16:46.122648 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-3b5173be-8197-40bc-b59a-bfd2a90288c7 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:16:46.141841 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b5173be-8197-40bc-b59a-bfd2a90288c7 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:46.143677 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b5173be-8197-40bc-b59a-bfd2a90288c7 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:46.145751 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b5173be-8197-40bc-b59a-bfd2a90288c7 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:46.149123 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b5173be-8197-40bc-b59a-bfd2a90288c7 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:46.163848 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b5173be-8197-40bc-b59a-bfd2a90288c7 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:46.164901 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b5173be-8197-40bc-b59a-bfd2a90288c7 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:46.223834 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-3b5173be-8197-40bc-b59a-bfd2a90288c7 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Getting quotas for project 65b47199573142cfabb119e111b69c9d. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:16:46.244637 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-3b5173be-8197-40bc-b59a-bfd2a90288c7 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Getting quotas for user 0af4775c28774015bc168bbcfc9b784d and project 65b47199573142cfabb119e111b69c9d. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:16:46.273975 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3b5173be-8197-40bc-b59a-bfd2a90288c7 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:16:46.278510 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3b5173be-8197-40bc-b59a-bfd2a90288c7 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] [instance: d96d68bb-2dab-43ee-872b-e9090e9a3b4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:16:46.346480 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-b7547e30-a728-4a89-a5b8-f61e1e081e43 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:16:46.348603 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-b7547e30-a728-4a89-a5b8-f61e1e081e43 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:16:46.349432 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-b7547e30-a728-4a89-a5b8-f61e1e081e43 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:16:46.350706 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-b7547e30-a728-4a89-a5b8-f61e1e081e43 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:16:46.352155 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-b7547e30-a728-4a89-a5b8-f61e1e081e43 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:16:46.404010 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b7547e30-a728-4a89-a5b8-f61e1e081e43 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:46.409303 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b7547e30-a728-4a89-a5b8-f61e1e081e43 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:46.410563 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b7547e30-a728-4a89-a5b8-f61e1e081e43 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:46.415748 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b7547e30-a728-4a89-a5b8-f61e1e081e43 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:46.417033 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b7547e30-a728-4a89-a5b8-f61e1e081e43 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:46.421096 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b7547e30-a728-4a89-a5b8-f61e1e081e43 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:46.450311 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3b5173be-8197-40bc-b59a-bfd2a90288c7 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.052547 Aug 07 01:16:46.459665 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 844/1508] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:16:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 3063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:16:46.465571 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-b7547e30-a728-4a89-a5b8-f61e1e081e43 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Getting quotas for project ba9e7a1c1fe14f47b5a5acf2fe8893b5. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:16:46.477542 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5a1c5832-edf8-4691-a4a2-2b8f576dd66c tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:46.478006 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-b7547e30-a728-4a89-a5b8-f61e1e081e43 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Getting quotas for user 0327f14a188e45fba98a58e5fd061248 and project ba9e7a1c1fe14f47b5a5acf2fe8893b5. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:16:46.478483 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5a1c5832-edf8-4691-a4a2-2b8f576dd66c tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:46.506099 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a1c5832-edf8-4691-a4a2-2b8f576dd66c tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:46.506968 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a1c5832-edf8-4691-a4a2-2b8f576dd66c tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:46.507758 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a1c5832-edf8-4691-a4a2-2b8f576dd66c tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:46.517123 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a1c5832-edf8-4691-a4a2-2b8f576dd66c tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:46.522586 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a1c5832-edf8-4691-a4a2-2b8f576dd66c tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:46.523157 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a1c5832-edf8-4691-a4a2-2b8f576dd66c tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:46.710138 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b7547e30-a728-4a89-a5b8-f61e1e081e43 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:16:46.721991 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b7547e30-a728-4a89-a5b8-f61e1e081e43 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1e96b930-c0bb-4120-9d25-9843c5c21533',volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:16:46.837048 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5a1c5832-edf8-4691-a4a2-2b8f576dd66c tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:46.873828 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5a1c5832-edf8-4691-a4a2-2b8f576dd66c tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27" status: 200 len: 1433 microversion: 2.1 time: 0.408269 Aug 07 01:16:46.906547 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 845/1509] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:46 2022] GET /compute/v2.1/servers/ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27 => generated 1433 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:46.933452 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-881abf15-fd39-42e9-804c-c6e6a452ed8d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:46.937105 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-881abf15-fd39-42e9-804c-c6e6a452ed8d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:46.992328 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-881abf15-fd39-42e9-804c-c6e6a452ed8d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:46.993164 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-881abf15-fd39-42e9-804c-c6e6a452ed8d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:46.995322 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-881abf15-fd39-42e9-804c-c6e6a452ed8d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:46.997145 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-881abf15-fd39-42e9-804c-c6e6a452ed8d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:46.998277 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-881abf15-fd39-42e9-804c-c6e6a452ed8d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:46.999365 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-881abf15-fd39-42e9-804c-c6e6a452ed8d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:47.581537 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b7547e30-a728-4a89-a5b8-f61e1e081e43 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.077250 Aug 07 01:16:47.602627 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 665/1510] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:16:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 6101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:16:47.630716 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-653202ce-37c4-4e53-b8e0-09482fa7c246 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:47.637858 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-653202ce-37c4-4e53-b8e0-09482fa7c246 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] [instance: 9e2ae24f-8349-46d5-b091-876927d02b68] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:47.662734 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-653202ce-37c4-4e53-b8e0-09482fa7c246 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:47.669004 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-653202ce-37c4-4e53-b8e0-09482fa7c246 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:47.670727 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-653202ce-37c4-4e53-b8e0-09482fa7c246 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:47.676417 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-653202ce-37c4-4e53-b8e0-09482fa7c246 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:47.677050 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-653202ce-37c4-4e53-b8e0-09482fa7c246 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:47.678260 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-653202ce-37c4-4e53-b8e0-09482fa7c246 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:47.809545 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-881abf15-fd39-42e9-804c-c6e6a452ed8d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:47.831538 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-881abf15-fd39-42e9-804c-c6e6a452ed8d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1379 microversion: 2.1 time: 0.922706 Aug 07 01:16:47.839759 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 846/1511] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:46 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1379 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:47.857920 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-c95b6641-42be-43f1-90ba-c3ba4387ddcb req-ed47a105-17d4-4333-a082-e2318e417c43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2dbfd1a-efab-4943-b00a-6cdd1051489c", "tag": "05c06eb8-fc76-4d4a-bf23-b4a1dd7229f7"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:16:47.897644 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c95b6641-42be-43f1-90ba-c3ba4387ddcb req-ed47a105-17d4-4333-a082-e2318e417c43 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:47.898147 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c95b6641-42be-43f1-90ba-c3ba4387ddcb req-ed47a105-17d4-4333-a082-e2318e417c43 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:47.898590 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c95b6641-42be-43f1-90ba-c3ba4387ddcb req-ed47a105-17d4-4333-a082-e2318e417c43 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:47.924350 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-c95b6641-42be-43f1-90ba-c3ba4387ddcb req-ed47a105-17d4-4333-a082-e2318e417c43 service nova] Creating event network-changed:05c06eb8-fc76-4d4a-bf23-b4a1dd7229f7 for instance d2dbfd1a-efab-4943-b00a-6cdd1051489c on n-h1-master-1 Aug 07 01:16:47.937197 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-c95b6641-42be-43f1-90ba-c3ba4387ddcb req-ed47a105-17d4-4333-a082-e2318e417c43 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095198 Aug 07 01:16:47.948292 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 847/1512] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:16:47.965722 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0ffb1de2-0815-4ea5-add2-837210804018 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:47.966915 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0ffb1de2-0815-4ea5-add2-837210804018 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] [instance: d96d68bb-2dab-43ee-872b-e9090e9a3b4b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:47.991937 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-653202ce-37c4-4e53-b8e0-09482fa7c246 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '786962988b754fb69bd48070c2992e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614797cd26be4995b087ab864f35d235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:48.005784 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-653202ce-37c4-4e53-b8e0-09482fa7c246 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68" status: 200 len: 1274 microversion: 2.1 time: 0.400878 Aug 07 01:16:48.006859 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 666/1513] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:47 2022] GET /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68 => generated 1274 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:48.015516 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-18ffbe00-ab87-4abd-8cf5-38c1d0c0551d tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:48.026993 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-18ffbe00-ab87-4abd-8cf5-38c1d0c0551d tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] [instance: 91da23de-c338-4658-8620-831662a596b9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:48.048869 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-18ffbe00-ab87-4abd-8cf5-38c1d0c0551d tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:48.049381 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-18ffbe00-ab87-4abd-8cf5-38c1d0c0551d tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:48.049832 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-18ffbe00-ab87-4abd-8cf5-38c1d0c0551d tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:48.051141 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-18ffbe00-ab87-4abd-8cf5-38c1d0c0551d tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:48.051807 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-18ffbe00-ab87-4abd-8cf5-38c1d0c0551d tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:48.056688 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-18ffbe00-ab87-4abd-8cf5-38c1d0c0551d tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:48.127639 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-18ffbe00-ab87-4abd-8cf5-38c1d0c0551d tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] [instance: 91da23de-c338-4658-8620-831662a596b9] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:16:48.159525 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0ffb1de2-0815-4ea5-add2-837210804018 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af4775c28774015bc168bbcfc9b784d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b47199573142cfabb119e111b69c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:48.180849 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0ffb1de2-0815-4ea5-add2-837210804018 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] 10.222.0.39 "GET /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b" status: 200 len: 1225 microversion: 2.1 time: 0.227889 Aug 07 01:16:48.183244 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 848/1514] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:47 2022] GET /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b => generated 1225 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:48.195220 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f5d72e1d-3a3b-40f9-b700-adde9cee80bc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:48.198194 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f5d72e1d-3a3b-40f9-b700-adde9cee80bc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:48.342496 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-18ffbe00-ab87-4abd-8cf5-38c1d0c0551d tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] 10.222.0.39 "DELETE /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9" status: 204 len: 0 microversion: 2.1 time: 0.333286 Aug 07 01:16:48.344108 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 667/1515] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:16:48 2022] DELETE /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:16:48.379816 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f5d72e1d-3a3b-40f9-b700-adde9cee80bc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:48.408609 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-52798556-5dfe-4a7d-8f2e-40119f5c6c32 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:48.416208 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-52798556-5dfe-4a7d-8f2e-40119f5c6c32 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:48.424009 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f5d72e1d-3a3b-40f9-b700-adde9cee80bc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1053 microversion: 2.1 time: 0.237829 Aug 07 01:16:48.435327 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52798556-5dfe-4a7d-8f2e-40119f5c6c32 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:48.436167 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52798556-5dfe-4a7d-8f2e-40119f5c6c32 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:48.436803 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52798556-5dfe-4a7d-8f2e-40119f5c6c32 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:48.437751 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52798556-5dfe-4a7d-8f2e-40119f5c6c32 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:48.438966 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52798556-5dfe-4a7d-8f2e-40119f5c6c32 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:48.439596 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52798556-5dfe-4a7d-8f2e-40119f5c6c32 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:48.443740 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 849/1516] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:48 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1053 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:48.466423 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-72728dd4-c440-4e55-9e61-d72ce1f973a9 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:48.472805 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-72728dd4-c440-4e55-9e61-d72ce1f973a9 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] [instance: 91da23de-c338-4658-8620-831662a596b9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:48.486635 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72728dd4-c440-4e55-9e61-d72ce1f973a9 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:48.491873 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72728dd4-c440-4e55-9e61-d72ce1f973a9 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:48.494868 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72728dd4-c440-4e55-9e61-d72ce1f973a9 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:48.496625 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72728dd4-c440-4e55-9e61-d72ce1f973a9 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:48.498939 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72728dd4-c440-4e55-9e61-d72ce1f973a9 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:48.499847 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72728dd4-c440-4e55-9e61-d72ce1f973a9 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:48.516887 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:48.534304 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52798556-5dfe-4a7d-8f2e-40119f5c6c32 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:48.535664 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52798556-5dfe-4a7d-8f2e-40119f5c6c32 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:48.536918 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52798556-5dfe-4a7d-8f2e-40119f5c6c32 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:48.538053 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-52798556-5dfe-4a7d-8f2e-40119f5c6c32 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lazy-loading 'fault' on Instance uuid ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:16:48.958806 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-52798556-5dfe-4a7d-8f2e-40119f5c6c32 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:48.978906 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-52798556-5dfe-4a7d-8f2e-40119f5c6c32 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27" status: 200 len: 1309 microversion: 2.1 time: 0.631281 Aug 07 01:16:49.010323 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 668/1517] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:48 2022] GET /compute/v2.1/servers/ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27 => generated 1309 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:49.010323 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-da35716a-882d-483b-9f41-cc2a1a27fa80 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:49.010323 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-da35716a-882d-483b-9f41-cc2a1a27fa80 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:49.010323 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da35716a-882d-483b-9f41-cc2a1a27fa80 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:49.010323 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da35716a-882d-483b-9f41-cc2a1a27fa80 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:49.011206 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da35716a-882d-483b-9f41-cc2a1a27fa80 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:49.016019 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da35716a-882d-483b-9f41-cc2a1a27fa80 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:49.016992 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da35716a-882d-483b-9f41-cc2a1a27fa80 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:49.017940 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da35716a-882d-483b-9f41-cc2a1a27fa80 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:49.119396 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-72728dd4-c440-4e55-9e61-d72ce1f973a9 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065d8324da60445ea1e97e1dc892f183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1530b8294fc4dd4bc7e7b228ad2b95c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:49.140194 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-72728dd4-c440-4e55-9e61-d72ce1f973a9 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] 10.222.0.39 "GET /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9" status: 200 len: 1666 microversion: 2.1 time: 0.692537 Aug 07 01:16:49.143424 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 850/1518] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:48 2022] GET /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9 => generated 1666 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:49.156620 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c6c61d11-729e-4971-88ed-f9414a1f770c tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:49.157311 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c6c61d11-729e-4971-88ed-f9414a1f770c tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] [instance: 9e2ae24f-8349-46d5-b091-876927d02b68] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:49.180201 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c6c61d11-729e-4971-88ed-f9414a1f770c tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:49.181002 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c6c61d11-729e-4971-88ed-f9414a1f770c tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:49.181766 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c6c61d11-729e-4971-88ed-f9414a1f770c tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:49.186668 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c6c61d11-729e-4971-88ed-f9414a1f770c tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:49.187483 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c6c61d11-729e-4971-88ed-f9414a1f770c tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:49.188732 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c6c61d11-729e-4971-88ed-f9414a1f770c tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:50.125682 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-da35716a-882d-483b-9f41-cc2a1a27fa80 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:50.135225 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c6c61d11-729e-4971-88ed-f9414a1f770c tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '786962988b754fb69bd48070c2992e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614797cd26be4995b087ab864f35d235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:50.137740 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-da35716a-882d-483b-9f41-cc2a1a27fa80 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1379 microversion: 2.1 time: 1.144572 Aug 07 01:16:50.156585 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 669/1519] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:48 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1379 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:50.158560 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c6c61d11-729e-4971-88ed-f9414a1f770c tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68" status: 200 len: 1316 microversion: 2.1 time: 1.010080 Aug 07 01:16:50.162881 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 851/1520] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:49 2022] GET /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68 => generated 1316 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:50.174422 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7ca6bc36-2d67-4e8f-a4b7-17efa26cdb09 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:50.176071 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7ca6bc36-2d67-4e8f-a4b7-17efa26cdb09 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] [instance: d96d68bb-2dab-43ee-872b-e9090e9a3b4b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:50.183216 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-9cfcf883-1112-4705-a01f-83d249bfb3a7 req-3ecc2125-facd-410f-8b99-c6d294fca468 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a95f871c-79e7-45bb-8f61-637cc588ee74", "name": "network-vif-deleted", "tag": "fc6ffea6-6329-42e5-9ee2-5abcc4ba9bfa"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:16:50.193646 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ca6bc36-2d67-4e8f-a4b7-17efa26cdb09 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:50.196960 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ca6bc36-2d67-4e8f-a4b7-17efa26cdb09 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:50.200208 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ca6bc36-2d67-4e8f-a4b7-17efa26cdb09 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:50.202877 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ca6bc36-2d67-4e8f-a4b7-17efa26cdb09 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:50.205720 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ca6bc36-2d67-4e8f-a4b7-17efa26cdb09 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:50.206982 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ca6bc36-2d67-4e8f-a4b7-17efa26cdb09 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:50.221521 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:50.225516 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-9cfcf883-1112-4705-a01f-83d249bfb3a7 req-3ecc2125-facd-410f-8b99-c6d294fca468 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:50.226736 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-9cfcf883-1112-4705-a01f-83d249bfb3a7 req-3ecc2125-facd-410f-8b99-c6d294fca468 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:50.227859 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-9cfcf883-1112-4705-a01f-83d249bfb3a7 req-3ecc2125-facd-410f-8b99-c6d294fca468 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:50.256955 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-9cfcf883-1112-4705-a01f-83d249bfb3a7 req-3ecc2125-facd-410f-8b99-c6d294fca468 service nova] Creating event network-vif-deleted:fc6ffea6-6329-42e5-9ee2-5abcc4ba9bfa for instance a95f871c-79e7-45bb-8f61-637cc588ee74 on n-h2-master-1 Aug 07 01:16:50.268195 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-9cfcf883-1112-4705-a01f-83d249bfb3a7 req-3ecc2125-facd-410f-8b99-c6d294fca468 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107501 Aug 07 01:16:50.273364 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 670/1521] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:16:50.284557 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-69680a43-d257-48f4-9bb7-f9d972d52828 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:50.286765 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-69680a43-d257-48f4-9bb7-f9d972d52828 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:50.298536 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-69680a43-d257-48f4-9bb7-f9d972d52828 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:50.299631 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-69680a43-d257-48f4-9bb7-f9d972d52828 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:50.301064 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-69680a43-d257-48f4-9bb7-f9d972d52828 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:50.303136 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-69680a43-d257-48f4-9bb7-f9d972d52828 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:50.304110 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-69680a43-d257-48f4-9bb7-f9d972d52828 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:50.304806 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-69680a43-d257-48f4-9bb7-f9d972d52828 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:50.524137 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7ca6bc36-2d67-4e8f-a4b7-17efa26cdb09 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af4775c28774015bc168bbcfc9b784d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b47199573142cfabb119e111b69c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:50.533355 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7ca6bc36-2d67-4e8f-a4b7-17efa26cdb09 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] 10.222.0.39 "GET /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b" status: 200 len: 1277 microversion: 2.1 time: 0.368876 Aug 07 01:16:50.536312 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 852/1522] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:50 2022] GET /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b => generated 1277 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:50.563371 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-96da170a-f76b-4c43-9c48-53cf148bd394 req-435e14fb-ba1f-4862-be4b-7956e2c4ef0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27", "name": "network-vif-deleted", "tag": "c037c38e-6ec4-487b-8848-881d4d981f1f"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:16:50.607794 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-96da170a-f76b-4c43-9c48-53cf148bd394 req-435e14fb-ba1f-4862-be4b-7956e2c4ef0f service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:50.608709 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-96da170a-f76b-4c43-9c48-53cf148bd394 req-435e14fb-ba1f-4862-be4b-7956e2c4ef0f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:50.609490 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-96da170a-f76b-4c43-9c48-53cf148bd394 req-435e14fb-ba1f-4862-be4b-7956e2c4ef0f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:50.641402 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-96da170a-f76b-4c43-9c48-53cf148bd394 req-435e14fb-ba1f-4862-be4b-7956e2c4ef0f service nova] Creating event network-vif-deleted:c037c38e-6ec4-487b-8848-881d4d981f1f for instance ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27 on n-h1-master-1 Aug 07 01:16:50.659762 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-96da170a-f76b-4c43-9c48-53cf148bd394 req-435e14fb-ba1f-4862-be4b-7956e2c4ef0f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103840 Aug 07 01:16:50.667285 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 853/1523] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:16:50.684103 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2be7409d-50d7-469d-9e5e-8d5d355afa4a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:50.686117 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2be7409d-50d7-469d-9e5e-8d5d355afa4a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:50.700171 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2be7409d-50d7-469d-9e5e-8d5d355afa4a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:50.702453 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2be7409d-50d7-469d-9e5e-8d5d355afa4a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:50.703532 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2be7409d-50d7-469d-9e5e-8d5d355afa4a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:50.705137 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2be7409d-50d7-469d-9e5e-8d5d355afa4a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:50.706275 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2be7409d-50d7-469d-9e5e-8d5d355afa4a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:50.708422 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2be7409d-50d7-469d-9e5e-8d5d355afa4a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:50.760392 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-2be7409d-50d7-469d-9e5e-8d5d355afa4a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] HTTP exception thrown: Instance ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27 could not be found. Aug 07 01:16:50.764242 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2be7409d-50d7-469d-9e5e-8d5d355afa4a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Request method failure captured: Aug 07 01:16:50.764242 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27 HTTP/1.1 Aug 07 01:16:50.764242 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:16:50.764242 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:16:50.764242 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:16:50.764242 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:16:50.764242 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:16:50.764242 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:16:50.764242 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:16:50.764242 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:16:50.764242 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xGgZk2s0TuGzjJ8Xb6l7TnV8b2-7iInqh8WC73CRWxSE0_rne48-_XKuRGb9kyv1AQzpFFJZcYYqYPMbhYC4_BIHJInCNDeosVwZHelUBKtqqVJND2DtGLIn9MgrQRQOOb_QIwQOiIjRrXCbSodF39r4CP0D2xvEnYTXsUUzANa4KA Aug 07 01:16:50.764242 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:16:50.764242 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:16:50.764242 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:16:50.764242 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:16:50.764242 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:16:50.764242 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:16:50.764242 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: d08d010c14a64f759887be0d2364c6e4 Aug 07 01:16:50.764242 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersOnMultiNodesTest-1089196105 Aug 07 01:16:50.764242 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:16:50.764242 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:16:50.767007 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d08d010c14a64f759887be0d2364c6e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d08d010c14a64f759887be0d2364c6e4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d08d010c14a64f759887be0d2364c6e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d08d010c14a64f759887be0d2364c6e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:16:50.767007 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersOnMultiNodesTest-1089196105 Aug 07 01:16:50.767007 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: d08d010c14a64f759887be0d2364c6e4 Aug 07 01:16:50.767007 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1089196105 Aug 07 01:16:50.767007 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersOnMultiNodesTest-1089196105-project Aug 07 01:16:50.767007 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:16:50.767007 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:16:50.767007 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 32fc1959d8aa41eabcead217b9d7bc47 Aug 07 01:16:50.767007 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersOnMultiNodesTest-1089196105-project Aug 07 01:16:50.767007 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:16:50.767007 n-d-master-1 devstack@n-api.service[119516]: exception: Instance ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27 could not be found. Aug 07 01:16:50.767007 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27'} Aug 07 01:16:50.768852 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:16:50.768852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:50.768852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:16:50.768852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:16:50.768852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:16:50.768852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:16:50.768852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:16:50.768852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:16:50.768852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:16:50.768852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:16:50.768852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27 could not be found. Aug 07 01:16:50.768852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:16:50.768852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:16:50.768852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:16:50.768852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:50.768852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:16:50.768852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:16:50.768852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:16:50.768852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:16:50.768852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:16:50.772724 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:16:50.772724 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:16:50.772724 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:16:50.772724 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:16:50.772724 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:16:50.772724 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:16:50.772724 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:16:50.772724 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27 could not be found. Aug 07 01:16:50.772724 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:16:50.772724 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:16:50.772724 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:16:50.772724 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:50.772724 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:16:50.772724 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:16:50.772724 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:16:50.772724 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:16:50.772724 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27 could not be found. Aug 07 01:16:50.772724 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:16:50.786488 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2be7409d-50d7-469d-9e5e-8d5d355afa4a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Returning 404 to user: Instance ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:16:50.796219 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2be7409d-50d7-469d-9e5e-8d5d355afa4a tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27" status: 404 len: 111 microversion: 2.1 time: 0.124338 Aug 07 01:16:50.802688 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 854/1524] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:50 2022] GET /compute/v2.1/servers/ad1d70f7-1c9a-4ce0-a4a4-47fdc9847b27 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:16:50.827529 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ba833063-2739-4e67-bde1-a389c0d5f1c9 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:50.829261 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ba833063-2739-4e67-bde1-a389c0d5f1c9 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] [instance: 91da23de-c338-4658-8620-831662a596b9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:50.853193 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ba833063-2739-4e67-bde1-a389c0d5f1c9 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:50.854489 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ba833063-2739-4e67-bde1-a389c0d5f1c9 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:50.858866 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ba833063-2739-4e67-bde1-a389c0d5f1c9 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:50.862910 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ba833063-2739-4e67-bde1-a389c0d5f1c9 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:50.869169 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ba833063-2739-4e67-bde1-a389c0d5f1c9 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:50.870352 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ba833063-2739-4e67-bde1-a389c0d5f1c9 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:50.934406 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-69680a43-d257-48f4-9bb7-f9d972d52828 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:50.952191 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-69680a43-d257-48f4-9bb7-f9d972d52828 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1151 microversion: 2.1 time: 0.676509 Aug 07 01:16:50.958353 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 671/1525] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:50 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1151 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:50.967365 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9acd23f8-1de8-4d09-ba89-777480ad60c6 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:50.968481 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9acd23f8-1de8-4d09-ba89-777480ad60c6 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: a95f871c-79e7-45bb-8f61-637cc588ee74] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:50.991350 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9acd23f8-1de8-4d09-ba89-777480ad60c6 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:50.993312 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9acd23f8-1de8-4d09-ba89-777480ad60c6 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:50.994196 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9acd23f8-1de8-4d09-ba89-777480ad60c6 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:50.995224 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9acd23f8-1de8-4d09-ba89-777480ad60c6 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:50.995966 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9acd23f8-1de8-4d09-ba89-777480ad60c6 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:50.996635 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9acd23f8-1de8-4d09-ba89-777480ad60c6 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:51.013406 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-9acd23f8-1de8-4d09-ba89-777480ad60c6 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] HTTP exception thrown: Instance a95f871c-79e7-45bb-8f61-637cc588ee74 could not be found. Aug 07 01:16:51.015808 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9acd23f8-1de8-4d09-ba89-777480ad60c6 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Request method failure captured: Aug 07 01:16:51.015808 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/a95f871c-79e7-45bb-8f61-637cc588ee74 HTTP/1.1 Aug 07 01:16:51.015808 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:16:51.015808 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:16:51.015808 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:16:51.015808 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:16:51.015808 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:16:51.015808 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:16:51.015808 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:16:51.015808 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:16:51.015808 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xGgZk2s0TuGzjJ8Xb6l7TnV8b2-7iInqh8WC73CRWxSE0_rne48-_XKuRGb9kyv1AQzpFFJZcYYqYPMbhYC4_BIHJInCNDeosVwZHelUBKtqqVJND2DtGLIn9MgrQRQOOb_QIwQOiIjRrXCbSodF39r4CP0D2xvEnYTXsUUzANa4KA Aug 07 01:16:51.015808 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:16:51.015808 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:16:51.015808 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:16:51.015808 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:16:51.015808 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:16:51.015808 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:16:51.015808 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: d08d010c14a64f759887be0d2364c6e4 Aug 07 01:16:51.015808 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersOnMultiNodesTest-1089196105 Aug 07 01:16:51.015808 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:16:51.015808 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:16:51.017342 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d08d010c14a64f759887be0d2364c6e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d08d010c14a64f759887be0d2364c6e4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d08d010c14a64f759887be0d2364c6e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d08d010c14a64f759887be0d2364c6e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:16:51.017342 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersOnMultiNodesTest-1089196105 Aug 07 01:16:51.017342 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: d08d010c14a64f759887be0d2364c6e4 Aug 07 01:16:51.017342 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1089196105 Aug 07 01:16:51.017342 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersOnMultiNodesTest-1089196105-project Aug 07 01:16:51.017342 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:16:51.017342 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:16:51.017342 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 32fc1959d8aa41eabcead217b9d7bc47 Aug 07 01:16:51.017342 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersOnMultiNodesTest-1089196105-project Aug 07 01:16:51.017342 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:16:51.017342 n-d-master-1 devstack@n-api.service[119517]: exception: Instance a95f871c-79e7-45bb-8f61-637cc588ee74 could not be found. Aug 07 01:16:51.017342 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'a95f871c-79e7-45bb-8f61-637cc588ee74'} Aug 07 01:16:51.018470 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:16:51.018470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:51.018470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:16:51.018470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:16:51.018470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:16:51.018470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:16:51.018470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:16:51.018470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:16:51.018470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:16:51.018470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:16:51.018470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a95f871c-79e7-45bb-8f61-637cc588ee74 could not be found. Aug 07 01:16:51.018470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:16:51.018470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:16:51.018470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:16:51.018470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:51.018470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:16:51.018470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:16:51.018470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:16:51.018470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:16:51.018470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:16:51.020397 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:16:51.020397 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:16:51.020397 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:16:51.020397 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:16:51.020397 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:16:51.020397 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:16:51.020397 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:16:51.020397 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a95f871c-79e7-45bb-8f61-637cc588ee74 could not be found. Aug 07 01:16:51.020397 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:16:51.020397 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:16:51.020397 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:16:51.020397 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:51.020397 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:16:51.020397 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:16:51.020397 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:16:51.020397 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:16:51.020397 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a95f871c-79e7-45bb-8f61-637cc588ee74 could not be found. Aug 07 01:16:51.020397 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:16:51.023367 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9acd23f8-1de8-4d09-ba89-777480ad60c6 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Returning 404 to user: Instance a95f871c-79e7-45bb-8f61-637cc588ee74 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:16:51.024592 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9acd23f8-1de8-4d09-ba89-777480ad60c6 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/a95f871c-79e7-45bb-8f61-637cc588ee74" status: 404 len: 111 microversion: 2.1 time: 0.063506 Aug 07 01:16:51.025802 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 672/1526] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:50 2022] GET /compute/v2.1/servers/a95f871c-79e7-45bb-8f61-637cc588ee74 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:16:51.039357 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2101dc9c-4b40-4cbd-8c7a-d41f1bce284e tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:51.125094 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2101dc9c-4b40-4cbd-8c7a-d41f1bce284e tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/f0c5c304-6e15-4031-b078-6cf8ea0f0c13" status: 204 len: 0 microversion: 2.1 time: 0.092373 Aug 07 01:16:51.126347 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 673/1527] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Aug 7 01:16:51 2022] DELETE /compute/v2.1/os-server-groups/f0c5c304-6e15-4031-b078-6cf8ea0f0c13 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:16:51.138171 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-498245b8-cce6-483c-9fa5-332b90194ba4 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:51.139124 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-498245b8-cce6-483c-9fa5-332b90194ba4 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: fb8bf657-63c6-4cea-8571-e9449c5ee529] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:51.148765 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-498245b8-cce6-483c-9fa5-332b90194ba4 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:51.149734 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-498245b8-cce6-483c-9fa5-332b90194ba4 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:51.161765 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-498245b8-cce6-483c-9fa5-332b90194ba4 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:51.166748 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-498245b8-cce6-483c-9fa5-332b90194ba4 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:51.168209 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-498245b8-cce6-483c-9fa5-332b90194ba4 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:51.170547 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-498245b8-cce6-483c-9fa5-332b90194ba4 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:51.233009 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-498245b8-cce6-483c-9fa5-332b90194ba4 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: fb8bf657-63c6-4cea-8571-e9449c5ee529] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:16:51.331059 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:51.469905 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ba833063-2739-4e67-bde1-a389c0d5f1c9 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065d8324da60445ea1e97e1dc892f183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1530b8294fc4dd4bc7e7b228ad2b95c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:51.479801 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ba833063-2739-4e67-bde1-a389c0d5f1c9 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] 10.222.0.39 "GET /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9" status: 200 len: 1666 microversion: 2.1 time: 0.674837 Aug 07 01:16:51.486302 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 855/1528] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:50 2022] GET /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9 => generated 1666 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:51.495539 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-67385831-55b0-4653-87f3-3594c28dcba2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:51.496657 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-67385831-55b0-4653-87f3-3594c28dcba2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:51.514613 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-498245b8-cce6-483c-9fa5-332b90194ba4 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "DELETE /compute/v2.1/servers/fb8bf657-63c6-4cea-8571-e9449c5ee529" status: 204 len: 0 microversion: 2.1 time: 0.380841 Aug 07 01:16:51.515642 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 674/1529] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:16:51 2022] DELETE /compute/v2.1/servers/fb8bf657-63c6-4cea-8571-e9449c5ee529 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 07 01:16:51.535974 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e3fb08a6-ab4a-486c-ba24-2f72378d553d tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:51.538472 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e3fb08a6-ab4a-486c-ba24-2f72378d553d tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] [instance: 9e2ae24f-8349-46d5-b091-876927d02b68] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:51.540483 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67385831-55b0-4653-87f3-3594c28dcba2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:51.541216 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67385831-55b0-4653-87f3-3594c28dcba2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:51.545197 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67385831-55b0-4653-87f3-3594c28dcba2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:51.551497 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67385831-55b0-4653-87f3-3594c28dcba2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:51.553109 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67385831-55b0-4653-87f3-3594c28dcba2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:51.557565 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67385831-55b0-4653-87f3-3594c28dcba2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:51.561848 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3fb08a6-ab4a-486c-ba24-2f72378d553d tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:51.562577 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3fb08a6-ab4a-486c-ba24-2f72378d553d tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:51.563138 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3fb08a6-ab4a-486c-ba24-2f72378d553d tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:51.569772 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3fb08a6-ab4a-486c-ba24-2f72378d553d tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:51.570910 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3fb08a6-ab4a-486c-ba24-2f72378d553d tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:51.571830 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3fb08a6-ab4a-486c-ba24-2f72378d553d tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:52.359315 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-67385831-55b0-4653-87f3-3594c28dcba2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:52.377560 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-67385831-55b0-4653-87f3-3594c28dcba2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1379 microversion: 2.1 time: 0.889246 Aug 07 01:16:52.378158 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 856/1530] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:51 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1379 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:52.396402 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-739bab59-081c-44b0-8f4c-5db5fa5f55ad tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:52.396909 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-739bab59-081c-44b0-8f4c-5db5fa5f55ad tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 9a4ced25-d85e-4469-95b6-5e666731a714] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:52.410379 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-739bab59-081c-44b0-8f4c-5db5fa5f55ad tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:52.411379 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-739bab59-081c-44b0-8f4c-5db5fa5f55ad tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:52.413514 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-739bab59-081c-44b0-8f4c-5db5fa5f55ad tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:52.415075 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-739bab59-081c-44b0-8f4c-5db5fa5f55ad tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:52.416186 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-739bab59-081c-44b0-8f4c-5db5fa5f55ad tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:52.416792 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-739bab59-081c-44b0-8f4c-5db5fa5f55ad tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:52.516154 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-739bab59-081c-44b0-8f4c-5db5fa5f55ad tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 9a4ced25-d85e-4469-95b6-5e666731a714] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:16:52.803652 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-739bab59-081c-44b0-8f4c-5db5fa5f55ad tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714" status: 204 len: 0 microversion: 2.1 time: 0.422993 Aug 07 01:16:52.811937 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 857/1531] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:16:52 2022] DELETE /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:16:52.825914 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-abff76f8-fd22-4ea3-ad1f-885df5b175bb tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:52.827208 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-abff76f8-fd22-4ea3-ad1f-885df5b175bb tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] [instance: d96d68bb-2dab-43ee-872b-e9090e9a3b4b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:52.837129 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-abff76f8-fd22-4ea3-ad1f-885df5b175bb tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:52.838244 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-abff76f8-fd22-4ea3-ad1f-885df5b175bb tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:52.838697 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-abff76f8-fd22-4ea3-ad1f-885df5b175bb tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:52.839441 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-abff76f8-fd22-4ea3-ad1f-885df5b175bb tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:52.839952 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-abff76f8-fd22-4ea3-ad1f-885df5b175bb tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:52.840357 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-abff76f8-fd22-4ea3-ad1f-885df5b175bb tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:53.085268 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-abff76f8-fd22-4ea3-ad1f-885df5b175bb tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af4775c28774015bc168bbcfc9b784d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b47199573142cfabb119e111b69c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:53.105070 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-abff76f8-fd22-4ea3-ad1f-885df5b175bb tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] 10.222.0.39 "GET /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b" status: 200 len: 1283 microversion: 2.1 time: 0.286505 Aug 07 01:16:53.106477 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 858/1532] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:52 2022] GET /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b => generated 1283 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:53.122553 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-7155abb5-1aea-4c07-afa2-bf2916f94661 req-315bcd5b-28ea-460e-bcf7-1d6029f301bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd1e4cce-7a53-4200-a2c1-dcabbb7f9544", "name": "network-vif-plugged", "status": "completed", "tag": "ee124f30-41ef-4d88-b49e-4ad7cac50168"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:16:53.160785 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-7155abb5-1aea-4c07-afa2-bf2916f94661 req-315bcd5b-28ea-460e-bcf7-1d6029f301bb service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:53.170165 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-7155abb5-1aea-4c07-afa2-bf2916f94661 req-315bcd5b-28ea-460e-bcf7-1d6029f301bb service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:53.172690 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-7155abb5-1aea-4c07-afa2-bf2916f94661 req-315bcd5b-28ea-460e-bcf7-1d6029f301bb service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:53.203155 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-7155abb5-1aea-4c07-afa2-bf2916f94661 req-315bcd5b-28ea-460e-bcf7-1d6029f301bb service nova] Creating event network-vif-plugged:ee124f30-41ef-4d88-b49e-4ad7cac50168 for instance dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 on n-h2-master-1 Aug 07 01:16:53.215223 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-7155abb5-1aea-4c07-afa2-bf2916f94661 req-315bcd5b-28ea-460e-bcf7-1d6029f301bb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107268 Aug 07 01:16:53.218189 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 859/1533] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:16:53.233602 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-85b7d4c7-2f94-41f1-a889-1dcaec2fd2d7 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:53.234421 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-85b7d4c7-2f94-41f1-a889-1dcaec2fd2d7 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:53.254678 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-85b7d4c7-2f94-41f1-a889-1dcaec2fd2d7 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:53.260064 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-85b7d4c7-2f94-41f1-a889-1dcaec2fd2d7 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:53.261194 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-85b7d4c7-2f94-41f1-a889-1dcaec2fd2d7 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:53.262395 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-85b7d4c7-2f94-41f1-a889-1dcaec2fd2d7 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:53.263093 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-85b7d4c7-2f94-41f1-a889-1dcaec2fd2d7 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:53.264883 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-85b7d4c7-2f94-41f1-a889-1dcaec2fd2d7 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:53.449966 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-85b7d4c7-2f94-41f1-a889-1dcaec2fd2d7 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:53.493454 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-85b7d4c7-2f94-41f1-a889-1dcaec2fd2d7 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1169 microversion: 2.1 time: 0.271347 Aug 07 01:16:53.494708 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 860/1534] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:53 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1169 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:53.499782 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-09dd301d-4898-465b-9094-dd54006df2b7 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:53.500639 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-09dd301d-4898-465b-9094-dd54006df2b7 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] [instance: 91da23de-c338-4658-8620-831662a596b9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:53.507575 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-09dd301d-4898-465b-9094-dd54006df2b7 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:53.508360 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-09dd301d-4898-465b-9094-dd54006df2b7 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:53.508957 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-09dd301d-4898-465b-9094-dd54006df2b7 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:53.510083 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-09dd301d-4898-465b-9094-dd54006df2b7 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:53.510900 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-09dd301d-4898-465b-9094-dd54006df2b7 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:53.511481 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-09dd301d-4898-465b-9094-dd54006df2b7 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:53.534140 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e3fb08a6-ab4a-486c-ba24-2f72378d553d tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '786962988b754fb69bd48070c2992e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614797cd26be4995b087ab864f35d235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:53.547583 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e3fb08a6-ab4a-486c-ba24-2f72378d553d tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68" status: 200 len: 1316 microversion: 2.1 time: 2.028511 Aug 07 01:16:53.550565 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 675/1535] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:51 2022] GET /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68 => generated 1316 bytes in 2034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:53.562336 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-db27da89-ef53-42ea-a593-656f04fbeaaf tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:53.564677 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-db27da89-ef53-42ea-a593-656f04fbeaaf tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: fb8bf657-63c6-4cea-8571-e9449c5ee529] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:53.584369 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db27da89-ef53-42ea-a593-656f04fbeaaf tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:53.585347 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db27da89-ef53-42ea-a593-656f04fbeaaf tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:53.586030 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db27da89-ef53-42ea-a593-656f04fbeaaf tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:53.587048 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db27da89-ef53-42ea-a593-656f04fbeaaf tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:53.587701 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db27da89-ef53-42ea-a593-656f04fbeaaf tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:53.589259 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db27da89-ef53-42ea-a593-656f04fbeaaf tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:53.937080 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-09dd301d-4898-465b-9094-dd54006df2b7 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065d8324da60445ea1e97e1dc892f183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1530b8294fc4dd4bc7e7b228ad2b95c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:53.948417 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-09dd301d-4898-465b-9094-dd54006df2b7 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] 10.222.0.39 "GET /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9" status: 200 len: 1666 microversion: 2.1 time: 0.451894 Aug 07 01:16:53.949443 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 861/1536] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:53 2022] GET /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9 => generated 1666 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:54.003234 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8770e07b-1a92-4152-a3d1-399e411e8e51 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:54.020897 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8770e07b-1a92-4152-a3d1-399e411e8e51 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:54.043494 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8770e07b-1a92-4152-a3d1-399e411e8e51 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:54.044372 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8770e07b-1a92-4152-a3d1-399e411e8e51 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:54.045835 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8770e07b-1a92-4152-a3d1-399e411e8e51 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:54.046777 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8770e07b-1a92-4152-a3d1-399e411e8e51 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:54.047266 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8770e07b-1a92-4152-a3d1-399e411e8e51 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:54.047983 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8770e07b-1a92-4152-a3d1-399e411e8e51 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:54.569290 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-db27da89-ef53-42ea-a593-656f04fbeaaf tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:54.582828 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-db27da89-ef53-42ea-a593-656f04fbeaaf tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/fb8bf657-63c6-4cea-8571-e9449c5ee529" status: 200 len: 1474 microversion: 2.1 time: 1.026710 Aug 07 01:16:54.583758 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 676/1537] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:53 2022] GET /compute/v2.1/servers/fb8bf657-63c6-4cea-8571-e9449c5ee529 => generated 1474 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:54.600353 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-912ef319-acb5-4a36-8074-807a28bbda9b tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:54.601270 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-912ef319-acb5-4a36-8074-807a28bbda9b tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] [instance: d96d68bb-2dab-43ee-872b-e9090e9a3b4b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:54.615455 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-912ef319-acb5-4a36-8074-807a28bbda9b tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:54.616262 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-912ef319-acb5-4a36-8074-807a28bbda9b tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:54.616881 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-912ef319-acb5-4a36-8074-807a28bbda9b tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:54.617832 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-912ef319-acb5-4a36-8074-807a28bbda9b tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:54.618678 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-912ef319-acb5-4a36-8074-807a28bbda9b tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:54.620509 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-912ef319-acb5-4a36-8074-807a28bbda9b tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:55.003153 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-912ef319-acb5-4a36-8074-807a28bbda9b tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af4775c28774015bc168bbcfc9b784d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b47199573142cfabb119e111b69c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:55.016373 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-912ef319-acb5-4a36-8074-807a28bbda9b tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] 10.222.0.39 "GET /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b" status: 200 len: 1283 microversion: 2.1 time: 0.431223 Aug 07 01:16:55.018707 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 677/1538] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:54 2022] GET /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b => generated 1283 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:55.034217 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-5fa6c2bc-1f56-4412-b664-c0ba855ce896 req-6c033e04-56c1-4985-ae1a-1e1fb2b47dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e2ae24f-8349-46d5-b091-876927d02b68", "tag": "63f23b72-85ce-4ced-9d43-dd32e2464731"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:16:55.074493 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-5fa6c2bc-1f56-4412-b664-c0ba855ce896 req-6c033e04-56c1-4985-ae1a-1e1fb2b47dc7 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:55.074991 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-5fa6c2bc-1f56-4412-b664-c0ba855ce896 req-6c033e04-56c1-4985-ae1a-1e1fb2b47dc7 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:55.077070 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-5fa6c2bc-1f56-4412-b664-c0ba855ce896 req-6c033e04-56c1-4985-ae1a-1e1fb2b47dc7 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:55.096064 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8770e07b-1a92-4152-a3d1-399e411e8e51 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:55.101762 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-5fa6c2bc-1f56-4412-b664-c0ba855ce896 req-6c033e04-56c1-4985-ae1a-1e1fb2b47dc7 service nova] Creating event network-changed:63f23b72-85ce-4ced-9d43-dd32e2464731 for instance 9e2ae24f-8349-46d5-b091-876927d02b68 on n-h1-master-1 Aug 07 01:16:55.113508 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-5fa6c2bc-1f56-4412-b664-c0ba855ce896 req-6c033e04-56c1-4985-ae1a-1e1fb2b47dc7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092520 Aug 07 01:16:55.121841 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 678/1539] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:16:55.128957 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-99337be5-cf84-46b5-a8c8-960d0b3bf436 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:55.132537 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-99337be5-cf84-46b5-a8c8-960d0b3bf436 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:55.144291 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8770e07b-1a92-4152-a3d1-399e411e8e51 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1379 microversion: 2.1 time: 1.161920 Aug 07 01:16:55.144904 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 862/1540] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:53 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1379 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:55.148874 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-99337be5-cf84-46b5-a8c8-960d0b3bf436 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:55.149654 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-99337be5-cf84-46b5-a8c8-960d0b3bf436 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:55.152211 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-99337be5-cf84-46b5-a8c8-960d0b3bf436 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:55.153198 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-99337be5-cf84-46b5-a8c8-960d0b3bf436 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:55.154656 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-75c8670c-d929-42d1-8105-0456b8e5895f tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:55.155285 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-75c8670c-d929-42d1-8105-0456b8e5895f tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] [instance: 9e2ae24f-8349-46d5-b091-876927d02b68] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:55.155631 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-99337be5-cf84-46b5-a8c8-960d0b3bf436 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:55.156386 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-99337be5-cf84-46b5-a8c8-960d0b3bf436 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:55.178128 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=93,nova_api:UPDATE=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:55.181193 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75c8670c-d929-42d1-8105-0456b8e5895f tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:55.183230 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75c8670c-d929-42d1-8105-0456b8e5895f tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:55.183977 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75c8670c-d929-42d1-8105-0456b8e5895f tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:55.185765 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75c8670c-d929-42d1-8105-0456b8e5895f tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:55.197563 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75c8670c-d929-42d1-8105-0456b8e5895f tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:55.198380 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75c8670c-d929-42d1-8105-0456b8e5895f tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:55.569744 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-99337be5-cf84-46b5-a8c8-960d0b3bf436 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:55.579096 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-99337be5-cf84-46b5-a8c8-960d0b3bf436 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1169 microversion: 2.1 time: 0.455791 Aug 07 01:16:55.579705 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 679/1541] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:55 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1169 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:55.594307 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3609a27e-0249-4726-906c-2b83f171532b tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:55.595261 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3609a27e-0249-4726-906c-2b83f171532b tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] [instance: 91da23de-c338-4658-8620-831662a596b9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:55.618439 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3609a27e-0249-4726-906c-2b83f171532b tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:55.618943 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3609a27e-0249-4726-906c-2b83f171532b tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:55.619389 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3609a27e-0249-4726-906c-2b83f171532b tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:55.619659 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-75c8670c-d929-42d1-8105-0456b8e5895f tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '786962988b754fb69bd48070c2992e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614797cd26be4995b087ab864f35d235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:55.620148 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3609a27e-0249-4726-906c-2b83f171532b tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:55.620619 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3609a27e-0249-4726-906c-2b83f171532b tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:55.621062 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3609a27e-0249-4726-906c-2b83f171532b tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:55.628757 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-75c8670c-d929-42d1-8105-0456b8e5895f tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68" status: 200 len: 1316 microversion: 2.1 time: 0.479523 Aug 07 01:16:55.636059 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 863/1542] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:55 2022] GET /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68 => generated 1316 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:55.641365 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-4a7cb166-6e3c-4869-a9b3-ccd029e08c73 req-832dafa7-a199-4adf-8aa2-018bf5f96707 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91da23de-c338-4658-8620-831662a596b9", "name": "network-vif-unplugged", "status": "completed", "tag": "99794d9c-3897-4d04-8ca2-58aae35eb7f7"}, {"server_uuid": "d2dbfd1a-efab-4943-b00a-6cdd1051489c", "name": "network-vif-plugged", "status": "completed", "tag": "05c06eb8-fc76-4d4a-bf23-b4a1dd7229f7"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:16:55.676796 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4a7cb166-6e3c-4869-a9b3-ccd029e08c73 req-832dafa7-a199-4adf-8aa2-018bf5f96707 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:55.677305 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4a7cb166-6e3c-4869-a9b3-ccd029e08c73 req-832dafa7-a199-4adf-8aa2-018bf5f96707 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:55.677786 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4a7cb166-6e3c-4869-a9b3-ccd029e08c73 req-832dafa7-a199-4adf-8aa2-018bf5f96707 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:55.704138 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-4a7cb166-6e3c-4869-a9b3-ccd029e08c73 req-832dafa7-a199-4adf-8aa2-018bf5f96707 service nova] Creating event network-vif-unplugged:99794d9c-3897-4d04-8ca2-58aae35eb7f7 for instance 91da23de-c338-4658-8620-831662a596b9 on n-h2-master-1 Aug 07 01:16:55.704665 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-4a7cb166-6e3c-4869-a9b3-ccd029e08c73 req-832dafa7-a199-4adf-8aa2-018bf5f96707 service nova] Creating event network-vif-plugged:05c06eb8-fc76-4d4a-bf23-b4a1dd7229f7 for instance d2dbfd1a-efab-4943-b00a-6cdd1051489c on n-h1-master-1 Aug 07 01:16:55.728679 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-4a7cb166-6e3c-4869-a9b3-ccd029e08c73 req-832dafa7-a199-4adf-8aa2-018bf5f96707 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.090889 Aug 07 01:16:55.729339 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 864/1543] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:16:55.737182 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-67e1e29c-0973-4f27-ac41-80bb8268398b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:55.738561 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-67e1e29c-0973-4f27-ac41-80bb8268398b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: fb8bf657-63c6-4cea-8571-e9449c5ee529] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:55.789249 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67e1e29c-0973-4f27-ac41-80bb8268398b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:55.790166 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67e1e29c-0973-4f27-ac41-80bb8268398b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:55.798478 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67e1e29c-0973-4f27-ac41-80bb8268398b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:55.799461 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67e1e29c-0973-4f27-ac41-80bb8268398b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:55.808341 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67e1e29c-0973-4f27-ac41-80bb8268398b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:55.808951 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67e1e29c-0973-4f27-ac41-80bb8268398b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:56.200889 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:56.309109 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-67e1e29c-0973-4f27-ac41-80bb8268398b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:56.330974 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-67e1e29c-0973-4f27-ac41-80bb8268398b tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/fb8bf657-63c6-4cea-8571-e9449c5ee529" status: 200 len: 1474 microversion: 2.1 time: 0.600382 Aug 07 01:16:56.332323 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 865/1544] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:55 2022] GET /compute/v2.1/servers/fb8bf657-63c6-4cea-8571-e9449c5ee529 => generated 1474 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:56.445271 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:56.447516 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-aa36e354-b937-468f-a79e-02ab4fb9a51b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2009766722", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "68fdaf7a-c018-4207-a54c-86715ad58de9"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:16:56.491827 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:56.581669 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-aa36e354-b937-468f-a79e-02ab4fb9a51b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] validate_networks() for [('68fdaf7a-c018-4207-a54c-86715ad58de9', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:16:57.331953 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3609a27e-0249-4726-906c-2b83f171532b tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065d8324da60445ea1e97e1dc892f183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1530b8294fc4dd4bc7e7b228ad2b95c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:57.346534 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3609a27e-0249-4726-906c-2b83f171532b tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] 10.222.0.39 "GET /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9" status: 200 len: 1666 microversion: 2.1 time: 1.758301 Aug 07 01:16:57.359554 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 680/1545] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:55 2022] GET /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9 => generated 1666 bytes in 1767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:57.375193 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-235818a5-99ed-4bbf-b2a7-fd1e27e35e0c tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:57.375830 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-235818a5-99ed-4bbf-b2a7-fd1e27e35e0c tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] [instance: d96d68bb-2dab-43ee-872b-e9090e9a3b4b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:57.397993 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-235818a5-99ed-4bbf-b2a7-fd1e27e35e0c tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:57.398503 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-235818a5-99ed-4bbf-b2a7-fd1e27e35e0c tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:57.398957 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-235818a5-99ed-4bbf-b2a7-fd1e27e35e0c tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:57.413869 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-235818a5-99ed-4bbf-b2a7-fd1e27e35e0c tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:57.414990 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-235818a5-99ed-4bbf-b2a7-fd1e27e35e0c tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:57.415465 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-235818a5-99ed-4bbf-b2a7-fd1e27e35e0c tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:57.607549 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-aa36e354-b937-468f-a79e-02ab4fb9a51b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:16:57.609068 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-aa36e354-b937-468f-a79e-02ab4fb9a51b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:16:57.610565 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-aa36e354-b937-468f-a79e-02ab4fb9a51b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:16:57.611196 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-aa36e354-b937-468f-a79e-02ab4fb9a51b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:16:57.611800 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-aa36e354-b937-468f-a79e-02ab4fb9a51b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:16:57.627622 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa36e354-b937-468f-a79e-02ab4fb9a51b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:57.628448 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa36e354-b937-468f-a79e-02ab4fb9a51b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:57.629530 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa36e354-b937-468f-a79e-02ab4fb9a51b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:57.630764 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa36e354-b937-468f-a79e-02ab4fb9a51b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:57.631431 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa36e354-b937-468f-a79e-02ab4fb9a51b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:57.632142 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa36e354-b937-468f-a79e-02ab4fb9a51b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:57.678071 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-aa36e354-b937-468f-a79e-02ab4fb9a51b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Getting quotas for project 1371b7aebfcf4088a02780393de8200f. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:16:57.685843 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-aa36e354-b937-468f-a79e-02ab4fb9a51b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Getting quotas for user 45ed48709ab84fa4b5b341332a843ad8 and project 1371b7aebfcf4088a02780393de8200f. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:16:57.704778 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-aa36e354-b937-468f-a79e-02ab4fb9a51b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:16:57.707952 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-aa36e354-b937-468f-a79e-02ab4fb9a51b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: ff193541-98b3-40f6-976c-8b1c721f0bc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:16:57.773472 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-aa36e354-b937-468f-a79e-02ab4fb9a51b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.439771 Aug 07 01:16:57.774641 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 866/1546] 10.222.0.39 () {62 vars in 1188 bytes} [Sun Aug 7 01:16:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1442 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 07 01:16:57.789419 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cec595fc-68b0-4a9e-9825-3978e53a828d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:57.790866 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cec595fc-68b0-4a9e-9825-3978e53a828d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:57.805762 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cec595fc-68b0-4a9e-9825-3978e53a828d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:57.821299 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cec595fc-68b0-4a9e-9825-3978e53a828d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:57.823830 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cec595fc-68b0-4a9e-9825-3978e53a828d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:57.832523 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cec595fc-68b0-4a9e-9825-3978e53a828d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:57.833794 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cec595fc-68b0-4a9e-9825-3978e53a828d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:57.834794 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cec595fc-68b0-4a9e-9825-3978e53a828d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:58.269868 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cec595fc-68b0-4a9e-9825-3978e53a828d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:58.304583 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cec595fc-68b0-4a9e-9825-3978e53a828d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1379 microversion: 2.1 time: 0.526636 Aug 07 01:16:58.317177 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 867/1547] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:57 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1379 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:58.326979 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-6dd9ec3d-c69c-45d4-a8a0-239897e584ef req-5b68071b-323f-47d4-8a6c-e1c297aa121e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb8bf657-63c6-4cea-8571-e9449c5ee529", "name": "network-vif-deleted", "tag": "1681a453-c8a8-46bc-aef4-5ce8cc192252"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:16:58.370487 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6dd9ec3d-c69c-45d4-a8a0-239897e584ef req-5b68071b-323f-47d4-8a6c-e1c297aa121e service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:58.373731 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6dd9ec3d-c69c-45d4-a8a0-239897e584ef req-5b68071b-323f-47d4-8a6c-e1c297aa121e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:58.374371 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6dd9ec3d-c69c-45d4-a8a0-239897e584ef req-5b68071b-323f-47d4-8a6c-e1c297aa121e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:58.410019 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-6dd9ec3d-c69c-45d4-a8a0-239897e584ef req-5b68071b-323f-47d4-8a6c-e1c297aa121e service nova] Creating event network-vif-deleted:1681a453-c8a8-46bc-aef4-5ce8cc192252 for instance fb8bf657-63c6-4cea-8571-e9449c5ee529 on n-h2-master-1 Aug 07 01:16:58.418374 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-6dd9ec3d-c69c-45d4-a8a0-239897e584ef req-5b68071b-323f-47d4-8a6c-e1c297aa121e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105583 Aug 07 01:16:58.422040 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 868/1548] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:16:58.430783 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-954376f8-94de-4ef1-8564-11bf7bb21342 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:58.431497 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-954376f8-94de-4ef1-8564-11bf7bb21342 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:58.453011 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-954376f8-94de-4ef1-8564-11bf7bb21342 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:58.456087 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-954376f8-94de-4ef1-8564-11bf7bb21342 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:58.456633 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-954376f8-94de-4ef1-8564-11bf7bb21342 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:58.457503 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-954376f8-94de-4ef1-8564-11bf7bb21342 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:58.457986 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-954376f8-94de-4ef1-8564-11bf7bb21342 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:58.458434 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-954376f8-94de-4ef1-8564-11bf7bb21342 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:58.463256 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:58.640646 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-954376f8-94de-4ef1-8564-11bf7bb21342 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:58.654174 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-954376f8-94de-4ef1-8564-11bf7bb21342 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1169 microversion: 2.1 time: 0.230741 Aug 07 01:16:58.654774 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 869/1549] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:58 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1169 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:58.683869 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-22d18d85-c42b-44ad-b32b-3b1b4fc95572 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:58.689201 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-22d18d85-c42b-44ad-b32b-3b1b4fc95572 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] [instance: 9e2ae24f-8349-46d5-b091-876927d02b68] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:58.717210 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22d18d85-c42b-44ad-b32b-3b1b4fc95572 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:58.718382 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22d18d85-c42b-44ad-b32b-3b1b4fc95572 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:58.719111 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22d18d85-c42b-44ad-b32b-3b1b4fc95572 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:58.723320 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22d18d85-c42b-44ad-b32b-3b1b4fc95572 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:58.726011 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22d18d85-c42b-44ad-b32b-3b1b4fc95572 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:58.729481 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22d18d85-c42b-44ad-b32b-3b1b4fc95572 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:59.659424 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-22d18d85-c42b-44ad-b32b-3b1b4fc95572 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '786962988b754fb69bd48070c2992e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614797cd26be4995b087ab864f35d235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:59.677399 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-22d18d85-c42b-44ad-b32b-3b1b4fc95572 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68" status: 200 len: 1316 microversion: 2.1 time: 1.004075 Aug 07 01:16:59.678081 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 870/1550] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:58 2022] GET /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68 => generated 1316 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:59.695423 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-456de8c6-1c59-464b-a0b1-c971906f99dd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:59.696087 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-456de8c6-1c59-464b-a0b1-c971906f99dd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: fb8bf657-63c6-4cea-8571-e9449c5ee529] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:59.727388 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-235818a5-99ed-4bbf-b2a7-fd1e27e35e0c tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af4775c28774015bc168bbcfc9b784d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b47199573142cfabb119e111b69c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:16:59.740947 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-456de8c6-1c59-464b-a0b1-c971906f99dd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:59.741365 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-235818a5-99ed-4bbf-b2a7-fd1e27e35e0c tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] 10.222.0.39 "GET /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b" status: 200 len: 1325 microversion: 2.1 time: 2.386691 Aug 07 01:16:59.741834 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-456de8c6-1c59-464b-a0b1-c971906f99dd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:59.743009 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 681/1551] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:57 2022] GET /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b => generated 1325 bytes in 2391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:16:59.757971 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-456de8c6-1c59-464b-a0b1-c971906f99dd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:59.762336 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-456de8c6-1c59-464b-a0b1-c971906f99dd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:59.762863 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f1be8637-90f3-40ac-b96a-47de5863fb54 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:59.763042 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-456de8c6-1c59-464b-a0b1-c971906f99dd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:59.763353 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-456de8c6-1c59-464b-a0b1-c971906f99dd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:59.766265 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f1be8637-90f3-40ac-b96a-47de5863fb54 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: ff193541-98b3-40f6-976c-8b1c721f0bc6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:59.810707 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-456de8c6-1c59-464b-a0b1-c971906f99dd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] HTTP exception thrown: Instance fb8bf657-63c6-4cea-8571-e9449c5ee529 could not be found. Aug 07 01:16:59.811631 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1be8637-90f3-40ac-b96a-47de5863fb54 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:59.812238 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1be8637-90f3-40ac-b96a-47de5863fb54 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:59.814642 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1be8637-90f3-40ac-b96a-47de5863fb54 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:59.827079 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-456de8c6-1c59-464b-a0b1-c971906f99dd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Request method failure captured: Aug 07 01:16:59.827079 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/fb8bf657-63c6-4cea-8571-e9449c5ee529 HTTP/1.1 Aug 07 01:16:59.827079 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:16:59.827079 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:16:59.827079 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:16:59.827079 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:16:59.827079 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:16:59.827079 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:16:59.827079 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:16:59.827079 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:16:59.827079 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xGgZk2s0TuGzjJ8Xb6l7TnV8b2-7iInqh8WC73CRWxSE0_rne48-_XKuRGb9kyv1AQzpFFJZcYYqYPMbhYC4_BIHJInCNDeosVwZHelUBKtqqVJND2DtGLIn9MgrQRQOOb_QIwQOiIjRrXCbSodF39r4CP0D2xvEnYTXsUUzANa4KA Aug 07 01:16:59.827079 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:16:59.827079 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:16:59.827079 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:16:59.827079 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:16:59.827079 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:16:59.827079 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:16:59.827079 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: d08d010c14a64f759887be0d2364c6e4 Aug 07 01:16:59.827079 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersOnMultiNodesTest-1089196105 Aug 07 01:16:59.827079 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:16:59.827079 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:16:59.828874 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d08d010c14a64f759887be0d2364c6e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d08d010c14a64f759887be0d2364c6e4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d08d010c14a64f759887be0d2364c6e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d08d010c14a64f759887be0d2364c6e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:16:59.828874 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersOnMultiNodesTest-1089196105 Aug 07 01:16:59.828874 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: d08d010c14a64f759887be0d2364c6e4 Aug 07 01:16:59.828874 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1089196105 Aug 07 01:16:59.828874 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersOnMultiNodesTest-1089196105-project Aug 07 01:16:59.828874 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:16:59.828874 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:16:59.828874 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 32fc1959d8aa41eabcead217b9d7bc47 Aug 07 01:16:59.828874 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersOnMultiNodesTest-1089196105-project Aug 07 01:16:59.828874 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:16:59.828874 n-d-master-1 devstack@n-api.service[119516]: exception: Instance fb8bf657-63c6-4cea-8571-e9449c5ee529 could not be found. Aug 07 01:16:59.828874 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'fb8bf657-63c6-4cea-8571-e9449c5ee529'} Aug 07 01:16:59.829842 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:16:59.829842 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:59.829842 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:16:59.829842 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:16:59.829842 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:16:59.829842 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:16:59.829842 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:16:59.829842 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:16:59.829842 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:16:59.829842 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:16:59.829842 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb8bf657-63c6-4cea-8571-e9449c5ee529 could not be found. Aug 07 01:16:59.829842 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:16:59.829842 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:16:59.829842 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:16:59.829842 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:59.829842 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:16:59.829842 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:16:59.829842 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:16:59.829842 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:16:59.829842 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:16:59.831309 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:16:59.831309 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:16:59.831309 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:16:59.831309 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:16:59.831309 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:16:59.831309 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:16:59.831309 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:16:59.831309 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb8bf657-63c6-4cea-8571-e9449c5ee529 could not be found. Aug 07 01:16:59.831309 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:16:59.831309 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:16:59.831309 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:16:59.831309 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:16:59.831309 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:16:59.831309 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:16:59.831309 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:16:59.831309 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:16:59.831309 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb8bf657-63c6-4cea-8571-e9449c5ee529 could not be found. Aug 07 01:16:59.831309 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:16:59.833368 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-456de8c6-1c59-464b-a0b1-c971906f99dd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Returning 404 to user: Instance fb8bf657-63c6-4cea-8571-e9449c5ee529 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:16:59.833368 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-456de8c6-1c59-464b-a0b1-c971906f99dd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/fb8bf657-63c6-4cea-8571-e9449c5ee529" status: 404 len: 111 microversion: 2.1 time: 0.139734 Aug 07 01:16:59.835589 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 871/1552] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:59 2022] GET /compute/v2.1/servers/fb8bf657-63c6-4cea-8571-e9449c5ee529 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:16:59.844198 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1be8637-90f3-40ac-b96a-47de5863fb54 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:59.852334 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-591e868e-d3cf-4c70-b8e9-f635b9a8c23a tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:16:59.853436 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-591e868e-d3cf-4c70-b8e9-f635b9a8c23a tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] [instance: 91da23de-c338-4658-8620-831662a596b9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:16:59.855169 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1be8637-90f3-40ac-b96a-47de5863fb54 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:59.855730 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1be8637-90f3-40ac-b96a-47de5863fb54 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:59.873441 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-591e868e-d3cf-4c70-b8e9-f635b9a8c23a tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:59.874263 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-591e868e-d3cf-4c70-b8e9-f635b9a8c23a tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:59.875818 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-591e868e-d3cf-4c70-b8e9-f635b9a8c23a tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:16:59.882758 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-591e868e-d3cf-4c70-b8e9-f635b9a8c23a tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:16:59.883577 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-591e868e-d3cf-4c70-b8e9-f635b9a8c23a tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:16:59.884633 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-591e868e-d3cf-4c70-b8e9-f635b9a8c23a tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:00.131937 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-591e868e-d3cf-4c70-b8e9-f635b9a8c23a tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065d8324da60445ea1e97e1dc892f183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1530b8294fc4dd4bc7e7b228ad2b95c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:00.147627 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-591e868e-d3cf-4c70-b8e9-f635b9a8c23a tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] 10.222.0.39 "GET /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9" status: 200 len: 1311 microversion: 2.1 time: 0.305882 Aug 07 01:17:00.164739 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 872/1553] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:16:59 2022] GET /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9 => generated 1311 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:00.175091 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f58ee5b6-0879-4c67-812d-a0b21f5bdd77 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:00.179282 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f58ee5b6-0879-4c67-812d-a0b21f5bdd77 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:00.202398 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f58ee5b6-0879-4c67-812d-a0b21f5bdd77 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:00.203378 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f58ee5b6-0879-4c67-812d-a0b21f5bdd77 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:00.204105 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f58ee5b6-0879-4c67-812d-a0b21f5bdd77 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:00.208853 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f58ee5b6-0879-4c67-812d-a0b21f5bdd77 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:00.211651 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f58ee5b6-0879-4c67-812d-a0b21f5bdd77 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:00.213995 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f58ee5b6-0879-4c67-812d-a0b21f5bdd77 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:00.560915 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f1be8637-90f3-40ac-b96a-47de5863fb54 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:00.596941 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f1be8637-90f3-40ac-b96a-47de5863fb54 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:00.603116 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f1be8637-90f3-40ac-b96a-47de5863fb54 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:00.605132 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f1be8637-90f3-40ac-b96a-47de5863fb54 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6" status: 200 len: 1314 microversion: 2.25 time: 0.860465 Aug 07 01:17:00.635159 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 682/1554] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:16:59 2022] GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6 => generated 1314 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:00.649795 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fc9c9930-df6f-49bc-85a1-1ec41beab000 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:00.652212 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fc9c9930-df6f-49bc-85a1-1ec41beab000 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:00.690456 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fc9c9930-df6f-49bc-85a1-1ec41beab000 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:00.707722 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fc9c9930-df6f-49bc-85a1-1ec41beab000 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:00.708744 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fc9c9930-df6f-49bc-85a1-1ec41beab000 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:00.709827 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fc9c9930-df6f-49bc-85a1-1ec41beab000 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:00.710521 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fc9c9930-df6f-49bc-85a1-1ec41beab000 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:00.715655 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fc9c9930-df6f-49bc-85a1-1ec41beab000 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:01.035662 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f58ee5b6-0879-4c67-812d-a0b21f5bdd77 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:01.076492 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f58ee5b6-0879-4c67-812d-a0b21f5bdd77 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1529 microversion: 2.1 time: 0.905726 Aug 07 01:17:01.077243 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 873/1555] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:00 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1529 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:01.104565 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-9b2ee028-d1bc-47e0-b0c2-b26d9690c0fb req-f7ce3b90-8dc8-4463-b64f-0086260bff08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91da23de-c338-4658-8620-831662a596b9", "name": "network-vif-deleted", "tag": "99794d9c-3897-4d04-8ca2-58aae35eb7f7"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:01.168143 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-9b2ee028-d1bc-47e0-b0c2-b26d9690c0fb req-f7ce3b90-8dc8-4463-b64f-0086260bff08 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:01.168937 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-9b2ee028-d1bc-47e0-b0c2-b26d9690c0fb req-f7ce3b90-8dc8-4463-b64f-0086260bff08 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:01.169630 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-9b2ee028-d1bc-47e0-b0c2-b26d9690c0fb req-f7ce3b90-8dc8-4463-b64f-0086260bff08 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:01.222012 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-9b2ee028-d1bc-47e0-b0c2-b26d9690c0fb req-f7ce3b90-8dc8-4463-b64f-0086260bff08 service nova] Creating event network-vif-deleted:99794d9c-3897-4d04-8ca2-58aae35eb7f7 for instance 91da23de-c338-4658-8620-831662a596b9 on n-h2-master-1 Aug 07 01:17:01.270404 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-9b2ee028-d1bc-47e0-b0c2-b26d9690c0fb req-f7ce3b90-8dc8-4463-b64f-0086260bff08 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186488 Aug 07 01:17:01.276429 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 874/1556] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:17:01.291430 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6a2b336b-88cb-4430-8043-0333da5ace05 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:01.292978 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6a2b336b-88cb-4430-8043-0333da5ace05 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 9a4ced25-d85e-4469-95b6-5e666731a714] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:01.310787 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a2b336b-88cb-4430-8043-0333da5ace05 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:01.314809 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a2b336b-88cb-4430-8043-0333da5ace05 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:01.315636 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a2b336b-88cb-4430-8043-0333da5ace05 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:01.317387 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a2b336b-88cb-4430-8043-0333da5ace05 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:01.318184 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a2b336b-88cb-4430-8043-0333da5ace05 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:01.321979 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a2b336b-88cb-4430-8043-0333da5ace05 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:01.359442 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-6a2b336b-88cb-4430-8043-0333da5ace05 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] HTTP exception thrown: Instance 9a4ced25-d85e-4469-95b6-5e666731a714 could not be found. Aug 07 01:17:01.361781 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6a2b336b-88cb-4430-8043-0333da5ace05 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Request method failure captured: Aug 07 01:17:01.361781 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714 HTTP/1.1 Aug 07 01:17:01.361781 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:17:01.361781 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:17:01.361781 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:17:01.361781 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:17:01.361781 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:17:01.361781 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:17:01.361781 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:17:01.361781 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:17:01.361781 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xGgZk2s0TuGzjJ8Xb6l7TnV8b2-7iInqh8WC73CRWxSE0_rne48-_XKuRGb9kyv1AQzpFFJZcYYqYPMbhYC4_BIHJInCNDeosVwZHelUBKtqqVJND2DtGLIn9MgrQRQOOb_QIwQOiIjRrXCbSodF39r4CP0D2xvEnYTXsUUzANa4KA Aug 07 01:17:01.361781 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:17:01.361781 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:17:01.361781 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:17:01.361781 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:17:01.361781 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:17:01.361781 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:17:01.361781 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: d08d010c14a64f759887be0d2364c6e4 Aug 07 01:17:01.361781 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersOnMultiNodesTest-1089196105 Aug 07 01:17:01.361781 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:17:01.361781 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:17:01.364009 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d08d010c14a64f759887be0d2364c6e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d08d010c14a64f759887be0d2364c6e4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d08d010c14a64f759887be0d2364c6e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d08d010c14a64f759887be0d2364c6e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:17:01.364009 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersOnMultiNodesTest-1089196105 Aug 07 01:17:01.364009 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: d08d010c14a64f759887be0d2364c6e4 Aug 07 01:17:01.364009 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1089196105 Aug 07 01:17:01.364009 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersOnMultiNodesTest-1089196105-project Aug 07 01:17:01.364009 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:17:01.364009 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:17:01.364009 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 32fc1959d8aa41eabcead217b9d7bc47 Aug 07 01:17:01.364009 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersOnMultiNodesTest-1089196105-project Aug 07 01:17:01.364009 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:17:01.364009 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 9a4ced25-d85e-4469-95b6-5e666731a714 could not be found. Aug 07 01:17:01.364009 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '9a4ced25-d85e-4469-95b6-5e666731a714'} Aug 07 01:17:01.365023 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:17:01.365023 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:01.365023 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:17:01.365023 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:17:01.365023 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:17:01.365023 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:17:01.365023 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:17:01.365023 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:17:01.365023 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:17:01.365023 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:17:01.365023 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a4ced25-d85e-4469-95b6-5e666731a714 could not be found. Aug 07 01:17:01.365023 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:17:01.365023 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:17:01.365023 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:17:01.365023 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:01.365023 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:17:01.365023 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:17:01.365023 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:17:01.365023 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:17:01.365023 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:17:01.366399 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:17:01.366399 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:17:01.366399 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:17:01.366399 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:17:01.366399 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:17:01.366399 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:17:01.366399 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:17:01.366399 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a4ced25-d85e-4469-95b6-5e666731a714 could not be found. Aug 07 01:17:01.366399 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:17:01.366399 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:17:01.366399 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:17:01.366399 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:01.366399 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:17:01.366399 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:17:01.366399 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:17:01.366399 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:17:01.366399 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a4ced25-d85e-4469-95b6-5e666731a714 could not be found. Aug 07 01:17:01.366399 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:17:01.371831 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6a2b336b-88cb-4430-8043-0333da5ace05 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Returning 404 to user: Instance 9a4ced25-d85e-4469-95b6-5e666731a714 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:17:01.373562 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6a2b336b-88cb-4430-8043-0333da5ace05 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714" status: 404 len: 111 microversion: 2.1 time: 0.095230 Aug 07 01:17:01.377844 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 875/1557] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:01 2022] GET /compute/v2.1/servers/9a4ced25-d85e-4469-95b6-5e666731a714 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:17:01.384844 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-6db90ea9-9798-4b2c-8612-884709bd9f22 req-493e6533-255b-4c94-b3cd-f0ae07868f56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a4ced25-d85e-4469-95b6-5e666731a714", "name": "network-vif-deleted", "tag": "0e4b319a-2574-4b38-a31e-4942cb5bda7f"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:01.403064 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6db90ea9-9798-4b2c-8612-884709bd9f22 req-493e6533-255b-4c94-b3cd-f0ae07868f56 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:01.405407 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6db90ea9-9798-4b2c-8612-884709bd9f22 req-493e6533-255b-4c94-b3cd-f0ae07868f56 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:01.406192 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6db90ea9-9798-4b2c-8612-884709bd9f22 req-493e6533-255b-4c94-b3cd-f0ae07868f56 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:01.441824 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-6db90ea9-9798-4b2c-8612-884709bd9f22 req-493e6533-255b-4c94-b3cd-f0ae07868f56 service nova] Creating event network-vif-deleted:0e4b319a-2574-4b38-a31e-4942cb5bda7f for instance 9a4ced25-d85e-4469-95b6-5e666731a714 on n-h2-master-1 Aug 07 01:17:01.454938 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-6db90ea9-9798-4b2c-8612-884709bd9f22 req-493e6533-255b-4c94-b3cd-f0ae07868f56 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074816 Aug 07 01:17:01.459456 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 876/1558] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:17:01.469303 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b8917a86-72b6-476e-8c85-4bc6aa6d25cc tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:01.473096 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b8917a86-72b6-476e-8c85-4bc6aa6d25cc tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] [instance: 9e2ae24f-8349-46d5-b091-876927d02b68] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:01.491304 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b8917a86-72b6-476e-8c85-4bc6aa6d25cc tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:01.494962 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b8917a86-72b6-476e-8c85-4bc6aa6d25cc tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:01.496065 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b8917a86-72b6-476e-8c85-4bc6aa6d25cc tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:01.499158 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b8917a86-72b6-476e-8c85-4bc6aa6d25cc tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:01.500569 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b8917a86-72b6-476e-8c85-4bc6aa6d25cc tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:01.507119 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b8917a86-72b6-476e-8c85-4bc6aa6d25cc tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:01.719633 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fc9c9930-df6f-49bc-85a1-1ec41beab000 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:01.732919 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fc9c9930-df6f-49bc-85a1-1ec41beab000 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1211 microversion: 2.1 time: 1.095104 Aug 07 01:17:01.739177 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 683/1559] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:00 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1211 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:01.759471 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-88e48251-68f1-4f75-91fe-785426240cbe tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:01.764775 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-88e48251-68f1-4f75-91fe-785426240cbe tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] [instance: d96d68bb-2dab-43ee-872b-e9090e9a3b4b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:01.795220 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-88e48251-68f1-4f75-91fe-785426240cbe tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:01.795975 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-88e48251-68f1-4f75-91fe-785426240cbe tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:01.801851 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-88e48251-68f1-4f75-91fe-785426240cbe tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:01.805787 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-88e48251-68f1-4f75-91fe-785426240cbe tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:01.806293 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-88e48251-68f1-4f75-91fe-785426240cbe tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:01.808204 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-88e48251-68f1-4f75-91fe-785426240cbe tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:02.142459 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b8917a86-72b6-476e-8c85-4bc6aa6d25cc tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '786962988b754fb69bd48070c2992e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614797cd26be4995b087ab864f35d235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:02.177710 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b8917a86-72b6-476e-8c85-4bc6aa6d25cc tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68" status: 200 len: 1316 microversion: 2.1 time: 0.715570 Aug 07 01:17:02.178531 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 877/1560] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:01 2022] GET /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68 => generated 1316 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:02.210574 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b2b216e7-bed3-42f2-a9c6-fc4320fde54b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:02.215105 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b2b216e7-bed3-42f2-a9c6-fc4320fde54b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:02.238912 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b2b216e7-bed3-42f2-a9c6-fc4320fde54b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:02.240963 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b2b216e7-bed3-42f2-a9c6-fc4320fde54b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:02.241992 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b2b216e7-bed3-42f2-a9c6-fc4320fde54b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:02.246759 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b2b216e7-bed3-42f2-a9c6-fc4320fde54b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:02.247556 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b2b216e7-bed3-42f2-a9c6-fc4320fde54b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:02.248203 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b2b216e7-bed3-42f2-a9c6-fc4320fde54b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:02.831718 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b2b216e7-bed3-42f2-a9c6-fc4320fde54b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:02.850180 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b2b216e7-bed3-42f2-a9c6-fc4320fde54b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1529 microversion: 2.1 time: 0.650436 Aug 07 01:17:02.855580 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 878/1561] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:02 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1529 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:02.881857 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-52ff0782-411c-4a89-82bc-f233a1b0951b tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:02.883013 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-52ff0782-411c-4a89-82bc-f233a1b0951b tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] [instance: 91da23de-c338-4658-8620-831662a596b9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:02.924508 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52ff0782-411c-4a89-82bc-f233a1b0951b tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:02.927382 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52ff0782-411c-4a89-82bc-f233a1b0951b tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:02.929682 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52ff0782-411c-4a89-82bc-f233a1b0951b tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:02.934571 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52ff0782-411c-4a89-82bc-f233a1b0951b tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:02.935622 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52ff0782-411c-4a89-82bc-f233a1b0951b tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:02.936526 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52ff0782-411c-4a89-82bc-f233a1b0951b tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:02.994729 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-52ff0782-411c-4a89-82bc-f233a1b0951b tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] HTTP exception thrown: Instance 91da23de-c338-4658-8620-831662a596b9 could not be found. Aug 07 01:17:02.998319 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-52ff0782-411c-4a89-82bc-f233a1b0951b tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Request method failure captured: Aug 07 01:17:02.998319 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9 HTTP/1.1 Aug 07 01:17:02.998319 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:17:02.998319 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:17:02.998319 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:17:02.998319 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:17:02.998319 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:17:02.998319 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:17:02.998319 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:17:02.998319 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:17:02.998319 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xI9TPCT7qjSc_JHDKCBWcODBbXM497nHdw1rq8sxoAqp5FiF75fKNe0SAOio9-1-VhNmaGKM7MKFATHigpFeqtX4dcM7cQ6MrKQHllky2EV6qFubR2Ob8SwEHBnEYWNrduP47CkpWLbVCpP20L1-9U6b9rOaUR_eIaZX49o02mFWgA Aug 07 01:17:02.998319 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:17:02.998319 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:17:02.998319 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:17:02.998319 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:17:02.998319 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:17:02.998319 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:17:02.998319 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: e1530b8294fc4dd4bc7e7b228ad2b95c Aug 07 01:17:02.998319 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersTestFqdnHostnames-1925255191 Aug 07 01:17:02.998319 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:17:02.998319 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:17:02.999987 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e1530b8294fc4dd4bc7e7b228ad2b95c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e1530b8294fc4dd4bc7e7b228ad2b95c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e1530b8294fc4dd4bc7e7b228ad2b95c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e1530b8294fc4dd4bc7e7b228ad2b95c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:17:02.999987 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersTestFqdnHostnames-1925255191 Aug 07 01:17:02.999987 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: e1530b8294fc4dd4bc7e7b228ad2b95c Aug 07 01:17:02.999987 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1925255191 Aug 07 01:17:02.999987 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersTestFqdnHostnames-1925255191-project Aug 07 01:17:02.999987 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:17:02.999987 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:17:02.999987 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 065d8324da60445ea1e97e1dc892f183 Aug 07 01:17:02.999987 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersTestFqdnHostnames-1925255191-project Aug 07 01:17:02.999987 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:17:02.999987 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 91da23de-c338-4658-8620-831662a596b9 could not be found. Aug 07 01:17:02.999987 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '91da23de-c338-4658-8620-831662a596b9'} Aug 07 01:17:03.000965 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:17:03.000965 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:03.000965 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:17:03.000965 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:17:03.000965 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:17:03.000965 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:17:03.000965 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:17:03.000965 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:17:03.000965 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:17:03.000965 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:17:03.000965 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91da23de-c338-4658-8620-831662a596b9 could not be found. Aug 07 01:17:03.000965 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:17:03.000965 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:17:03.000965 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:17:03.000965 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:03.000965 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:17:03.000965 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:17:03.000965 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:17:03.000965 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:17:03.000965 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:17:03.003073 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:17:03.003073 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:17:03.003073 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:17:03.003073 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:17:03.003073 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:17:03.003073 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:17:03.003073 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:17:03.003073 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91da23de-c338-4658-8620-831662a596b9 could not be found. Aug 07 01:17:03.003073 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:17:03.003073 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:17:03.003073 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:17:03.003073 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:03.003073 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:17:03.003073 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:17:03.003073 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:17:03.003073 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:17:03.003073 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91da23de-c338-4658-8620-831662a596b9 could not be found. Aug 07 01:17:03.003073 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:17:03.006778 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-52ff0782-411c-4a89-82bc-f233a1b0951b tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Returning 404 to user: Instance 91da23de-c338-4658-8620-831662a596b9 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:17:03.008128 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-52ff0782-411c-4a89-82bc-f233a1b0951b tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] 10.222.0.39 "GET /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9" status: 404 len: 111 microversion: 2.1 time: 0.148894 Aug 07 01:17:03.017649 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 879/1562] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:02 2022] GET /compute/v2.1/servers/91da23de-c338-4658-8620-831662a596b9 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:17:03.028210 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c7a8cdeb-f2f3-4963-b142-ed9a72d77ac3 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:03.086858 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c7a8cdeb-f2f3-4963-b142-ed9a72d77ac3 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/3ca9bf80-25d0-438c-8b41-d7d92142db5c" status: 204 len: 0 microversion: 2.1 time: 0.066551 Aug 07 01:17:03.088289 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 880/1563] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Aug 7 01:17:03 2022] DELETE /compute/v2.1/os-server-groups/3ca9bf80-25d0-438c-8b41-d7d92142db5c => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:17:03.103586 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fae8b90d-7338-4f23-9e44-4c6cfb59d7ad tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:03.104614 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fae8b90d-7338-4f23-9e44-4c6cfb59d7ad tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: ff193541-98b3-40f6-976c-8b1c721f0bc6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:03.152688 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fae8b90d-7338-4f23-9e44-4c6cfb59d7ad tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:03.155146 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fae8b90d-7338-4f23-9e44-4c6cfb59d7ad tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:03.156276 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fae8b90d-7338-4f23-9e44-4c6cfb59d7ad tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:03.157990 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fae8b90d-7338-4f23-9e44-4c6cfb59d7ad tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:03.159115 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fae8b90d-7338-4f23-9e44-4c6cfb59d7ad tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:03.161335 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fae8b90d-7338-4f23-9e44-4c6cfb59d7ad tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:03.389709 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-88e48251-68f1-4f75-91fe-785426240cbe tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af4775c28774015bc168bbcfc9b784d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b47199573142cfabb119e111b69c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:03.407472 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-88e48251-68f1-4f75-91fe-785426240cbe tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] 10.222.0.39 "GET /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b" status: 200 len: 1325 microversion: 2.1 time: 1.665150 Aug 07 01:17:03.408689 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 684/1564] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:01 2022] GET /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b => generated 1325 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:03.441882 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6230ccf9-35af-43ef-949e-aed172c7a677 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:03.442537 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6230ccf9-35af-43ef-949e-aed172c7a677 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:03.452371 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6230ccf9-35af-43ef-949e-aed172c7a677 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:03.452934 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6230ccf9-35af-43ef-949e-aed172c7a677 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:03.453667 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6230ccf9-35af-43ef-949e-aed172c7a677 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:03.454939 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6230ccf9-35af-43ef-949e-aed172c7a677 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:03.455797 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6230ccf9-35af-43ef-949e-aed172c7a677 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:03.460621 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6230ccf9-35af-43ef-949e-aed172c7a677 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:03.482665 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fae8b90d-7338-4f23-9e44-4c6cfb59d7ad tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:03.497571 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fae8b90d-7338-4f23-9e44-4c6cfb59d7ad tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:03.500192 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fae8b90d-7338-4f23-9e44-4c6cfb59d7ad tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:03.502816 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fae8b90d-7338-4f23-9e44-4c6cfb59d7ad tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6" status: 200 len: 1320 microversion: 2.25 time: 0.410645 Aug 07 01:17:03.507268 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 881/1565] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:03 2022] GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6 => generated 1320 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:03.523984 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-42af48c8-48f8-4a07-a3de-4a3a94e4785b tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:03.536847 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:17:03.536847 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:17:03.595342 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-42af48c8-48f8-4a07-a3de-4a3a94e4785b tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/9952423c-5f43-4e44-af82-6c069bfe067a" status: 202 len: 0 microversion: 2.1 time: 0.086348 Aug 07 01:17:03.598776 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 882/1566] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:17:03 2022] DELETE /compute/v2.1/flavors/9952423c-5f43-4e44-af82-6c069bfe067a => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:17:03.615013 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6b1558cf-f831-4b63-ace7-f4670a596d08 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] Calling method '.version_select at 0x7f9e2408f940>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:03.645494 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6b1558cf-f831-4b63-ace7-f4670a596d08 tempest-ServersTestFqdnHostnames-1925255191 tempest-ServersTestFqdnHostnames-1925255191-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1841217378" status: 202 len: 0 microversion: 2.1 time: 0.044912 Aug 07 01:17:03.651982 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 883/1567] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Aug 7 01:17:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1841217378 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:17:03.658188 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-29f1ce0f-4cbb-4876-aee8-243721d81316 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:03.660125 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-29f1ce0f-4cbb-4876-aee8-243721d81316 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 8511418d-b773-43fd-adc1-bc8862f82015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:03.669023 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-29f1ce0f-4cbb-4876-aee8-243721d81316 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:03.670094 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-29f1ce0f-4cbb-4876-aee8-243721d81316 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:03.670764 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-29f1ce0f-4cbb-4876-aee8-243721d81316 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:03.672485 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-29f1ce0f-4cbb-4876-aee8-243721d81316 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:03.673276 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-29f1ce0f-4cbb-4876-aee8-243721d81316 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:03.673963 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-29f1ce0f-4cbb-4876-aee8-243721d81316 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:03.740481 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-29f1ce0f-4cbb-4876-aee8-243721d81316 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 8511418d-b773-43fd-adc1-bc8862f82015] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:17:03.895745 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-29f1ce0f-4cbb-4876-aee8-243721d81316 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8511418d-b773-43fd-adc1-bc8862f82015" status: 204 len: 0 microversion: 2.1 time: 0.241548 Aug 07 01:17:03.902922 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 884/1568] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:17:03 2022] DELETE /compute/v2.1/servers/8511418d-b773-43fd-adc1-bc8862f82015 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:17:03.927200 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2763f868-ead5-4143-aab6-ec2d9ed11032 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:03.929006 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2763f868-ead5-4143-aab6-ec2d9ed11032 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] [instance: 9e2ae24f-8349-46d5-b091-876927d02b68] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:03.940732 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2763f868-ead5-4143-aab6-ec2d9ed11032 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:03.941785 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2763f868-ead5-4143-aab6-ec2d9ed11032 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:03.942560 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2763f868-ead5-4143-aab6-ec2d9ed11032 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:03.943583 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2763f868-ead5-4143-aab6-ec2d9ed11032 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:03.944307 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2763f868-ead5-4143-aab6-ec2d9ed11032 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:03.944947 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2763f868-ead5-4143-aab6-ec2d9ed11032 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:03.945218 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6230ccf9-35af-43ef-949e-aed172c7a677 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:03.990687 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6230ccf9-35af-43ef-949e-aed172c7a677 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1199 microversion: 2.1 time: 0.556222 Aug 07 01:17:04.004975 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 685/1569] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:03 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1199 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:04.017414 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d98ce3a1-fac1-4257-b9ea-f0c412f97b08 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:04.058261 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d98ce3a1-fac1-4257-b9ea-f0c412f97b08 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051569 Aug 07 01:17:04.059460 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 686/1570] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:17:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:04.087715 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-407fc9f7-1332-46e7-b985-fa3b84d934e3 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:04.087715 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-407fc9f7-1332-46e7-b985-fa3b84d934e3 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 8511418d-b773-43fd-adc1-bc8862f82015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:04.101358 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-407fc9f7-1332-46e7-b985-fa3b84d934e3 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:04.101893 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-407fc9f7-1332-46e7-b985-fa3b84d934e3 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:04.102351 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-407fc9f7-1332-46e7-b985-fa3b84d934e3 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:04.104692 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-407fc9f7-1332-46e7-b985-fa3b84d934e3 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:04.105335 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-407fc9f7-1332-46e7-b985-fa3b84d934e3 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:04.105978 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-407fc9f7-1332-46e7-b985-fa3b84d934e3 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:04.511496 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2763f868-ead5-4143-aab6-ec2d9ed11032 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '786962988b754fb69bd48070c2992e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614797cd26be4995b087ab864f35d235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:04.523321 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2763f868-ead5-4143-aab6-ec2d9ed11032 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68" status: 200 len: 1316 microversion: 2.1 time: 0.615050 Aug 07 01:17:04.549626 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 885/1571] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:03 2022] GET /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68 => generated 1316 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:04.561509 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e864c76d-35f6-428b-b9e6-d72c5297639c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:04.564025 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e864c76d-35f6-428b-b9e6-d72c5297639c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:04.584376 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e864c76d-35f6-428b-b9e6-d72c5297639c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:04.584803 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e864c76d-35f6-428b-b9e6-d72c5297639c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:04.585255 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e864c76d-35f6-428b-b9e6-d72c5297639c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:04.585976 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e864c76d-35f6-428b-b9e6-d72c5297639c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:04.591731 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e864c76d-35f6-428b-b9e6-d72c5297639c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:04.592374 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e864c76d-35f6-428b-b9e6-d72c5297639c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:04.667347 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-407fc9f7-1332-46e7-b985-fa3b84d934e3 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:04.698440 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-407fc9f7-1332-46e7-b985-fa3b84d934e3 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/8511418d-b773-43fd-adc1-bc8862f82015" status: 200 len: 1471 microversion: 2.1 time: 0.623902 Aug 07 01:17:04.715998 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 687/1572] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:04 2022] GET /compute/v2.1/servers/8511418d-b773-43fd-adc1-bc8862f82015 => generated 1471 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:04.715998 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f5d4e215-b95e-4682-b3a3-e04e39da15fe tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:04.715998 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f5d4e215-b95e-4682-b3a3-e04e39da15fe tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] [instance: d96d68bb-2dab-43ee-872b-e9090e9a3b4b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:04.731175 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f5d4e215-b95e-4682-b3a3-e04e39da15fe tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:04.733713 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f5d4e215-b95e-4682-b3a3-e04e39da15fe tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:04.735641 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f5d4e215-b95e-4682-b3a3-e04e39da15fe tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:04.736616 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f5d4e215-b95e-4682-b3a3-e04e39da15fe tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:04.737333 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f5d4e215-b95e-4682-b3a3-e04e39da15fe tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:04.739288 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f5d4e215-b95e-4682-b3a3-e04e39da15fe tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:04.810990 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e864c76d-35f6-428b-b9e6-d72c5297639c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:04.820455 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e864c76d-35f6-428b-b9e6-d72c5297639c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Old instance type tempest-test_resize_flavor_-597373442, new instance type m1.heat {{(pid=119516) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 07 01:17:04.843695 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e864c76d-35f6-428b-b9e6-d72c5297639c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:17:04.848911 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e864c76d-35f6-428b-b9e6-d72c5297639c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:17:04.849760 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e864c76d-35f6-428b-b9e6-d72c5297639c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:17:04.850359 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e864c76d-35f6-428b-b9e6-d72c5297639c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:17:04.850870 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e864c76d-35f6-428b-b9e6-d72c5297639c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:17:05.022617 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e864c76d-35f6-428b-b9e6-d72c5297639c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "POST /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544/action" status: 202 len: 0 microversion: 2.1 time: 0.469215 Aug 07 01:17:05.024910 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 886/1573] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:17:04 2022] POST /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:17:05.038015 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1de1de49-2b20-480b-85ae-88fd138bf6f9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:05.039141 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1de1de49-2b20-480b-85ae-88fd138bf6f9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: ff193541-98b3-40f6-976c-8b1c721f0bc6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:05.058177 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1de1de49-2b20-480b-85ae-88fd138bf6f9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:05.061308 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1de1de49-2b20-480b-85ae-88fd138bf6f9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:05.063108 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1de1de49-2b20-480b-85ae-88fd138bf6f9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:05.066417 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1de1de49-2b20-480b-85ae-88fd138bf6f9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:05.067956 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1de1de49-2b20-480b-85ae-88fd138bf6f9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:05.069247 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1de1de49-2b20-480b-85ae-88fd138bf6f9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:05.152118 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f5d4e215-b95e-4682-b3a3-e04e39da15fe tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af4775c28774015bc168bbcfc9b784d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b47199573142cfabb119e111b69c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:05.167009 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f5d4e215-b95e-4682-b3a3-e04e39da15fe tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] 10.222.0.39 "GET /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b" status: 200 len: 1325 microversion: 2.1 time: 0.462564 Aug 07 01:17:05.181355 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 688/1574] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:04 2022] GET /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b => generated 1325 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:05.193213 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-8f245b9a-54df-4449-93f9-9546117c8c4e req-5e582819-9168-4b68-bcf9-38a5c36a7738 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d96d68bb-2dab-43ee-872b-e9090e9a3b4b", "tag": "0c7cc18d-914b-49c2-ae9b-d4eb7775f7e3"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:05.245418 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-8f245b9a-54df-4449-93f9-9546117c8c4e req-5e582819-9168-4b68-bcf9-38a5c36a7738 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:05.248972 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-8f245b9a-54df-4449-93f9-9546117c8c4e req-5e582819-9168-4b68-bcf9-38a5c36a7738 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:05.251637 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-8f245b9a-54df-4449-93f9-9546117c8c4e req-5e582819-9168-4b68-bcf9-38a5c36a7738 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:05.271257 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-8f245b9a-54df-4449-93f9-9546117c8c4e req-5e582819-9168-4b68-bcf9-38a5c36a7738 service nova] Creating event network-changed:0c7cc18d-914b-49c2-ae9b-d4eb7775f7e3 for instance d96d68bb-2dab-43ee-872b-e9090e9a3b4b on n-h2-master-1 Aug 07 01:17:05.277130 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-8f245b9a-54df-4449-93f9-9546117c8c4e req-5e582819-9168-4b68-bcf9-38a5c36a7738 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091837 Aug 07 01:17:05.278378 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 689/1575] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:17:05.285514 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-36057ee0-b93a-4797-9cdc-1d9aa9ecce52 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:05.286943 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-36057ee0-b93a-4797-9cdc-1d9aa9ecce52 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:05.305306 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36057ee0-b93a-4797-9cdc-1d9aa9ecce52 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:05.305808 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36057ee0-b93a-4797-9cdc-1d9aa9ecce52 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:05.306344 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36057ee0-b93a-4797-9cdc-1d9aa9ecce52 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:05.310418 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36057ee0-b93a-4797-9cdc-1d9aa9ecce52 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:05.311074 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36057ee0-b93a-4797-9cdc-1d9aa9ecce52 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:05.311582 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36057ee0-b93a-4797-9cdc-1d9aa9ecce52 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:05.398365 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1de1de49-2b20-480b-85ae-88fd138bf6f9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:05.410235 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1de1de49-2b20-480b-85ae-88fd138bf6f9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:05.411865 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1de1de49-2b20-480b-85ae-88fd138bf6f9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:05.413026 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1de1de49-2b20-480b-85ae-88fd138bf6f9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6" status: 200 len: 1320 microversion: 2.25 time: 0.385853 Aug 07 01:17:05.414105 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 887/1576] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:05 2022] GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6 => generated 1320 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:05.420278 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f2e28bcb-fe92-436e-8554-dee705f1ca77 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:05.421775 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f2e28bcb-fe92-436e-8554-dee705f1ca77 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:05.432265 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2e28bcb-fe92-436e-8554-dee705f1ca77 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:05.432770 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2e28bcb-fe92-436e-8554-dee705f1ca77 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:05.433215 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2e28bcb-fe92-436e-8554-dee705f1ca77 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:05.433994 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2e28bcb-fe92-436e-8554-dee705f1ca77 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:05.434462 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2e28bcb-fe92-436e-8554-dee705f1ca77 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:05.434941 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2e28bcb-fe92-436e-8554-dee705f1ca77 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:05.736873 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f2e28bcb-fe92-436e-8554-dee705f1ca77 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:05.749536 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f2e28bcb-fe92-436e-8554-dee705f1ca77 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1538 microversion: 2.1 time: 0.334250 Aug 07 01:17:05.763426 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 888/1577] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:05 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1538 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:05.859896 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-463c6140-c6cd-43bc-873a-a0b356268761 tempest-FloatingIPDetailsNegativeTestJSON-1385686947 tempest-FloatingIPDetailsNegativeTestJSON-1385686947-project] Calling method '.version_select at 0x7f9e2443caf0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:05.995790 n-d-master-1 devstack@n-api.service[119516]: DEBUG neutronclient.v2_0.client [None req-463c6140-c6cd-43bc-873a-a0b356268761 tempest-FloatingIPDetailsNegativeTestJSON-1385686947 tempest-FloatingIPDetailsNegativeTestJSON-1385686947-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 37b0a7de-2414-4fec-9099-4383f976c527 could not be found", "detail": ""}} {{(pid=119516) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 07 01:17:05.998106 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-463c6140-c6cd-43bc-873a-a0b356268761 tempest-FloatingIPDetailsNegativeTestJSON-1385686947 tempest-FloatingIPDetailsNegativeTestJSON-1385686947-project] HTTP exception thrown: Floating IP not found for ID 37b0a7de-2414-4fec-9099-4383f976c527 Aug 07 01:17:06.007156 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-463c6140-c6cd-43bc-873a-a0b356268761 tempest-FloatingIPDetailsNegativeTestJSON-1385686947 tempest-FloatingIPDetailsNegativeTestJSON-1385686947-project] Request method failure captured: Aug 07 01:17:06.007156 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/os-floating-ips/37b0a7de-2414-4fec-9099-4383f976c527 HTTP/1.1 Aug 07 01:17:06.007156 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:17:06.007156 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:17:06.007156 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:17:06.007156 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:17:06.007156 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:17:06.007156 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:17:06.007156 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:17:06.007156 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:17:06.007156 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xKR0rt3rHei0bAJixsnKhtHtEDXOyG_mN6eLLfTWkHsXQ8pcYxnAwtsKqNLchdHZPjkveL_ecYYOMeEMlqN9Yr1R7t_PiTJCauh2tTvOMKcn56t4VPI-HjdjwPQikv4RrUEUf6vUGNzbr1MAzhWjrM2sfr71RbWK8Q6aU-_FJo-o7A Aug 07 01:17:06.007156 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:17:06.007156 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:17:06.007156 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:17:06.007156 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:17:06.007156 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:17:06.007156 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:17:06.007156 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: a42ccb7403cb4ab399ff83253b1ca038 Aug 07 01:17:06.007156 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1385686947 Aug 07 01:17:06.007156 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:17:06.007156 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:17:06.009048 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a42ccb7403cb4ab399ff83253b1ca038"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a42ccb7403cb4ab399ff83253b1ca038", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a42ccb7403cb4ab399ff83253b1ca038"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a42ccb7403cb4ab399ff83253b1ca038"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:17:06.009048 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1385686947 Aug 07 01:17:06.009048 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: a42ccb7403cb4ab399ff83253b1ca038 Aug 07 01:17:06.009048 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1385686947 Aug 07 01:17:06.009048 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1385686947-project Aug 07 01:17:06.009048 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:17:06.009048 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:17:06.009048 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: af1e7cba69374a7187623daae828ddfa Aug 07 01:17:06.009048 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1385686947-project Aug 07 01:17:06.009048 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:17:06.009048 n-d-master-1 devstack@n-api.service[119516]: exception: Floating IP not found for ID 37b0a7de-2414-4fec-9099-4383f976c527 Aug 07 01:17:06.009048 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '37b0a7de-2414-4fec-9099-4383f976c527'} Aug 07 01:17:06.010082 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:17:06.010082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:06.010082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 07 01:17:06.010082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 07 01:17:06.010082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:17:06.010082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:17:06.010082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 07 01:17:06.010082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 07 01:17:06.010082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:17:06.010082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:17:06.010082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 07 01:17:06.010082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 07 01:17:06.010082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:17:06.010082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:17:06.010082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 07 01:17:06.010082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 07 01:17:06.010082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:17:06.010082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:17:06.010082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 07 01:17:06.011695 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 07 01:17:06.011695 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:17:06.011695 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:17:06.011695 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 07 01:17:06.011695 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 07 01:17:06.011695 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 07 01:17:06.011695 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 07 01:17:06.011695 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 37b0a7de-2414-4fec-9099-4383f976c527 could not be found Aug 07 01:17:06.011695 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a9031372-432e-43a3-9c1e-812c831cdf9b'] Aug 07 01:17:06.011695 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:17:06.011695 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:17:06.011695 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:17:06.011695 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:06.011695 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 07 01:17:06.011695 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 07 01:17:06.011695 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 07 01:17:06.011695 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 07 01:17:06.011695 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 37b0a7de-2414-4fec-9099-4383f976c527. Aug 07 01:17:06.011695 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:17:06.014229 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:17:06.014229 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:17:06.014229 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:06.014229 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:17:06.014229 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:17:06.014229 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:17:06.014229 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:17:06.014229 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:17:06.014229 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:17:06.014229 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:17:06.014229 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:17:06.014229 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 07 01:17:06.014229 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 07 01:17:06.014229 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 37b0a7de-2414-4fec-9099-4383f976c527 Aug 07 01:17:06.014229 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:17:06.014229 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:17:06.014229 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:17:06.014229 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:06.014229 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:17:06.014229 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:17:06.014229 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:17:06.016098 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:17:06.016098 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 37b0a7de-2414-4fec-9099-4383f976c527 Aug 07 01:17:06.016098 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:17:06.016098 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-463c6140-c6cd-43bc-873a-a0b356268761 tempest-FloatingIPDetailsNegativeTestJSON-1385686947 tempest-FloatingIPDetailsNegativeTestJSON-1385686947-project] Returning 404 to user: Floating IP not found for ID 37b0a7de-2414-4fec-9099-4383f976c527 {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:17:06.036439 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-463c6140-c6cd-43bc-873a-a0b356268761 tempest-FloatingIPDetailsNegativeTestJSON-1385686947 tempest-FloatingIPDetailsNegativeTestJSON-1385686947-project] 10.222.0.39 "GET /compute/v2.1/os-floating-ips/37b0a7de-2414-4fec-9099-4383f976c527" status: 404 len: 111 microversion: 2.1 time: 0.264267 Aug 07 01:17:06.037426 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 889/1578] 10.222.0.39 () {58 vars in 1260 bytes} [Sun Aug 7 01:17:05 2022] GET /compute/v2.1/os-floating-ips/37b0a7de-2414-4fec-9099-4383f976c527 => generated 111 bytes in 287 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:17:06.049657 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7ae0943e-586e-4828-9f6b-e048ab762164 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:06.052509 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7ae0943e-586e-4828-9f6b-e048ab762164 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] [instance: 9e2ae24f-8349-46d5-b091-876927d02b68] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:06.069542 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ae0943e-586e-4828-9f6b-e048ab762164 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:06.070302 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ae0943e-586e-4828-9f6b-e048ab762164 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:06.070953 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ae0943e-586e-4828-9f6b-e048ab762164 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:06.072195 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ae0943e-586e-4828-9f6b-e048ab762164 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:06.072890 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ae0943e-586e-4828-9f6b-e048ab762164 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:06.073526 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ae0943e-586e-4828-9f6b-e048ab762164 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:06.123454 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:06.364779 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-36057ee0-b93a-4797-9cdc-1d9aa9ecce52 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:06.380768 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-36057ee0-b93a-4797-9cdc-1d9aa9ecce52 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1199 microversion: 2.1 time: 1.100423 Aug 07 01:17:06.381692 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 690/1579] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:05 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1199 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:06.386754 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3db04ea5-8a97-44cd-be1f-1a6e5f1edc2d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:06.387389 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3db04ea5-8a97-44cd-be1f-1a6e5f1edc2d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 8511418d-b773-43fd-adc1-bc8862f82015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:06.408665 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3db04ea5-8a97-44cd-be1f-1a6e5f1edc2d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:06.409171 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3db04ea5-8a97-44cd-be1f-1a6e5f1edc2d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:06.410157 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3db04ea5-8a97-44cd-be1f-1a6e5f1edc2d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:06.410898 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3db04ea5-8a97-44cd-be1f-1a6e5f1edc2d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:06.411364 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3db04ea5-8a97-44cd-be1f-1a6e5f1edc2d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:06.411852 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3db04ea5-8a97-44cd-be1f-1a6e5f1edc2d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:06.568036 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7ae0943e-586e-4828-9f6b-e048ab762164 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '786962988b754fb69bd48070c2992e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614797cd26be4995b087ab864f35d235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:06.584611 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7ae0943e-586e-4828-9f6b-e048ab762164 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68" status: 200 len: 1316 microversion: 2.1 time: 0.542814 Aug 07 01:17:06.586666 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 890/1580] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:06 2022] GET /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68 => generated 1316 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:06.594354 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dbdc3c88-ea16-4f91-94dd-703fefbc6335 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:06.595218 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-dbdc3c88-ea16-4f91-94dd-703fefbc6335 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] [instance: d96d68bb-2dab-43ee-872b-e9090e9a3b4b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:06.604983 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dbdc3c88-ea16-4f91-94dd-703fefbc6335 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:06.605768 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dbdc3c88-ea16-4f91-94dd-703fefbc6335 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:06.607394 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dbdc3c88-ea16-4f91-94dd-703fefbc6335 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:06.609756 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dbdc3c88-ea16-4f91-94dd-703fefbc6335 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:06.610685 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dbdc3c88-ea16-4f91-94dd-703fefbc6335 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:06.611373 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dbdc3c88-ea16-4f91-94dd-703fefbc6335 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:06.856461 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3db04ea5-8a97-44cd-be1f-1a6e5f1edc2d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:06.877857 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3db04ea5-8a97-44cd-be1f-1a6e5f1edc2d tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/8511418d-b773-43fd-adc1-bc8862f82015" status: 200 len: 1471 microversion: 2.1 time: 0.494999 Aug 07 01:17:06.879590 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 691/1581] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:06 2022] GET /compute/v2.1/servers/8511418d-b773-43fd-adc1-bc8862f82015 => generated 1471 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:06.885050 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-00d837eb-912b-4bfc-bf2c-95c8075ea541 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:06.885880 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-00d837eb-912b-4bfc-bf2c-95c8075ea541 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: ff193541-98b3-40f6-976c-8b1c721f0bc6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:06.893204 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00d837eb-912b-4bfc-bf2c-95c8075ea541 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:06.894427 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00d837eb-912b-4bfc-bf2c-95c8075ea541 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:06.895047 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00d837eb-912b-4bfc-bf2c-95c8075ea541 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:06.895995 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00d837eb-912b-4bfc-bf2c-95c8075ea541 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:06.896639 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00d837eb-912b-4bfc-bf2c-95c8075ea541 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:06.897244 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00d837eb-912b-4bfc-bf2c-95c8075ea541 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:07.272611 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-dbdc3c88-ea16-4f91-94dd-703fefbc6335 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af4775c28774015bc168bbcfc9b784d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b47199573142cfabb119e111b69c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:07.286542 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-dbdc3c88-ea16-4f91-94dd-703fefbc6335 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] 10.222.0.39 "GET /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b" status: 200 len: 1325 microversion: 2.1 time: 0.697802 Aug 07 01:17:07.287851 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 891/1582] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:06 2022] GET /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b => generated 1325 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:07.293929 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bd690cff-7be7-431c-82bf-a2e4b6d188a3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:07.297914 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bd690cff-7be7-431c-82bf-a2e4b6d188a3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:07.302114 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-00d837eb-912b-4bfc-bf2c-95c8075ea541 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:07.319415 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-00d837eb-912b-4bfc-bf2c-95c8075ea541 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:07.326073 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd690cff-7be7-431c-82bf-a2e4b6d188a3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:07.327365 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd690cff-7be7-431c-82bf-a2e4b6d188a3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:07.328137 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-00d837eb-912b-4bfc-bf2c-95c8075ea541 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:07.328342 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd690cff-7be7-431c-82bf-a2e4b6d188a3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:07.329807 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-00d837eb-912b-4bfc-bf2c-95c8075ea541 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6" status: 200 len: 1362 microversion: 2.25 time: 0.448999 Aug 07 01:17:07.330736 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd690cff-7be7-431c-82bf-a2e4b6d188a3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:07.331326 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd690cff-7be7-431c-82bf-a2e4b6d188a3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:07.331863 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd690cff-7be7-431c-82bf-a2e4b6d188a3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:07.348486 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 692/1583] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:06 2022] GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6 => generated 1362 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:07.355324 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-d11af9fa-ba56-47cf-b5da-ae8723b47331 req-9d2f7d53-ac06-4262-98cf-cf50ca050ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e2ae24f-8349-46d5-b091-876927d02b68", "name": "network-vif-plugged", "status": "completed", "tag": "63f23b72-85ce-4ced-9d43-dd32e2464731"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:07.367142 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d11af9fa-ba56-47cf-b5da-ae8723b47331 req-9d2f7d53-ac06-4262-98cf-cf50ca050ef0 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:07.369352 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d11af9fa-ba56-47cf-b5da-ae8723b47331 req-9d2f7d53-ac06-4262-98cf-cf50ca050ef0 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:07.370055 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d11af9fa-ba56-47cf-b5da-ae8723b47331 req-9d2f7d53-ac06-4262-98cf-cf50ca050ef0 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:07.375729 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:07.389622 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-d11af9fa-ba56-47cf-b5da-ae8723b47331 req-9d2f7d53-ac06-4262-98cf-cf50ca050ef0 service nova] Creating event network-vif-plugged:63f23b72-85ce-4ced-9d43-dd32e2464731 for instance 9e2ae24f-8349-46d5-b091-876927d02b68 on n-h1-master-1 Aug 07 01:17:07.400208 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-d11af9fa-ba56-47cf-b5da-ae8723b47331 req-9d2f7d53-ac06-4262-98cf-cf50ca050ef0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048844 Aug 07 01:17:07.402212 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 693/1584] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:17:07.408786 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-1edd31cd-3832-4253-9af7-ce71149b12cc req-20e65b96-9246-440b-afa4-179565b999d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e006496-fa0b-4e7a-8c5d-a3724b172720", "tag": "dcf52ab3-da5a-473c-accb-60d75e843c85"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:07.421419 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-1edd31cd-3832-4253-9af7-ce71149b12cc req-20e65b96-9246-440b-afa4-179565b999d5 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:07.422418 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-1edd31cd-3832-4253-9af7-ce71149b12cc req-20e65b96-9246-440b-afa4-179565b999d5 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:07.423343 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-1edd31cd-3832-4253-9af7-ce71149b12cc req-20e65b96-9246-440b-afa4-179565b999d5 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:07.436731 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-1edd31cd-3832-4253-9af7-ce71149b12cc req-20e65b96-9246-440b-afa4-179565b999d5 service nova] Creating event network-changed:dcf52ab3-da5a-473c-accb-60d75e843c85 for instance 2e006496-fa0b-4e7a-8c5d-a3724b172720 on n-h2-master-1 Aug 07 01:17:07.442332 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-1edd31cd-3832-4253-9af7-ce71149b12cc req-20e65b96-9246-440b-afa4-179565b999d5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038368 Aug 07 01:17:07.443590 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 694/1585] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:17:07.454423 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-391c0a63-1b98-44d1-b201-c1706ecf840b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:07.455615 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-391c0a63-1b98-44d1-b201-c1706ecf840b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:07.463935 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-391c0a63-1b98-44d1-b201-c1706ecf840b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:07.464870 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-391c0a63-1b98-44d1-b201-c1706ecf840b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:07.465577 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-391c0a63-1b98-44d1-b201-c1706ecf840b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:07.466628 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-391c0a63-1b98-44d1-b201-c1706ecf840b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:07.467301 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-391c0a63-1b98-44d1-b201-c1706ecf840b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:07.468593 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-391c0a63-1b98-44d1-b201-c1706ecf840b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:07.665410 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:07.699179 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=30 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:08.030710 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bd690cff-7be7-431c-82bf-a2e4b6d188a3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:08.050207 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bd690cff-7be7-431c-82bf-a2e4b6d188a3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1538 microversion: 2.1 time: 0.759950 Aug 07 01:17:08.064417 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 892/1586] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:07 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1538 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:08.070325 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-21c640e1-2a2d-4c96-bbdc-559c59520b23 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:08.070960 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-21c640e1-2a2d-4c96-bbdc-559c59520b23 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] [instance: 9e2ae24f-8349-46d5-b091-876927d02b68] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:08.096087 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21c640e1-2a2d-4c96-bbdc-559c59520b23 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:08.096699 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21c640e1-2a2d-4c96-bbdc-559c59520b23 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:08.097705 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21c640e1-2a2d-4c96-bbdc-559c59520b23 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:08.098435 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21c640e1-2a2d-4c96-bbdc-559c59520b23 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:08.099097 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21c640e1-2a2d-4c96-bbdc-559c59520b23 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:08.099704 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21c640e1-2a2d-4c96-bbdc-559c59520b23 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:08.509081 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-391c0a63-1b98-44d1-b201-c1706ecf840b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:08.521902 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-391c0a63-1b98-44d1-b201-c1706ecf840b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1199 microversion: 2.1 time: 1.076241 Aug 07 01:17:08.523301 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 695/1587] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:07 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1199 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:08.529500 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6de510d3-e25e-49d5-a0bd-6231ee1a9653 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:08.530653 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6de510d3-e25e-49d5-a0bd-6231ee1a9653 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 8511418d-b773-43fd-adc1-bc8862f82015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:08.540210 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6de510d3-e25e-49d5-a0bd-6231ee1a9653 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:08.541272 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6de510d3-e25e-49d5-a0bd-6231ee1a9653 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:08.542393 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6de510d3-e25e-49d5-a0bd-6231ee1a9653 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:08.543782 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6de510d3-e25e-49d5-a0bd-6231ee1a9653 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:08.544478 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6de510d3-e25e-49d5-a0bd-6231ee1a9653 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:08.545105 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6de510d3-e25e-49d5-a0bd-6231ee1a9653 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:08.595803 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6de510d3-e25e-49d5-a0bd-6231ee1a9653 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:08.596981 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6de510d3-e25e-49d5-a0bd-6231ee1a9653 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:08.598511 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6de510d3-e25e-49d5-a0bd-6231ee1a9653 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:08.599407 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-6de510d3-e25e-49d5-a0bd-6231ee1a9653 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lazy-loading 'fault' on Instance uuid 8511418d-b773-43fd-adc1-bc8862f82015 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:17:08.660236 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-21c640e1-2a2d-4c96-bbdc-559c59520b23 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '786962988b754fb69bd48070c2992e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614797cd26be4995b087ab864f35d235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:08.669405 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-21c640e1-2a2d-4c96-bbdc-559c59520b23 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68" status: 200 len: 1316 microversion: 2.1 time: 0.603722 Aug 07 01:17:08.676086 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 893/1588] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:08 2022] GET /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68 => generated 1316 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:08.685649 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-638261ef-8989-4fc2-aa36-42d683cec6d2 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:08.686694 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-638261ef-8989-4fc2-aa36-42d683cec6d2 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] [instance: d96d68bb-2dab-43ee-872b-e9090e9a3b4b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:08.702794 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-638261ef-8989-4fc2-aa36-42d683cec6d2 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:08.703293 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-638261ef-8989-4fc2-aa36-42d683cec6d2 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:08.704296 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-638261ef-8989-4fc2-aa36-42d683cec6d2 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:08.713269 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-638261ef-8989-4fc2-aa36-42d683cec6d2 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:08.714100 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-638261ef-8989-4fc2-aa36-42d683cec6d2 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:08.714825 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-638261ef-8989-4fc2-aa36-42d683cec6d2 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:08.957795 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6de510d3-e25e-49d5-a0bd-6231ee1a9653 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fc1959d8aa41eabcead217b9d7bc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08d010c14a64f759887be0d2364c6e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:08.970173 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6de510d3-e25e-49d5-a0bd-6231ee1a9653 tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/8511418d-b773-43fd-adc1-bc8862f82015" status: 200 len: 1306 microversion: 2.1 time: 0.445534 Aug 07 01:17:08.971085 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 696/1589] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:08 2022] GET /compute/v2.1/servers/8511418d-b773-43fd-adc1-bc8862f82015 => generated 1306 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:09.000376 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b6012f76-7e0d-46d2-a67c-3d2df30ddd9e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:09.001815 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b6012f76-7e0d-46d2-a67c-3d2df30ddd9e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: ff193541-98b3-40f6-976c-8b1c721f0bc6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:09.015064 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b6012f76-7e0d-46d2-a67c-3d2df30ddd9e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:09.015567 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b6012f76-7e0d-46d2-a67c-3d2df30ddd9e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:09.016287 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b6012f76-7e0d-46d2-a67c-3d2df30ddd9e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:09.016792 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b6012f76-7e0d-46d2-a67c-3d2df30ddd9e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:09.017421 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b6012f76-7e0d-46d2-a67c-3d2df30ddd9e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:09.017869 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b6012f76-7e0d-46d2-a67c-3d2df30ddd9e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:09.439482 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-638261ef-8989-4fc2-aa36-42d683cec6d2 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af4775c28774015bc168bbcfc9b784d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b47199573142cfabb119e111b69c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:09.458643 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-638261ef-8989-4fc2-aa36-42d683cec6d2 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] 10.222.0.39 "GET /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b" status: 200 len: 1325 microversion: 2.1 time: 0.780865 Aug 07 01:17:09.461843 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 894/1590] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:08 2022] GET /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b => generated 1325 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:09.478422 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0c9547e2-556f-40de-aae3-e08c675a9ebb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:09.479394 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0c9547e2-556f-40de-aae3-e08c675a9ebb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:09.485122 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:DELETE=7,nova_api:UPDATE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:09.494161 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c9547e2-556f-40de-aae3-e08c675a9ebb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:09.494991 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c9547e2-556f-40de-aae3-e08c675a9ebb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:09.495654 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c9547e2-556f-40de-aae3-e08c675a9ebb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:09.497403 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c9547e2-556f-40de-aae3-e08c675a9ebb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:09.498269 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c9547e2-556f-40de-aae3-e08c675a9ebb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:09.499458 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c9547e2-556f-40de-aae3-e08c675a9ebb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:09.525916 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b6012f76-7e0d-46d2-a67c-3d2df30ddd9e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:09.541851 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b6012f76-7e0d-46d2-a67c-3d2df30ddd9e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:09.545948 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b6012f76-7e0d-46d2-a67c-3d2df30ddd9e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:09.547170 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b6012f76-7e0d-46d2-a67c-3d2df30ddd9e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6" status: 200 len: 1362 microversion: 2.25 time: 0.574913 Aug 07 01:17:09.547746 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 697/1591] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:08 2022] GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6 => generated 1362 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:09.565099 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-c87e41eb-c9d6-4dd7-abea-a72edd922df7 req-b1e40156-5294-43c2-a7a2-a0d1ff4a64f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8511418d-b773-43fd-adc1-bc8862f82015", "name": "network-vif-deleted", "tag": "371f66e7-8f41-4b10-8ddc-d37b54c9607d"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:09.586635 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c87e41eb-c9d6-4dd7-abea-a72edd922df7 req-b1e40156-5294-43c2-a7a2-a0d1ff4a64f8 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:09.587563 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c87e41eb-c9d6-4dd7-abea-a72edd922df7 req-b1e40156-5294-43c2-a7a2-a0d1ff4a64f8 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:09.588204 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c87e41eb-c9d6-4dd7-abea-a72edd922df7 req-b1e40156-5294-43c2-a7a2-a0d1ff4a64f8 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:09.605397 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-c87e41eb-c9d6-4dd7-abea-a72edd922df7 req-b1e40156-5294-43c2-a7a2-a0d1ff4a64f8 service nova] Creating event network-vif-deleted:371f66e7-8f41-4b10-8ddc-d37b54c9607d for instance 8511418d-b773-43fd-adc1-bc8862f82015 on n-h2-master-1 Aug 07 01:17:09.613629 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-c87e41eb-c9d6-4dd7-abea-a72edd922df7 req-b1e40156-5294-43c2-a7a2-a0d1ff4a64f8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059026 Aug 07 01:17:09.614451 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 698/1592] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:17:09.621533 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-66eaae68-9fab-4a56-93f0-39e6d415749e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:09.622872 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-66eaae68-9fab-4a56-93f0-39e6d415749e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:09.633003 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-66eaae68-9fab-4a56-93f0-39e6d415749e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:09.634380 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-66eaae68-9fab-4a56-93f0-39e6d415749e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:09.635158 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-66eaae68-9fab-4a56-93f0-39e6d415749e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:09.637149 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-66eaae68-9fab-4a56-93f0-39e6d415749e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:09.637995 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-66eaae68-9fab-4a56-93f0-39e6d415749e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:09.638707 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-66eaae68-9fab-4a56-93f0-39e6d415749e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:09.911090 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0c9547e2-556f-40de-aae3-e08c675a9ebb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:09.926772 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0c9547e2-556f-40de-aae3-e08c675a9ebb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1538 microversion: 2.1 time: 0.463192 Aug 07 01:17:09.928109 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 895/1593] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:09 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1538 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:09.934909 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4a9d39df-9fdb-4fef-b584-74b824bf7956 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:09.936225 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4a9d39df-9fdb-4fef-b584-74b824bf7956 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] [instance: 9e2ae24f-8349-46d5-b091-876927d02b68] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:09.951495 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a9d39df-9fdb-4fef-b584-74b824bf7956 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:09.952518 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a9d39df-9fdb-4fef-b584-74b824bf7956 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:09.953813 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a9d39df-9fdb-4fef-b584-74b824bf7956 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:09.958868 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a9d39df-9fdb-4fef-b584-74b824bf7956 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:09.959903 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a9d39df-9fdb-4fef-b584-74b824bf7956 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:09.960941 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a9d39df-9fdb-4fef-b584-74b824bf7956 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:10.158281 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-66eaae68-9fab-4a56-93f0-39e6d415749e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:10.171391 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-66eaae68-9fab-4a56-93f0-39e6d415749e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1199 microversion: 2.1 time: 0.555397 Aug 07 01:17:10.172016 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 699/1594] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:09 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1199 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:10.177363 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d11209e9-1413-4a1c-9fcf-fc3fedeb56cd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:10.177994 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d11209e9-1413-4a1c-9fcf-fc3fedeb56cd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] [instance: 8511418d-b773-43fd-adc1-bc8862f82015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:10.197678 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d11209e9-1413-4a1c-9fcf-fc3fedeb56cd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:10.198697 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d11209e9-1413-4a1c-9fcf-fc3fedeb56cd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:10.199432 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d11209e9-1413-4a1c-9fcf-fc3fedeb56cd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:10.200492 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d11209e9-1413-4a1c-9fcf-fc3fedeb56cd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:10.201632 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d11209e9-1413-4a1c-9fcf-fc3fedeb56cd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:10.202295 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d11209e9-1413-4a1c-9fcf-fc3fedeb56cd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:10.224274 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-d11209e9-1413-4a1c-9fcf-fc3fedeb56cd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] HTTP exception thrown: Instance 8511418d-b773-43fd-adc1-bc8862f82015 could not be found. Aug 07 01:17:10.228088 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d11209e9-1413-4a1c-9fcf-fc3fedeb56cd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Request method failure captured: Aug 07 01:17:10.228088 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/8511418d-b773-43fd-adc1-bc8862f82015 HTTP/1.1 Aug 07 01:17:10.228088 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:17:10.228088 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:17:10.228088 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:17:10.228088 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:17:10.228088 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:17:10.228088 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:17:10.228088 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:17:10.228088 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:17:10.228088 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xGgZk2s0TuGzjJ8Xb6l7TnV8b2-7iInqh8WC73CRWxSE0_rne48-_XKuRGb9kyv1AQzpFFJZcYYqYPMbhYC4_BIHJInCNDeosVwZHelUBKtqqVJND2DtGLIn9MgrQRQOOb_QIwQOiIjRrXCbSodF39r4CP0D2xvEnYTXsUUzANa4KA Aug 07 01:17:10.228088 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:17:10.228088 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:17:10.228088 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:17:10.228088 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:17:10.228088 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:17:10.228088 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:17:10.228088 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: d08d010c14a64f759887be0d2364c6e4 Aug 07 01:17:10.228088 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersOnMultiNodesTest-1089196105 Aug 07 01:17:10.228088 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:17:10.228088 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:17:10.229705 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d08d010c14a64f759887be0d2364c6e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d08d010c14a64f759887be0d2364c6e4", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d08d010c14a64f759887be0d2364c6e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d08d010c14a64f759887be0d2364c6e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:17:10.229705 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersOnMultiNodesTest-1089196105 Aug 07 01:17:10.229705 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: d08d010c14a64f759887be0d2364c6e4 Aug 07 01:17:10.229705 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1089196105 Aug 07 01:17:10.229705 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersOnMultiNodesTest-1089196105-project Aug 07 01:17:10.229705 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:17:10.229705 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:17:10.229705 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 32fc1959d8aa41eabcead217b9d7bc47 Aug 07 01:17:10.229705 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersOnMultiNodesTest-1089196105-project Aug 07 01:17:10.229705 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:17:10.229705 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 8511418d-b773-43fd-adc1-bc8862f82015 could not be found. Aug 07 01:17:10.229705 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '8511418d-b773-43fd-adc1-bc8862f82015'} Aug 07 01:17:10.230549 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:17:10.230549 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:10.230549 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:17:10.230549 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:17:10.230549 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:17:10.230549 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:17:10.230549 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:17:10.230549 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:17:10.230549 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:17:10.230549 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:17:10.230549 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8511418d-b773-43fd-adc1-bc8862f82015 could not be found. Aug 07 01:17:10.230549 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:17:10.230549 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:17:10.230549 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:17:10.230549 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:10.230549 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:17:10.230549 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:17:10.230549 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:17:10.230549 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:17:10.230549 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:17:10.233404 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:17:10.233404 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:17:10.233404 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:17:10.233404 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:17:10.233404 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:17:10.233404 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:17:10.233404 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:17:10.233404 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8511418d-b773-43fd-adc1-bc8862f82015 could not be found. Aug 07 01:17:10.233404 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:17:10.233404 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:17:10.233404 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:17:10.233404 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:10.233404 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:17:10.233404 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:17:10.233404 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:17:10.233404 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:17:10.233404 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8511418d-b773-43fd-adc1-bc8862f82015 could not be found. Aug 07 01:17:10.233404 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:17:10.239589 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d11209e9-1413-4a1c-9fcf-fc3fedeb56cd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] Returning 404 to user: Instance 8511418d-b773-43fd-adc1-bc8862f82015 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:17:10.242462 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d11209e9-1413-4a1c-9fcf-fc3fedeb56cd tempest-ServersOnMultiNodesTest-1089196105 tempest-ServersOnMultiNodesTest-1089196105-project] 10.222.0.39 "GET /compute/v2.1/servers/8511418d-b773-43fd-adc1-bc8862f82015" status: 404 len: 111 microversion: 2.1 time: 0.068325 Aug 07 01:17:10.243381 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 700/1595] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:10 2022] GET /compute/v2.1/servers/8511418d-b773-43fd-adc1-bc8862f82015 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:17:10.486780 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c2cceecd-39cc-4f0f-a71a-2d150884acfa tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:10.487579 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c2cceecd-39cc-4f0f-a71a-2d150884acfa tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] [instance: d96d68bb-2dab-43ee-872b-e9090e9a3b4b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:10.490967 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4a9d39df-9fdb-4fef-b584-74b824bf7956 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '786962988b754fb69bd48070c2992e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614797cd26be4995b087ab864f35d235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:10.519286 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4a9d39df-9fdb-4fef-b584-74b824bf7956 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68" status: 200 len: 1465 microversion: 2.1 time: 0.581238 Aug 07 01:17:10.519286 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 896/1596] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:09 2022] GET /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68 => generated 1465 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:10.534363 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2cceecd-39cc-4f0f-a71a-2d150884acfa tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:10.535193 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2cceecd-39cc-4f0f-a71a-2d150884acfa tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:10.535515 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2cceecd-39cc-4f0f-a71a-2d150884acfa tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:10.536422 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2cceecd-39cc-4f0f-a71a-2d150884acfa tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:10.536868 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0b64f87e-07c5-453b-9765-fcbf47002917 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:10.537011 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2cceecd-39cc-4f0f-a71a-2d150884acfa tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:10.537465 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2cceecd-39cc-4f0f-a71a-2d150884acfa tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:10.537613 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0b64f87e-07c5-453b-9765-fcbf47002917 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] [instance: d2dbfd1a-efab-4943-b00a-6cdd1051489c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:10.552065 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b64f87e-07c5-453b-9765-fcbf47002917 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:10.552382 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b64f87e-07c5-453b-9765-fcbf47002917 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:10.552578 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b64f87e-07c5-453b-9765-fcbf47002917 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:10.554476 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b64f87e-07c5-453b-9765-fcbf47002917 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:10.554951 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b64f87e-07c5-453b-9765-fcbf47002917 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:10.555391 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b64f87e-07c5-453b-9765-fcbf47002917 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:11.043952 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0b64f87e-07c5-453b-9765-fcbf47002917 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '786962988b754fb69bd48070c2992e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614797cd26be4995b087ab864f35d235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:11.060691 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0b64f87e-07c5-453b-9765-fcbf47002917 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/servers/d2dbfd1a-efab-4943-b00a-6cdd1051489c" status: 200 len: 1466 microversion: 2.1 time: 0.527257 Aug 07 01:17:11.082120 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 897/1597] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:10 2022] GET /compute/v2.1/servers/d2dbfd1a-efab-4943-b00a-6cdd1051489c => generated 1466 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:11.097086 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6f762ba6-e4ed-4848-9835-763febbe1d9d tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:11.098047 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6f762ba6-e4ed-4848-9835-763febbe1d9d tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: ff193541-98b3-40f6-976c-8b1c721f0bc6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:11.126865 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f762ba6-e4ed-4848-9835-763febbe1d9d tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:11.128148 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f762ba6-e4ed-4848-9835-763febbe1d9d tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:11.129680 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f762ba6-e4ed-4848-9835-763febbe1d9d tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:11.130844 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f762ba6-e4ed-4848-9835-763febbe1d9d tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:11.132092 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f762ba6-e4ed-4848-9835-763febbe1d9d tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:11.132955 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f762ba6-e4ed-4848-9835-763febbe1d9d tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:11.220095 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c2cceecd-39cc-4f0f-a71a-2d150884acfa tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af4775c28774015bc168bbcfc9b784d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b47199573142cfabb119e111b69c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:11.230711 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c2cceecd-39cc-4f0f-a71a-2d150884acfa tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] 10.222.0.39 "GET /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b" status: 200 len: 1325 microversion: 2.1 time: 0.752962 Aug 07 01:17:11.232300 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 701/1598] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:10 2022] GET /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b => generated 1325 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:11.238476 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ca615126-5299-4e08-b061-ba2ffb80c456 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:11.240722 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ca615126-5299-4e08-b061-ba2ffb80c456 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:11.250367 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca615126-5299-4e08-b061-ba2ffb80c456 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:11.251084 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca615126-5299-4e08-b061-ba2ffb80c456 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:11.251693 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca615126-5299-4e08-b061-ba2ffb80c456 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:11.252623 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca615126-5299-4e08-b061-ba2ffb80c456 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:11.253279 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca615126-5299-4e08-b061-ba2ffb80c456 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:11.254772 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca615126-5299-4e08-b061-ba2ffb80c456 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:11.522814 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ca615126-5299-4e08-b061-ba2ffb80c456 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:11.539977 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ca615126-5299-4e08-b061-ba2ffb80c456 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1538 microversion: 2.1 time: 0.305897 Aug 07 01:17:11.542089 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 702/1599] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:11 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1538 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:11.549593 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1331a1d5-dc68-400d-ad55-c87ddf6c2885 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1496524298"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:11.553448 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1331a1d5-dc68-400d-ad55-c87ddf6c2885 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] [instance: d2dbfd1a-efab-4943-b00a-6cdd1051489c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:11.562188 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1331a1d5-dc68-400d-ad55-c87ddf6c2885 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:11.563187 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1331a1d5-dc68-400d-ad55-c87ddf6c2885 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:11.563917 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1331a1d5-dc68-400d-ad55-c87ddf6c2885 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:11.564993 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1331a1d5-dc68-400d-ad55-c87ddf6c2885 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:11.565680 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1331a1d5-dc68-400d-ad55-c87ddf6c2885 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:11.567368 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1331a1d5-dc68-400d-ad55-c87ddf6c2885 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:11.575035 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6f762ba6-e4ed-4848-9835-763febbe1d9d tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:11.601969 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6f762ba6-e4ed-4848-9835-763febbe1d9d tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:11.605463 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6f762ba6-e4ed-4848-9835-763febbe1d9d tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:11.607802 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6f762ba6-e4ed-4848-9835-763febbe1d9d tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6" status: 200 len: 1362 microversion: 2.25 time: 0.523379 Aug 07 01:17:11.634564 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 898/1600] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:11 2022] GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6 => generated 1362 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:11.639811 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e8208a1b-6216-4ba9-8172-04920a22e68c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:11.647020 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e8208a1b-6216-4ba9-8172-04920a22e68c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:11.662664 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e8208a1b-6216-4ba9-8172-04920a22e68c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:11.665977 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e8208a1b-6216-4ba9-8172-04920a22e68c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:11.667025 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e8208a1b-6216-4ba9-8172-04920a22e68c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:11.670246 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e8208a1b-6216-4ba9-8172-04920a22e68c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:11.671047 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e8208a1b-6216-4ba9-8172-04920a22e68c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:11.673026 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e8208a1b-6216-4ba9-8172-04920a22e68c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:11.984505 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1331a1d5-dc68-400d-ad55-c87ddf6c2885 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "POST /compute/v2.1/servers/d2dbfd1a-efab-4943-b00a-6cdd1051489c/action" status: 202 len: 0 microversion: 2.1 time: 0.438074 Aug 07 01:17:11.994615 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 703/1601] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:17:11 2022] POST /compute/v2.1/servers/d2dbfd1a-efab-4943-b00a-6cdd1051489c/action => generated 0 bytes in 446 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 07 01:17:12.009747 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-d59abb98-1612-4f7d-8800-7848f7f3761c req-5c1bea69-7e5e-41ac-bd78-c256bb6f914b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff193541-98b3-40f6-976c-8b1c721f0bc6", "tag": "0f90fd6b-35f9-4ef7-a7f1-72ecb34de724"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:12.078170 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d59abb98-1612-4f7d-8800-7848f7f3761c req-5c1bea69-7e5e-41ac-bd78-c256bb6f914b service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:12.080091 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e8208a1b-6216-4ba9-8172-04920a22e68c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:12.081005 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d59abb98-1612-4f7d-8800-7848f7f3761c req-5c1bea69-7e5e-41ac-bd78-c256bb6f914b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:12.082186 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d59abb98-1612-4f7d-8800-7848f7f3761c req-5c1bea69-7e5e-41ac-bd78-c256bb6f914b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:12.091009 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e8208a1b-6216-4ba9-8172-04920a22e68c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1199 microversion: 2.1 time: 0.454914 Aug 07 01:17:12.093752 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 899/1602] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:11 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1199 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:12.108603 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4d358ecc-712c-4dd7-9ed3-80410bf82860 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e29988040>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:12.134379 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-d59abb98-1612-4f7d-8800-7848f7f3761c req-5c1bea69-7e5e-41ac-bd78-c256bb6f914b service nova] Creating event network-changed:0f90fd6b-35f9-4ef7-a7f1-72ecb34de724 for instance ff193541-98b3-40f6-976c-8b1c721f0bc6 on n-h1-master-1 Aug 07 01:17:12.150455 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-d59abb98-1612-4f7d-8800-7848f7f3761c req-5c1bea69-7e5e-41ac-bd78-c256bb6f914b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158879 Aug 07 01:17:12.153245 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 704/1603] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:17:12.231305 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4d358ecc-712c-4dd7-9ed3-80410bf82860 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/e2ac911f-15de-4f5b-9d36-e03b3325331a" status: 200 len: 1455 microversion: 2.1 time: 0.131014 Aug 07 01:17:12.232001 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 900/1604] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:12 2022] GET /compute/v2.1/images/e2ac911f-15de-4f5b-9d36-e03b3325331a => generated 1455 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:12.263398 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b335eeb2-d7a2-4185-8d46-015dd490ced9 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:12.267085 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b335eeb2-d7a2-4185-8d46-015dd490ced9 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] [instance: d96d68bb-2dab-43ee-872b-e9090e9a3b4b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:12.272274 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-777fb5af-c3ab-48e7-be4f-f0b9091a0dc6 req-16fe71dd-6388-4cd5-b59f-c9e78fb5a4b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d96d68bb-2dab-43ee-872b-e9090e9a3b4b", "name": "network-vif-plugged", "status": "completed", "tag": "0c7cc18d-914b-49c2-ae9b-d4eb7775f7e3"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:12.290271 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b335eeb2-d7a2-4185-8d46-015dd490ced9 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:12.291281 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b335eeb2-d7a2-4185-8d46-015dd490ced9 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:12.291970 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b335eeb2-d7a2-4185-8d46-015dd490ced9 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:12.297147 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b335eeb2-d7a2-4185-8d46-015dd490ced9 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:12.300487 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b335eeb2-d7a2-4185-8d46-015dd490ced9 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:12.302506 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b335eeb2-d7a2-4185-8d46-015dd490ced9 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:12.311516 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-777fb5af-c3ab-48e7-be4f-f0b9091a0dc6 req-16fe71dd-6388-4cd5-b59f-c9e78fb5a4b5 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:12.313839 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-777fb5af-c3ab-48e7-be4f-f0b9091a0dc6 req-16fe71dd-6388-4cd5-b59f-c9e78fb5a4b5 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:12.317818 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-777fb5af-c3ab-48e7-be4f-f0b9091a0dc6 req-16fe71dd-6388-4cd5-b59f-c9e78fb5a4b5 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:12.359215 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-777fb5af-c3ab-48e7-be4f-f0b9091a0dc6 req-16fe71dd-6388-4cd5-b59f-c9e78fb5a4b5 service nova] Creating event network-vif-plugged:0c7cc18d-914b-49c2-ae9b-d4eb7775f7e3 for instance d96d68bb-2dab-43ee-872b-e9090e9a3b4b on n-h2-master-1 Aug 07 01:17:12.373264 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-777fb5af-c3ab-48e7-be4f-f0b9091a0dc6 req-16fe71dd-6388-4cd5-b59f-c9e78fb5a4b5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115930 Aug 07 01:17:12.376970 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 901/1605] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:17:12.565113 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c04938d2-e019-44e5-ade0-7239a26236a3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:12.566385 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c04938d2-e019-44e5-ade0-7239a26236a3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:12.576770 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c04938d2-e019-44e5-ade0-7239a26236a3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:12.577559 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c04938d2-e019-44e5-ade0-7239a26236a3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:12.578315 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c04938d2-e019-44e5-ade0-7239a26236a3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:12.580274 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c04938d2-e019-44e5-ade0-7239a26236a3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:12.580887 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c04938d2-e019-44e5-ade0-7239a26236a3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:12.581646 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c04938d2-e019-44e5-ade0-7239a26236a3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:13.260995 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b335eeb2-d7a2-4185-8d46-015dd490ced9 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af4775c28774015bc168bbcfc9b784d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b47199573142cfabb119e111b69c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:13.277373 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b335eeb2-d7a2-4185-8d46-015dd490ced9 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] 10.222.0.39 "GET /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b" status: 200 len: 1325 microversion: 2.1 time: 1.024321 Aug 07 01:17:13.278437 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 705/1606] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:12 2022] GET /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b => generated 1325 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:13.284297 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0dc0a7f7-2209-4e75-832f-8f816894cf9c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:13.285538 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0dc0a7f7-2209-4e75-832f-8f816894cf9c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: ff193541-98b3-40f6-976c-8b1c721f0bc6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:13.296751 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0dc0a7f7-2209-4e75-832f-8f816894cf9c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:13.297854 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0dc0a7f7-2209-4e75-832f-8f816894cf9c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:13.298669 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0dc0a7f7-2209-4e75-832f-8f816894cf9c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:13.300086 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0dc0a7f7-2209-4e75-832f-8f816894cf9c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:13.300849 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0dc0a7f7-2209-4e75-832f-8f816894cf9c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:13.301704 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0dc0a7f7-2209-4e75-832f-8f816894cf9c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:13.509105 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c04938d2-e019-44e5-ade0-7239a26236a3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:13.520978 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c04938d2-e019-44e5-ade0-7239a26236a3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1543 microversion: 2.1 time: 0.961976 Aug 07 01:17:13.537194 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 902/1607] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:12 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1543 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:13.542254 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8342a3ee-6ef9-4d0b-8c97-9a6fee9e461b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:13.543160 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8342a3ee-6ef9-4d0b-8c97-9a6fee9e461b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:13.557387 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8342a3ee-6ef9-4d0b-8c97-9a6fee9e461b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:13.558364 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8342a3ee-6ef9-4d0b-8c97-9a6fee9e461b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:13.559097 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8342a3ee-6ef9-4d0b-8c97-9a6fee9e461b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:13.560122 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8342a3ee-6ef9-4d0b-8c97-9a6fee9e461b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:13.560827 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8342a3ee-6ef9-4d0b-8c97-9a6fee9e461b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:13.561434 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8342a3ee-6ef9-4d0b-8c97-9a6fee9e461b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:13.877821 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8342a3ee-6ef9-4d0b-8c97-9a6fee9e461b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:13.888246 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8342a3ee-6ef9-4d0b-8c97-9a6fee9e461b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1199 microversion: 2.1 time: 0.349750 Aug 07 01:17:13.900297 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 903/1608] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:13 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1199 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:13.918867 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-db24f1cd-f6ec-43ea-b8fa-622fb720c949 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e29966550>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:13.934808 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0dc0a7f7-2209-4e75-832f-8f816894cf9c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:13.998822 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0dc0a7f7-2209-4e75-832f-8f816894cf9c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:14.000903 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0dc0a7f7-2209-4e75-832f-8f816894cf9c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:14.002329 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0dc0a7f7-2209-4e75-832f-8f816894cf9c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6" status: 200 len: 1362 microversion: 2.25 time: 0.722299 Aug 07 01:17:14.003436 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 706/1609] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:13 2022] GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6 => generated 1362 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:14.046470 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-db24f1cd-f6ec-43ea-b8fa-622fb720c949 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/e2ac911f-15de-4f5b-9d36-e03b3325331a" status: 200 len: 1455 microversion: 2.1 time: 0.130656 Aug 07 01:17:14.047852 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 904/1610] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:13 2022] GET /compute/v2.1/images/e2ac911f-15de-4f5b-9d36-e03b3325331a => generated 1455 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:14.320817 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fb61658b-5069-4173-9090-21f3d08b69ce tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:14.322127 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fb61658b-5069-4173-9090-21f3d08b69ce tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] [instance: d96d68bb-2dab-43ee-872b-e9090e9a3b4b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:14.341753 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb61658b-5069-4173-9090-21f3d08b69ce tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:14.342546 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb61658b-5069-4173-9090-21f3d08b69ce tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:14.343120 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb61658b-5069-4173-9090-21f3d08b69ce tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:14.343915 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb61658b-5069-4173-9090-21f3d08b69ce tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:14.344392 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb61658b-5069-4173-9090-21f3d08b69ce tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:14.344832 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb61658b-5069-4173-9090-21f3d08b69ce tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:14.547022 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c1faf27c-4480-4290-bda0-e25796fb6a07 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:14.548801 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c1faf27c-4480-4290-bda0-e25796fb6a07 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:14.562639 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1faf27c-4480-4290-bda0-e25796fb6a07 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:14.567292 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1faf27c-4480-4290-bda0-e25796fb6a07 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:14.569302 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1faf27c-4480-4290-bda0-e25796fb6a07 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:14.571212 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1faf27c-4480-4290-bda0-e25796fb6a07 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:14.572913 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1faf27c-4480-4290-bda0-e25796fb6a07 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:14.575023 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1faf27c-4480-4290-bda0-e25796fb6a07 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:15.047223 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fb61658b-5069-4173-9090-21f3d08b69ce tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af4775c28774015bc168bbcfc9b784d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b47199573142cfabb119e111b69c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:15.060742 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fb61658b-5069-4173-9090-21f3d08b69ce tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] 10.222.0.39 "GET /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b" status: 200 len: 1325 microversion: 2.1 time: 0.744911 Aug 07 01:17:15.069801 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 707/1611] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:14 2022] GET /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b => generated 1325 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:15.107781 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6b7ab99d-1cee-41a1-85c6-c1f4b3b8a0b2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:15.109186 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6b7ab99d-1cee-41a1-85c6-c1f4b3b8a0b2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:15.122815 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6b7ab99d-1cee-41a1-85c6-c1f4b3b8a0b2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:15.125475 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6b7ab99d-1cee-41a1-85c6-c1f4b3b8a0b2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:15.126048 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6b7ab99d-1cee-41a1-85c6-c1f4b3b8a0b2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:15.130522 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6b7ab99d-1cee-41a1-85c6-c1f4b3b8a0b2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:15.131590 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6b7ab99d-1cee-41a1-85c6-c1f4b3b8a0b2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:15.134345 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6b7ab99d-1cee-41a1-85c6-c1f4b3b8a0b2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:15.337068 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c1faf27c-4480-4290-bda0-e25796fb6a07 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:15.397580 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c1faf27c-4480-4290-bda0-e25796fb6a07 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1543 microversion: 2.1 time: 0.855307 Aug 07 01:17:15.399237 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 905/1612] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:14 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1543 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:15.443299 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-310d5619-fd83-4d1c-ad25-cfb43c27181a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:15.448770 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-310d5619-fd83-4d1c-ad25-cfb43c27181a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: ff193541-98b3-40f6-976c-8b1c721f0bc6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:15.466540 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-310d5619-fd83-4d1c-ad25-cfb43c27181a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:15.467929 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-310d5619-fd83-4d1c-ad25-cfb43c27181a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:15.469228 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-310d5619-fd83-4d1c-ad25-cfb43c27181a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:15.471655 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-310d5619-fd83-4d1c-ad25-cfb43c27181a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:15.472919 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-310d5619-fd83-4d1c-ad25-cfb43c27181a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:15.474051 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-310d5619-fd83-4d1c-ad25-cfb43c27181a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:15.777571 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6b7ab99d-1cee-41a1-85c6-c1f4b3b8a0b2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:15.791522 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6b7ab99d-1cee-41a1-85c6-c1f4b3b8a0b2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1199 microversion: 2.1 time: 0.712065 Aug 07 01:17:15.795947 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 708/1613] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:15 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1199 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:15.816670 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8f8ed5d8-0188-41cc-a421-d04e41ce1459 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e24971ca0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:15.867952 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-310d5619-fd83-4d1c-ad25-cfb43c27181a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:15.899106 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-310d5619-fd83-4d1c-ad25-cfb43c27181a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:15.904670 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-310d5619-fd83-4d1c-ad25-cfb43c27181a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:15.906270 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-310d5619-fd83-4d1c-ad25-cfb43c27181a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6" status: 200 len: 1362 microversion: 2.25 time: 0.493915 Aug 07 01:17:15.907456 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 906/1614] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:15 2022] GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6 => generated 1362 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:15.954479 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8f8ed5d8-0188-41cc-a421-d04e41ce1459 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/e2ac911f-15de-4f5b-9d36-e03b3325331a" status: 200 len: 1455 microversion: 2.1 time: 0.158313 Aug 07 01:17:15.955132 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 709/1615] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:15 2022] GET /compute/v2.1/images/e2ac911f-15de-4f5b-9d36-e03b3325331a => generated 1455 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:16.087053 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-64217f12-11e8-448b-b7ed-253a4832d343 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:16.087856 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-64217f12-11e8-448b-b7ed-253a4832d343 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] [instance: d96d68bb-2dab-43ee-872b-e9090e9a3b4b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:16.099036 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64217f12-11e8-448b-b7ed-253a4832d343 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:16.099721 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64217f12-11e8-448b-b7ed-253a4832d343 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:16.100373 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64217f12-11e8-448b-b7ed-253a4832d343 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:16.102961 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64217f12-11e8-448b-b7ed-253a4832d343 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:16.103616 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64217f12-11e8-448b-b7ed-253a4832d343 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:16.104251 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64217f12-11e8-448b-b7ed-253a4832d343 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:16.435942 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-023c34cc-cd16-4eff-a751-24e53e475b9c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:16.436849 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-023c34cc-cd16-4eff-a751-24e53e475b9c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:16.466022 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-023c34cc-cd16-4eff-a751-24e53e475b9c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:16.466532 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-023c34cc-cd16-4eff-a751-24e53e475b9c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:16.466978 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-023c34cc-cd16-4eff-a751-24e53e475b9c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:16.467725 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-023c34cc-cd16-4eff-a751-24e53e475b9c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:16.472306 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-023c34cc-cd16-4eff-a751-24e53e475b9c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:16.472790 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-023c34cc-cd16-4eff-a751-24e53e475b9c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:16.516838 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-64217f12-11e8-448b-b7ed-253a4832d343 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af4775c28774015bc168bbcfc9b784d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b47199573142cfabb119e111b69c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:16.529604 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-64217f12-11e8-448b-b7ed-253a4832d343 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] 10.222.0.39 "GET /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b" status: 200 len: 1521 microversion: 2.1 time: 0.444118 Aug 07 01:17:16.530395 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 907/1616] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:16 2022] GET /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b => generated 1521 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:16.553831 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-572fc5d3-cb2e-4605-9da9-893957cc76e8 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:16.555343 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-572fc5d3-cb2e-4605-9da9-893957cc76e8 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] [instance: d96d68bb-2dab-43ee-872b-e9090e9a3b4b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:16.564044 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-572fc5d3-cb2e-4605-9da9-893957cc76e8 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:16.566502 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-572fc5d3-cb2e-4605-9da9-893957cc76e8 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:16.567343 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-572fc5d3-cb2e-4605-9da9-893957cc76e8 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:16.568316 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-572fc5d3-cb2e-4605-9da9-893957cc76e8 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:16.569166 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-572fc5d3-cb2e-4605-9da9-893957cc76e8 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:16.570014 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-572fc5d3-cb2e-4605-9da9-893957cc76e8 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:16.620303 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-572fc5d3-cb2e-4605-9da9-893957cc76e8 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] HTTP exception thrown: Instance is not a member of specified network Aug 07 01:17:16.630631 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-572fc5d3-cb2e-4605-9da9-893957cc76e8 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Request method failure captured: Aug 07 01:17:16.630631 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b/ips/invalid HTTP/1.1 Aug 07 01:17:16.630631 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:17:16.630631 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:17:16.630631 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:17:16.630631 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:17:16.630631 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:17:16.630631 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:17:16.630631 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:17:16.630631 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:17:16.630631 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xJ6-D4ZiYIkPLf9y5zZtJJ3jvdqFWKaN19-V-FAF1lAkBXNnVfcpqS-hkL4tmKOHR1Jk5ZkdqUuNwaBmlHoAhSBG0NGmS3ExWiSIhAUMllb-Ke7sJ9MObfpWn0iziV-5MDAYrc_Bmgu2wQT7fLq9zRu6aNXohHxq5UIMCWtTvSff7s Aug 07 01:17:16.630631 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:17:16.630631 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:17:16.630631 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:17:16.630631 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:17:16.630631 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:17:16.630631 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:17:16.630631 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 65b47199573142cfabb119e111b69c9d Aug 07 01:17:16.630631 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-614485255 Aug 07 01:17:16.630631 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:17:16.630631 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:17:16.632563 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/65b47199573142cfabb119e111b69c9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_65b47199573142cfabb119e111b69c9d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/65b47199573142cfabb119e111b69c9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/65b47199573142cfabb119e111b69c9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:17:16.632563 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-614485255 Aug 07 01:17:16.632563 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 65b47199573142cfabb119e111b69c9d Aug 07 01:17:16.632563 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-614485255 Aug 07 01:17:16.632563 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServerAddressesNegativeTestJSON-614485255-project Aug 07 01:17:16.632563 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:17:16.632563 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:17:16.632563 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 0af4775c28774015bc168bbcfc9b784d Aug 07 01:17:16.632563 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-614485255-project Aug 07 01:17:16.632563 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:17:16.632563 n-d-master-1 devstack@n-api.service[119516]: exception: Instance is not a member of specified network Aug 07 01:17:16.632563 n-d-master-1 devstack@n-api.service[119516]: action_args: {'server_id': 'd96d68bb-2dab-43ee-872b-e9090e9a3b4b', 'id': 'invalid'} Aug 07 01:17:16.633551 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:17:16.633551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:16.633551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:17:16.633551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:17:16.633551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:17:16.633551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:17:16.633551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:17:16.633551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:17:16.633551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 07 01:17:16.633551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 07 01:17:16.633551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 07 01:17:16.633551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:17:16.633551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:17:16.633551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:17:16.633551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:16.633551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:17:16.633551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:17:16.633551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:17:16.633551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:17:16.633551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 07 01:17:16.633551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:17:16.635578 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-572fc5d3-cb2e-4605-9da9-893957cc76e8 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Returning 404 to user: Instance is not a member of specified network {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:17:16.635578 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-572fc5d3-cb2e-4605-9da9-893957cc76e8 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] 10.222.0.39 "GET /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.084369 Aug 07 01:17:16.639857 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 908/1617] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:17:16 2022] GET /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b/ips/invalid => generated 91 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:17:16.931029 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-005d83b8-8092-4ac9-99d2-6c70653236ca tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:16.934656 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:17:16.934656 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:17:16.959462 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-005d83b8-8092-4ac9-99d2-6c70653236ca tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:16.959462 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-005d83b8-8092-4ac9-99d2-6c70653236ca tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:16.959462 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-005d83b8-8092-4ac9-99d2-6c70653236ca tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:16.959835 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-005d83b8-8092-4ac9-99d2-6c70653236ca tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:16.960131 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-005d83b8-8092-4ac9-99d2-6c70653236ca tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:16.960715 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-023c34cc-cd16-4eff-a751-24e53e475b9c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:16.961205 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-005d83b8-8092-4ac9-99d2-6c70653236ca tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:16.970782 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-023c34cc-cd16-4eff-a751-24e53e475b9c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1543 microversion: 2.1 time: 0.539934 Aug 07 01:17:16.997975 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 710/1618] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:16 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1543 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:17:17.003542 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-898faf88-f73a-44d3-b593-fe825afc89f1 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:17.008580 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-898faf88-f73a-44d3-b593-fe825afc89f1 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Failed to fetch instance by id 999 {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 07 01:17:17.010708 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-898faf88-f73a-44d3-b593-fe825afc89f1 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] HTTP exception thrown: Instance 999 could not be found. Aug 07 01:17:17.014375 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-898faf88-f73a-44d3-b593-fe825afc89f1 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Request method failure captured: Aug 07 01:17:17.014375 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 07 01:17:17.014375 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:17:17.014375 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:17:17.014375 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:17:17.014375 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:17:17.014375 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:17:17.014375 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:17:17.014375 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:17:17.014375 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:17:17.014375 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xJ6-D4ZiYIkPLf9y5zZtJJ3jvdqFWKaN19-V-FAF1lAkBXNnVfcpqS-hkL4tmKOHR1Jk5ZkdqUuNwaBmlHoAhSBG0NGmS3ExWiSIhAUMllb-Ke7sJ9MObfpWn0iziV-5MDAYrc_Bmgu2wQT7fLq9zRu6aNXohHxq5UIMCWtTvSff7s Aug 07 01:17:17.014375 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:17:17.014375 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:17:17.014375 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:17:17.014375 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:17:17.014375 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:17:17.014375 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:17:17.014375 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 65b47199573142cfabb119e111b69c9d Aug 07 01:17:17.014375 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-614485255 Aug 07 01:17:17.014375 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:17:17.014375 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:17:17.015944 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/65b47199573142cfabb119e111b69c9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_65b47199573142cfabb119e111b69c9d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/65b47199573142cfabb119e111b69c9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/65b47199573142cfabb119e111b69c9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:17:17.015944 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-614485255 Aug 07 01:17:17.015944 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 65b47199573142cfabb119e111b69c9d Aug 07 01:17:17.015944 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-614485255 Aug 07 01:17:17.015944 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServerAddressesNegativeTestJSON-614485255-project Aug 07 01:17:17.015944 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:17:17.015944 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:17:17.015944 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 0af4775c28774015bc168bbcfc9b784d Aug 07 01:17:17.015944 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-614485255-project Aug 07 01:17:17.015944 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:17:17.015944 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 999 could not be found. Aug 07 01:17:17.015944 n-d-master-1 devstack@n-api.service[119517]: action_args: {'server_id': '999'} Aug 07 01:17:17.016780 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:17:17.016780 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:17.016780 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:17:17.016780 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:17:17.016780 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 07 01:17:17.016780 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 07 01:17:17.016780 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 07 01:17:17.016780 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:17:17.016780 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:17:17.016780 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:17:17.016780 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:17.016780 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:17:17.016780 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:17:17.016780 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:17:17.016780 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:17:17.016780 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:17:17.016780 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:17:17.016780 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 07 01:17:17.016780 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 07 01:17:17.016780 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:17:17.018434 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:17:17.018434 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 07 01:17:17.018434 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:17:17.018434 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:17:17.018434 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:17:17.018434 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:17.018434 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:17:17.018434 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:17:17.018434 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:17:17.018434 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:17:17.018434 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 07 01:17:17.018434 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:17:17.019279 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-005d83b8-8092-4ac9-99d2-6c70653236ca tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.373639 Aug 07 01:17:17.019279 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 909/1619] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Aug 7 01:17:16 2022] GET /compute/v2.1/os-services => generated 944 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:17:17.021101 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-99a1bc6f-b597-4995-be3b-e3617e4dfbbc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:17.021747 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-99a1bc6f-b597-4995-be3b-e3617e4dfbbc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:17.024564 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-898faf88-f73a-44d3-b593-fe825afc89f1 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Returning 404 to user: Instance 999 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:17:17.025509 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-898faf88-f73a-44d3-b593-fe825afc89f1 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] 10.222.0.39 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.026265 Aug 07 01:17:17.026086 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 711/1620] 10.222.0.39 () {58 vars in 1149 bytes} [Sun Aug 7 01:17:16 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:17:17.037304 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99a1bc6f-b597-4995-be3b-e3617e4dfbbc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:17.038175 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99a1bc6f-b597-4995-be3b-e3617e4dfbbc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:17.038825 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99a1bc6f-b597-4995-be3b-e3617e4dfbbc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:17.040759 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99a1bc6f-b597-4995-be3b-e3617e4dfbbc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:17.043617 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-38fac161-e44d-4019-a810-9174cb26279e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:17.044393 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-38fac161-e44d-4019-a810-9174cb26279e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: ff193541-98b3-40f6-976c-8b1c721f0bc6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:17.044819 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99a1bc6f-b597-4995-be3b-e3617e4dfbbc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:17.045447 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99a1bc6f-b597-4995-be3b-e3617e4dfbbc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:17.056007 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-38fac161-e44d-4019-a810-9174cb26279e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:17.056777 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-38fac161-e44d-4019-a810-9174cb26279e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:17.057419 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-38fac161-e44d-4019-a810-9174cb26279e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:17.058896 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-38fac161-e44d-4019-a810-9174cb26279e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:17.059537 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-38fac161-e44d-4019-a810-9174cb26279e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:17.060183 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-38fac161-e44d-4019-a810-9174cb26279e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:17.073223 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:17.365989 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-38fac161-e44d-4019-a810-9174cb26279e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:17.366763 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-99a1bc6f-b597-4995-be3b-e3617e4dfbbc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:17.381266 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-38fac161-e44d-4019-a810-9174cb26279e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:17.385102 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-38fac161-e44d-4019-a810-9174cb26279e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:17.387234 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-99a1bc6f-b597-4995-be3b-e3617e4dfbbc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1199 microversion: 2.1 time: 0.370324 Aug 07 01:17:17.389408 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 910/1621] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:17 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1199 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:17.416826 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-38fac161-e44d-4019-a810-9174cb26279e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6" status: 200 len: 1362 microversion: 2.25 time: 0.358379 Aug 07 01:17:17.424517 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 712/1622] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:17 2022] GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6 => generated 1362 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:17.427550 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f68109d4-947c-48d3-9f67-52da94f3315e tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e29966ca0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:17.520053 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0c0c4491-d1eb-4394-925b-9ffab806d024 tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:17.535674 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:17:17.535674 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:17:17.544223 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0c0c4491-d1eb-4394-925b-9ffab806d024 tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:17.547851 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0c0c4491-d1eb-4394-925b-9ffab806d024 tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:17.552366 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0c0c4491-d1eb-4394-925b-9ffab806d024 tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:17.557603 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0c0c4491-d1eb-4394-925b-9ffab806d024 tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:17.560837 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0c0c4491-d1eb-4394-925b-9ffab806d024 tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:17.562663 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0c0c4491-d1eb-4394-925b-9ffab806d024 tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:17.616975 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f68109d4-947c-48d3-9f67-52da94f3315e tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/e2ac911f-15de-4f5b-9d36-e03b3325331a" status: 200 len: 1455 microversion: 2.1 time: 0.224997 Aug 07 01:17:17.617874 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 911/1623] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:17 2022] GET /compute/v2.1/images/e2ac911f-15de-4f5b-9d36-e03b3325331a => generated 1455 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:17.638906 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1d963594-392a-49f4-9f4c-9ced21508a20 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:17.639620 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1d963594-392a-49f4-9f4c-9ced21508a20 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] [instance: d96d68bb-2dab-43ee-872b-e9090e9a3b4b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:17.661055 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d963594-392a-49f4-9f4c-9ced21508a20 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:17.661557 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d963594-392a-49f4-9f4c-9ced21508a20 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:17.664820 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d963594-392a-49f4-9f4c-9ced21508a20 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:17.665672 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d963594-392a-49f4-9f4c-9ced21508a20 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:17.665993 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d963594-392a-49f4-9f4c-9ced21508a20 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:17.666446 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d963594-392a-49f4-9f4c-9ced21508a20 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:17.701048 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0c0c4491-d1eb-4394-925b-9ffab806d024 tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.259812 Aug 07 01:17:17.707331 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 713/1624] 10.222.0.39 () {58 vars in 1170 bytes} [Sun Aug 7 01:17:17 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:17:17.726343 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fd4b99f9-bd70-4cbe-b32d-36f6e886972e tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:17.738688 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:17:17.738688 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:17:17.742210 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd4b99f9-bd70-4cbe-b32d-36f6e886972e tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:17.743233 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd4b99f9-bd70-4cbe-b32d-36f6e886972e tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:17.743646 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd4b99f9-bd70-4cbe-b32d-36f6e886972e tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:17.744538 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd4b99f9-bd70-4cbe-b32d-36f6e886972e tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:17.747365 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd4b99f9-bd70-4cbe-b32d-36f6e886972e tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:17.747696 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1d963594-392a-49f4-9f4c-9ced21508a20 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] [instance: d96d68bb-2dab-43ee-872b-e9090e9a3b4b] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:17:17.747831 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd4b99f9-bd70-4cbe-b32d-36f6e886972e tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:17.773035 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:17.798891 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:17.857976 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fd4b99f9-bd70-4cbe-b32d-36f6e886972e tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.140257 Aug 07 01:17:17.863495 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 714/1625] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Aug 7 01:17:17 2022] GET /compute/v2.1/os-services => generated 944 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:17:17.876626 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b36a3de9-85ee-4a4c-8078-a06ec395318c tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:17.883614 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:17:17.883614 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:17:17.885350 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b36a3de9-85ee-4a4c-8078-a06ec395318c tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:17.888077 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b36a3de9-85ee-4a4c-8078-a06ec395318c tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:17.898689 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b36a3de9-85ee-4a4c-8078-a06ec395318c tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:17.899581 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b36a3de9-85ee-4a4c-8078-a06ec395318c tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:17.901752 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b36a3de9-85ee-4a4c-8078-a06ec395318c tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:17.902262 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b36a3de9-85ee-4a4c-8078-a06ec395318c tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:17.950932 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1d963594-392a-49f4-9f4c-9ced21508a20 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b" status: 204 len: 0 microversion: 2.1 time: 0.323561 Aug 07 01:17:17.953767 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 912/1626] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:17:17 2022] DELETE /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:17:17.974820 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-3d5d88ee-a81e-4af2-b730-877500bccaee req-dd57f8a1-928d-4d5f-873f-bb2a5375d382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff193541-98b3-40f6-976c-8b1c721f0bc6", "name": "network-vif-plugged", "status": "completed", "tag": "0f90fd6b-35f9-4ef7-a7f1-72ecb34de724"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:17.978116 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b36a3de9-85ee-4a4c-8078-a06ec395318c tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.108918 Aug 07 01:17:17.979910 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 715/1627] 10.222.0.39 () {58 vars in 1194 bytes} [Sun Aug 7 01:17:17 2022] GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx => generated 16 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 07 01:17:17.986562 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-960aa347-fd66-4fee-8e1e-0bae82d7f360 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:17.987370 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-960aa347-fd66-4fee-8e1e-0bae82d7f360 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] [instance: d96d68bb-2dab-43ee-872b-e9090e9a3b4b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:17.994194 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-960aa347-fd66-4fee-8e1e-0bae82d7f360 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:17.994966 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-960aa347-fd66-4fee-8e1e-0bae82d7f360 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:17.996140 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-960aa347-fd66-4fee-8e1e-0bae82d7f360 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:17.997245 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-960aa347-fd66-4fee-8e1e-0bae82d7f360 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:17.997877 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-960aa347-fd66-4fee-8e1e-0bae82d7f360 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:17.999028 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-960aa347-fd66-4fee-8e1e-0bae82d7f360 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:18.019466 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3d5d88ee-a81e-4af2-b730-877500bccaee req-dd57f8a1-928d-4d5f-873f-bb2a5375d382 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:18.020124 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3d5d88ee-a81e-4af2-b730-877500bccaee req-dd57f8a1-928d-4d5f-873f-bb2a5375d382 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:18.022534 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3d5d88ee-a81e-4af2-b730-877500bccaee req-dd57f8a1-928d-4d5f-873f-bb2a5375d382 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:18.059944 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-3d5d88ee-a81e-4af2-b730-877500bccaee req-dd57f8a1-928d-4d5f-873f-bb2a5375d382 service nova] Creating event network-vif-plugged:0f90fd6b-35f9-4ef7-a7f1-72ecb34de724 for instance ff193541-98b3-40f6-976c-8b1c721f0bc6 on n-h1-master-1 Aug 07 01:17:18.073920 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-3d5d88ee-a81e-4af2-b730-877500bccaee req-dd57f8a1-928d-4d5f-873f-bb2a5375d382 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118464 Aug 07 01:17:18.076508 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 913/1628] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:17:18.089651 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bdcc5c11-cf36-4954-a136-c642f261720d tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:18.096650 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:17:18.096650 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:17:18.100946 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bdcc5c11-cf36-4954-a136-c642f261720d tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:18.101447 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bdcc5c11-cf36-4954-a136-c642f261720d tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:18.101906 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bdcc5c11-cf36-4954-a136-c642f261720d tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:18.105053 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bdcc5c11-cf36-4954-a136-c642f261720d tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:18.108748 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bdcc5c11-cf36-4954-a136-c642f261720d tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:18.109109 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bdcc5c11-cf36-4954-a136-c642f261720d tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:18.157216 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bdcc5c11-cf36-4954-a136-c642f261720d tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.079229 Aug 07 01:17:18.158007 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 914/1629] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Aug 7 01:17:18 2022] GET /compute/v2.1/os-services => generated 944 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:17:18.158007 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a7b95502-76dc-4f16-9df4-396d56364bda tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:18.165857 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a7b95502-76dc-4f16-9df4-396d56364bda tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:18.179687 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7b95502-76dc-4f16-9df4-396d56364bda tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:18.180365 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7b95502-76dc-4f16-9df4-396d56364bda tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:18.180695 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7b95502-76dc-4f16-9df4-396d56364bda tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:18.183847 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7b95502-76dc-4f16-9df4-396d56364bda tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:18.184261 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7b95502-76dc-4f16-9df4-396d56364bda tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:18.184706 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7b95502-76dc-4f16-9df4-396d56364bda tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:18.464679 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-960aa347-fd66-4fee-8e1e-0bae82d7f360 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af4775c28774015bc168bbcfc9b784d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b47199573142cfabb119e111b69c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:18.476853 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a7b95502-76dc-4f16-9df4-396d56364bda tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:18.479862 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-960aa347-fd66-4fee-8e1e-0bae82d7f360 tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] 10.222.0.39 "GET /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b" status: 200 len: 1527 microversion: 2.1 time: 0.498598 Aug 07 01:17:18.485820 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a7b95502-76dc-4f16-9df4-396d56364bda tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1543 microversion: 2.1 time: 0.326763 Aug 07 01:17:18.493033 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 716/1630] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:17 2022] GET /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b => generated 1527 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:18.500640 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2255c4e8-29c0-4908-90ea-3e63b8cf9b4a tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:18.505179 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:17:18.505179 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:17:18.505773 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 915/1631] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:18 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1543 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:18.510702 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2255c4e8-29c0-4908-90ea-3e63b8cf9b4a tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:18.517742 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2255c4e8-29c0-4908-90ea-3e63b8cf9b4a tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:18.519062 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2255c4e8-29c0-4908-90ea-3e63b8cf9b4a tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:18.520470 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2255c4e8-29c0-4908-90ea-3e63b8cf9b4a tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:18.521143 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2255c4e8-29c0-4908-90ea-3e63b8cf9b4a tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:18.521746 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2255c4e8-29c0-4908-90ea-3e63b8cf9b4a tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:18.530303 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3c2ba22a-1766-4d3b-9bd7-dd1360141445 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:18.531168 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3c2ba22a-1766-4d3b-9bd7-dd1360141445 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:18.543360 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c2ba22a-1766-4d3b-9bd7-dd1360141445 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:18.563304 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c2ba22a-1766-4d3b-9bd7-dd1360141445 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:18.563760 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c2ba22a-1766-4d3b-9bd7-dd1360141445 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:18.566127 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c2ba22a-1766-4d3b-9bd7-dd1360141445 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:18.566604 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c2ba22a-1766-4d3b-9bd7-dd1360141445 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:18.567039 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c2ba22a-1766-4d3b-9bd7-dd1360141445 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:18.609623 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2255c4e8-29c0-4908-90ea-3e63b8cf9b4a tempest-ServicesAdminNegativeTestJSON-1886161818 tempest-ServicesAdminNegativeTestJSON-1886161818-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.115115 Aug 07 01:17:18.620403 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 717/1632] 10.222.0.39 () {58 vars in 1198 bytes} [Sun Aug 7 01:17:18 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:17:18.625369 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-eb860881-3e14-4ae2-9f81-b5906a8fa9fb tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:18.633169 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-eb860881-3e14-4ae2-9f81-b5906a8fa9fb tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: ff193541-98b3-40f6-976c-8b1c721f0bc6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:18.644920 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb860881-3e14-4ae2-9f81-b5906a8fa9fb tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:18.647054 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb860881-3e14-4ae2-9f81-b5906a8fa9fb tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:18.651273 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb860881-3e14-4ae2-9f81-b5906a8fa9fb tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:18.652320 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb860881-3e14-4ae2-9f81-b5906a8fa9fb tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:18.653186 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb860881-3e14-4ae2-9f81-b5906a8fa9fb tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:18.654038 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb860881-3e14-4ae2-9f81-b5906a8fa9fb tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:18.848133 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3c2ba22a-1766-4d3b-9bd7-dd1360141445 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:18.861544 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3c2ba22a-1766-4d3b-9bd7-dd1360141445 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1199 microversion: 2.1 time: 0.352774 Aug 07 01:17:18.882620 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 916/1633] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:18 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1199 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:19.009378 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-eb860881-3e14-4ae2-9f81-b5906a8fa9fb tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:19.025938 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-eb860881-3e14-4ae2-9f81-b5906a8fa9fb tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:19.027776 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-eb860881-3e14-4ae2-9f81-b5906a8fa9fb tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:19.034018 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-eb860881-3e14-4ae2-9f81-b5906a8fa9fb tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6" status: 200 len: 1362 microversion: 2.25 time: 0.412402 Aug 07 01:17:19.037494 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 718/1634] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:18 2022] GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6 => generated 1362 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:19.058107 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8cd84da9-b094-4ded-86e9-0a6b35112561 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e24359940>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:19.137296 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8cd84da9-b094-4ded-86e9-0a6b35112561 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/e2ac911f-15de-4f5b-9d36-e03b3325331a" status: 200 len: 1455 microversion: 2.1 time: 0.096366 Aug 07 01:17:19.141858 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 719/1635] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:19 2022] GET /compute/v2.1/images/e2ac911f-15de-4f5b-9d36-e03b3325331a => generated 1455 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:19.349410 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-17edeab5-dc84-48b4-9fc3-5ecbb4e86363 tempest-ServicesAdminNegativeTestJSON-688179041 tempest-ServicesAdminNegativeTestJSON-688179041-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:19.352450 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:17:19.352450 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:17:19.353808 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-17edeab5-dc84-48b4-9fc3-5ecbb4e86363 tempest-ServicesAdminNegativeTestJSON-688179041 tempest-ServicesAdminNegativeTestJSON-688179041-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'a0cfe8884b8b49c8b38c4e91d77e994e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2389688d1f844f46a38347db9de6bdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:19.356577 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-17edeab5-dc84-48b4-9fc3-5ecbb4e86363 tempest-ServicesAdminNegativeTestJSON-688179041 tempest-ServicesAdminNegativeTestJSON-688179041-project] Request method failure captured: Aug 07 01:17:19.356577 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 07 01:17:19.356577 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:17:19.356577 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:17:19.356577 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:17:19.356577 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:17:19.356577 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:17:19.356577 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:17:19.356577 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:17:19.356577 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:17:19.356577 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xKbdpo4GWuQ4uwJKs1tPk2cqReAzjjhtyVvbN6k_NguEgwW7Re_tTsKXFn6hbnmkTjxewigtmV1VKnrbEngGQ1Fid6LQjYuafwNKq9YhSdSCakadr2GE-KqOSzpL4E1j_7pUqFU_xHCa3mlKix_PDh2jI7VmwddKlJqp8XwBbhPoCs Aug 07 01:17:19.356577 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:17:19.356577 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:17:19.356577 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:17:19.356577 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:17:19.356577 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:17:19.356577 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:17:19.356577 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 2389688d1f844f46a38347db9de6bdf0 Aug 07 01:17:19.356577 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-688179041 Aug 07 01:17:19.356577 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:17:19.356577 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:17:19.358089 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2389688d1f844f46a38347db9de6bdf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2389688d1f844f46a38347db9de6bdf0", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2389688d1f844f46a38347db9de6bdf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2389688d1f844f46a38347db9de6bdf0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:17:19.358089 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-688179041 Aug 07 01:17:19.358089 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 2389688d1f844f46a38347db9de6bdf0 Aug 07 01:17:19.358089 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-688179041 Aug 07 01:17:19.358089 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServicesAdminNegativeTestJSON-688179041-project Aug 07 01:17:19.358089 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:17:19.358089 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:17:19.358089 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: a0cfe8884b8b49c8b38c4e91d77e994e Aug 07 01:17:19.358089 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-688179041-project Aug 07 01:17:19.358089 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:17:19.358089 n-d-master-1 devstack@n-api.service[119516]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 07 01:17:19.358089 n-d-master-1 devstack@n-api.service[119516]: action_args: {} Aug 07 01:17:19.359007 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:17:19.359007 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:19.359007 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:17:19.359007 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:17:19.359007 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:17:19.359007 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:17:19.359007 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 07 01:17:19.359007 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:17:19.359007 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 07 01:17:19.359007 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:17:19.359007 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:17:19.359007 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:17:19.359007 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Aug 07 01:17:19.359007 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 07 01:17:19.359007 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 07 01:17:19.359007 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 07 01:17:19.359007 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 07 01:17:19.359007 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 07 01:17:19.359007 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:17:19.361256 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:17:19.361256 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:17:19.361256 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:17:19.361256 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 07 01:17:19.361256 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 07 01:17:19.361256 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 07 01:17:19.361256 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 07 01:17:19.361256 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 07 01:17:19.361256 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 07 01:17:19.361256 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 07 01:17:19.361256 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:17:19.361256 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:17:19.361256 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:17:19.361256 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:19.361256 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:17:19.361256 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:17:19.361256 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 07 01:17:19.361256 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 07 01:17:19.361256 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 07 01:17:19.361256 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:17:19.364409 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-17edeab5-dc84-48b4-9fc3-5ecbb4e86363 tempest-ServicesAdminNegativeTestJSON-688179041 tempest-ServicesAdminNegativeTestJSON-688179041-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:17:19.364409 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-17edeab5-dc84-48b4-9fc3-5ecbb4e86363 tempest-ServicesAdminNegativeTestJSON-688179041 tempest-ServicesAdminNegativeTestJSON-688179041-project] 10.222.0.39 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.474544 Aug 07 01:17:19.364409 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 917/1636] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Aug 7 01:17:18 2022] GET /compute/v2.1/os-services => generated 112 bytes in 481 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:17:19.507068 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5e3f4eea-f41e-40cf-8eab-5e3e4a3ffe5d tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:19.508333 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5e3f4eea-f41e-40cf-8eab-5e3e4a3ffe5d tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] [instance: d96d68bb-2dab-43ee-872b-e9090e9a3b4b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:19.513138 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-04c72b4c-a69b-43f8-94f6-72ed2b4337d9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:19.514160 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-04c72b4c-a69b-43f8-94f6-72ed2b4337d9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:19.521035 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e3f4eea-f41e-40cf-8eab-5e3e4a3ffe5d tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:19.526917 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e3f4eea-f41e-40cf-8eab-5e3e4a3ffe5d tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:19.530433 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e3f4eea-f41e-40cf-8eab-5e3e4a3ffe5d tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:19.531487 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e3f4eea-f41e-40cf-8eab-5e3e4a3ffe5d tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:19.532345 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-04c72b4c-a69b-43f8-94f6-72ed2b4337d9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:19.533576 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e3f4eea-f41e-40cf-8eab-5e3e4a3ffe5d tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:19.534026 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e3f4eea-f41e-40cf-8eab-5e3e4a3ffe5d tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:19.534751 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-04c72b4c-a69b-43f8-94f6-72ed2b4337d9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:19.535512 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-04c72b4c-a69b-43f8-94f6-72ed2b4337d9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:19.538248 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-04c72b4c-a69b-43f8-94f6-72ed2b4337d9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:19.577052 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-04c72b4c-a69b-43f8-94f6-72ed2b4337d9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.039s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:19.579423 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-04c72b4c-a69b-43f8-94f6-72ed2b4337d9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:20.028053 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-04c72b4c-a69b-43f8-94f6-72ed2b4337d9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:20.055054 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-04c72b4c-a69b-43f8-94f6-72ed2b4337d9 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1543 microversion: 2.1 time: 0.544604 Aug 07 01:17:20.057379 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 918/1637] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:19 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1543 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:17:20.063690 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2901fbea-f14b-4ce3-ab48-888a3bd91d94 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:20.065357 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2901fbea-f14b-4ce3-ab48-888a3bd91d94 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:20.074799 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5e3f4eea-f41e-40cf-8eab-5e3e4a3ffe5d tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af4775c28774015bc168bbcfc9b784d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b47199573142cfabb119e111b69c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:20.084041 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2901fbea-f14b-4ce3-ab48-888a3bd91d94 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:20.084571 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5e3f4eea-f41e-40cf-8eab-5e3e4a3ffe5d tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] 10.222.0.39 "GET /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b" status: 200 len: 1527 microversion: 2.1 time: 0.582381 Aug 07 01:17:20.085080 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2901fbea-f14b-4ce3-ab48-888a3bd91d94 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:20.085709 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2901fbea-f14b-4ce3-ab48-888a3bd91d94 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:20.087286 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2901fbea-f14b-4ce3-ab48-888a3bd91d94 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:20.091234 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2901fbea-f14b-4ce3-ab48-888a3bd91d94 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:20.091612 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 720/1638] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:19 2022] GET /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b => generated 1527 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:20.093830 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2901fbea-f14b-4ce3-ab48-888a3bd91d94 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:20.109011 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4a8d79a4-762f-464c-aed4-bcc662b381a9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:20.112551 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4a8d79a4-762f-464c-aed4-bcc662b381a9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: ff193541-98b3-40f6-976c-8b1c721f0bc6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:20.130271 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4a8d79a4-762f-464c-aed4-bcc662b381a9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:20.132908 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4a8d79a4-762f-464c-aed4-bcc662b381a9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:20.134908 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4a8d79a4-762f-464c-aed4-bcc662b381a9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:20.137067 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4a8d79a4-762f-464c-aed4-bcc662b381a9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:20.139308 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4a8d79a4-762f-464c-aed4-bcc662b381a9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:20.144090 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4a8d79a4-762f-464c-aed4-bcc662b381a9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:20.466513 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2901fbea-f14b-4ce3-ab48-888a3bd91d94 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:20.488628 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2901fbea-f14b-4ce3-ab48-888a3bd91d94 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1199 microversion: 2.1 time: 0.416819 Aug 07 01:17:20.490656 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 919/1639] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:20 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1199 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:20.506843 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6e007b6e-7685-455c-9f68-0adf73dc8d93 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e299979d0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:20.660528 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6e007b6e-7685-455c-9f68-0adf73dc8d93 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/e2ac911f-15de-4f5b-9d36-e03b3325331a" status: 200 len: 1455 microversion: 2.1 time: 0.167957 Aug 07 01:17:20.661236 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 920/1640] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:20 2022] GET /compute/v2.1/images/e2ac911f-15de-4f5b-9d36-e03b3325331a => generated 1455 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:20.968589 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-999ddf49-5186-4e43-814c-f691576f61d3 req-12ccac28-209f-4246-bed1-8c61ba2ff6eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d96d68bb-2dab-43ee-872b-e9090e9a3b4b", "name": "network-vif-deleted", "tag": "0c7cc18d-914b-49c2-ae9b-d4eb7775f7e3"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:21.014037 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-999ddf49-5186-4e43-814c-f691576f61d3 req-12ccac28-209f-4246-bed1-8c61ba2ff6eb service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:21.022470 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-999ddf49-5186-4e43-814c-f691576f61d3 req-12ccac28-209f-4246-bed1-8c61ba2ff6eb service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:21.032381 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-999ddf49-5186-4e43-814c-f691576f61d3 req-12ccac28-209f-4246-bed1-8c61ba2ff6eb service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:21.039488 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4a8d79a4-762f-464c-aed4-bcc662b381a9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:21.068685 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4a8d79a4-762f-464c-aed4-bcc662b381a9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:21.080937 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-999ddf49-5186-4e43-814c-f691576f61d3 req-12ccac28-209f-4246-bed1-8c61ba2ff6eb service nova] Creating event network-vif-deleted:0c7cc18d-914b-49c2-ae9b-d4eb7775f7e3 for instance d96d68bb-2dab-43ee-872b-e9090e9a3b4b on n-h2-master-1 Aug 07 01:17:21.085628 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4a8d79a4-762f-464c-aed4-bcc662b381a9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:21.089646 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4a8d79a4-762f-464c-aed4-bcc662b381a9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6" status: 200 len: 1558 microversion: 2.25 time: 0.994403 Aug 07 01:17:21.095513 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 721/1641] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:20 2022] GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6 => generated 1558 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:21.100018 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-999ddf49-5186-4e43-814c-f691576f61d3 req-12ccac28-209f-4246-bed1-8c61ba2ff6eb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141387 Aug 07 01:17:21.102225 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 921/1642] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 07 01:17:21.123207 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-27a6a53b-d667-481f-a8ec-8fd99141a285 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:21.125124 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-27a6a53b-d667-481f-a8ec-8fd99141a285 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:21.149171 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27a6a53b-d667-481f-a8ec-8fd99141a285 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:21.154511 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27a6a53b-d667-481f-a8ec-8fd99141a285 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:21.155818 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27a6a53b-d667-481f-a8ec-8fd99141a285 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:21.157251 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27a6a53b-d667-481f-a8ec-8fd99141a285 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:21.158054 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27a6a53b-d667-481f-a8ec-8fd99141a285 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:21.158805 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27a6a53b-d667-481f-a8ec-8fd99141a285 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:21.192613 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-469eb90b-c807-4395-83e4-5aeecd1d3d4a tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:21.193526 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-469eb90b-c807-4395-83e4-5aeecd1d3d4a tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] [instance: d96d68bb-2dab-43ee-872b-e9090e9a3b4b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:21.211084 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-469eb90b-c807-4395-83e4-5aeecd1d3d4a tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:21.212256 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-469eb90b-c807-4395-83e4-5aeecd1d3d4a tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:21.212842 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-469eb90b-c807-4395-83e4-5aeecd1d3d4a tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:21.213709 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-469eb90b-c807-4395-83e4-5aeecd1d3d4a tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:21.214315 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-469eb90b-c807-4395-83e4-5aeecd1d3d4a tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:21.215394 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-469eb90b-c807-4395-83e4-5aeecd1d3d4a tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:21.475147 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-27a6a53b-d667-481f-a8ec-8fd99141a285 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:21.509722 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-27a6a53b-d667-481f-a8ec-8fd99141a285 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1543 microversion: 2.1 time: 0.408381 Aug 07 01:17:21.512753 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 722/1643] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:21 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1543 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:21.884862 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-469eb90b-c807-4395-83e4-5aeecd1d3d4a tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af4775c28774015bc168bbcfc9b784d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65b47199573142cfabb119e111b69c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:21.922992 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-469eb90b-c807-4395-83e4-5aeecd1d3d4a tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] 10.222.0.39 "GET /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b" status: 200 len: 1310 microversion: 2.1 time: 0.805174 Aug 07 01:17:21.928805 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 922/1644] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:21 2022] GET /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b => generated 1310 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:21.943930 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d20daaa2-1cff-4782-abb6-fcb5213fab34 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:21.945146 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d20daaa2-1cff-4782-abb6-fcb5213fab34 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:21.975556 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d20daaa2-1cff-4782-abb6-fcb5213fab34 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:21.977001 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d20daaa2-1cff-4782-abb6-fcb5213fab34 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:21.978552 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d20daaa2-1cff-4782-abb6-fcb5213fab34 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:21.980016 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d20daaa2-1cff-4782-abb6-fcb5213fab34 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:21.994052 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d20daaa2-1cff-4782-abb6-fcb5213fab34 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:21.996943 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d20daaa2-1cff-4782-abb6-fcb5213fab34 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:22.161358 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0d56bba1-3c34-4c6d-8f57-da3fbc21e2c3 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:22.162638 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0d56bba1-3c34-4c6d-8f57-da3fbc21e2c3 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] [instance: ff193541-98b3-40f6-976c-8b1c721f0bc6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:22.195948 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d56bba1-3c34-4c6d-8f57-da3fbc21e2c3 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:22.197390 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d56bba1-3c34-4c6d-8f57-da3fbc21e2c3 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:22.198403 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d56bba1-3c34-4c6d-8f57-da3fbc21e2c3 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:22.206856 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d56bba1-3c34-4c6d-8f57-da3fbc21e2c3 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:22.208570 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d56bba1-3c34-4c6d-8f57-da3fbc21e2c3 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:22.209898 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d56bba1-3c34-4c6d-8f57-da3fbc21e2c3 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:22.486864 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-0d56bba1-3c34-4c6d-8f57-da3fbc21e2c3 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lazy-loading 'services' on Instance uuid ff193541-98b3-40f6-976c-8b1c721f0bc6 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:17:22.535002 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0d56bba1-3c34-4c6d-8f57-da3fbc21e2c3 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6" status: 200 len: 2051 microversion: 2.25 time: 1.015433 Aug 07 01:17:22.535658 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 723/1645] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:21 2022] GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6 => generated 2051 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:22.552257 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-4f95680d-31ab-4d59-8cbb-555a17edccbd req-3a933978-0517-4455-bb75-1c5b6e808b28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2dbfd1a-efab-4943-b00a-6cdd1051489c", "name": "network-vif-plugged", "status": "completed", "tag": "05c06eb8-fc76-4d4a-bf23-b4a1dd7229f7"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:22.564893 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-4f95680d-31ab-4d59-8cbb-555a17edccbd req-3a933978-0517-4455-bb75-1c5b6e808b28 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:22.565691 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-4f95680d-31ab-4d59-8cbb-555a17edccbd req-3a933978-0517-4455-bb75-1c5b6e808b28 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:22.566515 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-4f95680d-31ab-4d59-8cbb-555a17edccbd req-3a933978-0517-4455-bb75-1c5b6e808b28 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:22.598068 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-4f95680d-31ab-4d59-8cbb-555a17edccbd req-3a933978-0517-4455-bb75-1c5b6e808b28 service nova] Creating event network-vif-plugged:05c06eb8-fc76-4d4a-bf23-b4a1dd7229f7 for instance d2dbfd1a-efab-4943-b00a-6cdd1051489c on n-h1-master-1 Aug 07 01:17:22.612349 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-4f95680d-31ab-4d59-8cbb-555a17edccbd req-3a933978-0517-4455-bb75-1c5b6e808b28 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072196 Aug 07 01:17:22.615526 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 724/1646] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:17:22.625524 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fb91cc74-6064-416b-845b-904797e43e5b tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e24a41160>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:22.708987 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fb91cc74-6064-416b-845b-904797e43e5b tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/e2ac911f-15de-4f5b-9d36-e03b3325331a" status: 200 len: 1455 microversion: 2.1 time: 0.091651 Aug 07 01:17:22.710574 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 725/1647] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:22 2022] GET /compute/v2.1/images/e2ac911f-15de-4f5b-9d36-e03b3325331a => generated 1455 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:22.736225 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7036effc-4504-4696-935f-82b56d23d392 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:22.737197 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7036effc-4504-4696-935f-82b56d23d392 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:22.750791 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7036effc-4504-4696-935f-82b56d23d392 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:22.751451 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7036effc-4504-4696-935f-82b56d23d392 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:22.751916 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7036effc-4504-4696-935f-82b56d23d392 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:22.752675 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7036effc-4504-4696-935f-82b56d23d392 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:22.753207 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7036effc-4504-4696-935f-82b56d23d392 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:22.757336 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7036effc-4504-4696-935f-82b56d23d392 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:22.844258 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d20daaa2-1cff-4782-abb6-fcb5213fab34 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:22.853667 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d20daaa2-1cff-4782-abb6-fcb5213fab34 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1199 microversion: 2.1 time: 0.923324 Aug 07 01:17:22.858177 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 923/1648] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:21 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1199 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:22.938396 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-11cee831-896b-4525-a7e1-d46e0519e647 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:22.942845 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-11cee831-896b-4525-a7e1-d46e0519e647 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] [instance: ff193541-98b3-40f6-976c-8b1c721f0bc6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:22.967345 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-11cee831-896b-4525-a7e1-d46e0519e647 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:22.974318 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-11cee831-896b-4525-a7e1-d46e0519e647 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:22.986286 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-11cee831-896b-4525-a7e1-d46e0519e647 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:22.988469 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-11cee831-896b-4525-a7e1-d46e0519e647 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:22.990423 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-11cee831-896b-4525-a7e1-d46e0519e647 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:22.993178 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-11cee831-896b-4525-a7e1-d46e0519e647 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:23.349702 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7036effc-4504-4696-935f-82b56d23d392 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:23.366170 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7036effc-4504-4696-935f-82b56d23d392 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1543 microversion: 2.1 time: 0.653898 Aug 07 01:17:23.386681 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 726/1649] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:22 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1543 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:23.392511 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b5b189f2-c2ef-41f8-8089-16b2e1e71fcb tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:23.393748 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b5b189f2-c2ef-41f8-8089-16b2e1e71fcb tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] [instance: d96d68bb-2dab-43ee-872b-e9090e9a3b4b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:23.402161 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5b189f2-c2ef-41f8-8089-16b2e1e71fcb tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:23.403283 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5b189f2-c2ef-41f8-8089-16b2e1e71fcb tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:23.403729 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5b189f2-c2ef-41f8-8089-16b2e1e71fcb tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:23.404482 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5b189f2-c2ef-41f8-8089-16b2e1e71fcb tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:23.404929 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5b189f2-c2ef-41f8-8089-16b2e1e71fcb tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:23.405349 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5b189f2-c2ef-41f8-8089-16b2e1e71fcb tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:23.424766 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-b5b189f2-c2ef-41f8-8089-16b2e1e71fcb tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] HTTP exception thrown: Instance d96d68bb-2dab-43ee-872b-e9090e9a3b4b could not be found. Aug 07 01:17:23.438603 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b5b189f2-c2ef-41f8-8089-16b2e1e71fcb tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Request method failure captured: Aug 07 01:17:23.438603 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b HTTP/1.1 Aug 07 01:17:23.438603 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:17:23.438603 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:17:23.438603 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:17:23.438603 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:17:23.438603 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:17:23.438603 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:17:23.438603 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:17:23.438603 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:17:23.438603 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xJ6-D4ZiYIkPLf9y5zZtJJ3jvdqFWKaN19-V-FAF1lAkBXNnVfcpqS-hkL4tmKOHR1Jk5ZkdqUuNwaBmlHoAhSBG0NGmS3ExWiSIhAUMllb-Ke7sJ9MObfpWn0iziV-5MDAYrc_Bmgu2wQT7fLq9zRu6aNXohHxq5UIMCWtTvSff7s Aug 07 01:17:23.438603 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:17:23.438603 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:17:23.438603 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:17:23.438603 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:17:23.438603 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:17:23.438603 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:17:23.438603 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 65b47199573142cfabb119e111b69c9d Aug 07 01:17:23.438603 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-614485255 Aug 07 01:17:23.438603 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:17:23.438603 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:17:23.440248 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/65b47199573142cfabb119e111b69c9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_65b47199573142cfabb119e111b69c9d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/65b47199573142cfabb119e111b69c9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/65b47199573142cfabb119e111b69c9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:17:23.440248 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-614485255 Aug 07 01:17:23.440248 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 65b47199573142cfabb119e111b69c9d Aug 07 01:17:23.440248 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-614485255 Aug 07 01:17:23.440248 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServerAddressesNegativeTestJSON-614485255-project Aug 07 01:17:23.440248 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:17:23.440248 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:17:23.440248 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 0af4775c28774015bc168bbcfc9b784d Aug 07 01:17:23.440248 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-614485255-project Aug 07 01:17:23.440248 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:17:23.440248 n-d-master-1 devstack@n-api.service[119517]: exception: Instance d96d68bb-2dab-43ee-872b-e9090e9a3b4b could not be found. Aug 07 01:17:23.440248 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'd96d68bb-2dab-43ee-872b-e9090e9a3b4b'} Aug 07 01:17:23.441731 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:17:23.441731 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:23.441731 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:17:23.441731 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:17:23.441731 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:17:23.441731 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:17:23.441731 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:17:23.441731 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:17:23.441731 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:17:23.441731 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:17:23.441731 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d96d68bb-2dab-43ee-872b-e9090e9a3b4b could not be found. Aug 07 01:17:23.441731 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:17:23.441731 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:17:23.441731 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:17:23.441731 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:23.441731 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:17:23.441731 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:17:23.441731 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:17:23.441731 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:17:23.441731 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:17:23.445088 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:17:23.445088 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:17:23.445088 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:17:23.445088 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:17:23.445088 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:17:23.445088 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:17:23.445088 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:17:23.445088 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d96d68bb-2dab-43ee-872b-e9090e9a3b4b could not be found. Aug 07 01:17:23.445088 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:17:23.445088 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:17:23.445088 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:17:23.445088 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:17:23.445088 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:17:23.445088 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:17:23.445088 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:17:23.445088 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:17:23.445088 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d96d68bb-2dab-43ee-872b-e9090e9a3b4b could not be found. Aug 07 01:17:23.445088 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:17:23.447719 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b5b189f2-c2ef-41f8-8089-16b2e1e71fcb tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] Returning 404 to user: Instance d96d68bb-2dab-43ee-872b-e9090e9a3b4b could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:17:23.447719 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b5b189f2-c2ef-41f8-8089-16b2e1e71fcb tempest-ServerAddressesNegativeTestJSON-614485255 tempest-ServerAddressesNegativeTestJSON-614485255-project] 10.222.0.39 "GET /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b" status: 404 len: 111 microversion: 2.1 time: 0.051994 Aug 07 01:17:23.447719 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 727/1650] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:23 2022] GET /compute/v2.1/servers/d96d68bb-2dab-43ee-872b-e9090e9a3b4b => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:17:23.589748 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-11cee831-896b-4525-a7e1-d46e0519e647 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lazy-loading 'services' on Instance uuid ff193541-98b3-40f6-976c-8b1c721f0bc6 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:17:23.615861 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-11cee831-896b-4525-a7e1-d46e0519e647 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6" status: 200 len: 2051 microversion: 2.25 time: 0.755442 Aug 07 01:17:23.622484 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 924/1651] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:22 2022] GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6 => generated 2051 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:23.660832 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2f474980-7bb9-47c7-b93f-82ad3d3b2ad6 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:23.691484 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:17:23.691484 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:17:23.716311 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f474980-7bb9-47c7-b93f-82ad3d3b2ad6 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:23.726289 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e005bc7f-a475-409f-85a4-8ebca7181080 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e299cc550>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:23.739071 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f474980-7bb9-47c7-b93f-82ad3d3b2ad6 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:23.739785 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f474980-7bb9-47c7-b93f-82ad3d3b2ad6 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:23.743500 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f474980-7bb9-47c7-b93f-82ad3d3b2ad6 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:23.759161 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f474980-7bb9-47c7-b93f-82ad3d3b2ad6 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:23.760280 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f474980-7bb9-47c7-b93f-82ad3d3b2ad6 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:23.842333 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e005bc7f-a475-409f-85a4-8ebca7181080 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/e2ac911f-15de-4f5b-9d36-e03b3325331a" status: 200 len: 1455 microversion: 2.1 time: 0.120639 Aug 07 01:17:23.843037 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 925/1652] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:23 2022] GET /compute/v2.1/images/e2ac911f-15de-4f5b-9d36-e03b3325331a => generated 1455 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:23.847799 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2f474980-7bb9-47c7-b93f-82ad3d3b2ad6 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.195853 Aug 07 01:17:23.856102 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 728/1653] 10.222.0.39 () {60 vars in 1217 bytes} [Sun Aug 7 01:17:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:17:23.879152 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d2166bc5-21bb-46bc-aca4-726c6a1d3f2a tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": "auto"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:23.886731 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c3b7b334-1855-406d-943e-f409a43f650e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:23.887363 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c3b7b334-1855-406d-943e-f409a43f650e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:23.888281 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d2166bc5-21bb-46bc-aca4-726c6a1d3f2a tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] [instance: ff193541-98b3-40f6-976c-8b1c721f0bc6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:23.902354 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3b7b334-1855-406d-943e-f409a43f650e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:23.903212 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3b7b334-1855-406d-943e-f409a43f650e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:23.906827 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3b7b334-1855-406d-943e-f409a43f650e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:23.907705 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3b7b334-1855-406d-943e-f409a43f650e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:23.911827 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3b7b334-1855-406d-943e-f409a43f650e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:23.912602 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3b7b334-1855-406d-943e-f409a43f650e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:23.945483 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2166bc5-21bb-46bc-aca4-726c6a1d3f2a tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:23.946102 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2166bc5-21bb-46bc-aca4-726c6a1d3f2a tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:23.946562 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2166bc5-21bb-46bc-aca4-726c6a1d3f2a tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:23.947324 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2166bc5-21bb-46bc-aca4-726c6a1d3f2a tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:23.947794 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2166bc5-21bb-46bc-aca4-726c6a1d3f2a tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:23.948261 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2166bc5-21bb-46bc-aca4-726c6a1d3f2a tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:24.051859 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-d2166bc5-21bb-46bc-aca4-726c6a1d3f2a tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lazy-loading 'flavor' on Instance uuid ff193541-98b3-40f6-976c-8b1c721f0bc6 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:17:24.114041 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d2166bc5-21bb-46bc-aca4-726c6a1d3f2a tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] [instance: ff193541-98b3-40f6-976c-8b1c721f0bc6] Going to try to live migrate instance to n-h2-master-1 {{(pid=119516) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 07 01:17:25.966415 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c3b7b334-1855-406d-943e-f409a43f650e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:25.991195 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c3b7b334-1855-406d-943e-f409a43f650e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1199 microversion: 2.1 time: 2.108254 Aug 07 01:17:26.000083 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 729/1654] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:23 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1199 bytes in 2118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:17:26.038493 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2eff035b-b7b2-4a7e-a23a-bb05db34e177 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:26.043005 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2eff035b-b7b2-4a7e-a23a-bb05db34e177 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:26.078966 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2eff035b-b7b2-4a7e-a23a-bb05db34e177 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:26.079924 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2eff035b-b7b2-4a7e-a23a-bb05db34e177 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:26.080636 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2eff035b-b7b2-4a7e-a23a-bb05db34e177 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:26.082217 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2eff035b-b7b2-4a7e-a23a-bb05db34e177 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:26.084021 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2eff035b-b7b2-4a7e-a23a-bb05db34e177 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:26.086764 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2eff035b-b7b2-4a7e-a23a-bb05db34e177 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:27.170737 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2eff035b-b7b2-4a7e-a23a-bb05db34e177 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:27.187639 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2eff035b-b7b2-4a7e-a23a-bb05db34e177 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1543 microversion: 2.1 time: 1.177308 Aug 07 01:17:27.195592 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 730/1655] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:26 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1543 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:27.200418 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-c122b00d-72d3-46c1-9af9-67a44ca43bf6 req-64da3173-d188-4400-af00-6d4cc39c9a65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e006496-fa0b-4e7a-8c5d-a3724b172720", "name": "network-vif-plugged", "status": "completed", "tag": "dcf52ab3-da5a-473c-accb-60d75e843c85"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:27.234716 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c122b00d-72d3-46c1-9af9-67a44ca43bf6 req-64da3173-d188-4400-af00-6d4cc39c9a65 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:27.235212 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c122b00d-72d3-46c1-9af9-67a44ca43bf6 req-64da3173-d188-4400-af00-6d4cc39c9a65 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:27.235657 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c122b00d-72d3-46c1-9af9-67a44ca43bf6 req-64da3173-d188-4400-af00-6d4cc39c9a65 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:27.261995 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-c122b00d-72d3-46c1-9af9-67a44ca43bf6 req-64da3173-d188-4400-af00-6d4cc39c9a65 service nova] Creating event network-vif-plugged:dcf52ab3-da5a-473c-accb-60d75e843c85 for instance 2e006496-fa0b-4e7a-8c5d-a3724b172720 on n-h2-master-1 Aug 07 01:17:27.279992 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-c122b00d-72d3-46c1-9af9-67a44ca43bf6 req-64da3173-d188-4400-af00-6d4cc39c9a65 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089767 Aug 07 01:17:27.280685 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 731/1656] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:17:27.292557 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8d4e853f-2736-4573-8693-c5eb9c2f0386 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e240d79d0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:27.403076 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8d4e853f-2736-4573-8693-c5eb9c2f0386 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/e2ac911f-15de-4f5b-9d36-e03b3325331a" status: 200 len: 1455 microversion: 2.1 time: 0.120884 Aug 07 01:17:27.404725 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 732/1657] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:27 2022] GET /compute/v2.1/images/e2ac911f-15de-4f5b-9d36-e03b3325331a => generated 1455 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:27.424858 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3a25b9fb-a40e-4b43-8745-6647cd9ae1bb tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:27.425677 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3a25b9fb-a40e-4b43-8745-6647cd9ae1bb tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:27.443199 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3a25b9fb-a40e-4b43-8745-6647cd9ae1bb tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:27.444141 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3a25b9fb-a40e-4b43-8745-6647cd9ae1bb tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:27.444969 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3a25b9fb-a40e-4b43-8745-6647cd9ae1bb tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:27.446395 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3a25b9fb-a40e-4b43-8745-6647cd9ae1bb tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:27.449760 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3a25b9fb-a40e-4b43-8745-6647cd9ae1bb tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:27.449760 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3a25b9fb-a40e-4b43-8745-6647cd9ae1bb tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:27.819308 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d2166bc5-21bb-46bc-aca4-726c6a1d3f2a tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6/action" status: 202 len: 0 microversion: 2.25 time: 3.952041 Aug 07 01:17:27.820806 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 926/1658] 10.222.0.39 () {62 vars in 1319 bytes} [Sun Aug 7 01:17:23 2022] POST /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6/action => generated 0 bytes in 3954 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:17:27.830867 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8a7ba380-0564-4ada-b452-701242b13b9b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:27.833147 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8a7ba380-0564-4ada-b452-701242b13b9b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: ff193541-98b3-40f6-976c-8b1c721f0bc6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:27.877936 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a7ba380-0564-4ada-b452-701242b13b9b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:27.881818 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a7ba380-0564-4ada-b452-701242b13b9b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:27.883192 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a7ba380-0564-4ada-b452-701242b13b9b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:27.888425 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a7ba380-0564-4ada-b452-701242b13b9b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:27.892022 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a7ba380-0564-4ada-b452-701242b13b9b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:27.892676 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a7ba380-0564-4ada-b452-701242b13b9b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:28.132056 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=4 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:29.133259 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3a25b9fb-a40e-4b43-8745-6647cd9ae1bb tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:29.144632 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3a25b9fb-a40e-4b43-8745-6647cd9ae1bb tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1199 microversion: 2.1 time: 1.737524 Aug 07 01:17:29.145433 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 733/1659] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:27 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1199 bytes in 1740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:29.154795 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5e2d25b5-17e3-40ef-84b6-590dbfe4fa46 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:29.156625 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5e2d25b5-17e3-40ef-84b6-590dbfe4fa46 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:29.201316 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e2d25b5-17e3-40ef-84b6-590dbfe4fa46 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:29.206908 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e2d25b5-17e3-40ef-84b6-590dbfe4fa46 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:29.208169 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e2d25b5-17e3-40ef-84b6-590dbfe4fa46 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:29.210780 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e2d25b5-17e3-40ef-84b6-590dbfe4fa46 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:29.211525 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e2d25b5-17e3-40ef-84b6-590dbfe4fa46 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:29.213772 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e2d25b5-17e3-40ef-84b6-590dbfe4fa46 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:29.298273 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8a7ba380-0564-4ada-b452-701242b13b9b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:29.318372 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8a7ba380-0564-4ada-b452-701242b13b9b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:29.320127 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8a7ba380-0564-4ada-b452-701242b13b9b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:29.333314 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8a7ba380-0564-4ada-b452-701242b13b9b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6" status: 200 len: 1568 microversion: 2.25 time: 1.506721 Aug 07 01:17:29.339489 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 927/1660] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:27 2022] GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6 => generated 1568 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:29.347776 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fb6cfe53-2b02-4694-8bad-fa11d09fb13d tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e298ee160>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:29.480017 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fb6cfe53-2b02-4694-8bad-fa11d09fb13d tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/e2ac911f-15de-4f5b-9d36-e03b3325331a" status: 200 len: 1455 microversion: 2.1 time: 0.139301 Aug 07 01:17:29.483492 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 928/1661] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:29 2022] GET /compute/v2.1/images/e2ac911f-15de-4f5b-9d36-e03b3325331a => generated 1455 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:30.171850 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f84db60b-ad91-4d08-931a-9fd01d96f7ae tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:30.173491 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f84db60b-ad91-4d08-931a-9fd01d96f7ae tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:30.187222 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f84db60b-ad91-4d08-931a-9fd01d96f7ae tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:30.190119 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f84db60b-ad91-4d08-931a-9fd01d96f7ae tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:30.191200 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f84db60b-ad91-4d08-931a-9fd01d96f7ae tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:30.192271 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f84db60b-ad91-4d08-931a-9fd01d96f7ae tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:30.193511 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f84db60b-ad91-4d08-931a-9fd01d96f7ae tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:30.194992 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f84db60b-ad91-4d08-931a-9fd01d96f7ae tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:31.195388 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5e2d25b5-17e3-40ef-84b6-590dbfe4fa46 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:31.214000 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5e2d25b5-17e3-40ef-84b6-590dbfe4fa46 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1543 microversion: 2.1 time: 2.066967 Aug 07 01:17:31.229946 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 734/1662] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:29 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1543 bytes in 2084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:31.257299 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e4224785-7225-48b0-8e83-faf75d03f38a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:31.263202 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e4224785-7225-48b0-8e83-faf75d03f38a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: ff193541-98b3-40f6-976c-8b1c721f0bc6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:31.306433 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4224785-7225-48b0-8e83-faf75d03f38a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:31.307342 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4224785-7225-48b0-8e83-faf75d03f38a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:31.307996 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4224785-7225-48b0-8e83-faf75d03f38a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:31.314135 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4224785-7225-48b0-8e83-faf75d03f38a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:31.316033 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4224785-7225-48b0-8e83-faf75d03f38a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:31.319649 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4224785-7225-48b0-8e83-faf75d03f38a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:31.634372 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f84db60b-ad91-4d08-931a-9fd01d96f7ae tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:31.661021 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f84db60b-ad91-4d08-931a-9fd01d96f7ae tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1382 microversion: 2.1 time: 1.496944 Aug 07 01:17:31.662989 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 929/1663] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:30 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1382 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:17:31.691720 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8b1b0e42-6450-46c2-a9d6-0c87e4e2d5b9 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e240bc280>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:31.784286 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8b1b0e42-6450-46c2-a9d6-0c87e4e2d5b9 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/e2ac911f-15de-4f5b-9d36-e03b3325331a" status: 200 len: 1455 microversion: 2.1 time: 0.119775 Aug 07 01:17:31.785672 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 930/1664] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:31 2022] GET /compute/v2.1/images/e2ac911f-15de-4f5b-9d36-e03b3325331a => generated 1455 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:32.419060 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fa854b28-9324-4f75-b979-046c547ace60 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:32.419770 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fa854b28-9324-4f75-b979-046c547ace60 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:32.454730 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa854b28-9324-4f75-b979-046c547ace60 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:32.455238 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa854b28-9324-4f75-b979-046c547ace60 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:32.463657 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa854b28-9324-4f75-b979-046c547ace60 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:32.465128 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa854b28-9324-4f75-b979-046c547ace60 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:32.465876 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa854b28-9324-4f75-b979-046c547ace60 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:32.466536 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa854b28-9324-4f75-b979-046c547ace60 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:32.471311 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:32.627805 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e4224785-7225-48b0-8e83-faf75d03f38a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:32.643298 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e4224785-7225-48b0-8e83-faf75d03f38a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:32.653266 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e4224785-7225-48b0-8e83-faf75d03f38a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:32.661962 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e4224785-7225-48b0-8e83-faf75d03f38a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6" status: 200 len: 1568 microversion: 2.25 time: 1.425735 Aug 07 01:17:32.665095 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 735/1665] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:31 2022] GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6 => generated 1568 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:32.680076 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ed8f0a6f-824d-4d6f-91a6-2678895903d6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:32.681054 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ed8f0a6f-824d-4d6f-91a6-2678895903d6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:32.699471 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed8f0a6f-824d-4d6f-91a6-2678895903d6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:32.714200 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed8f0a6f-824d-4d6f-91a6-2678895903d6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:32.714670 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed8f0a6f-824d-4d6f-91a6-2678895903d6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:32.724251 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed8f0a6f-824d-4d6f-91a6-2678895903d6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:32.724779 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed8f0a6f-824d-4d6f-91a6-2678895903d6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:32.725241 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed8f0a6f-824d-4d6f-91a6-2678895903d6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:33.632549 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fa854b28-9324-4f75-b979-046c547ace60 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1533 microversion: 2.1 time: 1.831033 Aug 07 01:17:33.636901 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 931/1666] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:31 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1533 bytes in 1850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:33.651501 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2f421aae-c80f-41e7-9bd3-6c1cb338d0b3 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e299ccca0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:33.724892 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2f421aae-c80f-41e7-9bd3-6c1cb338d0b3 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/e2ac911f-15de-4f5b-9d36-e03b3325331a" status: 200 len: 1455 microversion: 2.1 time: 0.086195 Aug 07 01:17:33.726551 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 932/1667] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:33 2022] GET /compute/v2.1/images/e2ac911f-15de-4f5b-9d36-e03b3325331a => generated 1455 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:33.733509 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-c8639b59-aa9f-46a4-a799-3d3008c049bd req-62026e05-7e4f-47b3-9cab-3bd998fec8c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd1e4cce-7a53-4200-a2c1-dcabbb7f9544", "name": "network-vif-unplugged", "status": "completed", "tag": "ee124f30-41ef-4d88-b49e-4ad7cac50168"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:33.749198 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c8639b59-aa9f-46a4-a799-3d3008c049bd req-62026e05-7e4f-47b3-9cab-3bd998fec8c6 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:33.750049 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c8639b59-aa9f-46a4-a799-3d3008c049bd req-62026e05-7e4f-47b3-9cab-3bd998fec8c6 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:33.750758 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c8639b59-aa9f-46a4-a799-3d3008c049bd req-62026e05-7e4f-47b3-9cab-3bd998fec8c6 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:33.771248 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-c8639b59-aa9f-46a4-a799-3d3008c049bd req-62026e05-7e4f-47b3-9cab-3bd998fec8c6 service nova] Creating event network-vif-unplugged:ee124f30-41ef-4d88-b49e-4ad7cac50168 for instance dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 on n-h2-master-1 Aug 07 01:17:33.787455 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [req-c8639b59-aa9f-46a4-a799-3d3008c049bd req-62026e05-7e4f-47b3-9cab-3bd998fec8c6 service nova] Instance dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1'} {{(pid=119516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 01:17:33.792801 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=10 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:33.804326 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-c8639b59-aa9f-46a4-a799-3d3008c049bd req-62026e05-7e4f-47b3-9cab-3bd998fec8c6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075973 Aug 07 01:17:33.815959 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 933/1668] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:17:33.830855 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-705ff3d6-a8bf-4364-b8c5-1570987b19df tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:33.834911 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-705ff3d6-a8bf-4364-b8c5-1570987b19df tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:33.854924 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-705ff3d6-a8bf-4364-b8c5-1570987b19df tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:33.857461 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-705ff3d6-a8bf-4364-b8c5-1570987b19df tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:33.858957 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-705ff3d6-a8bf-4364-b8c5-1570987b19df tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:33.864794 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-705ff3d6-a8bf-4364-b8c5-1570987b19df tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:33.866005 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-705ff3d6-a8bf-4364-b8c5-1570987b19df tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:33.867756 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-705ff3d6-a8bf-4364-b8c5-1570987b19df tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:33.914853 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ed8f0a6f-824d-4d6f-91a6-2678895903d6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:33.939779 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ed8f0a6f-824d-4d6f-91a6-2678895903d6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1542 microversion: 2.1 time: 1.273196 Aug 07 01:17:33.946001 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 736/1669] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:32 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1542 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:33.994331 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3ebae2fd-d796-4591-860d-0bc2436736cc tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:33.994966 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3ebae2fd-d796-4591-860d-0bc2436736cc tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: ff193541-98b3-40f6-976c-8b1c721f0bc6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:34.016435 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ebae2fd-d796-4591-860d-0bc2436736cc tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:34.017327 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ebae2fd-d796-4591-860d-0bc2436736cc tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:34.018099 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ebae2fd-d796-4591-860d-0bc2436736cc tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:34.024052 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ebae2fd-d796-4591-860d-0bc2436736cc tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:34.025277 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ebae2fd-d796-4591-860d-0bc2436736cc tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:34.032226 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ebae2fd-d796-4591-860d-0bc2436736cc tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:34.480120 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-705ff3d6-a8bf-4364-b8c5-1570987b19df tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1533 microversion: 2.1 time: 0.660670 Aug 07 01:17:34.485753 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 934/1670] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:33 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1533 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:34.510261 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7f00d4ba-1afe-40de-9713-6303c19b1d19 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:34.513727 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:17:34.513727 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:17:34.515485 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f00d4ba-1afe-40de-9713-6303c19b1d19 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:34.524777 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f00d4ba-1afe-40de-9713-6303c19b1d19 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:34.525236 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f00d4ba-1afe-40de-9713-6303c19b1d19 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:34.526099 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f00d4ba-1afe-40de-9713-6303c19b1d19 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:34.526564 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f00d4ba-1afe-40de-9713-6303c19b1d19 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:34.527000 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f00d4ba-1afe-40de-9713-6303c19b1d19 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:34.603673 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7f00d4ba-1afe-40de-9713-6303c19b1d19 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.093925 Aug 07 01:17:34.614880 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 935/1671] 10.222.0.39 () {58 vars in 1176 bytes} [Sun Aug 7 01:17:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:17:34.624148 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0c80133e-1304-4886-b851-934cc271ed3e tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:34.630067 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0c80133e-1304-4886-b851-934cc271ed3e tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:34.647654 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c80133e-1304-4886-b851-934cc271ed3e tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:34.651276 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c80133e-1304-4886-b851-934cc271ed3e tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:34.652035 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c80133e-1304-4886-b851-934cc271ed3e tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:34.654606 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c80133e-1304-4886-b851-934cc271ed3e tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:34.658114 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c80133e-1304-4886-b851-934cc271ed3e tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:34.658854 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c80133e-1304-4886-b851-934cc271ed3e tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:34.698191 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-0c80133e-1304-4886-b851-934cc271ed3e tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lazy-loading 'flavor' on Instance uuid 2e006496-fa0b-4e7a-8c5d-a3724b172720 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:17:34.720647 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0c80133e-1304-4886-b851-934cc271ed3e tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Going to try to live migrate instance to n-h1-master-1 {{(pid=119516) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 07 01:17:35.675524 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3ebae2fd-d796-4591-860d-0bc2436736cc tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:35.691592 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3ebae2fd-d796-4591-860d-0bc2436736cc tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:35.696235 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3ebae2fd-d796-4591-860d-0bc2436736cc tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:35.702303 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3ebae2fd-d796-4591-860d-0bc2436736cc tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6" status: 200 len: 1568 microversion: 2.25 time: 1.729152 Aug 07 01:17:35.703710 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 737/1672] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:33 2022] GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6 => generated 1568 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:35.717816 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1bcbabf6-45db-46be-ae5a-70599272d0d4 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e24236280>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:35.827694 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1bcbabf6-45db-46be-ae5a-70599272d0d4 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/e2ac911f-15de-4f5b-9d36-e03b3325331a" status: 200 len: 1455 microversion: 2.1 time: 0.120569 Aug 07 01:17:35.828578 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 738/1673] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:35 2022] GET /compute/v2.1/images/e2ac911f-15de-4f5b-9d36-e03b3325331a => generated 1455 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:35.834049 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1bf33983-f242-4b82-b1d4-84e02f5d2a73 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:35.834764 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1bf33983-f242-4b82-b1d4-84e02f5d2a73 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:35.882677 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1bf33983-f242-4b82-b1d4-84e02f5d2a73 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:35.883472 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1bf33983-f242-4b82-b1d4-84e02f5d2a73 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:35.892303 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1bf33983-f242-4b82-b1d4-84e02f5d2a73 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:35.897714 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1bf33983-f242-4b82-b1d4-84e02f5d2a73 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:35.902461 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1bf33983-f242-4b82-b1d4-84e02f5d2a73 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:35.904411 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1bf33983-f242-4b82-b1d4-84e02f5d2a73 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:36.011996 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:37.261037 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1bf33983-f242-4b82-b1d4-84e02f5d2a73 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:37.287328 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1bf33983-f242-4b82-b1d4-84e02f5d2a73 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1474 microversion: 2.1 time: 1.457299 Aug 07 01:17:37.313510 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 739/1674] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:35 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1474 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:37.320241 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-dcc69393-5654-4544-9cf9-327f58c23a75 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:37.330030 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-dcc69393-5654-4544-9cf9-327f58c23a75 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: ff193541-98b3-40f6-976c-8b1c721f0bc6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:37.351715 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dcc69393-5654-4544-9cf9-327f58c23a75 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:37.352269 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dcc69393-5654-4544-9cf9-327f58c23a75 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:37.352719 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dcc69393-5654-4544-9cf9-327f58c23a75 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:37.353454 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dcc69393-5654-4544-9cf9-327f58c23a75 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:37.353913 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dcc69393-5654-4544-9cf9-327f58c23a75 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:37.358077 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dcc69393-5654-4544-9cf9-327f58c23a75 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:38.121483 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-dcc69393-5654-4544-9cf9-327f58c23a75 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:38.163674 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-dcc69393-5654-4544-9cf9-327f58c23a75 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:38.169161 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-dcc69393-5654-4544-9cf9-327f58c23a75 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:38.176834 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-dcc69393-5654-4544-9cf9-327f58c23a75 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6" status: 200 len: 1568 microversion: 2.25 time: 0.874424 Aug 07 01:17:38.181434 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 740/1675] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:37 2022] GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6 => generated 1568 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:38.193895 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ddae600c-14e3-462e-9460-3d63f7e67718 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e240d75e0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:38.339614 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ddae600c-14e3-462e-9460-3d63f7e67718 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/e2ac911f-15de-4f5b-9d36-e03b3325331a" status: 200 len: 1455 microversion: 2.1 time: 0.156571 Aug 07 01:17:38.343058 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 741/1676] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:38 2022] GET /compute/v2.1/images/e2ac911f-15de-4f5b-9d36-e03b3325331a => generated 1455 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:38.364579 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-75ec14fc-3763-4e0c-9af9-9987479768e5 req-4e39d408-adba-49cd-968a-8d85aa6c17a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff193541-98b3-40f6-976c-8b1c721f0bc6", "name": "network-vif-unplugged", "status": "completed", "tag": "0f90fd6b-35f9-4ef7-a7f1-72ecb34de724"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:38.431383 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-75ec14fc-3763-4e0c-9af9-9987479768e5 req-4e39d408-adba-49cd-968a-8d85aa6c17a6 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:38.432696 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-75ec14fc-3763-4e0c-9af9-9987479768e5 req-4e39d408-adba-49cd-968a-8d85aa6c17a6 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:38.434789 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-75ec14fc-3763-4e0c-9af9-9987479768e5 req-4e39d408-adba-49cd-968a-8d85aa6c17a6 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:38.491920 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-75ec14fc-3763-4e0c-9af9-9987479768e5 req-4e39d408-adba-49cd-968a-8d85aa6c17a6 service nova] Creating event network-vif-unplugged:0f90fd6b-35f9-4ef7-a7f1-72ecb34de724 for instance ff193541-98b3-40f6-976c-8b1c721f0bc6 on n-h1-master-1 Aug 07 01:17:38.501126 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-75ec14fc-3763-4e0c-9af9-9987479768e5 req-4e39d408-adba-49cd-968a-8d85aa6c17a6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.155357 Aug 07 01:17:38.503355 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 742/1677] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:17:38.509144 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9ca5e123-0050-49f8-b95e-e17d82965be0 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:38.522709 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9ca5e123-0050-49f8-b95e-e17d82965be0 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:38.544625 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ca5e123-0050-49f8-b95e-e17d82965be0 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:38.545429 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ca5e123-0050-49f8-b95e-e17d82965be0 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:38.546042 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ca5e123-0050-49f8-b95e-e17d82965be0 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:38.546964 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ca5e123-0050-49f8-b95e-e17d82965be0 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:38.547607 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ca5e123-0050-49f8-b95e-e17d82965be0 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:38.548237 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ca5e123-0050-49f8-b95e-e17d82965be0 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:39.808945 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9ca5e123-0050-49f8-b95e-e17d82965be0 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:39.824005 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9ca5e123-0050-49f8-b95e-e17d82965be0 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1471 microversion: 2.1 time: 1.318758 Aug 07 01:17:39.829981 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 743/1678] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:38 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1471 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:39.848718 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5d0fba69-91de-41f6-a369-e81ded806507 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:39.857461 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5d0fba69-91de-41f6-a369-e81ded806507 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: ff193541-98b3-40f6-976c-8b1c721f0bc6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:39.885154 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d0fba69-91de-41f6-a369-e81ded806507 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:39.887775 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d0fba69-91de-41f6-a369-e81ded806507 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:39.890682 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d0fba69-91de-41f6-a369-e81ded806507 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:39.891633 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d0fba69-91de-41f6-a369-e81ded806507 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:39.894102 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d0fba69-91de-41f6-a369-e81ded806507 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:39.894866 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d0fba69-91de-41f6-a369-e81ded806507 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:41.035376 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5d0fba69-91de-41f6-a369-e81ded806507 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:41.090400 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5d0fba69-91de-41f6-a369-e81ded806507 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:41.115918 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5d0fba69-91de-41f6-a369-e81ded806507 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:41.122777 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5d0fba69-91de-41f6-a369-e81ded806507 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6" status: 200 len: 1568 microversion: 2.25 time: 1.291359 Aug 07 01:17:41.131091 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 744/1679] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:39 2022] GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6 => generated 1568 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:41.174485 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-dcc2eb1d-e672-4cda-986b-29ed4f719209 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e24a724c0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:41.305625 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-dcc2eb1d-e672-4cda-986b-29ed4f719209 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/e2ac911f-15de-4f5b-9d36-e03b3325331a" status: 200 len: 1455 microversion: 2.1 time: 0.170959 Aug 07 01:17:41.307046 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 745/1680] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:41 2022] GET /compute/v2.1/images/e2ac911f-15de-4f5b-9d36-e03b3325331a => generated 1455 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:41.314257 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b6f31104-7939-428c-b0f0-92248f302267 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:41.315432 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b6f31104-7939-428c-b0f0-92248f302267 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:41.327557 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b6f31104-7939-428c-b0f0-92248f302267 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:41.328838 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b6f31104-7939-428c-b0f0-92248f302267 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:41.329672 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b6f31104-7939-428c-b0f0-92248f302267 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:41.330696 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b6f31104-7939-428c-b0f0-92248f302267 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:41.332235 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b6f31104-7939-428c-b0f0-92248f302267 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:41.332961 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b6f31104-7939-428c-b0f0-92248f302267 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:41.483304 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b6f31104-7939-428c-b0f0-92248f302267 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:41.485350 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b6f31104-7939-428c-b0f0-92248f302267 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:41.486979 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b6f31104-7939-428c-b0f0-92248f302267 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:41.488437 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b6f31104-7939-428c-b0f0-92248f302267 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:41.489156 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b6f31104-7939-428c-b0f0-92248f302267 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:41.489780 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b6f31104-7939-428c-b0f0-92248f302267 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:41.571468 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-b6f31104-7939-428c-b0f0-92248f302267 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Getting quotas for project 1911abc893ef4c01aa80ca9079dea6e9. Resources: {'ram', 'cores'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:17:41.582729 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-b6f31104-7939-428c-b0f0-92248f302267 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Getting quotas for user b945db9a6f7a4143a544b76be5e9af9f and project 1911abc893ef4c01aa80ca9079dea6e9. Resources: {'ram', 'cores'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:17:41.828683 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b6f31104-7939-428c-b0f0-92248f302267 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "POST /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544/action" status: 202 len: 0 microversion: 2.1 time: 0.505156 Aug 07 01:17:41.841854 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 746/1681] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:17:41 2022] POST /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544/action => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:17:41.854776 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-1162d331-171b-4452-8cce-18ece917fb12 req-f5384594-3c5a-41ce-a45d-035cd866c3b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff193541-98b3-40f6-976c-8b1c721f0bc6", "tag": "0f90fd6b-35f9-4ef7-a7f1-72ecb34de724"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:41.875557 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-1162d331-171b-4452-8cce-18ece917fb12 req-f5384594-3c5a-41ce-a45d-035cd866c3b1 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:41.876431 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-1162d331-171b-4452-8cce-18ece917fb12 req-f5384594-3c5a-41ce-a45d-035cd866c3b1 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:41.877179 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-1162d331-171b-4452-8cce-18ece917fb12 req-f5384594-3c5a-41ce-a45d-035cd866c3b1 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:41.911765 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-1162d331-171b-4452-8cce-18ece917fb12 req-f5384594-3c5a-41ce-a45d-035cd866c3b1 service nova] Creating event network-changed:0f90fd6b-35f9-4ef7-a7f1-72ecb34de724 for instance ff193541-98b3-40f6-976c-8b1c721f0bc6 on n-h1-master-1 Aug 07 01:17:41.933101 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-1162d331-171b-4452-8cce-18ece917fb12 req-f5384594-3c5a-41ce-a45d-035cd866c3b1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086663 Aug 07 01:17:41.937319 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 747/1682] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:17:41.997864 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0c80133e-1304-4886-b851-934cc271ed3e tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720/action" status: 202 len: 0 microversion: 2.1 time: 7.380336 Aug 07 01:17:42.005560 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 936/1683] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:17:34 2022] POST /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720/action => generated 0 bytes in 7390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:17:42.011473 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2b93ae58-7f40-4c27-b15c-fdfa234549db tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:42.012212 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2b93ae58-7f40-4c27-b15c-fdfa234549db tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:42.043659 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:42.049421 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2b93ae58-7f40-4c27-b15c-fdfa234549db tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:42.052006 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2b93ae58-7f40-4c27-b15c-fdfa234549db tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:42.053898 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2b93ae58-7f40-4c27-b15c-fdfa234549db tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:42.055084 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2b93ae58-7f40-4c27-b15c-fdfa234549db tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:42.056311 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2b93ae58-7f40-4c27-b15c-fdfa234549db tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:42.058320 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2b93ae58-7f40-4c27-b15c-fdfa234549db tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:42.335583 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d665adf7-fc54-4e32-bd4e-6a65032fb2e8 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1336653084", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "522f3ba8-208f-4b14-93bb-7dc525ec6e60"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:42.464645 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-d665adf7-fc54-4e32-bd4e-6a65032fb2e8 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] validate_networks() for [('522f3ba8-208f-4b14-93bb-7dc525ec6e60', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:17:42.861562 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2b93ae58-7f40-4c27-b15c-fdfa234549db tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:42.870984 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2b93ae58-7f40-4c27-b15c-fdfa234549db tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1470 microversion: 2.1 time: 0.864040 Aug 07 01:17:42.894832 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 937/1684] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:42 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1470 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:42.909918 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3a7d25f1-cc78-4703-923c-fc76356df9dc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:42.910946 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3a7d25f1-cc78-4703-923c-fc76356df9dc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:42.925030 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a7d25f1-cc78-4703-923c-fc76356df9dc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:42.939673 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a7d25f1-cc78-4703-923c-fc76356df9dc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:42.957247 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a7d25f1-cc78-4703-923c-fc76356df9dc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:42.960243 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a7d25f1-cc78-4703-923c-fc76356df9dc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:42.965233 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a7d25f1-cc78-4703-923c-fc76356df9dc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:42.965716 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a7d25f1-cc78-4703-923c-fc76356df9dc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:43.594558 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3a7d25f1-cc78-4703-923c-fc76356df9dc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:43.633882 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3a7d25f1-cc78-4703-923c-fc76356df9dc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1392 microversion: 2.1 time: 0.737228 Aug 07 01:17:43.644333 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 938/1685] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:42 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1392 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:43.658837 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9746df6e-6c76-4d97-89a7-aed72c98e413 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:43.669290 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9746df6e-6c76-4d97-89a7-aed72c98e413 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: ff193541-98b3-40f6-976c-8b1c721f0bc6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:43.688966 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9746df6e-6c76-4d97-89a7-aed72c98e413 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:43.689461 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9746df6e-6c76-4d97-89a7-aed72c98e413 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:43.689902 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9746df6e-6c76-4d97-89a7-aed72c98e413 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:43.690678 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9746df6e-6c76-4d97-89a7-aed72c98e413 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:43.691134 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9746df6e-6c76-4d97-89a7-aed72c98e413 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:43.691560 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9746df6e-6c76-4d97-89a7-aed72c98e413 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:44.566809 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:44.888204 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-d665adf7-fc54-4e32-bd4e-6a65032fb2e8 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:17:44.888785 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-d665adf7-fc54-4e32-bd4e-6a65032fb2e8 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:17:44.889372 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-d665adf7-fc54-4e32-bd4e-6a65032fb2e8 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:17:44.889901 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-d665adf7-fc54-4e32-bd4e-6a65032fb2e8 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:17:44.890581 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-d665adf7-fc54-4e32-bd4e-6a65032fb2e8 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:17:44.926659 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d665adf7-fc54-4e32-bd4e-6a65032fb2e8 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:44.927470 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d665adf7-fc54-4e32-bd4e-6a65032fb2e8 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:44.932261 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d665adf7-fc54-4e32-bd4e-6a65032fb2e8 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:44.935365 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d665adf7-fc54-4e32-bd4e-6a65032fb2e8 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:44.942794 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d665adf7-fc54-4e32-bd4e-6a65032fb2e8 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:44.943404 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d665adf7-fc54-4e32-bd4e-6a65032fb2e8 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:45.054898 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-d665adf7-fc54-4e32-bd4e-6a65032fb2e8 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Getting quotas for project 4b4cbb3c65be44668687983c0a76901c. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:17:45.104322 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-d665adf7-fc54-4e32-bd4e-6a65032fb2e8 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Getting quotas for user 4a359309c39a49c98f1f7aea48189efa and project 4b4cbb3c65be44668687983c0a76901c. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:17:45.152408 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d665adf7-fc54-4e32-bd4e-6a65032fb2e8 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:17:45.157391 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d665adf7-fc54-4e32-bd4e-6a65032fb2e8 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d44d731f-5443-4a7c-9a8d-8e330fd1639d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:17:45.318511 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d665adf7-fc54-4e32-bd4e-6a65032fb2e8 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.364779 Aug 07 01:17:45.327813 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 748/1686] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:17:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 3384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:17:45.353225 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0b7203f0-80c5-47f4-94f4-85cc893534d7 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e24018670>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:45.523343 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0b7203f0-80c5-47f4-94f4-85cc893534d7 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/e2ac911f-15de-4f5b-9d36-e03b3325331a" status: 200 len: 1455 microversion: 2.1 time: 0.192201 Aug 07 01:17:45.533182 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 749/1687] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:45 2022] GET /compute/v2.1/images/e2ac911f-15de-4f5b-9d36-e03b3325331a => generated 1455 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:45.550617 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-71cceb06-0b1a-4fda-8269-1b6f2cc0f3f3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:45.554030 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-71cceb06-0b1a-4fda-8269-1b6f2cc0f3f3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:45.578807 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-71cceb06-0b1a-4fda-8269-1b6f2cc0f3f3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:45.579580 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-71cceb06-0b1a-4fda-8269-1b6f2cc0f3f3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:45.580333 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-71cceb06-0b1a-4fda-8269-1b6f2cc0f3f3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:45.583707 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-71cceb06-0b1a-4fda-8269-1b6f2cc0f3f3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:45.588065 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-71cceb06-0b1a-4fda-8269-1b6f2cc0f3f3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:45.588807 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-71cceb06-0b1a-4fda-8269-1b6f2cc0f3f3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:46.207148 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9746df6e-6c76-4d97-89a7-aed72c98e413 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:46.243270 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9746df6e-6c76-4d97-89a7-aed72c98e413 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:46.257157 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9746df6e-6c76-4d97-89a7-aed72c98e413 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:46.267719 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9746df6e-6c76-4d97-89a7-aed72c98e413 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6" status: 200 len: 1568 microversion: 2.25 time: 2.627861 Aug 07 01:17:46.273028 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 939/1688] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:43 2022] GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6 => generated 1568 bytes in 2636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:46.305236 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2b942f84-3200-4c33-b267-705a49745b50 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:46.306086 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2b942f84-3200-4c33-b267-705a49745b50 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:46.330089 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2b942f84-3200-4c33-b267-705a49745b50 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:46.337255 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2b942f84-3200-4c33-b267-705a49745b50 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:46.346163 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2b942f84-3200-4c33-b267-705a49745b50 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:46.350772 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2b942f84-3200-4c33-b267-705a49745b50 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:46.356586 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2b942f84-3200-4c33-b267-705a49745b50 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:46.361918 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2b942f84-3200-4c33-b267-705a49745b50 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:46.583435 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-71cceb06-0b1a-4fda-8269-1b6f2cc0f3f3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:46.615077 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-71cceb06-0b1a-4fda-8269-1b6f2cc0f3f3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1470 microversion: 2.1 time: 1.074706 Aug 07 01:17:46.617308 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 750/1689] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:45 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1470 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:46.665473 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ebb00dc6-cbb7-4562-a2c5-a8e4663b24c0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:46.668401 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ebb00dc6-cbb7-4562-a2c5-a8e4663b24c0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d44d731f-5443-4a7c-9a8d-8e330fd1639d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:46.689288 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:46.908870 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ebb00dc6-cbb7-4562-a2c5-a8e4663b24c0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:46.920976 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ebb00dc6-cbb7-4562-a2c5-a8e4663b24c0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d" status: 200 len: 1218 microversion: 2.1 time: 0.294471 Aug 07 01:17:46.922459 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 751/1690] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:46 2022] GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d => generated 1218 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:46.939718 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-08f83ad4-b244-4e1e-909c-791183446b21 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e2407d5e0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:47.026798 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-08f83ad4-b244-4e1e-909c-791183446b21 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/e2ac911f-15de-4f5b-9d36-e03b3325331a" status: 200 len: 1464 microversion: 2.1 time: 0.102904 Aug 07 01:17:47.028439 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 752/1691] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:46 2022] GET /compute/v2.1/images/e2ac911f-15de-4f5b-9d36-e03b3325331a => generated 1464 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:47.053098 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3fcfab42-f98c-43cf-9897-825e6fdba95d tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e2407d430>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:47.121977 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3fcfab42-f98c-43cf-9897-825e6fdba95d tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/e2ac911f-15de-4f5b-9d36-e03b3325331a" status: 200 len: 1464 microversion: 2.1 time: 0.081595 Aug 07 01:17:47.123210 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 753/1692] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:47 2022] GET /compute/v2.1/images/e2ac911f-15de-4f5b-9d36-e03b3325331a => generated 1464 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:47.139766 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d38b24cd-7cd6-4028-be79-479bf539788e tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:47.140562 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d38b24cd-7cd6-4028-be79-479bf539788e tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] [instance: d2dbfd1a-efab-4943-b00a-6cdd1051489c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:47.168243 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d38b24cd-7cd6-4028-be79-479bf539788e tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:47.170893 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d38b24cd-7cd6-4028-be79-479bf539788e tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:47.173079 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d38b24cd-7cd6-4028-be79-479bf539788e tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:47.175581 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d38b24cd-7cd6-4028-be79-479bf539788e tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:47.178675 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d38b24cd-7cd6-4028-be79-479bf539788e tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:47.179249 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d38b24cd-7cd6-4028-be79-479bf539788e tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:47.424291 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2b942f84-3200-4c33-b267-705a49745b50 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:47.437765 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2b942f84-3200-4c33-b267-705a49745b50 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1392 microversion: 2.1 time: 1.160856 Aug 07 01:17:47.446186 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 940/1693] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:46 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1392 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:47.451579 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d838db67-e659-4b47-9057-ff6f204b172a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:47.452223 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d838db67-e659-4b47-9057-ff6f204b172a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: ff193541-98b3-40f6-976c-8b1c721f0bc6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:47.468741 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d838db67-e659-4b47-9057-ff6f204b172a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:47.471294 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d838db67-e659-4b47-9057-ff6f204b172a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:47.473550 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d838db67-e659-4b47-9057-ff6f204b172a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:47.475510 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d838db67-e659-4b47-9057-ff6f204b172a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:47.477065 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d838db67-e659-4b47-9057-ff6f204b172a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:47.478645 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d838db67-e659-4b47-9057-ff6f204b172a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:47.734449 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d38b24cd-7cd6-4028-be79-479bf539788e tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '786962988b754fb69bd48070c2992e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614797cd26be4995b087ab864f35d235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:47.747202 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d38b24cd-7cd6-4028-be79-479bf539788e tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/servers/d2dbfd1a-efab-4943-b00a-6cdd1051489c" status: 200 len: 1479 microversion: 2.1 time: 0.611697 Aug 07 01:17:47.761457 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 754/1694] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:47 2022] GET /compute/v2.1/servers/d2dbfd1a-efab-4943-b00a-6cdd1051489c => generated 1479 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:17:47.779092 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-38820f51-3252-4e57-bd4a-a7b665a5bb50 req-3756f13d-8261-4f7d-a649-839ac8c98a52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd1e4cce-7a53-4200-a2c1-dcabbb7f9544", "name": "network-vif-plugged", "status": "completed", "tag": "ee124f30-41ef-4d88-b49e-4ad7cac50168"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:47.810802 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-38820f51-3252-4e57-bd4a-a7b665a5bb50 req-3756f13d-8261-4f7d-a649-839ac8c98a52 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:47.811373 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-38820f51-3252-4e57-bd4a-a7b665a5bb50 req-3756f13d-8261-4f7d-a649-839ac8c98a52 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:47.811706 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-38820f51-3252-4e57-bd4a-a7b665a5bb50 req-3756f13d-8261-4f7d-a649-839ac8c98a52 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:47.872953 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-38820f51-3252-4e57-bd4a-a7b665a5bb50 req-3756f13d-8261-4f7d-a649-839ac8c98a52 service nova] Creating event network-vif-plugged:ee124f30-41ef-4d88-b49e-4ad7cac50168 for instance dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 on n-h2-master-1 Aug 07 01:17:47.904209 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [req-38820f51-3252-4e57-bd4a-a7b665a5bb50 req-3756f13d-8261-4f7d-a649-839ac8c98a52 service nova] Instance dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1'} {{(pid=119517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 01:17:47.986689 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-38820f51-3252-4e57-bd4a-a7b665a5bb50 req-3756f13d-8261-4f7d-a649-839ac8c98a52 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.213242 Aug 07 01:17:47.995682 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 755/1695] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:17:48.016669 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a3c67fbf-9ffe-4549-9495-ef298a1b74b1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:48.025034 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a3c67fbf-9ffe-4549-9495-ef298a1b74b1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:48.043672 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3c67fbf-9ffe-4549-9495-ef298a1b74b1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:48.045587 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3c67fbf-9ffe-4549-9495-ef298a1b74b1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:48.046251 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3c67fbf-9ffe-4549-9495-ef298a1b74b1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:48.047342 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3c67fbf-9ffe-4549-9495-ef298a1b74b1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:48.048018 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3c67fbf-9ffe-4549-9495-ef298a1b74b1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:48.048630 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3c67fbf-9ffe-4549-9495-ef298a1b74b1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:48.260399 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d838db67-e659-4b47-9057-ff6f204b172a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:48.288452 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d838db67-e659-4b47-9057-ff6f204b172a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:48.295301 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d838db67-e659-4b47-9057-ff6f204b172a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:48.300609 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d838db67-e659-4b47-9057-ff6f204b172a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6" status: 200 len: 1568 microversion: 2.25 time: 0.852624 Aug 07 01:17:48.301446 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 941/1696] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:47 2022] GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6 => generated 1568 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:48.308343 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e1f2f5ff-866c-49c3-ae13-5a7f53f4cbfd tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:48.327209 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e1f2f5ff-866c-49c3-ae13-5a7f53f4cbfd tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d44d731f-5443-4a7c-9a8d-8e330fd1639d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:48.343682 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1f2f5ff-866c-49c3-ae13-5a7f53f4cbfd tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:48.344226 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1f2f5ff-866c-49c3-ae13-5a7f53f4cbfd tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:48.345726 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1f2f5ff-866c-49c3-ae13-5a7f53f4cbfd tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:48.346484 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1f2f5ff-866c-49c3-ae13-5a7f53f4cbfd tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:48.351213 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1f2f5ff-866c-49c3-ae13-5a7f53f4cbfd tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:48.353700 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1f2f5ff-866c-49c3-ae13-5a7f53f4cbfd tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:49.096518 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e1f2f5ff-866c-49c3-ae13-5a7f53f4cbfd tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:49.107775 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e1f2f5ff-866c-49c3-ae13-5a7f53f4cbfd tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d" status: 200 len: 1270 microversion: 2.1 time: 0.805065 Aug 07 01:17:49.112236 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 942/1697] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:48 2022] GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d => generated 1270 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:49.141801 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ac41bac4-2b13-4ab2-b0e2-fa479ba2ef1b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:49.145031 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ac41bac4-2b13-4ab2-b0e2-fa479ba2ef1b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:49.166074 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac41bac4-2b13-4ab2-b0e2-fa479ba2ef1b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:49.166574 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac41bac4-2b13-4ab2-b0e2-fa479ba2ef1b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:49.167010 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac41bac4-2b13-4ab2-b0e2-fa479ba2ef1b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:49.172980 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac41bac4-2b13-4ab2-b0e2-fa479ba2ef1b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:49.173475 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac41bac4-2b13-4ab2-b0e2-fa479ba2ef1b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:49.173912 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac41bac4-2b13-4ab2-b0e2-fa479ba2ef1b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:49.522395 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a3c67fbf-9ffe-4549-9495-ef298a1b74b1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:49.543592 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a3c67fbf-9ffe-4549-9495-ef298a1b74b1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1470 microversion: 2.1 time: 1.543783 Aug 07 01:17:49.553245 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 756/1698] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:47 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1470 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:49.562681 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-37366a77-0944-4b71-a3de-18e22dd59f66 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:49.563947 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-37366a77-0944-4b71-a3de-18e22dd59f66 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] [instance: d2dbfd1a-efab-4943-b00a-6cdd1051489c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:49.597834 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37366a77-0944-4b71-a3de-18e22dd59f66 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:49.598625 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37366a77-0944-4b71-a3de-18e22dd59f66 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:49.598976 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37366a77-0944-4b71-a3de-18e22dd59f66 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:49.599777 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37366a77-0944-4b71-a3de-18e22dd59f66 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:49.600303 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37366a77-0944-4b71-a3de-18e22dd59f66 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:49.600740 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37366a77-0944-4b71-a3de-18e22dd59f66 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:49.775618 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ac41bac4-2b13-4ab2-b0e2-fa479ba2ef1b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:49.840572 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ac41bac4-2b13-4ab2-b0e2-fa479ba2ef1b tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1392 microversion: 2.1 time: 0.678758 Aug 07 01:17:49.841365 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 943/1699] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:49 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1392 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:49.850949 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-05e3c834-9f2e-4f4d-a5fa-cc82a96a1bc1 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:49.855861 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-05e3c834-9f2e-4f4d-a5fa-cc82a96a1bc1 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: ff193541-98b3-40f6-976c-8b1c721f0bc6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:49.885555 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05e3c834-9f2e-4f4d-a5fa-cc82a96a1bc1 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:49.889822 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05e3c834-9f2e-4f4d-a5fa-cc82a96a1bc1 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:49.893023 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05e3c834-9f2e-4f4d-a5fa-cc82a96a1bc1 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:49.895538 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05e3c834-9f2e-4f4d-a5fa-cc82a96a1bc1 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:49.898980 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05e3c834-9f2e-4f4d-a5fa-cc82a96a1bc1 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:49.900016 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05e3c834-9f2e-4f4d-a5fa-cc82a96a1bc1 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:50.231837 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-37366a77-0944-4b71-a3de-18e22dd59f66 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '786962988b754fb69bd48070c2992e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614797cd26be4995b087ab864f35d235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:50.254680 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-37366a77-0944-4b71-a3de-18e22dd59f66 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/servers/d2dbfd1a-efab-4943-b00a-6cdd1051489c" status: 200 len: 1466 microversion: 2.1 time: 0.699717 Aug 07 01:17:50.255555 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 757/1700] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:49 2022] GET /compute/v2.1/servers/d2dbfd1a-efab-4943-b00a-6cdd1051489c => generated 1466 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:50.272913 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e1c19e12-dcf0-4af4-a514-844f1afbe937 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:50.273830 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e1c19e12-dcf0-4af4-a514-844f1afbe937 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d44d731f-5443-4a7c-9a8d-8e330fd1639d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:50.294536 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1c19e12-dcf0-4af4-a514-844f1afbe937 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:50.296646 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1c19e12-dcf0-4af4-a514-844f1afbe937 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:50.298477 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1c19e12-dcf0-4af4-a514-844f1afbe937 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:50.313024 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1c19e12-dcf0-4af4-a514-844f1afbe937 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:50.314436 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1c19e12-dcf0-4af4-a514-844f1afbe937 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:50.317085 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1c19e12-dcf0-4af4-a514-844f1afbe937 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:50.568558 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e1c19e12-dcf0-4af4-a514-844f1afbe937 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:50.581029 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e1c19e12-dcf0-4af4-a514-844f1afbe937 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d" status: 200 len: 1276 microversion: 2.1 time: 0.324012 Aug 07 01:17:50.586138 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 758/1701] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:50 2022] GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d => generated 1276 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:50.593805 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-14e0b5b7-c603-4e49-822c-87af2f3e2986 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-246666532"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:50.598043 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-14e0b5b7-c603-4e49-822c-87af2f3e2986 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] [instance: 9e2ae24f-8349-46d5-b091-876927d02b68] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:50.611070 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-14e0b5b7-c603-4e49-822c-87af2f3e2986 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:50.612975 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-14e0b5b7-c603-4e49-822c-87af2f3e2986 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:50.613519 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-14e0b5b7-c603-4e49-822c-87af2f3e2986 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:50.614266 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-14e0b5b7-c603-4e49-822c-87af2f3e2986 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:50.614726 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-14e0b5b7-c603-4e49-822c-87af2f3e2986 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:50.615290 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-14e0b5b7-c603-4e49-822c-87af2f3e2986 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:50.809285 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-05e3c834-9f2e-4f4d-a5fa-cc82a96a1bc1 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:50.834504 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-05e3c834-9f2e-4f4d-a5fa-cc82a96a1bc1 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:50.841956 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-05e3c834-9f2e-4f4d-a5fa-cc82a96a1bc1 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:50.846103 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-05e3c834-9f2e-4f4d-a5fa-cc82a96a1bc1 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6" status: 200 len: 1568 microversion: 2.25 time: 1.002470 Aug 07 01:17:50.850407 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 944/1702] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:49 2022] GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6 => generated 1568 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:50.878958 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-9cd168c0-2341-4c87-830a-8dbbd27e4a26 req-eb3fd43c-2472-436e-bc2b-c17b9f16587f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2dbfd1a-efab-4943-b00a-6cdd1051489c", "name": "network-vif-unplugged", "status": "completed", "tag": "05c06eb8-fc76-4d4a-bf23-b4a1dd7229f7"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:50.925988 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-9cd168c0-2341-4c87-830a-8dbbd27e4a26 req-eb3fd43c-2472-436e-bc2b-c17b9f16587f service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:50.926769 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-9cd168c0-2341-4c87-830a-8dbbd27e4a26 req-eb3fd43c-2472-436e-bc2b-c17b9f16587f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:50.927385 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-9cd168c0-2341-4c87-830a-8dbbd27e4a26 req-eb3fd43c-2472-436e-bc2b-c17b9f16587f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:50.954209 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-9cd168c0-2341-4c87-830a-8dbbd27e4a26 req-eb3fd43c-2472-436e-bc2b-c17b9f16587f service nova] Creating event network-vif-unplugged:05c06eb8-fc76-4d4a-bf23-b4a1dd7229f7 for instance d2dbfd1a-efab-4943-b00a-6cdd1051489c on n-h1-master-1 Aug 07 01:17:50.965616 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-9cd168c0-2341-4c87-830a-8dbbd27e4a26 req-eb3fd43c-2472-436e-bc2b-c17b9f16587f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112502 Aug 07 01:17:50.966232 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 945/1703] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:17:50.976203 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1d496382-3158-4375-a854-5c1439ccccca tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:50.976968 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1d496382-3158-4375-a854-5c1439ccccca tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:51.012029 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d496382-3158-4375-a854-5c1439ccccca tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:51.012418 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d496382-3158-4375-a854-5c1439ccccca tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:51.015875 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d496382-3158-4375-a854-5c1439ccccca tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:51.016927 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d496382-3158-4375-a854-5c1439ccccca tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:51.017578 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d496382-3158-4375-a854-5c1439ccccca tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:51.018185 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d496382-3158-4375-a854-5c1439ccccca tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:51.024080 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:51.062297 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-14e0b5b7-c603-4e49-822c-87af2f3e2986 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "POST /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68/action" status: 202 len: 0 microversion: 2.1 time: 0.472760 Aug 07 01:17:51.074739 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 759/1704] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:17:50 2022] POST /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68/action => generated 0 bytes in 486 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 07 01:17:51.084686 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5e2f9ad8-8d43-4f97-ad71-5855db4604d4 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:51.086954 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5e2f9ad8-8d43-4f97-ad71-5855db4604d4 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:51.107391 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e2f9ad8-8d43-4f97-ad71-5855db4604d4 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:51.108749 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e2f9ad8-8d43-4f97-ad71-5855db4604d4 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:51.113526 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e2f9ad8-8d43-4f97-ad71-5855db4604d4 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:51.128252 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e2f9ad8-8d43-4f97-ad71-5855db4604d4 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:51.131323 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e2f9ad8-8d43-4f97-ad71-5855db4604d4 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:51.133305 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e2f9ad8-8d43-4f97-ad71-5855db4604d4 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:52.151222 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1d496382-3158-4375-a854-5c1439ccccca tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:52.167757 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1d496382-3158-4375-a854-5c1439ccccca tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1536 microversion: 2.1 time: 1.194815 Aug 07 01:17:52.167757 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 946/1705] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:50 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1536 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:52.180173 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8c266204-7805-4496-8af3-20bb4b9429ce tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e2408db80>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:52.272097 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5e2f9ad8-8d43-4f97-ad71-5855db4604d4 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:52.298079 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5e2f9ad8-8d43-4f97-ad71-5855db4604d4 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1392 microversion: 2.1 time: 1.221666 Aug 07 01:17:52.302742 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 760/1706] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:51 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1392 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:52.304130 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8c266204-7805-4496-8af3-20bb4b9429ce tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/628a7b3a-d5f5-4d29-9524-17454a5cfe53" status: 200 len: 1454 microversion: 2.1 time: 0.132787 Aug 07 01:17:52.306679 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 947/1707] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:52 2022] GET /compute/v2.1/images/628a7b3a-d5f5-4d29-9524-17454a5cfe53 => generated 1454 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:52.332400 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-52d058b9-cabb-4492-8876-2cd7fe229349 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:52.338129 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-52d058b9-cabb-4492-8876-2cd7fe229349 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d44d731f-5443-4a7c-9a8d-8e330fd1639d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:52.365448 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52d058b9-cabb-4492-8876-2cd7fe229349 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:52.366402 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52d058b9-cabb-4492-8876-2cd7fe229349 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:52.367144 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52d058b9-cabb-4492-8876-2cd7fe229349 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:52.371181 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52d058b9-cabb-4492-8876-2cd7fe229349 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:52.375302 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52d058b9-cabb-4492-8876-2cd7fe229349 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:52.376179 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52d058b9-cabb-4492-8876-2cd7fe229349 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:52.676927 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-52d058b9-cabb-4492-8876-2cd7fe229349 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:52.700591 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-52d058b9-cabb-4492-8876-2cd7fe229349 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d" status: 200 len: 1276 microversion: 2.1 time: 0.369594 Aug 07 01:17:52.701586 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 948/1708] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:52 2022] GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d => generated 1276 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:52.720620 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-faed73c0-749a-4c97-8364-601c78161208 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:52.721244 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-faed73c0-749a-4c97-8364-601c78161208 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: ff193541-98b3-40f6-976c-8b1c721f0bc6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:52.738211 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-faed73c0-749a-4c97-8364-601c78161208 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:52.738813 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-faed73c0-749a-4c97-8364-601c78161208 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:52.739265 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-faed73c0-749a-4c97-8364-601c78161208 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:52.740746 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-faed73c0-749a-4c97-8364-601c78161208 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:52.740746 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-faed73c0-749a-4c97-8364-601c78161208 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:52.751399 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-faed73c0-749a-4c97-8364-601c78161208 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:52.776538 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1cec3e25-f33d-46ee-9c0d-6b5d43931926 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1443946624", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "30a2efcf-29de-4e99-a58b-1824b5071f8c"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:52.803658 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:53.075924 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-1cec3e25-f33d-46ee-9c0d-6b5d43931926 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] validate_networks() for [('30a2efcf-29de-4e99-a58b-1824b5071f8c', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:17:53.531823 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-faed73c0-749a-4c97-8364-601c78161208 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:53.548103 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-faed73c0-749a-4c97-8364-601c78161208 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:53.550898 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-faed73c0-749a-4c97-8364-601c78161208 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:53.555683 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-faed73c0-749a-4c97-8364-601c78161208 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6" status: 200 len: 1568 microversion: 2.25 time: 0.852897 Aug 07 01:17:53.559396 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 949/1709] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:52 2022] GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6 => generated 1568 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:53.564888 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-4bb8ace7-b5eb-47a6-97ec-3c59023d2f73 req-cfff25bb-9721-4274-b116-119484f8d333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd1e4cce-7a53-4200-a2c1-dcabbb7f9544", "name": "network-vif-unplugged", "status": "completed", "tag": "ee124f30-41ef-4d88-b49e-4ad7cac50168"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:53.591752 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4bb8ace7-b5eb-47a6-97ec-3c59023d2f73 req-cfff25bb-9721-4274-b116-119484f8d333 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:53.599838 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4bb8ace7-b5eb-47a6-97ec-3c59023d2f73 req-cfff25bb-9721-4274-b116-119484f8d333 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:53.601610 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4bb8ace7-b5eb-47a6-97ec-3c59023d2f73 req-cfff25bb-9721-4274-b116-119484f8d333 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:53.636386 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-4bb8ace7-b5eb-47a6-97ec-3c59023d2f73 req-cfff25bb-9721-4274-b116-119484f8d333 service nova] Creating event network-vif-unplugged:ee124f30-41ef-4d88-b49e-4ad7cac50168 for instance dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 on n-h2-master-1 Aug 07 01:17:53.645129 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [req-4bb8ace7-b5eb-47a6-97ec-3c59023d2f73 req-cfff25bb-9721-4274-b116-119484f8d333 service nova] Instance dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1'} {{(pid=119516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 01:17:53.653469 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-4bb8ace7-b5eb-47a6-97ec-3c59023d2f73 req-cfff25bb-9721-4274-b116-119484f8d333 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092624 Aug 07 01:17:53.655357 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 950/1710] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:17:53.662150 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4309a447-a65d-4bcc-9807-2f13c2e2806b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:53.662918 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4309a447-a65d-4bcc-9807-2f13c2e2806b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:53.672684 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4309a447-a65d-4bcc-9807-2f13c2e2806b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:53.673173 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4309a447-a65d-4bcc-9807-2f13c2e2806b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:53.673604 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4309a447-a65d-4bcc-9807-2f13c2e2806b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:53.674528 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4309a447-a65d-4bcc-9807-2f13c2e2806b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:53.675573 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4309a447-a65d-4bcc-9807-2f13c2e2806b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:53.676030 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4309a447-a65d-4bcc-9807-2f13c2e2806b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:53.994205 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4309a447-a65d-4bcc-9807-2f13c2e2806b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:54.022843 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4309a447-a65d-4bcc-9807-2f13c2e2806b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1536 microversion: 2.1 time: 0.365978 Aug 07 01:17:54.046460 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 951/1711] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:53 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1536 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:54.058542 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1dfdb9ac-e890-4715-8ade-384b5fa77f38 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e2990cdc0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:54.138247 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1dfdb9ac-e890-4715-8ade-384b5fa77f38 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/628a7b3a-d5f5-4d29-9524-17454a5cfe53" status: 200 len: 1454 microversion: 2.1 time: 0.087412 Aug 07 01:17:54.140450 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 952/1712] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:54 2022] GET /compute/v2.1/images/628a7b3a-d5f5-4d29-9524-17454a5cfe53 => generated 1454 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:54.174298 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8704335f-cb52-494d-904c-53ad6b8417e2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:54.177771 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8704335f-cb52-494d-904c-53ad6b8417e2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:54.199711 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8704335f-cb52-494d-904c-53ad6b8417e2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:54.202014 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8704335f-cb52-494d-904c-53ad6b8417e2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:54.203839 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8704335f-cb52-494d-904c-53ad6b8417e2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:54.211151 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8704335f-cb52-494d-904c-53ad6b8417e2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:54.213983 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8704335f-cb52-494d-904c-53ad6b8417e2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:54.215671 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8704335f-cb52-494d-904c-53ad6b8417e2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:54.560213 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8704335f-cb52-494d-904c-53ad6b8417e2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:54.571737 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8704335f-cb52-494d-904c-53ad6b8417e2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1392 microversion: 2.1 time: 0.428529 Aug 07 01:17:54.590087 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 953/1713] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:54 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1392 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:54.600503 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e6b658ea-7738-4820-8897-491b3f5ed249 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:54.602283 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e6b658ea-7738-4820-8897-491b3f5ed249 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d44d731f-5443-4a7c-9a8d-8e330fd1639d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:54.615757 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6b658ea-7738-4820-8897-491b3f5ed249 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:54.617625 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6b658ea-7738-4820-8897-491b3f5ed249 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:54.618959 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6b658ea-7738-4820-8897-491b3f5ed249 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:54.620867 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6b658ea-7738-4820-8897-491b3f5ed249 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:54.621864 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6b658ea-7738-4820-8897-491b3f5ed249 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:54.622783 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6b658ea-7738-4820-8897-491b3f5ed249 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:55.004019 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=5 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:55.055878 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e6b658ea-7738-4820-8897-491b3f5ed249 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:55.071378 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e6b658ea-7738-4820-8897-491b3f5ed249 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d" status: 200 len: 1318 microversion: 2.1 time: 0.477520 Aug 07 01:17:55.073265 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 954/1714] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:54 2022] GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d => generated 1318 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:55.137113 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3c0faa85-097f-4132-9d40-a82353f05ad3 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:55.139995 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3c0faa85-097f-4132-9d40-a82353f05ad3 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: ff193541-98b3-40f6-976c-8b1c721f0bc6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:55.169870 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c0faa85-097f-4132-9d40-a82353f05ad3 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:55.178189 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c0faa85-097f-4132-9d40-a82353f05ad3 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:55.178914 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c0faa85-097f-4132-9d40-a82353f05ad3 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:55.183100 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c0faa85-097f-4132-9d40-a82353f05ad3 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:55.186049 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c0faa85-097f-4132-9d40-a82353f05ad3 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:55.186549 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c0faa85-097f-4132-9d40-a82353f05ad3 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:55.364785 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-1cec3e25-f33d-46ee-9c0d-6b5d43931926 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:17:55.365369 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-1cec3e25-f33d-46ee-9c0d-6b5d43931926 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:17:55.366056 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-1cec3e25-f33d-46ee-9c0d-6b5d43931926 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:17:55.366566 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-1cec3e25-f33d-46ee-9c0d-6b5d43931926 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:17:55.367045 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-1cec3e25-f33d-46ee-9c0d-6b5d43931926 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:17:55.397502 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1cec3e25-f33d-46ee-9c0d-6b5d43931926 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:55.398343 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1cec3e25-f33d-46ee-9c0d-6b5d43931926 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:55.400564 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1cec3e25-f33d-46ee-9c0d-6b5d43931926 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:55.408527 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1cec3e25-f33d-46ee-9c0d-6b5d43931926 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:55.411137 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1cec3e25-f33d-46ee-9c0d-6b5d43931926 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:55.412543 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1cec3e25-f33d-46ee-9c0d-6b5d43931926 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:55.480600 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-1cec3e25-f33d-46ee-9c0d-6b5d43931926 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Getting quotas for project 010990a44647402c9a355de2ec0176a7. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:17:55.501858 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-1cec3e25-f33d-46ee-9c0d-6b5d43931926 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Getting quotas for user bd2118b664634f1297fe908f30609f42 and project 010990a44647402c9a355de2ec0176a7. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:17:55.547564 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1cec3e25-f33d-46ee-9c0d-6b5d43931926 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:17:55.555289 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1cec3e25-f33d-46ee-9c0d-6b5d43931926 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] [instance: aa4650a8-deed-48a3-9502-cc4ab8b6ca0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:17:55.601507 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3c0faa85-097f-4132-9d40-a82353f05ad3 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:55.615633 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3c0faa85-097f-4132-9d40-a82353f05ad3 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:55.620464 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3c0faa85-097f-4132-9d40-a82353f05ad3 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:55.621719 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3c0faa85-097f-4132-9d40-a82353f05ad3 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6" status: 200 len: 1558 microversion: 2.25 time: 0.518426 Aug 07 01:17:55.626223 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 955/1715] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:55 2022] GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6 => generated 1558 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:55.628547 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1cec3e25-f33d-46ee-9c0d-6b5d43931926 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.324351 Aug 07 01:17:55.636343 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4794e660-ec9c-4fa9-9eb2-a3054324f612 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:55.636964 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4794e660-ec9c-4fa9-9eb2-a3054324f612 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:55.644900 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 761/1716] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:17:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 3341 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:17:55.654957 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-34b30220-29cf-4e20-814b-749b4b89af76 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e24050280>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:55.655229 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4794e660-ec9c-4fa9-9eb2-a3054324f612 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:55.655656 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4794e660-ec9c-4fa9-9eb2-a3054324f612 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:55.656336 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4794e660-ec9c-4fa9-9eb2-a3054324f612 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:55.658544 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4794e660-ec9c-4fa9-9eb2-a3054324f612 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:55.662480 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4794e660-ec9c-4fa9-9eb2-a3054324f612 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:55.663276 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4794e660-ec9c-4fa9-9eb2-a3054324f612 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:55.805898 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-34b30220-29cf-4e20-814b-749b4b89af76 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/628a7b3a-d5f5-4d29-9524-17454a5cfe53" status: 200 len: 1454 microversion: 2.1 time: 0.158354 Aug 07 01:17:55.809667 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 762/1717] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:55 2022] GET /compute/v2.1/images/628a7b3a-d5f5-4d29-9524-17454a5cfe53 => generated 1454 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:55.833186 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-579c9657-5cb0-424a-885e-deb5a2958b19 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:55.834409 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-579c9657-5cb0-424a-885e-deb5a2958b19 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:55.886442 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-579c9657-5cb0-424a-885e-deb5a2958b19 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:55.888066 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-579c9657-5cb0-424a-885e-deb5a2958b19 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:55.906477 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-579c9657-5cb0-424a-885e-deb5a2958b19 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:55.916897 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-579c9657-5cb0-424a-885e-deb5a2958b19 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:55.921925 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-579c9657-5cb0-424a-885e-deb5a2958b19 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:55.922692 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-579c9657-5cb0-424a-885e-deb5a2958b19 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:56.672898 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4794e660-ec9c-4fa9-9eb2-a3054324f612 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:56.686662 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4794e660-ec9c-4fa9-9eb2-a3054324f612 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1529 microversion: 2.1 time: 1.059259 Aug 07 01:17:56.695118 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 956/1718] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:55 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1529 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:56.730243 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-438b1fd9-3fd4-4da4-8bf1-6f9856c41379 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Calling method '.version_select at 0x7f9e298edf70>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:56.758339 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-438b1fd9-3fd4-4da4-8bf1-6f9856c41379 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:56.759665 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-438b1fd9-3fd4-4da4-8bf1-6f9856c41379 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:56.766101 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-438b1fd9-3fd4-4da4-8bf1-6f9856c41379 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:56.827422 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-438b1fd9-3fd4-4da4-8bf1-6f9856c41379 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 3871 microversion: 2.25 time: 0.110168 Aug 07 01:17:56.829357 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 957/1719] 10.222.0.39 () {60 vars in 1184 bytes} [Sun Aug 7 01:17:56 2022] GET /compute/v2.1/os-migrations => generated 3871 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:56.848459 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5236fdfa-7bb9-4a88-87a8-d9600839c7c0 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:56.857650 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5236fdfa-7bb9-4a88-87a8-d9600839c7c0 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] [instance: aa4650a8-deed-48a3-9502-cc4ab8b6ca0c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:57.299220 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-579c9657-5cb0-424a-885e-deb5a2958b19 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:57.325774 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-579c9657-5cb0-424a-885e-deb5a2958b19 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1392 microversion: 2.1 time: 1.512332 Aug 07 01:17:57.330321 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 763/1720] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:55 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1392 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:57.346909 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0b0bb2a1-39d4-453e-a91b-42f25928ed0e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:57.348910 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0b0bb2a1-39d4-453e-a91b-42f25928ed0e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d44d731f-5443-4a7c-9a8d-8e330fd1639d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:57.361978 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5236fdfa-7bb9-4a88-87a8-d9600839c7c0 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd2118b664634f1297fe908f30609f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010990a44647402c9a355de2ec0176a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:57.370003 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b0bb2a1-39d4-453e-a91b-42f25928ed0e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:57.373071 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b0bb2a1-39d4-453e-a91b-42f25928ed0e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:57.374469 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b0bb2a1-39d4-453e-a91b-42f25928ed0e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:57.376033 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b0bb2a1-39d4-453e-a91b-42f25928ed0e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:57.378769 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b0bb2a1-39d4-453e-a91b-42f25928ed0e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:57.382427 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b0bb2a1-39d4-453e-a91b-42f25928ed0e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:57.388813 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5236fdfa-7bb9-4a88-87a8-d9600839c7c0 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c" status: 200 len: 1216 microversion: 2.1 time: 0.549590 Aug 07 01:17:57.414957 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 958/1721] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:56 2022] GET /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c => generated 1216 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:57.422057 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9c56549f-30f0-477e-826c-0f0d3c991ba4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:57.435092 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9c56549f-30f0-477e-826c-0f0d3c991ba4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:57.459241 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c56549f-30f0-477e-826c-0f0d3c991ba4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:57.462232 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c56549f-30f0-477e-826c-0f0d3c991ba4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:57.464083 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c56549f-30f0-477e-826c-0f0d3c991ba4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:57.469685 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c56549f-30f0-477e-826c-0f0d3c991ba4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:57.471443 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c56549f-30f0-477e-826c-0f0d3c991ba4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:57.472285 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c56549f-30f0-477e-826c-0f0d3c991ba4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:58.557335 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9c56549f-30f0-477e-826c-0f0d3c991ba4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:58.564880 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9c56549f-30f0-477e-826c-0f0d3c991ba4 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1529 microversion: 2.1 time: 1.148678 Aug 07 01:17:58.565564 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 959/1722] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:57 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1529 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:58.586503 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6b94ccda-aa65-42c7-ab7d-6ffe6042b131 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e29966af0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:58.729637 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6b94ccda-aa65-42c7-ab7d-6ffe6042b131 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/628a7b3a-d5f5-4d29-9524-17454a5cfe53" status: 200 len: 1454 microversion: 2.1 time: 0.162532 Aug 07 01:17:58.735183 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 960/1723] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:58 2022] GET /compute/v2.1/images/628a7b3a-d5f5-4d29-9524-17454a5cfe53 => generated 1454 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:58.750708 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-698a6a27-38db-4f87-8bf5-af0abe0e317b tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:58.752698 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-698a6a27-38db-4f87-8bf5-af0abe0e317b tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] [instance: ff193541-98b3-40f6-976c-8b1c721f0bc6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:58.783747 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-698a6a27-38db-4f87-8bf5-af0abe0e317b tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:58.784970 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-698a6a27-38db-4f87-8bf5-af0abe0e317b tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:58.785416 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-698a6a27-38db-4f87-8bf5-af0abe0e317b tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:58.786221 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-698a6a27-38db-4f87-8bf5-af0abe0e317b tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:58.791618 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-698a6a27-38db-4f87-8bf5-af0abe0e317b tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:58.792188 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-698a6a27-38db-4f87-8bf5-af0abe0e317b tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:59.654826 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0b0bb2a1-39d4-453e-a91b-42f25928ed0e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:17:59.666875 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0b0bb2a1-39d4-453e-a91b-42f25928ed0e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d" status: 200 len: 1318 microversion: 2.1 time: 2.334210 Aug 07 01:17:59.674768 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 764/1724] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:57 2022] GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d => generated 1318 bytes in 2341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:17:59.686544 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-58bbd3ff-5b8b-4632-9937-fcfcf213327e req-1a60883d-be21-467b-98dd-9171ee4d19b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d44d731f-5443-4a7c-9a8d-8e330fd1639d", "tag": "42ea78b8-0daa-46f3-8493-fb08aabf3fc3"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:17:59.727077 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-58bbd3ff-5b8b-4632-9937-fcfcf213327e req-1a60883d-be21-467b-98dd-9171ee4d19b7 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:59.727572 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-58bbd3ff-5b8b-4632-9937-fcfcf213327e req-1a60883d-be21-467b-98dd-9171ee4d19b7 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:59.735097 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-58bbd3ff-5b8b-4632-9937-fcfcf213327e req-1a60883d-be21-467b-98dd-9171ee4d19b7 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:59.770798 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-58bbd3ff-5b8b-4632-9937-fcfcf213327e req-1a60883d-be21-467b-98dd-9171ee4d19b7 service nova] Creating event network-changed:42ea78b8-0daa-46f3-8493-fb08aabf3fc3 for instance d44d731f-5443-4a7c-9a8d-8e330fd1639d on n-h1-master-1 Aug 07 01:17:59.784126 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-698a6a27-38db-4f87-8bf5-af0abe0e317b tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lazy-loading 'services' on Instance uuid ff193541-98b3-40f6-976c-8b1c721f0bc6 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:17:59.804377 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-58bbd3ff-5b8b-4632-9937-fcfcf213327e req-1a60883d-be21-467b-98dd-9171ee4d19b7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127699 Aug 07 01:17:59.805557 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 765/1725] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:17:59.818588 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cb2214b2-c5e4-4d77-838e-14b391f2182c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:59.823740 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-cb2214b2-c5e4-4d77-838e-14b391f2182c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:59.838929 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cb2214b2-c5e4-4d77-838e-14b391f2182c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:59.839722 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cb2214b2-c5e4-4d77-838e-14b391f2182c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:59.840499 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cb2214b2-c5e4-4d77-838e-14b391f2182c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:59.841429 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cb2214b2-c5e4-4d77-838e-14b391f2182c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:59.842067 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cb2214b2-c5e4-4d77-838e-14b391f2182c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:59.843406 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cb2214b2-c5e4-4d77-838e-14b391f2182c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:59.856624 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-698a6a27-38db-4f87-8bf5-af0abe0e317b tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6" status: 200 len: 2051 microversion: 2.25 time: 1.120110 Aug 07 01:17:59.857899 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 961/1726] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:17:58 2022] GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6 => generated 2051 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:17:59.870368 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-af1d88dd-b67c-4a37-8ba0-8c31b9c57e89 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:17:59.871292 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-af1d88dd-b67c-4a37-8ba0-8c31b9c57e89 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] [instance: aa4650a8-deed-48a3-9502-cc4ab8b6ca0c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:17:59.888462 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af1d88dd-b67c-4a37-8ba0-8c31b9c57e89 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:59.889201 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af1d88dd-b67c-4a37-8ba0-8c31b9c57e89 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:59.889878 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af1d88dd-b67c-4a37-8ba0-8c31b9c57e89 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:17:59.890923 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af1d88dd-b67c-4a37-8ba0-8c31b9c57e89 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:17:59.892834 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af1d88dd-b67c-4a37-8ba0-8c31b9c57e89 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:17:59.897504 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af1d88dd-b67c-4a37-8ba0-8c31b9c57e89 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:00.212198 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-af1d88dd-b67c-4a37-8ba0-8c31b9c57e89 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd2118b664634f1297fe908f30609f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010990a44647402c9a355de2ec0176a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:00.232998 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-af1d88dd-b67c-4a37-8ba0-8c31b9c57e89 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c" status: 200 len: 1274 microversion: 2.1 time: 0.373158 Aug 07 01:18:00.260178 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 962/1727] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:59 2022] GET /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c => generated 1274 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:00.305696 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-792bbe74-4049-44ce-baae-6022bf96a989 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:00.312593 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:18:00.312593 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:18:00.342507 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-792bbe74-4049-44ce-baae-6022bf96a989 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] HTTP exception thrown: Flavor 9952423c-5f43-4e44-af82-6c069bfe067a could not be found. Aug 07 01:18:00.349714 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-792bbe74-4049-44ce-baae-6022bf96a989 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Request method failure captured: Aug 07 01:18:00.349714 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/flavors/9952423c-5f43-4e44-af82-6c069bfe067a HTTP/1.1 Aug 07 01:18:00.349714 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:18:00.349714 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:18:00.349714 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:18:00.349714 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:18:00.349714 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:18:00.349714 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:18:00.349714 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:18:00.349714 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:18:00.349714 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xGoraxuCJeFbkWNGDxTBaMMNGU0LYK2khDecGcaXqGH0g2LljWfHesPl2njzH2dfQ0QaNpVm1xRG_Fb4kUVoRNDW8Q4Q8eDf4aToTC6Rctnx5BQbEnhssKFcAYjvAKZOLOzNUDlH7JvHuKkIzWWsC34M_2whd_zSWQr51w95S_dOzs Aug 07 01:18:00.349714 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:18:00.349714 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:18:00.349714 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:18:00.349714 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:18:00.349714 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:18:00.349714 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:18:00.349714 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 57856e905c9940819ef8a5bac1a1f66f Aug 07 01:18:00.349714 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-MigrationsAdminTest-455441562 Aug 07 01:18:00.349714 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,admin,member Aug 07 01:18:00.349714 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,admin,member Aug 07 01:18:00.352889 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/57856e905c9940819ef8a5bac1a1f66f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_57856e905c9940819ef8a5bac1a1f66f", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/57856e905c9940819ef8a5bac1a1f66f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/57856e905c9940819ef8a5bac1a1f66f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:18:00.352889 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-MigrationsAdminTest-455441562 Aug 07 01:18:00.352889 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 57856e905c9940819ef8a5bac1a1f66f Aug 07 01:18:00.352889 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-MigrationsAdminTest-455441562 Aug 07 01:18:00.352889 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-MigrationsAdminTest-455441562-project-admin Aug 07 01:18:00.352889 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:18:00.352889 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:18:00.352889 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: fd62e88119574de6b8a03ace83572773 Aug 07 01:18:00.352889 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-MigrationsAdminTest-455441562-project-admin Aug 07 01:18:00.352889 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:18:00.352889 n-d-master-1 devstack@n-api.service[119516]: exception: Flavor 9952423c-5f43-4e44-af82-6c069bfe067a could not be found. Aug 07 01:18:00.352889 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '9952423c-5f43-4e44-af82-6c069bfe067a'} Aug 07 01:18:00.355005 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:18:00.355005 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:00.355005 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 07 01:18:00.355005 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 07 01:18:00.355005 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 07 01:18:00.355005 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 07 01:18:00.355005 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 07 01:18:00.355005 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 07 01:18:00.355005 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 07 01:18:00.355005 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 07 01:18:00.355005 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 07 01:18:00.355005 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 07 01:18:00.355005 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 07 01:18:00.355005 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 07 01:18:00.355005 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 9952423c-5f43-4e44-af82-6c069bfe067a could not be found. Aug 07 01:18:00.355005 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:18:00.355005 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:18:00.355005 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:18:00.355005 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:00.355005 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:18:00.377432 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:18:00.377432 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:18:00.377432 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:18:00.377432 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:18:00.377432 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:18:00.377432 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 07 01:18:00.377432 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:18:00.377432 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 9952423c-5f43-4e44-af82-6c069bfe067a could not be found. Aug 07 01:18:00.377432 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:18:00.377432 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:18:00.377432 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:18:00.377432 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:00.377432 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:18:00.377432 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:18:00.377432 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:18:00.377432 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:18:00.377432 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 9952423c-5f43-4e44-af82-6c069bfe067a could not be found. Aug 07 01:18:00.377432 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:18:00.388200 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-792bbe74-4049-44ce-baae-6022bf96a989 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Returning 404 to user: Flavor 9952423c-5f43-4e44-af82-6c069bfe067a could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:18:00.388200 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-792bbe74-4049-44ce-baae-6022bf96a989 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/9952423c-5f43-4e44-af82-6c069bfe067a" status: 404 len: 109 microversion: 2.1 time: 0.094846 Aug 07 01:18:00.388200 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 963/1728] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:18:00 2022] DELETE /compute/v2.1/flavors/9952423c-5f43-4e44-af82-6c069bfe067a => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:18:00.394839 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9bd72897-0778-4c74-a89b-030332bf6564 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e2995e5e0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:00.531787 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9bd72897-0778-4c74-a89b-030332bf6564 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/628a7b3a-d5f5-4d29-9524-17454a5cfe53" status: 200 len: 1454 microversion: 2.1 time: 0.158756 Aug 07 01:18:00.532753 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 964/1729] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:18:00 2022] GET /compute/v2.1/images/628a7b3a-d5f5-4d29-9524-17454a5cfe53 => generated 1454 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:00.538137 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-abd84219-c594-4bbe-bf13-847b12d12166 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-781083986", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "68fdaf7a-c018-4207-a54c-86715ad58de9"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:00.707596 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-abd84219-c594-4bbe-bf13-847b12d12166 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] validate_networks() for [('68fdaf7a-c018-4207-a54c-86715ad58de9', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:18:01.516730 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-cb2214b2-c5e4-4d77-838e-14b391f2182c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:01.534831 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cb2214b2-c5e4-4d77-838e-14b391f2182c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1392 microversion: 2.1 time: 1.726644 Aug 07 01:18:01.544107 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 766/1730] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:17:59 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1392 bytes in 1729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:01.550175 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-456a2053-49fc-4c35-aaba-54ff886a4a38 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:01.550741 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-456a2053-49fc-4c35-aaba-54ff886a4a38 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d44d731f-5443-4a7c-9a8d-8e330fd1639d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:01.576869 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-456a2053-49fc-4c35-aaba-54ff886a4a38 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:01.577309 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-456a2053-49fc-4c35-aaba-54ff886a4a38 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:01.577836 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-456a2053-49fc-4c35-aaba-54ff886a4a38 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:01.578523 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-456a2053-49fc-4c35-aaba-54ff886a4a38 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:01.578960 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-456a2053-49fc-4c35-aaba-54ff886a4a38 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:01.579453 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-456a2053-49fc-4c35-aaba-54ff886a4a38 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:02.384275 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-abd84219-c594-4bbe-bf13-847b12d12166 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:18:02.384873 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-abd84219-c594-4bbe-bf13-847b12d12166 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:18:02.385166 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-abd84219-c594-4bbe-bf13-847b12d12166 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:18:02.385575 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-abd84219-c594-4bbe-bf13-847b12d12166 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:18:02.386786 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-abd84219-c594-4bbe-bf13-847b12d12166 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:18:02.403222 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-abd84219-c594-4bbe-bf13-847b12d12166 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:02.403739 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-abd84219-c594-4bbe-bf13-847b12d12166 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:02.406366 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-abd84219-c594-4bbe-bf13-847b12d12166 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:02.407596 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-abd84219-c594-4bbe-bf13-847b12d12166 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:02.409597 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-abd84219-c594-4bbe-bf13-847b12d12166 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:02.411817 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-abd84219-c594-4bbe-bf13-847b12d12166 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:02.463730 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-abd84219-c594-4bbe-bf13-847b12d12166 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Getting quotas for project 1371b7aebfcf4088a02780393de8200f. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:18:02.478305 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-abd84219-c594-4bbe-bf13-847b12d12166 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Getting quotas for user 45ed48709ab84fa4b5b341332a843ad8 and project 1371b7aebfcf4088a02780393de8200f. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:18:02.518229 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-abd84219-c594-4bbe-bf13-847b12d12166 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:18:02.520660 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-abd84219-c594-4bbe-bf13-847b12d12166 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:18:02.631697 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-abd84219-c594-4bbe-bf13-847b12d12166 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.097845 Aug 07 01:18:02.653209 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 965/1731] 10.222.0.39 () {62 vars in 1188 bytes} [Sun Aug 7 01:18:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2120 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 07 01:18:02.659391 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-46008d3c-ed69-4f19-b73f-4e582dac8a5a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2109723991", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:02.758860 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-46008d3c-ed69-4f19-b73f-4e582dac8a5a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] validate_networks() for None {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:18:03.352546 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-456a2053-49fc-4c35-aaba-54ff886a4a38 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:03.373955 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-456a2053-49fc-4c35-aaba-54ff886a4a38 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d" status: 200 len: 1318 microversion: 2.1 time: 1.816691 Aug 07 01:18:03.375498 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 767/1732] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:01 2022] GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d => generated 1318 bytes in 1831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:03.391739 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-35d5fa63-d25f-47ce-a2a4-57218e640104 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:03.395901 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-35d5fa63-d25f-47ce-a2a4-57218e640104 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] [instance: aa4650a8-deed-48a3-9502-cc4ab8b6ca0c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:03.418083 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-35d5fa63-d25f-47ce-a2a4-57218e640104 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:03.419114 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-35d5fa63-d25f-47ce-a2a4-57218e640104 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:03.421608 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-35d5fa63-d25f-47ce-a2a4-57218e640104 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:03.444268 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-35d5fa63-d25f-47ce-a2a4-57218e640104 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:03.448388 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-35d5fa63-d25f-47ce-a2a4-57218e640104 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:03.450991 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-35d5fa63-d25f-47ce-a2a4-57218e640104 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:03.656360 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-46008d3c-ed69-4f19-b73f-4e582dac8a5a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:18:03.658455 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-46008d3c-ed69-4f19-b73f-4e582dac8a5a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:18:03.659928 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-46008d3c-ed69-4f19-b73f-4e582dac8a5a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:18:03.661231 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-46008d3c-ed69-4f19-b73f-4e582dac8a5a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:18:03.662418 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-46008d3c-ed69-4f19-b73f-4e582dac8a5a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:18:03.688394 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-46008d3c-ed69-4f19-b73f-4e582dac8a5a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:03.689391 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-46008d3c-ed69-4f19-b73f-4e582dac8a5a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:03.689940 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-46008d3c-ed69-4f19-b73f-4e582dac8a5a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:03.695565 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-46008d3c-ed69-4f19-b73f-4e582dac8a5a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:03.696390 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-46008d3c-ed69-4f19-b73f-4e582dac8a5a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:03.696967 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-46008d3c-ed69-4f19-b73f-4e582dac8a5a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:03.763398 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-46008d3c-ed69-4f19-b73f-4e582dac8a5a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Getting quotas for project 1911abc893ef4c01aa80ca9079dea6e9. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:18:03.780914 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-46008d3c-ed69-4f19-b73f-4e582dac8a5a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Getting quotas for user b945db9a6f7a4143a544b76be5e9af9f and project 1911abc893ef4c01aa80ca9079dea6e9. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:18:03.819045 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-46008d3c-ed69-4f19-b73f-4e582dac8a5a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:18:03.826704 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-46008d3c-ed69-4f19-b73f-4e582dac8a5a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:18:03.942549 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-46008d3c-ed69-4f19-b73f-4e582dac8a5a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.287928 Aug 07 01:18:03.943278 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 966/1733] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:18:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1289 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:18:03.960713 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-13f9648b-bbd7-43a1-afe3-2f01bad8907b req-9de1340b-c143-4996-97fa-7fac5090c4fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e2ae24f-8349-46d5-b091-876927d02b68", "name": "network-vif-plugged", "status": "completed", "tag": "63f23b72-85ce-4ced-9d43-dd32e2464731"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:03.991683 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-13f9648b-bbd7-43a1-afe3-2f01bad8907b req-9de1340b-c143-4996-97fa-7fac5090c4fa service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:03.994687 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-13f9648b-bbd7-43a1-afe3-2f01bad8907b req-9de1340b-c143-4996-97fa-7fac5090c4fa service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:03.995399 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-13f9648b-bbd7-43a1-afe3-2f01bad8907b req-9de1340b-c143-4996-97fa-7fac5090c4fa service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:04.017911 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-13f9648b-bbd7-43a1-afe3-2f01bad8907b req-9de1340b-c143-4996-97fa-7fac5090c4fa service nova] Creating event network-vif-plugged:63f23b72-85ce-4ced-9d43-dd32e2464731 for instance 9e2ae24f-8349-46d5-b091-876927d02b68 on n-h1-master-1 Aug 07 01:18:04.024923 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-13f9648b-bbd7-43a1-afe3-2f01bad8907b req-9de1340b-c143-4996-97fa-7fac5090c4fa service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077460 Aug 07 01:18:04.026180 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 967/1734] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:18:04.035100 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-37007152-b5ec-4ab7-b610-2c232238f5d9 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e24919d30>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:04.108667 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-37007152-b5ec-4ab7-b610-2c232238f5d9 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/628a7b3a-d5f5-4d29-9524-17454a5cfe53" status: 200 len: 1454 microversion: 2.1 time: 0.081028 Aug 07 01:18:04.117124 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 968/1735] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:18:04 2022] GET /compute/v2.1/images/628a7b3a-d5f5-4d29-9524-17454a5cfe53 => generated 1454 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:04.133174 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5ed90224-48d9-4418-917d-3767690940a4 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:04.140087 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5ed90224-48d9-4418-917d-3767690940a4 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:04.154538 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5ed90224-48d9-4418-917d-3767690940a4 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:04.159656 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5ed90224-48d9-4418-917d-3767690940a4 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:04.161092 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5ed90224-48d9-4418-917d-3767690940a4 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:04.168824 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5ed90224-48d9-4418-917d-3767690940a4 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:04.170149 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5ed90224-48d9-4418-917d-3767690940a4 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:04.171385 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5ed90224-48d9-4418-917d-3767690940a4 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:04.739748 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-35d5fa63-d25f-47ce-a2a4-57218e640104 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd2118b664634f1297fe908f30609f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010990a44647402c9a355de2ec0176a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:04.786269 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-35d5fa63-d25f-47ce-a2a4-57218e640104 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c" status: 200 len: 1316 microversion: 2.1 time: 1.408970 Aug 07 01:18:04.802184 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 768/1736] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:03 2022] GET /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c => generated 1316 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:04.826167 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ea330741-db2f-4dc6-b0ac-6b77245d5d60 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:04.827043 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ea330741-db2f-4dc6-b0ac-6b77245d5d60 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:04.861375 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ea330741-db2f-4dc6-b0ac-6b77245d5d60 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:04.865596 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ea330741-db2f-4dc6-b0ac-6b77245d5d60 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:04.873237 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ea330741-db2f-4dc6-b0ac-6b77245d5d60 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:04.875899 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ea330741-db2f-4dc6-b0ac-6b77245d5d60 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:04.876445 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ea330741-db2f-4dc6-b0ac-6b77245d5d60 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:04.881156 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ea330741-db2f-4dc6-b0ac-6b77245d5d60 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:05.193758 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5ed90224-48d9-4418-917d-3767690940a4 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:05.213942 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5ed90224-48d9-4418-917d-3767690940a4 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1392 microversion: 2.1 time: 1.088545 Aug 07 01:18:05.214592 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 969/1737] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:04 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1392 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:05.237416 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e1b003d6-83ce-4aa1-9940-55b78a040455 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:05.243797 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e1b003d6-83ce-4aa1-9940-55b78a040455 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:05.266292 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1b003d6-83ce-4aa1-9940-55b78a040455 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:05.267765 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1b003d6-83ce-4aa1-9940-55b78a040455 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:05.276333 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1b003d6-83ce-4aa1-9940-55b78a040455 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:05.277337 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1b003d6-83ce-4aa1-9940-55b78a040455 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:05.278021 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1b003d6-83ce-4aa1-9940-55b78a040455 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:05.279092 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1b003d6-83ce-4aa1-9940-55b78a040455 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:05.381423 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ea330741-db2f-4dc6-b0ac-6b77245d5d60 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:05.413662 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ea330741-db2f-4dc6-b0ac-6b77245d5d60 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:05.426809 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ea330741-db2f-4dc6-b0ac-6b77245d5d60 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:05.435718 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ea330741-db2f-4dc6-b0ac-6b77245d5d60 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a" status: 200 len: 1257 microversion: 2.25 time: 0.629415 Aug 07 01:18:05.439077 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 769/1738] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:18:04 2022] GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a => generated 1257 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:18:05.444721 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e1b003d6-83ce-4aa1-9940-55b78a040455 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:05.445391 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-70b03ecd-e190-4b53-b9f2-48d93b1ae60c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:05.447026 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-70b03ecd-e190-4b53-b9f2-48d93b1ae60c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d44d731f-5443-4a7c-9a8d-8e330fd1639d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:05.452492 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:05.454392 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e1b003d6-83ce-4aa1-9940-55b78a040455 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1217 microversion: 2.1 time: 0.221270 Aug 07 01:18:05.461155 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-70b03ecd-e190-4b53-b9f2-48d93b1ae60c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:05.462389 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-70b03ecd-e190-4b53-b9f2-48d93b1ae60c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:05.462994 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-70b03ecd-e190-4b53-b9f2-48d93b1ae60c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:05.464230 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-70b03ecd-e190-4b53-b9f2-48d93b1ae60c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:05.465063 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-70b03ecd-e190-4b53-b9f2-48d93b1ae60c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:05.465763 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-70b03ecd-e190-4b53-b9f2-48d93b1ae60c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:05.472557 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 970/1739] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:05 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1217 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:05.490999 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ff66fedf-f5f0-4593-bc1f-8c0c96acd136 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e2995eca0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:05.539985 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=14 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:05.591188 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ff66fedf-f5f0-4593-bc1f-8c0c96acd136 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/628a7b3a-d5f5-4d29-9524-17454a5cfe53" status: 200 len: 1454 microversion: 2.1 time: 0.117430 Aug 07 01:18:05.594908 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 971/1740] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:18:05 2022] GET /compute/v2.1/images/628a7b3a-d5f5-4d29-9524-17454a5cfe53 => generated 1454 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:05.818971 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6cc098f1-bb2c-44a8-9eb3-accebcebdaec tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:05.819934 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6cc098f1-bb2c-44a8-9eb3-accebcebdaec tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] [instance: aa4650a8-deed-48a3-9502-cc4ab8b6ca0c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:05.830247 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cc098f1-bb2c-44a8-9eb3-accebcebdaec tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:05.832500 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cc098f1-bb2c-44a8-9eb3-accebcebdaec tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:05.833159 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cc098f1-bb2c-44a8-9eb3-accebcebdaec tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:05.834064 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cc098f1-bb2c-44a8-9eb3-accebcebdaec tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:05.837502 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cc098f1-bb2c-44a8-9eb3-accebcebdaec tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:05.838201 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cc098f1-bb2c-44a8-9eb3-accebcebdaec tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:06.414547 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-70b03ecd-e190-4b53-b9f2-48d93b1ae60c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:06.428607 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-70b03ecd-e190-4b53-b9f2-48d93b1ae60c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d" status: 200 len: 1318 microversion: 2.1 time: 0.983660 Aug 07 01:18:06.442731 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 770/1741] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:05 2022] GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d => generated 1318 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:06.456544 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8c8e8c08-eef6-4d8f-97f6-67ebe9d42ddf tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:06.457466 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8c8e8c08-eef6-4d8f-97f6-67ebe9d42ddf tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:06.476485 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8c8e8c08-eef6-4d8f-97f6-67ebe9d42ddf tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:06.477315 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8c8e8c08-eef6-4d8f-97f6-67ebe9d42ddf tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:06.477935 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8c8e8c08-eef6-4d8f-97f6-67ebe9d42ddf tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:06.478878 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8c8e8c08-eef6-4d8f-97f6-67ebe9d42ddf tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:06.483755 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8c8e8c08-eef6-4d8f-97f6-67ebe9d42ddf tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:06.484538 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8c8e8c08-eef6-4d8f-97f6-67ebe9d42ddf tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:06.649290 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6cc098f1-bb2c-44a8-9eb3-accebcebdaec tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd2118b664634f1297fe908f30609f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010990a44647402c9a355de2ec0176a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:06.681049 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6cc098f1-bb2c-44a8-9eb3-accebcebdaec tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c" status: 200 len: 1316 microversion: 2.1 time: 0.866003 Aug 07 01:18:06.682054 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 972/1742] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:05 2022] GET /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c => generated 1316 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:18:06.733558 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-5a0fa9be-d60d-41da-85d2-72753697a1c8 req-c0567372-aa8c-4bd6-9e69-cf11b980ccef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd1e4cce-7a53-4200-a2c1-dcabbb7f9544", "name": "network-vif-plugged", "status": "completed", "tag": "ee124f30-41ef-4d88-b49e-4ad7cac50168"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:06.749873 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-5a0fa9be-d60d-41da-85d2-72753697a1c8 req-c0567372-aa8c-4bd6-9e69-cf11b980ccef service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:06.750928 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-5a0fa9be-d60d-41da-85d2-72753697a1c8 req-c0567372-aa8c-4bd6-9e69-cf11b980ccef service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:06.751697 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-5a0fa9be-d60d-41da-85d2-72753697a1c8 req-c0567372-aa8c-4bd6-9e69-cf11b980ccef service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:06.790777 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-5a0fa9be-d60d-41da-85d2-72753697a1c8 req-c0567372-aa8c-4bd6-9e69-cf11b980ccef service nova] Creating event network-vif-plugged:ee124f30-41ef-4d88-b49e-4ad7cac50168 for instance dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 on n-h2-master-1 Aug 07 01:18:06.799833 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-5a0fa9be-d60d-41da-85d2-72753697a1c8 req-c0567372-aa8c-4bd6-9e69-cf11b980ccef service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071133 Aug 07 01:18:06.801855 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 973/1743] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:18:06.814613 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9bd99542-cbd0-449b-bb7c-de6012409bd4 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:06.815916 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9bd99542-cbd0-449b-bb7c-de6012409bd4 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:06.824009 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9bd99542-cbd0-449b-bb7c-de6012409bd4 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:06.824750 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9bd99542-cbd0-449b-bb7c-de6012409bd4 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:06.825437 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9bd99542-cbd0-449b-bb7c-de6012409bd4 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:06.826469 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9bd99542-cbd0-449b-bb7c-de6012409bd4 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:06.827007 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9bd99542-cbd0-449b-bb7c-de6012409bd4 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:06.827437 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9bd99542-cbd0-449b-bb7c-de6012409bd4 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:07.014205 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9bd99542-cbd0-449b-bb7c-de6012409bd4 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:07.028673 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9bd99542-cbd0-449b-bb7c-de6012409bd4 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:07.034611 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9bd99542-cbd0-449b-bb7c-de6012409bd4 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:07.037236 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9bd99542-cbd0-449b-bb7c-de6012409bd4 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a" status: 200 len: 1319 microversion: 2.25 time: 0.233378 Aug 07 01:18:07.044602 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 974/1744] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:18:06 2022] GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:18:07.050555 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c2e14387-0cbd-4766-86c0-d735141d6703 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:07.054926 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c2e14387-0cbd-4766-86c0-d735141d6703 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:07.079579 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c2e14387-0cbd-4766-86c0-d735141d6703 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:07.084537 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c2e14387-0cbd-4766-86c0-d735141d6703 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:07.088540 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c2e14387-0cbd-4766-86c0-d735141d6703 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:07.091648 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c2e14387-0cbd-4766-86c0-d735141d6703 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:07.092499 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c2e14387-0cbd-4766-86c0-d735141d6703 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:07.101478 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c2e14387-0cbd-4766-86c0-d735141d6703 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:07.242261 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c2e14387-0cbd-4766-86c0-d735141d6703 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:07.260412 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c2e14387-0cbd-4766-86c0-d735141d6703 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1265 microversion: 2.1 time: 0.214100 Aug 07 01:18:07.261670 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 975/1745] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:07 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:07.271284 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0304eb6f-4e80-409d-af03-0083fd09cbec tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e298b1b80>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:07.417641 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0304eb6f-4e80-409d-af03-0083fd09cbec tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/628a7b3a-d5f5-4d29-9524-17454a5cfe53" status: 200 len: 1454 microversion: 2.1 time: 0.154241 Aug 07 01:18:07.421536 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 976/1746] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:18:07 2022] GET /compute/v2.1/images/628a7b3a-d5f5-4d29-9524-17454a5cfe53 => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:07.453594 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4a48f442-81bb-4a76-85d3-fcff2e6bb7d9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:07.454401 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4a48f442-81bb-4a76-85d3-fcff2e6bb7d9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d44d731f-5443-4a7c-9a8d-8e330fd1639d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:07.469961 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a48f442-81bb-4a76-85d3-fcff2e6bb7d9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:07.473262 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a48f442-81bb-4a76-85d3-fcff2e6bb7d9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:07.474011 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a48f442-81bb-4a76-85d3-fcff2e6bb7d9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:07.475033 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a48f442-81bb-4a76-85d3-fcff2e6bb7d9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:07.477375 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a48f442-81bb-4a76-85d3-fcff2e6bb7d9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:07.479698 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a48f442-81bb-4a76-85d3-fcff2e6bb7d9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:07.551661 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:07.821586 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4a48f442-81bb-4a76-85d3-fcff2e6bb7d9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:07.835657 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4a48f442-81bb-4a76-85d3-fcff2e6bb7d9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d" status: 200 len: 1318 microversion: 2.1 time: 0.385915 Aug 07 01:18:07.850207 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 977/1747] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:07 2022] GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d => generated 1318 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:18:07.855444 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0057127c-f238-4a19-ac52-f781f2fed902 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:07.856473 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0057127c-f238-4a19-ac52-f781f2fed902 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] [instance: aa4650a8-deed-48a3-9502-cc4ab8b6ca0c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:07.863336 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0057127c-f238-4a19-ac52-f781f2fed902 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:07.864294 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0057127c-f238-4a19-ac52-f781f2fed902 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:07.865004 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0057127c-f238-4a19-ac52-f781f2fed902 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:07.866468 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0057127c-f238-4a19-ac52-f781f2fed902 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:07.867215 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0057127c-f238-4a19-ac52-f781f2fed902 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:07.868029 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0057127c-f238-4a19-ac52-f781f2fed902 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:08.085007 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8c8e8c08-eef6-4d8f-97f6-67ebe9d42ddf tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:08.102243 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8c8e8c08-eef6-4d8f-97f6-67ebe9d42ddf tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1392 microversion: 2.1 time: 1.658013 Aug 07 01:18:08.104474 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 771/1748] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:06 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1392 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:08.129420 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-87653ca6-fe2f-4dd5-8e43-7f9f3a34f7bc tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:08.132855 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-87653ca6-fe2f-4dd5-8e43-7f9f3a34f7bc tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:08.159770 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-87653ca6-fe2f-4dd5-8e43-7f9f3a34f7bc tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:08.164678 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-87653ca6-fe2f-4dd5-8e43-7f9f3a34f7bc tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:08.166330 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-87653ca6-fe2f-4dd5-8e43-7f9f3a34f7bc tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:08.169075 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-87653ca6-fe2f-4dd5-8e43-7f9f3a34f7bc tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:08.169957 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-87653ca6-fe2f-4dd5-8e43-7f9f3a34f7bc tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:08.170744 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-87653ca6-fe2f-4dd5-8e43-7f9f3a34f7bc tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:08.383490 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0057127c-f238-4a19-ac52-f781f2fed902 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd2118b664634f1297fe908f30609f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010990a44647402c9a355de2ec0176a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:08.408449 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0057127c-f238-4a19-ac52-f781f2fed902 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c" status: 200 len: 1316 microversion: 2.1 time: 0.548574 Aug 07 01:18:08.421152 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 978/1749] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:07 2022] GET /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c => generated 1316 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:08.426579 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-20461a82-405e-4b60-8941-74ab5864ffa1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:08.429436 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-20461a82-405e-4b60-8941-74ab5864ffa1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:08.445944 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20461a82-405e-4b60-8941-74ab5864ffa1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:08.450403 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20461a82-405e-4b60-8941-74ab5864ffa1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:08.453691 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20461a82-405e-4b60-8941-74ab5864ffa1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:08.454661 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20461a82-405e-4b60-8941-74ab5864ffa1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:08.456005 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20461a82-405e-4b60-8941-74ab5864ffa1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:08.457617 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20461a82-405e-4b60-8941-74ab5864ffa1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:08.506751 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-87653ca6-fe2f-4dd5-8e43-7f9f3a34f7bc tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:08.526013 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-87653ca6-fe2f-4dd5-8e43-7f9f3a34f7bc tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:08.534020 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-87653ca6-fe2f-4dd5-8e43-7f9f3a34f7bc tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:08.538102 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-87653ca6-fe2f-4dd5-8e43-7f9f3a34f7bc tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a" status: 200 len: 1319 microversion: 2.25 time: 0.432169 Aug 07 01:18:08.538990 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 772/1750] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:18:08 2022] GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a => generated 1319 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:18:08.544908 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f65a28a2-bfb5-4eac-b965-77d86bfdace3 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e17fc6f70>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:08.636765 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f65a28a2-bfb5-4eac-b965-77d86bfdace3 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/628a7b3a-d5f5-4d29-9524-17454a5cfe53" status: 200 len: 1454 microversion: 2.1 time: 0.096262 Aug 07 01:18:08.637586 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 773/1751] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:18:08 2022] GET /compute/v2.1/images/628a7b3a-d5f5-4d29-9524-17454a5cfe53 => generated 1454 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:08.812061 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-0762e52f-97f5-46f4-8d86-6af4d07f58e8 req-c96b868a-d7d2-4b02-921a-27bd16cf80ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e006496-fa0b-4e7a-8c5d-a3724b172720", "name": "network-vif-unplugged", "status": "completed", "tag": "dcf52ab3-da5a-473c-accb-60d75e843c85"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:08.833528 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0762e52f-97f5-46f4-8d86-6af4d07f58e8 req-c96b868a-d7d2-4b02-921a-27bd16cf80ee service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:08.843266 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0762e52f-97f5-46f4-8d86-6af4d07f58e8 req-c96b868a-d7d2-4b02-921a-27bd16cf80ee service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:08.844121 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0762e52f-97f5-46f4-8d86-6af4d07f58e8 req-c96b868a-d7d2-4b02-921a-27bd16cf80ee service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:08.886752 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-0762e52f-97f5-46f4-8d86-6af4d07f58e8 req-c96b868a-d7d2-4b02-921a-27bd16cf80ee service nova] Creating event network-vif-unplugged:dcf52ab3-da5a-473c-accb-60d75e843c85 for instance 2e006496-fa0b-4e7a-8c5d-a3724b172720 on n-h2-master-1 Aug 07 01:18:08.896890 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-20461a82-405e-4b60-8941-74ab5864ffa1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:08.912193 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-20461a82-405e-4b60-8941-74ab5864ffa1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1271 microversion: 2.1 time: 0.500751 Aug 07 01:18:08.913941 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 979/1752] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:08 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1271 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:08.919017 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-0762e52f-97f5-46f4-8d86-6af4d07f58e8 req-c96b868a-d7d2-4b02-921a-27bd16cf80ee service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111216 Aug 07 01:18:08.922378 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 774/1753] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:18:08.928097 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-600c36ce-7688-4596-aa64-b55b19268f16 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:08.932654 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-600c36ce-7688-4596-aa64-b55b19268f16 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d44d731f-5443-4a7c-9a8d-8e330fd1639d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:08.950519 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:08.957767 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-600c36ce-7688-4596-aa64-b55b19268f16 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:08.958555 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-600c36ce-7688-4596-aa64-b55b19268f16 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:08.960382 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-600c36ce-7688-4596-aa64-b55b19268f16 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:08.962409 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-600c36ce-7688-4596-aa64-b55b19268f16 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:08.967723 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-600c36ce-7688-4596-aa64-b55b19268f16 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:08.968597 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-600c36ce-7688-4596-aa64-b55b19268f16 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:09.129560 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2c69d8cb-5b6e-41e9-8cb2-6c9854cfbd0e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:09.130374 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2c69d8cb-5b6e-41e9-8cb2-6c9854cfbd0e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:09.154696 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c69d8cb-5b6e-41e9-8cb2-6c9854cfbd0e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:09.155358 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c69d8cb-5b6e-41e9-8cb2-6c9854cfbd0e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:09.155907 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c69d8cb-5b6e-41e9-8cb2-6c9854cfbd0e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:09.159797 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c69d8cb-5b6e-41e9-8cb2-6c9854cfbd0e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:09.161813 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c69d8cb-5b6e-41e9-8cb2-6c9854cfbd0e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:09.164398 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c69d8cb-5b6e-41e9-8cb2-6c9854cfbd0e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:09.931530 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-600c36ce-7688-4596-aa64-b55b19268f16 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:09.962791 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-600c36ce-7688-4596-aa64-b55b19268f16 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d" status: 200 len: 1318 microversion: 2.1 time: 1.045057 Aug 07 01:18:09.965936 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 980/1754] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:08 2022] GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d => generated 1318 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:09.974220 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f1ffc191-c145-4492-b52a-73dd04f55272 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:09.975924 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f1ffc191-c145-4492-b52a-73dd04f55272 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] [instance: aa4650a8-deed-48a3-9502-cc4ab8b6ca0c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:09.992280 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f1ffc191-c145-4492-b52a-73dd04f55272 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:09.993994 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f1ffc191-c145-4492-b52a-73dd04f55272 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:09.994751 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f1ffc191-c145-4492-b52a-73dd04f55272 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:09.996266 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f1ffc191-c145-4492-b52a-73dd04f55272 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:09.997241 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f1ffc191-c145-4492-b52a-73dd04f55272 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:09.997925 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f1ffc191-c145-4492-b52a-73dd04f55272 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:10.142012 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2c69d8cb-5b6e-41e9-8cb2-6c9854cfbd0e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:10.154904 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2c69d8cb-5b6e-41e9-8cb2-6c9854cfbd0e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1392 microversion: 2.1 time: 1.030276 Aug 07 01:18:10.169984 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 775/1755] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:09 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1392 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:18:10.175481 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-54f83f12-8f1d-4706-87f7-1b61b004e029 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:10.176390 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-54f83f12-8f1d-4706-87f7-1b61b004e029 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:10.183390 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54f83f12-8f1d-4706-87f7-1b61b004e029 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:10.184194 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54f83f12-8f1d-4706-87f7-1b61b004e029 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:10.184815 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54f83f12-8f1d-4706-87f7-1b61b004e029 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:10.185808 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54f83f12-8f1d-4706-87f7-1b61b004e029 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:10.186452 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54f83f12-8f1d-4706-87f7-1b61b004e029 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:10.187063 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54f83f12-8f1d-4706-87f7-1b61b004e029 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:10.838156 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f1ffc191-c145-4492-b52a-73dd04f55272 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd2118b664634f1297fe908f30609f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010990a44647402c9a355de2ec0176a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:10.847743 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f1ffc191-c145-4492-b52a-73dd04f55272 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c" status: 200 len: 1316 microversion: 2.1 time: 0.879961 Aug 07 01:18:10.853217 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 981/1756] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:09 2022] GET /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c => generated 1316 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:10.868982 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-91a44de5-e9d9-461b-ab29-86db2f4fe2b3 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e298e6af0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:10.961360 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-54f83f12-8f1d-4706-87f7-1b61b004e029 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:10.976610 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-54f83f12-8f1d-4706-87f7-1b61b004e029 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:10.990743 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-91a44de5-e9d9-461b-ab29-86db2f4fe2b3 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/628a7b3a-d5f5-4d29-9524-17454a5cfe53" status: 200 len: 1454 microversion: 2.1 time: 0.136017 Aug 07 01:18:10.994386 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 982/1757] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:18:10 2022] GET /compute/v2.1/images/628a7b3a-d5f5-4d29-9524-17454a5cfe53 => generated 1454 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:11.007540 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-54f83f12-8f1d-4706-87f7-1b61b004e029 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:11.017416 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-54f83f12-8f1d-4706-87f7-1b61b004e029 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a" status: 200 len: 1319 microversion: 2.25 time: 0.842352 Aug 07 01:18:11.019119 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 776/1758] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:18:10 2022] GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a => generated 1319 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:18:11.023427 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-72603914-0432-44e7-b8ac-01232898b2e1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:11.027820 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-72603914-0432-44e7-b8ac-01232898b2e1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:11.041262 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-c5bb8646-992f-43c1-bcf0-f224173afccc req-82e4d819-632a-4066-b692-7e0b46d45ccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d44d731f-5443-4a7c-9a8d-8e330fd1639d", "name": "network-vif-plugged", "status": "completed", "tag": "42ea78b8-0daa-46f3-8493-fb08aabf3fc3"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:11.067954 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72603914-0432-44e7-b8ac-01232898b2e1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:11.068184 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c5bb8646-992f-43c1-bcf0-f224173afccc req-82e4d819-632a-4066-b692-7e0b46d45ccb service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:11.070689 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72603914-0432-44e7-b8ac-01232898b2e1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:11.071201 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72603914-0432-44e7-b8ac-01232898b2e1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:11.074401 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c5bb8646-992f-43c1-bcf0-f224173afccc req-82e4d819-632a-4066-b692-7e0b46d45ccb service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:11.074884 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72603914-0432-44e7-b8ac-01232898b2e1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:11.075265 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c5bb8646-992f-43c1-bcf0-f224173afccc req-82e4d819-632a-4066-b692-7e0b46d45ccb service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:11.075425 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72603914-0432-44e7-b8ac-01232898b2e1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:11.079012 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72603914-0432-44e7-b8ac-01232898b2e1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:11.092829 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-c5bb8646-992f-43c1-bcf0-f224173afccc req-82e4d819-632a-4066-b692-7e0b46d45ccb service nova] Creating event network-vif-plugged:42ea78b8-0daa-46f3-8493-fb08aabf3fc3 for instance d44d731f-5443-4a7c-9a8d-8e330fd1639d on n-h1-master-1 Aug 07 01:18:11.111244 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-c5bb8646-992f-43c1-bcf0-f224173afccc req-82e4d819-632a-4066-b692-7e0b46d45ccb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089423 Aug 07 01:18:11.113495 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 777/1759] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:18:11.125012 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-ed067f59-7f13-4982-8f30-7a40cc7dcde6 req-7186d352-a465-4d31-bb27-ed0f55f26f68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa4650a8-deed-48a3-9502-cc4ab8b6ca0c", "tag": "ed2e89b9-2eef-45e9-9ab3-8ce1fcdcf47b"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:11.150966 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-ed067f59-7f13-4982-8f30-7a40cc7dcde6 req-7186d352-a465-4d31-bb27-ed0f55f26f68 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:11.152957 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-ed067f59-7f13-4982-8f30-7a40cc7dcde6 req-7186d352-a465-4d31-bb27-ed0f55f26f68 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:11.154550 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-ed067f59-7f13-4982-8f30-7a40cc7dcde6 req-7186d352-a465-4d31-bb27-ed0f55f26f68 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:11.183549 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-ed067f59-7f13-4982-8f30-7a40cc7dcde6 req-7186d352-a465-4d31-bb27-ed0f55f26f68 service nova] Creating event network-changed:ed2e89b9-2eef-45e9-9ab3-8ce1fcdcf47b for instance aa4650a8-deed-48a3-9502-cc4ab8b6ca0c on n-h2-master-1 Aug 07 01:18:11.189841 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-ed067f59-7f13-4982-8f30-7a40cc7dcde6 req-7186d352-a465-4d31-bb27-ed0f55f26f68 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073455 Aug 07 01:18:11.191005 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 778/1760] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:18:11.212089 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-033a85aa-9b21-439c-88b7-6d41ca2a9bf0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:11.214050 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-033a85aa-9b21-439c-88b7-6d41ca2a9bf0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d44d731f-5443-4a7c-9a8d-8e330fd1639d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:11.224802 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-033a85aa-9b21-439c-88b7-6d41ca2a9bf0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:11.225633 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-033a85aa-9b21-439c-88b7-6d41ca2a9bf0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:11.226369 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-033a85aa-9b21-439c-88b7-6d41ca2a9bf0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:11.227272 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-033a85aa-9b21-439c-88b7-6d41ca2a9bf0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:11.227935 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-033a85aa-9b21-439c-88b7-6d41ca2a9bf0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:11.228991 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-033a85aa-9b21-439c-88b7-6d41ca2a9bf0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:12.327352 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-033a85aa-9b21-439c-88b7-6d41ca2a9bf0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:12.344144 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-033a85aa-9b21-439c-88b7-6d41ca2a9bf0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d" status: 200 len: 1318 microversion: 2.1 time: 1.151248 Aug 07 01:18:12.366429 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 779/1761] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:11 2022] GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d => generated 1318 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:12.384576 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8d0009bc-0457-441f-9a58-9ff99e78f4f5 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:12.389279 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8d0009bc-0457-441f-9a58-9ff99e78f4f5 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:12.400194 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8d0009bc-0457-441f-9a58-9ff99e78f4f5 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:12.400967 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8d0009bc-0457-441f-9a58-9ff99e78f4f5 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:12.401616 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8d0009bc-0457-441f-9a58-9ff99e78f4f5 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:12.402562 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8d0009bc-0457-441f-9a58-9ff99e78f4f5 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:12.403197 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8d0009bc-0457-441f-9a58-9ff99e78f4f5 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:12.403793 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8d0009bc-0457-441f-9a58-9ff99e78f4f5 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:12.782411 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-72603914-0432-44e7-b8ac-01232898b2e1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:12.834747 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-72603914-0432-44e7-b8ac-01232898b2e1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1313 microversion: 2.1 time: 1.830615 Aug 07 01:18:12.864135 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 983/1762] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:11 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1313 bytes in 1861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:12.879673 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-29f8dbe2-9b32-45ca-b234-20299d50283e req-47a7f64b-4e14-47eb-89ab-63dbb7281c46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e006496-fa0b-4e7a-8c5d-a3724b172720", "tag": "dcf52ab3-da5a-473c-accb-60d75e843c85"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:12.902404 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-29f8dbe2-9b32-45ca-b234-20299d50283e req-47a7f64b-4e14-47eb-89ab-63dbb7281c46 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:12.902970 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-29f8dbe2-9b32-45ca-b234-20299d50283e req-47a7f64b-4e14-47eb-89ab-63dbb7281c46 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:12.904157 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-29f8dbe2-9b32-45ca-b234-20299d50283e req-47a7f64b-4e14-47eb-89ab-63dbb7281c46 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:12.947208 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-29f8dbe2-9b32-45ca-b234-20299d50283e req-47a7f64b-4e14-47eb-89ab-63dbb7281c46 service nova] Creating event network-changed:dcf52ab3-da5a-473c-accb-60d75e843c85 for instance 2e006496-fa0b-4e7a-8c5d-a3724b172720 on n-h2-master-1 Aug 07 01:18:12.973965 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-29f8dbe2-9b32-45ca-b234-20299d50283e req-47a7f64b-4e14-47eb-89ab-63dbb7281c46 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104641 Aug 07 01:18:12.979953 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 984/1763] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:18:12.993498 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b4bcd07a-6b05-4588-948b-da89d65c6e1b tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:13.025081 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b4bcd07a-6b05-4588-948b-da89d65c6e1b tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] [instance: aa4650a8-deed-48a3-9502-cc4ab8b6ca0c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:13.073121 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4bcd07a-6b05-4588-948b-da89d65c6e1b tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:13.073616 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4bcd07a-6b05-4588-948b-da89d65c6e1b tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:13.074060 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4bcd07a-6b05-4588-948b-da89d65c6e1b tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:13.074792 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4bcd07a-6b05-4588-948b-da89d65c6e1b tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:13.083081 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4bcd07a-6b05-4588-948b-da89d65c6e1b tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:13.087535 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4bcd07a-6b05-4588-948b-da89d65c6e1b tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:13.719200 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=4 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:13.804593 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=14 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:13.958919 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b4bcd07a-6b05-4588-948b-da89d65c6e1b tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd2118b664634f1297fe908f30609f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010990a44647402c9a355de2ec0176a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:14.032078 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b4bcd07a-6b05-4588-948b-da89d65c6e1b tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c" status: 200 len: 1316 microversion: 2.1 time: 1.048686 Aug 07 01:18:14.037061 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 985/1764] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:12 2022] GET /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c => generated 1316 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:14.058240 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6e88b514-3d81-40f3-a824-54a010d1f118 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e298e6a60>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:14.185735 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6e88b514-3d81-40f3-a824-54a010d1f118 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/628a7b3a-d5f5-4d29-9524-17454a5cfe53" status: 200 len: 1454 microversion: 2.1 time: 0.140240 Aug 07 01:18:14.189020 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 986/1765] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:18:14 2022] GET /compute/v2.1/images/628a7b3a-d5f5-4d29-9524-17454a5cfe53 => generated 1454 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:14.201623 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c0ff2537-417a-48a8-b45f-cc08738561fc tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:14.202568 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c0ff2537-417a-48a8-b45f-cc08738561fc tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:14.214444 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c0ff2537-417a-48a8-b45f-cc08738561fc tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:14.220162 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c0ff2537-417a-48a8-b45f-cc08738561fc tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:14.220725 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c0ff2537-417a-48a8-b45f-cc08738561fc tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:14.221777 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c0ff2537-417a-48a8-b45f-cc08738561fc tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:14.222619 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c0ff2537-417a-48a8-b45f-cc08738561fc tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:14.223274 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c0ff2537-417a-48a8-b45f-cc08738561fc tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:14.597764 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c0ff2537-417a-48a8-b45f-cc08738561fc tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:14.598144 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8d0009bc-0457-441f-9a58-9ff99e78f4f5 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:14.611865 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c0ff2537-417a-48a8-b45f-cc08738561fc tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:14.614218 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c0ff2537-417a-48a8-b45f-cc08738561fc tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:14.617839 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8d0009bc-0457-441f-9a58-9ff99e78f4f5 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1392 microversion: 2.1 time: 2.249974 Aug 07 01:18:14.618813 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 780/1766] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:12 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1392 bytes in 2251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:14.619834 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c0ff2537-417a-48a8-b45f-cc08738561fc tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a" status: 200 len: 1361 microversion: 2.25 time: 0.429543 Aug 07 01:18:14.620854 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 987/1767] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:18:14 2022] GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a => generated 1361 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:18:14.623528 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-785ed15b-9b25-442c-9244-504da82086e2 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:14.624206 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-785ed15b-9b25-442c-9244-504da82086e2 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d44d731f-5443-4a7c-9a8d-8e330fd1639d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:14.638426 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8de304e3-ea3d-4466-8f67-dc1bf4a48986 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:14.639366 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8de304e3-ea3d-4466-8f67-dc1bf4a48986 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:14.639547 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-785ed15b-9b25-442c-9244-504da82086e2 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:14.640144 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-785ed15b-9b25-442c-9244-504da82086e2 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:14.640594 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-785ed15b-9b25-442c-9244-504da82086e2 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:14.641382 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-785ed15b-9b25-442c-9244-504da82086e2 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:14.641866 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-785ed15b-9b25-442c-9244-504da82086e2 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:14.644773 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-785ed15b-9b25-442c-9244-504da82086e2 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:14.647125 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8de304e3-ea3d-4466-8f67-dc1bf4a48986 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:14.647624 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8de304e3-ea3d-4466-8f67-dc1bf4a48986 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:14.648095 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8de304e3-ea3d-4466-8f67-dc1bf4a48986 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:14.648819 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8de304e3-ea3d-4466-8f67-dc1bf4a48986 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:14.649280 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8de304e3-ea3d-4466-8f67-dc1bf4a48986 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:14.649714 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8de304e3-ea3d-4466-8f67-dc1bf4a48986 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:15.307663 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-785ed15b-9b25-442c-9244-504da82086e2 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:15.311179 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:15.321580 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-785ed15b-9b25-442c-9244-504da82086e2 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d" status: 200 len: 1507 microversion: 2.1 time: 0.701632 Aug 07 01:18:15.332496 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 781/1768] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:14 2022] GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d => generated 1507 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:15.340715 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8a78623a-5de9-4ed8-8482-fcb88e3abdf2 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:15.344890 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8a78623a-5de9-4ed8-8482-fcb88e3abdf2 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] [instance: aa4650a8-deed-48a3-9502-cc4ab8b6ca0c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:15.365471 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a78623a-5de9-4ed8-8482-fcb88e3abdf2 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:15.366471 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a78623a-5de9-4ed8-8482-fcb88e3abdf2 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:15.375906 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a78623a-5de9-4ed8-8482-fcb88e3abdf2 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:15.377264 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a78623a-5de9-4ed8-8482-fcb88e3abdf2 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:15.378140 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a78623a-5de9-4ed8-8482-fcb88e3abdf2 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:15.378912 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a78623a-5de9-4ed8-8482-fcb88e3abdf2 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:15.544871 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8de304e3-ea3d-4466-8f67-dc1bf4a48986 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:15.577309 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8de304e3-ea3d-4466-8f67-dc1bf4a48986 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1313 microversion: 2.1 time: 0.955065 Aug 07 01:18:15.579579 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 988/1769] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:14 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1313 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:15.585816 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6bb33f8a-c974-4914-a5b8-692aa548bd22 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e249b0ca0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:15.647221 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6bb33f8a-c974-4914-a5b8-692aa548bd22 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/628a7b3a-d5f5-4d29-9524-17454a5cfe53" status: 200 len: 1454 microversion: 2.1 time: 0.066015 Aug 07 01:18:15.657400 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 989/1770] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:18:15 2022] GET /compute/v2.1/images/628a7b3a-d5f5-4d29-9524-17454a5cfe53 => generated 1454 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:15.663618 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-826d62c1-a059-4c40-b75d-88b465a79eca tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:15.664940 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-826d62c1-a059-4c40-b75d-88b465a79eca tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d44d731f-5443-4a7c-9a8d-8e330fd1639d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:15.673168 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-826d62c1-a059-4c40-b75d-88b465a79eca tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:15.674154 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-826d62c1-a059-4c40-b75d-88b465a79eca tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:15.675541 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-826d62c1-a059-4c40-b75d-88b465a79eca tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:15.676813 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-826d62c1-a059-4c40-b75d-88b465a79eca tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:15.677719 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-826d62c1-a059-4c40-b75d-88b465a79eca tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:15.679122 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-826d62c1-a059-4c40-b75d-88b465a79eca tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:16.302688 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8a78623a-5de9-4ed8-8482-fcb88e3abdf2 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd2118b664634f1297fe908f30609f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010990a44647402c9a355de2ec0176a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:16.312835 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8a78623a-5de9-4ed8-8482-fcb88e3abdf2 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c" status: 200 len: 1316 microversion: 2.1 time: 0.978712 Aug 07 01:18:16.317290 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 782/1771] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:15 2022] GET /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c => generated 1316 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:16.332328 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-9b9b57fe-caa2-4831-a64d-78f59f851170 req-e356937e-913d-4a99-820b-32452f3f3a0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a", "tag": "94432de4-2b7a-4c0b-a025-991a9fe958e7"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:16.354782 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-826d62c1-a059-4c40-b75d-88b465a79eca tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:16.363390 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-9b9b57fe-caa2-4831-a64d-78f59f851170 req-e356937e-913d-4a99-820b-32452f3f3a0a service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:16.364481 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-9b9b57fe-caa2-4831-a64d-78f59f851170 req-e356937e-913d-4a99-820b-32452f3f3a0a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:16.365160 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-9b9b57fe-caa2-4831-a64d-78f59f851170 req-e356937e-913d-4a99-820b-32452f3f3a0a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:16.369428 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-826d62c1-a059-4c40-b75d-88b465a79eca tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d" status: 200 len: 1507 microversion: 2.1 time: 0.710369 Aug 07 01:18:16.371112 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 990/1772] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:15 2022] GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d => generated 1507 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:16.385403 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-83c52c2b-b9be-4d62-8524-d8f6dd8825cc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:16.386389 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-83c52c2b-b9be-4d62-8524-d8f6dd8825cc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:16.399225 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-9b9b57fe-caa2-4831-a64d-78f59f851170 req-e356937e-913d-4a99-820b-32452f3f3a0a service nova] Creating event network-changed:94432de4-2b7a-4c0b-a025-991a9fe958e7 for instance 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a on n-h1-master-1 Aug 07 01:18:16.405089 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83c52c2b-b9be-4d62-8524-d8f6dd8825cc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:16.405588 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83c52c2b-b9be-4d62-8524-d8f6dd8825cc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:16.406029 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83c52c2b-b9be-4d62-8524-d8f6dd8825cc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:16.406748 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83c52c2b-b9be-4d62-8524-d8f6dd8825cc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:16.412632 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83c52c2b-b9be-4d62-8524-d8f6dd8825cc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:16.418996 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83c52c2b-b9be-4d62-8524-d8f6dd8825cc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:16.426330 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-9b9b57fe-caa2-4831-a64d-78f59f851170 req-e356937e-913d-4a99-820b-32452f3f3a0a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107446 Aug 07 01:18:16.426946 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 783/1773] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:18:16.432079 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1c9d9734-775d-4c48-a492-b498921f7521 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:16.432844 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1c9d9734-775d-4c48-a492-b498921f7521 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:16.463691 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c9d9734-775d-4c48-a492-b498921f7521 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:16.468556 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c9d9734-775d-4c48-a492-b498921f7521 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:16.469246 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c9d9734-775d-4c48-a492-b498921f7521 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:16.470166 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c9d9734-775d-4c48-a492-b498921f7521 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:16.470826 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c9d9734-775d-4c48-a492-b498921f7521 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:16.472040 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c9d9734-775d-4c48-a492-b498921f7521 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:16.904538 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-83c52c2b-b9be-4d62-8524-d8f6dd8825cc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:16.919876 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-83c52c2b-b9be-4d62-8524-d8f6dd8825cc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1392 microversion: 2.1 time: 0.543328 Aug 07 01:18:16.920837 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 991/1774] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:16 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1392 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:16.934357 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-0b536f78-683e-46b0-8104-cd54fb176df1 req-be6569cd-e23f-4aa4-b9cd-bc7b1643c338 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a4508ef-5167-4c2c-8bba-4a47c875263b", "tag": "2ce99914-7226-47ae-b72b-c5f4c2bc3fac"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:16.961596 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0b536f78-683e-46b0-8104-cd54fb176df1 req-be6569cd-e23f-4aa4-b9cd-bc7b1643c338 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:16.962357 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0b536f78-683e-46b0-8104-cd54fb176df1 req-be6569cd-e23f-4aa4-b9cd-bc7b1643c338 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:16.962961 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0b536f78-683e-46b0-8104-cd54fb176df1 req-be6569cd-e23f-4aa4-b9cd-bc7b1643c338 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:16.988360 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-0b536f78-683e-46b0-8104-cd54fb176df1 req-be6569cd-e23f-4aa4-b9cd-bc7b1643c338 service nova] Creating event network-changed:2ce99914-7226-47ae-b72b-c5f4c2bc3fac for instance 7a4508ef-5167-4c2c-8bba-4a47c875263b on n-h1-master-1 Aug 07 01:18:17.007590 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-0b536f78-683e-46b0-8104-cd54fb176df1 req-be6569cd-e23f-4aa4-b9cd-bc7b1643c338 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083249 Aug 07 01:18:17.013428 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 992/1775] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:18:17.035854 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-31c76e62-b3f6-483d-932e-fb01486858fe tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:17.044288 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-31c76e62-b3f6-483d-932e-fb01486858fe tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d44d731f-5443-4a7c-9a8d-8e330fd1639d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:17.069706 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31c76e62-b3f6-483d-932e-fb01486858fe tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:17.076016 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31c76e62-b3f6-483d-932e-fb01486858fe tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:17.078486 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31c76e62-b3f6-483d-932e-fb01486858fe tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:17.079461 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31c76e62-b3f6-483d-932e-fb01486858fe tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:17.082749 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31c76e62-b3f6-483d-932e-fb01486858fe tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:17.086004 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31c76e62-b3f6-483d-932e-fb01486858fe tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:17.926418 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1c9d9734-775d-4c48-a492-b498921f7521 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:18.000961 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1c9d9734-775d-4c48-a492-b498921f7521 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:18.002654 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1c9d9734-775d-4c48-a492-b498921f7521 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:18.003827 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1c9d9734-775d-4c48-a492-b498921f7521 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a" status: 200 len: 1361 microversion: 2.25 time: 1.575794 Aug 07 01:18:18.013261 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 784/1776] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:18:16 2022] GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a => generated 1361 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:18:18.338569 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f9acbe70-3144-4732-b80a-d29d07cd357b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:18.339266 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f9acbe70-3144-4732-b80a-d29d07cd357b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:18.359658 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:18.362569 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f9acbe70-3144-4732-b80a-d29d07cd357b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:18.363072 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f9acbe70-3144-4732-b80a-d29d07cd357b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:18.363511 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f9acbe70-3144-4732-b80a-d29d07cd357b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:18.364261 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f9acbe70-3144-4732-b80a-d29d07cd357b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:18.364714 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f9acbe70-3144-4732-b80a-d29d07cd357b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:18.365135 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f9acbe70-3144-4732-b80a-d29d07cd357b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:19.109424 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f9acbe70-3144-4732-b80a-d29d07cd357b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:19.118197 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f9acbe70-3144-4732-b80a-d29d07cd357b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1313 microversion: 2.1 time: 1.103716 Aug 07 01:18:19.118785 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 785/1777] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:18 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1313 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:19.131462 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-17f305f3-2b4a-4b50-8986-0a653061ba1b tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e17fe7dc0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:22.380814 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-17f305f3-2b4a-4b50-8986-0a653061ba1b tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/628a7b3a-d5f5-4d29-9524-17454a5cfe53" status: 200 len: 1454 microversion: 2.1 time: 3.260876 Aug 07 01:18:22.390246 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 786/1778] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:18:19 2022] GET /compute/v2.1/images/628a7b3a-d5f5-4d29-9524-17454a5cfe53 => generated 1454 bytes in 3271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:22.418865 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7fde9256-8de7-460c-9135-c04b22f42632 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:22.419600 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7fde9256-8de7-460c-9135-c04b22f42632 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] [instance: aa4650a8-deed-48a3-9502-cc4ab8b6ca0c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:22.422283 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-31c76e62-b3f6-483d-932e-fb01486858fe tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:18:22.422829 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-31c76e62-b3f6-483d-932e-fb01486858fe tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:18:22.429676 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-31c76e62-b3f6-483d-932e-fb01486858fe tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:18:22.430199 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-31c76e62-b3f6-483d-932e-fb01486858fe tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:18:22.433082 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-31c76e62-b3f6-483d-932e-fb01486858fe tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:18:22.439247 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7fde9256-8de7-460c-9135-c04b22f42632 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:22.448995 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7fde9256-8de7-460c-9135-c04b22f42632 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:22.449498 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7fde9256-8de7-460c-9135-c04b22f42632 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:22.450271 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7fde9256-8de7-460c-9135-c04b22f42632 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:22.455158 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7fde9256-8de7-460c-9135-c04b22f42632 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:22.456923 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7fde9256-8de7-460c-9135-c04b22f42632 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:22.664431 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-31c76e62-b3f6-483d-932e-fb01486858fe tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d44d731f-5443-4a7c-9a8d-8e330fd1639d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:22.701790 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31c76e62-b3f6-483d-932e-fb01486858fe tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:22.719752 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31c76e62-b3f6-483d-932e-fb01486858fe tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:22.720442 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31c76e62-b3f6-483d-932e-fb01486858fe tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:22.724205 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31c76e62-b3f6-483d-932e-fb01486858fe tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:22.725360 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31c76e62-b3f6-483d-932e-fb01486858fe tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:22.727743 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31c76e62-b3f6-483d-932e-fb01486858fe tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:22.870180 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-31c76e62-b3f6-483d-932e-fb01486858fe tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "POST /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d/action" status: 202 len: 1109 microversion: 2.1 time: 5.853337 Aug 07 01:18:22.871479 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 993/1779] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:18:17 2022] POST /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d/action => generated 1109 bytes in 5857 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 07 01:18:23.277595 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-05bf8265-89eb-4e4b-8f84-2904e86a3035 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1164272335", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "339d8f21-b38d-49c3-8efe-8ffee4d616dc"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:23.373115 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7fde9256-8de7-460c-9135-c04b22f42632 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd2118b664634f1297fe908f30609f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010990a44647402c9a355de2ec0176a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:23.382534 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7fde9256-8de7-460c-9135-c04b22f42632 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c" status: 200 len: 1316 microversion: 2.1 time: 0.991070 Aug 07 01:18:23.387042 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 787/1780] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:22 2022] GET /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c => generated 1316 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:23.403016 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bec59f13-e910-4009-aae1-8abb0927ac2c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:23.405609 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bec59f13-e910-4009-aae1-8abb0927ac2c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:23.427662 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bec59f13-e910-4009-aae1-8abb0927ac2c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:23.433054 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bec59f13-e910-4009-aae1-8abb0927ac2c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:23.433658 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bec59f13-e910-4009-aae1-8abb0927ac2c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:23.434716 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bec59f13-e910-4009-aae1-8abb0927ac2c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:23.435708 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bec59f13-e910-4009-aae1-8abb0927ac2c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:23.436619 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bec59f13-e910-4009-aae1-8abb0927ac2c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:23.544184 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-05bf8265-89eb-4e4b-8f84-2904e86a3035 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] validate_networks() for [('339d8f21-b38d-49c3-8efe-8ffee4d616dc', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:18:23.932987 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bec59f13-e910-4009-aae1-8abb0927ac2c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:23.952329 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bec59f13-e910-4009-aae1-8abb0927ac2c tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1392 microversion: 2.1 time: 0.563524 Aug 07 01:18:23.954799 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 788/1781] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:23 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1392 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:23.987521 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a2b7735e-efc9-48cf-bc7a-7f71bc4d701b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:24.020978 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a2b7735e-efc9-48cf-bc7a-7f71bc4d701b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:24.056100 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2b7735e-efc9-48cf-bc7a-7f71bc4d701b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:24.059061 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2b7735e-efc9-48cf-bc7a-7f71bc4d701b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:24.064924 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2b7735e-efc9-48cf-bc7a-7f71bc4d701b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:24.066480 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2b7735e-efc9-48cf-bc7a-7f71bc4d701b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:24.067197 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2b7735e-efc9-48cf-bc7a-7f71bc4d701b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:24.069011 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2b7735e-efc9-48cf-bc7a-7f71bc4d701b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:25.270137 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-05bf8265-89eb-4e4b-8f84-2904e86a3035 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:18:25.270658 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-05bf8265-89eb-4e4b-8f84-2904e86a3035 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:18:25.270958 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-05bf8265-89eb-4e4b-8f84-2904e86a3035 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:18:25.271368 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-05bf8265-89eb-4e4b-8f84-2904e86a3035 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:18:25.271779 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-05bf8265-89eb-4e4b-8f84-2904e86a3035 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:18:25.303084 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05bf8265-89eb-4e4b-8f84-2904e86a3035 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:25.315713 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05bf8265-89eb-4e4b-8f84-2904e86a3035 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:25.316381 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05bf8265-89eb-4e4b-8f84-2904e86a3035 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:25.317356 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05bf8265-89eb-4e4b-8f84-2904e86a3035 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:25.317814 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05bf8265-89eb-4e4b-8f84-2904e86a3035 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:25.329993 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05bf8265-89eb-4e4b-8f84-2904e86a3035 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:25.429547 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a2b7735e-efc9-48cf-bc7a-7f71bc4d701b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:25.437402 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-05bf8265-89eb-4e4b-8f84-2904e86a3035 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Getting quotas for project efad066360cb45b3a6e9ba872118ea57. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:18:25.441478 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a2b7735e-efc9-48cf-bc7a-7f71bc4d701b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:25.445683 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a2b7735e-efc9-48cf-bc7a-7f71bc4d701b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:25.456281 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a2b7735e-efc9-48cf-bc7a-7f71bc4d701b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a" status: 200 len: 1361 microversion: 2.25 time: 1.495255 Aug 07 01:18:25.464324 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 789/1782] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:18:23 2022] GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a => generated 1361 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:18:25.467815 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-05bf8265-89eb-4e4b-8f84-2904e86a3035 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Getting quotas for user d4f7282c7251455086368d5274a4fac5 and project efad066360cb45b3a6e9ba872118ea57. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:18:25.495030 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-42760358-8ed1-4c1d-abd5-a392e99c29e6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:25.496107 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-42760358-8ed1-4c1d-abd5-a392e99c29e6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:25.521901 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-42760358-8ed1-4c1d-abd5-a392e99c29e6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:25.523208 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-42760358-8ed1-4c1d-abd5-a392e99c29e6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:25.524055 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-42760358-8ed1-4c1d-abd5-a392e99c29e6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:25.525106 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-42760358-8ed1-4c1d-abd5-a392e99c29e6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:25.525834 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-42760358-8ed1-4c1d-abd5-a392e99c29e6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:25.526510 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-42760358-8ed1-4c1d-abd5-a392e99c29e6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:25.539734 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-05bf8265-89eb-4e4b-8f84-2904e86a3035 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:18:25.554228 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-05bf8265-89eb-4e4b-8f84-2904e86a3035 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 27c77ddb-09a6-49e0-bdca-0e6c23c18c56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:18:25.792390 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-05bf8265-89eb-4e4b-8f84-2904e86a3035 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.918937 Aug 07 01:18:25.816703 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 994/1783] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:18:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:18:25.827532 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-933cd7b7-a6f9-46af-a561-544f9db995fe req-c78a38dd-893b-432e-bf54-d275922ddedc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa4650a8-deed-48a3-9502-cc4ab8b6ca0c", "name": "network-vif-plugged", "status": "completed", "tag": "ed2e89b9-2eef-45e9-9ab3-8ce1fcdcf47b"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:25.862321 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-933cd7b7-a6f9-46af-a561-544f9db995fe req-c78a38dd-893b-432e-bf54-d275922ddedc service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:25.866072 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-933cd7b7-a6f9-46af-a561-544f9db995fe req-c78a38dd-893b-432e-bf54-d275922ddedc service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:25.866885 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-933cd7b7-a6f9-46af-a561-544f9db995fe req-c78a38dd-893b-432e-bf54-d275922ddedc service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:25.909702 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-933cd7b7-a6f9-46af-a561-544f9db995fe req-c78a38dd-893b-432e-bf54-d275922ddedc service nova] Creating event network-vif-plugged:ed2e89b9-2eef-45e9-9ab3-8ce1fcdcf47b for instance aa4650a8-deed-48a3-9502-cc4ab8b6ca0c on n-h2-master-1 Aug 07 01:18:25.930886 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-933cd7b7-a6f9-46af-a561-544f9db995fe req-c78a38dd-893b-432e-bf54-d275922ddedc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111990 Aug 07 01:18:25.935411 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 995/1784] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:18:25.943703 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3ce595e1-d42b-407c-961c-4773f7d8a94a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:25.950335 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3ce595e1-d42b-407c-961c-4773f7d8a94a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d44d731f-5443-4a7c-9a8d-8e330fd1639d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:25.984494 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ce595e1-d42b-407c-961c-4773f7d8a94a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:25.987722 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ce595e1-d42b-407c-961c-4773f7d8a94a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:25.988307 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ce595e1-d42b-407c-961c-4773f7d8a94a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:25.989186 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ce595e1-d42b-407c-961c-4773f7d8a94a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:25.990057 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ce595e1-d42b-407c-961c-4773f7d8a94a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:25.992570 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ce595e1-d42b-407c-961c-4773f7d8a94a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:26.062281 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-42760358-8ed1-4c1d-abd5-a392e99c29e6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:26.093972 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-42760358-8ed1-4c1d-abd5-a392e99c29e6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1313 microversion: 2.1 time: 0.616822 Aug 07 01:18:26.100140 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 790/1785] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:25 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1313 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:26.113672 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-77b15998-3a10-4350-9143-6359515456f1 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e17fe70d0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:26.241983 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-77b15998-3a10-4350-9143-6359515456f1 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/628a7b3a-d5f5-4d29-9524-17454a5cfe53" status: 200 len: 1454 microversion: 2.1 time: 0.140229 Aug 07 01:18:26.253683 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 791/1786] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:18:26 2022] GET /compute/v2.1/images/628a7b3a-d5f5-4d29-9524-17454a5cfe53 => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:26.274768 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-146aeddf-30c1-4dcd-9714-e70513d8d6e6 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:26.275433 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-146aeddf-30c1-4dcd-9714-e70513d8d6e6 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] [instance: aa4650a8-deed-48a3-9502-cc4ab8b6ca0c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:26.289863 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-146aeddf-30c1-4dcd-9714-e70513d8d6e6 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:26.291978 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-146aeddf-30c1-4dcd-9714-e70513d8d6e6 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:26.293426 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-146aeddf-30c1-4dcd-9714-e70513d8d6e6 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:26.297131 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-146aeddf-30c1-4dcd-9714-e70513d8d6e6 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:26.300361 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-146aeddf-30c1-4dcd-9714-e70513d8d6e6 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:26.301240 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-146aeddf-30c1-4dcd-9714-e70513d8d6e6 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:26.353374 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3ce595e1-d42b-407c-961c-4773f7d8a94a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:26.369380 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3ce595e1-d42b-407c-961c-4773f7d8a94a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d" status: 200 len: 1514 microversion: 2.1 time: 0.432114 Aug 07 01:18:26.370182 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 996/1787] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:25 2022] GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d => generated 1514 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:26.394979 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-34e14a2f-85b0-4e77-a428-c2fdc36ce429 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:26.416034 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-34e14a2f-85b0-4e77-a428-c2fdc36ce429 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:26.431261 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34e14a2f-85b0-4e77-a428-c2fdc36ce429 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:26.432568 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34e14a2f-85b0-4e77-a428-c2fdc36ce429 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:26.433830 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34e14a2f-85b0-4e77-a428-c2fdc36ce429 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:26.437831 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34e14a2f-85b0-4e77-a428-c2fdc36ce429 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:26.438434 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34e14a2f-85b0-4e77-a428-c2fdc36ce429 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:26.438977 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34e14a2f-85b0-4e77-a428-c2fdc36ce429 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:26.846571 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-34e14a2f-85b0-4e77-a428-c2fdc36ce429 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:26.856856 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:26.875744 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-34e14a2f-85b0-4e77-a428-c2fdc36ce429 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1382 microversion: 2.1 time: 0.493526 Aug 07 01:18:26.882940 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 997/1788] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:26 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1382 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:26.913960 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-97fd3d75-00dd-44fb-a06e-cfc621a76f59 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:26.920124 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-97fd3d75-00dd-44fb-a06e-cfc621a76f59 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 27c77ddb-09a6-49e0-bdca-0e6c23c18c56] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:27.133785 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-97fd3d75-00dd-44fb-a06e-cfc621a76f59 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:27.141460 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-97fd3d75-00dd-44fb-a06e-cfc621a76f59 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/27c77ddb-09a6-49e0-bdca-0e6c23c18c56" status: 200 len: 1193 microversion: 2.1 time: 0.245362 Aug 07 01:18:27.165172 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 998/1789] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:26 2022] GET /compute/v2.1/servers/27c77ddb-09a6-49e0-bdca-0e6c23c18c56 => generated 1193 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:27.170328 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-99855aa7-9b8b-4df6-8df3-f4d610cbb63a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:27.188081 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-99855aa7-9b8b-4df6-8df3-f4d610cbb63a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:27.196572 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99855aa7-9b8b-4df6-8df3-f4d610cbb63a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:27.211469 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99855aa7-9b8b-4df6-8df3-f4d610cbb63a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:27.212299 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99855aa7-9b8b-4df6-8df3-f4d610cbb63a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:27.217334 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99855aa7-9b8b-4df6-8df3-f4d610cbb63a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:27.219435 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99855aa7-9b8b-4df6-8df3-f4d610cbb63a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:27.220163 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99855aa7-9b8b-4df6-8df3-f4d610cbb63a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:27.290432 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-146aeddf-30c1-4dcd-9714-e70513d8d6e6 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd2118b664634f1297fe908f30609f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010990a44647402c9a355de2ec0176a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:27.322352 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-146aeddf-30c1-4dcd-9714-e70513d8d6e6 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c" status: 200 len: 1316 microversion: 2.1 time: 1.066724 Aug 07 01:18:27.323283 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 792/1790] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:26 2022] GET /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c => generated 1316 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:27.328574 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d86404a4-6028-4920-b973-77bac9c9b58b tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Calling method '.version_select at 0x7f9e24359a60>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:27.343875 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d86404a4-6028-4920-b973-77bac9c9b58b tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:27.349482 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d86404a4-6028-4920-b973-77bac9c9b58b tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:27.350026 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d86404a4-6028-4920-b973-77bac9c9b58b tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:27.407910 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d86404a4-6028-4920-b973-77bac9c9b58b tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 3114 microversion: 2.1 time: 0.082623 Aug 07 01:18:27.409314 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 793/1791] 10.222.0.39 () {58 vars in 1143 bytes} [Sun Aug 7 01:18:27 2022] GET /compute/v2.1/os-migrations => generated 3114 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:27.439104 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-44d3d7ae-63d3-4fab-8488-06dd23374fbc tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:27.443020 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-44d3d7ae-63d3-4fab-8488-06dd23374fbc tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:27.458569 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44d3d7ae-63d3-4fab-8488-06dd23374fbc tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:27.463429 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44d3d7ae-63d3-4fab-8488-06dd23374fbc tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:27.464428 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44d3d7ae-63d3-4fab-8488-06dd23374fbc tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:27.469482 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44d3d7ae-63d3-4fab-8488-06dd23374fbc tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:27.470550 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44d3d7ae-63d3-4fab-8488-06dd23374fbc tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:27.472303 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44d3d7ae-63d3-4fab-8488-06dd23374fbc tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:27.651232 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-99855aa7-9b8b-4df6-8df3-f4d610cbb63a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:27.676739 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-99855aa7-9b8b-4df6-8df3-f4d610cbb63a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:27.680761 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-99855aa7-9b8b-4df6-8df3-f4d610cbb63a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:27.684581 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-99855aa7-9b8b-4df6-8df3-f4d610cbb63a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a" status: 200 len: 1361 microversion: 2.25 time: 0.517236 Aug 07 01:18:27.691203 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 999/1792] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:18:27 2022] GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a => generated 1361 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:18:27.703228 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-84c15cd1-eeac-4c23-990a-6113f6266203 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e298e6160>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:27.817642 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-84c15cd1-eeac-4c23-990a-6113f6266203 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/628a7b3a-d5f5-4d29-9524-17454a5cfe53" status: 200 len: 1454 microversion: 2.1 time: 0.123075 Aug 07 01:18:27.827094 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1000/1793] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:18:27 2022] GET /compute/v2.1/images/628a7b3a-d5f5-4d29-9524-17454a5cfe53 => generated 1454 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:27.833023 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-19c136d5-4aea-4db3-a0d5-a5bf8ccea6fc tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:27.834130 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-19c136d5-4aea-4db3-a0d5-a5bf8ccea6fc tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d44d731f-5443-4a7c-9a8d-8e330fd1639d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:27.841811 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-19c136d5-4aea-4db3-a0d5-a5bf8ccea6fc tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:27.842707 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-19c136d5-4aea-4db3-a0d5-a5bf8ccea6fc tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:27.843404 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-19c136d5-4aea-4db3-a0d5-a5bf8ccea6fc tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:27.844444 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-19c136d5-4aea-4db3-a0d5-a5bf8ccea6fc tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:27.845187 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-19c136d5-4aea-4db3-a0d5-a5bf8ccea6fc tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:27.845526 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-44d3d7ae-63d3-4fab-8488-06dd23374fbc tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:27.846165 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-19c136d5-4aea-4db3-a0d5-a5bf8ccea6fc tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:27.856972 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-44d3d7ae-63d3-4fab-8488-06dd23374fbc tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1313 microversion: 2.1 time: 0.433196 Aug 07 01:18:27.862564 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 794/1794] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:27 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1313 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:27.910841 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e2633241-45c0-425a-8bb9-3a8661405042 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:27.912681 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e2633241-45c0-425a-8bb9-3a8661405042 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:27.925801 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e2633241-45c0-425a-8bb9-3a8661405042 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:27.927143 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e2633241-45c0-425a-8bb9-3a8661405042 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:27.928207 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e2633241-45c0-425a-8bb9-3a8661405042 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:27.930191 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e2633241-45c0-425a-8bb9-3a8661405042 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:27.931201 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e2633241-45c0-425a-8bb9-3a8661405042 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:27.932294 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e2633241-45c0-425a-8bb9-3a8661405042 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:28.207823 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-19c136d5-4aea-4db3-a0d5-a5bf8ccea6fc tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:28.224801 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-19c136d5-4aea-4db3-a0d5-a5bf8ccea6fc tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d" status: 200 len: 1514 microversion: 2.1 time: 0.394689 Aug 07 01:18:28.229060 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1001/1795] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:27 2022] GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d => generated 1514 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:28.239796 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-3cf480f0-6eeb-453c-8914-03afd9257fca req-3563b294-cd28-4bae-af5c-520f7bb135f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a", "name": "network-vif-plugged", "status": "completed", "tag": "94432de4-2b7a-4c0b-a025-991a9fe958e7"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:28.261702 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3cf480f0-6eeb-453c-8914-03afd9257fca req-3563b294-cd28-4bae-af5c-520f7bb135f3 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:28.264274 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3cf480f0-6eeb-453c-8914-03afd9257fca req-3563b294-cd28-4bae-af5c-520f7bb135f3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:28.265912 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3cf480f0-6eeb-453c-8914-03afd9257fca req-3563b294-cd28-4bae-af5c-520f7bb135f3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:28.313105 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-3cf480f0-6eeb-453c-8914-03afd9257fca req-3563b294-cd28-4bae-af5c-520f7bb135f3 service nova] Creating event network-vif-plugged:94432de4-2b7a-4c0b-a025-991a9fe958e7 for instance 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a on n-h1-master-1 Aug 07 01:18:28.320249 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-3cf480f0-6eeb-453c-8914-03afd9257fca req-3563b294-cd28-4bae-af5c-520f7bb135f3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089432 Aug 07 01:18:28.326168 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1002/1796] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:18:28.332907 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dd168a75-ba56-4b7d-9262-6284eab362a1 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:28.334002 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-dd168a75-ba56-4b7d-9262-6284eab362a1 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 27c77ddb-09a6-49e0-bdca-0e6c23c18c56] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:28.351169 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd168a75-ba56-4b7d-9262-6284eab362a1 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:28.352013 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd168a75-ba56-4b7d-9262-6284eab362a1 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:28.352779 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd168a75-ba56-4b7d-9262-6284eab362a1 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:28.353752 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd168a75-ba56-4b7d-9262-6284eab362a1 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:28.354428 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd168a75-ba56-4b7d-9262-6284eab362a1 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:28.355247 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd168a75-ba56-4b7d-9262-6284eab362a1 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:28.436288 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e2633241-45c0-425a-8bb9-3a8661405042 tempest-LiveMigrationTest-82452175 tempest-LiveMigrationTest-82452175-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1533 microversion: 2.1 time: 0.568911 Aug 07 01:18:28.449648 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 795/1797] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:27 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1533 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:28.452233 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-dd168a75-ba56-4b7d-9262-6284eab362a1 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:28.463345 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-dd168a75-ba56-4b7d-9262-6284eab362a1 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/27c77ddb-09a6-49e0-bdca-0e6c23c18c56" status: 200 len: 1189 microversion: 2.1 time: 0.134841 Aug 07 01:18:28.467692 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-460947c7-e2b2-4c02-bf4d-87326ceecb86 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:28.471431 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1003/1798] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:28 2022] GET /compute/v2.1/servers/27c77ddb-09a6-49e0-bdca-0e6c23c18c56 => generated 1189 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:28.472958 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-460947c7-e2b2-4c02-bf4d-87326ceecb86 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] [instance: aa4650a8-deed-48a3-9502-cc4ab8b6ca0c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:28.523679 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-460947c7-e2b2-4c02-bf4d-87326ceecb86 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:28.525553 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-460947c7-e2b2-4c02-bf4d-87326ceecb86 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:28.528806 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-460947c7-e2b2-4c02-bf4d-87326ceecb86 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:28.530235 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-460947c7-e2b2-4c02-bf4d-87326ceecb86 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:28.533080 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-460947c7-e2b2-4c02-bf4d-87326ceecb86 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:28.534089 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-460947c7-e2b2-4c02-bf4d-87326ceecb86 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:28.549905 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-62490dfa-a4c7-4e14-83ab-b79069f91f0e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:28.551304 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-62490dfa-a4c7-4e14-83ab-b79069f91f0e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:28.579901 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62490dfa-a4c7-4e14-83ab-b79069f91f0e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:28.581815 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62490dfa-a4c7-4e14-83ab-b79069f91f0e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:28.582633 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62490dfa-a4c7-4e14-83ab-b79069f91f0e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:28.585024 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62490dfa-a4c7-4e14-83ab-b79069f91f0e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:28.629046 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62490dfa-a4c7-4e14-83ab-b79069f91f0e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.044s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:28.630200 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62490dfa-a4c7-4e14-83ab-b79069f91f0e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:28.759699 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-62490dfa-a4c7-4e14-83ab-b79069f91f0e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:18:28.789947 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-460947c7-e2b2-4c02-bf4d-87326ceecb86 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd2118b664634f1297fe908f30609f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010990a44647402c9a355de2ec0176a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:28.807032 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-460947c7-e2b2-4c02-bf4d-87326ceecb86 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c" status: 200 len: 1316 microversion: 2.1 time: 0.355523 Aug 07 01:18:28.819714 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 796/1799] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:28 2022] GET /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c => generated 1316 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:28.841942 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3007f870-a83d-4bc0-980c-ae9927c6cc6d tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:28.843277 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3007f870-a83d-4bc0-980c-ae9927c6cc6d tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:28.854540 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3007f870-a83d-4bc0-980c-ae9927c6cc6d tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:28.855369 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3007f870-a83d-4bc0-980c-ae9927c6cc6d tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:28.856033 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3007f870-a83d-4bc0-980c-ae9927c6cc6d tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:28.856990 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3007f870-a83d-4bc0-980c-ae9927c6cc6d tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:28.857693 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3007f870-a83d-4bc0-980c-ae9927c6cc6d tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:28.858295 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3007f870-a83d-4bc0-980c-ae9927c6cc6d tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:28.993606 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-62490dfa-a4c7-4e14-83ab-b79069f91f0e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 204 len: 0 microversion: 2.1 time: 0.462892 Aug 07 01:18:28.998062 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1004/1800] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:18:28 2022] DELETE /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:18:29.028191 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5d5cacba-6b06-417a-92ea-e8fccebf9010 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e2990c790>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:29.159159 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3007f870-a83d-4bc0-980c-ae9927c6cc6d tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:29.166514 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5d5cacba-6b06-417a-92ea-e8fccebf9010 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/628a7b3a-d5f5-4d29-9524-17454a5cfe53" status: 200 len: 1454 microversion: 2.1 time: 0.169839 Aug 07 01:18:29.178963 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1005/1801] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:18:28 2022] GET /compute/v2.1/images/628a7b3a-d5f5-4d29-9524-17454a5cfe53 => generated 1454 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:29.181393 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3007f870-a83d-4bc0-980c-ae9927c6cc6d tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:29.185454 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7acb8782-576d-43c0-a9e1-53ff41b110d2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:29.186605 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7acb8782-576d-43c0-a9e1-53ff41b110d2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:29.202793 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3007f870-a83d-4bc0-980c-ae9927c6cc6d tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:29.202793 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3007f870-a83d-4bc0-980c-ae9927c6cc6d tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a" status: 200 len: 1361 microversion: 2.25 time: 0.373213 Aug 07 01:18:29.202793 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 797/1802] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:18:28 2022] GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a => generated 1361 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:18:29.202793 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1edc9c1a-e488-4708-be04-ec670bb66692 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:29.203320 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1edc9c1a-e488-4708-be04-ec670bb66692 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:29.218207 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7acb8782-576d-43c0-a9e1-53ff41b110d2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:29.218741 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7acb8782-576d-43c0-a9e1-53ff41b110d2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:29.219351 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7acb8782-576d-43c0-a9e1-53ff41b110d2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:29.219705 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1edc9c1a-e488-4708-be04-ec670bb66692 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:29.220141 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7acb8782-576d-43c0-a9e1-53ff41b110d2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:29.220614 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7acb8782-576d-43c0-a9e1-53ff41b110d2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:29.221606 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7acb8782-576d-43c0-a9e1-53ff41b110d2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:29.222055 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1edc9c1a-e488-4708-be04-ec670bb66692 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:29.222931 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1edc9c1a-e488-4708-be04-ec670bb66692 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:29.224109 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1edc9c1a-e488-4708-be04-ec670bb66692 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:29.225646 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1edc9c1a-e488-4708-be04-ec670bb66692 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:29.227073 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1edc9c1a-e488-4708-be04-ec670bb66692 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:29.511672 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1edc9c1a-e488-4708-be04-ec670bb66692 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:29.523064 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1edc9c1a-e488-4708-be04-ec670bb66692 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1388 microversion: 2.1 time: 0.324712 Aug 07 01:18:29.524660 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 798/1803] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:29 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1388 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:29.532406 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7acb8782-576d-43c0-a9e1-53ff41b110d2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:29.534616 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bc213618-b892-4fed-91d1-c9cd7d6d62f5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:29.535611 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bc213618-b892-4fed-91d1-c9cd7d6d62f5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d44d731f-5443-4a7c-9a8d-8e330fd1639d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:29.555924 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc213618-b892-4fed-91d1-c9cd7d6d62f5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:29.556994 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc213618-b892-4fed-91d1-c9cd7d6d62f5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:29.557711 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc213618-b892-4fed-91d1-c9cd7d6d62f5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:29.558752 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc213618-b892-4fed-91d1-c9cd7d6d62f5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:29.559547 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc213618-b892-4fed-91d1-c9cd7d6d62f5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:29.561137 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc213618-b892-4fed-91d1-c9cd7d6d62f5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:29.585197 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7acb8782-576d-43c0-a9e1-53ff41b110d2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1313 microversion: 2.1 time: 0.400665 Aug 07 01:18:29.596977 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1006/1804] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:29 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1313 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:29.621027 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2e47d320-4197-4ed0-b466-7da885881517 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:29.622443 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2e47d320-4197-4ed0-b466-7da885881517 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 27c77ddb-09a6-49e0-bdca-0e6c23c18c56] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:29.650121 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2e47d320-4197-4ed0-b466-7da885881517 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:29.652081 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2e47d320-4197-4ed0-b466-7da885881517 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:29.654634 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2e47d320-4197-4ed0-b466-7da885881517 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:29.656127 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2e47d320-4197-4ed0-b466-7da885881517 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:29.659668 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2e47d320-4197-4ed0-b466-7da885881517 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:29.661742 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2e47d320-4197-4ed0-b466-7da885881517 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:29.806560 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2e47d320-4197-4ed0-b466-7da885881517 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:29.829910 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2e47d320-4197-4ed0-b466-7da885881517 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/27c77ddb-09a6-49e0-bdca-0e6c23c18c56" status: 200 len: 1189 microversion: 2.1 time: 0.230289 Aug 07 01:18:29.832287 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1007/1805] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:29 2022] GET /compute/v2.1/servers/27c77ddb-09a6-49e0-bdca-0e6c23c18c56 => generated 1189 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:29.850977 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bc213618-b892-4fed-91d1-c9cd7d6d62f5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:29.859108 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bc213618-b892-4fed-91d1-c9cd7d6d62f5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d" status: 200 len: 1514 microversion: 2.1 time: 0.333026 Aug 07 01:18:29.864443 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 799/1806] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:29 2022] GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d => generated 1514 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:29.866488 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1ffabb98-04d8-4542-82bb-86ec52d70add tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:29.867088 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1ffabb98-04d8-4542-82bb-86ec52d70add tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] [instance: aa4650a8-deed-48a3-9502-cc4ab8b6ca0c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:29.892314 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ffabb98-04d8-4542-82bb-86ec52d70add tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:29.893399 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ffabb98-04d8-4542-82bb-86ec52d70add tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:29.893862 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ffabb98-04d8-4542-82bb-86ec52d70add tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:29.894581 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ffabb98-04d8-4542-82bb-86ec52d70add tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:29.895302 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ffabb98-04d8-4542-82bb-86ec52d70add tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:29.895728 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ffabb98-04d8-4542-82bb-86ec52d70add tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:30.172953 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1ffabb98-04d8-4542-82bb-86ec52d70add tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd2118b664634f1297fe908f30609f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010990a44647402c9a355de2ec0176a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:30.198872 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1ffabb98-04d8-4542-82bb-86ec52d70add tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c" status: 200 len: 1505 microversion: 2.1 time: 0.357631 Aug 07 01:18:30.200787 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bf7d95af-36a9-4b64-accd-5d343640fddf tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e17fc58b0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:30.204455 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1008/1807] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:29 2022] GET /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c => generated 1505 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:30.228880 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-74fe9351-1375-469f-82cf-31d0c31758ce tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:30.229519 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-74fe9351-1375-469f-82cf-31d0c31758ce tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] [instance: aa4650a8-deed-48a3-9502-cc4ab8b6ca0c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:30.262503 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-74fe9351-1375-469f-82cf-31d0c31758ce tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:30.264343 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-74fe9351-1375-469f-82cf-31d0c31758ce tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:30.268518 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-74fe9351-1375-469f-82cf-31d0c31758ce tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:30.275337 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-74fe9351-1375-469f-82cf-31d0c31758ce tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:30.275969 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-74fe9351-1375-469f-82cf-31d0c31758ce tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:30.276418 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-74fe9351-1375-469f-82cf-31d0c31758ce tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:30.339248 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bf7d95af-36a9-4b64-accd-5d343640fddf tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/628a7b3a-d5f5-4d29-9524-17454a5cfe53" status: 200 len: 1463 microversion: 2.1 time: 0.147840 Aug 07 01:18:30.348622 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 800/1808] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:18:30 2022] GET /compute/v2.1/images/628a7b3a-d5f5-4d29-9524-17454a5cfe53 => generated 1463 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:30.348622 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-13c3c06d-8e22-497b-aa56-3753631a8f68 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:30.349139 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-13c3c06d-8e22-497b-aa56-3753631a8f68 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:30.375608 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-74fe9351-1375-469f-82cf-31d0c31758ce tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] [instance: aa4650a8-deed-48a3-9502-cc4ab8b6ca0c] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:18:30.384104 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13c3c06d-8e22-497b-aa56-3753631a8f68 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:30.384592 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13c3c06d-8e22-497b-aa56-3753631a8f68 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:30.385025 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13c3c06d-8e22-497b-aa56-3753631a8f68 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:30.385737 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13c3c06d-8e22-497b-aa56-3753631a8f68 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:30.386187 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13c3c06d-8e22-497b-aa56-3753631a8f68 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:30.386606 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13c3c06d-8e22-497b-aa56-3753631a8f68 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:30.551742 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-74fe9351-1375-469f-82cf-31d0c31758ce tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] 10.222.0.39 "DELETE /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c" status: 204 len: 0 microversion: 2.1 time: 0.328327 Aug 07 01:18:30.552499 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1009/1809] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:18:30 2022] DELETE /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 07 01:18:30.557973 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0f4df42f-b615-4e7b-919e-bccaeb0c3114 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e298edee0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:30.646691 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0f4df42f-b615-4e7b-919e-bccaeb0c3114 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/628a7b3a-d5f5-4d29-9524-17454a5cfe53" status: 200 len: 1463 microversion: 2.1 time: 0.092686 Aug 07 01:18:30.655898 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1010/1810] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:18:30 2022] GET /compute/v2.1/images/628a7b3a-d5f5-4d29-9524-17454a5cfe53 => generated 1463 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:30.661645 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-e8205ef9-462b-4ec3-b27e-225c4176d672 req-86a61182-f89c-4bbf-96c9-eb9996491f17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a4508ef-5167-4c2c-8bba-4a47c875263b", "name": "network-vif-plugged", "status": "completed", "tag": "2ce99914-7226-47ae-b72b-c5f4c2bc3fac"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:30.690874 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e8205ef9-462b-4ec3-b27e-225c4176d672 req-86a61182-f89c-4bbf-96c9-eb9996491f17 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:30.692393 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e8205ef9-462b-4ec3-b27e-225c4176d672 req-86a61182-f89c-4bbf-96c9-eb9996491f17 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:30.694107 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e8205ef9-462b-4ec3-b27e-225c4176d672 req-86a61182-f89c-4bbf-96c9-eb9996491f17 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:30.722236 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-e8205ef9-462b-4ec3-b27e-225c4176d672 req-86a61182-f89c-4bbf-96c9-eb9996491f17 service nova] Creating event network-vif-plugged:2ce99914-7226-47ae-b72b-c5f4c2bc3fac for instance 7a4508ef-5167-4c2c-8bba-4a47c875263b on n-h1-master-1 Aug 07 01:18:30.744430 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-e8205ef9-462b-4ec3-b27e-225c4176d672 req-86a61182-f89c-4bbf-96c9-eb9996491f17 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077065 Aug 07 01:18:30.744430 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1011/1811] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:18:30.750443 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ef8e6968-5bf9-46e6-8dcd-50ca500d4b08 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:30.751971 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ef8e6968-5bf9-46e6-8dcd-50ca500d4b08 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] [instance: aa4650a8-deed-48a3-9502-cc4ab8b6ca0c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:30.761197 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef8e6968-5bf9-46e6-8dcd-50ca500d4b08 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:30.762059 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef8e6968-5bf9-46e6-8dcd-50ca500d4b08 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:30.762543 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef8e6968-5bf9-46e6-8dcd-50ca500d4b08 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:30.763395 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef8e6968-5bf9-46e6-8dcd-50ca500d4b08 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:30.764968 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef8e6968-5bf9-46e6-8dcd-50ca500d4b08 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:30.765518 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef8e6968-5bf9-46e6-8dcd-50ca500d4b08 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:30.840000 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-13c3c06d-8e22-497b-aa56-3753631a8f68 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:30.847497 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-13c3c06d-8e22-497b-aa56-3753631a8f68 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:30.854761 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-13c3c06d-8e22-497b-aa56-3753631a8f68 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:30.860631 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-13c3c06d-8e22-497b-aa56-3753631a8f68 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a" status: 200 len: 1361 microversion: 2.25 time: 0.519014 Aug 07 01:18:30.880758 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 801/1812] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:18:30 2022] GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a => generated 1361 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:18:30.895650 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-13dbfd0c-ddce-4e88-8b8a-d584ef1b33cc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:30.897179 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-13dbfd0c-ddce-4e88-8b8a-d584ef1b33cc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:30.906162 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13dbfd0c-ddce-4e88-8b8a-d584ef1b33cc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:30.907131 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13dbfd0c-ddce-4e88-8b8a-d584ef1b33cc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:30.907823 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13dbfd0c-ddce-4e88-8b8a-d584ef1b33cc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:30.908969 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13dbfd0c-ddce-4e88-8b8a-d584ef1b33cc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:30.910893 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13dbfd0c-ddce-4e88-8b8a-d584ef1b33cc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:30.911619 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13dbfd0c-ddce-4e88-8b8a-d584ef1b33cc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:31.019769 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-13dbfd0c-ddce-4e88-8b8a-d584ef1b33cc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:31.028141 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:31.031146 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-13dbfd0c-ddce-4e88-8b8a-d584ef1b33cc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1346 microversion: 2.1 time: 0.148440 Aug 07 01:18:31.032485 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 802/1813] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:30 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1346 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:31.039322 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-eb74bb25-1108-4508-9b33-ba4f398b79a3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:31.040405 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-eb74bb25-1108-4508-9b33-ba4f398b79a3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:31.050896 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb74bb25-1108-4508-9b33-ba4f398b79a3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:31.051866 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb74bb25-1108-4508-9b33-ba4f398b79a3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:31.052621 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb74bb25-1108-4508-9b33-ba4f398b79a3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:31.054031 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb74bb25-1108-4508-9b33-ba4f398b79a3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:31.056026 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb74bb25-1108-4508-9b33-ba4f398b79a3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:31.056942 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb74bb25-1108-4508-9b33-ba4f398b79a3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:31.276313 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-eb74bb25-1108-4508-9b33-ba4f398b79a3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:31.285575 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-eb74bb25-1108-4508-9b33-ba4f398b79a3 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1313 microversion: 2.1 time: 0.251612 Aug 07 01:18:31.304765 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 803/1814] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:31 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:31.309827 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ff8396ea-43a4-4d7e-94e4-0b6fd191c8f1 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:31.310445 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ff8396ea-43a4-4d7e-94e4-0b6fd191c8f1 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] [instance: 9e2ae24f-8349-46d5-b091-876927d02b68] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:31.330346 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ff8396ea-43a4-4d7e-94e4-0b6fd191c8f1 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:31.331122 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ff8396ea-43a4-4d7e-94e4-0b6fd191c8f1 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:31.331826 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ff8396ea-43a4-4d7e-94e4-0b6fd191c8f1 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:31.333076 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ff8396ea-43a4-4d7e-94e4-0b6fd191c8f1 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:31.333725 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ff8396ea-43a4-4d7e-94e4-0b6fd191c8f1 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:31.334427 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ff8396ea-43a4-4d7e-94e4-0b6fd191c8f1 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:31.544288 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ef8e6968-5bf9-46e6-8dcd-50ca500d4b08 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd2118b664634f1297fe908f30609f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010990a44647402c9a355de2ec0176a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:31.565764 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ef8e6968-5bf9-46e6-8dcd-50ca500d4b08 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c" status: 200 len: 1511 microversion: 2.1 time: 0.816502 Aug 07 01:18:31.565764 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1012/1815] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:30 2022] GET /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c => generated 1511 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:31.577937 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9d86cd30-d5a9-4ec2-b361-38c6428e11d6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:31.581946 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9d86cd30-d5a9-4ec2-b361-38c6428e11d6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 27c77ddb-09a6-49e0-bdca-0e6c23c18c56] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:31.591747 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d86cd30-d5a9-4ec2-b361-38c6428e11d6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:31.592266 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d86cd30-d5a9-4ec2-b361-38c6428e11d6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:31.592701 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d86cd30-d5a9-4ec2-b361-38c6428e11d6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:31.593591 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d86cd30-d5a9-4ec2-b361-38c6428e11d6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:31.593891 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d86cd30-d5a9-4ec2-b361-38c6428e11d6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:31.594277 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d86cd30-d5a9-4ec2-b361-38c6428e11d6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:31.627102 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ff8396ea-43a4-4d7e-94e4-0b6fd191c8f1 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '786962988b754fb69bd48070c2992e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614797cd26be4995b087ab864f35d235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:31.637554 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ff8396ea-43a4-4d7e-94e4-0b6fd191c8f1 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68" status: 200 len: 1465 microversion: 2.1 time: 0.331417 Aug 07 01:18:31.639377 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 804/1816] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:31 2022] GET /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68 => generated 1465 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:31.650902 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f7de0774-f3f1-4f8b-b780-0ca57d81dd3a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:31.651529 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f7de0774-f3f1-4f8b-b780-0ca57d81dd3a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d44d731f-5443-4a7c-9a8d-8e330fd1639d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:31.666227 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f7de0774-f3f1-4f8b-b780-0ca57d81dd3a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:31.670203 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f7de0774-f3f1-4f8b-b780-0ca57d81dd3a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:31.670653 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f7de0774-f3f1-4f8b-b780-0ca57d81dd3a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:31.675040 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f7de0774-f3f1-4f8b-b780-0ca57d81dd3a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:31.675516 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f7de0774-f3f1-4f8b-b780-0ca57d81dd3a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:31.676190 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f7de0774-f3f1-4f8b-b780-0ca57d81dd3a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:31.782791 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9d86cd30-d5a9-4ec2-b361-38c6428e11d6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:31.808381 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9d86cd30-d5a9-4ec2-b361-38c6428e11d6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/27c77ddb-09a6-49e0-bdca-0e6c23c18c56" status: 200 len: 1251 microversion: 2.1 time: 0.245395 Aug 07 01:18:31.826553 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1013/1817] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:31 2022] GET /compute/v2.1/servers/27c77ddb-09a6-49e0-bdca-0e6c23c18c56 => generated 1251 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:31.851225 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-969ed319-0cca-4b6c-a1c4-17c357669b4c tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2126123893"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:31.860156 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-969ed319-0cca-4b6c-a1c4-17c357669b4c tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] [instance: d2dbfd1a-efab-4943-b00a-6cdd1051489c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:31.877484 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-969ed319-0cca-4b6c-a1c4-17c357669b4c tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:31.877985 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-969ed319-0cca-4b6c-a1c4-17c357669b4c tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:31.882356 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-969ed319-0cca-4b6c-a1c4-17c357669b4c tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:31.883304 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-969ed319-0cca-4b6c-a1c4-17c357669b4c tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:31.883793 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-969ed319-0cca-4b6c-a1c4-17c357669b4c tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:31.884282 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-969ed319-0cca-4b6c-a1c4-17c357669b4c tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:32.292984 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f7de0774-f3f1-4f8b-b780-0ca57d81dd3a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:32.337942 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-969ed319-0cca-4b6c-a1c4-17c357669b4c tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "POST /compute/v2.1/servers/d2dbfd1a-efab-4943-b00a-6cdd1051489c/action" status: 202 len: 0 microversion: 2.1 time: 0.502525 Aug 07 01:18:32.337942 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1014/1818] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:18:31 2022] POST /compute/v2.1/servers/d2dbfd1a-efab-4943-b00a-6cdd1051489c/action => generated 0 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 07 01:18:32.348075 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-dfdbcd03-a268-4696-bf3a-91db4f7422cc req-28f61889-a5fa-4566-abd7-0e83f08a6971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e006496-fa0b-4e7a-8c5d-a3724b172720", "name": "network-vif-deleted", "tag": "dcf52ab3-da5a-473c-accb-60d75e843c85"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:32.372144 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f7de0774-f3f1-4f8b-b780-0ca57d81dd3a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d" status: 200 len: 1514 microversion: 2.1 time: 0.730067 Aug 07 01:18:32.398295 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 805/1819] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:31 2022] GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d => generated 1514 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:32.406158 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-dfdbcd03-a268-4696-bf3a-91db4f7422cc req-28f61889-a5fa-4566-abd7-0e83f08a6971 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:32.413256 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-dfdbcd03-a268-4696-bf3a-91db4f7422cc req-28f61889-a5fa-4566-abd7-0e83f08a6971 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:32.414302 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-dfdbcd03-a268-4696-bf3a-91db4f7422cc req-28f61889-a5fa-4566-abd7-0e83f08a6971 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:32.415419 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3b74d926-c963-4de0-81fe-3092be86ffd7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:32.426834 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3b74d926-c963-4de0-81fe-3092be86ffd7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:32.429912 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:32.443876 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b74d926-c963-4de0-81fe-3092be86ffd7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:32.446176 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b74d926-c963-4de0-81fe-3092be86ffd7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:32.446657 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b74d926-c963-4de0-81fe-3092be86ffd7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:32.447422 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b74d926-c963-4de0-81fe-3092be86ffd7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:32.447921 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b74d926-c963-4de0-81fe-3092be86ffd7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:32.448368 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b74d926-c963-4de0-81fe-3092be86ffd7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:32.482955 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-dfdbcd03-a268-4696-bf3a-91db4f7422cc req-28f61889-a5fa-4566-abd7-0e83f08a6971 service nova] Creating event network-vif-deleted:dcf52ab3-da5a-473c-accb-60d75e843c85 for instance 2e006496-fa0b-4e7a-8c5d-a3724b172720 on n-h1-master-1 Aug 07 01:18:32.514347 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-dfdbcd03-a268-4696-bf3a-91db4f7422cc req-28f61889-a5fa-4566-abd7-0e83f08a6971 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176436 Aug 07 01:18:32.518179 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1015/1820] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:18:32.529723 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cf2e8505-e2b5-4824-a1c6-5554173e2446 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:32.531981 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cf2e8505-e2b5-4824-a1c6-5554173e2446 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:32.574016 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cf2e8505-e2b5-4824-a1c6-5554173e2446 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:32.576878 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cf2e8505-e2b5-4824-a1c6-5554173e2446 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:32.577981 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cf2e8505-e2b5-4824-a1c6-5554173e2446 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:32.579577 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cf2e8505-e2b5-4824-a1c6-5554173e2446 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:32.580774 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cf2e8505-e2b5-4824-a1c6-5554173e2446 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:32.581894 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cf2e8505-e2b5-4824-a1c6-5554173e2446 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:33.237892 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cf2e8505-e2b5-4824-a1c6-5554173e2446 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:33.257024 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cf2e8505-e2b5-4824-a1c6-5554173e2446 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1184 microversion: 2.1 time: 0.734055 Aug 07 01:18:33.272390 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1016/1821] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:32 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1184 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:33.291395 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-80063253-3a23-4650-9a73-36895a6aaec1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:33.292495 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-80063253-3a23-4650-9a73-36895a6aaec1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:33.322509 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80063253-3a23-4650-9a73-36895a6aaec1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:33.323357 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80063253-3a23-4650-9a73-36895a6aaec1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:33.324963 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80063253-3a23-4650-9a73-36895a6aaec1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:33.325500 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80063253-3a23-4650-9a73-36895a6aaec1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:33.326180 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80063253-3a23-4650-9a73-36895a6aaec1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:33.326916 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80063253-3a23-4650-9a73-36895a6aaec1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:33.412586 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3b74d926-c963-4de0-81fe-3092be86ffd7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:33.428288 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3b74d926-c963-4de0-81fe-3092be86ffd7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:33.430282 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3b74d926-c963-4de0-81fe-3092be86ffd7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:33.431524 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3b74d926-c963-4de0-81fe-3092be86ffd7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a" status: 200 len: 1556 microversion: 2.25 time: 1.020041 Aug 07 01:18:33.439604 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 806/1822] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:18:32 2022] GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a => generated 1556 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:18:33.445091 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-43079398-2906-4f23-8f38-1084dda650e9 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e17fffa60>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:33.587361 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-43079398-2906-4f23-8f38-1084dda650e9 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/0bc8a99f-bbcc-4030-8b43-689c49c72915" status: 200 len: 1455 microversion: 2.1 time: 0.145864 Aug 07 01:18:33.590054 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 807/1823] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:18:33 2022] GET /compute/v2.1/images/0bc8a99f-bbcc-4030-8b43-689c49c72915 => generated 1455 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:33.598313 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-706eebe1-c67b-4517-82c0-be976a8498b0 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:33.600663 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-706eebe1-c67b-4517-82c0-be976a8498b0 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] [instance: aa4650a8-deed-48a3-9502-cc4ab8b6ca0c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:33.614486 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-706eebe1-c67b-4517-82c0-be976a8498b0 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:33.615232 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-706eebe1-c67b-4517-82c0-be976a8498b0 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:33.616005 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-706eebe1-c67b-4517-82c0-be976a8498b0 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:33.617180 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-706eebe1-c67b-4517-82c0-be976a8498b0 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:33.617786 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-706eebe1-c67b-4517-82c0-be976a8498b0 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:33.618542 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-706eebe1-c67b-4517-82c0-be976a8498b0 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:33.724275 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-80063253-3a23-4650-9a73-36895a6aaec1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:33.736228 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-80063253-3a23-4650-9a73-36895a6aaec1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1462 microversion: 2.1 time: 0.462239 Aug 07 01:18:33.737326 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1017/1824] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:33 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1462 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:33.742104 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-51619c30-0c43-4541-aaad-55dc5ba850c4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:33.742748 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-51619c30-0c43-4541-aaad-55dc5ba850c4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 27c77ddb-09a6-49e0-bdca-0e6c23c18c56] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:33.767247 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51619c30-0c43-4541-aaad-55dc5ba850c4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:33.767935 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51619c30-0c43-4541-aaad-55dc5ba850c4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:33.768425 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51619c30-0c43-4541-aaad-55dc5ba850c4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:33.772127 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51619c30-0c43-4541-aaad-55dc5ba850c4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:33.773401 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51619c30-0c43-4541-aaad-55dc5ba850c4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:33.773771 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51619c30-0c43-4541-aaad-55dc5ba850c4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:33.864564 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-51619c30-0c43-4541-aaad-55dc5ba850c4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:33.874639 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-51619c30-0c43-4541-aaad-55dc5ba850c4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/27c77ddb-09a6-49e0-bdca-0e6c23c18c56" status: 200 len: 1251 microversion: 2.1 time: 0.136040 Aug 07 01:18:33.876086 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1018/1825] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:33 2022] GET /compute/v2.1/servers/27c77ddb-09a6-49e0-bdca-0e6c23c18c56 => generated 1251 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:33.881725 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1796fd83-7b2e-42f1-9e88-b83ea4efa1ed tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:33.882594 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1796fd83-7b2e-42f1-9e88-b83ea4efa1ed tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d44d731f-5443-4a7c-9a8d-8e330fd1639d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:33.890422 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1796fd83-7b2e-42f1-9e88-b83ea4efa1ed tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:33.893716 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1796fd83-7b2e-42f1-9e88-b83ea4efa1ed tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:33.894507 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1796fd83-7b2e-42f1-9e88-b83ea4efa1ed tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:33.895740 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1796fd83-7b2e-42f1-9e88-b83ea4efa1ed tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:33.896236 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1796fd83-7b2e-42f1-9e88-b83ea4efa1ed tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:33.896661 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1796fd83-7b2e-42f1-9e88-b83ea4efa1ed tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:34.123380 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1796fd83-7b2e-42f1-9e88-b83ea4efa1ed tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:34.142705 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1796fd83-7b2e-42f1-9e88-b83ea4efa1ed tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d" status: 200 len: 1514 microversion: 2.1 time: 0.265293 Aug 07 01:18:34.161968 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1019/1826] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:33 2022] GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d => generated 1514 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:34.186488 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c3c437c8-3315-4fe7-ad25-6aaa4970c902 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:34.186488 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c3c437c8-3315-4fe7-ad25-6aaa4970c902 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] [instance: 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:34.186488 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:34.186488 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3c437c8-3315-4fe7-ad25-6aaa4970c902 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:34.187429 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3c437c8-3315-4fe7-ad25-6aaa4970c902 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:34.187429 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3c437c8-3315-4fe7-ad25-6aaa4970c902 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:34.187429 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3c437c8-3315-4fe7-ad25-6aaa4970c902 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:34.188221 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3c437c8-3315-4fe7-ad25-6aaa4970c902 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:34.188221 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3c437c8-3315-4fe7-ad25-6aaa4970c902 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:34.304351 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-706eebe1-c67b-4517-82c0-be976a8498b0 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd2118b664634f1297fe908f30609f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010990a44647402c9a355de2ec0176a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:34.320474 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-706eebe1-c67b-4517-82c0-be976a8498b0 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c" status: 200 len: 1511 microversion: 2.1 time: 0.728327 Aug 07 01:18:34.322313 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 808/1827] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:33 2022] GET /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c => generated 1511 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:34.336343 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-826844d2-0223-4b5e-b812-747b6f0cf8ae tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:34.338328 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-826844d2-0223-4b5e-b812-747b6f0cf8ae tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:34.359042 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-826844d2-0223-4b5e-b812-747b6f0cf8ae tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:34.360250 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-826844d2-0223-4b5e-b812-747b6f0cf8ae tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:34.361287 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-826844d2-0223-4b5e-b812-747b6f0cf8ae tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:34.363193 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-826844d2-0223-4b5e-b812-747b6f0cf8ae tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:34.363879 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-826844d2-0223-4b5e-b812-747b6f0cf8ae tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:34.364555 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-826844d2-0223-4b5e-b812-747b6f0cf8ae tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:34.479503 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-c3c437c8-3315-4fe7-ad25-6aaa4970c902 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lazy-loading 'services' on Instance uuid 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:18:34.559948 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c3c437c8-3315-4fe7-ad25-6aaa4970c902 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a" status: 200 len: 2048 microversion: 2.25 time: 0.393427 Aug 07 01:18:34.575987 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1020/1828] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:18:34 2022] GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a => generated 2048 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:18:34.592032 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-40581be6-8d7b-4820-b6e6-39cd88547c36 req-01853f0e-00c2-4a86-aed6-1b20ba95afcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa4650a8-deed-48a3-9502-cc4ab8b6ca0c", "name": "network-vif-deleted", "tag": "ed2e89b9-2eef-45e9-9ab3-8ce1fcdcf47b"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:34.646321 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-40581be6-8d7b-4820-b6e6-39cd88547c36 req-01853f0e-00c2-4a86-aed6-1b20ba95afcb service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:34.647028 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-40581be6-8d7b-4820-b6e6-39cd88547c36 req-01853f0e-00c2-4a86-aed6-1b20ba95afcb service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:34.647584 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-40581be6-8d7b-4820-b6e6-39cd88547c36 req-01853f0e-00c2-4a86-aed6-1b20ba95afcb service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:34.660131 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-40581be6-8d7b-4820-b6e6-39cd88547c36 req-01853f0e-00c2-4a86-aed6-1b20ba95afcb service nova] Creating event network-vif-deleted:ed2e89b9-2eef-45e9-9ab3-8ce1fcdcf47b for instance aa4650a8-deed-48a3-9502-cc4ab8b6ca0c on n-h2-master-1 Aug 07 01:18:34.678232 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-40581be6-8d7b-4820-b6e6-39cd88547c36 req-01853f0e-00c2-4a86-aed6-1b20ba95afcb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111547 Aug 07 01:18:34.704052 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1021/1829] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:18:34.711353 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f271de75-9819-488b-9fb3-7c814b792e00 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:34.717731 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f271de75-9819-488b-9fb3-7c814b792e00 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:34.735507 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f271de75-9819-488b-9fb3-7c814b792e00 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:34.736271 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f271de75-9819-488b-9fb3-7c814b792e00 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:34.744054 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f271de75-9819-488b-9fb3-7c814b792e00 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:34.745010 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f271de75-9819-488b-9fb3-7c814b792e00 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:34.745616 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f271de75-9819-488b-9fb3-7c814b792e00 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:34.746189 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f271de75-9819-488b-9fb3-7c814b792e00 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:34.835670 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-826844d2-0223-4b5e-b812-747b6f0cf8ae tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1613 microversion: 2.1 time: 0.511696 Aug 07 01:18:34.848183 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 809/1830] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:34 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1613 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:34.851008 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-554a0742-d61b-4aa4-9070-aa04bc044e29 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:34.851912 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-554a0742-d61b-4aa4-9070-aa04bc044e29 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] [instance: 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:34.868716 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-554a0742-d61b-4aa4-9070-aa04bc044e29 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:34.869554 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-554a0742-d61b-4aa4-9070-aa04bc044e29 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:34.870238 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-554a0742-d61b-4aa4-9070-aa04bc044e29 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:34.874271 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-554a0742-d61b-4aa4-9070-aa04bc044e29 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:34.875202 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-554a0742-d61b-4aa4-9070-aa04bc044e29 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:34.876646 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-554a0742-d61b-4aa4-9070-aa04bc044e29 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:34.895435 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f271de75-9819-488b-9fb3-7c814b792e00 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:34.912714 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f271de75-9819-488b-9fb3-7c814b792e00 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1184 microversion: 2.1 time: 0.205312 Aug 07 01:18:34.913791 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1022/1831] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:34 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1184 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:34.920082 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-614d96bb-27de-4c4a-ad83-7d18e17633a5 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e298ee8b0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:35.026557 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-614d96bb-27de-4c4a-ad83-7d18e17633a5 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/0bc8a99f-bbcc-4030-8b43-689c49c72915" status: 200 len: 1455 microversion: 2.1 time: 0.102206 Aug 07 01:18:35.030109 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1023/1832] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:18:34 2022] GET /compute/v2.1/images/0bc8a99f-bbcc-4030-8b43-689c49c72915 => generated 1455 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:35.039955 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-e0994200-be9f-44c1-8480-f789ba6a0a0a req-1fd7d73e-cf5a-4718-8636-2e358a72aca7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e2ae24f-8349-46d5-b091-876927d02b68", "name": "network-vif-unplugged", "status": "completed", "tag": "63f23b72-85ce-4ced-9d43-dd32e2464731"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:35.051954 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e0994200-be9f-44c1-8480-f789ba6a0a0a req-1fd7d73e-cf5a-4718-8636-2e358a72aca7 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:35.052853 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e0994200-be9f-44c1-8480-f789ba6a0a0a req-1fd7d73e-cf5a-4718-8636-2e358a72aca7 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:35.053601 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e0994200-be9f-44c1-8480-f789ba6a0a0a req-1fd7d73e-cf5a-4718-8636-2e358a72aca7 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:35.092529 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-e0994200-be9f-44c1-8480-f789ba6a0a0a req-1fd7d73e-cf5a-4718-8636-2e358a72aca7 service nova] Creating event network-vif-unplugged:63f23b72-85ce-4ced-9d43-dd32e2464731 for instance 9e2ae24f-8349-46d5-b091-876927d02b68 on n-h1-master-1 Aug 07 01:18:35.103872 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-e0994200-be9f-44c1-8480-f789ba6a0a0a req-1fd7d73e-cf5a-4718-8636-2e358a72aca7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069609 Aug 07 01:18:35.105448 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1024/1833] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:18:35.111106 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8b05ec6c-b24c-4e14-b730-ad1fb61bd0e7 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:35.112925 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8b05ec6c-b24c-4e14-b730-ad1fb61bd0e7 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:35.121154 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b05ec6c-b24c-4e14-b730-ad1fb61bd0e7 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:35.122083 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b05ec6c-b24c-4e14-b730-ad1fb61bd0e7 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:35.122831 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b05ec6c-b24c-4e14-b730-ad1fb61bd0e7 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:35.124268 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b05ec6c-b24c-4e14-b730-ad1fb61bd0e7 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:35.125019 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b05ec6c-b24c-4e14-b730-ad1fb61bd0e7 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:35.125937 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b05ec6c-b24c-4e14-b730-ad1fb61bd0e7 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:35.222209 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8b05ec6c-b24c-4e14-b730-ad1fb61bd0e7 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'fd62e88119574de6b8a03ace83572773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57856e905c9940819ef8a5bac1a1f66f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:35.224607 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8b05ec6c-b24c-4e14-b730-ad1fb61bd0e7 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] flavor_id is None. Assuming migration. {{(pid=119516) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 07 01:18:35.225424 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8b05ec6c-b24c-4e14-b730-ad1fb61bd0e7 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119516) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 07 01:18:35.382586 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:35.538538 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-554a0742-d61b-4aa4-9070-aa04bc044e29 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lazy-loading 'services' on Instance uuid 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:18:35.571631 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-554a0742-d61b-4aa4-9070-aa04bc044e29 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a" status: 200 len: 2048 microversion: 2.25 time: 0.733710 Aug 07 01:18:35.576137 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 810/1834] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:18:34 2022] GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a => generated 2048 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:18:35.590989 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a4f58c84-1883-4b62-9cb8-85e44ef6506b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:35.592816 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a4f58c84-1883-4b62-9cb8-85e44ef6506b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 27c77ddb-09a6-49e0-bdca-0e6c23c18c56] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:35.610829 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4f58c84-1883-4b62-9cb8-85e44ef6506b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:35.612254 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4f58c84-1883-4b62-9cb8-85e44ef6506b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:35.615225 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4f58c84-1883-4b62-9cb8-85e44ef6506b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:35.616040 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4f58c84-1883-4b62-9cb8-85e44ef6506b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:35.616519 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4f58c84-1883-4b62-9cb8-85e44ef6506b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:35.621388 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4f58c84-1883-4b62-9cb8-85e44ef6506b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:35.813965 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8b05ec6c-b24c-4e14-b730-ad1fb61bd0e7 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b/action" status: 202 len: 0 microversion: 2.1 time: 0.705169 Aug 07 01:18:35.817599 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1025/1835] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:18:35 2022] POST /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b/action => generated 0 bytes in 711 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:18:35.834153 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9cfc87a3-f39e-419c-a8e9-f9de94c9e1ae tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:35.835250 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9cfc87a3-f39e-419c-a8e9-f9de94c9e1ae tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d44d731f-5443-4a7c-9a8d-8e330fd1639d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:35.858338 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9cfc87a3-f39e-419c-a8e9-f9de94c9e1ae tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:35.860601 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9cfc87a3-f39e-419c-a8e9-f9de94c9e1ae tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:35.861254 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9cfc87a3-f39e-419c-a8e9-f9de94c9e1ae tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:35.864633 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9cfc87a3-f39e-419c-a8e9-f9de94c9e1ae tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:35.865417 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9cfc87a3-f39e-419c-a8e9-f9de94c9e1ae tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:35.868168 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9cfc87a3-f39e-419c-a8e9-f9de94c9e1ae tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:35.980836 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a4f58c84-1883-4b62-9cb8-85e44ef6506b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:35.993776 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a4f58c84-1883-4b62-9cb8-85e44ef6506b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/27c77ddb-09a6-49e0-bdca-0e6c23c18c56" status: 200 len: 1293 microversion: 2.1 time: 0.415966 Aug 07 01:18:36.008869 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 811/1836] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:35 2022] GET /compute/v2.1/servers/27c77ddb-09a6-49e0-bdca-0e6c23c18c56 => generated 1293 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:36.015251 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-da26f0ae-c5fc-448a-834c-3abc1615116c tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:36.017186 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-da26f0ae-c5fc-448a-834c-3abc1615116c tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] [instance: aa4650a8-deed-48a3-9502-cc4ab8b6ca0c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:36.027307 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da26f0ae-c5fc-448a-834c-3abc1615116c tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:36.028188 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da26f0ae-c5fc-448a-834c-3abc1615116c tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:36.028987 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da26f0ae-c5fc-448a-834c-3abc1615116c tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:36.029889 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da26f0ae-c5fc-448a-834c-3abc1615116c tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:36.030513 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da26f0ae-c5fc-448a-834c-3abc1615116c tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:36.031810 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da26f0ae-c5fc-448a-834c-3abc1615116c tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:36.051788 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-da26f0ae-c5fc-448a-834c-3abc1615116c tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] HTTP exception thrown: Instance aa4650a8-deed-48a3-9502-cc4ab8b6ca0c could not be found. Aug 07 01:18:36.053832 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-da26f0ae-c5fc-448a-834c-3abc1615116c tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Request method failure captured: Aug 07 01:18:36.053832 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c HTTP/1.1 Aug 07 01:18:36.053832 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:18:36.053832 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:18:36.053832 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:18:36.053832 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:18:36.053832 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:18:36.053832 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:18:36.053832 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:18:36.053832 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:18:36.053832 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xK_TbTyxekM5DzVKSxWArEscOrq7uc3gqo2yhGBo1GLbMRuKE7hMNVLj0a923K5bfQmyuh93vzLxf1z8jKHQ74_UgmVZR2p8pFZ8BX78IY3T9OS5I3uBPQPhaT5Wv79apYWhhPrmCW3OR2FQwRYCrkm4bHagFFJxmTNL1TDImZ1M1w Aug 07 01:18:36.053832 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:18:36.053832 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:18:36.053832 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:18:36.053832 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:18:36.053832 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:18:36.053832 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:18:36.053832 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 010990a44647402c9a355de2ec0176a7 Aug 07 01:18:36.053832 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ImagesNegativeTestJSON-728812729 Aug 07 01:18:36.053832 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:18:36.053832 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:18:36.055747 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/010990a44647402c9a355de2ec0176a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_010990a44647402c9a355de2ec0176a7", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/010990a44647402c9a355de2ec0176a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/010990a44647402c9a355de2ec0176a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:18:36.055747 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ImagesNegativeTestJSON-728812729 Aug 07 01:18:36.055747 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 010990a44647402c9a355de2ec0176a7 Aug 07 01:18:36.055747 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-728812729 Aug 07 01:18:36.055747 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ImagesNegativeTestJSON-728812729-project Aug 07 01:18:36.055747 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:18:36.055747 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:18:36.055747 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: bd2118b664634f1297fe908f30609f42 Aug 07 01:18:36.055747 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ImagesNegativeTestJSON-728812729-project Aug 07 01:18:36.055747 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:18:36.055747 n-d-master-1 devstack@n-api.service[119517]: exception: Instance aa4650a8-deed-48a3-9502-cc4ab8b6ca0c could not be found. Aug 07 01:18:36.055747 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'aa4650a8-deed-48a3-9502-cc4ab8b6ca0c'} Aug 07 01:18:36.056936 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:18:36.056936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:36.056936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:18:36.056936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:18:36.056936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:18:36.056936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:18:36.056936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:18:36.056936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:18:36.056936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:18:36.056936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:18:36.056936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa4650a8-deed-48a3-9502-cc4ab8b6ca0c could not be found. Aug 07 01:18:36.056936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:18:36.056936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:18:36.056936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:18:36.056936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:36.056936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:18:36.056936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:18:36.056936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:18:36.056936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:18:36.056936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:18:36.058989 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:18:36.058989 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:18:36.058989 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:18:36.058989 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:18:36.058989 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:18:36.058989 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:18:36.058989 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:18:36.058989 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa4650a8-deed-48a3-9502-cc4ab8b6ca0c could not be found. Aug 07 01:18:36.058989 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:18:36.058989 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:18:36.058989 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:18:36.058989 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:36.058989 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:18:36.058989 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:18:36.058989 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:18:36.058989 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:18:36.058989 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa4650a8-deed-48a3-9502-cc4ab8b6ca0c could not be found. Aug 07 01:18:36.058989 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:18:36.072489 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-da26f0ae-c5fc-448a-834c-3abc1615116c tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Returning 404 to user: Instance aa4650a8-deed-48a3-9502-cc4ab8b6ca0c could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:18:36.073901 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-da26f0ae-c5fc-448a-834c-3abc1615116c tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c" status: 404 len: 111 microversion: 2.1 time: 0.062986 Aug 07 01:18:36.075311 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 812/1837] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:36 2022] GET /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:18:36.080833 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-050a71cd-e0a5-42cb-87bf-8c017436469d tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:36.085151 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:18:36.085151 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:18:36.090024 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-050a71cd-e0a5-42cb-87bf-8c017436469d tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:36.090708 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-050a71cd-e0a5-42cb-87bf-8c017436469d tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:36.091324 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-050a71cd-e0a5-42cb-87bf-8c017436469d tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:36.092402 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-050a71cd-e0a5-42cb-87bf-8c017436469d tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:36.093037 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-050a71cd-e0a5-42cb-87bf-8c017436469d tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:36.093797 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-050a71cd-e0a5-42cb-87bf-8c017436469d tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:36.126438 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-050a71cd-e0a5-42cb-87bf-8c017436469d tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.049383 Aug 07 01:18:36.128220 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 813/1838] 10.222.0.39 () {60 vars in 1217 bytes} [Sun Aug 7 01:18:36 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:18:36.133137 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-52b32a50-b28d-4b8a-b645-a8b9a2f2626c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:36.133995 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-52b32a50-b28d-4b8a-b645-a8b9a2f2626c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:36.141644 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52b32a50-b28d-4b8a-b645-a8b9a2f2626c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:36.142386 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52b32a50-b28d-4b8a-b645-a8b9a2f2626c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:36.143542 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52b32a50-b28d-4b8a-b645-a8b9a2f2626c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:36.144474 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52b32a50-b28d-4b8a-b645-a8b9a2f2626c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:36.145507 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52b32a50-b28d-4b8a-b645-a8b9a2f2626c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:36.146100 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52b32a50-b28d-4b8a-b645-a8b9a2f2626c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:36.229094 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9cfc87a3-f39e-419c-a8e9-f9de94c9e1ae tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:36.247593 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9cfc87a3-f39e-419c-a8e9-f9de94c9e1ae tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d" status: 200 len: 1514 microversion: 2.1 time: 0.424954 Aug 07 01:18:36.264330 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1026/1839] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:35 2022] GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d => generated 1514 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:36.278907 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-065e6f12-7f50-462b-925e-007d66e67e71 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:36.279537 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-065e6f12-7f50-462b-925e-007d66e67e71 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:36.296250 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-065e6f12-7f50-462b-925e-007d66e67e71 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:36.296793 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-065e6f12-7f50-462b-925e-007d66e67e71 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:36.298608 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-065e6f12-7f50-462b-925e-007d66e67e71 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:36.299479 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-065e6f12-7f50-462b-925e-007d66e67e71 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:36.300484 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-065e6f12-7f50-462b-925e-007d66e67e71 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:36.300940 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-065e6f12-7f50-462b-925e-007d66e67e71 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:36.368594 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-52b32a50-b28d-4b8a-b645-a8b9a2f2626c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:36.384866 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-52b32a50-b28d-4b8a-b645-a8b9a2f2626c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1471 microversion: 2.1 time: 0.251179 Aug 07 01:18:36.385827 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 814/1840] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:36 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1471 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:36.398587 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6df9a38f-542c-4d15-a830-673cd35c7810 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e17fe7790>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:36.453853 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-065e6f12-7f50-462b-925e-007d66e67e71 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:36.478987 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-065e6f12-7f50-462b-925e-007d66e67e71 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1184 microversion: 2.1 time: 0.213445 Aug 07 01:18:36.483037 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1027/1841] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:36 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1184 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:36.510180 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e4177f81-ba57-4e84-8910-ede2cd631e91 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-793896105", "metadata": {"image_type": "test"}}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:36.520347 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e4177f81-ba57-4e84-8910-ede2cd631e91 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] [instance: aa4650a8-deed-48a3-9502-cc4ab8b6ca0c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:36.540220 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4177f81-ba57-4e84-8910-ede2cd631e91 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:36.544364 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6df9a38f-542c-4d15-a830-673cd35c7810 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/0bc8a99f-bbcc-4030-8b43-689c49c72915" status: 200 len: 1455 microversion: 2.1 time: 0.154953 Aug 07 01:18:36.546808 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4177f81-ba57-4e84-8910-ede2cd631e91 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:36.551803 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4177f81-ba57-4e84-8910-ede2cd631e91 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:36.552939 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 815/1842] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:18:36 2022] GET /compute/v2.1/images/0bc8a99f-bbcc-4030-8b43-689c49c72915 => generated 1455 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:36.553851 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4177f81-ba57-4e84-8910-ede2cd631e91 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:36.557011 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4177f81-ba57-4e84-8910-ede2cd631e91 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:36.572135 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-155c8da8-7c87-4bf4-b553-85118c4875e4 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:36.575739 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4177f81-ba57-4e84-8910-ede2cd631e91 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:36.577466 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-155c8da8-7c87-4bf4-b553-85118c4875e4 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] [instance: 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:36.591003 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-155c8da8-7c87-4bf4-b553-85118c4875e4 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:36.591823 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-155c8da8-7c87-4bf4-b553-85118c4875e4 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:36.592503 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-155c8da8-7c87-4bf4-b553-85118c4875e4 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:36.594799 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-155c8da8-7c87-4bf4-b553-85118c4875e4 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:36.595502 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-155c8da8-7c87-4bf4-b553-85118c4875e4 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:36.597511 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-155c8da8-7c87-4bf4-b553-85118c4875e4 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:36.616862 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-e4177f81-ba57-4e84-8910-ede2cd631e91 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] HTTP exception thrown: Instance aa4650a8-deed-48a3-9502-cc4ab8b6ca0c could not be found. Aug 07 01:18:36.621345 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e4177f81-ba57-4e84-8910-ede2cd631e91 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Request method failure captured: Aug 07 01:18:36.621345 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c/action HTTP/1.1 Aug 07 01:18:36.621345 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:18:36.621345 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:18:36.621345 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:18:36.621345 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 111 Aug 07 01:18:36.621345 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:18:36.621345 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:18:36.621345 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:18:36.621345 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:18:36.621345 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xK_TbTyxekM5DzVKSxWArEscOrq7uc3gqo2yhGBo1GLbMRuKE7hMNVLj0a923K5bfQmyuh93vzLxf1z8jKHQ74_UgmVZR2p8pFZ8BX78IY3T9OS5I3uBPQPhaT5Wv79apYWhhPrmCW3OR2FQwRYCrkm4bHagFFJxmTNL1TDImZ1M1w Aug 07 01:18:36.621345 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:18:36.621345 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:18:36.621345 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:18:36.621345 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:18:36.621345 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:18:36.621345 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:18:36.621345 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 010990a44647402c9a355de2ec0176a7 Aug 07 01:18:36.621345 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ImagesNegativeTestJSON-728812729 Aug 07 01:18:36.621345 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:18:36.621345 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:18:36.623329 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/010990a44647402c9a355de2ec0176a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_010990a44647402c9a355de2ec0176a7", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/010990a44647402c9a355de2ec0176a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/010990a44647402c9a355de2ec0176a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:18:36.623329 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ImagesNegativeTestJSON-728812729 Aug 07 01:18:36.623329 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 010990a44647402c9a355de2ec0176a7 Aug 07 01:18:36.623329 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-728812729 Aug 07 01:18:36.623329 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ImagesNegativeTestJSON-728812729-project Aug 07 01:18:36.623329 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:18:36.623329 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:18:36.623329 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: bd2118b664634f1297fe908f30609f42 Aug 07 01:18:36.623329 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ImagesNegativeTestJSON-728812729-project Aug 07 01:18:36.623329 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:18:36.623329 n-d-master-1 devstack@n-api.service[119516]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-793896105", "metadata": {"image_type": "test"}}} Aug 07 01:18:36.623329 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:18:36.624628 n-d-master-1 devstack@n-api.service[119516]: exception: Instance aa4650a8-deed-48a3-9502-cc4ab8b6ca0c could not be found. Aug 07 01:18:36.624628 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'aa4650a8-deed-48a3-9502-cc4ab8b6ca0c', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-793896105', 'metadata': {'image_type': 'test'}}}} Aug 07 01:18:36.624628 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:18:36.624628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:36.624628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:18:36.624628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:18:36.624628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:18:36.624628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:18:36.624628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:18:36.624628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:18:36.624628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:18:36.624628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:18:36.624628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa4650a8-deed-48a3-9502-cc4ab8b6ca0c could not be found. Aug 07 01:18:36.624628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:18:36.624628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:18:36.624628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:18:36.624628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:36.624628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:18:36.624628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:18:36.626339 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:18:36.626339 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:18:36.626339 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:18:36.626339 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:18:36.626339 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:18:36.626339 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:18:36.626339 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:18:36.626339 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:18:36.626339 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 07 01:18:36.626339 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 07 01:18:36.626339 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:18:36.626339 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:18:36.626339 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:18:36.626339 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:18:36.626339 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa4650a8-deed-48a3-9502-cc4ab8b6ca0c could not be found. Aug 07 01:18:36.626339 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:18:36.626339 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:18:36.626339 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:18:36.626339 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:36.626339 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:18:36.629106 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:18:36.629106 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:18:36.629106 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:18:36.629106 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa4650a8-deed-48a3-9502-cc4ab8b6ca0c could not be found. Aug 07 01:18:36.629106 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:18:36.629106 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e4177f81-ba57-4e84-8910-ede2cd631e91 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Returning 404 to user: Instance aa4650a8-deed-48a3-9502-cc4ab8b6ca0c could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:18:36.632022 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e4177f81-ba57-4e84-8910-ede2cd631e91 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] 10.222.0.39 "POST /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c/action" status: 404 len: 111 microversion: 2.1 time: 0.129381 Aug 07 01:18:36.633986 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1028/1843] 10.222.0.39 () {60 vars in 1279 bytes} [Sun Aug 7 01:18:36 2022] POST /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c/action => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:18:36.650086 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b224c58e-a672-47f2-967f-fe67d3325985 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-222524567", "metadata": {"image_type": "test"}}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:36.678707 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b224c58e-a672-47f2-967f-fe67d3325985 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Failed to fetch instance by id tempest-invalid-180450842 {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 07 01:18:36.684513 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-b224c58e-a672-47f2-967f-fe67d3325985 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] HTTP exception thrown: Instance tempest-invalid-180450842 could not be found. Aug 07 01:18:36.719685 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b224c58e-a672-47f2-967f-fe67d3325985 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Request method failure captured: Aug 07 01:18:36.719685 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers/tempest-invalid-180450842/action HTTP/1.1 Aug 07 01:18:36.719685 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:18:36.719685 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:18:36.719685 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:18:36.719685 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 111 Aug 07 01:18:36.719685 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:18:36.719685 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:18:36.719685 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:18:36.719685 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:18:36.719685 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xK_TbTyxekM5DzVKSxWArEscOrq7uc3gqo2yhGBo1GLbMRuKE7hMNVLj0a923K5bfQmyuh93vzLxf1z8jKHQ74_UgmVZR2p8pFZ8BX78IY3T9OS5I3uBPQPhaT5Wv79apYWhhPrmCW3OR2FQwRYCrkm4bHagFFJxmTNL1TDImZ1M1w Aug 07 01:18:36.719685 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:18:36.719685 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:18:36.719685 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:18:36.719685 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:18:36.719685 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:18:36.719685 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:18:36.719685 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 010990a44647402c9a355de2ec0176a7 Aug 07 01:18:36.719685 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ImagesNegativeTestJSON-728812729 Aug 07 01:18:36.719685 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:18:36.719685 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:18:36.722938 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/010990a44647402c9a355de2ec0176a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_010990a44647402c9a355de2ec0176a7", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/010990a44647402c9a355de2ec0176a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/010990a44647402c9a355de2ec0176a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:18:36.722938 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ImagesNegativeTestJSON-728812729 Aug 07 01:18:36.722938 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 010990a44647402c9a355de2ec0176a7 Aug 07 01:18:36.722938 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-728812729 Aug 07 01:18:36.722938 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ImagesNegativeTestJSON-728812729-project Aug 07 01:18:36.722938 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:18:36.722938 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:18:36.722938 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: bd2118b664634f1297fe908f30609f42 Aug 07 01:18:36.722938 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ImagesNegativeTestJSON-728812729-project Aug 07 01:18:36.722938 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:18:36.722938 n-d-master-1 devstack@n-api.service[119516]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-222524567", "metadata": {"image_type": "test"}}} Aug 07 01:18:36.722938 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:18:36.722938 n-d-master-1 devstack@n-api.service[119516]: exception: Instance tempest-invalid-180450842 could not be found. Aug 07 01:18:36.724041 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'tempest-invalid-180450842', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-222524567', 'metadata': {'image_type': 'test'}}}} Aug 07 01:18:36.724041 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:18:36.724041 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:36.724041 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:18:36.724041 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:18:36.724041 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 07 01:18:36.724041 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 07 01:18:36.724041 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-180450842 could not be found. Aug 07 01:18:36.724041 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:18:36.724041 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:18:36.724041 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:18:36.724041 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:36.724041 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:18:36.724041 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:18:36.724041 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:18:36.724041 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:18:36.724041 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:18:36.724041 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:18:36.724041 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:18:36.724041 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:18:36.725540 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:18:36.725540 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:18:36.725540 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 07 01:18:36.725540 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 07 01:18:36.725540 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:18:36.725540 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:18:36.725540 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:18:36.725540 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:18:36.725540 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-180450842 could not be found. Aug 07 01:18:36.725540 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:18:36.725540 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:18:36.725540 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:18:36.725540 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:36.725540 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:18:36.725540 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:18:36.725540 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:18:36.725540 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:18:36.725540 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-180450842 could not be found. Aug 07 01:18:36.725540 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:18:36.729775 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b224c58e-a672-47f2-967f-fe67d3325985 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Returning 404 to user: Instance tempest-invalid-180450842 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:18:36.734930 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b224c58e-a672-47f2-967f-fe67d3325985 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] 10.222.0.39 "POST /compute/v2.1/servers/tempest-invalid-180450842/action" status: 404 len: 100 microversion: 2.1 time: 0.090205 Aug 07 01:18:36.740760 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1029/1844] 10.222.0.39 () {60 vars in 1246 bytes} [Sun Aug 7 01:18:36 2022] POST /compute/v2.1/servers/tempest-invalid-180450842/action => generated 100 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:18:36.755196 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-56053d4f-ef46-41c5-b500-77a33ec9a942 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-320610424"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:36.778173 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-56053d4f-ef46-41c5-b500-77a33ec9a942 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 07 01:18:36.780461 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-155c8da8-7c87-4bf4-b553-85118c4875e4 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a/action" status: 202 len: 0 microversion: 2.25 time: 0.225016 Aug 07 01:18:36.781754 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 816/1845] 10.222.0.39 () {62 vars in 1319 bytes} [Sun Aug 7 01:18:36 2022] POST /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:18:36.787832 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-d8230588-95fc-4452-94c0-407dff4ffbaf req-2c2fd2bf-ee0c-471e-8173-37e3304bcdf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27c77ddb-09a6-49e0-bdca-0e6c23c18c56", "tag": "8f0059f1-599f-44c8-aaf3-9e744e8f6a33"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:36.796733 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-56053d4f-ef46-41c5-b500-77a33ec9a942 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 07 01:18:36.798391 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-56053d4f-ef46-41c5-b500-77a33ec9a942 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Request method failure captured: Aug 07 01:18:36.798391 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 07 01:18:36.798391 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:18:36.798391 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:18:36.798391 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:18:36.798391 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 56 Aug 07 01:18:36.798391 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:18:36.798391 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:18:36.798391 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:18:36.798391 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:18:36.798391 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xK_TbTyxekM5DzVKSxWArEscOrq7uc3gqo2yhGBo1GLbMRuKE7hMNVLj0a923K5bfQmyuh93vzLxf1z8jKHQ74_UgmVZR2p8pFZ8BX78IY3T9OS5I3uBPQPhaT5Wv79apYWhhPrmCW3OR2FQwRYCrkm4bHagFFJxmTNL1TDImZ1M1w Aug 07 01:18:36.798391 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:18:36.798391 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:18:36.798391 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:18:36.798391 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:18:36.798391 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:18:36.798391 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:18:36.798391 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 010990a44647402c9a355de2ec0176a7 Aug 07 01:18:36.798391 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ImagesNegativeTestJSON-728812729 Aug 07 01:18:36.798391 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:18:36.798391 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:18:36.801169 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/010990a44647402c9a355de2ec0176a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_010990a44647402c9a355de2ec0176a7", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/010990a44647402c9a355de2ec0176a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/010990a44647402c9a355de2ec0176a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:18:36.801169 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ImagesNegativeTestJSON-728812729 Aug 07 01:18:36.801169 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 010990a44647402c9a355de2ec0176a7 Aug 07 01:18:36.801169 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-728812729 Aug 07 01:18:36.801169 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ImagesNegativeTestJSON-728812729-project Aug 07 01:18:36.801169 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:18:36.801169 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:18:36.801169 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: bd2118b664634f1297fe908f30609f42 Aug 07 01:18:36.801169 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ImagesNegativeTestJSON-728812729-project Aug 07 01:18:36.801169 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:18:36.801169 n-d-master-1 devstack@n-api.service[119516]: {"createImage": {"name": "tempest-test-snap-320610424"}} Aug 07 01:18:36.801169 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:18:36.801169 n-d-master-1 devstack@n-api.service[119516]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 07 01:18:36.802306 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-320610424'}}} Aug 07 01:18:36.802306 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:18:36.802306 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:36.802306 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:18:36.802306 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:18:36.802306 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 07 01:18:36.802306 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 07 01:18:36.802306 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 07 01:18:36.802306 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:18:36.802306 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:18:36.802306 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:18:36.802306 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:36.802306 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:18:36.802306 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:18:36.802306 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:18:36.802306 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:18:36.802306 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:18:36.802306 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:18:36.802306 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:18:36.802306 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:18:36.805478 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:18:36.805478 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:18:36.805478 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 07 01:18:36.805478 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 07 01:18:36.805478 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:18:36.805478 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:18:36.805478 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:18:36.805478 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:18:36.805478 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 07 01:18:36.805478 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:18:36.805478 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:18:36.805478 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:18:36.805478 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:36.805478 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:18:36.805478 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:18:36.805478 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:18:36.805478 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:18:36.805478 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 07 01:18:36.805478 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:18:36.810337 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-56053d4f-ef46-41c5-b500-77a33ec9a942 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:18:36.818111 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d8230588-95fc-4452-94c0-407dff4ffbaf req-2c2fd2bf-ee0c-471e-8173-37e3304bcdf6 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:36.818281 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-56053d4f-ef46-41c5-b500-77a33ec9a942 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] 10.222.0.39 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.060925 Aug 07 01:18:36.818869 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d8230588-95fc-4452-94c0-407dff4ffbaf req-2c2fd2bf-ee0c-471e-8173-37e3304bcdf6 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:36.819031 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d8230588-95fc-4452-94c0-407dff4ffbaf req-2c2fd2bf-ee0c-471e-8173-37e3304bcdf6 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:36.824918 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1030/1846] 10.222.0.39 () {60 vars in 1275 bytes} [Sun Aug 7 01:18:36 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:18:36.835564 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5efaf31a-e60d-4f12-89b2-aca8df43c4fb tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:36.836227 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5efaf31a-e60d-4f12-89b2-aca8df43c4fb tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] [instance: 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:36.840987 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-d8230588-95fc-4452-94c0-407dff4ffbaf req-2c2fd2bf-ee0c-471e-8173-37e3304bcdf6 service nova] Creating event network-changed:8f0059f1-599f-44c8-aaf3-9e744e8f6a33 for instance 27c77ddb-09a6-49e0-bdca-0e6c23c18c56 on n-h2-master-1 Aug 07 01:18:36.850446 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5efaf31a-e60d-4f12-89b2-aca8df43c4fb tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:36.850943 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5efaf31a-e60d-4f12-89b2-aca8df43c4fb tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:36.851391 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5efaf31a-e60d-4f12-89b2-aca8df43c4fb tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:36.852277 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5efaf31a-e60d-4f12-89b2-aca8df43c4fb tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:36.852740 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5efaf31a-e60d-4f12-89b2-aca8df43c4fb tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:36.853176 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5efaf31a-e60d-4f12-89b2-aca8df43c4fb tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:36.857649 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-d8230588-95fc-4452-94c0-407dff4ffbaf req-2c2fd2bf-ee0c-471e-8173-37e3304bcdf6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074139 Aug 07 01:18:36.858814 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 817/1847] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:18:36.881043 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9028033c-241a-4cb3-b360-251415488d53 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2012727723"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:36.884335 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9028033c-241a-4cb3-b360-251415488d53 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 07 01:18:36.885259 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-9028033c-241a-4cb3-b360-251415488d53 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 07 01:18:36.887591 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9028033c-241a-4cb3-b360-251415488d53 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Request method failure captured: Aug 07 01:18:36.887591 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 07 01:18:36.887591 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:18:36.887591 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:18:36.887591 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:18:36.887591 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 57 Aug 07 01:18:36.887591 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:18:36.887591 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:18:36.887591 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:18:36.887591 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:18:36.887591 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xK_TbTyxekM5DzVKSxWArEscOrq7uc3gqo2yhGBo1GLbMRuKE7hMNVLj0a923K5bfQmyuh93vzLxf1z8jKHQ74_UgmVZR2p8pFZ8BX78IY3T9OS5I3uBPQPhaT5Wv79apYWhhPrmCW3OR2FQwRYCrkm4bHagFFJxmTNL1TDImZ1M1w Aug 07 01:18:36.887591 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:18:36.887591 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:18:36.887591 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:18:36.887591 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:18:36.887591 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:18:36.887591 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:18:36.887591 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 010990a44647402c9a355de2ec0176a7 Aug 07 01:18:36.887591 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ImagesNegativeTestJSON-728812729 Aug 07 01:18:36.887591 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:18:36.887591 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:18:36.889866 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/010990a44647402c9a355de2ec0176a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_010990a44647402c9a355de2ec0176a7", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/010990a44647402c9a355de2ec0176a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/010990a44647402c9a355de2ec0176a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:18:36.889866 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ImagesNegativeTestJSON-728812729 Aug 07 01:18:36.889866 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 010990a44647402c9a355de2ec0176a7 Aug 07 01:18:36.889866 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-728812729 Aug 07 01:18:36.889866 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ImagesNegativeTestJSON-728812729-project Aug 07 01:18:36.889866 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:18:36.889866 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:18:36.889866 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: bd2118b664634f1297fe908f30609f42 Aug 07 01:18:36.889866 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ImagesNegativeTestJSON-728812729-project Aug 07 01:18:36.889866 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:18:36.889866 n-d-master-1 devstack@n-api.service[119517]: {"createImage": {"name": "tempest-test-snap-2012727723"}} Aug 07 01:18:36.889866 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:18:36.889866 n-d-master-1 devstack@n-api.service[119517]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 07 01:18:36.891010 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-2012727723'}}} Aug 07 01:18:36.891010 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:18:36.891010 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:36.891010 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:18:36.891010 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:18:36.891010 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 07 01:18:36.891010 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 07 01:18:36.891010 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 07 01:18:36.891010 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:18:36.891010 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:18:36.891010 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:18:36.891010 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:36.891010 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:18:36.891010 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:18:36.891010 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:18:36.891010 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:18:36.891010 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:18:36.891010 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:18:36.891010 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:18:36.891010 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:18:36.895375 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:18:36.895375 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:18:36.895375 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 07 01:18:36.895375 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 07 01:18:36.895375 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:18:36.895375 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:18:36.895375 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:18:36.895375 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:18:36.895375 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 07 01:18:36.895375 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:18:36.895375 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:18:36.895375 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:18:36.895375 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:36.895375 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:18:36.895375 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:18:36.895375 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:18:36.895375 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:18:36.895375 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 07 01:18:36.895375 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:18:36.899998 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9028033c-241a-4cb3-b360-251415488d53 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:18:36.900473 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9028033c-241a-4cb3-b360-251415488d53 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] 10.222.0.39 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.040025 Aug 07 01:18:36.901253 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 818/1848] 10.222.0.39 () {60 vars in 1281 bytes} [Sun Aug 7 01:18:36 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:18:36.911096 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bb9e6425-bb83-4975-a4dc-25548c56e701 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:36.912610 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bb9e6425-bb83-4975-a4dc-25548c56e701 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] [instance: aa4650a8-deed-48a3-9502-cc4ab8b6ca0c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:36.929561 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bb9e6425-bb83-4975-a4dc-25548c56e701 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:36.930587 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bb9e6425-bb83-4975-a4dc-25548c56e701 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:36.933698 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bb9e6425-bb83-4975-a4dc-25548c56e701 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:36.934501 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bb9e6425-bb83-4975-a4dc-25548c56e701 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:36.935120 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bb9e6425-bb83-4975-a4dc-25548c56e701 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:36.935578 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bb9e6425-bb83-4975-a4dc-25548c56e701 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:36.966805 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-bb9e6425-bb83-4975-a4dc-25548c56e701 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] HTTP exception thrown: Instance aa4650a8-deed-48a3-9502-cc4ab8b6ca0c could not be found. Aug 07 01:18:36.973828 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bb9e6425-bb83-4975-a4dc-25548c56e701 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Request method failure captured: Aug 07 01:18:36.973828 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c HTTP/1.1 Aug 07 01:18:36.973828 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:18:36.973828 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:18:36.973828 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:18:36.973828 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:18:36.973828 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:18:36.973828 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:18:36.973828 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:18:36.973828 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:18:36.973828 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xK_TbTyxekM5DzVKSxWArEscOrq7uc3gqo2yhGBo1GLbMRuKE7hMNVLj0a923K5bfQmyuh93vzLxf1z8jKHQ74_UgmVZR2p8pFZ8BX78IY3T9OS5I3uBPQPhaT5Wv79apYWhhPrmCW3OR2FQwRYCrkm4bHagFFJxmTNL1TDImZ1M1w Aug 07 01:18:36.973828 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:18:36.973828 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:18:36.973828 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:18:36.973828 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:18:36.973828 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:18:36.973828 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:18:36.973828 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 010990a44647402c9a355de2ec0176a7 Aug 07 01:18:36.973828 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ImagesNegativeTestJSON-728812729 Aug 07 01:18:36.973828 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:18:36.973828 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:18:36.975467 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/010990a44647402c9a355de2ec0176a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_010990a44647402c9a355de2ec0176a7", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/010990a44647402c9a355de2ec0176a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/010990a44647402c9a355de2ec0176a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:18:36.975467 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ImagesNegativeTestJSON-728812729 Aug 07 01:18:36.975467 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 010990a44647402c9a355de2ec0176a7 Aug 07 01:18:36.975467 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-728812729 Aug 07 01:18:36.975467 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ImagesNegativeTestJSON-728812729-project Aug 07 01:18:36.975467 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:18:36.975467 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:18:36.975467 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: bd2118b664634f1297fe908f30609f42 Aug 07 01:18:36.975467 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ImagesNegativeTestJSON-728812729-project Aug 07 01:18:36.975467 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:18:36.975467 n-d-master-1 devstack@n-api.service[119517]: exception: Instance aa4650a8-deed-48a3-9502-cc4ab8b6ca0c could not be found. Aug 07 01:18:36.975467 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'aa4650a8-deed-48a3-9502-cc4ab8b6ca0c'} Aug 07 01:18:36.976403 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:18:36.976403 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:36.976403 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:18:36.976403 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:18:36.976403 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:18:36.976403 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:18:36.976403 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:18:36.976403 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:18:36.976403 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:18:36.976403 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:18:36.976403 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa4650a8-deed-48a3-9502-cc4ab8b6ca0c could not be found. Aug 07 01:18:36.976403 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:18:36.976403 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:18:36.976403 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:18:36.976403 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:36.976403 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:18:36.976403 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:18:36.976403 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:18:36.976403 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:18:36.976403 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:18:36.977826 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:18:36.977826 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:18:36.977826 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:18:36.977826 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:18:36.977826 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:18:36.977826 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:18:36.977826 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:18:36.977826 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:18:36.977826 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:18:36.977826 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa4650a8-deed-48a3-9502-cc4ab8b6ca0c could not be found. Aug 07 01:18:36.977826 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:18:36.977826 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:18:36.977826 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:18:36.977826 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:36.977826 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:18:36.977826 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:18:36.977826 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:18:36.977826 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:18:36.977826 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa4650a8-deed-48a3-9502-cc4ab8b6ca0c could not be found. Aug 07 01:18:36.977826 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:18:36.980948 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bb9e6425-bb83-4975-a4dc-25548c56e701 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Returning 404 to user: Instance aa4650a8-deed-48a3-9502-cc4ab8b6ca0c could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:18:36.982530 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bb9e6425-bb83-4975-a4dc-25548c56e701 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] 10.222.0.39 "DELETE /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c" status: 404 len: 111 microversion: 2.1 time: 0.076291 Aug 07 01:18:36.985985 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 819/1849] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:18:36 2022] DELETE /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:18:37.000928 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-db1f8684-865c-415f-84fa-bdd039b1e850 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:37.002003 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-db1f8684-865c-415f-84fa-bdd039b1e850 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] [instance: aa4650a8-deed-48a3-9502-cc4ab8b6ca0c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:37.014596 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db1f8684-865c-415f-84fa-bdd039b1e850 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:37.016112 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db1f8684-865c-415f-84fa-bdd039b1e850 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:37.016951 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db1f8684-865c-415f-84fa-bdd039b1e850 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:37.018504 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db1f8684-865c-415f-84fa-bdd039b1e850 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:37.019220 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db1f8684-865c-415f-84fa-bdd039b1e850 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:37.022738 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db1f8684-865c-415f-84fa-bdd039b1e850 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:37.056860 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-db1f8684-865c-415f-84fa-bdd039b1e850 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] HTTP exception thrown: Instance aa4650a8-deed-48a3-9502-cc4ab8b6ca0c could not be found. Aug 07 01:18:37.058807 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-db1f8684-865c-415f-84fa-bdd039b1e850 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Request method failure captured: Aug 07 01:18:37.058807 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c HTTP/1.1 Aug 07 01:18:37.058807 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:18:37.058807 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:18:37.058807 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:18:37.058807 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:18:37.058807 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:18:37.058807 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:18:37.058807 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:18:37.058807 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:18:37.058807 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xK_TbTyxekM5DzVKSxWArEscOrq7uc3gqo2yhGBo1GLbMRuKE7hMNVLj0a923K5bfQmyuh93vzLxf1z8jKHQ74_UgmVZR2p8pFZ8BX78IY3T9OS5I3uBPQPhaT5Wv79apYWhhPrmCW3OR2FQwRYCrkm4bHagFFJxmTNL1TDImZ1M1w Aug 07 01:18:37.058807 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:18:37.058807 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:18:37.058807 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:18:37.058807 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:18:37.058807 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:18:37.058807 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:18:37.058807 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 010990a44647402c9a355de2ec0176a7 Aug 07 01:18:37.058807 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ImagesNegativeTestJSON-728812729 Aug 07 01:18:37.058807 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:18:37.058807 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:18:37.060383 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/010990a44647402c9a355de2ec0176a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_010990a44647402c9a355de2ec0176a7", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/010990a44647402c9a355de2ec0176a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/010990a44647402c9a355de2ec0176a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:18:37.060383 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ImagesNegativeTestJSON-728812729 Aug 07 01:18:37.060383 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 010990a44647402c9a355de2ec0176a7 Aug 07 01:18:37.060383 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-728812729 Aug 07 01:18:37.060383 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ImagesNegativeTestJSON-728812729-project Aug 07 01:18:37.060383 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:18:37.060383 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:18:37.060383 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: bd2118b664634f1297fe908f30609f42 Aug 07 01:18:37.060383 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ImagesNegativeTestJSON-728812729-project Aug 07 01:18:37.060383 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:18:37.060383 n-d-master-1 devstack@n-api.service[119517]: exception: Instance aa4650a8-deed-48a3-9502-cc4ab8b6ca0c could not be found. Aug 07 01:18:37.060383 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'aa4650a8-deed-48a3-9502-cc4ab8b6ca0c'} Aug 07 01:18:37.061250 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:18:37.061250 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:37.061250 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:18:37.061250 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:18:37.061250 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:18:37.061250 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:18:37.061250 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:18:37.061250 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:18:37.061250 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:18:37.061250 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:18:37.061250 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa4650a8-deed-48a3-9502-cc4ab8b6ca0c could not be found. Aug 07 01:18:37.061250 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:18:37.061250 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:18:37.061250 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:18:37.061250 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:37.061250 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:18:37.061250 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:18:37.061250 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:18:37.061250 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:18:37.061250 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:18:37.062642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:18:37.062642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:18:37.062642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:18:37.062642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:18:37.062642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:18:37.062642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:18:37.062642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:18:37.062642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa4650a8-deed-48a3-9502-cc4ab8b6ca0c could not be found. Aug 07 01:18:37.062642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:18:37.062642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:18:37.062642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:18:37.062642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:37.062642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:18:37.062642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:18:37.062642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:18:37.062642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:18:37.062642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa4650a8-deed-48a3-9502-cc4ab8b6ca0c could not be found. Aug 07 01:18:37.062642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:18:37.065879 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-db1f8684-865c-415f-84fa-bdd039b1e850 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] Returning 404 to user: Instance aa4650a8-deed-48a3-9502-cc4ab8b6ca0c could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:18:37.067023 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-db1f8684-865c-415f-84fa-bdd039b1e850 tempest-ImagesNegativeTestJSON-728812729 tempest-ImagesNegativeTestJSON-728812729-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c" status: 404 len: 111 microversion: 2.1 time: 0.070007 Aug 07 01:18:37.072895 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 820/1850] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:36 2022] GET /compute/v2.1/servers/aa4650a8-deed-48a3-9502-cc4ab8b6ca0c => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:18:37.078953 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-26aa75d8-a2bf-40c0-a824-de020b2a149e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:37.085028 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-26aa75d8-a2bf-40c0-a824-de020b2a149e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 27c77ddb-09a6-49e0-bdca-0e6c23c18c56] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:37.098290 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-26aa75d8-a2bf-40c0-a824-de020b2a149e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:37.104820 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-26aa75d8-a2bf-40c0-a824-de020b2a149e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:37.105555 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-26aa75d8-a2bf-40c0-a824-de020b2a149e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:37.106610 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-26aa75d8-a2bf-40c0-a824-de020b2a149e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:37.107217 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-26aa75d8-a2bf-40c0-a824-de020b2a149e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:37.107785 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-26aa75d8-a2bf-40c0-a824-de020b2a149e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:37.140927 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=8 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:37.302835 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-5efaf31a-e60d-4f12-89b2-aca8df43c4fb tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lazy-loading 'services' on Instance uuid 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:18:37.366418 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5efaf31a-e60d-4f12-89b2-aca8df43c4fb tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a" status: 200 len: 2053 microversion: 2.25 time: 0.538092 Aug 07 01:18:37.382833 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1031/1851] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:18:36 2022] GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a => generated 2053 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:18:37.391410 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8654fecf-8780-49ff-bf06-d27abafecb00 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:37.396963 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8654fecf-8780-49ff-bf06-d27abafecb00 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d44d731f-5443-4a7c-9a8d-8e330fd1639d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:37.412785 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8654fecf-8780-49ff-bf06-d27abafecb00 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:37.414153 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8654fecf-8780-49ff-bf06-d27abafecb00 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:37.414795 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8654fecf-8780-49ff-bf06-d27abafecb00 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:37.415740 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8654fecf-8780-49ff-bf06-d27abafecb00 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:37.416541 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8654fecf-8780-49ff-bf06-d27abafecb00 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:37.417352 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8654fecf-8780-49ff-bf06-d27abafecb00 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:37.656082 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-26aa75d8-a2bf-40c0-a824-de020b2a149e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:37.666941 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-26aa75d8-a2bf-40c0-a824-de020b2a149e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/27c77ddb-09a6-49e0-bdca-0e6c23c18c56" status: 200 len: 1293 microversion: 2.1 time: 0.589547 Aug 07 01:18:37.685962 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 821/1852] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:37 2022] GET /compute/v2.1/servers/27c77ddb-09a6-49e0-bdca-0e6c23c18c56 => generated 1293 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:37.692179 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8f329fe8-79ab-4389-a4a7-a365894c2b55 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:37.693076 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8f329fe8-79ab-4389-a4a7-a365894c2b55 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:37.700232 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f329fe8-79ab-4389-a4a7-a365894c2b55 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:37.700961 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f329fe8-79ab-4389-a4a7-a365894c2b55 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:37.701601 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f329fe8-79ab-4389-a4a7-a365894c2b55 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:37.702504 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f329fe8-79ab-4389-a4a7-a365894c2b55 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:37.703129 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f329fe8-79ab-4389-a4a7-a365894c2b55 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:37.703726 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f329fe8-79ab-4389-a4a7-a365894c2b55 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:37.820675 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8654fecf-8780-49ff-bf06-d27abafecb00 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:37.850445 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8654fecf-8780-49ff-bf06-d27abafecb00 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d" status: 200 len: 1514 microversion: 2.1 time: 0.461539 Aug 07 01:18:37.856099 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1032/1853] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:37 2022] GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d => generated 1514 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:37.859980 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b0e8aae4-b3da-4a62-b766-075b820cbe79 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:37.861399 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b0e8aae4-b3da-4a62-b766-075b820cbe79 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:37.889082 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b0e8aae4-b3da-4a62-b766-075b820cbe79 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:37.890339 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b0e8aae4-b3da-4a62-b766-075b820cbe79 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:37.893441 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b0e8aae4-b3da-4a62-b766-075b820cbe79 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:37.896932 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b0e8aae4-b3da-4a62-b766-075b820cbe79 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:37.897616 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b0e8aae4-b3da-4a62-b766-075b820cbe79 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:37.898225 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b0e8aae4-b3da-4a62-b766-075b820cbe79 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:38.049202 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8f329fe8-79ab-4389-a4a7-a365894c2b55 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:38.078454 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8f329fe8-79ab-4389-a4a7-a365894c2b55 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1471 microversion: 2.1 time: 0.388031 Aug 07 01:18:38.079357 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 822/1854] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:37 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1471 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:38.102091 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9a6c9913-4bfc-49bf-8f08-f0ad34bd5a81 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e24b521f0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:38.169518 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b0e8aae4-b3da-4a62-b766-075b820cbe79 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:38.192964 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b0e8aae4-b3da-4a62-b766-075b820cbe79 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1184 microversion: 2.1 time: 0.337286 Aug 07 01:18:38.195142 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1033/1855] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:37 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1184 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:38.397150 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c7343804-ae2f-4cf4-b902-8d658cd8d3ef tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:38.398060 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c7343804-ae2f-4cf4-b902-8d658cd8d3ef tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] [instance: 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:38.409710 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c7343804-ae2f-4cf4-b902-8d658cd8d3ef tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:38.414395 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c7343804-ae2f-4cf4-b902-8d658cd8d3ef tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:38.415752 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c7343804-ae2f-4cf4-b902-8d658cd8d3ef tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:38.417290 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c7343804-ae2f-4cf4-b902-8d658cd8d3ef tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:38.419059 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c7343804-ae2f-4cf4-b902-8d658cd8d3ef tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:38.421144 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c7343804-ae2f-4cf4-b902-8d658cd8d3ef tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:39.348719 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-c7343804-ae2f-4cf4-b902-8d658cd8d3ef tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lazy-loading 'services' on Instance uuid 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:18:39.416192 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:39.435855 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c7343804-ae2f-4cf4-b902-8d658cd8d3ef tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a" status: 200 len: 2033 microversion: 2.25 time: 1.043648 Aug 07 01:18:39.443048 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1034/1856] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:18:38 2022] GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a => generated 2033 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:18:39.472287 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a0742b9e-86b0-41d4-aedd-b67cb516ddbc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:39.473499 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a0742b9e-86b0-41d4-aedd-b67cb516ddbc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 27c77ddb-09a6-49e0-bdca-0e6c23c18c56] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:39.498695 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a0742b9e-86b0-41d4-aedd-b67cb516ddbc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:39.499199 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a0742b9e-86b0-41d4-aedd-b67cb516ddbc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:39.499640 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a0742b9e-86b0-41d4-aedd-b67cb516ddbc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:39.500397 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a0742b9e-86b0-41d4-aedd-b67cb516ddbc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:39.500850 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a0742b9e-86b0-41d4-aedd-b67cb516ddbc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:39.501278 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a0742b9e-86b0-41d4-aedd-b67cb516ddbc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:40.123473 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a0742b9e-86b0-41d4-aedd-b67cb516ddbc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:40.132955 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a0742b9e-86b0-41d4-aedd-b67cb516ddbc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/27c77ddb-09a6-49e0-bdca-0e6c23c18c56" status: 200 len: 1293 microversion: 2.1 time: 0.682379 Aug 07 01:18:40.139834 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1035/1857] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:39 2022] GET /compute/v2.1/servers/27c77ddb-09a6-49e0-bdca-0e6c23c18c56 => generated 1293 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:40.153282 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cdcd9b8b-3931-4515-b123-569b1d1c9471 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:40.153944 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cdcd9b8b-3931-4515-b123-569b1d1c9471 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d44d731f-5443-4a7c-9a8d-8e330fd1639d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:40.167724 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cdcd9b8b-3931-4515-b123-569b1d1c9471 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:40.168267 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cdcd9b8b-3931-4515-b123-569b1d1c9471 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:40.168716 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cdcd9b8b-3931-4515-b123-569b1d1c9471 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:40.169479 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cdcd9b8b-3931-4515-b123-569b1d1c9471 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:40.169952 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cdcd9b8b-3931-4515-b123-569b1d1c9471 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:40.170389 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cdcd9b8b-3931-4515-b123-569b1d1c9471 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:41.110871 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cdcd9b8b-3931-4515-b123-569b1d1c9471 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:41.127785 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cdcd9b8b-3931-4515-b123-569b1d1c9471 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d" status: 200 len: 1514 microversion: 2.1 time: 0.986089 Aug 07 01:18:41.130617 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1036/1858] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:40 2022] GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d => generated 1514 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:41.137617 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-42539bf2-c6b8-4510-9203-87774209e9c1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:41.138551 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-42539bf2-c6b8-4510-9203-87774209e9c1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:41.162053 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42539bf2-c6b8-4510-9203-87774209e9c1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:41.162788 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42539bf2-c6b8-4510-9203-87774209e9c1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:41.163317 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42539bf2-c6b8-4510-9203-87774209e9c1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:41.164129 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42539bf2-c6b8-4510-9203-87774209e9c1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:41.164597 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42539bf2-c6b8-4510-9203-87774209e9c1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:41.165032 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42539bf2-c6b8-4510-9203-87774209e9c1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:41.568995 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-42539bf2-c6b8-4510-9203-87774209e9c1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:41.581087 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-42539bf2-c6b8-4510-9203-87774209e9c1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1471 microversion: 2.1 time: 0.449100 Aug 07 01:18:41.595067 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1037/1859] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:41 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1471 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:41.597137 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dfcf0021-3699-4323-a6ec-7514289dbddc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:41.597998 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-dfcf0021-3699-4323-a6ec-7514289dbddc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:41.616316 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dfcf0021-3699-4323-a6ec-7514289dbddc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:41.616741 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dfcf0021-3699-4323-a6ec-7514289dbddc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:41.617194 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dfcf0021-3699-4323-a6ec-7514289dbddc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:41.619257 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dfcf0021-3699-4323-a6ec-7514289dbddc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:41.619257 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dfcf0021-3699-4323-a6ec-7514289dbddc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:41.619257 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dfcf0021-3699-4323-a6ec-7514289dbddc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:41.758441 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dfcf0021-3699-4323-a6ec-7514289dbddc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:41.758948 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dfcf0021-3699-4323-a6ec-7514289dbddc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:41.759397 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dfcf0021-3699-4323-a6ec-7514289dbddc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:41.759859 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-dfcf0021-3699-4323-a6ec-7514289dbddc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lazy-loading 'fault' on Instance uuid 2e006496-fa0b-4e7a-8c5d-a3724b172720 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:18:42.241289 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-dfcf0021-3699-4323-a6ec-7514289dbddc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:42.255216 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-dfcf0021-3699-4323-a6ec-7514289dbddc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 200 len: 1143 microversion: 2.1 time: 0.672076 Aug 07 01:18:42.273200 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1038/1860] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:41 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 1143 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:42.297496 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-c658f511-ac27-4741-b7c8-895f4aa908d5 req-7b43ce2e-804b-4923-be22-2eaa57dcf09d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2dbfd1a-efab-4943-b00a-6cdd1051489c", "name": "network-vif-plugged", "status": "completed", "tag": "05c06eb8-fc76-4d4a-bf23-b4a1dd7229f7"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:42.319992 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c658f511-ac27-4741-b7c8-895f4aa908d5 req-7b43ce2e-804b-4923-be22-2eaa57dcf09d service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:42.322279 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c658f511-ac27-4741-b7c8-895f4aa908d5 req-7b43ce2e-804b-4923-be22-2eaa57dcf09d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:42.324522 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c658f511-ac27-4741-b7c8-895f4aa908d5 req-7b43ce2e-804b-4923-be22-2eaa57dcf09d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:42.363209 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-c658f511-ac27-4741-b7c8-895f4aa908d5 req-7b43ce2e-804b-4923-be22-2eaa57dcf09d service nova] Creating event network-vif-plugged:05c06eb8-fc76-4d4a-bf23-b4a1dd7229f7 for instance d2dbfd1a-efab-4943-b00a-6cdd1051489c on n-h1-master-1 Aug 07 01:18:42.374288 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-c658f511-ac27-4741-b7c8-895f4aa908d5 req-7b43ce2e-804b-4923-be22-2eaa57dcf09d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088600 Aug 07 01:18:42.378339 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1039/1861] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:18:42.396246 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4f4abb33-bb6f-457b-89bd-ff3a67c44063 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": "auto"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:42.407778 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4f4abb33-bb6f-457b-89bd-ff3a67c44063 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] [instance: 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:42.418652 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f4abb33-bb6f-457b-89bd-ff3a67c44063 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:42.420312 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f4abb33-bb6f-457b-89bd-ff3a67c44063 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:42.421010 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f4abb33-bb6f-457b-89bd-ff3a67c44063 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:42.422003 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f4abb33-bb6f-457b-89bd-ff3a67c44063 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:42.422835 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f4abb33-bb6f-457b-89bd-ff3a67c44063 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:42.424690 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f4abb33-bb6f-457b-89bd-ff3a67c44063 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:42.459106 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-4f4abb33-bb6f-457b-89bd-ff3a67c44063 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lazy-loading 'flavor' on Instance uuid 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:18:42.476925 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4f4abb33-bb6f-457b-89bd-ff3a67c44063 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] [instance: 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a] Going to try to live migrate instance to n-h2-master-1 {{(pid=119516) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 07 01:18:46.065393 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4f4abb33-bb6f-457b-89bd-ff3a67c44063 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a/action" status: 202 len: 0 microversion: 2.25 time: 3.683908 Aug 07 01:18:46.069267 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1040/1862] 10.222.0.39 () {62 vars in 1319 bytes} [Sun Aug 7 01:18:42 2022] POST /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a/action => generated 0 bytes in 3687 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:18:46.079202 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7264ff0a-6b53-42d2-8342-13174f833a82 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:46.083338 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7264ff0a-6b53-42d2-8342-13174f833a82 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 27c77ddb-09a6-49e0-bdca-0e6c23c18c56] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:46.099828 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:46.114105 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7264ff0a-6b53-42d2-8342-13174f833a82 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:46.114593 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7264ff0a-6b53-42d2-8342-13174f833a82 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:46.115039 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7264ff0a-6b53-42d2-8342-13174f833a82 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:46.115775 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7264ff0a-6b53-42d2-8342-13174f833a82 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:46.116275 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7264ff0a-6b53-42d2-8342-13174f833a82 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:46.116710 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7264ff0a-6b53-42d2-8342-13174f833a82 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:46.576285 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7264ff0a-6b53-42d2-8342-13174f833a82 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:46.584949 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7264ff0a-6b53-42d2-8342-13174f833a82 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/27c77ddb-09a6-49e0-bdca-0e6c23c18c56" status: 200 len: 1293 microversion: 2.1 time: 0.517313 Aug 07 01:18:46.593217 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1041/1863] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:46 2022] GET /compute/v2.1/servers/27c77ddb-09a6-49e0-bdca-0e6c23c18c56 => generated 1293 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:46.598968 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-827af7a3-89de-438a-aa21-c772a86f12b2 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:46.607036 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-827af7a3-89de-438a-aa21-c772a86f12b2 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d44d731f-5443-4a7c-9a8d-8e330fd1639d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:46.635608 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-827af7a3-89de-438a-aa21-c772a86f12b2 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:46.636433 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-827af7a3-89de-438a-aa21-c772a86f12b2 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:46.637079 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-827af7a3-89de-438a-aa21-c772a86f12b2 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:46.637973 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-827af7a3-89de-438a-aa21-c772a86f12b2 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:46.638610 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-827af7a3-89de-438a-aa21-c772a86f12b2 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:46.639213 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-827af7a3-89de-438a-aa21-c772a86f12b2 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:47.700158 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=63 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:47.774735 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-827af7a3-89de-438a-aa21-c772a86f12b2 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:47.784778 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-827af7a3-89de-438a-aa21-c772a86f12b2 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d" status: 200 len: 1520 microversion: 2.1 time: 1.190098 Aug 07 01:18:47.791197 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1042/1864] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:46 2022] GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d => generated 1520 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:47.802566 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b287e062-fd77-4fca-9286-e1219dcac4d7 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:47.807865 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b287e062-fd77-4fca-9286-e1219dcac4d7 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:47.821746 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b287e062-fd77-4fca-9286-e1219dcac4d7 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:47.827981 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b287e062-fd77-4fca-9286-e1219dcac4d7 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:47.828668 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b287e062-fd77-4fca-9286-e1219dcac4d7 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:47.838095 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b287e062-fd77-4fca-9286-e1219dcac4d7 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:47.838873 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b287e062-fd77-4fca-9286-e1219dcac4d7 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:47.841070 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b287e062-fd77-4fca-9286-e1219dcac4d7 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:48.056931 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:48.259440 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b287e062-fd77-4fca-9286-e1219dcac4d7 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:48.285277 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b287e062-fd77-4fca-9286-e1219dcac4d7 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1476 microversion: 2.1 time: 0.472550 Aug 07 01:18:48.288917 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1043/1865] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:47 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1476 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:48.307638 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c1dd1ac4-79e6-4f8d-ba1c-09d3cfaadf8e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:48.316686 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c1dd1ac4-79e6-4f8d-ba1c-09d3cfaadf8e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2e006496-fa0b-4e7a-8c5d-a3724b172720] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:48.338252 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1dd1ac4-79e6-4f8d-ba1c-09d3cfaadf8e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:48.341668 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1dd1ac4-79e6-4f8d-ba1c-09d3cfaadf8e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:48.342223 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1dd1ac4-79e6-4f8d-ba1c-09d3cfaadf8e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:48.343010 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1dd1ac4-79e6-4f8d-ba1c-09d3cfaadf8e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:48.346958 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1dd1ac4-79e6-4f8d-ba1c-09d3cfaadf8e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:48.347489 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1dd1ac4-79e6-4f8d-ba1c-09d3cfaadf8e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:48.389058 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-c1dd1ac4-79e6-4f8d-ba1c-09d3cfaadf8e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] HTTP exception thrown: Instance 2e006496-fa0b-4e7a-8c5d-a3724b172720 could not be found. Aug 07 01:18:48.398381 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c1dd1ac4-79e6-4f8d-ba1c-09d3cfaadf8e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Request method failure captured: Aug 07 01:18:48.398381 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 HTTP/1.1 Aug 07 01:18:48.398381 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:18:48.398381 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:18:48.398381 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:18:48.398381 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:18:48.398381 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:18:48.398381 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:18:48.398381 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:18:48.398381 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:18:48.398381 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xD2QrDlzIc_grVn-Bzr-WavOVOy3T9RqJf2eyxWxWwUPZ94QzCFwgeck9D1ChJJ9AB7o3ULcMPaoAAJfzZ17udYuxyOEAMG7oMTmbHKnZZcGvpFG8Yq4IrOXFwzhg6g_J5MwvnuChwQ9ZEP_954XcgYZcH_UrfG9Ko0_RGwm3ZjDhc Aug 07 01:18:48.398381 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:18:48.398381 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:18:48.398381 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:18:48.398381 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:18:48.398381 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:18:48.398381 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:18:48.398381 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: ba9e7a1c1fe14f47b5a5acf2fe8893b5 Aug 07 01:18:48.398381 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-LiveMigrationTest-1584424429 Aug 07 01:18:48.398381 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:18:48.398381 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:18:48.400903 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ba9e7a1c1fe14f47b5a5acf2fe8893b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ba9e7a1c1fe14f47b5a5acf2fe8893b5", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ba9e7a1c1fe14f47b5a5acf2fe8893b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ba9e7a1c1fe14f47b5a5acf2fe8893b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:18:48.400903 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-LiveMigrationTest-1584424429 Aug 07 01:18:48.400903 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: ba9e7a1c1fe14f47b5a5acf2fe8893b5 Aug 07 01:18:48.400903 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-LiveMigrationTest-1584424429 Aug 07 01:18:48.400903 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-LiveMigrationTest-1584424429-project Aug 07 01:18:48.400903 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:18:48.400903 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:18:48.400903 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 0327f14a188e45fba98a58e5fd061248 Aug 07 01:18:48.400903 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-LiveMigrationTest-1584424429-project Aug 07 01:18:48.400903 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:18:48.400903 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 2e006496-fa0b-4e7a-8c5d-a3724b172720 could not be found. Aug 07 01:18:48.400903 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '2e006496-fa0b-4e7a-8c5d-a3724b172720'} Aug 07 01:18:48.402627 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:18:48.402627 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:48.402627 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:18:48.402627 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:18:48.402627 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:18:48.402627 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:18:48.402627 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:18:48.402627 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:18:48.402627 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:18:48.402627 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:18:48.402627 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e006496-fa0b-4e7a-8c5d-a3724b172720 could not be found. Aug 07 01:18:48.402627 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:18:48.402627 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:18:48.402627 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:18:48.402627 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:48.402627 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:18:48.402627 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:18:48.402627 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:18:48.402627 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:18:48.402627 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:18:48.404512 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:18:48.404512 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:18:48.404512 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:18:48.404512 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:18:48.404512 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:18:48.404512 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:18:48.404512 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:18:48.404512 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e006496-fa0b-4e7a-8c5d-a3724b172720 could not be found. Aug 07 01:18:48.404512 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:18:48.404512 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:18:48.404512 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:18:48.404512 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:48.404512 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:18:48.404512 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:18:48.404512 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:18:48.404512 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:18:48.404512 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e006496-fa0b-4e7a-8c5d-a3724b172720 could not be found. Aug 07 01:18:48.404512 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:18:48.406248 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c1dd1ac4-79e6-4f8d-ba1c-09d3cfaadf8e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Returning 404 to user: Instance 2e006496-fa0b-4e7a-8c5d-a3724b172720 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:18:48.406248 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c1dd1ac4-79e6-4f8d-ba1c-09d3cfaadf8e tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720" status: 404 len: 111 microversion: 2.1 time: 0.109768 Aug 07 01:18:48.406248 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1044/1866] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:48 2022] GET /compute/v2.1/servers/2e006496-fa0b-4e7a-8c5d-a3724b172720 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:18:48.415203 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-b0654be5-ebeb-474b-bab8-50b7ad5ee951 req-5ad8f93a-1e46-4ed8-920a-cca4997a6f01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27c77ddb-09a6-49e0-bdca-0e6c23c18c56", "name": "network-vif-plugged", "status": "completed", "tag": "8f0059f1-599f-44c8-aaf3-9e744e8f6a33"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:48.438983 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b0654be5-ebeb-474b-bab8-50b7ad5ee951 req-5ad8f93a-1e46-4ed8-920a-cca4997a6f01 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:48.451486 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b0654be5-ebeb-474b-bab8-50b7ad5ee951 req-5ad8f93a-1e46-4ed8-920a-cca4997a6f01 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:48.452430 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b0654be5-ebeb-474b-bab8-50b7ad5ee951 req-5ad8f93a-1e46-4ed8-920a-cca4997a6f01 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:48.507249 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-b0654be5-ebeb-474b-bab8-50b7ad5ee951 req-5ad8f93a-1e46-4ed8-920a-cca4997a6f01 service nova] Creating event network-vif-plugged:8f0059f1-599f-44c8-aaf3-9e744e8f6a33 for instance 27c77ddb-09a6-49e0-bdca-0e6c23c18c56 on n-h2-master-1 Aug 07 01:18:48.533717 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-b0654be5-ebeb-474b-bab8-50b7ad5ee951 req-5ad8f93a-1e46-4ed8-920a-cca4997a6f01 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121360 Aug 07 01:18:48.542012 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1045/1867] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:18:48.552794 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-46f336c5-7a95-4a7f-9102-ead914375ab6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:48.553533 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-46f336c5-7a95-4a7f-9102-ead914375ab6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:48.580034 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-46f336c5-7a95-4a7f-9102-ead914375ab6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:48.581746 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-46f336c5-7a95-4a7f-9102-ead914375ab6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:48.582306 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-46f336c5-7a95-4a7f-9102-ead914375ab6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:48.585827 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-46f336c5-7a95-4a7f-9102-ead914375ab6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:48.589236 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-46f336c5-7a95-4a7f-9102-ead914375ab6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:48.591122 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-46f336c5-7a95-4a7f-9102-ead914375ab6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:48.880770 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-46f336c5-7a95-4a7f-9102-ead914375ab6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:48.893736 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-46f336c5-7a95-4a7f-9102-ead914375ab6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:48.897202 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-46f336c5-7a95-4a7f-9102-ead914375ab6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:48.899523 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-46f336c5-7a95-4a7f-9102-ead914375ab6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a" status: 200 len: 1566 microversion: 2.25 time: 0.356228 Aug 07 01:18:48.900658 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1046/1868] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:18:48 2022] GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a => generated 1566 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:18:48.906111 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6bcd8d48-b070-4dd3-bf43-3e3f9210ea63 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:48.906983 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6bcd8d48-b070-4dd3-bf43-3e3f9210ea63 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 27c77ddb-09a6-49e0-bdca-0e6c23c18c56] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:48.914378 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6bcd8d48-b070-4dd3-bf43-3e3f9210ea63 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:48.915184 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6bcd8d48-b070-4dd3-bf43-3e3f9210ea63 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:48.915822 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6bcd8d48-b070-4dd3-bf43-3e3f9210ea63 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:48.916788 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6bcd8d48-b070-4dd3-bf43-3e3f9210ea63 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:48.917574 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6bcd8d48-b070-4dd3-bf43-3e3f9210ea63 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:48.918185 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6bcd8d48-b070-4dd3-bf43-3e3f9210ea63 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:49.364868 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6bcd8d48-b070-4dd3-bf43-3e3f9210ea63 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:49.374436 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6bcd8d48-b070-4dd3-bf43-3e3f9210ea63 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/27c77ddb-09a6-49e0-bdca-0e6c23c18c56" status: 200 len: 1293 microversion: 2.1 time: 0.472240 Aug 07 01:18:49.380007 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1047/1869] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:48 2022] GET /compute/v2.1/servers/27c77ddb-09a6-49e0-bdca-0e6c23c18c56 => generated 1293 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:49.388557 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3f22e0db-3ac4-45d5-85c3-22c3449cb24f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:49.390962 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3f22e0db-3ac4-45d5-85c3-22c3449cb24f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d44d731f-5443-4a7c-9a8d-8e330fd1639d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:49.415095 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f22e0db-3ac4-45d5-85c3-22c3449cb24f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:49.416096 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f22e0db-3ac4-45d5-85c3-22c3449cb24f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:49.416789 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f22e0db-3ac4-45d5-85c3-22c3449cb24f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:49.420609 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f22e0db-3ac4-45d5-85c3-22c3449cb24f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:49.425748 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f22e0db-3ac4-45d5-85c3-22c3449cb24f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:49.429708 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f22e0db-3ac4-45d5-85c3-22c3449cb24f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:49.972883 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3f22e0db-3ac4-45d5-85c3-22c3449cb24f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:50.015975 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3f22e0db-3ac4-45d5-85c3-22c3449cb24f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d" status: 200 len: 1520 microversion: 2.1 time: 0.631722 Aug 07 01:18:50.016857 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1048/1870] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:49 2022] GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d => generated 1520 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:50.049746 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e9f2f9f9-0ecf-414e-ab9f-80b7d356be21 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:50.057703 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e9f2f9f9-0ecf-414e-ab9f-80b7d356be21 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:50.088069 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9f2f9f9-0ecf-414e-ab9f-80b7d356be21 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:50.092463 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9f2f9f9-0ecf-414e-ab9f-80b7d356be21 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:50.093099 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9f2f9f9-0ecf-414e-ab9f-80b7d356be21 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:50.094014 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9f2f9f9-0ecf-414e-ab9f-80b7d356be21 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:50.094522 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9f2f9f9-0ecf-414e-ab9f-80b7d356be21 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:50.094964 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9f2f9f9-0ecf-414e-ab9f-80b7d356be21 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:50.481385 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e9f2f9f9-0ecf-414e-ab9f-80b7d356be21 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:50.497026 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e9f2f9f9-0ecf-414e-ab9f-80b7d356be21 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1476 microversion: 2.1 time: 0.477357 Aug 07 01:18:50.513735 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1049/1871] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:50 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1476 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:50.538178 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-433d2b6a-ee8f-4d8c-870d-4a1c34ad823c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:50.541693 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-433d2b6a-ee8f-4d8c-870d-4a1c34ad823c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:50.566977 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-433d2b6a-ee8f-4d8c-870d-4a1c34ad823c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:50.568426 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-433d2b6a-ee8f-4d8c-870d-4a1c34ad823c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:50.574933 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-433d2b6a-ee8f-4d8c-870d-4a1c34ad823c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:50.578164 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-433d2b6a-ee8f-4d8c-870d-4a1c34ad823c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:50.579033 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-433d2b6a-ee8f-4d8c-870d-4a1c34ad823c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:50.579723 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-433d2b6a-ee8f-4d8c-870d-4a1c34ad823c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:51.233545 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-433d2b6a-ee8f-4d8c-870d-4a1c34ad823c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:51.256392 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-433d2b6a-ee8f-4d8c-870d-4a1c34ad823c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:51.266373 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-433d2b6a-ee8f-4d8c-870d-4a1c34ad823c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:51.273400 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-433d2b6a-ee8f-4d8c-870d-4a1c34ad823c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a" status: 200 len: 1566 microversion: 2.25 time: 0.750914 Aug 07 01:18:51.288170 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1050/1872] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:18:50 2022] GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a => generated 1566 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:18:51.299367 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-74bcf6d6-8496-47f6-9227-cbcd934fb23d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:51.300398 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-74bcf6d6-8496-47f6-9227-cbcd934fb23d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 27c77ddb-09a6-49e0-bdca-0e6c23c18c56] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:51.308630 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-74bcf6d6-8496-47f6-9227-cbcd934fb23d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:51.309438 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-74bcf6d6-8496-47f6-9227-cbcd934fb23d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:51.310079 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-74bcf6d6-8496-47f6-9227-cbcd934fb23d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:51.311779 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-74bcf6d6-8496-47f6-9227-cbcd934fb23d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:51.312457 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-74bcf6d6-8496-47f6-9227-cbcd934fb23d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:51.313251 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-74bcf6d6-8496-47f6-9227-cbcd934fb23d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:51.323137 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:51.771601 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-74bcf6d6-8496-47f6-9227-cbcd934fb23d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:51.837929 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-74bcf6d6-8496-47f6-9227-cbcd934fb23d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/27c77ddb-09a6-49e0-bdca-0e6c23c18c56" status: 200 len: 1473 microversion: 2.1 time: 0.548115 Aug 07 01:18:51.847014 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1051/1873] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:51 2022] GET /compute/v2.1/servers/27c77ddb-09a6-49e0-bdca-0e6c23c18c56 => generated 1473 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:51.869192 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-4cf257ff-d817-4862-8fa9-59f519f1ef86 req-2ed51e34-1f06-4296-8823-19f2afceb6cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a", "name": "network-vif-unplugged", "status": "completed", "tag": "94432de4-2b7a-4c0b-a025-991a9fe958e7"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:51.938205 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4cf257ff-d817-4862-8fa9-59f519f1ef86 req-2ed51e34-1f06-4296-8823-19f2afceb6cb service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:51.938701 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4cf257ff-d817-4862-8fa9-59f519f1ef86 req-2ed51e34-1f06-4296-8823-19f2afceb6cb service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:51.939143 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4cf257ff-d817-4862-8fa9-59f519f1ef86 req-2ed51e34-1f06-4296-8823-19f2afceb6cb service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:52.000308 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-4cf257ff-d817-4862-8fa9-59f519f1ef86 req-2ed51e34-1f06-4296-8823-19f2afceb6cb service nova] Creating event network-vif-unplugged:94432de4-2b7a-4c0b-a025-991a9fe958e7 for instance 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a on n-h1-master-1 Aug 07 01:18:52.018324 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-4cf257ff-d817-4862-8fa9-59f519f1ef86 req-2ed51e34-1f06-4296-8823-19f2afceb6cb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.152285 Aug 07 01:18:52.019617 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1052/1874] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:18:52.024646 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-d3f06890-fcc1-4405-a3d3-1ed8de26d085 req-8dea67a1-361b-41e2-ad4d-f38df207ff7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d44d731f-5443-4a7c-9a8d-8e330fd1639d", "name": "network-vif-unplugged", "status": "completed", "tag": "42ea78b8-0daa-46f3-8493-fb08aabf3fc3"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:52.063721 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d3f06890-fcc1-4405-a3d3-1ed8de26d085 req-8dea67a1-361b-41e2-ad4d-f38df207ff7a service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:52.064313 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d3f06890-fcc1-4405-a3d3-1ed8de26d085 req-8dea67a1-361b-41e2-ad4d-f38df207ff7a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:52.068555 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d3f06890-fcc1-4405-a3d3-1ed8de26d085 req-8dea67a1-361b-41e2-ad4d-f38df207ff7a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:52.158948 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-d3f06890-fcc1-4405-a3d3-1ed8de26d085 req-8dea67a1-361b-41e2-ad4d-f38df207ff7a service nova] Creating event network-vif-unplugged:42ea78b8-0daa-46f3-8493-fb08aabf3fc3 for instance d44d731f-5443-4a7c-9a8d-8e330fd1639d on n-h1-master-1 Aug 07 01:18:52.184300 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-d3f06890-fcc1-4405-a3d3-1ed8de26d085 req-8dea67a1-361b-41e2-ad4d-f38df207ff7a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.163774 Aug 07 01:18:52.188346 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1053/1875] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:18:52.205334 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-817254c8-0cac-4e65-98cd-1745844bdf9a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:52.209037 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-817254c8-0cac-4e65-98cd-1745844bdf9a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d44d731f-5443-4a7c-9a8d-8e330fd1639d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:52.229807 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-817254c8-0cac-4e65-98cd-1745844bdf9a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:52.230301 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-817254c8-0cac-4e65-98cd-1745844bdf9a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:52.230800 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-817254c8-0cac-4e65-98cd-1745844bdf9a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:52.231546 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-817254c8-0cac-4e65-98cd-1745844bdf9a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:52.232034 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-817254c8-0cac-4e65-98cd-1745844bdf9a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:52.232614 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-817254c8-0cac-4e65-98cd-1745844bdf9a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:52.544275 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-817254c8-0cac-4e65-98cd-1745844bdf9a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:52.558410 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-817254c8-0cac-4e65-98cd-1745844bdf9a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d" status: 200 len: 1520 microversion: 2.1 time: 0.366097 Aug 07 01:18:52.574912 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1054/1876] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:52 2022] GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d => generated 1520 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:52.593587 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9abc1a97-326d-46a0-89fb-ed4fd1c065f2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:52.597338 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9abc1a97-326d-46a0-89fb-ed4fd1c065f2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:52.615875 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9abc1a97-326d-46a0-89fb-ed4fd1c065f2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:52.617141 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9abc1a97-326d-46a0-89fb-ed4fd1c065f2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:52.617843 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9abc1a97-326d-46a0-89fb-ed4fd1c065f2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:52.618830 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9abc1a97-326d-46a0-89fb-ed4fd1c065f2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:52.619528 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9abc1a97-326d-46a0-89fb-ed4fd1c065f2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:52.620365 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9abc1a97-326d-46a0-89fb-ed4fd1c065f2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:53.038499 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9abc1a97-326d-46a0-89fb-ed4fd1c065f2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:53.047798 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9abc1a97-326d-46a0-89fb-ed4fd1c065f2 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1476 microversion: 2.1 time: 0.471457 Aug 07 01:18:53.053943 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1055/1877] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:52 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1476 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:53.060119 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b1e3904d-0571-4330-90e4-f67ec4c5bef9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1297703241", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:54.605745 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-b1e3904d-0571-4330-90e4-f67ec4c5bef9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] validate_networks() for [('339d8f21-b38d-49c3-8efe-8ffee4d616dc', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:18:54.614752 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9a6c9913-4bfc-49bf-8f08-f0ad34bd5a81 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/0bc8a99f-bbcc-4030-8b43-689c49c72915" status: 200 len: 1455 microversion: 2.1 time: 16.529587 Aug 07 01:18:54.632154 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 823/1878] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:18:38 2022] GET /compute/v2.1/images/0bc8a99f-bbcc-4030-8b43-689c49c72915 => generated 1455 bytes in 16552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:54.648632 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0e2f5734-b3a5-4f79-996b-b079bf4a67ad tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:54.649273 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0e2f5734-b3a5-4f79-996b-b079bf4a67ad tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:54.655947 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e2f5734-b3a5-4f79-996b-b079bf4a67ad tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:54.659225 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e2f5734-b3a5-4f79-996b-b079bf4a67ad tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:54.660079 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e2f5734-b3a5-4f79-996b-b079bf4a67ad tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:54.663496 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e2f5734-b3a5-4f79-996b-b079bf4a67ad tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:54.664253 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e2f5734-b3a5-4f79-996b-b079bf4a67ad tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:54.664882 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e2f5734-b3a5-4f79-996b-b079bf4a67ad tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:54.882580 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0e2f5734-b3a5-4f79-996b-b079bf4a67ad tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:54.899020 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0e2f5734-b3a5-4f79-996b-b079bf4a67ad tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:54.908076 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0e2f5734-b3a5-4f79-996b-b079bf4a67ad tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:54.909910 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0e2f5734-b3a5-4f79-996b-b079bf4a67ad tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a" status: 200 len: 1566 microversion: 2.25 time: 0.276743 Aug 07 01:18:54.923919 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 824/1879] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:18:54 2022] GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a => generated 1566 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:18:55.133887 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-99af2d68-06dd-44ff-8738-405b14840b1f tempest-AbsoluteLimitsTestJSON-761529160 tempest-AbsoluteLimitsTestJSON-761529160-project] Calling method '.version_select at 0x7f9e17fa38b0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:55.149079 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-99af2d68-06dd-44ff-8738-405b14840b1f tempest-AbsoluteLimitsTestJSON-761529160 tempest-AbsoluteLimitsTestJSON-761529160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:55.150904 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-99af2d68-06dd-44ff-8738-405b14840b1f tempest-AbsoluteLimitsTestJSON-761529160 tempest-AbsoluteLimitsTestJSON-761529160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:55.151611 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-99af2d68-06dd-44ff-8738-405b14840b1f tempest-AbsoluteLimitsTestJSON-761529160 tempest-AbsoluteLimitsTestJSON-761529160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:55.152841 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-99af2d68-06dd-44ff-8738-405b14840b1f tempest-AbsoluteLimitsTestJSON-761529160 tempest-AbsoluteLimitsTestJSON-761529160-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:55.153551 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-99af2d68-06dd-44ff-8738-405b14840b1f tempest-AbsoluteLimitsTestJSON-761529160 tempest-AbsoluteLimitsTestJSON-761529160-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:55.154199 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-99af2d68-06dd-44ff-8738-405b14840b1f tempest-AbsoluteLimitsTestJSON-761529160 tempest-AbsoluteLimitsTestJSON-761529160-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:55.178788 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-99af2d68-06dd-44ff-8738-405b14840b1f tempest-AbsoluteLimitsTestJSON-761529160 tempest-AbsoluteLimitsTestJSON-761529160-project] 10.222.0.39 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.264679 Aug 07 01:18:55.180300 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 825/1880] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:18:54 2022] GET /compute/v2.1/limits => generated 511 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:18:55.185181 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e53aff35-f4dd-4cdf-8b81-6c5ff6b88b93 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:55.186359 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e53aff35-f4dd-4cdf-8b81-6c5ff6b88b93 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d44d731f-5443-4a7c-9a8d-8e330fd1639d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:55.209499 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e53aff35-f4dd-4cdf-8b81-6c5ff6b88b93 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:55.218471 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e53aff35-f4dd-4cdf-8b81-6c5ff6b88b93 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:55.218943 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e53aff35-f4dd-4cdf-8b81-6c5ff6b88b93 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:55.223693 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e53aff35-f4dd-4cdf-8b81-6c5ff6b88b93 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:55.224377 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e53aff35-f4dd-4cdf-8b81-6c5ff6b88b93 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:55.225453 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e53aff35-f4dd-4cdf-8b81-6c5ff6b88b93 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:55.263921 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-b1e3904d-0571-4330-90e4-f67ec4c5bef9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:18:55.264352 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-b1e3904d-0571-4330-90e4-f67ec4c5bef9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:18:55.264835 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-b1e3904d-0571-4330-90e4-f67ec4c5bef9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:18:55.265251 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-b1e3904d-0571-4330-90e4-f67ec4c5bef9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:18:55.265666 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-b1e3904d-0571-4330-90e4-f67ec4c5bef9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:18:55.282501 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b1e3904d-0571-4330-90e4-f67ec4c5bef9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:55.283856 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b1e3904d-0571-4330-90e4-f67ec4c5bef9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:55.284548 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b1e3904d-0571-4330-90e4-f67ec4c5bef9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:55.285507 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b1e3904d-0571-4330-90e4-f67ec4c5bef9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:55.286151 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b1e3904d-0571-4330-90e4-f67ec4c5bef9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:55.286776 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b1e3904d-0571-4330-90e4-f67ec4c5bef9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:55.318326 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-b1e3904d-0571-4330-90e4-f67ec4c5bef9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Getting quotas for project efad066360cb45b3a6e9ba872118ea57. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:18:55.325621 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-b1e3904d-0571-4330-90e4-f67ec4c5bef9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Getting quotas for user d4f7282c7251455086368d5274a4fac5 and project efad066360cb45b3a6e9ba872118ea57. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:18:55.340706 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b1e3904d-0571-4330-90e4-f67ec4c5bef9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:18:55.344009 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b1e3904d-0571-4330-90e4-f67ec4c5bef9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 3241ffaf-f507-4365-80ec-a922012cb751] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:18:55.424918 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b1e3904d-0571-4330-90e4-f67ec4c5bef9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.369408 Aug 07 01:18:55.434884 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1056/1881] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:18:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2380 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:18:55.448275 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-863e0ce2-559d-4463-be5e-0d285f9c7f00 req-fa24c3f4-a0a3-43a8-8ff8-2224162df485 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a", "tag": "94432de4-2b7a-4c0b-a025-991a9fe958e7"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:55.480161 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-863e0ce2-559d-4463-be5e-0d285f9c7f00 req-fa24c3f4-a0a3-43a8-8ff8-2224162df485 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:55.480646 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-863e0ce2-559d-4463-be5e-0d285f9c7f00 req-fa24c3f4-a0a3-43a8-8ff8-2224162df485 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:55.481889 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-863e0ce2-559d-4463-be5e-0d285f9c7f00 req-fa24c3f4-a0a3-43a8-8ff8-2224162df485 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:55.508092 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-863e0ce2-559d-4463-be5e-0d285f9c7f00 req-fa24c3f4-a0a3-43a8-8ff8-2224162df485 service nova] Creating event network-changed:94432de4-2b7a-4c0b-a025-991a9fe958e7 for instance 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a on n-h1-master-1 Aug 07 01:18:55.522745 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-863e0ce2-559d-4463-be5e-0d285f9c7f00 req-fa24c3f4-a0a3-43a8-8ff8-2224162df485 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085514 Aug 07 01:18:55.528565 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1057/1882] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:18:55.541962 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-61a508ff-bd18-4559-a776-6d383be41f9f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:55.542686 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-61a508ff-bd18-4559-a776-6d383be41f9f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:55.553827 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-61a508ff-bd18-4559-a776-6d383be41f9f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:55.554526 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-61a508ff-bd18-4559-a776-6d383be41f9f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:55.555149 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-61a508ff-bd18-4559-a776-6d383be41f9f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:55.556248 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-61a508ff-bd18-4559-a776-6d383be41f9f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:55.556956 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-61a508ff-bd18-4559-a776-6d383be41f9f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:55.557624 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-61a508ff-bd18-4559-a776-6d383be41f9f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:55.566744 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e53aff35-f4dd-4cdf-8b81-6c5ff6b88b93 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:55.584088 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e53aff35-f4dd-4cdf-8b81-6c5ff6b88b93 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d" status: 200 len: 1520 microversion: 2.1 time: 0.400040 Aug 07 01:18:55.587037 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 826/1883] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:55 2022] GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d => generated 1520 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:55.598678 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-7f958d70-02e6-4c8f-8403-fac4ceb13d41 req-c13a30a4-8fb7-43b9-842c-7fa5cc1aee38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d44d731f-5443-4a7c-9a8d-8e330fd1639d", "name": "network-vif-plugged", "status": "completed", "tag": "42ea78b8-0daa-46f3-8493-fb08aabf3fc3"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:55.644178 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-7f958d70-02e6-4c8f-8403-fac4ceb13d41 req-c13a30a4-8fb7-43b9-842c-7fa5cc1aee38 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:55.650946 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-7f958d70-02e6-4c8f-8403-fac4ceb13d41 req-c13a30a4-8fb7-43b9-842c-7fa5cc1aee38 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:55.651477 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-7f958d70-02e6-4c8f-8403-fac4ceb13d41 req-c13a30a4-8fb7-43b9-842c-7fa5cc1aee38 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:55.685447 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-7f958d70-02e6-4c8f-8403-fac4ceb13d41 req-c13a30a4-8fb7-43b9-842c-7fa5cc1aee38 service nova] Creating event network-vif-plugged:42ea78b8-0daa-46f3-8493-fb08aabf3fc3 for instance d44d731f-5443-4a7c-9a8d-8e330fd1639d on n-h1-master-1 Aug 07 01:18:55.692772 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-7f958d70-02e6-4c8f-8403-fac4ceb13d41 req-c13a30a4-8fb7-43b9-842c-7fa5cc1aee38 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103764 Aug 07 01:18:55.704426 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 827/1884] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:18:56.279155 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ee386d4c-c8f9-4201-af4f-064ebd694e04 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Action: 'create', calling method: .version_select at 0x7f9e17fc5a60>, body: {"keypair": {"name": "tempest-keypair-1473140144", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCtyQvwiXcewGhmvx6odDaO4xQGKfWgXJ383EGLZifc5qC+YibCnT09Lb75yqiKzCZzkv1dCzKrT4geFJ5v4noq228voq8hZl9qP1FTvJdmN5hrg1rVCK/vVpOz1exbNw=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:56.301110 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-ee386d4c-c8f9-4201-af4f-064ebd694e04 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Getting quotas for project bc6a995089fa447e8f74df7d111b1c6b. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:18:56.309903 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-ee386d4c-c8f9-4201-af4f-064ebd694e04 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Getting quotas for user 5080c88d51a8455bba8b70e33cca958b and project bc6a995089fa447e8f74df7d111b1c6b. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:18:56.357120 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ee386d4c-c8f9-4201-af4f-064ebd694e04 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.649906 Aug 07 01:18:56.358216 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 828/1885] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:18:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:18:56.366571 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fafff77f-9b0c-4db4-ac6f-6b0cbc9daada tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:56.367440 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fafff77f-9b0c-4db4-ac6f-6b0cbc9daada tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 3241ffaf-f507-4365-80ec-a922012cb751] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:56.390714 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fafff77f-9b0c-4db4-ac6f-6b0cbc9daada tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 3241ffaf-f507-4365-80ec-a922012cb751] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:18:56.419482 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-61a508ff-bd18-4559-a776-6d383be41f9f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:56.438223 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-61a508ff-bd18-4559-a776-6d383be41f9f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1476 microversion: 2.1 time: 0.905200 Aug 07 01:18:56.442886 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1058/1886] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:55 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1476 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:56.458132 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dca5a4b4-c9fa-4091-836d-3766749484c2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:56.459755 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-dca5a4b4-c9fa-4091-836d-3766749484c2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:56.477129 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dca5a4b4-c9fa-4091-836d-3766749484c2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:56.477633 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dca5a4b4-c9fa-4091-836d-3766749484c2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:56.478072 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dca5a4b4-c9fa-4091-836d-3766749484c2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:56.480636 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dca5a4b4-c9fa-4091-836d-3766749484c2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:56.484663 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dca5a4b4-c9fa-4091-836d-3766749484c2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:56.485048 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dca5a4b4-c9fa-4091-836d-3766749484c2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:56.551314 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-dca5a4b4-c9fa-4091-836d-3766749484c2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:18:56.745369 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-dca5a4b4-c9fa-4091-836d-3766749484c2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "DELETE /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 204 len: 0 microversion: 2.1 time: 0.300420 Aug 07 01:18:56.745983 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1059/1887] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:18:56 2022] DELETE /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:18:56.764046 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6281f009-d79a-4255-a901-bb44acbdf6d8 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e240d4c10>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:56.849381 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6281f009-d79a-4255-a901-bb44acbdf6d8 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/0bc8a99f-bbcc-4030-8b43-689c49c72915" status: 200 len: 1455 microversion: 2.1 time: 0.102057 Aug 07 01:18:56.858104 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1060/1888] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:18:56 2022] GET /compute/v2.1/images/0bc8a99f-bbcc-4030-8b43-689c49c72915 => generated 1455 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:56.863447 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-145cc3fa-15d3-487b-96f3-e5939b931b93 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:56.864295 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-145cc3fa-15d3-487b-96f3-e5939b931b93 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:56.866419 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:56.899035 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-145cc3fa-15d3-487b-96f3-e5939b931b93 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:56.903498 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-145cc3fa-15d3-487b-96f3-e5939b931b93 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:56.904281 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-145cc3fa-15d3-487b-96f3-e5939b931b93 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:56.905285 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-145cc3fa-15d3-487b-96f3-e5939b931b93 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:56.906849 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-145cc3fa-15d3-487b-96f3-e5939b931b93 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:56.907605 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-145cc3fa-15d3-487b-96f3-e5939b931b93 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:57.170780 n-d-master-1 devstack@n-api.service[119517]: INFO nova.scheduler.client.report [None req-fafff77f-9b0c-4db4-ac6f-6b0cbc9daada tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Deleted allocations for instance 3241ffaf-f507-4365-80ec-a922012cb751 Aug 07 01:18:57.213096 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fafff77f-9b0c-4db4-ac6f-6b0cbc9daada tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3241ffaf-f507-4365-80ec-a922012cb751" status: 204 len: 0 microversion: 2.1 time: 0.852416 Aug 07 01:18:57.213776 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 829/1889] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:18:56 2022] DELETE /compute/v2.1/servers/3241ffaf-f507-4365-80ec-a922012cb751 => generated 0 bytes in 855 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:18:57.219738 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7c72e76e-b250-49a8-91eb-bb19c484843e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:57.220592 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7c72e76e-b250-49a8-91eb-bb19c484843e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d44d731f-5443-4a7c-9a8d-8e330fd1639d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:57.243025 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7c72e76e-b250-49a8-91eb-bb19c484843e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:57.243632 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7c72e76e-b250-49a8-91eb-bb19c484843e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:57.244096 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7c72e76e-b250-49a8-91eb-bb19c484843e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:57.247424 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7c72e76e-b250-49a8-91eb-bb19c484843e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:57.247997 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7c72e76e-b250-49a8-91eb-bb19c484843e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:57.249963 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7c72e76e-b250-49a8-91eb-bb19c484843e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:57.281058 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-145cc3fa-15d3-487b-96f3-e5939b931b93 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:57.289952 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-145cc3fa-15d3-487b-96f3-e5939b931b93 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:57.302087 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-145cc3fa-15d3-487b-96f3-e5939b931b93 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:57.303497 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-145cc3fa-15d3-487b-96f3-e5939b931b93 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a" status: 200 len: 1566 microversion: 2.25 time: 0.444159 Aug 07 01:18:57.323919 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1061/1890] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:18:56 2022] GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a => generated 1566 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:18:57.323919 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9f24ff0a-ff9a-4296-bda6-cda1adc1e4e2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:57.323919 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9f24ff0a-ff9a-4296-bda6-cda1adc1e4e2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:57.337596 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f24ff0a-ff9a-4296-bda6-cda1adc1e4e2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:57.338090 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f24ff0a-ff9a-4296-bda6-cda1adc1e4e2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:57.338532 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f24ff0a-ff9a-4296-bda6-cda1adc1e4e2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:57.344102 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f24ff0a-ff9a-4296-bda6-cda1adc1e4e2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:57.346500 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f24ff0a-ff9a-4296-bda6-cda1adc1e4e2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:57.346500 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f24ff0a-ff9a-4296-bda6-cda1adc1e4e2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:57.480128 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7c72e76e-b250-49a8-91eb-bb19c484843e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:57.492456 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7c72e76e-b250-49a8-91eb-bb19c484843e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d" status: 200 len: 1520 microversion: 2.1 time: 0.277371 Aug 07 01:18:57.493304 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 830/1891] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:57 2022] GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:57.498079 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-147ce731-3d12-4cfe-af6a-2a939a6d6366 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:57.498694 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-147ce731-3d12-4cfe-af6a-2a939a6d6366 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 3241ffaf-f507-4365-80ec-a922012cb751] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:57.541379 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-147ce731-3d12-4cfe-af6a-2a939a6d6366 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:57.542429 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-147ce731-3d12-4cfe-af6a-2a939a6d6366 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:57.542429 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-147ce731-3d12-4cfe-af6a-2a939a6d6366 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:57.543058 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-147ce731-3d12-4cfe-af6a-2a939a6d6366 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:57.543476 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-147ce731-3d12-4cfe-af6a-2a939a6d6366 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:57.543922 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-147ce731-3d12-4cfe-af6a-2a939a6d6366 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:57.585459 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-147ce731-3d12-4cfe-af6a-2a939a6d6366 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] HTTP exception thrown: Instance 3241ffaf-f507-4365-80ec-a922012cb751 could not be found. Aug 07 01:18:57.587809 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-147ce731-3d12-4cfe-af6a-2a939a6d6366 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Request method failure captured: Aug 07 01:18:57.587809 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/3241ffaf-f507-4365-80ec-a922012cb751 HTTP/1.1 Aug 07 01:18:57.587809 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:18:57.587809 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:18:57.587809 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:18:57.587809 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:18:57.587809 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:18:57.587809 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:18:57.587809 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:18:57.587809 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:18:57.587809 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xLZuMLvQ88KTsXpEnT0I-tjdBFOm7EEtVmBSoi3hGbagLa-WCqW3nJreDc3WwTe1tbLbMC3xnpg15asRoKTlUvK3aMhcihww2F0hywjkHPX3fkbbtMYbGiIT_pGesW2tpqp2g11Pwb-WDA3oTL-VeLkmCHA0u8DPW_SmhTlX9-nF08 Aug 07 01:18:57.587809 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:18:57.587809 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:18:57.587809 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:18:57.587809 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:18:57.587809 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:18:57.587809 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:18:57.587809 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:18:57.587809 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersTestJSON-576619186 Aug 07 01:18:57.587809 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:18:57.587809 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:18:57.590093 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_efad066360cb45b3a6e9ba872118ea57", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:18:57.590093 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersTestJSON-576619186 Aug 07 01:18:57.590093 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:18:57.590093 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersTestJSON-576619186 Aug 07 01:18:57.590093 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersTestJSON-576619186-project Aug 07 01:18:57.590093 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:18:57.590093 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:18:57.590093 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d4f7282c7251455086368d5274a4fac5 Aug 07 01:18:57.590093 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersTestJSON-576619186-project Aug 07 01:18:57.590093 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:18:57.590093 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 3241ffaf-f507-4365-80ec-a922012cb751 could not be found. Aug 07 01:18:57.590093 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '3241ffaf-f507-4365-80ec-a922012cb751'} Aug 07 01:18:57.591715 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:18:57.591715 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:57.591715 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:18:57.591715 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:18:57.591715 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:18:57.591715 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:18:57.591715 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:18:57.591715 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:18:57.591715 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:18:57.591715 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:18:57.591715 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3241ffaf-f507-4365-80ec-a922012cb751 could not be found. Aug 07 01:18:57.591715 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:18:57.591715 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:18:57.591715 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:18:57.591715 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:57.591715 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:18:57.591715 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:18:57.591715 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:18:57.591715 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:18:57.591715 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:18:57.593473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:18:57.593473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:18:57.593473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:18:57.593473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:18:57.593473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:18:57.593473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:18:57.593473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:18:57.593473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3241ffaf-f507-4365-80ec-a922012cb751 could not be found. Aug 07 01:18:57.593473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:18:57.593473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:18:57.593473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:18:57.593473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:18:57.593473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:18:57.593473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:18:57.593473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:18:57.593473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:18:57.593473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3241ffaf-f507-4365-80ec-a922012cb751 could not be found. Aug 07 01:18:57.593473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:18:57.601016 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-147ce731-3d12-4cfe-af6a-2a939a6d6366 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Returning 404 to user: Instance 3241ffaf-f507-4365-80ec-a922012cb751 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:18:57.602145 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-147ce731-3d12-4cfe-af6a-2a939a6d6366 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/3241ffaf-f507-4365-80ec-a922012cb751" status: 404 len: 111 microversion: 2.1 time: 0.108015 Aug 07 01:18:57.604887 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 831/1892] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:57 2022] GET /compute/v2.1/servers/3241ffaf-f507-4365-80ec-a922012cb751 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:18:57.617088 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8407b30a-ee9b-400e-ab54-ef3fac323f83 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:57.620176 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8407b30a-ee9b-400e-ab54-ef3fac323f83 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:57.646907 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8407b30a-ee9b-400e-ab54-ef3fac323f83 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:57.647962 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8407b30a-ee9b-400e-ab54-ef3fac323f83 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:57.648647 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8407b30a-ee9b-400e-ab54-ef3fac323f83 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:57.650388 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8407b30a-ee9b-400e-ab54-ef3fac323f83 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:57.655071 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8407b30a-ee9b-400e-ab54-ef3fac323f83 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:57.655937 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8407b30a-ee9b-400e-ab54-ef3fac323f83 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:58.109764 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9f24ff0a-ff9a-4296-bda6-cda1adc1e4e2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:58.120370 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9f24ff0a-ff9a-4296-bda6-cda1adc1e4e2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 200 len: 1667 microversion: 2.1 time: 0.809925 Aug 07 01:18:58.123612 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1062/1893] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:57 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 1667 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:58.136677 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c1a635f5-eedb-4726-8029-a63392821a78 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1277719730", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "339d8f21-b38d-49c3-8efe-8ffee4d616dc"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:18:58.250639 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-c1a635f5-eedb-4726-8029-a63392821a78 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] validate_networks() for [('339d8f21-b38d-49c3-8efe-8ffee4d616dc', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:18:58.475368 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8407b30a-ee9b-400e-ab54-ef3fac323f83 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:58.487941 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8407b30a-ee9b-400e-ab54-ef3fac323f83 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1476 microversion: 2.1 time: 0.881684 Aug 07 01:18:58.501390 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 832/1894] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:57 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1476 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:58.513480 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9342026d-206c-42b9-9291-cdafc98cac91 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e17f9a3a0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:58.573666 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9342026d-206c-42b9-9291-cdafc98cac91 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/0bc8a99f-bbcc-4030-8b43-689c49c72915" status: 200 len: 1464 microversion: 2.1 time: 0.066094 Aug 07 01:18:58.574681 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 833/1895] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:18:58 2022] GET /compute/v2.1/images/0bc8a99f-bbcc-4030-8b43-689c49c72915 => generated 1464 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:58.583802 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3e0e83af-9f4f-46ee-a5c5-7698d1d3bd56 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:58.584835 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3e0e83af-9f4f-46ee-a5c5-7698d1d3bd56 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:58.594242 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3e0e83af-9f4f-46ee-a5c5-7698d1d3bd56 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:58.594902 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3e0e83af-9f4f-46ee-a5c5-7698d1d3bd56 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:58.596128 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3e0e83af-9f4f-46ee-a5c5-7698d1d3bd56 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:58.597062 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3e0e83af-9f4f-46ee-a5c5-7698d1d3bd56 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:58.597643 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3e0e83af-9f4f-46ee-a5c5-7698d1d3bd56 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:58.598161 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3e0e83af-9f4f-46ee-a5c5-7698d1d3bd56 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:58.877280 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-c1a635f5-eedb-4726-8029-a63392821a78 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:18:58.877708 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-c1a635f5-eedb-4726-8029-a63392821a78 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:18:58.878840 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-c1a635f5-eedb-4726-8029-a63392821a78 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:18:58.879475 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-c1a635f5-eedb-4726-8029-a63392821a78 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:18:58.880213 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-c1a635f5-eedb-4726-8029-a63392821a78 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:18:58.894627 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1a635f5-eedb-4726-8029-a63392821a78 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:58.895818 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1a635f5-eedb-4726-8029-a63392821a78 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:58.896484 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1a635f5-eedb-4726-8029-a63392821a78 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:58.897657 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1a635f5-eedb-4726-8029-a63392821a78 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:58.898231 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1a635f5-eedb-4726-8029-a63392821a78 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:58.898949 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1a635f5-eedb-4726-8029-a63392821a78 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:58.922836 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-c1a635f5-eedb-4726-8029-a63392821a78 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Getting quotas for project efad066360cb45b3a6e9ba872118ea57. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:18:58.930162 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-c1a635f5-eedb-4726-8029-a63392821a78 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Getting quotas for user d4f7282c7251455086368d5274a4fac5 and project efad066360cb45b3a6e9ba872118ea57. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:18:58.956892 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c1a635f5-eedb-4726-8029-a63392821a78 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:18:58.958681 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c1a635f5-eedb-4726-8029-a63392821a78 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 545e5bdb-26c5-4585-90bd-a51dc9e956fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:18:59.007613 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c1a635f5-eedb-4726-8029-a63392821a78 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.881655 Aug 07 01:18:59.008801 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1063/1896] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:18:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:18:59.014438 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e379fa12-4bdf-46a9-b760-25a5c8c038ca tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:59.015297 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e379fa12-4bdf-46a9-b760-25a5c8c038ca tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d44d731f-5443-4a7c-9a8d-8e330fd1639d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:59.023528 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e379fa12-4bdf-46a9-b760-25a5c8c038ca tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:59.024347 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e379fa12-4bdf-46a9-b760-25a5c8c038ca tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:59.024980 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e379fa12-4bdf-46a9-b760-25a5c8c038ca tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:59.025877 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e379fa12-4bdf-46a9-b760-25a5c8c038ca tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:59.026509 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e379fa12-4bdf-46a9-b760-25a5c8c038ca tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:59.027140 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e379fa12-4bdf-46a9-b760-25a5c8c038ca tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:59.120038 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3e0e83af-9f4f-46ee-a5c5-7698d1d3bd56 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:59.128827 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3e0e83af-9f4f-46ee-a5c5-7698d1d3bd56 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:59.139091 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3e0e83af-9f4f-46ee-a5c5-7698d1d3bd56 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:59.141527 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3e0e83af-9f4f-46ee-a5c5-7698d1d3bd56 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a" status: 200 len: 1566 microversion: 2.25 time: 0.564193 Aug 07 01:18:59.163318 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 834/1897] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:18:58 2022] GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a => generated 1566 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:18:59.169380 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-26171e3c-084d-422d-8a6d-e7210f074efb tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e17fa31f0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:59.245018 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-26171e3c-084d-422d-8a6d-e7210f074efb tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/0bc8a99f-bbcc-4030-8b43-689c49c72915" status: 200 len: 1464 microversion: 2.1 time: 0.080200 Aug 07 01:18:59.245813 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 835/1898] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:18:59 2022] GET /compute/v2.1/images/0bc8a99f-bbcc-4030-8b43-689c49c72915 => generated 1464 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:59.288702 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e379fa12-4bdf-46a9-b760-25a5c8c038ca tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:59.300378 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e379fa12-4bdf-46a9-b760-25a5c8c038ca tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d" status: 200 len: 1505 microversion: 2.1 time: 0.288239 Aug 07 01:18:59.301505 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1064/1899] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:59 2022] GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d => generated 1505 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:59.307801 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9461fe20-5c9b-4585-ba8d-a27e773f9540 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:59.309148 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9461fe20-5c9b-4585-ba8d-a27e773f9540 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 545e5bdb-26c5-4585-90bd-a51dc9e956fe] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:59.397781 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9461fe20-5c9b-4585-ba8d-a27e773f9540 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:59.407710 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9461fe20-5c9b-4585-ba8d-a27e773f9540 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe" status: 200 len: 1221 microversion: 2.1 time: 0.104923 Aug 07 01:18:59.408871 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1065/1900] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:59 2022] GET /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe => generated 1221 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:59.430753 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-89746263-5462-44c7-917b-b4f8aa08a658 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:59.431388 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-89746263-5462-44c7-917b-b4f8aa08a658 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:59.438703 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-89746263-5462-44c7-917b-b4f8aa08a658 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:59.439531 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-89746263-5462-44c7-917b-b4f8aa08a658 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:59.440108 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-89746263-5462-44c7-917b-b4f8aa08a658 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:59.440865 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-89746263-5462-44c7-917b-b4f8aa08a658 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:59.441326 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-89746263-5462-44c7-917b-b4f8aa08a658 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:59.441757 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-89746263-5462-44c7-917b-b4f8aa08a658 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:59.490841 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b65d97e6-6880-4613-a5fd-6fb70adc6a18 tempest-AbsoluteLimitsNegativeTestJSON-865691980 tempest-AbsoluteLimitsNegativeTestJSON-865691980-project] Calling method '.version_select at 0x7f9e24057700>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:59.516124 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b65d97e6-6880-4613-a5fd-6fb70adc6a18 tempest-AbsoluteLimitsNegativeTestJSON-865691980 tempest-AbsoluteLimitsNegativeTestJSON-865691980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:59.516775 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b65d97e6-6880-4613-a5fd-6fb70adc6a18 tempest-AbsoluteLimitsNegativeTestJSON-865691980 tempest-AbsoluteLimitsNegativeTestJSON-865691980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:59.517320 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b65d97e6-6880-4613-a5fd-6fb70adc6a18 tempest-AbsoluteLimitsNegativeTestJSON-865691980 tempest-AbsoluteLimitsNegativeTestJSON-865691980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:59.518192 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b65d97e6-6880-4613-a5fd-6fb70adc6a18 tempest-AbsoluteLimitsNegativeTestJSON-865691980 tempest-AbsoluteLimitsNegativeTestJSON-865691980-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:59.519112 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b65d97e6-6880-4613-a5fd-6fb70adc6a18 tempest-AbsoluteLimitsNegativeTestJSON-865691980 tempest-AbsoluteLimitsNegativeTestJSON-865691980-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:59.519829 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b65d97e6-6880-4613-a5fd-6fb70adc6a18 tempest-AbsoluteLimitsNegativeTestJSON-865691980 tempest-AbsoluteLimitsNegativeTestJSON-865691980-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:59.556812 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b65d97e6-6880-4613-a5fd-6fb70adc6a18 tempest-AbsoluteLimitsNegativeTestJSON-865691980 tempest-AbsoluteLimitsNegativeTestJSON-865691980-project] 10.222.0.39 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.309572 Aug 07 01:18:59.564707 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 836/1901] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:18:59 2022] GET /compute/v2.1/limits => generated 511 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:18:59.578684 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-09593166-2954-45ed-987f-3ac0ee707e22 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:59.579742 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-09593166-2954-45ed-987f-3ac0ee707e22 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] [instance: d2dbfd1a-efab-4943-b00a-6cdd1051489c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:59.601927 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-09593166-2954-45ed-987f-3ac0ee707e22 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:59.603503 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-09593166-2954-45ed-987f-3ac0ee707e22 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:59.604412 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-09593166-2954-45ed-987f-3ac0ee707e22 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:59.605341 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-09593166-2954-45ed-987f-3ac0ee707e22 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:59.605823 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-09593166-2954-45ed-987f-3ac0ee707e22 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:59.606405 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-09593166-2954-45ed-987f-3ac0ee707e22 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:59.703661 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-89746263-5462-44c7-917b-b4f8aa08a658 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:59.720737 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-89746263-5462-44c7-917b-b4f8aa08a658 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 200 len: 1667 microversion: 2.1 time: 0.296415 Aug 07 01:18:59.722816 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1066/1902] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:59 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 1667 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:59.731489 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b84d0001-5755-4cd6-b0a4-6991228a770b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:59.733254 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b84d0001-5755-4cd6-b0a4-6991228a770b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d44d731f-5443-4a7c-9a8d-8e330fd1639d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:59.745659 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b84d0001-5755-4cd6-b0a4-6991228a770b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:59.746645 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b84d0001-5755-4cd6-b0a4-6991228a770b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:59.747501 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b84d0001-5755-4cd6-b0a4-6991228a770b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:59.748841 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b84d0001-5755-4cd6-b0a4-6991228a770b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:59.749671 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b84d0001-5755-4cd6-b0a4-6991228a770b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:59.750439 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b84d0001-5755-4cd6-b0a4-6991228a770b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:59.922143 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b84d0001-5755-4cd6-b0a4-6991228a770b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:18:59.932917 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b84d0001-5755-4cd6-b0a4-6991228a770b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d" status: 200 len: 1505 microversion: 2.1 time: 0.208247 Aug 07 01:18:59.933684 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1067/1903] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:59 2022] GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d => generated 1505 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:18:59.942481 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-994588e2-2b5e-4ff0-b15b-bdce82b3a53e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:18:59.943274 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-994588e2-2b5e-4ff0-b15b-bdce82b3a53e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:18:59.950287 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-994588e2-2b5e-4ff0-b15b-bdce82b3a53e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:59.951111 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-994588e2-2b5e-4ff0-b15b-bdce82b3a53e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:59.951624 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-994588e2-2b5e-4ff0-b15b-bdce82b3a53e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:18:59.952460 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-994588e2-2b5e-4ff0-b15b-bdce82b3a53e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:18:59.952990 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-994588e2-2b5e-4ff0-b15b-bdce82b3a53e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:18:59.953491 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-994588e2-2b5e-4ff0-b15b-bdce82b3a53e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:00.125697 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-994588e2-2b5e-4ff0-b15b-bdce82b3a53e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:00.135287 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-994588e2-2b5e-4ff0-b15b-bdce82b3a53e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1476 microversion: 2.1 time: 0.200061 Aug 07 01:19:00.136031 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1068/1904] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:59 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1476 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:00.146255 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-568e24cb-97ac-481d-924d-87fb4e580139 tempest-AbsoluteLimitsNegativeTestJSON-865691980 tempest-AbsoluteLimitsNegativeTestJSON-865691980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1030841292", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:00.219173 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-568e24cb-97ac-481d-924d-87fb4e580139 tempest-AbsoluteLimitsNegativeTestJSON-865691980 tempest-AbsoluteLimitsNegativeTestJSON-865691980-project] validate_networks() for None {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:19:00.319500 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-09593166-2954-45ed-987f-3ac0ee707e22 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '786962988b754fb69bd48070c2992e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614797cd26be4995b087ab864f35d235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:00.327763 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-09593166-2954-45ed-987f-3ac0ee707e22 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/servers/d2dbfd1a-efab-4943-b00a-6cdd1051489c" status: 200 len: 1466 microversion: 2.1 time: 0.760812 Aug 07 01:19:00.341929 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 837/1905] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:18:59 2022] GET /compute/v2.1/servers/d2dbfd1a-efab-4943-b00a-6cdd1051489c => generated 1466 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:00.347255 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-56949f44-0f75-4202-b5ee-d7c49e68abad tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:00.347769 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-56949f44-0f75-4202-b5ee-d7c49e68abad tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d44d731f-5443-4a7c-9a8d-8e330fd1639d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:00.358110 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-56949f44-0f75-4202-b5ee-d7c49e68abad tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:00.358639 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-56949f44-0f75-4202-b5ee-d7c49e68abad tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:00.359085 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-56949f44-0f75-4202-b5ee-d7c49e68abad tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:00.361781 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-56949f44-0f75-4202-b5ee-d7c49e68abad tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:00.362860 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-56949f44-0f75-4202-b5ee-d7c49e68abad tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:00.364283 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-56949f44-0f75-4202-b5ee-d7c49e68abad tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:00.407465 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-56949f44-0f75-4202-b5ee-d7c49e68abad tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d44d731f-5443-4a7c-9a8d-8e330fd1639d] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:19:00.496969 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-568e24cb-97ac-481d-924d-87fb4e580139 tempest-AbsoluteLimitsNegativeTestJSON-865691980 tempest-AbsoluteLimitsNegativeTestJSON-865691980-project] Getting quotas for project 75894dc30ff34892932d810a03b6b928. Resources: dict_keys(['metadata_items']) {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:19:00.504742 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-568e24cb-97ac-481d-924d-87fb4e580139 tempest-AbsoluteLimitsNegativeTestJSON-865691980 tempest-AbsoluteLimitsNegativeTestJSON-865691980-project] Getting quotas for user ea93e1ba81f34ecaa8e458b89a88e355 and project 75894dc30ff34892932d810a03b6b928. Resources: dict_keys(['metadata_items']) {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:19:00.534118 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-56949f44-0f75-4202-b5ee-d7c49e68abad tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d" status: 204 len: 0 microversion: 2.1 time: 0.192313 Aug 07 01:19:00.534613 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 838/1906] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:19:00 2022] DELETE /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:19:00.553672 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a90f0327-929a-407c-bd95-0c22f74f0c72 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:00.554227 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a90f0327-929a-407c-bd95-0c22f74f0c72 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:00.572753 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-568e24cb-97ac-481d-924d-87fb4e580139 tempest-AbsoluteLimitsNegativeTestJSON-865691980 tempest-AbsoluteLimitsNegativeTestJSON-865691980-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 07 01:19:00.574088 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a90f0327-929a-407c-bd95-0c22f74f0c72 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:00.574640 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a90f0327-929a-407c-bd95-0c22f74f0c72 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:00.575092 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a90f0327-929a-407c-bd95-0c22f74f0c72 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:00.580552 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a90f0327-929a-407c-bd95-0c22f74f0c72 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:00.580803 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a90f0327-929a-407c-bd95-0c22f74f0c72 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:00.581148 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a90f0327-929a-407c-bd95-0c22f74f0c72 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:00.598354 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-568e24cb-97ac-481d-924d-87fb4e580139 tempest-AbsoluteLimitsNegativeTestJSON-865691980 tempest-AbsoluteLimitsNegativeTestJSON-865691980-project] Request method failure captured: Aug 07 01:19:00.598354 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 07 01:19:00.598354 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:19:00.598354 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:19:00.598354 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:19:00.598354 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 1752 Aug 07 01:19:00.598354 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:19:00.598354 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:19:00.598354 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:19:00.598354 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:19:00.598354 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xMCDLRSsXjXwv8ZgETeP0nk1cUX-8rnNNc4qx8ARlfH1GjmWEPax6ujv8OOSxGS5KCn1GiE9q0QGdfu8qjz491kouMo4bfZPHu387_9Zlj5B2H1CAKLQekRmrkPPA2mOxqYxT5_DehIxtRP7rTtAIdicQq4P7KLCkMBRPEher4TrVQ Aug 07 01:19:00.598354 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:19:00.598354 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:19:00.598354 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:19:00.598354 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:19:00.598354 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:19:00.598354 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:19:00.598354 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 75894dc30ff34892932d810a03b6b928 Aug 07 01:19:00.598354 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-865691980 Aug 07 01:19:00.598354 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:19:00.598354 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:19:00.598354 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/75894dc30ff34892932d810a03b6b928"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_75894dc30ff34892932d810a03b6b928", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/75894dc30ff34892932d810a03b6b928"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/75894dc30ff34892932d810a03b6b928"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:19:00.598354 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-865691980 Aug 07 01:19:00.598354 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 75894dc30ff34892932d810a03b6b928 Aug 07 01:19:00.598354 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-865691980 Aug 07 01:19:00.598354 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-865691980-project Aug 07 01:19:00.598354 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:19:00.598354 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:19:00.598354 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: ea93e1ba81f34ecaa8e458b89a88e355 Aug 07 01:19:00.598354 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-865691980-project Aug 07 01:19:00.598354 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:19:00.598354 n-d-master-1 devstack@n-api.service[119516]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1030841292", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 07 01:19:00.598354 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:19:00.598354 n-d-master-1 devstack@n-api.service[119516]: exception: Maximum number of metadata items exceeds 128 Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1030841292', 'imageRef': 'e825bd61-bf05-4bd4-aa72-78daf2231731', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 464, in _check_metadata_properties_quota Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1004, in _checks_for_create_and_rebuild Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 471, in _check_metadata_properties_quota Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:19:00.601308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:19:00.609766 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:19:00.609766 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 07 01:19:00.609766 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 07 01:19:00.609766 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 07 01:19:00.609766 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 07 01:19:00.609766 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:19:00.609766 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:19:00.609766 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:19:00.609766 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:00.609766 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:19:00.609766 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:19:00.609766 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:19:00.609766 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:19:00.609766 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 07 01:19:00.609766 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:19:00.609766 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-568e24cb-97ac-481d-924d-87fb4e580139 tempest-AbsoluteLimitsNegativeTestJSON-865691980 tempest-AbsoluteLimitsNegativeTestJSON-865691980-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:19:00.609766 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-568e24cb-97ac-481d-924d-87fb4e580139 tempest-AbsoluteLimitsNegativeTestJSON-865691980 tempest-AbsoluteLimitsNegativeTestJSON-865691980-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.462926 Aug 07 01:19:00.609766 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1069/1907] 10.222.0.39 () {60 vars in 1148 bytes} [Sun Aug 7 01:19:00 2022] POST /compute/v2.1/servers => generated 87 bytes in 465 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:19:00.621915 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e02cbc81-14aa-486a-8002-5b7a95fbd409 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e24389e50>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:00.799870 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e02cbc81-14aa-486a-8002-5b7a95fbd409 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images?changes-since=2022-08-07T01%3A16%3A31Z" status: 200 len: 2328 microversion: 2.1 time: 0.192284 Aug 07 01:19:00.813326 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1070/1908] 10.222.0.39 () {58 vars in 1199 bytes} [Sun Aug 7 01:19:00 2022] GET /compute/v2.1/images?changes-since=2022-08-07T01%3A16%3A31Z => generated 2328 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:00.821470 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-aea8ebe5-1a60-4b95-bc91-fd1b47ce9e4d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:00.822304 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-aea8ebe5-1a60-4b95-bc91-fd1b47ce9e4d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 545e5bdb-26c5-4585-90bd-a51dc9e956fe] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:00.830221 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aea8ebe5-1a60-4b95-bc91-fd1b47ce9e4d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:00.832191 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aea8ebe5-1a60-4b95-bc91-fd1b47ce9e4d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:00.833659 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aea8ebe5-1a60-4b95-bc91-fd1b47ce9e4d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:00.834668 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aea8ebe5-1a60-4b95-bc91-fd1b47ce9e4d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:00.835328 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aea8ebe5-1a60-4b95-bc91-fd1b47ce9e4d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:00.835966 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aea8ebe5-1a60-4b95-bc91-fd1b47ce9e4d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:00.926153 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-aea8ebe5-1a60-4b95-bc91-fd1b47ce9e4d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:00.936366 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-aea8ebe5-1a60-4b95-bc91-fd1b47ce9e4d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe" status: 200 len: 1291 microversion: 2.1 time: 0.121839 Aug 07 01:19:00.937088 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1071/1909] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:00 2022] GET /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe => generated 1291 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:00.943761 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-67c96b0d-008a-44dc-aff8-ef50e3b78aaa tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:00.944770 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-67c96b0d-008a-44dc-aff8-ef50e3b78aaa tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:00.951715 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67c96b0d-008a-44dc-aff8-ef50e3b78aaa tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:00.952606 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67c96b0d-008a-44dc-aff8-ef50e3b78aaa tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:00.952991 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67c96b0d-008a-44dc-aff8-ef50e3b78aaa tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:00.954361 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67c96b0d-008a-44dc-aff8-ef50e3b78aaa tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:00.955775 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67c96b0d-008a-44dc-aff8-ef50e3b78aaa tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:00.956364 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67c96b0d-008a-44dc-aff8-ef50e3b78aaa tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:01.050882 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-67c96b0d-008a-44dc-aff8-ef50e3b78aaa tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:01.060749 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-67c96b0d-008a-44dc-aff8-ef50e3b78aaa tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 200 len: 1600 microversion: 2.1 time: 0.121825 Aug 07 01:19:01.061683 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1072/1910] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:00 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 1600 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:01.067661 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e4dd68c7-0212-45da-a9c9-7a7d70bf757c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-949134391", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "522f3ba8-208f-4b14-93bb-7dc525ec6e60"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:01.149372 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-e4dd68c7-0212-45da-a9c9-7a7d70bf757c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] validate_networks() for [('522f3ba8-208f-4b14-93bb-7dc525ec6e60', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:19:01.450629 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a90f0327-929a-407c-bd95-0c22f74f0c72 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:01.466214 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a90f0327-929a-407c-bd95-0c22f74f0c72 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:01.470230 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a90f0327-929a-407c-bd95-0c22f74f0c72 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:01.473259 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a90f0327-929a-407c-bd95-0c22f74f0c72 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a" status: 200 len: 1566 microversion: 2.25 time: 0.933788 Aug 07 01:19:01.474735 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 839/1911] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:19:00 2022] GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a => generated 1566 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:19:01.484532 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-678b1852-0e65-4bc0-b6ca-94bc86ede0b7 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e240575e0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:01.667217 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-678b1852-0e65-4bc0-b6ca-94bc86ede0b7 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-2026252661" status: 200 len: 485 microversion: 2.1 time: 0.186480 Aug 07 01:19:01.670667 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 840/1912] 10.222.0.39 () {58 vars in 1231 bytes} [Sun Aug 7 01:19:01 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-2026252661 => generated 485 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:01.683399 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d43e06ba-92a9-4c0a-b62c-4fb31533dc5e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:01.685149 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d43e06ba-92a9-4c0a-b62c-4fb31533dc5e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:01.693568 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d43e06ba-92a9-4c0a-b62c-4fb31533dc5e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:01.694664 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d43e06ba-92a9-4c0a-b62c-4fb31533dc5e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:01.695333 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d43e06ba-92a9-4c0a-b62c-4fb31533dc5e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:01.696956 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d43e06ba-92a9-4c0a-b62c-4fb31533dc5e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:01.698096 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d43e06ba-92a9-4c0a-b62c-4fb31533dc5e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:01.699407 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d43e06ba-92a9-4c0a-b62c-4fb31533dc5e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:01.854385 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e4dd68c7-0212-45da-a9c9-7a7d70bf757c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:19:01.866752 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e4dd68c7-0212-45da-a9c9-7a7d70bf757c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:19:01.867848 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e4dd68c7-0212-45da-a9c9-7a7d70bf757c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:19:01.868556 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e4dd68c7-0212-45da-a9c9-7a7d70bf757c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:19:01.873313 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e4dd68c7-0212-45da-a9c9-7a7d70bf757c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:19:01.909326 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4dd68c7-0212-45da-a9c9-7a7d70bf757c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:01.910494 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4dd68c7-0212-45da-a9c9-7a7d70bf757c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:01.912194 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4dd68c7-0212-45da-a9c9-7a7d70bf757c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:01.914591 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4dd68c7-0212-45da-a9c9-7a7d70bf757c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:01.915284 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4dd68c7-0212-45da-a9c9-7a7d70bf757c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:01.915958 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4dd68c7-0212-45da-a9c9-7a7d70bf757c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:01.950225 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-e4dd68c7-0212-45da-a9c9-7a7d70bf757c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Getting quotas for project 4b4cbb3c65be44668687983c0a76901c. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:19:01.959673 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-e4dd68c7-0212-45da-a9c9-7a7d70bf757c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Getting quotas for user 4a359309c39a49c98f1f7aea48189efa and project 4b4cbb3c65be44668687983c0a76901c. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:19:01.979480 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e4dd68c7-0212-45da-a9c9-7a7d70bf757c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:19:01.982835 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e4dd68c7-0212-45da-a9c9-7a7d70bf757c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:19:02.042718 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d43e06ba-92a9-4c0a-b62c-4fb31533dc5e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:02.054301 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e4dd68c7-0212-45da-a9c9-7a7d70bf757c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.991141 Aug 07 01:19:02.055810 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1073/1913] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:19:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:19:02.060982 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-f015df14-10fa-48d4-8a4b-45752595b156 req-7a0f877a-a143-4d66-826d-abbfc7453e0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "459c9fac-af66-443f-acd3-22587f83ca6e", "name": "network-vif-deleted", "tag": "920a50d8-b45c-480e-aaf9-c42f7d1e925e"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:02.074130 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d43e06ba-92a9-4c0a-b62c-4fb31533dc5e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1476 microversion: 2.1 time: 0.401976 Aug 07 01:19:02.075670 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f015df14-10fa-48d4-8a4b-45752595b156 req-7a0f877a-a143-4d66-826d-abbfc7453e0d service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:02.076571 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f015df14-10fa-48d4-8a4b-45752595b156 req-7a0f877a-a143-4d66-826d-abbfc7453e0d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:02.077259 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f015df14-10fa-48d4-8a4b-45752595b156 req-7a0f877a-a143-4d66-826d-abbfc7453e0d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:02.082844 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:02.096341 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-f015df14-10fa-48d4-8a4b-45752595b156 req-7a0f877a-a143-4d66-826d-abbfc7453e0d service nova] Creating event network-vif-deleted:920a50d8-b45c-480e-aaf9-c42f7d1e925e for instance 459c9fac-af66-443f-acd3-22587f83ca6e on n-h1-master-1 Aug 07 01:19:02.101251 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 841/1914] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:01 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1476 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:02.108045 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d48a181d-189c-40f6-9541-41ee16303429 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e17fc5e50>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:02.120115 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-f015df14-10fa-48d4-8a4b-45752595b156 req-7a0f877a-a143-4d66-826d-abbfc7453e0d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062733 Aug 07 01:19:02.122958 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1074/1915] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:02.172732 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8f35dbce-68ce-4f98-8295-5c2c6318218a tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-178610126", "imageRef": "199dc35b-daaf-4601-a359-5886e38c2a90", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "b15ee933-4c1b-4b15-85cb-4828537257a3"}], "security_groups": [{"name": "tempest-securitygroup--1543563062"}], "key_name": "tempest-keypair-1473140144", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:02.247428 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d48a181d-189c-40f6-9541-41ee16303429 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images?server=d2dbfd1a-efab-4943-b00a-6cdd1051489c" status: 200 len: 958 microversion: 2.1 time: 0.144760 Aug 07 01:19:02.257041 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 842/1916] 10.222.0.39 () {58 vars in 1209 bytes} [Sun Aug 7 01:19:02 2022] GET /compute/v2.1/images?server=d2dbfd1a-efab-4943-b00a-6cdd1051489c => generated 958 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:02.279246 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b862e1b7-ca0b-45e1-bec1-f3270714ee1f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:02.283955 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b862e1b7-ca0b-45e1-bec1-f3270714ee1f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 545e5bdb-26c5-4585-90bd-a51dc9e956fe] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:02.293798 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b862e1b7-ca0b-45e1-bec1-f3270714ee1f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:02.294391 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b862e1b7-ca0b-45e1-bec1-f3270714ee1f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:02.294824 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b862e1b7-ca0b-45e1-bec1-f3270714ee1f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:02.295566 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b862e1b7-ca0b-45e1-bec1-f3270714ee1f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:02.305135 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b862e1b7-ca0b-45e1-bec1-f3270714ee1f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:02.305694 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b862e1b7-ca0b-45e1-bec1-f3270714ee1f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:02.504784 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-8f35dbce-68ce-4f98-8295-5c2c6318218a tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] validate_networks() for [('b15ee933-4c1b-4b15-85cb-4828537257a3', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:19:02.878485 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b862e1b7-ca0b-45e1-bec1-f3270714ee1f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:02.905425 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b862e1b7-ca0b-45e1-bec1-f3270714ee1f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe" status: 200 len: 1321 microversion: 2.1 time: 0.640982 Aug 07 01:19:02.913696 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 843/1917] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:02 2022] GET /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe => generated 1321 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:02.950474 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2e8aab19-f1f2-4afc-8b0c-c1df101c35b3 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:02.969260 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2e8aab19-f1f2-4afc-8b0c-c1df101c35b3 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:03.195282 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2e8aab19-f1f2-4afc-8b0c-c1df101c35b3 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:03.203007 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2e8aab19-f1f2-4afc-8b0c-c1df101c35b3 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1217 microversion: 2.1 time: 0.287759 Aug 07 01:19:03.203616 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 844/1918] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:02 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1217 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:03.225972 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d7c0f048-2c51-4736-ac82-72615379d7e9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:03.226606 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d7c0f048-2c51-4736-ac82-72615379d7e9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 459c9fac-af66-443f-acd3-22587f83ca6e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:03.253988 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7c0f048-2c51-4736-ac82-72615379d7e9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:03.254592 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7c0f048-2c51-4736-ac82-72615379d7e9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:03.254974 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7c0f048-2c51-4736-ac82-72615379d7e9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:03.255723 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7c0f048-2c51-4736-ac82-72615379d7e9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:03.261892 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7c0f048-2c51-4736-ac82-72615379d7e9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:03.268480 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7c0f048-2c51-4736-ac82-72615379d7e9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:03.300592 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-d7c0f048-2c51-4736-ac82-72615379d7e9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] HTTP exception thrown: Instance 459c9fac-af66-443f-acd3-22587f83ca6e could not be found. Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d7c0f048-2c51-4736-ac82-72615379d7e9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Request method failure captured: Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e HTTP/1.1 Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xD2QrDlzIc_grVn-Bzr-WavOVOy3T9RqJf2eyxWxWwUPZ94QzCFwgeck9D1ChJJ9AB7o3ULcMPaoAAJfzZ17udYuxyOEAMG7oMTmbHKnZZcGvpFG8Yq4IrOXFwzhg6g_J5MwvnuChwQ9ZEP_954XcgYZcH_UrfG9Ko0_RGwm3ZjDhc Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: ba9e7a1c1fe14f47b5a5acf2fe8893b5 Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-LiveMigrationTest-1584424429 Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ba9e7a1c1fe14f47b5a5acf2fe8893b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ba9e7a1c1fe14f47b5a5acf2fe8893b5", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ba9e7a1c1fe14f47b5a5acf2fe8893b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ba9e7a1c1fe14f47b5a5acf2fe8893b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-LiveMigrationTest-1584424429 Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: ba9e7a1c1fe14f47b5a5acf2fe8893b5 Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-LiveMigrationTest-1584424429 Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-LiveMigrationTest-1584424429-project Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 0327f14a188e45fba98a58e5fd061248 Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-LiveMigrationTest-1584424429-project Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 459c9fac-af66-443f-acd3-22587f83ca6e could not be found. Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '459c9fac-af66-443f-acd3-22587f83ca6e'} Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 459c9fac-af66-443f-acd3-22587f83ca6e could not be found. Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 459c9fac-af66-443f-acd3-22587f83ca6e could not be found. Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:19:03.305314 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:19:03.310232 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:03.310232 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:19:03.310232 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:19:03.310232 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:19:03.310232 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:19:03.310232 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 459c9fac-af66-443f-acd3-22587f83ca6e could not be found. Aug 07 01:19:03.310232 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:19:03.320109 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d7c0f048-2c51-4736-ac82-72615379d7e9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Returning 404 to user: Instance 459c9fac-af66-443f-acd3-22587f83ca6e could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:19:03.321357 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d7c0f048-2c51-4736-ac82-72615379d7e9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e" status: 404 len: 111 microversion: 2.1 time: 0.114426 Aug 07 01:19:03.322712 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 845/1919] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:03 2022] GET /compute/v2.1/servers/459c9fac-af66-443f-acd3-22587f83ca6e => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:19:03.328286 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a18638d4-8e3c-4f74-83d9-254dd0677c10 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e17fc54c0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:03.513323 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a18638d4-8e3c-4f74-83d9-254dd0677c10 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.39%2Fcompute%2Fv2.1%2Fservers%2F9e2ae24f-8349-46d5-b091-876927d02b68" status: 200 len: 484 microversion: 2.1 time: 0.180710 Aug 07 01:19:03.518573 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 846/1920] 10.222.0.39 () {58 vars in 1317 bytes} [Sun Aug 7 01:19:03 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.39%2Fcompute%2Fv2.1%2Fservers%2F9e2ae24f-8349-46d5-b091-876927d02b68 => generated 484 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:03.531314 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9a427fb9-f01e-485f-8135-1c67266d2a77 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:03.536431 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9a427fb9-f01e-485f-8135-1c67266d2a77 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:03.550347 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-8f35dbce-68ce-4f98-8295-5c2c6318218a tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:19:03.550901 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-8f35dbce-68ce-4f98-8295-5c2c6318218a tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:19:03.551774 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-8f35dbce-68ce-4f98-8295-5c2c6318218a tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:19:03.552299 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-8f35dbce-68ce-4f98-8295-5c2c6318218a tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:19:03.552792 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-8f35dbce-68ce-4f98-8295-5c2c6318218a tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:19:03.567444 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a427fb9-f01e-485f-8135-1c67266d2a77 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:03.571954 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8f35dbce-68ce-4f98-8295-5c2c6318218a tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:03.572527 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a427fb9-f01e-485f-8135-1c67266d2a77 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:03.573492 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8f35dbce-68ce-4f98-8295-5c2c6318218a tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:03.574431 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a427fb9-f01e-485f-8135-1c67266d2a77 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:03.574969 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8f35dbce-68ce-4f98-8295-5c2c6318218a tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:03.575859 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8f35dbce-68ce-4f98-8295-5c2c6318218a tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:03.576488 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a427fb9-f01e-485f-8135-1c67266d2a77 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:03.576970 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a427fb9-f01e-485f-8135-1c67266d2a77 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:03.577405 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a427fb9-f01e-485f-8135-1c67266d2a77 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:03.577962 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8f35dbce-68ce-4f98-8295-5c2c6318218a tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:03.579344 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8f35dbce-68ce-4f98-8295-5c2c6318218a tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:03.643694 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-8f35dbce-68ce-4f98-8295-5c2c6318218a tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Getting quotas for project bc6a995089fa447e8f74df7d111b1c6b. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:19:03.658976 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-8f35dbce-68ce-4f98-8295-5c2c6318218a tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Getting quotas for user 5080c88d51a8455bba8b70e33cca958b and project bc6a995089fa447e8f74df7d111b1c6b. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:19:03.694380 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8f35dbce-68ce-4f98-8295-5c2c6318218a tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:19:03.696696 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8f35dbce-68ce-4f98-8295-5c2c6318218a tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] [instance: 1bc2c437-e710-4af4-9928-76c48834cfa2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='199dc35b-daaf-4601-a359-5886e38c2a90',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:19:03.763557 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8f35dbce-68ce-4f98-8295-5c2c6318218a tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.637641 Aug 07 01:19:03.764328 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1075/1921] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:19:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 1641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:19:03.769963 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-577aa9c0-8a63-40f4-afe0-6b64f4da22d1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:03.770846 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-577aa9c0-8a63-40f4-afe0-6b64f4da22d1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:03.785406 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-577aa9c0-8a63-40f4-afe0-6b64f4da22d1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:03.786722 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-577aa9c0-8a63-40f4-afe0-6b64f4da22d1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:03.788922 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-577aa9c0-8a63-40f4-afe0-6b64f4da22d1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:03.790371 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-577aa9c0-8a63-40f4-afe0-6b64f4da22d1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:03.791222 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-577aa9c0-8a63-40f4-afe0-6b64f4da22d1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:03.792225 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-577aa9c0-8a63-40f4-afe0-6b64f4da22d1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:03.926449 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9a427fb9-f01e-485f-8135-1c67266d2a77 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:03.938677 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9a427fb9-f01e-485f-8135-1c67266d2a77 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:03.941297 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9a427fb9-f01e-485f-8135-1c67266d2a77 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:03.943292 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9a427fb9-f01e-485f-8135-1c67266d2a77 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a" status: 200 len: 1541 microversion: 2.25 time: 0.422456 Aug 07 01:19:03.944297 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 847/1922] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:19:03 2022] GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a => generated 1541 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:19:03.951686 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-84a61f52-4041-4d0a-aa8c-d030bb6ffdd4 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '.version_select at 0x7f9e17fc5af0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:03.992552 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-84a61f52-4041-4d0a-aa8c-d030bb6ffdd4 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1610917116" status: 202 len: 0 microversion: 2.1 time: 0.046191 Aug 07 01:19:03.994411 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 848/1923] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Aug 7 01:19:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1610917116 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:19:04.000673 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e358c55f-5149-4d41-8940-d386615f4c03 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e17fa3160>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:04.031657 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-577aa9c0-8a63-40f4-afe0-6b64f4da22d1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:04.053056 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-577aa9c0-8a63-40f4-afe0-6b64f4da22d1 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1476 microversion: 2.1 time: 0.279961 Aug 07 01:19:04.065513 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1076/1924] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:03 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1476 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:04.074867 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-fc047925-7d62-4192-8c94-cf199c8e17fd req-b755f182-8f1c-4d06-b11f-2c2030c76798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2dbfd1a-efab-4943-b00a-6cdd1051489c", "name": "network-vif-unplugged", "status": "completed", "tag": "05c06eb8-fc76-4d4a-bf23-b4a1dd7229f7"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:04.091043 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-fc047925-7d62-4192-8c94-cf199c8e17fd req-b755f182-8f1c-4d06-b11f-2c2030c76798 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:04.091849 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-fc047925-7d62-4192-8c94-cf199c8e17fd req-b755f182-8f1c-4d06-b11f-2c2030c76798 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:04.092555 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-fc047925-7d62-4192-8c94-cf199c8e17fd req-b755f182-8f1c-4d06-b11f-2c2030c76798 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:04.115153 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-fc047925-7d62-4192-8c94-cf199c8e17fd req-b755f182-8f1c-4d06-b11f-2c2030c76798 service nova] Creating event network-vif-unplugged:05c06eb8-fc76-4d4a-bf23-b4a1dd7229f7 for instance d2dbfd1a-efab-4943-b00a-6cdd1051489c on n-h1-master-1 Aug 07 01:19:04.121760 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-fc047925-7d62-4192-8c94-cf199c8e17fd req-b755f182-8f1c-4d06-b11f-2c2030c76798 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054779 Aug 07 01:19:04.123266 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1077/1925] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:04.131357 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fa6101cc-fbcb-4ff8-b152-4fb27e2c3b5c tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:04.132422 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fa6101cc-fbcb-4ff8-b152-4fb27e2c3b5c tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] [instance: 1bc2c437-e710-4af4-9928-76c48834cfa2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:04.139042 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e358c55f-5149-4d41-8940-d386615f4c03 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.39%2Fcompute%2Fservers%2F9e2ae24f-8349-46d5-b091-876927d02b68" status: 200 len: 484 microversion: 2.1 time: 0.143067 Aug 07 01:19:04.141815 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 849/1926] 10.222.0.39 () {58 vars in 1303 bytes} [Sun Aug 7 01:19:03 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.39%2Fcompute%2Fservers%2F9e2ae24f-8349-46d5-b091-876927d02b68 => generated 484 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:04.154840 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d041e9c6-9f02-41d3-b7c9-2fd9daa34661 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:04.157304 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d041e9c6-9f02-41d3-b7c9-2fd9daa34661 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 545e5bdb-26c5-4585-90bd-a51dc9e956fe] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:04.174489 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d041e9c6-9f02-41d3-b7c9-2fd9daa34661 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:04.177349 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d041e9c6-9f02-41d3-b7c9-2fd9daa34661 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:04.179808 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d041e9c6-9f02-41d3-b7c9-2fd9daa34661 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:04.180964 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d041e9c6-9f02-41d3-b7c9-2fd9daa34661 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:04.182086 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d041e9c6-9f02-41d3-b7c9-2fd9daa34661 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:04.182812 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d041e9c6-9f02-41d3-b7c9-2fd9daa34661 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:04.234451 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fa6101cc-fbcb-4ff8-b152-4fb27e2c3b5c tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5080c88d51a8455bba8b70e33cca958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6a995089fa447e8f74df7d111b1c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:04.247004 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fa6101cc-fbcb-4ff8-b152-4fb27e2c3b5c tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] 10.222.0.39 "GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2" status: 200 len: 1245 microversion: 2.1 time: 0.121932 Aug 07 01:19:04.251173 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1078/1927] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:04 2022] GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2 => generated 1245 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:04.267006 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-175c3c9f-d2c4-47c3-bba2-0c0c39394de0 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Calling method '.version_select at 0x7f9e298dfca0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:04.280103 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-175c3c9f-d2c4-47c3-bba2-0c0c39394de0 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:04.285350 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-175c3c9f-d2c4-47c3-bba2-0c0c39394de0 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:04.288211 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-175c3c9f-d2c4-47c3-bba2-0c0c39394de0 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:04.319280 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-175c3c9f-d2c4-47c3-bba2-0c0c39394de0 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 3632 microversion: 2.25 time: 0.066582 Aug 07 01:19:04.320510 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1079/1928] 10.222.0.39 () {60 vars in 1184 bytes} [Sun Aug 7 01:19:04 2022] GET /compute/v2.1/os-migrations => generated 3632 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:19:04.325625 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-05f3071a-b37a-4ffc-be0c-2112d0982773 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e243899d0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:04.551163 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-05f3071a-b37a-4ffc-be0c-2112d0982773 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3706 microversion: 2.1 time: 0.229327 Aug 07 01:19:04.552114 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1080/1929] 10.222.0.39 () {58 vars in 1149 bytes} [Sun Aug 7 01:19:04 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3706 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:04.557156 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-638e5506-fa4f-43f8-be5e-fb8ab6bfb78d tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:04.558426 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-638e5506-fa4f-43f8-be5e-fb8ab6bfb78d tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:04.566018 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-638e5506-fa4f-43f8-be5e-fb8ab6bfb78d tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:04.566852 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-638e5506-fa4f-43f8-be5e-fb8ab6bfb78d tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:04.567487 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-638e5506-fa4f-43f8-be5e-fb8ab6bfb78d tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:04.568507 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-638e5506-fa4f-43f8-be5e-fb8ab6bfb78d tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:04.571056 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-638e5506-fa4f-43f8-be5e-fb8ab6bfb78d tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:04.571776 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-638e5506-fa4f-43f8-be5e-fb8ab6bfb78d tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:04.715904 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-638e5506-fa4f-43f8-be5e-fb8ab6bfb78d tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:04.728344 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-638e5506-fa4f-43f8-be5e-fb8ab6bfb78d tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1275 microversion: 2.1 time: 0.174875 Aug 07 01:19:04.740390 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1081/1930] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:04 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1275 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:04.748651 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0377395b-100d-4235-8153-8f3676bd15e6 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:04.749366 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0377395b-100d-4235-8153-8f3676bd15e6 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] [instance: 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:04.756677 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0377395b-100d-4235-8153-8f3676bd15e6 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:04.757169 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0377395b-100d-4235-8153-8f3676bd15e6 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:04.757840 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0377395b-100d-4235-8153-8f3676bd15e6 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:04.758806 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0377395b-100d-4235-8153-8f3676bd15e6 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:04.759433 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0377395b-100d-4235-8153-8f3676bd15e6 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:04.760235 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0377395b-100d-4235-8153-8f3676bd15e6 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:05.045959 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-0377395b-100d-4235-8153-8f3676bd15e6 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lazy-loading 'services' on Instance uuid 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:19:05.086545 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0377395b-100d-4235-8153-8f3676bd15e6 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a" status: 200 len: 2033 microversion: 2.25 time: 0.344060 Aug 07 01:19:05.087843 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1082/1931] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:19:04 2022] GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a => generated 2033 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:19:05.092679 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-801e3397-a78d-4725-b7ae-0c74cc34af22 req-95792a10-64c2-4d16-8dba-4330b27c2ad3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d44d731f-5443-4a7c-9a8d-8e330fd1639d", "name": "network-vif-deleted", "tag": "42ea78b8-0daa-46f3-8493-fb08aabf3fc3"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:05.124964 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-801e3397-a78d-4725-b7ae-0c74cc34af22 req-95792a10-64c2-4d16-8dba-4330b27c2ad3 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:05.125457 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-801e3397-a78d-4725-b7ae-0c74cc34af22 req-95792a10-64c2-4d16-8dba-4330b27c2ad3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:05.125894 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-801e3397-a78d-4725-b7ae-0c74cc34af22 req-95792a10-64c2-4d16-8dba-4330b27c2ad3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:05.152280 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-801e3397-a78d-4725-b7ae-0c74cc34af22 req-95792a10-64c2-4d16-8dba-4330b27c2ad3 service nova] Creating event network-vif-deleted:42ea78b8-0daa-46f3-8493-fb08aabf3fc3 for instance d44d731f-5443-4a7c-9a8d-8e330fd1639d on n-h1-master-1 Aug 07 01:19:05.158761 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-801e3397-a78d-4725-b7ae-0c74cc34af22 req-95792a10-64c2-4d16-8dba-4330b27c2ad3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068990 Aug 07 01:19:05.159833 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1083/1932] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:05.166455 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e7c58bc1-160b-497e-85e8-12f8e1fb52ab tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e2508f310>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:05.268623 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e7c58bc1-160b-497e-85e8-12f8e1fb52ab tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.106723 Aug 07 01:19:05.270846 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1084/1933] 10.222.0.39 () {58 vars in 1149 bytes} [Sun Aug 7 01:19:05 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:05.280101 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-77495ce1-7152-43a8-ba8c-5f8bd1ee5988 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:05.281326 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-77495ce1-7152-43a8-ba8c-5f8bd1ee5988 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:05.289291 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77495ce1-7152-43a8-ba8c-5f8bd1ee5988 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:05.290297 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77495ce1-7152-43a8-ba8c-5f8bd1ee5988 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:05.291018 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77495ce1-7152-43a8-ba8c-5f8bd1ee5988 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:05.292111 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77495ce1-7152-43a8-ba8c-5f8bd1ee5988 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:05.292799 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77495ce1-7152-43a8-ba8c-5f8bd1ee5988 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:05.293451 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77495ce1-7152-43a8-ba8c-5f8bd1ee5988 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:05.363908 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d041e9c6-9f02-41d3-b7c9-2fd9daa34661 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:05.373749 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d041e9c6-9f02-41d3-b7c9-2fd9daa34661 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe" status: 200 len: 1321 microversion: 2.1 time: 1.229752 Aug 07 01:19:05.383923 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 850/1934] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:04 2022] GET /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe => generated 1321 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:05.383923 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fd98acbc-b800-41fb-9903-b034f55dd48f tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Action: 'create', calling method: .version_select at 0x7f9e17f82c10>, body: {"keypair": {"name": "tempest-keypair-1716860004", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdZeXOyG4NmOfNjkigUS2/oCOIvkDp4RZXWX4k4wc2UPAUBgBPjFnJfkXAx5p6mka9rpqB/O+L5vIDM0kBguyNVl1Sxo+jYm/jHmcEFbEXLWbWon6mYZILwaDQ2ScOrwA=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:05.403380 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-fd98acbc-b800-41fb-9903-b034f55dd48f tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Getting quotas for project 1371b7aebfcf4088a02780393de8200f. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:19:05.409564 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-fd98acbc-b800-41fb-9903-b034f55dd48f tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Getting quotas for user 45ed48709ab84fa4b5b341332a843ad8 and project 1371b7aebfcf4088a02780393de8200f. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:19:05.439533 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fd98acbc-b800-41fb-9903-b034f55dd48f tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.062534 Aug 07 01:19:05.440845 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 851/1935] 10.222.0.39 () {62 vars in 1200 bytes} [Sun Aug 7 01:19:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 65 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 07 01:19:05.453449 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3b4b3b83-be1c-4223-ab51-caa84d8b1d13 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:05.453449 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3b4b3b83-be1c-4223-ab51-caa84d8b1d13 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] [instance: 1bc2c437-e710-4af4-9928-76c48834cfa2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:05.460820 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b4b3b83-be1c-4223-ab51-caa84d8b1d13 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:05.462118 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b4b3b83-be1c-4223-ab51-caa84d8b1d13 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:05.462118 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b4b3b83-be1c-4223-ab51-caa84d8b1d13 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:05.462722 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b4b3b83-be1c-4223-ab51-caa84d8b1d13 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:05.463249 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b4b3b83-be1c-4223-ab51-caa84d8b1d13 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:05.463772 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b4b3b83-be1c-4223-ab51-caa84d8b1d13 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:05.594190 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3b4b3b83-be1c-4223-ab51-caa84d8b1d13 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5080c88d51a8455bba8b70e33cca958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6a995089fa447e8f74df7d111b1c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:05.604016 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3b4b3b83-be1c-4223-ab51-caa84d8b1d13 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] 10.222.0.39 "GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2" status: 200 len: 1297 microversion: 2.1 time: 0.161947 Aug 07 01:19:05.605550 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 852/1936] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:05 2022] GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2 => generated 1297 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:05.612144 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-474f5d00-fcdc-4ad4-b677-6805ba22fa9e tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e17fa3dc0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:05.701550 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-474f5d00-fcdc-4ad4-b677-6805ba22fa9e tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images?limit=1" status: 200 len: 575 microversion: 2.1 time: 0.094113 Aug 07 01:19:05.711836 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 853/1937] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Aug 7 01:19:05 2022] GET /compute/v2.1/images?limit=1 => generated 575 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:05.718553 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-17196c99-3dfb-449f-8535-cc51216568dd tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e17fa3b80>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:05.784396 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-77495ce1-7152-43a8-ba8c-5f8bd1ee5988 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:05.793165 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-77495ce1-7152-43a8-ba8c-5f8bd1ee5988 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1475 microversion: 2.1 time: 0.520826 Aug 07 01:19:05.793794 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1085/1938] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:05 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1475 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:05.799692 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-aee4c1ce-7679-4b02-9843-1a1053158b0e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:05.801331 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-aee4c1ce-7679-4b02-9843-1a1053158b0e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:05.817599 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aee4c1ce-7679-4b02-9843-1a1053158b0e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:05.818382 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aee4c1ce-7679-4b02-9843-1a1053158b0e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:05.819457 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aee4c1ce-7679-4b02-9843-1a1053158b0e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:05.820493 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aee4c1ce-7679-4b02-9843-1a1053158b0e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:05.822174 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aee4c1ce-7679-4b02-9843-1a1053158b0e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:05.822804 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aee4c1ce-7679-4b02-9843-1a1053158b0e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:05.871106 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-17196c99-3dfb-449f-8535-cc51216568dd tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/detail?changes-since=2022-08-07T01%3A16%3A24Z" status: 200 len: 7021 microversion: 2.1 time: 0.156252 Aug 07 01:19:05.876083 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 854/1939] 10.222.0.39 () {58 vars in 1220 bytes} [Sun Aug 7 01:19:05 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-07T01%3A16%3A24Z => generated 7021 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:05.907317 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5444e917-b1f2-4b40-b52d-c974511202a5 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e17fc5700>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:05.974400 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5444e917-b1f2-4b40-b52d-c974511202a5 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-2026252661" status: 200 len: 665 microversion: 2.1 time: 0.077263 Aug 07 01:19:05.975580 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 855/1940] 10.222.0.39 () {58 vars in 1252 bytes} [Sun Aug 7 01:19:05 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-2026252661 => generated 665 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:05.994641 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-338281d1-dd89-4723-96c9-c711c2c0acd5 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e17f4f310>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:06.060675 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-338281d1-dd89-4723-96c9-c711c2c0acd5 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.39%2Fcompute%2Fv2.1%2Fservers%2F9e2ae24f-8349-46d5-b091-876927d02b68" status: 200 len: 1466 microversion: 2.1 time: 0.072574 Aug 07 01:19:06.061587 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 856/1941] 10.222.0.39 () {58 vars in 1338 bytes} [Sun Aug 7 01:19:05 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.39%2Fcompute%2Fv2.1%2Fservers%2F9e2ae24f-8349-46d5-b091-876927d02b68 => generated 1466 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:06.076462 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-dafe8d10-045a-41c6-a153-87c6e3269fb2 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e17f153a0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:06.152142 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-dafe8d10-045a-41c6-a153-87c6e3269fb2 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.39%2Fcompute%2Fservers%2F9e2ae24f-8349-46d5-b091-876927d02b68" status: 200 len: 1466 microversion: 2.1 time: 0.079816 Aug 07 01:19:06.153267 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 857/1942] 10.222.0.39 () {58 vars in 1324 bytes} [Sun Aug 7 01:19:06 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.39%2Fcompute%2Fservers%2F9e2ae24f-8349-46d5-b091-876927d02b68 => generated 1466 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:19:06.243189 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4297f818-c420-411a-a92d-906018d824a5 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e2408db80>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:06.270722 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-aee4c1ce-7679-4b02-9843-1a1053158b0e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:06.279928 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-aee4c1ce-7679-4b02-9843-1a1053158b0e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1275 microversion: 2.1 time: 0.484826 Aug 07 01:19:06.292458 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1086/1943] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:05 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1275 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:06.398506 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c58b73d4-4e1f-4f1f-950e-36cc1d4169e7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:06.399136 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c58b73d4-4e1f-4f1f-950e-36cc1d4169e7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 545e5bdb-26c5-4585-90bd-a51dc9e956fe] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:06.401797 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:06.419625 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c58b73d4-4e1f-4f1f-950e-36cc1d4169e7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:06.420171 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c58b73d4-4e1f-4f1f-950e-36cc1d4169e7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:06.420620 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c58b73d4-4e1f-4f1f-950e-36cc1d4169e7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:06.421350 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c58b73d4-4e1f-4f1f-950e-36cc1d4169e7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:06.421842 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c58b73d4-4e1f-4f1f-950e-36cc1d4169e7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:06.424415 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c58b73d4-4e1f-4f1f-950e-36cc1d4169e7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:06.442400 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4297f818-c420-411a-a92d-906018d824a5 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7796 microversion: 2.1 time: 0.203853 Aug 07 01:19:06.443342 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 858/1944] 10.222.0.39 () {58 vars in 1170 bytes} [Sun Aug 7 01:19:06 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7796 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:06.466402 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b7d8ab97-7347-4203-8fa3-f6d88b52df6d tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e17fa3f70>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:06.567731 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b7d8ab97-7347-4203-8fa3-f6d88b52df6d tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.104200 Aug 07 01:19:06.569653 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 859/1945] 10.222.0.39 () {58 vars in 1170 bytes} [Sun Aug 7 01:19:06 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:19:06.590230 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4720955f-24dd-4929-8b31-19af6a1cea4c tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e24063c10>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:06.683175 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4720955f-24dd-4929-8b31-19af6a1cea4c tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/e825bd61-bf05-4bd4-aa72-78daf2231731" status: 200 len: 784 microversion: 2.1 time: 0.099061 Aug 07 01:19:06.684662 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 860/1946] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:19:06 2022] GET /compute/v2.1/images/e825bd61-bf05-4bd4-aa72-78daf2231731 => generated 784 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:19:06.704633 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8797d63b-5c92-4c13-8d4e-6a5aa625989e tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:06.705904 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8797d63b-5c92-4c13-8d4e-6a5aa625989e tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] [instance: 1bc2c437-e710-4af4-9928-76c48834cfa2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:06.717876 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=2,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:06.722380 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8797d63b-5c92-4c13-8d4e-6a5aa625989e tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:06.723496 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8797d63b-5c92-4c13-8d4e-6a5aa625989e tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:06.724306 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8797d63b-5c92-4c13-8d4e-6a5aa625989e tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:06.725787 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8797d63b-5c92-4c13-8d4e-6a5aa625989e tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:06.726705 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8797d63b-5c92-4c13-8d4e-6a5aa625989e tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:06.727333 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8797d63b-5c92-4c13-8d4e-6a5aa625989e tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:06.740338 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:07.019669 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8797d63b-5c92-4c13-8d4e-6a5aa625989e tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5080c88d51a8455bba8b70e33cca958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6a995089fa447e8f74df7d111b1c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:07.039476 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8797d63b-5c92-4c13-8d4e-6a5aa625989e tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] 10.222.0.39 "GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2" status: 200 len: 1303 microversion: 2.1 time: 0.351866 Aug 07 01:19:07.043490 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 861/1947] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:06 2022] GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2 => generated 1303 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:07.061634 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e9d1745a-bf3d-45e0-9df8-6367afebb69a tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e17f4f1f0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:07.140771 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c58b73d4-4e1f-4f1f-950e-36cc1d4169e7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:07.169079 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c58b73d4-4e1f-4f1f-950e-36cc1d4169e7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe" status: 200 len: 1321 microversion: 2.1 time: 0.776371 Aug 07 01:19:07.169869 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1087/1948] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:06 2022] GET /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe => generated 1321 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:19:07.193195 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-62e207fd-d10a-4d6b-8bfe-c9c8696e6d8a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:07.194682 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-62e207fd-d10a-4d6b-8bfe-c9c8696e6d8a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:07.215576 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62e207fd-d10a-4d6b-8bfe-c9c8696e6d8a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:07.216343 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62e207fd-d10a-4d6b-8bfe-c9c8696e6d8a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:07.221356 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62e207fd-d10a-4d6b-8bfe-c9c8696e6d8a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:07.222494 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62e207fd-d10a-4d6b-8bfe-c9c8696e6d8a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:07.223239 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62e207fd-d10a-4d6b-8bfe-c9c8696e6d8a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:07.223903 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62e207fd-d10a-4d6b-8bfe-c9c8696e6d8a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:07.242489 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e9d1745a-bf3d-45e0-9df8-6367afebb69a tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 844 microversion: 2.1 time: 0.194403 Aug 07 01:19:07.243938 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 862/1949] 10.222.0.39 () {58 vars in 1158 bytes} [Sun Aug 7 01:19:07 2022] GET /compute/v2.1/images/detail?limit=1 => generated 844 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:07.262915 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6eb8c48c-6306-48ab-bce3-e56ed1821b03 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e17fc6280>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:08.292146 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-62e207fd-d10a-4d6b-8bfe-c9c8696e6d8a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:08.312452 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-62e207fd-d10a-4d6b-8bfe-c9c8696e6d8a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1475 microversion: 2.1 time: 1.141212 Aug 07 01:19:08.313700 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1088/1950] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:07 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1475 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:08.323986 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-eb7d8b4e-4b48-4ed0-a61b-caad48970d31 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:08.327337 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-eb7d8b4e-4b48-4ed0-a61b-caad48970d31 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:08.346247 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb7d8b4e-4b48-4ed0-a61b-caad48970d31 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:08.352392 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb7d8b4e-4b48-4ed0-a61b-caad48970d31 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:08.353289 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb7d8b4e-4b48-4ed0-a61b-caad48970d31 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:08.354453 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb7d8b4e-4b48-4ed0-a61b-caad48970d31 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:08.355250 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb7d8b4e-4b48-4ed0-a61b-caad48970d31 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:08.356461 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb7d8b4e-4b48-4ed0-a61b-caad48970d31 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:08.451682 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6eb8c48c-6306-48ab-bce3-e56ed1821b03 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "DELETE /compute/v2.1/images/0bc8a99f-bbcc-4030-8b43-689c49c72915" status: 204 len: 0 microversion: 2.1 time: 1.194553 Aug 07 01:19:08.459439 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 863/1951] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:07 2022] DELETE /compute/v2.1/images/0bc8a99f-bbcc-4030-8b43-689c49c72915 => generated 0 bytes in 1204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 07 01:19:08.475629 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-b3446efb-db2a-4423-89c3-5101ddcc03a7 req-ea40e6c5-a7d3-43a0-bbbd-40df88ee124b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "545e5bdb-26c5-4585-90bd-a51dc9e956fe", "tag": "3b7e0782-a83d-4791-8b3c-ac644f0eaa6e"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:08.502635 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b3446efb-db2a-4423-89c3-5101ddcc03a7 req-ea40e6c5-a7d3-43a0-bbbd-40df88ee124b service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:08.503100 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b3446efb-db2a-4423-89c3-5101ddcc03a7 req-ea40e6c5-a7d3-43a0-bbbd-40df88ee124b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:08.505382 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b3446efb-db2a-4423-89c3-5101ddcc03a7 req-ea40e6c5-a7d3-43a0-bbbd-40df88ee124b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:08.527633 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-b3446efb-db2a-4423-89c3-5101ddcc03a7 req-ea40e6c5-a7d3-43a0-bbbd-40df88ee124b service nova] Creating event network-changed:3b7e0782-a83d-4791-8b3c-ac644f0eaa6e for instance 545e5bdb-26c5-4585-90bd-a51dc9e956fe on n-h2-master-1 Aug 07 01:19:08.539594 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-b3446efb-db2a-4423-89c3-5101ddcc03a7 req-ea40e6c5-a7d3-43a0-bbbd-40df88ee124b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076298 Aug 07 01:19:08.540624 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 864/1952] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:08.546315 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-56d5677f-5239-4814-ba9a-8b592edf1709 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:08.547184 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-56d5677f-5239-4814-ba9a-8b592edf1709 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] [instance: 1bc2c437-e710-4af4-9928-76c48834cfa2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:08.556013 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-56d5677f-5239-4814-ba9a-8b592edf1709 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:08.556817 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-56d5677f-5239-4814-ba9a-8b592edf1709 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:08.557432 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-56d5677f-5239-4814-ba9a-8b592edf1709 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:08.558278 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-56d5677f-5239-4814-ba9a-8b592edf1709 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:08.558908 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-56d5677f-5239-4814-ba9a-8b592edf1709 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:08.559593 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-56d5677f-5239-4814-ba9a-8b592edf1709 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:08.737794 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-eb7d8b4e-4b48-4ed0-a61b-caad48970d31 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:08.745894 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-eb7d8b4e-4b48-4ed0-a61b-caad48970d31 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1317 microversion: 2.1 time: 0.430147 Aug 07 01:19:08.746493 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1089/1953] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:08 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1317 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:08.753130 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-75bc80fb-f6d0-4d28-a889-326a7d421847 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:08.753650 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-75bc80fb-f6d0-4d28-a889-326a7d421847 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 545e5bdb-26c5-4585-90bd-a51dc9e956fe] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:08.765164 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75bc80fb-f6d0-4d28-a889-326a7d421847 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:08.765962 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75bc80fb-f6d0-4d28-a889-326a7d421847 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:08.766397 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75bc80fb-f6d0-4d28-a889-326a7d421847 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:08.768110 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75bc80fb-f6d0-4d28-a889-326a7d421847 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:08.768356 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75bc80fb-f6d0-4d28-a889-326a7d421847 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:08.768785 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75bc80fb-f6d0-4d28-a889-326a7d421847 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:08.797430 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-56d5677f-5239-4814-ba9a-8b592edf1709 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5080c88d51a8455bba8b70e33cca958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6a995089fa447e8f74df7d111b1c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:08.813004 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-56d5677f-5239-4814-ba9a-8b592edf1709 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] 10.222.0.39 "GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2" status: 200 len: 1303 microversion: 2.1 time: 0.270518 Aug 07 01:19:08.836605 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 865/1954] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:08 2022] GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2 => generated 1303 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:08.845018 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4001655e-1b91-4224-a15f-924217943669 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:08.845018 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4001655e-1b91-4224-a15f-924217943669 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:08.853625 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4001655e-1b91-4224-a15f-924217943669 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:08.854117 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4001655e-1b91-4224-a15f-924217943669 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:08.854555 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4001655e-1b91-4224-a15f-924217943669 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:08.855315 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4001655e-1b91-4224-a15f-924217943669 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:08.855773 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4001655e-1b91-4224-a15f-924217943669 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:08.864234 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4001655e-1b91-4224-a15f-924217943669 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:08.941585 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4001655e-1b91-4224-a15f-924217943669 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:19:09.080182 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-75bc80fb-f6d0-4d28-a889-326a7d421847 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:09.085727 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4001655e-1b91-4224-a15f-924217943669 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "DELETE /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79" status: 204 len: 0 microversion: 2.1 time: 0.246059 Aug 07 01:19:09.087026 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 866/1955] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:19:08 2022] DELETE /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:19:09.098567 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-75bc80fb-f6d0-4d28-a889-326a7d421847 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe" status: 200 len: 1321 microversion: 2.1 time: 0.350633 Aug 07 01:19:09.100095 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1090/1956] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:08 2022] GET /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe => generated 1321 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:09.102589 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ca15a3de-3a45-4471-9bf0-9d5ecfd183b0 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e17f21820>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:09.108750 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-347b2aa5-3043-4520-89f7-246a5fceb911 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:09.110788 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-347b2aa5-3043-4520-89f7-246a5fceb911 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:09.121588 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-347b2aa5-3043-4520-89f7-246a5fceb911 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:09.122336 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-347b2aa5-3043-4520-89f7-246a5fceb911 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:09.123135 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-347b2aa5-3043-4520-89f7-246a5fceb911 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:09.124229 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-347b2aa5-3043-4520-89f7-246a5fceb911 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:09.124809 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-347b2aa5-3043-4520-89f7-246a5fceb911 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:09.125351 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-347b2aa5-3043-4520-89f7-246a5fceb911 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:09.536559 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=4 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:09.717999 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-347b2aa5-3043-4520-89f7-246a5fceb911 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:09.726638 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-347b2aa5-3043-4520-89f7-246a5fceb911 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79" status: 200 len: 1486 microversion: 2.1 time: 0.624646 Aug 07 01:19:09.738702 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1091/1957] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:09 2022] GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79 => generated 1486 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:09.756463 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a6d12a90-6bb3-459a-aebe-6308fc6bdc1e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:09.770074 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a6d12a90-6bb3-459a-aebe-6308fc6bdc1e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:09.787785 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a6d12a90-6bb3-459a-aebe-6308fc6bdc1e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:09.789431 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a6d12a90-6bb3-459a-aebe-6308fc6bdc1e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:09.794606 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a6d12a90-6bb3-459a-aebe-6308fc6bdc1e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:09.795819 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a6d12a90-6bb3-459a-aebe-6308fc6bdc1e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:09.796316 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a6d12a90-6bb3-459a-aebe-6308fc6bdc1e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:09.796800 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a6d12a90-6bb3-459a-aebe-6308fc6bdc1e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:10.452152 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ca15a3de-3a45-4471-9bf0-9d5ecfd183b0 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "DELETE /compute/v2.1/images/628a7b3a-d5f5-4d29-9524-17454a5cfe53" status: 204 len: 0 microversion: 2.1 time: 1.362655 Aug 07 01:19:10.454982 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 867/1958] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:09 2022] DELETE /compute/v2.1/images/628a7b3a-d5f5-4d29-9524-17454a5cfe53 => generated 0 bytes in 1366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:19:10.462317 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ef1da6cb-7343-4328-bf4a-0b28f10e0eb0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:10.463624 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ef1da6cb-7343-4328-bf4a-0b28f10e0eb0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:10.474126 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a6d12a90-6bb3-459a-aebe-6308fc6bdc1e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:10.492197 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a6d12a90-6bb3-459a-aebe-6308fc6bdc1e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1475 microversion: 2.1 time: 0.751942 Aug 07 01:19:10.497253 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1092/1959] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:09 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1475 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:10.517898 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ef1da6cb-7343-4328-bf4a-0b28f10e0eb0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:10.520491 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ef1da6cb-7343-4328-bf4a-0b28f10e0eb0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:10.523699 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ef1da6cb-7343-4328-bf4a-0b28f10e0eb0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:10.524633 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2f33592e-b291-4e56-9360-258d7b31547b tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:10.527111 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ef1da6cb-7343-4328-bf4a-0b28f10e0eb0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:10.530223 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2f33592e-b291-4e56-9360-258d7b31547b tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] [instance: 1bc2c437-e710-4af4-9928-76c48834cfa2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:10.531160 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ef1da6cb-7343-4328-bf4a-0b28f10e0eb0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:10.534217 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ef1da6cb-7343-4328-bf4a-0b28f10e0eb0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:10.571115 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f33592e-b291-4e56-9360-258d7b31547b tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:10.573243 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f33592e-b291-4e56-9360-258d7b31547b tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:10.578699 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f33592e-b291-4e56-9360-258d7b31547b tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:10.582274 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f33592e-b291-4e56-9360-258d7b31547b tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:10.586818 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f33592e-b291-4e56-9360-258d7b31547b tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:10.588010 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f33592e-b291-4e56-9360-258d7b31547b tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:11.531086 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2f33592e-b291-4e56-9360-258d7b31547b tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5080c88d51a8455bba8b70e33cca958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6a995089fa447e8f74df7d111b1c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:11.549770 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2f33592e-b291-4e56-9360-258d7b31547b tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] 10.222.0.39 "GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2" status: 200 len: 1371 microversion: 2.1 time: 1.045963 Aug 07 01:19:11.567850 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1093/1960] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:10 2022] GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2 => generated 1371 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:11.579105 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-634493e0-3018-4222-932f-725a96368ac6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:11.581234 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-634493e0-3018-4222-932f-725a96368ac6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 545e5bdb-26c5-4585-90bd-a51dc9e956fe] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:11.593923 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-634493e0-3018-4222-932f-725a96368ac6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:11.594418 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-634493e0-3018-4222-932f-725a96368ac6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:11.598802 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-634493e0-3018-4222-932f-725a96368ac6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:11.599674 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-634493e0-3018-4222-932f-725a96368ac6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:11.600193 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-634493e0-3018-4222-932f-725a96368ac6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:11.600641 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-634493e0-3018-4222-932f-725a96368ac6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:11.745396 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ef1da6cb-7343-4328-bf4a-0b28f10e0eb0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:11.764358 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ef1da6cb-7343-4328-bf4a-0b28f10e0eb0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1317 microversion: 2.1 time: 1.306854 Aug 07 01:19:11.765772 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 868/1961] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:10 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1317 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:11.781511 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a6531690-5387-4a50-956c-e6a4766e24ba tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e24057550>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:11.938611 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-634493e0-3018-4222-932f-725a96368ac6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:11.962027 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-634493e0-3018-4222-932f-725a96368ac6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe" status: 200 len: 1321 microversion: 2.1 time: 0.392302 Aug 07 01:19:11.976568 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1094/1962] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:11 2022] GET /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe => generated 1321 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:11.998785 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-0c701765-799c-471f-8be3-690c68b7d0eb req-a88811e6-651e-4e31-9b21-763d70454c29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a4508ef-5167-4c2c-8bba-4a47c875263b", "name": "network-vif-unplugged", "status": "completed", "tag": "2ce99914-7226-47ae-b72b-c5f4c2bc3fac"}, {"name": "network-changed", "server_uuid": "7a4508ef-5167-4c2c-8bba-4a47c875263b", "tag": "2ce99914-7226-47ae-b72b-c5f4c2bc3fac"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:12.012957 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0c701765-799c-471f-8be3-690c68b7d0eb req-a88811e6-651e-4e31-9b21-763d70454c29 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:12.013726 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0c701765-799c-471f-8be3-690c68b7d0eb req-a88811e6-651e-4e31-9b21-763d70454c29 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:12.016817 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0c701765-799c-471f-8be3-690c68b7d0eb req-a88811e6-651e-4e31-9b21-763d70454c29 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:12.048204 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-0c701765-799c-471f-8be3-690c68b7d0eb req-a88811e6-651e-4e31-9b21-763d70454c29 service nova] Creating event network-vif-unplugged:2ce99914-7226-47ae-b72b-c5f4c2bc3fac for instance 7a4508ef-5167-4c2c-8bba-4a47c875263b on n-h2-master-1 Aug 07 01:19:12.054014 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-0c701765-799c-471f-8be3-690c68b7d0eb req-a88811e6-651e-4e31-9b21-763d70454c29 service nova] Creating event network-changed:2ce99914-7226-47ae-b72b-c5f4c2bc3fac for instance 7a4508ef-5167-4c2c-8bba-4a47c875263b on n-h2-master-1 Aug 07 01:19:12.069651 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [req-0c701765-799c-471f-8be3-690c68b7d0eb req-a88811e6-651e-4e31-9b21-763d70454c29 service nova] Instance 7a4508ef-5167-4c2c-8bba-4a47c875263b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 01:19:12.114170 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-0c701765-799c-471f-8be3-690c68b7d0eb req-a88811e6-651e-4e31-9b21-763d70454c29 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.135712 Aug 07 01:19:12.115218 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1095/1963] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:12.129554 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1abb082c-4627-426b-813f-8222338ddfa2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:12.132123 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1abb082c-4627-426b-813f-8222338ddfa2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:12.140099 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1abb082c-4627-426b-813f-8222338ddfa2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:12.140612 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1abb082c-4627-426b-813f-8222338ddfa2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:12.141085 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1abb082c-4627-426b-813f-8222338ddfa2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:12.142271 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1abb082c-4627-426b-813f-8222338ddfa2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:12.142751 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1abb082c-4627-426b-813f-8222338ddfa2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:12.143626 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1abb082c-4627-426b-813f-8222338ddfa2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:12.204637 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1abb082c-4627-426b-813f-8222338ddfa2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:12.205387 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1abb082c-4627-426b-813f-8222338ddfa2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:12.205850 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1abb082c-4627-426b-813f-8222338ddfa2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:12.207016 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-1abb082c-4627-426b-813f-8222338ddfa2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lazy-loading 'fault' on Instance uuid 06b38422-fb09-4331-b7cb-3d5f99cc2e79 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:19:12.470533 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1abb082c-4627-426b-813f-8222338ddfa2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:12.475228 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:12.484242 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1abb082c-4627-426b-813f-8222338ddfa2 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79" status: 200 len: 1301 microversion: 2.1 time: 0.367192 Aug 07 01:19:12.484867 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1096/1964] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:12 2022] GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79 => generated 1301 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:12.504721 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-0805a098-6213-4f26-86fb-4da67f2b063b req-38bf8560-9f28-4e68-9609-428ba4daa7c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06b38422-fb09-4331-b7cb-3d5f99cc2e79", "name": "network-vif-deleted", "tag": "d5cc418b-ee3e-4a9b-b03a-2585f8a9e3b3"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:12.521266 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0805a098-6213-4f26-86fb-4da67f2b063b req-38bf8560-9f28-4e68-9609-428ba4daa7c6 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:12.521754 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0805a098-6213-4f26-86fb-4da67f2b063b req-38bf8560-9f28-4e68-9609-428ba4daa7c6 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:12.522190 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0805a098-6213-4f26-86fb-4da67f2b063b req-38bf8560-9f28-4e68-9609-428ba4daa7c6 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:12.556485 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-0805a098-6213-4f26-86fb-4da67f2b063b req-38bf8560-9f28-4e68-9609-428ba4daa7c6 service nova] Creating event network-vif-deleted:d5cc418b-ee3e-4a9b-b03a-2585f8a9e3b3 for instance 06b38422-fb09-4331-b7cb-3d5f99cc2e79 on n-h1-master-1 Aug 07 01:19:12.566654 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-0805a098-6213-4f26-86fb-4da67f2b063b req-38bf8560-9f28-4e68-9609-428ba4daa7c6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080498 Aug 07 01:19:12.570463 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1097/1965] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:12.580578 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7e8a809e-fac7-4245-a42c-34584ac8ad8e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:12.587161 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7e8a809e-fac7-4245-a42c-34584ac8ad8e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:12.616992 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e8a809e-fac7-4245-a42c-34584ac8ad8e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:12.617894 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e8a809e-fac7-4245-a42c-34584ac8ad8e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:12.618599 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e8a809e-fac7-4245-a42c-34584ac8ad8e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:12.619595 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e8a809e-fac7-4245-a42c-34584ac8ad8e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:12.620260 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e8a809e-fac7-4245-a42c-34584ac8ad8e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:12.620859 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e8a809e-fac7-4245-a42c-34584ac8ad8e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:13.448617 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a6531690-5387-4a50-956c-e6a4766e24ba tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "DELETE /compute/v2.1/images/e2ac911f-15de-4f5b-9d36-e03b3325331a" status: 204 len: 0 microversion: 2.1 time: 1.679738 Aug 07 01:19:13.462963 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 869/1966] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:11 2022] DELETE /compute/v2.1/images/e2ac911f-15de-4f5b-9d36-e03b3325331a => generated 0 bytes in 1685 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:19:13.479272 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-284d695d-615c-4abc-87c1-a3e61d1412c4 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:13.480257 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-284d695d-615c-4abc-87c1-a3e61d1412c4 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] [instance: 1bc2c437-e710-4af4-9928-76c48834cfa2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:13.538916 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-284d695d-615c-4abc-87c1-a3e61d1412c4 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:13.542892 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-284d695d-615c-4abc-87c1-a3e61d1412c4 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:13.545326 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-284d695d-615c-4abc-87c1-a3e61d1412c4 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:13.552643 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-284d695d-615c-4abc-87c1-a3e61d1412c4 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:13.554862 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-284d695d-615c-4abc-87c1-a3e61d1412c4 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:13.573742 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-284d695d-615c-4abc-87c1-a3e61d1412c4 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:13.613931 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=8 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:13.964731 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7e8a809e-fac7-4245-a42c-34584ac8ad8e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:13.977551 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7e8a809e-fac7-4245-a42c-34584ac8ad8e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1475 microversion: 2.1 time: 1.405471 Aug 07 01:19:13.993964 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1098/1967] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:12 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1475 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:14.002317 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dd82e4d9-5508-4201-8238-9012d68be6b5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:14.003333 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-dd82e4d9-5508-4201-8238-9012d68be6b5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:14.010965 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd82e4d9-5508-4201-8238-9012d68be6b5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:14.011840 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd82e4d9-5508-4201-8238-9012d68be6b5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:14.012635 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd82e4d9-5508-4201-8238-9012d68be6b5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:14.013789 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd82e4d9-5508-4201-8238-9012d68be6b5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:14.014990 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd82e4d9-5508-4201-8238-9012d68be6b5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:14.015664 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd82e4d9-5508-4201-8238-9012d68be6b5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:14.247710 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=32 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:14.665268 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-dd82e4d9-5508-4201-8238-9012d68be6b5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:14.674464 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-dd82e4d9-5508-4201-8238-9012d68be6b5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1317 microversion: 2.1 time: 0.678811 Aug 07 01:19:14.691539 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1099/1968] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:13 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1317 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:14.709130 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-284d695d-615c-4abc-87c1-a3e61d1412c4 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5080c88d51a8455bba8b70e33cca958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6a995089fa447e8f74df7d111b1c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:14.712095 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-73505d3f-ca46-4567-b952-e7974a783ad9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:14.712872 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-73505d3f-ca46-4567-b952-e7974a783ad9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 545e5bdb-26c5-4585-90bd-a51dc9e956fe] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:14.728109 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73505d3f-ca46-4567-b952-e7974a783ad9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:14.728843 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73505d3f-ca46-4567-b952-e7974a783ad9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:14.729381 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73505d3f-ca46-4567-b952-e7974a783ad9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:14.731426 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73505d3f-ca46-4567-b952-e7974a783ad9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:14.733757 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73505d3f-ca46-4567-b952-e7974a783ad9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:14.735038 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73505d3f-ca46-4567-b952-e7974a783ad9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:14.753091 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-284d695d-615c-4abc-87c1-a3e61d1412c4 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] 10.222.0.39 "GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2" status: 200 len: 1371 microversion: 2.1 time: 1.284120 Aug 07 01:19:14.754696 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 870/1969] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:13 2022] GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2 => generated 1371 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:14.784646 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6ece8999-9ca1-4f4e-8170-0116c8fee3ca tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:14.785733 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6ece8999-9ca1-4f4e-8170-0116c8fee3ca tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] [instance: 9e2ae24f-8349-46d5-b091-876927d02b68] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:14.814868 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ece8999-9ca1-4f4e-8170-0116c8fee3ca tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:14.817006 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ece8999-9ca1-4f4e-8170-0116c8fee3ca tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:14.818072 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ece8999-9ca1-4f4e-8170-0116c8fee3ca tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:14.820030 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ece8999-9ca1-4f4e-8170-0116c8fee3ca tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:14.822339 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ece8999-9ca1-4f4e-8170-0116c8fee3ca tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:14.823107 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ece8999-9ca1-4f4e-8170-0116c8fee3ca tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:14.870166 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6ece8999-9ca1-4f4e-8170-0116c8fee3ca tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] [instance: 9e2ae24f-8349-46d5-b091-876927d02b68] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:19:15.074053 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6ece8999-9ca1-4f4e-8170-0116c8fee3ca tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68" status: 204 len: 0 microversion: 2.1 time: 0.315695 Aug 07 01:19:15.078229 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 871/1970] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:19:14 2022] DELETE /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:19:15.088974 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8f3f963c-82f3-4c56-9298-273667979295 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:15.091694 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8f3f963c-82f3-4c56-9298-273667979295 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 06b38422-fb09-4331-b7cb-3d5f99cc2e79] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:15.116421 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f3f963c-82f3-4c56-9298-273667979295 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:15.137475 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f3f963c-82f3-4c56-9298-273667979295 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:15.153088 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f3f963c-82f3-4c56-9298-273667979295 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:15.158491 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f3f963c-82f3-4c56-9298-273667979295 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:15.166251 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f3f963c-82f3-4c56-9298-273667979295 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:15.194676 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f3f963c-82f3-4c56-9298-273667979295 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:15.226397 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-73505d3f-ca46-4567-b952-e7974a783ad9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:15.241905 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-73505d3f-ca46-4567-b952-e7974a783ad9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe" status: 200 len: 1321 microversion: 2.1 time: 0.548703 Aug 07 01:19:15.242759 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1100/1971] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:14 2022] GET /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe => generated 1321 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:15.254573 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-b28eade9-04c4-4ece-ab4f-98833d18bc3d req-e666c692-4edf-4c5b-b0f8-58cd6842cc5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "545e5bdb-26c5-4585-90bd-a51dc9e956fe", "name": "network-vif-plugged", "status": "completed", "tag": "3b7e0782-a83d-4791-8b3c-ac644f0eaa6e"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:15.281767 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b28eade9-04c4-4ece-ab4f-98833d18bc3d req-e666c692-4edf-4c5b-b0f8-58cd6842cc5a service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:15.284628 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b28eade9-04c4-4ece-ab4f-98833d18bc3d req-e666c692-4edf-4c5b-b0f8-58cd6842cc5a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:15.285399 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b28eade9-04c4-4ece-ab4f-98833d18bc3d req-e666c692-4edf-4c5b-b0f8-58cd6842cc5a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:15.303747 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-8f3f963c-82f3-4c56-9298-273667979295 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] HTTP exception thrown: Instance 06b38422-fb09-4331-b7cb-3d5f99cc2e79 could not be found. Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8f3f963c-82f3-4c56-9298-273667979295 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Request method failure captured: Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79 HTTP/1.1 Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xD2QrDlzIc_grVn-Bzr-WavOVOy3T9RqJf2eyxWxWwUPZ94QzCFwgeck9D1ChJJ9AB7o3ULcMPaoAAJfzZ17udYuxyOEAMG7oMTmbHKnZZcGvpFG8Yq4IrOXFwzhg6g_J5MwvnuChwQ9ZEP_954XcgYZcH_UrfG9Ko0_RGwm3ZjDhc Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: ba9e7a1c1fe14f47b5a5acf2fe8893b5 Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-LiveMigrationTest-1584424429 Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ba9e7a1c1fe14f47b5a5acf2fe8893b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ba9e7a1c1fe14f47b5a5acf2fe8893b5", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ba9e7a1c1fe14f47b5a5acf2fe8893b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ba9e7a1c1fe14f47b5a5acf2fe8893b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-LiveMigrationTest-1584424429 Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: ba9e7a1c1fe14f47b5a5acf2fe8893b5 Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-LiveMigrationTest-1584424429 Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-LiveMigrationTest-1584424429-project Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 0327f14a188e45fba98a58e5fd061248 Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-LiveMigrationTest-1584424429-project Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 06b38422-fb09-4331-b7cb-3d5f99cc2e79 could not be found. Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '06b38422-fb09-4331-b7cb-3d5f99cc2e79'} Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06b38422-fb09-4331-b7cb-3d5f99cc2e79 could not be found. Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06b38422-fb09-4331-b7cb-3d5f99cc2e79 could not be found. Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:19:15.307609 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:19:15.315490 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:15.315490 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:19:15.315490 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:19:15.315490 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:19:15.315490 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:19:15.315490 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06b38422-fb09-4331-b7cb-3d5f99cc2e79 could not be found. Aug 07 01:19:15.315490 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:19:15.316649 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8f3f963c-82f3-4c56-9298-273667979295 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Returning 404 to user: Instance 06b38422-fb09-4331-b7cb-3d5f99cc2e79 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:19:15.321759 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8f3f963c-82f3-4c56-9298-273667979295 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79" status: 404 len: 111 microversion: 2.1 time: 0.239534 Aug 07 01:19:15.323747 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-b28eade9-04c4-4ece-ab4f-98833d18bc3d req-e666c692-4edf-4c5b-b0f8-58cd6842cc5a service nova] Creating event network-vif-plugged:3b7e0782-a83d-4791-8b3c-ac644f0eaa6e for instance 545e5bdb-26c5-4585-90bd-a51dc9e956fe on n-h2-master-1 Aug 07 01:19:15.324434 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 872/1972] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:15 2022] GET /compute/v2.1/servers/06b38422-fb09-4331-b7cb-3d5f99cc2e79 => generated 111 bytes in 245 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:19:15.350782 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-706342ae-48f9-4a6b-aa53-7c13fc823141 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:15.352036 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-706342ae-48f9-4a6b-aa53-7c13fc823141 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:15.354176 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-b28eade9-04c4-4ece-ab4f-98833d18bc3d req-e666c692-4edf-4c5b-b0f8-58cd6842cc5a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109103 Aug 07 01:19:15.356331 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1101/1973] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:15.369472 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1ae8da5f-18fd-40a1-afe5-cbaf805c17ff tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:15.377436 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1ae8da5f-18fd-40a1-afe5-cbaf805c17ff tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] [instance: 9e2ae24f-8349-46d5-b091-876927d02b68] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:15.380489 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-706342ae-48f9-4a6b-aa53-7c13fc823141 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:15.381202 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-706342ae-48f9-4a6b-aa53-7c13fc823141 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:15.381844 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-706342ae-48f9-4a6b-aa53-7c13fc823141 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:15.393375 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-706342ae-48f9-4a6b-aa53-7c13fc823141 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:15.394104 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-706342ae-48f9-4a6b-aa53-7c13fc823141 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:15.394735 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-706342ae-48f9-4a6b-aa53-7c13fc823141 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:15.408986 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ae8da5f-18fd-40a1-afe5-cbaf805c17ff tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:15.424512 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=16 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:15.426300 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ae8da5f-18fd-40a1-afe5-cbaf805c17ff tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:15.426998 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ae8da5f-18fd-40a1-afe5-cbaf805c17ff tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:15.428213 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ae8da5f-18fd-40a1-afe5-cbaf805c17ff tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:15.428997 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ae8da5f-18fd-40a1-afe5-cbaf805c17ff tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:15.429699 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ae8da5f-18fd-40a1-afe5-cbaf805c17ff tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:16.061287 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1ae8da5f-18fd-40a1-afe5-cbaf805c17ff tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '786962988b754fb69bd48070c2992e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614797cd26be4995b087ab864f35d235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:16.083768 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1ae8da5f-18fd-40a1-afe5-cbaf805c17ff tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68" status: 200 len: 1471 microversion: 2.1 time: 0.725835 Aug 07 01:19:16.089358 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1102/1974] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:15 2022] GET /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68 => generated 1471 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:16.099372 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-64cffc3f-cc0b-4382-bad9-e9fcd65eb3dc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:16.102406 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-64cffc3f-cc0b-4382-bad9-e9fcd65eb3dc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:16.116119 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64cffc3f-cc0b-4382-bad9-e9fcd65eb3dc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:16.118926 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64cffc3f-cc0b-4382-bad9-e9fcd65eb3dc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:16.121468 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64cffc3f-cc0b-4382-bad9-e9fcd65eb3dc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:16.122518 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64cffc3f-cc0b-4382-bad9-e9fcd65eb3dc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:16.124133 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64cffc3f-cc0b-4382-bad9-e9fcd65eb3dc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:16.124882 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64cffc3f-cc0b-4382-bad9-e9fcd65eb3dc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:16.168650 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-64cffc3f-cc0b-4382-bad9-e9fcd65eb3dc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:19:16.313804 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-64cffc3f-cc0b-4382-bad9-e9fcd65eb3dc tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0" status: 204 len: 0 microversion: 2.1 time: 0.216866 Aug 07 01:19:16.321470 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1103/1975] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:19:16 2022] DELETE /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:19:16.329541 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-850f81fd-9eb5-44a2-9267-69c14554633a req-058e8784-517b-4f20-b5df-f559880b9bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bc2c437-e710-4af4-9928-76c48834cfa2", "tag": "ab6ea765-494d-449a-a112-5e331ebc939d"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:16.343221 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-850f81fd-9eb5-44a2-9267-69c14554633a req-058e8784-517b-4f20-b5df-f559880b9bf6 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:16.344505 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-850f81fd-9eb5-44a2-9267-69c14554633a req-058e8784-517b-4f20-b5df-f559880b9bf6 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:16.345224 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-850f81fd-9eb5-44a2-9267-69c14554633a req-058e8784-517b-4f20-b5df-f559880b9bf6 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:16.398998 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-850f81fd-9eb5-44a2-9267-69c14554633a req-058e8784-517b-4f20-b5df-f559880b9bf6 service nova] Creating event network-changed:ab6ea765-494d-449a-a112-5e331ebc939d for instance 1bc2c437-e710-4af4-9928-76c48834cfa2 on n-h2-master-1 Aug 07 01:19:16.408569 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-850f81fd-9eb5-44a2-9267-69c14554633a req-058e8784-517b-4f20-b5df-f559880b9bf6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084255 Aug 07 01:19:16.409395 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1104/1976] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:16.421764 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-88f4ac1e-a4a3-4e21-9e7b-e7465a4eabf5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:16.423834 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-88f4ac1e-a4a3-4e21-9e7b-e7465a4eabf5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:16.440842 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-88f4ac1e-a4a3-4e21-9e7b-e7465a4eabf5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:16.442264 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-88f4ac1e-a4a3-4e21-9e7b-e7465a4eabf5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:16.443329 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-88f4ac1e-a4a3-4e21-9e7b-e7465a4eabf5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:16.446843 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-88f4ac1e-a4a3-4e21-9e7b-e7465a4eabf5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:16.448012 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-88f4ac1e-a4a3-4e21-9e7b-e7465a4eabf5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:16.448994 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-88f4ac1e-a4a3-4e21-9e7b-e7465a4eabf5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:16.815257 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-88f4ac1e-a4a3-4e21-9e7b-e7465a4eabf5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:16.825661 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-88f4ac1e-a4a3-4e21-9e7b-e7465a4eabf5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1317 microversion: 2.1 time: 0.414837 Aug 07 01:19:16.826249 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1105/1977] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:16 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1317 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:16.831686 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7f3d0c2d-152e-45c8-a655-ef24bc80d9e3 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:16.832598 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7f3d0c2d-152e-45c8-a655-ef24bc80d9e3 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] [instance: 1bc2c437-e710-4af4-9928-76c48834cfa2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:16.840306 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f3d0c2d-152e-45c8-a655-ef24bc80d9e3 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:16.841005 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f3d0c2d-152e-45c8-a655-ef24bc80d9e3 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:16.841630 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f3d0c2d-152e-45c8-a655-ef24bc80d9e3 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:16.842564 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f3d0c2d-152e-45c8-a655-ef24bc80d9e3 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:16.843451 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f3d0c2d-152e-45c8-a655-ef24bc80d9e3 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:16.844731 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f3d0c2d-152e-45c8-a655-ef24bc80d9e3 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:16.898237 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-706342ae-48f9-4a6b-aa53-7c13fc823141 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:16.912990 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-706342ae-48f9-4a6b-aa53-7c13fc823141 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1475 microversion: 2.1 time: 1.583924 Aug 07 01:19:16.916113 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 873/1978] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:15 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1475 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:16.938378 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-952d77c9-4cd4-4035-85e9-c616efeb18b6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:16.939975 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-952d77c9-4cd4-4035-85e9-c616efeb18b6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 545e5bdb-26c5-4585-90bd-a51dc9e956fe] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:16.947123 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-952d77c9-4cd4-4035-85e9-c616efeb18b6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:16.947614 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-952d77c9-4cd4-4035-85e9-c616efeb18b6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:16.948404 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-952d77c9-4cd4-4035-85e9-c616efeb18b6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:16.949344 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-952d77c9-4cd4-4035-85e9-c616efeb18b6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:16.949810 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-952d77c9-4cd4-4035-85e9-c616efeb18b6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:16.950230 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-952d77c9-4cd4-4035-85e9-c616efeb18b6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:17.315944 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7f3d0c2d-152e-45c8-a655-ef24bc80d9e3 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5080c88d51a8455bba8b70e33cca958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6a995089fa447e8f74df7d111b1c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:17.326027 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7f3d0c2d-152e-45c8-a655-ef24bc80d9e3 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] 10.222.0.39 "GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2" status: 200 len: 1371 microversion: 2.1 time: 0.498049 Aug 07 01:19:17.332465 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1106/1979] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:16 2022] GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2 => generated 1371 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:17.343368 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1f9765a0-d13e-4c05-bb44-75595851cbf8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:17.344310 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1f9765a0-d13e-4c05-bb44-75595851cbf8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:17.354348 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f9765a0-d13e-4c05-bb44-75595851cbf8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:17.356161 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f9765a0-d13e-4c05-bb44-75595851cbf8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:17.356656 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f9765a0-d13e-4c05-bb44-75595851cbf8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:17.358003 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f9765a0-d13e-4c05-bb44-75595851cbf8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:17.358860 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f9765a0-d13e-4c05-bb44-75595851cbf8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:17.359369 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f9765a0-d13e-4c05-bb44-75595851cbf8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:17.375557 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-952d77c9-4cd4-4035-85e9-c616efeb18b6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:17.386664 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-952d77c9-4cd4-4035-85e9-c616efeb18b6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe" status: 200 len: 1321 microversion: 2.1 time: 0.457010 Aug 07 01:19:17.389834 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 874/1980] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:16 2022] GET /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe => generated 1321 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:17.404373 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a132fffd-e8fc-4f69-a934-c48ea1416337 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:17.406743 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a132fffd-e8fc-4f69-a934-c48ea1416337 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] [instance: 9e2ae24f-8349-46d5-b091-876927d02b68] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:17.421364 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a132fffd-e8fc-4f69-a934-c48ea1416337 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:17.428127 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a132fffd-e8fc-4f69-a934-c48ea1416337 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:17.431179 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a132fffd-e8fc-4f69-a934-c48ea1416337 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:17.436804 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a132fffd-e8fc-4f69-a934-c48ea1416337 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:17.440961 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a132fffd-e8fc-4f69-a934-c48ea1416337 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:17.441782 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a132fffd-e8fc-4f69-a934-c48ea1416337 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:17.971423 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a132fffd-e8fc-4f69-a934-c48ea1416337 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '786962988b754fb69bd48070c2992e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614797cd26be4995b087ab864f35d235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:17.993243 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a132fffd-e8fc-4f69-a934-c48ea1416337 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68" status: 200 len: 1471 microversion: 2.1 time: 0.601973 Aug 07 01:19:17.995085 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 875/1981] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:17 2022] GET /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68 => generated 1471 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:18.014946 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c9218dda-848d-47b7-9f26-cfbeb62ae186 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1704414638", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "68fdaf7a-c018-4207-a54c-86715ad58de9"}], "security_groups": [{"name": "tempest-securitygroup--1149155741"}], "key_name": "tempest-keypair-1716860004", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:18.472317 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1f9765a0-d13e-4c05-bb44-75595851cbf8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0327f14a188e45fba98a58e5fd061248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:18.498686 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1f9765a0-d13e-4c05-bb44-75595851cbf8 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0" status: 200 len: 1499 microversion: 2.1 time: 1.156885 Aug 07 01:19:18.505815 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1107/1982] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:17 2022] GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 => generated 1499 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:18.520055 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d355b301-99d9-412c-bd39-597dad85ac4b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:18.521646 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d355b301-99d9-412c-bd39-597dad85ac4b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:18.536429 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d355b301-99d9-412c-bd39-597dad85ac4b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:18.539365 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d355b301-99d9-412c-bd39-597dad85ac4b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:18.540847 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d355b301-99d9-412c-bd39-597dad85ac4b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:18.541889 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d355b301-99d9-412c-bd39-597dad85ac4b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:18.544668 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d355b301-99d9-412c-bd39-597dad85ac4b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:18.545416 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d355b301-99d9-412c-bd39-597dad85ac4b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:18.867841 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-c9218dda-848d-47b7-9f26-cfbeb62ae186 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] validate_networks() for [('68fdaf7a-c018-4207-a54c-86715ad58de9', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:19:18.951868 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d355b301-99d9-412c-bd39-597dad85ac4b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:18.970522 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d355b301-99d9-412c-bd39-597dad85ac4b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1317 microversion: 2.1 time: 0.462779 Aug 07 01:19:18.972383 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1108/1983] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:18 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1317 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:18.992894 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-43b4d2a1-d420-421e-a888-aa7d3e1dfc3c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:18.995505 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-43b4d2a1-d420-421e-a888-aa7d3e1dfc3c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:19.024011 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43b4d2a1-d420-421e-a888-aa7d3e1dfc3c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:19.027590 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43b4d2a1-d420-421e-a888-aa7d3e1dfc3c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:19.030555 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43b4d2a1-d420-421e-a888-aa7d3e1dfc3c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:19.033031 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43b4d2a1-d420-421e-a888-aa7d3e1dfc3c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:19.036388 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43b4d2a1-d420-421e-a888-aa7d3e1dfc3c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:19.037084 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43b4d2a1-d420-421e-a888-aa7d3e1dfc3c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:19.340452 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-43b4d2a1-d420-421e-a888-aa7d3e1dfc3c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:19.352567 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-43b4d2a1-d420-421e-a888-aa7d3e1dfc3c tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1470 microversion: 2.1 time: 0.378690 Aug 07 01:19:19.365924 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1109/1984] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:18 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1470 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:19.384210 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-0bfc552b-e8ce-4ece-a8e6-295a968763cc req-cc9aa664-7912-474b-922e-6181d83ca4bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e2ae24f-8349-46d5-b091-876927d02b68", "name": "network-vif-deleted", "tag": "63f23b72-85ce-4ced-9d43-dd32e2464731"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:19.415070 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0bfc552b-e8ce-4ece-a8e6-295a968763cc req-cc9aa664-7912-474b-922e-6181d83ca4bd service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:19.423752 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0bfc552b-e8ce-4ece-a8e6-295a968763cc req-cc9aa664-7912-474b-922e-6181d83ca4bd service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:19.424846 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0bfc552b-e8ce-4ece-a8e6-295a968763cc req-cc9aa664-7912-474b-922e-6181d83ca4bd service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:19.468057 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-0bfc552b-e8ce-4ece-a8e6-295a968763cc req-cc9aa664-7912-474b-922e-6181d83ca4bd service nova] Creating event network-vif-deleted:63f23b72-85ce-4ced-9d43-dd32e2464731 for instance 9e2ae24f-8349-46d5-b091-876927d02b68 on n-h1-master-1 Aug 07 01:19:19.483736 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-0bfc552b-e8ce-4ece-a8e6-295a968763cc req-cc9aa664-7912-474b-922e-6181d83ca4bd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114948 Aug 07 01:19:19.485998 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1110/1985] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:19.499044 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-541d07f8-4fdf-4f81-8fb8-14363ca53d02 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:19.499762 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-541d07f8-4fdf-4f81-8fb8-14363ca53d02 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] [instance: 1bc2c437-e710-4af4-9928-76c48834cfa2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:19.509571 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-541d07f8-4fdf-4f81-8fb8-14363ca53d02 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:19.510064 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-541d07f8-4fdf-4f81-8fb8-14363ca53d02 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:19.510502 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-541d07f8-4fdf-4f81-8fb8-14363ca53d02 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:19.511221 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-541d07f8-4fdf-4f81-8fb8-14363ca53d02 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:19.511680 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-541d07f8-4fdf-4f81-8fb8-14363ca53d02 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:19.512182 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-541d07f8-4fdf-4f81-8fb8-14363ca53d02 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:19.783169 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-c9218dda-848d-47b7-9f26-cfbeb62ae186 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:19:19.783766 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-c9218dda-848d-47b7-9f26-cfbeb62ae186 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:19:19.784130 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-c9218dda-848d-47b7-9f26-cfbeb62ae186 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:19:19.784553 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-c9218dda-848d-47b7-9f26-cfbeb62ae186 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:19:19.784973 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-c9218dda-848d-47b7-9f26-cfbeb62ae186 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:19:19.817994 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c9218dda-848d-47b7-9f26-cfbeb62ae186 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:19.821037 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c9218dda-848d-47b7-9f26-cfbeb62ae186 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:19.821500 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c9218dda-848d-47b7-9f26-cfbeb62ae186 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:19.821896 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-541d07f8-4fdf-4f81-8fb8-14363ca53d02 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5080c88d51a8455bba8b70e33cca958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6a995089fa447e8f74df7d111b1c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:19.825312 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c9218dda-848d-47b7-9f26-cfbeb62ae186 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:19.825814 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c9218dda-848d-47b7-9f26-cfbeb62ae186 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:19.826264 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c9218dda-848d-47b7-9f26-cfbeb62ae186 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:19.840935 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-541d07f8-4fdf-4f81-8fb8-14363ca53d02 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] 10.222.0.39 "GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2" status: 200 len: 1371 microversion: 2.1 time: 0.351592 Aug 07 01:19:19.842354 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1111/1986] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:19 2022] GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2 => generated 1371 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:19.856250 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-320ffec2-d9d4-4f08-bb55-940f01c021e4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:19.858397 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-320ffec2-d9d4-4f08-bb55-940f01c021e4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 545e5bdb-26c5-4585-90bd-a51dc9e956fe] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:19.882783 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-320ffec2-d9d4-4f08-bb55-940f01c021e4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:19.885450 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-320ffec2-d9d4-4f08-bb55-940f01c021e4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:19.887517 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-320ffec2-d9d4-4f08-bb55-940f01c021e4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:19.890262 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-320ffec2-d9d4-4f08-bb55-940f01c021e4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:19.893017 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-320ffec2-d9d4-4f08-bb55-940f01c021e4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:19.893502 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-320ffec2-d9d4-4f08-bb55-940f01c021e4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:19.916438 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-c9218dda-848d-47b7-9f26-cfbeb62ae186 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Getting quotas for project 1371b7aebfcf4088a02780393de8200f. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:19:19.952805 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-c9218dda-848d-47b7-9f26-cfbeb62ae186 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Getting quotas for user 45ed48709ab84fa4b5b341332a843ad8 and project 1371b7aebfcf4088a02780393de8200f. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:19:19.999064 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c9218dda-848d-47b7-9f26-cfbeb62ae186 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:19:20.002125 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c9218dda-848d-47b7-9f26-cfbeb62ae186 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:19:20.086340 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c9218dda-848d-47b7-9f26-cfbeb62ae186 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 2.089668 Aug 07 01:19:20.089028 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 876/1987] 10.222.0.39 () {62 vars in 1188 bytes} [Sun Aug 7 01:19:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 2093 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 07 01:19:20.094749 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-1457d17b-179d-4aa1-8c6a-5ae4f744bfd7 req-bded3dae-6f1f-4f3a-86e8-8770d68c6317 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed97583d-ce2f-4693-b2fe-aaebcf2dd66d", "tag": "2e08f8ea-bd0a-4227-84c2-18a7b5c5fede"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:20.106911 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-1457d17b-179d-4aa1-8c6a-5ae4f744bfd7 req-bded3dae-6f1f-4f3a-86e8-8770d68c6317 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:20.107711 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-1457d17b-179d-4aa1-8c6a-5ae4f744bfd7 req-bded3dae-6f1f-4f3a-86e8-8770d68c6317 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:20.108350 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-1457d17b-179d-4aa1-8c6a-5ae4f744bfd7 req-bded3dae-6f1f-4f3a-86e8-8770d68c6317 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:20.121545 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-1457d17b-179d-4aa1-8c6a-5ae4f744bfd7 req-bded3dae-6f1f-4f3a-86e8-8770d68c6317 service nova] Creating event network-changed:2e08f8ea-bd0a-4227-84c2-18a7b5c5fede for instance ed97583d-ce2f-4693-b2fe-aaebcf2dd66d on n-h2-master-1 Aug 07 01:19:20.143141 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-1457d17b-179d-4aa1-8c6a-5ae4f744bfd7 req-bded3dae-6f1f-4f3a-86e8-8770d68c6317 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052382 Aug 07 01:19:20.149756 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 877/1988] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:20.155545 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2f7894cc-7c67-4fcf-a33e-bb3bf97c83a4 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:20.156578 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2f7894cc-7c67-4fcf-a33e-bb3bf97c83a4 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] [instance: 9e2ae24f-8349-46d5-b091-876927d02b68] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:20.161598 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-320ffec2-d9d4-4f08-bb55-940f01c021e4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:20.165795 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f7894cc-7c67-4fcf-a33e-bb3bf97c83a4 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:20.166999 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f7894cc-7c67-4fcf-a33e-bb3bf97c83a4 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:20.167777 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f7894cc-7c67-4fcf-a33e-bb3bf97c83a4 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:20.168961 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f7894cc-7c67-4fcf-a33e-bb3bf97c83a4 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:20.169606 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f7894cc-7c67-4fcf-a33e-bb3bf97c83a4 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:20.170212 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f7894cc-7c67-4fcf-a33e-bb3bf97c83a4 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:20.171393 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-320ffec2-d9d4-4f08-bb55-940f01c021e4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe" status: 200 len: 1321 microversion: 2.1 time: 0.326537 Aug 07 01:19:20.186554 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1112/1989] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:19 2022] GET /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe => generated 1321 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:20.239698 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-2f7894cc-7c67-4fcf-a33e-bb3bf97c83a4 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] HTTP exception thrown: Instance 9e2ae24f-8349-46d5-b091-876927d02b68 could not be found. Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2f7894cc-7c67-4fcf-a33e-bb3bf97c83a4 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Request method failure captured: Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68 HTTP/1.1 Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xJn5BFX7NJ8isn8H9O9hfv8TzLfLJDDsp1NJekttJJoU2htDc6dF-OrDNSuJGNpgHeKYd96iidyUQupt4iQyMHuCSELTNB8nQ7ABy9FwxgQCLI79_VW6fmmFTOs1R9cjor1RBSFgW0UZ_yrrtL5ILHoVfNWubxUU_1hiL0--ZP1SuM Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 614797cd26be4995b087ab864f35d235 Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ListImageFiltersTestJSON-1517127125 Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/614797cd26be4995b087ab864f35d235"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_614797cd26be4995b087ab864f35d235", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/614797cd26be4995b087ab864f35d235"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/614797cd26be4995b087ab864f35d235"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ListImageFiltersTestJSON-1517127125 Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 614797cd26be4995b087ab864f35d235 Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1517127125 Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ListImageFiltersTestJSON-1517127125-project Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 786962988b754fb69bd48070c2992e13 Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ListImageFiltersTestJSON-1517127125-project Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 9e2ae24f-8349-46d5-b091-876927d02b68 could not be found. Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '9e2ae24f-8349-46d5-b091-876927d02b68'} Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e2ae24f-8349-46d5-b091-876927d02b68 could not be found. Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e2ae24f-8349-46d5-b091-876927d02b68 could not be found. Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:19:20.243204 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:19:20.249788 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:20.249788 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:19:20.249788 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:19:20.249788 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:19:20.249788 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:19:20.249788 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e2ae24f-8349-46d5-b091-876927d02b68 could not be found. Aug 07 01:19:20.249788 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:19:20.249788 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2f7894cc-7c67-4fcf-a33e-bb3bf97c83a4 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Returning 404 to user: Instance 9e2ae24f-8349-46d5-b091-876927d02b68 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:19:20.253116 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2f7894cc-7c67-4fcf-a33e-bb3bf97c83a4 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68" status: 404 len: 111 microversion: 2.1 time: 0.093945 Aug 07 01:19:20.253596 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 878/1990] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:20 2022] GET /compute/v2.1/servers/9e2ae24f-8349-46d5-b091-876927d02b68 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:19:20.266381 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-72109595-b089-4f99-a5c1-71d9c3a25223 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:20.278257 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-72109595-b089-4f99-a5c1-71d9c3a25223 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:20.313102 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-72109595-b089-4f99-a5c1-71d9c3a25223 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:20.313631 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-72109595-b089-4f99-a5c1-71d9c3a25223 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:20.314081 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-72109595-b089-4f99-a5c1-71d9c3a25223 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:20.314811 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-72109595-b089-4f99-a5c1-71d9c3a25223 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:20.315274 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-72109595-b089-4f99-a5c1-71d9c3a25223 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:20.315709 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-72109595-b089-4f99-a5c1-71d9c3a25223 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:20.497601 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f93b336f-9628-4011-8c7d-4005b6eba32a tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] Action: 'create', calling method: .version_select at 0x7f9e248ff430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-308618575", "description": "tempest-description-348415059"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:20.587123 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-72109595-b089-4f99-a5c1-71d9c3a25223 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "POST /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b/action" status: 202 len: 0 microversion: 2.1 time: 0.331505 Aug 07 01:19:20.592048 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 879/1991] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:19:20 2022] POST /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:19:20.600530 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-00e4619b-87d8-481f-a8d2-ff886a3425f9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:20.601246 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-00e4619b-87d8-481f-a8d2-ff886a3425f9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] [instance: 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:20.620152 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00e4619b-87d8-481f-a8d2-ff886a3425f9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:20.620987 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00e4619b-87d8-481f-a8d2-ff886a3425f9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:20.621633 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00e4619b-87d8-481f-a8d2-ff886a3425f9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:20.622590 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00e4619b-87d8-481f-a8d2-ff886a3425f9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:20.623275 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00e4619b-87d8-481f-a8d2-ff886a3425f9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:20.628141 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00e4619b-87d8-481f-a8d2-ff886a3425f9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:20.633970 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:20.672699 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-00e4619b-87d8-481f-a8d2-ff886a3425f9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] HTTP exception thrown: Instance 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 could not be found. Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-00e4619b-87d8-481f-a8d2-ff886a3425f9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Request method failure captured: Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 HTTP/1.1 Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xD2QrDlzIc_grVn-Bzr-WavOVOy3T9RqJf2eyxWxWwUPZ94QzCFwgeck9D1ChJJ9AB7o3ULcMPaoAAJfzZ17udYuxyOEAMG7oMTmbHKnZZcGvpFG8Yq4IrOXFwzhg6g_J5MwvnuChwQ9ZEP_954XcgYZcH_UrfG9Ko0_RGwm3ZjDhc Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: ba9e7a1c1fe14f47b5a5acf2fe8893b5 Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-LiveMigrationTest-1584424429 Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ba9e7a1c1fe14f47b5a5acf2fe8893b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ba9e7a1c1fe14f47b5a5acf2fe8893b5", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ba9e7a1c1fe14f47b5a5acf2fe8893b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ba9e7a1c1fe14f47b5a5acf2fe8893b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-LiveMigrationTest-1584424429 Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: ba9e7a1c1fe14f47b5a5acf2fe8893b5 Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-LiveMigrationTest-1584424429 Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-LiveMigrationTest-1584424429-project Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 0327f14a188e45fba98a58e5fd061248 Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-LiveMigrationTest-1584424429-project Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 could not be found. Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '2a06b411-f5fe-46fa-9e79-d208fd6dcbf0'} Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 could not be found. Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 could not be found. Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:19:20.680111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:19:20.691473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:20.691473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:19:20.691473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:19:20.691473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:19:20.691473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:19:20.691473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 could not be found. Aug 07 01:19:20.691473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:19:20.691473 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-00e4619b-87d8-481f-a8d2-ff886a3425f9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] Returning 404 to user: Instance 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:19:20.691473 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-00e4619b-87d8-481f-a8d2-ff886a3425f9 tempest-LiveMigrationTest-1584424429 tempest-LiveMigrationTest-1584424429-project] 10.222.0.39 "GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0" status: 404 len: 111 microversion: 2.1 time: 0.092811 Aug 07 01:19:20.694885 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 880/1992] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:20 2022] GET /compute/v2.1/servers/2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:19:20.703597 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-75c2313f-83aa-4fba-a81f-68048d28868a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:20.719024 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-75c2313f-83aa-4fba-a81f-68048d28868a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:20.736980 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75c2313f-83aa-4fba-a81f-68048d28868a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:20.737560 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75c2313f-83aa-4fba-a81f-68048d28868a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:20.738191 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75c2313f-83aa-4fba-a81f-68048d28868a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:20.739049 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75c2313f-83aa-4fba-a81f-68048d28868a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:20.740010 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75c2313f-83aa-4fba-a81f-68048d28868a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:20.740439 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75c2313f-83aa-4fba-a81f-68048d28868a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:20.865288 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f93b336f-9628-4011-8c7d-4005b6eba32a tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.690742 Aug 07 01:19:20.866742 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1113/1993] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Aug 7 01:19:20 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:20.872939 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-729e9330-0898-4116-8ee6-cb61110c6db7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:20.877281 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-729e9330-0898-4116-8ee6-cb61110c6db7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:21.036240 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-729e9330-0898-4116-8ee6-cb61110c6db7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:21.059987 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-729e9330-0898-4116-8ee6-cb61110c6db7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:21.075742 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-729e9330-0898-4116-8ee6-cb61110c6db7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:21.080906 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-729e9330-0898-4116-8ee6-cb61110c6db7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 1286 microversion: 2.25 time: 0.209013 Aug 07 01:19:21.083195 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1114/1994] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:19:20 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 1286 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:19:21.091798 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1a49499e-2e1d-4110-b018-267c299ef155 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:21.093144 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1a49499e-2e1d-4110-b018-267c299ef155 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] [instance: d2dbfd1a-efab-4943-b00a-6cdd1051489c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:21.125591 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1a49499e-2e1d-4110-b018-267c299ef155 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:21.131983 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1a49499e-2e1d-4110-b018-267c299ef155 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:21.134094 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1a49499e-2e1d-4110-b018-267c299ef155 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:21.136811 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1a49499e-2e1d-4110-b018-267c299ef155 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:21.139948 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1a49499e-2e1d-4110-b018-267c299ef155 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:21.142743 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1a49499e-2e1d-4110-b018-267c299ef155 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:21.259390 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1a49499e-2e1d-4110-b018-267c299ef155 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] [instance: d2dbfd1a-efab-4943-b00a-6cdd1051489c] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:19:21.343530 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:21.499804 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1a49499e-2e1d-4110-b018-267c299ef155 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d2dbfd1a-efab-4943-b00a-6cdd1051489c" status: 204 len: 0 microversion: 2.1 time: 0.414271 Aug 07 01:19:21.503754 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1115/1995] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:19:21 2022] DELETE /compute/v2.1/servers/d2dbfd1a-efab-4943-b00a-6cdd1051489c => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:19:21.519651 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-daae99e8-1051-4389-9f3b-46b4e4150197 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:21.521818 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-daae99e8-1051-4389-9f3b-46b4e4150197 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:21.535919 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-daae99e8-1051-4389-9f3b-46b4e4150197 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:21.541875 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-daae99e8-1051-4389-9f3b-46b4e4150197 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:21.542471 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-daae99e8-1051-4389-9f3b-46b4e4150197 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:21.543874 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-daae99e8-1051-4389-9f3b-46b4e4150197 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:21.543874 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-daae99e8-1051-4389-9f3b-46b4e4150197 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:21.545857 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-daae99e8-1051-4389-9f3b-46b4e4150197 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:21.776395 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-75c2313f-83aa-4fba-a81f-68048d28868a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:21.794532 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-75c2313f-83aa-4fba-a81f-68048d28868a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1317 microversion: 2.1 time: 1.094646 Aug 07 01:19:21.798836 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 881/1996] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:20 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1317 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:21.809742 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-64833618-f0b2-4074-b52b-3ecd7064a1eb tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:21.812612 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-64833618-f0b2-4074-b52b-3ecd7064a1eb tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] [instance: 1bc2c437-e710-4af4-9928-76c48834cfa2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:21.832237 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64833618-f0b2-4074-b52b-3ecd7064a1eb tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:21.833742 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64833618-f0b2-4074-b52b-3ecd7064a1eb tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:21.835295 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64833618-f0b2-4074-b52b-3ecd7064a1eb tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:21.836477 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64833618-f0b2-4074-b52b-3ecd7064a1eb tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:21.839604 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64833618-f0b2-4074-b52b-3ecd7064a1eb tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:21.840449 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64833618-f0b2-4074-b52b-3ecd7064a1eb tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:21.994648 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-daae99e8-1051-4389-9f3b-46b4e4150197 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:22.005466 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-daae99e8-1051-4389-9f3b-46b4e4150197 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1469 microversion: 2.1 time: 0.499722 Aug 07 01:19:22.010106 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1116/1997] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:21 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1469 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:22.024958 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-21487a4d-0be8-45ab-b2e6-36c8733fc6f6 tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] Action: 'create', calling method: .version_select at 0x7f9e24966b80>, body: {"security_group_rule": {"parent_group_id": "fb4f728b-7e24-440d-aeb6-9bd18b200249", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:22.394984 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-21487a4d-0be8-45ab-b2e6-36c8733fc6f6 tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.382252 Aug 07 01:19:22.412421 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1117/1998] 10.222.0.39 () {60 vars in 1195 bytes} [Sun Aug 7 01:19:22 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:22.420685 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e92da045-3a5a-4d78-acec-e63d16b05550 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:22.421758 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e92da045-3a5a-4d78-acec-e63d16b05550 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 545e5bdb-26c5-4585-90bd-a51dc9e956fe] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:22.429225 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e92da045-3a5a-4d78-acec-e63d16b05550 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:22.430411 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e92da045-3a5a-4d78-acec-e63d16b05550 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:22.430983 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e92da045-3a5a-4d78-acec-e63d16b05550 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:22.432025 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e92da045-3a5a-4d78-acec-e63d16b05550 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:22.432475 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e92da045-3a5a-4d78-acec-e63d16b05550 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:22.433054 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e92da045-3a5a-4d78-acec-e63d16b05550 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:22.656681 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e92da045-3a5a-4d78-acec-e63d16b05550 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:22.666027 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e92da045-3a5a-4d78-acec-e63d16b05550 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe" status: 200 len: 1502 microversion: 2.1 time: 0.251948 Aug 07 01:19:22.666911 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1118/1999] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:22 2022] GET /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe => generated 1502 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:22.671544 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d0924b61-34b4-4868-b32f-8925d266d558 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:22.672612 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d0924b61-34b4-4868-b32f-8925d266d558 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] [instance: d2dbfd1a-efab-4943-b00a-6cdd1051489c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:22.680528 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0924b61-34b4-4868-b32f-8925d266d558 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:22.681025 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0924b61-34b4-4868-b32f-8925d266d558 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:22.687984 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0924b61-34b4-4868-b32f-8925d266d558 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:22.687984 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0924b61-34b4-4868-b32f-8925d266d558 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:22.687984 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0924b61-34b4-4868-b32f-8925d266d558 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:22.687984 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0924b61-34b4-4868-b32f-8925d266d558 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:22.889291 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d0924b61-34b4-4868-b32f-8925d266d558 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '786962988b754fb69bd48070c2992e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614797cd26be4995b087ab864f35d235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:22.900373 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d0924b61-34b4-4868-b32f-8925d266d558 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/servers/d2dbfd1a-efab-4943-b00a-6cdd1051489c" status: 200 len: 1472 microversion: 2.1 time: 0.232568 Aug 07 01:19:22.907744 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1119/2000] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:22 2022] GET /compute/v2.1/servers/d2dbfd1a-efab-4943-b00a-6cdd1051489c => generated 1472 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:22.907744 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3945df46-05fe-482e-b87f-e7feb3c41621 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:22.907744 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3945df46-05fe-482e-b87f-e7feb3c41621 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:22.914127 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3945df46-05fe-482e-b87f-e7feb3c41621 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:22.914697 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3945df46-05fe-482e-b87f-e7feb3c41621 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:22.915140 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3945df46-05fe-482e-b87f-e7feb3c41621 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:22.916040 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3945df46-05fe-482e-b87f-e7feb3c41621 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:22.916502 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3945df46-05fe-482e-b87f-e7feb3c41621 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:22.916968 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3945df46-05fe-482e-b87f-e7feb3c41621 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:23.018577 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3945df46-05fe-482e-b87f-e7feb3c41621 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:23.029004 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3945df46-05fe-482e-b87f-e7feb3c41621 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:23.030574 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3945df46-05fe-482e-b87f-e7feb3c41621 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:23.031825 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3945df46-05fe-482e-b87f-e7feb3c41621 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 1282 microversion: 2.25 time: 0.129498 Aug 07 01:19:23.043920 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1120/2001] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:19:22 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 1282 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:19:23.043920 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-79027c95-285f-48d8-a337-53d8038cc050 req-b0193f09-0fd3-4750-ae11-6e09246064c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a06b411-f5fe-46fa-9e79-d208fd6dcbf0", "name": "network-vif-deleted", "tag": "d903aed3-3bb4-4c2d-bd4a-d9b615524a34"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:23.049589 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-79027c95-285f-48d8-a337-53d8038cc050 req-b0193f09-0fd3-4750-ae11-6e09246064c8 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:23.060747 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-79027c95-285f-48d8-a337-53d8038cc050 req-b0193f09-0fd3-4750-ae11-6e09246064c8 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:23.061500 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-79027c95-285f-48d8-a337-53d8038cc050 req-b0193f09-0fd3-4750-ae11-6e09246064c8 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:23.079060 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-79027c95-285f-48d8-a337-53d8038cc050 req-b0193f09-0fd3-4750-ae11-6e09246064c8 service nova] Creating event network-vif-deleted:d903aed3-3bb4-4c2d-bd4a-d9b615524a34 for instance 2a06b411-f5fe-46fa-9e79-d208fd6dcbf0 on n-h1-master-1 Aug 07 01:19:23.090909 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-79027c95-285f-48d8-a337-53d8038cc050 req-b0193f09-0fd3-4750-ae11-6e09246064c8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056496 Aug 07 01:19:23.092031 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1121/2002] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:23.098320 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3b3b7b79-90ef-4b4a-b93d-f00fe6c92deb tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] Action: 'create', calling method: .version_select at 0x7f9e248ff9d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1077479996", "description": "tempest-description-598315589"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:23.275475 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-64833618-f0b2-4074-b52b-3ecd7064a1eb tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5080c88d51a8455bba8b70e33cca958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6a995089fa447e8f74df7d111b1c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:23.284262 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-64833618-f0b2-4074-b52b-3ecd7064a1eb tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] 10.222.0.39 "GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2" status: 200 len: 1371 microversion: 2.1 time: 1.483951 Aug 07 01:19:23.298947 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 882/2003] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:21 2022] GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2 => generated 1371 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:23.308809 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-194f7afe-6cf6-4096-bef4-aa099623d914 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:23.313356 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-194f7afe-6cf6-4096-bef4-aa099623d914 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 545e5bdb-26c5-4585-90bd-a51dc9e956fe] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:23.339492 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-194f7afe-6cf6-4096-bef4-aa099623d914 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:23.340038 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-194f7afe-6cf6-4096-bef4-aa099623d914 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:23.340332 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-194f7afe-6cf6-4096-bef4-aa099623d914 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:23.341043 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-194f7afe-6cf6-4096-bef4-aa099623d914 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:23.341523 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-194f7afe-6cf6-4096-bef4-aa099623d914 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:23.342031 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-194f7afe-6cf6-4096-bef4-aa099623d914 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:23.402589 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3b3b7b79-90ef-4b4a-b93d-f00fe6c92deb tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.308533 Aug 07 01:19:23.412836 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1122/2004] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Aug 7 01:19:23 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:23.418788 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e9f1b21a-420c-43bc-b219-9a77dc80162f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:23.420038 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e9f1b21a-420c-43bc-b219-9a77dc80162f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:23.427705 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9f1b21a-420c-43bc-b219-9a77dc80162f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:23.428708 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9f1b21a-420c-43bc-b219-9a77dc80162f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:23.429406 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9f1b21a-420c-43bc-b219-9a77dc80162f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:23.430399 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9f1b21a-420c-43bc-b219-9a77dc80162f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:23.431178 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9f1b21a-420c-43bc-b219-9a77dc80162f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:23.432494 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9f1b21a-420c-43bc-b219-9a77dc80162f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:23.628662 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e9f1b21a-420c-43bc-b219-9a77dc80162f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:23.648295 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e9f1b21a-420c-43bc-b219-9a77dc80162f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1317 microversion: 2.1 time: 0.224655 Aug 07 01:19:23.654917 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1123/2005] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:23 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:23.662166 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c16919ad-5c4a-4c1d-ad5e-5b88a26c0643 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:23.663914 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c16919ad-5c4a-4c1d-ad5e-5b88a26c0643 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:23.673503 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c16919ad-5c4a-4c1d-ad5e-5b88a26c0643 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:23.674969 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c16919ad-5c4a-4c1d-ad5e-5b88a26c0643 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:23.675871 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c16919ad-5c4a-4c1d-ad5e-5b88a26c0643 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:23.679113 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c16919ad-5c4a-4c1d-ad5e-5b88a26c0643 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:23.679113 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c16919ad-5c4a-4c1d-ad5e-5b88a26c0643 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:23.679113 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c16919ad-5c4a-4c1d-ad5e-5b88a26c0643 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:24.100651 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c16919ad-5c4a-4c1d-ad5e-5b88a26c0643 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:24.112100 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c16919ad-5c4a-4c1d-ad5e-5b88a26c0643 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1469 microversion: 2.1 time: 0.455287 Aug 07 01:19:24.113711 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1124/2006] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:23 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1469 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:24.120382 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-286a3832-747e-4029-80a4-5cc4811342ea tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] Action: 'create', calling method: .version_select at 0x7f9e240bc550>, body: {"security_group_rule": {"parent_group_id": "86233b92-0745-42d2-8d1b-791ded25453d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:24.199179 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-194f7afe-6cf6-4096-bef4-aa099623d914 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:24.207736 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-194f7afe-6cf6-4096-bef4-aa099623d914 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe" status: 200 len: 1502 microversion: 2.1 time: 0.907379 Aug 07 01:19:24.208888 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 883/2007] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:23 2022] GET /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe => generated 1502 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:24.225243 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8495b2cf-b9e2-4051-b829-458684aae0fc tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:24.226262 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8495b2cf-b9e2-4051-b829-458684aae0fc tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] [instance: d2dbfd1a-efab-4943-b00a-6cdd1051489c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:24.248681 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8495b2cf-b9e2-4051-b829-458684aae0fc tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:24.249262 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8495b2cf-b9e2-4051-b829-458684aae0fc tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:24.249751 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8495b2cf-b9e2-4051-b829-458684aae0fc tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:24.250863 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8495b2cf-b9e2-4051-b829-458684aae0fc tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:24.251445 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8495b2cf-b9e2-4051-b829-458684aae0fc tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:24.252020 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8495b2cf-b9e2-4051-b829-458684aae0fc tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:24.567716 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-286a3832-747e-4029-80a4-5cc4811342ea tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.452217 Aug 07 01:19:24.568529 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1125/2008] 10.222.0.39 () {60 vars in 1195 bytes} [Sun Aug 7 01:19:24 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:24.574793 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6648d988-e413-4b7d-a409-b63534b79ded tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:24.575971 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6648d988-e413-4b7d-a409-b63534b79ded tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:24.603590 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6648d988-e413-4b7d-a409-b63534b79ded tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:24.604281 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6648d988-e413-4b7d-a409-b63534b79ded tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:24.604835 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6648d988-e413-4b7d-a409-b63534b79ded tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:24.605674 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6648d988-e413-4b7d-a409-b63534b79ded tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:24.606674 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6648d988-e413-4b7d-a409-b63534b79ded tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:24.607355 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6648d988-e413-4b7d-a409-b63534b79ded tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:24.771299 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6648d988-e413-4b7d-a409-b63534b79ded tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:24.784938 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6648d988-e413-4b7d-a409-b63534b79ded tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:24.787009 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6648d988-e413-4b7d-a409-b63534b79ded tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:24.788234 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6648d988-e413-4b7d-a409-b63534b79ded tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 1344 microversion: 2.25 time: 0.218334 Aug 07 01:19:24.795139 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1126/2009] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:19:24 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 1344 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:19:24.795139 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-9165b551-bad9-4091-b1b9-eaabbf4f2a7e req-b94401d7-3f40-411c-9461-9a48df2582d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a4508ef-5167-4c2c-8bba-4a47c875263b", "name": "network-vif-plugged", "status": "completed", "tag": "2ce99914-7226-47ae-b72b-c5f4c2bc3fac"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:24.805830 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-9165b551-bad9-4091-b1b9-eaabbf4f2a7e req-b94401d7-3f40-411c-9461-9a48df2582d8 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:24.806419 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-9165b551-bad9-4091-b1b9-eaabbf4f2a7e req-b94401d7-3f40-411c-9461-9a48df2582d8 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:24.806874 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-9165b551-bad9-4091-b1b9-eaabbf4f2a7e req-b94401d7-3f40-411c-9461-9a48df2582d8 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:24.822111 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-9165b551-bad9-4091-b1b9-eaabbf4f2a7e req-b94401d7-3f40-411c-9461-9a48df2582d8 service nova] Creating event network-vif-plugged:2ce99914-7226-47ae-b72b-c5f4c2bc3fac for instance 7a4508ef-5167-4c2c-8bba-4a47c875263b on n-h2-master-1 Aug 07 01:19:24.830568 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [req-9165b551-bad9-4091-b1b9-eaabbf4f2a7e req-b94401d7-3f40-411c-9461-9a48df2582d8 service nova] Instance 7a4508ef-5167-4c2c-8bba-4a47c875263b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 01:19:24.844444 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-9165b551-bad9-4091-b1b9-eaabbf4f2a7e req-b94401d7-3f40-411c-9461-9a48df2582d8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053581 Aug 07 01:19:24.845614 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1127/2010] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:24.853371 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-707ebc59-f1a6-4d2d-9371-6121adb3cb27 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:24.854682 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-707ebc59-f1a6-4d2d-9371-6121adb3cb27 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 545e5bdb-26c5-4585-90bd-a51dc9e956fe] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:24.858127 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8495b2cf-b9e2-4051-b829-458684aae0fc tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '786962988b754fb69bd48070c2992e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614797cd26be4995b087ab864f35d235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:24.865571 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-707ebc59-f1a6-4d2d-9371-6121adb3cb27 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:24.868054 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-707ebc59-f1a6-4d2d-9371-6121adb3cb27 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:24.868603 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8495b2cf-b9e2-4051-b829-458684aae0fc tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/servers/d2dbfd1a-efab-4943-b00a-6cdd1051489c" status: 200 len: 1472 microversion: 2.1 time: 0.659132 Aug 07 01:19:24.869141 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-707ebc59-f1a6-4d2d-9371-6121adb3cb27 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:24.872458 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-707ebc59-f1a6-4d2d-9371-6121adb3cb27 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:24.873243 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-707ebc59-f1a6-4d2d-9371-6121adb3cb27 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:24.874525 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-707ebc59-f1a6-4d2d-9371-6121adb3cb27 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:24.885048 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 884/2011] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:24 2022] GET /compute/v2.1/servers/d2dbfd1a-efab-4943-b00a-6cdd1051489c => generated 1472 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:24.890866 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9ff403e1-e62c-44da-816a-c2fac7b1b5ba tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:24.895619 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9ff403e1-e62c-44da-816a-c2fac7b1b5ba tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] [instance: 1bc2c437-e710-4af4-9928-76c48834cfa2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:24.903246 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ff403e1-e62c-44da-816a-c2fac7b1b5ba tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:24.903941 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ff403e1-e62c-44da-816a-c2fac7b1b5ba tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:24.904776 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ff403e1-e62c-44da-816a-c2fac7b1b5ba tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:24.905490 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ff403e1-e62c-44da-816a-c2fac7b1b5ba tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:24.906246 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ff403e1-e62c-44da-816a-c2fac7b1b5ba tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:24.906897 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ff403e1-e62c-44da-816a-c2fac7b1b5ba tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:24.926505 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-707ebc59-f1a6-4d2d-9371-6121adb3cb27 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 545e5bdb-26c5-4585-90bd-a51dc9e956fe] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:19:25.045285 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-707ebc59-f1a6-4d2d-9371-6121adb3cb27 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "DELETE /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe" status: 204 len: 0 microversion: 2.1 time: 0.197554 Aug 07 01:19:25.046124 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1128/2012] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:19:24 2022] DELETE /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:19:25.058056 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-23e25748-917c-47dd-ac63-e12b33022f10 tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] Action: 'create', calling method: .version_select at 0x7f9e24bd2c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-853820293", "description": "tempest-description-1613037762"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:25.352683 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9ff403e1-e62c-44da-816a-c2fac7b1b5ba tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5080c88d51a8455bba8b70e33cca958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6a995089fa447e8f74df7d111b1c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:25.362252 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9ff403e1-e62c-44da-816a-c2fac7b1b5ba tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] 10.222.0.39 "GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2" status: 200 len: 1371 microversion: 2.1 time: 0.476223 Aug 07 01:19:25.372737 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 885/2013] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:24 2022] GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2 => generated 1371 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:25.379143 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8a312786-e404-402c-bba5-9adda5d8df13 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:25.380030 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8a312786-e404-402c-bba5-9adda5d8df13 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:25.402033 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a312786-e404-402c-bba5-9adda5d8df13 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:25.404518 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a312786-e404-402c-bba5-9adda5d8df13 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:25.405227 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a312786-e404-402c-bba5-9adda5d8df13 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:25.405986 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a312786-e404-402c-bba5-9adda5d8df13 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:25.411000 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a312786-e404-402c-bba5-9adda5d8df13 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:25.411550 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a312786-e404-402c-bba5-9adda5d8df13 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:25.545378 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-23e25748-917c-47dd-ac63-e12b33022f10 tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.493518 Aug 07 01:19:25.548907 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1129/2014] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Aug 7 01:19:25 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:25.556829 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-52ce3833-7093-4813-829c-35be4f7a4f20 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:25.560818 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-52ce3833-7093-4813-829c-35be4f7a4f20 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 545e5bdb-26c5-4585-90bd-a51dc9e956fe] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:25.598568 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52ce3833-7093-4813-829c-35be4f7a4f20 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:25.599344 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52ce3833-7093-4813-829c-35be4f7a4f20 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:25.600166 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52ce3833-7093-4813-829c-35be4f7a4f20 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:25.605734 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52ce3833-7093-4813-829c-35be4f7a4f20 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:25.607314 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52ce3833-7093-4813-829c-35be4f7a4f20 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:25.625197 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52ce3833-7093-4813-829c-35be4f7a4f20 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:25.788956 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8a312786-e404-402c-bba5-9adda5d8df13 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:25.801901 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8a312786-e404-402c-bba5-9adda5d8df13 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1317 microversion: 2.1 time: 0.427406 Aug 07 01:19:25.803165 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 886/2015] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:25 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1317 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:25.812926 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d9fd0012-8124-40e0-89f2-8b59feab01cd tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:25.814569 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d9fd0012-8124-40e0-89f2-8b59feab01cd tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:25.822737 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9fd0012-8124-40e0-89f2-8b59feab01cd tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:25.823628 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9fd0012-8124-40e0-89f2-8b59feab01cd tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:25.824450 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9fd0012-8124-40e0-89f2-8b59feab01cd tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:25.825568 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9fd0012-8124-40e0-89f2-8b59feab01cd tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:25.826239 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9fd0012-8124-40e0-89f2-8b59feab01cd tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:25.826890 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9fd0012-8124-40e0-89f2-8b59feab01cd tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:26.331273 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-52ce3833-7093-4813-829c-35be4f7a4f20 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:26.343497 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-52ce3833-7093-4813-829c-35be4f7a4f20 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe" status: 200 len: 1508 microversion: 2.1 time: 0.792241 Aug 07 01:19:26.346108 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1130/2016] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:25 2022] GET /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe => generated 1508 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:26.353849 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-46bd91df-3ba9-4754-8831-df82fdcd02bd tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] Action: 'create', calling method: .version_select at 0x7f9e240bc550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1290792069", "description": "tempest-description-628104676"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:26.387673 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d9fd0012-8124-40e0-89f2-8b59feab01cd tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:26.398197 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d9fd0012-8124-40e0-89f2-8b59feab01cd tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1469 microversion: 2.1 time: 0.591805 Aug 07 01:19:26.405190 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 887/2017] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:25 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1469 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:26.417675 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-8578f063-92ba-46ab-8f7a-3072f92c28f2 req-b0ea63f6-ec55-42ec-9046-c9d5da2f4ebc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2dbfd1a-efab-4943-b00a-6cdd1051489c", "name": "network-vif-deleted", "tag": "05c06eb8-fc76-4d4a-bf23-b4a1dd7229f7"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:26.432985 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-8578f063-92ba-46ab-8f7a-3072f92c28f2 req-b0ea63f6-ec55-42ec-9046-c9d5da2f4ebc service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:26.433470 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-8578f063-92ba-46ab-8f7a-3072f92c28f2 req-b0ea63f6-ec55-42ec-9046-c9d5da2f4ebc service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:26.433906 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-8578f063-92ba-46ab-8f7a-3072f92c28f2 req-b0ea63f6-ec55-42ec-9046-c9d5da2f4ebc service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:26.487724 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-8578f063-92ba-46ab-8f7a-3072f92c28f2 req-b0ea63f6-ec55-42ec-9046-c9d5da2f4ebc service nova] Creating event network-vif-deleted:05c06eb8-fc76-4d4a-bf23-b4a1dd7229f7 for instance d2dbfd1a-efab-4943-b00a-6cdd1051489c on n-h1-master-1 Aug 07 01:19:26.508919 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-8578f063-92ba-46ab-8f7a-3072f92c28f2 req-b0ea63f6-ec55-42ec-9046-c9d5da2f4ebc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101819 Aug 07 01:19:26.510235 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 888/2018] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:26.520382 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3afd64f5-4616-465e-aefc-a49dcc2a2818 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:26.521349 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3afd64f5-4616-465e-aefc-a49dcc2a2818 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:26.533981 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3afd64f5-4616-465e-aefc-a49dcc2a2818 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:26.535453 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3afd64f5-4616-465e-aefc-a49dcc2a2818 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:26.536524 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3afd64f5-4616-465e-aefc-a49dcc2a2818 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:26.538121 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3afd64f5-4616-465e-aefc-a49dcc2a2818 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:26.539213 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3afd64f5-4616-465e-aefc-a49dcc2a2818 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:26.540564 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3afd64f5-4616-465e-aefc-a49dcc2a2818 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:26.750226 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-46bd91df-3ba9-4754-8831-df82fdcd02bd tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.401249 Aug 07 01:19:26.752869 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1131/2019] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Aug 7 01:19:26 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:26.763525 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5abfbde1-9898-421a-bb9e-0d2483a2d05a tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:26.764622 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5abfbde1-9898-421a-bb9e-0d2483a2d05a tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] [instance: d2dbfd1a-efab-4943-b00a-6cdd1051489c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:26.771869 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:26.780964 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5abfbde1-9898-421a-bb9e-0d2483a2d05a tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:26.783559 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5abfbde1-9898-421a-bb9e-0d2483a2d05a tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:26.784475 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5abfbde1-9898-421a-bb9e-0d2483a2d05a tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:26.785581 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5abfbde1-9898-421a-bb9e-0d2483a2d05a tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:26.786929 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5abfbde1-9898-421a-bb9e-0d2483a2d05a tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:26.788822 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5abfbde1-9898-421a-bb9e-0d2483a2d05a tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:26.807241 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-5abfbde1-9898-421a-bb9e-0d2483a2d05a tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] HTTP exception thrown: Instance d2dbfd1a-efab-4943-b00a-6cdd1051489c could not be found. Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5abfbde1-9898-421a-bb9e-0d2483a2d05a tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Request method failure captured: Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/d2dbfd1a-efab-4943-b00a-6cdd1051489c HTTP/1.1 Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xJn5BFX7NJ8isn8H9O9hfv8TzLfLJDDsp1NJekttJJoU2htDc6dF-OrDNSuJGNpgHeKYd96iidyUQupt4iQyMHuCSELTNB8nQ7ABy9FwxgQCLI79_VW6fmmFTOs1R9cjor1RBSFgW0UZ_yrrtL5ILHoVfNWubxUU_1hiL0--ZP1SuM Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 614797cd26be4995b087ab864f35d235 Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ListImageFiltersTestJSON-1517127125 Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/614797cd26be4995b087ab864f35d235"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_614797cd26be4995b087ab864f35d235", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/614797cd26be4995b087ab864f35d235"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/614797cd26be4995b087ab864f35d235"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ListImageFiltersTestJSON-1517127125 Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 614797cd26be4995b087ab864f35d235 Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1517127125 Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ListImageFiltersTestJSON-1517127125-project Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 786962988b754fb69bd48070c2992e13 Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ListImageFiltersTestJSON-1517127125-project Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: exception: Instance d2dbfd1a-efab-4943-b00a-6cdd1051489c could not be found. Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'd2dbfd1a-efab-4943-b00a-6cdd1051489c'} Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2dbfd1a-efab-4943-b00a-6cdd1051489c could not be found. Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2dbfd1a-efab-4943-b00a-6cdd1051489c could not be found. Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:19:26.810047 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:19:26.823521 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:26.823521 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:19:26.823521 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:19:26.823521 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:19:26.823521 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:19:26.823521 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2dbfd1a-efab-4943-b00a-6cdd1051489c could not be found. Aug 07 01:19:26.823521 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:19:26.823521 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5abfbde1-9898-421a-bb9e-0d2483a2d05a tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Returning 404 to user: Instance d2dbfd1a-efab-4943-b00a-6cdd1051489c could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:19:26.823521 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5abfbde1-9898-421a-bb9e-0d2483a2d05a tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "GET /compute/v2.1/servers/d2dbfd1a-efab-4943-b00a-6cdd1051489c" status: 404 len: 111 microversion: 2.1 time: 0.057631 Aug 07 01:19:26.823521 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1132/2020] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:26 2022] GET /compute/v2.1/servers/d2dbfd1a-efab-4943-b00a-6cdd1051489c => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:19:26.823521 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b2e2b050-407e-4295-b650-8d65a035bd79 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:26.825500 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b2e2b050-407e-4295-b650-8d65a035bd79 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] [instance: 1bc2c437-e710-4af4-9928-76c48834cfa2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:26.832502 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b2e2b050-407e-4295-b650-8d65a035bd79 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:26.833122 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b2e2b050-407e-4295-b650-8d65a035bd79 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:26.833644 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b2e2b050-407e-4295-b650-8d65a035bd79 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:26.834442 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b2e2b050-407e-4295-b650-8d65a035bd79 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:26.835137 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b2e2b050-407e-4295-b650-8d65a035bd79 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:26.836856 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b2e2b050-407e-4295-b650-8d65a035bd79 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:27.096543 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b2e2b050-407e-4295-b650-8d65a035bd79 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5080c88d51a8455bba8b70e33cca958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6a995089fa447e8f74df7d111b1c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:27.105714 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b2e2b050-407e-4295-b650-8d65a035bd79 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] 10.222.0.39 "GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2" status: 200 len: 1371 microversion: 2.1 time: 0.289090 Aug 07 01:19:27.106499 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1133/2021] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:26 2022] GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2 => generated 1371 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:27.112711 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-78211bc8-49c9-4968-ad6d-c6216a841404 tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] Action: 'create', calling method: .version_select at 0x7f9e26f93670>, body: {"security_group_rule": {"parent_group_id": "9fbfaa90-3296-42c2-961f-d1ef85c62462", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "a550c2cc-c9b2-4022-8409-a54ffbc22fa2"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:27.231436 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3afd64f5-4616-465e-aefc-a49dcc2a2818 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:27.243661 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3afd64f5-4616-465e-aefc-a49dcc2a2818 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:27.248651 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3afd64f5-4616-465e-aefc-a49dcc2a2818 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:27.248651 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3afd64f5-4616-465e-aefc-a49dcc2a2818 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 1412 microversion: 2.25 time: 0.735162 Aug 07 01:19:27.260545 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 889/2022] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:19:26 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 1412 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:19:27.267561 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-dfbf7a71-1c6c-42ff-a023-9ed9b504e2c6 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e17f4f820>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:27.565050 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-dfbf7a71-1c6c-42ff-a023-9ed9b504e2c6 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "DELETE /compute/v2.1/images/fb61e884-43f2-401a-a642-2bb83f6bbd9b" status: 204 len: 0 microversion: 2.1 time: 0.303455 Aug 07 01:19:27.566426 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 890/2023] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:27 2022] DELETE /compute/v2.1/images/fb61e884-43f2-401a-a642-2bb83f6bbd9b => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:19:27.571430 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9e9d3137-f5a9-41d6-bf40-23e2c3521d93 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:27.572187 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9e9d3137-f5a9-41d6-bf40-23e2c3521d93 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:27.578287 n-d-master-1 devstack@n-api.service[119516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 01:19:27.578870 n-d-master-1 devstack@n-api.service[119516]: Sun Aug 7 01:19:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-security-group-rules (ip 10.222.0.39) !!! Aug 07 01:19:27.585598 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9e9d3137-f5a9-41d6-bf40-23e2c3521d93 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:27.586570 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9e9d3137-f5a9-41d6-bf40-23e2c3521d93 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:27.587302 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9e9d3137-f5a9-41d6-bf40-23e2c3521d93 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:27.588214 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9e9d3137-f5a9-41d6-bf40-23e2c3521d93 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:27.589127 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9e9d3137-f5a9-41d6-bf40-23e2c3521d93 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:27.589943 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9e9d3137-f5a9-41d6-bf40-23e2c3521d93 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:27.707604 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-78211bc8-49c9-4968-ad6d-c6216a841404 tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.599546 Aug 07 01:19:27.708257 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1134/2024] 10.222.0.39 () {60 vars in 1195 bytes} [Sun Aug 7 01:19:27 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:27.719354 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-5a974c1d-52f5-47a6-8b00-014400461993 req-4dc28b9e-8044-4452-b8db-a3d6821ed050 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acc886e0-c989-4105-8375-0c42d4e96404", "tag": "1758f50b-5f5d-4ffb-9893-9d21dc63f5bd"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:27.736978 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-5a974c1d-52f5-47a6-8b00-014400461993 req-4dc28b9e-8044-4452-b8db-a3d6821ed050 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:27.737502 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-5a974c1d-52f5-47a6-8b00-014400461993 req-4dc28b9e-8044-4452-b8db-a3d6821ed050 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:27.737945 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-5a974c1d-52f5-47a6-8b00-014400461993 req-4dc28b9e-8044-4452-b8db-a3d6821ed050 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:27.749070 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-5a974c1d-52f5-47a6-8b00-014400461993 req-4dc28b9e-8044-4452-b8db-a3d6821ed050 service nova] Creating event network-changed:1758f50b-5f5d-4ffb-9893-9d21dc63f5bd for instance acc886e0-c989-4105-8375-0c42d4e96404 on n-h1-master-1 Aug 07 01:19:27.755135 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-5a974c1d-52f5-47a6-8b00-014400461993 req-4dc28b9e-8044-4452-b8db-a3d6821ed050 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045350 Aug 07 01:19:27.756089 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1135/2025] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:27.762281 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8d33d41a-6762-42e3-816a-ed1ad5a70bc8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:27.766030 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8d33d41a-6762-42e3-816a-ed1ad5a70bc8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 545e5bdb-26c5-4585-90bd-a51dc9e956fe] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:27.775363 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d33d41a-6762-42e3-816a-ed1ad5a70bc8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:27.776292 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d33d41a-6762-42e3-816a-ed1ad5a70bc8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:27.776923 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d33d41a-6762-42e3-816a-ed1ad5a70bc8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:27.778276 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d33d41a-6762-42e3-816a-ed1ad5a70bc8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:27.778921 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d33d41a-6762-42e3-816a-ed1ad5a70bc8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:27.779543 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d33d41a-6762-42e3-816a-ed1ad5a70bc8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:28.040938 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8d33d41a-6762-42e3-816a-ed1ad5a70bc8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:28.049769 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8d33d41a-6762-42e3-816a-ed1ad5a70bc8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe" status: 200 len: 1508 microversion: 2.1 time: 0.292258 Aug 07 01:19:28.050790 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1136/2026] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:27 2022] GET /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe => generated 1508 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:28.057510 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1808b3f6-aa52-437b-ab55-8dcb86c4ad7e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:28.058540 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1808b3f6-aa52-437b-ab55-8dcb86c4ad7e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:28.066154 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1808b3f6-aa52-437b-ab55-8dcb86c4ad7e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:28.066807 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1808b3f6-aa52-437b-ab55-8dcb86c4ad7e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:28.067365 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1808b3f6-aa52-437b-ab55-8dcb86c4ad7e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:28.068241 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1808b3f6-aa52-437b-ab55-8dcb86c4ad7e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:28.069207 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1808b3f6-aa52-437b-ab55-8dcb86c4ad7e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:28.069780 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1808b3f6-aa52-437b-ab55-8dcb86c4ad7e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:28.302422 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1808b3f6-aa52-437b-ab55-8dcb86c4ad7e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:28.302580 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9e9d3137-f5a9-41d6-bf40-23e2c3521d93 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:28.311662 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9e9d3137-f5a9-41d6-bf40-23e2c3521d93 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1317 microversion: 2.1 time: 0.743898 Aug 07 01:19:28.311913 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1808b3f6-aa52-437b-ab55-8dcb86c4ad7e tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1469 microversion: 2.1 time: 0.259513 Aug 07 01:19:28.312612 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 891/2027] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:27 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1317 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:28.313317 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1137/2028] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:28 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1469 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:28.328945 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-75f6f292-d75e-4b39-b9fd-e4c3fa0e0254 tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] Action: 'create', calling method: .version_select at 0x7f9e240d4670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-296059299", "description": "tempest-description-1226050920"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:28.331159 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-15aeee4d-b870-4962-99cc-ca9c05ba3cb1 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e2408d160>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:28.728065 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-75f6f292-d75e-4b39-b9fd-e4c3fa0e0254 tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.413169 Aug 07 01:19:28.729600 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1138/2029] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Aug 7 01:19:28 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:28.736538 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-7fc83df5-6210-406e-99cb-29b4918bac41 req-cddea231-4887-4b3f-ba8f-51acb4a859a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bc2c437-e710-4af4-9928-76c48834cfa2", "name": "network-vif-plugged", "status": "completed", "tag": "ab6ea765-494d-449a-a112-5e331ebc939d"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:28.760470 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-7fc83df5-6210-406e-99cb-29b4918bac41 req-cddea231-4887-4b3f-ba8f-51acb4a859a3 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:28.761279 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-15aeee4d-b870-4962-99cc-ca9c05ba3cb1 tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "DELETE /compute/v2.1/images/14dcfc2b-064a-40e6-b55e-ad5252a4559d" status: 204 len: 0 microversion: 2.1 time: 0.435624 Aug 07 01:19:28.763169 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-7fc83df5-6210-406e-99cb-29b4918bac41 req-cddea231-4887-4b3f-ba8f-51acb4a859a3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:28.764654 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-7fc83df5-6210-406e-99cb-29b4918bac41 req-cddea231-4887-4b3f-ba8f-51acb4a859a3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:28.766188 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 892/2030] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:28 2022] DELETE /compute/v2.1/images/14dcfc2b-064a-40e6-b55e-ad5252a4559d => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:19:28.770768 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:28.773939 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f47adc48-8527-42e9-ab5e-7a49e2e2fafa tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:28.775210 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f47adc48-8527-42e9-ab5e-7a49e2e2fafa tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] [instance: 1bc2c437-e710-4af4-9928-76c48834cfa2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:28.801174 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-7fc83df5-6210-406e-99cb-29b4918bac41 req-cddea231-4887-4b3f-ba8f-51acb4a859a3 service nova] Creating event network-vif-plugged:ab6ea765-494d-449a-a112-5e331ebc939d for instance 1bc2c437-e710-4af4-9928-76c48834cfa2 on n-h2-master-1 Aug 07 01:19:28.818165 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-7fc83df5-6210-406e-99cb-29b4918bac41 req-cddea231-4887-4b3f-ba8f-51acb4a859a3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085196 Aug 07 01:19:28.820531 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1139/2031] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:28.823727 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f47adc48-8527-42e9-ab5e-7a49e2e2fafa tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:28.826911 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f47adc48-8527-42e9-ab5e-7a49e2e2fafa tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:28.828249 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f47adc48-8527-42e9-ab5e-7a49e2e2fafa tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:28.830317 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f47adc48-8527-42e9-ab5e-7a49e2e2fafa tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:28.831691 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f47adc48-8527-42e9-ab5e-7a49e2e2fafa tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:28.833376 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f47adc48-8527-42e9-ab5e-7a49e2e2fafa tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:28.835778 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-46bc3aae-03b6-42e4-a1b2-65a5dbda9420 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:28.836546 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-46bc3aae-03b6-42e4-a1b2-65a5dbda9420 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:28.857925 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-46bc3aae-03b6-42e4-a1b2-65a5dbda9420 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:28.858435 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-46bc3aae-03b6-42e4-a1b2-65a5dbda9420 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:28.860118 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-46bc3aae-03b6-42e4-a1b2-65a5dbda9420 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:28.863347 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-46bc3aae-03b6-42e4-a1b2-65a5dbda9420 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:28.865482 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-46bc3aae-03b6-42e4-a1b2-65a5dbda9420 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:28.866171 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-46bc3aae-03b6-42e4-a1b2-65a5dbda9420 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:29.259093 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-46bc3aae-03b6-42e4-a1b2-65a5dbda9420 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:29.268752 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-46bc3aae-03b6-42e4-a1b2-65a5dbda9420 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:29.281650 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-46bc3aae-03b6-42e4-a1b2-65a5dbda9420 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:29.288428 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-46bc3aae-03b6-42e4-a1b2-65a5dbda9420 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 1412 microversion: 2.25 time: 0.465241 Aug 07 01:19:29.291977 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1140/2032] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:19:28 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 1412 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:19:29.297565 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-269d1faa-4b5e-4316-b1c6-c793e13c0e8d tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] Action: 'create', calling method: .version_select at 0x7f9e248ffe50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2003575093", "description": "tempest-description-380234569"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:29.842242 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-269d1faa-4b5e-4316-b1c6-c793e13c0e8d tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.548856 Aug 07 01:19:29.850465 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1141/2033] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Aug 7 01:19:29 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:29.859979 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:29.883597 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-522d1258-a749-4333-949f-55680c283e0a tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] Calling method '.version_select at 0x7f9e2443c670>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:29.971015 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f47adc48-8527-42e9-ab5e-7a49e2e2fafa tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5080c88d51a8455bba8b70e33cca958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6a995089fa447e8f74df7d111b1c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:29.979140 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f47adc48-8527-42e9-ab5e-7a49e2e2fafa tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] 10.222.0.39 "GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2" status: 200 len: 1371 microversion: 2.1 time: 1.210815 Aug 07 01:19:29.979726 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 893/2034] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:28 2022] GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2 => generated 1371 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:29.983296 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:29.989722 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e8bba07e-c88c-4d4b-9428-04068797677e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:29.990616 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e8bba07e-c88c-4d4b-9428-04068797677e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 545e5bdb-26c5-4585-90bd-a51dc9e956fe] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:29.997539 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e8bba07e-c88c-4d4b-9428-04068797677e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:29.998106 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e8bba07e-c88c-4d4b-9428-04068797677e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:29.998612 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e8bba07e-c88c-4d4b-9428-04068797677e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:29.999372 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e8bba07e-c88c-4d4b-9428-04068797677e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:30.000107 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e8bba07e-c88c-4d4b-9428-04068797677e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:30.000756 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e8bba07e-c88c-4d4b-9428-04068797677e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:30.024269 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-e8bba07e-c88c-4d4b-9428-04068797677e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] HTTP exception thrown: Instance 545e5bdb-26c5-4585-90bd-a51dc9e956fe could not be found. Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e8bba07e-c88c-4d4b-9428-04068797677e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Request method failure captured: Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe HTTP/1.1 Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xLZuMLvQ88KTsXpEnT0I-tjdBFOm7EEtVmBSoi3hGbagLa-WCqW3nJreDc3WwTe1tbLbMC3xnpg15asRoKTlUvK3aMhcihww2F0hywjkHPX3fkbbtMYbGiIT_pGesW2tpqp2g11Pwb-WDA3oTL-VeLkmCHA0u8DPW_SmhTlX9-nF08 Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersTestJSON-576619186 Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_efad066360cb45b3a6e9ba872118ea57", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersTestJSON-576619186 Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersTestJSON-576619186 Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersTestJSON-576619186-project Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d4f7282c7251455086368d5274a4fac5 Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersTestJSON-576619186-project Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 545e5bdb-26c5-4585-90bd-a51dc9e956fe could not be found. Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '545e5bdb-26c5-4585-90bd-a51dc9e956fe'} Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 545e5bdb-26c5-4585-90bd-a51dc9e956fe could not be found. Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 545e5bdb-26c5-4585-90bd-a51dc9e956fe could not be found. Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:19:30.026046 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:30.033454 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:19:30.033454 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:19:30.033454 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:19:30.033454 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:19:30.033454 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 545e5bdb-26c5-4585-90bd-a51dc9e956fe could not be found. Aug 07 01:19:30.033454 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:19:30.033454 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e8bba07e-c88c-4d4b-9428-04068797677e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Returning 404 to user: Instance 545e5bdb-26c5-4585-90bd-a51dc9e956fe could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:19:30.033454 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e8bba07e-c88c-4d4b-9428-04068797677e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe" status: 404 len: 111 microversion: 2.1 time: 0.044791 Aug 07 01:19:30.037197 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 894/2035] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:29 2022] GET /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:19:30.042615 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-edb5ad99-5db7-4980-9876-17b72628d2db tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:30.043909 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-edb5ad99-5db7-4980-9876-17b72628d2db tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:30.052297 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-edb5ad99-5db7-4980-9876-17b72628d2db tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:30.052788 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-edb5ad99-5db7-4980-9876-17b72628d2db tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:30.053331 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-edb5ad99-5db7-4980-9876-17b72628d2db tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:30.054234 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-edb5ad99-5db7-4980-9876-17b72628d2db tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:30.054686 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-edb5ad99-5db7-4980-9876-17b72628d2db tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:30.055136 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-edb5ad99-5db7-4980-9876-17b72628d2db tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:30.201575 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-522d1258-a749-4333-949f-55680c283e0a tempest-ListImageFiltersTestJSON-1517127125 tempest-ListImageFiltersTestJSON-1517127125-project] 10.222.0.39 "DELETE /compute/v2.1/images/8abad97a-a031-4524-97bc-f39c9adaefcd" status: 204 len: 0 microversion: 2.1 time: 0.349528 Aug 07 01:19:30.202267 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1142/2036] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:29 2022] DELETE /compute/v2.1/images/8abad97a-a031-4524-97bc-f39c9adaefcd => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:19:30.209909 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-72458aae-094a-455a-ae97-695f2e71ba69 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:30.210621 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-72458aae-094a-455a-ae97-695f2e71ba69 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:30.218510 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72458aae-094a-455a-ae97-695f2e71ba69 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:30.219209 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72458aae-094a-455a-ae97-695f2e71ba69 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:30.219795 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72458aae-094a-455a-ae97-695f2e71ba69 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:30.220634 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72458aae-094a-455a-ae97-695f2e71ba69 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:30.221298 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72458aae-094a-455a-ae97-695f2e71ba69 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:30.221834 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72458aae-094a-455a-ae97-695f2e71ba69 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:30.418653 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-72458aae-094a-455a-ae97-695f2e71ba69 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:30.431118 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-72458aae-094a-455a-ae97-695f2e71ba69 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1469 microversion: 2.1 time: 0.225933 Aug 07 01:19:30.433147 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1143/2037] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:30 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1469 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:30.439363 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-89ffb57c-5dd2-4764-9032-5c3a2e0c4d1e req-9bec5c67-2341-46ac-a7e9-10b07e1bb657 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "545e5bdb-26c5-4585-90bd-a51dc9e956fe", "name": "network-vif-deleted", "tag": "3b7e0782-a83d-4791-8b3c-ac644f0eaa6e"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:30.452520 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-89ffb57c-5dd2-4764-9032-5c3a2e0c4d1e req-9bec5c67-2341-46ac-a7e9-10b07e1bb657 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:30.453029 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-89ffb57c-5dd2-4764-9032-5c3a2e0c4d1e req-9bec5c67-2341-46ac-a7e9-10b07e1bb657 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:30.453542 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-89ffb57c-5dd2-4764-9032-5c3a2e0c4d1e req-9bec5c67-2341-46ac-a7e9-10b07e1bb657 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:30.467491 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-89ffb57c-5dd2-4764-9032-5c3a2e0c4d1e req-9bec5c67-2341-46ac-a7e9-10b07e1bb657 service nova] Creating event network-vif-deleted:3b7e0782-a83d-4791-8b3c-ac644f0eaa6e for instance 545e5bdb-26c5-4585-90bd-a51dc9e956fe on n-h2-master-1 Aug 07 01:19:30.479730 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-89ffb57c-5dd2-4764-9032-5c3a2e0c4d1e req-9bec5c67-2341-46ac-a7e9-10b07e1bb657 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044103 Aug 07 01:19:30.480349 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1144/2038] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:30.498786 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-72770b4f-4c00-4759-bafa-6055d988cf6d tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] Action: 'create', calling method: .version_select at 0x7f9e24c7ba60>, body: {"security_group_rule": {"parent_group_id": "4251203d-097c-4db3-a29b-84bd48bdef45", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "72dc64fa-a46f-4a82-8259-3276e13842f5"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:30.549794 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-edb5ad99-5db7-4980-9876-17b72628d2db tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:30.559060 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-edb5ad99-5db7-4980-9876-17b72628d2db tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1317 microversion: 2.1 time: 0.520664 Aug 07 01:19:30.577137 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 895/2039] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:30 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1317 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:30.590345 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8da89c30-c2ff-4d1d-8106-469b338485f1 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Action: 'create', calling method: .version_select at 0x7f9e17f4f310>, body: {"keypair": {"name": "tempest-key-762590661", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuiAy1WnGyB5upbORUtTBb/jvyM6rzinNZq396XgB9DGwXbPNReuu/ljz3faFmIdyYB+TUI4vhFfWxEZeW9RUAUr/Jp6SKiM0Rpc1dDnnK3U+pWgnAjyfAXs74uy2GGWA=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:30.642500 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-8da89c30-c2ff-4d1d-8106-469b338485f1 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Getting quotas for project efad066360cb45b3a6e9ba872118ea57. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:19:30.653188 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-8da89c30-c2ff-4d1d-8106-469b338485f1 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Getting quotas for user d4f7282c7251455086368d5274a4fac5 and project efad066360cb45b3a6e9ba872118ea57. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:19:30.708988 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:30.723404 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8da89c30-c2ff-4d1d-8106-469b338485f1 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.142875 Aug 07 01:19:30.724804 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 896/2040] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:19:30 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:30.737690 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9149a010-7c9d-474e-ad78-81415769dd72 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:30.744263 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9149a010-7c9d-474e-ad78-81415769dd72 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:30.756007 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9149a010-7c9d-474e-ad78-81415769dd72 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:30.756793 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9149a010-7c9d-474e-ad78-81415769dd72 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:30.757684 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9149a010-7c9d-474e-ad78-81415769dd72 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:30.758787 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9149a010-7c9d-474e-ad78-81415769dd72 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:30.759639 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9149a010-7c9d-474e-ad78-81415769dd72 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:30.760357 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9149a010-7c9d-474e-ad78-81415769dd72 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:30.994168 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-72770b4f-4c00-4759-bafa-6055d988cf6d tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.511697 Aug 07 01:19:30.995601 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1145/2041] 10.222.0.39 () {60 vars in 1195 bytes} [Sun Aug 7 01:19:30 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:31.004934 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7c99cf22-3a19-444a-81fd-64f955b8e948 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '.version_select at 0x7f9e24389790>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:31.016878 n-d-master-1 devstack@n-api.service[119516]: WARNING oslo_db.sqlalchemy.utils [None req-7c99cf22-3a19-444a-81fd-64f955b8e948 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 07 01:19:31.034582 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7c99cf22-3a19-444a-81fd-64f955b8e948 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.032893 Aug 07 01:19:31.037281 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1146/2042] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Aug 7 01:19:30 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:31.054691 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-26a27df0-c448-4786-8ba4-b66eb7e759b4 tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] Calling method '.version_select at 0x7f9e248e84c0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:31.077557 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:31.079623 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9149a010-7c9d-474e-ad78-81415769dd72 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:31.094406 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9149a010-7c9d-474e-ad78-81415769dd72 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:31.106919 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9149a010-7c9d-474e-ad78-81415769dd72 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:31.111086 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9149a010-7c9d-474e-ad78-81415769dd72 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 1412 microversion: 2.25 time: 0.383686 Aug 07 01:19:31.127962 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 897/2043] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:19:30 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 1412 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:19:31.141227 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-21f2f952-fc66-4105-b22f-b3c55bbc161f tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:31.142004 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-21f2f952-fc66-4105-b22f-b3c55bbc161f tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] [instance: 1bc2c437-e710-4af4-9928-76c48834cfa2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:31.188194 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21f2f952-fc66-4105-b22f-b3c55bbc161f tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:31.188895 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21f2f952-fc66-4105-b22f-b3c55bbc161f tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:31.189353 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21f2f952-fc66-4105-b22f-b3c55bbc161f tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:31.201252 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21f2f952-fc66-4105-b22f-b3c55bbc161f tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:31.202319 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21f2f952-fc66-4105-b22f-b3c55bbc161f tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:31.204464 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21f2f952-fc66-4105-b22f-b3c55bbc161f tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:31.545711 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-26a27df0-c448-4786-8ba4-b66eb7e759b4 tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/72dc64fa-a46f-4a82-8259-3276e13842f5" status: 202 len: 0 microversion: 2.1 time: 0.506976 Aug 07 01:19:31.547526 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1147/2044] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:19:31 2022] DELETE /compute/v2.1/os-security-groups/72dc64fa-a46f-4a82-8259-3276e13842f5 => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:19:31.554589 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-42c73bba-8afd-44fc-99c5-71e37c58002b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1928894108", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "key_name": "tempest-key-762590661", "networks": [{"uuid": "339d8f21-b38d-49c3-8efe-8ffee4d616dc"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:31.695567 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-42c73bba-8afd-44fc-99c5-71e37c58002b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] validate_networks() for [('339d8f21-b38d-49c3-8efe-8ffee4d616dc', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:19:31.768021 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-21f2f952-fc66-4105-b22f-b3c55bbc161f tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5080c88d51a8455bba8b70e33cca958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6a995089fa447e8f74df7d111b1c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:31.779375 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-21f2f952-fc66-4105-b22f-b3c55bbc161f tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] 10.222.0.39 "GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2" status: 200 len: 1556 microversion: 2.1 time: 0.655293 Aug 07 01:19:31.796020 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 898/2045] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:31 2022] GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2 => generated 1556 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:31.796020 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-26921dc5-c636-41e1-a0d9-cdb6985831c5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:31.796020 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-26921dc5-c636-41e1-a0d9-cdb6985831c5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:31.821797 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-26921dc5-c636-41e1-a0d9-cdb6985831c5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:31.822722 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-26921dc5-c636-41e1-a0d9-cdb6985831c5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:31.823284 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-26921dc5-c636-41e1-a0d9-cdb6985831c5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:31.824161 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-26921dc5-c636-41e1-a0d9-cdb6985831c5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:31.824929 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-26921dc5-c636-41e1-a0d9-cdb6985831c5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:31.826295 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-26921dc5-c636-41e1-a0d9-cdb6985831c5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:32.099041 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-26921dc5-c636-41e1-a0d9-cdb6985831c5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:32.128044 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-26921dc5-c636-41e1-a0d9-cdb6985831c5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1469 microversion: 2.1 time: 0.338237 Aug 07 01:19:32.129436 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 899/2046] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:31 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1469 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:32.151544 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-16ffa98b-52ff-4afd-8945-c20759317023 tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] Calling method '.version_select at 0x7f9e17e8fd30>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:32.243180 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-16ffa98b-52ff-4afd-8945-c20759317023 tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups/4251203d-097c-4db3-a29b-84bd48bdef45" status: 200 len: 247 microversion: 2.1 time: 0.107151 Aug 07 01:19:32.244483 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 900/2047] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Aug 7 01:19:32 2022] GET /compute/v2.1/os-security-groups/4251203d-097c-4db3-a29b-84bd48bdef45 => generated 247 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:32.256911 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0a5a66ee-2b44-41ca-8bad-d892a5232d33 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:32.257888 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0a5a66ee-2b44-41ca-8bad-d892a5232d33 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:32.268931 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a5a66ee-2b44-41ca-8bad-d892a5232d33 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:32.272362 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a5a66ee-2b44-41ca-8bad-d892a5232d33 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:32.277916 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a5a66ee-2b44-41ca-8bad-d892a5232d33 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:32.279019 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a5a66ee-2b44-41ca-8bad-d892a5232d33 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:32.279701 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a5a66ee-2b44-41ca-8bad-d892a5232d33 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:32.280630 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a5a66ee-2b44-41ca-8bad-d892a5232d33 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:32.501584 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0a5a66ee-2b44-41ca-8bad-d892a5232d33 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:32.514498 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0a5a66ee-2b44-41ca-8bad-d892a5232d33 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1317 microversion: 2.1 time: 0.268622 Aug 07 01:19:32.515396 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 901/2048] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:32 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:32.520280 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2ec8df4b-7bef-4d45-8c52-4fd6d94e71aa tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:32.521338 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2ec8df4b-7bef-4d45-8c52-4fd6d94e71aa tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] [instance: 1bc2c437-e710-4af4-9928-76c48834cfa2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:32.528203 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2ec8df4b-7bef-4d45-8c52-4fd6d94e71aa tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:32.528911 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2ec8df4b-7bef-4d45-8c52-4fd6d94e71aa tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:32.529690 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2ec8df4b-7bef-4d45-8c52-4fd6d94e71aa tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:32.530969 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2ec8df4b-7bef-4d45-8c52-4fd6d94e71aa tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:32.531935 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2ec8df4b-7bef-4d45-8c52-4fd6d94e71aa tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:32.532307 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2ec8df4b-7bef-4d45-8c52-4fd6d94e71aa tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:32.638444 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2ec8df4b-7bef-4d45-8c52-4fd6d94e71aa tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] 10.222.0.39 "GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.121896 Aug 07 01:19:32.639458 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 902/2049] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Aug 7 01:19:32 2022] GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2/os-interface => generated 284 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:32.644826 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-37c97941-0459-4c10-b538-c1d5bcd7f71f req-04867dab-0db8-4384-8fa9-c42330700b23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed97583d-ce2f-4693-b2fe-aaebcf2dd66d", "name": "network-vif-plugged", "status": "completed", "tag": "2e08f8ea-bd0a-4227-84c2-18a7b5c5fede"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:32.656529 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-37c97941-0459-4c10-b538-c1d5bcd7f71f req-04867dab-0db8-4384-8fa9-c42330700b23 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:32.660133 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-37c97941-0459-4c10-b538-c1d5bcd7f71f req-04867dab-0db8-4384-8fa9-c42330700b23 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:32.672348 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-37c97941-0459-4c10-b538-c1d5bcd7f71f req-04867dab-0db8-4384-8fa9-c42330700b23 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:32.677054 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:32.686279 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-37c97941-0459-4c10-b538-c1d5bcd7f71f req-04867dab-0db8-4384-8fa9-c42330700b23 service nova] Creating event network-vif-plugged:2e08f8ea-bd0a-4227-84c2-18a7b5c5fede for instance ed97583d-ce2f-4693-b2fe-aaebcf2dd66d on n-h2-master-1 Aug 07 01:19:32.693687 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-37c97941-0459-4c10-b538-c1d5bcd7f71f req-04867dab-0db8-4384-8fa9-c42330700b23 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052788 Aug 07 01:19:32.694302 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 903/2050] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:32.700213 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f2a4b396-ee44-4415-802b-646c3e650415 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:32.700944 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f2a4b396-ee44-4415-802b-646c3e650415 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:32.708077 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f2a4b396-ee44-4415-802b-646c3e650415 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:32.708572 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f2a4b396-ee44-4415-802b-646c3e650415 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:32.709013 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f2a4b396-ee44-4415-802b-646c3e650415 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:32.709722 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f2a4b396-ee44-4415-802b-646c3e650415 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:32.710181 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f2a4b396-ee44-4415-802b-646c3e650415 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:32.710600 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f2a4b396-ee44-4415-802b-646c3e650415 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:32.882665 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f2a4b396-ee44-4415-802b-646c3e650415 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:32.892779 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f2a4b396-ee44-4415-802b-646c3e650415 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:32.894926 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f2a4b396-ee44-4415-802b-646c3e650415 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:32.897126 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f2a4b396-ee44-4415-802b-646c3e650415 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 1412 microversion: 2.25 time: 0.201315 Aug 07 01:19:32.897788 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 904/2051] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:19:32 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 1412 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:19:32.902733 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8b053a1d-e4e2-46aa-ac4e-f44c776cb15d tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] Action: 'create', calling method: .version_select at 0x7f9e17f150d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-483896620", "description": "tempest-description-1192755699"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:32.926659 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-42c73bba-8afd-44fc-99c5-71e37c58002b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:19:32.927146 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-42c73bba-8afd-44fc-99c5-71e37c58002b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:19:32.927620 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-42c73bba-8afd-44fc-99c5-71e37c58002b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:19:32.928224 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-42c73bba-8afd-44fc-99c5-71e37c58002b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:19:32.928719 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-42c73bba-8afd-44fc-99c5-71e37c58002b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:19:32.944276 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42c73bba-8afd-44fc-99c5-71e37c58002b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:32.944781 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42c73bba-8afd-44fc-99c5-71e37c58002b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:32.945228 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42c73bba-8afd-44fc-99c5-71e37c58002b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:32.946003 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42c73bba-8afd-44fc-99c5-71e37c58002b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:32.946481 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42c73bba-8afd-44fc-99c5-71e37c58002b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:32.946974 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42c73bba-8afd-44fc-99c5-71e37c58002b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:32.993772 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-42c73bba-8afd-44fc-99c5-71e37c58002b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Getting quotas for project efad066360cb45b3a6e9ba872118ea57. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:19:33.001812 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-42c73bba-8afd-44fc-99c5-71e37c58002b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Getting quotas for user d4f7282c7251455086368d5274a4fac5 and project efad066360cb45b3a6e9ba872118ea57. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:19:33.038317 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-42c73bba-8afd-44fc-99c5-71e37c58002b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:19:33.042357 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-42c73bba-8afd-44fc-99c5-71e37c58002b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:19:33.176208 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8b053a1d-e4e2-46aa-ac4e-f44c776cb15d tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.276325 Aug 07 01:19:33.185852 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 905/2052] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Aug 7 01:19:32 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:33.227521 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-42c73bba-8afd-44fc-99c5-71e37c58002b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.678184 Aug 07 01:19:33.229667 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1148/2053] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:19:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:19:33.238705 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-acd57e5b-8d93-44f6-9051-93d1963e3b15 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:33.239292 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-acd57e5b-8d93-44f6-9051-93d1963e3b15 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:33.252450 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-acd57e5b-8d93-44f6-9051-93d1963e3b15 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:33.254779 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-acd57e5b-8d93-44f6-9051-93d1963e3b15 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:33.255544 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-acd57e5b-8d93-44f6-9051-93d1963e3b15 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:33.256546 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-acd57e5b-8d93-44f6-9051-93d1963e3b15 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:33.257179 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-acd57e5b-8d93-44f6-9051-93d1963e3b15 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:33.257776 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-acd57e5b-8d93-44f6-9051-93d1963e3b15 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:33.449776 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-341a07fd-9ca2-43f2-9a65-e8d431d488e3 tempest-ListImageFiltersNegativeTestJSON-1600071990 tempest-ListImageFiltersNegativeTestJSON-1600071990-project] Calling method '.version_select at 0x7f9e17fc5670>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:33.498673 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-341a07fd-9ca2-43f2-9a65-e8d431d488e3 tempest-ListImageFiltersNegativeTestJSON-1600071990 tempest-ListImageFiltersNegativeTestJSON-1600071990-project] HTTP exception thrown: Image not found. Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-341a07fd-9ca2-43f2-9a65-e8d431d488e3 tempest-ListImageFiltersNegativeTestJSON-1600071990 tempest-ListImageFiltersNegativeTestJSON-1600071990-project] Request method failure captured: Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/images/e6f288dd-34ed-4dd1-935b-c93851d52879 HTTP/1.1 Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xMk7rGt43mrpMsW3ic_oPN1e3Nytqp3do2Kbp6f4Qab7Hs4hdFmgnt2joLnM9TB7B9LqzOiPQUG1TJCcJ7kD4E8qRkavehtoEG55mNE2lPfOSIHnO5hkXbAEcKHZALB660El0ZeVwYLbT0a-9p25l_BIrDpsBsczQ-LfOZY2Acq3-4 Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 220e8f7e3524463d816698a16ece9e21 Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1600071990 Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/220e8f7e3524463d816698a16ece9e21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_220e8f7e3524463d816698a16ece9e21", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/220e8f7e3524463d816698a16ece9e21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/220e8f7e3524463d816698a16ece9e21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1600071990 Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 220e8f7e3524463d816698a16ece9e21 Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1600071990 Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ListImageFiltersNegativeTestJSON-1600071990-project Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 5c03a3fc3d0f47e79930637bf24330e1 Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1600071990-project Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: exception: Image not found. Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'e6f288dd-34ed-4dd1-935b-c93851d52879'} Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e6f288dd-34ed-4dd1-935b-c93851d52879 Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 07 01:19:33.502380 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e6f288dd-34ed-4dd1-935b-c93851d52879 could not be found. Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-341a07fd-9ca2-43f2-9a65-e8d431d488e3 tempest-ListImageFiltersNegativeTestJSON-1600071990 tempest-ListImageFiltersNegativeTestJSON-1600071990-project] Returning 404 to user: Image not found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-341a07fd-9ca2-43f2-9a65-e8d431d488e3 tempest-ListImageFiltersNegativeTestJSON-1600071990 tempest-ListImageFiltersNegativeTestJSON-1600071990-project] 10.222.0.39 "GET /compute/v2.1/images/e6f288dd-34ed-4dd1-935b-c93851d52879" status: 404 len: 62 microversion: 2.1 time: 0.319046 Aug 07 01:19:33.514394 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 906/2054] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:19:33 2022] GET /compute/v2.1/images/e6f288dd-34ed-4dd1-935b-c93851d52879 => generated 62 bytes in 320 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:19:33.533368 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3f6f8b20-5faf-4090-b097-42a9bd1db71e tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] Action: 'create', calling method: .version_select at 0x7f9e24da4b80>, body: {"security_group_rule": {"parent_group_id": "2065da3c-e539-4a14-ad90-e9cc1abec4ca", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:33.813213 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-acd57e5b-8d93-44f6-9051-93d1963e3b15 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:33.835036 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-acd57e5b-8d93-44f6-9051-93d1963e3b15 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1469 microversion: 2.1 time: 0.597688 Aug 07 01:19:33.837325 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1149/2055] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:33 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1469 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:33.853733 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d3872d33-7c4d-4afe-b4cb-d34e6c39ac65 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:33.855270 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d3872d33-7c4d-4afe-b4cb-d34e6c39ac65 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:33.963559 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3f6f8b20-5faf-4090-b097-42a9bd1db71e tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.454897 Aug 07 01:19:33.964416 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 907/2056] 10.222.0.39 () {60 vars in 1195 bytes} [Sun Aug 7 01:19:33 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:33.973935 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-abf7604f-7606-4105-ad49-972b6eee3d89 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:33.974594 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-abf7604f-7606-4105-ad49-972b6eee3d89 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:33.986669 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d3872d33-7c4d-4afe-b4cb-d34e6c39ac65 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:33.996551 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-abf7604f-7606-4105-ad49-972b6eee3d89 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:33.998426 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-abf7604f-7606-4105-ad49-972b6eee3d89 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:33.999428 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-abf7604f-7606-4105-ad49-972b6eee3d89 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:34.002219 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-abf7604f-7606-4105-ad49-972b6eee3d89 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:34.002724 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-abf7604f-7606-4105-ad49-972b6eee3d89 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:34.005959 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-abf7604f-7606-4105-ad49-972b6eee3d89 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:34.006986 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d3872d33-7c4d-4afe-b4cb-d34e6c39ac65 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6" status: 200 len: 1228 microversion: 2.1 time: 0.166723 Aug 07 01:19:34.007633 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1150/2057] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:33 2022] GET /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 => generated 1228 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:34.026184 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-aeeaaa05-f9dc-4592-99f7-d4bf4457efd5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:34.027082 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-aeeaaa05-f9dc-4592-99f7-d4bf4457efd5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:34.046293 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aeeaaa05-f9dc-4592-99f7-d4bf4457efd5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:34.047035 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aeeaaa05-f9dc-4592-99f7-d4bf4457efd5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:34.047501 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aeeaaa05-f9dc-4592-99f7-d4bf4457efd5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:34.048306 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aeeaaa05-f9dc-4592-99f7-d4bf4457efd5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:34.048775 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aeeaaa05-f9dc-4592-99f7-d4bf4457efd5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:34.049218 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aeeaaa05-f9dc-4592-99f7-d4bf4457efd5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:34.450713 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-abf7604f-7606-4105-ad49-972b6eee3d89 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:34.463873 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-abf7604f-7606-4105-ad49-972b6eee3d89 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1317 microversion: 2.1 time: 0.498040 Aug 07 01:19:34.464828 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 908/2058] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:33 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1317 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:34.472268 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-15c225a1-3174-49fd-aaf2-510fb1b39ff4 tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] Action: 'create', calling method: .version_select at 0x7f9e17ed8430>, body: {"security_group_rule": {"parent_group_id": "2065da3c-e539-4a14-ad90-e9cc1abec4ca", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:35.021457 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-aeeaaa05-f9dc-4592-99f7-d4bf4457efd5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:35.050872 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-aeeaaa05-f9dc-4592-99f7-d4bf4457efd5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:35.052922 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-aeeaaa05-f9dc-4592-99f7-d4bf4457efd5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:35.055705 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-aeeaaa05-f9dc-4592-99f7-d4bf4457efd5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 1412 microversion: 2.25 time: 1.040977 Aug 07 01:19:35.074822 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1151/2059] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:19:34 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 1412 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:19:35.081273 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-a52371d0-212c-496d-978f-a84f886a09e6 req-61b8d3ea-9945-49df-b805-9d90d5455a10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acc886e0-c989-4105-8375-0c42d4e96404", "name": "network-vif-plugged", "status": "completed", "tag": "1758f50b-5f5d-4ffb-9893-9d21dc63f5bd"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:35.101009 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a52371d0-212c-496d-978f-a84f886a09e6 req-61b8d3ea-9945-49df-b805-9d90d5455a10 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:35.102992 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a52371d0-212c-496d-978f-a84f886a09e6 req-61b8d3ea-9945-49df-b805-9d90d5455a10 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:35.103814 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a52371d0-212c-496d-978f-a84f886a09e6 req-61b8d3ea-9945-49df-b805-9d90d5455a10 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:35.121317 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-a52371d0-212c-496d-978f-a84f886a09e6 req-61b8d3ea-9945-49df-b805-9d90d5455a10 service nova] Creating event network-vif-plugged:1758f50b-5f5d-4ffb-9893-9d21dc63f5bd for instance acc886e0-c989-4105-8375-0c42d4e96404 on n-h1-master-1 Aug 07 01:19:35.127250 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-a52371d0-212c-496d-978f-a84f886a09e6 req-61b8d3ea-9945-49df-b805-9d90d5455a10 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050812 Aug 07 01:19:35.128302 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1152/2060] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:35.138569 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3c7fb967-900d-4068-bfd8-805482eaff63 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:35.139653 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3c7fb967-900d-4068-bfd8-805482eaff63 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:35.158955 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c7fb967-900d-4068-bfd8-805482eaff63 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:35.160049 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c7fb967-900d-4068-bfd8-805482eaff63 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:35.160691 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c7fb967-900d-4068-bfd8-805482eaff63 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:35.161595 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c7fb967-900d-4068-bfd8-805482eaff63 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:35.162280 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c7fb967-900d-4068-bfd8-805482eaff63 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:35.163134 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c7fb967-900d-4068-bfd8-805482eaff63 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:35.435302 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-15c225a1-3174-49fd-aaf2-510fb1b39ff4 tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.969029 Aug 07 01:19:35.435933 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 909/2061] 10.222.0.39 () {60 vars in 1195 bytes} [Sun Aug 7 01:19:34 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:35.440523 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5a91e867-f810-4eaf-84e9-c04cb0dd9b53 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:35.441137 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5a91e867-f810-4eaf-84e9-c04cb0dd9b53 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:35.453139 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a91e867-f810-4eaf-84e9-c04cb0dd9b53 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:35.455409 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a91e867-f810-4eaf-84e9-c04cb0dd9b53 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:35.456442 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a91e867-f810-4eaf-84e9-c04cb0dd9b53 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:35.457723 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a91e867-f810-4eaf-84e9-c04cb0dd9b53 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:35.458399 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a91e867-f810-4eaf-84e9-c04cb0dd9b53 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:35.458905 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a91e867-f810-4eaf-84e9-c04cb0dd9b53 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:35.631337 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3c7fb967-900d-4068-bfd8-805482eaff63 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:35.640406 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3c7fb967-900d-4068-bfd8-805482eaff63 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1469 microversion: 2.1 time: 0.506610 Aug 07 01:19:35.641007 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1153/2062] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:35 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1469 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:35.646365 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-387d9e93-dafa-41d1-aa83-aa46a0c02f76 req-89d96d7a-badb-4eb5-af9f-cb62eb70b74d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a4508ef-5167-4c2c-8bba-4a47c875263b", "name": "network-vif-unplugged", "status": "completed", "tag": "2ce99914-7226-47ae-b72b-c5f4c2bc3fac"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:35.680417 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-387d9e93-dafa-41d1-aa83-aa46a0c02f76 req-89d96d7a-badb-4eb5-af9f-cb62eb70b74d service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:35.680909 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-387d9e93-dafa-41d1-aa83-aa46a0c02f76 req-89d96d7a-badb-4eb5-af9f-cb62eb70b74d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:35.681348 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-387d9e93-dafa-41d1-aa83-aa46a0c02f76 req-89d96d7a-badb-4eb5-af9f-cb62eb70b74d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:35.704944 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-387d9e93-dafa-41d1-aa83-aa46a0c02f76 req-89d96d7a-badb-4eb5-af9f-cb62eb70b74d service nova] Creating event network-vif-unplugged:2ce99914-7226-47ae-b72b-c5f4c2bc3fac for instance 7a4508ef-5167-4c2c-8bba-4a47c875263b on n-h1-master-1 Aug 07 01:19:35.716508 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [req-387d9e93-dafa-41d1-aa83-aa46a0c02f76 req-89d96d7a-badb-4eb5-af9f-cb62eb70b74d service nova] Instance 7a4508ef-5167-4c2c-8bba-4a47c875263b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 01:19:35.740102 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-387d9e93-dafa-41d1-aa83-aa46a0c02f76 req-89d96d7a-badb-4eb5-af9f-cb62eb70b74d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097126 Aug 07 01:19:35.741739 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1154/2063] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:35.753122 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b7cce39a-ca00-400c-8b17-ffc8d81013fb tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] Calling method '.version_select at 0x7f9e24884040>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:35.937606 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5a91e867-f810-4eaf-84e9-c04cb0dd9b53 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:35.950343 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5a91e867-f810-4eaf-84e9-c04cb0dd9b53 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6" status: 200 len: 1286 microversion: 2.1 time: 0.513052 Aug 07 01:19:35.964992 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 910/2064] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:35 2022] GET /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 => generated 1286 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:35.964992 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bb06483b-c645-446b-a306-cfc903e074bd tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:35.964992 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bb06483b-c645-446b-a306-cfc903e074bd tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:35.973062 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bb06483b-c645-446b-a306-cfc903e074bd tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:35.973951 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bb06483b-c645-446b-a306-cfc903e074bd tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:35.974630 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bb06483b-c645-446b-a306-cfc903e074bd tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:35.975854 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bb06483b-c645-446b-a306-cfc903e074bd tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:35.976595 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bb06483b-c645-446b-a306-cfc903e074bd tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:35.977285 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bb06483b-c645-446b-a306-cfc903e074bd tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:35.980952 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b7cce39a-ca00-400c-8b17-ffc8d81013fb tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups/2065da3c-e539-4a14-ad90-e9cc1abec4ca" status: 200 len: 664 microversion: 2.1 time: 0.237491 Aug 07 01:19:35.981875 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1155/2065] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Aug 7 01:19:35 2022] GET /compute/v2.1/os-security-groups/2065da3c-e539-4a14-ad90-e9cc1abec4ca => generated 664 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:35.994191 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f32b56c4-bb0f-45a7-9540-69b2b343e684 tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] Calling method '.version_select at 0x7f9e248abaf0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:36.411323 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bb06483b-c645-446b-a306-cfc903e074bd tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:36.421989 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bb06483b-c645-446b-a306-cfc903e074bd tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1506 microversion: 2.1 time: 0.467442 Aug 07 01:19:36.440908 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 911/2066] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:35 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1506 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:36.453190 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-70796b88-0516-4a2e-9334-f950354f7738 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:36.455119 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-70796b88-0516-4a2e-9334-f950354f7738 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:36.475511 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-70796b88-0516-4a2e-9334-f950354f7738 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:36.476056 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-70796b88-0516-4a2e-9334-f950354f7738 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:36.476853 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-70796b88-0516-4a2e-9334-f950354f7738 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:36.477700 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-70796b88-0516-4a2e-9334-f950354f7738 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:36.478175 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-70796b88-0516-4a2e-9334-f950354f7738 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:36.481870 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-70796b88-0516-4a2e-9334-f950354f7738 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:36.490569 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f32b56c4-bb0f-45a7-9540-69b2b343e684 tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-group-rules/1592e4ec-0bc2-4300-a959-616605ef12e2" status: 202 len: 0 microversion: 2.1 time: 0.499722 Aug 07 01:19:36.495346 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1156/2067] 10.222.0.39 () {58 vars in 1287 bytes} [Sun Aug 7 01:19:35 2022] DELETE /compute/v2.1/os-security-group-rules/1592e4ec-0bc2-4300-a959-616605ef12e2 => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 01:19:36.500903 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-6f159993-43cb-4cea-b708-20bfbe8d98b6 req-af3ef664-9179-420a-af63-e93d426eeb79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bc2c437-e710-4af4-9928-76c48834cfa2", "tag": "ab6ea765-494d-449a-a112-5e331ebc939d"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:36.528544 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6f159993-43cb-4cea-b708-20bfbe8d98b6 req-af3ef664-9179-420a-af63-e93d426eeb79 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:36.530464 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6f159993-43cb-4cea-b708-20bfbe8d98b6 req-af3ef664-9179-420a-af63-e93d426eeb79 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:36.531218 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6f159993-43cb-4cea-b708-20bfbe8d98b6 req-af3ef664-9179-420a-af63-e93d426eeb79 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:36.556635 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-6f159993-43cb-4cea-b708-20bfbe8d98b6 req-af3ef664-9179-420a-af63-e93d426eeb79 service nova] Creating event network-changed:ab6ea765-494d-449a-a112-5e331ebc939d for instance 1bc2c437-e710-4af4-9928-76c48834cfa2 on n-h2-master-1 Aug 07 01:19:36.563624 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-6f159993-43cb-4cea-b708-20bfbe8d98b6 req-af3ef664-9179-420a-af63-e93d426eeb79 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066128 Aug 07 01:19:36.564865 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1157/2068] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:36.572404 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ff291571-1faa-49a8-973f-ba0c9ab763d6 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:36.573612 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ff291571-1faa-49a8-973f-ba0c9ab763d6 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:36.580810 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ff291571-1faa-49a8-973f-ba0c9ab763d6 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:36.581531 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ff291571-1faa-49a8-973f-ba0c9ab763d6 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:36.582266 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ff291571-1faa-49a8-973f-ba0c9ab763d6 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:36.583220 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ff291571-1faa-49a8-973f-ba0c9ab763d6 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:36.583924 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ff291571-1faa-49a8-973f-ba0c9ab763d6 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:36.584579 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ff291571-1faa-49a8-973f-ba0c9ab763d6 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:37.066696 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-70796b88-0516-4a2e-9334-f950354f7738 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:37.082199 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-70796b88-0516-4a2e-9334-f950354f7738 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:37.093385 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ff291571-1faa-49a8-973f-ba0c9ab763d6 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:37.098817 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-70796b88-0516-4a2e-9334-f950354f7738 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:37.108949 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-70796b88-0516-4a2e-9334-f950354f7738 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 1412 microversion: 2.25 time: 0.664786 Aug 07 01:19:37.109993 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 912/2069] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:19:36 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 1412 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:19:37.112540 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ff291571-1faa-49a8-973f-ba0c9ab763d6 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1506 microversion: 2.1 time: 0.544709 Aug 07 01:19:37.115524 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1158/2070] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:36 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1506 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:37.120840 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0e3a7826-2b41-4ae7-a44c-0cdc02858d1c tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] Calling method '.version_select at 0x7f9e17f97670>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:37.129952 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-698b5769-ec2b-4fcc-a2c2-79d4936a9211 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:37.135506 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-698b5769-ec2b-4fcc-a2c2-79d4936a9211 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:37.170717 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-698b5769-ec2b-4fcc-a2c2-79d4936a9211 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:37.187564 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-698b5769-ec2b-4fcc-a2c2-79d4936a9211 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:37.189658 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-698b5769-ec2b-4fcc-a2c2-79d4936a9211 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:37.191474 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-698b5769-ec2b-4fcc-a2c2-79d4936a9211 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:37.192555 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-698b5769-ec2b-4fcc-a2c2-79d4936a9211 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:37.193462 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-698b5769-ec2b-4fcc-a2c2-79d4936a9211 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:37.626160 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-698b5769-ec2b-4fcc-a2c2-79d4936a9211 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:37.634614 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-698b5769-ec2b-4fcc-a2c2-79d4936a9211 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1469 microversion: 2.1 time: 0.517696 Aug 07 01:19:37.649218 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1159/2071] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:37 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1469 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:37.654889 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5047b74f-e4c6-448a-a47e-1bd195269f37 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:37.655721 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5047b74f-e4c6-448a-a47e-1bd195269f37 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:37.664266 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5047b74f-e4c6-448a-a47e-1bd195269f37 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:37.665023 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5047b74f-e4c6-448a-a47e-1bd195269f37 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:37.665639 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5047b74f-e4c6-448a-a47e-1bd195269f37 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:37.666596 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5047b74f-e4c6-448a-a47e-1bd195269f37 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:37.667054 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5047b74f-e4c6-448a-a47e-1bd195269f37 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:37.667790 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5047b74f-e4c6-448a-a47e-1bd195269f37 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:38.002786 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5047b74f-e4c6-448a-a47e-1bd195269f37 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:38.024468 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5047b74f-e4c6-448a-a47e-1bd195269f37 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6" status: 200 len: 1328 microversion: 2.1 time: 0.367167 Aug 07 01:19:38.025821 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1160/2072] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:37 2022] GET /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 => generated 1328 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:38.041910 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f1df5e3b-e00e-4c2e-9cad-791d49fa6635 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:38.049398 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f1df5e3b-e00e-4c2e-9cad-791d49fa6635 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:38.071294 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f1df5e3b-e00e-4c2e-9cad-791d49fa6635 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:38.072738 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f1df5e3b-e00e-4c2e-9cad-791d49fa6635 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:38.075248 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f1df5e3b-e00e-4c2e-9cad-791d49fa6635 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:38.080882 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f1df5e3b-e00e-4c2e-9cad-791d49fa6635 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:38.085868 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f1df5e3b-e00e-4c2e-9cad-791d49fa6635 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:38.091337 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f1df5e3b-e00e-4c2e-9cad-791d49fa6635 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:38.136861 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0e3a7826-2b41-4ae7-a44c-0cdc02858d1c tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/2065da3c-e539-4a14-ad90-e9cc1abec4ca" status: 202 len: 0 microversion: 2.1 time: 1.022729 Aug 07 01:19:38.137442 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 913/2073] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:19:37 2022] DELETE /compute/v2.1/os-security-groups/2065da3c-e539-4a14-ad90-e9cc1abec4ca => generated 0 bytes in 1024 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:19:38.144475 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-ebee597c-709d-470c-8293-7b82c923141c req-e6577710-d02b-4d4e-9daf-1bc519afa422 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a4508ef-5167-4c2c-8bba-4a47c875263b", "tag": "2ce99914-7226-47ae-b72b-c5f4c2bc3fac"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:38.175933 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-ebee597c-709d-470c-8293-7b82c923141c req-e6577710-d02b-4d4e-9daf-1bc519afa422 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:38.176429 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-ebee597c-709d-470c-8293-7b82c923141c req-e6577710-d02b-4d4e-9daf-1bc519afa422 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:38.185028 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-ebee597c-709d-470c-8293-7b82c923141c req-e6577710-d02b-4d4e-9daf-1bc519afa422 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:38.203039 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-ebee597c-709d-470c-8293-7b82c923141c req-e6577710-d02b-4d4e-9daf-1bc519afa422 service nova] Creating event network-changed:2ce99914-7226-47ae-b72b-c5f4c2bc3fac for instance 7a4508ef-5167-4c2c-8bba-4a47c875263b on n-h1-master-1 Aug 07 01:19:38.216829 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [req-ebee597c-709d-470c-8293-7b82c923141c req-e6577710-d02b-4d4e-9daf-1bc519afa422 service nova] Instance 7a4508ef-5167-4c2c-8bba-4a47c875263b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 01:19:38.252378 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-ebee597c-709d-470c-8293-7b82c923141c req-e6577710-d02b-4d4e-9daf-1bc519afa422 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113435 Aug 07 01:19:38.254933 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 914/2074] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:38.266741 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4bdea9ea-6884-4d1f-ba3b-93cf2e3832b1 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:38.267464 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4bdea9ea-6884-4d1f-ba3b-93cf2e3832b1 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:38.273005 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f1df5e3b-e00e-4c2e-9cad-791d49fa6635 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "PUT /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1078 microversion: 2.1 time: 0.243556 Aug 07 01:19:38.273903 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1161/2075] 10.222.0.39 () {60 vars in 1256 bytes} [Sun Aug 7 01:19:38 2022] PUT /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1078 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:38.278255 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-225067da-3b7d-4bfe-be33-56d4432d2d2d tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] Calling method '.version_select at 0x7f9e250c8940>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:38.288091 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4bdea9ea-6884-4d1f-ba3b-93cf2e3832b1 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:38.295136 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4bdea9ea-6884-4d1f-ba3b-93cf2e3832b1 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:38.295866 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4bdea9ea-6884-4d1f-ba3b-93cf2e3832b1 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:38.296900 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4bdea9ea-6884-4d1f-ba3b-93cf2e3832b1 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:38.297573 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4bdea9ea-6884-4d1f-ba3b-93cf2e3832b1 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:38.298806 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4bdea9ea-6884-4d1f-ba3b-93cf2e3832b1 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:38.339569 n-d-master-1 devstack@n-api.service[119516]: DEBUG neutronclient.v2_0.client [None req-225067da-3b7d-4bfe-be33-56d4432d2d2d tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 72dc64fa-a46f-4a82-8259-3276e13842f5 does not exist", "detail": ""}} {{(pid=119516) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 07 01:19:38.340418 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.security_group_api [None req-225067da-3b7d-4bfe-be33-56d4432d2d2d tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] Neutron security group 72dc64fa-a46f-4a82-8259-3276e13842f5 not found {{(pid=119516) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 07 01:19:38.341358 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-225067da-3b7d-4bfe-be33-56d4432d2d2d tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] HTTP exception thrown: Security group 72dc64fa-a46f-4a82-8259-3276e13842f5 does not exist Aug 07 01:19:38.341358 n-d-master-1 devstack@n-api.service[119516]: Neutron server returns request_ids: ['req-8a847e9a-a728-45a1-abf0-3bc27a120580'] Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-225067da-3b7d-4bfe-be33-56d4432d2d2d tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] Request method failure captured: Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/os-security-groups/72dc64fa-a46f-4a82-8259-3276e13842f5 HTTP/1.1 Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xMXUHZ0cxwaJtDkbl6NaF_xuG5Yu_is8LgKVgKkdWu0-CULkiluFNDebsdhs8c4rdre5zpjm5RopsSk73pPtCGDb2ERlUAtMUqa4LTrshjwvp5O2MVpsgA9WGouvCfUi-gPULDNa8HXs33uJaRgFGJmdC8pPWL1SAoSRCS8dWY1YTk Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 173a9cd21505478684a69dc461813349 Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-780923801 Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/173a9cd21505478684a69dc461813349"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_173a9cd21505478684a69dc461813349", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/173a9cd21505478684a69dc461813349"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/173a9cd21505478684a69dc461813349"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-SecurityGroupRulesTestJSON-780923801 Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 173a9cd21505478684a69dc461813349 Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-780923801 Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-SecurityGroupRulesTestJSON-780923801-project Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: cb6a1da42d354933aa782ccdbb5831ac Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-SecurityGroupRulesTestJSON-780923801-project Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: exception: Security group 72dc64fa-a46f-4a82-8259-3276e13842f5 does not exist Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: Neutron server returns request_ids: ['req-8a847e9a-a728-45a1-abf0-3bc27a120580'] Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '72dc64fa-a46f-4a82-8259-3276e13842f5'} Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 07 01:19:38.344086 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 72dc64fa-a46f-4a82-8259-3276e13842f5 does not exist Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8a847e9a-a728-45a1-abf0-3bc27a120580'] Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 72dc64fa-a46f-4a82-8259-3276e13842f5 does not exist Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8a847e9a-a728-45a1-abf0-3bc27a120580'] Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 72dc64fa-a46f-4a82-8259-3276e13842f5 does not exist Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8a847e9a-a728-45a1-abf0-3bc27a120580'] Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 72dc64fa-a46f-4a82-8259-3276e13842f5 does not exist Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8a847e9a-a728-45a1-abf0-3bc27a120580'] Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-225067da-3b7d-4bfe-be33-56d4432d2d2d tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] Returning 404 to user: Security group 72dc64fa-a46f-4a82-8259-3276e13842f5 does not exist Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: Neutron server returns request_ids: ['req-8a847e9a-a728-45a1-abf0-3bc27a120580'] {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-225067da-3b7d-4bfe-be33-56d4432d2d2d tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/72dc64fa-a46f-4a82-8259-3276e13842f5" status: 404 len: 194 microversion: 2.1 time: 0.069907 Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1162/2076] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:19:38 2022] DELETE /compute/v2.1/os-security-groups/72dc64fa-a46f-4a82-8259-3276e13842f5 => generated 194 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-90c5edb9-f911-4883-bc10-f8e81dacc92f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:38.352568 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-90c5edb9-f911-4883-bc10-f8e81dacc92f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:38.364881 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90c5edb9-f911-4883-bc10-f8e81dacc92f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:38.365382 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90c5edb9-f911-4883-bc10-f8e81dacc92f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:38.365824 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90c5edb9-f911-4883-bc10-f8e81dacc92f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:38.367393 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90c5edb9-f911-4883-bc10-f8e81dacc92f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:38.367393 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90c5edb9-f911-4883-bc10-f8e81dacc92f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:38.367796 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90c5edb9-f911-4883-bc10-f8e81dacc92f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:38.664263 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4bdea9ea-6884-4d1f-ba3b-93cf2e3832b1 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:38.665192 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-90c5edb9-f911-4883-bc10-f8e81dacc92f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:38.677660 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-90c5edb9-f911-4883-bc10-f8e81dacc92f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1504 microversion: 2.1 time: 0.330728 Aug 07 01:19:38.679065 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1163/2077] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:38 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1504 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:38.680625 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4bdea9ea-6884-4d1f-ba3b-93cf2e3832b1 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:38.682423 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4bdea9ea-6884-4d1f-ba3b-93cf2e3832b1 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:38.684344 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4bdea9ea-6884-4d1f-ba3b-93cf2e3832b1 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 1607 microversion: 2.25 time: 0.428018 Aug 07 01:19:38.685503 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 915/2078] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:19:38 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 1607 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:19:38.687234 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ef9464c7-7b19-4842-81ae-319a98d6adba tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] Calling method '.version_select at 0x7f9e248ffee0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:38.692263 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6759195a-18db-4f2c-b854-df631ac1f91f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:38.693192 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6759195a-18db-4f2c-b854-df631ac1f91f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:38.712058 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6759195a-18db-4f2c-b854-df631ac1f91f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:38.712058 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6759195a-18db-4f2c-b854-df631ac1f91f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:38.712058 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6759195a-18db-4f2c-b854-df631ac1f91f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:38.713380 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6759195a-18db-4f2c-b854-df631ac1f91f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:38.714082 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6759195a-18db-4f2c-b854-df631ac1f91f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:38.714824 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6759195a-18db-4f2c-b854-df631ac1f91f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:39.225171 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ef9464c7-7b19-4842-81ae-319a98d6adba tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/4251203d-097c-4db3-a29b-84bd48bdef45" status: 202 len: 0 microversion: 2.1 time: 0.544180 Aug 07 01:19:39.226255 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1164/2079] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:19:38 2022] DELETE /compute/v2.1/os-security-groups/4251203d-097c-4db3-a29b-84bd48bdef45 => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:19:39.231167 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a9ad90e5-0b05-4858-93ee-08cf27603914 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:39.232024 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a9ad90e5-0b05-4858-93ee-08cf27603914 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:39.243844 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a9ad90e5-0b05-4858-93ee-08cf27603914 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:39.244365 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a9ad90e5-0b05-4858-93ee-08cf27603914 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:39.252626 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a9ad90e5-0b05-4858-93ee-08cf27603914 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:39.253419 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a9ad90e5-0b05-4858-93ee-08cf27603914 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:39.254261 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a9ad90e5-0b05-4858-93ee-08cf27603914 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:39.254874 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a9ad90e5-0b05-4858-93ee-08cf27603914 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:39.507162 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6759195a-18db-4f2c-b854-df631ac1f91f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:39.523821 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6759195a-18db-4f2c-b854-df631ac1f91f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1469 microversion: 2.1 time: 0.836895 Aug 07 01:19:39.524466 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 916/2080] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:38 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1469 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:39.538750 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a316b611-7d45-424c-bf49-d857364f33d0 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:39.539865 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a316b611-7d45-424c-bf49-d857364f33d0 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:39.556485 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a316b611-7d45-424c-bf49-d857364f33d0 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:39.556974 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a316b611-7d45-424c-bf49-d857364f33d0 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:39.558011 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a316b611-7d45-424c-bf49-d857364f33d0 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:39.559181 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a316b611-7d45-424c-bf49-d857364f33d0 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:39.562875 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a316b611-7d45-424c-bf49-d857364f33d0 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:39.563903 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a316b611-7d45-424c-bf49-d857364f33d0 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:39.832261 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a316b611-7d45-424c-bf49-d857364f33d0 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.304532 Aug 07 01:19:39.833178 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 917/2081] 10.222.0.39 () {60 vars in 1316 bytes} [Sun Aug 7 01:19:39 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404/os-interface => generated 284 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:19:39.845123 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-cc0ac399-2b78-426d-9ba1-ec2c88916df9 req-f81a1623-4e51-44e1-83bc-3850b08b458e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6", "tag": "b8a3f4d6-7cbf-4e51-8a06-62bb6fe91f7d"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:39.866962 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-cc0ac399-2b78-426d-9ba1-ec2c88916df9 req-f81a1623-4e51-44e1-83bc-3850b08b458e service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:39.868105 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-cc0ac399-2b78-426d-9ba1-ec2c88916df9 req-f81a1623-4e51-44e1-83bc-3850b08b458e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:39.871726 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-cc0ac399-2b78-426d-9ba1-ec2c88916df9 req-f81a1623-4e51-44e1-83bc-3850b08b458e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:39.899523 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-cc0ac399-2b78-426d-9ba1-ec2c88916df9 req-f81a1623-4e51-44e1-83bc-3850b08b458e service nova] Creating event network-changed:b8a3f4d6-7cbf-4e51-8a06-62bb6fe91f7d for instance 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 on n-h1-master-1 Aug 07 01:19:39.909626 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-cc0ac399-2b78-426d-9ba1-ec2c88916df9 req-f81a1623-4e51-44e1-83bc-3850b08b458e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074807 Aug 07 01:19:39.910970 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 918/2082] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:39.922249 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7a67f0c9-ccdf-47f4-a132-9716d920c96b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:39.923471 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7a67f0c9-ccdf-47f4-a132-9716d920c96b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:39.937624 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a67f0c9-ccdf-47f4-a132-9716d920c96b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:39.938465 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a67f0c9-ccdf-47f4-a132-9716d920c96b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:39.939131 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a67f0c9-ccdf-47f4-a132-9716d920c96b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:39.940128 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a67f0c9-ccdf-47f4-a132-9716d920c96b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:39.942866 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a67f0c9-ccdf-47f4-a132-9716d920c96b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:39.943676 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a67f0c9-ccdf-47f4-a132-9716d920c96b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:40.241445 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a9ad90e5-0b05-4858-93ee-08cf27603914 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:40.254410 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a9ad90e5-0b05-4858-93ee-08cf27603914 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1504 microversion: 2.1 time: 1.026802 Aug 07 01:19:40.255157 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1165/2083] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:39 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1504 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:40.263231 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-70868675-8eb2-4afc-a419-ca3620cf24f7 tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] Calling method '.version_select at 0x7f9e2480f820>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:40.584455 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7a67f0c9-ccdf-47f4-a132-9716d920c96b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:40.600595 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7a67f0c9-ccdf-47f4-a132-9716d920c96b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6" status: 200 len: 1328 microversion: 2.1 time: 0.688023 Aug 07 01:19:40.601274 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 919/2084] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:39 2022] GET /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 => generated 1328 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:40.607260 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-848bcc4a-419e-4575-9639-a60bd962523b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:40.610415 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-848bcc4a-419e-4575-9639-a60bd962523b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:40.620998 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-848bcc4a-419e-4575-9639-a60bd962523b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:40.621778 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-848bcc4a-419e-4575-9639-a60bd962523b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:40.622975 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-848bcc4a-419e-4575-9639-a60bd962523b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:40.623717 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-848bcc4a-419e-4575-9639-a60bd962523b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:40.624356 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-848bcc4a-419e-4575-9639-a60bd962523b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:40.624960 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-848bcc4a-419e-4575-9639-a60bd962523b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:40.693965 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=4 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:40.740545 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-848bcc4a-419e-4575-9639-a60bd962523b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:19:40.741118 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-848bcc4a-419e-4575-9639-a60bd962523b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:19:40.741601 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-848bcc4a-419e-4575-9639-a60bd962523b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:19:40.742172 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-848bcc4a-419e-4575-9639-a60bd962523b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:19:40.742412 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-848bcc4a-419e-4575-9639-a60bd962523b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:19:40.828290 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-848bcc4a-419e-4575-9639-a60bd962523b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:40.837505 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-848bcc4a-419e-4575-9639-a60bd962523b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:40.838451 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-848bcc4a-419e-4575-9639-a60bd962523b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:40.840524 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-848bcc4a-419e-4575-9639-a60bd962523b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:40.841544 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-848bcc4a-419e-4575-9639-a60bd962523b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:40.842288 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-848bcc4a-419e-4575-9639-a60bd962523b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:40.842943 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-848bcc4a-419e-4575-9639-a60bd962523b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:40.881929 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-848bcc4a-419e-4575-9639-a60bd962523b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "POST /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d/action" status: 202 len: 1110 microversion: 2.1 time: 0.279079 Aug 07 01:19:40.892930 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 920/2085] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:19:40 2022] POST /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d/action => generated 1110 bytes in 291 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 07 01:19:40.898281 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c6482219-2577-4a04-8011-a842fbb890d6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:40.898799 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c6482219-2577-4a04-8011-a842fbb890d6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:40.921011 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6482219-2577-4a04-8011-a842fbb890d6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:40.928565 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6482219-2577-4a04-8011-a842fbb890d6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:40.929294 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6482219-2577-4a04-8011-a842fbb890d6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:40.932944 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6482219-2577-4a04-8011-a842fbb890d6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:40.933696 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6482219-2577-4a04-8011-a842fbb890d6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:40.935531 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6482219-2577-4a04-8011-a842fbb890d6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:41.115151 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-70868675-8eb2-4afc-a419-ca3620cf24f7 tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/a550c2cc-c9b2-4022-8409-a54ffbc22fa2" status: 202 len: 0 microversion: 2.1 time: 0.856963 Aug 07 01:19:41.116811 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1166/2086] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:19:40 2022] DELETE /compute/v2.1/os-security-groups/a550c2cc-c9b2-4022-8409-a54ffbc22fa2 => generated 0 bytes in 861 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:19:41.127068 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c2da196d-1ef5-44aa-96ee-bcf9ed654cf5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:41.130900 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c2da196d-1ef5-44aa-96ee-bcf9ed654cf5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:41.174717 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c2da196d-1ef5-44aa-96ee-bcf9ed654cf5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:41.177761 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c2da196d-1ef5-44aa-96ee-bcf9ed654cf5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:41.179415 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c2da196d-1ef5-44aa-96ee-bcf9ed654cf5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:41.182598 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c2da196d-1ef5-44aa-96ee-bcf9ed654cf5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:41.185205 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c2da196d-1ef5-44aa-96ee-bcf9ed654cf5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:41.187755 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c2da196d-1ef5-44aa-96ee-bcf9ed654cf5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:41.666458 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c2da196d-1ef5-44aa-96ee-bcf9ed654cf5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:41.679052 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c2da196d-1ef5-44aa-96ee-bcf9ed654cf5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1515 microversion: 2.1 time: 0.559807 Aug 07 01:19:41.695591 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1167/2087] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:41 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1515 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:41.711029 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fee116de-c6c1-485b-bcfb-41b3af22a7ba tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] Calling method '.version_select at 0x7f9e24bd2c10>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:41.790081 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c6482219-2577-4a04-8011-a842fbb890d6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:41.803479 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c6482219-2577-4a04-8011-a842fbb890d6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1462 microversion: 2.1 time: 0.909281 Aug 07 01:19:41.809788 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 921/2088] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:40 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1462 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:41.825755 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-708fad54-e87c-42cf-bef1-7a34c6bd95ff tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:41.826802 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-708fad54-e87c-42cf-bef1-7a34c6bd95ff tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:41.847261 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-708fad54-e87c-42cf-bef1-7a34c6bd95ff tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:41.848048 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-708fad54-e87c-42cf-bef1-7a34c6bd95ff tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:41.856750 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-708fad54-e87c-42cf-bef1-7a34c6bd95ff tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:41.857613 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-708fad54-e87c-42cf-bef1-7a34c6bd95ff tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:41.858165 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-708fad54-e87c-42cf-bef1-7a34c6bd95ff tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:41.858674 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-708fad54-e87c-42cf-bef1-7a34c6bd95ff tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:42.235345 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fee116de-c6c1-485b-bcfb-41b3af22a7ba tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/9fbfaa90-3296-42c2-961f-d1ef85c62462" status: 202 len: 0 microversion: 2.1 time: 0.535483 Aug 07 01:19:42.236972 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1168/2089] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:19:41 2022] DELETE /compute/v2.1/os-security-groups/9fbfaa90-3296-42c2-961f-d1ef85c62462 => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:19:42.461572 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-708fad54-e87c-42cf-bef1-7a34c6bd95ff tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:42.475295 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-708fad54-e87c-42cf-bef1-7a34c6bd95ff tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6" status: 200 len: 1328 microversion: 2.1 time: 0.664104 Aug 07 01:19:42.476813 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 922/2090] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:41 2022] GET /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 => generated 1328 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:42.485922 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fa592809-ad37-4abb-8f93-d954fe4d10fe tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] Calling method '.version_select at 0x7f9e17e83e50>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:42.522404 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6764c1f4-a92e-437e-886d-88e582db52d7 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:42.523535 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6764c1f4-a92e-437e-886d-88e582db52d7 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:42.536447 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6764c1f4-a92e-437e-886d-88e582db52d7 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:42.538027 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6764c1f4-a92e-437e-886d-88e582db52d7 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:42.538764 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6764c1f4-a92e-437e-886d-88e582db52d7 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:42.539916 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6764c1f4-a92e-437e-886d-88e582db52d7 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:42.541428 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6764c1f4-a92e-437e-886d-88e582db52d7 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:42.542540 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6764c1f4-a92e-437e-886d-88e582db52d7 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:42.760251 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6764c1f4-a92e-437e-886d-88e582db52d7 tempest-MigrationsAdminTest-455441562 tempest-MigrationsAdminTest-455441562-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1613 microversion: 2.1 time: 0.521759 Aug 07 01:19:42.764238 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1169/2091] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:42 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1613 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:42.770847 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-55f15f6d-2335-4432-b9e4-9d6c9cbff160 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:42.783727 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-55f15f6d-2335-4432-b9e4-9d6c9cbff160 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:42.798446 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-55f15f6d-2335-4432-b9e4-9d6c9cbff160 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:42.798949 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-55f15f6d-2335-4432-b9e4-9d6c9cbff160 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:42.799397 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-55f15f6d-2335-4432-b9e4-9d6c9cbff160 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:42.805482 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-55f15f6d-2335-4432-b9e4-9d6c9cbff160 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:42.805988 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-55f15f6d-2335-4432-b9e4-9d6c9cbff160 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:42.806450 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-55f15f6d-2335-4432-b9e4-9d6c9cbff160 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:42.961188 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:43.264240 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-55f15f6d-2335-4432-b9e4-9d6c9cbff160 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:43.269337 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:43.279512 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-55f15f6d-2335-4432-b9e4-9d6c9cbff160 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1515 microversion: 2.1 time: 0.513647 Aug 07 01:19:43.280364 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1170/2092] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:42 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1515 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:43.285835 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e502c9eb-ccbf-44df-9f08-78c3da02a93d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:43.286654 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e502c9eb-ccbf-44df-9f08-78c3da02a93d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:43.295515 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e502c9eb-ccbf-44df-9f08-78c3da02a93d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:43.296450 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e502c9eb-ccbf-44df-9f08-78c3da02a93d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:43.297183 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e502c9eb-ccbf-44df-9f08-78c3da02a93d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:43.299154 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e502c9eb-ccbf-44df-9f08-78c3da02a93d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:43.304841 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e502c9eb-ccbf-44df-9f08-78c3da02a93d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:43.306782 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e502c9eb-ccbf-44df-9f08-78c3da02a93d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:43.342589 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e502c9eb-ccbf-44df-9f08-78c3da02a93d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:19:43.476352 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e502c9eb-ccbf-44df-9f08-78c3da02a93d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 204 len: 0 microversion: 2.1 time: 0.193666 Aug 07 01:19:43.481041 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1171/2093] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:19:43 2022] DELETE /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:19:43.490519 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e1570157-dec7-4fc7-9ad3-13e0462ff83f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:43.491282 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e1570157-dec7-4fc7-9ad3-13e0462ff83f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:43.503857 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1570157-dec7-4fc7-9ad3-13e0462ff83f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:43.505168 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1570157-dec7-4fc7-9ad3-13e0462ff83f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:43.506105 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1570157-dec7-4fc7-9ad3-13e0462ff83f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:43.507349 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1570157-dec7-4fc7-9ad3-13e0462ff83f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:43.508327 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1570157-dec7-4fc7-9ad3-13e0462ff83f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:43.509448 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1570157-dec7-4fc7-9ad3-13e0462ff83f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:43.828133 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fa592809-ad37-4abb-8f93-d954fe4d10fe tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/86233b92-0745-42d2-8d1b-791ded25453d" status: 202 len: 0 microversion: 2.1 time: 1.349716 Aug 07 01:19:43.832568 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 923/2094] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:19:42 2022] DELETE /compute/v2.1/os-security-groups/86233b92-0745-42d2-8d1b-791ded25453d => generated 0 bytes in 1352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:19:43.838771 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-59d36bbc-edab-476c-87a0-d77da8b6a7f0 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:43.839662 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-59d36bbc-edab-476c-87a0-d77da8b6a7f0 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:43.857475 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59d36bbc-edab-476c-87a0-d77da8b6a7f0 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:43.860522 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59d36bbc-edab-476c-87a0-d77da8b6a7f0 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:43.861111 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59d36bbc-edab-476c-87a0-d77da8b6a7f0 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:43.862767 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59d36bbc-edab-476c-87a0-d77da8b6a7f0 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:43.863920 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59d36bbc-edab-476c-87a0-d77da8b6a7f0 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:43.867686 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59d36bbc-edab-476c-87a0-d77da8b6a7f0 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:44.003205 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=8 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:44.105089 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e1570157-dec7-4fc7-9ad3-13e0462ff83f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:44.125000 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e1570157-dec7-4fc7-9ad3-13e0462ff83f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1468 microversion: 2.1 time: 0.640409 Aug 07 01:19:44.126507 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1172/2095] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:43 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1468 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:44.136264 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-502dccca-43a3-4b7d-96c5-3b7d76a27942 req-bc282b90-f463-4044-a3f5-fdb7c05749a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acc886e0-c989-4105-8375-0c42d4e96404", "tag": "1758f50b-5f5d-4ffb-9893-9d21dc63f5bd"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:44.155390 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-502dccca-43a3-4b7d-96c5-3b7d76a27942 req-bc282b90-f463-4044-a3f5-fdb7c05749a7 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:44.156235 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-502dccca-43a3-4b7d-96c5-3b7d76a27942 req-bc282b90-f463-4044-a3f5-fdb7c05749a7 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:44.159282 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-502dccca-43a3-4b7d-96c5-3b7d76a27942 req-bc282b90-f463-4044-a3f5-fdb7c05749a7 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:44.203214 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-502dccca-43a3-4b7d-96c5-3b7d76a27942 req-bc282b90-f463-4044-a3f5-fdb7c05749a7 service nova] Creating event network-changed:1758f50b-5f5d-4ffb-9893-9d21dc63f5bd for instance acc886e0-c989-4105-8375-0c42d4e96404 on n-h1-master-1 Aug 07 01:19:44.209571 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-502dccca-43a3-4b7d-96c5-3b7d76a27942 req-bc282b90-f463-4044-a3f5-fdb7c05749a7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081460 Aug 07 01:19:44.211142 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1173/2096] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:44.228306 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a6ca1eb2-497b-4ee2-bad8-5ab75b4db639 tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] Calling method '.version_select at 0x7f9e247e7ee0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:44.238027 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-59d36bbc-edab-476c-87a0-d77da8b6a7f0 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:44.249065 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-59d36bbc-edab-476c-87a0-d77da8b6a7f0 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6" status: 200 len: 1328 microversion: 2.1 time: 0.415160 Aug 07 01:19:44.258635 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 924/2097] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:43 2022] GET /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 => generated 1328 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:44.302080 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-12d08083-4551-4d78-997a-ce240c008d8b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:44.303606 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-12d08083-4551-4d78-997a-ce240c008d8b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:44.314954 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12d08083-4551-4d78-997a-ce240c008d8b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:44.318828 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12d08083-4551-4d78-997a-ce240c008d8b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:44.319642 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12d08083-4551-4d78-997a-ce240c008d8b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:44.320620 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12d08083-4551-4d78-997a-ce240c008d8b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:44.321287 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12d08083-4551-4d78-997a-ce240c008d8b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:44.321725 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12d08083-4551-4d78-997a-ce240c008d8b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:44.884533 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-12d08083-4551-4d78-997a-ce240c008d8b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:44.888335 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:44.894536 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-12d08083-4551-4d78-997a-ce240c008d8b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1515 microversion: 2.1 time: 0.597093 Aug 07 01:19:44.918746 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 925/2098] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:44 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1515 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:45.146761 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-28aeb8ce-8cbf-4776-9496-9a23697619cf tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:45.147660 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-28aeb8ce-8cbf-4776-9496-9a23697619cf tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:45.155748 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28aeb8ce-8cbf-4776-9496-9a23697619cf tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:45.167023 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28aeb8ce-8cbf-4776-9496-9a23697619cf tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:45.167517 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28aeb8ce-8cbf-4776-9496-9a23697619cf tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:45.168343 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28aeb8ce-8cbf-4776-9496-9a23697619cf tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:45.169081 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28aeb8ce-8cbf-4776-9496-9a23697619cf tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:45.169424 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28aeb8ce-8cbf-4776-9496-9a23697619cf tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:45.728549 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a6ca1eb2-497b-4ee2-bad8-5ab75b4db639 tempest-SecurityGroupRulesTestJSON-780923801 tempest-SecurityGroupRulesTestJSON-780923801-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/fb4f728b-7e24-440d-aeb6-9bd18b200249" status: 202 len: 0 microversion: 2.1 time: 1.513404 Aug 07 01:19:45.729764 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1174/2099] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:19:44 2022] DELETE /compute/v2.1/os-security-groups/fb4f728b-7e24-440d-aeb6-9bd18b200249 => generated 0 bytes in 1518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:19:45.734661 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-515afcce-0dc0-4c06-828b-79aeea1ce8b3 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:45.736604 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-515afcce-0dc0-4c06-828b-79aeea1ce8b3 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:45.760965 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-515afcce-0dc0-4c06-828b-79aeea1ce8b3 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:45.761466 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-515afcce-0dc0-4c06-828b-79aeea1ce8b3 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:45.761913 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-515afcce-0dc0-4c06-828b-79aeea1ce8b3 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:45.762648 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-515afcce-0dc0-4c06-828b-79aeea1ce8b3 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:45.763111 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-515afcce-0dc0-4c06-828b-79aeea1ce8b3 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:45.763539 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-515afcce-0dc0-4c06-828b-79aeea1ce8b3 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:46.049432 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-28aeb8ce-8cbf-4776-9496-9a23697619cf tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:46.062990 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-28aeb8ce-8cbf-4776-9496-9a23697619cf tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1468 microversion: 2.1 time: 0.920230 Aug 07 01:19:46.068773 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 926/2100] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:45 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1468 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:46.080902 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-56c34723-df82-49e3-a62e-2538f79a0e83 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:46.083129 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-56c34723-df82-49e3-a62e-2538f79a0e83 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:46.154896 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-56c34723-df82-49e3-a62e-2538f79a0e83 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:46.158530 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-56c34723-df82-49e3-a62e-2538f79a0e83 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:46.163498 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-56c34723-df82-49e3-a62e-2538f79a0e83 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:46.164956 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-56c34723-df82-49e3-a62e-2538f79a0e83 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:46.165820 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-515afcce-0dc0-4c06-828b-79aeea1ce8b3 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:46.166526 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-56c34723-df82-49e3-a62e-2538f79a0e83 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:46.167704 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-56c34723-df82-49e3-a62e-2538f79a0e83 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:46.174912 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-515afcce-0dc0-4c06-828b-79aeea1ce8b3 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6" status: 200 len: 1328 microversion: 2.1 time: 0.443886 Aug 07 01:19:46.175509 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1175/2101] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:45 2022] GET /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 => generated 1328 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:46.215724 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-a0c5b7af-246f-43ac-87b5-e62db69ceabd req-90f872f1-6cb9-4550-8c91-1619dfbf9153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a4508ef-5167-4c2c-8bba-4a47c875263b", "name": "network-vif-plugged", "status": "completed", "tag": "2ce99914-7226-47ae-b72b-c5f4c2bc3fac"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:46.234614 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a0c5b7af-246f-43ac-87b5-e62db69ceabd req-90f872f1-6cb9-4550-8c91-1619dfbf9153 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:46.237455 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a0c5b7af-246f-43ac-87b5-e62db69ceabd req-90f872f1-6cb9-4550-8c91-1619dfbf9153 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:46.238117 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a0c5b7af-246f-43ac-87b5-e62db69ceabd req-90f872f1-6cb9-4550-8c91-1619dfbf9153 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:46.272844 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-a0c5b7af-246f-43ac-87b5-e62db69ceabd req-90f872f1-6cb9-4550-8c91-1619dfbf9153 service nova] Creating event network-vif-plugged:2ce99914-7226-47ae-b72b-c5f4c2bc3fac for instance 7a4508ef-5167-4c2c-8bba-4a47c875263b on n-h1-master-1 Aug 07 01:19:46.289412 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-a0c5b7af-246f-43ac-87b5-e62db69ceabd req-90f872f1-6cb9-4550-8c91-1619dfbf9153 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077745 Aug 07 01:19:46.290700 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1176/2102] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:19:46.526810 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-56c34723-df82-49e3-a62e-2538f79a0e83 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:46.549324 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-56c34723-df82-49e3-a62e-2538f79a0e83 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1515 microversion: 2.1 time: 0.479102 Aug 07 01:19:46.551490 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 927/2103] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:46 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1515 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:47.101038 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cb5fa31d-1620-4ce3-9b70-dc83b4499ab6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:47.103057 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cb5fa31d-1620-4ce3-9b70-dc83b4499ab6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:47.118429 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb5fa31d-1620-4ce3-9b70-dc83b4499ab6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:47.119481 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb5fa31d-1620-4ce3-9b70-dc83b4499ab6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:47.121315 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb5fa31d-1620-4ce3-9b70-dc83b4499ab6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:47.122266 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb5fa31d-1620-4ce3-9b70-dc83b4499ab6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:47.124720 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb5fa31d-1620-4ce3-9b70-dc83b4499ab6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:47.127597 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb5fa31d-1620-4ce3-9b70-dc83b4499ab6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:47.200070 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-385a6365-3827-4053-81b0-7ec535a0348d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:47.201486 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-385a6365-3827-4053-81b0-7ec535a0348d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:47.218964 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-385a6365-3827-4053-81b0-7ec535a0348d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:47.220286 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-385a6365-3827-4053-81b0-7ec535a0348d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:47.224292 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-385a6365-3827-4053-81b0-7ec535a0348d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:47.226766 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-385a6365-3827-4053-81b0-7ec535a0348d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:47.229312 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-385a6365-3827-4053-81b0-7ec535a0348d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:47.233558 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-385a6365-3827-4053-81b0-7ec535a0348d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:47.474734 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cb5fa31d-1620-4ce3-9b70-dc83b4499ab6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:47.493754 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cb5fa31d-1620-4ce3-9b70-dc83b4499ab6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 200 len: 1426 microversion: 2.1 time: 0.402105 Aug 07 01:19:47.494364 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1177/2104] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:47 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 1426 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:47.536295 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-385f98fa-0772-40b6-85c2-4e4edc775c5f req-f7fbec88-a016-4a74-8452-73992819c4fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a4508ef-5167-4c2c-8bba-4a47c875263b", "name": "network-vif-deleted", "tag": "2ce99914-7226-47ae-b72b-c5f4c2bc3fac"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:47.595963 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-385f98fa-0772-40b6-85c2-4e4edc775c5f req-f7fbec88-a016-4a74-8452-73992819c4fc service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:47.596904 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-385f98fa-0772-40b6-85c2-4e4edc775c5f req-f7fbec88-a016-4a74-8452-73992819c4fc service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:47.599199 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-385f98fa-0772-40b6-85c2-4e4edc775c5f req-f7fbec88-a016-4a74-8452-73992819c4fc service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:47.687157 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-385f98fa-0772-40b6-85c2-4e4edc775c5f req-f7fbec88-a016-4a74-8452-73992819c4fc service nova] Creating event network-vif-deleted:2ce99914-7226-47ae-b72b-c5f4c2bc3fac for instance 7a4508ef-5167-4c2c-8bba-4a47c875263b on n-h1-master-1 Aug 07 01:19:47.705311 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-385f98fa-0772-40b6-85c2-4e4edc775c5f req-f7fbec88-a016-4a74-8452-73992819c4fc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178087 Aug 07 01:19:47.706433 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1178/2105] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:47.712005 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-619ddfbd-9cca-4fe5-9808-ba952058d7f8 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:47.712875 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-619ddfbd-9cca-4fe5-9808-ba952058d7f8 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:47.720356 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-619ddfbd-9cca-4fe5-9808-ba952058d7f8 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:47.721015 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-619ddfbd-9cca-4fe5-9808-ba952058d7f8 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:47.721562 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-619ddfbd-9cca-4fe5-9808-ba952058d7f8 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:47.722781 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-619ddfbd-9cca-4fe5-9808-ba952058d7f8 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:47.723348 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-619ddfbd-9cca-4fe5-9808-ba952058d7f8 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:47.724475 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-619ddfbd-9cca-4fe5-9808-ba952058d7f8 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:47.765387 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-385a6365-3827-4053-81b0-7ec535a0348d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:47.776182 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-385a6365-3827-4053-81b0-7ec535a0348d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6" status: 200 len: 1328 microversion: 2.1 time: 0.582365 Aug 07 01:19:47.790001 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 928/2106] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:47 2022] GET /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 => generated 1328 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:19:48.061329 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-619ddfbd-9cca-4fe5-9808-ba952058d7f8 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:48.071134 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-619ddfbd-9cca-4fe5-9808-ba952058d7f8 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1515 microversion: 2.1 time: 0.363253 Aug 07 01:19:48.072054 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1179/2107] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:47 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1515 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:48.517233 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5ffe81c7-93e9-44ba-8d0d-958cbdca4a32 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:48.518878 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5ffe81c7-93e9-44ba-8d0d-958cbdca4a32 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 7a4508ef-5167-4c2c-8bba-4a47c875263b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:48.528292 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5ffe81c7-93e9-44ba-8d0d-958cbdca4a32 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:48.529139 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5ffe81c7-93e9-44ba-8d0d-958cbdca4a32 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:48.529791 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5ffe81c7-93e9-44ba-8d0d-958cbdca4a32 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:48.530631 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5ffe81c7-93e9-44ba-8d0d-958cbdca4a32 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:48.532185 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5ffe81c7-93e9-44ba-8d0d-958cbdca4a32 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:48.532745 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5ffe81c7-93e9-44ba-8d0d-958cbdca4a32 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:48.564218 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-5ffe81c7-93e9-44ba-8d0d-958cbdca4a32 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] HTTP exception thrown: Instance 7a4508ef-5167-4c2c-8bba-4a47c875263b could not be found. Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5ffe81c7-93e9-44ba-8d0d-958cbdca4a32 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Request method failure captured: Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b HTTP/1.1 Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xGmBnM-sERHAF-yu4khVKHIk2FjJpwXHxpgOZFrdD5mWdYp38Q2IHVkblSiYcv1-_Wi-z3JVqsUP8zzujCNqQAX5xw8YLKxnrFzevVpXC3hZLNyJG2lkq83P2rkmx7ByVUEwPjOWj9Ti_q1HizAI9hlxMbhb5Nb4jiCnSs9xuMpTwQ Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 1911abc893ef4c01aa80ca9079dea6e9 Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-MigrationsAdminTest-2018910474 Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1911abc893ef4c01aa80ca9079dea6e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1911abc893ef4c01aa80ca9079dea6e9", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1911abc893ef4c01aa80ca9079dea6e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1911abc893ef4c01aa80ca9079dea6e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-MigrationsAdminTest-2018910474 Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 1911abc893ef4c01aa80ca9079dea6e9 Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-MigrationsAdminTest-2018910474 Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-MigrationsAdminTest-2018910474-project Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: b945db9a6f7a4143a544b76be5e9af9f Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-MigrationsAdminTest-2018910474-project Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 7a4508ef-5167-4c2c-8bba-4a47c875263b could not be found. Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '7a4508ef-5167-4c2c-8bba-4a47c875263b'} Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a4508ef-5167-4c2c-8bba-4a47c875263b could not be found. Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a4508ef-5167-4c2c-8bba-4a47c875263b could not be found. Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:19:48.571496 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:19:48.577147 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:48.577147 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:19:48.577147 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:19:48.577147 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:19:48.577147 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:19:48.577147 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a4508ef-5167-4c2c-8bba-4a47c875263b could not be found. Aug 07 01:19:48.577147 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:19:48.580161 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5ffe81c7-93e9-44ba-8d0d-958cbdca4a32 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Returning 404 to user: Instance 7a4508ef-5167-4c2c-8bba-4a47c875263b could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:19:48.580161 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5ffe81c7-93e9-44ba-8d0d-958cbdca4a32 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b" status: 404 len: 111 microversion: 2.1 time: 0.066641 Aug 07 01:19:48.580388 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1180/2108] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:48 2022] GET /compute/v2.1/servers/7a4508ef-5167-4c2c-8bba-4a47c875263b => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:19:48.597275 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ee1466b8-7071-4830-9636-a01fe632e43f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:48.600096 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ee1466b8-7071-4830-9636-a01fe632e43f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:48.613967 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee1466b8-7071-4830-9636-a01fe632e43f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:48.616332 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee1466b8-7071-4830-9636-a01fe632e43f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:48.617417 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee1466b8-7071-4830-9636-a01fe632e43f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:48.619197 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee1466b8-7071-4830-9636-a01fe632e43f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:48.620092 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee1466b8-7071-4830-9636-a01fe632e43f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:48.622142 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee1466b8-7071-4830-9636-a01fe632e43f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:48.689320 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ee1466b8-7071-4830-9636-a01fe632e43f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:19:48.723319 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4bb96f35-3d16-4273-a05e-8390e8ddf760 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Action: 'create', calling method: .version_select at 0x7f9e17ef8b80>, body: {"keypair": {"name": "tempest-keypair-1266733088", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmh0mRCqxPk/jdbF8Be3XBW/0H89beH9q2AMtnO/tD/3rqzj4AbPI5BmcncorplmTRJNvV12Z5cmWBOB+rGwez8pzfne4o3B5lEmutwRpU3Z6gYdJy29BuC5dvEA1QAeA=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:48.767375 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-4bb96f35-3d16-4273-a05e-8390e8ddf760 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Getting quotas for project 5897e4c216e646aaa3a4c9ec2c7a1cfb. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:19:48.785641 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-4bb96f35-3d16-4273-a05e-8390e8ddf760 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Getting quotas for user 80f8680c2a39400c8fcfc221872fa299 and project 5897e4c216e646aaa3a4c9ec2c7a1cfb. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:19:48.832439 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4bb96f35-3d16-4273-a05e-8390e8ddf760 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.567174 Aug 07 01:19:48.833069 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 929/2109] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:19:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:48.839500 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a382d04c-7463-444e-88ee-ce89c9ce9f7e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:48.842612 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a382d04c-7463-444e-88ee-ce89c9ce9f7e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:48.859100 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:48.864873 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ee1466b8-7071-4830-9636-a01fe632e43f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "DELETE /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 204 len: 0 microversion: 2.1 time: 0.278992 Aug 07 01:19:48.866692 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1181/2110] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:19:48 2022] DELETE /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:19:48.884859 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8d3d81dd-62a5-47fb-9428-f06f6199c779 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:48.885620 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8d3d81dd-62a5-47fb-9428-f06f6199c779 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:48.887618 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a382d04c-7463-444e-88ee-ce89c9ce9f7e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:48.888294 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a382d04c-7463-444e-88ee-ce89c9ce9f7e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:48.888750 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a382d04c-7463-444e-88ee-ce89c9ce9f7e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:48.893264 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a382d04c-7463-444e-88ee-ce89c9ce9f7e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:48.893848 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a382d04c-7463-444e-88ee-ce89c9ce9f7e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:48.894300 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a382d04c-7463-444e-88ee-ce89c9ce9f7e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:48.909783 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d3d81dd-62a5-47fb-9428-f06f6199c779 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:48.911838 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d3d81dd-62a5-47fb-9428-f06f6199c779 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:48.913212 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d3d81dd-62a5-47fb-9428-f06f6199c779 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:48.916192 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d3d81dd-62a5-47fb-9428-f06f6199c779 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:48.916734 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d3d81dd-62a5-47fb-9428-f06f6199c779 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:48.917189 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d3d81dd-62a5-47fb-9428-f06f6199c779 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:49.177949 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a382d04c-7463-444e-88ee-ce89c9ce9f7e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:49.193247 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a382d04c-7463-444e-88ee-ce89c9ce9f7e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6" status: 200 len: 1328 microversion: 2.1 time: 0.358071 Aug 07 01:19:49.196027 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 930/2111] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:48 2022] GET /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 => generated 1328 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:49.210715 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8e7b8d83-6b33-495d-a764-fa3b7a3cc5b5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:49.212081 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8e7b8d83-6b33-495d-a764-fa3b7a3cc5b5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:49.225363 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8e7b8d83-6b33-495d-a764-fa3b7a3cc5b5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:49.226221 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8e7b8d83-6b33-495d-a764-fa3b7a3cc5b5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:49.226835 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8e7b8d83-6b33-495d-a764-fa3b7a3cc5b5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:49.228112 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8e7b8d83-6b33-495d-a764-fa3b7a3cc5b5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:49.229092 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8e7b8d83-6b33-495d-a764-fa3b7a3cc5b5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:49.242972 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8e7b8d83-6b33-495d-a764-fa3b7a3cc5b5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:49.464435 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8d3d81dd-62a5-47fb-9428-f06f6199c779 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:49.475490 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8d3d81dd-62a5-47fb-9428-f06f6199c779 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1535 microversion: 2.1 time: 0.603044 Aug 07 01:19:49.491220 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1182/2112] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:48 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1535 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:49.659310 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8e7b8d83-6b33-495d-a764-fa3b7a3cc5b5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:49.675169 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8e7b8d83-6b33-495d-a764-fa3b7a3cc5b5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1515 microversion: 2.1 time: 0.474712 Aug 07 01:19:49.679630 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 931/2113] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:49 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1515 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:49.775493 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-b96595eb-5ff0-4a31-a912-f797d3425c41 req-dcce0c06-bdca-4865-ac81-afba5b62b80b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6", "name": "network-vif-plugged", "status": "completed", "tag": "b8a3f4d6-7cbf-4e51-8a06-62bb6fe91f7d"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:49.818198 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b96595eb-5ff0-4a31-a912-f797d3425c41 req-dcce0c06-bdca-4865-ac81-afba5b62b80b service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:49.819875 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b96595eb-5ff0-4a31-a912-f797d3425c41 req-dcce0c06-bdca-4865-ac81-afba5b62b80b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:49.824278 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b96595eb-5ff0-4a31-a912-f797d3425c41 req-dcce0c06-bdca-4865-ac81-afba5b62b80b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:49.861805 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-b96595eb-5ff0-4a31-a912-f797d3425c41 req-dcce0c06-bdca-4865-ac81-afba5b62b80b service nova] Creating event network-vif-plugged:b8a3f4d6-7cbf-4e51-8a06-62bb6fe91f7d for instance 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 on n-h1-master-1 Aug 07 01:19:49.879648 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-b96595eb-5ff0-4a31-a912-f797d3425c41 req-dcce0c06-bdca-4865-ac81-afba5b62b80b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106386 Aug 07 01:19:49.881110 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1183/2114] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:50.222649 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e33efddb-27f5-4b24-b2fc-a2cfd6197902 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:50.230731 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e33efddb-27f5-4b24-b2fc-a2cfd6197902 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:50.247674 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e33efddb-27f5-4b24-b2fc-a2cfd6197902 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:50.248627 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e33efddb-27f5-4b24-b2fc-a2cfd6197902 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:50.249234 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e33efddb-27f5-4b24-b2fc-a2cfd6197902 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:50.252636 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e33efddb-27f5-4b24-b2fc-a2cfd6197902 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:50.253125 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e33efddb-27f5-4b24-b2fc-a2cfd6197902 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:50.253574 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e33efddb-27f5-4b24-b2fc-a2cfd6197902 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:50.505199 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e33efddb-27f5-4b24-b2fc-a2cfd6197902 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:50.507846 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cbf00afe-6c1d-4592-82e0-0d2ee2649109 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:50.508733 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cbf00afe-6c1d-4592-82e0-0d2ee2649109 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:50.517176 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e33efddb-27f5-4b24-b2fc-a2cfd6197902 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6" status: 200 len: 1328 microversion: 2.1 time: 0.298768 Aug 07 01:19:50.518589 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 932/2115] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:50 2022] GET /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 => generated 1328 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:50.535724 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cbf00afe-6c1d-4592-82e0-0d2ee2649109 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:50.537038 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cbf00afe-6c1d-4592-82e0-0d2ee2649109 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:50.537996 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cbf00afe-6c1d-4592-82e0-0d2ee2649109 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:50.538871 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cbf00afe-6c1d-4592-82e0-0d2ee2649109 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:50.539494 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cbf00afe-6c1d-4592-82e0-0d2ee2649109 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:50.540276 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cbf00afe-6c1d-4592-82e0-0d2ee2649109 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:50.705162 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-172ca640-333b-4067-9961-eac1c613de8e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:50.705162 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-172ca640-333b-4067-9961-eac1c613de8e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:50.730018 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-172ca640-333b-4067-9961-eac1c613de8e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:50.731462 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-172ca640-333b-4067-9961-eac1c613de8e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:50.732491 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-172ca640-333b-4067-9961-eac1c613de8e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:50.736577 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-172ca640-333b-4067-9961-eac1c613de8e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:50.737340 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-172ca640-333b-4067-9961-eac1c613de8e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:50.737959 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-172ca640-333b-4067-9961-eac1c613de8e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:50.874558 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cbf00afe-6c1d-4592-82e0-0d2ee2649109 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:50.885179 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cbf00afe-6c1d-4592-82e0-0d2ee2649109 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1535 microversion: 2.1 time: 0.387659 Aug 07 01:19:50.902859 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1184/2116] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:50 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1535 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:51.466179 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a85cade9-dcca-46d2-9cce-7567a2facde6 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-199898331", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:51.542070 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-a85cade9-dcca-46d2-9cce-7567a2facde6 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] validate_networks() for None {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:19:51.766931 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-172ca640-333b-4067-9961-eac1c613de8e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:51.781333 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-172ca640-333b-4067-9961-eac1c613de8e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1515 microversion: 2.1 time: 1.083874 Aug 07 01:19:51.782827 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 933/2117] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:50 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1515 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:19:51.802238 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d0263c85-4a2e-4d0d-8b53-8a3f5e0ac169 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:51.803142 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d0263c85-4a2e-4d0d-8b53-8a3f5e0ac169 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:51.823623 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d0263c85-4a2e-4d0d-8b53-8a3f5e0ac169 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:51.825727 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d0263c85-4a2e-4d0d-8b53-8a3f5e0ac169 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:51.828452 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d0263c85-4a2e-4d0d-8b53-8a3f5e0ac169 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:51.831090 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d0263c85-4a2e-4d0d-8b53-8a3f5e0ac169 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:51.832307 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d0263c85-4a2e-4d0d-8b53-8a3f5e0ac169 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:51.836463 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d0263c85-4a2e-4d0d-8b53-8a3f5e0ac169 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:51.867244 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-a85cade9-dcca-46d2-9cce-7567a2facde6 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:19:51.867936 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-a85cade9-dcca-46d2-9cce-7567a2facde6 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:19:51.868527 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-a85cade9-dcca-46d2-9cce-7567a2facde6 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:19:51.869332 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-a85cade9-dcca-46d2-9cce-7567a2facde6 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:19:51.869828 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-a85cade9-dcca-46d2-9cce-7567a2facde6 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:19:51.883084 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a85cade9-dcca-46d2-9cce-7567a2facde6 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:51.883729 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a85cade9-dcca-46d2-9cce-7567a2facde6 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:51.884168 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a85cade9-dcca-46d2-9cce-7567a2facde6 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:51.885636 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a85cade9-dcca-46d2-9cce-7567a2facde6 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:51.886349 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a85cade9-dcca-46d2-9cce-7567a2facde6 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:51.887001 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a85cade9-dcca-46d2-9cce-7567a2facde6 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:51.912296 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-a85cade9-dcca-46d2-9cce-7567a2facde6 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Getting quotas for project 622262beb7574e388c20207cccd5073d. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:19:51.918818 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-a85cade9-dcca-46d2-9cce-7567a2facde6 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Getting quotas for user 81d0e7a058704483bbad57ef73de92e6 and project 622262beb7574e388c20207cccd5073d. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:19:51.942577 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a85cade9-dcca-46d2-9cce-7567a2facde6 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:19:51.945592 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a85cade9-dcca-46d2-9cce-7567a2facde6 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] [instance: 18856f67-eebe-4c6a-89bc-4a2e60408d2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:19:52.039900 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a85cade9-dcca-46d2-9cce-7567a2facde6 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.846286 Aug 07 01:19:52.045193 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1185/2118] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:19:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:19:52.053622 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-50ef2dce-38a2-452f-bf1a-f064779bc7c5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:52.055796 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-50ef2dce-38a2-452f-bf1a-f064779bc7c5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:52.065126 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-50ef2dce-38a2-452f-bf1a-f064779bc7c5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:52.069949 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-50ef2dce-38a2-452f-bf1a-f064779bc7c5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:52.070750 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-50ef2dce-38a2-452f-bf1a-f064779bc7c5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:52.071739 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-50ef2dce-38a2-452f-bf1a-f064779bc7c5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:52.072455 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-50ef2dce-38a2-452f-bf1a-f064779bc7c5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:52.074199 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-50ef2dce-38a2-452f-bf1a-f064779bc7c5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:52.241580 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d0263c85-4a2e-4d0d-8b53-8a3f5e0ac169 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:52.257836 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d0263c85-4a2e-4d0d-8b53-8a3f5e0ac169 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6" status: 200 len: 1508 microversion: 2.1 time: 0.472386 Aug 07 01:19:52.258783 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 934/2119] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:51 2022] GET /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 => generated 1508 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:52.266721 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bd90f121-19d8-496d-90bb-069d61ec2e29 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:52.267779 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bd90f121-19d8-496d-90bb-069d61ec2e29 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] [instance: 18856f67-eebe-4c6a-89bc-4a2e60408d2e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:52.401215 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bd90f121-19d8-496d-90bb-069d61ec2e29 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0e7a058704483bbad57ef73de92e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622262beb7574e388c20207cccd5073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:52.411798 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bd90f121-19d8-496d-90bb-069d61ec2e29 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] 10.222.0.39 "GET /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e" status: 200 len: 1221 microversion: 2.1 time: 0.151251 Aug 07 01:19:52.416641 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 935/2120] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:52 2022] GET /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e => generated 1221 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:52.430402 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-20906811-5d5f-4b25-96ae-d163b79b3ed8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:52.431174 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-20906811-5d5f-4b25-96ae-d163b79b3ed8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:52.446815 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-20906811-5d5f-4b25-96ae-d163b79b3ed8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:52.450422 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-20906811-5d5f-4b25-96ae-d163b79b3ed8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:52.459237 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-20906811-5d5f-4b25-96ae-d163b79b3ed8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:52.460931 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-20906811-5d5f-4b25-96ae-d163b79b3ed8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:52.465285 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-20906811-5d5f-4b25-96ae-d163b79b3ed8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:52.465795 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-20906811-5d5f-4b25-96ae-d163b79b3ed8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:52.665628 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-50ef2dce-38a2-452f-bf1a-f064779bc7c5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:52.677141 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-50ef2dce-38a2-452f-bf1a-f064779bc7c5 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 200 len: 1535 microversion: 2.1 time: 0.630516 Aug 07 01:19:52.686552 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1186/2121] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:52 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 1535 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:52.813207 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7bd7e4fa-67d2-4d3b-8555-4993ac57459f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:52.818892 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7bd7e4fa-67d2-4d3b-8555-4993ac57459f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:52.841258 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7bd7e4fa-67d2-4d3b-8555-4993ac57459f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:52.846458 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7bd7e4fa-67d2-4d3b-8555-4993ac57459f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:52.848723 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7bd7e4fa-67d2-4d3b-8555-4993ac57459f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:52.849694 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7bd7e4fa-67d2-4d3b-8555-4993ac57459f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:52.855544 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7bd7e4fa-67d2-4d3b-8555-4993ac57459f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:52.856127 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7bd7e4fa-67d2-4d3b-8555-4993ac57459f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:52.878270 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-20906811-5d5f-4b25-96ae-d163b79b3ed8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:52.894307 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-20906811-5d5f-4b25-96ae-d163b79b3ed8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6" status: 200 len: 1508 microversion: 2.1 time: 0.476046 Aug 07 01:19:52.894914 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 936/2122] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:52 2022] GET /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 => generated 1508 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:52.921028 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-399bee99-7797-474c-a96c-0bd9f5475309 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:52.942729 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-399bee99-7797-474c-a96c-0bd9f5475309 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:52.974061 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-399bee99-7797-474c-a96c-0bd9f5475309 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:52.974248 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-399bee99-7797-474c-a96c-0bd9f5475309 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:52.974942 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-399bee99-7797-474c-a96c-0bd9f5475309 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:52.979411 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-399bee99-7797-474c-a96c-0bd9f5475309 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:52.986657 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-399bee99-7797-474c-a96c-0bd9f5475309 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:52.987355 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-399bee99-7797-474c-a96c-0bd9f5475309 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:53.113710 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-399bee99-7797-474c-a96c-0bd9f5475309 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:19:53.363552 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-399bee99-7797-474c-a96c-0bd9f5475309 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6" status: 204 len: 0 microversion: 2.1 time: 0.446177 Aug 07 01:19:53.364614 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 937/2123] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:19:52 2022] DELETE /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:19:53.375806 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-0bf720b1-c122-41f4-924a-4bf4191221fd req-634aeafb-3183-4e1f-8761-336302adae7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd1e4cce-7a53-4200-a2c1-dcabbb7f9544", "name": "network-vif-deleted", "tag": "ee124f30-41ef-4d88-b49e-4ad7cac50168"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:53.396657 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0bf720b1-c122-41f4-924a-4bf4191221fd req-634aeafb-3183-4e1f-8761-336302adae7a service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:53.397159 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0bf720b1-c122-41f4-924a-4bf4191221fd req-634aeafb-3183-4e1f-8761-336302adae7a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:53.397635 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0bf720b1-c122-41f4-924a-4bf4191221fd req-634aeafb-3183-4e1f-8761-336302adae7a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:53.445395 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-0bf720b1-c122-41f4-924a-4bf4191221fd req-634aeafb-3183-4e1f-8761-336302adae7a service nova] Creating event network-vif-deleted:ee124f30-41ef-4d88-b49e-4ad7cac50168 for instance dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 on n-h2-master-1 Aug 07 01:19:53.458542 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-0bf720b1-c122-41f4-924a-4bf4191221fd req-634aeafb-3183-4e1f-8761-336302adae7a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091539 Aug 07 01:19:53.462932 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 938/2124] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:53.471673 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-13ce02ff-6165-4bd0-8453-3054daf57b4a tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1326150317", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "e423a9bd-7a6a-46a2-9fc3-c39b1de1fb47"}], "security_groups": [{"name": "tempest-securitygroup--1462987600"}], "key_name": "tempest-keypair-1266733088", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:53.532329 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7bd7e4fa-67d2-4d3b-8555-4993ac57459f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:53.557943 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7bd7e4fa-67d2-4d3b-8555-4993ac57459f tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1515 microversion: 2.1 time: 0.741515 Aug 07 01:19:53.576576 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1187/2125] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:52 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1515 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:53.582544 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7697a554-1cc3-4614-8cbd-5751e6130d49 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:53.583189 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7697a554-1cc3-4614-8cbd-5751e6130d49 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:53.616432 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7697a554-1cc3-4614-8cbd-5751e6130d49 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:53.619915 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7697a554-1cc3-4614-8cbd-5751e6130d49 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:53.620631 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7697a554-1cc3-4614-8cbd-5751e6130d49 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:53.622790 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7697a554-1cc3-4614-8cbd-5751e6130d49 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:53.623484 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7697a554-1cc3-4614-8cbd-5751e6130d49 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:53.625560 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7697a554-1cc3-4614-8cbd-5751e6130d49 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:53.672895 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-13ce02ff-6165-4bd0-8453-3054daf57b4a tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] validate_networks() for [('e423a9bd-7a6a-46a2-9fc3-c39b1de1fb47', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:19:54.336200 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7697a554-1cc3-4614-8cbd-5751e6130d49 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:54.345121 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7697a554-1cc3-4614-8cbd-5751e6130d49 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6" status: 200 len: 1514 microversion: 2.1 time: 0.766515 Aug 07 01:19:54.345826 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1188/2126] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:53 2022] GET /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 => generated 1514 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:54.363856 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-395f6ac5-cc24-4f93-ae05-5bf402df7f74 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:54.364705 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-395f6ac5-cc24-4f93-ae05-5bf402df7f74 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] [instance: 18856f67-eebe-4c6a-89bc-4a2e60408d2e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:54.372063 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-395f6ac5-cc24-4f93-ae05-5bf402df7f74 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:54.372851 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-395f6ac5-cc24-4f93-ae05-5bf402df7f74 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:54.373477 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-395f6ac5-cc24-4f93-ae05-5bf402df7f74 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:54.374472 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-395f6ac5-cc24-4f93-ae05-5bf402df7f74 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:54.375149 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-395f6ac5-cc24-4f93-ae05-5bf402df7f74 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:54.375793 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-395f6ac5-cc24-4f93-ae05-5bf402df7f74 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:54.380452 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-13ce02ff-6165-4bd0-8453-3054daf57b4a tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Getting quotas for project 5897e4c216e646aaa3a4c9ec2c7a1cfb. Resources: dict_keys(['metadata_items']) {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:19:54.380994 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:54.384444 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:54.388977 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-13ce02ff-6165-4bd0-8453-3054daf57b4a tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Getting quotas for user 80f8680c2a39400c8fcfc221872fa299 and project 5897e4c216e646aaa3a4c9ec2c7a1cfb. Resources: dict_keys(['metadata_items']) {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:19:54.408412 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-13ce02ff-6165-4bd0-8453-3054daf57b4a tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:19:54.409343 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-13ce02ff-6165-4bd0-8453-3054daf57b4a tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:19:54.410066 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-13ce02ff-6165-4bd0-8453-3054daf57b4a tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:19:54.410755 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-13ce02ff-6165-4bd0-8453-3054daf57b4a tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:19:54.411402 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-13ce02ff-6165-4bd0-8453-3054daf57b4a tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:19:54.422861 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13ce02ff-6165-4bd0-8453-3054daf57b4a tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:54.424150 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13ce02ff-6165-4bd0-8453-3054daf57b4a tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:54.424150 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13ce02ff-6165-4bd0-8453-3054daf57b4a tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:54.424898 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13ce02ff-6165-4bd0-8453-3054daf57b4a tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:54.425468 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13ce02ff-6165-4bd0-8453-3054daf57b4a tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:54.426012 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13ce02ff-6165-4bd0-8453-3054daf57b4a tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:54.458925 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-395f6ac5-cc24-4f93-ae05-5bf402df7f74 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0e7a058704483bbad57ef73de92e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622262beb7574e388c20207cccd5073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:54.468828 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-13ce02ff-6165-4bd0-8453-3054daf57b4a tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Getting quotas for project 5897e4c216e646aaa3a4c9ec2c7a1cfb. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:19:54.480266 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-395f6ac5-cc24-4f93-ae05-5bf402df7f74 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] 10.222.0.39 "GET /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e" status: 200 len: 1225 microversion: 2.1 time: 0.122939 Aug 07 01:19:54.481405 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1189/2127] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:54 2022] GET /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e => generated 1225 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:54.481570 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-13ce02ff-6165-4bd0-8453-3054daf57b4a tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Getting quotas for user 80f8680c2a39400c8fcfc221872fa299 and project 5897e4c216e646aaa3a4c9ec2c7a1cfb. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:19:54.498662 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bd49374c-fd4f-4d46-a1d9-6f77b69d955f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:54.499688 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bd49374c-fd4f-4d46-a1d9-6f77b69d955f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: dd1e4cce-7a53-4200-a2c1-dcabbb7f9544] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:54.505663 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-13ce02ff-6165-4bd0-8453-3054daf57b4a tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:19:54.508055 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd49374c-fd4f-4d46-a1d9-6f77b69d955f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:54.509313 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd49374c-fd4f-4d46-a1d9-6f77b69d955f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:54.509750 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-13ce02ff-6165-4bd0-8453-3054daf57b4a tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] [instance: 2de58a4c-7601-40e2-a4dc-073e102b659f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:19:54.521610 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd49374c-fd4f-4d46-a1d9-6f77b69d955f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:54.522554 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd49374c-fd4f-4d46-a1d9-6f77b69d955f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:54.523255 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd49374c-fd4f-4d46-a1d9-6f77b69d955f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:54.524792 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd49374c-fd4f-4d46-a1d9-6f77b69d955f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:54.554640 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-bd49374c-fd4f-4d46-a1d9-6f77b69d955f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] HTTP exception thrown: Instance dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 could not be found. Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bd49374c-fd4f-4d46-a1d9-6f77b69d955f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Request method failure captured: Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 HTTP/1.1 Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xGmBnM-sERHAF-yu4khVKHIk2FjJpwXHxpgOZFrdD5mWdYp38Q2IHVkblSiYcv1-_Wi-z3JVqsUP8zzujCNqQAX5xw8YLKxnrFzevVpXC3hZLNyJG2lkq83P2rkmx7ByVUEwPjOWj9Ti_q1HizAI9hlxMbhb5Nb4jiCnSs9xuMpTwQ Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 1911abc893ef4c01aa80ca9079dea6e9 Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-MigrationsAdminTest-2018910474 Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1911abc893ef4c01aa80ca9079dea6e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1911abc893ef4c01aa80ca9079dea6e9", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1911abc893ef4c01aa80ca9079dea6e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1911abc893ef4c01aa80ca9079dea6e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-MigrationsAdminTest-2018910474 Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 1911abc893ef4c01aa80ca9079dea6e9 Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-MigrationsAdminTest-2018910474 Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-MigrationsAdminTest-2018910474-project Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: b945db9a6f7a4143a544b76be5e9af9f Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-MigrationsAdminTest-2018910474-project Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: exception: Instance dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 could not be found. Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'dd1e4cce-7a53-4200-a2c1-dcabbb7f9544'} Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 could not be found. Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 could not be found. Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:19:54.566787 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:19:54.572319 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:54.572319 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:19:54.572319 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:19:54.572319 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:19:54.572319 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:19:54.572319 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 could not be found. Aug 07 01:19:54.572319 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:19:54.572319 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bd49374c-fd4f-4d46-a1d9-6f77b69d955f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Returning 404 to user: Instance dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:19:54.572319 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bd49374c-fd4f-4d46-a1d9-6f77b69d955f tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544" status: 404 len: 111 microversion: 2.1 time: 0.085452 Aug 07 01:19:54.572319 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1190/2128] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:54 2022] GET /compute/v2.1/servers/dd1e4cce-7a53-4200-a2c1-dcabbb7f9544 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:19:54.579100 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0eda525e-26c5-48ff-a39e-fb2266d0f58b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '.version_select at 0x7f9e248414c0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:54.593097 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-13ce02ff-6165-4bd0-8453-3054daf57b4a tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.128417 Aug 07 01:19:54.594100 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 939/2129] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:19:53 2022] POST /compute/v2.1/servers => generated 407 bytes in 1130 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:19:54.599675 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1c84cbc4-df07-4731-8b33-8b70b9c2c55c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:54.600322 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1c84cbc4-df07-4731-8b33-8b70b9c2c55c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:54.609259 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c84cbc4-df07-4731-8b33-8b70b9c2c55c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:54.609778 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c84cbc4-df07-4731-8b33-8b70b9c2c55c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:54.610213 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c84cbc4-df07-4731-8b33-8b70b9c2c55c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:54.610923 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c84cbc4-df07-4731-8b33-8b70b9c2c55c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:54.611539 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c84cbc4-df07-4731-8b33-8b70b9c2c55c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:54.611990 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c84cbc4-df07-4731-8b33-8b70b9c2c55c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:54.628676 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0eda525e-26c5-48ff-a39e-fb2266d0f58b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-298687927" status: 202 len: 0 microversion: 2.1 time: 0.054839 Aug 07 01:19:54.629850 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1191/2130] 10.222.0.39 () {58 vars in 1218 bytes} [Sun Aug 7 01:19:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-298687927 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:19:54.638392 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1fd6bd41-5bbe-40d7-89b0-5ae77d7b7bed tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:54.639037 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1fd6bd41-5bbe-40d7-89b0-5ae77d7b7bed tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] [instance: 2de58a4c-7601-40e2-a4dc-073e102b659f] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:54.749311 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1fd6bd41-5bbe-40d7-89b0-5ae77d7b7bed tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f8680c2a39400c8fcfc221872fa299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5897e4c216e646aaa3a4c9ec2c7a1cfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:54.761176 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1fd6bd41-5bbe-40d7-89b0-5ae77d7b7bed tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] 10.222.0.39 "GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f" status: 200 len: 1270 microversion: 2.1 time: 0.128866 Aug 07 01:19:54.762377 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1192/2131] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:54 2022] GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f => generated 1270 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:55.042362 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1c84cbc4-df07-4731-8b33-8b70b9c2c55c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:55.052508 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1c84cbc4-df07-4731-8b33-8b70b9c2c55c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1515 microversion: 2.1 time: 0.457290 Aug 07 01:19:55.056959 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 940/2132] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:54 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1515 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:55.403902 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-61d1a801-caab-445b-a901-b9bd1c145b1c tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:55.403902 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-61d1a801-caab-445b-a901-b9bd1c145b1c tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:55.424109 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-61d1a801-caab-445b-a901-b9bd1c145b1c tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:55.425048 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-61d1a801-caab-445b-a901-b9bd1c145b1c tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:55.425545 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-61d1a801-caab-445b-a901-b9bd1c145b1c tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:55.428775 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-61d1a801-caab-445b-a901-b9bd1c145b1c tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:55.429293 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-61d1a801-caab-445b-a901-b9bd1c145b1c tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:55.429725 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-61d1a801-caab-445b-a901-b9bd1c145b1c tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:55.505937 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5538eb07-9b6e-4aca-93b0-fe9312fd3fa8 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:55.506602 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5538eb07-9b6e-4aca-93b0-fe9312fd3fa8 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] [instance: 18856f67-eebe-4c6a-89bc-4a2e60408d2e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:55.518120 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5538eb07-9b6e-4aca-93b0-fe9312fd3fa8 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:55.518625 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5538eb07-9b6e-4aca-93b0-fe9312fd3fa8 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:55.519073 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5538eb07-9b6e-4aca-93b0-fe9312fd3fa8 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:55.519813 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5538eb07-9b6e-4aca-93b0-fe9312fd3fa8 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:55.534094 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5538eb07-9b6e-4aca-93b0-fe9312fd3fa8 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:55.535226 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5538eb07-9b6e-4aca-93b0-fe9312fd3fa8 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:55.690851 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5538eb07-9b6e-4aca-93b0-fe9312fd3fa8 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0e7a058704483bbad57ef73de92e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622262beb7574e388c20207cccd5073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:55.705278 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5538eb07-9b6e-4aca-93b0-fe9312fd3fa8 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] 10.222.0.39 "GET /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e" status: 200 len: 1281 microversion: 2.1 time: 0.203435 Aug 07 01:19:55.706228 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 941/2133] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:55 2022] GET /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e => generated 1281 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:55.788400 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2c323810-f540-4028-bb14-41728a4fefc7 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:55.788400 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2c323810-f540-4028-bb14-41728a4fefc7 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] [instance: 2de58a4c-7601-40e2-a4dc-073e102b659f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:55.798908 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c323810-f540-4028-bb14-41728a4fefc7 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:55.804700 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c323810-f540-4028-bb14-41728a4fefc7 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:55.805397 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c323810-f540-4028-bb14-41728a4fefc7 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:55.806483 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c323810-f540-4028-bb14-41728a4fefc7 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:55.807355 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c323810-f540-4028-bb14-41728a4fefc7 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:55.808146 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c323810-f540-4028-bb14-41728a4fefc7 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:55.962551 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-61d1a801-caab-445b-a901-b9bd1c145b1c tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:55.988591 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-61d1a801-caab-445b-a901-b9bd1c145b1c tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6" status: 200 len: 1514 microversion: 2.1 time: 0.614253 Aug 07 01:19:55.996370 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1193/2134] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:55 2022] GET /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 => generated 1514 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:56.033235 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2c323810-f540-4028-bb14-41728a4fefc7 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f8680c2a39400c8fcfc221872fa299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5897e4c216e646aaa3a4c9ec2c7a1cfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:56.042107 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2c323810-f540-4028-bb14-41728a4fefc7 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] 10.222.0.39 "GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f" status: 200 len: 1266 microversion: 2.1 time: 0.259988 Aug 07 01:19:56.044075 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 942/2135] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:55 2022] GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:56.081316 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6ff33878-5f88-4d27-80e0-55224921147b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:56.082487 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6ff33878-5f88-4d27-80e0-55224921147b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:56.105311 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ff33878-5f88-4d27-80e0-55224921147b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:56.106888 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ff33878-5f88-4d27-80e0-55224921147b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:56.108005 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ff33878-5f88-4d27-80e0-55224921147b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:56.112490 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ff33878-5f88-4d27-80e0-55224921147b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:56.113147 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ff33878-5f88-4d27-80e0-55224921147b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:56.113610 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ff33878-5f88-4d27-80e0-55224921147b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:56.207404 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2b431e15-58cf-41c8-81cd-c479b93a5579 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:56.207949 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2b431e15-58cf-41c8-81cd-c479b93a5579 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:56.218724 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b431e15-58cf-41c8-81cd-c479b93a5579 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:56.219733 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b431e15-58cf-41c8-81cd-c479b93a5579 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:56.220207 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b431e15-58cf-41c8-81cd-c479b93a5579 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:56.223940 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b431e15-58cf-41c8-81cd-c479b93a5579 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:56.223940 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b431e15-58cf-41c8-81cd-c479b93a5579 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:56.223940 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b431e15-58cf-41c8-81cd-c479b93a5579 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:56.272707 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2b431e15-58cf-41c8-81cd-c479b93a5579 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:19:56.319005 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:56.399782 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2b431e15-58cf-41c8-81cd-c479b93a5579 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "DELETE /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 204 len: 0 microversion: 2.1 time: 0.195454 Aug 07 01:19:56.403544 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 943/2136] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:19:56 2022] DELETE /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:19:56.417597 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cf3e7666-a738-4751-83eb-2436af5840d6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:56.420310 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-cf3e7666-a738-4751-83eb-2436af5840d6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:56.440555 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cf3e7666-a738-4751-83eb-2436af5840d6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:56.442195 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cf3e7666-a738-4751-83eb-2436af5840d6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:56.442860 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cf3e7666-a738-4751-83eb-2436af5840d6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:56.444045 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cf3e7666-a738-4751-83eb-2436af5840d6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:56.444525 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cf3e7666-a738-4751-83eb-2436af5840d6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:56.445082 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cf3e7666-a738-4751-83eb-2436af5840d6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:56.676229 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6ff33878-5f88-4d27-80e0-55224921147b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:56.685815 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6ff33878-5f88-4d27-80e0-55224921147b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1515 microversion: 2.1 time: 0.610617 Aug 07 01:19:56.693106 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1194/2137] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:56 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1515 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:56.704551 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-4961992c-b5ca-4fc8-822a-295c2d45166e req-44e1971a-5eb7-4c62-8cf5-bdd3b5a130cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6", "name": "network-vif-deleted", "tag": "b8a3f4d6-7cbf-4e51-8a06-62bb6fe91f7d"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:56.720545 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4961992c-b5ca-4fc8-822a-295c2d45166e req-44e1971a-5eb7-4c62-8cf5-bdd3b5a130cb service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:56.720885 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4961992c-b5ca-4fc8-822a-295c2d45166e req-44e1971a-5eb7-4c62-8cf5-bdd3b5a130cb service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:56.721536 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4961992c-b5ca-4fc8-822a-295c2d45166e req-44e1971a-5eb7-4c62-8cf5-bdd3b5a130cb service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:56.736094 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-4961992c-b5ca-4fc8-822a-295c2d45166e req-44e1971a-5eb7-4c62-8cf5-bdd3b5a130cb service nova] Creating event network-vif-deleted:b8a3f4d6-7cbf-4e51-8a06-62bb6fe91f7d for instance 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 on n-h1-master-1 Aug 07 01:19:56.741390 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-cf3e7666-a738-4751-83eb-2436af5840d6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:56.742114 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-4961992c-b5ca-4fc8-822a-295c2d45166e req-44e1971a-5eb7-4c62-8cf5-bdd3b5a130cb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045964 Aug 07 01:19:56.742733 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1195/2138] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:19:56.748299 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c374c608-c834-4c12-9dee-305c77a4a464 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:56.748991 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c374c608-c834-4c12-9dee-305c77a4a464 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] [instance: 18856f67-eebe-4c6a-89bc-4a2e60408d2e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:56.752641 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cf3e7666-a738-4751-83eb-2436af5840d6 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1469 microversion: 2.1 time: 0.343207 Aug 07 01:19:56.754618 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 944/2139] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:56 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1469 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:19:56.757172 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c374c608-c834-4c12-9dee-305c77a4a464 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:56.757928 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c374c608-c834-4c12-9dee-305c77a4a464 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:56.758606 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c374c608-c834-4c12-9dee-305c77a4a464 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:56.759920 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c374c608-c834-4c12-9dee-305c77a4a464 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:56.760385 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c374c608-c834-4c12-9dee-305c77a4a464 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:56.760815 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c374c608-c834-4c12-9dee-305c77a4a464 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:56.883613 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c374c608-c834-4c12-9dee-305c77a4a464 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0e7a058704483bbad57ef73de92e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622262beb7574e388c20207cccd5073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:56.892124 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c374c608-c834-4c12-9dee-305c77a4a464 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] 10.222.0.39 "GET /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e" status: 200 len: 1279 microversion: 2.1 time: 0.147842 Aug 07 01:19:56.892647 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1196/2140] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:56 2022] GET /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e => generated 1279 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:57.015545 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4002cc49-7c54-44a6-839f-559d1d469b6f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:57.016430 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4002cc49-7c54-44a6-839f-559d1d469b6f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:57.023234 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4002cc49-7c54-44a6-839f-559d1d469b6f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:57.023726 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4002cc49-7c54-44a6-839f-559d1d469b6f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:57.024188 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4002cc49-7c54-44a6-839f-559d1d469b6f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:57.024904 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4002cc49-7c54-44a6-839f-559d1d469b6f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:57.025557 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4002cc49-7c54-44a6-839f-559d1d469b6f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:57.025785 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4002cc49-7c54-44a6-839f-559d1d469b6f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:57.061695 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4002cc49-7c54-44a6-839f-559d1d469b6f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:57.062197 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4002cc49-7c54-44a6-839f-559d1d469b6f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:57.062705 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4002cc49-7c54-44a6-839f-559d1d469b6f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:57.063132 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-4002cc49-7c54-44a6-839f-559d1d469b6f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lazy-loading 'fault' on Instance uuid 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:19:57.075021 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0ec52570-09fa-4bba-bce6-a40a536f666c tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:57.076283 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0ec52570-09fa-4bba-bce6-a40a536f666c tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] [instance: 2de58a4c-7601-40e2-a4dc-073e102b659f] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:57.086840 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ec52570-09fa-4bba-bce6-a40a536f666c tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:57.088283 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ec52570-09fa-4bba-bce6-a40a536f666c tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:57.088929 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ec52570-09fa-4bba-bce6-a40a536f666c tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:57.090159 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ec52570-09fa-4bba-bce6-a40a536f666c tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:57.090851 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ec52570-09fa-4bba-bce6-a40a536f666c tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:57.092180 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ec52570-09fa-4bba-bce6-a40a536f666c tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:57.176566 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4002cc49-7c54-44a6-839f-559d1d469b6f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:57.185761 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4002cc49-7c54-44a6-839f-559d1d469b6f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6" status: 200 len: 1318 microversion: 2.1 time: 0.174359 Aug 07 01:19:57.205868 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 945/2141] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:57 2022] GET /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:57.295247 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0ec52570-09fa-4bba-bce6-a40a536f666c tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f8680c2a39400c8fcfc221872fa299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5897e4c216e646aaa3a4c9ec2c7a1cfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:57.310089 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0ec52570-09fa-4bba-bce6-a40a536f666c tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] 10.222.0.39 "GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f" status: 200 len: 1328 microversion: 2.1 time: 0.240170 Aug 07 01:19:57.311538 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1197/2142] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:57 2022] GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f => generated 1328 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:57.708432 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-33cfa9f7-271b-4d04-ae9b-253647efd42d tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:57.709288 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-33cfa9f7-271b-4d04-ae9b-253647efd42d tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:57.718957 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-33cfa9f7-271b-4d04-ae9b-253647efd42d tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:57.720467 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-33cfa9f7-271b-4d04-ae9b-253647efd42d tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:57.725842 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-33cfa9f7-271b-4d04-ae9b-253647efd42d tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:57.726695 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-33cfa9f7-271b-4d04-ae9b-253647efd42d tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:57.727319 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-33cfa9f7-271b-4d04-ae9b-253647efd42d tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:57.727797 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-33cfa9f7-271b-4d04-ae9b-253647efd42d tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:57.776642 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1b54999b-b8d3-4056-b9b2-35af2c6e0f8b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:57.777284 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1b54999b-b8d3-4056-b9b2-35af2c6e0f8b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:57.803407 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b54999b-b8d3-4056-b9b2-35af2c6e0f8b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:57.809758 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b54999b-b8d3-4056-b9b2-35af2c6e0f8b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:57.812920 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b54999b-b8d3-4056-b9b2-35af2c6e0f8b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:57.814564 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b54999b-b8d3-4056-b9b2-35af2c6e0f8b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:57.815240 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b54999b-b8d3-4056-b9b2-35af2c6e0f8b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:57.815903 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b54999b-b8d3-4056-b9b2-35af2c6e0f8b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:58.020868 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-33cfa9f7-271b-4d04-ae9b-253647efd42d tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:58.032239 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-33cfa9f7-271b-4d04-ae9b-253647efd42d tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1515 microversion: 2.1 time: 0.328647 Aug 07 01:19:58.032971 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 946/2143] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:57 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1515 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:19:58.043387 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-72bcd6cb-45f4-49bf-b85a-4c3fb9918e92 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:58.048410 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-72bcd6cb-45f4-49bf-b85a-4c3fb9918e92 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] [instance: 18856f67-eebe-4c6a-89bc-4a2e60408d2e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:58.058532 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-72bcd6cb-45f4-49bf-b85a-4c3fb9918e92 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:58.059874 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-72bcd6cb-45f4-49bf-b85a-4c3fb9918e92 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:58.060839 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-72bcd6cb-45f4-49bf-b85a-4c3fb9918e92 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:58.062598 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-72bcd6cb-45f4-49bf-b85a-4c3fb9918e92 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:58.064979 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-72bcd6cb-45f4-49bf-b85a-4c3fb9918e92 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:58.065877 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-72bcd6cb-45f4-49bf-b85a-4c3fb9918e92 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:58.136634 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1b54999b-b8d3-4056-b9b2-35af2c6e0f8b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:58.153401 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1b54999b-b8d3-4056-b9b2-35af2c6e0f8b tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1469 microversion: 2.1 time: 0.380213 Aug 07 01:19:58.154525 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1198/2144] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:57 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1469 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:58.217828 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-62e3fde7-5e7b-4048-bdfa-20bc3bb11a80 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:58.218699 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-62e3fde7-5e7b-4048-bdfa-20bc3bb11a80 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:58.242323 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62e3fde7-5e7b-4048-bdfa-20bc3bb11a80 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:58.243691 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62e3fde7-5e7b-4048-bdfa-20bc3bb11a80 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:58.244335 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62e3fde7-5e7b-4048-bdfa-20bc3bb11a80 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:58.245513 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62e3fde7-5e7b-4048-bdfa-20bc3bb11a80 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:58.246381 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62e3fde7-5e7b-4048-bdfa-20bc3bb11a80 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:58.249280 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62e3fde7-5e7b-4048-bdfa-20bc3bb11a80 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:58.274260 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-62e3fde7-5e7b-4048-bdfa-20bc3bb11a80 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] HTTP exception thrown: Instance 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 could not be found. Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-62e3fde7-5e7b-4048-bdfa-20bc3bb11a80 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Request method failure captured: Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 HTTP/1.1 Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xLZuMLvQ88KTsXpEnT0I-tjdBFOm7EEtVmBSoi3hGbagLa-WCqW3nJreDc3WwTe1tbLbMC3xnpg15asRoKTlUvK3aMhcihww2F0hywjkHPX3fkbbtMYbGiIT_pGesW2tpqp2g11Pwb-WDA3oTL-VeLkmCHA0u8DPW_SmhTlX9-nF08 Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersTestJSON-576619186 Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_efad066360cb45b3a6e9ba872118ea57", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersTestJSON-576619186 Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersTestJSON-576619186 Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersTestJSON-576619186-project Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: d4f7282c7251455086368d5274a4fac5 Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersTestJSON-576619186-project Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 could not be found. Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6'} Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 could not be found. Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 could not be found. Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:19:58.277916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:19:58.281081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:19:58.281081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:19:58.281081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:19:58.281081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:19:58.281081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 could not be found. Aug 07 01:19:58.281081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:19:58.283850 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-62e3fde7-5e7b-4048-bdfa-20bc3bb11a80 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Returning 404 to user: Instance 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:19:58.299516 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-62e3fde7-5e7b-4048-bdfa-20bc3bb11a80 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6" status: 404 len: 111 microversion: 2.1 time: 0.089035 Aug 07 01:19:58.301956 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1199/2145] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:58 2022] GET /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:19:58.312275 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d01d34aa-a1c6-4828-acc7-a288bf1bff75 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '.version_select at 0x7f9e248ff1f0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:58.348913 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d01d34aa-a1c6-4828-acc7-a288bf1bff75 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-key-762590661" status: 202 len: 0 microversion: 2.1 time: 0.041188 Aug 07 01:19:58.350667 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1200/2146] 10.222.0.39 () {58 vars in 1206 bytes} [Sun Aug 7 01:19:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-762590661 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:19:58.365697 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2e8bbe50-7ab5-4865-98da-72d0ec518446 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:58.367972 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2e8bbe50-7ab5-4865-98da-72d0ec518446 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] [instance: 2de58a4c-7601-40e2-a4dc-073e102b659f] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:58.383384 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2e8bbe50-7ab5-4865-98da-72d0ec518446 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:58.384312 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2e8bbe50-7ab5-4865-98da-72d0ec518446 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:58.384922 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2e8bbe50-7ab5-4865-98da-72d0ec518446 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:58.386144 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2e8bbe50-7ab5-4865-98da-72d0ec518446 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:58.387508 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2e8bbe50-7ab5-4865-98da-72d0ec518446 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:58.388264 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2e8bbe50-7ab5-4865-98da-72d0ec518446 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:58.700227 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-72bcd6cb-45f4-49bf-b85a-4c3fb9918e92 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0e7a058704483bbad57ef73de92e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622262beb7574e388c20207cccd5073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:58.712960 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-72bcd6cb-45f4-49bf-b85a-4c3fb9918e92 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] 10.222.0.39 "GET /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e" status: 200 len: 1321 microversion: 2.1 time: 0.678401 Aug 07 01:19:58.717931 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 947/2147] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:58 2022] GET /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e => generated 1321 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:58.727947 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0f87568c-385f-435a-bd51-043e32bcd4ad tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2018819603", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "339d8f21-b38d-49c3-8efe-8ffee4d616dc"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:19:58.831499 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-0f87568c-385f-435a-bd51-043e32bcd4ad tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] validate_networks() for [('339d8f21-b38d-49c3-8efe-8ffee4d616dc', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:19:58.835363 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2e8bbe50-7ab5-4865-98da-72d0ec518446 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f8680c2a39400c8fcfc221872fa299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5897e4c216e646aaa3a4c9ec2c7a1cfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:58.845166 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2e8bbe50-7ab5-4865-98da-72d0ec518446 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] 10.222.0.39 "GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f" status: 200 len: 1396 microversion: 2.1 time: 0.491640 Aug 07 01:19:58.860053 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1201/2148] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:58 2022] GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f => generated 1396 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:19:59.057170 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ffca0a6a-4fa3-4b3b-805a-7f6ee6d74ace tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:59.061689 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ffca0a6a-4fa3-4b3b-805a-7f6ee6d74ace tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:59.073014 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ffca0a6a-4fa3-4b3b-805a-7f6ee6d74ace tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:59.076139 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ffca0a6a-4fa3-4b3b-805a-7f6ee6d74ace tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:59.077342 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ffca0a6a-4fa3-4b3b-805a-7f6ee6d74ace tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:59.079011 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ffca0a6a-4fa3-4b3b-805a-7f6ee6d74ace tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:59.079760 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ffca0a6a-4fa3-4b3b-805a-7f6ee6d74ace tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:59.080660 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ffca0a6a-4fa3-4b3b-805a-7f6ee6d74ace tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:59.554231 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ffca0a6a-4fa3-4b3b-805a-7f6ee6d74ace tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:19:59.562736 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ffca0a6a-4fa3-4b3b-805a-7f6ee6d74ace tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1515 microversion: 2.1 time: 0.512662 Aug 07 01:19:59.563662 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1202/2149] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:59 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1515 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:19:59.570578 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4954c2f3-573c-4ab4-9027-6503fff715cb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:19:59.571214 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4954c2f3-573c-4ab4-9027-6503fff715cb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:19:59.586722 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4954c2f3-573c-4ab4-9027-6503fff715cb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:59.587207 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4954c2f3-573c-4ab4-9027-6503fff715cb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:59.587804 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4954c2f3-573c-4ab4-9027-6503fff715cb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:19:59.588724 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4954c2f3-573c-4ab4-9027-6503fff715cb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:19:59.589325 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4954c2f3-573c-4ab4-9027-6503fff715cb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:19:59.589895 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4954c2f3-573c-4ab4-9027-6503fff715cb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:00.089357 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4954c2f3-573c-4ab4-9027-6503fff715cb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:00.103404 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4954c2f3-573c-4ab4-9027-6503fff715cb tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 200 len: 1469 microversion: 2.1 time: 0.534259 Aug 07 01:20:00.104262 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1203/2150] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:19:59 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 1469 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:00.313916 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-0f87568c-385f-435a-bd51-043e32bcd4ad tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:20:00.314951 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-0f87568c-385f-435a-bd51-043e32bcd4ad tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:20:00.315637 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-0f87568c-385f-435a-bd51-043e32bcd4ad tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:20:00.316271 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-0f87568c-385f-435a-bd51-043e32bcd4ad tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:20:00.319143 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-0f87568c-385f-435a-bd51-043e32bcd4ad tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:20:00.349087 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0f87568c-385f-435a-bd51-043e32bcd4ad tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:00.350421 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0f87568c-385f-435a-bd51-043e32bcd4ad tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:00.351041 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0f87568c-385f-435a-bd51-043e32bcd4ad tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:00.351838 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0f87568c-385f-435a-bd51-043e32bcd4ad tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:00.352280 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0f87568c-385f-435a-bd51-043e32bcd4ad tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:00.352696 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0f87568c-385f-435a-bd51-043e32bcd4ad tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:00.399875 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-0f87568c-385f-435a-bd51-043e32bcd4ad tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Getting quotas for project efad066360cb45b3a6e9ba872118ea57. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:20:00.407363 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-0f87568c-385f-435a-bd51-043e32bcd4ad tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Getting quotas for user d4f7282c7251455086368d5274a4fac5 and project efad066360cb45b3a6e9ba872118ea57. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:20:00.413957 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-bd417c76-16b7-4641-9798-b18fc6b53f32 req-c8a2ced0-85cd-4b9a-aab0-e14b0f8c2aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18856f67-eebe-4c6a-89bc-4a2e60408d2e", "tag": "fff03e15-a848-4a71-acb3-d24ef1e8ff01"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:00.426339 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-bd417c76-16b7-4641-9798-b18fc6b53f32 req-c8a2ced0-85cd-4b9a-aab0-e14b0f8c2aa5 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:00.427114 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-bd417c76-16b7-4641-9798-b18fc6b53f32 req-c8a2ced0-85cd-4b9a-aab0-e14b0f8c2aa5 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:00.427730 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-bd417c76-16b7-4641-9798-b18fc6b53f32 req-c8a2ced0-85cd-4b9a-aab0-e14b0f8c2aa5 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:00.430872 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0f87568c-385f-435a-bd51-043e32bcd4ad tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:20:00.434693 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0f87568c-385f-435a-bd51-043e32bcd4ad tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 937ef9c3-acf0-4874-846f-fde53d884d0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:20:00.457155 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-bd417c76-16b7-4641-9798-b18fc6b53f32 req-c8a2ced0-85cd-4b9a-aab0-e14b0f8c2aa5 service nova] Creating event network-changed:fff03e15-a848-4a71-acb3-d24ef1e8ff01 for instance 18856f67-eebe-4c6a-89bc-4a2e60408d2e on n-h1-master-1 Aug 07 01:20:00.468051 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-bd417c76-16b7-4641-9798-b18fc6b53f32 req-c8a2ced0-85cd-4b9a-aab0-e14b0f8c2aa5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.362333 Aug 07 01:20:00.469739 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1204/2151] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:00.475682 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9c6df725-248c-4c37-9f2b-21ec4a55571b tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:00.477645 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9c6df725-248c-4c37-9f2b-21ec4a55571b tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] [instance: 18856f67-eebe-4c6a-89bc-4a2e60408d2e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:00.490834 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c6df725-248c-4c37-9f2b-21ec4a55571b tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:00.492447 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c6df725-248c-4c37-9f2b-21ec4a55571b tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:00.493125 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c6df725-248c-4c37-9f2b-21ec4a55571b tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:00.494068 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c6df725-248c-4c37-9f2b-21ec4a55571b tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:00.497072 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c6df725-248c-4c37-9f2b-21ec4a55571b tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:00.498555 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c6df725-248c-4c37-9f2b-21ec4a55571b tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:00.515524 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0f87568c-385f-435a-bd51-043e32bcd4ad tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.793529 Aug 07 01:20:00.516986 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 948/2152] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:19:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:20:00.523545 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1632b052-3bbc-498b-984b-aac4cfed8ffe tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:00.527347 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1632b052-3bbc-498b-984b-aac4cfed8ffe tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] [instance: 2de58a4c-7601-40e2-a4dc-073e102b659f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:00.540225 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1632b052-3bbc-498b-984b-aac4cfed8ffe tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:00.541006 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1632b052-3bbc-498b-984b-aac4cfed8ffe tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:00.541892 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1632b052-3bbc-498b-984b-aac4cfed8ffe tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:00.542981 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1632b052-3bbc-498b-984b-aac4cfed8ffe tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:00.543636 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1632b052-3bbc-498b-984b-aac4cfed8ffe tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:00.544404 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1632b052-3bbc-498b-984b-aac4cfed8ffe tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:00.879291 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9c6df725-248c-4c37-9f2b-21ec4a55571b tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0e7a058704483bbad57ef73de92e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622262beb7574e388c20207cccd5073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:00.891756 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9c6df725-248c-4c37-9f2b-21ec4a55571b tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] 10.222.0.39 "GET /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e" status: 200 len: 1321 microversion: 2.1 time: 0.420524 Aug 07 01:20:00.913824 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1205/2153] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:00 2022] GET /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e => generated 1321 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:00.916528 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1632b052-3bbc-498b-984b-aac4cfed8ffe tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f8680c2a39400c8fcfc221872fa299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5897e4c216e646aaa3a4c9ec2c7a1cfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:00.929035 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1632b052-3bbc-498b-984b-aac4cfed8ffe tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] 10.222.0.39 "GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f" status: 200 len: 1396 microversion: 2.1 time: 0.409663 Aug 07 01:20:00.929742 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 949/2154] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:00 2022] GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f => generated 1396 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:00.957767 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-96bb1691-211f-4e84-b392-b22929d2d59d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:00.960094 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-96bb1691-211f-4e84-b392-b22929d2d59d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 937ef9c3-acf0-4874-846f-fde53d884d0a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:01.068176 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-5497af6b-b317-4ee5-9b48-910caeb73912 req-4b4565b6-f077-476a-9df9-4e5e422ee169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "634a7ed6-84df-4292-bc38-5129fb0f57c9", "name": "network-vif-deleted", "tag": "93ab5068-1c0e-4ec2-bb1a-06cc1c07f96e"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:01.083849 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-96bb1691-211f-4e84-b392-b22929d2d59d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:01.090182 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-5497af6b-b317-4ee5-9b48-910caeb73912 req-4b4565b6-f077-476a-9df9-4e5e422ee169 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:01.091067 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-5497af6b-b317-4ee5-9b48-910caeb73912 req-4b4565b6-f077-476a-9df9-4e5e422ee169 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:01.091686 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-5497af6b-b317-4ee5-9b48-910caeb73912 req-4b4565b6-f077-476a-9df9-4e5e422ee169 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:01.095430 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-96bb1691-211f-4e84-b392-b22929d2d59d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a" status: 200 len: 1209 microversion: 2.1 time: 0.157004 Aug 07 01:20:01.096339 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 950/2155] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:00 2022] GET /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a => generated 1209 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:01.102213 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-64cb22f2-60e1-4f25-8643-56241eddf56a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:01.103254 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-64cb22f2-60e1-4f25-8643-56241eddf56a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:01.113472 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64cb22f2-60e1-4f25-8643-56241eddf56a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:01.114296 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64cb22f2-60e1-4f25-8643-56241eddf56a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:01.128067 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64cb22f2-60e1-4f25-8643-56241eddf56a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:01.129419 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64cb22f2-60e1-4f25-8643-56241eddf56a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:01.129499 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-5497af6b-b317-4ee5-9b48-910caeb73912 req-4b4565b6-f077-476a-9df9-4e5e422ee169 service nova] Creating event network-vif-deleted:93ab5068-1c0e-4ec2-bb1a-06cc1c07f96e for instance 634a7ed6-84df-4292-bc38-5129fb0f57c9 on n-h2-master-1 Aug 07 01:20:01.129572 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64cb22f2-60e1-4f25-8643-56241eddf56a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:01.130012 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64cb22f2-60e1-4f25-8643-56241eddf56a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:01.139922 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-5497af6b-b317-4ee5-9b48-910caeb73912 req-4b4565b6-f077-476a-9df9-4e5e422ee169 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.224323 Aug 07 01:20:01.140707 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1206/2156] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:01.147282 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-def92ec0-d1a6-4015-911a-fec207160209 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:01.148348 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-def92ec0-d1a6-4015-911a-fec207160209 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 634a7ed6-84df-4292-bc38-5129fb0f57c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:01.156029 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-def92ec0-d1a6-4015-911a-fec207160209 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:01.157302 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-def92ec0-d1a6-4015-911a-fec207160209 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:01.157927 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-def92ec0-d1a6-4015-911a-fec207160209 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:01.159060 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-def92ec0-d1a6-4015-911a-fec207160209 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:01.159748 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-def92ec0-d1a6-4015-911a-fec207160209 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:01.160441 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-def92ec0-d1a6-4015-911a-fec207160209 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:01.175774 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-def92ec0-d1a6-4015-911a-fec207160209 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] HTTP exception thrown: Instance 634a7ed6-84df-4292-bc38-5129fb0f57c9 could not be found. Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-def92ec0-d1a6-4015-911a-fec207160209 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Request method failure captured: Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 HTTP/1.1 Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xGmBnM-sERHAF-yu4khVKHIk2FjJpwXHxpgOZFrdD5mWdYp38Q2IHVkblSiYcv1-_Wi-z3JVqsUP8zzujCNqQAX5xw8YLKxnrFzevVpXC3hZLNyJG2lkq83P2rkmx7ByVUEwPjOWj9Ti_q1HizAI9hlxMbhb5Nb4jiCnSs9xuMpTwQ Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 1911abc893ef4c01aa80ca9079dea6e9 Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-MigrationsAdminTest-2018910474 Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1911abc893ef4c01aa80ca9079dea6e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1911abc893ef4c01aa80ca9079dea6e9", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1911abc893ef4c01aa80ca9079dea6e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1911abc893ef4c01aa80ca9079dea6e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-MigrationsAdminTest-2018910474 Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 1911abc893ef4c01aa80ca9079dea6e9 Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-MigrationsAdminTest-2018910474 Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-MigrationsAdminTest-2018910474-project Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: b945db9a6f7a4143a544b76be5e9af9f Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-MigrationsAdminTest-2018910474-project Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 634a7ed6-84df-4292-bc38-5129fb0f57c9 could not be found. Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '634a7ed6-84df-4292-bc38-5129fb0f57c9'} Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 634a7ed6-84df-4292-bc38-5129fb0f57c9 could not be found. Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 634a7ed6-84df-4292-bc38-5129fb0f57c9 could not be found. Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:01.179203 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:01.182356 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:01.182356 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:01.182356 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:01.182356 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:20:01.182356 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:20:01.182356 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 634a7ed6-84df-4292-bc38-5129fb0f57c9 could not be found. Aug 07 01:20:01.182356 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:01.189736 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-def92ec0-d1a6-4015-911a-fec207160209 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Returning 404 to user: Instance 634a7ed6-84df-4292-bc38-5129fb0f57c9 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:20:01.191000 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-def92ec0-d1a6-4015-911a-fec207160209 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9" status: 404 len: 111 microversion: 2.1 time: 0.048379 Aug 07 01:20:01.191870 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1207/2157] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:01 2022] GET /compute/v2.1/servers/634a7ed6-84df-4292-bc38-5129fb0f57c9 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:20:01.201216 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8d7fea76-55d8-4a13-8956-e48d750c695a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:01.202676 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8d7fea76-55d8-4a13-8956-e48d750c695a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:01.210602 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d7fea76-55d8-4a13-8956-e48d750c695a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:01.211513 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d7fea76-55d8-4a13-8956-e48d750c695a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:01.212417 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d7fea76-55d8-4a13-8956-e48d750c695a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:01.213383 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d7fea76-55d8-4a13-8956-e48d750c695a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:01.214030 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d7fea76-55d8-4a13-8956-e48d750c695a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:01.214643 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d7fea76-55d8-4a13-8956-e48d750c695a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:01.261029 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8d7fea76-55d8-4a13-8956-e48d750c695a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:20:01.347972 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-64cb22f2-60e1-4f25-8643-56241eddf56a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:01.361807 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-64cb22f2-60e1-4f25-8643-56241eddf56a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1515 microversion: 2.1 time: 0.263242 Aug 07 01:20:01.368863 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 951/2158] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:01 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1515 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:01.411661 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8d7fea76-55d8-4a13-8956-e48d750c695a tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "DELETE /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 204 len: 0 microversion: 2.1 time: 0.207432 Aug 07 01:20:01.415393 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1208/2159] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:20:01 2022] DELETE /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:20:01.422571 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3c51518a-0010-43b2-8d10-f2371ea2e256 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:01.423284 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3c51518a-0010-43b2-8d10-f2371ea2e256 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:01.438877 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c51518a-0010-43b2-8d10-f2371ea2e256 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:01.439593 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c51518a-0010-43b2-8d10-f2371ea2e256 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:01.442030 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c51518a-0010-43b2-8d10-f2371ea2e256 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:01.443053 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c51518a-0010-43b2-8d10-f2371ea2e256 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:01.443531 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c51518a-0010-43b2-8d10-f2371ea2e256 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:01.444000 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c51518a-0010-43b2-8d10-f2371ea2e256 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:01.655799 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3c51518a-0010-43b2-8d10-f2371ea2e256 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:01.672488 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3c51518a-0010-43b2-8d10-f2371ea2e256 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1468 microversion: 2.1 time: 0.254924 Aug 07 01:20:01.673611 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 952/2160] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:01 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1468 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:01.922868 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-499b4967-0e22-4c79-be9d-4b6813df9432 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:01.923581 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-499b4967-0e22-4c79-be9d-4b6813df9432 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] [instance: 18856f67-eebe-4c6a-89bc-4a2e60408d2e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:01.926419 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:01.932316 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-499b4967-0e22-4c79-be9d-4b6813df9432 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:01.932801 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-499b4967-0e22-4c79-be9d-4b6813df9432 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:01.933441 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-499b4967-0e22-4c79-be9d-4b6813df9432 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:01.934154 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-499b4967-0e22-4c79-be9d-4b6813df9432 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:01.934602 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-499b4967-0e22-4c79-be9d-4b6813df9432 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:01.935025 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-499b4967-0e22-4c79-be9d-4b6813df9432 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:01.955289 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b160ffd4-09bb-479f-b1bf-dddfbe3bcb70 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:01.956211 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b160ffd4-09bb-479f-b1bf-dddfbe3bcb70 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] [instance: 2de58a4c-7601-40e2-a4dc-073e102b659f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:01.962785 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b160ffd4-09bb-479f-b1bf-dddfbe3bcb70 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:01.963521 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b160ffd4-09bb-479f-b1bf-dddfbe3bcb70 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:01.963988 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b160ffd4-09bb-479f-b1bf-dddfbe3bcb70 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:01.964700 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b160ffd4-09bb-479f-b1bf-dddfbe3bcb70 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:01.965150 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b160ffd4-09bb-479f-b1bf-dddfbe3bcb70 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:01.965571 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b160ffd4-09bb-479f-b1bf-dddfbe3bcb70 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:02.170033 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b160ffd4-09bb-479f-b1bf-dddfbe3bcb70 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f8680c2a39400c8fcfc221872fa299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5897e4c216e646aaa3a4c9ec2c7a1cfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:02.182152 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b160ffd4-09bb-479f-b1bf-dddfbe3bcb70 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] 10.222.0.39 "GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f" status: 200 len: 1396 microversion: 2.1 time: 0.231472 Aug 07 01:20:02.183214 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 953/2161] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:01 2022] GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f => generated 1396 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:02.189767 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-57eb9ce7-3638-4a17-89ce-c82b693474e8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:02.191100 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-57eb9ce7-3638-4a17-89ce-c82b693474e8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 937ef9c3-acf0-4874-846f-fde53d884d0a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:02.199124 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-57eb9ce7-3638-4a17-89ce-c82b693474e8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:02.200035 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-57eb9ce7-3638-4a17-89ce-c82b693474e8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:02.200670 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-57eb9ce7-3638-4a17-89ce-c82b693474e8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:02.201620 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-57eb9ce7-3638-4a17-89ce-c82b693474e8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:02.202274 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-57eb9ce7-3638-4a17-89ce-c82b693474e8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:02.202989 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-57eb9ce7-3638-4a17-89ce-c82b693474e8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:02.332827 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-499b4967-0e22-4c79-be9d-4b6813df9432 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0e7a058704483bbad57ef73de92e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622262beb7574e388c20207cccd5073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:02.337633 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-57eb9ce7-3638-4a17-89ce-c82b693474e8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:02.348660 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-499b4967-0e22-4c79-be9d-4b6813df9432 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] 10.222.0.39 "GET /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e" status: 200 len: 1321 microversion: 2.1 time: 0.430199 Aug 07 01:20:02.351027 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1209/2162] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:01 2022] GET /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e => generated 1321 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:02.352459 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-57eb9ce7-3638-4a17-89ce-c82b693474e8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a" status: 200 len: 1261 microversion: 2.1 time: 0.168037 Aug 07 01:20:02.353057 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 954/2163] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:02 2022] GET /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a => generated 1261 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:02.398839 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-60e084e5-ff39-4903-80ed-31f7665bfe17 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:02.400529 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-60e084e5-ff39-4903-80ed-31f7665bfe17 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:02.409710 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60e084e5-ff39-4903-80ed-31f7665bfe17 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:02.410603 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60e084e5-ff39-4903-80ed-31f7665bfe17 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:02.411182 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60e084e5-ff39-4903-80ed-31f7665bfe17 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:02.413022 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60e084e5-ff39-4903-80ed-31f7665bfe17 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:02.413734 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60e084e5-ff39-4903-80ed-31f7665bfe17 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:02.414369 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60e084e5-ff39-4903-80ed-31f7665bfe17 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:02.693548 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-60e084e5-ff39-4903-80ed-31f7665bfe17 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:02.696354 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5d4dad9a-e0a6-49d2-a944-1fcff5c8a862 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:02.698039 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5d4dad9a-e0a6-49d2-a944-1fcff5c8a862 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:02.704178 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-60e084e5-ff39-4903-80ed-31f7665bfe17 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1515 microversion: 2.1 time: 0.315844 Aug 07 01:20:02.707169 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d4dad9a-e0a6-49d2-a944-1fcff5c8a862 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:02.708236 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d4dad9a-e0a6-49d2-a944-1fcff5c8a862 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:02.708889 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d4dad9a-e0a6-49d2-a944-1fcff5c8a862 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:02.710090 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d4dad9a-e0a6-49d2-a944-1fcff5c8a862 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:02.710741 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d4dad9a-e0a6-49d2-a944-1fcff5c8a862 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:02.711687 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d4dad9a-e0a6-49d2-a944-1fcff5c8a862 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:02.721051 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1210/2164] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:02 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1515 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:02.993795 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5d4dad9a-e0a6-49d2-a944-1fcff5c8a862 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:03.011919 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5d4dad9a-e0a6-49d2-a944-1fcff5c8a862 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1468 microversion: 2.1 time: 0.320582 Aug 07 01:20:03.013099 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 955/2165] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:02 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1468 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:03.162869 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-25df0ca5-f3c8-408a-b489-399f2f4cea52 req-26835a6b-69cf-4b22-be31-333c62cb0b9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2de58a4c-7601-40e2-a4dc-073e102b659f", "tag": "5e510ccb-df6b-4f78-97bf-bbc62a3514bf"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:03.183773 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-25df0ca5-f3c8-408a-b489-399f2f4cea52 req-26835a6b-69cf-4b22-be31-333c62cb0b9f service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:03.184708 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-25df0ca5-f3c8-408a-b489-399f2f4cea52 req-26835a6b-69cf-4b22-be31-333c62cb0b9f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:03.185649 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-25df0ca5-f3c8-408a-b489-399f2f4cea52 req-26835a6b-69cf-4b22-be31-333c62cb0b9f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:03.191765 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:03.206006 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b80f383f-604e-4773-8f3d-6bbee96ebd27 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:03.206632 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b80f383f-604e-4773-8f3d-6bbee96ebd27 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] [instance: 2de58a4c-7601-40e2-a4dc-073e102b659f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:03.210788 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-25df0ca5-f3c8-408a-b489-399f2f4cea52 req-26835a6b-69cf-4b22-be31-333c62cb0b9f service nova] Creating event network-changed:5e510ccb-df6b-4f78-97bf-bbc62a3514bf for instance 2de58a4c-7601-40e2-a4dc-073e102b659f on n-h1-master-1 Aug 07 01:20:03.214768 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b80f383f-604e-4773-8f3d-6bbee96ebd27 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:03.216995 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b80f383f-604e-4773-8f3d-6bbee96ebd27 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:03.219848 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-25df0ca5-f3c8-408a-b489-399f2f4cea52 req-26835a6b-69cf-4b22-be31-333c62cb0b9f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065753 Aug 07 01:20:03.221118 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1211/2166] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:03.225022 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b80f383f-604e-4773-8f3d-6bbee96ebd27 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:03.225627 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b80f383f-604e-4773-8f3d-6bbee96ebd27 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:03.226098 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b80f383f-604e-4773-8f3d-6bbee96ebd27 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:03.226525 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b80f383f-604e-4773-8f3d-6bbee96ebd27 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:03.382249 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c70e4856-836e-483c-9b6a-4f28daf6d8e2 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:03.384264 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c70e4856-836e-483c-9b6a-4f28daf6d8e2 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] [instance: 18856f67-eebe-4c6a-89bc-4a2e60408d2e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:03.398029 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c70e4856-836e-483c-9b6a-4f28daf6d8e2 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:03.399363 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c70e4856-836e-483c-9b6a-4f28daf6d8e2 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:03.400044 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c70e4856-836e-483c-9b6a-4f28daf6d8e2 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:03.400974 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c70e4856-836e-483c-9b6a-4f28daf6d8e2 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:03.401728 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c70e4856-836e-483c-9b6a-4f28daf6d8e2 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:03.402350 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c70e4856-836e-483c-9b6a-4f28daf6d8e2 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:03.587859 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b80f383f-604e-4773-8f3d-6bbee96ebd27 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f8680c2a39400c8fcfc221872fa299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5897e4c216e646aaa3a4c9ec2c7a1cfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:03.598659 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b80f383f-604e-4773-8f3d-6bbee96ebd27 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] 10.222.0.39 "GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f" status: 200 len: 1396 microversion: 2.1 time: 0.396336 Aug 07 01:20:03.616418 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 956/2167] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:03 2022] GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f => generated 1396 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:03.624409 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f7eacb15-e471-4d15-aced-3792a12bf49e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:03.626486 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f7eacb15-e471-4d15-aced-3792a12bf49e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 937ef9c3-acf0-4874-846f-fde53d884d0a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:03.637695 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f7eacb15-e471-4d15-aced-3792a12bf49e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:03.640627 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f7eacb15-e471-4d15-aced-3792a12bf49e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:03.642729 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f7eacb15-e471-4d15-aced-3792a12bf49e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:03.644874 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f7eacb15-e471-4d15-aced-3792a12bf49e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:03.654936 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f7eacb15-e471-4d15-aced-3792a12bf49e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:03.656160 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f7eacb15-e471-4d15-aced-3792a12bf49e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:03.942892 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c70e4856-836e-483c-9b6a-4f28daf6d8e2 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0e7a058704483bbad57ef73de92e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622262beb7574e388c20207cccd5073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:03.963590 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c70e4856-836e-483c-9b6a-4f28daf6d8e2 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] 10.222.0.39 "GET /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e" status: 200 len: 1321 microversion: 2.1 time: 0.593608 Aug 07 01:20:03.978949 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1212/2168] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:03 2022] GET /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e => generated 1321 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:03.995466 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e217dcd4-75a2-4902-985a-c686cb0de6a6 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:03.996325 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e217dcd4-75a2-4902-985a-c686cb0de6a6 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:04.003954 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e217dcd4-75a2-4902-985a-c686cb0de6a6 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:04.004889 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e217dcd4-75a2-4902-985a-c686cb0de6a6 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:04.005340 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e217dcd4-75a2-4902-985a-c686cb0de6a6 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:04.006438 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e217dcd4-75a2-4902-985a-c686cb0de6a6 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:04.006550 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e217dcd4-75a2-4902-985a-c686cb0de6a6 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:04.006938 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e217dcd4-75a2-4902-985a-c686cb0de6a6 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:04.095363 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f7eacb15-e471-4d15-aced-3792a12bf49e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:04.105234 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f7eacb15-e471-4d15-aced-3792a12bf49e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a" status: 200 len: 1309 microversion: 2.1 time: 0.487056 Aug 07 01:20:04.116171 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 957/2169] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:03 2022] GET /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a => generated 1309 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:04.121629 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4f15ac2a-1e93-403c-9432-dcf0afee0946 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:04.122258 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4f15ac2a-1e93-403c-9432-dcf0afee0946 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:04.132896 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f15ac2a-1e93-403c-9432-dcf0afee0946 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:04.133278 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f15ac2a-1e93-403c-9432-dcf0afee0946 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:04.140550 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f15ac2a-1e93-403c-9432-dcf0afee0946 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:04.142462 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f15ac2a-1e93-403c-9432-dcf0afee0946 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:04.142462 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f15ac2a-1e93-403c-9432-dcf0afee0946 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:04.143162 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f15ac2a-1e93-403c-9432-dcf0afee0946 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:04.572436 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4f15ac2a-1e93-403c-9432-dcf0afee0946 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:04.585744 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4f15ac2a-1e93-403c-9432-dcf0afee0946 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1468 microversion: 2.1 time: 0.468147 Aug 07 01:20:04.599810 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 958/2170] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:04 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1468 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:04.640017 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2b3ee583-2ed3-4a12-9ab1-2ce84d97bfa1 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:04.641265 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2b3ee583-2ed3-4a12-9ab1-2ce84d97bfa1 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] [instance: 2de58a4c-7601-40e2-a4dc-073e102b659f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:04.651242 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b3ee583-2ed3-4a12-9ab1-2ce84d97bfa1 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:04.652380 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b3ee583-2ed3-4a12-9ab1-2ce84d97bfa1 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:04.653825 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b3ee583-2ed3-4a12-9ab1-2ce84d97bfa1 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:04.654898 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b3ee583-2ed3-4a12-9ab1-2ce84d97bfa1 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:04.655579 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b3ee583-2ed3-4a12-9ab1-2ce84d97bfa1 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:04.656433 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b3ee583-2ed3-4a12-9ab1-2ce84d97bfa1 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:04.760714 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e217dcd4-75a2-4902-985a-c686cb0de6a6 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:04.763715 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=8 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:04.777198 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e217dcd4-75a2-4902-985a-c686cb0de6a6 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1515 microversion: 2.1 time: 0.792273 Aug 07 01:20:04.777996 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1213/2171] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:03 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1515 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:04.991809 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-264d6b3e-e71b-4a80-961e-d20020e001fe tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:04.992979 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-264d6b3e-e71b-4a80-961e-d20020e001fe tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] [instance: 18856f67-eebe-4c6a-89bc-4a2e60408d2e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:05.014818 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-264d6b3e-e71b-4a80-961e-d20020e001fe tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:05.015349 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-264d6b3e-e71b-4a80-961e-d20020e001fe tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:05.015850 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-264d6b3e-e71b-4a80-961e-d20020e001fe tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:05.017410 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-264d6b3e-e71b-4a80-961e-d20020e001fe tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:05.017890 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-264d6b3e-e71b-4a80-961e-d20020e001fe tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:05.018626 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-264d6b3e-e71b-4a80-961e-d20020e001fe tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:05.073138 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2b3ee583-2ed3-4a12-9ab1-2ce84d97bfa1 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f8680c2a39400c8fcfc221872fa299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5897e4c216e646aaa3a4c9ec2c7a1cfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:05.087342 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2b3ee583-2ed3-4a12-9ab1-2ce84d97bfa1 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] 10.222.0.39 "GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f" status: 200 len: 1396 microversion: 2.1 time: 0.456918 Aug 07 01:20:05.091591 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 959/2172] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:04 2022] GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f => generated 1396 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:05.133065 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0ef5c517-f820-4be1-bb6a-7fcb64f94ea4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:05.133724 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0ef5c517-f820-4be1-bb6a-7fcb64f94ea4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 937ef9c3-acf0-4874-846f-fde53d884d0a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:05.143005 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ef5c517-f820-4be1-bb6a-7fcb64f94ea4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:05.144067 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ef5c517-f820-4be1-bb6a-7fcb64f94ea4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:05.144672 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ef5c517-f820-4be1-bb6a-7fcb64f94ea4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:05.145427 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ef5c517-f820-4be1-bb6a-7fcb64f94ea4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:05.145892 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ef5c517-f820-4be1-bb6a-7fcb64f94ea4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:05.146570 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ef5c517-f820-4be1-bb6a-7fcb64f94ea4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:05.168791 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:05.571070 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0ef5c517-f820-4be1-bb6a-7fcb64f94ea4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:05.587537 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0ef5c517-f820-4be1-bb6a-7fcb64f94ea4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a" status: 200 len: 1309 microversion: 2.1 time: 0.455908 Aug 07 01:20:05.593279 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 960/2173] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:05 2022] GET /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a => generated 1309 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:05.599098 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-f127412f-4f34-4102-b860-521447c715ab req-036ea0a1-b853-4761-b085-2153080a3ade service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "937ef9c3-acf0-4874-846f-fde53d884d0a", "tag": "58804c58-1d5b-414f-bfba-63cb09aad77d"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:05.624318 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f127412f-4f34-4102-b860-521447c715ab req-036ea0a1-b853-4761-b085-2153080a3ade service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:05.627781 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f127412f-4f34-4102-b860-521447c715ab req-036ea0a1-b853-4761-b085-2153080a3ade service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:05.631114 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f127412f-4f34-4102-b860-521447c715ab req-036ea0a1-b853-4761-b085-2153080a3ade service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:05.650819 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-f127412f-4f34-4102-b860-521447c715ab req-036ea0a1-b853-4761-b085-2153080a3ade service nova] Creating event network-changed:58804c58-1d5b-414f-bfba-63cb09aad77d for instance 937ef9c3-acf0-4874-846f-fde53d884d0a on n-h2-master-1 Aug 07 01:20:05.661396 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-f127412f-4f34-4102-b860-521447c715ab req-036ea0a1-b853-4761-b085-2153080a3ade service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066087 Aug 07 01:20:05.662177 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 961/2174] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:05.669794 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f093c01f-e67b-4378-9fbb-8d842133411d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:05.670515 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f093c01f-e67b-4378-9fbb-8d842133411d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:05.679159 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f093c01f-e67b-4378-9fbb-8d842133411d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:05.679657 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f093c01f-e67b-4378-9fbb-8d842133411d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:05.680138 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f093c01f-e67b-4378-9fbb-8d842133411d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:05.696679 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f093c01f-e67b-4378-9fbb-8d842133411d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:05.697723 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f093c01f-e67b-4378-9fbb-8d842133411d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:05.700967 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f093c01f-e67b-4378-9fbb-8d842133411d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:05.781124 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-264d6b3e-e71b-4a80-961e-d20020e001fe tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0e7a058704483bbad57ef73de92e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622262beb7574e388c20207cccd5073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:05.790611 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-264d6b3e-e71b-4a80-961e-d20020e001fe tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] 10.222.0.39 "GET /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e" status: 200 len: 1321 microversion: 2.1 time: 0.806391 Aug 07 01:20:05.791206 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1214/2175] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:04 2022] GET /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e => generated 1321 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:05.818156 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-0d4f4ae3-6dc9-42be-a0ad-c7c9be21aa3f req-01e3c3af-1d29-4007-bf56-2904fbcc4fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08028949-8eca-4017-8cb2-04ab2b9213ae", "name": "network-vif-deleted", "tag": "7606e7d3-c5a2-4fdd-b3b8-464769ea2e7b"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:05.846807 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0d4f4ae3-6dc9-42be-a0ad-c7c9be21aa3f req-01e3c3af-1d29-4007-bf56-2904fbcc4fd1 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:05.847358 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0d4f4ae3-6dc9-42be-a0ad-c7c9be21aa3f req-01e3c3af-1d29-4007-bf56-2904fbcc4fd1 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:05.847797 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0d4f4ae3-6dc9-42be-a0ad-c7c9be21aa3f req-01e3c3af-1d29-4007-bf56-2904fbcc4fd1 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:05.870732 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-0d4f4ae3-6dc9-42be-a0ad-c7c9be21aa3f req-01e3c3af-1d29-4007-bf56-2904fbcc4fd1 service nova] Creating event network-vif-deleted:7606e7d3-c5a2-4fdd-b3b8-464769ea2e7b for instance 08028949-8eca-4017-8cb2-04ab2b9213ae on n-h1-master-1 Aug 07 01:20:05.886503 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-0d4f4ae3-6dc9-42be-a0ad-c7c9be21aa3f req-01e3c3af-1d29-4007-bf56-2904fbcc4fd1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075836 Aug 07 01:20:05.890600 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1215/2176] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:05.910271 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f170ecdf-926a-47c5-a29d-dbe16b1f70d9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:05.918132 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f170ecdf-926a-47c5-a29d-dbe16b1f70d9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:05.935699 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f170ecdf-926a-47c5-a29d-dbe16b1f70d9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:05.936299 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f170ecdf-926a-47c5-a29d-dbe16b1f70d9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:05.936732 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f170ecdf-926a-47c5-a29d-dbe16b1f70d9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:05.937462 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f170ecdf-926a-47c5-a29d-dbe16b1f70d9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:05.937958 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f170ecdf-926a-47c5-a29d-dbe16b1f70d9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:05.938388 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f170ecdf-926a-47c5-a29d-dbe16b1f70d9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:05.950565 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f093c01f-e67b-4378-9fbb-8d842133411d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b945db9a6f7a4143a544b76be5e9af9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1911abc893ef4c01aa80ca9079dea6e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:05.963937 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f093c01f-e67b-4378-9fbb-8d842133411d tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 200 len: 1426 microversion: 2.1 time: 0.298027 Aug 07 01:20:05.963937 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 962/2177] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:05 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 1426 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:06.054531 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-61d14650-3cdb-485d-9caa-c7717bb54db2 req-15bbc34a-97ac-40c3-a082-8f7a751e4a78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18856f67-eebe-4c6a-89bc-4a2e60408d2e", "name": "network-vif-plugged", "status": "completed", "tag": "fff03e15-a848-4a71-acb3-d24ef1e8ff01"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:06.076585 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-61d14650-3cdb-485d-9caa-c7717bb54db2 req-15bbc34a-97ac-40c3-a082-8f7a751e4a78 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:06.079118 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-61d14650-3cdb-485d-9caa-c7717bb54db2 req-15bbc34a-97ac-40c3-a082-8f7a751e4a78 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:06.079671 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-61d14650-3cdb-485d-9caa-c7717bb54db2 req-15bbc34a-97ac-40c3-a082-8f7a751e4a78 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:06.107640 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-61d14650-3cdb-485d-9caa-c7717bb54db2 req-15bbc34a-97ac-40c3-a082-8f7a751e4a78 service nova] Creating event network-vif-plugged:fff03e15-a848-4a71-acb3-d24ef1e8ff01 for instance 18856f67-eebe-4c6a-89bc-4a2e60408d2e on n-h1-master-1 Aug 07 01:20:06.119215 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-61d14650-3cdb-485d-9caa-c7717bb54db2 req-15bbc34a-97ac-40c3-a082-8f7a751e4a78 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068884 Aug 07 01:20:06.120155 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 963/2178] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:20:06.125552 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a65f7fbe-e685-42ab-b6af-c191a1f4771c tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:06.126192 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a65f7fbe-e685-42ab-b6af-c191a1f4771c tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] [instance: 2de58a4c-7601-40e2-a4dc-073e102b659f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:06.135532 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a65f7fbe-e685-42ab-b6af-c191a1f4771c tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:06.135532 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a65f7fbe-e685-42ab-b6af-c191a1f4771c tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:06.135823 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a65f7fbe-e685-42ab-b6af-c191a1f4771c tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:06.136621 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a65f7fbe-e685-42ab-b6af-c191a1f4771c tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:06.137081 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a65f7fbe-e685-42ab-b6af-c191a1f4771c tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:06.137513 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a65f7fbe-e685-42ab-b6af-c191a1f4771c tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:06.386621 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f170ecdf-926a-47c5-a29d-dbe16b1f70d9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:06.390035 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a65f7fbe-e685-42ab-b6af-c191a1f4771c tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f8680c2a39400c8fcfc221872fa299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5897e4c216e646aaa3a4c9ec2c7a1cfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:06.411996 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f170ecdf-926a-47c5-a29d-dbe16b1f70d9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1515 microversion: 2.1 time: 0.518368 Aug 07 01:20:06.412503 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a65f7fbe-e685-42ab-b6af-c191a1f4771c tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] 10.222.0.39 "GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f" status: 200 len: 1396 microversion: 2.1 time: 0.289091 Aug 07 01:20:06.414261 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 964/2179] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:06 2022] GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f => generated 1396 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:06.431867 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1216/2180] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:05 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1515 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:06.613956 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-27da2533-d190-4b5a-985a-9a8c40f0e47f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:06.614484 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-27da2533-d190-4b5a-985a-9a8c40f0e47f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 937ef9c3-acf0-4874-846f-fde53d884d0a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:06.623974 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27da2533-d190-4b5a-985a-9a8c40f0e47f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:06.624475 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27da2533-d190-4b5a-985a-9a8c40f0e47f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:06.625079 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27da2533-d190-4b5a-985a-9a8c40f0e47f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:06.625633 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27da2533-d190-4b5a-985a-9a8c40f0e47f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:06.626135 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27da2533-d190-4b5a-985a-9a8c40f0e47f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:06.629988 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27da2533-d190-4b5a-985a-9a8c40f0e47f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:06.816451 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-711b3ee8-7030-4be1-8301-e4dbc3a37e57 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:06.817141 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-711b3ee8-7030-4be1-8301-e4dbc3a37e57 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] [instance: 18856f67-eebe-4c6a-89bc-4a2e60408d2e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:06.819813 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:06.837078 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-711b3ee8-7030-4be1-8301-e4dbc3a37e57 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:06.839057 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-711b3ee8-7030-4be1-8301-e4dbc3a37e57 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:06.842257 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-711b3ee8-7030-4be1-8301-e4dbc3a37e57 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:06.843400 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-711b3ee8-7030-4be1-8301-e4dbc3a37e57 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:06.844668 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-711b3ee8-7030-4be1-8301-e4dbc3a37e57 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:06.847807 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-711b3ee8-7030-4be1-8301-e4dbc3a37e57 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:07.080504 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-711b3ee8-7030-4be1-8301-e4dbc3a37e57 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0e7a058704483bbad57ef73de92e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622262beb7574e388c20207cccd5073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:07.091048 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-711b3ee8-7030-4be1-8301-e4dbc3a37e57 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] 10.222.0.39 "GET /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e" status: 200 len: 1321 microversion: 2.1 time: 0.278328 Aug 07 01:20:07.103917 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1217/2181] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:06 2022] GET /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:07.103917 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cea06f13-d8ec-4cfd-8922-7fde9c665e83 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:07.103917 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cea06f13-d8ec-4cfd-8922-7fde9c665e83 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] [instance: 08028949-8eca-4017-8cb2-04ab2b9213ae] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:07.114107 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cea06f13-d8ec-4cfd-8922-7fde9c665e83 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:07.114614 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cea06f13-d8ec-4cfd-8922-7fde9c665e83 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:07.115067 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cea06f13-d8ec-4cfd-8922-7fde9c665e83 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:07.115860 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cea06f13-d8ec-4cfd-8922-7fde9c665e83 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:07.116368 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cea06f13-d8ec-4cfd-8922-7fde9c665e83 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:07.116801 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cea06f13-d8ec-4cfd-8922-7fde9c665e83 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:07.133593 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-cea06f13-d8ec-4cfd-8922-7fde9c665e83 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] HTTP exception thrown: Instance 08028949-8eca-4017-8cb2-04ab2b9213ae could not be found. Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cea06f13-d8ec-4cfd-8922-7fde9c665e83 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Request method failure captured: Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae HTTP/1.1 Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xGmBnM-sERHAF-yu4khVKHIk2FjJpwXHxpgOZFrdD5mWdYp38Q2IHVkblSiYcv1-_Wi-z3JVqsUP8zzujCNqQAX5xw8YLKxnrFzevVpXC3hZLNyJG2lkq83P2rkmx7ByVUEwPjOWj9Ti_q1HizAI9hlxMbhb5Nb4jiCnSs9xuMpTwQ Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 1911abc893ef4c01aa80ca9079dea6e9 Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-MigrationsAdminTest-2018910474 Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1911abc893ef4c01aa80ca9079dea6e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1911abc893ef4c01aa80ca9079dea6e9", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1911abc893ef4c01aa80ca9079dea6e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1911abc893ef4c01aa80ca9079dea6e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-MigrationsAdminTest-2018910474 Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 1911abc893ef4c01aa80ca9079dea6e9 Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-MigrationsAdminTest-2018910474 Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-MigrationsAdminTest-2018910474-project Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: b945db9a6f7a4143a544b76be5e9af9f Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-MigrationsAdminTest-2018910474-project Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 08028949-8eca-4017-8cb2-04ab2b9213ae could not be found. Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '08028949-8eca-4017-8cb2-04ab2b9213ae'} Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08028949-8eca-4017-8cb2-04ab2b9213ae could not be found. Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08028949-8eca-4017-8cb2-04ab2b9213ae could not be found. Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:07.135918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:07.139378 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:07.139378 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:07.139378 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:07.139378 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:20:07.139378 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:20:07.139378 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08028949-8eca-4017-8cb2-04ab2b9213ae could not be found. Aug 07 01:20:07.139378 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:07.139378 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cea06f13-d8ec-4cfd-8922-7fde9c665e83 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] Returning 404 to user: Instance 08028949-8eca-4017-8cb2-04ab2b9213ae could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:20:07.139378 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cea06f13-d8ec-4cfd-8922-7fde9c665e83 tempest-MigrationsAdminTest-2018910474 tempest-MigrationsAdminTest-2018910474-project] 10.222.0.39 "GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae" status: 404 len: 111 microversion: 2.1 time: 0.041611 Aug 07 01:20:07.139378 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1218/2182] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:07 2022] GET /compute/v2.1/servers/08028949-8eca-4017-8cb2-04ab2b9213ae => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:20:07.147293 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-27da2533-d190-4b5a-985a-9a8c40f0e47f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:07.163348 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-27da2533-d190-4b5a-985a-9a8c40f0e47f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a" status: 200 len: 1309 microversion: 2.1 time: 0.548582 Aug 07 01:20:07.177229 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 965/2183] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:06 2022] GET /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a => generated 1309 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:07.336194 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c4803467-c7fc-45be-856b-91da22919e82 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Action: 'create', calling method: .version_select at 0x7f9e2475f700>, body: {"keypair": {"name": "tempest-keypair-969236097", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLe9i7ck3tSE96n62LQXl5NyIN1ArsgawMkYVQfftFk3stEJdVoooZm3soZjU6DLEWvVBGjq9L7OPBVLVIQlldWxmOu5gWRIIlDMrmJ9n5Y8QmJV12wTJZHtFNBlAgQAEA=="}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:07.354110 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-c4803467-c7fc-45be-856b-91da22919e82 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Getting quotas for project b06e7912f1fe423ea1b2a4bcdb90804a. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:20:07.360763 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-c4803467-c7fc-45be-856b-91da22919e82 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Getting quotas for user e4feb14c621b4090af8c965c9aaf0e2d and project b06e7912f1fe423ea1b2a4bcdb90804a. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:20:07.391151 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c4803467-c7fc-45be-856b-91da22919e82 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.125609 Aug 07 01:20:07.400817 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1219/2184] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:20:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:07.434921 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cc029430-4984-4ef6-92a0-8a446d42c4d3 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:07.435939 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-cc029430-4984-4ef6-92a0-8a446d42c4d3 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] [instance: 2de58a4c-7601-40e2-a4dc-073e102b659f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:07.439291 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e85277bd-e2ad-4b71-ae0e-647837a9245c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:07.439949 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e85277bd-e2ad-4b71-ae0e-647837a9245c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:07.445521 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc029430-4984-4ef6-92a0-8a446d42c4d3 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:07.446231 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc029430-4984-4ef6-92a0-8a446d42c4d3 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:07.447227 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc029430-4984-4ef6-92a0-8a446d42c4d3 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:07.448281 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc029430-4984-4ef6-92a0-8a446d42c4d3 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:07.449032 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc029430-4984-4ef6-92a0-8a446d42c4d3 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:07.449765 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc029430-4984-4ef6-92a0-8a446d42c4d3 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:07.453315 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e85277bd-e2ad-4b71-ae0e-647837a9245c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:07.453802 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e85277bd-e2ad-4b71-ae0e-647837a9245c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:07.454249 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e85277bd-e2ad-4b71-ae0e-647837a9245c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:07.454981 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e85277bd-e2ad-4b71-ae0e-647837a9245c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:07.455446 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e85277bd-e2ad-4b71-ae0e-647837a9245c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:07.455906 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e85277bd-e2ad-4b71-ae0e-647837a9245c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:07.721521 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e85277bd-e2ad-4b71-ae0e-647837a9245c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:07.730216 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e85277bd-e2ad-4b71-ae0e-647837a9245c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1515 microversion: 2.1 time: 0.295589 Aug 07 01:20:07.730815 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1220/2185] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:07 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1515 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:07.851255 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-cc029430-4984-4ef6-92a0-8a446d42c4d3 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f8680c2a39400c8fcfc221872fa299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5897e4c216e646aaa3a4c9ec2c7a1cfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:07.862633 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cc029430-4984-4ef6-92a0-8a446d42c4d3 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] 10.222.0.39 "GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f" status: 200 len: 1396 microversion: 2.1 time: 0.432604 Aug 07 01:20:07.871698 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 966/2186] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:07 2022] GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f => generated 1396 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:08.117337 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9e04848c-5014-4d17-90f4-1d9998bdb55e tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:08.120032 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9e04848c-5014-4d17-90f4-1d9998bdb55e tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] [instance: 18856f67-eebe-4c6a-89bc-4a2e60408d2e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:08.133260 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e04848c-5014-4d17-90f4-1d9998bdb55e tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:08.134065 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e04848c-5014-4d17-90f4-1d9998bdb55e tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:08.134734 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e04848c-5014-4d17-90f4-1d9998bdb55e tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:08.136319 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e04848c-5014-4d17-90f4-1d9998bdb55e tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:08.137007 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e04848c-5014-4d17-90f4-1d9998bdb55e tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:08.137683 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e04848c-5014-4d17-90f4-1d9998bdb55e tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:08.191307 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7e45452f-61ef-4fcc-832c-5dadb662f5a5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:08.195645 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7e45452f-61ef-4fcc-832c-5dadb662f5a5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 937ef9c3-acf0-4874-846f-fde53d884d0a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:08.222657 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e45452f-61ef-4fcc-832c-5dadb662f5a5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:08.223560 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e45452f-61ef-4fcc-832c-5dadb662f5a5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:08.225201 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e45452f-61ef-4fcc-832c-5dadb662f5a5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:08.226287 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e45452f-61ef-4fcc-832c-5dadb662f5a5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:08.227025 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e45452f-61ef-4fcc-832c-5dadb662f5a5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:08.228825 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e45452f-61ef-4fcc-832c-5dadb662f5a5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:08.417397 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9e04848c-5014-4d17-90f4-1d9998bdb55e tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0e7a058704483bbad57ef73de92e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622262beb7574e388c20207cccd5073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:08.425550 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9e04848c-5014-4d17-90f4-1d9998bdb55e tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] 10.222.0.39 "GET /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e" status: 200 len: 1470 microversion: 2.1 time: 0.314107 Aug 07 01:20:08.439257 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1221/2187] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:08 2022] GET /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e => generated 1470 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:08.679374 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7e45452f-61ef-4fcc-832c-5dadb662f5a5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:08.696882 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7e45452f-61ef-4fcc-832c-5dadb662f5a5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a" status: 200 len: 1309 microversion: 2.1 time: 0.514717 Aug 07 01:20:08.713222 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 967/2188] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:08 2022] GET /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a => generated 1309 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:08.763763 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-2c5f91c8-ac7d-4d85-8039-717209a7b974 req-058de511-4f7c-47a0-b53a-c60a6a493b2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2de58a4c-7601-40e2-a4dc-073e102b659f", "name": "network-vif-plugged", "status": "completed", "tag": "5e510ccb-df6b-4f78-97bf-bbc62a3514bf"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:08.786336 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2c5f91c8-ac7d-4d85-8039-717209a7b974 req-058de511-4f7c-47a0-b53a-c60a6a493b2f service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:08.787844 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2c5f91c8-ac7d-4d85-8039-717209a7b974 req-058de511-4f7c-47a0-b53a-c60a6a493b2f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:08.788895 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2c5f91c8-ac7d-4d85-8039-717209a7b974 req-058de511-4f7c-47a0-b53a-c60a6a493b2f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:08.837368 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-2c5f91c8-ac7d-4d85-8039-717209a7b974 req-058de511-4f7c-47a0-b53a-c60a6a493b2f service nova] Creating event network-vif-plugged:5e510ccb-df6b-4f78-97bf-bbc62a3514bf for instance 2de58a4c-7601-40e2-a4dc-073e102b659f on n-h1-master-1 Aug 07 01:20:08.852623 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-2c5f91c8-ac7d-4d85-8039-717209a7b974 req-058de511-4f7c-47a0-b53a-c60a6a493b2f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.424588 Aug 07 01:20:08.861379 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1222/2189] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:08.878263 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1ac1a231-1817-489e-926e-f0c2e5f53b17 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:08.881377 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1ac1a231-1817-489e-926e-f0c2e5f53b17 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:08.918538 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ac1a231-1817-489e-926e-f0c2e5f53b17 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:08.919556 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ac1a231-1817-489e-926e-f0c2e5f53b17 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:08.920300 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ac1a231-1817-489e-926e-f0c2e5f53b17 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:08.923835 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ac1a231-1817-489e-926e-f0c2e5f53b17 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:08.927379 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ac1a231-1817-489e-926e-f0c2e5f53b17 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:08.928770 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ac1a231-1817-489e-926e-f0c2e5f53b17 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:09.055590 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-895941af-d5ae-4d15-8313-734c72a30f09 tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:09.056441 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-895941af-d5ae-4d15-8313-734c72a30f09 tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] [instance: 4e7224e7-8317-47a0-a092-21bddb9f2992] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:09.060208 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:09.070084 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-895941af-d5ae-4d15-8313-734c72a30f09 tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] HTTP exception thrown: Instance 4e7224e7-8317-47a0-a092-21bddb9f2992 could not be found. Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-895941af-d5ae-4d15-8313-734c72a30f09 tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Request method failure captured: Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/servers/4e7224e7-8317-47a0-a092-21bddb9f2992/action HTTP/1.1 Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 15 Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xM2i5PjLd9zMujLq8T6HkvkpG6R1LtQH8ywXJi1oPx4tNR-lEKd8E6A7RquOzc_s0tU2sRD6K6SqhM54YBIkDNT8StCzVVNCv6zr_J6h-AfMLyQp5jtxndmDquwtF8LV4H_LDYFOUzzGa80PDiQou8L-YvxrAg0wl9IQQ-AZJK3icM Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 585770175580432e87542c05b895ae62 Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1039037542 Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,admin,member Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,admin,member Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/585770175580432e87542c05b895ae62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_585770175580432e87542c05b895ae62", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/585770175580432e87542c05b895ae62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/585770175580432e87542c05b895ae62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1039037542 Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 585770175580432e87542c05b895ae62 Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1039037542 Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersAdminNegativeTestJSON-1039037542-project-admin Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 0c97cf736912462ca8ebb8e3292b4881 Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1039037542-project-admin Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: {"migrate": {}} Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 4e7224e7-8317-47a0-a092-21bddb9f2992 could not be found. Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '4e7224e7-8317-47a0-a092-21bddb9f2992', 'body': {'migrate': {}}} Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e7224e7-8317-47a0-a092-21bddb9f2992 could not be found. Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e7224e7-8317-47a0-a092-21bddb9f2992 could not be found. Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:09.076242 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:09.080231 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:09.080231 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:09.080231 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:20:09.080231 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:20:09.080231 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e7224e7-8317-47a0-a092-21bddb9f2992 could not be found. Aug 07 01:20:09.080231 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:09.082412 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-895941af-d5ae-4d15-8313-734c72a30f09 tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Returning 404 to user: Instance 4e7224e7-8317-47a0-a092-21bddb9f2992 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:20:09.089435 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-895941af-d5ae-4d15-8313-734c72a30f09 tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/4e7224e7-8317-47a0-a092-21bddb9f2992/action" status: 404 len: 111 microversion: 2.1 time: 0.374611 Aug 07 01:20:09.094992 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 968/2190] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:20:08 2022] POST /compute/v2.1/servers/4e7224e7-8317-47a0-a092-21bddb9f2992/action => generated 111 bytes in 381 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:20:09.111288 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-df303fda-a0b4-41c6-8fd0-1b77d40a5611 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:09.113878 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-df303fda-a0b4-41c6-8fd0-1b77d40a5611 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] [instance: 2de58a4c-7601-40e2-a4dc-073e102b659f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:09.136356 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-df303fda-a0b4-41c6-8fd0-1b77d40a5611 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:09.142843 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-df303fda-a0b4-41c6-8fd0-1b77d40a5611 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:09.143976 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-df303fda-a0b4-41c6-8fd0-1b77d40a5611 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:09.147111 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-df303fda-a0b4-41c6-8fd0-1b77d40a5611 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:09.150728 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-df303fda-a0b4-41c6-8fd0-1b77d40a5611 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:09.151558 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-df303fda-a0b4-41c6-8fd0-1b77d40a5611 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:09.374308 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1ac1a231-1817-489e-926e-f0c2e5f53b17 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:09.388784 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1ac1a231-1817-489e-926e-f0c2e5f53b17 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1515 microversion: 2.1 time: 0.523869 Aug 07 01:20:09.389661 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1223/2191] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:08 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1515 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:09.395047 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-df25b28e-62b1-42ee-8aa0-ea1c8fe12bc9 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1141365888", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:09.469265 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-df25b28e-62b1-42ee-8aa0-ea1c8fe12bc9 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] validate_networks() for None {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:20:09.548280 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-df303fda-a0b4-41c6-8fd0-1b77d40a5611 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f8680c2a39400c8fcfc221872fa299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5897e4c216e646aaa3a4c9ec2c7a1cfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:09.562386 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-df303fda-a0b4-41c6-8fd0-1b77d40a5611 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] 10.222.0.39 "GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f" status: 200 len: 1396 microversion: 2.1 time: 0.465795 Aug 07 01:20:09.564834 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 969/2192] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:09 2022] GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f => generated 1396 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:09.754189 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e5f2c17f-47cf-4fd5-87b1-7b354f66d1da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:09.754958 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e5f2c17f-47cf-4fd5-87b1-7b354f66d1da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 937ef9c3-acf0-4874-846f-fde53d884d0a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:09.764843 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e5f2c17f-47cf-4fd5-87b1-7b354f66d1da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:09.765367 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e5f2c17f-47cf-4fd5-87b1-7b354f66d1da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:09.765852 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e5f2c17f-47cf-4fd5-87b1-7b354f66d1da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:09.766634 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e5f2c17f-47cf-4fd5-87b1-7b354f66d1da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:09.767097 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e5f2c17f-47cf-4fd5-87b1-7b354f66d1da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:09.769645 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e5f2c17f-47cf-4fd5-87b1-7b354f66d1da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:09.791381 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-df25b28e-62b1-42ee-8aa0-ea1c8fe12bc9 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:20:09.791818 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-df25b28e-62b1-42ee-8aa0-ea1c8fe12bc9 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:20:09.793127 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-df25b28e-62b1-42ee-8aa0-ea1c8fe12bc9 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:20:09.793700 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-df25b28e-62b1-42ee-8aa0-ea1c8fe12bc9 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:20:09.794117 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-df25b28e-62b1-42ee-8aa0-ea1c8fe12bc9 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:20:09.842348 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df25b28e-62b1-42ee-8aa0-ea1c8fe12bc9 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:09.843256 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df25b28e-62b1-42ee-8aa0-ea1c8fe12bc9 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:09.844371 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df25b28e-62b1-42ee-8aa0-ea1c8fe12bc9 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:09.845549 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df25b28e-62b1-42ee-8aa0-ea1c8fe12bc9 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:09.846013 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df25b28e-62b1-42ee-8aa0-ea1c8fe12bc9 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:09.846518 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df25b28e-62b1-42ee-8aa0-ea1c8fe12bc9 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:09.870262 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-df25b28e-62b1-42ee-8aa0-ea1c8fe12bc9 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Getting quotas for project 622262beb7574e388c20207cccd5073d. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:20:09.878222 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-df25b28e-62b1-42ee-8aa0-ea1c8fe12bc9 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Getting quotas for user 81d0e7a058704483bbad57ef73de92e6 and project 622262beb7574e388c20207cccd5073d. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:20:09.894715 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-df25b28e-62b1-42ee-8aa0-ea1c8fe12bc9 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:20:09.898065 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-df25b28e-62b1-42ee-8aa0-ea1c8fe12bc9 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] [instance: bf9703d0-041f-4641-8c33-40b9d2026255] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:20:09.969342 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-df25b28e-62b1-42ee-8aa0-ea1c8fe12bc9 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.577143 Aug 07 01:20:09.971111 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1224/2193] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:20:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:20:09.987560 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6a5d40e5-4aab-49e9-a3d9-01eeac7318f3 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:09.991479 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6a5d40e5-4aab-49e9-a3d9-01eeac7318f3 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] [instance: bf9703d0-041f-4641-8c33-40b9d2026255] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:10.085578 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6a5d40e5-4aab-49e9-a3d9-01eeac7318f3 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0e7a058704483bbad57ef73de92e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622262beb7574e388c20207cccd5073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:10.096550 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6a5d40e5-4aab-49e9-a3d9-01eeac7318f3 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] 10.222.0.39 "GET /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255" status: 200 len: 1222 microversion: 2.1 time: 0.117167 Aug 07 01:20:10.111507 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1225/2194] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:09 2022] GET /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255 => generated 1222 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:10.200124 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e5f2c17f-47cf-4fd5-87b1-7b354f66d1da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:10.221816 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e5f2c17f-47cf-4fd5-87b1-7b354f66d1da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a" status: 200 len: 1309 microversion: 2.1 time: 0.502075 Aug 07 01:20:10.223459 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 970/2195] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:09 2022] GET /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a => generated 1309 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:10.415135 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-001a91a8-4cef-405a-9975-2b4e145f1bf1 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:10.416727 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-001a91a8-4cef-405a-9975-2b4e145f1bf1 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:10.433735 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-001a91a8-4cef-405a-9975-2b4e145f1bf1 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:10.434689 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-001a91a8-4cef-405a-9975-2b4e145f1bf1 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:10.435321 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-001a91a8-4cef-405a-9975-2b4e145f1bf1 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:10.439423 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-001a91a8-4cef-405a-9975-2b4e145f1bf1 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:10.440168 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-001a91a8-4cef-405a-9975-2b4e145f1bf1 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:10.441352 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-001a91a8-4cef-405a-9975-2b4e145f1bf1 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:10.584991 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1bd9a0ae-d315-40fe-a2b0-361286d187a8 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:10.585610 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1bd9a0ae-d315-40fe-a2b0-361286d187a8 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] [instance: 2de58a4c-7601-40e2-a4dc-073e102b659f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:10.592175 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=4 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:10.633940 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1bd9a0ae-d315-40fe-a2b0-361286d187a8 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:10.638384 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1bd9a0ae-d315-40fe-a2b0-361286d187a8 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:10.639996 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1bd9a0ae-d315-40fe-a2b0-361286d187a8 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:10.645924 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1bd9a0ae-d315-40fe-a2b0-361286d187a8 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:10.648250 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1bd9a0ae-d315-40fe-a2b0-361286d187a8 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:10.651319 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1bd9a0ae-d315-40fe-a2b0-361286d187a8 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:10.749122 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-001a91a8-4cef-405a-9975-2b4e145f1bf1 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:10.758938 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-001a91a8-4cef-405a-9975-2b4e145f1bf1 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1515 microversion: 2.1 time: 0.347747 Aug 07 01:20:10.764935 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1226/2196] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:10 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1515 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:11.002495 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1bd9a0ae-d315-40fe-a2b0-361286d187a8 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f8680c2a39400c8fcfc221872fa299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5897e4c216e646aaa3a4c9ec2c7a1cfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:11.012291 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1bd9a0ae-d315-40fe-a2b0-361286d187a8 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] 10.222.0.39 "GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f" status: 200 len: 1578 microversion: 2.1 time: 0.431181 Aug 07 01:20:11.014167 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 971/2197] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:10 2022] GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f => generated 1578 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:11.036739 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ac2e96d3-2407-49c2-8159-57e6c39bc2bb tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:11.037254 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ac2e96d3-2407-49c2-8159-57e6c39bc2bb tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] [instance: 2de58a4c-7601-40e2-a4dc-073e102b659f] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:11.043745 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac2e96d3-2407-49c2-8159-57e6c39bc2bb tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:11.044272 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac2e96d3-2407-49c2-8159-57e6c39bc2bb tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:11.044876 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac2e96d3-2407-49c2-8159-57e6c39bc2bb tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:11.045596 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac2e96d3-2407-49c2-8159-57e6c39bc2bb tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:11.046057 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac2e96d3-2407-49c2-8159-57e6c39bc2bb tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:11.046491 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac2e96d3-2407-49c2-8159-57e6c39bc2bb tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:11.119504 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-80ea31dd-dafb-4aa7-b494-09d7b1183e08 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:11.120312 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-80ea31dd-dafb-4aa7-b494-09d7b1183e08 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] [instance: bf9703d0-041f-4641-8c33-40b9d2026255] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:11.123448 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=24 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:11.157173 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-80ea31dd-dafb-4aa7-b494-09d7b1183e08 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:11.160254 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-80ea31dd-dafb-4aa7-b494-09d7b1183e08 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:11.160999 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-80ea31dd-dafb-4aa7-b494-09d7b1183e08 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:11.162463 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-80ea31dd-dafb-4aa7-b494-09d7b1183e08 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:11.164408 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-80ea31dd-dafb-4aa7-b494-09d7b1183e08 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:11.165260 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-80ea31dd-dafb-4aa7-b494-09d7b1183e08 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:11.341210 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ac2e96d3-2407-49c2-8159-57e6c39bc2bb tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] 10.222.0.39 "GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.309642 Aug 07 01:20:11.342232 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1227/2198] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Aug 7 01:20:11 2022] GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f/os-interface => generated 285 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:11.348676 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-75791f7d-c672-4304-aa35-66387d55cb2b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:11.352304 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-75791f7d-c672-4304-aa35-66387d55cb2b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 937ef9c3-acf0-4874-846f-fde53d884d0a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:11.380538 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75791f7d-c672-4304-aa35-66387d55cb2b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:11.382117 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75791f7d-c672-4304-aa35-66387d55cb2b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:11.397294 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75791f7d-c672-4304-aa35-66387d55cb2b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:11.399066 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75791f7d-c672-4304-aa35-66387d55cb2b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:11.401764 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75791f7d-c672-4304-aa35-66387d55cb2b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:11.403071 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75791f7d-c672-4304-aa35-66387d55cb2b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:11.736891 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-75791f7d-c672-4304-aa35-66387d55cb2b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:11.754870 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-75791f7d-c672-4304-aa35-66387d55cb2b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a" status: 200 len: 1309 microversion: 2.1 time: 0.411193 Aug 07 01:20:11.757023 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1228/2199] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:11 2022] GET /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a => generated 1309 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:11.792970 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a1f0cf68-737b-4e04-82de-a044f8068803 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:11.793955 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a1f0cf68-737b-4e04-82de-a044f8068803 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:11.814069 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a1f0cf68-737b-4e04-82de-a044f8068803 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:11.825352 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a1f0cf68-737b-4e04-82de-a044f8068803 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:11.828093 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a1f0cf68-737b-4e04-82de-a044f8068803 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:11.832068 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a1f0cf68-737b-4e04-82de-a044f8068803 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:11.834205 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a1f0cf68-737b-4e04-82de-a044f8068803 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:11.834911 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a1f0cf68-737b-4e04-82de-a044f8068803 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:11.930155 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-80ea31dd-dafb-4aa7-b494-09d7b1183e08 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0e7a058704483bbad57ef73de92e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622262beb7574e388c20207cccd5073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:11.940812 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-80ea31dd-dafb-4aa7-b494-09d7b1183e08 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] 10.222.0.39 "GET /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255" status: 200 len: 1218 microversion: 2.1 time: 0.825042 Aug 07 01:20:11.948965 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 972/2200] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:11 2022] GET /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255 => generated 1218 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:12.452142 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a1f0cf68-737b-4e04-82de-a044f8068803 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:12.465125 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a1f0cf68-737b-4e04-82de-a044f8068803 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1515 microversion: 2.1 time: 0.679556 Aug 07 01:20:12.480065 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1229/2201] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:11 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1515 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:12.758524 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-7eafb714-04b7-4f48-8768-f5d8f32f9c5e req-718609e1-fe4e-4334-894e-20649e6c0265 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "937ef9c3-acf0-4874-846f-fde53d884d0a", "name": "network-vif-plugged", "status": "completed", "tag": "58804c58-1d5b-414f-bfba-63cb09aad77d"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:12.786634 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-7eafb714-04b7-4f48-8768-f5d8f32f9c5e req-718609e1-fe4e-4334-894e-20649e6c0265 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:12.787372 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-7eafb714-04b7-4f48-8768-f5d8f32f9c5e req-718609e1-fe4e-4334-894e-20649e6c0265 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:12.787984 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-7eafb714-04b7-4f48-8768-f5d8f32f9c5e req-718609e1-fe4e-4334-894e-20649e6c0265 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:12.795063 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c1a5dbc6-b99e-409f-98bc-d1fb21584e55 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:12.799455 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c1a5dbc6-b99e-409f-98bc-d1fb21584e55 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 937ef9c3-acf0-4874-846f-fde53d884d0a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:12.831665 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-7eafb714-04b7-4f48-8768-f5d8f32f9c5e req-718609e1-fe4e-4334-894e-20649e6c0265 service nova] Creating event network-vif-plugged:58804c58-1d5b-414f-bfba-63cb09aad77d for instance 937ef9c3-acf0-4874-846f-fde53d884d0a on n-h2-master-1 Aug 07 01:20:12.837505 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1a5dbc6-b99e-409f-98bc-d1fb21584e55 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:12.838590 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1a5dbc6-b99e-409f-98bc-d1fb21584e55 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:12.844028 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1a5dbc6-b99e-409f-98bc-d1fb21584e55 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:12.848623 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1a5dbc6-b99e-409f-98bc-d1fb21584e55 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:12.848802 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-7eafb714-04b7-4f48-8768-f5d8f32f9c5e req-718609e1-fe4e-4334-894e-20649e6c0265 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094746 Aug 07 01:20:12.849316 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 973/2202] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:12.852419 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1a5dbc6-b99e-409f-98bc-d1fb21584e55 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:12.853137 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1a5dbc6-b99e-409f-98bc-d1fb21584e55 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:13.246091 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4687338e-c042-4ac3-98df-4e9ab2c5b6c1 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Calling method '.version_select at 0x7f9e17e65c10>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:13.355639 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4687338e-c042-4ac3-98df-4e9ab2c5b6c1 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/71ce4cdf1cd645a9848172410c68b38f" status: 200 len: 371 microversion: 2.1 time: 0.420395 Aug 07 01:20:13.356588 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 974/2203] 10.222.0.39 () {58 vars in 1242 bytes} [Sun Aug 7 01:20:12 2022] GET /compute/v2.1/os-quota-sets/71ce4cdf1cd645a9848172410c68b38f => generated 371 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:20:13.372196 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cb268ef6-d0cf-45a1-96d9-a54d417128e5 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:13.373902 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-cb268ef6-d0cf-45a1-96d9-a54d417128e5 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] [instance: bf9703d0-041f-4641-8c33-40b9d2026255] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:13.383025 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cb268ef6-d0cf-45a1-96d9-a54d417128e5 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:13.383845 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cb268ef6-d0cf-45a1-96d9-a54d417128e5 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:13.384667 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cb268ef6-d0cf-45a1-96d9-a54d417128e5 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:13.385836 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cb268ef6-d0cf-45a1-96d9-a54d417128e5 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:13.386513 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cb268ef6-d0cf-45a1-96d9-a54d417128e5 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:13.387173 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cb268ef6-d0cf-45a1-96d9-a54d417128e5 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:13.487757 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-cb268ef6-d0cf-45a1-96d9-a54d417128e5 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0e7a058704483bbad57ef73de92e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622262beb7574e388c20207cccd5073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:13.502360 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cb268ef6-d0cf-45a1-96d9-a54d417128e5 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] 10.222.0.39 "GET /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255" status: 200 len: 1280 microversion: 2.1 time: 0.136153 Aug 07 01:20:13.503264 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 975/2204] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:13 2022] GET /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255 => generated 1280 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:13.511319 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c1646c40-1b05-4ffe-adb8-63c06f3a69ac tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Action: 'update', calling method: .version_select at 0x7f9e17ef8310>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:13.590078 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c1a5dbc6-b99e-409f-98bc-d1fb21584e55 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:13.603011 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c1a5dbc6-b99e-409f-98bc-d1fb21584e55 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a" status: 200 len: 1309 microversion: 2.1 time: 0.816752 Aug 07 01:20:13.604324 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1230/2205] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:12 2022] GET /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a => generated 1309 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:13.611350 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a2171b8f-88bd-4ce3-9c38-25156f46651e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:13.613432 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a2171b8f-88bd-4ce3-9c38-25156f46651e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:13.627087 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2171b8f-88bd-4ce3-9c38-25156f46651e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:13.630959 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2171b8f-88bd-4ce3-9c38-25156f46651e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:13.634828 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2171b8f-88bd-4ce3-9c38-25156f46651e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:13.637030 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2171b8f-88bd-4ce3-9c38-25156f46651e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:13.639976 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2171b8f-88bd-4ce3-9c38-25156f46651e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:13.640660 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2171b8f-88bd-4ce3-9c38-25156f46651e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:13.689686 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c1646c40-1b05-4ffe-adb8-63c06f3a69ac tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:13.695855 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c1646c40-1b05-4ffe-adb8-63c06f3a69ac tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:13.696822 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c1646c40-1b05-4ffe-adb8-63c06f3a69ac tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:13.702541 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c1646c40-1b05-4ffe-adb8-63c06f3a69ac tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:13.704369 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c1646c40-1b05-4ffe-adb8-63c06f3a69ac tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:13.706707 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c1646c40-1b05-4ffe-adb8-63c06f3a69ac tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:13.872811 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c1646c40-1b05-4ffe-adb8-63c06f3a69ac tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/71ce4cdf1cd645a9848172410c68b38f" status: 200 len: 328 microversion: 2.1 time: 0.368184 Aug 07 01:20:13.883053 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 976/2206] 10.222.0.39 () {60 vars in 1262 bytes} [Sun Aug 7 01:20:13 2022] PUT /compute/v2.1/os-quota-sets/71ce4cdf1cd645a9848172410c68b38f => generated 328 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:14.068388 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-81b5e5e4-eed1-40ae-8523-d58f5951bbbc tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:14.070790 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-81b5e5e4-eed1-40ae-8523-d58f5951bbbc tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] [instance: 2de58a4c-7601-40e2-a4dc-073e102b659f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:14.100774 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-81b5e5e4-eed1-40ae-8523-d58f5951bbbc tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:14.103052 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-81b5e5e4-eed1-40ae-8523-d58f5951bbbc tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:14.103831 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-81b5e5e4-eed1-40ae-8523-d58f5951bbbc tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:14.104935 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-81b5e5e4-eed1-40ae-8523-d58f5951bbbc tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:14.105933 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-81b5e5e4-eed1-40ae-8523-d58f5951bbbc tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:14.106718 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-81b5e5e4-eed1-40ae-8523-d58f5951bbbc tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:14.339104 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a2171b8f-88bd-4ce3-9c38-25156f46651e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:14.357668 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a2171b8f-88bd-4ce3-9c38-25156f46651e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1521 microversion: 2.1 time: 0.752029 Aug 07 01:20:14.359718 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1231/2207] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:13 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1521 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:14.366666 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-d1f6bdcd-af22-41ad-b1d9-6fe11c641eee req-cab2b902-6ed6-401f-b148-98bec3bd104a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2de58a4c-7601-40e2-a4dc-073e102b659f", "tag": "5e510ccb-df6b-4f78-97bf-bbc62a3514bf"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:14.418609 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d1f6bdcd-af22-41ad-b1d9-6fe11c641eee req-cab2b902-6ed6-401f-b148-98bec3bd104a service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:14.419433 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d1f6bdcd-af22-41ad-b1d9-6fe11c641eee req-cab2b902-6ed6-401f-b148-98bec3bd104a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:14.420405 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d1f6bdcd-af22-41ad-b1d9-6fe11c641eee req-cab2b902-6ed6-401f-b148-98bec3bd104a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:14.439535 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-d1f6bdcd-af22-41ad-b1d9-6fe11c641eee req-cab2b902-6ed6-401f-b148-98bec3bd104a service nova] Creating event network-changed:5e510ccb-df6b-4f78-97bf-bbc62a3514bf for instance 2de58a4c-7601-40e2-a4dc-073e102b659f on n-h1-master-1 Aug 07 01:20:14.451556 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-d1f6bdcd-af22-41ad-b1d9-6fe11c641eee req-cab2b902-6ed6-401f-b148-98bec3bd104a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089728 Aug 07 01:20:14.452946 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1232/2208] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:14.522306 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-81b5e5e4-eed1-40ae-8523-d58f5951bbbc tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f8680c2a39400c8fcfc221872fa299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5897e4c216e646aaa3a4c9ec2c7a1cfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:14.537362 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-81b5e5e4-eed1-40ae-8523-d58f5951bbbc tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] 10.222.0.39 "GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f" status: 200 len: 1578 microversion: 2.1 time: 0.503240 Aug 07 01:20:14.560129 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 977/2209] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:14 2022] GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f => generated 1578 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:14.568059 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-dfeaba8d-7fe1-44ae-b847-879271d6b9d3 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:14.582507 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-dfeaba8d-7fe1-44ae-b847-879271d6b9d3 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] [instance: bf9703d0-041f-4641-8c33-40b9d2026255] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:14.610564 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dfeaba8d-7fe1-44ae-b847-879271d6b9d3 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:14.612116 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dfeaba8d-7fe1-44ae-b847-879271d6b9d3 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:14.618866 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4c323242-738f-4d29-b364-3469b853f5b9 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1550398992", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:14.626986 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dfeaba8d-7fe1-44ae-b847-879271d6b9d3 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:14.628787 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dfeaba8d-7fe1-44ae-b847-879271d6b9d3 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:14.631727 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dfeaba8d-7fe1-44ae-b847-879271d6b9d3 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:14.632573 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dfeaba8d-7fe1-44ae-b847-879271d6b9d3 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:14.718349 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-4c323242-738f-4d29-b364-3469b853f5b9 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] validate_networks() for None {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:20:15.097875 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-dfeaba8d-7fe1-44ae-b847-879271d6b9d3 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0e7a058704483bbad57ef73de92e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622262beb7574e388c20207cccd5073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:15.111606 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-dfeaba8d-7fe1-44ae-b847-879271d6b9d3 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] 10.222.0.39 "GET /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255" status: 200 len: 1322 microversion: 2.1 time: 0.549679 Aug 07 01:20:15.112505 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 978/2210] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:14 2022] GET /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255 => generated 1322 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:15.133044 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e1fac894-5962-45d3-a4a4-96a0cdd76702 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:15.134115 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e1fac894-5962-45d3-a4a4-96a0cdd76702 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 937ef9c3-acf0-4874-846f-fde53d884d0a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:15.147733 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1fac894-5962-45d3-a4a4-96a0cdd76702 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:15.148263 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1fac894-5962-45d3-a4a4-96a0cdd76702 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:15.148702 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1fac894-5962-45d3-a4a4-96a0cdd76702 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:15.151117 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1fac894-5962-45d3-a4a4-96a0cdd76702 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:15.151601 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1fac894-5962-45d3-a4a4-96a0cdd76702 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:15.157814 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1fac894-5962-45d3-a4a4-96a0cdd76702 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:15.360599 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-4c323242-738f-4d29-b364-3469b853f5b9 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:20:15.361701 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-4c323242-738f-4d29-b364-3469b853f5b9 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:20:15.362343 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-4c323242-738f-4d29-b364-3469b853f5b9 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:20:15.362905 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-4c323242-738f-4d29-b364-3469b853f5b9 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:20:15.363723 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-4c323242-738f-4d29-b364-3469b853f5b9 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:20:15.377648 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c323242-738f-4d29-b364-3469b853f5b9 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:15.378541 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c323242-738f-4d29-b364-3469b853f5b9 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:15.379213 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c323242-738f-4d29-b364-3469b853f5b9 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:15.380575 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c323242-738f-4d29-b364-3469b853f5b9 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:15.381463 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c323242-738f-4d29-b364-3469b853f5b9 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:15.381853 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c323242-738f-4d29-b364-3469b853f5b9 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:15.407978 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-4c323242-738f-4d29-b364-3469b853f5b9 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Getting quotas for project 71ce4cdf1cd645a9848172410c68b38f. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:20:15.416025 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-4c323242-738f-4d29-b364-3469b853f5b9 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Getting quotas for user ad21aaed5647465fb3b7921d1a376101 and project 71ce4cdf1cd645a9848172410c68b38f. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:20:15.437147 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.utils [None req-4c323242-738f-4d29-b364-3469b853f5b9 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] cores quota exceeded for 71ce4cdf1cd645a9848172410c68b38f, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119516) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 07 01:20:15.438852 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-4c323242-738f-4d29-b364-3469b853f5b9 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4c323242-738f-4d29-b364-3469b853f5b9 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Request method failure captured: Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 145 Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xNLPji4j81MxWz-5n6Tg-Tm24vpYgCNyIHvmQl-BwfdMKIAGAogdLqbVr_4_8dWrTLHD05zWB54ATe8JIYE4b4CZ_MGpnQYNuDB1cw91mqWCYRTtHU4bnRF6X7reJ3ulB3W1G1wrSPKhxhJFLpOyDebd_kklWkehdruHaJqP1xsTqg Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 71ce4cdf1cd645a9848172410c68b38f Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-QuotasAdminNegativeTest-434881158 Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/71ce4cdf1cd645a9848172410c68b38f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_71ce4cdf1cd645a9848172410c68b38f", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/71ce4cdf1cd645a9848172410c68b38f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/71ce4cdf1cd645a9848172410c68b38f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-QuotasAdminNegativeTest-434881158 Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 71ce4cdf1cd645a9848172410c68b38f Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-434881158 Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-QuotasAdminNegativeTest-434881158-project Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: ad21aaed5647465fb3b7921d1a376101 Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-QuotasAdminNegativeTest-434881158-project Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1550398992", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452"}} Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1550398992', 'imageRef': 'e825bd61-bf05-4bd4-aa72-78daf2231731', 'flavorRef': '452'}}} Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 07 01:20:15.457635 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4c323242-738f-4d29-b364-3469b853f5b9 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4c323242-738f-4d29-b364-3469b853f5b9 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.006799 Aug 07 01:20:15.466123 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1233/2211] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:20:14 2022] POST /compute/v2.1/servers => generated 111 bytes in 1010 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:20:15.480690 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-82033761-3af9-4dd9-9d64-2ea1afe9cd34 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65d2a5ed-de60-4416-8694-f2884be02259"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:15.491395 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-82033761-3af9-4dd9-9d64-2ea1afe9cd34 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] [instance: 1bc2c437-e710-4af4-9928-76c48834cfa2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:15.526337 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-82033761-3af9-4dd9-9d64-2ea1afe9cd34 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:15.530233 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-82033761-3af9-4dd9-9d64-2ea1afe9cd34 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:15.533129 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-82033761-3af9-4dd9-9d64-2ea1afe9cd34 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:15.535557 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-82033761-3af9-4dd9-9d64-2ea1afe9cd34 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:15.538172 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-82033761-3af9-4dd9-9d64-2ea1afe9cd34 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:15.539648 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-82033761-3af9-4dd9-9d64-2ea1afe9cd34 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:15.691367 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:16.041308 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-82033761-3af9-4dd9-9d64-2ea1afe9cd34 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] 10.222.0.39 "POST /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.571947 Aug 07 01:20:16.045068 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1234/2212] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Aug 7 01:20:15 2022] POST /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2/os-volume_attachments => generated 194 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:16.059243 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3c9b5ebb-4655-4ce8-b8ec-1edd6b9a5c34 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:16.061248 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3c9b5ebb-4655-4ce8-b8ec-1edd6b9a5c34 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:16.083169 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c9b5ebb-4655-4ce8-b8ec-1edd6b9a5c34 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:16.084014 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c9b5ebb-4655-4ce8-b8ec-1edd6b9a5c34 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:16.087160 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c9b5ebb-4655-4ce8-b8ec-1edd6b9a5c34 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:16.088334 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c9b5ebb-4655-4ce8-b8ec-1edd6b9a5c34 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:16.089454 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c9b5ebb-4655-4ce8-b8ec-1edd6b9a5c34 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:16.094276 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c9b5ebb-4655-4ce8-b8ec-1edd6b9a5c34 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:16.133448 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e1fac894-5962-45d3-a4a4-96a0cdd76702 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:16.145246 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e1fac894-5962-45d3-a4a4-96a0cdd76702 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a" status: 200 len: 1309 microversion: 2.1 time: 1.019763 Aug 07 01:20:16.147768 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 979/2213] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:15 2022] GET /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a => generated 1309 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:16.153384 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9a56afb9-be6e-46fd-aafe-d3a29b5dc1c6 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Action: 'update', calling method: .version_select at 0x7f9e17f4fee0>, body: {"quota_set": {"cores": 20}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:16.307246 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a56afb9-be6e-46fd-aafe-d3a29b5dc1c6 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:16.307736 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a56afb9-be6e-46fd-aafe-d3a29b5dc1c6 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:16.309933 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a56afb9-be6e-46fd-aafe-d3a29b5dc1c6 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:16.311832 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a56afb9-be6e-46fd-aafe-d3a29b5dc1c6 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:16.313725 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a56afb9-be6e-46fd-aafe-d3a29b5dc1c6 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:16.314791 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a56afb9-be6e-46fd-aafe-d3a29b5dc1c6 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:16.462947 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9a56afb9-be6e-46fd-aafe-d3a29b5dc1c6 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/71ce4cdf1cd645a9848172410c68b38f" status: 200 len: 329 microversion: 2.1 time: 0.313704 Aug 07 01:20:16.465485 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 980/2214] 10.222.0.39 () {60 vars in 1262 bytes} [Sun Aug 7 01:20:16 2022] PUT /compute/v2.1/os-quota-sets/71ce4cdf1cd645a9848172410c68b38f => generated 329 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:16.475043 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-498269d5-6dc4-43c0-b3a7-763f5a085f98 req-53d8d467-04f9-426c-8974-f3c7aec6f35c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf9703d0-041f-4641-8c33-40b9d2026255", "tag": "883a9b6f-ab5f-4447-bca3-1a10085e3be6"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:16.487459 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-498269d5-6dc4-43c0-b3a7-763f5a085f98 req-53d8d467-04f9-426c-8974-f3c7aec6f35c service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:16.487978 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-498269d5-6dc4-43c0-b3a7-763f5a085f98 req-53d8d467-04f9-426c-8974-f3c7aec6f35c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:16.488587 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-498269d5-6dc4-43c0-b3a7-763f5a085f98 req-53d8d467-04f9-426c-8974-f3c7aec6f35c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:16.500738 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-498269d5-6dc4-43c0-b3a7-763f5a085f98 req-53d8d467-04f9-426c-8974-f3c7aec6f35c service nova] Creating event network-changed:883a9b6f-ab5f-4447-bca3-1a10085e3be6 for instance bf9703d0-041f-4641-8c33-40b9d2026255 on n-h1-master-1 Aug 07 01:20:16.506471 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-498269d5-6dc4-43c0-b3a7-763f5a085f98 req-53d8d467-04f9-426c-8974-f3c7aec6f35c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039464 Aug 07 01:20:16.507445 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 981/2215] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:16.514102 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-52b4c221-d4fb-4d60-b4cc-8d361b916ee2 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:16.516518 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-52b4c221-d4fb-4d60-b4cc-8d361b916ee2 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] [instance: bf9703d0-041f-4641-8c33-40b9d2026255] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:16.526533 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52b4c221-d4fb-4d60-b4cc-8d361b916ee2 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:16.531121 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52b4c221-d4fb-4d60-b4cc-8d361b916ee2 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:16.532547 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52b4c221-d4fb-4d60-b4cc-8d361b916ee2 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:16.535553 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52b4c221-d4fb-4d60-b4cc-8d361b916ee2 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:16.536546 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52b4c221-d4fb-4d60-b4cc-8d361b916ee2 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:16.539657 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52b4c221-d4fb-4d60-b4cc-8d361b916ee2 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:16.639742 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3c9b5ebb-4655-4ce8-b8ec-1edd6b9a5c34 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:16.652837 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3c9b5ebb-4655-4ce8-b8ec-1edd6b9a5c34 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1521 microversion: 2.1 time: 0.604261 Aug 07 01:20:16.668834 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1235/2216] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:16 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1521 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:16.688700 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-942ea7ca-c930-460f-862b-d1caaa515cc0 req-46cc3229-5f2c-47f2-8fc1-5c517b16c77f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed97583d-ce2f-4693-b2fe-aaebcf2dd66d", "name": "network-vif-unplugged", "status": "completed", "tag": "2e08f8ea-bd0a-4227-84c2-18a7b5c5fede"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:16.713577 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-942ea7ca-c930-460f-862b-d1caaa515cc0 req-46cc3229-5f2c-47f2-8fc1-5c517b16c77f service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:16.715973 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-942ea7ca-c930-460f-862b-d1caaa515cc0 req-46cc3229-5f2c-47f2-8fc1-5c517b16c77f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:16.718726 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-942ea7ca-c930-460f-862b-d1caaa515cc0 req-46cc3229-5f2c-47f2-8fc1-5c517b16c77f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:16.745499 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-942ea7ca-c930-460f-862b-d1caaa515cc0 req-46cc3229-5f2c-47f2-8fc1-5c517b16c77f service nova] Creating event network-vif-unplugged:2e08f8ea-bd0a-4227-84c2-18a7b5c5fede for instance ed97583d-ce2f-4693-b2fe-aaebcf2dd66d on n-h2-master-1 Aug 07 01:20:16.762889 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-942ea7ca-c930-460f-862b-d1caaa515cc0 req-46cc3229-5f2c-47f2-8fc1-5c517b16c77f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086150 Aug 07 01:20:16.769490 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1236/2217] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:16.781992 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-12b1b396-5e45-47a7-91ad-4e3ac615060f tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Calling method '.version_select at 0x7f9e24414430>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:16.792550 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-52b4c221-d4fb-4d60-b4cc-8d361b916ee2 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0e7a058704483bbad57ef73de92e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622262beb7574e388c20207cccd5073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:16.803194 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-52b4c221-d4fb-4d60-b4cc-8d361b916ee2 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] 10.222.0.39 "GET /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255" status: 200 len: 1322 microversion: 2.1 time: 0.294166 Aug 07 01:20:16.806324 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 982/2218] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:16 2022] GET /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255 => generated 1322 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:16.870666 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-575615c0-fcce-42ca-9bf9-ca7f6dc2d683 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:16.871302 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-575615c0-fcce-42ca-9bf9-ca7f6dc2d683 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:16.879608 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-575615c0-fcce-42ca-9bf9-ca7f6dc2d683 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:16.880167 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-575615c0-fcce-42ca-9bf9-ca7f6dc2d683 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:16.880623 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-575615c0-fcce-42ca-9bf9-ca7f6dc2d683 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:16.881354 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-575615c0-fcce-42ca-9bf9-ca7f6dc2d683 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:16.881906 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-575615c0-fcce-42ca-9bf9-ca7f6dc2d683 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:16.882515 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-575615c0-fcce-42ca-9bf9-ca7f6dc2d683 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:16.909600 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:16.969930 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-12b1b396-5e45-47a7-91ad-4e3ac615060f tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/71ce4cdf1cd645a9848172410c68b38f" status: 200 len: 371 microversion: 2.1 time: 0.194612 Aug 07 01:20:16.971076 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1237/2219] 10.222.0.39 () {58 vars in 1242 bytes} [Sun Aug 7 01:20:16 2022] GET /compute/v2.1/os-quota-sets/71ce4cdf1cd645a9848172410c68b38f => generated 371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:16.982135 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-91cf1cef-b273-4ba4-a428-065c0b9b24a7 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Action: 'update', calling method: .version_select at 0x7f9e24723430>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:17.086833 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91cf1cef-b273-4ba4-a428-065c0b9b24a7 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:17.089417 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91cf1cef-b273-4ba4-a428-065c0b9b24a7 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:17.090865 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91cf1cef-b273-4ba4-a428-065c0b9b24a7 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:17.091820 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91cf1cef-b273-4ba4-a428-065c0b9b24a7 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:17.094137 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91cf1cef-b273-4ba4-a428-065c0b9b24a7 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:17.094739 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91cf1cef-b273-4ba4-a428-065c0b9b24a7 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:17.150584 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-575615c0-fcce-42ca-9bf9-ca7f6dc2d683 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lazy-loading 'services' on Instance uuid acc886e0-c989-4105-8375-0c42d4e96404 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:20:17.168943 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-575615c0-fcce-42ca-9bf9-ca7f6dc2d683 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 2344 microversion: 2.25 time: 0.301961 Aug 07 01:20:17.170077 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 983/2220] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:16 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 2344 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:20:17.183414 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a013469c-6c04-4205-8456-6b406c1de4bd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:17.185482 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a013469c-6c04-4205-8456-6b406c1de4bd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 937ef9c3-acf0-4874-846f-fde53d884d0a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:17.199625 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a013469c-6c04-4205-8456-6b406c1de4bd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:17.200272 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a013469c-6c04-4205-8456-6b406c1de4bd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:17.206806 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a013469c-6c04-4205-8456-6b406c1de4bd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:17.208235 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a013469c-6c04-4205-8456-6b406c1de4bd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:17.209113 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a013469c-6c04-4205-8456-6b406c1de4bd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:17.210027 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a013469c-6c04-4205-8456-6b406c1de4bd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:17.221666 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-91cf1cef-b273-4ba4-a428-065c0b9b24a7 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/71ce4cdf1cd645a9848172410c68b38f" status: 200 len: 328 microversion: 2.1 time: 0.243185 Aug 07 01:20:17.222702 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1238/2221] 10.222.0.39 () {60 vars in 1262 bytes} [Sun Aug 7 01:20:16 2022] PUT /compute/v2.1/os-quota-sets/71ce4cdf1cd645a9848172410c68b38f => generated 328 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:20:17.228229 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-47181124-5436-464e-881b-b3123646ba89 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:17.232363 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:20:17.232363 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:20:17.233924 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-47181124-5436-464e-881b-b3123646ba89 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:17.235256 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-47181124-5436-464e-881b-b3123646ba89 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:17.235936 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-47181124-5436-464e-881b-b3123646ba89 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:17.242700 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-47181124-5436-464e-881b-b3123646ba89 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:17.245334 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-47181124-5436-464e-881b-b3123646ba89 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:17.247372 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-47181124-5436-464e-881b-b3123646ba89 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:17.314419 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-47181124-5436-464e-881b-b3123646ba89 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.090370 Aug 07 01:20:17.315355 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1239/2222] 10.222.0.39 () {60 vars in 1217 bytes} [Sun Aug 7 01:20:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:20:17.329273 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9e8ac05b-6398-4f89-b740-5528b84bc8b3 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1702868297", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:17.413186 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a013469c-6c04-4205-8456-6b406c1de4bd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:17.425921 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a013469c-6c04-4205-8456-6b406c1de4bd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a" status: 200 len: 1490 microversion: 2.1 time: 0.254336 Aug 07 01:20:17.442017 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 984/2223] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:17 2022] GET /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a => generated 1490 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:17.449550 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-9e8ac05b-6398-4f89-b740-5528b84bc8b3 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] validate_networks() for None {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:20:17.680224 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-51661250-abb7-48d6-9981-ccbbffb525f9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:17.688527 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-51661250-abb7-48d6-9981-ccbbffb525f9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:17.702524 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-51661250-abb7-48d6-9981-ccbbffb525f9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:17.713214 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-51661250-abb7-48d6-9981-ccbbffb525f9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:17.714022 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-51661250-abb7-48d6-9981-ccbbffb525f9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:17.715018 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-51661250-abb7-48d6-9981-ccbbffb525f9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:17.715684 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-51661250-abb7-48d6-9981-ccbbffb525f9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:17.716688 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-51661250-abb7-48d6-9981-ccbbffb525f9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:17.819138 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-9e8ac05b-6398-4f89-b740-5528b84bc8b3 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:20:17.819605 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-9e8ac05b-6398-4f89-b740-5528b84bc8b3 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:20:17.820051 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-9e8ac05b-6398-4f89-b740-5528b84bc8b3 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:20:17.820898 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-9e8ac05b-6398-4f89-b740-5528b84bc8b3 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:20:17.821626 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-9e8ac05b-6398-4f89-b740-5528b84bc8b3 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:20:17.824633 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:17.837928 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e8ac05b-6398-4f89-b740-5528b84bc8b3 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:17.838718 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e8ac05b-6398-4f89-b740-5528b84bc8b3 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:17.840087 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e8ac05b-6398-4f89-b740-5528b84bc8b3 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:17.841044 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e8ac05b-6398-4f89-b740-5528b84bc8b3 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:17.841502 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e8ac05b-6398-4f89-b740-5528b84bc8b3 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:17.841962 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e8ac05b-6398-4f89-b740-5528b84bc8b3 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:17.869578 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-9e8ac05b-6398-4f89-b740-5528b84bc8b3 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Getting quotas for project 71ce4cdf1cd645a9848172410c68b38f. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:20:17.878362 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-9e8ac05b-6398-4f89-b740-5528b84bc8b3 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Getting quotas for user ad21aaed5647465fb3b7921d1a376101 and project 71ce4cdf1cd645a9848172410c68b38f. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:20:17.909926 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.utils [None req-9e8ac05b-6398-4f89-b740-5528b84bc8b3 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] instances quota exceeded for 71ce4cdf1cd645a9848172410c68b38f, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119516) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 07 01:20:17.916413 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-9e8ac05b-6398-4f89-b740-5528b84bc8b3 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9e8ac05b-6398-4f89-b740-5528b84bc8b3 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Request method failure captured: Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 145 Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xNLPji4j81MxWz-5n6Tg-Tm24vpYgCNyIHvmQl-BwfdMKIAGAogdLqbVr_4_8dWrTLHD05zWB54ATe8JIYE4b4CZ_MGpnQYNuDB1cw91mqWCYRTtHU4bnRF6X7reJ3ulB3W1G1wrSPKhxhJFLpOyDebd_kklWkehdruHaJqP1xsTqg Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 71ce4cdf1cd645a9848172410c68b38f Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-QuotasAdminNegativeTest-434881158 Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/71ce4cdf1cd645a9848172410c68b38f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_71ce4cdf1cd645a9848172410c68b38f", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/71ce4cdf1cd645a9848172410c68b38f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/71ce4cdf1cd645a9848172410c68b38f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-QuotasAdminNegativeTest-434881158 Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 71ce4cdf1cd645a9848172410c68b38f Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-434881158 Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-QuotasAdminNegativeTest-434881158-project Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: ad21aaed5647465fb3b7921d1a376101 Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-QuotasAdminNegativeTest-434881158-project Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1702868297", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452"}} Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1702868297', 'imageRef': 'e825bd61-bf05-4bd4-aa72-78daf2231731', 'flavorRef': '452'}}} Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 07 01:20:17.921918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 07 01:20:17.926213 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 07 01:20:17.926213 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 07 01:20:17.926213 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 07 01:20:17.926213 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 07 01:20:17.926213 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 07 01:20:17.926213 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 07 01:20:17.926213 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:17.926213 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:17.926213 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:17.926213 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:17.926213 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:17.926213 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:17.926213 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:20:17.926213 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:20:17.926213 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:20:17.926213 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:20:17.926213 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:20:17.926213 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:20:17.926213 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:20:17.926213 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:20:17.926213 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:20:17.926213 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:20:17.926213 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 07 01:20:17.926213 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 07 01:20:17.926213 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 07 01:20:17.926213 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 07 01:20:17.926213 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:17.926213 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:17.926213 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:17.926213 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:17.926213 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:17.926213 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:17.926213 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:20:17.926213 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:20:17.926213 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 07 01:20:17.926213 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:17.932265 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9e8ac05b-6398-4f89-b740-5528b84bc8b3 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:20:17.933825 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9e8ac05b-6398-4f89-b740-5528b84bc8b3 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.617474 Aug 07 01:20:17.938221 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1240/2224] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:20:17 2022] POST /compute/v2.1/servers => generated 119 bytes in 622 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:20:17.944900 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c9025dc7-e957-4b99-bcba-4acfe08099b8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2018819603", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "339d8f21-b38d-49c3-8efe-8ffee4d616dc"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:18.027734 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-c9025dc7-e957-4b99-bcba-4acfe08099b8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] validate_networks() for [('339d8f21-b38d-49c3-8efe-8ffee4d616dc', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:20:18.045760 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-51661250-abb7-48d6-9981-ccbbffb525f9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:18.057724 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-51661250-abb7-48d6-9981-ccbbffb525f9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1521 microversion: 2.1 time: 0.387135 Aug 07 01:20:18.059593 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 985/2225] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:17 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1521 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:18.065933 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6afdc550-0beb-41c1-968f-e7ec29b8ad0a tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:18.067316 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6afdc550-0beb-41c1-968f-e7ec29b8ad0a tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] [instance: bf9703d0-041f-4641-8c33-40b9d2026255] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:18.074648 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6afdc550-0beb-41c1-968f-e7ec29b8ad0a tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:18.075498 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6afdc550-0beb-41c1-968f-e7ec29b8ad0a tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:18.076302 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6afdc550-0beb-41c1-968f-e7ec29b8ad0a tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:18.077412 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6afdc550-0beb-41c1-968f-e7ec29b8ad0a tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:18.078795 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6afdc550-0beb-41c1-968f-e7ec29b8ad0a tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:18.079446 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6afdc550-0beb-41c1-968f-e7ec29b8ad0a tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:18.364585 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6afdc550-0beb-41c1-968f-e7ec29b8ad0a tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0e7a058704483bbad57ef73de92e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622262beb7574e388c20207cccd5073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:18.403202 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6afdc550-0beb-41c1-968f-e7ec29b8ad0a tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] 10.222.0.39 "GET /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255" status: 200 len: 1322 microversion: 2.1 time: 0.341755 Aug 07 01:20:18.404331 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 986/2226] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:18 2022] GET /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255 => generated 1322 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:18.413662 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-87686770-6008-42a0-aa04-e22cb8db6a66 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Action: 'update', calling method: .version_select at 0x7f9e17eaf160>, body: {"quota_set": {"instances": 10}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:18.532751 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-87686770-6008-42a0-aa04-e22cb8db6a66 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:18.534581 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-87686770-6008-42a0-aa04-e22cb8db6a66 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:18.535970 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-87686770-6008-42a0-aa04-e22cb8db6a66 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:18.537434 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-87686770-6008-42a0-aa04-e22cb8db6a66 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:18.538088 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-87686770-6008-42a0-aa04-e22cb8db6a66 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:18.538672 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-87686770-6008-42a0-aa04-e22cb8db6a66 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:18.634072 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-87686770-6008-42a0-aa04-e22cb8db6a66 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/71ce4cdf1cd645a9848172410c68b38f" status: 200 len: 329 microversion: 2.1 time: 0.225752 Aug 07 01:20:18.635116 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 987/2227] 10.222.0.39 () {60 vars in 1262 bytes} [Sun Aug 7 01:20:18 2022] PUT /compute/v2.1/os-quota-sets/71ce4cdf1cd645a9848172410c68b38f => generated 329 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:18.649212 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3a9c226a-661b-4b6c-8603-35a0a9d32035 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Calling method '.version_select at 0x7f9e17fc5af0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:18.765873 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3a9c226a-661b-4b6c-8603-35a0a9d32035 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/71ce4cdf1cd645a9848172410c68b38f" status: 200 len: 371 microversion: 2.1 time: 0.119964 Aug 07 01:20:18.767027 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 988/2228] 10.222.0.39 () {58 vars in 1242 bytes} [Sun Aug 7 01:20:18 2022] GET /compute/v2.1/os-quota-sets/71ce4cdf1cd645a9848172410c68b38f => generated 371 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:18.790016 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ea85f5cb-4200-40c7-9be9-dd7f43468340 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Action: 'update', calling method: .version_select at 0x7f9e17e46a60>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:18.918411 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ea85f5cb-4200-40c7-9be9-dd7f43468340 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:18.920400 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ea85f5cb-4200-40c7-9be9-dd7f43468340 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:18.921598 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ea85f5cb-4200-40c7-9be9-dd7f43468340 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:18.925053 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ea85f5cb-4200-40c7-9be9-dd7f43468340 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:18.926708 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ea85f5cb-4200-40c7-9be9-dd7f43468340 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:18.927258 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ea85f5cb-4200-40c7-9be9-dd7f43468340 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:19.072441 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ea85f5cb-4200-40c7-9be9-dd7f43468340 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/71ce4cdf1cd645a9848172410c68b38f" status: 200 len: 325 microversion: 2.1 time: 0.287877 Aug 07 01:20:19.077150 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 989/2229] 10.222.0.39 () {60 vars in 1262 bytes} [Sun Aug 7 01:20:18 2022] PUT /compute/v2.1/os-quota-sets/71ce4cdf1cd645a9848172410c68b38f => generated 325 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:19.083144 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-839b5319-6252-4998-af00-02e135cfeca8 req-5ef30982-fdd4-4c6c-bc26-4b7f2765000b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed97583d-ce2f-4693-b2fe-aaebcf2dd66d", "name": "network-vif-plugged", "status": "completed", "tag": "2e08f8ea-bd0a-4227-84c2-18a7b5c5fede"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:19.109400 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:19.125945 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-839b5319-6252-4998-af00-02e135cfeca8 req-5ef30982-fdd4-4c6c-bc26-4b7f2765000b service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:19.126986 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-839b5319-6252-4998-af00-02e135cfeca8 req-5ef30982-fdd4-4c6c-bc26-4b7f2765000b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:19.127712 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-839b5319-6252-4998-af00-02e135cfeca8 req-5ef30982-fdd4-4c6c-bc26-4b7f2765000b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:19.162727 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-839b5319-6252-4998-af00-02e135cfeca8 req-5ef30982-fdd4-4c6c-bc26-4b7f2765000b service nova] Creating event network-vif-plugged:2e08f8ea-bd0a-4227-84c2-18a7b5c5fede for instance ed97583d-ce2f-4693-b2fe-aaebcf2dd66d on n-h2-master-1 Aug 07 01:20:19.182561 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-839b5319-6252-4998-af00-02e135cfeca8 req-5ef30982-fdd4-4c6c-bc26-4b7f2765000b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104431 Aug 07 01:20:19.184055 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 990/2230] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:19.194959 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-901c01c0-c7a4-43e5-863e-cabd6bf14754 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:19.196246 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-901c01c0-c7a4-43e5-863e-cabd6bf14754 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:19.207119 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-901c01c0-c7a4-43e5-863e-cabd6bf14754 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:19.207999 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-901c01c0-c7a4-43e5-863e-cabd6bf14754 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:19.208662 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-901c01c0-c7a4-43e5-863e-cabd6bf14754 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:19.209790 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-901c01c0-c7a4-43e5-863e-cabd6bf14754 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:19.210500 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-901c01c0-c7a4-43e5-863e-cabd6bf14754 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:19.211466 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-901c01c0-c7a4-43e5-863e-cabd6bf14754 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:19.266231 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-c9025dc7-e957-4b99-bcba-4acfe08099b8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:20:19.268164 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-c9025dc7-e957-4b99-bcba-4acfe08099b8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:20:19.268872 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-c9025dc7-e957-4b99-bcba-4acfe08099b8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:20:19.269517 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-c9025dc7-e957-4b99-bcba-4acfe08099b8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:20:19.270140 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-c9025dc7-e957-4b99-bcba-4acfe08099b8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:20:19.291633 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c9025dc7-e957-4b99-bcba-4acfe08099b8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:19.298264 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c9025dc7-e957-4b99-bcba-4acfe08099b8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:19.299203 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c9025dc7-e957-4b99-bcba-4acfe08099b8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:19.300330 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c9025dc7-e957-4b99-bcba-4acfe08099b8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:19.302126 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c9025dc7-e957-4b99-bcba-4acfe08099b8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:19.309256 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c9025dc7-e957-4b99-bcba-4acfe08099b8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:19.342905 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-c9025dc7-e957-4b99-bcba-4acfe08099b8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Getting quotas for project efad066360cb45b3a6e9ba872118ea57. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:20:19.364966 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-c9025dc7-e957-4b99-bcba-4acfe08099b8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Getting quotas for user d4f7282c7251455086368d5274a4fac5 and project efad066360cb45b3a6e9ba872118ea57. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:20:19.391841 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c9025dc7-e957-4b99-bcba-4acfe08099b8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:20:19.395097 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c9025dc7-e957-4b99-bcba-4acfe08099b8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: a1c09528-36b8-4b0d-b03c-2d3351649579] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:20:19.473481 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c9025dc7-e957-4b99-bcba-4acfe08099b8 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.533689 Aug 07 01:20:19.476263 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1241/2231] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:20:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:20:19.487583 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-55ee590b-e936-41da-bdfd-f3857a585cd5 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2031055373", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:19.544657 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-901c01c0-c7a4-43e5-863e-cabd6bf14754 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:19.559798 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-901c01c0-c7a4-43e5-863e-cabd6bf14754 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1521 microversion: 2.1 time: 0.371581 Aug 07 01:20:19.570918 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 991/2232] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:19 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1521 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:19.580867 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-41b85318-be58-444c-aa5c-17cc1a5b04ce tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:19.583746 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-41b85318-be58-444c-aa5c-17cc1a5b04ce tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] [instance: bf9703d0-041f-4641-8c33-40b9d2026255] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:19.598772 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-41b85318-be58-444c-aa5c-17cc1a5b04ce tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:19.601588 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-41b85318-be58-444c-aa5c-17cc1a5b04ce tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:19.602063 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-41b85318-be58-444c-aa5c-17cc1a5b04ce tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:19.603362 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-55ee590b-e936-41da-bdfd-f3857a585cd5 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] validate_networks() for None {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:20:19.604745 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-41b85318-be58-444c-aa5c-17cc1a5b04ce tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:19.605254 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-41b85318-be58-444c-aa5c-17cc1a5b04ce tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:19.605697 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-41b85318-be58-444c-aa5c-17cc1a5b04ce tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:19.870139 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-41b85318-be58-444c-aa5c-17cc1a5b04ce tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0e7a058704483bbad57ef73de92e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622262beb7574e388c20207cccd5073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:19.883372 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-41b85318-be58-444c-aa5c-17cc1a5b04ce tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] 10.222.0.39 "GET /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255" status: 200 len: 1322 microversion: 2.1 time: 0.317660 Aug 07 01:20:19.884314 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 992/2233] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:19 2022] GET /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255 => generated 1322 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:19.903743 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fb881437-ccef-48b9-b58a-37ecc228863e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:19.904401 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fb881437-ccef-48b9-b58a-37ecc228863e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: a1c09528-36b8-4b0d-b03c-2d3351649579] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:20.052448 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fb881437-ccef-48b9-b58a-37ecc228863e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:20.069550 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fb881437-ccef-48b9-b58a-37ecc228863e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579" status: 200 len: 1209 microversion: 2.1 time: 0.180965 Aug 07 01:20:20.071015 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 993/2234] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:19 2022] GET /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579 => generated 1209 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:20.192237 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-55ee590b-e936-41da-bdfd-f3857a585cd5 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:20:20.192665 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-55ee590b-e936-41da-bdfd-f3857a585cd5 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:20:20.193162 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-55ee590b-e936-41da-bdfd-f3857a585cd5 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:20:20.193580 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-55ee590b-e936-41da-bdfd-f3857a585cd5 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:20:20.194045 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-55ee590b-e936-41da-bdfd-f3857a585cd5 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:20:20.202507 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-569dcf3d-05b2-43fc-a3d5-5267db18ce39 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e69bffdd-502c-4c90-aca0-d871b0d03cb3", "device": "/dev/xvdb"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:20.205722 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-569dcf3d-05b2-43fc-a3d5-5267db18ce39 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:20.212242 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-55ee590b-e936-41da-bdfd-f3857a585cd5 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:20.213056 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-55ee590b-e936-41da-bdfd-f3857a585cd5 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:20.213673 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-55ee590b-e936-41da-bdfd-f3857a585cd5 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:20.214337 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-569dcf3d-05b2-43fc-a3d5-5267db18ce39 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:20.214790 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-55ee590b-e936-41da-bdfd-f3857a585cd5 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:20.215010 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-569dcf3d-05b2-43fc-a3d5-5267db18ce39 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:20.215553 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-569dcf3d-05b2-43fc-a3d5-5267db18ce39 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:20.216396 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-569dcf3d-05b2-43fc-a3d5-5267db18ce39 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:20.216562 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-55ee590b-e936-41da-bdfd-f3857a585cd5 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:20.217179 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-569dcf3d-05b2-43fc-a3d5-5267db18ce39 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:20.217446 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-55ee590b-e936-41da-bdfd-f3857a585cd5 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:20.217792 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-569dcf3d-05b2-43fc-a3d5-5267db18ce39 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:20.248668 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-55ee590b-e936-41da-bdfd-f3857a585cd5 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Getting quotas for project 71ce4cdf1cd645a9848172410c68b38f. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:20:20.257479 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-55ee590b-e936-41da-bdfd-f3857a585cd5 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Getting quotas for user ad21aaed5647465fb3b7921d1a376101 and project 71ce4cdf1cd645a9848172410c68b38f. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:20:20.279402 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.utils [None req-55ee590b-e936-41da-bdfd-f3857a585cd5 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] ram quota exceeded for 71ce4cdf1cd645a9848172410c68b38f, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119516) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 07 01:20:20.280216 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-55ee590b-e936-41da-bdfd-f3857a585cd5 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-55ee590b-e936-41da-bdfd-f3857a585cd5 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Request method failure captured: Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 145 Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xNLPji4j81MxWz-5n6Tg-Tm24vpYgCNyIHvmQl-BwfdMKIAGAogdLqbVr_4_8dWrTLHD05zWB54ATe8JIYE4b4CZ_MGpnQYNuDB1cw91mqWCYRTtHU4bnRF6X7reJ3ulB3W1G1wrSPKhxhJFLpOyDebd_kklWkehdruHaJqP1xsTqg Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 71ce4cdf1cd645a9848172410c68b38f Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-QuotasAdminNegativeTest-434881158 Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/71ce4cdf1cd645a9848172410c68b38f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_71ce4cdf1cd645a9848172410c68b38f", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/71ce4cdf1cd645a9848172410c68b38f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/71ce4cdf1cd645a9848172410c68b38f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-QuotasAdminNegativeTest-434881158 Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 71ce4cdf1cd645a9848172410c68b38f Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-434881158 Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-QuotasAdminNegativeTest-434881158-project Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: ad21aaed5647465fb3b7921d1a376101 Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-QuotasAdminNegativeTest-434881158-project Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2031055373", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452"}} Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-2031055373', 'imageRef': 'e825bd61-bf05-4bd4-aa72-78daf2231731', 'flavorRef': '452'}}} Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 07 01:20:20.293588 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 07 01:20:20.297407 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 07 01:20:20.297407 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 07 01:20:20.297407 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 07 01:20:20.297407 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 07 01:20:20.297407 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 07 01:20:20.297407 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 07 01:20:20.297407 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:20.297407 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:20.297407 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:20.297407 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:20.297407 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:20.297407 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:20.297407 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:20:20.297407 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:20:20.297407 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:20:20.297407 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:20:20.297407 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:20:20.297407 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:20:20.297407 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:20:20.297407 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:20:20.297407 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:20:20.297407 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:20:20.297407 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 07 01:20:20.297407 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 07 01:20:20.297407 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 07 01:20:20.297407 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 07 01:20:20.297407 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:20.297407 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:20.297407 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:20.297407 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:20.297407 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:20.297407 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:20.297407 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:20:20.297407 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:20:20.297407 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 07 01:20:20.297407 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:20.297407 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-55ee590b-e936-41da-bdfd-f3857a585cd5 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:20:20.297407 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-55ee590b-e936-41da-bdfd-f3857a585cd5 tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.817204 Aug 07 01:20:20.304454 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1242/2235] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:20:19 2022] POST /compute/v2.1/servers => generated 110 bytes in 827 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:20:20.315629 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0473ca7f-dfea-426c-b667-514621c23637 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Action: 'update', calling method: .version_select at 0x7f9e244141f0>, body: {"quota_set": {"ram": 51200}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:20.461288 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0473ca7f-dfea-426c-b667-514621c23637 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:20.464417 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0473ca7f-dfea-426c-b667-514621c23637 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:20.465155 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0473ca7f-dfea-426c-b667-514621c23637 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:20.466458 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0473ca7f-dfea-426c-b667-514621c23637 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:20.467360 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0473ca7f-dfea-426c-b667-514621c23637 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:20.470156 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0473ca7f-dfea-426c-b667-514621c23637 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:20.601579 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0473ca7f-dfea-426c-b667-514621c23637 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/71ce4cdf1cd645a9848172410c68b38f" status: 200 len: 329 microversion: 2.1 time: 0.295616 Aug 07 01:20:20.602536 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1243/2236] 10.222.0.39 () {60 vars in 1262 bytes} [Sun Aug 7 01:20:20 2022] PUT /compute/v2.1/os-quota-sets/71ce4cdf1cd645a9848172410c68b38f => generated 329 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:20.608488 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2eaddcef-d9ab-4cf4-982d-d3a77a27be06 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:20.609260 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2eaddcef-d9ab-4cf4-982d-d3a77a27be06 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:20.617971 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2eaddcef-d9ab-4cf4-982d-d3a77a27be06 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:20.618610 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2eaddcef-d9ab-4cf4-982d-d3a77a27be06 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:20.619174 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2eaddcef-d9ab-4cf4-982d-d3a77a27be06 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:20.620082 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2eaddcef-d9ab-4cf4-982d-d3a77a27be06 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:20.620603 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2eaddcef-d9ab-4cf4-982d-d3a77a27be06 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:20.621088 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2eaddcef-d9ab-4cf4-982d-d3a77a27be06 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:20.667758 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-569dcf3d-05b2-43fc-a3d5-5267db18ce39 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "POST /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.468409 Aug 07 01:20:20.668826 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 994/2237] 10.222.0.39 () {62 vars in 1364 bytes} [Sun Aug 7 01:20:20 2022] POST /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404/os-volume_attachments => generated 194 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 01:20:20.678597 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b5e7d77b-945d-4a88-bef3-eab2560e601d tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Action: 'update', calling method: .version_select at 0x7f9e17eaf4c0>, body: {"quota_set": {"ram": 0}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:20.689480 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b5e7d77b-945d-4a88-bef3-eab2560e601d tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'ad21aaed5647465fb3b7921d1a376101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ce4cdf1cd645a9848172410c68b38f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b5e7d77b-945d-4a88-bef3-eab2560e601d tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Request method failure captured: Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: request: PUT /compute/v2.1/os-quota-sets/71ce4cdf1cd645a9848172410c68b38f HTTP/1.1 Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 25 Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xNLPji4j81MxWz-5n6Tg-Tm24vpYgCNyIHvmQl-BwfdMKIAGAogdLqbVr_4_8dWrTLHD05zWB54ATe8JIYE4b4CZ_MGpnQYNuDB1cw91mqWCYRTtHU4bnRF6X7reJ3ulB3W1G1wrSPKhxhJFLpOyDebd_kklWkehdruHaJqP1xsTqg Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 71ce4cdf1cd645a9848172410c68b38f Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-QuotasAdminNegativeTest-434881158 Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/71ce4cdf1cd645a9848172410c68b38f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_71ce4cdf1cd645a9848172410c68b38f", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/71ce4cdf1cd645a9848172410c68b38f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/71ce4cdf1cd645a9848172410c68b38f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-QuotasAdminNegativeTest-434881158 Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 71ce4cdf1cd645a9848172410c68b38f Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-434881158 Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-QuotasAdminNegativeTest-434881158-project Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: ad21aaed5647465fb3b7921d1a376101 Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-QuotasAdminNegativeTest-434881158-project Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: {"quota_set": {"ram": 0}} Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '71ce4cdf1cd645a9848172410c68b38f', 'body': {'quota_set': {'ram': 0}}} Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 07 01:20:20.699596 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 07 01:20:20.712844 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 07 01:20:20.712844 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 07 01:20:20.712844 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 07 01:20:20.712844 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 07 01:20:20.712844 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 07 01:20:20.712844 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:20.712844 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:20.712844 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:20.712844 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:20.712844 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:20.712844 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:20.712844 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 07 01:20:20.712844 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 07 01:20:20.712844 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 07 01:20:20.712844 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:20.712844 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b5e7d77b-945d-4a88-bef3-eab2560e601d tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:20:20.712844 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b5e7d77b-945d-4a88-bef3-eab2560e601d tempest-QuotasAdminNegativeTest-434881158 tempest-QuotasAdminNegativeTest-434881158-project] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/71ce4cdf1cd645a9848172410c68b38f" status: 403 len: 116 microversion: 2.1 time: 0.030731 Aug 07 01:20:20.712844 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 995/2238] 10.222.0.39 () {60 vars in 1262 bytes} [Sun Aug 7 01:20:20 2022] PUT /compute/v2.1/os-quota-sets/71ce4cdf1cd645a9848172410c68b38f => generated 116 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:20:20.841416 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2eaddcef-d9ab-4cf4-982d-d3a77a27be06 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:20.851929 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2eaddcef-d9ab-4cf4-982d-d3a77a27be06 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1521 microversion: 2.1 time: 0.248105 Aug 07 01:20:20.852735 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1244/2239] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:20 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:20.907692 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-27324e98-ff7b-4b89-9d29-3784efb92826 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:20.908718 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-27324e98-ff7b-4b89-9d29-3784efb92826 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] [instance: bf9703d0-041f-4641-8c33-40b9d2026255] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:20.917381 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27324e98-ff7b-4b89-9d29-3784efb92826 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:20.918232 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27324e98-ff7b-4b89-9d29-3784efb92826 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:20.918918 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27324e98-ff7b-4b89-9d29-3784efb92826 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:20.920024 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27324e98-ff7b-4b89-9d29-3784efb92826 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:20.920644 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27324e98-ff7b-4b89-9d29-3784efb92826 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:20.921367 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27324e98-ff7b-4b89-9d29-3784efb92826 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:21.095467 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dc2271aa-89e0-44fb-9c9a-08467d6da9b5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:21.096323 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-dc2271aa-89e0-44fb-9c9a-08467d6da9b5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: a1c09528-36b8-4b0d-b03c-2d3351649579] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:21.104417 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc2271aa-89e0-44fb-9c9a-08467d6da9b5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:21.105136 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc2271aa-89e0-44fb-9c9a-08467d6da9b5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:21.105723 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc2271aa-89e0-44fb-9c9a-08467d6da9b5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:21.106603 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc2271aa-89e0-44fb-9c9a-08467d6da9b5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:21.107175 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc2271aa-89e0-44fb-9c9a-08467d6da9b5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:21.107716 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc2271aa-89e0-44fb-9c9a-08467d6da9b5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:21.219093 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-27324e98-ff7b-4b89-9d29-3784efb92826 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0e7a058704483bbad57ef73de92e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622262beb7574e388c20207cccd5073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:21.228995 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-27324e98-ff7b-4b89-9d29-3784efb92826 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] 10.222.0.39 "GET /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255" status: 200 len: 1322 microversion: 2.1 time: 0.325863 Aug 07 01:20:21.233345 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 996/2240] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:20 2022] GET /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255 => generated 1322 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:21.246201 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-dc2271aa-89e0-44fb-9c9a-08467d6da9b5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:21.257186 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-dc2271aa-89e0-44fb-9c9a-08467d6da9b5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579" status: 200 len: 1261 microversion: 2.1 time: 0.166073 Aug 07 01:20:21.257877 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1245/2241] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:21 2022] GET /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579 => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:21.875253 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-04f5174c-24c4-479f-bced-e97886ade20e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:21.876543 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-04f5174c-24c4-479f-bced-e97886ade20e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:21.894014 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-dc60e87d-5232-4c81-80a9-0f22f47eb87d req-291577a2-9c27-4a97-882f-2d01bca6bfbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf9703d0-041f-4641-8c33-40b9d2026255", "name": "network-vif-plugged", "status": "completed", "tag": "883a9b6f-ab5f-4447-bca3-1a10085e3be6"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:21.905827 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-04f5174c-24c4-479f-bced-e97886ade20e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:21.909195 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-04f5174c-24c4-479f-bced-e97886ade20e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:21.910738 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-04f5174c-24c4-479f-bced-e97886ade20e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:21.913228 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-dc60e87d-5232-4c81-80a9-0f22f47eb87d req-291577a2-9c27-4a97-882f-2d01bca6bfbe service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:21.915592 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-04f5174c-24c4-479f-bced-e97886ade20e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:21.919161 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-04f5174c-24c4-479f-bced-e97886ade20e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:21.919857 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-04f5174c-24c4-479f-bced-e97886ade20e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:21.929230 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-dc60e87d-5232-4c81-80a9-0f22f47eb87d req-291577a2-9c27-4a97-882f-2d01bca6bfbe service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:21.930852 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-dc60e87d-5232-4c81-80a9-0f22f47eb87d req-291577a2-9c27-4a97-882f-2d01bca6bfbe service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:21.976748 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-dc60e87d-5232-4c81-80a9-0f22f47eb87d req-291577a2-9c27-4a97-882f-2d01bca6bfbe service nova] Creating event network-vif-plugged:883a9b6f-ab5f-4447-bca3-1a10085e3be6 for instance bf9703d0-041f-4641-8c33-40b9d2026255 on n-h1-master-1 Aug 07 01:20:21.986924 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-dc60e87d-5232-4c81-80a9-0f22f47eb87d req-291577a2-9c27-4a97-882f-2d01bca6bfbe service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097483 Aug 07 01:20:21.987854 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1246/2242] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:20:22.252966 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1be67e79-f870-4ae7-ab71-eca76dfb464e tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:22.254553 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1be67e79-f870-4ae7-ab71-eca76dfb464e tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] [instance: bf9703d0-041f-4641-8c33-40b9d2026255] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:22.268712 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1be67e79-f870-4ae7-ab71-eca76dfb464e tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:22.269426 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1be67e79-f870-4ae7-ab71-eca76dfb464e tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:22.270664 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1be67e79-f870-4ae7-ab71-eca76dfb464e tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:22.274259 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1be67e79-f870-4ae7-ab71-eca76dfb464e tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:22.275251 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1be67e79-f870-4ae7-ab71-eca76dfb464e tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:22.275983 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1be67e79-f870-4ae7-ab71-eca76dfb464e tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:22.494698 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1be67e79-f870-4ae7-ab71-eca76dfb464e tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0e7a058704483bbad57ef73de92e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622262beb7574e388c20207cccd5073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:22.505925 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1be67e79-f870-4ae7-ab71-eca76dfb464e tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] 10.222.0.39 "GET /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255" status: 200 len: 1322 microversion: 2.1 time: 0.259094 Aug 07 01:20:22.507083 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1247/2243] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:22 2022] GET /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255 => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:22.524355 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1eb8692a-0e65-4c71-aa30-eeb0dd34fa61 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:22.524643 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1eb8692a-0e65-4c71-aa30-eeb0dd34fa61 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: a1c09528-36b8-4b0d-b03c-2d3351649579] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:22.550488 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1eb8692a-0e65-4c71-aa30-eeb0dd34fa61 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:22.552838 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1eb8692a-0e65-4c71-aa30-eeb0dd34fa61 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:22.554729 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1eb8692a-0e65-4c71-aa30-eeb0dd34fa61 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:22.555701 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1eb8692a-0e65-4c71-aa30-eeb0dd34fa61 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:22.558491 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1eb8692a-0e65-4c71-aa30-eeb0dd34fa61 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:22.560175 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1eb8692a-0e65-4c71-aa30-eeb0dd34fa61 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:22.572024 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-04f5174c-24c4-479f-bced-e97886ade20e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:22.584885 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-04f5174c-24c4-479f-bced-e97886ade20e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1506 microversion: 2.1 time: 0.713060 Aug 07 01:20:22.586516 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 997/2244] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:21 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1506 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:22.617192 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-94d03d2f-6dfc-477e-b3c2-869be67dca72 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:22.618575 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-94d03d2f-6dfc-477e-b3c2-869be67dca72 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:22.633000 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94d03d2f-6dfc-477e-b3c2-869be67dca72 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:22.634071 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94d03d2f-6dfc-477e-b3c2-869be67dca72 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:22.635926 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94d03d2f-6dfc-477e-b3c2-869be67dca72 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:22.636909 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94d03d2f-6dfc-477e-b3c2-869be67dca72 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:22.637521 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94d03d2f-6dfc-477e-b3c2-869be67dca72 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:22.638271 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94d03d2f-6dfc-477e-b3c2-869be67dca72 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:22.931538 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1eb8692a-0e65-4c71-aa30-eeb0dd34fa61 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:22.950993 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1eb8692a-0e65-4c71-aa30-eeb0dd34fa61 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579" status: 200 len: 1309 microversion: 2.1 time: 0.440941 Aug 07 01:20:22.959944 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1248/2245] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:22 2022] GET /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579 => generated 1309 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:23.226263 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-94d03d2f-6dfc-477e-b3c2-869be67dca72 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:23.238549 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-94d03d2f-6dfc-477e-b3c2-869be67dca72 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 200 len: 1506 microversion: 2.1 time: 0.626265 Aug 07 01:20:23.241180 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 998/2246] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:22 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 1506 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:23.260342 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e3ecd7c6-1351-4c40-bd34-186aec9e89fc tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:23.261081 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e3ecd7c6-1351-4c40-bd34-186aec9e89fc tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:23.269690 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3ecd7c6-1351-4c40-bd34-186aec9e89fc tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:23.270600 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3ecd7c6-1351-4c40-bd34-186aec9e89fc tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:23.271182 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3ecd7c6-1351-4c40-bd34-186aec9e89fc tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:23.272457 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3ecd7c6-1351-4c40-bd34-186aec9e89fc tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:23.273158 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3ecd7c6-1351-4c40-bd34-186aec9e89fc tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:23.273942 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3ecd7c6-1351-4c40-bd34-186aec9e89fc tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:23.317987 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e3ecd7c6-1351-4c40-bd34-186aec9e89fc tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:20:23.465336 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e3ecd7c6-1351-4c40-bd34-186aec9e89fc tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 204 len: 0 microversion: 2.1 time: 0.208224 Aug 07 01:20:23.467792 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1249/2247] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:20:23 2022] DELETE /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:20:23.528281 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8b079041-72ef-4c97-9f63-46e55b9e258b tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:23.529181 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8b079041-72ef-4c97-9f63-46e55b9e258b tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] [instance: bf9703d0-041f-4641-8c33-40b9d2026255] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:23.541975 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8b079041-72ef-4c97-9f63-46e55b9e258b tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:23.542472 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8b079041-72ef-4c97-9f63-46e55b9e258b tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:23.542921 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8b079041-72ef-4c97-9f63-46e55b9e258b tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:23.559652 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8b079041-72ef-4c97-9f63-46e55b9e258b tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:23.560504 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8b079041-72ef-4c97-9f63-46e55b9e258b tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:23.562860 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8b079041-72ef-4c97-9f63-46e55b9e258b tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:23.691701 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-99b40df8-dd4b-428a-8ef7-e1ee1dec9e02 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1923254466", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "522f3ba8-208f-4b14-93bb-7dc525ec6e60"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:23.770080 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-99b40df8-dd4b-428a-8ef7-e1ee1dec9e02 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] validate_networks() for [('522f3ba8-208f-4b14-93bb-7dc525ec6e60', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:20:24.161904 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8b079041-72ef-4c97-9f63-46e55b9e258b tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0e7a058704483bbad57ef73de92e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622262beb7574e388c20207cccd5073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:24.179220 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8b079041-72ef-4c97-9f63-46e55b9e258b tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] 10.222.0.39 "GET /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255" status: 200 len: 1471 microversion: 2.1 time: 0.654560 Aug 07 01:20:24.182282 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 999/2248] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:23 2022] GET /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255 => generated 1471 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:24.200498 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d6c1dc3f-e2c1-4914-a923-3dd896b97bd9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:24.201497 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d6c1dc3f-e2c1-4914-a923-3dd896b97bd9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: a1c09528-36b8-4b0d-b03c-2d3351649579] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:24.231457 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d6c1dc3f-e2c1-4914-a923-3dd896b97bd9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:24.232087 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d6c1dc3f-e2c1-4914-a923-3dd896b97bd9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:24.232433 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d6c1dc3f-e2c1-4914-a923-3dd896b97bd9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:24.233244 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d6c1dc3f-e2c1-4914-a923-3dd896b97bd9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:24.233715 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d6c1dc3f-e2c1-4914-a923-3dd896b97bd9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:24.234186 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d6c1dc3f-e2c1-4914-a923-3dd896b97bd9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:24.354062 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-99b40df8-dd4b-428a-8ef7-e1ee1dec9e02 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:20:24.355396 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-99b40df8-dd4b-428a-8ef7-e1ee1dec9e02 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:20:24.356101 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-99b40df8-dd4b-428a-8ef7-e1ee1dec9e02 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:20:24.356724 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-99b40df8-dd4b-428a-8ef7-e1ee1dec9e02 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:20:24.357158 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-99b40df8-dd4b-428a-8ef7-e1ee1dec9e02 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:20:24.374409 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99b40df8-dd4b-428a-8ef7-e1ee1dec9e02 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:24.375521 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99b40df8-dd4b-428a-8ef7-e1ee1dec9e02 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:24.376071 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99b40df8-dd4b-428a-8ef7-e1ee1dec9e02 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:24.377202 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99b40df8-dd4b-428a-8ef7-e1ee1dec9e02 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:24.377794 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99b40df8-dd4b-428a-8ef7-e1ee1dec9e02 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:24.378426 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99b40df8-dd4b-428a-8ef7-e1ee1dec9e02 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:24.454664 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-99b40df8-dd4b-428a-8ef7-e1ee1dec9e02 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Getting quotas for project 4b4cbb3c65be44668687983c0a76901c. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:20:24.479571 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-99b40df8-dd4b-428a-8ef7-e1ee1dec9e02 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Getting quotas for user 4a359309c39a49c98f1f7aea48189efa and project 4b4cbb3c65be44668687983c0a76901c. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:20:24.509575 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-99b40df8-dd4b-428a-8ef7-e1ee1dec9e02 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:20:24.514614 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-99b40df8-dd4b-428a-8ef7-e1ee1dec9e02 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d2f5a46c-8f96-4c33-9146-1aba108920ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:20:24.540900 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d6c1dc3f-e2c1-4914-a923-3dd896b97bd9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:24.558031 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d6c1dc3f-e2c1-4914-a923-3dd896b97bd9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579" status: 200 len: 1309 microversion: 2.1 time: 0.369227 Aug 07 01:20:24.558673 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1000/2249] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:24 2022] GET /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579 => generated 1309 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:24.584636 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d30dc24e-f2a3-4722-9c39-574f5ad98a0b tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:24.585313 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d30dc24e-f2a3-4722-9c39-574f5ad98a0b tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] [instance: bf9703d0-041f-4641-8c33-40b9d2026255] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:24.601381 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d30dc24e-f2a3-4722-9c39-574f5ad98a0b tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:24.601907 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d30dc24e-f2a3-4722-9c39-574f5ad98a0b tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:24.603692 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d30dc24e-f2a3-4722-9c39-574f5ad98a0b tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:24.605372 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-99b40df8-dd4b-428a-8ef7-e1ee1dec9e02 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.920460 Aug 07 01:20:24.606546 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d30dc24e-f2a3-4722-9c39-574f5ad98a0b tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:24.608505 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d30dc24e-f2a3-4722-9c39-574f5ad98a0b tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:24.609732 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d30dc24e-f2a3-4722-9c39-574f5ad98a0b tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:24.615094 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1250/2250] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:20:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:20:24.627350 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-1994b7fc-c2f7-4d51-98f5-e608cf7c8ecf req-3e12b52e-00ba-4a6f-8f9c-c66e36f1240a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1c09528-36b8-4b0d-b03c-2d3351649579", "tag": "3069bfdf-1b77-40a1-bff5-d6fd063346fc"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:24.642638 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-1994b7fc-c2f7-4d51-98f5-e608cf7c8ecf req-3e12b52e-00ba-4a6f-8f9c-c66e36f1240a service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:24.643130 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-1994b7fc-c2f7-4d51-98f5-e608cf7c8ecf req-3e12b52e-00ba-4a6f-8f9c-c66e36f1240a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:24.643822 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-1994b7fc-c2f7-4d51-98f5-e608cf7c8ecf req-3e12b52e-00ba-4a6f-8f9c-c66e36f1240a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:24.665399 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-1994b7fc-c2f7-4d51-98f5-e608cf7c8ecf req-3e12b52e-00ba-4a6f-8f9c-c66e36f1240a service nova] Creating event network-changed:3069bfdf-1b77-40a1-bff5-d6fd063346fc for instance a1c09528-36b8-4b0d-b03c-2d3351649579 on n-h2-master-1 Aug 07 01:20:24.673102 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-1994b7fc-c2f7-4d51-98f5-e608cf7c8ecf req-3e12b52e-00ba-4a6f-8f9c-c66e36f1240a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054858 Aug 07 01:20:24.674064 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1251/2251] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:24.699484 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ba456764-9910-4920-886e-a6f27c61f01c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:24.705933 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-d30dc24e-f2a3-4722-9c39-574f5ad98a0b tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Lazy-loading 'flavor' on Instance uuid bf9703d0-041f-4641-8c33-40b9d2026255 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:20:24.714320 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ba456764-9910-4920-886e-a6f27c61f01c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d2f5a46c-8f96-4c33-9146-1aba108920ab] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:24.817191 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:24.857903 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d30dc24e-f2a3-4722-9c39-574f5ad98a0b tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255/action" status: 202 len: 0 microversion: 2.1 time: 0.297907 Aug 07 01:20:24.860922 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1001/2252] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:20:24 2022] POST /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:20:24.887598 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8c6bf589-5afd-4d09-99d4-7d5863056b8c tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:24.896927 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8c6bf589-5afd-4d09-99d4-7d5863056b8c tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] [instance: bf9703d0-041f-4641-8c33-40b9d2026255] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:24.902145 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ba456764-9910-4920-886e-a6f27c61f01c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:24.917072 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ba456764-9910-4920-886e-a6f27c61f01c tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab" status: 200 len: 1218 microversion: 2.1 time: 0.241465 Aug 07 01:20:24.923232 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8c6bf589-5afd-4d09-99d4-7d5863056b8c tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:24.923800 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1252/2253] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:24 2022] GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab => generated 1218 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:24.925018 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8c6bf589-5afd-4d09-99d4-7d5863056b8c tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:24.926344 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8c6bf589-5afd-4d09-99d4-7d5863056b8c tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:24.927264 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8c6bf589-5afd-4d09-99d4-7d5863056b8c tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:24.928476 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8c6bf589-5afd-4d09-99d4-7d5863056b8c tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:24.929110 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8c6bf589-5afd-4d09-99d4-7d5863056b8c tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:25.589553 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-884aacc5-e2f6-49a9-8812-c1f50eb4a907 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:25.590462 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-884aacc5-e2f6-49a9-8812-c1f50eb4a907 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: a1c09528-36b8-4b0d-b03c-2d3351649579] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:25.601332 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-884aacc5-e2f6-49a9-8812-c1f50eb4a907 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:25.602013 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-884aacc5-e2f6-49a9-8812-c1f50eb4a907 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:25.602615 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-884aacc5-e2f6-49a9-8812-c1f50eb4a907 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:25.604436 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-884aacc5-e2f6-49a9-8812-c1f50eb4a907 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:25.605321 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-884aacc5-e2f6-49a9-8812-c1f50eb4a907 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:25.606123 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-884aacc5-e2f6-49a9-8812-c1f50eb4a907 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:25.801390 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-884aacc5-e2f6-49a9-8812-c1f50eb4a907 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:25.819325 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-884aacc5-e2f6-49a9-8812-c1f50eb4a907 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579" status: 200 len: 1309 microversion: 2.1 time: 0.243072 Aug 07 01:20:25.827578 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1253/2254] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:25 2022] GET /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579 => generated 1309 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:25.942809 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a39f3d1b-baf2-4b60-9266-80d86ffb95b7 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:25.943984 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a39f3d1b-baf2-4b60-9266-80d86ffb95b7 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d2f5a46c-8f96-4c33-9146-1aba108920ab] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:25.957360 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a39f3d1b-baf2-4b60-9266-80d86ffb95b7 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:25.958032 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a39f3d1b-baf2-4b60-9266-80d86ffb95b7 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:25.964027 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a39f3d1b-baf2-4b60-9266-80d86ffb95b7 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:25.965340 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a39f3d1b-baf2-4b60-9266-80d86ffb95b7 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:25.965920 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a39f3d1b-baf2-4b60-9266-80d86ffb95b7 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:25.992698 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a39f3d1b-baf2-4b60-9266-80d86ffb95b7 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:26.114605 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a39f3d1b-baf2-4b60-9266-80d86ffb95b7 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:26.125053 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a39f3d1b-baf2-4b60-9266-80d86ffb95b7 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab" status: 200 len: 1214 microversion: 2.1 time: 0.186003 Aug 07 01:20:26.125916 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1254/2255] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:25 2022] GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab => generated 1214 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:26.170204 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8c6bf589-5afd-4d09-99d4-7d5863056b8c tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255" status: 200 len: 1630 microversion: 2.1 time: 1.287594 Aug 07 01:20:26.178288 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1002/2256] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:24 2022] GET /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255 => generated 1630 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:26.853021 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d87151db-828f-458c-9f81-42ade2bcb334 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:26.853707 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d87151db-828f-458c-9f81-42ade2bcb334 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: a1c09528-36b8-4b0d-b03c-2d3351649579] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:26.861884 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-d9457b31-131f-4108-ae49-2aa7cba3edb5 req-960f89be-9940-4a2a-82bc-ab78b4e44976 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed97583d-ce2f-4693-b2fe-aaebcf2dd66d", "name": "network-vif-deleted", "tag": "2e08f8ea-bd0a-4227-84c2-18a7b5c5fede"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:26.866279 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d87151db-828f-458c-9f81-42ade2bcb334 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:26.868639 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d87151db-828f-458c-9f81-42ade2bcb334 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:26.870381 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d87151db-828f-458c-9f81-42ade2bcb334 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:26.873671 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d87151db-828f-458c-9f81-42ade2bcb334 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:26.874430 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d87151db-828f-458c-9f81-42ade2bcb334 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:26.875918 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d87151db-828f-458c-9f81-42ade2bcb334 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:26.884958 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d9457b31-131f-4108-ae49-2aa7cba3edb5 req-960f89be-9940-4a2a-82bc-ab78b4e44976 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:26.896543 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d9457b31-131f-4108-ae49-2aa7cba3edb5 req-960f89be-9940-4a2a-82bc-ab78b4e44976 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:26.897647 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d9457b31-131f-4108-ae49-2aa7cba3edb5 req-960f89be-9940-4a2a-82bc-ab78b4e44976 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:26.940149 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-d9457b31-131f-4108-ae49-2aa7cba3edb5 req-960f89be-9940-4a2a-82bc-ab78b4e44976 service nova] Creating event network-vif-deleted:2e08f8ea-bd0a-4227-84c2-18a7b5c5fede for instance ed97583d-ce2f-4693-b2fe-aaebcf2dd66d on n-h2-master-1 Aug 07 01:20:26.969411 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-d9457b31-131f-4108-ae49-2aa7cba3edb5 req-960f89be-9940-4a2a-82bc-ab78b4e44976 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111396 Aug 07 01:20:26.970698 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1003/2257] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:27.151344 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-67b9e1d1-9e8a-4a7a-8842-4013bf4e66af tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:27.152855 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-67b9e1d1-9e8a-4a7a-8842-4013bf4e66af tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d2f5a46c-8f96-4c33-9146-1aba108920ab] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:27.168930 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-67b9e1d1-9e8a-4a7a-8842-4013bf4e66af tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:27.170259 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-67b9e1d1-9e8a-4a7a-8842-4013bf4e66af tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:27.173072 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-67b9e1d1-9e8a-4a7a-8842-4013bf4e66af tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:27.174214 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-67b9e1d1-9e8a-4a7a-8842-4013bf4e66af tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:27.174995 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-67b9e1d1-9e8a-4a7a-8842-4013bf4e66af tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:27.175675 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-67b9e1d1-9e8a-4a7a-8842-4013bf4e66af tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:27.271357 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d87151db-828f-458c-9f81-42ade2bcb334 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:27.279496 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-67b9e1d1-9e8a-4a7a-8842-4013bf4e66af tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:27.284573 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d87151db-828f-458c-9f81-42ade2bcb334 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579" status: 200 len: 1309 microversion: 2.1 time: 0.437952 Aug 07 01:20:27.285267 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1255/2258] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:26 2022] GET /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579 => generated 1309 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:27.289210 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-67b9e1d1-9e8a-4a7a-8842-4013bf4e66af tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab" status: 200 len: 1276 microversion: 2.1 time: 0.144307 Aug 07 01:20:27.290077 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ef141715-bb97-4fce-b0c6-1f7fee904012 tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:27.290774 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ef141715-bb97-4fce-b0c6-1f7fee904012 tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] [instance: bf9703d0-041f-4641-8c33-40b9d2026255] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:27.293451 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1004/2259] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:27 2022] GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab => generated 1276 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:27.308660 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:27.310317 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef141715-bb97-4fce-b0c6-1f7fee904012 tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:27.310774 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef141715-bb97-4fce-b0c6-1f7fee904012 tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:27.311241 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef141715-bb97-4fce-b0c6-1f7fee904012 tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:27.313525 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef141715-bb97-4fce-b0c6-1f7fee904012 tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:27.314023 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef141715-bb97-4fce-b0c6-1f7fee904012 tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:27.314456 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef141715-bb97-4fce-b0c6-1f7fee904012 tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:27.845323 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ef141715-bb97-4fce-b0c6-1f7fee904012 tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255" status: 200 len: 1613 microversion: 2.1 time: 0.558862 Aug 07 01:20:27.860143 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1256/2260] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:27 2022] GET /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255 => generated 1613 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:27.870244 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f55dc8b7-f0ca-4493-8977-45da02a84a52 tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:27.871174 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f55dc8b7-f0ca-4493-8977-45da02a84a52 tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] [instance: bf9703d0-041f-4641-8c33-40b9d2026255] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:27.890566 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f55dc8b7-f0ca-4493-8977-45da02a84a52 tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:27.891321 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f55dc8b7-f0ca-4493-8977-45da02a84a52 tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:27.891967 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f55dc8b7-f0ca-4493-8977-45da02a84a52 tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:27.892966 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f55dc8b7-f0ca-4493-8977-45da02a84a52 tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:27.893581 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f55dc8b7-f0ca-4493-8977-45da02a84a52 tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:27.894170 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f55dc8b7-f0ca-4493-8977-45da02a84a52 tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:27.934158 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-f55dc8b7-f0ca-4493-8977-45da02a84a52 tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] HTTP exception thrown: Cannot 'migrate' instance bf9703d0-041f-4641-8c33-40b9d2026255 while it is in vm_state suspended Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f55dc8b7-f0ca-4493-8977-45da02a84a52 tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Request method failure captured: Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255/action HTTP/1.1 Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 15 Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xM2i5PjLd9zMujLq8T6HkvkpG6R1LtQH8ywXJi1oPx4tNR-lEKd8E6A7RquOzc_s0tU2sRD6K6SqhM54YBIkDNT8StCzVVNCv6zr_J6h-AfMLyQp5jtxndmDquwtF8LV4H_LDYFOUzzGa80PDiQou8L-YvxrAg0wl9IQQ-AZJK3icM Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 585770175580432e87542c05b895ae62 Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1039037542 Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,admin,member Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,admin,member Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/585770175580432e87542c05b895ae62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_585770175580432e87542c05b895ae62", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/585770175580432e87542c05b895ae62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/585770175580432e87542c05b895ae62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1039037542 Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 585770175580432e87542c05b895ae62 Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1039037542 Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersAdminNegativeTestJSON-1039037542-project-admin Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 0c97cf736912462ca8ebb8e3292b4881 Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1039037542-project-admin Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: {"migrate": {}} Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: exception: Cannot 'migrate' instance bf9703d0-041f-4641-8c33-40b9d2026255 while it is in vm_state suspended Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'bf9703d0-041f-4641-8c33-40b9d2026255', 'body': {'migrate': {}}} Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bf9703d0-041f-4641-8c33-40b9d2026255 in vm_state suspended. Cannot resize while the instance is in this state. Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:20:27.936259 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:20:27.941058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:20:27.941058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 07 01:20:27.941058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 07 01:20:27.941058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 07 01:20:27.941058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 07 01:20:27.941058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance bf9703d0-041f-4641-8c33-40b9d2026255 while it is in vm_state suspended Aug 07 01:20:27.941058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:27.941058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:27.941058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:27.941058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:27.941058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:27.941058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:27.941058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:20:27.941058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:20:27.941058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance bf9703d0-041f-4641-8c33-40b9d2026255 while it is in vm_state suspended Aug 07 01:20:27.941058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:27.943011 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f55dc8b7-f0ca-4493-8977-45da02a84a52 tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Returning 409 to user: Cannot 'migrate' instance bf9703d0-041f-4641-8c33-40b9d2026255 while it is in vm_state suspended {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:20:27.944165 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f55dc8b7-f0ca-4493-8977-45da02a84a52 tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255/action" status: 409 len: 148 microversion: 2.1 time: 0.077809 Aug 07 01:20:27.944942 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1005/2261] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:20:27 2022] POST /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255/action => generated 148 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:20:27.957892 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-40af2121-7836-4292-95a8-6c936fb10a8f tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-40af2121-7836-4292-95a8-6c936fb10a8f tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Request method failure captured: Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e/action HTTP/1.1 Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 39 Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xM2i5PjLd9zMujLq8T6HkvkpG6R1LtQH8ywXJi1oPx4tNR-lEKd8E6A7RquOzc_s0tU2sRD6K6SqhM54YBIkDNT8StCzVVNCv6zr_J6h-AfMLyQp5jtxndmDquwtF8LV4H_LDYFOUzzGa80PDiQou8L-YvxrAg0wl9IQQ-AZJK3icM Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 585770175580432e87542c05b895ae62 Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1039037542 Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,admin,member Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,admin,member Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/585770175580432e87542c05b895ae62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_585770175580432e87542c05b895ae62", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/585770175580432e87542c05b895ae62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/585770175580432e87542c05b895ae62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1039037542 Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 585770175580432e87542c05b895ae62 Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1039037542 Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersAdminNegativeTestJSON-1039037542-project-admin Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 0c97cf736912462ca8ebb8e3292b4881 Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1039037542-project-admin Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: {"os-resetState": {"state": "invalid"}} Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '18856f67-eebe-4c6a-89bc-4a2e60408d2e', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'invalid' Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:20:27.962291 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:20:27.965732 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 07 01:20:27.965732 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:27.965732 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:27.965732 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:27.965732 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:27.965732 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:27.965732 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:27.965732 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:20:27.965732 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:20:27.965732 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 07 01:20:27.965732 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:27.967353 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-40af2121-7836-4292-95a8-6c936fb10a8f tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:20:27.968442 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-40af2121-7836-4292-95a8-6c936fb10a8f tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e/action" status: 400 len: 144 microversion: 2.1 time: 0.016936 Aug 07 01:20:27.978808 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-aca4d763-756c-4624-8bed-268a9b8e522a tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:27.979385 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1257/2262] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:20:27 2022] POST /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e/action => generated 144 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-aca4d763-756c-4624-8bed-268a9b8e522a tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Request method failure captured: Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e/action HTTP/1.1 Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 31 Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xM2i5PjLd9zMujLq8T6HkvkpG6R1LtQH8ywXJi1oPx4tNR-lEKd8E6A7RquOzc_s0tU2sRD6K6SqhM54YBIkDNT8StCzVVNCv6zr_J6h-AfMLyQp5jtxndmDquwtF8LV4H_LDYFOUzzGa80PDiQou8L-YvxrAg0wl9IQQ-AZJK3icM Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 585770175580432e87542c05b895ae62 Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1039037542 Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,admin,member Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,admin,member Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/585770175580432e87542c05b895ae62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_585770175580432e87542c05b895ae62", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/585770175580432e87542c05b895ae62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/585770175580432e87542c05b895ae62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1039037542 Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 585770175580432e87542c05b895ae62 Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1039037542 Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersAdminNegativeTestJSON-1039037542-project-admin Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 0c97cf736912462ca8ebb8e3292b4881 Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1039037542-project-admin Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: {"os-resetState": {"state": 1}} Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '18856f67-eebe-4c6a-89bc-4a2e60408d2e', 'body': {'os-resetState': {'state': 1}}} Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi 1 Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 07 01:20:27.983575 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:27.987799 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:27.987799 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:27.987799 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:27.987799 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:27.987799 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:27.987799 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:20:27.987799 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:20:27.987799 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 07 01:20:27.987799 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:27.989248 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-aca4d763-756c-4624-8bed-268a9b8e522a tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:20:27.991107 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-aca4d763-756c-4624-8bed-268a9b8e522a tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e/action" status: 400 len: 120 microversion: 2.1 time: 0.016163 Aug 07 01:20:27.991838 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1006/2263] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:20:27 2022] POST /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e/action => generated 120 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:20:28.002586 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-166f9bdc-736e-4d63-a946-2296ab5e4942 tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:28.005942 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-166f9bdc-736e-4d63-a946-2296ab5e4942 tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Failed to fetch instance by id 999 {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 07 01:20:28.006617 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-166f9bdc-736e-4d63-a946-2296ab5e4942 tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-166f9bdc-736e-4d63-a946-2296ab5e4942 tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Request method failure captured: Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 37 Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xM2i5PjLd9zMujLq8T6HkvkpG6R1LtQH8ywXJi1oPx4tNR-lEKd8E6A7RquOzc_s0tU2sRD6K6SqhM54YBIkDNT8StCzVVNCv6zr_J6h-AfMLyQp5jtxndmDquwtF8LV4H_LDYFOUzzGa80PDiQou8L-YvxrAg0wl9IQQ-AZJK3icM Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 585770175580432e87542c05b895ae62 Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1039037542 Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,admin,member Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,admin,member Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/585770175580432e87542c05b895ae62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_585770175580432e87542c05b895ae62", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/585770175580432e87542c05b895ae62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/585770175580432e87542c05b895ae62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1039037542 Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 585770175580432e87542c05b895ae62 Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1039037542 Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersAdminNegativeTestJSON-1039037542-project-admin Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 0c97cf736912462ca8ebb8e3292b4881 Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1039037542-project-admin Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: {"os-resetState": {"state": "error"}} Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 999 could not be found. Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:28.032330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:20:28.036177 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:20:28.036177 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 07 01:20:28.036177 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:28.039317 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-166f9bdc-736e-4d63-a946-2296ab5e4942 tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:20:28.040468 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-166f9bdc-736e-4d63-a946-2296ab5e4942 tempest-ServersAdminNegativeTestJSON-1039037542 tempest-ServersAdminNegativeTestJSON-1039037542-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.042317 Aug 07 01:20:28.047020 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1258/2264] 10.222.0.39 () {60 vars in 1179 bytes} [Sun Aug 7 01:20:27 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:20:28.051426 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2959d488-0ec4-46c2-8966-0f03e052c59d tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:28.052456 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2959d488-0ec4-46c2-8966-0f03e052c59d tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] [instance: bf9703d0-041f-4641-8c33-40b9d2026255] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:28.063096 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2959d488-0ec4-46c2-8966-0f03e052c59d tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:28.063986 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2959d488-0ec4-46c2-8966-0f03e052c59d tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:28.064653 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2959d488-0ec4-46c2-8966-0f03e052c59d tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:28.065654 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2959d488-0ec4-46c2-8966-0f03e052c59d tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:28.066448 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2959d488-0ec4-46c2-8966-0f03e052c59d tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:28.067132 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2959d488-0ec4-46c2-8966-0f03e052c59d tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:28.096384 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2959d488-0ec4-46c2-8966-0f03e052c59d tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] [instance: bf9703d0-041f-4641-8c33-40b9d2026255] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:20:28.242989 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2959d488-0ec4-46c2-8966-0f03e052c59d tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] 10.222.0.39 "DELETE /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255" status: 204 len: 0 microversion: 2.1 time: 0.195549 Aug 07 01:20:28.246721 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1007/2265] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:20:28 2022] DELETE /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:20:28.254515 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5fc6140e-ab34-498d-932b-64135ba49a36 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:28.255141 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5fc6140e-ab34-498d-932b-64135ba49a36 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] [instance: bf9703d0-041f-4641-8c33-40b9d2026255] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:28.267110 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5fc6140e-ab34-498d-932b-64135ba49a36 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:28.267614 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5fc6140e-ab34-498d-932b-64135ba49a36 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:28.268097 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5fc6140e-ab34-498d-932b-64135ba49a36 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:28.268830 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5fc6140e-ab34-498d-932b-64135ba49a36 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:28.269291 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5fc6140e-ab34-498d-932b-64135ba49a36 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:28.269842 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5fc6140e-ab34-498d-932b-64135ba49a36 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:28.305497 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:28.308911 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f2a0aee1-56fe-41c8-a137-2a4dc82e09da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:28.310369 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f2a0aee1-56fe-41c8-a137-2a4dc82e09da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: a1c09528-36b8-4b0d-b03c-2d3351649579] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:28.325972 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f2a0aee1-56fe-41c8-a137-2a4dc82e09da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:28.336655 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f2a0aee1-56fe-41c8-a137-2a4dc82e09da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:28.338771 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f2a0aee1-56fe-41c8-a137-2a4dc82e09da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:28.340323 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f2a0aee1-56fe-41c8-a137-2a4dc82e09da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:28.346008 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f2a0aee1-56fe-41c8-a137-2a4dc82e09da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:28.346485 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f2a0aee1-56fe-41c8-a137-2a4dc82e09da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:28.751048 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f2a0aee1-56fe-41c8-a137-2a4dc82e09da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:28.769153 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f2a0aee1-56fe-41c8-a137-2a4dc82e09da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579" status: 200 len: 1309 microversion: 2.1 time: 0.464644 Aug 07 01:20:28.769907 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1008/2266] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:28 2022] GET /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579 => generated 1309 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:28.774737 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-14610d25-3103-4bb6-bdb3-79eb2f500aad tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:28.775366 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-14610d25-3103-4bb6-bdb3-79eb2f500aad tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d2f5a46c-8f96-4c33-9146-1aba108920ab] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:28.790857 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-14610d25-3103-4bb6-bdb3-79eb2f500aad tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:28.791494 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-14610d25-3103-4bb6-bdb3-79eb2f500aad tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:28.791968 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-14610d25-3103-4bb6-bdb3-79eb2f500aad tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:28.792695 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-14610d25-3103-4bb6-bdb3-79eb2f500aad tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:28.793337 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-14610d25-3103-4bb6-bdb3-79eb2f500aad tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:28.802855 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-14610d25-3103-4bb6-bdb3-79eb2f500aad tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:28.884817 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5fc6140e-ab34-498d-932b-64135ba49a36 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0e7a058704483bbad57ef73de92e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622262beb7574e388c20207cccd5073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:28.893659 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5fc6140e-ab34-498d-932b-64135ba49a36 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] 10.222.0.39 "GET /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255" status: 200 len: 1468 microversion: 2.1 time: 0.644075 Aug 07 01:20:28.908192 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1259/2267] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:28 2022] GET /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255 => generated 1468 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:28.981927 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=8 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:29.167619 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-14610d25-3103-4bb6-bdb3-79eb2f500aad tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:29.182164 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-14610d25-3103-4bb6-bdb3-79eb2f500aad tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab" status: 200 len: 1318 microversion: 2.1 time: 0.411193 Aug 07 01:20:29.183493 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1009/2268] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:28 2022] GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab => generated 1318 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:29.712359 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-975cf19d-eccc-450a-b51b-af52ec6a3b9d req-47845e8a-0454-4615-9f46-c2f8c9a56760 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2f5a46c-8f96-4c33-9146-1aba108920ab", "tag": "39956047-e52a-4cec-88d8-400d42153136"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:29.748334 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-975cf19d-eccc-450a-b51b-af52ec6a3b9d req-47845e8a-0454-4615-9f46-c2f8c9a56760 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:29.748804 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-975cf19d-eccc-450a-b51b-af52ec6a3b9d req-47845e8a-0454-4615-9f46-c2f8c9a56760 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:29.749231 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-975cf19d-eccc-450a-b51b-af52ec6a3b9d req-47845e8a-0454-4615-9f46-c2f8c9a56760 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:29.785895 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-975cf19d-eccc-450a-b51b-af52ec6a3b9d req-47845e8a-0454-4615-9f46-c2f8c9a56760 service nova] Creating event network-changed:39956047-e52a-4cec-88d8-400d42153136 for instance d2f5a46c-8f96-4c33-9146-1aba108920ab on n-h1-master-1 Aug 07 01:20:29.792365 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-975cf19d-eccc-450a-b51b-af52ec6a3b9d req-47845e8a-0454-4615-9f46-c2f8c9a56760 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090835 Aug 07 01:20:29.793526 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1260/2269] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:29.804248 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-af33e503-61fc-4ba1-af92-e8a8917c75d1 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:29.804850 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-af33e503-61fc-4ba1-af92-e8a8917c75d1 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: a1c09528-36b8-4b0d-b03c-2d3351649579] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:29.811369 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-af33e503-61fc-4ba1-af92-e8a8917c75d1 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:29.811871 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-af33e503-61fc-4ba1-af92-e8a8917c75d1 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:29.813403 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-af33e503-61fc-4ba1-af92-e8a8917c75d1 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:29.814976 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-af33e503-61fc-4ba1-af92-e8a8917c75d1 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:29.816130 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-af33e503-61fc-4ba1-af92-e8a8917c75d1 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:29.816782 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-af33e503-61fc-4ba1-af92-e8a8917c75d1 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:29.926101 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-93e678c0-8d7a-45f8-adcc-197e2374b453 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:29.926819 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-93e678c0-8d7a-45f8-adcc-197e2374b453 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] [instance: bf9703d0-041f-4641-8c33-40b9d2026255] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:29.945734 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93e678c0-8d7a-45f8-adcc-197e2374b453 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:29.946238 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93e678c0-8d7a-45f8-adcc-197e2374b453 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:29.946674 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93e678c0-8d7a-45f8-adcc-197e2374b453 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:29.947395 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93e678c0-8d7a-45f8-adcc-197e2374b453 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:29.947846 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93e678c0-8d7a-45f8-adcc-197e2374b453 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:29.948306 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93e678c0-8d7a-45f8-adcc-197e2374b453 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:30.058984 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=38 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:30.352389 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-af33e503-61fc-4ba1-af92-e8a8917c75d1 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:30.380315 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-af33e503-61fc-4ba1-af92-e8a8917c75d1 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579" status: 200 len: 1309 microversion: 2.1 time: 0.577792 Aug 07 01:20:30.383063 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1010/2270] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:29 2022] GET /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579 => generated 1309 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:30.408287 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1b58f720-92e2-47ea-a582-27611e28b89a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:30.409378 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1b58f720-92e2-47ea-a582-27611e28b89a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d2f5a46c-8f96-4c33-9146-1aba108920ab] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:30.436464 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-93e678c0-8d7a-45f8-adcc-197e2374b453 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0e7a058704483bbad57ef73de92e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622262beb7574e388c20207cccd5073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:30.437759 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b58f720-92e2-47ea-a582-27611e28b89a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:30.438413 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b58f720-92e2-47ea-a582-27611e28b89a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:30.439677 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b58f720-92e2-47ea-a582-27611e28b89a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:30.441746 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b58f720-92e2-47ea-a582-27611e28b89a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:30.443768 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b58f720-92e2-47ea-a582-27611e28b89a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:30.444879 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b58f720-92e2-47ea-a582-27611e28b89a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:30.461007 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-93e678c0-8d7a-45f8-adcc-197e2374b453 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] 10.222.0.39 "GET /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255" status: 200 len: 1468 microversion: 2.1 time: 0.531763 Aug 07 01:20:30.461705 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1261/2271] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:29 2022] GET /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255 => generated 1468 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:30.842687 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1b58f720-92e2-47ea-a582-27611e28b89a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:30.856498 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1b58f720-92e2-47ea-a582-27611e28b89a tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab" status: 200 len: 1318 microversion: 2.1 time: 0.461384 Aug 07 01:20:30.858676 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1011/2272] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:30 2022] GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab => generated 1318 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:31.415587 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cea3f173-1960-4291-804d-2c1cfb1f27b6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:31.415587 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cea3f173-1960-4291-804d-2c1cfb1f27b6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: a1c09528-36b8-4b0d-b03c-2d3351649579] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:31.418950 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cea3f173-1960-4291-804d-2c1cfb1f27b6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:31.419750 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cea3f173-1960-4291-804d-2c1cfb1f27b6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:31.420440 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cea3f173-1960-4291-804d-2c1cfb1f27b6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:31.422062 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cea3f173-1960-4291-804d-2c1cfb1f27b6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:31.422870 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cea3f173-1960-4291-804d-2c1cfb1f27b6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:31.423536 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cea3f173-1960-4291-804d-2c1cfb1f27b6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:31.487129 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0cbc8d2f-910c-47af-99a3-71cf4848af94 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:31.488119 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0cbc8d2f-910c-47af-99a3-71cf4848af94 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] [instance: bf9703d0-041f-4641-8c33-40b9d2026255] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:31.502885 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0cbc8d2f-910c-47af-99a3-71cf4848af94 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:31.503782 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0cbc8d2f-910c-47af-99a3-71cf4848af94 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:31.504440 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0cbc8d2f-910c-47af-99a3-71cf4848af94 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:31.508613 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0cbc8d2f-910c-47af-99a3-71cf4848af94 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:31.510640 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0cbc8d2f-910c-47af-99a3-71cf4848af94 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:31.512645 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0cbc8d2f-910c-47af-99a3-71cf4848af94 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:31.730391 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0cbc8d2f-910c-47af-99a3-71cf4848af94 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0e7a058704483bbad57ef73de92e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622262beb7574e388c20207cccd5073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:31.738508 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0cbc8d2f-910c-47af-99a3-71cf4848af94 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] 10.222.0.39 "GET /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255" status: 200 len: 1426 microversion: 2.1 time: 0.259058 Aug 07 01:20:31.739142 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1012/2273] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:31 2022] GET /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255 => generated 1426 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:31.763051 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6fcf6591-21ea-417d-a62e-14a749fe6dd4 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:31.766275 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6fcf6591-21ea-417d-a62e-14a749fe6dd4 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] [instance: 1bc2c437-e710-4af4-9928-76c48834cfa2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:31.778875 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6fcf6591-21ea-417d-a62e-14a749fe6dd4 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:31.779598 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6fcf6591-21ea-417d-a62e-14a749fe6dd4 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:31.780255 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6fcf6591-21ea-417d-a62e-14a749fe6dd4 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:31.781760 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6fcf6591-21ea-417d-a62e-14a749fe6dd4 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:31.782391 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6fcf6591-21ea-417d-a62e-14a749fe6dd4 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:31.783273 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6fcf6591-21ea-417d-a62e-14a749fe6dd4 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:31.898943 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6fcf6591-21ea-417d-a62e-14a749fe6dd4 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] 10.222.0.39 "GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158589 Aug 07 01:20:31.912076 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1013/2274] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:20:31 2022] GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:31.925526 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7ed364bc-b56f-4089-8a32-6d8aee78f9f3 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:31.926437 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7ed364bc-b56f-4089-8a32-6d8aee78f9f3 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d2f5a46c-8f96-4c33-9146-1aba108920ab] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:31.953011 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ed364bc-b56f-4089-8a32-6d8aee78f9f3 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:31.953507 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ed364bc-b56f-4089-8a32-6d8aee78f9f3 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:31.953949 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ed364bc-b56f-4089-8a32-6d8aee78f9f3 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:31.954685 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ed364bc-b56f-4089-8a32-6d8aee78f9f3 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:31.955146 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ed364bc-b56f-4089-8a32-6d8aee78f9f3 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:31.955573 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ed364bc-b56f-4089-8a32-6d8aee78f9f3 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:32.100157 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cea3f173-1960-4291-804d-2c1cfb1f27b6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:32.117733 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cea3f173-1960-4291-804d-2c1cfb1f27b6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579" status: 200 len: 1309 microversion: 2.1 time: 0.707506 Aug 07 01:20:32.118661 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1262/2275] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:31 2022] GET /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579 => generated 1309 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:32.127224 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c49344f2-2231-446c-894d-e6a98e74a9d8 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:32.130725 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c49344f2-2231-446c-894d-e6a98e74a9d8 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] [instance: 1bc2c437-e710-4af4-9928-76c48834cfa2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:32.138086 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c49344f2-2231-446c-894d-e6a98e74a9d8 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:32.138746 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c49344f2-2231-446c-894d-e6a98e74a9d8 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:32.139353 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c49344f2-2231-446c-894d-e6a98e74a9d8 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:32.140835 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c49344f2-2231-446c-894d-e6a98e74a9d8 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:32.161910 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c49344f2-2231-446c-894d-e6a98e74a9d8 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:32.162907 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c49344f2-2231-446c-894d-e6a98e74a9d8 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:32.376517 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-c49344f2-2231-446c-894d-e6a98e74a9d8 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lazy-loading 'services' on Instance uuid 1bc2c437-e710-4af4-9928-76c48834cfa2 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:20:32.491505 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7ed364bc-b56f-4089-8a32-6d8aee78f9f3 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:32.508359 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7ed364bc-b56f-4089-8a32-6d8aee78f9f3 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab" status: 200 len: 1318 microversion: 2.1 time: 0.588930 Aug 07 01:20:32.508359 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1014/2276] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:31 2022] GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab => generated 1318 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:32.520433 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-79054ed3-f2b0-4c91-93e9-a892d7574f3a req-90a9f429-38d6-49bb-98d8-2bf2d80f5b5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf9703d0-041f-4641-8c33-40b9d2026255", "name": "network-vif-deleted", "tag": "883a9b6f-ab5f-4447-bca3-1a10085e3be6"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:32.542813 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-79054ed3-f2b0-4c91-93e9-a892d7574f3a req-90a9f429-38d6-49bb-98d8-2bf2d80f5b5d service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:32.543419 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-79054ed3-f2b0-4c91-93e9-a892d7574f3a req-90a9f429-38d6-49bb-98d8-2bf2d80f5b5d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:32.543941 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-79054ed3-f2b0-4c91-93e9-a892d7574f3a req-90a9f429-38d6-49bb-98d8-2bf2d80f5b5d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:32.570603 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c49344f2-2231-446c-894d-e6a98e74a9d8 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2/os-volume_attachments/65d2a5ed-de60-4416-8694-f2884be02259" status: 202 len: 0 microversion: 2.1 time: 0.449940 Aug 07 01:20:32.577237 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1263/2277] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Aug 7 01:20:32 2022] DELETE /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2/os-volume_attachments/65d2a5ed-de60-4416-8694-f2884be02259 => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:20:32.606168 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-79054ed3-f2b0-4c91-93e9-a892d7574f3a req-90a9f429-38d6-49bb-98d8-2bf2d80f5b5d service nova] Creating event network-vif-deleted:883a9b6f-ab5f-4447-bca3-1a10085e3be6 for instance bf9703d0-041f-4641-8c33-40b9d2026255 on n-h1-master-1 Aug 07 01:20:32.610190 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-2044b3b3-5a13-4bed-bd08-501ee67312bb req-697c4065-d7d9-42a6-801c-260722072c0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1c09528-36b8-4b0d-b03c-2d3351649579", "name": "network-vif-plugged", "status": "completed", "tag": "3069bfdf-1b77-40a1-bff5-d6fd063346fc"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:32.626245 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-79054ed3-f2b0-4c91-93e9-a892d7574f3a req-90a9f429-38d6-49bb-98d8-2bf2d80f5b5d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122251 Aug 07 01:20:32.635834 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2044b3b3-5a13-4bed-bd08-501ee67312bb req-697c4065-d7d9-42a6-801c-260722072c0d service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:32.636028 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1015/2278] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:32.638385 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2044b3b3-5a13-4bed-bd08-501ee67312bb req-697c4065-d7d9-42a6-801c-260722072c0d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:32.641252 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2044b3b3-5a13-4bed-bd08-501ee67312bb req-697c4065-d7d9-42a6-801c-260722072c0d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:32.673612 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-2044b3b3-5a13-4bed-bd08-501ee67312bb req-697c4065-d7d9-42a6-801c-260722072c0d service nova] Creating event network-vif-plugged:3069bfdf-1b77-40a1-bff5-d6fd063346fc for instance a1c09528-36b8-4b0d-b03c-2d3351649579 on n-h2-master-1 Aug 07 01:20:32.687326 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-2044b3b3-5a13-4bed-bd08-501ee67312bb req-697c4065-d7d9-42a6-801c-260722072c0d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099136 Aug 07 01:20:32.688231 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1264/2279] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:32.764780 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-06f47b71-ca79-4753-8eff-9a98964d3f38 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:32.766098 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-06f47b71-ca79-4753-8eff-9a98964d3f38 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] [instance: bf9703d0-041f-4641-8c33-40b9d2026255] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:32.777161 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06f47b71-ca79-4753-8eff-9a98964d3f38 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:32.777661 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06f47b71-ca79-4753-8eff-9a98964d3f38 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:32.778106 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06f47b71-ca79-4753-8eff-9a98964d3f38 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:32.778852 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06f47b71-ca79-4753-8eff-9a98964d3f38 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:32.779292 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06f47b71-ca79-4753-8eff-9a98964d3f38 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:32.780361 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06f47b71-ca79-4753-8eff-9a98964d3f38 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:32.857740 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06f47b71-ca79-4753-8eff-9a98964d3f38 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:32.858647 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06f47b71-ca79-4753-8eff-9a98964d3f38 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:32.859937 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06f47b71-ca79-4753-8eff-9a98964d3f38 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:32.862017 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-06f47b71-ca79-4753-8eff-9a98964d3f38 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lazy-loading 'fault' on Instance uuid bf9703d0-041f-4641-8c33-40b9d2026255 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:20:32.957278 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-06f47b71-ca79-4753-8eff-9a98964d3f38 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0e7a058704483bbad57ef73de92e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622262beb7574e388c20207cccd5073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:32.967620 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-06f47b71-ca79-4753-8eff-9a98964d3f38 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] 10.222.0.39 "GET /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255" status: 200 len: 1312 microversion: 2.1 time: 0.206935 Aug 07 01:20:32.969703 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1016/2280] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:32 2022] GET /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255 => generated 1312 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:33.125766 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e4fba3dc-fc4e-4f91-ab05-82a2fe7d5092 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Action: 'update', calling method: .version_select at 0x7f9e245a8700>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:33.128827 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:20:33.128827 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:20:33.129883 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4fba3dc-fc4e-4f91-ab05-82a2fe7d5092 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:33.130561 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4fba3dc-fc4e-4f91-ab05-82a2fe7d5092 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:33.131000 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4fba3dc-fc4e-4f91-ab05-82a2fe7d5092 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:33.138723 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b840d81d-dd8a-47af-b250-5095c617fd8a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:33.139753 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b840d81d-dd8a-47af-b250-5095c617fd8a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: a1c09528-36b8-4b0d-b03c-2d3351649579] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:33.141340 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=19 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:33.142930 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4fba3dc-fc4e-4f91-ab05-82a2fe7d5092 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:33.143499 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4fba3dc-fc4e-4f91-ab05-82a2fe7d5092 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:33.144420 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4fba3dc-fc4e-4f91-ab05-82a2fe7d5092 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:33.147822 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b840d81d-dd8a-47af-b250-5095c617fd8a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:33.147822 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b840d81d-dd8a-47af-b250-5095c617fd8a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:33.148523 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b840d81d-dd8a-47af-b250-5095c617fd8a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:33.148953 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b840d81d-dd8a-47af-b250-5095c617fd8a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:33.149405 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b840d81d-dd8a-47af-b250-5095c617fd8a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:33.149832 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b840d81d-dd8a-47af-b250-5095c617fd8a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:33.153533 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-e4fba3dc-fc4e-4f91-ab05-82a2fe7d5092 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] HTTP exception thrown: Service 7c140124-b3c6-4356-b962-40b0cc90e7d3 could not be found. Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e4fba3dc-fc4e-4f91-ab05-82a2fe7d5092 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Request method failure captured: Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: request: PUT /compute/v2.1/os-services/7c140124-b3c6-4356-b962-40b0cc90e7d3 HTTP/1.1 Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 56 Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xNgtv3EWl0xQrkQb3RXxtF1OwcftkEZvF2p2qDhAaS8HHknMgIXj96hBbgSWzceNupTJ0KcaWx15zb5uZQypoA99iZkZA8OVT1JvW5LNEHtYW1dIsiQKgPfOSgk9L2s-zFNQo8YRg3-hP0uDyeoNMW6zNRtkqwFmM94aL-STc1RYR4 Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: X-Openstack-Nova-Api-Version: 2.53 Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: c4f155ad32504ee9b269413712089ea6 Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-801460371 Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,admin,member Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,admin,member Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c4f155ad32504ee9b269413712089ea6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c4f155ad32504ee9b269413712089ea6", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c4f155ad32504ee9b269413712089ea6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c4f155ad32504ee9b269413712089ea6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-801460371 Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: c4f155ad32504ee9b269413712089ea6 Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-801460371 Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 327117236c71482baaad9fdfcebed76a Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: exception: Service 7c140124-b3c6-4356-b962-40b0cc90e7d3 could not be found. Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '7c140124-b3c6-4356-b962-40b0cc90e7d3', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6157, in service_get_by_id Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6159, in service_get_by_id Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 7c140124-b3c6-4356-b962-40b0cc90e7d3 could not be found. Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:20:33.155367 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:20:33.158949 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 07 01:20:33.158949 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:20:33.158949 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 7c140124-b3c6-4356-b962-40b0cc90e7d3 could not be found. Aug 07 01:20:33.158949 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:33.158949 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:33.158949 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:33.158949 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:33.158949 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:33.158949 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:33.158949 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:20:33.158949 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:20:33.158949 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 7c140124-b3c6-4356-b962-40b0cc90e7d3 could not be found. Aug 07 01:20:33.158949 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:33.158949 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e4fba3dc-fc4e-4f91-ab05-82a2fe7d5092 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Returning 404 to user: Service 7c140124-b3c6-4356-b962-40b0cc90e7d3 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:20:33.158949 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e4fba3dc-fc4e-4f91-ab05-82a2fe7d5092 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-services/7c140124-b3c6-4356-b962-40b0cc90e7d3" status: 404 len: 110 microversion: 2.53 time: 0.205166 Aug 07 01:20:33.158949 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1265/2281] 10.222.0.39 () {62 vars in 1309 bytes} [Sun Aug 7 01:20:32 2022] PUT /compute/v2.1/os-services/7c140124-b3c6-4356-b962-40b0cc90e7d3 => generated 110 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:20:33.170816 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1920c1d8-d9c3-42cf-8850-ca87c0ac2cb7 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Action: 'update', calling method: .version_select at 0x7f9e2481c8b0>, body: {"status": "disabled"} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:33.175622 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1920c1d8-d9c3-42cf-8850-ca87c0ac2cb7 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:33.176192 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1920c1d8-d9c3-42cf-8850-ca87c0ac2cb7 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:33.176635 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1920c1d8-d9c3-42cf-8850-ca87c0ac2cb7 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:33.184782 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1920c1d8-d9c3-42cf-8850-ca87c0ac2cb7 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:33.184782 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1920c1d8-d9c3-42cf-8850-ca87c0ac2cb7 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:33.184782 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1920c1d8-d9c3-42cf-8850-ca87c0ac2cb7 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:33.190978 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-1920c1d8-d9c3-42cf-8850-ca87c0ac2cb7 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] HTTP exception thrown: Service 7c140124-b3c6-4356-b962-40b0cc90e7d3 could not be found. Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1920c1d8-d9c3-42cf-8850-ca87c0ac2cb7 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Request method failure captured: Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: request: PUT /compute/v2.1/os-services/7c140124-b3c6-4356-b962-40b0cc90e7d3 HTTP/1.1 Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 22 Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xNgtv3EWl0xQrkQb3RXxtF1OwcftkEZvF2p2qDhAaS8HHknMgIXj96hBbgSWzceNupTJ0KcaWx15zb5uZQypoA99iZkZA8OVT1JvW5LNEHtYW1dIsiQKgPfOSgk9L2s-zFNQo8YRg3-hP0uDyeoNMW6zNRtkqwFmM94aL-STc1RYR4 Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: X-Openstack-Nova-Api-Version: 2.53 Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: c4f155ad32504ee9b269413712089ea6 Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-801460371 Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,admin,member Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,admin,member Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c4f155ad32504ee9b269413712089ea6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c4f155ad32504ee9b269413712089ea6", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c4f155ad32504ee9b269413712089ea6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c4f155ad32504ee9b269413712089ea6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-801460371 Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: c4f155ad32504ee9b269413712089ea6 Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-801460371 Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 327117236c71482baaad9fdfcebed76a Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: {"status": "disabled"} Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: exception: Service 7c140124-b3c6-4356-b962-40b0cc90e7d3 could not be found. Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '7c140124-b3c6-4356-b962-40b0cc90e7d3', 'body': {'status': 'disabled'}} Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6157, in service_get_by_id Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6159, in service_get_by_id Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 7c140124-b3c6-4356-b962-40b0cc90e7d3 could not be found. Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:20:33.193285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:20:33.201110 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 07 01:20:33.201110 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:20:33.201110 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 7c140124-b3c6-4356-b962-40b0cc90e7d3 could not be found. Aug 07 01:20:33.201110 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:33.201110 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:33.201110 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:33.201110 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:33.201110 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:33.201110 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:33.201110 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:20:33.201110 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:20:33.201110 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 7c140124-b3c6-4356-b962-40b0cc90e7d3 could not be found. Aug 07 01:20:33.201110 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:33.201110 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1920c1d8-d9c3-42cf-8850-ca87c0ac2cb7 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Returning 404 to user: Service 7c140124-b3c6-4356-b962-40b0cc90e7d3 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:20:33.201110 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1920c1d8-d9c3-42cf-8850-ca87c0ac2cb7 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-services/7c140124-b3c6-4356-b962-40b0cc90e7d3" status: 404 len: 110 microversion: 2.53 time: 0.031644 Aug 07 01:20:33.201110 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1266/2282] 10.222.0.39 () {62 vars in 1309 bytes} [Sun Aug 7 01:20:33 2022] PUT /compute/v2.1/os-services/7c140124-b3c6-4356-b962-40b0cc90e7d3 => generated 110 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 07 01:20:33.206075 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7f521687-003e-415c-ac04-df22ee1140ec tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Action: 'update', calling method: .version_select at 0x7f9e243d6310>, body: {"status": "enabled"} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:33.209648 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f521687-003e-415c-ac04-df22ee1140ec tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:33.210140 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f521687-003e-415c-ac04-df22ee1140ec tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:33.210587 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f521687-003e-415c-ac04-df22ee1140ec tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:33.216640 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f521687-003e-415c-ac04-df22ee1140ec tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:33.217123 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f521687-003e-415c-ac04-df22ee1140ec tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:33.218753 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f521687-003e-415c-ac04-df22ee1140ec tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:33.223472 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-7f521687-003e-415c-ac04-df22ee1140ec tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] HTTP exception thrown: Service 7c140124-b3c6-4356-b962-40b0cc90e7d3 could not be found. Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7f521687-003e-415c-ac04-df22ee1140ec tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Request method failure captured: Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: request: PUT /compute/v2.1/os-services/7c140124-b3c6-4356-b962-40b0cc90e7d3 HTTP/1.1 Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 21 Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xNgtv3EWl0xQrkQb3RXxtF1OwcftkEZvF2p2qDhAaS8HHknMgIXj96hBbgSWzceNupTJ0KcaWx15zb5uZQypoA99iZkZA8OVT1JvW5LNEHtYW1dIsiQKgPfOSgk9L2s-zFNQo8YRg3-hP0uDyeoNMW6zNRtkqwFmM94aL-STc1RYR4 Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: X-Openstack-Nova-Api-Version: 2.53 Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: c4f155ad32504ee9b269413712089ea6 Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-801460371 Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,admin,member Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,admin,member Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c4f155ad32504ee9b269413712089ea6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c4f155ad32504ee9b269413712089ea6", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c4f155ad32504ee9b269413712089ea6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c4f155ad32504ee9b269413712089ea6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-801460371 Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: c4f155ad32504ee9b269413712089ea6 Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-801460371 Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 327117236c71482baaad9fdfcebed76a Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: {"status": "enabled"} Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: exception: Service 7c140124-b3c6-4356-b962-40b0cc90e7d3 could not be found. Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '7c140124-b3c6-4356-b962-40b0cc90e7d3', 'body': {'status': 'enabled'}} Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6157, in service_get_by_id Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6159, in service_get_by_id Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 7c140124-b3c6-4356-b962-40b0cc90e7d3 could not be found. Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:20:33.224916 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:20:33.228457 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 07 01:20:33.228457 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:20:33.228457 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 7c140124-b3c6-4356-b962-40b0cc90e7d3 could not be found. Aug 07 01:20:33.228457 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:33.228457 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:33.228457 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:33.228457 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:33.228457 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:33.228457 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:33.228457 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:20:33.228457 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:20:33.228457 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 7c140124-b3c6-4356-b962-40b0cc90e7d3 could not be found. Aug 07 01:20:33.228457 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:33.228457 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7f521687-003e-415c-ac04-df22ee1140ec tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Returning 404 to user: Service 7c140124-b3c6-4356-b962-40b0cc90e7d3 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:20:33.228457 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7f521687-003e-415c-ac04-df22ee1140ec tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-services/7c140124-b3c6-4356-b962-40b0cc90e7d3" status: 404 len: 110 microversion: 2.53 time: 0.025409 Aug 07 01:20:33.228457 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1267/2283] 10.222.0.39 () {62 vars in 1309 bytes} [Sun Aug 7 01:20:33 2022] PUT /compute/v2.1/os-services/7c140124-b3c6-4356-b962-40b0cc90e7d3 => generated 110 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:20:33.240522 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2c17af79-850e-464d-8923-9704974a2b3f tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:33.243784 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:20:33.243784 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:20:33.245016 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c17af79-850e-464d-8923-9704974a2b3f tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:33.245505 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c17af79-850e-464d-8923-9704974a2b3f tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:33.251702 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c17af79-850e-464d-8923-9704974a2b3f tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:33.254723 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c17af79-850e-464d-8923-9704974a2b3f tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:33.255697 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c17af79-850e-464d-8923-9704974a2b3f tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:33.255697 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c17af79-850e-464d-8923-9704974a2b3f tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:33.308342 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2c17af79-850e-464d-8923-9704974a2b3f tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.067770 Aug 07 01:20:33.309260 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1268/2284] 10.222.0.39 () {60 vars in 1178 bytes} [Sun Aug 7 01:20:33 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:20:33.324906 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-46e2883c-6f8d-42c7-a7bf-23213d5a076b tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:33.328746 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:20:33.328746 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:20:33.330326 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-46e2883c-6f8d-42c7-a7bf-23213d5a076b tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:33.331039 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-46e2883c-6f8d-42c7-a7bf-23213d5a076b tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:33.331845 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-46e2883c-6f8d-42c7-a7bf-23213d5a076b tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:33.332814 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-46e2883c-6f8d-42c7-a7bf-23213d5a076b tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:33.333522 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-46e2883c-6f8d-42c7-a7bf-23213d5a076b tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:33.334151 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-46e2883c-6f8d-42c7-a7bf-23213d5a076b tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:33.351759 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b840d81d-dd8a-47af-b250-5095c617fd8a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:33.360798 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b840d81d-dd8a-47af-b250-5095c617fd8a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579" status: 200 len: 1309 microversion: 2.1 time: 0.225784 Aug 07 01:20:33.361399 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1017/2285] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:33 2022] GET /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579 => generated 1309 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:33.375695 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-46e2883c-6f8d-42c7-a7bf-23213d5a076b tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.054645 Aug 07 01:20:33.385034 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1269/2286] 10.222.0.39 () {60 vars in 1211 bytes} [Sun Aug 7 01:20:33 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:20:33.389843 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2c8367c9-032f-4ae7-a083-aa43ee69e74a tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:33.393177 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:20:33.393177 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:20:33.394400 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c8367c9-032f-4ae7-a083-aa43ee69e74a tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:33.394890 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c8367c9-032f-4ae7-a083-aa43ee69e74a tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:33.395337 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c8367c9-032f-4ae7-a083-aa43ee69e74a tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:33.396174 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c8367c9-032f-4ae7-a083-aa43ee69e74a tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:33.396895 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c8367c9-032f-4ae7-a083-aa43ee69e74a tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:33.397313 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c8367c9-032f-4ae7-a083-aa43ee69e74a tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:33.423106 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2c8367c9-032f-4ae7-a083-aa43ee69e74a tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.036925 Aug 07 01:20:33.423648 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1018/2287] 10.222.0.39 () {60 vars in 1178 bytes} [Sun Aug 7 01:20:33 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:20:33.435621 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4aa04492-43f8-41a3-bcc4-43ce713d91b0 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:33.438775 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:20:33.438775 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:20:33.440165 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4aa04492-43f8-41a3-bcc4-43ce713d91b0 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:33.440656 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4aa04492-43f8-41a3-bcc4-43ce713d91b0 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:33.441390 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4aa04492-43f8-41a3-bcc4-43ce713d91b0 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:33.442133 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4aa04492-43f8-41a3-bcc4-43ce713d91b0 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:33.443125 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4aa04492-43f8-41a3-bcc4-43ce713d91b0 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:33.443730 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4aa04492-43f8-41a3-bcc4-43ce713d91b0 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:33.474133 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4aa04492-43f8-41a3-bcc4-43ce713d91b0 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.042140 Aug 07 01:20:33.474758 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1270/2288] 10.222.0.39 () {60 vars in 1235 bytes} [Sun Aug 7 01:20:33 2022] GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx => generated 16 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:33.489513 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-637397cb-8e1a-402d-9a41-1377f57d2443 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:33.493151 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:20:33.493151 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:20:33.494599 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-637397cb-8e1a-402d-9a41-1377f57d2443 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:33.495098 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-637397cb-8e1a-402d-9a41-1377f57d2443 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:33.495556 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-637397cb-8e1a-402d-9a41-1377f57d2443 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:33.496497 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-637397cb-8e1a-402d-9a41-1377f57d2443 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:33.496966 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-637397cb-8e1a-402d-9a41-1377f57d2443 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:33.497404 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-637397cb-8e1a-402d-9a41-1377f57d2443 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:33.529183 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bafd4da2-c0e3-464e-9efa-2b4a64449a67 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:33.529998 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bafd4da2-c0e3-464e-9efa-2b4a64449a67 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d2f5a46c-8f96-4c33-9146-1aba108920ab] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:33.541983 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-637397cb-8e1a-402d-9a41-1377f57d2443 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.058834 Aug 07 01:20:33.550254 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1019/2289] 10.222.0.39 () {60 vars in 1178 bytes} [Sun Aug 7 01:20:33 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:20:33.550456 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bafd4da2-c0e3-464e-9efa-2b4a64449a67 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:33.550456 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bafd4da2-c0e3-464e-9efa-2b4a64449a67 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:33.550456 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bafd4da2-c0e3-464e-9efa-2b4a64449a67 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:33.550456 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bafd4da2-c0e3-464e-9efa-2b4a64449a67 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:33.550456 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bafd4da2-c0e3-464e-9efa-2b4a64449a67 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:33.550796 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bafd4da2-c0e3-464e-9efa-2b4a64449a67 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:33.560478 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f62849d1-e3a2-4f6f-906a-c1f52ecac273 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:33.565231 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:20:33.565231 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:20:33.566503 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f62849d1-e3a2-4f6f-906a-c1f52ecac273 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:33.567300 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f62849d1-e3a2-4f6f-906a-c1f52ecac273 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:33.567755 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f62849d1-e3a2-4f6f-906a-c1f52ecac273 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:33.568862 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f62849d1-e3a2-4f6f-906a-c1f52ecac273 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:33.569332 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f62849d1-e3a2-4f6f-906a-c1f52ecac273 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:33.569774 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f62849d1-e3a2-4f6f-906a-c1f52ecac273 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:33.576062 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:33.640289 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f62849d1-e3a2-4f6f-906a-c1f52ecac273 tempest-ServicesAdminNegativeV253TestJSON-801460371 tempest-ServicesAdminNegativeV253TestJSON-801460371-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.085270 Aug 07 01:20:33.644919 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1020/2290] 10.222.0.39 () {60 vars in 1239 bytes} [Sun Aug 7 01:20:33 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:33.924487 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8c0031b0-7240-4ef5-a325-497efad9fc0a tempest-ServicesAdminNegativeV253TestJSON-977443940 tempest-ServicesAdminNegativeV253TestJSON-977443940-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:33.928076 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:20:33.928076 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:20:33.929528 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8c0031b0-7240-4ef5-a325-497efad9fc0a tempest-ServicesAdminNegativeV253TestJSON-977443940 tempest-ServicesAdminNegativeV253TestJSON-977443940-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'd0e4a371822146d28378559885345af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14d3cce0761e4c789e40a9832e385f68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8c0031b0-7240-4ef5-a325-497efad9fc0a tempest-ServicesAdminNegativeV253TestJSON-977443940 tempest-ServicesAdminNegativeV253TestJSON-977443940-project] Request method failure captured: Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xNfxT-T9XNtsgXsGXl9NPz6tjs9tGL67R-imD8oNDAg1G-1I0dNQ1LXJMKy7gAQJUFKhjptxJ4zo3678BF_SmL9DN_Iv48OMa4kj8ko9ngTMz9uGxz3nBtpl5pj-FfVyyFmkZ86rxNFLLkPc7TrI7PyUmQYk3pxeZEpFFr0QMPdJHo Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: X-Openstack-Nova-Api-Version: 2.53 Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 14d3cce0761e4c789e40a9832e385f68 Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-977443940 Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/14d3cce0761e4c789e40a9832e385f68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_14d3cce0761e4c789e40a9832e385f68", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/14d3cce0761e4c789e40a9832e385f68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/14d3cce0761e4c789e40a9832e385f68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-977443940 Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 14d3cce0761e4c789e40a9832e385f68 Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-977443940 Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServicesAdminNegativeV253TestJSON-977443940-project Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d0e4a371822146d28378559885345af1 Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-977443940-project Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: action_args: {} Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 07 01:20:33.931697 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 07 01:20:33.935158 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:33.935158 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:33.935158 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:33.935158 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:33.935158 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:33.935158 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:33.935158 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 07 01:20:33.935158 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 07 01:20:33.935158 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 07 01:20:33.935158 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:33.937692 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bafd4da2-c0e3-464e-9efa-2b4a64449a67 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:33.938222 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8c0031b0-7240-4ef5-a325-497efad9fc0a tempest-ServicesAdminNegativeV253TestJSON-977443940 tempest-ServicesAdminNegativeV253TestJSON-977443940-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:20:33.938222 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8c0031b0-7240-4ef5-a325-497efad9fc0a tempest-ServicesAdminNegativeV253TestJSON-977443940 tempest-ServicesAdminNegativeV253TestJSON-977443940-project] 10.222.0.39 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.283196 Aug 07 01:20:33.938222 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1021/2291] 10.222.0.39 () {60 vars in 1178 bytes} [Sun Aug 7 01:20:33 2022] GET /compute/v2.1/os-services => generated 112 bytes in 285 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:20:33.940853 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bafd4da2-c0e3-464e-9efa-2b4a64449a67 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab" status: 200 len: 1318 microversion: 2.1 time: 0.420628 Aug 07 01:20:33.943943 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1271/2292] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:33 2022] GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab => generated 1318 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:33.998576 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c5804bf1-fe65-4fd0-a083-6a3e186fbd38 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:34.000182 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c5804bf1-fe65-4fd0-a083-6a3e186fbd38 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] [instance: bf9703d0-041f-4641-8c33-40b9d2026255] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:34.019186 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c5804bf1-fe65-4fd0-a083-6a3e186fbd38 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:34.028847 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c5804bf1-fe65-4fd0-a083-6a3e186fbd38 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:34.029313 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c5804bf1-fe65-4fd0-a083-6a3e186fbd38 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:34.030223 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c5804bf1-fe65-4fd0-a083-6a3e186fbd38 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:34.031061 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c5804bf1-fe65-4fd0-a083-6a3e186fbd38 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:34.031513 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c5804bf1-fe65-4fd0-a083-6a3e186fbd38 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:34.074885 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-c5804bf1-fe65-4fd0-a083-6a3e186fbd38 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] HTTP exception thrown: Instance bf9703d0-041f-4641-8c33-40b9d2026255 could not be found. Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c5804bf1-fe65-4fd0-a083-6a3e186fbd38 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Request method failure captured: Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255 HTTP/1.1 Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xM2699BQyDEczBJkmqbn1GCOIwLX3BGFHmXkPNkib8YrrAcYKpTPFzS4bLw_Nh6kMe9cC_nqGBwHawN54WnEnovzZJZAwgomYwkCJqLA0P5syFi3Czs2ijC7M04tUegmfxl91c6aYmeHbKQ045ZHXrxcIGcTYhflVmVnOmTgT_ivKc Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 622262beb7574e388c20207cccd5073d Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1167256409 Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/622262beb7574e388c20207cccd5073d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_622262beb7574e388c20207cccd5073d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/622262beb7574e388c20207cccd5073d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/622262beb7574e388c20207cccd5073d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1167256409 Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 622262beb7574e388c20207cccd5073d Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1167256409 Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersAdminNegativeTestJSON-1167256409-project Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 81d0e7a058704483bbad57ef73de92e6 Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1167256409-project Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: exception: Instance bf9703d0-041f-4641-8c33-40b9d2026255 could not be found. Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'bf9703d0-041f-4641-8c33-40b9d2026255'} Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf9703d0-041f-4641-8c33-40b9d2026255 could not be found. Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf9703d0-041f-4641-8c33-40b9d2026255 could not be found. Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:34.076508 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:34.081346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:34.081346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:34.081346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:34.081346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:34.081346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:20:34.081346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:20:34.081346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf9703d0-041f-4641-8c33-40b9d2026255 could not be found. Aug 07 01:20:34.081346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:34.081346 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c5804bf1-fe65-4fd0-a083-6a3e186fbd38 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Returning 404 to user: Instance bf9703d0-041f-4641-8c33-40b9d2026255 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:20:34.081346 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c5804bf1-fe65-4fd0-a083-6a3e186fbd38 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] 10.222.0.39 "GET /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255" status: 404 len: 111 microversion: 2.1 time: 0.086671 Aug 07 01:20:34.081346 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1022/2293] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:33 2022] GET /compute/v2.1/servers/bf9703d0-041f-4641-8c33-40b9d2026255 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:20:34.089172 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ab04fab7-6854-4a15-ba87-88e726172eef tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:34.090054 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ab04fab7-6854-4a15-ba87-88e726172eef tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] [instance: 18856f67-eebe-4c6a-89bc-4a2e60408d2e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:34.104111 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ab04fab7-6854-4a15-ba87-88e726172eef tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:34.105061 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ab04fab7-6854-4a15-ba87-88e726172eef tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:34.105826 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ab04fab7-6854-4a15-ba87-88e726172eef tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:34.107591 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ab04fab7-6854-4a15-ba87-88e726172eef tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:34.108567 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ab04fab7-6854-4a15-ba87-88e726172eef tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:34.109341 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ab04fab7-6854-4a15-ba87-88e726172eef tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:34.149714 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ab04fab7-6854-4a15-ba87-88e726172eef tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] [instance: 18856f67-eebe-4c6a-89bc-4a2e60408d2e] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:20:34.253297 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ab04fab7-6854-4a15-ba87-88e726172eef tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] 10.222.0.39 "DELETE /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e" status: 204 len: 0 microversion: 2.1 time: 0.168852 Aug 07 01:20:34.253793 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1272/2294] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:20:34 2022] DELETE /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:20:34.266832 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b2da0c8f-54e6-40ed-9742-394671a33863 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:34.267704 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b2da0c8f-54e6-40ed-9742-394671a33863 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] [instance: 18856f67-eebe-4c6a-89bc-4a2e60408d2e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:34.281310 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2da0c8f-54e6-40ed-9742-394671a33863 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:34.285403 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2da0c8f-54e6-40ed-9742-394671a33863 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:34.285869 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2da0c8f-54e6-40ed-9742-394671a33863 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:34.286959 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2da0c8f-54e6-40ed-9742-394671a33863 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:34.287425 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2da0c8f-54e6-40ed-9742-394671a33863 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:34.288327 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2da0c8f-54e6-40ed-9742-394671a33863 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:34.384617 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bb98a9f5-0978-4789-bf77-a6561c097409 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:34.385499 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bb98a9f5-0978-4789-bf77-a6561c097409 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: a1c09528-36b8-4b0d-b03c-2d3351649579] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:34.405396 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb98a9f5-0978-4789-bf77-a6561c097409 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:34.405942 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb98a9f5-0978-4789-bf77-a6561c097409 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:34.406387 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb98a9f5-0978-4789-bf77-a6561c097409 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:34.407138 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb98a9f5-0978-4789-bf77-a6561c097409 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:34.412707 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb98a9f5-0978-4789-bf77-a6561c097409 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:34.413165 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb98a9f5-0978-4789-bf77-a6561c097409 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:34.482175 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b2da0c8f-54e6-40ed-9742-394671a33863 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0e7a058704483bbad57ef73de92e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622262beb7574e388c20207cccd5073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:34.491718 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b2da0c8f-54e6-40ed-9742-394671a33863 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] 10.222.0.39 "GET /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e" status: 200 len: 1476 microversion: 2.1 time: 0.232537 Aug 07 01:20:34.492901 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1023/2295] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:34 2022] GET /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e => generated 1476 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:34.831701 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bb98a9f5-0978-4789-bf77-a6561c097409 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:34.858774 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bb98a9f5-0978-4789-bf77-a6561c097409 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579" status: 200 len: 1309 microversion: 2.1 time: 0.479532 Aug 07 01:20:34.863812 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1273/2296] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:34 2022] GET /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579 => generated 1309 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:34.963920 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-639bb877-2247-4d5d-a09e-2ec798d5f0d7 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:34.964754 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-639bb877-2247-4d5d-a09e-2ec798d5f0d7 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d2f5a46c-8f96-4c33-9146-1aba108920ab] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:34.973268 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-639bb877-2247-4d5d-a09e-2ec798d5f0d7 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:34.974054 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-639bb877-2247-4d5d-a09e-2ec798d5f0d7 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:34.974741 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-639bb877-2247-4d5d-a09e-2ec798d5f0d7 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:34.975645 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-639bb877-2247-4d5d-a09e-2ec798d5f0d7 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:34.976303 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-639bb877-2247-4d5d-a09e-2ec798d5f0d7 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:34.976908 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-639bb877-2247-4d5d-a09e-2ec798d5f0d7 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:35.170056 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-639bb877-2247-4d5d-a09e-2ec798d5f0d7 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:35.180523 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-639bb877-2247-4d5d-a09e-2ec798d5f0d7 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab" status: 200 len: 1318 microversion: 2.1 time: 0.222049 Aug 07 01:20:35.181346 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1024/2297] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:34 2022] GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:35.514144 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-29194e81-3953-458c-b8b7-4be0e346de54 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:35.514782 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-29194e81-3953-458c-b8b7-4be0e346de54 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] [instance: 18856f67-eebe-4c6a-89bc-4a2e60408d2e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:35.516895 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=62 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:35.531921 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-29194e81-3953-458c-b8b7-4be0e346de54 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:35.533761 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-29194e81-3953-458c-b8b7-4be0e346de54 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:35.534643 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-29194e81-3953-458c-b8b7-4be0e346de54 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:35.535790 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-29194e81-3953-458c-b8b7-4be0e346de54 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:35.536722 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-29194e81-3953-458c-b8b7-4be0e346de54 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:35.538098 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-29194e81-3953-458c-b8b7-4be0e346de54 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:35.900863 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-78e050f0-5db9-473e-8a72-2455ae6fa537 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:35.904164 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-78e050f0-5db9-473e-8a72-2455ae6fa537 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: a1c09528-36b8-4b0d-b03c-2d3351649579] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:35.921330 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78e050f0-5db9-473e-8a72-2455ae6fa537 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:35.922295 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78e050f0-5db9-473e-8a72-2455ae6fa537 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:35.922742 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78e050f0-5db9-473e-8a72-2455ae6fa537 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:35.923457 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78e050f0-5db9-473e-8a72-2455ae6fa537 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:35.924011 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78e050f0-5db9-473e-8a72-2455ae6fa537 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:35.924362 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78e050f0-5db9-473e-8a72-2455ae6fa537 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:36.056466 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-29194e81-3953-458c-b8b7-4be0e346de54 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0e7a058704483bbad57ef73de92e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622262beb7574e388c20207cccd5073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:36.081279 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-29194e81-3953-458c-b8b7-4be0e346de54 tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] 10.222.0.39 "GET /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e" status: 200 len: 1476 microversion: 2.1 time: 0.565259 Aug 07 01:20:36.084297 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1274/2298] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:35 2022] GET /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e => generated 1476 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:36.207634 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7940f59c-d08d-4979-be37-09ed8ac7a3de tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:36.208777 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7940f59c-d08d-4979-be37-09ed8ac7a3de tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d2f5a46c-8f96-4c33-9146-1aba108920ab] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:36.220661 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-78e050f0-5db9-473e-8a72-2455ae6fa537 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:36.228928 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7940f59c-d08d-4979-be37-09ed8ac7a3de tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:36.231315 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7940f59c-d08d-4979-be37-09ed8ac7a3de tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:36.234708 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-78e050f0-5db9-473e-8a72-2455ae6fa537 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579" status: 200 len: 1489 microversion: 2.1 time: 0.353723 Aug 07 01:20:36.235940 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1025/2299] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:35 2022] GET /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579 => generated 1489 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:36.236616 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7940f59c-d08d-4979-be37-09ed8ac7a3de tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:36.237382 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7940f59c-d08d-4979-be37-09ed8ac7a3de tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:36.237856 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7940f59c-d08d-4979-be37-09ed8ac7a3de tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:36.238285 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7940f59c-d08d-4979-be37-09ed8ac7a3de tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:36.256163 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5f1ec2b2-baa0-4595-ad77-cd78a483b76d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:36.257064 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5f1ec2b2-baa0-4595-ad77-cd78a483b76d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 937ef9c3-acf0-4874-846f-fde53d884d0a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:36.270263 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f1ec2b2-baa0-4595-ad77-cd78a483b76d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:36.270873 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f1ec2b2-baa0-4595-ad77-cd78a483b76d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:36.271325 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f1ec2b2-baa0-4595-ad77-cd78a483b76d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:36.272575 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f1ec2b2-baa0-4595-ad77-cd78a483b76d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:36.273036 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f1ec2b2-baa0-4595-ad77-cd78a483b76d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:36.273634 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f1ec2b2-baa0-4595-ad77-cd78a483b76d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:36.507989 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5f1ec2b2-baa0-4595-ad77-cd78a483b76d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:36.522345 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5f1ec2b2-baa0-4595-ad77-cd78a483b76d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a" status: 200 len: 1490 microversion: 2.1 time: 0.270036 Aug 07 01:20:36.523948 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1026/2300] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:36 2022] GET /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a => generated 1490 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:36.549179 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-88402ae7-903d-4b32-bf54-1970425cdfb9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:36.550244 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-88402ae7-903d-4b32-bf54-1970425cdfb9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: a1c09528-36b8-4b0d-b03c-2d3351649579] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:36.559199 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-88402ae7-903d-4b32-bf54-1970425cdfb9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:36.559956 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-88402ae7-903d-4b32-bf54-1970425cdfb9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:36.560629 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-88402ae7-903d-4b32-bf54-1970425cdfb9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:36.561563 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-88402ae7-903d-4b32-bf54-1970425cdfb9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:36.562195 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-88402ae7-903d-4b32-bf54-1970425cdfb9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:36.562824 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-88402ae7-903d-4b32-bf54-1970425cdfb9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:36.676859 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7940f59c-d08d-4979-be37-09ed8ac7a3de tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:36.685183 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7940f59c-d08d-4979-be37-09ed8ac7a3de tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab" status: 200 len: 1318 microversion: 2.1 time: 0.488341 Aug 07 01:20:36.690581 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1275/2301] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:36 2022] GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab => generated 1318 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:20:36.753904 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-88402ae7-903d-4b32-bf54-1970425cdfb9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:36.768714 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-88402ae7-903d-4b32-bf54-1970425cdfb9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579" status: 200 len: 1489 microversion: 2.1 time: 0.219907 Aug 07 01:20:36.769631 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1027/2302] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:36 2022] GET /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579 => generated 1489 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:36.792259 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a147bf77-164c-4f8b-8c3e-6bf381e45e4e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:36.792941 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a147bf77-164c-4f8b-8c3e-6bf381e45e4e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: a1c09528-36b8-4b0d-b03c-2d3351649579] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:36.816771 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a147bf77-164c-4f8b-8c3e-6bf381e45e4e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:36.817521 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a147bf77-164c-4f8b-8c3e-6bf381e45e4e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:36.818110 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a147bf77-164c-4f8b-8c3e-6bf381e45e4e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:36.820771 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a147bf77-164c-4f8b-8c3e-6bf381e45e4e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:36.823281 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a147bf77-164c-4f8b-8c3e-6bf381e45e4e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:36.826240 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a147bf77-164c-4f8b-8c3e-6bf381e45e4e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:36.923521 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a147bf77-164c-4f8b-8c3e-6bf381e45e4e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: a1c09528-36b8-4b0d-b03c-2d3351649579] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:20:37.082875 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-33e6b8cc-b898-45c7-bfea-46257a205bc0 req-c99e3e9d-fcd4-449f-bcdc-4be8f1da259e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18856f67-eebe-4c6a-89bc-4a2e60408d2e", "name": "network-vif-deleted", "tag": "fff03e15-a848-4a71-acb3-d24ef1e8ff01"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:37.104883 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-33e6b8cc-b898-45c7-bfea-46257a205bc0 req-c99e3e9d-fcd4-449f-bcdc-4be8f1da259e service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:37.105629 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-33e6b8cc-b898-45c7-bfea-46257a205bc0 req-c99e3e9d-fcd4-449f-bcdc-4be8f1da259e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:37.106403 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-33e6b8cc-b898-45c7-bfea-46257a205bc0 req-c99e3e9d-fcd4-449f-bcdc-4be8f1da259e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:37.128388 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-33e6b8cc-b898-45c7-bfea-46257a205bc0 req-c99e3e9d-fcd4-449f-bcdc-4be8f1da259e service nova] Creating event network-vif-deleted:fff03e15-a848-4a71-acb3-d24ef1e8ff01 for instance 18856f67-eebe-4c6a-89bc-4a2e60408d2e on n-h1-master-1 Aug 07 01:20:37.140068 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-33e6b8cc-b898-45c7-bfea-46257a205bc0 req-c99e3e9d-fcd4-449f-bcdc-4be8f1da259e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067779 Aug 07 01:20:37.141793 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1028/2303] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:37.149137 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-55bd0820-ff9a-4278-a30a-e7a26e747a5a tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:37.150116 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-55bd0820-ff9a-4278-a30a-e7a26e747a5a tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] [instance: 18856f67-eebe-4c6a-89bc-4a2e60408d2e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:37.157495 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-55bd0820-ff9a-4278-a30a-e7a26e747a5a tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:37.158310 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-55bd0820-ff9a-4278-a30a-e7a26e747a5a tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:37.158923 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-55bd0820-ff9a-4278-a30a-e7a26e747a5a tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:37.159954 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-55bd0820-ff9a-4278-a30a-e7a26e747a5a tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:37.160611 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-55bd0820-ff9a-4278-a30a-e7a26e747a5a tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:37.161220 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-55bd0820-ff9a-4278-a30a-e7a26e747a5a tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:37.193639 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a147bf77-164c-4f8b-8c3e-6bf381e45e4e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579" status: 204 len: 0 microversion: 2.1 time: 0.405719 Aug 07 01:20:37.194863 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1276/2304] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:20:36 2022] DELETE /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:20:37.208292 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9f4dfea6-3a8f-4b0f-8482-d3e3f0ee3337 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:37.209295 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9f4dfea6-3a8f-4b0f-8482-d3e3f0ee3337 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: a1c09528-36b8-4b0d-b03c-2d3351649579] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:37.231902 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f4dfea6-3a8f-4b0f-8482-d3e3f0ee3337 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:37.237622 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f4dfea6-3a8f-4b0f-8482-d3e3f0ee3337 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:37.237622 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f4dfea6-3a8f-4b0f-8482-d3e3f0ee3337 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:37.237622 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f4dfea6-3a8f-4b0f-8482-d3e3f0ee3337 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:37.237622 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f4dfea6-3a8f-4b0f-8482-d3e3f0ee3337 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:37.237622 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f4dfea6-3a8f-4b0f-8482-d3e3f0ee3337 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:37.273028 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:37.299322 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-55bd0820-ff9a-4278-a30a-e7a26e747a5a tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d0e7a058704483bbad57ef73de92e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '622262beb7574e388c20207cccd5073d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:37.325021 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-55bd0820-ff9a-4278-a30a-e7a26e747a5a tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] 10.222.0.39 "GET /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e" status: 200 len: 1306 microversion: 2.1 time: 0.179781 Aug 07 01:20:37.325689 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1029/2305] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:37 2022] GET /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e => generated 1306 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:37.500418 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9f4dfea6-3a8f-4b0f-8482-d3e3f0ee3337 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:37.509996 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9f4dfea6-3a8f-4b0f-8482-d3e3f0ee3337 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579" status: 200 len: 1495 microversion: 2.1 time: 0.310441 Aug 07 01:20:37.511032 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1277/2306] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:37 2022] GET /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579 => generated 1495 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:37.714775 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-80c36141-9168-4cf3-a7ff-3d300e9162c0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:37.722605 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-80c36141-9168-4cf3-a7ff-3d300e9162c0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d2f5a46c-8f96-4c33-9146-1aba108920ab] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:37.739508 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-80c36141-9168-4cf3-a7ff-3d300e9162c0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:37.740022 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-80c36141-9168-4cf3-a7ff-3d300e9162c0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:37.749938 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-80c36141-9168-4cf3-a7ff-3d300e9162c0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:37.750706 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-80c36141-9168-4cf3-a7ff-3d300e9162c0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:37.751186 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-80c36141-9168-4cf3-a7ff-3d300e9162c0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:37.751616 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-80c36141-9168-4cf3-a7ff-3d300e9162c0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:38.011915 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-cd3495ef-bf7f-4732-99f5-69e4f2896524 req-a64d7422-e1ac-466f-b46b-fac5f8da9132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2f5a46c-8f96-4c33-9146-1aba108920ab", "name": "network-vif-plugged", "status": "completed", "tag": "39956047-e52a-4cec-88d8-400d42153136"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:38.018593 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-80c36141-9168-4cf3-a7ff-3d300e9162c0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:38.029069 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-80c36141-9168-4cf3-a7ff-3d300e9162c0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab" status: 200 len: 1318 microversion: 2.1 time: 0.318434 Aug 07 01:20:38.030386 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1030/2307] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:37 2022] GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:38.044796 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-cd3495ef-bf7f-4732-99f5-69e4f2896524 req-a64d7422-e1ac-466f-b46b-fac5f8da9132 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:38.045298 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-cd3495ef-bf7f-4732-99f5-69e4f2896524 req-a64d7422-e1ac-466f-b46b-fac5f8da9132 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:38.045742 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-cd3495ef-bf7f-4732-99f5-69e4f2896524 req-a64d7422-e1ac-466f-b46b-fac5f8da9132 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:38.060565 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-cd3495ef-bf7f-4732-99f5-69e4f2896524 req-a64d7422-e1ac-466f-b46b-fac5f8da9132 service nova] Creating event network-vif-plugged:39956047-e52a-4cec-88d8-400d42153136 for instance d2f5a46c-8f96-4c33-9146-1aba108920ab on n-h1-master-1 Aug 07 01:20:38.067088 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-cd3495ef-bf7f-4732-99f5-69e4f2896524 req-a64d7422-e1ac-466f-b46b-fac5f8da9132 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065168 Aug 07 01:20:38.068387 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1278/2308] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:20:38.346383 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7de4e663-e6b7-4bdf-ba8c-e254da8f0a5a tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:38.348567 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7de4e663-e6b7-4bdf-ba8c-e254da8f0a5a tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] [instance: 18856f67-eebe-4c6a-89bc-4a2e60408d2e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:38.356984 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7de4e663-e6b7-4bdf-ba8c-e254da8f0a5a tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:38.357897 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7de4e663-e6b7-4bdf-ba8c-e254da8f0a5a tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:38.359118 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7de4e663-e6b7-4bdf-ba8c-e254da8f0a5a tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:38.360309 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7de4e663-e6b7-4bdf-ba8c-e254da8f0a5a tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:38.361009 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7de4e663-e6b7-4bdf-ba8c-e254da8f0a5a tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:38.361652 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7de4e663-e6b7-4bdf-ba8c-e254da8f0a5a tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:38.379196 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-7de4e663-e6b7-4bdf-ba8c-e254da8f0a5a tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] HTTP exception thrown: Instance 18856f67-eebe-4c6a-89bc-4a2e60408d2e could not be found. Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7de4e663-e6b7-4bdf-ba8c-e254da8f0a5a tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Request method failure captured: Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e HTTP/1.1 Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xM2699BQyDEczBJkmqbn1GCOIwLX3BGFHmXkPNkib8YrrAcYKpTPFzS4bLw_Nh6kMe9cC_nqGBwHawN54WnEnovzZJZAwgomYwkCJqLA0P5syFi3Czs2ijC7M04tUegmfxl91c6aYmeHbKQ045ZHXrxcIGcTYhflVmVnOmTgT_ivKc Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 622262beb7574e388c20207cccd5073d Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1167256409 Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/622262beb7574e388c20207cccd5073d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_622262beb7574e388c20207cccd5073d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/622262beb7574e388c20207cccd5073d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/622262beb7574e388c20207cccd5073d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1167256409 Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 622262beb7574e388c20207cccd5073d Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1167256409 Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersAdminNegativeTestJSON-1167256409-project Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 81d0e7a058704483bbad57ef73de92e6 Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1167256409-project Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 18856f67-eebe-4c6a-89bc-4a2e60408d2e could not be found. Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '18856f67-eebe-4c6a-89bc-4a2e60408d2e'} Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18856f67-eebe-4c6a-89bc-4a2e60408d2e could not be found. Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18856f67-eebe-4c6a-89bc-4a2e60408d2e could not be found. Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:38.381292 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:38.384634 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:38.384634 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:38.384634 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:38.384634 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:38.384634 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:20:38.384634 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:20:38.384634 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18856f67-eebe-4c6a-89bc-4a2e60408d2e could not be found. Aug 07 01:20:38.384634 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:38.386790 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7de4e663-e6b7-4bdf-ba8c-e254da8f0a5a tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] Returning 404 to user: Instance 18856f67-eebe-4c6a-89bc-4a2e60408d2e could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:20:38.387995 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7de4e663-e6b7-4bdf-ba8c-e254da8f0a5a tempest-ServersAdminNegativeTestJSON-1167256409 tempest-ServersAdminNegativeTestJSON-1167256409-project] 10.222.0.39 "GET /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e" status: 404 len: 111 microversion: 2.1 time: 0.045794 Aug 07 01:20:38.389120 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1031/2309] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:38 2022] GET /compute/v2.1/servers/18856f67-eebe-4c6a-89bc-4a2e60408d2e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:20:38.531842 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2d301407-1dc3-4e56-8ec2-5a2f24492adc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:38.532576 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2d301407-1dc3-4e56-8ec2-5a2f24492adc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: a1c09528-36b8-4b0d-b03c-2d3351649579] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:38.551673 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2d301407-1dc3-4e56-8ec2-5a2f24492adc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:38.552194 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2d301407-1dc3-4e56-8ec2-5a2f24492adc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:38.552631 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2d301407-1dc3-4e56-8ec2-5a2f24492adc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:38.553346 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2d301407-1dc3-4e56-8ec2-5a2f24492adc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:38.553796 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2d301407-1dc3-4e56-8ec2-5a2f24492adc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:38.554223 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2d301407-1dc3-4e56-8ec2-5a2f24492adc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:38.800174 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2d301407-1dc3-4e56-8ec2-5a2f24492adc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:38.813719 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2d301407-1dc3-4e56-8ec2-5a2f24492adc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579" status: 200 len: 1495 microversion: 2.1 time: 0.286717 Aug 07 01:20:38.814679 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1279/2310] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:38 2022] GET /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579 => generated 1495 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:39.050788 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4b7894e0-3d65-4d82-9f79-e84a91cbcd24 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:39.051425 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4b7894e0-3d65-4d82-9f79-e84a91cbcd24 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d2f5a46c-8f96-4c33-9146-1aba108920ab] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:39.063711 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b7894e0-3d65-4d82-9f79-e84a91cbcd24 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:39.064463 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b7894e0-3d65-4d82-9f79-e84a91cbcd24 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:39.065099 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b7894e0-3d65-4d82-9f79-e84a91cbcd24 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:39.066039 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b7894e0-3d65-4d82-9f79-e84a91cbcd24 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:39.066689 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b7894e0-3d65-4d82-9f79-e84a91cbcd24 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:39.067314 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b7894e0-3d65-4d82-9f79-e84a91cbcd24 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:39.543801 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4b7894e0-3d65-4d82-9f79-e84a91cbcd24 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:39.557493 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4b7894e0-3d65-4d82-9f79-e84a91cbcd24 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab" status: 200 len: 1318 microversion: 2.1 time: 0.509430 Aug 07 01:20:39.558965 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1032/2311] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:39 2022] GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab => generated 1318 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:39.836299 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a74733cd-457f-41d1-8e58-884d337e0e44 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:39.836921 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a74733cd-457f-41d1-8e58-884d337e0e44 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: a1c09528-36b8-4b0d-b03c-2d3351649579] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:39.852627 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a74733cd-457f-41d1-8e58-884d337e0e44 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:39.853430 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a74733cd-457f-41d1-8e58-884d337e0e44 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:39.854051 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a74733cd-457f-41d1-8e58-884d337e0e44 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:39.854977 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a74733cd-457f-41d1-8e58-884d337e0e44 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:39.855626 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a74733cd-457f-41d1-8e58-884d337e0e44 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:39.856307 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a74733cd-457f-41d1-8e58-884d337e0e44 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:40.068232 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a74733cd-457f-41d1-8e58-884d337e0e44 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:40.081244 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a74733cd-457f-41d1-8e58-884d337e0e44 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579" status: 200 len: 1453 microversion: 2.1 time: 0.245291 Aug 07 01:20:40.081952 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1280/2312] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:39 2022] GET /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579 => generated 1453 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:40.144486 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-947a6468-41f1-4307-b23e-3469e36bd1b5 req-e584c67c-8d10-45b7-bba6-104aff280fde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1c09528-36b8-4b0d-b03c-2d3351649579", "name": "network-vif-deleted", "tag": "3069bfdf-1b77-40a1-bff5-d6fd063346fc"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:40.175780 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-947a6468-41f1-4307-b23e-3469e36bd1b5 req-e584c67c-8d10-45b7-bba6-104aff280fde service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:40.177816 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-947a6468-41f1-4307-b23e-3469e36bd1b5 req-e584c67c-8d10-45b7-bba6-104aff280fde service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:40.178603 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-947a6468-41f1-4307-b23e-3469e36bd1b5 req-e584c67c-8d10-45b7-bba6-104aff280fde service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:40.228071 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-947a6468-41f1-4307-b23e-3469e36bd1b5 req-e584c67c-8d10-45b7-bba6-104aff280fde service nova] Creating event network-vif-deleted:3069bfdf-1b77-40a1-bff5-d6fd063346fc for instance a1c09528-36b8-4b0d-b03c-2d3351649579 on n-h2-master-1 Aug 07 01:20:40.236134 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-947a6468-41f1-4307-b23e-3469e36bd1b5 req-e584c67c-8d10-45b7-bba6-104aff280fde service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098068 Aug 07 01:20:40.238310 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1033/2313] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:40.586298 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d53b1dcf-02a1-42b6-9404-62f548593cbb tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:40.591601 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d53b1dcf-02a1-42b6-9404-62f548593cbb tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] [instance: 1bc2c437-e710-4af4-9928-76c48834cfa2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:40.592162 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2c1b582f-8c9b-4448-8697-615a4c829331 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:40.612631 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2c1b582f-8c9b-4448-8697-615a4c829331 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d2f5a46c-8f96-4c33-9146-1aba108920ab] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:40.626694 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d53b1dcf-02a1-42b6-9404-62f548593cbb tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:40.627191 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d53b1dcf-02a1-42b6-9404-62f548593cbb tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:40.630112 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c1b582f-8c9b-4448-8697-615a4c829331 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:40.630644 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d53b1dcf-02a1-42b6-9404-62f548593cbb tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:40.631709 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c1b582f-8c9b-4448-8697-615a4c829331 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:40.632392 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d53b1dcf-02a1-42b6-9404-62f548593cbb tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:40.632858 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d53b1dcf-02a1-42b6-9404-62f548593cbb tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:40.633320 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c1b582f-8c9b-4448-8697-615a4c829331 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:40.634043 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c1b582f-8c9b-4448-8697-615a4c829331 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:40.634493 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c1b582f-8c9b-4448-8697-615a4c829331 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:40.634910 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c1b582f-8c9b-4448-8697-615a4c829331 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:40.636326 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d53b1dcf-02a1-42b6-9404-62f548593cbb tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:40.751564 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d53b1dcf-02a1-42b6-9404-62f548593cbb tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] 10.222.0.39 "GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.175347 Aug 07 01:20:40.759756 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1281/2314] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:20:40 2022] GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2/os-volume_attachments => generated 25 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:20:40.765879 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ab1fc954-a877-4546-a465-fcc60b907318 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:40.767003 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ab1fc954-a877-4546-a465-fcc60b907318 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:40.776276 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ab1fc954-a877-4546-a465-fcc60b907318 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:40.776933 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ab1fc954-a877-4546-a465-fcc60b907318 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:40.779402 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ab1fc954-a877-4546-a465-fcc60b907318 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:40.781147 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ab1fc954-a877-4546-a465-fcc60b907318 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:40.781785 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ab1fc954-a877-4546-a465-fcc60b907318 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:40.782401 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ab1fc954-a877-4546-a465-fcc60b907318 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:41.046463 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2c1b582f-8c9b-4448-8697-615a4c829331 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:41.065378 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2c1b582f-8c9b-4448-8697-615a4c829331 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab" status: 200 len: 1507 microversion: 2.1 time: 0.484292 Aug 07 01:20:41.067492 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1034/2315] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:40 2022] GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab => generated 1507 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:41.083830 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-99d002c9-9a81-4710-ba89-88ada322c7ac tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:41.089093 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-99d002c9-9a81-4710-ba89-88ada322c7ac tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] [instance: 1bc2c437-e710-4af4-9928-76c48834cfa2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:41.095513 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:41.103363 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-99d002c9-9a81-4710-ba89-88ada322c7ac tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:41.104228 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-99d002c9-9a81-4710-ba89-88ada322c7ac tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:41.104975 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-99d002c9-9a81-4710-ba89-88ada322c7ac tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:41.106839 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-99d002c9-9a81-4710-ba89-88ada322c7ac tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:41.107639 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-99d002c9-9a81-4710-ba89-88ada322c7ac tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:41.108600 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-99d002c9-9a81-4710-ba89-88ada322c7ac tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:41.119391 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-ab1fc954-a877-4546-a465-fcc60b907318 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lazy-loading 'services' on Instance uuid acc886e0-c989-4105-8375-0c42d4e96404 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:20:41.173099 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ab1fc954-a877-4546-a465-fcc60b907318 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 2422 microversion: 2.25 time: 0.411242 Aug 07 01:20:41.176581 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1282/2316] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:40 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 2422 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:20:41.201368 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9a603930-9461-4107-b529-e3401e9fbc73 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:41.202005 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9a603930-9461-4107-b529-e3401e9fbc73 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d2f5a46c-8f96-4c33-9146-1aba108920ab] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:41.203358 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-99d002c9-9a81-4710-ba89-88ada322c7ac tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] 10.222.0.39 "GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.133338 Aug 07 01:20:41.204224 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1035/2317] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:20:41 2022] GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2/os-volume_attachments => generated 25 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:20:41.217738 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9a603930-9461-4107-b529-e3401e9fbc73 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:41.218612 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9a603930-9461-4107-b529-e3401e9fbc73 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:41.219786 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9a603930-9461-4107-b529-e3401e9fbc73 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:41.220764 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9a603930-9461-4107-b529-e3401e9fbc73 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:41.222127 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9a603930-9461-4107-b529-e3401e9fbc73 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:41.223028 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9a603930-9461-4107-b529-e3401e9fbc73 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:41.235105 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fa0ec8d4-a123-48fc-b59f-34fb69f8267b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:41.237509 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fa0ec8d4-a123-48fc-b59f-34fb69f8267b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: a1c09528-36b8-4b0d-b03c-2d3351649579] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:41.258138 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa0ec8d4-a123-48fc-b59f-34fb69f8267b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:41.258818 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa0ec8d4-a123-48fc-b59f-34fb69f8267b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:41.260326 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa0ec8d4-a123-48fc-b59f-34fb69f8267b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:41.261933 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa0ec8d4-a123-48fc-b59f-34fb69f8267b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:41.265574 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa0ec8d4-a123-48fc-b59f-34fb69f8267b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:41.266133 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa0ec8d4-a123-48fc-b59f-34fb69f8267b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:41.307167 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-fa0ec8d4-a123-48fc-b59f-34fb69f8267b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] HTTP exception thrown: Instance a1c09528-36b8-4b0d-b03c-2d3351649579 could not be found. Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fa0ec8d4-a123-48fc-b59f-34fb69f8267b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Request method failure captured: Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579 HTTP/1.1 Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xLZuMLvQ88KTsXpEnT0I-tjdBFOm7EEtVmBSoi3hGbagLa-WCqW3nJreDc3WwTe1tbLbMC3xnpg15asRoKTlUvK3aMhcihww2F0hywjkHPX3fkbbtMYbGiIT_pGesW2tpqp2g11Pwb-WDA3oTL-VeLkmCHA0u8DPW_SmhTlX9-nF08 Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersTestJSON-576619186 Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_efad066360cb45b3a6e9ba872118ea57", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersTestJSON-576619186 Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersTestJSON-576619186 Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersTestJSON-576619186-project Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d4f7282c7251455086368d5274a4fac5 Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersTestJSON-576619186-project Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: exception: Instance a1c09528-36b8-4b0d-b03c-2d3351649579 could not be found. Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'a1c09528-36b8-4b0d-b03c-2d3351649579'} Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1c09528-36b8-4b0d-b03c-2d3351649579 could not be found. Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1c09528-36b8-4b0d-b03c-2d3351649579 could not be found. Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:41.309983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:41.314342 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:41.314342 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:41.314342 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:20:41.314342 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:20:41.314342 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1c09528-36b8-4b0d-b03c-2d3351649579 could not be found. Aug 07 01:20:41.314342 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:41.319639 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fa0ec8d4-a123-48fc-b59f-34fb69f8267b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Returning 404 to user: Instance a1c09528-36b8-4b0d-b03c-2d3351649579 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:20:41.323385 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fa0ec8d4-a123-48fc-b59f-34fb69f8267b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579" status: 404 len: 111 microversion: 2.1 time: 0.117690 Aug 07 01:20:41.334049 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1036/2318] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:41 2022] GET /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:20:41.351325 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-94d15c43-d7e7-4a73-add3-18ef3c313c8d tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": "auto"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:41.355940 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-94d15c43-d7e7-4a73-add3-18ef3c313c8d tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:41.376472 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94d15c43-d7e7-4a73-add3-18ef3c313c8d tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:41.380830 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94d15c43-d7e7-4a73-add3-18ef3c313c8d tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:41.384285 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94d15c43-d7e7-4a73-add3-18ef3c313c8d tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:41.385552 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94d15c43-d7e7-4a73-add3-18ef3c313c8d tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:41.386282 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94d15c43-d7e7-4a73-add3-18ef3c313c8d tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:41.390422 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94d15c43-d7e7-4a73-add3-18ef3c313c8d tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:41.438229 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-94d15c43-d7e7-4a73-add3-18ef3c313c8d tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lazy-loading 'flavor' on Instance uuid acc886e0-c989-4105-8375-0c42d4e96404 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:20:41.460374 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-94d15c43-d7e7-4a73-add3-18ef3c313c8d tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Going to try to live migrate instance to n-h2-master-1 {{(pid=119517) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 07 01:20:41.580936 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9a603930-9461-4107-b529-e3401e9fbc73 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:41.591613 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9a603930-9461-4107-b529-e3401e9fbc73 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab" status: 200 len: 1507 microversion: 2.1 time: 0.412772 Aug 07 01:20:41.611449 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1283/2319] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:41 2022] GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab => generated 1507 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:41.622081 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b848c828-e617-4afb-996b-b2bde379da8f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:41.622626 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b848c828-e617-4afb-996b-b2bde379da8f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 937ef9c3-acf0-4874-846f-fde53d884d0a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:41.639641 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b848c828-e617-4afb-996b-b2bde379da8f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:41.642156 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b848c828-e617-4afb-996b-b2bde379da8f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:41.642997 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b848c828-e617-4afb-996b-b2bde379da8f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:41.644782 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b848c828-e617-4afb-996b-b2bde379da8f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:41.645261 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b848c828-e617-4afb-996b-b2bde379da8f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:41.645704 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b848c828-e617-4afb-996b-b2bde379da8f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:41.713306 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b848c828-e617-4afb-996b-b2bde379da8f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 937ef9c3-acf0-4874-846f-fde53d884d0a] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:20:41.849415 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b848c828-e617-4afb-996b-b2bde379da8f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "DELETE /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a" status: 204 len: 0 microversion: 2.1 time: 0.236114 Aug 07 01:20:41.850007 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1284/2320] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:20:41 2022] DELETE /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:20:41.857936 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-02e9880d-1f73-4cb9-82ea-44f989495f50 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:41.859486 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-02e9880d-1f73-4cb9-82ea-44f989495f50 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] [instance: 1bc2c437-e710-4af4-9928-76c48834cfa2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:41.880849 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-02e9880d-1f73-4cb9-82ea-44f989495f50 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:41.882261 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-02e9880d-1f73-4cb9-82ea-44f989495f50 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:41.882944 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-02e9880d-1f73-4cb9-82ea-44f989495f50 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:41.883874 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-02e9880d-1f73-4cb9-82ea-44f989495f50 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:41.884543 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-02e9880d-1f73-4cb9-82ea-44f989495f50 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:41.887078 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-02e9880d-1f73-4cb9-82ea-44f989495f50 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:41.933459 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-02e9880d-1f73-4cb9-82ea-44f989495f50 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] [instance: 1bc2c437-e710-4af4-9928-76c48834cfa2] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:20:42.145903 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-02e9880d-1f73-4cb9-82ea-44f989495f50 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2" status: 204 len: 0 microversion: 2.1 time: 0.293743 Aug 07 01:20:42.147577 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1285/2321] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:20:41 2022] DELETE /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:20:42.164019 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-eeea5c09-4aef-420f-85fa-1414bb350ad9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:42.166930 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-eeea5c09-4aef-420f-85fa-1414bb350ad9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d2f5a46c-8f96-4c33-9146-1aba108920ab] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:42.182737 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eeea5c09-4aef-420f-85fa-1414bb350ad9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:42.183503 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eeea5c09-4aef-420f-85fa-1414bb350ad9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:42.184077 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eeea5c09-4aef-420f-85fa-1414bb350ad9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:42.184888 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eeea5c09-4aef-420f-85fa-1414bb350ad9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:42.185440 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eeea5c09-4aef-420f-85fa-1414bb350ad9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:42.185999 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eeea5c09-4aef-420f-85fa-1414bb350ad9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:42.295662 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-eeea5c09-4aef-420f-85fa-1414bb350ad9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "PUT /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab" status: 200 len: 1079 microversion: 2.1 time: 0.142784 Aug 07 01:20:42.302864 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1286/2322] 10.222.0.39 () {60 vars in 1256 bytes} [Sun Aug 7 01:20:42 2022] PUT /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab => generated 1079 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:42.308120 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e7e82fb0-d000-493a-a57a-4a91b22b3c8f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:42.308849 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e7e82fb0-d000-493a-a57a-4a91b22b3c8f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 937ef9c3-acf0-4874-846f-fde53d884d0a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:42.316109 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7e82fb0-d000-493a-a57a-4a91b22b3c8f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:42.316670 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7e82fb0-d000-493a-a57a-4a91b22b3c8f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:42.317209 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7e82fb0-d000-493a-a57a-4a91b22b3c8f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:42.318020 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7e82fb0-d000-493a-a57a-4a91b22b3c8f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:42.318571 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7e82fb0-d000-493a-a57a-4a91b22b3c8f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:42.319088 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7e82fb0-d000-493a-a57a-4a91b22b3c8f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:42.606325 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e7e82fb0-d000-493a-a57a-4a91b22b3c8f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:42.615069 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e7e82fb0-d000-493a-a57a-4a91b22b3c8f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a" status: 200 len: 1496 microversion: 2.1 time: 0.310744 Aug 07 01:20:42.615926 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1287/2323] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:42 2022] GET /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a => generated 1496 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:42.620317 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e3c03b72-aeb2-43c4-b988-c31e69fb034a tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:42.620934 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e3c03b72-aeb2-43c4-b988-c31e69fb034a tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] [instance: 1bc2c437-e710-4af4-9928-76c48834cfa2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:42.633627 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3c03b72-aeb2-43c4-b988-c31e69fb034a tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:42.637509 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3c03b72-aeb2-43c4-b988-c31e69fb034a tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:42.638063 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3c03b72-aeb2-43c4-b988-c31e69fb034a tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:42.638955 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3c03b72-aeb2-43c4-b988-c31e69fb034a tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:42.639475 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3c03b72-aeb2-43c4-b988-c31e69fb034a tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:42.639937 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3c03b72-aeb2-43c4-b988-c31e69fb034a tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:42.961120 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e3c03b72-aeb2-43c4-b988-c31e69fb034a tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5080c88d51a8455bba8b70e33cca958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6a995089fa447e8f74df7d111b1c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:42.978040 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e3c03b72-aeb2-43c4-b988-c31e69fb034a tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] 10.222.0.39 "GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2" status: 200 len: 1681 microversion: 2.1 time: 0.361205 Aug 07 01:20:42.979629 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1288/2324] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:42 2022] GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2 => generated 1681 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:42.988275 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2f11f9c1-d1bc-434d-b24b-9a15fe164849 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:42.990591 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2f11f9c1-d1bc-434d-b24b-9a15fe164849 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d2f5a46c-8f96-4c33-9146-1aba108920ab] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:42.998770 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f11f9c1-d1bc-434d-b24b-9a15fe164849 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:42.999821 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f11f9c1-d1bc-434d-b24b-9a15fe164849 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:43.000781 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f11f9c1-d1bc-434d-b24b-9a15fe164849 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:43.002105 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f11f9c1-d1bc-434d-b24b-9a15fe164849 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:43.003013 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f11f9c1-d1bc-434d-b24b-9a15fe164849 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:43.005158 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f11f9c1-d1bc-434d-b24b-9a15fe164849 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:43.323384 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2f11f9c1-d1bc-434d-b24b-9a15fe164849 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:43.335557 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2f11f9c1-d1bc-434d-b24b-9a15fe164849 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab" status: 200 len: 1505 microversion: 2.1 time: 0.354158 Aug 07 01:20:43.337142 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1289/2325] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:42 2022] GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab => generated 1505 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:43.362733 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d30b4664-5853-4cb2-a3de-5f963f2506e6 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:43.363855 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d30b4664-5853-4cb2-a3de-5f963f2506e6 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d2f5a46c-8f96-4c33-9146-1aba108920ab] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:43.372254 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d30b4664-5853-4cb2-a3de-5f963f2506e6 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:43.373306 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d30b4664-5853-4cb2-a3de-5f963f2506e6 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:43.373983 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d30b4664-5853-4cb2-a3de-5f963f2506e6 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:43.376139 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d30b4664-5853-4cb2-a3de-5f963f2506e6 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:43.376809 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d30b4664-5853-4cb2-a3de-5f963f2506e6 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:43.377521 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d30b4664-5853-4cb2-a3de-5f963f2506e6 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:43.394234 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:43.476129 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=11 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:43.576402 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:43.716240 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d30b4664-5853-4cb2-a3de-5f963f2506e6 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:43.729709 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d30b4664-5853-4cb2-a3de-5f963f2506e6 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab" status: 200 len: 1505 microversion: 2.1 time: 0.370498 Aug 07 01:20:43.743918 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1290/2326] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:43 2022] GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab => generated 1505 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:43.743918 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6153c2c2-f00f-46d9-9eea-c552c11ff67d tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-711389692", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "bfd7ed5b-0592-4c12-8563-ad4b1303abcb"}], "security_groups": [{"name": "tempest-securitygroup--144612663"}], "key_name": "tempest-keypair-969236097", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "c4682d45-0ee0-4d56-a658-aed285e0370a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:44.249927 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-6153c2c2-f00f-46d9-9eea-c552c11ff67d tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] validate_networks() for [('bfd7ed5b-0592-4c12-8563-ad4b1303abcb', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:20:45.045112 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-6153c2c2-f00f-46d9-9eea-c552c11ff67d tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Getting quotas for project b06e7912f1fe423ea1b2a4bcdb90804a. Resources: dict_keys(['metadata_items']) {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:20:45.059801 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-6153c2c2-f00f-46d9-9eea-c552c11ff67d tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Getting quotas for user e4feb14c621b4090af8c965c9aaf0e2d and project b06e7912f1fe423ea1b2a4bcdb90804a. Resources: dict_keys(['metadata_items']) {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:20:45.078996 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:45.081489 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-6153c2c2-f00f-46d9-9eea-c552c11ff67d tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:20:45.082218 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-6153c2c2-f00f-46d9-9eea-c552c11ff67d tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:20:45.082847 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-6153c2c2-f00f-46d9-9eea-c552c11ff67d tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:20:45.083409 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-6153c2c2-f00f-46d9-9eea-c552c11ff67d tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:20:45.083997 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-6153c2c2-f00f-46d9-9eea-c552c11ff67d tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:20:45.097288 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6153c2c2-f00f-46d9-9eea-c552c11ff67d tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:45.098448 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6153c2c2-f00f-46d9-9eea-c552c11ff67d tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:45.099212 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6153c2c2-f00f-46d9-9eea-c552c11ff67d tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:45.100256 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6153c2c2-f00f-46d9-9eea-c552c11ff67d tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:45.101058 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6153c2c2-f00f-46d9-9eea-c552c11ff67d tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:45.101778 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6153c2c2-f00f-46d9-9eea-c552c11ff67d tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:45.124613 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-6153c2c2-f00f-46d9-9eea-c552c11ff67d tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Getting quotas for project b06e7912f1fe423ea1b2a4bcdb90804a. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:20:45.132564 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-6153c2c2-f00f-46d9-9eea-c552c11ff67d tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Getting quotas for user e4feb14c621b4090af8c965c9aaf0e2d and project b06e7912f1fe423ea1b2a4bcdb90804a. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:20:45.205826 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6153c2c2-f00f-46d9-9eea-c552c11ff67d tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:20:45.208085 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6153c2c2-f00f-46d9-9eea-c552c11ff67d tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] [instance: 76aa2198-b299-4359-b606-3b6afa2326fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c4682d45-0ee0-4d56-a658-aed285e0370a',volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:20:45.408685 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6153c2c2-f00f-46d9-9eea-c552c11ff67d tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.676275 Aug 07 01:20:45.413246 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1291/2327] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:20:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 1681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:20:45.431834 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d3538793-5344-4e06-b9f0-d0628d367d92 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:45.434042 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d3538793-5344-4e06-b9f0-d0628d367d92 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 937ef9c3-acf0-4874-846f-fde53d884d0a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:45.443602 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3538793-5344-4e06-b9f0-d0628d367d92 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:45.444189 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3538793-5344-4e06-b9f0-d0628d367d92 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:45.445788 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3538793-5344-4e06-b9f0-d0628d367d92 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:45.445941 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3538793-5344-4e06-b9f0-d0628d367d92 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:45.446383 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3538793-5344-4e06-b9f0-d0628d367d92 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:45.447957 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3538793-5344-4e06-b9f0-d0628d367d92 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:45.674007 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-94d15c43-d7e7-4a73-add3-18ef3c313c8d tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404/action" status: 202 len: 0 microversion: 2.25 time: 4.338475 Aug 07 01:20:45.677585 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1037/2328] 10.222.0.39 () {62 vars in 1319 bytes} [Sun Aug 7 01:20:41 2022] POST /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404/action => generated 0 bytes in 4340 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:20:45.681187 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6f6fbb9b-5e44-47fc-b63e-f1990e9e939b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:45.683763 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6f6fbb9b-5e44-47fc-b63e-f1990e9e939b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d2f5a46c-8f96-4c33-9146-1aba108920ab] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:45.712523 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f6fbb9b-5e44-47fc-b63e-f1990e9e939b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:45.713462 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f6fbb9b-5e44-47fc-b63e-f1990e9e939b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:45.714177 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f6fbb9b-5e44-47fc-b63e-f1990e9e939b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:45.715456 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f6fbb9b-5e44-47fc-b63e-f1990e9e939b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:45.718525 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f6fbb9b-5e44-47fc-b63e-f1990e9e939b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:45.719773 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f6fbb9b-5e44-47fc-b63e-f1990e9e939b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:45.834301 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6f6fbb9b-5e44-47fc-b63e-f1990e9e939b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "PUT /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab" status: 200 len: 1081 microversion: 2.1 time: 0.158201 Aug 07 01:20:45.835809 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1038/2329] 10.222.0.39 () {60 vars in 1256 bytes} [Sun Aug 7 01:20:45 2022] PUT /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab => generated 1081 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:45.845948 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d3538793-5344-4e06-b9f0-d0628d367d92 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:45.852719 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-02c4bc74-2538-44f0-9781-4e8276e7feae tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:45.853723 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-02c4bc74-2538-44f0-9781-4e8276e7feae tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] [instance: 1bc2c437-e710-4af4-9928-76c48834cfa2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:45.857643 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d3538793-5344-4e06-b9f0-d0628d367d92 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a" status: 200 len: 1496 microversion: 2.1 time: 0.443616 Aug 07 01:20:45.859712 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1292/2330] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:45 2022] GET /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a => generated 1496 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:45.874438 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-228adcf0-1c39-4b05-8c50-c9c14eebc905 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:45.876814 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-228adcf0-1c39-4b05-8c50-c9c14eebc905 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] [instance: 76aa2198-b299-4359-b606-3b6afa2326fa] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:45.882482 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-02c4bc74-2538-44f0-9781-4e8276e7feae tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:45.887528 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-02c4bc74-2538-44f0-9781-4e8276e7feae tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:45.891453 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-02c4bc74-2538-44f0-9781-4e8276e7feae tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:45.892745 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-02c4bc74-2538-44f0-9781-4e8276e7feae tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:45.894412 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-02c4bc74-2538-44f0-9781-4e8276e7feae tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:45.897884 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-02c4bc74-2538-44f0-9781-4e8276e7feae tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:45.912960 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:46.073985 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-228adcf0-1c39-4b05-8c50-c9c14eebc905 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4feb14c621b4090af8c965c9aaf0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06e7912f1fe423ea1b2a4bcdb90804a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:46.088145 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-228adcf0-1c39-4b05-8c50-c9c14eebc905 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] 10.222.0.39 "GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa" status: 200 len: 1120 microversion: 2.1 time: 0.223473 Aug 07 01:20:46.088755 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1293/2331] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:45 2022] GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa => generated 1120 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:46.111368 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-93664a98-f56d-4416-ada9-fd9ec75f4fcb tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:46.113437 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-93664a98-f56d-4416-ada9-fd9ec75f4fcb tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:46.123950 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93664a98-f56d-4416-ada9-fd9ec75f4fcb tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:46.124799 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93664a98-f56d-4416-ada9-fd9ec75f4fcb tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:46.126044 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93664a98-f56d-4416-ada9-fd9ec75f4fcb tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:46.127035 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93664a98-f56d-4416-ada9-fd9ec75f4fcb tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:46.127695 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93664a98-f56d-4416-ada9-fd9ec75f4fcb tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:46.128368 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93664a98-f56d-4416-ada9-fd9ec75f4fcb tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:46.449678 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-93664a98-f56d-4416-ada9-fd9ec75f4fcb tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:46.463276 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-93664a98-f56d-4416-ada9-fd9ec75f4fcb tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:46.465567 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-93664a98-f56d-4416-ada9-fd9ec75f4fcb tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:46.469351 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-93664a98-f56d-4416-ada9-fd9ec75f4fcb tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 1813 microversion: 2.25 time: 0.379584 Aug 07 01:20:46.475222 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1294/2332] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:46 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 1813 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:20:46.488656 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-44c1d4cf-5857-4ea7-9366-db5dc9e3c5e2 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:46.491659 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-44c1d4cf-5857-4ea7-9366-db5dc9e3c5e2 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d2f5a46c-8f96-4c33-9146-1aba108920ab] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:46.508615 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-44c1d4cf-5857-4ea7-9366-db5dc9e3c5e2 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:46.510054 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-44c1d4cf-5857-4ea7-9366-db5dc9e3c5e2 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:46.511818 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-44c1d4cf-5857-4ea7-9366-db5dc9e3c5e2 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:46.515696 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-44c1d4cf-5857-4ea7-9366-db5dc9e3c5e2 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:46.516441 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-44c1d4cf-5857-4ea7-9366-db5dc9e3c5e2 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:46.517045 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-44c1d4cf-5857-4ea7-9366-db5dc9e3c5e2 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:46.965281 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-44c1d4cf-5857-4ea7-9366-db5dc9e3c5e2 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:47.009211 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-44c1d4cf-5857-4ea7-9366-db5dc9e3c5e2 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab" status: 200 len: 1507 microversion: 2.1 time: 0.532141 Aug 07 01:20:47.009839 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1295/2333] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:46 2022] GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab => generated 1507 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:47.022719 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-739c7bb8-3e13-4376-bb34-03d0b65bca9f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:47.023624 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-739c7bb8-3e13-4376-bb34-03d0b65bca9f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 937ef9c3-acf0-4874-846f-fde53d884d0a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:47.035658 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-739c7bb8-3e13-4376-bb34-03d0b65bca9f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:47.043675 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-739c7bb8-3e13-4376-bb34-03d0b65bca9f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:47.044455 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-739c7bb8-3e13-4376-bb34-03d0b65bca9f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:47.045753 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-739c7bb8-3e13-4376-bb34-03d0b65bca9f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:47.045753 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-739c7bb8-3e13-4376-bb34-03d0b65bca9f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:47.046597 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-739c7bb8-3e13-4376-bb34-03d0b65bca9f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:47.287766 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-02c4bc74-2538-44f0-9781-4e8276e7feae tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5080c88d51a8455bba8b70e33cca958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6a995089fa447e8f74df7d111b1c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:47.297882 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-02c4bc74-2538-44f0-9781-4e8276e7feae tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] 10.222.0.39 "GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2" status: 200 len: 1681 microversion: 2.1 time: 1.458700 Aug 07 01:20:47.298398 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1039/2334] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:45 2022] GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2 => generated 1681 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:47.321373 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-da6cbfa9-e182-40a3-abc6-c7a0b6d17fb0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:47.322002 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-da6cbfa9-e182-40a3-abc6-c7a0b6d17fb0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d2f5a46c-8f96-4c33-9146-1aba108920ab] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:47.345055 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da6cbfa9-e182-40a3-abc6-c7a0b6d17fb0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:47.345557 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da6cbfa9-e182-40a3-abc6-c7a0b6d17fb0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:47.346194 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da6cbfa9-e182-40a3-abc6-c7a0b6d17fb0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:47.347070 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da6cbfa9-e182-40a3-abc6-c7a0b6d17fb0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:47.347674 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da6cbfa9-e182-40a3-abc6-c7a0b6d17fb0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:47.348310 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da6cbfa9-e182-40a3-abc6-c7a0b6d17fb0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:47.629058 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-739c7bb8-3e13-4376-bb34-03d0b65bca9f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:47.649873 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-739c7bb8-3e13-4376-bb34-03d0b65bca9f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a" status: 200 len: 1496 microversion: 2.1 time: 0.636542 Aug 07 01:20:47.663456 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1296/2335] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:47 2022] GET /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a => generated 1496 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:47.663456 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-756f7cc5-f4c4-4de1-92e8-d6f4f96e4637 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:47.663456 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-756f7cc5-f4c4-4de1-92e8-d6f4f96e4637 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] [instance: 76aa2198-b299-4359-b606-3b6afa2326fa] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:47.666827 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-756f7cc5-f4c4-4de1-92e8-d6f4f96e4637 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:47.667432 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-756f7cc5-f4c4-4de1-92e8-d6f4f96e4637 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:47.668421 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-756f7cc5-f4c4-4de1-92e8-d6f4f96e4637 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:47.672959 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-756f7cc5-f4c4-4de1-92e8-d6f4f96e4637 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:47.673659 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-756f7cc5-f4c4-4de1-92e8-d6f4f96e4637 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:47.676420 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-756f7cc5-f4c4-4de1-92e8-d6f4f96e4637 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:48.078350 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-da6cbfa9-e182-40a3-abc6-c7a0b6d17fb0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:48.078578 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-756f7cc5-f4c4-4de1-92e8-d6f4f96e4637 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4feb14c621b4090af8c965c9aaf0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06e7912f1fe423ea1b2a4bcdb90804a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:48.086624 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-756f7cc5-f4c4-4de1-92e8-d6f4f96e4637 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] 10.222.0.39 "GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa" status: 200 len: 1236 microversion: 2.1 time: 0.434633 Aug 07 01:20:48.087212 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1297/2336] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:47 2022] GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa => generated 1236 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:48.104202 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-da6cbfa9-e182-40a3-abc6-c7a0b6d17fb0 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab" status: 200 len: 1507 microversion: 2.1 time: 0.790214 Aug 07 01:20:48.104202 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1040/2337] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:47 2022] GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab => generated 1507 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:48.106444 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-63ac3357-382c-4747-a5a5-f124d2279272 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:48.115914 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-63ac3357-382c-4747-a5a5-f124d2279272 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:48.136223 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-63ac3357-382c-4747-a5a5-f124d2279272 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:48.137669 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-63ac3357-382c-4747-a5a5-f124d2279272 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:48.138214 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-63ac3357-382c-4747-a5a5-f124d2279272 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:48.138997 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-63ac3357-382c-4747-a5a5-f124d2279272 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:48.139476 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-63ac3357-382c-4747-a5a5-f124d2279272 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:48.142235 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-63ac3357-382c-4747-a5a5-f124d2279272 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:48.149255 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b6516bae-d402-468a-b4bd-7893c9718bc5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:48.154299 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b6516bae-d402-468a-b4bd-7893c9718bc5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d2f5a46c-8f96-4c33-9146-1aba108920ab] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:48.170432 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b6516bae-d402-468a-b4bd-7893c9718bc5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:48.172873 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b6516bae-d402-468a-b4bd-7893c9718bc5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:48.174502 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b6516bae-d402-468a-b4bd-7893c9718bc5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:48.175837 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b6516bae-d402-468a-b4bd-7893c9718bc5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:48.177399 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b6516bae-d402-468a-b4bd-7893c9718bc5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:48.179950 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b6516bae-d402-468a-b4bd-7893c9718bc5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:48.265580 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b6516bae-d402-468a-b4bd-7893c9718bc5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d2f5a46c-8f96-4c33-9146-1aba108920ab] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:20:48.450884 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b6516bae-d402-468a-b4bd-7893c9718bc5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab" status: 204 len: 0 microversion: 2.1 time: 0.311374 Aug 07 01:20:48.465654 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1298/2338] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:20:48 2022] DELETE /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:20:48.467007 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2ded6825-fa93-4367-b55f-3b882e7a669a tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:48.470729 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2ded6825-fa93-4367-b55f-3b882e7a669a tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] [instance: 1bc2c437-e710-4af4-9928-76c48834cfa2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:48.483203 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2ded6825-fa93-4367-b55f-3b882e7a669a tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:48.484267 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2ded6825-fa93-4367-b55f-3b882e7a669a tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:48.484724 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2ded6825-fa93-4367-b55f-3b882e7a669a tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:48.485464 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2ded6825-fa93-4367-b55f-3b882e7a669a tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:48.485927 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2ded6825-fa93-4367-b55f-3b882e7a669a tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:48.486361 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2ded6825-fa93-4367-b55f-3b882e7a669a tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:48.691598 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2ded6825-fa93-4367-b55f-3b882e7a669a tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5080c88d51a8455bba8b70e33cca958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6a995089fa447e8f74df7d111b1c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:48.707165 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2ded6825-fa93-4367-b55f-3b882e7a669a tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] 10.222.0.39 "GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2" status: 200 len: 1613 microversion: 2.1 time: 0.248941 Aug 07 01:20:48.721282 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-63ac3357-382c-4747-a5a5-f124d2279272 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:48.724913 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1299/2339] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:48 2022] GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2 => generated 1613 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:48.736440 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e0e72d05-886a-46c0-818a-193cd17f073e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:48.736950 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e0e72d05-886a-46c0-818a-193cd17f073e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d2f5a46c-8f96-4c33-9146-1aba108920ab] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:48.759122 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-63ac3357-382c-4747-a5a5-f124d2279272 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:48.760721 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-63ac3357-382c-4747-a5a5-f124d2279272 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:48.766932 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0e72d05-886a-46c0-818a-193cd17f073e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:48.769579 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0e72d05-886a-46c0-818a-193cd17f073e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:48.770106 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0e72d05-886a-46c0-818a-193cd17f073e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:48.770407 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-63ac3357-382c-4747-a5a5-f124d2279272 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 1813 microversion: 2.25 time: 0.669480 Aug 07 01:20:48.770873 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0e72d05-886a-46c0-818a-193cd17f073e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:48.771345 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0e72d05-886a-46c0-818a-193cd17f073e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:48.773740 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1041/2340] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:48 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 1813 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:20:48.774726 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0e72d05-886a-46c0-818a-193cd17f073e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:48.787485 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7a3af3ff-7ec2-475c-9a86-9dac4bf71c20 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:48.793610 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7a3af3ff-7ec2-475c-9a86-9dac4bf71c20 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 937ef9c3-acf0-4874-846f-fde53d884d0a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:48.829724 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a3af3ff-7ec2-475c-9a86-9dac4bf71c20 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:48.839601 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a3af3ff-7ec2-475c-9a86-9dac4bf71c20 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:48.841715 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a3af3ff-7ec2-475c-9a86-9dac4bf71c20 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:48.842824 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a3af3ff-7ec2-475c-9a86-9dac4bf71c20 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:48.845727 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a3af3ff-7ec2-475c-9a86-9dac4bf71c20 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:48.848038 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a3af3ff-7ec2-475c-9a86-9dac4bf71c20 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:48.855240 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e0e72d05-886a-46c0-818a-193cd17f073e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d2f5a46c-8f96-4c33-9146-1aba108920ab] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:20:49.044585 n-d-master-1 devstack@n-api.service[119516]: INFO nova.compute.api [None req-e0e72d05-886a-46c0-818a-193cd17f073e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d2f5a46c-8f96-4c33-9146-1aba108920ab] Instance is already in deleting state, ignoring this request Aug 07 01:20:49.047744 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e0e72d05-886a-46c0-818a-193cd17f073e tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab" status: 204 len: 0 microversion: 2.1 time: 0.319905 Aug 07 01:20:49.048756 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1300/2341] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:20:48 2022] DELETE /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:20:49.062355 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-1200feef-c2ce-4357-a255-8a604dac8198 req-c3167e3d-6c35-4a26-926a-32414c922fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "937ef9c3-acf0-4874-846f-fde53d884d0a", "name": "network-vif-deleted", "tag": "58804c58-1d5b-414f-bfba-63cb09aad77d"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:49.085851 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-1200feef-c2ce-4357-a255-8a604dac8198 req-c3167e3d-6c35-4a26-926a-32414c922fe6 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:49.086363 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-1200feef-c2ce-4357-a255-8a604dac8198 req-c3167e3d-6c35-4a26-926a-32414c922fe6 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:49.086860 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-1200feef-c2ce-4357-a255-8a604dac8198 req-c3167e3d-6c35-4a26-926a-32414c922fe6 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:49.113399 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-1200feef-c2ce-4357-a255-8a604dac8198 req-c3167e3d-6c35-4a26-926a-32414c922fe6 service nova] Creating event network-vif-deleted:58804c58-1d5b-414f-bfba-63cb09aad77d for instance 937ef9c3-acf0-4874-846f-fde53d884d0a on n-h2-master-1 Aug 07 01:20:49.129485 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-1200feef-c2ce-4357-a255-8a604dac8198 req-c3167e3d-6c35-4a26-926a-32414c922fe6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079103 Aug 07 01:20:49.132415 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1301/2342] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:49.143196 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e9a76913-cb72-4706-b9d7-039c6822b1a9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:49.143929 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e9a76913-cb72-4706-b9d7-039c6822b1a9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d2f5a46c-8f96-4c33-9146-1aba108920ab] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:49.170358 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7a3af3ff-7ec2-475c-9a86-9dac4bf71c20 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:49.181972 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9a76913-cb72-4706-b9d7-039c6822b1a9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:49.182261 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9a76913-cb72-4706-b9d7-039c6822b1a9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:49.182528 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9a76913-cb72-4706-b9d7-039c6822b1a9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:49.183244 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9a76913-cb72-4706-b9d7-039c6822b1a9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:49.183707 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9a76913-cb72-4706-b9d7-039c6822b1a9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:49.187514 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7a3af3ff-7ec2-475c-9a86-9dac4bf71c20 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a" status: 200 len: 1294 microversion: 2.1 time: 0.410129 Aug 07 01:20:49.190358 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1042/2343] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:48 2022] GET /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a => generated 1294 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:49.200474 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9a76913-cb72-4706-b9d7-039c6822b1a9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:49.207858 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-590601a5-0832-43fa-a992-71c58c3a8506 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:49.217017 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-590601a5-0832-43fa-a992-71c58c3a8506 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] [instance: 76aa2198-b299-4359-b606-3b6afa2326fa] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:49.230828 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-590601a5-0832-43fa-a992-71c58c3a8506 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:49.235330 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-590601a5-0832-43fa-a992-71c58c3a8506 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:49.237787 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-590601a5-0832-43fa-a992-71c58c3a8506 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:49.238764 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-590601a5-0832-43fa-a992-71c58c3a8506 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:49.243215 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-590601a5-0832-43fa-a992-71c58c3a8506 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:49.243685 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-590601a5-0832-43fa-a992-71c58c3a8506 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:49.731514 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-590601a5-0832-43fa-a992-71c58c3a8506 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4feb14c621b4090af8c965c9aaf0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06e7912f1fe423ea1b2a4bcdb90804a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:49.739723 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-590601a5-0832-43fa-a992-71c58c3a8506 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] 10.222.0.39 "GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa" status: 200 len: 1236 microversion: 2.1 time: 0.548058 Aug 07 01:20:49.740343 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1043/2344] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:49 2022] GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa => generated 1236 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:50.021472 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e9a76913-cb72-4706-b9d7-039c6822b1a9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:50.037852 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e9a76913-cb72-4706-b9d7-039c6822b1a9 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab" status: 200 len: 1513 microversion: 2.1 time: 0.904132 Aug 07 01:20:50.038810 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1302/2345] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:49 2022] GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab => generated 1513 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:50.064837 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c5ed899f-4ca3-414a-ae92-09ef2ada2224 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:50.066328 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c5ed899f-4ca3-414a-ae92-09ef2ada2224 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] [instance: 1bc2c437-e710-4af4-9928-76c48834cfa2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:50.079851 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4a32017a-6e66-4891-95a6-519ba6c1a26a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1720716236", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "6c5c235e-c2e8-41e7-9759-0dbd7d7d0e8a"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:50.082630 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c5ed899f-4ca3-414a-ae92-09ef2ada2224 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:50.085813 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c5ed899f-4ca3-414a-ae92-09ef2ada2224 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:50.087398 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c5ed899f-4ca3-414a-ae92-09ef2ada2224 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:50.088450 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c5ed899f-4ca3-414a-ae92-09ef2ada2224 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:50.092450 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c5ed899f-4ca3-414a-ae92-09ef2ada2224 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:50.093238 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c5ed899f-4ca3-414a-ae92-09ef2ada2224 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:50.186904 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c5ed899f-4ca3-414a-ae92-09ef2ada2224 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:50.187654 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c5ed899f-4ca3-414a-ae92-09ef2ada2224 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:50.189560 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c5ed899f-4ca3-414a-ae92-09ef2ada2224 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:50.192915 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-c5ed899f-4ca3-414a-ae92-09ef2ada2224 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lazy-loading 'fault' on Instance uuid 1bc2c437-e710-4af4-9928-76c48834cfa2 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:20:50.204759 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-4a32017a-6e66-4891-95a6-519ba6c1a26a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] validate_networks() for [('6c5c235e-c2e8-41e7-9759-0dbd7d7d0e8a', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:20:50.315587 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c5ed899f-4ca3-414a-ae92-09ef2ada2224 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5080c88d51a8455bba8b70e33cca958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc6a995089fa447e8f74df7d111b1c6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:50.339161 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c5ed899f-4ca3-414a-ae92-09ef2ada2224 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] 10.222.0.39 "GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2" status: 200 len: 1331 microversion: 2.1 time: 0.298847 Aug 07 01:20:50.345227 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1303/2346] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:50 2022] GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2 => generated 1331 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:50.366092 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5bec6563-0bce-432f-a818-66e91f29c06e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:50.367519 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5bec6563-0bce-432f-a818-66e91f29c06e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:50.386062 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5bec6563-0bce-432f-a818-66e91f29c06e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:50.388149 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5bec6563-0bce-432f-a818-66e91f29c06e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:50.399680 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5bec6563-0bce-432f-a818-66e91f29c06e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:50.400860 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5bec6563-0bce-432f-a818-66e91f29c06e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:50.405667 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5bec6563-0bce-432f-a818-66e91f29c06e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:50.406492 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5bec6563-0bce-432f-a818-66e91f29c06e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:50.964333 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5bec6563-0bce-432f-a818-66e91f29c06e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:50.986079 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5bec6563-0bce-432f-a818-66e91f29c06e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:50.992213 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5bec6563-0bce-432f-a818-66e91f29c06e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:50.996216 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5bec6563-0bce-432f-a818-66e91f29c06e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 1813 microversion: 2.25 time: 0.649567 Aug 07 01:20:50.997048 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1304/2347] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:50 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 1813 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:20:51.013230 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ff573ad9-8ac8-461a-b026-1c4c1ca9b892 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:51.018553 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ff573ad9-8ac8-461a-b026-1c4c1ca9b892 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80f8680c2a39400c8fcfc221872fa299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5897e4c216e646aaa3a4c9ec2c7a1cfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:51.026052 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ff573ad9-8ac8-461a-b026-1c4c1ca9b892 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Searching by: {'deleted': False, 'project_id': '5897e4c216e646aaa3a4c9ec2c7a1cfb'} {{(pid=119516) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:20:51.041116 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ff573ad9-8ac8-461a-b026-1c4c1ca9b892 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:51.044718 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ff573ad9-8ac8-461a-b026-1c4c1ca9b892 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:51.048293 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ff573ad9-8ac8-461a-b026-1c4c1ca9b892 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:51.049450 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ff573ad9-8ac8-461a-b026-1c4c1ca9b892 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:51.050128 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ff573ad9-8ac8-461a-b026-1c4c1ca9b892 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:51.050765 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ff573ad9-8ac8-461a-b026-1c4c1ca9b892 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:51.109910 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.multi_cell_list [None req-ff573ad9-8ac8-461a-b026-1c4c1ca9b892 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 01:20:51.131000 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:51.171986 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ff573ad9-8ac8-461a-b026-1c4c1ca9b892 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.170396 Aug 07 01:20:51.172953 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1305/2348] 10.222.0.39 () {58 vars in 1125 bytes} [Sun Aug 7 01:20:50 2022] GET /compute/v2.1/servers => generated 334 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:51.196534 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-000fde4b-b212-4109-9fb9-5a928bc6b511 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:51.197550 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-000fde4b-b212-4109-9fb9-5a928bc6b511 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 937ef9c3-acf0-4874-846f-fde53d884d0a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:51.205197 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-000fde4b-b212-4109-9fb9-5a928bc6b511 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:51.206288 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-000fde4b-b212-4109-9fb9-5a928bc6b511 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:51.208758 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-000fde4b-b212-4109-9fb9-5a928bc6b511 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:51.209952 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-000fde4b-b212-4109-9fb9-5a928bc6b511 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:51.216029 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-000fde4b-b212-4109-9fb9-5a928bc6b511 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:51.216889 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-000fde4b-b212-4109-9fb9-5a928bc6b511 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:51.249356 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-000fde4b-b212-4109-9fb9-5a928bc6b511 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] HTTP exception thrown: Instance 937ef9c3-acf0-4874-846f-fde53d884d0a could not be found. Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-000fde4b-b212-4109-9fb9-5a928bc6b511 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Request method failure captured: Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a HTTP/1.1 Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xLZuMLvQ88KTsXpEnT0I-tjdBFOm7EEtVmBSoi3hGbagLa-WCqW3nJreDc3WwTe1tbLbMC3xnpg15asRoKTlUvK3aMhcihww2F0hywjkHPX3fkbbtMYbGiIT_pGesW2tpqp2g11Pwb-WDA3oTL-VeLkmCHA0u8DPW_SmhTlX9-nF08 Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersTestJSON-576619186 Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_efad066360cb45b3a6e9ba872118ea57", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersTestJSON-576619186 Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersTestJSON-576619186 Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersTestJSON-576619186-project Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: d4f7282c7251455086368d5274a4fac5 Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersTestJSON-576619186-project Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 937ef9c3-acf0-4874-846f-fde53d884d0a could not be found. Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '937ef9c3-acf0-4874-846f-fde53d884d0a'} Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 937ef9c3-acf0-4874-846f-fde53d884d0a could not be found. Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 937ef9c3-acf0-4874-846f-fde53d884d0a could not be found. Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:51.251444 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:51.255170 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:51.255170 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:51.255170 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:20:51.255170 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:20:51.255170 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 937ef9c3-acf0-4874-846f-fde53d884d0a could not be found. Aug 07 01:20:51.255170 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:51.257415 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-000fde4b-b212-4109-9fb9-5a928bc6b511 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Returning 404 to user: Instance 937ef9c3-acf0-4874-846f-fde53d884d0a could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:20:51.265691 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-000fde4b-b212-4109-9fb9-5a928bc6b511 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a" status: 404 len: 111 microversion: 2.1 time: 0.090865 Aug 07 01:20:51.267157 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1306/2349] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:51 2022] GET /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:20:51.292389 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-27db92c5-0bff-4ea0-ad6c-d48f8be255fd tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:51.293475 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-27db92c5-0bff-4ea0-ad6c-d48f8be255fd tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] [instance: 76aa2198-b299-4359-b606-3b6afa2326fa] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:51.300494 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27db92c5-0bff-4ea0-ad6c-d48f8be255fd tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:51.301305 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27db92c5-0bff-4ea0-ad6c-d48f8be255fd tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:51.305332 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27db92c5-0bff-4ea0-ad6c-d48f8be255fd tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:51.306377 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27db92c5-0bff-4ea0-ad6c-d48f8be255fd tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:51.307056 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27db92c5-0bff-4ea0-ad6c-d48f8be255fd tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:51.307693 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27db92c5-0bff-4ea0-ad6c-d48f8be255fd tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:52.306340 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-4a32017a-6e66-4891-95a6-519ba6c1a26a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:20:52.306908 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-4a32017a-6e66-4891-95a6-519ba6c1a26a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:20:52.307219 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-4a32017a-6e66-4891-95a6-519ba6c1a26a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:20:52.307632 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-4a32017a-6e66-4891-95a6-519ba6c1a26a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:20:52.308084 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-4a32017a-6e66-4891-95a6-519ba6c1a26a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:20:52.322625 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4a32017a-6e66-4891-95a6-519ba6c1a26a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:52.323120 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4a32017a-6e66-4891-95a6-519ba6c1a26a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:52.327932 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4a32017a-6e66-4891-95a6-519ba6c1a26a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:52.329258 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4a32017a-6e66-4891-95a6-519ba6c1a26a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:52.330001 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4a32017a-6e66-4891-95a6-519ba6c1a26a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:52.330672 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4a32017a-6e66-4891-95a6-519ba6c1a26a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:52.379631 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-4a32017a-6e66-4891-95a6-519ba6c1a26a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Getting quotas for project afc8a87d755a42239e9d4572e4bf2f2d. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:20:52.391648 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-4a32017a-6e66-4891-95a6-519ba6c1a26a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Getting quotas for user 5041cbc4adc24ae8871d60064720d680 and project afc8a87d755a42239e9d4572e4bf2f2d. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:20:52.422506 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4a32017a-6e66-4891-95a6-519ba6c1a26a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:20:52.430199 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4a32017a-6e66-4891-95a6-519ba6c1a26a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: ee42a97e-a680-4b64-bbfa-df12eba6dcde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:20:52.526431 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4a32017a-6e66-4891-95a6-519ba6c1a26a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.785003 Aug 07 01:20:52.527740 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1044/2350] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:20:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:20:52.533172 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-db896b86-eac8-4fe1-9f4f-6a64358dc877 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:52.544201 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-db896b86-eac8-4fe1-9f4f-6a64358dc877 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d2f5a46c-8f96-4c33-9146-1aba108920ab] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:52.559561 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db896b86-eac8-4fe1-9f4f-6a64358dc877 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:52.560432 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db896b86-eac8-4fe1-9f4f-6a64358dc877 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:52.561083 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db896b86-eac8-4fe1-9f4f-6a64358dc877 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:52.562100 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db896b86-eac8-4fe1-9f4f-6a64358dc877 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:52.564008 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db896b86-eac8-4fe1-9f4f-6a64358dc877 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:52.564747 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db896b86-eac8-4fe1-9f4f-6a64358dc877 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:52.929772 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-27db92c5-0bff-4ea0-ad6c-d48f8be255fd tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4feb14c621b4090af8c965c9aaf0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06e7912f1fe423ea1b2a4bcdb90804a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:52.944332 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-27db92c5-0bff-4ea0-ad6c-d48f8be255fd tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] 10.222.0.39 "GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa" status: 200 len: 1303 microversion: 2.1 time: 1.675613 Aug 07 01:20:52.975067 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1307/2351] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:51 2022] GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa => generated 1303 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:52.990111 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fc7e848a-7286-4cf9-855b-56a96044ccf1 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:53.010156 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fc7e848a-7286-4cf9-855b-56a96044ccf1 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80f8680c2a39400c8fcfc221872fa299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5897e4c216e646aaa3a4c9ec2c7a1cfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:53.011478 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fc7e848a-7286-4cf9-855b-56a96044ccf1 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Searching by: {'deleted': False, 'project_id': '5897e4c216e646aaa3a4c9ec2c7a1cfb'} {{(pid=119516) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:20:53.028378 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc7e848a-7286-4cf9-855b-56a96044ccf1 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:53.029350 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc7e848a-7286-4cf9-855b-56a96044ccf1 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:53.030002 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc7e848a-7286-4cf9-855b-56a96044ccf1 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:53.033008 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc7e848a-7286-4cf9-855b-56a96044ccf1 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:53.039275 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc7e848a-7286-4cf9-855b-56a96044ccf1 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:53.041152 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc7e848a-7286-4cf9-855b-56a96044ccf1 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:53.084242 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-db896b86-eac8-4fe1-9f4f-6a64358dc877 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a359309c39a49c98f1f7aea48189efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4cbb3c65be44668687983c0a76901c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:53.102618 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-db896b86-eac8-4fe1-9f4f-6a64358dc877 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab" status: 200 len: 1471 microversion: 2.1 time: 0.573562 Aug 07 01:20:53.116267 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1045/2352] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:52 2022] GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab => generated 1471 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:53.137903 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-797b6c47-0ea3-4b11-9e5f-d525ce868c10 req-3cabe5c5-6553-4fc3-bbca-fcfa1e86e462 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bc2c437-e710-4af4-9928-76c48834cfa2", "name": "network-vif-deleted", "tag": "ab6ea765-494d-449a-a112-5e331ebc939d"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:53.166372 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-797b6c47-0ea3-4b11-9e5f-d525ce868c10 req-3cabe5c5-6553-4fc3-bbca-fcfa1e86e462 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:53.179972 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.multi_cell_list [None req-fc7e848a-7286-4cf9-855b-56a96044ccf1 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 01:20:53.180694 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-797b6c47-0ea3-4b11-9e5f-d525ce868c10 req-3cabe5c5-6553-4fc3-bbca-fcfa1e86e462 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:53.181253 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-797b6c47-0ea3-4b11-9e5f-d525ce868c10 req-3cabe5c5-6553-4fc3-bbca-fcfa1e86e462 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:53.213960 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-797b6c47-0ea3-4b11-9e5f-d525ce868c10 req-3cabe5c5-6553-4fc3-bbca-fcfa1e86e462 service nova] Creating event network-vif-deleted:ab6ea765-494d-449a-a112-5e331ebc939d for instance 1bc2c437-e710-4af4-9928-76c48834cfa2 on n-h2-master-1 Aug 07 01:20:53.231632 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-797b6c47-0ea3-4b11-9e5f-d525ce868c10 req-3cabe5c5-6553-4fc3-bbca-fcfa1e86e462 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113434 Aug 07 01:20:53.233042 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1046/2353] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:53.294248 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-77ebcbf5-e0a3-4d26-8565-d61f46b2df73 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:53.295322 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-77ebcbf5-e0a3-4d26-8565-d61f46b2df73 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] [instance: 1bc2c437-e710-4af4-9928-76c48834cfa2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:53.319574 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-77ebcbf5-e0a3-4d26-8565-d61f46b2df73 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:53.320235 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-77ebcbf5-e0a3-4d26-8565-d61f46b2df73 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:53.321458 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-77ebcbf5-e0a3-4d26-8565-d61f46b2df73 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:53.322343 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-77ebcbf5-e0a3-4d26-8565-d61f46b2df73 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:53.324503 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-77ebcbf5-e0a3-4d26-8565-d61f46b2df73 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:53.327925 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-77ebcbf5-e0a3-4d26-8565-d61f46b2df73 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:53.385319 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fc7e848a-7286-4cf9-855b-56a96044ccf1 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f8680c2a39400c8fcfc221872fa299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5897e4c216e646aaa3a4c9ec2c7a1cfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:53.385970 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-77ebcbf5-e0a3-4d26-8565-d61f46b2df73 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] HTTP exception thrown: Instance 1bc2c437-e710-4af4-9928-76c48834cfa2 could not be found. Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-77ebcbf5-e0a3-4d26-8565-d61f46b2df73 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Request method failure captured: Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2 HTTP/1.1 Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xLBUvqgTysISe_3nImj-XfiASn_IiT7FYLcFtI_0yzkP64V7YK7XyrMEayv2cqk3gIjSkywQWc6YTZckkl3iz9RW11k2SZz-rpia1-6VAg9-mYlPaQnjWnaJdvDC1BXINTqngAJHlA1gC84s3a1GjHR2aENuDH8HmGR1WYX5W9nl6E Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: bc6a995089fa447e8f74df7d111b1c6b Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-138096746 Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bc6a995089fa447e8f74df7d111b1c6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bc6a995089fa447e8f74df7d111b1c6b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bc6a995089fa447e8f74df7d111b1c6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bc6a995089fa447e8f74df7d111b1c6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-138096746 Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: bc6a995089fa447e8f74df7d111b1c6b Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-138096746 Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-AttachSCSIVolumeTestJSON-138096746-project Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 5080c88d51a8455bba8b70e33cca958b Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-138096746-project Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 1bc2c437-e710-4af4-9928-76c48834cfa2 could not be found. Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '1bc2c437-e710-4af4-9928-76c48834cfa2'} Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bc2c437-e710-4af4-9928-76c48834cfa2 could not be found. Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bc2c437-e710-4af4-9928-76c48834cfa2 could not be found. Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:53.388540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:53.393006 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:53.393006 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:53.393006 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:53.393006 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:20:53.393006 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:20:53.393006 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bc2c437-e710-4af4-9928-76c48834cfa2 could not be found. Aug 07 01:20:53.393006 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:53.395547 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-77ebcbf5-e0a3-4d26-8565-d61f46b2df73 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Returning 404 to user: Instance 1bc2c437-e710-4af4-9928-76c48834cfa2 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:20:53.401399 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-77ebcbf5-e0a3-4d26-8565-d61f46b2df73 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] 10.222.0.39 "GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2" status: 404 len: 111 microversion: 2.1 time: 0.166832 Aug 07 01:20:53.402211 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1047/2354] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:53 2022] GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2 => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:20:53.417124 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc7e848a-7286-4cf9-855b-56a96044ccf1 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:53.421120 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc7e848a-7286-4cf9-855b-56a96044ccf1 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:53.421721 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc7e848a-7286-4cf9-855b-56a96044ccf1 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:53.425591 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-626b5151-5d9d-4c67-940a-0102f745a438 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1558875586", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "339d8f21-b38d-49c3-8efe-8ffee4d616dc"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:53.573093 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-626b5151-5d9d-4c67-940a-0102f745a438 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] validate_networks() for [('339d8f21-b38d-49c3-8efe-8ffee4d616dc', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:20:53.859235 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fc7e848a-7286-4cf9-855b-56a96044ccf1 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] 10.222.0.39 "GET /compute/v2.1/servers/detail" status: 200 len: 1699 microversion: 2.1 time: 0.880400 Aug 07 01:20:53.860327 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1308/2355] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:20:52 2022] GET /compute/v2.1/servers/detail => generated 1699 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:53.884049 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b7f404a1-9863-43e3-a91a-e6f8966ea7c7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:53.886404 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b7f404a1-9863-43e3-a91a-e6f8966ea7c7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:53.911052 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7f404a1-9863-43e3-a91a-e6f8966ea7c7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:53.916181 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7f404a1-9863-43e3-a91a-e6f8966ea7c7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:53.923297 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7f404a1-9863-43e3-a91a-e6f8966ea7c7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:53.926453 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7f404a1-9863-43e3-a91a-e6f8966ea7c7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:53.927876 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7f404a1-9863-43e3-a91a-e6f8966ea7c7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:53.930768 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7f404a1-9863-43e3-a91a-e6f8966ea7c7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:54.512916 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b7f404a1-9863-43e3-a91a-e6f8966ea7c7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:54.545378 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b7f404a1-9863-43e3-a91a-e6f8966ea7c7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:54.552336 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b7f404a1-9863-43e3-a91a-e6f8966ea7c7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:54.553957 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b7f404a1-9863-43e3-a91a-e6f8966ea7c7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 1813 microversion: 2.25 time: 0.692465 Aug 07 01:20:54.554552 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1309/2356] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:53 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 1813 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:20:54.563415 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-02493ded-15fd-451a-9bc6-e382bffd0cfa tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:54.566910 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-02493ded-15fd-451a-9bc6-e382bffd0cfa tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: ee42a97e-a680-4b64-bbfa-df12eba6dcde] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:54.584473 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-02493ded-15fd-451a-9bc6-e382bffd0cfa tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:54.586417 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-02493ded-15fd-451a-9bc6-e382bffd0cfa tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:54.588471 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-02493ded-15fd-451a-9bc6-e382bffd0cfa tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:54.591336 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-02493ded-15fd-451a-9bc6-e382bffd0cfa tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:54.592024 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-02493ded-15fd-451a-9bc6-e382bffd0cfa tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:54.592657 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-02493ded-15fd-451a-9bc6-e382bffd0cfa tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:54.707695 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-02493ded-15fd-451a-9bc6-e382bffd0cfa tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5041cbc4adc24ae8871d60064720d680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc8a87d755a42239e9d4572e4bf2f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:54.722824 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-02493ded-15fd-451a-9bc6-e382bffd0cfa tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "GET /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde" status: 200 len: 1276 microversion: 2.1 time: 0.163476 Aug 07 01:20:54.723436 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1310/2357] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:54 2022] GET /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde => generated 1276 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:54.744874 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-ac3777a6-d832-4555-a3d8-efc0239ddbfa req-62a81c32-8c54-4e99-9b66-2d54d99a802a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2f5a46c-8f96-4c33-9146-1aba108920ab", "name": "network-vif-deleted", "tag": "39956047-e52a-4cec-88d8-400d42153136"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:54.774398 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-ac3777a6-d832-4555-a3d8-efc0239ddbfa req-62a81c32-8c54-4e99-9b66-2d54d99a802a service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:54.775125 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-ac3777a6-d832-4555-a3d8-efc0239ddbfa req-62a81c32-8c54-4e99-9b66-2d54d99a802a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:54.775705 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-ac3777a6-d832-4555-a3d8-efc0239ddbfa req-62a81c32-8c54-4e99-9b66-2d54d99a802a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:54.798332 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-ac3777a6-d832-4555-a3d8-efc0239ddbfa req-62a81c32-8c54-4e99-9b66-2d54d99a802a service nova] Creating event network-vif-deleted:39956047-e52a-4cec-88d8-400d42153136 for instance d2f5a46c-8f96-4c33-9146-1aba108920ab on n-h1-master-1 Aug 07 01:20:54.808682 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-ac3777a6-d832-4555-a3d8-efc0239ddbfa req-62a81c32-8c54-4e99-9b66-2d54d99a802a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067362 Aug 07 01:20:54.815386 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1311/2358] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:54.833383 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-44052191-37a6-4afd-b4ed-2004a58c9202 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Calling method '.version_select at 0x7f9e245f3160>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:54.872769 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-44052191-37a6-4afd-b4ed-2004a58c9202 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1473140144" status: 202 len: 0 microversion: 2.1 time: 0.055776 Aug 07 01:20:54.873666 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1312/2359] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Aug 7 01:20:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1473140144 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:20:54.883327 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dc42f2f4-24be-431c-8f13-c00a829fe1a4 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:54.913754 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-dc42f2f4-24be-431c-8f13-c00a829fe1a4 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032736 Aug 07 01:20:54.921411 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1313/2360] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Aug 7 01:20:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:54.929886 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6ab3826a-3956-4116-98d1-285ccd7f7dc5 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:54.930650 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6ab3826a-3956-4116-98d1-285ccd7f7dc5 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] [instance: 76aa2198-b299-4359-b606-3b6afa2326fa] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:54.960500 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ab3826a-3956-4116-98d1-285ccd7f7dc5 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:54.971200 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ab3826a-3956-4116-98d1-285ccd7f7dc5 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:54.972044 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ab3826a-3956-4116-98d1-285ccd7f7dc5 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:54.973024 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ab3826a-3956-4116-98d1-285ccd7f7dc5 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:54.985686 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ab3826a-3956-4116-98d1-285ccd7f7dc5 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:54.986447 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ab3826a-3956-4116-98d1-285ccd7f7dc5 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:55.476248 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-626b5151-5d9d-4c67-940a-0102f745a438 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:20:55.477434 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-626b5151-5d9d-4c67-940a-0102f745a438 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:20:55.478107 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-626b5151-5d9d-4c67-940a-0102f745a438 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:20:55.478519 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-626b5151-5d9d-4c67-940a-0102f745a438 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:20:55.479111 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-626b5151-5d9d-4c67-940a-0102f745a438 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:20:55.497904 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-626b5151-5d9d-4c67-940a-0102f745a438 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:55.500473 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-626b5151-5d9d-4c67-940a-0102f745a438 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:55.501286 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-626b5151-5d9d-4c67-940a-0102f745a438 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:55.503848 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-626b5151-5d9d-4c67-940a-0102f745a438 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:55.504487 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-626b5151-5d9d-4c67-940a-0102f745a438 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:55.508738 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-626b5151-5d9d-4c67-940a-0102f745a438 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:55.555387 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-626b5151-5d9d-4c67-940a-0102f745a438 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Getting quotas for project efad066360cb45b3a6e9ba872118ea57. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:20:55.567920 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-626b5151-5d9d-4c67-940a-0102f745a438 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Getting quotas for user d4f7282c7251455086368d5274a4fac5 and project efad066360cb45b3a6e9ba872118ea57. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:20:55.589018 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6ab3826a-3956-4116-98d1-285ccd7f7dc5 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4feb14c621b4090af8c965c9aaf0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06e7912f1fe423ea1b2a4bcdb90804a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:55.607850 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6ab3826a-3956-4116-98d1-285ccd7f7dc5 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] 10.222.0.39 "GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa" status: 200 len: 1303 microversion: 2.1 time: 0.689724 Aug 07 01:20:55.611288 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1314/2361] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:54 2022] GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa => generated 1303 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:55.627643 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-626b5151-5d9d-4c67-940a-0102f745a438 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:20:55.629717 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-eb101d24-2f8f-49bc-8148-0c8f315f72b5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:55.635261 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-eb101d24-2f8f-49bc-8148-0c8f315f72b5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d2f5a46c-8f96-4c33-9146-1aba108920ab] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:55.638629 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-626b5151-5d9d-4c67-940a-0102f745a438 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: c320acee-ca30-4e57-a35f-0f102d7cd7a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:20:55.652892 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb101d24-2f8f-49bc-8148-0c8f315f72b5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:55.653426 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb101d24-2f8f-49bc-8148-0c8f315f72b5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:55.653846 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb101d24-2f8f-49bc-8148-0c8f315f72b5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:55.660371 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb101d24-2f8f-49bc-8148-0c8f315f72b5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:55.666309 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb101d24-2f8f-49bc-8148-0c8f315f72b5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:55.666805 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb101d24-2f8f-49bc-8148-0c8f315f72b5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:55.721278 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-eb101d24-2f8f-49bc-8148-0c8f315f72b5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] HTTP exception thrown: Instance d2f5a46c-8f96-4c33-9146-1aba108920ab could not be found. Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-eb101d24-2f8f-49bc-8148-0c8f315f72b5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Request method failure captured: Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab HTTP/1.1 Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xK0i97sEsNttmuA9_hK4Bj-ALZmrvlU_PPnojUcwyxSZxwVFE2TsCDb7VOSD_6ARMM2pkn8uj_XdWeDX09GDc7jpTvqYSDh_hr_hZ9T5TdE5z_HRc_MFMcWF7DPQfEzRKvpaK9fPsAYUzZtUWEP_woHCPtojoY7hbsCpJfEuox73G0 Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 4b4cbb3c65be44668687983c0a76901c Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2092997942 Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4b4cbb3c65be44668687983c0a76901c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4b4cbb3c65be44668687983c0a76901c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4b4cbb3c65be44668687983c0a76901c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4b4cbb3c65be44668687983c0a76901c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServerDiskConfigTestJSON-2092997942 Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 4b4cbb3c65be44668687983c0a76901c Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2092997942 Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServerDiskConfigTestJSON-2092997942-project Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 4a359309c39a49c98f1f7aea48189efa Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServerDiskConfigTestJSON-2092997942-project Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: exception: Instance d2f5a46c-8f96-4c33-9146-1aba108920ab could not be found. Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'd2f5a46c-8f96-4c33-9146-1aba108920ab'} Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2f5a46c-8f96-4c33-9146-1aba108920ab could not be found. Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2f5a46c-8f96-4c33-9146-1aba108920ab could not be found. Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:55.728397 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:55.732596 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:55.732596 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:55.732596 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:55.732596 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:20:55.732596 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:20:55.732596 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2f5a46c-8f96-4c33-9146-1aba108920ab could not be found. Aug 07 01:20:55.732596 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:55.736746 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-eb101d24-2f8f-49bc-8148-0c8f315f72b5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Returning 404 to user: Instance d2f5a46c-8f96-4c33-9146-1aba108920ab could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:20:55.738402 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-eb101d24-2f8f-49bc-8148-0c8f315f72b5 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab" status: 404 len: 111 microversion: 2.1 time: 0.123142 Aug 07 01:20:55.741870 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1315/2362] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:55 2022] GET /compute/v2.1/servers/d2f5a46c-8f96-4c33-9146-1aba108920ab => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:20:55.751321 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-66010813-62ec-4e06-8a9e-8a8b4031a086 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:55.756924 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-66010813-62ec-4e06-8a9e-8a8b4031a086 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] [instance: 2de58a4c-7601-40e2-a4dc-073e102b659f] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:55.773282 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-66010813-62ec-4e06-8a9e-8a8b4031a086 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:55.776779 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-66010813-62ec-4e06-8a9e-8a8b4031a086 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:55.777491 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-66010813-62ec-4e06-8a9e-8a8b4031a086 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:55.781032 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-66010813-62ec-4e06-8a9e-8a8b4031a086 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:55.783028 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-66010813-62ec-4e06-8a9e-8a8b4031a086 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:55.783588 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-66010813-62ec-4e06-8a9e-8a8b4031a086 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:55.793177 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-626b5151-5d9d-4c67-940a-0102f745a438 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.380316 Aug 07 01:20:55.795608 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1048/2363] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:20:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:20:55.813785 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e407fb21-5d2e-4836-8791-8da5f9598ddd tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:55.816323 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e407fb21-5d2e-4836-8791-8da5f9598ddd tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:55.842056 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e407fb21-5d2e-4836-8791-8da5f9598ddd tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:55.842630 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e407fb21-5d2e-4836-8791-8da5f9598ddd tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:55.843610 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e407fb21-5d2e-4836-8791-8da5f9598ddd tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:55.844380 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e407fb21-5d2e-4836-8791-8da5f9598ddd tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:55.849014 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e407fb21-5d2e-4836-8791-8da5f9598ddd tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:55.849886 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e407fb21-5d2e-4836-8791-8da5f9598ddd tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:55.877561 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-66010813-62ec-4e06-8a9e-8a8b4031a086 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] [instance: 2de58a4c-7601-40e2-a4dc-073e102b659f] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:20:56.145351 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-66010813-62ec-4e06-8a9e-8a8b4031a086 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f" status: 204 len: 0 microversion: 2.1 time: 0.401662 Aug 07 01:20:56.147303 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1316/2364] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:20:55 2022] DELETE /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:20:56.161118 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e7958730-df56-4bbd-981e-a2b1a21c402c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:56.162964 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e7958730-df56-4bbd-981e-a2b1a21c402c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: ee42a97e-a680-4b64-bbfa-df12eba6dcde] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:56.174547 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7958730-df56-4bbd-981e-a2b1a21c402c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:56.188564 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7958730-df56-4bbd-981e-a2b1a21c402c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:56.189087 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7958730-df56-4bbd-981e-a2b1a21c402c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:56.194027 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7958730-df56-4bbd-981e-a2b1a21c402c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:56.194027 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7958730-df56-4bbd-981e-a2b1a21c402c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:56.194027 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7958730-df56-4bbd-981e-a2b1a21c402c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:56.293856 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e407fb21-5d2e-4836-8791-8da5f9598ddd tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:56.305162 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e407fb21-5d2e-4836-8791-8da5f9598ddd tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:56.307027 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e407fb21-5d2e-4836-8791-8da5f9598ddd tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:56.309029 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e407fb21-5d2e-4836-8791-8da5f9598ddd tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 1813 microversion: 2.25 time: 0.509759 Aug 07 01:20:56.309931 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1049/2365] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:55 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 1813 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:20:56.317668 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d08705e7-6f10-4f36-bdb4-f12d370f88ac tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:56.318468 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d08705e7-6f10-4f36-bdb4-f12d370f88ac tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:56.335838 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d08705e7-6f10-4f36-bdb4-f12d370f88ac tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:56.336623 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d08705e7-6f10-4f36-bdb4-f12d370f88ac tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:56.337245 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d08705e7-6f10-4f36-bdb4-f12d370f88ac tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:56.338328 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d08705e7-6f10-4f36-bdb4-f12d370f88ac tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:56.339206 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d08705e7-6f10-4f36-bdb4-f12d370f88ac tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:56.340675 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d08705e7-6f10-4f36-bdb4-f12d370f88ac tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:56.386192 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-d08705e7-6f10-4f36-bdb4-f12d370f88ac tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] HTTP exception thrown: Instance ed97583d-ce2f-4693-b2fe-aaebcf2dd66d could not be found. Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d08705e7-6f10-4f36-bdb4-f12d370f88ac tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Request method failure captured: Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d HTTP/1.1 Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xK0i97sEsNttmuA9_hK4Bj-ALZmrvlU_PPnojUcwyxSZxwVFE2TsCDb7VOSD_6ARMM2pkn8uj_XdWeDX09GDc7jpTvqYSDh_hr_hZ9T5TdE5z_HRc_MFMcWF7DPQfEzRKvpaK9fPsAYUzZtUWEP_woHCPtojoY7hbsCpJfEuox73G0 Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 4b4cbb3c65be44668687983c0a76901c Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2092997942 Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4b4cbb3c65be44668687983c0a76901c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4b4cbb3c65be44668687983c0a76901c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4b4cbb3c65be44668687983c0a76901c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4b4cbb3c65be44668687983c0a76901c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServerDiskConfigTestJSON-2092997942 Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 4b4cbb3c65be44668687983c0a76901c Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2092997942 Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServerDiskConfigTestJSON-2092997942-project Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 4a359309c39a49c98f1f7aea48189efa Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServerDiskConfigTestJSON-2092997942-project Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: exception: Instance ed97583d-ce2f-4693-b2fe-aaebcf2dd66d could not be found. Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'ed97583d-ce2f-4693-b2fe-aaebcf2dd66d'} Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed97583d-ce2f-4693-b2fe-aaebcf2dd66d could not be found. Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:20:56.392215 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:20:56.396613 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed97583d-ce2f-4693-b2fe-aaebcf2dd66d could not be found. Aug 07 01:20:56.396613 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:56.396613 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:56.396613 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:56.396613 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:56.396613 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:56.396613 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:56.396613 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:20:56.396613 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:20:56.396613 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed97583d-ce2f-4693-b2fe-aaebcf2dd66d could not be found. Aug 07 01:20:56.396613 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:56.398908 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d08705e7-6f10-4f36-bdb4-f12d370f88ac tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Returning 404 to user: Instance ed97583d-ce2f-4693-b2fe-aaebcf2dd66d could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:20:56.400174 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d08705e7-6f10-4f36-bdb4-f12d370f88ac tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 404 len: 111 microversion: 2.1 time: 0.088820 Aug 07 01:20:56.400900 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1050/2366] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:20:56 2022] DELETE /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:20:56.422248 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5270b16f-203a-4d30-a35d-cff37d1d2a6c tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:56.428697 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5270b16f-203a-4d30-a35d-cff37d1d2a6c tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: c320acee-ca30-4e57-a35f-0f102d7cd7a5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:56.504678 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e7958730-df56-4bbd-981e-a2b1a21c402c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5041cbc4adc24ae8871d60064720d680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc8a87d755a42239e9d4572e4bf2f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:56.543124 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5270b16f-203a-4d30-a35d-cff37d1d2a6c tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:56.546345 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e7958730-df56-4bbd-981e-a2b1a21c402c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "GET /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde" status: 200 len: 1282 microversion: 2.1 time: 0.395751 Aug 07 01:20:56.547406 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1317/2367] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:56 2022] GET /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde => generated 1282 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:56.563095 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5270b16f-203a-4d30-a35d-cff37d1d2a6c tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5" status: 200 len: 1209 microversion: 2.1 time: 0.158870 Aug 07 01:20:56.563734 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1051/2368] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:56 2022] GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5 => generated 1209 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:56.583119 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b40d1056-4eb8-4741-ab71-780cac0c797c tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:56.583405 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b40d1056-4eb8-4741-ab71-780cac0c797c tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] [instance: 2de58a4c-7601-40e2-a4dc-073e102b659f] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:56.595460 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b40d1056-4eb8-4741-ab71-780cac0c797c tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:56.596004 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b40d1056-4eb8-4741-ab71-780cac0c797c tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:56.596625 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b40d1056-4eb8-4741-ab71-780cac0c797c tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:56.597518 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b40d1056-4eb8-4741-ab71-780cac0c797c tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:56.598122 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b40d1056-4eb8-4741-ab71-780cac0c797c tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:56.598696 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b40d1056-4eb8-4741-ab71-780cac0c797c tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:56.712145 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-727535d1-4dcd-41de-82f0-0a0573db639f tempest-FloatingIPsTestJSON-1845688227 tempest-FloatingIPsTestJSON-1845688227-project] Action: 'create', calling method: .version_select at 0x7f9e17eaf3a0>, body: {"pool": null} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:56.999220 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b40d1056-4eb8-4741-ab71-780cac0c797c tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f8680c2a39400c8fcfc221872fa299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5897e4c216e646aaa3a4c9ec2c7a1cfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:57.009117 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b40d1056-4eb8-4741-ab71-780cac0c797c tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] 10.222.0.39 "GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f" status: 200 len: 1702 microversion: 2.1 time: 0.444792 Aug 07 01:20:57.010438 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1318/2369] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:56 2022] GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f => generated 1702 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:57.045616 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1a91cd4a-e0e6-4be6-b1b6-6378d0b8412b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:57.047146 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1a91cd4a-e0e6-4be6-b1b6-6378d0b8412b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: ed97583d-ce2f-4693-b2fe-aaebcf2dd66d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:57.056493 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1a91cd4a-e0e6-4be6-b1b6-6378d0b8412b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:57.057603 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1a91cd4a-e0e6-4be6-b1b6-6378d0b8412b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:57.058488 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1a91cd4a-e0e6-4be6-b1b6-6378d0b8412b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:57.059430 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1a91cd4a-e0e6-4be6-b1b6-6378d0b8412b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:57.060394 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1a91cd4a-e0e6-4be6-b1b6-6378d0b8412b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:57.061325 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1a91cd4a-e0e6-4be6-b1b6-6378d0b8412b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:57.087333 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-1a91cd4a-e0e6-4be6-b1b6-6378d0b8412b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] HTTP exception thrown: Instance ed97583d-ce2f-4693-b2fe-aaebcf2dd66d could not be found. Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1a91cd4a-e0e6-4be6-b1b6-6378d0b8412b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Request method failure captured: Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d HTTP/1.1 Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xK0i97sEsNttmuA9_hK4Bj-ALZmrvlU_PPnojUcwyxSZxwVFE2TsCDb7VOSD_6ARMM2pkn8uj_XdWeDX09GDc7jpTvqYSDh_hr_hZ9T5TdE5z_HRc_MFMcWF7DPQfEzRKvpaK9fPsAYUzZtUWEP_woHCPtojoY7hbsCpJfEuox73G0 Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 4b4cbb3c65be44668687983c0a76901c Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2092997942 Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4b4cbb3c65be44668687983c0a76901c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4b4cbb3c65be44668687983c0a76901c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4b4cbb3c65be44668687983c0a76901c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4b4cbb3c65be44668687983c0a76901c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServerDiskConfigTestJSON-2092997942 Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 4b4cbb3c65be44668687983c0a76901c Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2092997942 Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServerDiskConfigTestJSON-2092997942-project Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 4a359309c39a49c98f1f7aea48189efa Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServerDiskConfigTestJSON-2092997942-project Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: exception: Instance ed97583d-ce2f-4693-b2fe-aaebcf2dd66d could not be found. Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'ed97583d-ce2f-4693-b2fe-aaebcf2dd66d'} Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed97583d-ce2f-4693-b2fe-aaebcf2dd66d could not be found. Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed97583d-ce2f-4693-b2fe-aaebcf2dd66d could not be found. Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:57.089353 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:57.093650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:57.093650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:57.093650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:57.093650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:20:57.093650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:20:57.093650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed97583d-ce2f-4693-b2fe-aaebcf2dd66d could not be found. Aug 07 01:20:57.093650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:57.096521 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1a91cd4a-e0e6-4be6-b1b6-6378d0b8412b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Returning 404 to user: Instance ed97583d-ce2f-4693-b2fe-aaebcf2dd66d could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:20:57.097829 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1a91cd4a-e0e6-4be6-b1b6-6378d0b8412b tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d" status: 404 len: 111 microversion: 2.1 time: 0.071785 Aug 07 01:20:57.098939 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1319/2370] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:57 2022] GET /compute/v2.1/servers/ed97583d-ce2f-4693-b2fe-aaebcf2dd66d => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:20:57.107405 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6ec2ab08-ae80-4f5e-a621-1f874efbbd18 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:57.109106 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6ec2ab08-ae80-4f5e-a621-1f874efbbd18 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] [instance: 76aa2198-b299-4359-b606-3b6afa2326fa] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:57.122710 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ec2ab08-ae80-4f5e-a621-1f874efbbd18 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:57.123210 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ec2ab08-ae80-4f5e-a621-1f874efbbd18 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:57.123681 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ec2ab08-ae80-4f5e-a621-1f874efbbd18 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:57.124512 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ec2ab08-ae80-4f5e-a621-1f874efbbd18 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:57.124975 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ec2ab08-ae80-4f5e-a621-1f874efbbd18 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:57.125413 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ec2ab08-ae80-4f5e-a621-1f874efbbd18 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:57.766794 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6ec2ab08-ae80-4f5e-a621-1f874efbbd18 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4feb14c621b4090af8c965c9aaf0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06e7912f1fe423ea1b2a4bcdb90804a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:57.784052 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6ec2ab08-ae80-4f5e-a621-1f874efbbd18 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] 10.222.0.39 "GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa" status: 200 len: 1303 microversion: 2.1 time: 0.682113 Aug 07 01:20:57.786891 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1320/2371] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:57 2022] GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa => generated 1303 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:57.803512 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-f17a73c7-8512-431e-807d-a77aaf58babf req-efd5cd13-7a6b-4348-9198-29e732ec9670 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76aa2198-b299-4359-b606-3b6afa2326fa", "tag": "3ab32283-65ff-4a43-8b7d-5c9620395daa"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:20:57.834338 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f17a73c7-8512-431e-807d-a77aaf58babf req-efd5cd13-7a6b-4348-9198-29e732ec9670 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:57.836155 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f17a73c7-8512-431e-807d-a77aaf58babf req-efd5cd13-7a6b-4348-9198-29e732ec9670 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:57.839341 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f17a73c7-8512-431e-807d-a77aaf58babf req-efd5cd13-7a6b-4348-9198-29e732ec9670 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:57.865344 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-f17a73c7-8512-431e-807d-a77aaf58babf req-efd5cd13-7a6b-4348-9198-29e732ec9670 service nova] Creating event network-changed:3ab32283-65ff-4a43-8b7d-5c9620395daa for instance 76aa2198-b299-4359-b606-3b6afa2326fa on n-h2-master-1 Aug 07 01:20:57.875164 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-f17a73c7-8512-431e-807d-a77aaf58babf req-efd5cd13-7a6b-4348-9198-29e732ec9670 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085546 Aug 07 01:20:57.876088 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1321/2372] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:57.881750 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-70fef29f-efcd-4e37-b7db-6c9cc34a7663 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:57.887853 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-70fef29f-efcd-4e37-b7db-6c9cc34a7663 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d44d731f-5443-4a7c-9a8d-8e330fd1639d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:57.907496 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-70fef29f-efcd-4e37-b7db-6c9cc34a7663 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:57.908117 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-70fef29f-efcd-4e37-b7db-6c9cc34a7663 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:57.908563 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-70fef29f-efcd-4e37-b7db-6c9cc34a7663 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:57.909711 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-70fef29f-efcd-4e37-b7db-6c9cc34a7663 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:57.909892 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-70fef29f-efcd-4e37-b7db-6c9cc34a7663 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:57.910305 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-70fef29f-efcd-4e37-b7db-6c9cc34a7663 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:57.936235 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-70fef29f-efcd-4e37-b7db-6c9cc34a7663 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] HTTP exception thrown: Instance d44d731f-5443-4a7c-9a8d-8e330fd1639d could not be found. Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-70fef29f-efcd-4e37-b7db-6c9cc34a7663 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Request method failure captured: Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d HTTP/1.1 Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xK0i97sEsNttmuA9_hK4Bj-ALZmrvlU_PPnojUcwyxSZxwVFE2TsCDb7VOSD_6ARMM2pkn8uj_XdWeDX09GDc7jpTvqYSDh_hr_hZ9T5TdE5z_HRc_MFMcWF7DPQfEzRKvpaK9fPsAYUzZtUWEP_woHCPtojoY7hbsCpJfEuox73G0 Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 4b4cbb3c65be44668687983c0a76901c Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2092997942 Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4b4cbb3c65be44668687983c0a76901c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4b4cbb3c65be44668687983c0a76901c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4b4cbb3c65be44668687983c0a76901c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4b4cbb3c65be44668687983c0a76901c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServerDiskConfigTestJSON-2092997942 Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 4b4cbb3c65be44668687983c0a76901c Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2092997942 Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServerDiskConfigTestJSON-2092997942-project Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 4a359309c39a49c98f1f7aea48189efa Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServerDiskConfigTestJSON-2092997942-project Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: exception: Instance d44d731f-5443-4a7c-9a8d-8e330fd1639d could not be found. Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'd44d731f-5443-4a7c-9a8d-8e330fd1639d'} Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d44d731f-5443-4a7c-9a8d-8e330fd1639d could not be found. Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:20:57.951639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:20:57.955667 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d44d731f-5443-4a7c-9a8d-8e330fd1639d could not be found. Aug 07 01:20:57.955667 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:57.955667 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:57.955667 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:57.955667 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:57.955667 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:57.955667 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:57.955667 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:20:57.955667 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:20:57.955667 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d44d731f-5443-4a7c-9a8d-8e330fd1639d could not be found. Aug 07 01:20:57.955667 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:20:57.955667 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-70fef29f-efcd-4e37-b7db-6c9cc34a7663 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Returning 404 to user: Instance d44d731f-5443-4a7c-9a8d-8e330fd1639d could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:20:57.955667 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-70fef29f-efcd-4e37-b7db-6c9cc34a7663 tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d" status: 404 len: 111 microversion: 2.1 time: 0.076248 Aug 07 01:20:57.957423 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1322/2373] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:20:57 2022] DELETE /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:20:57.970430 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e421bd62-2ee2-4b89-93de-66ffcb8d0712 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:57.971874 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e421bd62-2ee2-4b89-93de-66ffcb8d0712 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:57.994292 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e421bd62-2ee2-4b89-93de-66ffcb8d0712 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:57.994788 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e421bd62-2ee2-4b89-93de-66ffcb8d0712 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:57.995222 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e421bd62-2ee2-4b89-93de-66ffcb8d0712 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:57.995962 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e421bd62-2ee2-4b89-93de-66ffcb8d0712 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:57.996417 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e421bd62-2ee2-4b89-93de-66ffcb8d0712 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:57.997022 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e421bd62-2ee2-4b89-93de-66ffcb8d0712 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:58.716925 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e421bd62-2ee2-4b89-93de-66ffcb8d0712 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:58.734266 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e421bd62-2ee2-4b89-93de-66ffcb8d0712 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:58.735812 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e421bd62-2ee2-4b89-93de-66ffcb8d0712 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:58.748030 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e421bd62-2ee2-4b89-93de-66ffcb8d0712 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 1813 microversion: 2.25 time: 0.778630 Aug 07 01:20:58.749541 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1323/2374] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:20:57 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 1813 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:20:58.757124 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e596f376-81a9-40cf-b6ae-c493df14686a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:58.757740 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e596f376-81a9-40cf-b6ae-c493df14686a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: ee42a97e-a680-4b64-bbfa-df12eba6dcde] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:58.759843 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:58.784568 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e596f376-81a9-40cf-b6ae-c493df14686a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:58.785254 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e596f376-81a9-40cf-b6ae-c493df14686a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:58.785484 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e596f376-81a9-40cf-b6ae-c493df14686a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:58.786396 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e596f376-81a9-40cf-b6ae-c493df14686a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:58.787013 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e596f376-81a9-40cf-b6ae-c493df14686a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:58.787597 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e596f376-81a9-40cf-b6ae-c493df14686a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:59.224918 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e596f376-81a9-40cf-b6ae-c493df14686a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5041cbc4adc24ae8871d60064720d680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc8a87d755a42239e9d4572e4bf2f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:20:59.235827 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e596f376-81a9-40cf-b6ae-c493df14686a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "GET /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde" status: 200 len: 1324 microversion: 2.1 time: 0.485097 Aug 07 01:20:59.236455 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1324/2375] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:58 2022] GET /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde => generated 1324 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:20:59.259716 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6c736f30-bc1c-472b-908e-928b52fa97da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:59.260621 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6c736f30-bc1c-472b-908e-928b52fa97da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: c320acee-ca30-4e57-a35f-0f102d7cd7a5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:59.277125 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c736f30-bc1c-472b-908e-928b52fa97da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:59.277928 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c736f30-bc1c-472b-908e-928b52fa97da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:59.281097 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c736f30-bc1c-472b-908e-928b52fa97da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:59.282178 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c736f30-bc1c-472b-908e-928b52fa97da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:59.282825 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c736f30-bc1c-472b-908e-928b52fa97da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:59.283334 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c736f30-bc1c-472b-908e-928b52fa97da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:59.694000 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-727535d1-4dcd-41de-82f0-0a0573db639f tempest-FloatingIPsTestJSON-1845688227 tempest-FloatingIPsTestJSON-1845688227-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.129017 Aug 07 01:20:59.695548 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1052/2376] 10.222.0.39 () {60 vars in 1170 bytes} [Sun Aug 7 01:20:56 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:20:59.701249 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-40162a09-d746-4f11-801a-45b0cc8da8ab tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:59.701994 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-40162a09-d746-4f11-801a-45b0cc8da8ab tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] [instance: d44d731f-5443-4a7c-9a8d-8e330fd1639d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:59.715285 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-40162a09-d746-4f11-801a-45b0cc8da8ab tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:59.715706 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-40162a09-d746-4f11-801a-45b0cc8da8ab tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:59.716185 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-40162a09-d746-4f11-801a-45b0cc8da8ab tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:59.725564 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-40162a09-d746-4f11-801a-45b0cc8da8ab tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:59.727279 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-40162a09-d746-4f11-801a-45b0cc8da8ab tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:59.727920 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-40162a09-d746-4f11-801a-45b0cc8da8ab tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:59.746333 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-40162a09-d746-4f11-801a-45b0cc8da8ab tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] HTTP exception thrown: Instance d44d731f-5443-4a7c-9a8d-8e330fd1639d could not be found. Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-40162a09-d746-4f11-801a-45b0cc8da8ab tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Request method failure captured: Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d HTTP/1.1 Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xK0i97sEsNttmuA9_hK4Bj-ALZmrvlU_PPnojUcwyxSZxwVFE2TsCDb7VOSD_6ARMM2pkn8uj_XdWeDX09GDc7jpTvqYSDh_hr_hZ9T5TdE5z_HRc_MFMcWF7DPQfEzRKvpaK9fPsAYUzZtUWEP_woHCPtojoY7hbsCpJfEuox73G0 Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 4b4cbb3c65be44668687983c0a76901c Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2092997942 Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4b4cbb3c65be44668687983c0a76901c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4b4cbb3c65be44668687983c0a76901c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4b4cbb3c65be44668687983c0a76901c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4b4cbb3c65be44668687983c0a76901c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServerDiskConfigTestJSON-2092997942 Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 4b4cbb3c65be44668687983c0a76901c Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2092997942 Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServerDiskConfigTestJSON-2092997942-project Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 4a359309c39a49c98f1f7aea48189efa Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServerDiskConfigTestJSON-2092997942-project Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: exception: Instance d44d731f-5443-4a7c-9a8d-8e330fd1639d could not be found. Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'd44d731f-5443-4a7c-9a8d-8e330fd1639d'} Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d44d731f-5443-4a7c-9a8d-8e330fd1639d could not be found. Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d44d731f-5443-4a7c-9a8d-8e330fd1639d could not be found. Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:20:59.756009 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:59.759716 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:20:59.759716 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:20:59.759716 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:20:59.759716 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:20:59.759716 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:20:59.759716 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d44d731f-5443-4a7c-9a8d-8e330fd1639d could not be found. Aug 07 01:20:59.759716 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:20:59.759716 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-40162a09-d746-4f11-801a-45b0cc8da8ab tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] Returning 404 to user: Instance d44d731f-5443-4a7c-9a8d-8e330fd1639d could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:20:59.759716 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-40162a09-d746-4f11-801a-45b0cc8da8ab tempest-ServerDiskConfigTestJSON-2092997942 tempest-ServerDiskConfigTestJSON-2092997942-project] 10.222.0.39 "GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d" status: 404 len: 111 microversion: 2.1 time: 0.060937 Aug 07 01:20:59.760388 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1053/2377] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:59 2022] GET /compute/v2.1/servers/d44d731f-5443-4a7c-9a8d-8e330fd1639d => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:20:59.767555 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0fad0c19-9b5c-4b5e-a0f0-b0cdb3b6b81d tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:20:59.776004 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0fad0c19-9b5c-4b5e-a0f0-b0cdb3b6b81d tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] [instance: 2de58a4c-7601-40e2-a4dc-073e102b659f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:20:59.784274 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0fad0c19-9b5c-4b5e-a0f0-b0cdb3b6b81d tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:59.785132 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0fad0c19-9b5c-4b5e-a0f0-b0cdb3b6b81d tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:59.785720 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0fad0c19-9b5c-4b5e-a0f0-b0cdb3b6b81d tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:20:59.786589 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0fad0c19-9b5c-4b5e-a0f0-b0cdb3b6b81d tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:20:59.787198 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0fad0c19-9b5c-4b5e-a0f0-b0cdb3b6b81d tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:20:59.787778 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0fad0c19-9b5c-4b5e-a0f0-b0cdb3b6b81d tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:00.362357 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0fad0c19-9b5c-4b5e-a0f0-b0cdb3b6b81d tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f8680c2a39400c8fcfc221872fa299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5897e4c216e646aaa3a4c9ec2c7a1cfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:00.374797 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0fad0c19-9b5c-4b5e-a0f0-b0cdb3b6b81d tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] 10.222.0.39 "GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f" status: 200 len: 1702 microversion: 2.1 time: 0.612449 Aug 07 01:21:00.380896 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1054/2378] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:59 2022] GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f => generated 1702 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:00.394682 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8c9408f0-87a6-4e86-a050-9a71707b8b19 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:00.396335 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8c9408f0-87a6-4e86-a050-9a71707b8b19 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] [instance: 76aa2198-b299-4359-b606-3b6afa2326fa] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:00.415249 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8c9408f0-87a6-4e86-a050-9a71707b8b19 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:00.415763 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8c9408f0-87a6-4e86-a050-9a71707b8b19 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:00.416238 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8c9408f0-87a6-4e86-a050-9a71707b8b19 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:00.416973 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8c9408f0-87a6-4e86-a050-9a71707b8b19 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:00.417558 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8c9408f0-87a6-4e86-a050-9a71707b8b19 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:00.417861 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8c9408f0-87a6-4e86-a050-9a71707b8b19 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:00.562408 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6c736f30-bc1c-472b-908e-928b52fa97da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:00.566346 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:00.585533 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6c736f30-bc1c-472b-908e-928b52fa97da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5" status: 200 len: 1267 microversion: 2.1 time: 1.338818 Aug 07 01:21:00.586528 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1325/2379] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:20:59 2022] GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5 => generated 1267 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:00.592205 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d128af94-e3e8-46db-8b43-6afa04ada6e6 tempest-FloatingIPsTestJSON-1845688227 tempest-FloatingIPsTestJSON-1845688227-project] Calling method '.version_select at 0x7f9e24024790>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:00.952365 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8c9408f0-87a6-4e86-a050-9a71707b8b19 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4feb14c621b4090af8c965c9aaf0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06e7912f1fe423ea1b2a4bcdb90804a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:00.980946 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8c9408f0-87a6-4e86-a050-9a71707b8b19 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] 10.222.0.39 "GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa" status: 200 len: 1303 microversion: 2.1 time: 0.598294 Aug 07 01:21:00.981600 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1055/2380] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:00 2022] GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa => generated 1303 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:00.987366 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-93faf2b2-a134-49e6-95f2-283746d34ad4 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:00.988190 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-93faf2b2-a134-49e6-95f2-283746d34ad4 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:01.002075 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93faf2b2-a134-49e6-95f2-283746d34ad4 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:01.003252 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93faf2b2-a134-49e6-95f2-283746d34ad4 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:01.004112 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93faf2b2-a134-49e6-95f2-283746d34ad4 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:01.009557 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93faf2b2-a134-49e6-95f2-283746d34ad4 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:01.010080 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93faf2b2-a134-49e6-95f2-283746d34ad4 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:01.010527 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93faf2b2-a134-49e6-95f2-283746d34ad4 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:01.549836 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-93faf2b2-a134-49e6-95f2-283746d34ad4 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:01.564827 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-93faf2b2-a134-49e6-95f2-283746d34ad4 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:01.568348 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-93faf2b2-a134-49e6-95f2-283746d34ad4 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:01.570909 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-93faf2b2-a134-49e6-95f2-283746d34ad4 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 1813 microversion: 2.25 time: 0.588045 Aug 07 01:21:01.583925 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1056/2381] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:00 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 1813 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:01.595599 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e246678c-92fa-4ef6-8192-4d6955749b5c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:01.596258 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e246678c-92fa-4ef6-8192-4d6955749b5c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: ee42a97e-a680-4b64-bbfa-df12eba6dcde] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:01.603530 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e246678c-92fa-4ef6-8192-4d6955749b5c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:01.610068 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e246678c-92fa-4ef6-8192-4d6955749b5c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:01.610625 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e246678c-92fa-4ef6-8192-4d6955749b5c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:01.612180 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e246678c-92fa-4ef6-8192-4d6955749b5c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:01.612848 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e246678c-92fa-4ef6-8192-4d6955749b5c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:01.613479 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e246678c-92fa-4ef6-8192-4d6955749b5c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:01.630606 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d128af94-e3e8-46db-8b43-6afa04ada6e6 tempest-FloatingIPsTestJSON-1845688227 tempest-FloatingIPsTestJSON-1845688227-project] 10.222.0.39 "GET /compute/v2.1/os-floating-ips/aa399a48-7b8b-449c-8471-a58754b28b5f" status: 200 len: 141 microversion: 2.1 time: 1.042202 Aug 07 01:21:01.645806 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1326/2382] 10.222.0.39 () {58 vars in 1260 bytes} [Sun Aug 7 01:21:00 2022] GET /compute/v2.1/os-floating-ips/aa399a48-7b8b-449c-8471-a58754b28b5f => generated 141 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:21:01.652664 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0fa7fc30-4903-4baa-8ade-04d542a2f5aa tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:01.653271 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0fa7fc30-4903-4baa-8ade-04d542a2f5aa tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] [instance: 2de58a4c-7601-40e2-a4dc-073e102b659f] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:01.674528 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0fa7fc30-4903-4baa-8ade-04d542a2f5aa tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:01.675312 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0fa7fc30-4903-4baa-8ade-04d542a2f5aa tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:01.676585 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0fa7fc30-4903-4baa-8ade-04d542a2f5aa tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:01.677561 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0fa7fc30-4903-4baa-8ade-04d542a2f5aa tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:01.678375 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0fa7fc30-4903-4baa-8ade-04d542a2f5aa tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:01.679518 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0fa7fc30-4903-4baa-8ade-04d542a2f5aa tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:01.942178 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0fa7fc30-4903-4baa-8ade-04d542a2f5aa tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f8680c2a39400c8fcfc221872fa299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5897e4c216e646aaa3a4c9ec2c7a1cfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:01.960071 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0fa7fc30-4903-4baa-8ade-04d542a2f5aa tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] 10.222.0.39 "GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f" status: 200 len: 1634 microversion: 2.1 time: 0.312976 Aug 07 01:21:01.961309 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1327/2383] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:01 2022] GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f => generated 1634 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:01.974172 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c176417c-8aeb-47e4-89c3-d072f038bde3 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:01.975147 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c176417c-8aeb-47e4-89c3-d072f038bde3 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: c320acee-ca30-4e57-a35f-0f102d7cd7a5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:01.985812 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c176417c-8aeb-47e4-89c3-d072f038bde3 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:01.988054 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c176417c-8aeb-47e4-89c3-d072f038bde3 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:01.988737 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c176417c-8aeb-47e4-89c3-d072f038bde3 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:01.993527 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c176417c-8aeb-47e4-89c3-d072f038bde3 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:01.994226 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c176417c-8aeb-47e4-89c3-d072f038bde3 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:01.997641 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c176417c-8aeb-47e4-89c3-d072f038bde3 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:02.049248 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e246678c-92fa-4ef6-8192-4d6955749b5c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5041cbc4adc24ae8871d60064720d680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc8a87d755a42239e9d4572e4bf2f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:02.065193 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e246678c-92fa-4ef6-8192-4d6955749b5c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "GET /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde" status: 200 len: 1324 microversion: 2.1 time: 0.479109 Aug 07 01:21:02.067605 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1057/2384] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:01 2022] GET /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde => generated 1324 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:02.091443 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cbccf7ac-a1ae-4f5c-9ed4-29f2ff14e927 tempest-FloatingIPsTestJSON-1845688227 tempest-FloatingIPsTestJSON-1845688227-project] Calling method '.version_select at 0x7f9e17f4f310>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:02.560366 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c176417c-8aeb-47e4-89c3-d072f038bde3 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:02.582664 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c176417c-8aeb-47e4-89c3-d072f038bde3 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5" status: 200 len: 1309 microversion: 2.1 time: 0.619947 Aug 07 01:21:02.587641 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1328/2385] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:01 2022] GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5 => generated 1309 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:02.632896 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cbccf7ac-a1ae-4f5c-9ed4-29f2ff14e927 tempest-FloatingIPsTestJSON-1845688227 tempest-FloatingIPsTestJSON-1845688227-project] 10.222.0.39 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.548652 Aug 07 01:21:02.633961 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1058/2386] 10.222.0.39 () {58 vars in 1149 bytes} [Sun Aug 7 01:21:02 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:21:02.639775 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-9d6a6fcc-642f-4576-9037-5e2e34b84ec8 req-81b36d0c-1bc8-4821-8d13-033eaf08ddd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee42a97e-a680-4b64-bbfa-df12eba6dcde", "tag": "8a25057f-4c60-4889-8490-fb06550888b8"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:02.644210 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-20101e1d-02e6-408b-a3eb-b003342939d3 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:02.651273 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-20101e1d-02e6-408b-a3eb-b003342939d3 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] [instance: 76aa2198-b299-4359-b606-3b6afa2326fa] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:02.653464 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-9d6a6fcc-642f-4576-9037-5e2e34b84ec8 req-81b36d0c-1bc8-4821-8d13-033eaf08ddd8 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:02.654323 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-9d6a6fcc-642f-4576-9037-5e2e34b84ec8 req-81b36d0c-1bc8-4821-8d13-033eaf08ddd8 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:02.655484 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-9d6a6fcc-642f-4576-9037-5e2e34b84ec8 req-81b36d0c-1bc8-4821-8d13-033eaf08ddd8 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:02.668483 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-9d6a6fcc-642f-4576-9037-5e2e34b84ec8 req-81b36d0c-1bc8-4821-8d13-033eaf08ddd8 service nova] Creating event network-changed:8a25057f-4c60-4889-8490-fb06550888b8 for instance ee42a97e-a680-4b64-bbfa-df12eba6dcde on n-h1-master-1 Aug 07 01:21:02.670473 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20101e1d-02e6-408b-a3eb-b003342939d3 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:02.673836 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20101e1d-02e6-408b-a3eb-b003342939d3 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:02.674408 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20101e1d-02e6-408b-a3eb-b003342939d3 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:02.675266 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20101e1d-02e6-408b-a3eb-b003342939d3 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:02.675924 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-9d6a6fcc-642f-4576-9037-5e2e34b84ec8 req-81b36d0c-1bc8-4821-8d13-033eaf08ddd8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040137 Aug 07 01:21:02.676490 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20101e1d-02e6-408b-a3eb-b003342939d3 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:02.677567 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1059/2387] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:21:02.678135 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20101e1d-02e6-408b-a3eb-b003342939d3 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:02.683480 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c39c3362-69aa-4909-ad66-d15477279558 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:02.684740 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c39c3362-69aa-4909-ad66-d15477279558 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:02.693682 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c39c3362-69aa-4909-ad66-d15477279558 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:02.697400 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c39c3362-69aa-4909-ad66-d15477279558 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:02.700502 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c39c3362-69aa-4909-ad66-d15477279558 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:02.701266 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c39c3362-69aa-4909-ad66-d15477279558 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:02.701773 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c39c3362-69aa-4909-ad66-d15477279558 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:02.702210 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c39c3362-69aa-4909-ad66-d15477279558 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:02.916322 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-20101e1d-02e6-408b-a3eb-b003342939d3 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4feb14c621b4090af8c965c9aaf0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06e7912f1fe423ea1b2a4bcdb90804a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:02.926564 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-20101e1d-02e6-408b-a3eb-b003342939d3 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] 10.222.0.39 "GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa" status: 200 len: 1303 microversion: 2.1 time: 0.335093 Aug 07 01:21:02.927911 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1329/2388] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:02 2022] GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa => generated 1303 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:02.944345 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1af7ea2f-7fbb-499b-939d-125229c790be tempest-FloatingIPsTestJSON-1845688227 tempest-FloatingIPsTestJSON-1845688227-project] Calling method '.version_select at 0x7f9e2401a430>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:02.990175 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c39c3362-69aa-4909-ad66-d15477279558 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:03.015505 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c39c3362-69aa-4909-ad66-d15477279558 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:03.021870 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c39c3362-69aa-4909-ad66-d15477279558 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:03.026918 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c39c3362-69aa-4909-ad66-d15477279558 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 1813 microversion: 2.25 time: 0.346580 Aug 07 01:21:03.031914 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1060/2389] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:02 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 1813 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:03.049832 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8eea83de-ca90-4ec4-b1df-3567d27b42c5 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:03.070708 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8eea83de-ca90-4ec4-b1df-3567d27b42c5 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] [instance: 2de58a4c-7601-40e2-a4dc-073e102b659f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:03.083323 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:03.099087 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8eea83de-ca90-4ec4-b1df-3567d27b42c5 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:03.099836 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8eea83de-ca90-4ec4-b1df-3567d27b42c5 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:03.100490 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8eea83de-ca90-4ec4-b1df-3567d27b42c5 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:03.101782 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8eea83de-ca90-4ec4-b1df-3567d27b42c5 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:03.105986 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8eea83de-ca90-4ec4-b1df-3567d27b42c5 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:03.106651 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8eea83de-ca90-4ec4-b1df-3567d27b42c5 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:03.238463 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8eea83de-ca90-4ec4-b1df-3567d27b42c5 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:03.247095 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8eea83de-ca90-4ec4-b1df-3567d27b42c5 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:03.250307 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8eea83de-ca90-4ec4-b1df-3567d27b42c5 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:03.251045 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-8eea83de-ca90-4ec4-b1df-3567d27b42c5 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lazy-loading 'fault' on Instance uuid 2de58a4c-7601-40e2-a4dc-073e102b659f {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:21:03.365322 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=14 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:03.550233 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8eea83de-ca90-4ec4-b1df-3567d27b42c5 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f8680c2a39400c8fcfc221872fa299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5897e4c216e646aaa3a4c9ec2c7a1cfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:03.578613 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8eea83de-ca90-4ec4-b1df-3567d27b42c5 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] 10.222.0.39 "GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f" status: 200 len: 1360 microversion: 2.1 time: 0.543360 Aug 07 01:21:03.580719 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1061/2390] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:03 2022] GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f => generated 1360 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:03.588983 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8922f128-35ac-4527-9756-17d4fcfae8f1 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:03.593257 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8922f128-35ac-4527-9756-17d4fcfae8f1 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: ee42a97e-a680-4b64-bbfa-df12eba6dcde] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:03.614310 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8922f128-35ac-4527-9756-17d4fcfae8f1 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:03.615055 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8922f128-35ac-4527-9756-17d4fcfae8f1 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:03.615781 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8922f128-35ac-4527-9756-17d4fcfae8f1 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:03.616925 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8922f128-35ac-4527-9756-17d4fcfae8f1 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:03.617689 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8922f128-35ac-4527-9756-17d4fcfae8f1 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:03.618311 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8922f128-35ac-4527-9756-17d4fcfae8f1 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:04.459603 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8922f128-35ac-4527-9756-17d4fcfae8f1 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5041cbc4adc24ae8871d60064720d680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc8a87d755a42239e9d4572e4bf2f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:04.471301 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8922f128-35ac-4527-9756-17d4fcfae8f1 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "GET /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde" status: 200 len: 1324 microversion: 2.1 time: 0.889226 Aug 07 01:21:04.473529 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1062/2391] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:03 2022] GET /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde => generated 1324 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:04.482637 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-c39352cc-024f-45d5-abbf-79322810f911 req-881fe975-5906-4d44-942f-4399b1df77d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c320acee-ca30-4e57-a35f-0f102d7cd7a5", "tag": "d263fe31-014b-4894-b46a-c776761e4287"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:04.502528 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c39352cc-024f-45d5-abbf-79322810f911 req-881fe975-5906-4d44-942f-4399b1df77d6 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:04.517368 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c39352cc-024f-45d5-abbf-79322810f911 req-881fe975-5906-4d44-942f-4399b1df77d6 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:04.520832 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c39352cc-024f-45d5-abbf-79322810f911 req-881fe975-5906-4d44-942f-4399b1df77d6 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:04.532533 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1af7ea2f-7fbb-499b-939d-125229c790be tempest-FloatingIPsTestJSON-1845688227 tempest-FloatingIPsTestJSON-1845688227-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/aa399a48-7b8b-449c-8471-a58754b28b5f" status: 202 len: 0 microversion: 2.1 time: 1.603245 Aug 07 01:21:04.533139 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1330/2392] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Aug 7 01:21:02 2022] DELETE /compute/v2.1/os-floating-ips/aa399a48-7b8b-449c-8471-a58754b28b5f => generated 0 bytes in 1604 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:21:04.533828 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:04.538515 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3e30b440-4ebf-41a8-824a-c7fddfd8a036 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:04.539159 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3e30b440-4ebf-41a8-824a-c7fddfd8a036 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: c320acee-ca30-4e57-a35f-0f102d7cd7a5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:04.552681 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-c39352cc-024f-45d5-abbf-79322810f911 req-881fe975-5906-4d44-942f-4399b1df77d6 service nova] Creating event network-changed:d263fe31-014b-4894-b46a-c776761e4287 for instance c320acee-ca30-4e57-a35f-0f102d7cd7a5 on n-h1-master-1 Aug 07 01:21:04.556431 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e30b440-4ebf-41a8-824a-c7fddfd8a036 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:04.557311 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e30b440-4ebf-41a8-824a-c7fddfd8a036 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:04.557916 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e30b440-4ebf-41a8-824a-c7fddfd8a036 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:04.558798 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e30b440-4ebf-41a8-824a-c7fddfd8a036 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:04.559485 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e30b440-4ebf-41a8-824a-c7fddfd8a036 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:04.560124 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e30b440-4ebf-41a8-824a-c7fddfd8a036 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:04.567676 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-c39352cc-024f-45d5-abbf-79322810f911 req-881fe975-5906-4d44-942f-4399b1df77d6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092704 Aug 07 01:21:04.568772 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1063/2393] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:21:04.575952 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8f50fb9a-e50b-41b5-bcd9-d226c50e82a3 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:04.575952 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8f50fb9a-e50b-41b5-bcd9-d226c50e82a3 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] [instance: 76aa2198-b299-4359-b606-3b6afa2326fa] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:04.590299 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f50fb9a-e50b-41b5-bcd9-d226c50e82a3 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:04.590803 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f50fb9a-e50b-41b5-bcd9-d226c50e82a3 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:04.592276 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f50fb9a-e50b-41b5-bcd9-d226c50e82a3 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:04.593726 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f50fb9a-e50b-41b5-bcd9-d226c50e82a3 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:04.594349 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f50fb9a-e50b-41b5-bcd9-d226c50e82a3 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:04.595107 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f50fb9a-e50b-41b5-bcd9-d226c50e82a3 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:04.735651 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3e30b440-4ebf-41a8-824a-c7fddfd8a036 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:04.745534 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3e30b440-4ebf-41a8-824a-c7fddfd8a036 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5" status: 200 len: 1309 microversion: 2.1 time: 0.210866 Aug 07 01:21:04.759658 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1331/2394] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:04 2022] GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5 => generated 1309 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:04.768066 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6543ab5c-9d49-4ca3-9484-594f4bdd723b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:04.768759 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6543ab5c-9d49-4ca3-9484-594f4bdd723b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:04.781573 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6543ab5c-9d49-4ca3-9484-594f4bdd723b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:04.782069 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6543ab5c-9d49-4ca3-9484-594f4bdd723b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:04.782514 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6543ab5c-9d49-4ca3-9484-594f4bdd723b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:04.783238 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6543ab5c-9d49-4ca3-9484-594f4bdd723b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:04.783693 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6543ab5c-9d49-4ca3-9484-594f4bdd723b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:04.784156 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6543ab5c-9d49-4ca3-9484-594f4bdd723b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:04.860260 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8f50fb9a-e50b-41b5-bcd9-d226c50e82a3 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4feb14c621b4090af8c965c9aaf0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06e7912f1fe423ea1b2a4bcdb90804a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:04.875955 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8f50fb9a-e50b-41b5-bcd9-d226c50e82a3 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] 10.222.0.39 "GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa" status: 200 len: 1291 microversion: 2.1 time: 0.305859 Aug 07 01:21:04.876584 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1064/2395] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:04 2022] GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa => generated 1291 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:04.904533 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1ba424fd-fcfe-497b-8be9-0b935718a15b tempest-FloatingIPsTestJSON-1845688227 tempest-FloatingIPsTestJSON-1845688227-project] Action: 'create', calling method: .version_select at 0x7f9e240d7790>, body: {"pool": null} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:05.173467 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6543ab5c-9d49-4ca3-9484-594f4bdd723b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:05.184191 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6543ab5c-9d49-4ca3-9484-594f4bdd723b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:05.185683 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6543ab5c-9d49-4ca3-9484-594f4bdd723b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:05.187080 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6543ab5c-9d49-4ca3-9484-594f4bdd723b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 1813 microversion: 2.25 time: 0.429770 Aug 07 01:21:05.200942 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1332/2396] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:04 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 1813 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:05.216693 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-42343384-72ff-4a7f-8a56-596a85337ba6 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:05.218348 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-42343384-72ff-4a7f-8a56-596a85337ba6 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] [instance: 2de58a4c-7601-40e2-a4dc-073e102b659f] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:05.225687 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42343384-72ff-4a7f-8a56-596a85337ba6 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:05.226539 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42343384-72ff-4a7f-8a56-596a85337ba6 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:05.227219 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42343384-72ff-4a7f-8a56-596a85337ba6 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:05.228334 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42343384-72ff-4a7f-8a56-596a85337ba6 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:05.233841 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42343384-72ff-4a7f-8a56-596a85337ba6 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:05.234681 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42343384-72ff-4a7f-8a56-596a85337ba6 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:05.255391 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-42343384-72ff-4a7f-8a56-596a85337ba6 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] HTTP exception thrown: Instance 2de58a4c-7601-40e2-a4dc-073e102b659f could not be found. Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-42343384-72ff-4a7f-8a56-596a85337ba6 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Request method failure captured: Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f HTTP/1.1 Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xM0fgYfYIQI3l2Nc8v1CLc1D6c181sQgTp-A6wRlAbOTvqNH4OaqigpvZwRYNb60scbh54Pa4S0teDF-yUkM11-Zrz4JiEv5TYKYlvT5rt3KLyWf5YmJARygyaDKdAQb8SrRYJvc6tNdHl85b86LCQbVv0Aa46kYw6CKwBL2SWFMZM Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 5897e4c216e646aaa3a4c9ec2c7a1cfb Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersTestJSON-125045282 Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5897e4c216e646aaa3a4c9ec2c7a1cfb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5897e4c216e646aaa3a4c9ec2c7a1cfb", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5897e4c216e646aaa3a4c9ec2c7a1cfb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5897e4c216e646aaa3a4c9ec2c7a1cfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersTestJSON-125045282 Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 5897e4c216e646aaa3a4c9ec2c7a1cfb Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersTestJSON-125045282 Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersTestJSON-125045282-project Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 80f8680c2a39400c8fcfc221872fa299 Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersTestJSON-125045282-project Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 2de58a4c-7601-40e2-a4dc-073e102b659f could not be found. Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '2de58a4c-7601-40e2-a4dc-073e102b659f'} Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2de58a4c-7601-40e2-a4dc-073e102b659f could not be found. Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2de58a4c-7601-40e2-a4dc-073e102b659f could not be found. Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:21:05.257343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:05.260924 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:21:05.260924 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:21:05.260924 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:21:05.260924 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:21:05.260924 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2de58a4c-7601-40e2-a4dc-073e102b659f could not be found. Aug 07 01:21:05.260924 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:21:05.262748 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-42343384-72ff-4a7f-8a56-596a85337ba6 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Returning 404 to user: Instance 2de58a4c-7601-40e2-a4dc-073e102b659f could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:21:05.263909 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-42343384-72ff-4a7f-8a56-596a85337ba6 tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] 10.222.0.39 "GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f" status: 404 len: 111 microversion: 2.1 time: 0.051308 Aug 07 01:21:05.265308 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1333/2397] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:05 2022] GET /compute/v2.1/servers/2de58a4c-7601-40e2-a4dc-073e102b659f => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:21:05.274136 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-f6265b91-24cf-47aa-a12c-6b9748729783 req-752eeda2-aec0-4ed9-88ef-f95d1b280b16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2de58a4c-7601-40e2-a4dc-073e102b659f", "name": "network-vif-deleted", "tag": "5e510ccb-df6b-4f78-97bf-bbc62a3514bf"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:05.285247 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f6265b91-24cf-47aa-a12c-6b9748729783 req-752eeda2-aec0-4ed9-88ef-f95d1b280b16 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:05.286099 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f6265b91-24cf-47aa-a12c-6b9748729783 req-752eeda2-aec0-4ed9-88ef-f95d1b280b16 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:05.286773 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f6265b91-24cf-47aa-a12c-6b9748729783 req-752eeda2-aec0-4ed9-88ef-f95d1b280b16 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:05.300682 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-f6265b91-24cf-47aa-a12c-6b9748729783 req-752eeda2-aec0-4ed9-88ef-f95d1b280b16 service nova] Creating event network-vif-deleted:5e510ccb-df6b-4f78-97bf-bbc62a3514bf for instance 2de58a4c-7601-40e2-a4dc-073e102b659f on n-h1-master-1 Aug 07 01:21:05.306532 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-f6265b91-24cf-47aa-a12c-6b9748729783 req-752eeda2-aec0-4ed9-88ef-f95d1b280b16 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036360 Aug 07 01:21:05.307710 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1334/2398] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:21:05.313278 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3ea530bd-29ad-4c08-bba1-aa60fdc6bb2e tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] Calling method '.version_select at 0x7f9e298b1670>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:05.337499 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3ea530bd-29ad-4c08-bba1-aa60fdc6bb2e tempest-ServersTestJSON-125045282 tempest-ServersTestJSON-125045282-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1266733088" status: 202 len: 0 microversion: 2.1 time: 0.028309 Aug 07 01:21:05.343251 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1335/2399] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Aug 7 01:21:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1266733088 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:21:05.501287 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ffb95431-06c4-4445-8967-ad6f4295946c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:05.502165 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ffb95431-06c4-4445-8967-ad6f4295946c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: ee42a97e-a680-4b64-bbfa-df12eba6dcde] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:05.511934 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ffb95431-06c4-4445-8967-ad6f4295946c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:05.524432 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ffb95431-06c4-4445-8967-ad6f4295946c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:05.525066 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ffb95431-06c4-4445-8967-ad6f4295946c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:05.525919 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ffb95431-06c4-4445-8967-ad6f4295946c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:05.526467 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ffb95431-06c4-4445-8967-ad6f4295946c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:05.526614 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=4 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:05.527606 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ffb95431-06c4-4445-8967-ad6f4295946c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:05.872321 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ffb95431-06c4-4445-8967-ad6f4295946c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5041cbc4adc24ae8871d60064720d680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc8a87d755a42239e9d4572e4bf2f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:05.896409 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ffb95431-06c4-4445-8967-ad6f4295946c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "GET /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde" status: 200 len: 1324 microversion: 2.1 time: 0.399850 Aug 07 01:21:05.898194 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1336/2400] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:05 2022] GET /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde => generated 1324 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:05.904307 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b04f7eed-d6cf-4b76-8346-22d2c9fa19af tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:05.905270 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b04f7eed-d6cf-4b76-8346-22d2c9fa19af tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: c320acee-ca30-4e57-a35f-0f102d7cd7a5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:05.913484 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b04f7eed-d6cf-4b76-8346-22d2c9fa19af tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:05.914304 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b04f7eed-d6cf-4b76-8346-22d2c9fa19af tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:05.914932 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b04f7eed-d6cf-4b76-8346-22d2c9fa19af tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:05.916032 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b04f7eed-d6cf-4b76-8346-22d2c9fa19af tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:05.916854 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b04f7eed-d6cf-4b76-8346-22d2c9fa19af tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:05.917531 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b04f7eed-d6cf-4b76-8346-22d2c9fa19af tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:06.472039 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b04f7eed-d6cf-4b76-8346-22d2c9fa19af tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:06.493102 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b04f7eed-d6cf-4b76-8346-22d2c9fa19af tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5" status: 200 len: 1309 microversion: 2.1 time: 0.593599 Aug 07 01:21:06.506539 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1337/2401] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:05 2022] GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5 => generated 1309 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:06.510695 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ea27d4c3-566e-4ad7-91ad-e147e72fb9cc tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:06.511320 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ea27d4c3-566e-4ad7-91ad-e147e72fb9cc tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] [instance: 76aa2198-b299-4359-b606-3b6afa2326fa] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:06.518161 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea27d4c3-566e-4ad7-91ad-e147e72fb9cc tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:06.518652 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea27d4c3-566e-4ad7-91ad-e147e72fb9cc tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:06.519090 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea27d4c3-566e-4ad7-91ad-e147e72fb9cc tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:06.519807 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea27d4c3-566e-4ad7-91ad-e147e72fb9cc tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:06.520335 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea27d4c3-566e-4ad7-91ad-e147e72fb9cc tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:06.520766 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea27d4c3-566e-4ad7-91ad-e147e72fb9cc tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:06.547565 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=14 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:06.751868 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ea27d4c3-566e-4ad7-91ad-e147e72fb9cc tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4feb14c621b4090af8c965c9aaf0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06e7912f1fe423ea1b2a4bcdb90804a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:06.766632 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ea27d4c3-566e-4ad7-91ad-e147e72fb9cc tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] 10.222.0.39 "GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa" status: 200 len: 1291 microversion: 2.1 time: 0.270095 Aug 07 01:21:06.767654 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1338/2402] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:06 2022] GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa => generated 1291 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:06.797088 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d2a4d7c1-3078-4d84-bc16-746086125eb8 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:06.797752 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d2a4d7c1-3078-4d84-bc16-746086125eb8 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:06.804638 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2a4d7c1-3078-4d84-bc16-746086125eb8 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:06.805120 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2a4d7c1-3078-4d84-bc16-746086125eb8 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:06.805552 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2a4d7c1-3078-4d84-bc16-746086125eb8 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:06.806396 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2a4d7c1-3078-4d84-bc16-746086125eb8 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:06.806863 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2a4d7c1-3078-4d84-bc16-746086125eb8 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:06.807286 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2a4d7c1-3078-4d84-bc16-746086125eb8 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:07.100523 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d2a4d7c1-3078-4d84-bc16-746086125eb8 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:07.110234 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d2a4d7c1-3078-4d84-bc16-746086125eb8 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:07.114491 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d2a4d7c1-3078-4d84-bc16-746086125eb8 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:07.116128 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d2a4d7c1-3078-4d84-bc16-746086125eb8 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 1813 microversion: 2.25 time: 0.347358 Aug 07 01:21:07.116921 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1339/2403] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:06 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 1813 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:07.130843 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-180aead8-e1ac-4fbd-9335-46b4bc968fbb tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:07.131805 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-180aead8-e1ac-4fbd-9335-46b4bc968fbb tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: ee42a97e-a680-4b64-bbfa-df12eba6dcde] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:07.150433 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-180aead8-e1ac-4fbd-9335-46b4bc968fbb tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:07.150944 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-180aead8-e1ac-4fbd-9335-46b4bc968fbb tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:07.151650 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-180aead8-e1ac-4fbd-9335-46b4bc968fbb tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:07.152559 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-180aead8-e1ac-4fbd-9335-46b4bc968fbb tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:07.153209 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-180aead8-e1ac-4fbd-9335-46b4bc968fbb tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:07.153920 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-180aead8-e1ac-4fbd-9335-46b4bc968fbb tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:07.382914 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-180aead8-e1ac-4fbd-9335-46b4bc968fbb tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5041cbc4adc24ae8871d60064720d680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc8a87d755a42239e9d4572e4bf2f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:07.396066 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-180aead8-e1ac-4fbd-9335-46b4bc968fbb tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "GET /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde" status: 200 len: 1324 microversion: 2.1 time: 0.277550 Aug 07 01:21:07.398793 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1340/2404] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:07 2022] GET /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde => generated 1324 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:07.516213 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cf6df5fa-3a52-4628-82ec-ac818852e4e4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:07.517205 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cf6df5fa-3a52-4628-82ec-ac818852e4e4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: c320acee-ca30-4e57-a35f-0f102d7cd7a5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:07.526624 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cf6df5fa-3a52-4628-82ec-ac818852e4e4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:07.527466 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cf6df5fa-3a52-4628-82ec-ac818852e4e4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:07.528190 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cf6df5fa-3a52-4628-82ec-ac818852e4e4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:07.529000 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cf6df5fa-3a52-4628-82ec-ac818852e4e4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:07.529523 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cf6df5fa-3a52-4628-82ec-ac818852e4e4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:07.530174 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cf6df5fa-3a52-4628-82ec-ac818852e4e4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:07.703511 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cf6df5fa-3a52-4628-82ec-ac818852e4e4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:07.712475 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cf6df5fa-3a52-4628-82ec-ac818852e4e4 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5" status: 200 len: 1309 microversion: 2.1 time: 0.200977 Aug 07 01:21:07.721587 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1341/2405] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:07 2022] GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5 => generated 1309 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:21:07.788499 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-92dd5f6a-5645-416f-8ccf-fbad94a430d9 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:07.789108 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-92dd5f6a-5645-416f-8ccf-fbad94a430d9 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] [instance: 76aa2198-b299-4359-b606-3b6afa2326fa] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:07.796287 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92dd5f6a-5645-416f-8ccf-fbad94a430d9 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:07.796859 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92dd5f6a-5645-416f-8ccf-fbad94a430d9 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:07.797303 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92dd5f6a-5645-416f-8ccf-fbad94a430d9 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:07.798027 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92dd5f6a-5645-416f-8ccf-fbad94a430d9 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:07.809217 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92dd5f6a-5645-416f-8ccf-fbad94a430d9 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:07.809998 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92dd5f6a-5645-416f-8ccf-fbad94a430d9 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:08.027246 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-92dd5f6a-5645-416f-8ccf-fbad94a430d9 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4feb14c621b4090af8c965c9aaf0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06e7912f1fe423ea1b2a4bcdb90804a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:08.038353 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-92dd5f6a-5645-416f-8ccf-fbad94a430d9 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] 10.222.0.39 "GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa" status: 200 len: 1291 microversion: 2.1 time: 0.253592 Aug 07 01:21:08.051290 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1342/2406] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:07 2022] GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa => generated 1291 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:08.141832 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d20b7070-e6c9-4316-942d-c0947b3e5ffa tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:08.142586 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d20b7070-e6c9-4316-942d-c0947b3e5ffa tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:08.152530 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d20b7070-e6c9-4316-942d-c0947b3e5ffa tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:08.154105 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d20b7070-e6c9-4316-942d-c0947b3e5ffa tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:08.154764 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d20b7070-e6c9-4316-942d-c0947b3e5ffa tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:08.156462 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d20b7070-e6c9-4316-942d-c0947b3e5ffa tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:08.156952 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d20b7070-e6c9-4316-942d-c0947b3e5ffa tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:08.157637 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d20b7070-e6c9-4316-942d-c0947b3e5ffa tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:08.374857 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d20b7070-e6c9-4316-942d-c0947b3e5ffa tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:08.416846 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d20b7070-e6c9-4316-942d-c0947b3e5ffa tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:08.423642 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d20b7070-e6c9-4316-942d-c0947b3e5ffa tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:08.424976 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d20b7070-e6c9-4316-942d-c0947b3e5ffa tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 1813 microversion: 2.25 time: 0.287728 Aug 07 01:21:08.425556 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1343/2407] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:08 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 1813 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:21:08.439489 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-98c694d9-0c09-4ea5-9ad8-bd100fc6ac5d tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:08.441865 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-98c694d9-0c09-4ea5-9ad8-bd100fc6ac5d tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: ee42a97e-a680-4b64-bbfa-df12eba6dcde] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:08.454743 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-98c694d9-0c09-4ea5-9ad8-bd100fc6ac5d tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:08.458075 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-98c694d9-0c09-4ea5-9ad8-bd100fc6ac5d tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:08.458947 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-98c694d9-0c09-4ea5-9ad8-bd100fc6ac5d tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:08.459847 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-98c694d9-0c09-4ea5-9ad8-bd100fc6ac5d tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:08.461918 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-98c694d9-0c09-4ea5-9ad8-bd100fc6ac5d tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:08.462545 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-98c694d9-0c09-4ea5-9ad8-bd100fc6ac5d tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:08.692429 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1ba424fd-fcfe-497b-8be9-0b935718a15b tempest-FloatingIPsTestJSON-1845688227 tempest-FloatingIPsTestJSON-1845688227-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.799168 Aug 07 01:21:08.693757 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1065/2408] 10.222.0.39 () {60 vars in 1170 bytes} [Sun Aug 7 01:21:04 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3816 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:21:08.705507 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-52da4913-f361-4fe4-ad2e-c11534cda07b tempest-FloatingIPsTestJSON-1845688227 tempest-FloatingIPsTestJSON-1845688227-project] Calling method '.version_select at 0x7f9e24b95160>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:08.757834 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-98c694d9-0c09-4ea5-9ad8-bd100fc6ac5d tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5041cbc4adc24ae8871d60064720d680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc8a87d755a42239e9d4572e4bf2f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:08.767279 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-98c694d9-0c09-4ea5-9ad8-bd100fc6ac5d tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "GET /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde" status: 200 len: 1324 microversion: 2.1 time: 0.337676 Aug 07 01:21:08.768393 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1344/2409] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:08 2022] GET /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde => generated 1324 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:08.773444 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6707e75f-768b-4bc7-a2da-9b6948f3377a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:08.774151 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6707e75f-768b-4bc7-a2da-9b6948f3377a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: c320acee-ca30-4e57-a35f-0f102d7cd7a5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:08.781204 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6707e75f-768b-4bc7-a2da-9b6948f3377a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:08.781788 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6707e75f-768b-4bc7-a2da-9b6948f3377a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:08.782460 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6707e75f-768b-4bc7-a2da-9b6948f3377a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:08.783187 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6707e75f-768b-4bc7-a2da-9b6948f3377a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:08.783744 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6707e75f-768b-4bc7-a2da-9b6948f3377a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:08.784280 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6707e75f-768b-4bc7-a2da-9b6948f3377a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:09.029662 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6707e75f-768b-4bc7-a2da-9b6948f3377a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:09.040635 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6707e75f-768b-4bc7-a2da-9b6948f3377a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5" status: 200 len: 1309 microversion: 2.1 time: 0.271038 Aug 07 01:21:09.043860 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1345/2410] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:08 2022] GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5 => generated 1309 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:09.049344 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-24917ffa-9c8c-4773-a6df-29862ea5da5e tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:09.058139 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-24917ffa-9c8c-4773-a6df-29862ea5da5e tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] [instance: 1bc2c437-e710-4af4-9928-76c48834cfa2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:09.071487 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24917ffa-9c8c-4773-a6df-29862ea5da5e tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:09.072261 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24917ffa-9c8c-4773-a6df-29862ea5da5e tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:09.073892 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24917ffa-9c8c-4773-a6df-29862ea5da5e tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:09.074815 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24917ffa-9c8c-4773-a6df-29862ea5da5e tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:09.079835 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24917ffa-9c8c-4773-a6df-29862ea5da5e tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:09.080531 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24917ffa-9c8c-4773-a6df-29862ea5da5e tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:09.104529 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-24917ffa-9c8c-4773-a6df-29862ea5da5e tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] HTTP exception thrown: Instance 1bc2c437-e710-4af4-9928-76c48834cfa2 could not be found. Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-24917ffa-9c8c-4773-a6df-29862ea5da5e tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Request method failure captured: Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2 HTTP/1.1 Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xLBUvqgTysISe_3nImj-XfiASn_IiT7FYLcFtI_0yzkP64V7YK7XyrMEayv2cqk3gIjSkywQWc6YTZckkl3iz9RW11k2SZz-rpia1-6VAg9-mYlPaQnjWnaJdvDC1BXINTqngAJHlA1gC84s3a1GjHR2aENuDH8HmGR1WYX5W9nl6E Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: bc6a995089fa447e8f74df7d111b1c6b Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-138096746 Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bc6a995089fa447e8f74df7d111b1c6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bc6a995089fa447e8f74df7d111b1c6b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bc6a995089fa447e8f74df7d111b1c6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bc6a995089fa447e8f74df7d111b1c6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-138096746 Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: bc6a995089fa447e8f74df7d111b1c6b Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-138096746 Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-AttachSCSIVolumeTestJSON-138096746-project Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 5080c88d51a8455bba8b70e33cca958b Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-138096746-project Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 1bc2c437-e710-4af4-9928-76c48834cfa2 could not be found. Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '1bc2c437-e710-4af4-9928-76c48834cfa2'} Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bc2c437-e710-4af4-9928-76c48834cfa2 could not be found. Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:21:09.108310 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:21:09.111724 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bc2c437-e710-4af4-9928-76c48834cfa2 could not be found. Aug 07 01:21:09.111724 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:21:09.111724 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:21:09.111724 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:21:09.111724 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:09.111724 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:21:09.111724 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:21:09.111724 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:21:09.111724 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:21:09.111724 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bc2c437-e710-4af4-9928-76c48834cfa2 could not be found. Aug 07 01:21:09.111724 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:21:09.114093 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-24917ffa-9c8c-4773-a6df-29862ea5da5e tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Returning 404 to user: Instance 1bc2c437-e710-4af4-9928-76c48834cfa2 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:21:09.115256 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-24917ffa-9c8c-4773-a6df-29862ea5da5e tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2" status: 404 len: 111 microversion: 2.1 time: 0.070184 Aug 07 01:21:09.129706 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1346/2411] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:21:09 2022] DELETE /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:21:09.146564 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3fddf240-0f12-429a-98ce-e7197e0a005d tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:09.148325 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3fddf240-0f12-429a-98ce-e7197e0a005d tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] [instance: 76aa2198-b299-4359-b606-3b6afa2326fa] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:09.159010 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fddf240-0f12-429a-98ce-e7197e0a005d tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:09.159829 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fddf240-0f12-429a-98ce-e7197e0a005d tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:09.160552 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fddf240-0f12-429a-98ce-e7197e0a005d tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:09.162073 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fddf240-0f12-429a-98ce-e7197e0a005d tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:09.162767 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fddf240-0f12-429a-98ce-e7197e0a005d tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:09.163444 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fddf240-0f12-429a-98ce-e7197e0a005d tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:09.186729 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:09.667593 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3fddf240-0f12-429a-98ce-e7197e0a005d tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4feb14c621b4090af8c965c9aaf0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06e7912f1fe423ea1b2a4bcdb90804a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:09.677149 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3fddf240-0f12-429a-98ce-e7197e0a005d tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] 10.222.0.39 "GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa" status: 200 len: 1291 microversion: 2.1 time: 0.545935 Aug 07 01:21:09.711839 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1347/2412] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:09 2022] GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa => generated 1291 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:09.718757 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-204cfc29-e1fb-4197-84b5-ad2ccb15e1d9 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:09.719618 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-204cfc29-e1fb-4197-84b5-ad2ccb15e1d9 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] [instance: 1bc2c437-e710-4af4-9928-76c48834cfa2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:09.727618 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-204cfc29-e1fb-4197-84b5-ad2ccb15e1d9 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:09.728362 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-204cfc29-e1fb-4197-84b5-ad2ccb15e1d9 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:09.728973 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-204cfc29-e1fb-4197-84b5-ad2ccb15e1d9 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:09.729836 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-204cfc29-e1fb-4197-84b5-ad2ccb15e1d9 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:09.730556 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-204cfc29-e1fb-4197-84b5-ad2ccb15e1d9 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:09.731252 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-204cfc29-e1fb-4197-84b5-ad2ccb15e1d9 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:09.753564 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-204cfc29-e1fb-4197-84b5-ad2ccb15e1d9 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] HTTP exception thrown: Instance 1bc2c437-e710-4af4-9928-76c48834cfa2 could not be found. Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-204cfc29-e1fb-4197-84b5-ad2ccb15e1d9 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Request method failure captured: Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2 HTTP/1.1 Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xLBUvqgTysISe_3nImj-XfiASn_IiT7FYLcFtI_0yzkP64V7YK7XyrMEayv2cqk3gIjSkywQWc6YTZckkl3iz9RW11k2SZz-rpia1-6VAg9-mYlPaQnjWnaJdvDC1BXINTqngAJHlA1gC84s3a1GjHR2aENuDH8HmGR1WYX5W9nl6E Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: bc6a995089fa447e8f74df7d111b1c6b Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-138096746 Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bc6a995089fa447e8f74df7d111b1c6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bc6a995089fa447e8f74df7d111b1c6b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bc6a995089fa447e8f74df7d111b1c6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bc6a995089fa447e8f74df7d111b1c6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-138096746 Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: bc6a995089fa447e8f74df7d111b1c6b Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-138096746 Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-AttachSCSIVolumeTestJSON-138096746-project Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 5080c88d51a8455bba8b70e33cca958b Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-138096746-project Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 1bc2c437-e710-4af4-9928-76c48834cfa2 could not be found. Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '1bc2c437-e710-4af4-9928-76c48834cfa2'} Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bc2c437-e710-4af4-9928-76c48834cfa2 could not be found. Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bc2c437-e710-4af4-9928-76c48834cfa2 could not be found. Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:21:09.755568 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:21:09.759604 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:09.759604 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:21:09.759604 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:21:09.759604 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:21:09.759604 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:21:09.759604 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bc2c437-e710-4af4-9928-76c48834cfa2 could not be found. Aug 07 01:21:09.759604 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:21:09.759604 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-204cfc29-e1fb-4197-84b5-ad2ccb15e1d9 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] Returning 404 to user: Instance 1bc2c437-e710-4af4-9928-76c48834cfa2 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:21:09.759604 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-204cfc29-e1fb-4197-84b5-ad2ccb15e1d9 tempest-AttachSCSIVolumeTestJSON-138096746 tempest-AttachSCSIVolumeTestJSON-138096746-project] 10.222.0.39 "GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2" status: 404 len: 111 microversion: 2.1 time: 0.043909 Aug 07 01:21:09.759604 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1348/2413] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:09 2022] GET /compute/v2.1/servers/1bc2c437-e710-4af4-9928-76c48834cfa2 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:21:09.775993 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7945b746-7d29-41ec-b43a-488eeb4c2e60 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:09.776622 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7945b746-7d29-41ec-b43a-488eeb4c2e60 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:09.786508 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7945b746-7d29-41ec-b43a-488eeb4c2e60 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:09.787756 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7945b746-7d29-41ec-b43a-488eeb4c2e60 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:09.788135 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7945b746-7d29-41ec-b43a-488eeb4c2e60 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:09.789309 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7945b746-7d29-41ec-b43a-488eeb4c2e60 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:09.791325 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7945b746-7d29-41ec-b43a-488eeb4c2e60 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:09.791325 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7945b746-7d29-41ec-b43a-488eeb4c2e60 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:10.025285 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7945b746-7d29-41ec-b43a-488eeb4c2e60 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:10.035623 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7945b746-7d29-41ec-b43a-488eeb4c2e60 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:10.037741 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7945b746-7d29-41ec-b43a-488eeb4c2e60 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:10.039125 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7945b746-7d29-41ec-b43a-488eeb4c2e60 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 1813 microversion: 2.25 time: 0.280800 Aug 07 01:21:10.040074 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1349/2414] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:09 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 1813 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:10.044977 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e002a295-18db-4510-aa80-c57f5876cc91 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:10.046363 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e002a295-18db-4510-aa80-c57f5876cc91 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: ee42a97e-a680-4b64-bbfa-df12eba6dcde] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:10.057322 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e002a295-18db-4510-aa80-c57f5876cc91 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:10.057811 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e002a295-18db-4510-aa80-c57f5876cc91 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:10.058470 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e002a295-18db-4510-aa80-c57f5876cc91 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:10.059385 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e002a295-18db-4510-aa80-c57f5876cc91 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:10.060024 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e002a295-18db-4510-aa80-c57f5876cc91 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:10.060655 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e002a295-18db-4510-aa80-c57f5876cc91 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:10.288196 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e002a295-18db-4510-aa80-c57f5876cc91 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5041cbc4adc24ae8871d60064720d680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc8a87d755a42239e9d4572e4bf2f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:10.302244 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e002a295-18db-4510-aa80-c57f5876cc91 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "GET /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde" status: 200 len: 1324 microversion: 2.1 time: 0.260628 Aug 07 01:21:10.304380 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1350/2415] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:10 2022] GET /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde => generated 1324 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:10.310376 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1028d562-1eb2-4f95-988b-bb4b5fd5d717 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:10.312101 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1028d562-1eb2-4f95-988b-bb4b5fd5d717 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: c320acee-ca30-4e57-a35f-0f102d7cd7a5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:10.325868 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1028d562-1eb2-4f95-988b-bb4b5fd5d717 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:10.326329 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1028d562-1eb2-4f95-988b-bb4b5fd5d717 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:10.327659 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1028d562-1eb2-4f95-988b-bb4b5fd5d717 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:10.328693 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1028d562-1eb2-4f95-988b-bb4b5fd5d717 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:10.329196 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1028d562-1eb2-4f95-988b-bb4b5fd5d717 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:10.329637 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1028d562-1eb2-4f95-988b-bb4b5fd5d717 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:10.539897 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1028d562-1eb2-4f95-988b-bb4b5fd5d717 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:10.548848 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1028d562-1eb2-4f95-988b-bb4b5fd5d717 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5" status: 200 len: 1309 microversion: 2.1 time: 0.242862 Aug 07 01:21:10.565061 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1351/2416] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:10 2022] GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5 => generated 1309 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:10.668339 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-32cd0b82-736e-46ae-b9ce-0525de7d05ea req-0e1101df-2097-48df-bceb-f1cde1aa08b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee42a97e-a680-4b64-bbfa-df12eba6dcde", "name": "network-vif-plugged", "status": "completed", "tag": "8a25057f-4c60-4889-8490-fb06550888b8"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:10.678764 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-32cd0b82-736e-46ae-b9ce-0525de7d05ea req-0e1101df-2097-48df-bceb-f1cde1aa08b3 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:10.679349 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-32cd0b82-736e-46ae-b9ce-0525de7d05ea req-0e1101df-2097-48df-bceb-f1cde1aa08b3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:10.679859 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-32cd0b82-736e-46ae-b9ce-0525de7d05ea req-0e1101df-2097-48df-bceb-f1cde1aa08b3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:10.694822 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-32cd0b82-736e-46ae-b9ce-0525de7d05ea req-0e1101df-2097-48df-bceb-f1cde1aa08b3 service nova] Creating event network-vif-plugged:8a25057f-4c60-4889-8490-fb06550888b8 for instance ee42a97e-a680-4b64-bbfa-df12eba6dcde on n-h1-master-1 Aug 07 01:21:10.701118 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-32cd0b82-736e-46ae-b9ce-0525de7d05ea req-0e1101df-2097-48df-bceb-f1cde1aa08b3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037293 Aug 07 01:21:10.702139 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1352/2417] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:21:10.710415 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-89725562-6225-4434-8836-b8663eed298f tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:10.711305 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-89725562-6225-4434-8836-b8663eed298f tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] [instance: 76aa2198-b299-4359-b606-3b6afa2326fa] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:10.718595 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-89725562-6225-4434-8836-b8663eed298f tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:10.719316 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-89725562-6225-4434-8836-b8663eed298f tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:10.719980 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-89725562-6225-4434-8836-b8663eed298f tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:10.721007 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-89725562-6225-4434-8836-b8663eed298f tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:10.723152 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-89725562-6225-4434-8836-b8663eed298f tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:10.723790 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-89725562-6225-4434-8836-b8663eed298f tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:10.961174 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-52da4913-f361-4fe4-ad2e-c11534cda07b tempest-FloatingIPsTestJSON-1845688227 tempest-FloatingIPsTestJSON-1845688227-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/639d7caa-4b02-45fd-885f-aa7a58f6e2c9" status: 202 len: 0 microversion: 2.1 time: 2.258730 Aug 07 01:21:10.976266 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1066/2418] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Aug 7 01:21:08 2022] DELETE /compute/v2.1/os-floating-ips/639d7caa-4b02-45fd-885f-aa7a58f6e2c9 => generated 0 bytes in 2275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 01:21:10.981648 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ceb0c5ac-cfb9-4212-adf0-cb1641d5aa57 tempest-FloatingIPsTestJSON-1845688227 tempest-FloatingIPsTestJSON-1845688227-project] Calling method '.version_select at 0x7f9e24057040>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:11.022421 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-89725562-6225-4434-8836-b8663eed298f tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4feb14c621b4090af8c965c9aaf0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06e7912f1fe423ea1b2a4bcdb90804a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:11.039104 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-89725562-6225-4434-8836-b8663eed298f tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] 10.222.0.39 "GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa" status: 200 len: 1291 microversion: 2.1 time: 0.334822 Aug 07 01:21:11.039758 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1353/2419] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:10 2022] GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa => generated 1291 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:11.062315 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-50b0086c-bd11-4f96-9cb3-69c51a74490c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:11.062996 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-50b0086c-bd11-4f96-9cb3-69c51a74490c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:11.069304 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-50b0086c-bd11-4f96-9cb3-69c51a74490c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:11.070155 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-50b0086c-bd11-4f96-9cb3-69c51a74490c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:11.070783 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-50b0086c-bd11-4f96-9cb3-69c51a74490c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:11.071748 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-50b0086c-bd11-4f96-9cb3-69c51a74490c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:11.072758 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-50b0086c-bd11-4f96-9cb3-69c51a74490c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:11.074064 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-50b0086c-bd11-4f96-9cb3-69c51a74490c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:11.091135 n-d-master-1 devstack@n-api.service[119517]: DEBUG neutronclient.v2_0.client [None req-ceb0c5ac-cfb9-4212-adf0-cb1641d5aa57 tempest-FloatingIPsTestJSON-1845688227 tempest-FloatingIPsTestJSON-1845688227-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 639d7caa-4b02-45fd-885f-aa7a58f6e2c9 could not be found", "detail": ""}} {{(pid=119517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 07 01:21:11.093446 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-ceb0c5ac-cfb9-4212-adf0-cb1641d5aa57 tempest-FloatingIPsTestJSON-1845688227 tempest-FloatingIPsTestJSON-1845688227-project] HTTP exception thrown: Floating IP not found for ID 639d7caa-4b02-45fd-885f-aa7a58f6e2c9 Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ceb0c5ac-cfb9-4212-adf0-cb1641d5aa57 tempest-FloatingIPsTestJSON-1845688227 tempest-FloatingIPsTestJSON-1845688227-project] Request method failure captured: Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/os-floating-ips/639d7caa-4b02-45fd-885f-aa7a58f6e2c9 HTTP/1.1 Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xN49-vR9FgcaVo-C9mJ-YCYXA4TjYdiyYDug5qgTroaIwFFFq26xnc7XR7QI3G3PELRN3HhcD7WDhXc9qgtGezBXLX_UioReSq2rbxc0nOn_993syBOdFrEiIRpt3DS97yiCcoZ8aq8lKVkV7Y3P0fBWlwG80UJLjxQMV458n0VVFk Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 68f08b38eb9d4956a26450e2fbbf0413 Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-FloatingIPsTestJSON-1845688227 Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/68f08b38eb9d4956a26450e2fbbf0413"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_68f08b38eb9d4956a26450e2fbbf0413", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/68f08b38eb9d4956a26450e2fbbf0413"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/68f08b38eb9d4956a26450e2fbbf0413"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-FloatingIPsTestJSON-1845688227 Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 68f08b38eb9d4956a26450e2fbbf0413 Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1845688227 Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-FloatingIPsTestJSON-1845688227-project Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: dd32243133b8451c9b9e8e3bd6a96080 Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-FloatingIPsTestJSON-1845688227-project Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: exception: Floating IP not found for ID 639d7caa-4b02-45fd-885f-aa7a58f6e2c9 Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '639d7caa-4b02-45fd-885f-aa7a58f6e2c9'} Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 639d7caa-4b02-45fd-885f-aa7a58f6e2c9 could not be found Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c067681b-5948-4a8d-bf26-df53d36b9c9d'] Aug 07 01:21:11.096820 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:11.100438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:21:11.100438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:11.100438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:11.100438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 07 01:21:11.100438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 07 01:21:11.100438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 07 01:21:11.100438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 07 01:21:11.100438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 639d7caa-4b02-45fd-885f-aa7a58f6e2c9. Aug 07 01:21:11.100438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:11.100438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:21:11.100438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:11.100438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:11.100438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:21:11.100438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:21:11.100438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:21:11.100438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:21:11.100438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:21:11.100438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:21:11.100438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:21:11.100438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:21:11.100438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 07 01:21:11.100438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 07 01:21:11.100438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 639d7caa-4b02-45fd-885f-aa7a58f6e2c9 Aug 07 01:21:11.100438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:11.100438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:21:11.100438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:11.100438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:11.100438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:21:11.100438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:21:11.100438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:21:11.100438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:21:11.100438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 639d7caa-4b02-45fd-885f-aa7a58f6e2c9 Aug 07 01:21:11.100438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:11.100438 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ceb0c5ac-cfb9-4212-adf0-cb1641d5aa57 tempest-FloatingIPsTestJSON-1845688227 tempest-FloatingIPsTestJSON-1845688227-project] Returning 404 to user: Floating IP not found for ID 639d7caa-4b02-45fd-885f-aa7a58f6e2c9 {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:21:11.104097 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ceb0c5ac-cfb9-4212-adf0-cb1641d5aa57 tempest-FloatingIPsTestJSON-1845688227 tempest-FloatingIPsTestJSON-1845688227-project] 10.222.0.39 "GET /compute/v2.1/os-floating-ips/639d7caa-4b02-45fd-885f-aa7a58f6e2c9" status: 404 len: 111 microversion: 2.1 time: 0.123508 Aug 07 01:21:11.104097 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1067/2420] 10.222.0.39 () {58 vars in 1260 bytes} [Sun Aug 7 01:21:10 2022] GET /compute/v2.1/os-floating-ips/639d7caa-4b02-45fd-885f-aa7a58f6e2c9 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:21:11.110517 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-851bcd36-96cb-4213-bc04-95bcf3d89470 tempest-FloatingIPsTestJSON-1845688227 tempest-FloatingIPsTestJSON-1845688227-project] Calling method '.version_select at 0x7f9e240d7b80>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:11.183192 n-d-master-1 devstack@n-api.service[119517]: DEBUG neutronclient.v2_0.client [None req-851bcd36-96cb-4213-bc04-95bcf3d89470 tempest-FloatingIPsTestJSON-1845688227 tempest-FloatingIPsTestJSON-1845688227-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 639d7caa-4b02-45fd-885f-aa7a58f6e2c9 could not be found", "detail": ""}} {{(pid=119517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 07 01:21:11.184611 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-851bcd36-96cb-4213-bc04-95bcf3d89470 tempest-FloatingIPsTestJSON-1845688227 tempest-FloatingIPsTestJSON-1845688227-project] HTTP exception thrown: Floating IP not found for ID 639d7caa-4b02-45fd-885f-aa7a58f6e2c9 Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-851bcd36-96cb-4213-bc04-95bcf3d89470 tempest-FloatingIPsTestJSON-1845688227 tempest-FloatingIPsTestJSON-1845688227-project] Request method failure captured: Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/os-floating-ips/639d7caa-4b02-45fd-885f-aa7a58f6e2c9 HTTP/1.1 Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xN49-vR9FgcaVo-C9mJ-YCYXA4TjYdiyYDug5qgTroaIwFFFq26xnc7XR7QI3G3PELRN3HhcD7WDhXc9qgtGezBXLX_UioReSq2rbxc0nOn_993syBOdFrEiIRpt3DS97yiCcoZ8aq8lKVkV7Y3P0fBWlwG80UJLjxQMV458n0VVFk Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 68f08b38eb9d4956a26450e2fbbf0413 Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-FloatingIPsTestJSON-1845688227 Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/68f08b38eb9d4956a26450e2fbbf0413"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_68f08b38eb9d4956a26450e2fbbf0413", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/68f08b38eb9d4956a26450e2fbbf0413"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/68f08b38eb9d4956a26450e2fbbf0413"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-FloatingIPsTestJSON-1845688227 Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 68f08b38eb9d4956a26450e2fbbf0413 Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1845688227 Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-FloatingIPsTestJSON-1845688227-project Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: dd32243133b8451c9b9e8e3bd6a96080 Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-FloatingIPsTestJSON-1845688227-project Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: exception: Floating IP not found for ID 639d7caa-4b02-45fd-885f-aa7a58f6e2c9 Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '639d7caa-4b02-45fd-885f-aa7a58f6e2c9'} Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 639d7caa-4b02-45fd-885f-aa7a58f6e2c9 could not be found Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3affe3fc-7142-41cd-9ba0-d27cfb178a8f'] Aug 07 01:21:11.189674 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:11.193154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:21:11.193154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:11.193154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:11.193154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 07 01:21:11.193154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 07 01:21:11.193154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 07 01:21:11.193154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 07 01:21:11.193154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 639d7caa-4b02-45fd-885f-aa7a58f6e2c9. Aug 07 01:21:11.193154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:11.193154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:21:11.193154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:11.193154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:11.193154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:21:11.193154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:21:11.193154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:21:11.193154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:21:11.193154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:21:11.193154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:21:11.193154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:21:11.193154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:21:11.193154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 07 01:21:11.193154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 07 01:21:11.193154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 639d7caa-4b02-45fd-885f-aa7a58f6e2c9 Aug 07 01:21:11.193154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:11.193154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:21:11.193154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:11.193154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:11.193154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:21:11.193154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:21:11.193154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:21:11.193154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:21:11.193154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 639d7caa-4b02-45fd-885f-aa7a58f6e2c9 Aug 07 01:21:11.193154 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:11.197065 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-851bcd36-96cb-4213-bc04-95bcf3d89470 tempest-FloatingIPsTestJSON-1845688227 tempest-FloatingIPsTestJSON-1845688227-project] Returning 404 to user: Floating IP not found for ID 639d7caa-4b02-45fd-885f-aa7a58f6e2c9 {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:21:11.198178 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-851bcd36-96cb-4213-bc04-95bcf3d89470 tempest-FloatingIPsTestJSON-1845688227 tempest-FloatingIPsTestJSON-1845688227-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/639d7caa-4b02-45fd-885f-aa7a58f6e2c9" status: 404 len: 111 microversion: 2.1 time: 0.092367 Aug 07 01:21:11.199637 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1068/2421] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Aug 7 01:21:11 2022] DELETE /compute/v2.1/os-floating-ips/639d7caa-4b02-45fd-885f-aa7a58f6e2c9 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:21:11.325642 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1569a8a7-bec8-4753-af5c-3d7bd60a35b4 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:11.326322 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1569a8a7-bec8-4753-af5c-3d7bd60a35b4 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: ee42a97e-a680-4b64-bbfa-df12eba6dcde] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:11.329765 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:11.340850 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1569a8a7-bec8-4753-af5c-3d7bd60a35b4 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:11.348209 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1569a8a7-bec8-4753-af5c-3d7bd60a35b4 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:11.348791 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1569a8a7-bec8-4753-af5c-3d7bd60a35b4 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:11.349576 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1569a8a7-bec8-4753-af5c-3d7bd60a35b4 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:11.350060 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1569a8a7-bec8-4753-af5c-3d7bd60a35b4 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:11.350500 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1569a8a7-bec8-4753-af5c-3d7bd60a35b4 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:11.392700 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-50b0086c-bd11-4f96-9cb3-69c51a74490c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:11.420957 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-50b0086c-bd11-4f96-9cb3-69c51a74490c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:11.425921 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-50b0086c-bd11-4f96-9cb3-69c51a74490c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:11.429172 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-50b0086c-bd11-4f96-9cb3-69c51a74490c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 1813 microversion: 2.25 time: 0.370710 Aug 07 01:21:11.432347 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1354/2422] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:11 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 1813 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:21:11.573383 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d4f8eb05-66ca-412a-93b6-b3a61551bf9d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:11.574006 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d4f8eb05-66ca-412a-93b6-b3a61551bf9d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: c320acee-ca30-4e57-a35f-0f102d7cd7a5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:11.581992 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d4f8eb05-66ca-412a-93b6-b3a61551bf9d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:11.583395 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d4f8eb05-66ca-412a-93b6-b3a61551bf9d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:11.584138 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d4f8eb05-66ca-412a-93b6-b3a61551bf9d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:11.585587 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d4f8eb05-66ca-412a-93b6-b3a61551bf9d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:11.586264 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d4f8eb05-66ca-412a-93b6-b3a61551bf9d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:11.587399 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d4f8eb05-66ca-412a-93b6-b3a61551bf9d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:11.702622 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1569a8a7-bec8-4753-af5c-3d7bd60a35b4 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5041cbc4adc24ae8871d60064720d680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc8a87d755a42239e9d4572e4bf2f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:11.713620 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1569a8a7-bec8-4753-af5c-3d7bd60a35b4 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "GET /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde" status: 200 len: 1324 microversion: 2.1 time: 0.393085 Aug 07 01:21:11.720535 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1069/2423] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:11 2022] GET /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde => generated 1324 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:21:12.063963 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-672fd57d-ecf2-47c4-85cf-3e17134db6ee tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:12.065369 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-672fd57d-ecf2-47c4-85cf-3e17134db6ee tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] [instance: 76aa2198-b299-4359-b606-3b6afa2326fa] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:12.074034 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-672fd57d-ecf2-47c4-85cf-3e17134db6ee tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:12.074945 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-672fd57d-ecf2-47c4-85cf-3e17134db6ee tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:12.075597 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-672fd57d-ecf2-47c4-85cf-3e17134db6ee tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:12.076892 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-672fd57d-ecf2-47c4-85cf-3e17134db6ee tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:12.077899 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-672fd57d-ecf2-47c4-85cf-3e17134db6ee tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:12.078719 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-672fd57d-ecf2-47c4-85cf-3e17134db6ee tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:12.092953 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d4f8eb05-66ca-412a-93b6-b3a61551bf9d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:12.107571 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d4f8eb05-66ca-412a-93b6-b3a61551bf9d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5" status: 200 len: 1309 microversion: 2.1 time: 0.537400 Aug 07 01:21:12.113292 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1355/2424] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:11 2022] GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5 => generated 1309 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:21:12.461507 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9abaf772-b6fe-43a5-8859-0eb27db4e63a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:12.463129 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9abaf772-b6fe-43a5-8859-0eb27db4e63a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:12.465492 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-672fd57d-ecf2-47c4-85cf-3e17134db6ee tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4feb14c621b4090af8c965c9aaf0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06e7912f1fe423ea1b2a4bcdb90804a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:12.481210 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-672fd57d-ecf2-47c4-85cf-3e17134db6ee tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] 10.222.0.39 "GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa" status: 200 len: 1291 microversion: 2.1 time: 0.423292 Aug 07 01:21:12.482803 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9abaf772-b6fe-43a5-8859-0eb27db4e63a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:12.485703 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9abaf772-b6fe-43a5-8859-0eb27db4e63a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:12.486314 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9abaf772-b6fe-43a5-8859-0eb27db4e63a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:12.488177 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9abaf772-b6fe-43a5-8859-0eb27db4e63a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:12.491968 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9abaf772-b6fe-43a5-8859-0eb27db4e63a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:12.492884 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9abaf772-b6fe-43a5-8859-0eb27db4e63a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:12.497060 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1070/2425] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:12 2022] GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa => generated 1291 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:12.727177 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-d929d81f-5788-442c-b126-a602e61178f3 req-0273e319-c31c-4585-90cf-5cfe15483f9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c320acee-ca30-4e57-a35f-0f102d7cd7a5", "name": "network-vif-plugged", "status": "completed", "tag": "d263fe31-014b-4894-b46a-c776761e4287"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:12.738055 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d929d81f-5788-442c-b126-a602e61178f3 req-0273e319-c31c-4585-90cf-5cfe15483f9a service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:12.738814 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d929d81f-5788-442c-b126-a602e61178f3 req-0273e319-c31c-4585-90cf-5cfe15483f9a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:12.739404 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d929d81f-5788-442c-b126-a602e61178f3 req-0273e319-c31c-4585-90cf-5cfe15483f9a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:12.758829 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-d929d81f-5788-442c-b126-a602e61178f3 req-0273e319-c31c-4585-90cf-5cfe15483f9a service nova] Creating event network-vif-plugged:d263fe31-014b-4894-b46a-c776761e4287 for instance c320acee-ca30-4e57-a35f-0f102d7cd7a5 on n-h1-master-1 Aug 07 01:21:12.768643 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-d929d81f-5788-442c-b126-a602e61178f3 req-0273e319-c31c-4585-90cf-5cfe15483f9a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043843 Aug 07 01:21:12.769362 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1071/2426] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:21:12.780290 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a7447d3f-5cb0-40c8-9076-06fc4d2510c0 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:12.781248 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a7447d3f-5cb0-40c8-9076-06fc4d2510c0 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: ee42a97e-a680-4b64-bbfa-df12eba6dcde] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:12.788472 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a7447d3f-5cb0-40c8-9076-06fc4d2510c0 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:12.789243 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a7447d3f-5cb0-40c8-9076-06fc4d2510c0 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:12.789841 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a7447d3f-5cb0-40c8-9076-06fc4d2510c0 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:12.790720 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a7447d3f-5cb0-40c8-9076-06fc4d2510c0 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:12.791359 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a7447d3f-5cb0-40c8-9076-06fc4d2510c0 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:12.792096 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a7447d3f-5cb0-40c8-9076-06fc4d2510c0 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:13.174747 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9abaf772-b6fe-43a5-8859-0eb27db4e63a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:13.179617 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a7447d3f-5cb0-40c8-9076-06fc4d2510c0 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5041cbc4adc24ae8871d60064720d680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc8a87d755a42239e9d4572e4bf2f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:13.200462 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9abaf772-b6fe-43a5-8859-0eb27db4e63a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:13.200720 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a7447d3f-5cb0-40c8-9076-06fc4d2510c0 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "GET /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde" status: 200 len: 1520 microversion: 2.1 time: 0.424385 Aug 07 01:21:13.201676 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1072/2427] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:12 2022] GET /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde => generated 1520 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:13.206944 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9abaf772-b6fe-43a5-8859-0eb27db4e63a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:13.208500 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9abaf772-b6fe-43a5-8859-0eb27db4e63a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 1813 microversion: 2.25 time: 0.751578 Aug 07 01:21:13.209565 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-323ea8a3-c370-4926-be2b-f58773da7a9b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:13.210671 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-323ea8a3-c370-4926-be2b-f58773da7a9b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: c320acee-ca30-4e57-a35f-0f102d7cd7a5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:13.223560 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-323ea8a3-c370-4926-be2b-f58773da7a9b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:13.224449 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1356/2428] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:12 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 1813 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:21:13.225528 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-323ea8a3-c370-4926-be2b-f58773da7a9b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:13.227166 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-323ea8a3-c370-4926-be2b-f58773da7a9b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:13.228820 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-323ea8a3-c370-4926-be2b-f58773da7a9b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:13.230061 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-323ea8a3-c370-4926-be2b-f58773da7a9b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:13.234122 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-323ea8a3-c370-4926-be2b-f58773da7a9b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:13.237524 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-a6360afc-2df1-4219-b25d-2d0d2eee76ef req-9ac8a543-e18d-4c75-aa0f-6531c5979043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acc886e0-c989-4105-8375-0c42d4e96404", "name": "network-vif-unplugged", "status": "completed", "tag": "1758f50b-5f5d-4ffb-9893-9d21dc63f5bd"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:13.278713 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a6360afc-2df1-4219-b25d-2d0d2eee76ef req-9ac8a543-e18d-4c75-aa0f-6531c5979043 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:13.280403 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a6360afc-2df1-4219-b25d-2d0d2eee76ef req-9ac8a543-e18d-4c75-aa0f-6531c5979043 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:13.280962 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a6360afc-2df1-4219-b25d-2d0d2eee76ef req-9ac8a543-e18d-4c75-aa0f-6531c5979043 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:13.297270 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-a6360afc-2df1-4219-b25d-2d0d2eee76ef req-9ac8a543-e18d-4c75-aa0f-6531c5979043 service nova] Creating event network-vif-unplugged:1758f50b-5f5d-4ffb-9893-9d21dc63f5bd for instance acc886e0-c989-4105-8375-0c42d4e96404 on n-h1-master-1 Aug 07 01:21:13.302694 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-a6360afc-2df1-4219-b25d-2d0d2eee76ef req-9ac8a543-e18d-4c75-aa0f-6531c5979043 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076936 Aug 07 01:21:13.303510 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1357/2429] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:21:13.312135 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8e5f63eb-2300-463a-aa69-e86ac5b54b3c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Action: 'create', calling method: .version_select at 0x7f9e24024940>, body: {"pool": null} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:13.947317 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-323ea8a3-c370-4926-be2b-f58773da7a9b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:13.958861 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-323ea8a3-c370-4926-be2b-f58773da7a9b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5" status: 200 len: 1309 microversion: 2.1 time: 0.754857 Aug 07 01:21:13.960138 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1073/2430] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:13 2022] GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5 => generated 1309 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:14.008673 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-32c20a47-8219-436b-a23a-24f740933c30 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:14.009795 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-32c20a47-8219-436b-a23a-24f740933c30 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] [instance: 76aa2198-b299-4359-b606-3b6afa2326fa] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:14.026545 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-32c20a47-8219-436b-a23a-24f740933c30 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:14.027345 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-32c20a47-8219-436b-a23a-24f740933c30 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:14.028122 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-32c20a47-8219-436b-a23a-24f740933c30 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:14.032502 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-32c20a47-8219-436b-a23a-24f740933c30 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:14.033342 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-32c20a47-8219-436b-a23a-24f740933c30 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:14.033943 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-32c20a47-8219-436b-a23a-24f740933c30 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:14.380590 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-32c20a47-8219-436b-a23a-24f740933c30 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4feb14c621b4090af8c965c9aaf0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06e7912f1fe423ea1b2a4bcdb90804a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:14.390031 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-32c20a47-8219-436b-a23a-24f740933c30 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] 10.222.0.39 "GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa" status: 200 len: 1291 microversion: 2.1 time: 0.387081 Aug 07 01:21:14.408496 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1074/2431] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:13 2022] GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa => generated 1291 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:14.414656 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-071bcc02-634d-4b8d-813f-f805afca7e3b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:14.415500 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-071bcc02-634d-4b8d-813f-f805afca7e3b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:14.431657 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-071bcc02-634d-4b8d-813f-f805afca7e3b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:14.432233 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-071bcc02-634d-4b8d-813f-f805afca7e3b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:14.432652 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-071bcc02-634d-4b8d-813f-f805afca7e3b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:14.433552 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-071bcc02-634d-4b8d-813f-f805afca7e3b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:14.434185 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-071bcc02-634d-4b8d-813f-f805afca7e3b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:14.434772 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-071bcc02-634d-4b8d-813f-f805afca7e3b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:14.994279 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-071bcc02-634d-4b8d-813f-f805afca7e3b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:15.009881 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-071bcc02-634d-4b8d-813f-f805afca7e3b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:15.012986 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-071bcc02-634d-4b8d-813f-f805afca7e3b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:15.016168 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-071bcc02-634d-4b8d-813f-f805afca7e3b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 1813 microversion: 2.25 time: 0.606271 Aug 07 01:21:15.032167 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1075/2432] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:14 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 1813 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:15.040069 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-007a41dc-1f26-4e51-8eac-796d6980cb8d req-932404e5-be4c-4ee3-aa48-657629e4cd70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76aa2198-b299-4359-b606-3b6afa2326fa", "name": "network-vif-plugged", "status": "completed", "tag": "3ab32283-65ff-4a43-8b7d-5c9620395daa"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:15.055745 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-007a41dc-1f26-4e51-8eac-796d6980cb8d req-932404e5-be4c-4ee3-aa48-657629e4cd70 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:15.056637 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-007a41dc-1f26-4e51-8eac-796d6980cb8d req-932404e5-be4c-4ee3-aa48-657629e4cd70 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:15.057287 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-007a41dc-1f26-4e51-8eac-796d6980cb8d req-932404e5-be4c-4ee3-aa48-657629e4cd70 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:15.074927 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-007a41dc-1f26-4e51-8eac-796d6980cb8d req-932404e5-be4c-4ee3-aa48-657629e4cd70 service nova] Creating event network-vif-plugged:3ab32283-65ff-4a43-8b7d-5c9620395daa for instance 76aa2198-b299-4359-b606-3b6afa2326fa on n-h2-master-1 Aug 07 01:21:15.082903 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-007a41dc-1f26-4e51-8eac-796d6980cb8d req-932404e5-be4c-4ee3-aa48-657629e4cd70 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048934 Aug 07 01:21:15.085266 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1076/2433] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:21:15.099550 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-426021de-bd9b-4e57-8d0f-fd11a0b35f6a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:15.104108 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-426021de-bd9b-4e57-8d0f-fd11a0b35f6a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: c320acee-ca30-4e57-a35f-0f102d7cd7a5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:15.148191 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-426021de-bd9b-4e57-8d0f-fd11a0b35f6a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:15.149869 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-426021de-bd9b-4e57-8d0f-fd11a0b35f6a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:15.150336 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-426021de-bd9b-4e57-8d0f-fd11a0b35f6a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:15.151588 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-426021de-bd9b-4e57-8d0f-fd11a0b35f6a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:15.155700 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-426021de-bd9b-4e57-8d0f-fd11a0b35f6a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:15.157522 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-426021de-bd9b-4e57-8d0f-fd11a0b35f6a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:15.554313 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-426021de-bd9b-4e57-8d0f-fd11a0b35f6a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:15.569875 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-426021de-bd9b-4e57-8d0f-fd11a0b35f6a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5" status: 200 len: 1309 microversion: 2.1 time: 0.482517 Aug 07 01:21:15.572262 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1077/2434] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:15 2022] GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5 => generated 1309 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:15.591097 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-d1bf763f-b369-4539-aaa6-574594a2dcaf req-084e05d8-2bfd-4600-9712-73bf82026fba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acc886e0-c989-4105-8375-0c42d4e96404", "tag": "1758f50b-5f5d-4ffb-9893-9d21dc63f5bd"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:15.606333 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d1bf763f-b369-4539-aaa6-574594a2dcaf req-084e05d8-2bfd-4600-9712-73bf82026fba service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:15.608679 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d1bf763f-b369-4539-aaa6-574594a2dcaf req-084e05d8-2bfd-4600-9712-73bf82026fba service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:15.609447 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d1bf763f-b369-4539-aaa6-574594a2dcaf req-084e05d8-2bfd-4600-9712-73bf82026fba service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:15.628672 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-d1bf763f-b369-4539-aaa6-574594a2dcaf req-084e05d8-2bfd-4600-9712-73bf82026fba service nova] Creating event network-changed:1758f50b-5f5d-4ffb-9893-9d21dc63f5bd for instance acc886e0-c989-4105-8375-0c42d4e96404 on n-h1-master-1 Aug 07 01:21:15.635618 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-d1bf763f-b369-4539-aaa6-574594a2dcaf req-084e05d8-2bfd-4600-9712-73bf82026fba service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061236 Aug 07 01:21:15.638081 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1078/2435] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:21:15.646484 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6597b338-dc00-425f-885c-80bf9f7bf2af tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:15.648579 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6597b338-dc00-425f-885c-80bf9f7bf2af tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] [instance: 76aa2198-b299-4359-b606-3b6afa2326fa] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:15.656920 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6597b338-dc00-425f-885c-80bf9f7bf2af tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:15.657715 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6597b338-dc00-425f-885c-80bf9f7bf2af tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:15.658352 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6597b338-dc00-425f-885c-80bf9f7bf2af tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:15.659331 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6597b338-dc00-425f-885c-80bf9f7bf2af tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:15.660049 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6597b338-dc00-425f-885c-80bf9f7bf2af tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:15.660677 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6597b338-dc00-425f-885c-80bf9f7bf2af tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:15.899591 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6597b338-dc00-425f-885c-80bf9f7bf2af tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4feb14c621b4090af8c965c9aaf0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06e7912f1fe423ea1b2a4bcdb90804a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:15.912113 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6597b338-dc00-425f-885c-80bf9f7bf2af tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] 10.222.0.39 "GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa" status: 200 len: 1291 microversion: 2.1 time: 0.269345 Aug 07 01:21:15.913613 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1079/2436] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:15 2022] GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa => generated 1291 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:16.048360 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-84299771-53b4-4674-9522-9fd956432c9b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:16.049249 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-84299771-53b4-4674-9522-9fd956432c9b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:16.057010 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-84299771-53b4-4674-9522-9fd956432c9b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:16.058056 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-84299771-53b4-4674-9522-9fd956432c9b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:16.058413 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-84299771-53b4-4674-9522-9fd956432c9b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:16.059361 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-84299771-53b4-4674-9522-9fd956432c9b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:16.060527 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-84299771-53b4-4674-9522-9fd956432c9b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:16.061187 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-84299771-53b4-4674-9522-9fd956432c9b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:16.455662 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-84299771-53b4-4674-9522-9fd956432c9b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:16.465964 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-84299771-53b4-4674-9522-9fd956432c9b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:16.469513 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-84299771-53b4-4674-9522-9fd956432c9b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:16.471391 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-84299771-53b4-4674-9522-9fd956432c9b tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 1813 microversion: 2.25 time: 0.430427 Aug 07 01:21:16.473797 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1080/2437] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:16 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 1813 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:16.592717 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b578e8a0-6dac-4f14-8bce-045be9356b9f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:16.595430 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b578e8a0-6dac-4f14-8bce-045be9356b9f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: c320acee-ca30-4e57-a35f-0f102d7cd7a5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:16.606468 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b578e8a0-6dac-4f14-8bce-045be9356b9f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:16.606969 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b578e8a0-6dac-4f14-8bce-045be9356b9f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:16.607399 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b578e8a0-6dac-4f14-8bce-045be9356b9f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:16.611283 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b578e8a0-6dac-4f14-8bce-045be9356b9f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:16.612268 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b578e8a0-6dac-4f14-8bce-045be9356b9f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:16.614963 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b578e8a0-6dac-4f14-8bce-045be9356b9f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:16.870137 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b578e8a0-6dac-4f14-8bce-045be9356b9f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:16.896954 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b578e8a0-6dac-4f14-8bce-045be9356b9f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5" status: 200 len: 1490 microversion: 2.1 time: 0.304150 Aug 07 01:21:16.902619 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1081/2438] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:16 2022] GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5 => generated 1490 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:16.931873 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b4308bf1-5ed2-4ae1-bbd5-4d972c2b63b5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:16.939001 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b4308bf1-5ed2-4ae1-bbd5-4d972c2b63b5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: c320acee-ca30-4e57-a35f-0f102d7cd7a5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:16.961071 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b4308bf1-5ed2-4ae1-bbd5-4d972c2b63b5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:16.961934 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b4308bf1-5ed2-4ae1-bbd5-4d972c2b63b5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:16.962486 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b4308bf1-5ed2-4ae1-bbd5-4d972c2b63b5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:16.963554 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b4308bf1-5ed2-4ae1-bbd5-4d972c2b63b5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:16.964443 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b4308bf1-5ed2-4ae1-bbd5-4d972c2b63b5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:16.965234 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b4308bf1-5ed2-4ae1-bbd5-4d972c2b63b5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:17.144095 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b4308bf1-5ed2-4ae1-bbd5-4d972c2b63b5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "PUT /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5" status: 200 len: 1085 microversion: 2.1 time: 0.220072 Aug 07 01:21:17.145371 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1082/2439] 10.222.0.39 () {60 vars in 1256 bytes} [Sun Aug 7 01:21:16 2022] PUT /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5 => generated 1085 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:17.159247 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b300f163-3583-43c7-9a45-f410542f80d1 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:17.159861 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b300f163-3583-43c7-9a45-f410542f80d1 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] [instance: 76aa2198-b299-4359-b606-3b6afa2326fa] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:17.166570 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b300f163-3583-43c7-9a45-f410542f80d1 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:17.167517 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b300f163-3583-43c7-9a45-f410542f80d1 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:17.168200 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b300f163-3583-43c7-9a45-f410542f80d1 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:17.169393 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b300f163-3583-43c7-9a45-f410542f80d1 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:17.170598 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b300f163-3583-43c7-9a45-f410542f80d1 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:17.171239 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b300f163-3583-43c7-9a45-f410542f80d1 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:17.567604 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b300f163-3583-43c7-9a45-f410542f80d1 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4feb14c621b4090af8c965c9aaf0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06e7912f1fe423ea1b2a4bcdb90804a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:17.581103 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b300f163-3583-43c7-9a45-f410542f80d1 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] 10.222.0.39 "GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa" status: 200 len: 1483 microversion: 2.1 time: 0.434410 Aug 07 01:21:17.596505 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1083/2440] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:17 2022] GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa => generated 1483 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:17.602919 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-572f8db9-cab2-4727-9915-4b0645c003ff tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:17.603727 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-572f8db9-cab2-4727-9915-4b0645c003ff tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: c320acee-ca30-4e57-a35f-0f102d7cd7a5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:17.610994 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-572f8db9-cab2-4727-9915-4b0645c003ff tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:17.611803 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-572f8db9-cab2-4727-9915-4b0645c003ff tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:17.612938 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-572f8db9-cab2-4727-9915-4b0645c003ff tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:17.614298 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-572f8db9-cab2-4727-9915-4b0645c003ff tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:17.614957 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-572f8db9-cab2-4727-9915-4b0645c003ff tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:17.615584 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-572f8db9-cab2-4727-9915-4b0645c003ff tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:18.323520 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-572f8db9-cab2-4727-9915-4b0645c003ff tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:18.337851 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-572f8db9-cab2-4727-9915-4b0645c003ff tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5" status: 200 len: 1511 microversion: 2.1 time: 0.736758 Aug 07 01:21:18.338552 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1084/2441] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:17 2022] GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5 => generated 1511 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:18.352598 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8e140c85-2c18-435b-ae0a-0e3c6304b7f1 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:18.353101 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8e140c85-2c18-435b-ae0a-0e3c6304b7f1 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:18.372414 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8e140c85-2c18-435b-ae0a-0e3c6304b7f1 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:18.373369 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8e140c85-2c18-435b-ae0a-0e3c6304b7f1 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:18.376350 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8e140c85-2c18-435b-ae0a-0e3c6304b7f1 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:18.377949 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8e140c85-2c18-435b-ae0a-0e3c6304b7f1 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:18.379862 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8e140c85-2c18-435b-ae0a-0e3c6304b7f1 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:18.381016 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8e140c85-2c18-435b-ae0a-0e3c6304b7f1 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:18.922796 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8e5f63eb-2300-463a-aa69-e86ac5b54b3c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.617729 Aug 07 01:21:18.938402 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1358/2442] 10.222.0.39 () {60 vars in 1170 bytes} [Sun Aug 7 01:21:13 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:21:18.946192 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0ca5bb54-c1e3-4d2d-8d9c-434b32b87c85 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:18.951973 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0ca5bb54-c1e3-4d2d-8d9c-434b32b87c85 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] [instance: 76aa2198-b299-4359-b606-3b6afa2326fa] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:18.976527 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ca5bb54-c1e3-4d2d-8d9c-434b32b87c85 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:18.980926 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ca5bb54-c1e3-4d2d-8d9c-434b32b87c85 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:18.982087 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ca5bb54-c1e3-4d2d-8d9c-434b32b87c85 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:18.984522 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ca5bb54-c1e3-4d2d-8d9c-434b32b87c85 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:18.986410 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ca5bb54-c1e3-4d2d-8d9c-434b32b87c85 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:18.990583 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ca5bb54-c1e3-4d2d-8d9c-434b32b87c85 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:19.137849 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0ca5bb54-c1e3-4d2d-8d9c-434b32b87c85 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] 10.222.0.39 "GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.197175 Aug 07 01:21:19.138979 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1359/2443] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Aug 7 01:21:18 2022] GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa/os-interface => generated 285 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:21:19.145473 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8dd88d59-0e22-4030-b516-3af79d7f52bd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:19.146506 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8dd88d59-0e22-4030-b516-3af79d7f52bd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: c320acee-ca30-4e57-a35f-0f102d7cd7a5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:19.158421 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8dd88d59-0e22-4030-b516-3af79d7f52bd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:19.159147 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8dd88d59-0e22-4030-b516-3af79d7f52bd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:19.159837 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8dd88d59-0e22-4030-b516-3af79d7f52bd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:19.160865 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8dd88d59-0e22-4030-b516-3af79d7f52bd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:19.161596 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8dd88d59-0e22-4030-b516-3af79d7f52bd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:19.162242 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8dd88d59-0e22-4030-b516-3af79d7f52bd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:19.680108 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8dd88d59-0e22-4030-b516-3af79d7f52bd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:19.692337 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8dd88d59-0e22-4030-b516-3af79d7f52bd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5" status: 200 len: 1511 microversion: 2.1 time: 0.551478 Aug 07 01:21:19.693637 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1360/2444] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:19 2022] GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5 => generated 1511 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:19.705742 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3611b0e4-1c4b-4f12-a3c6-9233cd3c489a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-859343066", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "6c5c235e-c2e8-41e7-9759-0dbd7d7d0e8a"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:19.784870 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8e140c85-2c18-435b-ae0a-0e3c6304b7f1 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:19.785412 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-3611b0e4-1c4b-4f12-a3c6-9233cd3c489a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] validate_networks() for [('6c5c235e-c2e8-41e7-9759-0dbd7d7d0e8a', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:21:19.789907 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:19.836205 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8e140c85-2c18-435b-ae0a-0e3c6304b7f1 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:19.881403 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8e140c85-2c18-435b-ae0a-0e3c6304b7f1 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:19.886880 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8e140c85-2c18-435b-ae0a-0e3c6304b7f1 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 1813 microversion: 2.25 time: 1.544617 Aug 07 01:21:19.897896 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1085/2445] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:18 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 1813 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:19.918207 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-450415b0-54ae-43cb-bcb0-b96c722db43b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:19.925497 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-450415b0-54ae-43cb-bcb0-b96c722db43b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: c320acee-ca30-4e57-a35f-0f102d7cd7a5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:19.943367 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-450415b0-54ae-43cb-bcb0-b96c722db43b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:19.944897 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-450415b0-54ae-43cb-bcb0-b96c722db43b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:19.948458 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-450415b0-54ae-43cb-bcb0-b96c722db43b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:19.949477 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-450415b0-54ae-43cb-bcb0-b96c722db43b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:19.953961 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-450415b0-54ae-43cb-bcb0-b96c722db43b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:19.956255 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-450415b0-54ae-43cb-bcb0-b96c722db43b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:20.017310 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-450415b0-54ae-43cb-bcb0-b96c722db43b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: c320acee-ca30-4e57-a35f-0f102d7cd7a5] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:21:20.167076 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-450415b0-54ae-43cb-bcb0-b96c722db43b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5" status: 204 len: 0 microversion: 2.1 time: 0.267546 Aug 07 01:21:20.168433 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1086/2446] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:21:19 2022] DELETE /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:21:20.179642 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7bd5574c-72e8-434c-be12-a70bcb9609b7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:20.180719 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7bd5574c-72e8-434c-be12-a70bcb9609b7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: c320acee-ca30-4e57-a35f-0f102d7cd7a5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:20.215182 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7bd5574c-72e8-434c-be12-a70bcb9609b7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:20.215963 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7bd5574c-72e8-434c-be12-a70bcb9609b7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:20.216798 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7bd5574c-72e8-434c-be12-a70bcb9609b7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:20.218383 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7bd5574c-72e8-434c-be12-a70bcb9609b7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:20.219193 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7bd5574c-72e8-434c-be12-a70bcb9609b7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:20.219973 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7bd5574c-72e8-434c-be12-a70bcb9609b7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:20.701052 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7bd5574c-72e8-434c-be12-a70bcb9609b7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:20.708941 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7bd5574c-72e8-434c-be12-a70bcb9609b7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5" status: 200 len: 1517 microversion: 2.1 time: 0.535750 Aug 07 01:21:20.723502 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1087/2447] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:20 2022] GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5 => generated 1517 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:20.916016 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cbb054ad-f1df-4735-8baa-c3369cdffd6a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:20.916716 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-cbb054ad-f1df-4735-8baa-c3369cdffd6a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:20.922852 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cbb054ad-f1df-4735-8baa-c3369cdffd6a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:20.923338 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cbb054ad-f1df-4735-8baa-c3369cdffd6a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:20.923787 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cbb054ad-f1df-4735-8baa-c3369cdffd6a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:20.924570 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cbb054ad-f1df-4735-8baa-c3369cdffd6a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:20.925020 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cbb054ad-f1df-4735-8baa-c3369cdffd6a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:20.925442 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cbb054ad-f1df-4735-8baa-c3369cdffd6a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:21.422196 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-cbb054ad-f1df-4735-8baa-c3369cdffd6a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:21.464847 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-cbb054ad-f1df-4735-8baa-c3369cdffd6a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:21.467438 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-cbb054ad-f1df-4735-8baa-c3369cdffd6a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:21.469198 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-3611b0e4-1c4b-4f12-a3c6-9233cd3c489a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:21:21.470793 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cbb054ad-f1df-4735-8baa-c3369cdffd6a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 1813 microversion: 2.25 time: 0.557693 Aug 07 01:21:21.485598 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-3611b0e4-1c4b-4f12-a3c6-9233cd3c489a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:21:21.485598 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-3611b0e4-1c4b-4f12-a3c6-9233cd3c489a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:21:21.486127 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1088/2448] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:20 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 1813 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:21:21.486220 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-3611b0e4-1c4b-4f12-a3c6-9233cd3c489a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:21:21.486220 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-3611b0e4-1c4b-4f12-a3c6-9233cd3c489a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:21:21.496591 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3611b0e4-1c4b-4f12-a3c6-9233cd3c489a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:21.497097 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3611b0e4-1c4b-4f12-a3c6-9233cd3c489a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:21.497616 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3611b0e4-1c4b-4f12-a3c6-9233cd3c489a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:21.498877 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3611b0e4-1c4b-4f12-a3c6-9233cd3c489a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:21.499341 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3611b0e4-1c4b-4f12-a3c6-9233cd3c489a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:21.499776 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3611b0e4-1c4b-4f12-a3c6-9233cd3c489a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:21.538393 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-3611b0e4-1c4b-4f12-a3c6-9233cd3c489a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Getting quotas for project afc8a87d755a42239e9d4572e4bf2f2d. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:21:21.551152 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-3611b0e4-1c4b-4f12-a3c6-9233cd3c489a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Getting quotas for user 5041cbc4adc24ae8871d60064720d680 and project afc8a87d755a42239e9d4572e4bf2f2d. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:21:21.581253 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3611b0e4-1c4b-4f12-a3c6-9233cd3c489a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:21:21.583552 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3611b0e4-1c4b-4f12-a3c6-9233cd3c489a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: aa4e1c13-c268-4138-ad4e-8627558931bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:21:21.663823 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3611b0e4-1c4b-4f12-a3c6-9233cd3c489a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.967435 Aug 07 01:21:21.668049 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1361/2449] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:21:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:21:21.678749 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6327e637-b943-4943-81f4-57792e76ab51 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:21.679377 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6327e637-b943-4943-81f4-57792e76ab51 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: aa4e1c13-c268-4138-ad4e-8627558931bf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:21.738270 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-006d813f-9bf8-43a1-aa8c-848afae6e45d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:21.740911 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-006d813f-9bf8-43a1-aa8c-848afae6e45d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: c320acee-ca30-4e57-a35f-0f102d7cd7a5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:21.757515 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-006d813f-9bf8-43a1-aa8c-848afae6e45d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:21.764864 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-006d813f-9bf8-43a1-aa8c-848afae6e45d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:21.765519 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-006d813f-9bf8-43a1-aa8c-848afae6e45d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:21.766452 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-006d813f-9bf8-43a1-aa8c-848afae6e45d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:21.771702 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-006d813f-9bf8-43a1-aa8c-848afae6e45d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:21.772679 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-006d813f-9bf8-43a1-aa8c-848afae6e45d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:21.865554 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6327e637-b943-4943-81f4-57792e76ab51 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5041cbc4adc24ae8871d60064720d680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc8a87d755a42239e9d4572e4bf2f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:21.874101 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6327e637-b943-4943-81f4-57792e76ab51 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4e1c13-c268-4138-ad4e-8627558931bf" status: 200 len: 1223 microversion: 2.1 time: 0.199351 Aug 07 01:21:21.894496 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1089/2450] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:21 2022] GET /compute/v2.1/servers/aa4e1c13-c268-4138-ad4e-8627558931bf => generated 1223 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:22.369271 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-006d813f-9bf8-43a1-aa8c-848afae6e45d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:22.384701 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-006d813f-9bf8-43a1-aa8c-848afae6e45d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5" status: 200 len: 1517 microversion: 2.1 time: 0.655199 Aug 07 01:21:22.386021 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1362/2451] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:21 2022] GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5 => generated 1517 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:22.496701 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b24cb7d8-3c7b-436a-8f28-3eea91dd7af5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:22.497390 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b24cb7d8-3c7b-436a-8f28-3eea91dd7af5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:22.513861 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b24cb7d8-3c7b-436a-8f28-3eea91dd7af5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:22.516587 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b24cb7d8-3c7b-436a-8f28-3eea91dd7af5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:22.518176 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b24cb7d8-3c7b-436a-8f28-3eea91dd7af5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:22.520169 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b24cb7d8-3c7b-436a-8f28-3eea91dd7af5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:22.520829 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b24cb7d8-3c7b-436a-8f28-3eea91dd7af5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:22.522634 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b24cb7d8-3c7b-436a-8f28-3eea91dd7af5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:22.830330 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-811e2646-d9a9-4971-ad67-ea8447244f28 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:22.831376 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-811e2646-d9a9-4971-ad67-ea8447244f28 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] [instance: 76aa2198-b299-4359-b606-3b6afa2326fa] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:22.866527 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-811e2646-d9a9-4971-ad67-ea8447244f28 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:22.867042 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-811e2646-d9a9-4971-ad67-ea8447244f28 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:22.870828 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-811e2646-d9a9-4971-ad67-ea8447244f28 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:22.874214 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-811e2646-d9a9-4971-ad67-ea8447244f28 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:22.874742 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-811e2646-d9a9-4971-ad67-ea8447244f28 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:22.875195 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-811e2646-d9a9-4971-ad67-ea8447244f28 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:23.642801 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b24cb7d8-3c7b-436a-8f28-3eea91dd7af5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:23.656736 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b24cb7d8-3c7b-436a-8f28-3eea91dd7af5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:23.661855 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b24cb7d8-3c7b-436a-8f28-3eea91dd7af5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:23.667290 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b24cb7d8-3c7b-436a-8f28-3eea91dd7af5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 1813 microversion: 2.25 time: 1.171886 Aug 07 01:21:23.670601 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1090/2452] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:22 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 1813 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:23.688052 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-7e91077a-9e22-4308-a142-225989de85e1 req-0b8d14b4-6549-4665-82c0-f67519ec934d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76aa2198-b299-4359-b606-3b6afa2326fa", "tag": "3ab32283-65ff-4a43-8b7d-5c9620395daa"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:23.739091 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-7e91077a-9e22-4308-a142-225989de85e1 req-0b8d14b4-6549-4665-82c0-f67519ec934d service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:23.739584 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-7e91077a-9e22-4308-a142-225989de85e1 req-0b8d14b4-6549-4665-82c0-f67519ec934d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:23.746318 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-7e91077a-9e22-4308-a142-225989de85e1 req-0b8d14b4-6549-4665-82c0-f67519ec934d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:23.793251 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-7e91077a-9e22-4308-a142-225989de85e1 req-0b8d14b4-6549-4665-82c0-f67519ec934d service nova] Creating event network-changed:3ab32283-65ff-4a43-8b7d-5c9620395daa for instance 76aa2198-b299-4359-b606-3b6afa2326fa on n-h2-master-1 Aug 07 01:21:23.822603 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-7e91077a-9e22-4308-a142-225989de85e1 req-0b8d14b4-6549-4665-82c0-f67519ec934d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150420 Aug 07 01:21:23.823233 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1091/2453] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:21:23.855824 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cc0ad730-d067-493f-9684-55831bdeba9e tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:23.858996 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-cc0ad730-d067-493f-9684-55831bdeba9e tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: aa4e1c13-c268-4138-ad4e-8627558931bf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:23.886066 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc0ad730-d067-493f-9684-55831bdeba9e tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:23.889754 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc0ad730-d067-493f-9684-55831bdeba9e tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:23.891257 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc0ad730-d067-493f-9684-55831bdeba9e tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:23.895562 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc0ad730-d067-493f-9684-55831bdeba9e tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:23.898123 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc0ad730-d067-493f-9684-55831bdeba9e tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:23.899452 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc0ad730-d067-493f-9684-55831bdeba9e tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:24.439325 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-811e2646-d9a9-4971-ad67-ea8447244f28 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4feb14c621b4090af8c965c9aaf0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06e7912f1fe423ea1b2a4bcdb90804a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:24.450128 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-811e2646-d9a9-4971-ad67-ea8447244f28 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] 10.222.0.39 "GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa" status: 200 len: 1483 microversion: 2.1 time: 1.626821 Aug 07 01:21:24.456451 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1363/2454] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:22 2022] GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa => generated 1483 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:24.466821 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7d8da132-61d0-4f42-a10a-8820ffc575bd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:24.469973 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7d8da132-61d0-4f42-a10a-8820ffc575bd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: c320acee-ca30-4e57-a35f-0f102d7cd7a5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:24.486542 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d8da132-61d0-4f42-a10a-8820ffc575bd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:24.487031 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d8da132-61d0-4f42-a10a-8820ffc575bd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:24.487475 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d8da132-61d0-4f42-a10a-8820ffc575bd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:24.488243 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d8da132-61d0-4f42-a10a-8820ffc575bd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:24.488701 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d8da132-61d0-4f42-a10a-8820ffc575bd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:24.494638 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d8da132-61d0-4f42-a10a-8820ffc575bd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:24.782213 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-cc0ad730-d067-493f-9684-55831bdeba9e tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5041cbc4adc24ae8871d60064720d680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc8a87d755a42239e9d4572e4bf2f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:24.802069 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cc0ad730-d067-493f-9684-55831bdeba9e tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4e1c13-c268-4138-ad4e-8627558931bf" status: 200 len: 1293 microversion: 2.1 time: 0.971348 Aug 07 01:21:24.802968 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1092/2455] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:23 2022] GET /compute/v2.1/servers/aa4e1c13-c268-4138-ad4e-8627558931bf => generated 1293 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:24.807986 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3bdbbe11-a449-4efb-8eac-d85fe25988eb tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:24.808616 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3bdbbe11-a449-4efb-8eac-d85fe25988eb tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:24.828908 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3bdbbe11-a449-4efb-8eac-d85fe25988eb tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:24.829500 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3bdbbe11-a449-4efb-8eac-d85fe25988eb tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:24.829974 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3bdbbe11-a449-4efb-8eac-d85fe25988eb tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:24.833082 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3bdbbe11-a449-4efb-8eac-d85fe25988eb tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:24.833612 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3bdbbe11-a449-4efb-8eac-d85fe25988eb tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:24.834069 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3bdbbe11-a449-4efb-8eac-d85fe25988eb tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:25.053612 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7d8da132-61d0-4f42-a10a-8820ffc575bd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:25.067764 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7d8da132-61d0-4f42-a10a-8820ffc575bd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5" status: 200 len: 1517 microversion: 2.1 time: 0.609726 Aug 07 01:21:25.068518 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1364/2456] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:24 2022] GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5 => generated 1517 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:25.415754 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3bdbbe11-a449-4efb-8eac-d85fe25988eb tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:25.475968 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3bdbbe11-a449-4efb-8eac-d85fe25988eb tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:25.478471 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3bdbbe11-a449-4efb-8eac-d85fe25988eb tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:25.481607 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3bdbbe11-a449-4efb-8eac-d85fe25988eb tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 1813 microversion: 2.25 time: 0.677474 Aug 07 01:21:25.485090 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1093/2457] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:24 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 1813 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:25.828368 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5bbd7de6-e97a-42f3-a59a-a63d1841284c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:25.829672 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5bbd7de6-e97a-42f3-a59a-a63d1841284c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: aa4e1c13-c268-4138-ad4e-8627558931bf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:25.871381 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5bbd7de6-e97a-42f3-a59a-a63d1841284c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:25.871945 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5bbd7de6-e97a-42f3-a59a-a63d1841284c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:25.872410 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5bbd7de6-e97a-42f3-a59a-a63d1841284c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:25.880451 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5bbd7de6-e97a-42f3-a59a-a63d1841284c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:25.882094 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5bbd7de6-e97a-42f3-a59a-a63d1841284c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:25.887064 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5bbd7de6-e97a-42f3-a59a-a63d1841284c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:26.095131 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c2d7cd29-feab-45c8-bfde-5fe7f629ea1c tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:26.095806 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c2d7cd29-feab-45c8-bfde-5fe7f629ea1c tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: c320acee-ca30-4e57-a35f-0f102d7cd7a5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:26.119075 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2d7cd29-feab-45c8-bfde-5fe7f629ea1c tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:26.119578 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2d7cd29-feab-45c8-bfde-5fe7f629ea1c tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:26.122235 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2d7cd29-feab-45c8-bfde-5fe7f629ea1c tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:26.123051 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2d7cd29-feab-45c8-bfde-5fe7f629ea1c tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:26.123526 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2d7cd29-feab-45c8-bfde-5fe7f629ea1c tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:26.123991 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2d7cd29-feab-45c8-bfde-5fe7f629ea1c tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:26.272088 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2d7cd29-feab-45c8-bfde-5fe7f629ea1c tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:26.272844 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2d7cd29-feab-45c8-bfde-5fe7f629ea1c tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:26.273290 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2d7cd29-feab-45c8-bfde-5fe7f629ea1c tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:26.278664 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-c2d7cd29-feab-45c8-bfde-5fe7f629ea1c tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lazy-loading 'fault' on Instance uuid c320acee-ca30-4e57-a35f-0f102d7cd7a5 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:21:26.401889 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c2d7cd29-feab-45c8-bfde-5fe7f629ea1c tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:26.422732 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c2d7cd29-feab-45c8-bfde-5fe7f629ea1c tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5" status: 200 len: 1320 microversion: 2.1 time: 0.332694 Aug 07 01:21:26.423825 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1094/2458] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:26 2022] GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5 => generated 1320 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:26.429021 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-d9255c2e-b160-48d1-a5e8-facca5e08a5f req-7109726b-55ea-4222-8dbd-3a71acefe2ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c320acee-ca30-4e57-a35f-0f102d7cd7a5", "name": "network-vif-deleted", "tag": "d263fe31-014b-4894-b46a-c776761e4287"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:26.479213 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d9255c2e-b160-48d1-a5e8-facca5e08a5f req-7109726b-55ea-4222-8dbd-3a71acefe2ce service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:26.479704 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d9255c2e-b160-48d1-a5e8-facca5e08a5f req-7109726b-55ea-4222-8dbd-3a71acefe2ce service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:26.480169 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d9255c2e-b160-48d1-a5e8-facca5e08a5f req-7109726b-55ea-4222-8dbd-3a71acefe2ce service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:26.517297 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-d9255c2e-b160-48d1-a5e8-facca5e08a5f req-7109726b-55ea-4222-8dbd-3a71acefe2ce service nova] Creating event network-vif-deleted:d263fe31-014b-4894-b46a-c776761e4287 for instance c320acee-ca30-4e57-a35f-0f102d7cd7a5 on n-h1-master-1 Aug 07 01:21:26.539767 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-d9255c2e-b160-48d1-a5e8-facca5e08a5f req-7109726b-55ea-4222-8dbd-3a71acefe2ce service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113879 Aug 07 01:21:26.543786 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1095/2459] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:21:26.590045 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-11df7679-ef47-47c7-a2da-3494a4192a56 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:26.593691 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-11df7679-ef47-47c7-a2da-3494a4192a56 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:26.618716 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-11df7679-ef47-47c7-a2da-3494a4192a56 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:26.619629 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-11df7679-ef47-47c7-a2da-3494a4192a56 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:26.623105 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-11df7679-ef47-47c7-a2da-3494a4192a56 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:26.625214 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-11df7679-ef47-47c7-a2da-3494a4192a56 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:26.625827 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-11df7679-ef47-47c7-a2da-3494a4192a56 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:26.627169 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-11df7679-ef47-47c7-a2da-3494a4192a56 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:26.704003 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5bbd7de6-e97a-42f3-a59a-a63d1841284c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5041cbc4adc24ae8871d60064720d680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc8a87d755a42239e9d4572e4bf2f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:26.740295 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5bbd7de6-e97a-42f3-a59a-a63d1841284c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4e1c13-c268-4138-ad4e-8627558931bf" status: 200 len: 1281 microversion: 2.1 time: 0.914618 Aug 07 01:21:26.743767 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1365/2460] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:25 2022] GET /compute/v2.1/servers/aa4e1c13-c268-4138-ad4e-8627558931bf => generated 1281 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:27.124379 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-11df7679-ef47-47c7-a2da-3494a4192a56 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:27.140450 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-11df7679-ef47-47c7-a2da-3494a4192a56 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:27.145945 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-11df7679-ef47-47c7-a2da-3494a4192a56 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:27.149070 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-11df7679-ef47-47c7-a2da-3494a4192a56 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 1813 microversion: 2.25 time: 0.582064 Aug 07 01:21:27.152922 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1096/2461] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:26 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 1813 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:27.448835 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b2f5538b-6825-46c1-b66c-318e0f6b6ce7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:27.449456 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b2f5538b-6825-46c1-b66c-318e0f6b6ce7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: c320acee-ca30-4e57-a35f-0f102d7cd7a5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:27.460871 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2f5538b-6825-46c1-b66c-318e0f6b6ce7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:27.461338 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2f5538b-6825-46c1-b66c-318e0f6b6ce7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:27.464905 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2f5538b-6825-46c1-b66c-318e0f6b6ce7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:27.466018 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2f5538b-6825-46c1-b66c-318e0f6b6ce7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:27.467775 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2f5538b-6825-46c1-b66c-318e0f6b6ce7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:27.473725 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2f5538b-6825-46c1-b66c-318e0f6b6ce7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:27.508542 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-b2f5538b-6825-46c1-b66c-318e0f6b6ce7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] HTTP exception thrown: Instance c320acee-ca30-4e57-a35f-0f102d7cd7a5 could not be found. Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b2f5538b-6825-46c1-b66c-318e0f6b6ce7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Request method failure captured: Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5 HTTP/1.1 Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xLZuMLvQ88KTsXpEnT0I-tjdBFOm7EEtVmBSoi3hGbagLa-WCqW3nJreDc3WwTe1tbLbMC3xnpg15asRoKTlUvK3aMhcihww2F0hywjkHPX3fkbbtMYbGiIT_pGesW2tpqp2g11Pwb-WDA3oTL-VeLkmCHA0u8DPW_SmhTlX9-nF08 Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersTestJSON-576619186 Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_efad066360cb45b3a6e9ba872118ea57", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersTestJSON-576619186 Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersTestJSON-576619186 Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersTestJSON-576619186-project Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d4f7282c7251455086368d5274a4fac5 Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersTestJSON-576619186-project Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: exception: Instance c320acee-ca30-4e57-a35f-0f102d7cd7a5 could not be found. Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'c320acee-ca30-4e57-a35f-0f102d7cd7a5'} Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c320acee-ca30-4e57-a35f-0f102d7cd7a5 could not be found. Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c320acee-ca30-4e57-a35f-0f102d7cd7a5 could not be found. Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:27.510870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:27.515015 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:21:27.515015 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:21:27.515015 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:21:27.515015 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:21:27.515015 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c320acee-ca30-4e57-a35f-0f102d7cd7a5 could not be found. Aug 07 01:21:27.515015 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:27.519364 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b2f5538b-6825-46c1-b66c-318e0f6b6ce7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Returning 404 to user: Instance c320acee-ca30-4e57-a35f-0f102d7cd7a5 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:21:27.520662 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b2f5538b-6825-46c1-b66c-318e0f6b6ce7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5" status: 404 len: 111 microversion: 2.1 time: 0.075698 Aug 07 01:21:27.535665 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1097/2462] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:27 2022] GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:21:27.598848 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b46563cc-253f-4b8b-8274-ea060625b7b8 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] Action: 'create', calling method: .version_select at 0x7f9e24074b80>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPAMyxcvkL3DNixYsmVrJ4F2ouUBbQ83p9bwpzV8CrL25L0WXAv9ee9YmT+xyHiI8QpcmOhKEhHafIIxVBrtdOfO3XrZldnCkK/THp+utpIBlb3XM/+TbGSeA+v2eQFTg=="}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b46563cc-253f-4b8b-8274-ea060625b7b8 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] Request method failure captured: Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 257 Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xOXRuAz4HmPc-PnMLvD7eiUAGshysSnszpYDEZnK8PlN1BAEBsJVONrN0T1dIK54y7K3Sx_66NuxOX8zJXaOiTO2PZa2lHKIHuy5MOfcB4GY7vCP6G3pjQsPrYDTWWNM3vBXQLWyBW4XPV5Grou8QLG42GPtjsgDfRInrJ0senD3h0 Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: b1211639a253415b8f764c77aeabb276 Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-483282951 Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b1211639a253415b8f764c77aeabb276"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b1211639a253415b8f764c77aeabb276", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b1211639a253415b8f764c77aeabb276"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b1211639a253415b8f764c77aeabb276"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-KeyPairsNegativeTestJSON-483282951 Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: b1211639a253415b8f764c77aeabb276 Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-483282951 Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-KeyPairsNegativeTestJSON-483282951-project Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 69bdc46e9aa540d4ad74e47f57543306 Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-KeyPairsNegativeTestJSON-483282951-project Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPAMyxcvkL3DNixYsmVrJ4F2ouUBbQ83p9bwpzV8CrL25L0WXAv9ee9YmT+xyHiI8QpcmOhKEhHafIIxVBrtdOfO3XrZldnCkK/THp+utpIBlb3XM/+TbGSeA+v2eQFTg=="}} Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPAMyxcvkL3DNixYsmVrJ4F2ouUBbQ83p9bwpzV8CrL25L0WXAv9ee9YmT+xyHiI8QpcmOhKEhHafIIxVBrtdOfO3XrZldnCkK/THp+utpIBlb3XM/+TbGSeA+v2eQFTg=='}}} Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 07 01:21:27.624118 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:21:27.631355 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:21:27.631355 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:21:27.631355 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:27.631355 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:21:27.631355 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:21:27.631355 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:21:27.631355 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:21:27.631355 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:21:27.631355 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:21:27.631355 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:21:27.631355 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:21:27.631355 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:21:27.631355 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:21:27.631355 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:21:27.631355 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:21:27.631355 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:21:27.631355 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:21:27.631355 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:21:27.631355 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:21:27.631355 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 07 01:21:27.631355 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:21:27.631355 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:21:27.631355 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:21:27.631355 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:27.631355 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:21:27.631355 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:21:27.631355 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:21:27.631355 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:21:27.631355 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 07 01:21:27.631355 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:21:27.631355 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b46563cc-253f-4b8b-8274-ea060625b7b8 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:21:27.631355 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b46563cc-253f-4b8b-8274-ea060625b7b8 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.366828 Aug 07 01:21:27.640711 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1366/2463] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:21:27 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 378 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:21:27.640878 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d0f24264-07a0-48b5-a00e-a7ed06abf505 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] Action: 'create', calling method: .version_select at 0x7f9e240d7790>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-957993408", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:27.688676 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-d0f24264-07a0-48b5-a00e-a7ed06abf505 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] Getting quotas for project b1211639a253415b8f764c77aeabb276. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:21:27.710838 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-d0f24264-07a0-48b5-a00e-a7ed06abf505 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] Getting quotas for user 69bdc46e9aa540d4ad74e47f57543306 and project b1211639a253415b8f764c77aeabb276. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:21:27.724733 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-437d1fd8-cdb2-4bb7-b0b2-8632f26e0805 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2021620729", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "339d8f21-b38d-49c3-8efe-8ffee4d616dc"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:27.752751 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-d0f24264-07a0-48b5-a00e-a7ed06abf505 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 07 01:21:27.786165 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d0f24264-07a0-48b5-a00e-a7ed06abf505 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] Request method failure captured: Aug 07 01:21:27.786165 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 07 01:21:27.786165 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:21:27.786165 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:21:27.786165 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:21:27.786165 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 2166 Aug 07 01:21:27.786165 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:21:27.786165 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:21:27.786165 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:21:27.786165 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:21:27.786165 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xOXRuAz4HmPc-PnMLvD7eiUAGshysSnszpYDEZnK8PlN1BAEBsJVONrN0T1dIK54y7K3Sx_66NuxOX8zJXaOiTO2PZa2lHKIHuy5MOfcB4GY7vCP6G3pjQsPrYDTWWNM3vBXQLWyBW4XPV5Grou8QLG42GPtjsgDfRInrJ0senD3h0 Aug 07 01:21:27.786165 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:21:27.786165 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:21:27.786165 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:21:27.786165 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:21:27.786165 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:21:27.786165 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:21:27.786165 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: b1211639a253415b8f764c77aeabb276 Aug 07 01:21:27.786165 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-483282951 Aug 07 01:21:27.786165 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:21:27.786165 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:21:27.786165 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b1211639a253415b8f764c77aeabb276"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b1211639a253415b8f764c77aeabb276", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b1211639a253415b8f764c77aeabb276"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b1211639a253415b8f764c77aeabb276"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:21:27.786165 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-KeyPairsNegativeTestJSON-483282951 Aug 07 01:21:27.786165 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: b1211639a253415b8f764c77aeabb276 Aug 07 01:21:27.786165 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-483282951 Aug 07 01:21:27.786165 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-KeyPairsNegativeTestJSON-483282951-project Aug 07 01:21:27.786165 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:21:27.786165 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:21:27.786165 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 69bdc46e9aa540d4ad74e47f57543306 Aug 07 01:21:27.786165 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-KeyPairsNegativeTestJSON-483282951-project Aug 07 01:21:27.786165 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:21:27.786165 n-d-master-1 devstack@n-api.service[119517]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-957993408", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 07 01:21:27.786165 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:21:27.786165 n-d-master-1 devstack@n-api.service[119517]: exception: Keypair data is invalid: failed to generate fingerprint Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-957993408', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6727, in import_key_pair Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6800, in _generate_fingerprint Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:21:27.788202 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:21:27.791451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:21:27.791451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:21:27.791451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:21:27.791451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:21:27.791451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 07 01:21:27.791451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 07 01:21:27.791451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 07 01:21:27.791451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 07 01:21:27.791451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 07 01:21:27.791451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:27.791451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:21:27.791451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:27.791451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:27.791451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:21:27.791451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:21:27.791451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:21:27.791451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:21:27.791451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 07 01:21:27.791451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:27.791451 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d0f24264-07a0-48b5-a00e-a7ed06abf505 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:21:27.791451 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d0f24264-07a0-48b5-a00e-a7ed06abf505 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.155777 Aug 07 01:21:27.791451 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1098/2464] 10.222.0.39 () {60 vars in 1160 bytes} [Sun Aug 7 01:21:27 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 157 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 07 01:21:27.813185 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4b01385d-b41d-4033-b540-79f3a14b5d8b tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:27.814645 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4b01385d-b41d-4033-b540-79f3a14b5d8b tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: aa4e1c13-c268-4138-ad4e-8627558931bf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:27.840468 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b01385d-b41d-4033-b540-79f3a14b5d8b tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:27.840972 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b01385d-b41d-4033-b540-79f3a14b5d8b tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:27.841421 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b01385d-b41d-4033-b540-79f3a14b5d8b tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:27.842747 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b01385d-b41d-4033-b540-79f3a14b5d8b tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:27.843209 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b01385d-b41d-4033-b540-79f3a14b5d8b tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:27.844091 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b01385d-b41d-4033-b540-79f3a14b5d8b tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:27.849974 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-437d1fd8-cdb2-4bb7-b0b2-8632f26e0805 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] validate_networks() for [('339d8f21-b38d-49c3-8efe-8ffee4d616dc', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:21:28.243790 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4b01385d-b41d-4033-b540-79f3a14b5d8b tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5041cbc4adc24ae8871d60064720d680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc8a87d755a42239e9d4572e4bf2f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:28.268276 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4b01385d-b41d-4033-b540-79f3a14b5d8b tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4e1c13-c268-4138-ad4e-8627558931bf" status: 200 len: 1323 microversion: 2.1 time: 0.471665 Aug 07 01:21:28.280118 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1099/2465] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:27 2022] GET /compute/v2.1/servers/aa4e1c13-c268-4138-ad4e-8627558931bf => generated 1323 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:28.325656 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6cd1519f-4482-4eb5-8942-786b0b083f91 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] Action: 'create', calling method: .version_select at 0x7f9e2409d310>, body: {"keypair": {"name": "tempest-keypair-885902599", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtbGUkKEQRwFZwgpureEDjIbY9lZ8LKc35KrYtzItxP29/0CcYu3OR3a0cdVacgBwUxj0XgfjsSCKDNgSy50hKr/B1anXYmWvNoskLNZ7Eu8QYPVg+ytGBHJ9aRojqHXw=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:28.370533 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-6cd1519f-4482-4eb5-8942-786b0b083f91 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] Getting quotas for project b1211639a253415b8f764c77aeabb276. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:21:28.383863 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-6cd1519f-4482-4eb5-8942-786b0b083f91 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] Getting quotas for user 69bdc46e9aa540d4ad74e47f57543306 and project b1211639a253415b8f764c77aeabb276. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:21:28.426552 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6cd1519f-4482-4eb5-8942-786b0b083f91 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.144810 Aug 07 01:21:28.428000 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1100/2466] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:21:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:21:28.441518 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-79ac5a4b-e650-4f1b-a673-860fe9636c29 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:28.442171 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-79ac5a4b-e650-4f1b-a673-860fe9636c29 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:28.449053 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-79ac5a4b-e650-4f1b-a673-860fe9636c29 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:28.449834 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-79ac5a4b-e650-4f1b-a673-860fe9636c29 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:28.450464 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-79ac5a4b-e650-4f1b-a673-860fe9636c29 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:28.451800 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-79ac5a4b-e650-4f1b-a673-860fe9636c29 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:28.452294 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-79ac5a4b-e650-4f1b-a673-860fe9636c29 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:28.452839 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-79ac5a4b-e650-4f1b-a673-860fe9636c29 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:28.817572 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-79ac5a4b-e650-4f1b-a673-860fe9636c29 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:28.836080 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-79ac5a4b-e650-4f1b-a673-860fe9636c29 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:28.838194 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-79ac5a4b-e650-4f1b-a673-860fe9636c29 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:28.839576 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-79ac5a4b-e650-4f1b-a673-860fe9636c29 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 1813 microversion: 2.25 time: 0.410539 Aug 07 01:21:28.840391 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1101/2467] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:28 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 1813 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:28.848539 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ac60fb7c-f316-4315-9e14-48313d385e22 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] Action: 'create', calling method: .version_select at 0x7f9e242363a0>, body: {"keypair": {"name": "tempest-keypair-885902599", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzVgKsjfKVgXDWD5wA0yw/BIFvJxsGJd+g03LTvjuL7go/j1Rhny3r7vmo1EUTpkxKFZOILbKVGo9AhH092OvuuRPQI4ApoU2fyV+QSnTi6pv1ApIX3/45gNfLTIPfg6Q=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:28.868365 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-ac60fb7c-f316-4315-9e14-48313d385e22 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] Getting quotas for project b1211639a253415b8f764c77aeabb276. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:21:28.874254 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-ac60fb7c-f316-4315-9e14-48313d385e22 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] Getting quotas for user 69bdc46e9aa540d4ad74e47f57543306 and project b1211639a253415b8f764c77aeabb276. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:21:28.877622 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:28.906225 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-ac60fb7c-f316-4315-9e14-48313d385e22 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] HTTP exception thrown: Key pair 'tempest-keypair-885902599' already exists. Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ac60fb7c-f316-4315-9e14-48313d385e22 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] Request method failure captured: Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 272 Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xOXRuAz4HmPc-PnMLvD7eiUAGshysSnszpYDEZnK8PlN1BAEBsJVONrN0T1dIK54y7K3Sx_66NuxOX8zJXaOiTO2PZa2lHKIHuy5MOfcB4GY7vCP6G3pjQsPrYDTWWNM3vBXQLWyBW4XPV5Grou8QLG42GPtjsgDfRInrJ0senD3h0 Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: b1211639a253415b8f764c77aeabb276 Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-483282951 Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b1211639a253415b8f764c77aeabb276"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b1211639a253415b8f764c77aeabb276", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b1211639a253415b8f764c77aeabb276"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b1211639a253415b8f764c77aeabb276"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-KeyPairsNegativeTestJSON-483282951 Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: b1211639a253415b8f764c77aeabb276 Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-483282951 Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-KeyPairsNegativeTestJSON-483282951-project Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 69bdc46e9aa540d4ad74e47f57543306 Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-KeyPairsNegativeTestJSON-483282951-project Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: {"keypair": {"name": "tempest-keypair-885902599", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzVgKsjfKVgXDWD5wA0yw/BIFvJxsGJd+g03LTvjuL7go/j1Rhny3r7vmo1EUTpkxKFZOILbKVGo9AhH092OvuuRPQI4ApoU2fyV+QSnTi6pv1ApIX3/45gNfLTIPfg6Q=="}} Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: exception: Key pair 'tempest-keypair-885902599' already exists. Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-885902599', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzVgKsjfKVgXDWD5wA0yw/BIFvJxsGJd+g03LTvjuL7go/j1Rhny3r7vmo1EUTpkxKFZOILbKVGo9AhH092OvuuRPQI4ApoU2fyV+QSnTi6pv1ApIX3/45gNfLTIPfg6Q=='}}} Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result.read() Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '69bdc46e9aa540d4ad74e47f57543306-tempest-keypair-885902599' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 07 01:21:28.914523 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi session.flush() Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result.read() Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 07 01:21:28.919164 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '69bdc46e9aa540d4ad74e47f57543306-tempest-keypair-885902599' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 7, 1, 21, 28, 898724), 'updated_at': None, 'name': 'tempest-keypair-885902599', 'user_id': '69bdc46e9aa540d4ad74e47f57543306', 'fingerprint': '45:c4:4d:b5:e3:48:84:3e:b3:f3:93:6a:5b:b0:d9:3f', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzVgKsjfKVgXDWD5wA0yw/BIFvJxsGJd+g03LTvjuL7go/j1Rhny3r7vmo1EUTpkxKFZOILbKVGo9AhH092OvuuRPQI4ApoU2fyV+QSnTi6pv1ApIX3/45gNfLTIPfg6Q==', 'type': 'ssh'}] Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6730, in import_key_pair Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi keypair.create() Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._create() Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-885902599' already exists. Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 07 01:21:28.927383 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-885902599' already exists. Aug 07 01:21:28.934000 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:28.934000 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:21:28.934000 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:28.934000 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:28.934000 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:21:28.934000 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:21:28.934000 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:21:28.934000 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:21:28.934000 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-885902599' already exists. Aug 07 01:21:28.934000 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:28.934000 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ac60fb7c-f316-4315-9e14-48313d385e22 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] Returning 409 to user: Key pair 'tempest-keypair-885902599' already exists. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:21:28.934000 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ac60fb7c-f316-4315-9e14-48313d385e22 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.084803 Aug 07 01:21:28.934000 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1102/2468] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:21:28 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 86 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:21:28.941886 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e1e1dd22-59a8-4ad2-bc87-ac83dd715541 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] Calling method '.version_select at 0x7f9e17eaf3a0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:28.969915 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e1e1dd22-59a8-4ad2-bc87-ac83dd715541 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-885902599" status: 202 len: 0 microversion: 2.1 time: 0.033592 Aug 07 01:21:28.970507 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1103/2469] 10.222.0.39 () {58 vars in 1218 bytes} [Sun Aug 7 01:21:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-885902599 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:21:28.990683 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c204af8c-e122-4227-819e-cf12c1536b02 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] Action: 'create', calling method: .version_select at 0x7f9e240068b0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTTTMnOOmGwsoLPxGQlBH8AheyVLLdstOwh5y+dmVUOD/7i3jG2S+dk2goW+ylmgMcoy6e+3T3jFt+UXuhx/U3e2g0nx50tWORrmS97MczymIeAs1cWhyj4K1gMfNK8Bw=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c204af8c-e122-4227-819e-cf12c1536b02 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] Request method failure captured: Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 247 Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xOXRuAz4HmPc-PnMLvD7eiUAGshysSnszpYDEZnK8PlN1BAEBsJVONrN0T1dIK54y7K3Sx_66NuxOX8zJXaOiTO2PZa2lHKIHuy5MOfcB4GY7vCP6G3pjQsPrYDTWWNM3vBXQLWyBW4XPV5Grou8QLG42GPtjsgDfRInrJ0senD3h0 Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: b1211639a253415b8f764c77aeabb276 Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-483282951 Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b1211639a253415b8f764c77aeabb276"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b1211639a253415b8f764c77aeabb276", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b1211639a253415b8f764c77aeabb276"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b1211639a253415b8f764c77aeabb276"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-KeyPairsNegativeTestJSON-483282951 Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: b1211639a253415b8f764c77aeabb276 Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-483282951 Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-KeyPairsNegativeTestJSON-483282951-project Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 69bdc46e9aa540d4ad74e47f57543306 Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-KeyPairsNegativeTestJSON-483282951-project Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTTTMnOOmGwsoLPxGQlBH8AheyVLLdstOwh5y+dmVUOD/7i3jG2S+dk2goW+ylmgMcoy6e+3T3jFt+UXuhx/U3e2g0nx50tWORrmS97MczymIeAs1cWhyj4K1gMfNK8Bw=="}} Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTTTMnOOmGwsoLPxGQlBH8AheyVLLdstOwh5y+dmVUOD/7i3jG2S+dk2goW+ylmgMcoy6e+3T3jFt+UXuhx/U3e2g0nx50tWORrmS97MczymIeAs1cWhyj4K1gMfNK8Bw=='}}} Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi '' Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:21:28.997243 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:21:29.004637 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:21:29.004637 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:21:29.004637 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:21:29.004637 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:21:29.004637 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 07 01:21:29.004637 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:29.004637 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:21:29.004637 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:29.004637 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:29.004637 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:21:29.004637 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:21:29.004637 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:21:29.004637 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:21:29.004637 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 07 01:21:29.004637 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:29.004637 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c204af8c-e122-4227-819e-cf12c1536b02 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:21:29.004637 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c204af8c-e122-4227-819e-cf12c1536b02 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.013538 Aug 07 01:21:29.007048 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1104/2470] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:21:28 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:21:29.010103 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2136ea5c-4683-41c1-9a76-d93774987ec2 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] Action: 'create', calling method: .version_select at 0x7f9e240ffc10>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1391182353", "public_key": " "}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:29.034026 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-2136ea5c-4683-41c1-9a76-d93774987ec2 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] Getting quotas for project b1211639a253415b8f764c77aeabb276. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:21:29.040425 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-2136ea5c-4683-41c1-9a76-d93774987ec2 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] Getting quotas for user 69bdc46e9aa540d4ad74e47f57543306 and project b1211639a253415b8f764c77aeabb276. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:21:29.062283 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-2136ea5c-4683-41c1-9a76-d93774987ec2 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2136ea5c-4683-41c1-9a76-d93774987ec2 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] Request method failure captured: Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 95 Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xOXRuAz4HmPc-PnMLvD7eiUAGshysSnszpYDEZnK8PlN1BAEBsJVONrN0T1dIK54y7K3Sx_66NuxOX8zJXaOiTO2PZa2lHKIHuy5MOfcB4GY7vCP6G3pjQsPrYDTWWNM3vBXQLWyBW4XPV5Grou8QLG42GPtjsgDfRInrJ0senD3h0 Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: b1211639a253415b8f764c77aeabb276 Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-483282951 Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b1211639a253415b8f764c77aeabb276"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b1211639a253415b8f764c77aeabb276", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b1211639a253415b8f764c77aeabb276"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b1211639a253415b8f764c77aeabb276"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-KeyPairsNegativeTestJSON-483282951 Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: b1211639a253415b8f764c77aeabb276 Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-483282951 Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-KeyPairsNegativeTestJSON-483282951-project Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 69bdc46e9aa540d4ad74e47f57543306 Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-KeyPairsNegativeTestJSON-483282951-project Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1391182353", "public_key": " "}} Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: exception: Keypair data is invalid: failed to generate fingerprint Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1391182353', 'public_key': ' '}}} Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6727, in import_key_pair Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6800, in _generate_fingerprint Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:21:29.064354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:29.075297 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:29.075297 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:21:29.075297 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:21:29.075297 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:21:29.075297 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:21:29.075297 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:21:29.075297 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:21:29.075297 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:21:29.075297 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:21:29.075297 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:21:29.075297 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:21:29.075297 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:21:29.075297 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:21:29.075297 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 07 01:21:29.075297 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 07 01:21:29.075297 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 07 01:21:29.075297 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 07 01:21:29.075297 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 07 01:21:29.075297 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:29.075297 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:21:29.075297 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:29.075297 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:29.075297 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:21:29.075297 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:21:29.075297 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:21:29.075297 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:21:29.075297 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 07 01:21:29.075297 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:29.075297 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2136ea5c-4683-41c1-9a76-d93774987ec2 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:21:29.075297 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2136ea5c-4683-41c1-9a76-d93774987ec2 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.060789 Aug 07 01:21:29.075297 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1105/2471] 10.222.0.39 () {60 vars in 1158 bytes} [Sun Aug 7 01:21:29 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 62 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 07 01:21:29.083297 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f8423866-77c3-4253-9d2a-1cb6b6f4fd56 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] Action: 'create', calling method: .version_select at 0x7f9e240ff4c0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBc9orlb42GPkbNQZL10nSwWI2ye5kPuhOmjkLU1VlbZw00xvrFx7rS21jkpdoOHysl9VRDowMz17ztS8SumP289CyFOPRq8Kv1lDc6KDJQn/JLIw9kuNLsPgAeCUp2j+g=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f8423866-77c3-4253-9d2a-1cb6b6f4fd56 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] Request method failure captured: Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 507 Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xOXRuAz4HmPc-PnMLvD7eiUAGshysSnszpYDEZnK8PlN1BAEBsJVONrN0T1dIK54y7K3Sx_66NuxOX8zJXaOiTO2PZa2lHKIHuy5MOfcB4GY7vCP6G3pjQsPrYDTWWNM3vBXQLWyBW4XPV5Grou8QLG42GPtjsgDfRInrJ0senD3h0 Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: b1211639a253415b8f764c77aeabb276 Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-483282951 Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b1211639a253415b8f764c77aeabb276"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b1211639a253415b8f764c77aeabb276", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b1211639a253415b8f764c77aeabb276"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b1211639a253415b8f764c77aeabb276"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-KeyPairsNegativeTestJSON-483282951 Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: b1211639a253415b8f764c77aeabb276 Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-483282951 Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-KeyPairsNegativeTestJSON-483282951-project Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 69bdc46e9aa540d4ad74e47f57543306 Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-KeyPairsNegativeTestJSON-483282951-project Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBc9orlb42GPkbNQZL10nSwWI2ye5kPuhOmjkLU1VlbZw00xvrFx7rS21jkpdoOHysl9VRDowMz17ztS8SumP289CyFOPRq8Kv1lDc6KDJQn/JLIw9kuNLsPgAeCUp2j+g=="}} Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBc9orlb42GPkbNQZL10nSwWI2ye5kPuhOmjkLU1VlbZw00xvrFx7rS21jkpdoOHysl9VRDowMz17ztS8SumP289CyFOPRq8Kv1lDc6KDJQn/JLIw9kuNLsPgAeCUp2j+g=='}}} Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 07 01:21:29.088055 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 07 01:21:29.098290 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:29.098290 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:21:29.098290 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:29.098290 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:29.098290 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:21:29.098290 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:21:29.098290 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:21:29.098290 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:21:29.098290 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:21:29.098290 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:21:29.098290 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:21:29.098290 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:21:29.098290 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:21:29.098290 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:21:29.098290 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:21:29.098290 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:21:29.098290 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:21:29.098290 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:21:29.098290 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:21:29.098290 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:21:29.098290 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 07 01:21:29.098290 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:29.098290 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:21:29.098290 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:29.098290 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:29.098290 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:21:29.098290 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:21:29.098290 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:21:29.098290 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:21:29.098290 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 07 01:21:29.098290 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:29.098290 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f8423866-77c3-4253-9d2a-1cb6b6f4fd56 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:21:29.098290 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f8423866-77c3-4253-9d2a-1cb6b6f4fd56 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.013762 Aug 07 01:21:29.098290 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1106/2472] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:21:29 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:21:29.103276 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bfdcc183-d913-49b0-8e7f-72fb92deffaf tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] Action: 'create', calling method: .version_select at 0x7f9e240068b0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-349679638", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:29.125525 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-bfdcc183-d913-49b0-8e7f-72fb92deffaf tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] Getting quotas for project b1211639a253415b8f764c77aeabb276. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:21:29.132035 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-bfdcc183-d913-49b0-8e7f-72fb92deffaf tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] Getting quotas for user 69bdc46e9aa540d4ad74e47f57543306 and project b1211639a253415b8f764c77aeabb276. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:21:29.150783 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-bfdcc183-d913-49b0-8e7f-72fb92deffaf tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bfdcc183-d913-49b0-8e7f-72fb92deffaf tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] Request method failure captured: Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 117 Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xOXRuAz4HmPc-PnMLvD7eiUAGshysSnszpYDEZnK8PlN1BAEBsJVONrN0T1dIK54y7K3Sx_66NuxOX8zJXaOiTO2PZa2lHKIHuy5MOfcB4GY7vCP6G3pjQsPrYDTWWNM3vBXQLWyBW4XPV5Grou8QLG42GPtjsgDfRInrJ0senD3h0 Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: b1211639a253415b8f764c77aeabb276 Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-483282951 Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b1211639a253415b8f764c77aeabb276"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b1211639a253415b8f764c77aeabb276", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b1211639a253415b8f764c77aeabb276"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b1211639a253415b8f764c77aeabb276"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-KeyPairsNegativeTestJSON-483282951 Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: b1211639a253415b8f764c77aeabb276 Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-483282951 Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-KeyPairsNegativeTestJSON-483282951-project Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 69bdc46e9aa540d4ad74e47f57543306 Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-KeyPairsNegativeTestJSON-483282951-project Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-349679638", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: exception: Keypair data is invalid: failed to generate fingerprint Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-349679638', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6727, in import_key_pair Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6800, in _generate_fingerprint Aug 07 01:21:29.152956 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 07 01:21:29.162573 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 07 01:21:29.162573 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 07 01:21:29.162573 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 07 01:21:29.162573 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:29.162573 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:21:29.162573 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:29.162573 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:29.162573 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:21:29.162573 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:21:29.162573 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:21:29.162573 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:21:29.162573 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:21:29.162573 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:21:29.162573 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:21:29.162573 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:21:29.162573 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:21:29.162573 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:21:29.162573 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:21:29.162573 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:21:29.162573 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 07 01:21:29.162573 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 07 01:21:29.162573 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 07 01:21:29.162573 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 07 01:21:29.162573 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 07 01:21:29.162573 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:29.162573 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:21:29.162573 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:29.162573 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:29.162573 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:21:29.162573 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:21:29.162573 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:21:29.162573 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:21:29.162573 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 07 01:21:29.162573 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:29.162573 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bfdcc183-d913-49b0-8e7f-72fb92deffaf tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:21:29.162573 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bfdcc183-d913-49b0-8e7f-72fb92deffaf tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.057660 Aug 07 01:21:29.162573 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1107/2473] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:21:29 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 07 01:21:29.168408 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c75047d7-1261-4bed-b0ea-bea99ba70f62 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] Calling method '.version_select at 0x7f9e242363a0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:29.180240 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-c75047d7-1261-4bed-b0ea-bea99ba70f62 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1830166234 not found for user 69bdc46e9aa540d4ad74e47f57543306 Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c75047d7-1261-4bed-b0ea-bea99ba70f62 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] Request method failure captured: Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1830166234 HTTP/1.1 Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xOXRuAz4HmPc-PnMLvD7eiUAGshysSnszpYDEZnK8PlN1BAEBsJVONrN0T1dIK54y7K3Sx_66NuxOX8zJXaOiTO2PZa2lHKIHuy5MOfcB4GY7vCP6G3pjQsPrYDTWWNM3vBXQLWyBW4XPV5Grou8QLG42GPtjsgDfRInrJ0senD3h0 Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: b1211639a253415b8f764c77aeabb276 Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-483282951 Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b1211639a253415b8f764c77aeabb276"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b1211639a253415b8f764c77aeabb276", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b1211639a253415b8f764c77aeabb276"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b1211639a253415b8f764c77aeabb276"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-KeyPairsNegativeTestJSON-483282951 Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: b1211639a253415b8f764c77aeabb276 Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-483282951 Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-KeyPairsNegativeTestJSON-483282951-project Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 69bdc46e9aa540d4ad74e47f57543306 Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-KeyPairsNegativeTestJSON-483282951-project Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: exception: Keypair tempest-keypair-non-existent-1830166234 not found for user 69bdc46e9aa540d4ad74e47f57543306 Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'tempest-keypair-non-existent-1830166234'} Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise self.value Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6814, in delete_key_pair Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6835, in get_key_pair Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1830166234 not found for user 69bdc46e9aa540d4ad74e47f57543306 Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:29.182304 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:21:29.186470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:29.186470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:29.186470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:21:29.186470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:21:29.186470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:21:29.186470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:21:29.186470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:21:29.186470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:21:29.186470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 07 01:21:29.186470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:21:29.186470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:21:29.186470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:21:29.186470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 07 01:21:29.186470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 07 01:21:29.186470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 07 01:21:29.186470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 07 01:21:29.186470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1830166234 not found for user 69bdc46e9aa540d4ad74e47f57543306 Aug 07 01:21:29.186470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:29.186470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:21:29.186470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:29.186470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:21:29.186470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:21:29.186470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:21:29.186470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:21:29.186470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:21:29.186470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1830166234 not found for user 69bdc46e9aa540d4ad74e47f57543306 Aug 07 01:21:29.186470 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:21:29.186470 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c75047d7-1261-4bed-b0ea-bea99ba70f62 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1830166234 not found for user 69bdc46e9aa540d4ad74e47f57543306 {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:21:29.186470 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c75047d7-1261-4bed-b0ea-bea99ba70f62 tempest-KeyPairsNegativeTestJSON-483282951 tempest-KeyPairsNegativeTestJSON-483282951-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1830166234" status: 404 len: 145 microversion: 2.1 time: 0.022519 Aug 07 01:21:29.186470 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1108/2474] 10.222.0.39 () {58 vars in 1260 bytes} [Sun Aug 7 01:21:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1830166234 => generated 145 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:21:29.302312 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ed15c131-d705-416c-8c24-c93a2f3ed514 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:29.302974 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ed15c131-d705-416c-8c24-c93a2f3ed514 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: aa4e1c13-c268-4138-ad4e-8627558931bf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:29.320601 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed15c131-d705-416c-8c24-c93a2f3ed514 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:29.322286 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed15c131-d705-416c-8c24-c93a2f3ed514 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:29.322737 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed15c131-d705-416c-8c24-c93a2f3ed514 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:29.323482 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed15c131-d705-416c-8c24-c93a2f3ed514 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:29.323963 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed15c131-d705-416c-8c24-c93a2f3ed514 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:29.324439 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed15c131-d705-416c-8c24-c93a2f3ed514 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:29.536481 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ed15c131-d705-416c-8c24-c93a2f3ed514 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5041cbc4adc24ae8871d60064720d680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc8a87d755a42239e9d4572e4bf2f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:29.565874 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ed15c131-d705-416c-8c24-c93a2f3ed514 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4e1c13-c268-4138-ad4e-8627558931bf" status: 200 len: 1323 microversion: 2.1 time: 0.274893 Aug 07 01:21:29.566960 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1109/2475] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:29 2022] GET /compute/v2.1/servers/aa4e1c13-c268-4138-ad4e-8627558931bf => generated 1323 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:21:29.868361 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7b02bd02-a999-41b2-9b70-14c663f4fd5a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:29.869502 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7b02bd02-a999-41b2-9b70-14c663f4fd5a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:29.879901 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b02bd02-a999-41b2-9b70-14c663f4fd5a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:29.881178 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b02bd02-a999-41b2-9b70-14c663f4fd5a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:29.882671 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b02bd02-a999-41b2-9b70-14c663f4fd5a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:29.884099 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b02bd02-a999-41b2-9b70-14c663f4fd5a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:29.885960 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b02bd02-a999-41b2-9b70-14c663f4fd5a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:29.886697 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b02bd02-a999-41b2-9b70-14c663f4fd5a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:30.111570 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-437d1fd8-cdb2-4bb7-b0b2-8632f26e0805 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:21:30.113886 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-437d1fd8-cdb2-4bb7-b0b2-8632f26e0805 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:21:30.118034 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-437d1fd8-cdb2-4bb7-b0b2-8632f26e0805 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:21:30.118827 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-437d1fd8-cdb2-4bb7-b0b2-8632f26e0805 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:21:30.120487 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-437d1fd8-cdb2-4bb7-b0b2-8632f26e0805 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:21:30.132323 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:30.141766 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-437d1fd8-cdb2-4bb7-b0b2-8632f26e0805 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:30.142290 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-437d1fd8-cdb2-4bb7-b0b2-8632f26e0805 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:30.142814 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-437d1fd8-cdb2-4bb7-b0b2-8632f26e0805 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:30.143535 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-437d1fd8-cdb2-4bb7-b0b2-8632f26e0805 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:30.144132 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-437d1fd8-cdb2-4bb7-b0b2-8632f26e0805 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:30.144563 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-437d1fd8-cdb2-4bb7-b0b2-8632f26e0805 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:30.176619 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-437d1fd8-cdb2-4bb7-b0b2-8632f26e0805 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Getting quotas for project efad066360cb45b3a6e9ba872118ea57. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:21:30.182857 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-437d1fd8-cdb2-4bb7-b0b2-8632f26e0805 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Getting quotas for user d4f7282c7251455086368d5274a4fac5 and project efad066360cb45b3a6e9ba872118ea57. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:21:30.199074 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-437d1fd8-cdb2-4bb7-b0b2-8632f26e0805 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:21:30.203343 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-437d1fd8-cdb2-4bb7-b0b2-8632f26e0805 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: b8da873d-12c6-4107-bb72-49b6cef897e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:21:30.265873 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-437d1fd8-cdb2-4bb7-b0b2-8632f26e0805 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.545609 Aug 07 01:21:30.267282 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1367/2476] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:21:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:21:30.280475 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1a4b751a-975a-48f2-9058-9f28023460b2 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:30.281469 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1a4b751a-975a-48f2-9058-9f28023460b2 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: b8da873d-12c6-4107-bb72-49b6cef897e1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:30.571096 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1a4b751a-975a-48f2-9058-9f28023460b2 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:30.592798 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1a4b751a-975a-48f2-9058-9f28023460b2 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1" status: 200 len: 1209 microversion: 2.1 time: 0.316679 Aug 07 01:21:30.613263 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1368/2477] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:30 2022] GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1 => generated 1209 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:30.627476 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bb0ebcf6-f792-41e1-8cf2-b436586bc673 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:30.633553 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bb0ebcf6-f792-41e1-8cf2-b436586bc673 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: aa4e1c13-c268-4138-ad4e-8627558931bf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:30.662687 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb0ebcf6-f792-41e1-8cf2-b436586bc673 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:30.663207 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb0ebcf6-f792-41e1-8cf2-b436586bc673 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:30.664034 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb0ebcf6-f792-41e1-8cf2-b436586bc673 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:30.664970 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb0ebcf6-f792-41e1-8cf2-b436586bc673 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:30.665645 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb0ebcf6-f792-41e1-8cf2-b436586bc673 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:30.666259 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb0ebcf6-f792-41e1-8cf2-b436586bc673 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:30.840741 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7b02bd02-a999-41b2-9b70-14c663f4fd5a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:30.858599 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7b02bd02-a999-41b2-9b70-14c663f4fd5a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:30.873828 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7b02bd02-a999-41b2-9b70-14c663f4fd5a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:30.875223 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7b02bd02-a999-41b2-9b70-14c663f4fd5a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 1803 microversion: 2.25 time: 1.012682 Aug 07 01:21:30.876046 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1110/2478] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:29 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 1803 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:30.906804 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c3b97d50-f839-4013-87af-3e1e5fd9e3c5 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Calling method '.version_select at 0x7f9e24006820>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:30.910776 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3b97d50-f839-4013-87af-3e1e5fd9e3c5 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:30.911273 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3b97d50-f839-4013-87af-3e1e5fd9e3c5 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:30.911720 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3b97d50-f839-4013-87af-3e1e5fd9e3c5 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:30.941827 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c3b97d50-f839-4013-87af-3e1e5fd9e3c5 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 1524 microversion: 2.25 time: 0.040119 Aug 07 01:21:30.942791 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1111/2479] 10.222.0.39 () {60 vars in 1184 bytes} [Sun Aug 7 01:21:30 2022] GET /compute/v2.1/os-migrations => generated 1524 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:30.959039 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b99b6479-9a00-4113-bd0e-b95e62e9b6dc tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:30.959704 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b99b6479-9a00-4113-bd0e-b95e62e9b6dc tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:30.989224 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b99b6479-9a00-4113-bd0e-b95e62e9b6dc tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:30.989735 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b99b6479-9a00-4113-bd0e-b95e62e9b6dc tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:30.990179 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b99b6479-9a00-4113-bd0e-b95e62e9b6dc tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:30.990909 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b99b6479-9a00-4113-bd0e-b95e62e9b6dc tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:30.991369 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b99b6479-9a00-4113-bd0e-b95e62e9b6dc tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:30.991807 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b99b6479-9a00-4113-bd0e-b95e62e9b6dc tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:31.512440 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-b99b6479-9a00-4113-bd0e-b95e62e9b6dc tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lazy-loading 'services' on Instance uuid acc886e0-c989-4105-8375-0c42d4e96404 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:21:31.518995 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:31.538833 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b99b6479-9a00-4113-bd0e-b95e62e9b6dc tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 2422 microversion: 2.25 time: 0.583438 Aug 07 01:21:31.540404 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1112/2480] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:30 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 2422 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:31.547152 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-225f37e7-ae6c-4bbd-8785-97746d3ae770 req-38ca52d3-fb0c-47d9-b743-495ebedb8963 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa4e1c13-c268-4138-ad4e-8627558931bf", "tag": "e962044b-2b07-4716-b16b-df9c45e8c3d9"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:31.574444 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-225f37e7-ae6c-4bbd-8785-97746d3ae770 req-38ca52d3-fb0c-47d9-b743-495ebedb8963 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:31.575503 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-225f37e7-ae6c-4bbd-8785-97746d3ae770 req-38ca52d3-fb0c-47d9-b743-495ebedb8963 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:31.576572 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-225f37e7-ae6c-4bbd-8785-97746d3ae770 req-38ca52d3-fb0c-47d9-b743-495ebedb8963 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:31.593003 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-225f37e7-ae6c-4bbd-8785-97746d3ae770 req-38ca52d3-fb0c-47d9-b743-495ebedb8963 service nova] Creating event network-changed:e962044b-2b07-4716-b16b-df9c45e8c3d9 for instance aa4e1c13-c268-4138-ad4e-8627558931bf on n-h2-master-1 Aug 07 01:21:31.597880 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bb0ebcf6-f792-41e1-8cf2-b436586bc673 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5041cbc4adc24ae8871d60064720d680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc8a87d755a42239e9d4572e4bf2f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:31.599326 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-225f37e7-ae6c-4bbd-8785-97746d3ae770 req-38ca52d3-fb0c-47d9-b743-495ebedb8963 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056652 Aug 07 01:21:31.600025 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1113/2481] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:21:31.605726 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e11eca43-18f4-4edc-9dfa-a625d75b975c tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:31.606725 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e11eca43-18f4-4edc-9dfa-a625d75b975c tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:31.614735 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e11eca43-18f4-4edc-9dfa-a625d75b975c tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:31.615733 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e11eca43-18f4-4edc-9dfa-a625d75b975c tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:31.619186 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bb0ebcf6-f792-41e1-8cf2-b436586bc673 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4e1c13-c268-4138-ad4e-8627558931bf" status: 200 len: 1323 microversion: 2.1 time: 1.003878 Aug 07 01:21:31.620016 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1369/2482] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:30 2022] GET /compute/v2.1/servers/aa4e1c13-c268-4138-ad4e-8627558931bf => generated 1323 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:31.621407 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e11eca43-18f4-4edc-9dfa-a625d75b975c tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:31.622443 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e11eca43-18f4-4edc-9dfa-a625d75b975c tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:31.623612 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e11eca43-18f4-4edc-9dfa-a625d75b975c tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:31.624408 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e11eca43-18f4-4edc-9dfa-a625d75b975c tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:31.627045 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-21b91f19-3c47-4c8b-84ad-c42a50a39e7f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:31.627668 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-21b91f19-3c47-4c8b-84ad-c42a50a39e7f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: b8da873d-12c6-4107-bb72-49b6cef897e1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:31.664669 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21b91f19-3c47-4c8b-84ad-c42a50a39e7f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:31.665618 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21b91f19-3c47-4c8b-84ad-c42a50a39e7f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:31.666308 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21b91f19-3c47-4c8b-84ad-c42a50a39e7f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:31.667333 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21b91f19-3c47-4c8b-84ad-c42a50a39e7f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:31.667978 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21b91f19-3c47-4c8b-84ad-c42a50a39e7f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:31.668751 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21b91f19-3c47-4c8b-84ad-c42a50a39e7f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:31.902137 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-21b91f19-3c47-4c8b-84ad-c42a50a39e7f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:31.914537 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:31.933373 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-21b91f19-3c47-4c8b-84ad-c42a50a39e7f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1" status: 200 len: 1205 microversion: 2.1 time: 0.311990 Aug 07 01:21:31.936096 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-e11eca43-18f4-4edc-9dfa-a625d75b975c tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lazy-loading 'services' on Instance uuid acc886e0-c989-4105-8375-0c42d4e96404 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:21:31.937616 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1370/2483] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:31 2022] GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1 => generated 1205 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:31.962714 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e11eca43-18f4-4edc-9dfa-a625d75b975c tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 2422 microversion: 2.25 time: 0.360902 Aug 07 01:21:31.964218 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1114/2484] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:21:31 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 2422 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:21:32.119130 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d1de7f06-bec1-4909-9967-0722006fb0a6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:32.119645 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d1de7f06-bec1-4909-9967-0722006fb0a6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:32.139268 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d1de7f06-bec1-4909-9967-0722006fb0a6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:32.139859 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d1de7f06-bec1-4909-9967-0722006fb0a6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:32.141616 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d1de7f06-bec1-4909-9967-0722006fb0a6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:32.142399 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d1de7f06-bec1-4909-9967-0722006fb0a6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:32.142866 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d1de7f06-bec1-4909-9967-0722006fb0a6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:32.145466 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d1de7f06-bec1-4909-9967-0722006fb0a6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:32.339427 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-d1de7f06-bec1-4909-9967-0722006fb0a6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lazy-loading 'services' on Instance uuid acc886e0-c989-4105-8375-0c42d4e96404 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:21:32.545182 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d1de7f06-bec1-4909-9967-0722006fb0a6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "DELETE /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404/os-volume_attachments/e69bffdd-502c-4c90-aca0-d871b0d03cb3" status: 202 len: 0 microversion: 2.25 time: 0.430029 Aug 07 01:21:32.548045 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1371/2485] 10.222.0.39 () {60 vars in 1457 bytes} [Sun Aug 7 01:21:32 2022] DELETE /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404/os-volume_attachments/e69bffdd-502c-4c90-aca0-d871b0d03cb3 => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:21:32.567405 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-414b0b38-af3e-4285-821c-40d1d6217c8e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:32.576232 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-414b0b38-af3e-4285-821c-40d1d6217c8e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:32.597393 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-414b0b38-af3e-4285-821c-40d1d6217c8e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:32.598186 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-414b0b38-af3e-4285-821c-40d1d6217c8e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:32.599309 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-414b0b38-af3e-4285-821c-40d1d6217c8e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:32.600873 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-414b0b38-af3e-4285-821c-40d1d6217c8e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:32.603477 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-414b0b38-af3e-4285-821c-40d1d6217c8e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:32.605105 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-414b0b38-af3e-4285-821c-40d1d6217c8e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:32.692960 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-414b0b38-af3e-4285-821c-40d1d6217c8e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.138058 Aug 07 01:21:32.699786 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1372/2486] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Aug 7 01:21:32 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:21:32.708311 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e4d46f6c-d93b-4e7f-8324-1412bd52a87f tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:32.712068 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e4d46f6c-d93b-4e7f-8324-1412bd52a87f tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: aa4e1c13-c268-4138-ad4e-8627558931bf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:32.728619 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4d46f6c-d93b-4e7f-8324-1412bd52a87f tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:32.729888 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4d46f6c-d93b-4e7f-8324-1412bd52a87f tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:32.734130 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4d46f6c-d93b-4e7f-8324-1412bd52a87f tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:32.736497 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4d46f6c-d93b-4e7f-8324-1412bd52a87f tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:32.737208 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4d46f6c-d93b-4e7f-8324-1412bd52a87f tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:32.739535 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4d46f6c-d93b-4e7f-8324-1412bd52a87f tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:33.136701 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7f5fa7b7-e45b-4211-bb38-4fc34f68fc2b tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1449143285", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "80536ab8-74ab-40f3-8349-f1abe6e2fcf1"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:33.241587 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-7f5fa7b7-e45b-4211-bb38-4fc34f68fc2b tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] validate_networks() for [('80536ab8-74ab-40f3-8349-f1abe6e2fcf1', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:21:33.347456 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e4d46f6c-d93b-4e7f-8324-1412bd52a87f tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5041cbc4adc24ae8871d60064720d680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc8a87d755a42239e9d4572e4bf2f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:33.355292 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e4d46f6c-d93b-4e7f-8324-1412bd52a87f tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4e1c13-c268-4138-ad4e-8627558931bf" status: 200 len: 1323 microversion: 2.1 time: 0.654026 Aug 07 01:21:33.358668 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1373/2487] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:32 2022] GET /compute/v2.1/servers/aa4e1c13-c268-4138-ad4e-8627558931bf => generated 1323 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:33.371965 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-43481586-aab1-47b9-b59c-57232f2fa544 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:33.380205 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-43481586-aab1-47b9-b59c-57232f2fa544 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: b8da873d-12c6-4107-bb72-49b6cef897e1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:33.399771 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43481586-aab1-47b9-b59c-57232f2fa544 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:33.405589 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43481586-aab1-47b9-b59c-57232f2fa544 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:33.406201 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43481586-aab1-47b9-b59c-57232f2fa544 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:33.408255 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43481586-aab1-47b9-b59c-57232f2fa544 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:33.408877 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43481586-aab1-47b9-b59c-57232f2fa544 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:33.410507 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43481586-aab1-47b9-b59c-57232f2fa544 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:33.737069 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-43481586-aab1-47b9-b59c-57232f2fa544 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:33.753717 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-43481586-aab1-47b9-b59c-57232f2fa544 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1" status: 200 len: 1267 microversion: 2.1 time: 0.386016 Aug 07 01:21:33.755024 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1374/2488] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:33 2022] GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1 => generated 1267 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:33.774981 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-aad3fb51-597f-49f6-99d3-e9e95a941d5a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:33.777752 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-aad3fb51-597f-49f6-99d3-e9e95a941d5a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:33.790339 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aad3fb51-597f-49f6-99d3-e9e95a941d5a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:33.791237 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aad3fb51-597f-49f6-99d3-e9e95a941d5a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:33.791983 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aad3fb51-597f-49f6-99d3-e9e95a941d5a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:33.803054 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aad3fb51-597f-49f6-99d3-e9e95a941d5a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:33.814863 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aad3fb51-597f-49f6-99d3-e9e95a941d5a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:33.815780 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aad3fb51-597f-49f6-99d3-e9e95a941d5a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:33.893696 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-aad3fb51-597f-49f6-99d3-e9e95a941d5a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.130089 Aug 07 01:21:33.899866 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1375/2489] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Aug 7 01:21:33 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:21:34.382869 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-48ef609b-fe59-4985-b28c-6e0960e41963 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:34.383629 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-48ef609b-fe59-4985-b28c-6e0960e41963 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: aa4e1c13-c268-4138-ad4e-8627558931bf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:34.398161 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48ef609b-fe59-4985-b28c-6e0960e41963 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:34.398999 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48ef609b-fe59-4985-b28c-6e0960e41963 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:34.399809 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48ef609b-fe59-4985-b28c-6e0960e41963 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:34.400813 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48ef609b-fe59-4985-b28c-6e0960e41963 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:34.403357 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48ef609b-fe59-4985-b28c-6e0960e41963 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:34.404188 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48ef609b-fe59-4985-b28c-6e0960e41963 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:34.932462 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-7f5fa7b7-e45b-4211-bb38-4fc34f68fc2b tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:21:34.933638 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-7f5fa7b7-e45b-4211-bb38-4fc34f68fc2b tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:21:34.934303 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-7f5fa7b7-e45b-4211-bb38-4fc34f68fc2b tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:21:34.934973 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-7f5fa7b7-e45b-4211-bb38-4fc34f68fc2b tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:21:34.936218 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-7f5fa7b7-e45b-4211-bb38-4fc34f68fc2b tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:21:34.997565 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7f5fa7b7-e45b-4211-bb38-4fc34f68fc2b tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:34.998558 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7f5fa7b7-e45b-4211-bb38-4fc34f68fc2b tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:34.999297 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7f5fa7b7-e45b-4211-bb38-4fc34f68fc2b tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:35.000580 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7f5fa7b7-e45b-4211-bb38-4fc34f68fc2b tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:35.001316 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7f5fa7b7-e45b-4211-bb38-4fc34f68fc2b tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:35.002070 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7f5fa7b7-e45b-4211-bb38-4fc34f68fc2b tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:35.053365 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-7f5fa7b7-e45b-4211-bb38-4fc34f68fc2b tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Getting quotas for project 22296c942ac648039f202269c9d64749. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:21:35.068229 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-7f5fa7b7-e45b-4211-bb38-4fc34f68fc2b tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Getting quotas for user 093384280c5448f6af8915b37082e14b and project 22296c942ac648039f202269c9d64749. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:21:35.110844 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7f5fa7b7-e45b-4211-bb38-4fc34f68fc2b tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:21:35.122939 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7f5fa7b7-e45b-4211-bb38-4fc34f68fc2b tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] [instance: 912ca661-97cc-457c-bf67-2250ef30eb43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:21:35.261921 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7f5fa7b7-e45b-4211-bb38-4fc34f68fc2b tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.748767 Aug 07 01:21:35.265431 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1115/2490] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:21:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:21:35.284455 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c6354b51-5e39-4c5d-ab13-7ade9e2f30c0 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:35.289522 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c6354b51-5e39-4c5d-ab13-7ade9e2f30c0 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: b8da873d-12c6-4107-bb72-49b6cef897e1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:35.309826 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6354b51-5e39-4c5d-ab13-7ade9e2f30c0 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:35.316573 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6354b51-5e39-4c5d-ab13-7ade9e2f30c0 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:35.317041 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6354b51-5e39-4c5d-ab13-7ade9e2f30c0 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:35.317794 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6354b51-5e39-4c5d-ab13-7ade9e2f30c0 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:35.318258 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6354b51-5e39-4c5d-ab13-7ade9e2f30c0 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:35.318684 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6354b51-5e39-4c5d-ab13-7ade9e2f30c0 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:35.414746 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-48ef609b-fe59-4985-b28c-6e0960e41963 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5041cbc4adc24ae8871d60064720d680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc8a87d755a42239e9d4572e4bf2f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:35.423331 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-48ef609b-fe59-4985-b28c-6e0960e41963 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4e1c13-c268-4138-ad4e-8627558931bf" status: 200 len: 1323 microversion: 2.1 time: 1.044291 Aug 07 01:21:35.430129 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1376/2491] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:34 2022] GET /compute/v2.1/servers/aa4e1c13-c268-4138-ad4e-8627558931bf => generated 1323 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:35.443550 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-df472f4d-4986-4f0f-bfbd-3382028c0b50 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:35.451695 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-df472f4d-4986-4f0f-bfbd-3382028c0b50 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:35.470395 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df472f4d-4986-4f0f-bfbd-3382028c0b50 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:35.471194 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df472f4d-4986-4f0f-bfbd-3382028c0b50 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:35.471792 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df472f4d-4986-4f0f-bfbd-3382028c0b50 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:35.472941 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df472f4d-4986-4f0f-bfbd-3382028c0b50 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:35.473722 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df472f4d-4986-4f0f-bfbd-3382028c0b50 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:35.475877 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df472f4d-4986-4f0f-bfbd-3382028c0b50 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:35.564869 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-df472f4d-4986-4f0f-bfbd-3382028c0b50 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.133510 Aug 07 01:21:35.566054 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1377/2492] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Aug 7 01:21:35 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:21:35.575807 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-54c8c3b2-efda-4e52-b0b4-aa883bf23afe tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:35.579130 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-54c8c3b2-efda-4e52-b0b4-aa883bf23afe tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] [instance: 912ca661-97cc-457c-bf67-2250ef30eb43] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:35.874946 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c6354b51-5e39-4c5d-ab13-7ade9e2f30c0 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:35.900081 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c6354b51-5e39-4c5d-ab13-7ade9e2f30c0 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1" status: 200 len: 1309 microversion: 2.1 time: 0.630148 Aug 07 01:21:35.903984 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1116/2493] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:35 2022] GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1 => generated 1309 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:36.301619 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-54c8c3b2-efda-4e52-b0b4-aa883bf23afe tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093384280c5448f6af8915b37082e14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22296c942ac648039f202269c9d64749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:36.315615 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-54c8c3b2-efda-4e52-b0b4-aa883bf23afe tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] 10.222.0.39 "GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43" status: 200 len: 1217 microversion: 2.1 time: 0.744692 Aug 07 01:21:36.334158 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1378/2494] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:35 2022] GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43 => generated 1217 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:36.449644 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-87d487dd-0d45-4b6e-b5b0-f34be84cb1e6 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:36.451370 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-87d487dd-0d45-4b6e-b5b0-f34be84cb1e6 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: aa4e1c13-c268-4138-ad4e-8627558931bf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:36.468216 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-87d487dd-0d45-4b6e-b5b0-f34be84cb1e6 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:36.469010 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-87d487dd-0d45-4b6e-b5b0-f34be84cb1e6 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:36.471630 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-87d487dd-0d45-4b6e-b5b0-f34be84cb1e6 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:36.472656 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-87d487dd-0d45-4b6e-b5b0-f34be84cb1e6 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:36.474517 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-87d487dd-0d45-4b6e-b5b0-f34be84cb1e6 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:36.475533 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-87d487dd-0d45-4b6e-b5b0-f34be84cb1e6 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:36.585126 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-42b6879e-db3f-412f-b14e-20eb28dde5c8 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:36.590986 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-42b6879e-db3f-412f-b14e-20eb28dde5c8 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:36.604462 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42b6879e-db3f-412f-b14e-20eb28dde5c8 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:36.605375 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42b6879e-db3f-412f-b14e-20eb28dde5c8 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:36.606205 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42b6879e-db3f-412f-b14e-20eb28dde5c8 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:36.607816 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42b6879e-db3f-412f-b14e-20eb28dde5c8 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:36.608634 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42b6879e-db3f-412f-b14e-20eb28dde5c8 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:36.609305 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42b6879e-db3f-412f-b14e-20eb28dde5c8 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:36.707180 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-42b6879e-db3f-412f-b14e-20eb28dde5c8 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.125054 Aug 07 01:21:36.712709 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1379/2495] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Aug 7 01:21:36 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:21:36.929521 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9658173c-8976-4736-9428-73bd7c91a5a9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:36.930635 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9658173c-8976-4736-9428-73bd7c91a5a9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: b8da873d-12c6-4107-bb72-49b6cef897e1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:36.956599 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9658173c-8976-4736-9428-73bd7c91a5a9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:36.960909 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9658173c-8976-4736-9428-73bd7c91a5a9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:36.961829 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9658173c-8976-4736-9428-73bd7c91a5a9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:36.963052 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9658173c-8976-4736-9428-73bd7c91a5a9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:36.964620 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9658173c-8976-4736-9428-73bd7c91a5a9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:36.965311 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9658173c-8976-4736-9428-73bd7c91a5a9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:37.236297 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-87d487dd-0d45-4b6e-b5b0-f34be84cb1e6 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5041cbc4adc24ae8871d60064720d680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc8a87d755a42239e9d4572e4bf2f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:37.251250 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-87d487dd-0d45-4b6e-b5b0-f34be84cb1e6 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4e1c13-c268-4138-ad4e-8627558931bf" status: 200 len: 1323 microversion: 2.1 time: 0.806733 Aug 07 01:21:37.252137 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1117/2496] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:36 2022] GET /compute/v2.1/servers/aa4e1c13-c268-4138-ad4e-8627558931bf => generated 1323 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:37.340457 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-262841df-1b7b-43ba-a965-aad0168078ad tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:37.342534 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-262841df-1b7b-43ba-a965-aad0168078ad tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] [instance: 912ca661-97cc-457c-bf67-2250ef30eb43] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:37.359375 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-262841df-1b7b-43ba-a965-aad0168078ad tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:37.361584 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-262841df-1b7b-43ba-a965-aad0168078ad tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:37.367247 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-262841df-1b7b-43ba-a965-aad0168078ad tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:37.371014 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-262841df-1b7b-43ba-a965-aad0168078ad tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:37.373200 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-262841df-1b7b-43ba-a965-aad0168078ad tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:37.375211 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-262841df-1b7b-43ba-a965-aad0168078ad tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:37.642840 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-262841df-1b7b-43ba-a965-aad0168078ad tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093384280c5448f6af8915b37082e14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22296c942ac648039f202269c9d64749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:37.654060 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-262841df-1b7b-43ba-a965-aad0168078ad tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] 10.222.0.39 "GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43" status: 200 len: 1269 microversion: 2.1 time: 0.318613 Aug 07 01:21:37.658368 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1118/2497] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:37 2022] GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43 => generated 1269 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:21:37.724021 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-086821f9-28c7-46a0-bdc2-ad0190636adf tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:37.727219 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-086821f9-28c7-46a0-bdc2-ad0190636adf tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:37.755731 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-086821f9-28c7-46a0-bdc2-ad0190636adf tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:37.756269 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-086821f9-28c7-46a0-bdc2-ad0190636adf tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:37.758906 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-086821f9-28c7-46a0-bdc2-ad0190636adf tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:37.759723 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-086821f9-28c7-46a0-bdc2-ad0190636adf tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:37.760440 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-086821f9-28c7-46a0-bdc2-ad0190636adf tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:37.765507 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-086821f9-28c7-46a0-bdc2-ad0190636adf tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:37.865592 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-086821f9-28c7-46a0-bdc2-ad0190636adf tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.141219 Aug 07 01:21:37.866485 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1119/2498] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Aug 7 01:21:37 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:21:38.204134 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9658173c-8976-4736-9428-73bd7c91a5a9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:38.213815 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9658173c-8976-4736-9428-73bd7c91a5a9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1" status: 200 len: 1309 microversion: 2.1 time: 1.288801 Aug 07 01:21:38.217956 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1380/2499] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:36 2022] GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1 => generated 1309 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:38.282432 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-689345c4-f04d-43c6-9393-322e2539192c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:38.283300 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-689345c4-f04d-43c6-9393-322e2539192c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: aa4e1c13-c268-4138-ad4e-8627558931bf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:38.295444 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-689345c4-f04d-43c6-9393-322e2539192c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:38.296264 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-689345c4-f04d-43c6-9393-322e2539192c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:38.300668 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-689345c4-f04d-43c6-9393-322e2539192c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:38.301691 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-689345c4-f04d-43c6-9393-322e2539192c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:38.302329 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-689345c4-f04d-43c6-9393-322e2539192c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:38.303058 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-689345c4-f04d-43c6-9393-322e2539192c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:38.674793 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e0465c21-5810-4bd3-a059-134920d5ce73 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:38.675421 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e0465c21-5810-4bd3-a059-134920d5ce73 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] [instance: 912ca661-97cc-457c-bf67-2250ef30eb43] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:38.693096 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0465c21-5810-4bd3-a059-134920d5ce73 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:38.693946 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0465c21-5810-4bd3-a059-134920d5ce73 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:38.694536 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0465c21-5810-4bd3-a059-134920d5ce73 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:38.698610 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0465c21-5810-4bd3-a059-134920d5ce73 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:38.703246 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0465c21-5810-4bd3-a059-134920d5ce73 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:38.704845 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0465c21-5810-4bd3-a059-134920d5ce73 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:39.086342 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-689345c4-f04d-43c6-9393-322e2539192c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5041cbc4adc24ae8871d60064720d680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc8a87d755a42239e9d4572e4bf2f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:39.136989 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-689345c4-f04d-43c6-9393-322e2539192c tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4e1c13-c268-4138-ad4e-8627558931bf" status: 200 len: 1323 microversion: 2.1 time: 0.859839 Aug 07 01:21:39.137722 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1120/2500] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:38 2022] GET /compute/v2.1/servers/aa4e1c13-c268-4138-ad4e-8627558931bf => generated 1323 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:39.160721 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-581102ec-6f04-488d-b50e-ed55267301fa tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:39.167115 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-581102ec-6f04-488d-b50e-ed55267301fa tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:39.189616 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-581102ec-6f04-488d-b50e-ed55267301fa tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:39.190692 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-581102ec-6f04-488d-b50e-ed55267301fa tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:39.191373 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-581102ec-6f04-488d-b50e-ed55267301fa tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:39.197150 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-581102ec-6f04-488d-b50e-ed55267301fa tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:39.216040 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-581102ec-6f04-488d-b50e-ed55267301fa tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:39.217379 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-581102ec-6f04-488d-b50e-ed55267301fa tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:39.328315 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-581102ec-6f04-488d-b50e-ed55267301fa tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.187787 Aug 07 01:21:39.328917 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1121/2501] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Aug 7 01:21:39 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:21:39.346931 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-eacbce93-61aa-44af-9678-8a402566cd5d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:39.347565 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-eacbce93-61aa-44af-9678-8a402566cd5d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: b8da873d-12c6-4107-bb72-49b6cef897e1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:39.361671 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eacbce93-61aa-44af-9678-8a402566cd5d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:39.362164 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eacbce93-61aa-44af-9678-8a402566cd5d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:39.362598 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eacbce93-61aa-44af-9678-8a402566cd5d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:39.363327 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eacbce93-61aa-44af-9678-8a402566cd5d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:39.363779 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eacbce93-61aa-44af-9678-8a402566cd5d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:39.368696 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eacbce93-61aa-44af-9678-8a402566cd5d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:39.472872 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e0465c21-5810-4bd3-a059-134920d5ce73 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093384280c5448f6af8915b37082e14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22296c942ac648039f202269c9d64749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:39.495404 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e0465c21-5810-4bd3-a059-134920d5ce73 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] 10.222.0.39 "GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43" status: 200 len: 1275 microversion: 2.1 time: 0.824379 Aug 07 01:21:39.500227 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1381/2502] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:38 2022] GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43 => generated 1275 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:40.158894 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b7407511-10bf-46d8-971a-071609a265a8 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:40.159680 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b7407511-10bf-46d8-971a-071609a265a8 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: aa4e1c13-c268-4138-ad4e-8627558931bf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:40.176261 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=4 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:40.179020 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7407511-10bf-46d8-971a-071609a265a8 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:40.179746 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7407511-10bf-46d8-971a-071609a265a8 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:40.180237 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7407511-10bf-46d8-971a-071609a265a8 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:40.187833 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7407511-10bf-46d8-971a-071609a265a8 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:40.188552 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7407511-10bf-46d8-971a-071609a265a8 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:40.189021 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7407511-10bf-46d8-971a-071609a265a8 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:40.429973 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-eacbce93-61aa-44af-9678-8a402566cd5d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:40.452491 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-eacbce93-61aa-44af-9678-8a402566cd5d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1" status: 200 len: 1309 microversion: 2.1 time: 1.122447 Aug 07 01:21:40.453264 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1122/2503] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:39 2022] GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1 => generated 1309 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:40.468396 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-1174a216-8daa-4f80-821c-15df96d83d3c req-5d69f30b-bf27-4715-b3f1-f08bc7109b29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8da873d-12c6-4107-bb72-49b6cef897e1", "tag": "0f8e1eea-f5ca-442c-81a5-6d667ac5e6f8"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:40.492729 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-1174a216-8daa-4f80-821c-15df96d83d3c req-5d69f30b-bf27-4715-b3f1-f08bc7109b29 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:40.493541 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-1174a216-8daa-4f80-821c-15df96d83d3c req-5d69f30b-bf27-4715-b3f1-f08bc7109b29 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:40.494424 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-1174a216-8daa-4f80-821c-15df96d83d3c req-5d69f30b-bf27-4715-b3f1-f08bc7109b29 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:40.532822 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-1174a216-8daa-4f80-821c-15df96d83d3c req-5d69f30b-bf27-4715-b3f1-f08bc7109b29 service nova] Creating event network-changed:0f8e1eea-f5ca-442c-81a5-6d667ac5e6f8 for instance b8da873d-12c6-4107-bb72-49b6cef897e1 on n-h1-master-1 Aug 07 01:21:40.543989 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-1174a216-8daa-4f80-821c-15df96d83d3c req-5d69f30b-bf27-4715-b3f1-f08bc7109b29 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088937 Aug 07 01:21:40.548118 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1123/2504] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:21:40.562802 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-48456a28-0ed1-4b91-a6f6-c8c6943967ca tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:40.572551 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-48456a28-0ed1-4b91-a6f6-c8c6943967ca tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:40.584558 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-48456a28-0ed1-4b91-a6f6-c8c6943967ca tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:40.587214 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-48456a28-0ed1-4b91-a6f6-c8c6943967ca tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:40.590680 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-48456a28-0ed1-4b91-a6f6-c8c6943967ca tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:40.592683 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-48456a28-0ed1-4b91-a6f6-c8c6943967ca tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:40.593339 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-48456a28-0ed1-4b91-a6f6-c8c6943967ca tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:40.595718 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-48456a28-0ed1-4b91-a6f6-c8c6943967ca tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:40.653067 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-48456a28-0ed1-4b91-a6f6-c8c6943967ca tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.103433 Aug 07 01:21:40.654328 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1124/2505] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Aug 7 01:21:40 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:21:40.662566 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-006550d8-0fac-4699-be3b-f0075390a2a8 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:40.663485 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-006550d8-0fac-4699-be3b-f0075390a2a8 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] [instance: 912ca661-97cc-457c-bf67-2250ef30eb43] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:40.671787 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-006550d8-0fac-4699-be3b-f0075390a2a8 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:40.672741 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-006550d8-0fac-4699-be3b-f0075390a2a8 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:40.673236 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-006550d8-0fac-4699-be3b-f0075390a2a8 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:40.675612 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-006550d8-0fac-4699-be3b-f0075390a2a8 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:40.676770 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-006550d8-0fac-4699-be3b-f0075390a2a8 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:40.677376 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-006550d8-0fac-4699-be3b-f0075390a2a8 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:41.357672 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-006550d8-0fac-4699-be3b-f0075390a2a8 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093384280c5448f6af8915b37082e14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22296c942ac648039f202269c9d64749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:41.359715 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b7407511-10bf-46d8-971a-071609a265a8 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5041cbc4adc24ae8871d60064720d680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc8a87d755a42239e9d4572e4bf2f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:41.378040 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-006550d8-0fac-4699-be3b-f0075390a2a8 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] 10.222.0.39 "GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43" status: 200 len: 1317 microversion: 2.1 time: 0.720484 Aug 07 01:21:41.395466 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b7407511-10bf-46d8-971a-071609a265a8 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4e1c13-c268-4138-ad4e-8627558931bf" status: 200 len: 1323 microversion: 2.1 time: 1.230359 Aug 07 01:21:41.395466 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1382/2506] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:40 2022] GET /compute/v2.1/servers/aa4e1c13-c268-4138-ad4e-8627558931bf => generated 1323 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:21:41.399278 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-76628d0e-5e64-4f8a-b720-8fff1d3d2be3 req-061c74cf-602d-4383-9b97-c72d917ff23e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa4e1c13-c268-4138-ad4e-8627558931bf", "name": "network-vif-plugged", "status": "completed", "tag": "e962044b-2b07-4716-b16b-df9c45e8c3d9"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:41.400847 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1125/2507] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:40 2022] GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43 => generated 1317 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:41.428828 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-76628d0e-5e64-4f8a-b720-8fff1d3d2be3 req-061c74cf-602d-4383-9b97-c72d917ff23e service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:41.432212 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-76628d0e-5e64-4f8a-b720-8fff1d3d2be3 req-061c74cf-602d-4383-9b97-c72d917ff23e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:41.432827 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-76628d0e-5e64-4f8a-b720-8fff1d3d2be3 req-061c74cf-602d-4383-9b97-c72d917ff23e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:41.476026 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-76628d0e-5e64-4f8a-b720-8fff1d3d2be3 req-061c74cf-602d-4383-9b97-c72d917ff23e service nova] Creating event network-vif-plugged:e962044b-2b07-4716-b16b-df9c45e8c3d9 for instance aa4e1c13-c268-4138-ad4e-8627558931bf on n-h2-master-1 Aug 07 01:21:41.478663 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-58de338f-d4e2-40ed-b4d0-0f74603a000e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:41.479425 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-58de338f-d4e2-40ed-b4d0-0f74603a000e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: b8da873d-12c6-4107-bb72-49b6cef897e1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:41.491161 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-76628d0e-5e64-4f8a-b720-8fff1d3d2be3 req-061c74cf-602d-4383-9b97-c72d917ff23e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102176 Aug 07 01:21:41.493363 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1383/2508] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:21:41.507862 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-58de338f-d4e2-40ed-b4d0-0f74603a000e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:41.508792 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-58de338f-d4e2-40ed-b4d0-0f74603a000e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:41.509253 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-58de338f-d4e2-40ed-b4d0-0f74603a000e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:41.512724 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-58de338f-d4e2-40ed-b4d0-0f74603a000e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:41.514355 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-58de338f-d4e2-40ed-b4d0-0f74603a000e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:41.515352 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-58de338f-d4e2-40ed-b4d0-0f74603a000e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:41.668381 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bfc4b8a0-9fd6-462d-a9b0-94b4a9ad8f79 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:41.671683 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bfc4b8a0-9fd6-462d-a9b0-94b4a9ad8f79 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:41.691914 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bfc4b8a0-9fd6-462d-a9b0-94b4a9ad8f79 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:41.692528 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bfc4b8a0-9fd6-462d-a9b0-94b4a9ad8f79 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:41.693216 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bfc4b8a0-9fd6-462d-a9b0-94b4a9ad8f79 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:41.694400 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bfc4b8a0-9fd6-462d-a9b0-94b4a9ad8f79 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:41.695123 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bfc4b8a0-9fd6-462d-a9b0-94b4a9ad8f79 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:41.696633 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bfc4b8a0-9fd6-462d-a9b0-94b4a9ad8f79 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:41.799013 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bfc4b8a0-9fd6-462d-a9b0-94b4a9ad8f79 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.135849 Aug 07 01:21:41.801559 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1384/2509] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Aug 7 01:21:41 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 01:21:42.251722 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-58de338f-d4e2-40ed-b4d0-0f74603a000e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:42.262319 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-58de338f-d4e2-40ed-b4d0-0f74603a000e tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1" status: 200 len: 1309 microversion: 2.1 time: 0.791253 Aug 07 01:21:42.264357 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1126/2510] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:41 2022] GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1 => generated 1309 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:21:42.410358 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0c15bfef-72e8-455d-be67-954c7be63ff5 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:42.411239 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c4a1480e-2746-4a41-9def-f8bb6b304bf3 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:42.411922 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0c15bfef-72e8-455d-be67-954c7be63ff5 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: aa4e1c13-c268-4138-ad4e-8627558931bf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:42.412841 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c4a1480e-2746-4a41-9def-f8bb6b304bf3 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] [instance: 912ca661-97cc-457c-bf67-2250ef30eb43] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:42.442508 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0c15bfef-72e8-455d-be67-954c7be63ff5 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:42.444103 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0c15bfef-72e8-455d-be67-954c7be63ff5 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:42.445724 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0c15bfef-72e8-455d-be67-954c7be63ff5 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:42.450322 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0c15bfef-72e8-455d-be67-954c7be63ff5 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:42.453408 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0c15bfef-72e8-455d-be67-954c7be63ff5 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:42.457101 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0c15bfef-72e8-455d-be67-954c7be63ff5 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:42.462202 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c4a1480e-2746-4a41-9def-f8bb6b304bf3 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:42.465686 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c4a1480e-2746-4a41-9def-f8bb6b304bf3 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:42.499337 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c4a1480e-2746-4a41-9def-f8bb6b304bf3 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:42.503532 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c4a1480e-2746-4a41-9def-f8bb6b304bf3 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:42.505743 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c4a1480e-2746-4a41-9def-f8bb6b304bf3 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:42.512707 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c4a1480e-2746-4a41-9def-f8bb6b304bf3 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:42.953594 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0c15bfef-72e8-455d-be67-954c7be63ff5 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5041cbc4adc24ae8871d60064720d680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc8a87d755a42239e9d4572e4bf2f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:42.969955 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0c15bfef-72e8-455d-be67-954c7be63ff5 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4e1c13-c268-4138-ad4e-8627558931bf" status: 200 len: 1323 microversion: 2.1 time: 0.564813 Aug 07 01:21:42.972511 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1127/2511] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:42 2022] GET /compute/v2.1/servers/aa4e1c13-c268-4138-ad4e-8627558931bf => generated 1323 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:42.998108 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4de243c8-aa8e-4ab0-bc4c-ed160f0724a6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:43.007766 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4de243c8-aa8e-4ab0-bc4c-ed160f0724a6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:43.030571 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4de243c8-aa8e-4ab0-bc4c-ed160f0724a6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:43.031082 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4de243c8-aa8e-4ab0-bc4c-ed160f0724a6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:43.033890 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4de243c8-aa8e-4ab0-bc4c-ed160f0724a6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:43.034730 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4de243c8-aa8e-4ab0-bc4c-ed160f0724a6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:43.035335 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4de243c8-aa8e-4ab0-bc4c-ed160f0724a6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:43.038415 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4de243c8-aa8e-4ab0-bc4c-ed160f0724a6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:43.056992 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c4a1480e-2746-4a41-9def-f8bb6b304bf3 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093384280c5448f6af8915b37082e14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22296c942ac648039f202269c9d64749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:43.075783 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c4a1480e-2746-4a41-9def-f8bb6b304bf3 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] 10.222.0.39 "GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43" status: 200 len: 1317 microversion: 2.1 time: 0.671966 Aug 07 01:21:43.081053 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1385/2512] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:42 2022] GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43 => generated 1317 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:43.167177 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4de243c8-aa8e-4ab0-bc4c-ed160f0724a6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.188198 Aug 07 01:21:43.168532 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1128/2513] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Aug 7 01:21:42 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404/os-volume_attachments => generated 25 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:43.286281 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-878209eb-95b3-4e4b-9fda-2aed66b8d558 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:43.286892 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-878209eb-95b3-4e4b-9fda-2aed66b8d558 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: b8da873d-12c6-4107-bb72-49b6cef897e1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:43.297898 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-878209eb-95b3-4e4b-9fda-2aed66b8d558 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:43.298389 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-878209eb-95b3-4e4b-9fda-2aed66b8d558 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:43.298832 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-878209eb-95b3-4e4b-9fda-2aed66b8d558 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:43.299554 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-878209eb-95b3-4e4b-9fda-2aed66b8d558 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:43.311052 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-878209eb-95b3-4e4b-9fda-2aed66b8d558 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:43.312513 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-878209eb-95b3-4e4b-9fda-2aed66b8d558 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:43.430352 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-993aeae8-195c-4b1c-9507-b9d0256af352 tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] Calling method '.version_select at 0x7f9e24a95790>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:43.515261 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-993aeae8-195c-4b1c-9507-b9d0256af352 tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] 10.222.0.39 "GET /compute/v2.1/images/487da344-f342-43e6-86c4-a8b72534f07c" status: 200 len: 636 microversion: 2.1 time: 0.090917 Aug 07 01:21:43.517039 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1129/2514] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:21:43 2022] GET /compute/v2.1/images/487da344-f342-43e6-86c4-a8b72534f07c => generated 636 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:21:43.555852 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3beb07c0-12e1-4c94-a8b5-fd08483735c9 tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] Action: 'update_all', calling method: .version_select at 0x7f9e24af2940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:43.646139 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-3beb07c0-12e1-4c94-a8b5-fd08483735c9 tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] Getting quotas for project c34f5e0602134ef7ae2eaf6a05f82c32. Resources: dict_keys(['metadata_items']) {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:21:43.660801 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-3beb07c0-12e1-4c94-a8b5-fd08483735c9 tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] Getting quotas for user 3adbb2fc6f6a48b39962545bb8de46c8 and project c34f5e0602134ef7ae2eaf6a05f82c32. Resources: dict_keys(['metadata_items']) {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:21:44.305145 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3beb07c0-12e1-4c94-a8b5-fd08483735c9 tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] 10.222.0.39 "PUT /compute/v2.1/images/487da344-f342-43e6-86c4-a8b72534f07c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.754431 Aug 07 01:21:44.311362 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1130/2515] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Aug 7 01:21:43 2022] PUT /compute/v2.1/images/487da344-f342-43e6-86c4-a8b72534f07c/metadata => generated 61 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:21:44.316498 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-3191a701-fc77-4fb5-951e-c73bf6275822 req-9a6c67c2-dead-4f08-97a6-0e08eb4912ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "912ca661-97cc-457c-bf67-2250ef30eb43", "tag": "27dafc12-f662-4012-9662-c3a303b1320d"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:44.350691 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3191a701-fc77-4fb5-951e-c73bf6275822 req-9a6c67c2-dead-4f08-97a6-0e08eb4912ce service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:44.359015 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3191a701-fc77-4fb5-951e-c73bf6275822 req-9a6c67c2-dead-4f08-97a6-0e08eb4912ce service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:44.360105 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3191a701-fc77-4fb5-951e-c73bf6275822 req-9a6c67c2-dead-4f08-97a6-0e08eb4912ce service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:44.386427 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-3191a701-fc77-4fb5-951e-c73bf6275822 req-9a6c67c2-dead-4f08-97a6-0e08eb4912ce service nova] Creating event network-changed:27dafc12-f662-4012-9662-c3a303b1320d for instance 912ca661-97cc-457c-bf67-2250ef30eb43 on n-h1-master-1 Aug 07 01:21:44.396662 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-3191a701-fc77-4fb5-951e-c73bf6275822 req-9a6c67c2-dead-4f08-97a6-0e08eb4912ce service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087784 Aug 07 01:21:44.397867 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1131/2516] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:21:44.410404 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a3d84329-6de4-4ed8-884b-264bf412fb38 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:44.411212 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a3d84329-6de4-4ed8-884b-264bf412fb38 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: aa4e1c13-c268-4138-ad4e-8627558931bf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:44.431423 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3d84329-6de4-4ed8-884b-264bf412fb38 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:44.431958 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3d84329-6de4-4ed8-884b-264bf412fb38 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:44.432410 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3d84329-6de4-4ed8-884b-264bf412fb38 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:44.433156 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3d84329-6de4-4ed8-884b-264bf412fb38 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:44.433618 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3d84329-6de4-4ed8-884b-264bf412fb38 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:44.434051 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3d84329-6de4-4ed8-884b-264bf412fb38 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:44.918052 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-878209eb-95b3-4e4b-9fda-2aed66b8d558 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:44.942974 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-878209eb-95b3-4e4b-9fda-2aed66b8d558 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1" status: 200 len: 1309 microversion: 2.1 time: 1.659083 Aug 07 01:21:44.943606 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1386/2517] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:43 2022] GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1 => generated 1309 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:44.949291 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-79a3938b-4661-4d69-a911-01633f2c4a5a tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:44.951519 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-79a3938b-4661-4d69-a911-01633f2c4a5a tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] [instance: 912ca661-97cc-457c-bf67-2250ef30eb43] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:44.978885 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-79a3938b-4661-4d69-a911-01633f2c4a5a tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:44.982229 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-79a3938b-4661-4d69-a911-01633f2c4a5a tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:44.983241 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-79a3938b-4661-4d69-a911-01633f2c4a5a tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:44.984501 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-79a3938b-4661-4d69-a911-01633f2c4a5a tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:44.985427 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-79a3938b-4661-4d69-a911-01633f2c4a5a tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:44.986073 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-79a3938b-4661-4d69-a911-01633f2c4a5a tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:45.026363 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:45.159540 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a3d84329-6de4-4ed8-884b-264bf412fb38 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5041cbc4adc24ae8871d60064720d680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc8a87d755a42239e9d4572e4bf2f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:45.175221 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a3d84329-6de4-4ed8-884b-264bf412fb38 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4e1c13-c268-4138-ad4e-8627558931bf" status: 200 len: 1519 microversion: 2.1 time: 0.769209 Aug 07 01:21:45.176191 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1132/2518] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:44 2022] GET /compute/v2.1/servers/aa4e1c13-c268-4138-ad4e-8627558931bf => generated 1519 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:45.195456 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-494fc0bf-72bf-416a-860d-0b8fa1083321 tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] Calling method '.version_select at 0x7f9e24e80dc0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:45.335292 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-79a3938b-4661-4d69-a911-01633f2c4a5a tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093384280c5448f6af8915b37082e14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22296c942ac648039f202269c9d64749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:45.355565 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-79a3938b-4661-4d69-a911-01633f2c4a5a tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] 10.222.0.39 "GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43" status: 200 len: 1317 microversion: 2.1 time: 0.403368 Aug 07 01:21:45.366075 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1387/2519] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:44 2022] GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43 => generated 1317 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:45.381456 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ebd6ad1f-2392-48f6-898b-a3b5184aad5a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Action: 'action', calling method: .version_select at 0x7f9e273ea670>, body: {"addFloatingIp": {"address": "172.35.4.107"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:45.386063 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ebd6ad1f-2392-48f6-898b-a3b5184aad5a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: ee42a97e-a680-4b64-bbfa-df12eba6dcde] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:45.404785 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ebd6ad1f-2392-48f6-898b-a3b5184aad5a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:45.405223 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ebd6ad1f-2392-48f6-898b-a3b5184aad5a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:45.407251 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ebd6ad1f-2392-48f6-898b-a3b5184aad5a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:45.409217 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ebd6ad1f-2392-48f6-898b-a3b5184aad5a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:45.409845 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ebd6ad1f-2392-48f6-898b-a3b5184aad5a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:45.411147 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ebd6ad1f-2392-48f6-898b-a3b5184aad5a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:45.648700 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:45.664576 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ebd6ad1f-2392-48f6-898b-a3b5184aad5a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "refresh_cache-ee42a97e-a680-4b64-bbfa-df12eba6dcde" {{(pid=119516) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 07 01:21:45.664982 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ebd6ad1f-2392-48f6-898b-a3b5184aad5a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquired lock "refresh_cache-ee42a97e-a680-4b64-bbfa-df12eba6dcde" {{(pid=119516) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 07 01:21:45.758715 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-494fc0bf-72bf-416a-860d-0b8fa1083321 tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] 10.222.0.39 "DELETE /compute/v2.1/images/487da344-f342-43e6-86c4-a8b72534f07c/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.580839 Aug 07 01:21:45.760302 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1133/2520] 10.222.0.39 () {58 vars in 1296 bytes} [Sun Aug 7 01:21:45 2022] DELETE /compute/v2.1/images/487da344-f342-43e6-86c4-a8b72534f07c/metadata/os_version => generated 0 bytes in 583 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:21:45.770966 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7e5ac063-c1d7-4c08-afdd-267e4c901623 tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] Calling method '.version_select at 0x7f9e240ff700>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:45.858225 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7e5ac063-c1d7-4c08-afdd-267e4c901623 tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] 10.222.0.39 "GET /compute/v2.1/images/487da344-f342-43e6-86c4-a8b72534f07c/metadata" status: 200 len: 37 microversion: 2.1 time: 0.092914 Aug 07 01:21:45.860424 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1134/2521] 10.222.0.39 () {58 vars in 1260 bytes} [Sun Aug 7 01:21:45 2022] GET /compute/v2.1/images/487da344-f342-43e6-86c4-a8b72534f07c/metadata => generated 37 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:21:45.880853 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-13bdad9b-dbb8-4bb4-b963-45c3b9099286 tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] Action: 'update_all', calling method: .version_select at 0x7f9e24caa8b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:45.980201 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-13bdad9b-dbb8-4bb4-b963-45c3b9099286 tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] Getting quotas for project c34f5e0602134ef7ae2eaf6a05f82c32. Resources: dict_keys(['metadata_items']) {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:21:45.992275 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-13bdad9b-dbb8-4bb4-b963-45c3b9099286 tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] Getting quotas for user 3adbb2fc6f6a48b39962545bb8de46c8 and project c34f5e0602134ef7ae2eaf6a05f82c32. Resources: dict_keys(['metadata_items']) {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:21:45.999643 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:46.307966 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=16 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:46.782392 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-13bdad9b-dbb8-4bb4-b963-45c3b9099286 tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] 10.222.0.39 "PUT /compute/v2.1/images/487da344-f342-43e6-86c4-a8b72534f07c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.909480 Aug 07 01:21:46.783304 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1135/2522] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Aug 7 01:21:45 2022] PUT /compute/v2.1/images/487da344-f342-43e6-86c4-a8b72534f07c/metadata => generated 61 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:21:46.789462 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8f453797-ba91-4e0d-84b1-3f1be87aab9d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:46.791175 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8f453797-ba91-4e0d-84b1-3f1be87aab9d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: b8da873d-12c6-4107-bb72-49b6cef897e1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:46.811969 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f453797-ba91-4e0d-84b1-3f1be87aab9d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:46.812588 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f453797-ba91-4e0d-84b1-3f1be87aab9d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:46.813041 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f453797-ba91-4e0d-84b1-3f1be87aab9d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:46.813796 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f453797-ba91-4e0d-84b1-3f1be87aab9d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:46.814249 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f453797-ba91-4e0d-84b1-3f1be87aab9d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:46.814674 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f453797-ba91-4e0d-84b1-3f1be87aab9d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:47.247232 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8f453797-ba91-4e0d-84b1-3f1be87aab9d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:47.251507 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:47.269077 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8f453797-ba91-4e0d-84b1-3f1be87aab9d tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1" status: 200 len: 1309 microversion: 2.1 time: 0.483559 Aug 07 01:21:47.283577 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1136/2523] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:46 2022] GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1 => generated 1309 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:47.283577 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a931ab44-fc65-435a-964d-99eed201da5f tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:47.283577 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a931ab44-fc65-435a-964d-99eed201da5f tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] [instance: 912ca661-97cc-457c-bf67-2250ef30eb43] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:47.286152 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a931ab44-fc65-435a-964d-99eed201da5f tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:47.286641 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a931ab44-fc65-435a-964d-99eed201da5f tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:47.287075 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a931ab44-fc65-435a-964d-99eed201da5f tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:47.288060 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a931ab44-fc65-435a-964d-99eed201da5f tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:47.288585 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a931ab44-fc65-435a-964d-99eed201da5f tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:47.289127 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a931ab44-fc65-435a-964d-99eed201da5f tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:47.717390 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a931ab44-fc65-435a-964d-99eed201da5f tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093384280c5448f6af8915b37082e14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22296c942ac648039f202269c9d64749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:47.752086 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a931ab44-fc65-435a-964d-99eed201da5f tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] 10.222.0.39 "GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43" status: 200 len: 1317 microversion: 2.1 time: 0.480226 Aug 07 01:21:47.771716 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1137/2524] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:47 2022] GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43 => generated 1317 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:47.786324 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5e9e2f4b-0c7b-43fa-a66e-a741d8e3969f tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] Calling method '.version_select at 0x7f9e17f15dc0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:47.890648 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5e9e2f4b-0c7b-43fa-a66e-a741d8e3969f tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] 10.222.0.39 "GET /compute/v2.1/images/487da344-f342-43e6-86c4-a8b72534f07c/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.117072 Aug 07 01:21:47.891940 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1138/2525] 10.222.0.39 () {58 vars in 1290 bytes} [Sun Aug 7 01:21:47 2022] GET /compute/v2.1/images/487da344-f342-43e6-86c4-a8b72534f07c/metadata/os_distro => generated 33 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:21:47.908489 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ef8090fa-e7c6-4d41-aded-bd2f366d6994 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-325146508", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "96e42e16-0d31-4d83-892c-76ee856b3f83"}, {"uuid": "1c704c0f-9061-4885-8902-bee9427e119d"}, {"uuid": "96e42e16-0d31-4d83-892c-76ee856b3f83"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:48.061418 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-ef8090fa-e7c6-4d41-aded-bd2f366d6994 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] validate_networks() for [('96e42e16-0d31-4d83-892c-76ee856b3f83', None, None, None, None, None), ('1c704c0f-9061-4885-8902-bee9427e119d', None, None, None, None, None), ('96e42e16-0d31-4d83-892c-76ee856b3f83', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:21:49.894809 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-ef8090fa-e7c6-4d41-aded-bd2f366d6994 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:21:49.896367 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-ef8090fa-e7c6-4d41-aded-bd2f366d6994 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:21:49.897627 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-ef8090fa-e7c6-4d41-aded-bd2f366d6994 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:21:49.898265 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-ef8090fa-e7c6-4d41-aded-bd2f366d6994 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:21:49.899499 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-ef8090fa-e7c6-4d41-aded-bd2f366d6994 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:21:49.919453 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=37 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:49.931957 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ef8090fa-e7c6-4d41-aded-bd2f366d6994 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:49.932827 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ef8090fa-e7c6-4d41-aded-bd2f366d6994 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:49.935279 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ef8090fa-e7c6-4d41-aded-bd2f366d6994 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:49.936694 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ef8090fa-e7c6-4d41-aded-bd2f366d6994 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:49.937563 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ef8090fa-e7c6-4d41-aded-bd2f366d6994 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:49.938323 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ef8090fa-e7c6-4d41-aded-bd2f366d6994 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:49.972814 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-ef8090fa-e7c6-4d41-aded-bd2f366d6994 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Getting quotas for project 7e166fb219464337af5e274671580d80. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:21:49.983210 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-ef8090fa-e7c6-4d41-aded-bd2f366d6994 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Getting quotas for user d60a6557665a43cda4a64a83c92e2998 and project 7e166fb219464337af5e274671580d80. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:21:50.021510 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ef8090fa-e7c6-4d41-aded-bd2f366d6994 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:21:50.025288 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ef8090fa-e7c6-4d41-aded-bd2f366d6994 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 72538b92-6b72-4a50-96da-74b7d88bcd3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:21:50.144815 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ef8090fa-e7c6-4d41-aded-bd2f366d6994 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.246797 Aug 07 01:21:50.146193 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1139/2526] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:21:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2253 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:21:50.159113 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-69c9128a-e730-4c1c-aeae-f78fff70501a tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] Action: 'update_all', calling method: .version_select at 0x7f9e24baf550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:50.267092 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-69c9128a-e730-4c1c-aeae-f78fff70501a tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] Getting quotas for project c34f5e0602134ef7ae2eaf6a05f82c32. Resources: dict_keys(['metadata_items']) {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:21:50.279693 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-69c9128a-e730-4c1c-aeae-f78fff70501a tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] Getting quotas for user 3adbb2fc6f6a48b39962545bb8de46c8 and project c34f5e0602134ef7ae2eaf6a05f82c32. Resources: dict_keys(['metadata_items']) {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:21:50.681963 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-ebd6ad1f-2392-48f6-898b-a3b5184aad5a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: ee42a97e-a680-4b64-bbfa-df12eba6dcde] Building network info cache for instance {{(pid=119516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 07 01:21:50.704316 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-69c9128a-e730-4c1c-aeae-f78fff70501a tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] 10.222.0.39 "PUT /compute/v2.1/images/487da344-f342-43e6-86c4-a8b72534f07c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.556715 Aug 07 01:21:50.705108 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1140/2527] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Aug 7 01:21:50 2022] PUT /compute/v2.1/images/487da344-f342-43e6-86c4-a8b72534f07c/metadata => generated 61 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:21:50.723655 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-83556bb5-4f91-4547-b72d-85ca8b4de70a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:50.724484 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-83556bb5-4f91-4547-b72d-85ca8b4de70a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: b8da873d-12c6-4107-bb72-49b6cef897e1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:50.765638 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-83556bb5-4f91-4547-b72d-85ca8b4de70a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:50.766490 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-83556bb5-4f91-4547-b72d-85ca8b4de70a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:50.766992 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-83556bb5-4f91-4547-b72d-85ca8b4de70a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:50.772654 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-83556bb5-4f91-4547-b72d-85ca8b4de70a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:50.773457 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-83556bb5-4f91-4547-b72d-85ca8b4de70a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:50.775778 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-83556bb5-4f91-4547-b72d-85ca8b4de70a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:51.263461 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-83556bb5-4f91-4547-b72d-85ca8b4de70a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:51.282659 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-83556bb5-4f91-4547-b72d-85ca8b4de70a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1" status: 200 len: 1309 microversion: 2.1 time: 0.570343 Aug 07 01:21:51.284031 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1141/2528] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:50 2022] GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1 => generated 1309 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:51.310630 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d12ef053-f327-4057-9595-956d7ded93b4 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:51.312975 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d12ef053-f327-4057-9595-956d7ded93b4 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] [instance: 912ca661-97cc-457c-bf67-2250ef30eb43] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:51.349433 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d12ef053-f327-4057-9595-956d7ded93b4 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:51.353427 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d12ef053-f327-4057-9595-956d7ded93b4 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:51.354644 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d12ef053-f327-4057-9595-956d7ded93b4 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:51.356167 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d12ef053-f327-4057-9595-956d7ded93b4 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:51.356939 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d12ef053-f327-4057-9595-956d7ded93b4 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:51.359418 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d12ef053-f327-4057-9595-956d7ded93b4 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:51.750052 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d12ef053-f327-4057-9595-956d7ded93b4 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093384280c5448f6af8915b37082e14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22296c942ac648039f202269c9d64749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:51.769571 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d12ef053-f327-4057-9595-956d7ded93b4 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] 10.222.0.39 "GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43" status: 200 len: 1317 microversion: 2.1 time: 0.478356 Aug 07 01:21:51.770576 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1142/2529] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:51 2022] GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43 => generated 1317 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:51.787395 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ff06558c-4eb3-4225-8740-f5fcff575203 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:51.789966 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ff06558c-4eb3-4225-8740-f5fcff575203 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 72538b92-6b72-4a50-96da-74b7d88bcd3c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:51.806771 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ff06558c-4eb3-4225-8740-f5fcff575203 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:51.810918 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ff06558c-4eb3-4225-8740-f5fcff575203 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:51.811694 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ff06558c-4eb3-4225-8740-f5fcff575203 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:51.815950 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ff06558c-4eb3-4225-8740-f5fcff575203 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:51.817714 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ff06558c-4eb3-4225-8740-f5fcff575203 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:51.820564 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ff06558c-4eb3-4225-8740-f5fcff575203 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:52.074551 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ff06558c-4eb3-4225-8740-f5fcff575203 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:52.090868 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ff06558c-4eb3-4225-8740-f5fcff575203 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c" status: 200 len: 1208 microversion: 2.1 time: 0.318049 Aug 07 01:21:52.092800 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1143/2530] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:51 2022] GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c => generated 1208 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:52.156339 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-55ca7b9e-ca7d-4f61-829b-65bd48897321 req-2567791d-75e7-45e9-a80a-c28170a2b1d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee42a97e-a680-4b64-bbfa-df12eba6dcde", "tag": "8a25057f-4c60-4889-8490-fb06550888b8"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:52.194505 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-55ca7b9e-ca7d-4f61-829b-65bd48897321 req-2567791d-75e7-45e9-a80a-c28170a2b1d6 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:52.195344 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-55ca7b9e-ca7d-4f61-829b-65bd48897321 req-2567791d-75e7-45e9-a80a-c28170a2b1d6 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:52.196504 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-55ca7b9e-ca7d-4f61-829b-65bd48897321 req-2567791d-75e7-45e9-a80a-c28170a2b1d6 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:52.244806 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-55ca7b9e-ca7d-4f61-829b-65bd48897321 req-2567791d-75e7-45e9-a80a-c28170a2b1d6 service nova] Creating event network-changed:8a25057f-4c60-4889-8490-fb06550888b8 for instance ee42a97e-a680-4b64-bbfa-df12eba6dcde on n-h1-master-1 Aug 07 01:21:52.273792 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-55ca7b9e-ca7d-4f61-829b-65bd48897321 req-2567791d-75e7-45e9-a80a-c28170a2b1d6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175482 Aug 07 01:21:52.279341 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1144/2531] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:21:52.321792 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1b96c3c1-3bf6-4e6b-b8ad-995218ea0dde tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] Calling method '.version_select at 0x7f9e246b71f0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:52.419706 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1b96c3c1-3bf6-4e6b-b8ad-995218ea0dde tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] 10.222.0.39 "GET /compute/v2.1/images/487da344-f342-43e6-86c4-a8b72534f07c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.124033 Aug 07 01:21:52.421672 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1145/2532] 10.222.0.39 () {58 vars in 1260 bytes} [Sun Aug 7 01:21:52 2022] GET /compute/v2.1/images/487da344-f342-43e6-86c4-a8b72534f07c/metadata => generated 61 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:21:52.430953 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5def6976-d626-4d81-84f3-946393e3016a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:52.431644 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5def6976-d626-4d81-84f3-946393e3016a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: b8da873d-12c6-4107-bb72-49b6cef897e1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:52.453200 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5def6976-d626-4d81-84f3-946393e3016a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:52.453710 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5def6976-d626-4d81-84f3-946393e3016a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:52.455060 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5def6976-d626-4d81-84f3-946393e3016a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:52.456579 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5def6976-d626-4d81-84f3-946393e3016a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:52.457061 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5def6976-d626-4d81-84f3-946393e3016a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:52.457485 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5def6976-d626-4d81-84f3-946393e3016a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:52.780107 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5def6976-d626-4d81-84f3-946393e3016a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:52.795150 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5def6976-d626-4d81-84f3-946393e3016a tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1" status: 200 len: 1309 microversion: 2.1 time: 0.373073 Aug 07 01:21:52.795777 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1146/2533] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:52 2022] GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1 => generated 1309 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:52.811230 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3e9d3610-9b10-41a7-8e2e-d3f3168ed4dc tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] Action: 'update_all', calling method: .version_select at 0x7f9e2407d310>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:52.948547 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-3e9d3610-9b10-41a7-8e2e-d3f3168ed4dc tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] Getting quotas for project c34f5e0602134ef7ae2eaf6a05f82c32. Resources: dict_keys(['metadata_items']) {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:21:53.018911 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-3e9d3610-9b10-41a7-8e2e-d3f3168ed4dc tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] Getting quotas for user 3adbb2fc6f6a48b39962545bb8de46c8 and project c34f5e0602134ef7ae2eaf6a05f82c32. Resources: dict_keys(['metadata_items']) {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:21:53.350357 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3e9d3610-9b10-41a7-8e2e-d3f3168ed4dc tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] 10.222.0.39 "PUT /compute/v2.1/images/487da344-f342-43e6-86c4-a8b72534f07c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.553376 Aug 07 01:21:53.351186 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1147/2534] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Aug 7 01:21:52 2022] PUT /compute/v2.1/images/487da344-f342-43e6-86c4-a8b72534f07c/metadata => generated 61 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:21:53.364273 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0be2cf0f-3e5e-41a3-b4cd-3c3e0b777b67 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:53.364933 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0be2cf0f-3e5e-41a3-b4cd-3c3e0b777b67 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] [instance: 912ca661-97cc-457c-bf67-2250ef30eb43] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:53.382523 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0be2cf0f-3e5e-41a3-b4cd-3c3e0b777b67 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:53.383030 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0be2cf0f-3e5e-41a3-b4cd-3c3e0b777b67 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:53.383487 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0be2cf0f-3e5e-41a3-b4cd-3c3e0b777b67 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:53.384303 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0be2cf0f-3e5e-41a3-b4cd-3c3e0b777b67 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:53.385228 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0be2cf0f-3e5e-41a3-b4cd-3c3e0b777b67 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:53.386581 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0be2cf0f-3e5e-41a3-b4cd-3c3e0b777b67 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:53.673887 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0be2cf0f-3e5e-41a3-b4cd-3c3e0b777b67 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093384280c5448f6af8915b37082e14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22296c942ac648039f202269c9d64749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:53.691372 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0be2cf0f-3e5e-41a3-b4cd-3c3e0b777b67 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] 10.222.0.39 "GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43" status: 200 len: 1317 microversion: 2.1 time: 0.331381 Aug 07 01:21:53.693665 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1148/2535] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:53 2022] GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43 => generated 1317 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:53.700001 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-15e5778e-748e-416c-83d1-f5be8fc9725e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:53.701123 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-15e5778e-748e-416c-83d1-f5be8fc9725e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 72538b92-6b72-4a50-96da-74b7d88bcd3c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:53.714285 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15e5778e-748e-416c-83d1-f5be8fc9725e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:53.715182 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15e5778e-748e-416c-83d1-f5be8fc9725e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:53.715753 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15e5778e-748e-416c-83d1-f5be8fc9725e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:53.732465 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15e5778e-748e-416c-83d1-f5be8fc9725e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:53.733225 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15e5778e-748e-416c-83d1-f5be8fc9725e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:53.733920 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15e5778e-748e-416c-83d1-f5be8fc9725e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:53.890437 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-15e5778e-748e-416c-83d1-f5be8fc9725e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:53.903118 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-15e5778e-748e-416c-83d1-f5be8fc9725e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c" status: 200 len: 1270 microversion: 2.1 time: 0.207539 Aug 07 01:21:53.904373 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1149/2536] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:53 2022] GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c => generated 1270 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:53.910260 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-28011d94-aa3f-4fe4-93d2-255db6331de2 tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] Action: 'update_all', calling method: .version_select at 0x7f9e24882ee0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:54.023553 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-28011d94-aa3f-4fe4-93d2-255db6331de2 tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] Getting quotas for project c34f5e0602134ef7ae2eaf6a05f82c32. Resources: dict_keys(['metadata_items']) {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:21:54.030561 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-28011d94-aa3f-4fe4-93d2-255db6331de2 tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] Getting quotas for user 3adbb2fc6f6a48b39962545bb8de46c8 and project c34f5e0602134ef7ae2eaf6a05f82c32. Resources: dict_keys(['metadata_items']) {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:21:54.349693 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-ebd6ad1f-2392-48f6-898b-a3b5184aad5a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: ee42a97e-a680-4b64-bbfa-df12eba6dcde] Updating instance_info_cache with network_info: [{"id": "8a25057f-4c60-4889-8490-fb06550888b8", "address": "fa:16:3e:d8:4a:b0", "network": {"id": "6c5c235e-c2e8-41e7-9759-0dbd7d7d0e8a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1070683176-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "afc8a87d755a42239e9d4572e4bf2f2d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8a25057f-4c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 07 01:21:54.369932 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ebd6ad1f-2392-48f6-898b-a3b5184aad5a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Releasing lock "refresh_cache-ee42a97e-a680-4b64-bbfa-df12eba6dcde" {{(pid=119516) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 07 01:21:54.373405 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ebd6ad1f-2392-48f6-898b-a3b5184aad5a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "POST /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde/action" status: 202 len: 0 microversion: 2.1 time: 9.002800 Aug 07 01:21:54.381453 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1388/2537] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:21:45 2022] POST /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde/action => generated 0 bytes in 9011 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 07 01:21:54.388915 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-213b84df-8f34-4a1b-8f3d-855ec42ae1fd req-ac15c0e2-ce3a-4dbe-88ca-7b1b9c29946a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8da873d-12c6-4107-bb72-49b6cef897e1", "name": "network-vif-plugged", "status": "completed", "tag": "0f8e1eea-f5ca-442c-81a5-6d667ac5e6f8"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:54.402323 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-213b84df-8f34-4a1b-8f3d-855ec42ae1fd req-ac15c0e2-ce3a-4dbe-88ca-7b1b9c29946a service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:54.409284 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-213b84df-8f34-4a1b-8f3d-855ec42ae1fd req-ac15c0e2-ce3a-4dbe-88ca-7b1b9c29946a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:54.410264 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-213b84df-8f34-4a1b-8f3d-855ec42ae1fd req-ac15c0e2-ce3a-4dbe-88ca-7b1b9c29946a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:54.427418 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-213b84df-8f34-4a1b-8f3d-855ec42ae1fd req-ac15c0e2-ce3a-4dbe-88ca-7b1b9c29946a service nova] Creating event network-vif-plugged:0f8e1eea-f5ca-442c-81a5-6d667ac5e6f8 for instance b8da873d-12c6-4107-bb72-49b6cef897e1 on n-h1-master-1 Aug 07 01:21:54.436433 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-213b84df-8f34-4a1b-8f3d-855ec42ae1fd req-ac15c0e2-ce3a-4dbe-88ca-7b1b9c29946a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050864 Aug 07 01:21:54.437488 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1389/2538] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:21:54.446472 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-944f6b2a-7226-407f-a904-076cf9497b2f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:54.453414 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-944f6b2a-7226-407f-a904-076cf9497b2f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: b8da873d-12c6-4107-bb72-49b6cef897e1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:54.465760 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-944f6b2a-7226-407f-a904-076cf9497b2f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:54.468344 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-944f6b2a-7226-407f-a904-076cf9497b2f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:54.470121 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-944f6b2a-7226-407f-a904-076cf9497b2f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:54.492012 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-944f6b2a-7226-407f-a904-076cf9497b2f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:54.508343 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-944f6b2a-7226-407f-a904-076cf9497b2f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:54.510370 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-944f6b2a-7226-407f-a904-076cf9497b2f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:54.620339 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-28011d94-aa3f-4fe4-93d2-255db6331de2 tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] 10.222.0.39 "PUT /compute/v2.1/images/487da344-f342-43e6-86c4-a8b72534f07c/metadata" status: 200 len: 64 microversion: 2.1 time: 0.714231 Aug 07 01:21:54.620950 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1150/2539] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Aug 7 01:21:53 2022] PUT /compute/v2.1/images/487da344-f342-43e6-86c4-a8b72534f07c/metadata => generated 64 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:21:54.629908 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c2cb2b56-2462-46fe-8dce-b2d5105697ee tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Action: 'action', calling method: .version_select at 0x7f9e273b0d30>, body: {"addFloatingIp": {"address": "172.35.4.107"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:54.641714 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c2cb2b56-2462-46fe-8dce-b2d5105697ee tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: aa4e1c13-c268-4138-ad4e-8627558931bf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:54.652383 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2cb2b56-2462-46fe-8dce-b2d5105697ee tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:54.654672 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2cb2b56-2462-46fe-8dce-b2d5105697ee tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:54.656227 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2cb2b56-2462-46fe-8dce-b2d5105697ee tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:54.659005 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2cb2b56-2462-46fe-8dce-b2d5105697ee tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:54.667265 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2cb2b56-2462-46fe-8dce-b2d5105697ee tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:54.668478 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2cb2b56-2462-46fe-8dce-b2d5105697ee tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:54.782017 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2cb2b56-2462-46fe-8dce-b2d5105697ee tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "refresh_cache-aa4e1c13-c268-4138-ad4e-8627558931bf" {{(pid=119517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 07 01:21:54.782334 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2cb2b56-2462-46fe-8dce-b2d5105697ee tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquired lock "refresh_cache-aa4e1c13-c268-4138-ad4e-8627558931bf" {{(pid=119517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 07 01:21:55.600000 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-944f6b2a-7226-407f-a904-076cf9497b2f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:55.613162 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-944f6b2a-7226-407f-a904-076cf9497b2f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1" status: 200 len: 1309 microversion: 2.1 time: 1.173305 Aug 07 01:21:55.615246 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1390/2540] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:54 2022] GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1 => generated 1309 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:55.626208 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-52a468a1-fa7f-41bf-bd3a-9c8e507b8a5f tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] Calling method '.version_select at 0x7f9e17aafdc0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:55.711285 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-52a468a1-fa7f-41bf-bd3a-9c8e507b8a5f tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] 10.222.0.39 "GET /compute/v2.1/images/487da344-f342-43e6-86c4-a8b72534f07c/metadata" status: 200 len: 64 microversion: 2.1 time: 0.092752 Aug 07 01:21:55.712721 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1391/2541] 10.222.0.39 () {58 vars in 1260 bytes} [Sun Aug 7 01:21:55 2022] GET /compute/v2.1/images/487da344-f342-43e6-86c4-a8b72534f07c/metadata => generated 64 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:21:55.721194 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0c7ecc4a-a241-4847-bbee-b3cfafc99ad1 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:55.724056 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0c7ecc4a-a241-4847-bbee-b3cfafc99ad1 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] [instance: 912ca661-97cc-457c-bf67-2250ef30eb43] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:55.742681 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c7ecc4a-a241-4847-bbee-b3cfafc99ad1 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:55.744244 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c7ecc4a-a241-4847-bbee-b3cfafc99ad1 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:55.745032 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c7ecc4a-a241-4847-bbee-b3cfafc99ad1 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:55.748563 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c7ecc4a-a241-4847-bbee-b3cfafc99ad1 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:55.749114 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c7ecc4a-a241-4847-bbee-b3cfafc99ad1 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:55.749832 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c7ecc4a-a241-4847-bbee-b3cfafc99ad1 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:56.274640 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0c7ecc4a-a241-4847-bbee-b3cfafc99ad1 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093384280c5448f6af8915b37082e14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22296c942ac648039f202269c9d64749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:56.287759 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0c7ecc4a-a241-4847-bbee-b3cfafc99ad1 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] 10.222.0.39 "GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43" status: 200 len: 1317 microversion: 2.1 time: 0.573704 Aug 07 01:21:56.301671 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1392/2542] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:55 2022] GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43 => generated 1317 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:56.309041 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2b94d3b0-e648-4240-80f8-bafd9585f43f tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:56.314344 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2b94d3b0-e648-4240-80f8-bafd9585f43f tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 72538b92-6b72-4a50-96da-74b7d88bcd3c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:56.322737 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2b94d3b0-e648-4240-80f8-bafd9585f43f tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:56.328636 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2b94d3b0-e648-4240-80f8-bafd9585f43f tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:56.331027 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2b94d3b0-e648-4240-80f8-bafd9585f43f tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:56.331999 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2b94d3b0-e648-4240-80f8-bafd9585f43f tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:56.334349 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2b94d3b0-e648-4240-80f8-bafd9585f43f tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:56.334980 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2b94d3b0-e648-4240-80f8-bafd9585f43f tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:56.748444 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2b94d3b0-e648-4240-80f8-bafd9585f43f tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:56.763843 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2b94d3b0-e648-4240-80f8-bafd9585f43f tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c" status: 200 len: 1312 microversion: 2.1 time: 0.460668 Aug 07 01:21:56.773325 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1393/2543] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:56 2022] GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c => generated 1312 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:56.789612 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e5cfd3c7-ce74-40f6-9dba-af4114387a6b tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] Action: 'update_all', calling method: .version_select at 0x7f9e2401a700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:56.948916 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-e5cfd3c7-ce74-40f6-9dba-af4114387a6b tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] Getting quotas for project c34f5e0602134ef7ae2eaf6a05f82c32. Resources: dict_keys(['metadata_items']) {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:21:56.969839 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-e5cfd3c7-ce74-40f6-9dba-af4114387a6b tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] Getting quotas for user 3adbb2fc6f6a48b39962545bb8de46c8 and project c34f5e0602134ef7ae2eaf6a05f82c32. Resources: dict_keys(['metadata_items']) {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:21:57.637817 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e5cfd3c7-ce74-40f6-9dba-af4114387a6b tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] 10.222.0.39 "PUT /compute/v2.1/images/487da344-f342-43e6-86c4-a8b72534f07c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.862966 Aug 07 01:21:57.638983 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1394/2544] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Aug 7 01:21:56 2022] PUT /compute/v2.1/images/487da344-f342-43e6-86c4-a8b72534f07c/metadata => generated 61 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:21:57.947386 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ed404a20-6c02-4e67-835b-6829dbc362bd tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Action: 'create', calling method: .version_select at 0x7f9e17aeac10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-179833216", "description": "tempest-description-1050981130"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:58.536721 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ed404a20-6c02-4e67-835b-6829dbc362bd tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.895350 Aug 07 01:21:58.540586 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1395/2545] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Aug 7 01:21:57 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:21:58.546227 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-baa47cbb-61e7-4b67-a363-59689f2937fc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:58.547127 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-baa47cbb-61e7-4b67-a363-59689f2937fc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: b8da873d-12c6-4107-bb72-49b6cef897e1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:58.565995 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-baa47cbb-61e7-4b67-a363-59689f2937fc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:58.566504 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-baa47cbb-61e7-4b67-a363-59689f2937fc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:58.570508 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-baa47cbb-61e7-4b67-a363-59689f2937fc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:58.572238 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-baa47cbb-61e7-4b67-a363-59689f2937fc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:58.574845 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-baa47cbb-61e7-4b67-a363-59689f2937fc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:58.576245 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-baa47cbb-61e7-4b67-a363-59689f2937fc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:58.842368 n-d-master-1 devstack@n-api.service[119517]: INFO nova.network.neutron [None req-c2cb2b56-2462-46fe-8dce-b2d5105697ee tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: aa4e1c13-c268-4138-ad4e-8627558931bf] re-assign floating IP 172.35.4.107 from instance ee42a97e-a680-4b64-bbfa-df12eba6dcde Aug 07 01:21:58.942182 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-c2cb2b56-2462-46fe-8dce-b2d5105697ee tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: ee42a97e-a680-4b64-bbfa-df12eba6dcde] Building network info cache for instance {{(pid=119517) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 07 01:21:58.948425 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-baa47cbb-61e7-4b67-a363-59689f2937fc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:58.961644 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-baa47cbb-61e7-4b67-a363-59689f2937fc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1" status: 200 len: 1489 microversion: 2.1 time: 0.419472 Aug 07 01:21:58.964613 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1396/2546] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:58 2022] GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1 => generated 1489 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:58.977773 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4012b6e8-35a0-4c5e-a237-b29de6e3d159 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:58.978452 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4012b6e8-35a0-4c5e-a237-b29de6e3d159 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] [instance: 912ca661-97cc-457c-bf67-2250ef30eb43] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:21:58.995451 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4012b6e8-35a0-4c5e-a237-b29de6e3d159 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:58.995451 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4012b6e8-35a0-4c5e-a237-b29de6e3d159 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:58.995919 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4012b6e8-35a0-4c5e-a237-b29de6e3d159 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:58.996681 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4012b6e8-35a0-4c5e-a237-b29de6e3d159 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:59.005145 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4012b6e8-35a0-4c5e-a237-b29de6e3d159 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:59.005724 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4012b6e8-35a0-4c5e-a237-b29de6e3d159 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:59.335245 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4012b6e8-35a0-4c5e-a237-b29de6e3d159 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093384280c5448f6af8915b37082e14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22296c942ac648039f202269c9d64749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:59.348831 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4012b6e8-35a0-4c5e-a237-b29de6e3d159 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] 10.222.0.39 "GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43" status: 200 len: 1317 microversion: 2.1 time: 0.382764 Aug 07 01:21:59.355577 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1397/2547] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:21:58 2022] GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43 => generated 1317 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:21:59.360893 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e7a65dd8-d335-409f-985a-1486dd3e5af7 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:21:59.370400 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e7a65dd8-d335-409f-985a-1486dd3e5af7 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e4feb14c621b4090af8c965c9aaf0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06e7912f1fe423ea1b2a4bcdb90804a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:21:59.375851 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e7a65dd8-d335-409f-985a-1486dd3e5af7 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Searching by: {'deleted': False, 'project_id': 'b06e7912f1fe423ea1b2a4bcdb90804a'} {{(pid=119516) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:21:59.390526 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7a65dd8-d335-409f-985a-1486dd3e5af7 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:59.390972 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7a65dd8-d335-409f-985a-1486dd3e5af7 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:59.391419 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7a65dd8-d335-409f-985a-1486dd3e5af7 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:59.392222 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7a65dd8-d335-409f-985a-1486dd3e5af7 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:21:59.392694 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7a65dd8-d335-409f-985a-1486dd3e5af7 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:21:59.393124 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7a65dd8-d335-409f-985a-1486dd3e5af7 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:21:59.456296 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.multi_cell_list [None req-e7a65dd8-d335-409f-985a-1486dd3e5af7 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 01:21:59.546091 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e7a65dd8-d335-409f-985a-1486dd3e5af7 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.188907 Aug 07 01:21:59.555862 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1398/2548] 10.222.0.39 () {58 vars in 1125 bytes} [Sun Aug 7 01:21:59 2022] GET /compute/v2.1/servers => generated 343 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:21:59.568194 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cde4e57e-1e47-42c5-92cc-414edd84e7ba tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] Action: 'update', calling method: .version_select at 0x7f9e17aae040>, body: {"meta": {"os_version": "alt"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:21:59.686194 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-cde4e57e-1e47-42c5-92cc-414edd84e7ba tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] Getting quotas for project c34f5e0602134ef7ae2eaf6a05f82c32. Resources: dict_keys(['metadata_items']) {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:21:59.701434 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-cde4e57e-1e47-42c5-92cc-414edd84e7ba tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] Getting quotas for user 3adbb2fc6f6a48b39962545bb8de46c8 and project c34f5e0602134ef7ae2eaf6a05f82c32. Resources: dict_keys(['metadata_items']) {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:21:59.954696 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:00.064004 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-c2cb2b56-2462-46fe-8dce-b2d5105697ee tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: ee42a97e-a680-4b64-bbfa-df12eba6dcde] Updating instance_info_cache with network_info: [{"id": "8a25057f-4c60-4889-8490-fb06550888b8", "address": "fa:16:3e:d8:4a:b0", "network": {"id": "6c5c235e-c2e8-41e7-9759-0dbd7d7d0e8a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1070683176-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "afc8a87d755a42239e9d4572e4bf2f2d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8a25057f-4c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119517) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 07 01:22:00.106225 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-c2cb2b56-2462-46fe-8dce-b2d5105697ee tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: aa4e1c13-c268-4138-ad4e-8627558931bf] Building network info cache for instance {{(pid=119517) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 07 01:22:00.259438 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cde4e57e-1e47-42c5-92cc-414edd84e7ba tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] 10.222.0.39 "PUT /compute/v2.1/images/487da344-f342-43e6-86c4-a8b72534f07c/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.695568 Aug 07 01:22:00.260724 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1399/2549] 10.222.0.39 () {60 vars in 1313 bytes} [Sun Aug 7 01:21:59 2022] PUT /compute/v2.1/images/487da344-f342-43e6-86c4-a8b72534f07c/metadata/os_version => generated 31 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:22:00.266358 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-306e60a4-5f3c-4b28-9823-8655acd17813 req-d8e30187-2d54-4276-995c-bffbc03ed7b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "912ca661-97cc-457c-bf67-2250ef30eb43", "name": "network-vif-plugged", "status": "completed", "tag": "27dafc12-f662-4012-9662-c3a303b1320d"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:00.279330 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:00.298852 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-306e60a4-5f3c-4b28-9823-8655acd17813 req-d8e30187-2d54-4276-995c-bffbc03ed7b0 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:00.299455 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-306e60a4-5f3c-4b28-9823-8655acd17813 req-d8e30187-2d54-4276-995c-bffbc03ed7b0 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:00.299912 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-306e60a4-5f3c-4b28-9823-8655acd17813 req-d8e30187-2d54-4276-995c-bffbc03ed7b0 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:00.369282 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-306e60a4-5f3c-4b28-9823-8655acd17813 req-d8e30187-2d54-4276-995c-bffbc03ed7b0 service nova] Creating event network-vif-plugged:27dafc12-f662-4012-9662-c3a303b1320d for instance 912ca661-97cc-457c-bf67-2250ef30eb43 on n-h1-master-1 Aug 07 01:22:00.389034 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-306e60a4-5f3c-4b28-9823-8655acd17813 req-d8e30187-2d54-4276-995c-bffbc03ed7b0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126907 Aug 07 01:22:00.389668 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1400/2550] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:00.407678 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-af170d01-02a2-4137-a6fe-844e88a48b92 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:00.411706 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-af170d01-02a2-4137-a6fe-844e88a48b92 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 72538b92-6b72-4a50-96da-74b7d88bcd3c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:00.437110 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af170d01-02a2-4137-a6fe-844e88a48b92 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:00.437726 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af170d01-02a2-4137-a6fe-844e88a48b92 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:00.438186 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af170d01-02a2-4137-a6fe-844e88a48b92 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:00.439239 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af170d01-02a2-4137-a6fe-844e88a48b92 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:00.439756 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af170d01-02a2-4137-a6fe-844e88a48b92 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:00.440286 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af170d01-02a2-4137-a6fe-844e88a48b92 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:01.130518 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-c2cb2b56-2462-46fe-8dce-b2d5105697ee tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: aa4e1c13-c268-4138-ad4e-8627558931bf] Updating instance_info_cache with network_info: [{"id": "e962044b-2b07-4716-b16b-df9c45e8c3d9", "address": "fa:16:3e:5c:ae:f6", "network": {"id": "6c5c235e-c2e8-41e7-9759-0dbd7d7d0e8a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1070683176-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "afc8a87d755a42239e9d4572e4bf2f2d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape962044b-2b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119517) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 07 01:22:01.150848 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-af170d01-02a2-4137-a6fe-844e88a48b92 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:01.156601 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2cb2b56-2462-46fe-8dce-b2d5105697ee tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Releasing lock "refresh_cache-aa4e1c13-c268-4138-ad4e-8627558931bf" {{(pid=119517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 07 01:22:01.157802 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c2cb2b56-2462-46fe-8dce-b2d5105697ee tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "POST /compute/v2.1/servers/aa4e1c13-c268-4138-ad4e-8627558931bf/action" status: 202 len: 0 microversion: 2.1 time: 6.535450 Aug 07 01:22:01.158511 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1151/2551] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:21:54 2022] POST /compute/v2.1/servers/aa4e1c13-c268-4138-ad4e-8627558931bf/action => generated 0 bytes in 6537 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 07 01:22:01.164106 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-62d969f4-de65-4ef7-9ff0-97c7e17c793d tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Action: 'create', calling method: .version_select at 0x7f9e24694940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-670941133", "description": "tempest-description-1281363758"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:01.172726 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-af170d01-02a2-4137-a6fe-844e88a48b92 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c" status: 200 len: 1354 microversion: 2.1 time: 0.779874 Aug 07 01:22:01.174246 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1401/2552] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:00 2022] GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c => generated 1354 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:01.216914 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-6a782113-9919-4150-9f66-444467c42665 req-c5e9cdc7-374b-4799-8d72-19ff72620571 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee42a97e-a680-4b64-bbfa-df12eba6dcde", "tag": "8a25057f-4c60-4889-8490-fb06550888b8"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:01.256079 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6a782113-9919-4150-9f66-444467c42665 req-c5e9cdc7-374b-4799-8d72-19ff72620571 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:01.256992 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6a782113-9919-4150-9f66-444467c42665 req-c5e9cdc7-374b-4799-8d72-19ff72620571 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:01.257446 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6a782113-9919-4150-9f66-444467c42665 req-c5e9cdc7-374b-4799-8d72-19ff72620571 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:01.283303 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-6a782113-9919-4150-9f66-444467c42665 req-c5e9cdc7-374b-4799-8d72-19ff72620571 service nova] Creating event network-changed:8a25057f-4c60-4889-8490-fb06550888b8 for instance ee42a97e-a680-4b64-bbfa-df12eba6dcde on n-h1-master-1 Aug 07 01:22:01.297308 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-6a782113-9919-4150-9f66-444467c42665 req-c5e9cdc7-374b-4799-8d72-19ff72620571 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092386 Aug 07 01:22:01.298901 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1402/2553] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:01.309056 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7a9ef34c-31d0-4676-81b2-db773b58ad05 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1574529638"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:01.317581 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7a9ef34c-31d0-4676-81b2-db773b58ad05 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: b8da873d-12c6-4107-bb72-49b6cef897e1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:01.356968 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7a9ef34c-31d0-4676-81b2-db773b58ad05 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:01.358022 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7a9ef34c-31d0-4676-81b2-db773b58ad05 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:01.358807 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7a9ef34c-31d0-4676-81b2-db773b58ad05 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:01.371785 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7a9ef34c-31d0-4676-81b2-db773b58ad05 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:01.375087 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7a9ef34c-31d0-4676-81b2-db773b58ad05 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:01.381542 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7a9ef34c-31d0-4676-81b2-db773b58ad05 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:01.507491 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-62d969f4-de65-4ef7-9ff0-97c7e17c793d tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.347464 Aug 07 01:22:01.521683 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1152/2554] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Aug 7 01:22:01 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:01.527380 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2b476165-b852-43ca-bd6a-122d5324d7b2 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:01.538561 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2b476165-b852-43ca-bd6a-122d5324d7b2 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e4feb14c621b4090af8c965c9aaf0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06e7912f1fe423ea1b2a4bcdb90804a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:01.549108 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2b476165-b852-43ca-bd6a-122d5324d7b2 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Searching by: {'deleted': False, 'project_id': 'b06e7912f1fe423ea1b2a4bcdb90804a'} {{(pid=119517) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:22:01.581574 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7a9ef34c-31d0-4676-81b2-db773b58ad05 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "PUT /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1" status: 200 len: 1074 microversion: 2.1 time: 0.271314 Aug 07 01:22:01.586943 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1403/2555] 10.222.0.39 () {60 vars in 1256 bytes} [Sun Aug 7 01:22:01 2022] PUT /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1 => generated 1074 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:01.591502 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b476165-b852-43ca-bd6a-122d5324d7b2 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:01.592688 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b476165-b852-43ca-bd6a-122d5324d7b2 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:01.593729 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b476165-b852-43ca-bd6a-122d5324d7b2 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:01.596495 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b476165-b852-43ca-bd6a-122d5324d7b2 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:01.598657 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b476165-b852-43ca-bd6a-122d5324d7b2 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:01.600383 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b476165-b852-43ca-bd6a-122d5324d7b2 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:01.604354 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e1a8fe7b-1f3b-42ab-962a-fd8274dd8a55 tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] Calling method '.version_select at 0x7f9e17aea160>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:01.684776 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.multi_cell_list [None req-2b476165-b852-43ca-bd6a-122d5324d7b2 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 01:22:01.714361 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e1a8fe7b-1f3b-42ab-962a-fd8274dd8a55 tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] 10.222.0.39 "GET /compute/v2.1/images/487da344-f342-43e6-86c4-a8b72534f07c/metadata" status: 200 len: 58 microversion: 2.1 time: 0.125738 Aug 07 01:22:01.715338 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1404/2556] 10.222.0.39 () {58 vars in 1260 bytes} [Sun Aug 7 01:22:01 2022] GET /compute/v2.1/images/487da344-f342-43e6-86c4-a8b72534f07c/metadata => generated 58 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:22:01.721542 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-93010ad6-be6a-4f06-af1b-f635e5029f81 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:01.722170 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-93010ad6-be6a-4f06-af1b-f635e5029f81 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] [instance: 912ca661-97cc-457c-bf67-2250ef30eb43] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:01.753578 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93010ad6-be6a-4f06-af1b-f635e5029f81 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:01.754089 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93010ad6-be6a-4f06-af1b-f635e5029f81 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:01.754572 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93010ad6-be6a-4f06-af1b-f635e5029f81 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:01.757251 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93010ad6-be6a-4f06-af1b-f635e5029f81 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:01.757730 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93010ad6-be6a-4f06-af1b-f635e5029f81 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:01.758276 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93010ad6-be6a-4f06-af1b-f635e5029f81 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:01.836796 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2b476165-b852-43ca-bd6a-122d5324d7b2 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4feb14c621b4090af8c965c9aaf0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06e7912f1fe423ea1b2a4bcdb90804a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:01.865903 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b476165-b852-43ca-bd6a-122d5324d7b2 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:01.867082 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b476165-b852-43ca-bd6a-122d5324d7b2 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:01.868020 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b476165-b852-43ca-bd6a-122d5324d7b2 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:02.175254 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2b476165-b852-43ca-bd6a-122d5324d7b2 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] 10.222.0.39 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 0.651516 Aug 07 01:22:02.176415 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1153/2557] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:22:01 2022] GET /compute/v2.1/servers/detail => generated 1604 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:02.190433 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-222544df-4b77-4031-8c1d-3c780b78c92e tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Action: 'action', calling method: .version_select at 0x7f9e27535700>, body: {"removeFloatingIp": {"address": "172.35.4.107"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:02.518185 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-222544df-4b77-4031-8c1d-3c780b78c92e tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: aa4e1c13-c268-4138-ad4e-8627558931bf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:02.525583 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-222544df-4b77-4031-8c1d-3c780b78c92e tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:02.526065 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-222544df-4b77-4031-8c1d-3c780b78c92e tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:02.526708 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-222544df-4b77-4031-8c1d-3c780b78c92e tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:02.531025 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-222544df-4b77-4031-8c1d-3c780b78c92e tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:02.531518 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-222544df-4b77-4031-8c1d-3c780b78c92e tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:02.531993 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-222544df-4b77-4031-8c1d-3c780b78c92e tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:03.041464 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-222544df-4b77-4031-8c1d-3c780b78c92e tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] HTTP exception thrown: Floating IP 172.35.4.107 is not associated with instance ee42a97e-a680-4b64-bbfa-df12eba6dcde. Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-222544df-4b77-4031-8c1d-3c780b78c92e tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Request method failure captured: Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde/action HTTP/1.1 Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 49 Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xNxyRFbl8-_9_nYUVdUpTgz7xbjp9TfbS1_o1roGpGmBOpk6vldBnNDFFGA21Wk90hDsWXGZI7pPE3AIOUOwXhgkSAEzupQWOiKslq0k4W6jDiEG-w8xgWWh6qRWb9brPWe34VDJ2Q-_bQzw-U6DpqRTfZ4GN04cV-v6xf1_81AWRA Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: afc8a87d755a42239e9d4572e4bf2f2d Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-629577005 Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/afc8a87d755a42239e9d4572e4bf2f2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_afc8a87d755a42239e9d4572e4bf2f2d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/afc8a87d755a42239e9d4572e4bf2f2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/afc8a87d755a42239e9d4572e4bf2f2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-629577005 Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: afc8a87d755a42239e9d4572e4bf2f2d Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-629577005 Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-FloatingIPsAssociationTestJSON-629577005-project Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 5041cbc4adc24ae8871d60064720d680 Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-629577005-project Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: {"removeFloatingIp": {"address": "172.35.4.107"}} Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: exception: Floating IP 172.35.4.107 is not associated with instance ee42a97e-a680-4b64-bbfa-df12eba6dcde. Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'ee42a97e-a680-4b64-bbfa-df12eba6dcde', 'body': {'removeFloatingIp': {'address': '172.35.4.107'}}} Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.35.4.107 is not associated with instance ee42a97e-a680-4b64-bbfa-df12eba6dcde. Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.35.4.107 is not associated with instance ee42a97e-a680-4b64-bbfa-df12eba6dcde. Aug 07 01:22:03.046810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:03.061279 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-222544df-4b77-4031-8c1d-3c780b78c92e tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Returning 409 to user: Floating IP 172.35.4.107 is not associated with instance ee42a97e-a680-4b64-bbfa-df12eba6dcde. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:22:03.061279 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-222544df-4b77-4031-8c1d-3c780b78c92e tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "POST /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde/action" status: 409 len: 146 microversion: 2.1 time: 0.871475 Aug 07 01:22:03.061279 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1154/2558] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:22:02 2022] POST /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde/action => generated 146 bytes in 874 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:22:03.061279 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1c40226f-64bf-4169-b5f6-3c87dbe89d37 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:03.061279 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1c40226f-64bf-4169-b5f6-3c87dbe89d37 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: b8da873d-12c6-4107-bb72-49b6cef897e1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:03.072297 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c40226f-64bf-4169-b5f6-3c87dbe89d37 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:03.073152 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c40226f-64bf-4169-b5f6-3c87dbe89d37 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:03.074177 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c40226f-64bf-4169-b5f6-3c87dbe89d37 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:03.075517 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c40226f-64bf-4169-b5f6-3c87dbe89d37 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:03.076385 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c40226f-64bf-4169-b5f6-3c87dbe89d37 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:03.077164 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c40226f-64bf-4169-b5f6-3c87dbe89d37 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:03.209345 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-93010ad6-be6a-4f06-af1b-f635e5029f81 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093384280c5448f6af8915b37082e14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22296c942ac648039f202269c9d64749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:03.226594 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-93010ad6-be6a-4f06-af1b-f635e5029f81 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] 10.222.0.39 "GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43" status: 200 len: 1317 microversion: 2.1 time: 1.509342 Aug 07 01:22:03.228055 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1405/2559] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:01 2022] GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43 => generated 1317 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:03.235837 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bd45bbe8-08fd-4fe1-b7d1-02d6578910d4 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-2092674326", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "9b5526ad-7601-46c0-aa73-d97eb424e744"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:03.359623 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-bd45bbe8-08fd-4fe1-b7d1-02d6578910d4 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] validate_networks() for [('9b5526ad-7601-46c0-aa73-d97eb424e744', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:22:03.402280 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1c40226f-64bf-4169-b5f6-3c87dbe89d37 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:03.416124 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1c40226f-64bf-4169-b5f6-3c87dbe89d37 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1" status: 200 len: 1500 microversion: 2.1 time: 0.363420 Aug 07 01:22:03.416718 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1155/2560] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:03 2022] GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1 => generated 1500 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:03.423143 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-82d83d02-60af-42ea-92b1-de2e254e860e req-ac8191d9-0b51-42a3-ad1a-d9601cab2cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72538b92-6b72-4a50-96da-74b7d88bcd3c", "tag": "cba8300c-9e8a-4744-a200-7888f1fca836"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:03.437970 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-82d83d02-60af-42ea-92b1-de2e254e860e req-ac8191d9-0b51-42a3-ad1a-d9601cab2cc6 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:03.438715 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-82d83d02-60af-42ea-92b1-de2e254e860e req-ac8191d9-0b51-42a3-ad1a-d9601cab2cc6 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:03.439305 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-82d83d02-60af-42ea-92b1-de2e254e860e req-ac8191d9-0b51-42a3-ad1a-d9601cab2cc6 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:03.455218 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-82d83d02-60af-42ea-92b1-de2e254e860e req-ac8191d9-0b51-42a3-ad1a-d9601cab2cc6 service nova] Creating event network-changed:cba8300c-9e8a-4744-a200-7888f1fca836 for instance 72538b92-6b72-4a50-96da-74b7d88bcd3c on n-h2-master-1 Aug 07 01:22:03.461491 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-82d83d02-60af-42ea-92b1-de2e254e860e req-ac8191d9-0b51-42a3-ad1a-d9601cab2cc6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043025 Aug 07 01:22:03.463994 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1156/2561] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:03.476387 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1f36fa8f-a6cf-4ddc-b72d-97777859c65f tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] Action: 'update_all', calling method: .version_select at 0x7f9e24589ee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:03.573829 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-1f36fa8f-a6cf-4ddc-b72d-97777859c65f tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] Getting quotas for project c34f5e0602134ef7ae2eaf6a05f82c32. Resources: dict_keys(['metadata_items']) {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:22:03.584997 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-1f36fa8f-a6cf-4ddc-b72d-97777859c65f tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] Getting quotas for user 3adbb2fc6f6a48b39962545bb8de46c8 and project c34f5e0602134ef7ae2eaf6a05f82c32. Resources: dict_keys(['metadata_items']) {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:22:03.964674 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1f36fa8f-a6cf-4ddc-b72d-97777859c65f tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] 10.222.0.39 "PUT /compute/v2.1/images/487da344-f342-43e6-86c4-a8b72534f07c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.498070 Aug 07 01:22:03.966031 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1157/2562] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Aug 7 01:22:03 2022] PUT /compute/v2.1/images/487da344-f342-43e6-86c4-a8b72534f07c/metadata => generated 61 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:22:03.979377 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f23ef850-52f1-4d61-a7d3-44a8b0950ce0 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:03.993311 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f23ef850-52f1-4d61-a7d3-44a8b0950ce0 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025728 Aug 07 01:22:03.994825 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1158/2563] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Aug 7 01:22:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:04.004957 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-926500c7-49ff-401a-b710-c7306c106a3a tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:04.006298 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-926500c7-49ff-401a-b710-c7306c106a3a tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 72538b92-6b72-4a50-96da-74b7d88bcd3c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:04.018742 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-926500c7-49ff-401a-b710-c7306c106a3a tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:04.019994 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-926500c7-49ff-401a-b710-c7306c106a3a tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:04.021111 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-926500c7-49ff-401a-b710-c7306c106a3a tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:04.023402 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-926500c7-49ff-401a-b710-c7306c106a3a tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:04.024434 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-926500c7-49ff-401a-b710-c7306c106a3a tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:04.025124 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-926500c7-49ff-401a-b710-c7306c106a3a tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:04.487753 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-926500c7-49ff-401a-b710-c7306c106a3a tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:04.501141 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-926500c7-49ff-401a-b710-c7306c106a3a tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c" status: 200 len: 1354 microversion: 2.1 time: 0.504717 Aug 07 01:22:04.515527 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1159/2564] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:03 2022] GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c => generated 1354 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:04.515527 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-13d6e7a8-7b4b-4c96-8801-1a7b3f5cc9e0 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.107"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:04.553585 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-bd45bbe8-08fd-4fe1-b7d1-02d6578910d4 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:22:04.556674 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-bd45bbe8-08fd-4fe1-b7d1-02d6578910d4 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:22:04.559470 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-bd45bbe8-08fd-4fe1-b7d1-02d6578910d4 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:22:04.561610 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-bd45bbe8-08fd-4fe1-b7d1-02d6578910d4 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:22:04.562477 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-bd45bbe8-08fd-4fe1-b7d1-02d6578910d4 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:22:04.577890 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd45bbe8-08fd-4fe1-b7d1-02d6578910d4 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:04.578683 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd45bbe8-08fd-4fe1-b7d1-02d6578910d4 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:04.579321 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd45bbe8-08fd-4fe1-b7d1-02d6578910d4 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:04.580943 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd45bbe8-08fd-4fe1-b7d1-02d6578910d4 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:04.581717 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd45bbe8-08fd-4fe1-b7d1-02d6578910d4 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:04.582709 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd45bbe8-08fd-4fe1-b7d1-02d6578910d4 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:04.607689 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-bd45bbe8-08fd-4fe1-b7d1-02d6578910d4 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Getting quotas for project 791ad97e3c374d2d8494abc25b46a0bf. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:22:04.616730 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-bd45bbe8-08fd-4fe1-b7d1-02d6578910d4 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Getting quotas for user 51ab58be25a94cd6a59634e7c7cad158 and project 791ad97e3c374d2d8494abc25b46a0bf. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:22:04.634763 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bd45bbe8-08fd-4fe1-b7d1-02d6578910d4 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:22:04.638087 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bd45bbe8-08fd-4fe1-b7d1-02d6578910d4 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 817c48ff-36fa-4ea6-8a75-672cfb8b6da5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:22:04.710929 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bd45bbe8-08fd-4fe1-b7d1-02d6578910d4 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.480302 Aug 07 01:22:04.728266 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1406/2565] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:22:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:22:04.743623 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-41850bdb-f576-4ac3-8bfe-6f3a2695b1e3 req-47424e5e-4eee-4ef5-9a82-794e21f6b509 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa4e1c13-c268-4138-ad4e-8627558931bf", "tag": "e962044b-2b07-4716-b16b-df9c45e8c3d9"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:04.764784 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-41850bdb-f576-4ac3-8bfe-6f3a2695b1e3 req-47424e5e-4eee-4ef5-9a82-794e21f6b509 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:04.765756 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-41850bdb-f576-4ac3-8bfe-6f3a2695b1e3 req-47424e5e-4eee-4ef5-9a82-794e21f6b509 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:04.766362 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-41850bdb-f576-4ac3-8bfe-6f3a2695b1e3 req-47424e5e-4eee-4ef5-9a82-794e21f6b509 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:04.784012 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-41850bdb-f576-4ac3-8bfe-6f3a2695b1e3 req-47424e5e-4eee-4ef5-9a82-794e21f6b509 service nova] Creating event network-changed:e962044b-2b07-4716-b16b-df9c45e8c3d9 for instance aa4e1c13-c268-4138-ad4e-8627558931bf on n-h2-master-1 Aug 07 01:22:04.790732 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-41850bdb-f576-4ac3-8bfe-6f3a2695b1e3 req-47424e5e-4eee-4ef5-9a82-794e21f6b509 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060368 Aug 07 01:22:04.791991 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1407/2566] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:04.797607 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0a44a0ae-d129-45c3-b4f9-24bc18fbb409 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:04.798581 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0a44a0ae-d129-45c3-b4f9-24bc18fbb409 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: b8da873d-12c6-4107-bb72-49b6cef897e1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:04.805490 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a44a0ae-d129-45c3-b4f9-24bc18fbb409 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:04.806620 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a44a0ae-d129-45c3-b4f9-24bc18fbb409 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:04.807228 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a44a0ae-d129-45c3-b4f9-24bc18fbb409 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:04.815936 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-13d6e7a8-7b4b-4c96-8801-1a7b3f5cc9e0 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: aa4e1c13-c268-4138-ad4e-8627558931bf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:04.823185 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13d6e7a8-7b4b-4c96-8801-1a7b3f5cc9e0 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:04.823677 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13d6e7a8-7b4b-4c96-8801-1a7b3f5cc9e0 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:04.824153 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13d6e7a8-7b4b-4c96-8801-1a7b3f5cc9e0 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:04.825413 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13d6e7a8-7b4b-4c96-8801-1a7b3f5cc9e0 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:04.825883 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13d6e7a8-7b4b-4c96-8801-1a7b3f5cc9e0 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:04.826319 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13d6e7a8-7b4b-4c96-8801-1a7b3f5cc9e0 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:04.826882 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a44a0ae-d129-45c3-b4f9-24bc18fbb409 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:04.827722 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a44a0ae-d129-45c3-b4f9-24bc18fbb409 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:04.828211 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a44a0ae-d129-45c3-b4f9-24bc18fbb409 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:05.254290 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0a44a0ae-d129-45c3-b4f9-24bc18fbb409 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:05.255692 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13d6e7a8-7b4b-4c96-8801-1a7b3f5cc9e0 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "refresh_cache-aa4e1c13-c268-4138-ad4e-8627558931bf" {{(pid=119517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 07 01:22:05.256134 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13d6e7a8-7b4b-4c96-8801-1a7b3f5cc9e0 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquired lock "refresh_cache-aa4e1c13-c268-4138-ad4e-8627558931bf" {{(pid=119517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 07 01:22:05.297089 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0a44a0ae-d129-45c3-b4f9-24bc18fbb409 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1" status: 200 len: 1500 microversion: 2.1 time: 0.503529 Aug 07 01:22:05.298179 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1408/2567] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:04 2022] GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1 => generated 1500 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:05.325770 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6e1bc94b-b0dd-4458-8f97-6c1639080201 tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] Action: 'create', calling method: .version_select at 0x7f9e17aaf040>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:05.437245 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-6e1bc94b-b0dd-4458-8f97-6c1639080201 tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] Getting quotas for project c34f5e0602134ef7ae2eaf6a05f82c32. Resources: dict_keys(['metadata_items']) {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:22:05.448698 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-6e1bc94b-b0dd-4458-8f97-6c1639080201 tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] Getting quotas for user 3adbb2fc6f6a48b39962545bb8de46c8 and project c34f5e0602134ef7ae2eaf6a05f82c32. Resources: dict_keys(['metadata_items']) {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:22:06.026552 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6e1bc94b-b0dd-4458-8f97-6c1639080201 tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] 10.222.0.39 "POST /compute/v2.1/images/487da344-f342-43e6-86c4-a8b72534f07c/metadata" status: 200 len: 85 microversion: 2.1 time: 0.721703 Aug 07 01:22:06.027726 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1409/2568] 10.222.0.39 () {60 vars in 1281 bytes} [Sun Aug 7 01:22:05 2022] POST /compute/v2.1/images/487da344-f342-43e6-86c4-a8b72534f07c/metadata => generated 85 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:22:06.033954 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0481753e-7f87-46c0-85ff-2476ca6be93d tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:06.049447 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0481753e-7f87-46c0-85ff-2476ca6be93d tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] [instance: 912ca661-97cc-457c-bf67-2250ef30eb43] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:06.080089 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0481753e-7f87-46c0-85ff-2476ca6be93d tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:06.080929 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0481753e-7f87-46c0-85ff-2476ca6be93d tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:06.081764 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0481753e-7f87-46c0-85ff-2476ca6be93d tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:06.082804 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0481753e-7f87-46c0-85ff-2476ca6be93d tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:06.110607 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0481753e-7f87-46c0-85ff-2476ca6be93d tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:06.111704 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0481753e-7f87-46c0-85ff-2476ca6be93d tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:06.529523 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0481753e-7f87-46c0-85ff-2476ca6be93d tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093384280c5448f6af8915b37082e14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22296c942ac648039f202269c9d64749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:06.545769 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0481753e-7f87-46c0-85ff-2476ca6be93d tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] 10.222.0.39 "GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43" status: 200 len: 1505 microversion: 2.1 time: 0.515992 Aug 07 01:22:06.546389 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1410/2569] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:06 2022] GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43 => generated 1505 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:06.577809 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-92a41a2f-449c-434e-a916-bd393432d868 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:06.578705 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-92a41a2f-449c-434e-a916-bd393432d868 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] [instance: 76aa2198-b299-4359-b606-3b6afa2326fa] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:06.594117 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92a41a2f-449c-434e-a916-bd393432d868 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:06.594908 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92a41a2f-449c-434e-a916-bd393432d868 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:06.596583 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92a41a2f-449c-434e-a916-bd393432d868 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:06.597538 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92a41a2f-449c-434e-a916-bd393432d868 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:06.598008 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92a41a2f-449c-434e-a916-bd393432d868 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:06.598437 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92a41a2f-449c-434e-a916-bd393432d868 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:06.678582 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-92a41a2f-449c-434e-a916-bd393432d868 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] [instance: 76aa2198-b299-4359-b606-3b6afa2326fa] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:22:06.800173 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:06.946683 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-92a41a2f-449c-434e-a916-bd393432d868 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] 10.222.0.39 "DELETE /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa" status: 204 len: 0 microversion: 2.1 time: 0.381556 Aug 07 01:22:06.948883 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1411/2570] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:22:06 2022] DELETE /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:22:06.967095 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a22b8f8f-371c-44e5-bd65-ac1dc367ae7b tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:06.969303 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a22b8f8f-371c-44e5-bd65-ac1dc367ae7b tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 817c48ff-36fa-4ea6-8a75-672cfb8b6da5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:07.000013 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a22b8f8f-371c-44e5-bd65-ac1dc367ae7b tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:07.000013 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a22b8f8f-371c-44e5-bd65-ac1dc367ae7b tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:07.000013 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a22b8f8f-371c-44e5-bd65-ac1dc367ae7b tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:07.004519 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a22b8f8f-371c-44e5-bd65-ac1dc367ae7b tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:07.004519 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a22b8f8f-371c-44e5-bd65-ac1dc367ae7b tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:07.004519 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a22b8f8f-371c-44e5-bd65-ac1dc367ae7b tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:07.121280 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a22b8f8f-371c-44e5-bd65-ac1dc367ae7b tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab58be25a94cd6a59634e7c7cad158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791ad97e3c374d2d8494abc25b46a0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:07.133530 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a22b8f8f-371c-44e5-bd65-ac1dc367ae7b tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/servers/817c48ff-36fa-4ea6-8a75-672cfb8b6da5" status: 200 len: 1274 microversion: 2.1 time: 0.180258 Aug 07 01:22:07.134213 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1412/2571] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:06 2022] GET /compute/v2.1/servers/817c48ff-36fa-4ea6-8a75-672cfb8b6da5 => generated 1274 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:07.144984 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1052a92d-7c8a-4b0e-97c3-7755164bf7aa tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:07.163636 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-13d6e7a8-7b4b-4c96-8801-1a7b3f5cc9e0 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: aa4e1c13-c268-4138-ad4e-8627558931bf] Building network info cache for instance {{(pid=119517) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 07 01:22:07.163636 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:07.168611 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1052a92d-7c8a-4b0e-97c3-7755164bf7aa tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:07.169147 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1052a92d-7c8a-4b0e-97c3-7755164bf7aa tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:07.169590 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1052a92d-7c8a-4b0e-97c3-7755164bf7aa tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:07.290121 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1052a92d-7c8a-4b0e-97c3-7755164bf7aa tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: b8da873d-12c6-4107-bb72-49b6cef897e1] Going to try to stop instance {{(pid=119516) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 07 01:22:07.413111 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1052a92d-7c8a-4b0e-97c3-7755164bf7aa tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "POST /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1/action" status: 202 len: 0 microversion: 2.1 time: 0.276367 Aug 07 01:22:07.429063 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1413/2572] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:22:07 2022] POST /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:22:07.466237 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c1449a7d-862f-4e05-a99f-5e3f752d0786 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:07.466963 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c1449a7d-862f-4e05-a99f-5e3f752d0786 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 72538b92-6b72-4a50-96da-74b7d88bcd3c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:07.488893 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1449a7d-862f-4e05-a99f-5e3f752d0786 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:07.489406 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1449a7d-862f-4e05-a99f-5e3f752d0786 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:07.489850 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1449a7d-862f-4e05-a99f-5e3f752d0786 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:07.490582 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1449a7d-862f-4e05-a99f-5e3f752d0786 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:07.491041 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1449a7d-862f-4e05-a99f-5e3f752d0786 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:07.491676 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1449a7d-862f-4e05-a99f-5e3f752d0786 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:07.987146 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c1449a7d-862f-4e05-a99f-5e3f752d0786 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:08.030384 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c1449a7d-862f-4e05-a99f-5e3f752d0786 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c" status: 200 len: 1354 microversion: 2.1 time: 0.581834 Aug 07 01:22:08.031078 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1414/2573] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:07 2022] GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c => generated 1354 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:08.049916 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-3ada7dbb-a5b3-4a06-82d7-45ec7b41848f req-e793a68c-ce33-4b3e-87cc-1c891db450b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72538b92-6b72-4a50-96da-74b7d88bcd3c", "tag": "223569dd-ed36-4248-914c-669ed102ccf4"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:08.087733 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3ada7dbb-a5b3-4a06-82d7-45ec7b41848f req-e793a68c-ce33-4b3e-87cc-1c891db450b9 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:08.088415 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3ada7dbb-a5b3-4a06-82d7-45ec7b41848f req-e793a68c-ce33-4b3e-87cc-1c891db450b9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:08.088981 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3ada7dbb-a5b3-4a06-82d7-45ec7b41848f req-e793a68c-ce33-4b3e-87cc-1c891db450b9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:08.116777 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-3ada7dbb-a5b3-4a06-82d7-45ec7b41848f req-e793a68c-ce33-4b3e-87cc-1c891db450b9 service nova] Creating event network-changed:223569dd-ed36-4248-914c-669ed102ccf4 for instance 72538b92-6b72-4a50-96da-74b7d88bcd3c on n-h2-master-1 Aug 07 01:22:08.132191 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-3ada7dbb-a5b3-4a06-82d7-45ec7b41848f req-e793a68c-ce33-4b3e-87cc-1c891db450b9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097858 Aug 07 01:22:08.133266 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1415/2574] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:08.145409 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ee196242-9964-4afa-abc7-5dc2936e2632 tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] Calling method '.version_select at 0x7f9e17aafe50>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:08.181683 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-13d6e7a8-7b4b-4c96-8801-1a7b3f5cc9e0 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: aa4e1c13-c268-4138-ad4e-8627558931bf] Updating instance_info_cache with network_info: [{"id": "e962044b-2b07-4716-b16b-df9c45e8c3d9", "address": "fa:16:3e:5c:ae:f6", "network": {"id": "6c5c235e-c2e8-41e7-9759-0dbd7d7d0e8a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1070683176-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "afc8a87d755a42239e9d4572e4bf2f2d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape962044b-2b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119517) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 07 01:22:08.210321 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13d6e7a8-7b4b-4c96-8801-1a7b3f5cc9e0 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Releasing lock "refresh_cache-aa4e1c13-c268-4138-ad4e-8627558931bf" {{(pid=119517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 07 01:22:08.211984 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-13d6e7a8-7b4b-4c96-8801-1a7b3f5cc9e0 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "POST /compute/v2.1/servers/aa4e1c13-c268-4138-ad4e-8627558931bf/action" status: 202 len: 0 microversion: 2.1 time: 3.705122 Aug 07 01:22:08.216611 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1160/2575] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:22:04 2022] POST /compute/v2.1/servers/aa4e1c13-c268-4138-ad4e-8627558931bf/action => generated 0 bytes in 3712 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 07 01:22:08.227818 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8df6397a-f59b-4f01-aec4-e6ad504d7b2d tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:08.231831 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ee196242-9964-4afa-abc7-5dc2936e2632 tempest-ImagesMetadataTestJSON-605551940 tempest-ImagesMetadataTestJSON-605551940-project] 10.222.0.39 "GET /compute/v2.1/images/487da344-f342-43e6-86c4-a8b72534f07c/metadata" status: 200 len: 85 microversion: 2.1 time: 0.096522 Aug 07 01:22:08.233000 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8df6397a-f59b-4f01-aec4-e6ad504d7b2d tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] [instance: 912ca661-97cc-457c-bf67-2250ef30eb43] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:08.239513 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1416/2576] 10.222.0.39 () {58 vars in 1260 bytes} [Sun Aug 7 01:22:08 2022] GET /compute/v2.1/images/487da344-f342-43e6-86c4-a8b72534f07c/metadata => generated 85 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:22:08.252693 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9b61a6b1-083a-44eb-a17c-796a1df3040c tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:08.258115 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9b61a6b1-083a-44eb-a17c-796a1df3040c tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] [instance: 76aa2198-b299-4359-b606-3b6afa2326fa] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:08.265526 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8df6397a-f59b-4f01-aec4-e6ad504d7b2d tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:08.266454 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8df6397a-f59b-4f01-aec4-e6ad504d7b2d tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:08.266981 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8df6397a-f59b-4f01-aec4-e6ad504d7b2d tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:08.269553 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8df6397a-f59b-4f01-aec4-e6ad504d7b2d tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:08.270039 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8df6397a-f59b-4f01-aec4-e6ad504d7b2d tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:08.273024 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b61a6b1-083a-44eb-a17c-796a1df3040c tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:08.273357 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8df6397a-f59b-4f01-aec4-e6ad504d7b2d tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:08.274119 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b61a6b1-083a-44eb-a17c-796a1df3040c tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:08.279419 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b61a6b1-083a-44eb-a17c-796a1df3040c tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:08.281016 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b61a6b1-083a-44eb-a17c-796a1df3040c tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:08.281598 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b61a6b1-083a-44eb-a17c-796a1df3040c tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:08.282764 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b61a6b1-083a-44eb-a17c-796a1df3040c tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:08.388589 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8df6397a-f59b-4f01-aec4-e6ad504d7b2d tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '093384280c5448f6af8915b37082e14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22296c942ac648039f202269c9d64749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:08.391059 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8df6397a-f59b-4f01-aec4-e6ad504d7b2d tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] 10.222.0.39 "GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43/os-instance-actions/req-7f5fa7b7-e45b-4211-bb38-4fc34f68fc2b" status: 200 len: 313 microversion: 2.1 time: 0.172012 Aug 07 01:22:08.397021 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1161/2577] 10.222.0.39 () {58 vars in 1419 bytes} [Sun Aug 7 01:22:08 2022] GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43/os-instance-actions/req-7f5fa7b7-e45b-4211-bb38-4fc34f68fc2b => generated 313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:08.403209 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-a82f36cc-3cc2-4759-992b-eafd6bceded2 req-bdc57b11-c06b-4df9-aab5-e8b32f204cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa4e1c13-c268-4138-ad4e-8627558931bf", "tag": "e962044b-2b07-4716-b16b-df9c45e8c3d9"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:08.441665 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a82f36cc-3cc2-4759-992b-eafd6bceded2 req-bdc57b11-c06b-4df9-aab5-e8b32f204cd6 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:08.442407 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a82f36cc-3cc2-4759-992b-eafd6bceded2 req-bdc57b11-c06b-4df9-aab5-e8b32f204cd6 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:08.442963 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a82f36cc-3cc2-4759-992b-eafd6bceded2 req-bdc57b11-c06b-4df9-aab5-e8b32f204cd6 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:08.469786 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-a82f36cc-3cc2-4759-992b-eafd6bceded2 req-bdc57b11-c06b-4df9-aab5-e8b32f204cd6 service nova] Creating event network-changed:e962044b-2b07-4716-b16b-df9c45e8c3d9 for instance aa4e1c13-c268-4138-ad4e-8627558931bf on n-h2-master-1 Aug 07 01:22:08.498565 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-a82f36cc-3cc2-4759-992b-eafd6bceded2 req-bdc57b11-c06b-4df9-aab5-e8b32f204cd6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099276 Aug 07 01:22:08.502733 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1162/2578] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:08.523582 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-62daabd0-3d0d-4965-8915-f3d380680fa7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:08.525037 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-62daabd0-3d0d-4965-8915-f3d380680fa7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: b8da873d-12c6-4107-bb72-49b6cef897e1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:08.536562 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-62daabd0-3d0d-4965-8915-f3d380680fa7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:08.537422 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-62daabd0-3d0d-4965-8915-f3d380680fa7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:08.538003 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-62daabd0-3d0d-4965-8915-f3d380680fa7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:08.539935 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-62daabd0-3d0d-4965-8915-f3d380680fa7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:08.541743 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-62daabd0-3d0d-4965-8915-f3d380680fa7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:08.542453 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-62daabd0-3d0d-4965-8915-f3d380680fa7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:08.799742 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9b61a6b1-083a-44eb-a17c-796a1df3040c tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4feb14c621b4090af8c965c9aaf0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06e7912f1fe423ea1b2a4bcdb90804a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:08.812770 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9b61a6b1-083a-44eb-a17c-796a1df3040c tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] 10.222.0.39 "GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa" status: 200 len: 1607 microversion: 2.1 time: 0.571773 Aug 07 01:22:08.813445 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1417/2579] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:08 2022] GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa => generated 1607 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:08.830315 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-59cc0831-1775-4de4-a02e-ee561b2bb2fe tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:08.830946 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-59cc0831-1775-4de4-a02e-ee561b2bb2fe tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 817c48ff-36fa-4ea6-8a75-672cfb8b6da5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:08.852933 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-59cc0831-1775-4de4-a02e-ee561b2bb2fe tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:08.853426 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-59cc0831-1775-4de4-a02e-ee561b2bb2fe tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:08.853867 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-59cc0831-1775-4de4-a02e-ee561b2bb2fe tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:08.854595 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-59cc0831-1775-4de4-a02e-ee561b2bb2fe tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:08.862138 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-59cc0831-1775-4de4-a02e-ee561b2bb2fe tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:08.862815 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-59cc0831-1775-4de4-a02e-ee561b2bb2fe tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:09.152977 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-62daabd0-3d0d-4965-8915-f3d380680fa7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:09.170586 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-62daabd0-3d0d-4965-8915-f3d380680fa7 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1" status: 200 len: 1510 microversion: 2.1 time: 0.664474 Aug 07 01:22:09.171547 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1163/2580] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:08 2022] GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1 => generated 1510 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:09.176976 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b980b6e3-e04d-4690-8c1a-a69a24030fc5 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:09.177913 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b980b6e3-e04d-4690-8c1a-a69a24030fc5 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: aa4e1c13-c268-4138-ad4e-8627558931bf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:09.191952 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b980b6e3-e04d-4690-8c1a-a69a24030fc5 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:09.193299 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b980b6e3-e04d-4690-8c1a-a69a24030fc5 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:09.193835 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b980b6e3-e04d-4690-8c1a-a69a24030fc5 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:09.195083 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b980b6e3-e04d-4690-8c1a-a69a24030fc5 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:09.197636 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b980b6e3-e04d-4690-8c1a-a69a24030fc5 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:09.204038 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b980b6e3-e04d-4690-8c1a-a69a24030fc5 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:09.244315 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b980b6e3-e04d-4690-8c1a-a69a24030fc5 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: aa4e1c13-c268-4138-ad4e-8627558931bf] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:22:09.373844 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:09.384600 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b980b6e3-e04d-4690-8c1a-a69a24030fc5 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "DELETE /compute/v2.1/servers/aa4e1c13-c268-4138-ad4e-8627558931bf" status: 204 len: 0 microversion: 2.1 time: 0.211294 Aug 07 01:22:09.385307 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1164/2581] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:22:09 2022] DELETE /compute/v2.1/servers/aa4e1c13-c268-4138-ad4e-8627558931bf => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:22:09.407251 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d4982b7e-e8c6-40b0-82d7-1b6ca9ded71d tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:09.417415 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d4982b7e-e8c6-40b0-82d7-1b6ca9ded71d tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] [instance: 912ca661-97cc-457c-bf67-2250ef30eb43] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:09.423016 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-59cc0831-1775-4de4-a02e-ee561b2bb2fe tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab58be25a94cd6a59634e7c7cad158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791ad97e3c374d2d8494abc25b46a0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:09.432111 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d4982b7e-e8c6-40b0-82d7-1b6ca9ded71d tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:09.432931 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d4982b7e-e8c6-40b0-82d7-1b6ca9ded71d tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:09.433644 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d4982b7e-e8c6-40b0-82d7-1b6ca9ded71d tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:09.434689 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d4982b7e-e8c6-40b0-82d7-1b6ca9ded71d tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:09.436916 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-59cc0831-1775-4de4-a02e-ee561b2bb2fe tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/servers/817c48ff-36fa-4ea6-8a75-672cfb8b6da5" status: 200 len: 1316 microversion: 2.1 time: 0.613882 Aug 07 01:22:09.442588 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1418/2582] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:08 2022] GET /compute/v2.1/servers/817c48ff-36fa-4ea6-8a75-672cfb8b6da5 => generated 1316 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:09.448338 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a661ed98-73c9-4a5c-a707-199b43c4f936 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:09.453315 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a661ed98-73c9-4a5c-a707-199b43c4f936 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 72538b92-6b72-4a50-96da-74b7d88bcd3c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:09.464344 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d4982b7e-e8c6-40b0-82d7-1b6ca9ded71d tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:09.466440 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d4982b7e-e8c6-40b0-82d7-1b6ca9ded71d tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:09.470456 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a661ed98-73c9-4a5c-a707-199b43c4f936 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:09.471346 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a661ed98-73c9-4a5c-a707-199b43c4f936 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:09.471784 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a661ed98-73c9-4a5c-a707-199b43c4f936 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:09.474795 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a661ed98-73c9-4a5c-a707-199b43c4f936 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:09.475353 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a661ed98-73c9-4a5c-a707-199b43c4f936 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:09.479067 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a661ed98-73c9-4a5c-a707-199b43c4f936 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:09.703946 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d4982b7e-e8c6-40b0-82d7-1b6ca9ded71d tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] 10.222.0.39 "POST /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43/action" status: 202 len: 0 microversion: 2.1 time: 0.315616 Aug 07 01:22:09.705133 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1165/2583] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:22:09 2022] POST /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:22:09.713868 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-84bfc80f-299f-4ecd-8ecf-4b02d245cafe tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.107"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:09.717258 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-84bfc80f-299f-4ecd-8ecf-4b02d245cafe tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: ee42a97e-a680-4b64-bbfa-df12eba6dcde] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:09.730761 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-84bfc80f-299f-4ecd-8ecf-4b02d245cafe tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:09.731702 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-84bfc80f-299f-4ecd-8ecf-4b02d245cafe tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:09.732872 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-84bfc80f-299f-4ecd-8ecf-4b02d245cafe tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:09.734210 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-84bfc80f-299f-4ecd-8ecf-4b02d245cafe tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:09.735536 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-84bfc80f-299f-4ecd-8ecf-4b02d245cafe tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:09.747720 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-84bfc80f-299f-4ecd-8ecf-4b02d245cafe tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:09.790453 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-84bfc80f-299f-4ecd-8ecf-4b02d245cafe tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "refresh_cache-ee42a97e-a680-4b64-bbfa-df12eba6dcde" {{(pid=119517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 07 01:22:09.791023 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-84bfc80f-299f-4ecd-8ecf-4b02d245cafe tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquired lock "refresh_cache-ee42a97e-a680-4b64-bbfa-df12eba6dcde" {{(pid=119517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 07 01:22:10.203198 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a661ed98-73c9-4a5c-a707-199b43c4f936 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:10.227459 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a661ed98-73c9-4a5c-a707-199b43c4f936 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c" status: 200 len: 1354 microversion: 2.1 time: 0.783188 Aug 07 01:22:10.228819 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1419/2584] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:09 2022] GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c => generated 1354 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:10.245766 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fef79795-5a6e-46b2-954d-47507dda18d4 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:10.246851 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fef79795-5a6e-46b2-954d-47507dda18d4 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] [instance: 912ca661-97cc-457c-bf67-2250ef30eb43] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:10.265881 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fef79795-5a6e-46b2-954d-47507dda18d4 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:10.266614 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fef79795-5a6e-46b2-954d-47507dda18d4 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:10.267247 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fef79795-5a6e-46b2-954d-47507dda18d4 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:10.268167 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fef79795-5a6e-46b2-954d-47507dda18d4 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:10.268777 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fef79795-5a6e-46b2-954d-47507dda18d4 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:10.269356 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fef79795-5a6e-46b2-954d-47507dda18d4 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:11.308819 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fef79795-5a6e-46b2-954d-47507dda18d4 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093384280c5448f6af8915b37082e14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22296c942ac648039f202269c9d64749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:11.319328 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fef79795-5a6e-46b2-954d-47507dda18d4 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] 10.222.0.39 "GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43" status: 200 len: 1507 microversion: 2.1 time: 1.089036 Aug 07 01:22:11.335669 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1420/2585] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:10 2022] GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43 => generated 1507 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:11.363416 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c910e51e-3c48-4187-89c9-772ec8efd2b7 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:11.364468 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c910e51e-3c48-4187-89c9-772ec8efd2b7 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] [instance: 76aa2198-b299-4359-b606-3b6afa2326fa] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:11.380903 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c910e51e-3c48-4187-89c9-772ec8efd2b7 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:11.381903 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c910e51e-3c48-4187-89c9-772ec8efd2b7 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:11.383967 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c910e51e-3c48-4187-89c9-772ec8efd2b7 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:11.386198 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c910e51e-3c48-4187-89c9-772ec8efd2b7 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:11.387650 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c910e51e-3c48-4187-89c9-772ec8efd2b7 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:11.389066 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c910e51e-3c48-4187-89c9-772ec8efd2b7 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:11.563003 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c910e51e-3c48-4187-89c9-772ec8efd2b7 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4feb14c621b4090af8c965c9aaf0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06e7912f1fe423ea1b2a4bcdb90804a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:11.601966 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c910e51e-3c48-4187-89c9-772ec8efd2b7 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] 10.222.0.39 "GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa" status: 200 len: 1540 microversion: 2.1 time: 0.252977 Aug 07 01:22:11.602829 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1421/2586] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:11 2022] GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa => generated 1540 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:11.608330 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-5a21ef06-80d8-444f-9b5d-447508342f4f req-0ba1a644-b921-4d46-95b5-fbabadd3b27f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72538b92-6b72-4a50-96da-74b7d88bcd3c", "tag": "b434050c-137a-4958-8d94-110db0030b89"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:11.623726 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-5a21ef06-80d8-444f-9b5d-447508342f4f req-0ba1a644-b921-4d46-95b5-fbabadd3b27f service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:11.624257 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-5a21ef06-80d8-444f-9b5d-447508342f4f req-0ba1a644-b921-4d46-95b5-fbabadd3b27f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:11.624694 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-5a21ef06-80d8-444f-9b5d-447508342f4f req-0ba1a644-b921-4d46-95b5-fbabadd3b27f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:11.646732 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:11.654784 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-5a21ef06-80d8-444f-9b5d-447508342f4f req-0ba1a644-b921-4d46-95b5-fbabadd3b27f service nova] Creating event network-changed:b434050c-137a-4958-8d94-110db0030b89 for instance 72538b92-6b72-4a50-96da-74b7d88bcd3c on n-h2-master-1 Aug 07 01:22:11.661396 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-5a21ef06-80d8-444f-9b5d-447508342f4f req-0ba1a644-b921-4d46-95b5-fbabadd3b27f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057103 Aug 07 01:22:11.662076 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1422/2587] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:11.669774 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bd2fc63c-72f1-489e-86e8-3cbe01ed11d6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:11.671459 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bd2fc63c-72f1-489e-86e8-3cbe01ed11d6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: b8da873d-12c6-4107-bb72-49b6cef897e1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:11.681230 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd2fc63c-72f1-489e-86e8-3cbe01ed11d6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:11.681787 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd2fc63c-72f1-489e-86e8-3cbe01ed11d6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:11.682445 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd2fc63c-72f1-489e-86e8-3cbe01ed11d6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:11.683554 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd2fc63c-72f1-489e-86e8-3cbe01ed11d6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:11.684306 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd2fc63c-72f1-489e-86e8-3cbe01ed11d6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:11.684909 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd2fc63c-72f1-489e-86e8-3cbe01ed11d6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:12.137573 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bd2fc63c-72f1-489e-86e8-3cbe01ed11d6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:12.146032 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bd2fc63c-72f1-489e-86e8-3cbe01ed11d6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1" status: 200 len: 1510 microversion: 2.1 time: 0.482363 Aug 07 01:22:12.146872 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1423/2588] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:11 2022] GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1 => generated 1510 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:12.166563 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-18f98f30-60ec-42c1-9fa9-68cf046c1cd0 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:12.167489 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-18f98f30-60ec-42c1-9fa9-68cf046c1cd0 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 817c48ff-36fa-4ea6-8a75-672cfb8b6da5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:12.174906 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-18f98f30-60ec-42c1-9fa9-68cf046c1cd0 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:12.175654 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-18f98f30-60ec-42c1-9fa9-68cf046c1cd0 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:12.176294 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-18f98f30-60ec-42c1-9fa9-68cf046c1cd0 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:12.177231 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-18f98f30-60ec-42c1-9fa9-68cf046c1cd0 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:12.177869 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-18f98f30-60ec-42c1-9fa9-68cf046c1cd0 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:12.178465 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-18f98f30-60ec-42c1-9fa9-68cf046c1cd0 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:12.571032 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-18f98f30-60ec-42c1-9fa9-68cf046c1cd0 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab58be25a94cd6a59634e7c7cad158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791ad97e3c374d2d8494abc25b46a0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:12.587805 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-18f98f30-60ec-42c1-9fa9-68cf046c1cd0 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/servers/817c48ff-36fa-4ea6-8a75-672cfb8b6da5" status: 200 len: 1316 microversion: 2.1 time: 0.429975 Aug 07 01:22:12.601539 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1424/2589] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:12 2022] GET /compute/v2.1/servers/817c48ff-36fa-4ea6-8a75-672cfb8b6da5 => generated 1316 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:12.613815 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9e61e847-c574-453c-b7a5-127e93a280f5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:12.615491 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9e61e847-c574-453c-b7a5-127e93a280f5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 72538b92-6b72-4a50-96da-74b7d88bcd3c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:12.627447 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e61e847-c574-453c-b7a5-127e93a280f5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:12.630464 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e61e847-c574-453c-b7a5-127e93a280f5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:12.632633 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e61e847-c574-453c-b7a5-127e93a280f5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:12.638969 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e61e847-c574-453c-b7a5-127e93a280f5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:12.639694 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e61e847-c574-453c-b7a5-127e93a280f5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:12.640342 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e61e847-c574-453c-b7a5-127e93a280f5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:12.900519 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9e61e847-c574-453c-b7a5-127e93a280f5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:12.914736 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9e61e847-c574-453c-b7a5-127e93a280f5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c" status: 200 len: 1354 microversion: 2.1 time: 0.310941 Aug 07 01:22:12.916684 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1425/2590] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:12 2022] GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c => generated 1354 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:12.938766 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-af16a6de-d4f9-4f5b-9239-10cdacd112a7 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:12.940681 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-af16a6de-d4f9-4f5b-9239-10cdacd112a7 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] [instance: 912ca661-97cc-457c-bf67-2250ef30eb43] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:12.954280 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af16a6de-d4f9-4f5b-9239-10cdacd112a7 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:12.955569 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af16a6de-d4f9-4f5b-9239-10cdacd112a7 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:12.956678 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af16a6de-d4f9-4f5b-9239-10cdacd112a7 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:12.958550 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af16a6de-d4f9-4f5b-9239-10cdacd112a7 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:12.960326 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af16a6de-d4f9-4f5b-9239-10cdacd112a7 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:12.961505 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af16a6de-d4f9-4f5b-9239-10cdacd112a7 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:13.229501 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-af16a6de-d4f9-4f5b-9239-10cdacd112a7 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093384280c5448f6af8915b37082e14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22296c942ac648039f202269c9d64749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:13.252082 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-af16a6de-d4f9-4f5b-9239-10cdacd112a7 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] 10.222.0.39 "GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43" status: 200 len: 1507 microversion: 2.1 time: 0.326862 Aug 07 01:22:13.269403 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1426/2591] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:12 2022] GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43 => generated 1507 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:13.276548 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ef969f77-054f-4622-924a-67a788335eb1 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:13.277324 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ef969f77-054f-4622-924a-67a788335eb1 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] [instance: 76aa2198-b299-4359-b606-3b6afa2326fa] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:13.286616 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef969f77-054f-4622-924a-67a788335eb1 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:13.287115 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef969f77-054f-4622-924a-67a788335eb1 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:13.287556 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef969f77-054f-4622-924a-67a788335eb1 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:13.288320 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef969f77-054f-4622-924a-67a788335eb1 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:13.289513 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef969f77-054f-4622-924a-67a788335eb1 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:13.289955 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef969f77-054f-4622-924a-67a788335eb1 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:13.418258 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ef969f77-054f-4622-924a-67a788335eb1 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4feb14c621b4090af8c965c9aaf0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06e7912f1fe423ea1b2a4bcdb90804a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:13.429852 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ef969f77-054f-4622-924a-67a788335eb1 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] 10.222.0.39 "GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa" status: 200 len: 1540 microversion: 2.1 time: 0.159015 Aug 07 01:22:13.430725 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1427/2592] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:13 2022] GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa => generated 1540 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:13.436750 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-582ce77c-768c-4c43-af1e-8406a930b062 req-bea386e0-7323-4057-bcf3-6dd7ab089a43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76aa2198-b299-4359-b606-3b6afa2326fa", "name": "network-vif-deleted", "tag": "3ab32283-65ff-4a43-8b7d-5c9620395daa"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:13.463689 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-582ce77c-768c-4c43-af1e-8406a930b062 req-bea386e0-7323-4057-bcf3-6dd7ab089a43 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:13.465384 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-582ce77c-768c-4c43-af1e-8406a930b062 req-bea386e0-7323-4057-bcf3-6dd7ab089a43 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:13.467916 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-582ce77c-768c-4c43-af1e-8406a930b062 req-bea386e0-7323-4057-bcf3-6dd7ab089a43 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:13.509247 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-582ce77c-768c-4c43-af1e-8406a930b062 req-bea386e0-7323-4057-bcf3-6dd7ab089a43 service nova] Creating event network-vif-deleted:3ab32283-65ff-4a43-8b7d-5c9620395daa for instance 76aa2198-b299-4359-b606-3b6afa2326fa on n-h2-master-1 Aug 07 01:22:13.538532 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-582ce77c-768c-4c43-af1e-8406a930b062 req-bea386e0-7323-4057-bcf3-6dd7ab089a43 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106026 Aug 07 01:22:13.543136 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1428/2593] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:13.550303 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2c37f704-8f11-499d-8882-3c857b319786 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:13.560389 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2c37f704-8f11-499d-8882-3c857b319786 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: b8da873d-12c6-4107-bb72-49b6cef897e1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:13.579111 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c37f704-8f11-499d-8882-3c857b319786 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:13.580996 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c37f704-8f11-499d-8882-3c857b319786 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:13.588241 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c37f704-8f11-499d-8882-3c857b319786 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:13.589598 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c37f704-8f11-499d-8882-3c857b319786 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:13.590904 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c37f704-8f11-499d-8882-3c857b319786 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:13.591656 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c37f704-8f11-499d-8882-3c857b319786 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:13.599561 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=23 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:14.031298 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2c37f704-8f11-499d-8882-3c857b319786 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:14.034552 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:14.053797 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2c37f704-8f11-499d-8882-3c857b319786 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1" status: 200 len: 1510 microversion: 2.1 time: 0.504671 Aug 07 01:22:14.056548 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1429/2594] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:13 2022] GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1 => generated 1510 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:14.093375 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3e2accd7-9f2d-4da4-8d19-b86d7f647b06 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:14.110403 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3e2accd7-9f2d-4da4-8d19-b86d7f647b06 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 817c48ff-36fa-4ea6-8a75-672cfb8b6da5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:14.141064 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e2accd7-9f2d-4da4-8d19-b86d7f647b06 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:14.141570 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e2accd7-9f2d-4da4-8d19-b86d7f647b06 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:14.142281 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e2accd7-9f2d-4da4-8d19-b86d7f647b06 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:14.143236 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e2accd7-9f2d-4da4-8d19-b86d7f647b06 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:14.146237 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e2accd7-9f2d-4da4-8d19-b86d7f647b06 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:14.146887 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e2accd7-9f2d-4da4-8d19-b86d7f647b06 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:14.583398 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3e2accd7-9f2d-4da4-8d19-b86d7f647b06 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab58be25a94cd6a59634e7c7cad158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791ad97e3c374d2d8494abc25b46a0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:14.595824 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=4 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:14.604057 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3e2accd7-9f2d-4da4-8d19-b86d7f647b06 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/servers/817c48ff-36fa-4ea6-8a75-672cfb8b6da5" status: 200 len: 1316 microversion: 2.1 time: 0.540446 Aug 07 01:22:14.615362 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1430/2595] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:14 2022] GET /compute/v2.1/servers/817c48ff-36fa-4ea6-8a75-672cfb8b6da5 => generated 1316 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:14.638369 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-25d25f24-5d3a-4457-81c2-d934696afddb req-4ceefed8-fb81-4065-8786-b6450adf0bed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "817c48ff-36fa-4ea6-8a75-672cfb8b6da5", "tag": "2791ffb2-9e29-488e-88c1-4c55cfa4d733"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:14.685263 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-25d25f24-5d3a-4457-81c2-d934696afddb req-4ceefed8-fb81-4065-8786-b6450adf0bed service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:14.689556 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-25d25f24-5d3a-4457-81c2-d934696afddb req-4ceefed8-fb81-4065-8786-b6450adf0bed service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:14.693906 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-25d25f24-5d3a-4457-81c2-d934696afddb req-4ceefed8-fb81-4065-8786-b6450adf0bed service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:14.744039 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-25d25f24-5d3a-4457-81c2-d934696afddb req-4ceefed8-fb81-4065-8786-b6450adf0bed service nova] Creating event network-changed:2791ffb2-9e29-488e-88c1-4c55cfa4d733 for instance 817c48ff-36fa-4ea6-8a75-672cfb8b6da5 on n-h1-master-1 Aug 07 01:22:14.758160 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-25d25f24-5d3a-4457-81c2-d934696afddb req-4ceefed8-fb81-4065-8786-b6450adf0bed service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140471 Aug 07 01:22:14.767816 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1431/2596] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:14.801332 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1ca76375-78ac-477f-974d-7f8d987fdb38 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:14.803253 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1ca76375-78ac-477f-974d-7f8d987fdb38 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 72538b92-6b72-4a50-96da-74b7d88bcd3c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:14.862858 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ca76375-78ac-477f-974d-7f8d987fdb38 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:14.863605 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ca76375-78ac-477f-974d-7f8d987fdb38 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:14.864096 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ca76375-78ac-477f-974d-7f8d987fdb38 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:14.878677 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ca76375-78ac-477f-974d-7f8d987fdb38 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:14.886037 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ca76375-78ac-477f-974d-7f8d987fdb38 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:14.900648 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ca76375-78ac-477f-974d-7f8d987fdb38 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:15.462911 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=18 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:15.952511 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1ca76375-78ac-477f-974d-7f8d987fdb38 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:15.968783 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1ca76375-78ac-477f-974d-7f8d987fdb38 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c" status: 200 len: 1354 microversion: 2.1 time: 1.199226 Aug 07 01:22:15.969407 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1432/2597] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:14 2022] GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c => generated 1354 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:15.983551 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e7604cfc-6c03-4119-96c4-d5fa4684976c tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:15.987258 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e7604cfc-6c03-4119-96c4-d5fa4684976c tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] [instance: 912ca661-97cc-457c-bf67-2250ef30eb43] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:16.005445 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7604cfc-6c03-4119-96c4-d5fa4684976c tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:16.006254 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7604cfc-6c03-4119-96c4-d5fa4684976c tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:16.007768 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7604cfc-6c03-4119-96c4-d5fa4684976c tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:16.008733 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7604cfc-6c03-4119-96c4-d5fa4684976c tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:16.012810 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7604cfc-6c03-4119-96c4-d5fa4684976c tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:16.013550 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7604cfc-6c03-4119-96c4-d5fa4684976c tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:16.127912 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-84bfc80f-299f-4ecd-8ecf-4b02d245cafe tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: ee42a97e-a680-4b64-bbfa-df12eba6dcde] Building network info cache for instance {{(pid=119517) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 07 01:22:16.528083 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e7604cfc-6c03-4119-96c4-d5fa4684976c tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093384280c5448f6af8915b37082e14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22296c942ac648039f202269c9d64749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:16.552680 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e7604cfc-6c03-4119-96c4-d5fa4684976c tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] 10.222.0.39 "GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43" status: 200 len: 1505 microversion: 2.1 time: 0.581947 Aug 07 01:22:16.556768 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1433/2598] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:15 2022] GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43 => generated 1505 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:16.572288 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-60567c6e-da98-4158-8f7d-cffea11c5291 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:16.573350 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-60567c6e-da98-4158-8f7d-cffea11c5291 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] [instance: 76aa2198-b299-4359-b606-3b6afa2326fa] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:16.588042 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60567c6e-da98-4158-8f7d-cffea11c5291 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:16.589124 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60567c6e-da98-4158-8f7d-cffea11c5291 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:16.589745 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60567c6e-da98-4158-8f7d-cffea11c5291 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:16.591560 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60567c6e-da98-4158-8f7d-cffea11c5291 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:16.592255 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60567c6e-da98-4158-8f7d-cffea11c5291 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:16.596798 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60567c6e-da98-4158-8f7d-cffea11c5291 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:16.894071 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-60567c6e-da98-4158-8f7d-cffea11c5291 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4feb14c621b4090af8c965c9aaf0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06e7912f1fe423ea1b2a4bcdb90804a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:16.906355 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-60567c6e-da98-4158-8f7d-cffea11c5291 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] 10.222.0.39 "GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa" status: 200 len: 1251 microversion: 2.1 time: 0.348049 Aug 07 01:22:16.914201 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1434/2599] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:16 2022] GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa => generated 1251 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:16.924415 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-90446187-c484-4dc6-bd97-21d573192197 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:16.925905 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-90446187-c484-4dc6-bd97-21d573192197 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: b8da873d-12c6-4107-bb72-49b6cef897e1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:16.951462 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90446187-c484-4dc6-bd97-21d573192197 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:16.954735 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90446187-c484-4dc6-bd97-21d573192197 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:16.956330 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90446187-c484-4dc6-bd97-21d573192197 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:16.961172 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90446187-c484-4dc6-bd97-21d573192197 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:16.970194 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90446187-c484-4dc6-bd97-21d573192197 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:16.971395 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90446187-c484-4dc6-bd97-21d573192197 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:17.423549 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-90446187-c484-4dc6-bd97-21d573192197 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:17.436415 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-90446187-c484-4dc6-bd97-21d573192197 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1" status: 200 len: 1510 microversion: 2.1 time: 0.520515 Aug 07 01:22:17.439242 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1435/2600] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:16 2022] GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1 => generated 1510 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:17.451560 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7c5b906b-9162-4eb9-98a1-d4e53382a13c tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:17.455834 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7c5b906b-9162-4eb9-98a1-d4e53382a13c tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 817c48ff-36fa-4ea6-8a75-672cfb8b6da5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:17.470066 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7c5b906b-9162-4eb9-98a1-d4e53382a13c tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:17.473988 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7c5b906b-9162-4eb9-98a1-d4e53382a13c tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:17.474646 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7c5b906b-9162-4eb9-98a1-d4e53382a13c tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:17.476509 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7c5b906b-9162-4eb9-98a1-d4e53382a13c tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:17.482060 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7c5b906b-9162-4eb9-98a1-d4e53382a13c tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:17.482792 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7c5b906b-9162-4eb9-98a1-d4e53382a13c tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:17.768404 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-84bfc80f-299f-4ecd-8ecf-4b02d245cafe tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: ee42a97e-a680-4b64-bbfa-df12eba6dcde] Updating instance_info_cache with network_info: [{"id": "8a25057f-4c60-4889-8490-fb06550888b8", "address": "fa:16:3e:d8:4a:b0", "network": {"id": "6c5c235e-c2e8-41e7-9759-0dbd7d7d0e8a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1070683176-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "afc8a87d755a42239e9d4572e4bf2f2d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8a25057f-4c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119517) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 07 01:22:17.784151 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-84bfc80f-299f-4ecd-8ecf-4b02d245cafe tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Releasing lock "refresh_cache-ee42a97e-a680-4b64-bbfa-df12eba6dcde" {{(pid=119517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 07 01:22:17.786532 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-84bfc80f-299f-4ecd-8ecf-4b02d245cafe tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "POST /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde/action" status: 202 len: 0 microversion: 2.1 time: 8.078294 Aug 07 01:22:17.788836 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1166/2601] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:22:09 2022] POST /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde/action => generated 0 bytes in 8083 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 07 01:22:17.805386 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-854c6c2f-54b4-4664-8177-b12f346057fd req-4ee981c9-e2da-4de3-87c3-998c0831a8cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa4e1c13-c268-4138-ad4e-8627558931bf", "name": "network-vif-deleted", "tag": "e962044b-2b07-4716-b16b-df9c45e8c3d9"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:17.828665 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-854c6c2f-54b4-4664-8177-b12f346057fd req-4ee981c9-e2da-4de3-87c3-998c0831a8cb service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:17.831503 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-854c6c2f-54b4-4664-8177-b12f346057fd req-4ee981c9-e2da-4de3-87c3-998c0831a8cb service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:17.832196 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-854c6c2f-54b4-4664-8177-b12f346057fd req-4ee981c9-e2da-4de3-87c3-998c0831a8cb service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:17.873270 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-854c6c2f-54b4-4664-8177-b12f346057fd req-4ee981c9-e2da-4de3-87c3-998c0831a8cb service nova] Creating event network-vif-deleted:e962044b-2b07-4716-b16b-df9c45e8c3d9 for instance aa4e1c13-c268-4138-ad4e-8627558931bf on n-h2-master-1 Aug 07 01:22:17.884708 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-854c6c2f-54b4-4664-8177-b12f346057fd req-4ee981c9-e2da-4de3-87c3-998c0831a8cb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088909 Aug 07 01:22:17.888553 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1167/2602] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:17.906285 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d9c087d8-891c-4eec-8ca6-64f3883fc591 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Calling method '.version_select at 0x7f9e24589040>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:17.907242 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d9c087d8-891c-4eec-8ca6-64f3883fc591 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] [instance: 912ca661-97cc-457c-bf67-2250ef30eb43] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:17.926655 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9c087d8-891c-4eec-8ca6-64f3883fc591 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:17.928009 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9c087d8-891c-4eec-8ca6-64f3883fc591 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:17.930106 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9c087d8-891c-4eec-8ca6-64f3883fc591 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:17.931167 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9c087d8-891c-4eec-8ca6-64f3883fc591 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:17.943343 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9c087d8-891c-4eec-8ca6-64f3883fc591 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:17.944170 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9c087d8-891c-4eec-8ca6-64f3883fc591 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:18.005360 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d9c087d8-891c-4eec-8ca6-64f3883fc591 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] 10.222.0.39 "GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.113204 Aug 07 01:22:18.006272 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1168/2603] 10.222.0.39 () {58 vars in 1296 bytes} [Sun Aug 7 01:22:17 2022] GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43/os-instance-actions => generated 611 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:18.011207 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2decdee4-918d-4a29-8c85-cc7d2d17d30d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:18.012554 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2decdee4-918d-4a29-8c85-cc7d2d17d30d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 72538b92-6b72-4a50-96da-74b7d88bcd3c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:18.019334 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2decdee4-918d-4a29-8c85-cc7d2d17d30d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:18.020174 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2decdee4-918d-4a29-8c85-cc7d2d17d30d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:18.020912 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2decdee4-918d-4a29-8c85-cc7d2d17d30d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:18.021861 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2decdee4-918d-4a29-8c85-cc7d2d17d30d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:18.022859 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2decdee4-918d-4a29-8c85-cc7d2d17d30d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:18.023506 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2decdee4-918d-4a29-8c85-cc7d2d17d30d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:18.039984 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7c5b906b-9162-4eb9-98a1-d4e53382a13c tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab58be25a94cd6a59634e7c7cad158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791ad97e3c374d2d8494abc25b46a0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:18.064972 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7c5b906b-9162-4eb9-98a1-d4e53382a13c tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/servers/817c48ff-36fa-4ea6-8a75-672cfb8b6da5" status: 200 len: 1316 microversion: 2.1 time: 0.617682 Aug 07 01:22:18.065801 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1436/2604] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:17 2022] GET /compute/v2.1/servers/817c48ff-36fa-4ea6-8a75-672cfb8b6da5 => generated 1316 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:18.083966 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8aa7cd40-b81d-4437-961a-3dcc9fb2bda6 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Calling method '.version_select at 0x7f9e179fd1f0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:18.326518 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2decdee4-918d-4a29-8c85-cc7d2d17d30d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:18.337339 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2decdee4-918d-4a29-8c85-cc7d2d17d30d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c" status: 200 len: 1354 microversion: 2.1 time: 0.329777 Aug 07 01:22:18.339090 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1169/2605] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:18 2022] GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c => generated 1354 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:18.348922 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-975812d6-528a-4875-b76e-49cc74f2bef9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1790819210", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "68fdaf7a-c018-4207-a54c-86715ad58de9"}], "block_device_mapping_v2": [{"uuid": "d57e1fb9-a6e2-430c-a768-66017b6bf6aa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:18.468194 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-975812d6-528a-4875-b76e-49cc74f2bef9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] validate_networks() for [('68fdaf7a-c018-4207-a54c-86715ad58de9', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:22:18.474566 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8aa7cd40-b81d-4437-961a-3dcc9fb2bda6 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "GET /compute/v2.1/os-floating-ips/2a540452-e8a3-4432-b383-0ca3037bdf44" status: 200 len: 184 microversion: 2.1 time: 0.404488 Aug 07 01:22:18.484128 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1437/2606] 10.222.0.39 () {58 vars in 1260 bytes} [Sun Aug 7 01:22:18 2022] GET /compute/v2.1/os-floating-ips/2a540452-e8a3-4432-b383-0ca3037bdf44 => generated 184 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:18.489708 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1ddad2a3-acca-495c-8d2c-003bf0e86ed2 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:18.490656 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1ddad2a3-acca-495c-8d2c-003bf0e86ed2 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] [instance: 76aa2198-b299-4359-b606-3b6afa2326fa] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:18.510028 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ddad2a3-acca-495c-8d2c-003bf0e86ed2 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:18.511153 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ddad2a3-acca-495c-8d2c-003bf0e86ed2 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:18.514729 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ddad2a3-acca-495c-8d2c-003bf0e86ed2 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:18.520941 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ddad2a3-acca-495c-8d2c-003bf0e86ed2 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:18.521775 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ddad2a3-acca-495c-8d2c-003bf0e86ed2 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:18.522773 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ddad2a3-acca-495c-8d2c-003bf0e86ed2 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:18.659374 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1ddad2a3-acca-495c-8d2c-003bf0e86ed2 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4feb14c621b4090af8c965c9aaf0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06e7912f1fe423ea1b2a4bcdb90804a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:18.669701 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1ddad2a3-acca-495c-8d2c-003bf0e86ed2 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] 10.222.0.39 "GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa" status: 200 len: 1251 microversion: 2.1 time: 0.183650 Aug 07 01:22:18.670598 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1438/2607] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:18 2022] GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa => generated 1251 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:18.675853 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-354a08f4-f828-4c0b-af6b-623ae13248c4 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:18.676638 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-354a08f4-f828-4c0b-af6b-623ae13248c4 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] [instance: 912ca661-97cc-457c-bf67-2250ef30eb43] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:18.685196 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-354a08f4-f828-4c0b-af6b-623ae13248c4 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:18.685945 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-354a08f4-f828-4c0b-af6b-623ae13248c4 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:18.686579 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-354a08f4-f828-4c0b-af6b-623ae13248c4 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:18.687611 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-354a08f4-f828-4c0b-af6b-623ae13248c4 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:18.688266 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-354a08f4-f828-4c0b-af6b-623ae13248c4 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:18.688855 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-354a08f4-f828-4c0b-af6b-623ae13248c4 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:18.729107 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-354a08f4-f828-4c0b-af6b-623ae13248c4 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] [instance: 912ca661-97cc-457c-bf67-2250ef30eb43] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:22:18.846151 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:18.889378 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-354a08f4-f828-4c0b-af6b-623ae13248c4 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] 10.222.0.39 "DELETE /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43" status: 204 len: 0 microversion: 2.1 time: 0.215982 Aug 07 01:22:18.895464 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1439/2608] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:22:18 2022] DELETE /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:22:18.903687 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-92f0dab6-998f-4224-91f7-62af98028eca tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:18.904874 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-92f0dab6-998f-4224-91f7-62af98028eca tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: b8da873d-12c6-4107-bb72-49b6cef897e1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:18.913368 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92f0dab6-998f-4224-91f7-62af98028eca tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:18.913976 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92f0dab6-998f-4224-91f7-62af98028eca tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:18.914525 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92f0dab6-998f-4224-91f7-62af98028eca tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:18.915658 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92f0dab6-998f-4224-91f7-62af98028eca tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:18.916019 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92f0dab6-998f-4224-91f7-62af98028eca tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:18.916861 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92f0dab6-998f-4224-91f7-62af98028eca tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:19.204313 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-92f0dab6-998f-4224-91f7-62af98028eca tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:19.214142 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-92f0dab6-998f-4224-91f7-62af98028eca tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1" status: 200 len: 1510 microversion: 2.1 time: 0.319288 Aug 07 01:22:19.214142 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1440/2609] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:18 2022] GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1 => generated 1510 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:19.223249 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ee643574-a9ee-48e8-9873-353d0fa4e99d tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Action: 'action', calling method: .version_select at 0x7f9e273eae50>, body: {"removeFloatingIp": {"address": "172.35.4.107"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:19.227146 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-975812d6-528a-4875-b76e-49cc74f2bef9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:22:19.229618 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-975812d6-528a-4875-b76e-49cc74f2bef9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:22:19.230981 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-975812d6-528a-4875-b76e-49cc74f2bef9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:22:19.232577 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-975812d6-528a-4875-b76e-49cc74f2bef9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:22:19.233519 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-975812d6-528a-4875-b76e-49cc74f2bef9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:22:19.251824 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-975812d6-528a-4875-b76e-49cc74f2bef9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:19.252667 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-975812d6-528a-4875-b76e-49cc74f2bef9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:19.253297 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-975812d6-528a-4875-b76e-49cc74f2bef9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:19.254452 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-975812d6-528a-4875-b76e-49cc74f2bef9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:19.255119 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-975812d6-528a-4875-b76e-49cc74f2bef9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:19.255726 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-975812d6-528a-4875-b76e-49cc74f2bef9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:19.285141 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-975812d6-528a-4875-b76e-49cc74f2bef9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Getting quotas for project 1371b7aebfcf4088a02780393de8200f. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:22:19.296161 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-975812d6-528a-4875-b76e-49cc74f2bef9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Getting quotas for user 45ed48709ab84fa4b5b341332a843ad8 and project 1371b7aebfcf4088a02780393de8200f. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:22:19.379936 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-975812d6-528a-4875-b76e-49cc74f2bef9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:22:19.382094 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-975812d6-528a-4875-b76e-49cc74f2bef9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d57e1fb9-a6e2-430c-a768-66017b6bf6aa',volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:22:19.548676 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ee643574-a9ee-48e8-9873-353d0fa4e99d tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: ee42a97e-a680-4b64-bbfa-df12eba6dcde] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:19.555389 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee643574-a9ee-48e8-9873-353d0fa4e99d tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:19.556000 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee643574-a9ee-48e8-9873-353d0fa4e99d tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:19.556444 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee643574-a9ee-48e8-9873-353d0fa4e99d tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:19.562293 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee643574-a9ee-48e8-9873-353d0fa4e99d tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:19.566207 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee643574-a9ee-48e8-9873-353d0fa4e99d tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:19.568488 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee643574-a9ee-48e8-9873-353d0fa4e99d tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:19.604860 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-975812d6-528a-4875-b76e-49cc74f2bef9 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.263628 Aug 07 01:22:19.611003 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1170/2610] 10.222.0.39 () {62 vars in 1188 bytes} [Sun Aug 7 01:22:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1269 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 07 01:22:19.626739 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2bef928c-133e-450f-a566-b451f62a74a3 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:19.630537 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2bef928c-133e-450f-a566-b451f62a74a3 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] [instance: 912ca661-97cc-457c-bf67-2250ef30eb43] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:19.647286 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2bef928c-133e-450f-a566-b451f62a74a3 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:19.648365 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2bef928c-133e-450f-a566-b451f62a74a3 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:19.649001 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2bef928c-133e-450f-a566-b451f62a74a3 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:19.650943 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2bef928c-133e-450f-a566-b451f62a74a3 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:19.651741 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2bef928c-133e-450f-a566-b451f62a74a3 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:19.652620 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2bef928c-133e-450f-a566-b451f62a74a3 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:19.985644 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2bef928c-133e-450f-a566-b451f62a74a3 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093384280c5448f6af8915b37082e14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22296c942ac648039f202269c9d64749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:20.000902 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2bef928c-133e-450f-a566-b451f62a74a3 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] 10.222.0.39 "GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43" status: 200 len: 1511 microversion: 2.1 time: 0.388347 Aug 07 01:22:20.001554 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1171/2611] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:19 2022] GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43 => generated 1511 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:20.023043 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2729f2e9-f526-4bc8-80e6-c0527537a5c8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:20.023979 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2729f2e9-f526-4bc8-80e6-c0527537a5c8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 817c48ff-36fa-4ea6-8a75-672cfb8b6da5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:20.039764 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2729f2e9-f526-4bc8-80e6-c0527537a5c8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:20.040656 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2729f2e9-f526-4bc8-80e6-c0527537a5c8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:20.041580 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2729f2e9-f526-4bc8-80e6-c0527537a5c8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:20.042921 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2729f2e9-f526-4bc8-80e6-c0527537a5c8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:20.043948 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2729f2e9-f526-4bc8-80e6-c0527537a5c8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:20.044664 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2729f2e9-f526-4bc8-80e6-c0527537a5c8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:20.244890 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2729f2e9-f526-4bc8-80e6-c0527537a5c8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab58be25a94cd6a59634e7c7cad158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791ad97e3c374d2d8494abc25b46a0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:20.266837 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2729f2e9-f526-4bc8-80e6-c0527537a5c8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/servers/817c48ff-36fa-4ea6-8a75-672cfb8b6da5" status: 200 len: 1316 microversion: 2.1 time: 0.248424 Aug 07 01:22:20.268179 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1172/2612] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:20 2022] GET /compute/v2.1/servers/817c48ff-36fa-4ea6-8a75-672cfb8b6da5 => generated 1316 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:20.280104 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c8184820-2ddb-4213-bc10-8a1d583e9a32 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:20.281920 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c8184820-2ddb-4213-bc10-8a1d583e9a32 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 72538b92-6b72-4a50-96da-74b7d88bcd3c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:20.295482 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c8184820-2ddb-4213-bc10-8a1d583e9a32 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:20.296637 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c8184820-2ddb-4213-bc10-8a1d583e9a32 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:20.297608 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c8184820-2ddb-4213-bc10-8a1d583e9a32 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:20.298858 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c8184820-2ddb-4213-bc10-8a1d583e9a32 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:20.300025 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c8184820-2ddb-4213-bc10-8a1d583e9a32 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:20.300640 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c8184820-2ddb-4213-bc10-8a1d583e9a32 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:20.520288 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c8184820-2ddb-4213-bc10-8a1d583e9a32 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:20.532442 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c8184820-2ddb-4213-bc10-8a1d583e9a32 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c" status: 200 len: 1354 microversion: 2.1 time: 0.262405 Aug 07 01:22:20.534000 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1173/2613] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:20 2022] GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c => generated 1354 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:20.540005 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a76f3081-5df1-481e-81df-6089e9d9053e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:20.541046 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a76f3081-5df1-481e-81df-6089e9d9053e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:20.562121 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a76f3081-5df1-481e-81df-6089e9d9053e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:20.562121 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a76f3081-5df1-481e-81df-6089e9d9053e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:20.562121 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a76f3081-5df1-481e-81df-6089e9d9053e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:20.562842 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a76f3081-5df1-481e-81df-6089e9d9053e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:20.563313 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a76f3081-5df1-481e-81df-6089e9d9053e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:20.563764 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a76f3081-5df1-481e-81df-6089e9d9053e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:20.680299 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a76f3081-5df1-481e-81df-6089e9d9053e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:20.688939 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a76f3081-5df1-481e-81df-6089e9d9053e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:20.690497 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a76f3081-5df1-481e-81df-6089e9d9053e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:20.691690 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a76f3081-5df1-481e-81df-6089e9d9053e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1177 microversion: 2.25 time: 0.156041 Aug 07 01:22:20.692876 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1174/2614] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:22:20 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1177 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:22:20.711253 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-07f65041-0654-474b-8ba9-f49810f6f4ff tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:20.711253 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-07f65041-0654-474b-8ba9-f49810f6f4ff tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] [instance: 76aa2198-b299-4359-b606-3b6afa2326fa] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:20.721301 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-07f65041-0654-474b-8ba9-f49810f6f4ff tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:20.721805 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-07f65041-0654-474b-8ba9-f49810f6f4ff tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:20.722246 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-07f65041-0654-474b-8ba9-f49810f6f4ff tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:20.722988 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-07f65041-0654-474b-8ba9-f49810f6f4ff tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:20.723459 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-07f65041-0654-474b-8ba9-f49810f6f4ff tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:20.723915 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-07f65041-0654-474b-8ba9-f49810f6f4ff tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:20.736081 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=4,nova_cell1:RELEASE=2,nova_cell1:INSERT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:20.883832 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-07f65041-0654-474b-8ba9-f49810f6f4ff tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4feb14c621b4090af8c965c9aaf0e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06e7912f1fe423ea1b2a4bcdb90804a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:20.898971 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-07f65041-0654-474b-8ba9-f49810f6f4ff tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] 10.222.0.39 "GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa" status: 200 len: 1251 microversion: 2.1 time: 0.205040 Aug 07 01:22:20.919142 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1175/2615] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:20 2022] GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa => generated 1251 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:20.926304 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-b5af24d5-bb71-440e-b647-9ba7570543ba req-85708ba8-0776-4999-8454-87a15c0502d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee42a97e-a680-4b64-bbfa-df12eba6dcde", "tag": "8a25057f-4c60-4889-8490-fb06550888b8"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:20.956615 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b5af24d5-bb71-440e-b647-9ba7570543ba req-85708ba8-0776-4999-8454-87a15c0502d4 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:20.957113 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b5af24d5-bb71-440e-b647-9ba7570543ba req-85708ba8-0776-4999-8454-87a15c0502d4 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:20.957551 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b5af24d5-bb71-440e-b647-9ba7570543ba req-85708ba8-0776-4999-8454-87a15c0502d4 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:20.981116 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-b5af24d5-bb71-440e-b647-9ba7570543ba req-85708ba8-0776-4999-8454-87a15c0502d4 service nova] Creating event network-changed:8a25057f-4c60-4889-8490-fb06550888b8 for instance ee42a97e-a680-4b64-bbfa-df12eba6dcde on n-h1-master-1 Aug 07 01:22:20.990624 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-b5af24d5-bb71-440e-b647-9ba7570543ba req-85708ba8-0776-4999-8454-87a15c0502d4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068958 Aug 07 01:22:21.000943 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1176/2616] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:21.006666 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0a9f7355-fa4a-4b6f-a579-feb45e8a93d9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:21.007369 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0a9f7355-fa4a-4b6f-a579-feb45e8a93d9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: b8da873d-12c6-4107-bb72-49b6cef897e1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:21.020658 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a9f7355-fa4a-4b6f-a579-feb45e8a93d9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:21.021412 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a9f7355-fa4a-4b6f-a579-feb45e8a93d9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:21.022058 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a9f7355-fa4a-4b6f-a579-feb45e8a93d9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:21.023852 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a9f7355-fa4a-4b6f-a579-feb45e8a93d9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:21.024572 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a9f7355-fa4a-4b6f-a579-feb45e8a93d9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:21.025233 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a9f7355-fa4a-4b6f-a579-feb45e8a93d9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:21.247589 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee643574-a9ee-48e8-9873-353d0fa4e99d tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "refresh_cache-ee42a97e-a680-4b64-bbfa-df12eba6dcde" {{(pid=119516) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 07 01:22:21.249441 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee643574-a9ee-48e8-9873-353d0fa4e99d tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquired lock "refresh_cache-ee42a97e-a680-4b64-bbfa-df12eba6dcde" {{(pid=119516) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 07 01:22:21.395789 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0a9f7355-fa4a-4b6f-a579-feb45e8a93d9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:21.411758 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0a9f7355-fa4a-4b6f-a579-feb45e8a93d9 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1" status: 200 len: 1510 microversion: 2.1 time: 0.409321 Aug 07 01:22:21.415460 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1177/2617] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:21 2022] GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1 => generated 1510 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:21.438955 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-19c087d1-7a5d-4a1c-ada4-b99aeed94334 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:21.440299 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-19c087d1-7a5d-4a1c-ada4-b99aeed94334 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] [instance: 912ca661-97cc-457c-bf67-2250ef30eb43] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:21.478915 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-19c087d1-7a5d-4a1c-ada4-b99aeed94334 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:21.483200 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-19c087d1-7a5d-4a1c-ada4-b99aeed94334 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:21.486095 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-19c087d1-7a5d-4a1c-ada4-b99aeed94334 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:21.492758 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-19c087d1-7a5d-4a1c-ada4-b99aeed94334 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:21.496011 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-19c087d1-7a5d-4a1c-ada4-b99aeed94334 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:21.500811 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-19c087d1-7a5d-4a1c-ada4-b99aeed94334 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:22.314354 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-19c087d1-7a5d-4a1c-ada4-b99aeed94334 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '093384280c5448f6af8915b37082e14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22296c942ac648039f202269c9d64749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:22.327597 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-19c087d1-7a5d-4a1c-ada4-b99aeed94334 tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] 10.222.0.39 "GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43" status: 200 len: 1511 microversion: 2.1 time: 0.910621 Aug 07 01:22:22.353066 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1178/2618] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:21 2022] GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43 => generated 1511 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:22.364943 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-22a46a2c-b543-4ee7-afce-6dab7ff1d8cb tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:22.366188 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-22a46a2c-b543-4ee7-afce-6dab7ff1d8cb tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 817c48ff-36fa-4ea6-8a75-672cfb8b6da5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:22.373837 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22a46a2c-b543-4ee7-afce-6dab7ff1d8cb tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:22.374783 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22a46a2c-b543-4ee7-afce-6dab7ff1d8cb tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:22.375757 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22a46a2c-b543-4ee7-afce-6dab7ff1d8cb tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:22.376997 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22a46a2c-b543-4ee7-afce-6dab7ff1d8cb tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:22.377750 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22a46a2c-b543-4ee7-afce-6dab7ff1d8cb tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:22.378718 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22a46a2c-b543-4ee7-afce-6dab7ff1d8cb tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:23.163963 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-22a46a2c-b543-4ee7-afce-6dab7ff1d8cb tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab58be25a94cd6a59634e7c7cad158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791ad97e3c374d2d8494abc25b46a0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:23.177703 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-22a46a2c-b543-4ee7-afce-6dab7ff1d8cb tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/servers/817c48ff-36fa-4ea6-8a75-672cfb8b6da5" status: 200 len: 1316 microversion: 2.1 time: 0.818575 Aug 07 01:22:23.180506 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1179/2619] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:22 2022] GET /compute/v2.1/servers/817c48ff-36fa-4ea6-8a75-672cfb8b6da5 => generated 1316 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:23.196769 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5245a028-d051-4ab1-a8c6-0c4b0557d9fe tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:23.197402 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5245a028-d051-4ab1-a8c6-0c4b0557d9fe tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 72538b92-6b72-4a50-96da-74b7d88bcd3c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:23.227652 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5245a028-d051-4ab1-a8c6-0c4b0557d9fe tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:23.228256 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5245a028-d051-4ab1-a8c6-0c4b0557d9fe tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:23.228702 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5245a028-d051-4ab1-a8c6-0c4b0557d9fe tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:23.230684 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5245a028-d051-4ab1-a8c6-0c4b0557d9fe tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:23.232432 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5245a028-d051-4ab1-a8c6-0c4b0557d9fe tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:23.232885 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5245a028-d051-4ab1-a8c6-0c4b0557d9fe tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:23.773637 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5245a028-d051-4ab1-a8c6-0c4b0557d9fe tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:23.793135 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5245a028-d051-4ab1-a8c6-0c4b0557d9fe tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c" status: 200 len: 1354 microversion: 2.1 time: 0.609639 Aug 07 01:22:23.795014 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1180/2620] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:23 2022] GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c => generated 1354 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:23.839593 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-06938651-52ab-4ea6-9a87-86e4e52cc990 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:23.844909 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-06938651-52ab-4ea6-9a87-86e4e52cc990 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:23.861378 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06938651-52ab-4ea6-9a87-86e4e52cc990 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:23.863260 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06938651-52ab-4ea6-9a87-86e4e52cc990 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:23.864319 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06938651-52ab-4ea6-9a87-86e4e52cc990 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:23.866514 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06938651-52ab-4ea6-9a87-86e4e52cc990 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:23.868173 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06938651-52ab-4ea6-9a87-86e4e52cc990 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:23.870468 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06938651-52ab-4ea6-9a87-86e4e52cc990 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:24.033337 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-06938651-52ab-4ea6-9a87-86e4e52cc990 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:24.052570 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-06938651-52ab-4ea6-9a87-86e4e52cc990 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:24.055088 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-06938651-52ab-4ea6-9a87-86e4e52cc990 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:24.057872 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-06938651-52ab-4ea6-9a87-86e4e52cc990 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1251 microversion: 2.25 time: 0.259396 Aug 07 01:22:24.062054 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1181/2621] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:22:23 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1251 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:22:24.070105 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-def10078-6135-4b8b-b6a2-edb54c54065c tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:24.071018 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-def10078-6135-4b8b-b6a2-edb54c54065c tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] [instance: 76aa2198-b299-4359-b606-3b6afa2326fa] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:24.082653 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-def10078-6135-4b8b-b6a2-edb54c54065c tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:24.083510 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-def10078-6135-4b8b-b6a2-edb54c54065c tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:24.084128 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-def10078-6135-4b8b-b6a2-edb54c54065c tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:24.085855 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-def10078-6135-4b8b-b6a2-edb54c54065c tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:24.086634 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-def10078-6135-4b8b-b6a2-edb54c54065c tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:24.087212 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-def10078-6135-4b8b-b6a2-edb54c54065c tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:24.123168 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-def10078-6135-4b8b-b6a2-edb54c54065c tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] HTTP exception thrown: Instance 76aa2198-b299-4359-b606-3b6afa2326fa could not be found. Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-def10078-6135-4b8b-b6a2-edb54c54065c tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Request method failure captured: Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa HTTP/1.1 Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xNHNaejFwKMqRwAwQAJumDQMXyz3jERhJa6wDPFBO262339T53DqhsG7nLztHNTiqYOzbnLaCCew5NfCVvYXU-Rz_W9PTbR3oVjs-Hp9SQWIzyh8PrRWRwWbpQO6Zf7rKtuMNSENgg4-4uA2L5JvU2lHllQxwUmh2sN0gnQo6QSdUQ Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: b06e7912f1fe423ea1b2a4bcdb90804a Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersTestBootFromVolume-1998659903 Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b06e7912f1fe423ea1b2a4bcdb90804a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b06e7912f1fe423ea1b2a4bcdb90804a", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b06e7912f1fe423ea1b2a4bcdb90804a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b06e7912f1fe423ea1b2a4bcdb90804a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersTestBootFromVolume-1998659903 Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: b06e7912f1fe423ea1b2a4bcdb90804a Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1998659903 Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersTestBootFromVolume-1998659903-project Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: e4feb14c621b4090af8c965c9aaf0e2d Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersTestBootFromVolume-1998659903-project Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 76aa2198-b299-4359-b606-3b6afa2326fa could not be found. Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '76aa2198-b299-4359-b606-3b6afa2326fa'} Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76aa2198-b299-4359-b606-3b6afa2326fa could not be found. Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76aa2198-b299-4359-b606-3b6afa2326fa could not be found. Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:24.129942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:24.134774 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:24.134774 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:24.134774 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:24.134774 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:22:24.134774 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:22:24.134774 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76aa2198-b299-4359-b606-3b6afa2326fa could not be found. Aug 07 01:22:24.134774 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:24.138083 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-def10078-6135-4b8b-b6a2-edb54c54065c tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Returning 404 to user: Instance 76aa2198-b299-4359-b606-3b6afa2326fa could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:22:24.143702 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-def10078-6135-4b8b-b6a2-edb54c54065c tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] 10.222.0.39 "GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa" status: 404 len: 111 microversion: 2.1 time: 0.079784 Aug 07 01:22:24.148542 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1182/2622] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:24 2022] GET /compute/v2.1/servers/76aa2198-b299-4359-b606-3b6afa2326fa => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:22:24.159961 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-adb0bc3b-e52a-42ed-b7d5-4ddd1e25fb45 req-c4847cab-e19a-4fd9-82b9-b54391c30002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "817c48ff-36fa-4ea6-8a75-672cfb8b6da5", "name": "network-vif-plugged", "status": "completed", "tag": "2791ffb2-9e29-488e-88c1-4c55cfa4d733"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:24.189417 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-adb0bc3b-e52a-42ed-b7d5-4ddd1e25fb45 req-c4847cab-e19a-4fd9-82b9-b54391c30002 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:24.190736 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-adb0bc3b-e52a-42ed-b7d5-4ddd1e25fb45 req-c4847cab-e19a-4fd9-82b9-b54391c30002 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:24.194180 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-adb0bc3b-e52a-42ed-b7d5-4ddd1e25fb45 req-c4847cab-e19a-4fd9-82b9-b54391c30002 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:24.222738 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-adb0bc3b-e52a-42ed-b7d5-4ddd1e25fb45 req-c4847cab-e19a-4fd9-82b9-b54391c30002 service nova] Creating event network-vif-plugged:2791ffb2-9e29-488e-88c1-4c55cfa4d733 for instance 817c48ff-36fa-4ea6-8a75-672cfb8b6da5 on n-h1-master-1 Aug 07 01:22:24.242024 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-adb0bc3b-e52a-42ed-b7d5-4ddd1e25fb45 req-c4847cab-e19a-4fd9-82b9-b54391c30002 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092080 Aug 07 01:22:24.245100 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1183/2623] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:24.259604 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c50b2af7-ef9b-47f5-b79d-4f0f8a3703dd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:24.262614 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c50b2af7-ef9b-47f5-b79d-4f0f8a3703dd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: b8da873d-12c6-4107-bb72-49b6cef897e1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:24.288735 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c50b2af7-ef9b-47f5-b79d-4f0f8a3703dd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:24.292528 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c50b2af7-ef9b-47f5-b79d-4f0f8a3703dd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:24.296164 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c50b2af7-ef9b-47f5-b79d-4f0f8a3703dd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:24.298788 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c50b2af7-ef9b-47f5-b79d-4f0f8a3703dd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:24.300407 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c50b2af7-ef9b-47f5-b79d-4f0f8a3703dd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:24.303008 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c50b2af7-ef9b-47f5-b79d-4f0f8a3703dd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:24.691378 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c50b2af7-ef9b-47f5-b79d-4f0f8a3703dd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:24.706975 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c50b2af7-ef9b-47f5-b79d-4f0f8a3703dd tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1" status: 200 len: 1487 microversion: 2.1 time: 0.454068 Aug 07 01:22:24.707837 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1184/2624] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:24 2022] GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1 => generated 1487 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:24.713059 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-19a00ba7-f38e-42f7-9018-300e95911e40 req-b626d36b-0d65-4062-9107-e3b29906e670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "912ca661-97cc-457c-bf67-2250ef30eb43", "name": "network-vif-deleted", "tag": "27dafc12-f662-4012-9662-c3a303b1320d"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:24.727223 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-ee643574-a9ee-48e8-9873-353d0fa4e99d tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: ee42a97e-a680-4b64-bbfa-df12eba6dcde] Building network info cache for instance {{(pid=119516) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 07 01:22:24.746036 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-19a00ba7-f38e-42f7-9018-300e95911e40 req-b626d36b-0d65-4062-9107-e3b29906e670 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:24.748544 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-19a00ba7-f38e-42f7-9018-300e95911e40 req-b626d36b-0d65-4062-9107-e3b29906e670 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:24.749052 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-19a00ba7-f38e-42f7-9018-300e95911e40 req-b626d36b-0d65-4062-9107-e3b29906e670 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:24.789749 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-19a00ba7-f38e-42f7-9018-300e95911e40 req-b626d36b-0d65-4062-9107-e3b29906e670 service nova] Creating event network-vif-deleted:27dafc12-f662-4012-9662-c3a303b1320d for instance 912ca661-97cc-457c-bf67-2250ef30eb43 on n-h1-master-1 Aug 07 01:22:24.808295 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-19a00ba7-f38e-42f7-9018-300e95911e40 req-b626d36b-0d65-4062-9107-e3b29906e670 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094479 Aug 07 01:22:24.814065 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1185/2625] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:24.829834 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-baaccfbf-d9be-4a17-8ad3-7a4dfa04c0ed tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:24.830608 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-baaccfbf-d9be-4a17-8ad3-7a4dfa04c0ed tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] [instance: 912ca661-97cc-457c-bf67-2250ef30eb43] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:24.855122 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-baaccfbf-d9be-4a17-8ad3-7a4dfa04c0ed tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:24.855701 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-baaccfbf-d9be-4a17-8ad3-7a4dfa04c0ed tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:24.857847 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-baaccfbf-d9be-4a17-8ad3-7a4dfa04c0ed tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:24.860541 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-baaccfbf-d9be-4a17-8ad3-7a4dfa04c0ed tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:24.861064 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-baaccfbf-d9be-4a17-8ad3-7a4dfa04c0ed tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:24.863972 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-baaccfbf-d9be-4a17-8ad3-7a4dfa04c0ed tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:24.903563 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-baaccfbf-d9be-4a17-8ad3-7a4dfa04c0ed tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] HTTP exception thrown: Instance 912ca661-97cc-457c-bf67-2250ef30eb43 could not be found. Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-baaccfbf-d9be-4a17-8ad3-7a4dfa04c0ed tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Request method failure captured: Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43 HTTP/1.1 Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xOczfnCi9f_jFN4k44hedmuPuY7tBjIxybYq5vnO4eFGGPdxjZGB0_9RZ9jLDo8VFVezkgIXJKCS64R0369M77G1LKZP4zhIpdoT19UbDcK-dPmtJQASLofs-K0Dh3HttgfWk79yc9tWLeT19X5b8xzIMoLbOxg54XvemN245jItYM Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 22296c942ac648039f202269c9d64749 Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-InstanceActionsTestJSON-493048444 Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/22296c942ac648039f202269c9d64749"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_22296c942ac648039f202269c9d64749", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/22296c942ac648039f202269c9d64749"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/22296c942ac648039f202269c9d64749"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-InstanceActionsTestJSON-493048444 Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 22296c942ac648039f202269c9d64749 Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-InstanceActionsTestJSON-493048444 Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-InstanceActionsTestJSON-493048444-project Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 093384280c5448f6af8915b37082e14b Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-InstanceActionsTestJSON-493048444-project Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 912ca661-97cc-457c-bf67-2250ef30eb43 could not be found. Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '912ca661-97cc-457c-bf67-2250ef30eb43'} Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 912ca661-97cc-457c-bf67-2250ef30eb43 could not be found. Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 912ca661-97cc-457c-bf67-2250ef30eb43 could not be found. Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:24.910161 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:24.914668 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:24.914668 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:24.914668 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:24.914668 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:22:24.914668 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:22:24.914668 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 912ca661-97cc-457c-bf67-2250ef30eb43 could not be found. Aug 07 01:22:24.914668 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:24.914668 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-baaccfbf-d9be-4a17-8ad3-7a4dfa04c0ed tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] Returning 404 to user: Instance 912ca661-97cc-457c-bf67-2250ef30eb43 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:22:24.915609 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-baaccfbf-d9be-4a17-8ad3-7a4dfa04c0ed tempest-InstanceActionsTestJSON-493048444 tempest-InstanceActionsTestJSON-493048444-project] 10.222.0.39 "GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43" status: 404 len: 111 microversion: 2.1 time: 0.098607 Aug 07 01:22:24.915609 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1186/2626] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:24 2022] GET /compute/v2.1/servers/912ca661-97cc-457c-bf67-2250ef30eb43 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:22:24.929634 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b13f0e07-44f0-4b6f-8009-13b128cea685 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] Calling method '.version_select at 0x7f9e242fde50>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:24.995653 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b13f0e07-44f0-4b6f-8009-13b128cea685 tempest-ServersTestBootFromVolume-1998659903 tempest-ServersTestBootFromVolume-1998659903-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-969236097" status: 202 len: 0 microversion: 2.1 time: 0.075304 Aug 07 01:22:25.002253 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1187/2627] 10.222.0.39 () {58 vars in 1218 bytes} [Sun Aug 7 01:22:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-969236097 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:22:25.017688 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4e13cbe2-4430-46b1-92cf-caf513e3184b tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:25.018504 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4e13cbe2-4430-46b1-92cf-caf513e3184b tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 817c48ff-36fa-4ea6-8a75-672cfb8b6da5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:25.033625 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4e13cbe2-4430-46b1-92cf-caf513e3184b tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:25.034126 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4e13cbe2-4430-46b1-92cf-caf513e3184b tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:25.038303 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4e13cbe2-4430-46b1-92cf-caf513e3184b tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:25.039226 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4e13cbe2-4430-46b1-92cf-caf513e3184b tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:25.039761 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4e13cbe2-4430-46b1-92cf-caf513e3184b tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:25.040247 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4e13cbe2-4430-46b1-92cf-caf513e3184b tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:25.537712 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4e13cbe2-4430-46b1-92cf-caf513e3184b tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab58be25a94cd6a59634e7c7cad158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791ad97e3c374d2d8494abc25b46a0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:25.546411 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4e13cbe2-4430-46b1-92cf-caf513e3184b tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/servers/817c48ff-36fa-4ea6-8a75-672cfb8b6da5" status: 200 len: 1316 microversion: 2.1 time: 0.541561 Aug 07 01:22:25.566782 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1188/2628] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:25 2022] GET /compute/v2.1/servers/817c48ff-36fa-4ea6-8a75-672cfb8b6da5 => generated 1316 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:25.572071 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8734f02f-4bc7-4eb6-be5b-347998c014f6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1237597370"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:25.578264 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8734f02f-4bc7-4eb6-be5b-347998c014f6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: b8da873d-12c6-4107-bb72-49b6cef897e1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:25.593924 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8734f02f-4bc7-4eb6-be5b-347998c014f6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:25.597027 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8734f02f-4bc7-4eb6-be5b-347998c014f6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:25.600931 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8734f02f-4bc7-4eb6-be5b-347998c014f6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:25.602454 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8734f02f-4bc7-4eb6-be5b-347998c014f6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:25.604378 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8734f02f-4bc7-4eb6-be5b-347998c014f6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:25.609346 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8734f02f-4bc7-4eb6-be5b-347998c014f6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:25.752436 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8734f02f-4bc7-4eb6-be5b-347998c014f6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "PUT /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1" status: 200 len: 1060 microversion: 2.1 time: 0.184213 Aug 07 01:22:25.753650 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1189/2629] 10.222.0.39 () {60 vars in 1256 bytes} [Sun Aug 7 01:22:25 2022] PUT /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1 => generated 1060 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:25.760701 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ab8e0e6d-0028-4efb-9cc2-ec5310ab672b tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:25.765535 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ab8e0e6d-0028-4efb-9cc2-ec5310ab672b tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 72538b92-6b72-4a50-96da-74b7d88bcd3c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:25.778562 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab8e0e6d-0028-4efb-9cc2-ec5310ab672b tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:25.780550 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab8e0e6d-0028-4efb-9cc2-ec5310ab672b tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:25.782862 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab8e0e6d-0028-4efb-9cc2-ec5310ab672b tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:25.783763 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab8e0e6d-0028-4efb-9cc2-ec5310ab672b tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:25.786505 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab8e0e6d-0028-4efb-9cc2-ec5310ab672b tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:25.787076 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab8e0e6d-0028-4efb-9cc2-ec5310ab672b tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:26.128138 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ab8e0e6d-0028-4efb-9cc2-ec5310ab672b tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:26.158680 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ab8e0e6d-0028-4efb-9cc2-ec5310ab672b tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c" status: 200 len: 1354 microversion: 2.1 time: 0.401501 Aug 07 01:22:26.161446 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1190/2630] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:25 2022] GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c => generated 1354 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:26.185766 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-37fd8d02-954b-4960-b84d-4a683c801a22 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:26.192318 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-37fd8d02-954b-4960-b84d-4a683c801a22 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:26.236586 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37fd8d02-954b-4960-b84d-4a683c801a22 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:26.240497 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37fd8d02-954b-4960-b84d-4a683c801a22 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:26.241457 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37fd8d02-954b-4960-b84d-4a683c801a22 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:26.248494 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37fd8d02-954b-4960-b84d-4a683c801a22 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:26.250052 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37fd8d02-954b-4960-b84d-4a683c801a22 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:26.253945 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37fd8d02-954b-4960-b84d-4a683c801a22 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:26.763642 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-37fd8d02-954b-4960-b84d-4a683c801a22 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:26.774978 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-37fd8d02-954b-4960-b84d-4a683c801a22 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:26.779908 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-37fd8d02-954b-4960-b84d-4a683c801a22 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:26.783276 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-37fd8d02-954b-4960-b84d-4a683c801a22 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1293 microversion: 2.25 time: 0.615642 Aug 07 01:22:26.784129 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1191/2631] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:22:26 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1293 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:22:26.798519 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0c170485-4069-40ac-a902-441358cfc247 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:26.799316 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0c170485-4069-40ac-a902-441358cfc247 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: b8da873d-12c6-4107-bb72-49b6cef897e1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:26.808266 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0c170485-4069-40ac-a902-441358cfc247 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:26.811132 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0c170485-4069-40ac-a902-441358cfc247 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:26.812914 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0c170485-4069-40ac-a902-441358cfc247 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:26.813898 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0c170485-4069-40ac-a902-441358cfc247 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:26.818270 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0c170485-4069-40ac-a902-441358cfc247 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:26.818888 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0c170485-4069-40ac-a902-441358cfc247 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:27.126631 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-ee643574-a9ee-48e8-9873-353d0fa4e99d tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: ee42a97e-a680-4b64-bbfa-df12eba6dcde] Updating instance_info_cache with network_info: [{"id": "8a25057f-4c60-4889-8490-fb06550888b8", "address": "fa:16:3e:d8:4a:b0", "network": {"id": "6c5c235e-c2e8-41e7-9759-0dbd7d7d0e8a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1070683176-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "afc8a87d755a42239e9d4572e4bf2f2d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8a25057f-4c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 07 01:22:27.146662 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee643574-a9ee-48e8-9873-353d0fa4e99d tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Releasing lock "refresh_cache-ee42a97e-a680-4b64-bbfa-df12eba6dcde" {{(pid=119516) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 07 01:22:27.148884 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ee643574-a9ee-48e8-9873-353d0fa4e99d tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "POST /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde/action" status: 202 len: 0 microversion: 2.1 time: 7.928992 Aug 07 01:22:27.151950 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1441/2632] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:22:19 2022] POST /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde/action => generated 0 bytes in 7937 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 07 01:22:27.160557 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0c170485-4069-40ac-a902-441358cfc247 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:27.170924 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0c170485-4069-40ac-a902-441358cfc247 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1" status: 200 len: 1487 microversion: 2.1 time: 0.384900 Aug 07 01:22:27.173474 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1192/2633] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:26 2022] GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1 => generated 1487 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:27.174444 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-8d3e142d-fd65-439f-8855-6a22f341210b req-009c0b91-7616-44cd-842b-0850c13c1062 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "536a25a5-29bc-447e-9cf6-81b2db1ec700", "tag": "b4a97479-abbd-4e8a-b47c-ebf03a104d41"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:27.178262 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-0b96cab7-9e01-40b8-a9dd-c8b807900252 req-3fa51a98-ac5e-402d-a76c-0eae105775b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72538b92-6b72-4a50-96da-74b7d88bcd3c", "name": "network-vif-plugged", "status": "completed", "tag": "b434050c-137a-4958-8d94-110db0030b89"}, {"server_uuid": "72538b92-6b72-4a50-96da-74b7d88bcd3c", "name": "network-vif-plugged", "status": "completed", "tag": "223569dd-ed36-4248-914c-669ed102ccf4"}, {"server_uuid": "72538b92-6b72-4a50-96da-74b7d88bcd3c", "name": "network-vif-plugged", "status": "completed", "tag": "cba8300c-9e8a-4744-a200-7888f1fca836"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:27.191681 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0b96cab7-9e01-40b8-a9dd-c8b807900252 req-3fa51a98-ac5e-402d-a76c-0eae105775b8 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:27.192338 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0b96cab7-9e01-40b8-a9dd-c8b807900252 req-3fa51a98-ac5e-402d-a76c-0eae105775b8 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:27.192952 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0b96cab7-9e01-40b8-a9dd-c8b807900252 req-3fa51a98-ac5e-402d-a76c-0eae105775b8 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:27.208525 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-0b96cab7-9e01-40b8-a9dd-c8b807900252 req-3fa51a98-ac5e-402d-a76c-0eae105775b8 service nova] Creating event network-vif-plugged:b434050c-137a-4958-8d94-110db0030b89 for instance 72538b92-6b72-4a50-96da-74b7d88bcd3c on n-h2-master-1 Aug 07 01:22:27.209052 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-0b96cab7-9e01-40b8-a9dd-c8b807900252 req-3fa51a98-ac5e-402d-a76c-0eae105775b8 service nova] Creating event network-vif-plugged:223569dd-ed36-4248-914c-669ed102ccf4 for instance 72538b92-6b72-4a50-96da-74b7d88bcd3c on n-h2-master-1 Aug 07 01:22:27.209754 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-0b96cab7-9e01-40b8-a9dd-c8b807900252 req-3fa51a98-ac5e-402d-a76c-0eae105775b8 service nova] Creating event network-vif-plugged:cba8300c-9e8a-4744-a200-7888f1fca836 for instance 72538b92-6b72-4a50-96da-74b7d88bcd3c on n-h2-master-1 Aug 07 01:22:27.215580 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-8d3e142d-fd65-439f-8855-6a22f341210b req-009c0b91-7616-44cd-842b-0850c13c1062 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:27.216508 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-8d3e142d-fd65-439f-8855-6a22f341210b req-009c0b91-7616-44cd-842b-0850c13c1062 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:27.217247 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-8d3e142d-fd65-439f-8855-6a22f341210b req-009c0b91-7616-44cd-842b-0850c13c1062 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:27.217668 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-0b96cab7-9e01-40b8-a9dd-c8b807900252 req-3fa51a98-ac5e-402d-a76c-0eae105775b8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.043403 Aug 07 01:22:27.218695 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1193/2634] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:27.224656 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6c59283d-9363-4798-abb3-0e1fa7438edc tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:27.225386 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6c59283d-9363-4798-abb3-0e1fa7438edc tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 817c48ff-36fa-4ea6-8a75-672cfb8b6da5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:27.234121 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c59283d-9363-4798-abb3-0e1fa7438edc tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:27.235411 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c59283d-9363-4798-abb3-0e1fa7438edc tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:27.236047 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c59283d-9363-4798-abb3-0e1fa7438edc tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:27.251463 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c59283d-9363-4798-abb3-0e1fa7438edc tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:27.252003 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c59283d-9363-4798-abb3-0e1fa7438edc tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:27.255129 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c59283d-9363-4798-abb3-0e1fa7438edc tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:27.259692 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-8d3e142d-fd65-439f-8855-6a22f341210b req-009c0b91-7616-44cd-842b-0850c13c1062 service nova] Creating event network-changed:b4a97479-abbd-4e8a-b47c-ebf03a104d41 for instance 536a25a5-29bc-447e-9cf6-81b2db1ec700 on n-h2-master-1 Aug 07 01:22:27.298300 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-8d3e142d-fd65-439f-8855-6a22f341210b req-009c0b91-7616-44cd-842b-0850c13c1062 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135638 Aug 07 01:22:27.299348 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1442/2635] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:27.319748 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-02090572-eeb7-4c9d-a3ab-2269b9cb85a2 req-51ce8de2-dd78-425e-8076-f417229dd0dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee42a97e-a680-4b64-bbfa-df12eba6dcde", "tag": "8a25057f-4c60-4889-8490-fb06550888b8"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:27.367022 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-02090572-eeb7-4c9d-a3ab-2269b9cb85a2 req-51ce8de2-dd78-425e-8076-f417229dd0dc service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:27.372553 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-02090572-eeb7-4c9d-a3ab-2269b9cb85a2 req-51ce8de2-dd78-425e-8076-f417229dd0dc service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:27.374008 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-02090572-eeb7-4c9d-a3ab-2269b9cb85a2 req-51ce8de2-dd78-425e-8076-f417229dd0dc service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:27.426177 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-02090572-eeb7-4c9d-a3ab-2269b9cb85a2 req-51ce8de2-dd78-425e-8076-f417229dd0dc service nova] Creating event network-changed:8a25057f-4c60-4889-8490-fb06550888b8 for instance ee42a97e-a680-4b64-bbfa-df12eba6dcde on n-h1-master-1 Aug 07 01:22:27.456183 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-02090572-eeb7-4c9d-a3ab-2269b9cb85a2 req-51ce8de2-dd78-425e-8076-f417229dd0dc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152139 Aug 07 01:22:27.461389 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1443/2636] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:27.478494 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ddd35175-4592-4349-9efa-f4c154310506 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:27.486395 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ddd35175-4592-4349-9efa-f4c154310506 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: aa4e1c13-c268-4138-ad4e-8627558931bf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:27.513262 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddd35175-4592-4349-9efa-f4c154310506 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:27.514548 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddd35175-4592-4349-9efa-f4c154310506 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:27.515007 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddd35175-4592-4349-9efa-f4c154310506 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:27.518528 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddd35175-4592-4349-9efa-f4c154310506 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:27.519659 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddd35175-4592-4349-9efa-f4c154310506 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:27.520172 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddd35175-4592-4349-9efa-f4c154310506 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:27.561171 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-ddd35175-4592-4349-9efa-f4c154310506 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] HTTP exception thrown: Instance aa4e1c13-c268-4138-ad4e-8627558931bf could not be found. Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ddd35175-4592-4349-9efa-f4c154310506 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Request method failure captured: Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/servers/aa4e1c13-c268-4138-ad4e-8627558931bf HTTP/1.1 Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xNxyRFbl8-_9_nYUVdUpTgz7xbjp9TfbS1_o1roGpGmBOpk6vldBnNDFFGA21Wk90hDsWXGZI7pPE3AIOUOwXhgkSAEzupQWOiKslq0k4W6jDiEG-w8xgWWh6qRWb9brPWe34VDJ2Q-_bQzw-U6DpqRTfZ4GN04cV-v6xf1_81AWRA Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: afc8a87d755a42239e9d4572e4bf2f2d Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-629577005 Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/afc8a87d755a42239e9d4572e4bf2f2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_afc8a87d755a42239e9d4572e4bf2f2d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/afc8a87d755a42239e9d4572e4bf2f2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/afc8a87d755a42239e9d4572e4bf2f2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-629577005 Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: afc8a87d755a42239e9d4572e4bf2f2d Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-629577005 Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-FloatingIPsAssociationTestJSON-629577005-project Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 5041cbc4adc24ae8871d60064720d680 Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-629577005-project Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: exception: Instance aa4e1c13-c268-4138-ad4e-8627558931bf could not be found. Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'aa4e1c13-c268-4138-ad4e-8627558931bf'} Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa4e1c13-c268-4138-ad4e-8627558931bf could not be found. Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:22:27.567445 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:22:27.572393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa4e1c13-c268-4138-ad4e-8627558931bf could not be found. Aug 07 01:22:27.572393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:27.572393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:27.572393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:27.572393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:27.572393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:27.572393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:27.572393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:22:27.572393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:22:27.572393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa4e1c13-c268-4138-ad4e-8627558931bf could not be found. Aug 07 01:22:27.572393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:27.572393 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ddd35175-4592-4349-9efa-f4c154310506 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Returning 404 to user: Instance aa4e1c13-c268-4138-ad4e-8627558931bf could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:22:27.572393 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ddd35175-4592-4349-9efa-f4c154310506 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "DELETE /compute/v2.1/servers/aa4e1c13-c268-4138-ad4e-8627558931bf" status: 404 len: 111 microversion: 2.1 time: 0.106123 Aug 07 01:22:27.575666 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1444/2637] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:22:27 2022] DELETE /compute/v2.1/servers/aa4e1c13-c268-4138-ad4e-8627558931bf => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:22:27.589726 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7a4d34f4-aa84-45a3-9daa-919853eaa94e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:27.593021 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7a4d34f4-aa84-45a3-9daa-919853eaa94e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 72538b92-6b72-4a50-96da-74b7d88bcd3c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:27.611486 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7a4d34f4-aa84-45a3-9daa-919853eaa94e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:27.614350 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7a4d34f4-aa84-45a3-9daa-919853eaa94e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:27.615021 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7a4d34f4-aa84-45a3-9daa-919853eaa94e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:27.617784 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7a4d34f4-aa84-45a3-9daa-919853eaa94e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:27.625221 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7a4d34f4-aa84-45a3-9daa-919853eaa94e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:27.625890 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7a4d34f4-aa84-45a3-9daa-919853eaa94e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:28.534493 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6c59283d-9363-4798-abb3-0e1fa7438edc tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab58be25a94cd6a59634e7c7cad158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791ad97e3c374d2d8494abc25b46a0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:28.546444 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6c59283d-9363-4798-abb3-0e1fa7438edc tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/servers/817c48ff-36fa-4ea6-8a75-672cfb8b6da5" status: 200 len: 1504 microversion: 2.1 time: 1.326462 Aug 07 01:22:28.563450 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1194/2638] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:27 2022] GET /compute/v2.1/servers/817c48ff-36fa-4ea6-8a75-672cfb8b6da5 => generated 1504 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:28.568788 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0051b46d-2f23-4313-a60a-7c5ba4bf2b76 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:28.569751 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0051b46d-2f23-4313-a60a-7c5ba4bf2b76 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: b8da873d-12c6-4107-bb72-49b6cef897e1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:28.586108 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0051b46d-2f23-4313-a60a-7c5ba4bf2b76 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:28.586884 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0051b46d-2f23-4313-a60a-7c5ba4bf2b76 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:28.587511 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0051b46d-2f23-4313-a60a-7c5ba4bf2b76 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:28.588472 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0051b46d-2f23-4313-a60a-7c5ba4bf2b76 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:28.589222 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0051b46d-2f23-4313-a60a-7c5ba4bf2b76 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:28.590516 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0051b46d-2f23-4313-a60a-7c5ba4bf2b76 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:28.604259 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7a4d34f4-aa84-45a3-9daa-919853eaa94e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:28.621727 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7a4d34f4-aa84-45a3-9daa-919853eaa94e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c" status: 200 len: 1354 microversion: 2.1 time: 1.042022 Aug 07 01:22:28.637304 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1445/2639] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:27 2022] GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c => generated 1354 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:28.644329 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e15a8b18-3d4a-4529-90fe-cf6bb7d1d6fd tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:28.645388 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e15a8b18-3d4a-4529-90fe-cf6bb7d1d6fd tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: aa4e1c13-c268-4138-ad4e-8627558931bf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:28.659230 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e15a8b18-3d4a-4529-90fe-cf6bb7d1d6fd tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:28.660313 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e15a8b18-3d4a-4529-90fe-cf6bb7d1d6fd tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:28.661000 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e15a8b18-3d4a-4529-90fe-cf6bb7d1d6fd tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:28.662797 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e15a8b18-3d4a-4529-90fe-cf6bb7d1d6fd tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:28.664425 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e15a8b18-3d4a-4529-90fe-cf6bb7d1d6fd tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:28.668671 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e15a8b18-3d4a-4529-90fe-cf6bb7d1d6fd tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:28.694460 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-e15a8b18-3d4a-4529-90fe-cf6bb7d1d6fd tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] HTTP exception thrown: Instance aa4e1c13-c268-4138-ad4e-8627558931bf could not be found. Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e15a8b18-3d4a-4529-90fe-cf6bb7d1d6fd tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Request method failure captured: Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/aa4e1c13-c268-4138-ad4e-8627558931bf HTTP/1.1 Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xNxyRFbl8-_9_nYUVdUpTgz7xbjp9TfbS1_o1roGpGmBOpk6vldBnNDFFGA21Wk90hDsWXGZI7pPE3AIOUOwXhgkSAEzupQWOiKslq0k4W6jDiEG-w8xgWWh6qRWb9brPWe34VDJ2Q-_bQzw-U6DpqRTfZ4GN04cV-v6xf1_81AWRA Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: afc8a87d755a42239e9d4572e4bf2f2d Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-629577005 Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/afc8a87d755a42239e9d4572e4bf2f2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_afc8a87d755a42239e9d4572e4bf2f2d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/afc8a87d755a42239e9d4572e4bf2f2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/afc8a87d755a42239e9d4572e4bf2f2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-629577005 Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: afc8a87d755a42239e9d4572e4bf2f2d Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-629577005 Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-FloatingIPsAssociationTestJSON-629577005-project Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 5041cbc4adc24ae8871d60064720d680 Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-629577005-project Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: exception: Instance aa4e1c13-c268-4138-ad4e-8627558931bf could not be found. Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'aa4e1c13-c268-4138-ad4e-8627558931bf'} Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa4e1c13-c268-4138-ad4e-8627558931bf could not be found. Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa4e1c13-c268-4138-ad4e-8627558931bf could not be found. Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:28.696713 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:28.700891 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:28.700891 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:28.700891 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:28.700891 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:28.700891 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:22:28.700891 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:22:28.700891 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa4e1c13-c268-4138-ad4e-8627558931bf could not be found. Aug 07 01:22:28.700891 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:28.705435 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e15a8b18-3d4a-4529-90fe-cf6bb7d1d6fd tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Returning 404 to user: Instance aa4e1c13-c268-4138-ad4e-8627558931bf could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:22:28.706970 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e15a8b18-3d4a-4529-90fe-cf6bb7d1d6fd tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "GET /compute/v2.1/servers/aa4e1c13-c268-4138-ad4e-8627558931bf" status: 404 len: 111 microversion: 2.1 time: 0.068091 Aug 07 01:22:28.708986 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1446/2640] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:28 2022] GET /compute/v2.1/servers/aa4e1c13-c268-4138-ad4e-8627558931bf => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:22:28.715609 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-893fa082-6770-4f78-8b65-51d44c6607ae tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:28.716593 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-893fa082-6770-4f78-8b65-51d44c6607ae tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:28.723032 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-893fa082-6770-4f78-8b65-51d44c6607ae tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:28.723958 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-893fa082-6770-4f78-8b65-51d44c6607ae tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:28.726573 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-893fa082-6770-4f78-8b65-51d44c6607ae tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:28.728080 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-893fa082-6770-4f78-8b65-51d44c6607ae tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:28.728799 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-893fa082-6770-4f78-8b65-51d44c6607ae tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:28.729479 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-893fa082-6770-4f78-8b65-51d44c6607ae tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:29.072616 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-893fa082-6770-4f78-8b65-51d44c6607ae tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:29.090661 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-893fa082-6770-4f78-8b65-51d44c6607ae tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:29.092640 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-893fa082-6770-4f78-8b65-51d44c6607ae tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:29.094054 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-893fa082-6770-4f78-8b65-51d44c6607ae tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1293 microversion: 2.25 time: 0.383572 Aug 07 01:22:29.096052 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1447/2641] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:22:28 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1293 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:22:29.102380 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-be895a0a-5742-4a8d-bd0d-0a11a7690304 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-179833216"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:29.107120 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-be895a0a-5742-4a8d-bd0d-0a11a7690304 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 817c48ff-36fa-4ea6-8a75-672cfb8b6da5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:29.122738 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-be895a0a-5742-4a8d-bd0d-0a11a7690304 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:29.123874 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-be895a0a-5742-4a8d-bd0d-0a11a7690304 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:29.126527 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-be895a0a-5742-4a8d-bd0d-0a11a7690304 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:29.127583 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-be895a0a-5742-4a8d-bd0d-0a11a7690304 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:29.137277 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-be895a0a-5742-4a8d-bd0d-0a11a7690304 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:29.138003 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-be895a0a-5742-4a8d-bd0d-0a11a7690304 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:29.142822 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:29.271465 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:29.314674 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:29.666275 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0051b46d-2f23-4313-a60a-7c5ba4bf2b76 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:29.705212 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0051b46d-2f23-4313-a60a-7c5ba4bf2b76 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1" status: 200 len: 1487 microversion: 2.1 time: 1.138984 Aug 07 01:22:29.711212 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1195/2642] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:28 2022] GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1 => generated 1487 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:29.720698 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0cbe9625-56c0-493a-9076-a4b8d36b14ed tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Calling method '.version_select at 0x7f9e24348af0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:29.887029 n-d-master-1 devstack@n-api.service[119516]: INFO nova.network.security_group_api [None req-be895a0a-5742-4a8d-bd0d-0a11a7690304 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Adding security group 98595ee8-51ab-4c0a-b639-bc69b6033141 to port 2791ffb2-9e29-488e-88c1-4c55cfa4d733 Aug 07 01:22:31.475548 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-be895a0a-5742-4a8d-bd0d-0a11a7690304 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "POST /compute/v2.1/servers/817c48ff-36fa-4ea6-8a75-672cfb8b6da5/action" status: 202 len: 0 microversion: 2.1 time: 2.378165 Aug 07 01:22:31.476900 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1448/2643] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:22:29 2022] POST /compute/v2.1/servers/817c48ff-36fa-4ea6-8a75-672cfb8b6da5/action => generated 0 bytes in 2380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:22:31.485530 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-280c05d5-4e41-4098-ac66-f5acd97f2a00 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:31.486439 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-280c05d5-4e41-4098-ac66-f5acd97f2a00 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 72538b92-6b72-4a50-96da-74b7d88bcd3c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:31.525455 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-280c05d5-4e41-4098-ac66-f5acd97f2a00 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:31.529171 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-280c05d5-4e41-4098-ac66-f5acd97f2a00 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:31.535123 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-280c05d5-4e41-4098-ac66-f5acd97f2a00 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:31.536866 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-280c05d5-4e41-4098-ac66-f5acd97f2a00 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:31.541007 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-280c05d5-4e41-4098-ac66-f5acd97f2a00 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:31.547276 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-280c05d5-4e41-4098-ac66-f5acd97f2a00 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:32.390106 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-280c05d5-4e41-4098-ac66-f5acd97f2a00 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:32.402834 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-280c05d5-4e41-4098-ac66-f5acd97f2a00 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c" status: 200 len: 1805 microversion: 2.1 time: 0.924160 Aug 07 01:22:32.419179 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1449/2644] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:31 2022] GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c => generated 1805 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:32.439474 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-74c4457c-c7d5-4f5f-b0af-7c0db5d9b3b5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:32.447388 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-74c4457c-c7d5-4f5f-b0af-7c0db5d9b3b5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: b8da873d-12c6-4107-bb72-49b6cef897e1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:32.462888 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-74c4457c-c7d5-4f5f-b0af-7c0db5d9b3b5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:32.463413 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-74c4457c-c7d5-4f5f-b0af-7c0db5d9b3b5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:32.463854 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-74c4457c-c7d5-4f5f-b0af-7c0db5d9b3b5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:32.476617 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-74c4457c-c7d5-4f5f-b0af-7c0db5d9b3b5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:32.477439 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-74c4457c-c7d5-4f5f-b0af-7c0db5d9b3b5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:32.484948 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-74c4457c-c7d5-4f5f-b0af-7c0db5d9b3b5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:32.568544 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-74c4457c-c7d5-4f5f-b0af-7c0db5d9b3b5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: b8da873d-12c6-4107-bb72-49b6cef897e1] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:22:32.834188 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-74c4457c-c7d5-4f5f-b0af-7c0db5d9b3b5 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1" status: 204 len: 0 microversion: 2.1 time: 0.412392 Aug 07 01:22:32.835682 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1450/2645] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:22:32 2022] DELETE /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:22:32.846178 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3fe8797f-188a-40d0-a695-04c822a43b67 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:32.847784 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3fe8797f-188a-40d0-a695-04c822a43b67 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:32.869688 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fe8797f-188a-40d0-a695-04c822a43b67 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:32.873253 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fe8797f-188a-40d0-a695-04c822a43b67 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:32.874540 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fe8797f-188a-40d0-a695-04c822a43b67 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:32.877990 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fe8797f-188a-40d0-a695-04c822a43b67 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:32.883595 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fe8797f-188a-40d0-a695-04c822a43b67 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:32.884834 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fe8797f-188a-40d0-a695-04c822a43b67 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:33.663252 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3fe8797f-188a-40d0-a695-04c822a43b67 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:33.679310 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3fe8797f-188a-40d0-a695-04c822a43b67 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:33.681035 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3fe8797f-188a-40d0-a695-04c822a43b67 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:33.682259 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3fe8797f-188a-40d0-a695-04c822a43b67 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1293 microversion: 2.25 time: 0.844970 Aug 07 01:22:33.682843 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1451/2646] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:22:32 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1293 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:22:33.694988 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ef7fdf9b-c251-4ec9-bfbb-bc40e58d3b40 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-670941133"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:33.699942 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ef7fdf9b-c251-4ec9-bfbb-bc40e58d3b40 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 817c48ff-36fa-4ea6-8a75-672cfb8b6da5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:33.707592 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef7fdf9b-c251-4ec9-bfbb-bc40e58d3b40 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:33.708124 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef7fdf9b-c251-4ec9-bfbb-bc40e58d3b40 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:33.708574 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef7fdf9b-c251-4ec9-bfbb-bc40e58d3b40 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:33.709867 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef7fdf9b-c251-4ec9-bfbb-bc40e58d3b40 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:33.710358 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef7fdf9b-c251-4ec9-bfbb-bc40e58d3b40 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:33.710797 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef7fdf9b-c251-4ec9-bfbb-bc40e58d3b40 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:34.055724 n-d-master-1 devstack@n-api.service[119516]: INFO nova.network.security_group_api [None req-ef7fdf9b-c251-4ec9-bfbb-bc40e58d3b40 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Adding security group 80e964be-6230-419c-959c-df68acd15810 to port 2791ffb2-9e29-488e-88c1-4c55cfa4d733 Aug 07 01:22:34.364545 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0cbe9625-56c0-493a-9076-a4b8d36b14ed tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/2a540452-e8a3-4432-b383-0ca3037bdf44" status: 202 len: 0 microversion: 2.1 time: 4.651748 Aug 07 01:22:34.372591 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1196/2647] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Aug 7 01:22:29 2022] DELETE /compute/v2.1/os-floating-ips/2a540452-e8a3-4432-b383-0ca3037bdf44 => generated 0 bytes in 4660 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:22:34.382695 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-214be03f-9b77-4bda-aa8d-4162b5232359 req-494b61dc-9f10-4315-b9ce-9903173d0067 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "817c48ff-36fa-4ea6-8a75-672cfb8b6da5", "tag": "2791ffb2-9e29-488e-88c1-4c55cfa4d733"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:34.399457 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-214be03f-9b77-4bda-aa8d-4162b5232359 req-494b61dc-9f10-4315-b9ce-9903173d0067 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:34.401377 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-214be03f-9b77-4bda-aa8d-4162b5232359 req-494b61dc-9f10-4315-b9ce-9903173d0067 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:34.402252 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-214be03f-9b77-4bda-aa8d-4162b5232359 req-494b61dc-9f10-4315-b9ce-9903173d0067 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:34.413801 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:34.445520 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-214be03f-9b77-4bda-aa8d-4162b5232359 req-494b61dc-9f10-4315-b9ce-9903173d0067 service nova] Creating event network-changed:2791ffb2-9e29-488e-88c1-4c55cfa4d733 for instance 817c48ff-36fa-4ea6-8a75-672cfb8b6da5 on n-h1-master-1 Aug 07 01:22:34.455208 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-214be03f-9b77-4bda-aa8d-4162b5232359 req-494b61dc-9f10-4315-b9ce-9903173d0067 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079224 Aug 07 01:22:34.456581 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1197/2648] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:34.463072 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4d9eaaf0-3b1a-4697-8398-86d34a079857 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:34.464282 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4d9eaaf0-3b1a-4697-8398-86d34a079857 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 72538b92-6b72-4a50-96da-74b7d88bcd3c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:34.473658 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d9eaaf0-3b1a-4697-8398-86d34a079857 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:34.474861 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d9eaaf0-3b1a-4697-8398-86d34a079857 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:34.475577 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d9eaaf0-3b1a-4697-8398-86d34a079857 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:34.476677 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d9eaaf0-3b1a-4697-8398-86d34a079857 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:34.477893 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d9eaaf0-3b1a-4697-8398-86d34a079857 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:34.478836 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d9eaaf0-3b1a-4697-8398-86d34a079857 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:34.565612 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4d9eaaf0-3b1a-4697-8398-86d34a079857 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c/ips" status: 200 len: 219 microversion: 2.1 time: 0.107158 Aug 07 01:22:34.566723 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1198/2649] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Aug 7 01:22:34 2022] GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c/ips => generated 219 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:34.572075 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-96abca15-9cc6-4dcd-826d-71a28f1debf0 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:34.572774 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-96abca15-9cc6-4dcd-826d-71a28f1debf0 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: b8da873d-12c6-4107-bb72-49b6cef897e1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:34.592554 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-96abca15-9cc6-4dcd-826d-71a28f1debf0 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:34.593061 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-96abca15-9cc6-4dcd-826d-71a28f1debf0 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:34.593511 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-96abca15-9cc6-4dcd-826d-71a28f1debf0 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:34.594253 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-96abca15-9cc6-4dcd-826d-71a28f1debf0 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:34.595133 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-96abca15-9cc6-4dcd-826d-71a28f1debf0 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:34.600119 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-96abca15-9cc6-4dcd-826d-71a28f1debf0 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:35.003543 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-96abca15-9cc6-4dcd-826d-71a28f1debf0 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:35.015189 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-96abca15-9cc6-4dcd-826d-71a28f1debf0 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1" status: 200 len: 1493 microversion: 2.1 time: 0.446999 Aug 07 01:22:35.016260 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1199/2650] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:34 2022] GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1 => generated 1493 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:35.021217 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d53f4e32-4ce2-411a-a45e-f4c0c257bd20 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:35.022056 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d53f4e32-4ce2-411a-a45e-f4c0c257bd20 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: ee42a97e-a680-4b64-bbfa-df12eba6dcde] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:35.029206 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d53f4e32-4ce2-411a-a45e-f4c0c257bd20 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:35.030061 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d53f4e32-4ce2-411a-a45e-f4c0c257bd20 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:35.030765 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d53f4e32-4ce2-411a-a45e-f4c0c257bd20 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:35.031712 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d53f4e32-4ce2-411a-a45e-f4c0c257bd20 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:35.032512 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d53f4e32-4ce2-411a-a45e-f4c0c257bd20 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:35.033159 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d53f4e32-4ce2-411a-a45e-f4c0c257bd20 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:35.062266 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d53f4e32-4ce2-411a-a45e-f4c0c257bd20 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: ee42a97e-a680-4b64-bbfa-df12eba6dcde] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:22:35.158558 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d53f4e32-4ce2-411a-a45e-f4c0c257bd20 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde" status: 204 len: 0 microversion: 2.1 time: 0.140830 Aug 07 01:22:35.159826 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1200/2651] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:22:35 2022] DELETE /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:22:35.165864 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-66e92a4c-0af9-4498-9818-3168a1a24e14 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:35.166465 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-66e92a4c-0af9-4498-9818-3168a1a24e14 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 72538b92-6b72-4a50-96da-74b7d88bcd3c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:35.174499 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-66e92a4c-0af9-4498-9818-3168a1a24e14 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:35.175007 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-66e92a4c-0af9-4498-9818-3168a1a24e14 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:35.176795 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-66e92a4c-0af9-4498-9818-3168a1a24e14 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:35.178315 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-66e92a4c-0af9-4498-9818-3168a1a24e14 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:35.179025 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-66e92a4c-0af9-4498-9818-3168a1a24e14 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:35.179718 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-66e92a4c-0af9-4498-9818-3168a1a24e14 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:35.234327 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-66e92a4c-0af9-4498-9818-3168a1a24e14 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 72538b92-6b72-4a50-96da-74b7d88bcd3c] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:22:35.339460 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:35.351637 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-66e92a4c-0af9-4498-9818-3168a1a24e14 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "DELETE /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c" status: 204 len: 0 microversion: 2.1 time: 0.189807 Aug 07 01:22:35.352472 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1201/2652] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:22:35 2022] DELETE /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:22:35.360669 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b5f43aef-64b3-4c18-b3ec-d038cc67c753 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:35.361764 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b5f43aef-64b3-4c18-b3ec-d038cc67c753 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:35.371488 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5f43aef-64b3-4c18-b3ec-d038cc67c753 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:35.372187 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5f43aef-64b3-4c18-b3ec-d038cc67c753 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:35.372441 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5f43aef-64b3-4c18-b3ec-d038cc67c753 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:35.373401 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5f43aef-64b3-4c18-b3ec-d038cc67c753 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:35.373871 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5f43aef-64b3-4c18-b3ec-d038cc67c753 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:35.374304 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5f43aef-64b3-4c18-b3ec-d038cc67c753 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:35.643696 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b5f43aef-64b3-4c18-b3ec-d038cc67c753 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:35.658171 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b5f43aef-64b3-4c18-b3ec-d038cc67c753 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:35.664114 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b5f43aef-64b3-4c18-b3ec-d038cc67c753 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:35.666117 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b5f43aef-64b3-4c18-b3ec-d038cc67c753 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1281 microversion: 2.25 time: 0.312215 Aug 07 01:22:35.667019 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1202/2653] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:22:35 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1281 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:22:35.673229 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e6035b21-2eec-4469-a70d-b0f660d942b9 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:35.674202 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e6035b21-2eec-4469-a70d-b0f660d942b9 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: ee42a97e-a680-4b64-bbfa-df12eba6dcde] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:35.697054 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e6035b21-2eec-4469-a70d-b0f660d942b9 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:35.697890 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e6035b21-2eec-4469-a70d-b0f660d942b9 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:35.698563 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e6035b21-2eec-4469-a70d-b0f660d942b9 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:35.699687 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e6035b21-2eec-4469-a70d-b0f660d942b9 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:35.700482 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e6035b21-2eec-4469-a70d-b0f660d942b9 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:35.701140 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e6035b21-2eec-4469-a70d-b0f660d942b9 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:35.924711 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e6035b21-2eec-4469-a70d-b0f660d942b9 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5041cbc4adc24ae8871d60064720d680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc8a87d755a42239e9d4572e4bf2f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:35.937747 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e6035b21-2eec-4469-a70d-b0f660d942b9 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "GET /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde" status: 200 len: 1526 microversion: 2.1 time: 0.268532 Aug 07 01:22:35.939005 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1203/2654] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:35 2022] GET /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde => generated 1526 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:35.952226 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-106ac59f-3330-4865-91ff-6a6898b8c469 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:35.952226 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-106ac59f-3330-4865-91ff-6a6898b8c469 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 72538b92-6b72-4a50-96da-74b7d88bcd3c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:35.976373 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-106ac59f-3330-4865-91ff-6a6898b8c469 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:35.987700 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-106ac59f-3330-4865-91ff-6a6898b8c469 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:35.988180 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-106ac59f-3330-4865-91ff-6a6898b8c469 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:35.989243 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-106ac59f-3330-4865-91ff-6a6898b8c469 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:35.989886 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-106ac59f-3330-4865-91ff-6a6898b8c469 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:35.990298 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-106ac59f-3330-4865-91ff-6a6898b8c469 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:36.225458 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-106ac59f-3330-4865-91ff-6a6898b8c469 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:36.236846 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-106ac59f-3330-4865-91ff-6a6898b8c469 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c" status: 200 len: 1811 microversion: 2.1 time: 0.296168 Aug 07 01:22:36.237082 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ef7fdf9b-c251-4ec9-bfbb-bc40e58d3b40 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "POST /compute/v2.1/servers/817c48ff-36fa-4ea6-8a75-672cfb8b6da5/action" status: 202 len: 0 microversion: 2.1 time: 2.551624 Aug 07 01:22:36.237866 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1204/2655] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:35 2022] GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c => generated 1811 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:36.238648 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1452/2656] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:22:33 2022] POST /compute/v2.1/servers/817c48ff-36fa-4ea6-8a75-672cfb8b6da5/action => generated 0 bytes in 2554 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:22:36.244424 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fbdac44d-5275-4452-bd72-f90159495734 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:36.245355 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fbdac44d-5275-4452-bd72-f90159495734 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: b8da873d-12c6-4107-bb72-49b6cef897e1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:36.260562 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fbdac44d-5275-4452-bd72-f90159495734 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:36.261076 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fbdac44d-5275-4452-bd72-f90159495734 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:36.262106 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fbdac44d-5275-4452-bd72-f90159495734 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:36.263306 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fbdac44d-5275-4452-bd72-f90159495734 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:36.270400 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fbdac44d-5275-4452-bd72-f90159495734 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:36.271292 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fbdac44d-5275-4452-bd72-f90159495734 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:36.471472 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4676217d-6dde-4d3e-94e7-1aa5cd26544e tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Action: 'create', calling method: .version_select at 0x7f9e242dc430>, body: {"keypair": {"name": "tempest-keypair-1563677030", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEN+8NlUejFXvRoYxHffKZ4ESTk0x18+atPzTyZ4wJwFSdhwk2M5RTlFaJ2OY24bUQvnwN/X1qaENU9TxLDTVnzfRirw3ir0Nd2QIwrc2HKhhub1qKxDI7ceFYQPhKnv3w=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:36.502655 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-4676217d-6dde-4d3e-94e7-1aa5cd26544e tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Getting quotas for project 6a5267b6a8e34a4397cd94fae11283be. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:22:36.510685 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-4676217d-6dde-4d3e-94e7-1aa5cd26544e tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Getting quotas for user 2185c595c9df4719bdca76d8797c76e3 and project 6a5267b6a8e34a4397cd94fae11283be. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:22:36.551379 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4676217d-6dde-4d3e-94e7-1aa5cd26544e tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.312239 Aug 07 01:22:36.564156 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1205/2657] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:22:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:36.569340 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-28eda45f-a1f0-4cb7-9e8e-cb6d6fbc3fc3 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:36.569864 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-28eda45f-a1f0-4cb7-9e8e-cb6d6fbc3fc3 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 817c48ff-36fa-4ea6-8a75-672cfb8b6da5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:36.581935 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28eda45f-a1f0-4cb7-9e8e-cb6d6fbc3fc3 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:36.582440 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28eda45f-a1f0-4cb7-9e8e-cb6d6fbc3fc3 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:36.582886 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28eda45f-a1f0-4cb7-9e8e-cb6d6fbc3fc3 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:36.583619 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28eda45f-a1f0-4cb7-9e8e-cb6d6fbc3fc3 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:36.584122 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28eda45f-a1f0-4cb7-9e8e-cb6d6fbc3fc3 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:36.584559 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28eda45f-a1f0-4cb7-9e8e-cb6d6fbc3fc3 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:36.696903 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fbdac44d-5275-4452-bd72-f90159495734 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:36.705832 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fbdac44d-5275-4452-bd72-f90159495734 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1" status: 200 len: 1451 microversion: 2.1 time: 0.465909 Aug 07 01:22:36.707189 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1453/2658] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:36 2022] GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1 => generated 1451 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:36.736626 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-9134a51a-7fb7-4fb1-80d1-1113185786bc req-1f9b60e2-e769-43f9-9114-bf94645a1a56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8da873d-12c6-4107-bb72-49b6cef897e1", "name": "network-vif-deleted", "tag": "0f8e1eea-f5ca-442c-81a5-6d667ac5e6f8"}, {"name": "network-changed", "server_uuid": "817c48ff-36fa-4ea6-8a75-672cfb8b6da5", "tag": "2791ffb2-9e29-488e-88c1-4c55cfa4d733"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:36.751093 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-9134a51a-7fb7-4fb1-80d1-1113185786bc req-1f9b60e2-e769-43f9-9114-bf94645a1a56 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:36.752146 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-9134a51a-7fb7-4fb1-80d1-1113185786bc req-1f9b60e2-e769-43f9-9114-bf94645a1a56 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:36.752841 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-9134a51a-7fb7-4fb1-80d1-1113185786bc req-1f9b60e2-e769-43f9-9114-bf94645a1a56 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:36.770601 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-9134a51a-7fb7-4fb1-80d1-1113185786bc req-1f9b60e2-e769-43f9-9114-bf94645a1a56 service nova] Creating event network-vif-deleted:0f8e1eea-f5ca-442c-81a5-6d667ac5e6f8 for instance b8da873d-12c6-4107-bb72-49b6cef897e1 on n-h1-master-1 Aug 07 01:22:36.771707 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-9134a51a-7fb7-4fb1-80d1-1113185786bc req-1f9b60e2-e769-43f9-9114-bf94645a1a56 service nova] Creating event network-changed:2791ffb2-9e29-488e-88c1-4c55cfa4d733 for instance 817c48ff-36fa-4ea6-8a75-672cfb8b6da5 on n-h1-master-1 Aug 07 01:22:36.786518 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-9134a51a-7fb7-4fb1-80d1-1113185786bc req-1f9b60e2-e769-43f9-9114-bf94645a1a56 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.063379 Aug 07 01:22:36.789568 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1454/2659] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:36.801870 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-22312307-e8dc-4366-8377-0510bd9d9a88 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:36.803530 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-22312307-e8dc-4366-8377-0510bd9d9a88 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:36.817602 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22312307-e8dc-4366-8377-0510bd9d9a88 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:36.821227 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22312307-e8dc-4366-8377-0510bd9d9a88 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:36.822435 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22312307-e8dc-4366-8377-0510bd9d9a88 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:36.823859 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22312307-e8dc-4366-8377-0510bd9d9a88 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:36.826151 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22312307-e8dc-4366-8377-0510bd9d9a88 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:36.827026 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22312307-e8dc-4366-8377-0510bd9d9a88 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:36.960067 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-28eda45f-a1f0-4cb7-9e8e-cb6d6fbc3fc3 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/servers/817c48ff-36fa-4ea6-8a75-672cfb8b6da5/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.394865 Aug 07 01:22:36.960667 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1206/2660] 10.222.0.39 () {58 vars in 1293 bytes} [Sun Aug 7 01:22:36 2022] GET /compute/v2.1/servers/817c48ff-36fa-4ea6-8a75-672cfb8b6da5/os-security-groups => generated 1157 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:36.991946 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e2e99e54-24da-4c5a-aaef-b80676c50dc6 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:36.994046 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e2e99e54-24da-4c5a-aaef-b80676c50dc6 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: ee42a97e-a680-4b64-bbfa-df12eba6dcde] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:37.010902 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e2e99e54-24da-4c5a-aaef-b80676c50dc6 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:37.012200 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e2e99e54-24da-4c5a-aaef-b80676c50dc6 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:37.013064 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e2e99e54-24da-4c5a-aaef-b80676c50dc6 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:37.014455 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e2e99e54-24da-4c5a-aaef-b80676c50dc6 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:37.015560 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e2e99e54-24da-4c5a-aaef-b80676c50dc6 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:37.016638 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e2e99e54-24da-4c5a-aaef-b80676c50dc6 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:37.413106 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e2e99e54-24da-4c5a-aaef-b80676c50dc6 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5041cbc4adc24ae8871d60064720d680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc8a87d755a42239e9d4572e4bf2f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:37.432243 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e2e99e54-24da-4c5a-aaef-b80676c50dc6 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "GET /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde" status: 200 len: 1526 microversion: 2.1 time: 0.470148 Aug 07 01:22:37.446418 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1207/2661] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:36 2022] GET /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde => generated 1526 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:37.454778 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fc502542-792f-45ec-8634-54003d1f7055 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Action: 'create', calling method: .version_select at 0x7f9e243881f0>, body: {"security_group": {"name": " tempest-securitygroup -860956277 ", "description": "tempest-description-215401199"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:38.106688 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-22312307-e8dc-4366-8377-0510bd9d9a88 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:38.125178 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-22312307-e8dc-4366-8377-0510bd9d9a88 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:38.128086 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-22312307-e8dc-4366-8377-0510bd9d9a88 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:38.149457 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-22312307-e8dc-4366-8377-0510bd9d9a88 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1281 microversion: 2.25 time: 1.357255 Aug 07 01:22:38.150129 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1455/2662] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:22:36 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1281 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:22:38.161353 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0cbd6d35-52b4-4e58-9d6a-ed61e5f22c9d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:38.161986 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0cbd6d35-52b4-4e58-9d6a-ed61e5f22c9d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 72538b92-6b72-4a50-96da-74b7d88bcd3c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:38.200407 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0cbd6d35-52b4-4e58-9d6a-ed61e5f22c9d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:38.202191 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0cbd6d35-52b4-4e58-9d6a-ed61e5f22c9d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:38.204579 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0cbd6d35-52b4-4e58-9d6a-ed61e5f22c9d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:38.209264 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0cbd6d35-52b4-4e58-9d6a-ed61e5f22c9d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:38.210693 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0cbd6d35-52b4-4e58-9d6a-ed61e5f22c9d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:38.211815 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0cbd6d35-52b4-4e58-9d6a-ed61e5f22c9d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:38.490796 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fc502542-792f-45ec-8634-54003d1f7055 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 1.040340 Aug 07 01:22:38.508730 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1208/2663] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Aug 7 01:22:37 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:38.535367 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-938f76fb-4028-4b3b-9a2a-32c434b17342 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:38.537024 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-938f76fb-4028-4b3b-9a2a-32c434b17342 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: b8da873d-12c6-4107-bb72-49b6cef897e1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:38.567317 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-938f76fb-4028-4b3b-9a2a-32c434b17342 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:38.568448 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-938f76fb-4028-4b3b-9a2a-32c434b17342 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:38.569337 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-938f76fb-4028-4b3b-9a2a-32c434b17342 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:38.571739 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-938f76fb-4028-4b3b-9a2a-32c434b17342 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:38.573054 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-938f76fb-4028-4b3b-9a2a-32c434b17342 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:38.574251 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-938f76fb-4028-4b3b-9a2a-32c434b17342 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:38.604509 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-938f76fb-4028-4b3b-9a2a-32c434b17342 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] HTTP exception thrown: Instance b8da873d-12c6-4107-bb72-49b6cef897e1 could not be found. Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-938f76fb-4028-4b3b-9a2a-32c434b17342 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Request method failure captured: Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1 HTTP/1.1 Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xLZuMLvQ88KTsXpEnT0I-tjdBFOm7EEtVmBSoi3hGbagLa-WCqW3nJreDc3WwTe1tbLbMC3xnpg15asRoKTlUvK3aMhcihww2F0hywjkHPX3fkbbtMYbGiIT_pGesW2tpqp2g11Pwb-WDA3oTL-VeLkmCHA0u8DPW_SmhTlX9-nF08 Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersTestJSON-576619186 Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_efad066360cb45b3a6e9ba872118ea57", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersTestJSON-576619186 Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersTestJSON-576619186 Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersTestJSON-576619186-project Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d4f7282c7251455086368d5274a4fac5 Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersTestJSON-576619186-project Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: exception: Instance b8da873d-12c6-4107-bb72-49b6cef897e1 could not be found. Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'b8da873d-12c6-4107-bb72-49b6cef897e1'} Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8da873d-12c6-4107-bb72-49b6cef897e1 could not be found. Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8da873d-12c6-4107-bb72-49b6cef897e1 could not be found. Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:38.608068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:38.616521 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:38.616521 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:38.616521 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:22:38.616521 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:22:38.616521 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8da873d-12c6-4107-bb72-49b6cef897e1 could not be found. Aug 07 01:22:38.616521 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:38.616521 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-938f76fb-4028-4b3b-9a2a-32c434b17342 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Returning 404 to user: Instance b8da873d-12c6-4107-bb72-49b6cef897e1 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:22:38.616521 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-938f76fb-4028-4b3b-9a2a-32c434b17342 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1" status: 404 len: 111 microversion: 2.1 time: 0.099213 Aug 07 01:22:38.616521 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1209/2664] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:38 2022] GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:22:38.621346 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5c7b1b6c-b400-4ee9-88e6-29f2ce60e169 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:38.622091 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5c7b1b6c-b400-4ee9-88e6-29f2ce60e169 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: ee42a97e-a680-4b64-bbfa-df12eba6dcde] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:38.630013 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c7b1b6c-b400-4ee9-88e6-29f2ce60e169 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:38.630672 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c7b1b6c-b400-4ee9-88e6-29f2ce60e169 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:38.631225 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c7b1b6c-b400-4ee9-88e6-29f2ce60e169 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:38.632114 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c7b1b6c-b400-4ee9-88e6-29f2ce60e169 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:38.632701 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c7b1b6c-b400-4ee9-88e6-29f2ce60e169 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:38.633261 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c7b1b6c-b400-4ee9-88e6-29f2ce60e169 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:39.385683 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5c7b1b6c-b400-4ee9-88e6-29f2ce60e169 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5041cbc4adc24ae8871d60064720d680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc8a87d755a42239e9d4572e4bf2f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:39.396970 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5c7b1b6c-b400-4ee9-88e6-29f2ce60e169 tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "GET /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde" status: 200 len: 1526 microversion: 2.1 time: 0.780213 Aug 07 01:22:39.399305 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1210/2665] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:38 2022] GET /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde => generated 1526 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:39.410087 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f5545c00-9eea-4996-837a-ef332cca9a9f tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '.version_select at 0x7f9e2436a040>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:39.467445 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0cbd6d35-52b4-4e58-9d6a-ed61e5f22c9d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:39.480853 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0cbd6d35-52b4-4e58-9d6a-ed61e5f22c9d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c" status: 200 len: 1811 microversion: 2.1 time: 1.323986 Aug 07 01:22:39.490457 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1456/2666] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:38 2022] GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c => generated 1811 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:39.497665 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ad809bd7-2a87-4721-a2eb-cd1f48b00bfc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:39.498389 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ad809bd7-2a87-4721-a2eb-cd1f48b00bfc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: b8da873d-12c6-4107-bb72-49b6cef897e1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:39.509728 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ad809bd7-2a87-4721-a2eb-cd1f48b00bfc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:39.514221 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ad809bd7-2a87-4721-a2eb-cd1f48b00bfc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:39.514924 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ad809bd7-2a87-4721-a2eb-cd1f48b00bfc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:39.515861 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ad809bd7-2a87-4721-a2eb-cd1f48b00bfc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:39.519665 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ad809bd7-2a87-4721-a2eb-cd1f48b00bfc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:39.520591 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ad809bd7-2a87-4721-a2eb-cd1f48b00bfc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:39.556374 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-ad809bd7-2a87-4721-a2eb-cd1f48b00bfc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] HTTP exception thrown: Instance b8da873d-12c6-4107-bb72-49b6cef897e1 could not be found. Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ad809bd7-2a87-4721-a2eb-cd1f48b00bfc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Request method failure captured: Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1 HTTP/1.1 Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xLZuMLvQ88KTsXpEnT0I-tjdBFOm7EEtVmBSoi3hGbagLa-WCqW3nJreDc3WwTe1tbLbMC3xnpg15asRoKTlUvK3aMhcihww2F0hywjkHPX3fkbbtMYbGiIT_pGesW2tpqp2g11Pwb-WDA3oTL-VeLkmCHA0u8DPW_SmhTlX9-nF08 Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersTestJSON-576619186 Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_efad066360cb45b3a6e9ba872118ea57", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersTestJSON-576619186 Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersTestJSON-576619186 Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersTestJSON-576619186-project Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: d4f7282c7251455086368d5274a4fac5 Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersTestJSON-576619186-project Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: exception: Instance b8da873d-12c6-4107-bb72-49b6cef897e1 could not be found. Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'b8da873d-12c6-4107-bb72-49b6cef897e1'} Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8da873d-12c6-4107-bb72-49b6cef897e1 could not be found. Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:22:39.568519 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8da873d-12c6-4107-bb72-49b6cef897e1 could not be found. Aug 07 01:22:39.572660 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:39.572660 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:39.572660 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:39.572660 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:39.572660 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:39.572660 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:39.572660 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:22:39.572660 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:22:39.572660 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8da873d-12c6-4107-bb72-49b6cef897e1 could not be found. Aug 07 01:22:39.572660 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:39.575238 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ad809bd7-2a87-4721-a2eb-cd1f48b00bfc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Returning 404 to user: Instance b8da873d-12c6-4107-bb72-49b6cef897e1 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:22:39.576462 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ad809bd7-2a87-4721-a2eb-cd1f48b00bfc tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1" status: 404 len: 111 microversion: 2.1 time: 0.084603 Aug 07 01:22:39.577660 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1457/2667] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:22:39 2022] DELETE /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:22:39.583161 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-4f2e1fd9-fe34-455f-8394-4d76bb039bb3 req-b26acca8-27b8-4200-b502-3bb7e0341d02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72538b92-6b72-4a50-96da-74b7d88bcd3c", "name": "network-vif-deleted", "tag": "b434050c-137a-4958-8d94-110db0030b89"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:39.610204 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4f2e1fd9-fe34-455f-8394-4d76bb039bb3 req-b26acca8-27b8-4200-b502-3bb7e0341d02 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:39.610722 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4f2e1fd9-fe34-455f-8394-4d76bb039bb3 req-b26acca8-27b8-4200-b502-3bb7e0341d02 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:39.611168 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4f2e1fd9-fe34-455f-8394-4d76bb039bb3 req-b26acca8-27b8-4200-b502-3bb7e0341d02 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:39.640024 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-4f2e1fd9-fe34-455f-8394-4d76bb039bb3 req-b26acca8-27b8-4200-b502-3bb7e0341d02 service nova] Creating event network-vif-deleted:b434050c-137a-4958-8d94-110db0030b89 for instance 72538b92-6b72-4a50-96da-74b7d88bcd3c on n-h2-master-1 Aug 07 01:22:39.655735 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-4f2e1fd9-fe34-455f-8394-4d76bb039bb3 req-b26acca8-27b8-4200-b502-3bb7e0341d02 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076553 Aug 07 01:22:39.657222 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1458/2668] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:39.672272 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2752df7d-8df6-482a-a741-6bc2cbe5ac7c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:39.672994 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2752df7d-8df6-482a-a741-6bc2cbe5ac7c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:39.695911 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2752df7d-8df6-482a-a741-6bc2cbe5ac7c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:39.696797 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2752df7d-8df6-482a-a741-6bc2cbe5ac7c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:39.697963 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2752df7d-8df6-482a-a741-6bc2cbe5ac7c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:39.701003 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2752df7d-8df6-482a-a741-6bc2cbe5ac7c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:39.701828 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2752df7d-8df6-482a-a741-6bc2cbe5ac7c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:39.702673 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2752df7d-8df6-482a-a741-6bc2cbe5ac7c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:39.804625 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f5545c00-9eea-4996-837a-ef332cca9a9f tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups/e2280de3-252f-4dc1-b32c-99c902752847" status: 200 len: 222 microversion: 2.1 time: 0.402446 Aug 07 01:22:39.814318 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1211/2669] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Aug 7 01:22:39 2022] GET /compute/v2.1/os-security-groups/e2280de3-252f-4dc1-b32c-99c902752847 => generated 222 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:39.820179 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-967b0282-bfc9-418e-923b-85c4ba7d3504 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:39.821217 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-967b0282-bfc9-418e-923b-85c4ba7d3504 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: b8da873d-12c6-4107-bb72-49b6cef897e1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:39.847486 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-967b0282-bfc9-418e-923b-85c4ba7d3504 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:39.848501 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-967b0282-bfc9-418e-923b-85c4ba7d3504 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:39.851619 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-967b0282-bfc9-418e-923b-85c4ba7d3504 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:39.855691 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-967b0282-bfc9-418e-923b-85c4ba7d3504 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:39.868521 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-967b0282-bfc9-418e-923b-85c4ba7d3504 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:39.869385 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-967b0282-bfc9-418e-923b-85c4ba7d3504 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:39.962321 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-967b0282-bfc9-418e-923b-85c4ba7d3504 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] HTTP exception thrown: Instance b8da873d-12c6-4107-bb72-49b6cef897e1 could not be found. Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-967b0282-bfc9-418e-923b-85c4ba7d3504 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Request method failure captured: Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1 HTTP/1.1 Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xLZuMLvQ88KTsXpEnT0I-tjdBFOm7EEtVmBSoi3hGbagLa-WCqW3nJreDc3WwTe1tbLbMC3xnpg15asRoKTlUvK3aMhcihww2F0hywjkHPX3fkbbtMYbGiIT_pGesW2tpqp2g11Pwb-WDA3oTL-VeLkmCHA0u8DPW_SmhTlX9-nF08 Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersTestJSON-576619186 Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_efad066360cb45b3a6e9ba872118ea57", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersTestJSON-576619186 Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersTestJSON-576619186 Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersTestJSON-576619186-project Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d4f7282c7251455086368d5274a4fac5 Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersTestJSON-576619186-project Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: exception: Instance b8da873d-12c6-4107-bb72-49b6cef897e1 could not be found. Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'b8da873d-12c6-4107-bb72-49b6cef897e1'} Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8da873d-12c6-4107-bb72-49b6cef897e1 could not be found. Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8da873d-12c6-4107-bb72-49b6cef897e1 could not be found. Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:39.976769 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:39.981925 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:39.981925 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:39.981925 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:22:39.981925 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:22:39.981925 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8da873d-12c6-4107-bb72-49b6cef897e1 could not be found. Aug 07 01:22:39.981925 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:39.985586 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-967b0282-bfc9-418e-923b-85c4ba7d3504 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Returning 404 to user: Instance b8da873d-12c6-4107-bb72-49b6cef897e1 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:22:39.993962 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-967b0282-bfc9-418e-923b-85c4ba7d3504 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1" status: 404 len: 111 microversion: 2.1 time: 0.177931 Aug 07 01:22:39.997213 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1212/2670] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:39 2022] GET /compute/v2.1/servers/b8da873d-12c6-4107-bb72-49b6cef897e1 => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:22:40.018123 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-412dc76b-fe3c-495a-b61e-278a0e619ef8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '.version_select at 0x7f9e242d5af0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:40.567824 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2752df7d-8df6-482a-a741-6bc2cbe5ac7c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:40.581184 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2752df7d-8df6-482a-a741-6bc2cbe5ac7c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:40.582710 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2752df7d-8df6-482a-a741-6bc2cbe5ac7c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:40.583870 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2752df7d-8df6-482a-a741-6bc2cbe5ac7c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1281 microversion: 2.25 time: 0.925507 Aug 07 01:22:40.595095 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1459/2671] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:22:39 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1281 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:22:40.607025 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8ecbd419-1df6-4898-b2bf-112153b386e6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:40.616986 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8ecbd419-1df6-4898-b2bf-112153b386e6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: c320acee-ca30-4e57-a35f-0f102d7cd7a5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:40.631135 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8ecbd419-1df6-4898-b2bf-112153b386e6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:40.634747 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8ecbd419-1df6-4898-b2bf-112153b386e6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:40.635366 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8ecbd419-1df6-4898-b2bf-112153b386e6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:40.637049 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8ecbd419-1df6-4898-b2bf-112153b386e6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:40.639899 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8ecbd419-1df6-4898-b2bf-112153b386e6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:40.640619 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8ecbd419-1df6-4898-b2bf-112153b386e6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:40.670935 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-8ecbd419-1df6-4898-b2bf-112153b386e6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] HTTP exception thrown: Instance c320acee-ca30-4e57-a35f-0f102d7cd7a5 could not be found. Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8ecbd419-1df6-4898-b2bf-112153b386e6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Request method failure captured: Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5 HTTP/1.1 Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xLZuMLvQ88KTsXpEnT0I-tjdBFOm7EEtVmBSoi3hGbagLa-WCqW3nJreDc3WwTe1tbLbMC3xnpg15asRoKTlUvK3aMhcihww2F0hywjkHPX3fkbbtMYbGiIT_pGesW2tpqp2g11Pwb-WDA3oTL-VeLkmCHA0u8DPW_SmhTlX9-nF08 Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersTestJSON-576619186 Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_efad066360cb45b3a6e9ba872118ea57", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersTestJSON-576619186 Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersTestJSON-576619186 Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersTestJSON-576619186-project Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: d4f7282c7251455086368d5274a4fac5 Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersTestJSON-576619186-project Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: exception: Instance c320acee-ca30-4e57-a35f-0f102d7cd7a5 could not be found. Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'c320acee-ca30-4e57-a35f-0f102d7cd7a5'} Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c320acee-ca30-4e57-a35f-0f102d7cd7a5 could not be found. Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:22:40.674884 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c320acee-ca30-4e57-a35f-0f102d7cd7a5 could not be found. Aug 07 01:22:40.678575 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:40.678575 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:40.678575 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:40.678575 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:40.678575 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:40.678575 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:40.678575 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:22:40.678575 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:22:40.678575 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c320acee-ca30-4e57-a35f-0f102d7cd7a5 could not be found. Aug 07 01:22:40.678575 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:40.680882 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8ecbd419-1df6-4898-b2bf-112153b386e6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Returning 404 to user: Instance c320acee-ca30-4e57-a35f-0f102d7cd7a5 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:22:40.682205 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8ecbd419-1df6-4898-b2bf-112153b386e6 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5" status: 404 len: 111 microversion: 2.1 time: 0.086013 Aug 07 01:22:40.683038 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1460/2672] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:22:40 2022] DELETE /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:22:40.692168 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c06420e4-5c40-437a-ac2f-234e0601932a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:40.693030 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c06420e4-5c40-437a-ac2f-234e0601932a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] [instance: ee42a97e-a680-4b64-bbfa-df12eba6dcde] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:40.700651 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c06420e4-5c40-437a-ac2f-234e0601932a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:40.701409 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c06420e4-5c40-437a-ac2f-234e0601932a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:40.702019 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c06420e4-5c40-437a-ac2f-234e0601932a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:40.702917 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c06420e4-5c40-437a-ac2f-234e0601932a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:40.703532 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c06420e4-5c40-437a-ac2f-234e0601932a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:40.704198 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c06420e4-5c40-437a-ac2f-234e0601932a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:40.724727 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-c06420e4-5c40-437a-ac2f-234e0601932a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] HTTP exception thrown: Instance ee42a97e-a680-4b64-bbfa-df12eba6dcde could not be found. Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c06420e4-5c40-437a-ac2f-234e0601932a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Request method failure captured: Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde HTTP/1.1 Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xNxyRFbl8-_9_nYUVdUpTgz7xbjp9TfbS1_o1roGpGmBOpk6vldBnNDFFGA21Wk90hDsWXGZI7pPE3AIOUOwXhgkSAEzupQWOiKslq0k4W6jDiEG-w8xgWWh6qRWb9brPWe34VDJ2Q-_bQzw-U6DpqRTfZ4GN04cV-v6xf1_81AWRA Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: afc8a87d755a42239e9d4572e4bf2f2d Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-629577005 Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/afc8a87d755a42239e9d4572e4bf2f2d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_afc8a87d755a42239e9d4572e4bf2f2d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/afc8a87d755a42239e9d4572e4bf2f2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/afc8a87d755a42239e9d4572e4bf2f2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-629577005 Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: afc8a87d755a42239e9d4572e4bf2f2d Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-629577005 Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-FloatingIPsAssociationTestJSON-629577005-project Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 5041cbc4adc24ae8871d60064720d680 Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-629577005-project Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: exception: Instance ee42a97e-a680-4b64-bbfa-df12eba6dcde could not be found. Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'ee42a97e-a680-4b64-bbfa-df12eba6dcde'} Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee42a97e-a680-4b64-bbfa-df12eba6dcde could not be found. Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee42a97e-a680-4b64-bbfa-df12eba6dcde could not be found. Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:40.726610 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:40.732660 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:40.732660 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:40.732660 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:40.732660 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:40.732660 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:22:40.732660 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:22:40.732660 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee42a97e-a680-4b64-bbfa-df12eba6dcde could not be found. Aug 07 01:22:40.732660 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:40.734686 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c06420e4-5c40-437a-ac2f-234e0601932a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] Returning 404 to user: Instance ee42a97e-a680-4b64-bbfa-df12eba6dcde could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:22:40.735855 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c06420e4-5c40-437a-ac2f-234e0601932a tempest-FloatingIPsAssociationTestJSON-629577005 tempest-FloatingIPsAssociationTestJSON-629577005-project] 10.222.0.39 "GET /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde" status: 404 len: 111 microversion: 2.1 time: 0.050974 Aug 07 01:22:40.740638 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1461/2673] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:40 2022] GET /compute/v2.1/servers/ee42a97e-a680-4b64-bbfa-df12eba6dcde => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:22:40.746519 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dd6e43e3-c17c-4913-8fb6-6b01d83f27b3 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:40.747576 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-dd6e43e3-c17c-4913-8fb6-6b01d83f27b3 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 72538b92-6b72-4a50-96da-74b7d88bcd3c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:40.754826 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd6e43e3-c17c-4913-8fb6-6b01d83f27b3 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:40.755721 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd6e43e3-c17c-4913-8fb6-6b01d83f27b3 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:40.756570 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd6e43e3-c17c-4913-8fb6-6b01d83f27b3 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:40.757743 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd6e43e3-c17c-4913-8fb6-6b01d83f27b3 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:40.758486 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd6e43e3-c17c-4913-8fb6-6b01d83f27b3 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:40.759181 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd6e43e3-c17c-4913-8fb6-6b01d83f27b3 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:41.617930 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-412dc76b-fe3c-495a-b61e-278a0e619ef8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/e2280de3-252f-4dc1-b32c-99c902752847" status: 202 len: 0 microversion: 2.1 time: 1.618849 Aug 07 01:22:41.623611 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1213/2674] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:22:39 2022] DELETE /compute/v2.1/os-security-groups/e2280de3-252f-4dc1-b32c-99c902752847 => generated 0 bytes in 1622 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:22:41.630134 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c36bd057-e214-460f-9660-77319840e858 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:41.631093 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c36bd057-e214-460f-9660-77319840e858 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: c320acee-ca30-4e57-a35f-0f102d7cd7a5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:41.640004 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c36bd057-e214-460f-9660-77319840e858 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:41.641112 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c36bd057-e214-460f-9660-77319840e858 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:41.641761 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c36bd057-e214-460f-9660-77319840e858 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:41.642689 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c36bd057-e214-460f-9660-77319840e858 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:41.643328 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c36bd057-e214-460f-9660-77319840e858 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:41.643956 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c36bd057-e214-460f-9660-77319840e858 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:41.666616 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-c36bd057-e214-460f-9660-77319840e858 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] HTTP exception thrown: Instance c320acee-ca30-4e57-a35f-0f102d7cd7a5 could not be found. Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c36bd057-e214-460f-9660-77319840e858 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Request method failure captured: Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5 HTTP/1.1 Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xLZuMLvQ88KTsXpEnT0I-tjdBFOm7EEtVmBSoi3hGbagLa-WCqW3nJreDc3WwTe1tbLbMC3xnpg15asRoKTlUvK3aMhcihww2F0hywjkHPX3fkbbtMYbGiIT_pGesW2tpqp2g11Pwb-WDA3oTL-VeLkmCHA0u8DPW_SmhTlX9-nF08 Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersTestJSON-576619186 Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_efad066360cb45b3a6e9ba872118ea57", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersTestJSON-576619186 Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersTestJSON-576619186 Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersTestJSON-576619186-project Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d4f7282c7251455086368d5274a4fac5 Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersTestJSON-576619186-project Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: exception: Instance c320acee-ca30-4e57-a35f-0f102d7cd7a5 could not be found. Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'c320acee-ca30-4e57-a35f-0f102d7cd7a5'} Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c320acee-ca30-4e57-a35f-0f102d7cd7a5 could not be found. Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c320acee-ca30-4e57-a35f-0f102d7cd7a5 could not be found. Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:41.669024 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:41.673055 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:41.673055 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:41.673055 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:22:41.673055 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:22:41.673055 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c320acee-ca30-4e57-a35f-0f102d7cd7a5 could not be found. Aug 07 01:22:41.673055 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:41.676149 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c36bd057-e214-460f-9660-77319840e858 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Returning 404 to user: Instance c320acee-ca30-4e57-a35f-0f102d7cd7a5 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:22:41.677315 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c36bd057-e214-460f-9660-77319840e858 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5" status: 404 len: 111 microversion: 2.1 time: 0.051386 Aug 07 01:22:41.678916 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1214/2675] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:41 2022] GET /compute/v2.1/servers/c320acee-ca30-4e57-a35f-0f102d7cd7a5 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:22:41.686570 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-f03958c6-ce8a-493f-b2f1-d1eec9776a0a req-57d398e1-618d-45e4-b005-49b8f9f327e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72538b92-6b72-4a50-96da-74b7d88bcd3c", "name": "network-vif-unplugged", "status": "completed", "tag": "223569dd-ed36-4248-914c-669ed102ccf4"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:41.701889 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f03958c6-ce8a-493f-b2f1-d1eec9776a0a req-57d398e1-618d-45e4-b005-49b8f9f327e3 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:41.702722 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f03958c6-ce8a-493f-b2f1-d1eec9776a0a req-57d398e1-618d-45e4-b005-49b8f9f327e3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:41.703392 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f03958c6-ce8a-493f-b2f1-d1eec9776a0a req-57d398e1-618d-45e4-b005-49b8f9f327e3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:41.718394 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-f03958c6-ce8a-493f-b2f1-d1eec9776a0a req-57d398e1-618d-45e4-b005-49b8f9f327e3 service nova] Creating event network-vif-unplugged:223569dd-ed36-4248-914c-669ed102ccf4 for instance 72538b92-6b72-4a50-96da-74b7d88bcd3c on n-h2-master-1 Aug 07 01:22:41.727257 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-f03958c6-ce8a-493f-b2f1-d1eec9776a0a req-57d398e1-618d-45e4-b005-49b8f9f327e3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046469 Aug 07 01:22:41.728561 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1215/2676] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:41.735121 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-06ea599c-0c59-4ea9-87e4-d1d9df4ce216 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:41.736344 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-06ea599c-0c59-4ea9-87e4-d1d9df4ce216 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:41.751049 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06ea599c-0c59-4ea9-87e4-d1d9df4ce216 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:41.751476 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06ea599c-0c59-4ea9-87e4-d1d9df4ce216 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:41.752396 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06ea599c-0c59-4ea9-87e4-d1d9df4ce216 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:41.754277 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06ea599c-0c59-4ea9-87e4-d1d9df4ce216 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:41.755618 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06ea599c-0c59-4ea9-87e4-d1d9df4ce216 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:41.756901 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06ea599c-0c59-4ea9-87e4-d1d9df4ce216 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:42.091364 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-dd6e43e3-c17c-4913-8fb6-6b01d83f27b3 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:42.108661 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-dd6e43e3-c17c-4913-8fb6-6b01d83f27b3 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c" status: 200 len: 1675 microversion: 2.1 time: 1.366372 Aug 07 01:22:42.133084 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1462/2677] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:40 2022] GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c => generated 1675 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:42.148761 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0c3808e6-aa4d-4769-a903-99a970761c26 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '.version_select at 0x7f9e179b78b0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:42.149519 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-06ea599c-0c59-4ea9-87e4-d1d9df4ce216 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:42.162284 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-06ea599c-0c59-4ea9-87e4-d1d9df4ce216 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:42.163665 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-06ea599c-0c59-4ea9-87e4-d1d9df4ce216 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:42.169011 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-06ea599c-0c59-4ea9-87e4-d1d9df4ce216 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1281 microversion: 2.25 time: 0.439095 Aug 07 01:22:42.169602 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1216/2678] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:22:41 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1281 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:22:42.180375 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8a548d63-bcf0-4c92-a6eb-45266e1a8efa tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:42.181902 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8a548d63-bcf0-4c92-a6eb-45266e1a8efa tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: a1c09528-36b8-4b0d-b03c-2d3351649579] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:42.209894 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a548d63-bcf0-4c92-a6eb-45266e1a8efa tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:42.210385 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a548d63-bcf0-4c92-a6eb-45266e1a8efa tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:42.210821 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a548d63-bcf0-4c92-a6eb-45266e1a8efa tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:42.211541 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a548d63-bcf0-4c92-a6eb-45266e1a8efa tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:42.212020 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a548d63-bcf0-4c92-a6eb-45266e1a8efa tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:42.212625 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a548d63-bcf0-4c92-a6eb-45266e1a8efa tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:42.229795 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-8a548d63-bcf0-4c92-a6eb-45266e1a8efa tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] HTTP exception thrown: Instance a1c09528-36b8-4b0d-b03c-2d3351649579 could not be found. Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8a548d63-bcf0-4c92-a6eb-45266e1a8efa tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Request method failure captured: Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579 HTTP/1.1 Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xLZuMLvQ88KTsXpEnT0I-tjdBFOm7EEtVmBSoi3hGbagLa-WCqW3nJreDc3WwTe1tbLbMC3xnpg15asRoKTlUvK3aMhcihww2F0hywjkHPX3fkbbtMYbGiIT_pGesW2tpqp2g11Pwb-WDA3oTL-VeLkmCHA0u8DPW_SmhTlX9-nF08 Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersTestJSON-576619186 Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_efad066360cb45b3a6e9ba872118ea57", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersTestJSON-576619186 Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersTestJSON-576619186 Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersTestJSON-576619186-project Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d4f7282c7251455086368d5274a4fac5 Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersTestJSON-576619186-project Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: exception: Instance a1c09528-36b8-4b0d-b03c-2d3351649579 could not be found. Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'a1c09528-36b8-4b0d-b03c-2d3351649579'} Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1c09528-36b8-4b0d-b03c-2d3351649579 could not be found. Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:22:42.231927 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1c09528-36b8-4b0d-b03c-2d3351649579 could not be found. Aug 07 01:22:42.238365 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.238365 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:42.238365 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.238365 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:42.238365 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:42.238365 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:42.238365 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:22:42.238365 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:22:42.238365 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1c09528-36b8-4b0d-b03c-2d3351649579 could not be found. Aug 07 01:22:42.238365 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.238365 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8a548d63-bcf0-4c92-a6eb-45266e1a8efa tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Returning 404 to user: Instance a1c09528-36b8-4b0d-b03c-2d3351649579 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:22:42.238365 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8a548d63-bcf0-4c92-a6eb-45266e1a8efa tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579" status: 404 len: 111 microversion: 2.1 time: 0.059225 Aug 07 01:22:42.238365 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1217/2679] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:22:42 2022] DELETE /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:22:42.241843 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-51c33a43-bb86-4622-a330-e388fd05a5d3 req-8989e267-9552-4b66-b089-7cc1e73189c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee42a97e-a680-4b64-bbfa-df12eba6dcde", "name": "network-vif-deleted", "tag": "8a25057f-4c60-4889-8490-fb06550888b8"}, {"server_uuid": "72538b92-6b72-4a50-96da-74b7d88bcd3c", "name": "network-vif-deleted", "tag": "cba8300c-9e8a-4744-a200-7888f1fca836"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:42.258225 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-51c33a43-bb86-4622-a330-e388fd05a5d3 req-8989e267-9552-4b66-b089-7cc1e73189c6 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:42.258664 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-51c33a43-bb86-4622-a330-e388fd05a5d3 req-8989e267-9552-4b66-b089-7cc1e73189c6 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:42.259195 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-51c33a43-bb86-4622-a330-e388fd05a5d3 req-8989e267-9552-4b66-b089-7cc1e73189c6 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:42.287740 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-51c33a43-bb86-4622-a330-e388fd05a5d3 req-8989e267-9552-4b66-b089-7cc1e73189c6 service nova] Creating event network-vif-deleted:8a25057f-4c60-4889-8490-fb06550888b8 for instance ee42a97e-a680-4b64-bbfa-df12eba6dcde on n-h1-master-1 Aug 07 01:22:42.288489 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-51c33a43-bb86-4622-a330-e388fd05a5d3 req-8989e267-9552-4b66-b089-7cc1e73189c6 service nova] Creating event network-vif-deleted:cba8300c-9e8a-4744-a200-7888f1fca836 for instance 72538b92-6b72-4a50-96da-74b7d88bcd3c on n-h2-master-1 Aug 07 01:22:42.304959 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-51c33a43-bb86-4622-a330-e388fd05a5d3 req-8989e267-9552-4b66-b089-7cc1e73189c6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.066628 Aug 07 01:22:42.305733 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1218/2680] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:42.318560 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ce1c51dc-0033-4f85-befe-8972b62bb8ae tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:42.319272 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ce1c51dc-0033-4f85-befe-8972b62bb8ae tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: a1c09528-36b8-4b0d-b03c-2d3351649579] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:42.336478 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce1c51dc-0033-4f85-befe-8972b62bb8ae tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:42.345022 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce1c51dc-0033-4f85-befe-8972b62bb8ae tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:42.345553 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce1c51dc-0033-4f85-befe-8972b62bb8ae tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:42.346432 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce1c51dc-0033-4f85-befe-8972b62bb8ae tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:42.346895 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce1c51dc-0033-4f85-befe-8972b62bb8ae tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:42.347325 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce1c51dc-0033-4f85-befe-8972b62bb8ae tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:42.366386 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-ce1c51dc-0033-4f85-befe-8972b62bb8ae tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] HTTP exception thrown: Instance a1c09528-36b8-4b0d-b03c-2d3351649579 could not be found. Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ce1c51dc-0033-4f85-befe-8972b62bb8ae tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Request method failure captured: Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579 HTTP/1.1 Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xLZuMLvQ88KTsXpEnT0I-tjdBFOm7EEtVmBSoi3hGbagLa-WCqW3nJreDc3WwTe1tbLbMC3xnpg15asRoKTlUvK3aMhcihww2F0hywjkHPX3fkbbtMYbGiIT_pGesW2tpqp2g11Pwb-WDA3oTL-VeLkmCHA0u8DPW_SmhTlX9-nF08 Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersTestJSON-576619186 Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_efad066360cb45b3a6e9ba872118ea57", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersTestJSON-576619186 Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersTestJSON-576619186 Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersTestJSON-576619186-project Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d4f7282c7251455086368d5274a4fac5 Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersTestJSON-576619186-project Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: exception: Instance a1c09528-36b8-4b0d-b03c-2d3351649579 could not be found. Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'a1c09528-36b8-4b0d-b03c-2d3351649579'} Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1c09528-36b8-4b0d-b03c-2d3351649579 could not be found. Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1c09528-36b8-4b0d-b03c-2d3351649579 could not be found. Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.368111 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:42.372951 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:42.372951 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:42.372951 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:22:42.372951 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:22:42.372951 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1c09528-36b8-4b0d-b03c-2d3351649579 could not be found. Aug 07 01:22:42.372951 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.372951 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ce1c51dc-0033-4f85-befe-8972b62bb8ae tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Returning 404 to user: Instance a1c09528-36b8-4b0d-b03c-2d3351649579 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:22:42.372951 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ce1c51dc-0033-4f85-befe-8972b62bb8ae tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579" status: 404 len: 111 microversion: 2.1 time: 0.062893 Aug 07 01:22:42.372951 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1219/2681] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:42 2022] GET /compute/v2.1/servers/a1c09528-36b8-4b0d-b03c-2d3351649579 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:22:42.380024 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-766f62b7-b49b-4a33-930e-aeb6b2b67003 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:42.381005 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-766f62b7-b49b-4a33-930e-aeb6b2b67003 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 937ef9c3-acf0-4874-846f-fde53d884d0a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:42.399600 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-766f62b7-b49b-4a33-930e-aeb6b2b67003 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:42.400778 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-766f62b7-b49b-4a33-930e-aeb6b2b67003 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:42.403771 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-766f62b7-b49b-4a33-930e-aeb6b2b67003 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:42.405157 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-766f62b7-b49b-4a33-930e-aeb6b2b67003 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:42.412615 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-766f62b7-b49b-4a33-930e-aeb6b2b67003 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:42.413253 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-766f62b7-b49b-4a33-930e-aeb6b2b67003 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:42.442415 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-766f62b7-b49b-4a33-930e-aeb6b2b67003 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] HTTP exception thrown: Instance 937ef9c3-acf0-4874-846f-fde53d884d0a could not be found. Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-766f62b7-b49b-4a33-930e-aeb6b2b67003 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Request method failure captured: Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a HTTP/1.1 Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xLZuMLvQ88KTsXpEnT0I-tjdBFOm7EEtVmBSoi3hGbagLa-WCqW3nJreDc3WwTe1tbLbMC3xnpg15asRoKTlUvK3aMhcihww2F0hywjkHPX3fkbbtMYbGiIT_pGesW2tpqp2g11Pwb-WDA3oTL-VeLkmCHA0u8DPW_SmhTlX9-nF08 Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersTestJSON-576619186 Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_efad066360cb45b3a6e9ba872118ea57", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersTestJSON-576619186 Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersTestJSON-576619186 Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersTestJSON-576619186-project Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d4f7282c7251455086368d5274a4fac5 Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersTestJSON-576619186-project Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 937ef9c3-acf0-4874-846f-fde53d884d0a could not be found. Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '937ef9c3-acf0-4874-846f-fde53d884d0a'} Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 937ef9c3-acf0-4874-846f-fde53d884d0a could not be found. Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:22:42.447983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 937ef9c3-acf0-4874-846f-fde53d884d0a could not be found. Aug 07 01:22:42.456670 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.456670 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:42.456670 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.456670 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:42.456670 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:42.456670 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:42.456670 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:22:42.456670 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:22:42.456670 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 937ef9c3-acf0-4874-846f-fde53d884d0a could not be found. Aug 07 01:22:42.456670 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.456670 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-766f62b7-b49b-4a33-930e-aeb6b2b67003 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Returning 404 to user: Instance 937ef9c3-acf0-4874-846f-fde53d884d0a could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:22:42.456670 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-766f62b7-b49b-4a33-930e-aeb6b2b67003 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "DELETE /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a" status: 404 len: 111 microversion: 2.1 time: 0.073819 Aug 07 01:22:42.456670 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1220/2682] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:22:42 2022] DELETE /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:22:42.469715 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-61c5c209-86b3-4197-9b2a-f429d128781f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:42.470439 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-61c5c209-86b3-4197-9b2a-f429d128781f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 937ef9c3-acf0-4874-846f-fde53d884d0a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: DEBUG neutronclient.v2_0.client [None req-0c3808e6-aa4d-4769-a903-99a970761c26 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e2280de3-252f-4dc1-b32c-99c902752847 does not exist", "detail": ""}} {{(pid=119516) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.security_group_api [None req-0c3808e6-aa4d-4769-a903-99a970761c26 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Neutron security group e2280de3-252f-4dc1-b32c-99c902752847 not found {{(pid=119516) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-0c3808e6-aa4d-4769-a903-99a970761c26 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] HTTP exception thrown: Security group e2280de3-252f-4dc1-b32c-99c902752847 does not exist Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: Neutron server returns request_ids: ['req-88a71724-0089-4f8b-abe8-ab38384b877c'] Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0c3808e6-aa4d-4769-a903-99a970761c26 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Request method failure captured: Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/os-security-groups/e2280de3-252f-4dc1-b32c-99c902752847 HTTP/1.1 Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xO08qP9itd1x7LkO549onPIQKYKrTn80RQpW5pCdeHaOqBQA0wDyajz8J-UALON-vNzJgXv0Ujib217Kc5O9bkWEANKCqcpJLGxO-2U8bRcRiaBsEe5TSczuDlBj3IZDQsdnYyQfIf9mOfj407D3QdxTi9cVsMgzz9HNwd9HVPDZu0 Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 791ad97e3c374d2d8494abc25b46a0bf Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_791ad97e3c374d2d8494abc25b46a0bf", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 791ad97e3c374d2d8494abc25b46a0bf Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-SecurityGroupsTestJSON-1082000213-project Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 51ab58be25a94cd6a59634e7c7cad158 Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-SecurityGroupsTestJSON-1082000213-project Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: exception: Security group e2280de3-252f-4dc1-b32c-99c902752847 does not exist Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: Neutron server returns request_ids: ['req-88a71724-0089-4f8b-abe8-ab38384b877c'] Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'e2280de3-252f-4dc1-b32c-99c902752847'} Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 07 01:22:42.478132 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e2280de3-252f-4dc1-b32c-99c902752847 does not exist Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88a71724-0089-4f8b-abe8-ab38384b877c'] Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e2280de3-252f-4dc1-b32c-99c902752847 does not exist Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88a71724-0089-4f8b-abe8-ab38384b877c'] Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e2280de3-252f-4dc1-b32c-99c902752847 does not exist Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88a71724-0089-4f8b-abe8-ab38384b877c'] Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e2280de3-252f-4dc1-b32c-99c902752847 does not exist Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88a71724-0089-4f8b-abe8-ab38384b877c'] Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0c3808e6-aa4d-4769-a903-99a970761c26 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Returning 404 to user: Security group e2280de3-252f-4dc1-b32c-99c902752847 does not exist Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: Neutron server returns request_ids: ['req-88a71724-0089-4f8b-abe8-ab38384b877c'] {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0c3808e6-aa4d-4769-a903-99a970761c26 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups/e2280de3-252f-4dc1-b32c-99c902752847" status: 404 len: 194 microversion: 2.1 time: 0.343191 Aug 07 01:22:42.488192 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1463/2683] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Aug 7 01:22:42 2022] GET /compute/v2.1/os-security-groups/e2280de3-252f-4dc1-b32c-99c902752847 => generated 194 bytes in 344 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:22:42.502723 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-61c5c209-86b3-4197-9b2a-f429d128781f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:42.502723 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-61c5c209-86b3-4197-9b2a-f429d128781f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:42.502723 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-61c5c209-86b3-4197-9b2a-f429d128781f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:42.502723 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-61c5c209-86b3-4197-9b2a-f429d128781f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:42.502723 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-61c5c209-86b3-4197-9b2a-f429d128781f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:42.502723 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-61c5c209-86b3-4197-9b2a-f429d128781f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:42.504201 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6a7ec775-c8ab-46c6-b94d-ae1c04bf9906 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Action: 'create', calling method: .version_select at 0x7f9e179460d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1728838094", "description": "tempest-description-550202228"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:42.504462 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:42.513367 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-61c5c209-86b3-4197-9b2a-f429d128781f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] HTTP exception thrown: Instance 937ef9c3-acf0-4874-846f-fde53d884d0a could not be found. Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-61c5c209-86b3-4197-9b2a-f429d128781f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Request method failure captured: Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a HTTP/1.1 Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xLZuMLvQ88KTsXpEnT0I-tjdBFOm7EEtVmBSoi3hGbagLa-WCqW3nJreDc3WwTe1tbLbMC3xnpg15asRoKTlUvK3aMhcihww2F0hywjkHPX3fkbbtMYbGiIT_pGesW2tpqp2g11Pwb-WDA3oTL-VeLkmCHA0u8DPW_SmhTlX9-nF08 Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersTestJSON-576619186 Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_efad066360cb45b3a6e9ba872118ea57", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersTestJSON-576619186 Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersTestJSON-576619186 Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersTestJSON-576619186-project Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d4f7282c7251455086368d5274a4fac5 Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersTestJSON-576619186-project Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 937ef9c3-acf0-4874-846f-fde53d884d0a could not be found. Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '937ef9c3-acf0-4874-846f-fde53d884d0a'} Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 937ef9c3-acf0-4874-846f-fde53d884d0a could not be found. Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 937ef9c3-acf0-4874-846f-fde53d884d0a could not be found. Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.515083 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:42.525347 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:42.525347 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:42.525347 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:22:42.525347 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:22:42.525347 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 937ef9c3-acf0-4874-846f-fde53d884d0a could not be found. Aug 07 01:22:42.525347 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.525347 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-61c5c209-86b3-4197-9b2a-f429d128781f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Returning 404 to user: Instance 937ef9c3-acf0-4874-846f-fde53d884d0a could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:22:42.525347 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-61c5c209-86b3-4197-9b2a-f429d128781f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a" status: 404 len: 111 microversion: 2.1 time: 0.058535 Aug 07 01:22:42.525347 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1221/2684] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:42 2022] GET /compute/v2.1/servers/937ef9c3-acf0-4874-846f-fde53d884d0a => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:22:42.526523 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-49518172-6b47-4f3c-a81a-813ceaeeb108 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:42.526523 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-49518172-6b47-4f3c-a81a-813ceaeeb108 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:42.546836 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49518172-6b47-4f3c-a81a-813ceaeeb108 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:42.547329 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49518172-6b47-4f3c-a81a-813ceaeeb108 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:42.547764 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49518172-6b47-4f3c-a81a-813ceaeeb108 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:42.548628 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49518172-6b47-4f3c-a81a-813ceaeeb108 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:42.549136 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49518172-6b47-4f3c-a81a-813ceaeeb108 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:42.551147 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49518172-6b47-4f3c-a81a-813ceaeeb108 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:42.566367 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-49518172-6b47-4f3c-a81a-813ceaeeb108 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] HTTP exception thrown: Instance 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 could not be found. Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-49518172-6b47-4f3c-a81a-813ceaeeb108 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Request method failure captured: Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 HTTP/1.1 Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xLZuMLvQ88KTsXpEnT0I-tjdBFOm7EEtVmBSoi3hGbagLa-WCqW3nJreDc3WwTe1tbLbMC3xnpg15asRoKTlUvK3aMhcihww2F0hywjkHPX3fkbbtMYbGiIT_pGesW2tpqp2g11Pwb-WDA3oTL-VeLkmCHA0u8DPW_SmhTlX9-nF08 Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersTestJSON-576619186 Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_efad066360cb45b3a6e9ba872118ea57", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersTestJSON-576619186 Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersTestJSON-576619186 Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersTestJSON-576619186-project Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d4f7282c7251455086368d5274a4fac5 Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersTestJSON-576619186-project Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 could not be found. Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6'} Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 could not be found. Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:22:42.568153 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 could not be found. Aug 07 01:22:42.571813 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.571813 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:42.571813 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.571813 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:42.571813 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:42.571813 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:42.571813 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:22:42.571813 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:22:42.571813 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 could not be found. Aug 07 01:22:42.571813 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.581942 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-49518172-6b47-4f3c-a81a-813ceaeeb108 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Returning 404 to user: Instance 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:22:42.587243 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-49518172-6b47-4f3c-a81a-813ceaeeb108 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6" status: 404 len: 111 microversion: 2.1 time: 0.065101 Aug 07 01:22:42.592996 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1222/2685] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:22:42 2022] DELETE /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:22:42.602718 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bd18582e-bce5-42bd-ac11-354b825810bf tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:42.603632 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bd18582e-bce5-42bd-ac11-354b825810bf tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:42.613555 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bd18582e-bce5-42bd-ac11-354b825810bf tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:42.614106 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bd18582e-bce5-42bd-ac11-354b825810bf tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:42.614610 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bd18582e-bce5-42bd-ac11-354b825810bf tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:42.615474 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bd18582e-bce5-42bd-ac11-354b825810bf tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:42.616106 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bd18582e-bce5-42bd-ac11-354b825810bf tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:42.616633 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bd18582e-bce5-42bd-ac11-354b825810bf tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:42.634586 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-bd18582e-bce5-42bd-ac11-354b825810bf tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] HTTP exception thrown: Instance 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 could not be found. Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bd18582e-bce5-42bd-ac11-354b825810bf tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Request method failure captured: Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 HTTP/1.1 Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xLZuMLvQ88KTsXpEnT0I-tjdBFOm7EEtVmBSoi3hGbagLa-WCqW3nJreDc3WwTe1tbLbMC3xnpg15asRoKTlUvK3aMhcihww2F0hywjkHPX3fkbbtMYbGiIT_pGesW2tpqp2g11Pwb-WDA3oTL-VeLkmCHA0u8DPW_SmhTlX9-nF08 Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersTestJSON-576619186 Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_efad066360cb45b3a6e9ba872118ea57", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersTestJSON-576619186 Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersTestJSON-576619186 Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersTestJSON-576619186-project Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d4f7282c7251455086368d5274a4fac5 Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersTestJSON-576619186-project Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 could not be found. Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6'} Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 could not be found. Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 could not be found. Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.636806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:42.641161 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:42.641161 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:42.641161 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:22:42.641161 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:22:42.641161 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 could not be found. Aug 07 01:22:42.641161 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.643008 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bd18582e-bce5-42bd-ac11-354b825810bf tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Returning 404 to user: Instance 8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:22:42.644157 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bd18582e-bce5-42bd-ac11-354b825810bf tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6" status: 404 len: 111 microversion: 2.1 time: 0.048440 Aug 07 01:22:42.645326 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1223/2686] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:42 2022] GET /compute/v2.1/servers/8945f5bd-5c9e-4fe7-9f7e-641b3d2040f6 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:22:42.675406 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9179f675-0a38-4d5a-9119-4a61c1478039 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:42.676062 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9179f675-0a38-4d5a-9119-4a61c1478039 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 545e5bdb-26c5-4585-90bd-a51dc9e956fe] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:42.685777 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9179f675-0a38-4d5a-9119-4a61c1478039 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:42.686276 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9179f675-0a38-4d5a-9119-4a61c1478039 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:42.687355 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9179f675-0a38-4d5a-9119-4a61c1478039 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:42.688135 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9179f675-0a38-4d5a-9119-4a61c1478039 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:42.688778 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9179f675-0a38-4d5a-9119-4a61c1478039 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:42.691209 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9179f675-0a38-4d5a-9119-4a61c1478039 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:42.708089 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-9179f675-0a38-4d5a-9119-4a61c1478039 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] HTTP exception thrown: Instance 545e5bdb-26c5-4585-90bd-a51dc9e956fe could not be found. Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9179f675-0a38-4d5a-9119-4a61c1478039 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Request method failure captured: Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe HTTP/1.1 Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xLZuMLvQ88KTsXpEnT0I-tjdBFOm7EEtVmBSoi3hGbagLa-WCqW3nJreDc3WwTe1tbLbMC3xnpg15asRoKTlUvK3aMhcihww2F0hywjkHPX3fkbbtMYbGiIT_pGesW2tpqp2g11Pwb-WDA3oTL-VeLkmCHA0u8DPW_SmhTlX9-nF08 Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersTestJSON-576619186 Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_efad066360cb45b3a6e9ba872118ea57", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersTestJSON-576619186 Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersTestJSON-576619186 Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersTestJSON-576619186-project Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d4f7282c7251455086368d5274a4fac5 Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersTestJSON-576619186-project Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 545e5bdb-26c5-4585-90bd-a51dc9e956fe could not be found. Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '545e5bdb-26c5-4585-90bd-a51dc9e956fe'} Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 545e5bdb-26c5-4585-90bd-a51dc9e956fe could not be found. Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:22:42.710982 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 545e5bdb-26c5-4585-90bd-a51dc9e956fe could not be found. Aug 07 01:22:42.715582 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.715582 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:42.715582 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.715582 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:42.715582 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:42.715582 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:42.715582 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:22:42.715582 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:22:42.715582 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 545e5bdb-26c5-4585-90bd-a51dc9e956fe could not be found. Aug 07 01:22:42.715582 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.715582 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9179f675-0a38-4d5a-9119-4a61c1478039 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Returning 404 to user: Instance 545e5bdb-26c5-4585-90bd-a51dc9e956fe could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:22:42.715582 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9179f675-0a38-4d5a-9119-4a61c1478039 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "DELETE /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe" status: 404 len: 111 microversion: 2.1 time: 0.044148 Aug 07 01:22:42.717816 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1224/2687] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:22:42 2022] DELETE /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:22:42.722916 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3d844230-df6f-44bd-b283-634def686e3b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:42.723550 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3d844230-df6f-44bd-b283-634def686e3b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 545e5bdb-26c5-4585-90bd-a51dc9e956fe] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:42.732001 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3d844230-df6f-44bd-b283-634def686e3b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:42.732391 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3d844230-df6f-44bd-b283-634def686e3b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:42.733035 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3d844230-df6f-44bd-b283-634def686e3b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:42.733949 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3d844230-df6f-44bd-b283-634def686e3b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:42.734473 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3d844230-df6f-44bd-b283-634def686e3b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:42.734971 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3d844230-df6f-44bd-b283-634def686e3b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:42.758257 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-3d844230-df6f-44bd-b283-634def686e3b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] HTTP exception thrown: Instance 545e5bdb-26c5-4585-90bd-a51dc9e956fe could not be found. Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3d844230-df6f-44bd-b283-634def686e3b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Request method failure captured: Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe HTTP/1.1 Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xLZuMLvQ88KTsXpEnT0I-tjdBFOm7EEtVmBSoi3hGbagLa-WCqW3nJreDc3WwTe1tbLbMC3xnpg15asRoKTlUvK3aMhcihww2F0hywjkHPX3fkbbtMYbGiIT_pGesW2tpqp2g11Pwb-WDA3oTL-VeLkmCHA0u8DPW_SmhTlX9-nF08 Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersTestJSON-576619186 Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_efad066360cb45b3a6e9ba872118ea57", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersTestJSON-576619186 Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersTestJSON-576619186 Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersTestJSON-576619186-project Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d4f7282c7251455086368d5274a4fac5 Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersTestJSON-576619186-project Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 545e5bdb-26c5-4585-90bd-a51dc9e956fe could not be found. Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '545e5bdb-26c5-4585-90bd-a51dc9e956fe'} Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 545e5bdb-26c5-4585-90bd-a51dc9e956fe could not be found. Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 545e5bdb-26c5-4585-90bd-a51dc9e956fe could not be found. Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.762732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:42.768334 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:42.768334 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:42.768334 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:22:42.768334 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:22:42.768334 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 545e5bdb-26c5-4585-90bd-a51dc9e956fe could not be found. Aug 07 01:22:42.768334 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.768334 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3d844230-df6f-44bd-b283-634def686e3b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Returning 404 to user: Instance 545e5bdb-26c5-4585-90bd-a51dc9e956fe could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:22:42.768334 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3d844230-df6f-44bd-b283-634def686e3b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe" status: 404 len: 111 microversion: 2.1 time: 0.045455 Aug 07 01:22:42.768334 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1225/2688] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:42 2022] GET /compute/v2.1/servers/545e5bdb-26c5-4585-90bd-a51dc9e956fe => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:22:42.778975 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7fc6b654-709d-43b3-a186-39d42fca615f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:42.779573 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7fc6b654-709d-43b3-a186-39d42fca615f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 3241ffaf-f507-4365-80ec-a922012cb751] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:42.794523 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7fc6b654-709d-43b3-a186-39d42fca615f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:42.794927 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7fc6b654-709d-43b3-a186-39d42fca615f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:42.796459 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7fc6b654-709d-43b3-a186-39d42fca615f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:42.798030 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7fc6b654-709d-43b3-a186-39d42fca615f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:42.798776 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7fc6b654-709d-43b3-a186-39d42fca615f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:42.799412 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7fc6b654-709d-43b3-a186-39d42fca615f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:42.823842 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-7fc6b654-709d-43b3-a186-39d42fca615f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] HTTP exception thrown: Instance 3241ffaf-f507-4365-80ec-a922012cb751 could not be found. Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7fc6b654-709d-43b3-a186-39d42fca615f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Request method failure captured: Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/3241ffaf-f507-4365-80ec-a922012cb751 HTTP/1.1 Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xLZuMLvQ88KTsXpEnT0I-tjdBFOm7EEtVmBSoi3hGbagLa-WCqW3nJreDc3WwTe1tbLbMC3xnpg15asRoKTlUvK3aMhcihww2F0hywjkHPX3fkbbtMYbGiIT_pGesW2tpqp2g11Pwb-WDA3oTL-VeLkmCHA0u8DPW_SmhTlX9-nF08 Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersTestJSON-576619186 Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_efad066360cb45b3a6e9ba872118ea57", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersTestJSON-576619186 Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersTestJSON-576619186 Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersTestJSON-576619186-project Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d4f7282c7251455086368d5274a4fac5 Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersTestJSON-576619186-project Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 3241ffaf-f507-4365-80ec-a922012cb751 could not be found. Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '3241ffaf-f507-4365-80ec-a922012cb751'} Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3241ffaf-f507-4365-80ec-a922012cb751 could not be found. Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:22:42.826234 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3241ffaf-f507-4365-80ec-a922012cb751 could not be found. Aug 07 01:22:42.830048 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.830048 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:42.830048 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.830048 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:42.830048 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:42.830048 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:42.830048 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:22:42.830048 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:22:42.830048 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3241ffaf-f507-4365-80ec-a922012cb751 could not be found. Aug 07 01:22:42.830048 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.832274 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7fc6b654-709d-43b3-a186-39d42fca615f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Returning 404 to user: Instance 3241ffaf-f507-4365-80ec-a922012cb751 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:22:42.833424 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7fc6b654-709d-43b3-a186-39d42fca615f tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3241ffaf-f507-4365-80ec-a922012cb751" status: 404 len: 111 microversion: 2.1 time: 0.059847 Aug 07 01:22:42.834234 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1226/2689] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:22:42 2022] DELETE /compute/v2.1/servers/3241ffaf-f507-4365-80ec-a922012cb751 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:22:42.843677 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b2abdf47-a155-4bf1-aaa9-257c4c5c451b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:42.844728 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b2abdf47-a155-4bf1-aaa9-257c4c5c451b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 3241ffaf-f507-4365-80ec-a922012cb751] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:42.856818 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2abdf47-a155-4bf1-aaa9-257c4c5c451b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:42.858052 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2abdf47-a155-4bf1-aaa9-257c4c5c451b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:42.858498 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2abdf47-a155-4bf1-aaa9-257c4c5c451b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:42.859218 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2abdf47-a155-4bf1-aaa9-257c4c5c451b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:42.859789 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2abdf47-a155-4bf1-aaa9-257c4c5c451b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:42.860285 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2abdf47-a155-4bf1-aaa9-257c4c5c451b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:42.880783 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-b2abdf47-a155-4bf1-aaa9-257c4c5c451b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] HTTP exception thrown: Instance 3241ffaf-f507-4365-80ec-a922012cb751 could not be found. Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b2abdf47-a155-4bf1-aaa9-257c4c5c451b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Request method failure captured: Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/3241ffaf-f507-4365-80ec-a922012cb751 HTTP/1.1 Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xLZuMLvQ88KTsXpEnT0I-tjdBFOm7EEtVmBSoi3hGbagLa-WCqW3nJreDc3WwTe1tbLbMC3xnpg15asRoKTlUvK3aMhcihww2F0hywjkHPX3fkbbtMYbGiIT_pGesW2tpqp2g11Pwb-WDA3oTL-VeLkmCHA0u8DPW_SmhTlX9-nF08 Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersTestJSON-576619186 Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_efad066360cb45b3a6e9ba872118ea57", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersTestJSON-576619186 Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersTestJSON-576619186 Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersTestJSON-576619186-project Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d4f7282c7251455086368d5274a4fac5 Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersTestJSON-576619186-project Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 3241ffaf-f507-4365-80ec-a922012cb751 could not be found. Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '3241ffaf-f507-4365-80ec-a922012cb751'} Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3241ffaf-f507-4365-80ec-a922012cb751 could not be found. Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3241ffaf-f507-4365-80ec-a922012cb751 could not be found. Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.882993 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:42.887522 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:42.887522 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:42.887522 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:22:42.887522 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:22:42.887522 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3241ffaf-f507-4365-80ec-a922012cb751 could not be found. Aug 07 01:22:42.887522 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:42.889742 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b2abdf47-a155-4bf1-aaa9-257c4c5c451b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Returning 404 to user: Instance 3241ffaf-f507-4365-80ec-a922012cb751 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:22:42.891133 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b2abdf47-a155-4bf1-aaa9-257c4c5c451b tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/3241ffaf-f507-4365-80ec-a922012cb751" status: 404 len: 111 microversion: 2.1 time: 0.052856 Aug 07 01:22:42.892363 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1227/2690] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:42 2022] GET /compute/v2.1/servers/3241ffaf-f507-4365-80ec-a922012cb751 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:22:42.904437 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2f2e7cfc-f74c-43c1-adf9-c98a4d107313 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:42.905257 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2f2e7cfc-f74c-43c1-adf9-c98a4d107313 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 27c77ddb-09a6-49e0-bdca-0e6c23c18c56] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:42.912893 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f2e7cfc-f74c-43c1-adf9-c98a4d107313 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:42.913700 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f2e7cfc-f74c-43c1-adf9-c98a4d107313 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:42.914160 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f2e7cfc-f74c-43c1-adf9-c98a4d107313 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:42.914875 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f2e7cfc-f74c-43c1-adf9-c98a4d107313 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:42.915560 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f2e7cfc-f74c-43c1-adf9-c98a4d107313 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:42.916111 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f2e7cfc-f74c-43c1-adf9-c98a4d107313 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:42.979401 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2f2e7cfc-f74c-43c1-adf9-c98a4d107313 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 27c77ddb-09a6-49e0-bdca-0e6c23c18c56] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:22:43.090709 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2f2e7cfc-f74c-43c1-adf9-c98a4d107313 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "DELETE /compute/v2.1/servers/27c77ddb-09a6-49e0-bdca-0e6c23c18c56" status: 204 len: 0 microversion: 2.1 time: 0.193791 Aug 07 01:22:43.091809 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1228/2691] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:22:42 2022] DELETE /compute/v2.1/servers/27c77ddb-09a6-49e0-bdca-0e6c23c18c56 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:22:43.101120 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8a480bdb-5e69-4714-8c19-cf23dc4d9eaa tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:43.102222 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8a480bdb-5e69-4714-8c19-cf23dc4d9eaa tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 27c77ddb-09a6-49e0-bdca-0e6c23c18c56] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:43.110224 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a480bdb-5e69-4714-8c19-cf23dc4d9eaa tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:43.111110 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a480bdb-5e69-4714-8c19-cf23dc4d9eaa tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:43.112031 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a480bdb-5e69-4714-8c19-cf23dc4d9eaa tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:43.113022 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a480bdb-5e69-4714-8c19-cf23dc4d9eaa tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:43.115448 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a480bdb-5e69-4714-8c19-cf23dc4d9eaa tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:43.116208 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a480bdb-5e69-4714-8c19-cf23dc4d9eaa tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:43.303422 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6a7ec775-c8ab-46c6-b94d-ae1c04bf9906 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.812024 Aug 07 01:22:43.304414 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1464/2692] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Aug 7 01:22:42 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:22:43.310501 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4eca419c-a8ec-415e-96d9-cd27ffae5f78 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:43.311128 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4eca419c-a8ec-415e-96d9-cd27ffae5f78 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 72538b92-6b72-4a50-96da-74b7d88bcd3c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:43.334033 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4eca419c-a8ec-415e-96d9-cd27ffae5f78 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:43.334532 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4eca419c-a8ec-415e-96d9-cd27ffae5f78 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:43.334979 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4eca419c-a8ec-415e-96d9-cd27ffae5f78 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:43.335715 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4eca419c-a8ec-415e-96d9-cd27ffae5f78 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:43.336186 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4eca419c-a8ec-415e-96d9-cd27ffae5f78 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:43.340583 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4eca419c-a8ec-415e-96d9-cd27ffae5f78 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:43.365778 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8a480bdb-5e69-4714-8c19-cf23dc4d9eaa tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:43.375351 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8a480bdb-5e69-4714-8c19-cf23dc4d9eaa tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/27c77ddb-09a6-49e0-bdca-0e6c23c18c56" status: 200 len: 1479 microversion: 2.1 time: 0.279296 Aug 07 01:22:43.401649 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1229/2693] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:43 2022] GET /compute/v2.1/servers/27c77ddb-09a6-49e0-bdca-0e6c23c18c56 => generated 1479 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:22:43.407970 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4eca419c-a8ec-415e-96d9-cd27ffae5f78 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:43.407970 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4eca419c-a8ec-415e-96d9-cd27ffae5f78 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:43.414139 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6edd89e7-d549-49e2-ab69-9ce0ba370e1e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:43.417397 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6edd89e7-d549-49e2-ab69-9ce0ba370e1e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:43.425928 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6edd89e7-d549-49e2-ab69-9ce0ba370e1e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:43.427427 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6edd89e7-d549-49e2-ab69-9ce0ba370e1e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:43.428565 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6edd89e7-d549-49e2-ab69-9ce0ba370e1e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:43.428887 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4eca419c-a8ec-415e-96d9-cd27ffae5f78 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:43.429933 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6edd89e7-d549-49e2-ab69-9ce0ba370e1e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:43.430636 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6edd89e7-d549-49e2-ab69-9ce0ba370e1e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:43.431454 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-4eca419c-a8ec-415e-96d9-cd27ffae5f78 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lazy-loading 'fault' on Instance uuid 72538b92-6b72-4a50-96da-74b7d88bcd3c {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:22:43.432297 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6edd89e7-d549-49e2-ab69-9ce0ba370e1e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:43.588336 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4eca419c-a8ec-415e-96d9-cd27ffae5f78 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:43.603918 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4eca419c-a8ec-415e-96d9-cd27ffae5f78 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c" status: 200 len: 1302 microversion: 2.1 time: 0.298104 Aug 07 01:22:43.604513 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1465/2694] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:43 2022] GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c => generated 1302 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:43.621816 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fda06da5-e167-49f2-aa59-d05fdf61e81c tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Action: 'create', calling method: .version_select at 0x7f9e17a62160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1046812894", "description": "tempest-description-1328701326"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:43.674598 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6edd89e7-d549-49e2-ab69-9ce0ba370e1e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:43.684730 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6edd89e7-d549-49e2-ab69-9ce0ba370e1e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:43.686280 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6edd89e7-d549-49e2-ab69-9ce0ba370e1e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:43.687433 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6edd89e7-d549-49e2-ab69-9ce0ba370e1e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1281 microversion: 2.25 time: 0.283894 Aug 07 01:22:43.692302 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1230/2695] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:22:43 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1281 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:22:43.732278 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7f14fe28-2278-4aad-b764-3425ffee9696 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1404788574", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "61c05cb2-dbbb-4d57-bb1b-576a5e5555f2"}], "security_groups": [{"name": "tempest-securitygroup--378950370"}], "key_name": "tempest-keypair-1563677030", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:43.894515 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-7f14fe28-2278-4aad-b764-3425ffee9696 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] validate_networks() for [('61c05cb2-dbbb-4d57-bb1b-576a5e5555f2', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:22:44.295781 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fda06da5-e167-49f2-aa59-d05fdf61e81c tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.686980 Aug 07 01:22:44.296735 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1466/2696] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Aug 7 01:22:43 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:44.309778 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a3a13bbe-9baf-456d-b828-3c1980cd3e84 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Action: 'create', calling method: .version_select at 0x7f9e179fa3a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-307804498", "description": "tempest-description-1829261469"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:44.538938 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-7f14fe28-2278-4aad-b764-3425ffee9696 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Getting quotas for project 6a5267b6a8e34a4397cd94fae11283be. Resources: dict_keys(['metadata_items']) {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:22:44.547660 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-7f14fe28-2278-4aad-b764-3425ffee9696 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Getting quotas for user 2185c595c9df4719bdca76d8797c76e3 and project 6a5267b6a8e34a4397cd94fae11283be. Resources: dict_keys(['metadata_items']) {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:22:44.568735 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-7f14fe28-2278-4aad-b764-3425ffee9696 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:22:44.569723 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-7f14fe28-2278-4aad-b764-3425ffee9696 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:22:44.570489 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-7f14fe28-2278-4aad-b764-3425ffee9696 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:22:44.571122 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-7f14fe28-2278-4aad-b764-3425ffee9696 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:22:44.571966 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-7f14fe28-2278-4aad-b764-3425ffee9696 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:22:44.588847 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7f14fe28-2278-4aad-b764-3425ffee9696 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:44.591237 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7f14fe28-2278-4aad-b764-3425ffee9696 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:44.592231 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7f14fe28-2278-4aad-b764-3425ffee9696 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:44.593555 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7f14fe28-2278-4aad-b764-3425ffee9696 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:44.594716 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7f14fe28-2278-4aad-b764-3425ffee9696 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:44.595859 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7f14fe28-2278-4aad-b764-3425ffee9696 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:44.637734 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-7f14fe28-2278-4aad-b764-3425ffee9696 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Getting quotas for project 6a5267b6a8e34a4397cd94fae11283be. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:22:44.646068 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-7f14fe28-2278-4aad-b764-3425ffee9696 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Getting quotas for user 2185c595c9df4719bdca76d8797c76e3 and project 6a5267b6a8e34a4397cd94fae11283be. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:22:44.685856 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7f14fe28-2278-4aad-b764-3425ffee9696 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:22:44.691614 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7f14fe28-2278-4aad-b764-3425ffee9696 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] [instance: 8bbf0611-5a3b-4fec-a722-c07a08d09b26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:22:44.795033 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7f14fe28-2278-4aad-b764-3425ffee9696 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.066880 Aug 07 01:22:44.802656 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1231/2697] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:22:43 2022] POST /compute/v2.1/servers => generated 408 bytes in 1071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 07 01:22:44.813520 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-b3140301-22af-473c-ab49-52bd8a7cfcca req-0f5ea812-d8fc-4fa9-8c80-b605daf24ca7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72538b92-6b72-4a50-96da-74b7d88bcd3c", "name": "network-vif-deleted", "tag": "223569dd-ed36-4248-914c-669ed102ccf4"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:44.882862 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b3140301-22af-473c-ab49-52bd8a7cfcca req-0f5ea812-d8fc-4fa9-8c80-b605daf24ca7 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:44.884750 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b3140301-22af-473c-ab49-52bd8a7cfcca req-0f5ea812-d8fc-4fa9-8c80-b605daf24ca7 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:44.888542 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b3140301-22af-473c-ab49-52bd8a7cfcca req-0f5ea812-d8fc-4fa9-8c80-b605daf24ca7 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:44.902546 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a3a13bbe-9baf-456d-b828-3c1980cd3e84 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.597340 Aug 07 01:22:44.918460 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1467/2698] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Aug 7 01:22:44 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:22:44.949511 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-b3140301-22af-473c-ab49-52bd8a7cfcca req-0f5ea812-d8fc-4fa9-8c80-b605daf24ca7 service nova] Creating event network-vif-deleted:223569dd-ed36-4248-914c-669ed102ccf4 for instance 72538b92-6b72-4a50-96da-74b7d88bcd3c on n-h2-master-1 Aug 07 01:22:44.963294 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-b3140301-22af-473c-ab49-52bd8a7cfcca req-0f5ea812-d8fc-4fa9-8c80-b605daf24ca7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164680 Aug 07 01:22:44.965216 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1232/2699] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:44.971836 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a281e4a7-099a-4b55-8446-bfa115c8382c tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:44.973550 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a281e4a7-099a-4b55-8446-bfa115c8382c tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 72538b92-6b72-4a50-96da-74b7d88bcd3c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:44.979014 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-60ff1750-260b-49eb-8e4a-6692f66f31da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:44.996261 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a281e4a7-099a-4b55-8446-bfa115c8382c tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:44.997000 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-60ff1750-260b-49eb-8e4a-6692f66f31da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 27c77ddb-09a6-49e0-bdca-0e6c23c18c56] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:44.997364 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a281e4a7-099a-4b55-8446-bfa115c8382c tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:44.998055 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a281e4a7-099a-4b55-8446-bfa115c8382c tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:44.999005 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a281e4a7-099a-4b55-8446-bfa115c8382c tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:45.001558 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a281e4a7-099a-4b55-8446-bfa115c8382c tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:45.004376 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a281e4a7-099a-4b55-8446-bfa115c8382c tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:45.015035 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60ff1750-260b-49eb-8e4a-6692f66f31da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:45.016315 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60ff1750-260b-49eb-8e4a-6692f66f31da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:45.016962 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60ff1750-260b-49eb-8e4a-6692f66f31da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:45.019549 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60ff1750-260b-49eb-8e4a-6692f66f31da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:45.020290 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60ff1750-260b-49eb-8e4a-6692f66f31da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:45.021041 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60ff1750-260b-49eb-8e4a-6692f66f31da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:45.036871 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-a281e4a7-099a-4b55-8446-bfa115c8382c tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] HTTP exception thrown: Instance 72538b92-6b72-4a50-96da-74b7d88bcd3c could not be found. Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a281e4a7-099a-4b55-8446-bfa115c8382c tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Request method failure captured: Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c HTTP/1.1 Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xOmDixoOe5zESLEYDXA3axJNRP6bGIp2s8bsDueZmxkJOpZQpG1lySHsKEJwVaRwpeMoczbg3dNvWHOCd_gHZWNk1LiXQTx7fKsKxID1y_LZjG_VPVKnF0DLo2BFr_7w9sMgiCQLlafu9KThwRV0woNm4alGRtyWM2huHJZPVTWYRA Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 7e166fb219464337af5e274671580d80 Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersTestMultiNic-1944764525 Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7e166fb219464337af5e274671580d80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7e166fb219464337af5e274671580d80", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7e166fb219464337af5e274671580d80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7e166fb219464337af5e274671580d80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersTestMultiNic-1944764525 Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 7e166fb219464337af5e274671580d80 Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersTestMultiNic-1944764525 Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersTestMultiNic-1944764525-project Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d60a6557665a43cda4a64a83c92e2998 Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersTestMultiNic-1944764525-project Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 72538b92-6b72-4a50-96da-74b7d88bcd3c could not be found. Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '72538b92-6b72-4a50-96da-74b7d88bcd3c'} Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72538b92-6b72-4a50-96da-74b7d88bcd3c could not be found. Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72538b92-6b72-4a50-96da-74b7d88bcd3c could not be found. Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:45.045740 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:45.050035 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:45.050035 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:45.050035 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:45.050035 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:22:45.050035 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:22:45.050035 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72538b92-6b72-4a50-96da-74b7d88bcd3c could not be found. Aug 07 01:22:45.050035 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:45.050451 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a281e4a7-099a-4b55-8446-bfa115c8382c tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Returning 404 to user: Instance 72538b92-6b72-4a50-96da-74b7d88bcd3c could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:22:45.051749 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a281e4a7-099a-4b55-8446-bfa115c8382c tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c" status: 404 len: 111 microversion: 2.1 time: 0.084110 Aug 07 01:22:45.056385 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1233/2700] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:44 2022] GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:22:45.064917 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b23580a7-4e7e-4ebd-a0ec-7ee30700bcbe tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:45.065819 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b23580a7-4e7e-4ebd-a0ec-7ee30700bcbe tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:45.094992 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:45.100491 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b23580a7-4e7e-4ebd-a0ec-7ee30700bcbe tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:45.101084 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b23580a7-4e7e-4ebd-a0ec-7ee30700bcbe tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:45.101549 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b23580a7-4e7e-4ebd-a0ec-7ee30700bcbe tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:45.102348 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b23580a7-4e7e-4ebd-a0ec-7ee30700bcbe tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:45.102806 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b23580a7-4e7e-4ebd-a0ec-7ee30700bcbe tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:45.103235 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b23580a7-4e7e-4ebd-a0ec-7ee30700bcbe tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:45.589954 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b23580a7-4e7e-4ebd-a0ec-7ee30700bcbe tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:45.602628 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b23580a7-4e7e-4ebd-a0ec-7ee30700bcbe tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:45.607487 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b23580a7-4e7e-4ebd-a0ec-7ee30700bcbe tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:45.613063 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b23580a7-4e7e-4ebd-a0ec-7ee30700bcbe tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1281 microversion: 2.25 time: 0.554565 Aug 07 01:22:45.630021 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1234/2701] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:22:45 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1281 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:22:45.639854 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5457640c-d1e8-4abb-b760-1b85c088a86a tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:45.651150 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5457640c-d1e8-4abb-b760-1b85c088a86a tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] [instance: 8bbf0611-5a3b-4fec-a722-c07a08d09b26] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:45.797414 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5457640c-d1e8-4abb-b760-1b85c088a86a tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2185c595c9df4719bdca76d8797c76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5267b6a8e34a4397cd94fae11283be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:45.816844 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5457640c-d1e8-4abb-b760-1b85c088a86a tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] 10.222.0.39 "GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26" status: 200 len: 1278 microversion: 2.1 time: 0.181187 Aug 07 01:22:45.817623 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1235/2702] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:45 2022] GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26 => generated 1278 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:45.826819 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-67b69939-b787-4275-939a-9a186c56e145 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '.version_select at 0x7f9e242c8c10>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:46.251483 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-60ff1750-260b-49eb-8e4a-6692f66f31da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f7282c7251455086368d5274a4fac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efad066360cb45b3a6e9ba872118ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:46.274209 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-60ff1750-260b-49eb-8e4a-6692f66f31da tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/27c77ddb-09a6-49e0-bdca-0e6c23c18c56" status: 200 len: 1479 microversion: 2.1 time: 1.352264 Aug 07 01:22:46.279666 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1468/2703] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:44 2022] GET /compute/v2.1/servers/27c77ddb-09a6-49e0-bdca-0e6c23c18c56 => generated 1479 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:46.304946 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-2c42ce33-e829-445f-8e77-d2139caf9e14 req-ef84762d-14c6-4d62-9a0b-2472ec83ad75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "536a25a5-29bc-447e-9cf6-81b2db1ec700", "name": "network-vif-plugged", "status": "completed", "tag": "b4a97479-abbd-4e8a-b47c-ebf03a104d41"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:46.332072 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2c42ce33-e829-445f-8e77-d2139caf9e14 req-ef84762d-14c6-4d62-9a0b-2472ec83ad75 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:46.332944 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2c42ce33-e829-445f-8e77-d2139caf9e14 req-ef84762d-14c6-4d62-9a0b-2472ec83ad75 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:46.333543 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2c42ce33-e829-445f-8e77-d2139caf9e14 req-ef84762d-14c6-4d62-9a0b-2472ec83ad75 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:46.382365 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-2c42ce33-e829-445f-8e77-d2139caf9e14 req-ef84762d-14c6-4d62-9a0b-2472ec83ad75 service nova] Creating event network-vif-plugged:b4a97479-abbd-4e8a-b47c-ebf03a104d41 for instance 536a25a5-29bc-447e-9cf6-81b2db1ec700 on n-h2-master-1 Aug 07 01:22:46.415132 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-2c42ce33-e829-445f-8e77-d2139caf9e14 req-ef84762d-14c6-4d62-9a0b-2472ec83ad75 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120121 Aug 07 01:22:46.415860 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1469/2704] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:46.648160 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cd08e3f0-425e-45ee-8bb4-7102da25b5f5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:46.650967 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cd08e3f0-425e-45ee-8bb4-7102da25b5f5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:46.665355 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd08e3f0-425e-45ee-8bb4-7102da25b5f5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:46.666106 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd08e3f0-425e-45ee-8bb4-7102da25b5f5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:46.666760 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd08e3f0-425e-45ee-8bb4-7102da25b5f5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:46.667809 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd08e3f0-425e-45ee-8bb4-7102da25b5f5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:46.668444 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd08e3f0-425e-45ee-8bb4-7102da25b5f5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:46.669033 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd08e3f0-425e-45ee-8bb4-7102da25b5f5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:46.694318 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-67b69939-b787-4275-939a-9a186c56e145 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 0.874362 Aug 07 01:22:46.694974 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1236/2705] 10.222.0.39 () {58 vars in 1158 bytes} [Sun Aug 7 01:22:45 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:46.710367 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-073c5d9f-42cf-4223-85a0-9af74570f9d8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '.version_select at 0x7f9e17f829d0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:47.230316 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cd08e3f0-425e-45ee-8bb4-7102da25b5f5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:47.254874 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cd08e3f0-425e-45ee-8bb4-7102da25b5f5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:47.260314 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cd08e3f0-425e-45ee-8bb4-7102da25b5f5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:47.264906 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cd08e3f0-425e-45ee-8bb4-7102da25b5f5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1281 microversion: 2.25 time: 0.624424 Aug 07 01:22:47.266351 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1470/2706] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:22:46 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1281 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:22:47.275438 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-31443b2f-6f4d-4cd3-ac25-d182ea53628c tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:47.276292 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-31443b2f-6f4d-4cd3-ac25-d182ea53628c tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] [instance: 8bbf0611-5a3b-4fec-a722-c07a08d09b26] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:47.287940 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31443b2f-6f4d-4cd3-ac25-d182ea53628c tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:47.288645 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31443b2f-6f4d-4cd3-ac25-d182ea53628c tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:47.289249 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31443b2f-6f4d-4cd3-ac25-d182ea53628c tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:47.301990 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31443b2f-6f4d-4cd3-ac25-d182ea53628c tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:47.304478 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31443b2f-6f4d-4cd3-ac25-d182ea53628c tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:47.306066 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31443b2f-6f4d-4cd3-ac25-d182ea53628c tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:47.374029 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:47.545211 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-073c5d9f-42cf-4223-85a0-9af74570f9d8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/cf469416-e888-4dd0-b68f-0ed24cbe2419" status: 202 len: 0 microversion: 2.1 time: 0.840112 Aug 07 01:22:47.546736 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1237/2707] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:22:46 2022] DELETE /compute/v2.1/os-security-groups/cf469416-e888-4dd0-b68f-0ed24cbe2419 => generated 0 bytes in 842 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:22:47.553180 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-436997ba-a098-4940-b7b0-582b94d9f8a9 req-582fdba3-f79d-450d-84b3-7458673b7468 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27c77ddb-09a6-49e0-bdca-0e6c23c18c56", "name": "network-vif-deleted", "tag": "8f0059f1-599f-44c8-aaf3-9e744e8f6a33"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:47.563812 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-436997ba-a098-4940-b7b0-582b94d9f8a9 req-582fdba3-f79d-450d-84b3-7458673b7468 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:47.564698 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-436997ba-a098-4940-b7b0-582b94d9f8a9 req-582fdba3-f79d-450d-84b3-7458673b7468 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:47.565286 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-436997ba-a098-4940-b7b0-582b94d9f8a9 req-582fdba3-f79d-450d-84b3-7458673b7468 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:47.580674 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-436997ba-a098-4940-b7b0-582b94d9f8a9 req-582fdba3-f79d-450d-84b3-7458673b7468 service nova] Creating event network-vif-deleted:8f0059f1-599f-44c8-aaf3-9e744e8f6a33 for instance 27c77ddb-09a6-49e0-bdca-0e6c23c18c56 on n-h2-master-1 Aug 07 01:22:47.586642 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-436997ba-a098-4940-b7b0-582b94d9f8a9 req-582fdba3-f79d-450d-84b3-7458673b7468 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038367 Aug 07 01:22:47.587858 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1238/2708] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:47.595220 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6f4c3ad3-e15f-4cdb-90b5-078782751512 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:47.596587 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6f4c3ad3-e15f-4cdb-90b5-078782751512 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] [instance: 27c77ddb-09a6-49e0-bdca-0e6c23c18c56] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:47.597007 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-31443b2f-6f4d-4cd3-ac25-d182ea53628c tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2185c595c9df4719bdca76d8797c76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5267b6a8e34a4397cd94fae11283be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:47.614597 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-31443b2f-6f4d-4cd3-ac25-d182ea53628c tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] 10.222.0.39 "GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26" status: 200 len: 1336 microversion: 2.1 time: 0.346585 Aug 07 01:22:47.615348 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1471/2709] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:47 2022] GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26 => generated 1336 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:47.616267 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f4c3ad3-e15f-4cdb-90b5-078782751512 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:47.616836 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f4c3ad3-e15f-4cdb-90b5-078782751512 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:47.618502 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f4c3ad3-e15f-4cdb-90b5-078782751512 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:47.619265 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f4c3ad3-e15f-4cdb-90b5-078782751512 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:47.619732 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f4c3ad3-e15f-4cdb-90b5-078782751512 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:47.625817 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f4c3ad3-e15f-4cdb-90b5-078782751512 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:47.636059 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-27de3873-0345-402a-826e-f87160c28287 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '.version_select at 0x7f9e17993790>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:47.648995 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-6f4c3ad3-e15f-4cdb-90b5-078782751512 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] HTTP exception thrown: Instance 27c77ddb-09a6-49e0-bdca-0e6c23c18c56 could not be found. Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6f4c3ad3-e15f-4cdb-90b5-078782751512 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Request method failure captured: Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/27c77ddb-09a6-49e0-bdca-0e6c23c18c56 HTTP/1.1 Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xLZuMLvQ88KTsXpEnT0I-tjdBFOm7EEtVmBSoi3hGbagLa-WCqW3nJreDc3WwTe1tbLbMC3xnpg15asRoKTlUvK3aMhcihww2F0hywjkHPX3fkbbtMYbGiIT_pGesW2tpqp2g11Pwb-WDA3oTL-VeLkmCHA0u8DPW_SmhTlX9-nF08 Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersTestJSON-576619186 Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_efad066360cb45b3a6e9ba872118ea57", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/efad066360cb45b3a6e9ba872118ea57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersTestJSON-576619186 Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: efad066360cb45b3a6e9ba872118ea57 Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersTestJSON-576619186 Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersTestJSON-576619186-project Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d4f7282c7251455086368d5274a4fac5 Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersTestJSON-576619186-project Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 27c77ddb-09a6-49e0-bdca-0e6c23c18c56 could not be found. Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '27c77ddb-09a6-49e0-bdca-0e6c23c18c56'} Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27c77ddb-09a6-49e0-bdca-0e6c23c18c56 could not be found. Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27c77ddb-09a6-49e0-bdca-0e6c23c18c56 could not be found. Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:47.650734 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:47.655380 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:47.655380 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:47.655380 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:22:47.655380 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:22:47.655380 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27c77ddb-09a6-49e0-bdca-0e6c23c18c56 could not be found. Aug 07 01:22:47.655380 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:47.655380 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6f4c3ad3-e15f-4cdb-90b5-078782751512 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] Returning 404 to user: Instance 27c77ddb-09a6-49e0-bdca-0e6c23c18c56 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:22:47.655380 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6f4c3ad3-e15f-4cdb-90b5-078782751512 tempest-ServersTestJSON-576619186 tempest-ServersTestJSON-576619186-project] 10.222.0.39 "GET /compute/v2.1/servers/27c77ddb-09a6-49e0-bdca-0e6c23c18c56" status: 404 len: 111 microversion: 2.1 time: 0.063318 Aug 07 01:22:47.655380 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1239/2710] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:47 2022] GET /compute/v2.1/servers/27c77ddb-09a6-49e0-bdca-0e6c23c18c56 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:22:47.736789 n-d-master-1 devstack@n-api.service[119516]: DEBUG neutronclient.v2_0.client [None req-27de3873-0345-402a-826e-f87160c28287 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cf469416-e888-4dd0-b68f-0ed24cbe2419 does not exist", "detail": ""}} {{(pid=119516) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 07 01:22:47.737783 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.security_group_api [None req-27de3873-0345-402a-826e-f87160c28287 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Neutron security group cf469416-e888-4dd0-b68f-0ed24cbe2419 not found {{(pid=119516) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 07 01:22:47.738505 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-27de3873-0345-402a-826e-f87160c28287 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] HTTP exception thrown: Security group cf469416-e888-4dd0-b68f-0ed24cbe2419 does not exist Aug 07 01:22:47.738505 n-d-master-1 devstack@n-api.service[119516]: Neutron server returns request_ids: ['req-9a9257f2-cf40-41ba-b6af-29c82672d2f8'] Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-27de3873-0345-402a-826e-f87160c28287 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Request method failure captured: Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/os-security-groups/cf469416-e888-4dd0-b68f-0ed24cbe2419 HTTP/1.1 Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xO08qP9itd1x7LkO549onPIQKYKrTn80RQpW5pCdeHaOqBQA0wDyajz8J-UALON-vNzJgXv0Ujib217Kc5O9bkWEANKCqcpJLGxO-2U8bRcRiaBsEe5TSczuDlBj3IZDQsdnYyQfIf9mOfj407D3QdxTi9cVsMgzz9HNwd9HVPDZu0 Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 791ad97e3c374d2d8494abc25b46a0bf Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_791ad97e3c374d2d8494abc25b46a0bf", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 791ad97e3c374d2d8494abc25b46a0bf Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-SecurityGroupsTestJSON-1082000213-project Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 51ab58be25a94cd6a59634e7c7cad158 Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-SecurityGroupsTestJSON-1082000213-project Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: exception: Security group cf469416-e888-4dd0-b68f-0ed24cbe2419 does not exist Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: Neutron server returns request_ids: ['req-9a9257f2-cf40-41ba-b6af-29c82672d2f8'] Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'cf469416-e888-4dd0-b68f-0ed24cbe2419'} Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 07 01:22:47.740629 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cf469416-e888-4dd0-b68f-0ed24cbe2419 does not exist Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9a9257f2-cf40-41ba-b6af-29c82672d2f8'] Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cf469416-e888-4dd0-b68f-0ed24cbe2419 does not exist Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9a9257f2-cf40-41ba-b6af-29c82672d2f8'] Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cf469416-e888-4dd0-b68f-0ed24cbe2419 does not exist Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9a9257f2-cf40-41ba-b6af-29c82672d2f8'] Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cf469416-e888-4dd0-b68f-0ed24cbe2419 does not exist Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9a9257f2-cf40-41ba-b6af-29c82672d2f8'] Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-27de3873-0345-402a-826e-f87160c28287 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Returning 404 to user: Security group cf469416-e888-4dd0-b68f-0ed24cbe2419 does not exist Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: Neutron server returns request_ids: ['req-9a9257f2-cf40-41ba-b6af-29c82672d2f8'] {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-27de3873-0345-402a-826e-f87160c28287 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups/cf469416-e888-4dd0-b68f-0ed24cbe2419" status: 404 len: 194 microversion: 2.1 time: 0.112146 Aug 07 01:22:47.744955 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1472/2711] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Aug 7 01:22:47 2022] GET /compute/v2.1/os-security-groups/cf469416-e888-4dd0-b68f-0ed24cbe2419 => generated 194 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:22:47.753205 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bd6bbd11-1804-402b-b023-b9ed3dc6f949 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '.version_select at 0x7f9e24348d30>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:48.297205 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0894eab1-a5b6-4696-a2d2-bb9b41428af6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:48.298220 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0894eab1-a5b6-4696-a2d2-bb9b41428af6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:48.345825 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0894eab1-a5b6-4696-a2d2-bb9b41428af6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:48.348469 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0894eab1-a5b6-4696-a2d2-bb9b41428af6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:48.351325 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0894eab1-a5b6-4696-a2d2-bb9b41428af6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:48.353684 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0894eab1-a5b6-4696-a2d2-bb9b41428af6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:48.354516 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0894eab1-a5b6-4696-a2d2-bb9b41428af6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:48.355709 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0894eab1-a5b6-4696-a2d2-bb9b41428af6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:48.472970 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bd6bbd11-1804-402b-b023-b9ed3dc6f949 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/6b002198-bc5a-48e8-8fdf-7757d2b91565" status: 202 len: 0 microversion: 2.1 time: 0.724972 Aug 07 01:22:48.474020 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1240/2712] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:22:47 2022] DELETE /compute/v2.1/os-security-groups/6b002198-bc5a-48e8-8fdf-7757d2b91565 => generated 0 bytes in 727 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:22:48.486725 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b604dba6-d07f-4ac3-9b96-0a4560be64c8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '.version_select at 0x7f9e243bd670>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:48.560190 n-d-master-1 devstack@n-api.service[119517]: DEBUG neutronclient.v2_0.client [None req-b604dba6-d07f-4ac3-9b96-0a4560be64c8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6b002198-bc5a-48e8-8fdf-7757d2b91565 does not exist", "detail": ""}} {{(pid=119517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.security_group_api [None req-b604dba6-d07f-4ac3-9b96-0a4560be64c8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Neutron security group 6b002198-bc5a-48e8-8fdf-7757d2b91565 not found {{(pid=119517) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-b604dba6-d07f-4ac3-9b96-0a4560be64c8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] HTTP exception thrown: Security group 6b002198-bc5a-48e8-8fdf-7757d2b91565 does not exist Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: Neutron server returns request_ids: ['req-909049ee-e103-47f9-87b3-73e6a6e4adbb'] Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b604dba6-d07f-4ac3-9b96-0a4560be64c8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Request method failure captured: Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/os-security-groups/6b002198-bc5a-48e8-8fdf-7757d2b91565 HTTP/1.1 Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xO08qP9itd1x7LkO549onPIQKYKrTn80RQpW5pCdeHaOqBQA0wDyajz8J-UALON-vNzJgXv0Ujib217Kc5O9bkWEANKCqcpJLGxO-2U8bRcRiaBsEe5TSczuDlBj3IZDQsdnYyQfIf9mOfj407D3QdxTi9cVsMgzz9HNwd9HVPDZu0 Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 791ad97e3c374d2d8494abc25b46a0bf Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_791ad97e3c374d2d8494abc25b46a0bf", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 791ad97e3c374d2d8494abc25b46a0bf Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-SecurityGroupsTestJSON-1082000213-project Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 51ab58be25a94cd6a59634e7c7cad158 Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-SecurityGroupsTestJSON-1082000213-project Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: exception: Security group 6b002198-bc5a-48e8-8fdf-7757d2b91565 does not exist Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: Neutron server returns request_ids: ['req-909049ee-e103-47f9-87b3-73e6a6e4adbb'] Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '6b002198-bc5a-48e8-8fdf-7757d2b91565'} Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 07 01:22:48.565539 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6b002198-bc5a-48e8-8fdf-7757d2b91565 does not exist Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-909049ee-e103-47f9-87b3-73e6a6e4adbb'] Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6b002198-bc5a-48e8-8fdf-7757d2b91565 does not exist Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-909049ee-e103-47f9-87b3-73e6a6e4adbb'] Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6b002198-bc5a-48e8-8fdf-7757d2b91565 does not exist Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-909049ee-e103-47f9-87b3-73e6a6e4adbb'] Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6b002198-bc5a-48e8-8fdf-7757d2b91565 does not exist Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-909049ee-e103-47f9-87b3-73e6a6e4adbb'] Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b604dba6-d07f-4ac3-9b96-0a4560be64c8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Returning 404 to user: Security group 6b002198-bc5a-48e8-8fdf-7757d2b91565 does not exist Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: Neutron server returns request_ids: ['req-909049ee-e103-47f9-87b3-73e6a6e4adbb'] {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b604dba6-d07f-4ac3-9b96-0a4560be64c8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups/6b002198-bc5a-48e8-8fdf-7757d2b91565" status: 404 len: 194 microversion: 2.1 time: 0.086245 Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1241/2713] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Aug 7 01:22:48 2022] GET /compute/v2.1/os-security-groups/6b002198-bc5a-48e8-8fdf-7757d2b91565 => generated 194 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:22:48.580227 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d9b38a29-bcb2-41b3-a6ef-b24c704b86d1 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '.version_select at 0x7f9e24348430>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:48.792861 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0894eab1-a5b6-4696-a2d2-bb9b41428af6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:48.801889 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0894eab1-a5b6-4696-a2d2-bb9b41428af6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:48.814478 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0894eab1-a5b6-4696-a2d2-bb9b41428af6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:48.816023 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0894eab1-a5b6-4696-a2d2-bb9b41428af6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1476 microversion: 2.25 time: 0.528467 Aug 07 01:22:48.816751 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1473/2714] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:22:48 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1476 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:22:48.821648 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-da608c2a-e58c-42e2-bb92-857b4c5de515 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:48.829964 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-da608c2a-e58c-42e2-bb92-857b4c5de515 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] [instance: 8bbf0611-5a3b-4fec-a722-c07a08d09b26] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:48.840156 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da608c2a-e58c-42e2-bb92-857b4c5de515 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:48.840973 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da608c2a-e58c-42e2-bb92-857b4c5de515 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:48.852217 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da608c2a-e58c-42e2-bb92-857b4c5de515 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:48.853402 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da608c2a-e58c-42e2-bb92-857b4c5de515 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:48.854042 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da608c2a-e58c-42e2-bb92-857b4c5de515 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:48.855231 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da608c2a-e58c-42e2-bb92-857b4c5de515 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:49.163817 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-da608c2a-e58c-42e2-bb92-857b4c5de515 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2185c595c9df4719bdca76d8797c76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5267b6a8e34a4397cd94fae11283be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:49.175125 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-da608c2a-e58c-42e2-bb92-857b4c5de515 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] 10.222.0.39 "GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26" status: 200 len: 1336 microversion: 2.1 time: 0.357152 Aug 07 01:22:49.181776 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1474/2715] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:48 2022] GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26 => generated 1336 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:49.317005 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d9b38a29-bcb2-41b3-a6ef-b24c704b86d1 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/928c5f3b-2ea6-4a4c-ad74-c872e6f4bcd1" status: 202 len: 0 microversion: 2.1 time: 0.746649 Aug 07 01:22:49.318172 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1242/2716] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:22:48 2022] DELETE /compute/v2.1/os-security-groups/928c5f3b-2ea6-4a4c-ad74-c872e6f4bcd1 => generated 0 bytes in 748 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 01:22:49.338784 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3448a36b-19a6-498d-815c-ac42f78b0a73 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '.version_select at 0x7f9e24caa820>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:49.409604 n-d-master-1 devstack@n-api.service[119517]: DEBUG neutronclient.v2_0.client [None req-3448a36b-19a6-498d-815c-ac42f78b0a73 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 928c5f3b-2ea6-4a4c-ad74-c872e6f4bcd1 does not exist", "detail": ""}} {{(pid=119517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 07 01:22:49.410210 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.security_group_api [None req-3448a36b-19a6-498d-815c-ac42f78b0a73 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Neutron security group 928c5f3b-2ea6-4a4c-ad74-c872e6f4bcd1 not found {{(pid=119517) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 07 01:22:49.410751 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-3448a36b-19a6-498d-815c-ac42f78b0a73 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] HTTP exception thrown: Security group 928c5f3b-2ea6-4a4c-ad74-c872e6f4bcd1 does not exist Aug 07 01:22:49.410751 n-d-master-1 devstack@n-api.service[119517]: Neutron server returns request_ids: ['req-fef6702a-7e6d-44d9-b901-9bda7d87215e'] Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3448a36b-19a6-498d-815c-ac42f78b0a73 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Request method failure captured: Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/os-security-groups/928c5f3b-2ea6-4a4c-ad74-c872e6f4bcd1 HTTP/1.1 Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xO08qP9itd1x7LkO549onPIQKYKrTn80RQpW5pCdeHaOqBQA0wDyajz8J-UALON-vNzJgXv0Ujib217Kc5O9bkWEANKCqcpJLGxO-2U8bRcRiaBsEe5TSczuDlBj3IZDQsdnYyQfIf9mOfj407D3QdxTi9cVsMgzz9HNwd9HVPDZu0 Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 791ad97e3c374d2d8494abc25b46a0bf Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_791ad97e3c374d2d8494abc25b46a0bf", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 791ad97e3c374d2d8494abc25b46a0bf Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-SecurityGroupsTestJSON-1082000213-project Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 51ab58be25a94cd6a59634e7c7cad158 Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-SecurityGroupsTestJSON-1082000213-project Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: exception: Security group 928c5f3b-2ea6-4a4c-ad74-c872e6f4bcd1 does not exist Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: Neutron server returns request_ids: ['req-fef6702a-7e6d-44d9-b901-9bda7d87215e'] Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '928c5f3b-2ea6-4a4c-ad74-c872e6f4bcd1'} Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 07 01:22:49.412785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 928c5f3b-2ea6-4a4c-ad74-c872e6f4bcd1 does not exist Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fef6702a-7e6d-44d9-b901-9bda7d87215e'] Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 928c5f3b-2ea6-4a4c-ad74-c872e6f4bcd1 does not exist Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fef6702a-7e6d-44d9-b901-9bda7d87215e'] Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 928c5f3b-2ea6-4a4c-ad74-c872e6f4bcd1 does not exist Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fef6702a-7e6d-44d9-b901-9bda7d87215e'] Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 928c5f3b-2ea6-4a4c-ad74-c872e6f4bcd1 does not exist Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fef6702a-7e6d-44d9-b901-9bda7d87215e'] Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3448a36b-19a6-498d-815c-ac42f78b0a73 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Returning 404 to user: Security group 928c5f3b-2ea6-4a4c-ad74-c872e6f4bcd1 does not exist Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: Neutron server returns request_ids: ['req-fef6702a-7e6d-44d9-b901-9bda7d87215e'] {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3448a36b-19a6-498d-815c-ac42f78b0a73 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups/928c5f3b-2ea6-4a4c-ad74-c872e6f4bcd1" status: 404 len: 194 microversion: 2.1 time: 0.089815 Aug 07 01:22:49.417439 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1243/2717] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Aug 7 01:22:49 2022] GET /compute/v2.1/os-security-groups/928c5f3b-2ea6-4a4c-ad74-c872e6f4bcd1 => generated 194 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:22:49.423978 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0e2cb89d-95c3-486a-877a-c602728dcede tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '.version_select at 0x7f9e248e9310>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:49.543198 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0a158b61-9030-488a-8e15-f9df2666dd34 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:49.544653 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0a158b61-9030-488a-8e15-f9df2666dd34 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:49.555858 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:49.558552 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a158b61-9030-488a-8e15-f9df2666dd34 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:49.561000 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a158b61-9030-488a-8e15-f9df2666dd34 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:49.564956 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a158b61-9030-488a-8e15-f9df2666dd34 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:49.566008 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a158b61-9030-488a-8e15-f9df2666dd34 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:49.566651 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a158b61-9030-488a-8e15-f9df2666dd34 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:49.567180 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a158b61-9030-488a-8e15-f9df2666dd34 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:50.793192 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-0a158b61-9030-488a-8e15-f9df2666dd34 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lazy-loading 'services' on Instance uuid 536a25a5-29bc-447e-9cf6-81b2db1ec700 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:22:50.819127 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0a158b61-9030-488a-8e15-f9df2666dd34 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1969 microversion: 2.25 time: 1.634727 Aug 07 01:22:50.820030 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1475/2718] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:22:49 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1969 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:22:50.832391 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8e49cf63-901d-43eb-9944-9429c7c44eb7 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:50.838990 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8e49cf63-901d-43eb-9944-9429c7c44eb7 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] [instance: 8bbf0611-5a3b-4fec-a722-c07a08d09b26] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:50.859643 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8e49cf63-901d-43eb-9944-9429c7c44eb7 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:50.860539 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8e49cf63-901d-43eb-9944-9429c7c44eb7 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:50.861184 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8e49cf63-901d-43eb-9944-9429c7c44eb7 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:50.862133 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8e49cf63-901d-43eb-9944-9429c7c44eb7 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:50.862803 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8e49cf63-901d-43eb-9944-9429c7c44eb7 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:50.863454 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8e49cf63-901d-43eb-9944-9429c7c44eb7 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:50.935021 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0e2cb89d-95c3-486a-877a-c602728dcede tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 1.514874 Aug 07 01:22:50.936802 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1244/2719] 10.222.0.39 () {58 vars in 1158 bytes} [Sun Aug 7 01:22:49 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:50.953960 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c2b29a33-3460-4fd0-ab68-3ca791c057fb tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:50.954595 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c2b29a33-3460-4fd0-ab68-3ca791c057fb tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:50.969043 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2b29a33-3460-4fd0-ab68-3ca791c057fb tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:50.977333 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2b29a33-3460-4fd0-ab68-3ca791c057fb tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:50.978071 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2b29a33-3460-4fd0-ab68-3ca791c057fb tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:50.983575 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2b29a33-3460-4fd0-ab68-3ca791c057fb tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:50.984043 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2b29a33-3460-4fd0-ab68-3ca791c057fb tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:50.984487 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2b29a33-3460-4fd0-ab68-3ca791c057fb tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:51.420157 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-c2b29a33-3460-4fd0-ab68-3ca791c057fb tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lazy-loading 'services' on Instance uuid 536a25a5-29bc-447e-9cf6-81b2db1ec700 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:22:51.437471 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c2b29a33-3460-4fd0-ab68-3ca791c057fb tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1969 microversion: 2.25 time: 0.498914 Aug 07 01:22:51.438841 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1245/2720] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:22:50 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1969 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:22:51.444051 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-996bc3ff-960e-4ff9-a31d-698e5d346401 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Action: 'create', calling method: .version_select at 0x7f9e17e39b80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-813402867", "description": "tempest-description-79494937"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:51.611085 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8e49cf63-901d-43eb-9944-9429c7c44eb7 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2185c595c9df4719bdca76d8797c76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5267b6a8e34a4397cd94fae11283be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:51.627456 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8e49cf63-901d-43eb-9944-9429c7c44eb7 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] 10.222.0.39 "GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26" status: 200 len: 1403 microversion: 2.1 time: 0.805565 Aug 07 01:22:51.629438 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1476/2721] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:50 2022] GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26 => generated 1403 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:51.640542 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5a40b869-46cc-4ae1-bbb0-f7ed318dd756 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:51.662682 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:22:51.662682 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:22:51.666103 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a40b869-46cc-4ae1-bbb0-f7ed318dd756 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:51.668775 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a40b869-46cc-4ae1-bbb0-f7ed318dd756 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:51.670256 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a40b869-46cc-4ae1-bbb0-f7ed318dd756 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:51.673020 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a40b869-46cc-4ae1-bbb0-f7ed318dd756 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:51.681407 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a40b869-46cc-4ae1-bbb0-f7ed318dd756 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:51.683169 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a40b869-46cc-4ae1-bbb0-f7ed318dd756 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:51.749239 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5a40b869-46cc-4ae1-bbb0-f7ed318dd756 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.117373 Aug 07 01:22:51.758506 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1477/2722] 10.222.0.39 () {60 vars in 1217 bytes} [Sun Aug 7 01:22:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:22:51.780489 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f85cf335-4dbe-4bfb-b469-2d36d018e280 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": "auto"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:51.784182 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f85cf335-4dbe-4bfb-b469-2d36d018e280 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:51.794896 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f85cf335-4dbe-4bfb-b469-2d36d018e280 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:51.797287 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f85cf335-4dbe-4bfb-b469-2d36d018e280 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:51.797961 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f85cf335-4dbe-4bfb-b469-2d36d018e280 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:51.799672 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f85cf335-4dbe-4bfb-b469-2d36d018e280 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:51.800665 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f85cf335-4dbe-4bfb-b469-2d36d018e280 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:51.801464 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f85cf335-4dbe-4bfb-b469-2d36d018e280 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:51.888796 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-f85cf335-4dbe-4bfb-b469-2d36d018e280 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lazy-loading 'flavor' on Instance uuid 536a25a5-29bc-447e-9cf6-81b2db1ec700 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:22:51.913537 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f85cf335-4dbe-4bfb-b469-2d36d018e280 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Going to try to live migrate instance to n-h1-master-1 {{(pid=119516) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 07 01:22:51.959363 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-996bc3ff-960e-4ff9-a31d-698e5d346401 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.518684 Aug 07 01:22:51.960242 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1246/2723] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Aug 7 01:22:51 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:52.011688 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cde525d1-fc21-4de1-9aeb-d51182fc5e17 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Action: 'create', calling method: .version_select at 0x7f9e17e3ba60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1264013529", "description": "tempest-description-872845880"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:52.632947 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cde525d1-fc21-4de1-9aeb-d51182fc5e17 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.630567 Aug 07 01:22:52.635412 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1247/2724] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Aug 7 01:22:51 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:52.651232 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-aa5faefd-42c4-4e83-8434-2f9692ee925b tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:52.652533 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-aa5faefd-42c4-4e83-8434-2f9692ee925b tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] [instance: 8bbf0611-5a3b-4fec-a722-c07a08d09b26] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:52.680817 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa5faefd-42c4-4e83-8434-2f9692ee925b tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:52.681315 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa5faefd-42c4-4e83-8434-2f9692ee925b tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:52.681759 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa5faefd-42c4-4e83-8434-2f9692ee925b tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:52.682504 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa5faefd-42c4-4e83-8434-2f9692ee925b tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:52.683027 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa5faefd-42c4-4e83-8434-2f9692ee925b tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:52.683470 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa5faefd-42c4-4e83-8434-2f9692ee925b tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:53.563096 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-aa5faefd-42c4-4e83-8434-2f9692ee925b tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2185c595c9df4719bdca76d8797c76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5267b6a8e34a4397cd94fae11283be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:53.575730 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-aa5faefd-42c4-4e83-8434-2f9692ee925b tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] 10.222.0.39 "GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26" status: 200 len: 1403 microversion: 2.1 time: 0.929000 Aug 07 01:22:53.583314 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1248/2725] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:52 2022] GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26 => generated 1403 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:53.600607 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-32dc1c2c-61fd-401d-9974-c6d99735dcda tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-167788303", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "9b5526ad-7601-46c0-aa73-d97eb424e744"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:53.732588 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-32dc1c2c-61fd-401d-9974-c6d99735dcda tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] validate_networks() for [('9b5526ad-7601-46c0-aa73-d97eb424e744', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:22:54.617471 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:54.632634 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-32dc1c2c-61fd-401d-9974-c6d99735dcda tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:22:54.634895 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-32dc1c2c-61fd-401d-9974-c6d99735dcda tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:22:54.657275 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-32dc1c2c-61fd-401d-9974-c6d99735dcda tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:22:54.661291 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-32dc1c2c-61fd-401d-9974-c6d99735dcda tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:22:54.662134 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-32dc1c2c-61fd-401d-9974-c6d99735dcda tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:22:54.712843 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-32dc1c2c-61fd-401d-9974-c6d99735dcda tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:54.716503 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-32dc1c2c-61fd-401d-9974-c6d99735dcda tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:54.718037 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-32dc1c2c-61fd-401d-9974-c6d99735dcda tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:54.720885 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-32dc1c2c-61fd-401d-9974-c6d99735dcda tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:54.722720 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-32dc1c2c-61fd-401d-9974-c6d99735dcda tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:54.724269 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-32dc1c2c-61fd-401d-9974-c6d99735dcda tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:54.771239 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-32dc1c2c-61fd-401d-9974-c6d99735dcda tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Getting quotas for project 791ad97e3c374d2d8494abc25b46a0bf. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:22:54.783277 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-32dc1c2c-61fd-401d-9974-c6d99735dcda tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Getting quotas for user 51ab58be25a94cd6a59634e7c7cad158 and project 791ad97e3c374d2d8494abc25b46a0bf. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:22:54.809736 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-32dc1c2c-61fd-401d-9974-c6d99735dcda tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:22:54.816672 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-32dc1c2c-61fd-401d-9974-c6d99735dcda tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 0b8441a7-9091-4b45-ac29-9023f2a6bc43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:22:54.915660 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-32dc1c2c-61fd-401d-9974-c6d99735dcda tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.328095 Aug 07 01:22:54.917306 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1249/2726] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:22:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1333 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:22:54.929289 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5ed7f047-ba3b-45e1-9253-13baeee57e39 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:54.930707 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5ed7f047-ba3b-45e1-9253-13baeee57e39 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] [instance: 8bbf0611-5a3b-4fec-a722-c07a08d09b26] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:54.943687 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5ed7f047-ba3b-45e1-9253-13baeee57e39 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:54.944425 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5ed7f047-ba3b-45e1-9253-13baeee57e39 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:54.945510 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5ed7f047-ba3b-45e1-9253-13baeee57e39 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:54.945692 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5ed7f047-ba3b-45e1-9253-13baeee57e39 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:54.946193 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5ed7f047-ba3b-45e1-9253-13baeee57e39 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:54.946627 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5ed7f047-ba3b-45e1-9253-13baeee57e39 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:55.190741 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5ed7f047-ba3b-45e1-9253-13baeee57e39 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2185c595c9df4719bdca76d8797c76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5267b6a8e34a4397cd94fae11283be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:55.207368 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5ed7f047-ba3b-45e1-9253-13baeee57e39 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] 10.222.0.39 "GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26" status: 200 len: 1403 microversion: 2.1 time: 0.288579 Aug 07 01:22:55.211373 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1250/2727] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:54 2022] GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26 => generated 1403 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:55.223478 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f420e1f9-0b77-40e3-bb65-48716d44f4a0 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1624250447", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "051b8b13-d0ff-471d-9d6e-1b9950169482"}, {"uuid": "e49b87cb-ace6-4f32-9a55-f13b064824d5"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:55.322156 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-f420e1f9-0b77-40e3-bb65-48716d44f4a0 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] validate_networks() for [('051b8b13-d0ff-471d-9d6e-1b9950169482', None, None, None, None, None), ('e49b87cb-ace6-4f32-9a55-f13b064824d5', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:22:56.756223 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-f420e1f9-0b77-40e3-bb65-48716d44f4a0 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:22:56.757638 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-f420e1f9-0b77-40e3-bb65-48716d44f4a0 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:22:56.759012 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-f420e1f9-0b77-40e3-bb65-48716d44f4a0 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:22:56.759628 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-f420e1f9-0b77-40e3-bb65-48716d44f4a0 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:22:56.762743 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-f420e1f9-0b77-40e3-bb65-48716d44f4a0 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:22:56.783818 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f420e1f9-0b77-40e3-bb65-48716d44f4a0 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:56.784615 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f420e1f9-0b77-40e3-bb65-48716d44f4a0 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:56.785109 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f420e1f9-0b77-40e3-bb65-48716d44f4a0 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:56.785889 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f420e1f9-0b77-40e3-bb65-48716d44f4a0 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:56.786361 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f420e1f9-0b77-40e3-bb65-48716d44f4a0 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:56.786800 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f420e1f9-0b77-40e3-bb65-48716d44f4a0 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:56.820858 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-f420e1f9-0b77-40e3-bb65-48716d44f4a0 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Getting quotas for project 7e166fb219464337af5e274671580d80. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:22:56.833373 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-f420e1f9-0b77-40e3-bb65-48716d44f4a0 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Getting quotas for user d60a6557665a43cda4a64a83c92e2998 and project 7e166fb219464337af5e274671580d80. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:22:56.872953 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f420e1f9-0b77-40e3-bb65-48716d44f4a0 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:22:56.886351 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f420e1f9-0b77-40e3-bb65-48716d44f4a0 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 51642c80-018a-4126-be66-97ced5cefece] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:22:57.011748 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f420e1f9-0b77-40e3-bb65-48716d44f4a0 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.796652 Aug 07 01:22:57.016432 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1251/2728] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:22:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:22:57.032373 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-69e60947-4ab2-483e-820d-801362eb311f tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:57.033416 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-69e60947-4ab2-483e-820d-801362eb311f tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 0b8441a7-9091-4b45-ac29-9023f2a6bc43] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:57.049825 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-69e60947-4ab2-483e-820d-801362eb311f tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:57.052128 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-69e60947-4ab2-483e-820d-801362eb311f tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:57.052802 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-69e60947-4ab2-483e-820d-801362eb311f tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:57.053751 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-69e60947-4ab2-483e-820d-801362eb311f tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:57.054374 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-69e60947-4ab2-483e-820d-801362eb311f tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:57.055065 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-69e60947-4ab2-483e-820d-801362eb311f tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:57.219849 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-69e60947-4ab2-483e-820d-801362eb311f tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab58be25a94cd6a59634e7c7cad158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791ad97e3c374d2d8494abc25b46a0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:57.251141 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-69e60947-4ab2-483e-820d-801362eb311f tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43" status: 200 len: 1285 microversion: 2.1 time: 0.232396 Aug 07 01:22:57.254118 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1252/2729] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:57 2022] GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43 => generated 1285 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:57.270765 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-602ddece-84a2-4333-a006-405073e71b2b tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:57.272126 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-602ddece-84a2-4333-a006-405073e71b2b tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] [instance: 8bbf0611-5a3b-4fec-a722-c07a08d09b26] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:57.300635 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-602ddece-84a2-4333-a006-405073e71b2b tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:57.301824 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-602ddece-84a2-4333-a006-405073e71b2b tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:57.302939 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-602ddece-84a2-4333-a006-405073e71b2b tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:57.304664 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-602ddece-84a2-4333-a006-405073e71b2b tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:57.305943 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-602ddece-84a2-4333-a006-405073e71b2b tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:57.306771 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-602ddece-84a2-4333-a006-405073e71b2b tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:57.589880 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f85cf335-4dbe-4bfb-b469-2d36d018e280 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700/action" status: 202 len: 0 microversion: 2.25 time: 5.825333 Aug 07 01:22:57.598497 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1478/2730] 10.222.0.39 () {62 vars in 1319 bytes} [Sun Aug 7 01:22:51 2022] POST /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700/action => generated 0 bytes in 5839 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:22:57.623566 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-69ce1a28-8161-454b-b21a-ce22f7d6198c req-df59575c-7b9a-4102-b792-db4b3adceff8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bbf0611-5a3b-4fec-a722-c07a08d09b26", "tag": "5c645525-cb30-401a-9b09-abfcb2929409"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:22:57.678850 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-69ce1a28-8161-454b-b21a-ce22f7d6198c req-df59575c-7b9a-4102-b792-db4b3adceff8 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:57.679636 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-69ce1a28-8161-454b-b21a-ce22f7d6198c req-df59575c-7b9a-4102-b792-db4b3adceff8 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:57.680734 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-69ce1a28-8161-454b-b21a-ce22f7d6198c req-df59575c-7b9a-4102-b792-db4b3adceff8 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:57.695874 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-69ce1a28-8161-454b-b21a-ce22f7d6198c req-df59575c-7b9a-4102-b792-db4b3adceff8 service nova] Creating event network-changed:5c645525-cb30-401a-9b09-abfcb2929409 for instance 8bbf0611-5a3b-4fec-a722-c07a08d09b26 on n-h1-master-1 Aug 07 01:22:57.704075 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-69ce1a28-8161-454b-b21a-ce22f7d6198c req-df59575c-7b9a-4102-b792-db4b3adceff8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103254 Aug 07 01:22:57.705371 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1479/2731] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:22:57.712088 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f277dbd2-e683-45ea-990c-0cee7f93f817 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:57.713279 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f277dbd2-e683-45ea-990c-0cee7f93f817 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 51642c80-018a-4126-be66-97ced5cefece] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:57.929948 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-602ddece-84a2-4333-a006-405073e71b2b tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2185c595c9df4719bdca76d8797c76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5267b6a8e34a4397cd94fae11283be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:57.950285 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-602ddece-84a2-4333-a006-405073e71b2b tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] 10.222.0.39 "GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26" status: 200 len: 1403 microversion: 2.1 time: 0.694171 Aug 07 01:22:57.965152 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1253/2732] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:57 2022] GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26 => generated 1403 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:57.972869 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-43116ec4-d2cc-477d-b9ca-6d6f3093c597 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:57.973966 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-43116ec4-d2cc-477d-b9ca-6d6f3093c597 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:57.989352 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-43116ec4-d2cc-477d-b9ca-6d6f3093c597 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:57.989994 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-43116ec4-d2cc-477d-b9ca-6d6f3093c597 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:57.990588 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-43116ec4-d2cc-477d-b9ca-6d6f3093c597 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:57.991225 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-43116ec4-d2cc-477d-b9ca-6d6f3093c597 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:57.991805 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-43116ec4-d2cc-477d-b9ca-6d6f3093c597 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:57.992248 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-43116ec4-d2cc-477d-b9ca-6d6f3093c597 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:58.334607 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f277dbd2-e683-45ea-990c-0cee7f93f817 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:58.371460 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f277dbd2-e683-45ea-990c-0cee7f93f817 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece" status: 200 len: 1213 microversion: 2.1 time: 0.664493 Aug 07 01:22:58.375864 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1480/2733] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:57 2022] GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece => generated 1213 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:58.391741 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3a546618-4297-454d-9579-a4a9e7c90286 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:58.392951 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3a546618-4297-454d-9579-a4a9e7c90286 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 0b8441a7-9091-4b45-ac29-9023f2a6bc43] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:58.411114 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a546618-4297-454d-9579-a4a9e7c90286 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:58.414321 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a546618-4297-454d-9579-a4a9e7c90286 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:58.416291 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a546618-4297-454d-9579-a4a9e7c90286 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:58.420021 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a546618-4297-454d-9579-a4a9e7c90286 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:58.424710 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a546618-4297-454d-9579-a4a9e7c90286 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:58.425334 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a546618-4297-454d-9579-a4a9e7c90286 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:59.111468 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-43116ec4-d2cc-477d-b9ca-6d6f3093c597 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:59.160552 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-43116ec4-d2cc-477d-b9ca-6d6f3093c597 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:59.177153 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-43116ec4-d2cc-477d-b9ca-6d6f3093c597 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:59.178812 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-43116ec4-d2cc-477d-b9ca-6d6f3093c597 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1486 microversion: 2.25 time: 1.212064 Aug 07 01:22:59.196317 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1254/2734] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:22:57 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1486 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:22:59.196317 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f964e896-cf48-4b21-ad3c-d466987e2250 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:59.196317 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f964e896-cf48-4b21-ad3c-d466987e2250 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] [instance: 8bbf0611-5a3b-4fec-a722-c07a08d09b26] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:59.199720 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f964e896-cf48-4b21-ad3c-d466987e2250 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:59.200378 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f964e896-cf48-4b21-ad3c-d466987e2250 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:59.200933 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f964e896-cf48-4b21-ad3c-d466987e2250 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:59.202578 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f964e896-cf48-4b21-ad3c-d466987e2250 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:59.203315 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f964e896-cf48-4b21-ad3c-d466987e2250 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:59.203966 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f964e896-cf48-4b21-ad3c-d466987e2250 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:59.222607 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:59.234437 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3a546618-4297-454d-9579-a4a9e7c90286 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab58be25a94cd6a59634e7c7cad158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791ad97e3c374d2d8494abc25b46a0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:59.251663 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3a546618-4297-454d-9579-a4a9e7c90286 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43" status: 200 len: 1273 microversion: 2.1 time: 0.869414 Aug 07 01:22:59.253461 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1481/2735] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:58 2022] GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43 => generated 1273 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:59.410973 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6c74201f-d661-44de-943e-045a0bcc58c5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:22:59.411625 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6c74201f-d661-44de-943e-045a0bcc58c5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 51642c80-018a-4126-be66-97ced5cefece] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:22:59.420402 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c74201f-d661-44de-943e-045a0bcc58c5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:59.421756 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c74201f-d661-44de-943e-045a0bcc58c5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:59.422908 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c74201f-d661-44de-943e-045a0bcc58c5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:59.424458 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c74201f-d661-44de-943e-045a0bcc58c5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:22:59.425376 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c74201f-d661-44de-943e-045a0bcc58c5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:22:59.426052 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c74201f-d661-44de-943e-045a0bcc58c5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:22:59.782223 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6c74201f-d661-44de-943e-045a0bcc58c5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:59.792653 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6c74201f-d661-44de-943e-045a0bcc58c5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece" status: 200 len: 1273 microversion: 2.1 time: 0.386082 Aug 07 01:22:59.798408 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1482/2736] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:59 2022] GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece => generated 1273 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:22:59.937536 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f964e896-cf48-4b21-ad3c-d466987e2250 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2185c595c9df4719bdca76d8797c76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5267b6a8e34a4397cd94fae11283be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:22:59.956699 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f964e896-cf48-4b21-ad3c-d466987e2250 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] 10.222.0.39 "GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26" status: 200 len: 1403 microversion: 2.1 time: 0.774234 Aug 07 01:22:59.957300 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1255/2737] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:22:59 2022] GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26 => generated 1403 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:00.209491 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d10fc613-b7f6-459d-9535-bcfb768c0c0c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:00.215178 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d10fc613-b7f6-459d-9535-bcfb768c0c0c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:00.241253 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d10fc613-b7f6-459d-9535-bcfb768c0c0c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:00.244457 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d10fc613-b7f6-459d-9535-bcfb768c0c0c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:00.245254 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d10fc613-b7f6-459d-9535-bcfb768c0c0c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:00.247964 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d10fc613-b7f6-459d-9535-bcfb768c0c0c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:00.257712 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d10fc613-b7f6-459d-9535-bcfb768c0c0c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:00.258584 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d10fc613-b7f6-459d-9535-bcfb768c0c0c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:00.279469 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6a217e3d-fb86-4a26-86e5-69af8aa83752 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:00.281040 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6a217e3d-fb86-4a26-86e5-69af8aa83752 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 0b8441a7-9091-4b45-ac29-9023f2a6bc43] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:00.302558 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a217e3d-fb86-4a26-86e5-69af8aa83752 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:00.309914 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a217e3d-fb86-4a26-86e5-69af8aa83752 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:00.310720 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a217e3d-fb86-4a26-86e5-69af8aa83752 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:00.314768 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a217e3d-fb86-4a26-86e5-69af8aa83752 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:00.320388 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a217e3d-fb86-4a26-86e5-69af8aa83752 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:00.321464 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a217e3d-fb86-4a26-86e5-69af8aa83752 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:01.085023 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d10fc613-b7f6-459d-9535-bcfb768c0c0c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:01.102794 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d10fc613-b7f6-459d-9535-bcfb768c0c0c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:01.104893 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d10fc613-b7f6-459d-9535-bcfb768c0c0c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:01.106115 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d10fc613-b7f6-459d-9535-bcfb768c0c0c tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1486 microversion: 2.25 time: 0.904526 Aug 07 01:23:01.120831 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1483/2738] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:00 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1486 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:23:01.126229 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-be48a6e1-4012-4dc5-a381-7bc39c6c73bb tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:01.126868 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-be48a6e1-4012-4dc5-a381-7bc39c6c73bb tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 51642c80-018a-4126-be66-97ced5cefece] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:01.147156 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-be48a6e1-4012-4dc5-a381-7bc39c6c73bb tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:01.148194 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-be48a6e1-4012-4dc5-a381-7bc39c6c73bb tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:01.148656 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-be48a6e1-4012-4dc5-a381-7bc39c6c73bb tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:01.149424 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-be48a6e1-4012-4dc5-a381-7bc39c6c73bb tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:01.149889 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-be48a6e1-4012-4dc5-a381-7bc39c6c73bb tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:01.150318 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-be48a6e1-4012-4dc5-a381-7bc39c6c73bb tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:01.334689 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-be48a6e1-4012-4dc5-a381-7bc39c6c73bb tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:01.352805 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-be48a6e1-4012-4dc5-a381-7bc39c6c73bb tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece" status: 200 len: 1271 microversion: 2.1 time: 0.230520 Aug 07 01:23:01.353630 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1484/2739] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:01 2022] GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece => generated 1271 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:01.358663 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a52d8330-2c54-4e29-9959-84e8fd0a51f6 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:01.361803 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a52d8330-2c54-4e29-9959-84e8fd0a51f6 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] [instance: 8bbf0611-5a3b-4fec-a722-c07a08d09b26] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:01.375574 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a52d8330-2c54-4e29-9959-84e8fd0a51f6 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:01.378663 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a52d8330-2c54-4e29-9959-84e8fd0a51f6 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:01.379381 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a52d8330-2c54-4e29-9959-84e8fd0a51f6 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:01.382650 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a52d8330-2c54-4e29-9959-84e8fd0a51f6 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:01.383497 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a52d8330-2c54-4e29-9959-84e8fd0a51f6 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:01.384132 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a52d8330-2c54-4e29-9959-84e8fd0a51f6 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:01.639118 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6a217e3d-fb86-4a26-86e5-69af8aa83752 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab58be25a94cd6a59634e7c7cad158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791ad97e3c374d2d8494abc25b46a0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:01.649155 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6a217e3d-fb86-4a26-86e5-69af8aa83752 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43" status: 200 len: 1315 microversion: 2.1 time: 1.374601 Aug 07 01:23:01.652712 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1256/2740] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:00 2022] GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43 => generated 1315 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:01.705947 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:02.063961 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a52d8330-2c54-4e29-9959-84e8fd0a51f6 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2185c595c9df4719bdca76d8797c76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5267b6a8e34a4397cd94fae11283be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:02.088436 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a52d8330-2c54-4e29-9959-84e8fd0a51f6 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] 10.222.0.39 "GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26" status: 200 len: 1403 microversion: 2.1 time: 0.731131 Aug 07 01:23:02.090366 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1485/2741] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:01 2022] GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26 => generated 1403 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:02.133173 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8f290c82-c978-4f3d-b9b6-1d655ddd2ac6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:02.134044 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8f290c82-c978-4f3d-b9b6-1d655ddd2ac6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:02.152786 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f290c82-c978-4f3d-b9b6-1d655ddd2ac6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:02.154119 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f290c82-c978-4f3d-b9b6-1d655ddd2ac6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:02.154834 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f290c82-c978-4f3d-b9b6-1d655ddd2ac6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:02.156257 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f290c82-c978-4f3d-b9b6-1d655ddd2ac6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:02.157279 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f290c82-c978-4f3d-b9b6-1d655ddd2ac6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:02.157899 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f290c82-c978-4f3d-b9b6-1d655ddd2ac6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:02.378962 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-45cb4316-184f-4afc-acc4-e7ee9d138c4e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:02.380310 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-45cb4316-184f-4afc-acc4-e7ee9d138c4e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 51642c80-018a-4126-be66-97ced5cefece] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:02.394689 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-45cb4316-184f-4afc-acc4-e7ee9d138c4e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:02.396452 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-45cb4316-184f-4afc-acc4-e7ee9d138c4e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:02.397119 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-45cb4316-184f-4afc-acc4-e7ee9d138c4e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:02.400588 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-45cb4316-184f-4afc-acc4-e7ee9d138c4e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:02.401571 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-45cb4316-184f-4afc-acc4-e7ee9d138c4e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:02.404314 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-45cb4316-184f-4afc-acc4-e7ee9d138c4e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:02.703165 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-45cb4316-184f-4afc-acc4-e7ee9d138c4e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:02.720261 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-45cb4316-184f-4afc-acc4-e7ee9d138c4e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece" status: 200 len: 1271 microversion: 2.1 time: 0.343016 Aug 07 01:23:02.734376 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1486/2742] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:02 2022] GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece => generated 1271 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:02.739581 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-03e2b2b0-f6ac-4c92-99ba-098c8cc10945 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:02.788185 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-03e2b2b0-f6ac-4c92-99ba-098c8cc10945 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 0b8441a7-9091-4b45-ac29-9023f2a6bc43] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:02.803377 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-03e2b2b0-f6ac-4c92-99ba-098c8cc10945 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:02.808141 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-03e2b2b0-f6ac-4c92-99ba-098c8cc10945 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:02.808938 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-03e2b2b0-f6ac-4c92-99ba-098c8cc10945 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:02.810135 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-03e2b2b0-f6ac-4c92-99ba-098c8cc10945 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:02.811068 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-03e2b2b0-f6ac-4c92-99ba-098c8cc10945 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:02.814874 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-03e2b2b0-f6ac-4c92-99ba-098c8cc10945 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:03.181455 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8f290c82-c978-4f3d-b9b6-1d655ddd2ac6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:03.189956 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8f290c82-c978-4f3d-b9b6-1d655ddd2ac6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:03.202157 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8f290c82-c978-4f3d-b9b6-1d655ddd2ac6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:03.203956 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8f290c82-c978-4f3d-b9b6-1d655ddd2ac6 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1486 microversion: 2.25 time: 1.074821 Aug 07 01:23:03.204773 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1257/2743] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:02 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1486 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:23:03.225745 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-98463a08-a8c0-4258-99f7-a423d03bc1c2 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:03.228281 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-98463a08-a8c0-4258-99f7-a423d03bc1c2 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] [instance: 8bbf0611-5a3b-4fec-a722-c07a08d09b26] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:03.263271 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-98463a08-a8c0-4258-99f7-a423d03bc1c2 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:03.264422 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-98463a08-a8c0-4258-99f7-a423d03bc1c2 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:03.273545 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-98463a08-a8c0-4258-99f7-a423d03bc1c2 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:03.276678 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-98463a08-a8c0-4258-99f7-a423d03bc1c2 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:03.279276 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-98463a08-a8c0-4258-99f7-a423d03bc1c2 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:03.282532 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-98463a08-a8c0-4258-99f7-a423d03bc1c2 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:04.076333 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-03e2b2b0-f6ac-4c92-99ba-098c8cc10945 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab58be25a94cd6a59634e7c7cad158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791ad97e3c374d2d8494abc25b46a0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:04.098907 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-03e2b2b0-f6ac-4c92-99ba-098c8cc10945 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43" status: 200 len: 1315 microversion: 2.1 time: 1.361490 Aug 07 01:23:04.101016 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1487/2744] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:02 2022] GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43 => generated 1315 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:04.114316 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fbec0abf-b216-4a98-80df-9eca820a66e3 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:04.115210 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fbec0abf-b216-4a98-80df-9eca820a66e3 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 51642c80-018a-4126-be66-97ced5cefece] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:04.169112 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fbec0abf-b216-4a98-80df-9eca820a66e3 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:04.171620 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fbec0abf-b216-4a98-80df-9eca820a66e3 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:04.172918 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fbec0abf-b216-4a98-80df-9eca820a66e3 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:04.174734 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fbec0abf-b216-4a98-80df-9eca820a66e3 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:04.178631 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fbec0abf-b216-4a98-80df-9eca820a66e3 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:04.181998 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fbec0abf-b216-4a98-80df-9eca820a66e3 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:04.483218 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-98463a08-a8c0-4258-99f7-a423d03bc1c2 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2185c595c9df4719bdca76d8797c76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5267b6a8e34a4397cd94fae11283be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:04.502441 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-98463a08-a8c0-4258-99f7-a423d03bc1c2 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] 10.222.0.39 "GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26" status: 200 len: 1403 microversion: 2.1 time: 1.291973 Aug 07 01:23:04.519712 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1258/2745] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:03 2022] GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26 => generated 1403 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:04.532487 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-dbf25f45-5342-4861-9dd7-970368e1afa7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:04.533538 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-dbf25f45-5342-4861-9dd7-970368e1afa7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:04.553459 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dbf25f45-5342-4861-9dd7-970368e1afa7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:04.554652 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dbf25f45-5342-4861-9dd7-970368e1afa7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:04.555334 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dbf25f45-5342-4861-9dd7-970368e1afa7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:04.556624 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dbf25f45-5342-4861-9dd7-970368e1afa7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:04.557708 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dbf25f45-5342-4861-9dd7-970368e1afa7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:04.558382 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dbf25f45-5342-4861-9dd7-970368e1afa7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:05.216720 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-dbf25f45-5342-4861-9dd7-970368e1afa7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:05.232219 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-dbf25f45-5342-4861-9dd7-970368e1afa7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:05.233747 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-dbf25f45-5342-4861-9dd7-970368e1afa7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:05.242883 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-dbf25f45-5342-4861-9dd7-970368e1afa7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1486 microversion: 2.25 time: 0.721897 Aug 07 01:23:05.246953 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1259/2746] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:04 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1486 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:23:05.282791 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-44408356-f922-452a-b668-aa48242ccacf req-4b055079-7d18-4742-886b-df1293e7d69e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b8441a7-9091-4b45-ac29-9023f2a6bc43", "tag": "7eba9569-21b0-4b5d-be00-748d51cbc8ae"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:05.318181 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-44408356-f922-452a-b668-aa48242ccacf req-4b055079-7d18-4742-886b-df1293e7d69e service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:05.321667 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-44408356-f922-452a-b668-aa48242ccacf req-4b055079-7d18-4742-886b-df1293e7d69e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:05.322391 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-44408356-f922-452a-b668-aa48242ccacf req-4b055079-7d18-4742-886b-df1293e7d69e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:05.363061 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-44408356-f922-452a-b668-aa48242ccacf req-4b055079-7d18-4742-886b-df1293e7d69e service nova] Creating event network-changed:7eba9569-21b0-4b5d-be00-748d51cbc8ae for instance 0b8441a7-9091-4b45-ac29-9023f2a6bc43 on n-h1-master-1 Aug 07 01:23:05.376236 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-44408356-f922-452a-b668-aa48242ccacf req-4b055079-7d18-4742-886b-df1293e7d69e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096910 Aug 07 01:23:05.377631 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1260/2747] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:05.388517 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8789d996-47e5-4877-9973-74e11ebac482 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:05.389323 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8789d996-47e5-4877-9973-74e11ebac482 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 0b8441a7-9091-4b45-ac29-9023f2a6bc43] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:05.398853 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8789d996-47e5-4877-9973-74e11ebac482 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:05.399644 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8789d996-47e5-4877-9973-74e11ebac482 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:05.401413 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8789d996-47e5-4877-9973-74e11ebac482 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:05.404022 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8789d996-47e5-4877-9973-74e11ebac482 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:05.404892 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8789d996-47e5-4877-9973-74e11ebac482 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:05.405715 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8789d996-47e5-4877-9973-74e11ebac482 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:05.468215 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fbec0abf-b216-4a98-80df-9eca820a66e3 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:05.506247 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fbec0abf-b216-4a98-80df-9eca820a66e3 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece" status: 200 len: 1313 microversion: 2.1 time: 1.401644 Aug 07 01:23:05.507586 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1488/2748] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:04 2022] GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece => generated 1313 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:05.544700 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-05055928-8967-46c0-b3ff-9d32a0f5d84e tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:05.547383 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-05055928-8967-46c0-b3ff-9d32a0f5d84e tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] [instance: 8bbf0611-5a3b-4fec-a722-c07a08d09b26] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:05.568227 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05055928-8967-46c0-b3ff-9d32a0f5d84e tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:05.575910 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05055928-8967-46c0-b3ff-9d32a0f5d84e tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:05.577215 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05055928-8967-46c0-b3ff-9d32a0f5d84e tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:05.579060 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05055928-8967-46c0-b3ff-9d32a0f5d84e tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:05.580948 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05055928-8967-46c0-b3ff-9d32a0f5d84e tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:05.590519 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05055928-8967-46c0-b3ff-9d32a0f5d84e tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:05.649469 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:06.263870 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8789d996-47e5-4877-9973-74e11ebac482 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab58be25a94cd6a59634e7c7cad158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791ad97e3c374d2d8494abc25b46a0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:06.285581 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8789d996-47e5-4877-9973-74e11ebac482 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43" status: 200 len: 1315 microversion: 2.1 time: 0.906441 Aug 07 01:23:06.290077 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1261/2749] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:05 2022] GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43 => generated 1315 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:06.309347 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c305f732-8082-45b6-ae41-be770f3b7efd tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:06.314721 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c305f732-8082-45b6-ae41-be770f3b7efd tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:06.330563 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c305f732-8082-45b6-ae41-be770f3b7efd tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:06.331404 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c305f732-8082-45b6-ae41-be770f3b7efd tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:06.332522 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c305f732-8082-45b6-ae41-be770f3b7efd tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:06.334167 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c305f732-8082-45b6-ae41-be770f3b7efd tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:06.335230 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c305f732-8082-45b6-ae41-be770f3b7efd tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:06.336304 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c305f732-8082-45b6-ae41-be770f3b7efd tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:06.656407 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-05055928-8967-46c0-b3ff-9d32a0f5d84e tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2185c595c9df4719bdca76d8797c76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5267b6a8e34a4397cd94fae11283be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:06.675152 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-05055928-8967-46c0-b3ff-9d32a0f5d84e tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] 10.222.0.39 "GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26" status: 200 len: 1403 microversion: 2.1 time: 1.141887 Aug 07 01:23:06.689539 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1489/2750] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:05 2022] GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26 => generated 1403 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:06.689539 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-59390c84-252b-456e-8188-8e49e5e5e8f7 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:06.689539 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-59390c84-252b-456e-8188-8e49e5e5e8f7 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 51642c80-018a-4126-be66-97ced5cefece] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:06.694497 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-59390c84-252b-456e-8188-8e49e5e5e8f7 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:06.695049 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-59390c84-252b-456e-8188-8e49e5e5e8f7 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:06.695491 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-59390c84-252b-456e-8188-8e49e5e5e8f7 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:06.702596 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-59390c84-252b-456e-8188-8e49e5e5e8f7 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:06.703233 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-59390c84-252b-456e-8188-8e49e5e5e8f7 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:06.703588 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-59390c84-252b-456e-8188-8e49e5e5e8f7 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:06.799954 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=4 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:06.851573 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=28 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:07.180105 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-59390c84-252b-456e-8188-8e49e5e5e8f7 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:07.246660 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-59390c84-252b-456e-8188-8e49e5e5e8f7 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece" status: 200 len: 1313 microversion: 2.1 time: 0.552464 Aug 07 01:23:07.276645 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1490/2751] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:06 2022] GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece => generated 1313 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:07.315474 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-84279e4a-12f3-431e-aadf-f476f20ae223 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:07.330746 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-84279e4a-12f3-431e-aadf-f476f20ae223 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 0b8441a7-9091-4b45-ac29-9023f2a6bc43] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:07.365838 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84279e4a-12f3-431e-aadf-f476f20ae223 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:07.366628 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84279e4a-12f3-431e-aadf-f476f20ae223 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:07.373336 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84279e4a-12f3-431e-aadf-f476f20ae223 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:07.385005 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84279e4a-12f3-431e-aadf-f476f20ae223 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:07.386923 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84279e4a-12f3-431e-aadf-f476f20ae223 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:07.388097 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84279e4a-12f3-431e-aadf-f476f20ae223 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:07.536366 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c305f732-8082-45b6-ae41-be770f3b7efd tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:07.601627 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c305f732-8082-45b6-ae41-be770f3b7efd tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:07.621424 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c305f732-8082-45b6-ae41-be770f3b7efd tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:07.624296 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c305f732-8082-45b6-ae41-be770f3b7efd tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1486 microversion: 2.25 time: 1.330011 Aug 07 01:23:07.629224 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1262/2752] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:06 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1486 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:23:07.703690 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1a8bd386-61d6-4ca1-b4eb-f6709adc344c tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:07.707072 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1a8bd386-61d6-4ca1-b4eb-f6709adc344c tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] [instance: 8bbf0611-5a3b-4fec-a722-c07a08d09b26] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:07.748356 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1a8bd386-61d6-4ca1-b4eb-f6709adc344c tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:07.749559 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1a8bd386-61d6-4ca1-b4eb-f6709adc344c tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:07.758997 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1a8bd386-61d6-4ca1-b4eb-f6709adc344c tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:07.761204 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1a8bd386-61d6-4ca1-b4eb-f6709adc344c tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:07.763615 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1a8bd386-61d6-4ca1-b4eb-f6709adc344c tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:07.764919 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1a8bd386-61d6-4ca1-b4eb-f6709adc344c tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:08.370974 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:08.906150 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-84279e4a-12f3-431e-aadf-f476f20ae223 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab58be25a94cd6a59634e7c7cad158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791ad97e3c374d2d8494abc25b46a0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:08.938748 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-84279e4a-12f3-431e-aadf-f476f20ae223 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43" status: 200 len: 1315 microversion: 2.1 time: 1.629971 Aug 07 01:23:08.955826 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1491/2753] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:07 2022] GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43 => generated 1315 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:08.963091 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-782975b5-0f14-460b-b3d8-3c77ca48693d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:08.966410 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-782975b5-0f14-460b-b3d8-3c77ca48693d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 51642c80-018a-4126-be66-97ced5cefece] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:08.980799 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-782975b5-0f14-460b-b3d8-3c77ca48693d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:08.983219 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-782975b5-0f14-460b-b3d8-3c77ca48693d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:08.984307 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-782975b5-0f14-460b-b3d8-3c77ca48693d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:08.986675 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-782975b5-0f14-460b-b3d8-3c77ca48693d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:08.987582 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-782975b5-0f14-460b-b3d8-3c77ca48693d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:08.988420 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-782975b5-0f14-460b-b3d8-3c77ca48693d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:09.534987 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1a8bd386-61d6-4ca1-b4eb-f6709adc344c tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2185c595c9df4719bdca76d8797c76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5267b6a8e34a4397cd94fae11283be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:09.565903 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1a8bd386-61d6-4ca1-b4eb-f6709adc344c tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] 10.222.0.39 "GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26" status: 200 len: 1403 microversion: 2.1 time: 1.870487 Aug 07 01:23:09.567262 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1263/2754] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:07 2022] GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26 => generated 1403 bytes in 1874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:09.588969 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-e4e1953a-9554-4e2d-aacd-669fcf2cafeb req-275aa35a-5f45-460a-bbff-4483c2f3202b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bbf0611-5a3b-4fec-a722-c07a08d09b26", "name": "network-vif-plugged", "status": "completed", "tag": "5c645525-cb30-401a-9b09-abfcb2929409"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:09.623252 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-e4e1953a-9554-4e2d-aacd-669fcf2cafeb req-275aa35a-5f45-460a-bbff-4483c2f3202b service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:09.624749 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-e4e1953a-9554-4e2d-aacd-669fcf2cafeb req-275aa35a-5f45-460a-bbff-4483c2f3202b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:09.625876 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-e4e1953a-9554-4e2d-aacd-669fcf2cafeb req-275aa35a-5f45-460a-bbff-4483c2f3202b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:09.654140 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-e4e1953a-9554-4e2d-aacd-669fcf2cafeb req-275aa35a-5f45-460a-bbff-4483c2f3202b service nova] Creating event network-vif-plugged:5c645525-cb30-401a-9b09-abfcb2929409 for instance 8bbf0611-5a3b-4fec-a722-c07a08d09b26 on n-h1-master-1 Aug 07 01:23:09.666012 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-e4e1953a-9554-4e2d-aacd-669fcf2cafeb req-275aa35a-5f45-460a-bbff-4483c2f3202b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095428 Aug 07 01:23:09.675010 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1264/2755] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:09.715348 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6780bee6-870d-4099-898c-bd8343b18258 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:09.717668 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6780bee6-870d-4099-898c-bd8343b18258 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:09.753751 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6780bee6-870d-4099-898c-bd8343b18258 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:09.755359 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6780bee6-870d-4099-898c-bd8343b18258 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:09.756758 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6780bee6-870d-4099-898c-bd8343b18258 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:09.763137 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6780bee6-870d-4099-898c-bd8343b18258 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:09.764631 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6780bee6-870d-4099-898c-bd8343b18258 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:09.766142 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6780bee6-870d-4099-898c-bd8343b18258 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:10.107982 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-782975b5-0f14-460b-b3d8-3c77ca48693d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:10.125047 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-782975b5-0f14-460b-b3d8-3c77ca48693d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece" status: 200 len: 1334 microversion: 2.1 time: 1.167392 Aug 07 01:23:10.126068 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1492/2756] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:08 2022] GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece => generated 1334 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:10.152445 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a00b9e1e-ca76-4f9d-b611-e54a0f17263c tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:10.164743 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a00b9e1e-ca76-4f9d-b611-e54a0f17263c tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 0b8441a7-9091-4b45-ac29-9023f2a6bc43] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:10.181988 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a00b9e1e-ca76-4f9d-b611-e54a0f17263c tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:10.194688 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a00b9e1e-ca76-4f9d-b611-e54a0f17263c tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:10.196070 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a00b9e1e-ca76-4f9d-b611-e54a0f17263c tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:10.199065 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a00b9e1e-ca76-4f9d-b611-e54a0f17263c tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:10.201003 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a00b9e1e-ca76-4f9d-b611-e54a0f17263c tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:10.206475 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a00b9e1e-ca76-4f9d-b611-e54a0f17263c tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:11.003389 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6780bee6-870d-4099-898c-bd8343b18258 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:11.030505 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6780bee6-870d-4099-898c-bd8343b18258 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:11.037082 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6780bee6-870d-4099-898c-bd8343b18258 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:11.039510 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6780bee6-870d-4099-898c-bd8343b18258 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1486 microversion: 2.25 time: 1.361287 Aug 07 01:23:11.043221 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1265/2757] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:09 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1486 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:23:11.080457 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d2e7440f-5a47-4b94-a54e-98a84966c847 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:11.082391 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d2e7440f-5a47-4b94-a54e-98a84966c847 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] [instance: 8bbf0611-5a3b-4fec-a722-c07a08d09b26] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:11.096007 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2e7440f-5a47-4b94-a54e-98a84966c847 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:11.097166 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2e7440f-5a47-4b94-a54e-98a84966c847 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:11.097870 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2e7440f-5a47-4b94-a54e-98a84966c847 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:11.098879 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2e7440f-5a47-4b94-a54e-98a84966c847 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:11.099656 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2e7440f-5a47-4b94-a54e-98a84966c847 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:11.100536 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2e7440f-5a47-4b94-a54e-98a84966c847 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:12.575777 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a00b9e1e-ca76-4f9d-b611-e54a0f17263c tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab58be25a94cd6a59634e7c7cad158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791ad97e3c374d2d8494abc25b46a0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:12.609379 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a00b9e1e-ca76-4f9d-b611-e54a0f17263c tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43" status: 200 len: 1315 microversion: 2.1 time: 2.481644 Aug 07 01:23:12.619129 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1493/2758] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:10 2022] GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43 => generated 1315 bytes in 2492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:12.662893 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b90ec848-04df-4c5d-979a-579bebaf95b1 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:12.663566 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b90ec848-04df-4c5d-979a-579bebaf95b1 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 51642c80-018a-4126-be66-97ced5cefece] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:12.695977 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b90ec848-04df-4c5d-979a-579bebaf95b1 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:12.698730 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b90ec848-04df-4c5d-979a-579bebaf95b1 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:12.703857 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b90ec848-04df-4c5d-979a-579bebaf95b1 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:12.716338 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b90ec848-04df-4c5d-979a-579bebaf95b1 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:12.717264 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b90ec848-04df-4c5d-979a-579bebaf95b1 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:12.724431 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b90ec848-04df-4c5d-979a-579bebaf95b1 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:12.744204 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d2e7440f-5a47-4b94-a54e-98a84966c847 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2185c595c9df4719bdca76d8797c76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5267b6a8e34a4397cd94fae11283be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:12.768203 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d2e7440f-5a47-4b94-a54e-98a84966c847 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] 10.222.0.39 "GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26" status: 200 len: 1403 microversion: 2.1 time: 1.692162 Aug 07 01:23:12.786952 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1266/2759] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:11 2022] GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26 => generated 1403 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:12.809099 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0e432007-4688-473b-bcd5-7b928e720c97 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:12.813447 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0e432007-4688-473b-bcd5-7b928e720c97 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:12.841467 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e432007-4688-473b-bcd5-7b928e720c97 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:12.843710 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e432007-4688-473b-bcd5-7b928e720c97 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:12.845652 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e432007-4688-473b-bcd5-7b928e720c97 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:12.850119 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e432007-4688-473b-bcd5-7b928e720c97 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:12.853030 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e432007-4688-473b-bcd5-7b928e720c97 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:12.853812 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e432007-4688-473b-bcd5-7b928e720c97 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:13.475691 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0e432007-4688-473b-bcd5-7b928e720c97 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:13.499863 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0e432007-4688-473b-bcd5-7b928e720c97 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:13.515204 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b90ec848-04df-4c5d-979a-579bebaf95b1 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:13.515687 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0e432007-4688-473b-bcd5-7b928e720c97 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:13.522233 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0e432007-4688-473b-bcd5-7b928e720c97 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1486 microversion: 2.25 time: 0.733432 Aug 07 01:23:13.529870 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1267/2760] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:12 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1486 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:23:13.530758 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b90ec848-04df-4c5d-979a-579bebaf95b1 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece" status: 200 len: 1334 microversion: 2.1 time: 0.907354 Aug 07 01:23:13.542303 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1494/2761] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:12 2022] GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece => generated 1334 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:13.633169 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a790c1c2-64c4-45f4-98b5-ece541a65dd0 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:13.634123 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a790c1c2-64c4-45f4-98b5-ece541a65dd0 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 0b8441a7-9091-4b45-ac29-9023f2a6bc43] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:13.646324 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a790c1c2-64c4-45f4-98b5-ece541a65dd0 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:13.664495 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a790c1c2-64c4-45f4-98b5-ece541a65dd0 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:13.665459 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a790c1c2-64c4-45f4-98b5-ece541a65dd0 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:13.666330 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a790c1c2-64c4-45f4-98b5-ece541a65dd0 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:13.669162 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a790c1c2-64c4-45f4-98b5-ece541a65dd0 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:13.670066 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a790c1c2-64c4-45f4-98b5-ece541a65dd0 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:13.824447 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fcb84488-e490-4721-ac76-b7ba939b01bf tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:13.840467 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fcb84488-e490-4721-ac76-b7ba939b01bf tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] [instance: 8bbf0611-5a3b-4fec-a722-c07a08d09b26] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:13.880979 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fcb84488-e490-4721-ac76-b7ba939b01bf tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:13.882586 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fcb84488-e490-4721-ac76-b7ba939b01bf tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:13.884594 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fcb84488-e490-4721-ac76-b7ba939b01bf tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:13.886992 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fcb84488-e490-4721-ac76-b7ba939b01bf tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:13.888159 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fcb84488-e490-4721-ac76-b7ba939b01bf tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:13.889237 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fcb84488-e490-4721-ac76-b7ba939b01bf tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:14.599532 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fcb84488-e490-4721-ac76-b7ba939b01bf tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2185c595c9df4719bdca76d8797c76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5267b6a8e34a4397cd94fae11283be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:14.633746 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fcb84488-e490-4721-ac76-b7ba939b01bf tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] 10.222.0.39 "GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26" status: 200 len: 1590 microversion: 2.1 time: 0.834610 Aug 07 01:23:14.635915 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1495/2762] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:13 2022] GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26 => generated 1590 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:14.645289 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-96b867cd-cf6a-48d2-b1cb-8e499ade286e req-41dcc119-a903-49c3-b06d-12c211faad53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51642c80-018a-4126-be66-97ced5cefece", "tag": "d02958b8-9820-4614-b86f-bfba455a3d18"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:14.660991 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-96b867cd-cf6a-48d2-b1cb-8e499ade286e req-41dcc119-a903-49c3-b06d-12c211faad53 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:14.662070 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-96b867cd-cf6a-48d2-b1cb-8e499ade286e req-41dcc119-a903-49c3-b06d-12c211faad53 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:14.662708 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-96b867cd-cf6a-48d2-b1cb-8e499ade286e req-41dcc119-a903-49c3-b06d-12c211faad53 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:14.680600 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-96b867cd-cf6a-48d2-b1cb-8e499ade286e req-41dcc119-a903-49c3-b06d-12c211faad53 service nova] Creating event network-changed:d02958b8-9820-4614-b86f-bfba455a3d18 for instance 51642c80-018a-4126-be66-97ced5cefece on n-h2-master-1 Aug 07 01:23:14.692685 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-96b867cd-cf6a-48d2-b1cb-8e499ade286e req-41dcc119-a903-49c3-b06d-12c211faad53 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051729 Aug 07 01:23:14.694100 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1496/2763] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:14.914320 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a790c1c2-64c4-45f4-98b5-ece541a65dd0 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab58be25a94cd6a59634e7c7cad158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791ad97e3c374d2d8494abc25b46a0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:14.940296 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a790c1c2-64c4-45f4-98b5-ece541a65dd0 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43" status: 200 len: 1315 microversion: 2.1 time: 1.307890 Aug 07 01:23:14.945374 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1268/2764] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:13 2022] GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43 => generated 1315 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:14.967388 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7e42b68c-bee3-4566-bce3-498dc8c10c39 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:14.971077 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7e42b68c-bee3-4566-bce3-498dc8c10c39 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:14.991724 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e42b68c-bee3-4566-bce3-498dc8c10c39 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:14.994206 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e42b68c-bee3-4566-bce3-498dc8c10c39 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:14.996975 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e42b68c-bee3-4566-bce3-498dc8c10c39 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:15.004653 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e42b68c-bee3-4566-bce3-498dc8c10c39 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:15.006073 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e42b68c-bee3-4566-bce3-498dc8c10c39 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:15.008194 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e42b68c-bee3-4566-bce3-498dc8c10c39 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:15.438986 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-19a191db-aa59-4ed9-845d-cf68be02353e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'create', calling method: .version_select at 0x7f9e2403a820>, body: {"keypair": {"name": "tempest-keypair-514522053", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWexp9DWd/p+JLtwqjpvspuX5EPUpFn2HSJGztcj5wmfgfrjyKvEJJK5iASO/kWbXPdhoNgB0JKJzqPVvKAvNjTBCpMBkRPkzIOlyGTgJ5yxfas2UjJNxC5TkQxFq7fiw=="}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:15.502219 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-19a191db-aa59-4ed9-845d-cf68be02353e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Getting quotas for project 939fea7fa6ea4deda8d4fbef70a4e510. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:23:15.511418 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-19a191db-aa59-4ed9-845d-cf68be02353e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Getting quotas for user ef29bd35cca547c39d76c54058d32979 and project 939fea7fa6ea4deda8d4fbef70a4e510. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:23:15.587252 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-19a191db-aa59-4ed9-845d-cf68be02353e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.891348 Aug 07 01:23:15.589917 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1497/2765] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:23:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:15.596687 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d6cc6bee-e222-4e12-a1dc-8aee7b40a8e5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:15.598652 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d6cc6bee-e222-4e12-a1dc-8aee7b40a8e5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 51642c80-018a-4126-be66-97ced5cefece] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:15.619158 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6cc6bee-e222-4e12-a1dc-8aee7b40a8e5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:15.621236 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6cc6bee-e222-4e12-a1dc-8aee7b40a8e5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:15.621701 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6cc6bee-e222-4e12-a1dc-8aee7b40a8e5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:15.622449 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6cc6bee-e222-4e12-a1dc-8aee7b40a8e5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:15.622920 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6cc6bee-e222-4e12-a1dc-8aee7b40a8e5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:15.623360 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6cc6bee-e222-4e12-a1dc-8aee7b40a8e5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:15.894180 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7e42b68c-bee3-4566-bce3-498dc8c10c39 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:15.907802 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7e42b68c-bee3-4566-bce3-498dc8c10c39 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:15.909706 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7e42b68c-bee3-4566-bce3-498dc8c10c39 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:15.911675 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7e42b68c-bee3-4566-bce3-498dc8c10c39 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1486 microversion: 2.25 time: 0.961771 Aug 07 01:23:15.932333 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1269/2766] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:14 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1486 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:23:15.939786 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-840bd274-0a2d-4184-b9d4-bdacbb3f6d1c tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:15.940650 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-840bd274-0a2d-4184-b9d4-bdacbb3f6d1c tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] [instance: 8bbf0611-5a3b-4fec-a722-c07a08d09b26] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:15.948378 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:15.951191 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-840bd274-0a2d-4184-b9d4-bdacbb3f6d1c tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:15.952012 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-840bd274-0a2d-4184-b9d4-bdacbb3f6d1c tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:15.952890 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-840bd274-0a2d-4184-b9d4-bdacbb3f6d1c tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:15.953862 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-840bd274-0a2d-4184-b9d4-bdacbb3f6d1c tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:15.954690 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-840bd274-0a2d-4184-b9d4-bdacbb3f6d1c tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:15.955402 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-840bd274-0a2d-4184-b9d4-bdacbb3f6d1c tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:16.258497 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d6cc6bee-e222-4e12-a1dc-8aee7b40a8e5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:16.296035 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d6cc6bee-e222-4e12-a1dc-8aee7b40a8e5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece" status: 200 len: 1334 microversion: 2.1 time: 0.703813 Aug 07 01:23:16.312584 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-840bd274-0a2d-4184-b9d4-bdacbb3f6d1c tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] 10.222.0.39 "GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.377747 Aug 07 01:23:16.312696 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1498/2767] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:15 2022] GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece => generated 1334 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:16.312955 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1270/2768] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Aug 7 01:23:15 2022] GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26/os-interface => generated 284 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:16.324435 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-01676f41-21d2-4f83-9936-1879cc7b7091 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:16.325436 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-01676f41-21d2-4f83-9936-1879cc7b7091 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 0b8441a7-9091-4b45-ac29-9023f2a6bc43] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:16.342845 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-01676f41-21d2-4f83-9936-1879cc7b7091 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:16.344993 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-01676f41-21d2-4f83-9936-1879cc7b7091 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:16.346685 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-01676f41-21d2-4f83-9936-1879cc7b7091 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:16.358246 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-01676f41-21d2-4f83-9936-1879cc7b7091 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:16.359493 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-01676f41-21d2-4f83-9936-1879cc7b7091 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:16.360689 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-01676f41-21d2-4f83-9936-1879cc7b7091 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:16.787779 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-24acde50-bd18-45d1-a8af-66ff01399a18 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1991319600", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "8f08bf34-4ba1-4a3b-8f31-ae9f5f9dda25"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:16.928046 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-24acde50-bd18-45d1-a8af-66ff01399a18 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] validate_networks() for [('8f08bf34-4ba1-4a3b-8f31-ae9f5f9dda25', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:23:17.048236 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-01676f41-21d2-4f83-9936-1879cc7b7091 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab58be25a94cd6a59634e7c7cad158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791ad97e3c374d2d8494abc25b46a0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:17.058791 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-01676f41-21d2-4f83-9936-1879cc7b7091 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43" status: 200 len: 1315 microversion: 2.1 time: 0.744475 Aug 07 01:23:17.074034 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1271/2769] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:16 2022] GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43 => generated 1315 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:17.229661 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e33f9100-f780-489e-814d-d8e23512e80f tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] Action: 'create', calling method: .version_select at 0x7f9e17f82430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-914174968"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:18.277906 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e33f9100-f780-489e-814d-d8e23512e80f tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.201806 Aug 07 01:23:18.280665 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1272/2770] 10.222.0.39 () {60 vars in 1155 bytes} [Sun Aug 7 01:23:17 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1206 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 07 01:23:18.293018 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d17b4b2e-f7aa-4441-862d-685a0f72be92 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:18.294910 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d17b4b2e-f7aa-4441-862d-685a0f72be92 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:18.309608 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d17b4b2e-f7aa-4441-862d-685a0f72be92 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:18.310502 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d17b4b2e-f7aa-4441-862d-685a0f72be92 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:18.311426 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d17b4b2e-f7aa-4441-862d-685a0f72be92 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:18.312681 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d17b4b2e-f7aa-4441-862d-685a0f72be92 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:18.313456 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d17b4b2e-f7aa-4441-862d-685a0f72be92 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:18.314233 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d17b4b2e-f7aa-4441-862d-685a0f72be92 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:18.679024 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-24acde50-bd18-45d1-a8af-66ff01399a18 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:23:18.679761 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-24acde50-bd18-45d1-a8af-66ff01399a18 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:23:18.680271 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-24acde50-bd18-45d1-a8af-66ff01399a18 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:23:18.680692 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-24acde50-bd18-45d1-a8af-66ff01399a18 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:23:18.681204 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-24acde50-bd18-45d1-a8af-66ff01399a18 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:23:18.700052 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24acde50-bd18-45d1-a8af-66ff01399a18 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:18.700556 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24acde50-bd18-45d1-a8af-66ff01399a18 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:18.701005 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24acde50-bd18-45d1-a8af-66ff01399a18 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:18.701766 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24acde50-bd18-45d1-a8af-66ff01399a18 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:18.706964 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24acde50-bd18-45d1-a8af-66ff01399a18 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:18.707727 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24acde50-bd18-45d1-a8af-66ff01399a18 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:18.776093 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-24acde50-bd18-45d1-a8af-66ff01399a18 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Getting quotas for project a7056cca1edc4e60a51a98237d187857. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:23:18.808486 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-24acde50-bd18-45d1-a8af-66ff01399a18 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Getting quotas for user 07a75cbb3d8a4b4baa361b0444c2370e and project a7056cca1edc4e60a51a98237d187857. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:23:18.841928 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-24acde50-bd18-45d1-a8af-66ff01399a18 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:23:18.845259 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-24acde50-bd18-45d1-a8af-66ff01399a18 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] [instance: 9399abef-0bdd-46db-9718-78e074738d1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:23:18.984577 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-24acde50-bd18-45d1-a8af-66ff01399a18 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.669235 Aug 07 01:23:18.985253 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1499/2771] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:23:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:23:19.008649 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-28a0bfd9-7aa4-44d1-85db-a41870863834 req-5572d0d4-6255-4685-9799-f470cebda395 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b8441a7-9091-4b45-ac29-9023f2a6bc43", "name": "network-vif-plugged", "status": "completed", "tag": "7eba9569-21b0-4b5d-be00-748d51cbc8ae"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:19.051678 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-28a0bfd9-7aa4-44d1-85db-a41870863834 req-5572d0d4-6255-4685-9799-f470cebda395 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:19.053064 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-28a0bfd9-7aa4-44d1-85db-a41870863834 req-5572d0d4-6255-4685-9799-f470cebda395 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:19.053578 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-28a0bfd9-7aa4-44d1-85db-a41870863834 req-5572d0d4-6255-4685-9799-f470cebda395 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:19.089199 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-28a0bfd9-7aa4-44d1-85db-a41870863834 req-5572d0d4-6255-4685-9799-f470cebda395 service nova] Creating event network-vif-plugged:7eba9569-21b0-4b5d-be00-748d51cbc8ae for instance 0b8441a7-9091-4b45-ac29-9023f2a6bc43 on n-h1-master-1 Aug 07 01:23:19.102392 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-28a0bfd9-7aa4-44d1-85db-a41870863834 req-5572d0d4-6255-4685-9799-f470cebda395 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113961 Aug 07 01:23:19.106474 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1500/2772] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:19.121450 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-52596949-5cc6-455d-9ac5-00295f904a7e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:19.124431 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-52596949-5cc6-455d-9ac5-00295f904a7e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 51642c80-018a-4126-be66-97ced5cefece] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:19.142344 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52596949-5cc6-455d-9ac5-00295f904a7e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:19.144645 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52596949-5cc6-455d-9ac5-00295f904a7e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:19.145767 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52596949-5cc6-455d-9ac5-00295f904a7e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:19.149025 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52596949-5cc6-455d-9ac5-00295f904a7e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:19.152608 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52596949-5cc6-455d-9ac5-00295f904a7e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:19.153262 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52596949-5cc6-455d-9ac5-00295f904a7e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:19.489873 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d17b4b2e-f7aa-4441-862d-685a0f72be92 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:19.510665 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d17b4b2e-f7aa-4441-862d-685a0f72be92 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:19.514207 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d17b4b2e-f7aa-4441-862d-685a0f72be92 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:19.519170 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d17b4b2e-f7aa-4441-862d-685a0f72be92 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1486 microversion: 2.25 time: 1.236298 Aug 07 01:23:19.520105 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1273/2773] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:18 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1486 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:23:19.537955 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-d38e3168-2bdc-40d0-99ce-52c40778e9a8 req-48a1daac-8525-4412-9592-184a7ccdd9d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51642c80-018a-4126-be66-97ced5cefece", "tag": "90b7e8fd-564b-468f-8889-a0388488ce36"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:19.586483 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d38e3168-2bdc-40d0-99ce-52c40778e9a8 req-48a1daac-8525-4412-9592-184a7ccdd9d4 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:19.589516 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d38e3168-2bdc-40d0-99ce-52c40778e9a8 req-48a1daac-8525-4412-9592-184a7ccdd9d4 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:19.590589 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d38e3168-2bdc-40d0-99ce-52c40778e9a8 req-48a1daac-8525-4412-9592-184a7ccdd9d4 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:19.632659 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-d38e3168-2bdc-40d0-99ce-52c40778e9a8 req-48a1daac-8525-4412-9592-184a7ccdd9d4 service nova] Creating event network-changed:90b7e8fd-564b-468f-8889-a0388488ce36 for instance 51642c80-018a-4126-be66-97ced5cefece on n-h2-master-1 Aug 07 01:23:19.658192 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-d38e3168-2bdc-40d0-99ce-52c40778e9a8 req-48a1daac-8525-4412-9592-184a7ccdd9d4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126594 Aug 07 01:23:19.660819 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1274/2774] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:19.676543 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-64519b94-b421-4b56-8f51-2fa17c6cd481 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:19.680867 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-64519b94-b421-4b56-8f51-2fa17c6cd481 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 0b8441a7-9091-4b45-ac29-9023f2a6bc43] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:19.708078 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64519b94-b421-4b56-8f51-2fa17c6cd481 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:19.712750 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64519b94-b421-4b56-8f51-2fa17c6cd481 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:19.714793 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64519b94-b421-4b56-8f51-2fa17c6cd481 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:19.718276 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64519b94-b421-4b56-8f51-2fa17c6cd481 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:19.720530 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64519b94-b421-4b56-8f51-2fa17c6cd481 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:19.721308 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64519b94-b421-4b56-8f51-2fa17c6cd481 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:19.768008 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:20.147123 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-52596949-5cc6-455d-9ac5-00295f904a7e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:20.187382 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-52596949-5cc6-455d-9ac5-00295f904a7e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece" status: 200 len: 1334 microversion: 2.1 time: 1.077387 Aug 07 01:23:20.189665 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1501/2775] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:19 2022] GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece => generated 1334 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:20.208561 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fd535357-74ec-4af3-82de-626ab6de1fc6 tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] Calling method '.version_select at 0x7f9e179ab820>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:20.375804 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fd535357-74ec-4af3-82de-626ab6de1fc6 tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/70cac16f-43e5-400f-89f3-ecc0bf63f806" status: 200 len: 345 microversion: 2.1 time: 0.182881 Aug 07 01:23:20.385125 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1502/2776] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Aug 7 01:23:20 2022] GET /compute/v2.1/os-volumes/70cac16f-43e5-400f-89f3-ecc0bf63f806 => generated 345 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:20.385125 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f8da6ba2-5126-476c-8fb4-4cde5c27f645 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:20.385125 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f8da6ba2-5126-476c-8fb4-4cde5c27f645 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] [instance: 9399abef-0bdd-46db-9718-78e074738d1b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:20.395593 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:20.432744 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f8da6ba2-5126-476c-8fb4-4cde5c27f645 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:20.433353 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f8da6ba2-5126-476c-8fb4-4cde5c27f645 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:20.433817 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f8da6ba2-5126-476c-8fb4-4cde5c27f645 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:20.434836 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f8da6ba2-5126-476c-8fb4-4cde5c27f645 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:20.440451 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f8da6ba2-5126-476c-8fb4-4cde5c27f645 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:20.442421 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f8da6ba2-5126-476c-8fb4-4cde5c27f645 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:20.616719 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f8da6ba2-5126-476c-8fb4-4cde5c27f645 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07a75cbb3d8a4b4baa361b0444c2370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7056cca1edc4e60a51a98237d187857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:20.626476 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f8da6ba2-5126-476c-8fb4-4cde5c27f645 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] 10.222.0.39 "GET /compute/v2.1/servers/9399abef-0bdd-46db-9718-78e074738d1b" status: 200 len: 1229 microversion: 2.1 time: 0.248652 Aug 07 01:23:20.627352 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1503/2777] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:20 2022] GET /compute/v2.1/servers/9399abef-0bdd-46db-9718-78e074738d1b => generated 1229 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:20.638256 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a9e7bfbe-ead4-44cf-954c-ba74ff67d2bc tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] Action: 'create', calling method: .version_select at 0x7f9e179ab820>, body: {"snapshot": {"volume_id": "70cac16f-43e5-400f-89f3-ecc0bf63f806", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-591724161"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:20.965400 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a9e7bfbe-ead4-44cf-954c-ba74ff67d2bc tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] 10.222.0.39 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.336410 Aug 07 01:23:20.966252 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1504/2778] 10.222.0.39 () {60 vars in 1162 bytes} [Sun Aug 7 01:23:20 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:20.973074 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-562aaef0-0eb3-420a-808e-e3503a838527 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:20.975241 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-562aaef0-0eb3-420a-808e-e3503a838527 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:20.997965 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-562aaef0-0eb3-420a-808e-e3503a838527 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:20.998712 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-562aaef0-0eb3-420a-808e-e3503a838527 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:21.000016 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-562aaef0-0eb3-420a-808e-e3503a838527 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:21.004356 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-562aaef0-0eb3-420a-808e-e3503a838527 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:21.005131 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-562aaef0-0eb3-420a-808e-e3503a838527 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:21.005734 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-562aaef0-0eb3-420a-808e-e3503a838527 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:21.169117 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-64519b94-b421-4b56-8f51-2fa17c6cd481 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab58be25a94cd6a59634e7c7cad158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791ad97e3c374d2d8494abc25b46a0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:21.178279 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-64519b94-b421-4b56-8f51-2fa17c6cd481 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43" status: 200 len: 1315 microversion: 2.1 time: 1.516141 Aug 07 01:23:21.184966 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1275/2779] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:19 2022] GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43 => generated 1315 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:21.190068 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5af43d51-469e-490c-ad4c-1e1ff175e450 tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] Calling method '.version_select at 0x7f9e245d90d0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:21.362884 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5af43d51-469e-490c-ad4c-1e1ff175e450 tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/7d970971-2987-4d5f-809f-030ba8c076ae" status: 200 len: 286 microversion: 2.1 time: 0.176504 Aug 07 01:23:21.363972 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1276/2780] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Aug 7 01:23:21 2022] GET /compute/v2.1/os-snapshots/7d970971-2987-4d5f-809f-030ba8c076ae => generated 286 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:21.369746 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d373847d-6233-4f66-8c34-2d2dd9838b85 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:21.371432 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d373847d-6233-4f66-8c34-2d2dd9838b85 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 51642c80-018a-4126-be66-97ced5cefece] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:21.385196 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d373847d-6233-4f66-8c34-2d2dd9838b85 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:21.391561 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d373847d-6233-4f66-8c34-2d2dd9838b85 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:21.402535 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d373847d-6233-4f66-8c34-2d2dd9838b85 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:21.403611 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d373847d-6233-4f66-8c34-2d2dd9838b85 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:21.404250 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d373847d-6233-4f66-8c34-2d2dd9838b85 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:21.404800 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d373847d-6233-4f66-8c34-2d2dd9838b85 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:21.898583 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-562aaef0-0eb3-420a-808e-e3503a838527 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:21.914040 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-562aaef0-0eb3-420a-808e-e3503a838527 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:21.925986 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-562aaef0-0eb3-420a-808e-e3503a838527 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:21.937491 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-562aaef0-0eb3-420a-808e-e3503a838527 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1486 microversion: 2.25 time: 0.969909 Aug 07 01:23:21.940841 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1505/2781] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:20 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1486 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:23:21.958194 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4cb27f82-cc42-48a3-ad55-a0dc30be534c tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] Calling method '.version_select at 0x7f9e24024550>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:22.071606 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4cb27f82-cc42-48a3-ad55-a0dc30be534c tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.126755 Aug 07 01:23:22.072777 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1506/2782] 10.222.0.39 () {58 vars in 1140 bytes} [Sun Aug 7 01:23:21 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:22.078412 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a032f692-cd1b-4854-af03-c83e0ae5e0c1 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:22.080173 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a032f692-cd1b-4854-af03-c83e0ae5e0c1 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] [instance: 9399abef-0bdd-46db-9718-78e074738d1b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:22.112087 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a032f692-cd1b-4854-af03-c83e0ae5e0c1 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:22.113128 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a032f692-cd1b-4854-af03-c83e0ae5e0c1 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:22.113756 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a032f692-cd1b-4854-af03-c83e0ae5e0c1 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:22.114799 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a032f692-cd1b-4854-af03-c83e0ae5e0c1 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:22.115648 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a032f692-cd1b-4854-af03-c83e0ae5e0c1 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:22.120083 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a032f692-cd1b-4854-af03-c83e0ae5e0c1 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:22.438677 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a032f692-cd1b-4854-af03-c83e0ae5e0c1 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07a75cbb3d8a4b4baa361b0444c2370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7056cca1edc4e60a51a98237d187857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:22.451765 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a032f692-cd1b-4854-af03-c83e0ae5e0c1 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] 10.222.0.39 "GET /compute/v2.1/servers/9399abef-0bdd-46db-9718-78e074738d1b" status: 200 len: 1283 microversion: 2.1 time: 0.376904 Aug 07 01:23:22.454966 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1507/2783] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:22 2022] GET /compute/v2.1/servers/9399abef-0bdd-46db-9718-78e074738d1b => generated 1283 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:22.460350 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c40f50b8-e4f0-411e-b71f-6da58ba9c7ad tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] Calling method '.version_select at 0x7f9e179abaf0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:22.535712 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c40f50b8-e4f0-411e-b71f-6da58ba9c7ad tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/7d970971-2987-4d5f-809f-030ba8c076ae" status: 200 len: 286 microversion: 2.1 time: 0.079283 Aug 07 01:23:22.536743 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1508/2784] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Aug 7 01:23:22 2022] GET /compute/v2.1/os-snapshots/7d970971-2987-4d5f-809f-030ba8c076ae => generated 286 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:22.541829 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c19823ec-2f1a-4c28-bbc4-558a6e4e3899 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:22.542457 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c19823ec-2f1a-4c28-bbc4-558a6e4e3899 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 0b8441a7-9091-4b45-ac29-9023f2a6bc43] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:22.555013 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c19823ec-2f1a-4c28-bbc4-558a6e4e3899 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:22.555526 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c19823ec-2f1a-4c28-bbc4-558a6e4e3899 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:22.556071 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c19823ec-2f1a-4c28-bbc4-558a6e4e3899 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:22.557504 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c19823ec-2f1a-4c28-bbc4-558a6e4e3899 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:22.557980 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c19823ec-2f1a-4c28-bbc4-558a6e4e3899 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:22.558414 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c19823ec-2f1a-4c28-bbc4-558a6e4e3899 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:22.578481 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d373847d-6233-4f66-8c34-2d2dd9838b85 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:22.591579 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d373847d-6233-4f66-8c34-2d2dd9838b85 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece" status: 200 len: 1334 microversion: 2.1 time: 1.226294 Aug 07 01:23:22.599488 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1277/2785] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:21 2022] GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece => generated 1334 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:22.893339 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-dd70d6a7-a68e-4c9d-b779-ebb36e101c79 req-98abf3c8-c74d-4139-ae75-627ad3380fcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "536a25a5-29bc-447e-9cf6-81b2db1ec700", "name": "network-vif-unplugged", "status": "completed", "tag": "b4a97479-abbd-4e8a-b47c-ebf03a104d41"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:22.926962 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-dd70d6a7-a68e-4c9d-b779-ebb36e101c79 req-98abf3c8-c74d-4139-ae75-627ad3380fcd service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:22.927731 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-dd70d6a7-a68e-4c9d-b779-ebb36e101c79 req-98abf3c8-c74d-4139-ae75-627ad3380fcd service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:22.928409 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-dd70d6a7-a68e-4c9d-b779-ebb36e101c79 req-98abf3c8-c74d-4139-ae75-627ad3380fcd service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:22.946349 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-dd70d6a7-a68e-4c9d-b779-ebb36e101c79 req-98abf3c8-c74d-4139-ae75-627ad3380fcd service nova] Creating event network-vif-unplugged:b4a97479-abbd-4e8a-b47c-ebf03a104d41 for instance 536a25a5-29bc-447e-9cf6-81b2db1ec700 on n-h2-master-1 Aug 07 01:23:22.954918 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-dd70d6a7-a68e-4c9d-b779-ebb36e101c79 req-98abf3c8-c74d-4139-ae75-627ad3380fcd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073668 Aug 07 01:23:22.956263 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1278/2786] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:23.013830 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1403b1a5-d8f2-41d9-b299-0004b1006210 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:23.014924 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1403b1a5-d8f2-41d9-b299-0004b1006210 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:23.026055 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1403b1a5-d8f2-41d9-b299-0004b1006210 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:23.028285 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1403b1a5-d8f2-41d9-b299-0004b1006210 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:23.030370 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1403b1a5-d8f2-41d9-b299-0004b1006210 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:23.038070 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1403b1a5-d8f2-41d9-b299-0004b1006210 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:23.038678 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1403b1a5-d8f2-41d9-b299-0004b1006210 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:23.039153 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1403b1a5-d8f2-41d9-b299-0004b1006210 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:23.290807 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c19823ec-2f1a-4c28-bbc4-558a6e4e3899 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab58be25a94cd6a59634e7c7cad158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791ad97e3c374d2d8494abc25b46a0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:23.346184 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c19823ec-2f1a-4c28-bbc4-558a6e4e3899 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43" status: 200 len: 1504 microversion: 2.1 time: 0.808298 Aug 07 01:23:23.346802 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1509/2787] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:22 2022] GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43 => generated 1504 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:23.371925 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-77a52a46-8522-4565-820a-de0cb430700b tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:23.372637 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-77a52a46-8522-4565-820a-de0cb430700b tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] [instance: 8bbf0611-5a3b-4fec-a722-c07a08d09b26] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:23.385121 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77a52a46-8522-4565-820a-de0cb430700b tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:23.389090 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77a52a46-8522-4565-820a-de0cb430700b tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:23.390325 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77a52a46-8522-4565-820a-de0cb430700b tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:23.392007 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77a52a46-8522-4565-820a-de0cb430700b tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:23.392525 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77a52a46-8522-4565-820a-de0cb430700b tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:23.392991 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77a52a46-8522-4565-820a-de0cb430700b tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:23.864378 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1403b1a5-d8f2-41d9-b299-0004b1006210 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:23.886983 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1403b1a5-d8f2-41d9-b299-0004b1006210 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:23.895288 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1403b1a5-d8f2-41d9-b299-0004b1006210 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:23.897510 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1403b1a5-d8f2-41d9-b299-0004b1006210 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1486 microversion: 2.25 time: 0.903116 Aug 07 01:23:23.918381 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1279/2788] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:22 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1486 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:23:23.928395 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-72aca12e-e828-4695-9956-c70e3e0c8328 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-813402867"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:23.929282 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-72aca12e-e828-4695-9956-c70e3e0c8328 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 0b8441a7-9091-4b45-ac29-9023f2a6bc43] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:23.944432 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-72aca12e-e828-4695-9956-c70e3e0c8328 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:23.945264 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-72aca12e-e828-4695-9956-c70e3e0c8328 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:23.945871 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-72aca12e-e828-4695-9956-c70e3e0c8328 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:23.947340 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-72aca12e-e828-4695-9956-c70e3e0c8328 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:23.948116 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-72aca12e-e828-4695-9956-c70e3e0c8328 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:23.948701 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-72aca12e-e828-4695-9956-c70e3e0c8328 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:24.190963 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-77a52a46-8522-4565-820a-de0cb430700b tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2185c595c9df4719bdca76d8797c76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5267b6a8e34a4397cd94fae11283be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:24.201369 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-77a52a46-8522-4565-820a-de0cb430700b tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] 10.222.0.39 "GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26" status: 200 len: 1590 microversion: 2.1 time: 0.847390 Aug 07 01:23:24.207598 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1510/2789] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:23 2022] GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26 => generated 1590 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:24.222073 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-132980b6-9f78-482b-9b7d-11af56a28974 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:24.223091 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-132980b6-9f78-482b-9b7d-11af56a28974 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] [instance: 9399abef-0bdd-46db-9718-78e074738d1b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:24.236703 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-132980b6-9f78-482b-9b7d-11af56a28974 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:24.237529 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-132980b6-9f78-482b-9b7d-11af56a28974 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:24.238368 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-132980b6-9f78-482b-9b7d-11af56a28974 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:24.239372 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-132980b6-9f78-482b-9b7d-11af56a28974 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:24.240067 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-132980b6-9f78-482b-9b7d-11af56a28974 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:24.240689 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-132980b6-9f78-482b-9b7d-11af56a28974 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:24.484965 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-132980b6-9f78-482b-9b7d-11af56a28974 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07a75cbb3d8a4b4baa361b0444c2370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7056cca1edc4e60a51a98237d187857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:24.498035 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-132980b6-9f78-482b-9b7d-11af56a28974 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] 10.222.0.39 "GET /compute/v2.1/servers/9399abef-0bdd-46db-9718-78e074738d1b" status: 200 len: 1283 microversion: 2.1 time: 0.288793 Aug 07 01:23:24.501734 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1511/2790] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:24 2022] GET /compute/v2.1/servers/9399abef-0bdd-46db-9718-78e074738d1b => generated 1283 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:24.514087 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-16ed219a-911c-4b33-ae0b-9a942a48a87c tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] Calling method '.version_select at 0x7f9e17af9e50>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:24.616724 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-16ed219a-911c-4b33-ae0b-9a942a48a87c tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/7d970971-2987-4d5f-809f-030ba8c076ae" status: 200 len: 287 microversion: 2.1 time: 0.111723 Aug 07 01:23:24.630661 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1512/2791] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Aug 7 01:23:24 2022] GET /compute/v2.1/os-snapshots/7d970971-2987-4d5f-809f-030ba8c076ae => generated 287 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:24.643640 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-27ef6bdc-2c29-4bf4-9c7d-e3401ec174e0 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:24.644760 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-27ef6bdc-2c29-4bf4-9c7d-e3401ec174e0 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 51642c80-018a-4126-be66-97ced5cefece] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:24.667919 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27ef6bdc-2c29-4bf4-9c7d-e3401ec174e0 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:24.670083 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27ef6bdc-2c29-4bf4-9c7d-e3401ec174e0 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:24.672224 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27ef6bdc-2c29-4bf4-9c7d-e3401ec174e0 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:24.673231 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27ef6bdc-2c29-4bf4-9c7d-e3401ec174e0 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:24.675476 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27ef6bdc-2c29-4bf4-9c7d-e3401ec174e0 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:24.676184 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27ef6bdc-2c29-4bf4-9c7d-e3401ec174e0 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:24.809366 n-d-master-1 devstack@n-api.service[119517]: INFO nova.network.security_group_api [None req-72aca12e-e828-4695-9956-c70e3e0c8328 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Adding security group 13028388-ce18-4c5b-b7a7-e92a5448e811 to port 7eba9569-21b0-4b5d-be00-748d51cbc8ae Aug 07 01:23:25.123830 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-27ef6bdc-2c29-4bf4-9c7d-e3401ec174e0 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:25.127863 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:25.141039 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-27ef6bdc-2c29-4bf4-9c7d-e3401ec174e0 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece" status: 200 len: 1334 microversion: 2.1 time: 0.506191 Aug 07 01:23:25.142048 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1513/2792] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:24 2022] GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece => generated 1334 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:25.148347 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c6a1831c-fe82-4a7d-82cc-0fc57937dab5 tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] Calling method '.version_select at 0x7f9e245b7e50>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:25.269399 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c6a1831c-fe82-4a7d-82cc-0fc57937dab5 tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] 10.222.0.39 "DELETE /compute/v2.1/os-snapshots/7d970971-2987-4d5f-809f-030ba8c076ae" status: 202 len: 0 microversion: 2.1 time: 0.126012 Aug 07 01:23:25.270619 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1514/2793] 10.222.0.39 () {58 vars in 1254 bytes} [Sun Aug 7 01:23:25 2022] DELETE /compute/v2.1/os-snapshots/7d970971-2987-4d5f-809f-030ba8c076ae => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:23:25.278966 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-146669a2-38cf-414c-b4c3-006ec58521f0 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:25.284498 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-146669a2-38cf-414c-b4c3-006ec58521f0 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:25.302078 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-146669a2-38cf-414c-b4c3-006ec58521f0 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:25.306574 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-146669a2-38cf-414c-b4c3-006ec58521f0 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:25.307073 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-146669a2-38cf-414c-b4c3-006ec58521f0 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:25.307839 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-146669a2-38cf-414c-b4c3-006ec58521f0 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:25.308505 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-146669a2-38cf-414c-b4c3-006ec58521f0 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:25.310921 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-146669a2-38cf-414c-b4c3-006ec58521f0 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:25.569577 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-146669a2-38cf-414c-b4c3-006ec58521f0 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:25.595542 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-146669a2-38cf-414c-b4c3-006ec58521f0 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:25.597110 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-146669a2-38cf-414c-b4c3-006ec58521f0 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:25.598332 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-146669a2-38cf-414c-b4c3-006ec58521f0 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1486 microversion: 2.25 time: 0.326226 Aug 07 01:23:25.598901 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1515/2794] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:25 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1486 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:23:25.632786 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-282c8129-1a2b-4c75-b091-83cf460008a8 req-c81e34f2-3ec0-45e3-a9a8-a61b1497a446 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bbf0611-5a3b-4fec-a722-c07a08d09b26", "tag": "5c645525-cb30-401a-9b09-abfcb2929409"}, {"name": "network-changed", "server_uuid": "536a25a5-29bc-447e-9cf6-81b2db1ec700", "tag": "b4a97479-abbd-4e8a-b47c-ebf03a104d41"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:25.670830 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-282c8129-1a2b-4c75-b091-83cf460008a8 req-c81e34f2-3ec0-45e3-a9a8-a61b1497a446 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:25.673574 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-282c8129-1a2b-4c75-b091-83cf460008a8 req-c81e34f2-3ec0-45e3-a9a8-a61b1497a446 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:25.676860 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-282c8129-1a2b-4c75-b091-83cf460008a8 req-c81e34f2-3ec0-45e3-a9a8-a61b1497a446 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:25.719513 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-282c8129-1a2b-4c75-b091-83cf460008a8 req-c81e34f2-3ec0-45e3-a9a8-a61b1497a446 service nova] Creating event network-changed:5c645525-cb30-401a-9b09-abfcb2929409 for instance 8bbf0611-5a3b-4fec-a722-c07a08d09b26 on n-h1-master-1 Aug 07 01:23:25.722567 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-282c8129-1a2b-4c75-b091-83cf460008a8 req-c81e34f2-3ec0-45e3-a9a8-a61b1497a446 service nova] Creating event network-changed:b4a97479-abbd-4e8a-b47c-ebf03a104d41 for instance 536a25a5-29bc-447e-9cf6-81b2db1ec700 on n-h2-master-1 Aug 07 01:23:25.746982 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-282c8129-1a2b-4c75-b091-83cf460008a8 req-c81e34f2-3ec0-45e3-a9a8-a61b1497a446 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.117810 Aug 07 01:23:25.751808 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1516/2795] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:25.757414 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a5638fbb-14c9-44ac-bd20-f91758d12e4e tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] Calling method '.version_select at 0x7f9e17a628b0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:25.836140 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a5638fbb-14c9-44ac-bd20-f91758d12e4e tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/7d970971-2987-4d5f-809f-030ba8c076ae" status: 200 len: 286 microversion: 2.1 time: 0.082889 Aug 07 01:23:25.838315 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1517/2796] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Aug 7 01:23:25 2022] GET /compute/v2.1/os-snapshots/7d970971-2987-4d5f-809f-030ba8c076ae => generated 286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:25.861928 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-edc02487-b731-461f-bc58-add4e079a6e8 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:25.862680 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-edc02487-b731-461f-bc58-add4e079a6e8 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] [instance: 9399abef-0bdd-46db-9718-78e074738d1b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:25.888128 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-edc02487-b731-461f-bc58-add4e079a6e8 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:25.888631 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-edc02487-b731-461f-bc58-add4e079a6e8 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:25.889075 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-edc02487-b731-461f-bc58-add4e079a6e8 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:25.896429 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-edc02487-b731-461f-bc58-add4e079a6e8 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:25.900134 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-edc02487-b731-461f-bc58-add4e079a6e8 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:25.900674 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-edc02487-b731-461f-bc58-add4e079a6e8 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:26.068268 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-72aca12e-e828-4695-9956-c70e3e0c8328 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "POST /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43/action" status: 202 len: 0 microversion: 2.1 time: 2.147868 Aug 07 01:23:26.072742 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1280/2797] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:23:23 2022] POST /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43/action => generated 0 bytes in 2153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:23:26.079297 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7fc0f617-2bd7-4ea8-9d26-9307a4879110 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-453505490", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "38e7289f-8c36-40c7-bc8a-a94f77b67d92"}], "security_groups": [{"name": "tempest-securitygroup--75438223"}], "key_name": "tempest-keypair-514522053", "user_data": "}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:26.311053 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-edc02487-b731-461f-bc58-add4e079a6e8 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07a75cbb3d8a4b4baa361b0444c2370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7056cca1edc4e60a51a98237d187857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:26.326722 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-edc02487-b731-461f-bc58-add4e079a6e8 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] 10.222.0.39 "GET /compute/v2.1/servers/9399abef-0bdd-46db-9718-78e074738d1b" status: 200 len: 1325 microversion: 2.1 time: 0.485850 Aug 07 01:23:26.345800 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1518/2798] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:25 2022] GET /compute/v2.1/servers/9399abef-0bdd-46db-9718-78e074738d1b => generated 1325 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:26.495243 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-24991791-f235-4702-9353-21b43498758d tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1258487168", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "c33bc911-16cd-416b-9f90-ec30c465d3ab"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:26.587768 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-7fc0f617-2bd7-4ea8-9d26-9307a4879110 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] validate_networks() for [('38e7289f-8c36-40c7-bc8a-a94f77b67d92', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:23:26.600472 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-24991791-f235-4702-9353-21b43498758d tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] validate_networks() for [('c33bc911-16cd-416b-9f90-ec30c465d3ab', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:23:27.913189 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-24991791-f235-4702-9353-21b43498758d tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:23:27.913743 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-24991791-f235-4702-9353-21b43498758d tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:23:27.914142 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-24991791-f235-4702-9353-21b43498758d tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:23:27.914768 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-24991791-f235-4702-9353-21b43498758d tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:23:27.916576 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-24991791-f235-4702-9353-21b43498758d tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:23:27.936535 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24991791-f235-4702-9353-21b43498758d tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:27.937877 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24991791-f235-4702-9353-21b43498758d tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:27.938537 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24991791-f235-4702-9353-21b43498758d tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:27.939790 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24991791-f235-4702-9353-21b43498758d tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:27.941325 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24991791-f235-4702-9353-21b43498758d tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:27.941988 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24991791-f235-4702-9353-21b43498758d tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:27.968414 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-24991791-f235-4702-9353-21b43498758d tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Getting quotas for project 4e24336f2ab84adda758d98cbb785888. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:23:27.977974 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-24991791-f235-4702-9353-21b43498758d tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Getting quotas for user 58a40e444e92495c917f58fbcec63c8c and project 4e24336f2ab84adda758d98cbb785888. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:23:27.994763 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-24991791-f235-4702-9353-21b43498758d tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:23:27.997842 n-d-master-1 devstack@n-api.service[119516]: WARNING nova.utils [None req-24991791-f235-4702-9353-21b43498758d tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1258487168 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-125848716 Aug 07 01:23:27.999430 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-24991791-f235-4702-9353-21b43498758d tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] [instance: 1239e799-ec72-41c7-a2d3-19f5aee58ed4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:23:28.067067 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-24991791-f235-4702-9353-21b43498758d tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.714530 Aug 07 01:23:28.073025 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1519/2799] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:23:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:23:28.084569 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7ff9bdce-1a18-4f5f-8402-8214208c4aea tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '.version_select at 0x7f9e179a6ee0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:28.352381 n-d-master-1 devstack@n-api.service[119516]: DEBUG neutronclient.v2_0.client [None req-7ff9bdce-1a18-4f5f-8402-8214208c4aea tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 13028388-ce18-4c5b-b7a7-e92a5448e811 in use.", "detail": ""}} {{(pid=119516) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 07 01:23:28.359402 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-7ff9bdce-1a18-4f5f-8402-8214208c4aea tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] HTTP exception thrown: Security Group 13028388-ce18-4c5b-b7a7-e92a5448e811 in use. Aug 07 01:23:28.359402 n-d-master-1 devstack@n-api.service[119516]: Neutron server returns request_ids: ['req-2e4bd055-023a-45a9-8cd1-4b708425e3ee'] Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7ff9bdce-1a18-4f5f-8402-8214208c4aea tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Request method failure captured: Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/os-security-groups/13028388-ce18-4c5b-b7a7-e92a5448e811 HTTP/1.1 Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xO08qP9itd1x7LkO549onPIQKYKrTn80RQpW5pCdeHaOqBQA0wDyajz8J-UALON-vNzJgXv0Ujib217Kc5O9bkWEANKCqcpJLGxO-2U8bRcRiaBsEe5TSczuDlBj3IZDQsdnYyQfIf9mOfj407D3QdxTi9cVsMgzz9HNwd9HVPDZu0 Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 791ad97e3c374d2d8494abc25b46a0bf Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_791ad97e3c374d2d8494abc25b46a0bf", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 791ad97e3c374d2d8494abc25b46a0bf Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-SecurityGroupsTestJSON-1082000213-project Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 51ab58be25a94cd6a59634e7c7cad158 Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-SecurityGroupsTestJSON-1082000213-project Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: exception: Security Group 13028388-ce18-4c5b-b7a7-e92a5448e811 in use. Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: Neutron server returns request_ids: ['req-2e4bd055-023a-45a9-8cd1-4b708425e3ee'] Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '13028388-ce18-4c5b-b7a7-e92a5448e811'} Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 07 01:23:28.370087 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 13028388-ce18-4c5b-b7a7-e92a5448e811 in use. Aug 07 01:23:28.374628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2e4bd055-023a-45a9-8cd1-4b708425e3ee'] Aug 07 01:23:28.374628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:28.374628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:28.374628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:28.374628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:28.374628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 07 01:23:28.374628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 07 01:23:28.374628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 07 01:23:28.374628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 07 01:23:28.374628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 13028388-ce18-4c5b-b7a7-e92a5448e811 in use. Aug 07 01:23:28.374628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2e4bd055-023a-45a9-8cd1-4b708425e3ee'] Aug 07 01:23:28.374628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:28.374628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:28.374628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:28.374628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:28.374628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:28.374628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:28.374628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:23:28.374628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:23:28.374628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:23:28.374628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:23:28.374628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:23:28.374628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:23:28.374628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 07 01:23:28.374628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 07 01:23:28.374628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 13028388-ce18-4c5b-b7a7-e92a5448e811 in use. Aug 07 01:23:28.374628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2e4bd055-023a-45a9-8cd1-4b708425e3ee'] Aug 07 01:23:28.374628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:28.374628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:28.374628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:28.374628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:28.374628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:28.374628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:28.374628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:23:28.374628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:23:28.374628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 13028388-ce18-4c5b-b7a7-e92a5448e811 in use. Aug 07 01:23:28.374628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2e4bd055-023a-45a9-8cd1-4b708425e3ee'] Aug 07 01:23:28.374628 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:28.382722 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7ff9bdce-1a18-4f5f-8402-8214208c4aea tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Returning 400 to user: Security Group 13028388-ce18-4c5b-b7a7-e92a5448e811 in use. Aug 07 01:23:28.382722 n-d-master-1 devstack@n-api.service[119516]: Neutron server returns request_ids: ['req-2e4bd055-023a-45a9-8cd1-4b708425e3ee'] {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:23:28.386370 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7ff9bdce-1a18-4f5f-8402-8214208c4aea tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/13028388-ce18-4c5b-b7a7-e92a5448e811" status: 400 len: 185 microversion: 2.1 time: 0.309573 Aug 07 01:23:28.390323 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1520/2800] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:23:28 2022] DELETE /compute/v2.1/os-security-groups/13028388-ce18-4c5b-b7a7-e92a5448e811 => generated 185 bytes in 315 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:23:28.403707 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-46b7959a-ca77-4918-bebc-7fb64b1382ef tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:28.404426 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-46b7959a-ca77-4918-bebc-7fb64b1382ef tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 51642c80-018a-4126-be66-97ced5cefece] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:28.417565 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-46b7959a-ca77-4918-bebc-7fb64b1382ef tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:28.418294 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-46b7959a-ca77-4918-bebc-7fb64b1382ef tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:28.418780 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-46b7959a-ca77-4918-bebc-7fb64b1382ef tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:28.419516 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-46b7959a-ca77-4918-bebc-7fb64b1382ef tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:28.420179 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-46b7959a-ca77-4918-bebc-7fb64b1382ef tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:28.420977 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-46b7959a-ca77-4918-bebc-7fb64b1382ef tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:28.563721 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-7fc0f617-2bd7-4ea8-9d26-9307a4879110 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:23:28.564821 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-7fc0f617-2bd7-4ea8-9d26-9307a4879110 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:23:28.565513 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-7fc0f617-2bd7-4ea8-9d26-9307a4879110 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:23:28.566090 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-7fc0f617-2bd7-4ea8-9d26-9307a4879110 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:23:28.566656 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-7fc0f617-2bd7-4ea8-9d26-9307a4879110 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:23:28.589667 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7fc0f617-2bd7-4ea8-9d26-9307a4879110 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:28.590374 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7fc0f617-2bd7-4ea8-9d26-9307a4879110 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:28.590858 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7fc0f617-2bd7-4ea8-9d26-9307a4879110 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:28.591746 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7fc0f617-2bd7-4ea8-9d26-9307a4879110 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:28.592269 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7fc0f617-2bd7-4ea8-9d26-9307a4879110 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:28.592703 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7fc0f617-2bd7-4ea8-9d26-9307a4879110 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:28.656906 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-7fc0f617-2bd7-4ea8-9d26-9307a4879110 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Getting quotas for project 939fea7fa6ea4deda8d4fbef70a4e510. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:23:28.672411 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-7fc0f617-2bd7-4ea8-9d26-9307a4879110 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Getting quotas for user ef29bd35cca547c39d76c54058d32979 and project 939fea7fa6ea4deda8d4fbef70a4e510. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:23:28.713781 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7fc0f617-2bd7-4ea8-9d26-9307a4879110 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:23:28.725046 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-46b7959a-ca77-4918-bebc-7fb64b1382ef tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:28.730888 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7fc0f617-2bd7-4ea8-9d26-9307a4879110 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:23:28.750927 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-46b7959a-ca77-4918-bebc-7fb64b1382ef tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece" status: 200 len: 1334 microversion: 2.1 time: 0.359036 Aug 07 01:23:28.761382 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1521/2801] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:28 2022] GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece => generated 1334 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:28.791146 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-efddfb17-bc75-469d-ad5a-09c2df668e1a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:28.792729 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-efddfb17-bc75-469d-ad5a-09c2df668e1a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:28.816873 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-efddfb17-bc75-469d-ad5a-09c2df668e1a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:28.817641 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-efddfb17-bc75-469d-ad5a-09c2df668e1a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:28.818308 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-efddfb17-bc75-469d-ad5a-09c2df668e1a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:28.819801 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-efddfb17-bc75-469d-ad5a-09c2df668e1a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:28.821653 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-efddfb17-bc75-469d-ad5a-09c2df668e1a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:28.823431 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-efddfb17-bc75-469d-ad5a-09c2df668e1a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:28.888836 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7fc0f617-2bd7-4ea8-9d26-9307a4879110 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.813905 Aug 07 01:23:28.896069 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1281/2802] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:23:26 2022] POST /compute/v2.1/servers => generated 407 bytes in 2822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:23:28.902972 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1316d75d-a5e9-47f2-aa5e-8dd97d4c65ee tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] Calling method '.version_select at 0x7f9e242d5040>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:28.958199 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-1316d75d-a5e9-47f2-aa5e-8dd97d4c65ee tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] HTTP exception thrown: Snapshot 7d970971-2987-4d5f-809f-030ba8c076ae could not be found. Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1316d75d-a5e9-47f2-aa5e-8dd97d4c65ee tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] Request method failure captured: Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/os-snapshots/7d970971-2987-4d5f-809f-030ba8c076ae HTTP/1.1 Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xQEIdaONFVpgUTf50ti9k27wugBhRKLHp_KBE9Hruz_3vJMoS8q4MpRkOHtrR8vjpGpbPZ8n-U463YE8rSylbmmwjNSZgHwuZv4K4j-M0rYyfMxK6pzMDGLzHoH66qfXNEEbMvgALUkR1jpdUuRhbljWVjV7q9RCv7sxve3RxeKsTw Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 3e033f826a784e72a57e827ab964c012 Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2040970473 Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3e033f826a784e72a57e827ab964c012"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3e033f826a784e72a57e827ab964c012", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3e033f826a784e72a57e827ab964c012"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3e033f826a784e72a57e827ab964c012"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2040970473 Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 3e033f826a784e72a57e827ab964c012 Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2040970473 Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-VolumesSnapshotsTestJSON-2040970473-project Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: bf6105148497448381fc2eb092a6eb94 Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2040970473-project Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: exception: Snapshot 7d970971-2987-4d5f-809f-030ba8c076ae could not be found. Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '7d970971-2987-4d5f-809f-030ba8c076ae'} Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 7d970971-2987-4d5f-809f-030ba8c076ae could not be found. (HTTP 404) (Request-ID: req-f37b9895-a579-445c-a2ff-f4846233aab5) Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 01:23:28.970011 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 7d970971-2987-4d5f-809f-030ba8c076ae could not be found. Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 7d970971-2987-4d5f-809f-030ba8c076ae could not be found. Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 7d970971-2987-4d5f-809f-030ba8c076ae could not be found. Aug 07 01:23:28.976843 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:28.982765 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1316d75d-a5e9-47f2-aa5e-8dd97d4c65ee tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] Returning 404 to user: Snapshot 7d970971-2987-4d5f-809f-030ba8c076ae could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:23:28.983174 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1316d75d-a5e9-47f2-aa5e-8dd97d4c65ee tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/7d970971-2987-4d5f-809f-030ba8c076ae" status: 404 len: 111 microversion: 2.1 time: 0.085318 Aug 07 01:23:28.986839 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1282/2803] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Aug 7 01:23:28 2022] GET /compute/v2.1/os-snapshots/7d970971-2987-4d5f-809f-030ba8c076ae => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:23:28.991805 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-ddd60d3f-ca31-4555-97dc-af0d8162bf50 req-4946dba4-2009-49ff-a949-7ba328f3c395 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9399abef-0bdd-46db-9718-78e074738d1b", "tag": "91424783-dd6f-4de0-8380-f80d8bfcba58"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:29.008608 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-ddd60d3f-ca31-4555-97dc-af0d8162bf50 req-4946dba4-2009-49ff-a949-7ba328f3c395 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:29.009360 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-ddd60d3f-ca31-4555-97dc-af0d8162bf50 req-4946dba4-2009-49ff-a949-7ba328f3c395 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:29.009986 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-ddd60d3f-ca31-4555-97dc-af0d8162bf50 req-4946dba4-2009-49ff-a949-7ba328f3c395 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:29.025773 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-ddd60d3f-ca31-4555-97dc-af0d8162bf50 req-4946dba4-2009-49ff-a949-7ba328f3c395 service nova] Creating event network-changed:91424783-dd6f-4de0-8380-f80d8bfcba58 for instance 9399abef-0bdd-46db-9718-78e074738d1b on n-h1-master-1 Aug 07 01:23:29.033679 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-ddd60d3f-ca31-4555-97dc-af0d8162bf50 req-4946dba4-2009-49ff-a949-7ba328f3c395 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044739 Aug 07 01:23:29.034863 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1283/2804] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:29.045857 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-726ba7ba-9be5-4e69-aea3-d454e34ea911 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:29.046398 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-726ba7ba-9be5-4e69-aea3-d454e34ea911 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] [instance: 9399abef-0bdd-46db-9718-78e074738d1b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:29.060239 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-726ba7ba-9be5-4e69-aea3-d454e34ea911 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:29.061197 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-726ba7ba-9be5-4e69-aea3-d454e34ea911 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:29.061806 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-726ba7ba-9be5-4e69-aea3-d454e34ea911 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:29.062919 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-726ba7ba-9be5-4e69-aea3-d454e34ea911 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:29.063610 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-726ba7ba-9be5-4e69-aea3-d454e34ea911 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:29.064748 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-726ba7ba-9be5-4e69-aea3-d454e34ea911 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:29.293038 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-efddfb17-bc75-469d-ad5a-09c2df668e1a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:29.310470 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-efddfb17-bc75-469d-ad5a-09c2df668e1a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:29.318091 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-efddfb17-bc75-469d-ad5a-09c2df668e1a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:29.322961 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-efddfb17-bc75-469d-ad5a-09c2df668e1a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1486 microversion: 2.25 time: 0.543884 Aug 07 01:23:29.324581 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1522/2805] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:28 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1486 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:23:29.342579 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-ed4bc0d0-094e-4bb6-8990-ffc5179eed59 req-e6675cda-2f6d-45f7-9628-86bf5f6fd912 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b8441a7-9091-4b45-ac29-9023f2a6bc43", "tag": "7eba9569-21b0-4b5d-be00-748d51cbc8ae"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:29.375682 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-ed4bc0d0-094e-4bb6-8990-ffc5179eed59 req-e6675cda-2f6d-45f7-9628-86bf5f6fd912 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:29.376451 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-ed4bc0d0-094e-4bb6-8990-ffc5179eed59 req-e6675cda-2f6d-45f7-9628-86bf5f6fd912 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:29.377069 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-ed4bc0d0-094e-4bb6-8990-ffc5179eed59 req-e6675cda-2f6d-45f7-9628-86bf5f6fd912 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:29.404753 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-ed4bc0d0-094e-4bb6-8990-ffc5179eed59 req-e6675cda-2f6d-45f7-9628-86bf5f6fd912 service nova] Creating event network-changed:7eba9569-21b0-4b5d-be00-748d51cbc8ae for instance 0b8441a7-9091-4b45-ac29-9023f2a6bc43 on n-h1-master-1 Aug 07 01:23:29.412511 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-726ba7ba-9be5-4e69-aea3-d454e34ea911 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07a75cbb3d8a4b4baa361b0444c2370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7056cca1edc4e60a51a98237d187857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:29.420155 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-ed4bc0d0-094e-4bb6-8990-ffc5179eed59 req-e6675cda-2f6d-45f7-9628-86bf5f6fd912 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092338 Aug 07 01:23:29.422999 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1523/2806] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:29.440462 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ec5cb1eb-1e33-47fb-afe4-a9a207dd5813 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:29.442549 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-726ba7ba-9be5-4e69-aea3-d454e34ea911 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] 10.222.0.39 "GET /compute/v2.1/servers/9399abef-0bdd-46db-9718-78e074738d1b" status: 200 len: 1325 microversion: 2.1 time: 0.405056 Aug 07 01:23:29.443291 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ec5cb1eb-1e33-47fb-afe4-a9a207dd5813 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] [instance: 1239e799-ec72-41c7-a2d3-19f5aee58ed4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:29.448356 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1284/2807] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:29 2022] GET /compute/v2.1/servers/9399abef-0bdd-46db-9718-78e074738d1b => generated 1325 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:29.459812 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec5cb1eb-1e33-47fb-afe4-a9a207dd5813 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:29.461087 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec5cb1eb-1e33-47fb-afe4-a9a207dd5813 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:29.461980 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec5cb1eb-1e33-47fb-afe4-a9a207dd5813 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:29.465566 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c3010327-2019-4f61-a622-d70702bb826a tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:29.466065 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec5cb1eb-1e33-47fb-afe4-a9a207dd5813 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:29.468318 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec5cb1eb-1e33-47fb-afe4-a9a207dd5813 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:29.469766 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec5cb1eb-1e33-47fb-afe4-a9a207dd5813 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:29.470962 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c3010327-2019-4f61-a622-d70702bb826a tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 0b8441a7-9091-4b45-ac29-9023f2a6bc43] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:29.499044 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3010327-2019-4f61-a622-d70702bb826a tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:29.500120 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3010327-2019-4f61-a622-d70702bb826a tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:29.507360 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3010327-2019-4f61-a622-d70702bb826a tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:29.508978 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3010327-2019-4f61-a622-d70702bb826a tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:29.511673 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3010327-2019-4f61-a622-d70702bb826a tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:29.513682 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3010327-2019-4f61-a622-d70702bb826a tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:29.602509 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ec5cb1eb-1e33-47fb-afe4-a9a207dd5813 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a40e444e92495c917f58fbcec63c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e24336f2ab84adda758d98cbb785888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:29.623012 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ec5cb1eb-1e33-47fb-afe4-a9a207dd5813 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] 10.222.0.39 "GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4" status: 200 len: 1236 microversion: 2.1 time: 0.194113 Aug 07 01:23:29.639624 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1524/2808] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:29 2022] GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4 => generated 1236 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:29.649757 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cc075e69-c491-4c39-9499-bb239784d4c2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:29.650997 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cc075e69-c491-4c39-9499-bb239784d4c2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:29.716333 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cc075e69-c491-4c39-9499-bb239784d4c2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:29.720091 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c3010327-2019-4f61-a622-d70702bb826a tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "POST /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43/action" status: 202 len: 0 microversion: 2.1 time: 0.263587 Aug 07 01:23:29.723227 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1285/2809] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:23:29 2022] POST /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:23:29.728711 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cc075e69-c491-4c39-9499-bb239784d4c2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1237 microversion: 2.1 time: 0.086792 Aug 07 01:23:29.743458 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-949cfb25-75a8-4e95-bf3d-f6cbbe5e8c2b tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] Calling method '.version_select at 0x7f9e240ff8b0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:29.745955 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1525/2810] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:29 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1237 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:29.751533 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b27403c3-e575-4ac6-8f2b-dc8526e7db12 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:29.755110 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b27403c3-e575-4ac6-8f2b-dc8526e7db12 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 0b8441a7-9091-4b45-ac29-9023f2a6bc43] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:29.793081 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b27403c3-e575-4ac6-8f2b-dc8526e7db12 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:29.798115 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b27403c3-e575-4ac6-8f2b-dc8526e7db12 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:29.800330 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b27403c3-e575-4ac6-8f2b-dc8526e7db12 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:29.803238 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b27403c3-e575-4ac6-8f2b-dc8526e7db12 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:29.806767 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b27403c3-e575-4ac6-8f2b-dc8526e7db12 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:29.815005 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b27403c3-e575-4ac6-8f2b-dc8526e7db12 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:29.884066 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-949cfb25-75a8-4e95-bf3d-f6cbbe5e8c2b tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/70cac16f-43e5-400f-89f3-ecc0bf63f806" status: 202 len: 0 microversion: 2.1 time: 0.158844 Aug 07 01:23:29.886685 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1286/2811] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Aug 7 01:23:29 2022] DELETE /compute/v2.1/os-volumes/70cac16f-43e5-400f-89f3-ecc0bf63f806 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:23:29.899759 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c70a1233-0083-43e9-abc4-3010a72710bc tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:29.900679 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c70a1233-0083-43e9-abc4-3010a72710bc tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 51642c80-018a-4126-be66-97ced5cefece] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:29.922195 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c70a1233-0083-43e9-abc4-3010a72710bc tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:29.925013 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c70a1233-0083-43e9-abc4-3010a72710bc tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:29.925932 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c70a1233-0083-43e9-abc4-3010a72710bc tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:29.927131 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c70a1233-0083-43e9-abc4-3010a72710bc tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:29.932493 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c70a1233-0083-43e9-abc4-3010a72710bc tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:29.933417 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c70a1233-0083-43e9-abc4-3010a72710bc tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:30.408334 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b27403c3-e575-4ac6-8f2b-dc8526e7db12 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab58be25a94cd6a59634e7c7cad158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791ad97e3c374d2d8494abc25b46a0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:30.424357 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b27403c3-e575-4ac6-8f2b-dc8526e7db12 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43" status: 200 len: 1574 microversion: 2.1 time: 0.676851 Aug 07 01:23:30.424964 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1526/2812] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:29 2022] GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43 => generated 1574 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:30.445355 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bb8bd22c-56fe-48d8-a9b9-3bcc69e20f74 tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] Calling method '.version_select at 0x7f9e17a62310>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:30.605858 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bb8bd22c-56fe-48d8-a9b9-3bcc69e20f74 tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/70cac16f-43e5-400f-89f3-ecc0bf63f806" status: 200 len: 344 microversion: 2.1 time: 0.179644 Aug 07 01:23:30.607005 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1527/2813] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Aug 7 01:23:30 2022] GET /compute/v2.1/os-volumes/70cac16f-43e5-400f-89f3-ecc0bf63f806 => generated 344 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:30.616711 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4c9adb32-6c88-48e9-beb0-ee85653a8f77 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:30.617545 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4c9adb32-6c88-48e9-beb0-ee85653a8f77 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:30.631464 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c9adb32-6c88-48e9-beb0-ee85653a8f77 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:30.642301 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c9adb32-6c88-48e9-beb0-ee85653a8f77 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:30.646493 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c9adb32-6c88-48e9-beb0-ee85653a8f77 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:30.648425 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c9adb32-6c88-48e9-beb0-ee85653a8f77 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:30.663237 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c9adb32-6c88-48e9-beb0-ee85653a8f77 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:30.663869 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c9adb32-6c88-48e9-beb0-ee85653a8f77 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:31.150936 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c70a1233-0083-43e9-abc4-3010a72710bc tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:31.169552 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c70a1233-0083-43e9-abc4-3010a72710bc tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece" status: 200 len: 1334 microversion: 2.1 time: 1.281679 Aug 07 01:23:31.170152 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1287/2814] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:29 2022] GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece => generated 1334 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:31.207263 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7ca787a1-0aee-4cdf-a49b-7f7af4499060 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:31.208228 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7ca787a1-0aee-4cdf-a49b-7f7af4499060 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] [instance: 9399abef-0bdd-46db-9718-78e074738d1b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:31.233190 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ca787a1-0aee-4cdf-a49b-7f7af4499060 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:31.238421 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ca787a1-0aee-4cdf-a49b-7f7af4499060 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:31.246121 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ca787a1-0aee-4cdf-a49b-7f7af4499060 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:31.249930 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ca787a1-0aee-4cdf-a49b-7f7af4499060 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:31.250656 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ca787a1-0aee-4cdf-a49b-7f7af4499060 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:31.253482 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ca787a1-0aee-4cdf-a49b-7f7af4499060 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:31.545030 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4c9adb32-6c88-48e9-beb0-ee85653a8f77 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:31.569310 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4c9adb32-6c88-48e9-beb0-ee85653a8f77 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:31.572605 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4c9adb32-6c88-48e9-beb0-ee85653a8f77 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:31.577479 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4c9adb32-6c88-48e9-beb0-ee85653a8f77 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1486 microversion: 2.25 time: 0.968057 Aug 07 01:23:31.578253 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1528/2815] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:30 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1486 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:23:31.594521 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0345d21f-1c15-4050-b2b8-a36c76eceaa7 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:31.595866 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0345d21f-1c15-4050-b2b8-a36c76eceaa7 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] [instance: 1239e799-ec72-41c7-a2d3-19f5aee58ed4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:31.628466 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0345d21f-1c15-4050-b2b8-a36c76eceaa7 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:31.646321 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0345d21f-1c15-4050-b2b8-a36c76eceaa7 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:31.647025 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0345d21f-1c15-4050-b2b8-a36c76eceaa7 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:31.649472 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0345d21f-1c15-4050-b2b8-a36c76eceaa7 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:31.652678 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0345d21f-1c15-4050-b2b8-a36c76eceaa7 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:31.653459 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0345d21f-1c15-4050-b2b8-a36c76eceaa7 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:32.127673 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0345d21f-1c15-4050-b2b8-a36c76eceaa7 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a40e444e92495c917f58fbcec63c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e24336f2ab84adda758d98cbb785888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:32.144205 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0345d21f-1c15-4050-b2b8-a36c76eceaa7 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] 10.222.0.39 "GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4" status: 200 len: 1290 microversion: 2.1 time: 0.562540 Aug 07 01:23:32.146996 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1529/2816] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:31 2022] GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4 => generated 1290 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:32.158723 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-91b47bb7-ffb2-40eb-917b-4b80079ce270 req-891409c5-b0ab-4ef3-a85a-d2e45f72d82f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51642c80-018a-4126-be66-97ced5cefece", "name": "network-vif-plugged", "status": "completed", "tag": "90b7e8fd-564b-468f-8889-a0388488ce36"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:32.186118 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-91b47bb7-ffb2-40eb-917b-4b80079ce270 req-891409c5-b0ab-4ef3-a85a-d2e45f72d82f service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:32.187648 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-91b47bb7-ffb2-40eb-917b-4b80079ce270 req-891409c5-b0ab-4ef3-a85a-d2e45f72d82f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:32.190229 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-91b47bb7-ffb2-40eb-917b-4b80079ce270 req-891409c5-b0ab-4ef3-a85a-d2e45f72d82f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:32.220627 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-91b47bb7-ffb2-40eb-917b-4b80079ce270 req-891409c5-b0ab-4ef3-a85a-d2e45f72d82f service nova] Creating event network-vif-plugged:90b7e8fd-564b-468f-8889-a0388488ce36 for instance 51642c80-018a-4126-be66-97ced5cefece on n-h2-master-1 Aug 07 01:23:32.240839 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-91b47bb7-ffb2-40eb-917b-4b80079ce270 req-891409c5-b0ab-4ef3-a85a-d2e45f72d82f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088385 Aug 07 01:23:32.244685 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1530/2817] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:32.257360 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5db94c52-0c72-4aa6-b0b7-a4aac7311ddb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:32.261216 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5db94c52-0c72-4aa6-b0b7-a4aac7311ddb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:32.277253 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5db94c52-0c72-4aa6-b0b7-a4aac7311ddb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:32.277763 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5db94c52-0c72-4aa6-b0b7-a4aac7311ddb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:32.278211 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5db94c52-0c72-4aa6-b0b7-a4aac7311ddb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:32.281548 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5db94c52-0c72-4aa6-b0b7-a4aac7311ddb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:32.282031 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5db94c52-0c72-4aa6-b0b7-a4aac7311ddb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:32.285165 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5db94c52-0c72-4aa6-b0b7-a4aac7311ddb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:32.329154 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7ca787a1-0aee-4cdf-a49b-7f7af4499060 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07a75cbb3d8a4b4baa361b0444c2370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7056cca1edc4e60a51a98237d187857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:32.342713 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7ca787a1-0aee-4cdf-a49b-7f7af4499060 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] 10.222.0.39 "GET /compute/v2.1/servers/9399abef-0bdd-46db-9718-78e074738d1b" status: 200 len: 1325 microversion: 2.1 time: 1.166736 Aug 07 01:23:32.343305 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1288/2818] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:31 2022] GET /compute/v2.1/servers/9399abef-0bdd-46db-9718-78e074738d1b => generated 1325 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:32.357158 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-61b714de-61da-40ef-b84b-3941b5bcecda tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:32.367319 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-61b714de-61da-40ef-b84b-3941b5bcecda tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 0b8441a7-9091-4b45-ac29-9023f2a6bc43] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:32.389520 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-61b714de-61da-40ef-b84b-3941b5bcecda tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:32.390297 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-61b714de-61da-40ef-b84b-3941b5bcecda tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:32.390887 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-61b714de-61da-40ef-b84b-3941b5bcecda tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:32.391764 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-61b714de-61da-40ef-b84b-3941b5bcecda tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:32.392461 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-61b714de-61da-40ef-b84b-3941b5bcecda tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:32.393040 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-61b714de-61da-40ef-b84b-3941b5bcecda tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:32.463328 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5db94c52-0c72-4aa6-b0b7-a4aac7311ddb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:32.475216 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5db94c52-0c72-4aa6-b0b7-a4aac7311ddb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1295 microversion: 2.1 time: 0.228951 Aug 07 01:23:32.480362 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1531/2819] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:32 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1295 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:32.492440 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c91be601-2ec0-4187-9016-4b5aae8af7c6 tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] Calling method '.version_select at 0x7f9e243d6790>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:32.637609 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c91be601-2ec0-4187-9016-4b5aae8af7c6 tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/70cac16f-43e5-400f-89f3-ecc0bf63f806" status: 200 len: 344 microversion: 2.1 time: 0.154936 Aug 07 01:23:32.638774 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1532/2820] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Aug 7 01:23:32 2022] GET /compute/v2.1/os-volumes/70cac16f-43e5-400f-89f3-ecc0bf63f806 => generated 344 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:32.652003 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1470818e-b3c3-4a5b-9b04-33a83a319682 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:32.652659 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1470818e-b3c3-4a5b-9b04-33a83a319682 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 51642c80-018a-4126-be66-97ced5cefece] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:32.690294 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1470818e-b3c3-4a5b-9b04-33a83a319682 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:32.690962 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1470818e-b3c3-4a5b-9b04-33a83a319682 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:32.691428 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1470818e-b3c3-4a5b-9b04-33a83a319682 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:32.692233 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1470818e-b3c3-4a5b-9b04-33a83a319682 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:32.696790 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1470818e-b3c3-4a5b-9b04-33a83a319682 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:32.697867 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1470818e-b3c3-4a5b-9b04-33a83a319682 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:33.454261 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-61b714de-61da-40ef-b84b-3941b5bcecda tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab58be25a94cd6a59634e7c7cad158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791ad97e3c374d2d8494abc25b46a0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:33.464493 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-61b714de-61da-40ef-b84b-3941b5bcecda tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43" status: 200 len: 1574 microversion: 2.1 time: 1.111225 Aug 07 01:23:33.470830 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1289/2821] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:32 2022] GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43 => generated 1574 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:33.476218 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e305c120-e4ed-46c8-a41b-198c43223719 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:33.476852 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e305c120-e4ed-46c8-a41b-198c43223719 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:33.496346 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e305c120-e4ed-46c8-a41b-198c43223719 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:33.496845 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e305c120-e4ed-46c8-a41b-198c43223719 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:33.497283 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e305c120-e4ed-46c8-a41b-198c43223719 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:33.497999 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e305c120-e4ed-46c8-a41b-198c43223719 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:33.498449 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e305c120-e4ed-46c8-a41b-198c43223719 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:33.498872 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e305c120-e4ed-46c8-a41b-198c43223719 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:33.518026 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1470818e-b3c3-4a5b-9b04-33a83a319682 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:33.536508 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1470818e-b3c3-4a5b-9b04-33a83a319682 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece" status: 200 len: 1334 microversion: 2.1 time: 0.886469 Aug 07 01:23:33.552164 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1533/2822] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:32 2022] GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece => generated 1334 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:33.570064 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bc83262c-063e-448b-9824-562e131d39bb tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:33.571051 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bc83262c-063e-448b-9824-562e131d39bb tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] [instance: 1239e799-ec72-41c7-a2d3-19f5aee58ed4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:33.590321 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bc83262c-063e-448b-9824-562e131d39bb tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:33.591146 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bc83262c-063e-448b-9824-562e131d39bb tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:33.591975 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bc83262c-063e-448b-9824-562e131d39bb tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:33.595803 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bc83262c-063e-448b-9824-562e131d39bb tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:33.596683 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bc83262c-063e-448b-9824-562e131d39bb tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:33.598939 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bc83262c-063e-448b-9824-562e131d39bb tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:33.905757 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e305c120-e4ed-46c8-a41b-198c43223719 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:33.926002 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e305c120-e4ed-46c8-a41b-198c43223719 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:33.934315 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e305c120-e4ed-46c8-a41b-198c43223719 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:33.935572 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e305c120-e4ed-46c8-a41b-198c43223719 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1486 microversion: 2.25 time: 0.463591 Aug 07 01:23:33.936168 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1290/2823] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:33 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1486 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:23:33.960972 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8a15d2d0-7f26-4dd1-8acd-77b0c7dc0a6a tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:33.973301 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8a15d2d0-7f26-4dd1-8acd-77b0c7dc0a6a tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] [instance: 9399abef-0bdd-46db-9718-78e074738d1b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:33.989822 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a15d2d0-7f26-4dd1-8acd-77b0c7dc0a6a tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:33.990327 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a15d2d0-7f26-4dd1-8acd-77b0c7dc0a6a tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:33.990778 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a15d2d0-7f26-4dd1-8acd-77b0c7dc0a6a tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:33.991510 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a15d2d0-7f26-4dd1-8acd-77b0c7dc0a6a tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:33.992174 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a15d2d0-7f26-4dd1-8acd-77b0c7dc0a6a tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:33.995074 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a15d2d0-7f26-4dd1-8acd-77b0c7dc0a6a tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:34.026469 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bc83262c-063e-448b-9824-562e131d39bb tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a40e444e92495c917f58fbcec63c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e24336f2ab84adda758d98cbb785888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:34.048540 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bc83262c-063e-448b-9824-562e131d39bb tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] 10.222.0.39 "GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4" status: 200 len: 1332 microversion: 2.1 time: 0.494276 Aug 07 01:23:34.049749 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1534/2824] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:33 2022] GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4 => generated 1332 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:34.054725 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9e8581dc-6867-4611-835e-25163288c9d7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:34.055568 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9e8581dc-6867-4611-835e-25163288c9d7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:34.069527 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e8581dc-6867-4611-835e-25163288c9d7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:34.073080 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e8581dc-6867-4611-835e-25163288c9d7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:34.073778 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e8581dc-6867-4611-835e-25163288c9d7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:34.074692 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e8581dc-6867-4611-835e-25163288c9d7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:34.075311 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e8581dc-6867-4611-835e-25163288c9d7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:34.076855 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e8581dc-6867-4611-835e-25163288c9d7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:34.190540 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9e8581dc-6867-4611-835e-25163288c9d7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:34.207824 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9e8581dc-6867-4611-835e-25163288c9d7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1295 microversion: 2.1 time: 0.156355 Aug 07 01:23:34.208484 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1535/2825] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:34 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1295 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:34.219990 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7aa8d90d-c33f-47a6-9bbe-53138c825092 tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] Calling method '.version_select at 0x7f9e299790d0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:34.325134 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7aa8d90d-c33f-47a6-9bbe-53138c825092 tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/70cac16f-43e5-400f-89f3-ecc0bf63f806" status: 200 len: 344 microversion: 2.1 time: 0.115446 Aug 07 01:23:34.326127 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1536/2826] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Aug 7 01:23:34 2022] GET /compute/v2.1/os-volumes/70cac16f-43e5-400f-89f3-ecc0bf63f806 => generated 344 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:34.331200 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-388838ce-e2fa-4176-87d7-4fa481ab2f5e req-c5bf06a1-c7f3-43f1-ae52-91aacd6badea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51642c80-018a-4126-be66-97ced5cefece", "name": "network-vif-plugged", "status": "completed", "tag": "d02958b8-9820-4614-b86f-bfba455a3d18"}, {"server_uuid": "9399abef-0bdd-46db-9718-78e074738d1b", "name": "network-vif-plugged", "status": "completed", "tag": "91424783-dd6f-4de0-8380-f80d8bfcba58"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:34.344934 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-388838ce-e2fa-4176-87d7-4fa481ab2f5e req-c5bf06a1-c7f3-43f1-ae52-91aacd6badea service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:34.346603 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-388838ce-e2fa-4176-87d7-4fa481ab2f5e req-c5bf06a1-c7f3-43f1-ae52-91aacd6badea service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:34.347315 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-388838ce-e2fa-4176-87d7-4fa481ab2f5e req-c5bf06a1-c7f3-43f1-ae52-91aacd6badea service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:34.367517 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-388838ce-e2fa-4176-87d7-4fa481ab2f5e req-c5bf06a1-c7f3-43f1-ae52-91aacd6badea service nova] Creating event network-vif-plugged:d02958b8-9820-4614-b86f-bfba455a3d18 for instance 51642c80-018a-4126-be66-97ced5cefece on n-h2-master-1 Aug 07 01:23:34.368231 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-388838ce-e2fa-4176-87d7-4fa481ab2f5e req-c5bf06a1-c7f3-43f1-ae52-91aacd6badea service nova] Creating event network-vif-plugged:91424783-dd6f-4de0-8380-f80d8bfcba58 for instance 9399abef-0bdd-46db-9718-78e074738d1b on n-h1-master-1 Aug 07 01:23:34.379110 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-388838ce-e2fa-4176-87d7-4fa481ab2f5e req-c5bf06a1-c7f3-43f1-ae52-91aacd6badea service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.051344 Aug 07 01:23:34.379918 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1537/2827] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:34.495435 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f36462dc-34db-49a4-8eff-5b4f22322b58 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:34.496225 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f36462dc-34db-49a4-8eff-5b4f22322b58 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 0b8441a7-9091-4b45-ac29-9023f2a6bc43] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:34.509587 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f36462dc-34db-49a4-8eff-5b4f22322b58 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:34.511095 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f36462dc-34db-49a4-8eff-5b4f22322b58 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:34.512115 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f36462dc-34db-49a4-8eff-5b4f22322b58 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:34.513342 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f36462dc-34db-49a4-8eff-5b4f22322b58 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:34.514203 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f36462dc-34db-49a4-8eff-5b4f22322b58 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:34.514972 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f36462dc-34db-49a4-8eff-5b4f22322b58 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:34.756762 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f36462dc-34db-49a4-8eff-5b4f22322b58 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab58be25a94cd6a59634e7c7cad158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791ad97e3c374d2d8494abc25b46a0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:34.766497 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f36462dc-34db-49a4-8eff-5b4f22322b58 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43" status: 200 len: 1579 microversion: 2.1 time: 0.276119 Aug 07 01:23:34.784120 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1538/2828] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:34 2022] GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43 => generated 1579 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:23:34.787440 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8a15d2d0-7f26-4dd1-8acd-77b0c7dc0a6a tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07a75cbb3d8a4b4baa361b0444c2370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7056cca1edc4e60a51a98237d187857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:34.796883 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fc8af9c3-eec2-4792-9339-7608435c3a01 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:34.797520 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fc8af9c3-eec2-4792-9339-7608435c3a01 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 51642c80-018a-4126-be66-97ced5cefece] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:34.803169 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8a15d2d0-7f26-4dd1-8acd-77b0c7dc0a6a tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] 10.222.0.39 "GET /compute/v2.1/servers/9399abef-0bdd-46db-9718-78e074738d1b" status: 200 len: 1325 microversion: 2.1 time: 0.858381 Aug 07 01:23:34.805365 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1291/2829] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:33 2022] GET /compute/v2.1/servers/9399abef-0bdd-46db-9718-78e074738d1b => generated 1325 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:34.824351 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc8af9c3-eec2-4792-9339-7608435c3a01 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:34.824836 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc8af9c3-eec2-4792-9339-7608435c3a01 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:34.825286 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc8af9c3-eec2-4792-9339-7608435c3a01 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:34.826006 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc8af9c3-eec2-4792-9339-7608435c3a01 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:34.826464 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc8af9c3-eec2-4792-9339-7608435c3a01 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:34.826895 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc8af9c3-eec2-4792-9339-7608435c3a01 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:34.968389 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ac4194b6-178b-4de8-acd4-ccd9577c5941 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:34.973419 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ac4194b6-178b-4de8-acd4-ccd9577c5941 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:35.004183 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ac4194b6-178b-4de8-acd4-ccd9577c5941 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:35.005399 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ac4194b6-178b-4de8-acd4-ccd9577c5941 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:35.006838 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ac4194b6-178b-4de8-acd4-ccd9577c5941 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:35.007902 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ac4194b6-178b-4de8-acd4-ccd9577c5941 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:35.012563 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ac4194b6-178b-4de8-acd4-ccd9577c5941 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:35.014282 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ac4194b6-178b-4de8-acd4-ccd9577c5941 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:35.135353 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fc8af9c3-eec2-4792-9339-7608435c3a01 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:35.144725 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fc8af9c3-eec2-4792-9339-7608435c3a01 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece" status: 200 len: 1334 microversion: 2.1 time: 0.359248 Aug 07 01:23:35.145442 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1539/2830] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:34 2022] GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece => generated 1334 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:35.152654 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3249d142-23ed-40cd-82fa-c074f43045c9 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:35.153457 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3249d142-23ed-40cd-82fa-c074f43045c9 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] [instance: 1239e799-ec72-41c7-a2d3-19f5aee58ed4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:35.160862 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3249d142-23ed-40cd-82fa-c074f43045c9 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:35.161640 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3249d142-23ed-40cd-82fa-c074f43045c9 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:35.162249 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3249d142-23ed-40cd-82fa-c074f43045c9 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:35.163212 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3249d142-23ed-40cd-82fa-c074f43045c9 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:35.163830 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3249d142-23ed-40cd-82fa-c074f43045c9 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:35.164552 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3249d142-23ed-40cd-82fa-c074f43045c9 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:35.369767 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3249d142-23ed-40cd-82fa-c074f43045c9 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a40e444e92495c917f58fbcec63c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e24336f2ab84adda758d98cbb785888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:35.374147 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:35.381503 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3249d142-23ed-40cd-82fa-c074f43045c9 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] 10.222.0.39 "GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4" status: 200 len: 1332 microversion: 2.1 time: 0.234004 Aug 07 01:23:35.383937 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1540/2831] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:35 2022] GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4 => generated 1332 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:35.388510 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b611bd5f-5ccf-49ab-8589-2bae8afefd2e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:35.389381 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b611bd5f-5ccf-49ab-8589-2bae8afefd2e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:35.397507 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b611bd5f-5ccf-49ab-8589-2bae8afefd2e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:35.399615 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b611bd5f-5ccf-49ab-8589-2bae8afefd2e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:35.400314 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b611bd5f-5ccf-49ab-8589-2bae8afefd2e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:35.401072 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b611bd5f-5ccf-49ab-8589-2bae8afefd2e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:35.401534 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b611bd5f-5ccf-49ab-8589-2bae8afefd2e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:35.402139 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b611bd5f-5ccf-49ab-8589-2bae8afefd2e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:35.472204 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b611bd5f-5ccf-49ab-8589-2bae8afefd2e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:35.483315 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b611bd5f-5ccf-49ab-8589-2bae8afefd2e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1295 microversion: 2.1 time: 0.099052 Aug 07 01:23:35.499919 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1541/2832] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:35 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1295 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:35.506861 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-25c021e0-163c-4352-886a-6d357c589d2a tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] Calling method '.version_select at 0x7f9e17a62ca0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:35.537872 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-25c021e0-163c-4352-886a-6d357c589d2a tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] HTTP exception thrown: Volume 70cac16f-43e5-400f-89f3-ecc0bf63f806 could not be found. Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-25c021e0-163c-4352-886a-6d357c589d2a tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] Request method failure captured: Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/os-volumes/70cac16f-43e5-400f-89f3-ecc0bf63f806 HTTP/1.1 Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xQEIdaONFVpgUTf50ti9k27wugBhRKLHp_KBE9Hruz_3vJMoS8q4MpRkOHtrR8vjpGpbPZ8n-U463YE8rSylbmmwjNSZgHwuZv4K4j-M0rYyfMxK6pzMDGLzHoH66qfXNEEbMvgALUkR1jpdUuRhbljWVjV7q9RCv7sxve3RxeKsTw Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 3e033f826a784e72a57e827ab964c012 Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2040970473 Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3e033f826a784e72a57e827ab964c012"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3e033f826a784e72a57e827ab964c012", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3e033f826a784e72a57e827ab964c012"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3e033f826a784e72a57e827ab964c012"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2040970473 Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 3e033f826a784e72a57e827ab964c012 Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2040970473 Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-VolumesSnapshotsTestJSON-2040970473-project Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: bf6105148497448381fc2eb092a6eb94 Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2040970473-project Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: exception: Volume 70cac16f-43e5-400f-89f3-ecc0bf63f806 could not be found. Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '70cac16f-43e5-400f-89f3-ecc0bf63f806'} Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 70cac16f-43e5-400f-89f3-ecc0bf63f806 could not be found. (HTTP 404) (Request-ID: req-ce5b3f6f-f92e-4cb7-8b52-a1194b7c6d05) Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 01:23:35.540969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 70cac16f-43e5-400f-89f3-ecc0bf63f806 could not be found. Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 70cac16f-43e5-400f-89f3-ecc0bf63f806 could not be found. Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 70cac16f-43e5-400f-89f3-ecc0bf63f806 could not be found. Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-25c021e0-163c-4352-886a-6d357c589d2a tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] Returning 404 to user: Volume 70cac16f-43e5-400f-89f3-ecc0bf63f806 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-25c021e0-163c-4352-886a-6d357c589d2a tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/70cac16f-43e5-400f-89f3-ecc0bf63f806" status: 404 len: 109 microversion: 2.1 time: 0.049706 Aug 07 01:23:35.551163 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1542/2833] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Aug 7 01:23:35 2022] GET /compute/v2.1/os-volumes/70cac16f-43e5-400f-89f3-ecc0bf63f806 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:23:35.558564 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cf2cfedc-ab1f-456d-a3b9-b65e98e75b0c tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] Calling method '.version_select at 0x7f9e245a8e50>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:35.598838 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ac4194b6-178b-4de8-acd4-ccd9577c5941 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:35.604262 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-cf2cfedc-ab1f-456d-a3b9-b65e98e75b0c tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] HTTP exception thrown: Volume 70cac16f-43e5-400f-89f3-ecc0bf63f806 could not be found. Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cf2cfedc-ab1f-456d-a3b9-b65e98e75b0c tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] Request method failure captured: Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/os-volumes/70cac16f-43e5-400f-89f3-ecc0bf63f806 HTTP/1.1 Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xQEIdaONFVpgUTf50ti9k27wugBhRKLHp_KBE9Hruz_3vJMoS8q4MpRkOHtrR8vjpGpbPZ8n-U463YE8rSylbmmwjNSZgHwuZv4K4j-M0rYyfMxK6pzMDGLzHoH66qfXNEEbMvgALUkR1jpdUuRhbljWVjV7q9RCv7sxve3RxeKsTw Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 3e033f826a784e72a57e827ab964c012 Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2040970473 Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3e033f826a784e72a57e827ab964c012"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3e033f826a784e72a57e827ab964c012", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3e033f826a784e72a57e827ab964c012"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3e033f826a784e72a57e827ab964c012"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2040970473 Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 3e033f826a784e72a57e827ab964c012 Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2040970473 Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-VolumesSnapshotsTestJSON-2040970473-project Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: bf6105148497448381fc2eb092a6eb94 Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2040970473-project Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: exception: Volume 70cac16f-43e5-400f-89f3-ecc0bf63f806 could not be found. Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '70cac16f-43e5-400f-89f3-ecc0bf63f806'} Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 70cac16f-43e5-400f-89f3-ecc0bf63f806 could not be found. (HTTP 404) (Request-ID: req-93e05904-97c6-4014-be63-63e208807435) Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 01:23:35.607702 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 70cac16f-43e5-400f-89f3-ecc0bf63f806 could not be found. Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 70cac16f-43e5-400f-89f3-ecc0bf63f806 could not be found. Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 70cac16f-43e5-400f-89f3-ecc0bf63f806 could not be found. Aug 07 01:23:35.612447 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:35.616922 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ac4194b6-178b-4de8-acd4-ccd9577c5941 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:35.618755 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cf2cfedc-ab1f-456d-a3b9-b65e98e75b0c tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] Returning 404 to user: Volume 70cac16f-43e5-400f-89f3-ecc0bf63f806 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:23:35.619603 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cf2cfedc-ab1f-456d-a3b9-b65e98e75b0c tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/70cac16f-43e5-400f-89f3-ecc0bf63f806" status: 404 len: 109 microversion: 2.1 time: 0.068825 Aug 07 01:23:35.620190 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ac4194b6-178b-4de8-acd4-ccd9577c5941 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:35.620604 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1543/2834] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Aug 7 01:23:35 2022] DELETE /compute/v2.1/os-volumes/70cac16f-43e5-400f-89f3-ecc0bf63f806 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:23:35.622688 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ac4194b6-178b-4de8-acd4-ccd9577c5941 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1486 microversion: 2.25 time: 0.667727 Aug 07 01:23:35.623710 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1292/2835] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:34 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1486 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:23:35.633936 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cc3b4664-58b9-4dfb-a68c-f30467ff5105 tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] Calling method '.version_select at 0x7f9e17a62ee0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:35.670809 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-cc3b4664-58b9-4dfb-a68c-f30467ff5105 tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] HTTP exception thrown: Volume 70cac16f-43e5-400f-89f3-ecc0bf63f806 could not be found. Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cc3b4664-58b9-4dfb-a68c-f30467ff5105 tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] Request method failure captured: Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/os-volumes/70cac16f-43e5-400f-89f3-ecc0bf63f806 HTTP/1.1 Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xQEIdaONFVpgUTf50ti9k27wugBhRKLHp_KBE9Hruz_3vJMoS8q4MpRkOHtrR8vjpGpbPZ8n-U463YE8rSylbmmwjNSZgHwuZv4K4j-M0rYyfMxK6pzMDGLzHoH66qfXNEEbMvgALUkR1jpdUuRhbljWVjV7q9RCv7sxve3RxeKsTw Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 3e033f826a784e72a57e827ab964c012 Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2040970473 Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3e033f826a784e72a57e827ab964c012"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3e033f826a784e72a57e827ab964c012", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3e033f826a784e72a57e827ab964c012"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3e033f826a784e72a57e827ab964c012"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2040970473 Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 3e033f826a784e72a57e827ab964c012 Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2040970473 Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-VolumesSnapshotsTestJSON-2040970473-project Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: bf6105148497448381fc2eb092a6eb94 Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2040970473-project Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: exception: Volume 70cac16f-43e5-400f-89f3-ecc0bf63f806 could not be found. Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '70cac16f-43e5-400f-89f3-ecc0bf63f806'} Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 70cac16f-43e5-400f-89f3-ecc0bf63f806 could not be found. (HTTP 404) (Request-ID: req-75a49f85-c2ef-434a-a0d2-5993804367da) Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 01:23:35.674492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 70cac16f-43e5-400f-89f3-ecc0bf63f806 could not be found. Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 70cac16f-43e5-400f-89f3-ecc0bf63f806 could not be found. Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 70cac16f-43e5-400f-89f3-ecc0bf63f806 could not be found. Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:35.679246 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cc3b4664-58b9-4dfb-a68c-f30467ff5105 tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] Returning 404 to user: Volume 70cac16f-43e5-400f-89f3-ecc0bf63f806 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:23:35.682632 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cc3b4664-58b9-4dfb-a68c-f30467ff5105 tempest-VolumesSnapshotsTestJSON-2040970473 tempest-VolumesSnapshotsTestJSON-2040970473-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/70cac16f-43e5-400f-89f3-ecc0bf63f806" status: 404 len: 109 microversion: 2.1 time: 0.048293 Aug 07 01:23:35.683155 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1544/2836] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Aug 7 01:23:35 2022] GET /compute/v2.1/os-volumes/70cac16f-43e5-400f-89f3-ecc0bf63f806 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:23:35.802461 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f7a3921f-cee7-4344-927f-e4fd1a1b49f8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:35.805223 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f7a3921f-cee7-4344-927f-e4fd1a1b49f8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 0b8441a7-9091-4b45-ac29-9023f2a6bc43] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:35.828097 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1f4446ca-39e9-4943-beb1-48e6c3a1dc61 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:35.829423 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1f4446ca-39e9-4943-beb1-48e6c3a1dc61 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] [instance: 9399abef-0bdd-46db-9718-78e074738d1b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:35.834841 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f7a3921f-cee7-4344-927f-e4fd1a1b49f8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:35.840015 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f7a3921f-cee7-4344-927f-e4fd1a1b49f8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:35.840692 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f7a3921f-cee7-4344-927f-e4fd1a1b49f8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:35.842174 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f7a3921f-cee7-4344-927f-e4fd1a1b49f8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:35.843876 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f7a3921f-cee7-4344-927f-e4fd1a1b49f8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:35.845951 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f7a3921f-cee7-4344-927f-e4fd1a1b49f8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:35.849200 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f4446ca-39e9-4943-beb1-48e6c3a1dc61 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:35.850026 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f4446ca-39e9-4943-beb1-48e6c3a1dc61 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:35.850645 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f4446ca-39e9-4943-beb1-48e6c3a1dc61 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:35.851676 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f4446ca-39e9-4943-beb1-48e6c3a1dc61 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:35.853032 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f4446ca-39e9-4943-beb1-48e6c3a1dc61 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:35.853893 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f4446ca-39e9-4943-beb1-48e6c3a1dc61 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:36.166760 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1f4446ca-39e9-4943-beb1-48e6c3a1dc61 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07a75cbb3d8a4b4baa361b0444c2370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7056cca1edc4e60a51a98237d187857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:36.179524 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1f4446ca-39e9-4943-beb1-48e6c3a1dc61 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] 10.222.0.39 "GET /compute/v2.1/servers/9399abef-0bdd-46db-9718-78e074738d1b" status: 200 len: 1325 microversion: 2.1 time: 0.355280 Aug 07 01:23:36.195938 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1545/2837] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:35 2022] GET /compute/v2.1/servers/9399abef-0bdd-46db-9718-78e074738d1b => generated 1325 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:23:36.206554 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3fa3fcef-ddd4-4787-911d-dc2c29b9b074 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:36.207965 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3fa3fcef-ddd4-4787-911d-dc2c29b9b074 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 51642c80-018a-4126-be66-97ced5cefece] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:36.217110 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fa3fcef-ddd4-4787-911d-dc2c29b9b074 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:36.218106 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fa3fcef-ddd4-4787-911d-dc2c29b9b074 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:36.218640 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fa3fcef-ddd4-4787-911d-dc2c29b9b074 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:36.219839 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fa3fcef-ddd4-4787-911d-dc2c29b9b074 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:36.220651 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fa3fcef-ddd4-4787-911d-dc2c29b9b074 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:36.221769 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fa3fcef-ddd4-4787-911d-dc2c29b9b074 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:36.262179 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f7a3921f-cee7-4344-927f-e4fd1a1b49f8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab58be25a94cd6a59634e7c7cad158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791ad97e3c374d2d8494abc25b46a0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:36.270782 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f7a3921f-cee7-4344-927f-e4fd1a1b49f8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43" status: 200 len: 1572 microversion: 2.1 time: 0.487915 Aug 07 01:23:36.280262 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1293/2838] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:35 2022] GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43 => generated 1572 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:36.294045 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fd54eec5-f9b9-42bb-b79b-3a7610b16733 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1264013529"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:36.294601 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fd54eec5-f9b9-42bb-b79b-3a7610b16733 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 0b8441a7-9091-4b45-ac29-9023f2a6bc43] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:36.311686 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd54eec5-f9b9-42bb-b79b-3a7610b16733 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:36.312282 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd54eec5-f9b9-42bb-b79b-3a7610b16733 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:36.312909 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd54eec5-f9b9-42bb-b79b-3a7610b16733 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:36.313812 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd54eec5-f9b9-42bb-b79b-3a7610b16733 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:36.319114 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd54eec5-f9b9-42bb-b79b-3a7610b16733 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:36.319748 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd54eec5-f9b9-42bb-b79b-3a7610b16733 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:36.452129 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3fa3fcef-ddd4-4787-911d-dc2c29b9b074 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:36.462600 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3fa3fcef-ddd4-4787-911d-dc2c29b9b074 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece" status: 200 len: 1668 microversion: 2.1 time: 0.276752 Aug 07 01:23:36.463738 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1546/2839] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:36 2022] GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece => generated 1668 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:36.468854 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1c45d022-791f-4ba1-afce-fabf3ff18070 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:36.469507 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1c45d022-791f-4ba1-afce-fabf3ff18070 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] [instance: 1239e799-ec72-41c7-a2d3-19f5aee58ed4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:36.477065 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c45d022-791f-4ba1-afce-fabf3ff18070 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:36.478529 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c45d022-791f-4ba1-afce-fabf3ff18070 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:36.479223 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c45d022-791f-4ba1-afce-fabf3ff18070 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:36.480477 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c45d022-791f-4ba1-afce-fabf3ff18070 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:36.481105 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c45d022-791f-4ba1-afce-fabf3ff18070 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:36.481624 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c45d022-791f-4ba1-afce-fabf3ff18070 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:36.707549 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1c45d022-791f-4ba1-afce-fabf3ff18070 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a40e444e92495c917f58fbcec63c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e24336f2ab84adda758d98cbb785888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:36.724500 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1c45d022-791f-4ba1-afce-fabf3ff18070 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] 10.222.0.39 "GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4" status: 200 len: 1332 microversion: 2.1 time: 0.259420 Aug 07 01:23:36.725663 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1547/2840] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:36 2022] GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4 => generated 1332 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:36.747975 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2a2581ae-cdbb-4d86-98ee-467d82f1bd4d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:36.749029 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2a2581ae-cdbb-4d86-98ee-467d82f1bd4d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 51642c80-018a-4126-be66-97ced5cefece] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:36.754901 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a2581ae-cdbb-4d86-98ee-467d82f1bd4d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:36.755398 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a2581ae-cdbb-4d86-98ee-467d82f1bd4d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:36.756098 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a2581ae-cdbb-4d86-98ee-467d82f1bd4d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:36.756815 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a2581ae-cdbb-4d86-98ee-467d82f1bd4d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:36.757278 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a2581ae-cdbb-4d86-98ee-467d82f1bd4d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:36.757727 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a2581ae-cdbb-4d86-98ee-467d82f1bd4d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:36.771787 n-d-master-1 devstack@n-api.service[119517]: INFO nova.network.security_group_api [None req-fd54eec5-f9b9-42bb-b79b-3a7610b16733 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Adding security group 94862e19-9a3f-4bfa-bcbf-3ab01ae83871 to port 7eba9569-21b0-4b5d-be00-748d51cbc8ae Aug 07 01:23:36.785578 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2a2581ae-cdbb-4d86-98ee-467d82f1bd4d tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece/ips" status: 200 len: 178 microversion: 2.1 time: 0.046552 Aug 07 01:23:36.786344 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1548/2841] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Aug 7 01:23:36 2022] GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece/ips => generated 178 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:36.792152 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e0338d62-88e1-4a47-8e60-cb6f1b4528dc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:36.792985 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e0338d62-88e1-4a47-8e60-cb6f1b4528dc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:36.800298 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0338d62-88e1-4a47-8e60-cb6f1b4528dc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:36.801080 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0338d62-88e1-4a47-8e60-cb6f1b4528dc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:36.802339 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0338d62-88e1-4a47-8e60-cb6f1b4528dc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:36.803364 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0338d62-88e1-4a47-8e60-cb6f1b4528dc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:36.803916 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0338d62-88e1-4a47-8e60-cb6f1b4528dc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:36.804793 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0338d62-88e1-4a47-8e60-cb6f1b4528dc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:37.088445 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e0338d62-88e1-4a47-8e60-cb6f1b4528dc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:37.100070 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e0338d62-88e1-4a47-8e60-cb6f1b4528dc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1361 microversion: 2.1 time: 0.311646 Aug 07 01:23:37.101062 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1549/2842] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:36 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1361 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:37.117654 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-724ad662-82d9-4fa3-85b7-80ddaaf662d7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:37.118251 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-724ad662-82d9-4fa3-85b7-80ddaaf662d7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:37.126491 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-724ad662-82d9-4fa3-85b7-80ddaaf662d7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:37.126991 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-724ad662-82d9-4fa3-85b7-80ddaaf662d7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:37.127435 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-724ad662-82d9-4fa3-85b7-80ddaaf662d7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:37.128269 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-724ad662-82d9-4fa3-85b7-80ddaaf662d7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:37.129539 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-724ad662-82d9-4fa3-85b7-80ddaaf662d7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:37.130292 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-724ad662-82d9-4fa3-85b7-80ddaaf662d7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:37.430533 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-724ad662-82d9-4fa3-85b7-80ddaaf662d7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:37.444379 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-724ad662-82d9-4fa3-85b7-80ddaaf662d7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:37.447833 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-724ad662-82d9-4fa3-85b7-80ddaaf662d7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:37.449988 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-724ad662-82d9-4fa3-85b7-80ddaaf662d7 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1486 microversion: 2.25 time: 0.347603 Aug 07 01:23:37.469736 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1550/2843] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:37 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1486 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:23:37.479012 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2222b91a-6a31-4edc-81ad-c4fd8c484eee tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:37.479875 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2222b91a-6a31-4edc-81ad-c4fd8c484eee tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 51642c80-018a-4126-be66-97ced5cefece] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:37.487850 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2222b91a-6a31-4edc-81ad-c4fd8c484eee tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:37.489577 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2222b91a-6a31-4edc-81ad-c4fd8c484eee tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:37.490413 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2222b91a-6a31-4edc-81ad-c4fd8c484eee tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:37.492257 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2222b91a-6a31-4edc-81ad-c4fd8c484eee tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:37.493662 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2222b91a-6a31-4edc-81ad-c4fd8c484eee tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:37.494691 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2222b91a-6a31-4edc-81ad-c4fd8c484eee tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:37.539769 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2222b91a-6a31-4edc-81ad-c4fd8c484eee tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 51642c80-018a-4126-be66-97ced5cefece] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:23:37.637094 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2222b91a-6a31-4edc-81ad-c4fd8c484eee tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "DELETE /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece" status: 204 len: 0 microversion: 2.1 time: 0.165570 Aug 07 01:23:37.638005 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1551/2844] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:23:37 2022] DELETE /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:23:37.645251 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-7aba079c-144d-43a7-8d94-d3092df7fa4c req-7ad31989-95ed-498c-a75c-4bb24574d5ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1239e799-ec72-41c7-a2d3-19f5aee58ed4", "tag": "812230e5-3e0b-4949-97b7-6fbd5953341c"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:37.662237 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-7aba079c-144d-43a7-8d94-d3092df7fa4c req-7ad31989-95ed-498c-a75c-4bb24574d5ce service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:37.663950 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-7aba079c-144d-43a7-8d94-d3092df7fa4c req-7ad31989-95ed-498c-a75c-4bb24574d5ce service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:37.664407 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-7aba079c-144d-43a7-8d94-d3092df7fa4c req-7ad31989-95ed-498c-a75c-4bb24574d5ce service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:37.684203 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-7aba079c-144d-43a7-8d94-d3092df7fa4c req-7ad31989-95ed-498c-a75c-4bb24574d5ce service nova] Creating event network-changed:812230e5-3e0b-4949-97b7-6fbd5953341c for instance 1239e799-ec72-41c7-a2d3-19f5aee58ed4 on n-h2-master-1 Aug 07 01:23:37.695090 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-7aba079c-144d-43a7-8d94-d3092df7fa4c req-7ad31989-95ed-498c-a75c-4bb24574d5ce service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055480 Aug 07 01:23:37.696202 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1552/2845] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:37.704989 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-13fcb7b9-e144-4fa9-a1f3-2944a5422517 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:37.704989 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-13fcb7b9-e144-4fa9-a1f3-2944a5422517 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] [instance: 9399abef-0bdd-46db-9718-78e074738d1b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:37.712942 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-13fcb7b9-e144-4fa9-a1f3-2944a5422517 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:37.713513 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-13fcb7b9-e144-4fa9-a1f3-2944a5422517 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:37.714264 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-13fcb7b9-e144-4fa9-a1f3-2944a5422517 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:37.715203 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-13fcb7b9-e144-4fa9-a1f3-2944a5422517 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:37.715995 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-13fcb7b9-e144-4fa9-a1f3-2944a5422517 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:37.717000 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-13fcb7b9-e144-4fa9-a1f3-2944a5422517 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:37.908964 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fd54eec5-f9b9-42bb-b79b-3a7610b16733 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "POST /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43/action" status: 202 len: 0 microversion: 2.1 time: 1.618781 Aug 07 01:23:37.913026 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1294/2846] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:23:36 2022] POST /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43/action => generated 0 bytes in 1621 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:23:37.915465 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a2662944-3404-4f3f-a6bb-861e85918706 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:37.916186 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a2662944-3404-4f3f-a6bb-861e85918706 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 51642c80-018a-4126-be66-97ced5cefece] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:37.922983 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2662944-3404-4f3f-a6bb-861e85918706 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:37.950421 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2662944-3404-4f3f-a6bb-861e85918706 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:37.951087 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2662944-3404-4f3f-a6bb-861e85918706 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:37.951873 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2662944-3404-4f3f-a6bb-861e85918706 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:37.952374 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2662944-3404-4f3f-a6bb-861e85918706 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:37.952810 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2662944-3404-4f3f-a6bb-861e85918706 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:37.956764 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=4 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:38.262477 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a2662944-3404-4f3f-a6bb-861e85918706 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:38.274580 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a2662944-3404-4f3f-a6bb-861e85918706 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece" status: 200 len: 1674 microversion: 2.1 time: 0.363219 Aug 07 01:23:38.276197 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1295/2847] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:37 2022] GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece => generated 1674 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:38.280852 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-99d7e527-4e05-43f0-abf3-d4de8ee94314 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:38.281665 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-99d7e527-4e05-43f0-abf3-d4de8ee94314 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] [instance: 1239e799-ec72-41c7-a2d3-19f5aee58ed4] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:38.288642 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-99d7e527-4e05-43f0-abf3-d4de8ee94314 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:38.290062 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-99d7e527-4e05-43f0-abf3-d4de8ee94314 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:38.291223 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-99d7e527-4e05-43f0-abf3-d4de8ee94314 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:38.292316 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-99d7e527-4e05-43f0-abf3-d4de8ee94314 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:38.293003 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-99d7e527-4e05-43f0-abf3-d4de8ee94314 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:38.293644 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-99d7e527-4e05-43f0-abf3-d4de8ee94314 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:38.317751 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:38.459141 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-13fcb7b9-e144-4fa9-a1f3-2944a5422517 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07a75cbb3d8a4b4baa361b0444c2370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7056cca1edc4e60a51a98237d187857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:38.475283 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-13fcb7b9-e144-4fa9-a1f3-2944a5422517 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] 10.222.0.39 "GET /compute/v2.1/servers/9399abef-0bdd-46db-9718-78e074738d1b" status: 200 len: 1523 microversion: 2.1 time: 0.773606 Aug 07 01:23:38.483545 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1553/2848] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:37 2022] GET /compute/v2.1/servers/9399abef-0bdd-46db-9718-78e074738d1b => generated 1523 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:38.499438 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bd8bbfab-633b-43f5-b1ce-f78cec7b3c22 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '.version_select at 0x7f9e179a6310>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:38.525624 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-99d7e527-4e05-43f0-abf3-d4de8ee94314 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a40e444e92495c917f58fbcec63c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e24336f2ab84adda758d98cbb785888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:38.535909 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-99d7e527-4e05-43f0-abf3-d4de8ee94314 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] 10.222.0.39 "GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4" status: 200 len: 1332 microversion: 2.1 time: 0.258356 Aug 07 01:23:38.551126 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1296/2849] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:38 2022] GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4 => generated 1332 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:38.551126 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-430d6cc4-9274-4a6e-b186-57363af5a02b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:38.551126 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-430d6cc4-9274-4a6e-b186-57363af5a02b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:38.553029 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-430d6cc4-9274-4a6e-b186-57363af5a02b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:38.553660 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-430d6cc4-9274-4a6e-b186-57363af5a02b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:38.554196 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-430d6cc4-9274-4a6e-b186-57363af5a02b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:38.555014 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-430d6cc4-9274-4a6e-b186-57363af5a02b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:38.555973 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-430d6cc4-9274-4a6e-b186-57363af5a02b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:38.557024 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-430d6cc4-9274-4a6e-b186-57363af5a02b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:38.604029 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:38.642982 n-d-master-1 devstack@n-api.service[119516]: DEBUG neutronclient.v2_0.client [None req-bd8bbfab-633b-43f5-b1ce-f78cec7b3c22 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 94862e19-9a3f-4bfa-bcbf-3ab01ae83871 in use.", "detail": ""}} {{(pid=119516) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 07 01:23:38.643691 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-bd8bbfab-633b-43f5-b1ce-f78cec7b3c22 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] HTTP exception thrown: Security Group 94862e19-9a3f-4bfa-bcbf-3ab01ae83871 in use. Aug 07 01:23:38.643691 n-d-master-1 devstack@n-api.service[119516]: Neutron server returns request_ids: ['req-16c49360-c786-4a11-9c07-6d25b3a43a1d'] Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bd8bbfab-633b-43f5-b1ce-f78cec7b3c22 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Request method failure captured: Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/os-security-groups/94862e19-9a3f-4bfa-bcbf-3ab01ae83871 HTTP/1.1 Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xO08qP9itd1x7LkO549onPIQKYKrTn80RQpW5pCdeHaOqBQA0wDyajz8J-UALON-vNzJgXv0Ujib217Kc5O9bkWEANKCqcpJLGxO-2U8bRcRiaBsEe5TSczuDlBj3IZDQsdnYyQfIf9mOfj407D3QdxTi9cVsMgzz9HNwd9HVPDZu0 Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 791ad97e3c374d2d8494abc25b46a0bf Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_791ad97e3c374d2d8494abc25b46a0bf", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 791ad97e3c374d2d8494abc25b46a0bf Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-SecurityGroupsTestJSON-1082000213-project Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 51ab58be25a94cd6a59634e7c7cad158 Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-SecurityGroupsTestJSON-1082000213-project Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: exception: Security Group 94862e19-9a3f-4bfa-bcbf-3ab01ae83871 in use. Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: Neutron server returns request_ids: ['req-16c49360-c786-4a11-9c07-6d25b3a43a1d'] Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '94862e19-9a3f-4bfa-bcbf-3ab01ae83871'} Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 07 01:23:38.645858 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 94862e19-9a3f-4bfa-bcbf-3ab01ae83871 in use. Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-16c49360-c786-4a11-9c07-6d25b3a43a1d'] Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 94862e19-9a3f-4bfa-bcbf-3ab01ae83871 in use. Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-16c49360-c786-4a11-9c07-6d25b3a43a1d'] Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 94862e19-9a3f-4bfa-bcbf-3ab01ae83871 in use. Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-16c49360-c786-4a11-9c07-6d25b3a43a1d'] Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 94862e19-9a3f-4bfa-bcbf-3ab01ae83871 in use. Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-16c49360-c786-4a11-9c07-6d25b3a43a1d'] Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bd8bbfab-633b-43f5-b1ce-f78cec7b3c22 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Returning 400 to user: Security Group 94862e19-9a3f-4bfa-bcbf-3ab01ae83871 in use. Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: Neutron server returns request_ids: ['req-16c49360-c786-4a11-9c07-6d25b3a43a1d'] {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bd8bbfab-633b-43f5-b1ce-f78cec7b3c22 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/94862e19-9a3f-4bfa-bcbf-3ab01ae83871" status: 400 len: 185 microversion: 2.1 time: 0.161724 Aug 07 01:23:38.650279 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1554/2850] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:23:38 2022] DELETE /compute/v2.1/os-security-groups/94862e19-9a3f-4bfa-bcbf-3ab01ae83871 => generated 185 bytes in 163 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:23:38.656933 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-23fdec10-da22-45e6-9e97-5bb0fe3e9150 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:38.657504 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-23fdec10-da22-45e6-9e97-5bb0fe3e9150 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:38.668523 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-23fdec10-da22-45e6-9e97-5bb0fe3e9150 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:38.669351 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-23fdec10-da22-45e6-9e97-5bb0fe3e9150 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:38.670153 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-23fdec10-da22-45e6-9e97-5bb0fe3e9150 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:38.671337 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-23fdec10-da22-45e6-9e97-5bb0fe3e9150 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:38.672734 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-23fdec10-da22-45e6-9e97-5bb0fe3e9150 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:38.674083 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-23fdec10-da22-45e6-9e97-5bb0fe3e9150 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:38.692697 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:38.757810 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-430d6cc4-9274-4a6e-b186-57363af5a02b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:38.767349 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-430d6cc4-9274-4a6e-b186-57363af5a02b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1361 microversion: 2.1 time: 0.227677 Aug 07 01:23:38.782094 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1297/2851] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:38 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1361 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:38.782094 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-581e4338-1bdd-49e7-a222-d81df1a4786b tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:38.782094 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-581e4338-1bdd-49e7-a222-d81df1a4786b tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] [instance: 9399abef-0bdd-46db-9718-78e074738d1b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:38.782413 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-581e4338-1bdd-49e7-a222-d81df1a4786b tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:38.782749 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-581e4338-1bdd-49e7-a222-d81df1a4786b tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:38.783080 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-581e4338-1bdd-49e7-a222-d81df1a4786b tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:38.784125 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-581e4338-1bdd-49e7-a222-d81df1a4786b tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:38.784593 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-581e4338-1bdd-49e7-a222-d81df1a4786b tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:38.785027 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-581e4338-1bdd-49e7-a222-d81df1a4786b tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:38.818574 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-581e4338-1bdd-49e7-a222-d81df1a4786b tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] HTTP exception thrown: Action 999 not found Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-581e4338-1bdd-49e7-a222-d81df1a4786b tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Request method failure captured: Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/9399abef-0bdd-46db-9718-78e074738d1b/os-instance-actions/999 HTTP/1.1 Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xQD7-PltU6ZkkD9hrc1aezTTwYBkiaKy_tZP-B5obHrsFIcH6JjcB_cEmfoecJuL9R_2PpIVBMYfhMkECD_EuxmabhbjMAOHgpHniIozEgq2uV8GOXFjEkdCr22cjvowLEXGXIpQx9pWaHKJ76ruo2fhLWfmmoEzc2Vv9AjXSnK_Gg Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: a7056cca1edc4e60a51a98237d187857 Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1105401601 Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a7056cca1edc4e60a51a98237d187857"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a7056cca1edc4e60a51a98237d187857", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a7056cca1edc4e60a51a98237d187857"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a7056cca1edc4e60a51a98237d187857"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1105401601 Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: a7056cca1edc4e60a51a98237d187857 Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1105401601 Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-InstanceActionsNegativeTestJSON-1105401601-project Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 07a75cbb3d8a4b4baa361b0444c2370e Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1105401601-project Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: exception: Action 999 not found Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: action_args: {'server_id': '9399abef-0bdd-46db-9718-78e074738d1b', 'id': '999'} Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 07 01:23:38.828444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:38.832097 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-581e4338-1bdd-49e7-a222-d81df1a4786b tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Returning 404 to user: Action 999 not found {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:23:38.832097 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-581e4338-1bdd-49e7-a222-d81df1a4786b tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] 10.222.0.39 "GET /compute/v2.1/servers/9399abef-0bdd-46db-9718-78e074738d1b/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.060796 Aug 07 01:23:38.832097 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1298/2852] 10.222.0.39 () {58 vars in 1308 bytes} [Sun Aug 7 01:23:38 2022] GET /compute/v2.1/servers/9399abef-0bdd-46db-9718-78e074738d1b/os-instance-actions/999 => generated 66 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:23:38.840649 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4ad15b97-e2df-4a73-a73f-753bdcd688ed tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:38.841159 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4ad15b97-e2df-4a73-a73f-753bdcd688ed tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 0b8441a7-9091-4b45-ac29-9023f2a6bc43] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:38.847725 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ad15b97-e2df-4a73-a73f-753bdcd688ed tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:38.848259 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ad15b97-e2df-4a73-a73f-753bdcd688ed tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:38.848701 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ad15b97-e2df-4a73-a73f-753bdcd688ed tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:38.849417 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ad15b97-e2df-4a73-a73f-753bdcd688ed tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:38.849871 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ad15b97-e2df-4a73-a73f-753bdcd688ed tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:38.850293 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ad15b97-e2df-4a73-a73f-753bdcd688ed tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:38.862599 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-23fdec10-da22-45e6-9e97-5bb0fe3e9150 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:38.875489 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-23fdec10-da22-45e6-9e97-5bb0fe3e9150 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:38.877219 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-23fdec10-da22-45e6-9e97-5bb0fe3e9150 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:38.878478 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-23fdec10-da22-45e6-9e97-5bb0fe3e9150 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1476 microversion: 2.25 time: 0.229443 Aug 07 01:23:38.879229 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1555/2853] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:38 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1476 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:23:38.885477 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1fe25ff4-39bc-450d-a652-9fa57e2f1085 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Calling method '.version_select at 0x7f9e2471b9d0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:38.886308 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1fe25ff4-39bc-450d-a652-9fa57e2f1085 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] [instance: 4b17b428-afcc-43a3-aca6-23a1c33f3297] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:38.889375 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:38.893221 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-1fe25ff4-39bc-450d-a652-9fa57e2f1085 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] HTTP exception thrown: Instance 4b17b428-afcc-43a3-aca6-23a1c33f3297 could not be found. Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1fe25ff4-39bc-450d-a652-9fa57e2f1085 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Request method failure captured: Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/4b17b428-afcc-43a3-aca6-23a1c33f3297/os-instance-actions HTTP/1.1 Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xQD7-PltU6ZkkD9hrc1aezTTwYBkiaKy_tZP-B5obHrsFIcH6JjcB_cEmfoecJuL9R_2PpIVBMYfhMkECD_EuxmabhbjMAOHgpHniIozEgq2uV8GOXFjEkdCr22cjvowLEXGXIpQx9pWaHKJ76ruo2fhLWfmmoEzc2Vv9AjXSnK_Gg Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: a7056cca1edc4e60a51a98237d187857 Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1105401601 Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a7056cca1edc4e60a51a98237d187857"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a7056cca1edc4e60a51a98237d187857", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a7056cca1edc4e60a51a98237d187857"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a7056cca1edc4e60a51a98237d187857"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1105401601 Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: a7056cca1edc4e60a51a98237d187857 Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1105401601 Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-InstanceActionsNegativeTestJSON-1105401601-project Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 07a75cbb3d8a4b4baa361b0444c2370e Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1105401601-project Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 4b17b428-afcc-43a3-aca6-23a1c33f3297 could not be found. Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: action_args: {'server_id': '4b17b428-afcc-43a3-aca6-23a1c33f3297'} Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b17b428-afcc-43a3-aca6-23a1c33f3297 could not be found. Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:23:38.895450 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:23:38.899510 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b17b428-afcc-43a3-aca6-23a1c33f3297 could not be found. Aug 07 01:23:38.899510 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:38.899510 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:38.899510 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:38.899510 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:38.899510 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:38.899510 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:38.899510 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:23:38.899510 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:23:38.899510 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b17b428-afcc-43a3-aca6-23a1c33f3297 could not be found. Aug 07 01:23:38.899510 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:38.903372 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1fe25ff4-39bc-450d-a652-9fa57e2f1085 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Returning 404 to user: Instance 4b17b428-afcc-43a3-aca6-23a1c33f3297 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:23:38.905303 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1fe25ff4-39bc-450d-a652-9fa57e2f1085 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] 10.222.0.39 "GET /compute/v2.1/servers/4b17b428-afcc-43a3-aca6-23a1c33f3297/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.024270 Aug 07 01:23:38.906592 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1556/2854] 10.222.0.39 () {58 vars in 1296 bytes} [Sun Aug 7 01:23:38 2022] GET /compute/v2.1/servers/4b17b428-afcc-43a3-aca6-23a1c33f3297/os-instance-actions => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:23:38.919411 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-66888b9c-ea13-4a72-94ce-d0ad2ef49345 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Calling method '.version_select at 0x7f9e243d6550>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:38.919640 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4ad15b97-e2df-4a73-a73f-753bdcd688ed tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 0b8441a7-9091-4b45-ac29-9023f2a6bc43] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:23:38.924928 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-66888b9c-ea13-4a72-94ce-d0ad2ef49345 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:38.925522 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-66888b9c-ea13-4a72-94ce-d0ad2ef49345 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:38.926044 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-66888b9c-ea13-4a72-94ce-d0ad2ef49345 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:38.941149 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-66888b9c-ea13-4a72-94ce-d0ad2ef49345 tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 1945 microversion: 2.25 time: 0.033248 Aug 07 01:23:38.944055 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1557/2855] 10.222.0.39 () {60 vars in 1184 bytes} [Sun Aug 7 01:23:38 2022] GET /compute/v2.1/os-migrations => generated 1945 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:23:38.948961 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-73e6f2a1-b88d-489f-b298-ec2c7f28e993 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:38.949627 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-73e6f2a1-b88d-489f-b298-ec2c7f28e993 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] [instance: 9399abef-0bdd-46db-9718-78e074738d1b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:38.956826 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73e6f2a1-b88d-489f-b298-ec2c7f28e993 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:38.957421 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73e6f2a1-b88d-489f-b298-ec2c7f28e993 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:38.958172 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73e6f2a1-b88d-489f-b298-ec2c7f28e993 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:38.958905 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73e6f2a1-b88d-489f-b298-ec2c7f28e993 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:38.959526 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73e6f2a1-b88d-489f-b298-ec2c7f28e993 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:38.959980 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73e6f2a1-b88d-489f-b298-ec2c7f28e993 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:39.010976 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-73e6f2a1-b88d-489f-b298-ec2c7f28e993 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] [instance: 9399abef-0bdd-46db-9718-78e074738d1b] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:23:39.048251 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4ad15b97-e2df-4a73-a73f-753bdcd688ed tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43" status: 204 len: 0 microversion: 2.1 time: 0.215850 Aug 07 01:23:39.052931 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1299/2856] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:23:38 2022] DELETE /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:23:39.058616 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c127f6a9-7bc0-4bb7-be11-7b3fe2ccaabd tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:39.059318 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c127f6a9-7bc0-4bb7-be11-7b3fe2ccaabd tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:39.065280 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c127f6a9-7bc0-4bb7-be11-7b3fe2ccaabd tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:39.065764 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c127f6a9-7bc0-4bb7-be11-7b3fe2ccaabd tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:39.066196 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c127f6a9-7bc0-4bb7-be11-7b3fe2ccaabd tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:39.066903 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c127f6a9-7bc0-4bb7-be11-7b3fe2ccaabd tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:39.067355 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c127f6a9-7bc0-4bb7-be11-7b3fe2ccaabd tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:39.067846 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c127f6a9-7bc0-4bb7-be11-7b3fe2ccaabd tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:39.119820 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-73e6f2a1-b88d-489f-b298-ec2c7f28e993 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9399abef-0bdd-46db-9718-78e074738d1b" status: 204 len: 0 microversion: 2.1 time: 0.176339 Aug 07 01:23:39.122761 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1558/2857] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:23:38 2022] DELETE /compute/v2.1/servers/9399abef-0bdd-46db-9718-78e074738d1b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:23:39.130949 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ea4791e3-606b-408e-8847-da3888999315 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:39.132021 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ea4791e3-606b-408e-8847-da3888999315 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 0b8441a7-9091-4b45-ac29-9023f2a6bc43] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:39.141299 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea4791e3-606b-408e-8847-da3888999315 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:39.142085 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea4791e3-606b-408e-8847-da3888999315 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:39.142953 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea4791e3-606b-408e-8847-da3888999315 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:39.145002 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea4791e3-606b-408e-8847-da3888999315 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:39.145695 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea4791e3-606b-408e-8847-da3888999315 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:39.146328 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea4791e3-606b-408e-8847-da3888999315 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:39.227289 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-c127f6a9-7bc0-4bb7-be11-7b3fe2ccaabd tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] Lazy-loading 'services' on Instance uuid 536a25a5-29bc-447e-9cf6-81b2db1ec700 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:23:39.247366 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c127f6a9-7bc0-4bb7-be11-7b3fe2ccaabd tempest-LiveAutoBlockMigrationV225Test-2100824289 tempest-LiveAutoBlockMigrationV225Test-2100824289-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1969 microversion: 2.25 time: 0.193304 Aug 07 01:23:39.247998 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1300/2858] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:39 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1969 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:23:39.262253 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bda3f54c-2a10-4e07-8f06-cc7d1261aa3b tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:39.263107 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bda3f54c-2a10-4e07-8f06-cc7d1261aa3b tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] [instance: 9399abef-0bdd-46db-9718-78e074738d1b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:39.281627 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bda3f54c-2a10-4e07-8f06-cc7d1261aa3b tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:39.282113 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bda3f54c-2a10-4e07-8f06-cc7d1261aa3b tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:39.282542 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bda3f54c-2a10-4e07-8f06-cc7d1261aa3b tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:39.283244 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bda3f54c-2a10-4e07-8f06-cc7d1261aa3b tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:39.284668 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bda3f54c-2a10-4e07-8f06-cc7d1261aa3b tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:39.285337 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bda3f54c-2a10-4e07-8f06-cc7d1261aa3b tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:39.329169 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ea4791e3-606b-408e-8847-da3888999315 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab58be25a94cd6a59634e7c7cad158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791ad97e3c374d2d8494abc25b46a0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:39.337782 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ea4791e3-606b-408e-8847-da3888999315 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43" status: 200 len: 1647 microversion: 2.1 time: 0.211846 Aug 07 01:23:39.347991 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1559/2859] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:39 2022] GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43 => generated 1647 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:39.347991 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-245e970a-057c-48cc-aded-5c642152824f tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:39.347991 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-245e970a-057c-48cc-aded-5c642152824f tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:39.351033 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-245e970a-057c-48cc-aded-5c642152824f tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:39.351524 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-245e970a-057c-48cc-aded-5c642152824f tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:39.351996 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-245e970a-057c-48cc-aded-5c642152824f tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:39.353980 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-245e970a-057c-48cc-aded-5c642152824f tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:39.353980 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-245e970a-057c-48cc-aded-5c642152824f tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:39.354285 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-245e970a-057c-48cc-aded-5c642152824f tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:39.383356 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-245e970a-057c-48cc-aded-5c642152824f tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:23:39.386654 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:39.490523 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-245e970a-057c-48cc-aded-5c642152824f tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "DELETE /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 204 len: 0 microversion: 2.25 time: 0.150200 Aug 07 01:23:39.492698 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1560/2860] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Aug 7 01:23:39 2022] DELETE /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 01:23:39.506110 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-24fafa62-6cb6-4319-bb66-ba064043520a tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:39.507455 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-24fafa62-6cb6-4319-bb66-ba064043520a tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 51642c80-018a-4126-be66-97ced5cefece] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:39.514242 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24fafa62-6cb6-4319-bb66-ba064043520a tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:39.514730 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24fafa62-6cb6-4319-bb66-ba064043520a tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:39.515226 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24fafa62-6cb6-4319-bb66-ba064043520a tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:39.515948 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24fafa62-6cb6-4319-bb66-ba064043520a tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:39.516447 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24fafa62-6cb6-4319-bb66-ba064043520a tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:39.516856 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24fafa62-6cb6-4319-bb66-ba064043520a tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:39.598671 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bda3f54c-2a10-4e07-8f06-cc7d1261aa3b tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07a75cbb3d8a4b4baa361b0444c2370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7056cca1edc4e60a51a98237d187857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:39.610619 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bda3f54c-2a10-4e07-8f06-cc7d1261aa3b tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] 10.222.0.39 "GET /compute/v2.1/servers/9399abef-0bdd-46db-9718-78e074738d1b" status: 200 len: 1529 microversion: 2.1 time: 0.357073 Aug 07 01:23:39.612254 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1301/2861] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:39 2022] GET /compute/v2.1/servers/9399abef-0bdd-46db-9718-78e074738d1b => generated 1529 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:39.620335 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-12dd4c30-b986-4f84-9dd2-b1a068827c91 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:39.621690 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-12dd4c30-b986-4f84-9dd2-b1a068827c91 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:39.629386 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12dd4c30-b986-4f84-9dd2-b1a068827c91 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:39.630434 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12dd4c30-b986-4f84-9dd2-b1a068827c91 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:39.631849 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12dd4c30-b986-4f84-9dd2-b1a068827c91 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:39.633024 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12dd4c30-b986-4f84-9dd2-b1a068827c91 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:39.636253 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12dd4c30-b986-4f84-9dd2-b1a068827c91 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:39.636945 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12dd4c30-b986-4f84-9dd2-b1a068827c91 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:39.691792 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-24fafa62-6cb6-4319-bb66-ba064043520a tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:39.701921 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-24fafa62-6cb6-4319-bb66-ba064043520a tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece" status: 200 len: 1674 microversion: 2.1 time: 0.204697 Aug 07 01:23:39.703019 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1561/2862] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:39 2022] GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece => generated 1674 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:39.707922 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-90010e05-1051-4ac1-96b4-ee94305ec5f5 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:39.708619 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-90010e05-1051-4ac1-96b4-ee94305ec5f5 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] [instance: 1239e799-ec72-41c7-a2d3-19f5aee58ed4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:39.715047 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90010e05-1051-4ac1-96b4-ee94305ec5f5 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:39.715700 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90010e05-1051-4ac1-96b4-ee94305ec5f5 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:39.716268 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90010e05-1051-4ac1-96b4-ee94305ec5f5 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:39.717082 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90010e05-1051-4ac1-96b4-ee94305ec5f5 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:39.717615 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90010e05-1051-4ac1-96b4-ee94305ec5f5 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:39.718126 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90010e05-1051-4ac1-96b4-ee94305ec5f5 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:39.738265 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=18 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:39.890203 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-90010e05-1051-4ac1-96b4-ee94305ec5f5 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a40e444e92495c917f58fbcec63c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e24336f2ab84adda758d98cbb785888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:39.910440 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-90010e05-1051-4ac1-96b4-ee94305ec5f5 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] 10.222.0.39 "GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4" status: 200 len: 1332 microversion: 2.1 time: 0.206203 Aug 07 01:23:39.911064 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1562/2863] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:39 2022] GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4 => generated 1332 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:39.919672 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-83c44c4e-8766-46c0-b34d-086632f52cf6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:39.921868 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-83c44c4e-8766-46c0-b34d-086632f52cf6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:39.930499 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83c44c4e-8766-46c0-b34d-086632f52cf6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:39.931644 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83c44c4e-8766-46c0-b34d-086632f52cf6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:39.932800 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83c44c4e-8766-46c0-b34d-086632f52cf6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:39.934067 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83c44c4e-8766-46c0-b34d-086632f52cf6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:39.934968 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83c44c4e-8766-46c0-b34d-086632f52cf6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:39.935820 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83c44c4e-8766-46c0-b34d-086632f52cf6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:40.172567 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-83c44c4e-8766-46c0-b34d-086632f52cf6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:40.181542 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-83c44c4e-8766-46c0-b34d-086632f52cf6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1361 microversion: 2.1 time: 0.267487 Aug 07 01:23:40.182136 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1563/2864] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:39 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1361 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:40.188283 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-78e359db-8c60-4bfb-893b-7c3e1c708c43 req-8547977b-3ca3-4afe-91ab-918521e4f483 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b8441a7-9091-4b45-ac29-9023f2a6bc43", "tag": "7eba9569-21b0-4b5d-be00-748d51cbc8ae"}, {"name": "network-changed", "server_uuid": "e39f0d23-55ab-417b-818e-92de14de44c0", "tag": "04267581-58b6-42a6-92a4-4f79278a63aa"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:40.199362 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-78e359db-8c60-4bfb-893b-7c3e1c708c43 req-8547977b-3ca3-4afe-91ab-918521e4f483 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:40.199844 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-78e359db-8c60-4bfb-893b-7c3e1c708c43 req-8547977b-3ca3-4afe-91ab-918521e4f483 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:40.200305 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-78e359db-8c60-4bfb-893b-7c3e1c708c43 req-8547977b-3ca3-4afe-91ab-918521e4f483 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:40.215611 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-78e359db-8c60-4bfb-893b-7c3e1c708c43 req-8547977b-3ca3-4afe-91ab-918521e4f483 service nova] Creating event network-changed:7eba9569-21b0-4b5d-be00-748d51cbc8ae for instance 0b8441a7-9091-4b45-ac29-9023f2a6bc43 on n-h1-master-1 Aug 07 01:23:40.216395 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-78e359db-8c60-4bfb-893b-7c3e1c708c43 req-8547977b-3ca3-4afe-91ab-918521e4f483 service nova] Creating event network-changed:04267581-58b6-42a6-92a4-4f79278a63aa for instance e39f0d23-55ab-417b-818e-92de14de44c0 on n-h2-master-1 Aug 07 01:23:40.224738 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-78e359db-8c60-4bfb-893b-7c3e1c708c43 req-8547977b-3ca3-4afe-91ab-918521e4f483 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.040198 Aug 07 01:23:40.225358 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1564/2865] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:40.304723 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-12dd4c30-b986-4f84-9dd2-b1a068827c91 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:40.313146 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-12dd4c30-b986-4f84-9dd2-b1a068827c91 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:40.314650 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-12dd4c30-b986-4f84-9dd2-b1a068827c91 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:40.316145 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-12dd4c30-b986-4f84-9dd2-b1a068827c91 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1482 microversion: 2.25 time: 0.702353 Aug 07 01:23:40.316816 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1302/2866] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:39 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1482 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:23:40.365557 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-51afa71a-3505-41cb-8cef-239da264b75c tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:40.366298 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-51afa71a-3505-41cb-8cef-239da264b75c tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 0b8441a7-9091-4b45-ac29-9023f2a6bc43] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:40.381593 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51afa71a-3505-41cb-8cef-239da264b75c tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:40.382189 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51afa71a-3505-41cb-8cef-239da264b75c tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:40.382665 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51afa71a-3505-41cb-8cef-239da264b75c tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:40.383572 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51afa71a-3505-41cb-8cef-239da264b75c tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:40.384232 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51afa71a-3505-41cb-8cef-239da264b75c tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:40.384674 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51afa71a-3505-41cb-8cef-239da264b75c tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:40.605149 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-51afa71a-3505-41cb-8cef-239da264b75c tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab58be25a94cd6a59634e7c7cad158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791ad97e3c374d2d8494abc25b46a0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:40.622472 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-51afa71a-3505-41cb-8cef-239da264b75c tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43" status: 200 len: 1647 microversion: 2.1 time: 0.266106 Aug 07 01:23:40.623720 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1565/2867] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:40 2022] GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43 => generated 1647 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:40.635513 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d42f91b9-8edb-4780-9c33-5fea3efa235b tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:40.636894 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d42f91b9-8edb-4780-9c33-5fea3efa235b tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] [instance: 9399abef-0bdd-46db-9718-78e074738d1b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:40.649629 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d42f91b9-8edb-4780-9c33-5fea3efa235b tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:40.650814 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d42f91b9-8edb-4780-9c33-5fea3efa235b tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:40.651401 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d42f91b9-8edb-4780-9c33-5fea3efa235b tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:40.654345 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d42f91b9-8edb-4780-9c33-5fea3efa235b tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:40.657693 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d42f91b9-8edb-4780-9c33-5fea3efa235b tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:40.658304 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d42f91b9-8edb-4780-9c33-5fea3efa235b tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:40.727545 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b6bceba7-6214-4874-8e5a-b488670cb57a tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:40.728653 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b6bceba7-6214-4874-8e5a-b488670cb57a tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 51642c80-018a-4126-be66-97ced5cefece] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:40.741893 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b6bceba7-6214-4874-8e5a-b488670cb57a tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:40.742396 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b6bceba7-6214-4874-8e5a-b488670cb57a tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:40.742840 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b6bceba7-6214-4874-8e5a-b488670cb57a tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:40.743631 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b6bceba7-6214-4874-8e5a-b488670cb57a tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:40.744135 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b6bceba7-6214-4874-8e5a-b488670cb57a tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:40.744758 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b6bceba7-6214-4874-8e5a-b488670cb57a tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:40.860668 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d42f91b9-8edb-4780-9c33-5fea3efa235b tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07a75cbb3d8a4b4baa361b0444c2370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7056cca1edc4e60a51a98237d187857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:40.870889 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d42f91b9-8edb-4780-9c33-5fea3efa235b tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] 10.222.0.39 "GET /compute/v2.1/servers/9399abef-0bdd-46db-9718-78e074738d1b" status: 200 len: 1529 microversion: 2.1 time: 0.239932 Aug 07 01:23:40.871728 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1303/2868] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:40 2022] GET /compute/v2.1/servers/9399abef-0bdd-46db-9718-78e074738d1b => generated 1529 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:40.933901 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-566c98e3-3756-4953-8c2f-1f2ee93f4d91 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:40.934607 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-566c98e3-3756-4953-8c2f-1f2ee93f4d91 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] [instance: 1239e799-ec72-41c7-a2d3-19f5aee58ed4] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:40.941313 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-566c98e3-3756-4953-8c2f-1f2ee93f4d91 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:40.941928 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-566c98e3-3756-4953-8c2f-1f2ee93f4d91 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:40.942753 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-566c98e3-3756-4953-8c2f-1f2ee93f4d91 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:40.943580 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-566c98e3-3756-4953-8c2f-1f2ee93f4d91 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:40.944188 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-566c98e3-3756-4953-8c2f-1f2ee93f4d91 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:40.944684 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-566c98e3-3756-4953-8c2f-1f2ee93f4d91 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:40.945024 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b6bceba7-6214-4874-8e5a-b488670cb57a tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:40.956916 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b6bceba7-6214-4874-8e5a-b488670cb57a tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece" status: 200 len: 1653 microversion: 2.1 time: 0.235820 Aug 07 01:23:40.957948 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1566/2869] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:40 2022] GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece => generated 1653 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:41.092323 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-566c98e3-3756-4953-8c2f-1f2ee93f4d91 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a40e444e92495c917f58fbcec63c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e24336f2ab84adda758d98cbb785888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:41.100552 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-566c98e3-3756-4953-8c2f-1f2ee93f4d91 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] 10.222.0.39 "GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4" status: 200 len: 1332 microversion: 2.1 time: 0.171164 Aug 07 01:23:41.101136 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1304/2870] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:40 2022] GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4 => generated 1332 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:23:41.203529 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a826f09a-ff98-4f00-aa2b-34bd2b95018a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:41.204539 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a826f09a-ff98-4f00-aa2b-34bd2b95018a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:41.211077 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a826f09a-ff98-4f00-aa2b-34bd2b95018a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:41.211918 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a826f09a-ff98-4f00-aa2b-34bd2b95018a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:41.212593 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a826f09a-ff98-4f00-aa2b-34bd2b95018a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:41.213484 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a826f09a-ff98-4f00-aa2b-34bd2b95018a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:41.214122 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a826f09a-ff98-4f00-aa2b-34bd2b95018a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:41.214747 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a826f09a-ff98-4f00-aa2b-34bd2b95018a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:41.343026 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-08f83be3-57c7-4675-a8bc-4a9fe785aa51 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:41.343755 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-08f83be3-57c7-4675-a8bc-4a9fe785aa51 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:41.350464 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-08f83be3-57c7-4675-a8bc-4a9fe785aa51 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:41.351959 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-08f83be3-57c7-4675-a8bc-4a9fe785aa51 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:41.352417 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-08f83be3-57c7-4675-a8bc-4a9fe785aa51 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:41.353215 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-08f83be3-57c7-4675-a8bc-4a9fe785aa51 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:41.353670 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-08f83be3-57c7-4675-a8bc-4a9fe785aa51 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:41.354110 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-08f83be3-57c7-4675-a8bc-4a9fe785aa51 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:41.407043 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a826f09a-ff98-4f00-aa2b-34bd2b95018a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:41.422335 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a826f09a-ff98-4f00-aa2b-34bd2b95018a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1361 microversion: 2.1 time: 0.222634 Aug 07 01:23:41.423923 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1567/2871] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:41 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1361 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:41.647428 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4b438667-a529-4f11-810d-80f216520b8e tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:41.649200 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4b438667-a529-4f11-810d-80f216520b8e tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 0b8441a7-9091-4b45-ac29-9023f2a6bc43] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:41.657027 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b438667-a529-4f11-810d-80f216520b8e tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:41.657631 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b438667-a529-4f11-810d-80f216520b8e tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:41.658120 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b438667-a529-4f11-810d-80f216520b8e tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:41.658893 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b438667-a529-4f11-810d-80f216520b8e tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:41.659359 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b438667-a529-4f11-810d-80f216520b8e tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:41.659795 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b438667-a529-4f11-810d-80f216520b8e tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:41.809749 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-08f83be3-57c7-4675-a8bc-4a9fe785aa51 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:41.823475 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-08f83be3-57c7-4675-a8bc-4a9fe785aa51 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:41.825979 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-08f83be3-57c7-4675-a8bc-4a9fe785aa51 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:41.827467 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-08f83be3-57c7-4675-a8bc-4a9fe785aa51 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1482 microversion: 2.25 time: 0.488454 Aug 07 01:23:41.830538 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1305/2872] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:41 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1482 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:23:41.885182 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4b438667-a529-4f11-810d-80f216520b8e tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab58be25a94cd6a59634e7c7cad158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791ad97e3c374d2d8494abc25b46a0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:41.895051 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3669beb9-5fb2-40c1-8020-ce4f5cde2409 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:41.895815 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3669beb9-5fb2-40c1-8020-ce4f5cde2409 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] [instance: 9399abef-0bdd-46db-9718-78e074738d1b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:41.910832 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4b438667-a529-4f11-810d-80f216520b8e tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43" status: 200 len: 1647 microversion: 2.1 time: 0.267442 Aug 07 01:23:41.912637 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1568/2873] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:41 2022] GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43 => generated 1647 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:41.913645 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3669beb9-5fb2-40c1-8020-ce4f5cde2409 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:41.915630 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3669beb9-5fb2-40c1-8020-ce4f5cde2409 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:41.916713 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3669beb9-5fb2-40c1-8020-ce4f5cde2409 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:41.919634 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3669beb9-5fb2-40c1-8020-ce4f5cde2409 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:41.920337 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3669beb9-5fb2-40c1-8020-ce4f5cde2409 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:41.921053 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3669beb9-5fb2-40c1-8020-ce4f5cde2409 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:41.981180 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c623b5c5-b9f9-4c2b-8608-b6a9ae955543 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:41.981818 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c623b5c5-b9f9-4c2b-8608-b6a9ae955543 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 51642c80-018a-4126-be66-97ced5cefece] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:41.992051 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c623b5c5-b9f9-4c2b-8608-b6a9ae955543 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:41.992988 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c623b5c5-b9f9-4c2b-8608-b6a9ae955543 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:41.994189 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c623b5c5-b9f9-4c2b-8608-b6a9ae955543 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:41.995247 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c623b5c5-b9f9-4c2b-8608-b6a9ae955543 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:41.996110 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c623b5c5-b9f9-4c2b-8608-b6a9ae955543 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:41.996620 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c623b5c5-b9f9-4c2b-8608-b6a9ae955543 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:42.158957 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c623b5c5-b9f9-4c2b-8608-b6a9ae955543 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:42.167922 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c623b5c5-b9f9-4c2b-8608-b6a9ae955543 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece" status: 200 len: 1653 microversion: 2.1 time: 0.192390 Aug 07 01:23:42.168757 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1569/2874] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:41 2022] GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece => generated 1653 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:23:42.184361 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b7988d6c-e20e-4855-8b83-928d955fe3ff tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:42.185873 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b7988d6c-e20e-4855-8b83-928d955fe3ff tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] [instance: 1239e799-ec72-41c7-a2d3-19f5aee58ed4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:42.194481 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7988d6c-e20e-4855-8b83-928d955fe3ff tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:42.194975 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7988d6c-e20e-4855-8b83-928d955fe3ff tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:42.195625 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7988d6c-e20e-4855-8b83-928d955fe3ff tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:42.196761 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7988d6c-e20e-4855-8b83-928d955fe3ff tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:42.197422 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7988d6c-e20e-4855-8b83-928d955fe3ff tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:42.198025 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7988d6c-e20e-4855-8b83-928d955fe3ff tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:42.255603 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3669beb9-5fb2-40c1-8020-ce4f5cde2409 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07a75cbb3d8a4b4baa361b0444c2370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7056cca1edc4e60a51a98237d187857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:42.269947 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3669beb9-5fb2-40c1-8020-ce4f5cde2409 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] 10.222.0.39 "GET /compute/v2.1/servers/9399abef-0bdd-46db-9718-78e074738d1b" status: 200 len: 1529 microversion: 2.1 time: 0.379412 Aug 07 01:23:42.271478 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1306/2875] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:41 2022] GET /compute/v2.1/servers/9399abef-0bdd-46db-9718-78e074738d1b => generated 1529 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:23:42.287126 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-6af6b78a-eb69-42c6-8039-630b49722e63 req-d7e78615-2d1f-485b-b4db-d118bf3cb5bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51642c80-018a-4126-be66-97ced5cefece", "name": "network-vif-deleted", "tag": "d02958b8-9820-4614-b86f-bfba455a3d18"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:42.300510 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6af6b78a-eb69-42c6-8039-630b49722e63 req-d7e78615-2d1f-485b-b4db-d118bf3cb5bc service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:42.300987 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6af6b78a-eb69-42c6-8039-630b49722e63 req-d7e78615-2d1f-485b-b4db-d118bf3cb5bc service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:42.301429 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6af6b78a-eb69-42c6-8039-630b49722e63 req-d7e78615-2d1f-485b-b4db-d118bf3cb5bc service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:42.321643 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-6af6b78a-eb69-42c6-8039-630b49722e63 req-d7e78615-2d1f-485b-b4db-d118bf3cb5bc service nova] Creating event network-vif-deleted:d02958b8-9820-4614-b86f-bfba455a3d18 for instance 51642c80-018a-4126-be66-97ced5cefece on n-h2-master-1 Aug 07 01:23:42.326959 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-6af6b78a-eb69-42c6-8039-630b49722e63 req-d7e78615-2d1f-485b-b4db-d118bf3cb5bc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053394 Aug 07 01:23:42.327917 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1307/2876] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:42.444682 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f9d0f5e9-e115-4cc9-a531-a45f02a11cc0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:42.445461 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f9d0f5e9-e115-4cc9-a531-a45f02a11cc0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:42.463819 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f9d0f5e9-e115-4cc9-a531-a45f02a11cc0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:42.464603 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f9d0f5e9-e115-4cc9-a531-a45f02a11cc0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:42.465142 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f9d0f5e9-e115-4cc9-a531-a45f02a11cc0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:42.465978 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f9d0f5e9-e115-4cc9-a531-a45f02a11cc0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:42.466638 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f9d0f5e9-e115-4cc9-a531-a45f02a11cc0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:42.467240 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f9d0f5e9-e115-4cc9-a531-a45f02a11cc0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:42.522075 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b7988d6c-e20e-4855-8b83-928d955fe3ff tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a40e444e92495c917f58fbcec63c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e24336f2ab84adda758d98cbb785888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:42.536976 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b7988d6c-e20e-4855-8b83-928d955fe3ff tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] 10.222.0.39 "GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4" status: 200 len: 1332 microversion: 2.1 time: 0.366003 Aug 07 01:23:42.542079 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1570/2877] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:42 2022] GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4 => generated 1332 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:42.858467 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6ea04bb6-f496-4213-b15c-6661685c7d43 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:42.859074 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6ea04bb6-f496-4213-b15c-6661685c7d43 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:42.868168 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ea04bb6-f496-4213-b15c-6661685c7d43 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:42.869544 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ea04bb6-f496-4213-b15c-6661685c7d43 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:42.870651 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ea04bb6-f496-4213-b15c-6661685c7d43 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:42.872439 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ea04bb6-f496-4213-b15c-6661685c7d43 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:42.873007 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ea04bb6-f496-4213-b15c-6661685c7d43 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:42.873924 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ea04bb6-f496-4213-b15c-6661685c7d43 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:42.923302 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f9d0f5e9-e115-4cc9-a531-a45f02a11cc0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:42.935611 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f9d0f5e9-e115-4cc9-a531-a45f02a11cc0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1361 microversion: 2.1 time: 0.495958 Aug 07 01:23:42.937773 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1308/2878] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:42 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1361 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:23:42.952767 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c909e48d-a10e-4107-bdcf-eda6a389ed0d tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:42.956513 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c909e48d-a10e-4107-bdcf-eda6a389ed0d tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 0b8441a7-9091-4b45-ac29-9023f2a6bc43] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:42.976860 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c909e48d-a10e-4107-bdcf-eda6a389ed0d tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:42.981673 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c909e48d-a10e-4107-bdcf-eda6a389ed0d tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:42.987994 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c909e48d-a10e-4107-bdcf-eda6a389ed0d tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:42.989395 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c909e48d-a10e-4107-bdcf-eda6a389ed0d tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:42.989395 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c909e48d-a10e-4107-bdcf-eda6a389ed0d tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:42.990085 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c909e48d-a10e-4107-bdcf-eda6a389ed0d tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:43.267337 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6ea04bb6-f496-4213-b15c-6661685c7d43 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:43.283293 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6ea04bb6-f496-4213-b15c-6661685c7d43 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:43.284747 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6ea04bb6-f496-4213-b15c-6661685c7d43 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:43.286068 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6ea04bb6-f496-4213-b15c-6661685c7d43 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1482 microversion: 2.25 time: 0.432038 Aug 07 01:23:43.286808 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1571/2879] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:42 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1482 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:23:43.294494 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c5957dba-e4d4-4d2e-ba24-41970d3e1a13 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:43.295484 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c5957dba-e4d4-4d2e-ba24-41970d3e1a13 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 51642c80-018a-4126-be66-97ced5cefece] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:43.309046 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c5957dba-e4d4-4d2e-ba24-41970d3e1a13 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:43.310214 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c5957dba-e4d4-4d2e-ba24-41970d3e1a13 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:43.311611 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c5957dba-e4d4-4d2e-ba24-41970d3e1a13 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:43.313007 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c5957dba-e4d4-4d2e-ba24-41970d3e1a13 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:43.313917 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c5957dba-e4d4-4d2e-ba24-41970d3e1a13 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:43.314583 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c5957dba-e4d4-4d2e-ba24-41970d3e1a13 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:43.361004 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c5957dba-e4d4-4d2e-ba24-41970d3e1a13 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:43.362020 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c5957dba-e4d4-4d2e-ba24-41970d3e1a13 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:43.364002 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c5957dba-e4d4-4d2e-ba24-41970d3e1a13 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:43.364667 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-c5957dba-e4d4-4d2e-ba24-41970d3e1a13 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lazy-loading 'fault' on Instance uuid 51642c80-018a-4126-be66-97ced5cefece {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:23:43.464637 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c5957dba-e4d4-4d2e-ba24-41970d3e1a13 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd60a6557665a43cda4a64a83c92e2998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e166fb219464337af5e274671580d80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:43.481437 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c5957dba-e4d4-4d2e-ba24-41970d3e1a13 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece" status: 200 len: 1458 microversion: 2.1 time: 0.193266 Aug 07 01:23:43.499284 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1572/2880] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:43 2022] GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece => generated 1458 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:43.505629 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1f97ae92-f9d1-42e3-92f3-0407b3abe3fc tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:43.506570 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1f97ae92-f9d1-42e3-92f3-0407b3abe3fc tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] [instance: 9399abef-0bdd-46db-9718-78e074738d1b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:43.520892 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f97ae92-f9d1-42e3-92f3-0407b3abe3fc tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:43.522087 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f97ae92-f9d1-42e3-92f3-0407b3abe3fc tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:43.523318 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f97ae92-f9d1-42e3-92f3-0407b3abe3fc tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:43.524119 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f97ae92-f9d1-42e3-92f3-0407b3abe3fc tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:43.524890 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f97ae92-f9d1-42e3-92f3-0407b3abe3fc tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:43.525562 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f97ae92-f9d1-42e3-92f3-0407b3abe3fc tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:43.825420 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1f97ae92-f9d1-42e3-92f3-0407b3abe3fc tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07a75cbb3d8a4b4baa361b0444c2370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7056cca1edc4e60a51a98237d187857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:43.837512 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1f97ae92-f9d1-42e3-92f3-0407b3abe3fc tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] 10.222.0.39 "GET /compute/v2.1/servers/9399abef-0bdd-46db-9718-78e074738d1b" status: 200 len: 1529 microversion: 2.1 time: 0.350549 Aug 07 01:23:43.845240 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1573/2881] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:43 2022] GET /compute/v2.1/servers/9399abef-0bdd-46db-9718-78e074738d1b => generated 1529 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:43.857622 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c3d5531b-4053-4255-9101-4c29cec8c61c tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:43.859674 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c3d5531b-4053-4255-9101-4c29cec8c61c tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] [instance: 1239e799-ec72-41c7-a2d3-19f5aee58ed4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:43.874092 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3d5531b-4053-4255-9101-4c29cec8c61c tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:43.876562 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3d5531b-4053-4255-9101-4c29cec8c61c tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:43.877395 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3d5531b-4053-4255-9101-4c29cec8c61c tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:43.878784 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3d5531b-4053-4255-9101-4c29cec8c61c tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:43.879633 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3d5531b-4053-4255-9101-4c29cec8c61c tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:43.880478 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3d5531b-4053-4255-9101-4c29cec8c61c tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:44.131819 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c3d5531b-4053-4255-9101-4c29cec8c61c tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a40e444e92495c917f58fbcec63c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e24336f2ab84adda758d98cbb785888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:44.141710 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c3d5531b-4053-4255-9101-4c29cec8c61c tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] 10.222.0.39 "GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4" status: 200 len: 1332 microversion: 2.1 time: 0.294887 Aug 07 01:23:44.146919 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1574/2882] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:43 2022] GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4 => generated 1332 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:44.156992 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-9bb921b5-dc07-4f24-bec0-cc99835f1a90 req-d0e57dee-dd55-44c6-9da7-90d6bcf12981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b8441a7-9091-4b45-ac29-9023f2a6bc43", "name": "network-vif-deleted", "tag": "7eba9569-21b0-4b5d-be00-748d51cbc8ae"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:44.171619 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-9bb921b5-dc07-4f24-bec0-cc99835f1a90 req-d0e57dee-dd55-44c6-9da7-90d6bcf12981 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:44.172226 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-9bb921b5-dc07-4f24-bec0-cc99835f1a90 req-d0e57dee-dd55-44c6-9da7-90d6bcf12981 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:44.172798 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-9bb921b5-dc07-4f24-bec0-cc99835f1a90 req-d0e57dee-dd55-44c6-9da7-90d6bcf12981 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:44.189463 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-9bb921b5-dc07-4f24-bec0-cc99835f1a90 req-d0e57dee-dd55-44c6-9da7-90d6bcf12981 service nova] Creating event network-vif-deleted:7eba9569-21b0-4b5d-be00-748d51cbc8ae for instance 0b8441a7-9091-4b45-ac29-9023f2a6bc43 on n-h1-master-1 Aug 07 01:23:44.195368 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-9bb921b5-dc07-4f24-bec0-cc99835f1a90 req-d0e57dee-dd55-44c6-9da7-90d6bcf12981 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045336 Aug 07 01:23:44.196877 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1575/2883] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:44.217471 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3e8ce12b-9272-41ff-bfbb-6e07a3ab1b9c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:44.218587 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3e8ce12b-9272-41ff-bfbb-6e07a3ab1b9c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:44.226871 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e8ce12b-9272-41ff-bfbb-6e07a3ab1b9c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:44.227506 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e8ce12b-9272-41ff-bfbb-6e07a3ab1b9c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:44.228065 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e8ce12b-9272-41ff-bfbb-6e07a3ab1b9c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:44.228877 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e8ce12b-9272-41ff-bfbb-6e07a3ab1b9c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:44.229514 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e8ce12b-9272-41ff-bfbb-6e07a3ab1b9c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:44.230124 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e8ce12b-9272-41ff-bfbb-6e07a3ab1b9c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:44.378720 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c909e48d-a10e-4107-bdcf-eda6a389ed0d tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab58be25a94cd6a59634e7c7cad158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791ad97e3c374d2d8494abc25b46a0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:44.420396 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c909e48d-a10e-4107-bdcf-eda6a389ed0d tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43" status: 200 len: 1647 microversion: 2.1 time: 1.479492 Aug 07 01:23:44.424592 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1309/2884] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:42 2022] GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43 => generated 1647 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:44.438870 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1af112a1-280b-418e-bd7a-454f6283a7e2 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:44.443085 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1af112a1-280b-418e-bd7a-454f6283a7e2 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:44.463781 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1af112a1-280b-418e-bd7a-454f6283a7e2 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:44.464364 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1af112a1-280b-418e-bd7a-454f6283a7e2 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:44.464805 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1af112a1-280b-418e-bd7a-454f6283a7e2 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:44.465525 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1af112a1-280b-418e-bd7a-454f6283a7e2 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:44.470847 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1af112a1-280b-418e-bd7a-454f6283a7e2 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:44.471510 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1af112a1-280b-418e-bd7a-454f6283a7e2 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:44.582539 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3e8ce12b-9272-41ff-bfbb-6e07a3ab1b9c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:44.594356 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:44.606123 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3e8ce12b-9272-41ff-bfbb-6e07a3ab1b9c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1361 microversion: 2.1 time: 0.400674 Aug 07 01:23:44.610533 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1576/2885] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:44 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1361 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:44.619567 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-a2159f87-fe22-4103-b243-ed5edb27c37a req-ea341ae3-85a7-4544-9940-294406ebdcdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51642c80-018a-4126-be66-97ced5cefece", "name": "network-vif-deleted", "tag": "90b7e8fd-564b-468f-8889-a0388488ce36"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:44.640462 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a2159f87-fe22-4103-b243-ed5edb27c37a req-ea341ae3-85a7-4544-9940-294406ebdcdc service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:44.642730 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a2159f87-fe22-4103-b243-ed5edb27c37a req-ea341ae3-85a7-4544-9940-294406ebdcdc service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:44.644522 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a2159f87-fe22-4103-b243-ed5edb27c37a req-ea341ae3-85a7-4544-9940-294406ebdcdc service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:44.674198 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-a2159f87-fe22-4103-b243-ed5edb27c37a req-ea341ae3-85a7-4544-9940-294406ebdcdc service nova] Creating event network-vif-deleted:90b7e8fd-564b-468f-8889-a0388488ce36 for instance 51642c80-018a-4126-be66-97ced5cefece on n-h2-master-1 Aug 07 01:23:44.685288 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-a2159f87-fe22-4103-b243-ed5edb27c37a req-ea341ae3-85a7-4544-9940-294406ebdcdc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071545 Aug 07 01:23:44.686888 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1577/2886] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:44.696208 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8d3d3417-5bd5-4c0e-8a69-2a8f550227ff tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:44.698239 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8d3d3417-5bd5-4c0e-8a69-2a8f550227ff tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 51642c80-018a-4126-be66-97ced5cefece] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:44.710421 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d3d3417-5bd5-4c0e-8a69-2a8f550227ff tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:44.711488 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d3d3417-5bd5-4c0e-8a69-2a8f550227ff tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:44.712894 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d3d3417-5bd5-4c0e-8a69-2a8f550227ff tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:44.714130 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d3d3417-5bd5-4c0e-8a69-2a8f550227ff tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:44.714867 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d3d3417-5bd5-4c0e-8a69-2a8f550227ff tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:44.715685 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d3d3417-5bd5-4c0e-8a69-2a8f550227ff tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:44.734274 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-8d3d3417-5bd5-4c0e-8a69-2a8f550227ff tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] HTTP exception thrown: Instance 51642c80-018a-4126-be66-97ced5cefece could not be found. Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8d3d3417-5bd5-4c0e-8a69-2a8f550227ff tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Request method failure captured: Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece HTTP/1.1 Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xOmDixoOe5zESLEYDXA3axJNRP6bGIp2s8bsDueZmxkJOpZQpG1lySHsKEJwVaRwpeMoczbg3dNvWHOCd_gHZWNk1LiXQTx7fKsKxID1y_LZjG_VPVKnF0DLo2BFr_7w9sMgiCQLlafu9KThwRV0woNm4alGRtyWM2huHJZPVTWYRA Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 7e166fb219464337af5e274671580d80 Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersTestMultiNic-1944764525 Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7e166fb219464337af5e274671580d80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7e166fb219464337af5e274671580d80", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7e166fb219464337af5e274671580d80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7e166fb219464337af5e274671580d80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersTestMultiNic-1944764525 Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 7e166fb219464337af5e274671580d80 Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersTestMultiNic-1944764525 Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersTestMultiNic-1944764525-project Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: d60a6557665a43cda4a64a83c92e2998 Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersTestMultiNic-1944764525-project Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 51642c80-018a-4126-be66-97ced5cefece could not be found. Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '51642c80-018a-4126-be66-97ced5cefece'} Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51642c80-018a-4126-be66-97ced5cefece could not be found. Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51642c80-018a-4126-be66-97ced5cefece could not be found. Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:44.736393 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:44.743822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:44.743822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:44.743822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:44.743822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:23:44.743822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:23:44.743822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51642c80-018a-4126-be66-97ced5cefece could not be found. Aug 07 01:23:44.743822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:44.743822 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8d3d3417-5bd5-4c0e-8a69-2a8f550227ff tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Returning 404 to user: Instance 51642c80-018a-4126-be66-97ced5cefece could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:23:44.743822 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8d3d3417-5bd5-4c0e-8a69-2a8f550227ff tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece" status: 404 len: 111 microversion: 2.1 time: 0.049384 Aug 07 01:23:44.752586 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1578/2887] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:44 2022] GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:23:44.862942 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9661707e-6fcb-4a42-a6b5-e3ef5ec0c6b1 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:44.864008 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9661707e-6fcb-4a42-a6b5-e3ef5ec0c6b1 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] [instance: 9399abef-0bdd-46db-9718-78e074738d1b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:44.881910 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9661707e-6fcb-4a42-a6b5-e3ef5ec0c6b1 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:44.887155 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9661707e-6fcb-4a42-a6b5-e3ef5ec0c6b1 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:44.887155 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9661707e-6fcb-4a42-a6b5-e3ef5ec0c6b1 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:44.898056 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9661707e-6fcb-4a42-a6b5-e3ef5ec0c6b1 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:44.898622 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9661707e-6fcb-4a42-a6b5-e3ef5ec0c6b1 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:44.899072 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9661707e-6fcb-4a42-a6b5-e3ef5ec0c6b1 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:45.120035 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1af112a1-280b-418e-bd7a-454f6283a7e2 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:45.153460 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1af112a1-280b-418e-bd7a-454f6283a7e2 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:45.159650 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1af112a1-280b-418e-bd7a-454f6283a7e2 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:45.163344 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1af112a1-280b-418e-bd7a-454f6283a7e2 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1482 microversion: 2.25 time: 0.735633 Aug 07 01:23:45.168740 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1310/2888] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:44 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1482 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:23:45.179176 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9661707e-6fcb-4a42-a6b5-e3ef5ec0c6b1 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07a75cbb3d8a4b4baa361b0444c2370e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7056cca1edc4e60a51a98237d187857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:45.185261 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a0b860e3-91a3-41d2-a37c-80925aa5e0ee tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:45.190741 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a0b860e3-91a3-41d2-a37c-80925aa5e0ee tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] [instance: 1239e799-ec72-41c7-a2d3-19f5aee58ed4] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:45.199242 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9661707e-6fcb-4a42-a6b5-e3ef5ec0c6b1 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] 10.222.0.39 "GET /compute/v2.1/servers/9399abef-0bdd-46db-9718-78e074738d1b" status: 200 len: 1487 microversion: 2.1 time: 0.330727 Aug 07 01:23:45.199242 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1579/2889] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:44 2022] GET /compute/v2.1/servers/9399abef-0bdd-46db-9718-78e074738d1b => generated 1487 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:23:45.208992 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a0b860e3-91a3-41d2-a37c-80925aa5e0ee tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:45.209763 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a0b860e3-91a3-41d2-a37c-80925aa5e0ee tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:45.210984 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a0b860e3-91a3-41d2-a37c-80925aa5e0ee tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:45.213940 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a0b860e3-91a3-41d2-a37c-80925aa5e0ee tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:45.214669 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a0b860e3-91a3-41d2-a37c-80925aa5e0ee tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:45.216947 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a0b860e3-91a3-41d2-a37c-80925aa5e0ee tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:45.450424 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-02f711cf-cb0e-45c6-90cd-d74b9b012ea3 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:45.457844 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-02f711cf-cb0e-45c6-90cd-d74b9b012ea3 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 0b8441a7-9091-4b45-ac29-9023f2a6bc43] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:45.463457 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-02f711cf-cb0e-45c6-90cd-d74b9b012ea3 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:45.464097 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-02f711cf-cb0e-45c6-90cd-d74b9b012ea3 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:45.464542 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-02f711cf-cb0e-45c6-90cd-d74b9b012ea3 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:45.465346 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-02f711cf-cb0e-45c6-90cd-d74b9b012ea3 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:45.465803 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-02f711cf-cb0e-45c6-90cd-d74b9b012ea3 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:45.466233 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-02f711cf-cb0e-45c6-90cd-d74b9b012ea3 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:45.508937 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-02f711cf-cb0e-45c6-90cd-d74b9b012ea3 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] HTTP exception thrown: Instance 0b8441a7-9091-4b45-ac29-9023f2a6bc43 could not be found. Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-02f711cf-cb0e-45c6-90cd-d74b9b012ea3 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Request method failure captured: Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43 HTTP/1.1 Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xO08qP9itd1x7LkO549onPIQKYKrTn80RQpW5pCdeHaOqBQA0wDyajz8J-UALON-vNzJgXv0Ujib217Kc5O9bkWEANKCqcpJLGxO-2U8bRcRiaBsEe5TSczuDlBj3IZDQsdnYyQfIf9mOfj407D3QdxTi9cVsMgzz9HNwd9HVPDZu0 Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 791ad97e3c374d2d8494abc25b46a0bf Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_791ad97e3c374d2d8494abc25b46a0bf", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 791ad97e3c374d2d8494abc25b46a0bf Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-SecurityGroupsTestJSON-1082000213-project Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 51ab58be25a94cd6a59634e7c7cad158 Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-SecurityGroupsTestJSON-1082000213-project Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 0b8441a7-9091-4b45-ac29-9023f2a6bc43 could not be found. Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '0b8441a7-9091-4b45-ac29-9023f2a6bc43'} Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b8441a7-9091-4b45-ac29-9023f2a6bc43 could not be found. Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b8441a7-9091-4b45-ac29-9023f2a6bc43 could not be found. Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:45.510514 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:45.515010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:45.515010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:45.515010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:45.515010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:23:45.515010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:23:45.515010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b8441a7-9091-4b45-ac29-9023f2a6bc43 could not be found. Aug 07 01:23:45.515010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:45.515010 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-02f711cf-cb0e-45c6-90cd-d74b9b012ea3 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Returning 404 to user: Instance 0b8441a7-9091-4b45-ac29-9023f2a6bc43 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:23:45.515010 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-02f711cf-cb0e-45c6-90cd-d74b9b012ea3 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43" status: 404 len: 111 microversion: 2.1 time: 0.067314 Aug 07 01:23:45.516242 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1580/2890] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:45 2022] GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:23:45.532549 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-68dca734-7118-454a-804a-3241117cb89c tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '.version_select at 0x7f9e24737f70>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:45.718061 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a0b860e3-91a3-41d2-a37c-80925aa5e0ee tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a40e444e92495c917f58fbcec63c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e24336f2ab84adda758d98cbb785888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:45.721049 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:45.735718 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a0b860e3-91a3-41d2-a37c-80925aa5e0ee tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] 10.222.0.39 "GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4" status: 200 len: 1332 microversion: 2.1 time: 0.564971 Aug 07 01:23:45.736353 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1311/2891] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:45 2022] GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4 => generated 1332 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:45.758310 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-09bd33b2-e507-40d3-b65b-84c6cd31dd78 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:45.763963 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-09bd33b2-e507-40d3-b65b-84c6cd31dd78 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:45.788941 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-09bd33b2-e507-40d3-b65b-84c6cd31dd78 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:45.789594 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-09bd33b2-e507-40d3-b65b-84c6cd31dd78 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:45.794744 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-09bd33b2-e507-40d3-b65b-84c6cd31dd78 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:45.798236 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-09bd33b2-e507-40d3-b65b-84c6cd31dd78 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:45.798987 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-09bd33b2-e507-40d3-b65b-84c6cd31dd78 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:45.800484 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-09bd33b2-e507-40d3-b65b-84c6cd31dd78 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:45.959799 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-68dca734-7118-454a-804a-3241117cb89c tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/13028388-ce18-4c5b-b7a7-e92a5448e811" status: 202 len: 0 microversion: 2.1 time: 0.442333 Aug 07 01:23:45.960832 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1581/2892] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:23:45 2022] DELETE /compute/v2.1/os-security-groups/13028388-ce18-4c5b-b7a7-e92a5448e811 => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:23:45.970528 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ff0262f2-a125-4641-b027-6f48f4011927 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '.version_select at 0x7f9e179a69d0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:46.289435 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-09bd33b2-e507-40d3-b65b-84c6cd31dd78 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:46.303111 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-09bd33b2-e507-40d3-b65b-84c6cd31dd78 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1361 microversion: 2.1 time: 0.558938 Aug 07 01:23:46.303716 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1312/2893] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:45 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1361 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:46.312117 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-54f284e1-1316-403b-84ad-9579f3c5e138 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:46.315927 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-54f284e1-1316-403b-84ad-9579f3c5e138 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:46.318520 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:46.339780 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54f284e1-1316-403b-84ad-9579f3c5e138 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:46.342682 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54f284e1-1316-403b-84ad-9579f3c5e138 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:46.343348 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54f284e1-1316-403b-84ad-9579f3c5e138 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:46.345937 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54f284e1-1316-403b-84ad-9579f3c5e138 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:46.346665 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54f284e1-1316-403b-84ad-9579f3c5e138 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:46.349671 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54f284e1-1316-403b-84ad-9579f3c5e138 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:46.383609 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ff0262f2-a125-4641-b027-6f48f4011927 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/94862e19-9a3f-4bfa-bcbf-3ab01ae83871" status: 202 len: 0 microversion: 2.1 time: 0.418078 Aug 07 01:23:46.385225 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1582/2894] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:23:45 2022] DELETE /compute/v2.1/os-security-groups/94862e19-9a3f-4bfa-bcbf-3ab01ae83871 => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 01:23:46.390254 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-adb476f9-e0a3-4324-9b64-a5267487c5e6 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:46.390876 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-adb476f9-e0a3-4324-9b64-a5267487c5e6 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] [instance: 9399abef-0bdd-46db-9718-78e074738d1b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:46.407710 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-adb476f9-e0a3-4324-9b64-a5267487c5e6 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:46.410499 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-adb476f9-e0a3-4324-9b64-a5267487c5e6 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:46.411139 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-adb476f9-e0a3-4324-9b64-a5267487c5e6 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:46.412115 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-adb476f9-e0a3-4324-9b64-a5267487c5e6 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:46.413097 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-adb476f9-e0a3-4324-9b64-a5267487c5e6 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:46.415150 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-adb476f9-e0a3-4324-9b64-a5267487c5e6 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:46.456087 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-adb476f9-e0a3-4324-9b64-a5267487c5e6 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] HTTP exception thrown: Instance 9399abef-0bdd-46db-9718-78e074738d1b could not be found. Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-adb476f9-e0a3-4324-9b64-a5267487c5e6 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Request method failure captured: Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/9399abef-0bdd-46db-9718-78e074738d1b HTTP/1.1 Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xQD7-PltU6ZkkD9hrc1aezTTwYBkiaKy_tZP-B5obHrsFIcH6JjcB_cEmfoecJuL9R_2PpIVBMYfhMkECD_EuxmabhbjMAOHgpHniIozEgq2uV8GOXFjEkdCr22cjvowLEXGXIpQx9pWaHKJ76ruo2fhLWfmmoEzc2Vv9AjXSnK_Gg Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: a7056cca1edc4e60a51a98237d187857 Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1105401601 Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a7056cca1edc4e60a51a98237d187857"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a7056cca1edc4e60a51a98237d187857", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a7056cca1edc4e60a51a98237d187857"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a7056cca1edc4e60a51a98237d187857"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1105401601 Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: a7056cca1edc4e60a51a98237d187857 Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1105401601 Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-InstanceActionsNegativeTestJSON-1105401601-project Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 07a75cbb3d8a4b4baa361b0444c2370e Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1105401601-project Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 9399abef-0bdd-46db-9718-78e074738d1b could not be found. Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '9399abef-0bdd-46db-9718-78e074738d1b'} Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9399abef-0bdd-46db-9718-78e074738d1b could not be found. Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9399abef-0bdd-46db-9718-78e074738d1b could not be found. Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:46.460625 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:46.473209 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:46.473209 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:46.473209 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:46.473209 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:46.473209 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:23:46.473209 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:23:46.473209 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9399abef-0bdd-46db-9718-78e074738d1b could not be found. Aug 07 01:23:46.473209 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:46.473209 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-adb476f9-e0a3-4324-9b64-a5267487c5e6 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] Returning 404 to user: Instance 9399abef-0bdd-46db-9718-78e074738d1b could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:23:46.473209 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-adb476f9-e0a3-4324-9b64-a5267487c5e6 tempest-InstanceActionsNegativeTestJSON-1105401601 tempest-InstanceActionsNegativeTestJSON-1105401601-project] 10.222.0.39 "GET /compute/v2.1/servers/9399abef-0bdd-46db-9718-78e074738d1b" status: 404 len: 111 microversion: 2.1 time: 0.078100 Aug 07 01:23:46.473209 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1583/2895] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:46 2022] GET /compute/v2.1/servers/9399abef-0bdd-46db-9718-78e074738d1b => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:23:46.482204 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-9a9f6291-384b-44d4-bf60-8b2bfdc5b4e4 req-f92023d2-4dba-4f3a-8ac4-9c9dbfe73fec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1239e799-ec72-41c7-a2d3-19f5aee58ed4", "name": "network-vif-plugged", "status": "completed", "tag": "812230e5-3e0b-4949-97b7-6fbd5953341c"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:46.494679 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-54f284e1-1316-403b-84ad-9579f3c5e138 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:46.497682 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-9a9f6291-384b-44d4-bf60-8b2bfdc5b4e4 req-f92023d2-4dba-4f3a-8ac4-9c9dbfe73fec service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:46.498456 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-9a9f6291-384b-44d4-bf60-8b2bfdc5b4e4 req-f92023d2-4dba-4f3a-8ac4-9c9dbfe73fec service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:46.498591 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-9a9f6291-384b-44d4-bf60-8b2bfdc5b4e4 req-f92023d2-4dba-4f3a-8ac4-9c9dbfe73fec service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:46.511031 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-54f284e1-1316-403b-84ad-9579f3c5e138 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:46.515209 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-54f284e1-1316-403b-84ad-9579f3c5e138 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:46.516584 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-54f284e1-1316-403b-84ad-9579f3c5e138 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1266 microversion: 2.25 time: 0.211529 Aug 07 01:23:46.517169 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1313/2896] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:46 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:23:46.525587 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3d0e770a-9224-427e-bd01-058a56e6ebf4 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Action: 'create', calling method: .version_select at 0x7f9e17e370d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1377986499", "description": "tempest-description-1923155762"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:46.545129 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-9a9f6291-384b-44d4-bf60-8b2bfdc5b4e4 req-f92023d2-4dba-4f3a-8ac4-9c9dbfe73fec service nova] Creating event network-vif-plugged:812230e5-3e0b-4949-97b7-6fbd5953341c for instance 1239e799-ec72-41c7-a2d3-19f5aee58ed4 on n-h2-master-1 Aug 07 01:23:46.559413 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-9a9f6291-384b-44d4-bf60-8b2bfdc5b4e4 req-f92023d2-4dba-4f3a-8ac4-9c9dbfe73fec service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090552 Aug 07 01:23:46.560054 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1584/2897] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:46.728916 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-67e4c8cd-fdca-4108-8a21-1ac72102d3dc req-16cb0338-d770-43dd-a0ec-8d4ec4ba6929 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9399abef-0bdd-46db-9718-78e074738d1b", "name": "network-vif-deleted", "tag": "91424783-dd6f-4de0-8380-f80d8bfcba58"}, {"server_uuid": "536a25a5-29bc-447e-9cf6-81b2db1ec700", "name": "network-vif-deleted", "tag": "b4a97479-abbd-4e8a-b47c-ebf03a104d41"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:46.749968 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-67e4c8cd-fdca-4108-8a21-1ac72102d3dc req-16cb0338-d770-43dd-a0ec-8d4ec4ba6929 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:46.750468 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-67e4c8cd-fdca-4108-8a21-1ac72102d3dc req-16cb0338-d770-43dd-a0ec-8d4ec4ba6929 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:46.750906 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-67e4c8cd-fdca-4108-8a21-1ac72102d3dc req-16cb0338-d770-43dd-a0ec-8d4ec4ba6929 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:46.770606 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-67e4c8cd-fdca-4108-8a21-1ac72102d3dc req-16cb0338-d770-43dd-a0ec-8d4ec4ba6929 service nova] Creating event network-vif-deleted:91424783-dd6f-4de0-8380-f80d8bfcba58 for instance 9399abef-0bdd-46db-9718-78e074738d1b on n-h1-master-1 Aug 07 01:23:46.771178 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-67e4c8cd-fdca-4108-8a21-1ac72102d3dc req-16cb0338-d770-43dd-a0ec-8d4ec4ba6929 service nova] Creating event network-vif-deleted:b4a97479-abbd-4e8a-b47c-ebf03a104d41 for instance 536a25a5-29bc-447e-9cf6-81b2db1ec700 on n-h1-master-1 Aug 07 01:23:46.806561 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-67e4c8cd-fdca-4108-8a21-1ac72102d3dc req-16cb0338-d770-43dd-a0ec-8d4ec4ba6929 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.080796 Aug 07 01:23:46.809590 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1585/2898] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:23:46.828504 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-caf6755a-ff37-4645-8d2a-cd28343ae93b tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:46.829248 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-caf6755a-ff37-4645-8d2a-cd28343ae93b tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] [instance: 1239e799-ec72-41c7-a2d3-19f5aee58ed4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:46.856860 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-caf6755a-ff37-4645-8d2a-cd28343ae93b tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:46.858551 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-caf6755a-ff37-4645-8d2a-cd28343ae93b tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:46.859027 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-caf6755a-ff37-4645-8d2a-cd28343ae93b tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:46.862877 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-caf6755a-ff37-4645-8d2a-cd28343ae93b tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:46.863592 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-caf6755a-ff37-4645-8d2a-cd28343ae93b tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:46.864213 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-caf6755a-ff37-4645-8d2a-cd28343ae93b tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:46.968240 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3d0e770a-9224-427e-bd01-058a56e6ebf4 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.446709 Aug 07 01:23:46.976740 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1314/2899] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Aug 7 01:23:46 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:46.985586 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-75cf362e-1549-425e-81d3-f0b62bbe12dd tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Action: 'update', calling method: .version_select at 0x7f9e29a36700>, body: {"security_group": {"name": "tempest-sg-hth-63305034", "description": "tempest-description-hth-1467791894"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:47.254598 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-caf6755a-ff37-4645-8d2a-cd28343ae93b tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a40e444e92495c917f58fbcec63c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e24336f2ab84adda758d98cbb785888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:47.269274 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-caf6755a-ff37-4645-8d2a-cd28343ae93b tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] 10.222.0.39 "GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4" status: 200 len: 1332 microversion: 2.1 time: 0.455211 Aug 07 01:23:47.271006 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1586/2900] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:46 2022] GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4 => generated 1332 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:47.325060 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f72414e3-f73e-4ffe-9bcf-a82d899d70b8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:47.325835 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f72414e3-f73e-4ffe-9bcf-a82d899d70b8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:47.338490 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f72414e3-f73e-4ffe-9bcf-a82d899d70b8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:47.340585 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f72414e3-f73e-4ffe-9bcf-a82d899d70b8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:47.341077 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f72414e3-f73e-4ffe-9bcf-a82d899d70b8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:47.341826 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f72414e3-f73e-4ffe-9bcf-a82d899d70b8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:47.342291 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f72414e3-f73e-4ffe-9bcf-a82d899d70b8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:47.344180 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f72414e3-f73e-4ffe-9bcf-a82d899d70b8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:47.560337 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-75cf362e-1549-425e-81d3-f0b62bbe12dd tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "PUT /compute/v2.1/os-security-groups/a5a34330-2fe1-42d7-908b-87e084b476a5" status: 200 len: 216 microversion: 2.1 time: 0.581711 Aug 07 01:23:47.560947 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1315/2901] 10.222.0.39 () {60 vars in 1290 bytes} [Sun Aug 7 01:23:46 2022] PUT /compute/v2.1/os-security-groups/a5a34330-2fe1-42d7-908b-87e084b476a5 => generated 216 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:47.565944 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-992841d1-e533-4271-82f0-dcf7b6192b6f tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:47.566803 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-992841d1-e533-4271-82f0-dcf7b6192b6f tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:47.580711 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-992841d1-e533-4271-82f0-dcf7b6192b6f tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:47.581407 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-992841d1-e533-4271-82f0-dcf7b6192b6f tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:47.582052 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-992841d1-e533-4271-82f0-dcf7b6192b6f tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:47.582959 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-992841d1-e533-4271-82f0-dcf7b6192b6f tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:47.585436 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-992841d1-e533-4271-82f0-dcf7b6192b6f tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:47.586063 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-992841d1-e533-4271-82f0-dcf7b6192b6f tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:47.670537 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-992841d1-e533-4271-82f0-dcf7b6192b6f tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:47.688832 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-992841d1-e533-4271-82f0-dcf7b6192b6f tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:47.691315 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-992841d1-e533-4271-82f0-dcf7b6192b6f tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:47.693730 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-992841d1-e533-4271-82f0-dcf7b6192b6f tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1266 microversion: 2.25 time: 0.131480 Aug 07 01:23:47.695291 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1316/2902] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:47 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1266 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:23:47.703744 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ac020b15-548d-4610-85ca-6a606fc4d5f2 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '.version_select at 0x7f9e17e370d0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:47.747480 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f72414e3-f73e-4ffe-9bcf-a82d899d70b8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:47.759822 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f72414e3-f73e-4ffe-9bcf-a82d899d70b8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1361 microversion: 2.1 time: 0.438671 Aug 07 01:23:47.762926 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1587/2903] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:47 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1361 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:23:47.788336 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ac020b15-548d-4610-85ca-6a606fc4d5f2 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups/a5a34330-2fe1-42d7-908b-87e084b476a5" status: 200 len: 216 microversion: 2.1 time: 0.089911 Aug 07 01:23:47.790651 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1317/2904] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Aug 7 01:23:47 2022] GET /compute/v2.1/os-security-groups/a5a34330-2fe1-42d7-908b-87e084b476a5 => generated 216 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:47.804371 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4ce55b7c-a39a-4982-88cc-35bbbdc3f553 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '.version_select at 0x7f9e240744c0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:48.293262 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-362701ce-5471-4252-a857-8b1e5f8c7913 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:48.294783 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-362701ce-5471-4252-a857-8b1e5f8c7913 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] [instance: 1239e799-ec72-41c7-a2d3-19f5aee58ed4] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:48.309643 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-362701ce-5471-4252-a857-8b1e5f8c7913 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:48.313896 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-362701ce-5471-4252-a857-8b1e5f8c7913 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:48.317680 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-362701ce-5471-4252-a857-8b1e5f8c7913 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:48.319226 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-362701ce-5471-4252-a857-8b1e5f8c7913 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:48.320212 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-362701ce-5471-4252-a857-8b1e5f8c7913 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:48.323752 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-362701ce-5471-4252-a857-8b1e5f8c7913 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:48.536996 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-362701ce-5471-4252-a857-8b1e5f8c7913 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a40e444e92495c917f58fbcec63c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e24336f2ab84adda758d98cbb785888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:48.546201 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-362701ce-5471-4252-a857-8b1e5f8c7913 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] 10.222.0.39 "GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4" status: 200 len: 1332 microversion: 2.1 time: 0.257920 Aug 07 01:23:48.546774 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1318/2905] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:48 2022] GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4 => generated 1332 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:23:48.717319 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-42c51731-af82-4537-b167-f593c87720ec tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:48.717933 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-42c51731-af82-4537-b167-f593c87720ec tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:48.724412 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-42c51731-af82-4537-b167-f593c87720ec tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:48.724897 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-42c51731-af82-4537-b167-f593c87720ec tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:48.725628 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-42c51731-af82-4537-b167-f593c87720ec tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:48.726506 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-42c51731-af82-4537-b167-f593c87720ec tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:48.727125 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-42c51731-af82-4537-b167-f593c87720ec tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:48.728189 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-42c51731-af82-4537-b167-f593c87720ec tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:48.816256 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-42c51731-af82-4537-b167-f593c87720ec tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:48.829781 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-42c51731-af82-4537-b167-f593c87720ec tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:48.832538 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-42c51731-af82-4537-b167-f593c87720ec tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:48.834251 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-42c51731-af82-4537-b167-f593c87720ec tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1266 microversion: 2.25 time: 0.120842 Aug 07 01:23:48.851028 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1319/2906] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:48 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:23:48.866366 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e6b1dd76-b7ad-451e-9366-3597a67de070 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:48.867569 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e6b1dd76-b7ad-451e-9366-3597a67de070 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:48.884098 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e6b1dd76-b7ad-451e-9366-3597a67de070 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:48.888111 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e6b1dd76-b7ad-451e-9366-3597a67de070 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:48.891605 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e6b1dd76-b7ad-451e-9366-3597a67de070 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:48.892839 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e6b1dd76-b7ad-451e-9366-3597a67de070 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:48.893508 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e6b1dd76-b7ad-451e-9366-3597a67de070 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:48.896467 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e6b1dd76-b7ad-451e-9366-3597a67de070 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:48.966041 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4ce55b7c-a39a-4982-88cc-35bbbdc3f553 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/a5a34330-2fe1-42d7-908b-87e084b476a5" status: 202 len: 0 microversion: 2.1 time: 1.166804 Aug 07 01:23:48.970421 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1588/2907] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:23:47 2022] DELETE /compute/v2.1/os-security-groups/a5a34330-2fe1-42d7-908b-87e084b476a5 => generated 0 bytes in 1169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:23:48.977276 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-13218001-c038-48ff-afdc-2ac9bb585940 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:48.978167 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-13218001-c038-48ff-afdc-2ac9bb585940 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 0b8441a7-9091-4b45-ac29-9023f2a6bc43] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:48.997440 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-13218001-c038-48ff-afdc-2ac9bb585940 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:49.000772 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-13218001-c038-48ff-afdc-2ac9bb585940 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:49.001555 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-13218001-c038-48ff-afdc-2ac9bb585940 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:49.004688 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-13218001-c038-48ff-afdc-2ac9bb585940 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:49.011325 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-13218001-c038-48ff-afdc-2ac9bb585940 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:49.012389 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-13218001-c038-48ff-afdc-2ac9bb585940 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:49.057374 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-13218001-c038-48ff-afdc-2ac9bb585940 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] HTTP exception thrown: Instance 0b8441a7-9091-4b45-ac29-9023f2a6bc43 could not be found. Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-13218001-c038-48ff-afdc-2ac9bb585940 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Request method failure captured: Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43 HTTP/1.1 Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xO08qP9itd1x7LkO549onPIQKYKrTn80RQpW5pCdeHaOqBQA0wDyajz8J-UALON-vNzJgXv0Ujib217Kc5O9bkWEANKCqcpJLGxO-2U8bRcRiaBsEe5TSczuDlBj3IZDQsdnYyQfIf9mOfj407D3QdxTi9cVsMgzz9HNwd9HVPDZu0 Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 791ad97e3c374d2d8494abc25b46a0bf Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_791ad97e3c374d2d8494abc25b46a0bf", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 791ad97e3c374d2d8494abc25b46a0bf Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-SecurityGroupsTestJSON-1082000213-project Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 51ab58be25a94cd6a59634e7c7cad158 Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-SecurityGroupsTestJSON-1082000213-project Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 0b8441a7-9091-4b45-ac29-9023f2a6bc43 could not be found. Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '0b8441a7-9091-4b45-ac29-9023f2a6bc43'} Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b8441a7-9091-4b45-ac29-9023f2a6bc43 could not be found. Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:23:49.063296 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:23:49.067199 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b8441a7-9091-4b45-ac29-9023f2a6bc43 could not be found. Aug 07 01:23:49.067199 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.067199 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:49.067199 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.067199 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:49.067199 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:49.067199 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:49.067199 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:23:49.067199 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:23:49.067199 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b8441a7-9091-4b45-ac29-9023f2a6bc43 could not be found. Aug 07 01:23:49.067199 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.072943 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-13218001-c038-48ff-afdc-2ac9bb585940 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Returning 404 to user: Instance 0b8441a7-9091-4b45-ac29-9023f2a6bc43 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:23:49.074117 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-13218001-c038-48ff-afdc-2ac9bb585940 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43" status: 404 len: 111 microversion: 2.1 time: 0.102341 Aug 07 01:23:49.074783 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1589/2908] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:23:48 2022] DELETE /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:23:49.085736 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f4ea5098-63a2-47ea-89e6-7c73880ffc3f tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:49.086539 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f4ea5098-63a2-47ea-89e6-7c73880ffc3f tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 0b8441a7-9091-4b45-ac29-9023f2a6bc43] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:49.094407 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f4ea5098-63a2-47ea-89e6-7c73880ffc3f tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:49.095315 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f4ea5098-63a2-47ea-89e6-7c73880ffc3f tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:49.096638 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f4ea5098-63a2-47ea-89e6-7c73880ffc3f tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:49.097692 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f4ea5098-63a2-47ea-89e6-7c73880ffc3f tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:49.098502 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f4ea5098-63a2-47ea-89e6-7c73880ffc3f tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:49.099339 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f4ea5098-63a2-47ea-89e6-7c73880ffc3f tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:49.128241 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-f4ea5098-63a2-47ea-89e6-7c73880ffc3f tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] HTTP exception thrown: Instance 0b8441a7-9091-4b45-ac29-9023f2a6bc43 could not be found. Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f4ea5098-63a2-47ea-89e6-7c73880ffc3f tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Request method failure captured: Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43 HTTP/1.1 Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xO08qP9itd1x7LkO549onPIQKYKrTn80RQpW5pCdeHaOqBQA0wDyajz8J-UALON-vNzJgXv0Ujib217Kc5O9bkWEANKCqcpJLGxO-2U8bRcRiaBsEe5TSczuDlBj3IZDQsdnYyQfIf9mOfj407D3QdxTi9cVsMgzz9HNwd9HVPDZu0 Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 791ad97e3c374d2d8494abc25b46a0bf Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_791ad97e3c374d2d8494abc25b46a0bf", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 791ad97e3c374d2d8494abc25b46a0bf Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-SecurityGroupsTestJSON-1082000213-project Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 51ab58be25a94cd6a59634e7c7cad158 Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-SecurityGroupsTestJSON-1082000213-project Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 0b8441a7-9091-4b45-ac29-9023f2a6bc43 could not be found. Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '0b8441a7-9091-4b45-ac29-9023f2a6bc43'} Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b8441a7-9091-4b45-ac29-9023f2a6bc43 could not be found. Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b8441a7-9091-4b45-ac29-9023f2a6bc43 could not be found. Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:49.130343 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.136195 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:49.136195 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:49.136195 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:49.136195 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:23:49.136195 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:23:49.136195 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b8441a7-9091-4b45-ac29-9023f2a6bc43 could not be found. Aug 07 01:23:49.136195 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.138855 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f4ea5098-63a2-47ea-89e6-7c73880ffc3f tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Returning 404 to user: Instance 0b8441a7-9091-4b45-ac29-9023f2a6bc43 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:23:49.140179 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f4ea5098-63a2-47ea-89e6-7c73880ffc3f tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43" status: 404 len: 111 microversion: 2.1 time: 0.058752 Aug 07 01:23:49.144391 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1590/2909] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:49 2022] GET /compute/v2.1/servers/0b8441a7-9091-4b45-ac29-9023f2a6bc43 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:23:49.152657 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-527a5126-468b-45da-b8f0-f91ff242f9c7 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '.version_select at 0x7f9e246d5e50>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:49.201507 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e6b1dd76-b7ad-451e-9366-3597a67de070 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:49.209987 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e6b1dd76-b7ad-451e-9366-3597a67de070 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1361 microversion: 2.1 time: 0.353947 Aug 07 01:23:49.224813 n-d-master-1 devstack@n-api.service[119516]: DEBUG neutronclient.v2_0.client [None req-527a5126-468b-45da-b8f0-f91ff242f9c7 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 94862e19-9a3f-4bfa-bcbf-3ab01ae83871 does not exist", "detail": ""}} {{(pid=119516) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 07 01:23:49.226677 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1320/2910] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:48 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1361 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:49.227228 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.security_group_api [None req-527a5126-468b-45da-b8f0-f91ff242f9c7 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Neutron security group 94862e19-9a3f-4bfa-bcbf-3ab01ae83871 not found {{(pid=119516) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 07 01:23:49.228512 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-527a5126-468b-45da-b8f0-f91ff242f9c7 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] HTTP exception thrown: Security group 94862e19-9a3f-4bfa-bcbf-3ab01ae83871 does not exist Aug 07 01:23:49.228512 n-d-master-1 devstack@n-api.service[119516]: Neutron server returns request_ids: ['req-cc85d089-54e6-44e7-9d15-5c2093a84179'] Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-527a5126-468b-45da-b8f0-f91ff242f9c7 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Request method failure captured: Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/os-security-groups/94862e19-9a3f-4bfa-bcbf-3ab01ae83871 HTTP/1.1 Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xO08qP9itd1x7LkO549onPIQKYKrTn80RQpW5pCdeHaOqBQA0wDyajz8J-UALON-vNzJgXv0Ujib217Kc5O9bkWEANKCqcpJLGxO-2U8bRcRiaBsEe5TSczuDlBj3IZDQsdnYyQfIf9mOfj407D3QdxTi9cVsMgzz9HNwd9HVPDZu0 Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 791ad97e3c374d2d8494abc25b46a0bf Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_791ad97e3c374d2d8494abc25b46a0bf", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 791ad97e3c374d2d8494abc25b46a0bf Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-SecurityGroupsTestJSON-1082000213-project Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 51ab58be25a94cd6a59634e7c7cad158 Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-SecurityGroupsTestJSON-1082000213-project Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: exception: Security group 94862e19-9a3f-4bfa-bcbf-3ab01ae83871 does not exist Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: Neutron server returns request_ids: ['req-cc85d089-54e6-44e7-9d15-5c2093a84179'] Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '94862e19-9a3f-4bfa-bcbf-3ab01ae83871'} Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 07 01:23:49.233027 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 94862e19-9a3f-4bfa-bcbf-3ab01ae83871 does not exist Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cc85d089-54e6-44e7-9d15-5c2093a84179'] Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 94862e19-9a3f-4bfa-bcbf-3ab01ae83871 does not exist Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cc85d089-54e6-44e7-9d15-5c2093a84179'] Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 94862e19-9a3f-4bfa-bcbf-3ab01ae83871 does not exist Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cc85d089-54e6-44e7-9d15-5c2093a84179'] Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 94862e19-9a3f-4bfa-bcbf-3ab01ae83871 does not exist Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cc85d089-54e6-44e7-9d15-5c2093a84179'] Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-527a5126-468b-45da-b8f0-f91ff242f9c7 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Returning 404 to user: Security group 94862e19-9a3f-4bfa-bcbf-3ab01ae83871 does not exist Aug 07 01:23:49.236926 n-d-master-1 devstack@n-api.service[119516]: Neutron server returns request_ids: ['req-cc85d089-54e6-44e7-9d15-5c2093a84179'] {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:23:49.240080 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-527a5126-468b-45da-b8f0-f91ff242f9c7 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/94862e19-9a3f-4bfa-bcbf-3ab01ae83871" status: 404 len: 194 microversion: 2.1 time: 0.093202 Aug 07 01:23:49.248167 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1591/2911] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:23:49 2022] DELETE /compute/v2.1/os-security-groups/94862e19-9a3f-4bfa-bcbf-3ab01ae83871 => generated 194 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:23:49.253750 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-02752eb4-ea93-4ed3-815b-e98d9241a22b tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '.version_select at 0x7f9e29a218b0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:49.311808 n-d-master-1 devstack@n-api.service[119517]: DEBUG neutronclient.v2_0.client [None req-02752eb4-ea93-4ed3-815b-e98d9241a22b tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 13028388-ce18-4c5b-b7a7-e92a5448e811 does not exist", "detail": ""}} {{(pid=119517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 07 01:23:49.312787 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.security_group_api [None req-02752eb4-ea93-4ed3-815b-e98d9241a22b tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Neutron security group 13028388-ce18-4c5b-b7a7-e92a5448e811 not found {{(pid=119517) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 07 01:23:49.312970 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-02752eb4-ea93-4ed3-815b-e98d9241a22b tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] HTTP exception thrown: Security group 13028388-ce18-4c5b-b7a7-e92a5448e811 does not exist Aug 07 01:23:49.312970 n-d-master-1 devstack@n-api.service[119517]: Neutron server returns request_ids: ['req-f5350863-ed90-42ee-b63c-4bf544c0846d'] Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-02752eb4-ea93-4ed3-815b-e98d9241a22b tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Request method failure captured: Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/os-security-groups/13028388-ce18-4c5b-b7a7-e92a5448e811 HTTP/1.1 Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xO08qP9itd1x7LkO549onPIQKYKrTn80RQpW5pCdeHaOqBQA0wDyajz8J-UALON-vNzJgXv0Ujib217Kc5O9bkWEANKCqcpJLGxO-2U8bRcRiaBsEe5TSczuDlBj3IZDQsdnYyQfIf9mOfj407D3QdxTi9cVsMgzz9HNwd9HVPDZu0 Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 791ad97e3c374d2d8494abc25b46a0bf Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_791ad97e3c374d2d8494abc25b46a0bf", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 791ad97e3c374d2d8494abc25b46a0bf Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-SecurityGroupsTestJSON-1082000213-project Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 51ab58be25a94cd6a59634e7c7cad158 Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-SecurityGroupsTestJSON-1082000213-project Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: exception: Security group 13028388-ce18-4c5b-b7a7-e92a5448e811 does not exist Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: Neutron server returns request_ids: ['req-f5350863-ed90-42ee-b63c-4bf544c0846d'] Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '13028388-ce18-4c5b-b7a7-e92a5448e811'} Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 07 01:23:49.315255 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 13028388-ce18-4c5b-b7a7-e92a5448e811 does not exist Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5350863-ed90-42ee-b63c-4bf544c0846d'] Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 13028388-ce18-4c5b-b7a7-e92a5448e811 does not exist Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5350863-ed90-42ee-b63c-4bf544c0846d'] Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 13028388-ce18-4c5b-b7a7-e92a5448e811 does not exist Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5350863-ed90-42ee-b63c-4bf544c0846d'] Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 13028388-ce18-4c5b-b7a7-e92a5448e811 does not exist Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5350863-ed90-42ee-b63c-4bf544c0846d'] Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-02752eb4-ea93-4ed3-815b-e98d9241a22b tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Returning 404 to user: Security group 13028388-ce18-4c5b-b7a7-e92a5448e811 does not exist Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: Neutron server returns request_ids: ['req-f5350863-ed90-42ee-b63c-4bf544c0846d'] {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-02752eb4-ea93-4ed3-815b-e98d9241a22b tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/13028388-ce18-4c5b-b7a7-e92a5448e811" status: 404 len: 194 microversion: 2.1 time: 0.068020 Aug 07 01:23:49.331856 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1321/2912] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:23:49 2022] DELETE /compute/v2.1/os-security-groups/13028388-ce18-4c5b-b7a7-e92a5448e811 => generated 194 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:23:49.342571 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-81fa72fd-b75d-40af-8aa8-0565b3c63eb5 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '.version_select at 0x7f9e299790d0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:49.505718 n-d-master-1 devstack@n-api.service[119516]: DEBUG neutronclient.v2_0.client [None req-81fa72fd-b75d-40af-8aa8-0565b3c63eb5 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 928c5f3b-2ea6-4a4c-ad74-c872e6f4bcd1 does not exist", "detail": ""}} {{(pid=119516) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 07 01:23:49.506647 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.security_group_api [None req-81fa72fd-b75d-40af-8aa8-0565b3c63eb5 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Neutron security group 928c5f3b-2ea6-4a4c-ad74-c872e6f4bcd1 not found {{(pid=119516) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 07 01:23:49.507418 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-81fa72fd-b75d-40af-8aa8-0565b3c63eb5 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] HTTP exception thrown: Security group 928c5f3b-2ea6-4a4c-ad74-c872e6f4bcd1 does not exist Aug 07 01:23:49.507418 n-d-master-1 devstack@n-api.service[119516]: Neutron server returns request_ids: ['req-941968cc-0486-4882-a5e1-a544dca595f9'] Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-81fa72fd-b75d-40af-8aa8-0565b3c63eb5 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Request method failure captured: Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/os-security-groups/928c5f3b-2ea6-4a4c-ad74-c872e6f4bcd1 HTTP/1.1 Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xO08qP9itd1x7LkO549onPIQKYKrTn80RQpW5pCdeHaOqBQA0wDyajz8J-UALON-vNzJgXv0Ujib217Kc5O9bkWEANKCqcpJLGxO-2U8bRcRiaBsEe5TSczuDlBj3IZDQsdnYyQfIf9mOfj407D3QdxTi9cVsMgzz9HNwd9HVPDZu0 Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 791ad97e3c374d2d8494abc25b46a0bf Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_791ad97e3c374d2d8494abc25b46a0bf", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 791ad97e3c374d2d8494abc25b46a0bf Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-SecurityGroupsTestJSON-1082000213-project Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 51ab58be25a94cd6a59634e7c7cad158 Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-SecurityGroupsTestJSON-1082000213-project Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: exception: Security group 928c5f3b-2ea6-4a4c-ad74-c872e6f4bcd1 does not exist Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: Neutron server returns request_ids: ['req-941968cc-0486-4882-a5e1-a544dca595f9'] Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '928c5f3b-2ea6-4a4c-ad74-c872e6f4bcd1'} Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 07 01:23:49.509892 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 928c5f3b-2ea6-4a4c-ad74-c872e6f4bcd1 does not exist Aug 07 01:23:49.513697 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-941968cc-0486-4882-a5e1-a544dca595f9'] Aug 07 01:23:49.513697 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.513697 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:49.513697 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.513697 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:49.513697 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 07 01:23:49.513697 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 07 01:23:49.513697 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 07 01:23:49.513697 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 07 01:23:49.513697 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 928c5f3b-2ea6-4a4c-ad74-c872e6f4bcd1 does not exist Aug 07 01:23:49.513697 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-941968cc-0486-4882-a5e1-a544dca595f9'] Aug 07 01:23:49.513697 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.513697 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:49.513697 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.513697 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:49.513697 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:49.513697 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:49.513697 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:23:49.513697 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:23:49.513697 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:23:49.513697 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:23:49.513697 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:23:49.513697 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:23:49.513697 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 07 01:23:49.513697 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 07 01:23:49.513697 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 928c5f3b-2ea6-4a4c-ad74-c872e6f4bcd1 does not exist Aug 07 01:23:49.513697 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-941968cc-0486-4882-a5e1-a544dca595f9'] Aug 07 01:23:49.513697 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.513697 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:49.513697 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.513697 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:49.513697 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:49.513697 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:49.513697 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:23:49.513697 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:23:49.513697 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 928c5f3b-2ea6-4a4c-ad74-c872e6f4bcd1 does not exist Aug 07 01:23:49.513697 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-941968cc-0486-4882-a5e1-a544dca595f9'] Aug 07 01:23:49.513697 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.518392 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-81fa72fd-b75d-40af-8aa8-0565b3c63eb5 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Returning 404 to user: Security group 928c5f3b-2ea6-4a4c-ad74-c872e6f4bcd1 does not exist Aug 07 01:23:49.518392 n-d-master-1 devstack@n-api.service[119516]: Neutron server returns request_ids: ['req-941968cc-0486-4882-a5e1-a544dca595f9'] {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:23:49.520153 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-81fa72fd-b75d-40af-8aa8-0565b3c63eb5 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/928c5f3b-2ea6-4a4c-ad74-c872e6f4bcd1" status: 404 len: 194 microversion: 2.1 time: 0.196223 Aug 07 01:23:49.521319 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1592/2913] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:23:49 2022] DELETE /compute/v2.1/os-security-groups/928c5f3b-2ea6-4a4c-ad74-c872e6f4bcd1 => generated 194 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:23:49.537570 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-72154e4e-3345-4738-9371-e995cf1935b9 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '.version_select at 0x7f9e17f82a60>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:49.569954 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d78bae0c-790f-458c-a839-e5e74e04d8b9 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:49.570356 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d78bae0c-790f-458c-a839-e5e74e04d8b9 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] [instance: 1239e799-ec72-41c7-a2d3-19f5aee58ed4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:49.594842 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d78bae0c-790f-458c-a839-e5e74e04d8b9 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:49.598313 n-d-master-1 devstack@n-api.service[119517]: DEBUG neutronclient.v2_0.client [None req-72154e4e-3345-4738-9371-e995cf1935b9 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6b002198-bc5a-48e8-8fdf-7757d2b91565 does not exist", "detail": ""}} {{(pid=119517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 07 01:23:49.598926 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.security_group_api [None req-72154e4e-3345-4738-9371-e995cf1935b9 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Neutron security group 6b002198-bc5a-48e8-8fdf-7757d2b91565 not found {{(pid=119517) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 07 01:23:49.599460 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-72154e4e-3345-4738-9371-e995cf1935b9 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] HTTP exception thrown: Security group 6b002198-bc5a-48e8-8fdf-7757d2b91565 does not exist Aug 07 01:23:49.599460 n-d-master-1 devstack@n-api.service[119517]: Neutron server returns request_ids: ['req-0e835779-1e83-44f6-94fc-7dd67ab3b0ac'] Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-72154e4e-3345-4738-9371-e995cf1935b9 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Request method failure captured: Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/os-security-groups/6b002198-bc5a-48e8-8fdf-7757d2b91565 HTTP/1.1 Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xO08qP9itd1x7LkO549onPIQKYKrTn80RQpW5pCdeHaOqBQA0wDyajz8J-UALON-vNzJgXv0Ujib217Kc5O9bkWEANKCqcpJLGxO-2U8bRcRiaBsEe5TSczuDlBj3IZDQsdnYyQfIf9mOfj407D3QdxTi9cVsMgzz9HNwd9HVPDZu0 Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 791ad97e3c374d2d8494abc25b46a0bf Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_791ad97e3c374d2d8494abc25b46a0bf", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 791ad97e3c374d2d8494abc25b46a0bf Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-SecurityGroupsTestJSON-1082000213-project Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 51ab58be25a94cd6a59634e7c7cad158 Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-SecurityGroupsTestJSON-1082000213-project Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: exception: Security group 6b002198-bc5a-48e8-8fdf-7757d2b91565 does not exist Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: Neutron server returns request_ids: ['req-0e835779-1e83-44f6-94fc-7dd67ab3b0ac'] Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '6b002198-bc5a-48e8-8fdf-7757d2b91565'} Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 07 01:23:49.602058 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6b002198-bc5a-48e8-8fdf-7757d2b91565 does not exist Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e835779-1e83-44f6-94fc-7dd67ab3b0ac'] Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6b002198-bc5a-48e8-8fdf-7757d2b91565 does not exist Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e835779-1e83-44f6-94fc-7dd67ab3b0ac'] Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6b002198-bc5a-48e8-8fdf-7757d2b91565 does not exist Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e835779-1e83-44f6-94fc-7dd67ab3b0ac'] Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6b002198-bc5a-48e8-8fdf-7757d2b91565 does not exist Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0e835779-1e83-44f6-94fc-7dd67ab3b0ac'] Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-72154e4e-3345-4738-9371-e995cf1935b9 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Returning 404 to user: Security group 6b002198-bc5a-48e8-8fdf-7757d2b91565 does not exist Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: Neutron server returns request_ids: ['req-0e835779-1e83-44f6-94fc-7dd67ab3b0ac'] {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:23:49.605980 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-72154e4e-3345-4738-9371-e995cf1935b9 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/6b002198-bc5a-48e8-8fdf-7757d2b91565" status: 404 len: 194 microversion: 2.1 time: 0.075447 Aug 07 01:23:49.611037 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d78bae0c-790f-458c-a839-e5e74e04d8b9 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:49.611037 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d78bae0c-790f-458c-a839-e5e74e04d8b9 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:49.611037 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d78bae0c-790f-458c-a839-e5e74e04d8b9 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:49.611037 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d78bae0c-790f-458c-a839-e5e74e04d8b9 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:49.611037 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d78bae0c-790f-458c-a839-e5e74e04d8b9 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:49.615926 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1322/2914] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:23:49 2022] DELETE /compute/v2.1/os-security-groups/6b002198-bc5a-48e8-8fdf-7757d2b91565 => generated 194 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:23:49.625679 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0a797860-0f15-4100-8eb6-401590c69fa7 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '.version_select at 0x7f9e29a22700>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:49.670696 n-d-master-1 devstack@n-api.service[119517]: DEBUG neutronclient.v2_0.client [None req-0a797860-0f15-4100-8eb6-401590c69fa7 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cf469416-e888-4dd0-b68f-0ed24cbe2419 does not exist", "detail": ""}} {{(pid=119517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 07 01:23:49.671601 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.security_group_api [None req-0a797860-0f15-4100-8eb6-401590c69fa7 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Neutron security group cf469416-e888-4dd0-b68f-0ed24cbe2419 not found {{(pid=119517) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 07 01:23:49.672421 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-0a797860-0f15-4100-8eb6-401590c69fa7 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] HTTP exception thrown: Security group cf469416-e888-4dd0-b68f-0ed24cbe2419 does not exist Aug 07 01:23:49.672421 n-d-master-1 devstack@n-api.service[119517]: Neutron server returns request_ids: ['req-d650383b-b1cb-4712-82a3-15398e3560b7'] Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0a797860-0f15-4100-8eb6-401590c69fa7 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Request method failure captured: Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/os-security-groups/cf469416-e888-4dd0-b68f-0ed24cbe2419 HTTP/1.1 Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xO08qP9itd1x7LkO549onPIQKYKrTn80RQpW5pCdeHaOqBQA0wDyajz8J-UALON-vNzJgXv0Ujib217Kc5O9bkWEANKCqcpJLGxO-2U8bRcRiaBsEe5TSczuDlBj3IZDQsdnYyQfIf9mOfj407D3QdxTi9cVsMgzz9HNwd9HVPDZu0 Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 791ad97e3c374d2d8494abc25b46a0bf Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_791ad97e3c374d2d8494abc25b46a0bf", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 791ad97e3c374d2d8494abc25b46a0bf Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-SecurityGroupsTestJSON-1082000213-project Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 51ab58be25a94cd6a59634e7c7cad158 Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-SecurityGroupsTestJSON-1082000213-project Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: exception: Security group cf469416-e888-4dd0-b68f-0ed24cbe2419 does not exist Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: Neutron server returns request_ids: ['req-d650383b-b1cb-4712-82a3-15398e3560b7'] Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'cf469416-e888-4dd0-b68f-0ed24cbe2419'} Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 07 01:23:49.675970 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cf469416-e888-4dd0-b68f-0ed24cbe2419 does not exist Aug 07 01:23:49.681428 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d650383b-b1cb-4712-82a3-15398e3560b7'] Aug 07 01:23:49.681428 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.681428 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:49.681428 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.681428 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:49.681428 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 07 01:23:49.681428 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 07 01:23:49.681428 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 07 01:23:49.681428 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 07 01:23:49.681428 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cf469416-e888-4dd0-b68f-0ed24cbe2419 does not exist Aug 07 01:23:49.681428 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d650383b-b1cb-4712-82a3-15398e3560b7'] Aug 07 01:23:49.681428 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.681428 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:49.681428 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.681428 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:49.681428 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:49.681428 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:49.681428 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:23:49.681428 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:23:49.681428 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:23:49.681428 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:23:49.681428 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:23:49.681428 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:23:49.681428 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 07 01:23:49.681428 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 07 01:23:49.681428 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cf469416-e888-4dd0-b68f-0ed24cbe2419 does not exist Aug 07 01:23:49.681428 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d650383b-b1cb-4712-82a3-15398e3560b7'] Aug 07 01:23:49.681428 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.681428 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:49.681428 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.681428 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:49.681428 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:49.681428 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:49.681428 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:23:49.681428 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:23:49.681428 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cf469416-e888-4dd0-b68f-0ed24cbe2419 does not exist Aug 07 01:23:49.681428 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d650383b-b1cb-4712-82a3-15398e3560b7'] Aug 07 01:23:49.681428 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.688296 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0a797860-0f15-4100-8eb6-401590c69fa7 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Returning 404 to user: Security group cf469416-e888-4dd0-b68f-0ed24cbe2419 does not exist Aug 07 01:23:49.688296 n-d-master-1 devstack@n-api.service[119517]: Neutron server returns request_ids: ['req-d650383b-b1cb-4712-82a3-15398e3560b7'] {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:23:49.688296 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0a797860-0f15-4100-8eb6-401590c69fa7 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/cf469416-e888-4dd0-b68f-0ed24cbe2419" status: 404 len: 194 microversion: 2.1 time: 0.071247 Aug 07 01:23:49.688296 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1323/2915] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:23:49 2022] DELETE /compute/v2.1/os-security-groups/cf469416-e888-4dd0-b68f-0ed24cbe2419 => generated 194 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:23:49.707073 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-209fbbff-333f-453e-ac51-69d1525d9f09 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '.version_select at 0x7f9e29a21af0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:49.760923 n-d-master-1 devstack@n-api.service[119517]: DEBUG neutronclient.v2_0.client [None req-209fbbff-333f-453e-ac51-69d1525d9f09 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e2280de3-252f-4dc1-b32c-99c902752847 does not exist", "detail": ""}} {{(pid=119517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 07 01:23:49.761540 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.security_group_api [None req-209fbbff-333f-453e-ac51-69d1525d9f09 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Neutron security group e2280de3-252f-4dc1-b32c-99c902752847 not found {{(pid=119517) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 07 01:23:49.762072 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-209fbbff-333f-453e-ac51-69d1525d9f09 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] HTTP exception thrown: Security group e2280de3-252f-4dc1-b32c-99c902752847 does not exist Aug 07 01:23:49.762072 n-d-master-1 devstack@n-api.service[119517]: Neutron server returns request_ids: ['req-47716eef-370d-40cd-89e3-dca806395215'] Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-209fbbff-333f-453e-ac51-69d1525d9f09 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Request method failure captured: Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/os-security-groups/e2280de3-252f-4dc1-b32c-99c902752847 HTTP/1.1 Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xO08qP9itd1x7LkO549onPIQKYKrTn80RQpW5pCdeHaOqBQA0wDyajz8J-UALON-vNzJgXv0Ujib217Kc5O9bkWEANKCqcpJLGxO-2U8bRcRiaBsEe5TSczuDlBj3IZDQsdnYyQfIf9mOfj407D3QdxTi9cVsMgzz9HNwd9HVPDZu0 Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 791ad97e3c374d2d8494abc25b46a0bf Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_791ad97e3c374d2d8494abc25b46a0bf", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 791ad97e3c374d2d8494abc25b46a0bf Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-SecurityGroupsTestJSON-1082000213-project Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 51ab58be25a94cd6a59634e7c7cad158 Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-SecurityGroupsTestJSON-1082000213-project Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: exception: Security group e2280de3-252f-4dc1-b32c-99c902752847 does not exist Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: Neutron server returns request_ids: ['req-47716eef-370d-40cd-89e3-dca806395215'] Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'e2280de3-252f-4dc1-b32c-99c902752847'} Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 07 01:23:49.764056 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e2280de3-252f-4dc1-b32c-99c902752847 does not exist Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-47716eef-370d-40cd-89e3-dca806395215'] Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e2280de3-252f-4dc1-b32c-99c902752847 does not exist Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-47716eef-370d-40cd-89e3-dca806395215'] Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e2280de3-252f-4dc1-b32c-99c902752847 does not exist Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-47716eef-370d-40cd-89e3-dca806395215'] Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e2280de3-252f-4dc1-b32c-99c902752847 does not exist Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-47716eef-370d-40cd-89e3-dca806395215'] Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-209fbbff-333f-453e-ac51-69d1525d9f09 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Returning 404 to user: Security group e2280de3-252f-4dc1-b32c-99c902752847 does not exist Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: Neutron server returns request_ids: ['req-47716eef-370d-40cd-89e3-dca806395215'] {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-209fbbff-333f-453e-ac51-69d1525d9f09 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/e2280de3-252f-4dc1-b32c-99c902752847" status: 404 len: 194 microversion: 2.1 time: 0.069015 Aug 07 01:23:49.768198 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1324/2916] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:23:49 2022] DELETE /compute/v2.1/os-security-groups/e2280de3-252f-4dc1-b32c-99c902752847 => generated 194 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:23:49.776626 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ce854739-dcd4-4718-9a30-5b21484395d8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:49.777138 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ce854739-dcd4-4718-9a30-5b21484395d8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 817c48ff-36fa-4ea6-8a75-672cfb8b6da5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:49.810281 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce854739-dcd4-4718-9a30-5b21484395d8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:49.810784 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce854739-dcd4-4718-9a30-5b21484395d8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:49.811226 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce854739-dcd4-4718-9a30-5b21484395d8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:49.812563 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce854739-dcd4-4718-9a30-5b21484395d8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:49.813027 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce854739-dcd4-4718-9a30-5b21484395d8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:49.813524 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce854739-dcd4-4718-9a30-5b21484395d8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:49.866960 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ce854739-dcd4-4718-9a30-5b21484395d8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 817c48ff-36fa-4ea6-8a75-672cfb8b6da5] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:23:50.111145 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ce854739-dcd4-4718-9a30-5b21484395d8 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "DELETE /compute/v2.1/servers/817c48ff-36fa-4ea6-8a75-672cfb8b6da5" status: 204 len: 0 microversion: 2.1 time: 0.338798 Aug 07 01:23:50.113988 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1325/2917] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:23:49 2022] DELETE /compute/v2.1/servers/817c48ff-36fa-4ea6-8a75-672cfb8b6da5 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 07 01:23:50.126432 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1f7b8267-e584-4df1-bbcf-b4ab9bff951e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:50.127143 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1f7b8267-e584-4df1-bbcf-b4ab9bff951e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:50.135361 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1f7b8267-e584-4df1-bbcf-b4ab9bff951e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:50.135853 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1f7b8267-e584-4df1-bbcf-b4ab9bff951e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:50.136327 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1f7b8267-e584-4df1-bbcf-b4ab9bff951e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:50.137038 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1f7b8267-e584-4df1-bbcf-b4ab9bff951e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:50.137510 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1f7b8267-e584-4df1-bbcf-b4ab9bff951e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:50.138137 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1f7b8267-e584-4df1-bbcf-b4ab9bff951e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:50.157989 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d78bae0c-790f-458c-a839-e5e74e04d8b9 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a40e444e92495c917f58fbcec63c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e24336f2ab84adda758d98cbb785888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:50.170720 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d78bae0c-790f-458c-a839-e5e74e04d8b9 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] 10.222.0.39 "GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4" status: 200 len: 1536 microversion: 2.1 time: 0.603903 Aug 07 01:23:50.188653 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1593/2918] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:49 2022] GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4 => generated 1536 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:50.206125 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-8df1c3a5-9403-45cf-8bc5-ce11ae1fdda7 req-7b7c597e-9819-40ba-9ffd-62e6f40b7976 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e39f0d23-55ab-417b-818e-92de14de44c0", "name": "network-vif-plugged", "status": "completed", "tag": "04267581-58b6-42a6-92a4-4f79278a63aa"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:50.240918 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-8df1c3a5-9403-45cf-8bc5-ce11ae1fdda7 req-7b7c597e-9819-40ba-9ffd-62e6f40b7976 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:50.245705 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-8df1c3a5-9403-45cf-8bc5-ce11ae1fdda7 req-7b7c597e-9819-40ba-9ffd-62e6f40b7976 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:50.246748 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-8df1c3a5-9403-45cf-8bc5-ce11ae1fdda7 req-7b7c597e-9819-40ba-9ffd-62e6f40b7976 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:50.287049 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-8df1c3a5-9403-45cf-8bc5-ce11ae1fdda7 req-7b7c597e-9819-40ba-9ffd-62e6f40b7976 service nova] Creating event network-vif-plugged:04267581-58b6-42a6-92a4-4f79278a63aa for instance e39f0d23-55ab-417b-818e-92de14de44c0 on n-h2-master-1 Aug 07 01:23:50.308436 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1f7b8267-e584-4df1-bbcf-b4ab9bff951e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:50.313080 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-8df1c3a5-9403-45cf-8bc5-ce11ae1fdda7 req-7b7c597e-9819-40ba-9ffd-62e6f40b7976 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122682 Aug 07 01:23:50.317565 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1594/2919] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:50.320566 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1f7b8267-e584-4df1-bbcf-b4ab9bff951e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:50.322644 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1f7b8267-e584-4df1-bbcf-b4ab9bff951e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:50.324111 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1f7b8267-e584-4df1-bbcf-b4ab9bff951e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1266 microversion: 2.25 time: 0.202325 Aug 07 01:23:50.324863 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1326/2920] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:50 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:23:50.326510 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-35652a04-296e-46d1-b7d5-2553ac2ad0ee tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:50.327993 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-35652a04-296e-46d1-b7d5-2553ac2ad0ee tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 817c48ff-36fa-4ea6-8a75-672cfb8b6da5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:50.348214 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d81a251f-4597-48af-a3e5-9a72033dce12 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Action: 'create', calling method: .version_select at 0x7f9e17e3baf0>, body: {"pool": "8049ef63-728c-4ad0-8526-50dc3e712e09"} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:50.366810 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-35652a04-296e-46d1-b7d5-2553ac2ad0ee tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:50.367498 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-35652a04-296e-46d1-b7d5-2553ac2ad0ee tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:50.368727 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-35652a04-296e-46d1-b7d5-2553ac2ad0ee tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:50.370130 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-35652a04-296e-46d1-b7d5-2553ac2ad0ee tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:50.370929 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-35652a04-296e-46d1-b7d5-2553ac2ad0ee tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:50.371710 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-35652a04-296e-46d1-b7d5-2553ac2ad0ee tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:50.942180 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-35652a04-296e-46d1-b7d5-2553ac2ad0ee tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab58be25a94cd6a59634e7c7cad158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791ad97e3c374d2d8494abc25b46a0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:50.952753 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-35652a04-296e-46d1-b7d5-2553ac2ad0ee tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/servers/817c48ff-36fa-4ea6-8a75-672cfb8b6da5" status: 200 len: 1646 microversion: 2.1 time: 0.633891 Aug 07 01:23:50.953376 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1595/2921] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:50 2022] GET /compute/v2.1/servers/817c48ff-36fa-4ea6-8a75-672cfb8b6da5 => generated 1646 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:50.971277 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fa909921-6724-48d3-ac39-89c7bca5dbec tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:50.972345 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fa909921-6724-48d3-ac39-89c7bca5dbec tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:50.988352 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa909921-6724-48d3-ac39-89c7bca5dbec tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:50.989416 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa909921-6724-48d3-ac39-89c7bca5dbec tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:50.990022 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa909921-6724-48d3-ac39-89c7bca5dbec tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:50.991433 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa909921-6724-48d3-ac39-89c7bca5dbec tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:50.992089 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa909921-6724-48d3-ac39-89c7bca5dbec tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:50.992686 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa909921-6724-48d3-ac39-89c7bca5dbec tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:51.293614 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fa909921-6724-48d3-ac39-89c7bca5dbec tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:51.311621 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fa909921-6724-48d3-ac39-89c7bca5dbec tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1361 microversion: 2.1 time: 0.352383 Aug 07 01:23:51.315575 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1596/2922] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:50 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1361 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:51.324715 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4b251f7c-37fe-449f-ba38-73f3cde77b5e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:51.325231 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4b251f7c-37fe-449f-ba38-73f3cde77b5e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 51642c80-018a-4126-be66-97ced5cefece] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:51.344927 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b251f7c-37fe-449f-ba38-73f3cde77b5e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:51.345429 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b251f7c-37fe-449f-ba38-73f3cde77b5e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:51.345878 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b251f7c-37fe-449f-ba38-73f3cde77b5e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:51.346606 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b251f7c-37fe-449f-ba38-73f3cde77b5e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:51.347072 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b251f7c-37fe-449f-ba38-73f3cde77b5e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:51.347508 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b251f7c-37fe-449f-ba38-73f3cde77b5e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:51.371801 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-4b251f7c-37fe-449f-ba38-73f3cde77b5e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] HTTP exception thrown: Instance 51642c80-018a-4126-be66-97ced5cefece could not be found. Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4b251f7c-37fe-449f-ba38-73f3cde77b5e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Request method failure captured: Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece HTTP/1.1 Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xOmDixoOe5zESLEYDXA3axJNRP6bGIp2s8bsDueZmxkJOpZQpG1lySHsKEJwVaRwpeMoczbg3dNvWHOCd_gHZWNk1LiXQTx7fKsKxID1y_LZjG_VPVKnF0DLo2BFr_7w9sMgiCQLlafu9KThwRV0woNm4alGRtyWM2huHJZPVTWYRA Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 7e166fb219464337af5e274671580d80 Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersTestMultiNic-1944764525 Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7e166fb219464337af5e274671580d80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7e166fb219464337af5e274671580d80", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7e166fb219464337af5e274671580d80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7e166fb219464337af5e274671580d80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersTestMultiNic-1944764525 Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 7e166fb219464337af5e274671580d80 Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersTestMultiNic-1944764525 Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersTestMultiNic-1944764525-project Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: d60a6557665a43cda4a64a83c92e2998 Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersTestMultiNic-1944764525-project Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 51642c80-018a-4126-be66-97ced5cefece could not be found. Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '51642c80-018a-4126-be66-97ced5cefece'} Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51642c80-018a-4126-be66-97ced5cefece could not be found. Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:23:51.373543 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:23:51.378191 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51642c80-018a-4126-be66-97ced5cefece could not be found. Aug 07 01:23:51.378191 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:51.378191 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:51.378191 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:51.378191 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:51.378191 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:51.378191 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:51.378191 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:23:51.378191 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:23:51.378191 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51642c80-018a-4126-be66-97ced5cefece could not be found. Aug 07 01:23:51.378191 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:51.387708 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4b251f7c-37fe-449f-ba38-73f3cde77b5e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Returning 404 to user: Instance 51642c80-018a-4126-be66-97ced5cefece could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:23:51.390958 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4b251f7c-37fe-449f-ba38-73f3cde77b5e tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "DELETE /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece" status: 404 len: 111 microversion: 2.1 time: 0.072209 Aug 07 01:23:51.392653 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1597/2923] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:23:51 2022] DELETE /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:23:51.404109 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fc8ff4a3-ab15-44d0-8371-d95be318a610 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:51.409260 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fc8ff4a3-ab15-44d0-8371-d95be318a610 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:51.427116 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc8ff4a3-ab15-44d0-8371-d95be318a610 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:51.428255 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc8ff4a3-ab15-44d0-8371-d95be318a610 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:51.428920 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc8ff4a3-ab15-44d0-8371-d95be318a610 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:51.430375 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc8ff4a3-ab15-44d0-8371-d95be318a610 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:51.431194 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc8ff4a3-ab15-44d0-8371-d95be318a610 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:51.432035 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc8ff4a3-ab15-44d0-8371-d95be318a610 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:51.633019 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fc8ff4a3-ab15-44d0-8371-d95be318a610 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:51.648101 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fc8ff4a3-ab15-44d0-8371-d95be318a610 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:51.651842 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fc8ff4a3-ab15-44d0-8371-d95be318a610 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:51.661124 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fc8ff4a3-ab15-44d0-8371-d95be318a610 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 200 len: 1266 microversion: 2.25 time: 0.263321 Aug 07 01:23:51.661778 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1598/2924] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:51 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 1266 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:23:51.684280 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2b8e5949-4166-49c1-a849-2ea0af0cf3a5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:51.685580 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2b8e5949-4166-49c1-a849-2ea0af0cf3a5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 51642c80-018a-4126-be66-97ced5cefece] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:51.701116 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2b8e5949-4166-49c1-a849-2ea0af0cf3a5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:51.702009 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2b8e5949-4166-49c1-a849-2ea0af0cf3a5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:51.702648 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2b8e5949-4166-49c1-a849-2ea0af0cf3a5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:51.704808 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2b8e5949-4166-49c1-a849-2ea0af0cf3a5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:51.705789 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2b8e5949-4166-49c1-a849-2ea0af0cf3a5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:51.708205 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2b8e5949-4166-49c1-a849-2ea0af0cf3a5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:51.796328 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-2b8e5949-4166-49c1-a849-2ea0af0cf3a5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] HTTP exception thrown: Instance 51642c80-018a-4126-be66-97ced5cefece could not be found. Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2b8e5949-4166-49c1-a849-2ea0af0cf3a5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Request method failure captured: Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece HTTP/1.1 Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xOmDixoOe5zESLEYDXA3axJNRP6bGIp2s8bsDueZmxkJOpZQpG1lySHsKEJwVaRwpeMoczbg3dNvWHOCd_gHZWNk1LiXQTx7fKsKxID1y_LZjG_VPVKnF0DLo2BFr_7w9sMgiCQLlafu9KThwRV0woNm4alGRtyWM2huHJZPVTWYRA Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 7e166fb219464337af5e274671580d80 Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersTestMultiNic-1944764525 Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7e166fb219464337af5e274671580d80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7e166fb219464337af5e274671580d80", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7e166fb219464337af5e274671580d80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7e166fb219464337af5e274671580d80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersTestMultiNic-1944764525 Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 7e166fb219464337af5e274671580d80 Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersTestMultiNic-1944764525 Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersTestMultiNic-1944764525-project Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: d60a6557665a43cda4a64a83c92e2998 Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersTestMultiNic-1944764525-project Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 51642c80-018a-4126-be66-97ced5cefece could not be found. Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '51642c80-018a-4126-be66-97ced5cefece'} Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51642c80-018a-4126-be66-97ced5cefece could not be found. Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51642c80-018a-4126-be66-97ced5cefece could not be found. Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:51.802325 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:51.807335 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:51.807335 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:51.807335 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:51.807335 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:23:51.807335 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:23:51.807335 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51642c80-018a-4126-be66-97ced5cefece could not be found. Aug 07 01:23:51.807335 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:51.807335 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2b8e5949-4166-49c1-a849-2ea0af0cf3a5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Returning 404 to user: Instance 51642c80-018a-4126-be66-97ced5cefece could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:23:51.807335 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2b8e5949-4166-49c1-a849-2ea0af0cf3a5 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece" status: 404 len: 111 microversion: 2.1 time: 0.141135 Aug 07 01:23:51.813293 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1599/2925] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:51 2022] GET /compute/v2.1/servers/51642c80-018a-4126-be66-97ced5cefece => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:23:51.827591 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-94f75714-8271-4b73-8c2b-fd3ef1cdff71 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:51.844239 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-94f75714-8271-4b73-8c2b-fd3ef1cdff71 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2185c595c9df4719bdca76d8797c76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5267b6a8e34a4397cd94fae11283be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:51.845274 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-94f75714-8271-4b73-8c2b-fd3ef1cdff71 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Searching by: {'deleted': False, 'project_id': '6a5267b6a8e34a4397cd94fae11283be'} {{(pid=119516) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:23:51.860823 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94f75714-8271-4b73-8c2b-fd3ef1cdff71 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:51.861366 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94f75714-8271-4b73-8c2b-fd3ef1cdff71 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:51.861883 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94f75714-8271-4b73-8c2b-fd3ef1cdff71 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:51.864946 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94f75714-8271-4b73-8c2b-fd3ef1cdff71 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:51.865444 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94f75714-8271-4b73-8c2b-fd3ef1cdff71 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:51.865909 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94f75714-8271-4b73-8c2b-fd3ef1cdff71 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:51.917492 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.multi_cell_list [None req-94f75714-8271-4b73-8c2b-fd3ef1cdff71 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 01:23:52.007317 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-94f75714-8271-4b73-8c2b-fd3ef1cdff71 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.189508 Aug 07 01:23:52.008550 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1600/2926] 10.222.0.39 () {58 vars in 1125 bytes} [Sun Aug 7 01:23:51 2022] GET /compute/v2.1/servers => generated 340 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:52.019484 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0f17ec9d-5251-4559-8ba0-b104c961f7a6 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:52.021136 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0f17ec9d-5251-4559-8ba0-b104c961f7a6 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 72538b92-6b72-4a50-96da-74b7d88bcd3c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:52.056571 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f17ec9d-5251-4559-8ba0-b104c961f7a6 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:52.057456 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f17ec9d-5251-4559-8ba0-b104c961f7a6 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:52.058130 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f17ec9d-5251-4559-8ba0-b104c961f7a6 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:52.060092 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f17ec9d-5251-4559-8ba0-b104c961f7a6 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:52.061361 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f17ec9d-5251-4559-8ba0-b104c961f7a6 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:52.062709 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f17ec9d-5251-4559-8ba0-b104c961f7a6 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:52.094507 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-0f17ec9d-5251-4559-8ba0-b104c961f7a6 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] HTTP exception thrown: Instance 72538b92-6b72-4a50-96da-74b7d88bcd3c could not be found. Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0f17ec9d-5251-4559-8ba0-b104c961f7a6 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Request method failure captured: Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c HTTP/1.1 Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xOmDixoOe5zESLEYDXA3axJNRP6bGIp2s8bsDueZmxkJOpZQpG1lySHsKEJwVaRwpeMoczbg3dNvWHOCd_gHZWNk1LiXQTx7fKsKxID1y_LZjG_VPVKnF0DLo2BFr_7w9sMgiCQLlafu9KThwRV0woNm4alGRtyWM2huHJZPVTWYRA Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 7e166fb219464337af5e274671580d80 Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersTestMultiNic-1944764525 Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7e166fb219464337af5e274671580d80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7e166fb219464337af5e274671580d80", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7e166fb219464337af5e274671580d80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7e166fb219464337af5e274671580d80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersTestMultiNic-1944764525 Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 7e166fb219464337af5e274671580d80 Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersTestMultiNic-1944764525 Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersTestMultiNic-1944764525-project Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: d60a6557665a43cda4a64a83c92e2998 Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersTestMultiNic-1944764525-project Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 72538b92-6b72-4a50-96da-74b7d88bcd3c could not be found. Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '72538b92-6b72-4a50-96da-74b7d88bcd3c'} Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72538b92-6b72-4a50-96da-74b7d88bcd3c could not be found. Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:23:52.096727 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:23:52.101430 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72538b92-6b72-4a50-96da-74b7d88bcd3c could not be found. Aug 07 01:23:52.101430 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:52.101430 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:52.101430 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:52.101430 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:52.101430 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:52.101430 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:52.101430 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:23:52.101430 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:23:52.101430 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72538b92-6b72-4a50-96da-74b7d88bcd3c could not be found. Aug 07 01:23:52.101430 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:52.101430 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0f17ec9d-5251-4559-8ba0-b104c961f7a6 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Returning 404 to user: Instance 72538b92-6b72-4a50-96da-74b7d88bcd3c could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:23:52.104042 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0f17ec9d-5251-4559-8ba0-b104c961f7a6 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "DELETE /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c" status: 404 len: 111 microversion: 2.1 time: 0.093723 Aug 07 01:23:52.104740 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1601/2927] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:23:52 2022] DELETE /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:23:52.122704 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ef5286dc-5e6a-43e0-9870-3326874b412a tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:52.123925 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ef5286dc-5e6a-43e0-9870-3326874b412a tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 817c48ff-36fa-4ea6-8a75-672cfb8b6da5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:52.136790 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef5286dc-5e6a-43e0-9870-3326874b412a tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:52.137654 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef5286dc-5e6a-43e0-9870-3326874b412a tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:52.138378 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef5286dc-5e6a-43e0-9870-3326874b412a tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:52.139541 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef5286dc-5e6a-43e0-9870-3326874b412a tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:52.140275 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef5286dc-5e6a-43e0-9870-3326874b412a tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:52.140931 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef5286dc-5e6a-43e0-9870-3326874b412a tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:52.533877 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ef5286dc-5e6a-43e0-9870-3326874b412a tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ab58be25a94cd6a59634e7c7cad158', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '791ad97e3c374d2d8494abc25b46a0bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:52.543876 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ef5286dc-5e6a-43e0-9870-3326874b412a tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/servers/817c48ff-36fa-4ea6-8a75-672cfb8b6da5" status: 200 len: 1646 microversion: 2.1 time: 0.437821 Aug 07 01:23:52.547350 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1602/2928] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:52 2022] GET /compute/v2.1/servers/817c48ff-36fa-4ea6-8a75-672cfb8b6da5 => generated 1646 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:52.554728 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-af949ccd-78de-4051-8a0d-c0982a0b6095 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:52.560642 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-af949ccd-78de-4051-8a0d-c0982a0b6095 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2185c595c9df4719bdca76d8797c76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5267b6a8e34a4397cd94fae11283be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:52.569675 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-af949ccd-78de-4051-8a0d-c0982a0b6095 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Searching by: {'deleted': False, 'project_id': '6a5267b6a8e34a4397cd94fae11283be'} {{(pid=119516) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:23:52.588353 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af949ccd-78de-4051-8a0d-c0982a0b6095 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:52.589764 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af949ccd-78de-4051-8a0d-c0982a0b6095 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:52.590394 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af949ccd-78de-4051-8a0d-c0982a0b6095 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:52.591375 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af949ccd-78de-4051-8a0d-c0982a0b6095 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:52.592131 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af949ccd-78de-4051-8a0d-c0982a0b6095 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:52.592734 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af949ccd-78de-4051-8a0d-c0982a0b6095 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:52.619794 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d81a251f-4597-48af-a3e5-9a72033dce12 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 2.282980 Aug 07 01:23:52.622491 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1327/2929] 10.222.0.39 () {60 vars in 1170 bytes} [Sun Aug 7 01:23:50 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 2297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:52.650764 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.multi_cell_list [None req-af949ccd-78de-4051-8a0d-c0982a0b6095 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 01:23:52.651344 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bcfaace7-a9de-4c16-bdc3-f77922f37f19 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:52.653908 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bcfaace7-a9de-4c16-bdc3-f77922f37f19 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] [instance: 72538b92-6b72-4a50-96da-74b7d88bcd3c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:52.679044 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bcfaace7-a9de-4c16-bdc3-f77922f37f19 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:52.680200 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bcfaace7-a9de-4c16-bdc3-f77922f37f19 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:52.681292 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bcfaace7-a9de-4c16-bdc3-f77922f37f19 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:52.683526 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bcfaace7-a9de-4c16-bdc3-f77922f37f19 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:52.684561 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bcfaace7-a9de-4c16-bdc3-f77922f37f19 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:52.687297 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bcfaace7-a9de-4c16-bdc3-f77922f37f19 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:52.731365 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-bcfaace7-a9de-4c16-bdc3-f77922f37f19 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] HTTP exception thrown: Instance 72538b92-6b72-4a50-96da-74b7d88bcd3c could not be found. Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bcfaace7-a9de-4c16-bdc3-f77922f37f19 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Request method failure captured: Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c HTTP/1.1 Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xOmDixoOe5zESLEYDXA3axJNRP6bGIp2s8bsDueZmxkJOpZQpG1lySHsKEJwVaRwpeMoczbg3dNvWHOCd_gHZWNk1LiXQTx7fKsKxID1y_LZjG_VPVKnF0DLo2BFr_7w9sMgiCQLlafu9KThwRV0woNm4alGRtyWM2huHJZPVTWYRA Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 7e166fb219464337af5e274671580d80 Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersTestMultiNic-1944764525 Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7e166fb219464337af5e274671580d80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7e166fb219464337af5e274671580d80", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7e166fb219464337af5e274671580d80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7e166fb219464337af5e274671580d80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersTestMultiNic-1944764525 Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 7e166fb219464337af5e274671580d80 Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersTestMultiNic-1944764525 Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersTestMultiNic-1944764525-project Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d60a6557665a43cda4a64a83c92e2998 Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersTestMultiNic-1944764525-project Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 72538b92-6b72-4a50-96da-74b7d88bcd3c could not be found. Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '72538b92-6b72-4a50-96da-74b7d88bcd3c'} Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72538b92-6b72-4a50-96da-74b7d88bcd3c could not be found. Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72538b92-6b72-4a50-96da-74b7d88bcd3c could not be found. Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:52.733524 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:52.737760 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:52.737760 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:52.737760 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:52.737760 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:23:52.737760 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:23:52.737760 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72538b92-6b72-4a50-96da-74b7d88bcd3c could not be found. Aug 07 01:23:52.737760 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:23:52.740973 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bcfaace7-a9de-4c16-bdc3-f77922f37f19 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] Returning 404 to user: Instance 72538b92-6b72-4a50-96da-74b7d88bcd3c could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:23:52.743472 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bcfaace7-a9de-4c16-bdc3-f77922f37f19 tempest-ServersTestMultiNic-1944764525 tempest-ServersTestMultiNic-1944764525-project] 10.222.0.39 "GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c" status: 404 len: 111 microversion: 2.1 time: 0.119049 Aug 07 01:23:52.744406 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1328/2930] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:52 2022] GET /compute/v2.1/servers/72538b92-6b72-4a50-96da-74b7d88bcd3c => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:23:52.750841 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-af949ccd-78de-4051-8a0d-c0982a0b6095 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2185c595c9df4719bdca76d8797c76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5267b6a8e34a4397cd94fae11283be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:52.760296 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-aadb7b91-de51-4771-9c43-ff37ff899a68 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:52.761332 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-aadb7b91-de51-4771-9c43-ff37ff899a68 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:52.768791 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aadb7b91-de51-4771-9c43-ff37ff899a68 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:52.769961 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aadb7b91-de51-4771-9c43-ff37ff899a68 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:52.770686 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aadb7b91-de51-4771-9c43-ff37ff899a68 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:52.770809 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af949ccd-78de-4051-8a0d-c0982a0b6095 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:52.771247 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af949ccd-78de-4051-8a0d-c0982a0b6095 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:52.771761 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af949ccd-78de-4051-8a0d-c0982a0b6095 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:52.772355 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aadb7b91-de51-4771-9c43-ff37ff899a68 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:52.773332 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aadb7b91-de51-4771-9c43-ff37ff899a68 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:52.773993 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aadb7b91-de51-4771-9c43-ff37ff899a68 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:53.125502 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-aadb7b91-de51-4771-9c43-ff37ff899a68 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:53.145418 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-aadb7b91-de51-4771-9c43-ff37ff899a68 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1548 microversion: 2.1 time: 0.397884 Aug 07 01:23:53.146267 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1329/2931] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:52 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1548 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:53.155714 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0b9c042f-0193-495e-909b-5c36ec0d9188 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.7"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:53.164814 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0b9c042f-0193-495e-909b-5c36ec0d9188 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] [instance: 1239e799-ec72-41c7-a2d3-19f5aee58ed4] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:53.175456 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b9c042f-0193-495e-909b-5c36ec0d9188 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:53.182281 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b9c042f-0193-495e-909b-5c36ec0d9188 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:53.182952 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b9c042f-0193-495e-909b-5c36ec0d9188 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:53.186617 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b9c042f-0193-495e-909b-5c36ec0d9188 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:53.187468 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b9c042f-0193-495e-909b-5c36ec0d9188 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:53.188132 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b9c042f-0193-495e-909b-5c36ec0d9188 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:53.242638 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b9c042f-0193-495e-909b-5c36ec0d9188 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "refresh_cache-1239e799-ec72-41c7-a2d3-19f5aee58ed4" {{(pid=119517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 07 01:23:53.243991 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b9c042f-0193-495e-909b-5c36ec0d9188 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquired lock "refresh_cache-1239e799-ec72-41c7-a2d3-19f5aee58ed4" {{(pid=119517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 07 01:23:53.368874 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-af949ccd-78de-4051-8a0d-c0982a0b6095 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] 10.222.0.39 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.817983 Aug 07 01:23:53.370293 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1603/2932] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:23:52 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:53.391522 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-76c4ef70-485f-4d14-8fbf-94c6ae4d9bee tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:53.392781 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-76c4ef70-485f-4d14-8fbf-94c6ae4d9bee tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 536a25a5-29bc-447e-9cf6-81b2db1ec700] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:53.394893 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:53.410809 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-76c4ef70-485f-4d14-8fbf-94c6ae4d9bee tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:53.411200 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-76c4ef70-485f-4d14-8fbf-94c6ae4d9bee tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:53.411974 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-76c4ef70-485f-4d14-8fbf-94c6ae4d9bee tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:53.413023 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-76c4ef70-485f-4d14-8fbf-94c6ae4d9bee tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:53.413737 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-76c4ef70-485f-4d14-8fbf-94c6ae4d9bee tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:53.414279 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-76c4ef70-485f-4d14-8fbf-94c6ae4d9bee tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:53.488616 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-76c4ef70-485f-4d14-8fbf-94c6ae4d9bee tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] HTTP exception thrown: Instance 536a25a5-29bc-447e-9cf6-81b2db1ec700 could not be found. Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-76c4ef70-485f-4d14-8fbf-94c6ae4d9bee tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Request method failure captured: Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 HTTP/1.1 Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xJoqlTATLW8uMDMoZMXyKBzWleBkINAFeIL-mnaWrG6RXbT2iO7g_wynN1U-Z8CziPuyfNUmUBCtPWxuKC8V0l12Oal7bq2L0teRKF_r8EC6r__AOrALmDS_q5pM_7u-u8KNsMHj2IfS7MEbtLL4E3bfsWaqGPiPtnFAYAy7y3bBJ0 Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: X-Openstack-Nova-Api-Version: 2.25 Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 1371b7aebfcf4088a02780393de8200f Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-415415489 Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1371b7aebfcf4088a02780393de8200f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1371b7aebfcf4088a02780393de8200f", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1371b7aebfcf4088a02780393de8200f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1371b7aebfcf4088a02780393de8200f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-415415489 Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 1371b7aebfcf4088a02780393de8200f Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-415415489 Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-LiveAutoBlockMigrationV225Test-415415489-project Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 45ed48709ab84fa4b5b341332a843ad8 Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-415415489-project Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 536a25a5-29bc-447e-9cf6-81b2db1ec700 could not be found. Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '536a25a5-29bc-447e-9cf6-81b2db1ec700'} Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 536a25a5-29bc-447e-9cf6-81b2db1ec700 could not be found. Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 536a25a5-29bc-447e-9cf6-81b2db1ec700 could not be found. Aug 07 01:23:53.491378 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:53.498856 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:53.498856 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:53.498856 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:53.498856 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:53.498856 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:53.498856 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:23:53.498856 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:23:53.498856 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 536a25a5-29bc-447e-9cf6-81b2db1ec700 could not be found. Aug 07 01:23:53.498856 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:53.503385 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-76c4ef70-485f-4d14-8fbf-94c6ae4d9bee tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Returning 404 to user: Instance 536a25a5-29bc-447e-9cf6-81b2db1ec700 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:23:53.505220 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-76c4ef70-485f-4d14-8fbf-94c6ae4d9bee tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700" status: 404 len: 111 microversion: 2.25 time: 0.133726 Aug 07 01:23:53.507264 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1604/2933] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:23:53 2022] GET /compute/v2.1/servers/536a25a5-29bc-447e-9cf6-81b2db1ec700 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:23:53.516303 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-abb8df80-793f-4ab5-bb19-2a4f5bd116a6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:53.517234 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-abb8df80-793f-4ab5-bb19-2a4f5bd116a6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:53.528500 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-abb8df80-793f-4ab5-bb19-2a4f5bd116a6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:53.529452 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-abb8df80-793f-4ab5-bb19-2a4f5bd116a6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:53.530145 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-abb8df80-793f-4ab5-bb19-2a4f5bd116a6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:53.531269 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-abb8df80-793f-4ab5-bb19-2a4f5bd116a6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:53.532771 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-abb8df80-793f-4ab5-bb19-2a4f5bd116a6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:53.533558 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-abb8df80-793f-4ab5-bb19-2a4f5bd116a6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:54.212580 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-abb8df80-793f-4ab5-bb19-2a4f5bd116a6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.702727 Aug 07 01:23:54.213516 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1605/2934] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Aug 7 01:23:53 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/os-interface => generated 285 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:54.218294 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-4c2093f7-ad5c-43e6-bbf4-1bc7fbc5cbae req-6c683d96-7ee2-4984-aba9-d54903d3409b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "817c48ff-36fa-4ea6-8a75-672cfb8b6da5", "name": "network-vif-deleted", "tag": "2791ffb2-9e29-488e-88c1-4c55cfa4d733"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:54.244337 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4c2093f7-ad5c-43e6-bbf4-1bc7fbc5cbae req-6c683d96-7ee2-4984-aba9-d54903d3409b service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:54.244832 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4c2093f7-ad5c-43e6-bbf4-1bc7fbc5cbae req-6c683d96-7ee2-4984-aba9-d54903d3409b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:54.245274 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4c2093f7-ad5c-43e6-bbf4-1bc7fbc5cbae req-6c683d96-7ee2-4984-aba9-d54903d3409b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:54.267842 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-4c2093f7-ad5c-43e6-bbf4-1bc7fbc5cbae req-6c683d96-7ee2-4984-aba9-d54903d3409b service nova] Creating event network-vif-deleted:2791ffb2-9e29-488e-88c1-4c55cfa4d733 for instance 817c48ff-36fa-4ea6-8a75-672cfb8b6da5 on n-h1-master-1 Aug 07 01:23:54.285816 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-4c2093f7-ad5c-43e6-bbf4-1bc7fbc5cbae req-6c683d96-7ee2-4984-aba9-d54903d3409b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070984 Aug 07 01:23:54.286732 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1606/2935] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:54.292282 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b1c57864-7d9c-48ff-9ffe-98de2b081ed9 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:54.313708 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b1c57864-7d9c-48ff-9ffe-98de2b081ed9 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025554 Aug 07 01:23:54.314905 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1607/2936] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Aug 7 01:23:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:54.326275 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e0b1ad83-cee9-4a39-9c11-b94efb4ae695 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:54.327291 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e0b1ad83-cee9-4a39-9c11-b94efb4ae695 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] [instance: 817c48ff-36fa-4ea6-8a75-672cfb8b6da5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:54.344707 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0b1ad83-cee9-4a39-9c11-b94efb4ae695 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:54.345489 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0b1ad83-cee9-4a39-9c11-b94efb4ae695 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:54.346128 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0b1ad83-cee9-4a39-9c11-b94efb4ae695 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:54.347062 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0b1ad83-cee9-4a39-9c11-b94efb4ae695 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:54.347716 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0b1ad83-cee9-4a39-9c11-b94efb4ae695 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:54.348349 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0b1ad83-cee9-4a39-9c11-b94efb4ae695 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:54.353870 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:54.378575 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-e0b1ad83-cee9-4a39-9c11-b94efb4ae695 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] HTTP exception thrown: Instance 817c48ff-36fa-4ea6-8a75-672cfb8b6da5 could not be found. Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e0b1ad83-cee9-4a39-9c11-b94efb4ae695 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Request method failure captured: Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/817c48ff-36fa-4ea6-8a75-672cfb8b6da5 HTTP/1.1 Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xO08qP9itd1x7LkO549onPIQKYKrTn80RQpW5pCdeHaOqBQA0wDyajz8J-UALON-vNzJgXv0Ujib217Kc5O9bkWEANKCqcpJLGxO-2U8bRcRiaBsEe5TSczuDlBj3IZDQsdnYyQfIf9mOfj407D3QdxTi9cVsMgzz9HNwd9HVPDZu0 Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 791ad97e3c374d2d8494abc25b46a0bf Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_791ad97e3c374d2d8494abc25b46a0bf", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/791ad97e3c374d2d8494abc25b46a0bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 791ad97e3c374d2d8494abc25b46a0bf Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1082000213 Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-SecurityGroupsTestJSON-1082000213-project Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 51ab58be25a94cd6a59634e7c7cad158 Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-SecurityGroupsTestJSON-1082000213-project Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 817c48ff-36fa-4ea6-8a75-672cfb8b6da5 could not be found. Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '817c48ff-36fa-4ea6-8a75-672cfb8b6da5'} Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 817c48ff-36fa-4ea6-8a75-672cfb8b6da5 could not be found. Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 817c48ff-36fa-4ea6-8a75-672cfb8b6da5 could not be found. Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:23:54.382863 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:54.388567 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:23:54.388567 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:23:54.388567 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:23:54.388567 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:23:54.388567 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:23:54.388567 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 817c48ff-36fa-4ea6-8a75-672cfb8b6da5 could not be found. Aug 07 01:23:54.388567 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:23:54.399949 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e0b1ad83-cee9-4a39-9c11-b94efb4ae695 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Returning 404 to user: Instance 817c48ff-36fa-4ea6-8a75-672cfb8b6da5 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:23:54.401062 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e0b1ad83-cee9-4a39-9c11-b94efb4ae695 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "GET /compute/v2.1/servers/817c48ff-36fa-4ea6-8a75-672cfb8b6da5" status: 404 len: 111 microversion: 2.1 time: 0.085013 Aug 07 01:23:54.401809 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1608/2937] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:54 2022] GET /compute/v2.1/servers/817c48ff-36fa-4ea6-8a75-672cfb8b6da5 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:23:54.411564 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-277d0623-f8d9-418b-94ca-7d5375f4356f tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '.version_select at 0x7f9e17ac0ee0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:55.862128 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-0b9c042f-0193-495e-909b-5c36ec0d9188 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] [instance: 1239e799-ec72-41c7-a2d3-19f5aee58ed4] Building network info cache for instance {{(pid=119517) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 07 01:23:55.944493 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-277d0623-f8d9-418b-94ca-7d5375f4356f tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/80e964be-6230-419c-959c-df68acd15810" status: 202 len: 0 microversion: 2.1 time: 1.538240 Aug 07 01:23:55.945086 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1609/2938] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:23:54 2022] DELETE /compute/v2.1/os-security-groups/80e964be-6230-419c-959c-df68acd15810 => generated 0 bytes in 1540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 01:23:55.950498 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8026859a-76d7-4c3f-9528-7f57203e5bb7 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:55.951065 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8026859a-76d7-4c3f-9528-7f57203e5bb7 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] [instance: 8bbf0611-5a3b-4fec-a722-c07a08d09b26] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:55.967185 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8026859a-76d7-4c3f-9528-7f57203e5bb7 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:55.967686 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8026859a-76d7-4c3f-9528-7f57203e5bb7 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:55.968174 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8026859a-76d7-4c3f-9528-7f57203e5bb7 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:55.971752 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8026859a-76d7-4c3f-9528-7f57203e5bb7 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:55.973417 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8026859a-76d7-4c3f-9528-7f57203e5bb7 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:55.974580 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8026859a-76d7-4c3f-9528-7f57203e5bb7 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:56.039829 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8026859a-76d7-4c3f-9528-7f57203e5bb7 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] [instance: 8bbf0611-5a3b-4fec-a722-c07a08d09b26] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:23:56.228899 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8026859a-76d7-4c3f-9528-7f57203e5bb7 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26" status: 204 len: 0 microversion: 2.1 time: 0.279301 Aug 07 01:23:56.230335 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1610/2939] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:23:55 2022] DELETE /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:23:56.240018 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cac798df-26c8-43b1-9184-d7854ad27d98 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] Calling method '.version_select at 0x7f9e2475fb80>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:57.208552 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-0b9c042f-0193-495e-909b-5c36ec0d9188 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] [instance: 1239e799-ec72-41c7-a2d3-19f5aee58ed4] Updating instance_info_cache with network_info: [{"id": "812230e5-3e0b-4949-97b7-6fbd5953341c", "address": "fa:16:3e:f4:ca:91", "network": {"id": "c33bc911-16cd-416b-9f90-ec30c465d3ab", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1731069853-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4e24336f2ab84adda758d98cbb785888", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap812230e5-3e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119517) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 07 01:23:57.238035 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b9c042f-0193-495e-909b-5c36ec0d9188 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Releasing lock "refresh_cache-1239e799-ec72-41c7-a2d3-19f5aee58ed4" {{(pid=119517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 07 01:23:57.239027 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0b9c042f-0193-495e-909b-5c36ec0d9188 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] 10.222.0.39 "POST /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4/action" status: 202 len: 0 microversion: 2.1 time: 4.091362 Aug 07 01:23:57.243230 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1330/2940] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:23:53 2022] POST /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4/action => generated 0 bytes in 4093 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 07 01:23:57.247520 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a78b4b82-94e9-4f87-a93f-f6595a1dbb92 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:57.258796 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a78b4b82-94e9-4f87-a93f-f6595a1dbb92 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] [instance: 8bbf0611-5a3b-4fec-a722-c07a08d09b26] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:57.281272 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a78b4b82-94e9-4f87-a93f-f6595a1dbb92 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:57.284021 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a78b4b82-94e9-4f87-a93f-f6595a1dbb92 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:57.284923 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a78b4b82-94e9-4f87-a93f-f6595a1dbb92 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:57.285930 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a78b4b82-94e9-4f87-a93f-f6595a1dbb92 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:57.296713 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a78b4b82-94e9-4f87-a93f-f6595a1dbb92 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:57.305061 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a78b4b82-94e9-4f87-a93f-f6595a1dbb92 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:57.725772 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a78b4b82-94e9-4f87-a93f-f6595a1dbb92 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2185c595c9df4719bdca76d8797c76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5267b6a8e34a4397cd94fae11283be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:57.739260 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a78b4b82-94e9-4f87-a93f-f6595a1dbb92 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] 10.222.0.39 "GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26" status: 200 len: 1715 microversion: 2.1 time: 0.497551 Aug 07 01:23:57.741973 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1331/2941] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:57 2022] GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26 => generated 1715 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:23:57.748490 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-d6ea4049-4cee-4b83-acf4-61e0de5be01f req-7a421bbb-33ac-4edc-bc38-16d4c357a13e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1239e799-ec72-41c7-a2d3-19f5aee58ed4", "tag": "812230e5-3e0b-4949-97b7-6fbd5953341c"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:57.766484 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d6ea4049-4cee-4b83-acf4-61e0de5be01f req-7a421bbb-33ac-4edc-bc38-16d4c357a13e service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:57.766993 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d6ea4049-4cee-4b83-acf4-61e0de5be01f req-7a421bbb-33ac-4edc-bc38-16d4c357a13e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:57.767519 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d6ea4049-4cee-4b83-acf4-61e0de5be01f req-7a421bbb-33ac-4edc-bc38-16d4c357a13e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:57.810365 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-d6ea4049-4cee-4b83-acf4-61e0de5be01f req-7a421bbb-33ac-4edc-bc38-16d4c357a13e service nova] Creating event network-changed:812230e5-3e0b-4949-97b7-6fbd5953341c for instance 1239e799-ec72-41c7-a2d3-19f5aee58ed4 on n-h2-master-1 Aug 07 01:23:57.816501 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-d6ea4049-4cee-4b83-acf4-61e0de5be01f req-7a421bbb-33ac-4edc-bc38-16d4c357a13e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072284 Aug 07 01:23:57.817478 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1332/2942] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:57.828421 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-07de5b32-1a41-4eb7-9006-5d30b0ef267b tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Action: 'create', calling method: .version_select at 0x7f9e242d58b0>, body: {"pool": "8049ef63-728c-4ad0-8526-50dc3e712e09"} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:57.982834 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cac798df-26c8-43b1-9184-d7854ad27d98 tempest-SecurityGroupsTestJSON-1082000213 tempest-SecurityGroupsTestJSON-1082000213-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/98595ee8-51ab-4c0a-b639-bc69b6033141" status: 202 len: 0 microversion: 2.1 time: 1.750816 Aug 07 01:23:57.984274 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1611/2943] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:23:56 2022] DELETE /compute/v2.1/os-security-groups/98595ee8-51ab-4c0a-b639-bc69b6033141 => generated 0 bytes in 1753 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:23:58.426023 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-9bff9013-937d-4562-8bee-d3eb85d38f4e req-6a2b8468-5221-4775-9fd4-df52220f1f23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e39f0d23-55ab-417b-818e-92de14de44c0", "tag": "04267581-58b6-42a6-92a4-4f79278a63aa"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:23:58.451377 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-9bff9013-937d-4562-8bee-d3eb85d38f4e req-6a2b8468-5221-4775-9fd4-df52220f1f23 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:58.451868 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-9bff9013-937d-4562-8bee-d3eb85d38f4e req-6a2b8468-5221-4775-9fd4-df52220f1f23 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:58.452324 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-9bff9013-937d-4562-8bee-d3eb85d38f4e req-6a2b8468-5221-4775-9fd4-df52220f1f23 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:58.506846 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-9bff9013-937d-4562-8bee-d3eb85d38f4e req-6a2b8468-5221-4775-9fd4-df52220f1f23 service nova] Creating event network-changed:04267581-58b6-42a6-92a4-4f79278a63aa for instance e39f0d23-55ab-417b-818e-92de14de44c0 on n-h2-master-1 Aug 07 01:23:58.526956 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-9bff9013-937d-4562-8bee-d3eb85d38f4e req-6a2b8468-5221-4775-9fd4-df52220f1f23 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104744 Aug 07 01:23:58.527952 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1612/2944] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:23:58.768520 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7b749e14-7ebb-4519-b421-f79a827852ce tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:23:58.769256 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7b749e14-7ebb-4519-b421-f79a827852ce tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] [instance: 8bbf0611-5a3b-4fec-a722-c07a08d09b26] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:23:58.794032 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b749e14-7ebb-4519-b421-f79a827852ce tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:58.794599 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b749e14-7ebb-4519-b421-f79a827852ce tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:58.795058 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b749e14-7ebb-4519-b421-f79a827852ce tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:58.795819 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b749e14-7ebb-4519-b421-f79a827852ce tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:23:58.802507 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b749e14-7ebb-4519-b421-f79a827852ce tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:23:58.803113 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b749e14-7ebb-4519-b421-f79a827852ce tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:23:59.905424 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7b749e14-7ebb-4519-b421-f79a827852ce tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2185c595c9df4719bdca76d8797c76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5267b6a8e34a4397cd94fae11283be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:23:59.918166 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7b749e14-7ebb-4519-b421-f79a827852ce tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] 10.222.0.39 "GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26" status: 200 len: 1715 microversion: 2.1 time: 1.154779 Aug 07 01:23:59.923084 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1613/2945] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:58 2022] GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26 => generated 1715 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:24:00.449195 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3148957a-71aa-470d-98e9-c7d617e75daa tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:00.450710 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3148957a-71aa-470d-98e9-c7d617e75daa tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:00.462314 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3148957a-71aa-470d-98e9-c7d617e75daa tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:00.463169 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3148957a-71aa-470d-98e9-c7d617e75daa tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:00.464024 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3148957a-71aa-470d-98e9-c7d617e75daa tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:00.464965 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3148957a-71aa-470d-98e9-c7d617e75daa tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:00.466420 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3148957a-71aa-470d-98e9-c7d617e75daa tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:00.467147 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3148957a-71aa-470d-98e9-c7d617e75daa tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:00.502058 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3148957a-71aa-470d-98e9-c7d617e75daa tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:24:00.724368 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3148957a-71aa-470d-98e9-c7d617e75daa tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "DELETE /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 204 len: 0 microversion: 2.25 time: 0.277375 Aug 07 01:24:00.728911 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1614/2946] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Aug 7 01:24:00 2022] DELETE /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 01:24:00.736905 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-04ca2656-0a0c-47a1-8f60-ce5532f1544a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:00.737624 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-04ca2656-0a0c-47a1-8f60-ce5532f1544a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:00.748482 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-04ca2656-0a0c-47a1-8f60-ce5532f1544a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:00.748971 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-04ca2656-0a0c-47a1-8f60-ce5532f1544a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:00.749598 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-04ca2656-0a0c-47a1-8f60-ce5532f1544a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:00.750839 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-04ca2656-0a0c-47a1-8f60-ce5532f1544a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:00.751597 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-04ca2656-0a0c-47a1-8f60-ce5532f1544a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:00.752285 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-04ca2656-0a0c-47a1-8f60-ce5532f1544a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:01.179874 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-04ca2656-0a0c-47a1-8f60-ce5532f1544a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:01.198275 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-04ca2656-0a0c-47a1-8f60-ce5532f1544a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:01.210496 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-04ca2656-0a0c-47a1-8f60-ce5532f1544a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:01.219212 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-04ca2656-0a0c-47a1-8f60-ce5532f1544a tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 1731 microversion: 2.25 time: 0.484876 Aug 07 01:24:01.220556 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1615/2947] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:24:00 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 1731 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:24:01.248562 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a91a2216-0f98-47ed-99c9-53780f46d7d3 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:01.254120 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a91a2216-0f98-47ed-99c9-53780f46d7d3 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] [instance: 8bbf0611-5a3b-4fec-a722-c07a08d09b26] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:01.274694 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a91a2216-0f98-47ed-99c9-53780f46d7d3 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:01.276454 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a91a2216-0f98-47ed-99c9-53780f46d7d3 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:01.280744 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a91a2216-0f98-47ed-99c9-53780f46d7d3 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:01.286246 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a91a2216-0f98-47ed-99c9-53780f46d7d3 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:01.290022 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a91a2216-0f98-47ed-99c9-53780f46d7d3 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:01.292653 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a91a2216-0f98-47ed-99c9-53780f46d7d3 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:01.659079 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a91a2216-0f98-47ed-99c9-53780f46d7d3 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2185c595c9df4719bdca76d8797c76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5267b6a8e34a4397cd94fae11283be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:01.670321 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a91a2216-0f98-47ed-99c9-53780f46d7d3 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] 10.222.0.39 "GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26" status: 200 len: 1715 microversion: 2.1 time: 0.429965 Aug 07 01:24:01.672359 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1616/2948] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:01 2022] GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26 => generated 1715 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:02.246164 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6bcf4976-5a89-4e91-8712-354af99c9896 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:02.247502 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6bcf4976-5a89-4e91-8712-354af99c9896 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:02.255273 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6bcf4976-5a89-4e91-8712-354af99c9896 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:02.256072 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6bcf4976-5a89-4e91-8712-354af99c9896 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:02.256514 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6bcf4976-5a89-4e91-8712-354af99c9896 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:02.257596 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6bcf4976-5a89-4e91-8712-354af99c9896 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:02.258238 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6bcf4976-5a89-4e91-8712-354af99c9896 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:02.258866 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6bcf4976-5a89-4e91-8712-354af99c9896 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:02.579413 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6bcf4976-5a89-4e91-8712-354af99c9896 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:02.590729 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6bcf4976-5a89-4e91-8712-354af99c9896 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:02.592458 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6bcf4976-5a89-4e91-8712-354af99c9896 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:02.594642 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6bcf4976-5a89-4e91-8712-354af99c9896 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 1731 microversion: 2.25 time: 0.352478 Aug 07 01:24:02.596483 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1617/2949] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:24:02 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 1731 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:24:02.725367 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-17af9611-edd2-4340-8cbb-d0fa69a08c63 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:02.726004 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-17af9611-edd2-4340-8cbb-d0fa69a08c63 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] [instance: 8bbf0611-5a3b-4fec-a722-c07a08d09b26] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:02.749336 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=4 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:02.753488 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:02.775077 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-17af9611-edd2-4340-8cbb-d0fa69a08c63 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:02.779813 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-17af9611-edd2-4340-8cbb-d0fa69a08c63 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:02.782257 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-17af9611-edd2-4340-8cbb-d0fa69a08c63 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:02.785886 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-17af9611-edd2-4340-8cbb-d0fa69a08c63 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:02.787233 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-17af9611-edd2-4340-8cbb-d0fa69a08c63 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:02.798004 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-17af9611-edd2-4340-8cbb-d0fa69a08c63 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:03.011065 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-17af9611-edd2-4340-8cbb-d0fa69a08c63 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2185c595c9df4719bdca76d8797c76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5267b6a8e34a4397cd94fae11283be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:03.021828 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-17af9611-edd2-4340-8cbb-d0fa69a08c63 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] 10.222.0.39 "GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26" status: 200 len: 1648 microversion: 2.1 time: 0.319226 Aug 07 01:24:03.022454 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1618/2950] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:02 2022] GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26 => generated 1648 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:03.623627 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4753ddac-23c0-4c54-9c33-567688f40443 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:03.624280 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4753ddac-23c0-4c54-9c33-567688f40443 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:03.632703 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4753ddac-23c0-4c54-9c33-567688f40443 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:03.633334 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4753ddac-23c0-4c54-9c33-567688f40443 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:03.633849 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4753ddac-23c0-4c54-9c33-567688f40443 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:03.634644 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4753ddac-23c0-4c54-9c33-567688f40443 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:03.635357 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4753ddac-23c0-4c54-9c33-567688f40443 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:03.636048 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4753ddac-23c0-4c54-9c33-567688f40443 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:03.977134 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4753ddac-23c0-4c54-9c33-567688f40443 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:03.991395 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4753ddac-23c0-4c54-9c33-567688f40443 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:03.997321 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4753ddac-23c0-4c54-9c33-567688f40443 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:03.998850 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4753ddac-23c0-4c54-9c33-567688f40443 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 1731 microversion: 2.25 time: 0.379373 Aug 07 01:24:04.000154 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1619/2951] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:24:03 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 1731 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:24:04.051067 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-73fdd288-e851-40a6-907e-33f68ec3de0d tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:04.054587 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-73fdd288-e851-40a6-907e-33f68ec3de0d tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] [instance: 8bbf0611-5a3b-4fec-a722-c07a08d09b26] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:04.081968 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73fdd288-e851-40a6-907e-33f68ec3de0d tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:04.082552 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73fdd288-e851-40a6-907e-33f68ec3de0d tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:04.084349 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73fdd288-e851-40a6-907e-33f68ec3de0d tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:04.085261 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73fdd288-e851-40a6-907e-33f68ec3de0d tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:04.085734 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73fdd288-e851-40a6-907e-33f68ec3de0d tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:04.086972 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73fdd288-e851-40a6-907e-33f68ec3de0d tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:04.174338 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-73fdd288-e851-40a6-907e-33f68ec3de0d tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2185c595c9df4719bdca76d8797c76e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a5267b6a8e34a4397cd94fae11283be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:04.184373 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-73fdd288-e851-40a6-907e-33f68ec3de0d tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] 10.222.0.39 "GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26" status: 200 len: 1648 microversion: 2.1 time: 0.138917 Aug 07 01:24:04.185214 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1620/2952] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:04 2022] GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26 => generated 1648 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:04.561678 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-56c5f395-aeb0-4252-91f1-4c287f0cca12 req-7ee756b3-d099-494b-8c09-8e293587281a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bbf0611-5a3b-4fec-a722-c07a08d09b26", "name": "network-vif-deleted", "tag": "5c645525-cb30-401a-9b09-abfcb2929409"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:24:04.578091 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-56c5f395-aeb0-4252-91f1-4c287f0cca12 req-7ee756b3-d099-494b-8c09-8e293587281a service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:04.580535 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-56c5f395-aeb0-4252-91f1-4c287f0cca12 req-7ee756b3-d099-494b-8c09-8e293587281a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:04.583849 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-56c5f395-aeb0-4252-91f1-4c287f0cca12 req-7ee756b3-d099-494b-8c09-8e293587281a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:04.607606 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-56c5f395-aeb0-4252-91f1-4c287f0cca12 req-7ee756b3-d099-494b-8c09-8e293587281a service nova] Creating event network-vif-deleted:5c645525-cb30-401a-9b09-abfcb2929409 for instance 8bbf0611-5a3b-4fec-a722-c07a08d09b26 on n-h1-master-1 Aug 07 01:24:04.627708 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-56c5f395-aeb0-4252-91f1-4c287f0cca12 req-7ee756b3-d099-494b-8c09-8e293587281a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070673 Aug 07 01:24:04.633752 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1621/2953] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:24:05.027819 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-77266751-34d3-4b46-a686-2895bec9854e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:05.028629 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-77266751-34d3-4b46-a686-2895bec9854e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:05.040978 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77266751-34d3-4b46-a686-2895bec9854e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:05.041480 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77266751-34d3-4b46-a686-2895bec9854e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:05.056334 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77266751-34d3-4b46-a686-2895bec9854e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:05.061216 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77266751-34d3-4b46-a686-2895bec9854e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:05.061974 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77266751-34d3-4b46-a686-2895bec9854e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:05.063969 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77266751-34d3-4b46-a686-2895bec9854e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:05.463039 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-77266751-34d3-4b46-a686-2895bec9854e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:05.471802 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-77266751-34d3-4b46-a686-2895bec9854e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:05.489433 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-77266751-34d3-4b46-a686-2895bec9854e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:05.494358 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-77266751-34d3-4b46-a686-2895bec9854e tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 1663 microversion: 2.25 time: 0.473228 Aug 07 01:24:05.502163 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1622/2954] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:24:05 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 1663 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:24:05.516945 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f78bb7ac-9ff6-4a8e-b826-9d79b727c450 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:05.520508 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f78bb7ac-9ff6-4a8e-b826-9d79b727c450 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] [instance: 8bbf0611-5a3b-4fec-a722-c07a08d09b26] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:05.528172 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f78bb7ac-9ff6-4a8e-b826-9d79b727c450 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:05.529411 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f78bb7ac-9ff6-4a8e-b826-9d79b727c450 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:05.530066 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f78bb7ac-9ff6-4a8e-b826-9d79b727c450 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:05.532556 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f78bb7ac-9ff6-4a8e-b826-9d79b727c450 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:05.533257 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f78bb7ac-9ff6-4a8e-b826-9d79b727c450 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:05.533905 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f78bb7ac-9ff6-4a8e-b826-9d79b727c450 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:05.553617 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-f78bb7ac-9ff6-4a8e-b826-9d79b727c450 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] HTTP exception thrown: Instance 8bbf0611-5a3b-4fec-a722-c07a08d09b26 could not be found. Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f78bb7ac-9ff6-4a8e-b826-9d79b727c450 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Request method failure captured: Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26 HTTP/1.1 Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xPba2CU87RoiUWEeGTnthSTdutoUH0Tnubvv2stYa8gFeDgk6JTa1B_7IdEQJ4TzGAvehomBRxJNxjh_q3VP2wD_qrWDHdRMM2TuG4yYo4nD3zmqM9jTVl8ne_YK4owXMVJ9PiHe_DiEdzrsHZFpNzUjbt7viX58Llu5L_rRE4pEao Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 6a5267b6a8e34a4397cd94fae11283be Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersTestManualDisk-568018162 Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6a5267b6a8e34a4397cd94fae11283be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6a5267b6a8e34a4397cd94fae11283be", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6a5267b6a8e34a4397cd94fae11283be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6a5267b6a8e34a4397cd94fae11283be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersTestManualDisk-568018162 Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 6a5267b6a8e34a4397cd94fae11283be Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersTestManualDisk-568018162 Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersTestManualDisk-568018162-project Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 2185c595c9df4719bdca76d8797c76e3 Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersTestManualDisk-568018162-project Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 8bbf0611-5a3b-4fec-a722-c07a08d09b26 could not be found. Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '8bbf0611-5a3b-4fec-a722-c07a08d09b26'} Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bbf0611-5a3b-4fec-a722-c07a08d09b26 could not be found. Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bbf0611-5a3b-4fec-a722-c07a08d09b26 could not be found. Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:24:05.557146 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:05.586068 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:24:05.586068 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:24:05.586068 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:24:05.586068 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:24:05.586068 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:24:05.586068 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bbf0611-5a3b-4fec-a722-c07a08d09b26 could not be found. Aug 07 01:24:05.586068 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:05.586068 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f78bb7ac-9ff6-4a8e-b826-9d79b727c450 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Returning 404 to user: Instance 8bbf0611-5a3b-4fec-a722-c07a08d09b26 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:24:05.588464 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f78bb7ac-9ff6-4a8e-b826-9d79b727c450 tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] 10.222.0.39 "GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26" status: 404 len: 111 microversion: 2.1 time: 0.071770 Aug 07 01:24:05.589578 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1623/2955] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:05 2022] GET /compute/v2.1/servers/8bbf0611-5a3b-4fec-a722-c07a08d09b26 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:24:05.607614 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c571a1d1-ea6d-453a-9e7e-491a79dbd58f tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] Calling method '.version_select at 0x7f9e24fbe160>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:05.662102 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c571a1d1-ea6d-453a-9e7e-491a79dbd58f tempest-ServersTestManualDisk-568018162 tempest-ServersTestManualDisk-568018162-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1563677030" status: 202 len: 0 microversion: 2.1 time: 0.063669 Aug 07 01:24:05.665952 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1624/2956] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Aug 7 01:24:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1563677030 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:24:06.523985 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-76fdba5f-7ad9-48e7-b5f1-858e7c2e18af tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:06.525112 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-76fdba5f-7ad9-48e7-b5f1-858e7c2e18af tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:06.545940 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-76fdba5f-7ad9-48e7-b5f1-858e7c2e18af tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:06.546749 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-76fdba5f-7ad9-48e7-b5f1-858e7c2e18af tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:06.547376 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-76fdba5f-7ad9-48e7-b5f1-858e7c2e18af tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:06.548709 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-76fdba5f-7ad9-48e7-b5f1-858e7c2e18af tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:06.549368 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-76fdba5f-7ad9-48e7-b5f1-858e7c2e18af tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:06.549982 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-76fdba5f-7ad9-48e7-b5f1-858e7c2e18af tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:06.716932 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-76fdba5f-7ad9-48e7-b5f1-858e7c2e18af tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:06.730232 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-76fdba5f-7ad9-48e7-b5f1-858e7c2e18af tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:06.745985 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-76fdba5f-7ad9-48e7-b5f1-858e7c2e18af tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:06.750674 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-76fdba5f-7ad9-48e7-b5f1-858e7c2e18af tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 200 len: 1663 microversion: 2.25 time: 0.231686 Aug 07 01:24:06.756140 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1625/2957] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:24:06 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 1663 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:24:06.761214 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-1a1dfad2-74fe-4795-8476-c648dbb912af req-98d1d43b-1ce3-41aa-9c49-9ed5b7e647bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acc886e0-c989-4105-8375-0c42d4e96404", "name": "network-vif-deleted", "tag": "1758f50b-5f5d-4ffb-9893-9d21dc63f5bd"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:24:06.810857 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-1a1dfad2-74fe-4795-8476-c648dbb912af req-98d1d43b-1ce3-41aa-9c49-9ed5b7e647bf service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:06.813386 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-1a1dfad2-74fe-4795-8476-c648dbb912af req-98d1d43b-1ce3-41aa-9c49-9ed5b7e647bf service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:06.813870 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-1a1dfad2-74fe-4795-8476-c648dbb912af req-98d1d43b-1ce3-41aa-9c49-9ed5b7e647bf service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:06.849643 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-1a1dfad2-74fe-4795-8476-c648dbb912af req-98d1d43b-1ce3-41aa-9c49-9ed5b7e647bf service nova] Creating event network-vif-deleted:1758f50b-5f5d-4ffb-9893-9d21dc63f5bd for instance acc886e0-c989-4105-8375-0c42d4e96404 on n-h2-master-1 Aug 07 01:24:06.872819 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-1a1dfad2-74fe-4795-8476-c648dbb912af req-98d1d43b-1ce3-41aa-9c49-9ed5b7e647bf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108178 Aug 07 01:24:06.873754 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1626/2958] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:24:07.363081 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-07de5b32-1a41-4eb7-9006-5d30b0ef267b tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 9.542216 Aug 07 01:24:07.365194 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1333/2959] 10.222.0.39 () {60 vars in 1170 bytes} [Sun Aug 7 01:23:57 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 9546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:24:07.378477 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0e5d8fda-9c36-4d48-b665-1b8a1024ddfc tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.169"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:24:07.383907 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0e5d8fda-9c36-4d48-b665-1b8a1024ddfc tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] [instance: 1239e799-ec72-41c7-a2d3-19f5aee58ed4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:07.421941 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0e5d8fda-9c36-4d48-b665-1b8a1024ddfc tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:07.422583 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0e5d8fda-9c36-4d48-b665-1b8a1024ddfc tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:07.424583 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0e5d8fda-9c36-4d48-b665-1b8a1024ddfc tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:07.425828 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0e5d8fda-9c36-4d48-b665-1b8a1024ddfc tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:07.426470 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0e5d8fda-9c36-4d48-b665-1b8a1024ddfc tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:07.426919 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0e5d8fda-9c36-4d48-b665-1b8a1024ddfc tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:07.548100 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0e5d8fda-9c36-4d48-b665-1b8a1024ddfc tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "refresh_cache-1239e799-ec72-41c7-a2d3-19f5aee58ed4" {{(pid=119516) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 07 01:24:07.548720 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0e5d8fda-9c36-4d48-b665-1b8a1024ddfc tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquired lock "refresh_cache-1239e799-ec72-41c7-a2d3-19f5aee58ed4" {{(pid=119516) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 07 01:24:07.781212 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4b38d0e9-75b7-46cb-bc47-9ac8079e8ac2 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:07.782426 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4b38d0e9-75b7-46cb-bc47-9ac8079e8ac2 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: acc886e0-c989-4105-8375-0c42d4e96404] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:07.799001 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:07.802755 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:07.809805 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b38d0e9-75b7-46cb-bc47-9ac8079e8ac2 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:07.811873 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b38d0e9-75b7-46cb-bc47-9ac8079e8ac2 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:07.812469 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b38d0e9-75b7-46cb-bc47-9ac8079e8ac2 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:07.827517 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b38d0e9-75b7-46cb-bc47-9ac8079e8ac2 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:07.829188 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b38d0e9-75b7-46cb-bc47-9ac8079e8ac2 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:07.831524 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b38d0e9-75b7-46cb-bc47-9ac8079e8ac2 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:07.912458 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-4b38d0e9-75b7-46cb-bc47-9ac8079e8ac2 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] HTTP exception thrown: Instance acc886e0-c989-4105-8375-0c42d4e96404 could not be found. Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4b38d0e9-75b7-46cb-bc47-9ac8079e8ac2 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Request method failure captured: Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 HTTP/1.1 Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xJoqlTATLW8uMDMoZMXyKBzWleBkINAFeIL-mnaWrG6RXbT2iO7g_wynN1U-Z8CziPuyfNUmUBCtPWxuKC8V0l12Oal7bq2L0teRKF_r8EC6r__AOrALmDS_q5pM_7u-u8KNsMHj2IfS7MEbtLL4E3bfsWaqGPiPtnFAYAy7y3bBJ0 Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: X-Openstack-Nova-Api-Version: 2.25 Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 1371b7aebfcf4088a02780393de8200f Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-415415489 Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1371b7aebfcf4088a02780393de8200f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1371b7aebfcf4088a02780393de8200f", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1371b7aebfcf4088a02780393de8200f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1371b7aebfcf4088a02780393de8200f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-415415489 Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 1371b7aebfcf4088a02780393de8200f Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-415415489 Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-LiveAutoBlockMigrationV225Test-415415489-project Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 45ed48709ab84fa4b5b341332a843ad8 Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-415415489-project Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: exception: Instance acc886e0-c989-4105-8375-0c42d4e96404 could not be found. Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'acc886e0-c989-4105-8375-0c42d4e96404'} Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acc886e0-c989-4105-8375-0c42d4e96404 could not be found. Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acc886e0-c989-4105-8375-0c42d4e96404 could not be found. Aug 07 01:24:07.944516 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:24:07.950479 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:24:07.950479 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:24:07.950479 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:24:07.950479 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:24:07.950479 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:24:07.950479 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:24:07.950479 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:24:07.950479 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acc886e0-c989-4105-8375-0c42d4e96404 could not be found. Aug 07 01:24:07.950479 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:24:07.950479 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4b38d0e9-75b7-46cb-bc47-9ac8079e8ac2 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Returning 404 to user: Instance acc886e0-c989-4105-8375-0c42d4e96404 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:24:07.950479 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4b38d0e9-75b7-46cb-bc47-9ac8079e8ac2 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404" status: 404 len: 111 microversion: 2.25 time: 0.173595 Aug 07 01:24:07.952251 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1334/2960] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:24:07 2022] GET /compute/v2.1/servers/acc886e0-c989-4105-8375-0c42d4e96404 => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:24:07.963830 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d78076eb-c0e3-4e84-b7da-291fd3da5eb1 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '.version_select at 0x7f9e242d5310>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:08.014672 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d78076eb-c0e3-4e84-b7da-291fd3da5eb1 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1716860004" status: 204 len: 0 microversion: 2.25 time: 0.060951 Aug 07 01:24:08.015971 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1335/2961] 10.222.0.39 () {60 vars in 1262 bytes} [Sun Aug 7 01:24:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1716860004 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 01:24:08.889516 n-d-master-1 devstack@n-api.service[119516]: DEBUG neutronclient.v2_0.client [None req-0e5d8fda-9c36-4d48-b665-1b8a1024ddfc tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.4.169 (185bbddb-6d33-45a4-9876-997460bddfe6) with port 812230e5-3e0b-4949-97b7-6fbd5953341c using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 8049ef63-728c-4ad0-8526-50dc3e712e09.", "detail": ""}} {{(pid=119516) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 07 01:24:08.891669 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0e5d8fda-9c36-4d48-b665-1b8a1024ddfc tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Releasing lock "refresh_cache-1239e799-ec72-41c7-a2d3-19f5aee58ed4" {{(pid=119516) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 07 01:24:08.892884 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-0e5d8fda-9c36-4d48-b665-1b8a1024ddfc tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] HTTP exception thrown: Cannot associate floating IP 172.35.4.169 (185bbddb-6d33-45a4-9876-997460bddfe6) with port 812230e5-3e0b-4949-97b7-6fbd5953341c using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 8049ef63-728c-4ad0-8526-50dc3e712e09. Aug 07 01:24:08.892884 n-d-master-1 devstack@n-api.service[119516]: Neutron server returns request_ids: ['req-5f95a197-af99-4f1a-bd64-838f4ef3862f'] Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0e5d8fda-9c36-4d48-b665-1b8a1024ddfc tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Request method failure captured: Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4/action HTTP/1.1 Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 46 Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xQNljljot1timBZyhuh46dWYi5yGuUalSK6Z5bTIvEatNShVAUAXX-bHAd_FT02Y63Sb22BzPiuPpAenYnpNBTchQiXROLGyRRBiITRyYwVCSJZQtB6yDRbVHnsMWw2D31qkR4jpHK6aJcclut6lOE2_4lRnkFabXNTjWjjJjNA_cM Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 4e24336f2ab84adda758d98cbb785888 Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-369437783 Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e24336f2ab84adda758d98cbb785888"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4e24336f2ab84adda758d98cbb785888", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e24336f2ab84adda758d98cbb785888"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4e24336f2ab84adda758d98cbb785888"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-369437783 Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 4e24336f2ab84adda758d98cbb785888 Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-369437783 Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 58a40e444e92495c917f58fbcec63c8c Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: {"addFloatingIp": {"address": "172.35.4.169"}} Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: exception: Cannot associate floating IP 172.35.4.169 (185bbddb-6d33-45a4-9876-997460bddfe6) with port 812230e5-3e0b-4949-97b7-6fbd5953341c using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 8049ef63-728c-4ad0-8526-50dc3e712e09. Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: Neutron server returns request_ids: ['req-5f95a197-af99-4f1a-bd64-838f4ef3862f'] Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '1239e799-ec72-41c7-a2d3-19f5aee58ed4', 'body': {'addFloatingIp': {'address': '172.35.4.169'}}} Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 07 01:24:08.899744 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.35.4.169 (185bbddb-6d33-45a4-9876-997460bddfe6) with port 812230e5-3e0b-4949-97b7-6fbd5953341c using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 8049ef63-728c-4ad0-8526-50dc3e712e09. Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f95a197-af99-4f1a-bd64-838f4ef3862f'] Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.35.4.169 (185bbddb-6d33-45a4-9876-997460bddfe6) with port 812230e5-3e0b-4949-97b7-6fbd5953341c using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 8049ef63-728c-4ad0-8526-50dc3e712e09. Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f95a197-af99-4f1a-bd64-838f4ef3862f'] Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.35.4.169 (185bbddb-6d33-45a4-9876-997460bddfe6) with port 812230e5-3e0b-4949-97b7-6fbd5953341c using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 8049ef63-728c-4ad0-8526-50dc3e712e09. Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f95a197-af99-4f1a-bd64-838f4ef3862f'] Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.35.4.169 (185bbddb-6d33-45a4-9876-997460bddfe6) with port 812230e5-3e0b-4949-97b7-6fbd5953341c using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 8049ef63-728c-4ad0-8526-50dc3e712e09. Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f95a197-af99-4f1a-bd64-838f4ef3862f'] Aug 07 01:24:08.908031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:08.919510 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0e5d8fda-9c36-4d48-b665-1b8a1024ddfc tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Returning 400 to user: Cannot associate floating IP 172.35.4.169 (185bbddb-6d33-45a4-9876-997460bddfe6) with port 812230e5-3e0b-4949-97b7-6fbd5953341c using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 8049ef63-728c-4ad0-8526-50dc3e712e09. Aug 07 01:24:08.919510 n-d-master-1 devstack@n-api.service[119516]: Neutron server returns request_ids: ['req-5f95a197-af99-4f1a-bd64-838f4ef3862f'] {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:24:08.920727 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0e5d8fda-9c36-4d48-b665-1b8a1024ddfc tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] 10.222.0.39 "POST /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4/action" status: 400 len: 381 microversion: 2.1 time: 1.547482 Aug 07 01:24:08.935647 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1627/2962] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:24:07 2022] POST /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4/action => generated 381 bytes in 1558 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:24:08.941761 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-51b33a6a-3f24-449e-9b36-7ab73abcf8c0 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Calling method '.version_select at 0x7f9e17f82ca0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:11.558676 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f36a21a6-efae-46b0-b958-531210cfc252 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:11.559813 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f36a21a6-efae-46b0-b958-531210cfc252 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:11.573620 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f36a21a6-efae-46b0-b958-531210cfc252 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:11.583331 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f36a21a6-efae-46b0-b958-531210cfc252 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:11.584212 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f36a21a6-efae-46b0-b958-531210cfc252 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:11.585318 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f36a21a6-efae-46b0-b958-531210cfc252 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:11.586099 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f36a21a6-efae-46b0-b958-531210cfc252 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:11.588232 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f36a21a6-efae-46b0-b958-531210cfc252 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:11.635076 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:11.655106 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f36a21a6-efae-46b0-b958-531210cfc252 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:24:11.787721 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f36a21a6-efae-46b0-b958-531210cfc252 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a" status: 204 len: 0 microversion: 2.25 time: 0.229883 Aug 07 01:24:11.789415 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1628/2963] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Aug 7 01:24:11 2022] DELETE /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 01:24:11.804481 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6a327280-9e2f-4e31-a064-1424b0cfb6e4 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:11.805942 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6a327280-9e2f-4e31-a064-1424b0cfb6e4 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:11.816841 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a327280-9e2f-4e31-a064-1424b0cfb6e4 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:11.818152 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a327280-9e2f-4e31-a064-1424b0cfb6e4 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:11.819296 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a327280-9e2f-4e31-a064-1424b0cfb6e4 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:11.821962 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a327280-9e2f-4e31-a064-1424b0cfb6e4 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:11.824986 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a327280-9e2f-4e31-a064-1424b0cfb6e4 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:11.825887 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a327280-9e2f-4e31-a064-1424b0cfb6e4 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:11.944879 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-51b33a6a-3f24-449e-9b36-7ab73abcf8c0 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/185bbddb-6d33-45a4-9876-997460bddfe6" status: 202 len: 0 microversion: 2.1 time: 3.007758 Aug 07 01:24:11.946540 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1336/2964] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Aug 7 01:24:08 2022] DELETE /compute/v2.1/os-floating-ips/185bbddb-6d33-45a4-9876-997460bddfe6 => generated 0 bytes in 3010 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:24:11.957528 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6321e804-4ce4-447a-9cfb-554427fe58a7 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.7"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:24:12.253700 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6321e804-4ce4-447a-9cfb-554427fe58a7 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] [instance: 1239e799-ec72-41c7-a2d3-19f5aee58ed4] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:12.260977 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6a327280-9e2f-4e31-a064-1424b0cfb6e4 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:12.261714 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6321e804-4ce4-447a-9cfb-554427fe58a7 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:12.262435 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6321e804-4ce4-447a-9cfb-554427fe58a7 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:12.266398 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6321e804-4ce4-447a-9cfb-554427fe58a7 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:12.268028 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6321e804-4ce4-447a-9cfb-554427fe58a7 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:12.268695 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6321e804-4ce4-447a-9cfb-554427fe58a7 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:12.269304 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6321e804-4ce4-447a-9cfb-554427fe58a7 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:12.288717 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6a327280-9e2f-4e31-a064-1424b0cfb6e4 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:12.295454 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6a327280-9e2f-4e31-a064-1424b0cfb6e4 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:12.298134 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6a327280-9e2f-4e31-a064-1424b0cfb6e4 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a" status: 200 len: 1547 microversion: 2.25 time: 0.501040 Aug 07 01:24:12.299551 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1629/2965] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:24:11 2022] GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a => generated 1547 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:24:13.168932 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6321e804-4ce4-447a-9cfb-554427fe58a7 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "refresh_cache-1239e799-ec72-41c7-a2d3-19f5aee58ed4" {{(pid=119517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 07 01:24:13.170043 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6321e804-4ce4-447a-9cfb-554427fe58a7 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquired lock "refresh_cache-1239e799-ec72-41c7-a2d3-19f5aee58ed4" {{(pid=119517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 07 01:24:13.323846 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4cc42e75-8638-43b5-ab2c-6786f8af67d0 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:13.324890 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4cc42e75-8638-43b5-ab2c-6786f8af67d0 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:13.337848 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4cc42e75-8638-43b5-ab2c-6786f8af67d0 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:13.338355 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4cc42e75-8638-43b5-ab2c-6786f8af67d0 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:13.338802 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4cc42e75-8638-43b5-ab2c-6786f8af67d0 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:13.339534 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4cc42e75-8638-43b5-ab2c-6786f8af67d0 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:13.345659 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4cc42e75-8638-43b5-ab2c-6786f8af67d0 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:13.349602 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4cc42e75-8638-43b5-ab2c-6786f8af67d0 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:14.143877 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4cc42e75-8638-43b5-ab2c-6786f8af67d0 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:14.174762 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4cc42e75-8638-43b5-ab2c-6786f8af67d0 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:14.181816 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4cc42e75-8638-43b5-ab2c-6786f8af67d0 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:14.186347 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4cc42e75-8638-43b5-ab2c-6786f8af67d0 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a" status: 200 len: 1547 microversion: 2.25 time: 0.865881 Aug 07 01:24:14.186927 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1630/2966] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:24:13 2022] GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a => generated 1547 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:24:14.635783 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-45ccf54a-940e-4111-b4ac-7ca684d004de req-f2a08c25-ed96-4394-8047-e1f04871cd8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a", "name": "network-vif-deleted", "tag": "94432de4-2b7a-4c0b-a025-991a9fe958e7"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:24:14.663846 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-45ccf54a-940e-4111-b4ac-7ca684d004de req-f2a08c25-ed96-4394-8047-e1f04871cd8e service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:14.665021 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-45ccf54a-940e-4111-b4ac-7ca684d004de req-f2a08c25-ed96-4394-8047-e1f04871cd8e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:14.666184 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-45ccf54a-940e-4111-b4ac-7ca684d004de req-f2a08c25-ed96-4394-8047-e1f04871cd8e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:14.697592 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-45ccf54a-940e-4111-b4ac-7ca684d004de req-f2a08c25-ed96-4394-8047-e1f04871cd8e service nova] Creating event network-vif-deleted:94432de4-2b7a-4c0b-a025-991a9fe958e7 for instance 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a on n-h2-master-1 Aug 07 01:24:14.709815 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-45ccf54a-940e-4111-b4ac-7ca684d004de req-f2a08c25-ed96-4394-8047-e1f04871cd8e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082357 Aug 07 01:24:14.712126 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1631/2967] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:24:15.213166 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cd8bed72-f4f9-4d12-9dee-d35c6c751800 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:15.214021 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cd8bed72-f4f9-4d12-9dee-d35c6c751800 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:15.227144 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd8bed72-f4f9-4d12-9dee-d35c6c751800 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:15.232398 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd8bed72-f4f9-4d12-9dee-d35c6c751800 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:15.233192 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd8bed72-f4f9-4d12-9dee-d35c6c751800 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:15.234156 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd8bed72-f4f9-4d12-9dee-d35c6c751800 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:15.234814 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd8bed72-f4f9-4d12-9dee-d35c6c751800 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:15.235445 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd8bed72-f4f9-4d12-9dee-d35c6c751800 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:15.356010 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd8bed72-f4f9-4d12-9dee-d35c6c751800 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:15.359042 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd8bed72-f4f9-4d12-9dee-d35c6c751800 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:15.362607 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd8bed72-f4f9-4d12-9dee-d35c6c751800 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:15.363224 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-cd8bed72-f4f9-4d12-9dee-d35c6c751800 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lazy-loading 'fault' on Instance uuid 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:24:15.602691 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-6321e804-4ce4-447a-9cfb-554427fe58a7 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] [instance: 1239e799-ec72-41c7-a2d3-19f5aee58ed4] Building network info cache for instance {{(pid=119517) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 07 01:24:15.966379 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cd8bed72-f4f9-4d12-9dee-d35c6c751800 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:15.979519 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cd8bed72-f4f9-4d12-9dee-d35c6c751800 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:15.983300 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cd8bed72-f4f9-4d12-9dee-d35c6c751800 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:15.984581 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cd8bed72-f4f9-4d12-9dee-d35c6c751800 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a" status: 200 len: 1351 microversion: 2.25 time: 0.778001 Aug 07 01:24:15.985157 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1632/2968] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:24:15 2022] GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a => generated 1351 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:24:16.755358 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-fd447f39-8429-4bc8-bcc2-56f09c894c59 req-88c40d1b-92a2-45d9-ba99-38a2f022bd62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1239e799-ec72-41c7-a2d3-19f5aee58ed4", "tag": "812230e5-3e0b-4949-97b7-6fbd5953341c"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:24:16.785006 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-fd447f39-8429-4bc8-bcc2-56f09c894c59 req-88c40d1b-92a2-45d9-ba99-38a2f022bd62 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:16.786291 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-fd447f39-8429-4bc8-bcc2-56f09c894c59 req-88c40d1b-92a2-45d9-ba99-38a2f022bd62 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:16.787783 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-fd447f39-8429-4bc8-bcc2-56f09c894c59 req-88c40d1b-92a2-45d9-ba99-38a2f022bd62 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:16.822035 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-fd447f39-8429-4bc8-bcc2-56f09c894c59 req-88c40d1b-92a2-45d9-ba99-38a2f022bd62 service nova] Creating event network-changed:812230e5-3e0b-4949-97b7-6fbd5953341c for instance 1239e799-ec72-41c7-a2d3-19f5aee58ed4 on n-h2-master-1 Aug 07 01:24:16.829059 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-fd447f39-8429-4bc8-bcc2-56f09c894c59 req-88c40d1b-92a2-45d9-ba99-38a2f022bd62 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079059 Aug 07 01:24:16.830688 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1633/2969] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:24:17.011556 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-12e29072-bda4-43b7-a637-5d1a687a20e5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:17.012593 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-12e29072-bda4-43b7-a637-5d1a687a20e5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:17.032812 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-12e29072-bda4-43b7-a637-5d1a687a20e5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:17.033328 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-12e29072-bda4-43b7-a637-5d1a687a20e5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:17.033821 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-12e29072-bda4-43b7-a637-5d1a687a20e5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:17.042720 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-12e29072-bda4-43b7-a637-5d1a687a20e5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:17.043653 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-12e29072-bda4-43b7-a637-5d1a687a20e5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:17.044159 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-12e29072-bda4-43b7-a637-5d1a687a20e5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:17.067532 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-12e29072-bda4-43b7-a637-5d1a687a20e5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] HTTP exception thrown: Instance 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a could not be found. Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-12e29072-bda4-43b7-a637-5d1a687a20e5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Request method failure captured: Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a HTTP/1.1 Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xJoqlTATLW8uMDMoZMXyKBzWleBkINAFeIL-mnaWrG6RXbT2iO7g_wynN1U-Z8CziPuyfNUmUBCtPWxuKC8V0l12Oal7bq2L0teRKF_r8EC6r__AOrALmDS_q5pM_7u-u8KNsMHj2IfS7MEbtLL4E3bfsWaqGPiPtnFAYAy7y3bBJ0 Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: X-Openstack-Nova-Api-Version: 2.25 Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 1371b7aebfcf4088a02780393de8200f Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-415415489 Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1371b7aebfcf4088a02780393de8200f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1371b7aebfcf4088a02780393de8200f", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1371b7aebfcf4088a02780393de8200f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1371b7aebfcf4088a02780393de8200f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-415415489 Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 1371b7aebfcf4088a02780393de8200f Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-415415489 Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-LiveAutoBlockMigrationV225Test-415415489-project Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 45ed48709ab84fa4b5b341332a843ad8 Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-415415489-project Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a could not be found. Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a'} Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a could not be found. Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a could not be found. Aug 07 01:24:17.070616 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:17.074770 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:24:17.074770 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:17.074770 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:24:17.074770 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:24:17.074770 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:24:17.074770 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:24:17.074770 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:24:17.074770 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a could not be found. Aug 07 01:24:17.074770 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:17.078529 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-12e29072-bda4-43b7-a637-5d1a687a20e5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Returning 404 to user: Instance 4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:24:17.081233 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-12e29072-bda4-43b7-a637-5d1a687a20e5 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a" status: 404 len: 111 microversion: 2.25 time: 0.076012 Aug 07 01:24:17.082687 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1634/2970] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:24:17 2022] GET /compute/v2.1/servers/4cb9cfa0-6219-4b3c-81f4-d2bc9baf863a => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 07 01:24:17.096495 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-81014f97-3008-44a5-bdfa-8530c921bbc3 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:17.099301 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-81014f97-3008-44a5-bdfa-8530c921bbc3 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: ff193541-98b3-40f6-976c-8b1c721f0bc6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:17.122674 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-81014f97-3008-44a5-bdfa-8530c921bbc3 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:17.123592 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-81014f97-3008-44a5-bdfa-8530c921bbc3 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:17.125442 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-81014f97-3008-44a5-bdfa-8530c921bbc3 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:17.127808 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-81014f97-3008-44a5-bdfa-8530c921bbc3 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:17.132429 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-81014f97-3008-44a5-bdfa-8530c921bbc3 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:17.133791 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-81014f97-3008-44a5-bdfa-8530c921bbc3 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:17.208710 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-81014f97-3008-44a5-bdfa-8530c921bbc3 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: ff193541-98b3-40f6-976c-8b1c721f0bc6] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:24:17.359536 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-81014f97-3008-44a5-bdfa-8530c921bbc3 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6" status: 204 len: 0 microversion: 2.25 time: 0.271543 Aug 07 01:24:17.360654 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1635/2971] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Aug 7 01:24:17 2022] DELETE /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 01:24:17.372329 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1f82ddba-88ec-4bfb-a76a-54befaba4c35 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:17.374177 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1f82ddba-88ec-4bfb-a76a-54befaba4c35 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: ff193541-98b3-40f6-976c-8b1c721f0bc6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:17.388683 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f82ddba-88ec-4bfb-a76a-54befaba4c35 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:17.390185 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f82ddba-88ec-4bfb-a76a-54befaba4c35 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:17.390872 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f82ddba-88ec-4bfb-a76a-54befaba4c35 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:17.391982 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f82ddba-88ec-4bfb-a76a-54befaba4c35 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:17.392701 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f82ddba-88ec-4bfb-a76a-54befaba4c35 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:17.393764 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f82ddba-88ec-4bfb-a76a-54befaba4c35 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:17.938048 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-6321e804-4ce4-447a-9cfb-554427fe58a7 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] [instance: 1239e799-ec72-41c7-a2d3-19f5aee58ed4] Updating instance_info_cache with network_info: [{"id": "812230e5-3e0b-4949-97b7-6fbd5953341c", "address": "fa:16:3e:f4:ca:91", "network": {"id": "c33bc911-16cd-416b-9f90-ec30c465d3ab", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1731069853-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4e24336f2ab84adda758d98cbb785888", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap812230e5-3e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119517) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 07 01:24:17.969962 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6321e804-4ce4-447a-9cfb-554427fe58a7 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Releasing lock "refresh_cache-1239e799-ec72-41c7-a2d3-19f5aee58ed4" {{(pid=119517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 07 01:24:17.971124 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6321e804-4ce4-447a-9cfb-554427fe58a7 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] 10.222.0.39 "POST /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4/action" status: 202 len: 0 microversion: 2.1 time: 6.020452 Aug 07 01:24:17.972301 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1337/2972] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:24:11 2022] POST /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4/action => generated 0 bytes in 6022 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 07 01:24:17.989201 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-23fcc395-a175-4612-b2a1-ed043fbb0a4c tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Calling method '.version_select at 0x7f9e29a5e430>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:18.747841 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1f82ddba-88ec-4bfb-a76a-54befaba4c35 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:18.760758 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1f82ddba-88ec-4bfb-a76a-54befaba4c35 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:18.762404 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1f82ddba-88ec-4bfb-a76a-54befaba4c35 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:18.763636 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1f82ddba-88ec-4bfb-a76a-54befaba4c35 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6" status: 200 len: 1564 microversion: 2.25 time: 1.398680 Aug 07 01:24:18.774962 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1636/2973] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:24:17 2022] GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6 => generated 1564 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:24:19.792629 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1be9b865-9368-4580-9a3e-7d5e0e127da8 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:19.793326 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1be9b865-9368-4580-9a3e-7d5e0e127da8 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: ff193541-98b3-40f6-976c-8b1c721f0bc6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:19.807676 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1be9b865-9368-4580-9a3e-7d5e0e127da8 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:19.808206 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1be9b865-9368-4580-9a3e-7d5e0e127da8 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:19.808650 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1be9b865-9368-4580-9a3e-7d5e0e127da8 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:19.809370 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1be9b865-9368-4580-9a3e-7d5e0e127da8 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:19.812417 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1be9b865-9368-4580-9a3e-7d5e0e127da8 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:19.812873 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1be9b865-9368-4580-9a3e-7d5e0e127da8 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:20.164711 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1be9b865-9368-4580-9a3e-7d5e0e127da8 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:20.178103 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1be9b865-9368-4580-9a3e-7d5e0e127da8 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:20.183698 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1be9b865-9368-4580-9a3e-7d5e0e127da8 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45ed48709ab84fa4b5b341332a843ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1371b7aebfcf4088a02780393de8200f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:20.188098 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1be9b865-9368-4580-9a3e-7d5e0e127da8 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6" status: 200 len: 1522 microversion: 2.25 time: 0.402408 Aug 07 01:24:20.189857 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1637/2974] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:24:19 2022] GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6 => generated 1522 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:24:20.207087 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-04494dab-30d9-41c1-9ee7-85619d4c8d1f req-453acf00-750c-47f0-a904-d320f3b4886b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff193541-98b3-40f6-976c-8b1c721f0bc6", "name": "network-vif-deleted", "tag": "0f90fd6b-35f9-4ef7-a7f1-72ecb34de724"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:24:20.236096 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-04494dab-30d9-41c1-9ee7-85619d4c8d1f req-453acf00-750c-47f0-a904-d320f3b4886b service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:20.236973 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-04494dab-30d9-41c1-9ee7-85619d4c8d1f req-453acf00-750c-47f0-a904-d320f3b4886b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:20.240024 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-04494dab-30d9-41c1-9ee7-85619d4c8d1f req-453acf00-750c-47f0-a904-d320f3b4886b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:20.281136 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-04494dab-30d9-41c1-9ee7-85619d4c8d1f req-453acf00-750c-47f0-a904-d320f3b4886b service nova] Creating event network-vif-deleted:0f90fd6b-35f9-4ef7-a7f1-72ecb34de724 for instance ff193541-98b3-40f6-976c-8b1c721f0bc6 on n-h2-master-1 Aug 07 01:24:20.299158 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-04494dab-30d9-41c1-9ee7-85619d4c8d1f req-453acf00-750c-47f0-a904-d320f3b4886b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104049 Aug 07 01:24:20.300342 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1638/2975] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:24:20.454164 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-23fcc395-a175-4612-b2a1-ed043fbb0a4c tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/f2cd4e28-bddd-4314-b934-d517d05cc2aa" status: 202 len: 0 microversion: 2.1 time: 2.468727 Aug 07 01:24:20.455071 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1338/2976] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Aug 7 01:24:17 2022] DELETE /compute/v2.1/os-floating-ips/f2cd4e28-bddd-4314-b934-d517d05cc2aa => generated 0 bytes in 2479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 01:24:20.466189 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d2d90fc1-86a2-4afa-8cb1-b5a53e787884 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d2d90fc1-86a2-4afa-8cb1-b5a53e787884 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Request method failure captured: Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4/action HTTP/1.1 Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 34 Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xQNljljot1timBZyhuh46dWYi5yGuUalSK6Z5bTIvEatNShVAUAXX-bHAd_FT02Y63Sb22BzPiuPpAenYnpNBTchQiXROLGyRRBiITRyYwVCSJZQtB6yDRbVHnsMWw2D31qkR4jpHK6aJcclut6lOE2_4lRnkFabXNTjWjjJjNA_cM Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 4e24336f2ab84adda758d98cbb785888 Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-369437783 Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e24336f2ab84adda758d98cbb785888"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4e24336f2ab84adda758d98cbb785888", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e24336f2ab84adda758d98cbb785888"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4e24336f2ab84adda758d98cbb785888"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-369437783 Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 4e24336f2ab84adda758d98cbb785888 Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-369437783 Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 58a40e444e92495c917f58fbcec63c8c Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: {"addFloatingIp": {"address": ""}} Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '1239e799-ec72-41c7-a2d3-19f5aee58ed4', 'body': {'addFloatingIp': {'address': ''}}} Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi '' Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:24:20.472891 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:24:20.478642 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:24:20.478642 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 07 01:24:20.478642 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:20.478642 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:24:20.478642 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:20.478642 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:24:20.478642 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:24:20.478642 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:24:20.478642 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:24:20.478642 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:24:20.478642 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 07 01:24:20.478642 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:20.480766 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d2d90fc1-86a2-4afa-8cb1-b5a53e787884 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:24:20.487066 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d2d90fc1-86a2-4afa-8cb1-b5a53e787884 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] 10.222.0.39 "POST /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4/action" status: 400 len: 142 microversion: 2.1 time: 0.026229 Aug 07 01:24:20.488266 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1639/2977] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:24:20 2022] POST /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4/action => generated 142 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:24:20.497835 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0a79e6cf-3194-4ed8-89f2-86da36dd883b tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:24:20.500572 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0a79e6cf-3194-4ed8-89f2-86da36dd883b tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] [instance: 1239e799-ec72-41c7-a2d3-19f5aee58ed4] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:20.516190 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a79e6cf-3194-4ed8-89f2-86da36dd883b tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:20.517749 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a79e6cf-3194-4ed8-89f2-86da36dd883b tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:20.520558 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a79e6cf-3194-4ed8-89f2-86da36dd883b tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:20.521446 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a79e6cf-3194-4ed8-89f2-86da36dd883b tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:20.522112 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a79e6cf-3194-4ed8-89f2-86da36dd883b tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:20.522932 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a79e6cf-3194-4ed8-89f2-86da36dd883b tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:20.576299 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a79e6cf-3194-4ed8-89f2-86da36dd883b tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "refresh_cache-1239e799-ec72-41c7-a2d3-19f5aee58ed4" {{(pid=119517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 07 01:24:20.576944 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a79e6cf-3194-4ed8-89f2-86da36dd883b tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquired lock "refresh_cache-1239e799-ec72-41c7-a2d3-19f5aee58ed4" {{(pid=119517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 07 01:24:20.804132 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a79e6cf-3194-4ed8-89f2-86da36dd883b tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Releasing lock "refresh_cache-1239e799-ec72-41c7-a2d3-19f5aee58ed4" {{(pid=119517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 07 01:24:20.806154 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-0a79e6cf-3194-4ed8-89f2-86da36dd883b tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] HTTP exception thrown: floating IP not found Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0a79e6cf-3194-4ed8-89f2-86da36dd883b tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Request method failure captured: Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4/action HTTP/1.1 Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 41 Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xQNljljot1timBZyhuh46dWYi5yGuUalSK6Z5bTIvEatNShVAUAXX-bHAd_FT02Y63Sb22BzPiuPpAenYnpNBTchQiXROLGyRRBiITRyYwVCSJZQtB6yDRbVHnsMWw2D31qkR4jpHK6aJcclut6lOE2_4lRnkFabXNTjWjjJjNA_cM Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 4e24336f2ab84adda758d98cbb785888 Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-369437783 Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e24336f2ab84adda758d98cbb785888"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4e24336f2ab84adda758d98cbb785888", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e24336f2ab84adda758d98cbb785888"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4e24336f2ab84adda758d98cbb785888"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-369437783 Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 4e24336f2ab84adda758d98cbb785888 Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-369437783 Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 58a40e444e92495c917f58fbcec63c8c Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: exception: floating IP not found Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '1239e799-ec72-41c7-a2d3-19f5aee58ed4', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 07 01:24:20.808229 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:24:20.813180 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:24:20.813180 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:24:20.813180 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:24:20.813180 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:24:20.813180 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:24:20.813180 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:24:20.813180 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:24:20.813180 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 07 01:24:20.813180 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:24:20.813180 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0a79e6cf-3194-4ed8-89f2-86da36dd883b tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Returning 404 to user: floating IP not found {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:24:20.813180 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0a79e6cf-3194-4ed8-89f2-86da36dd883b tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] 10.222.0.39 "POST /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4/action" status: 404 len: 67 microversion: 2.1 time: 0.315948 Aug 07 01:24:20.813180 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1339/2978] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:24:20 2022] POST /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4/action => generated 67 bytes in 318 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:24:20.824860 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b33bb8f5-3290-4fb1-a2c8-a843fbe463b1 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:24:20.949705 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-b33bb8f5-3290-4fb1-a2c8-a843fbe463b1 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b33bb8f5-3290-4fb1-a2c8-a843fbe463b1 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Request method failure captured: Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4/action HTTP/1.1 Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 44 Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xQNljljot1timBZyhuh46dWYi5yGuUalSK6Z5bTIvEatNShVAUAXX-bHAd_FT02Y63Sb22BzPiuPpAenYnpNBTchQiXROLGyRRBiITRyYwVCSJZQtB6yDRbVHnsMWw2D31qkR4jpHK6aJcclut6lOE2_4lRnkFabXNTjWjjJjNA_cM Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 4e24336f2ab84adda758d98cbb785888 Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-369437783 Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e24336f2ab84adda758d98cbb785888"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4e24336f2ab84adda758d98cbb785888", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e24336f2ab84adda758d98cbb785888"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4e24336f2ab84adda758d98cbb785888"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-369437783 Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 4e24336f2ab84adda758d98cbb785888 Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-369437783 Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 58a40e444e92495c917f58fbcec63c8c Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: exception: Floating IP not found for address 0.0.0.0. Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '1239e799-ec72-41c7-a2d3-19f5aee58ed4', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 07 01:24:20.952285 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 07 01:24:20.956552 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 07 01:24:20.956552 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:20.956552 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:24:20.956552 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:20.956552 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:24:20.956552 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:24:20.956552 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:24:20.956552 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:24:20.956552 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:24:20.956552 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 07 01:24:20.956552 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:20.957533 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b33bb8f5-3290-4fb1-a2c8-a843fbe463b1 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:24:20.958555 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b33bb8f5-3290-4fb1-a2c8-a843fbe463b1 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] 10.222.0.39 "POST /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4/action" status: 404 len: 88 microversion: 2.1 time: 0.140702 Aug 07 01:24:20.963571 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1640/2979] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:24:20 2022] POST /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4/action => generated 88 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:24:20.970043 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f4685e5e-e517-4854-9623-79e895fc1164 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:20.970911 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f4685e5e-e517-4854-9623-79e895fc1164 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] [instance: 1239e799-ec72-41c7-a2d3-19f5aee58ed4] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:20.978279 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4685e5e-e517-4854-9623-79e895fc1164 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:20.978991 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4685e5e-e517-4854-9623-79e895fc1164 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:20.979547 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4685e5e-e517-4854-9623-79e895fc1164 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:20.980503 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4685e5e-e517-4854-9623-79e895fc1164 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:20.981080 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4685e5e-e517-4854-9623-79e895fc1164 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:20.981623 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4685e5e-e517-4854-9623-79e895fc1164 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:21.016152 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f4685e5e-e517-4854-9623-79e895fc1164 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] [instance: 1239e799-ec72-41c7-a2d3-19f5aee58ed4] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:24:21.215163 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bfea887e-ad66-42ac-97fc-335b8c32ac04 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:21.216011 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bfea887e-ad66-42ac-97fc-335b8c32ac04 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] [instance: ff193541-98b3-40f6-976c-8b1c721f0bc6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:21.227710 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f4685e5e-e517-4854-9623-79e895fc1164 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4" status: 204 len: 0 microversion: 2.1 time: 0.261733 Aug 07 01:24:21.228269 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bfea887e-ad66-42ac-97fc-335b8c32ac04 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:21.228753 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bfea887e-ad66-42ac-97fc-335b8c32ac04 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:21.229418 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bfea887e-ad66-42ac-97fc-335b8c32ac04 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:21.229612 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1340/2980] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:24:20 2022] DELETE /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:24:21.229984 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bfea887e-ad66-42ac-97fc-335b8c32ac04 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:21.230405 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bfea887e-ad66-42ac-97fc-335b8c32ac04 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:21.230832 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bfea887e-ad66-42ac-97fc-335b8c32ac04 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:21.244036 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bc878ec3-c19b-4403-b23b-fc1d5ce4b939 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:21.245204 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bc878ec3-c19b-4403-b23b-fc1d5ce4b939 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] [instance: 1239e799-ec72-41c7-a2d3-19f5aee58ed4] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:21.267861 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc878ec3-c19b-4403-b23b-fc1d5ce4b939 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:21.268699 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc878ec3-c19b-4403-b23b-fc1d5ce4b939 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:21.269407 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc878ec3-c19b-4403-b23b-fc1d5ce4b939 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:21.270273 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc878ec3-c19b-4403-b23b-fc1d5ce4b939 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:21.270971 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc878ec3-c19b-4403-b23b-fc1d5ce4b939 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:21.271519 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc878ec3-c19b-4403-b23b-fc1d5ce4b939 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:21.271730 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-bfea887e-ad66-42ac-97fc-335b8c32ac04 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] HTTP exception thrown: Instance ff193541-98b3-40f6-976c-8b1c721f0bc6 could not be found. Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bfea887e-ad66-42ac-97fc-335b8c32ac04 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Request method failure captured: Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6 HTTP/1.1 Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xJoqlTATLW8uMDMoZMXyKBzWleBkINAFeIL-mnaWrG6RXbT2iO7g_wynN1U-Z8CziPuyfNUmUBCtPWxuKC8V0l12Oal7bq2L0teRKF_r8EC6r__AOrALmDS_q5pM_7u-u8KNsMHj2IfS7MEbtLL4E3bfsWaqGPiPtnFAYAy7y3bBJ0 Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: X-Openstack-Nova-Api-Version: 2.25 Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 1371b7aebfcf4088a02780393de8200f Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-415415489 Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1371b7aebfcf4088a02780393de8200f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1371b7aebfcf4088a02780393de8200f", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1371b7aebfcf4088a02780393de8200f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1371b7aebfcf4088a02780393de8200f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-415415489 Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 1371b7aebfcf4088a02780393de8200f Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-415415489 Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-LiveAutoBlockMigrationV225Test-415415489-project Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 45ed48709ab84fa4b5b341332a843ad8 Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-415415489-project Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: exception: Instance ff193541-98b3-40f6-976c-8b1c721f0bc6 could not be found. Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'ff193541-98b3-40f6-976c-8b1c721f0bc6'} Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff193541-98b3-40f6-976c-8b1c721f0bc6 could not be found. Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff193541-98b3-40f6-976c-8b1c721f0bc6 could not be found. Aug 07 01:24:21.279609 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:21.284336 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:24:21.284336 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:21.284336 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:24:21.284336 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:24:21.284336 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:24:21.284336 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:24:21.284336 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:24:21.284336 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff193541-98b3-40f6-976c-8b1c721f0bc6 could not be found. Aug 07 01:24:21.284336 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:21.284336 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bfea887e-ad66-42ac-97fc-335b8c32ac04 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] Returning 404 to user: Instance ff193541-98b3-40f6-976c-8b1c721f0bc6 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:24:21.284336 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bfea887e-ad66-42ac-97fc-335b8c32ac04 tempest-LiveAutoBlockMigrationV225Test-415415489 tempest-LiveAutoBlockMigrationV225Test-415415489-project] 10.222.0.39 "GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6" status: 404 len: 111 microversion: 2.25 time: 0.070113 Aug 07 01:24:21.286606 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1641/2981] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:24:21 2022] GET /compute/v2.1/servers/ff193541-98b3-40f6-976c-8b1c721f0bc6 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:24:22.694356 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-eb627c25-e295-4440-a398-42d25a941e0b tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1915440004", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "cb9229ee-f9dd-4261-8b06-0cad538a441c"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:24:22.811469 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-eb627c25-e295-4440-a398-42d25a941e0b tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] validate_networks() for [('cb9229ee-f9dd-4261-8b06-0cad538a441c', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:24:22.833066 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bc878ec3-c19b-4403-b23b-fc1d5ce4b939 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a40e444e92495c917f58fbcec63c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e24336f2ab84adda758d98cbb785888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:22.852499 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bc878ec3-c19b-4403-b23b-fc1d5ce4b939 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] 10.222.0.39 "GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4" status: 200 len: 1542 microversion: 2.1 time: 1.617796 Aug 07 01:24:22.867398 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1341/2982] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:21 2022] GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4 => generated 1542 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:24:23.875956 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bcd8de04-3338-48bf-b6b9-c32ca1673a4f tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:23.876833 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bcd8de04-3338-48bf-b6b9-c32ca1673a4f tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] [instance: 1239e799-ec72-41c7-a2d3-19f5aee58ed4] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:23.894151 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bcd8de04-3338-48bf-b6b9-c32ca1673a4f tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:23.894672 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bcd8de04-3338-48bf-b6b9-c32ca1673a4f tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:23.895168 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bcd8de04-3338-48bf-b6b9-c32ca1673a4f tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:23.901969 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bcd8de04-3338-48bf-b6b9-c32ca1673a4f tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:23.902888 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bcd8de04-3338-48bf-b6b9-c32ca1673a4f tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:23.906318 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bcd8de04-3338-48bf-b6b9-c32ca1673a4f tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:24.702908 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-eb627c25-e295-4440-a398-42d25a941e0b tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:24:24.706667 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-eb627c25-e295-4440-a398-42d25a941e0b tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:24:24.707583 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-eb627c25-e295-4440-a398-42d25a941e0b tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:24:24.708721 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-eb627c25-e295-4440-a398-42d25a941e0b tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:24:24.709407 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-eb627c25-e295-4440-a398-42d25a941e0b tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:24:24.712909 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:24.734815 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb627c25-e295-4440-a398-42d25a941e0b tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:24.736214 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb627c25-e295-4440-a398-42d25a941e0b tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:24.736972 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb627c25-e295-4440-a398-42d25a941e0b tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:24.741002 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb627c25-e295-4440-a398-42d25a941e0b tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:24.742525 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb627c25-e295-4440-a398-42d25a941e0b tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:24.743244 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb627c25-e295-4440-a398-42d25a941e0b tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:24.790231 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-eb627c25-e295-4440-a398-42d25a941e0b tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Getting quotas for project 2e60e8cd3e6842ec82633393b0af52fd. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:24:24.823692 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-eb627c25-e295-4440-a398-42d25a941e0b tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Getting quotas for user dfaafe20889443e692f94fd4e4b8b023 and project 2e60e8cd3e6842ec82633393b0af52fd. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:24:24.852858 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bcd8de04-3338-48bf-b6b9-c32ca1673a4f tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a40e444e92495c917f58fbcec63c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e24336f2ab84adda758d98cbb785888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:24.868064 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-eb627c25-e295-4440-a398-42d25a941e0b tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:24:24.868283 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bcd8de04-3338-48bf-b6b9-c32ca1673a4f tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] 10.222.0.39 "GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4" status: 200 len: 1542 microversion: 2.1 time: 0.993764 Aug 07 01:24:24.868705 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1342/2983] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:23 2022] GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4 => generated 1542 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:24:24.874142 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-eb627c25-e295-4440-a398-42d25a941e0b tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] [instance: b7680b77-1951-4c01-aecc-f593bb0edd05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:24:24.981648 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-eb627c25-e295-4440-a398-42d25a941e0b tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.922876 Aug 07 01:24:24.983012 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1642/2984] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:24:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:24:24.994775 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-18657cda-1640-4439-9016-4b6f6cf5459c tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:24.995994 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-18657cda-1640-4439-9016-4b6f6cf5459c tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] [instance: b7680b77-1951-4c01-aecc-f593bb0edd05] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:25.166504 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-18657cda-1640-4439-9016-4b6f6cf5459c tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaafe20889443e692f94fd4e4b8b023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e60e8cd3e6842ec82633393b0af52fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:25.180245 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-18657cda-1640-4439-9016-4b6f6cf5459c tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] 10.222.0.39 "GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05" status: 200 len: 1216 microversion: 2.1 time: 0.189083 Aug 07 01:24:25.180864 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1343/2985] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:24 2022] GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05 => generated 1216 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:25.894961 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1c367667-507d-4cb2-83a4-9b19e041fa2c tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:25.896543 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1c367667-507d-4cb2-83a4-9b19e041fa2c tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] [instance: 1239e799-ec72-41c7-a2d3-19f5aee58ed4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:25.915610 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c367667-507d-4cb2-83a4-9b19e041fa2c tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:25.917199 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c367667-507d-4cb2-83a4-9b19e041fa2c tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:25.917878 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c367667-507d-4cb2-83a4-9b19e041fa2c tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:25.922307 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c367667-507d-4cb2-83a4-9b19e041fa2c tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:25.922829 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c367667-507d-4cb2-83a4-9b19e041fa2c tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:25.923488 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c367667-507d-4cb2-83a4-9b19e041fa2c tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:26.128572 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1c367667-507d-4cb2-83a4-9b19e041fa2c tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a40e444e92495c917f58fbcec63c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e24336f2ab84adda758d98cbb785888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:26.142079 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1c367667-507d-4cb2-83a4-9b19e041fa2c tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] 10.222.0.39 "GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4" status: 200 len: 1500 microversion: 2.1 time: 0.255789 Aug 07 01:24:26.143300 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1643/2986] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:25 2022] GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4 => generated 1500 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:26.205115 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-da943bbb-db73-4797-abcf-5d20cafac139 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:26.205891 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-da943bbb-db73-4797-abcf-5d20cafac139 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] [instance: b7680b77-1951-4c01-aecc-f593bb0edd05] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:26.220918 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da943bbb-db73-4797-abcf-5d20cafac139 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:26.223143 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da943bbb-db73-4797-abcf-5d20cafac139 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:26.223848 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da943bbb-db73-4797-abcf-5d20cafac139 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:26.228270 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da943bbb-db73-4797-abcf-5d20cafac139 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:26.229066 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da943bbb-db73-4797-abcf-5d20cafac139 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:26.231005 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da943bbb-db73-4797-abcf-5d20cafac139 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:26.561249 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-50b389b1-e53e-43d6-9114-9731fac05e62 req-021bab78-42a0-4515-a71a-6c66aace48c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1239e799-ec72-41c7-a2d3-19f5aee58ed4", "name": "network-vif-deleted", "tag": "812230e5-3e0b-4949-97b7-6fbd5953341c"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:24:26.600710 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-50b389b1-e53e-43d6-9114-9731fac05e62 req-021bab78-42a0-4515-a71a-6c66aace48c6 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:26.602359 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-50b389b1-e53e-43d6-9114-9731fac05e62 req-021bab78-42a0-4515-a71a-6c66aace48c6 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:26.603362 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-50b389b1-e53e-43d6-9114-9731fac05e62 req-021bab78-42a0-4515-a71a-6c66aace48c6 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:26.652873 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-50b389b1-e53e-43d6-9114-9731fac05e62 req-021bab78-42a0-4515-a71a-6c66aace48c6 service nova] Creating event network-vif-deleted:812230e5-3e0b-4949-97b7-6fbd5953341c for instance 1239e799-ec72-41c7-a2d3-19f5aee58ed4 on n-h2-master-1 Aug 07 01:24:26.667670 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-50b389b1-e53e-43d6-9114-9731fac05e62 req-021bab78-42a0-4515-a71a-6c66aace48c6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110060 Aug 07 01:24:26.673339 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1644/2987] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:24:26.793793 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-da943bbb-db73-4797-abcf-5d20cafac139 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaafe20889443e692f94fd4e4b8b023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e60e8cd3e6842ec82633393b0af52fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:26.802524 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-da943bbb-db73-4797-abcf-5d20cafac139 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] 10.222.0.39 "GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05" status: 200 len: 1212 microversion: 2.1 time: 0.601855 Aug 07 01:24:26.808350 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1344/2988] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:26 2022] GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05 => generated 1212 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:27.165744 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1627b975-56f9-45ab-81c7-8c684aeb7956 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:27.166451 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1627b975-56f9-45ab-81c7-8c684aeb7956 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] [instance: 1239e799-ec72-41c7-a2d3-19f5aee58ed4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:27.183599 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1627b975-56f9-45ab-81c7-8c684aeb7956 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:27.184154 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1627b975-56f9-45ab-81c7-8c684aeb7956 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:27.188847 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1627b975-56f9-45ab-81c7-8c684aeb7956 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:27.189687 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1627b975-56f9-45ab-81c7-8c684aeb7956 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:27.190181 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1627b975-56f9-45ab-81c7-8c684aeb7956 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:27.200590 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1627b975-56f9-45ab-81c7-8c684aeb7956 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:27.335970 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1627b975-56f9-45ab-81c7-8c684aeb7956 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:27.336578 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1627b975-56f9-45ab-81c7-8c684aeb7956 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:27.337033 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1627b975-56f9-45ab-81c7-8c684aeb7956 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:27.340261 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-1627b975-56f9-45ab-81c7-8c684aeb7956 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lazy-loading 'fault' on Instance uuid 1239e799-ec72-41c7-a2d3-19f5aee58ed4 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:24:27.477881 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1627b975-56f9-45ab-81c7-8c684aeb7956 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a40e444e92495c917f58fbcec63c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e24336f2ab84adda758d98cbb785888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:27.506752 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1627b975-56f9-45ab-81c7-8c684aeb7956 tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] 10.222.0.39 "GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4" status: 200 len: 1322 microversion: 2.1 time: 0.328370 Aug 07 01:24:27.508605 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1645/2989] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:27 2022] GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4 => generated 1322 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:27.826235 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9239bec4-d8e4-4304-81bc-79e3077c859d tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:27.834294 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9239bec4-d8e4-4304-81bc-79e3077c859d tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] [instance: b7680b77-1951-4c01-aecc-f593bb0edd05] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:27.844950 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9239bec4-d8e4-4304-81bc-79e3077c859d tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:27.856499 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9239bec4-d8e4-4304-81bc-79e3077c859d tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:27.857256 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9239bec4-d8e4-4304-81bc-79e3077c859d tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:27.858231 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9239bec4-d8e4-4304-81bc-79e3077c859d tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:27.858877 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9239bec4-d8e4-4304-81bc-79e3077c859d tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:27.859492 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9239bec4-d8e4-4304-81bc-79e3077c859d tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:28.079860 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9239bec4-d8e4-4304-81bc-79e3077c859d tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaafe20889443e692f94fd4e4b8b023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e60e8cd3e6842ec82633393b0af52fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:28.094614 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9239bec4-d8e4-4304-81bc-79e3077c859d tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] 10.222.0.39 "GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05" status: 200 len: 1274 microversion: 2.1 time: 0.271715 Aug 07 01:24:28.095759 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1345/2990] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:27 2022] GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05 => generated 1274 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:28.537261 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b23148d4-f8fc-4b74-b553-37174e2c4a1a tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:28.538264 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b23148d4-f8fc-4b74-b553-37174e2c4a1a tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] [instance: 1239e799-ec72-41c7-a2d3-19f5aee58ed4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:28.573848 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b23148d4-f8fc-4b74-b553-37174e2c4a1a tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:28.574705 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b23148d4-f8fc-4b74-b553-37174e2c4a1a tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:28.575165 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b23148d4-f8fc-4b74-b553-37174e2c4a1a tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:28.582518 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b23148d4-f8fc-4b74-b553-37174e2c4a1a tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:28.583035 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b23148d4-f8fc-4b74-b553-37174e2c4a1a tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:28.583489 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b23148d4-f8fc-4b74-b553-37174e2c4a1a tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:28.642813 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-b23148d4-f8fc-4b74-b553-37174e2c4a1a tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] HTTP exception thrown: Instance 1239e799-ec72-41c7-a2d3-19f5aee58ed4 could not be found. Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b23148d4-f8fc-4b74-b553-37174e2c4a1a tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Request method failure captured: Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4 HTTP/1.1 Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xQNljljot1timBZyhuh46dWYi5yGuUalSK6Z5bTIvEatNShVAUAXX-bHAd_FT02Y63Sb22BzPiuPpAenYnpNBTchQiXROLGyRRBiITRyYwVCSJZQtB6yDRbVHnsMWw2D31qkR4jpHK6aJcclut6lOE2_4lRnkFabXNTjWjjJjNA_cM Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 4e24336f2ab84adda758d98cbb785888 Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-369437783 Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e24336f2ab84adda758d98cbb785888"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4e24336f2ab84adda758d98cbb785888", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e24336f2ab84adda758d98cbb785888"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4e24336f2ab84adda758d98cbb785888"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-369437783 Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 4e24336f2ab84adda758d98cbb785888 Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-369437783 Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 58a40e444e92495c917f58fbcec63c8c Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 1239e799-ec72-41c7-a2d3-19f5aee58ed4 could not be found. Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '1239e799-ec72-41c7-a2d3-19f5aee58ed4'} Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1239e799-ec72-41c7-a2d3-19f5aee58ed4 could not be found. Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1239e799-ec72-41c7-a2d3-19f5aee58ed4 could not be found. Aug 07 01:24:28.645951 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:28.652679 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:24:28.652679 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:28.652679 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:24:28.652679 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:24:28.652679 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:24:28.652679 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:24:28.652679 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:24:28.652679 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1239e799-ec72-41c7-a2d3-19f5aee58ed4 could not be found. Aug 07 01:24:28.652679 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:24:28.654748 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b23148d4-f8fc-4b74-b553-37174e2c4a1a tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] Returning 404 to user: Instance 1239e799-ec72-41c7-a2d3-19f5aee58ed4 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:24:28.656009 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b23148d4-f8fc-4b74-b553-37174e2c4a1a tempest-FloatingIPsAssociationNegativeTestJSON-369437783 tempest-FloatingIPsAssociationNegativeTestJSON-369437783-project] 10.222.0.39 "GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4" status: 404 len: 111 microversion: 2.1 time: 0.126290 Aug 07 01:24:28.662378 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1646/2991] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:28 2022] GET /compute/v2.1/servers/1239e799-ec72-41c7-a2d3-19f5aee58ed4 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:24:29.119129 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-04fc8b0a-4bf2-4fb5-8001-2e7c39207b90 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:29.120388 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-04fc8b0a-4bf2-4fb5-8001-2e7c39207b90 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] [instance: b7680b77-1951-4c01-aecc-f593bb0edd05] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:29.150481 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-04fc8b0a-4bf2-4fb5-8001-2e7c39207b90 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:29.155435 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-04fc8b0a-4bf2-4fb5-8001-2e7c39207b90 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:29.158932 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-04fc8b0a-4bf2-4fb5-8001-2e7c39207b90 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:29.162712 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-04fc8b0a-4bf2-4fb5-8001-2e7c39207b90 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:29.164493 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-04fc8b0a-4bf2-4fb5-8001-2e7c39207b90 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:29.166850 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-04fc8b0a-4bf2-4fb5-8001-2e7c39207b90 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:29.368145 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-04fc8b0a-4bf2-4fb5-8001-2e7c39207b90 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaafe20889443e692f94fd4e4b8b023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e60e8cd3e6842ec82633393b0af52fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:29.383487 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-04fc8b0a-4bf2-4fb5-8001-2e7c39207b90 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] 10.222.0.39 "GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05" status: 200 len: 1274 microversion: 2.1 time: 0.268135 Aug 07 01:24:29.384745 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1346/2992] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:29 2022] GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05 => generated 1274 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:30.148996 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9f9959e9-bc71-4a33-918e-1cd58edf85e3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:30.149761 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9f9959e9-bc71-4a33-918e-1cd58edf85e3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:30.166962 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f9959e9-bc71-4a33-918e-1cd58edf85e3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:30.168175 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f9959e9-bc71-4a33-918e-1cd58edf85e3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:30.169110 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f9959e9-bc71-4a33-918e-1cd58edf85e3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:30.172531 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f9959e9-bc71-4a33-918e-1cd58edf85e3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:30.175144 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f9959e9-bc71-4a33-918e-1cd58edf85e3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:30.176193 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f9959e9-bc71-4a33-918e-1cd58edf85e3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:30.411682 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9acfa7b9-17c6-4571-8c41-b3b2bc987b42 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:30.416502 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9acfa7b9-17c6-4571-8c41-b3b2bc987b42 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] [instance: b7680b77-1951-4c01-aecc-f593bb0edd05] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:30.448989 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9acfa7b9-17c6-4571-8c41-b3b2bc987b42 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:30.449771 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9acfa7b9-17c6-4571-8c41-b3b2bc987b42 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:30.452806 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9acfa7b9-17c6-4571-8c41-b3b2bc987b42 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:30.454826 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9acfa7b9-17c6-4571-8c41-b3b2bc987b42 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:30.455482 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9acfa7b9-17c6-4571-8c41-b3b2bc987b42 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:30.456403 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9acfa7b9-17c6-4571-8c41-b3b2bc987b42 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:31.119121 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9acfa7b9-17c6-4571-8c41-b3b2bc987b42 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaafe20889443e692f94fd4e4b8b023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e60e8cd3e6842ec82633393b0af52fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:31.134682 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9acfa7b9-17c6-4571-8c41-b3b2bc987b42 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] 10.222.0.39 "GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05" status: 200 len: 1316 microversion: 2.1 time: 0.729800 Aug 07 01:24:31.145425 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1347/2993] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:30 2022] GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05 => generated 1316 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:31.615528 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9f9959e9-bc71-4a33-918e-1cd58edf85e3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:31.633593 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9f9959e9-bc71-4a33-918e-1cd58edf85e3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 1.484345 Aug 07 01:24:31.634477 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1647/2994] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:30 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:31.658016 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-93f5b80e-deba-4d99-8241-2662e7113e7c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:31.658657 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-93f5b80e-deba-4d99-8241-2662e7113e7c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:31.668730 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93f5b80e-deba-4d99-8241-2662e7113e7c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:31.669666 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93f5b80e-deba-4d99-8241-2662e7113e7c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:31.670401 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93f5b80e-deba-4d99-8241-2662e7113e7c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:31.671415 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93f5b80e-deba-4d99-8241-2662e7113e7c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:31.672106 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93f5b80e-deba-4d99-8241-2662e7113e7c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:31.672699 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93f5b80e-deba-4d99-8241-2662e7113e7c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:32.168780 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-af303ef2-c4a1-4853-aa29-b7e33dee5f7d tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:32.170292 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-af303ef2-c4a1-4853-aa29-b7e33dee5f7d tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] [instance: b7680b77-1951-4c01-aecc-f593bb0edd05] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:32.190848 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af303ef2-c4a1-4853-aa29-b7e33dee5f7d tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:32.191352 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af303ef2-c4a1-4853-aa29-b7e33dee5f7d tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:32.195686 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af303ef2-c4a1-4853-aa29-b7e33dee5f7d tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:32.200935 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af303ef2-c4a1-4853-aa29-b7e33dee5f7d tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:32.201864 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af303ef2-c4a1-4853-aa29-b7e33dee5f7d tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:32.203459 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af303ef2-c4a1-4853-aa29-b7e33dee5f7d tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:32.218166 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:33.077970 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-93f5b80e-deba-4d99-8241-2662e7113e7c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:33.092158 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-93f5b80e-deba-4d99-8241-2662e7113e7c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 1.437931 Aug 07 01:24:33.092748 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1348/2995] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:31 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:33.118276 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-05669212-9513-4f34-9c7e-658c4e902a96 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:33.119047 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-05669212-9513-4f34-9c7e-658c4e902a96 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:33.139102 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05669212-9513-4f34-9c7e-658c4e902a96 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:33.139602 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05669212-9513-4f34-9c7e-658c4e902a96 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:33.140163 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05669212-9513-4f34-9c7e-658c4e902a96 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:33.140914 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05669212-9513-4f34-9c7e-658c4e902a96 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:33.141395 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05669212-9513-4f34-9c7e-658c4e902a96 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:33.141826 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05669212-9513-4f34-9c7e-658c4e902a96 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:33.300055 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-af303ef2-c4a1-4853-aa29-b7e33dee5f7d tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaafe20889443e692f94fd4e4b8b023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e60e8cd3e6842ec82633393b0af52fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:33.312148 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-af303ef2-c4a1-4853-aa29-b7e33dee5f7d tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] 10.222.0.39 "GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05" status: 200 len: 1316 microversion: 2.1 time: 1.148117 Aug 07 01:24:33.324216 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1648/2996] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:32 2022] GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05 => generated 1316 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:34.070585 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-05669212-9513-4f34-9c7e-658c4e902a96 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:34.085690 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-05669212-9513-4f34-9c7e-658c4e902a96 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.970647 Aug 07 01:24:34.086276 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1349/2997] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:33 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:34.109585 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b436ee85-b18e-4514-9dfb-219368cf6054 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-902457846"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:24:34.112166 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b436ee85-b18e-4514-9dfb-219368cf6054 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:34.132824 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b436ee85-b18e-4514-9dfb-219368cf6054 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:34.138391 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b436ee85-b18e-4514-9dfb-219368cf6054 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:34.139483 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b436ee85-b18e-4514-9dfb-219368cf6054 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:34.140297 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b436ee85-b18e-4514-9dfb-219368cf6054 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:34.140783 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b436ee85-b18e-4514-9dfb-219368cf6054 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:34.146762 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b436ee85-b18e-4514-9dfb-219368cf6054 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:34.336820 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-34785a15-bf1b-4701-b452-ac2ab1fc4ea2 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:34.337609 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-34785a15-bf1b-4701-b452-ac2ab1fc4ea2 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] [instance: b7680b77-1951-4c01-aecc-f593bb0edd05] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:34.352185 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-34785a15-bf1b-4701-b452-ac2ab1fc4ea2 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:34.352796 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-34785a15-bf1b-4701-b452-ac2ab1fc4ea2 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:34.353330 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-34785a15-bf1b-4701-b452-ac2ab1fc4ea2 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:34.354143 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-34785a15-bf1b-4701-b452-ac2ab1fc4ea2 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:34.354697 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-34785a15-bf1b-4701-b452-ac2ab1fc4ea2 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:34.355219 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-34785a15-bf1b-4701-b452-ac2ab1fc4ea2 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:34.773398 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:34.865568 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:34.915949 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b436ee85-b18e-4514-9dfb-219368cf6054 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action" status: 202 len: 0 microversion: 2.1 time: 0.804661 Aug 07 01:24:34.921006 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1649/2998] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:24:34 2022] POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action => generated 0 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 07 01:24:34.938927 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-3c357219-b9ca-4cb3-8375-4ed67fc65134 req-faea22cb-e685-443e-ae9b-75f01a0b0775 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7680b77-1951-4c01-aecc-f593bb0edd05", "tag": "5ebcabb2-5963-4cd4-a3de-90e9875253b6"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:24:34.970927 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3c357219-b9ca-4cb3-8375-4ed67fc65134 req-faea22cb-e685-443e-ae9b-75f01a0b0775 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:34.971742 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3c357219-b9ca-4cb3-8375-4ed67fc65134 req-faea22cb-e685-443e-ae9b-75f01a0b0775 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:34.972662 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3c357219-b9ca-4cb3-8375-4ed67fc65134 req-faea22cb-e685-443e-ae9b-75f01a0b0775 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:34.991319 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-3c357219-b9ca-4cb3-8375-4ed67fc65134 req-faea22cb-e685-443e-ae9b-75f01a0b0775 service nova] Creating event network-changed:5ebcabb2-5963-4cd4-a3de-90e9875253b6 for instance b7680b77-1951-4c01-aecc-f593bb0edd05 on n-h1-master-1 Aug 07 01:24:35.001266 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-3c357219-b9ca-4cb3-8375-4ed67fc65134 req-faea22cb-e685-443e-ae9b-75f01a0b0775 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075401 Aug 07 01:24:35.024369 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1650/2999] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:24:35.174458 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:36.334259 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-34785a15-bf1b-4701-b452-ac2ab1fc4ea2 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaafe20889443e692f94fd4e4b8b023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e60e8cd3e6842ec82633393b0af52fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:36.342768 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-34785a15-bf1b-4701-b452-ac2ab1fc4ea2 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] 10.222.0.39 "GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05" status: 200 len: 1316 microversion: 2.1 time: 2.010261 Aug 07 01:24:36.343364 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1350/3000] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:34 2022] GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05 => generated 1316 bytes in 2012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:24:37.388650 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cce6c76c-750b-4ea4-b5a6-18b97fc215bb tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:37.390091 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cce6c76c-750b-4ea4-b5a6-18b97fc215bb tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] [instance: b7680b77-1951-4c01-aecc-f593bb0edd05] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:37.419113 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cce6c76c-750b-4ea4-b5a6-18b97fc215bb tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:37.419632 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cce6c76c-750b-4ea4-b5a6-18b97fc215bb tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:37.420126 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cce6c76c-750b-4ea4-b5a6-18b97fc215bb tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:37.420862 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cce6c76c-750b-4ea4-b5a6-18b97fc215bb tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:37.421328 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cce6c76c-750b-4ea4-b5a6-18b97fc215bb tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:37.426118 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cce6c76c-750b-4ea4-b5a6-18b97fc215bb tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:39.184283 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cce6c76c-750b-4ea4-b5a6-18b97fc215bb tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaafe20889443e692f94fd4e4b8b023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e60e8cd3e6842ec82633393b0af52fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:39.195497 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cce6c76c-750b-4ea4-b5a6-18b97fc215bb tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] 10.222.0.39 "GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05" status: 200 len: 1316 microversion: 2.1 time: 1.818572 Aug 07 01:24:39.196147 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1651/3001] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:37 2022] GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05 => generated 1316 bytes in 1826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:40.216776 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-352efa4a-44da-4298-9683-1a59112246e2 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:40.218123 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-352efa4a-44da-4298-9683-1a59112246e2 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] [instance: b7680b77-1951-4c01-aecc-f593bb0edd05] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:40.231130 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:40.234845 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-352efa4a-44da-4298-9683-1a59112246e2 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:40.236809 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-352efa4a-44da-4298-9683-1a59112246e2 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:40.242530 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-352efa4a-44da-4298-9683-1a59112246e2 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:40.245750 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-352efa4a-44da-4298-9683-1a59112246e2 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:40.246256 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-352efa4a-44da-4298-9683-1a59112246e2 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:40.246687 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-352efa4a-44da-4298-9683-1a59112246e2 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:40.331943 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=83,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:40.855395 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-352efa4a-44da-4298-9683-1a59112246e2 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaafe20889443e692f94fd4e4b8b023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e60e8cd3e6842ec82633393b0af52fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:40.865627 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-352efa4a-44da-4298-9683-1a59112246e2 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] 10.222.0.39 "GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05" status: 200 len: 1316 microversion: 2.1 time: 0.653052 Aug 07 01:24:40.867590 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1351/3002] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:40 2022] GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05 => generated 1316 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:41.888261 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-eafb3a3d-8404-4baa-9ad1-50422052c056 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:41.888960 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-eafb3a3d-8404-4baa-9ad1-50422052c056 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] [instance: b7680b77-1951-4c01-aecc-f593bb0edd05] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:41.920485 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eafb3a3d-8404-4baa-9ad1-50422052c056 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:41.920485 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eafb3a3d-8404-4baa-9ad1-50422052c056 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:41.920925 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eafb3a3d-8404-4baa-9ad1-50422052c056 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:41.926994 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eafb3a3d-8404-4baa-9ad1-50422052c056 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:41.930349 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eafb3a3d-8404-4baa-9ad1-50422052c056 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:41.936254 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eafb3a3d-8404-4baa-9ad1-50422052c056 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:42.777027 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-eafb3a3d-8404-4baa-9ad1-50422052c056 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaafe20889443e692f94fd4e4b8b023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e60e8cd3e6842ec82633393b0af52fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:42.807112 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-eafb3a3d-8404-4baa-9ad1-50422052c056 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] 10.222.0.39 "GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05" status: 200 len: 1316 microversion: 2.1 time: 0.918879 Aug 07 01:24:42.811325 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1652/3003] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:41 2022] GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05 => generated 1316 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:43.832880 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-608803b9-b4a5-4880-a643-53c9894a1737 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:43.833946 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-608803b9-b4a5-4880-a643-53c9894a1737 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] [instance: b7680b77-1951-4c01-aecc-f593bb0edd05] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:43.864481 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-608803b9-b4a5-4880-a643-53c9894a1737 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:43.865086 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-608803b9-b4a5-4880-a643-53c9894a1737 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:43.865543 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-608803b9-b4a5-4880-a643-53c9894a1737 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:43.872468 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-608803b9-b4a5-4880-a643-53c9894a1737 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:43.872973 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-608803b9-b4a5-4880-a643-53c9894a1737 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:43.873423 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-608803b9-b4a5-4880-a643-53c9894a1737 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:44.626531 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-608803b9-b4a5-4880-a643-53c9894a1737 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaafe20889443e692f94fd4e4b8b023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e60e8cd3e6842ec82633393b0af52fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:44.633377 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-608803b9-b4a5-4880-a643-53c9894a1737 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] 10.222.0.39 "GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05" status: 200 len: 1316 microversion: 2.1 time: 0.805277 Aug 07 01:24:44.649316 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1352/3004] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:43 2022] GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05 => generated 1316 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:45.656602 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2e467163-e156-4ed5-99d1-fbd696b7241f tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:45.657762 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2e467163-e156-4ed5-99d1-fbd696b7241f tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] [instance: b7680b77-1951-4c01-aecc-f593bb0edd05] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:45.689607 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2e467163-e156-4ed5-99d1-fbd696b7241f tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:45.690254 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2e467163-e156-4ed5-99d1-fbd696b7241f tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:45.690709 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2e467163-e156-4ed5-99d1-fbd696b7241f tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:45.695508 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2e467163-e156-4ed5-99d1-fbd696b7241f tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:45.697126 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2e467163-e156-4ed5-99d1-fbd696b7241f tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:45.699278 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2e467163-e156-4ed5-99d1-fbd696b7241f tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:47.202094 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-e97643c9-5afb-4be7-a9b2-9249b1bf4216 req-51e95786-f62d-4f0a-8221-e33820ef11a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e39f0d23-55ab-417b-818e-92de14de44c0", "name": "network-vif-plugged", "status": "completed", "tag": "04267581-58b6-42a6-92a4-4f79278a63aa"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:24:47.235740 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-e97643c9-5afb-4be7-a9b2-9249b1bf4216 req-51e95786-f62d-4f0a-8221-e33820ef11a8 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:47.236349 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-e97643c9-5afb-4be7-a9b2-9249b1bf4216 req-51e95786-f62d-4f0a-8221-e33820ef11a8 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:47.236850 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-e97643c9-5afb-4be7-a9b2-9249b1bf4216 req-51e95786-f62d-4f0a-8221-e33820ef11a8 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:47.299809 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-e97643c9-5afb-4be7-a9b2-9249b1bf4216 req-51e95786-f62d-4f0a-8221-e33820ef11a8 service nova] Creating event network-vif-plugged:04267581-58b6-42a6-92a4-4f79278a63aa for instance e39f0d23-55ab-417b-818e-92de14de44c0 on n-h2-master-1 Aug 07 01:24:47.311242 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-e97643c9-5afb-4be7-a9b2-9249b1bf4216 req-51e95786-f62d-4f0a-8221-e33820ef11a8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114301 Aug 07 01:24:47.316125 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1353/3005] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:24:47.558629 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2e467163-e156-4ed5-99d1-fbd696b7241f tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaafe20889443e692f94fd4e4b8b023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e60e8cd3e6842ec82633393b0af52fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:47.570884 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2e467163-e156-4ed5-99d1-fbd696b7241f tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] 10.222.0.39 "GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05" status: 200 len: 1316 microversion: 2.1 time: 1.919790 Aug 07 01:24:47.584243 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1653/3006] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:45 2022] GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05 => generated 1316 bytes in 1933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:48.603235 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-16fb821a-cf24-4759-9ad5-dc988dfe60b0 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:48.603997 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-16fb821a-cf24-4759-9ad5-dc988dfe60b0 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] [instance: b7680b77-1951-4c01-aecc-f593bb0edd05] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:48.624343 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16fb821a-cf24-4759-9ad5-dc988dfe60b0 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:48.624854 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16fb821a-cf24-4759-9ad5-dc988dfe60b0 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:48.636098 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16fb821a-cf24-4759-9ad5-dc988dfe60b0 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:48.642068 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16fb821a-cf24-4759-9ad5-dc988dfe60b0 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:48.642849 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16fb821a-cf24-4759-9ad5-dc988dfe60b0 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:48.643516 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16fb821a-cf24-4759-9ad5-dc988dfe60b0 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:49.501991 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-16fb821a-cf24-4759-9ad5-dc988dfe60b0 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaafe20889443e692f94fd4e4b8b023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e60e8cd3e6842ec82633393b0af52fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:49.520976 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-16fb821a-cf24-4759-9ad5-dc988dfe60b0 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] 10.222.0.39 "GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05" status: 200 len: 1316 microversion: 2.1 time: 0.923163 Aug 07 01:24:49.522816 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1354/3007] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:48 2022] GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05 => generated 1316 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:49.751340 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-3b855bf3-b1d9-479a-bd59-0f7e02b9dfee req-4e0067f1-13a3-4b57-af3e-31f8496708ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7680b77-1951-4c01-aecc-f593bb0edd05", "name": "network-vif-plugged", "status": "completed", "tag": "5ebcabb2-5963-4cd4-a3de-90e9875253b6"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:24:49.785380 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3b855bf3-b1d9-479a-bd59-0f7e02b9dfee req-4e0067f1-13a3-4b57-af3e-31f8496708ef service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:49.786854 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3b855bf3-b1d9-479a-bd59-0f7e02b9dfee req-4e0067f1-13a3-4b57-af3e-31f8496708ef service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:49.788543 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3b855bf3-b1d9-479a-bd59-0f7e02b9dfee req-4e0067f1-13a3-4b57-af3e-31f8496708ef service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:49.826671 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-3b855bf3-b1d9-479a-bd59-0f7e02b9dfee req-4e0067f1-13a3-4b57-af3e-31f8496708ef service nova] Creating event network-vif-plugged:5ebcabb2-5963-4cd4-a3de-90e9875253b6 for instance b7680b77-1951-4c01-aecc-f593bb0edd05 on n-h1-master-1 Aug 07 01:24:49.846397 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-3b855bf3-b1d9-479a-bd59-0f7e02b9dfee req-4e0067f1-13a3-4b57-af3e-31f8496708ef service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098684 Aug 07 01:24:49.847442 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1654/3008] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:24:50.545206 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-30d595af-1dde-4a27-964f-0e84b5c480da tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:50.545843 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-30d595af-1dde-4a27-964f-0e84b5c480da tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] [instance: b7680b77-1951-4c01-aecc-f593bb0edd05] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:50.556366 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-30d595af-1dde-4a27-964f-0e84b5c480da tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:50.556857 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-30d595af-1dde-4a27-964f-0e84b5c480da tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:50.557294 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-30d595af-1dde-4a27-964f-0e84b5c480da tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:50.568747 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-30d595af-1dde-4a27-964f-0e84b5c480da tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:50.569330 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-30d595af-1dde-4a27-964f-0e84b5c480da tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:50.569778 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-30d595af-1dde-4a27-964f-0e84b5c480da tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:51.433586 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-30d595af-1dde-4a27-964f-0e84b5c480da tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaafe20889443e692f94fd4e4b8b023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e60e8cd3e6842ec82633393b0af52fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:51.441679 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-30d595af-1dde-4a27-964f-0e84b5c480da tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] 10.222.0.39 "GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05" status: 200 len: 1316 microversion: 2.1 time: 0.902001 Aug 07 01:24:51.442275 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1355/3009] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:50 2022] GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05 => generated 1316 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:52.471641 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-276feebd-af2c-457f-a747-085a39d7d06d tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:52.473124 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-276feebd-af2c-457f-a747-085a39d7d06d tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] [instance: b7680b77-1951-4c01-aecc-f593bb0edd05] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:52.498912 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-276feebd-af2c-457f-a747-085a39d7d06d tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:52.510978 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-276feebd-af2c-457f-a747-085a39d7d06d tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:52.513984 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-276feebd-af2c-457f-a747-085a39d7d06d tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:52.517085 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-276feebd-af2c-457f-a747-085a39d7d06d tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:52.520125 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-276feebd-af2c-457f-a747-085a39d7d06d tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:52.523102 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-276feebd-af2c-457f-a747-085a39d7d06d tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:53.095030 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-276feebd-af2c-457f-a747-085a39d7d06d tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaafe20889443e692f94fd4e4b8b023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e60e8cd3e6842ec82633393b0af52fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:53.106855 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-276feebd-af2c-457f-a747-085a39d7d06d tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] 10.222.0.39 "GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05" status: 200 len: 1503 microversion: 2.1 time: 0.643724 Aug 07 01:24:53.108506 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1655/3010] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:52 2022] GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05 => generated 1503 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:53.131103 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f0b0ba50-2ca2-43ca-894e-050e39d2294e tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:53.133799 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f0b0ba50-2ca2-43ca-894e-050e39d2294e tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] [instance: b7680b77-1951-4c01-aecc-f593bb0edd05] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:53.141939 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f0b0ba50-2ca2-43ca-894e-050e39d2294e tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:53.142686 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f0b0ba50-2ca2-43ca-894e-050e39d2294e tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:53.143293 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f0b0ba50-2ca2-43ca-894e-050e39d2294e tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:53.144787 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f0b0ba50-2ca2-43ca-894e-050e39d2294e tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:53.145436 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f0b0ba50-2ca2-43ca-894e-050e39d2294e tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:53.146072 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f0b0ba50-2ca2-43ca-894e-050e39d2294e tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:53.237406 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f0b0ba50-2ca2-43ca-894e-050e39d2294e tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.109126 Aug 07 01:24:53.250300 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-da608997-dc99-4f7d-909a-43ca1d6ab3d9 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:53.251116 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-da608997-dc99-4f7d-909a-43ca1d6ab3d9 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] [instance: b7680b77-1951-4c01-aecc-f593bb0edd05] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:53.279368 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1356/3011] 10.222.0.39 () {58 vars in 1296 bytes} [Sun Aug 7 01:24:53 2022] DELETE /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05/os-server-password => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:24:53.286723 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da608997-dc99-4f7d-909a-43ca1d6ab3d9 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:53.291958 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da608997-dc99-4f7d-909a-43ca1d6ab3d9 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:53.292739 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da608997-dc99-4f7d-909a-43ca1d6ab3d9 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:53.293751 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da608997-dc99-4f7d-909a-43ca1d6ab3d9 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:53.294413 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da608997-dc99-4f7d-909a-43ca1d6ab3d9 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:53.297126 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da608997-dc99-4f7d-909a-43ca1d6ab3d9 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:53.353902 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-da608997-dc99-4f7d-909a-43ca1d6ab3d9 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] 10.222.0.39 "GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.108102 Aug 07 01:24:53.365200 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5eb9c83e-910f-4f98-8632-fb13511e11a2 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:53.366059 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5eb9c83e-910f-4f98-8632-fb13511e11a2 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] [instance: b7680b77-1951-4c01-aecc-f593bb0edd05] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:53.373879 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1656/3012] 10.222.0.39 () {58 vars in 1293 bytes} [Sun Aug 7 01:24:53 2022] GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05/os-server-password => generated 16 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:24:53.376340 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5eb9c83e-910f-4f98-8632-fb13511e11a2 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:53.383151 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5eb9c83e-910f-4f98-8632-fb13511e11a2 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:53.384081 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5eb9c83e-910f-4f98-8632-fb13511e11a2 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:53.385066 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5eb9c83e-910f-4f98-8632-fb13511e11a2 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:53.385747 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5eb9c83e-910f-4f98-8632-fb13511e11a2 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:53.386460 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5eb9c83e-910f-4f98-8632-fb13511e11a2 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:53.476855 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5eb9c83e-910f-4f98-8632-fb13511e11a2 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] [instance: b7680b77-1951-4c01-aecc-f593bb0edd05] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:24:53.662195 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5eb9c83e-910f-4f98-8632-fb13511e11a2 tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05" status: 204 len: 0 microversion: 2.1 time: 0.300585 Aug 07 01:24:53.671620 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a9c072ba-59a6-4c62-9292-5222ca1f7d8c tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:53.673089 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a9c072ba-59a6-4c62-9292-5222ca1f7d8c tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] [instance: b7680b77-1951-4c01-aecc-f593bb0edd05] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:53.677524 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1357/3013] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:24:53 2022] DELETE /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:24:53.687116 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a9c072ba-59a6-4c62-9292-5222ca1f7d8c tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:53.696592 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a9c072ba-59a6-4c62-9292-5222ca1f7d8c tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:53.697432 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a9c072ba-59a6-4c62-9292-5222ca1f7d8c tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:53.698410 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a9c072ba-59a6-4c62-9292-5222ca1f7d8c tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:53.699124 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a9c072ba-59a6-4c62-9292-5222ca1f7d8c tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:53.699782 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a9c072ba-59a6-4c62-9292-5222ca1f7d8c tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:56.100377 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a9c072ba-59a6-4c62-9292-5222ca1f7d8c tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaafe20889443e692f94fd4e4b8b023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e60e8cd3e6842ec82633393b0af52fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:56.121234 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a9c072ba-59a6-4c62-9292-5222ca1f7d8c tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] 10.222.0.39 "GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05" status: 200 len: 1509 microversion: 2.1 time: 2.452631 Aug 07 01:24:56.135921 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1657/3014] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:53 2022] GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05 => generated 1509 bytes in 2461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:57.155597 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fda60407-03c4-4297-9024-09a601bded7f tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:57.157182 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fda60407-03c4-4297-9024-09a601bded7f tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] [instance: b7680b77-1951-4c01-aecc-f593bb0edd05] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:57.229836 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fda60407-03c4-4297-9024-09a601bded7f tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:57.237180 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fda60407-03c4-4297-9024-09a601bded7f tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:57.239628 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fda60407-03c4-4297-9024-09a601bded7f tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:57.243732 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fda60407-03c4-4297-9024-09a601bded7f tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:57.246425 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fda60407-03c4-4297-9024-09a601bded7f tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:57.252714 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fda60407-03c4-4297-9024-09a601bded7f tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:57.559355 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fda60407-03c4-4297-9024-09a601bded7f tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaafe20889443e692f94fd4e4b8b023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e60e8cd3e6842ec82633393b0af52fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:57.573141 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fda60407-03c4-4297-9024-09a601bded7f tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] 10.222.0.39 "GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05" status: 200 len: 1467 microversion: 2.1 time: 0.432858 Aug 07 01:24:57.582925 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1358/3015] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:57 2022] GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05 => generated 1467 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:24:57.928451 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-f49711a1-0c1b-4f84-92be-6dbb1a909146 req-d26691ea-81b4-4d9a-9e16-97848c93446b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7680b77-1951-4c01-aecc-f593bb0edd05", "name": "network-vif-deleted", "tag": "5ebcabb2-5963-4cd4-a3de-90e9875253b6"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:24:57.956069 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f49711a1-0c1b-4f84-92be-6dbb1a909146 req-d26691ea-81b4-4d9a-9e16-97848c93446b service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:58.022410 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f49711a1-0c1b-4f84-92be-6dbb1a909146 req-d26691ea-81b4-4d9a-9e16-97848c93446b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.049s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:58.032399 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f49711a1-0c1b-4f84-92be-6dbb1a909146 req-d26691ea-81b4-4d9a-9e16-97848c93446b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:58.067391 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e807f42e-4344-4ea7-a9d9-09f226a44b84 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-338713083", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "554905b9-fa00-4877-bc90-609c81108292"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:24:58.119042 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:58.223929 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-f49711a1-0c1b-4f84-92be-6dbb1a909146 req-d26691ea-81b4-4d9a-9e16-97848c93446b service nova] Creating event network-vif-deleted:5ebcabb2-5963-4cd4-a3de-90e9875253b6 for instance b7680b77-1951-4c01-aecc-f593bb0edd05 on n-h1-master-1 Aug 07 01:24:58.270656 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-f49711a1-0c1b-4f84-92be-6dbb1a909146 req-d26691ea-81b4-4d9a-9e16-97848c93446b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.340208 Aug 07 01:24:58.280975 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1359/3016] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 07 01:24:58.608644 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-669f5f36-33c6-4685-a53d-f05cdc3d1a4c tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:24:58.612139 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-669f5f36-33c6-4685-a53d-f05cdc3d1a4c tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] [instance: b7680b77-1951-4c01-aecc-f593bb0edd05] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:24:58.638116 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-669f5f36-33c6-4685-a53d-f05cdc3d1a4c tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:58.642325 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-669f5f36-33c6-4685-a53d-f05cdc3d1a4c tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:58.646782 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-669f5f36-33c6-4685-a53d-f05cdc3d1a4c tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:58.651226 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-669f5f36-33c6-4685-a53d-f05cdc3d1a4c tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:58.654692 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-669f5f36-33c6-4685-a53d-f05cdc3d1a4c tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:58.658911 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-669f5f36-33c6-4685-a53d-f05cdc3d1a4c tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:58.843611 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-669f5f36-33c6-4685-a53d-f05cdc3d1a4c tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:24:58.847177 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-669f5f36-33c6-4685-a53d-f05cdc3d1a4c tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:24:58.870842 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-669f5f36-33c6-4685-a53d-f05cdc3d1a4c tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:24:58.882139 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-669f5f36-33c6-4685-a53d-f05cdc3d1a4c tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lazy-loading 'fault' on Instance uuid b7680b77-1951-4c01-aecc-f593bb0edd05 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:24:59.066854 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-669f5f36-33c6-4685-a53d-f05cdc3d1a4c tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaafe20889443e692f94fd4e4b8b023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e60e8cd3e6842ec82633393b0af52fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:24:59.075633 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-669f5f36-33c6-4685-a53d-f05cdc3d1a4c tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] 10.222.0.39 "GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05" status: 200 len: 1306 microversion: 2.1 time: 0.472251 Aug 07 01:24:59.078929 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1360/3017] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:24:58 2022] GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05 => generated 1306 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:00.100106 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a6d8d06b-ebd5-4289-9df9-0b46c8aaa59a tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:00.101533 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a6d8d06b-ebd5-4289-9df9-0b46c8aaa59a tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] [instance: b7680b77-1951-4c01-aecc-f593bb0edd05] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:00.118795 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a6d8d06b-ebd5-4289-9df9-0b46c8aaa59a tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:00.119634 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a6d8d06b-ebd5-4289-9df9-0b46c8aaa59a tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:00.120361 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a6d8d06b-ebd5-4289-9df9-0b46c8aaa59a tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:00.124828 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a6d8d06b-ebd5-4289-9df9-0b46c8aaa59a tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:00.129383 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a6d8d06b-ebd5-4289-9df9-0b46c8aaa59a tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:00.134220 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a6d8d06b-ebd5-4289-9df9-0b46c8aaa59a tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:00.214499 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-a6d8d06b-ebd5-4289-9df9-0b46c8aaa59a tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] HTTP exception thrown: Instance b7680b77-1951-4c01-aecc-f593bb0edd05 could not be found. Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a6d8d06b-ebd5-4289-9df9-0b46c8aaa59a tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Request method failure captured: Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05 HTTP/1.1 Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xRFk_G3KqkqUmvhughuGS_KOas0AdBkXYFXS2bTdQdSP60mFuGpKIHcCrvhkMslVknGVSx8Oi73R0BJ0vFlbbjgWi3ndjiVrLyIEnaMSns4AC9_qCXmZ6dTuhAHgO9uSJEblG4ENecksQsW8qIJVzhHVU6RFgezvj6Op6uc53l3YKw Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 2e60e8cd3e6842ec82633393b0af52fd Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServerPasswordTestJSON-788838134 Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2e60e8cd3e6842ec82633393b0af52fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2e60e8cd3e6842ec82633393b0af52fd", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2e60e8cd3e6842ec82633393b0af52fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2e60e8cd3e6842ec82633393b0af52fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServerPasswordTestJSON-788838134 Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 2e60e8cd3e6842ec82633393b0af52fd Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServerPasswordTestJSON-788838134 Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServerPasswordTestJSON-788838134-project Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: dfaafe20889443e692f94fd4e4b8b023 Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServerPasswordTestJSON-788838134-project Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: exception: Instance b7680b77-1951-4c01-aecc-f593bb0edd05 could not be found. Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'b7680b77-1951-4c01-aecc-f593bb0edd05'} Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7680b77-1951-4c01-aecc-f593bb0edd05 could not be found. Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7680b77-1951-4c01-aecc-f593bb0edd05 could not be found. Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:25:00.216246 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:25:00.221359 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:25:00.221359 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:25:00.221359 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:25:00.221359 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:25:00.221359 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:25:00.221359 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7680b77-1951-4c01-aecc-f593bb0edd05 could not be found. Aug 07 01:25:00.221359 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:25:00.221359 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a6d8d06b-ebd5-4289-9df9-0b46c8aaa59a tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] Returning 404 to user: Instance b7680b77-1951-4c01-aecc-f593bb0edd05 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:25:00.221359 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a6d8d06b-ebd5-4289-9df9-0b46c8aaa59a tempest-ServerPasswordTestJSON-788838134 tempest-ServerPasswordTestJSON-788838134-project] 10.222.0.39 "GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05" status: 404 len: 111 microversion: 2.1 time: 0.124261 Aug 07 01:25:00.240093 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1361/3018] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:00 2022] GET /compute/v2.1/servers/b7680b77-1951-4c01-aecc-f593bb0edd05 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:25:06.118643 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:08.142419 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:10.289906 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:10.293397 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:10.675857 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-00f4ce02-7921-484c-b2dc-d55406d6feda tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-315503800", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "aad9ba1b-e4bc-4046-88bb-e7d112e5c033"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:25:15.139452 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-e807f42e-4344-4ea7-a9d9-09f226a44b84 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] validate_networks() for [('554905b9-fa00-4877-bc90-609c81108292', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:25:15.169558 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-00f4ce02-7921-484c-b2dc-d55406d6feda tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] validate_networks() for [('aad9ba1b-e4bc-4046-88bb-e7d112e5c033', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:25:16.416895 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e807f42e-4344-4ea7-a9d9-09f226a44b84 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:25:16.417794 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e807f42e-4344-4ea7-a9d9-09f226a44b84 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:25:16.418433 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e807f42e-4344-4ea7-a9d9-09f226a44b84 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:25:16.419162 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e807f42e-4344-4ea7-a9d9-09f226a44b84 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:25:16.420396 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e807f42e-4344-4ea7-a9d9-09f226a44b84 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:25:16.512247 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e807f42e-4344-4ea7-a9d9-09f226a44b84 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:16.513197 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e807f42e-4344-4ea7-a9d9-09f226a44b84 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:16.523544 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e807f42e-4344-4ea7-a9d9-09f226a44b84 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:16.527548 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e807f42e-4344-4ea7-a9d9-09f226a44b84 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:16.532209 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e807f42e-4344-4ea7-a9d9-09f226a44b84 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:16.534319 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e807f42e-4344-4ea7-a9d9-09f226a44b84 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:16.570513 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-e807f42e-4344-4ea7-a9d9-09f226a44b84 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Getting quotas for project 5506f7c95c1a46c5b3966597764b0111. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:25:16.577119 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-e807f42e-4344-4ea7-a9d9-09f226a44b84 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Getting quotas for user d1f0c01c340940388b440932d51988ff and project 5506f7c95c1a46c5b3966597764b0111. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:25:16.600072 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e807f42e-4344-4ea7-a9d9-09f226a44b84 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:25:16.604272 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e807f42e-4344-4ea7-a9d9-09f226a44b84 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6492010f-c0b5-4782-b58b-e46c498fe667] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:25:16.691490 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e807f42e-4344-4ea7-a9d9-09f226a44b84 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 19.338223 Aug 07 01:25:16.694345 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1658/3019] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:24:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 19342 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 07 01:25:16.701027 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e1431e52-1082-47e4-8dc0-15d8902c4c29 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:16.702110 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e1431e52-1082-47e4-8dc0-15d8902c4c29 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:16.719652 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1431e52-1082-47e4-8dc0-15d8902c4c29 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:16.720716 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1431e52-1082-47e4-8dc0-15d8902c4c29 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:16.722287 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1431e52-1082-47e4-8dc0-15d8902c4c29 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:16.724764 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1431e52-1082-47e4-8dc0-15d8902c4c29 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:16.728892 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1431e52-1082-47e4-8dc0-15d8902c4c29 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:16.729916 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1431e52-1082-47e4-8dc0-15d8902c4c29 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:17.207402 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e1431e52-1082-47e4-8dc0-15d8902c4c29 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:17.228458 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e1431e52-1082-47e4-8dc0-15d8902c4c29 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.532183 Aug 07 01:25:17.243700 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1659/3020] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:16 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:17.260239 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f1d3732a-69de-41e2-accc-9c864e77fceb tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:17.260239 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f1d3732a-69de-41e2-accc-9c864e77fceb tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6492010f-c0b5-4782-b58b-e46c498fe667] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:17.635457 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f1d3732a-69de-41e2-accc-9c864e77fceb tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:17.664946 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f1d3732a-69de-41e2-accc-9c864e77fceb tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667" status: 200 len: 1214 microversion: 2.1 time: 0.418285 Aug 07 01:25:17.669601 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1660/3021] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:17 2022] GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667 => generated 1214 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:17.709472 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1ee045b3-06ba-4a83-b177-1da44810d8f5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-976123588"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:25:17.714022 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1ee045b3-06ba-4a83-b177-1da44810d8f5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:17.748600 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ee045b3-06ba-4a83-b177-1da44810d8f5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:17.751821 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ee045b3-06ba-4a83-b177-1da44810d8f5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:17.757381 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ee045b3-06ba-4a83-b177-1da44810d8f5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:17.761900 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ee045b3-06ba-4a83-b177-1da44810d8f5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:17.763419 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ee045b3-06ba-4a83-b177-1da44810d8f5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:17.766449 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ee045b3-06ba-4a83-b177-1da44810d8f5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:17.921433 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-00f4ce02-7921-484c-b2dc-d55406d6feda tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:25:17.922576 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-00f4ce02-7921-484c-b2dc-d55406d6feda tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:25:17.923467 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-00f4ce02-7921-484c-b2dc-d55406d6feda tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:25:17.924388 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-00f4ce02-7921-484c-b2dc-d55406d6feda tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:25:17.925284 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-00f4ce02-7921-484c-b2dc-d55406d6feda tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:25:17.954015 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00f4ce02-7921-484c-b2dc-d55406d6feda tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:17.957219 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00f4ce02-7921-484c-b2dc-d55406d6feda tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:17.958119 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00f4ce02-7921-484c-b2dc-d55406d6feda tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:17.960166 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00f4ce02-7921-484c-b2dc-d55406d6feda tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:17.961044 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00f4ce02-7921-484c-b2dc-d55406d6feda tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:17.961829 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00f4ce02-7921-484c-b2dc-d55406d6feda tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:18.100497 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-00f4ce02-7921-484c-b2dc-d55406d6feda tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Getting quotas for project b7995a68f5a541aabda74c0b01f6aac9. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:25:18.133186 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-00f4ce02-7921-484c-b2dc-d55406d6feda tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Getting quotas for user a50140f86f00487b90d0503d4819234f and project b7995a68f5a541aabda74c0b01f6aac9. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:25:18.217559 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-00f4ce02-7921-484c-b2dc-d55406d6feda tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:25:18.226480 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-00f4ce02-7921-484c-b2dc-d55406d6feda tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: 77f80d2b-d1d8-4ea9-9637-f43100b95523] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:25:18.366783 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-00f4ce02-7921-484c-b2dc-d55406d6feda tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.088631 Aug 07 01:25:18.369912 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1362/3022] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:25:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 8092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:25:18.386814 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e30f6f4a-7352-4937-ae67-54b7eaef40dc tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:18.387392 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e30f6f4a-7352-4937-ae67-54b7eaef40dc tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: 77f80d2b-d1d8-4ea9-9637-f43100b95523] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:18.549861 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e30f6f4a-7352-4937-ae67-54b7eaef40dc tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:18.558270 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e30f6f4a-7352-4937-ae67-54b7eaef40dc tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523" status: 200 len: 1207 microversion: 2.1 time: 0.177531 Aug 07 01:25:18.562522 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1363/3023] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:18 2022] GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523 => generated 1207 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:25:18.698837 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4e6ec922-bdf0-4c94-827a-8da4fac640f1 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:18.699723 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4e6ec922-bdf0-4c94-827a-8da4fac640f1 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6492010f-c0b5-4782-b58b-e46c498fe667] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:18.730668 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1ee045b3-06ba-4a83-b177-1da44810d8f5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action" status: 202 len: 0 microversion: 2.1 time: 1.034984 Aug 07 01:25:18.736605 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1661/3024] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:25:17 2022] POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action => generated 0 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 07 01:25:19.604187 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-91c2da74-d5b3-4548-b731-7a7472aab85f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:19.605683 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-91c2da74-d5b3-4548-b731-7a7472aab85f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: 77f80d2b-d1d8-4ea9-9637-f43100b95523] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:19.838170 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4e6ec922-bdf0-4c94-827a-8da4fac640f1 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:19.872515 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4e6ec922-bdf0-4c94-827a-8da4fac640f1 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667" status: 200 len: 1214 microversion: 2.1 time: 1.176639 Aug 07 01:25:19.874940 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1364/3025] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:18 2022] GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667 => generated 1214 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:19.893565 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-91c2da74-d5b3-4548-b731-7a7472aab85f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:19.915220 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-91c2da74-d5b3-4548-b731-7a7472aab85f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523" status: 200 len: 1207 microversion: 2.1 time: 0.309704 Aug 07 01:25:19.917660 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1662/3026] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:19 2022] GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523 => generated 1207 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:25:20.901784 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1a76f9af-87b4-4822-96fc-491909fb2c05 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:20.905656 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1a76f9af-87b4-4822-96fc-491909fb2c05 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6492010f-c0b5-4782-b58b-e46c498fe667] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:20.942069 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1a76f9af-87b4-4822-96fc-491909fb2c05 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:20.943593 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1a76f9af-87b4-4822-96fc-491909fb2c05 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:20.946114 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1a76f9af-87b4-4822-96fc-491909fb2c05 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:20.947167 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1a76f9af-87b4-4822-96fc-491909fb2c05 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:20.953537 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d27dd32c-8ce5-4625-ba3b-52d2a8f9ff6d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:20.954714 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d27dd32c-8ce5-4625-ba3b-52d2a8f9ff6d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: 77f80d2b-d1d8-4ea9-9637-f43100b95523] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:20.955768 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1a76f9af-87b4-4822-96fc-491909fb2c05 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:20.956464 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1a76f9af-87b4-4822-96fc-491909fb2c05 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:20.983944 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d27dd32c-8ce5-4625-ba3b-52d2a8f9ff6d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:20.984449 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d27dd32c-8ce5-4625-ba3b-52d2a8f9ff6d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:20.984910 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d27dd32c-8ce5-4625-ba3b-52d2a8f9ff6d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:20.985616 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d27dd32c-8ce5-4625-ba3b-52d2a8f9ff6d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:20.996090 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d27dd32c-8ce5-4625-ba3b-52d2a8f9ff6d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:20.996799 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d27dd32c-8ce5-4625-ba3b-52d2a8f9ff6d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:21.267349 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d27dd32c-8ce5-4625-ba3b-52d2a8f9ff6d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:21.283632 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1a76f9af-87b4-4822-96fc-491909fb2c05 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:21.284211 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d27dd32c-8ce5-4625-ba3b-52d2a8f9ff6d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523" status: 200 len: 1259 microversion: 2.1 time: 0.342772 Aug 07 01:25:21.296206 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1663/3027] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:20 2022] GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523 => generated 1259 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:21.329317 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1a76f9af-87b4-4822-96fc-491909fb2c05 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667" status: 200 len: 1272 microversion: 2.1 time: 0.433798 Aug 07 01:25:21.332402 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1365/3028] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:20 2022] GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667 => generated 1272 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:21.861922 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-f58b51e9-37b2-4b20-92ef-5fd91bd2349d req-768edd59-c26a-4fbd-8510-b518ef3c5c6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e39f0d23-55ab-417b-818e-92de14de44c0", "name": "network-vif-unplugged", "status": "completed", "tag": "04267581-58b6-42a6-92a4-4f79278a63aa"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:25:21.888337 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f58b51e9-37b2-4b20-92ef-5fd91bd2349d req-768edd59-c26a-4fbd-8510-b518ef3c5c6a service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:21.889224 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f58b51e9-37b2-4b20-92ef-5fd91bd2349d req-768edd59-c26a-4fbd-8510-b518ef3c5c6a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:21.889894 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f58b51e9-37b2-4b20-92ef-5fd91bd2349d req-768edd59-c26a-4fbd-8510-b518ef3c5c6a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:21.926073 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-f58b51e9-37b2-4b20-92ef-5fd91bd2349d req-768edd59-c26a-4fbd-8510-b518ef3c5c6a service nova] Creating event network-vif-unplugged:04267581-58b6-42a6-92a4-4f79278a63aa for instance e39f0d23-55ab-417b-818e-92de14de44c0 on n-h2-master-1 Aug 07 01:25:21.948554 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-f58b51e9-37b2-4b20-92ef-5fd91bd2349d req-768edd59-c26a-4fbd-8510-b518ef3c5c6a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.650383 Aug 07 01:25:21.949922 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1664/3029] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:25:22.326070 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-eba1c7e1-725b-44b9-a3fe-03468e7d82bc tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:22.327389 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-eba1c7e1-725b-44b9-a3fe-03468e7d82bc tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: 77f80d2b-d1d8-4ea9-9637-f43100b95523] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:22.347368 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eba1c7e1-725b-44b9-a3fe-03468e7d82bc tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:22.347872 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eba1c7e1-725b-44b9-a3fe-03468e7d82bc tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:22.348554 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eba1c7e1-725b-44b9-a3fe-03468e7d82bc tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:22.349126 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eba1c7e1-725b-44b9-a3fe-03468e7d82bc tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:22.349591 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eba1c7e1-725b-44b9-a3fe-03468e7d82bc tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:22.350024 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eba1c7e1-725b-44b9-a3fe-03468e7d82bc tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:22.397063 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-993f66e2-ba73-4080-9a49-aee2c5cf00d3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:22.404428 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-993f66e2-ba73-4080-9a49-aee2c5cf00d3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6492010f-c0b5-4782-b58b-e46c498fe667] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:22.447754 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-993f66e2-ba73-4080-9a49-aee2c5cf00d3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:22.450620 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-993f66e2-ba73-4080-9a49-aee2c5cf00d3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:22.452630 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-993f66e2-ba73-4080-9a49-aee2c5cf00d3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:22.463250 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-993f66e2-ba73-4080-9a49-aee2c5cf00d3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:22.465703 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-993f66e2-ba73-4080-9a49-aee2c5cf00d3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:22.471416 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-993f66e2-ba73-4080-9a49-aee2c5cf00d3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:22.834898 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-993f66e2-ba73-4080-9a49-aee2c5cf00d3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:22.902896 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-993f66e2-ba73-4080-9a49-aee2c5cf00d3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667" status: 200 len: 1272 microversion: 2.1 time: 0.526094 Aug 07 01:25:22.904547 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1665/3030] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:22 2022] GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667 => generated 1272 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:23.075441 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-eba1c7e1-725b-44b9-a3fe-03468e7d82bc tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:23.085088 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-eba1c7e1-725b-44b9-a3fe-03468e7d82bc tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523" status: 200 len: 1265 microversion: 2.1 time: 0.765692 Aug 07 01:25:23.085692 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1366/3031] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:22 2022] GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523 => generated 1265 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:23.951299 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-036e9047-06ce-453e-9609-c38f93bde9f5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:23.954095 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-036e9047-06ce-453e-9609-c38f93bde9f5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6492010f-c0b5-4782-b58b-e46c498fe667] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:24.007969 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-036e9047-06ce-453e-9609-c38f93bde9f5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:24.008504 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-036e9047-06ce-453e-9609-c38f93bde9f5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:24.008956 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-036e9047-06ce-453e-9609-c38f93bde9f5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:24.012578 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-036e9047-06ce-453e-9609-c38f93bde9f5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:24.014251 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-036e9047-06ce-453e-9609-c38f93bde9f5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:24.015323 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-036e9047-06ce-453e-9609-c38f93bde9f5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:24.110567 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a2777647-40ed-49ce-ac30-2e87cbc87f23 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:24.111678 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a2777647-40ed-49ce-ac30-2e87cbc87f23 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: 77f80d2b-d1d8-4ea9-9637-f43100b95523] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:24.139205 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2777647-40ed-49ce-ac30-2e87cbc87f23 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:24.139773 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2777647-40ed-49ce-ac30-2e87cbc87f23 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:24.141335 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2777647-40ed-49ce-ac30-2e87cbc87f23 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:24.144083 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2777647-40ed-49ce-ac30-2e87cbc87f23 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:24.145150 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2777647-40ed-49ce-ac30-2e87cbc87f23 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:24.146639 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2777647-40ed-49ce-ac30-2e87cbc87f23 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:24.371258 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-036e9047-06ce-453e-9609-c38f93bde9f5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:24.395674 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-036e9047-06ce-453e-9609-c38f93bde9f5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667" status: 200 len: 1272 microversion: 2.1 time: 0.451972 Aug 07 01:25:24.396316 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1666/3032] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:23 2022] GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667 => generated 1272 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:24.431008 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a2777647-40ed-49ce-ac30-2e87cbc87f23 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:24.461099 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a2777647-40ed-49ce-ac30-2e87cbc87f23 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523" status: 200 len: 1265 microversion: 2.1 time: 0.357345 Aug 07 01:25:24.462427 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1367/3033] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:24 2022] GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523 => generated 1265 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:25.422796 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-34d2a57b-1ee4-4775-92b3-4628e5b54ad4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:25.424845 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-34d2a57b-1ee4-4775-92b3-4628e5b54ad4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6492010f-c0b5-4782-b58b-e46c498fe667] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:25.436611 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34d2a57b-1ee4-4775-92b3-4628e5b54ad4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:25.437324 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34d2a57b-1ee4-4775-92b3-4628e5b54ad4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:25.437935 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34d2a57b-1ee4-4775-92b3-4628e5b54ad4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:25.438848 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34d2a57b-1ee4-4775-92b3-4628e5b54ad4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:25.439471 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34d2a57b-1ee4-4775-92b3-4628e5b54ad4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:25.441743 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34d2a57b-1ee4-4775-92b3-4628e5b54ad4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:25.499758 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-16fb34c6-b240-4782-8a52-104a9af247d9 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:25.502972 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-16fb34c6-b240-4782-8a52-104a9af247d9 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: 77f80d2b-d1d8-4ea9-9637-f43100b95523] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:25.534857 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16fb34c6-b240-4782-8a52-104a9af247d9 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:25.535353 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16fb34c6-b240-4782-8a52-104a9af247d9 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:25.543903 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16fb34c6-b240-4782-8a52-104a9af247d9 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:25.545590 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16fb34c6-b240-4782-8a52-104a9af247d9 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:25.546109 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16fb34c6-b240-4782-8a52-104a9af247d9 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:25.546542 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16fb34c6-b240-4782-8a52-104a9af247d9 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:26.377512 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-16fb34c6-b240-4782-8a52-104a9af247d9 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:26.391627 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-16fb34c6-b240-4782-8a52-104a9af247d9 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523" status: 200 len: 1265 microversion: 2.1 time: 0.897764 Aug 07 01:25:26.404577 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1368/3034] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:25 2022] GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523 => generated 1265 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:25:26.559370 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:26.571738 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-34d2a57b-1ee4-4775-92b3-4628e5b54ad4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:26.603433 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-34d2a57b-1ee4-4775-92b3-4628e5b54ad4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667" status: 200 len: 1314 microversion: 2.1 time: 1.184493 Aug 07 01:25:26.634528 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1667/3035] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:25 2022] GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667 => generated 1314 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:25:27.428835 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2edb4d8f-ac63-4eac-af6c-275a26667314 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:27.431453 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2edb4d8f-ac63-4eac-af6c-275a26667314 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: 77f80d2b-d1d8-4ea9-9637-f43100b95523] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:27.453944 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2edb4d8f-ac63-4eac-af6c-275a26667314 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:27.463183 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2edb4d8f-ac63-4eac-af6c-275a26667314 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:27.465003 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2edb4d8f-ac63-4eac-af6c-275a26667314 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:27.467271 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2edb4d8f-ac63-4eac-af6c-275a26667314 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:27.472514 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2edb4d8f-ac63-4eac-af6c-275a26667314 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:27.473230 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2edb4d8f-ac63-4eac-af6c-275a26667314 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:27.633933 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c9504456-424b-44d1-bbfd-8cdf17c04d36 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:27.642065 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c9504456-424b-44d1-bbfd-8cdf17c04d36 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6492010f-c0b5-4782-b58b-e46c498fe667] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:27.671967 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c9504456-424b-44d1-bbfd-8cdf17c04d36 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:27.674307 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c9504456-424b-44d1-bbfd-8cdf17c04d36 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:27.677012 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c9504456-424b-44d1-bbfd-8cdf17c04d36 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:27.680052 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c9504456-424b-44d1-bbfd-8cdf17c04d36 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:27.684127 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c9504456-424b-44d1-bbfd-8cdf17c04d36 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:27.685241 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c9504456-424b-44d1-bbfd-8cdf17c04d36 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:27.778106 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2edb4d8f-ac63-4eac-af6c-275a26667314 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:27.799153 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2edb4d8f-ac63-4eac-af6c-275a26667314 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523" status: 200 len: 1265 microversion: 2.1 time: 0.377273 Aug 07 01:25:27.802382 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1369/3036] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:27 2022] GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523 => generated 1265 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:28.086419 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c9504456-424b-44d1-bbfd-8cdf17c04d36 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:28.100813 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c9504456-424b-44d1-bbfd-8cdf17c04d36 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667" status: 200 len: 1314 microversion: 2.1 time: 0.470660 Aug 07 01:25:28.118212 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1668/3037] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:27 2022] GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667 => generated 1314 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:25:28.817377 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:28.823987 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3ac2a0c6-ce75-413a-8404-d1e3ae499a4d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:28.824672 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3ac2a0c6-ce75-413a-8404-d1e3ae499a4d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: 77f80d2b-d1d8-4ea9-9637-f43100b95523] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:28.844066 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ac2a0c6-ce75-413a-8404-d1e3ae499a4d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:28.844574 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ac2a0c6-ce75-413a-8404-d1e3ae499a4d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:28.845024 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ac2a0c6-ce75-413a-8404-d1e3ae499a4d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:28.845751 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ac2a0c6-ce75-413a-8404-d1e3ae499a4d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:28.846215 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ac2a0c6-ce75-413a-8404-d1e3ae499a4d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:28.846681 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ac2a0c6-ce75-413a-8404-d1e3ae499a4d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:29.125736 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6ff276c1-ec52-42cc-bb1d-8175ecbcbe80 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:29.127118 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6ff276c1-ec52-42cc-bb1d-8175ecbcbe80 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6492010f-c0b5-4782-b58b-e46c498fe667] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:29.165680 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ff276c1-ec52-42cc-bb1d-8175ecbcbe80 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:29.167456 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ff276c1-ec52-42cc-bb1d-8175ecbcbe80 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:29.170675 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ff276c1-ec52-42cc-bb1d-8175ecbcbe80 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:29.174796 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ff276c1-ec52-42cc-bb1d-8175ecbcbe80 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:29.187120 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ff276c1-ec52-42cc-bb1d-8175ecbcbe80 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:29.188049 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ff276c1-ec52-42cc-bb1d-8175ecbcbe80 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:29.305374 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3ac2a0c6-ce75-413a-8404-d1e3ae499a4d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:29.342050 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3ac2a0c6-ce75-413a-8404-d1e3ae499a4d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523" status: 200 len: 1307 microversion: 2.1 time: 0.523007 Aug 07 01:25:29.347618 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1370/3038] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:28 2022] GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523 => generated 1307 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:29.902089 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=10 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:30.179971 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6ff276c1-ec52-42cc-bb1d-8175ecbcbe80 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:30.188616 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6ff276c1-ec52-42cc-bb1d-8175ecbcbe80 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667" status: 200 len: 1314 microversion: 2.1 time: 1.066895 Aug 07 01:25:30.197074 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1669/3039] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:29 2022] GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667 => generated 1314 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:30.362156 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=10 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:30.368056 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-53fb14f3-730a-4d32-a581-f23f3cb4f67e tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:30.369039 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-53fb14f3-730a-4d32-a581-f23f3cb4f67e tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: 77f80d2b-d1d8-4ea9-9637-f43100b95523] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:30.390078 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53fb14f3-730a-4d32-a581-f23f3cb4f67e tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:30.400710 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53fb14f3-730a-4d32-a581-f23f3cb4f67e tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:30.401557 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53fb14f3-730a-4d32-a581-f23f3cb4f67e tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:30.402546 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53fb14f3-730a-4d32-a581-f23f3cb4f67e tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:30.404432 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53fb14f3-730a-4d32-a581-f23f3cb4f67e tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:30.405126 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53fb14f3-730a-4d32-a581-f23f3cb4f67e tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:31.223083 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fc5ddde3-e5d4-44b3-8cf1-24518b000e58 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:31.224395 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fc5ddde3-e5d4-44b3-8cf1-24518b000e58 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6492010f-c0b5-4782-b58b-e46c498fe667] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:31.255256 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc5ddde3-e5d4-44b3-8cf1-24518b000e58 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:31.263296 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc5ddde3-e5d4-44b3-8cf1-24518b000e58 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:31.268167 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc5ddde3-e5d4-44b3-8cf1-24518b000e58 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:31.275220 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc5ddde3-e5d4-44b3-8cf1-24518b000e58 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:31.280975 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc5ddde3-e5d4-44b3-8cf1-24518b000e58 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:31.284170 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc5ddde3-e5d4-44b3-8cf1-24518b000e58 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:32.670156 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-53fb14f3-730a-4d32-a581-f23f3cb4f67e tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:32.692231 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-53fb14f3-730a-4d32-a581-f23f3cb4f67e tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523" status: 200 len: 1307 microversion: 2.1 time: 2.325481 Aug 07 01:25:32.695111 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1371/3040] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:30 2022] GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523 => generated 1307 bytes in 2335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:33.713097 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-121ef229-679d-4a56-b329-73256bcb5379 req-c5289991-2b4e-446e-a024-dfdf8bfa0fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77f80d2b-d1d8-4ea9-9637-f43100b95523", "tag": "f7686f09-aeaf-4946-ba71-0a2620fdc9ba"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:25:33.730401 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fc5ddde3-e5d4-44b3-8cf1-24518b000e58 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:33.743265 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-121ef229-679d-4a56-b329-73256bcb5379 req-c5289991-2b4e-446e-a024-dfdf8bfa0fd6 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:33.743759 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-121ef229-679d-4a56-b329-73256bcb5379 req-c5289991-2b4e-446e-a024-dfdf8bfa0fd6 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:33.744229 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-121ef229-679d-4a56-b329-73256bcb5379 req-c5289991-2b4e-446e-a024-dfdf8bfa0fd6 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:33.750177 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fc5ddde3-e5d4-44b3-8cf1-24518b000e58 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667" status: 200 len: 1314 microversion: 2.1 time: 2.532026 Aug 07 01:25:33.757149 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1670/3041] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:31 2022] GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667 => generated 1314 bytes in 2540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:33.769798 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-84ef5ee3-bab3-4cc1-95da-2f8b03710e70 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:33.783334 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-84ef5ee3-bab3-4cc1-95da-2f8b03710e70 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: 77f80d2b-d1d8-4ea9-9637-f43100b95523] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:33.792595 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-121ef229-679d-4a56-b329-73256bcb5379 req-c5289991-2b4e-446e-a024-dfdf8bfa0fd6 service nova] Creating event network-changed:f7686f09-aeaf-4946-ba71-0a2620fdc9ba for instance 77f80d2b-d1d8-4ea9-9637-f43100b95523 on n-h1-master-1 Aug 07 01:25:33.811437 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84ef5ee3-bab3-4cc1-95da-2f8b03710e70 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:33.817377 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-121ef229-679d-4a56-b329-73256bcb5379 req-c5289991-2b4e-446e-a024-dfdf8bfa0fd6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.446694 Aug 07 01:25:33.821893 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1372/3042] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:25:33.826424 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84ef5ee3-bab3-4cc1-95da-2f8b03710e70 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:33.827594 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84ef5ee3-bab3-4cc1-95da-2f8b03710e70 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:33.833445 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84ef5ee3-bab3-4cc1-95da-2f8b03710e70 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:33.834597 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84ef5ee3-bab3-4cc1-95da-2f8b03710e70 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:33.835537 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84ef5ee3-bab3-4cc1-95da-2f8b03710e70 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:34.351046 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-84ef5ee3-bab3-4cc1-95da-2f8b03710e70 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:34.366369 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-84ef5ee3-bab3-4cc1-95da-2f8b03710e70 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523" status: 200 len: 1307 microversion: 2.1 time: 0.606908 Aug 07 01:25:34.368022 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1671/3043] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:33 2022] GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523 => generated 1307 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:34.784050 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b0a5ca3e-b3f7-4915-ac31-0c2958d8aeaa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:34.790207 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b0a5ca3e-b3f7-4915-ac31-0c2958d8aeaa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6492010f-c0b5-4782-b58b-e46c498fe667] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:34.800011 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b0a5ca3e-b3f7-4915-ac31-0c2958d8aeaa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:34.805471 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b0a5ca3e-b3f7-4915-ac31-0c2958d8aeaa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:34.806303 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b0a5ca3e-b3f7-4915-ac31-0c2958d8aeaa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:34.807236 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b0a5ca3e-b3f7-4915-ac31-0c2958d8aeaa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:34.807873 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b0a5ca3e-b3f7-4915-ac31-0c2958d8aeaa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:34.808518 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b0a5ca3e-b3f7-4915-ac31-0c2958d8aeaa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:35.322923 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-f145a217-420b-4242-a16b-83a6925acc7c req-9e006d5a-9385-4749-b7e3-68fc58ba3769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e39f0d23-55ab-417b-818e-92de14de44c0", "name": "network-vif-plugged", "status": "completed", "tag": "04267581-58b6-42a6-92a4-4f79278a63aa"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:25:35.348911 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f145a217-420b-4242-a16b-83a6925acc7c req-9e006d5a-9385-4749-b7e3-68fc58ba3769 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:35.356725 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f145a217-420b-4242-a16b-83a6925acc7c req-9e006d5a-9385-4749-b7e3-68fc58ba3769 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:35.358619 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f145a217-420b-4242-a16b-83a6925acc7c req-9e006d5a-9385-4749-b7e3-68fc58ba3769 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:35.420029 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-f145a217-420b-4242-a16b-83a6925acc7c req-9e006d5a-9385-4749-b7e3-68fc58ba3769 service nova] Creating event network-vif-plugged:04267581-58b6-42a6-92a4-4f79278a63aa for instance e39f0d23-55ab-417b-818e-92de14de44c0 on n-h2-master-1 Aug 07 01:25:35.458790 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-f145a217-420b-4242-a16b-83a6925acc7c req-9e006d5a-9385-4749-b7e3-68fc58ba3769 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140919 Aug 07 01:25:35.470819 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1672/3044] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 07 01:25:35.480619 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-54f65a92-360d-4af6-9396-4af4c60d8ae8 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:35.489941 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-54f65a92-360d-4af6-9396-4af4c60d8ae8 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: 77f80d2b-d1d8-4ea9-9637-f43100b95523] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:35.513808 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-54f65a92-360d-4af6-9396-4af4c60d8ae8 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:35.514656 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-54f65a92-360d-4af6-9396-4af4c60d8ae8 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:35.515316 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-54f65a92-360d-4af6-9396-4af4c60d8ae8 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:35.516316 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-54f65a92-360d-4af6-9396-4af4c60d8ae8 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:35.517000 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-54f65a92-360d-4af6-9396-4af4c60d8ae8 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:35.523633 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-54f65a92-360d-4af6-9396-4af4c60d8ae8 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:36.205117 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-54f65a92-360d-4af6-9396-4af4c60d8ae8 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:36.229910 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-54f65a92-360d-4af6-9396-4af4c60d8ae8 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523" status: 200 len: 1307 microversion: 2.1 time: 0.754984 Aug 07 01:25:36.230231 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1673/3045] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:35 2022] GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523 => generated 1307 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:36.244838 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-6b98c80e-8297-4c83-b069-2d17c06a720a req-84dc99b4-9fc8-4182-b361-66de42bb3437 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6492010f-c0b5-4782-b58b-e46c498fe667", "tag": "161c3dc4-2a0d-40f4-8f0b-0ea0776b55a5"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:25:36.283828 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6b98c80e-8297-4c83-b069-2d17c06a720a req-84dc99b4-9fc8-4182-b361-66de42bb3437 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:36.289334 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6b98c80e-8297-4c83-b069-2d17c06a720a req-84dc99b4-9fc8-4182-b361-66de42bb3437 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:36.290032 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6b98c80e-8297-4c83-b069-2d17c06a720a req-84dc99b4-9fc8-4182-b361-66de42bb3437 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:36.323142 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-6b98c80e-8297-4c83-b069-2d17c06a720a req-84dc99b4-9fc8-4182-b361-66de42bb3437 service nova] Creating event network-changed:161c3dc4-2a0d-40f4-8f0b-0ea0776b55a5 for instance 6492010f-c0b5-4782-b58b-e46c498fe667 on n-h1-master-1 Aug 07 01:25:36.336785 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-6b98c80e-8297-4c83-b069-2d17c06a720a req-84dc99b4-9fc8-4182-b361-66de42bb3437 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097395 Aug 07 01:25:36.346213 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1674/3046] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:25:37.092572 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b0a5ca3e-b3f7-4915-ac31-0c2958d8aeaa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:37.101041 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b0a5ca3e-b3f7-4915-ac31-0c2958d8aeaa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667" status: 200 len: 1314 microversion: 2.1 time: 2.322686 Aug 07 01:25:37.102387 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1373/3047] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:34 2022] GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667 => generated 1314 bytes in 2325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:37.253850 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-49624730-21bb-4acd-9fbd-6daf1f1aa70b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:37.255837 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-49624730-21bb-4acd-9fbd-6daf1f1aa70b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: 77f80d2b-d1d8-4ea9-9637-f43100b95523] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:37.287495 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-49624730-21bb-4acd-9fbd-6daf1f1aa70b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:37.297974 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-49624730-21bb-4acd-9fbd-6daf1f1aa70b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:37.310287 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-49624730-21bb-4acd-9fbd-6daf1f1aa70b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:37.313420 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-49624730-21bb-4acd-9fbd-6daf1f1aa70b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:37.316817 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-49624730-21bb-4acd-9fbd-6daf1f1aa70b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:37.322181 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-49624730-21bb-4acd-9fbd-6daf1f1aa70b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:37.851681 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-49624730-21bb-4acd-9fbd-6daf1f1aa70b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:37.876749 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-49624730-21bb-4acd-9fbd-6daf1f1aa70b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523" status: 200 len: 1307 microversion: 2.1 time: 0.628935 Aug 07 01:25:37.882270 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1675/3048] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:37 2022] GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523 => generated 1307 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:38.125963 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-44198138-a26d-4b24-8c65-05827f92d5dc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:38.126751 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-44198138-a26d-4b24-8c65-05827f92d5dc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6492010f-c0b5-4782-b58b-e46c498fe667] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:38.149931 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44198138-a26d-4b24-8c65-05827f92d5dc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:38.151921 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44198138-a26d-4b24-8c65-05827f92d5dc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:38.157823 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44198138-a26d-4b24-8c65-05827f92d5dc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:38.159691 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44198138-a26d-4b24-8c65-05827f92d5dc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:38.162103 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44198138-a26d-4b24-8c65-05827f92d5dc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:38.163385 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44198138-a26d-4b24-8c65-05827f92d5dc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:38.523685 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-44198138-a26d-4b24-8c65-05827f92d5dc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:38.539085 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-44198138-a26d-4b24-8c65-05827f92d5dc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667" status: 200 len: 1314 microversion: 2.1 time: 0.417609 Aug 07 01:25:38.540282 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1374/3049] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:38 2022] GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667 => generated 1314 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:38.902341 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-66c7015a-057a-47fb-8e3c-3da8691748e6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:38.902962 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-66c7015a-057a-47fb-8e3c-3da8691748e6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: 77f80d2b-d1d8-4ea9-9637-f43100b95523] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:38.927695 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:38.936614 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-66c7015a-057a-47fb-8e3c-3da8691748e6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:38.940164 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-66c7015a-057a-47fb-8e3c-3da8691748e6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:38.944015 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-66c7015a-057a-47fb-8e3c-3da8691748e6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:38.946456 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-66c7015a-057a-47fb-8e3c-3da8691748e6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:38.948323 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-66c7015a-057a-47fb-8e3c-3da8691748e6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:38.953173 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-66c7015a-057a-47fb-8e3c-3da8691748e6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:39.468500 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-66c7015a-057a-47fb-8e3c-3da8691748e6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:39.480404 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-66c7015a-057a-47fb-8e3c-3da8691748e6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523" status: 200 len: 1307 microversion: 2.1 time: 0.582859 Aug 07 01:25:39.481606 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1676/3050] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:38 2022] GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523 => generated 1307 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:39.566005 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f3d62601-a24d-41af-8b66-d21122572aa7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:39.568746 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f3d62601-a24d-41af-8b66-d21122572aa7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6492010f-c0b5-4782-b58b-e46c498fe667] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:39.588438 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f3d62601-a24d-41af-8b66-d21122572aa7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:39.588987 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f3d62601-a24d-41af-8b66-d21122572aa7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:39.589445 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f3d62601-a24d-41af-8b66-d21122572aa7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:39.593265 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f3d62601-a24d-41af-8b66-d21122572aa7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:39.594019 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f3d62601-a24d-41af-8b66-d21122572aa7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:39.595590 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f3d62601-a24d-41af-8b66-d21122572aa7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:40.171274 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f3d62601-a24d-41af-8b66-d21122572aa7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:40.183048 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f3d62601-a24d-41af-8b66-d21122572aa7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667" status: 200 len: 1314 microversion: 2.1 time: 0.621885 Aug 07 01:25:40.206938 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1375/3051] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:39 2022] GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667 => generated 1314 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:40.509599 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-07ae42fb-ed4b-49b9-aabc-315af06bc904 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:40.511768 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-07ae42fb-ed4b-49b9-aabc-315af06bc904 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: 77f80d2b-d1d8-4ea9-9637-f43100b95523] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:40.536681 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-07ae42fb-ed4b-49b9-aabc-315af06bc904 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:40.537572 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-07ae42fb-ed4b-49b9-aabc-315af06bc904 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:40.538247 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-07ae42fb-ed4b-49b9-aabc-315af06bc904 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:40.540821 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-07ae42fb-ed4b-49b9-aabc-315af06bc904 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:40.541668 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-07ae42fb-ed4b-49b9-aabc-315af06bc904 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:40.548868 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-07ae42fb-ed4b-49b9-aabc-315af06bc904 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:41.209897 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ba1d1b7b-64cd-4691-8999-95e451ffb44e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:41.211259 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ba1d1b7b-64cd-4691-8999-95e451ffb44e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6492010f-c0b5-4782-b58b-e46c498fe667] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:41.220801 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:41.254137 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ba1d1b7b-64cd-4691-8999-95e451ffb44e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:41.255227 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ba1d1b7b-64cd-4691-8999-95e451ffb44e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:41.258679 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ba1d1b7b-64cd-4691-8999-95e451ffb44e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:41.260111 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ba1d1b7b-64cd-4691-8999-95e451ffb44e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:41.260979 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ba1d1b7b-64cd-4691-8999-95e451ffb44e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:41.264237 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ba1d1b7b-64cd-4691-8999-95e451ffb44e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:41.288400 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=65 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:41.818733 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-07ae42fb-ed4b-49b9-aabc-315af06bc904 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:41.826033 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ba1d1b7b-64cd-4691-8999-95e451ffb44e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:41.860470 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:41.869468 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-07ae42fb-ed4b-49b9-aabc-315af06bc904 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523" status: 200 len: 1307 microversion: 2.1 time: 1.367669 Aug 07 01:25:41.871546 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ba1d1b7b-64cd-4691-8999-95e451ffb44e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667" status: 200 len: 1314 microversion: 2.1 time: 0.666543 Aug 07 01:25:41.872195 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1376/3052] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:41 2022] GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667 => generated 1314 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:41.886164 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1677/3053] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:40 2022] GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523 => generated 1307 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:42.897890 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b1b00058-75c7-47db-8da1-415c0ae0f911 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:42.899463 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b1b00058-75c7-47db-8da1-415c0ae0f911 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6492010f-c0b5-4782-b58b-e46c498fe667] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:42.906989 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4a6f5be3-a433-474b-919d-299000589f2e tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:42.908398 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4a6f5be3-a433-474b-919d-299000589f2e tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: 77f80d2b-d1d8-4ea9-9637-f43100b95523] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:42.950022 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b1b00058-75c7-47db-8da1-415c0ae0f911 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:42.952383 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a6f5be3-a433-474b-919d-299000589f2e tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:42.952961 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b1b00058-75c7-47db-8da1-415c0ae0f911 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:42.954006 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b1b00058-75c7-47db-8da1-415c0ae0f911 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:42.955367 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a6f5be3-a433-474b-919d-299000589f2e tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:42.975240 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a6f5be3-a433-474b-919d-299000589f2e tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:42.980616 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a6f5be3-a433-474b-919d-299000589f2e tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:42.981895 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b1b00058-75c7-47db-8da1-415c0ae0f911 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:42.985618 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b1b00058-75c7-47db-8da1-415c0ae0f911 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:42.988187 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a6f5be3-a433-474b-919d-299000589f2e tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:42.989179 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a6f5be3-a433-474b-919d-299000589f2e tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:42.992907 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b1b00058-75c7-47db-8da1-415c0ae0f911 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:43.419052 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b1b00058-75c7-47db-8da1-415c0ae0f911 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:43.434530 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b1b00058-75c7-47db-8da1-415c0ae0f911 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667" status: 200 len: 1314 microversion: 2.1 time: 0.540759 Aug 07 01:25:43.435334 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1377/3054] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:42 2022] GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667 => generated 1314 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:43.791023 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4a6f5be3-a433-474b-919d-299000589f2e tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:43.803028 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4a6f5be3-a433-474b-919d-299000589f2e tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523" status: 200 len: 1307 microversion: 2.1 time: 0.898526 Aug 07 01:25:43.806153 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1678/3055] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:42 2022] GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523 => generated 1307 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:44.457985 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9be72e24-65fb-450c-9df8-761b53377a98 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:44.459270 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9be72e24-65fb-450c-9df8-761b53377a98 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6492010f-c0b5-4782-b58b-e46c498fe667] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:44.473157 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9be72e24-65fb-450c-9df8-761b53377a98 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:44.473949 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9be72e24-65fb-450c-9df8-761b53377a98 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:44.474889 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9be72e24-65fb-450c-9df8-761b53377a98 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:44.476625 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9be72e24-65fb-450c-9df8-761b53377a98 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:44.477309 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9be72e24-65fb-450c-9df8-761b53377a98 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:44.477962 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9be72e24-65fb-450c-9df8-761b53377a98 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:44.937909 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9b6cfd48-4ff8-419a-b4c0-63e6039d97de tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-291323392", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "92c1cca3-c0ca-419b-99e6-b5c0409e2e09"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:25:45.000805 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9be72e24-65fb-450c-9df8-761b53377a98 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:45.021922 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9be72e24-65fb-450c-9df8-761b53377a98 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667" status: 200 len: 1314 microversion: 2.1 time: 0.567889 Aug 07 01:25:45.037160 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1378/3056] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:44 2022] GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667 => generated 1314 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:45.046867 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e0e724ac-86f9-4d45-a660-22b5f7af9f67 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:45.050163 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e0e724ac-86f9-4d45-a660-22b5f7af9f67 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: 77f80d2b-d1d8-4ea9-9637-f43100b95523] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:45.067556 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e0e724ac-86f9-4d45-a660-22b5f7af9f67 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:45.069659 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e0e724ac-86f9-4d45-a660-22b5f7af9f67 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:45.071195 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e0e724ac-86f9-4d45-a660-22b5f7af9f67 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:45.072610 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e0e724ac-86f9-4d45-a660-22b5f7af9f67 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:45.074329 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e0e724ac-86f9-4d45-a660-22b5f7af9f67 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:45.075671 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e0e724ac-86f9-4d45-a660-22b5f7af9f67 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:45.350187 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e0e724ac-86f9-4d45-a660-22b5f7af9f67 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:45.364660 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e0e724ac-86f9-4d45-a660-22b5f7af9f67 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523" status: 200 len: 1307 microversion: 2.1 time: 0.324044 Aug 07 01:25:45.367312 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1379/3057] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:45 2022] GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523 => generated 1307 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:45.429577 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-9b6cfd48-4ff8-419a-b4c0-63e6039d97de tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] validate_networks() for [('92c1cca3-c0ca-419b-99e6-b5c0409e2e09', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:25:46.048755 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cc79ade3-d7e3-4296-81da-49245ddd8ee2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:46.050013 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-cc79ade3-d7e3-4296-81da-49245ddd8ee2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6492010f-c0b5-4782-b58b-e46c498fe667] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:46.065685 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc79ade3-d7e3-4296-81da-49245ddd8ee2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:46.066449 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc79ade3-d7e3-4296-81da-49245ddd8ee2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:46.067108 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc79ade3-d7e3-4296-81da-49245ddd8ee2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:46.068054 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc79ade3-d7e3-4296-81da-49245ddd8ee2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:46.069587 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc79ade3-d7e3-4296-81da-49245ddd8ee2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:46.071497 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc79ade3-d7e3-4296-81da-49245ddd8ee2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:46.557011 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-9b6cfd48-4ff8-419a-b4c0-63e6039d97de tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:25:46.557544 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-9b6cfd48-4ff8-419a-b4c0-63e6039d97de tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:25:46.557902 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-9b6cfd48-4ff8-419a-b4c0-63e6039d97de tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:25:46.558316 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-9b6cfd48-4ff8-419a-b4c0-63e6039d97de tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:25:46.558735 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-9b6cfd48-4ff8-419a-b4c0-63e6039d97de tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:25:46.573059 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b6cfd48-4ff8-419a-b4c0-63e6039d97de tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:46.573557 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b6cfd48-4ff8-419a-b4c0-63e6039d97de tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:46.574004 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b6cfd48-4ff8-419a-b4c0-63e6039d97de tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:46.574747 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b6cfd48-4ff8-419a-b4c0-63e6039d97de tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:46.575202 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b6cfd48-4ff8-419a-b4c0-63e6039d97de tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:46.575635 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b6cfd48-4ff8-419a-b4c0-63e6039d97de tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:46.663511 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-9b6cfd48-4ff8-419a-b4c0-63e6039d97de tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Getting quotas for project 6826f9d4a91245a3982795ce6022141f. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:25:46.670387 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-9b6cfd48-4ff8-419a-b4c0-63e6039d97de tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Getting quotas for user 2a43de829b91441797cabd51581ad38a and project 6826f9d4a91245a3982795ce6022141f. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:25:46.683736 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-cc79ade3-d7e3-4296-81da-49245ddd8ee2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:46.703046 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cc79ade3-d7e3-4296-81da-49245ddd8ee2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667" status: 200 len: 1314 microversion: 2.1 time: 0.658040 Aug 07 01:25:46.718244 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1380/3058] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:46 2022] GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667 => generated 1314 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:25:46.724526 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4d23e487-d302-4c5b-b8be-d950b2beb79c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:46.725401 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4d23e487-d302-4c5b-b8be-d950b2beb79c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: 77f80d2b-d1d8-4ea9-9637-f43100b95523] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:46.731726 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9b6cfd48-4ff8-419a-b4c0-63e6039d97de tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:25:46.734104 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9b6cfd48-4ff8-419a-b4c0-63e6039d97de tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] [instance: b2ab22b8-b388-447e-85ab-7a4b6d4a466f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:25:46.740193 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d23e487-d302-4c5b-b8be-d950b2beb79c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:46.740697 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d23e487-d302-4c5b-b8be-d950b2beb79c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:46.741144 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d23e487-d302-4c5b-b8be-d950b2beb79c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:46.748543 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d23e487-d302-4c5b-b8be-d950b2beb79c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:46.749069 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d23e487-d302-4c5b-b8be-d950b2beb79c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:46.753049 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d23e487-d302-4c5b-b8be-d950b2beb79c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:46.856263 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9b6cfd48-4ff8-419a-b4c0-63e6039d97de tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.039107 Aug 07 01:25:46.869750 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1679/3059] 10.222.0.39 () {62 vars in 1188 bytes} [Sun Aug 7 01:25:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2043 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 07 01:25:46.876178 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-230bd128-5dc2-4758-97b4-5d4b21e1f546 req-9f70f9a2-eaa2-4c0f-8b75-1ad82ce3a628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f80d2b-d1d8-4ea9-9637-f43100b95523", "name": "network-vif-plugged", "status": "completed", "tag": "f7686f09-aeaf-4946-ba71-0a2620fdc9ba"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:25:46.893300 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-230bd128-5dc2-4758-97b4-5d4b21e1f546 req-9f70f9a2-eaa2-4c0f-8b75-1ad82ce3a628 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:46.893965 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-230bd128-5dc2-4758-97b4-5d4b21e1f546 req-9f70f9a2-eaa2-4c0f-8b75-1ad82ce3a628 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:46.896935 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-230bd128-5dc2-4758-97b4-5d4b21e1f546 req-9f70f9a2-eaa2-4c0f-8b75-1ad82ce3a628 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:46.928529 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-230bd128-5dc2-4758-97b4-5d4b21e1f546 req-9f70f9a2-eaa2-4c0f-8b75-1ad82ce3a628 service nova] Creating event network-vif-plugged:f7686f09-aeaf-4946-ba71-0a2620fdc9ba for instance 77f80d2b-d1d8-4ea9-9637-f43100b95523 on n-h1-master-1 Aug 07 01:25:46.952781 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-230bd128-5dc2-4758-97b4-5d4b21e1f546 req-9f70f9a2-eaa2-4c0f-8b75-1ad82ce3a628 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076534 Aug 07 01:25:46.956720 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1680/3060] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:25:46.975622 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-74960f15-ee08-48b5-8e15-7c7f7282b49b tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:46.981981 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-74960f15-ee08-48b5-8e15-7c7f7282b49b tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] [instance: b2ab22b8-b388-447e-85ab-7a4b6d4a466f] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:47.178659 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-74960f15-ee08-48b5-8e15-7c7f7282b49b tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:47.195440 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-74960f15-ee08-48b5-8e15-7c7f7282b49b tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:47.197648 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-74960f15-ee08-48b5-8e15-7c7f7282b49b tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:47.216819 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-74960f15-ee08-48b5-8e15-7c7f7282b49b tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] 10.222.0.39 "GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f" status: 200 len: 1261 microversion: 2.26 time: 0.248476 Aug 07 01:25:47.217472 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1681/3061] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:46 2022] GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f => generated 1261 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:25:47.423872 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4d23e487-d302-4c5b-b8be-d950b2beb79c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:47.438172 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4d23e487-d302-4c5b-b8be-d950b2beb79c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523" status: 200 len: 1307 microversion: 2.1 time: 0.718475 Aug 07 01:25:47.439996 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1381/3062] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:46 2022] GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523 => generated 1307 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:47.726148 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-43eb2f22-a68f-444a-8542-7fbd663309de tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:47.726806 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-43eb2f22-a68f-444a-8542-7fbd663309de tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6492010f-c0b5-4782-b58b-e46c498fe667] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:47.735365 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43eb2f22-a68f-444a-8542-7fbd663309de tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:47.735866 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43eb2f22-a68f-444a-8542-7fbd663309de tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:47.736386 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43eb2f22-a68f-444a-8542-7fbd663309de tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:47.744708 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43eb2f22-a68f-444a-8542-7fbd663309de tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:47.745229 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43eb2f22-a68f-444a-8542-7fbd663309de tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:47.745689 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43eb2f22-a68f-444a-8542-7fbd663309de tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:48.249723 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-25693e95-ecab-46f2-a5db-69011c2f18c0 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:48.250631 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-25693e95-ecab-46f2-a5db-69011c2f18c0 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] [instance: b2ab22b8-b388-447e-85ab-7a4b6d4a466f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:48.301729 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-43eb2f22-a68f-444a-8542-7fbd663309de tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:48.302848 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-25693e95-ecab-46f2-a5db-69011c2f18c0 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:48.303534 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-25693e95-ecab-46f2-a5db-69011c2f18c0 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:48.304019 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-25693e95-ecab-46f2-a5db-69011c2f18c0 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:48.310781 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-25693e95-ecab-46f2-a5db-69011c2f18c0 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:48.317809 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-25693e95-ecab-46f2-a5db-69011c2f18c0 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:48.318328 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-25693e95-ecab-46f2-a5db-69011c2f18c0 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:48.318827 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-43eb2f22-a68f-444a-8542-7fbd663309de tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667" status: 200 len: 1314 microversion: 2.1 time: 0.597942 Aug 07 01:25:48.332589 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1682/3063] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:47 2022] GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667 => generated 1314 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:48.466807 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7e696dc4-83b1-456d-8cb0-9a1db5a1bf92 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:48.467460 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7e696dc4-83b1-456d-8cb0-9a1db5a1bf92 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: 77f80d2b-d1d8-4ea9-9637-f43100b95523] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:48.481880 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e696dc4-83b1-456d-8cb0-9a1db5a1bf92 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:48.498129 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e696dc4-83b1-456d-8cb0-9a1db5a1bf92 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:48.499356 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e696dc4-83b1-456d-8cb0-9a1db5a1bf92 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:48.500302 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e696dc4-83b1-456d-8cb0-9a1db5a1bf92 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:48.500707 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e696dc4-83b1-456d-8cb0-9a1db5a1bf92 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:48.502954 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e696dc4-83b1-456d-8cb0-9a1db5a1bf92 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:48.840715 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-25693e95-ecab-46f2-a5db-69011c2f18c0 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:48.858444 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-25693e95-ecab-46f2-a5db-69011c2f18c0 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:48.874625 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-25693e95-ecab-46f2-a5db-69011c2f18c0 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:48.880619 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-25693e95-ecab-46f2-a5db-69011c2f18c0 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] 10.222.0.39 "GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f" status: 200 len: 1313 microversion: 2.26 time: 0.636471 Aug 07 01:25:48.885348 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1382/3064] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:48 2022] GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f => generated 1313 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:25:49.009572 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7e696dc4-83b1-456d-8cb0-9a1db5a1bf92 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:49.020413 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7e696dc4-83b1-456d-8cb0-9a1db5a1bf92 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523" status: 200 len: 1307 microversion: 2.1 time: 0.558296 Aug 07 01:25:49.022997 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1683/3065] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:48 2022] GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523 => generated 1307 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:49.345132 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e3e7033f-1cf8-4e34-8e97-f5927f02cbcc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:49.345762 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e3e7033f-1cf8-4e34-8e97-f5927f02cbcc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6492010f-c0b5-4782-b58b-e46c498fe667] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:49.376151 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3e7033f-1cf8-4e34-8e97-f5927f02cbcc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:49.383825 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3e7033f-1cf8-4e34-8e97-f5927f02cbcc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:49.386475 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3e7033f-1cf8-4e34-8e97-f5927f02cbcc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:49.387244 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3e7033f-1cf8-4e34-8e97-f5927f02cbcc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:49.387716 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3e7033f-1cf8-4e34-8e97-f5927f02cbcc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:49.395622 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3e7033f-1cf8-4e34-8e97-f5927f02cbcc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:49.909748 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a775deb8-b3ec-4483-b742-713f7be71ac7 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:49.911121 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a775deb8-b3ec-4483-b742-713f7be71ac7 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] [instance: b2ab22b8-b388-447e-85ab-7a4b6d4a466f] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:49.934537 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a775deb8-b3ec-4483-b742-713f7be71ac7 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:49.944645 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a775deb8-b3ec-4483-b742-713f7be71ac7 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:49.945283 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a775deb8-b3ec-4483-b742-713f7be71ac7 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:49.946188 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a775deb8-b3ec-4483-b742-713f7be71ac7 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:49.948156 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a775deb8-b3ec-4483-b742-713f7be71ac7 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:49.948782 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a775deb8-b3ec-4483-b742-713f7be71ac7 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:50.358609 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a775deb8-b3ec-4483-b742-713f7be71ac7 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:50.380553 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a775deb8-b3ec-4483-b742-713f7be71ac7 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:50.384134 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a775deb8-b3ec-4483-b742-713f7be71ac7 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:50.388656 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a775deb8-b3ec-4483-b742-713f7be71ac7 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] 10.222.0.39 "GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f" status: 200 len: 1319 microversion: 2.26 time: 0.483870 Aug 07 01:25:50.403628 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1684/3066] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:49 2022] GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f => generated 1319 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:25:50.439582 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-de4cdf6c-ef3c-4ecd-92c0-66efb288b5f0 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:50.444960 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-de4cdf6c-ef3c-4ecd-92c0-66efb288b5f0 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: 77f80d2b-d1d8-4ea9-9637-f43100b95523] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:50.468500 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-de4cdf6c-ef3c-4ecd-92c0-66efb288b5f0 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:50.471375 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-de4cdf6c-ef3c-4ecd-92c0-66efb288b5f0 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:50.472093 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-de4cdf6c-ef3c-4ecd-92c0-66efb288b5f0 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:50.474968 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-de4cdf6c-ef3c-4ecd-92c0-66efb288b5f0 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:50.480122 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-de4cdf6c-ef3c-4ecd-92c0-66efb288b5f0 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:50.482961 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-de4cdf6c-ef3c-4ecd-92c0-66efb288b5f0 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:50.858402 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-de4cdf6c-ef3c-4ecd-92c0-66efb288b5f0 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:50.898320 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-de4cdf6c-ef3c-4ecd-92c0-66efb288b5f0 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523" status: 200 len: 1486 microversion: 2.1 time: 0.481377 Aug 07 01:25:50.900885 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1685/3067] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:50 2022] GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523 => generated 1486 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:50.921541 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-8c7ca931-7578-43a5-88e4-e41dde6fee18 req-9726ef8a-68f2-4737-9cec-379c11ed7ca0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6492010f-c0b5-4782-b58b-e46c498fe667", "name": "network-vif-plugged", "status": "completed", "tag": "161c3dc4-2a0d-40f4-8f0b-0ea0776b55a5"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:25:50.951470 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-8c7ca931-7578-43a5-88e4-e41dde6fee18 req-9726ef8a-68f2-4737-9cec-379c11ed7ca0 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:50.952047 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-8c7ca931-7578-43a5-88e4-e41dde6fee18 req-9726ef8a-68f2-4737-9cec-379c11ed7ca0 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:50.952493 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-8c7ca931-7578-43a5-88e4-e41dde6fee18 req-9726ef8a-68f2-4737-9cec-379c11ed7ca0 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:50.985592 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-8c7ca931-7578-43a5-88e4-e41dde6fee18 req-9726ef8a-68f2-4737-9cec-379c11ed7ca0 service nova] Creating event network-vif-plugged:161c3dc4-2a0d-40f4-8f0b-0ea0776b55a5 for instance 6492010f-c0b5-4782-b58b-e46c498fe667 on n-h1-master-1 Aug 07 01:25:51.002653 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-8c7ca931-7578-43a5-88e4-e41dde6fee18 req-9726ef8a-68f2-4737-9cec-379c11ed7ca0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100399 Aug 07 01:25:51.003277 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1686/3068] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:25:51.009314 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b16e63a9-64f2-4fd3-8130-5654ed94740d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:25:51.009974 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b16e63a9-64f2-4fd3-8130-5654ed94740d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: 77f80d2b-d1d8-4ea9-9637-f43100b95523] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:51.023821 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e3e7033f-1cf8-4e34-8e97-f5927f02cbcc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:51.035945 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b16e63a9-64f2-4fd3-8130-5654ed94740d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:51.048185 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b16e63a9-64f2-4fd3-8130-5654ed94740d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:51.048821 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b16e63a9-64f2-4fd3-8130-5654ed94740d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:51.049608 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b16e63a9-64f2-4fd3-8130-5654ed94740d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:51.050217 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b16e63a9-64f2-4fd3-8130-5654ed94740d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:51.050522 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b16e63a9-64f2-4fd3-8130-5654ed94740d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:51.056699 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e3e7033f-1cf8-4e34-8e97-f5927f02cbcc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667" status: 200 len: 1314 microversion: 2.1 time: 1.709482 Aug 07 01:25:51.061941 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1383/3069] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:49 2022] GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667 => generated 1314 bytes in 1724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:51.325501 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b16e63a9-64f2-4fd3-8130-5654ed94740d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "POST /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523/action" status: 202 len: 0 microversion: 2.1 time: 0.308021 Aug 07 01:25:51.327739 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1687/3070] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:25:51 2022] POST /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:25:51.337560 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-90a047f4-ca37-4933-914b-680d9f70a6fb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:51.338185 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-90a047f4-ca37-4933-914b-680d9f70a6fb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: 77f80d2b-d1d8-4ea9-9637-f43100b95523] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:51.356924 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90a047f4-ca37-4933-914b-680d9f70a6fb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:51.358495 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90a047f4-ca37-4933-914b-680d9f70a6fb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:51.358954 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90a047f4-ca37-4933-914b-680d9f70a6fb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:51.359706 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90a047f4-ca37-4933-914b-680d9f70a6fb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:51.360194 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90a047f4-ca37-4933-914b-680d9f70a6fb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:51.369921 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90a047f4-ca37-4933-914b-680d9f70a6fb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:51.418049 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-775a08dd-ff4c-42ee-bbe6-fe0383620b59 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:51.419397 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-775a08dd-ff4c-42ee-bbe6-fe0383620b59 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] [instance: b2ab22b8-b388-447e-85ab-7a4b6d4a466f] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:51.440851 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-775a08dd-ff4c-42ee-bbe6-fe0383620b59 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:51.442168 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-775a08dd-ff4c-42ee-bbe6-fe0383620b59 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:51.445111 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-775a08dd-ff4c-42ee-bbe6-fe0383620b59 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:51.451026 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-775a08dd-ff4c-42ee-bbe6-fe0383620b59 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:51.492057 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-775a08dd-ff4c-42ee-bbe6-fe0383620b59 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:51.593257 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-775a08dd-ff4c-42ee-bbe6-fe0383620b59 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.040s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:52.067215 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-775a08dd-ff4c-42ee-bbe6-fe0383620b59 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:52.089898 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-775a08dd-ff4c-42ee-bbe6-fe0383620b59 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:52.103773 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-775a08dd-ff4c-42ee-bbe6-fe0383620b59 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:52.112887 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-775a08dd-ff4c-42ee-bbe6-fe0383620b59 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] 10.222.0.39 "GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f" status: 200 len: 1319 microversion: 2.26 time: 0.698991 Aug 07 01:25:52.122136 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1688/3071] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:51 2022] GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f => generated 1319 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:25:52.144394 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6205d4b8-d156-4dd1-a591-55356686d5fa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:52.145206 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6205d4b8-d156-4dd1-a591-55356686d5fa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6492010f-c0b5-4782-b58b-e46c498fe667] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:52.164920 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6205d4b8-d156-4dd1-a591-55356686d5fa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:52.165436 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6205d4b8-d156-4dd1-a591-55356686d5fa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:52.167941 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6205d4b8-d156-4dd1-a591-55356686d5fa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:52.170908 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6205d4b8-d156-4dd1-a591-55356686d5fa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:52.178212 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6205d4b8-d156-4dd1-a591-55356686d5fa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:52.181623 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6205d4b8-d156-4dd1-a591-55356686d5fa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:53.201217 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-90a047f4-ca37-4933-914b-680d9f70a6fb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:53.214117 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-90a047f4-ca37-4933-914b-680d9f70a6fb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523" status: 200 len: 1491 microversion: 2.1 time: 1.882746 Aug 07 01:25:53.221098 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1384/3072] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:51 2022] GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523 => generated 1491 bytes in 1890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:53.252769 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-295c7a89-a6fe-4a10-8e01-c883edd23dd8 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:53.259908 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-295c7a89-a6fe-4a10-8e01-c883edd23dd8 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] [instance: b2ab22b8-b388-447e-85ab-7a4b6d4a466f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:53.286175 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-295c7a89-a6fe-4a10-8e01-c883edd23dd8 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:53.286682 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-295c7a89-a6fe-4a10-8e01-c883edd23dd8 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:53.287127 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-295c7a89-a6fe-4a10-8e01-c883edd23dd8 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:53.287870 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-295c7a89-a6fe-4a10-8e01-c883edd23dd8 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:53.288343 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-295c7a89-a6fe-4a10-8e01-c883edd23dd8 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:53.288947 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-295c7a89-a6fe-4a10-8e01-c883edd23dd8 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:53.595739 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6205d4b8-d156-4dd1-a591-55356686d5fa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:53.610495 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6205d4b8-d156-4dd1-a591-55356686d5fa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667" status: 200 len: 1314 microversion: 2.1 time: 1.482574 Aug 07 01:25:53.613292 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1689/3073] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:52 2022] GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667 => generated 1314 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:54.249790 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cb90f56c-dd94-4410-8e46-e8cf1d1827b6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:54.250857 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cb90f56c-dd94-4410-8e46-e8cf1d1827b6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: 77f80d2b-d1d8-4ea9-9637-f43100b95523] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:54.286703 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb90f56c-dd94-4410-8e46-e8cf1d1827b6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:54.292417 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb90f56c-dd94-4410-8e46-e8cf1d1827b6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:54.293231 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb90f56c-dd94-4410-8e46-e8cf1d1827b6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:54.299509 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb90f56c-dd94-4410-8e46-e8cf1d1827b6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:54.301985 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb90f56c-dd94-4410-8e46-e8cf1d1827b6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:54.302729 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb90f56c-dd94-4410-8e46-e8cf1d1827b6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:55.215024 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-295c7a89-a6fe-4a10-8e01-c883edd23dd8 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:55.243077 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-295c7a89-a6fe-4a10-8e01-c883edd23dd8 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:55.254666 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-295c7a89-a6fe-4a10-8e01-c883edd23dd8 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:55.262796 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-295c7a89-a6fe-4a10-8e01-c883edd23dd8 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] 10.222.0.39 "GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f" status: 200 len: 1361 microversion: 2.26 time: 2.040251 Aug 07 01:25:55.264834 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1385/3074] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:53 2022] GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f => generated 1361 bytes in 2043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:25:55.281227 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-90d6e577-9f94-469a-873b-15772d4e6ce3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:55.282167 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-90d6e577-9f94-469a-873b-15772d4e6ce3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6492010f-c0b5-4782-b58b-e46c498fe667] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:55.318623 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90d6e577-9f94-469a-873b-15772d4e6ce3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:55.319627 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90d6e577-9f94-469a-873b-15772d4e6ce3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:55.320433 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90d6e577-9f94-469a-873b-15772d4e6ce3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:55.322666 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90d6e577-9f94-469a-873b-15772d4e6ce3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:55.323469 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90d6e577-9f94-469a-873b-15772d4e6ce3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:55.324224 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90d6e577-9f94-469a-873b-15772d4e6ce3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:55.600481 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-90d6e577-9f94-469a-873b-15772d4e6ce3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:55.613901 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-90d6e577-9f94-469a-873b-15772d4e6ce3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667" status: 200 len: 1502 microversion: 2.1 time: 0.347098 Aug 07 01:25:55.618951 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1386/3075] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:55 2022] GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667 => generated 1502 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:55.642338 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-acbe9729-7957-4e0d-b0fc-50a86223b7b5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:55.645450 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-acbe9729-7957-4e0d-b0fc-50a86223b7b5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6492010f-c0b5-4782-b58b-e46c498fe667] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:55.665012 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-acbe9729-7957-4e0d-b0fc-50a86223b7b5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:55.667681 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-acbe9729-7957-4e0d-b0fc-50a86223b7b5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:55.670619 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-acbe9729-7957-4e0d-b0fc-50a86223b7b5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:55.674350 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-acbe9729-7957-4e0d-b0fc-50a86223b7b5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:55.676200 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-acbe9729-7957-4e0d-b0fc-50a86223b7b5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:55.678795 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-acbe9729-7957-4e0d-b0fc-50a86223b7b5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:55.687633 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cb90f56c-dd94-4410-8e46-e8cf1d1827b6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:55.696165 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cb90f56c-dd94-4410-8e46-e8cf1d1827b6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523" status: 200 len: 1471 microversion: 2.1 time: 1.451400 Aug 07 01:25:55.703824 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1690/3076] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:54 2022] GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523 => generated 1471 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:55.731287 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1dabff80-2e13-462e-b976-7e5645287621 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-714453611"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:25:55.742823 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1dabff80-2e13-462e-b976-7e5645287621 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: 77f80d2b-d1d8-4ea9-9637-f43100b95523] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:55.775104 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1dabff80-2e13-462e-b976-7e5645287621 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:55.776602 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1dabff80-2e13-462e-b976-7e5645287621 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:55.780161 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1dabff80-2e13-462e-b976-7e5645287621 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:55.781319 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1dabff80-2e13-462e-b976-7e5645287621 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:55.787547 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1dabff80-2e13-462e-b976-7e5645287621 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:55.791298 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1dabff80-2e13-462e-b976-7e5645287621 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:55.800485 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-acbe9729-7957-4e0d-b0fc-50a86223b7b5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6492010f-c0b5-4782-b58b-e46c498fe667] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:25:56.082791 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-acbe9729-7957-4e0d-b0fc-50a86223b7b5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667" status: 204 len: 0 microversion: 2.1 time: 0.438403 Aug 07 01:25:56.083469 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1387/3077] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:25:55 2022] DELETE /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:25:56.117324 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6ce58ea9-bbe1-415b-9bf1-dc70061cc4ed tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:56.118082 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6ce58ea9-bbe1-415b-9bf1-dc70061cc4ed tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6492010f-c0b5-4782-b58b-e46c498fe667] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:56.151970 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ce58ea9-bbe1-415b-9bf1-dc70061cc4ed tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:56.152476 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ce58ea9-bbe1-415b-9bf1-dc70061cc4ed tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:56.154633 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ce58ea9-bbe1-415b-9bf1-dc70061cc4ed tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:56.155402 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ce58ea9-bbe1-415b-9bf1-dc70061cc4ed tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:56.162436 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ce58ea9-bbe1-415b-9bf1-dc70061cc4ed tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:56.165480 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ce58ea9-bbe1-415b-9bf1-dc70061cc4ed tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:56.627358 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:56.801224 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6ce58ea9-bbe1-415b-9bf1-dc70061cc4ed tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:56.812662 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6ce58ea9-bbe1-415b-9bf1-dc70061cc4ed tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667" status: 200 len: 1508 microversion: 2.1 time: 0.721762 Aug 07 01:25:56.814686 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1388/3078] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:56 2022] GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667 => generated 1508 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:56.828413 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-200241ec-1168-4506-95c6-f154f772c983 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:56.830027 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-200241ec-1168-4506-95c6-f154f772c983 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] [instance: b2ab22b8-b388-447e-85ab-7a4b6d4a466f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:56.853797 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-200241ec-1168-4506-95c6-f154f772c983 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:56.854612 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-200241ec-1168-4506-95c6-f154f772c983 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:56.863968 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-200241ec-1168-4506-95c6-f154f772c983 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:56.865033 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-200241ec-1168-4506-95c6-f154f772c983 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:56.865684 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-200241ec-1168-4506-95c6-f154f772c983 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:56.872254 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-200241ec-1168-4506-95c6-f154f772c983 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:57.209932 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=8 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:57.362052 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-200241ec-1168-4506-95c6-f154f772c983 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:57.380460 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-200241ec-1168-4506-95c6-f154f772c983 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:57.384223 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-200241ec-1168-4506-95c6-f154f772c983 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:57.387055 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-200241ec-1168-4506-95c6-f154f772c983 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] 10.222.0.39 "GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f" status: 200 len: 1361 microversion: 2.26 time: 0.569504 Aug 07 01:25:57.391234 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1389/3079] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:56 2022] GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f => generated 1361 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:25:57.409519 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-4a7c50a5-fd80-4f06-bc84-7724a62b9e28 req-c29ddaa7-c8af-46cb-ad8c-43821fb4bb7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2ab22b8-b388-447e-85ab-7a4b6d4a466f", "tag": "c47e3688-e367-4a1e-b221-a82250dd507e"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:25:57.435785 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-4a7c50a5-fd80-4f06-bc84-7724a62b9e28 req-c29ddaa7-c8af-46cb-ad8c-43821fb4bb7c service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:57.443172 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-4a7c50a5-fd80-4f06-bc84-7724a62b9e28 req-c29ddaa7-c8af-46cb-ad8c-43821fb4bb7c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:57.443812 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-4a7c50a5-fd80-4f06-bc84-7724a62b9e28 req-c29ddaa7-c8af-46cb-ad8c-43821fb4bb7c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:57.466720 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1dabff80-2e13-462e-b976-7e5645287621 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "POST /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523/action" status: 202 len: 0 microversion: 2.1 time: 1.742876 Aug 07 01:25:57.469572 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-4a7c50a5-fd80-4f06-bc84-7724a62b9e28 req-c29ddaa7-c8af-46cb-ad8c-43821fb4bb7c service nova] Creating event network-changed:c47e3688-e367-4a1e-b221-a82250dd507e for instance b2ab22b8-b388-447e-85ab-7a4b6d4a466f on n-h2-master-1 Aug 07 01:25:57.473069 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1691/3080] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:25:55 2022] POST /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523/action => generated 0 bytes in 1750 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 07 01:25:57.481354 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-4a7c50a5-fd80-4f06-bc84-7724a62b9e28 req-c29ddaa7-c8af-46cb-ad8c-43821fb4bb7c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087271 Aug 07 01:25:57.483943 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1390/3081] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:25:57.509329 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9e5fe0fe-3545-4ba2-83cc-c4580bd57e25 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e25259f70>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:57.839593 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-aa38130e-0abb-473e-bbd4-3c45f62a4f84 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:57.843320 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-aa38130e-0abb-473e-bbd4-3c45f62a4f84 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6492010f-c0b5-4782-b58b-e46c498fe667] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:57.871699 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa38130e-0abb-473e-bbd4-3c45f62a4f84 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:57.873899 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa38130e-0abb-473e-bbd4-3c45f62a4f84 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:57.877087 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa38130e-0abb-473e-bbd4-3c45f62a4f84 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:57.882214 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa38130e-0abb-473e-bbd4-3c45f62a4f84 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:57.885357 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa38130e-0abb-473e-bbd4-3c45f62a4f84 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:57.885357 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa38130e-0abb-473e-bbd4-3c45f62a4f84 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:58.156375 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9e5fe0fe-3545-4ba2-83cc-c4580bd57e25 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/63e76497-a620-45de-87be-0d947bdbb9a7" status: 200 len: 1413 microversion: 2.1 time: 0.665258 Aug 07 01:25:58.157210 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1692/3082] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:25:57 2022] GET /compute/v2.1/images/63e76497-a620-45de-87be-0d947bdbb9a7 => generated 1413 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:58.427527 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6e1c3d23-d181-4980-abae-6834b2a14684 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:58.428601 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6e1c3d23-d181-4980-abae-6834b2a14684 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] [instance: b2ab22b8-b388-447e-85ab-7a4b6d4a466f] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:58.455110 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e1c3d23-d181-4980-abae-6834b2a14684 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:58.455682 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e1c3d23-d181-4980-abae-6834b2a14684 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:58.456330 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e1c3d23-d181-4980-abae-6834b2a14684 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:58.457120 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e1c3d23-d181-4980-abae-6834b2a14684 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:58.457757 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e1c3d23-d181-4980-abae-6834b2a14684 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:58.459639 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e1c3d23-d181-4980-abae-6834b2a14684 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:58.555579 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-aa38130e-0abb-473e-bbd4-3c45f62a4f84 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:58.559014 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:58.579600 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-aa38130e-0abb-473e-bbd4-3c45f62a4f84 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667" status: 200 len: 1508 microversion: 2.1 time: 0.746404 Aug 07 01:25:58.586638 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1391/3083] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:57 2022] GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667 => generated 1508 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:25:58.865659 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6e1c3d23-d181-4980-abae-6834b2a14684 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:58.887189 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6e1c3d23-d181-4980-abae-6834b2a14684 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:58.893976 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6e1c3d23-d181-4980-abae-6834b2a14684 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:25:58.896822 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6e1c3d23-d181-4980-abae-6834b2a14684 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] 10.222.0.39 "GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f" status: 200 len: 1361 microversion: 2.26 time: 0.474745 Aug 07 01:25:58.916032 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1693/3084] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:58 2022] GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f => generated 1361 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:25:59.174962 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-80cc0dbc-104a-4b69-9dbd-d8fef7788ccb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e29937f70>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:59.282056 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-80cc0dbc-104a-4b69-9dbd-d8fef7788ccb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/63e76497-a620-45de-87be-0d947bdbb9a7" status: 200 len: 1413 microversion: 2.1 time: 0.113590 Aug 07 01:25:59.282988 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1392/3085] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:25:59 2022] GET /compute/v2.1/images/63e76497-a620-45de-87be-0d947bdbb9a7 => generated 1413 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:25:59.640597 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c425fe47-e96b-479f-9f5e-d1aab3f5c702 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:25:59.650713 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c425fe47-e96b-479f-9f5e-d1aab3f5c702 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6492010f-c0b5-4782-b58b-e46c498fe667] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:25:59.695712 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c425fe47-e96b-479f-9f5e-d1aab3f5c702 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:59.698469 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c425fe47-e96b-479f-9f5e-d1aab3f5c702 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:59.699637 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c425fe47-e96b-479f-9f5e-d1aab3f5c702 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:59.700823 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c425fe47-e96b-479f-9f5e-d1aab3f5c702 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:25:59.702047 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c425fe47-e96b-479f-9f5e-d1aab3f5c702 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:25:59.703783 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c425fe47-e96b-479f-9f5e-d1aab3f5c702 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:25:59.995139 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-56d68d97-a097-4771-ada1-c5d8716ba1ac tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:00.023321 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-56d68d97-a097-4771-ada1-c5d8716ba1ac tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] [instance: b2ab22b8-b388-447e-85ab-7a4b6d4a466f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:00.074377 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-56d68d97-a097-4771-ada1-c5d8716ba1ac tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:00.078534 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-56d68d97-a097-4771-ada1-c5d8716ba1ac tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:00.091086 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-56d68d97-a097-4771-ada1-c5d8716ba1ac tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:00.092051 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-56d68d97-a097-4771-ada1-c5d8716ba1ac tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:00.092560 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-56d68d97-a097-4771-ada1-c5d8716ba1ac tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:00.093016 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-56d68d97-a097-4771-ada1-c5d8716ba1ac tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:00.234101 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c425fe47-e96b-479f-9f5e-d1aab3f5c702 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:00.256343 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c425fe47-e96b-479f-9f5e-d1aab3f5c702 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667" status: 200 len: 1466 microversion: 2.1 time: 0.649271 Aug 07 01:26:00.257983 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1694/3086] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:25:59 2022] GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667 => generated 1466 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:00.265252 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-22480734-2b11-4176-9f14-4af58611f099 req-16ba2104-2c87-46fe-96eb-31f0969f44ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6492010f-c0b5-4782-b58b-e46c498fe667", "name": "network-vif-deleted", "tag": "161c3dc4-2a0d-40f4-8f0b-0ea0776b55a5"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:00.320444 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-22480734-2b11-4176-9f14-4af58611f099 req-16ba2104-2c87-46fe-96eb-31f0969f44ef service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:00.320918 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-22480734-2b11-4176-9f14-4af58611f099 req-16ba2104-2c87-46fe-96eb-31f0969f44ef service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:00.321593 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-22480734-2b11-4176-9f14-4af58611f099 req-16ba2104-2c87-46fe-96eb-31f0969f44ef service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:00.352987 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-22480734-2b11-4176-9f14-4af58611f099 req-16ba2104-2c87-46fe-96eb-31f0969f44ef service nova] Creating event network-vif-deleted:161c3dc4-2a0d-40f4-8f0b-0ea0776b55a5 for instance 6492010f-c0b5-4782-b58b-e46c498fe667 on n-h1-master-1 Aug 07 01:26:00.358812 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-22480734-2b11-4176-9f14-4af58611f099 req-16ba2104-2c87-46fe-96eb-31f0969f44ef service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098876 Aug 07 01:26:00.360050 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1695/3087] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:26:00.370526 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1d96ae33-0385-4894-bfd7-691d35a4e17b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e24743040>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:00.465964 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1d96ae33-0385-4894-bfd7-691d35a4e17b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/63e76497-a620-45de-87be-0d947bdbb9a7" status: 200 len: 1413 microversion: 2.1 time: 0.099896 Aug 07 01:26:00.473393 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1696/3088] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:26:00 2022] GET /compute/v2.1/images/63e76497-a620-45de-87be-0d947bdbb9a7 => generated 1413 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:00.488497 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d131a0b7-f0b5-4138-96cc-07bd2d92caf0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:00.488497 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d131a0b7-f0b5-4138-96cc-07bd2d92caf0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:00.522034 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d131a0b7-f0b5-4138-96cc-07bd2d92caf0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:00.522790 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d131a0b7-f0b5-4138-96cc-07bd2d92caf0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:00.523232 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d131a0b7-f0b5-4138-96cc-07bd2d92caf0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:00.523983 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d131a0b7-f0b5-4138-96cc-07bd2d92caf0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:00.524460 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d131a0b7-f0b5-4138-96cc-07bd2d92caf0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:00.524892 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d131a0b7-f0b5-4138-96cc-07bd2d92caf0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:00.840404 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-56d68d97-a097-4771-ada1-c5d8716ba1ac tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:00.857245 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-56d68d97-a097-4771-ada1-c5d8716ba1ac tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:00.858781 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-56d68d97-a097-4771-ada1-c5d8716ba1ac tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:00.859984 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-56d68d97-a097-4771-ada1-c5d8716ba1ac tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] 10.222.0.39 "GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f" status: 200 len: 1361 microversion: 2.26 time: 0.931102 Aug 07 01:26:00.876367 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1393/3089] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:25:59 2022] GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f => generated 1361 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:26:01.021463 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d131a0b7-f0b5-4138-96cc-07bd2d92caf0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:01.034197 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:01.052606 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d131a0b7-f0b5-4138-96cc-07bd2d92caf0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.577749 Aug 07 01:26:01.055177 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1697/3090] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:00 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:01.091625 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-39ba17ba-fb4a-4b7d-808b-3457bd64c489 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1266930348"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:01.094130 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-39ba17ba-fb4a-4b7d-808b-3457bd64c489 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:01.119538 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39ba17ba-fb4a-4b7d-808b-3457bd64c489 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:01.120075 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39ba17ba-fb4a-4b7d-808b-3457bd64c489 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:01.120519 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39ba17ba-fb4a-4b7d-808b-3457bd64c489 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:01.121238 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39ba17ba-fb4a-4b7d-808b-3457bd64c489 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:01.124122 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39ba17ba-fb4a-4b7d-808b-3457bd64c489 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:01.124567 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39ba17ba-fb4a-4b7d-808b-3457bd64c489 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:01.281350 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4f1d9b57-4d6d-4084-8fea-5bb9262dbbe6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:01.281971 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4f1d9b57-4d6d-4084-8fea-5bb9262dbbe6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6492010f-c0b5-4782-b58b-e46c498fe667] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:01.289762 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f1d9b57-4d6d-4084-8fea-5bb9262dbbe6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:01.290252 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f1d9b57-4d6d-4084-8fea-5bb9262dbbe6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:01.290688 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f1d9b57-4d6d-4084-8fea-5bb9262dbbe6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:01.291389 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f1d9b57-4d6d-4084-8fea-5bb9262dbbe6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:01.291842 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f1d9b57-4d6d-4084-8fea-5bb9262dbbe6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:01.308545 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f1d9b57-4d6d-4084-8fea-5bb9262dbbe6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:01.351474 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-4f1d9b57-4d6d-4084-8fea-5bb9262dbbe6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] HTTP exception thrown: Instance 6492010f-c0b5-4782-b58b-e46c498fe667 could not be found. Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4f1d9b57-4d6d-4084-8fea-5bb9262dbbe6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Request method failure captured: Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667 HTTP/1.1 Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xRoqM1ZK4H7GtvmxWX9ofAmOsKF2OdU6k1rehi-6yk86CpmfTNVcE0kwd9G1ahgJHyDlEB2bKz4XbnD5Ku_zcl240Q-kfWeKv3HfC_GyXmFAQWa4hNXP2nUgxgBXBe_oBb5a-t1xlRXFxfo9n87AmGbLBI9ZdV03LZwWshVd2n0WvE Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5506f7c95c1a46c5b3966597764b0111", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: d1f0c01c340940388b440932d51988ff Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 6492010f-c0b5-4782-b58b-e46c498fe667 could not be found. Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '6492010f-c0b5-4782-b58b-e46c498fe667'} Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6492010f-c0b5-4782-b58b-e46c498fe667 could not be found. Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6492010f-c0b5-4782-b58b-e46c498fe667 could not be found. Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:26:01.353565 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:26:01.358702 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:26:01.358702 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:26:01.358702 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:26:01.358702 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:26:01.358702 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:26:01.358702 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6492010f-c0b5-4782-b58b-e46c498fe667 could not be found. Aug 07 01:26:01.358702 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:26:01.360021 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4f1d9b57-4d6d-4084-8fea-5bb9262dbbe6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Returning 404 to user: Instance 6492010f-c0b5-4782-b58b-e46c498fe667 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:26:01.363768 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4f1d9b57-4d6d-4084-8fea-5bb9262dbbe6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667" status: 404 len: 111 microversion: 2.1 time: 0.086588 Aug 07 01:26:01.365274 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1698/3091] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:01 2022] GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:26:01.480795 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b511df1c-44c9-40a2-b4fc-d6ecf781ffc4 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e248e8940>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:01.627001 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b511df1c-44c9-40a2-b4fc-d6ecf781ffc4 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/63e76497-a620-45de-87be-0d947bdbb9a7" status: 200 len: 1413 microversion: 2.1 time: 0.149891 Aug 07 01:26:01.630918 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1699/3092] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:26:01 2022] GET /compute/v2.1/images/63e76497-a620-45de-87be-0d947bdbb9a7 => generated 1413 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:01.674753 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b81e358a-0bed-47bb-9b4a-100e56277cd0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-189313999", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "554905b9-fa00-4877-bc90-609c81108292"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:01.715207 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-39ba17ba-fb4a-4b7d-808b-3457bd64c489 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action" status: 202 len: 0 microversion: 2.1 time: 0.629466 Aug 07 01:26:01.728980 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1394/3093] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:26:01 2022] POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action => generated 0 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 07 01:26:01.743251 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a3431edb-e0d4-4392-b70d-e5fd87a8e7f6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:01.750502 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a3431edb-e0d4-4392-b70d-e5fd87a8e7f6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:01.761387 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3431edb-e0d4-4392-b70d-e5fd87a8e7f6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:01.771853 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3431edb-e0d4-4392-b70d-e5fd87a8e7f6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:01.773763 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3431edb-e0d4-4392-b70d-e5fd87a8e7f6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:01.776203 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3431edb-e0d4-4392-b70d-e5fd87a8e7f6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:01.777757 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3431edb-e0d4-4392-b70d-e5fd87a8e7f6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:01.779465 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3431edb-e0d4-4392-b70d-e5fd87a8e7f6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:01.832452 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-b81e358a-0bed-47bb-9b4a-100e56277cd0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] validate_networks() for [('554905b9-fa00-4877-bc90-609c81108292', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:26:02.651672 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-b81e358a-0bed-47bb-9b4a-100e56277cd0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:26:02.652373 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-b81e358a-0bed-47bb-9b4a-100e56277cd0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:26:02.653562 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-b81e358a-0bed-47bb-9b4a-100e56277cd0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:26:02.654353 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-b81e358a-0bed-47bb-9b4a-100e56277cd0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:26:02.654849 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-b81e358a-0bed-47bb-9b4a-100e56277cd0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:26:02.678097 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b81e358a-0bed-47bb-9b4a-100e56277cd0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:02.678876 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b81e358a-0bed-47bb-9b4a-100e56277cd0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:02.679810 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b81e358a-0bed-47bb-9b4a-100e56277cd0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:02.681741 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b81e358a-0bed-47bb-9b4a-100e56277cd0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:02.682419 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b81e358a-0bed-47bb-9b4a-100e56277cd0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:02.683129 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b81e358a-0bed-47bb-9b4a-100e56277cd0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:02.757824 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-b81e358a-0bed-47bb-9b4a-100e56277cd0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Getting quotas for project 5506f7c95c1a46c5b3966597764b0111. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:26:02.786256 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-b81e358a-0bed-47bb-9b4a-100e56277cd0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Getting quotas for user d1f0c01c340940388b440932d51988ff and project 5506f7c95c1a46c5b3966597764b0111. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:26:02.804979 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a3431edb-e0d4-4392-b70d-e5fd87a8e7f6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:02.815957 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a3431edb-e0d4-4392-b70d-e5fd87a8e7f6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1677 microversion: 2.1 time: 1.083376 Aug 07 01:26:02.816450 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1395/3094] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:01 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1677 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:02.827778 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b81e358a-0bed-47bb-9b4a-100e56277cd0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:26:02.836954 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b81e358a-0bed-47bb-9b4a-100e56277cd0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 2a78e835-73be-4ac9-bfd9-9b13009845ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:26:02.874553 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7ef76d16-fde8-4698-932c-6cc23cd66819 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:02.875261 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7ef76d16-fde8-4698-932c-6cc23cd66819 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] [instance: b2ab22b8-b388-447e-85ab-7a4b6d4a466f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:02.905769 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ef76d16-fde8-4698-932c-6cc23cd66819 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:02.906362 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ef76d16-fde8-4698-932c-6cc23cd66819 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:02.906819 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ef76d16-fde8-4698-932c-6cc23cd66819 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:02.907572 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ef76d16-fde8-4698-932c-6cc23cd66819 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:02.911094 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ef76d16-fde8-4698-932c-6cc23cd66819 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:02.911609 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ef76d16-fde8-4698-932c-6cc23cd66819 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:02.996465 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b81e358a-0bed-47bb-9b4a-100e56277cd0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.325388 Aug 07 01:26:03.005674 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1700/3095] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:26:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1336 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:26:03.021084 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b47c4b5c-68ed-4c15-b5bc-5b4aad724902 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e24919c10>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:03.132384 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b47c4b5c-68ed-4c15-b5bc-5b4aad724902 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/63e76497-a620-45de-87be-0d947bdbb9a7" status: 200 len: 1413 microversion: 2.1 time: 0.124970 Aug 07 01:26:03.139944 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1701/3096] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:26:03 2022] GET /compute/v2.1/images/63e76497-a620-45de-87be-0d947bdbb9a7 => generated 1413 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:03.147203 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-b57bbe95-d02e-470f-8758-e148fd2a236b req-756cf768-cd60-4047-a4eb-6c362b25c39c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f80d2b-d1d8-4ea9-9637-f43100b95523", "name": "network-vif-plugged", "status": "completed", "tag": "f7686f09-aeaf-4946-ba71-0a2620fdc9ba"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:03.205097 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b57bbe95-d02e-470f-8758-e148fd2a236b req-756cf768-cd60-4047-a4eb-6c362b25c39c service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:03.205624 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b57bbe95-d02e-470f-8758-e148fd2a236b req-756cf768-cd60-4047-a4eb-6c362b25c39c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:03.206100 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b57bbe95-d02e-470f-8758-e148fd2a236b req-756cf768-cd60-4047-a4eb-6c362b25c39c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:03.266035 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-b57bbe95-d02e-470f-8758-e148fd2a236b req-756cf768-cd60-4047-a4eb-6c362b25c39c service nova] Creating event network-vif-plugged:f7686f09-aeaf-4946-ba71-0a2620fdc9ba for instance 77f80d2b-d1d8-4ea9-9637-f43100b95523 on n-h1-master-1 Aug 07 01:26:03.302482 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-b57bbe95-d02e-470f-8758-e148fd2a236b req-756cf768-cd60-4047-a4eb-6c362b25c39c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164884 Aug 07 01:26:03.312654 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1702/3097] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:26:03.332901 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6c6a05c3-26dc-4012-86e6-695ad7988351 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:03.335547 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6c6a05c3-26dc-4012-86e6-695ad7988351 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 2a78e835-73be-4ac9-bfd9-9b13009845ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:03.482820 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6c6a05c3-26dc-4012-86e6-695ad7988351 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:03.492210 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6c6a05c3-26dc-4012-86e6-695ad7988351 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca" status: 200 len: 1214 microversion: 2.1 time: 0.178045 Aug 07 01:26:03.492841 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1703/3098] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:03 2022] GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca => generated 1214 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:03.635287 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7ef76d16-fde8-4698-932c-6cc23cd66819 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:03.648493 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7ef76d16-fde8-4698-932c-6cc23cd66819 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:03.651622 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7ef76d16-fde8-4698-932c-6cc23cd66819 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:03.654764 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7ef76d16-fde8-4698-932c-6cc23cd66819 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] 10.222.0.39 "GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f" status: 200 len: 1361 microversion: 2.26 time: 0.837286 Aug 07 01:26:03.671607 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1396/3099] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:26:02 2022] GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f => generated 1361 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:26:03.839786 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-379c3a75-7e26-4df5-a94a-6d3e64d92c2b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:03.841553 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-379c3a75-7e26-4df5-a94a-6d3e64d92c2b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:03.871662 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-379c3a75-7e26-4df5-a94a-6d3e64d92c2b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:03.874096 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-379c3a75-7e26-4df5-a94a-6d3e64d92c2b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:03.876535 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-379c3a75-7e26-4df5-a94a-6d3e64d92c2b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:03.881839 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-379c3a75-7e26-4df5-a94a-6d3e64d92c2b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:03.884170 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-379c3a75-7e26-4df5-a94a-6d3e64d92c2b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:03.887044 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-379c3a75-7e26-4df5-a94a-6d3e64d92c2b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:04.150529 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6a74d03b-6119-40d5-a220-4aa81ad68030 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e29a3daf0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:04.245138 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6a74d03b-6119-40d5-a220-4aa81ad68030 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/63e76497-a620-45de-87be-0d947bdbb9a7" status: 200 len: 1413 microversion: 2.1 time: 0.101743 Aug 07 01:26:04.248896 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1397/3100] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:26:04 2022] GET /compute/v2.1/images/63e76497-a620-45de-87be-0d947bdbb9a7 => generated 1413 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:04.513672 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4ad3afc5-84f6-46e6-9d29-388e90857a31 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:04.514824 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4ad3afc5-84f6-46e6-9d29-388e90857a31 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 2a78e835-73be-4ac9-bfd9-9b13009845ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:04.532530 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ad3afc5-84f6-46e6-9d29-388e90857a31 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:04.534104 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ad3afc5-84f6-46e6-9d29-388e90857a31 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:04.535726 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ad3afc5-84f6-46e6-9d29-388e90857a31 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:04.536932 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ad3afc5-84f6-46e6-9d29-388e90857a31 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:04.537558 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ad3afc5-84f6-46e6-9d29-388e90857a31 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:04.539659 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ad3afc5-84f6-46e6-9d29-388e90857a31 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:04.697119 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4ad3afc5-84f6-46e6-9d29-388e90857a31 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:04.710261 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4ad3afc5-84f6-46e6-9d29-388e90857a31 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca" status: 200 len: 1218 microversion: 2.1 time: 0.200862 Aug 07 01:26:04.713371 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1398/3101] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:04 2022] GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca => generated 1218 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:26:04.790660 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d6f5bc07-66b4-4aee-879b-46fc2be35722 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:04.799870 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d6f5bc07-66b4-4aee-879b-46fc2be35722 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] [instance: b2ab22b8-b388-447e-85ab-7a4b6d4a466f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:04.837683 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d6f5bc07-66b4-4aee-879b-46fc2be35722 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:04.838762 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d6f5bc07-66b4-4aee-879b-46fc2be35722 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:04.842278 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d6f5bc07-66b4-4aee-879b-46fc2be35722 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:04.843985 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d6f5bc07-66b4-4aee-879b-46fc2be35722 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:04.847923 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d6f5bc07-66b4-4aee-879b-46fc2be35722 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:04.854768 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d6f5bc07-66b4-4aee-879b-46fc2be35722 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:04.892716 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-379c3a75-7e26-4df5-a94a-6d3e64d92c2b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:04.903271 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-379c3a75-7e26-4df5-a94a-6d3e64d92c2b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1685 microversion: 2.1 time: 1.068683 Aug 07 01:26:04.932587 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1704/3102] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:03 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1685 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:05.262630 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-76da3376-cfc1-4639-8a60-9d060439c9e6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e24389af0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:05.376658 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-76da3376-cfc1-4639-8a60-9d060439c9e6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/63e76497-a620-45de-87be-0d947bdbb9a7" status: 200 len: 1413 microversion: 2.1 time: 0.117873 Aug 07 01:26:05.377835 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1705/3103] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:26:05 2022] GET /compute/v2.1/images/63e76497-a620-45de-87be-0d947bdbb9a7 => generated 1413 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:26:05.550533 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-6c510895-5a6c-49bf-b575-b2012451658a req-0346d039-5f85-4117-992e-a651a4563d24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e39f0d23-55ab-417b-818e-92de14de44c0", "name": "network-vif-unplugged", "status": "completed", "tag": "04267581-58b6-42a6-92a4-4f79278a63aa"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:05.587344 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6c510895-5a6c-49bf-b575-b2012451658a req-0346d039-5f85-4117-992e-a651a4563d24 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:05.590867 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6c510895-5a6c-49bf-b575-b2012451658a req-0346d039-5f85-4117-992e-a651a4563d24 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:05.592756 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6c510895-5a6c-49bf-b575-b2012451658a req-0346d039-5f85-4117-992e-a651a4563d24 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:05.615672 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-6c510895-5a6c-49bf-b575-b2012451658a req-0346d039-5f85-4117-992e-a651a4563d24 service nova] Creating event network-vif-unplugged:04267581-58b6-42a6-92a4-4f79278a63aa for instance e39f0d23-55ab-417b-818e-92de14de44c0 on n-h2-master-1 Aug 07 01:26:05.632823 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-6c510895-5a6c-49bf-b575-b2012451658a req-0346d039-5f85-4117-992e-a651a4563d24 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086353 Aug 07 01:26:05.634245 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1706/3104] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:26:05.738223 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2583f12e-7777-4c00-b100-8d263c371136 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:05.739360 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2583f12e-7777-4c00-b100-8d263c371136 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 2a78e835-73be-4ac9-bfd9-9b13009845ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:05.750411 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2583f12e-7777-4c00-b100-8d263c371136 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:05.760252 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2583f12e-7777-4c00-b100-8d263c371136 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:05.761086 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2583f12e-7777-4c00-b100-8d263c371136 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:05.762062 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2583f12e-7777-4c00-b100-8d263c371136 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:05.762755 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2583f12e-7777-4c00-b100-8d263c371136 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:05.768012 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2583f12e-7777-4c00-b100-8d263c371136 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:05.913140 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2583f12e-7777-4c00-b100-8d263c371136 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:05.926723 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2583f12e-7777-4c00-b100-8d263c371136 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca" status: 200 len: 1272 microversion: 2.1 time: 0.192748 Aug 07 01:26:05.946902 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1707/3105] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:05 2022] GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca => generated 1272 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:26:05.952542 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1f782a2e-feee-4654-910d-533c74c88138 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:05.953485 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1f782a2e-feee-4654-910d-533c74c88138 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:05.961124 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f782a2e-feee-4654-910d-533c74c88138 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:05.961945 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f782a2e-feee-4654-910d-533c74c88138 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:05.962604 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f782a2e-feee-4654-910d-533c74c88138 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:05.963551 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f782a2e-feee-4654-910d-533c74c88138 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:05.964296 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f782a2e-feee-4654-910d-533c74c88138 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:05.965046 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f782a2e-feee-4654-910d-533c74c88138 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:06.447113 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1f782a2e-feee-4654-910d-533c74c88138 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:06.455264 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1f782a2e-feee-4654-910d-533c74c88138 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1685 microversion: 2.1 time: 0.506726 Aug 07 01:26:06.463078 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1708/3106] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:05 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1685 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:06.480579 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9586f914-31b1-49c2-ada7-7ea860f0dd8d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e247299d0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:06.516147 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d6f5bc07-66b4-4aee-879b-46fc2be35722 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:06.534971 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d6f5bc07-66b4-4aee-879b-46fc2be35722 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:06.544188 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d6f5bc07-66b4-4aee-879b-46fc2be35722 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:06.555707 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d6f5bc07-66b4-4aee-879b-46fc2be35722 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] 10.222.0.39 "GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f" status: 200 len: 1361 microversion: 2.26 time: 1.821928 Aug 07 01:26:06.562399 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1399/3107] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:26:04 2022] GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f => generated 1361 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:26:06.722092 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9586f914-31b1-49c2-ada7-7ea860f0dd8d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/63e76497-a620-45de-87be-0d947bdbb9a7" status: 200 len: 1413 microversion: 2.1 time: 0.256469 Aug 07 01:26:06.723850 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1709/3108] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:26:06 2022] GET /compute/v2.1/images/63e76497-a620-45de-87be-0d947bdbb9a7 => generated 1413 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:06.954589 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a82bdad0-f7f4-4ebe-acb0-a9c07a81eb11 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:06.955170 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a82bdad0-f7f4-4ebe-acb0-a9c07a81eb11 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 2a78e835-73be-4ac9-bfd9-9b13009845ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:06.968839 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a82bdad0-f7f4-4ebe-acb0-a9c07a81eb11 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:06.969339 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a82bdad0-f7f4-4ebe-acb0-a9c07a81eb11 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:06.969783 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a82bdad0-f7f4-4ebe-acb0-a9c07a81eb11 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:06.970513 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a82bdad0-f7f4-4ebe-acb0-a9c07a81eb11 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:06.970974 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a82bdad0-f7f4-4ebe-acb0-a9c07a81eb11 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:06.989820 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a82bdad0-f7f4-4ebe-acb0-a9c07a81eb11 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:07.467481 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a82bdad0-f7f4-4ebe-acb0-a9c07a81eb11 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:07.483770 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fd2a51b5-daff-4a27-898f-e17352c47023 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:07.484522 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fd2a51b5-daff-4a27-898f-e17352c47023 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:07.511840 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a82bdad0-f7f4-4ebe-acb0-a9c07a81eb11 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca" status: 200 len: 1272 microversion: 2.1 time: 0.561108 Aug 07 01:26:07.514621 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1400/3109] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:06 2022] GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca => generated 1272 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:07.524168 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd2a51b5-daff-4a27-898f-e17352c47023 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:07.532757 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd2a51b5-daff-4a27-898f-e17352c47023 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:07.538009 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd2a51b5-daff-4a27-898f-e17352c47023 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:07.540053 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd2a51b5-daff-4a27-898f-e17352c47023 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:07.544422 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd2a51b5-daff-4a27-898f-e17352c47023 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:07.548406 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd2a51b5-daff-4a27-898f-e17352c47023 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:07.587955 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7b1b79a6-553d-4740-b038-ba25fa5f49b4 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:07.588679 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7b1b79a6-553d-4740-b038-ba25fa5f49b4 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] [instance: b2ab22b8-b388-447e-85ab-7a4b6d4a466f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:07.597903 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b1b79a6-553d-4740-b038-ba25fa5f49b4 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:07.598401 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b1b79a6-553d-4740-b038-ba25fa5f49b4 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:07.598844 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b1b79a6-553d-4740-b038-ba25fa5f49b4 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:07.599562 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b1b79a6-553d-4740-b038-ba25fa5f49b4 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:07.624635 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b1b79a6-553d-4740-b038-ba25fa5f49b4 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:07.625340 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b1b79a6-553d-4740-b038-ba25fa5f49b4 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:08.239620 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fd2a51b5-daff-4a27-898f-e17352c47023 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:08.270742 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fd2a51b5-daff-4a27-898f-e17352c47023 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1680 microversion: 2.1 time: 0.792683 Aug 07 01:26:08.294658 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1710/3110] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:07 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1680 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:26:08.311639 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-45c18fd6-422d-4ed0-aa71-a35f0aa28aaa req-1bce1cda-886e-4613-bc48-3e3fafa5f62c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2ab22b8-b388-447e-85ab-7a4b6d4a466f", "name": "network-vif-plugged", "status": "completed", "tag": "c47e3688-e367-4a1e-b221-a82250dd507e"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:08.340465 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-45c18fd6-422d-4ed0-aa71-a35f0aa28aaa req-1bce1cda-886e-4613-bc48-3e3fafa5f62c service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:08.341537 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-45c18fd6-422d-4ed0-aa71-a35f0aa28aaa req-1bce1cda-886e-4613-bc48-3e3fafa5f62c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:08.342011 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-45c18fd6-422d-4ed0-aa71-a35f0aa28aaa req-1bce1cda-886e-4613-bc48-3e3fafa5f62c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:08.378072 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-45c18fd6-422d-4ed0-aa71-a35f0aa28aaa req-1bce1cda-886e-4613-bc48-3e3fafa5f62c service nova] Creating event network-vif-plugged:c47e3688-e367-4a1e-b221-a82250dd507e for instance b2ab22b8-b388-447e-85ab-7a4b6d4a466f on n-h2-master-1 Aug 07 01:26:08.400081 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-45c18fd6-422d-4ed0-aa71-a35f0aa28aaa req-1bce1cda-886e-4613-bc48-3e3fafa5f62c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097717 Aug 07 01:26:08.401196 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1711/3111] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:26:08.413055 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8cb330fc-0c6b-4c51-8a9a-023d551fbd0e tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e249663a0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:09.954301 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7b1b79a6-553d-4740-b038-ba25fa5f49b4 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:09.973654 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7b1b79a6-553d-4740-b038-ba25fa5f49b4 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:09.987400 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7b1b79a6-553d-4740-b038-ba25fa5f49b4 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:09.989541 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7b1b79a6-553d-4740-b038-ba25fa5f49b4 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] 10.222.0.39 "GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f" status: 200 len: 1361 microversion: 2.26 time: 2.405638 Aug 07 01:26:10.005324 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1401/3112] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:26:07 2022] GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f => generated 1361 bytes in 2422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:26:10.017384 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-500fa4a7-ce9e-4242-a98d-3b1e1595911b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:10.018005 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-500fa4a7-ce9e-4242-a98d-3b1e1595911b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 2a78e835-73be-4ac9-bfd9-9b13009845ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:10.041235 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-500fa4a7-ce9e-4242-a98d-3b1e1595911b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:10.042015 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-500fa4a7-ce9e-4242-a98d-3b1e1595911b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:10.042450 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-500fa4a7-ce9e-4242-a98d-3b1e1595911b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:10.043165 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-500fa4a7-ce9e-4242-a98d-3b1e1595911b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:10.054435 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-500fa4a7-ce9e-4242-a98d-3b1e1595911b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:10.059004 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-500fa4a7-ce9e-4242-a98d-3b1e1595911b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:11.419411 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-500fa4a7-ce9e-4242-a98d-3b1e1595911b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:11.450476 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-500fa4a7-ce9e-4242-a98d-3b1e1595911b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca" status: 200 len: 1314 microversion: 2.1 time: 1.436961 Aug 07 01:26:11.478635 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1402/3113] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:10 2022] GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca => generated 1314 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:11.490261 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ac7a6b6d-0baf-449c-a30d-dbe9c6560ff7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:11.491645 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ac7a6b6d-0baf-449c-a30d-dbe9c6560ff7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:11.524919 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:11.532134 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ac7a6b6d-0baf-449c-a30d-dbe9c6560ff7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:11.533723 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ac7a6b6d-0baf-449c-a30d-dbe9c6560ff7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:11.537914 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ac7a6b6d-0baf-449c-a30d-dbe9c6560ff7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:11.542220 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ac7a6b6d-0baf-449c-a30d-dbe9c6560ff7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:11.545437 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ac7a6b6d-0baf-449c-a30d-dbe9c6560ff7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:11.547908 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ac7a6b6d-0baf-449c-a30d-dbe9c6560ff7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:12.693747 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:13.489101 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=8 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:13.568543 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ac7a6b6d-0baf-449c-a30d-dbe9c6560ff7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:13.587673 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ac7a6b6d-0baf-449c-a30d-dbe9c6560ff7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1680 microversion: 2.1 time: 2.103829 Aug 07 01:26:13.589043 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1403/3114] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:11 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1680 bytes in 2108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:13.601394 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d228d919-14e4-4062-afe5-a6030096395f tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:13.604991 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d228d919-14e4-4062-afe5-a6030096395f tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] [instance: b2ab22b8-b388-447e-85ab-7a4b6d4a466f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:13.622302 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d228d919-14e4-4062-afe5-a6030096395f tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:13.625504 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d228d919-14e4-4062-afe5-a6030096395f tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:13.628145 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d228d919-14e4-4062-afe5-a6030096395f tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:13.632474 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d228d919-14e4-4062-afe5-a6030096395f tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:13.633724 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d228d919-14e4-4062-afe5-a6030096395f tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:13.634418 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d228d919-14e4-4062-afe5-a6030096395f tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:14.414276 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d228d919-14e4-4062-afe5-a6030096395f tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:14.434623 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d228d919-14e4-4062-afe5-a6030096395f tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:14.446123 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d228d919-14e4-4062-afe5-a6030096395f tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:14.455470 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d228d919-14e4-4062-afe5-a6030096395f tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] 10.222.0.39 "GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f" status: 200 len: 1545 microversion: 2.26 time: 0.861599 Aug 07 01:26:14.462761 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1404/3115] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:26:13 2022] GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f => generated 1545 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:26:14.488385 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-46375749-328e-4b4d-8ed2-01d5c1697e6d req-9256f586-b123-461c-8301-2695c19f6a19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e39f0d23-55ab-417b-818e-92de14de44c0", "name": "network-vif-plugged", "status": "completed", "tag": "04267581-58b6-42a6-92a4-4f79278a63aa"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:14.548682 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-46375749-328e-4b4d-8ed2-01d5c1697e6d req-9256f586-b123-461c-8301-2695c19f6a19 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:14.550520 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-46375749-328e-4b4d-8ed2-01d5c1697e6d req-9256f586-b123-461c-8301-2695c19f6a19 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:14.550907 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-46375749-328e-4b4d-8ed2-01d5c1697e6d req-9256f586-b123-461c-8301-2695c19f6a19 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:14.586320 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-46375749-328e-4b4d-8ed2-01d5c1697e6d req-9256f586-b123-461c-8301-2695c19f6a19 service nova] Creating event network-vif-plugged:04267581-58b6-42a6-92a4-4f79278a63aa for instance e39f0d23-55ab-417b-818e-92de14de44c0 on n-h2-master-1 Aug 07 01:26:14.604038 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-46375749-328e-4b4d-8ed2-01d5c1697e6d req-9256f586-b123-461c-8301-2695c19f6a19 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138279 Aug 07 01:26:14.604598 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1405/3116] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:26:14.617557 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-080ee3bb-26ac-462d-bed3-9a999126bcb6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:14.619491 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-080ee3bb-26ac-462d-bed3-9a999126bcb6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 2a78e835-73be-4ac9-bfd9-9b13009845ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:14.630653 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-080ee3bb-26ac-462d-bed3-9a999126bcb6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:14.631454 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-080ee3bb-26ac-462d-bed3-9a999126bcb6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:14.632094 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-080ee3bb-26ac-462d-bed3-9a999126bcb6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:14.632984 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-080ee3bb-26ac-462d-bed3-9a999126bcb6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:14.633628 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-080ee3bb-26ac-462d-bed3-9a999126bcb6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:14.634230 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-080ee3bb-26ac-462d-bed3-9a999126bcb6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:15.820851 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-080ee3bb-26ac-462d-bed3-9a999126bcb6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:15.849315 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-080ee3bb-26ac-462d-bed3-9a999126bcb6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca" status: 200 len: 1314 microversion: 2.1 time: 1.239249 Aug 07 01:26:15.849914 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1406/3117] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:14 2022] GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca => generated 1314 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:15.881140 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1dcd9dd1-937d-446e-a168-e0724d01d058 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Calling method '.version_select at 0x7f9e29a21ee0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:15.912572 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1dcd9dd1-937d-446e-a168-e0724d01d058 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:15.912572 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1dcd9dd1-937d-446e-a168-e0724d01d058 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:15.912882 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1dcd9dd1-937d-446e-a168-e0724d01d058 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:15.913390 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1dcd9dd1-937d-446e-a168-e0724d01d058 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] [instance: b2ab22b8-b388-447e-85ab-7a4b6d4a466f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:15.926344 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1dcd9dd1-937d-446e-a168-e0724d01d058 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:15.927544 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1dcd9dd1-937d-446e-a168-e0724d01d058 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:15.928185 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1dcd9dd1-937d-446e-a168-e0724d01d058 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:15.929557 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1dcd9dd1-937d-446e-a168-e0724d01d058 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:15.930974 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1dcd9dd1-937d-446e-a168-e0724d01d058 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:15.932303 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1dcd9dd1-937d-446e-a168-e0724d01d058 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:15.969762 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1dcd9dd1-937d-446e-a168-e0724d01d058 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:15.970553 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1dcd9dd1-937d-446e-a168-e0724d01d058 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:15.971160 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1dcd9dd1-937d-446e-a168-e0724d01d058 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:15.988454 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1dcd9dd1-937d-446e-a168-e0724d01d058 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:15.989191 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1dcd9dd1-937d-446e-a168-e0724d01d058 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:15.989774 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1dcd9dd1-937d-446e-a168-e0724d01d058 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:16.044035 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-1dcd9dd1-937d-446e-a168-e0724d01d058 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lazy-loading 'flavor' on Instance uuid b2ab22b8-b388-447e-85ab-7a4b6d4a466f {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:26:16.122448 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:16.137685 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1dcd9dd1-937d-446e-a168-e0724d01d058 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] 10.222.0.39 "PUT /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f/tags/tempest-tag-982962737" status: 201 len: 0 microversion: 2.26 time: 0.285493 Aug 07 01:26:16.139054 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1407/3118] 10.222.0.39 () {62 vars in 1377 bytes} [Sun Aug 7 01:26:15 2022] PUT /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f/tags/tempest-tag-982962737 => generated 0 bytes in 288 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 07 01:26:16.144947 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0e890f27-aa3c-4657-97b9-540eeeafbaf3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:16.146473 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0e890f27-aa3c-4657-97b9-540eeeafbaf3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:16.160520 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e890f27-aa3c-4657-97b9-540eeeafbaf3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:16.161375 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e890f27-aa3c-4657-97b9-540eeeafbaf3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:16.162020 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e890f27-aa3c-4657-97b9-540eeeafbaf3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:16.162917 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e890f27-aa3c-4657-97b9-540eeeafbaf3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:16.163512 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e890f27-aa3c-4657-97b9-540eeeafbaf3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:16.164129 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e890f27-aa3c-4657-97b9-540eeeafbaf3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:16.616014 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0e890f27-aa3c-4657-97b9-540eeeafbaf3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:16.634315 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0e890f27-aa3c-4657-97b9-540eeeafbaf3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1680 microversion: 2.1 time: 0.492626 Aug 07 01:26:16.636968 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1408/3119] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:16 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1680 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:16.648836 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-406cfd7c-d09d-419c-a495-fe19ccd347bf req-9923e60b-cd5b-49ad-818d-50a5a85794ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a78e835-73be-4ac9-bfd9-9b13009845ca", "tag": "42ae2720-0d84-474b-a284-0714e94c1948"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:16.687795 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-406cfd7c-d09d-419c-a495-fe19ccd347bf req-9923e60b-cd5b-49ad-818d-50a5a85794ed service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:16.690020 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-406cfd7c-d09d-419c-a495-fe19ccd347bf req-9923e60b-cd5b-49ad-818d-50a5a85794ed service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:16.693033 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-406cfd7c-d09d-419c-a495-fe19ccd347bf req-9923e60b-cd5b-49ad-818d-50a5a85794ed service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:17.379917 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-406cfd7c-d09d-419c-a495-fe19ccd347bf req-9923e60b-cd5b-49ad-818d-50a5a85794ed service nova] Creating event network-changed:42ae2720-0d84-474b-a284-0714e94c1948 for instance 2a78e835-73be-4ac9-bfd9-9b13009845ca on n-h1-master-1 Aug 07 01:26:17.397590 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-406cfd7c-d09d-419c-a495-fe19ccd347bf req-9923e60b-cd5b-49ad-818d-50a5a85794ed service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.758777 Aug 07 01:26:17.398743 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1409/3120] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:26:17.407019 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3f34ee09-5ff6-4559-a923-04a64be56e6e tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Calling method '.version_select at 0x7f9e29995a60>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:17.425502 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3f34ee09-5ff6-4559-a923-04a64be56e6e tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:17.428475 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3f34ee09-5ff6-4559-a923-04a64be56e6e tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:17.429596 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3f34ee09-5ff6-4559-a923-04a64be56e6e tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:17.462304 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3f34ee09-5ff6-4559-a923-04a64be56e6e tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] 10.222.0.39 "GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f/tags/tempest-tag-982962737" status: 204 len: 0 microversion: 2.26 time: 0.061862 Aug 07 01:26:17.464903 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1410/3121] 10.222.0.39 () {60 vars in 1358 bytes} [Sun Aug 7 01:26:17 2022] GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f/tags/tempest-tag-982962737 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 01:26:17.478575 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0773ead4-3ea6-404c-9132-c15415a11b27 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:17.481274 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0773ead4-3ea6-404c-9132-c15415a11b27 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 2a78e835-73be-4ac9-bfd9-9b13009845ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:17.514512 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0773ead4-3ea6-404c-9132-c15415a11b27 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:17.515176 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0773ead4-3ea6-404c-9132-c15415a11b27 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:17.523046 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0773ead4-3ea6-404c-9132-c15415a11b27 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:17.530566 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0773ead4-3ea6-404c-9132-c15415a11b27 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:17.531108 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0773ead4-3ea6-404c-9132-c15415a11b27 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:17.531821 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0773ead4-3ea6-404c-9132-c15415a11b27 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:18.154367 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0773ead4-3ea6-404c-9132-c15415a11b27 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:18.170517 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0773ead4-3ea6-404c-9132-c15415a11b27 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca" status: 200 len: 1314 microversion: 2.1 time: 0.703147 Aug 07 01:26:18.185094 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1411/3122] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:17 2022] GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca => generated 1314 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:18.205497 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-76e50013-c7f4-4ab2-880e-4a2b029ed669 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Calling method '.version_select at 0x7f9e29951ca0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:18.229083 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76e50013-c7f4-4ab2-880e-4a2b029ed669 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:18.231506 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76e50013-c7f4-4ab2-880e-4a2b029ed669 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:18.233434 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76e50013-c7f4-4ab2-880e-4a2b029ed669 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:18.234233 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-76e50013-c7f4-4ab2-880e-4a2b029ed669 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] [instance: b2ab22b8-b388-447e-85ab-7a4b6d4a466f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:18.269498 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76e50013-c7f4-4ab2-880e-4a2b029ed669 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:18.277111 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76e50013-c7f4-4ab2-880e-4a2b029ed669 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:18.278388 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76e50013-c7f4-4ab2-880e-4a2b029ed669 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:18.280598 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76e50013-c7f4-4ab2-880e-4a2b029ed669 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:18.291558 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76e50013-c7f4-4ab2-880e-4a2b029ed669 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:18.292519 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76e50013-c7f4-4ab2-880e-4a2b029ed669 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:18.327266 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:18.346975 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=34 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:18.366819 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76e50013-c7f4-4ab2-880e-4a2b029ed669 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:18.367971 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76e50013-c7f4-4ab2-880e-4a2b029ed669 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:18.368702 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-76e50013-c7f4-4ab2-880e-4a2b029ed669 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:18.419246 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-76e50013-c7f4-4ab2-880e-4a2b029ed669 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lazy-loading 'flavor' on Instance uuid b2ab22b8-b388-447e-85ab-7a4b6d4a466f {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:26:18.456805 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-76e50013-c7f4-4ab2-880e-4a2b029ed669 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f/tags" status: 204 len: 0 microversion: 2.26 time: 0.270509 Aug 07 01:26:18.458107 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1412/3123] 10.222.0.39 () {60 vars in 1295 bytes} [Sun Aug 7 01:26:18 2022] DELETE /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f/tags => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 01:26:18.466098 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-31415c6d-0c22-4fe1-92a6-26845473d0f1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:18.467117 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-31415c6d-0c22-4fe1-92a6-26845473d0f1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:18.476654 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-31415c6d-0c22-4fe1-92a6-26845473d0f1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:18.477562 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-31415c6d-0c22-4fe1-92a6-26845473d0f1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:18.480637 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-31415c6d-0c22-4fe1-92a6-26845473d0f1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:18.482020 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-31415c6d-0c22-4fe1-92a6-26845473d0f1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:18.482751 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-31415c6d-0c22-4fe1-92a6-26845473d0f1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:18.483575 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-31415c6d-0c22-4fe1-92a6-26845473d0f1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:20.791606 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-31415c6d-0c22-4fe1-92a6-26845473d0f1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:20.805308 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-31415c6d-0c22-4fe1-92a6-26845473d0f1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1680 microversion: 2.1 time: 2.345796 Aug 07 01:26:20.825338 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1413/3124] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:18 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1680 bytes in 2366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:20.846306 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1a9a3332-661f-42c0-9cda-b69f4bb4be85 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Calling method '.version_select at 0x7f9e29a504c0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:20.879068 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1a9a3332-661f-42c0-9cda-b69f4bb4be85 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:20.881807 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1a9a3332-661f-42c0-9cda-b69f4bb4be85 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:20.882569 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1a9a3332-661f-42c0-9cda-b69f4bb4be85 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:20.920331 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1a9a3332-661f-42c0-9cda-b69f4bb4be85 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] 10.222.0.39 "GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f/tags" status: 200 len: 12 microversion: 2.26 time: 0.093380 Aug 07 01:26:20.933072 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1414/3125] 10.222.0.39 () {60 vars in 1292 bytes} [Sun Aug 7 01:26:20 2022] GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f/tags => generated 12 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:20.947773 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4d93e22c-4ad8-43b5-987a-0ebae4456e20 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Action: 'create', calling method: .version_select at 0x7f9e299b4040>, body: {"keypair": {"name": "tempest-keypair-2116889065", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpsbJtg28XB71K4CUgg3LRJhpgwtXxHLO74Ojd4LHJTQB+o17rkSR2sDPAAgHFwPMFXIP3YYEAeEam2jgPjSzlku+rsU9N74C+VOE18Pupu4R5lnkfPoGl3A7lMrkSutA=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:20.994397 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-4d93e22c-4ad8-43b5-987a-0ebae4456e20 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Getting quotas for project 9ecc3d5efbe54d76ae9e6ed5f7633c1d. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:26:21.019792 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-4d93e22c-4ad8-43b5-987a-0ebae4456e20 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Getting quotas for user e379b67e2bb248b3ad25b92b2082b0fe and project 9ecc3d5efbe54d76ae9e6ed5f7633c1d. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:26:21.085269 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4d93e22c-4ad8-43b5-987a-0ebae4456e20 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.150983 Aug 07 01:26:21.087290 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1415/3126] 10.222.0.39 () {62 vars in 1200 bytes} [Sun Aug 7 01:26:20 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 154 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 07 01:26:21.101252 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4851ad0f-8fe5-4c95-a160-78d0b7716cc3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:21.102382 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4851ad0f-8fe5-4c95-a160-78d0b7716cc3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 2a78e835-73be-4ac9-bfd9-9b13009845ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:21.119684 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4851ad0f-8fe5-4c95-a160-78d0b7716cc3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:21.120469 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4851ad0f-8fe5-4c95-a160-78d0b7716cc3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:21.121158 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4851ad0f-8fe5-4c95-a160-78d0b7716cc3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:21.122147 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4851ad0f-8fe5-4c95-a160-78d0b7716cc3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:21.122841 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4851ad0f-8fe5-4c95-a160-78d0b7716cc3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:21.127005 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4851ad0f-8fe5-4c95-a160-78d0b7716cc3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:21.978761 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4851ad0f-8fe5-4c95-a160-78d0b7716cc3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:22.005605 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4851ad0f-8fe5-4c95-a160-78d0b7716cc3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca" status: 200 len: 1314 microversion: 2.1 time: 0.915147 Aug 07 01:26:22.007100 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1416/3127] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:21 2022] GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca => generated 1314 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:22.025172 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f17c659d-3447-4034-b4a3-f1d3dfa0cb1d tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Calling method '.version_select at 0x7f9e2504daf0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:22.054245 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f17c659d-3447-4034-b4a3-f1d3dfa0cb1d tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:22.057018 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f17c659d-3447-4034-b4a3-f1d3dfa0cb1d tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:22.062607 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f17c659d-3447-4034-b4a3-f1d3dfa0cb1d tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:22.067687 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f17c659d-3447-4034-b4a3-f1d3dfa0cb1d tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] [instance: b2ab22b8-b388-447e-85ab-7a4b6d4a466f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:22.093922 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f17c659d-3447-4034-b4a3-f1d3dfa0cb1d tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:22.095533 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f17c659d-3447-4034-b4a3-f1d3dfa0cb1d tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:22.096480 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f17c659d-3447-4034-b4a3-f1d3dfa0cb1d tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:22.098993 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f17c659d-3447-4034-b4a3-f1d3dfa0cb1d tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:22.100326 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f17c659d-3447-4034-b4a3-f1d3dfa0cb1d tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:22.104171 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f17c659d-3447-4034-b4a3-f1d3dfa0cb1d tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:22.178547 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f17c659d-3447-4034-b4a3-f1d3dfa0cb1d tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:22.185988 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f17c659d-3447-4034-b4a3-f1d3dfa0cb1d tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:22.188504 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f17c659d-3447-4034-b4a3-f1d3dfa0cb1d tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:22.220426 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f17c659d-3447-4034-b4a3-f1d3dfa0cb1d tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:22.221331 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f17c659d-3447-4034-b4a3-f1d3dfa0cb1d tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:22.222040 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f17c659d-3447-4034-b4a3-f1d3dfa0cb1d tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:22.291947 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-f17c659d-3447-4034-b4a3-f1d3dfa0cb1d tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lazy-loading 'flavor' on Instance uuid b2ab22b8-b388-447e-85ab-7a4b6d4a466f {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:26:22.334003 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f17c659d-3447-4034-b4a3-f1d3dfa0cb1d tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] 10.222.0.39 "PUT /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f/tags/tempest-tag-302839724" status: 201 len: 0 microversion: 2.26 time: 0.324990 Aug 07 01:26:22.336365 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1417/3128] 10.222.0.39 () {62 vars in 1377 bytes} [Sun Aug 7 01:26:22 2022] PUT /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f/tags/tempest-tag-302839724 => generated 0 bytes in 328 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 07 01:26:22.348539 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-907a2bfc-619e-4648-a7c7-fa4166181469 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:22.352899 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-907a2bfc-619e-4648-a7c7-fa4166181469 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:22.371587 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-907a2bfc-619e-4648-a7c7-fa4166181469 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:22.376711 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-907a2bfc-619e-4648-a7c7-fa4166181469 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:22.377649 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-907a2bfc-619e-4648-a7c7-fa4166181469 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:22.378724 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-907a2bfc-619e-4648-a7c7-fa4166181469 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:22.379469 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-907a2bfc-619e-4648-a7c7-fa4166181469 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:22.383106 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-907a2bfc-619e-4648-a7c7-fa4166181469 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:22.817757 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-907a2bfc-619e-4648-a7c7-fa4166181469 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:22.834226 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-907a2bfc-619e-4648-a7c7-fa4166181469 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1680 microversion: 2.1 time: 0.490274 Aug 07 01:26:22.835106 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1418/3129] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:22 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1680 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:23.330997 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c27492ea-a928-4db1-90b7-8b2d96fcd3d1 tempest-NetworksTest-1118315782 tempest-NetworksTest-1118315782-project-admin] Calling method '.version_select at 0x7f9e29a509d0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:23.960202 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c27492ea-a928-4db1-90b7-8b2d96fcd3d1 tempest-NetworksTest-1118315782 tempest-NetworksTest-1118315782-project-admin] 10.222.0.39 "GET /compute/v2.1/os-networks" status: 200 len: 11412 microversion: 2.1 time: 1.122955 Aug 07 01:26:23.965196 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1419/3130] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Aug 7 01:26:22 2022] GET /compute/v2.1/os-networks => generated 11412 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:26:23.970003 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3e626cfb-f9ed-4feb-816f-5b7bb2a84d8a tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Calling method '.version_select at 0x7f9e29a1b0d0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:23.997378 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3e626cfb-f9ed-4feb-816f-5b7bb2a84d8a tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:23.999224 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3e626cfb-f9ed-4feb-816f-5b7bb2a84d8a tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:24.006167 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3e626cfb-f9ed-4feb-816f-5b7bb2a84d8a tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:24.056459 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3e626cfb-f9ed-4feb-816f-5b7bb2a84d8a tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] 10.222.0.39 "GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f/tags" status: 200 len: 35 microversion: 2.26 time: 0.092974 Aug 07 01:26:24.059957 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1420/3131] 10.222.0.39 () {60 vars in 1292 bytes} [Sun Aug 7 01:26:23 2022] GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f/tags => generated 35 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:24.081641 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-659d8751-7900-4e3b-a56d-280251ee4dfd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:24.086329 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-659d8751-7900-4e3b-a56d-280251ee4dfd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 2a78e835-73be-4ac9-bfd9-9b13009845ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:24.104021 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-659d8751-7900-4e3b-a56d-280251ee4dfd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:24.104518 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-659d8751-7900-4e3b-a56d-280251ee4dfd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:24.112040 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-659d8751-7900-4e3b-a56d-280251ee4dfd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:24.117885 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-659d8751-7900-4e3b-a56d-280251ee4dfd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:24.120855 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-659d8751-7900-4e3b-a56d-280251ee4dfd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:24.123533 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-659d8751-7900-4e3b-a56d-280251ee4dfd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:24.597099 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-659d8751-7900-4e3b-a56d-280251ee4dfd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:24.609616 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-659d8751-7900-4e3b-a56d-280251ee4dfd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca" status: 200 len: 1314 microversion: 2.1 time: 0.545064 Aug 07 01:26:24.611227 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1421/3132] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:24 2022] GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca => generated 1314 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:24.619067 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0d89d42c-a86e-445e-9133-11fa85006356 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:24.620236 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0d89d42c-a86e-445e-9133-11fa85006356 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:24.649692 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d89d42c-a86e-445e-9133-11fa85006356 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:24.650498 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d89d42c-a86e-445e-9133-11fa85006356 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:24.651108 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d89d42c-a86e-445e-9133-11fa85006356 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:24.652047 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d89d42c-a86e-445e-9133-11fa85006356 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:24.652665 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d89d42c-a86e-445e-9133-11fa85006356 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:24.655948 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d89d42c-a86e-445e-9133-11fa85006356 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:25.198545 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0d89d42c-a86e-445e-9133-11fa85006356 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:25.213377 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0d89d42c-a86e-445e-9133-11fa85006356 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1680 microversion: 2.1 time: 0.597737 Aug 07 01:26:25.214800 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1422/3133] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:24 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1680 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:25.228055 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bd936b94-cdc5-4709-8304-34d63d521d27 tempest-NetworksTest-1118315782 tempest-NetworksTest-1118315782-project-admin] Calling method '.version_select at 0x7f9e29951f70>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:25.438177 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bd936b94-cdc5-4709-8304-34d63d521d27 tempest-NetworksTest-1118315782 tempest-NetworksTest-1118315782-project-admin] 10.222.0.39 "GET /compute/v2.1/os-networks/8049ef63-728c-4ad0-8526-50dc3e712e09" status: 200 len: 652 microversion: 2.1 time: 0.218071 Aug 07 01:26:25.439396 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1423/3134] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Aug 7 01:26:25 2022] GET /compute/v2.1/os-networks/8049ef63-728c-4ad0-8526-50dc3e712e09 => generated 652 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:26:25.448114 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a31b78b7-2230-45f3-b1d2-cb0c5e289048 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Action: 'create', calling method: .version_select at 0x7f9e29951550>, body: {"keypair": {"name": "tempest-keypair-1694686018", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSTByArYJL5xIC7oyfw5DrGVLeXsNDvgahwwthjQDcNIVzt6jFrdq3/FVVcfrWWypeZwaJPfUNDHa/7t3hk5zQH473Jgm+bLb7ivDEBwuTx5ZajFwuCblIRNfkVEuem5g=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:25.493585 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-a31b78b7-2230-45f3-b1d2-cb0c5e289048 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Getting quotas for project f5f3e59419be4d2b892f498e527cb2e8. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:26:25.508491 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-a31b78b7-2230-45f3-b1d2-cb0c5e289048 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Getting quotas for user 106559a2b8754c54b1c41ba8cadd1a97 and project f5f3e59419be4d2b892f498e527cb2e8. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:26:25.557396 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a31b78b7-2230-45f3-b1d2-cb0c5e289048 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.116096 Aug 07 01:26:25.570754 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1424/3135] 10.222.0.39 () {62 vars in 1200 bytes} [Sun Aug 7 01:26:25 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 130 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 07 01:26:25.576453 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f3188c20-4cb2-4527-913f-ba6af58050f8 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Calling method '.version_select at 0x7f9e299b41f0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:25.602491 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f3188c20-4cb2-4527-913f-ba6af58050f8 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:25.603708 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f3188c20-4cb2-4527-913f-ba6af58050f8 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:25.609209 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f3188c20-4cb2-4527-913f-ba6af58050f8 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:25.611244 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f3188c20-4cb2-4527-913f-ba6af58050f8 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] [instance: b2ab22b8-b388-447e-85ab-7a4b6d4a466f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:25.631080 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f3188c20-4cb2-4527-913f-ba6af58050f8 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:25.635069 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f3188c20-4cb2-4527-913f-ba6af58050f8 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:25.635530 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f3188c20-4cb2-4527-913f-ba6af58050f8 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:25.636520 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f3188c20-4cb2-4527-913f-ba6af58050f8 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:25.637153 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f3188c20-4cb2-4527-913f-ba6af58050f8 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:25.639074 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f3188c20-4cb2-4527-913f-ba6af58050f8 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:25.714987 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f3188c20-4cb2-4527-913f-ba6af58050f8 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:25.715832 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f3188c20-4cb2-4527-913f-ba6af58050f8 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:25.716833 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f3188c20-4cb2-4527-913f-ba6af58050f8 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:25.770333 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-f3188c20-4cb2-4527-913f-ba6af58050f8 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lazy-loading 'flavor' on Instance uuid b2ab22b8-b388-447e-85ab-7a4b6d4a466f {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:26:25.818896 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f3188c20-4cb2-4527-913f-ba6af58050f8 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f/tags/tempest-tag-302839724" status: 204 len: 0 microversion: 2.26 time: 0.246504 Aug 07 01:26:25.824122 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1425/3136] 10.222.0.39 () {60 vars in 1361 bytes} [Sun Aug 7 01:26:25 2022] DELETE /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f/tags/tempest-tag-302839724 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 01:26:25.833709 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ba4991d4-bed7-4118-a92c-681845f89d89 tempest-NetworksTest-1118315782 tempest-NetworksTest-1118315782-project-admin] Calling method '.version_select at 0x7f9e29995a60>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:26.741799 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ba4991d4-bed7-4118-a92c-681845f89d89 tempest-NetworksTest-1118315782 tempest-NetworksTest-1118315782-project-admin] 10.222.0.39 "GET /compute/v2.1/os-networks" status: 200 len: 10777 microversion: 2.1 time: 0.915827 Aug 07 01:26:26.743168 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1426/3137] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Aug 7 01:26:25 2022] GET /compute/v2.1/os-networks => generated 10777 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:26:26.752860 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6496b940-9ead-481b-aad3-7fc3157c2675 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:26.754540 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6496b940-9ead-481b-aad3-7fc3157c2675 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 2a78e835-73be-4ac9-bfd9-9b13009845ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:26.773785 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6496b940-9ead-481b-aad3-7fc3157c2675 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:26.779129 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6496b940-9ead-481b-aad3-7fc3157c2675 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:26.780907 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6496b940-9ead-481b-aad3-7fc3157c2675 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:26.788155 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6496b940-9ead-481b-aad3-7fc3157c2675 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:26.788429 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6496b940-9ead-481b-aad3-7fc3157c2675 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:26.790121 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6496b940-9ead-481b-aad3-7fc3157c2675 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:27.420182 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6496b940-9ead-481b-aad3-7fc3157c2675 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:27.432185 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6496b940-9ead-481b-aad3-7fc3157c2675 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca" status: 200 len: 1314 microversion: 2.1 time: 0.687709 Aug 07 01:26:27.443009 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1427/3138] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:26 2022] GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca => generated 1314 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:27.465028 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e7cea5bc-8f67-4fb7-85ce-d26ac4ea4dc2 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Calling method '.version_select at 0x7f9e299b4820>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:27.507577 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7cea5bc-8f67-4fb7-85ce-d26ac4ea4dc2 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:27.508346 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7cea5bc-8f67-4fb7-85ce-d26ac4ea4dc2 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:27.508636 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7cea5bc-8f67-4fb7-85ce-d26ac4ea4dc2 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:27.548190 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=95,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:27.572663 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e7cea5bc-8f67-4fb7-85ce-d26ac4ea4dc2 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] 10.222.0.39 "GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f/tags" status: 200 len: 12 microversion: 2.26 time: 0.128026 Aug 07 01:26:27.573604 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1428/3139] 10.222.0.39 () {60 vars in 1292 bytes} [Sun Aug 7 01:26:27 2022] GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f/tags => generated 12 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:27.594871 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8cc57be9-f1b1-4b14-b909-1ed2ab53a261 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:27.602944 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8cc57be9-f1b1-4b14-b909-1ed2ab53a261 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:27.642384 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8cc57be9-f1b1-4b14-b909-1ed2ab53a261 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:27.643966 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8cc57be9-f1b1-4b14-b909-1ed2ab53a261 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:27.645445 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8cc57be9-f1b1-4b14-b909-1ed2ab53a261 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:27.646517 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8cc57be9-f1b1-4b14-b909-1ed2ab53a261 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:27.649666 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8cc57be9-f1b1-4b14-b909-1ed2ab53a261 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:27.651702 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8cc57be9-f1b1-4b14-b909-1ed2ab53a261 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:28.198315 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8cc57be9-f1b1-4b14-b909-1ed2ab53a261 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:28.226570 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8cc57be9-f1b1-4b14-b909-1ed2ab53a261 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1680 microversion: 2.1 time: 0.646226 Aug 07 01:26:28.230382 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1429/3140] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:27 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1680 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:28.253731 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d2e05487-a619-4adf-9c52-3474acb82f6d tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Calling method '.version_select at 0x7f9e29a2fdc0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:28.271230 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2e05487-a619-4adf-9c52-3474acb82f6d tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:28.272683 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2e05487-a619-4adf-9c52-3474acb82f6d tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:28.273782 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2e05487-a619-4adf-9c52-3474acb82f6d tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:28.274794 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d2e05487-a619-4adf-9c52-3474acb82f6d tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] [instance: b2ab22b8-b388-447e-85ab-7a4b6d4a466f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:28.295771 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2e05487-a619-4adf-9c52-3474acb82f6d tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:28.297448 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2e05487-a619-4adf-9c52-3474acb82f6d tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:28.298276 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2e05487-a619-4adf-9c52-3474acb82f6d tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:28.300739 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2e05487-a619-4adf-9c52-3474acb82f6d tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:28.301809 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2e05487-a619-4adf-9c52-3474acb82f6d tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:28.302985 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2e05487-a619-4adf-9c52-3474acb82f6d tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:28.365925 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8cb330fc-0c6b-4c51-8a9a-023d551fbd0e tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/63e76497-a620-45de-87be-0d947bdbb9a7" status: 200 len: 1422 microversion: 2.1 time: 19.962957 Aug 07 01:26:28.368299 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1712/3141] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:26:08 2022] GET /compute/v2.1/images/63e76497-a620-45de-87be-0d947bdbb9a7 => generated 1422 bytes in 19966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:28.372184 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2e05487-a619-4adf-9c52-3474acb82f6d tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:28.373235 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2e05487-a619-4adf-9c52-3474acb82f6d tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:28.374198 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-1e3452c5-504e-4d23-bd47-7522fd82a007 req-dbd29adf-4f06-4901-84d7-c494a1dbb37d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a78e835-73be-4ac9-bfd9-9b13009845ca", "name": "network-vif-plugged", "status": "completed", "tag": "42ae2720-0d84-474b-a284-0714e94c1948"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:28.374863 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2e05487-a619-4adf-9c52-3474acb82f6d tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:28.405001 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-d2e05487-a619-4adf-9c52-3474acb82f6d tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lazy-loading 'flavor' on Instance uuid b2ab22b8-b388-447e-85ab-7a4b6d4a466f {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:26:28.405654 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-1e3452c5-504e-4d23-bd47-7522fd82a007 req-dbd29adf-4f06-4901-84d7-c494a1dbb37d service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:28.406143 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-1e3452c5-504e-4d23-bd47-7522fd82a007 req-dbd29adf-4f06-4901-84d7-c494a1dbb37d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:28.406582 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-1e3452c5-504e-4d23-bd47-7522fd82a007 req-dbd29adf-4f06-4901-84d7-c494a1dbb37d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:28.425479 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d2e05487-a619-4adf-9c52-3474acb82f6d tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f/tags" status: 204 len: 0 microversion: 2.26 time: 0.190206 Aug 07 01:26:28.425908 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-1e3452c5-504e-4d23-bd47-7522fd82a007 req-dbd29adf-4f06-4901-84d7-c494a1dbb37d service nova] Creating event network-vif-plugged:42ae2720-0d84-474b-a284-0714e94c1948 for instance 2a78e835-73be-4ac9-bfd9-9b13009845ca on n-h1-master-1 Aug 07 01:26:28.426925 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1430/3142] 10.222.0.39 () {60 vars in 1295 bytes} [Sun Aug 7 01:26:28 2022] DELETE /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f/tags => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 01:26:28.437229 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a83b60c1-e611-4d00-a1ef-6cc16f4e957a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-324472328", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "c11d7b15-3c6f-448c-a5ea-bdfbf8bbb586"}, {"port": "4ef68384-661e-4ee2-9cb3-6b136e92c283", "tag": "port-1"}, {"port": "ddd3713f-bf35-44b3-af6e-430d7ac4d4e5", "tag": "port-2"}, {"uuid": "442067d4-ce3e-45fc-91ca-99d11089ecc9", "tag": "net-1"}, {"uuid": "442067d4-ce3e-45fc-91ca-99d11089ecc9"}, {"uuid": "5e8bb4e5-7f5c-4627-86c1-9d21ab1c776a", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "5e8bb4e5-7f5c-4627-86c1-9d21ab1c776a", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "1a31e228-4250-4551-9d7e-2360db14e870", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "93c4e61f-81aa-425a-a2e7-e04599963e5d", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "13f12255-9057-4bbf-bd01-530c832bd624", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--94684749"}], "key_name": "tempest-keypair-2116889065", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:28.444546 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-1e3452c5-504e-4d23-bd47-7522fd82a007 req-dbd29adf-4f06-4901-84d7-c494a1dbb37d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074877 Aug 07 01:26:28.446527 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1713/3143] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:26:28.460983 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ab71c7e3-d5e6-439f-81df-74fdb584c9c2 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e240d4ca0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:28.593105 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ab71c7e3-d5e6-439f-81df-74fdb584c9c2 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/63e76497-a620-45de-87be-0d947bdbb9a7" status: 200 len: 1422 microversion: 2.1 time: 0.145098 Aug 07 01:26:28.593694 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1714/3144] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:26:28 2022] GET /compute/v2.1/images/63e76497-a620-45de-87be-0d947bdbb9a7 => generated 1422 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:28.600840 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-32920c19-10e8-44fc-b320-7abed88d2b87 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Calling method '.version_select at 0x7f9e2443caf0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:28.613226 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32920c19-10e8-44fc-b320-7abed88d2b87 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:28.613714 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32920c19-10e8-44fc-b320-7abed88d2b87 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:28.614167 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32920c19-10e8-44fc-b320-7abed88d2b87 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:28.614756 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-32920c19-10e8-44fc-b320-7abed88d2b87 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] [instance: b2ab22b8-b388-447e-85ab-7a4b6d4a466f] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:28.627161 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32920c19-10e8-44fc-b320-7abed88d2b87 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:28.628981 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32920c19-10e8-44fc-b320-7abed88d2b87 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:28.629758 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32920c19-10e8-44fc-b320-7abed88d2b87 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:28.630770 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32920c19-10e8-44fc-b320-7abed88d2b87 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:28.631531 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32920c19-10e8-44fc-b320-7abed88d2b87 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:28.633085 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32920c19-10e8-44fc-b320-7abed88d2b87 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:28.693842 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32920c19-10e8-44fc-b320-7abed88d2b87 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:28.695244 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32920c19-10e8-44fc-b320-7abed88d2b87 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:28.695910 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32920c19-10e8-44fc-b320-7abed88d2b87 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:28.714016 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32920c19-10e8-44fc-b320-7abed88d2b87 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:28.715050 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32920c19-10e8-44fc-b320-7abed88d2b87 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:28.715667 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32920c19-10e8-44fc-b320-7abed88d2b87 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:28.732773 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-a83b60c1-e611-4d00-a1ef-6cc16f4e957a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] validate_networks() for [('c11d7b15-3c6f-448c-a5ea-bdfbf8bbb586', None, None, None, None, None), (None, None, '4ef68384-661e-4ee2-9cb3-6b136e92c283', None, None, None), (None, None, 'ddd3713f-bf35-44b3-af6e-430d7ac4d4e5', None, None, None), ('442067d4-ce3e-45fc-91ca-99d11089ecc9', None, None, None, None, None), ('442067d4-ce3e-45fc-91ca-99d11089ecc9', None, None, None, None, None), ('5e8bb4e5-7f5c-4627-86c1-9d21ab1c776a', '10.2.2.100', None, None, None, None), ('5e8bb4e5-7f5c-4627-86c1-9d21ab1c776a', '10.2.2.200', None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:26:28.764873 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-32920c19-10e8-44fc-b320-7abed88d2b87 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lazy-loading 'flavor' on Instance uuid b2ab22b8-b388-447e-85ab-7a4b6d4a466f {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:26:28.862156 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-32920c19-10e8-44fc-b320-7abed88d2b87 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] 10.222.0.39 "PUT /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f/tags/tempest-tag-2130655269" status: 201 len: 0 microversion: 2.26 time: 0.261189 Aug 07 01:26:28.874987 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1715/3145] 10.222.0.39 () {62 vars in 1380 bytes} [Sun Aug 7 01:26:28 2022] PUT /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f/tags/tempest-tag-2130655269 => generated 0 bytes in 278 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 07 01:26:28.883048 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0ca97c25-13c5-4190-8f44-b0ebd22bc90b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:28.883679 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0ca97c25-13c5-4190-8f44-b0ebd22bc90b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 2a78e835-73be-4ac9-bfd9-9b13009845ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:28.891778 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ca97c25-13c5-4190-8f44-b0ebd22bc90b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:28.892784 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ca97c25-13c5-4190-8f44-b0ebd22bc90b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:28.894230 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ca97c25-13c5-4190-8f44-b0ebd22bc90b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:28.895969 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ca97c25-13c5-4190-8f44-b0ebd22bc90b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:28.896801 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ca97c25-13c5-4190-8f44-b0ebd22bc90b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:28.897950 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ca97c25-13c5-4190-8f44-b0ebd22bc90b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:29.228145 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0ca97c25-13c5-4190-8f44-b0ebd22bc90b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:29.240827 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0ca97c25-13c5-4190-8f44-b0ebd22bc90b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca" status: 200 len: 1314 microversion: 2.1 time: 0.362783 Aug 07 01:26:29.255377 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1716/3146] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:28 2022] GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:29.262926 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c12fd6aa-68c7-4a0d-9cb6-d7d907e5b0c8 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e240ac0d0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:31.149127 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c12fd6aa-68c7-4a0d-9cb6-d7d907e5b0c8 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "DELETE /compute/v2.1/images/63e76497-a620-45de-87be-0d947bdbb9a7" status: 204 len: 0 microversion: 2.1 time: 1.906218 Aug 07 01:26:31.149766 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1717/3147] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:29 2022] DELETE /compute/v2.1/images/63e76497-a620-45de-87be-0d947bdbb9a7 => generated 0 bytes in 1907 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:26:31.155078 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-800a6684-4975-4077-956d-cd6f8cb472c4 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Calling method '.version_select at 0x7f9e247431f0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:31.208042 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-800a6684-4975-4077-956d-cd6f8cb472c4 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:31.225007 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-800a6684-4975-4077-956d-cd6f8cb472c4 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:31.225531 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-800a6684-4975-4077-956d-cd6f8cb472c4 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:31.228453 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-800a6684-4975-4077-956d-cd6f8cb472c4 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] [instance: b2ab22b8-b388-447e-85ab-7a4b6d4a466f] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:31.242902 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-800a6684-4975-4077-956d-cd6f8cb472c4 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:31.248820 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-800a6684-4975-4077-956d-cd6f8cb472c4 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:31.250544 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-800a6684-4975-4077-956d-cd6f8cb472c4 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:31.251336 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-800a6684-4975-4077-956d-cd6f8cb472c4 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:31.254845 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-800a6684-4975-4077-956d-cd6f8cb472c4 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:31.255656 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-800a6684-4975-4077-956d-cd6f8cb472c4 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:31.372555 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-800a6684-4975-4077-956d-cd6f8cb472c4 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:31.372940 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-800a6684-4975-4077-956d-cd6f8cb472c4 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:31.373382 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-800a6684-4975-4077-956d-cd6f8cb472c4 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:31.399680 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-800a6684-4975-4077-956d-cd6f8cb472c4 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:31.400622 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-800a6684-4975-4077-956d-cd6f8cb472c4 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:31.401717 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-800a6684-4975-4077-956d-cd6f8cb472c4 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:31.458846 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-800a6684-4975-4077-956d-cd6f8cb472c4 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lazy-loading 'flavor' on Instance uuid b2ab22b8-b388-447e-85ab-7a4b6d4a466f {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:26:31.492102 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-800a6684-4975-4077-956d-cd6f8cb472c4 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] 10.222.0.39 "PUT /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f/tags/tempest-tag-814796541" status: 201 len: 0 microversion: 2.26 time: 0.341217 Aug 07 01:26:31.508587 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1718/3148] 10.222.0.39 () {62 vars in 1377 bytes} [Sun Aug 7 01:26:31 2022] PUT /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f/tags/tempest-tag-814796541 => generated 0 bytes in 358 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 07 01:26:31.514535 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9b0cba56-c163-4853-97ad-c88768f5ddf2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:31.515563 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9b0cba56-c163-4853-97ad-c88768f5ddf2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:31.523736 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b0cba56-c163-4853-97ad-c88768f5ddf2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:31.524808 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b0cba56-c163-4853-97ad-c88768f5ddf2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:31.526051 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b0cba56-c163-4853-97ad-c88768f5ddf2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:31.527059 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b0cba56-c163-4853-97ad-c88768f5ddf2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:31.527746 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b0cba56-c163-4853-97ad-c88768f5ddf2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:31.528414 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b0cba56-c163-4853-97ad-c88768f5ddf2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:31.867829 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9b0cba56-c163-4853-97ad-c88768f5ddf2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:31.885367 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9b0cba56-c163-4853-97ad-c88768f5ddf2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1680 microversion: 2.1 time: 0.374837 Aug 07 01:26:31.888277 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1719/3149] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:31 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1680 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:31.930242 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-10ed1d51-6217-4816-9158-f32a04468a27 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:31.930970 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-10ed1d51-6217-4816-9158-f32a04468a27 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 2a78e835-73be-4ac9-bfd9-9b13009845ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:31.946176 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10ed1d51-6217-4816-9158-f32a04468a27 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:31.946861 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10ed1d51-6217-4816-9158-f32a04468a27 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:31.947324 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10ed1d51-6217-4816-9158-f32a04468a27 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:31.949931 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10ed1d51-6217-4816-9158-f32a04468a27 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:31.950439 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10ed1d51-6217-4816-9158-f32a04468a27 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:31.950870 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10ed1d51-6217-4816-9158-f32a04468a27 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:32.229026 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-10ed1d51-6217-4816-9158-f32a04468a27 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:32.240699 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-10ed1d51-6217-4816-9158-f32a04468a27 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca" status: 200 len: 1502 microversion: 2.1 time: 0.349943 Aug 07 01:26:32.242186 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1720/3150] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:31 2022] GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca => generated 1502 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:32.254006 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0ae8436f-0b33-4484-b2f6-7beb7ffe3de5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:32.255660 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0ae8436f-0b33-4484-b2f6-7beb7ffe3de5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: 77f80d2b-d1d8-4ea9-9637-f43100b95523] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:32.272725 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ae8436f-0b33-4484-b2f6-7beb7ffe3de5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:32.273340 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ae8436f-0b33-4484-b2f6-7beb7ffe3de5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:32.275126 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ae8436f-0b33-4484-b2f6-7beb7ffe3de5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:32.275764 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ae8436f-0b33-4484-b2f6-7beb7ffe3de5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:32.276900 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ae8436f-0b33-4484-b2f6-7beb7ffe3de5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:32.278527 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ae8436f-0b33-4484-b2f6-7beb7ffe3de5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:32.338411 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0ae8436f-0b33-4484-b2f6-7beb7ffe3de5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: 77f80d2b-d1d8-4ea9-9637-f43100b95523] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:26:32.513518 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0ae8436f-0b33-4484-b2f6-7beb7ffe3de5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "DELETE /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523" status: 204 len: 0 microversion: 2.1 time: 0.269186 Aug 07 01:26:32.519980 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1721/3151] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:26:32 2022] DELETE /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:26:32.543032 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2853c6c9-82f9-40b5-93c4-a31e47a2d297 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Calling method '.version_select at 0x7f9e240acd30>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:32.572362 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2853c6c9-82f9-40b5-93c4-a31e47a2d297 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:32.574661 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2853c6c9-82f9-40b5-93c4-a31e47a2d297 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:32.575457 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2853c6c9-82f9-40b5-93c4-a31e47a2d297 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:32.578962 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2853c6c9-82f9-40b5-93c4-a31e47a2d297 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] [instance: b2ab22b8-b388-447e-85ab-7a4b6d4a466f] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:32.601871 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2853c6c9-82f9-40b5-93c4-a31e47a2d297 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:32.605017 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2853c6c9-82f9-40b5-93c4-a31e47a2d297 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:32.607456 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2853c6c9-82f9-40b5-93c4-a31e47a2d297 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:32.612855 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2853c6c9-82f9-40b5-93c4-a31e47a2d297 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:32.614920 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2853c6c9-82f9-40b5-93c4-a31e47a2d297 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:32.615447 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2853c6c9-82f9-40b5-93c4-a31e47a2d297 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:32.706398 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2853c6c9-82f9-40b5-93c4-a31e47a2d297 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:32.708353 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2853c6c9-82f9-40b5-93c4-a31e47a2d297 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:32.709184 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2853c6c9-82f9-40b5-93c4-a31e47a2d297 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:32.743512 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-2853c6c9-82f9-40b5-93c4-a31e47a2d297 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lazy-loading 'flavor' on Instance uuid b2ab22b8-b388-447e-85ab-7a4b6d4a466f {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:26:32.780494 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2853c6c9-82f9-40b5-93c4-a31e47a2d297 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f/tags" status: 204 len: 0 microversion: 2.26 time: 0.258812 Aug 07 01:26:32.785659 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1722/3152] 10.222.0.39 () {60 vars in 1295 bytes} [Sun Aug 7 01:26:32 2022] DELETE /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f/tags => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 01:26:32.794970 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bb8e78a7-3d95-4a4c-9e9a-cc18f66b0a92 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-514400617", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "c0f0ce12-0e98-4e19-94e3-c911da0403cb"}, {"port": "d4a336ca-825e-45ea-b60b-7c5fc663a27f", "tag": "port-1"}, {"port": "40561cc9-b152-4881-8f63-0ed22243935d", "tag": "port-2"}, {"uuid": "2edd6fca-6541-4dd9-8e59-d9426a97b62a", "tag": "net-1"}, {"uuid": "2edd6fca-6541-4dd9-8e59-d9426a97b62a"}, {"uuid": "b1d8be7d-c213-4d74-9750-b41b5c6c701c", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "b1d8be7d-c213-4d74-9750-b41b5c6c701c", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "d622bb1c-e41e-4c36-b6af-3a99b5c49bb9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "87f83973-9733-4bf1-8ef3-eac960ba8321", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "2eb21b66-e555-4f7f-b42d-f4f12191af5a", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--826553119"}], "key_name": "tempest-keypair-1694686018", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:33.756658 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-bb8e78a7-3d95-4a4c-9e9a-cc18f66b0a92 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] validate_networks() for [('c0f0ce12-0e98-4e19-94e3-c911da0403cb', None, None, None, None, None), (None, None, 'd4a336ca-825e-45ea-b60b-7c5fc663a27f', None, None, None), (None, None, '40561cc9-b152-4881-8f63-0ed22243935d', None, None, None), ('2edd6fca-6541-4dd9-8e59-d9426a97b62a', None, None, None, None, None), ('2edd6fca-6541-4dd9-8e59-d9426a97b62a', None, None, None, None, None), ('b1d8be7d-c213-4d74-9750-b41b5c6c701c', '10.2.2.100', None, None, None, None), ('b1d8be7d-c213-4d74-9750-b41b5c6c701c', '10.2.2.200', None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:26:35.528071 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=8 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:36.105142 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-a83b60c1-e611-4d00-a1ef-6cc16f4e957a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:26:36.105678 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-a83b60c1-e611-4d00-a1ef-6cc16f4e957a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:26:36.106824 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-a83b60c1-e611-4d00-a1ef-6cc16f4e957a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:26:36.107298 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-a83b60c1-e611-4d00-a1ef-6cc16f4e957a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:26:36.107741 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-a83b60c1-e611-4d00-a1ef-6cc16f4e957a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:26:36.124133 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a83b60c1-e611-4d00-a1ef-6cc16f4e957a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:36.124899 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a83b60c1-e611-4d00-a1ef-6cc16f4e957a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:36.125542 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a83b60c1-e611-4d00-a1ef-6cc16f4e957a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:36.126462 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a83b60c1-e611-4d00-a1ef-6cc16f4e957a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:36.127820 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a83b60c1-e611-4d00-a1ef-6cc16f4e957a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:36.128459 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a83b60c1-e611-4d00-a1ef-6cc16f4e957a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:36.150385 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-a83b60c1-e611-4d00-a1ef-6cc16f4e957a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Getting quotas for project 9ecc3d5efbe54d76ae9e6ed5f7633c1d. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:26:36.158118 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-a83b60c1-e611-4d00-a1ef-6cc16f4e957a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Getting quotas for user e379b67e2bb248b3ad25b92b2082b0fe and project 9ecc3d5efbe54d76ae9e6ed5f7633c1d. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:26:36.357343 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a83b60c1-e611-4d00-a1ef-6cc16f4e957a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:26:36.360584 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a83b60c1-e611-4d00-a1ef-6cc16f4e957a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='1a31e228-4250-4551-9d7e-2360db14e870',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='93c4e61f-81aa-425a-a2e7-e04599963e5d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='13f12255-9057-4bbf-bd01-530c832bd624',volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:26:36.441320 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-bb8e78a7-3d95-4a4c-9e9a-cc18f66b0a92 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:26:36.442507 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-bb8e78a7-3d95-4a4c-9e9a-cc18f66b0a92 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:26:36.443194 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-bb8e78a7-3d95-4a4c-9e9a-cc18f66b0a92 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:26:36.443863 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-bb8e78a7-3d95-4a4c-9e9a-cc18f66b0a92 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:26:36.444527 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-bb8e78a7-3d95-4a4c-9e9a-cc18f66b0a92 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:26:36.459862 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb8e78a7-3d95-4a4c-9e9a-cc18f66b0a92 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:36.460882 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb8e78a7-3d95-4a4c-9e9a-cc18f66b0a92 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:36.461852 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb8e78a7-3d95-4a4c-9e9a-cc18f66b0a92 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:36.463004 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb8e78a7-3d95-4a4c-9e9a-cc18f66b0a92 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:36.463637 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb8e78a7-3d95-4a4c-9e9a-cc18f66b0a92 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:36.464239 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb8e78a7-3d95-4a4c-9e9a-cc18f66b0a92 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:36.494665 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-bb8e78a7-3d95-4a4c-9e9a-cc18f66b0a92 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Getting quotas for project f5f3e59419be4d2b892f498e527cb2e8. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:26:36.503831 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-bb8e78a7-3d95-4a4c-9e9a-cc18f66b0a92 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Getting quotas for user 106559a2b8754c54b1c41ba8cadd1a97 and project f5f3e59419be4d2b892f498e527cb2e8. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:26:36.773041 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bb8e78a7-3d95-4a4c-9e9a-cc18f66b0a92 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:26:36.786972 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bb8e78a7-3d95-4a4c-9e9a-cc18f66b0a92 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='d622bb1c-e41e-4c36-b6af-3a99b5c49bb9',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='87f83973-9733-4bf1-8ef3-eac960ba8321',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2eb21b66-e555-4f7f-b42d-f4f12191af5a',volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:26:36.875503 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a83b60c1-e611-4d00-a1ef-6cc16f4e957a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.32 time: 8.447077 Aug 07 01:26:36.880166 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1431/3153] 10.222.0.39 () {62 vars in 1189 bytes} [Sun Aug 7 01:26:28 2022] POST /compute/v2.1/servers => generated 404 bytes in 8453 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 07 01:26:36.898106 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3d07ccea-7771-487b-b998-6ffa13fc001c tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Calling method '.version_select at 0x7f9e29a47ca0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:36.909858 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3d07ccea-7771-487b-b998-6ffa13fc001c tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:36.910772 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3d07ccea-7771-487b-b998-6ffa13fc001c tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:36.911345 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3d07ccea-7771-487b-b998-6ffa13fc001c tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:36.923779 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3d07ccea-7771-487b-b998-6ffa13fc001c tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] 10.222.0.39 "GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f/tags" status: 200 len: 12 microversion: 2.26 time: 0.040062 Aug 07 01:26:36.925490 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1432/3154] 10.222.0.39 () {60 vars in 1292 bytes} [Sun Aug 7 01:26:36 2022] GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f/tags => generated 12 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:36.932028 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-13f5a824-de86-4920-b2b2-ea51db185457 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:36.933238 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-13f5a824-de86-4920-b2b2-ea51db185457 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:36.940571 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:36.944182 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13f5a824-de86-4920-b2b2-ea51db185457 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:36.945321 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13f5a824-de86-4920-b2b2-ea51db185457 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:36.945803 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13f5a824-de86-4920-b2b2-ea51db185457 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:36.947598 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13f5a824-de86-4920-b2b2-ea51db185457 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:36.948231 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13f5a824-de86-4920-b2b2-ea51db185457 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:36.948774 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13f5a824-de86-4920-b2b2-ea51db185457 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:37.152298 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-13f5a824-de86-4920-b2b2-ea51db185457 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:37.163638 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-13f5a824-de86-4920-b2b2-ea51db185457 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.236638 Aug 07 01:26:37.164844 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1433/3155] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:36 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:37.170938 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bc3ea299-96a3-4988-9f3d-48df03125009 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1734539800", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "aad9ba1b-e4bc-4046-88bb-e7d112e5c033"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:37.266237 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-bc3ea299-96a3-4988-9f3d-48df03125009 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] validate_networks() for [('aad9ba1b-e4bc-4046-88bb-e7d112e5c033', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:26:37.405138 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bb8e78a7-3d95-4a4c-9e9a-cc18f66b0a92 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 4.617301 Aug 07 01:26:37.406118 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1723/3156] 10.222.0.39 () {62 vars in 1189 bytes} [Sun Aug 7 01:26:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 4620 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 07 01:26:37.411354 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-df004213-cda6-4335-b2f9-5e440a4f145c req-64697a4b-b1ae-42b6-9757-ee37b1f9b2cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f80d2b-d1d8-4ea9-9637-f43100b95523", "name": "network-vif-unplugged", "status": "completed", "tag": "f7686f09-aeaf-4946-ba71-0a2620fdc9ba"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:37.427460 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-df004213-cda6-4335-b2f9-5e440a4f145c req-64697a4b-b1ae-42b6-9757-ee37b1f9b2cd service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:37.428264 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-df004213-cda6-4335-b2f9-5e440a4f145c req-64697a4b-b1ae-42b6-9757-ee37b1f9b2cd service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:37.428811 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-df004213-cda6-4335-b2f9-5e440a4f145c req-64697a4b-b1ae-42b6-9757-ee37b1f9b2cd service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:37.443469 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-df004213-cda6-4335-b2f9-5e440a4f145c req-64697a4b-b1ae-42b6-9757-ee37b1f9b2cd service nova] Creating event network-vif-unplugged:f7686f09-aeaf-4946-ba71-0a2620fdc9ba for instance 77f80d2b-d1d8-4ea9-9637-f43100b95523 on n-h1-master-1 Aug 07 01:26:37.450036 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-df004213-cda6-4335-b2f9-5e440a4f145c req-64697a4b-b1ae-42b6-9757-ee37b1f9b2cd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042559 Aug 07 01:26:37.452202 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1724/3157] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:26:37.622162 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c6ea9ae5-b73c-4d50-9563-74f3ce0b719e tempest-QuotaClassesAdmin257Test-1863139247 tempest-QuotaClassesAdmin257Test-1863139247-project-admin] Calling method '.version_select at 0x7f9e24c6c700>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:37.623238 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:26:37.623238 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:26:37.636695 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c6ea9ae5-b73c-4d50-9563-74f3ce0b719e tempest-QuotaClassesAdmin257Test-1863139247 tempest-QuotaClassesAdmin257Test-1863139247-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.182641 Aug 07 01:26:37.638720 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1725/3158] 10.222.0.39 () {60 vars in 1226 bytes} [Sun Aug 7 01:26:37 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:26:37.644406 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ad557f70-2823-42ed-a4ee-9d6de0094cf0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "563c3c9d-2175-4949-9db9-93982e0eb35d"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:37.647527 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ad557f70-2823-42ed-a4ee-9d6de0094cf0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 2a78e835-73be-4ac9-bfd9-9b13009845ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:37.655822 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ad557f70-2823-42ed-a4ee-9d6de0094cf0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:37.656605 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ad557f70-2823-42ed-a4ee-9d6de0094cf0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:37.657246 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ad557f70-2823-42ed-a4ee-9d6de0094cf0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:37.658388 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ad557f70-2823-42ed-a4ee-9d6de0094cf0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:37.659032 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ad557f70-2823-42ed-a4ee-9d6de0094cf0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:37.659660 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ad557f70-2823-42ed-a4ee-9d6de0094cf0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:37.770032 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-bc3ea299-96a3-4988-9f3d-48df03125009 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:26:37.770323 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-bc3ea299-96a3-4988-9f3d-48df03125009 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:26:37.771528 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-bc3ea299-96a3-4988-9f3d-48df03125009 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:26:37.771528 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-bc3ea299-96a3-4988-9f3d-48df03125009 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:26:37.771967 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-bc3ea299-96a3-4988-9f3d-48df03125009 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:26:37.785654 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc3ea299-96a3-4988-9f3d-48df03125009 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:37.786155 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc3ea299-96a3-4988-9f3d-48df03125009 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:37.786591 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc3ea299-96a3-4988-9f3d-48df03125009 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:37.787332 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc3ea299-96a3-4988-9f3d-48df03125009 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:37.787786 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc3ea299-96a3-4988-9f3d-48df03125009 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:37.788350 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc3ea299-96a3-4988-9f3d-48df03125009 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:37.808401 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-bc3ea299-96a3-4988-9f3d-48df03125009 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Getting quotas for project b7995a68f5a541aabda74c0b01f6aac9. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:26:37.813722 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-bc3ea299-96a3-4988-9f3d-48df03125009 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Getting quotas for user a50140f86f00487b90d0503d4819234f and project b7995a68f5a541aabda74c0b01f6aac9. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:26:37.829325 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bc3ea299-96a3-4988-9f3d-48df03125009 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:26:37.832229 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bc3ea299-96a3-4988-9f3d-48df03125009 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: f5432da5-94bc-4358-bca6-b025d2bc3186] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:26:37.883174 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bc3ea299-96a3-4988-9f3d-48df03125009 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.716984 Aug 07 01:26:37.884544 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1434/3159] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:26:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:26:37.907672 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-43da88c2-401c-4d33-845d-c80bec38c4e1 req-1824fc93-4632-40cd-8565-2b695ea6d5e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f80d2b-d1d8-4ea9-9637-f43100b95523", "name": "network-vif-deleted", "tag": "f7686f09-aeaf-4946-ba71-0a2620fdc9ba"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:37.936903 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-43da88c2-401c-4d33-845d-c80bec38c4e1 req-1824fc93-4632-40cd-8565-2b695ea6d5e3 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:37.938749 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-43da88c2-401c-4d33-845d-c80bec38c4e1 req-1824fc93-4632-40cd-8565-2b695ea6d5e3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:37.940207 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-43da88c2-401c-4d33-845d-c80bec38c4e1 req-1824fc93-4632-40cd-8565-2b695ea6d5e3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:37.954183 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-43da88c2-401c-4d33-845d-c80bec38c4e1 req-1824fc93-4632-40cd-8565-2b695ea6d5e3 service nova] Creating event network-vif-deleted:f7686f09-aeaf-4946-ba71-0a2620fdc9ba for instance 77f80d2b-d1d8-4ea9-9637-f43100b95523 on n-h1-master-1 Aug 07 01:26:37.965999 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-43da88c2-401c-4d33-845d-c80bec38c4e1 req-1824fc93-4632-40cd-8565-2b695ea6d5e3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079536 Aug 07 01:26:37.969841 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1435/3160] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:26:37.998218 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ccd7bdf8-cdee-4aca-a484-818ddc9e6315 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:37.999322 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ccd7bdf8-cdee-4aca-a484-818ddc9e6315 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:38.080843 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ccd7bdf8-cdee-4aca-a484-818ddc9e6315 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:38.102054 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ccd7bdf8-cdee-4aca-a484-818ddc9e6315 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:38.107843 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ccd7bdf8-cdee-4aca-a484-818ddc9e6315 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:38.109103 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ccd7bdf8-cdee-4aca-a484-818ddc9e6315 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1285 microversion: 2.32 time: 0.137880 Aug 07 01:26:38.112144 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1436/3161] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:26:37 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:26:38.125508 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ad557f70-2823-42ed-a4ee-9d6de0094cf0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "POST /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.485243 Aug 07 01:26:38.126519 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1726/3162] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Aug 7 01:26:37 2022] POST /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca/os-volume_attachments => generated 194 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:26:38.128096 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fd8e396b-6f6f-4dd6-944b-42ce70f152df tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Calling method '.version_select at 0x7f9e29a1b700>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:38.135742 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1c754146-19bd-468e-9931-0967f0e60cce tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:38.140620 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1c754146-19bd-468e-9931-0967f0e60cce tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:38.148432 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd8e396b-6f6f-4dd6-944b-42ce70f152df tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:38.148927 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd8e396b-6f6f-4dd6-944b-42ce70f152df tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:38.149371 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd8e396b-6f6f-4dd6-944b-42ce70f152df tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:38.149865 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fd8e396b-6f6f-4dd6-944b-42ce70f152df tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] [instance: b2ab22b8-b388-447e-85ab-7a4b6d4a466f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:38.157854 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c754146-19bd-468e-9931-0967f0e60cce tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:38.159132 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c754146-19bd-468e-9931-0967f0e60cce tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:38.159586 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c754146-19bd-468e-9931-0967f0e60cce tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:38.160355 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c754146-19bd-468e-9931-0967f0e60cce tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:38.160816 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c754146-19bd-468e-9931-0967f0e60cce tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:38.161250 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c754146-19bd-468e-9931-0967f0e60cce tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:38.168673 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd8e396b-6f6f-4dd6-944b-42ce70f152df tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:38.169170 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd8e396b-6f6f-4dd6-944b-42ce70f152df tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:38.170943 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd8e396b-6f6f-4dd6-944b-42ce70f152df tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:38.171664 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd8e396b-6f6f-4dd6-944b-42ce70f152df tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:38.172227 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd8e396b-6f6f-4dd6-944b-42ce70f152df tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:38.172664 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd8e396b-6f6f-4dd6-944b-42ce70f152df tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:38.202343 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=4,nova_cell1:RELEASE=2,nova_cell1:UPDATE=3,nova_cell1:DELETE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:38.226364 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd8e396b-6f6f-4dd6-944b-42ce70f152df tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:38.226868 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd8e396b-6f6f-4dd6-944b-42ce70f152df tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:38.227317 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd8e396b-6f6f-4dd6-944b-42ce70f152df tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:38.267113 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-fd8e396b-6f6f-4dd6-944b-42ce70f152df tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lazy-loading 'flavor' on Instance uuid b2ab22b8-b388-447e-85ab-7a4b6d4a466f {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:26:38.309915 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fd8e396b-6f6f-4dd6-944b-42ce70f152df tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f/tags" status: 204 len: 0 microversion: 2.26 time: 0.196199 Aug 07 01:26:38.313845 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1437/3163] 10.222.0.39 () {60 vars in 1295 bytes} [Sun Aug 7 01:26:38 2022] DELETE /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f/tags => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 01:26:38.334668 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8e4cd7de-a06b-4aca-80ff-b3cd640f6cd5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:38.336779 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8e4cd7de-a06b-4aca-80ff-b3cd640f6cd5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:38.463582 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1c754146-19bd-468e-9931-0967f0e60cce tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:38.465831 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8e4cd7de-a06b-4aca-80ff-b3cd640f6cd5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:38.474046 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1c754146-19bd-468e-9931-0967f0e60cce tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.346126 Aug 07 01:26:38.476497 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8e4cd7de-a06b-4aca-80ff-b3cd640f6cd5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:38.478061 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1727/3164] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:38 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:38.484370 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8e4cd7de-a06b-4aca-80ff-b3cd640f6cd5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:38.485588 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8e4cd7de-a06b-4aca-80ff-b3cd640f6cd5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1285 microversion: 2.42 time: 0.168756 Aug 07 01:26:38.486149 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1438/3165] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:26:38 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1285 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:26:38.492432 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f14de0b2-760e-4039-ae26-074839a46d8d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:38.492836 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-78a1fa1b-cdbf-4667-8f31-333ce488f594 tempest-QuotaClassesAdmin257Test-1863139247 tempest-QuotaClassesAdmin257Test-1863139247-project-admin] Action: 'update', calling method: .version_select at 0x7f9e24729a60>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:38.494750 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f14de0b2-760e-4039-ae26-074839a46d8d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: f5432da5-94bc-4358-bca6-b025d2bc3186] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:38.505323 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:26:38.505323 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:26:38.648000 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f14de0b2-760e-4039-ae26-074839a46d8d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:38.659788 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f14de0b2-760e-4039-ae26-074839a46d8d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186" status: 200 len: 1208 microversion: 2.1 time: 0.172284 Aug 07 01:26:38.668476 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1439/3166] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:38 2022] GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186 => generated 1208 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:38.678204 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ea952b30-b862-444c-86b0-3024d2c81cee tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Calling method '.version_select at 0x7f9e29a478b0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:38.720281 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ea952b30-b862-444c-86b0-3024d2c81cee tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:38.721301 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ea952b30-b862-444c-86b0-3024d2c81cee tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:38.723250 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ea952b30-b862-444c-86b0-3024d2c81cee tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:38.724024 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ea952b30-b862-444c-86b0-3024d2c81cee tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] [instance: b2ab22b8-b388-447e-85ab-7a4b6d4a466f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:38.738534 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ea952b30-b862-444c-86b0-3024d2c81cee tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:38.739010 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ea952b30-b862-444c-86b0-3024d2c81cee tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:38.739444 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ea952b30-b862-444c-86b0-3024d2c81cee tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:38.743918 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ea952b30-b862-444c-86b0-3024d2c81cee tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:38.744681 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ea952b30-b862-444c-86b0-3024d2c81cee tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:38.749284 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ea952b30-b862-444c-86b0-3024d2c81cee tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:38.796083 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-78a1fa1b-cdbf-4667-8f31-333ce488f594 tempest-QuotaClassesAdmin257Test-1863139247 tempest-QuotaClassesAdmin257Test-1863139247-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.314296 Aug 07 01:26:38.796765 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1728/3167] 10.222.0.39 () {62 vars in 1247 bytes} [Sun Aug 7 01:26:38 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:26:38.806347 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ea952b30-b862-444c-86b0-3024d2c81cee tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:38.807299 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ea952b30-b862-444c-86b0-3024d2c81cee tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:38.808642 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ea952b30-b862-444c-86b0-3024d2c81cee tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:38.817910 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e3d2ebb8-0132-40c6-ac7a-70acfb47519f tempest-QuotaClassesAdmin257Test-1863139247 tempest-QuotaClassesAdmin257Test-1863139247-project-admin] Calling method '.version_select at 0x7f9e2443c8b0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:38.820314 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:26:38.820314 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:26:38.833833 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ea952b30-b862-444c-86b0-3024d2c81cee tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:38.836160 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ea952b30-b862-444c-86b0-3024d2c81cee tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:38.836791 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ea952b30-b862-444c-86b0-3024d2c81cee tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:38.846851 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e3d2ebb8-0132-40c6-ac7a-70acfb47519f tempest-QuotaClassesAdmin257Test-1863139247 tempest-QuotaClassesAdmin257Test-1863139247-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.034356 Aug 07 01:26:38.850704 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1729/3168] 10.222.0.39 () {60 vars in 1226 bytes} [Sun Aug 7 01:26:38 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:26:38.864655 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2024263a-5ad9-451a-bffb-fbad1df665ff tempest-QuotaClassesAdmin257Test-1863139247 tempest-QuotaClassesAdmin257Test-1863139247-project-admin] Action: 'update', calling method: .version_select at 0x7f9e2408f550>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:38.900650 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-ea952b30-b862-444c-86b0-3024d2c81cee tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lazy-loading 'flavor' on Instance uuid b2ab22b8-b388-447e-85ab-7a4b6d4a466f {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:26:38.942954 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ea952b30-b862-444c-86b0-3024d2c81cee tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] 10.222.0.39 "PUT /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f/tags/tempest-tag-2112764949" status: 201 len: 0 microversion: 2.26 time: 0.269058 Aug 07 01:26:38.944059 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1440/3169] 10.222.0.39 () {62 vars in 1380 bytes} [Sun Aug 7 01:26:38 2022] PUT /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f/tags/tempest-tag-2112764949 => generated 0 bytes in 274 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 07 01:26:38.958852 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-432011d5-632b-4c27-8de8-4537dc995721 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Calling method '.version_select at 0x7f9e29a50b80>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:38.983370 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-432011d5-632b-4c27-8de8-4537dc995721 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:38.989115 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-432011d5-632b-4c27-8de8-4537dc995721 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:38.990032 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-432011d5-632b-4c27-8de8-4537dc995721 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:38.991573 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-432011d5-632b-4c27-8de8-4537dc995721 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] [instance: b2ab22b8-b388-447e-85ab-7a4b6d4a466f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:39.010250 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-432011d5-632b-4c27-8de8-4537dc995721 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:39.011104 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-432011d5-632b-4c27-8de8-4537dc995721 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:39.011822 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-432011d5-632b-4c27-8de8-4537dc995721 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:39.016120 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-432011d5-632b-4c27-8de8-4537dc995721 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:39.016663 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-432011d5-632b-4c27-8de8-4537dc995721 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:39.017117 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-432011d5-632b-4c27-8de8-4537dc995721 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:39.029727 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2024263a-5ad9-451a-bffb-fbad1df665ff tempest-QuotaClassesAdmin257Test-1863139247 tempest-QuotaClassesAdmin257Test-1863139247-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.167306 Aug 07 01:26:39.030669 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1730/3170] 10.222.0.39 () {62 vars in 1247 bytes} [Sun Aug 7 01:26:38 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 01:26:39.067013 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-432011d5-632b-4c27-8de8-4537dc995721 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:39.067508 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-432011d5-632b-4c27-8de8-4537dc995721 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:39.071343 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-432011d5-632b-4c27-8de8-4537dc995721 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:39.108376 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-432011d5-632b-4c27-8de8-4537dc995721 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:39.109238 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-432011d5-632b-4c27-8de8-4537dc995721 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:39.109844 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-432011d5-632b-4c27-8de8-4537dc995721 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:39.136707 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-593863a0-6d8b-478d-8095-46c097fd3958 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:39.137595 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-593863a0-6d8b-478d-8095-46c097fd3958 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:39.155978 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-593863a0-6d8b-478d-8095-46c097fd3958 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:39.157115 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-593863a0-6d8b-478d-8095-46c097fd3958 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:39.157855 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-593863a0-6d8b-478d-8095-46c097fd3958 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:39.159011 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-593863a0-6d8b-478d-8095-46c097fd3958 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:39.159765 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-593863a0-6d8b-478d-8095-46c097fd3958 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:39.160564 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-593863a0-6d8b-478d-8095-46c097fd3958 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:39.163715 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-432011d5-632b-4c27-8de8-4537dc995721 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lazy-loading 'flavor' on Instance uuid b2ab22b8-b388-447e-85ab-7a4b6d4a466f {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:26:39.199523 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-432011d5-632b-4c27-8de8-4537dc995721 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] 10.222.0.39 "PUT /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f/tags/tempest-tag-683449951" status: 201 len: 0 microversion: 2.26 time: 0.247756 Aug 07 01:26:39.205755 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1441/3171] 10.222.0.39 () {62 vars in 1377 bytes} [Sun Aug 7 01:26:38 2022] PUT /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f/tags/tempest-tag-683449951 => generated 0 bytes in 254 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 07 01:26:39.212947 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-84073e5f-2167-44a7-8762-8b2e1ed51b06 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Action: 'update_all', calling method: .version_select at 0x7f9e29a1b280>, body: {"tags": ["tempest-tag-13513473", "tempest-tag-1414223341"]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:39.223081 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-84073e5f-2167-44a7-8762-8b2e1ed51b06 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:39.223834 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-84073e5f-2167-44a7-8762-8b2e1ed51b06 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:39.224463 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-84073e5f-2167-44a7-8762-8b2e1ed51b06 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:39.225119 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-84073e5f-2167-44a7-8762-8b2e1ed51b06 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] [instance: b2ab22b8-b388-447e-85ab-7a4b6d4a466f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:39.233147 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-84073e5f-2167-44a7-8762-8b2e1ed51b06 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:39.233924 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-84073e5f-2167-44a7-8762-8b2e1ed51b06 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:39.245079 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-84073e5f-2167-44a7-8762-8b2e1ed51b06 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:39.249190 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-84073e5f-2167-44a7-8762-8b2e1ed51b06 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:39.250030 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-84073e5f-2167-44a7-8762-8b2e1ed51b06 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:39.250686 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-84073e5f-2167-44a7-8762-8b2e1ed51b06 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:39.296729 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-593863a0-6d8b-478d-8095-46c097fd3958 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:39.301358 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-84073e5f-2167-44a7-8762-8b2e1ed51b06 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:39.302063 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-84073e5f-2167-44a7-8762-8b2e1ed51b06 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:39.302794 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-84073e5f-2167-44a7-8762-8b2e1ed51b06 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:39.313944 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-593863a0-6d8b-478d-8095-46c097fd3958 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:39.317841 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-593863a0-6d8b-478d-8095-46c097fd3958 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:39.341861 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-593863a0-6d8b-478d-8095-46c097fd3958 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1519 microversion: 2.32 time: 0.209283 Aug 07 01:26:39.345289 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1731/3172] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:26:39 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1519 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:26:39.367161 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-84073e5f-2167-44a7-8762-8b2e1ed51b06 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lazy-loading 'flavor' on Instance uuid b2ab22b8-b388-447e-85ab-7a4b6d4a466f {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:26:39.396061 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-84073e5f-2167-44a7-8762-8b2e1ed51b06 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] 10.222.0.39 "PUT /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f/tags" status: 200 len: 60 microversion: 2.26 time: 0.188680 Aug 07 01:26:39.402439 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1442/3173] 10.222.0.39 () {62 vars in 1312 bytes} [Sun Aug 7 01:26:39 2022] PUT /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f/tags => generated 60 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:39.410935 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f008f5e8-88a2-4d88-b366-1770168f5cdf tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Calling method '.version_select at 0x7f9e240ac940>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:39.421969 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f008f5e8-88a2-4d88-b366-1770168f5cdf tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:39.422688 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f008f5e8-88a2-4d88-b366-1770168f5cdf tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:39.423407 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f008f5e8-88a2-4d88-b366-1770168f5cdf tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:39.435289 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f008f5e8-88a2-4d88-b366-1770168f5cdf tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] 10.222.0.39 "GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f/tags" status: 200 len: 60 microversion: 2.26 time: 0.030107 Aug 07 01:26:39.436211 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1732/3174] 10.222.0.39 () {60 vars in 1292 bytes} [Sun Aug 7 01:26:39 2022] GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f/tags => generated 60 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:39.453503 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-321afc5a-b438-4f31-aa92-a22d04a82510 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Calling method '.version_select at 0x7f9e29a473a0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:39.468522 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-4dd04020-0578-4c79-bf90-d49d63b64293 req-3827f204-a94c-4830-9695-dc22441c63cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e39f0d23-55ab-417b-818e-92de14de44c0", "name": "network-vif-unplugged", "status": "completed", "tag": "04267581-58b6-42a6-92a4-4f79278a63aa"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:39.474853 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-321afc5a-b438-4f31-aa92-a22d04a82510 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:39.475331 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-321afc5a-b438-4f31-aa92-a22d04a82510 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:39.475840 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-321afc5a-b438-4f31-aa92-a22d04a82510 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:39.476488 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-321afc5a-b438-4f31-aa92-a22d04a82510 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] [instance: b2ab22b8-b388-447e-85ab-7a4b6d4a466f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:39.481254 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=15,nova_api:INSERT=5 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:39.483600 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4dd04020-0578-4c79-bf90-d49d63b64293 req-3827f204-a94c-4830-9695-dc22441c63cd service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:39.484530 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4dd04020-0578-4c79-bf90-d49d63b64293 req-3827f204-a94c-4830-9695-dc22441c63cd service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:39.485204 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4dd04020-0578-4c79-bf90-d49d63b64293 req-3827f204-a94c-4830-9695-dc22441c63cd service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:39.497896 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-321afc5a-b438-4f31-aa92-a22d04a82510 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:39.502878 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-321afc5a-b438-4f31-aa92-a22d04a82510 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:39.503423 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-321afc5a-b438-4f31-aa92-a22d04a82510 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:39.504304 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-321afc5a-b438-4f31-aa92-a22d04a82510 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:39.504862 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-321afc5a-b438-4f31-aa92-a22d04a82510 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:39.505479 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-321afc5a-b438-4f31-aa92-a22d04a82510 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:39.506544 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-4dd04020-0578-4c79-bf90-d49d63b64293 req-3827f204-a94c-4830-9695-dc22441c63cd service nova] Creating event network-vif-unplugged:04267581-58b6-42a6-92a4-4f79278a63aa for instance e39f0d23-55ab-417b-818e-92de14de44c0 on n-h2-master-1 Aug 07 01:26:39.526331 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-4dd04020-0578-4c79-bf90-d49d63b64293 req-3827f204-a94c-4830-9695-dc22441c63cd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062278 Aug 07 01:26:39.526951 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1733/3175] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:26:39.545843 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-aeb35df2-b854-47a0-a0a4-d0466e090eb7 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:39.547147 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-aeb35df2-b854-47a0-a0a4-d0466e090eb7 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:39.562435 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aeb35df2-b854-47a0-a0a4-d0466e090eb7 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:39.563171 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aeb35df2-b854-47a0-a0a4-d0466e090eb7 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:39.563803 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aeb35df2-b854-47a0-a0a4-d0466e090eb7 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:39.564781 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aeb35df2-b854-47a0-a0a4-d0466e090eb7 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:39.565428 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aeb35df2-b854-47a0-a0a4-d0466e090eb7 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:39.566024 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aeb35df2-b854-47a0-a0a4-d0466e090eb7 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:39.575908 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-321afc5a-b438-4f31-aa92-a22d04a82510 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:39.576800 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-321afc5a-b438-4f31-aa92-a22d04a82510 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:39.578185 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-321afc5a-b438-4f31-aa92-a22d04a82510 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:39.605126 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-321afc5a-b438-4f31-aa92-a22d04a82510 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lazy-loading 'flavor' on Instance uuid b2ab22b8-b388-447e-85ab-7a4b6d4a466f {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:26:39.633635 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-321afc5a-b438-4f31-aa92-a22d04a82510 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f/tags" status: 204 len: 0 microversion: 2.26 time: 0.188229 Aug 07 01:26:39.639222 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1443/3176] 10.222.0.39 () {60 vars in 1295 bytes} [Sun Aug 7 01:26:39 2022] DELETE /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f/tags => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 01:26:39.648054 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b4a74953-508b-4bdf-87aa-1526f63f5abb tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:39.649034 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b4a74953-508b-4bdf-87aa-1526f63f5abb tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] [instance: b2ab22b8-b388-447e-85ab-7a4b6d4a466f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:39.649876 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-aeb35df2-b854-47a0-a0a4-d0466e090eb7 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:39.660591 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-aeb35df2-b854-47a0-a0a4-d0466e090eb7 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:39.662128 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-aeb35df2-b854-47a0-a0a4-d0466e090eb7 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:39.663402 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-aeb35df2-b854-47a0-a0a4-d0466e090eb7 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1519 microversion: 2.42 time: 0.125309 Aug 07 01:26:39.668668 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1734/3177] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:26:39 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1519 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:26:39.669428 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b4a74953-508b-4bdf-87aa-1526f63f5abb tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:39.670595 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b4a74953-508b-4bdf-87aa-1526f63f5abb tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:39.671044 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b4a74953-508b-4bdf-87aa-1526f63f5abb tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:39.672756 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b4a74953-508b-4bdf-87aa-1526f63f5abb tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:39.673414 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b4a74953-508b-4bdf-87aa-1526f63f5abb tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:39.674447 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b4a74953-508b-4bdf-87aa-1526f63f5abb tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:39.689918 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-96e157a9-2711-4cc0-9796-33d8f7ef6624 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:39.690605 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-96e157a9-2711-4cc0-9796-33d8f7ef6624 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: f5432da5-94bc-4358-bca6-b025d2bc3186] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:39.708022 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-96e157a9-2711-4cc0-9796-33d8f7ef6624 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:39.713077 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-96e157a9-2711-4cc0-9796-33d8f7ef6624 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:39.713833 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-96e157a9-2711-4cc0-9796-33d8f7ef6624 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:39.717196 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-96e157a9-2711-4cc0-9796-33d8f7ef6624 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:39.718218 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-96e157a9-2711-4cc0-9796-33d8f7ef6624 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:39.720421 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-96e157a9-2711-4cc0-9796-33d8f7ef6624 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:39.738980 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b4a74953-508b-4bdf-87aa-1526f63f5abb tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] [instance: b2ab22b8-b388-447e-85ab-7a4b6d4a466f] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:26:39.759717 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=89,nova_cell1:DELETE=4,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:39.847662 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-96e157a9-2711-4cc0-9796-33d8f7ef6624 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:39.865650 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-96e157a9-2711-4cc0-9796-33d8f7ef6624 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186" status: 200 len: 1260 microversion: 2.1 time: 0.179866 Aug 07 01:26:39.874258 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1735/3178] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:39 2022] GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186 => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:26:39.936673 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b4a74953-508b-4bdf-87aa-1526f63f5abb tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f" status: 204 len: 0 microversion: 2.26 time: 0.295154 Aug 07 01:26:39.937696 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1444/3179] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Aug 7 01:26:39 2022] DELETE /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 01:26:39.947345 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-472a7d03-952a-4378-be5e-6c08f108a3a2 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:39.948897 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-472a7d03-952a-4378-be5e-6c08f108a3a2 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] [instance: b2ab22b8-b388-447e-85ab-7a4b6d4a466f] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:39.960528 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-472a7d03-952a-4378-be5e-6c08f108a3a2 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:39.963556 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-472a7d03-952a-4378-be5e-6c08f108a3a2 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:39.976978 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-472a7d03-952a-4378-be5e-6c08f108a3a2 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:39.980458 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-472a7d03-952a-4378-be5e-6c08f108a3a2 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:39.980458 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-472a7d03-952a-4378-be5e-6c08f108a3a2 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:39.986777 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-472a7d03-952a-4378-be5e-6c08f108a3a2 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:40.369585 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-472a7d03-952a-4378-be5e-6c08f108a3a2 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:40.373477 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4c71b5fb-17e3-4d47-b1d6-717e5153390b tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:40.374199 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4c71b5fb-17e3-4d47-b1d6-717e5153390b tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:40.384506 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4c71b5fb-17e3-4d47-b1d6-717e5153390b tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:40.385396 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4c71b5fb-17e3-4d47-b1d6-717e5153390b tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:40.386035 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4c71b5fb-17e3-4d47-b1d6-717e5153390b tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:40.387161 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4c71b5fb-17e3-4d47-b1d6-717e5153390b tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:40.387790 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4c71b5fb-17e3-4d47-b1d6-717e5153390b tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:40.388565 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4c71b5fb-17e3-4d47-b1d6-717e5153390b tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:40.397599 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-472a7d03-952a-4378-be5e-6c08f108a3a2 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:40.415242 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-472a7d03-952a-4378-be5e-6c08f108a3a2 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:40.425552 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-472a7d03-952a-4378-be5e-6c08f108a3a2 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] 10.222.0.39 "GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f" status: 200 len: 1551 microversion: 2.26 time: 0.476149 Aug 07 01:26:40.428085 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1736/3180] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:26:39 2022] GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f => generated 1551 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:26:40.546015 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4c71b5fb-17e3-4d47-b1d6-717e5153390b tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:40.570452 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4c71b5fb-17e3-4d47-b1d6-717e5153390b tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:40.572694 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4c71b5fb-17e3-4d47-b1d6-717e5153390b tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:40.574461 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4c71b5fb-17e3-4d47-b1d6-717e5153390b tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1593 microversion: 2.32 time: 0.205529 Aug 07 01:26:40.576799 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1445/3181] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:26:40 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1593 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:26:40.697638 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-08160f29-d58a-4ee3-9374-477d83da23ed tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:40.698267 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-08160f29-d58a-4ee3-9374-477d83da23ed tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:40.729490 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08160f29-d58a-4ee3-9374-477d83da23ed tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:40.730465 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08160f29-d58a-4ee3-9374-477d83da23ed tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:40.731360 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08160f29-d58a-4ee3-9374-477d83da23ed tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:40.732658 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08160f29-d58a-4ee3-9374-477d83da23ed tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:40.733448 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08160f29-d58a-4ee3-9374-477d83da23ed tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:40.734239 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08160f29-d58a-4ee3-9374-477d83da23ed tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:40.895793 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c30a94cc-c489-4d22-8c8a-79aaa407556f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:40.905280 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c30a94cc-c489-4d22-8c8a-79aaa407556f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: f5432da5-94bc-4358-bca6-b025d2bc3186] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:40.934253 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c30a94cc-c489-4d22-8c8a-79aaa407556f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:40.938153 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c30a94cc-c489-4d22-8c8a-79aaa407556f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:40.941408 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c30a94cc-c489-4d22-8c8a-79aaa407556f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:40.948299 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c30a94cc-c489-4d22-8c8a-79aaa407556f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:40.949367 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c30a94cc-c489-4d22-8c8a-79aaa407556f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:40.950539 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c30a94cc-c489-4d22-8c8a-79aaa407556f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:41.170434 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-08160f29-d58a-4ee3-9374-477d83da23ed tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:41.219120 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-08160f29-d58a-4ee3-9374-477d83da23ed tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:41.228302 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-08160f29-d58a-4ee3-9374-477d83da23ed tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:41.230940 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-08160f29-d58a-4ee3-9374-477d83da23ed tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1575 microversion: 2.42 time: 0.537820 Aug 07 01:26:41.234425 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1737/3182] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:26:40 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1575 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:26:41.243000 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1bff842e-1aa3-4c26-993a-35baeebc3601 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:41.244420 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1bff842e-1aa3-4c26-993a-35baeebc3601 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:41.255683 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1bff842e-1aa3-4c26-993a-35baeebc3601 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:41.256839 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1bff842e-1aa3-4c26-993a-35baeebc3601 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:41.257509 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1bff842e-1aa3-4c26-993a-35baeebc3601 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:41.258714 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1bff842e-1aa3-4c26-993a-35baeebc3601 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:41.259403 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1bff842e-1aa3-4c26-993a-35baeebc3601 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:41.260115 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1bff842e-1aa3-4c26-993a-35baeebc3601 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:41.348790 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c30a94cc-c489-4d22-8c8a-79aaa407556f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:41.356878 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c30a94cc-c489-4d22-8c8a-79aaa407556f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186" status: 200 len: 1266 microversion: 2.1 time: 0.465774 Aug 07 01:26:41.357460 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1446/3183] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:40 2022] GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186 => generated 1266 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:26:41.454321 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-aeb9ae2a-436e-4ad3-a527-5f2c44cd617f tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:41.455913 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-aeb9ae2a-436e-4ad3-a527-5f2c44cd617f tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] [instance: b2ab22b8-b388-447e-85ab-7a4b6d4a466f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:41.485436 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aeb9ae2a-436e-4ad3-a527-5f2c44cd617f tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:41.488349 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aeb9ae2a-436e-4ad3-a527-5f2c44cd617f tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:41.488952 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aeb9ae2a-436e-4ad3-a527-5f2c44cd617f tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:41.490744 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aeb9ae2a-436e-4ad3-a527-5f2c44cd617f tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:41.492745 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aeb9ae2a-436e-4ad3-a527-5f2c44cd617f tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:41.498898 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aeb9ae2a-436e-4ad3-a527-5f2c44cd617f tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:41.577973 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1bff842e-1aa3-4c26-993a-35baeebc3601 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:41.592748 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1bff842e-1aa3-4c26-993a-35baeebc3601 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.355534 Aug 07 01:26:41.608903 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1738/3184] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:41 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:41.617319 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e5950613-d936-4d94-ad1f-ee2719b476a9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:41.618196 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e5950613-d936-4d94-ad1f-ee2719b476a9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:41.625202 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5950613-d936-4d94-ad1f-ee2719b476a9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:41.625950 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5950613-d936-4d94-ad1f-ee2719b476a9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:41.626591 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5950613-d936-4d94-ad1f-ee2719b476a9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:41.628334 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5950613-d936-4d94-ad1f-ee2719b476a9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:41.629252 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5950613-d936-4d94-ad1f-ee2719b476a9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:41.629884 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5950613-d936-4d94-ad1f-ee2719b476a9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:41.779504 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e5950613-d936-4d94-ad1f-ee2719b476a9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:41.818524 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e5950613-d936-4d94-ad1f-ee2719b476a9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:41.831120 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e5950613-d936-4d94-ad1f-ee2719b476a9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:41.834216 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e5950613-d936-4d94-ad1f-ee2719b476a9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1593 microversion: 2.32 time: 0.223758 Aug 07 01:26:41.838438 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1739/3185] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:26:41 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1593 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:26:41.874589 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ebe3e6de-69d7-44a3-9cca-c39e3a960a41 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:41.884871 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ebe3e6de-69d7-44a3-9cca-c39e3a960a41 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:41.904493 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ebe3e6de-69d7-44a3-9cca-c39e3a960a41 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:41.905457 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ebe3e6de-69d7-44a3-9cca-c39e3a960a41 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:41.906109 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ebe3e6de-69d7-44a3-9cca-c39e3a960a41 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:41.916329 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ebe3e6de-69d7-44a3-9cca-c39e3a960a41 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:41.917154 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ebe3e6de-69d7-44a3-9cca-c39e3a960a41 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:41.917803 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ebe3e6de-69d7-44a3-9cca-c39e3a960a41 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:42.215259 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ebe3e6de-69d7-44a3-9cca-c39e3a960a41 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:42.234382 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ebe3e6de-69d7-44a3-9cca-c39e3a960a41 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.393022 Aug 07 01:26:42.234907 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1740/3186] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:41 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:42.261188 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-601c00ce-fa1d-4f96-b87d-ac233df4c69d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:42.261817 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-601c00ce-fa1d-4f96-b87d-ac233df4c69d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:42.279544 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-601c00ce-fa1d-4f96-b87d-ac233df4c69d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:42.280072 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-601c00ce-fa1d-4f96-b87d-ac233df4c69d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:42.280959 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-601c00ce-fa1d-4f96-b87d-ac233df4c69d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:42.281884 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-601c00ce-fa1d-4f96-b87d-ac233df4c69d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:42.282505 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-601c00ce-fa1d-4f96-b87d-ac233df4c69d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:42.283654 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-601c00ce-fa1d-4f96-b87d-ac233df4c69d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:42.512836 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-aeb9ae2a-436e-4ad3-a527-5f2c44cd617f tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:42.534381 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-aeb9ae2a-436e-4ad3-a527-5f2c44cd617f tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:42.537635 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-aeb9ae2a-436e-4ad3-a527-5f2c44cd617f tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:42.540416 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-aeb9ae2a-436e-4ad3-a527-5f2c44cd617f tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] 10.222.0.39 "GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f" status: 200 len: 1551 microversion: 2.26 time: 1.089958 Aug 07 01:26:42.542919 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1447/3187] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:26:41 2022] GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f => generated 1551 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:26:42.555533 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-899c50ee-a358-480a-a43d-dff9eca05696 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:42.557739 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-899c50ee-a358-480a-a43d-dff9eca05696 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:42.566826 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-899c50ee-a358-480a-a43d-dff9eca05696 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:42.567618 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-899c50ee-a358-480a-a43d-dff9eca05696 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:42.568704 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-899c50ee-a358-480a-a43d-dff9eca05696 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:42.569663 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-899c50ee-a358-480a-a43d-dff9eca05696 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:42.570356 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-899c50ee-a358-480a-a43d-dff9eca05696 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:42.571130 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-899c50ee-a358-480a-a43d-dff9eca05696 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:42.767072 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-899c50ee-a358-480a-a43d-dff9eca05696 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:42.778536 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-899c50ee-a358-480a-a43d-dff9eca05696 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:42.781336 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-899c50ee-a358-480a-a43d-dff9eca05696 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:42.783683 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-899c50ee-a358-480a-a43d-dff9eca05696 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1593 microversion: 2.42 time: 0.238882 Aug 07 01:26:42.784648 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1448/3188] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:26:42 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1593 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:26:42.790008 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f88785c9-1ae0-48e1-aa76-e8d8809e964b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:42.791371 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f88785c9-1ae0-48e1-aa76-e8d8809e964b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: f5432da5-94bc-4358-bca6-b025d2bc3186] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:42.810431 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f88785c9-1ae0-48e1-aa76-e8d8809e964b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:42.812625 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f88785c9-1ae0-48e1-aa76-e8d8809e964b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:42.813341 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f88785c9-1ae0-48e1-aa76-e8d8809e964b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:42.815022 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f88785c9-1ae0-48e1-aa76-e8d8809e964b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:42.815837 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f88785c9-1ae0-48e1-aa76-e8d8809e964b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:42.816515 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f88785c9-1ae0-48e1-aa76-e8d8809e964b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:43.116919 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-601c00ce-fa1d-4f96-b87d-ac233df4c69d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:43.129313 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-601c00ce-fa1d-4f96-b87d-ac233df4c69d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.871985 Aug 07 01:26:43.148986 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1741/3189] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:42 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:43.156786 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0ba02386-d911-4ba1-8416-5b83eca9b2c2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:43.157424 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0ba02386-d911-4ba1-8416-5b83eca9b2c2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:43.172752 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ba02386-d911-4ba1-8416-5b83eca9b2c2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:43.174206 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ba02386-d911-4ba1-8416-5b83eca9b2c2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:43.174832 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ba02386-d911-4ba1-8416-5b83eca9b2c2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:43.175754 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ba02386-d911-4ba1-8416-5b83eca9b2c2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:43.176419 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ba02386-d911-4ba1-8416-5b83eca9b2c2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:43.177009 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ba02386-d911-4ba1-8416-5b83eca9b2c2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:43.414119 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0ba02386-d911-4ba1-8416-5b83eca9b2c2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:43.430660 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0ba02386-d911-4ba1-8416-5b83eca9b2c2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:43.435652 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0ba02386-d911-4ba1-8416-5b83eca9b2c2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:43.436945 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0ba02386-d911-4ba1-8416-5b83eca9b2c2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1593 microversion: 2.32 time: 0.286844 Aug 07 01:26:43.445522 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1742/3190] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:26:43 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1593 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:26:43.453390 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bce310b2-ab66-4e6d-8067-098dbd89487b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:43.467498 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bce310b2-ab66-4e6d-8067-098dbd89487b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:43.475577 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bce310b2-ab66-4e6d-8067-098dbd89487b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:43.476645 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bce310b2-ab66-4e6d-8067-098dbd89487b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:43.477330 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bce310b2-ab66-4e6d-8067-098dbd89487b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:43.481591 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bce310b2-ab66-4e6d-8067-098dbd89487b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:43.482405 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bce310b2-ab66-4e6d-8067-098dbd89487b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:43.483568 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bce310b2-ab66-4e6d-8067-098dbd89487b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:43.643096 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bce310b2-ab66-4e6d-8067-098dbd89487b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action" status: 202 len: 0 microversion: 2.1 time: 0.195241 Aug 07 01:26:43.644105 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1743/3191] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:26:43 2022] POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:26:43.655164 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0bf568da-1fb9-4655-8e68-2ab6bed82d10 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:43.656166 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0bf568da-1fb9-4655-8e68-2ab6bed82d10 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] [instance: b2ab22b8-b388-447e-85ab-7a4b6d4a466f] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:43.668686 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0bf568da-1fb9-4655-8e68-2ab6bed82d10 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:43.670281 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0bf568da-1fb9-4655-8e68-2ab6bed82d10 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:43.670893 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0bf568da-1fb9-4655-8e68-2ab6bed82d10 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:43.672211 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0bf568da-1fb9-4655-8e68-2ab6bed82d10 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:43.672829 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0bf568da-1fb9-4655-8e68-2ab6bed82d10 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:43.674363 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0bf568da-1fb9-4655-8e68-2ab6bed82d10 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:43.789744 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f88785c9-1ae0-48e1-aa76-e8d8809e964b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:43.800016 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f88785c9-1ae0-48e1-aa76-e8d8809e964b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186" status: 200 len: 1308 microversion: 2.1 time: 1.013801 Aug 07 01:26:43.805099 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1449/3192] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:42 2022] GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186 => generated 1308 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:43.816496 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1b034298-1451-4870-b5e6-c88aed7da246 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:43.824921 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1b034298-1451-4870-b5e6-c88aed7da246 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:43.833503 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b034298-1451-4870-b5e6-c88aed7da246 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:43.842219 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b034298-1451-4870-b5e6-c88aed7da246 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:43.843071 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b034298-1451-4870-b5e6-c88aed7da246 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:43.844522 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b034298-1451-4870-b5e6-c88aed7da246 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:43.845515 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b034298-1451-4870-b5e6-c88aed7da246 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:43.846237 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b034298-1451-4870-b5e6-c88aed7da246 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:44.258187 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0bf568da-1fb9-4655-8e68-2ab6bed82d10 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:44.273318 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0bf568da-1fb9-4655-8e68-2ab6bed82d10 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:44.279274 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0bf568da-1fb9-4655-8e68-2ab6bed82d10 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:44.280705 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0bf568da-1fb9-4655-8e68-2ab6bed82d10 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] 10.222.0.39 "GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f" status: 200 len: 1551 microversion: 2.26 time: 0.632011 Aug 07 01:26:44.281305 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1744/3193] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:26:43 2022] GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f => generated 1551 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:26:44.295101 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-597f2040-a831-43b6-9b5e-b609dd0a309a tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:44.296005 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-597f2040-a831-43b6-9b5e-b609dd0a309a tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:44.308387 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-597f2040-a831-43b6-9b5e-b609dd0a309a tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:44.308905 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-597f2040-a831-43b6-9b5e-b609dd0a309a tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:44.310014 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-597f2040-a831-43b6-9b5e-b609dd0a309a tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:44.310906 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-597f2040-a831-43b6-9b5e-b609dd0a309a tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:44.311391 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-597f2040-a831-43b6-9b5e-b609dd0a309a tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:44.311999 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-597f2040-a831-43b6-9b5e-b609dd0a309a tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:44.580813 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1b034298-1451-4870-b5e6-c88aed7da246 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:44.591692 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1b034298-1451-4870-b5e6-c88aed7da246 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1669 microversion: 2.1 time: 0.784570 Aug 07 01:26:44.593937 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1450/3194] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:43 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1669 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:44.600936 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-755b2cc0-9562-40c4-84ce-f2b981cd98fc tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:44.601789 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-755b2cc0-9562-40c4-84ce-f2b981cd98fc tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:44.608462 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-755b2cc0-9562-40c4-84ce-f2b981cd98fc tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:44.609194 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-755b2cc0-9562-40c4-84ce-f2b981cd98fc tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:44.609818 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-755b2cc0-9562-40c4-84ce-f2b981cd98fc tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:44.610776 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-755b2cc0-9562-40c4-84ce-f2b981cd98fc tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:44.611542 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-755b2cc0-9562-40c4-84ce-f2b981cd98fc tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:44.612409 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-755b2cc0-9562-40c4-84ce-f2b981cd98fc tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:44.948447 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-597f2040-a831-43b6-9b5e-b609dd0a309a tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:44.998988 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-597f2040-a831-43b6-9b5e-b609dd0a309a tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:45.010091 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-597f2040-a831-43b6-9b5e-b609dd0a309a tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:45.011319 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-597f2040-a831-43b6-9b5e-b609dd0a309a tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1660 microversion: 2.42 time: 0.729000 Aug 07 01:26:45.033299 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1745/3195] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:26:44 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1660 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:26:45.038904 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1d722e36-786c-47ef-9155-b446a8c29768 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:45.039544 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1d722e36-786c-47ef-9155-b446a8c29768 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: f5432da5-94bc-4358-bca6-b025d2bc3186] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:45.062375 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d722e36-786c-47ef-9155-b446a8c29768 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:45.090853 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d722e36-786c-47ef-9155-b446a8c29768 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:45.093238 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d722e36-786c-47ef-9155-b446a8c29768 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:45.100892 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d722e36-786c-47ef-9155-b446a8c29768 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:45.102036 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d722e36-786c-47ef-9155-b446a8c29768 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:45.102502 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d722e36-786c-47ef-9155-b446a8c29768 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:45.503515 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-755b2cc0-9562-40c4-84ce-f2b981cd98fc tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:45.529604 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-755b2cc0-9562-40c4-84ce-f2b981cd98fc tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:45.531522 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-755b2cc0-9562-40c4-84ce-f2b981cd98fc tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:45.533893 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-755b2cc0-9562-40c4-84ce-f2b981cd98fc tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1659 microversion: 2.32 time: 0.938226 Aug 07 01:26:45.540023 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1451/3196] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:26:44 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1659 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:26:45.553625 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-72d0cdef-721c-4d7a-8518-7a9862432751 req-aa04fc2e-e80c-4447-851b-29c8f3264a85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2ab22b8-b388-447e-85ab-7a4b6d4a466f", "name": "network-vif-deleted", "tag": "c47e3688-e367-4a1e-b221-a82250dd507e"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:45.585947 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-72d0cdef-721c-4d7a-8518-7a9862432751 req-aa04fc2e-e80c-4447-851b-29c8f3264a85 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:45.589236 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-72d0cdef-721c-4d7a-8518-7a9862432751 req-aa04fc2e-e80c-4447-851b-29c8f3264a85 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:45.591129 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-72d0cdef-721c-4d7a-8518-7a9862432751 req-aa04fc2e-e80c-4447-851b-29c8f3264a85 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:45.608526 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-72d0cdef-721c-4d7a-8518-7a9862432751 req-aa04fc2e-e80c-4447-851b-29c8f3264a85 service nova] Creating event network-vif-deleted:c47e3688-e367-4a1e-b221-a82250dd507e for instance b2ab22b8-b388-447e-85ab-7a4b6d4a466f on n-h2-master-1 Aug 07 01:26:45.616207 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-72d0cdef-721c-4d7a-8518-7a9862432751 req-aa04fc2e-e80c-4447-851b-29c8f3264a85 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073782 Aug 07 01:26:45.617371 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1452/3197] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:26:45.624666 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2175c03c-b474-454c-b7cd-51d15bb87c22 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:45.625828 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2175c03c-b474-454c-b7cd-51d15bb87c22 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] [instance: b2ab22b8-b388-447e-85ab-7a4b6d4a466f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:45.634423 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2175c03c-b474-454c-b7cd-51d15bb87c22 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:45.635252 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2175c03c-b474-454c-b7cd-51d15bb87c22 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:45.635860 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2175c03c-b474-454c-b7cd-51d15bb87c22 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:45.637009 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2175c03c-b474-454c-b7cd-51d15bb87c22 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:45.638627 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2175c03c-b474-454c-b7cd-51d15bb87c22 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:45.639203 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2175c03c-b474-454c-b7cd-51d15bb87c22 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:45.689727 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2175c03c-b474-454c-b7cd-51d15bb87c22 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:45.690560 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2175c03c-b474-454c-b7cd-51d15bb87c22 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:45.691614 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2175c03c-b474-454c-b7cd-51d15bb87c22 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:45.692298 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-2175c03c-b474-454c-b7cd-51d15bb87c22 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lazy-loading 'fault' on Instance uuid b2ab22b8-b388-447e-85ab-7a4b6d4a466f {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:26:46.083338 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2175c03c-b474-454c-b7cd-51d15bb87c22 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:46.095216 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2175c03c-b474-454c-b7cd-51d15bb87c22 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:46.103503 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2175c03c-b474-454c-b7cd-51d15bb87c22 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a43de829b91441797cabd51581ad38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6826f9d4a91245a3982795ce6022141f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:46.104150 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2175c03c-b474-454c-b7cd-51d15bb87c22 tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] 10.222.0.39 "GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f" status: 200 len: 1351 microversion: 2.26 time: 0.485493 Aug 07 01:26:46.108538 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1453/3198] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:26:45 2022] GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f => generated 1351 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:26:46.116810 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-24abf878-3634-43b8-9d16-05acfce470ff tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:46.118106 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-24abf878-3634-43b8-9d16-05acfce470ff tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:46.126156 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-24abf878-3634-43b8-9d16-05acfce470ff tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:46.127672 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-24abf878-3634-43b8-9d16-05acfce470ff tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:46.128620 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-24abf878-3634-43b8-9d16-05acfce470ff tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:46.130101 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-24abf878-3634-43b8-9d16-05acfce470ff tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:46.130871 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-24abf878-3634-43b8-9d16-05acfce470ff tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:46.131610 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-24abf878-3634-43b8-9d16-05acfce470ff tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:46.168962 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1d722e36-786c-47ef-9155-b446a8c29768 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:46.182190 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1d722e36-786c-47ef-9155-b446a8c29768 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186" status: 200 len: 1308 microversion: 2.1 time: 1.147180 Aug 07 01:26:46.183058 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1746/3199] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:45 2022] GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186 => generated 1308 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:46.196444 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-735e5cf8-aa64-40b6-a6c0-62e7cd9be020 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:46.197367 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-735e5cf8-aa64-40b6-a6c0-62e7cd9be020 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:46.211088 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-735e5cf8-aa64-40b6-a6c0-62e7cd9be020 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:46.212043 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-735e5cf8-aa64-40b6-a6c0-62e7cd9be020 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:46.212655 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-735e5cf8-aa64-40b6-a6c0-62e7cd9be020 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:46.213542 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-735e5cf8-aa64-40b6-a6c0-62e7cd9be020 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:46.214002 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-735e5cf8-aa64-40b6-a6c0-62e7cd9be020 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:46.214430 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-735e5cf8-aa64-40b6-a6c0-62e7cd9be020 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:46.275525 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:46.477162 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:46.906018 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-735e5cf8-aa64-40b6-a6c0-62e7cd9be020 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:46.916480 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-24abf878-3634-43b8-9d16-05acfce470ff tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:46.917523 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-735e5cf8-aa64-40b6-a6c0-62e7cd9be020 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:46.919036 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-735e5cf8-aa64-40b6-a6c0-62e7cd9be020 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:46.921680 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-735e5cf8-aa64-40b6-a6c0-62e7cd9be020 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1706 microversion: 2.42 time: 0.737474 Aug 07 01:26:46.930136 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1747/3200] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:26:46 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1706 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:26:46.936646 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2e8188e0-0b19-4fd3-bcdb-9c39d34e2e95 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:46.940842 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2e8188e0-0b19-4fd3-bcdb-9c39d34e2e95 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:46.957217 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2e8188e0-0b19-4fd3-bcdb-9c39d34e2e95 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:46.959308 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2e8188e0-0b19-4fd3-bcdb-9c39d34e2e95 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:46.960958 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2e8188e0-0b19-4fd3-bcdb-9c39d34e2e95 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:46.962570 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2e8188e0-0b19-4fd3-bcdb-9c39d34e2e95 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:46.964663 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2e8188e0-0b19-4fd3-bcdb-9c39d34e2e95 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:46.966315 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2e8188e0-0b19-4fd3-bcdb-9c39d34e2e95 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:46.974867 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-24abf878-3634-43b8-9d16-05acfce470ff tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1669 microversion: 2.1 time: 0.864399 Aug 07 01:26:46.993115 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1454/3201] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:46 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1669 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:47.377629 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c2fd1c16-eccb-41c8-847a-7e8ec84a3584 tempest-SecurityGroupsTestAdminJSON-396502944 tempest-SecurityGroupsTestAdminJSON-396502944-project] Action: 'create', calling method: .version_select at 0x7f9e17e39af0>, body: {"security_group": {"name": "tempest-securitygroup-520759027", "description": "tempest-description-1807698272"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:47.545906 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2e8188e0-0b19-4fd3-bcdb-9c39d34e2e95 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:47.574633 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2e8188e0-0b19-4fd3-bcdb-9c39d34e2e95 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:47.577803 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2e8188e0-0b19-4fd3-bcdb-9c39d34e2e95 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:47.582867 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2e8188e0-0b19-4fd3-bcdb-9c39d34e2e95 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1659 microversion: 2.32 time: 0.649741 Aug 07 01:26:47.591262 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1748/3202] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:26:46 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1659 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:26:47.603147 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5ec6d77b-c811-4e0a-be65-b2fe52e8b0cb tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:47.604314 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5ec6d77b-c811-4e0a-be65-b2fe52e8b0cb tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] [instance: b2ab22b8-b388-447e-85ab-7a4b6d4a466f] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:47.614531 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5ec6d77b-c811-4e0a-be65-b2fe52e8b0cb tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:47.615631 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5ec6d77b-c811-4e0a-be65-b2fe52e8b0cb tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:47.616555 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5ec6d77b-c811-4e0a-be65-b2fe52e8b0cb tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:47.617940 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5ec6d77b-c811-4e0a-be65-b2fe52e8b0cb tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:47.618910 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5ec6d77b-c811-4e0a-be65-b2fe52e8b0cb tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:47.619822 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5ec6d77b-c811-4e0a-be65-b2fe52e8b0cb tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:47.653993 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-5ec6d77b-c811-4e0a-be65-b2fe52e8b0cb tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] HTTP exception thrown: Instance b2ab22b8-b388-447e-85ab-7a4b6d4a466f could not be found. Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5ec6d77b-c811-4e0a-be65-b2fe52e8b0cb tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Request method failure captured: Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f HTTP/1.1 Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xSYGf5YsTMenlfDD95iidAaZhMS86sTDMfBJJcMU9PlItUel9cAioE1nvv1lxhs5-laErbpNAE6G70kKosEAkqJNPb43qmalz78nxQ-AYHGo7gGWnHjixF-DGWpjyig6SpiLogjcobez_eSGDjTrUi20UidMI5spILx6zQLWGfcAXw Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: X-Openstack-Nova-Api-Version: 2.26 Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 6826f9d4a91245a3982795ce6022141f Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServerTagsTestJSON-2039147314 Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6826f9d4a91245a3982795ce6022141f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6826f9d4a91245a3982795ce6022141f", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6826f9d4a91245a3982795ce6022141f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6826f9d4a91245a3982795ce6022141f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServerTagsTestJSON-2039147314 Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 6826f9d4a91245a3982795ce6022141f Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServerTagsTestJSON-2039147314 Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServerTagsTestJSON-2039147314-project Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 2a43de829b91441797cabd51581ad38a Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServerTagsTestJSON-2039147314-project Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: exception: Instance b2ab22b8-b388-447e-85ab-7a4b6d4a466f could not be found. Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'b2ab22b8-b388-447e-85ab-7a4b6d4a466f'} Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2ab22b8-b388-447e-85ab-7a4b6d4a466f could not be found. Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2ab22b8-b388-447e-85ab-7a4b6d4a466f could not be found. Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:26:47.655749 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:26:47.665160 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:26:47.665160 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:26:47.665160 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:26:47.665160 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:26:47.665160 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:26:47.665160 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2ab22b8-b388-447e-85ab-7a4b6d4a466f could not be found. Aug 07 01:26:47.665160 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:26:47.665160 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5ec6d77b-c811-4e0a-be65-b2fe52e8b0cb tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] Returning 404 to user: Instance b2ab22b8-b388-447e-85ab-7a4b6d4a466f could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:26:47.665160 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5ec6d77b-c811-4e0a-be65-b2fe52e8b0cb tempest-ServerTagsTestJSON-2039147314 tempest-ServerTagsTestJSON-2039147314-project] 10.222.0.39 "GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f" status: 404 len: 111 microversion: 2.26 time: 0.064313 Aug 07 01:26:47.665160 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1749/3203] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:26:47 2022] GET /compute/v2.1/servers/b2ab22b8-b388-447e-85ab-7a4b6d4a466f => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:26:47.665160 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-de504f1c-dbe4-4bfb-b4a3-803a39b383be tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:47.666088 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-de504f1c-dbe4-4bfb-b4a3-803a39b383be tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: f5432da5-94bc-4358-bca6-b025d2bc3186] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:47.674474 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-de504f1c-dbe4-4bfb-b4a3-803a39b383be tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:47.674888 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-de504f1c-dbe4-4bfb-b4a3-803a39b383be tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:47.675329 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-de504f1c-dbe4-4bfb-b4a3-803a39b383be tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:47.676238 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-de504f1c-dbe4-4bfb-b4a3-803a39b383be tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:47.676998 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-de504f1c-dbe4-4bfb-b4a3-803a39b383be tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:47.677436 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-de504f1c-dbe4-4bfb-b4a3-803a39b383be tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:47.799144 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=4 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:48.075112 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-de504f1c-dbe4-4bfb-b4a3-803a39b383be tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:48.101020 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-de504f1c-dbe4-4bfb-b4a3-803a39b383be tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186" status: 200 len: 1308 microversion: 2.1 time: 0.439889 Aug 07 01:26:48.110530 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1750/3204] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:47 2022] GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186 => generated 1308 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:48.118153 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-1a36c5d8-b2ab-4ffe-bb59-626fdf0d5e01 req-8ead70ca-bf57-4351-8fff-0b3fa3be40e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5432da5-94bc-4358-bca6-b025d2bc3186", "tag": "4e7534f9-e07f-4f04-a90d-f11e0ff193e2"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:48.138565 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-1a36c5d8-b2ab-4ffe-bb59-626fdf0d5e01 req-8ead70ca-bf57-4351-8fff-0b3fa3be40e4 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:48.139052 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-1a36c5d8-b2ab-4ffe-bb59-626fdf0d5e01 req-8ead70ca-bf57-4351-8fff-0b3fa3be40e4 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:48.139496 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-1a36c5d8-b2ab-4ffe-bb59-626fdf0d5e01 req-8ead70ca-bf57-4351-8fff-0b3fa3be40e4 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:48.155722 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-1a36c5d8-b2ab-4ffe-bb59-626fdf0d5e01 req-8ead70ca-bf57-4351-8fff-0b3fa3be40e4 service nova] Creating event network-changed:4e7534f9-e07f-4f04-a90d-f11e0ff193e2 for instance f5432da5-94bc-4358-bca6-b025d2bc3186 on n-h1-master-1 Aug 07 01:26:48.165914 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-1a36c5d8-b2ab-4ffe-bb59-626fdf0d5e01 req-8ead70ca-bf57-4351-8fff-0b3fa3be40e4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062973 Aug 07 01:26:48.166522 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1751/3205] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:26:48.176501 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-32ff2c2f-2207-493a-bdab-9f9de101e5f2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:48.179021 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-32ff2c2f-2207-493a-bdab-9f9de101e5f2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:48.190640 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32ff2c2f-2207-493a-bdab-9f9de101e5f2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:48.191150 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32ff2c2f-2207-493a-bdab-9f9de101e5f2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:48.191858 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32ff2c2f-2207-493a-bdab-9f9de101e5f2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:48.192887 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32ff2c2f-2207-493a-bdab-9f9de101e5f2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:48.193703 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32ff2c2f-2207-493a-bdab-9f9de101e5f2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:48.194707 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32ff2c2f-2207-493a-bdab-9f9de101e5f2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:48.495716 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-32ff2c2f-2207-493a-bdab-9f9de101e5f2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:48.517214 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-32ff2c2f-2207-493a-bdab-9f9de101e5f2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:48.519652 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-32ff2c2f-2207-493a-bdab-9f9de101e5f2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:48.521195 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-32ff2c2f-2207-493a-bdab-9f9de101e5f2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1752 microversion: 2.42 time: 0.353298 Aug 07 01:26:48.522981 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1752/3206] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:26:48 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1752 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:26:48.535743 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-11ff020e-27dd-4a7f-a2a0-32f833ed32a8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:48.543726 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-11ff020e-27dd-4a7f-a2a0-32f833ed32a8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:48.555244 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-11ff020e-27dd-4a7f-a2a0-32f833ed32a8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:48.557082 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-11ff020e-27dd-4a7f-a2a0-32f833ed32a8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:48.560575 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-11ff020e-27dd-4a7f-a2a0-32f833ed32a8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:48.561709 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-11ff020e-27dd-4a7f-a2a0-32f833ed32a8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:48.562415 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-11ff020e-27dd-4a7f-a2a0-32f833ed32a8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:48.563080 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-11ff020e-27dd-4a7f-a2a0-32f833ed32a8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:48.623230 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c2fd1c16-eccb-41c8-847a-7e8ec84a3584 tempest-SecurityGroupsTestAdminJSON-396502944 tempest-SecurityGroupsTestAdminJSON-396502944-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.609074 Aug 07 01:26:48.624156 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1455/3207] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Aug 7 01:26:47 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:26:48.631544 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f0022250-8f2e-46c9-8d2a-0d5b0dd70857 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:48.633294 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f0022250-8f2e-46c9-8d2a-0d5b0dd70857 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:48.649931 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f0022250-8f2e-46c9-8d2a-0d5b0dd70857 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:48.651277 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f0022250-8f2e-46c9-8d2a-0d5b0dd70857 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:48.651914 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f0022250-8f2e-46c9-8d2a-0d5b0dd70857 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:48.652854 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f0022250-8f2e-46c9-8d2a-0d5b0dd70857 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:48.653490 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f0022250-8f2e-46c9-8d2a-0d5b0dd70857 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:48.654100 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f0022250-8f2e-46c9-8d2a-0d5b0dd70857 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:48.654738 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=18 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:48.836468 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f0022250-8f2e-46c9-8d2a-0d5b0dd70857 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:48.867155 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f0022250-8f2e-46c9-8d2a-0d5b0dd70857 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:48.874294 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f0022250-8f2e-46c9-8d2a-0d5b0dd70857 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:48.875818 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f0022250-8f2e-46c9-8d2a-0d5b0dd70857 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1704 microversion: 2.32 time: 0.250552 Aug 07 01:26:48.878039 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1456/3208] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:26:48 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1704 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:26:48.883068 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-86d4aa28-abde-4348-9ae0-1796f71a9375 tempest-SecurityGroupsTestAdminJSON-396502944 tempest-SecurityGroupsTestAdminJSON-396502944-project] Action: 'create', calling method: .version_select at 0x7f9e29951280>, body: {"security_group": {"name": "tempest-securitygroup-23395667", "description": "tempest-description-368557788"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:49.017267 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=20,nova_cell0:UPDATE=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:49.043556 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-11ff020e-27dd-4a7f-a2a0-32f833ed32a8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:49.060731 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-11ff020e-27dd-4a7f-a2a0-32f833ed32a8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.530468 Aug 07 01:26:49.064928 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1753/3209] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:48 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:49.072441 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-86d4aa28-abde-4348-9ae0-1796f71a9375 tempest-SecurityGroupsTestAdminJSON-396502944 tempest-SecurityGroupsTestAdminJSON-396502944-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 218 microversion: 2.1 time: 0.190131 Aug 07 01:26:49.072441 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1457/3210] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Aug 7 01:26:48 2022] POST /compute/v2.1/os-security-groups => generated 218 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:26:49.138497 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9d5472c2-60f1-4e83-a298-1d8d2807c726 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:49.151537 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9d5472c2-60f1-4e83-a298-1d8d2807c726 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:49.175320 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d5472c2-60f1-4e83-a298-1d8d2807c726 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:49.175835 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d5472c2-60f1-4e83-a298-1d8d2807c726 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:49.185257 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d5472c2-60f1-4e83-a298-1d8d2807c726 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:49.187295 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d5472c2-60f1-4e83-a298-1d8d2807c726 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:49.205420 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d5472c2-60f1-4e83-a298-1d8d2807c726 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:49.206074 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d5472c2-60f1-4e83-a298-1d8d2807c726 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:49.307145 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9d5472c2-60f1-4e83-a298-1d8d2807c726 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action" status: 200 len: 322 microversion: 2.1 time: 0.201014 Aug 07 01:26:49.308083 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1754/3211] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:26:49 2022] POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action => generated 322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:26:49.314329 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-10093937-68d5-4e27-8518-7ab0cdabe54f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:49.315054 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-10093937-68d5-4e27-8518-7ab0cdabe54f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: f5432da5-94bc-4358-bca6-b025d2bc3186] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:49.337379 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10093937-68d5-4e27-8518-7ab0cdabe54f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:49.339534 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10093937-68d5-4e27-8518-7ab0cdabe54f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:49.340284 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10093937-68d5-4e27-8518-7ab0cdabe54f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:49.341342 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10093937-68d5-4e27-8518-7ab0cdabe54f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:49.344781 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10093937-68d5-4e27-8518-7ab0cdabe54f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:49.346688 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10093937-68d5-4e27-8518-7ab0cdabe54f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:49.672878 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d20bfb01-a8d1-4ca8-b19d-a3aa3a7d1d94 tempest-SecurityGroupsTestAdminJSON-2050294989 tempest-SecurityGroupsTestAdminJSON-2050294989-project-admin] Action: 'create', calling method: .version_select at 0x7f9e29a3db80>, body: {"security_group": {"name": "tempest-securitygroup-1947557335", "description": "tempest-description-361631687"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:49.986235 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-10093937-68d5-4e27-8518-7ab0cdabe54f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:50.001197 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-10093937-68d5-4e27-8518-7ab0cdabe54f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186" status: 200 len: 1308 microversion: 2.1 time: 0.691787 Aug 07 01:26:50.004352 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1755/3212] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:49 2022] GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186 => generated 1308 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:50.010499 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-59f9706a-7211-48a4-99e3-8172cf41c322 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:50.011534 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-59f9706a-7211-48a4-99e3-8172cf41c322 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:50.020504 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-59f9706a-7211-48a4-99e3-8172cf41c322 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:50.021721 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-59f9706a-7211-48a4-99e3-8172cf41c322 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:50.024926 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-59f9706a-7211-48a4-99e3-8172cf41c322 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:50.026856 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-59f9706a-7211-48a4-99e3-8172cf41c322 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:50.027833 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-59f9706a-7211-48a4-99e3-8172cf41c322 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:50.028639 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-59f9706a-7211-48a4-99e3-8172cf41c322 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:50.646271 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d20bfb01-a8d1-4ca8-b19d-a3aa3a7d1d94 tempest-SecurityGroupsTestAdminJSON-2050294989 tempest-SecurityGroupsTestAdminJSON-2050294989-project-admin] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.551745 Aug 07 01:26:50.648009 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1458/3213] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Aug 7 01:26:49 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:26:50.654086 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1c201851-ae80-4580-b664-0d1b5a8db492 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:50.656400 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1c201851-ae80-4580-b664-0d1b5a8db492 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:50.666790 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c201851-ae80-4580-b664-0d1b5a8db492 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:50.669056 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c201851-ae80-4580-b664-0d1b5a8db492 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:50.669801 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c201851-ae80-4580-b664-0d1b5a8db492 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:50.671408 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c201851-ae80-4580-b664-0d1b5a8db492 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:50.672226 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c201851-ae80-4580-b664-0d1b5a8db492 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:50.673079 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c201851-ae80-4580-b664-0d1b5a8db492 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:50.862155 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-59f9706a-7211-48a4-99e3-8172cf41c322 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:50.873371 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-59f9706a-7211-48a4-99e3-8172cf41c322 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.865240 Aug 07 01:26:50.874075 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1756/3214] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:50 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:50.896932 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8db79713-d37d-48d6-8fe9-3ff16252dff9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:50.898822 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8db79713-d37d-48d6-8fe9-3ff16252dff9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:50.908497 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8db79713-d37d-48d6-8fe9-3ff16252dff9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:50.909252 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8db79713-d37d-48d6-8fe9-3ff16252dff9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:50.910456 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8db79713-d37d-48d6-8fe9-3ff16252dff9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:50.911928 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8db79713-d37d-48d6-8fe9-3ff16252dff9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:50.912723 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8db79713-d37d-48d6-8fe9-3ff16252dff9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:50.913315 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8db79713-d37d-48d6-8fe9-3ff16252dff9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:51.204002 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1c201851-ae80-4580-b664-0d1b5a8db492 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:51.218922 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1c201851-ae80-4580-b664-0d1b5a8db492 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:51.223277 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1c201851-ae80-4580-b664-0d1b5a8db492 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:51.229102 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1c201851-ae80-4580-b664-0d1b5a8db492 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1752 microversion: 2.42 time: 0.576990 Aug 07 01:26:51.231773 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1459/3215] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:26:50 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1752 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:26:51.243781 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fca09ee7-8c0d-4774-a588-6235903a1ccd tempest-SecurityGroupsTestAdminJSON-2050294989 tempest-SecurityGroupsTestAdminJSON-2050294989-project-admin] Action: 'create', calling method: .version_select at 0x7f9e29a3d9d0>, body: {"security_group": {"name": "tempest-securitygroup-1931500175", "description": "tempest-description-2103850591"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:51.710453 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fca09ee7-8c0d-4774-a588-6235903a1ccd tempest-SecurityGroupsTestAdminJSON-2050294989 tempest-SecurityGroupsTestAdminJSON-2050294989-project-admin] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.477105 Aug 07 01:26:51.712194 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1460/3216] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Aug 7 01:26:51 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:26:51.717422 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-575e3f53-8c2f-4314-b609-3ee8cfba1d70 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:51.718904 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-575e3f53-8c2f-4314-b609-3ee8cfba1d70 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:51.736838 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-575e3f53-8c2f-4314-b609-3ee8cfba1d70 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:51.737648 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-575e3f53-8c2f-4314-b609-3ee8cfba1d70 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:51.738965 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-575e3f53-8c2f-4314-b609-3ee8cfba1d70 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:51.740231 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-575e3f53-8c2f-4314-b609-3ee8cfba1d70 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:51.740892 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-575e3f53-8c2f-4314-b609-3ee8cfba1d70 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:51.741496 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-575e3f53-8c2f-4314-b609-3ee8cfba1d70 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:51.975924 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8db79713-d37d-48d6-8fe9-3ff16252dff9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:51.986198 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8db79713-d37d-48d6-8fe9-3ff16252dff9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:51.998000 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8db79713-d37d-48d6-8fe9-3ff16252dff9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:51.999290 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8db79713-d37d-48d6-8fe9-3ff16252dff9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1749 microversion: 2.32 time: 1.106897 Aug 07 01:26:52.000069 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1757/3217] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:26:50 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1749 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:26:52.017402 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-932bba39-6e4e-49d2-b13b-d2ef175a4712 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:52.018315 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-932bba39-6e4e-49d2-b13b-d2ef175a4712 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: f5432da5-94bc-4358-bca6-b025d2bc3186] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:52.025987 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-932bba39-6e4e-49d2-b13b-d2ef175a4712 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:52.026888 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-932bba39-6e4e-49d2-b13b-d2ef175a4712 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:52.027636 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-932bba39-6e4e-49d2-b13b-d2ef175a4712 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:52.029470 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-932bba39-6e4e-49d2-b13b-d2ef175a4712 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:52.030099 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-932bba39-6e4e-49d2-b13b-d2ef175a4712 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:52.030892 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-932bba39-6e4e-49d2-b13b-d2ef175a4712 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:52.044917 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-575e3f53-8c2f-4314-b609-3ee8cfba1d70 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:52.055625 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-575e3f53-8c2f-4314-b609-3ee8cfba1d70 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.342007 Aug 07 01:26:52.069286 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1461/3218] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:51 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:52.080499 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a28efffc-b37d-479a-9784-70652f35a249 tempest-SecurityGroupsTestAdminJSON-2050294989 tempest-SecurityGroupsTestAdminJSON-2050294989-project-admin] Calling method '.version_select at 0x7f9e24da4b80>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:52.503108 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-932bba39-6e4e-49d2-b13b-d2ef175a4712 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:52.516358 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-932bba39-6e4e-49d2-b13b-d2ef175a4712 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186" status: 200 len: 1308 microversion: 2.1 time: 0.514170 Aug 07 01:26:52.517896 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1758/3219] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:52 2022] GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186 => generated 1308 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:52.526192 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7c4c060e-a7d2-43a8-8f20-776fde31e336 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:52.526616 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7c4c060e-a7d2-43a8-8f20-776fde31e336 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:52.548043 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7c4c060e-a7d2-43a8-8f20-776fde31e336 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:52.549090 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7c4c060e-a7d2-43a8-8f20-776fde31e336 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:52.550232 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7c4c060e-a7d2-43a8-8f20-776fde31e336 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:52.551847 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7c4c060e-a7d2-43a8-8f20-776fde31e336 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:52.552978 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7c4c060e-a7d2-43a8-8f20-776fde31e336 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:52.554016 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7c4c060e-a7d2-43a8-8f20-776fde31e336 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:53.256412 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7c4c060e-a7d2-43a8-8f20-776fde31e336 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:53.268558 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7c4c060e-a7d2-43a8-8f20-776fde31e336 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.749310 Aug 07 01:26:53.289151 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1759/3220] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:52 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:53.302932 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bc5e9f24-63d7-4fca-a8ea-5e7b2305f19b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:53.303928 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bc5e9f24-63d7-4fca-a8ea-5e7b2305f19b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:53.319936 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bc5e9f24-63d7-4fca-a8ea-5e7b2305f19b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:53.320971 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bc5e9f24-63d7-4fca-a8ea-5e7b2305f19b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:53.321423 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bc5e9f24-63d7-4fca-a8ea-5e7b2305f19b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:53.322176 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bc5e9f24-63d7-4fca-a8ea-5e7b2305f19b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:53.322604 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bc5e9f24-63d7-4fca-a8ea-5e7b2305f19b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:53.323034 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bc5e9f24-63d7-4fca-a8ea-5e7b2305f19b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:54.026623 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bc5e9f24-63d7-4fca-a8ea-5e7b2305f19b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:54.042718 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bc5e9f24-63d7-4fca-a8ea-5e7b2305f19b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:54.045963 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bc5e9f24-63d7-4fca-a8ea-5e7b2305f19b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:54.053091 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bc5e9f24-63d7-4fca-a8ea-5e7b2305f19b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1798 microversion: 2.42 time: 0.760361 Aug 07 01:26:54.056033 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1760/3221] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:26:53 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1798 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:26:54.073269 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9b64362d-4b89-4498-82ff-65506a003551 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:54.074156 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9b64362d-4b89-4498-82ff-65506a003551 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:54.090974 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b64362d-4b89-4498-82ff-65506a003551 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:54.091520 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b64362d-4b89-4498-82ff-65506a003551 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:54.092432 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b64362d-4b89-4498-82ff-65506a003551 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:54.095458 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b64362d-4b89-4498-82ff-65506a003551 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:54.097310 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b64362d-4b89-4498-82ff-65506a003551 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:54.099537 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b64362d-4b89-4498-82ff-65506a003551 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:54.939846 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9b64362d-4b89-4498-82ff-65506a003551 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:54.959335 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9b64362d-4b89-4498-82ff-65506a003551 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:54.965401 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9b64362d-4b89-4498-82ff-65506a003551 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:54.966758 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9b64362d-4b89-4498-82ff-65506a003551 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1839 microversion: 2.32 time: 0.908635 Aug 07 01:26:54.992897 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1761/3222] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:26:54 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1839 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:26:55.000539 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-a3b20327-1465-4c7c-823a-88f013df2d66 req-c4498dcb-183c-4f69-a8ad-cf19652b6e9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5432da5-94bc-4358-bca6-b025d2bc3186", "name": "network-vif-plugged", "status": "completed", "tag": "4e7534f9-e07f-4f04-a90d-f11e0ff193e2"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:55.038564 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a3b20327-1465-4c7c-823a-88f013df2d66 req-c4498dcb-183c-4f69-a8ad-cf19652b6e9c service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:55.040346 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a3b20327-1465-4c7c-823a-88f013df2d66 req-c4498dcb-183c-4f69-a8ad-cf19652b6e9c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:55.043793 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a3b20327-1465-4c7c-823a-88f013df2d66 req-c4498dcb-183c-4f69-a8ad-cf19652b6e9c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:55.075333 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-a3b20327-1465-4c7c-823a-88f013df2d66 req-c4498dcb-183c-4f69-a8ad-cf19652b6e9c service nova] Creating event network-vif-plugged:4e7534f9-e07f-4f04-a90d-f11e0ff193e2 for instance f5432da5-94bc-4358-bca6-b025d2bc3186 on n-h1-master-1 Aug 07 01:26:55.092507 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-a3b20327-1465-4c7c-823a-88f013df2d66 req-c4498dcb-183c-4f69-a8ad-cf19652b6e9c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097712 Aug 07 01:26:55.097954 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1762/3223] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:26:55.105948 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-71fc0518-0248-40e1-8393-4830e7311524 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:55.110393 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-71fc0518-0248-40e1-8393-4830e7311524 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:55.126920 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-71fc0518-0248-40e1-8393-4830e7311524 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:55.128889 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-71fc0518-0248-40e1-8393-4830e7311524 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:55.129644 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-71fc0518-0248-40e1-8393-4830e7311524 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:55.136631 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-71fc0518-0248-40e1-8393-4830e7311524 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:55.137121 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-71fc0518-0248-40e1-8393-4830e7311524 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:55.137570 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-71fc0518-0248-40e1-8393-4830e7311524 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:56.013010 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-71fc0518-0248-40e1-8393-4830e7311524 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:56.032819 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-71fc0518-0248-40e1-8393-4830e7311524 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.933028 Aug 07 01:26:56.033222 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1763/3224] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:55 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:56.067462 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f370a471-f9ab-4ecb-9474-1308690834d0 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:56.076893 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f370a471-f9ab-4ecb-9474-1308690834d0 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: f5432da5-94bc-4358-bca6-b025d2bc3186] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:56.086899 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f370a471-f9ab-4ecb-9474-1308690834d0 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:56.091206 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f370a471-f9ab-4ecb-9474-1308690834d0 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:56.091952 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f370a471-f9ab-4ecb-9474-1308690834d0 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:56.096355 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f370a471-f9ab-4ecb-9474-1308690834d0 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:56.097113 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f370a471-f9ab-4ecb-9474-1308690834d0 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:56.097883 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f370a471-f9ab-4ecb-9474-1308690834d0 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:56.943147 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f370a471-f9ab-4ecb-9474-1308690834d0 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:56.981057 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f370a471-f9ab-4ecb-9474-1308690834d0 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186" status: 200 len: 1308 microversion: 2.1 time: 0.931165 Aug 07 01:26:56.983373 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1764/3225] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:56 2022] GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186 => generated 1308 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:56.991289 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ae055542-9d64-4e71-bd2f-cee65597471f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:56.992688 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ae055542-9d64-4e71-bd2f-cee65597471f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:57.009330 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ae055542-9d64-4e71-bd2f-cee65597471f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:57.012425 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ae055542-9d64-4e71-bd2f-cee65597471f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:57.013299 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ae055542-9d64-4e71-bd2f-cee65597471f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:57.018218 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ae055542-9d64-4e71-bd2f-cee65597471f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:57.019173 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ae055542-9d64-4e71-bd2f-cee65597471f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:57.021244 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ae055542-9d64-4e71-bd2f-cee65597471f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:57.545440 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ae055542-9d64-4e71-bd2f-cee65597471f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:57.565453 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ae055542-9d64-4e71-bd2f-cee65597471f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:57.570144 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ae055542-9d64-4e71-bd2f-cee65597471f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:57.575796 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ae055542-9d64-4e71-bd2f-cee65597471f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1844 microversion: 2.42 time: 0.588638 Aug 07 01:26:57.576738 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1765/3226] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:26:56 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1844 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:26:57.582413 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1fa8b8e7-6f86-4bf8-9bbb-70f8147e1a9b tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:57.592844 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1fa8b8e7-6f86-4bf8-9bbb-70f8147e1a9b tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:57.614950 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1fa8b8e7-6f86-4bf8-9bbb-70f8147e1a9b tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:57.615957 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1fa8b8e7-6f86-4bf8-9bbb-70f8147e1a9b tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:57.616541 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1fa8b8e7-6f86-4bf8-9bbb-70f8147e1a9b tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:57.618309 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1fa8b8e7-6f86-4bf8-9bbb-70f8147e1a9b tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:57.618879 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1fa8b8e7-6f86-4bf8-9bbb-70f8147e1a9b tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:57.621096 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1fa8b8e7-6f86-4bf8-9bbb-70f8147e1a9b tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:57.663471 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:58.233124 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1fa8b8e7-6f86-4bf8-9bbb-70f8147e1a9b tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:58.249605 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1fa8b8e7-6f86-4bf8-9bbb-70f8147e1a9b tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:58.252214 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1fa8b8e7-6f86-4bf8-9bbb-70f8147e1a9b tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:58.255304 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1fa8b8e7-6f86-4bf8-9bbb-70f8147e1a9b tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1860 microversion: 2.32 time: 0.676535 Aug 07 01:26:58.276229 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1766/3227] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:26:57 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1860 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:26:58.285376 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d34e5e88-cb3a-4fb4-b27c-95056ac80fc3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1692283969", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "38e7289f-8c36-40c7-bc8a-a94f77b67d92"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:58.403192 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-d34e5e88-cb3a-4fb4-b27c-95056ac80fc3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] validate_networks() for [('38e7289f-8c36-40c7-bc8a-a94f77b67d92', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:26:58.523187 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a28efffc-b37d-479a-9784-70652f35a249 tempest-SecurityGroupsTestAdminJSON-2050294989 tempest-SecurityGroupsTestAdminJSON-2050294989-project-admin] 10.222.0.39 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11605 microversion: 2.1 time: 6.451594 Aug 07 01:26:58.541233 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1462/3228] 10.222.0.39 () {58 vars in 1191 bytes} [Sun Aug 7 01:26:52 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11605 bytes in 6471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:26:58.549570 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-6cccd924-57e9-4584-a9a9-895cfb8d022b req-5f494633-4f19-419e-add2-8bad546529ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77ed645e-669e-4167-ae78-8ce69770babf", "tag": "20e0f822-dbb7-40fe-862e-071c9953a3bf"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:26:58.563270 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6cccd924-57e9-4584-a9a9-895cfb8d022b req-5f494633-4f19-419e-add2-8bad546529ee service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:58.563793 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6cccd924-57e9-4584-a9a9-895cfb8d022b req-5f494633-4f19-419e-add2-8bad546529ee service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:58.564268 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6cccd924-57e9-4584-a9a9-895cfb8d022b req-5f494633-4f19-419e-add2-8bad546529ee service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:58.585014 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-6cccd924-57e9-4584-a9a9-895cfb8d022b req-5f494633-4f19-419e-add2-8bad546529ee service nova] Creating event network-changed:20e0f822-dbb7-40fe-862e-071c9953a3bf for instance 77ed645e-669e-4167-ae78-8ce69770babf on n-h1-master-1 Aug 07 01:26:58.590686 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-6cccd924-57e9-4584-a9a9-895cfb8d022b req-5f494633-4f19-419e-add2-8bad546529ee service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047704 Aug 07 01:26:58.591846 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1463/3229] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:26:58.604756 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cd029d79-0afd-4f0d-a92e-85f337b01fd8 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:58.607135 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-cd029d79-0afd-4f0d-a92e-85f337b01fd8 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: f5432da5-94bc-4358-bca6-b025d2bc3186] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:26:58.616970 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cd029d79-0afd-4f0d-a92e-85f337b01fd8 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:58.617742 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cd029d79-0afd-4f0d-a92e-85f337b01fd8 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:58.618348 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cd029d79-0afd-4f0d-a92e-85f337b01fd8 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:58.619251 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cd029d79-0afd-4f0d-a92e-85f337b01fd8 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:58.620092 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cd029d79-0afd-4f0d-a92e-85f337b01fd8 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:58.620854 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cd029d79-0afd-4f0d-a92e-85f337b01fd8 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:59.442271 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-cd029d79-0afd-4f0d-a92e-85f337b01fd8 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:26:59.457270 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cd029d79-0afd-4f0d-a92e-85f337b01fd8 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186" status: 200 len: 1487 microversion: 2.1 time: 0.864011 Aug 07 01:26:59.471946 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1464/3230] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:26:58 2022] GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186 => generated 1487 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:26:59.471946 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3050520d-a770-4f6b-8635-0e09c7b65e6f tempest-SecurityGroupsTestAdminJSON-396502944 tempest-SecurityGroupsTestAdminJSON-396502944-project] Calling method '.version_select at 0x7f9e242d5ca0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:59.819685 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-d34e5e88-cb3a-4fb4-b27c-95056ac80fc3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:26:59.820302 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-d34e5e88-cb3a-4fb4-b27c-95056ac80fc3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:26:59.820625 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-d34e5e88-cb3a-4fb4-b27c-95056ac80fc3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:26:59.821049 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-d34e5e88-cb3a-4fb4-b27c-95056ac80fc3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:26:59.821578 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-d34e5e88-cb3a-4fb4-b27c-95056ac80fc3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:26:59.832784 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d34e5e88-cb3a-4fb4-b27c-95056ac80fc3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:59.833363 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d34e5e88-cb3a-4fb4-b27c-95056ac80fc3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:59.834014 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d34e5e88-cb3a-4fb4-b27c-95056ac80fc3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:59.835145 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d34e5e88-cb3a-4fb4-b27c-95056ac80fc3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:26:59.835620 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d34e5e88-cb3a-4fb4-b27c-95056ac80fc3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:26:59.836366 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d34e5e88-cb3a-4fb4-b27c-95056ac80fc3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:26:59.856788 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-d34e5e88-cb3a-4fb4-b27c-95056ac80fc3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Getting quotas for project 939fea7fa6ea4deda8d4fbef70a4e510. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:26:59.863832 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-d34e5e88-cb3a-4fb4-b27c-95056ac80fc3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Getting quotas for user ef29bd35cca547c39d76c54058d32979 and project 939fea7fa6ea4deda8d4fbef70a4e510. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:26:59.878588 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d34e5e88-cb3a-4fb4-b27c-95056ac80fc3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:26:59.881281 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d34e5e88-cb3a-4fb4-b27c-95056ac80fc3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 69381f01-4547-4f10-845d-04b426d685cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:26:59.973656 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d34e5e88-cb3a-4fb4-b27c-95056ac80fc3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.694022 Aug 07 01:26:59.989494 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1767/3231] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:26:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:26:59.995069 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3eddec8c-70bd-49ed-9a89-21674f4d13f2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:26:59.995687 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3eddec8c-70bd-49ed-9a89-21674f4d13f2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:00.007670 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3eddec8c-70bd-49ed-9a89-21674f4d13f2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:00.007670 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3eddec8c-70bd-49ed-9a89-21674f4d13f2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:00.007670 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3eddec8c-70bd-49ed-9a89-21674f4d13f2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:00.007670 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3eddec8c-70bd-49ed-9a89-21674f4d13f2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:00.008355 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3eddec8c-70bd-49ed-9a89-21674f4d13f2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:00.008789 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3eddec8c-70bd-49ed-9a89-21674f4d13f2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:00.288680 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3eddec8c-70bd-49ed-9a89-21674f4d13f2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:00.307482 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3eddec8c-70bd-49ed-9a89-21674f4d13f2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:00.314522 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3eddec8c-70bd-49ed-9a89-21674f4d13f2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:00.317097 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3eddec8c-70bd-49ed-9a89-21674f4d13f2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1865 microversion: 2.42 time: 0.325469 Aug 07 01:27:00.335864 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1768/3232] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:26:59 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1865 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:00.749372 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-94164647-0f08-48da-aa8e-3b3e936d1591 req-b4c36f5e-fb82-49a2-9132-21b5fbb9ffb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "799e740e-2304-4bdf-ad6e-ea4817a92b15", "tag": "66d655ef-9cf7-49d7-a3ac-b463c6c5f801"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:00.762155 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-94164647-0f08-48da-aa8e-3b3e936d1591 req-b4c36f5e-fb82-49a2-9132-21b5fbb9ffb3 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:00.762863 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-94164647-0f08-48da-aa8e-3b3e936d1591 req-b4c36f5e-fb82-49a2-9132-21b5fbb9ffb3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:00.763867 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-94164647-0f08-48da-aa8e-3b3e936d1591 req-b4c36f5e-fb82-49a2-9132-21b5fbb9ffb3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:00.778872 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-94164647-0f08-48da-aa8e-3b3e936d1591 req-b4c36f5e-fb82-49a2-9132-21b5fbb9ffb3 service nova] Creating event network-changed:66d655ef-9cf7-49d7-a3ac-b463c6c5f801 for instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 on n-h1-master-1 Aug 07 01:27:00.786998 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-94164647-0f08-48da-aa8e-3b3e936d1591 req-b4c36f5e-fb82-49a2-9132-21b5fbb9ffb3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.452181 Aug 07 01:27:00.792492 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1769/3233] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:27:00.804682 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-33186b3a-e193-4278-91cf-d05af87734b8 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:00.811149 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-33186b3a-e193-4278-91cf-d05af87734b8 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:00.818340 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33186b3a-e193-4278-91cf-d05af87734b8 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:00.819096 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33186b3a-e193-4278-91cf-d05af87734b8 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:00.820633 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33186b3a-e193-4278-91cf-d05af87734b8 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:00.822026 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33186b3a-e193-4278-91cf-d05af87734b8 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:00.822696 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33186b3a-e193-4278-91cf-d05af87734b8 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:00.823286 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33186b3a-e193-4278-91cf-d05af87734b8 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:00.949995 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3050520d-a770-4f6b-8635-0e09c7b65e6f tempest-SecurityGroupsTestAdminJSON-396502944 tempest-SecurityGroupsTestAdminJSON-396502944-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1109 microversion: 2.1 time: 1.490751 Aug 07 01:27:00.952220 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1465/3234] 10.222.0.39 () {58 vars in 1191 bytes} [Sun Aug 7 01:26:59 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1109 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:00.968970 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b9855bf3-3272-41f9-ad25-1aa40d8f5336 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:00.996528 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9855bf3-3272-41f9-ad25-1aa40d8f5336 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:00.997038 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9855bf3-3272-41f9-ad25-1aa40d8f5336 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:00.997775 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9855bf3-3272-41f9-ad25-1aa40d8f5336 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:01.153336 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b9855bf3-3272-41f9-ad25-1aa40d8f5336 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: f5432da5-94bc-4358-bca6-b025d2bc3186] Going to try to stop instance {{(pid=119517) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 07 01:27:01.161302 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:01.239037 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b9855bf3-3272-41f9-ad25-1aa40d8f5336 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "POST /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186/action" status: 202 len: 0 microversion: 2.1 time: 0.282486 Aug 07 01:27:01.244881 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1466/3235] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:27:00 2022] POST /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:27:01.253131 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-25d9352c-3065-4467-a965-43d90ca1ff4d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:01.254914 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-25d9352c-3065-4467-a965-43d90ca1ff4d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 69381f01-4547-4f10-845d-04b426d685cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:01.263468 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-25d9352c-3065-4467-a965-43d90ca1ff4d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:01.264186 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-25d9352c-3065-4467-a965-43d90ca1ff4d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:01.264993 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-25d9352c-3065-4467-a965-43d90ca1ff4d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:01.266578 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-25d9352c-3065-4467-a965-43d90ca1ff4d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:01.268359 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-25d9352c-3065-4467-a965-43d90ca1ff4d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:01.268975 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-25d9352c-3065-4467-a965-43d90ca1ff4d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:01.457258 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-25d9352c-3065-4467-a965-43d90ca1ff4d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:01.472318 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-25d9352c-3065-4467-a965-43d90ca1ff4d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd" status: 200 len: 1267 microversion: 2.1 time: 0.224967 Aug 07 01:27:01.475413 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1467/3236] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:01 2022] GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd => generated 1267 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:01.487369 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-bc6805af-3ce9-4429-8863-6c1e18dd86cf req-52c9cd4c-b3d4-415c-b97d-6c2cddf50ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77ed645e-669e-4167-ae78-8ce69770babf", "tag": "4ef68384-661e-4ee2-9cb3-6b136e92c283"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:01.508814 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-bc6805af-3ce9-4429-8863-6c1e18dd86cf req-52c9cd4c-b3d4-415c-b97d-6c2cddf50ef5 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:01.509353 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-bc6805af-3ce9-4429-8863-6c1e18dd86cf req-52c9cd4c-b3d4-415c-b97d-6c2cddf50ef5 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:01.509848 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-bc6805af-3ce9-4429-8863-6c1e18dd86cf req-52c9cd4c-b3d4-415c-b97d-6c2cddf50ef5 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:01.525176 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-bc6805af-3ce9-4429-8863-6c1e18dd86cf req-52c9cd4c-b3d4-415c-b97d-6c2cddf50ef5 service nova] Creating event network-changed:4ef68384-661e-4ee2-9cb3-6b136e92c283 for instance 77ed645e-669e-4167-ae78-8ce69770babf on n-h1-master-1 Aug 07 01:27:01.531811 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-bc6805af-3ce9-4429-8863-6c1e18dd86cf req-52c9cd4c-b3d4-415c-b97d-6c2cddf50ef5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054259 Aug 07 01:27:01.534242 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1468/3237] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:27:01.541193 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-dfe95f4b-160e-4834-85e2-467101ef623a tempest-SecurityGroupsTestAdminJSON-2050294989 tempest-SecurityGroupsTestAdminJSON-2050294989-project-admin] Calling method '.version_select at 0x7f9e299a9a60>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:02.148198 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-33186b3a-e193-4278-91cf-d05af87734b8 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:02.158814 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-33186b3a-e193-4278-91cf-d05af87734b8 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:02.167119 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-33186b3a-e193-4278-91cf-d05af87734b8 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:02.168619 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-33186b3a-e193-4278-91cf-d05af87734b8 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1881 microversion: 2.32 time: 1.372121 Aug 07 01:27:02.173489 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1770/3238] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:00 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1881 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:02.185637 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-979b2a18-1c48-4d3e-862f-01360622daed tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:02.186575 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-979b2a18-1c48-4d3e-862f-01360622daed tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: f5432da5-94bc-4358-bca6-b025d2bc3186] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:02.197482 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-979b2a18-1c48-4d3e-862f-01360622daed tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:02.200660 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-979b2a18-1c48-4d3e-862f-01360622daed tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:02.201121 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-979b2a18-1c48-4d3e-862f-01360622daed tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:02.201872 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-979b2a18-1c48-4d3e-862f-01360622daed tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:02.202339 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-979b2a18-1c48-4d3e-862f-01360622daed tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:02.202769 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-979b2a18-1c48-4d3e-862f-01360622daed tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:02.442980 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-dfe95f4b-160e-4834-85e2-467101ef623a tempest-SecurityGroupsTestAdminJSON-2050294989 tempest-SecurityGroupsTestAdminJSON-2050294989-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/0ce0bdf5-7d9d-4995-bffb-fb91fb165853" status: 202 len: 0 microversion: 2.1 time: 0.906861 Aug 07 01:27:02.444246 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1469/3239] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:27:01 2022] DELETE /compute/v2.1/os-security-groups/0ce0bdf5-7d9d-4995-bffb-fb91fb165853 => generated 0 bytes in 909 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:27:02.449510 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e12100f7-154d-499a-9e43-91df7d3041ef tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:02.450629 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e12100f7-154d-499a-9e43-91df7d3041ef tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:02.466328 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e12100f7-154d-499a-9e43-91df7d3041ef tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:02.471305 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e12100f7-154d-499a-9e43-91df7d3041ef tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:02.473169 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e12100f7-154d-499a-9e43-91df7d3041ef tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:02.474614 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e12100f7-154d-499a-9e43-91df7d3041ef tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:02.475680 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e12100f7-154d-499a-9e43-91df7d3041ef tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:02.476396 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e12100f7-154d-499a-9e43-91df7d3041ef tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:02.693935 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-979b2a18-1c48-4d3e-862f-01360622daed tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:02.715826 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-979b2a18-1c48-4d3e-862f-01360622daed tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186" status: 200 len: 1497 microversion: 2.1 time: 0.531870 Aug 07 01:27:02.723085 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1771/3240] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:02 2022] GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186 => generated 1497 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:02.754040 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1f10f232-ce35-4bf9-ab47-d4103238e18f tempest-SecurityGroupsTestAdminJSON-2050294989 tempest-SecurityGroupsTestAdminJSON-2050294989-project-admin] Calling method '.version_select at 0x7f9e299c21f0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:03.366144 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e12100f7-154d-499a-9e43-91df7d3041ef tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:03.392224 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e12100f7-154d-499a-9e43-91df7d3041ef tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:03.405801 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e12100f7-154d-499a-9e43-91df7d3041ef tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:03.413192 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e12100f7-154d-499a-9e43-91df7d3041ef tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1865 microversion: 2.42 time: 0.965901 Aug 07 01:27:03.416058 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1470/3241] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:02 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1865 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:03.436193 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-39b28c49-16fb-4747-b257-6747ed3f80e3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:03.439013 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-39b28c49-16fb-4747-b257-6747ed3f80e3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 69381f01-4547-4f10-845d-04b426d685cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:03.458982 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:03.465918 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39b28c49-16fb-4747-b257-6747ed3f80e3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:03.466403 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39b28c49-16fb-4747-b257-6747ed3f80e3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:03.466850 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39b28c49-16fb-4747-b257-6747ed3f80e3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:03.467587 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39b28c49-16fb-4747-b257-6747ed3f80e3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:03.468078 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39b28c49-16fb-4747-b257-6747ed3f80e3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:03.468509 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39b28c49-16fb-4747-b257-6747ed3f80e3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:03.525408 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1f10f232-ce35-4bf9-ab47-d4103238e18f tempest-SecurityGroupsTestAdminJSON-2050294989 tempest-SecurityGroupsTestAdminJSON-2050294989-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/75eb49f8-0f01-4945-b99f-ce563b1ea175" status: 202 len: 0 microversion: 2.1 time: 0.800165 Aug 07 01:27:03.527383 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1772/3242] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:27:02 2022] DELETE /compute/v2.1/os-security-groups/75eb49f8-0f01-4945-b99f-ce563b1ea175 => generated 0 bytes in 803 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:27:03.533547 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0477b4bc-a0e6-4c47-9759-44d755806f28 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:03.534605 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0477b4bc-a0e6-4c47-9759-44d755806f28 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:03.549781 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0477b4bc-a0e6-4c47-9759-44d755806f28 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:03.552337 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0477b4bc-a0e6-4c47-9759-44d755806f28 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:03.553114 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0477b4bc-a0e6-4c47-9759-44d755806f28 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:03.554735 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0477b4bc-a0e6-4c47-9759-44d755806f28 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:03.556600 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0477b4bc-a0e6-4c47-9759-44d755806f28 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:03.559464 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0477b4bc-a0e6-4c47-9759-44d755806f28 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:03.999105 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-39b28c49-16fb-4747-b257-6747ed3f80e3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:04.016258 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-39b28c49-16fb-4747-b257-6747ed3f80e3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd" status: 200 len: 1273 microversion: 2.1 time: 0.597449 Aug 07 01:27:04.017467 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1471/3243] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:03 2022] GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd => generated 1273 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:04.032826 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1465cd77-57ac-4fc7-a0c4-9185500ab9b2 tempest-SecurityGroupsTestAdminJSON-396502944 tempest-SecurityGroupsTestAdminJSON-396502944-project] Calling method '.version_select at 0x7f9e17e390d0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:04.096937 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0477b4bc-a0e6-4c47-9759-44d755806f28 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:04.114708 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0477b4bc-a0e6-4c47-9759-44d755806f28 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:04.122079 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0477b4bc-a0e6-4c47-9759-44d755806f28 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:04.123649 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0477b4bc-a0e6-4c47-9759-44d755806f28 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1881 microversion: 2.32 time: 0.594952 Aug 07 01:27:04.127771 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1773/3244] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:03 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1881 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:04.135437 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-2e23cb11-8abb-42d4-b397-d24ccb7a9882 req-293721a3-1880-4cbb-9092-658f344fde8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77ed645e-669e-4167-ae78-8ce69770babf", "tag": "ddd3713f-bf35-44b3-af6e-430d7ac4d4e5"}, {"name": "network-changed", "server_uuid": "799e740e-2304-4bdf-ad6e-ea4817a92b15", "tag": "d4a336ca-825e-45ea-b60b-7c5fc663a27f"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:04.162556 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2e23cb11-8abb-42d4-b397-d24ccb7a9882 req-293721a3-1880-4cbb-9092-658f344fde8c service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:04.163850 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2e23cb11-8abb-42d4-b397-d24ccb7a9882 req-293721a3-1880-4cbb-9092-658f344fde8c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:04.164594 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2e23cb11-8abb-42d4-b397-d24ccb7a9882 req-293721a3-1880-4cbb-9092-658f344fde8c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:04.181506 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-2e23cb11-8abb-42d4-b397-d24ccb7a9882 req-293721a3-1880-4cbb-9092-658f344fde8c service nova] Creating event network-changed:ddd3713f-bf35-44b3-af6e-430d7ac4d4e5 for instance 77ed645e-669e-4167-ae78-8ce69770babf on n-h1-master-1 Aug 07 01:27:04.182417 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-2e23cb11-8abb-42d4-b397-d24ccb7a9882 req-293721a3-1880-4cbb-9092-658f344fde8c service nova] Creating event network-changed:d4a336ca-825e-45ea-b60b-7c5fc663a27f for instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 on n-h1-master-1 Aug 07 01:27:04.192359 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-2e23cb11-8abb-42d4-b397-d24ccb7a9882 req-293721a3-1880-4cbb-9092-658f344fde8c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.062733 Aug 07 01:27:04.195161 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1774/3245] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:27:04.211023 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0042d1b7-6c23-4d8c-acd3-85002a2c0f16 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:04.212885 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0042d1b7-6c23-4d8c-acd3-85002a2c0f16 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: f5432da5-94bc-4358-bca6-b025d2bc3186] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:04.232451 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0042d1b7-6c23-4d8c-acd3-85002a2c0f16 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:04.234513 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0042d1b7-6c23-4d8c-acd3-85002a2c0f16 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:04.235279 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0042d1b7-6c23-4d8c-acd3-85002a2c0f16 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:04.237626 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0042d1b7-6c23-4d8c-acd3-85002a2c0f16 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:04.239341 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0042d1b7-6c23-4d8c-acd3-85002a2c0f16 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:04.240073 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0042d1b7-6c23-4d8c-acd3-85002a2c0f16 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:04.814439 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0042d1b7-6c23-4d8c-acd3-85002a2c0f16 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:04.834772 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0042d1b7-6c23-4d8c-acd3-85002a2c0f16 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186" status: 200 len: 1497 microversion: 2.1 time: 0.635093 Aug 07 01:27:04.835796 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1775/3246] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:04 2022] GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186 => generated 1497 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:04.848463 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3c3470d6-b279-4ea3-a236-03e7e0967179 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:04.849172 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3c3470d6-b279-4ea3-a236-03e7e0967179 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:04.864135 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c3470d6-b279-4ea3-a236-03e7e0967179 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:04.864638 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c3470d6-b279-4ea3-a236-03e7e0967179 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:04.865082 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c3470d6-b279-4ea3-a236-03e7e0967179 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:04.865860 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c3470d6-b279-4ea3-a236-03e7e0967179 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:04.866253 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c3470d6-b279-4ea3-a236-03e7e0967179 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:04.866694 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c3470d6-b279-4ea3-a236-03e7e0967179 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:05.776701 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1465cd77-57ac-4fc7-a0c4-9185500ab9b2 tempest-SecurityGroupsTestAdminJSON-396502944 tempest-SecurityGroupsTestAdminJSON-396502944-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/cd240209-8a62-42b3-8307-a5ca1ee77b87" status: 202 len: 0 microversion: 2.1 time: 1.757793 Aug 07 01:27:05.777972 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1472/3247] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:27:04 2022] DELETE /compute/v2.1/os-security-groups/cd240209-8a62-42b3-8307-a5ca1ee77b87 => generated 0 bytes in 1760 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:27:05.788044 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d08ca567-faeb-4f40-9d8d-dc81862d2947 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:05.789400 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d08ca567-faeb-4f40-9d8d-dc81862d2947 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 69381f01-4547-4f10-845d-04b426d685cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:05.809628 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d08ca567-faeb-4f40-9d8d-dc81862d2947 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:05.825436 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d08ca567-faeb-4f40-9d8d-dc81862d2947 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:05.826846 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d08ca567-faeb-4f40-9d8d-dc81862d2947 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:05.828226 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d08ca567-faeb-4f40-9d8d-dc81862d2947 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:05.830697 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d08ca567-faeb-4f40-9d8d-dc81862d2947 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:05.832213 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d08ca567-faeb-4f40-9d8d-dc81862d2947 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:05.883396 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3c3470d6-b279-4ea3-a236-03e7e0967179 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:05.918195 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3c3470d6-b279-4ea3-a236-03e7e0967179 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:05.921588 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3c3470d6-b279-4ea3-a236-03e7e0967179 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:05.931348 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3c3470d6-b279-4ea3-a236-03e7e0967179 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1886 microversion: 2.42 time: 1.092555 Aug 07 01:27:05.935534 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1776/3248] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:04 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1886 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:05.952008 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-276e4806-a5d4-4f9a-b456-3b367cd2ed0c tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:05.952925 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-276e4806-a5d4-4f9a-b456-3b367cd2ed0c tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:05.974218 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:05.989640 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-276e4806-a5d4-4f9a-b456-3b367cd2ed0c tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:05.990234 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-276e4806-a5d4-4f9a-b456-3b367cd2ed0c tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:05.990759 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-276e4806-a5d4-4f9a-b456-3b367cd2ed0c tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:05.991936 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-276e4806-a5d4-4f9a-b456-3b367cd2ed0c tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:05.992401 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-276e4806-a5d4-4f9a-b456-3b367cd2ed0c tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:05.992837 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-276e4806-a5d4-4f9a-b456-3b367cd2ed0c tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:06.448836 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-276e4806-a5d4-4f9a-b456-3b367cd2ed0c tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:06.467626 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-276e4806-a5d4-4f9a-b456-3b367cd2ed0c tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:06.470750 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-276e4806-a5d4-4f9a-b456-3b367cd2ed0c tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:06.472575 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-276e4806-a5d4-4f9a-b456-3b367cd2ed0c tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1881 microversion: 2.32 time: 0.531966 Aug 07 01:27:06.485984 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1777/3249] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:05 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1881 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:06.496763 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4550351a-bf9f-43b0-84b5-1f5a95bfef99 tempest-SecurityGroupsTestAdminJSON-396502944 tempest-SecurityGroupsTestAdminJSON-396502944-project] Calling method '.version_select at 0x7f9e179463a0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:06.980240 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d08ca567-faeb-4f40-9d8d-dc81862d2947 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:06.994781 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d08ca567-faeb-4f40-9d8d-dc81862d2947 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd" status: 200 len: 1315 microversion: 2.1 time: 1.215153 Aug 07 01:27:06.998148 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1473/3250] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:05 2022] GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd => generated 1315 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:07.012994 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-21a98a56-b6dc-42a6-929f-c6d58e668d88 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:07.020919 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-21a98a56-b6dc-42a6-929f-c6d58e668d88 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: f5432da5-94bc-4358-bca6-b025d2bc3186] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:07.050560 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21a98a56-b6dc-42a6-929f-c6d58e668d88 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:07.052137 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21a98a56-b6dc-42a6-929f-c6d58e668d88 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:07.054211 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21a98a56-b6dc-42a6-929f-c6d58e668d88 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:07.061051 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21a98a56-b6dc-42a6-929f-c6d58e668d88 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:07.074548 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21a98a56-b6dc-42a6-929f-c6d58e668d88 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:07.084404 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21a98a56-b6dc-42a6-929f-c6d58e668d88 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:07.950197 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-21a98a56-b6dc-42a6-929f-c6d58e668d88 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:07.959135 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-21a98a56-b6dc-42a6-929f-c6d58e668d88 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186" status: 200 len: 1497 microversion: 2.1 time: 0.956373 Aug 07 01:27:07.977328 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1474/3251] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:06 2022] GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186 => generated 1497 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:07.994731 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5a3fbeeb-1580-4588-83ef-213c5408b0cd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:07.995315 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5a3fbeeb-1580-4588-83ef-213c5408b0cd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 2a78e835-73be-4ac9-bfd9-9b13009845ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:08.018165 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a3fbeeb-1580-4588-83ef-213c5408b0cd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:08.018702 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a3fbeeb-1580-4588-83ef-213c5408b0cd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:08.019144 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a3fbeeb-1580-4588-83ef-213c5408b0cd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:08.019902 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a3fbeeb-1580-4588-83ef-213c5408b0cd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:08.020369 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a3fbeeb-1580-4588-83ef-213c5408b0cd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:08.020801 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a3fbeeb-1580-4588-83ef-213c5408b0cd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:08.065705 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4550351a-bf9f-43b0-84b5-1f5a95bfef99 tempest-SecurityGroupsTestAdminJSON-396502944 tempest-SecurityGroupsTestAdminJSON-396502944-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/7dfd7ad0-8ecd-414b-a124-053af364b093" status: 202 len: 0 microversion: 2.1 time: 1.573656 Aug 07 01:27:08.066704 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1778/3252] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:27:06 2022] DELETE /compute/v2.1/os-security-groups/7dfd7ad0-8ecd-414b-a124-053af364b093 => generated 0 bytes in 1580 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:27:08.071766 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5a3fbeeb-1580-4588-83ef-213c5408b0cd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 2a78e835-73be-4ac9-bfd9-9b13009845ca] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:27:08.079815 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-32429b9b-4fb3-4535-ba64-47c09fa6f6f3 req-11e36f4d-0400-4203-ae12-bd425164e386 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77ed645e-669e-4167-ae78-8ce69770babf", "tag": "1268da76-b550-4f84-ab0c-afc461703feb"}, {"name": "network-changed", "server_uuid": "799e740e-2304-4bdf-ad6e-ea4817a92b15", "tag": "40561cc9-b152-4881-8f63-0ed22243935d"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:08.115714 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-32429b9b-4fb3-4535-ba64-47c09fa6f6f3 req-11e36f4d-0400-4203-ae12-bd425164e386 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:08.116245 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-32429b9b-4fb3-4535-ba64-47c09fa6f6f3 req-11e36f4d-0400-4203-ae12-bd425164e386 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:08.122212 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-32429b9b-4fb3-4535-ba64-47c09fa6f6f3 req-11e36f4d-0400-4203-ae12-bd425164e386 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:08.182397 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-32429b9b-4fb3-4535-ba64-47c09fa6f6f3 req-11e36f4d-0400-4203-ae12-bd425164e386 service nova] Creating event network-changed:1268da76-b550-4f84-ab0c-afc461703feb for instance 77ed645e-669e-4167-ae78-8ce69770babf on n-h1-master-1 Aug 07 01:27:08.184252 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-32429b9b-4fb3-4535-ba64-47c09fa6f6f3 req-11e36f4d-0400-4203-ae12-bd425164e386 service nova] Creating event network-changed:40561cc9-b152-4881-8f63-0ed22243935d for instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 on n-h1-master-1 Aug 07 01:27:08.204957 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-32429b9b-4fb3-4535-ba64-47c09fa6f6f3 req-11e36f4d-0400-4203-ae12-bd425164e386 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.136716 Aug 07 01:27:08.209990 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1779/3253] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:27:08.220222 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-54d897cc-4439-4328-a59a-d8a96b6fa27e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:08.227151 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-54d897cc-4439-4328-a59a-d8a96b6fa27e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:08.239309 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-54d897cc-4439-4328-a59a-d8a96b6fa27e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:08.240149 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-54d897cc-4439-4328-a59a-d8a96b6fa27e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:08.242676 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-54d897cc-4439-4328-a59a-d8a96b6fa27e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:08.243978 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-54d897cc-4439-4328-a59a-d8a96b6fa27e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:08.244674 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-54d897cc-4439-4328-a59a-d8a96b6fa27e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:08.245295 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-54d897cc-4439-4328-a59a-d8a96b6fa27e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:08.299540 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5a3fbeeb-1580-4588-83ef-213c5408b0cd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca" status: 204 len: 0 microversion: 2.1 time: 0.320283 Aug 07 01:27:08.304428 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1475/3254] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:27:07 2022] DELETE /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:27:08.329137 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ba254421-b2f4-4fa9-a85c-b0440d2845ad tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:08.330670 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ba254421-b2f4-4fa9-a85c-b0440d2845ad tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:08.351803 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ba254421-b2f4-4fa9-a85c-b0440d2845ad tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:08.352339 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ba254421-b2f4-4fa9-a85c-b0440d2845ad tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:08.352793 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ba254421-b2f4-4fa9-a85c-b0440d2845ad tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:08.353527 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ba254421-b2f4-4fa9-a85c-b0440d2845ad tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:08.353991 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ba254421-b2f4-4fa9-a85c-b0440d2845ad tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:08.354421 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ba254421-b2f4-4fa9-a85c-b0440d2845ad tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:08.777369 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-54d897cc-4439-4328-a59a-d8a96b6fa27e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:08.788583 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-54d897cc-4439-4328-a59a-d8a96b6fa27e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:08.790124 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-54d897cc-4439-4328-a59a-d8a96b6fa27e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:08.791341 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-54d897cc-4439-4328-a59a-d8a96b6fa27e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1886 microversion: 2.42 time: 0.579452 Aug 07 01:27:08.804766 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1780/3255] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:08 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1886 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:08.810304 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1782adbf-19c9-4195-a185-49ff75da3cdc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:08.811108 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1782adbf-19c9-4195-a185-49ff75da3cdc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 69381f01-4547-4f10-845d-04b426d685cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:08.818677 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1782adbf-19c9-4195-a185-49ff75da3cdc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:08.819309 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1782adbf-19c9-4195-a185-49ff75da3cdc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:08.819853 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1782adbf-19c9-4195-a185-49ff75da3cdc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:08.820843 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1782adbf-19c9-4195-a185-49ff75da3cdc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:08.821409 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1782adbf-19c9-4195-a185-49ff75da3cdc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:08.821946 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1782adbf-19c9-4195-a185-49ff75da3cdc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:09.165035 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ba254421-b2f4-4fa9-a85c-b0440d2845ad tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:09.186547 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ba254421-b2f4-4fa9-a85c-b0440d2845ad tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:09.191191 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ba254421-b2f4-4fa9-a85c-b0440d2845ad tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:09.197608 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ba254421-b2f4-4fa9-a85c-b0440d2845ad tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1881 microversion: 2.32 time: 0.888787 Aug 07 01:27:09.199247 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1476/3256] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:08 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1881 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:09.215602 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b80bd040-35b5-4a9b-bd6e-bc433ad6c746 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:09.224629 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b80bd040-35b5-4a9b-bd6e-bc433ad6c746 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 2a78e835-73be-4ac9-bfd9-9b13009845ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:09.244165 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b80bd040-35b5-4a9b-bd6e-bc433ad6c746 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:09.244931 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b80bd040-35b5-4a9b-bd6e-bc433ad6c746 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:09.245554 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b80bd040-35b5-4a9b-bd6e-bc433ad6c746 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:09.246526 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b80bd040-35b5-4a9b-bd6e-bc433ad6c746 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:09.247158 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b80bd040-35b5-4a9b-bd6e-bc433ad6c746 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:09.247836 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b80bd040-35b5-4a9b-bd6e-bc433ad6c746 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:09.537703 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1782adbf-19c9-4195-a185-49ff75da3cdc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:09.576516 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1782adbf-19c9-4195-a185-49ff75da3cdc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd" status: 200 len: 1315 microversion: 2.1 time: 0.769007 Aug 07 01:27:09.581145 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1781/3257] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:08 2022] GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd => generated 1315 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:09.597713 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-24f9955f-ff33-481e-97b8-9659a98ede63 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:09.598639 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-24f9955f-ff33-481e-97b8-9659a98ede63 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: f5432da5-94bc-4358-bca6-b025d2bc3186] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:09.608835 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24f9955f-ff33-481e-97b8-9659a98ede63 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:09.610639 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24f9955f-ff33-481e-97b8-9659a98ede63 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:09.611674 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24f9955f-ff33-481e-97b8-9659a98ede63 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:09.613208 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24f9955f-ff33-481e-97b8-9659a98ede63 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:09.614256 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24f9955f-ff33-481e-97b8-9659a98ede63 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:09.615236 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24f9955f-ff33-481e-97b8-9659a98ede63 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:09.839472 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b80bd040-35b5-4a9b-bd6e-bc433ad6c746 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:09.849080 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:09.855027 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b80bd040-35b5-4a9b-bd6e-bc433ad6c746 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca" status: 200 len: 1554 microversion: 2.1 time: 0.651368 Aug 07 01:27:09.872466 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1477/3258] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:09 2022] GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca => generated 1554 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:09.872730 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:09.884145 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8fb31faa-29dd-4834-8775-70ea6db9e1a3 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:09.884779 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8fb31faa-29dd-4834-8775-70ea6db9e1a3 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:09.893927 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8fb31faa-29dd-4834-8775-70ea6db9e1a3 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:09.894457 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8fb31faa-29dd-4834-8775-70ea6db9e1a3 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:09.894906 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8fb31faa-29dd-4834-8775-70ea6db9e1a3 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:09.895777 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8fb31faa-29dd-4834-8775-70ea6db9e1a3 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:09.896198 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8fb31faa-29dd-4834-8775-70ea6db9e1a3 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:09.896633 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8fb31faa-29dd-4834-8775-70ea6db9e1a3 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:10.137461 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-24f9955f-ff33-481e-97b8-9659a98ede63 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:10.151913 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-24f9955f-ff33-481e-97b8-9659a98ede63 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186" status: 200 len: 1497 microversion: 2.1 time: 0.569351 Aug 07 01:27:10.153121 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1782/3259] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:09 2022] GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186 => generated 1497 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:10.226102 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1ab9d1b0-f382-45cf-9e8f-e0f2bf5df818 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:10.227264 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1ab9d1b0-f382-45cf-9e8f-e0f2bf5df818 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:10.237887 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ab9d1b0-f382-45cf-9e8f-e0f2bf5df818 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:10.238758 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ab9d1b0-f382-45cf-9e8f-e0f2bf5df818 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:10.240043 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ab9d1b0-f382-45cf-9e8f-e0f2bf5df818 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:10.241090 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ab9d1b0-f382-45cf-9e8f-e0f2bf5df818 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:10.241817 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ab9d1b0-f382-45cf-9e8f-e0f2bf5df818 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:10.242451 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ab9d1b0-f382-45cf-9e8f-e0f2bf5df818 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:10.777747 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8fb31faa-29dd-4834-8775-70ea6db9e1a3 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:10.828353 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8fb31faa-29dd-4834-8775-70ea6db9e1a3 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:10.831056 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8fb31faa-29dd-4834-8775-70ea6db9e1a3 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:10.837099 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8fb31faa-29dd-4834-8775-70ea6db9e1a3 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1886 microversion: 2.42 time: 0.960891 Aug 07 01:27:10.838683 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1478/3260] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:09 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1886 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:10.856337 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-3ec6fb3e-3047-4ed5-a992-d14a961bbdf6 req-55ad8b4c-e05e-44c9-9797-7cc6a3b92c1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77ed645e-669e-4167-ae78-8ce69770babf", "tag": "840656e7-e0bc-4bee-89df-d4b7a1945712"}, {"name": "network-changed", "server_uuid": "69381f01-4547-4f10-845d-04b426d685cd", "tag": "6339ef02-96a8-47d9-8b82-d7536d6c4120"}, {"name": "network-changed", "server_uuid": "799e740e-2304-4bdf-ad6e-ea4817a92b15", "tag": "57dd2ceb-1878-4d37-b462-7fa515b4642e"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:10.900807 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3ec6fb3e-3047-4ed5-a992-d14a961bbdf6 req-55ad8b4c-e05e-44c9-9797-7cc6a3b92c1a service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:10.901409 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3ec6fb3e-3047-4ed5-a992-d14a961bbdf6 req-55ad8b4c-e05e-44c9-9797-7cc6a3b92c1a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:10.912296 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3ec6fb3e-3047-4ed5-a992-d14a961bbdf6 req-55ad8b4c-e05e-44c9-9797-7cc6a3b92c1a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:10.958451 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-3ec6fb3e-3047-4ed5-a992-d14a961bbdf6 req-55ad8b4c-e05e-44c9-9797-7cc6a3b92c1a service nova] Creating event network-changed:840656e7-e0bc-4bee-89df-d4b7a1945712 for instance 77ed645e-669e-4167-ae78-8ce69770babf on n-h1-master-1 Aug 07 01:27:10.959320 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-3ec6fb3e-3047-4ed5-a992-d14a961bbdf6 req-55ad8b4c-e05e-44c9-9797-7cc6a3b92c1a service nova] Creating event network-changed:6339ef02-96a8-47d9-8b82-d7536d6c4120 for instance 69381f01-4547-4f10-845d-04b426d685cd on n-h2-master-1 Aug 07 01:27:10.960044 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-3ec6fb3e-3047-4ed5-a992-d14a961bbdf6 req-55ad8b4c-e05e-44c9-9797-7cc6a3b92c1a service nova] Creating event network-changed:57dd2ceb-1878-4d37-b462-7fa515b4642e for instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 on n-h1-master-1 Aug 07 01:27:10.997163 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-3ec6fb3e-3047-4ed5-a992-d14a961bbdf6 req-55ad8b4c-e05e-44c9-9797-7cc6a3b92c1a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.154137 Aug 07 01:27:10.998026 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1479/3261] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:27:11.025796 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-474d096f-7916-4a97-9c31-da7651c8c9a3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:11.026900 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-474d096f-7916-4a97-9c31-da7651c8c9a3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 69381f01-4547-4f10-845d-04b426d685cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:11.045795 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-474d096f-7916-4a97-9c31-da7651c8c9a3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:11.048117 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-474d096f-7916-4a97-9c31-da7651c8c9a3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:11.048860 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-474d096f-7916-4a97-9c31-da7651c8c9a3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:11.049815 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-474d096f-7916-4a97-9c31-da7651c8c9a3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:11.056109 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-474d096f-7916-4a97-9c31-da7651c8c9a3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:11.056784 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-474d096f-7916-4a97-9c31-da7651c8c9a3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:12.215258 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1ab9d1b0-f382-45cf-9e8f-e0f2bf5df818 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:12.237298 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1ab9d1b0-f382-45cf-9e8f-e0f2bf5df818 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:12.241894 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1ab9d1b0-f382-45cf-9e8f-e0f2bf5df818 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:12.246846 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1ab9d1b0-f382-45cf-9e8f-e0f2bf5df818 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1881 microversion: 2.32 time: 2.027788 Aug 07 01:27:12.248207 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1783/3262] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:10 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1881 bytes in 2030 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:12.263393 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-efc73835-dd9f-48e5-8acc-b1145e73978f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:12.264589 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-efc73835-dd9f-48e5-8acc-b1145e73978f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 2a78e835-73be-4ac9-bfd9-9b13009845ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:12.278685 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-efc73835-dd9f-48e5-8acc-b1145e73978f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:12.279521 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-efc73835-dd9f-48e5-8acc-b1145e73978f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:12.280421 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-efc73835-dd9f-48e5-8acc-b1145e73978f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:12.283120 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-efc73835-dd9f-48e5-8acc-b1145e73978f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:12.285419 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-efc73835-dd9f-48e5-8acc-b1145e73978f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:12.287465 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-efc73835-dd9f-48e5-8acc-b1145e73978f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:12.325371 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-474d096f-7916-4a97-9c31-da7651c8c9a3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:12.334412 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-474d096f-7916-4a97-9c31-da7651c8c9a3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd" status: 200 len: 1315 microversion: 2.1 time: 1.334900 Aug 07 01:27:12.353099 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1480/3263] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:10 2022] GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd => generated 1315 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:12.358382 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1244d046-07cb-4d28-88a9-653e8cab4b15 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:12.359024 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1244d046-07cb-4d28-88a9-653e8cab4b15 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: f5432da5-94bc-4358-bca6-b025d2bc3186] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:12.383296 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1244d046-07cb-4d28-88a9-653e8cab4b15 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:12.383493 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1244d046-07cb-4d28-88a9-653e8cab4b15 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:12.384165 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1244d046-07cb-4d28-88a9-653e8cab4b15 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:12.385206 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1244d046-07cb-4d28-88a9-653e8cab4b15 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:12.385871 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1244d046-07cb-4d28-88a9-653e8cab4b15 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:12.386310 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1244d046-07cb-4d28-88a9-653e8cab4b15 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:12.845820 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1244d046-07cb-4d28-88a9-653e8cab4b15 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:12.859320 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1244d046-07cb-4d28-88a9-653e8cab4b15 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186" status: 200 len: 1497 microversion: 2.1 time: 0.505000 Aug 07 01:27:12.860974 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1481/3264] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:12 2022] GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186 => generated 1497 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:12.881918 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-78fa6033-6cd3-4e28-a805-ad9336a28b61 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:12.883601 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-78fa6033-6cd3-4e28-a805-ad9336a28b61 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:12.899612 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78fa6033-6cd3-4e28-a805-ad9336a28b61 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:12.900375 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78fa6033-6cd3-4e28-a805-ad9336a28b61 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:12.901000 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78fa6033-6cd3-4e28-a805-ad9336a28b61 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:12.902906 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78fa6033-6cd3-4e28-a805-ad9336a28b61 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:12.907454 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78fa6033-6cd3-4e28-a805-ad9336a28b61 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:12.908431 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78fa6033-6cd3-4e28-a805-ad9336a28b61 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:13.106445 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-efc73835-dd9f-48e5-8acc-b1145e73978f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:13.123237 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-efc73835-dd9f-48e5-8acc-b1145e73978f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca" status: 200 len: 1554 microversion: 2.1 time: 0.872486 Aug 07 01:27:13.124902 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1784/3265] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:12 2022] GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca => generated 1554 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:13.282848 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4885505e-fd20-414a-9751-5f703de8f787 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:13.283775 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4885505e-fd20-414a-9751-5f703de8f787 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:13.308410 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4885505e-fd20-414a-9751-5f703de8f787 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:13.321533 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4885505e-fd20-414a-9751-5f703de8f787 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:13.324297 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4885505e-fd20-414a-9751-5f703de8f787 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:13.326366 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4885505e-fd20-414a-9751-5f703de8f787 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:13.332509 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4885505e-fd20-414a-9751-5f703de8f787 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:13.334937 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4885505e-fd20-414a-9751-5f703de8f787 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:14.096070 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-78fa6033-6cd3-4e28-a805-ad9336a28b61 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:14.168626 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-78fa6033-6cd3-4e28-a805-ad9336a28b61 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:14.184980 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-78fa6033-6cd3-4e28-a805-ad9336a28b61 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:14.198838 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-78fa6033-6cd3-4e28-a805-ad9336a28b61 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1886 microversion: 2.42 time: 1.336121 Aug 07 01:27:14.218031 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1482/3266] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:12 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1886 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:14.228639 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2a13aeb4-57b6-446a-a151-8ab7c19cf8d8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:14.245870 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2a13aeb4-57b6-446a-a151-8ab7c19cf8d8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 69381f01-4547-4f10-845d-04b426d685cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:14.269125 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2a13aeb4-57b6-446a-a151-8ab7c19cf8d8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:14.270368 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2a13aeb4-57b6-446a-a151-8ab7c19cf8d8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:14.289825 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2a13aeb4-57b6-446a-a151-8ab7c19cf8d8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:14.296178 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2a13aeb4-57b6-446a-a151-8ab7c19cf8d8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:14.296707 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2a13aeb4-57b6-446a-a151-8ab7c19cf8d8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:14.298072 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2a13aeb4-57b6-446a-a151-8ab7c19cf8d8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:15.275604 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4885505e-fd20-414a-9751-5f703de8f787 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:15.302118 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4885505e-fd20-414a-9751-5f703de8f787 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:15.305279 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4885505e-fd20-414a-9751-5f703de8f787 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:15.310417 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4885505e-fd20-414a-9751-5f703de8f787 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1881 microversion: 2.32 time: 2.036591 Aug 07 01:27:15.314284 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1785/3267] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:13 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1881 bytes in 2042 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:15.327960 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1971ad0e-6543-4a26-b15a-64c26c82f96b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:15.331452 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1971ad0e-6543-4a26-b15a-64c26c82f96b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: f5432da5-94bc-4358-bca6-b025d2bc3186] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:15.352678 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1971ad0e-6543-4a26-b15a-64c26c82f96b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:15.354557 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1971ad0e-6543-4a26-b15a-64c26c82f96b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:15.355616 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1971ad0e-6543-4a26-b15a-64c26c82f96b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:15.357904 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1971ad0e-6543-4a26-b15a-64c26c82f96b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:15.359834 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1971ad0e-6543-4a26-b15a-64c26c82f96b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:15.361508 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1971ad0e-6543-4a26-b15a-64c26c82f96b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:15.380836 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2a13aeb4-57b6-446a-a151-8ab7c19cf8d8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:15.390319 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2a13aeb4-57b6-446a-a151-8ab7c19cf8d8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd" status: 200 len: 1315 microversion: 2.1 time: 1.170940 Aug 07 01:27:15.397719 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1483/3268] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:14 2022] GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd => generated 1315 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:15.402807 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-eaf31ad6-3da1-4d6e-b6ab-18ab3d9e9eb1 req-5d03bfd5-696c-44c1-b21c-4c2cd3831fba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "799e740e-2304-4bdf-ad6e-ea4817a92b15", "tag": "bae6d831-aaf8-4653-86fb-18251963e1b9"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:15.427140 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-eaf31ad6-3da1-4d6e-b6ab-18ab3d9e9eb1 req-5d03bfd5-696c-44c1-b21c-4c2cd3831fba service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:15.428030 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-eaf31ad6-3da1-4d6e-b6ab-18ab3d9e9eb1 req-5d03bfd5-696c-44c1-b21c-4c2cd3831fba service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:15.430564 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-eaf31ad6-3da1-4d6e-b6ab-18ab3d9e9eb1 req-5d03bfd5-696c-44c1-b21c-4c2cd3831fba service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:15.477166 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:15.479486 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-eaf31ad6-3da1-4d6e-b6ab-18ab3d9e9eb1 req-5d03bfd5-696c-44c1-b21c-4c2cd3831fba service nova] Creating event network-changed:bae6d831-aaf8-4653-86fb-18251963e1b9 for instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 on n-h1-master-1 Aug 07 01:27:15.487135 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-eaf31ad6-3da1-4d6e-b6ab-18ab3d9e9eb1 req-5d03bfd5-696c-44c1-b21c-4c2cd3831fba service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088117 Aug 07 01:27:15.488035 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1484/3269] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:27:15.493527 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-71646eda-a0c9-47f6-8123-a40be869f47f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:15.494159 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-71646eda-a0c9-47f6-8123-a40be869f47f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 2a78e835-73be-4ac9-bfd9-9b13009845ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:15.521038 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-71646eda-a0c9-47f6-8123-a40be869f47f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:15.522811 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-71646eda-a0c9-47f6-8123-a40be869f47f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:15.523603 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-71646eda-a0c9-47f6-8123-a40be869f47f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:15.530940 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-71646eda-a0c9-47f6-8123-a40be869f47f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:15.532125 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-71646eda-a0c9-47f6-8123-a40be869f47f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:15.533095 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-71646eda-a0c9-47f6-8123-a40be869f47f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:15.705085 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-71646eda-a0c9-47f6-8123-a40be869f47f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:15.718591 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-71646eda-a0c9-47f6-8123-a40be869f47f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca" status: 200 len: 1345 microversion: 2.1 time: 0.228231 Aug 07 01:27:15.720832 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1485/3270] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:15 2022] GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca => generated 1345 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:15.728276 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-771012e6-6b77-4aac-bdb9-10d96f2b83f5 req-168b4462-02c8-467e-b620-f95bdb3db4d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a78e835-73be-4ac9-bfd9-9b13009845ca", "name": "network-vif-deleted", "tag": "42ae2720-0d84-474b-a284-0714e94c1948"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:15.759502 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-771012e6-6b77-4aac-bdb9-10d96f2b83f5 req-168b4462-02c8-467e-b620-f95bdb3db4d4 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:15.760784 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-771012e6-6b77-4aac-bdb9-10d96f2b83f5 req-168b4462-02c8-467e-b620-f95bdb3db4d4 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:15.761407 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-771012e6-6b77-4aac-bdb9-10d96f2b83f5 req-168b4462-02c8-467e-b620-f95bdb3db4d4 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:15.794529 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-771012e6-6b77-4aac-bdb9-10d96f2b83f5 req-168b4462-02c8-467e-b620-f95bdb3db4d4 service nova] Creating event network-vif-deleted:42ae2720-0d84-474b-a284-0714e94c1948 for instance 2a78e835-73be-4ac9-bfd9-9b13009845ca on n-h1-master-1 Aug 07 01:27:15.807344 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-771012e6-6b77-4aac-bdb9-10d96f2b83f5 req-168b4462-02c8-467e-b620-f95bdb3db4d4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084429 Aug 07 01:27:15.810334 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1486/3271] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:27:15.821334 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-75cdd901-2440-4b2f-8278-21aacd397511 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:15.825583 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-75cdd901-2440-4b2f-8278-21aacd397511 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:15.841243 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75cdd901-2440-4b2f-8278-21aacd397511 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:15.844350 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75cdd901-2440-4b2f-8278-21aacd397511 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:15.845720 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75cdd901-2440-4b2f-8278-21aacd397511 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:15.850185 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75cdd901-2440-4b2f-8278-21aacd397511 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:15.851068 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75cdd901-2440-4b2f-8278-21aacd397511 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:15.851801 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75cdd901-2440-4b2f-8278-21aacd397511 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:16.577305 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1971ad0e-6543-4a26-b15a-64c26c82f96b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:16.600490 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1971ad0e-6543-4a26-b15a-64c26c82f96b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186" status: 200 len: 1497 microversion: 2.1 time: 1.281510 Aug 07 01:27:16.618992 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1786/3272] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:15 2022] GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186 => generated 1497 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:16.676240 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-75cdd901-2440-4b2f-8278-21aacd397511 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:16.692884 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-75cdd901-2440-4b2f-8278-21aacd397511 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:16.697741 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-75cdd901-2440-4b2f-8278-21aacd397511 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:16.703871 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-75cdd901-2440-4b2f-8278-21aacd397511 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1886 microversion: 2.42 time: 0.891329 Aug 07 01:27:16.705688 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1487/3273] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:15 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1886 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:16.713050 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-58442acb-d28f-4ec8-be9c-e35cd3fe4f9e req-20960491-c3f3-41fb-a353-8a9a20d98a00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69381f01-4547-4f10-845d-04b426d685cd", "name": "network-vif-plugged", "status": "completed", "tag": "6339ef02-96a8-47d9-8b82-d7536d6c4120"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:16.757518 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-58442acb-d28f-4ec8-be9c-e35cd3fe4f9e req-20960491-c3f3-41fb-a353-8a9a20d98a00 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:16.761446 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-58442acb-d28f-4ec8-be9c-e35cd3fe4f9e req-20960491-c3f3-41fb-a353-8a9a20d98a00 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:16.763112 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-58442acb-d28f-4ec8-be9c-e35cd3fe4f9e req-20960491-c3f3-41fb-a353-8a9a20d98a00 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:16.804004 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-58442acb-d28f-4ec8-be9c-e35cd3fe4f9e req-20960491-c3f3-41fb-a353-8a9a20d98a00 service nova] Creating event network-vif-plugged:6339ef02-96a8-47d9-8b82-d7536d6c4120 for instance 69381f01-4547-4f10-845d-04b426d685cd on n-h2-master-1 Aug 07 01:27:16.812769 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-58442acb-d28f-4ec8-be9c-e35cd3fe4f9e req-20960491-c3f3-41fb-a353-8a9a20d98a00 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104242 Aug 07 01:27:16.841127 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1488/3274] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:27:16.850131 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-85a17a53-3849-403b-8be8-a2ece38c4b17 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:16.851078 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-85a17a53-3849-403b-8be8-a2ece38c4b17 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:16.920025 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-85a17a53-3849-403b-8be8-a2ece38c4b17 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:16.922354 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-85a17a53-3849-403b-8be8-a2ece38c4b17 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:16.923765 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-85a17a53-3849-403b-8be8-a2ece38c4b17 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:16.924954 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-85a17a53-3849-403b-8be8-a2ece38c4b17 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:16.925710 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-85a17a53-3849-403b-8be8-a2ece38c4b17 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:16.926393 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-85a17a53-3849-403b-8be8-a2ece38c4b17 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:16.945961 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5d02117f-23ec-484b-bd37-31355aa1e992 tempest-ListImagesTestJSON-1882964905 tempest-ListImagesTestJSON-1882964905-project] Calling method '.version_select at 0x7f9e24882f70>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:17.061981 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5d02117f-23ec-484b-bd37-31355aa1e992 tempest-ListImagesTestJSON-1882964905 tempest-ListImagesTestJSON-1882964905-project] 10.222.0.39 "GET /compute/v2.1/images/e825bd61-bf05-4bd4-aa72-78daf2231731" status: 200 len: 784 microversion: 2.1 time: 0.440462 Aug 07 01:27:17.063773 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1787/3275] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:16 2022] GET /compute/v2.1/images/e825bd61-bf05-4bd4-aa72-78daf2231731 => generated 784 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:27:17.069785 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fea151d8-6129-4f56-8b38-1ac4ee95c35c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:17.070805 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fea151d8-6129-4f56-8b38-1ac4ee95c35c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 69381f01-4547-4f10-845d-04b426d685cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:17.081756 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fea151d8-6129-4f56-8b38-1ac4ee95c35c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:17.082965 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fea151d8-6129-4f56-8b38-1ac4ee95c35c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:17.085319 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fea151d8-6129-4f56-8b38-1ac4ee95c35c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:17.086434 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fea151d8-6129-4f56-8b38-1ac4ee95c35c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:17.088007 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fea151d8-6129-4f56-8b38-1ac4ee95c35c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:17.089372 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fea151d8-6129-4f56-8b38-1ac4ee95c35c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:17.162236 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:17.643795 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fea151d8-6129-4f56-8b38-1ac4ee95c35c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:17.651677 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fea151d8-6129-4f56-8b38-1ac4ee95c35c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd" status: 200 len: 1315 microversion: 2.1 time: 0.586452 Aug 07 01:27:17.660193 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1788/3276] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:17 2022] GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd => generated 1315 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:17.669178 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-397a1bbb-8eab-4136-9318-b5f8ca8c1279 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:17.670040 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-397a1bbb-8eab-4136-9318-b5f8ca8c1279 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 2a78e835-73be-4ac9-bfd9-9b13009845ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:17.681545 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-397a1bbb-8eab-4136-9318-b5f8ca8c1279 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:17.684672 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-397a1bbb-8eab-4136-9318-b5f8ca8c1279 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:17.685369 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-397a1bbb-8eab-4136-9318-b5f8ca8c1279 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:17.686291 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-397a1bbb-8eab-4136-9318-b5f8ca8c1279 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:17.686959 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-397a1bbb-8eab-4136-9318-b5f8ca8c1279 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:17.690888 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-397a1bbb-8eab-4136-9318-b5f8ca8c1279 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:17.721544 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-85a17a53-3849-403b-8be8-a2ece38c4b17 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:17.759592 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-85a17a53-3849-403b-8be8-a2ece38c4b17 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:17.767199 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-85a17a53-3849-403b-8be8-a2ece38c4b17 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:17.768806 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-85a17a53-3849-403b-8be8-a2ece38c4b17 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1881 microversion: 2.32 time: 0.924890 Aug 07 01:27:17.779534 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1489/3277] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:16 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1881 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:17.790278 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9c73be93-5909-4a41-8334-e1c2913009b6 tempest-ListImagesTestJSON-1882964905 tempest-ListImagesTestJSON-1882964905-project] Calling method '.version_select at 0x7f9e29a48550>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:17.866831 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9c73be93-5909-4a41-8334-e1c2913009b6 tempest-ListImagesTestJSON-1882964905 tempest-ListImagesTestJSON-1882964905-project] 10.222.0.39 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.085326 Aug 07 01:27:17.874392 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-397a1bbb-8eab-4136-9318-b5f8ca8c1279 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:17.875769 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1490/3278] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:17 2022] GET /compute/v2.1/images => generated 445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:27:17.881070 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-993001d8-2f6b-4294-bf87-5d083b70aa35 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:17.882308 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-993001d8-2f6b-4294-bf87-5d083b70aa35 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: f5432da5-94bc-4358-bca6-b025d2bc3186] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:17.884716 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-397a1bbb-8eab-4136-9318-b5f8ca8c1279 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca" status: 200 len: 1345 microversion: 2.1 time: 0.222642 Aug 07 01:27:17.896124 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1789/3279] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:17 2022] GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca => generated 1345 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:17.911932 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-4af2a598-b1b4-498f-945f-8c03888fac1a req-4ddab286-ca5b-4f51-ae39-9db6e511061d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77ed645e-669e-4167-ae78-8ce69770babf", "tag": "b49b5afb-08c7-4f77-bad9-32ce23dd63c7"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:17.912262 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-993001d8-2f6b-4294-bf87-5d083b70aa35 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:17.912262 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-993001d8-2f6b-4294-bf87-5d083b70aa35 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:17.912262 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-993001d8-2f6b-4294-bf87-5d083b70aa35 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:17.912262 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-993001d8-2f6b-4294-bf87-5d083b70aa35 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:17.912262 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-993001d8-2f6b-4294-bf87-5d083b70aa35 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:17.912262 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-993001d8-2f6b-4294-bf87-5d083b70aa35 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:17.920061 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4af2a598-b1b4-498f-945f-8c03888fac1a req-4ddab286-ca5b-4f51-ae39-9db6e511061d service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:17.923556 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4af2a598-b1b4-498f-945f-8c03888fac1a req-4ddab286-ca5b-4f51-ae39-9db6e511061d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:17.932518 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4af2a598-b1b4-498f-945f-8c03888fac1a req-4ddab286-ca5b-4f51-ae39-9db6e511061d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:17.959388 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-4af2a598-b1b4-498f-945f-8c03888fac1a req-4ddab286-ca5b-4f51-ae39-9db6e511061d service nova] Creating event network-changed:b49b5afb-08c7-4f77-bad9-32ce23dd63c7 for instance 77ed645e-669e-4167-ae78-8ce69770babf on n-h1-master-1 Aug 07 01:27:17.966249 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-4af2a598-b1b4-498f-945f-8c03888fac1a req-4ddab286-ca5b-4f51-ae39-9db6e511061d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079537 Aug 07 01:27:17.968115 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1790/3280] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:27:17.975747 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-42e45c8b-51bb-4cee-905b-6f664ab50a55 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:17.978102 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-42e45c8b-51bb-4cee-905b-6f664ab50a55 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:17.989705 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42e45c8b-51bb-4cee-905b-6f664ab50a55 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:17.990562 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42e45c8b-51bb-4cee-905b-6f664ab50a55 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:17.991242 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42e45c8b-51bb-4cee-905b-6f664ab50a55 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:17.992269 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42e45c8b-51bb-4cee-905b-6f664ab50a55 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:17.992976 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42e45c8b-51bb-4cee-905b-6f664ab50a55 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:17.993648 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42e45c8b-51bb-4cee-905b-6f664ab50a55 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:18.549832 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-993001d8-2f6b-4294-bf87-5d083b70aa35 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:18.562459 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-993001d8-2f6b-4294-bf87-5d083b70aa35 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186" status: 200 len: 1497 microversion: 2.1 time: 0.685064 Aug 07 01:27:18.567654 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1491/3281] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:17 2022] GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186 => generated 1497 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:18.577670 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2eee6ae7-f175-47eb-88c0-0b201b75d1ec tempest-ListImagesTestJSON-1882964905 tempest-ListImagesTestJSON-1882964905-project] Calling method '.version_select at 0x7f9e29a22d30>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:18.626941 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-42e45c8b-51bb-4cee-905b-6f664ab50a55 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:18.653253 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-42e45c8b-51bb-4cee-905b-6f664ab50a55 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:18.688555 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-42e45c8b-51bb-4cee-905b-6f664ab50a55 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:18.698942 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-42e45c8b-51bb-4cee-905b-6f664ab50a55 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1886 microversion: 2.42 time: 0.728913 Aug 07 01:27:18.712089 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1791/3282] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:17 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1886 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:18.712319 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2eee6ae7-f175-47eb-88c0-0b201b75d1ec tempest-ListImagesTestJSON-1882964905 tempest-ListImagesTestJSON-1882964905-project] 10.222.0.39 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.142258 Aug 07 01:27:18.712549 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1492/3283] 10.222.0.39 () {58 vars in 1143 bytes} [Sun Aug 7 01:27:18 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:27:18.721188 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ca6fcfa0-b302-4f04-8eaa-072371fa737a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:18.722919 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ca6fcfa0-b302-4f04-8eaa-072371fa737a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 69381f01-4547-4f10-845d-04b426d685cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:18.733452 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca6fcfa0-b302-4f04-8eaa-072371fa737a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:18.734293 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca6fcfa0-b302-4f04-8eaa-072371fa737a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:18.735711 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca6fcfa0-b302-4f04-8eaa-072371fa737a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:18.737002 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca6fcfa0-b302-4f04-8eaa-072371fa737a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:18.737753 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca6fcfa0-b302-4f04-8eaa-072371fa737a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:18.738657 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca6fcfa0-b302-4f04-8eaa-072371fa737a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:18.797809 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6da2a9a7-e2a1-43ff-8440-f97be323e03d tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:18.798683 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6da2a9a7-e2a1-43ff-8440-f97be323e03d tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:18.809574 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6da2a9a7-e2a1-43ff-8440-f97be323e03d tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:18.820102 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6da2a9a7-e2a1-43ff-8440-f97be323e03d tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:18.820826 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6da2a9a7-e2a1-43ff-8440-f97be323e03d tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:18.822036 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6da2a9a7-e2a1-43ff-8440-f97be323e03d tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:18.822692 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6da2a9a7-e2a1-43ff-8440-f97be323e03d tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:18.823310 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6da2a9a7-e2a1-43ff-8440-f97be323e03d tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:19.349181 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ca6fcfa0-b302-4f04-8eaa-072371fa737a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:19.367135 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ca6fcfa0-b302-4f04-8eaa-072371fa737a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd" status: 200 len: 1315 microversion: 2.1 time: 0.660783 Aug 07 01:27:19.369261 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1792/3284] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:18 2022] GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd => generated 1315 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:19.378274 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c93ce849-427d-4676-8807-477feb93e8aa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:19.379314 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c93ce849-427d-4676-8807-477feb93e8aa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 2a78e835-73be-4ac9-bfd9-9b13009845ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:19.389238 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c93ce849-427d-4676-8807-477feb93e8aa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:19.390223 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c93ce849-427d-4676-8807-477feb93e8aa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:19.391086 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c93ce849-427d-4676-8807-477feb93e8aa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:19.392388 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c93ce849-427d-4676-8807-477feb93e8aa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:19.394685 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c93ce849-427d-4676-8807-477feb93e8aa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:19.395714 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c93ce849-427d-4676-8807-477feb93e8aa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:19.535485 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c93ce849-427d-4676-8807-477feb93e8aa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:19.547032 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c93ce849-427d-4676-8807-477feb93e8aa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca" status: 200 len: 1345 microversion: 2.1 time: 0.175237 Aug 07 01:27:19.548311 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1793/3285] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:19 2022] GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca => generated 1345 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:19.594720 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0f8d4270-3144-4aad-8491-03c03a321296 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:19.596646 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0f8d4270-3144-4aad-8491-03c03a321296 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: f5432da5-94bc-4358-bca6-b025d2bc3186] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:19.604396 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f8d4270-3144-4aad-8491-03c03a321296 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:19.605198 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f8d4270-3144-4aad-8491-03c03a321296 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:19.605816 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f8d4270-3144-4aad-8491-03c03a321296 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:19.606733 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f8d4270-3144-4aad-8491-03c03a321296 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:19.607407 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f8d4270-3144-4aad-8491-03c03a321296 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:19.608405 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f8d4270-3144-4aad-8491-03c03a321296 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:19.759460 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6da2a9a7-e2a1-43ff-8440-f97be323e03d tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:19.778919 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6da2a9a7-e2a1-43ff-8440-f97be323e03d tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:19.782000 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6da2a9a7-e2a1-43ff-8440-f97be323e03d tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:19.785881 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6da2a9a7-e2a1-43ff-8440-f97be323e03d tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1881 microversion: 2.32 time: 0.991836 Aug 07 01:27:19.788039 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1493/3286] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:18 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1881 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:19.797927 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-16bbb8c8-ee55-4405-9e7c-1a488b0bc809 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:19.800277 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-16bbb8c8-ee55-4405-9e7c-1a488b0bc809 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:19.814211 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16bbb8c8-ee55-4405-9e7c-1a488b0bc809 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:19.815140 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16bbb8c8-ee55-4405-9e7c-1a488b0bc809 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:19.815857 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16bbb8c8-ee55-4405-9e7c-1a488b0bc809 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:19.817056 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16bbb8c8-ee55-4405-9e7c-1a488b0bc809 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:19.817961 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16bbb8c8-ee55-4405-9e7c-1a488b0bc809 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:19.818719 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16bbb8c8-ee55-4405-9e7c-1a488b0bc809 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:20.357685 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0f8d4270-3144-4aad-8491-03c03a321296 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:20.367496 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0f8d4270-3144-4aad-8491-03c03a321296 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186" status: 200 len: 1497 microversion: 2.1 time: 0.777769 Aug 07 01:27:20.368628 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1794/3287] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:19 2022] GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186 => generated 1497 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:27:20.390770 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-897b091f-3a15-457c-acd5-21b466c56045 req-06ee23c1-054b-40aa-a72b-0bedb92718e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "799e740e-2304-4bdf-ad6e-ea4817a92b15", "tag": "d11b2113-f2e1-4422-8f6b-9bf9b38eea92"}, {"name": "network-changed", "server_uuid": "77ed645e-669e-4167-ae78-8ce69770babf", "tag": "266d9506-a2b8-4b18-a0fc-163e3269dd34"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:20.406713 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-897b091f-3a15-457c-acd5-21b466c56045 req-06ee23c1-054b-40aa-a72b-0bedb92718e3 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:20.407203 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-897b091f-3a15-457c-acd5-21b466c56045 req-06ee23c1-054b-40aa-a72b-0bedb92718e3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:20.407646 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-897b091f-3a15-457c-acd5-21b466c56045 req-06ee23c1-054b-40aa-a72b-0bedb92718e3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:20.440810 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-897b091f-3a15-457c-acd5-21b466c56045 req-06ee23c1-054b-40aa-a72b-0bedb92718e3 service nova] Creating event network-changed:d11b2113-f2e1-4422-8f6b-9bf9b38eea92 for instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 on n-h1-master-1 Aug 07 01:27:20.441341 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-897b091f-3a15-457c-acd5-21b466c56045 req-06ee23c1-054b-40aa-a72b-0bedb92718e3 service nova] Creating event network-changed:266d9506-a2b8-4b18-a0fc-163e3269dd34 for instance 77ed645e-669e-4167-ae78-8ce69770babf on n-h1-master-1 Aug 07 01:27:20.454591 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-897b091f-3a15-457c-acd5-21b466c56045 req-06ee23c1-054b-40aa-a72b-0bedb92718e3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.084414 Aug 07 01:27:20.456048 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1795/3288] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:27:20.463815 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-414a289f-6f7c-4bfc-bf7c-b7df327a812a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:20.465465 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-414a289f-6f7c-4bfc-bf7c-b7df327a812a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 69381f01-4547-4f10-845d-04b426d685cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:20.476434 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-414a289f-6f7c-4bfc-bf7c-b7df327a812a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:20.477202 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-414a289f-6f7c-4bfc-bf7c-b7df327a812a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:20.477957 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-414a289f-6f7c-4bfc-bf7c-b7df327a812a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:20.479375 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-414a289f-6f7c-4bfc-bf7c-b7df327a812a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:20.480379 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-414a289f-6f7c-4bfc-bf7c-b7df327a812a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:20.481123 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-414a289f-6f7c-4bfc-bf7c-b7df327a812a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:21.085983 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-16bbb8c8-ee55-4405-9e7c-1a488b0bc809 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:21.099545 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-414a289f-6f7c-4bfc-bf7c-b7df327a812a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:21.114012 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-414a289f-6f7c-4bfc-bf7c-b7df327a812a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd" status: 200 len: 1502 microversion: 2.1 time: 0.656272 Aug 07 01:27:21.116141 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-16bbb8c8-ee55-4405-9e7c-1a488b0bc809 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:21.118538 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1796/3289] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:20 2022] GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd => generated 1502 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:21.123364 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-16bbb8c8-ee55-4405-9e7c-1a488b0bc809 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:21.139649 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-16bbb8c8-ee55-4405-9e7c-1a488b0bc809 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1886 microversion: 2.42 time: 1.349536 Aug 07 01:27:21.143946 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7caa32bb-3b2c-4b0e-a9b7-3de9dda01c6d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:21.156622 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1494/3290] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:19 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1886 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:21.172487 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7caa32bb-3b2c-4b0e-a9b7-3de9dda01c6d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 2a78e835-73be-4ac9-bfd9-9b13009845ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:21.189752 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-73c1c7af-0850-4722-81fe-c3b5a9b42926 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:21.191264 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-73c1c7af-0850-4722-81fe-c3b5a9b42926 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:21.194566 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7caa32bb-3b2c-4b0e-a9b7-3de9dda01c6d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:21.195326 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7caa32bb-3b2c-4b0e-a9b7-3de9dda01c6d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:21.205556 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-73c1c7af-0850-4722-81fe-c3b5a9b42926 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:21.206354 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7caa32bb-3b2c-4b0e-a9b7-3de9dda01c6d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:21.207049 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-73c1c7af-0850-4722-81fe-c3b5a9b42926 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:21.208205 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-73c1c7af-0850-4722-81fe-c3b5a9b42926 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:21.209121 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7caa32bb-3b2c-4b0e-a9b7-3de9dda01c6d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:21.209742 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7caa32bb-3b2c-4b0e-a9b7-3de9dda01c6d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:21.210204 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7caa32bb-3b2c-4b0e-a9b7-3de9dda01c6d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:21.210506 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-73c1c7af-0850-4722-81fe-c3b5a9b42926 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:21.211624 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-73c1c7af-0850-4722-81fe-c3b5a9b42926 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:21.212585 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-73c1c7af-0850-4722-81fe-c3b5a9b42926 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:21.442920 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7caa32bb-3b2c-4b0e-a9b7-3de9dda01c6d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:21.455505 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7caa32bb-3b2c-4b0e-a9b7-3de9dda01c6d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca" status: 200 len: 1345 microversion: 2.1 time: 0.330148 Aug 07 01:27:21.473226 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1797/3291] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:21 2022] GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca => generated 1345 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:21.504822 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cefcbedf-016c-45a4-b9ba-3836afbafe7b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:21.536264 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cefcbedf-016c-45a4-b9ba-3836afbafe7b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:21.536777 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cefcbedf-016c-45a4-b9ba-3836afbafe7b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:21.540861 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cefcbedf-016c-45a4-b9ba-3836afbafe7b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:21.626137 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cefcbedf-016c-45a4-b9ba-3836afbafe7b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 69381f01-4547-4f10-845d-04b426d685cd] Going to try to stop instance {{(pid=119516) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 07 01:27:21.723857 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cefcbedf-016c-45a4-b9ba-3836afbafe7b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd/action" status: 202 len: 0 microversion: 2.1 time: 0.244006 Aug 07 01:27:21.725662 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1798/3292] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:27:21 2022] POST /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:27:21.734480 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9b9bbb47-60d6-4c31-98b4-8b6483d0ae48 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:21.738949 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9b9bbb47-60d6-4c31-98b4-8b6483d0ae48 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: f5432da5-94bc-4358-bca6-b025d2bc3186] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:21.761507 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b9bbb47-60d6-4c31-98b4-8b6483d0ae48 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:21.763272 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b9bbb47-60d6-4c31-98b4-8b6483d0ae48 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:21.766402 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b9bbb47-60d6-4c31-98b4-8b6483d0ae48 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:21.767851 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b9bbb47-60d6-4c31-98b4-8b6483d0ae48 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:21.771651 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b9bbb47-60d6-4c31-98b4-8b6483d0ae48 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:21.772432 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b9bbb47-60d6-4c31-98b4-8b6483d0ae48 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:21.962874 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-73c1c7af-0850-4722-81fe-c3b5a9b42926 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:21.982052 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-73c1c7af-0850-4722-81fe-c3b5a9b42926 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:21.990310 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-73c1c7af-0850-4722-81fe-c3b5a9b42926 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:21.993510 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-73c1c7af-0850-4722-81fe-c3b5a9b42926 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1869 microversion: 2.32 time: 0.834906 Aug 07 01:27:21.998117 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1495/3293] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:21 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1869 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:22.015146 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-62f0f107-3ca6-471d-ad12-a592f88355d5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:22.016794 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-62f0f107-3ca6-471d-ad12-a592f88355d5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 69381f01-4547-4f10-845d-04b426d685cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:22.026123 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-62f0f107-3ca6-471d-ad12-a592f88355d5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:22.026839 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-62f0f107-3ca6-471d-ad12-a592f88355d5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:22.027478 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-62f0f107-3ca6-471d-ad12-a592f88355d5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:22.028439 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-62f0f107-3ca6-471d-ad12-a592f88355d5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:22.029080 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-62f0f107-3ca6-471d-ad12-a592f88355d5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:22.029688 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-62f0f107-3ca6-471d-ad12-a592f88355d5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:22.365290 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9b9bbb47-60d6-4c31-98b4-8b6483d0ae48 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:22.377017 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-62f0f107-3ca6-471d-ad12-a592f88355d5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:22.388361 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-62f0f107-3ca6-471d-ad12-a592f88355d5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd" status: 200 len: 1512 microversion: 2.1 time: 0.388287 Aug 07 01:27:22.389158 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9b9bbb47-60d6-4c31-98b4-8b6483d0ae48 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186" status: 200 len: 1497 microversion: 2.1 time: 0.656797 Aug 07 01:27:22.390278 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1799/3294] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:21 2022] GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186 => generated 1497 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:22.408539 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1496/3295] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:21 2022] GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd => generated 1512 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:22.424629 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-53dcfc9d-ae27-48d8-a79d-33ebaf025979 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:22.427806 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-53dcfc9d-ae27-48d8-a79d-33ebaf025979 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:22.438374 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53dcfc9d-ae27-48d8-a79d-33ebaf025979 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:22.439321 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53dcfc9d-ae27-48d8-a79d-33ebaf025979 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:22.440057 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53dcfc9d-ae27-48d8-a79d-33ebaf025979 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:22.441448 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53dcfc9d-ae27-48d8-a79d-33ebaf025979 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:22.442184 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53dcfc9d-ae27-48d8-a79d-33ebaf025979 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:22.443604 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53dcfc9d-ae27-48d8-a79d-33ebaf025979 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:22.990851 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dc4b4112-8e75-4ba9-93e4-bf75236a1381 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-269981629", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "cf9a6ffb-a1bc-4f16-8970-9d69635f8f75"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:23.160314 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-dc4b4112-8e75-4ba9-93e4-bf75236a1381 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] validate_networks() for [('cf9a6ffb-a1bc-4f16-8970-9d69635f8f75', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:27:23.500030 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-53dcfc9d-ae27-48d8-a79d-33ebaf025979 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:23.514277 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-53dcfc9d-ae27-48d8-a79d-33ebaf025979 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:23.516576 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-53dcfc9d-ae27-48d8-a79d-33ebaf025979 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:23.518062 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-53dcfc9d-ae27-48d8-a79d-33ebaf025979 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1886 microversion: 2.42 time: 1.099015 Aug 07 01:27:23.518910 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1497/3296] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:22 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1886 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:23.536833 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1c1b3308-a0bd-449c-908e-cbd3d95c1cd6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:23.537909 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1c1b3308-a0bd-449c-908e-cbd3d95c1cd6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 2a78e835-73be-4ac9-bfd9-9b13009845ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:23.546379 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c1b3308-a0bd-449c-908e-cbd3d95c1cd6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:23.547849 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c1b3308-a0bd-449c-908e-cbd3d95c1cd6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:23.549874 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c1b3308-a0bd-449c-908e-cbd3d95c1cd6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:23.552529 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c1b3308-a0bd-449c-908e-cbd3d95c1cd6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:23.553313 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c1b3308-a0bd-449c-908e-cbd3d95c1cd6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:23.555373 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c1b3308-a0bd-449c-908e-cbd3d95c1cd6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:23.699259 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1c1b3308-a0bd-449c-908e-cbd3d95c1cd6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:23.721777 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1c1b3308-a0bd-449c-908e-cbd3d95c1cd6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca" status: 200 len: 1345 microversion: 2.1 time: 0.201451 Aug 07 01:27:23.733457 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1498/3297] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:23 2022] GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca => generated 1345 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:23.754550 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5d53297b-daa1-4e55-95de-bc4ca7d5489b tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:23.755428 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5d53297b-daa1-4e55-95de-bc4ca7d5489b tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:23.770041 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d53297b-daa1-4e55-95de-bc4ca7d5489b tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:23.773742 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d53297b-daa1-4e55-95de-bc4ca7d5489b tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:23.774484 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d53297b-daa1-4e55-95de-bc4ca7d5489b tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:23.780963 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d53297b-daa1-4e55-95de-bc4ca7d5489b tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:23.782217 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d53297b-daa1-4e55-95de-bc4ca7d5489b tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:23.783296 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d53297b-daa1-4e55-95de-bc4ca7d5489b tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:24.274958 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5d53297b-daa1-4e55-95de-bc4ca7d5489b tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:24.295000 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5d53297b-daa1-4e55-95de-bc4ca7d5489b tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:24.297442 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5d53297b-daa1-4e55-95de-bc4ca7d5489b tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:24.299137 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5d53297b-daa1-4e55-95de-bc4ca7d5489b tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1869 microversion: 2.32 time: 0.558825 Aug 07 01:27:24.309131 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1499/3298] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:23 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1869 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:24.571265 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-dc4b4112-8e75-4ba9-93e4-bf75236a1381 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:27:24.572638 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-dc4b4112-8e75-4ba9-93e4-bf75236a1381 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:27:24.574420 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-dc4b4112-8e75-4ba9-93e4-bf75236a1381 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:27:24.576432 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-dc4b4112-8e75-4ba9-93e4-bf75236a1381 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:27:24.577855 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-dc4b4112-8e75-4ba9-93e4-bf75236a1381 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:27:24.598553 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc4b4112-8e75-4ba9-93e4-bf75236a1381 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:24.602706 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc4b4112-8e75-4ba9-93e4-bf75236a1381 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:24.603457 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc4b4112-8e75-4ba9-93e4-bf75236a1381 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:24.608296 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc4b4112-8e75-4ba9-93e4-bf75236a1381 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:24.610097 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc4b4112-8e75-4ba9-93e4-bf75236a1381 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:24.610450 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a0138677-f0f0-4de6-9e68-636886e650ac tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] Action: 'create', calling method: .version_select at 0x7f9e29a50e50>, body: {"keypair": {"name": "tempest-keypair-834053211", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzwgR08zmEi2V4rIpSpPT7umF4NToAh+JHCLrmZuO1l+KvwsCYUvcsGKfD4g4fLzMUA/E6Zw8gxgQ3tZzUx8XBlJCogHgaus8RPG3syv8mTauX2KvxXRJIRvjFlXOTeww=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:24.612085 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc4b4112-8e75-4ba9-93e4-bf75236a1381 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:24.656894 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-dc4b4112-8e75-4ba9-93e4-bf75236a1381 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Getting quotas for project 38b7f4c69d5542a88fa2870354d507ce. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:27:24.666027 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-dc4b4112-8e75-4ba9-93e4-bf75236a1381 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Getting quotas for user 8a2c261b4e794705a8725b3b7126bd73 and project 38b7f4c69d5542a88fa2870354d507ce. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:27:24.680558 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-a0138677-f0f0-4de6-9e68-636886e650ac tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] Getting quotas for project dbfccb8c7dd548d89a6bd79f2e4a7a80. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:27:24.686797 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-a0138677-f0f0-4de6-9e68-636886e650ac tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] Getting quotas for user 2d663f0a7c484595bf4377b7e3507438 and project dbfccb8c7dd548d89a6bd79f2e4a7a80. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:27:24.692956 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-dc4b4112-8e75-4ba9-93e4-bf75236a1381 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:27:24.697150 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-dc4b4112-8e75-4ba9-93e4-bf75236a1381 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:27:24.729085 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a0138677-f0f0-4de6-9e68-636886e650ac tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.418152 Aug 07 01:27:24.729588 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1500/3299] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:27:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:27:24.735227 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-6ed89ea4-3624-4722-b9b0-999a97967585 req-ea8c3231-8f67-408d-bd32-119cae1466f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "799e740e-2304-4bdf-ad6e-ea4817a92b15", "tag": "ed270649-5cff-4279-a1a6-2363fa515342"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:24.761372 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6ed89ea4-3624-4722-b9b0-999a97967585 req-ea8c3231-8f67-408d-bd32-119cae1466f8 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:24.767754 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-dc4b4112-8e75-4ba9-93e4-bf75236a1381 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.375218 Aug 07 01:27:24.768717 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1800/3300] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:27:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2378 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:27:24.780223 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6ed89ea4-3624-4722-b9b0-999a97967585 req-ea8c3231-8f67-408d-bd32-119cae1466f8 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:24.780462 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-733706df-4907-49ce-8a39-d6e05cbe78d1 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:24.780779 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6ed89ea4-3624-4722-b9b0-999a97967585 req-ea8c3231-8f67-408d-bd32-119cae1466f8 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:24.781032 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-733706df-4907-49ce-8a39-d6e05cbe78d1 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: f5432da5-94bc-4358-bca6-b025d2bc3186] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:24.789520 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-733706df-4907-49ce-8a39-d6e05cbe78d1 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:24.790071 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-733706df-4907-49ce-8a39-d6e05cbe78d1 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:24.790693 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-733706df-4907-49ce-8a39-d6e05cbe78d1 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:24.791614 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-733706df-4907-49ce-8a39-d6e05cbe78d1 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:24.792146 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-733706df-4907-49ce-8a39-d6e05cbe78d1 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:24.792779 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-733706df-4907-49ce-8a39-d6e05cbe78d1 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:24.814852 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-6ed89ea4-3624-4722-b9b0-999a97967585 req-ea8c3231-8f67-408d-bd32-119cae1466f8 service nova] Creating event network-changed:ed270649-5cff-4279-a1a6-2363fa515342 for instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 on n-h1-master-1 Aug 07 01:27:24.831511 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-6ed89ea4-3624-4722-b9b0-999a97967585 req-ea8c3231-8f67-408d-bd32-119cae1466f8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097732 Aug 07 01:27:24.832545 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1501/3301] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:27:24.839943 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-33d470e0-728a-43ff-8ff8-3070b28912f0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:24.840656 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-33d470e0-728a-43ff-8ff8-3070b28912f0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 69381f01-4547-4f10-845d-04b426d685cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:24.859518 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-33d470e0-728a-43ff-8ff8-3070b28912f0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:24.860037 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-33d470e0-728a-43ff-8ff8-3070b28912f0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:24.860689 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-33d470e0-728a-43ff-8ff8-3070b28912f0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:24.861589 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-33d470e0-728a-43ff-8ff8-3070b28912f0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:24.862269 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-33d470e0-728a-43ff-8ff8-3070b28912f0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:24.862887 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-33d470e0-728a-43ff-8ff8-3070b28912f0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:25.311558 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-33d470e0-728a-43ff-8ff8-3070b28912f0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:25.325007 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-33d470e0-728a-43ff-8ff8-3070b28912f0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd" status: 200 len: 1512 microversion: 2.1 time: 0.491202 Aug 07 01:27:25.329441 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1502/3302] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:24 2022] GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd => generated 1512 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:25.340458 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f9a03ef5-7dd8-48f0-8717-08ec905a5f57 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:25.345445 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f9a03ef5-7dd8-48f0-8717-08ec905a5f57 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:25.361996 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f9a03ef5-7dd8-48f0-8717-08ec905a5f57 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:25.363033 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f9a03ef5-7dd8-48f0-8717-08ec905a5f57 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:25.367501 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f9a03ef5-7dd8-48f0-8717-08ec905a5f57 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:25.369886 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f9a03ef5-7dd8-48f0-8717-08ec905a5f57 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:25.374348 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f9a03ef5-7dd8-48f0-8717-08ec905a5f57 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:25.380439 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f9a03ef5-7dd8-48f0-8717-08ec905a5f57 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:25.392280 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-733706df-4907-49ce-8a39-d6e05cbe78d1 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:25.409686 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-733706df-4907-49ce-8a39-d6e05cbe78d1 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186" status: 200 len: 1497 microversion: 2.1 time: 0.633000 Aug 07 01:27:25.413566 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1801/3303] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:24 2022] GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186 => generated 1497 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:25.422409 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-75f357ed-093a-49ab-8c8b-a0ff8e64fcbe tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] Calling method '.version_select at 0x7f9e249664c0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:25.466858 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-75f357ed-093a-49ab-8c8b-a0ff8e64fcbe tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] 10.222.0.39 "GET /compute/v2.1/os-keypairs/tempest-keypair-834053211" status: 200 len: 497 microversion: 2.1 time: 0.051624 Aug 07 01:27:25.477400 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1802/3304] 10.222.0.39 () {58 vars in 1215 bytes} [Sun Aug 7 01:27:25 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-834053211 => generated 497 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:27:25.488639 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fb507252-5a9f-41ed-853b-425fd0740aec tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:25.489274 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fb507252-5a9f-41ed-853b-425fd0740aec tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 2a78e835-73be-4ac9-bfd9-9b13009845ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:25.503300 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fb507252-5a9f-41ed-853b-425fd0740aec tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:25.503799 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fb507252-5a9f-41ed-853b-425fd0740aec tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:25.504268 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fb507252-5a9f-41ed-853b-425fd0740aec tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:25.511756 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fb507252-5a9f-41ed-853b-425fd0740aec tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:25.512587 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fb507252-5a9f-41ed-853b-425fd0740aec tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:25.517182 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fb507252-5a9f-41ed-853b-425fd0740aec tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:25.741207 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fb507252-5a9f-41ed-853b-425fd0740aec tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:25.760924 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fb507252-5a9f-41ed-853b-425fd0740aec tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca" status: 200 len: 1345 microversion: 2.1 time: 0.281483 Aug 07 01:27:25.762125 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1803/3305] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:25 2022] GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca => generated 1345 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:25.785244 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a790fd75-2c0e-4834-aadb-d3f420be1c60 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:25.786182 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a790fd75-2c0e-4834-aadb-d3f420be1c60 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:25.793286 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a790fd75-2c0e-4834-aadb-d3f420be1c60 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:25.794819 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a790fd75-2c0e-4834-aadb-d3f420be1c60 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:25.795800 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a790fd75-2c0e-4834-aadb-d3f420be1c60 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:25.807775 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a790fd75-2c0e-4834-aadb-d3f420be1c60 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:25.808798 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a790fd75-2c0e-4834-aadb-d3f420be1c60 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:25.809545 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a790fd75-2c0e-4834-aadb-d3f420be1c60 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:25.994003 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a790fd75-2c0e-4834-aadb-d3f420be1c60 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:26.007985 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f9a03ef5-7dd8-48f0-8717-08ec905a5f57 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:26.011456 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a790fd75-2c0e-4834-aadb-d3f420be1c60 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1220 microversion: 2.1 time: 0.231997 Aug 07 01:27:26.012085 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1804/3306] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:25 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1220 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:26.017315 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-60a7130d-3ad5-4833-b270-e482df3a6b27 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:26.017951 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-60a7130d-3ad5-4833-b270-e482df3a6b27 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:26.024452 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60a7130d-3ad5-4833-b270-e482df3a6b27 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:26.025230 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60a7130d-3ad5-4833-b270-e482df3a6b27 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:26.025846 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60a7130d-3ad5-4833-b270-e482df3a6b27 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:26.026749 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60a7130d-3ad5-4833-b270-e482df3a6b27 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:26.027399 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60a7130d-3ad5-4833-b270-e482df3a6b27 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:26.028036 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60a7130d-3ad5-4833-b270-e482df3a6b27 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:26.048202 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f9a03ef5-7dd8-48f0-8717-08ec905a5f57 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:26.055554 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f9a03ef5-7dd8-48f0-8717-08ec905a5f57 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:26.064528 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f9a03ef5-7dd8-48f0-8717-08ec905a5f57 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1886 microversion: 2.42 time: 0.733552 Aug 07 01:27:26.069203 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1503/3307] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:25 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1886 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:26.074182 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-076c5763-f221-4b6b-b356-41c2484a3357 tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] Calling method '.version_select at 0x7f9e2433f940>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:26.157577 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-076c5763-f221-4b6b-b356-41c2484a3357 tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-834053211" status: 202 len: 0 microversion: 2.1 time: 0.087126 Aug 07 01:27:26.165398 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1504/3308] 10.222.0.39 () {58 vars in 1218 bytes} [Sun Aug 7 01:27:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-834053211 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:27:26.173995 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7a6cc8e4-de2c-435b-a616-bc6de5b63818 tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] Action: 'create', calling method: .version_select at 0x7f9e2439eb80>, body: {"keypair": {"name": "tempest-keypair-2060059710", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEb6Kd4WEtMmRbvBBRxVvoMiUgKW1HTMFq1vLWkrHHI4An918XIINywYLCV7aMWnxdEvLa6EqTzAtR2i54q5dc/nfxT555FdjnqpNPXo7viZPzou/tF7ChI6+YL6nbr8gQ=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:26.221579 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-7a6cc8e4-de2c-435b-a616-bc6de5b63818 tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] Getting quotas for project dbfccb8c7dd548d89a6bd79f2e4a7a80. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:27:26.236136 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-7a6cc8e4-de2c-435b-a616-bc6de5b63818 tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] Getting quotas for user 2d663f0a7c484595bf4377b7e3507438 and project dbfccb8c7dd548d89a6bd79f2e4a7a80. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:27:26.299135 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7a6cc8e4-de2c-435b-a616-bc6de5b63818 tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.131517 Aug 07 01:27:26.301107 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1505/3309] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:27:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:27:26.315583 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cac135e3-0547-4a4f-ba15-4d7f5ac64ffc tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] Calling method '.version_select at 0x7f9e17f82430>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:26.344637 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cac135e3-0547-4a4f-ba15-4d7f5ac64ffc tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2060059710" status: 202 len: 0 microversion: 2.1 time: 0.037029 Aug 07 01:27:26.346620 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1506/3310] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Aug 7 01:27:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2060059710 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 01:27:26.355366 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9a159883-3828-4b12-b3c4-548d79d94d81 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:26.356633 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9a159883-3828-4b12-b3c4-548d79d94d81 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 69381f01-4547-4f10-845d-04b426d685cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:26.365721 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a159883-3828-4b12-b3c4-548d79d94d81 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:26.366787 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a159883-3828-4b12-b3c4-548d79d94d81 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:26.367464 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a159883-3828-4b12-b3c4-548d79d94d81 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:26.368479 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a159883-3828-4b12-b3c4-548d79d94d81 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:26.369111 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a159883-3828-4b12-b3c4-548d79d94d81 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:26.369710 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a159883-3828-4b12-b3c4-548d79d94d81 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:26.611710 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-60a7130d-3ad5-4833-b270-e482df3a6b27 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:26.626225 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-60a7130d-3ad5-4833-b270-e482df3a6b27 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:26.636498 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-60a7130d-3ad5-4833-b270-e482df3a6b27 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:26.640468 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-60a7130d-3ad5-4833-b270-e482df3a6b27 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1869 microversion: 2.32 time: 0.627334 Aug 07 01:27:26.646664 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1805/3311] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:26 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1869 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:26.658231 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2e16c656-fd0d-4b9f-b7bd-267c40f9690b tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] Action: 'create', calling method: .version_select at 0x7f9e179b7940>, body: {"keypair": {"name": "tempest-keypair-1096179033", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:26.712235 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-2e16c656-fd0d-4b9f-b7bd-267c40f9690b tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] Getting quotas for project dbfccb8c7dd548d89a6bd79f2e4a7a80. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:27:26.729354 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-2e16c656-fd0d-4b9f-b7bd-267c40f9690b tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] Getting quotas for user 2d663f0a7c484595bf4377b7e3507438 and project dbfccb8c7dd548d89a6bd79f2e4a7a80. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:27:26.731159 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9a159883-3828-4b12-b3c4-548d79d94d81 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:26.749068 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9a159883-3828-4b12-b3c4-548d79d94d81 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd" status: 200 len: 1512 microversion: 2.1 time: 0.400933 Aug 07 01:27:26.749684 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1507/3312] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:26 2022] GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd => generated 1512 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:26.755757 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e3ad5ac5-dead-4fec-9e11-7a1866b878a4 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:26.756418 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e3ad5ac5-dead-4fec-9e11-7a1866b878a4 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: f5432da5-94bc-4358-bca6-b025d2bc3186] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:26.790042 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3ad5ac5-dead-4fec-9e11-7a1866b878a4 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:26.790549 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3ad5ac5-dead-4fec-9e11-7a1866b878a4 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:26.791026 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3ad5ac5-dead-4fec-9e11-7a1866b878a4 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:26.792265 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3ad5ac5-dead-4fec-9e11-7a1866b878a4 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:26.792845 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3ad5ac5-dead-4fec-9e11-7a1866b878a4 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:26.793393 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3ad5ac5-dead-4fec-9e11-7a1866b878a4 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:26.817649 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2e16c656-fd0d-4b9f-b7bd-267c40f9690b tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.156186 Aug 07 01:27:26.823541 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1806/3313] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:27:26 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:27:26.827444 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5bd4a479-f8df-408c-9dc5-06705c44d515 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:26.828750 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5bd4a479-f8df-408c-9dc5-06705c44d515 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 2a78e835-73be-4ac9-bfd9-9b13009845ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:26.852760 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5bd4a479-f8df-408c-9dc5-06705c44d515 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:26.854518 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5bd4a479-f8df-408c-9dc5-06705c44d515 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:26.856580 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5bd4a479-f8df-408c-9dc5-06705c44d515 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:26.858866 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5bd4a479-f8df-408c-9dc5-06705c44d515 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:26.859679 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5bd4a479-f8df-408c-9dc5-06705c44d515 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:26.862223 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5bd4a479-f8df-408c-9dc5-06705c44d515 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:27.033304 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5bd4a479-f8df-408c-9dc5-06705c44d515 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:27.048931 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5bd4a479-f8df-408c-9dc5-06705c44d515 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca" status: 200 len: 1345 microversion: 2.1 time: 0.226950 Aug 07 01:27:27.057158 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1807/3314] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:26 2022] GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca => generated 1345 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:27.064898 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-82050a27-20db-4406-9882-84b14b5989a8 tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] Calling method '.version_select at 0x7f9e2482a670>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:27.098588 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-82050a27-20db-4406-9882-84b14b5989a8 tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1096179033" status: 202 len: 0 microversion: 2.1 time: 0.039525 Aug 07 01:27:27.106407 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1808/3315] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Aug 7 01:27:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1096179033 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:27:27.113395 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-acd0609b-dcd1-4f5a-8df9-3bb1497fe055 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:27.117266 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-acd0609b-dcd1-4f5a-8df9-3bb1497fe055 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:27.128938 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-acd0609b-dcd1-4f5a-8df9-3bb1497fe055 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:27.129572 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-acd0609b-dcd1-4f5a-8df9-3bb1497fe055 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:27.130305 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-acd0609b-dcd1-4f5a-8df9-3bb1497fe055 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:27.131293 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-acd0609b-dcd1-4f5a-8df9-3bb1497fe055 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:27.132052 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-acd0609b-dcd1-4f5a-8df9-3bb1497fe055 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:27.132753 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-acd0609b-dcd1-4f5a-8df9-3bb1497fe055 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:27.138195 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:27.372314 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-acd0609b-dcd1-4f5a-8df9-3bb1497fe055 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:27.385680 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-acd0609b-dcd1-4f5a-8df9-3bb1497fe055 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1274 microversion: 2.1 time: 0.277148 Aug 07 01:27:27.387995 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1809/3316] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:27 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1274 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:27.404957 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e0dee08c-7736-436b-905a-5a83eb93817e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:27.406592 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e0dee08c-7736-436b-905a-5a83eb93817e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:27.417255 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0dee08c-7736-436b-905a-5a83eb93817e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:27.422842 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0dee08c-7736-436b-905a-5a83eb93817e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:27.423827 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0dee08c-7736-436b-905a-5a83eb93817e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:27.425268 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0dee08c-7736-436b-905a-5a83eb93817e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:27.426021 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0dee08c-7736-436b-905a-5a83eb93817e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:27.426682 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e0dee08c-7736-436b-905a-5a83eb93817e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:27.446871 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e3ad5ac5-dead-4fec-9e11-7a1866b878a4 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:27.462529 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e3ad5ac5-dead-4fec-9e11-7a1866b878a4 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186" status: 200 len: 1474 microversion: 2.1 time: 0.709488 Aug 07 01:27:27.463332 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1508/3317] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:26 2022] GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186 => generated 1474 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:27.475685 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-64543ff5-a540-42a7-9be8-b0995188e7db tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] Action: 'create', calling method: .version_select at 0x7f9e17f825e0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-929233743", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMX3z1NRsUBQ3G3Oeuud7dhrdT+5w3yYiD0DRRlr2sxOr2SGlh6j2U+mgVqgoL3r86LQV2DgDionNUL/TJBKbm7XuXpXjmHk22ks5J8Ysd5azrBrFpuAcmt2gUIT7pToIw=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:27.489601 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:27.525592 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-64543ff5-a540-42a7-9be8-b0995188e7db tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] Getting quotas for project dbfccb8c7dd548d89a6bd79f2e4a7a80. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:27:27.562175 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-64543ff5-a540-42a7-9be8-b0995188e7db tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] Getting quotas for user 2d663f0a7c484595bf4377b7e3507438 and project dbfccb8c7dd548d89a6bd79f2e4a7a80. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:27:27.629322 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-64543ff5-a540-42a7-9be8-b0995188e7db tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.163927 Aug 07 01:27:27.638563 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1509/3318] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:27:27 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:27:27.638953 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ad80baf9-590e-4c03-8257-a0f41a04ac6b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1124816071"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:27.642535 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ad80baf9-590e-4c03-8257-a0f41a04ac6b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: f5432da5-94bc-4358-bca6-b025d2bc3186] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:27.653486 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad80baf9-590e-4c03-8257-a0f41a04ac6b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:27.654139 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad80baf9-590e-4c03-8257-a0f41a04ac6b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:27.654597 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad80baf9-590e-4c03-8257-a0f41a04ac6b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:27.655364 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad80baf9-590e-4c03-8257-a0f41a04ac6b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:27.655836 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad80baf9-590e-4c03-8257-a0f41a04ac6b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:27.656331 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad80baf9-590e-4c03-8257-a0f41a04ac6b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:27.683395 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:28.113568 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ad80baf9-590e-4c03-8257-a0f41a04ac6b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "POST /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186/action" status: 202 len: 0 microversion: 2.1 time: 0.481384 Aug 07 01:27:28.121367 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1510/3319] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:27:27 2022] POST /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186/action => generated 0 bytes in 483 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 07 01:27:28.128130 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ba362aa8-3439-4abb-85be-7a942a6a64a7 tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] Action: 'create', calling method: .version_select at 0x7f9e246355e0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2052562819", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHI2YH2gJBG3RXKOnWWwCiNDG7MZQsBQCVRCYbNL23buVwnmj0z5Dur+f6/cjSTSh3NIO6M1YfAaomxnR/DjvurvsEYAgNTgH3DP/7lBKPt9V8ienHsSV0WCIkOWwSzHog=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:28.142136 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e0dee08c-7736-436b-905a-5a83eb93817e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:28.155498 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-ba362aa8-3439-4abb-85be-7a942a6a64a7 tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] Getting quotas for project dbfccb8c7dd548d89a6bd79f2e4a7a80. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:27:28.155770 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e0dee08c-7736-436b-905a-5a83eb93817e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:28.158370 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e0dee08c-7736-436b-905a-5a83eb93817e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:28.160295 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e0dee08c-7736-436b-905a-5a83eb93817e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1886 microversion: 2.42 time: 0.770391 Aug 07 01:27:28.161225 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1810/3320] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:27 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1886 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:28.165861 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-ba362aa8-3439-4abb-85be-7a942a6a64a7 tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] Getting quotas for user 2d663f0a7c484595bf4377b7e3507438 and project dbfccb8c7dd548d89a6bd79f2e4a7a80. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:27:28.167062 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cad3ca7a-9472-44c0-ac6c-6e7b0273e9c5 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:28.167950 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cad3ca7a-9472-44c0-ac6c-6e7b0273e9c5 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:28.175253 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cad3ca7a-9472-44c0-ac6c-6e7b0273e9c5 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:28.176124 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cad3ca7a-9472-44c0-ac6c-6e7b0273e9c5 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:28.176767 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cad3ca7a-9472-44c0-ac6c-6e7b0273e9c5 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:28.177680 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cad3ca7a-9472-44c0-ac6c-6e7b0273e9c5 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:28.178378 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cad3ca7a-9472-44c0-ac6c-6e7b0273e9c5 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:28.179169 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cad3ca7a-9472-44c0-ac6c-6e7b0273e9c5 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:28.216394 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ba362aa8-3439-4abb-85be-7a942a6a64a7 tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.093074 Aug 07 01:27:28.217441 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1511/3321] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:27:28 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:27:28.224620 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7cb0356c-3353-4218-afb8-8c2719d3d110 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:28.225979 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7cb0356c-3353-4218-afb8-8c2719d3d110 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 69381f01-4547-4f10-845d-04b426d685cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:28.236684 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7cb0356c-3353-4218-afb8-8c2719d3d110 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:28.237931 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7cb0356c-3353-4218-afb8-8c2719d3d110 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:28.239169 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7cb0356c-3353-4218-afb8-8c2719d3d110 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:28.240122 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7cb0356c-3353-4218-afb8-8c2719d3d110 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:28.240838 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7cb0356c-3353-4218-afb8-8c2719d3d110 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:28.241282 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7cb0356c-3353-4218-afb8-8c2719d3d110 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:28.680194 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cad3ca7a-9472-44c0-ac6c-6e7b0273e9c5 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:28.704608 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cad3ca7a-9472-44c0-ac6c-6e7b0273e9c5 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:28.708552 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cad3ca7a-9472-44c0-ac6c-6e7b0273e9c5 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:28.711298 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cad3ca7a-9472-44c0-ac6c-6e7b0273e9c5 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1869 microversion: 2.32 time: 0.548318 Aug 07 01:27:28.729838 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1811/3322] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:28 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1869 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:28.735860 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2cd35dcb-c8f4-45db-aba9-fb23ba68bf85 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:28.736675 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2cd35dcb-c8f4-45db-aba9-fb23ba68bf85 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 2a78e835-73be-4ac9-bfd9-9b13009845ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:28.743155 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2cd35dcb-c8f4-45db-aba9-fb23ba68bf85 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:28.743594 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2cd35dcb-c8f4-45db-aba9-fb23ba68bf85 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:28.744073 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2cd35dcb-c8f4-45db-aba9-fb23ba68bf85 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:28.745073 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2cd35dcb-c8f4-45db-aba9-fb23ba68bf85 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:28.745721 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2cd35dcb-c8f4-45db-aba9-fb23ba68bf85 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:28.746079 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2cd35dcb-c8f4-45db-aba9-fb23ba68bf85 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:28.763775 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-2cd35dcb-c8f4-45db-aba9-fb23ba68bf85 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] HTTP exception thrown: Instance 2a78e835-73be-4ac9-bfd9-9b13009845ca could not be found. Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2cd35dcb-c8f4-45db-aba9-fb23ba68bf85 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Request method failure captured: Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca HTTP/1.1 Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xRoqM1ZK4H7GtvmxWX9ofAmOsKF2OdU6k1rehi-6yk86CpmfTNVcE0kwd9G1ahgJHyDlEB2bKz4XbnD5Ku_zcl240Q-kfWeKv3HfC_GyXmFAQWa4hNXP2nUgxgBXBe_oBb5a-t1xlRXFxfo9n87AmGbLBI9ZdV03LZwWshVd2n0WvE Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5506f7c95c1a46c5b3966597764b0111", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: d1f0c01c340940388b440932d51988ff Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 2a78e835-73be-4ac9-bfd9-9b13009845ca could not be found. Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '2a78e835-73be-4ac9-bfd9-9b13009845ca'} Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a78e835-73be-4ac9-bfd9-9b13009845ca could not be found. Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a78e835-73be-4ac9-bfd9-9b13009845ca could not be found. Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:27:28.765579 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:28.771728 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:27:28.771728 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:27:28.771728 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:27:28.771728 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:27:28.771728 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:27:28.771728 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a78e835-73be-4ac9-bfd9-9b13009845ca could not be found. Aug 07 01:27:28.771728 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:28.771728 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2cd35dcb-c8f4-45db-aba9-fb23ba68bf85 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Returning 404 to user: Instance 2a78e835-73be-4ac9-bfd9-9b13009845ca could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:27:28.771728 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2cd35dcb-c8f4-45db-aba9-fb23ba68bf85 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca" status: 404 len: 111 microversion: 2.1 time: 0.035756 Aug 07 01:27:28.771728 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1812/3323] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:28 2022] GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:27:28.776929 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ef541005-2e83-4dda-b4bc-d6c395bef133 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e17aeab80>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:28.844354 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ef541005-2e83-4dda-b4bc-d6c395bef133 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6" status: 200 len: 1414 microversion: 2.1 time: 0.071131 Aug 07 01:27:28.845570 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1813/3324] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:28 2022] GET /compute/v2.1/images/f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6 => generated 1414 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:28.862199 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-45516db5-f362-45cc-9109-147770eb7469 tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] Action: 'create', calling method: .version_select at 0x7f9e17a7d670>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-214675764", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAB7M9pRkYpgZEMMISbscgyYP+xRy1XACtTuuZiH5DfJw6Ghl0L8B3tQeJAwfsrC1zZj2NlE6Ixf7Lkdr/Rl7EvSduuK62MCE9TBe9/mlAyRW2yMhXLdvpSakPNM7MEPjA=="}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:28.938900 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-45516db5-f362-45cc-9109-147770eb7469 tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] Getting quotas for project dbfccb8c7dd548d89a6bd79f2e4a7a80. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:27:28.948754 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-45516db5-f362-45cc-9109-147770eb7469 tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] Getting quotas for user 2d663f0a7c484595bf4377b7e3507438 and project dbfccb8c7dd548d89a6bd79f2e4a7a80. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:27:28.949252 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7cb0356c-3353-4218-afb8-8c2719d3d110 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:28.955323 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:28.988305 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7cb0356c-3353-4218-afb8-8c2719d3d110 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd" status: 200 len: 1512 microversion: 2.1 time: 0.768683 Aug 07 01:27:28.993074 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-45516db5-f362-45cc-9109-147770eb7469 tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.136325 Aug 07 01:27:28.996229 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1814/3325] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:27:28 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:27:29.000482 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1512/3326] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:28 2022] GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd => generated 1512 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:29.013469 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-73c0d7c9-7076-4b6b-b0c8-32ad39bfae54 tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] Calling method '.version_select at 0x7f9e242dc310>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:29.013745 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bc0426cc-484e-40d7-bea1-5001c8bc7b1a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:29.013745 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bc0426cc-484e-40d7-bea1-5001c8bc7b1a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:29.018806 n-d-master-1 devstack@n-api.service[119517]: WARNING oslo_db.sqlalchemy.utils [None req-73c0d7c9-7076-4b6b-b0c8-32ad39bfae54 tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 07 01:27:29.025296 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bc0426cc-484e-40d7-bea1-5001c8bc7b1a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:29.028925 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bc0426cc-484e-40d7-bea1-5001c8bc7b1a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:29.029736 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bc0426cc-484e-40d7-bea1-5001c8bc7b1a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:29.030760 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bc0426cc-484e-40d7-bea1-5001c8bc7b1a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:29.032063 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bc0426cc-484e-40d7-bea1-5001c8bc7b1a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:29.032755 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bc0426cc-484e-40d7-bea1-5001c8bc7b1a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:29.041871 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-73c0d7c9-7076-4b6b-b0c8-32ad39bfae54 tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] 10.222.0.39 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.038867 Aug 07 01:27:29.049728 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1513/3327] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Aug 7 01:27:29 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:29.054997 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d435605a-4819-43a0-b1b7-cf1660325cef tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] Calling method '.version_select at 0x7f9e29a28c10>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:29.117235 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d435605a-4819-43a0-b1b7-cf1660325cef tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-214675764" status: 202 len: 0 microversion: 2.1 time: 0.065933 Aug 07 01:27:29.122567 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1514/3328] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Aug 7 01:27:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-214675764 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:27:29.128797 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0e17aac2-d3b4-4115-8307-bf144d32691e tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] Calling method '.version_select at 0x7f9e24589280>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:29.176105 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0e17aac2-d3b4-4115-8307-bf144d32691e tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2052562819" status: 202 len: 0 microversion: 2.1 time: 0.051517 Aug 07 01:27:29.181146 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1515/3329] 10.222.0.39 () {58 vars in 1278 bytes} [Sun Aug 7 01:27:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2052562819 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:27:29.189120 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ec924f8b-aefd-400b-ba40-971ae4f61795 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:29.192861 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ec924f8b-aefd-400b-ba40-971ae4f61795 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:29.228868 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ec924f8b-aefd-400b-ba40-971ae4f61795 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:29.230659 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ec924f8b-aefd-400b-ba40-971ae4f61795 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:29.232118 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ec924f8b-aefd-400b-ba40-971ae4f61795 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:29.233757 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ec924f8b-aefd-400b-ba40-971ae4f61795 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:29.235007 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ec924f8b-aefd-400b-ba40-971ae4f61795 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:29.236247 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ec924f8b-aefd-400b-ba40-971ae4f61795 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:29.818400 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bc0426cc-484e-40d7-bea1-5001c8bc7b1a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:29.832107 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bc0426cc-484e-40d7-bea1-5001c8bc7b1a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1274 microversion: 2.1 time: 0.832211 Aug 07 01:27:29.841893 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1815/3330] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:28 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1274 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:29.873429 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1fadb4ed-fd13-4356-9dc7-f643dc1efea0 tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] Calling method '.version_select at 0x7f9e24389af0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:29.912653 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ec924f8b-aefd-400b-ba40-971ae4f61795 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:29.947190 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ec924f8b-aefd-400b-ba40-971ae4f61795 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:29.947803 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1fadb4ed-fd13-4356-9dc7-f643dc1efea0 tempest-KeyPairsV2TestJSON-1448995251 tempest-KeyPairsV2TestJSON-1448995251-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-929233743" status: 202 len: 0 microversion: 2.1 time: 0.103820 Aug 07 01:27:29.950914 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ec924f8b-aefd-400b-ba40-971ae4f61795 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:29.957739 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1816/3331] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Aug 7 01:27:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-929233743 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:27:29.957998 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ec924f8b-aefd-400b-ba40-971ae4f61795 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1886 microversion: 2.42 time: 0.774905 Aug 07 01:27:29.962615 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1516/3332] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:29 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1886 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:29.967682 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8843a9a4-8ef3-453f-8ff7-0e5f8e57fd33 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:29.971912 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-92cce136-8bd3-42a6-a9e6-97f10254cdb0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:29.973576 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8843a9a4-8ef3-453f-8ff7-0e5f8e57fd33 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:29.982466 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-92cce136-8bd3-42a6-a9e6-97f10254cdb0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 2a78e835-73be-4ac9-bfd9-9b13009845ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:30.004173 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92cce136-8bd3-42a6-a9e6-97f10254cdb0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:30.004427 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8843a9a4-8ef3-453f-8ff7-0e5f8e57fd33 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:30.005565 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92cce136-8bd3-42a6-a9e6-97f10254cdb0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:30.006052 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8843a9a4-8ef3-453f-8ff7-0e5f8e57fd33 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:30.006710 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8843a9a4-8ef3-453f-8ff7-0e5f8e57fd33 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:30.007999 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8843a9a4-8ef3-453f-8ff7-0e5f8e57fd33 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:30.009144 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8843a9a4-8ef3-453f-8ff7-0e5f8e57fd33 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:30.009374 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92cce136-8bd3-42a6-a9e6-97f10254cdb0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:30.010283 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92cce136-8bd3-42a6-a9e6-97f10254cdb0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:30.011448 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8843a9a4-8ef3-453f-8ff7-0e5f8e57fd33 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:30.013802 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92cce136-8bd3-42a6-a9e6-97f10254cdb0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:30.014457 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92cce136-8bd3-42a6-a9e6-97f10254cdb0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:30.069279 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-92cce136-8bd3-42a6-a9e6-97f10254cdb0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] HTTP exception thrown: Instance 2a78e835-73be-4ac9-bfd9-9b13009845ca could not be found. Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-92cce136-8bd3-42a6-a9e6-97f10254cdb0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Request method failure captured: Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca/os-volume_attachments HTTP/1.1 Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xRoqM1ZK4H7GtvmxWX9ofAmOsKF2OdU6k1rehi-6yk86CpmfTNVcE0kwd9G1ahgJHyDlEB2bKz4XbnD5Ku_zcl240Q-kfWeKv3HfC_GyXmFAQWa4hNXP2nUgxgBXBe_oBb5a-t1xlRXFxfo9n87AmGbLBI9ZdV03LZwWshVd2n0WvE Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5506f7c95c1a46c5b3966597764b0111", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: d1f0c01c340940388b440932d51988ff Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 2a78e835-73be-4ac9-bfd9-9b13009845ca could not be found. Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: action_args: {'server_id': '2a78e835-73be-4ac9-bfd9-9b13009845ca'} Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a78e835-73be-4ac9-bfd9-9b13009845ca could not be found. Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:27:30.070829 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:27:30.080061 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a78e835-73be-4ac9-bfd9-9b13009845ca could not be found. Aug 07 01:27:30.080061 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:30.080061 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:27:30.080061 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:30.080061 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:27:30.080061 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:27:30.080061 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:27:30.080061 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:27:30.080061 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:27:30.080061 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a78e835-73be-4ac9-bfd9-9b13009845ca could not be found. Aug 07 01:27:30.080061 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:30.080061 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-92cce136-8bd3-42a6-a9e6-97f10254cdb0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Returning 404 to user: Instance 2a78e835-73be-4ac9-bfd9-9b13009845ca could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:27:30.080061 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-92cce136-8bd3-42a6-a9e6-97f10254cdb0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.112673 Aug 07 01:27:30.094168 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1817/3333] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:27:29 2022] GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca/os-volume_attachments => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:27:30.109853 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d6f142f1-695d-49f4-a197-c4097e3f14f7 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e179faee0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:30.222963 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d6f142f1-695d-49f4-a197-c4097e3f14f7 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6" status: 200 len: 1414 microversion: 2.1 time: 0.121598 Aug 07 01:27:30.224265 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1818/3334] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:30 2022] GET /compute/v2.1/images/f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6 => generated 1414 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:30.258647 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c654b437-824d-4850-9e6c-db860dced3b3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:30.259771 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c654b437-824d-4850-9e6c-db860dced3b3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 69381f01-4547-4f10-845d-04b426d685cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:30.289743 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c654b437-824d-4850-9e6c-db860dced3b3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:30.290248 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c654b437-824d-4850-9e6c-db860dced3b3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:30.290707 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c654b437-824d-4850-9e6c-db860dced3b3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:30.301439 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c654b437-824d-4850-9e6c-db860dced3b3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:30.302215 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c654b437-824d-4850-9e6c-db860dced3b3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:30.302910 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c654b437-824d-4850-9e6c-db860dced3b3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:31.330485 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c654b437-824d-4850-9e6c-db860dced3b3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:31.396650 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c654b437-824d-4850-9e6c-db860dced3b3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd" status: 200 len: 1512 microversion: 2.1 time: 1.156890 Aug 07 01:27:31.398059 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1819/3335] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:30 2022] GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd => generated 1512 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:31.457789 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-65e0cc94-696c-43b5-9af7-b4a919062433 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1082870931", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "554905b9-fa00-4877-bc90-609c81108292"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:31.952231 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-65e0cc94-696c-43b5-9af7-b4a919062433 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] validate_networks() for [('554905b9-fa00-4877-bc90-609c81108292', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:27:33.057917 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8843a9a4-8ef3-453f-8ff7-0e5f8e57fd33 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:33.103876 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8843a9a4-8ef3-453f-8ff7-0e5f8e57fd33 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:33.111396 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8843a9a4-8ef3-453f-8ff7-0e5f8e57fd33 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:33.114120 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8843a9a4-8ef3-453f-8ff7-0e5f8e57fd33 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1869 microversion: 2.32 time: 3.150144 Aug 07 01:27:33.124379 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1517/3336] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:29 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1869 bytes in 3161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:33.143665 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c6244591-d163-4351-9cb4-fe626d58a09d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:33.156375 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c6244591-d163-4351-9cb4-fe626d58a09d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:33.186235 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6244591-d163-4351-9cb4-fe626d58a09d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:33.186746 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6244591-d163-4351-9cb4-fe626d58a09d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:33.187751 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6244591-d163-4351-9cb4-fe626d58a09d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:33.189421 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6244591-d163-4351-9cb4-fe626d58a09d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:33.190568 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6244591-d163-4351-9cb4-fe626d58a09d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:33.191029 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6244591-d163-4351-9cb4-fe626d58a09d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:33.894049 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-65e0cc94-696c-43b5-9af7-b4a919062433 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:27:33.901900 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-65e0cc94-696c-43b5-9af7-b4a919062433 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:27:33.902830 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-65e0cc94-696c-43b5-9af7-b4a919062433 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:27:33.903466 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-65e0cc94-696c-43b5-9af7-b4a919062433 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:27:33.904974 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-65e0cc94-696c-43b5-9af7-b4a919062433 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:27:33.921893 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-65e0cc94-696c-43b5-9af7-b4a919062433 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:33.923214 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-65e0cc94-696c-43b5-9af7-b4a919062433 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:33.923720 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-65e0cc94-696c-43b5-9af7-b4a919062433 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:33.926293 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-65e0cc94-696c-43b5-9af7-b4a919062433 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:33.927611 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-65e0cc94-696c-43b5-9af7-b4a919062433 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:33.928310 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-65e0cc94-696c-43b5-9af7-b4a919062433 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:33.981995 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-65e0cc94-696c-43b5-9af7-b4a919062433 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Getting quotas for project 5506f7c95c1a46c5b3966597764b0111. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:27:33.999102 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-65e0cc94-696c-43b5-9af7-b4a919062433 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Getting quotas for user d1f0c01c340940388b440932d51988ff and project 5506f7c95c1a46c5b3966597764b0111. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:27:34.092676 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-65e0cc94-696c-43b5-9af7-b4a919062433 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:27:34.110831 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-65e0cc94-696c-43b5-9af7-b4a919062433 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 8f35f41f-1a7c-45c0-8958-216eb837382c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:27:34.309252 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-65e0cc94-696c-43b5-9af7-b4a919062433 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.900399 Aug 07 01:27:34.318797 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1820/3337] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:27:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:27:34.323766 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0747091c-1524-429c-8160-9668bbf315cc tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:34.324419 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0747091c-1524-429c-8160-9668bbf315cc tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:34.364300 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0747091c-1524-429c-8160-9668bbf315cc tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:34.364802 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0747091c-1524-429c-8160-9668bbf315cc tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:34.365244 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0747091c-1524-429c-8160-9668bbf315cc tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:34.365959 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0747091c-1524-429c-8160-9668bbf315cc tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:34.366412 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0747091c-1524-429c-8160-9668bbf315cc tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:34.377147 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0747091c-1524-429c-8160-9668bbf315cc tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:34.653945 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c6244591-d163-4351-9cb4-fe626d58a09d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:34.691061 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c6244591-d163-4351-9cb4-fe626d58a09d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1316 microversion: 2.1 time: 1.562264 Aug 07 01:27:34.694796 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1518/3338] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:33 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1316 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:34.706998 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bf9fb4bf-9f88-4ade-afde-958bc62ba66b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e24589790>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:34.855235 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bf9fb4bf-9f88-4ade-afde-958bc62ba66b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6" status: 200 len: 1414 microversion: 2.1 time: 0.155365 Aug 07 01:27:34.859780 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1519/3339] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:34 2022] GET /compute/v2.1/images/f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6 => generated 1414 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:34.883773 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-53bb6605-ea17-4fdf-a062-6a9a95cf9691 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:34.893282 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-53bb6605-ea17-4fdf-a062-6a9a95cf9691 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 69381f01-4547-4f10-845d-04b426d685cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:34.955004 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53bb6605-ea17-4fdf-a062-6a9a95cf9691 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:34.955516 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53bb6605-ea17-4fdf-a062-6a9a95cf9691 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:34.971977 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53bb6605-ea17-4fdf-a062-6a9a95cf9691 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:34.978578 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53bb6605-ea17-4fdf-a062-6a9a95cf9691 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:34.984116 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53bb6605-ea17-4fdf-a062-6a9a95cf9691 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:34.986424 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53bb6605-ea17-4fdf-a062-6a9a95cf9691 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:35.471453 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0747091c-1524-429c-8160-9668bbf315cc tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:35.532647 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0747091c-1524-429c-8160-9668bbf315cc tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:35.535206 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0747091c-1524-429c-8160-9668bbf315cc tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:35.537043 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0747091c-1524-429c-8160-9668bbf315cc tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1886 microversion: 2.42 time: 1.217226 Aug 07 01:27:35.538225 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1821/3340] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:34 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1886 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:35.551546 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c55deb8a-ae8c-4884-a538-d4696d31b91d tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:35.553086 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c55deb8a-ae8c-4884-a538-d4696d31b91d tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:35.585263 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c55deb8a-ae8c-4884-a538-d4696d31b91d tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:35.585824 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c55deb8a-ae8c-4884-a538-d4696d31b91d tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:35.586266 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c55deb8a-ae8c-4884-a538-d4696d31b91d tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:35.592834 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c55deb8a-ae8c-4884-a538-d4696d31b91d tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:35.594369 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c55deb8a-ae8c-4884-a538-d4696d31b91d tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:35.595045 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c55deb8a-ae8c-4884-a538-d4696d31b91d tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:35.850273 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-53bb6605-ea17-4fdf-a062-6a9a95cf9691 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:35.889306 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-53bb6605-ea17-4fdf-a062-6a9a95cf9691 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd" status: 200 len: 1512 microversion: 2.1 time: 1.016555 Aug 07 01:27:35.892676 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1520/3341] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:34 2022] GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd => generated 1512 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:35.923679 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-94217dc6-341f-4bd7-9273-da805ba9c9c1 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:35.933513 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-94217dc6-341f-4bd7-9273-da805ba9c9c1 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 8f35f41f-1a7c-45c0-8958-216eb837382c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:36.005799 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94217dc6-341f-4bd7-9273-da805ba9c9c1 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:36.006512 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94217dc6-341f-4bd7-9273-da805ba9c9c1 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:36.006979 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94217dc6-341f-4bd7-9273-da805ba9c9c1 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:36.007750 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94217dc6-341f-4bd7-9273-da805ba9c9c1 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:36.008284 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94217dc6-341f-4bd7-9273-da805ba9c9c1 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:36.008725 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94217dc6-341f-4bd7-9273-da805ba9c9c1 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:36.453871 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c55deb8a-ae8c-4884-a538-d4696d31b91d tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:36.465543 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c55deb8a-ae8c-4884-a538-d4696d31b91d tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:36.467870 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c55deb8a-ae8c-4884-a538-d4696d31b91d tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:36.469953 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c55deb8a-ae8c-4884-a538-d4696d31b91d tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1869 microversion: 2.32 time: 0.929945 Aug 07 01:27:36.500064 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1822/3342] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:35 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1869 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:36.508791 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-00e756e9-32fc-4221-9a71-e8537daeef47 req-19d81bba-14ee-4001-b8a7-86c0cdad5135 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9b1883a-c95a-4c49-ad6d-335ecf03b015", "tag": "cb3c2bf2-1cb1-4779-8b61-f6d977daac69"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:36.521483 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-00e756e9-32fc-4221-9a71-e8537daeef47 req-19d81bba-14ee-4001-b8a7-86c0cdad5135 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:36.522359 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-00e756e9-32fc-4221-9a71-e8537daeef47 req-19d81bba-14ee-4001-b8a7-86c0cdad5135 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:36.522843 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-00e756e9-32fc-4221-9a71-e8537daeef47 req-19d81bba-14ee-4001-b8a7-86c0cdad5135 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:36.543696 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-00e756e9-32fc-4221-9a71-e8537daeef47 req-19d81bba-14ee-4001-b8a7-86c0cdad5135 service nova] Creating event network-changed:cb3c2bf2-1cb1-4779-8b61-f6d977daac69 for instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 on n-h2-master-1 Aug 07 01:27:36.552133 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-00e756e9-32fc-4221-9a71-e8537daeef47 req-19d81bba-14ee-4001-b8a7-86c0cdad5135 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050671 Aug 07 01:27:36.554285 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1823/3343] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:27:36.570146 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-c40e1e18-71c6-4aec-81ca-ea151c74e7ab req-7edc27fc-8bce-4055-8b41-f24a3edfd4f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5432da5-94bc-4358-bca6-b025d2bc3186", "name": "network-vif-plugged", "status": "completed", "tag": "4e7534f9-e07f-4f04-a90d-f11e0ff193e2"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:36.603655 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c40e1e18-71c6-4aec-81ca-ea151c74e7ab req-7edc27fc-8bce-4055-8b41-f24a3edfd4f3 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:36.604711 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c40e1e18-71c6-4aec-81ca-ea151c74e7ab req-7edc27fc-8bce-4055-8b41-f24a3edfd4f3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:36.605422 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c40e1e18-71c6-4aec-81ca-ea151c74e7ab req-7edc27fc-8bce-4055-8b41-f24a3edfd4f3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:36.640816 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-c40e1e18-71c6-4aec-81ca-ea151c74e7ab req-7edc27fc-8bce-4055-8b41-f24a3edfd4f3 service nova] Creating event network-vif-plugged:4e7534f9-e07f-4f04-a90d-f11e0ff193e2 for instance f5432da5-94bc-4358-bca6-b025d2bc3186 on n-h1-master-1 Aug 07 01:27:36.657251 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-c40e1e18-71c6-4aec-81ca-ea151c74e7ab req-7edc27fc-8bce-4055-8b41-f24a3edfd4f3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099636 Aug 07 01:27:36.661936 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1824/3344] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:27:36.674045 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4dfd6663-a567-42b9-8628-684db69146ab tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:36.683500 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4dfd6663-a567-42b9-8628-684db69146ab tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:36.699712 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4dfd6663-a567-42b9-8628-684db69146ab tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:36.700596 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4dfd6663-a567-42b9-8628-684db69146ab tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:36.701602 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4dfd6663-a567-42b9-8628-684db69146ab tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:36.702879 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4dfd6663-a567-42b9-8628-684db69146ab tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:36.703685 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4dfd6663-a567-42b9-8628-684db69146ab tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:36.708177 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4dfd6663-a567-42b9-8628-684db69146ab tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:36.917962 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-94217dc6-341f-4bd7-9273-da805ba9c9c1 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:36.944916 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-94217dc6-341f-4bd7-9273-da805ba9c9c1 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c" status: 200 len: 1219 microversion: 2.1 time: 1.035542 Aug 07 01:27:36.948919 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1521/3345] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:35 2022] GET /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c => generated 1219 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:36.982697 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-653b3626-4da1-4c78-b7ab-8c426ab82068 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e246355e0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:37.136249 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-653b3626-4da1-4c78-b7ab-8c426ab82068 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6" status: 200 len: 1414 microversion: 2.1 time: 0.164188 Aug 07 01:27:37.146163 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1522/3346] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:36 2022] GET /compute/v2.1/images/f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6 => generated 1414 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:37.159769 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4dfd6663-a567-42b9-8628-684db69146ab tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:37.169197 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a9afff20-8749-4298-8c35-7202c4338833 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:37.169832 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a9afff20-8749-4298-8c35-7202c4338833 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:37.171671 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4dfd6663-a567-42b9-8628-684db69146ab tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1316 microversion: 2.1 time: 0.507075 Aug 07 01:27:37.188572 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1825/3347] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:36 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1316 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:37.198189 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-737625bf-6bcc-430a-b076-9faa6a65feda tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:37.199706 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-737625bf-6bcc-430a-b076-9faa6a65feda tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 69381f01-4547-4f10-845d-04b426d685cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:37.209444 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a9afff20-8749-4298-8c35-7202c4338833 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:37.212565 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a9afff20-8749-4298-8c35-7202c4338833 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:37.213554 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a9afff20-8749-4298-8c35-7202c4338833 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:37.214892 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a9afff20-8749-4298-8c35-7202c4338833 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:37.216402 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a9afff20-8749-4298-8c35-7202c4338833 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:37.217821 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-737625bf-6bcc-430a-b076-9faa6a65feda tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:37.218596 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a9afff20-8749-4298-8c35-7202c4338833 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:37.221491 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-737625bf-6bcc-430a-b076-9faa6a65feda tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:37.222009 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-737625bf-6bcc-430a-b076-9faa6a65feda tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:37.222782 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-737625bf-6bcc-430a-b076-9faa6a65feda tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:37.225267 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-737625bf-6bcc-430a-b076-9faa6a65feda tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:37.225846 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-737625bf-6bcc-430a-b076-9faa6a65feda tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:37.534675 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-737625bf-6bcc-430a-b076-9faa6a65feda tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:37.543995 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-737625bf-6bcc-430a-b076-9faa6a65feda tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd" status: 200 len: 1512 microversion: 2.1 time: 0.351617 Aug 07 01:27:37.568001 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1826/3348] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:37 2022] GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd => generated 1512 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:37.573273 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c3b01739-79b4-4951-9270-ce371c3db300 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:37.579787 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c3b01739-79b4-4951-9270-ce371c3db300 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 8f35f41f-1a7c-45c0-8958-216eb837382c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:37.600183 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3b01739-79b4-4951-9270-ce371c3db300 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:37.601258 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3b01739-79b4-4951-9270-ce371c3db300 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:37.603377 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3b01739-79b4-4951-9270-ce371c3db300 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:37.610576 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3b01739-79b4-4951-9270-ce371c3db300 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:37.616331 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3b01739-79b4-4951-9270-ce371c3db300 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:37.617192 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3b01739-79b4-4951-9270-ce371c3db300 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:37.739837 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c3b01739-79b4-4951-9270-ce371c3db300 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 8f35f41f-1a7c-45c0-8958-216eb837382c] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:27:38.018493 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c3b01739-79b4-4951-9270-ce371c3db300 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c" status: 204 len: 0 microversion: 2.1 time: 0.443664 Aug 07 01:27:38.021418 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1827/3349] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:27:37 2022] DELETE /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:27:38.037141 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b7a36f78-fb96-4c89-b1ec-df0e0d3d5ffb tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:38.037880 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b7a36f78-fb96-4c89-b1ec-df0e0d3d5ffb tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:38.053740 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7a36f78-fb96-4c89-b1ec-df0e0d3d5ffb tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:38.054398 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7a36f78-fb96-4c89-b1ec-df0e0d3d5ffb tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:38.055322 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7a36f78-fb96-4c89-b1ec-df0e0d3d5ffb tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:38.057236 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7a36f78-fb96-4c89-b1ec-df0e0d3d5ffb tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:38.059397 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7a36f78-fb96-4c89-b1ec-df0e0d3d5ffb tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:38.060323 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7a36f78-fb96-4c89-b1ec-df0e0d3d5ffb tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:38.179033 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=16 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:38.319749 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a9afff20-8749-4298-8c35-7202c4338833 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:38.371671 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a9afff20-8749-4298-8c35-7202c4338833 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:38.378605 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a9afff20-8749-4298-8c35-7202c4338833 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:38.381624 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a9afff20-8749-4298-8c35-7202c4338833 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1886 microversion: 2.42 time: 1.232762 Aug 07 01:27:38.383841 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1523/3350] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:37 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1886 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:38.395222 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7e5411f7-7779-4882-b153-8f791e17dfa8 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:38.397730 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7e5411f7-7779-4882-b153-8f791e17dfa8 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 8f35f41f-1a7c-45c0-8958-216eb837382c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:38.410254 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e5411f7-7779-4882-b153-8f791e17dfa8 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:38.412477 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e5411f7-7779-4882-b153-8f791e17dfa8 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:38.413750 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e5411f7-7779-4882-b153-8f791e17dfa8 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:38.416003 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e5411f7-7779-4882-b153-8f791e17dfa8 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:38.420445 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e5411f7-7779-4882-b153-8f791e17dfa8 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:38.421800 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e5411f7-7779-4882-b153-8f791e17dfa8 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:38.627760 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b7a36f78-fb96-4c89-b1ec-df0e0d3d5ffb tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:38.642138 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b7a36f78-fb96-4c89-b1ec-df0e0d3d5ffb tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:38.648359 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b7a36f78-fb96-4c89-b1ec-df0e0d3d5ffb tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:38.650825 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b7a36f78-fb96-4c89-b1ec-df0e0d3d5ffb tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1869 microversion: 2.32 time: 0.626123 Aug 07 01:27:38.654982 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1828/3351] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:38 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1869 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:38.766457 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7e5411f7-7779-4882-b153-8f791e17dfa8 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:38.779723 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7e5411f7-7779-4882-b153-8f791e17dfa8 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c" status: 200 len: 1273 microversion: 2.1 time: 0.393297 Aug 07 01:27:38.855214 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1524/3352] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:38 2022] GET /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c => generated 1273 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:38.870885 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d0a30634-b73f-46ea-9ff8-e03adfbb8d80 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e242dc310>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:39.012607 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d0a30634-b73f-46ea-9ff8-e03adfbb8d80 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6" status: 200 len: 1414 microversion: 2.1 time: 0.154309 Aug 07 01:27:39.029056 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1525/3353] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:38 2022] GET /compute/v2.1/images/f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6 => generated 1414 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:39.035207 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e0053281-81ae-490a-a841-c0dadc5eb207 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:39.035939 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e0053281-81ae-490a-a841-c0dadc5eb207 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:39.045766 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e0053281-81ae-490a-a841-c0dadc5eb207 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:39.046883 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e0053281-81ae-490a-a841-c0dadc5eb207 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:39.047337 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e0053281-81ae-490a-a841-c0dadc5eb207 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:39.049431 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e0053281-81ae-490a-a841-c0dadc5eb207 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:39.050011 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e0053281-81ae-490a-a841-c0dadc5eb207 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:39.051092 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e0053281-81ae-490a-a841-c0dadc5eb207 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:39.138848 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e94c6df9-d8f4-4174-998d-06055d9270d5 tempest-MultipleCreateNegativeTestJSON-1726606904 tempest-MultipleCreateNegativeTestJSON-1726606904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1237783312", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:39.145220 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-e94c6df9-d8f4-4174-998d-06055d9270d5 tempest-MultipleCreateNegativeTestJSON-1726606904 tempest-MultipleCreateNegativeTestJSON-1726606904-project] HTTP exception thrown: min_count must be <= max_count Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e94c6df9-d8f4-4174-998d-06055d9270d5 tempest-MultipleCreateNegativeTestJSON-1726606904 tempest-MultipleCreateNegativeTestJSON-1726606904-project] Request method failure captured: Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 184 Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xUJ5wENYWFd8M4SCtKhGrhW_tS7EZFH6W9UpicjZVJnQimKkWYPrCELoPgdDx4GNib6AOmN1vFXHXSyJsSkFOdHzGBnZaBz-ARNRPKUK9PIXBny3LZGdToCkGRQTbeYMbjPnunQpe6qbbWR0_oFtlqamkU3sdU6iG0trH4iRIMa3qI Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: d5fd4266d58342919c303da9f76d55bb Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1726606904 Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d5fd4266d58342919c303da9f76d55bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d5fd4266d58342919c303da9f76d55bb", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d5fd4266d58342919c303da9f76d55bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d5fd4266d58342919c303da9f76d55bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1726606904 Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: d5fd4266d58342919c303da9f76d55bb Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1726606904 Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-MultipleCreateNegativeTestJSON-1726606904-project Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: af9ab9e997454898b8d1b5945deeec02 Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1726606904-project Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1237783312", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: exception: min_count must be <= max_count Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1237783312', 'imageRef': 'e825bd61-bf05-4bd4-aa72-78daf2231731', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 07 01:27:39.152812 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:39.158497 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e94c6df9-d8f4-4174-998d-06055d9270d5 tempest-MultipleCreateNegativeTestJSON-1726606904 tempest-MultipleCreateNegativeTestJSON-1726606904-project] Returning 400 to user: min_count must be <= max_count {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:27:39.173863 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e94c6df9-d8f4-4174-998d-06055d9270d5 tempest-MultipleCreateNegativeTestJSON-1726606904 tempest-MultipleCreateNegativeTestJSON-1726606904-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.500209 Aug 07 01:27:39.200479 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1829/3354] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:27:38 2022] POST /compute/v2.1/servers => generated 74 bytes in 544 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 07 01:27:39.236395 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fc851a2e-d2f6-462f-a31b-0cda987078c5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:39.239210 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fc851a2e-d2f6-462f-a31b-0cda987078c5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 69381f01-4547-4f10-845d-04b426d685cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:39.258170 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc851a2e-d2f6-462f-a31b-0cda987078c5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:39.258810 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc851a2e-d2f6-462f-a31b-0cda987078c5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:39.259712 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc851a2e-d2f6-462f-a31b-0cda987078c5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:39.269044 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc851a2e-d2f6-462f-a31b-0cda987078c5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:39.269722 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc851a2e-d2f6-462f-a31b-0cda987078c5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:39.270196 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc851a2e-d2f6-462f-a31b-0cda987078c5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:39.763914 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fc851a2e-d2f6-462f-a31b-0cda987078c5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:39.789063 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fc851a2e-d2f6-462f-a31b-0cda987078c5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd" status: 200 len: 1512 microversion: 2.1 time: 0.581618 Aug 07 01:27:39.792392 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1830/3355] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:39 2022] GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd => generated 1512 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:39.808863 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3d5d4d83-38a3-450e-a081-bad1b9216432 tempest-MultipleCreateNegativeTestJSON-1726606904 tempest-MultipleCreateNegativeTestJSON-1726606904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1936214286", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "max_count": 0}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3d5d4d83-38a3-450e-a081-bad1b9216432 tempest-MultipleCreateNegativeTestJSON-1726606904 tempest-MultipleCreateNegativeTestJSON-1726606904-project] Request method failure captured: Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 168 Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xUJ5wENYWFd8M4SCtKhGrhW_tS7EZFH6W9UpicjZVJnQimKkWYPrCELoPgdDx4GNib6AOmN1vFXHXSyJsSkFOdHzGBnZaBz-ARNRPKUK9PIXBny3LZGdToCkGRQTbeYMbjPnunQpe6qbbWR0_oFtlqamkU3sdU6iG0trH4iRIMa3qI Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: d5fd4266d58342919c303da9f76d55bb Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1726606904 Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d5fd4266d58342919c303da9f76d55bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d5fd4266d58342919c303da9f76d55bb", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d5fd4266d58342919c303da9f76d55bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d5fd4266d58342919c303da9f76d55bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1726606904 Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: d5fd4266d58342919c303da9f76d55bb Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1726606904 Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-MultipleCreateNegativeTestJSON-1726606904-project Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: af9ab9e997454898b8d1b5945deeec02 Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1726606904-project Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1936214286", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "max_count": 0}} Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1936214286', 'imageRef': 'e825bd61-bf05-4bd4-aa72-78daf2231731', 'flavorRef': '452', 'max_count': 0}}} Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 0 Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:27:39.819156 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:27:39.825388 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:27:39.825388 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:27:39.825388 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:27:39.825388 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:27:39.825388 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 07 01:27:39.825388 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:39.825388 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:27:39.825388 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:39.825388 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:27:39.825388 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:27:39.825388 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:27:39.825388 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:27:39.825388 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:27:39.825388 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 07 01:27:39.825388 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:39.830825 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3d5d4d83-38a3-450e-a081-bad1b9216432 tempest-MultipleCreateNegativeTestJSON-1726606904 tempest-MultipleCreateNegativeTestJSON-1726606904-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:27:39.834365 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3d5d4d83-38a3-450e-a081-bad1b9216432 tempest-MultipleCreateNegativeTestJSON-1726606904 tempest-MultipleCreateNegativeTestJSON-1726606904-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.040246 Aug 07 01:27:39.852663 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1831/3356] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:27:39 2022] POST /compute/v2.1/servers => generated 130 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:27:39.860249 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3a38eed6-c59b-4bed-9a72-89e7d7164630 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:39.861174 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3a38eed6-c59b-4bed-9a72-89e7d7164630 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:39.873326 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a38eed6-c59b-4bed-9a72-89e7d7164630 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:39.891475 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a38eed6-c59b-4bed-9a72-89e7d7164630 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:39.892006 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a38eed6-c59b-4bed-9a72-89e7d7164630 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:39.892797 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a38eed6-c59b-4bed-9a72-89e7d7164630 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:39.893276 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a38eed6-c59b-4bed-9a72-89e7d7164630 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:39.893718 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a38eed6-c59b-4bed-9a72-89e7d7164630 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:40.135184 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e0053281-81ae-490a-a841-c0dadc5eb207 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:40.144331 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e0053281-81ae-490a-a841-c0dadc5eb207 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1316 microversion: 2.1 time: 1.113818 Aug 07 01:27:40.167169 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1526/3357] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:39 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1316 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:40.167169 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f2d0eeef-76b0-45c6-99da-1ac355622061 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:40.167169 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f2d0eeef-76b0-45c6-99da-1ac355622061 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:40.171698 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f2d0eeef-76b0-45c6-99da-1ac355622061 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:40.176083 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f2d0eeef-76b0-45c6-99da-1ac355622061 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:40.176632 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f2d0eeef-76b0-45c6-99da-1ac355622061 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:40.177528 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f2d0eeef-76b0-45c6-99da-1ac355622061 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:40.178069 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f2d0eeef-76b0-45c6-99da-1ac355622061 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:40.178619 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f2d0eeef-76b0-45c6-99da-1ac355622061 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:40.224253 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3a38eed6-c59b-4bed-9a72-89e7d7164630 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:40.242709 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3a38eed6-c59b-4bed-9a72-89e7d7164630 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:40.244837 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3a38eed6-c59b-4bed-9a72-89e7d7164630 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:40.246060 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3a38eed6-c59b-4bed-9a72-89e7d7164630 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1874 microversion: 2.42 time: 0.392652 Aug 07 01:27:40.246625 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1832/3358] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:39 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1874 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:40.266530 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b5668a2a-462c-46d8-b8c0-54ca48c4128a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:40.267425 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b5668a2a-462c-46d8-b8c0-54ca48c4128a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 8f35f41f-1a7c-45c0-8958-216eb837382c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:40.288022 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b5668a2a-462c-46d8-b8c0-54ca48c4128a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:40.292653 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b5668a2a-462c-46d8-b8c0-54ca48c4128a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:40.293114 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b5668a2a-462c-46d8-b8c0-54ca48c4128a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:40.308690 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b5668a2a-462c-46d8-b8c0-54ca48c4128a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:40.309232 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b5668a2a-462c-46d8-b8c0-54ca48c4128a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:40.309690 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b5668a2a-462c-46d8-b8c0-54ca48c4128a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:40.369673 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:40.452873 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b5668a2a-462c-46d8-b8c0-54ca48c4128a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:40.466057 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b5668a2a-462c-46d8-b8c0-54ca48c4128a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c" status: 200 len: 1273 microversion: 2.1 time: 0.218323 Aug 07 01:27:40.466972 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1833/3359] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:40 2022] GET /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c => generated 1273 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:40.477372 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2a88bba7-1fc9-45c2-9c97-455d6c2b12b4 tempest-MultipleCreateNegativeTestJSON-1726606904 tempest-MultipleCreateNegativeTestJSON-1726606904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-735127344", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "max_count": 2.5}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2a88bba7-1fc9-45c2-9c97-455d6c2b12b4 tempest-MultipleCreateNegativeTestJSON-1726606904 tempest-MultipleCreateNegativeTestJSON-1726606904-project] Request method failure captured: Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 169 Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xUJ5wENYWFd8M4SCtKhGrhW_tS7EZFH6W9UpicjZVJnQimKkWYPrCELoPgdDx4GNib6AOmN1vFXHXSyJsSkFOdHzGBnZaBz-ARNRPKUK9PIXBny3LZGdToCkGRQTbeYMbjPnunQpe6qbbWR0_oFtlqamkU3sdU6iG0trH4iRIMa3qI Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: d5fd4266d58342919c303da9f76d55bb Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1726606904 Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d5fd4266d58342919c303da9f76d55bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d5fd4266d58342919c303da9f76d55bb", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d5fd4266d58342919c303da9f76d55bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d5fd4266d58342919c303da9f76d55bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1726606904 Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: d5fd4266d58342919c303da9f76d55bb Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1726606904 Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-MultipleCreateNegativeTestJSON-1726606904-project Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: af9ab9e997454898b8d1b5945deeec02 Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1726606904-project Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-735127344", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "max_count": 2.5}} Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-735127344', 'imageRef': 'e825bd61-bf05-4bd4-aa72-78daf2231731', 'flavorRef': '452', 'max_count': 2.5}}} Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 2.5 Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:27:40.481484 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:27:40.486627 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:27:40.486627 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:27:40.486627 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:27:40.486627 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:27:40.486627 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 07 01:27:40.486627 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:40.486627 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:27:40.486627 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:40.486627 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:27:40.486627 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:27:40.486627 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:27:40.486627 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:27:40.486627 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:27:40.486627 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 07 01:27:40.486627 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:40.486627 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2a88bba7-1fc9-45c2-9c97-455d6c2b12b4 tempest-MultipleCreateNegativeTestJSON-1726606904 tempest-MultipleCreateNegativeTestJSON-1726606904-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:27:40.486627 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2a88bba7-1fc9-45c2-9c97-455d6c2b12b4 tempest-MultipleCreateNegativeTestJSON-1726606904 tempest-MultipleCreateNegativeTestJSON-1726606904-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.009554 Aug 07 01:27:40.495673 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1834/3360] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:27:40 2022] POST /compute/v2.1/servers => generated 139 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:27:40.505507 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e5308d0a-0a71-4981-92a6-f16ece80fd0e tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e243c9ca0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:40.614673 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e5308d0a-0a71-4981-92a6-f16ece80fd0e tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6" status: 200 len: 1414 microversion: 2.1 time: 0.117737 Aug 07 01:27:40.623021 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1835/3361] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:40 2022] GET /compute/v2.1/images/f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6 => generated 1414 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:40.635959 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e7d792f3-5714-40ac-8358-7b7e5c60d8e5 tempest-MultipleCreateNegativeTestJSON-1726606904 tempest-MultipleCreateNegativeTestJSON-1726606904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-256557575", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "min_count": 0}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e7d792f3-5714-40ac-8358-7b7e5c60d8e5 tempest-MultipleCreateNegativeTestJSON-1726606904 tempest-MultipleCreateNegativeTestJSON-1726606904-project] Request method failure captured: Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 167 Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xUJ5wENYWFd8M4SCtKhGrhW_tS7EZFH6W9UpicjZVJnQimKkWYPrCELoPgdDx4GNib6AOmN1vFXHXSyJsSkFOdHzGBnZaBz-ARNRPKUK9PIXBny3LZGdToCkGRQTbeYMbjPnunQpe6qbbWR0_oFtlqamkU3sdU6iG0trH4iRIMa3qI Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: d5fd4266d58342919c303da9f76d55bb Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1726606904 Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d5fd4266d58342919c303da9f76d55bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d5fd4266d58342919c303da9f76d55bb", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d5fd4266d58342919c303da9f76d55bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d5fd4266d58342919c303da9f76d55bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1726606904 Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: d5fd4266d58342919c303da9f76d55bb Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1726606904 Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-MultipleCreateNegativeTestJSON-1726606904-project Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: af9ab9e997454898b8d1b5945deeec02 Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1726606904-project Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-256557575", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "min_count": 0}} Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-256557575', 'imageRef': 'e825bd61-bf05-4bd4-aa72-78daf2231731', 'flavorRef': '452', 'min_count': 0}}} Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 0 Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:27:40.649739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:27:40.656700 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:27:40.656700 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:27:40.656700 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:27:40.656700 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:27:40.656700 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 07 01:27:40.656700 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:40.656700 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:27:40.656700 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:40.656700 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:27:40.656700 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:27:40.656700 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:27:40.656700 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:27:40.656700 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:27:40.656700 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 07 01:27:40.656700 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:40.660383 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e7d792f3-5714-40ac-8358-7b7e5c60d8e5 tempest-MultipleCreateNegativeTestJSON-1726606904 tempest-MultipleCreateNegativeTestJSON-1726606904-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:27:40.662896 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e7d792f3-5714-40ac-8358-7b7e5c60d8e5 tempest-MultipleCreateNegativeTestJSON-1726606904 tempest-MultipleCreateNegativeTestJSON-1726606904-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.046628 Aug 07 01:27:40.674780 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1836/3362] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:27:40 2022] POST /compute/v2.1/servers => generated 130 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:27:40.737865 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a146d659-20e8-49a4-bf86-f1a4c70f28dd tempest-MultipleCreateNegativeTestJSON-1726606904 tempest-MultipleCreateNegativeTestJSON-1726606904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2116624558", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "min_count": 2.5}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a146d659-20e8-49a4-bf86-f1a4c70f28dd tempest-MultipleCreateNegativeTestJSON-1726606904 tempest-MultipleCreateNegativeTestJSON-1726606904-project] Request method failure captured: Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 170 Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xUJ5wENYWFd8M4SCtKhGrhW_tS7EZFH6W9UpicjZVJnQimKkWYPrCELoPgdDx4GNib6AOmN1vFXHXSyJsSkFOdHzGBnZaBz-ARNRPKUK9PIXBny3LZGdToCkGRQTbeYMbjPnunQpe6qbbWR0_oFtlqamkU3sdU6iG0trH4iRIMa3qI Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: d5fd4266d58342919c303da9f76d55bb Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1726606904 Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d5fd4266d58342919c303da9f76d55bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d5fd4266d58342919c303da9f76d55bb", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d5fd4266d58342919c303da9f76d55bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d5fd4266d58342919c303da9f76d55bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1726606904 Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: d5fd4266d58342919c303da9f76d55bb Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1726606904 Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-MultipleCreateNegativeTestJSON-1726606904-project Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: af9ab9e997454898b8d1b5945deeec02 Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1726606904-project Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2116624558", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "min_count": 2.5}} Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2116624558', 'imageRef': 'e825bd61-bf05-4bd4-aa72-78daf2231731', 'flavorRef': '452', 'min_count': 2.5}}} Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 2.5 Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:27:40.757909 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:27:40.762789 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:27:40.762789 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:27:40.762789 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:27:40.762789 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:27:40.762789 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 07 01:27:40.762789 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:40.762789 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:27:40.762789 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:40.762789 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:27:40.762789 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:27:40.762789 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:27:40.762789 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:27:40.762789 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:27:40.762789 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 07 01:27:40.762789 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:27:40.762789 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a146d659-20e8-49a4-bf86-f1a4c70f28dd tempest-MultipleCreateNegativeTestJSON-1726606904 tempest-MultipleCreateNegativeTestJSON-1726606904-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:27:40.762789 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a146d659-20e8-49a4-bf86-f1a4c70f28dd tempest-MultipleCreateNegativeTestJSON-1726606904 tempest-MultipleCreateNegativeTestJSON-1726606904-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.027950 Aug 07 01:27:40.762789 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1837/3363] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:27:40 2022] POST /compute/v2.1/servers => generated 139 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:27:40.820116 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1061cdda-7e42-4e7f-9710-76c88cd94e21 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:40.820910 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1061cdda-7e42-4e7f-9710-76c88cd94e21 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 69381f01-4547-4f10-845d-04b426d685cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:40.835319 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1061cdda-7e42-4e7f-9710-76c88cd94e21 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:40.841157 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1061cdda-7e42-4e7f-9710-76c88cd94e21 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:40.844953 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1061cdda-7e42-4e7f-9710-76c88cd94e21 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:40.852337 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1061cdda-7e42-4e7f-9710-76c88cd94e21 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:40.854301 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1061cdda-7e42-4e7f-9710-76c88cd94e21 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:40.854782 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1061cdda-7e42-4e7f-9710-76c88cd94e21 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:41.367597 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f2d0eeef-76b0-45c6-99da-1ac355622061 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:41.381351 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f2d0eeef-76b0-45c6-99da-1ac355622061 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:41.393329 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f2d0eeef-76b0-45c6-99da-1ac355622061 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:41.394764 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f2d0eeef-76b0-45c6-99da-1ac355622061 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1869 microversion: 2.32 time: 1.239155 Aug 07 01:27:41.395489 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1527/3364] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:40 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1869 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:41.406900 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d749bf5e-b507-4c74-b1cd-628e1830851b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:41.407705 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d749bf5e-b507-4c74-b1cd-628e1830851b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:41.424734 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d749bf5e-b507-4c74-b1cd-628e1830851b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:41.428751 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d749bf5e-b507-4c74-b1cd-628e1830851b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:41.430062 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d749bf5e-b507-4c74-b1cd-628e1830851b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:41.431250 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d749bf5e-b507-4c74-b1cd-628e1830851b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:41.433045 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d749bf5e-b507-4c74-b1cd-628e1830851b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:41.433814 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d749bf5e-b507-4c74-b1cd-628e1830851b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:41.439533 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1061cdda-7e42-4e7f-9710-76c88cd94e21 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:41.450233 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1061cdda-7e42-4e7f-9710-76c88cd94e21 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd" status: 200 len: 1512 microversion: 2.1 time: 0.636467 Aug 07 01:27:41.479581 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1838/3365] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:40 2022] GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd => generated 1512 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:41.487163 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a3761fe1-1aa3-48a8-a5e7-921ede2a4c4c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:41.492944 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a3761fe1-1aa3-48a8-a5e7-921ede2a4c4c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:41.507861 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3761fe1-1aa3-48a8-a5e7-921ede2a4c4c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:41.508658 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3761fe1-1aa3-48a8-a5e7-921ede2a4c4c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:41.509336 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3761fe1-1aa3-48a8-a5e7-921ede2a4c4c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:41.510587 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3761fe1-1aa3-48a8-a5e7-921ede2a4c4c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:41.511367 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3761fe1-1aa3-48a8-a5e7-921ede2a4c4c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:41.511999 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3761fe1-1aa3-48a8-a5e7-921ede2a4c4c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:42.013573 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d749bf5e-b507-4c74-b1cd-628e1830851b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:42.027138 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d749bf5e-b507-4c74-b1cd-628e1830851b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1316 microversion: 2.1 time: 0.626272 Aug 07 01:27:42.027792 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1528/3366] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:41 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1316 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:42.045282 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-609db5ee-830b-4a39-9124-4f050339fb85 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:42.046427 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-609db5ee-830b-4a39-9124-4f050339fb85 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 8f35f41f-1a7c-45c0-8958-216eb837382c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:42.054592 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-609db5ee-830b-4a39-9124-4f050339fb85 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:42.055707 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-609db5ee-830b-4a39-9124-4f050339fb85 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:42.055707 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-609db5ee-830b-4a39-9124-4f050339fb85 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:42.056841 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-609db5ee-830b-4a39-9124-4f050339fb85 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:42.056841 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-609db5ee-830b-4a39-9124-4f050339fb85 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:42.057197 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-609db5ee-830b-4a39-9124-4f050339fb85 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:42.608199 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-609db5ee-830b-4a39-9124-4f050339fb85 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:42.619116 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-609db5ee-830b-4a39-9124-4f050339fb85 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c" status: 200 len: 1315 microversion: 2.1 time: 0.589812 Aug 07 01:27:42.622771 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1529/3367] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:42 2022] GET /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c => generated 1315 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:42.641226 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9261eac7-49ab-4d54-ad32-69d0ebddcdaf tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e24882d30>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:42.645836 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a3761fe1-1aa3-48a8-a5e7-921ede2a4c4c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:42.684615 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a3761fe1-1aa3-48a8-a5e7-921ede2a4c4c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:42.694561 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a3761fe1-1aa3-48a8-a5e7-921ede2a4c4c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:42.704271 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a3761fe1-1aa3-48a8-a5e7-921ede2a4c4c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1874 microversion: 2.42 time: 1.217320 Aug 07 01:27:42.704952 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1839/3368] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:41 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1874 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:42.728562 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e1a56164-ac6b-47b2-a61f-dca7630fdeea tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:42.747667 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9261eac7-49ab-4d54-ad32-69d0ebddcdaf tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6" status: 200 len: 1414 microversion: 2.1 time: 0.123421 Aug 07 01:27:42.748690 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1530/3369] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:42 2022] GET /compute/v2.1/images/f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6 => generated 1414 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:42.751795 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e1a56164-ac6b-47b2-a61f-dca7630fdeea tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:42.770914 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0e1d9d62-5a2a-4d33-a8e8-afe819c8c2c8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:42.772392 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0e1d9d62-5a2a-4d33-a8e8-afe819c8c2c8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 69381f01-4547-4f10-845d-04b426d685cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:42.776650 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1a56164-ac6b-47b2-a61f-dca7630fdeea tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:42.779993 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1a56164-ac6b-47b2-a61f-dca7630fdeea tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:42.786231 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1a56164-ac6b-47b2-a61f-dca7630fdeea tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:42.787369 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1a56164-ac6b-47b2-a61f-dca7630fdeea tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:42.789243 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1a56164-ac6b-47b2-a61f-dca7630fdeea tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:42.789888 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1a56164-ac6b-47b2-a61f-dca7630fdeea tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:42.800060 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e1d9d62-5a2a-4d33-a8e8-afe819c8c2c8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:42.801707 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e1d9d62-5a2a-4d33-a8e8-afe819c8c2c8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:42.804612 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e1d9d62-5a2a-4d33-a8e8-afe819c8c2c8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:42.806869 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e1d9d62-5a2a-4d33-a8e8-afe819c8c2c8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:42.807662 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e1d9d62-5a2a-4d33-a8e8-afe819c8c2c8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:42.813341 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e1d9d62-5a2a-4d33-a8e8-afe819c8c2c8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:43.311475 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0e1d9d62-5a2a-4d33-a8e8-afe819c8c2c8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:43.326656 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0e1d9d62-5a2a-4d33-a8e8-afe819c8c2c8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd" status: 200 len: 1512 microversion: 2.1 time: 0.575109 Aug 07 01:27:43.327533 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1531/3370] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:42 2022] GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd => generated 1512 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:43.343806 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-72d84d9e-7944-416d-8e58-a07dd7749e57 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:43.346735 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-72d84d9e-7944-416d-8e58-a07dd7749e57 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:43.378129 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-72d84d9e-7944-416d-8e58-a07dd7749e57 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:43.378631 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-72d84d9e-7944-416d-8e58-a07dd7749e57 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:43.379077 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-72d84d9e-7944-416d-8e58-a07dd7749e57 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:43.379803 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-72d84d9e-7944-416d-8e58-a07dd7749e57 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:43.380297 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-72d84d9e-7944-416d-8e58-a07dd7749e57 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:43.380732 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-72d84d9e-7944-416d-8e58-a07dd7749e57 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:43.442508 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e1a56164-ac6b-47b2-a61f-dca7630fdeea tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:43.461177 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e1a56164-ac6b-47b2-a61f-dca7630fdeea tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:43.469985 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e1a56164-ac6b-47b2-a61f-dca7630fdeea tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:43.476341 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e1a56164-ac6b-47b2-a61f-dca7630fdeea tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1869 microversion: 2.32 time: 0.764834 Aug 07 01:27:43.492881 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1840/3371] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:42 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1869 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:43.657399 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-698d4fe7-7c2d-4b0e-a471-a86496c2b863 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:43.659859 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-698d4fe7-7c2d-4b0e-a471-a86496c2b863 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 8f35f41f-1a7c-45c0-8958-216eb837382c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:43.670578 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-698d4fe7-7c2d-4b0e-a471-a86496c2b863 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:43.671349 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-698d4fe7-7c2d-4b0e-a471-a86496c2b863 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:43.673853 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-698d4fe7-7c2d-4b0e-a471-a86496c2b863 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:43.686016 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-698d4fe7-7c2d-4b0e-a471-a86496c2b863 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:43.690284 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-698d4fe7-7c2d-4b0e-a471-a86496c2b863 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:43.691501 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-698d4fe7-7c2d-4b0e-a471-a86496c2b863 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:43.913717 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-72d84d9e-7944-416d-8e58-a07dd7749e57 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:43.923267 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-72d84d9e-7944-416d-8e58-a07dd7749e57 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1316 microversion: 2.1 time: 0.592362 Aug 07 01:27:43.929018 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1532/3372] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:43 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1316 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:43.935074 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a87786d6-646f-4a4e-b163-886ef3ecf00f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:43.936243 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a87786d6-646f-4a4e-b163-886ef3ecf00f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:43.949922 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a87786d6-646f-4a4e-b163-886ef3ecf00f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:43.956559 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=4 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:43.957275 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a87786d6-646f-4a4e-b163-886ef3ecf00f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:43.957979 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a87786d6-646f-4a4e-b163-886ef3ecf00f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:43.958999 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a87786d6-646f-4a4e-b163-886ef3ecf00f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:43.959764 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a87786d6-646f-4a4e-b163-886ef3ecf00f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:43.964270 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a87786d6-646f-4a4e-b163-886ef3ecf00f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:44.033208 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=20 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:44.076807 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-698d4fe7-7c2d-4b0e-a471-a86496c2b863 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:44.085928 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-698d4fe7-7c2d-4b0e-a471-a86496c2b863 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c" status: 200 len: 1315 microversion: 2.1 time: 0.442019 Aug 07 01:27:44.089343 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1841/3373] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:43 2022] GET /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c => generated 1315 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:44.112958 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-077b57bd-fa19-45fc-860b-7bc781c42b73 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e2401a0d0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:44.218884 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-077b57bd-fa19-45fc-860b-7bc781c42b73 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6" status: 200 len: 1414 microversion: 2.1 time: 0.128163 Aug 07 01:27:44.220151 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1842/3374] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:44 2022] GET /compute/v2.1/images/f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6 => generated 1414 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:44.349279 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2755c0a2-0637-4a9c-b7ba-dabcf4931a88 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:44.350048 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2755c0a2-0637-4a9c-b7ba-dabcf4931a88 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 69381f01-4547-4f10-845d-04b426d685cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:44.361515 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2755c0a2-0637-4a9c-b7ba-dabcf4931a88 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:44.367278 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2755c0a2-0637-4a9c-b7ba-dabcf4931a88 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:44.367878 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2755c0a2-0637-4a9c-b7ba-dabcf4931a88 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:44.368770 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2755c0a2-0637-4a9c-b7ba-dabcf4931a88 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:44.369364 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2755c0a2-0637-4a9c-b7ba-dabcf4931a88 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:44.369902 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2755c0a2-0637-4a9c-b7ba-dabcf4931a88 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:44.407508 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a87786d6-646f-4a4e-b163-886ef3ecf00f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:44.417398 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:44.428048 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a87786d6-646f-4a4e-b163-886ef3ecf00f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:44.430992 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a87786d6-646f-4a4e-b163-886ef3ecf00f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:44.436186 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a87786d6-646f-4a4e-b163-886ef3ecf00f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1874 microversion: 2.42 time: 0.504239 Aug 07 01:27:44.438200 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1533/3375] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:43 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1874 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:44.515651 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-469a57c6-5674-443c-a9c3-38b6731e7061 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:44.524182 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-469a57c6-5674-443c-a9c3-38b6731e7061 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:44.539057 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-469a57c6-5674-443c-a9c3-38b6731e7061 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:44.540245 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-469a57c6-5674-443c-a9c3-38b6731e7061 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:44.541080 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-469a57c6-5674-443c-a9c3-38b6731e7061 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:44.542162 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-469a57c6-5674-443c-a9c3-38b6731e7061 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:44.542880 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-469a57c6-5674-443c-a9c3-38b6731e7061 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:44.543564 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-469a57c6-5674-443c-a9c3-38b6731e7061 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:44.797292 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2755c0a2-0637-4a9c-b7ba-dabcf4931a88 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:44.818337 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2755c0a2-0637-4a9c-b7ba-dabcf4931a88 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd" status: 200 len: 1512 microversion: 2.1 time: 0.468480 Aug 07 01:27:44.820242 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1843/3376] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:44 2022] GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd => generated 1512 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:27:44.848125 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-90a26d8e-7a5b-479e-9998-92cf48099efb req-ecba232f-9deb-44ce-8798-a8dda17f4cc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f35f41f-1a7c-45c0-8958-216eb837382c", "tag": "7a8e81f8-70bd-4214-815e-a7f6a32a5f39"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:44.908552 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-90a26d8e-7a5b-479e-9998-92cf48099efb req-ecba232f-9deb-44ce-8798-a8dda17f4cc9 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:44.910055 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-90a26d8e-7a5b-479e-9998-92cf48099efb req-ecba232f-9deb-44ce-8798-a8dda17f4cc9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:44.916664 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-90a26d8e-7a5b-479e-9998-92cf48099efb req-ecba232f-9deb-44ce-8798-a8dda17f4cc9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:44.964020 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-90a26d8e-7a5b-479e-9998-92cf48099efb req-ecba232f-9deb-44ce-8798-a8dda17f4cc9 service nova] Creating event network-changed:7a8e81f8-70bd-4214-815e-a7f6a32a5f39 for instance 8f35f41f-1a7c-45c0-8958-216eb837382c on n-h2-master-1 Aug 07 01:27:44.973876 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-90a26d8e-7a5b-479e-9998-92cf48099efb req-ecba232f-9deb-44ce-8798-a8dda17f4cc9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151070 Aug 07 01:27:44.975193 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1844/3377] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:27:44.994314 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3c083774-ed8d-4775-a5f3-fdbacb923330 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:45.000271 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3c083774-ed8d-4775-a5f3-fdbacb923330 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:45.011581 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c083774-ed8d-4775-a5f3-fdbacb923330 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:45.012127 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c083774-ed8d-4775-a5f3-fdbacb923330 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:45.012625 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c083774-ed8d-4775-a5f3-fdbacb923330 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:45.014196 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c083774-ed8d-4775-a5f3-fdbacb923330 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:45.015250 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c083774-ed8d-4775-a5f3-fdbacb923330 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:45.015689 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c083774-ed8d-4775-a5f3-fdbacb923330 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:45.026101 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-469a57c6-5674-443c-a9c3-38b6731e7061 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:45.041735 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-469a57c6-5674-443c-a9c3-38b6731e7061 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:45.044977 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-469a57c6-5674-443c-a9c3-38b6731e7061 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:45.052058 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-469a57c6-5674-443c-a9c3-38b6731e7061 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1869 microversion: 2.32 time: 0.546988 Aug 07 01:27:45.056469 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1534/3378] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:44 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1869 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:45.129058 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-774b33b7-da03-4a0d-b371-453cc75470cb tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:45.130136 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-774b33b7-da03-4a0d-b371-453cc75470cb tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 8f35f41f-1a7c-45c0-8958-216eb837382c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:45.138115 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-774b33b7-da03-4a0d-b371-453cc75470cb tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:45.140778 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-774b33b7-da03-4a0d-b371-453cc75470cb tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:45.142236 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-774b33b7-da03-4a0d-b371-453cc75470cb tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:45.143184 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-774b33b7-da03-4a0d-b371-453cc75470cb tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:45.144175 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-774b33b7-da03-4a0d-b371-453cc75470cb tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:45.144802 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-774b33b7-da03-4a0d-b371-453cc75470cb tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:45.590897 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-774b33b7-da03-4a0d-b371-453cc75470cb tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:45.605507 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-774b33b7-da03-4a0d-b371-453cc75470cb tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c" status: 200 len: 1315 microversion: 2.1 time: 0.483195 Aug 07 01:27:45.608424 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1535/3379] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:45 2022] GET /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c => generated 1315 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:45.619380 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-22dccf5e-d532-4262-9d96-67d09c4fc1dd tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e2436a280>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:45.645484 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3c083774-ed8d-4775-a5f3-fdbacb923330 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:45.671233 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3c083774-ed8d-4775-a5f3-fdbacb923330 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1316 microversion: 2.1 time: 0.692323 Aug 07 01:27:45.671921 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1845/3380] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:44 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1316 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:45.687375 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9f41ab11-9e50-4df7-b637-ac9f39f1b786 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:45.689902 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9f41ab11-9e50-4df7-b637-ac9f39f1b786 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:45.711083 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f41ab11-9e50-4df7-b637-ac9f39f1b786 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:45.716205 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f41ab11-9e50-4df7-b637-ac9f39f1b786 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:45.717258 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f41ab11-9e50-4df7-b637-ac9f39f1b786 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:45.718326 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f41ab11-9e50-4df7-b637-ac9f39f1b786 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:45.719955 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f41ab11-9e50-4df7-b637-ac9f39f1b786 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:45.722534 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f41ab11-9e50-4df7-b637-ac9f39f1b786 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:45.730501 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-22dccf5e-d532-4262-9d96-67d09c4fc1dd tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6" status: 200 len: 1414 microversion: 2.1 time: 0.120015 Aug 07 01:27:45.739363 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1536/3381] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:45 2022] GET /compute/v2.1/images/f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6 => generated 1414 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:45.746680 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-1ea3bd96-4687-4c34-95e9-a1fa9daecfcc req-4e87d4c9-a019-4c12-b36f-49690093d6c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9b1883a-c95a-4c49-ad6d-335ecf03b015", "name": "network-vif-plugged", "status": "completed", "tag": "cb3c2bf2-1cb1-4779-8b61-f6d977daac69"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:45.766192 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-1ea3bd96-4687-4c34-95e9-a1fa9daecfcc req-4e87d4c9-a019-4c12-b36f-49690093d6c9 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:45.767033 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-1ea3bd96-4687-4c34-95e9-a1fa9daecfcc req-4e87d4c9-a019-4c12-b36f-49690093d6c9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:45.767863 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-1ea3bd96-4687-4c34-95e9-a1fa9daecfcc req-4e87d4c9-a019-4c12-b36f-49690093d6c9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:45.784446 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-1ea3bd96-4687-4c34-95e9-a1fa9daecfcc req-4e87d4c9-a019-4c12-b36f-49690093d6c9 service nova] Creating event network-vif-plugged:cb3c2bf2-1cb1-4779-8b61-f6d977daac69 for instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 on n-h2-master-1 Aug 07 01:27:45.791452 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-1ea3bd96-4687-4c34-95e9-a1fa9daecfcc req-4e87d4c9-a019-4c12-b36f-49690093d6c9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050129 Aug 07 01:27:45.792754 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1537/3382] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:27:45.855251 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a81b4976-c621-4e79-89f9-24641d847e9f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:45.856523 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a81b4976-c621-4e79-89f9-24641d847e9f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 69381f01-4547-4f10-845d-04b426d685cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:45.879021 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a81b4976-c621-4e79-89f9-24641d847e9f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:45.879538 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a81b4976-c621-4e79-89f9-24641d847e9f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:45.881739 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a81b4976-c621-4e79-89f9-24641d847e9f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:45.887034 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a81b4976-c621-4e79-89f9-24641d847e9f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:45.887805 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a81b4976-c621-4e79-89f9-24641d847e9f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:45.890633 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a81b4976-c621-4e79-89f9-24641d847e9f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:46.222808 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9f41ab11-9e50-4df7-b637-ac9f39f1b786 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:46.237699 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9f41ab11-9e50-4df7-b637-ac9f39f1b786 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:46.246349 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9f41ab11-9e50-4df7-b637-ac9f39f1b786 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:46.258274 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9f41ab11-9e50-4df7-b637-ac9f39f1b786 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1874 microversion: 2.42 time: 0.584391 Aug 07 01:27:46.272526 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1846/3383] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:45 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1874 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:46.282809 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0c54bb0a-f8a9-4646-8c81-bccf5a2796d2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:46.286846 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0c54bb0a-f8a9-4646-8c81-bccf5a2796d2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:46.302960 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c54bb0a-f8a9-4646-8c81-bccf5a2796d2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:46.303754 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c54bb0a-f8a9-4646-8c81-bccf5a2796d2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:46.304389 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c54bb0a-f8a9-4646-8c81-bccf5a2796d2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:46.308441 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c54bb0a-f8a9-4646-8c81-bccf5a2796d2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:46.310166 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c54bb0a-f8a9-4646-8c81-bccf5a2796d2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:46.316649 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c54bb0a-f8a9-4646-8c81-bccf5a2796d2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:46.339243 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a81b4976-c621-4e79-89f9-24641d847e9f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:46.362420 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a81b4976-c621-4e79-89f9-24641d847e9f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd" status: 200 len: 1512 microversion: 2.1 time: 0.514327 Aug 07 01:27:46.380171 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1538/3384] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:45 2022] GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd => generated 1512 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:46.631246 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-90d62725-91fb-499a-aa18-70c21271a422 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:46.632477 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-90d62725-91fb-499a-aa18-70c21271a422 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 8f35f41f-1a7c-45c0-8958-216eb837382c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:46.639670 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90d62725-91fb-499a-aa18-70c21271a422 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:46.640453 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90d62725-91fb-499a-aa18-70c21271a422 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:46.641093 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90d62725-91fb-499a-aa18-70c21271a422 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:46.641979 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90d62725-91fb-499a-aa18-70c21271a422 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:46.642606 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90d62725-91fb-499a-aa18-70c21271a422 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:46.643197 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90d62725-91fb-499a-aa18-70c21271a422 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:46.689019 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0c54bb0a-f8a9-4646-8c81-bccf5a2796d2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:46.705489 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0c54bb0a-f8a9-4646-8c81-bccf5a2796d2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:46.710674 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0c54bb0a-f8a9-4646-8c81-bccf5a2796d2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:46.715734 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0c54bb0a-f8a9-4646-8c81-bccf5a2796d2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1869 microversion: 2.32 time: 0.437446 Aug 07 01:27:46.716785 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1847/3385] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:46 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1869 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:46.737887 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-794d958b-3ce1-4e07-bbb6-72a17c747d3a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:46.745542 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-794d958b-3ce1-4e07-bbb6-72a17c747d3a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:46.763440 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-794d958b-3ce1-4e07-bbb6-72a17c747d3a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:46.764174 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-794d958b-3ce1-4e07-bbb6-72a17c747d3a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:46.764878 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-794d958b-3ce1-4e07-bbb6-72a17c747d3a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:46.765807 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-794d958b-3ce1-4e07-bbb6-72a17c747d3a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:46.766462 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-794d958b-3ce1-4e07-bbb6-72a17c747d3a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:46.767085 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-794d958b-3ce1-4e07-bbb6-72a17c747d3a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:46.882405 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-90d62725-91fb-499a-aa18-70c21271a422 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:46.916746 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-90d62725-91fb-499a-aa18-70c21271a422 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c" status: 200 len: 1315 microversion: 2.1 time: 0.287028 Aug 07 01:27:46.918797 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1539/3386] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:46 2022] GET /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:46.935970 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-11231838-761d-4ab2-bdde-f589682d47c6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e24359790>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:47.057232 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-11231838-761d-4ab2-bdde-f589682d47c6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6" status: 200 len: 1414 microversion: 2.1 time: 0.135990 Aug 07 01:27:47.060741 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1540/3387] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:46 2022] GET /compute/v2.1/images/f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6 => generated 1414 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:47.205808 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-794d958b-3ce1-4e07-bbb6-72a17c747d3a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:47.214729 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-794d958b-3ce1-4e07-bbb6-72a17c747d3a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1316 microversion: 2.1 time: 0.495396 Aug 07 01:27:47.215972 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1848/3388] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:46 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1316 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:47.287208 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-73d2c261-6b3b-49b9-b67a-c9f5fbe4f69e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:47.288189 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-73d2c261-6b3b-49b9-b67a-c9f5fbe4f69e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:47.305882 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-73d2c261-6b3b-49b9-b67a-c9f5fbe4f69e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:47.306530 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-73d2c261-6b3b-49b9-b67a-c9f5fbe4f69e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:47.307054 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-73d2c261-6b3b-49b9-b67a-c9f5fbe4f69e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:47.307872 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-73d2c261-6b3b-49b9-b67a-c9f5fbe4f69e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:47.308461 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-73d2c261-6b3b-49b9-b67a-c9f5fbe4f69e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:47.310284 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-73d2c261-6b3b-49b9-b67a-c9f5fbe4f69e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:47.390427 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6bba4e46-3f01-45d5-a8eb-6f3dba9a0e39 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:47.391510 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6bba4e46-3f01-45d5-a8eb-6f3dba9a0e39 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 69381f01-4547-4f10-845d-04b426d685cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:47.403710 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6bba4e46-3f01-45d5-a8eb-6f3dba9a0e39 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:47.404301 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6bba4e46-3f01-45d5-a8eb-6f3dba9a0e39 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:47.404660 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6bba4e46-3f01-45d5-a8eb-6f3dba9a0e39 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:47.405394 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6bba4e46-3f01-45d5-a8eb-6f3dba9a0e39 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:47.405842 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6bba4e46-3f01-45d5-a8eb-6f3dba9a0e39 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:47.406267 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6bba4e46-3f01-45d5-a8eb-6f3dba9a0e39 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:47.629223 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6bba4e46-3f01-45d5-a8eb-6f3dba9a0e39 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:47.642024 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6bba4e46-3f01-45d5-a8eb-6f3dba9a0e39 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd" status: 200 len: 1512 microversion: 2.1 time: 0.256098 Aug 07 01:27:47.664789 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1849/3389] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:47 2022] GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd => generated 1512 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:47.757813 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d1934c20-bc37-4bce-9cfd-e7612d729390 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:47.758846 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d1934c20-bc37-4bce-9cfd-e7612d729390 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:47.767065 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d1934c20-bc37-4bce-9cfd-e7612d729390 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:47.767903 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d1934c20-bc37-4bce-9cfd-e7612d729390 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:47.768579 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d1934c20-bc37-4bce-9cfd-e7612d729390 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:47.769541 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d1934c20-bc37-4bce-9cfd-e7612d729390 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:47.770229 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d1934c20-bc37-4bce-9cfd-e7612d729390 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:47.770878 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d1934c20-bc37-4bce-9cfd-e7612d729390 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:47.783941 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-73d2c261-6b3b-49b9-b67a-c9f5fbe4f69e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:47.798434 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-73d2c261-6b3b-49b9-b67a-c9f5fbe4f69e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:47.804694 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-73d2c261-6b3b-49b9-b67a-c9f5fbe4f69e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:47.806326 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-73d2c261-6b3b-49b9-b67a-c9f5fbe4f69e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1874 microversion: 2.42 time: 0.523231 Aug 07 01:27:47.812970 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1541/3390] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:47 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1874 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:47.953763 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-41f58c22-fbf4-40f2-bdfb-693018a54d6d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:47.954965 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-41f58c22-fbf4-40f2-bdfb-693018a54d6d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 8f35f41f-1a7c-45c0-8958-216eb837382c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:47.965474 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-41f58c22-fbf4-40f2-bdfb-693018a54d6d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:47.970599 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-41f58c22-fbf4-40f2-bdfb-693018a54d6d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:47.971086 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-41f58c22-fbf4-40f2-bdfb-693018a54d6d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:47.971846 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-41f58c22-fbf4-40f2-bdfb-693018a54d6d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:47.972343 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-41f58c22-fbf4-40f2-bdfb-693018a54d6d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:47.972777 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-41f58c22-fbf4-40f2-bdfb-693018a54d6d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:48.139592 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d1934c20-bc37-4bce-9cfd-e7612d729390 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:48.155457 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d1934c20-bc37-4bce-9cfd-e7612d729390 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:48.158331 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d1934c20-bc37-4bce-9cfd-e7612d729390 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:48.160464 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d1934c20-bc37-4bce-9cfd-e7612d729390 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1869 microversion: 2.32 time: 0.406707 Aug 07 01:27:48.230643 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1850/3391] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:47 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1869 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:48.245426 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-be049ee1-5b07-4040-a5eb-431725855bab tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e178ad0d0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:48.365359 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-be049ee1-5b07-4040-a5eb-431725855bab tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6" status: 200 len: 1414 microversion: 2.1 time: 0.115998 Aug 07 01:27:48.376397 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1851/3392] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:48 2022] GET /compute/v2.1/images/f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6 => generated 1414 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:48.405702 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4282e656-abee-4358-8d9a-245cf70e7e12 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:48.407126 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4282e656-abee-4358-8d9a-245cf70e7e12 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:48.422620 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4282e656-abee-4358-8d9a-245cf70e7e12 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:48.423529 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4282e656-abee-4358-8d9a-245cf70e7e12 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:48.424700 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4282e656-abee-4358-8d9a-245cf70e7e12 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:48.425093 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4282e656-abee-4358-8d9a-245cf70e7e12 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:48.426151 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4282e656-abee-4358-8d9a-245cf70e7e12 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:48.426749 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4282e656-abee-4358-8d9a-245cf70e7e12 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:48.650997 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4282e656-abee-4358-8d9a-245cf70e7e12 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:48.668801 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4282e656-abee-4358-8d9a-245cf70e7e12 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.289145 Aug 07 01:27:48.669751 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1852/3393] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:48 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:48.679498 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f820d3ec-2af2-41ec-8e5e-ffdd13356ad6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:48.685862 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f820d3ec-2af2-41ec-8e5e-ffdd13356ad6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 69381f01-4547-4f10-845d-04b426d685cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:48.705566 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f820d3ec-2af2-41ec-8e5e-ffdd13356ad6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:48.711493 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f820d3ec-2af2-41ec-8e5e-ffdd13356ad6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:48.712251 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f820d3ec-2af2-41ec-8e5e-ffdd13356ad6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:48.714761 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f820d3ec-2af2-41ec-8e5e-ffdd13356ad6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:48.715452 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f820d3ec-2af2-41ec-8e5e-ffdd13356ad6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:48.716638 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f820d3ec-2af2-41ec-8e5e-ffdd13356ad6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:48.956961 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f820d3ec-2af2-41ec-8e5e-ffdd13356ad6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:48.971030 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f820d3ec-2af2-41ec-8e5e-ffdd13356ad6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd" status: 200 len: 1489 microversion: 2.1 time: 0.300088 Aug 07 01:27:48.973986 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1853/3394] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:48 2022] GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd => generated 1489 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:48.988883 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c6bbfb3d-5ad6-470f-95f0-7997bd3b8ef2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:48.989761 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c6bbfb3d-5ad6-470f-95f0-7997bd3b8ef2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:49.000523 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c6bbfb3d-5ad6-470f-95f0-7997bd3b8ef2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:49.002991 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c6bbfb3d-5ad6-470f-95f0-7997bd3b8ef2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:49.007324 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c6bbfb3d-5ad6-470f-95f0-7997bd3b8ef2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:49.010091 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c6bbfb3d-5ad6-470f-95f0-7997bd3b8ef2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:49.010534 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c6bbfb3d-5ad6-470f-95f0-7997bd3b8ef2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:49.010975 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c6bbfb3d-5ad6-470f-95f0-7997bd3b8ef2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:49.068004 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-41f58c22-fbf4-40f2-bdfb-693018a54d6d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:49.087709 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-41f58c22-fbf4-40f2-bdfb-693018a54d6d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c" status: 200 len: 1315 microversion: 2.1 time: 1.127964 Aug 07 01:27:49.089412 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1542/3395] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:47 2022] GET /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c => generated 1315 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:49.095377 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4f1d6bb6-39ee-47d7-9a04-11ac624799df tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1688234327", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "cf9a6ffb-a1bc-4f16-8970-9d69635f8f75"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:49.200164 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-4f1d6bb6-39ee-47d7-9a04-11ac624799df tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] validate_networks() for [('cf9a6ffb-a1bc-4f16-8970-9d69635f8f75', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:27:49.452178 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c6bbfb3d-5ad6-470f-95f0-7997bd3b8ef2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:49.463455 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c6bbfb3d-5ad6-470f-95f0-7997bd3b8ef2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:49.476014 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c6bbfb3d-5ad6-470f-95f0-7997bd3b8ef2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:49.478728 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c6bbfb3d-5ad6-470f-95f0-7997bd3b8ef2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1874 microversion: 2.42 time: 0.503443 Aug 07 01:27:49.482235 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1854/3396] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:48 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1874 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:49.499532 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4bfa0a42-3de1-487e-8524-d52e2b2fd511 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:49.502191 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4bfa0a42-3de1-487e-8524-d52e2b2fd511 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:49.522056 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4bfa0a42-3de1-487e-8524-d52e2b2fd511 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:49.523442 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4bfa0a42-3de1-487e-8524-d52e2b2fd511 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:49.524269 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4bfa0a42-3de1-487e-8524-d52e2b2fd511 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:49.525383 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4bfa0a42-3de1-487e-8524-d52e2b2fd511 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:49.526366 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4bfa0a42-3de1-487e-8524-d52e2b2fd511 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:49.527285 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4bfa0a42-3de1-487e-8524-d52e2b2fd511 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:49.657716 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4bfa0a42-3de1-487e-8524-d52e2b2fd511 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action" status: 200 len: 130 microversion: 2.1 time: 0.173702 Aug 07 01:27:49.664594 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1855/3397] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:27:49 2022] POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action => generated 130 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:27:49.683683 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dce24e1c-85ee-4e92-860c-8f92ae8c929d tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:49.691225 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-dce24e1c-85ee-4e92-860c-8f92ae8c929d tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:49.700005 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dce24e1c-85ee-4e92-860c-8f92ae8c929d tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:49.704100 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dce24e1c-85ee-4e92-860c-8f92ae8c929d tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:49.706788 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dce24e1c-85ee-4e92-860c-8f92ae8c929d tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:49.707737 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dce24e1c-85ee-4e92-860c-8f92ae8c929d tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:49.708799 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dce24e1c-85ee-4e92-860c-8f92ae8c929d tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:49.708946 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dce24e1c-85ee-4e92-860c-8f92ae8c929d tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:50.307188 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-dce24e1c-85ee-4e92-860c-8f92ae8c929d tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:50.330352 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-dce24e1c-85ee-4e92-860c-8f92ae8c929d tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:50.331971 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-dce24e1c-85ee-4e92-860c-8f92ae8c929d tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:50.334462 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-dce24e1c-85ee-4e92-860c-8f92ae8c929d tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1869 microversion: 2.32 time: 0.667703 Aug 07 01:27:50.335433 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1856/3398] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:49 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1869 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:50.341133 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-53d7014d-fca0-40ef-819e-242a7be0e762 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e1784b940>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:50.417249 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-53d7014d-fca0-40ef-819e-242a7be0e762 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6" status: 200 len: 1414 microversion: 2.1 time: 0.080600 Aug 07 01:27:50.423618 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1857/3399] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:50 2022] GET /compute/v2.1/images/f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6 => generated 1414 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:50.433085 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8cce8699-1a67-47fa-9b82-6524a4c13e83 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:50.435443 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8cce8699-1a67-47fa-9b82-6524a4c13e83 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:50.446284 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8cce8699-1a67-47fa-9b82-6524a4c13e83 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:50.447320 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8cce8699-1a67-47fa-9b82-6524a4c13e83 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:50.447996 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8cce8699-1a67-47fa-9b82-6524a4c13e83 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:50.449125 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8cce8699-1a67-47fa-9b82-6524a4c13e83 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:50.449861 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8cce8699-1a67-47fa-9b82-6524a4c13e83 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:50.450485 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8cce8699-1a67-47fa-9b82-6524a4c13e83 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:50.457113 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:50.480781 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-4f1d6bb6-39ee-47d7-9a04-11ac624799df tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:27:50.481835 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-4f1d6bb6-39ee-47d7-9a04-11ac624799df tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:27:50.482512 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-4f1d6bb6-39ee-47d7-9a04-11ac624799df tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:27:50.483667 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-4f1d6bb6-39ee-47d7-9a04-11ac624799df tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:27:50.484319 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-4f1d6bb6-39ee-47d7-9a04-11ac624799df tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:27:50.503037 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f1d6bb6-39ee-47d7-9a04-11ac624799df tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:50.503831 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f1d6bb6-39ee-47d7-9a04-11ac624799df tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:50.504525 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f1d6bb6-39ee-47d7-9a04-11ac624799df tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:50.505322 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f1d6bb6-39ee-47d7-9a04-11ac624799df tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:50.505787 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f1d6bb6-39ee-47d7-9a04-11ac624799df tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:50.506218 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f1d6bb6-39ee-47d7-9a04-11ac624799df tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:50.555791 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-4f1d6bb6-39ee-47d7-9a04-11ac624799df tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Getting quotas for project 38b7f4c69d5542a88fa2870354d507ce. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:27:50.572200 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-4f1d6bb6-39ee-47d7-9a04-11ac624799df tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Getting quotas for user 8a2c261b4e794705a8725b3b7126bd73 and project 38b7f4c69d5542a88fa2870354d507ce. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:27:50.609190 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4f1d6bb6-39ee-47d7-9a04-11ac624799df tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:27:50.616776 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4f1d6bb6-39ee-47d7-9a04-11ac624799df tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 19784b1a-63aa-44b2-bbd5-d8dda713efdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:27:50.733152 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4f1d6bb6-39ee-47d7-9a04-11ac624799df tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.633852 Aug 07 01:27:50.735009 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1543/3400] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:27:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:27:50.740735 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0149be43-e303-4b87-9edc-08f47a5bb3a2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:50.741379 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0149be43-e303-4b87-9edc-08f47a5bb3a2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 8f35f41f-1a7c-45c0-8958-216eb837382c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:50.756117 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0149be43-e303-4b87-9edc-08f47a5bb3a2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:50.770670 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0149be43-e303-4b87-9edc-08f47a5bb3a2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:50.771870 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0149be43-e303-4b87-9edc-08f47a5bb3a2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:50.773416 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0149be43-e303-4b87-9edc-08f47a5bb3a2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:50.774077 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0149be43-e303-4b87-9edc-08f47a5bb3a2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:50.775422 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0149be43-e303-4b87-9edc-08f47a5bb3a2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:51.132499 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8cce8699-1a67-47fa-9b82-6524a4c13e83 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:51.150198 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8cce8699-1a67-47fa-9b82-6524a4c13e83 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.723368 Aug 07 01:27:51.158159 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1858/3401] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:50 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:51.168002 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e5621678-65f4-475e-908a-c87f80425bd5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:51.171666 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e5621678-65f4-475e-908a-c87f80425bd5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:51.189882 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5621678-65f4-475e-908a-c87f80425bd5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:51.190660 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5621678-65f4-475e-908a-c87f80425bd5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:51.191391 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5621678-65f4-475e-908a-c87f80425bd5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:51.192414 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5621678-65f4-475e-908a-c87f80425bd5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:51.193079 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5621678-65f4-475e-908a-c87f80425bd5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:51.193712 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5621678-65f4-475e-908a-c87f80425bd5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:51.278791 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0149be43-e303-4b87-9edc-08f47a5bb3a2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:51.307757 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0149be43-e303-4b87-9edc-08f47a5bb3a2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c" status: 200 len: 1315 microversion: 2.1 time: 0.571050 Aug 07 01:27:51.309204 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1544/3402] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:50 2022] GET /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c => generated 1315 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:51.315149 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1c36b679-bc1c-4e23-839c-b183854a367c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:51.317916 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1c36b679-bc1c-4e23-839c-b183854a367c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 19784b1a-63aa-44b2-bbd5-d8dda713efdd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:51.333582 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:51.566366 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e5621678-65f4-475e-908a-c87f80425bd5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:51.578394 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1c36b679-bc1c-4e23-839c-b183854a367c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:51.584025 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e5621678-65f4-475e-908a-c87f80425bd5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:51.586686 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e5621678-65f4-475e-908a-c87f80425bd5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:51.589152 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e5621678-65f4-475e-908a-c87f80425bd5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1874 microversion: 2.42 time: 0.429663 Aug 07 01:27:51.590106 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1c36b679-bc1c-4e23-839c-b183854a367c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd" status: 200 len: 1217 microversion: 2.1 time: 0.279518 Aug 07 01:27:51.591426 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1545/3403] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:51 2022] GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd => generated 1217 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:51.604033 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1859/3404] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:51 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1874 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:51.604033 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7f1ad098-7426-45fe-a05f-2c1fbc5cf6eb tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:51.604033 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7f1ad098-7426-45fe-a05f-2c1fbc5cf6eb tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:51.619401 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9c786325-b164-44c1-ae27-d56a607f1ed1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:51.621073 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9c786325-b164-44c1-ae27-d56a607f1ed1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:51.634900 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9c786325-b164-44c1-ae27-d56a607f1ed1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:51.635730 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9c786325-b164-44c1-ae27-d56a607f1ed1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:51.636749 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9c786325-b164-44c1-ae27-d56a607f1ed1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:51.638677 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9c786325-b164-44c1-ae27-d56a607f1ed1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:51.640188 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9c786325-b164-44c1-ae27-d56a607f1ed1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:51.640971 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9c786325-b164-44c1-ae27-d56a607f1ed1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:51.650428 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f1ad098-7426-45fe-a05f-2c1fbc5cf6eb tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:51.653770 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f1ad098-7426-45fe-a05f-2c1fbc5cf6eb tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:51.654265 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f1ad098-7426-45fe-a05f-2c1fbc5cf6eb tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:51.665268 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f1ad098-7426-45fe-a05f-2c1fbc5cf6eb tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:51.665972 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f1ad098-7426-45fe-a05f-2c1fbc5cf6eb tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:51.666436 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f1ad098-7426-45fe-a05f-2c1fbc5cf6eb tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:52.221334 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7f1ad098-7426-45fe-a05f-2c1fbc5cf6eb tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:52.237316 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7f1ad098-7426-45fe-a05f-2c1fbc5cf6eb tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:52.241721 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7f1ad098-7426-45fe-a05f-2c1fbc5cf6eb tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:52.243795 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7f1ad098-7426-45fe-a05f-2c1fbc5cf6eb tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1869 microversion: 2.32 time: 0.648441 Aug 07 01:27:52.245276 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1860/3405] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:51 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1869 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:52.254212 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8ed33c38-90f7-4cec-8342-9dfa55ea3bf4 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e17aaf700>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:52.348630 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8ed33c38-90f7-4cec-8342-9dfa55ea3bf4 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6" status: 200 len: 1414 microversion: 2.1 time: 0.100610 Aug 07 01:27:52.359752 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1861/3406] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:52 2022] GET /compute/v2.1/images/f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6 => generated 1414 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:52.365315 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-8ad1f04d-2deb-4174-8e8b-25606ca94995 req-b9c2b4e8-45ee-47ee-9ed7-b59d6054ad78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f35f41f-1a7c-45c0-8958-216eb837382c", "name": "network-vif-plugged", "status": "completed", "tag": "7a8e81f8-70bd-4214-815e-a7f6a32a5f39"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:52.382371 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:52.389637 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-8ad1f04d-2deb-4174-8e8b-25606ca94995 req-b9c2b4e8-45ee-47ee-9ed7-b59d6054ad78 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:52.390567 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-8ad1f04d-2deb-4174-8e8b-25606ca94995 req-b9c2b4e8-45ee-47ee-9ed7-b59d6054ad78 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:52.391299 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-8ad1f04d-2deb-4174-8e8b-25606ca94995 req-b9c2b4e8-45ee-47ee-9ed7-b59d6054ad78 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:52.410351 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-8ad1f04d-2deb-4174-8e8b-25606ca94995 req-b9c2b4e8-45ee-47ee-9ed7-b59d6054ad78 service nova] Creating event network-vif-plugged:7a8e81f8-70bd-4214-815e-a7f6a32a5f39 for instance 8f35f41f-1a7c-45c0-8958-216eb837382c on n-h2-master-1 Aug 07 01:27:52.416975 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-8ad1f04d-2deb-4174-8e8b-25606ca94995 req-b9c2b4e8-45ee-47ee-9ed7-b59d6054ad78 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054756 Aug 07 01:27:52.418411 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1862/3407] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:27:52.429619 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4f5fdfcf-a2df-4cb0-8cce-7de30543d218 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:52.432192 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4f5fdfcf-a2df-4cb0-8cce-7de30543d218 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 8f35f41f-1a7c-45c0-8958-216eb837382c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:52.433722 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9c786325-b164-44c1-ae27-d56a607f1ed1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:52.444571 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f5fdfcf-a2df-4cb0-8cce-7de30543d218 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:52.445589 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f5fdfcf-a2df-4cb0-8cce-7de30543d218 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:52.446571 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f5fdfcf-a2df-4cb0-8cce-7de30543d218 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:52.447542 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f5fdfcf-a2df-4cb0-8cce-7de30543d218 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:52.448271 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f5fdfcf-a2df-4cb0-8cce-7de30543d218 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:52.449622 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9c786325-b164-44c1-ae27-d56a607f1ed1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.855125 Aug 07 01:27:52.450112 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f5fdfcf-a2df-4cb0-8cce-7de30543d218 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:52.451006 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1546/3408] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:51 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:52.492060 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-394f4375-0d00-45cf-b88f-b7129f3a3acc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:52.492691 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-394f4375-0d00-45cf-b88f-b7129f3a3acc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:52.518001 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-394f4375-0d00-45cf-b88f-b7129f3a3acc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:52.522750 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-394f4375-0d00-45cf-b88f-b7129f3a3acc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:52.525220 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-394f4375-0d00-45cf-b88f-b7129f3a3acc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:52.530639 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-394f4375-0d00-45cf-b88f-b7129f3a3acc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:52.533473 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-394f4375-0d00-45cf-b88f-b7129f3a3acc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:52.535996 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-394f4375-0d00-45cf-b88f-b7129f3a3acc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:52.668175 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4f5fdfcf-a2df-4cb0-8cce-7de30543d218 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:52.682284 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4f5fdfcf-a2df-4cb0-8cce-7de30543d218 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c" status: 200 len: 1315 microversion: 2.1 time: 0.258661 Aug 07 01:27:52.702716 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1863/3409] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:52 2022] GET /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:52.711732 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5a2eaba1-79f9-4ad2-bf4e-7410672b1eeb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:52.713007 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5a2eaba1-79f9-4ad2-bf4e-7410672b1eeb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 19784b1a-63aa-44b2-bbd5-d8dda713efdd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:52.721607 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a2eaba1-79f9-4ad2-bf4e-7410672b1eeb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:52.722615 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a2eaba1-79f9-4ad2-bf4e-7410672b1eeb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:52.724147 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a2eaba1-79f9-4ad2-bf4e-7410672b1eeb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:52.725141 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a2eaba1-79f9-4ad2-bf4e-7410672b1eeb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:52.725788 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a2eaba1-79f9-4ad2-bf4e-7410672b1eeb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:52.726517 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a2eaba1-79f9-4ad2-bf4e-7410672b1eeb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:52.818594 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5a2eaba1-79f9-4ad2-bf4e-7410672b1eeb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:52.830467 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5a2eaba1-79f9-4ad2-bf4e-7410672b1eeb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd" status: 200 len: 1277 microversion: 2.1 time: 0.126250 Aug 07 01:27:52.831873 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1864/3410] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:52 2022] GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd => generated 1277 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:52.836840 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c83cf2eb-ee08-4969-ad4c-cc0c70f7284f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:52.837774 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c83cf2eb-ee08-4969-ad4c-cc0c70f7284f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:52.848249 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c83cf2eb-ee08-4969-ad4c-cc0c70f7284f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:52.849781 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c83cf2eb-ee08-4969-ad4c-cc0c70f7284f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:52.853263 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c83cf2eb-ee08-4969-ad4c-cc0c70f7284f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:52.855148 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c83cf2eb-ee08-4969-ad4c-cc0c70f7284f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:52.858436 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c83cf2eb-ee08-4969-ad4c-cc0c70f7284f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:52.859230 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c83cf2eb-ee08-4969-ad4c-cc0c70f7284f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:53.195395 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c83cf2eb-ee08-4969-ad4c-cc0c70f7284f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:53.206134 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c83cf2eb-ee08-4969-ad4c-cc0c70f7284f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:53.211123 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c83cf2eb-ee08-4969-ad4c-cc0c70f7284f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:53.215161 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c83cf2eb-ee08-4969-ad4c-cc0c70f7284f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1874 microversion: 2.42 time: 0.380839 Aug 07 01:27:53.227950 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1865/3411] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:52 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1874 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:53.272730 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-31b2faa4-5fb1-4210-801a-5622fb2fcd96 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:53.273357 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-31b2faa4-5fb1-4210-801a-5622fb2fcd96 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:53.280151 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31b2faa4-5fb1-4210-801a-5622fb2fcd96 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:53.280648 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31b2faa4-5fb1-4210-801a-5622fb2fcd96 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:53.281086 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31b2faa4-5fb1-4210-801a-5622fb2fcd96 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:53.281816 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31b2faa4-5fb1-4210-801a-5622fb2fcd96 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:53.282271 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31b2faa4-5fb1-4210-801a-5622fb2fcd96 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:53.282727 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31b2faa4-5fb1-4210-801a-5622fb2fcd96 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:53.573567 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-31b2faa4-5fb1-4210-801a-5622fb2fcd96 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:53.591009 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-31b2faa4-5fb1-4210-801a-5622fb2fcd96 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:53.601457 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-31b2faa4-5fb1-4210-801a-5622fb2fcd96 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:53.603203 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-31b2faa4-5fb1-4210-801a-5622fb2fcd96 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1869 microversion: 2.32 time: 0.334944 Aug 07 01:27:53.633021 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-394f4375-0d00-45cf-b88f-b7129f3a3acc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:53.659500 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1866/3412] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:53 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1869 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:27:53.666752 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-394f4375-0d00-45cf-b88f-b7129f3a3acc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 1.181752 Aug 07 01:27:53.681185 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e322480f-7089-4cee-8448-eb343179b396 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e17aafee0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:53.682570 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1547/3413] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:52 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:53.692609 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6edb304a-f147-43f5-b169-f23fda35c3f1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:53.693164 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6edb304a-f147-43f5-b169-f23fda35c3f1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:53.721422 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6edb304a-f147-43f5-b169-f23fda35c3f1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:53.722015 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6edb304a-f147-43f5-b169-f23fda35c3f1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:53.722371 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6edb304a-f147-43f5-b169-f23fda35c3f1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:53.723061 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6edb304a-f147-43f5-b169-f23fda35c3f1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:53.723522 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6edb304a-f147-43f5-b169-f23fda35c3f1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:53.723989 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6edb304a-f147-43f5-b169-f23fda35c3f1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:53.735743 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e322480f-7089-4cee-8448-eb343179b396 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6" status: 200 len: 1414 microversion: 2.1 time: 0.074019 Aug 07 01:27:53.749102 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1867/3414] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:53 2022] GET /compute/v2.1/images/f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6 => generated 1414 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:53.754009 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3ac56991-64bf-4b57-a55c-b18bb86106f9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:53.754627 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3ac56991-64bf-4b57-a55c-b18bb86106f9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 8f35f41f-1a7c-45c0-8958-216eb837382c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:53.769411 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ac56991-64bf-4b57-a55c-b18bb86106f9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:53.770006 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ac56991-64bf-4b57-a55c-b18bb86106f9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:53.770521 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ac56991-64bf-4b57-a55c-b18bb86106f9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:53.771334 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ac56991-64bf-4b57-a55c-b18bb86106f9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:53.772153 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ac56991-64bf-4b57-a55c-b18bb86106f9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:53.772664 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ac56991-64bf-4b57-a55c-b18bb86106f9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:53.992080 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3ac56991-64bf-4b57-a55c-b18bb86106f9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:54.005269 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3ac56991-64bf-4b57-a55c-b18bb86106f9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c" status: 200 len: 1315 microversion: 2.1 time: 0.255023 Aug 07 01:27:54.007388 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1868/3415] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:53 2022] GET /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:54.015327 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-470a0657-de1a-4aba-8efd-75e4ce00f28c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:54.016737 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-470a0657-de1a-4aba-8efd-75e4ce00f28c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 19784b1a-63aa-44b2-bbd5-d8dda713efdd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:54.027735 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-470a0657-de1a-4aba-8efd-75e4ce00f28c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:54.028491 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-470a0657-de1a-4aba-8efd-75e4ce00f28c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:54.029201 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-470a0657-de1a-4aba-8efd-75e4ce00f28c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:54.030165 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-470a0657-de1a-4aba-8efd-75e4ce00f28c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:54.030789 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-470a0657-de1a-4aba-8efd-75e4ce00f28c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:54.031376 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-470a0657-de1a-4aba-8efd-75e4ce00f28c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:54.118892 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-470a0657-de1a-4aba-8efd-75e4ce00f28c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:54.129946 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-470a0657-de1a-4aba-8efd-75e4ce00f28c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd" status: 200 len: 1275 microversion: 2.1 time: 0.120567 Aug 07 01:27:54.131732 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1869/3416] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:54 2022] GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd => generated 1275 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:54.162393 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6edb304a-f147-43f5-b169-f23fda35c3f1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:54.171750 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6edb304a-f147-43f5-b169-f23fda35c3f1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.483017 Aug 07 01:27:54.183035 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1548/3417] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:53 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:27:54.241460 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c5f3982a-6e32-4517-907c-6b512f163d1c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:54.244133 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c5f3982a-6e32-4517-907c-6b512f163d1c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:54.263201 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c5f3982a-6e32-4517-907c-6b512f163d1c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:54.263739 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c5f3982a-6e32-4517-907c-6b512f163d1c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:54.267870 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c5f3982a-6e32-4517-907c-6b512f163d1c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:54.269322 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c5f3982a-6e32-4517-907c-6b512f163d1c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:54.269800 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c5f3982a-6e32-4517-907c-6b512f163d1c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:54.270232 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c5f3982a-6e32-4517-907c-6b512f163d1c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:54.372763 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fc639935-d7b4-43f3-bc18-fd51a11b39c7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1503688485", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "38e7289f-8c36-40c7-bc8a-a94f77b67d92"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:54.466811 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-fc639935-d7b4-43f3-bc18-fd51a11b39c7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] validate_networks() for [('38e7289f-8c36-40c7-bc8a-a94f77b67d92', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:27:54.553220 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c5f3982a-6e32-4517-907c-6b512f163d1c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:54.567046 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c5f3982a-6e32-4517-907c-6b512f163d1c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:54.568914 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c5f3982a-6e32-4517-907c-6b512f163d1c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:54.570084 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c5f3982a-6e32-4517-907c-6b512f163d1c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1874 microversion: 2.42 time: 0.334158 Aug 07 01:27:54.570945 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1870/3418] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:54 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1874 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:54.632784 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ed29394d-a16b-41d0-89ef-79691f141caa tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:54.633514 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ed29394d-a16b-41d0-89ef-79691f141caa tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:54.640745 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ed29394d-a16b-41d0-89ef-79691f141caa tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:54.641380 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ed29394d-a16b-41d0-89ef-79691f141caa tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:54.641937 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ed29394d-a16b-41d0-89ef-79691f141caa tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:54.642725 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ed29394d-a16b-41d0-89ef-79691f141caa tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:54.643282 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ed29394d-a16b-41d0-89ef-79691f141caa tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:54.643811 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ed29394d-a16b-41d0-89ef-79691f141caa tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:54.943508 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ed29394d-a16b-41d0-89ef-79691f141caa tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:54.960233 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ed29394d-a16b-41d0-89ef-79691f141caa tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:54.961690 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ed29394d-a16b-41d0-89ef-79691f141caa tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:54.968627 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ed29394d-a16b-41d0-89ef-79691f141caa tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1869 microversion: 2.32 time: 0.339904 Aug 07 01:27:54.969441 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1871/3419] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:54 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1869 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:54.987546 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e93b4def-a561-4a4d-878d-0b109262b6b3 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e24743d30>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:55.051951 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e93b4def-a561-4a4d-878d-0b109262b6b3 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6" status: 200 len: 1423 microversion: 2.1 time: 0.080606 Aug 07 01:27:55.062329 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1872/3420] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:54 2022] GET /compute/v2.1/images/f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6 => generated 1423 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:55.068129 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2643f94a-17cd-4aaf-88ce-312c13b161e9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:55.076890 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2643f94a-17cd-4aaf-88ce-312c13b161e9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 8f35f41f-1a7c-45c0-8958-216eb837382c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:55.086496 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2643f94a-17cd-4aaf-88ce-312c13b161e9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:55.087320 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2643f94a-17cd-4aaf-88ce-312c13b161e9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:55.087766 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2643f94a-17cd-4aaf-88ce-312c13b161e9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:55.088588 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2643f94a-17cd-4aaf-88ce-312c13b161e9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:55.089156 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2643f94a-17cd-4aaf-88ce-312c13b161e9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:55.089807 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2643f94a-17cd-4aaf-88ce-312c13b161e9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:55.270674 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2643f94a-17cd-4aaf-88ce-312c13b161e9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:55.279462 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2643f94a-17cd-4aaf-88ce-312c13b161e9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c" status: 200 len: 1315 microversion: 2.1 time: 0.215939 Aug 07 01:27:55.293547 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1873/3421] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:55 2022] GET /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:55.293547 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-be617206-6089-455d-a232-2b5906f1bf1d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e243c9b80>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:55.332097 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-be617206-6089-455d-a232-2b5906f1bf1d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6" status: 200 len: 1423 microversion: 2.1 time: 0.049686 Aug 07 01:27:55.333013 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1874/3422] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:55 2022] GET /compute/v2.1/images/f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6 => generated 1423 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:55.338427 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b67d9097-70e9-427d-a9ba-ff4d610bb7ee tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:55.339382 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b67d9097-70e9-427d-a9ba-ff4d610bb7ee tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 19784b1a-63aa-44b2-bbd5-d8dda713efdd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:55.346927 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b67d9097-70e9-427d-a9ba-ff4d610bb7ee tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:55.347708 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b67d9097-70e9-427d-a9ba-ff4d610bb7ee tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:55.348195 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b67d9097-70e9-427d-a9ba-ff4d610bb7ee tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:55.348913 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b67d9097-70e9-427d-a9ba-ff4d610bb7ee tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:55.349375 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b67d9097-70e9-427d-a9ba-ff4d610bb7ee tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:55.349804 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b67d9097-70e9-427d-a9ba-ff4d610bb7ee tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:55.423299 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b67d9097-70e9-427d-a9ba-ff4d610bb7ee tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:55.438000 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b67d9097-70e9-427d-a9ba-ff4d610bb7ee tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd" status: 200 len: 1275 microversion: 2.1 time: 0.103276 Aug 07 01:27:55.448867 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1875/3423] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:55 2022] GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd => generated 1275 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:55.469040 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f69a7942-be97-4711-9815-f6b07d7fd13d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e2482a8b0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:56.225675 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f69a7942-be97-4711-9815-f6b07d7fd13d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "DELETE /compute/v2.1/images/f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6" status: 204 len: 0 microversion: 2.1 time: 0.771677 Aug 07 01:27:56.226363 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1876/3424] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:55 2022] DELETE /compute/v2.1/images/f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6 => generated 0 bytes in 777 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:27:56.235310 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a607768d-1133-4fec-9462-166b6e0f0424 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:56.236270 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a607768d-1133-4fec-9462-166b6e0f0424 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:56.243509 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a607768d-1133-4fec-9462-166b6e0f0424 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:56.244376 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a607768d-1133-4fec-9462-166b6e0f0424 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:56.245086 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a607768d-1133-4fec-9462-166b6e0f0424 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:56.246047 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a607768d-1133-4fec-9462-166b6e0f0424 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:56.246737 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a607768d-1133-4fec-9462-166b6e0f0424 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:56.248195 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a607768d-1133-4fec-9462-166b6e0f0424 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:56.445061 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-fc639935-d7b4-43f3-bc18-fd51a11b39c7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:27:56.445520 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-fc639935-d7b4-43f3-bc18-fd51a11b39c7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:27:56.446079 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-fc639935-d7b4-43f3-bc18-fd51a11b39c7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:27:56.446563 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-fc639935-d7b4-43f3-bc18-fd51a11b39c7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:27:56.447067 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-fc639935-d7b4-43f3-bc18-fd51a11b39c7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:27:56.461488 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fc639935-d7b4-43f3-bc18-fd51a11b39c7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:56.466549 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fc639935-d7b4-43f3-bc18-fd51a11b39c7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:56.467047 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fc639935-d7b4-43f3-bc18-fd51a11b39c7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:56.469995 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fc639935-d7b4-43f3-bc18-fd51a11b39c7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:56.470624 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fc639935-d7b4-43f3-bc18-fd51a11b39c7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:56.471132 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fc639935-d7b4-43f3-bc18-fd51a11b39c7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:56.534386 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-fc639935-d7b4-43f3-bc18-fd51a11b39c7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Getting quotas for project 939fea7fa6ea4deda8d4fbef70a4e510. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:27:56.543852 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-fc639935-d7b4-43f3-bc18-fd51a11b39c7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Getting quotas for user ef29bd35cca547c39d76c54058d32979 and project 939fea7fa6ea4deda8d4fbef70a4e510. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:27:56.564022 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a607768d-1133-4fec-9462-166b6e0f0424 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:56.568171 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fc639935-d7b4-43f3-bc18-fd51a11b39c7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:27:56.572412 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fc639935-d7b4-43f3-bc18-fd51a11b39c7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: edea7d5b-2ad8-4b91-b389-8d3a6dd3f118] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:27:56.578741 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a607768d-1133-4fec-9462-166b6e0f0424 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:56.580688 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a607768d-1133-4fec-9462-166b6e0f0424 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:56.582224 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a607768d-1133-4fec-9462-166b6e0f0424 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1874 microversion: 2.42 time: 0.351315 Aug 07 01:27:56.596258 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1877/3425] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:56 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1874 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:56.608551 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0a4bcc7b-b65d-4596-a813-557812f70ebd tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:56.609763 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0a4bcc7b-b65d-4596-a813-557812f70ebd tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:56.620163 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a4bcc7b-b65d-4596-a813-557812f70ebd tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:56.621050 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a4bcc7b-b65d-4596-a813-557812f70ebd tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:56.621704 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a4bcc7b-b65d-4596-a813-557812f70ebd tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:56.622998 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a4bcc7b-b65d-4596-a813-557812f70ebd tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:56.624330 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a4bcc7b-b65d-4596-a813-557812f70ebd tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:56.624959 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a4bcc7b-b65d-4596-a813-557812f70ebd tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:56.677995 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fc639935-d7b4-43f3-bc18-fd51a11b39c7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.309777 Aug 07 01:27:56.679025 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1549/3426] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:27:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2312 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:27:56.692394 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-583d6d20-6bb2-4ffa-9252-efe469dd954b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:56.692942 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-583d6d20-6bb2-4ffa-9252-efe469dd954b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: f5432da5-94bc-4358-bca6-b025d2bc3186] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:56.709486 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-583d6d20-6bb2-4ffa-9252-efe469dd954b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:56.710398 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-583d6d20-6bb2-4ffa-9252-efe469dd954b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:56.711007 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-583d6d20-6bb2-4ffa-9252-efe469dd954b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:56.713502 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-583d6d20-6bb2-4ffa-9252-efe469dd954b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:56.716703 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-583d6d20-6bb2-4ffa-9252-efe469dd954b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:56.719589 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-583d6d20-6bb2-4ffa-9252-efe469dd954b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:56.764839 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-583d6d20-6bb2-4ffa-9252-efe469dd954b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: f5432da5-94bc-4358-bca6-b025d2bc3186] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:27:56.959761 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-583d6d20-6bb2-4ffa-9252-efe469dd954b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186" status: 204 len: 0 microversion: 2.1 time: 0.278453 Aug 07 01:27:56.973096 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1550/3427] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:27:56 2022] DELETE /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:27:56.999541 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e978d262-c1d7-4292-8768-08111179414a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:57.002275 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e978d262-c1d7-4292-8768-08111179414a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 8f35f41f-1a7c-45c0-8958-216eb837382c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:57.023294 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e978d262-c1d7-4292-8768-08111179414a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:57.024110 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e978d262-c1d7-4292-8768-08111179414a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:57.024834 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e978d262-c1d7-4292-8768-08111179414a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:57.025830 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e978d262-c1d7-4292-8768-08111179414a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:57.026720 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e978d262-c1d7-4292-8768-08111179414a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:57.027932 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e978d262-c1d7-4292-8768-08111179414a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:57.059708 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0a4bcc7b-b65d-4596-a813-557812f70ebd tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:57.083745 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0a4bcc7b-b65d-4596-a813-557812f70ebd tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:57.088550 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0a4bcc7b-b65d-4596-a813-557812f70ebd tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:57.091364 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0a4bcc7b-b65d-4596-a813-557812f70ebd tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1869 microversion: 2.32 time: 0.493804 Aug 07 01:27:57.097872 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1878/3428] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:56 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1869 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:57.128353 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-12a6bd23-d794-47b5-a52c-12bc87d15c5d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:57.134065 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-12a6bd23-d794-47b5-a52c-12bc87d15c5d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 19784b1a-63aa-44b2-bbd5-d8dda713efdd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:57.155532 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-12a6bd23-d794-47b5-a52c-12bc87d15c5d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:57.156081 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-12a6bd23-d794-47b5-a52c-12bc87d15c5d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:57.156542 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-12a6bd23-d794-47b5-a52c-12bc87d15c5d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:57.157544 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-12a6bd23-d794-47b5-a52c-12bc87d15c5d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:57.160095 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-12a6bd23-d794-47b5-a52c-12bc87d15c5d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:57.160778 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-12a6bd23-d794-47b5-a52c-12bc87d15c5d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:57.348342 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-12a6bd23-d794-47b5-a52c-12bc87d15c5d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:57.359026 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-12a6bd23-d794-47b5-a52c-12bc87d15c5d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd" status: 200 len: 1317 microversion: 2.1 time: 0.258768 Aug 07 01:27:57.360423 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1879/3429] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:57 2022] GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd => generated 1317 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:57.365578 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ddb7fe14-a643-4d03-9a21-572ea2ca35a4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:57.369288 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ddb7fe14-a643-4d03-9a21-572ea2ca35a4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: edea7d5b-2ad8-4b91-b389-8d3a6dd3f118] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:57.456204 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ddb7fe14-a643-4d03-9a21-572ea2ca35a4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:57.468325 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ddb7fe14-a643-4d03-9a21-572ea2ca35a4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118" status: 200 len: 1215 microversion: 2.1 time: 0.104465 Aug 07 01:27:57.470177 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1880/3430] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:57 2022] GET /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118 => generated 1215 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:57.476507 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f26e5c58-8b84-472f-9f56-9e939501b1a3 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-940271644", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "aad9ba1b-e4bc-4046-88bb-e7d112e5c033"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:57.550196 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-f26e5c58-8b84-472f-9f56-9e939501b1a3 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] validate_networks() for [('aad9ba1b-e4bc-4046-88bb-e7d112e5c033', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:27:58.239785 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e978d262-c1d7-4292-8768-08111179414a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:58.249725 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e978d262-c1d7-4292-8768-08111179414a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c" status: 200 len: 1315 microversion: 2.1 time: 1.274894 Aug 07 01:27:58.250747 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1551/3431] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:56 2022] GET /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c => generated 1315 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:58.258467 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e20de619-1088-49dd-8a57-9d72c9c93468 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:58.259457 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e20de619-1088-49dd-8a57-9d72c9c93468 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:58.272069 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e20de619-1088-49dd-8a57-9d72c9c93468 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:58.272791 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e20de619-1088-49dd-8a57-9d72c9c93468 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:58.273566 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e20de619-1088-49dd-8a57-9d72c9c93468 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:58.274789 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e20de619-1088-49dd-8a57-9d72c9c93468 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:58.275874 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e20de619-1088-49dd-8a57-9d72c9c93468 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:58.276850 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e20de619-1088-49dd-8a57-9d72c9c93468 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:58.500976 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-f26e5c58-8b84-472f-9f56-9e939501b1a3 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:27:58.501406 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-f26e5c58-8b84-472f-9f56-9e939501b1a3 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:27:58.501872 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-f26e5c58-8b84-472f-9f56-9e939501b1a3 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:27:58.502286 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-f26e5c58-8b84-472f-9f56-9e939501b1a3 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:27:58.502700 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-f26e5c58-8b84-472f-9f56-9e939501b1a3 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:27:58.512474 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f26e5c58-8b84-472f-9f56-9e939501b1a3 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:58.514536 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f26e5c58-8b84-472f-9f56-9e939501b1a3 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:58.515244 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f26e5c58-8b84-472f-9f56-9e939501b1a3 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:58.517742 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f26e5c58-8b84-472f-9f56-9e939501b1a3 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:58.519635 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f26e5c58-8b84-472f-9f56-9e939501b1a3 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:58.519635 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f26e5c58-8b84-472f-9f56-9e939501b1a3 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:58.551767 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-f26e5c58-8b84-472f-9f56-9e939501b1a3 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Getting quotas for project b7995a68f5a541aabda74c0b01f6aac9. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:27:58.557313 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-f26e5c58-8b84-472f-9f56-9e939501b1a3 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Getting quotas for user a50140f86f00487b90d0503d4819234f and project b7995a68f5a541aabda74c0b01f6aac9. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:27:58.572697 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f26e5c58-8b84-472f-9f56-9e939501b1a3 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:27:58.574861 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f26e5c58-8b84-472f-9f56-9e939501b1a3 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: ce6c308a-7eb4-429f-ac41-9be9c4059355] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:27:58.642955 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f26e5c58-8b84-472f-9f56-9e939501b1a3 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.171321 Aug 07 01:27:58.644118 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1881/3432] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:27:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:27:58.660017 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c0a91b12-7057-441f-aec8-8ef9b2da16f9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:58.661748 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c0a91b12-7057-441f-aec8-8ef9b2da16f9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:58.670275 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c0a91b12-7057-441f-aec8-8ef9b2da16f9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:58.671229 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c0a91b12-7057-441f-aec8-8ef9b2da16f9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:58.672192 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c0a91b12-7057-441f-aec8-8ef9b2da16f9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:58.673198 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c0a91b12-7057-441f-aec8-8ef9b2da16f9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:58.673883 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c0a91b12-7057-441f-aec8-8ef9b2da16f9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:58.674547 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c0a91b12-7057-441f-aec8-8ef9b2da16f9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:58.681446 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:58.820835 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e20de619-1088-49dd-8a57-9d72c9c93468 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:58.832980 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e20de619-1088-49dd-8a57-9d72c9c93468 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:58.835352 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e20de619-1088-49dd-8a57-9d72c9c93468 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:58.837251 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e20de619-1088-49dd-8a57-9d72c9c93468 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1874 microversion: 2.42 time: 0.585270 Aug 07 01:27:58.838563 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1552/3433] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:58 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1874 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:58.845278 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-388cbebd-1c89-4767-98d6-44003749b77d req-d5de9a57-29d8-41fc-8d70-2ea72ce15796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f35f41f-1a7c-45c0-8958-216eb837382c", "name": "network-vif-deleted", "tag": "7a8e81f8-70bd-4214-815e-a7f6a32a5f39"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:27:58.858133 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-388cbebd-1c89-4767-98d6-44003749b77d req-d5de9a57-29d8-41fc-8d70-2ea72ce15796 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:58.858889 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-388cbebd-1c89-4767-98d6-44003749b77d req-d5de9a57-29d8-41fc-8d70-2ea72ce15796 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:58.859682 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-388cbebd-1c89-4767-98d6-44003749b77d req-d5de9a57-29d8-41fc-8d70-2ea72ce15796 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:58.873881 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-388cbebd-1c89-4767-98d6-44003749b77d req-d5de9a57-29d8-41fc-8d70-2ea72ce15796 service nova] Creating event network-vif-deleted:7a8e81f8-70bd-4214-815e-a7f6a32a5f39 for instance 8f35f41f-1a7c-45c0-8958-216eb837382c on n-h2-master-1 Aug 07 01:27:58.878838 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-388cbebd-1c89-4767-98d6-44003749b77d req-d5de9a57-29d8-41fc-8d70-2ea72ce15796 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038791 Aug 07 01:27:58.880050 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1553/3434] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:27:58.885979 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c2833ea4-e004-4148-ba78-c66d6d87e485 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:58.886926 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c2833ea4-e004-4148-ba78-c66d6d87e485 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 19784b1a-63aa-44b2-bbd5-d8dda713efdd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:58.894307 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2833ea4-e004-4148-ba78-c66d6d87e485 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:58.895202 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2833ea4-e004-4148-ba78-c66d6d87e485 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:58.895804 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2833ea4-e004-4148-ba78-c66d6d87e485 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:58.897000 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2833ea4-e004-4148-ba78-c66d6d87e485 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:58.897847 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2833ea4-e004-4148-ba78-c66d6d87e485 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:58.898484 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2833ea4-e004-4148-ba78-c66d6d87e485 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:58.921105 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:59.378626 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c0a91b12-7057-441f-aec8-8ef9b2da16f9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:59.396432 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c0a91b12-7057-441f-aec8-8ef9b2da16f9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:59.403329 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c0a91b12-7057-441f-aec8-8ef9b2da16f9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:59.407963 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c0a91b12-7057-441f-aec8-8ef9b2da16f9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1869 microversion: 2.32 time: 0.760911 Aug 07 01:27:59.410191 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1882/3435] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:58 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1869 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:27:59.418959 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-69750b10-637e-4b7d-b1de-e89d840ff2eb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:59.420417 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-69750b10-637e-4b7d-b1de-e89d840ff2eb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: edea7d5b-2ad8-4b91-b389-8d3a6dd3f118] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:59.429929 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-69750b10-637e-4b7d-b1de-e89d840ff2eb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:59.430499 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-69750b10-637e-4b7d-b1de-e89d840ff2eb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:59.431234 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-69750b10-637e-4b7d-b1de-e89d840ff2eb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:59.434073 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-69750b10-637e-4b7d-b1de-e89d840ff2eb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:59.434628 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-69750b10-637e-4b7d-b1de-e89d840ff2eb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:59.435082 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-69750b10-637e-4b7d-b1de-e89d840ff2eb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:59.540617 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-69750b10-637e-4b7d-b1de-e89d840ff2eb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:59.550685 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-69750b10-637e-4b7d-b1de-e89d840ff2eb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118" status: 200 len: 1273 microversion: 2.1 time: 0.138433 Aug 07 01:27:59.551586 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1883/3436] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:59 2022] GET /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118 => generated 1273 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:59.560054 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9d68cfa4-4dcc-4cdc-ace3-a5a6aa86508a tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:59.561157 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9d68cfa4-4dcc-4cdc-ace3-a5a6aa86508a tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: ce6c308a-7eb4-429f-ac41-9be9c4059355] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:59.571012 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d68cfa4-4dcc-4cdc-ace3-a5a6aa86508a tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:59.571933 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d68cfa4-4dcc-4cdc-ace3-a5a6aa86508a tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:59.572637 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d68cfa4-4dcc-4cdc-ace3-a5a6aa86508a tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:59.573878 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d68cfa4-4dcc-4cdc-ace3-a5a6aa86508a tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:59.574564 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d68cfa4-4dcc-4cdc-ace3-a5a6aa86508a tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:59.576994 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d68cfa4-4dcc-4cdc-ace3-a5a6aa86508a tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:59.671620 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9d68cfa4-4dcc-4cdc-ace3-a5a6aa86508a tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:59.680423 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9d68cfa4-4dcc-4cdc-ace3-a5a6aa86508a tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355" status: 200 len: 1211 microversion: 2.1 time: 0.127223 Aug 07 01:27:59.681464 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1884/3437] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:59 2022] GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355 => generated 1211 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:59.687581 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fd0975ff-1500-4987-9b7a-71f700ae9253 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:59.688646 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fd0975ff-1500-4987-9b7a-71f700ae9253 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 8f35f41f-1a7c-45c0-8958-216eb837382c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:59.697876 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c2833ea4-e004-4148-ba78-c66d6d87e485 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:59.704328 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd0975ff-1500-4987-9b7a-71f700ae9253 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:59.704908 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd0975ff-1500-4987-9b7a-71f700ae9253 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:59.705362 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd0975ff-1500-4987-9b7a-71f700ae9253 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:59.706634 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c2833ea4-e004-4148-ba78-c66d6d87e485 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd" status: 200 len: 1317 microversion: 2.1 time: 0.825197 Aug 07 01:27:59.719836 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd0975ff-1500-4987-9b7a-71f700ae9253 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:59.719836 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd0975ff-1500-4987-9b7a-71f700ae9253 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:59.719836 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd0975ff-1500-4987-9b7a-71f700ae9253 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:59.721011 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1554/3438] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:58 2022] GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd => generated 1317 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:59.838633 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fd0975ff-1500-4987-9b7a-71f700ae9253 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:27:59.850982 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fd0975ff-1500-4987-9b7a-71f700ae9253 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c" status: 200 len: 1294 microversion: 2.1 time: 0.167911 Aug 07 01:27:59.868288 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1885/3439] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:27:59 2022] GET /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c => generated 1294 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:27:59.875145 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-63b04772-4ceb-421d-b658-2fe83f777b44 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:27:59.876129 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-63b04772-4ceb-421d-b658-2fe83f777b44 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:27:59.883775 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-63b04772-4ceb-421d-b658-2fe83f777b44 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:59.884348 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-63b04772-4ceb-421d-b658-2fe83f777b44 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:59.884822 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-63b04772-4ceb-421d-b658-2fe83f777b44 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:27:59.885501 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-63b04772-4ceb-421d-b658-2fe83f777b44 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:27:59.885971 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-63b04772-4ceb-421d-b658-2fe83f777b44 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:27:59.886407 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-63b04772-4ceb-421d-b658-2fe83f777b44 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:00.442690 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b87039d5-5a26-44af-9e9c-4090ba56bfff tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:00.443348 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b87039d5-5a26-44af-9e9c-4090ba56bfff tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:00.450742 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b87039d5-5a26-44af-9e9c-4090ba56bfff tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:00.451233 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b87039d5-5a26-44af-9e9c-4090ba56bfff tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:00.451747 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b87039d5-5a26-44af-9e9c-4090ba56bfff tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:00.452492 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b87039d5-5a26-44af-9e9c-4090ba56bfff tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:00.452946 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b87039d5-5a26-44af-9e9c-4090ba56bfff tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:00.453367 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b87039d5-5a26-44af-9e9c-4090ba56bfff tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:00.737913 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-63b04772-4ceb-421d-b658-2fe83f777b44 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:00.747456 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-63b04772-4ceb-421d-b658-2fe83f777b44 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:00.749113 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-63b04772-4ceb-421d-b658-2fe83f777b44 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:00.750360 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-63b04772-4ceb-421d-b658-2fe83f777b44 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1874 microversion: 2.42 time: 0.885543 Aug 07 01:28:00.750937 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1555/3440] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:27:59 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1874 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:28:00.766548 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c97f0f97-56c0-4d27-ab4b-8fb39be3c61f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:00.767175 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c97f0f97-56c0-4d27-ab4b-8fb39be3c61f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: edea7d5b-2ad8-4b91-b389-8d3a6dd3f118] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:00.783714 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c97f0f97-56c0-4d27-ab4b-8fb39be3c61f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:00.785190 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c97f0f97-56c0-4d27-ab4b-8fb39be3c61f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:00.786264 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c97f0f97-56c0-4d27-ab4b-8fb39be3c61f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:00.789022 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c97f0f97-56c0-4d27-ab4b-8fb39be3c61f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:00.798140 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c97f0f97-56c0-4d27-ab4b-8fb39be3c61f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:00.799439 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c97f0f97-56c0-4d27-ab4b-8fb39be3c61f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:00.971211 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b87039d5-5a26-44af-9e9c-4090ba56bfff tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:01.013648 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c97f0f97-56c0-4d27-ab4b-8fb39be3c61f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:01.018946 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b87039d5-5a26-44af-9e9c-4090ba56bfff tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:01.024495 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b87039d5-5a26-44af-9e9c-4090ba56bfff tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:01.027217 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b87039d5-5a26-44af-9e9c-4090ba56bfff tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1869 microversion: 2.32 time: 0.588818 Aug 07 01:28:01.043933 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1886/3441] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:28:00 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1869 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:28:01.043933 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b7c9f286-8998-4392-b631-0c9a9665ce96 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:01.043933 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b7c9f286-8998-4392-b631-0c9a9665ce96 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: ce6c308a-7eb4-429f-ac41-9be9c4059355] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:01.055037 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7c9f286-8998-4392-b631-0c9a9665ce96 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:01.056078 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7c9f286-8998-4392-b631-0c9a9665ce96 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:01.056843 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7c9f286-8998-4392-b631-0c9a9665ce96 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:01.057898 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7c9f286-8998-4392-b631-0c9a9665ce96 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:01.058629 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7c9f286-8998-4392-b631-0c9a9665ce96 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:01.059303 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7c9f286-8998-4392-b631-0c9a9665ce96 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:01.080683 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c97f0f97-56c0-4d27-ab4b-8fb39be3c61f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118" status: 200 len: 1273 microversion: 2.1 time: 0.318480 Aug 07 01:28:01.081730 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1556/3442] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:00 2022] GET /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118 => generated 1273 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:01.100924 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b1f39ff2-0b80-4113-bc47-737667635822 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:01.102559 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b1f39ff2-0b80-4113-bc47-737667635822 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 19784b1a-63aa-44b2-bbd5-d8dda713efdd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:01.121855 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b1f39ff2-0b80-4113-bc47-737667635822 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:01.122733 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b1f39ff2-0b80-4113-bc47-737667635822 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:01.124241 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b1f39ff2-0b80-4113-bc47-737667635822 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:01.125503 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b1f39ff2-0b80-4113-bc47-737667635822 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:01.126662 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b1f39ff2-0b80-4113-bc47-737667635822 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:01.127437 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b1f39ff2-0b80-4113-bc47-737667635822 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:01.196702 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b7c9f286-8998-4392-b631-0c9a9665ce96 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:01.204855 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b7c9f286-8998-4392-b631-0c9a9665ce96 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355" status: 200 len: 1265 microversion: 2.1 time: 0.170318 Aug 07 01:28:01.205446 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1887/3443] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:01 2022] GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:01.210306 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-94d16229-34a7-443a-ae13-f243596873ed tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:01.211238 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-94d16229-34a7-443a-ae13-f243596873ed tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 8f35f41f-1a7c-45c0-8958-216eb837382c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:01.218077 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94d16229-34a7-443a-ae13-f243596873ed tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:01.218907 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94d16229-34a7-443a-ae13-f243596873ed tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:01.219563 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94d16229-34a7-443a-ae13-f243596873ed tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:01.220819 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94d16229-34a7-443a-ae13-f243596873ed tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:01.221503 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94d16229-34a7-443a-ae13-f243596873ed tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:01.221925 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94d16229-34a7-443a-ae13-f243596873ed tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:01.406228 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-94d16229-34a7-443a-ae13-f243596873ed tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:01.422054 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-94d16229-34a7-443a-ae13-f243596873ed tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c" status: 200 len: 1294 microversion: 2.1 time: 0.211460 Aug 07 01:28:01.423030 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1888/3444] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:01 2022] GET /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c => generated 1294 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:01.430189 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-ae9c3799-3eea-4c16-aded-f2b860ccb19c req-c84add78-8b45-486c-beff-516e58724572 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19784b1a-63aa-44b2-bbd5-d8dda713efdd", "tag": "f9c5ce9d-4152-4817-9794-be707d2942bd"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:01.446918 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-ae9c3799-3eea-4c16-aded-f2b860ccb19c req-c84add78-8b45-486c-beff-516e58724572 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:01.448667 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-ae9c3799-3eea-4c16-aded-f2b860ccb19c req-c84add78-8b45-486c-beff-516e58724572 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:01.448973 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-ae9c3799-3eea-4c16-aded-f2b860ccb19c req-c84add78-8b45-486c-beff-516e58724572 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:01.469202 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-ae9c3799-3eea-4c16-aded-f2b860ccb19c req-c84add78-8b45-486c-beff-516e58724572 service nova] Creating event network-changed:f9c5ce9d-4152-4817-9794-be707d2942bd for instance 19784b1a-63aa-44b2-bbd5-d8dda713efdd on n-h1-master-1 Aug 07 01:28:01.475348 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-ae9c3799-3eea-4c16-aded-f2b860ccb19c req-c84add78-8b45-486c-beff-516e58724572 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050833 Aug 07 01:28:01.476715 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1889/3445] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:28:01.591390 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-c9175354-e8c7-4a6a-8b02-3a227dd3d6a9 req-6fa85dfd-8d1a-475a-a6ca-3fcafd2f2900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77ed645e-669e-4167-ae78-8ce69770babf", "name": "network-vif-plugged", "status": "completed", "tag": "20e0f822-dbb7-40fe-862e-071c9953a3bf"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:01.603337 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c9175354-e8c7-4a6a-8b02-3a227dd3d6a9 req-6fa85dfd-8d1a-475a-a6ca-3fcafd2f2900 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:01.604223 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c9175354-e8c7-4a6a-8b02-3a227dd3d6a9 req-6fa85dfd-8d1a-475a-a6ca-3fcafd2f2900 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:01.604888 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c9175354-e8c7-4a6a-8b02-3a227dd3d6a9 req-6fa85dfd-8d1a-475a-a6ca-3fcafd2f2900 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:01.624531 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-c9175354-e8c7-4a6a-8b02-3a227dd3d6a9 req-6fa85dfd-8d1a-475a-a6ca-3fcafd2f2900 service nova] Creating event network-vif-plugged:20e0f822-dbb7-40fe-862e-071c9953a3bf for instance 77ed645e-669e-4167-ae78-8ce69770babf on n-h1-master-1 Aug 07 01:28:01.638899 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-c9175354-e8c7-4a6a-8b02-3a227dd3d6a9 req-6fa85dfd-8d1a-475a-a6ca-3fcafd2f2900 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052506 Aug 07 01:28:01.640890 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1890/3446] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:28:01.712439 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b1f39ff2-0b80-4113-bc47-737667635822 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:01.738312 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b1f39ff2-0b80-4113-bc47-737667635822 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd" status: 200 len: 1317 microversion: 2.1 time: 0.652031 Aug 07 01:28:01.741166 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1557/3447] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:01 2022] GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd => generated 1317 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:01.780195 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c0215e83-657e-4edf-a02c-289f46621f8a tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:01.782069 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c0215e83-657e-4edf-a02c-289f46621f8a tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:01.794624 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c0215e83-657e-4edf-a02c-289f46621f8a tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:01.796631 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c0215e83-657e-4edf-a02c-289f46621f8a tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:01.797931 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c0215e83-657e-4edf-a02c-289f46621f8a tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:01.799670 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c0215e83-657e-4edf-a02c-289f46621f8a tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:01.800786 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c0215e83-657e-4edf-a02c-289f46621f8a tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:01.801643 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c0215e83-657e-4edf-a02c-289f46621f8a tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:02.076350 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d54a5c9b-46d7-4b68-88e2-70e2c95fccb2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:02.077192 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d54a5c9b-46d7-4b68-88e2-70e2c95fccb2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:02.089760 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d54a5c9b-46d7-4b68-88e2-70e2c95fccb2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:02.100688 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d54a5c9b-46d7-4b68-88e2-70e2c95fccb2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:02.101485 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d54a5c9b-46d7-4b68-88e2-70e2c95fccb2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:02.102533 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d54a5c9b-46d7-4b68-88e2-70e2c95fccb2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:02.103239 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d54a5c9b-46d7-4b68-88e2-70e2c95fccb2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:02.103975 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d54a5c9b-46d7-4b68-88e2-70e2c95fccb2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:02.386443 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c0215e83-657e-4edf-a02c-289f46621f8a tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:02.401774 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c0215e83-657e-4edf-a02c-289f46621f8a tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:02.410456 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c0215e83-657e-4edf-a02c-289f46621f8a tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:02.411745 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c0215e83-657e-4edf-a02c-289f46621f8a tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1874 microversion: 2.42 time: 0.636830 Aug 07 01:28:02.412382 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1891/3448] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:28:01 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1874 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:28:02.432714 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-787c6956-aab4-4956-970f-0fd90950a3d6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:02.434121 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-787c6956-aab4-4956-970f-0fd90950a3d6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: edea7d5b-2ad8-4b91-b389-8d3a6dd3f118] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:02.441700 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-787c6956-aab4-4956-970f-0fd90950a3d6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:02.441910 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-787c6956-aab4-4956-970f-0fd90950a3d6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:02.442351 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-787c6956-aab4-4956-970f-0fd90950a3d6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:02.443315 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-787c6956-aab4-4956-970f-0fd90950a3d6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:02.443531 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-787c6956-aab4-4956-970f-0fd90950a3d6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:02.443986 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-787c6956-aab4-4956-970f-0fd90950a3d6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:02.989953 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-787c6956-aab4-4956-970f-0fd90950a3d6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:03.012377 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-787c6956-aab4-4956-970f-0fd90950a3d6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118" status: 200 len: 1315 microversion: 2.1 time: 0.598778 Aug 07 01:28:03.029199 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1892/3449] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:02 2022] GET /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118 => generated 1315 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:03.031004 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3f296a7b-cca8-4fed-b50a-2d5096c6960a tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:03.032213 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3f296a7b-cca8-4fed-b50a-2d5096c6960a tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: ce6c308a-7eb4-429f-ac41-9be9c4059355] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:03.058068 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f296a7b-cca8-4fed-b50a-2d5096c6960a tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:03.059210 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f296a7b-cca8-4fed-b50a-2d5096c6960a tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:03.059736 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f296a7b-cca8-4fed-b50a-2d5096c6960a tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:03.065180 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f296a7b-cca8-4fed-b50a-2d5096c6960a tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:03.065785 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f296a7b-cca8-4fed-b50a-2d5096c6960a tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:03.066458 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f296a7b-cca8-4fed-b50a-2d5096c6960a tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:03.246037 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d54a5c9b-46d7-4b68-88e2-70e2c95fccb2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:03.256142 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d54a5c9b-46d7-4b68-88e2-70e2c95fccb2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:03.257661 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d54a5c9b-46d7-4b68-88e2-70e2c95fccb2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:03.263293 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d54a5c9b-46d7-4b68-88e2-70e2c95fccb2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1869 microversion: 2.32 time: 1.192039 Aug 07 01:28:03.266698 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1558/3450] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:28:02 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1869 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:28:03.275261 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-78d782c8-84d3-470d-bc8a-8b0611c1e7ce tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:03.276188 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-78d782c8-84d3-470d-bc8a-8b0611c1e7ce tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 8f35f41f-1a7c-45c0-8958-216eb837382c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:03.288065 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78d782c8-84d3-470d-bc8a-8b0611c1e7ce tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:03.288977 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78d782c8-84d3-470d-bc8a-8b0611c1e7ce tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:03.289653 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78d782c8-84d3-470d-bc8a-8b0611c1e7ce tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:03.290663 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78d782c8-84d3-470d-bc8a-8b0611c1e7ce tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:03.291502 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78d782c8-84d3-470d-bc8a-8b0611c1e7ce tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:03.292204 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78d782c8-84d3-470d-bc8a-8b0611c1e7ce tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:03.310184 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-78d782c8-84d3-470d-bc8a-8b0611c1e7ce tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] HTTP exception thrown: Instance 8f35f41f-1a7c-45c0-8958-216eb837382c could not be found. Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-78d782c8-84d3-470d-bc8a-8b0611c1e7ce tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Request method failure captured: Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c HTTP/1.1 Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xRoqM1ZK4H7GtvmxWX9ofAmOsKF2OdU6k1rehi-6yk86CpmfTNVcE0kwd9G1ahgJHyDlEB2bKz4XbnD5Ku_zcl240Q-kfWeKv3HfC_GyXmFAQWa4hNXP2nUgxgBXBe_oBb5a-t1xlRXFxfo9n87AmGbLBI9ZdV03LZwWshVd2n0WvE Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5506f7c95c1a46c5b3966597764b0111", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d1f0c01c340940388b440932d51988ff Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 8f35f41f-1a7c-45c0-8958-216eb837382c could not be found. Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '8f35f41f-1a7c-45c0-8958-216eb837382c'} Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f35f41f-1a7c-45c0-8958-216eb837382c could not be found. Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f35f41f-1a7c-45c0-8958-216eb837382c could not be found. Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:03.312751 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:03.317276 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:03.317276 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:03.317276 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:03.317276 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:28:03.317276 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:28:03.317276 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f35f41f-1a7c-45c0-8958-216eb837382c could not be found. Aug 07 01:28:03.317276 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:03.320023 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-78d782c8-84d3-470d-bc8a-8b0611c1e7ce tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Returning 404 to user: Instance 8f35f41f-1a7c-45c0-8958-216eb837382c could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:28:03.321138 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-78d782c8-84d3-470d-bc8a-8b0611c1e7ce tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c" status: 404 len: 111 microversion: 2.1 time: 0.053285 Aug 07 01:28:03.322088 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1559/3451] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:03 2022] GET /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:28:03.328581 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8724db1e-c998-4018-830d-37b5ad5ab0a6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:03.330075 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8724db1e-c998-4018-830d-37b5ad5ab0a6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 19784b1a-63aa-44b2-bbd5-d8dda713efdd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:03.337127 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8724db1e-c998-4018-830d-37b5ad5ab0a6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:03.337979 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8724db1e-c998-4018-830d-37b5ad5ab0a6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:03.338664 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8724db1e-c998-4018-830d-37b5ad5ab0a6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:03.339861 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8724db1e-c998-4018-830d-37b5ad5ab0a6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:03.340624 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8724db1e-c998-4018-830d-37b5ad5ab0a6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:03.341289 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8724db1e-c998-4018-830d-37b5ad5ab0a6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:03.363377 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3f296a7b-cca8-4fed-b50a-2d5096c6960a tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:03.372060 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3f296a7b-cca8-4fed-b50a-2d5096c6960a tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355" status: 200 len: 1307 microversion: 2.1 time: 0.353664 Aug 07 01:28:03.372660 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1893/3452] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:03 2022] GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355 => generated 1307 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:03.442780 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4f9bec40-835c-4376-b15a-9c92f2902e6c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:03.443459 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4f9bec40-835c-4376-b15a-9c92f2902e6c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:03.452953 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f9bec40-835c-4376-b15a-9c92f2902e6c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:03.453451 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f9bec40-835c-4376-b15a-9c92f2902e6c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:03.453892 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f9bec40-835c-4376-b15a-9c92f2902e6c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:03.454609 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f9bec40-835c-4376-b15a-9c92f2902e6c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:03.455068 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f9bec40-835c-4376-b15a-9c92f2902e6c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:03.455495 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f9bec40-835c-4376-b15a-9c92f2902e6c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:03.882675 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8724db1e-c998-4018-830d-37b5ad5ab0a6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:03.897817 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8724db1e-c998-4018-830d-37b5ad5ab0a6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd" status: 200 len: 1317 microversion: 2.1 time: 0.574332 Aug 07 01:28:03.900843 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1560/3453] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:03 2022] GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd => generated 1317 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:03.907276 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b9cda391-a9eb-454f-82a1-4b4f81e9a421 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-954063463", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "554905b9-fa00-4877-bc90-609c81108292"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:04.019536 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-b9cda391-a9eb-454f-82a1-4b4f81e9a421 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] validate_networks() for [('554905b9-fa00-4877-bc90-609c81108292', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:28:04.190969 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4f9bec40-835c-4376-b15a-9c92f2902e6c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:04.208796 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4f9bec40-835c-4376-b15a-9c92f2902e6c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:04.211873 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4f9bec40-835c-4376-b15a-9c92f2902e6c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:04.213990 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4f9bec40-835c-4376-b15a-9c92f2902e6c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1874 microversion: 2.42 time: 0.774990 Aug 07 01:28:04.229732 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1894/3454] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:28:03 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1874 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:28:04.242506 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-9c579318-ab06-4daa-80e3-fcf5f372fa11 req-609d95fe-874f-4187-a25a-d8e88c707a6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5432da5-94bc-4358-bca6-b025d2bc3186", "name": "network-vif-deleted", "tag": "4e7534f9-e07f-4f04-a90d-f11e0ff193e2"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:04.254344 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-9c579318-ab06-4daa-80e3-fcf5f372fa11 req-609d95fe-874f-4187-a25a-d8e88c707a6e service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:04.255159 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-9c579318-ab06-4daa-80e3-fcf5f372fa11 req-609d95fe-874f-4187-a25a-d8e88c707a6e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:04.255761 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-9c579318-ab06-4daa-80e3-fcf5f372fa11 req-609d95fe-874f-4187-a25a-d8e88c707a6e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:04.271461 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-9c579318-ab06-4daa-80e3-fcf5f372fa11 req-609d95fe-874f-4187-a25a-d8e88c707a6e service nova] Creating event network-vif-deleted:4e7534f9-e07f-4f04-a90d-f11e0ff193e2 for instance f5432da5-94bc-4358-bca6-b025d2bc3186 on n-h1-master-1 Aug 07 01:28:04.278333 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-9c579318-ab06-4daa-80e3-fcf5f372fa11 req-609d95fe-874f-4187-a25a-d8e88c707a6e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046935 Aug 07 01:28:04.280099 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1895/3455] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:28:04.286680 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-e181a60d-eaf6-4883-9242-e44d16e34cf2 req-3154878e-0bc1-4a7c-a71f-ad269b050f7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77ed645e-669e-4167-ae78-8ce69770babf", "name": "network-vif-plugged", "status": "completed", "tag": "840656e7-e0bc-4bee-89df-d4b7a1945712"}, {"server_uuid": "77ed645e-669e-4167-ae78-8ce69770babf", "name": "network-vif-plugged", "status": "completed", "tag": "ddd3713f-bf35-44b3-af6e-430d7ac4d4e5"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:04.304061 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e181a60d-eaf6-4883-9242-e44d16e34cf2 req-3154878e-0bc1-4a7c-a71f-ad269b050f7f service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:04.304793 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e181a60d-eaf6-4883-9242-e44d16e34cf2 req-3154878e-0bc1-4a7c-a71f-ad269b050f7f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:04.305503 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e181a60d-eaf6-4883-9242-e44d16e34cf2 req-3154878e-0bc1-4a7c-a71f-ad269b050f7f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:04.321228 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-e181a60d-eaf6-4883-9242-e44d16e34cf2 req-3154878e-0bc1-4a7c-a71f-ad269b050f7f service nova] Creating event network-vif-plugged:840656e7-e0bc-4bee-89df-d4b7a1945712 for instance 77ed645e-669e-4167-ae78-8ce69770babf on n-h1-master-1 Aug 07 01:28:04.322525 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-e181a60d-eaf6-4883-9242-e44d16e34cf2 req-3154878e-0bc1-4a7c-a71f-ad269b050f7f service nova] Creating event network-vif-plugged:ddd3713f-bf35-44b3-af6e-430d7ac4d4e5 for instance 77ed645e-669e-4167-ae78-8ce69770babf on n-h1-master-1 Aug 07 01:28:04.329105 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-e181a60d-eaf6-4883-9242-e44d16e34cf2 req-3154878e-0bc1-4a7c-a71f-ad269b050f7f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046877 Aug 07 01:28:04.330116 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1896/3456] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:28:04.336395 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9e5cae95-7975-40d6-bbdf-affe2fde40b5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:04.337483 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9e5cae95-7975-40d6-bbdf-affe2fde40b5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: edea7d5b-2ad8-4b91-b389-8d3a6dd3f118] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:04.346147 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e5cae95-7975-40d6-bbdf-affe2fde40b5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:04.347106 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e5cae95-7975-40d6-bbdf-affe2fde40b5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:04.348114 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e5cae95-7975-40d6-bbdf-affe2fde40b5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:04.349679 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e5cae95-7975-40d6-bbdf-affe2fde40b5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:04.350846 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e5cae95-7975-40d6-bbdf-affe2fde40b5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:04.351547 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e5cae95-7975-40d6-bbdf-affe2fde40b5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:04.707805 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9e5cae95-7975-40d6-bbdf-affe2fde40b5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:04.721494 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9e5cae95-7975-40d6-bbdf-affe2fde40b5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118" status: 200 len: 1315 microversion: 2.1 time: 0.389522 Aug 07 01:28:04.724185 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1897/3457] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:04 2022] GET /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118 => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:05.103579 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1b217581-a88f-4b73-be1e-26baa3d45d28 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-293719115", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:05.189172 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-1b217581-a88f-4b73-be1e-26baa3d45d28 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] validate_networks() for [('6004ae73-1463-4d0d-b75b-78b3f2a8489b', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:28:05.298266 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-b9cda391-a9eb-454f-82a1-4b4f81e9a421 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:28:05.300015 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-b9cda391-a9eb-454f-82a1-4b4f81e9a421 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:28:05.305348 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-b9cda391-a9eb-454f-82a1-4b4f81e9a421 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:28:05.308287 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-b9cda391-a9eb-454f-82a1-4b4f81e9a421 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:28:05.309032 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-b9cda391-a9eb-454f-82a1-4b4f81e9a421 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:28:05.323063 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9cda391-a9eb-454f-82a1-4b4f81e9a421 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:05.324947 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9cda391-a9eb-454f-82a1-4b4f81e9a421 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:05.329501 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9cda391-a9eb-454f-82a1-4b4f81e9a421 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:05.330453 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9cda391-a9eb-454f-82a1-4b4f81e9a421 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:05.331342 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9cda391-a9eb-454f-82a1-4b4f81e9a421 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:05.331874 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9cda391-a9eb-454f-82a1-4b4f81e9a421 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:05.358834 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-b9cda391-a9eb-454f-82a1-4b4f81e9a421 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Getting quotas for project 5506f7c95c1a46c5b3966597764b0111. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:28:05.373327 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-b9cda391-a9eb-454f-82a1-4b4f81e9a421 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Getting quotas for user d1f0c01c340940388b440932d51988ff and project 5506f7c95c1a46c5b3966597764b0111. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:28:05.397551 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b9cda391-a9eb-454f-82a1-4b4f81e9a421 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:28:05.400629 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b9cda391-a9eb-454f-82a1-4b4f81e9a421 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6d4bf33c-473a-445e-8194-29cbf0b4f1ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:28:05.493557 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b9cda391-a9eb-454f-82a1-4b4f81e9a421 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.591442 Aug 07 01:28:05.500064 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1561/3458] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:28:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:28:05.500064 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d10a3f8a-465d-486d-88da-16550c764030 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:05.500064 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d10a3f8a-465d-486d-88da-16550c764030 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:05.511262 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d10a3f8a-465d-486d-88da-16550c764030 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:05.512184 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d10a3f8a-465d-486d-88da-16550c764030 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:05.512799 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d10a3f8a-465d-486d-88da-16550c764030 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:05.514295 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d10a3f8a-465d-486d-88da-16550c764030 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:05.514937 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d10a3f8a-465d-486d-88da-16550c764030 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:05.515537 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d10a3f8a-465d-486d-88da-16550c764030 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:06.180039 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d10a3f8a-465d-486d-88da-16550c764030 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:06.191169 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d10a3f8a-465d-486d-88da-16550c764030 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:06.192812 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d10a3f8a-465d-486d-88da-16550c764030 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:06.194309 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d10a3f8a-465d-486d-88da-16550c764030 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1869 microversion: 2.32 time: 0.699132 Aug 07 01:28:06.195453 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1562/3459] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:28:05 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1869 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:28:06.200958 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-97349429-390a-455b-b2b5-b2ee7b54cedc tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:06.202270 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-97349429-390a-455b-b2b5-b2ee7b54cedc tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: ce6c308a-7eb4-429f-ac41-9be9c4059355] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:06.210821 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-97349429-390a-455b-b2b5-b2ee7b54cedc tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:06.211749 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-97349429-390a-455b-b2b5-b2ee7b54cedc tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:06.212469 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-97349429-390a-455b-b2b5-b2ee7b54cedc tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:06.213577 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-97349429-390a-455b-b2b5-b2ee7b54cedc tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:06.216045 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-97349429-390a-455b-b2b5-b2ee7b54cedc tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:06.217055 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-97349429-390a-455b-b2b5-b2ee7b54cedc tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:06.528406 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-97349429-390a-455b-b2b5-b2ee7b54cedc tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:06.540320 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-97349429-390a-455b-b2b5-b2ee7b54cedc tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355" status: 200 len: 1307 microversion: 2.1 time: 0.342939 Aug 07 01:28:06.541249 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1563/3460] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:06 2022] GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355 => generated 1307 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:06.549887 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f1f97c98-72ca-4120-aa3b-23afd733593b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:06.550826 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f1f97c98-72ca-4120-aa3b-23afd733593b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 19784b1a-63aa-44b2-bbd5-d8dda713efdd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:06.560146 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1f97c98-72ca-4120-aa3b-23afd733593b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:06.561433 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1f97c98-72ca-4120-aa3b-23afd733593b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:06.562080 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1f97c98-72ca-4120-aa3b-23afd733593b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:06.562980 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1f97c98-72ca-4120-aa3b-23afd733593b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:06.564346 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1f97c98-72ca-4120-aa3b-23afd733593b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:06.565164 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1f97c98-72ca-4120-aa3b-23afd733593b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:06.703641 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-1b217581-a88f-4b73-be1e-26baa3d45d28 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:28:06.704658 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-1b217581-a88f-4b73-be1e-26baa3d45d28 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:28:06.705328 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-1b217581-a88f-4b73-be1e-26baa3d45d28 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:28:06.705898 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-1b217581-a88f-4b73-be1e-26baa3d45d28 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:28:06.706472 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-1b217581-a88f-4b73-be1e-26baa3d45d28 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:28:06.717788 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b217581-a88f-4b73-be1e-26baa3d45d28 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:06.718480 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b217581-a88f-4b73-be1e-26baa3d45d28 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:06.719106 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b217581-a88f-4b73-be1e-26baa3d45d28 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:06.720023 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b217581-a88f-4b73-be1e-26baa3d45d28 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:06.720650 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b217581-a88f-4b73-be1e-26baa3d45d28 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:06.721284 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b217581-a88f-4b73-be1e-26baa3d45d28 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:06.740853 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-1b217581-a88f-4b73-be1e-26baa3d45d28 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Getting quotas for project d8face435f3549b5adbadf2f94707712. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:28:06.747814 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-1b217581-a88f-4b73-be1e-26baa3d45d28 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Getting quotas for user 845cd61b22924fd3a915186a6093ac12 and project d8face435f3549b5adbadf2f94707712. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:28:06.764313 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1b217581-a88f-4b73-be1e-26baa3d45d28 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:28:06.766999 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1b217581-a88f-4b73-be1e-26baa3d45d28 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:28:06.859566 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1b217581-a88f-4b73-be1e-26baa3d45d28 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.134565 Aug 07 01:28:06.862039 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1898/3461] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:28:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 2138 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:28:06.868528 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-eb6aab26-5c11-47fa-a739-c0087325b132 req-f1cb0885-8e22-4273-b797-696ef08889f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce6c308a-7eb4-429f-ac41-9be9c4059355", "tag": "5948aeb6-19cc-4823-b3f6-0002d62e04ea"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:06.883355 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-eb6aab26-5c11-47fa-a739-c0087325b132 req-f1cb0885-8e22-4273-b797-696ef08889f7 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:06.884214 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-eb6aab26-5c11-47fa-a739-c0087325b132 req-f1cb0885-8e22-4273-b797-696ef08889f7 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:06.884810 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-eb6aab26-5c11-47fa-a739-c0087325b132 req-f1cb0885-8e22-4273-b797-696ef08889f7 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:06.899398 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-eb6aab26-5c11-47fa-a739-c0087325b132 req-f1cb0885-8e22-4273-b797-696ef08889f7 service nova] Creating event network-changed:5948aeb6-19cc-4823-b3f6-0002d62e04ea for instance ce6c308a-7eb4-429f-ac41-9be9c4059355 on n-h1-master-1 Aug 07 01:28:06.905657 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-eb6aab26-5c11-47fa-a739-c0087325b132 req-f1cb0885-8e22-4273-b797-696ef08889f7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042171 Aug 07 01:28:06.907123 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1899/3462] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:28:06.940397 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ca434328-bd70-4fc2-96ee-8f20d84c63bb tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:06.942616 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ca434328-bd70-4fc2-96ee-8f20d84c63bb tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:06.959610 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca434328-bd70-4fc2-96ee-8f20d84c63bb tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:06.960491 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca434328-bd70-4fc2-96ee-8f20d84c63bb tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:06.961570 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca434328-bd70-4fc2-96ee-8f20d84c63bb tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:06.964220 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca434328-bd70-4fc2-96ee-8f20d84c63bb tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:06.965119 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca434328-bd70-4fc2-96ee-8f20d84c63bb tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:06.965760 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca434328-bd70-4fc2-96ee-8f20d84c63bb tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:07.380752 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ca434328-bd70-4fc2-96ee-8f20d84c63bb tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:07.390973 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f1f97c98-72ca-4120-aa3b-23afd733593b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:07.416004 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f1f97c98-72ca-4120-aa3b-23afd733593b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd" status: 200 len: 1317 microversion: 2.1 time: 0.867640 Aug 07 01:28:07.416662 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1564/3463] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:06 2022] GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd => generated 1317 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:07.418232 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ca434328-bd70-4fc2-96ee-8f20d84c63bb tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:07.426245 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ca434328-bd70-4fc2-96ee-8f20d84c63bb tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:07.431993 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ca434328-bd70-4fc2-96ee-8f20d84c63bb tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1874 microversion: 2.42 time: 0.520809 Aug 07 01:28:07.436403 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-04f3478f-fca8-4d14-a5af-3f9606b0e450 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:07.437360 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1900/3464] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:28:06 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1874 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:28:07.438772 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-04f3478f-fca8-4d14-a5af-3f9606b0e450 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6d4bf33c-473a-445e-8194-29cbf0b4f1ac] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:07.462895 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7218ff53-3719-42de-94bb-3e4e0cbb7743 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:07.465055 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7218ff53-3719-42de-94bb-3e4e0cbb7743 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: edea7d5b-2ad8-4b91-b389-8d3a6dd3f118] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:07.466845 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-04f3478f-fca8-4d14-a5af-3f9606b0e450 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:07.469810 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-04f3478f-fca8-4d14-a5af-3f9606b0e450 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:07.470332 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-04f3478f-fca8-4d14-a5af-3f9606b0e450 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:07.471562 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-04f3478f-fca8-4d14-a5af-3f9606b0e450 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:07.472894 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-04f3478f-fca8-4d14-a5af-3f9606b0e450 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:07.474186 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-04f3478f-fca8-4d14-a5af-3f9606b0e450 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:07.474948 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:07.490780 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7218ff53-3719-42de-94bb-3e4e0cbb7743 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:07.492677 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7218ff53-3719-42de-94bb-3e4e0cbb7743 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:07.495294 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7218ff53-3719-42de-94bb-3e4e0cbb7743 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:07.501823 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7218ff53-3719-42de-94bb-3e4e0cbb7743 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:07.502356 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7218ff53-3719-42de-94bb-3e4e0cbb7743 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:07.504253 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7218ff53-3719-42de-94bb-3e4e0cbb7743 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:07.626333 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-04f3478f-fca8-4d14-a5af-3f9606b0e450 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:07.650779 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-04f3478f-fca8-4d14-a5af-3f9606b0e450 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac" status: 200 len: 1272 microversion: 2.1 time: 0.231113 Aug 07 01:28:07.652044 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1565/3465] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:07 2022] GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac => generated 1272 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:07.659113 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-eb99e6db-600e-4dd6-b9a8-488f11d8f756 req-f1819e4a-9d9e-49e1-8ab7-489dae53ef5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77ed645e-669e-4167-ae78-8ce69770babf", "name": "network-vif-plugged", "status": "completed", "tag": "1268da76-b550-4f84-ab0c-afc461703feb"}, {"server_uuid": "77ed645e-669e-4167-ae78-8ce69770babf", "name": "network-vif-plugged", "status": "completed", "tag": "4ef68384-661e-4ee2-9cb3-6b136e92c283"}, {"server_uuid": "77ed645e-669e-4167-ae78-8ce69770babf", "name": "network-vif-plugged", "status": "completed", "tag": "266d9506-a2b8-4b18-a0fc-163e3269dd34"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:07.683347 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-eb99e6db-600e-4dd6-b9a8-488f11d8f756 req-f1819e4a-9d9e-49e1-8ab7-489dae53ef5d service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:07.684314 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-eb99e6db-600e-4dd6-b9a8-488f11d8f756 req-f1819e4a-9d9e-49e1-8ab7-489dae53ef5d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:07.684918 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-eb99e6db-600e-4dd6-b9a8-488f11d8f756 req-f1819e4a-9d9e-49e1-8ab7-489dae53ef5d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:07.715027 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-eb99e6db-600e-4dd6-b9a8-488f11d8f756 req-f1819e4a-9d9e-49e1-8ab7-489dae53ef5d service nova] Creating event network-vif-plugged:1268da76-b550-4f84-ab0c-afc461703feb for instance 77ed645e-669e-4167-ae78-8ce69770babf on n-h1-master-1 Aug 07 01:28:07.721724 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-eb99e6db-600e-4dd6-b9a8-488f11d8f756 req-f1819e4a-9d9e-49e1-8ab7-489dae53ef5d service nova] Creating event network-vif-plugged:4ef68384-661e-4ee2-9cb3-6b136e92c283 for instance 77ed645e-669e-4167-ae78-8ce69770babf on n-h1-master-1 Aug 07 01:28:07.722357 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-eb99e6db-600e-4dd6-b9a8-488f11d8f756 req-f1819e4a-9d9e-49e1-8ab7-489dae53ef5d service nova] Creating event network-vif-plugged:266d9506-a2b8-4b18-a0fc-163e3269dd34 for instance 77ed645e-669e-4167-ae78-8ce69770babf on n-h1-master-1 Aug 07 01:28:07.736150 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-eb99e6db-600e-4dd6-b9a8-488f11d8f756 req-f1819e4a-9d9e-49e1-8ab7-489dae53ef5d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.080789 Aug 07 01:28:07.737686 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1566/3466] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:28:07.751787 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-5307d8c3-8059-43df-988a-ee3214c2763c req-895390cb-1996-4565-95dc-8cdd5533314c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edea7d5b-2ad8-4b91-b389-8d3a6dd3f118", "tag": "eea9c425-f243-40e7-b3d0-3627b460e54c"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:07.768217 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-5307d8c3-8059-43df-988a-ee3214c2763c req-895390cb-1996-4565-95dc-8cdd5533314c service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:07.772857 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-5307d8c3-8059-43df-988a-ee3214c2763c req-895390cb-1996-4565-95dc-8cdd5533314c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:07.773311 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-5307d8c3-8059-43df-988a-ee3214c2763c req-895390cb-1996-4565-95dc-8cdd5533314c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:07.774915 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7218ff53-3719-42de-94bb-3e4e0cbb7743 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:07.786718 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7218ff53-3719-42de-94bb-3e4e0cbb7743 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118" status: 200 len: 1315 microversion: 2.1 time: 0.346717 Aug 07 01:28:07.787947 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1901/3467] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:07 2022] GET /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118 => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:07.793472 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9c710d48-ce4f-4128-97a4-acac16e198b1 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:07.794350 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9c710d48-ce4f-4128-97a4-acac16e198b1 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:07.798555 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-5307d8c3-8059-43df-988a-ee3214c2763c req-895390cb-1996-4565-95dc-8cdd5533314c service nova] Creating event network-changed:eea9c425-f243-40e7-b3d0-3627b460e54c for instance edea7d5b-2ad8-4b91-b389-8d3a6dd3f118 on n-h2-master-1 Aug 07 01:28:07.803597 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c710d48-ce4f-4128-97a4-acac16e198b1 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:07.804421 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c710d48-ce4f-4128-97a4-acac16e198b1 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:07.805025 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c710d48-ce4f-4128-97a4-acac16e198b1 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:07.806528 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c710d48-ce4f-4128-97a4-acac16e198b1 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:07.807353 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c710d48-ce4f-4128-97a4-acac16e198b1 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:07.811287 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c710d48-ce4f-4128-97a4-acac16e198b1 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:07.811864 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-5307d8c3-8059-43df-988a-ee3214c2763c req-895390cb-1996-4565-95dc-8cdd5533314c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069367 Aug 07 01:28:07.812533 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1567/3468] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:28:07.818321 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-592ab62d-0c2c-42da-822b-ec33b9ef4b56 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:07.819068 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-592ab62d-0c2c-42da-822b-ec33b9ef4b56 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:07.826061 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-592ab62d-0c2c-42da-822b-ec33b9ef4b56 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:07.826977 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-592ab62d-0c2c-42da-822b-ec33b9ef4b56 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:07.827602 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-592ab62d-0c2c-42da-822b-ec33b9ef4b56 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:07.828552 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-592ab62d-0c2c-42da-822b-ec33b9ef4b56 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:07.829191 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-592ab62d-0c2c-42da-822b-ec33b9ef4b56 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:07.829821 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-592ab62d-0c2c-42da-822b-ec33b9ef4b56 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:07.905377 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9c710d48-ce4f-4128-97a4-acac16e198b1 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:07.910009 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:07.917640 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9c710d48-ce4f-4128-97a4-acac16e198b1 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1217 microversion: 2.1 time: 0.128376 Aug 07 01:28:07.934030 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1902/3469] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:07 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1217 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:07.940734 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b036abdb-db1c-4605-a05c-f5f76b67c8b6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:07.941417 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b036abdb-db1c-4605-a05c-f5f76b67c8b6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: ce6c308a-7eb4-429f-ac41-9be9c4059355] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:07.949170 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b036abdb-db1c-4605-a05c-f5f76b67c8b6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:07.949582 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b036abdb-db1c-4605-a05c-f5f76b67c8b6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:07.950015 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b036abdb-db1c-4605-a05c-f5f76b67c8b6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:07.950782 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b036abdb-db1c-4605-a05c-f5f76b67c8b6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:07.951456 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b036abdb-db1c-4605-a05c-f5f76b67c8b6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:07.952094 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b036abdb-db1c-4605-a05c-f5f76b67c8b6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:08.130856 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b036abdb-db1c-4605-a05c-f5f76b67c8b6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:08.150217 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b036abdb-db1c-4605-a05c-f5f76b67c8b6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355" status: 200 len: 1307 microversion: 2.1 time: 0.214750 Aug 07 01:28:08.168122 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1903/3470] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:07 2022] GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355 => generated 1307 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:08.444957 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-359525b8-4140-4400-987a-e68721aac4f8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:08.445862 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-359525b8-4140-4400-987a-e68721aac4f8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 19784b1a-63aa-44b2-bbd5-d8dda713efdd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:08.457488 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-359525b8-4140-4400-987a-e68721aac4f8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:08.457971 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-359525b8-4140-4400-987a-e68721aac4f8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:08.460219 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-359525b8-4140-4400-987a-e68721aac4f8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:08.460957 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-359525b8-4140-4400-987a-e68721aac4f8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:08.461416 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-359525b8-4140-4400-987a-e68721aac4f8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:08.461856 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-359525b8-4140-4400-987a-e68721aac4f8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:08.533399 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-592ab62d-0c2c-42da-822b-ec33b9ef4b56 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:08.555810 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-592ab62d-0c2c-42da-822b-ec33b9ef4b56 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:08.563634 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-592ab62d-0c2c-42da-822b-ec33b9ef4b56 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:08.567170 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-592ab62d-0c2c-42da-822b-ec33b9ef4b56 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1869 microversion: 2.32 time: 0.751641 Aug 07 01:28:08.568192 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1568/3471] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:28:07 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1869 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:28:08.580626 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d10d3c77-bf44-4d79-9693-ce17fd925e9f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:08.585244 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d10d3c77-bf44-4d79-9693-ce17fd925e9f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:08.619095 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d10d3c77-bf44-4d79-9693-ce17fd925e9f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:08.631316 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d10d3c77-bf44-4d79-9693-ce17fd925e9f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:08.632640 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d10d3c77-bf44-4d79-9693-ce17fd925e9f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:08.636492 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d10d3c77-bf44-4d79-9693-ce17fd925e9f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:08.637916 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d10d3c77-bf44-4d79-9693-ce17fd925e9f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:08.640095 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d10d3c77-bf44-4d79-9693-ce17fd925e9f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:08.788741 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-359525b8-4140-4400-987a-e68721aac4f8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:08.797749 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-359525b8-4140-4400-987a-e68721aac4f8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd" status: 200 len: 1317 microversion: 2.1 time: 0.357400 Aug 07 01:28:08.798338 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1904/3472] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:08 2022] GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd => generated 1317 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:28:08.804737 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d4076d58-ebb3-4d37-a6e8-a8f04c2223f9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:08.805591 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d4076d58-ebb3-4d37-a6e8-a8f04c2223f9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6d4bf33c-473a-445e-8194-29cbf0b4f1ac] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:08.817073 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d4076d58-ebb3-4d37-a6e8-a8f04c2223f9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:08.817568 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d4076d58-ebb3-4d37-a6e8-a8f04c2223f9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:08.818011 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d4076d58-ebb3-4d37-a6e8-a8f04c2223f9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:08.818730 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d4076d58-ebb3-4d37-a6e8-a8f04c2223f9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:08.819387 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d4076d58-ebb3-4d37-a6e8-a8f04c2223f9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:08.820134 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d4076d58-ebb3-4d37-a6e8-a8f04c2223f9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:08.892895 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d4076d58-ebb3-4d37-a6e8-a8f04c2223f9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:08.910059 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d4076d58-ebb3-4d37-a6e8-a8f04c2223f9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac" status: 200 len: 1272 microversion: 2.1 time: 0.110419 Aug 07 01:28:08.910648 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1905/3473] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:08 2022] GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac => generated 1272 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:08.925573 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-72ecd00a-e538-41b1-a07f-0962ad811004 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:08.926447 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-72ecd00a-e538-41b1-a07f-0962ad811004 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: edea7d5b-2ad8-4b91-b389-8d3a6dd3f118] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:08.939347 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72ecd00a-e538-41b1-a07f-0962ad811004 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:08.939869 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72ecd00a-e538-41b1-a07f-0962ad811004 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:08.942413 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72ecd00a-e538-41b1-a07f-0962ad811004 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:08.943258 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72ecd00a-e538-41b1-a07f-0962ad811004 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:08.943738 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72ecd00a-e538-41b1-a07f-0962ad811004 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:08.950691 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72ecd00a-e538-41b1-a07f-0962ad811004 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:09.479342 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-72ecd00a-e538-41b1-a07f-0962ad811004 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:09.492094 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-72ecd00a-e538-41b1-a07f-0962ad811004 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118" status: 200 len: 1315 microversion: 2.1 time: 0.580116 Aug 07 01:28:09.509013 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1906/3474] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:08 2022] GET /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118 => generated 1315 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:09.530167 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7fea1272-46b0-41ab-89a3-878973ea537e tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:09.532912 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7fea1272-46b0-41ab-89a3-878973ea537e tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:09.553392 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7fea1272-46b0-41ab-89a3-878973ea537e tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:09.553889 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7fea1272-46b0-41ab-89a3-878973ea537e tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:09.556324 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7fea1272-46b0-41ab-89a3-878973ea537e tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:09.557267 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d10d3c77-bf44-4d79-9693-ce17fd925e9f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:09.559679 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7fea1272-46b0-41ab-89a3-878973ea537e tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:09.561040 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7fea1272-46b0-41ab-89a3-878973ea537e tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:09.562866 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7fea1272-46b0-41ab-89a3-878973ea537e tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:09.570553 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d10d3c77-bf44-4d79-9693-ce17fd925e9f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:09.578854 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d10d3c77-bf44-4d79-9693-ce17fd925e9f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:09.584528 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d10d3c77-bf44-4d79-9693-ce17fd925e9f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1874 microversion: 2.42 time: 1.013437 Aug 07 01:28:09.592476 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1569/3475] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:28:08 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1874 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:28:09.604080 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-538ec857-569c-4397-954d-7d30e1378c02 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:09.612261 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-538ec857-569c-4397-954d-7d30e1378c02 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: ce6c308a-7eb4-429f-ac41-9be9c4059355] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:09.626652 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-538ec857-569c-4397-954d-7d30e1378c02 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:09.627514 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-538ec857-569c-4397-954d-7d30e1378c02 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:09.628176 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-538ec857-569c-4397-954d-7d30e1378c02 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:09.629100 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-538ec857-569c-4397-954d-7d30e1378c02 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:09.629727 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-538ec857-569c-4397-954d-7d30e1378c02 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:09.630336 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-538ec857-569c-4397-954d-7d30e1378c02 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:09.682664 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7fea1272-46b0-41ab-89a3-878973ea537e tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:09.700801 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7fea1272-46b0-41ab-89a3-878973ea537e tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1271 microversion: 2.1 time: 0.189543 Aug 07 01:28:09.701926 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1907/3476] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:09 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1271 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:09.709372 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-be19c438-0ed9-4f1e-b66a-308dc47847c9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:09.715065 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-be19c438-0ed9-4f1e-b66a-308dc47847c9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:09.730664 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-be19c438-0ed9-4f1e-b66a-308dc47847c9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:09.731528 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-be19c438-0ed9-4f1e-b66a-308dc47847c9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:09.732337 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-be19c438-0ed9-4f1e-b66a-308dc47847c9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:09.733589 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-be19c438-0ed9-4f1e-b66a-308dc47847c9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:09.734318 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-be19c438-0ed9-4f1e-b66a-308dc47847c9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:09.735106 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-be19c438-0ed9-4f1e-b66a-308dc47847c9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:10.105105 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-be19c438-0ed9-4f1e-b66a-308dc47847c9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:10.116745 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-be19c438-0ed9-4f1e-b66a-308dc47847c9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:10.118718 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-be19c438-0ed9-4f1e-b66a-308dc47847c9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:10.120459 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-be19c438-0ed9-4f1e-b66a-308dc47847c9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1869 microversion: 2.32 time: 0.416646 Aug 07 01:28:10.121655 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1908/3477] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:28:09 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1869 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:28:10.126854 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-d8de8035-2b5d-423a-866e-29411ba61f9a req-a96c697d-6497-4607-9af9-4983901daa84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77ed645e-669e-4167-ae78-8ce69770babf", "name": "network-vif-plugged", "status": "completed", "tag": "b49b5afb-08c7-4f77-bad9-32ce23dd63c7"}, {"server_uuid": "799e740e-2304-4bdf-ad6e-ea4817a92b15", "name": "network-vif-plugged", "status": "completed", "tag": "d4a336ca-825e-45ea-b60b-7c5fc663a27f"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:10.146180 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d8de8035-2b5d-423a-866e-29411ba61f9a req-a96c697d-6497-4607-9af9-4983901daa84 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:10.147001 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d8de8035-2b5d-423a-866e-29411ba61f9a req-a96c697d-6497-4607-9af9-4983901daa84 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:10.148491 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d8de8035-2b5d-423a-866e-29411ba61f9a req-a96c697d-6497-4607-9af9-4983901daa84 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:10.181844 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-d8de8035-2b5d-423a-866e-29411ba61f9a req-a96c697d-6497-4607-9af9-4983901daa84 service nova] Creating event network-vif-plugged:b49b5afb-08c7-4f77-bad9-32ce23dd63c7 for instance 77ed645e-669e-4167-ae78-8ce69770babf on n-h1-master-1 Aug 07 01:28:10.182726 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-d8de8035-2b5d-423a-866e-29411ba61f9a req-a96c697d-6497-4607-9af9-4983901daa84 service nova] Creating event network-vif-plugged:d4a336ca-825e-45ea-b60b-7c5fc663a27f for instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 on n-h1-master-1 Aug 07 01:28:10.203164 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-d8de8035-2b5d-423a-866e-29411ba61f9a req-a96c697d-6497-4607-9af9-4983901daa84 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.076615 Aug 07 01:28:10.204441 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1909/3478] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:28:10.222132 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-906e67bf-f401-4bb2-a932-2e3edc18e4cb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:10.223188 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-906e67bf-f401-4bb2-a932-2e3edc18e4cb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 19784b1a-63aa-44b2-bbd5-d8dda713efdd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:10.235949 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-906e67bf-f401-4bb2-a932-2e3edc18e4cb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:10.235949 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-906e67bf-f401-4bb2-a932-2e3edc18e4cb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:10.236627 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-906e67bf-f401-4bb2-a932-2e3edc18e4cb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:10.237477 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-906e67bf-f401-4bb2-a932-2e3edc18e4cb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:10.238051 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-906e67bf-f401-4bb2-a932-2e3edc18e4cb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:10.238597 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-906e67bf-f401-4bb2-a932-2e3edc18e4cb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:10.487085 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-906e67bf-f401-4bb2-a932-2e3edc18e4cb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:10.499048 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-906e67bf-f401-4bb2-a932-2e3edc18e4cb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd" status: 200 len: 1317 microversion: 2.1 time: 0.289472 Aug 07 01:28:10.502982 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1910/3479] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:10 2022] GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:10.511723 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f098f058-d29b-47e2-a823-4ae9f0fd44cd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:10.514853 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f098f058-d29b-47e2-a823-4ae9f0fd44cd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6d4bf33c-473a-445e-8194-29cbf0b4f1ac] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:10.523280 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f098f058-d29b-47e2-a823-4ae9f0fd44cd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:10.524646 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f098f058-d29b-47e2-a823-4ae9f0fd44cd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:10.525617 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f098f058-d29b-47e2-a823-4ae9f0fd44cd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:10.527513 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f098f058-d29b-47e2-a823-4ae9f0fd44cd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:10.528508 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f098f058-d29b-47e2-a823-4ae9f0fd44cd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:10.530254 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f098f058-d29b-47e2-a823-4ae9f0fd44cd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:10.566682 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-538ec857-569c-4397-954d-7d30e1378c02 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:10.582635 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-538ec857-569c-4397-954d-7d30e1378c02 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355" status: 200 len: 1307 microversion: 2.1 time: 0.988860 Aug 07 01:28:10.587585 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1570/3480] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:09 2022] GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355 => generated 1307 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:10.596664 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fd28f08d-cbeb-48c7-9345-c92eee2dfbae tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:10.597691 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fd28f08d-cbeb-48c7-9345-c92eee2dfbae tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: edea7d5b-2ad8-4b91-b389-8d3a6dd3f118] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:10.610696 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd28f08d-cbeb-48c7-9345-c92eee2dfbae tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:10.611280 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd28f08d-cbeb-48c7-9345-c92eee2dfbae tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:10.612263 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd28f08d-cbeb-48c7-9345-c92eee2dfbae tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:10.613073 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd28f08d-cbeb-48c7-9345-c92eee2dfbae tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:10.613608 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd28f08d-cbeb-48c7-9345-c92eee2dfbae tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:10.614112 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd28f08d-cbeb-48c7-9345-c92eee2dfbae tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:10.847790 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f098f058-d29b-47e2-a823-4ae9f0fd44cd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:10.859068 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f098f058-d29b-47e2-a823-4ae9f0fd44cd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac" status: 200 len: 1314 microversion: 2.1 time: 0.354611 Aug 07 01:28:10.859967 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1911/3481] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:10 2022] GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:10.876189 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2f23b49a-e58a-4136-a767-904fcf4749c4 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:10.876818 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2f23b49a-e58a-4136-a767-904fcf4749c4 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:10.888073 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f23b49a-e58a-4136-a767-904fcf4749c4 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:10.889174 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f23b49a-e58a-4136-a767-904fcf4749c4 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:10.889527 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f23b49a-e58a-4136-a767-904fcf4749c4 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:10.893924 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f23b49a-e58a-4136-a767-904fcf4749c4 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:10.894389 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f23b49a-e58a-4136-a767-904fcf4749c4 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:10.894834 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f23b49a-e58a-4136-a767-904fcf4749c4 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:11.240716 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fd28f08d-cbeb-48c7-9345-c92eee2dfbae tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:11.252167 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fd28f08d-cbeb-48c7-9345-c92eee2dfbae tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118" status: 200 len: 1315 microversion: 2.1 time: 0.662966 Aug 07 01:28:11.266429 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1571/3482] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:10 2022] GET /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118 => generated 1315 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:11.279228 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1bce9aac-07a3-4730-9f17-f2ec54e76d32 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:11.280197 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1bce9aac-07a3-4730-9f17-f2ec54e76d32 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:11.287609 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1bce9aac-07a3-4730-9f17-f2ec54e76d32 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:11.288744 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1bce9aac-07a3-4730-9f17-f2ec54e76d32 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:11.290286 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1bce9aac-07a3-4730-9f17-f2ec54e76d32 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:11.291640 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1bce9aac-07a3-4730-9f17-f2ec54e76d32 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:11.292657 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1bce9aac-07a3-4730-9f17-f2ec54e76d32 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:11.293776 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1bce9aac-07a3-4730-9f17-f2ec54e76d32 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:11.407615 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1bce9aac-07a3-4730-9f17-f2ec54e76d32 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:11.422185 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1bce9aac-07a3-4730-9f17-f2ec54e76d32 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1271 microversion: 2.1 time: 0.147749 Aug 07 01:28:11.423372 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1572/3483] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:11 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1271 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:11.430589 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-16a0f847-b093-491d-90db-f6102a4c9c91 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:11.431451 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-16a0f847-b093-491d-90db-f6102a4c9c91 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:11.443380 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16a0f847-b093-491d-90db-f6102a4c9c91 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:11.444367 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16a0f847-b093-491d-90db-f6102a4c9c91 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:11.444972 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16a0f847-b093-491d-90db-f6102a4c9c91 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:11.446380 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16a0f847-b093-491d-90db-f6102a4c9c91 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:11.447099 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16a0f847-b093-491d-90db-f6102a4c9c91 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:11.447695 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16a0f847-b093-491d-90db-f6102a4c9c91 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:11.566219 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2f23b49a-e58a-4136-a767-904fcf4749c4 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:11.578767 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2f23b49a-e58a-4136-a767-904fcf4749c4 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:11.580723 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2f23b49a-e58a-4136-a767-904fcf4749c4 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:11.582193 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2f23b49a-e58a-4136-a767-904fcf4749c4 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1874 microversion: 2.42 time: 0.721274 Aug 07 01:28:11.582967 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1912/3484] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:28:10 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1874 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:28:11.598332 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-97490b55-cc25-4c43-8da4-e26147009806 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:11.599496 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-97490b55-cc25-4c43-8da4-e26147009806 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 19784b1a-63aa-44b2-bbd5-d8dda713efdd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:11.607698 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-97490b55-cc25-4c43-8da4-e26147009806 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:11.608741 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-97490b55-cc25-4c43-8da4-e26147009806 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:11.609554 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-97490b55-cc25-4c43-8da4-e26147009806 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:11.610619 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-97490b55-cc25-4c43-8da4-e26147009806 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:11.611296 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-97490b55-cc25-4c43-8da4-e26147009806 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:11.612257 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-97490b55-cc25-4c43-8da4-e26147009806 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:11.921375 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-97490b55-cc25-4c43-8da4-e26147009806 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:11.934968 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-97490b55-cc25-4c43-8da4-e26147009806 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd" status: 200 len: 1317 microversion: 2.1 time: 0.349696 Aug 07 01:28:11.937145 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1913/3485] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:11 2022] GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd => generated 1317 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:11.944172 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-189c4559-1824-4ac5-a9ff-0eb06b018be2 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:11.950530 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-189c4559-1824-4ac5-a9ff-0eb06b018be2 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: ce6c308a-7eb4-429f-ac41-9be9c4059355] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:11.965670 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-189c4559-1824-4ac5-a9ff-0eb06b018be2 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:11.968338 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-189c4559-1824-4ac5-a9ff-0eb06b018be2 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:11.972644 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-189c4559-1824-4ac5-a9ff-0eb06b018be2 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:11.973689 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-189c4559-1824-4ac5-a9ff-0eb06b018be2 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:11.975998 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-189c4559-1824-4ac5-a9ff-0eb06b018be2 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:11.978655 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-189c4559-1824-4ac5-a9ff-0eb06b018be2 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:12.117327 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-16a0f847-b093-491d-90db-f6102a4c9c91 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:12.125042 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:12.144465 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-16a0f847-b093-491d-90db-f6102a4c9c91 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:12.158981 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-16a0f847-b093-491d-90db-f6102a4c9c91 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:12.163118 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-16a0f847-b093-491d-90db-f6102a4c9c91 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1869 microversion: 2.32 time: 0.736832 Aug 07 01:28:12.164905 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1573/3486] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:28:11 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1869 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:28:12.176638 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-08d9e75b-0033-4ad6-acc1-436dd3c3c250 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:12.177637 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-08d9e75b-0033-4ad6-acc1-436dd3c3c250 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6d4bf33c-473a-445e-8194-29cbf0b4f1ac] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:12.187113 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-08d9e75b-0033-4ad6-acc1-436dd3c3c250 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:12.187970 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-08d9e75b-0033-4ad6-acc1-436dd3c3c250 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:12.188729 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-08d9e75b-0033-4ad6-acc1-436dd3c3c250 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:12.190126 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-08d9e75b-0033-4ad6-acc1-436dd3c3c250 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:12.193168 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-08d9e75b-0033-4ad6-acc1-436dd3c3c250 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:12.194606 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-08d9e75b-0033-4ad6-acc1-436dd3c3c250 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:12.263855 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-189c4559-1824-4ac5-a9ff-0eb06b018be2 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:12.276701 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-189c4559-1824-4ac5-a9ff-0eb06b018be2 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355" status: 200 len: 1307 microversion: 2.1 time: 0.337517 Aug 07 01:28:12.278668 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1914/3487] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:11 2022] GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355 => generated 1307 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:12.293009 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8a002553-f457-43a8-ba53-8860aea377bb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:12.294053 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8a002553-f457-43a8-ba53-8860aea377bb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: edea7d5b-2ad8-4b91-b389-8d3a6dd3f118] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:12.305104 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a002553-f457-43a8-ba53-8860aea377bb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:12.307081 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a002553-f457-43a8-ba53-8860aea377bb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:12.307821 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a002553-f457-43a8-ba53-8860aea377bb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:12.308934 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a002553-f457-43a8-ba53-8860aea377bb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:12.309672 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a002553-f457-43a8-ba53-8860aea377bb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:12.310995 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a002553-f457-43a8-ba53-8860aea377bb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:12.625720 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8a002553-f457-43a8-ba53-8860aea377bb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:12.642285 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8a002553-f457-43a8-ba53-8860aea377bb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118" status: 200 len: 1315 microversion: 2.1 time: 0.358623 Aug 07 01:28:12.643671 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1915/3488] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:12 2022] GET /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118 => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:12.653401 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0186510f-150e-4b85-9385-83e5fe147dc8 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:12.654500 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0186510f-150e-4b85-9385-83e5fe147dc8 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:12.670393 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0186510f-150e-4b85-9385-83e5fe147dc8 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:12.680690 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0186510f-150e-4b85-9385-83e5fe147dc8 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:12.681147 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0186510f-150e-4b85-9385-83e5fe147dc8 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:12.682112 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0186510f-150e-4b85-9385-83e5fe147dc8 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:12.682748 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0186510f-150e-4b85-9385-83e5fe147dc8 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:12.683368 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0186510f-150e-4b85-9385-83e5fe147dc8 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:12.683784 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-08d9e75b-0033-4ad6-acc1-436dd3c3c250 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:12.718201 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-08d9e75b-0033-4ad6-acc1-436dd3c3c250 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac" status: 200 len: 1314 microversion: 2.1 time: 0.549095 Aug 07 01:28:12.719790 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1574/3489] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:12 2022] GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac => generated 1314 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:12.727147 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-91176803-9ec2-4456-92d9-b28f7b80e7b0 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:12.728179 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-91176803-9ec2-4456-92d9-b28f7b80e7b0 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:12.750852 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-91176803-9ec2-4456-92d9-b28f7b80e7b0 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:12.751501 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-91176803-9ec2-4456-92d9-b28f7b80e7b0 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:12.752058 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-91176803-9ec2-4456-92d9-b28f7b80e7b0 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:12.754407 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-91176803-9ec2-4456-92d9-b28f7b80e7b0 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:12.754407 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-91176803-9ec2-4456-92d9-b28f7b80e7b0 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:12.754646 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-91176803-9ec2-4456-92d9-b28f7b80e7b0 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:12.964109 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0186510f-150e-4b85-9385-83e5fe147dc8 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:12.979864 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0186510f-150e-4b85-9385-83e5fe147dc8 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1313 microversion: 2.1 time: 0.333297 Aug 07 01:28:12.983064 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1916/3490] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:12 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:13.010882 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9af9243b-054f-42f1-872b-03a845a3992f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:13.012703 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9af9243b-054f-42f1-872b-03a845a3992f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 19784b1a-63aa-44b2-bbd5-d8dda713efdd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:13.028345 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9af9243b-054f-42f1-872b-03a845a3992f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:13.029856 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9af9243b-054f-42f1-872b-03a845a3992f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:13.032390 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9af9243b-054f-42f1-872b-03a845a3992f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:13.034406 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9af9243b-054f-42f1-872b-03a845a3992f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:13.036828 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9af9243b-054f-42f1-872b-03a845a3992f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:13.037558 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9af9243b-054f-42f1-872b-03a845a3992f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:13.184917 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-91176803-9ec2-4456-92d9-b28f7b80e7b0 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:13.195020 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-91176803-9ec2-4456-92d9-b28f7b80e7b0 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:13.196627 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-91176803-9ec2-4456-92d9-b28f7b80e7b0 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:13.197835 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-91176803-9ec2-4456-92d9-b28f7b80e7b0 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1874 microversion: 2.42 time: 0.476788 Aug 07 01:28:13.198986 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1575/3491] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:28:12 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1874 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:28:13.204349 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-b9820a19-5d07-4d8e-b202-259219de67a8 req-75d75f90-4105-485b-82cc-3958a31b7b5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edea7d5b-2ad8-4b91-b389-8d3a6dd3f118", "name": "network-vif-plugged", "status": "completed", "tag": "eea9c425-f243-40e7-b3d0-3627b460e54c"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:13.214476 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b9820a19-5d07-4d8e-b202-259219de67a8 req-75d75f90-4105-485b-82cc-3958a31b7b5f service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:13.215274 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b9820a19-5d07-4d8e-b202-259219de67a8 req-75d75f90-4105-485b-82cc-3958a31b7b5f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:13.215925 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b9820a19-5d07-4d8e-b202-259219de67a8 req-75d75f90-4105-485b-82cc-3958a31b7b5f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:13.230262 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-b9820a19-5d07-4d8e-b202-259219de67a8 req-75d75f90-4105-485b-82cc-3958a31b7b5f service nova] Creating event network-vif-plugged:eea9c425-f243-40e7-b3d0-3627b460e54c for instance edea7d5b-2ad8-4b91-b389-8d3a6dd3f118 on n-h2-master-1 Aug 07 01:28:13.236591 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-b9820a19-5d07-4d8e-b202-259219de67a8 req-75d75f90-4105-485b-82cc-3958a31b7b5f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035904 Aug 07 01:28:13.237872 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1576/3492] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:28:13.245603 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e5e512d0-241b-4891-b0a9-ce3f5087a247 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:13.246539 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e5e512d0-241b-4891-b0a9-ce3f5087a247 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:13.254406 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e5e512d0-241b-4891-b0a9-ce3f5087a247 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:13.255204 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e5e512d0-241b-4891-b0a9-ce3f5087a247 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:13.255810 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e5e512d0-241b-4891-b0a9-ce3f5087a247 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:13.256770 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e5e512d0-241b-4891-b0a9-ce3f5087a247 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:13.257395 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e5e512d0-241b-4891-b0a9-ce3f5087a247 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:13.257981 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e5e512d0-241b-4891-b0a9-ce3f5087a247 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:13.470893 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9af9243b-054f-42f1-872b-03a845a3992f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:13.480328 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9af9243b-054f-42f1-872b-03a845a3992f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd" status: 200 len: 1317 microversion: 2.1 time: 0.482250 Aug 07 01:28:13.481298 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1917/3493] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:12 2022] GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd => generated 1317 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:13.498501 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2f397914-c9b5-413c-ad42-8c8242aa4094 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:13.499163 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2f397914-c9b5-413c-ad42-8c8242aa4094 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: ce6c308a-7eb4-429f-ac41-9be9c4059355] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:13.506075 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f397914-c9b5-413c-ad42-8c8242aa4094 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:13.506570 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f397914-c9b5-413c-ad42-8c8242aa4094 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:13.507006 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f397914-c9b5-413c-ad42-8c8242aa4094 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:13.507718 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f397914-c9b5-413c-ad42-8c8242aa4094 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:13.508288 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f397914-c9b5-413c-ad42-8c8242aa4094 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:13.508729 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f397914-c9b5-413c-ad42-8c8242aa4094 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:13.767231 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2f397914-c9b5-413c-ad42-8c8242aa4094 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:13.799542 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2f397914-c9b5-413c-ad42-8c8242aa4094 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355" status: 200 len: 1307 microversion: 2.1 time: 0.316580 Aug 07 01:28:13.802462 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1918/3494] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:13 2022] GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355 => generated 1307 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:13.828862 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-83d30739-5683-4fba-af58-71a179de1bcd req-9cd1e535-17f9-4509-a25c-b1b9954b89a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d4bf33c-473a-445e-8194-29cbf0b4f1ac", "tag": "de308dbf-bd37-485b-bae4-307491eeaf18"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:13.847807 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-83d30739-5683-4fba-af58-71a179de1bcd req-9cd1e535-17f9-4509-a25c-b1b9954b89a9 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:13.849982 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-83d30739-5683-4fba-af58-71a179de1bcd req-9cd1e535-17f9-4509-a25c-b1b9954b89a9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:13.851323 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-83d30739-5683-4fba-af58-71a179de1bcd req-9cd1e535-17f9-4509-a25c-b1b9954b89a9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:13.870688 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-83d30739-5683-4fba-af58-71a179de1bcd req-9cd1e535-17f9-4509-a25c-b1b9954b89a9 service nova] Creating event network-changed:de308dbf-bd37-485b-bae4-307491eeaf18 for instance 6d4bf33c-473a-445e-8194-29cbf0b4f1ac on n-h1-master-1 Aug 07 01:28:13.882190 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-83d30739-5683-4fba-af58-71a179de1bcd req-9cd1e535-17f9-4509-a25c-b1b9954b89a9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075494 Aug 07 01:28:13.884301 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1919/3495] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:28:13.896355 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a7e09cf0-2f20-4688-ac3a-66ef8378e722 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:13.900674 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a7e09cf0-2f20-4688-ac3a-66ef8378e722 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: edea7d5b-2ad8-4b91-b389-8d3a6dd3f118] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:13.915867 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7e09cf0-2f20-4688-ac3a-66ef8378e722 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:13.917081 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7e09cf0-2f20-4688-ac3a-66ef8378e722 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:13.918198 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7e09cf0-2f20-4688-ac3a-66ef8378e722 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:13.920412 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7e09cf0-2f20-4688-ac3a-66ef8378e722 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:13.921421 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7e09cf0-2f20-4688-ac3a-66ef8378e722 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:13.922898 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7e09cf0-2f20-4688-ac3a-66ef8378e722 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:13.943563 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e5e512d0-241b-4891-b0a9-ce3f5087a247 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:13.963990 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e5e512d0-241b-4891-b0a9-ce3f5087a247 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:13.970913 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e5e512d0-241b-4891-b0a9-ce3f5087a247 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:13.976641 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e5e512d0-241b-4891-b0a9-ce3f5087a247 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 2822 microversion: 2.32 time: 0.736693 Aug 07 01:28:13.979046 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1577/3496] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:28:13 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 2822 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:28:13.991365 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-150e4c1b-12f4-4521-895c-8a31bac63de2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:13.992322 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-150e4c1b-12f4-4521-895c-8a31bac63de2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6d4bf33c-473a-445e-8194-29cbf0b4f1ac] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:14.009379 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:14.011185 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-150e4c1b-12f4-4521-895c-8a31bac63de2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:14.012723 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-150e4c1b-12f4-4521-895c-8a31bac63de2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:14.013639 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-150e4c1b-12f4-4521-895c-8a31bac63de2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:14.014566 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-150e4c1b-12f4-4521-895c-8a31bac63de2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:14.015343 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-150e4c1b-12f4-4521-895c-8a31bac63de2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:14.016203 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-150e4c1b-12f4-4521-895c-8a31bac63de2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:14.271214 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a7e09cf0-2f20-4688-ac3a-66ef8378e722 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:14.275410 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:14.286258 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a7e09cf0-2f20-4688-ac3a-66ef8378e722 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118" status: 200 len: 1315 microversion: 2.1 time: 0.398722 Aug 07 01:28:14.289023 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1920/3497] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:13 2022] GET /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118 => generated 1315 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:14.299315 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4ca571d7-488c-44a1-b1f4-773dc038e4b4 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:14.300576 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4ca571d7-488c-44a1-b1f4-773dc038e4b4 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:14.311862 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4ca571d7-488c-44a1-b1f4-773dc038e4b4 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:14.313410 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4ca571d7-488c-44a1-b1f4-773dc038e4b4 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:14.314309 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4ca571d7-488c-44a1-b1f4-773dc038e4b4 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:14.316545 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4ca571d7-488c-44a1-b1f4-773dc038e4b4 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:14.317233 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4ca571d7-488c-44a1-b1f4-773dc038e4b4 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:14.317868 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4ca571d7-488c-44a1-b1f4-773dc038e4b4 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:14.460153 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-150e4c1b-12f4-4521-895c-8a31bac63de2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:14.468469 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-150e4c1b-12f4-4521-895c-8a31bac63de2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac" status: 200 len: 1314 microversion: 2.1 time: 0.488099 Aug 07 01:28:14.469425 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1578/3498] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:13 2022] GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac => generated 1314 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:14.474621 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-de2c90ff-3763-4fcb-9011-2c65ceaf708e tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:14.480832 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-de2c90ff-3763-4fcb-9011-2c65ceaf708e tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:14.490156 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-de2c90ff-3763-4fcb-9011-2c65ceaf708e tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:14.491450 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-de2c90ff-3763-4fcb-9011-2c65ceaf708e tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:14.492582 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-de2c90ff-3763-4fcb-9011-2c65ceaf708e tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:14.494543 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-de2c90ff-3763-4fcb-9011-2c65ceaf708e tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:14.495317 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-de2c90ff-3763-4fcb-9011-2c65ceaf708e tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:14.495955 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-de2c90ff-3763-4fcb-9011-2c65ceaf708e tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:14.780338 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-de2c90ff-3763-4fcb-9011-2c65ceaf708e tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.309227 Aug 07 01:28:14.781194 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1579/3499] 10.222.0.39 () {60 vars in 1316 bytes} [Sun Aug 7 01:28:14 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf/os-interface => generated 1832 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:28:14.788762 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-743a2d8a-9161-4267-a95c-cd4934c999ae tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:14.789717 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-743a2d8a-9161-4267-a95c-cd4934c999ae tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:14.803627 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-743a2d8a-9161-4267-a95c-cd4934c999ae tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:14.805086 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-743a2d8a-9161-4267-a95c-cd4934c999ae tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:14.806119 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-743a2d8a-9161-4267-a95c-cd4934c999ae tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:14.807581 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-743a2d8a-9161-4267-a95c-cd4934c999ae tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:14.808682 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-743a2d8a-9161-4267-a95c-cd4934c999ae tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:14.809625 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-743a2d8a-9161-4267-a95c-cd4934c999ae tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:15.019343 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4ca571d7-488c-44a1-b1f4-773dc038e4b4 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:15.032347 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4ca571d7-488c-44a1-b1f4-773dc038e4b4 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1313 microversion: 2.1 time: 0.741649 Aug 07 01:28:15.046127 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1921/3500] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:14 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1313 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:15.052506 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1454c7a9-9cd0-480a-974e-445ce32adb4c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:15.056304 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1454c7a9-9cd0-480a-974e-445ce32adb4c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 19784b1a-63aa-44b2-bbd5-d8dda713efdd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:15.068851 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1454c7a9-9cd0-480a-974e-445ce32adb4c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:15.069391 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1454c7a9-9cd0-480a-974e-445ce32adb4c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:15.069781 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1454c7a9-9cd0-480a-974e-445ce32adb4c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:15.073427 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1454c7a9-9cd0-480a-974e-445ce32adb4c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:15.073911 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1454c7a9-9cd0-480a-974e-445ce32adb4c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:15.074357 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1454c7a9-9cd0-480a-974e-445ce32adb4c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:15.347275 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:15.387659 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=20 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:15.461026 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1454c7a9-9cd0-480a-974e-445ce32adb4c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:15.481773 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1454c7a9-9cd0-480a-974e-445ce32adb4c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd" status: 200 len: 1317 microversion: 2.1 time: 0.433774 Aug 07 01:28:15.491947 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1922/3501] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:15 2022] GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd => generated 1317 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:15.509640 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0801122a-b151-427d-9b8d-282939a2c9b9 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:15.510217 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0801122a-b151-427d-9b8d-282939a2c9b9 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: ce6c308a-7eb4-429f-ac41-9be9c4059355] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:15.517319 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0801122a-b151-427d-9b8d-282939a2c9b9 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:15.517816 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0801122a-b151-427d-9b8d-282939a2c9b9 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:15.518255 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0801122a-b151-427d-9b8d-282939a2c9b9 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:15.519009 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0801122a-b151-427d-9b8d-282939a2c9b9 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:15.519467 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0801122a-b151-427d-9b8d-282939a2c9b9 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:15.520018 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0801122a-b151-427d-9b8d-282939a2c9b9 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:15.587507 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-743a2d8a-9161-4267-a95c-cd4934c999ae tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:15.620994 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-743a2d8a-9161-4267-a95c-cd4934c999ae tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:15.624786 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-743a2d8a-9161-4267-a95c-cd4934c999ae tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:15.627465 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-743a2d8a-9161-4267-a95c-cd4934c999ae tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1874 microversion: 2.42 time: 0.844622 Aug 07 01:28:15.629271 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1580/3502] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:28:14 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1874 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:28:15.637384 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-a42781f0-e9f6-4f3c-9d33-2018b64bb3f3 req-c5a1e15b-9856-45a2-9e92-044f3c54e920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "799e740e-2304-4bdf-ad6e-ea4817a92b15", "name": "network-vif-plugged", "status": "completed", "tag": "d11b2113-f2e1-4422-8f6b-9bf9b38eea92"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:15.662712 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a42781f0-e9f6-4f3c-9d33-2018b64bb3f3 req-c5a1e15b-9856-45a2-9e92-044f3c54e920 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:15.664677 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a42781f0-e9f6-4f3c-9d33-2018b64bb3f3 req-c5a1e15b-9856-45a2-9e92-044f3c54e920 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:15.665771 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a42781f0-e9f6-4f3c-9d33-2018b64bb3f3 req-c5a1e15b-9856-45a2-9e92-044f3c54e920 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:15.683394 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-a42781f0-e9f6-4f3c-9d33-2018b64bb3f3 req-c5a1e15b-9856-45a2-9e92-044f3c54e920 service nova] Creating event network-vif-plugged:d11b2113-f2e1-4422-8f6b-9bf9b38eea92 for instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 on n-h1-master-1 Aug 07 01:28:15.692208 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-a42781f0-e9f6-4f3c-9d33-2018b64bb3f3 req-c5a1e15b-9856-45a2-9e92-044f3c54e920 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060792 Aug 07 01:28:15.693096 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1581/3503] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:28:15.803531 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c6cb16aa-44d8-4c3c-8652-5c6f711da4c7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:15.806609 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c6cb16aa-44d8-4c3c-8652-5c6f711da4c7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: edea7d5b-2ad8-4b91-b389-8d3a6dd3f118] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:15.824469 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6cb16aa-44d8-4c3c-8652-5c6f711da4c7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:15.826359 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6cb16aa-44d8-4c3c-8652-5c6f711da4c7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:15.827248 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6cb16aa-44d8-4c3c-8652-5c6f711da4c7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:15.829081 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6cb16aa-44d8-4c3c-8652-5c6f711da4c7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:15.830211 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6cb16aa-44d8-4c3c-8652-5c6f711da4c7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:15.831243 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6cb16aa-44d8-4c3c-8652-5c6f711da4c7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:16.061702 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0801122a-b151-427d-9b8d-282939a2c9b9 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:16.079218 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0801122a-b151-427d-9b8d-282939a2c9b9 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355" status: 200 len: 1307 microversion: 2.1 time: 0.582948 Aug 07 01:28:16.081533 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1923/3504] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:15 2022] GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355 => generated 1307 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:16.106312 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f1937a11-ade5-4387-bd0b-3587e1bbbdeb tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:16.107159 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f1937a11-ade5-4387-bd0b-3587e1bbbdeb tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6d4bf33c-473a-445e-8194-29cbf0b4f1ac] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:16.133793 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f1937a11-ade5-4387-bd0b-3587e1bbbdeb tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:16.137256 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f1937a11-ade5-4387-bd0b-3587e1bbbdeb tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:16.139448 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f1937a11-ade5-4387-bd0b-3587e1bbbdeb tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:16.141051 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f1937a11-ade5-4387-bd0b-3587e1bbbdeb tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:16.141533 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f1937a11-ade5-4387-bd0b-3587e1bbbdeb tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:16.141976 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f1937a11-ade5-4387-bd0b-3587e1bbbdeb tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:16.363921 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f1937a11-ade5-4387-bd0b-3587e1bbbdeb tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:16.371975 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f1937a11-ade5-4387-bd0b-3587e1bbbdeb tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac" status: 200 len: 1314 microversion: 2.1 time: 0.289091 Aug 07 01:28:16.373443 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1924/3505] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:16 2022] GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:16.378314 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-91bf12e0-5ba7-4c44-9161-9bae4e9154bd req-5885fafc-4462-41fd-8a0d-6458531a8fab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92e64da4-c05c-4bdc-a42c-7fbb858c846a", "tag": "738890f4-f9c5-48ca-8d3f-3d153d3b482d"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:16.389209 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-91bf12e0-5ba7-4c44-9161-9bae4e9154bd req-5885fafc-4462-41fd-8a0d-6458531a8fab service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:16.389731 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-91bf12e0-5ba7-4c44-9161-9bae4e9154bd req-5885fafc-4462-41fd-8a0d-6458531a8fab service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:16.390157 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-91bf12e0-5ba7-4c44-9161-9bae4e9154bd req-5885fafc-4462-41fd-8a0d-6458531a8fab service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:16.402164 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-91bf12e0-5ba7-4c44-9161-9bae4e9154bd req-5885fafc-4462-41fd-8a0d-6458531a8fab service nova] Creating event network-changed:738890f4-f9c5-48ca-8d3f-3d153d3b482d for instance 92e64da4-c05c-4bdc-a42c-7fbb858c846a on n-h1-master-1 Aug 07 01:28:16.406899 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-91bf12e0-5ba7-4c44-9161-9bae4e9154bd req-5885fafc-4462-41fd-8a0d-6458531a8fab service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031952 Aug 07 01:28:16.407525 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1925/3506] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:28:16.412571 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0364b024-1655-4f08-bcb4-e0e8619a7cb0 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:16.413266 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0364b024-1655-4f08-bcb4-e0e8619a7cb0 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:16.420193 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0364b024-1655-4f08-bcb4-e0e8619a7cb0 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:16.420922 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0364b024-1655-4f08-bcb4-e0e8619a7cb0 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:16.421652 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0364b024-1655-4f08-bcb4-e0e8619a7cb0 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:16.422526 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0364b024-1655-4f08-bcb4-e0e8619a7cb0 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:16.423147 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0364b024-1655-4f08-bcb4-e0e8619a7cb0 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:16.423576 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0364b024-1655-4f08-bcb4-e0e8619a7cb0 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:16.573526 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0364b024-1655-4f08-bcb4-e0e8619a7cb0 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:16.581357 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0364b024-1655-4f08-bcb4-e0e8619a7cb0 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1313 microversion: 2.1 time: 0.172593 Aug 07 01:28:16.594497 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1926/3507] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:16 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:16.599659 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-be013f04-a724-4828-a13d-5928a1feded2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:16.600428 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-be013f04-a724-4828-a13d-5928a1feded2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 19784b1a-63aa-44b2-bbd5-d8dda713efdd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:16.606525 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-be013f04-a724-4828-a13d-5928a1feded2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:16.607544 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-be013f04-a724-4828-a13d-5928a1feded2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:16.607979 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-be013f04-a724-4828-a13d-5928a1feded2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:16.608697 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-be013f04-a724-4828-a13d-5928a1feded2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:16.609150 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-be013f04-a724-4828-a13d-5928a1feded2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:16.609579 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-be013f04-a724-4828-a13d-5928a1feded2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:16.730250 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=4 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:16.752426 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-be013f04-a724-4828-a13d-5928a1feded2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:16.754666 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c6cb16aa-44d8-4c3c-8652-5c6f711da4c7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:16.756501 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=14 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:16.762297 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-be013f04-a724-4828-a13d-5928a1feded2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd" status: 200 len: 1317 microversion: 2.1 time: 0.166624 Aug 07 01:28:16.762985 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1927/3508] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:16 2022] GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:16.763781 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c6cb16aa-44d8-4c3c-8652-5c6f711da4c7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118" status: 200 len: 1502 microversion: 2.1 time: 1.069150 Aug 07 01:28:16.764623 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1582/3509] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:15 2022] GET /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118 => generated 1502 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:16.768231 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3a73f2ba-28fa-4866-8533-4c56fe0a61fd tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:16.769126 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3a73f2ba-28fa-4866-8533-4c56fe0a61fd tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:16.776047 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a73f2ba-28fa-4866-8533-4c56fe0a61fd tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:16.776816 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a73f2ba-28fa-4866-8533-4c56fe0a61fd tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:16.777320 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a73f2ba-28fa-4866-8533-4c56fe0a61fd tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:16.778088 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a73f2ba-28fa-4866-8533-4c56fe0a61fd tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:16.778607 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a73f2ba-28fa-4866-8533-4c56fe0a61fd tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:16.779100 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a73f2ba-28fa-4866-8533-4c56fe0a61fd tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:16.789361 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8749c18d-0ca2-4317-b986-e1e134d1e772 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:16.791781 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8749c18d-0ca2-4317-b986-e1e134d1e772 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: edea7d5b-2ad8-4b91-b389-8d3a6dd3f118] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:16.798621 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8749c18d-0ca2-4317-b986-e1e134d1e772 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:16.799410 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8749c18d-0ca2-4317-b986-e1e134d1e772 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:16.799858 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8749c18d-0ca2-4317-b986-e1e134d1e772 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:16.800613 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8749c18d-0ca2-4317-b986-e1e134d1e772 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:16.801263 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8749c18d-0ca2-4317-b986-e1e134d1e772 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:16.801712 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8749c18d-0ca2-4317-b986-e1e134d1e772 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:16.871489 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8749c18d-0ca2-4317-b986-e1e134d1e772 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118/action" status: 200 len: 14 microversion: 2.1 time: 0.084681 Aug 07 01:28:16.874458 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1583/3510] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:28:16 2022] POST /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:28:16.990643 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3a73f2ba-28fa-4866-8533-4c56fe0a61fd tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:17.001811 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3a73f2ba-28fa-4866-8533-4c56fe0a61fd tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:17.003733 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3a73f2ba-28fa-4866-8533-4c56fe0a61fd tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:17.005638 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3a73f2ba-28fa-4866-8533-4c56fe0a61fd tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1874 microversion: 2.42 time: 0.240846 Aug 07 01:28:17.022357 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1928/3511] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:28:16 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1874 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:28:17.103519 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-880be438-6950-4c9c-b195-0cafaeff712c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:17.104323 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-880be438-6950-4c9c-b195-0cafaeff712c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: ce6c308a-7eb4-429f-ac41-9be9c4059355] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:17.112491 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-880be438-6950-4c9c-b195-0cafaeff712c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:17.113088 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-880be438-6950-4c9c-b195-0cafaeff712c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:17.113797 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-880be438-6950-4c9c-b195-0cafaeff712c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:17.114492 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-880be438-6950-4c9c-b195-0cafaeff712c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:17.114981 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-880be438-6950-4c9c-b195-0cafaeff712c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:17.115417 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-880be438-6950-4c9c-b195-0cafaeff712c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:17.396014 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e560ce17-58c5-4ff0-9ca9-658c5ad94db6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:17.396895 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e560ce17-58c5-4ff0-9ca9-658c5ad94db6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6d4bf33c-473a-445e-8194-29cbf0b4f1ac] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:17.403524 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e560ce17-58c5-4ff0-9ca9-658c5ad94db6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:17.404737 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e560ce17-58c5-4ff0-9ca9-658c5ad94db6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:17.405105 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e560ce17-58c5-4ff0-9ca9-658c5ad94db6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:17.405819 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e560ce17-58c5-4ff0-9ca9-658c5ad94db6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:17.406298 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e560ce17-58c5-4ff0-9ca9-658c5ad94db6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:17.406707 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e560ce17-58c5-4ff0-9ca9-658c5ad94db6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:17.564693 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e560ce17-58c5-4ff0-9ca9-658c5ad94db6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:17.572906 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e560ce17-58c5-4ff0-9ca9-658c5ad94db6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac" status: 200 len: 1314 microversion: 2.1 time: 0.180789 Aug 07 01:28:17.573510 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1929/3512] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:17 2022] GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:28:17.602546 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b5b932f4-0c7c-49e6-b8eb-f2d37490eddd tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:17.603119 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b5b932f4-0c7c-49e6-b8eb-f2d37490eddd tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:17.610384 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b5b932f4-0c7c-49e6-b8eb-f2d37490eddd tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:17.610984 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b5b932f4-0c7c-49e6-b8eb-f2d37490eddd tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:17.611323 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b5b932f4-0c7c-49e6-b8eb-f2d37490eddd tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:17.612069 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b5b932f4-0c7c-49e6-b8eb-f2d37490eddd tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:17.612559 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b5b932f4-0c7c-49e6-b8eb-f2d37490eddd tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:17.612990 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b5b932f4-0c7c-49e6-b8eb-f2d37490eddd tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:17.752057 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b5b932f4-0c7c-49e6-b8eb-f2d37490eddd tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:17.761922 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b5b932f4-0c7c-49e6-b8eb-f2d37490eddd tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1313 microversion: 2.1 time: 0.163563 Aug 07 01:28:17.762521 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1930/3513] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:17 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:28:17.783551 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ce456ebb-9619-4088-b737-beef0cd9c9b8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:17.784288 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ce456ebb-9619-4088-b737-beef0cd9c9b8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 19784b1a-63aa-44b2-bbd5-d8dda713efdd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:17.794072 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce456ebb-9619-4088-b737-beef0cd9c9b8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:17.794697 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce456ebb-9619-4088-b737-beef0cd9c9b8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:17.795227 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce456ebb-9619-4088-b737-beef0cd9c9b8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:17.796092 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce456ebb-9619-4088-b737-beef0cd9c9b8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:17.796657 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce456ebb-9619-4088-b737-beef0cd9c9b8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:17.797151 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce456ebb-9619-4088-b737-beef0cd9c9b8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:17.880369 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-880be438-6950-4c9c-b195-0cafaeff712c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:17.890758 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-880be438-6950-4c9c-b195-0cafaeff712c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355" status: 200 len: 1307 microversion: 2.1 time: 0.792021 Aug 07 01:28:17.891754 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1584/3514] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:17 2022] GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355 => generated 1307 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:17.897289 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-988526e2-2948-4763-875b-ad4bab18fa90 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:17.899763 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-988526e2-2948-4763-875b-ad4bab18fa90 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: edea7d5b-2ad8-4b91-b389-8d3a6dd3f118] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:17.908075 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-988526e2-2948-4763-875b-ad4bab18fa90 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:17.908844 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-988526e2-2948-4763-875b-ad4bab18fa90 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:17.909494 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-988526e2-2948-4763-875b-ad4bab18fa90 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:17.910692 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-988526e2-2948-4763-875b-ad4bab18fa90 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:17.911177 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-988526e2-2948-4763-875b-ad4bab18fa90 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:17.911606 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-988526e2-2948-4763-875b-ad4bab18fa90 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:17.971330 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ce456ebb-9619-4088-b737-beef0cd9c9b8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:17.980002 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ce456ebb-9619-4088-b737-beef0cd9c9b8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd" status: 200 len: 1317 microversion: 2.1 time: 0.200138 Aug 07 01:28:17.986237 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1931/3515] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:17 2022] GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd => generated 1317 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:28:17.986468 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-988526e2-2948-4763-875b-ad4bab18fa90 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118/action" status: 200 len: 14 microversion: 2.1 time: 0.091224 Aug 07 01:28:17.986468 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1585/3516] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:28:17 2022] POST /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:28:18.029529 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f9c54c13-e29c-4d6d-a0c8-c67b2a3c004b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:18.030145 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f9c54c13-e29c-4d6d-a0c8-c67b2a3c004b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:18.036109 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f9c54c13-e29c-4d6d-a0c8-c67b2a3c004b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:18.036589 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f9c54c13-e29c-4d6d-a0c8-c67b2a3c004b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:18.037026 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f9c54c13-e29c-4d6d-a0c8-c67b2a3c004b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:18.037727 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f9c54c13-e29c-4d6d-a0c8-c67b2a3c004b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:18.038376 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f9c54c13-e29c-4d6d-a0c8-c67b2a3c004b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:18.038888 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f9c54c13-e29c-4d6d-a0c8-c67b2a3c004b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:18.266334 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f9c54c13-e29c-4d6d-a0c8-c67b2a3c004b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:18.276573 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f9c54c13-e29c-4d6d-a0c8-c67b2a3c004b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:18.278106 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f9c54c13-e29c-4d6d-a0c8-c67b2a3c004b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:18.279339 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f9c54c13-e29c-4d6d-a0c8-c67b2a3c004b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1874 microversion: 2.42 time: 0.253740 Aug 07 01:28:18.279924 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1932/3517] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:28:18 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1874 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:28:18.500762 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-30281f77-eed3-49a6-8410-6bc96f10a4cb req-0ab1e48e-55ad-4e69-a57c-ae6cf7cc3db5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77ed645e-669e-4167-ae78-8ce69770babf", "tag": "20e0f822-dbb7-40fe-862e-071c9953a3bf"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:18.513262 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-30281f77-eed3-49a6-8410-6bc96f10a4cb req-0ab1e48e-55ad-4e69-a57c-ae6cf7cc3db5 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:18.514107 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-30281f77-eed3-49a6-8410-6bc96f10a4cb req-0ab1e48e-55ad-4e69-a57c-ae6cf7cc3db5 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:18.515391 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-30281f77-eed3-49a6-8410-6bc96f10a4cb req-0ab1e48e-55ad-4e69-a57c-ae6cf7cc3db5 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:18.529214 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-30281f77-eed3-49a6-8410-6bc96f10a4cb req-0ab1e48e-55ad-4e69-a57c-ae6cf7cc3db5 service nova] Creating event network-changed:20e0f822-dbb7-40fe-862e-071c9953a3bf for instance 77ed645e-669e-4167-ae78-8ce69770babf on n-h1-master-1 Aug 07 01:28:18.537024 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-30281f77-eed3-49a6-8410-6bc96f10a4cb req-0ab1e48e-55ad-4e69-a57c-ae6cf7cc3db5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040588 Aug 07 01:28:18.537630 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1586/3518] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:28:18.609052 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-25a94b79-2bf5-4446-b779-25335ad46e19 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:18.612982 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-25a94b79-2bf5-4446-b779-25335ad46e19 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6d4bf33c-473a-445e-8194-29cbf0b4f1ac] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:18.622425 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-25a94b79-2bf5-4446-b779-25335ad46e19 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:18.623381 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-25a94b79-2bf5-4446-b779-25335ad46e19 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:18.624014 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-25a94b79-2bf5-4446-b779-25335ad46e19 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:18.624935 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-25a94b79-2bf5-4446-b779-25335ad46e19 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:18.625390 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-25a94b79-2bf5-4446-b779-25335ad46e19 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:18.625815 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-25a94b79-2bf5-4446-b779-25335ad46e19 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:18.787659 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7721723e-7237-4af8-b9ba-ec691d3a72e2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:18.788766 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7721723e-7237-4af8-b9ba-ec691d3a72e2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:18.807016 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7721723e-7237-4af8-b9ba-ec691d3a72e2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:18.807728 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7721723e-7237-4af8-b9ba-ec691d3a72e2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:18.808298 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7721723e-7237-4af8-b9ba-ec691d3a72e2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:18.810925 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7721723e-7237-4af8-b9ba-ec691d3a72e2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:18.812532 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7721723e-7237-4af8-b9ba-ec691d3a72e2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:18.814877 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7721723e-7237-4af8-b9ba-ec691d3a72e2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:18.878195 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-25a94b79-2bf5-4446-b779-25335ad46e19 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:18.886830 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-25a94b79-2bf5-4446-b779-25335ad46e19 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac" status: 200 len: 1314 microversion: 2.1 time: 0.295544 Aug 07 01:28:18.890400 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1933/3519] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:18 2022] GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:18.915126 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-91b31303-0ece-413f-b4b3-c97451a71419 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:18.916258 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-91b31303-0ece-413f-b4b3-c97451a71419 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: ce6c308a-7eb4-429f-ac41-9be9c4059355] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:18.925833 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91b31303-0ece-413f-b4b3-c97451a71419 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:18.926595 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91b31303-0ece-413f-b4b3-c97451a71419 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:18.927215 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91b31303-0ece-413f-b4b3-c97451a71419 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:18.928361 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91b31303-0ece-413f-b4b3-c97451a71419 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:18.929018 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91b31303-0ece-413f-b4b3-c97451a71419 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:18.929628 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91b31303-0ece-413f-b4b3-c97451a71419 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:19.043637 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7721723e-7237-4af8-b9ba-ec691d3a72e2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:19.058968 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7721723e-7237-4af8-b9ba-ec691d3a72e2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1313 microversion: 2.1 time: 0.276580 Aug 07 01:28:19.060183 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1587/3520] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:18 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:19.067339 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f79ee220-4017-4686-a377-50322d2074ef tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:19.070754 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f79ee220-4017-4686-a377-50322d2074ef tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: edea7d5b-2ad8-4b91-b389-8d3a6dd3f118] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:19.080544 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f79ee220-4017-4686-a377-50322d2074ef tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:19.081631 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f79ee220-4017-4686-a377-50322d2074ef tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:19.082313 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f79ee220-4017-4686-a377-50322d2074ef tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:19.083074 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f79ee220-4017-4686-a377-50322d2074ef tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:19.083820 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f79ee220-4017-4686-a377-50322d2074ef tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:19.084603 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f79ee220-4017-4686-a377-50322d2074ef tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:19.161000 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f79ee220-4017-4686-a377-50322d2074ef tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118/action" status: 200 len: 14 microversion: 2.1 time: 0.098811 Aug 07 01:28:19.165098 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1588/3521] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:28:19 2022] POST /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:28:19.169357 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-211bc50d-4010-48a9-b13c-83e62a34e806 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:19.170224 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-211bc50d-4010-48a9-b13c-83e62a34e806 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 19784b1a-63aa-44b2-bbd5-d8dda713efdd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:19.180399 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-211bc50d-4010-48a9-b13c-83e62a34e806 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:19.181308 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-211bc50d-4010-48a9-b13c-83e62a34e806 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:19.182024 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-211bc50d-4010-48a9-b13c-83e62a34e806 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:19.183298 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-211bc50d-4010-48a9-b13c-83e62a34e806 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:19.184058 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-211bc50d-4010-48a9-b13c-83e62a34e806 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:19.184757 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-211bc50d-4010-48a9-b13c-83e62a34e806 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:19.265096 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-91b31303-0ece-413f-b4b3-c97451a71419 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:19.273452 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-91b31303-0ece-413f-b4b3-c97451a71419 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355" status: 200 len: 1307 microversion: 2.1 time: 0.363951 Aug 07 01:28:19.274699 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1934/3522] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:18 2022] GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355 => generated 1307 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:19.306836 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4d52993c-8229-4d41-92fd-67f898657afd tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:19.307454 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4d52993c-8229-4d41-92fd-67f898657afd tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:19.316007 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d52993c-8229-4d41-92fd-67f898657afd tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:19.316765 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d52993c-8229-4d41-92fd-67f898657afd tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:19.317365 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d52993c-8229-4d41-92fd-67f898657afd tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:19.318373 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d52993c-8229-4d41-92fd-67f898657afd tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:19.318832 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d52993c-8229-4d41-92fd-67f898657afd tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:19.319443 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d52993c-8229-4d41-92fd-67f898657afd tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:19.585260 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-211bc50d-4010-48a9-b13c-83e62a34e806 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:19.594358 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-211bc50d-4010-48a9-b13c-83e62a34e806 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd" status: 200 len: 1317 microversion: 2.1 time: 0.431035 Aug 07 01:28:19.608654 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1589/3523] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:19 2022] GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd => generated 1317 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:19.715126 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4d52993c-8229-4d41-92fd-67f898657afd tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:19.734609 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4d52993c-8229-4d41-92fd-67f898657afd tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:19.737234 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4d52993c-8229-4d41-92fd-67f898657afd tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:19.738675 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4d52993c-8229-4d41-92fd-67f898657afd tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1874 microversion: 2.42 time: 0.435905 Aug 07 01:28:19.739735 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1935/3524] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:28:19 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1874 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:28:19.911311 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-98a4e569-fe9a-4ad5-98a6-3de0b38e6ade tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:19.912290 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-98a4e569-fe9a-4ad5-98a6-3de0b38e6ade tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6d4bf33c-473a-445e-8194-29cbf0b4f1ac] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:19.920307 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-98a4e569-fe9a-4ad5-98a6-3de0b38e6ade tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:19.921093 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-98a4e569-fe9a-4ad5-98a6-3de0b38e6ade tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:19.921707 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-98a4e569-fe9a-4ad5-98a6-3de0b38e6ade tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:19.922596 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-98a4e569-fe9a-4ad5-98a6-3de0b38e6ade tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:19.923210 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-98a4e569-fe9a-4ad5-98a6-3de0b38e6ade tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:19.923813 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-98a4e569-fe9a-4ad5-98a6-3de0b38e6ade tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:20.083352 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b8301706-c4ff-4613-8477-282056ed5ceb tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:20.084042 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b8301706-c4ff-4613-8477-282056ed5ceb tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:20.092127 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b8301706-c4ff-4613-8477-282056ed5ceb tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:20.092941 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b8301706-c4ff-4613-8477-282056ed5ceb tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:20.093553 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b8301706-c4ff-4613-8477-282056ed5ceb tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:20.094473 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b8301706-c4ff-4613-8477-282056ed5ceb tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:20.095119 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b8301706-c4ff-4613-8477-282056ed5ceb tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:20.095740 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b8301706-c4ff-4613-8477-282056ed5ceb tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:20.351615 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-98a4e569-fe9a-4ad5-98a6-3de0b38e6ade tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:20.383382 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-98a4e569-fe9a-4ad5-98a6-3de0b38e6ade tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac" status: 200 len: 1314 microversion: 2.1 time: 0.474570 Aug 07 01:28:20.386312 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1590/3525] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:19 2022] GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:20.403005 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-36711bdc-4a57-4953-af37-38fa07bbcfb2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:20.407831 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-36711bdc-4a57-4953-af37-38fa07bbcfb2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: edea7d5b-2ad8-4b91-b389-8d3a6dd3f118] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:20.430471 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36711bdc-4a57-4953-af37-38fa07bbcfb2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:20.431256 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36711bdc-4a57-4953-af37-38fa07bbcfb2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:20.431815 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36711bdc-4a57-4953-af37-38fa07bbcfb2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:20.432770 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36711bdc-4a57-4953-af37-38fa07bbcfb2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:20.434567 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36711bdc-4a57-4953-af37-38fa07bbcfb2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:20.435615 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36711bdc-4a57-4953-af37-38fa07bbcfb2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:20.514279 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-36711bdc-4a57-4953-af37-38fa07bbcfb2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118/action" status: 200 len: 14 microversion: 2.1 time: 0.123130 Aug 07 01:28:20.515529 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1591/3526] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:28:20 2022] POST /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:28:20.524199 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5bea1f4b-b519-4929-a772-443c82028f38 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:20.525226 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5bea1f4b-b519-4929-a772-443c82028f38 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: ce6c308a-7eb4-429f-ac41-9be9c4059355] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:20.534241 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b8301706-c4ff-4613-8477-282056ed5ceb tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:20.536337 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5bea1f4b-b519-4929-a772-443c82028f38 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:20.537060 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5bea1f4b-b519-4929-a772-443c82028f38 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:20.537668 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5bea1f4b-b519-4929-a772-443c82028f38 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:20.538606 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5bea1f4b-b519-4929-a772-443c82028f38 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:20.539842 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5bea1f4b-b519-4929-a772-443c82028f38 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:20.540367 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5bea1f4b-b519-4929-a772-443c82028f38 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:20.547128 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b8301706-c4ff-4613-8477-282056ed5ceb tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1313 microversion: 2.1 time: 0.463685 Aug 07 01:28:20.548278 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1936/3527] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:20 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1313 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:20.585643 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-761798d0-de38-4eda-be6a-fdc24026fe11 req-50572c6e-ca5c-4c4b-a01a-f35d19820f7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "799e740e-2304-4bdf-ad6e-ea4817a92b15", "name": "network-vif-plugged", "status": "completed", "tag": "ed270649-5cff-4279-a1a6-2363fa515342"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:20.601810 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-761798d0-de38-4eda-be6a-fdc24026fe11 req-50572c6e-ca5c-4c4b-a01a-f35d19820f7b service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:20.612012 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-761798d0-de38-4eda-be6a-fdc24026fe11 req-50572c6e-ca5c-4c4b-a01a-f35d19820f7b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:20.612321 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-761798d0-de38-4eda-be6a-fdc24026fe11 req-50572c6e-ca5c-4c4b-a01a-f35d19820f7b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:20.638225 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-761798d0-de38-4eda-be6a-fdc24026fe11 req-50572c6e-ca5c-4c4b-a01a-f35d19820f7b service nova] Creating event network-vif-plugged:ed270649-5cff-4279-a1a6-2363fa515342 for instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 on n-h1-master-1 Aug 07 01:28:20.657755 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-761798d0-de38-4eda-be6a-fdc24026fe11 req-50572c6e-ca5c-4c4b-a01a-f35d19820f7b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066803 Aug 07 01:28:20.659844 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1937/3528] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:28:20.669122 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-66f32e60-7236-41e8-a941-27dbc02336b0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:20.670974 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-66f32e60-7236-41e8-a941-27dbc02336b0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 19784b1a-63aa-44b2-bbd5-d8dda713efdd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:20.683424 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-66f32e60-7236-41e8-a941-27dbc02336b0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:20.684179 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-66f32e60-7236-41e8-a941-27dbc02336b0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:20.688397 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-66f32e60-7236-41e8-a941-27dbc02336b0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:20.689680 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-66f32e60-7236-41e8-a941-27dbc02336b0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:20.690376 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-66f32e60-7236-41e8-a941-27dbc02336b0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:20.691796 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-66f32e60-7236-41e8-a941-27dbc02336b0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:20.748948 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5bea1f4b-b519-4929-a772-443c82028f38 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:20.757381 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5bea1f4b-b519-4929-a772-443c82028f38 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355" status: 200 len: 1307 microversion: 2.1 time: 0.240670 Aug 07 01:28:20.770655 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1592/3529] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:20 2022] GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355 => generated 1307 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:20.777249 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-68e1ba04-89be-4e4e-add8-7c6a85737d2a tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:20.778137 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-68e1ba04-89be-4e4e-add8-7c6a85737d2a tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:20.785236 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68e1ba04-89be-4e4e-add8-7c6a85737d2a tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:20.785727 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68e1ba04-89be-4e4e-add8-7c6a85737d2a tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:20.786362 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68e1ba04-89be-4e4e-add8-7c6a85737d2a tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:20.787095 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68e1ba04-89be-4e4e-add8-7c6a85737d2a tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:20.787557 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68e1ba04-89be-4e4e-add8-7c6a85737d2a tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:20.788033 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68e1ba04-89be-4e4e-add8-7c6a85737d2a tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:20.966584 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-66f32e60-7236-41e8-a941-27dbc02336b0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:20.970472 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:20.981963 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-66f32e60-7236-41e8-a941-27dbc02336b0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd" status: 200 len: 1317 microversion: 2.1 time: 0.319621 Aug 07 01:28:20.990366 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1938/3530] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:20 2022] GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd => generated 1317 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:21.054617 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-68e1ba04-89be-4e4e-add8-7c6a85737d2a tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:21.065618 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-68e1ba04-89be-4e4e-add8-7c6a85737d2a tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:21.068308 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-68e1ba04-89be-4e4e-add8-7c6a85737d2a tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:21.071680 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-68e1ba04-89be-4e4e-add8-7c6a85737d2a tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1874 microversion: 2.42 time: 0.298517 Aug 07 01:28:21.072502 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1593/3531] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:28:20 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1874 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:28:21.407717 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-99118ae8-de68-4b10-8316-2e666a2f1d7f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:21.408100 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-99118ae8-de68-4b10-8316-2e666a2f1d7f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6d4bf33c-473a-445e-8194-29cbf0b4f1ac] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:21.415458 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99118ae8-de68-4b10-8316-2e666a2f1d7f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:21.416353 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99118ae8-de68-4b10-8316-2e666a2f1d7f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:21.417028 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99118ae8-de68-4b10-8316-2e666a2f1d7f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:21.417731 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99118ae8-de68-4b10-8316-2e666a2f1d7f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:21.418292 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99118ae8-de68-4b10-8316-2e666a2f1d7f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:21.418824 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99118ae8-de68-4b10-8316-2e666a2f1d7f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:21.525985 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d40b0811-6d10-4cde-bc37-627e3c56ed5d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:21.529872 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d40b0811-6d10-4cde-bc37-627e3c56ed5d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: edea7d5b-2ad8-4b91-b389-8d3a6dd3f118] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:21.537734 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d40b0811-6d10-4cde-bc37-627e3c56ed5d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:21.538228 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d40b0811-6d10-4cde-bc37-627e3c56ed5d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:21.538893 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d40b0811-6d10-4cde-bc37-627e3c56ed5d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:21.539826 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d40b0811-6d10-4cde-bc37-627e3c56ed5d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:21.540324 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d40b0811-6d10-4cde-bc37-627e3c56ed5d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:21.540923 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d40b0811-6d10-4cde-bc37-627e3c56ed5d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:21.575010 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:21.577781 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-99118ae8-de68-4b10-8316-2e666a2f1d7f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:21.586357 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-99118ae8-de68-4b10-8316-2e666a2f1d7f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac" status: 200 len: 1314 microversion: 2.1 time: 0.183441 Aug 07 01:28:21.586941 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1939/3532] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:21 2022] GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:21.594951 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-556bb6d8-f041-4f6d-807f-a57823e4b0df tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:21.595844 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-556bb6d8-f041-4f6d-807f-a57823e4b0df tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:21.603548 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-556bb6d8-f041-4f6d-807f-a57823e4b0df tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:21.604273 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-556bb6d8-f041-4f6d-807f-a57823e4b0df tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:21.604900 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-556bb6d8-f041-4f6d-807f-a57823e4b0df tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:21.606338 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-556bb6d8-f041-4f6d-807f-a57823e4b0df tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:21.608055 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-556bb6d8-f041-4f6d-807f-a57823e4b0df tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:21.608503 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-556bb6d8-f041-4f6d-807f-a57823e4b0df tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:21.622720 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d40b0811-6d10-4cde-bc37-627e3c56ed5d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118/action" status: 200 len: 14 microversion: 2.1 time: 0.100782 Aug 07 01:28:21.623797 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1594/3533] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:28:21 2022] POST /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 07 01:28:21.770634 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-556bb6d8-f041-4f6d-807f-a57823e4b0df tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:21.781510 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-27c12f8b-2076-4af2-8f07-20ec496fd640 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:21.781797 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-556bb6d8-f041-4f6d-807f-a57823e4b0df tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1313 microversion: 2.1 time: 0.191976 Aug 07 01:28:21.782681 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-27c12f8b-2076-4af2-8f07-20ec496fd640 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: ce6c308a-7eb4-429f-ac41-9be9c4059355] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:21.783664 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1940/3534] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:21 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:21.791214 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27c12f8b-2076-4af2-8f07-20ec496fd640 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:21.792173 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27c12f8b-2076-4af2-8f07-20ec496fd640 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:21.792646 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27c12f8b-2076-4af2-8f07-20ec496fd640 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:21.793416 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27c12f8b-2076-4af2-8f07-20ec496fd640 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:21.793875 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27c12f8b-2076-4af2-8f07-20ec496fd640 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:21.794508 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27c12f8b-2076-4af2-8f07-20ec496fd640 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:22.003690 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3fc4525c-bdbd-4594-a2b5-6117741311c3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:22.005445 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3fc4525c-bdbd-4594-a2b5-6117741311c3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 19784b1a-63aa-44b2-bbd5-d8dda713efdd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:22.014063 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fc4525c-bdbd-4594-a2b5-6117741311c3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:22.015379 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fc4525c-bdbd-4594-a2b5-6117741311c3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:22.016524 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fc4525c-bdbd-4594-a2b5-6117741311c3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:22.017631 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fc4525c-bdbd-4594-a2b5-6117741311c3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:22.018375 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fc4525c-bdbd-4594-a2b5-6117741311c3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:22.019055 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fc4525c-bdbd-4594-a2b5-6117741311c3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:22.313681 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3fc4525c-bdbd-4594-a2b5-6117741311c3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:22.316162 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-27c12f8b-2076-4af2-8f07-20ec496fd640 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:22.327317 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-27c12f8b-2076-4af2-8f07-20ec496fd640 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355" status: 200 len: 1307 microversion: 2.1 time: 0.552037 Aug 07 01:28:22.344873 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1595/3535] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:21 2022] GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355 => generated 1307 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:22.349589 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3fc4525c-bdbd-4594-a2b5-6117741311c3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd" status: 200 len: 1317 microversion: 2.1 time: 0.350518 Aug 07 01:28:22.350209 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1941/3536] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:21 2022] GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd => generated 1317 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:28:22.355929 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-03a1296d-cee8-4051-bd83-b7f39421e145 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:22.357012 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-03a1296d-cee8-4051-bd83-b7f39421e145 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:22.365976 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-03a1296d-cee8-4051-bd83-b7f39421e145 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:22.366471 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-03a1296d-cee8-4051-bd83-b7f39421e145 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:22.367298 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-03a1296d-cee8-4051-bd83-b7f39421e145 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:22.369505 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-03a1296d-cee8-4051-bd83-b7f39421e145 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:22.370394 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-03a1296d-cee8-4051-bd83-b7f39421e145 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:22.371478 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-03a1296d-cee8-4051-bd83-b7f39421e145 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:22.609701 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ca9e8e76-acae-4c6e-8680-c5c423161686 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:22.610038 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ca9e8e76-acae-4c6e-8680-c5c423161686 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6d4bf33c-473a-445e-8194-29cbf0b4f1ac] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:22.616956 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca9e8e76-acae-4c6e-8680-c5c423161686 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:22.617600 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca9e8e76-acae-4c6e-8680-c5c423161686 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:22.618148 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca9e8e76-acae-4c6e-8680-c5c423161686 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:22.618975 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca9e8e76-acae-4c6e-8680-c5c423161686 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:22.619659 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca9e8e76-acae-4c6e-8680-c5c423161686 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:22.620229 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca9e8e76-acae-4c6e-8680-c5c423161686 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:22.628799 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-03a1296d-cee8-4051-bd83-b7f39421e145 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:22.641903 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-03a1296d-cee8-4051-bd83-b7f39421e145 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:22.643523 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-03a1296d-cee8-4051-bd83-b7f39421e145 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:22.644934 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-03a1296d-cee8-4051-bd83-b7f39421e145 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1874 microversion: 2.42 time: 0.298706 Aug 07 01:28:22.659952 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1596/3537] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:28:22 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1874 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:28:22.665005 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-00d5ca68-aeb5-4101-a718-c96f517dcd8f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:22.667234 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-00d5ca68-aeb5-4101-a718-c96f517dcd8f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: edea7d5b-2ad8-4b91-b389-8d3a6dd3f118] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:22.675274 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00d5ca68-aeb5-4101-a718-c96f517dcd8f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:22.676100 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00d5ca68-aeb5-4101-a718-c96f517dcd8f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:22.676612 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00d5ca68-aeb5-4101-a718-c96f517dcd8f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:22.677550 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00d5ca68-aeb5-4101-a718-c96f517dcd8f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:22.678107 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00d5ca68-aeb5-4101-a718-c96f517dcd8f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:22.678862 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00d5ca68-aeb5-4101-a718-c96f517dcd8f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:22.758928 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-00d5ca68-aeb5-4101-a718-c96f517dcd8f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118/action" status: 200 len: 14 microversion: 2.1 time: 0.097515 Aug 07 01:28:22.762765 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1597/3538] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:28:22 2022] POST /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:28:22.769911 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-a897cfa1-0996-4fd3-9939-8e043d6680c5 req-de33be66-21c1-4500-9c2a-35858c8f1438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "799e740e-2304-4bdf-ad6e-ea4817a92b15", "name": "network-vif-plugged", "status": "completed", "tag": "57dd2ceb-1878-4d37-b462-7fa515b4642e"}, {"server_uuid": "799e740e-2304-4bdf-ad6e-ea4817a92b15", "name": "network-vif-plugged", "status": "completed", "tag": "66d655ef-9cf7-49d7-a3ac-b463c6c5f801"}, {"server_uuid": "799e740e-2304-4bdf-ad6e-ea4817a92b15", "name": "network-vif-plugged", "status": "completed", "tag": "bae6d831-aaf8-4653-86fb-18251963e1b9"}, {"server_uuid": "19784b1a-63aa-44b2-bbd5-d8dda713efdd", "name": "network-vif-plugged", "status": "completed", "tag": "f9c5ce9d-4152-4817-9794-be707d2942bd"}, {"server_uuid": "799e740e-2304-4bdf-ad6e-ea4817a92b15", "name": "network-vif-plugged", "status": "completed", "tag": "40561cc9-b152-4881-8f63-0ed22243935d"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:22.785732 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a897cfa1-0996-4fd3-9939-8e043d6680c5 req-de33be66-21c1-4500-9c2a-35858c8f1438 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:22.786313 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a897cfa1-0996-4fd3-9939-8e043d6680c5 req-de33be66-21c1-4500-9c2a-35858c8f1438 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:22.786965 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a897cfa1-0996-4fd3-9939-8e043d6680c5 req-de33be66-21c1-4500-9c2a-35858c8f1438 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:22.808249 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-a897cfa1-0996-4fd3-9939-8e043d6680c5 req-de33be66-21c1-4500-9c2a-35858c8f1438 service nova] Creating event network-vif-plugged:57dd2ceb-1878-4d37-b462-7fa515b4642e for instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 on n-h1-master-1 Aug 07 01:28:22.808779 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-a897cfa1-0996-4fd3-9939-8e043d6680c5 req-de33be66-21c1-4500-9c2a-35858c8f1438 service nova] Creating event network-vif-plugged:66d655ef-9cf7-49d7-a3ac-b463c6c5f801 for instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 on n-h1-master-1 Aug 07 01:28:22.809421 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-a897cfa1-0996-4fd3-9939-8e043d6680c5 req-de33be66-21c1-4500-9c2a-35858c8f1438 service nova] Creating event network-vif-plugged:bae6d831-aaf8-4653-86fb-18251963e1b9 for instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 on n-h1-master-1 Aug 07 01:28:22.809834 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-a897cfa1-0996-4fd3-9939-8e043d6680c5 req-de33be66-21c1-4500-9c2a-35858c8f1438 service nova] Creating event network-vif-plugged:f9c5ce9d-4152-4817-9794-be707d2942bd for instance 19784b1a-63aa-44b2-bbd5-d8dda713efdd on n-h1-master-1 Aug 07 01:28:22.811511 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-a897cfa1-0996-4fd3-9939-8e043d6680c5 req-de33be66-21c1-4500-9c2a-35858c8f1438 service nova] Creating event network-vif-plugged:40561cc9-b152-4881-8f63-0ed22243935d for instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 on n-h1-master-1 Aug 07 01:28:22.819798 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-a897cfa1-0996-4fd3-9939-8e043d6680c5 req-de33be66-21c1-4500-9c2a-35858c8f1438 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.055218 Aug 07 01:28:22.820870 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1598/3539] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:28:22.827023 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-97af4d08-b590-4b62-bb9c-5ca7c8c9f04a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:22.828226 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-97af4d08-b590-4b62-bb9c-5ca7c8c9f04a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:22.835275 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-97af4d08-b590-4b62-bb9c-5ca7c8c9f04a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:22.836157 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-97af4d08-b590-4b62-bb9c-5ca7c8c9f04a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:22.836987 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-97af4d08-b590-4b62-bb9c-5ca7c8c9f04a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:22.838759 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-97af4d08-b590-4b62-bb9c-5ca7c8c9f04a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:22.839983 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-97af4d08-b590-4b62-bb9c-5ca7c8c9f04a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:22.840608 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-97af4d08-b590-4b62-bb9c-5ca7c8c9f04a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:22.868086 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ca9e8e76-acae-4c6e-8680-c5c423161686 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:22.882977 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ca9e8e76-acae-4c6e-8680-c5c423161686 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac" status: 200 len: 1314 microversion: 2.1 time: 0.278959 Aug 07 01:28:22.883555 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1942/3540] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:22 2022] GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:28:23.048093 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-97af4d08-b590-4b62-bb9c-5ca7c8c9f04a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:23.056350 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-97af4d08-b590-4b62-bb9c-5ca7c8c9f04a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1313 microversion: 2.1 time: 0.233996 Aug 07 01:28:23.057113 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1599/3541] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:22 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:23.349007 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-49bb86dc-4405-44bc-85c8-dadb7d50484b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:23.351123 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-49bb86dc-4405-44bc-85c8-dadb7d50484b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: ce6c308a-7eb4-429f-ac41-9be9c4059355] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:23.358649 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-49bb86dc-4405-44bc-85c8-dadb7d50484b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:23.359410 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-49bb86dc-4405-44bc-85c8-dadb7d50484b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:23.360088 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-49bb86dc-4405-44bc-85c8-dadb7d50484b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:23.361170 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-49bb86dc-4405-44bc-85c8-dadb7d50484b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:23.361625 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-49bb86dc-4405-44bc-85c8-dadb7d50484b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:23.362049 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-49bb86dc-4405-44bc-85c8-dadb7d50484b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:23.371647 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-baf1fca2-93ba-4648-9405-7bb8da2129d0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:23.371647 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-baf1fca2-93ba-4648-9405-7bb8da2129d0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 19784b1a-63aa-44b2-bbd5-d8dda713efdd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:23.391358 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-baf1fca2-93ba-4648-9405-7bb8da2129d0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:23.392334 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-baf1fca2-93ba-4648-9405-7bb8da2129d0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:23.393498 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-baf1fca2-93ba-4648-9405-7bb8da2129d0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:23.393705 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-baf1fca2-93ba-4648-9405-7bb8da2129d0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:23.393994 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-baf1fca2-93ba-4648-9405-7bb8da2129d0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:23.394426 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-baf1fca2-93ba-4648-9405-7bb8da2129d0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:23.598736 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-baf1fca2-93ba-4648-9405-7bb8da2129d0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:23.609294 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-baf1fca2-93ba-4648-9405-7bb8da2129d0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd" status: 200 len: 1317 microversion: 2.1 time: 0.242439 Aug 07 01:28:23.610475 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1600/3542] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:23 2022] GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:28:23.661869 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-49bb86dc-4405-44bc-85c8-dadb7d50484b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:23.670299 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-49bb86dc-4405-44bc-85c8-dadb7d50484b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355" status: 200 len: 1307 microversion: 2.1 time: 0.325069 Aug 07 01:28:23.673843 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-60a3114a-b45c-4587-9785-31218f08bd55 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:23.674845 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1943/3543] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:23 2022] GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355 => generated 1307 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:23.675401 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-60a3114a-b45c-4587-9785-31218f08bd55 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:23.682226 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-60a3114a-b45c-4587-9785-31218f08bd55 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:23.682763 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-60a3114a-b45c-4587-9785-31218f08bd55 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:23.683244 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-60a3114a-b45c-4587-9785-31218f08bd55 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:23.684206 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-60a3114a-b45c-4587-9785-31218f08bd55 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:23.685343 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-60a3114a-b45c-4587-9785-31218f08bd55 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:23.685817 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-60a3114a-b45c-4587-9785-31218f08bd55 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:23.770844 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e1d9572c-7848-4964-916a-df5155900b9b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:23.774456 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e1d9572c-7848-4964-916a-df5155900b9b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: edea7d5b-2ad8-4b91-b389-8d3a6dd3f118] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:23.798955 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1d9572c-7848-4964-916a-df5155900b9b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:23.799809 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1d9572c-7848-4964-916a-df5155900b9b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:23.800514 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1d9572c-7848-4964-916a-df5155900b9b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:23.801543 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1d9572c-7848-4964-916a-df5155900b9b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:23.802235 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1d9572c-7848-4964-916a-df5155900b9b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:23.802920 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1d9572c-7848-4964-916a-df5155900b9b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:23.878646 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e1d9572c-7848-4964-916a-df5155900b9b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118/action" status: 200 len: 14 microversion: 2.1 time: 0.111404 Aug 07 01:28:23.883459 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1944/3544] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:28:23 2022] POST /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 07 01:28:23.908785 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-07cd72a2-a319-4e82-b66a-ef4d11962293 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:23.910397 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-07cd72a2-a319-4e82-b66a-ef4d11962293 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6d4bf33c-473a-445e-8194-29cbf0b4f1ac] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:23.919355 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-07cd72a2-a319-4e82-b66a-ef4d11962293 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:23.920165 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-07cd72a2-a319-4e82-b66a-ef4d11962293 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:23.920611 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-07cd72a2-a319-4e82-b66a-ef4d11962293 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:23.922113 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-07cd72a2-a319-4e82-b66a-ef4d11962293 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:23.922832 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-07cd72a2-a319-4e82-b66a-ef4d11962293 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:23.923430 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-07cd72a2-a319-4e82-b66a-ef4d11962293 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:23.939019 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-60a3114a-b45c-4587-9785-31218f08bd55 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:23.949018 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-60a3114a-b45c-4587-9785-31218f08bd55 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:23.951035 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-60a3114a-b45c-4587-9785-31218f08bd55 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:23.952661 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-60a3114a-b45c-4587-9785-31218f08bd55 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1874 microversion: 2.42 time: 0.283525 Aug 07 01:28:23.953612 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1601/3545] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:28:23 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1874 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:28:24.082783 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9002fa82-6c12-4400-a2ce-bbcf2c30f687 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:24.084124 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9002fa82-6c12-4400-a2ce-bbcf2c30f687 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:24.098204 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9002fa82-6c12-4400-a2ce-bbcf2c30f687 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:24.099133 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9002fa82-6c12-4400-a2ce-bbcf2c30f687 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:24.100077 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9002fa82-6c12-4400-a2ce-bbcf2c30f687 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:24.101528 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9002fa82-6c12-4400-a2ce-bbcf2c30f687 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:24.102421 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9002fa82-6c12-4400-a2ce-bbcf2c30f687 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:24.103353 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9002fa82-6c12-4400-a2ce-bbcf2c30f687 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:24.233700 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-07cd72a2-a319-4e82-b66a-ef4d11962293 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:24.243085 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-07cd72a2-a319-4e82-b66a-ef4d11962293 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac" status: 200 len: 1314 microversion: 2.1 time: 0.339497 Aug 07 01:28:24.245260 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1945/3546] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:23 2022] GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:24.288540 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9002fa82-6c12-4400-a2ce-bbcf2c30f687 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:24.296412 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9002fa82-6c12-4400-a2ce-bbcf2c30f687 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1313 microversion: 2.1 time: 0.222139 Aug 07 01:28:24.297006 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1602/3547] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:24 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:28:24.631187 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-772801d8-fc82-4feb-b152-57c4778f7e15 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:24.632119 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-772801d8-fc82-4feb-b152-57c4778f7e15 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 19784b1a-63aa-44b2-bbd5-d8dda713efdd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:24.641241 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-772801d8-fc82-4feb-b152-57c4778f7e15 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:24.641972 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-772801d8-fc82-4feb-b152-57c4778f7e15 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:24.642407 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-772801d8-fc82-4feb-b152-57c4778f7e15 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:24.643213 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-772801d8-fc82-4feb-b152-57c4778f7e15 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:24.643667 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-772801d8-fc82-4feb-b152-57c4778f7e15 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:24.644201 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-772801d8-fc82-4feb-b152-57c4778f7e15 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:24.693434 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-683ccd23-5bad-4e77-9ad8-4cf52e9fe9e4 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:24.696584 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-683ccd23-5bad-4e77-9ad8-4cf52e9fe9e4 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: ce6c308a-7eb4-429f-ac41-9be9c4059355] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:24.726137 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-683ccd23-5bad-4e77-9ad8-4cf52e9fe9e4 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:24.726790 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-683ccd23-5bad-4e77-9ad8-4cf52e9fe9e4 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:24.727357 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-683ccd23-5bad-4e77-9ad8-4cf52e9fe9e4 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:24.741109 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-683ccd23-5bad-4e77-9ad8-4cf52e9fe9e4 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:24.741643 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-683ccd23-5bad-4e77-9ad8-4cf52e9fe9e4 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:24.742278 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-683ccd23-5bad-4e77-9ad8-4cf52e9fe9e4 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:25.117842 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-683ccd23-5bad-4e77-9ad8-4cf52e9fe9e4 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:25.130925 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-683ccd23-5bad-4e77-9ad8-4cf52e9fe9e4 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355" status: 200 len: 1307 microversion: 2.1 time: 0.442182 Aug 07 01:28:25.131547 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1603/3548] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:24 2022] GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355 => generated 1307 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:28:25.141507 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-772801d8-fc82-4feb-b152-57c4778f7e15 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:25.152823 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f4c89ff3-2dfd-40e7-af11-f5c4fbb30e4c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:25.155732 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f4c89ff3-2dfd-40e7-af11-f5c4fbb30e4c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: edea7d5b-2ad8-4b91-b389-8d3a6dd3f118] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:25.164634 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4c89ff3-2dfd-40e7-af11-f5c4fbb30e4c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:25.165350 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4c89ff3-2dfd-40e7-af11-f5c4fbb30e4c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:25.165915 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-772801d8-fc82-4feb-b152-57c4778f7e15 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd" status: 200 len: 1317 microversion: 2.1 time: 0.538885 Aug 07 01:28:25.166158 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4c89ff3-2dfd-40e7-af11-f5c4fbb30e4c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:25.166953 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1946/3549] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:24 2022] GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd => generated 1317 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:25.167374 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4c89ff3-2dfd-40e7-af11-f5c4fbb30e4c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:25.168044 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4c89ff3-2dfd-40e7-af11-f5c4fbb30e4c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:25.169729 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4c89ff3-2dfd-40e7-af11-f5c4fbb30e4c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:25.175572 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9358450c-83a2-4d35-8d33-d5e5a469fe20 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:25.176222 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9358450c-83a2-4d35-8d33-d5e5a469fe20 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:25.184952 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9358450c-83a2-4d35-8d33-d5e5a469fe20 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:25.185377 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9358450c-83a2-4d35-8d33-d5e5a469fe20 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:25.185815 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9358450c-83a2-4d35-8d33-d5e5a469fe20 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:25.186860 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9358450c-83a2-4d35-8d33-d5e5a469fe20 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:25.187322 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9358450c-83a2-4d35-8d33-d5e5a469fe20 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:25.187706 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9358450c-83a2-4d35-8d33-d5e5a469fe20 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:25.270153 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f4c89ff3-2dfd-40e7-af11-f5c4fbb30e4c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118/action" status: 200 len: 14 microversion: 2.1 time: 0.123131 Aug 07 01:28:25.276505 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1604/3550] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:28:25 2022] POST /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:28:25.285055 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-56e087bd-d61f-44e3-9b7b-fc655bb4b3d2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:25.286355 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-56e087bd-d61f-44e3-9b7b-fc655bb4b3d2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6d4bf33c-473a-445e-8194-29cbf0b4f1ac] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:25.306126 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-56e087bd-d61f-44e3-9b7b-fc655bb4b3d2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:25.307412 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-56e087bd-d61f-44e3-9b7b-fc655bb4b3d2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:25.308395 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-56e087bd-d61f-44e3-9b7b-fc655bb4b3d2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:25.309406 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-56e087bd-d61f-44e3-9b7b-fc655bb4b3d2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:25.310111 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-56e087bd-d61f-44e3-9b7b-fc655bb4b3d2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:25.310990 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-56e087bd-d61f-44e3-9b7b-fc655bb4b3d2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:25.494661 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9358450c-83a2-4d35-8d33-d5e5a469fe20 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:25.508187 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9358450c-83a2-4d35-8d33-d5e5a469fe20 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:25.510379 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9358450c-83a2-4d35-8d33-d5e5a469fe20 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:25.512311 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9358450c-83a2-4d35-8d33-d5e5a469fe20 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1874 microversion: 2.42 time: 0.344212 Aug 07 01:28:25.513901 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1947/3551] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:28:25 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1874 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:28:25.519293 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-90931a35-7e38-48a9-8488-4154dec1ee4f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:25.520600 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-90931a35-7e38-48a9-8488-4154dec1ee4f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:25.531402 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90931a35-7e38-48a9-8488-4154dec1ee4f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:25.532364 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90931a35-7e38-48a9-8488-4154dec1ee4f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:25.533126 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90931a35-7e38-48a9-8488-4154dec1ee4f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:25.534215 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90931a35-7e38-48a9-8488-4154dec1ee4f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:25.535034 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90931a35-7e38-48a9-8488-4154dec1ee4f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:25.536120 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90931a35-7e38-48a9-8488-4154dec1ee4f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:25.727706 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-56e087bd-d61f-44e3-9b7b-fc655bb4b3d2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:25.754018 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-56e087bd-d61f-44e3-9b7b-fc655bb4b3d2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac" status: 200 len: 1314 microversion: 2.1 time: 0.471067 Aug 07 01:28:25.754963 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1605/3552] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:25 2022] GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:25.772744 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-333fd931-8601-45d6-8b0a-78bfd3c985e3 req-4b44d17f-97d8-40c6-b855-8e291a712946 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce6c308a-7eb4-429f-ac41-9be9c4059355", "name": "network-vif-plugged", "status": "completed", "tag": "5948aeb6-19cc-4823-b3f6-0002d62e04ea"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:25.786010 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-333fd931-8601-45d6-8b0a-78bfd3c985e3 req-4b44d17f-97d8-40c6-b855-8e291a712946 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:25.786762 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-333fd931-8601-45d6-8b0a-78bfd3c985e3 req-4b44d17f-97d8-40c6-b855-8e291a712946 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:25.787370 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-333fd931-8601-45d6-8b0a-78bfd3c985e3 req-4b44d17f-97d8-40c6-b855-8e291a712946 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:25.805201 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-333fd931-8601-45d6-8b0a-78bfd3c985e3 req-4b44d17f-97d8-40c6-b855-8e291a712946 service nova] Creating event network-vif-plugged:5948aeb6-19cc-4823-b3f6-0002d62e04ea for instance ce6c308a-7eb4-429f-ac41-9be9c4059355 on n-h1-master-1 Aug 07 01:28:25.812630 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-333fd931-8601-45d6-8b0a-78bfd3c985e3 req-4b44d17f-97d8-40c6-b855-8e291a712946 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043882 Aug 07 01:28:25.813891 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1606/3553] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:28:26.108498 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-90931a35-7e38-48a9-8488-4154dec1ee4f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:26.119988 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-90931a35-7e38-48a9-8488-4154dec1ee4f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1313 microversion: 2.1 time: 0.603805 Aug 07 01:28:26.120597 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1948/3554] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:25 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1313 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:26.155385 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c83d4b7e-db19-4d1d-a0c9-21c91c1203ad tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:26.156409 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c83d4b7e-db19-4d1d-a0c9-21c91c1203ad tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: ce6c308a-7eb4-429f-ac41-9be9c4059355] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:26.163568 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c83d4b7e-db19-4d1d-a0c9-21c91c1203ad tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:26.164239 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c83d4b7e-db19-4d1d-a0c9-21c91c1203ad tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:26.165036 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c83d4b7e-db19-4d1d-a0c9-21c91c1203ad tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:26.165766 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c83d4b7e-db19-4d1d-a0c9-21c91c1203ad tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:26.166235 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c83d4b7e-db19-4d1d-a0c9-21c91c1203ad tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:26.166668 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c83d4b7e-db19-4d1d-a0c9-21c91c1203ad tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:26.191939 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4404ab03-da86-46ba-8c3a-5919eafb42e7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:26.192934 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4404ab03-da86-46ba-8c3a-5919eafb42e7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 19784b1a-63aa-44b2-bbd5-d8dda713efdd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:26.199924 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4404ab03-da86-46ba-8c3a-5919eafb42e7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:26.200438 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4404ab03-da86-46ba-8c3a-5919eafb42e7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:26.201009 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4404ab03-da86-46ba-8c3a-5919eafb42e7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:26.201896 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4404ab03-da86-46ba-8c3a-5919eafb42e7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:26.202505 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4404ab03-da86-46ba-8c3a-5919eafb42e7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:26.203095 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4404ab03-da86-46ba-8c3a-5919eafb42e7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:26.313944 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c83d4b7e-db19-4d1d-a0c9-21c91c1203ad tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:26.322399 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c83d4b7e-db19-4d1d-a0c9-21c91c1203ad tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355" status: 200 len: 1307 microversion: 2.1 time: 0.172060 Aug 07 01:28:26.323479 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1607/3555] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:26 2022] GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355 => generated 1307 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:26.329322 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-75dbed2e-0541-4e3e-a8d3-67bc3f40818e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:26.331748 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-75dbed2e-0541-4e3e-a8d3-67bc3f40818e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: edea7d5b-2ad8-4b91-b389-8d3a6dd3f118] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:26.338268 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75dbed2e-0541-4e3e-a8d3-67bc3f40818e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:26.338854 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75dbed2e-0541-4e3e-a8d3-67bc3f40818e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:26.339359 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75dbed2e-0541-4e3e-a8d3-67bc3f40818e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:26.340328 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75dbed2e-0541-4e3e-a8d3-67bc3f40818e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:26.340830 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75dbed2e-0541-4e3e-a8d3-67bc3f40818e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:26.341808 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75dbed2e-0541-4e3e-a8d3-67bc3f40818e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:26.392086 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4404ab03-da86-46ba-8c3a-5919eafb42e7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:26.407928 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4404ab03-da86-46ba-8c3a-5919eafb42e7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd" status: 200 len: 1507 microversion: 2.1 time: 0.213749 Aug 07 01:28:26.414798 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-75dbed2e-0541-4e3e-a8d3-67bc3f40818e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118/action" status: 200 len: 14 microversion: 2.1 time: 0.089776 Aug 07 01:28:26.415579 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1608/3556] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:28:26 2022] POST /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:28:26.415962 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1949/3557] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:26 2022] GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd => generated 1507 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:26.426073 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e8432edf-2310-4c3f-b8f1-66f5e6ad74c8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:26.426764 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e8432edf-2310-4c3f-b8f1-66f5e6ad74c8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 19784b1a-63aa-44b2-bbd5-d8dda713efdd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:26.434754 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e8432edf-2310-4c3f-b8f1-66f5e6ad74c8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:26.435304 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e8432edf-2310-4c3f-b8f1-66f5e6ad74c8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:26.436128 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e8432edf-2310-4c3f-b8f1-66f5e6ad74c8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:26.436912 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e8432edf-2310-4c3f-b8f1-66f5e6ad74c8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:26.437591 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e8432edf-2310-4c3f-b8f1-66f5e6ad74c8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:26.438222 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e8432edf-2310-4c3f-b8f1-66f5e6ad74c8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:26.470883 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e8432edf-2310-4c3f-b8f1-66f5e6ad74c8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 19784b1a-63aa-44b2-bbd5-d8dda713efdd] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:28:26.537896 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-42df3a15-bf46-48e2-9c01-616a1b632e34 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:26.539002 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-42df3a15-bf46-48e2-9c01-616a1b632e34 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:26.547340 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42df3a15-bf46-48e2-9c01-616a1b632e34 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:26.548526 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42df3a15-bf46-48e2-9c01-616a1b632e34 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:26.549280 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42df3a15-bf46-48e2-9c01-616a1b632e34 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:26.550369 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42df3a15-bf46-48e2-9c01-616a1b632e34 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:26.551330 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42df3a15-bf46-48e2-9c01-616a1b632e34 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:26.555175 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42df3a15-bf46-48e2-9c01-616a1b632e34 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:26.576679 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e8432edf-2310-4c3f-b8f1-66f5e6ad74c8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "DELETE /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd" status: 204 len: 0 microversion: 2.1 time: 0.156348 Aug 07 01:28:26.587291 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1609/3558] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:28:26 2022] DELETE /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:28:26.605585 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-07eeb7df-9048-4020-ac54-0e31d9abeded tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:26.607254 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-07eeb7df-9048-4020-ac54-0e31d9abeded tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 19784b1a-63aa-44b2-bbd5-d8dda713efdd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:26.617601 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-07eeb7df-9048-4020-ac54-0e31d9abeded tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:26.619344 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-07eeb7df-9048-4020-ac54-0e31d9abeded tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:26.620040 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-07eeb7df-9048-4020-ac54-0e31d9abeded tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:26.621011 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-07eeb7df-9048-4020-ac54-0e31d9abeded tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:26.621589 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-07eeb7df-9048-4020-ac54-0e31d9abeded tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:26.623062 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-07eeb7df-9048-4020-ac54-0e31d9abeded tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:26.806744 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-07eeb7df-9048-4020-ac54-0e31d9abeded tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:26.816217 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-07eeb7df-9048-4020-ac54-0e31d9abeded tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd" status: 200 len: 1513 microversion: 2.1 time: 0.223823 Aug 07 01:28:26.838260 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1610/3559] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:26 2022] GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd => generated 1513 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:26.847683 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-77bf75f1-f594-4130-b634-164a2950f876 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:26.848744 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-77bf75f1-f594-4130-b634-164a2950f876 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6d4bf33c-473a-445e-8194-29cbf0b4f1ac] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:26.856606 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-77bf75f1-f594-4130-b634-164a2950f876 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:26.857647 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-77bf75f1-f594-4130-b634-164a2950f876 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:26.858382 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-77bf75f1-f594-4130-b634-164a2950f876 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:26.859387 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-77bf75f1-f594-4130-b634-164a2950f876 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:26.860158 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-77bf75f1-f594-4130-b634-164a2950f876 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:26.860868 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-77bf75f1-f594-4130-b634-164a2950f876 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:26.901072 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-42df3a15-bf46-48e2-9c01-616a1b632e34 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:26.911143 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-42df3a15-bf46-48e2-9c01-616a1b632e34 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:26.917113 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-42df3a15-bf46-48e2-9c01-616a1b632e34 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:26.921496 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-42df3a15-bf46-48e2-9c01-616a1b632e34 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 2832 microversion: 2.42 time: 0.387397 Aug 07 01:28:26.922878 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1950/3560] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:28:26 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 2832 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:28:27.004745 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ea37469b-6746-4f18-8cb6-a80363e6b258 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:27.006627 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ea37469b-6746-4f18-8cb6-a80363e6b258 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:27.014730 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:27.017757 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea37469b-6746-4f18-8cb6-a80363e6b258 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:27.018577 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea37469b-6746-4f18-8cb6-a80363e6b258 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:27.028070 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea37469b-6746-4f18-8cb6-a80363e6b258 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:27.030119 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea37469b-6746-4f18-8cb6-a80363e6b258 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:27.031057 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea37469b-6746-4f18-8cb6-a80363e6b258 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:27.032011 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea37469b-6746-4f18-8cb6-a80363e6b258 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:27.134389 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-77bf75f1-f594-4130-b634-164a2950f876 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:27.145491 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:27.148773 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-77bf75f1-f594-4130-b634-164a2950f876 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac" status: 200 len: 1314 microversion: 2.1 time: 0.308267 Aug 07 01:28:27.150349 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1611/3561] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:26 2022] GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:27.155634 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-82ecbc27-7c79-40f9-b920-e2d90fcbebbd tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:27.156551 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-82ecbc27-7c79-40f9-b920-e2d90fcbebbd tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:27.167696 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-82ecbc27-7c79-40f9-b920-e2d90fcbebbd tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:27.169848 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-82ecbc27-7c79-40f9-b920-e2d90fcbebbd tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:27.171443 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-82ecbc27-7c79-40f9-b920-e2d90fcbebbd tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:27.172701 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-82ecbc27-7c79-40f9-b920-e2d90fcbebbd tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:27.173925 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-82ecbc27-7c79-40f9-b920-e2d90fcbebbd tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:27.174735 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-82ecbc27-7c79-40f9-b920-e2d90fcbebbd tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:27.217516 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ea37469b-6746-4f18-8cb6-a80363e6b258 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.267352 Aug 07 01:28:27.218624 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1951/3562] 10.222.0.39 () {60 vars in 1316 bytes} [Sun Aug 7 01:28:26 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15/os-interface => generated 1832 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:28:27.344470 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9c62a7fe-5624-421a-9c98-f76e04432b71 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:27.345363 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9c62a7fe-5624-421a-9c98-f76e04432b71 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: ce6c308a-7eb4-429f-ac41-9be9c4059355] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:27.352060 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c62a7fe-5624-421a-9c98-f76e04432b71 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:27.352863 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c62a7fe-5624-421a-9c98-f76e04432b71 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:27.353620 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c62a7fe-5624-421a-9c98-f76e04432b71 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:27.354352 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c62a7fe-5624-421a-9c98-f76e04432b71 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:27.354812 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c62a7fe-5624-421a-9c98-f76e04432b71 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:27.355243 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c62a7fe-5624-421a-9c98-f76e04432b71 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:27.497666 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-82ecbc27-7c79-40f9-b920-e2d90fcbebbd tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:27.505315 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-82ecbc27-7c79-40f9-b920-e2d90fcbebbd tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1313 microversion: 2.1 time: 0.353348 Aug 07 01:28:27.506195 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1612/3563] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:27 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1313 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:27.529128 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-88fa70df-ccaf-4081-b3e8-2ed5a8d2bada tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:27.532080 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-88fa70df-ccaf-4081-b3e8-2ed5a8d2bada tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: edea7d5b-2ad8-4b91-b389-8d3a6dd3f118] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:27.539061 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-88fa70df-ccaf-4081-b3e8-2ed5a8d2bada tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:27.539913 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-88fa70df-ccaf-4081-b3e8-2ed5a8d2bada tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:27.540620 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-88fa70df-ccaf-4081-b3e8-2ed5a8d2bada tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:27.541533 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-88fa70df-ccaf-4081-b3e8-2ed5a8d2bada tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:27.542800 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-88fa70df-ccaf-4081-b3e8-2ed5a8d2bada tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:27.543500 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-88fa70df-ccaf-4081-b3e8-2ed5a8d2bada tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:27.633848 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-88fa70df-ccaf-4081-b3e8-2ed5a8d2bada tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118/action" status: 200 len: 14 microversion: 2.1 time: 0.111855 Aug 07 01:28:27.634941 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1613/3564] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:28:27 2022] POST /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:28:27.694835 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9c62a7fe-5624-421a-9c98-f76e04432b71 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:27.703631 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9c62a7fe-5624-421a-9c98-f76e04432b71 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355" status: 200 len: 1307 microversion: 2.1 time: 0.362903 Aug 07 01:28:27.718011 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1952/3565] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:27 2022] GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355 => generated 1307 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:28:27.840767 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ab0ba329-ecb7-4b6b-8ddd-f90bb30e28e1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:27.842031 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ab0ba329-ecb7-4b6b-8ddd-f90bb30e28e1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 19784b1a-63aa-44b2-bbd5-d8dda713efdd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:27.852109 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab0ba329-ecb7-4b6b-8ddd-f90bb30e28e1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:27.853270 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab0ba329-ecb7-4b6b-8ddd-f90bb30e28e1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:27.854143 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab0ba329-ecb7-4b6b-8ddd-f90bb30e28e1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:27.859843 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-887182ba-e996-46f5-85bb-377734fceaa2 req-b3f47e8c-6fff-42a9-ac60-7772cd04311b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e64da4-c05c-4bdc-a42c-7fbb858c846a", "name": "network-vif-plugged", "status": "completed", "tag": "738890f4-f9c5-48ca-8d3f-3d153d3b482d"}, {"server_uuid": "6d4bf33c-473a-445e-8194-29cbf0b4f1ac", "name": "network-vif-plugged", "status": "completed", "tag": "de308dbf-bd37-485b-bae4-307491eeaf18"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:27.867593 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab0ba329-ecb7-4b6b-8ddd-f90bb30e28e1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:27.868166 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab0ba329-ecb7-4b6b-8ddd-f90bb30e28e1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:27.868804 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab0ba329-ecb7-4b6b-8ddd-f90bb30e28e1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:27.879916 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-887182ba-e996-46f5-85bb-377734fceaa2 req-b3f47e8c-6fff-42a9-ac60-7772cd04311b service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:27.883447 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-887182ba-e996-46f5-85bb-377734fceaa2 req-b3f47e8c-6fff-42a9-ac60-7772cd04311b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:27.883447 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-887182ba-e996-46f5-85bb-377734fceaa2 req-b3f47e8c-6fff-42a9-ac60-7772cd04311b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:27.917465 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-887182ba-e996-46f5-85bb-377734fceaa2 req-b3f47e8c-6fff-42a9-ac60-7772cd04311b service nova] Creating event network-vif-plugged:738890f4-f9c5-48ca-8d3f-3d153d3b482d for instance 92e64da4-c05c-4bdc-a42c-7fbb858c846a on n-h1-master-1 Aug 07 01:28:27.918226 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-887182ba-e996-46f5-85bb-377734fceaa2 req-b3f47e8c-6fff-42a9-ac60-7772cd04311b service nova] Creating event network-vif-plugged:de308dbf-bd37-485b-bae4-307491eeaf18 for instance 6d4bf33c-473a-445e-8194-29cbf0b4f1ac on n-h1-master-1 Aug 07 01:28:27.930276 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-887182ba-e996-46f5-85bb-377734fceaa2 req-b3f47e8c-6fff-42a9-ac60-7772cd04311b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.074032 Aug 07 01:28:27.931708 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1953/3566] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:28:28.172117 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5fbfdf9a-9d0e-4300-9481-952f8f78d9ca tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:28.174373 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5fbfdf9a-9d0e-4300-9481-952f8f78d9ca tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6d4bf33c-473a-445e-8194-29cbf0b4f1ac] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:28.176197 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ab0ba329-ecb7-4b6b-8ddd-f90bb30e28e1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:28.181851 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5fbfdf9a-9d0e-4300-9481-952f8f78d9ca tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:28.182648 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5fbfdf9a-9d0e-4300-9481-952f8f78d9ca tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:28.183388 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5fbfdf9a-9d0e-4300-9481-952f8f78d9ca tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:28.184707 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5fbfdf9a-9d0e-4300-9481-952f8f78d9ca tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:28.185354 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5fbfdf9a-9d0e-4300-9481-952f8f78d9ca tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:28.185956 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5fbfdf9a-9d0e-4300-9481-952f8f78d9ca tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:28.192093 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ab0ba329-ecb7-4b6b-8ddd-f90bb30e28e1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd" status: 200 len: 1513 microversion: 2.1 time: 0.355835 Aug 07 01:28:28.205409 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1614/3567] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:27 2022] GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd => generated 1513 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:28.488044 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5fbfdf9a-9d0e-4300-9481-952f8f78d9ca tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:28.498662 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5fbfdf9a-9d0e-4300-9481-952f8f78d9ca tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac" status: 200 len: 1314 microversion: 2.1 time: 0.331420 Aug 07 01:28:28.499857 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1954/3568] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:28 2022] GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:28.530805 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5a20a9ae-22ad-4e95-8c90-00df3c01b8f7 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:28.532394 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5a20a9ae-22ad-4e95-8c90-00df3c01b8f7 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:28.543941 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a20a9ae-22ad-4e95-8c90-00df3c01b8f7 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:28.544994 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a20a9ae-22ad-4e95-8c90-00df3c01b8f7 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:28.545896 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a20a9ae-22ad-4e95-8c90-00df3c01b8f7 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:28.547018 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a20a9ae-22ad-4e95-8c90-00df3c01b8f7 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:28.548134 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a20a9ae-22ad-4e95-8c90-00df3c01b8f7 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:28.548745 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a20a9ae-22ad-4e95-8c90-00df3c01b8f7 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:28.645814 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8ac9d471-0ed8-42f0-bc16-b1ed790efec7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:28.648682 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8ac9d471-0ed8-42f0-bc16-b1ed790efec7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: edea7d5b-2ad8-4b91-b389-8d3a6dd3f118] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:28.661790 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8ac9d471-0ed8-42f0-bc16-b1ed790efec7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:28.662548 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8ac9d471-0ed8-42f0-bc16-b1ed790efec7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:28.671598 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8ac9d471-0ed8-42f0-bc16-b1ed790efec7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:28.672673 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8ac9d471-0ed8-42f0-bc16-b1ed790efec7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:28.673326 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8ac9d471-0ed8-42f0-bc16-b1ed790efec7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:28.673985 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8ac9d471-0ed8-42f0-bc16-b1ed790efec7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:28.770652 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8ac9d471-0ed8-42f0-bc16-b1ed790efec7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118/action" status: 200 len: 8204 microversion: 2.1 time: 0.127707 Aug 07 01:28:28.772323 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1955/3569] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:28:28 2022] POST /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118/action => generated 8204 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:28:28.778930 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-aa778865-ac5c-4ded-8c67-64f96823ccc2 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:28.780051 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-aa778865-ac5c-4ded-8c67-64f96823ccc2 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: ce6c308a-7eb4-429f-ac41-9be9c4059355] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:28.791780 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa778865-ac5c-4ded-8c67-64f96823ccc2 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:28.794286 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa778865-ac5c-4ded-8c67-64f96823ccc2 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:28.795074 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa778865-ac5c-4ded-8c67-64f96823ccc2 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:28.797639 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa778865-ac5c-4ded-8c67-64f96823ccc2 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:28.798430 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa778865-ac5c-4ded-8c67-64f96823ccc2 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:28.799484 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa778865-ac5c-4ded-8c67-64f96823ccc2 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:28.881329 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5a20a9ae-22ad-4e95-8c90-00df3c01b8f7 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:28.891619 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5a20a9ae-22ad-4e95-8c90-00df3c01b8f7 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1313 microversion: 2.1 time: 0.367250 Aug 07 01:28:28.893207 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1615/3570] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:28 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1313 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:28.899763 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-aec0ce4e-af9e-4c67-b2c2-3207c5e9a5b0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:28.901372 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-aec0ce4e-af9e-4c67-b2c2-3207c5e9a5b0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:28.911831 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aec0ce4e-af9e-4c67-b2c2-3207c5e9a5b0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:28.915855 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aec0ce4e-af9e-4c67-b2c2-3207c5e9a5b0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:28.916422 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aec0ce4e-af9e-4c67-b2c2-3207c5e9a5b0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:28.917116 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aec0ce4e-af9e-4c67-b2c2-3207c5e9a5b0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:28.917575 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aec0ce4e-af9e-4c67-b2c2-3207c5e9a5b0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:28.923353 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aec0ce4e-af9e-4c67-b2c2-3207c5e9a5b0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:29.200866 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-aa778865-ac5c-4ded-8c67-64f96823ccc2 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:29.214333 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-aa778865-ac5c-4ded-8c67-64f96823ccc2 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355" status: 200 len: 1487 microversion: 2.1 time: 0.440578 Aug 07 01:28:29.218182 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1956/3571] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:28 2022] GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355 => generated 1487 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:29.224221 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-43afd535-2fc7-46fb-afb0-6714bda87f7b req-7c9b490d-610f-4228-ad69-c669e530ff07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "799e740e-2304-4bdf-ad6e-ea4817a92b15", "tag": "66d655ef-9cf7-49d7-a3ac-b463c6c5f801"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:29.257274 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-43afd535-2fc7-46fb-afb0-6714bda87f7b req-7c9b490d-610f-4228-ad69-c669e530ff07 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:29.266547 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-43afd535-2fc7-46fb-afb0-6714bda87f7b req-7c9b490d-610f-4228-ad69-c669e530ff07 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:29.267611 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-43afd535-2fc7-46fb-afb0-6714bda87f7b req-7c9b490d-610f-4228-ad69-c669e530ff07 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:29.272996 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:29.290571 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-43afd535-2fc7-46fb-afb0-6714bda87f7b req-7c9b490d-610f-4228-ad69-c669e530ff07 service nova] Creating event network-changed:66d655ef-9cf7-49d7-a3ac-b463c6c5f801 for instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 on n-h1-master-1 Aug 07 01:28:29.293437 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-aec0ce4e-af9e-4c67-b2c2-3207c5e9a5b0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:29.299047 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-43afd535-2fc7-46fb-afb0-6714bda87f7b req-7c9b490d-610f-4228-ad69-c669e530ff07 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078305 Aug 07 01:28:29.299970 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1957/3572] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:28:29.307127 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9e488f04-6301-431e-995d-ba2e7b9fb6af tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:29.308255 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9e488f04-6301-431e-995d-ba2e7b9fb6af tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 19784b1a-63aa-44b2-bbd5-d8dda713efdd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:29.317111 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e488f04-6301-431e-995d-ba2e7b9fb6af tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:29.317608 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-aec0ce4e-af9e-4c67-b2c2-3207c5e9a5b0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.422403 Aug 07 01:28:29.318234 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1616/3573] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:28 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:29.318627 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e488f04-6301-431e-995d-ba2e7b9fb6af tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:29.319332 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e488f04-6301-431e-995d-ba2e7b9fb6af tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:29.320352 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e488f04-6301-431e-995d-ba2e7b9fb6af tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:29.321053 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e488f04-6301-431e-995d-ba2e7b9fb6af tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:29.321732 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e488f04-6301-431e-995d-ba2e7b9fb6af tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:29.323190 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b2435a70-79d2-4c2f-82c4-e4d9b1679d30 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:29.323770 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b2435a70-79d2-4c2f-82c4-e4d9b1679d30 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: ce6c308a-7eb4-429f-ac41-9be9c4059355] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:29.346808 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2435a70-79d2-4c2f-82c4-e4d9b1679d30 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:29.348823 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2435a70-79d2-4c2f-82c4-e4d9b1679d30 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:29.350021 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2435a70-79d2-4c2f-82c4-e4d9b1679d30 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:29.352200 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2435a70-79d2-4c2f-82c4-e4d9b1679d30 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:29.353471 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2435a70-79d2-4c2f-82c4-e4d9b1679d30 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:29.357348 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2435a70-79d2-4c2f-82c4-e4d9b1679d30 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:29.389019 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-b2435a70-79d2-4c2f-82c4-e4d9b1679d30 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lazy-loading 'flavor' on Instance uuid ce6c308a-7eb4-429f-ac41-9be9c4059355 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:28:29.479315 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b2435a70-79d2-4c2f-82c4-e4d9b1679d30 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "POST /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355/action" status: 202 len: 0 microversion: 2.1 time: 0.159190 Aug 07 01:28:29.480455 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1617/3574] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:28:29 2022] POST /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:28:29.490171 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-95988557-17c5-4359-962f-d369563ec5fb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:29.491122 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-95988557-17c5-4359-962f-d369563ec5fb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:29.498093 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-95988557-17c5-4359-962f-d369563ec5fb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:29.498736 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-95988557-17c5-4359-962f-d369563ec5fb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:29.499283 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-95988557-17c5-4359-962f-d369563ec5fb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:29.500143 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-95988557-17c5-4359-962f-d369563ec5fb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:29.500702 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-95988557-17c5-4359-962f-d369563ec5fb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:29.501408 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-95988557-17c5-4359-962f-d369563ec5fb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:29.690277 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9e488f04-6301-431e-995d-ba2e7b9fb6af tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:29.699183 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9e488f04-6301-431e-995d-ba2e7b9fb6af tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd" status: 200 len: 1513 microversion: 2.1 time: 0.397761 Aug 07 01:28:29.703581 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1958/3575] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:29 2022] GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd => generated 1513 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:29.710750 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a5f4c4e7-9f0a-485b-b4ef-f77c444420db tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:29.711371 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a5f4c4e7-9f0a-485b-b4ef-f77c444420db tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: ce6c308a-7eb4-429f-ac41-9be9c4059355] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:29.723617 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-95988557-17c5-4359-962f-d369563ec5fb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:29.725827 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a5f4c4e7-9f0a-485b-b4ef-f77c444420db tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:29.726328 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a5f4c4e7-9f0a-485b-b4ef-f77c444420db tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:29.726766 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a5f4c4e7-9f0a-485b-b4ef-f77c444420db tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:29.727652 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a5f4c4e7-9f0a-485b-b4ef-f77c444420db tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:29.728189 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a5f4c4e7-9f0a-485b-b4ef-f77c444420db tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:29.728621 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a5f4c4e7-9f0a-485b-b4ef-f77c444420db tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:29.747334 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-95988557-17c5-4359-962f-d369563ec5fb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.264251 Aug 07 01:28:29.748438 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1618/3576] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:29 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:29.753568 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ee5d62b6-b186-40bf-ae5d-2bee539241dd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:29.754466 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ee5d62b6-b186-40bf-ae5d-2bee539241dd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6d4bf33c-473a-445e-8194-29cbf0b4f1ac] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:29.766788 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee5d62b6-b186-40bf-ae5d-2bee539241dd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:29.767502 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee5d62b6-b186-40bf-ae5d-2bee539241dd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:29.768500 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee5d62b6-b186-40bf-ae5d-2bee539241dd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:29.769457 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee5d62b6-b186-40bf-ae5d-2bee539241dd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:29.770666 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee5d62b6-b186-40bf-ae5d-2bee539241dd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:29.772977 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee5d62b6-b186-40bf-ae5d-2bee539241dd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:30.018063 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ee5d62b6-b186-40bf-ae5d-2bee539241dd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:30.028396 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ee5d62b6-b186-40bf-ae5d-2bee539241dd tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac" status: 200 len: 1314 microversion: 2.1 time: 0.278498 Aug 07 01:28:30.029122 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1619/3577] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:29 2022] GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:30.042992 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1b529134-3830-4fc3-b50f-bb6927280673 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:30.045599 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1b529134-3830-4fc3-b50f-bb6927280673 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:30.053668 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b529134-3830-4fc3-b50f-bb6927280673 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:30.054727 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b529134-3830-4fc3-b50f-bb6927280673 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:30.055465 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b529134-3830-4fc3-b50f-bb6927280673 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:30.056446 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b529134-3830-4fc3-b50f-bb6927280673 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:30.057140 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b529134-3830-4fc3-b50f-bb6927280673 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:30.057787 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b529134-3830-4fc3-b50f-bb6927280673 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:30.242562 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a5f4c4e7-9f0a-485b-b4ef-f77c444420db tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:30.251731 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a5f4c4e7-9f0a-485b-b4ef-f77c444420db tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355" status: 200 len: 1495 microversion: 2.1 time: 0.546919 Aug 07 01:28:30.253110 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1959/3578] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:29 2022] GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355 => generated 1495 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:30.258406 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e499e5fc-cd03-41f2-9b30-227542c209d2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:30.259506 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e499e5fc-cd03-41f2-9b30-227542c209d2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:30.266815 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e499e5fc-cd03-41f2-9b30-227542c209d2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:30.267720 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e499e5fc-cd03-41f2-9b30-227542c209d2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:30.268439 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e499e5fc-cd03-41f2-9b30-227542c209d2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:30.269408 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e499e5fc-cd03-41f2-9b30-227542c209d2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:30.270087 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e499e5fc-cd03-41f2-9b30-227542c209d2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:30.270779 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e499e5fc-cd03-41f2-9b30-227542c209d2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:30.289448 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1b529134-3830-4fc3-b50f-bb6927280673 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:30.300790 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1b529134-3830-4fc3-b50f-bb6927280673 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.270362 Aug 07 01:28:30.301846 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1620/3579] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:30 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:30.325333 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-87f3dfb2-4527-44ac-8ef6-8689ca7deee4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:30.326431 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-87f3dfb2-4527-44ac-8ef6-8689ca7deee4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:30.334762 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-87f3dfb2-4527-44ac-8ef6-8689ca7deee4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:30.335543 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-87f3dfb2-4527-44ac-8ef6-8689ca7deee4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:30.336112 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-87f3dfb2-4527-44ac-8ef6-8689ca7deee4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:30.337885 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-87f3dfb2-4527-44ac-8ef6-8689ca7deee4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:30.337885 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-87f3dfb2-4527-44ac-8ef6-8689ca7deee4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:30.338625 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-87f3dfb2-4527-44ac-8ef6-8689ca7deee4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:30.594361 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-87f3dfb2-4527-44ac-8ef6-8689ca7deee4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:30.606479 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-87f3dfb2-4527-44ac-8ef6-8689ca7deee4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.284952 Aug 07 01:28:30.614410 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1621/3580] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:30 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:28:30.614410 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-1cee5b63-1527-494f-90b0-19eefcc56640 req-9f0a6dfa-9f10-47e0-afe4-f2ab123e9940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19784b1a-63aa-44b2-bbd5-d8dda713efdd", "name": "network-vif-deleted", "tag": "f9c5ce9d-4152-4817-9794-be707d2942bd"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:30.626513 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-1cee5b63-1527-494f-90b0-19eefcc56640 req-9f0a6dfa-9f10-47e0-afe4-f2ab123e9940 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:30.627492 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-1cee5b63-1527-494f-90b0-19eefcc56640 req-9f0a6dfa-9f10-47e0-afe4-f2ab123e9940 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:30.628345 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-1cee5b63-1527-494f-90b0-19eefcc56640 req-9f0a6dfa-9f10-47e0-afe4-f2ab123e9940 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:30.645819 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-1cee5b63-1527-494f-90b0-19eefcc56640 req-9f0a6dfa-9f10-47e0-afe4-f2ab123e9940 service nova] Creating event network-vif-deleted:f9c5ce9d-4152-4817-9794-be707d2942bd for instance 19784b1a-63aa-44b2-bbd5-d8dda713efdd on n-h1-master-1 Aug 07 01:28:30.653705 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-1cee5b63-1527-494f-90b0-19eefcc56640 req-9f0a6dfa-9f10-47e0-afe4-f2ab123e9940 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044412 Aug 07 01:28:30.654651 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1622/3581] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:28:30.662435 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2c93fc43-371b-4dd4-98a1-c6da4f05f044 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:30.663162 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2c93fc43-371b-4dd4-98a1-c6da4f05f044 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:30.674358 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c93fc43-371b-4dd4-98a1-c6da4f05f044 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:30.674861 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c93fc43-371b-4dd4-98a1-c6da4f05f044 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:30.675398 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c93fc43-371b-4dd4-98a1-c6da4f05f044 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:30.676046 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c93fc43-371b-4dd4-98a1-c6da4f05f044 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:30.676510 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c93fc43-371b-4dd4-98a1-c6da4f05f044 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:30.676933 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c93fc43-371b-4dd4-98a1-c6da4f05f044 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:30.731475 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2c93fc43-371b-4dd4-98a1-c6da4f05f044 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Locking {{(pid=119517) lock /opt/stack/nova/nova/compute/api.py:4781}} Aug 07 01:28:30.742223 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e499e5fc-cd03-41f2-9b30-227542c209d2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:30.754129 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e499e5fc-cd03-41f2-9b30-227542c209d2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1313 microversion: 2.1 time: 0.499630 Aug 07 01:28:30.756080 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1960/3582] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:30 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1313 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:30.763991 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4ea87fad-16c5-4e18-bef9-98d0f793ebde tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:30.764950 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4ea87fad-16c5-4e18-bef9-98d0f793ebde tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 19784b1a-63aa-44b2-bbd5-d8dda713efdd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:30.772815 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4ea87fad-16c5-4e18-bef9-98d0f793ebde tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:30.773838 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4ea87fad-16c5-4e18-bef9-98d0f793ebde tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:30.777223 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4ea87fad-16c5-4e18-bef9-98d0f793ebde tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:30.777223 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4ea87fad-16c5-4e18-bef9-98d0f793ebde tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:30.777681 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4ea87fad-16c5-4e18-bef9-98d0f793ebde tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:30.778231 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4ea87fad-16c5-4e18-bef9-98d0f793ebde tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:30.826883 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2c93fc43-371b-4dd4-98a1-c6da4f05f044 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action" status: 202 len: 0 microversion: 2.1 time: 0.169875 Aug 07 01:28:30.830572 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1623/3583] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:28:30 2022] POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:28:30.838990 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-beb1394f-a067-4417-8ec8-3d22f3ea2117 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:30.839702 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-beb1394f-a067-4417-8ec8-3d22f3ea2117 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:30.847999 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-beb1394f-a067-4417-8ec8-3d22f3ea2117 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:30.849388 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-beb1394f-a067-4417-8ec8-3d22f3ea2117 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:30.849953 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-beb1394f-a067-4417-8ec8-3d22f3ea2117 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:30.850791 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-beb1394f-a067-4417-8ec8-3d22f3ea2117 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:30.851592 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-beb1394f-a067-4417-8ec8-3d22f3ea2117 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:30.852349 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-beb1394f-a067-4417-8ec8-3d22f3ea2117 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:30.909687 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4ea87fad-16c5-4e18-bef9-98d0f793ebde tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:30.957362 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4ea87fad-16c5-4e18-bef9-98d0f793ebde tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd" status: 200 len: 1471 microversion: 2.1 time: 0.199558 Aug 07 01:28:30.959643 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1961/3584] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:30 2022] GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd => generated 1471 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:31.050477 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ce65322d-6fc9-45ac-a9e7-e21a19039cce tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:31.051610 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ce65322d-6fc9-45ac-a9e7-e21a19039cce tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6d4bf33c-473a-445e-8194-29cbf0b4f1ac] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:31.058929 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce65322d-6fc9-45ac-a9e7-e21a19039cce tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:31.060169 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce65322d-6fc9-45ac-a9e7-e21a19039cce tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:31.063337 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce65322d-6fc9-45ac-a9e7-e21a19039cce tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:31.078759 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce65322d-6fc9-45ac-a9e7-e21a19039cce tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:31.079424 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce65322d-6fc9-45ac-a9e7-e21a19039cce tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:31.080093 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce65322d-6fc9-45ac-a9e7-e21a19039cce tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:31.134625 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-beb1394f-a067-4417-8ec8-3d22f3ea2117 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:31.143544 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-beb1394f-a067-4417-8ec8-3d22f3ea2117 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.308940 Aug 07 01:28:31.144179 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1624/3585] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:30 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:28:31.166022 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c9fe5f02-16a7-48a4-8038-f86cf5d27de2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:31.168383 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:31.174457 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c9fe5f02-16a7-48a4-8038-f86cf5d27de2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:31.175043 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c9fe5f02-16a7-48a4-8038-f86cf5d27de2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:31.175551 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c9fe5f02-16a7-48a4-8038-f86cf5d27de2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:31.196769 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:31.213137 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-c9fe5f02-16a7-48a4-8038-f86cf5d27de2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] HTTP exception thrown: Instance e39f0d23-55ab-417b-818e-92de14de44c0 is locked Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c9fe5f02-16a7-48a4-8038-f86cf5d27de2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Request method failure captured: Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action HTTP/1.1 Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 15 Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xQCEJk-j7q5GMRny_lsGnif3Sdi6J_PRK48HvBw7IFCGAd_4S8dbT6u0ir6pCNKAcDzgjJe8K3EgGxRXM_bdEmqwJ2s26cJoZ1m0Ije37wqG_FgPxW47Mp_NsDH3oUqaT1pJwDbOh-Nmz7ouIQa3E2NiKYv614rH5Vd5TuR7lUPJkQ Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 939fea7fa6ea4deda8d4fbef70a4e510 Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServerActionsTestJSON-447960584 Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/939fea7fa6ea4deda8d4fbef70a4e510"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_939fea7fa6ea4deda8d4fbef70a4e510", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/939fea7fa6ea4deda8d4fbef70a4e510"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/939fea7fa6ea4deda8d4fbef70a4e510"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServerActionsTestJSON-447960584 Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 939fea7fa6ea4deda8d4fbef70a4e510 Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServerActionsTestJSON-447960584 Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServerActionsTestJSON-447960584-project Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: ef29bd35cca547c39d76c54058d32979 Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServerActionsTestJSON-447960584-project Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: {"os-stop": {}} Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: exception: Instance e39f0d23-55ab-417b-818e-92de14de44c0 is locked Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'e39f0d23-55ab-417b-818e-92de14de44c0', 'body': {'os-stop': {}}} Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance e39f0d23-55ab-417b-818e-92de14de44c0 is locked Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance e39f0d23-55ab-417b-818e-92de14de44c0 is locked Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e39f0d23-55ab-417b-818e-92de14de44c0 is locked Aug 07 01:28:31.216279 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:31.223873 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c9fe5f02-16a7-48a4-8038-f86cf5d27de2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Returning 409 to user: Instance e39f0d23-55ab-417b-818e-92de14de44c0 is locked {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:28:31.225237 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c9fe5f02-16a7-48a4-8038-f86cf5d27de2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action" status: 409 len: 107 microversion: 2.1 time: 0.063620 Aug 07 01:28:31.232085 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1625/3586] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:28:31 2022] POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action => generated 107 bytes in 71 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 07 01:28:31.239753 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f26a512b-91cd-4489-bd65-f371c994a166 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:31.240656 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f26a512b-91cd-4489-bd65-f371c994a166 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:31.251947 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f26a512b-91cd-4489-bd65-f371c994a166 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:31.252740 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f26a512b-91cd-4489-bd65-f371c994a166 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:31.253362 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f26a512b-91cd-4489-bd65-f371c994a166 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:31.254289 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f26a512b-91cd-4489-bd65-f371c994a166 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:31.255311 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f26a512b-91cd-4489-bd65-f371c994a166 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:31.255957 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f26a512b-91cd-4489-bd65-f371c994a166 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:31.320178 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f26a512b-91cd-4489-bd65-f371c994a166 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Unlocking {{(pid=119517) unlock /opt/stack/nova/nova/compute/api.py:4810}} Aug 07 01:28:31.370858 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ce65322d-6fc9-45ac-a9e7-e21a19039cce tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:31.386270 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ce65322d-6fc9-45ac-a9e7-e21a19039cce tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac" status: 200 len: 1314 microversion: 2.1 time: 0.339853 Aug 07 01:28:31.389638 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1962/3587] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:31 2022] GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:31.395666 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a4ffc057-dee7-4c3d-962d-f5ef11d06b03 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:31.397169 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a4ffc057-dee7-4c3d-962d-f5ef11d06b03 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: ce6c308a-7eb4-429f-ac41-9be9c4059355] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:31.405440 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4ffc057-dee7-4c3d-962d-f5ef11d06b03 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:31.406358 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4ffc057-dee7-4c3d-962d-f5ef11d06b03 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:31.407302 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4ffc057-dee7-4c3d-962d-f5ef11d06b03 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:31.407956 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f26a512b-91cd-4489-bd65-f371c994a166 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action" status: 202 len: 0 microversion: 2.1 time: 0.171883 Aug 07 01:28:31.409367 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4ffc057-dee7-4c3d-962d-f5ef11d06b03 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:31.410307 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4ffc057-dee7-4c3d-962d-f5ef11d06b03 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:31.410897 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4ffc057-dee7-4c3d-962d-f5ef11d06b03 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:31.414035 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1626/3588] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:28:31 2022] POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:28:31.431955 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2e7a8fb5-58ad-406b-b634-14db00cfc47d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:31.469325 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2e7a8fb5-58ad-406b-b634-14db00cfc47d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:31.470507 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2e7a8fb5-58ad-406b-b634-14db00cfc47d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:31.471227 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2e7a8fb5-58ad-406b-b634-14db00cfc47d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:31.524499 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2e7a8fb5-58ad-406b-b634-14db00cfc47d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Going to try to stop instance {{(pid=119517) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 07 01:28:31.641958 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2e7a8fb5-58ad-406b-b634-14db00cfc47d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action" status: 202 len: 0 microversion: 2.1 time: 0.225546 Aug 07 01:28:31.656699 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1627/3589] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:28:31 2022] POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:28:31.667743 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4791343f-ce5f-406b-bf05-c28f58716842 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:31.675462 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4791343f-ce5f-406b-bf05-c28f58716842 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:31.695669 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4791343f-ce5f-406b-bf05-c28f58716842 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:31.696433 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4791343f-ce5f-406b-bf05-c28f58716842 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:31.696926 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4791343f-ce5f-406b-bf05-c28f58716842 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:31.698059 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4791343f-ce5f-406b-bf05-c28f58716842 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:31.698727 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4791343f-ce5f-406b-bf05-c28f58716842 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:31.701864 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4791343f-ce5f-406b-bf05-c28f58716842 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:31.734463 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a4ffc057-dee7-4c3d-962d-f5ef11d06b03 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:31.744411 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a4ffc057-dee7-4c3d-962d-f5ef11d06b03 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355" status: 200 len: 1478 microversion: 2.1 time: 0.353461 Aug 07 01:28:31.745711 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1963/3590] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:31 2022] GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355 => generated 1478 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:31.777544 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-92184626-b5bb-4cd8-87ad-193baa76c918 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:31.800565 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-92184626-b5bb-4cd8-87ad-193baa76c918 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:31.819642 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92184626-b5bb-4cd8-87ad-193baa76c918 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:31.824430 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92184626-b5bb-4cd8-87ad-193baa76c918 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:31.825562 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92184626-b5bb-4cd8-87ad-193baa76c918 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:31.826403 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92184626-b5bb-4cd8-87ad-193baa76c918 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:31.827423 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92184626-b5bb-4cd8-87ad-193baa76c918 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:31.828830 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92184626-b5bb-4cd8-87ad-193baa76c918 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:32.021844 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-92184626-b5bb-4cd8-87ad-193baa76c918 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:32.036777 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-92184626-b5bb-4cd8-87ad-193baa76c918 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1498 microversion: 2.1 time: 0.263064 Aug 07 01:28:32.037376 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1964/3591] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:31 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1498 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:32.042196 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ce635706-ed39-4e2c-a40d-2c45659ac424 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-25833113"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:32.044739 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ce635706-ed39-4e2c-a40d-2c45659ac424 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: ce6c308a-7eb4-429f-ac41-9be9c4059355] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:32.051792 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce635706-ed39-4e2c-a40d-2c45659ac424 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:32.052343 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce635706-ed39-4e2c-a40d-2c45659ac424 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:32.052789 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce635706-ed39-4e2c-a40d-2c45659ac424 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:32.053725 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce635706-ed39-4e2c-a40d-2c45659ac424 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:32.054359 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce635706-ed39-4e2c-a40d-2c45659ac424 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:32.054802 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce635706-ed39-4e2c-a40d-2c45659ac424 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:32.102346 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4791343f-ce5f-406b-bf05-c28f58716842 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:32.112562 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4791343f-ce5f-406b-bf05-c28f58716842 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1677 microversion: 2.1 time: 0.451128 Aug 07 01:28:32.116423 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1628/3592] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:31 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1677 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:32.124422 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-293b7144-bb01-45a4-b702-bd1410bd1e20 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:32.125310 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-293b7144-bb01-45a4-b702-bd1410bd1e20 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 19784b1a-63aa-44b2-bbd5-d8dda713efdd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:32.132735 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-293b7144-bb01-45a4-b702-bd1410bd1e20 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:32.133476 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-293b7144-bb01-45a4-b702-bd1410bd1e20 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:32.134076 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-293b7144-bb01-45a4-b702-bd1410bd1e20 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:32.135087 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-293b7144-bb01-45a4-b702-bd1410bd1e20 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:32.136157 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-293b7144-bb01-45a4-b702-bd1410bd1e20 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:32.136688 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-293b7144-bb01-45a4-b702-bd1410bd1e20 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:32.175740 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-293b7144-bb01-45a4-b702-bd1410bd1e20 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:32.176366 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-293b7144-bb01-45a4-b702-bd1410bd1e20 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:32.176957 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-293b7144-bb01-45a4-b702-bd1410bd1e20 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:32.177530 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-293b7144-bb01-45a4-b702-bd1410bd1e20 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lazy-loading 'fault' on Instance uuid 19784b1a-63aa-44b2-bbd5-d8dda713efdd {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:28:32.234704 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-293b7144-bb01-45a4-b702-bd1410bd1e20 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:32.246227 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-293b7144-bb01-45a4-b702-bd1410bd1e20 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd" status: 200 len: 1307 microversion: 2.1 time: 0.127872 Aug 07 01:28:32.247060 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1629/3593] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:32 2022] GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd => generated 1307 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:32.252686 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c36682c0-5b08-4abb-ae49-bf80487f5b8c tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:32.255298 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c36682c0-5b08-4abb-ae49-bf80487f5b8c tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:32.264772 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c36682c0-5b08-4abb-ae49-bf80487f5b8c tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:32.265420 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c36682c0-5b08-4abb-ae49-bf80487f5b8c tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:32.265953 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c36682c0-5b08-4abb-ae49-bf80487f5b8c tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:32.267027 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c36682c0-5b08-4abb-ae49-bf80487f5b8c tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:32.267285 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c36682c0-5b08-4abb-ae49-bf80487f5b8c tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:32.268321 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c36682c0-5b08-4abb-ae49-bf80487f5b8c tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:32.274971 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ce635706-ed39-4e2c-a40d-2c45659ac424 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "POST /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355/action" status: 202 len: 0 microversion: 2.1 time: 0.236275 Aug 07 01:28:32.275977 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1965/3594] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:28:32 2022] POST /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 07 01:28:32.287946 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-39f4aaa5-e293-4851-b8cb-9af05af454b9 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e2401a8b0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:32.304567 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-c36682c0-5b08-4abb-ae49-bf80487f5b8c tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lazy-loading 'flavor' on Instance uuid 92e64da4-c05c-4bdc-a42c-7fbb858c846a {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:28:32.368623 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-39f4aaa5-e293-4851-b8cb-9af05af454b9 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453" status: 200 len: 1438 microversion: 2.1 time: 0.085274 Aug 07 01:28:32.370101 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1966/3595] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:28:32 2022] GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453 => generated 1438 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:28:32.414767 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5a66342d-981e-43cd-a217-d56f2c08014f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:32.415655 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5a66342d-981e-43cd-a217-d56f2c08014f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6d4bf33c-473a-445e-8194-29cbf0b4f1ac] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:32.423317 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a66342d-981e-43cd-a217-d56f2c08014f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:32.423808 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a66342d-981e-43cd-a217-d56f2c08014f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:32.424580 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a66342d-981e-43cd-a217-d56f2c08014f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:32.425481 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a66342d-981e-43cd-a217-d56f2c08014f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:32.426174 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a66342d-981e-43cd-a217-d56f2c08014f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:32.426929 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a66342d-981e-43cd-a217-d56f2c08014f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:32.436720 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c36682c0-5b08-4abb-ae49-bf80487f5b8c tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "POST /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a/action" status: 200 len: 32 microversion: 2.1 time: 0.188010 Aug 07 01:28:32.437347 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1630/3596] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:28:32 2022] POST /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a/action => generated 32 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:28:32.447596 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8402f37b-2144-4f53-a164-d2222faf98a3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:32.448507 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8402f37b-2144-4f53-a164-d2222faf98a3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:32.455710 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8402f37b-2144-4f53-a164-d2222faf98a3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:32.456243 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8402f37b-2144-4f53-a164-d2222faf98a3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:32.456687 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8402f37b-2144-4f53-a164-d2222faf98a3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:32.457405 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8402f37b-2144-4f53-a164-d2222faf98a3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:32.457866 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8402f37b-2144-4f53-a164-d2222faf98a3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:32.458327 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8402f37b-2144-4f53-a164-d2222faf98a3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:32.613376 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5a66342d-981e-43cd-a217-d56f2c08014f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:32.629024 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5a66342d-981e-43cd-a217-d56f2c08014f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac" status: 200 len: 1501 microversion: 2.1 time: 0.220281 Aug 07 01:28:32.629760 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1967/3597] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:32 2022] GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac => generated 1501 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:28:32.651394 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-67b45848-00ec-4510-a248-952a897460f0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:32.652556 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-67b45848-00ec-4510-a248-952a897460f0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6d4bf33c-473a-445e-8194-29cbf0b4f1ac] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:32.659579 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67b45848-00ec-4510-a248-952a897460f0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:32.660215 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67b45848-00ec-4510-a248-952a897460f0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:32.660749 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67b45848-00ec-4510-a248-952a897460f0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:32.661540 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67b45848-00ec-4510-a248-952a897460f0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:32.662112 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67b45848-00ec-4510-a248-952a897460f0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:32.662613 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67b45848-00ec-4510-a248-952a897460f0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:32.742493 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-67b45848-00ec-4510-a248-952a897460f0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "POST /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac/action" status: 202 len: 0 microversion: 2.1 time: 0.094359 Aug 07 01:28:32.743440 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1968/3598] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:28:32 2022] POST /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 01:28:32.763049 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-025fd899-7efa-4d6e-9de6-bac8c66d0a18 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:32.765494 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-025fd899-7efa-4d6e-9de6-bac8c66d0a18 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6d4bf33c-473a-445e-8194-29cbf0b4f1ac] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:32.779422 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-025fd899-7efa-4d6e-9de6-bac8c66d0a18 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:32.782704 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-025fd899-7efa-4d6e-9de6-bac8c66d0a18 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:32.783334 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-025fd899-7efa-4d6e-9de6-bac8c66d0a18 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:32.784361 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-025fd899-7efa-4d6e-9de6-bac8c66d0a18 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:32.788860 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-025fd899-7efa-4d6e-9de6-bac8c66d0a18 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:32.789769 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-025fd899-7efa-4d6e-9de6-bac8c66d0a18 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:32.866790 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8402f37b-2144-4f53-a164-d2222faf98a3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:32.875203 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8402f37b-2144-4f53-a164-d2222faf98a3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1504 microversion: 2.1 time: 0.431888 Aug 07 01:28:32.876430 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1631/3599] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:32 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1504 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:28:33.133117 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-025fd899-7efa-4d6e-9de6-bac8c66d0a18 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:33.138165 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6e31aa35-93e4-46ad-8edc-ecefc38077c2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:33.139650 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6e31aa35-93e4-46ad-8edc-ecefc38077c2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:33.149087 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-025fd899-7efa-4d6e-9de6-bac8c66d0a18 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac" status: 200 len: 1506 microversion: 2.1 time: 0.400203 Aug 07 01:28:33.149687 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1969/3600] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:32 2022] GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac => generated 1506 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:33.167616 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6e31aa35-93e4-46ad-8edc-ecefc38077c2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:33.168426 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6e31aa35-93e4-46ad-8edc-ecefc38077c2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:33.169628 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6e31aa35-93e4-46ad-8edc-ecefc38077c2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:33.170957 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6e31aa35-93e4-46ad-8edc-ecefc38077c2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:33.171878 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6e31aa35-93e4-46ad-8edc-ecefc38077c2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:33.172551 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6e31aa35-93e4-46ad-8edc-ecefc38077c2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:33.267595 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7a4f39f9-a480-4b5a-89de-f851d9756a0f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:33.268655 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7a4f39f9-a480-4b5a-89de-f851d9756a0f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 19784b1a-63aa-44b2-bbd5-d8dda713efdd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:33.292903 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7a4f39f9-a480-4b5a-89de-f851d9756a0f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:33.294376 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7a4f39f9-a480-4b5a-89de-f851d9756a0f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:33.295042 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7a4f39f9-a480-4b5a-89de-f851d9756a0f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:33.296063 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7a4f39f9-a480-4b5a-89de-f851d9756a0f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:33.296783 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7a4f39f9-a480-4b5a-89de-f851d9756a0f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:33.297451 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7a4f39f9-a480-4b5a-89de-f851d9756a0f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:33.320957 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-7a4f39f9-a480-4b5a-89de-f851d9756a0f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] HTTP exception thrown: Instance 19784b1a-63aa-44b2-bbd5-d8dda713efdd could not be found. Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7a4f39f9-a480-4b5a-89de-f851d9756a0f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd HTTP/1.1 Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 19784b1a-63aa-44b2-bbd5-d8dda713efdd could not be found. Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '19784b1a-63aa-44b2-bbd5-d8dda713efdd'} Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19784b1a-63aa-44b2-bbd5-d8dda713efdd could not be found. Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19784b1a-63aa-44b2-bbd5-d8dda713efdd could not be found. Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:33.323216 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:33.327896 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:33.327896 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:33.327896 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:33.327896 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:28:33.327896 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:28:33.327896 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19784b1a-63aa-44b2-bbd5-d8dda713efdd could not be found. Aug 07 01:28:33.327896 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:33.330161 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7a4f39f9-a480-4b5a-89de-f851d9756a0f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 404 to user: Instance 19784b1a-63aa-44b2-bbd5-d8dda713efdd could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:28:33.331279 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7a4f39f9-a480-4b5a-89de-f851d9756a0f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd" status: 404 len: 111 microversion: 2.1 time: 0.067660 Aug 07 01:28:33.332634 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1970/3601] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:33 2022] GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:28:33.342445 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1967da33-a076-4479-ae2f-081d85618334 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:33.343648 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1967da33-a076-4479-ae2f-081d85618334 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:33.351138 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1967da33-a076-4479-ae2f-081d85618334 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:33.352088 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1967da33-a076-4479-ae2f-081d85618334 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:33.352806 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1967da33-a076-4479-ae2f-081d85618334 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:33.354012 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1967da33-a076-4479-ae2f-081d85618334 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:33.354721 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1967da33-a076-4479-ae2f-081d85618334 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:33.355838 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1967da33-a076-4479-ae2f-081d85618334 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:33.516030 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6e31aa35-93e4-46ad-8edc-ecefc38077c2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:33.526929 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6e31aa35-93e4-46ad-8edc-ecefc38077c2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1677 microversion: 2.1 time: 0.394412 Aug 07 01:28:33.528246 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1632/3602] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:33 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1677 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:33.533616 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3a3b6886-3307-4865-96a2-934f82d3ca0f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e24018430>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:33.592719 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3a3b6886-3307-4865-96a2-934f82d3ca0f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453" status: 200 len: 1438 microversion: 2.1 time: 0.063058 Aug 07 01:28:33.593896 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1633/3603] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:28:33 2022] GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453 => generated 1438 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:33.735106 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1967da33-a076-4479-ae2f-081d85618334 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:33.757009 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1967da33-a076-4479-ae2f-081d85618334 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.418993 Aug 07 01:28:33.758859 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1971/3604] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:33 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:28:33.842422 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ebb51c69-3ca6-448f-aa59-70834d8bf628 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "cf9a6ffb-a1bc-4f16-8970-9d69635f8f75"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ebb51c69-3ca6-448f-aa59-70834d8bf628 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 163 Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: {"server": {"name": 12345, "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "cf9a6ffb-a1bc-4f16-8970-9d69635f8f75"}]}} Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'e825bd61-bf05-4bd4-aa72-78daf2231731', 'flavorRef': '452', 'networks': [{'uuid': 'cf9a6ffb-a1bc-4f16-8970-9d69635f8f75'}]}}} Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi 12345 Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:28:33.846655 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:28:33.861006 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:28:33.861006 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 07 01:28:33.861006 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:33.861006 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:33.861006 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:33.861006 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:33.861006 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:33.861006 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:33.861006 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:28:33.861006 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:28:33.861006 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 07 01:28:33.861006 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:33.861006 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ebb51c69-3ca6-448f-aa59-70834d8bf628 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:28:33.861006 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ebb51c69-3ca6-448f-aa59-70834d8bf628 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.010626 Aug 07 01:28:33.861006 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1634/3605] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:28:33 2022] POST /compute/v2.1/servers => generated 127 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 07 01:28:33.864834 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-da30c300-340c-4d7d-93da-dd9b88b459c3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:33.864834 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-da30c300-340c-4d7d-93da-dd9b88b459c3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:33.884362 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da30c300-340c-4d7d-93da-dd9b88b459c3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:33.885148 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da30c300-340c-4d7d-93da-dd9b88b459c3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:33.885640 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da30c300-340c-4d7d-93da-dd9b88b459c3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:33.886532 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da30c300-340c-4d7d-93da-dd9b88b459c3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:33.887995 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da30c300-340c-4d7d-93da-dd9b88b459c3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:33.888518 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da30c300-340c-4d7d-93da-dd9b88b459c3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:33.901136 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9eab9496-5180-46e8-9ceb-392c84fd1834 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:33.901795 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9eab9496-5180-46e8-9ceb-392c84fd1834 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:33.909813 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9eab9496-5180-46e8-9ceb-392c84fd1834 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:33.910379 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9eab9496-5180-46e8-9ceb-392c84fd1834 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:33.911545 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9eab9496-5180-46e8-9ceb-392c84fd1834 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:33.912405 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9eab9496-5180-46e8-9ceb-392c84fd1834 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:33.912848 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9eab9496-5180-46e8-9ceb-392c84fd1834 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:33.914339 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9eab9496-5180-46e8-9ceb-392c84fd1834 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:34.245717 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9eab9496-5180-46e8-9ceb-392c84fd1834 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:34.255534 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9eab9496-5180-46e8-9ceb-392c84fd1834 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1504 microversion: 2.1 time: 0.362266 Aug 07 01:28:34.255995 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1635/3606] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:33 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1504 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:34.260671 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-73462492-92b8-4331-9f4d-d9cbb4d40900 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:34.261285 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-73462492-92b8-4331-9f4d-d9cbb4d40900 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6d4bf33c-473a-445e-8194-29cbf0b4f1ac] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:34.269205 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-73462492-92b8-4331-9f4d-d9cbb4d40900 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:34.269682 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-73462492-92b8-4331-9f4d-d9cbb4d40900 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:34.270121 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-73462492-92b8-4331-9f4d-d9cbb4d40900 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:34.270832 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-73462492-92b8-4331-9f4d-d9cbb4d40900 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:34.271569 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-73462492-92b8-4331-9f4d-d9cbb4d40900 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:34.272300 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-73462492-92b8-4331-9f4d-d9cbb4d40900 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:34.480663 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-73462492-92b8-4331-9f4d-d9cbb4d40900 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:34.494298 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-73462492-92b8-4331-9f4d-d9cbb4d40900 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac" status: 200 len: 1486 microversion: 2.1 time: 0.237051 Aug 07 01:28:34.495307 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1636/3607] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:34 2022] GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac => generated 1486 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:34.499843 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-da30c300-340c-4d7d-93da-dd9b88b459c3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:34.519232 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-dc509bb0-d30a-4bc1-978b-979eded8a8cc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:34.520252 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-dc509bb0-d30a-4bc1-978b-979eded8a8cc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6d4bf33c-473a-445e-8194-29cbf0b4f1ac] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:34.528314 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dc509bb0-d30a-4bc1-978b-979eded8a8cc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:34.529080 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dc509bb0-d30a-4bc1-978b-979eded8a8cc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:34.529793 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dc509bb0-d30a-4bc1-978b-979eded8a8cc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:34.530716 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dc509bb0-d30a-4bc1-978b-979eded8a8cc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:34.531213 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dc509bb0-d30a-4bc1-978b-979eded8a8cc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:34.531648 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dc509bb0-d30a-4bc1-978b-979eded8a8cc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:34.532185 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-da30c300-340c-4d7d-93da-dd9b88b459c3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.675946 Aug 07 01:28:34.534757 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1972/3608] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:33 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:34.559097 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-683ec2e1-3192-4cf0-be47-f0e1d3356ca9 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:34.560338 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-683ec2e1-3192-4cf0-be47-f0e1d3356ca9 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:34.568737 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-dc509bb0-d30a-4bc1-978b-979eded8a8cc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6d4bf33c-473a-445e-8194-29cbf0b4f1ac] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:28:34.579646 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-683ec2e1-3192-4cf0-be47-f0e1d3356ca9 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:34.583403 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-683ec2e1-3192-4cf0-be47-f0e1d3356ca9 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:34.586294 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-683ec2e1-3192-4cf0-be47-f0e1d3356ca9 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:34.587097 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-683ec2e1-3192-4cf0-be47-f0e1d3356ca9 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:34.587586 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-683ec2e1-3192-4cf0-be47-f0e1d3356ca9 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:34.591836 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-683ec2e1-3192-4cf0-be47-f0e1d3356ca9 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:34.623318 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=4,nova_cell1:UPDATE=7 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:34.707165 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-dc509bb0-d30a-4bc1-978b-979eded8a8cc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac" status: 204 len: 0 microversion: 2.1 time: 0.192126 Aug 07 01:28:34.711668 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1637/3609] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:28:34 2022] DELETE /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 07 01:28:34.722000 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d640ea16-42f4-4c25-8714-b312898aba9d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:34.722879 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d640ea16-42f4-4c25-8714-b312898aba9d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:34.729689 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d640ea16-42f4-4c25-8714-b312898aba9d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:34.731218 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d640ea16-42f4-4c25-8714-b312898aba9d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:34.731218 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d640ea16-42f4-4c25-8714-b312898aba9d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:34.732061 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d640ea16-42f4-4c25-8714-b312898aba9d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:34.733432 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d640ea16-42f4-4c25-8714-b312898aba9d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:34.733990 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d640ea16-42f4-4c25-8714-b312898aba9d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:34.845470 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-683ec2e1-3192-4cf0-be47-f0e1d3356ca9 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:34.849906 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:34.859084 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-683ec2e1-3192-4cf0-be47-f0e1d3356ca9 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1677 microversion: 2.1 time: 0.310784 Aug 07 01:28:34.859782 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1973/3610] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:34 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1677 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:34.864554 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-81979b3f-f3ee-42cc-b259-8fcc4b53a4cf tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e177e68b0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:34.945912 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-81979b3f-f3ee-42cc-b259-8fcc4b53a4cf tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453" status: 200 len: 1438 microversion: 2.1 time: 0.084738 Aug 07 01:28:34.954277 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1974/3611] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:28:34 2022] GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453 => generated 1438 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:34.958431 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-086ae50b-a913-4743-a2bf-80ac9b66389c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:34.959319 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-086ae50b-a913-4743-a2bf-80ac9b66389c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6d4bf33c-473a-445e-8194-29cbf0b4f1ac] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:34.995113 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-086ae50b-a913-4743-a2bf-80ac9b66389c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:34.996277 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-086ae50b-a913-4743-a2bf-80ac9b66389c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:34.997675 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-086ae50b-a913-4743-a2bf-80ac9b66389c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:34.998735 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-086ae50b-a913-4743-a2bf-80ac9b66389c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:34.999511 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-086ae50b-a913-4743-a2bf-80ac9b66389c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:35.000836 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-086ae50b-a913-4743-a2bf-80ac9b66389c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:35.040251 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d640ea16-42f4-4c25-8714-b312898aba9d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:35.054616 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d640ea16-42f4-4c25-8714-b312898aba9d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.341379 Aug 07 01:28:35.055938 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1638/3612] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:34 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:35.209680 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-086ae50b-a913-4743-a2bf-80ac9b66389c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:35.220349 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-086ae50b-a913-4743-a2bf-80ac9b66389c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac" status: 200 len: 1492 microversion: 2.1 time: 0.269655 Aug 07 01:28:35.232607 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1975/3613] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:34 2022] GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac => generated 1492 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:35.278200 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c2eb7660-ddf6-4d05-b548-b62a2c8954d5 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:35.279826 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c2eb7660-ddf6-4d05-b548-b62a2c8954d5 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:35.289014 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2eb7660-ddf6-4d05-b548-b62a2c8954d5 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:35.291322 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2eb7660-ddf6-4d05-b548-b62a2c8954d5 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:35.292157 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2eb7660-ddf6-4d05-b548-b62a2c8954d5 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:35.293181 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2eb7660-ddf6-4d05-b548-b62a2c8954d5 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:35.294460 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2eb7660-ddf6-4d05-b548-b62a2c8954d5 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:35.295188 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2eb7660-ddf6-4d05-b548-b62a2c8954d5 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:35.599999 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c2eb7660-ddf6-4d05-b548-b62a2c8954d5 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:35.611040 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c2eb7660-ddf6-4d05-b548-b62a2c8954d5 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1504 microversion: 2.1 time: 0.336485 Aug 07 01:28:35.612722 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1639/3614] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:35 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1504 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:35.889236 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b6f0105d-046a-425e-b05a-0a96f80606d3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:35.890232 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b6f0105d-046a-425e-b05a-0a96f80606d3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:35.905431 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b6f0105d-046a-425e-b05a-0a96f80606d3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:35.908998 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b6f0105d-046a-425e-b05a-0a96f80606d3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:35.910534 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b6f0105d-046a-425e-b05a-0a96f80606d3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:35.911293 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b6f0105d-046a-425e-b05a-0a96f80606d3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:35.920129 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b6f0105d-046a-425e-b05a-0a96f80606d3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:35.921190 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b6f0105d-046a-425e-b05a-0a96f80606d3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:35.965172 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d24c01e1-2605-46a3-a85c-74108780fe6e tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e24383e50>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:36.036456 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d24c01e1-2605-46a3-a85c-74108780fe6e tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453" status: 200 len: 1438 microversion: 2.1 time: 0.077658 Aug 07 01:28:36.036944 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1640/3615] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:28:35 2022] GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453 => generated 1438 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:28:36.240617 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b6f0105d-046a-425e-b05a-0a96f80606d3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:36.245273 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d89e7131-9dc5-48a4-9cf8-5c1060a27983 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:36.245273 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d89e7131-9dc5-48a4-9cf8-5c1060a27983 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6d4bf33c-473a-445e-8194-29cbf0b4f1ac] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:36.257265 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d89e7131-9dc5-48a4-9cf8-5c1060a27983 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:36.257760 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d89e7131-9dc5-48a4-9cf8-5c1060a27983 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:36.258421 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d89e7131-9dc5-48a4-9cf8-5c1060a27983 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:36.259487 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d89e7131-9dc5-48a4-9cf8-5c1060a27983 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:36.260138 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b6f0105d-046a-425e-b05a-0a96f80606d3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1677 microversion: 2.1 time: 0.382401 Aug 07 01:28:36.260309 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d89e7131-9dc5-48a4-9cf8-5c1060a27983 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:36.266481 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1976/3616] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:35 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1677 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:36.275654 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d89e7131-9dc5-48a4-9cf8-5c1060a27983 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:36.501270 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d89e7131-9dc5-48a4-9cf8-5c1060a27983 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:36.517423 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d89e7131-9dc5-48a4-9cf8-5c1060a27983 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac" status: 200 len: 1492 microversion: 2.1 time: 0.277675 Aug 07 01:28:36.518669 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1641/3617] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:36 2022] GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac => generated 1492 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:28:36.634178 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-71e43bf4-78c4-4a92-b2be-52eed8f979a0 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:36.635214 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-71e43bf4-78c4-4a92-b2be-52eed8f979a0 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:36.646799 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-71e43bf4-78c4-4a92-b2be-52eed8f979a0 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:36.653620 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-71e43bf4-78c4-4a92-b2be-52eed8f979a0 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:36.654459 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-71e43bf4-78c4-4a92-b2be-52eed8f979a0 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:36.655706 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-71e43bf4-78c4-4a92-b2be-52eed8f979a0 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:36.656468 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-71e43bf4-78c4-4a92-b2be-52eed8f979a0 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:36.657135 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-71e43bf4-78c4-4a92-b2be-52eed8f979a0 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:37.032462 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-71e43bf4-78c4-4a92-b2be-52eed8f979a0 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:37.045866 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-71e43bf4-78c4-4a92-b2be-52eed8f979a0 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1504 microversion: 2.1 time: 0.415462 Aug 07 01:28:37.046464 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1977/3618] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:36 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1504 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:28:37.069652 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f0c6d6f2-1720-48e1-a76a-a7bbf6389a30 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e2401b0d0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:37.146903 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f0c6d6f2-1720-48e1-a76a-a7bbf6389a30 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453" status: 200 len: 1438 microversion: 2.1 time: 0.080831 Aug 07 01:28:37.148234 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-418b2175-5ca8-469a-9fe8-dc7b15f5537e req-163a4690-c7d6-4d89-afab-d7c30b5c052e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce6c308a-7eb4-429f-ac41-9be9c4059355", "name": "network-vif-plugged", "status": "completed", "tag": "5948aeb6-19cc-4823-b3f6-0002d62e04ea"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:37.148731 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1642/3619] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:28:37 2022] GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453 => generated 1438 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:37.169376 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-418b2175-5ca8-469a-9fe8-dc7b15f5537e req-163a4690-c7d6-4d89-afab-d7c30b5c052e service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:37.170318 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-418b2175-5ca8-469a-9fe8-dc7b15f5537e req-163a4690-c7d6-4d89-afab-d7c30b5c052e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:37.171477 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-418b2175-5ca8-469a-9fe8-dc7b15f5537e req-163a4690-c7d6-4d89-afab-d7c30b5c052e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:37.193772 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-418b2175-5ca8-469a-9fe8-dc7b15f5537e req-163a4690-c7d6-4d89-afab-d7c30b5c052e service nova] Creating event network-vif-plugged:5948aeb6-19cc-4823-b3f6-0002d62e04ea for instance ce6c308a-7eb4-429f-ac41-9be9c4059355 on n-h1-master-1 Aug 07 01:28:37.200751 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-418b2175-5ca8-469a-9fe8-dc7b15f5537e req-163a4690-c7d6-4d89-afab-d7c30b5c052e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056907 Aug 07 01:28:37.202355 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1978/3620] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:28:37.286937 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-281ed5a6-ac1d-4957-a002-a736f5fd0d9a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:37.287930 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-281ed5a6-ac1d-4957-a002-a736f5fd0d9a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:37.302141 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-281ed5a6-ac1d-4957-a002-a736f5fd0d9a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:37.303022 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-281ed5a6-ac1d-4957-a002-a736f5fd0d9a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:37.311497 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-281ed5a6-ac1d-4957-a002-a736f5fd0d9a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:37.312630 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-281ed5a6-ac1d-4957-a002-a736f5fd0d9a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:37.313352 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-281ed5a6-ac1d-4957-a002-a736f5fd0d9a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:37.314018 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-281ed5a6-ac1d-4957-a002-a736f5fd0d9a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:37.545374 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b80817e9-0db5-453d-910b-03f1b429db7d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:37.550402 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b80817e9-0db5-453d-910b-03f1b429db7d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6d4bf33c-473a-445e-8194-29cbf0b4f1ac] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:37.570063 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b80817e9-0db5-453d-910b-03f1b429db7d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:37.570787 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b80817e9-0db5-453d-910b-03f1b429db7d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:37.575499 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b80817e9-0db5-453d-910b-03f1b429db7d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:37.576325 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b80817e9-0db5-453d-910b-03f1b429db7d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:37.576797 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b80817e9-0db5-453d-910b-03f1b429db7d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:37.577436 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b80817e9-0db5-453d-910b-03f1b429db7d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:37.722577 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b80817e9-0db5-453d-910b-03f1b429db7d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:37.756430 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b80817e9-0db5-453d-910b-03f1b429db7d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac" status: 200 len: 1450 microversion: 2.1 time: 0.219320 Aug 07 01:28:37.766360 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1979/3621] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:37 2022] GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac => generated 1450 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:37.788702 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-b5dbbf6a-a74e-46f1-a1e3-87f586514361 req-4037c3d3-39aa-48b8-8256-b8e21997c360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d4bf33c-473a-445e-8194-29cbf0b4f1ac", "name": "network-vif-deleted", "tag": "de308dbf-bd37-485b-bae4-307491eeaf18"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:37.808639 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b5dbbf6a-a74e-46f1-a1e3-87f586514361 req-4037c3d3-39aa-48b8-8256-b8e21997c360 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:37.809284 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b5dbbf6a-a74e-46f1-a1e3-87f586514361 req-4037c3d3-39aa-48b8-8256-b8e21997c360 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:37.809944 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b5dbbf6a-a74e-46f1-a1e3-87f586514361 req-4037c3d3-39aa-48b8-8256-b8e21997c360 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:37.829293 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-281ed5a6-ac1d-4957-a002-a736f5fd0d9a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:37.838114 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-b5dbbf6a-a74e-46f1-a1e3-87f586514361 req-4037c3d3-39aa-48b8-8256-b8e21997c360 service nova] Creating event network-vif-deleted:de308dbf-bd37-485b-bae4-307491eeaf18 for instance 6d4bf33c-473a-445e-8194-29cbf0b4f1ac on n-h1-master-1 Aug 07 01:28:37.848225 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-b5dbbf6a-a74e-46f1-a1e3-87f586514361 req-4037c3d3-39aa-48b8-8256-b8e21997c360 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078556 Aug 07 01:28:37.849099 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-281ed5a6-ac1d-4957-a002-a736f5fd0d9a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1677 microversion: 2.1 time: 0.555937 Aug 07 01:28:37.850409 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1980/3622] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:28:37.850701 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1643/3623] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:37 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1677 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:38.027137 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9497e7a4-e7df-48f4-85da-2095e60d580e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-378912805", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "ef19a904-2b09-4487-a55b-026f84d4240d", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "cf9a6ffb-a1bc-4f16-8970-9d69635f8f75"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:38.068102 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f456d9cc-29fb-4b75-9a59-8062764e08e8 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:38.069470 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f456d9cc-29fb-4b75-9a59-8062764e08e8 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:38.086632 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f456d9cc-29fb-4b75-9a59-8062764e08e8 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:38.087459 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f456d9cc-29fb-4b75-9a59-8062764e08e8 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:38.088152 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f456d9cc-29fb-4b75-9a59-8062764e08e8 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:38.090031 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f456d9cc-29fb-4b75-9a59-8062764e08e8 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:38.091437 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f456d9cc-29fb-4b75-9a59-8062764e08e8 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:38.092252 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f456d9cc-29fb-4b75-9a59-8062764e08e8 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:38.136774 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-9497e7a4-e7df-48f4-85da-2095e60d580e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] HTTP exception thrown: Block Device ef19a904-2b09-4487-a55b-026f84d4240d is not bootable. Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9497e7a4-e7df-48f4-85da-2095e60d580e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 357 Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-378912805", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "ef19a904-2b09-4487-a55b-026f84d4240d", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "cf9a6ffb-a1bc-4f16-8970-9d69635f8f75"}]}} Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: exception: Block Device ef19a904-2b09-4487-a55b-026f84d4240d is not bootable. Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-378912805', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'ef19a904-2b09-4487-a55b-026f84d4240d'}], 'networks': [{'uuid': 'cf9a6ffb-a1bc-4f16-8970-9d69635f8f75'}]}}} Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1624, in _create_instance Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device ef19a904-2b09-4487-a55b-026f84d4240d is not bootable. Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:28:38.147613 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:28:38.153914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:28:38.153914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:28:38.153914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:28:38.153914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 07 01:28:38.153914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 07 01:28:38.153914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 07 01:28:38.153914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device ef19a904-2b09-4487-a55b-026f84d4240d is not bootable. Aug 07 01:28:38.153914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:38.153914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:38.153914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:38.153914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:38.153914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:38.153914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:38.153914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:28:38.153914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:28:38.153914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device ef19a904-2b09-4487-a55b-026f84d4240d is not bootable. Aug 07 01:28:38.153914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:38.153914 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9497e7a4-e7df-48f4-85da-2095e60d580e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 400 to user: Block Device ef19a904-2b09-4487-a55b-026f84d4240d is not bootable. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:28:38.157727 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9497e7a4-e7df-48f4-85da-2095e60d580e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.133021 Aug 07 01:28:38.160363 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1981/3624] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:28:38 2022] POST /compute/v2.1/servers => generated 110 bytes in 140 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:28:38.176174 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-96d276ac-e2af-48c4-9df6-ea88c7ba3bc2 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e17aaf9d0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:38.293979 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-96d276ac-e2af-48c4-9df6-ea88c7ba3bc2 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453" status: 200 len: 1438 microversion: 2.1 time: 0.123192 Aug 07 01:28:38.304399 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1982/3625] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:28:38 2022] GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453 => generated 1438 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:38.311704 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b68709eb-eadf-43a4-9145-70eebc7ae9ef tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:38.312949 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b68709eb-eadf-43a4-9145-70eebc7ae9ef tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:38.328354 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b68709eb-eadf-43a4-9145-70eebc7ae9ef tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:38.329439 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b68709eb-eadf-43a4-9145-70eebc7ae9ef tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:38.330117 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b68709eb-eadf-43a4-9145-70eebc7ae9ef tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:38.331151 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b68709eb-eadf-43a4-9145-70eebc7ae9ef tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:38.331839 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b68709eb-eadf-43a4-9145-70eebc7ae9ef tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:38.332565 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b68709eb-eadf-43a4-9145-70eebc7ae9ef tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:38.551196 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f456d9cc-29fb-4b75-9a59-8062764e08e8 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:38.564233 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f456d9cc-29fb-4b75-9a59-8062764e08e8 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1504 microversion: 2.1 time: 0.496646 Aug 07 01:28:38.564917 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1644/3626] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:38 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1504 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:28:38.598864 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b68709eb-eadf-43a4-9145-70eebc7ae9ef tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:38.608479 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b68709eb-eadf-43a4-9145-70eebc7ae9ef tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.302551 Aug 07 01:28:38.613446 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1983/3627] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:38 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:38.644071 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fdedfd38-e765-4904-9187-50c9b0d9b98c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:38.644984 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fdedfd38-e765-4904-9187-50c9b0d9b98c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:38.651546 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fdedfd38-e765-4904-9187-50c9b0d9b98c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:38.659030 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fdedfd38-e765-4904-9187-50c9b0d9b98c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:38.659843 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fdedfd38-e765-4904-9187-50c9b0d9b98c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:38.660906 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fdedfd38-e765-4904-9187-50c9b0d9b98c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:38.661613 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fdedfd38-e765-4904-9187-50c9b0d9b98c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:38.662232 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fdedfd38-e765-4904-9187-50c9b0d9b98c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:38.783672 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0d2d6fa2-e5a6-4bf7-a24c-f9d982826d2e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:38.784596 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0d2d6fa2-e5a6-4bf7-a24c-f9d982826d2e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6d4bf33c-473a-445e-8194-29cbf0b4f1ac] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:38.797024 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0d2d6fa2-e5a6-4bf7-a24c-f9d982826d2e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:38.797863 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0d2d6fa2-e5a6-4bf7-a24c-f9d982826d2e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:38.801858 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0d2d6fa2-e5a6-4bf7-a24c-f9d982826d2e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:38.802800 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0d2d6fa2-e5a6-4bf7-a24c-f9d982826d2e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:38.803441 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0d2d6fa2-e5a6-4bf7-a24c-f9d982826d2e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:38.804083 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0d2d6fa2-e5a6-4bf7-a24c-f9d982826d2e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:38.840609 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-0d2d6fa2-e5a6-4bf7-a24c-f9d982826d2e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] HTTP exception thrown: Instance 6d4bf33c-473a-445e-8194-29cbf0b4f1ac could not be found. Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0d2d6fa2-e5a6-4bf7-a24c-f9d982826d2e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Request method failure captured: Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac HTTP/1.1 Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xRoqM1ZK4H7GtvmxWX9ofAmOsKF2OdU6k1rehi-6yk86CpmfTNVcE0kwd9G1ahgJHyDlEB2bKz4XbnD5Ku_zcl240Q-kfWeKv3HfC_GyXmFAQWa4hNXP2nUgxgBXBe_oBb5a-t1xlRXFxfo9n87AmGbLBI9ZdV03LZwWshVd2n0WvE Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5506f7c95c1a46c5b3966597764b0111", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: d1f0c01c340940388b440932d51988ff Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 6d4bf33c-473a-445e-8194-29cbf0b4f1ac could not be found. Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '6d4bf33c-473a-445e-8194-29cbf0b4f1ac'} Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d4bf33c-473a-445e-8194-29cbf0b4f1ac could not be found. Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d4bf33c-473a-445e-8194-29cbf0b4f1ac could not be found. Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:38.856308 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:38.861313 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:38.861313 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:38.861313 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:38.861313 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:28:38.861313 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:28:38.861313 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d4bf33c-473a-445e-8194-29cbf0b4f1ac could not be found. Aug 07 01:28:38.861313 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:38.864452 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0d2d6fa2-e5a6-4bf7-a24c-f9d982826d2e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Returning 404 to user: Instance 6d4bf33c-473a-445e-8194-29cbf0b4f1ac could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:28:38.865538 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0d2d6fa2-e5a6-4bf7-a24c-f9d982826d2e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac" status: 404 len: 111 microversion: 2.1 time: 0.087925 Aug 07 01:28:38.871266 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1984/3628] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:38 2022] GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:28:38.894105 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cfab36ef-00a6-4b8c-83b7-1e5791096c8a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:38.897672 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cfab36ef-00a6-4b8c-83b7-1e5791096c8a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:38.908885 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfab36ef-00a6-4b8c-83b7-1e5791096c8a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:38.909907 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfab36ef-00a6-4b8c-83b7-1e5791096c8a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:38.910567 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfab36ef-00a6-4b8c-83b7-1e5791096c8a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:38.911741 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfab36ef-00a6-4b8c-83b7-1e5791096c8a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:38.912457 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfab36ef-00a6-4b8c-83b7-1e5791096c8a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:38.913229 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfab36ef-00a6-4b8c-83b7-1e5791096c8a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:39.078995 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fdedfd38-e765-4904-9187-50c9b0d9b98c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:39.093499 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fdedfd38-e765-4904-9187-50c9b0d9b98c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.453168 Aug 07 01:28:39.094228 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1645/3629] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:38 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:39.104022 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-916b346a-09ee-4dcb-b594-eea57851645f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1614921366", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "554905b9-fa00-4877-bc90-609c81108292"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:39.218482 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-916b346a-09ee-4dcb-b594-eea57851645f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] validate_networks() for [('554905b9-fa00-4877-bc90-609c81108292', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:28:39.916719 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cfab36ef-00a6-4b8c-83b7-1e5791096c8a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:39.933341 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cfab36ef-00a6-4b8c-83b7-1e5791096c8a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1677 microversion: 2.1 time: 1.058087 Aug 07 01:28:39.936578 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1985/3630] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:38 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1677 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:39.943324 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-319f8f27-5333-4c91-9884-4c606f9cd167 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e17aafd30>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:40.032223 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-319f8f27-5333-4c91-9884-4c606f9cd167 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453" status: 200 len: 1438 microversion: 2.1 time: 0.094147 Aug 07 01:28:40.033517 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1986/3631] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:28:39 2022] GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453 => generated 1438 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:40.039654 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-92c461f3-8fe8-43b8-bf60-e1643f5d6ded tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:40.041458 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-92c461f3-8fe8-43b8-bf60-e1643f5d6ded tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:40.051803 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92c461f3-8fe8-43b8-bf60-e1643f5d6ded tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:40.053275 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92c461f3-8fe8-43b8-bf60-e1643f5d6ded tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:40.054775 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92c461f3-8fe8-43b8-bf60-e1643f5d6ded tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:40.058938 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92c461f3-8fe8-43b8-bf60-e1643f5d6ded tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:40.060554 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92c461f3-8fe8-43b8-bf60-e1643f5d6ded tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:40.062129 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92c461f3-8fe8-43b8-bf60-e1643f5d6ded tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:40.485112 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-92c461f3-8fe8-43b8-bf60-e1643f5d6ded tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:40.506744 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-92c461f3-8fe8-43b8-bf60-e1643f5d6ded tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1504 microversion: 2.1 time: 0.460448 Aug 07 01:28:40.509338 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1987/3632] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:40 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1504 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:40.959059 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0afe6045-c833-4454-b564-73d204818ec5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:40.963776 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0afe6045-c833-4454-b564-73d204818ec5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:40.990556 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0afe6045-c833-4454-b564-73d204818ec5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:40.991492 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0afe6045-c833-4454-b564-73d204818ec5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:40.995161 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0afe6045-c833-4454-b564-73d204818ec5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:40.996280 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0afe6045-c833-4454-b564-73d204818ec5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:40.997198 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0afe6045-c833-4454-b564-73d204818ec5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:40.998780 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0afe6045-c833-4454-b564-73d204818ec5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:41.341620 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0afe6045-c833-4454-b564-73d204818ec5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:41.343861 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-916b346a-09ee-4dcb-b594-eea57851645f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:28:41.344524 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-916b346a-09ee-4dcb-b594-eea57851645f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:28:41.344802 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-916b346a-09ee-4dcb-b594-eea57851645f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:28:41.345214 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-916b346a-09ee-4dcb-b594-eea57851645f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:28:41.346674 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-916b346a-09ee-4dcb-b594-eea57851645f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:28:41.352537 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0afe6045-c833-4454-b564-73d204818ec5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1677 microversion: 2.1 time: 0.398049 Aug 07 01:28:41.372488 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-916b346a-09ee-4dcb-b594-eea57851645f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:41.374550 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1988/3633] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:40 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1677 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:41.375817 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-916b346a-09ee-4dcb-b594-eea57851645f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:41.380739 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-916b346a-09ee-4dcb-b594-eea57851645f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:41.381776 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-916b346a-09ee-4dcb-b594-eea57851645f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:41.382456 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-916b346a-09ee-4dcb-b594-eea57851645f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:41.382823 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2590294a-b1e8-4f91-b114-ee5ccc08d5c0 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e17aaf430>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:41.384076 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-916b346a-09ee-4dcb-b594-eea57851645f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:41.442837 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-916b346a-09ee-4dcb-b594-eea57851645f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Getting quotas for project 5506f7c95c1a46c5b3966597764b0111. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:28:41.459536 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-916b346a-09ee-4dcb-b594-eea57851645f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Getting quotas for user d1f0c01c340940388b440932d51988ff and project 5506f7c95c1a46c5b3966597764b0111. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:28:41.482804 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-916b346a-09ee-4dcb-b594-eea57851645f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:28:41.485684 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-916b346a-09ee-4dcb-b594-eea57851645f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:28:41.487137 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2590294a-b1e8-4f91-b114-ee5ccc08d5c0 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453" status: 200 len: 1438 microversion: 2.1 time: 0.108268 Aug 07 01:28:41.488360 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1989/3634] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:28:41 2022] GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453 => generated 1438 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:41.573053 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2add5e79-8a2c-41ac-80d7-69ce74a6964d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:41.580394 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-916b346a-09ee-4dcb-b594-eea57851645f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.481725 Aug 07 01:28:41.581269 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1646/3635] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:28:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:28:41.584801 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2add5e79-8a2c-41ac-80d7-69ce74a6964d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:41.601388 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2add5e79-8a2c-41ac-80d7-69ce74a6964d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:41.602807 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2add5e79-8a2c-41ac-80d7-69ce74a6964d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:41.603975 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2add5e79-8a2c-41ac-80d7-69ce74a6964d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:41.605825 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2add5e79-8a2c-41ac-80d7-69ce74a6964d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:41.606555 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9e90a436-c341-46fd-91d6-f37a179bcce1 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:41.607213 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2add5e79-8a2c-41ac-80d7-69ce74a6964d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:41.607363 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9e90a436-c341-46fd-91d6-f37a179bcce1 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:41.608535 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2add5e79-8a2c-41ac-80d7-69ce74a6964d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:41.832508 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9e90a436-c341-46fd-91d6-f37a179bcce1 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:41.844502 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9e90a436-c341-46fd-91d6-f37a179bcce1 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1215 microversion: 2.1 time: 0.250215 Aug 07 01:28:41.864100 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1647/3636] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:41 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1215 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:41.941804 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-209de258-5669-4536-945f-3727294dee35 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-671320335", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "e825bd61-bf05-4bd4-aa72-78daf2231731", "destination_type": "local"}, {"source_type": "volume", "uuid": "0d28d575-8774-4eed-94d5-6c727e772133", "destination_type": "invalid"}], "networks": [{"uuid": "cf9a6ffb-a1bc-4f16-8970-9d69635f8f75"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-209de258-5669-4536-945f-3727294dee35 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 494 Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-671320335", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "e825bd61-bf05-4bd4-aa72-78daf2231731", "destination_type": "local"}, {"source_type": "volume", "uuid": "0d28d575-8774-4eed-94d5-6c727e772133", "destination_type": "invalid"}], "networks": [{"uuid": "cf9a6ffb-a1bc-4f16-8970-9d69635f8f75"}]}} Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-671320335', 'imageRef': 'e825bd61-bf05-4bd4-aa72-78daf2231731', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'e825bd61-bf05-4bd4-aa72-78daf2231731', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '0d28d575-8774-4eed-94d5-6c727e772133', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'cf9a6ffb-a1bc-4f16-8970-9d69635f8f75'}]}}} Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi 'invalid' Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:28:41.946667 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:28:41.958961 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:28:41.958961 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:28:41.958961 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:28:41.958961 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:28:41.958961 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:28:41.958961 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:28:41.958961 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:28:41.958961 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:28:41.958961 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:28:41.958961 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 07 01:28:41.958961 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:41.958961 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:41.958961 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:41.958961 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:41.958961 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:41.958961 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:41.958961 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:28:41.958961 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:28:41.958961 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 07 01:28:41.958961 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:41.958961 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-209de258-5669-4536-945f-3727294dee35 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:28:41.958961 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-209de258-5669-4536-945f-3727294dee35 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.011216 Aug 07 01:28:41.958961 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1648/3637] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:28:41 2022] POST /compute/v2.1/servers => generated 155 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 07 01:28:41.979997 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5664f32d-c67d-4b20-820a-2b277018828a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:41.982850 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5664f32d-c67d-4b20-820a-2b277018828a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:42.006147 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5664f32d-c67d-4b20-820a-2b277018828a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:42.006784 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5664f32d-c67d-4b20-820a-2b277018828a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:42.007388 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5664f32d-c67d-4b20-820a-2b277018828a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:42.008409 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5664f32d-c67d-4b20-820a-2b277018828a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:42.008726 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5664f32d-c67d-4b20-820a-2b277018828a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:42.009305 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5664f32d-c67d-4b20-820a-2b277018828a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:42.270604 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2add5e79-8a2c-41ac-80d7-69ce74a6964d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:42.288409 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2add5e79-8a2c-41ac-80d7-69ce74a6964d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1504 microversion: 2.1 time: 0.730464 Aug 07 01:28:42.290632 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1990/3638] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:41 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1504 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:28:42.380079 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-de027025-9b33-4e5e-bc69-751297d3f1a8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:42.381042 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-de027025-9b33-4e5e-bc69-751297d3f1a8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:42.401509 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-de027025-9b33-4e5e-bc69-751297d3f1a8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:42.402140 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-de027025-9b33-4e5e-bc69-751297d3f1a8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:42.403287 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-de027025-9b33-4e5e-bc69-751297d3f1a8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:42.412875 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-de027025-9b33-4e5e-bc69-751297d3f1a8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:42.417915 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-de027025-9b33-4e5e-bc69-751297d3f1a8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:42.427302 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-de027025-9b33-4e5e-bc69-751297d3f1a8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:42.541183 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5664f32d-c67d-4b20-820a-2b277018828a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:42.560805 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5664f32d-c67d-4b20-820a-2b277018828a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.598135 Aug 07 01:28:42.566256 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1649/3639] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:41 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:42.580657 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-647dce5b-e7de-40c4-8623-442433ec5d2b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e2409d1f0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:42.725233 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-647dce5b-e7de-40c4-8623-442433ec5d2b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453" status: 200 len: 1438 microversion: 2.1 time: 0.157415 Aug 07 01:28:42.726981 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1650/3640] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:28:42 2022] GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453 => generated 1438 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:42.738588 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e6588cb7-961c-4d16-bf7c-e834b22f88b6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:42.741256 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e6588cb7-961c-4d16-bf7c-e834b22f88b6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:42.754536 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e6588cb7-961c-4d16-bf7c-e834b22f88b6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:42.755475 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e6588cb7-961c-4d16-bf7c-e834b22f88b6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:42.756486 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e6588cb7-961c-4d16-bf7c-e834b22f88b6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:42.757950 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e6588cb7-961c-4d16-bf7c-e834b22f88b6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:42.758638 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e6588cb7-961c-4d16-bf7c-e834b22f88b6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:42.759280 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e6588cb7-961c-4d16-bf7c-e834b22f88b6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:42.994998 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-de027025-9b33-4e5e-bc69-751297d3f1a8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:43.008080 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-de027025-9b33-4e5e-bc69-751297d3f1a8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1654 microversion: 2.1 time: 0.633004 Aug 07 01:28:43.018518 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1991/3641] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:42 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1654 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:43.064956 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b76cf2dd-1530-4f08-83b2-8f0f21cc5d9c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:43.070904 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b76cf2dd-1530-4f08-83b2-8f0f21cc5d9c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:43.096035 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b76cf2dd-1530-4f08-83b2-8f0f21cc5d9c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:43.096674 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b76cf2dd-1530-4f08-83b2-8f0f21cc5d9c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:43.097208 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b76cf2dd-1530-4f08-83b2-8f0f21cc5d9c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:43.098967 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b76cf2dd-1530-4f08-83b2-8f0f21cc5d9c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:43.099686 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b76cf2dd-1530-4f08-83b2-8f0f21cc5d9c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:43.100474 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b76cf2dd-1530-4f08-83b2-8f0f21cc5d9c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:43.226682 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e6588cb7-961c-4d16-bf7c-e834b22f88b6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:43.241624 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e6588cb7-961c-4d16-bf7c-e834b22f88b6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.513269 Aug 07 01:28:43.252075 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1651/3642] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:42 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:43.267588 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b76cf2dd-1530-4f08-83b2-8f0f21cc5d9c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:43.287859 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-74477111-7dfa-4cda-a15b-6762d498212c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:43.289199 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b76cf2dd-1530-4f08-83b2-8f0f21cc5d9c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1211 microversion: 2.1 time: 0.269445 Aug 07 01:28:43.295250 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1992/3643] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:43 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1211 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:43.317537 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-74477111-7dfa-4cda-a15b-6762d498212c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:43.318032 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-74477111-7dfa-4cda-a15b-6762d498212c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:43.318476 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-74477111-7dfa-4cda-a15b-6762d498212c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:43.322780 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a7231a46-163c-4d37-9b01-6d4ece43cdab tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:43.324405 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a7231a46-163c-4d37-9b01-6d4ece43cdab tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:43.332894 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7231a46-163c-4d37-9b01-6d4ece43cdab tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:43.333815 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7231a46-163c-4d37-9b01-6d4ece43cdab tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:43.336542 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7231a46-163c-4d37-9b01-6d4ece43cdab tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:43.337607 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7231a46-163c-4d37-9b01-6d4ece43cdab tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:43.338260 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7231a46-163c-4d37-9b01-6d4ece43cdab tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:43.338757 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7231a46-163c-4d37-9b01-6d4ece43cdab tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:43.406537 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-74477111-7dfa-4cda-a15b-6762d498212c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Going to try to start instance {{(pid=119517) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 07 01:28:43.517616 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-74477111-7dfa-4cda-a15b-6762d498212c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action" status: 202 len: 0 microversion: 2.1 time: 0.261201 Aug 07 01:28:43.520578 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1652/3644] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:28:43 2022] POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:28:43.536682 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d2046524-509a-4a4c-85f7-69a105748f2f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1049156436", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "cf9a6ffb-a1bc-4f16-8970-9d69635f8f75"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d2046524-509a-4a4c-85f7-69a105748f2f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 492 Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1049156436", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "cf9a6ffb-a1bc-4f16-8970-9d69635f8f75"}]}} Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1049156436', 'imageRef': 'e825bd61-bf05-4bd4-aa72-78daf2231731', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'cf9a6ffb-a1bc-4f16-8970-9d69635f8f75'}]}}} Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:43.552871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 07 01:28:43.560791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 07 01:28:43.560791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:43.560791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:43.560791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:43.560791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:43.560791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:43.560791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:43.560791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:28:43.560791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:28:43.560791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:28:43.560791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:28:43.560791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:28:43.560791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:28:43.560791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:28:43.560791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:28:43.560791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:28:43.560791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:28:43.560791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:28:43.560791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:28:43.560791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 07 01:28:43.560791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:43.560791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:43.560791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:43.560791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:43.560791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:43.560791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:43.560791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:28:43.560791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:28:43.560791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 07 01:28:43.560791 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:43.570294 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d2046524-509a-4a4c-85f7-69a105748f2f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:28:43.570294 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d2046524-509a-4a4c-85f7-69a105748f2f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.046342 Aug 07 01:28:43.570294 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1653/3645] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:28:43 2022] POST /compute/v2.1/servers => generated 624 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:28:43.584752 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c14866ef-4ac4-4c9c-9acf-ff62b9de641c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:43.589208 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c14866ef-4ac4-4c9c-9acf-ff62b9de641c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:43.628994 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c14866ef-4ac4-4c9c-9acf-ff62b9de641c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:43.631237 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c14866ef-4ac4-4c9c-9acf-ff62b9de641c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:43.632406 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c14866ef-4ac4-4c9c-9acf-ff62b9de641c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:43.638053 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c14866ef-4ac4-4c9c-9acf-ff62b9de641c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:43.638558 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c14866ef-4ac4-4c9c-9acf-ff62b9de641c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:43.639057 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c14866ef-4ac4-4c9c-9acf-ff62b9de641c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:43.958298 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a7231a46-163c-4d37-9b01-6d4ece43cdab tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:43.987211 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a7231a46-163c-4d37-9b01-6d4ece43cdab tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1504 microversion: 2.1 time: 0.664220 Aug 07 01:28:43.991472 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1993/3646] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:43 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1504 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:28:44.022104 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ebf88e68-73de-4b0a-bb89-1102ceb25c9a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:44.023606 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ebf88e68-73de-4b0a-bb89-1102ceb25c9a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:44.034662 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ebf88e68-73de-4b0a-bb89-1102ceb25c9a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:44.035238 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ebf88e68-73de-4b0a-bb89-1102ceb25c9a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:44.035640 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ebf88e68-73de-4b0a-bb89-1102ceb25c9a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:44.036412 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ebf88e68-73de-4b0a-bb89-1102ceb25c9a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:44.036923 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ebf88e68-73de-4b0a-bb89-1102ceb25c9a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:44.037414 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ebf88e68-73de-4b0a-bb89-1102ceb25c9a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:44.344535 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c14866ef-4ac4-4c9c-9acf-ff62b9de641c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:44.357166 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c14866ef-4ac4-4c9c-9acf-ff62b9de641c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1663 microversion: 2.1 time: 0.786773 Aug 07 01:28:44.371993 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1654/3647] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:43 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1663 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:44.375077 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1460371e-4844-4c1e-869f-b7883386aa8b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e24882b80>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:44.467165 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1460371e-4844-4c1e-869f-b7883386aa8b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453" status: 200 len: 1438 microversion: 2.1 time: 0.104078 Aug 07 01:28:44.478656 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1655/3648] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:28:44 2022] GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453 => generated 1438 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:44.484043 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cedcd288-fa93-4769-8e73-4915f96c6f39 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:44.489245 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-cedcd288-fa93-4769-8e73-4915f96c6f39 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:44.508352 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ebf88e68-73de-4b0a-bb89-1102ceb25c9a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:44.518007 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cedcd288-fa93-4769-8e73-4915f96c6f39 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:44.521532 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cedcd288-fa93-4769-8e73-4915f96c6f39 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:44.524329 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ebf88e68-73de-4b0a-bb89-1102ceb25c9a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.529179 Aug 07 01:28:44.525032 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cedcd288-fa93-4769-8e73-4915f96c6f39 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:44.527243 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1994/3649] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:43 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:44.527683 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cedcd288-fa93-4769-8e73-4915f96c6f39 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:44.536834 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cedcd288-fa93-4769-8e73-4915f96c6f39 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:44.539266 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cedcd288-fa93-4769-8e73-4915f96c6f39 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:44.550694 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5887787d-e0d3-4ec4-8894-4804b962b194 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:44.551720 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5887787d-e0d3-4ec4-8894-4804b962b194 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:44.558326 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5887787d-e0d3-4ec4-8894-4804b962b194 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:44.559113 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5887787d-e0d3-4ec4-8894-4804b962b194 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:44.559766 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5887787d-e0d3-4ec4-8894-4804b962b194 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:44.560715 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5887787d-e0d3-4ec4-8894-4804b962b194 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:44.561383 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5887787d-e0d3-4ec4-8894-4804b962b194 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:44.562015 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5887787d-e0d3-4ec4-8894-4804b962b194 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:44.786484 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-cedcd288-fa93-4769-8e73-4915f96c6f39 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:44.795080 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cedcd288-fa93-4769-8e73-4915f96c6f39 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1273 microversion: 2.1 time: 0.315005 Aug 07 01:28:44.795878 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1656/3650] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:44 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1273 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:45.023005 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6a58e491-1f29-4638-917e-ef24b9636c0e tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:45.024294 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6a58e491-1f29-4638-917e-ef24b9636c0e tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:45.044912 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a58e491-1f29-4638-917e-ef24b9636c0e tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:45.046451 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a58e491-1f29-4638-917e-ef24b9636c0e tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:45.048061 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a58e491-1f29-4638-917e-ef24b9636c0e tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:45.055358 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a58e491-1f29-4638-917e-ef24b9636c0e tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:45.061893 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a58e491-1f29-4638-917e-ef24b9636c0e tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:45.090195 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a58e491-1f29-4638-917e-ef24b9636c0e tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:45.274230 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5887787d-e0d3-4ec4-8894-4804b962b194 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:45.296484 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5887787d-e0d3-4ec4-8894-4804b962b194 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.749364 Aug 07 01:28:45.321922 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1995/3651] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:44 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:28:45.388230 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-64702be8-5e23-42df-b9ce-1d84d00b72ed tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:45.389007 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-64702be8-5e23-42df-b9ce-1d84d00b72ed tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:45.400173 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64702be8-5e23-42df-b9ce-1d84d00b72ed tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:45.400654 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64702be8-5e23-42df-b9ce-1d84d00b72ed tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:45.401026 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64702be8-5e23-42df-b9ce-1d84d00b72ed tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:45.401749 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64702be8-5e23-42df-b9ce-1d84d00b72ed tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:45.402205 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64702be8-5e23-42df-b9ce-1d84d00b72ed tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:45.403210 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64702be8-5e23-42df-b9ce-1d84d00b72ed tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:45.968988 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-64702be8-5e23-42df-b9ce-1d84d00b72ed tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:46.000386 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-64702be8-5e23-42df-b9ce-1d84d00b72ed tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1663 microversion: 2.1 time: 0.614240 Aug 07 01:28:46.001319 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1996/3652] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:45 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1663 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:28:46.019716 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-75e32628-6cd5-4ec4-a93c-cd4bacba22fa tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "cf9a6ffb-a1bc-4f16-8970-9d69635f8f75"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-75e32628-6cd5-4ec4-a93c-cd4bacba22fa tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 416 Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "cf9a6ffb-a1bc-4f16-8970-9d69635f8f75"}]}} Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'e825bd61-bf05-4bd4-aa72-78daf2231731', 'flavorRef': '452', 'networks': [{'uuid': 'cf9a6ffb-a1bc-4f16-8970-9d69635f8f75'}]}}} Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:46.029486 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:46.033923 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:46.033923 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:46.033923 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:46.033923 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:46.033923 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:28:46.033923 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:28:46.033923 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:28:46.033923 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:28:46.033923 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:28:46.033923 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:28:46.033923 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:28:46.033923 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:28:46.033923 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:28:46.033923 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:28:46.033923 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:28:46.033923 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:28:46.033923 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 07 01:28:46.033923 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:46.033923 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:46.033923 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:46.033923 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:46.033923 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:46.033923 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:46.033923 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:28:46.033923 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:28:46.033923 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 07 01:28:46.033923 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:46.040611 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-75e32628-6cd5-4ec4-a93c-cd4bacba22fa tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:28:46.041803 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-75e32628-6cd5-4ec4-a93c-cd4bacba22fa tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.039019 Aug 07 01:28:46.044717 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1997/3653] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:28:46 2022] POST /compute/v2.1/servers => generated 619 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:28:46.059723 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a56b41d7-0e81-4d42-afe4-6393d55551f4 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e2401a820>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:46.141835 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6a58e491-1f29-4638-917e-ef24b9636c0e tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:46.161922 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6a58e491-1f29-4638-917e-ef24b9636c0e tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1504 microversion: 2.1 time: 1.141659 Aug 07 01:28:46.172157 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1657/3654] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:45 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1504 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:46.193215 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a56b41d7-0e81-4d42-afe4-6393d55551f4 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453" status: 200 len: 1438 microversion: 2.1 time: 0.146230 Aug 07 01:28:46.194264 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1998/3655] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:28:46 2022] GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453 => generated 1438 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:46.198827 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-238163ea-94d9-496d-8358-ec02594ddd3e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:46.199497 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-238163ea-94d9-496d-8358-ec02594ddd3e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:46.200807 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-da6a6eba-dbbf-44cc-bbe7-3fb955f7f7f3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:46.201481 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-da6a6eba-dbbf-44cc-bbe7-3fb955f7f7f3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:46.206623 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-238163ea-94d9-496d-8358-ec02594ddd3e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:46.207234 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-238163ea-94d9-496d-8358-ec02594ddd3e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:46.207675 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-238163ea-94d9-496d-8358-ec02594ddd3e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:46.220314 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-238163ea-94d9-496d-8358-ec02594ddd3e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:46.221336 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-238163ea-94d9-496d-8358-ec02594ddd3e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:46.222199 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-238163ea-94d9-496d-8358-ec02594ddd3e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:46.233729 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da6a6eba-dbbf-44cc-bbe7-3fb955f7f7f3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:46.234242 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da6a6eba-dbbf-44cc-bbe7-3fb955f7f7f3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:46.234704 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da6a6eba-dbbf-44cc-bbe7-3fb955f7f7f3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:46.235465 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da6a6eba-dbbf-44cc-bbe7-3fb955f7f7f3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:46.235961 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da6a6eba-dbbf-44cc-bbe7-3fb955f7f7f3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:46.236417 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da6a6eba-dbbf-44cc-bbe7-3fb955f7f7f3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:46.309629 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:46.769603 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-238163ea-94d9-496d-8358-ec02594ddd3e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:46.780646 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-238163ea-94d9-496d-8358-ec02594ddd3e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1273 microversion: 2.1 time: 0.611309 Aug 07 01:28:46.781550 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1658/3656] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:46 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1273 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:46.798323 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-da6a6eba-dbbf-44cc-bbe7-3fb955f7f7f3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:46.806565 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-da6a6eba-dbbf-44cc-bbe7-3fb955f7f7f3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.611258 Aug 07 01:28:46.807442 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 1999/3657] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:46 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:46.839169 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0156eefa-e0a6-4dec-a10c-e17e44a75527 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:46.842996 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0156eefa-e0a6-4dec-a10c-e17e44a75527 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:46.854240 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0156eefa-e0a6-4dec-a10c-e17e44a75527 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:46.855130 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0156eefa-e0a6-4dec-a10c-e17e44a75527 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:46.856095 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0156eefa-e0a6-4dec-a10c-e17e44a75527 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:46.857744 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0156eefa-e0a6-4dec-a10c-e17e44a75527 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:46.858460 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0156eefa-e0a6-4dec-a10c-e17e44a75527 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:46.859108 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0156eefa-e0a6-4dec-a10c-e17e44a75527 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:47.027058 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e073f85d-9b40-4761-a62f-4ce66d31d1b1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:47.028576 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e073f85d-9b40-4761-a62f-4ce66d31d1b1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:47.040711 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e073f85d-9b40-4761-a62f-4ce66d31d1b1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:47.041536 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e073f85d-9b40-4761-a62f-4ce66d31d1b1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:47.042311 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e073f85d-9b40-4761-a62f-4ce66d31d1b1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:47.045879 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e073f85d-9b40-4761-a62f-4ce66d31d1b1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:47.046360 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e073f85d-9b40-4761-a62f-4ce66d31d1b1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:47.046605 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e073f85d-9b40-4761-a62f-4ce66d31d1b1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:47.447397 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0156eefa-e0a6-4dec-a10c-e17e44a75527 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:47.500302 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0156eefa-e0a6-4dec-a10c-e17e44a75527 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.654315 Aug 07 01:28:47.504157 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1659/3658] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:46 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:47.520181 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3b0f6360-b886-4bf3-a88f-0c1ffdf1579c tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:47.521537 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3b0f6360-b886-4bf3-a88f-0c1ffdf1579c tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:47.532401 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b0f6360-b886-4bf3-a88f-0c1ffdf1579c tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:47.533222 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b0f6360-b886-4bf3-a88f-0c1ffdf1579c tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:47.534029 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b0f6360-b886-4bf3-a88f-0c1ffdf1579c tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:47.535111 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b0f6360-b886-4bf3-a88f-0c1ffdf1579c tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:47.535734 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b0f6360-b886-4bf3-a88f-0c1ffdf1579c tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:47.536339 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b0f6360-b886-4bf3-a88f-0c1ffdf1579c tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:47.575371 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:47.583445 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e073f85d-9b40-4761-a62f-4ce66d31d1b1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:47.623986 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e073f85d-9b40-4761-a62f-4ce66d31d1b1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1663 microversion: 2.1 time: 0.600173 Aug 07 01:28:47.630333 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2000/3659] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:47 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1663 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:47.651731 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0e9ec879-693a-49b4-9c3f-df1f5e449bfc tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e298c6f70>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:47.755776 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0e9ec879-693a-49b4-9c3f-df1f5e449bfc tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453" status: 200 len: 1438 microversion: 2.1 time: 0.112523 Aug 07 01:28:47.757478 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2001/3660] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:28:47 2022] GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453 => generated 1438 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:47.763454 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2e6e5d8a-eb94-4da3-b195-224bedbb252e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1402571559", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": -1, "networks": [{"uuid": "cf9a6ffb-a1bc-4f16-8970-9d69635f8f75"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:47.789702 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-2e6e5d8a-eb94-4da3-b195-224bedbb252e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] HTTP exception thrown: Flavor -1 could not be found. Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2e6e5d8a-eb94-4da3-b195-224bedbb252e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 206 Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1402571559", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": -1, "networks": [{"uuid": "cf9a6ffb-a1bc-4f16-8970-9d69635f8f75"}]}} Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: exception: Flavor -1 could not be found. Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1402571559', 'imageRef': 'e825bd61-bf05-4bd4-aa72-78daf2231731', 'flavorRef': -1, 'networks': [{'uuid': 'cf9a6ffb-a1bc-4f16-8970-9d69635f8f75'}]}}} Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:28:47.805995 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:28:47.812142 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:28:47.812142 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:28:47.812142 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:28:47.812142 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:28:47.812142 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 07 01:28:47.812142 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 07 01:28:47.812142 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 07 01:28:47.812142 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 07 01:28:47.812142 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:47.812142 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:47.812142 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:47.812142 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:47.812142 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:47.812142 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:47.812142 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:28:47.812142 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:28:47.812142 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 07 01:28:47.812142 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:47.814643 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2e6e5d8a-eb94-4da3-b195-224bedbb252e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:28:47.815696 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2e6e5d8a-eb94-4da3-b195-224bedbb252e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.057095 Aug 07 01:28:47.816815 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2002/3661] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:28:47 2022] POST /compute/v2.1/servers => generated 73 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 07 01:28:47.825190 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f0ea4588-e309-49cb-b004-216093d44cef tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:47.826156 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f0ea4588-e309-49cb-b004-216093d44cef tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:47.833886 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f0ea4588-e309-49cb-b004-216093d44cef tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:47.835355 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f0ea4588-e309-49cb-b004-216093d44cef tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:47.836085 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f0ea4588-e309-49cb-b004-216093d44cef tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:47.837002 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f0ea4588-e309-49cb-b004-216093d44cef tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:47.837649 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f0ea4588-e309-49cb-b004-216093d44cef tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:47.838270 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f0ea4588-e309-49cb-b004-216093d44cef tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:48.107103 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f0ea4588-e309-49cb-b004-216093d44cef tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:48.118329 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f0ea4588-e309-49cb-b004-216093d44cef tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1315 microversion: 2.1 time: 0.300197 Aug 07 01:28:48.124785 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2003/3662] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:47 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:48.130592 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f6299b6a-a0ec-4d4f-88e9-4bf14cad8138 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:48.133625 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f6299b6a-a0ec-4d4f-88e9-4bf14cad8138 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:48.152014 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f6299b6a-a0ec-4d4f-88e9-4bf14cad8138 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:48.156558 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f6299b6a-a0ec-4d4f-88e9-4bf14cad8138 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:48.157354 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f6299b6a-a0ec-4d4f-88e9-4bf14cad8138 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:48.158484 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f6299b6a-a0ec-4d4f-88e9-4bf14cad8138 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:48.159116 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f6299b6a-a0ec-4d4f-88e9-4bf14cad8138 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:48.159712 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f6299b6a-a0ec-4d4f-88e9-4bf14cad8138 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:48.236479 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3b0f6360-b886-4bf3-a88f-0c1ffdf1579c tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:48.245625 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3b0f6360-b886-4bf3-a88f-0c1ffdf1579c tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1504 microversion: 2.1 time: 0.739831 Aug 07 01:28:48.247562 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1660/3663] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:47 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1504 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:48.459833 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f6299b6a-a0ec-4d4f-88e9-4bf14cad8138 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:48.473962 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f6299b6a-a0ec-4d4f-88e9-4bf14cad8138 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.347435 Aug 07 01:28:48.475168 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2004/3664] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:48 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:48.501053 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fd17f0b9-c809-4d00-8e69-d8a5460e267e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:48.504558 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fd17f0b9-c809-4d00-8e69-d8a5460e267e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:48.512120 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd17f0b9-c809-4d00-8e69-d8a5460e267e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:48.512822 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd17f0b9-c809-4d00-8e69-d8a5460e267e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:48.513146 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd17f0b9-c809-4d00-8e69-d8a5460e267e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:48.513964 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd17f0b9-c809-4d00-8e69-d8a5460e267e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:48.514421 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd17f0b9-c809-4d00-8e69-d8a5460e267e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:48.514836 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd17f0b9-c809-4d00-8e69-d8a5460e267e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:48.646891 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f6848cc4-2456-4cad-b1d7-6ce1ed7c46eb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:48.647908 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f6848cc4-2456-4cad-b1d7-6ce1ed7c46eb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:48.660911 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f6848cc4-2456-4cad-b1d7-6ce1ed7c46eb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:48.661633 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f6848cc4-2456-4cad-b1d7-6ce1ed7c46eb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:48.662323 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f6848cc4-2456-4cad-b1d7-6ce1ed7c46eb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:48.663275 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f6848cc4-2456-4cad-b1d7-6ce1ed7c46eb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:48.664157 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f6848cc4-2456-4cad-b1d7-6ce1ed7c46eb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:48.664923 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f6848cc4-2456-4cad-b1d7-6ce1ed7c46eb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:49.146785 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fd17f0b9-c809-4d00-8e69-d8a5460e267e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:49.148928 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f6848cc4-2456-4cad-b1d7-6ce1ed7c46eb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:49.160978 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fd17f0b9-c809-4d00-8e69-d8a5460e267e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.665691 Aug 07 01:28:49.161479 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f6848cc4-2456-4cad-b1d7-6ce1ed7c46eb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1663 microversion: 2.1 time: 0.517077 Aug 07 01:28:49.162821 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2005/3665] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:48 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1663 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:49.168587 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-76c2e426-89ff-459f-ac98-7716a2573d01 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e298c61f0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:49.201860 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1661/3666] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:48 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:49.219023 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5b6a94cd-b989-4a8c-94b6-eeaac1f4d6e6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:49.220334 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5b6a94cd-b989-4a8c-94b6-eeaac1f4d6e6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:49.229786 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5b6a94cd-b989-4a8c-94b6-eeaac1f4d6e6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:49.230918 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5b6a94cd-b989-4a8c-94b6-eeaac1f4d6e6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:49.231557 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5b6a94cd-b989-4a8c-94b6-eeaac1f4d6e6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:49.233309 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5b6a94cd-b989-4a8c-94b6-eeaac1f4d6e6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:49.235963 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5b6a94cd-b989-4a8c-94b6-eeaac1f4d6e6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:49.236844 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5b6a94cd-b989-4a8c-94b6-eeaac1f4d6e6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:49.261539 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-76c2e426-89ff-459f-ac98-7716a2573d01 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453" status: 200 len: 1438 microversion: 2.1 time: 0.096864 Aug 07 01:28:49.261539 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2006/3667] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:28:49 2022] GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453 => generated 1438 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:49.276946 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f502249b-91aa-4019-a58c-41a777a70609 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:49.288477 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f502249b-91aa-4019-a58c-41a777a70609 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:49.295387 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f502249b-91aa-4019-a58c-41a777a70609 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:49.296238 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f502249b-91aa-4019-a58c-41a777a70609 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:49.296936 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f502249b-91aa-4019-a58c-41a777a70609 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:49.297836 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f502249b-91aa-4019-a58c-41a777a70609 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:49.301126 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f502249b-91aa-4019-a58c-41a777a70609 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:49.302013 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f502249b-91aa-4019-a58c-41a777a70609 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:49.657217 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f502249b-91aa-4019-a58c-41a777a70609 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:49.671622 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f502249b-91aa-4019-a58c-41a777a70609 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1504 microversion: 2.1 time: 0.398701 Aug 07 01:28:49.675112 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2007/3668] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:49 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1504 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:49.686626 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b49824cf-2e43-44ae-9fda-161dddc284c7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1587751631", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "cf9a6ffb-a1bc-4f16-8970-9d69635f8f75"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b49824cf-2e43-44ae-9fda-161dddc284c7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 173 Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1587751631", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "cf9a6ffb-a1bc-4f16-8970-9d69635f8f75"}]}} Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1587751631', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'cf9a6ffb-a1bc-4f16-8970-9d69635f8f75'}]}}} Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi -1 Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:28:49.696817 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:28:49.702424 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:28:49.702424 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:28:49.702424 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:28:49.702424 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 07 01:28:49.702424 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:49.702424 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:49.702424 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:49.702424 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:49.702424 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:49.702424 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:49.702424 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:28:49.702424 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:28:49.702424 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 07 01:28:49.702424 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:49.704452 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b49824cf-2e43-44ae-9fda-161dddc284c7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:28:49.705514 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b49824cf-2e43-44ae-9fda-161dddc284c7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.028338 Aug 07 01:28:49.706274 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2008/3669] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:28:49 2022] POST /compute/v2.1/servers => generated 145 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:28:49.715768 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-072d91b9-a542-4967-a7dd-cdb718f0d7a6 req-7d844839-abbf-4f76-a4a0-0c187a185935 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aacc9718-ff8d-4ef4-8380-7d863a4b5cd1", "tag": "6eee3035-8373-408c-81bd-fa491c09b2b5"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:49.726887 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-072d91b9-a542-4967-a7dd-cdb718f0d7a6 req-7d844839-abbf-4f76-a4a0-0c187a185935 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:49.727692 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-072d91b9-a542-4967-a7dd-cdb718f0d7a6 req-7d844839-abbf-4f76-a4a0-0c187a185935 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:49.728321 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-072d91b9-a542-4967-a7dd-cdb718f0d7a6 req-7d844839-abbf-4f76-a4a0-0c187a185935 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:49.740100 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-072d91b9-a542-4967-a7dd-cdb718f0d7a6 req-7d844839-abbf-4f76-a4a0-0c187a185935 service nova] Creating event network-changed:6eee3035-8373-408c-81bd-fa491c09b2b5 for instance aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 on n-h2-master-1 Aug 07 01:28:49.745899 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-072d91b9-a542-4967-a7dd-cdb718f0d7a6 req-7d844839-abbf-4f76-a4a0-0c187a185935 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038266 Aug 07 01:28:49.747306 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2009/3670] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:28:49.752632 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4b09e821-0d34-4e69-9b08-e918c08e4659 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:49.753694 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4b09e821-0d34-4e69-9b08-e918c08e4659 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:49.765262 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b09e821-0d34-4e69-9b08-e918c08e4659 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:49.766302 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b09e821-0d34-4e69-9b08-e918c08e4659 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:49.766965 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b09e821-0d34-4e69-9b08-e918c08e4659 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:49.768150 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b09e821-0d34-4e69-9b08-e918c08e4659 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:49.768961 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b09e821-0d34-4e69-9b08-e918c08e4659 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:49.769620 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b09e821-0d34-4e69-9b08-e918c08e4659 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:49.789817 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5b6a94cd-b989-4a8c-94b6-eeaac1f4d6e6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:49.817881 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5b6a94cd-b989-4a8c-94b6-eeaac1f4d6e6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1315 microversion: 2.1 time: 0.614716 Aug 07 01:28:49.826817 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1662/3671] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:49 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1315 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:50.087540 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4b09e821-0d34-4e69-9b08-e918c08e4659 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:50.102788 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4b09e821-0d34-4e69-9b08-e918c08e4659 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.353869 Aug 07 01:28:50.106685 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2010/3672] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:49 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:50.135309 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-eb370941-aecc-4b4c-bbbf-70d431231a64 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:50.135993 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-eb370941-aecc-4b4c-bbbf-70d431231a64 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:50.150644 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb370941-aecc-4b4c-bbbf-70d431231a64 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:50.151318 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb370941-aecc-4b4c-bbbf-70d431231a64 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:50.153447 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb370941-aecc-4b4c-bbbf-70d431231a64 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:50.155279 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb370941-aecc-4b4c-bbbf-70d431231a64 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:50.156505 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb370941-aecc-4b4c-bbbf-70d431231a64 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:50.158207 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb370941-aecc-4b4c-bbbf-70d431231a64 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:50.194518 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-87ea26d7-1e2f-4df6-8701-e2bd7138b51b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:50.195276 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-87ea26d7-1e2f-4df6-8701-e2bd7138b51b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:50.202858 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:50.211156 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-87ea26d7-1e2f-4df6-8701-e2bd7138b51b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:50.212391 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-87ea26d7-1e2f-4df6-8701-e2bd7138b51b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:50.212991 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-87ea26d7-1e2f-4df6-8701-e2bd7138b51b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:50.215405 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-87ea26d7-1e2f-4df6-8701-e2bd7138b51b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:50.216106 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-87ea26d7-1e2f-4df6-8701-e2bd7138b51b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:50.216835 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-87ea26d7-1e2f-4df6-8701-e2bd7138b51b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:50.426483 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-87ea26d7-1e2f-4df6-8701-e2bd7138b51b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:50.441325 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-87ea26d7-1e2f-4df6-8701-e2bd7138b51b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.252035 Aug 07 01:28:50.457043 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2011/3673] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:50 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:50.466223 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ff382c7a-c2bb-491b-854f-811f7000760b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e298b10d0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:50.532195 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ff382c7a-c2bb-491b-854f-811f7000760b tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453" status: 200 len: 1438 microversion: 2.1 time: 0.071353 Aug 07 01:28:50.534249 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2012/3674] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:28:50 2022] GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453 => generated 1438 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:50.539076 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e77d8c91-d370-451e-883a-9494cd0d7e2e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:50.539706 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e77d8c91-d370-451e-883a-9494cd0d7e2e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:50.553247 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e77d8c91-d370-451e-883a-9494cd0d7e2e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:50.553746 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e77d8c91-d370-451e-883a-9494cd0d7e2e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:50.554443 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e77d8c91-d370-451e-883a-9494cd0d7e2e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:50.555437 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e77d8c91-d370-451e-883a-9494cd0d7e2e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:50.556557 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e77d8c91-d370-451e-883a-9494cd0d7e2e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:50.557237 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e77d8c91-d370-451e-883a-9494cd0d7e2e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:50.604806 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-eb370941-aecc-4b4c-bbbf-70d431231a64 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:50.623317 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-eb370941-aecc-4b4c-bbbf-70d431231a64 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.493231 Aug 07 01:28:50.624668 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1663/3675] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:50 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:50.697021 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f8dd9355-5c14-4e83-bd4e-ee6dfb3cffad tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:50.697804 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f8dd9355-5c14-4e83-bd4e-ee6dfb3cffad tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:50.705357 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f8dd9355-5c14-4e83-bd4e-ee6dfb3cffad tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:50.705853 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f8dd9355-5c14-4e83-bd4e-ee6dfb3cffad tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:50.708213 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f8dd9355-5c14-4e83-bd4e-ee6dfb3cffad tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:50.708972 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f8dd9355-5c14-4e83-bd4e-ee6dfb3cffad tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:50.709444 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f8dd9355-5c14-4e83-bd4e-ee6dfb3cffad tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:50.709877 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f8dd9355-5c14-4e83-bd4e-ee6dfb3cffad tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:50.739484 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e77d8c91-d370-451e-883a-9494cd0d7e2e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:50.750913 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e77d8c91-d370-451e-883a-9494cd0d7e2e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.216336 Aug 07 01:28:50.751510 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2013/3676] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:50 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:50.776715 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-aa95cb62-a553-4551-9981-eb16e8cc792c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1468653425", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:50.782430 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-aa95cb62-a553-4551-9981-eb16e8cc792c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-aa95cb62-a553-4551-9981-eb16e8cc792c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 216 Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1468653425", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1468653425', 'imageRef': 'e825bd61-bf05-4bd4-aa72-78daf2231731', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:50.784108 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:50.789551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:50.789551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:50.789551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:50.789551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:50.789551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:28:50.789551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:28:50.789551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 07 01:28:50.789551 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:50.789551 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-aa95cb62-a553-4551-9981-eb16e8cc792c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:28:50.789551 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-aa95cb62-a553-4551-9981-eb16e8cc792c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.019466 Aug 07 01:28:50.792247 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2014/3677] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:28:50 2022] POST /compute/v2.1/servers => generated 123 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:28:50.799995 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3f6d9fe9-aa96-4581-92db-e485583831fc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:50.800562 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3f6d9fe9-aa96-4581-92db-e485583831fc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:50.807709 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f6d9fe9-aa96-4581-92db-e485583831fc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:50.808307 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f6d9fe9-aa96-4581-92db-e485583831fc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:50.808806 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f6d9fe9-aa96-4581-92db-e485583831fc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:50.809531 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f6d9fe9-aa96-4581-92db-e485583831fc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:50.809996 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f6d9fe9-aa96-4581-92db-e485583831fc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:50.810431 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f6d9fe9-aa96-4581-92db-e485583831fc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:50.887818 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3f6d9fe9-aa96-4581-92db-e485583831fc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Unlocking {{(pid=119516) unlock /opt/stack/nova/nova/compute/api.py:4810}} Aug 07 01:28:50.999226 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f8dd9355-5c14-4e83-bd4e-ee6dfb3cffad tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:51.020855 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f8dd9355-5c14-4e83-bd4e-ee6dfb3cffad tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1504 microversion: 2.1 time: 0.328040 Aug 07 01:28:51.024423 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3f6d9fe9-aa96-4581-92db-e485583831fc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action" status: 202 len: 0 microversion: 2.1 time: 0.230780 Aug 07 01:28:51.031684 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2015/3678] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:28:50 2022] POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:28:51.041639 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-556c01d6-5b7c-4163-ae6d-ecbf528f0d41 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:51.044843 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-556c01d6-5b7c-4163-ae6d-ecbf528f0d41 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:51.045023 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1664/3679] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:50 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1504 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:51.052168 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-afd11d49-7369-409e-9e39-4897026188f5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:51.052993 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-afd11d49-7369-409e-9e39-4897026188f5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:51.053727 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-556c01d6-5b7c-4163-ae6d-ecbf528f0d41 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:51.067131 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-afd11d49-7369-409e-9e39-4897026188f5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:51.068824 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-afd11d49-7369-409e-9e39-4897026188f5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:51.069473 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-afd11d49-7369-409e-9e39-4897026188f5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:51.070390 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-afd11d49-7369-409e-9e39-4897026188f5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:51.071051 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-afd11d49-7369-409e-9e39-4897026188f5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:51.071186 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-556c01d6-5b7c-4163-ae6d-ecbf528f0d41 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:51.071776 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-afd11d49-7369-409e-9e39-4897026188f5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:51.073340 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-556c01d6-5b7c-4163-ae6d-ecbf528f0d41 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:51.077162 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-556c01d6-5b7c-4163-ae6d-ecbf528f0d41 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:51.080582 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-556c01d6-5b7c-4163-ae6d-ecbf528f0d41 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:51.081307 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-556c01d6-5b7c-4163-ae6d-ecbf528f0d41 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:51.284594 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-afd11d49-7369-409e-9e39-4897026188f5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:51.298312 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-afd11d49-7369-409e-9e39-4897026188f5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1315 microversion: 2.1 time: 0.252114 Aug 07 01:28:51.299349 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1665/3680] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:51 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:51.304679 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4cb0cbbb-4716-4bca-905b-a590f0050ef6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:51.305647 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4cb0cbbb-4716-4bca-905b-a590f0050ef6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:51.316367 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4cb0cbbb-4716-4bca-905b-a590f0050ef6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:51.317020 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4cb0cbbb-4716-4bca-905b-a590f0050ef6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:51.317657 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4cb0cbbb-4716-4bca-905b-a590f0050ef6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:51.323909 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4cb0cbbb-4716-4bca-905b-a590f0050ef6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:51.325131 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4cb0cbbb-4716-4bca-905b-a590f0050ef6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:51.325761 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4cb0cbbb-4716-4bca-905b-a590f0050ef6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:51.415295 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:51.431557 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-556c01d6-5b7c-4163-ae6d-ecbf528f0d41 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:51.445909 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-556c01d6-5b7c-4163-ae6d-ecbf528f0d41 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.411063 Aug 07 01:28:51.446762 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2016/3681] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:51 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:51.475073 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-13004217-cb2e-4121-8065-6de985d272b5 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:51.479924 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-13004217-cb2e-4121-8065-6de985d272b5 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:51.500186 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-13004217-cb2e-4121-8065-6de985d272b5 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:51.501079 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-13004217-cb2e-4121-8065-6de985d272b5 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:51.504217 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-13004217-cb2e-4121-8065-6de985d272b5 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:51.505140 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-13004217-cb2e-4121-8065-6de985d272b5 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:51.505637 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-13004217-cb2e-4121-8065-6de985d272b5 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:51.510438 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-13004217-cb2e-4121-8065-6de985d272b5 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:51.594869 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4cb0cbbb-4716-4bca-905b-a590f0050ef6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:51.611981 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4cb0cbbb-4716-4bca-905b-a590f0050ef6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.311217 Aug 07 01:28:51.613274 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1666/3682] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:51 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:51.619816 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a30f432b-8557-4998-91fe-7c85a2d9fd76 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e17e045e0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:51.688775 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a30f432b-8557-4998-91fe-7c85a2d9fd76 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453" status: 200 len: 1438 microversion: 2.1 time: 0.074080 Aug 07 01:28:51.698328 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1667/3683] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:28:51 2022] GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453 => generated 1438 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:51.704899 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-46e19efa-4541-42c7-849b-fb506887f0e6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:51.705949 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-46e19efa-4541-42c7-849b-fb506887f0e6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:51.713293 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-46e19efa-4541-42c7-849b-fb506887f0e6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:51.714171 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-46e19efa-4541-42c7-849b-fb506887f0e6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:51.715396 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-46e19efa-4541-42c7-849b-fb506887f0e6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:51.717594 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-46e19efa-4541-42c7-849b-fb506887f0e6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:51.718374 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-46e19efa-4541-42c7-849b-fb506887f0e6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:51.720404 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-46e19efa-4541-42c7-849b-fb506887f0e6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:51.842519 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=8 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:51.858858 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-13004217-cb2e-4121-8065-6de985d272b5 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:51.867970 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-13004217-cb2e-4121-8065-6de985d272b5 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.398507 Aug 07 01:28:51.869158 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2017/3684] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:51 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:28:51.927437 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-46e19efa-4541-42c7-849b-fb506887f0e6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:51.941090 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-46e19efa-4541-42c7-849b-fb506887f0e6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.240370 Aug 07 01:28:51.953465 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1668/3685] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:51 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:51.961969 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6ad0f815-5d07-4e3d-820b-3ce2f98c01fe tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1367830728", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "key_name": "tempest-key-937097672", "networks": [{"uuid": "cf9a6ffb-a1bc-4f16-8970-9d69635f8f75"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:51.994326 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8d50e054-0b83-4285-99ce-8f5145fa88a5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:51.995081 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8d50e054-0b83-4285-99ce-8f5145fa88a5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:52.004690 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8d50e054-0b83-4285-99ce-8f5145fa88a5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:52.005456 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8d50e054-0b83-4285-99ce-8f5145fa88a5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:52.005689 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8d50e054-0b83-4285-99ce-8f5145fa88a5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:52.006802 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8d50e054-0b83-4285-99ce-8f5145fa88a5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:52.007359 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8d50e054-0b83-4285-99ce-8f5145fa88a5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:52.008037 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8d50e054-0b83-4285-99ce-8f5145fa88a5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:52.090862 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-6ad0f815-5d07-4e3d-820b-3ce2f98c01fe tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] validate_networks() for [('cf9a6ffb-a1bc-4f16-8970-9d69635f8f75', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:28:52.320690 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8d50e054-0b83-4285-99ce-8f5145fa88a5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:52.337711 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8d50e054-0b83-4285-99ce-8f5145fa88a5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.355577 Aug 07 01:28:52.338706 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1669/3686] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:51 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:52.346511 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-309bbe46-60a2-4405-b7fa-1a15741c845f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:52.347652 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-309bbe46-60a2-4405-b7fa-1a15741c845f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:52.358681 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-309bbe46-60a2-4405-b7fa-1a15741c845f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:52.359618 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-309bbe46-60a2-4405-b7fa-1a15741c845f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:52.360311 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-309bbe46-60a2-4405-b7fa-1a15741c845f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:52.361273 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-309bbe46-60a2-4405-b7fa-1a15741c845f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:52.361962 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-309bbe46-60a2-4405-b7fa-1a15741c845f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:52.362618 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-309bbe46-60a2-4405-b7fa-1a15741c845f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:52.371124 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-6ad0f815-5d07-4e3d-820b-3ce2f98c01fe tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] HTTP exception thrown: Invalid key_name provided. Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6ad0f815-5d07-4e3d-820b-3ce2f98c01fe tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 246 Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1367830728", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "key_name": "tempest-key-937097672", "networks": [{"uuid": "cf9a6ffb-a1bc-4f16-8970-9d69635f8f75"}]}} Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: exception: Invalid key_name provided. Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1367830728', 'imageRef': 'e825bd61-bf05-4bd4-aa72-78daf2231731', 'flavorRef': '452', 'key_name': 'tempest-key-937097672', 'networks': [{'uuid': 'cf9a6ffb-a1bc-4f16-8970-9d69635f8f75'}]}}} Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1077, in _validate_and_build_base_options Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-937097672 not found for user 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:52.373330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:52.386650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:52.386650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:28:52.386650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:28:52.386650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:28:52.386650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:28:52.386650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:28:52.386650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:28:52.386650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:28:52.386650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:28:52.386650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:28:52.386650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:28:52.386650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 07 01:28:52.386650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 07 01:28:52.386650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 07 01:28:52.386650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 07 01:28:52.386650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:52.386650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:52.386650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:52.386650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:52.386650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:52.386650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:52.386650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:28:52.386650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:28:52.386650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 07 01:28:52.386650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:52.386650 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6ad0f815-5d07-4e3d-820b-3ce2f98c01fe tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 400 to user: Invalid key_name provided. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:28:52.386650 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6ad0f815-5d07-4e3d-820b-3ce2f98c01fe tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.416935 Aug 07 01:28:52.386650 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2018/3687] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:28:51 2022] POST /compute/v2.1/servers => generated 70 bytes in 419 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 07 01:28:52.386650 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fae98224-d492-457b-b042-1a19b621dc08 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:52.386650 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fae98224-d492-457b-b042-1a19b621dc08 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:52.393769 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fae98224-d492-457b-b042-1a19b621dc08 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:52.394398 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fae98224-d492-457b-b042-1a19b621dc08 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:52.394933 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fae98224-d492-457b-b042-1a19b621dc08 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:52.395750 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fae98224-d492-457b-b042-1a19b621dc08 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:52.396575 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fae98224-d492-457b-b042-1a19b621dc08 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:52.397393 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fae98224-d492-457b-b042-1a19b621dc08 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:52.560247 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fae98224-d492-457b-b042-1a19b621dc08 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:52.570496 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fae98224-d492-457b-b042-1a19b621dc08 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1315 microversion: 2.1 time: 0.192032 Aug 07 01:28:52.571129 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2019/3688] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:52 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:52.600729 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-52609eb9-d2d2-4016-a972-396242a3a5ad tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:52.601295 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-52609eb9-d2d2-4016-a972-396242a3a5ad tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:52.618915 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52609eb9-d2d2-4016-a972-396242a3a5ad tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:52.619514 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52609eb9-d2d2-4016-a972-396242a3a5ad tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:52.620234 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52609eb9-d2d2-4016-a972-396242a3a5ad tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:52.621017 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52609eb9-d2d2-4016-a972-396242a3a5ad tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:52.622276 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52609eb9-d2d2-4016-a972-396242a3a5ad tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:52.622937 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52609eb9-d2d2-4016-a972-396242a3a5ad tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:52.710758 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=5 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:52.776986 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-52609eb9-d2d2-4016-a972-396242a3a5ad tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action" status: 202 len: 0 microversion: 2.1 time: 0.187482 Aug 07 01:28:52.778801 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2020/3689] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:28:52 2022] POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:28:52.798027 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-31261193-ca28-40e9-8e5c-4e09c599824f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:52.800739 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-31261193-ca28-40e9-8e5c-4e09c599824f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:52.814218 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31261193-ca28-40e9-8e5c-4e09c599824f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:52.815127 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31261193-ca28-40e9-8e5c-4e09c599824f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:52.816179 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31261193-ca28-40e9-8e5c-4e09c599824f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:52.817259 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31261193-ca28-40e9-8e5c-4e09c599824f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:52.817723 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31261193-ca28-40e9-8e5c-4e09c599824f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:52.818159 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31261193-ca28-40e9-8e5c-4e09c599824f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:53.062864 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-31261193-ca28-40e9-8e5c-4e09c599824f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:53.086683 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-31261193-ca28-40e9-8e5c-4e09c599824f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.304717 Aug 07 01:28:53.087309 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2021/3690] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:52 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:53.116893 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-163cf07b-7b83-462a-b1df-9d0e21c9ed67 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e24a4c430>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:53.199652 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-163cf07b-7b83-462a-b1df-9d0e21c9ed67 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453" status: 200 len: 1438 microversion: 2.1 time: 0.110138 Aug 07 01:28:53.200311 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2022/3691] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:28:53 2022] GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453 => generated 1438 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:53.209983 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a4d2626b-716f-4fb1-addb-863351439732 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:53.210871 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a4d2626b-716f-4fb1-addb-863351439732 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:53.224392 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4d2626b-716f-4fb1-addb-863351439732 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:53.225042 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4d2626b-716f-4fb1-addb-863351439732 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:53.225654 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4d2626b-716f-4fb1-addb-863351439732 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:53.226494 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4d2626b-716f-4fb1-addb-863351439732 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:53.227061 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4d2626b-716f-4fb1-addb-863351439732 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:53.227598 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4d2626b-716f-4fb1-addb-863351439732 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:53.308851 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-309bbe46-60a2-4405-b7fa-1a15741c845f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:53.320398 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-309bbe46-60a2-4405-b7fa-1a15741c845f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1504 microversion: 2.1 time: 0.979680 Aug 07 01:28:53.323400 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1670/3692] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:52 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1504 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:53.338588 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-75687689-8ce1-43d5-b037-0b625aa4a2e0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:53.339221 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-75687689-8ce1-43d5-b037-0b625aa4a2e0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:53.366782 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75687689-8ce1-43d5-b037-0b625aa4a2e0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:53.367286 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75687689-8ce1-43d5-b037-0b625aa4a2e0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:53.367729 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75687689-8ce1-43d5-b037-0b625aa4a2e0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:53.375243 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75687689-8ce1-43d5-b037-0b625aa4a2e0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:53.376727 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75687689-8ce1-43d5-b037-0b625aa4a2e0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:53.377388 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75687689-8ce1-43d5-b037-0b625aa4a2e0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:53.413799 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a4d2626b-716f-4fb1-addb-863351439732 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:53.423372 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a4d2626b-716f-4fb1-addb-863351439732 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1652 microversion: 2.1 time: 0.221934 Aug 07 01:28:53.424648 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2023/3693] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:53 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1652 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:53.449454 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6a4b0788-3039-4877-967c-ca2a6f9571ae tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:53.450611 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6a4b0788-3039-4877-967c-ca2a6f9571ae tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:53.457706 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a4b0788-3039-4877-967c-ca2a6f9571ae tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:53.457919 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a4b0788-3039-4877-967c-ca2a6f9571ae tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:53.460252 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a4b0788-3039-4877-967c-ca2a6f9571ae tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:53.460252 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a4b0788-3039-4877-967c-ca2a6f9571ae tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:53.460252 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a4b0788-3039-4877-967c-ca2a6f9571ae tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:53.460252 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a4b0788-3039-4877-967c-ca2a6f9571ae tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:53.552450 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6a4b0788-3039-4877-967c-ca2a6f9571ae tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action" status: 202 len: 0 microversion: 2.1 time: 0.107697 Aug 07 01:28:53.557643 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2024/3694] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:28:53 2022] POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:28:53.568703 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1f2a60cd-b184-4581-81f4-e75cf3239227 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:53.569409 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1f2a60cd-b184-4581-81f4-e75cf3239227 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:53.578301 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f2a60cd-b184-4581-81f4-e75cf3239227 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:53.578799 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f2a60cd-b184-4581-81f4-e75cf3239227 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:53.579240 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f2a60cd-b184-4581-81f4-e75cf3239227 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:53.580410 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f2a60cd-b184-4581-81f4-e75cf3239227 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:53.580996 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f2a60cd-b184-4581-81f4-e75cf3239227 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:53.581816 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f2a60cd-b184-4581-81f4-e75cf3239227 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:53.718821 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-75687689-8ce1-43d5-b037-0b625aa4a2e0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:53.734372 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-75687689-8ce1-43d5-b037-0b625aa4a2e0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.405826 Aug 07 01:28:53.736626 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1671/3695] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:53 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:53.746856 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e4d571cb-cd16-436f-b2c6-16a1c8c70aaf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:53.748111 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e4d571cb-cd16-436f-b2c6-16a1c8c70aaf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:53.751519 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:53.756250 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4d571cb-cd16-436f-b2c6-16a1c8c70aaf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:53.757486 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4d571cb-cd16-436f-b2c6-16a1c8c70aaf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:53.758743 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4d571cb-cd16-436f-b2c6-16a1c8c70aaf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:53.759981 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4d571cb-cd16-436f-b2c6-16a1c8c70aaf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:53.760837 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4d571cb-cd16-436f-b2c6-16a1c8c70aaf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:53.762207 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4d571cb-cd16-436f-b2c6-16a1c8c70aaf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:54.107693 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e4d571cb-cd16-436f-b2c6-16a1c8c70aaf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:54.117627 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e4d571cb-cd16-436f-b2c6-16a1c8c70aaf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1315 microversion: 2.1 time: 0.379739 Aug 07 01:28:54.118569 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1672/3696] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:53 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:54.123320 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-36c085d4-1ed1-4041-91b2-dc5a67595a2e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-467077761", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "cf9a6ffb-a1bc-4f16-8970-9d69635f8f75"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:54.190293 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1f2a60cd-b184-4581-81f4-e75cf3239227 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:54.229416 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1f2a60cd-b184-4581-81f4-e75cf3239227 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1659 microversion: 2.1 time: 0.670283 Aug 07 01:28:54.232095 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2025/3697] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:53 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1659 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:54.239578 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7da10a3c-88fb-4948-849b-5cd488f74f50 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e24a4c5e0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:54.257320 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.security_group_api [None req-36c085d4-1ed1-4041-91b2-dc5a67595a2e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Neutron security group does_not_exist not found {{(pid=119517) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 07 01:28:54.258531 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-36c085d4-1ed1-4041-91b2-dc5a67595a2e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-36c085d4-1ed1-4041-91b2-dc5a67595a2e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 257 Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-467077761", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "cf9a6ffb-a1bc-4f16-8970-9d69635f8f75"}]}} Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-467077761', 'imageRef': 'e825bd61-bf05-4bd4-aa72-78daf2231731', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'cf9a6ffb-a1bc-4f16-8970-9d69635f8f75'}]}}} Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 07 01:28:54.272096 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1062, in _validate_and_build_base_options Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 509, in _check_requested_secgroups Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:54.279855 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-36c085d4-1ed1-4041-91b2-dc5a67595a2e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:28:54.290686 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-36c085d4-1ed1-4041-91b2-dc5a67595a2e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.161067 Aug 07 01:28:54.290686 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1673/3698] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:28:54 2022] POST /compute/v2.1/servers => generated 106 bytes in 163 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:28:54.320356 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-10835a35-892b-43bb-9551-e65e3296024a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:54.326491 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-10835a35-892b-43bb-9551-e65e3296024a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:54.351051 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10835a35-892b-43bb-9551-e65e3296024a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:54.353069 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10835a35-892b-43bb-9551-e65e3296024a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:54.354547 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10835a35-892b-43bb-9551-e65e3296024a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:54.355977 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7da10a3c-88fb-4948-849b-5cd488f74f50 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453" status: 200 len: 1438 microversion: 2.1 time: 0.122321 Aug 07 01:28:54.356834 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2026/3699] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:28:54 2022] GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453 => generated 1438 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:54.360046 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10835a35-892b-43bb-9551-e65e3296024a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:54.361144 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10835a35-892b-43bb-9551-e65e3296024a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:54.361847 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10835a35-892b-43bb-9551-e65e3296024a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:54.378266 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8498b442-f5b8-4c88-aea5-a86bee53ef9a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:54.379380 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8498b442-f5b8-4c88-aea5-a86bee53ef9a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:54.390815 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8498b442-f5b8-4c88-aea5-a86bee53ef9a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:54.391319 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8498b442-f5b8-4c88-aea5-a86bee53ef9a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:54.391809 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8498b442-f5b8-4c88-aea5-a86bee53ef9a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:54.392757 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8498b442-f5b8-4c88-aea5-a86bee53ef9a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:54.393319 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8498b442-f5b8-4c88-aea5-a86bee53ef9a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:54.393805 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8498b442-f5b8-4c88-aea5-a86bee53ef9a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:54.561321 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-10835a35-892b-43bb-9551-e65e3296024a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:54.570912 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-10835a35-892b-43bb-9551-e65e3296024a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.281574 Aug 07 01:28:54.571916 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1674/3700] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:54 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:54.599623 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-227fe971-2a3e-487c-9dd7-825fb386640b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:54.600367 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-227fe971-2a3e-487c-9dd7-825fb386640b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:54.607833 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-227fe971-2a3e-487c-9dd7-825fb386640b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:54.608489 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-227fe971-2a3e-487c-9dd7-825fb386640b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:54.608938 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-227fe971-2a3e-487c-9dd7-825fb386640b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:54.609664 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-227fe971-2a3e-487c-9dd7-825fb386640b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:54.610178 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-227fe971-2a3e-487c-9dd7-825fb386640b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:54.610551 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-227fe971-2a3e-487c-9dd7-825fb386640b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:54.862468 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8498b442-f5b8-4c88-aea5-a86bee53ef9a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:54.873670 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-227fe971-2a3e-487c-9dd7-825fb386640b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:54.884435 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-227fe971-2a3e-487c-9dd7-825fb386640b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.289099 Aug 07 01:28:54.900407 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8498b442-f5b8-4c88-aea5-a86bee53ef9a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1504 microversion: 2.1 time: 0.517596 Aug 07 01:28:54.901550 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1675/3701] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:54 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:28:54.904915 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2027/3702] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:54 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1504 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:54.908455 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-79d85373-2d0f-4c43-88a4-634eb33032b7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:54.909144 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-79d85373-2d0f-4c43-88a4-634eb33032b7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 09f3e5bc-e577-430b-b306-28722221a480] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:54.915179 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-79d85373-2d0f-4c43-88a4-634eb33032b7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] HTTP exception thrown: Instance 09f3e5bc-e577-430b-b306-28722221a480 could not be found. Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-79d85373-2d0f-4c43-88a4-634eb33032b7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/09f3e5bc-e577-430b-b306-28722221a480 HTTP/1.1 Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 09f3e5bc-e577-430b-b306-28722221a480 could not be found. Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '09f3e5bc-e577-430b-b306-28722221a480'} Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09f3e5bc-e577-430b-b306-28722221a480 could not be found. Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09f3e5bc-e577-430b-b306-28722221a480 could not be found. Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:54.917076 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:54.937158 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:54.937158 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:54.937158 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:54.937158 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:54.937158 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:28:54.937158 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:28:54.937158 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09f3e5bc-e577-430b-b306-28722221a480 could not be found. Aug 07 01:28:54.937158 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:54.937158 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-79d85373-2d0f-4c43-88a4-634eb33032b7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 404 to user: Instance 09f3e5bc-e577-430b-b306-28722221a480 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:28:54.937158 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-79d85373-2d0f-4c43-88a4-634eb33032b7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "DELETE /compute/v2.1/servers/09f3e5bc-e577-430b-b306-28722221a480" status: 404 len: 111 microversion: 2.1 time: 0.016278 Aug 07 01:28:54.937158 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1676/3703] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:28:54 2022] DELETE /compute/v2.1/servers/09f3e5bc-e577-430b-b306-28722221a480 => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:28:54.939629 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6043055c-973a-4098-a764-55b473cffc62 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:54.939629 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6043055c-973a-4098-a764-55b473cffc62 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:54.950307 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6043055c-973a-4098-a764-55b473cffc62 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:54.950307 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6043055c-973a-4098-a764-55b473cffc62 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:54.950307 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6043055c-973a-4098-a764-55b473cffc62 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:54.950307 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6043055c-973a-4098-a764-55b473cffc62 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:54.950307 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6043055c-973a-4098-a764-55b473cffc62 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:54.950307 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6043055c-973a-4098-a764-55b473cffc62 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:55.145802 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-047b1741-41b3-4c9f-98d1-d281c9a43cd4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:55.147505 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-047b1741-41b3-4c9f-98d1-d281c9a43cd4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:55.158924 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-047b1741-41b3-4c9f-98d1-d281c9a43cd4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:55.159814 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-047b1741-41b3-4c9f-98d1-d281c9a43cd4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:55.160454 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-047b1741-41b3-4c9f-98d1-d281c9a43cd4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:55.162118 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-047b1741-41b3-4c9f-98d1-d281c9a43cd4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:55.163693 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-047b1741-41b3-4c9f-98d1-d281c9a43cd4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:55.164417 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-047b1741-41b3-4c9f-98d1-d281c9a43cd4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:55.249552 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6043055c-973a-4098-a764-55b473cffc62 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:55.265705 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6043055c-973a-4098-a764-55b473cffc62 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.340080 Aug 07 01:28:55.267642 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2028/3704] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:54 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:55.279109 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-454b0912-7eea-4b11-b384-f0256ee07f10 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:55.281863 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-454b0912-7eea-4b11-b384-f0256ee07f10 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:55.303363 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-454b0912-7eea-4b11-b384-f0256ee07f10 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:55.307600 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-454b0912-7eea-4b11-b384-f0256ee07f10 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:55.310644 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-454b0912-7eea-4b11-b384-f0256ee07f10 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:55.316920 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-454b0912-7eea-4b11-b384-f0256ee07f10 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:55.317419 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-454b0912-7eea-4b11-b384-f0256ee07f10 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:55.317866 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-454b0912-7eea-4b11-b384-f0256ee07f10 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:55.430035 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-047b1741-41b3-4c9f-98d1-d281c9a43cd4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:55.441724 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-047b1741-41b3-4c9f-98d1-d281c9a43cd4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1315 microversion: 2.1 time: 0.303841 Aug 07 01:28:55.442767 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1677/3705] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:55 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:55.449885 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0ef26286-3251-4b74-8454-adb43d705cb4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:55.450825 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0ef26286-3251-4b74-8454-adb43d705cb4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:55.459706 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ef26286-3251-4b74-8454-adb43d705cb4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:55.460953 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ef26286-3251-4b74-8454-adb43d705cb4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:55.461726 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ef26286-3251-4b74-8454-adb43d705cb4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:55.462606 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ef26286-3251-4b74-8454-adb43d705cb4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:55.470186 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ef26286-3251-4b74-8454-adb43d705cb4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:55.471029 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ef26286-3251-4b74-8454-adb43d705cb4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:55.710208 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0ef26286-3251-4b74-8454-adb43d705cb4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:55.722037 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0ef26286-3251-4b74-8454-adb43d705cb4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.277662 Aug 07 01:28:55.726244 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1678/3706] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:55 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:55.732289 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-23b93705-d250-4595-9c00-1fb02ad7d5da tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e2463cc10>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:55.772747 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-454b0912-7eea-4b11-b384-f0256ee07f10 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:55.783190 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-454b0912-7eea-4b11-b384-f0256ee07f10 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.512820 Aug 07 01:28:55.793195 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2029/3707] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:55 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:55.794319 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-23b93705-d250-4595-9c00-1fb02ad7d5da tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453" status: 200 len: 1438 microversion: 2.1 time: 0.065965 Aug 07 01:28:55.795301 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1679/3708] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:28:55 2022] GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453 => generated 1438 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:55.807266 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a5836436-09b3-426f-84c7-d74069c05cfe tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:55.807973 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a5836436-09b3-426f-84c7-d74069c05cfe tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Failed to fetch instance by id 9223372036854775808 {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 07 01:28:55.808857 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-a5836436-09b3-426f-84c7-d74069c05cfe tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a5836436-09b3-426f-84c7-d74069c05cfe tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 9223372036854775808 could not be found. Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '9223372036854775808'} Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:55.813038 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:55.819878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:55.819878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:28:55.819878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:28:55.819878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 07 01:28:55.819878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:55.820608 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-54f54e2f-e2d8-4308-9fbb-47e4e0631c60 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:55.820608 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-54f54e2f-e2d8-4308-9fbb-47e4e0631c60 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:55.822257 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a5836436-09b3-426f-84c7-d74069c05cfe tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:28:55.823471 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a5836436-09b3-426f-84c7-d74069c05cfe tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.022033 Aug 07 01:28:55.825166 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2030/3709] 10.222.0.39 () {58 vars in 1188 bytes} [Sun Aug 7 01:28:55 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:28:55.827923 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54f54e2f-e2d8-4308-9fbb-47e4e0631c60 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:55.828585 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54f54e2f-e2d8-4308-9fbb-47e4e0631c60 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:55.829193 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54f54e2f-e2d8-4308-9fbb-47e4e0631c60 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:55.830086 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54f54e2f-e2d8-4308-9fbb-47e4e0631c60 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:55.831017 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54f54e2f-e2d8-4308-9fbb-47e4e0631c60 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:55.831762 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54f54e2f-e2d8-4308-9fbb-47e4e0631c60 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:55.836653 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7999c976-5074-4dd7-ab04-ab149090129a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:55.837593 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7999c976-5074-4dd7-ab04-ab149090129a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:55.846559 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7999c976-5074-4dd7-ab04-ab149090129a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:55.847367 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7999c976-5074-4dd7-ab04-ab149090129a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:55.848133 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7999c976-5074-4dd7-ab04-ab149090129a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:55.849042 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7999c976-5074-4dd7-ab04-ab149090129a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:55.849702 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7999c976-5074-4dd7-ab04-ab149090129a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:55.850305 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7999c976-5074-4dd7-ab04-ab149090129a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:56.105584 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7999c976-5074-4dd7-ab04-ab149090129a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:56.118146 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7999c976-5074-4dd7-ab04-ab149090129a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.288426 Aug 07 01:28:56.130093 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2031/3710] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:55 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:28:56.136106 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-92f52af0-d394-46b9-9a7d-5ff0dd6d7c96 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:56.136106 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-92f52af0-d394-46b9-9a7d-5ff0dd6d7c96 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:56.145866 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92f52af0-d394-46b9-9a7d-5ff0dd6d7c96 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:56.147330 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92f52af0-d394-46b9-9a7d-5ff0dd6d7c96 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:56.147831 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92f52af0-d394-46b9-9a7d-5ff0dd6d7c96 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:56.148731 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92f52af0-d394-46b9-9a7d-5ff0dd6d7c96 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:56.149246 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92f52af0-d394-46b9-9a7d-5ff0dd6d7c96 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:56.149819 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92f52af0-d394-46b9-9a7d-5ff0dd6d7c96 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:56.406477 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-54f54e2f-e2d8-4308-9fbb-47e4e0631c60 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:56.414396 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:56.429626 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-92f52af0-d394-46b9-9a7d-5ff0dd6d7c96 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:56.444769 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-54f54e2f-e2d8-4308-9fbb-47e4e0631c60 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.637265 Aug 07 01:28:56.447362 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1680/3711] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:55 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:56.453834 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-92f52af0-d394-46b9-9a7d-5ff0dd6d7c96 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1504 microversion: 2.1 time: 0.333454 Aug 07 01:28:56.460767 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2d4fd12c-dced-42df-baf1-2a51b9ea7495 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:56.461714 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2d4fd12c-dced-42df-baf1-2a51b9ea7495 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:56.467910 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2032/3712] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:56 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1504 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:56.480825 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d4fd12c-dced-42df-baf1-2a51b9ea7495 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:56.481402 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d4fd12c-dced-42df-baf1-2a51b9ea7495 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:56.482869 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d4fd12c-dced-42df-baf1-2a51b9ea7495 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:56.483619 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d4fd12c-dced-42df-baf1-2a51b9ea7495 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:56.484120 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d4fd12c-dced-42df-baf1-2a51b9ea7495 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:56.487295 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d4fd12c-dced-42df-baf1-2a51b9ea7495 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:56.510497 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6e850488-4449-4e05-810a-a56f05af14ed tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:56.512776 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6e850488-4449-4e05-810a-a56f05af14ed tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:56.546547 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e850488-4449-4e05-810a-a56f05af14ed tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:56.548371 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e850488-4449-4e05-810a-a56f05af14ed tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:56.552758 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e850488-4449-4e05-810a-a56f05af14ed tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:56.555094 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e850488-4449-4e05-810a-a56f05af14ed tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:56.560250 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e850488-4449-4e05-810a-a56f05af14ed tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:56.561018 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e850488-4449-4e05-810a-a56f05af14ed tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:56.756542 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6e850488-4449-4e05-810a-a56f05af14ed tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:56.765009 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6e850488-4449-4e05-810a-a56f05af14ed tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1315 microversion: 2.1 time: 0.292187 Aug 07 01:28:56.765598 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2033/3713] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:56 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:56.784801 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-fe989736-d939-484c-9987-f6bb11ed02ab req-e675e004-0087-44d2-ad32-1be7c62daf1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aacc9718-ff8d-4ef4-8380-7d863a4b5cd1", "name": "network-vif-plugged", "status": "completed", "tag": "6eee3035-8373-408c-81bd-fa491c09b2b5"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:56.796786 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-fe989736-d939-484c-9987-f6bb11ed02ab req-e675e004-0087-44d2-ad32-1be7c62daf1f service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:56.797574 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-fe989736-d939-484c-9987-f6bb11ed02ab req-e675e004-0087-44d2-ad32-1be7c62daf1f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:56.798228 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-fe989736-d939-484c-9987-f6bb11ed02ab req-e675e004-0087-44d2-ad32-1be7c62daf1f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:56.812296 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-fe989736-d939-484c-9987-f6bb11ed02ab req-e675e004-0087-44d2-ad32-1be7c62daf1f service nova] Creating event network-vif-plugged:6eee3035-8373-408c-81bd-fa491c09b2b5 for instance aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 on n-h2-master-1 Aug 07 01:28:56.820042 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-fe989736-d939-484c-9987-f6bb11ed02ab req-e675e004-0087-44d2-ad32-1be7c62daf1f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052955 Aug 07 01:28:56.821250 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2034/3714] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:28:56.828203 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2d4fd12c-dced-42df-baf1-2a51b9ea7495 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:56.833445 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8aba3d66-de47-4d57-8ab4-38ab1ddbc43d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:56.835251 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8aba3d66-de47-4d57-8ab4-38ab1ddbc43d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:56.836911 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2d4fd12c-dced-42df-baf1-2a51b9ea7495 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.388418 Aug 07 01:28:56.838034 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1681/3715] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:56 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:56.844485 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a768b187-586b-493a-aabe-05e5be3d59ce tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e17e04550>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:56.863034 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8aba3d66-de47-4d57-8ab4-38ab1ddbc43d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:56.863718 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8aba3d66-de47-4d57-8ab4-38ab1ddbc43d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:56.864217 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8aba3d66-de47-4d57-8ab4-38ab1ddbc43d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:56.865082 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8aba3d66-de47-4d57-8ab4-38ab1ddbc43d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:56.865468 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8aba3d66-de47-4d57-8ab4-38ab1ddbc43d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:56.865914 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8aba3d66-de47-4d57-8ab4-38ab1ddbc43d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:56.935177 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a768b187-586b-493a-aabe-05e5be3d59ce tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453" status: 200 len: 1447 microversion: 2.1 time: 0.095788 Aug 07 01:28:56.950680 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1682/3716] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:28:56 2022] GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453 => generated 1447 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:56.957694 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f84850dd-a33d-4cd3-bff6-5d70de243ff1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:56.968181 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f84850dd-a33d-4cd3-bff6-5d70de243ff1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Failed to fetch instance by id -1 {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 07 01:28:56.970349 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-f84850dd-a33d-4cd3-bff6-5d70de243ff1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] HTTP exception thrown: Instance -1 could not be found. Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f84850dd-a33d-4cd3-bff6-5d70de243ff1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: exception: Instance -1 could not be found. Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '-1'} Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:56.982540 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:56.989425 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:28:56.989425 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:28:56.989425 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 07 01:28:56.989425 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:56.994529 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f84850dd-a33d-4cd3-bff6-5d70de243ff1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 404 to user: Instance -1 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:28:56.998377 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f84850dd-a33d-4cd3-bff6-5d70de243ff1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.045807 Aug 07 01:28:57.005880 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1683/3717] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Aug 7 01:28:56 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:28:57.024418 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d8393457-69eb-4617-a2ce-789a1622c11e tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e24041ca0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:57.144447 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d8393457-69eb-4617-a2ce-789a1622c11e tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453" status: 200 len: 1447 microversion: 2.1 time: 0.135958 Aug 07 01:28:57.158206 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1684/3718] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:28:57 2022] GET /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453 => generated 1447 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:57.171783 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-22916fd8-8e43-48b6-9ed7-c8e85929ef8b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:57.172585 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-22916fd8-8e43-48b6-9ed7-c8e85929ef8b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:57.180467 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22916fd8-8e43-48b6-9ed7-c8e85929ef8b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:57.180977 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22916fd8-8e43-48b6-9ed7-c8e85929ef8b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:57.181561 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22916fd8-8e43-48b6-9ed7-c8e85929ef8b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:57.182470 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22916fd8-8e43-48b6-9ed7-c8e85929ef8b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:57.183122 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22916fd8-8e43-48b6-9ed7-c8e85929ef8b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:57.184495 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22916fd8-8e43-48b6-9ed7-c8e85929ef8b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:57.192279 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8aba3d66-de47-4d57-8ab4-38ab1ddbc43d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:57.209961 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8aba3d66-de47-4d57-8ab4-38ab1ddbc43d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.381498 Aug 07 01:28:57.211328 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2035/3719] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:56 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:57.226637 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4a29354e-fff2-4c9f-90ef-71e627586ec9 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e240bc8b0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:57.575708 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-22916fd8-8e43-48b6-9ed7-c8e85929ef8b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:57.588554 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-22916fd8-8e43-48b6-9ed7-c8e85929ef8b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.427610 Aug 07 01:28:57.589228 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1685/3720] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:57 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:57.594679 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e2f5e5d0-afab-4fda-a717-536e6b79d8cd tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:57.595309 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e2f5e5d0-afab-4fda-a717-536e6b79d8cd tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:57.613968 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e2f5e5d0-afab-4fda-a717-536e6b79d8cd tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:57.614969 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e2f5e5d0-afab-4fda-a717-536e6b79d8cd tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:57.614969 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e2f5e5d0-afab-4fda-a717-536e6b79d8cd tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:57.615616 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e2f5e5d0-afab-4fda-a717-536e6b79d8cd tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:57.616164 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e2f5e5d0-afab-4fda-a717-536e6b79d8cd tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:57.621215 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e2f5e5d0-afab-4fda-a717-536e6b79d8cd tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:57.932450 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e2f5e5d0-afab-4fda-a717-536e6b79d8cd tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:57.938933 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4a29354e-fff2-4c9f-90ef-71e627586ec9 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "DELETE /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453" status: 204 len: 0 microversion: 2.1 time: 0.725444 Aug 07 01:28:57.939594 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2036/3721] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:57 2022] DELETE /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453 => generated 0 bytes in 727 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:28:57.945909 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-149dbd8e-ed2e-49cc-844b-33d841a5254c tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:57.946738 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-149dbd8e-ed2e-49cc-844b-33d841a5254c tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:57.954976 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-149dbd8e-ed2e-49cc-844b-33d841a5254c tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:57.955950 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e2f5e5d0-afab-4fda-a717-536e6b79d8cd tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.365010 Aug 07 01:28:57.957056 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1686/3722] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:57 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:57.971050 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8a505988-da40-432c-93d7-678ce8e1ce62 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:57.972321 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8a505988-da40-432c-93d7-678ce8e1ce62 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:57.981284 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a505988-da40-432c-93d7-678ce8e1ce62 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:57.982244 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a505988-da40-432c-93d7-678ce8e1ce62 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:57.982892 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a505988-da40-432c-93d7-678ce8e1ce62 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:57.983948 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a505988-da40-432c-93d7-678ce8e1ce62 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:57.986429 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a505988-da40-432c-93d7-678ce8e1ce62 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:57.986931 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-149dbd8e-ed2e-49cc-844b-33d841a5254c tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:57.987617 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a505988-da40-432c-93d7-678ce8e1ce62 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:57.988111 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-149dbd8e-ed2e-49cc-844b-33d841a5254c tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:57.989385 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-149dbd8e-ed2e-49cc-844b-33d841a5254c tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:57.991333 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-149dbd8e-ed2e-49cc-844b-33d841a5254c tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:57.992154 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-149dbd8e-ed2e-49cc-844b-33d841a5254c tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:58.170713 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-149dbd8e-ed2e-49cc-844b-33d841a5254c tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:58.181121 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-149dbd8e-ed2e-49cc-844b-33d841a5254c tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1504 microversion: 2.1 time: 0.240067 Aug 07 01:28:58.181675 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2037/3723] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:57 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1504 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:58.187299 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d7af550f-facc-411b-bf04-d0aadf6b6407 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:58.187844 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d7af550f-facc-411b-bf04-d0aadf6b6407 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:58.194593 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d7af550f-facc-411b-bf04-d0aadf6b6407 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:58.196822 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d7af550f-facc-411b-bf04-d0aadf6b6407 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:58.197398 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d7af550f-facc-411b-bf04-d0aadf6b6407 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:58.198200 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d7af550f-facc-411b-bf04-d0aadf6b6407 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:58.198798 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d7af550f-facc-411b-bf04-d0aadf6b6407 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:58.199452 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d7af550f-facc-411b-bf04-d0aadf6b6407 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:58.290754 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8a505988-da40-432c-93d7-678ce8e1ce62 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:58.305715 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8a505988-da40-432c-93d7-678ce8e1ce62 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.347254 Aug 07 01:28:58.306444 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1687/3724] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:57 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:58.311465 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b5c7bd0d-37b8-413d-9ccb-bc6ff9f3837d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:58.312840 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b5c7bd0d-37b8-413d-9ccb-bc6ff9f3837d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: ce6c308a-7eb4-429f-ac41-9be9c4059355] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:58.319229 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5c7bd0d-37b8-413d-9ccb-bc6ff9f3837d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:58.320123 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5c7bd0d-37b8-413d-9ccb-bc6ff9f3837d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:58.320765 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5c7bd0d-37b8-413d-9ccb-bc6ff9f3837d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:58.321740 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5c7bd0d-37b8-413d-9ccb-bc6ff9f3837d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:58.322416 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5c7bd0d-37b8-413d-9ccb-bc6ff9f3837d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:58.322953 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5c7bd0d-37b8-413d-9ccb-bc6ff9f3837d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:58.355956 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b5c7bd0d-37b8-413d-9ccb-bc6ff9f3837d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: ce6c308a-7eb4-429f-ac41-9be9c4059355] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:28:58.375709 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d7af550f-facc-411b-bf04-d0aadf6b6407 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:58.386348 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d7af550f-facc-411b-bf04-d0aadf6b6407 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1315 microversion: 2.1 time: 0.203447 Aug 07 01:28:58.387080 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2038/3725] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:58 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:58.393040 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9986074b-38d9-495b-b437-9498fae64c08 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:58.393613 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9986074b-38d9-495b-b437-9498fae64c08 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:58.400909 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9986074b-38d9-495b-b437-9498fae64c08 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:58.401635 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9986074b-38d9-495b-b437-9498fae64c08 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:58.402829 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9986074b-38d9-495b-b437-9498fae64c08 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:58.403552 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9986074b-38d9-495b-b437-9498fae64c08 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:58.404380 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9986074b-38d9-495b-b437-9498fae64c08 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:58.405120 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9986074b-38d9-495b-b437-9498fae64c08 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:58.468990 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b5c7bd0d-37b8-413d-9ccb-bc6ff9f3837d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355" status: 204 len: 0 microversion: 2.1 time: 0.160718 Aug 07 01:28:58.470248 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1688/3726] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:28:58 2022] DELETE /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:28:58.483181 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6e338cfb-f667-4a90-8fd0-b8900f16f059 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:58.484175 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6e338cfb-f667-4a90-8fd0-b8900f16f059 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: fe84dcd7-e67e-4fa4-97d7-3df1e42af1ab] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:58.503345 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-6e338cfb-f667-4a90-8fd0-b8900f16f059 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] HTTP exception thrown: Instance fe84dcd7-e67e-4fa4-97d7-3df1e42af1ab could not be found. Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6e338cfb-f667-4a90-8fd0-b8900f16f059 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/servers/fe84dcd7-e67e-4fa4-97d7-3df1e42af1ab/action HTTP/1.1 Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 19 Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: {"forceDelete": {}} Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: exception: Instance fe84dcd7-e67e-4fa4-97d7-3df1e42af1ab could not be found. Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'fe84dcd7-e67e-4fa4-97d7-3df1e42af1ab', 'body': {'forceDelete': {}}} Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe84dcd7-e67e-4fa4-97d7-3df1e42af1ab could not be found. Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe84dcd7-e67e-4fa4-97d7-3df1e42af1ab could not be found. Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:58.514921 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:58.522527 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:28:58.522527 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:28:58.522527 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe84dcd7-e67e-4fa4-97d7-3df1e42af1ab could not be found. Aug 07 01:28:58.522527 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:28:58.522527 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6e338cfb-f667-4a90-8fd0-b8900f16f059 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 404 to user: Instance fe84dcd7-e67e-4fa4-97d7-3df1e42af1ab could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:28:58.522527 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6e338cfb-f667-4a90-8fd0-b8900f16f059 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers/fe84dcd7-e67e-4fa4-97d7-3df1e42af1ab/action" status: 404 len: 111 microversion: 2.1 time: 0.043441 Aug 07 01:28:58.522527 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1689/3727] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:28:58 2022] POST /compute/v2.1/servers/fe84dcd7-e67e-4fa4-97d7-3df1e42af1ab/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:28:58.529928 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2f94a630-e9a3-42b9-8b43-4d82a68d9d7b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:58.530551 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2f94a630-e9a3-42b9-8b43-4d82a68d9d7b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:58.546678 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f94a630-e9a3-42b9-8b43-4d82a68d9d7b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:58.547196 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f94a630-e9a3-42b9-8b43-4d82a68d9d7b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:58.547858 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f94a630-e9a3-42b9-8b43-4d82a68d9d7b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:58.548790 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f94a630-e9a3-42b9-8b43-4d82a68d9d7b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:58.549322 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f94a630-e9a3-42b9-8b43-4d82a68d9d7b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:58.549896 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f94a630-e9a3-42b9-8b43-4d82a68d9d7b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:58.587846 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9986074b-38d9-495b-b437-9498fae64c08 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:58.605532 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9986074b-38d9-495b-b437-9498fae64c08 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.216791 Aug 07 01:28:58.607477 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2039/3728] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:58 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:58.617821 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-30ada409-3eba-4d3f-b882-9f143f109deb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1167781869", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "aad9ba1b-e4bc-4046-88bb-e7d112e5c033"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:58.702851 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-30ada409-3eba-4d3f-b882-9f143f109deb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] validate_networks() for [('aad9ba1b-e4bc-4046-88bb-e7d112e5c033', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:28:58.873550 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2f94a630-e9a3-42b9-8b43-4d82a68d9d7b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:58.884607 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2f94a630-e9a3-42b9-8b43-4d82a68d9d7b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.362301 Aug 07 01:28:58.885823 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1690/3729] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:58 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:28:58.892406 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cfb53311-6146-4ca2-857c-3e94a2e9e4c4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:58.893274 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-cfb53311-6146-4ca2-857c-3e94a2e9e4c4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:58.902646 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cfb53311-6146-4ca2-857c-3e94a2e9e4c4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:58.903568 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cfb53311-6146-4ca2-857c-3e94a2e9e4c4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:58.904518 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cfb53311-6146-4ca2-857c-3e94a2e9e4c4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:58.905593 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cfb53311-6146-4ca2-857c-3e94a2e9e4c4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:58.906354 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cfb53311-6146-4ca2-857c-3e94a2e9e4c4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:58.906884 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cfb53311-6146-4ca2-857c-3e94a2e9e4c4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:59.257222 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-cfb53311-6146-4ca2-857c-3e94a2e9e4c4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:59.281143 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cfb53311-6146-4ca2-857c-3e94a2e9e4c4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.393027 Aug 07 01:28:59.283326 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1691/3730] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:58 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:59.290277 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-30ada409-3eba-4d3f-b882-9f143f109deb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:28:59.291962 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-30ada409-3eba-4d3f-b882-9f143f109deb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:28:59.293639 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-30ada409-3eba-4d3f-b882-9f143f109deb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:28:59.294409 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-30ada409-3eba-4d3f-b882-9f143f109deb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:28:59.295153 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-30ada409-3eba-4d3f-b882-9f143f109deb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:28:59.295628 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6b8001ed-226a-48f3-91e3-d093d62a6140 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:59.307511 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6b8001ed-226a-48f3-91e3-d093d62a6140 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:59.313941 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-30ada409-3eba-4d3f-b882-9f143f109deb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:59.314752 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-30ada409-3eba-4d3f-b882-9f143f109deb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:59.315490 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-30ada409-3eba-4d3f-b882-9f143f109deb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:59.316418 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-30ada409-3eba-4d3f-b882-9f143f109deb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:59.317037 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-30ada409-3eba-4d3f-b882-9f143f109deb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:59.317679 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-30ada409-3eba-4d3f-b882-9f143f109deb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:59.321541 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6b8001ed-226a-48f3-91e3-d093d62a6140 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:59.322424 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6b8001ed-226a-48f3-91e3-d093d62a6140 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:59.323238 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6b8001ed-226a-48f3-91e3-d093d62a6140 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:59.324707 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6b8001ed-226a-48f3-91e3-d093d62a6140 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:59.325716 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6b8001ed-226a-48f3-91e3-d093d62a6140 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:59.326434 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6b8001ed-226a-48f3-91e3-d093d62a6140 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:59.348803 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-30ada409-3eba-4d3f-b882-9f143f109deb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Getting quotas for project b7995a68f5a541aabda74c0b01f6aac9. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:28:59.357091 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-30ada409-3eba-4d3f-b882-9f143f109deb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Getting quotas for user a50140f86f00487b90d0503d4819234f and project b7995a68f5a541aabda74c0b01f6aac9. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:28:59.377372 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-30ada409-3eba-4d3f-b882-9f143f109deb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:28:59.381452 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-30ada409-3eba-4d3f-b882-9f143f109deb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: d9c8e298-f10a-4a99-9b30-00d1a0cc12b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:28:59.462159 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-30ada409-3eba-4d3f-b882-9f143f109deb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.852558 Aug 07 01:28:59.465011 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2040/3731] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:28:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:28:59.468573 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-af776e60-f168-4b07-9c8f-e56b462f32d6 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:59.469397 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-af776e60-f168-4b07-9c8f-e56b462f32d6 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:59.478113 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af776e60-f168-4b07-9c8f-e56b462f32d6 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:59.478884 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af776e60-f168-4b07-9c8f-e56b462f32d6 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:59.479573 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af776e60-f168-4b07-9c8f-e56b462f32d6 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:59.481559 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af776e60-f168-4b07-9c8f-e56b462f32d6 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:59.482005 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af776e60-f168-4b07-9c8f-e56b462f32d6 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:59.493588 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af776e60-f168-4b07-9c8f-e56b462f32d6 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:59.532250 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:59.613745 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6b8001ed-226a-48f3-91e3-d093d62a6140 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:59.625391 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6b8001ed-226a-48f3-91e3-d093d62a6140 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.339860 Aug 07 01:28:59.640397 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1692/3732] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:59 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:59.640913 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c2d64eda-ed31-4aec-b4e1-fa83d2b72c5b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:59.641618 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c2d64eda-ed31-4aec-b4e1-fa83d2b72c5b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:59.652811 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2d64eda-ed31-4aec-b4e1-fa83d2b72c5b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:59.653689 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2d64eda-ed31-4aec-b4e1-fa83d2b72c5b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:59.654417 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2d64eda-ed31-4aec-b4e1-fa83d2b72c5b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:59.655584 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2d64eda-ed31-4aec-b4e1-fa83d2b72c5b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:59.656629 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2d64eda-ed31-4aec-b4e1-fa83d2b72c5b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:59.657438 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2d64eda-ed31-4aec-b4e1-fa83d2b72c5b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:59.776852 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-af776e60-f168-4b07-9c8f-e56b462f32d6 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:59.784655 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-af776e60-f168-4b07-9c8f-e56b462f32d6 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1504 microversion: 2.1 time: 0.320838 Aug 07 01:28:59.785316 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2041/3733] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:59 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1504 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:59.800956 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5c1e485c-37ee-475e-951e-a1b78d3a7f21 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:59.801926 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5c1e485c-37ee-475e-951e-a1b78d3a7f21 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: d9c8e298-f10a-4a99-9b30-00d1a0cc12b5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:59.869302 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5c1e485c-37ee-475e-951e-a1b78d3a7f21 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:28:59.878363 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5c1e485c-37ee-475e-951e-a1b78d3a7f21 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5" status: 200 len: 1208 microversion: 2.1 time: 0.081316 Aug 07 01:28:59.879364 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2042/3734] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:59 2022] GET /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5 => generated 1208 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:28:59.885176 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d131dcd8-80c1-4a2a-bd2c-67b0e028de4c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:28:59.888168 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d131dcd8-80c1-4a2a-bd2c-67b0e028de4c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: c3c97de7-3ab7-4716-a9b3-4b845b0e3ccc] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:59.897375 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-d131dcd8-80c1-4a2a-bd2c-67b0e028de4c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] HTTP exception thrown: Instance c3c97de7-3ab7-4716-a9b3-4b845b0e3ccc could not be found. Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d131dcd8-80c1-4a2a-bd2c-67b0e028de4c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers/c3c97de7-3ab7-4716-a9b3-4b845b0e3ccc/action HTTP/1.1 Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 39 Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: {"os-getConsoleOutput": {"length": 10}} Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: exception: Instance c3c97de7-3ab7-4716-a9b3-4b845b0e3ccc could not be found. Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'c3c97de7-3ab7-4716-a9b3-4b845b0e3ccc', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3c97de7-3ab7-4716-a9b3-4b845b0e3ccc could not be found. Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3c97de7-3ab7-4716-a9b3-4b845b0e3ccc could not be found. Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:59.900878 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:28:59.909175 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:28:59.909175 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:28:59.909175 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:28:59.909175 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:28:59.909175 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3c97de7-3ab7-4716-a9b3-4b845b0e3ccc could not be found. Aug 07 01:28:59.909175 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:28:59.909175 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d131dcd8-80c1-4a2a-bd2c-67b0e028de4c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 404 to user: Instance c3c97de7-3ab7-4716-a9b3-4b845b0e3ccc could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:28:59.909175 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d131dcd8-80c1-4a2a-bd2c-67b0e028de4c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers/c3c97de7-3ab7-4716-a9b3-4b845b0e3ccc/action" status: 404 len: 111 microversion: 2.1 time: 0.025675 Aug 07 01:28:59.909175 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2043/3735] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:28:59 2022] POST /compute/v2.1/servers/c3c97de7-3ab7-4716-a9b3-4b845b0e3ccc/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:28:59.919689 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-39328481-29e7-47d1-9b22-b79c8f82802c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:28:59.920484 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-39328481-29e7-47d1-9b22-b79c8f82802c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:28:59.928335 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-39328481-29e7-47d1-9b22-b79c8f82802c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:59.929285 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-39328481-29e7-47d1-9b22-b79c8f82802c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:59.929744 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-39328481-29e7-47d1-9b22-b79c8f82802c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:28:59.930495 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-39328481-29e7-47d1-9b22-b79c8f82802c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:28:59.930971 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-39328481-29e7-47d1-9b22-b79c8f82802c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:28:59.931460 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-39328481-29e7-47d1-9b22-b79c8f82802c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:00.110798 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-39328481-29e7-47d1-9b22-b79c8f82802c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:00.122050 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-39328481-29e7-47d1-9b22-b79c8f82802c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.208448 Aug 07 01:29:00.122894 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2044/3736] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:59 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:00.145904 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5e98e557-3992-451a-86e8-b3d1c2f77ea4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:00.147304 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5e98e557-3992-451a-86e8-b3d1c2f77ea4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:00.153981 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e98e557-3992-451a-86e8-b3d1c2f77ea4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:00.154587 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e98e557-3992-451a-86e8-b3d1c2f77ea4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:00.155129 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e98e557-3992-451a-86e8-b3d1c2f77ea4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:00.155985 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e98e557-3992-451a-86e8-b3d1c2f77ea4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:00.156599 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e98e557-3992-451a-86e8-b3d1c2f77ea4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:00.157333 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e98e557-3992-451a-86e8-b3d1c2f77ea4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:00.295655 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c2d64eda-ed31-4aec-b4e1-fa83d2b72c5b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:00.305451 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c2d64eda-ed31-4aec-b4e1-fa83d2b72c5b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1502 microversion: 2.1 time: 0.675062 Aug 07 01:29:00.306394 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1693/3737] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:28:59 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1502 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:00.316233 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5e98e557-3992-451a-86e8-b3d1c2f77ea4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:00.326559 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5e98e557-3992-451a-86e8-b3d1c2f77ea4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.184818 Aug 07 01:29:00.328959 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2a6dc5cf-3ed1-44b6-9c0b-2bb63236732a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:00.329711 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2a6dc5cf-3ed1-44b6-9c0b-2bb63236732a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:00.335445 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2045/3738] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:00 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:00.337874 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2a6dc5cf-3ed1-44b6-9c0b-2bb63236732a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:00.338367 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2a6dc5cf-3ed1-44b6-9c0b-2bb63236732a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:00.338800 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2a6dc5cf-3ed1-44b6-9c0b-2bb63236732a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:00.339741 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2a6dc5cf-3ed1-44b6-9c0b-2bb63236732a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:00.340672 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2a6dc5cf-3ed1-44b6-9c0b-2bb63236732a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:00.341837 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2a6dc5cf-3ed1-44b6-9c0b-2bb63236732a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:00.349110 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5b74a8d9-3171-4be5-88f2-016f3748e583 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:00.349733 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5b74a8d9-3171-4be5-88f2-016f3748e583 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 1b13a25c-16e8-42b7-97f6-f524bc999694] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:00.357962 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-5b74a8d9-3171-4be5-88f2-016f3748e583 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] HTTP exception thrown: Instance 1b13a25c-16e8-42b7-97f6-f524bc999694 could not be found. Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5b74a8d9-3171-4be5-88f2-016f3748e583 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/1b13a25c-16e8-42b7-97f6-f524bc999694 HTTP/1.1 Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 1b13a25c-16e8-42b7-97f6-f524bc999694 could not be found. Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '1b13a25c-16e8-42b7-97f6-f524bc999694'} Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b13a25c-16e8-42b7-97f6-f524bc999694 could not be found. Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b13a25c-16e8-42b7-97f6-f524bc999694 could not be found. Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:00.359682 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:00.368855 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:00.368855 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:29:00.368855 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:29:00.368855 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b13a25c-16e8-42b7-97f6-f524bc999694 could not be found. Aug 07 01:29:00.368855 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:00.368855 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5b74a8d9-3171-4be5-88f2-016f3748e583 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 404 to user: Instance 1b13a25c-16e8-42b7-97f6-f524bc999694 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:29:00.368855 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5b74a8d9-3171-4be5-88f2-016f3748e583 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/1b13a25c-16e8-42b7-97f6-f524bc999694" status: 404 len: 111 microversion: 2.1 time: 0.016360 Aug 07 01:29:00.368855 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2046/3739] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:00 2022] GET /compute/v2.1/servers/1b13a25c-16e8-42b7-97f6-f524bc999694 => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:29:00.370024 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-296d0c6a-699b-4d4a-b7bc-fb9b52687143 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:00.371204 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-296d0c6a-699b-4d4a-b7bc-fb9b52687143 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:00.372944 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-2a6dc5cf-3ed1-44b6-9c0b-2bb63236732a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lazy-loading 'flavor' on Instance uuid aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:29:00.379009 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-296d0c6a-699b-4d4a-b7bc-fb9b52687143 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:00.379606 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-296d0c6a-699b-4d4a-b7bc-fb9b52687143 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:00.380149 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-296d0c6a-699b-4d4a-b7bc-fb9b52687143 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:00.381343 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-296d0c6a-699b-4d4a-b7bc-fb9b52687143 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:00.381343 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-296d0c6a-699b-4d4a-b7bc-fb9b52687143 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:00.382097 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-296d0c6a-699b-4d4a-b7bc-fb9b52687143 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:00.553660 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-296d0c6a-699b-4d4a-b7bc-fb9b52687143 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:00.564891 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-296d0c6a-699b-4d4a-b7bc-fb9b52687143 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.198392 Aug 07 01:29:00.566305 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2047/3740] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:00 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:00.587353 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-339f2ee8-45af-4025-8e93-f8c41cac4b1b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:00.588356 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-339f2ee8-45af-4025-8e93-f8c41cac4b1b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:00.596311 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-339f2ee8-45af-4025-8e93-f8c41cac4b1b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:00.597246 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-339f2ee8-45af-4025-8e93-f8c41cac4b1b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:00.597914 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-339f2ee8-45af-4025-8e93-f8c41cac4b1b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:00.599034 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-339f2ee8-45af-4025-8e93-f8c41cac4b1b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:00.599520 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-339f2ee8-45af-4025-8e93-f8c41cac4b1b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:00.599996 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-339f2ee8-45af-4025-8e93-f8c41cac4b1b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:00.613046 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2a6dc5cf-3ed1-44b6-9c0b-2bb63236732a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "POST /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1/action" status: 202 len: 0 microversion: 2.1 time: 0.288736 Aug 07 01:29:00.614471 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1694/3741] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:29:00 2022] POST /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 01:29:00.631732 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ae5e3ed6-b83d-44c9-be00-885601813d9d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:00.633066 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ae5e3ed6-b83d-44c9-be00-885601813d9d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:00.645529 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ae5e3ed6-b83d-44c9-be00-885601813d9d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:00.646845 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ae5e3ed6-b83d-44c9-be00-885601813d9d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:00.647817 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ae5e3ed6-b83d-44c9-be00-885601813d9d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:00.649649 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ae5e3ed6-b83d-44c9-be00-885601813d9d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:00.650895 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ae5e3ed6-b83d-44c9-be00-885601813d9d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:00.651767 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ae5e3ed6-b83d-44c9-be00-885601813d9d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:00.798822 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-339f2ee8-45af-4025-8e93-f8c41cac4b1b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:00.807360 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-339f2ee8-45af-4025-8e93-f8c41cac4b1b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.223839 Aug 07 01:29:00.809142 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2048/3742] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:00 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:29:00.813615 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-af57f379-119e-427b-9f3c-f7fb913aeb54 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:00.814223 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-af57f379-119e-427b-9f3c-f7fb913aeb54 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:00.820300 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af57f379-119e-427b-9f3c-f7fb913aeb54 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:00.821024 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af57f379-119e-427b-9f3c-f7fb913aeb54 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:00.821624 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af57f379-119e-427b-9f3c-f7fb913aeb54 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:00.822511 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af57f379-119e-427b-9f3c-f7fb913aeb54 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:00.823131 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af57f379-119e-427b-9f3c-f7fb913aeb54 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:00.823837 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af57f379-119e-427b-9f3c-f7fb913aeb54 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:00.905559 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ae5e3ed6-b83d-44c9-be00-885601813d9d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:00.920192 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ae5e3ed6-b83d-44c9-be00-885601813d9d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1508 microversion: 2.1 time: 0.295075 Aug 07 01:29:00.931912 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1695/3743] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:00 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1508 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:00.931912 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2c09fc7b-c630-4a92-8de5-145d3a555f22 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-166917179", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "cf9a6ffb-a1bc-4f16-8970-9d69635f8f75"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2c09fc7b-c630-4a92-8de5-145d3a555f22 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 237 Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-166917179", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "cf9a6ffb-a1bc-4f16-8970-9d69635f8f75"}]}} Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-166917179', 'imageRef': 'e825bd61-bf05-4bd4-aa72-78daf2231731', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'cf9a6ffb-a1bc-4f16-8970-9d69635f8f75'}]}}} Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:00.952581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:00.957663 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:00.957663 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:00.957663 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:29:00.957663 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:29:00.957663 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:29:00.957663 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:29:00.957663 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:29:00.957663 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:29:00.957663 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:29:00.957663 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:29:00.957663 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:29:00.957663 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:29:00.957663 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:29:00.957663 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:29:00.957663 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 07 01:29:00.957663 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:00.957663 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:00.957663 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:00.957663 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:00.957663 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:00.957663 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:00.957663 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:29:00.957663 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:29:00.957663 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 07 01:29:00.957663 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:00.957663 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2c09fc7b-c630-4a92-8de5-145d3a555f22 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:29:00.957663 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2c09fc7b-c630-4a92-8de5-145d3a555f22 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.031405 Aug 07 01:29:00.957663 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1696/3744] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:29:00 2022] POST /compute/v2.1/servers => generated 139 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:29:00.968210 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-70fee9b5-bb8d-4794-abc4-91d25b8af62c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:00.969132 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-70fee9b5-bb8d-4794-abc4-91d25b8af62c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: d9c8e298-f10a-4a99-9b30-00d1a0cc12b5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:00.972995 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-af57f379-119e-427b-9f3c-f7fb913aeb54 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:00.978772 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-70fee9b5-bb8d-4794-abc4-91d25b8af62c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:00.979455 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-70fee9b5-bb8d-4794-abc4-91d25b8af62c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:00.980935 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-70fee9b5-bb8d-4794-abc4-91d25b8af62c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:00.981866 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-70fee9b5-bb8d-4794-abc4-91d25b8af62c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:00.982326 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-70fee9b5-bb8d-4794-abc4-91d25b8af62c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:00.982758 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-70fee9b5-bb8d-4794-abc4-91d25b8af62c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:00.986850 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-af57f379-119e-427b-9f3c-f7fb913aeb54 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1504 microversion: 2.1 time: 0.176784 Aug 07 01:29:00.988505 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2049/3745] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:00 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1504 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:00.993488 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1afd803a-ac90-4812-94c2-64154e724f0f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:00.994700 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1afd803a-ac90-4812-94c2-64154e724f0f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:01.004427 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1afd803a-ac90-4812-94c2-64154e724f0f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:01.004929 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1afd803a-ac90-4812-94c2-64154e724f0f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:01.005419 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1afd803a-ac90-4812-94c2-64154e724f0f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:01.006332 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1afd803a-ac90-4812-94c2-64154e724f0f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:01.007083 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1afd803a-ac90-4812-94c2-64154e724f0f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:01.007734 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1afd803a-ac90-4812-94c2-64154e724f0f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:01.102398 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-70fee9b5-bb8d-4794-abc4-91d25b8af62c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:01.113921 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-70fee9b5-bb8d-4794-abc4-91d25b8af62c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5" status: 200 len: 1260 microversion: 2.1 time: 0.157071 Aug 07 01:29:01.114965 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1697/3746] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:00 2022] GET /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:01.211856 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1afd803a-ac90-4812-94c2-64154e724f0f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:01.223781 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1afd803a-ac90-4812-94c2-64154e724f0f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.233826 Aug 07 01:29:01.224577 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2050/3747] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:00 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:01.250398 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-320fc9e3-4b66-4efc-b421-e472e3b06358 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:01.251745 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-320fc9e3-4b66-4efc-b421-e472e3b06358 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:01.259114 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-320fc9e3-4b66-4efc-b421-e472e3b06358 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:01.260806 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-320fc9e3-4b66-4efc-b421-e472e3b06358 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:01.262084 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-320fc9e3-4b66-4efc-b421-e472e3b06358 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:01.263027 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-320fc9e3-4b66-4efc-b421-e472e3b06358 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:01.263694 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-320fc9e3-4b66-4efc-b421-e472e3b06358 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:01.264374 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-320fc9e3-4b66-4efc-b421-e472e3b06358 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:01.631580 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-320fc9e3-4b66-4efc-b421-e472e3b06358 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:01.636536 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:01.643365 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-320fc9e3-4b66-4efc-b421-e472e3b06358 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.399503 Aug 07 01:29:01.654316 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1698/3748] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:01 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:01.730399 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1623161f-043c-4f6e-8ef2-93a03818c9c8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1721977267", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "cf9a6ffb-a1bc-4f16-8970-9d69635f8f75"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1623161f-043c-4f6e-8ef2-93a03818c9c8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 235 Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1721977267", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "cf9a6ffb-a1bc-4f16-8970-9d69635f8f75"}]}} Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1721977267', 'imageRef': 'e825bd61-bf05-4bd4-aa72-78daf2231731', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'cf9a6ffb-a1bc-4f16-8970-9d69635f8f75'}]}}} Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:01.740739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:01.749064 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:01.749064 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:01.749064 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:29:01.749064 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:29:01.749064 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:29:01.749064 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:29:01.749064 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:29:01.749064 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:29:01.749064 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:29:01.749064 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:29:01.749064 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:29:01.749064 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:29:01.749064 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:29:01.749064 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:29:01.749064 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 07 01:29:01.749064 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:01.749064 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:01.749064 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:01.749064 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:01.749064 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:01.749064 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:01.749064 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:29:01.749064 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:29:01.749064 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 07 01:29:01.749064 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:01.749064 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1623161f-043c-4f6e-8ef2-93a03818c9c8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:29:01.749064 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1623161f-043c-4f6e-8ef2-93a03818c9c8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.025607 Aug 07 01:29:01.752600 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2051/3749] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:29:01 2022] POST /compute/v2.1/servers => generated 133 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:29:01.756172 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-87f297cd-d2da-484b-9960-66ffc6733c14 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:01.756801 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-87f297cd-d2da-484b-9960-66ffc6733c14 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:01.768346 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-87f297cd-d2da-484b-9960-66ffc6733c14 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:01.768963 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-87f297cd-d2da-484b-9960-66ffc6733c14 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:01.769553 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-87f297cd-d2da-484b-9960-66ffc6733c14 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:01.770290 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-87f297cd-d2da-484b-9960-66ffc6733c14 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:01.770819 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-87f297cd-d2da-484b-9960-66ffc6733c14 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:01.772270 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-87f297cd-d2da-484b-9960-66ffc6733c14 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:01.949722 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7113f76e-a9c5-40ea-af77-8e3ab75f264c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:01.950514 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7113f76e-a9c5-40ea-af77-8e3ab75f264c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:02.003827 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7113f76e-a9c5-40ea-af77-8e3ab75f264c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:02.004700 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7113f76e-a9c5-40ea-af77-8e3ab75f264c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:02.005248 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7113f76e-a9c5-40ea-af77-8e3ab75f264c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:02.006099 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7113f76e-a9c5-40ea-af77-8e3ab75f264c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:02.006920 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7113f76e-a9c5-40ea-af77-8e3ab75f264c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:02.007596 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7113f76e-a9c5-40ea-af77-8e3ab75f264c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:02.205998 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-87f297cd-d2da-484b-9960-66ffc6733c14 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:02.220606 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-87f297cd-d2da-484b-9960-66ffc6733c14 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.468307 Aug 07 01:29:02.221487 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1699/3750] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:01 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:02.226283 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-53b7b96f-3afb-4e5b-8fd7-309cca94437f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:02.237035 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-53b7b96f-3afb-4e5b-8fd7-309cca94437f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:02.246378 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53b7b96f-3afb-4e5b-8fd7-309cca94437f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:02.247204 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53b7b96f-3afb-4e5b-8fd7-309cca94437f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:02.247865 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53b7b96f-3afb-4e5b-8fd7-309cca94437f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:02.248809 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53b7b96f-3afb-4e5b-8fd7-309cca94437f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:02.249549 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53b7b96f-3afb-4e5b-8fd7-309cca94437f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:02.250162 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53b7b96f-3afb-4e5b-8fd7-309cca94437f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:02.287681 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7113f76e-a9c5-40ea-af77-8e3ab75f264c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:02.301015 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7113f76e-a9c5-40ea-af77-8e3ab75f264c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1508 microversion: 2.1 time: 0.360466 Aug 07 01:29:02.315946 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2052/3751] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:01 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1508 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:29:02.323425 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-b8ab5c8a-0d7c-4a0b-aef2-7f46f8b22e16 req-85ce4132-3021-484c-9840-b0dfa3e641d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce6c308a-7eb4-429f-ac41-9be9c4059355", "name": "network-vif-deleted", "tag": "5948aeb6-19cc-4823-b3f6-0002d62e04ea"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:02.335268 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b8ab5c8a-0d7c-4a0b-aef2-7f46f8b22e16 req-85ce4132-3021-484c-9840-b0dfa3e641d9 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:02.335764 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b8ab5c8a-0d7c-4a0b-aef2-7f46f8b22e16 req-85ce4132-3021-484c-9840-b0dfa3e641d9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:02.336266 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b8ab5c8a-0d7c-4a0b-aef2-7f46f8b22e16 req-85ce4132-3021-484c-9840-b0dfa3e641d9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:02.349292 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-b8ab5c8a-0d7c-4a0b-aef2-7f46f8b22e16 req-85ce4132-3021-484c-9840-b0dfa3e641d9 service nova] Creating event network-vif-deleted:5948aeb6-19cc-4823-b3f6-0002d62e04ea for instance ce6c308a-7eb4-429f-ac41-9be9c4059355 on n-h1-master-1 Aug 07 01:29:02.357780 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-b8ab5c8a-0d7c-4a0b-aef2-7f46f8b22e16 req-85ce4132-3021-484c-9840-b0dfa3e641d9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042797 Aug 07 01:29:02.358778 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2053/3752] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:29:02.364469 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9153482f-c016-4288-9182-f72747c5f1fe tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:02.365188 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9153482f-c016-4288-9182-f72747c5f1fe tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: d9c8e298-f10a-4a99-9b30-00d1a0cc12b5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:02.376991 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9153482f-c016-4288-9182-f72747c5f1fe tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:02.377225 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9153482f-c016-4288-9182-f72747c5f1fe tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:02.377886 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9153482f-c016-4288-9182-f72747c5f1fe tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:02.378767 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9153482f-c016-4288-9182-f72747c5f1fe tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:02.379314 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9153482f-c016-4288-9182-f72747c5f1fe tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:02.379960 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9153482f-c016-4288-9182-f72747c5f1fe tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:02.578755 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-53b7b96f-3afb-4e5b-8fd7-309cca94437f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:02.600581 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-53b7b96f-3afb-4e5b-8fd7-309cca94437f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1504 microversion: 2.1 time: 0.373842 Aug 07 01:29:02.601811 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1700/3753] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:02 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1504 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:02.609445 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-645dbef9-221f-428e-8097-62fc5650c386 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:02.610139 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-645dbef9-221f-428e-8097-62fc5650c386 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:02.618786 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-645dbef9-221f-428e-8097-62fc5650c386 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:02.619640 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-645dbef9-221f-428e-8097-62fc5650c386 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:02.621784 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-645dbef9-221f-428e-8097-62fc5650c386 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:02.643899 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-645dbef9-221f-428e-8097-62fc5650c386 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:02.644629 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-645dbef9-221f-428e-8097-62fc5650c386 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:02.645101 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-645dbef9-221f-428e-8097-62fc5650c386 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:02.736635 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9153482f-c016-4288-9182-f72747c5f1fe tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:02.748775 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9153482f-c016-4288-9182-f72747c5f1fe tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5" status: 200 len: 1308 microversion: 2.1 time: 0.387582 Aug 07 01:29:02.759365 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2054/3754] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:02 2022] GET /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5 => generated 1308 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:02.958021 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-645dbef9-221f-428e-8097-62fc5650c386 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:02.977217 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-645dbef9-221f-428e-8097-62fc5650c386 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.373851 Aug 07 01:29:02.978338 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1701/3755] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:02 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:02.998815 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b939eafe-2a36-4563-a932-f6d03b2f15b0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:03.004831 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b939eafe-2a36-4563-a932-f6d03b2f15b0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: f4522654-3bf0-4047-b65d-f0f41f27f1f4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:03.014079 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-b939eafe-2a36-4563-a932-f6d03b2f15b0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] HTTP exception thrown: Instance f4522654-3bf0-4047-b65d-f0f41f27f1f4 could not be found. Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b939eafe-2a36-4563-a932-f6d03b2f15b0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers/f4522654-3bf0-4047-b65d-f0f41f27f1f4/action HTTP/1.1 Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 13 Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: {"pause": {}} Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: exception: Instance f4522654-3bf0-4047-b65d-f0f41f27f1f4 could not be found. Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'f4522654-3bf0-4047-b65d-f0f41f27f1f4', 'body': {'pause': {}}} Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4522654-3bf0-4047-b65d-f0f41f27f1f4 could not be found. Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4522654-3bf0-4047-b65d-f0f41f27f1f4 could not be found. Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:03.018733 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:03.025337 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:29:03.025337 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:29:03.025337 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4522654-3bf0-4047-b65d-f0f41f27f1f4 could not be found. Aug 07 01:29:03.025337 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:03.025337 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b939eafe-2a36-4563-a932-f6d03b2f15b0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 404 to user: Instance f4522654-3bf0-4047-b65d-f0f41f27f1f4 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:29:03.025337 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b939eafe-2a36-4563-a932-f6d03b2f15b0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers/f4522654-3bf0-4047-b65d-f0f41f27f1f4/action" status: 404 len: 111 microversion: 2.1 time: 0.027396 Aug 07 01:29:03.025337 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2055/3756] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:29:02 2022] POST /compute/v2.1/servers/f4522654-3bf0-4047-b65d-f0f41f27f1f4/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:29:03.036184 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2d804d82-77b0-40e4-92f5-99b6fe5698cb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:03.036806 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2d804d82-77b0-40e4-92f5-99b6fe5698cb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:03.044653 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d804d82-77b0-40e4-92f5-99b6fe5698cb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:03.045140 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d804d82-77b0-40e4-92f5-99b6fe5698cb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:03.045585 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d804d82-77b0-40e4-92f5-99b6fe5698cb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:03.046290 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d804d82-77b0-40e4-92f5-99b6fe5698cb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:03.046744 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d804d82-77b0-40e4-92f5-99b6fe5698cb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:03.047161 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d804d82-77b0-40e4-92f5-99b6fe5698cb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:03.332635 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cbcdca1c-c8d1-41e0-a676-ef6ee383c8d2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:03.334842 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cbcdca1c-c8d1-41e0-a676-ef6ee383c8d2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:03.343060 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cbcdca1c-c8d1-41e0-a676-ef6ee383c8d2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:03.343697 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cbcdca1c-c8d1-41e0-a676-ef6ee383c8d2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:03.344381 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cbcdca1c-c8d1-41e0-a676-ef6ee383c8d2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:03.345376 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cbcdca1c-c8d1-41e0-a676-ef6ee383c8d2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:03.345907 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cbcdca1c-c8d1-41e0-a676-ef6ee383c8d2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:03.346451 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cbcdca1c-c8d1-41e0-a676-ef6ee383c8d2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:03.502919 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2d804d82-77b0-40e4-92f5-99b6fe5698cb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:03.512345 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2d804d82-77b0-40e4-92f5-99b6fe5698cb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.480421 Aug 07 01:29:03.512944 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1702/3757] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:03 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:03.536200 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b904fa40-def0-4e5b-a6af-421e773ee770 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:03.537131 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b904fa40-def0-4e5b-a6af-421e773ee770 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:03.557647 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b904fa40-def0-4e5b-a6af-421e773ee770 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:03.558197 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b904fa40-def0-4e5b-a6af-421e773ee770 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:03.558649 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b904fa40-def0-4e5b-a6af-421e773ee770 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:03.559379 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b904fa40-def0-4e5b-a6af-421e773ee770 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:03.559843 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b904fa40-def0-4e5b-a6af-421e773ee770 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:03.560303 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b904fa40-def0-4e5b-a6af-421e773ee770 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:03.650656 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cbcdca1c-c8d1-41e0-a676-ef6ee383c8d2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:03.666270 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cbcdca1c-c8d1-41e0-a676-ef6ee383c8d2 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1508 microversion: 2.1 time: 0.343983 Aug 07 01:29:03.668038 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2056/3758] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:03 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1508 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:29:03.673743 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6011c616-4893-4a6c-b91d-d408dd772123 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:03.675525 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6011c616-4893-4a6c-b91d-d408dd772123 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:03.687094 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6011c616-4893-4a6c-b91d-d408dd772123 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:03.687996 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6011c616-4893-4a6c-b91d-d408dd772123 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:03.688882 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6011c616-4893-4a6c-b91d-d408dd772123 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:03.689961 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6011c616-4893-4a6c-b91d-d408dd772123 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:03.690742 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6011c616-4893-4a6c-b91d-d408dd772123 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:03.691400 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6011c616-4893-4a6c-b91d-d408dd772123 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:03.880738 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b904fa40-def0-4e5b-a6af-421e773ee770 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:03.893228 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b904fa40-def0-4e5b-a6af-421e773ee770 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.361631 Aug 07 01:29:03.910566 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1703/3759] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:03 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:03.918061 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b395300d-37c2-4e27-af65-46f30e0c5e60 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:03.919542 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b395300d-37c2-4e27-af65-46f30e0c5e60 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: d9c8e298-f10a-4a99-9b30-00d1a0cc12b5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:03.926411 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b395300d-37c2-4e27-af65-46f30e0c5e60 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:03.927276 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b395300d-37c2-4e27-af65-46f30e0c5e60 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:03.927844 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b395300d-37c2-4e27-af65-46f30e0c5e60 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:03.928893 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b395300d-37c2-4e27-af65-46f30e0c5e60 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:03.929974 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b395300d-37c2-4e27-af65-46f30e0c5e60 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:03.930628 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b395300d-37c2-4e27-af65-46f30e0c5e60 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:03.952326 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6011c616-4893-4a6c-b91d-d408dd772123 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:03.969329 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6011c616-4893-4a6c-b91d-d408dd772123 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1504 microversion: 2.1 time: 0.299854 Aug 07 01:29:03.970466 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2057/3760] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:03 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1504 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:03.994873 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-394ddc54-2c7b-4ed3-a9b2-37864ce0a70d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:03.996779 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-394ddc54-2c7b-4ed3-a9b2-37864ce0a70d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:04.008175 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-394ddc54-2c7b-4ed3-a9b2-37864ce0a70d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:04.009081 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-394ddc54-2c7b-4ed3-a9b2-37864ce0a70d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:04.011492 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-394ddc54-2c7b-4ed3-a9b2-37864ce0a70d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:04.012478 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-394ddc54-2c7b-4ed3-a9b2-37864ce0a70d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:04.013173 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-394ddc54-2c7b-4ed3-a9b2-37864ce0a70d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:04.014921 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-394ddc54-2c7b-4ed3-a9b2-37864ce0a70d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:04.116668 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-394ddc54-2c7b-4ed3-a9b2-37864ce0a70d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015/action" status: 202 len: 0 microversion: 2.1 time: 0.143976 Aug 07 01:29:04.117287 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2058/3761] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:29:03 2022] POST /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:29:04.135928 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-bda3ab3c-fd3e-4458-b199-f608a9e00faa req-f95cbd23-6cf3-4750-9917-3c85f2a797e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9c8e298-f10a-4a99-9b30-00d1a0cc12b5", "tag": "8cdc75fb-4acd-4c53-a858-7be2c2e39a11"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:04.152038 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:04.154919 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-bda3ab3c-fd3e-4458-b199-f608a9e00faa req-f95cbd23-6cf3-4750-9917-3c85f2a797e8 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:04.155485 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-bda3ab3c-fd3e-4458-b199-f608a9e00faa req-f95cbd23-6cf3-4750-9917-3c85f2a797e8 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:04.156069 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-bda3ab3c-fd3e-4458-b199-f608a9e00faa req-f95cbd23-6cf3-4750-9917-3c85f2a797e8 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:04.173183 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-bda3ab3c-fd3e-4458-b199-f608a9e00faa req-f95cbd23-6cf3-4750-9917-3c85f2a797e8 service nova] Creating event network-changed:8cdc75fb-4acd-4c53-a858-7be2c2e39a11 for instance d9c8e298-f10a-4a99-9b30-00d1a0cc12b5 on n-h1-master-1 Aug 07 01:29:04.178724 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-bda3ab3c-fd3e-4458-b199-f608a9e00faa req-f95cbd23-6cf3-4750-9917-3c85f2a797e8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059605 Aug 07 01:29:04.179722 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2059/3762] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:29:04.180441 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b395300d-37c2-4e27-af65-46f30e0c5e60 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:04.185933 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d00ea3bc-690a-4b7a-b73f-e6c7a88f6ada tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:04.186703 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d00ea3bc-690a-4b7a-b73f-e6c7a88f6ada tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:04.198026 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b395300d-37c2-4e27-af65-46f30e0c5e60 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5" status: 200 len: 1308 microversion: 2.1 time: 0.285851 Aug 07 01:29:04.200236 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1704/3763] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:03 2022] GET /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5 => generated 1308 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:04.200443 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d00ea3bc-690a-4b7a-b73f-e6c7a88f6ada tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:04.200443 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d00ea3bc-690a-4b7a-b73f-e6c7a88f6ada tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:04.200614 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d00ea3bc-690a-4b7a-b73f-e6c7a88f6ada tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:04.201309 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d00ea3bc-690a-4b7a-b73f-e6c7a88f6ada tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:04.201771 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d00ea3bc-690a-4b7a-b73f-e6c7a88f6ada tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:04.202200 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d00ea3bc-690a-4b7a-b73f-e6c7a88f6ada tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:04.443768 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d00ea3bc-690a-4b7a-b73f-e6c7a88f6ada tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:04.456764 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d00ea3bc-690a-4b7a-b73f-e6c7a88f6ada tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1511 microversion: 2.1 time: 0.275501 Aug 07 01:29:04.459999 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2060/3764] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:04 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1511 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:04.689541 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-00a7a2d7-efdb-4cfe-8f60-26adb14ce3d8 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:04.690437 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-00a7a2d7-efdb-4cfe-8f60-26adb14ce3d8 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:04.697464 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00a7a2d7-efdb-4cfe-8f60-26adb14ce3d8 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:04.697968 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00a7a2d7-efdb-4cfe-8f60-26adb14ce3d8 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:04.698686 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00a7a2d7-efdb-4cfe-8f60-26adb14ce3d8 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:04.699435 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00a7a2d7-efdb-4cfe-8f60-26adb14ce3d8 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:04.699906 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00a7a2d7-efdb-4cfe-8f60-26adb14ce3d8 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:04.700343 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00a7a2d7-efdb-4cfe-8f60-26adb14ce3d8 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:04.916591 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-00a7a2d7-efdb-4cfe-8f60-26adb14ce3d8 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:04.925331 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-00a7a2d7-efdb-4cfe-8f60-26adb14ce3d8 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1508 microversion: 2.1 time: 0.239575 Aug 07 01:29:04.925934 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1705/3765] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:04 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1508 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:04.995113 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d016676c-41d7-4328-a02f-72cd60cca545 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:04.995801 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d016676c-41d7-4328-a02f-72cd60cca545 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:05.002040 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d016676c-41d7-4328-a02f-72cd60cca545 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:05.002527 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d016676c-41d7-4328-a02f-72cd60cca545 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:05.002994 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d016676c-41d7-4328-a02f-72cd60cca545 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:05.003753 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d016676c-41d7-4328-a02f-72cd60cca545 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:05.004176 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d016676c-41d7-4328-a02f-72cd60cca545 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:05.004602 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d016676c-41d7-4328-a02f-72cd60cca545 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:05.206536 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d016676c-41d7-4328-a02f-72cd60cca545 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:05.223015 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d016676c-41d7-4328-a02f-72cd60cca545 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1504 microversion: 2.1 time: 0.231354 Aug 07 01:29:05.224134 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2061/3766] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:04 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1504 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:05.230547 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-10aa3367-9f96-4249-b478-3fb73c911ac2 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:05.233024 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-10aa3367-9f96-4249-b478-3fb73c911ac2 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: d9c8e298-f10a-4a99-9b30-00d1a0cc12b5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:05.246812 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10aa3367-9f96-4249-b478-3fb73c911ac2 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:05.248367 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10aa3367-9f96-4249-b478-3fb73c911ac2 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:05.249458 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10aa3367-9f96-4249-b478-3fb73c911ac2 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:05.251080 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10aa3367-9f96-4249-b478-3fb73c911ac2 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:05.252261 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10aa3367-9f96-4249-b478-3fb73c911ac2 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:05.253322 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10aa3367-9f96-4249-b478-3fb73c911ac2 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:05.478389 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-10aa3367-9f96-4249-b478-3fb73c911ac2 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:05.481316 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d291b7bc-832e-402a-b26a-6861e92b83d7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:05.481947 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d291b7bc-832e-402a-b26a-6861e92b83d7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:05.491693 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d291b7bc-832e-402a-b26a-6861e92b83d7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:05.492720 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d291b7bc-832e-402a-b26a-6861e92b83d7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:05.493721 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d291b7bc-832e-402a-b26a-6861e92b83d7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:05.494859 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-10aa3367-9f96-4249-b478-3fb73c911ac2 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5" status: 200 len: 1308 microversion: 2.1 time: 0.275349 Aug 07 01:29:05.495320 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d291b7bc-832e-402a-b26a-6861e92b83d7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:05.496513 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d291b7bc-832e-402a-b26a-6861e92b83d7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:05.497686 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d291b7bc-832e-402a-b26a-6861e92b83d7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:05.512368 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1706/3767] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:05 2022] GET /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5 => generated 1308 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:05.694452 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d291b7bc-832e-402a-b26a-6861e92b83d7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:05.703259 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d291b7bc-832e-402a-b26a-6861e92b83d7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1491 microversion: 2.1 time: 0.227538 Aug 07 01:29:05.704330 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2062/3768] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:05 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1491 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:29:05.725041 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0f255417-66fa-451c-881c-fe0ef851fbe5 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:05.725891 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0f255417-66fa-451c-881c-fe0ef851fbe5 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:05.732744 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0f255417-66fa-451c-881c-fe0ef851fbe5 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:05.733517 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0f255417-66fa-451c-881c-fe0ef851fbe5 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:05.735793 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0f255417-66fa-451c-881c-fe0ef851fbe5 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:05.735793 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0f255417-66fa-451c-881c-fe0ef851fbe5 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:05.740967 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0f255417-66fa-451c-881c-fe0ef851fbe5 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:05.740967 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0f255417-66fa-451c-881c-fe0ef851fbe5 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:05.761594 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-0f255417-66fa-451c-881c-fe0ef851fbe5 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] HTTP exception thrown: Cannot 'pause' instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 while it is in vm_state paused Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0f255417-66fa-451c-881c-fe0ef851fbe5 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015/action HTTP/1.1 Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 13 Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: {"pause": {}} Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: exception: Cannot 'pause' instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 while it is in vm_state paused Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'd9b1883a-c95a-4c49-ad6d-335ecf03b015', 'body': {'pause': {}}} Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 in vm_state paused. Cannot pause while the instance is in this state. Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 while it is in vm_state paused Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:05.763451 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:05.770230 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:05.770230 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:29:05.770230 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:29:05.770230 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 while it is in vm_state paused Aug 07 01:29:05.770230 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:05.770230 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0f255417-66fa-451c-881c-fe0ef851fbe5 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 409 to user: Cannot 'pause' instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 while it is in vm_state paused {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:29:05.770230 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0f255417-66fa-451c-881c-fe0ef851fbe5 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015/action" status: 409 len: 143 microversion: 2.1 time: 0.043986 Aug 07 01:29:05.774326 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-64050fb6-87e3-4f6f-bfe9-4c95c8bbe7e7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:05.777091 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-64050fb6-87e3-4f6f-bfe9-4c95c8bbe7e7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:05.777262 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1707/3769] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:29:05 2022] POST /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015/action => generated 143 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:29:05.782054 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64050fb6-87e3-4f6f-bfe9-4c95c8bbe7e7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:05.782548 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64050fb6-87e3-4f6f-bfe9-4c95c8bbe7e7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:05.782988 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64050fb6-87e3-4f6f-bfe9-4c95c8bbe7e7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:05.783714 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64050fb6-87e3-4f6f-bfe9-4c95c8bbe7e7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:05.784204 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64050fb6-87e3-4f6f-bfe9-4c95c8bbe7e7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:05.784639 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64050fb6-87e3-4f6f-bfe9-4c95c8bbe7e7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:05.801083 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:05.877585 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-64050fb6-87e3-4f6f-bfe9-4c95c8bbe7e7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015/action" status: 202 len: 0 microversion: 2.1 time: 0.107299 Aug 07 01:29:05.881857 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2063/3770] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:29:05 2022] POST /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:29:05.888654 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6ac86fca-144c-4f13-a1ed-d92730f14d4d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:05.889293 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6ac86fca-144c-4f13-a1ed-d92730f14d4d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:05.898838 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ac86fca-144c-4f13-a1ed-d92730f14d4d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:05.899699 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ac86fca-144c-4f13-a1ed-d92730f14d4d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:05.900156 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ac86fca-144c-4f13-a1ed-d92730f14d4d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:05.901937 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ac86fca-144c-4f13-a1ed-d92730f14d4d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:05.902696 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ac86fca-144c-4f13-a1ed-d92730f14d4d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:05.903434 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ac86fca-144c-4f13-a1ed-d92730f14d4d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:05.969699 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9e624018-fba9-4a9c-a4a1-84ba8b16538b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:05.970636 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9e624018-fba9-4a9c-a4a1-84ba8b16538b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:05.982557 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e624018-fba9-4a9c-a4a1-84ba8b16538b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:05.983114 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e624018-fba9-4a9c-a4a1-84ba8b16538b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:05.987293 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e624018-fba9-4a9c-a4a1-84ba8b16538b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:05.988460 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e624018-fba9-4a9c-a4a1-84ba8b16538b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:05.988987 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e624018-fba9-4a9c-a4a1-84ba8b16538b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:05.989444 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e624018-fba9-4a9c-a4a1-84ba8b16538b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:06.172347 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9e624018-fba9-4a9c-a4a1-84ba8b16538b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:06.186805 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9e624018-fba9-4a9c-a4a1-84ba8b16538b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1508 microversion: 2.1 time: 0.223591 Aug 07 01:29:06.187687 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2064/3771] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:05 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1508 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:06.251414 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c02bcb65-2de9-47ff-9b1d-acace00d3f94 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:06.252473 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c02bcb65-2de9-47ff-9b1d-acace00d3f94 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:06.260936 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c02bcb65-2de9-47ff-9b1d-acace00d3f94 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:06.261708 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c02bcb65-2de9-47ff-9b1d-acace00d3f94 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:06.262355 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c02bcb65-2de9-47ff-9b1d-acace00d3f94 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:06.263413 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c02bcb65-2de9-47ff-9b1d-acace00d3f94 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:06.264188 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c02bcb65-2de9-47ff-9b1d-acace00d3f94 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:06.264962 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c02bcb65-2de9-47ff-9b1d-acace00d3f94 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:06.294691 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6ac86fca-144c-4f13-a1ed-d92730f14d4d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:06.315564 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6ac86fca-144c-4f13-a1ed-d92730f14d4d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1498 microversion: 2.1 time: 0.431961 Aug 07 01:29:06.330016 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1708/3772] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:05 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1498 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:06.438531 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c02bcb65-2de9-47ff-9b1d-acace00d3f94 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:06.447178 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c02bcb65-2de9-47ff-9b1d-acace00d3f94 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1504 microversion: 2.1 time: 0.203677 Aug 07 01:29:06.447952 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2065/3773] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:06 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1504 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:06.529802 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-44d84497-e33e-4d8e-ad18-4757becb5b34 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:06.530430 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-44d84497-e33e-4d8e-ad18-4757becb5b34 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: d9c8e298-f10a-4a99-9b30-00d1a0cc12b5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:06.536963 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44d84497-e33e-4d8e-ad18-4757becb5b34 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:06.537456 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44d84497-e33e-4d8e-ad18-4757becb5b34 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:06.537901 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44d84497-e33e-4d8e-ad18-4757becb5b34 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:06.538626 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44d84497-e33e-4d8e-ad18-4757becb5b34 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:06.539090 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44d84497-e33e-4d8e-ad18-4757becb5b34 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:06.539524 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44d84497-e33e-4d8e-ad18-4757becb5b34 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:06.746464 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-44d84497-e33e-4d8e-ad18-4757becb5b34 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:06.759932 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-44d84497-e33e-4d8e-ad18-4757becb5b34 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5" status: 200 len: 1308 microversion: 2.1 time: 0.236203 Aug 07 01:29:06.765240 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1709/3774] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:06 2022] GET /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5 => generated 1308 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:07.210670 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c7c5d7ca-f552-43a1-b65a-a4b1bab17ab1 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:07.211535 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c7c5d7ca-f552-43a1-b65a-a4b1bab17ab1 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:07.224689 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c7c5d7ca-f552-43a1-b65a-a4b1bab17ab1 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:07.224689 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c7c5d7ca-f552-43a1-b65a-a4b1bab17ab1 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:07.224689 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c7c5d7ca-f552-43a1-b65a-a4b1bab17ab1 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:07.224689 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c7c5d7ca-f552-43a1-b65a-a4b1bab17ab1 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:07.224689 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c7c5d7ca-f552-43a1-b65a-a4b1bab17ab1 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:07.225384 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c7c5d7ca-f552-43a1-b65a-a4b1bab17ab1 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:07.338453 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ec626790-6d45-44a2-a3da-7d37a468be46 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:07.339609 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ec626790-6d45-44a2-a3da-7d37a468be46 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:07.346620 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ec626790-6d45-44a2-a3da-7d37a468be46 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:07.347114 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ec626790-6d45-44a2-a3da-7d37a468be46 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:07.347769 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ec626790-6d45-44a2-a3da-7d37a468be46 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:07.348699 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ec626790-6d45-44a2-a3da-7d37a468be46 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:07.350780 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ec626790-6d45-44a2-a3da-7d37a468be46 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:07.351409 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ec626790-6d45-44a2-a3da-7d37a468be46 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:07.478092 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c7c5d7ca-f552-43a1-b65a-a4b1bab17ab1 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:07.487324 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c7c5d7ca-f552-43a1-b65a-a4b1bab17ab1 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1508 microversion: 2.1 time: 0.281015 Aug 07 01:29:07.488580 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2066/3775] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:07 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1508 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:07.494137 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-df5e7177-7bfa-4291-8273-f99b6c4cddf6 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:07.495154 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-df5e7177-7bfa-4291-8273-f99b6c4cddf6 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:07.503416 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df5e7177-7bfa-4291-8273-f99b6c4cddf6 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:07.504259 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df5e7177-7bfa-4291-8273-f99b6c4cddf6 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:07.504899 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df5e7177-7bfa-4291-8273-f99b6c4cddf6 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:07.505816 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df5e7177-7bfa-4291-8273-f99b6c4cddf6 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:07.506899 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df5e7177-7bfa-4291-8273-f99b6c4cddf6 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:07.507555 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df5e7177-7bfa-4291-8273-f99b6c4cddf6 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:07.732352 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ec626790-6d45-44a2-a3da-7d37a468be46 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:07.746245 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ec626790-6d45-44a2-a3da-7d37a468be46 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.411018 Aug 07 01:29:07.761758 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-df5e7177-7bfa-4291-8273-f99b6c4cddf6 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:07.765408 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1710/3776] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:07 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:07.775611 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-df5e7177-7bfa-4291-8273-f99b6c4cddf6 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1504 microversion: 2.1 time: 0.285596 Aug 07 01:29:07.777687 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2067/3777] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:07 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1504 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:07.789519 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2541fa1b-c332-4f7c-9f9b-8a80a99fcb7d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:07.790318 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2541fa1b-c332-4f7c-9f9b-8a80a99fcb7d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:07.795458 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f8351e8d-ac0f-4e13-ad70-f8628eb7dbb0 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:07.796793 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f8351e8d-ac0f-4e13-ad70-f8628eb7dbb0 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: d9c8e298-f10a-4a99-9b30-00d1a0cc12b5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:07.798397 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2541fa1b-c332-4f7c-9f9b-8a80a99fcb7d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:07.799664 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2541fa1b-c332-4f7c-9f9b-8a80a99fcb7d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:07.800392 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2541fa1b-c332-4f7c-9f9b-8a80a99fcb7d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:07.800930 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2541fa1b-c332-4f7c-9f9b-8a80a99fcb7d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:07.801466 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2541fa1b-c332-4f7c-9f9b-8a80a99fcb7d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:07.802093 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2541fa1b-c332-4f7c-9f9b-8a80a99fcb7d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:07.813536 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f8351e8d-ac0f-4e13-ad70-f8628eb7dbb0 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:07.814236 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f8351e8d-ac0f-4e13-ad70-f8628eb7dbb0 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:07.815075 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f8351e8d-ac0f-4e13-ad70-f8628eb7dbb0 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:07.816177 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f8351e8d-ac0f-4e13-ad70-f8628eb7dbb0 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:07.816884 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f8351e8d-ac0f-4e13-ad70-f8628eb7dbb0 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:07.819225 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f8351e8d-ac0f-4e13-ad70-f8628eb7dbb0 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:08.037664 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2541fa1b-c332-4f7c-9f9b-8a80a99fcb7d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:08.051876 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2541fa1b-c332-4f7c-9f9b-8a80a99fcb7d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.268083 Aug 07 01:29:08.070075 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1711/3778] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:07 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:08.081047 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c070bdf7-3af0-46ce-95dc-a3e93b89e31f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:08.084204 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c070bdf7-3af0-46ce-95dc-a3e93b89e31f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 19784b1a-63aa-44b2-bbd5-d8dda713efdd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:08.094112 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c070bdf7-3af0-46ce-95dc-a3e93b89e31f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:08.094711 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c070bdf7-3af0-46ce-95dc-a3e93b89e31f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:08.095231 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c070bdf7-3af0-46ce-95dc-a3e93b89e31f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:08.096063 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c070bdf7-3af0-46ce-95dc-a3e93b89e31f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:08.096729 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c070bdf7-3af0-46ce-95dc-a3e93b89e31f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:08.097399 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c070bdf7-3af0-46ce-95dc-a3e93b89e31f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:08.119719 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-c070bdf7-3af0-46ce-95dc-a3e93b89e31f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] HTTP exception thrown: Instance 19784b1a-63aa-44b2-bbd5-d8dda713efdd could not be found. Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c070bdf7-3af0-46ce-95dc-a3e93b89e31f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd/action HTTP/1.1 Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 28 Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: {"reboot": {"type": "SOFT"}} Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 19784b1a-63aa-44b2-bbd5-d8dda713efdd could not be found. Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '19784b1a-63aa-44b2-bbd5-d8dda713efdd', 'body': {'reboot': {'type': 'SOFT'}}} Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19784b1a-63aa-44b2-bbd5-d8dda713efdd could not be found. Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:29:08.122919 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:29:08.129095 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19784b1a-63aa-44b2-bbd5-d8dda713efdd could not be found. Aug 07 01:29:08.129095 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:08.129095 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:08.129095 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:08.129095 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:08.129095 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:08.129095 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:08.129095 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:29:08.129095 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:29:08.129095 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19784b1a-63aa-44b2-bbd5-d8dda713efdd could not be found. Aug 07 01:29:08.129095 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:08.129095 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c070bdf7-3af0-46ce-95dc-a3e93b89e31f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 404 to user: Instance 19784b1a-63aa-44b2-bbd5-d8dda713efdd could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:29:08.129095 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c070bdf7-3af0-46ce-95dc-a3e93b89e31f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd/action" status: 404 len: 111 microversion: 2.1 time: 0.052107 Aug 07 01:29:08.129095 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1712/3779] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:29:08 2022] POST /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd/action => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:29:08.140695 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2a5ee3c5-da15-47a6-905e-5329a8335308 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:08.142343 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f8351e8d-ac0f-4e13-ad70-f8628eb7dbb0 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:08.143138 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2a5ee3c5-da15-47a6-905e-5329a8335308 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:08.150969 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f8351e8d-ac0f-4e13-ad70-f8628eb7dbb0 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5" status: 200 len: 1308 microversion: 2.1 time: 0.367934 Aug 07 01:29:08.165956 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2068/3780] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:07 2022] GET /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5 => generated 1308 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:08.169923 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2a5ee3c5-da15-47a6-905e-5329a8335308 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:08.170624 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2a5ee3c5-da15-47a6-905e-5329a8335308 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:08.171073 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2a5ee3c5-da15-47a6-905e-5329a8335308 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:08.172715 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2a5ee3c5-da15-47a6-905e-5329a8335308 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:08.173209 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2a5ee3c5-da15-47a6-905e-5329a8335308 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:08.173697 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2a5ee3c5-da15-47a6-905e-5329a8335308 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:08.337557 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2a5ee3c5-da15-47a6-905e-5329a8335308 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:08.346712 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2a5ee3c5-da15-47a6-905e-5329a8335308 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.213283 Aug 07 01:29:08.348216 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1713/3781] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:08 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:29:08.373497 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-033fb7b2-5be9-49f7-8f53-d117e288fa23 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:08.374119 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-033fb7b2-5be9-49f7-8f53-d117e288fa23 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:08.381184 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-033fb7b2-5be9-49f7-8f53-d117e288fa23 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:08.381975 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-033fb7b2-5be9-49f7-8f53-d117e288fa23 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:08.382412 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-033fb7b2-5be9-49f7-8f53-d117e288fa23 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:08.383124 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-033fb7b2-5be9-49f7-8f53-d117e288fa23 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:08.383575 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-033fb7b2-5be9-49f7-8f53-d117e288fa23 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:08.384029 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-033fb7b2-5be9-49f7-8f53-d117e288fa23 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:08.514989 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-124a0a8d-f0e2-442f-9f97-a46873ca07a5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:08.515795 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-124a0a8d-f0e2-442f-9f97-a46873ca07a5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:08.523073 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-124a0a8d-f0e2-442f-9f97-a46873ca07a5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:08.524016 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-124a0a8d-f0e2-442f-9f97-a46873ca07a5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:08.524871 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-124a0a8d-f0e2-442f-9f97-a46873ca07a5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:08.526127 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-124a0a8d-f0e2-442f-9f97-a46873ca07a5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:08.526704 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-124a0a8d-f0e2-442f-9f97-a46873ca07a5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:08.527247 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-124a0a8d-f0e2-442f-9f97-a46873ca07a5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:08.618657 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-033fb7b2-5be9-49f7-8f53-d117e288fa23 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:08.635110 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-033fb7b2-5be9-49f7-8f53-d117e288fa23 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.267002 Aug 07 01:29:08.636513 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2069/3782] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:08 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:08.660130 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6ab3b937-b0d1-4c68-a7c7-5a7e6961042c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:08.663165 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6ab3b937-b0d1-4c68-a7c7-5a7e6961042c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 9d6f9a09-70e0-4b0c-8efd-c3285ddd0c69] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:08.673453 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-6ab3b937-b0d1-4c68-a7c7-5a7e6961042c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] HTTP exception thrown: Instance 9d6f9a09-70e0-4b0c-8efd-c3285ddd0c69 could not be found. Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6ab3b937-b0d1-4c68-a7c7-5a7e6961042c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers/9d6f9a09-70e0-4b0c-8efd-c3285ddd0c69/action HTTP/1.1 Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 28 Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: {"reboot": {"type": "SOFT"}} Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 9d6f9a09-70e0-4b0c-8efd-c3285ddd0c69 could not be found. Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '9d6f9a09-70e0-4b0c-8efd-c3285ddd0c69', 'body': {'reboot': {'type': 'SOFT'}}} Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d6f9a09-70e0-4b0c-8efd-c3285ddd0c69 could not be found. Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d6f9a09-70e0-4b0c-8efd-c3285ddd0c69 could not be found. Aug 07 01:29:08.677279 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:08.687269 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:08.687269 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:08.687269 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:08.687269 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:08.687269 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:08.687269 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:29:08.687269 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:29:08.687269 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d6f9a09-70e0-4b0c-8efd-c3285ddd0c69 could not be found. Aug 07 01:29:08.687269 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:08.687269 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6ab3b937-b0d1-4c68-a7c7-5a7e6961042c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 404 to user: Instance 9d6f9a09-70e0-4b0c-8efd-c3285ddd0c69 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:29:08.687269 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6ab3b937-b0d1-4c68-a7c7-5a7e6961042c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers/9d6f9a09-70e0-4b0c-8efd-c3285ddd0c69/action" status: 404 len: 111 microversion: 2.1 time: 0.025484 Aug 07 01:29:08.687269 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2070/3783] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:29:08 2022] POST /compute/v2.1/servers/9d6f9a09-70e0-4b0c-8efd-c3285ddd0c69/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:29:08.694451 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f42954b2-308c-4860-9c82-c5410a56b205 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:08.694451 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f42954b2-308c-4860-9c82-c5410a56b205 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:08.714947 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f42954b2-308c-4860-9c82-c5410a56b205 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:08.715443 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f42954b2-308c-4860-9c82-c5410a56b205 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:08.715923 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f42954b2-308c-4860-9c82-c5410a56b205 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:08.716668 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f42954b2-308c-4860-9c82-c5410a56b205 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:08.717123 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f42954b2-308c-4860-9c82-c5410a56b205 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:08.717547 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f42954b2-308c-4860-9c82-c5410a56b205 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:08.741284 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-124a0a8d-f0e2-442f-9f97-a46873ca07a5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:08.763168 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-124a0a8d-f0e2-442f-9f97-a46873ca07a5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1508 microversion: 2.1 time: 0.252240 Aug 07 01:29:08.764141 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1714/3784] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:08 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1508 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:08.804982 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-30357470-82e6-4568-b5c1-a95423c7146a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:08.805714 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-30357470-82e6-4568-b5c1-a95423c7146a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:08.813427 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-30357470-82e6-4568-b5c1-a95423c7146a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:08.814025 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-30357470-82e6-4568-b5c1-a95423c7146a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:08.814566 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-30357470-82e6-4568-b5c1-a95423c7146a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:08.815638 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-30357470-82e6-4568-b5c1-a95423c7146a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:08.816345 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-30357470-82e6-4568-b5c1-a95423c7146a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:08.816856 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-30357470-82e6-4568-b5c1-a95423c7146a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:08.980966 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-30357470-82e6-4568-b5c1-a95423c7146a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:08.990235 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f42954b2-308c-4860-9c82-c5410a56b205 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:08.992238 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-30357470-82e6-4568-b5c1-a95423c7146a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1484 microversion: 2.1 time: 0.191375 Aug 07 01:29:08.994141 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1715/3785] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:08 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1484 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:29:08.999849 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f42954b2-308c-4860-9c82-c5410a56b205 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.311682 Aug 07 01:29:09.004125 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2071/3786] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:08 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:09.025411 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fdfd6421-120f-413e-9143-5d899740f12a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:09.025888 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fdfd6421-120f-413e-9143-5d899740f12a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:09.032197 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fdfd6421-120f-413e-9143-5d899740f12a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:09.032979 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fdfd6421-120f-413e-9143-5d899740f12a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:09.033630 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fdfd6421-120f-413e-9143-5d899740f12a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:09.034549 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fdfd6421-120f-413e-9143-5d899740f12a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:09.035181 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fdfd6421-120f-413e-9143-5d899740f12a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:09.035777 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fdfd6421-120f-413e-9143-5d899740f12a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:09.062576 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:09.086820 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-05d2203b-65d3-436f-95a6-252ac7c34504 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1414172160", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:09.177152 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-05d2203b-65d3-436f-95a6-252ac7c34504 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] validate_networks() for [('6004ae73-1463-4d0d-b75b-78b3f2a8489b', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:29:09.221345 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fdfd6421-120f-413e-9143-5d899740f12a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:09.240073 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fdfd6421-120f-413e-9143-5d899740f12a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.218638 Aug 07 01:29:09.241812 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1716/3787] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:09 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:09.249019 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d60b1431-fe7e-490c-8cdc-367223daf2f6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:09.249835 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d60b1431-fe7e-490c-8cdc-367223daf2f6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: d9c8e298-f10a-4a99-9b30-00d1a0cc12b5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:09.262803 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d60b1431-fe7e-490c-8cdc-367223daf2f6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:09.263545 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d60b1431-fe7e-490c-8cdc-367223daf2f6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:09.269271 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d60b1431-fe7e-490c-8cdc-367223daf2f6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:09.270379 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d60b1431-fe7e-490c-8cdc-367223daf2f6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:09.271354 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d60b1431-fe7e-490c-8cdc-367223daf2f6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:09.272554 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d60b1431-fe7e-490c-8cdc-367223daf2f6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:09.336425 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:09.478703 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d60b1431-fe7e-490c-8cdc-367223daf2f6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:09.500441 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d60b1431-fe7e-490c-8cdc-367223daf2f6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5" status: 200 len: 1308 microversion: 2.1 time: 0.256268 Aug 07 01:29:09.501751 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1717/3788] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:09 2022] GET /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5 => generated 1308 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:09.509960 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-565ef181-7beb-4890-a149-3e7cef985464 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:09.515550 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-565ef181-7beb-4890-a149-3e7cef985464 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 19784b1a-63aa-44b2-bbd5-d8dda713efdd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:09.524566 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-565ef181-7beb-4890-a149-3e7cef985464 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:09.526838 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-565ef181-7beb-4890-a149-3e7cef985464 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:09.526838 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-565ef181-7beb-4890-a149-3e7cef985464 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:09.528413 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-565ef181-7beb-4890-a149-3e7cef985464 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:09.529545 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-565ef181-7beb-4890-a149-3e7cef985464 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:09.530678 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-565ef181-7beb-4890-a149-3e7cef985464 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:09.571921 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-565ef181-7beb-4890-a149-3e7cef985464 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] HTTP exception thrown: Instance 19784b1a-63aa-44b2-bbd5-d8dda713efdd could not be found. Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-565ef181-7beb-4890-a149-3e7cef985464 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd/action HTTP/1.1 Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 65 Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: {"rebuild": {"imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731"}} Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 19784b1a-63aa-44b2-bbd5-d8dda713efdd could not be found. Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '19784b1a-63aa-44b2-bbd5-d8dda713efdd', 'body': {'rebuild': {'imageRef': 'e825bd61-bf05-4bd4-aa72-78daf2231731'}}} Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19784b1a-63aa-44b2-bbd5-d8dda713efdd could not be found. Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 07 01:29:09.574222 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 07 01:29:09.579476 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 07 01:29:09.579476 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:29:09.579476 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:29:09.579476 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:29:09.579476 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:29:09.579476 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19784b1a-63aa-44b2-bbd5-d8dda713efdd could not be found. Aug 07 01:29:09.579476 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:09.579476 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:09.579476 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:09.579476 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:09.579476 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:09.579476 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:09.579476 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:29:09.579476 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:29:09.579476 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19784b1a-63aa-44b2-bbd5-d8dda713efdd could not be found. Aug 07 01:29:09.579476 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:09.585244 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-565ef181-7beb-4890-a149-3e7cef985464 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 404 to user: Instance 19784b1a-63aa-44b2-bbd5-d8dda713efdd could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:29:09.586496 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-565ef181-7beb-4890-a149-3e7cef985464 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd/action" status: 404 len: 111 microversion: 2.1 time: 0.083338 Aug 07 01:29:09.587664 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1718/3789] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:29:09 2022] POST /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd/action => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:29:09.593315 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-4efa5cdc-d860-48a8-b55d-89daa35ec4d3 req-a3e9fea4-5d11-4047-86c6-cb3f793672f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9c8e298-f10a-4a99-9b30-00d1a0cc12b5", "name": "network-vif-plugged", "status": "completed", "tag": "8cdc75fb-4acd-4c53-a858-7be2c2e39a11"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:09.616015 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-4efa5cdc-d860-48a8-b55d-89daa35ec4d3 req-a3e9fea4-5d11-4047-86c6-cb3f793672f2 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:09.616973 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-4efa5cdc-d860-48a8-b55d-89daa35ec4d3 req-a3e9fea4-5d11-4047-86c6-cb3f793672f2 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:09.618321 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-4efa5cdc-d860-48a8-b55d-89daa35ec4d3 req-a3e9fea4-5d11-4047-86c6-cb3f793672f2 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:09.637600 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-4efa5cdc-d860-48a8-b55d-89daa35ec4d3 req-a3e9fea4-5d11-4047-86c6-cb3f793672f2 service nova] Creating event network-vif-plugged:8cdc75fb-4acd-4c53-a858-7be2c2e39a11 for instance d9c8e298-f10a-4a99-9b30-00d1a0cc12b5 on n-h1-master-1 Aug 07 01:29:09.645618 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-4efa5cdc-d860-48a8-b55d-89daa35ec4d3 req-a3e9fea4-5d11-4047-86c6-cb3f793672f2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056486 Aug 07 01:29:09.647723 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1719/3790] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:29:09.656026 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6fa48ac3-1604-4316-941b-dd6517e06f83 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:09.657315 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6fa48ac3-1604-4316-941b-dd6517e06f83 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:09.664648 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6fa48ac3-1604-4316-941b-dd6517e06f83 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:09.666303 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6fa48ac3-1604-4316-941b-dd6517e06f83 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:09.667788 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6fa48ac3-1604-4316-941b-dd6517e06f83 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:09.668749 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6fa48ac3-1604-4316-941b-dd6517e06f83 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:09.669476 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6fa48ac3-1604-4316-941b-dd6517e06f83 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:09.670072 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6fa48ac3-1604-4316-941b-dd6517e06f83 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:09.875174 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=8 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:10.091968 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6fa48ac3-1604-4316-941b-dd6517e06f83 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:10.107392 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6fa48ac3-1604-4316-941b-dd6517e06f83 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.456659 Aug 07 01:29:10.119767 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1720/3791] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:09 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:10.119767 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f961f2eb-6f00-4f65-8bfd-2e4326048a9f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:10.119767 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f961f2eb-6f00-4f65-8bfd-2e4326048a9f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:10.123558 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f961f2eb-6f00-4f65-8bfd-2e4326048a9f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:10.124747 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f961f2eb-6f00-4f65-8bfd-2e4326048a9f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:10.125748 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f961f2eb-6f00-4f65-8bfd-2e4326048a9f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:10.126735 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f961f2eb-6f00-4f65-8bfd-2e4326048a9f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:10.127534 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f961f2eb-6f00-4f65-8bfd-2e4326048a9f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:10.128249 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f961f2eb-6f00-4f65-8bfd-2e4326048a9f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:10.389453 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-05d2203b-65d3-436f-95a6-252ac7c34504 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:29:10.391809 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-05d2203b-65d3-436f-95a6-252ac7c34504 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:29:10.393482 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-05d2203b-65d3-436f-95a6-252ac7c34504 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:29:10.394562 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-05d2203b-65d3-436f-95a6-252ac7c34504 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:29:10.395258 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-05d2203b-65d3-436f-95a6-252ac7c34504 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:29:10.410152 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05d2203b-65d3-436f-95a6-252ac7c34504 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:10.410841 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05d2203b-65d3-436f-95a6-252ac7c34504 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:10.411445 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05d2203b-65d3-436f-95a6-252ac7c34504 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:10.412208 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05d2203b-65d3-436f-95a6-252ac7c34504 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:10.412784 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05d2203b-65d3-436f-95a6-252ac7c34504 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:10.413272 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05d2203b-65d3-436f-95a6-252ac7c34504 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:10.421879 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f961f2eb-6f00-4f65-8bfd-2e4326048a9f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:10.432564 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f961f2eb-6f00-4f65-8bfd-2e4326048a9f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1508 microversion: 2.1 time: 0.322639 Aug 07 01:29:10.433510 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1721/3792] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:10 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1508 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:10.438957 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5e78c548-97b9-4da6-a3ea-06721c9a498a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:10.439997 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5e78c548-97b9-4da6-a3ea-06721c9a498a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:10.446728 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e78c548-97b9-4da6-a3ea-06721c9a498a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:10.447471 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e78c548-97b9-4da6-a3ea-06721c9a498a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:10.447942 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e78c548-97b9-4da6-a3ea-06721c9a498a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:10.448954 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e78c548-97b9-4da6-a3ea-06721c9a498a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:10.449355 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e78c548-97b9-4da6-a3ea-06721c9a498a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:10.452458 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e78c548-97b9-4da6-a3ea-06721c9a498a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:10.459852 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-05d2203b-65d3-436f-95a6-252ac7c34504 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Getting quotas for project d8face435f3549b5adbadf2f94707712. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:29:10.467639 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-05d2203b-65d3-436f-95a6-252ac7c34504 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Getting quotas for user 845cd61b22924fd3a915186a6093ac12 and project d8face435f3549b5adbadf2f94707712. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:29:10.492801 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-05d2203b-65d3-436f-95a6-252ac7c34504 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:29:10.495209 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-05d2203b-65d3-436f-95a6-252ac7c34504 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:29:10.570244 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-05d2203b-65d3-436f-95a6-252ac7c34504 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.487599 Aug 07 01:29:10.571025 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2072/3793] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:29:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 1489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 07 01:29:10.585971 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bc673649-98e3-4687-958d-a1f3195f5b89 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:10.586608 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bc673649-98e3-4687-958d-a1f3195f5b89 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: d9c8e298-f10a-4a99-9b30-00d1a0cc12b5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:10.596274 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bc673649-98e3-4687-958d-a1f3195f5b89 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:10.596274 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bc673649-98e3-4687-958d-a1f3195f5b89 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:10.596673 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bc673649-98e3-4687-958d-a1f3195f5b89 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:10.597406 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bc673649-98e3-4687-958d-a1f3195f5b89 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:10.597993 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bc673649-98e3-4687-958d-a1f3195f5b89 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:10.598633 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bc673649-98e3-4687-958d-a1f3195f5b89 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:10.692167 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5e78c548-97b9-4da6-a3ea-06721c9a498a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:10.734059 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5e78c548-97b9-4da6-a3ea-06721c9a498a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.296808 Aug 07 01:29:10.744557 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1722/3794] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:10 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:10.767017 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e186bd56-5a63-4b87-9553-37123b4ff618 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:10.770661 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e186bd56-5a63-4b87-9553-37123b4ff618 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:10.788493 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:10.835268 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bc673649-98e3-4687-958d-a1f3195f5b89 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:10.846173 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bc673649-98e3-4687-958d-a1f3195f5b89 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5" status: 200 len: 1308 microversion: 2.1 time: 0.273839 Aug 07 01:29:10.847267 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2073/3795] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:10 2022] GET /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5 => generated 1308 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:10.853122 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1fdd646a-9797-454a-af0f-eecf64e0e92a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:10.858880 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1fdd646a-9797-454a-af0f-eecf64e0e92a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: e55d8655-af89-4612-bc42-388d1bd82fa0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:10.866234 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-1fdd646a-9797-454a-af0f-eecf64e0e92a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] HTTP exception thrown: Instance e55d8655-af89-4612-bc42-388d1bd82fa0 could not be found. Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1fdd646a-9797-454a-af0f-eecf64e0e92a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers/e55d8655-af89-4612-bc42-388d1bd82fa0/action HTTP/1.1 Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 65 Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: {"rebuild": {"imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731"}} Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: exception: Instance e55d8655-af89-4612-bc42-388d1bd82fa0 could not be found. Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'e55d8655-af89-4612-bc42-388d1bd82fa0', 'body': {'rebuild': {'imageRef': 'e825bd61-bf05-4bd4-aa72-78daf2231731'}}} Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e55d8655-af89-4612-bc42-388d1bd82fa0 could not be found. Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 07 01:29:10.868097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:29:10.874663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:29:10.874663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:29:10.874663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:29:10.874663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e55d8655-af89-4612-bc42-388d1bd82fa0 could not be found. Aug 07 01:29:10.874663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:10.874663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:10.874663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:10.874663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:10.874663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:10.874663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:10.874663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:29:10.874663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:29:10.874663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e55d8655-af89-4612-bc42-388d1bd82fa0 could not be found. Aug 07 01:29:10.874663 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:10.878702 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1fdd646a-9797-454a-af0f-eecf64e0e92a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 404 to user: Instance e55d8655-af89-4612-bc42-388d1bd82fa0 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:29:10.878702 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1fdd646a-9797-454a-af0f-eecf64e0e92a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers/e55d8655-af89-4612-bc42-388d1bd82fa0/action" status: 404 len: 111 microversion: 2.1 time: 0.029624 Aug 07 01:29:10.879124 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e186bd56-5a63-4b87-9553-37123b4ff618 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:10.880365 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2074/3796] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:29:10 2022] POST /compute/v2.1/servers/e55d8655-af89-4612-bc42-388d1bd82fa0/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:29:10.886642 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e69a16e6-7e71-4554-a87b-c1a611103760 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:10.887621 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e69a16e6-7e71-4554-a87b-c1a611103760 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:10.891627 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e186bd56-5a63-4b87-9553-37123b4ff618 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1214 microversion: 2.1 time: 0.136824 Aug 07 01:29:10.892332 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1723/3797] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:10 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1214 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:10.897160 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e69a16e6-7e71-4554-a87b-c1a611103760 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:10.897988 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e69a16e6-7e71-4554-a87b-c1a611103760 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:10.898660 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e69a16e6-7e71-4554-a87b-c1a611103760 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:10.900001 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e69a16e6-7e71-4554-a87b-c1a611103760 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:10.900146 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5222cb66-c011-4e9d-b6f9-78b900e54741 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:10.900909 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e69a16e6-7e71-4554-a87b-c1a611103760 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:10.901161 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5222cb66-c011-4e9d-b6f9-78b900e54741 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:10.902522 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e69a16e6-7e71-4554-a87b-c1a611103760 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:10.921964 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5222cb66-c011-4e9d-b6f9-78b900e54741 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:10.922742 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5222cb66-c011-4e9d-b6f9-78b900e54741 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:10.924006 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5222cb66-c011-4e9d-b6f9-78b900e54741 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:10.925031 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5222cb66-c011-4e9d-b6f9-78b900e54741 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:10.925888 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5222cb66-c011-4e9d-b6f9-78b900e54741 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:10.926827 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5222cb66-c011-4e9d-b6f9-78b900e54741 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:11.172683 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5222cb66-c011-4e9d-b6f9-78b900e54741 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:11.183388 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5222cb66-c011-4e9d-b6f9-78b900e54741 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.289795 Aug 07 01:29:11.184200 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1724/3798] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:10 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:11.213429 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6c50146d-d87b-4a0a-8315-a85769460502 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:11.215515 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6c50146d-d87b-4a0a-8315-a85769460502 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:11.233543 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c50146d-d87b-4a0a-8315-a85769460502 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:11.233543 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c50146d-d87b-4a0a-8315-a85769460502 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:11.233543 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c50146d-d87b-4a0a-8315-a85769460502 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:11.233543 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c50146d-d87b-4a0a-8315-a85769460502 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:11.233543 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c50146d-d87b-4a0a-8315-a85769460502 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:11.233543 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c50146d-d87b-4a0a-8315-a85769460502 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:11.310799 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e69a16e6-7e71-4554-a87b-c1a611103760 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:11.337655 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e69a16e6-7e71-4554-a87b-c1a611103760 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:11.341627 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e69a16e6-7e71-4554-a87b-c1a611103760 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:11.344025 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e69a16e6-7e71-4554-a87b-c1a611103760 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 2939 microversion: 2.32 time: 0.462384 Aug 07 01:29:11.345565 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2075/3799] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:29:10 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 2939 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:29:11.372488 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a0bf027e-93e9-4323-a931-c7a23f630f37 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:11.373668 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a0bf027e-93e9-4323-a931-c7a23f630f37 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:11.383247 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a0bf027e-93e9-4323-a931-c7a23f630f37 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:11.383802 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a0bf027e-93e9-4323-a931-c7a23f630f37 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:11.384221 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a0bf027e-93e9-4323-a931-c7a23f630f37 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:11.386017 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a0bf027e-93e9-4323-a931-c7a23f630f37 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:11.386522 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a0bf027e-93e9-4323-a931-c7a23f630f37 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:11.387253 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a0bf027e-93e9-4323-a931-c7a23f630f37 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:11.434494 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6c50146d-d87b-4a0a-8315-a85769460502 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:11.444176 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6c50146d-d87b-4a0a-8315-a85769460502 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.238927 Aug 07 01:29:11.445274 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1725/3800] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:11 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:11.462005 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-da683c95-041b-4783-b0d5-b674bb6e176f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:11.462748 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-da683c95-041b-4783-b0d5-b674bb6e176f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:11.470288 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da683c95-041b-4783-b0d5-b674bb6e176f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:11.471622 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da683c95-041b-4783-b0d5-b674bb6e176f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:11.472311 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da683c95-041b-4783-b0d5-b674bb6e176f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:11.473324 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da683c95-041b-4783-b0d5-b674bb6e176f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:11.473867 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da683c95-041b-4783-b0d5-b674bb6e176f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:11.474593 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da683c95-041b-4783-b0d5-b674bb6e176f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:11.572702 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a0bf027e-93e9-4323-a931-c7a23f630f37 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.204619 Aug 07 01:29:11.584825 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2076/3801] 10.222.0.39 () {60 vars in 1316 bytes} [Sun Aug 7 01:29:11 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf/os-interface => generated 1832 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:29:11.593749 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b5cb7c2c-40a3-4ca9-9aed-6626a1d85978 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:11.594835 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b5cb7c2c-40a3-4ca9-9aed-6626a1d85978 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 02024587-a974-4e02-8d45-248090ccfc05] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:11.602555 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-b5cb7c2c-40a3-4ca9-9aed-6626a1d85978 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] HTTP exception thrown: Instance 02024587-a974-4e02-8d45-248090ccfc05 could not be found. Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b5cb7c2c-40a3-4ca9-9aed-6626a1d85978 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers/02024587-a974-4e02-8d45-248090ccfc05/action HTTP/1.1 Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 15 Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: {"restore": {}} Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 02024587-a974-4e02-8d45-248090ccfc05 could not be found. Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '02024587-a974-4e02-8d45-248090ccfc05', 'body': {'restore': {}}} Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02024587-a974-4e02-8d45-248090ccfc05 could not be found. Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02024587-a974-4e02-8d45-248090ccfc05 could not be found. Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:11.605176 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:11.617689 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:29:11.617689 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:29:11.617689 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02024587-a974-4e02-8d45-248090ccfc05 could not be found. Aug 07 01:29:11.617689 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:11.617689 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b5cb7c2c-40a3-4ca9-9aed-6626a1d85978 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 404 to user: Instance 02024587-a974-4e02-8d45-248090ccfc05 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:29:11.617689 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b5cb7c2c-40a3-4ca9-9aed-6626a1d85978 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers/02024587-a974-4e02-8d45-248090ccfc05/action" status: 404 len: 111 microversion: 2.1 time: 0.019639 Aug 07 01:29:11.617689 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2077/3802] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:29:11 2022] POST /compute/v2.1/servers/02024587-a974-4e02-8d45-248090ccfc05/action => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:29:11.617689 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-22d74e85-cecd-47e7-a71d-da3198cedfa6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:11.619301 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-22d74e85-cecd-47e7-a71d-da3198cedfa6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:11.627390 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22d74e85-cecd-47e7-a71d-da3198cedfa6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:11.628011 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22d74e85-cecd-47e7-a71d-da3198cedfa6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:11.628545 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22d74e85-cecd-47e7-a71d-da3198cedfa6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:11.629864 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22d74e85-cecd-47e7-a71d-da3198cedfa6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:11.630565 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22d74e85-cecd-47e7-a71d-da3198cedfa6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:11.631272 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22d74e85-cecd-47e7-a71d-da3198cedfa6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:11.676635 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-da683c95-041b-4783-b0d5-b674bb6e176f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:11.685683 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-da683c95-041b-4783-b0d5-b674bb6e176f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1508 microversion: 2.1 time: 0.232494 Aug 07 01:29:11.697788 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1726/3803] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:11 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1508 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:11.872119 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-caf7d708-b29f-4571-ab0c-8fd0f229175c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:11.873532 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-caf7d708-b29f-4571-ab0c-8fd0f229175c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: d9c8e298-f10a-4a99-9b30-00d1a0cc12b5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:11.889029 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-caf7d708-b29f-4571-ab0c-8fd0f229175c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:11.889796 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-caf7d708-b29f-4571-ab0c-8fd0f229175c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:11.890039 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-caf7d708-b29f-4571-ab0c-8fd0f229175c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:11.891681 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-caf7d708-b29f-4571-ab0c-8fd0f229175c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:11.892180 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-caf7d708-b29f-4571-ab0c-8fd0f229175c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:11.892643 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-caf7d708-b29f-4571-ab0c-8fd0f229175c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:11.940098 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-22d74e85-cecd-47e7-a71d-da3198cedfa6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:11.967251 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-22d74e85-cecd-47e7-a71d-da3198cedfa6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.354013 Aug 07 01:29:11.968631 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2078/3804] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:11 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:11.985554 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-076cad06-0b23-4c54-a554-ce08f983da6f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:11.989945 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-076cad06-0b23-4c54-a554-ce08f983da6f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:11.999575 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-076cad06-0b23-4c54-a554-ce08f983da6f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:12.000672 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-076cad06-0b23-4c54-a554-ce08f983da6f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:12.001594 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-076cad06-0b23-4c54-a554-ce08f983da6f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:12.003240 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-076cad06-0b23-4c54-a554-ce08f983da6f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:12.003993 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-076cad06-0b23-4c54-a554-ce08f983da6f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:12.005701 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-076cad06-0b23-4c54-a554-ce08f983da6f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:12.160704 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-076cad06-0b23-4c54-a554-ce08f983da6f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:12.174853 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-076cad06-0b23-4c54-a554-ce08f983da6f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1266 microversion: 2.1 time: 0.204216 Aug 07 01:29:12.178738 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2079/3805] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:11 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:12.191737 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6b36d506-a2b6-425b-aa4c-38b785416e3f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:12.196250 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6b36d506-a2b6-425b-aa4c-38b785416e3f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:12.215816 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b36d506-a2b6-425b-aa4c-38b785416e3f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:12.217558 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b36d506-a2b6-425b-aa4c-38b785416e3f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:12.219235 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b36d506-a2b6-425b-aa4c-38b785416e3f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:12.221059 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b36d506-a2b6-425b-aa4c-38b785416e3f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:12.222588 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b36d506-a2b6-425b-aa4c-38b785416e3f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:12.223726 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b36d506-a2b6-425b-aa4c-38b785416e3f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:12.233567 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-caf7d708-b29f-4571-ab0c-8fd0f229175c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:12.248700 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-caf7d708-b29f-4571-ab0c-8fd0f229175c tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5" status: 200 len: 1487 microversion: 2.1 time: 0.380340 Aug 07 01:29:12.250521 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1727/3806] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:11 2022] GET /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5 => generated 1487 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:29:12.283208 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4997ecd1-a800-4480-9029-69ba979b9bfb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-646089748"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:12.288181 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4997ecd1-a800-4480-9029-69ba979b9bfb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: d9c8e298-f10a-4a99-9b30-00d1a0cc12b5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:12.305666 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4997ecd1-a800-4480-9029-69ba979b9bfb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:12.306560 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4997ecd1-a800-4480-9029-69ba979b9bfb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:12.307266 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4997ecd1-a800-4480-9029-69ba979b9bfb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:12.308704 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4997ecd1-a800-4480-9029-69ba979b9bfb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:12.310401 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4997ecd1-a800-4480-9029-69ba979b9bfb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:12.311141 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4997ecd1-a800-4480-9029-69ba979b9bfb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:12.544785 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6b36d506-a2b6-425b-aa4c-38b785416e3f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:12.555250 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6b36d506-a2b6-425b-aa4c-38b785416e3f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.373628 Aug 07 01:29:12.556625 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2080/3807] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:12 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:12.580151 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ecf4b669-9e7d-482b-8d71-5cb351c56fcc tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:12.580641 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ecf4b669-9e7d-482b-8d71-5cb351c56fcc tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:12.584798 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4997ecd1-a800-4480-9029-69ba979b9bfb tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "POST /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5/action" status: 202 len: 0 microversion: 2.1 time: 0.310106 Aug 07 01:29:12.591816 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1728/3808] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:29:12 2022] POST /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 07 01:29:12.598429 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-42fe344b-2f7c-45e1-9a9f-d8c2087aab55 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e17eafe50>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:12.609523 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecf4b669-9e7d-482b-8d71-5cb351c56fcc tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:12.611689 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecf4b669-9e7d-482b-8d71-5cb351c56fcc tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:12.612490 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecf4b669-9e7d-482b-8d71-5cb351c56fcc tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:12.613338 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecf4b669-9e7d-482b-8d71-5cb351c56fcc tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:12.614084 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecf4b669-9e7d-482b-8d71-5cb351c56fcc tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:12.614588 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecf4b669-9e7d-482b-8d71-5cb351c56fcc tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:12.654853 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-ecf4b669-9e7d-482b-8d71-5cb351c56fcc tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] HTTP exception thrown: Cannot 'restore' instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 while it is in vm_state active Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ecf4b669-9e7d-482b-8d71-5cb351c56fcc tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015/action HTTP/1.1 Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 15 Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: {"restore": {}} Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: exception: Cannot 'restore' instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 while it is in vm_state active Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'd9b1883a-c95a-4c49-ad6d-335ecf03b015', 'body': {'restore': {}}} Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 in vm_state active. Cannot restore while the instance is in this state. Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 while it is in vm_state active Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:12.657097 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:12.663820 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:12.663820 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:29:12.663820 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:29:12.663820 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 while it is in vm_state active Aug 07 01:29:12.663820 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:12.666156 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ecf4b669-9e7d-482b-8d71-5cb351c56fcc tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 409 to user: Cannot 'restore' instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 while it is in vm_state active {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:29:12.667850 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ecf4b669-9e7d-482b-8d71-5cb351c56fcc tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015/action" status: 409 len: 145 microversion: 2.1 time: 0.092938 Aug 07 01:29:12.668973 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2081/3809] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:29:12 2022] POST /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015/action => generated 145 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 07 01:29:12.679346 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-42fe344b-2f7c-45e1-9a9f-d8c2087aab55 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/ae23ff48-1a98-46d6-baaa-b158a60c65b9" status: 200 len: 1413 microversion: 2.1 time: 0.084552 Aug 07 01:29:12.680143 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-008f758b-6ed0-47ff-9818-c30282afd85e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:12.681319 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-008f758b-6ed0-47ff-9818-c30282afd85e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:12.692209 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1729/3810] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:29:12 2022] GET /compute/v2.1/images/ae23ff48-1a98-46d6-baaa-b158a60c65b9 => generated 1413 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:12.702740 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-008f758b-6ed0-47ff-9818-c30282afd85e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:12.702998 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-008f758b-6ed0-47ff-9818-c30282afd85e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:12.703659 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-008f758b-6ed0-47ff-9818-c30282afd85e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:12.704433 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-008f758b-6ed0-47ff-9818-c30282afd85e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:12.705092 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-008f758b-6ed0-47ff-9818-c30282afd85e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:12.707968 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-008f758b-6ed0-47ff-9818-c30282afd85e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:12.709028 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0dfb18f5-4291-4c78-b922-5c9ac1d09ca9 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e242c8c10>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:12.800951 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0dfb18f5-4291-4c78-b922-5c9ac1d09ca9 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/ae23ff48-1a98-46d6-baaa-b158a60c65b9" status: 200 len: 1413 microversion: 2.1 time: 0.107471 Aug 07 01:29:12.801541 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1730/3811] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:29:12 2022] GET /compute/v2.1/images/ae23ff48-1a98-46d6-baaa-b158a60c65b9 => generated 1413 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:12.826681 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2b37cacd-fe6c-4d9a-b39e-eef7b12c2e90 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:12.827482 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2b37cacd-fe6c-4d9a-b39e-eef7b12c2e90 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:12.844186 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b37cacd-fe6c-4d9a-b39e-eef7b12c2e90 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:12.844750 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b37cacd-fe6c-4d9a-b39e-eef7b12c2e90 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:12.845299 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b37cacd-fe6c-4d9a-b39e-eef7b12c2e90 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:12.846085 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b37cacd-fe6c-4d9a-b39e-eef7b12c2e90 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:12.847041 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b37cacd-fe6c-4d9a-b39e-eef7b12c2e90 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:12.847550 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b37cacd-fe6c-4d9a-b39e-eef7b12c2e90 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:12.951948 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-008f758b-6ed0-47ff-9818-c30282afd85e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:12.959806 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-008f758b-6ed0-47ff-9818-c30282afd85e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.285530 Aug 07 01:29:12.960408 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2082/3812] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:12 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:12.975695 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3f95fbe9-3e7a-4d56-8b4c-1eb19024973d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e17aaf4c0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:13.183811 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3f95fbe9-3e7a-4d56-8b4c-1eb19024973d tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "DELETE /compute/v2.1/images/ae23ff48-1a98-46d6-baaa-b158a60c65b9" status: 204 len: 0 microversion: 2.1 time: 0.222027 Aug 07 01:29:13.184904 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2083/3813] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:12 2022] DELETE /compute/v2.1/images/ae23ff48-1a98-46d6-baaa-b158a60c65b9 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:29:13.191427 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-071225b0-a69f-4708-8cb1-135348579bed tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:13.192219 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-071225b0-a69f-4708-8cb1-135348579bed tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:13.205164 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-071225b0-a69f-4708-8cb1-135348579bed tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:13.206043 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-071225b0-a69f-4708-8cb1-135348579bed tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:13.207456 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-071225b0-a69f-4708-8cb1-135348579bed tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:13.207995 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-071225b0-a69f-4708-8cb1-135348579bed tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:13.209405 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-071225b0-a69f-4708-8cb1-135348579bed tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:13.210532 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-071225b0-a69f-4708-8cb1-135348579bed tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:13.232424 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:13.238966 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2b37cacd-fe6c-4d9a-b39e-eef7b12c2e90 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:13.256514 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2b37cacd-fe6c-4d9a-b39e-eef7b12c2e90 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1508 microversion: 2.1 time: 0.449880 Aug 07 01:29:13.268959 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1731/3814] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:12 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1508 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:13.297457 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-69d3a2d1-07a9-425c-942b-1b12cb624f97 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e29937310>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:13.347639 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-69d3a2d1-07a9-425c-942b-1b12cb624f97 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] HTTP exception thrown: Image not found. Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-69d3a2d1-07a9-425c-942b-1b12cb624f97 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Request method failure captured: Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/images/ae23ff48-1a98-46d6-baaa-b158a60c65b9 HTTP/1.1 Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xR1vVMxdu4c-VeD8WhwnArlAdw4LaGDK4QiCB0iMp9aO9Z3Q0fVt5yTJxs9dkJJOd9I9nBpVN3nv_jIlwb9BZ7oFtDtYDUeZ4cD0pVKYhhtTo9jhTO5r9M3m1LYU02WfuWIlV6V0ob5NCcHreEgUGr8EsrWBVEtbhJAeWkC7O-CPZA Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: b7995a68f5a541aabda74c0b01f6aac9 Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ImagesTestJSON-2146129186 Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b7995a68f5a541aabda74c0b01f6aac9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b7995a68f5a541aabda74c0b01f6aac9", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b7995a68f5a541aabda74c0b01f6aac9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b7995a68f5a541aabda74c0b01f6aac9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ImagesTestJSON-2146129186 Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: b7995a68f5a541aabda74c0b01f6aac9 Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ImagesTestJSON-2146129186 Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ImagesTestJSON-2146129186-project Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: a50140f86f00487b90d0503d4819234f Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ImagesTestJSON-2146129186-project Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: exception: Image not found. Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'ae23ff48-1a98-46d6-baaa-b158a60c65b9'} Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ae23ff48-1a98-46d6-baaa-b158a60c65b9 Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 07 01:29:13.349877 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ae23ff48-1a98-46d6-baaa-b158a60c65b9 could not be found. Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 07 01:29:13.355821 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:13.362825 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-69d3a2d1-07a9-425c-942b-1b12cb624f97 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Returning 404 to user: Image not found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:29:13.364440 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-69d3a2d1-07a9-425c-942b-1b12cb624f97 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/images/ae23ff48-1a98-46d6-baaa-b158a60c65b9" status: 404 len: 62 microversion: 2.1 time: 0.085101 Aug 07 01:29:13.365317 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1732/3815] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:29:13 2022] GET /compute/v2.1/images/ae23ff48-1a98-46d6-baaa-b158a60c65b9 => generated 62 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:29:13.374162 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-601adb73-0985-4edb-86a6-7b68318e04be tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:13.378927 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-601adb73-0985-4edb-86a6-7b68318e04be tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:13.396808 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-601adb73-0985-4edb-86a6-7b68318e04be tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:13.398540 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-601adb73-0985-4edb-86a6-7b68318e04be tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:13.399410 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-601adb73-0985-4edb-86a6-7b68318e04be tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:13.400660 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-601adb73-0985-4edb-86a6-7b68318e04be tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:13.401524 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-601adb73-0985-4edb-86a6-7b68318e04be tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:13.402315 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-601adb73-0985-4edb-86a6-7b68318e04be tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:13.452307 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-071225b0-a69f-4708-8cb1-135348579bed tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:13.466071 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-071225b0-a69f-4708-8cb1-135348579bed tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.280007 Aug 07 01:29:13.467416 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2084/3816] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:13 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:13.494109 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-221c606d-a7c1-4687-b9dc-6aac3690b11f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:13.496078 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-221c606d-a7c1-4687-b9dc-6aac3690b11f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: d9c8e298-f10a-4a99-9b30-00d1a0cc12b5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:13.512896 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-221c606d-a7c1-4687-b9dc-6aac3690b11f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:13.514350 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-221c606d-a7c1-4687-b9dc-6aac3690b11f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:13.514936 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-221c606d-a7c1-4687-b9dc-6aac3690b11f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:13.515830 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-221c606d-a7c1-4687-b9dc-6aac3690b11f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:13.516626 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-221c606d-a7c1-4687-b9dc-6aac3690b11f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:13.517330 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-221c606d-a7c1-4687-b9dc-6aac3690b11f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:13.852028 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-601adb73-0985-4edb-86a6-7b68318e04be tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:13.865925 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-601adb73-0985-4edb-86a6-7b68318e04be tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1314 microversion: 2.1 time: 0.494759 Aug 07 01:29:13.877015 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1733/3817] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:13 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1314 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:13.889093 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-221c606d-a7c1-4687-b9dc-6aac3690b11f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:13.906547 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f2deefc7-3ff5-4064-a128-f20ecab56bc8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:13.906738 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-221c606d-a7c1-4687-b9dc-6aac3690b11f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5" status: 200 len: 1499 microversion: 2.1 time: 0.425714 Aug 07 01:29:13.907829 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f2deefc7-3ff5-4064-a128-f20ecab56bc8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 7cbbe4d6-2d90-4640-86d6-5a3aa603a7ae] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:13.908817 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2085/3818] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:13 2022] GET /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5 => generated 1499 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:13.927731 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-f2deefc7-3ff5-4064-a128-f20ecab56bc8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] HTTP exception thrown: Instance 7cbbe4d6-2d90-4640-86d6-5a3aa603a7ae could not be found. Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f2deefc7-3ff5-4064-a128-f20ecab56bc8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/servers/7cbbe4d6-2d90-4640-86d6-5a3aa603a7ae/action HTTP/1.1 Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 14 Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: {"resume": {}} Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 7cbbe4d6-2d90-4640-86d6-5a3aa603a7ae could not be found. Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '7cbbe4d6-2d90-4640-86d6-5a3aa603a7ae', 'body': {'resume': {}}} Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cbbe4d6-2d90-4640-86d6-5a3aa603a7ae could not be found. Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cbbe4d6-2d90-4640-86d6-5a3aa603a7ae could not be found. Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:13.947863 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:13.957648 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:29:13.957648 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:29:13.957648 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cbbe4d6-2d90-4640-86d6-5a3aa603a7ae could not be found. Aug 07 01:29:13.957648 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:13.957648 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f2deefc7-3ff5-4064-a128-f20ecab56bc8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 404 to user: Instance 7cbbe4d6-2d90-4640-86d6-5a3aa603a7ae could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:29:13.957648 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f2deefc7-3ff5-4064-a128-f20ecab56bc8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers/7cbbe4d6-2d90-4640-86d6-5a3aa603a7ae/action" status: 404 len: 111 microversion: 2.1 time: 0.052794 Aug 07 01:29:13.957648 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1734/3819] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:29:13 2022] POST /compute/v2.1/servers/7cbbe4d6-2d90-4640-86d6-5a3aa603a7ae/action => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:29:13.969656 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7e50057d-c841-42ac-b102-11f7c9745ced tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:13.971596 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7e50057d-c841-42ac-b102-11f7c9745ced tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:13.983305 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e50057d-c841-42ac-b102-11f7c9745ced tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:13.988914 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e50057d-c841-42ac-b102-11f7c9745ced tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:13.990337 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e50057d-c841-42ac-b102-11f7c9745ced tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:13.991775 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e50057d-c841-42ac-b102-11f7c9745ced tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:13.993006 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e50057d-c841-42ac-b102-11f7c9745ced tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:13.993728 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e50057d-c841-42ac-b102-11f7c9745ced tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:14.297826 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b53bb01d-e1ec-485d-a8ff-bcfab9752b37 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:14.299433 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b53bb01d-e1ec-485d-a8ff-bcfab9752b37 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:14.309824 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b53bb01d-e1ec-485d-a8ff-bcfab9752b37 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:14.310824 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b53bb01d-e1ec-485d-a8ff-bcfab9752b37 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:14.311515 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b53bb01d-e1ec-485d-a8ff-bcfab9752b37 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:14.312673 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b53bb01d-e1ec-485d-a8ff-bcfab9752b37 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:14.313391 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b53bb01d-e1ec-485d-a8ff-bcfab9752b37 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:14.314044 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b53bb01d-e1ec-485d-a8ff-bcfab9752b37 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:14.350089 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7e50057d-c841-42ac-b102-11f7c9745ced tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:14.362481 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7e50057d-c841-42ac-b102-11f7c9745ced tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.401811 Aug 07 01:29:14.366669 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2086/3820] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:13 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:14.392434 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1d29fa4d-f867-4e3c-8fa4-4e45a456afd1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:14.393358 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1d29fa4d-f867-4e3c-8fa4-4e45a456afd1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:14.401873 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d29fa4d-f867-4e3c-8fa4-4e45a456afd1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:14.404083 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d29fa4d-f867-4e3c-8fa4-4e45a456afd1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:14.404741 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d29fa4d-f867-4e3c-8fa4-4e45a456afd1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:14.406293 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d29fa4d-f867-4e3c-8fa4-4e45a456afd1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:14.406953 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d29fa4d-f867-4e3c-8fa4-4e45a456afd1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:14.407566 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d29fa4d-f867-4e3c-8fa4-4e45a456afd1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:14.680375 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1d29fa4d-f867-4e3c-8fa4-4e45a456afd1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:14.692224 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1d29fa4d-f867-4e3c-8fa4-4e45a456afd1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.303864 Aug 07 01:29:14.708999 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2087/3821] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:14 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:14.716836 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9d9a1829-9d8f-4aac-b3eb-e6ad23c4ecad tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:14.717672 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9d9a1829-9d8f-4aac-b3eb-e6ad23c4ecad tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:14.725998 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d9a1829-9d8f-4aac-b3eb-e6ad23c4ecad tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:14.726813 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d9a1829-9d8f-4aac-b3eb-e6ad23c4ecad tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:14.727442 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d9a1829-9d8f-4aac-b3eb-e6ad23c4ecad tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:14.728477 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d9a1829-9d8f-4aac-b3eb-e6ad23c4ecad tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:14.729352 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d9a1829-9d8f-4aac-b3eb-e6ad23c4ecad tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:14.730094 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d9a1829-9d8f-4aac-b3eb-e6ad23c4ecad tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:14.762205 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-9d9a1829-9d8f-4aac-b3eb-e6ad23c4ecad tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] HTTP exception thrown: Cannot 'resume' instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 while it is in vm_state active Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9d9a1829-9d8f-4aac-b3eb-e6ad23c4ecad tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015/action HTTP/1.1 Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 14 Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: {"resume": {}} Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: exception: Cannot 'resume' instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 while it is in vm_state active Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'd9b1883a-c95a-4c49-ad6d-335ecf03b015', 'body': {'resume': {}}} Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 in vm_state active. Cannot resume while the instance is in this state. Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 while it is in vm_state active Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:14.764263 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:14.770492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:14.770492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:29:14.770492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:29:14.770492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 while it is in vm_state active Aug 07 01:29:14.770492 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:14.773509 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9d9a1829-9d8f-4aac-b3eb-e6ad23c4ecad tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 409 to user: Cannot 'resume' instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 while it is in vm_state active {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:29:14.774595 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9d9a1829-9d8f-4aac-b3eb-e6ad23c4ecad tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015/action" status: 409 len: 144 microversion: 2.1 time: 0.062896 Aug 07 01:29:14.779109 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2088/3822] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:29:14 2022] POST /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015/action => generated 144 bytes in 68 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 07 01:29:14.785489 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5acb0bbc-4686-497e-862e-0883026db553 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:14.786512 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5acb0bbc-4686-497e-862e-0883026db553 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:14.795032 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5acb0bbc-4686-497e-862e-0883026db553 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:14.795799 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5acb0bbc-4686-497e-862e-0883026db553 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:14.796521 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5acb0bbc-4686-497e-862e-0883026db553 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:14.797439 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5acb0bbc-4686-497e-862e-0883026db553 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:14.798252 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5acb0bbc-4686-497e-862e-0883026db553 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:14.798940 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5acb0bbc-4686-497e-862e-0883026db553 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:14.925389 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b53bb01d-e1ec-485d-a8ff-bcfab9752b37 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:14.942659 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b53bb01d-e1ec-485d-a8ff-bcfab9752b37 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1508 microversion: 2.1 time: 0.648795 Aug 07 01:29:14.956830 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1735/3823] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:14 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1508 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:14.965929 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8297eb01-fe13-4e53-a4ac-23944af547b3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:14.966931 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8297eb01-fe13-4e53-a4ac-23944af547b3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:14.976093 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8297eb01-fe13-4e53-a4ac-23944af547b3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:14.977118 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8297eb01-fe13-4e53-a4ac-23944af547b3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:14.977736 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8297eb01-fe13-4e53-a4ac-23944af547b3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:14.978686 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8297eb01-fe13-4e53-a4ac-23944af547b3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:14.979360 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8297eb01-fe13-4e53-a4ac-23944af547b3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:14.979994 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8297eb01-fe13-4e53-a4ac-23944af547b3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:15.183306 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5acb0bbc-4686-497e-862e-0883026db553 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:15.198782 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5acb0bbc-4686-497e-862e-0883026db553 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.418145 Aug 07 01:29:15.199383 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2089/3824] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:14 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:15.208322 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5002647d-52c6-4037-bd69-e043d30c76b4 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:15.209520 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5002647d-52c6-4037-bd69-e043d30c76b4 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: d9c8e298-f10a-4a99-9b30-00d1a0cc12b5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:15.228341 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5002647d-52c6-4037-bd69-e043d30c76b4 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:15.230162 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5002647d-52c6-4037-bd69-e043d30c76b4 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:15.241241 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5002647d-52c6-4037-bd69-e043d30c76b4 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:15.241241 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5002647d-52c6-4037-bd69-e043d30c76b4 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:15.241241 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5002647d-52c6-4037-bd69-e043d30c76b4 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:15.241241 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5002647d-52c6-4037-bd69-e043d30c76b4 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:15.296765 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8297eb01-fe13-4e53-a4ac-23944af547b3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:15.306665 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8297eb01-fe13-4e53-a4ac-23944af547b3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1314 microversion: 2.1 time: 0.348194 Aug 07 01:29:15.308355 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1736/3825] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:14 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:15.315041 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-353e463d-e00e-4044-94a1-08e4f8f2c256 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:15.316356 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-353e463d-e00e-4044-94a1-08e4f8f2c256 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:15.325568 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-353e463d-e00e-4044-94a1-08e4f8f2c256 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:15.326485 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-353e463d-e00e-4044-94a1-08e4f8f2c256 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:15.327366 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-353e463d-e00e-4044-94a1-08e4f8f2c256 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:15.328412 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-353e463d-e00e-4044-94a1-08e4f8f2c256 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:15.329221 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-353e463d-e00e-4044-94a1-08e4f8f2c256 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:15.329967 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-353e463d-e00e-4044-94a1-08e4f8f2c256 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:15.610403 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5002647d-52c6-4037-bd69-e043d30c76b4 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:15.637484 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5002647d-52c6-4037-bd69-e043d30c76b4 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5" status: 200 len: 1505 microversion: 2.1 time: 0.436929 Aug 07 01:29:15.638313 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2090/3826] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:15 2022] GET /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5 => generated 1505 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:15.641124 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-353e463d-e00e-4044-94a1-08e4f8f2c256 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:15.654529 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-353e463d-e00e-4044-94a1-08e4f8f2c256 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.344092 Aug 07 01:29:15.655744 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1737/3827] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:15 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:15.736267 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2d961d3a-ba55-426d-b733-ff6b157b5219 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "cf9a6ffb-a1bc-4f16-8970-9d69635f8f75"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2d961d3a-ba55-426d-b733-ff6b157b5219 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 160 Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: {"server": {"name": "", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "cf9a6ffb-a1bc-4f16-8970-9d69635f8f75"}]}} Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: action_args: {'body': {'server': {'name': '', 'imageRef': 'e825bd61-bf05-4bd4-aa72-78daf2231731', 'flavorRef': '452', 'networks': [{'uuid': 'cf9a6ffb-a1bc-4f16-8970-9d69635f8f75'}]}}} Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi '' Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:29:15.743826 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:29:15.749506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:29:15.749506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 07 01:29:15.749506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:15.749506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:15.749506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:15.749506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:15.749506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:15.749506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:15.749506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:29:15.749506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:29:15.749506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 07 01:29:15.749506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:15.755052 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2d961d3a-ba55-426d-b733-ff6b157b5219 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:29:15.758266 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2d961d3a-ba55-426d-b733-ff6b157b5219 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.028475 Aug 07 01:29:15.772284 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2091/3828] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:29:15 2022] POST /compute/v2.1/servers => generated 108 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:29:15.777460 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-a11cd047-3301-476c-b4de-6c3c3595475c req-86a513a4-4288-4439-9af6-4d371233a0f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70c50292-4191-4cb3-955b-757ad1575a17", "tag": "c76a6bcd-5ca4-451e-a693-b5ee6ea2941a"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:15.781779 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-062af5c3-e684-45dc-8b39-90f59d04e9aa tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:15.785897 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-062af5c3-e684-45dc-8b39-90f59d04e9aa tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:15.799525 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-062af5c3-e684-45dc-8b39-90f59d04e9aa tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:15.800187 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a11cd047-3301-476c-b4de-6c3c3595475c req-86a513a4-4288-4439-9af6-4d371233a0f4 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:15.800437 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-062af5c3-e684-45dc-8b39-90f59d04e9aa tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:15.800737 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a11cd047-3301-476c-b4de-6c3c3595475c req-86a513a4-4288-4439-9af6-4d371233a0f4 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:15.801117 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-062af5c3-e684-45dc-8b39-90f59d04e9aa tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:15.801343 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a11cd047-3301-476c-b4de-6c3c3595475c req-86a513a4-4288-4439-9af6-4d371233a0f4 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:15.802135 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-062af5c3-e684-45dc-8b39-90f59d04e9aa tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:15.802908 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-062af5c3-e684-45dc-8b39-90f59d04e9aa tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:15.803542 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-062af5c3-e684-45dc-8b39-90f59d04e9aa tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:15.808103 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:15.836418 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-a11cd047-3301-476c-b4de-6c3c3595475c req-86a513a4-4288-4439-9af6-4d371233a0f4 service nova] Creating event network-changed:c76a6bcd-5ca4-451e-a693-b5ee6ea2941a for instance 70c50292-4191-4cb3-955b-757ad1575a17 on n-h2-master-1 Aug 07 01:29:15.847511 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-a11cd047-3301-476c-b4de-6c3c3595475c req-86a513a4-4288-4439-9af6-4d371233a0f4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083341 Aug 07 01:29:15.848868 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1738/3829] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:29:15.982143 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c3308c93-d33e-4227-8055-54cae8a6b8f6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:15.983913 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c3308c93-d33e-4227-8055-54cae8a6b8f6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:15.992170 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3308c93-d33e-4227-8055-54cae8a6b8f6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:15.993057 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3308c93-d33e-4227-8055-54cae8a6b8f6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:15.994081 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3308c93-d33e-4227-8055-54cae8a6b8f6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:15.995160 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3308c93-d33e-4227-8055-54cae8a6b8f6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:15.999481 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3308c93-d33e-4227-8055-54cae8a6b8f6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:16.000307 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3308c93-d33e-4227-8055-54cae8a6b8f6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:16.025814 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-062af5c3-e684-45dc-8b39-90f59d04e9aa tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:16.036103 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-062af5c3-e684-45dc-8b39-90f59d04e9aa tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.262346 Aug 07 01:29:16.044455 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2092/3830] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:15 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:16.057880 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1463ed11-94bf-4c07-b5e9-d5c641ba2a9b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:16.058566 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1463ed11-94bf-4c07-b5e9-d5c641ba2a9b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:16.065055 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1463ed11-94bf-4c07-b5e9-d5c641ba2a9b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:16.065879 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1463ed11-94bf-4c07-b5e9-d5c641ba2a9b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:16.066401 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1463ed11-94bf-4c07-b5e9-d5c641ba2a9b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:16.067186 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1463ed11-94bf-4c07-b5e9-d5c641ba2a9b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:16.067727 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1463ed11-94bf-4c07-b5e9-d5c641ba2a9b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:16.068237 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1463ed11-94bf-4c07-b5e9-d5c641ba2a9b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:16.241822 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1463ed11-94bf-4c07-b5e9-d5c641ba2a9b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:16.253372 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1463ed11-94bf-4c07-b5e9-d5c641ba2a9b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.199334 Aug 07 01:29:16.254930 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2093/3831] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:16 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:16.286218 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-71ec62bc-b577-4ffc-bfc8-baad3dff2e15 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:16.286955 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-71ec62bc-b577-4ffc-bfc8-baad3dff2e15 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d8e32452-6c6a-4886-9daf-be6f07452473] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:16.295457 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-71ec62bc-b577-4ffc-bfc8-baad3dff2e15 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] HTTP exception thrown: Instance d8e32452-6c6a-4886-9daf-be6f07452473 could not be found. Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-71ec62bc-b577-4ffc-bfc8-baad3dff2e15 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers/d8e32452-6c6a-4886-9daf-be6f07452473/action HTTP/1.1 Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 14 Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: {"shelve": {}} Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: exception: Instance d8e32452-6c6a-4886-9daf-be6f07452473 could not be found. Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'd8e32452-6c6a-4886-9daf-be6f07452473', 'body': {'shelve': {}}} Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8e32452-6c6a-4886-9daf-be6f07452473 could not be found. Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8e32452-6c6a-4886-9daf-be6f07452473 could not be found. Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:16.299597 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:16.309865 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:29:16.309865 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:29:16.309865 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8e32452-6c6a-4886-9daf-be6f07452473 could not be found. Aug 07 01:29:16.309865 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:16.309865 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-71ec62bc-b577-4ffc-bfc8-baad3dff2e15 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 404 to user: Instance d8e32452-6c6a-4886-9daf-be6f07452473 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:29:16.309865 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-71ec62bc-b577-4ffc-bfc8-baad3dff2e15 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers/d8e32452-6c6a-4886-9daf-be6f07452473/action" status: 404 len: 111 microversion: 2.1 time: 0.022929 Aug 07 01:29:16.309865 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2094/3832] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:29:16 2022] POST /compute/v2.1/servers/d8e32452-6c6a-4886-9daf-be6f07452473/action => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:29:16.315175 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-aadc8598-3bad-498d-8cf9-6abf8f8b3963 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:16.315795 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-aadc8598-3bad-498d-8cf9-6abf8f8b3963 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:16.326198 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aadc8598-3bad-498d-8cf9-6abf8f8b3963 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:16.326739 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aadc8598-3bad-498d-8cf9-6abf8f8b3963 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:16.327380 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aadc8598-3bad-498d-8cf9-6abf8f8b3963 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:16.328130 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aadc8598-3bad-498d-8cf9-6abf8f8b3963 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:16.328714 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aadc8598-3bad-498d-8cf9-6abf8f8b3963 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:16.329342 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aadc8598-3bad-498d-8cf9-6abf8f8b3963 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:16.371935 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c3308c93-d33e-4227-8055-54cae8a6b8f6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:16.380614 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c3308c93-d33e-4227-8055-54cae8a6b8f6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1508 microversion: 2.1 time: 0.413877 Aug 07 01:29:16.383581 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1739/3833] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:15 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1508 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:16.392061 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4e95a43e-43a6-4645-9970-4ceb7d0700b3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:16.393025 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4e95a43e-43a6-4645-9970-4ceb7d0700b3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:16.406944 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4e95a43e-43a6-4645-9970-4ceb7d0700b3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:16.408028 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4e95a43e-43a6-4645-9970-4ceb7d0700b3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:16.408779 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4e95a43e-43a6-4645-9970-4ceb7d0700b3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:16.409804 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4e95a43e-43a6-4645-9970-4ceb7d0700b3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:16.410223 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4e95a43e-43a6-4645-9970-4ceb7d0700b3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:16.410891 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4e95a43e-43a6-4645-9970-4ceb7d0700b3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:16.652469 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4e95a43e-43a6-4645-9970-4ceb7d0700b3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:16.663725 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4e95a43e-43a6-4645-9970-4ceb7d0700b3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1314 microversion: 2.1 time: 0.276104 Aug 07 01:29:16.667199 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-aadc8598-3bad-498d-8cf9-6abf8f8b3963 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:16.677330 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1740/3834] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:16 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:16.682308 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-17302eb7-5111-49b6-ba29-fe1a0b818710 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:16.683081 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-17302eb7-5111-49b6-ba29-fe1a0b818710 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: d9c8e298-f10a-4a99-9b30-00d1a0cc12b5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:16.688090 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-aadc8598-3bad-498d-8cf9-6abf8f8b3963 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.377998 Aug 07 01:29:16.689059 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2095/3835] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:16 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:16.698671 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-17302eb7-5111-49b6-ba29-fe1a0b818710 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:16.700806 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-17302eb7-5111-49b6-ba29-fe1a0b818710 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:16.701299 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-17302eb7-5111-49b6-ba29-fe1a0b818710 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:16.702063 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-17302eb7-5111-49b6-ba29-fe1a0b818710 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:16.702580 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-17302eb7-5111-49b6-ba29-fe1a0b818710 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:16.705423 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-17302eb7-5111-49b6-ba29-fe1a0b818710 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:16.715547 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-53e26420-5f6c-4aef-a248-abf35341946b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:16.717303 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-53e26420-5f6c-4aef-a248-abf35341946b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:16.728548 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-53e26420-5f6c-4aef-a248-abf35341946b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:16.729637 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-53e26420-5f6c-4aef-a248-abf35341946b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:16.730421 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-53e26420-5f6c-4aef-a248-abf35341946b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:16.731852 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-53e26420-5f6c-4aef-a248-abf35341946b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:16.732511 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-53e26420-5f6c-4aef-a248-abf35341946b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:16.733270 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-53e26420-5f6c-4aef-a248-abf35341946b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:16.843071 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-17302eb7-5111-49b6-ba29-fe1a0b818710 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:16.850917 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-17302eb7-5111-49b6-ba29-fe1a0b818710 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5" status: 200 len: 1487 microversion: 2.1 time: 0.172627 Aug 07 01:29:16.851507 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1741/3836] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:16 2022] GET /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5 => generated 1487 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:16.871682 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e14d2cd9-46bf-4c80-a56f-9859865b56dd tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:16.872231 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e14d2cd9-46bf-4c80-a56f-9859865b56dd tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: d9c8e298-f10a-4a99-9b30-00d1a0cc12b5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:16.878613 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e14d2cd9-46bf-4c80-a56f-9859865b56dd tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:16.879278 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e14d2cd9-46bf-4c80-a56f-9859865b56dd tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:16.879734 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e14d2cd9-46bf-4c80-a56f-9859865b56dd tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:16.880521 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e14d2cd9-46bf-4c80-a56f-9859865b56dd tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:16.881016 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e14d2cd9-46bf-4c80-a56f-9859865b56dd tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:16.881444 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e14d2cd9-46bf-4c80-a56f-9859865b56dd tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:16.909944 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e14d2cd9-46bf-4c80-a56f-9859865b56dd tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: d9c8e298-f10a-4a99-9b30-00d1a0cc12b5] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:29:17.003656 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e14d2cd9-46bf-4c80-a56f-9859865b56dd tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5" status: 204 len: 0 microversion: 2.1 time: 0.135812 Aug 07 01:29:17.004423 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1742/3837] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:29:16 2022] DELETE /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 07 01:29:17.013442 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-53e26420-5f6c-4aef-a248-abf35341946b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:17.015368 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5e4309e5-b898-4186-ad38-2935925c3bf5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e242c88b0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:17.024807 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-53e26420-5f6c-4aef-a248-abf35341946b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.318193 Aug 07 01:29:17.036625 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2096/3838] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:16 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:29:17.047059 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5970f40d-c914-4b7c-8c36-97cfa2b89b44 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:17.047671 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5970f40d-c914-4b7c-8c36-97cfa2b89b44 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:17.051858 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-5e4309e5-b898-4186-ad38-2935925c3bf5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] HTTP exception thrown: Image not found. Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5e4309e5-b898-4186-ad38-2935925c3bf5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Request method failure captured: Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/images/ae23ff48-1a98-46d6-baaa-b158a60c65b9 HTTP/1.1 Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xR1vVMxdu4c-VeD8WhwnArlAdw4LaGDK4QiCB0iMp9aO9Z3Q0fVt5yTJxs9dkJJOd9I9nBpVN3nv_jIlwb9BZ7oFtDtYDUeZ4cD0pVKYhhtTo9jhTO5r9M3m1LYU02WfuWIlV6V0ob5NCcHreEgUGr8EsrWBVEtbhJAeWkC7O-CPZA Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: b7995a68f5a541aabda74c0b01f6aac9 Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ImagesTestJSON-2146129186 Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b7995a68f5a541aabda74c0b01f6aac9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b7995a68f5a541aabda74c0b01f6aac9", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b7995a68f5a541aabda74c0b01f6aac9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b7995a68f5a541aabda74c0b01f6aac9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ImagesTestJSON-2146129186 Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: b7995a68f5a541aabda74c0b01f6aac9 Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ImagesTestJSON-2146129186 Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ImagesTestJSON-2146129186-project Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: a50140f86f00487b90d0503d4819234f Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ImagesTestJSON-2146129186-project Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: exception: Image not found. Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'ae23ff48-1a98-46d6-baaa-b158a60c65b9'} Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ae23ff48-1a98-46d6-baaa-b158a60c65b9 to delete Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ae23ff48-1a98-46d6-baaa-b158a60c65b9 could not be found. Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:17.053784 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:17.062407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:17.062407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:17.062407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:29:17.062407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:29:17.062407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:29:17.062407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:29:17.062407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:29:17.062407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:29:17.062407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 07 01:29:17.062407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 07 01:29:17.062407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 07 01:29:17.062407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:17.062407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:17.062407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:17.062407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:17.062407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:17.062407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:17.062407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:29:17.062407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:29:17.062407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 07 01:29:17.062407 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:17.064853 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5970f40d-c914-4b7c-8c36-97cfa2b89b44 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:17.065038 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5e4309e5-b898-4186-ad38-2935925c3bf5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Returning 404 to user: Image not found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:29:17.065214 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5970f40d-c914-4b7c-8c36-97cfa2b89b44 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:17.065214 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5970f40d-c914-4b7c-8c36-97cfa2b89b44 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:17.065534 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5e4309e5-b898-4186-ad38-2935925c3bf5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "DELETE /compute/v2.1/images/ae23ff48-1a98-46d6-baaa-b158a60c65b9" status: 404 len: 62 microversion: 2.1 time: 0.044963 Aug 07 01:29:17.065715 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5970f40d-c914-4b7c-8c36-97cfa2b89b44 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:17.065879 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1743/3839] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:17 2022] DELETE /compute/v2.1/images/ae23ff48-1a98-46d6-baaa-b158a60c65b9 => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 07 01:29:17.066053 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5970f40d-c914-4b7c-8c36-97cfa2b89b44 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:17.066053 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5970f40d-c914-4b7c-8c36-97cfa2b89b44 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:17.066365 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6c4c7fc4-36c3-4804-bb06-fe29aef1e780 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:17.067558 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6c4c7fc4-36c3-4804-bb06-fe29aef1e780 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: d9c8e298-f10a-4a99-9b30-00d1a0cc12b5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:17.075141 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c4c7fc4-36c3-4804-bb06-fe29aef1e780 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:17.075632 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c4c7fc4-36c3-4804-bb06-fe29aef1e780 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:17.076760 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c4c7fc4-36c3-4804-bb06-fe29aef1e780 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:17.078234 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c4c7fc4-36c3-4804-bb06-fe29aef1e780 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:17.078616 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c4c7fc4-36c3-4804-bb06-fe29aef1e780 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:17.079946 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c4c7fc4-36c3-4804-bb06-fe29aef1e780 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:17.082662 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-5970f40d-c914-4b7c-8c36-97cfa2b89b44 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lazy-loading 'flavor' on Instance uuid d9b1883a-c95a-4c49-ad6d-335ecf03b015 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:29:17.108654 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6c4c7fc4-36c3-4804-bb06-fe29aef1e780 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: d9c8e298-f10a-4a99-9b30-00d1a0cc12b5] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:29:17.164631 n-d-master-1 devstack@n-api.service[119517]: INFO nova.compute.api [None req-6c4c7fc4-36c3-4804-bb06-fe29aef1e780 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: d9c8e298-f10a-4a99-9b30-00d1a0cc12b5] Instance is already in deleting state, ignoring this request Aug 07 01:29:17.166182 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6c4c7fc4-36c3-4804-bb06-fe29aef1e780 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5" status: 204 len: 0 microversion: 2.1 time: 0.105506 Aug 07 01:29:17.170837 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1744/3840] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:29:17 2022] DELETE /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:29:17.177297 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-dd8a83ed-008d-4c94-bad3-c7cd894ba0e9 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:17.178321 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-dd8a83ed-008d-4c94-bad3-c7cd894ba0e9 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: d9c8e298-f10a-4a99-9b30-00d1a0cc12b5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:17.185566 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd8a83ed-008d-4c94-bad3-c7cd894ba0e9 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:17.187419 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd8a83ed-008d-4c94-bad3-c7cd894ba0e9 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:17.188444 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd8a83ed-008d-4c94-bad3-c7cd894ba0e9 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:17.189418 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd8a83ed-008d-4c94-bad3-c7cd894ba0e9 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:17.190106 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd8a83ed-008d-4c94-bad3-c7cd894ba0e9 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:17.190777 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd8a83ed-008d-4c94-bad3-c7cd894ba0e9 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:17.388636 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5970f40d-c914-4b7c-8c36-97cfa2b89b44 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015/action" status: 202 len: 0 microversion: 2.1 time: 0.342991 Aug 07 01:29:17.392340 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2097/3841] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:29:17 2022] POST /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 01:29:17.411302 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-dd8a83ed-008d-4c94-bad3-c7cd894ba0e9 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:17.421486 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c75e1299-5fc9-4d3f-b587-d6da3eca6f30 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:17.424641 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-dd8a83ed-008d-4c94-bad3-c7cd894ba0e9 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5" status: 200 len: 1493 microversion: 2.1 time: 0.251962 Aug 07 01:29:17.426352 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1745/3842] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:17 2022] GET /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5 => generated 1493 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:17.428856 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c75e1299-5fc9-4d3f-b587-d6da3eca6f30 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:17.444945 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-70f08cb0-2eb9-4317-8155-071f269ed690 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:17.445744 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-70f08cb0-2eb9-4317-8155-071f269ed690 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:17.452392 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c75e1299-5fc9-4d3f-b587-d6da3eca6f30 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:17.453234 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-70f08cb0-2eb9-4317-8155-071f269ed690 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:17.453733 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-70f08cb0-2eb9-4317-8155-071f269ed690 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:17.454049 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c75e1299-5fc9-4d3f-b587-d6da3eca6f30 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:17.454213 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-70f08cb0-2eb9-4317-8155-071f269ed690 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:17.454883 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-70f08cb0-2eb9-4317-8155-071f269ed690 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:17.455344 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-70f08cb0-2eb9-4317-8155-071f269ed690 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:17.455480 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c75e1299-5fc9-4d3f-b587-d6da3eca6f30 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:17.455773 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-70f08cb0-2eb9-4317-8155-071f269ed690 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:17.457069 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c75e1299-5fc9-4d3f-b587-d6da3eca6f30 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:17.458060 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c75e1299-5fc9-4d3f-b587-d6da3eca6f30 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:17.459096 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c75e1299-5fc9-4d3f-b587-d6da3eca6f30 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:17.677938 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c75e1299-5fc9-4d3f-b587-d6da3eca6f30 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:17.692978 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c75e1299-5fc9-4d3f-b587-d6da3eca6f30 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1512 microversion: 2.1 time: 0.294742 Aug 07 01:29:17.694742 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2098/3843] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:17 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1512 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:17.707484 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-9e12ab77-83a3-4a11-9d51-02c8e0fac046 req-e5d2819d-264c-44a5-ad5b-1f51bf1a5701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9c8e298-f10a-4a99-9b30-00d1a0cc12b5", "name": "network-vif-plugged", "status": "completed", "tag": "8cdc75fb-4acd-4c53-a858-7be2c2e39a11"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:17.726045 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-9e12ab77-83a3-4a11-9d51-02c8e0fac046 req-e5d2819d-264c-44a5-ad5b-1f51bf1a5701 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:17.727019 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-9e12ab77-83a3-4a11-9d51-02c8e0fac046 req-e5d2819d-264c-44a5-ad5b-1f51bf1a5701 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:17.727826 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-9e12ab77-83a3-4a11-9d51-02c8e0fac046 req-e5d2819d-264c-44a5-ad5b-1f51bf1a5701 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:17.730835 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-70f08cb0-2eb9-4317-8155-071f269ed690 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:17.743570 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-70f08cb0-2eb9-4317-8155-071f269ed690 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1508 microversion: 2.1 time: 0.316110 Aug 07 01:29:17.745543 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1746/3844] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:17 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1508 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:17.752542 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b81f9bfe-7814-46a3-81ad-182bfab203d1 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:17.753729 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b81f9bfe-7814-46a3-81ad-182bfab203d1 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:17.754180 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-9e12ab77-83a3-4a11-9d51-02c8e0fac046 req-e5d2819d-264c-44a5-ad5b-1f51bf1a5701 service nova] Creating event network-vif-plugged:8cdc75fb-4acd-4c53-a858-7be2c2e39a11 for instance d9c8e298-f10a-4a99-9b30-00d1a0cc12b5 on n-h1-master-1 Aug 07 01:29:17.769203 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b81f9bfe-7814-46a3-81ad-182bfab203d1 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:17.771631 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b81f9bfe-7814-46a3-81ad-182bfab203d1 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:17.772412 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-9e12ab77-83a3-4a11-9d51-02c8e0fac046 req-e5d2819d-264c-44a5-ad5b-1f51bf1a5701 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075418 Aug 07 01:29:17.772998 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b81f9bfe-7814-46a3-81ad-182bfab203d1 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:17.773129 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2099/3845] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:29:17.774293 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b81f9bfe-7814-46a3-81ad-182bfab203d1 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:17.775002 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b81f9bfe-7814-46a3-81ad-182bfab203d1 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:17.775646 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b81f9bfe-7814-46a3-81ad-182bfab203d1 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:18.112050 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b81f9bfe-7814-46a3-81ad-182bfab203d1 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:18.121339 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b81f9bfe-7814-46a3-81ad-182bfab203d1 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1314 microversion: 2.1 time: 0.374311 Aug 07 01:29:18.122595 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1747/3846] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:17 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:18.449182 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8a710df7-c1db-4210-8357-1388bd0cb3b6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:18.450650 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8a710df7-c1db-4210-8357-1388bd0cb3b6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: d9c8e298-f10a-4a99-9b30-00d1a0cc12b5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:18.458441 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a710df7-c1db-4210-8357-1388bd0cb3b6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:18.458932 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a710df7-c1db-4210-8357-1388bd0cb3b6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:18.459564 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a710df7-c1db-4210-8357-1388bd0cb3b6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:18.460510 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a710df7-c1db-4210-8357-1388bd0cb3b6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:18.461146 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a710df7-c1db-4210-8357-1388bd0cb3b6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:18.461753 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a710df7-c1db-4210-8357-1388bd0cb3b6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:18.623295 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8a710df7-c1db-4210-8357-1388bd0cb3b6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:18.631707 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8a710df7-c1db-4210-8357-1388bd0cb3b6 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5" status: 200 len: 1493 microversion: 2.1 time: 0.188137 Aug 07 01:29:18.633001 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2100/3847] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:18 2022] GET /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5 => generated 1493 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:18.714921 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1bec8132-b0e5-4297-83cc-e489b914fd60 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:18.715850 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1bec8132-b0e5-4297-83cc-e489b914fd60 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:18.723016 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1bec8132-b0e5-4297-83cc-e489b914fd60 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:18.723775 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1bec8132-b0e5-4297-83cc-e489b914fd60 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:18.724254 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1bec8132-b0e5-4297-83cc-e489b914fd60 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:18.724970 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1bec8132-b0e5-4297-83cc-e489b914fd60 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:18.725609 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1bec8132-b0e5-4297-83cc-e489b914fd60 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:18.726041 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1bec8132-b0e5-4297-83cc-e489b914fd60 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:18.768081 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-195bbe54-42e7-4ecc-ba59-e042560db871 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:18.769005 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-195bbe54-42e7-4ecc-ba59-e042560db871 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:18.780013 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-195bbe54-42e7-4ecc-ba59-e042560db871 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:18.781264 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-195bbe54-42e7-4ecc-ba59-e042560db871 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:18.782096 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-195bbe54-42e7-4ecc-ba59-e042560db871 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:18.783237 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-195bbe54-42e7-4ecc-ba59-e042560db871 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:18.783908 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-195bbe54-42e7-4ecc-ba59-e042560db871 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:18.784520 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-195bbe54-42e7-4ecc-ba59-e042560db871 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:19.030234 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1bec8132-b0e5-4297-83cc-e489b914fd60 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:19.040526 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1bec8132-b0e5-4297-83cc-e489b914fd60 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1512 microversion: 2.1 time: 0.329373 Aug 07 01:29:19.042066 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1748/3848] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:18 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1512 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:19.150200 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-add15b89-a37b-4800-8fc9-167c210ced06 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:19.152784 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-add15b89-a37b-4800-8fc9-167c210ced06 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:19.164626 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-add15b89-a37b-4800-8fc9-167c210ced06 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:19.166152 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-add15b89-a37b-4800-8fc9-167c210ced06 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:19.167911 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-add15b89-a37b-4800-8fc9-167c210ced06 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:19.170110 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-add15b89-a37b-4800-8fc9-167c210ced06 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:19.177821 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-add15b89-a37b-4800-8fc9-167c210ced06 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:19.178235 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-add15b89-a37b-4800-8fc9-167c210ced06 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:19.484544 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-add15b89-a37b-4800-8fc9-167c210ced06 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:19.502076 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-add15b89-a37b-4800-8fc9-167c210ced06 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1314 microversion: 2.1 time: 0.361791 Aug 07 01:29:19.516866 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1749/3849] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:19 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:29:19.578802 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-195bbe54-42e7-4ecc-ba59-e042560db871 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:19.591247 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-195bbe54-42e7-4ecc-ba59-e042560db871 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1508 microversion: 2.1 time: 0.828192 Aug 07 01:29:19.595259 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2101/3850] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:18 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1508 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:19.659090 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5c9e672e-1359-4447-9b33-d339e2e63fc7 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:19.660051 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5c9e672e-1359-4447-9b33-d339e2e63fc7 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: d9c8e298-f10a-4a99-9b30-00d1a0cc12b5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:19.667461 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c9e672e-1359-4447-9b33-d339e2e63fc7 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:19.668763 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c9e672e-1359-4447-9b33-d339e2e63fc7 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:19.674442 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c9e672e-1359-4447-9b33-d339e2e63fc7 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:19.675560 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c9e672e-1359-4447-9b33-d339e2e63fc7 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:19.676242 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c9e672e-1359-4447-9b33-d339e2e63fc7 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:19.676859 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c9e672e-1359-4447-9b33-d339e2e63fc7 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:19.824310 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-43dff326-1bdc-4e74-95b8-4712c88bec93 req-e3ad1f30-2f43-4a1c-a9e0-48b34809d6da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9c8e298-f10a-4a99-9b30-00d1a0cc12b5", "name": "network-vif-unplugged", "status": "completed", "tag": "8cdc75fb-4acd-4c53-a858-7be2c2e39a11"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:19.857099 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-43dff326-1bdc-4e74-95b8-4712c88bec93 req-e3ad1f30-2f43-4a1c-a9e0-48b34809d6da service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:19.857982 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-43dff326-1bdc-4e74-95b8-4712c88bec93 req-e3ad1f30-2f43-4a1c-a9e0-48b34809d6da service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:19.858776 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-43dff326-1bdc-4e74-95b8-4712c88bec93 req-e3ad1f30-2f43-4a1c-a9e0-48b34809d6da service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:19.877940 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:19.906122 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-43dff326-1bdc-4e74-95b8-4712c88bec93 req-e3ad1f30-2f43-4a1c-a9e0-48b34809d6da service nova] Creating event network-vif-unplugged:8cdc75fb-4acd-4c53-a858-7be2c2e39a11 for instance d9c8e298-f10a-4a99-9b30-00d1a0cc12b5 on n-h1-master-1 Aug 07 01:29:19.915645 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-43dff326-1bdc-4e74-95b8-4712c88bec93 req-e3ad1f30-2f43-4a1c-a9e0-48b34809d6da service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099319 Aug 07 01:29:19.917537 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2102/3851] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:29:19.920412 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5c9e672e-1359-4447-9b33-d339e2e63fc7 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a50140f86f00487b90d0503d4819234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7995a68f5a541aabda74c0b01f6aac9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:19.930056 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5c9e672e-1359-4447-9b33-d339e2e63fc7 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5" status: 200 len: 1493 microversion: 2.1 time: 0.275376 Aug 07 01:29:19.930676 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1750/3852] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:19 2022] GET /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5 => generated 1493 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:20.096542 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-77b64f00-9e7a-4af9-a12d-248df1456b4c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:20.098727 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-77b64f00-9e7a-4af9-a12d-248df1456b4c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:20.132947 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77b64f00-9e7a-4af9-a12d-248df1456b4c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:20.136124 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77b64f00-9e7a-4af9-a12d-248df1456b4c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:20.138050 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77b64f00-9e7a-4af9-a12d-248df1456b4c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:20.139856 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77b64f00-9e7a-4af9-a12d-248df1456b4c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:20.156012 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-cd4dd146-6b6b-4a75-b29f-803336d8526d req-1e0c34a5-437b-4549-bf35-b246a4aadbd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9c8e298-f10a-4a99-9b30-00d1a0cc12b5", "name": "network-vif-deleted", "tag": "8cdc75fb-4acd-4c53-a858-7be2c2e39a11"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:20.167339 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77b64f00-9e7a-4af9-a12d-248df1456b4c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:20.171593 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-cd4dd146-6b6b-4a75-b29f-803336d8526d req-1e0c34a5-437b-4549-bf35-b246a4aadbd2 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:20.172139 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-cd4dd146-6b6b-4a75-b29f-803336d8526d req-1e0c34a5-437b-4549-bf35-b246a4aadbd2 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:20.172517 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77b64f00-9e7a-4af9-a12d-248df1456b4c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:20.172722 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-cd4dd146-6b6b-4a75-b29f-803336d8526d req-1e0c34a5-437b-4549-bf35-b246a4aadbd2 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:20.190352 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-cd4dd146-6b6b-4a75-b29f-803336d8526d req-1e0c34a5-437b-4549-bf35-b246a4aadbd2 service nova] Creating event network-vif-deleted:8cdc75fb-4acd-4c53-a858-7be2c2e39a11 for instance d9c8e298-f10a-4a99-9b30-00d1a0cc12b5 on n-h1-master-1 Aug 07 01:29:20.198821 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-cd4dd146-6b6b-4a75-b29f-803336d8526d req-1e0c34a5-437b-4549-bf35-b246a4aadbd2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046247 Aug 07 01:29:20.199798 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1751/3853] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:29:20.428008 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:20.486506 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:20.498531 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-77b64f00-9e7a-4af9-a12d-248df1456b4c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:20.507125 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-77b64f00-9e7a-4af9-a12d-248df1456b4c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1512 microversion: 2.1 time: 0.428992 Aug 07 01:29:20.508644 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2103/3854] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:20 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1512 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:20.540196 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b2ff222a-8845-4f4a-8a71-8acb4348b607 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:20.541165 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b2ff222a-8845-4f4a-8a71-8acb4348b607 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:20.551051 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2ff222a-8845-4f4a-8a71-8acb4348b607 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:20.551051 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2ff222a-8845-4f4a-8a71-8acb4348b607 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:20.551051 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2ff222a-8845-4f4a-8a71-8acb4348b607 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:20.551051 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2ff222a-8845-4f4a-8a71-8acb4348b607 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:20.551602 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2ff222a-8845-4f4a-8a71-8acb4348b607 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:20.551815 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2ff222a-8845-4f4a-8a71-8acb4348b607 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:20.628655 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c2b63386-ab71-4fba-9752-5a63677a2ab7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:20.629588 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c2b63386-ab71-4fba-9752-5a63677a2ab7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:20.632880 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:20.640682 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c2b63386-ab71-4fba-9752-5a63677a2ab7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:20.641613 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c2b63386-ab71-4fba-9752-5a63677a2ab7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:20.642402 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c2b63386-ab71-4fba-9752-5a63677a2ab7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:20.643376 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c2b63386-ab71-4fba-9752-5a63677a2ab7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:20.644382 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c2b63386-ab71-4fba-9752-5a63677a2ab7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:20.645151 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c2b63386-ab71-4fba-9752-5a63677a2ab7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:20.786336 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b2ff222a-8845-4f4a-8a71-8acb4348b607 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:20.805279 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b2ff222a-8845-4f4a-8a71-8acb4348b607 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1314 microversion: 2.1 time: 0.269609 Aug 07 01:29:20.807749 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1752/3855] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:20 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:20.842301 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c2b63386-ab71-4fba-9752-5a63677a2ab7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:20.851698 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c2b63386-ab71-4fba-9752-5a63677a2ab7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1508 microversion: 2.1 time: 0.226842 Aug 07 01:29:20.856022 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2104/3856] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:20 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1508 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:29:20.953802 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7a96f350-6451-41f6-a0e1-d2745ae5a809 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:20.954619 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7a96f350-6451-41f6-a0e1-d2745ae5a809 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: d9c8e298-f10a-4a99-9b30-00d1a0cc12b5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:20.957099 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:20.964918 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a96f350-6451-41f6-a0e1-d2745ae5a809 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:20.965783 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a96f350-6451-41f6-a0e1-d2745ae5a809 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:20.966423 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a96f350-6451-41f6-a0e1-d2745ae5a809 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:20.967582 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a96f350-6451-41f6-a0e1-d2745ae5a809 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:20.968290 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a96f350-6451-41f6-a0e1-d2745ae5a809 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:20.968888 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a96f350-6451-41f6-a0e1-d2745ae5a809 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:21.000383 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-7a96f350-6451-41f6-a0e1-d2745ae5a809 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] HTTP exception thrown: Instance d9c8e298-f10a-4a99-9b30-00d1a0cc12b5 could not be found. Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7a96f350-6451-41f6-a0e1-d2745ae5a809 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Request method failure captured: Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5 HTTP/1.1 Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xR1vVMxdu4c-VeD8WhwnArlAdw4LaGDK4QiCB0iMp9aO9Z3Q0fVt5yTJxs9dkJJOd9I9nBpVN3nv_jIlwb9BZ7oFtDtYDUeZ4cD0pVKYhhtTo9jhTO5r9M3m1LYU02WfuWIlV6V0ob5NCcHreEgUGr8EsrWBVEtbhJAeWkC7O-CPZA Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: b7995a68f5a541aabda74c0b01f6aac9 Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ImagesTestJSON-2146129186 Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b7995a68f5a541aabda74c0b01f6aac9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b7995a68f5a541aabda74c0b01f6aac9", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b7995a68f5a541aabda74c0b01f6aac9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b7995a68f5a541aabda74c0b01f6aac9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ImagesTestJSON-2146129186 Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: b7995a68f5a541aabda74c0b01f6aac9 Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ImagesTestJSON-2146129186 Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ImagesTestJSON-2146129186-project Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: a50140f86f00487b90d0503d4819234f Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ImagesTestJSON-2146129186-project Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: exception: Instance d9c8e298-f10a-4a99-9b30-00d1a0cc12b5 could not be found. Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'd9c8e298-f10a-4a99-9b30-00d1a0cc12b5'} Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9c8e298-f10a-4a99-9b30-00d1a0cc12b5 could not be found. Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9c8e298-f10a-4a99-9b30-00d1a0cc12b5 could not be found. Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.003354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:21.009466 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:21.009466 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:21.009466 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:29:21.009466 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:29:21.009466 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9c8e298-f10a-4a99-9b30-00d1a0cc12b5 could not be found. Aug 07 01:29:21.009466 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.009466 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7a96f350-6451-41f6-a0e1-d2745ae5a809 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Returning 404 to user: Instance d9c8e298-f10a-4a99-9b30-00d1a0cc12b5 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:29:21.009466 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7a96f350-6451-41f6-a0e1-d2745ae5a809 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5" status: 404 len: 111 microversion: 2.1 time: 0.057251 Aug 07 01:29:21.009466 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1753/3857] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:20 2022] GET /compute/v2.1/servers/d9c8e298-f10a-4a99-9b30-00d1a0cc12b5 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:29:21.015120 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c6b3ab3a-0229-4b35-b2b1-5e83e9213246 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e249000d0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:21.041127 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-c6b3ab3a-0229-4b35-b2b1-5e83e9213246 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] HTTP exception thrown: Image not found. Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c6b3ab3a-0229-4b35-b2b1-5e83e9213246 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Request method failure captured: Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453 HTTP/1.1 Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xR1vVMxdu4c-VeD8WhwnArlAdw4LaGDK4QiCB0iMp9aO9Z3Q0fVt5yTJxs9dkJJOd9I9nBpVN3nv_jIlwb9BZ7oFtDtYDUeZ4cD0pVKYhhtTo9jhTO5r9M3m1LYU02WfuWIlV6V0ob5NCcHreEgUGr8EsrWBVEtbhJAeWkC7O-CPZA Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: b7995a68f5a541aabda74c0b01f6aac9 Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ImagesTestJSON-2146129186 Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b7995a68f5a541aabda74c0b01f6aac9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b7995a68f5a541aabda74c0b01f6aac9", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b7995a68f5a541aabda74c0b01f6aac9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b7995a68f5a541aabda74c0b01f6aac9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ImagesTestJSON-2146129186 Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: b7995a68f5a541aabda74c0b01f6aac9 Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ImagesTestJSON-2146129186 Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ImagesTestJSON-2146129186-project Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: a50140f86f00487b90d0503d4819234f Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ImagesTestJSON-2146129186-project Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: exception: Image not found. Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'a3951e33-e584-4ec5-9f42-9e8d028b0453'} Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a3951e33-e584-4ec5-9f42-9e8d028b0453 to delete Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a3951e33-e584-4ec5-9f42-9e8d028b0453 could not be found. Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.044190 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:21.051234 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:21.051234 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:21.051234 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:29:21.051234 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:29:21.051234 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:29:21.051234 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:29:21.051234 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:29:21.051234 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:29:21.051234 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 07 01:29:21.051234 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 07 01:29:21.051234 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 07 01:29:21.051234 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.051234 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:21.051234 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.051234 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:21.051234 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:21.051234 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:21.051234 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:29:21.051234 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:29:21.051234 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 07 01:29:21.051234 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.051234 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c6b3ab3a-0229-4b35-b2b1-5e83e9213246 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Returning 404 to user: Image not found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:29:21.051234 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c6b3ab3a-0229-4b35-b2b1-5e83e9213246 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "DELETE /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453" status: 404 len: 62 microversion: 2.1 time: 0.035729 Aug 07 01:29:21.051234 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2105/3858] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:21 2022] DELETE /compute/v2.1/images/a3951e33-e584-4ec5-9f42-9e8d028b0453 => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:29:21.055079 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e87bc4e4-08ec-4efa-96ab-d19cae49469f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:21.055290 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e87bc4e4-08ec-4efa-96ab-d19cae49469f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: ce6c308a-7eb4-429f-ac41-9be9c4059355] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:21.061953 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e87bc4e4-08ec-4efa-96ab-d19cae49469f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:21.062453 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e87bc4e4-08ec-4efa-96ab-d19cae49469f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:21.062866 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e87bc4e4-08ec-4efa-96ab-d19cae49469f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:21.063568 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e87bc4e4-08ec-4efa-96ab-d19cae49469f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:21.064051 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e87bc4e4-08ec-4efa-96ab-d19cae49469f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:21.064474 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e87bc4e4-08ec-4efa-96ab-d19cae49469f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:21.079165 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-e87bc4e4-08ec-4efa-96ab-d19cae49469f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] HTTP exception thrown: Instance ce6c308a-7eb4-429f-ac41-9be9c4059355 could not be found. Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e87bc4e4-08ec-4efa-96ab-d19cae49469f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Request method failure captured: Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355 HTTP/1.1 Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xR1vVMxdu4c-VeD8WhwnArlAdw4LaGDK4QiCB0iMp9aO9Z3Q0fVt5yTJxs9dkJJOd9I9nBpVN3nv_jIlwb9BZ7oFtDtYDUeZ4cD0pVKYhhtTo9jhTO5r9M3m1LYU02WfuWIlV6V0ob5NCcHreEgUGr8EsrWBVEtbhJAeWkC7O-CPZA Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: b7995a68f5a541aabda74c0b01f6aac9 Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ImagesTestJSON-2146129186 Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b7995a68f5a541aabda74c0b01f6aac9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b7995a68f5a541aabda74c0b01f6aac9", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b7995a68f5a541aabda74c0b01f6aac9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b7995a68f5a541aabda74c0b01f6aac9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ImagesTestJSON-2146129186 Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: b7995a68f5a541aabda74c0b01f6aac9 Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ImagesTestJSON-2146129186 Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ImagesTestJSON-2146129186-project Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: a50140f86f00487b90d0503d4819234f Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ImagesTestJSON-2146129186-project Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: exception: Instance ce6c308a-7eb4-429f-ac41-9be9c4059355 could not be found. Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'ce6c308a-7eb4-429f-ac41-9be9c4059355'} Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce6c308a-7eb4-429f-ac41-9be9c4059355 could not be found. Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:29:21.080787 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce6c308a-7eb4-429f-ac41-9be9c4059355 could not be found. Aug 07 01:29:21.088853 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.088853 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:21.088853 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.088853 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:21.088853 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:21.088853 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:21.088853 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:29:21.088853 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:29:21.088853 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce6c308a-7eb4-429f-ac41-9be9c4059355 could not be found. Aug 07 01:29:21.088853 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.088853 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e87bc4e4-08ec-4efa-96ab-d19cae49469f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Returning 404 to user: Instance ce6c308a-7eb4-429f-ac41-9be9c4059355 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:29:21.088853 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e87bc4e4-08ec-4efa-96ab-d19cae49469f tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355" status: 404 len: 111 microversion: 2.1 time: 0.031553 Aug 07 01:29:21.088853 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1754/3859] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:29:21 2022] DELETE /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:29:21.091041 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e150295f-1bd0-466e-bae8-3e9fd16150c5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:21.091675 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e150295f-1bd0-466e-bae8-3e9fd16150c5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: ce6c308a-7eb4-429f-ac41-9be9c4059355] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:21.105331 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e150295f-1bd0-466e-bae8-3e9fd16150c5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:21.105825 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e150295f-1bd0-466e-bae8-3e9fd16150c5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:21.106263 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e150295f-1bd0-466e-bae8-3e9fd16150c5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:21.106972 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e150295f-1bd0-466e-bae8-3e9fd16150c5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:21.107426 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e150295f-1bd0-466e-bae8-3e9fd16150c5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:21.107856 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e150295f-1bd0-466e-bae8-3e9fd16150c5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:21.126316 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-e150295f-1bd0-466e-bae8-3e9fd16150c5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] HTTP exception thrown: Instance ce6c308a-7eb4-429f-ac41-9be9c4059355 could not be found. Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e150295f-1bd0-466e-bae8-3e9fd16150c5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Request method failure captured: Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355 HTTP/1.1 Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xR1vVMxdu4c-VeD8WhwnArlAdw4LaGDK4QiCB0iMp9aO9Z3Q0fVt5yTJxs9dkJJOd9I9nBpVN3nv_jIlwb9BZ7oFtDtYDUeZ4cD0pVKYhhtTo9jhTO5r9M3m1LYU02WfuWIlV6V0ob5NCcHreEgUGr8EsrWBVEtbhJAeWkC7O-CPZA Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: b7995a68f5a541aabda74c0b01f6aac9 Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ImagesTestJSON-2146129186 Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b7995a68f5a541aabda74c0b01f6aac9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b7995a68f5a541aabda74c0b01f6aac9", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b7995a68f5a541aabda74c0b01f6aac9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b7995a68f5a541aabda74c0b01f6aac9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ImagesTestJSON-2146129186 Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: b7995a68f5a541aabda74c0b01f6aac9 Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ImagesTestJSON-2146129186 Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ImagesTestJSON-2146129186-project Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: a50140f86f00487b90d0503d4819234f Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ImagesTestJSON-2146129186-project Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: exception: Instance ce6c308a-7eb4-429f-ac41-9be9c4059355 could not be found. Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'ce6c308a-7eb4-429f-ac41-9be9c4059355'} Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce6c308a-7eb4-429f-ac41-9be9c4059355 could not be found. Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce6c308a-7eb4-429f-ac41-9be9c4059355 could not be found. Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.127914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:21.136241 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:21.136241 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:21.136241 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:29:21.136241 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:29:21.136241 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce6c308a-7eb4-429f-ac41-9be9c4059355 could not be found. Aug 07 01:29:21.136241 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.136241 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e150295f-1bd0-466e-bae8-3e9fd16150c5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Returning 404 to user: Instance ce6c308a-7eb4-429f-ac41-9be9c4059355 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:29:21.136241 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e150295f-1bd0-466e-bae8-3e9fd16150c5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355" status: 404 len: 111 microversion: 2.1 time: 0.042308 Aug 07 01:29:21.136241 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2106/3860] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:21 2022] GET /compute/v2.1/servers/ce6c308a-7eb4-429f-ac41-9be9c4059355 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:29:21.138168 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6ff5efa3-2c6b-40d7-84e1-7cab1a2930a3 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e240508b0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:21.161446 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-6ff5efa3-2c6b-40d7-84e1-7cab1a2930a3 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] HTTP exception thrown: Image not found. Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6ff5efa3-2c6b-40d7-84e1-7cab1a2930a3 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Request method failure captured: Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/images/f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6 HTTP/1.1 Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xR1vVMxdu4c-VeD8WhwnArlAdw4LaGDK4QiCB0iMp9aO9Z3Q0fVt5yTJxs9dkJJOd9I9nBpVN3nv_jIlwb9BZ7oFtDtYDUeZ4cD0pVKYhhtTo9jhTO5r9M3m1LYU02WfuWIlV6V0ob5NCcHreEgUGr8EsrWBVEtbhJAeWkC7O-CPZA Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: b7995a68f5a541aabda74c0b01f6aac9 Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ImagesTestJSON-2146129186 Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b7995a68f5a541aabda74c0b01f6aac9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b7995a68f5a541aabda74c0b01f6aac9", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b7995a68f5a541aabda74c0b01f6aac9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b7995a68f5a541aabda74c0b01f6aac9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ImagesTestJSON-2146129186 Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: b7995a68f5a541aabda74c0b01f6aac9 Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ImagesTestJSON-2146129186 Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ImagesTestJSON-2146129186-project Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: a50140f86f00487b90d0503d4819234f Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ImagesTestJSON-2146129186-project Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: exception: Image not found. Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6'} Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6 to delete Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6 could not be found. Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.163363 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:21.170672 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:21.170672 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:21.170672 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:29:21.170672 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:29:21.170672 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:29:21.170672 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:29:21.170672 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:29:21.170672 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:29:21.170672 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 07 01:29:21.170672 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 07 01:29:21.170672 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 07 01:29:21.170672 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.170672 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:21.170672 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.170672 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:21.170672 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:21.170672 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:21.170672 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:29:21.170672 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:29:21.170672 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 07 01:29:21.170672 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.170672 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6ff5efa3-2c6b-40d7-84e1-7cab1a2930a3 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Returning 404 to user: Image not found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:29:21.170672 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6ff5efa3-2c6b-40d7-84e1-7cab1a2930a3 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "DELETE /compute/v2.1/images/f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6" status: 404 len: 62 microversion: 2.1 time: 0.030688 Aug 07 01:29:21.170672 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1755/3861] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:21 2022] DELETE /compute/v2.1/images/f1fcae1c-32a7-4bcb-98a8-3b17559cd0f6 => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 07 01:29:21.177007 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f3be93c5-9c1f-48dd-8a4c-d80c62e69ad5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:21.177857 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f3be93c5-9c1f-48dd-8a4c-d80c62e69ad5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: f5432da5-94bc-4358-bca6-b025d2bc3186] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:21.188416 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f3be93c5-9c1f-48dd-8a4c-d80c62e69ad5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:21.188914 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f3be93c5-9c1f-48dd-8a4c-d80c62e69ad5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:21.189355 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f3be93c5-9c1f-48dd-8a4c-d80c62e69ad5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:21.190088 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f3be93c5-9c1f-48dd-8a4c-d80c62e69ad5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:21.190552 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f3be93c5-9c1f-48dd-8a4c-d80c62e69ad5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:21.191059 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f3be93c5-9c1f-48dd-8a4c-d80c62e69ad5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:21.206590 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-f3be93c5-9c1f-48dd-8a4c-d80c62e69ad5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] HTTP exception thrown: Instance f5432da5-94bc-4358-bca6-b025d2bc3186 could not be found. Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f3be93c5-9c1f-48dd-8a4c-d80c62e69ad5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Request method failure captured: Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186 HTTP/1.1 Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xR1vVMxdu4c-VeD8WhwnArlAdw4LaGDK4QiCB0iMp9aO9Z3Q0fVt5yTJxs9dkJJOd9I9nBpVN3nv_jIlwb9BZ7oFtDtYDUeZ4cD0pVKYhhtTo9jhTO5r9M3m1LYU02WfuWIlV6V0ob5NCcHreEgUGr8EsrWBVEtbhJAeWkC7O-CPZA Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: b7995a68f5a541aabda74c0b01f6aac9 Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ImagesTestJSON-2146129186 Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b7995a68f5a541aabda74c0b01f6aac9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b7995a68f5a541aabda74c0b01f6aac9", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b7995a68f5a541aabda74c0b01f6aac9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b7995a68f5a541aabda74c0b01f6aac9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ImagesTestJSON-2146129186 Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: b7995a68f5a541aabda74c0b01f6aac9 Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ImagesTestJSON-2146129186 Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ImagesTestJSON-2146129186-project Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: a50140f86f00487b90d0503d4819234f Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ImagesTestJSON-2146129186-project Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: exception: Instance f5432da5-94bc-4358-bca6-b025d2bc3186 could not be found. Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'f5432da5-94bc-4358-bca6-b025d2bc3186'} Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5432da5-94bc-4358-bca6-b025d2bc3186 could not be found. Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:29:21.208268 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5432da5-94bc-4358-bca6-b025d2bc3186 could not be found. Aug 07 01:29:21.213927 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.213927 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:21.213927 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.213927 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:21.213927 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:21.213927 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:21.213927 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:29:21.213927 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:29:21.213927 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5432da5-94bc-4358-bca6-b025d2bc3186 could not be found. Aug 07 01:29:21.213927 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.213927 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f3be93c5-9c1f-48dd-8a4c-d80c62e69ad5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Returning 404 to user: Instance f5432da5-94bc-4358-bca6-b025d2bc3186 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:29:21.213927 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f3be93c5-9c1f-48dd-8a4c-d80c62e69ad5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186" status: 404 len: 111 microversion: 2.1 time: 0.037830 Aug 07 01:29:21.213927 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2107/3862] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:29:21 2022] DELETE /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:29:21.219656 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-36fcb1c6-95fb-4b97-aacf-665257cff108 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:21.220358 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-36fcb1c6-95fb-4b97-aacf-665257cff108 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: f5432da5-94bc-4358-bca6-b025d2bc3186] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:21.229497 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36fcb1c6-95fb-4b97-aacf-665257cff108 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:21.230107 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36fcb1c6-95fb-4b97-aacf-665257cff108 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:21.230752 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36fcb1c6-95fb-4b97-aacf-665257cff108 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:21.232219 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36fcb1c6-95fb-4b97-aacf-665257cff108 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:21.232754 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36fcb1c6-95fb-4b97-aacf-665257cff108 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:21.233225 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36fcb1c6-95fb-4b97-aacf-665257cff108 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:21.249321 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-36fcb1c6-95fb-4b97-aacf-665257cff108 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] HTTP exception thrown: Instance f5432da5-94bc-4358-bca6-b025d2bc3186 could not be found. Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-36fcb1c6-95fb-4b97-aacf-665257cff108 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Request method failure captured: Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186 HTTP/1.1 Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xR1vVMxdu4c-VeD8WhwnArlAdw4LaGDK4QiCB0iMp9aO9Z3Q0fVt5yTJxs9dkJJOd9I9nBpVN3nv_jIlwb9BZ7oFtDtYDUeZ4cD0pVKYhhtTo9jhTO5r9M3m1LYU02WfuWIlV6V0ob5NCcHreEgUGr8EsrWBVEtbhJAeWkC7O-CPZA Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: b7995a68f5a541aabda74c0b01f6aac9 Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ImagesTestJSON-2146129186 Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b7995a68f5a541aabda74c0b01f6aac9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b7995a68f5a541aabda74c0b01f6aac9", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b7995a68f5a541aabda74c0b01f6aac9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b7995a68f5a541aabda74c0b01f6aac9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ImagesTestJSON-2146129186 Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: b7995a68f5a541aabda74c0b01f6aac9 Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ImagesTestJSON-2146129186 Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ImagesTestJSON-2146129186-project Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: a50140f86f00487b90d0503d4819234f Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ImagesTestJSON-2146129186-project Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: exception: Instance f5432da5-94bc-4358-bca6-b025d2bc3186 could not be found. Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'f5432da5-94bc-4358-bca6-b025d2bc3186'} Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5432da5-94bc-4358-bca6-b025d2bc3186 could not be found. Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5432da5-94bc-4358-bca6-b025d2bc3186 could not be found. Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.250969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:21.256085 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:21.256085 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:21.256085 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:29:21.256085 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:29:21.256085 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5432da5-94bc-4358-bca6-b025d2bc3186 could not be found. Aug 07 01:29:21.256085 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.256085 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-36fcb1c6-95fb-4b97-aacf-665257cff108 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Returning 404 to user: Instance f5432da5-94bc-4358-bca6-b025d2bc3186 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:29:21.256085 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-36fcb1c6-95fb-4b97-aacf-665257cff108 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186" status: 404 len: 111 microversion: 2.1 time: 0.036970 Aug 07 01:29:21.256085 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1756/3863] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:21 2022] GET /compute/v2.1/servers/f5432da5-94bc-4358-bca6-b025d2bc3186 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:29:21.262224 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7458377b-fe9b-4f1e-8a79-8b0218be0622 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '.version_select at 0x7f9e298ed3a0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:21.285628 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-7458377b-fe9b-4f1e-8a79-8b0218be0622 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] HTTP exception thrown: Image not found. Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7458377b-fe9b-4f1e-8a79-8b0218be0622 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Request method failure captured: Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/images/63e76497-a620-45de-87be-0d947bdbb9a7 HTTP/1.1 Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xR1vVMxdu4c-VeD8WhwnArlAdw4LaGDK4QiCB0iMp9aO9Z3Q0fVt5yTJxs9dkJJOd9I9nBpVN3nv_jIlwb9BZ7oFtDtYDUeZ4cD0pVKYhhtTo9jhTO5r9M3m1LYU02WfuWIlV6V0ob5NCcHreEgUGr8EsrWBVEtbhJAeWkC7O-CPZA Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: b7995a68f5a541aabda74c0b01f6aac9 Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ImagesTestJSON-2146129186 Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b7995a68f5a541aabda74c0b01f6aac9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b7995a68f5a541aabda74c0b01f6aac9", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b7995a68f5a541aabda74c0b01f6aac9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b7995a68f5a541aabda74c0b01f6aac9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ImagesTestJSON-2146129186 Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: b7995a68f5a541aabda74c0b01f6aac9 Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ImagesTestJSON-2146129186 Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ImagesTestJSON-2146129186-project Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: a50140f86f00487b90d0503d4819234f Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ImagesTestJSON-2146129186-project Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: exception: Image not found. Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '63e76497-a620-45de-87be-0d947bdbb9a7'} Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 63e76497-a620-45de-87be-0d947bdbb9a7 to delete Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 63e76497-a620-45de-87be-0d947bdbb9a7 could not be found. Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.287594 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:21.294237 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:21.294237 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:21.294237 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:29:21.294237 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:29:21.294237 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:29:21.294237 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:29:21.294237 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:29:21.294237 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:29:21.294237 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 07 01:29:21.294237 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 07 01:29:21.294237 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 07 01:29:21.294237 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.294237 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:21.294237 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.294237 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:21.294237 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:21.294237 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:21.294237 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:29:21.294237 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:29:21.294237 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 07 01:29:21.294237 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.294237 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7458377b-fe9b-4f1e-8a79-8b0218be0622 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Returning 404 to user: Image not found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:29:21.294237 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7458377b-fe9b-4f1e-8a79-8b0218be0622 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "DELETE /compute/v2.1/images/63e76497-a620-45de-87be-0d947bdbb9a7" status: 404 len: 62 microversion: 2.1 time: 0.031193 Aug 07 01:29:21.294237 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2108/3864] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:21 2022] DELETE /compute/v2.1/images/63e76497-a620-45de-87be-0d947bdbb9a7 => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:29:21.301612 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0b554e29-c6b1-4273-a440-043e38f601b5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:21.302112 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0b554e29-c6b1-4273-a440-043e38f601b5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: 77f80d2b-d1d8-4ea9-9637-f43100b95523] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:21.309445 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b554e29-c6b1-4273-a440-043e38f601b5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:21.309756 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b554e29-c6b1-4273-a440-043e38f601b5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:21.310224 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b554e29-c6b1-4273-a440-043e38f601b5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:21.310914 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b554e29-c6b1-4273-a440-043e38f601b5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:21.311373 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b554e29-c6b1-4273-a440-043e38f601b5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:21.311800 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b554e29-c6b1-4273-a440-043e38f601b5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:21.316873 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:21.328637 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-0b554e29-c6b1-4273-a440-043e38f601b5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] HTTP exception thrown: Instance 77f80d2b-d1d8-4ea9-9637-f43100b95523 could not be found. Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0b554e29-c6b1-4273-a440-043e38f601b5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Request method failure captured: Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523 HTTP/1.1 Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xR1vVMxdu4c-VeD8WhwnArlAdw4LaGDK4QiCB0iMp9aO9Z3Q0fVt5yTJxs9dkJJOd9I9nBpVN3nv_jIlwb9BZ7oFtDtYDUeZ4cD0pVKYhhtTo9jhTO5r9M3m1LYU02WfuWIlV6V0ob5NCcHreEgUGr8EsrWBVEtbhJAeWkC7O-CPZA Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: b7995a68f5a541aabda74c0b01f6aac9 Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ImagesTestJSON-2146129186 Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b7995a68f5a541aabda74c0b01f6aac9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b7995a68f5a541aabda74c0b01f6aac9", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b7995a68f5a541aabda74c0b01f6aac9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b7995a68f5a541aabda74c0b01f6aac9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ImagesTestJSON-2146129186 Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: b7995a68f5a541aabda74c0b01f6aac9 Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ImagesTestJSON-2146129186 Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ImagesTestJSON-2146129186-project Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: a50140f86f00487b90d0503d4819234f Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ImagesTestJSON-2146129186-project Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 77f80d2b-d1d8-4ea9-9637-f43100b95523 could not be found. Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '77f80d2b-d1d8-4ea9-9637-f43100b95523'} Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77f80d2b-d1d8-4ea9-9637-f43100b95523 could not be found. Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:29:21.330482 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77f80d2b-d1d8-4ea9-9637-f43100b95523 could not be found. Aug 07 01:29:21.335611 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.335611 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:21.335611 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.335611 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:21.335611 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:21.335611 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:21.335611 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:29:21.335611 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:29:21.335611 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77f80d2b-d1d8-4ea9-9637-f43100b95523 could not be found. Aug 07 01:29:21.335611 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.335611 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0b554e29-c6b1-4273-a440-043e38f601b5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Returning 404 to user: Instance 77f80d2b-d1d8-4ea9-9637-f43100b95523 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:29:21.335611 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0b554e29-c6b1-4273-a440-043e38f601b5 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "DELETE /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523" status: 404 len: 111 microversion: 2.1 time: 0.034259 Aug 07 01:29:21.335611 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1757/3865] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:29:21 2022] DELETE /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:29:21.342065 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f6c9f617-43ab-4c3c-b380-ad20036cde31 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:21.342654 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f6c9f617-43ab-4c3c-b380-ad20036cde31 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] [instance: 77f80d2b-d1d8-4ea9-9637-f43100b95523] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:21.350520 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f6c9f617-43ab-4c3c-b380-ad20036cde31 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:21.351201 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f6c9f617-43ab-4c3c-b380-ad20036cde31 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:21.351720 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f6c9f617-43ab-4c3c-b380-ad20036cde31 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:21.352480 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f6c9f617-43ab-4c3c-b380-ad20036cde31 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:21.352944 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f6c9f617-43ab-4c3c-b380-ad20036cde31 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:21.353380 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f6c9f617-43ab-4c3c-b380-ad20036cde31 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:21.372614 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-f6c9f617-43ab-4c3c-b380-ad20036cde31 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] HTTP exception thrown: Instance 77f80d2b-d1d8-4ea9-9637-f43100b95523 could not be found. Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f6c9f617-43ab-4c3c-b380-ad20036cde31 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Request method failure captured: Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523 HTTP/1.1 Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xR1vVMxdu4c-VeD8WhwnArlAdw4LaGDK4QiCB0iMp9aO9Z3Q0fVt5yTJxs9dkJJOd9I9nBpVN3nv_jIlwb9BZ7oFtDtYDUeZ4cD0pVKYhhtTo9jhTO5r9M3m1LYU02WfuWIlV6V0ob5NCcHreEgUGr8EsrWBVEtbhJAeWkC7O-CPZA Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: b7995a68f5a541aabda74c0b01f6aac9 Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ImagesTestJSON-2146129186 Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b7995a68f5a541aabda74c0b01f6aac9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b7995a68f5a541aabda74c0b01f6aac9", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b7995a68f5a541aabda74c0b01f6aac9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b7995a68f5a541aabda74c0b01f6aac9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ImagesTestJSON-2146129186 Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: b7995a68f5a541aabda74c0b01f6aac9 Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ImagesTestJSON-2146129186 Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ImagesTestJSON-2146129186-project Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: a50140f86f00487b90d0503d4819234f Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ImagesTestJSON-2146129186-project Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 77f80d2b-d1d8-4ea9-9637-f43100b95523 could not be found. Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '77f80d2b-d1d8-4ea9-9637-f43100b95523'} Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77f80d2b-d1d8-4ea9-9637-f43100b95523 could not be found. Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77f80d2b-d1d8-4ea9-9637-f43100b95523 could not be found. Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.374193 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:21.379693 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:21.379693 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:21.379693 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:29:21.379693 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:29:21.379693 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77f80d2b-d1d8-4ea9-9637-f43100b95523 could not be found. Aug 07 01:29:21.379693 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:21.379693 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f6c9f617-43ab-4c3c-b380-ad20036cde31 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] Returning 404 to user: Instance 77f80d2b-d1d8-4ea9-9637-f43100b95523 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:29:21.379693 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f6c9f617-43ab-4c3c-b380-ad20036cde31 tempest-ImagesTestJSON-2146129186 tempest-ImagesTestJSON-2146129186-project] 10.222.0.39 "GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523" status: 404 len: 111 microversion: 2.1 time: 0.037710 Aug 07 01:29:21.379693 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2109/3866] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:21 2022] GET /compute/v2.1/servers/77f80d2b-d1d8-4ea9-9637-f43100b95523 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:29:21.532853 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5aa19d24-de90-4d7a-8ecc-b263b6d90b96 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:21.533472 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5aa19d24-de90-4d7a-8ecc-b263b6d90b96 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:21.545497 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5aa19d24-de90-4d7a-8ecc-b263b6d90b96 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:21.545497 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5aa19d24-de90-4d7a-8ecc-b263b6d90b96 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:21.546041 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5aa19d24-de90-4d7a-8ecc-b263b6d90b96 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:21.546895 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5aa19d24-de90-4d7a-8ecc-b263b6d90b96 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:21.547473 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5aa19d24-de90-4d7a-8ecc-b263b6d90b96 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:21.548066 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5aa19d24-de90-4d7a-8ecc-b263b6d90b96 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:21.835499 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fa33fd2d-ed4c-4925-8448-382441df9b05 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:21.839774 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fa33fd2d-ed4c-4925-8448-382441df9b05 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:21.857261 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa33fd2d-ed4c-4925-8448-382441df9b05 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:21.858146 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa33fd2d-ed4c-4925-8448-382441df9b05 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:21.861232 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa33fd2d-ed4c-4925-8448-382441df9b05 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:21.862504 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa33fd2d-ed4c-4925-8448-382441df9b05 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:21.863184 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa33fd2d-ed4c-4925-8448-382441df9b05 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:21.864846 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa33fd2d-ed4c-4925-8448-382441df9b05 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:21.890966 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5aa19d24-de90-4d7a-8ecc-b263b6d90b96 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:21.904919 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5aa19d24-de90-4d7a-8ecc-b263b6d90b96 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1512 microversion: 2.1 time: 0.376472 Aug 07 01:29:21.905810 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1758/3867] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:21 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1512 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:21.910827 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f71dea66-e20c-4269-a8fd-80d54403baf9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:21.924943 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f71dea66-e20c-4269-a8fd-80d54403baf9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:21.934697 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f71dea66-e20c-4269-a8fd-80d54403baf9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:21.935229 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f71dea66-e20c-4269-a8fd-80d54403baf9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:21.935690 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f71dea66-e20c-4269-a8fd-80d54403baf9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:21.936482 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f71dea66-e20c-4269-a8fd-80d54403baf9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:21.936955 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f71dea66-e20c-4269-a8fd-80d54403baf9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:21.937551 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f71dea66-e20c-4269-a8fd-80d54403baf9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:22.141462 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fa33fd2d-ed4c-4925-8448-382441df9b05 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:22.150333 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fa33fd2d-ed4c-4925-8448-382441df9b05 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1314 microversion: 2.1 time: 0.321259 Aug 07 01:29:22.154930 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2110/3868] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:21 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:29:22.189215 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f71dea66-e20c-4269-a8fd-80d54403baf9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:22.197998 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f71dea66-e20c-4269-a8fd-80d54403baf9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1508 microversion: 2.1 time: 0.290782 Aug 07 01:29:22.201537 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1759/3869] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:21 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1508 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:22.374935 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-000b2b5f-eaa8-4e6a-aa2e-32acbc3a984e req-6e28615b-67a1-4acb-a12c-ae1fbd731366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c50292-4191-4cb3-955b-757ad1575a17", "name": "network-vif-plugged", "status": "completed", "tag": "c76a6bcd-5ca4-451e-a693-b5ee6ea2941a"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:22.409819 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-000b2b5f-eaa8-4e6a-aa2e-32acbc3a984e req-6e28615b-67a1-4acb-a12c-ae1fbd731366 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:22.410613 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-000b2b5f-eaa8-4e6a-aa2e-32acbc3a984e req-6e28615b-67a1-4acb-a12c-ae1fbd731366 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:22.411222 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-000b2b5f-eaa8-4e6a-aa2e-32acbc3a984e req-6e28615b-67a1-4acb-a12c-ae1fbd731366 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:22.430673 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-000b2b5f-eaa8-4e6a-aa2e-32acbc3a984e req-6e28615b-67a1-4acb-a12c-ae1fbd731366 service nova] Creating event network-vif-plugged:c76a6bcd-5ca4-451e-a693-b5ee6ea2941a for instance 70c50292-4191-4cb3-955b-757ad1575a17 on n-h2-master-1 Aug 07 01:29:22.440867 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-000b2b5f-eaa8-4e6a-aa2e-32acbc3a984e req-6e28615b-67a1-4acb-a12c-ae1fbd731366 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070011 Aug 07 01:29:22.444290 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2111/3870] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:29:22.927462 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ee768c62-b202-4dbe-8b18-36bc52f4fca3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:22.928919 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ee768c62-b202-4dbe-8b18-36bc52f4fca3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:22.937856 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee768c62-b202-4dbe-8b18-36bc52f4fca3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:22.938760 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee768c62-b202-4dbe-8b18-36bc52f4fca3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:22.939408 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee768c62-b202-4dbe-8b18-36bc52f4fca3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:22.940920 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee768c62-b202-4dbe-8b18-36bc52f4fca3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:22.941734 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee768c62-b202-4dbe-8b18-36bc52f4fca3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:22.942388 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee768c62-b202-4dbe-8b18-36bc52f4fca3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:23.181699 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0f046c23-4111-4acf-a34a-d97ca6e31cfe tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:23.183209 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0f046c23-4111-4acf-a34a-d97ca6e31cfe tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:23.196939 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f046c23-4111-4acf-a34a-d97ca6e31cfe tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:23.198701 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f046c23-4111-4acf-a34a-d97ca6e31cfe tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:23.199568 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f046c23-4111-4acf-a34a-d97ca6e31cfe tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:23.201251 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f046c23-4111-4acf-a34a-d97ca6e31cfe tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:23.202149 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f046c23-4111-4acf-a34a-d97ca6e31cfe tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:23.203058 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f046c23-4111-4acf-a34a-d97ca6e31cfe tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:23.309984 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ee768c62-b202-4dbe-8b18-36bc52f4fca3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:23.333682 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ee768c62-b202-4dbe-8b18-36bc52f4fca3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1512 microversion: 2.1 time: 0.410513 Aug 07 01:29:23.334847 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1760/3871] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:22 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1512 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:23.340957 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6a16de26-e461-4dfd-b4ea-ee413e6c5e58 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:23.341849 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6a16de26-e461-4dfd-b4ea-ee413e6c5e58 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:23.349357 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a16de26-e461-4dfd-b4ea-ee413e6c5e58 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:23.350201 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a16de26-e461-4dfd-b4ea-ee413e6c5e58 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:23.350828 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a16de26-e461-4dfd-b4ea-ee413e6c5e58 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:23.351963 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a16de26-e461-4dfd-b4ea-ee413e6c5e58 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:23.354717 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a16de26-e461-4dfd-b4ea-ee413e6c5e58 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:23.356069 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a16de26-e461-4dfd-b4ea-ee413e6c5e58 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:23.472299 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0f046c23-4111-4acf-a34a-d97ca6e31cfe tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:23.485355 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0f046c23-4111-4acf-a34a-d97ca6e31cfe tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1314 microversion: 2.1 time: 0.308525 Aug 07 01:29:23.487389 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2112/3872] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:23 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:23.662490 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6a16de26-e461-4dfd-b4ea-ee413e6c5e58 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:23.671776 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6a16de26-e461-4dfd-b4ea-ee413e6c5e58 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1508 microversion: 2.1 time: 0.335079 Aug 07 01:29:23.673262 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1761/3873] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:23 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1508 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:24.369847 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-89381aa5-c042-4b5b-b032-b6650d95323a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:24.372120 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-89381aa5-c042-4b5b-b032-b6650d95323a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:24.380233 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-89381aa5-c042-4b5b-b032-b6650d95323a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:24.380862 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-89381aa5-c042-4b5b-b032-b6650d95323a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:24.381838 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-89381aa5-c042-4b5b-b032-b6650d95323a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:24.382618 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-89381aa5-c042-4b5b-b032-b6650d95323a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:24.383078 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-89381aa5-c042-4b5b-b032-b6650d95323a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:24.383502 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-89381aa5-c042-4b5b-b032-b6650d95323a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:24.508749 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-06174f7a-6012-4ac0-a9c1-db8b2dd9f57f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:24.512823 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-06174f7a-6012-4ac0-a9c1-db8b2dd9f57f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:24.528112 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06174f7a-6012-4ac0-a9c1-db8b2dd9f57f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:24.529103 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06174f7a-6012-4ac0-a9c1-db8b2dd9f57f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:24.529840 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06174f7a-6012-4ac0-a9c1-db8b2dd9f57f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:24.530970 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06174f7a-6012-4ac0-a9c1-db8b2dd9f57f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:24.532018 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06174f7a-6012-4ac0-a9c1-db8b2dd9f57f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:24.533651 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06174f7a-6012-4ac0-a9c1-db8b2dd9f57f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:24.621796 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-89381aa5-c042-4b5b-b032-b6650d95323a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:24.630058 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-89381aa5-c042-4b5b-b032-b6650d95323a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1512 microversion: 2.1 time: 0.265285 Aug 07 01:29:24.631310 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2113/3874] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:24 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1512 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:24.637411 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-eff53d4e-0151-4ff9-bae6-4c5a56d62c08 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:24.638508 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-eff53d4e-0151-4ff9-bae6-4c5a56d62c08 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:24.646719 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eff53d4e-0151-4ff9-bae6-4c5a56d62c08 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:24.647320 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eff53d4e-0151-4ff9-bae6-4c5a56d62c08 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:24.647865 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eff53d4e-0151-4ff9-bae6-4c5a56d62c08 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:24.648709 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eff53d4e-0151-4ff9-bae6-4c5a56d62c08 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:24.649273 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eff53d4e-0151-4ff9-bae6-4c5a56d62c08 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:24.649819 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eff53d4e-0151-4ff9-bae6-4c5a56d62c08 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:24.762487 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-06174f7a-6012-4ac0-a9c1-db8b2dd9f57f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:24.772371 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-06174f7a-6012-4ac0-a9c1-db8b2dd9f57f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:24.774107 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-06174f7a-6012-4ac0-a9c1-db8b2dd9f57f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:24.775406 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-06174f7a-6012-4ac0-a9c1-db8b2dd9f57f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 2950 microversion: 2.42 time: 0.273848 Aug 07 01:29:24.776101 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1762/3875] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:29:24 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 2950 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:29:24.802223 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e7f000d1-d287-4967-8235-8db4eb8fccbf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:24.802961 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e7f000d1-d287-4967-8235-8db4eb8fccbf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:24.810049 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7f000d1-d287-4967-8235-8db4eb8fccbf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:24.810547 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7f000d1-d287-4967-8235-8db4eb8fccbf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:24.810993 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7f000d1-d287-4967-8235-8db4eb8fccbf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:24.812423 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7f000d1-d287-4967-8235-8db4eb8fccbf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:24.812889 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7f000d1-d287-4967-8235-8db4eb8fccbf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:24.813319 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7f000d1-d287-4967-8235-8db4eb8fccbf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:24.910041 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-eff53d4e-0151-4ff9-bae6-4c5a56d62c08 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:24.921083 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-eff53d4e-0151-4ff9-bae6-4c5a56d62c08 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1500 microversion: 2.1 time: 0.288354 Aug 07 01:29:24.922199 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2114/3876] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:24 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1500 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:24.948594 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ee728418-d101-445a-a2e9-55dc91240cb6 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:24.949191 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ee728418-d101-445a-a2e9-55dc91240cb6 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:24.956431 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee728418-d101-445a-a2e9-55dc91240cb6 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:24.957198 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee728418-d101-445a-a2e9-55dc91240cb6 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:24.957691 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee728418-d101-445a-a2e9-55dc91240cb6 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:24.958421 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee728418-d101-445a-a2e9-55dc91240cb6 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:24.959094 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee728418-d101-445a-a2e9-55dc91240cb6 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:24.959579 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee728418-d101-445a-a2e9-55dc91240cb6 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:24.980635 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e7f000d1-d287-4967-8235-8db4eb8fccbf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:24.989241 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e7f000d1-d287-4967-8235-8db4eb8fccbf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1508 microversion: 2.1 time: 0.196815 Aug 07 01:29:24.990841 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1763/3877] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:24 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1508 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:25.004006 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-de47ff93-054e-4752-a606-a3246ad2818b tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:25.008051 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-de47ff93-054e-4752-a606-a3246ad2818b tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:25.016761 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-de47ff93-054e-4752-a606-a3246ad2818b tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:25.017711 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-de47ff93-054e-4752-a606-a3246ad2818b tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:25.018338 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-de47ff93-054e-4752-a606-a3246ad2818b tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:25.019434 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-de47ff93-054e-4752-a606-a3246ad2818b tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:25.020102 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-de47ff93-054e-4752-a606-a3246ad2818b tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:25.023136 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-de47ff93-054e-4752-a606-a3246ad2818b tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:25.048668 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-de47ff93-054e-4752-a606-a3246ad2818b tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lazy-loading 'flavor' on Instance uuid 70c50292-4191-4cb3-955b-757ad1575a17 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:29:25.145421 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-de47ff93-054e-4752-a606-a3246ad2818b tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "POST /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17/action" status: 200 len: 32 microversion: 2.1 time: 0.152298 Aug 07 01:29:25.146422 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1764/3878] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:29:24 2022] POST /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17/action => generated 32 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:29:25.154195 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ee728418-d101-445a-a2e9-55dc91240cb6 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.218297 Aug 07 01:29:25.154834 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2115/3879] 10.222.0.39 () {60 vars in 1316 bytes} [Sun Aug 7 01:29:24 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15/os-interface => generated 1832 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:29:25.159652 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a70fe86d-4f49-4f31-a1a9-dcf8267bd8d9 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:25.161299 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a70fe86d-4f49-4f31-a1a9-dcf8267bd8d9 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:25.169274 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a70fe86d-4f49-4f31-a1a9-dcf8267bd8d9 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:25.170055 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a70fe86d-4f49-4f31-a1a9-dcf8267bd8d9 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:25.170667 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a70fe86d-4f49-4f31-a1a9-dcf8267bd8d9 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:25.171614 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a70fe86d-4f49-4f31-a1a9-dcf8267bd8d9 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:25.172146 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a70fe86d-4f49-4f31-a1a9-dcf8267bd8d9 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:25.172829 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a70fe86d-4f49-4f31-a1a9-dcf8267bd8d9 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:25.650598 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a70fe86d-4f49-4f31-a1a9-dcf8267bd8d9 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:25.661183 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ab59e595-03ee-4a48-8fe2-c92d113d0ce4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:25.662335 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ab59e595-03ee-4a48-8fe2-c92d113d0ce4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:25.669606 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a70fe86d-4f49-4f31-a1a9-dcf8267bd8d9 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1506 microversion: 2.1 time: 0.514541 Aug 07 01:29:25.676897 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ab59e595-03ee-4a48-8fe2-c92d113d0ce4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:25.678748 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ab59e595-03ee-4a48-8fe2-c92d113d0ce4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:25.680033 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ab59e595-03ee-4a48-8fe2-c92d113d0ce4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:25.681096 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ab59e595-03ee-4a48-8fe2-c92d113d0ce4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:25.689832 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1765/3880] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:25 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1506 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:29:25.708272 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ab59e595-03ee-4a48-8fe2-c92d113d0ce4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:25.709938 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ab59e595-03ee-4a48-8fe2-c92d113d0ce4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:26.037770 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-627b83cc-0561-48e6-9be5-954f75152731 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:26.039303 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-627b83cc-0561-48e6-9be5-954f75152731 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:26.050373 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-627b83cc-0561-48e6-9be5-954f75152731 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:26.051985 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-627b83cc-0561-48e6-9be5-954f75152731 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:26.052675 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-627b83cc-0561-48e6-9be5-954f75152731 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:26.053660 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-627b83cc-0561-48e6-9be5-954f75152731 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:26.055063 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-627b83cc-0561-48e6-9be5-954f75152731 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:26.055765 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-627b83cc-0561-48e6-9be5-954f75152731 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:26.310991 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-627b83cc-0561-48e6-9be5-954f75152731 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:26.323555 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-627b83cc-0561-48e6-9be5-954f75152731 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1508 microversion: 2.1 time: 0.310089 Aug 07 01:29:26.328110 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1766/3881] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:26 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1508 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:26.516576 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ab59e595-03ee-4a48-8fe2-c92d113d0ce4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:26.527695 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ab59e595-03ee-4a48-8fe2-c92d113d0ce4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1512 microversion: 2.1 time: 0.878191 Aug 07 01:29:26.529001 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2116/3882] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:25 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1512 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:29:26.700267 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8f83d6b0-cbbd-487a-93c1-336471f60bc2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:26.701329 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8f83d6b0-cbbd-487a-93c1-336471f60bc2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:26.710772 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f83d6b0-cbbd-487a-93c1-336471f60bc2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:26.712258 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f83d6b0-cbbd-487a-93c1-336471f60bc2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:26.712833 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f83d6b0-cbbd-487a-93c1-336471f60bc2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:26.714098 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f83d6b0-cbbd-487a-93c1-336471f60bc2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:26.714098 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f83d6b0-cbbd-487a-93c1-336471f60bc2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:26.714546 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f83d6b0-cbbd-487a-93c1-336471f60bc2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:26.990419 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8f83d6b0-cbbd-487a-93c1-336471f60bc2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:26.999518 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8f83d6b0-cbbd-487a-93c1-336471f60bc2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1506 microversion: 2.1 time: 0.305665 Aug 07 01:29:27.014304 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1767/3883] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:26 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1506 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:27.348603 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-98ab058f-908b-4bfa-a922-c350076ab63e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:27.350032 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-98ab058f-908b-4bfa-a922-c350076ab63e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:27.357720 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-98ab058f-908b-4bfa-a922-c350076ab63e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:27.358305 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-98ab058f-908b-4bfa-a922-c350076ab63e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:27.358672 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-98ab058f-908b-4bfa-a922-c350076ab63e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:27.359421 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-98ab058f-908b-4bfa-a922-c350076ab63e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:27.360045 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-98ab058f-908b-4bfa-a922-c350076ab63e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:27.360475 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-98ab058f-908b-4bfa-a922-c350076ab63e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:27.551860 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-453984ea-fc2d-43a0-8a58-bc6453a996f3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:27.553959 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-453984ea-fc2d-43a0-8a58-bc6453a996f3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:27.562990 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-453984ea-fc2d-43a0-8a58-bc6453a996f3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:27.563562 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-453984ea-fc2d-43a0-8a58-bc6453a996f3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:27.564131 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-453984ea-fc2d-43a0-8a58-bc6453a996f3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:27.565035 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-453984ea-fc2d-43a0-8a58-bc6453a996f3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:27.565558 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-453984ea-fc2d-43a0-8a58-bc6453a996f3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:27.566634 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-453984ea-fc2d-43a0-8a58-bc6453a996f3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:27.661709 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-98ab058f-908b-4bfa-a922-c350076ab63e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:27.676475 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-98ab058f-908b-4bfa-a922-c350076ab63e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1508 microversion: 2.1 time: 0.331790 Aug 07 01:29:27.677082 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2117/3884] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:27 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1508 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:27.962970 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-453984ea-fc2d-43a0-8a58-bc6453a996f3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:27.976269 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-453984ea-fc2d-43a0-8a58-bc6453a996f3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1512 microversion: 2.1 time: 0.429639 Aug 07 01:29:27.991334 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1768/3885] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:27 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1512 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:29:28.022274 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-609a1f5a-ff62-4d53-93aa-e75f6e892e3b tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:28.022908 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-609a1f5a-ff62-4d53-93aa-e75f6e892e3b tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:28.032283 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-609a1f5a-ff62-4d53-93aa-e75f6e892e3b tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:28.032422 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-609a1f5a-ff62-4d53-93aa-e75f6e892e3b tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:28.034524 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-609a1f5a-ff62-4d53-93aa-e75f6e892e3b tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:28.034634 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-609a1f5a-ff62-4d53-93aa-e75f6e892e3b tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:28.035148 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-609a1f5a-ff62-4d53-93aa-e75f6e892e3b tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:28.036026 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-609a1f5a-ff62-4d53-93aa-e75f6e892e3b tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:28.195344 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-609a1f5a-ff62-4d53-93aa-e75f6e892e3b tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:28.204663 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-609a1f5a-ff62-4d53-93aa-e75f6e892e3b tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1506 microversion: 2.1 time: 0.187022 Aug 07 01:29:28.205561 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2118/3886] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:28 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1506 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:28.713417 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8d4b98fa-ab2e-4cb5-a69b-f3b8988543bb tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:28.714980 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8d4b98fa-ab2e-4cb5-a69b-f3b8988543bb tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:28.756604 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d4b98fa-ab2e-4cb5-a69b-f3b8988543bb tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:28.758505 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d4b98fa-ab2e-4cb5-a69b-f3b8988543bb tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:28.759736 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d4b98fa-ab2e-4cb5-a69b-f3b8988543bb tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:28.765042 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d4b98fa-ab2e-4cb5-a69b-f3b8988543bb tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:28.767106 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d4b98fa-ab2e-4cb5-a69b-f3b8988543bb tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:28.768224 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d4b98fa-ab2e-4cb5-a69b-f3b8988543bb tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:28.789700 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cd91f0be-1154-4eed-aaaf-5a9da91d3576 tempest-ImagesDeleteNegativeTestJSON-2009422972 tempest-ImagesDeleteNegativeTestJSON-2009422972-project] 10.222.0.39 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.183316 Aug 07 01:29:28.790287 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1769/3887] 10.222.0.39 () {58 vars in 1128 bytes} [Sun Aug 7 01:29:28 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 07 01:29:28.800797 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-83664514-dd29-46ff-a5c4-ae73e9a7d4ea tempest-ImagesDeleteNegativeTestJSON-2009422972 tempest-ImagesDeleteNegativeTestJSON-2009422972-project] Calling method '.version_select at 0x7f9e29a5ac10>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:28.831670 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-83664514-dd29-46ff-a5c4-ae73e9a7d4ea tempest-ImagesDeleteNegativeTestJSON-2009422972 tempest-ImagesDeleteNegativeTestJSON-2009422972-project] HTTP exception thrown: Image not found. Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-83664514-dd29-46ff-a5c4-ae73e9a7d4ea tempest-ImagesDeleteNegativeTestJSON-2009422972 tempest-ImagesDeleteNegativeTestJSON-2009422972-project] Request method failure captured: Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xV4ue9E5bdt2NplRhWF2q8W32SZefguDXUDgaSLw5xzezDfdxWNoiqzQ7E3jxLokGTar4El4dA12Ol4qFPG1BLNNTXGhLro3yMGSvXrbIvT7GzgZ2Cw3daNyfQPve5cxB1fw4LqfPQACnXqXpe7wioYQ3Wa4Pzml5xsXlStbgtiskE Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: a0120724da79436895adbcdcf83cc299 Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2009422972 Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a0120724da79436895adbcdcf83cc299"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a0120724da79436895adbcdcf83cc299", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a0120724da79436895adbcdcf83cc299"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a0120724da79436895adbcdcf83cc299"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2009422972 Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: a0120724da79436895adbcdcf83cc299 Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2009422972 Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ImagesDeleteNegativeTestJSON-2009422972-project Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 1b0db36c74b44fe08f33edc325a290f2 Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2009422972-project Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: exception: Image not found. Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '-1'} Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:28.833917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:28.842756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:28.842756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:28.842756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:29:28.842756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:29:28.842756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:29:28.842756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:29:28.842756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:29:28.842756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:29:28.842756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 07 01:29:28.842756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 07 01:29:28.842756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 07 01:29:28.842756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:28.842756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:28.842756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:28.842756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:28.842756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:28.842756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:28.842756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:29:28.842756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:29:28.842756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 07 01:29:28.842756 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:28.842756 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-83664514-dd29-46ff-a5c4-ae73e9a7d4ea tempest-ImagesDeleteNegativeTestJSON-2009422972 tempest-ImagesDeleteNegativeTestJSON-2009422972-project] Returning 404 to user: Image not found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:29:28.842756 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-83664514-dd29-46ff-a5c4-ae73e9a7d4ea tempest-ImagesDeleteNegativeTestJSON-2009422972 tempest-ImagesDeleteNegativeTestJSON-2009422972-project] 10.222.0.39 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.040575 Aug 07 01:29:28.842756 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1770/3888] 10.222.0.39 () {58 vars in 1134 bytes} [Sun Aug 7 01:29:28 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 07 01:29:28.854645 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-92c13f00-3681-4647-89d5-272c796f9f7b tempest-ImagesDeleteNegativeTestJSON-2009422972 tempest-ImagesDeleteNegativeTestJSON-2009422972-project] Calling method '.version_select at 0x7f9e17f15af0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:28.882869 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-92c13f00-3681-4647-89d5-272c796f9f7b tempest-ImagesDeleteNegativeTestJSON-2009422972 tempest-ImagesDeleteNegativeTestJSON-2009422972-project] HTTP exception thrown: Image not found. Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-92c13f00-3681-4647-89d5-272c796f9f7b tempest-ImagesDeleteNegativeTestJSON-2009422972 tempest-ImagesDeleteNegativeTestJSON-2009422972-project] Request method failure captured: Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/images/ac0da2b9-0689-4e59-958b-9683415fcf4j HTTP/1.1 Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xV4ue9E5bdt2NplRhWF2q8W32SZefguDXUDgaSLw5xzezDfdxWNoiqzQ7E3jxLokGTar4El4dA12Ol4qFPG1BLNNTXGhLro3yMGSvXrbIvT7GzgZ2Cw3daNyfQPve5cxB1fw4LqfPQACnXqXpe7wioYQ3Wa4Pzml5xsXlStbgtiskE Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: a0120724da79436895adbcdcf83cc299 Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2009422972 Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a0120724da79436895adbcdcf83cc299"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a0120724da79436895adbcdcf83cc299", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a0120724da79436895adbcdcf83cc299"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a0120724da79436895adbcdcf83cc299"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2009422972 Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: a0120724da79436895adbcdcf83cc299 Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2009422972 Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ImagesDeleteNegativeTestJSON-2009422972-project Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 1b0db36c74b44fe08f33edc325a290f2 Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2009422972-project Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: exception: Image not found. Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'ac0da2b9-0689-4e59-958b-9683415fcf4j'} Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ac0da2b9-0689-4e59-958b-9683415fcf4j to delete Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ac0da2b9-0689-4e59-958b-9683415fcf4j could not be found. Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:28.887538 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:28.892198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:28.892198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:28.892198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:28.892198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:29:28.892198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:29:28.892198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:29:28.892198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:29:28.892198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:29:28.892198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:29:28.892198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 07 01:29:28.892198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 07 01:29:28.892198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 07 01:29:28.892198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:28.892198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:28.892198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:28.892198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:28.892198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:28.892198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:28.892198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:29:28.892198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:29:28.892198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 07 01:29:28.892198 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:28.896434 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-92c13f00-3681-4647-89d5-272c796f9f7b tempest-ImagesDeleteNegativeTestJSON-2009422972 tempest-ImagesDeleteNegativeTestJSON-2009422972-project] Returning 404 to user: Image not found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:29:28.897870 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-92c13f00-3681-4647-89d5-272c796f9f7b tempest-ImagesDeleteNegativeTestJSON-2009422972 tempest-ImagesDeleteNegativeTestJSON-2009422972-project] 10.222.0.39 "DELETE /compute/v2.1/images/ac0da2b9-0689-4e59-958b-9683415fcf4j" status: 404 len: 62 microversion: 2.1 time: 0.052980 Aug 07 01:29:28.898728 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1771/3889] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:28 2022] DELETE /compute/v2.1/images/ac0da2b9-0689-4e59-958b-9683415fcf4j => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:29:28.912297 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b67e3b2f-2f81-420b-aa77-67b4bb78fc01 tempest-ImagesDeleteNegativeTestJSON-2009422972 tempest-ImagesDeleteNegativeTestJSON-2009422972-project] Calling method '.version_select at 0x7f9e299378b0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:28.930539 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-b67e3b2f-2f81-420b-aa77-67b4bb78fc01 tempest-ImagesDeleteNegativeTestJSON-2009422972 tempest-ImagesDeleteNegativeTestJSON-2009422972-project] HTTP exception thrown: Image not found. Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b67e3b2f-2f81-420b-aa77-67b4bb78fc01 tempest-ImagesDeleteNegativeTestJSON-2009422972 tempest-ImagesDeleteNegativeTestJSON-2009422972-project] Request method failure captured: Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/images/28cd3cbe-ba47-48d4-92cb-d210bd65ed021 HTTP/1.1 Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xV4ue9E5bdt2NplRhWF2q8W32SZefguDXUDgaSLw5xzezDfdxWNoiqzQ7E3jxLokGTar4El4dA12Ol4qFPG1BLNNTXGhLro3yMGSvXrbIvT7GzgZ2Cw3daNyfQPve5cxB1fw4LqfPQACnXqXpe7wioYQ3Wa4Pzml5xsXlStbgtiskE Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: a0120724da79436895adbcdcf83cc299 Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2009422972 Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a0120724da79436895adbcdcf83cc299"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a0120724da79436895adbcdcf83cc299", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a0120724da79436895adbcdcf83cc299"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a0120724da79436895adbcdcf83cc299"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2009422972 Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: a0120724da79436895adbcdcf83cc299 Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2009422972 Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ImagesDeleteNegativeTestJSON-2009422972-project Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 1b0db36c74b44fe08f33edc325a290f2 Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2009422972-project Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: exception: Image not found. Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '28cd3cbe-ba47-48d4-92cb-d210bd65ed021'} Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 28cd3cbe-ba47-48d4-92cb-d210bd65ed021 to delete Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 28cd3cbe-ba47-48d4-92cb-d210bd65ed021 could not be found. Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:28.933944 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:28.938577 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:28.938577 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:28.938577 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:28.938577 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:29:28.938577 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:29:28.938577 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:29:28.938577 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:29:28.938577 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:29:28.938577 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:29:28.938577 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 07 01:29:28.938577 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 07 01:29:28.938577 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 07 01:29:28.938577 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:28.938577 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:28.938577 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:28.938577 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:28.938577 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:28.938577 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:28.938577 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:29:28.938577 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:29:28.938577 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 07 01:29:28.938577 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:28.938577 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b67e3b2f-2f81-420b-aa77-67b4bb78fc01 tempest-ImagesDeleteNegativeTestJSON-2009422972 tempest-ImagesDeleteNegativeTestJSON-2009422972-project] Returning 404 to user: Image not found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:29:28.938577 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b67e3b2f-2f81-420b-aa77-67b4bb78fc01 tempest-ImagesDeleteNegativeTestJSON-2009422972 tempest-ImagesDeleteNegativeTestJSON-2009422972-project] 10.222.0.39 "DELETE /compute/v2.1/images/28cd3cbe-ba47-48d4-92cb-d210bd65ed021" status: 404 len: 62 microversion: 2.1 time: 0.031027 Aug 07 01:29:28.938577 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1772/3890] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:29:28 2022] DELETE /compute/v2.1/images/28cd3cbe-ba47-48d4-92cb-d210bd65ed021 => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 07 01:29:28.956540 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d5ae7b43-3c99-4cf2-900a-ca698b511a0c tempest-ImagesDeleteNegativeTestJSON-2009422972 tempest-ImagesDeleteNegativeTestJSON-2009422972-project] Calling method '.version_select at 0x7f9e242c83a0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:28.986034 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8d4b98fa-ab2e-4cb5-a69b-f3b8988543bb tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:28.987574 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-d5ae7b43-3c99-4cf2-900a-ca698b511a0c tempest-ImagesDeleteNegativeTestJSON-2009422972 tempest-ImagesDeleteNegativeTestJSON-2009422972-project] HTTP exception thrown: Image not found. Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d5ae7b43-3c99-4cf2-900a-ca698b511a0c tempest-ImagesDeleteNegativeTestJSON-2009422972 tempest-ImagesDeleteNegativeTestJSON-2009422972-project] Request method failure captured: Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/images/tempest-invalid-943155697 HTTP/1.1 Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xV4ue9E5bdt2NplRhWF2q8W32SZefguDXUDgaSLw5xzezDfdxWNoiqzQ7E3jxLokGTar4El4dA12Ol4qFPG1BLNNTXGhLro3yMGSvXrbIvT7GzgZ2Cw3daNyfQPve5cxB1fw4LqfPQACnXqXpe7wioYQ3Wa4Pzml5xsXlStbgtiskE Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: a0120724da79436895adbcdcf83cc299 Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2009422972 Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a0120724da79436895adbcdcf83cc299"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a0120724da79436895adbcdcf83cc299", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a0120724da79436895adbcdcf83cc299"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a0120724da79436895adbcdcf83cc299"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2009422972 Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: a0120724da79436895adbcdcf83cc299 Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2009422972 Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ImagesDeleteNegativeTestJSON-2009422972-project Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 1b0db36c74b44fe08f33edc325a290f2 Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2009422972-project Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: exception: Image not found. Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'tempest-invalid-943155697'} Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-943155697 to delete Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-943155697 could not be found. Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:28.989711 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:28.998473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:28.998473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:28.998473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:29:28.998473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:29:28.998473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:29:28.998473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:29:28.998473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:29:28.998473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:29:28.998473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 07 01:29:28.998473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 07 01:29:28.998473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 07 01:29:28.998473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:28.998473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:28.998473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:28.998473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:28.998473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:28.998473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:28.998473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:29:28.998473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:29:28.998473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 07 01:29:28.998473 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:29:28.998473 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d5ae7b43-3c99-4cf2-900a-ca698b511a0c tempest-ImagesDeleteNegativeTestJSON-2009422972 tempest-ImagesDeleteNegativeTestJSON-2009422972-project] Returning 404 to user: Image not found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:29:28.998473 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d5ae7b43-3c99-4cf2-900a-ca698b511a0c tempest-ImagesDeleteNegativeTestJSON-2009422972 tempest-ImagesDeleteNegativeTestJSON-2009422972-project] 10.222.0.39 "DELETE /compute/v2.1/images/tempest-invalid-943155697" status: 404 len: 62 microversion: 2.1 time: 0.049598 Aug 07 01:29:28.998473 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1773/3891] 10.222.0.39 () {58 vars in 1203 bytes} [Sun Aug 7 01:29:28 2022] DELETE /compute/v2.1/images/tempest-invalid-943155697 => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:29:29.003496 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-232682f1-267b-4fad-8995-5a38cb831a15 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:29.003496 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-232682f1-267b-4fad-8995-5a38cb831a15 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:29.004888 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8d4b98fa-ab2e-4cb5-a69b-f3b8988543bb tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1508 microversion: 2.1 time: 0.308506 Aug 07 01:29:29.005663 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2119/3892] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:28 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1508 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:29.018257 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-232682f1-267b-4fad-8995-5a38cb831a15 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:29.022482 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-232682f1-267b-4fad-8995-5a38cb831a15 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:29.023016 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-232682f1-267b-4fad-8995-5a38cb831a15 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:29.023799 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-232682f1-267b-4fad-8995-5a38cb831a15 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:29.024460 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-232682f1-267b-4fad-8995-5a38cb831a15 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:29.024751 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-232682f1-267b-4fad-8995-5a38cb831a15 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:29.027433 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-34e1439a-58ee-40e4-84f1-fdef767adbb0 tempest-ImagesDeleteNegativeTestJSON-2009422972 tempest-ImagesDeleteNegativeTestJSON-2009422972-project] Calling method '.version_select at 0x7f9e24743940>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:29.056253 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-34e1439a-58ee-40e4-84f1-fdef767adbb0 tempest-ImagesDeleteNegativeTestJSON-2009422972 tempest-ImagesDeleteNegativeTestJSON-2009422972-project] HTTP exception thrown: Image not found. Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-34e1439a-58ee-40e4-84f1-fdef767adbb0 tempest-ImagesDeleteNegativeTestJSON-2009422972 tempest-ImagesDeleteNegativeTestJSON-2009422972-project] Request method failure captured: Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/images/9fa171d3-029f-436c-adf6-cecb9fc71a5d HTTP/1.1 Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xV4ue9E5bdt2NplRhWF2q8W32SZefguDXUDgaSLw5xzezDfdxWNoiqzQ7E3jxLokGTar4El4dA12Ol4qFPG1BLNNTXGhLro3yMGSvXrbIvT7GzgZ2Cw3daNyfQPve5cxB1fw4LqfPQACnXqXpe7wioYQ3Wa4Pzml5xsXlStbgtiskE Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: a0120724da79436895adbcdcf83cc299 Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2009422972 Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a0120724da79436895adbcdcf83cc299"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a0120724da79436895adbcdcf83cc299", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a0120724da79436895adbcdcf83cc299"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a0120724da79436895adbcdcf83cc299"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2009422972 Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: a0120724da79436895adbcdcf83cc299 Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2009422972 Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ImagesDeleteNegativeTestJSON-2009422972-project Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 1b0db36c74b44fe08f33edc325a290f2 Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2009422972-project Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: exception: Image not found. Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '9fa171d3-029f-436c-adf6-cecb9fc71a5d'} Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9fa171d3-029f-436c-adf6-cecb9fc71a5d to delete Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9fa171d3-029f-436c-adf6-cecb9fc71a5d could not be found. Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:29.058914 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:29.064922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:29.064922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:29.064922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:29.064922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:29:29.064922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:29:29.064922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:29:29.064922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:29:29.064922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:29:29.064922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:29:29.064922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 07 01:29:29.064922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 07 01:29:29.064922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 07 01:29:29.064922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:29.064922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:29:29.064922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:29.064922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:29:29.064922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:29:29.064922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:29:29.064922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:29:29.064922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:29:29.064922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 07 01:29:29.064922 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:29:29.064922 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-34e1439a-58ee-40e4-84f1-fdef767adbb0 tempest-ImagesDeleteNegativeTestJSON-2009422972 tempest-ImagesDeleteNegativeTestJSON-2009422972-project] Returning 404 to user: Image not found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:29:29.064922 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-34e1439a-58ee-40e4-84f1-fdef767adbb0 tempest-ImagesDeleteNegativeTestJSON-2009422972 tempest-ImagesDeleteNegativeTestJSON-2009422972-project] 10.222.0.39 "DELETE /compute/v2.1/images/9fa171d3-029f-436c-adf6-cecb9fc71a5d" status: 404 len: 62 microversion: 2.1 time: 0.053960 Aug 07 01:29:29.064922 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2120/3893] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:29 2022] DELETE /compute/v2.1/images/9fa171d3-029f-436c-adf6-cecb9fc71a5d => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:29:29.225205 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-232682f1-267b-4fad-8995-5a38cb831a15 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:29.233251 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-15a3023a-ed19-40d1-8166-5c1ecba0d6e2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:29.234542 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-232682f1-267b-4fad-8995-5a38cb831a15 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1512 microversion: 2.1 time: 0.238341 Aug 07 01:29:29.234799 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-15a3023a-ed19-40d1-8166-5c1ecba0d6e2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:29.235635 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1774/3894] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:28 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1512 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:29.250926 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-15a3023a-ed19-40d1-8166-5c1ecba0d6e2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:29.252146 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-15a3023a-ed19-40d1-8166-5c1ecba0d6e2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:29.256004 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-15a3023a-ed19-40d1-8166-5c1ecba0d6e2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:29.257806 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-15a3023a-ed19-40d1-8166-5c1ecba0d6e2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:29.259130 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-15a3023a-ed19-40d1-8166-5c1ecba0d6e2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:29.261032 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-15a3023a-ed19-40d1-8166-5c1ecba0d6e2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:29.535156 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-15a3023a-ed19-40d1-8166-5c1ecba0d6e2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:29.548766 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-15a3023a-ed19-40d1-8166-5c1ecba0d6e2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1506 microversion: 2.1 time: 0.323652 Aug 07 01:29:29.552506 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2121/3895] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:29 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1506 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:30.044722 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8c6f208b-5a5a-476d-b412-93c98ebbcc1c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:30.045508 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8c6f208b-5a5a-476d-b412-93c98ebbcc1c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:30.072696 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8c6f208b-5a5a-476d-b412-93c98ebbcc1c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:30.077352 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8c6f208b-5a5a-476d-b412-93c98ebbcc1c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:30.079413 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8c6f208b-5a5a-476d-b412-93c98ebbcc1c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:30.082440 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8c6f208b-5a5a-476d-b412-93c98ebbcc1c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:30.082925 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8c6f208b-5a5a-476d-b412-93c98ebbcc1c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:30.084467 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8c6f208b-5a5a-476d-b412-93c98ebbcc1c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:30.259014 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a6adc727-1fcb-421f-a177-4db778c624a0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:30.260278 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a6adc727-1fcb-421f-a177-4db778c624a0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:30.268256 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a6adc727-1fcb-421f-a177-4db778c624a0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:30.268822 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a6adc727-1fcb-421f-a177-4db778c624a0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:30.269434 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a6adc727-1fcb-421f-a177-4db778c624a0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:30.270353 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a6adc727-1fcb-421f-a177-4db778c624a0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:30.271096 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a6adc727-1fcb-421f-a177-4db778c624a0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:30.271589 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a6adc727-1fcb-421f-a177-4db778c624a0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:30.388105 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8c6f208b-5a5a-476d-b412-93c98ebbcc1c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:30.398255 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8c6f208b-5a5a-476d-b412-93c98ebbcc1c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1508 microversion: 2.1 time: 0.369620 Aug 07 01:29:30.411104 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1775/3896] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:30 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1508 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:30.557491 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a6adc727-1fcb-421f-a177-4db778c624a0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:30.571964 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-914d0e55-5d42-4e16-907c-4457ae826b9f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:30.573947 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-914d0e55-5d42-4e16-907c-4457ae826b9f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:30.583624 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a6adc727-1fcb-421f-a177-4db778c624a0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1512 microversion: 2.1 time: 0.329404 Aug 07 01:29:30.587433 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2122/3897] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:30 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1512 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:30.590370 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-914d0e55-5d42-4e16-907c-4457ae826b9f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:30.590878 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-914d0e55-5d42-4e16-907c-4457ae826b9f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:30.594863 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-914d0e55-5d42-4e16-907c-4457ae826b9f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:30.595732 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-914d0e55-5d42-4e16-907c-4457ae826b9f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:30.596243 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-914d0e55-5d42-4e16-907c-4457ae826b9f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:30.596677 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-914d0e55-5d42-4e16-907c-4457ae826b9f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:30.865352 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-914d0e55-5d42-4e16-907c-4457ae826b9f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:30.877969 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-914d0e55-5d42-4e16-907c-4457ae826b9f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1506 microversion: 2.1 time: 0.310551 Aug 07 01:29:30.882739 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1776/3898] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:30 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1506 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:31.424749 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9876de57-b698-4719-9a3c-cfd8a2b2124c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:31.426150 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9876de57-b698-4719-9a3c-cfd8a2b2124c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:31.435043 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9876de57-b698-4719-9a3c-cfd8a2b2124c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:31.436054 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9876de57-b698-4719-9a3c-cfd8a2b2124c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:31.436779 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9876de57-b698-4719-9a3c-cfd8a2b2124c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:31.437772 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9876de57-b698-4719-9a3c-cfd8a2b2124c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:31.439115 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9876de57-b698-4719-9a3c-cfd8a2b2124c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:31.439838 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9876de57-b698-4719-9a3c-cfd8a2b2124c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:31.704730 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-627d4d52-975d-40bf-b20e-7972815ef16f tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Action: 'create', calling method: .version_select at 0x7f9e297fe1f0>, body: {"keypair": {"name": "tempest-keypair-1746975238", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaiNVLCYuySevza2GFPKMc52SUT8pDD54ZEY/xZBIO5tYpjw59Kf+sGeEQasNFdwZo1KB+XCAaMGYkXL0zVYmAe+T1pZa7XPwE/7D0IFQ56gqMuEH6jGcrH7Y5OkyXt3A=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:31.757220 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-627d4d52-975d-40bf-b20e-7972815ef16f tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Getting quotas for project 81506548c3b44b50839cbaa818db1f00. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:29:31.766984 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-627d4d52-975d-40bf-b20e-7972815ef16f tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Getting quotas for user 12e5f4dc85b34ab6947f58d305531b39 and project 81506548c3b44b50839cbaa818db1f00. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:29:31.774653 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:31.818878 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-627d4d52-975d-40bf-b20e-7972815ef16f tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.346766 Aug 07 01:29:31.819963 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1777/3899] 10.222.0.39 () {62 vars in 1199 bytes} [Sun Aug 7 01:29:31 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 349 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 07 01:29:31.838261 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9876de57-b698-4719-9a3c-cfd8a2b2124c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:31.842636 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d0216e2e-0b7a-4f68-ad4e-a56417b74217 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:31.844112 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d0216e2e-0b7a-4f68-ad4e-a56417b74217 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:31.851919 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d0216e2e-0b7a-4f68-ad4e-a56417b74217 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:31.852454 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9876de57-b698-4719-9a3c-cfd8a2b2124c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1529 microversion: 2.1 time: 0.430652 Aug 07 01:29:31.853024 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d0216e2e-0b7a-4f68-ad4e-a56417b74217 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:31.854339 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d0216e2e-0b7a-4f68-ad4e-a56417b74217 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:31.855390 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d0216e2e-0b7a-4f68-ad4e-a56417b74217 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:31.856248 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d0216e2e-0b7a-4f68-ad4e-a56417b74217 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:31.856923 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d0216e2e-0b7a-4f68-ad4e-a56417b74217 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:31.872383 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2123/3900] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:31 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1529 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:31.890234 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a9ce0d50-4c57-4b22-97d7-5c718c79b963 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Calling method '.version_select at 0x7f9e17aaf940>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:31.898090 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:31.913437 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a9ce0d50-4c57-4b22-97d7-5c718c79b963 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] 10.222.0.39 "GET /compute/v2.1/os-keypairs/tempest-keypair-1746975238" status: 200 len: 513 microversion: 2.2 time: 0.038639 Aug 07 01:29:31.914929 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2124/3901] 10.222.0.39 () {60 vars in 1258 bytes} [Sun Aug 7 01:29:31 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1746975238 => generated 513 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:29:31.928964 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6cd0e6c2-9415-477a-8db5-941166eebfd5 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:31.940879 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6cd0e6c2-9415-477a-8db5-941166eebfd5 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:31.958529 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cd0e6c2-9415-477a-8db5-941166eebfd5 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:31.968954 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cd0e6c2-9415-477a-8db5-941166eebfd5 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:31.970219 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cd0e6c2-9415-477a-8db5-941166eebfd5 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:31.971292 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cd0e6c2-9415-477a-8db5-941166eebfd5 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:31.972360 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cd0e6c2-9415-477a-8db5-941166eebfd5 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:31.973086 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cd0e6c2-9415-477a-8db5-941166eebfd5 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:32.131018 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d0216e2e-0b7a-4f68-ad4e-a56417b74217 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:32.140654 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d0216e2e-0b7a-4f68-ad4e-a56417b74217 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1512 microversion: 2.1 time: 0.302711 Aug 07 01:29:32.161843 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1778/3902] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:31 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1512 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:32.168456 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1d292a58-301e-4954-93d9-1553ee59a749 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Calling method '.version_select at 0x7f9e29a5a550>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:32.203791 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1d292a58-301e-4954-93d9-1553ee59a749 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1746975238" status: 204 len: 0 microversion: 2.2 time: 0.040603 Aug 07 01:29:32.214998 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1779/3903] 10.222.0.39 () {60 vars in 1261 bytes} [Sun Aug 7 01:29:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1746975238 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:29:32.220710 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a49a4041-0779-4dc3-90b4-7a4314ce9388 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Action: 'create', calling method: .version_select at 0x7f9e297fe8b0>, body: {"keypair": {"name": "tempest-keypair-109028989", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPATldVAxnnPuG6gjKGu+Bcer1JM1flEcQmo2nK8Nms1TdcEMUduVayrzp4OLrcUqBj9e6UG1lAn0XNJnGpFkYYbmn+tyI8v+DJc/WXPm+uem0JheeQ3NnMZNCD5lEqhQA=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:32.229570 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6cd0e6c2-9415-477a-8db5-941166eebfd5 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:32.242269 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6cd0e6c2-9415-477a-8db5-941166eebfd5 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1506 microversion: 2.1 time: 0.322771 Aug 07 01:29:32.244292 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2125/3904] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:31 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1506 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:32.252604 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-a49a4041-0779-4dc3-90b4-7a4314ce9388 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Getting quotas for project 81506548c3b44b50839cbaa818db1f00. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:29:32.281588 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-a49a4041-0779-4dc3-90b4-7a4314ce9388 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Getting quotas for user 12e5f4dc85b34ab6947f58d305531b39 and project 81506548c3b44b50839cbaa818db1f00. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:29:32.324152 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3dbd2e04-eccf-4603-8f92-0bf588e4d95c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:32.326449 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3dbd2e04-eccf-4603-8f92-0bf588e4d95c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:32.345576 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a49a4041-0779-4dc3-90b4-7a4314ce9388 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.128924 Aug 07 01:29:32.346510 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1780/3905] 10.222.0.39 () {62 vars in 1199 bytes} [Sun Aug 7 01:29:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 131 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 07 01:29:32.347322 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3dbd2e04-eccf-4603-8f92-0bf588e4d95c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:32.347906 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3dbd2e04-eccf-4603-8f92-0bf588e4d95c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:32.348378 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3dbd2e04-eccf-4603-8f92-0bf588e4d95c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:32.349137 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3dbd2e04-eccf-4603-8f92-0bf588e4d95c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:32.349601 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3dbd2e04-eccf-4603-8f92-0bf588e4d95c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:32.350033 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3dbd2e04-eccf-4603-8f92-0bf588e4d95c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:32.357922 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-09264c77-9dec-47b1-adff-a74dca91c64e tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Calling method '.version_select at 0x7f9e297f84c0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:32.394889 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:32.407523 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-09264c77-9dec-47b1-adff-a74dca91c64e tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-109028989" status: 204 len: 0 microversion: 2.2 time: 0.053487 Aug 07 01:29:32.408818 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1781/3906] 10.222.0.39 () {60 vars in 1258 bytes} [Sun Aug 7 01:29:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-109028989 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:29:32.420179 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-caef0a1f-c661-4c9c-8f02-02e96eb155c0 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Action: 'create', calling method: .version_select at 0x7f9e297fee50>, body: {"keypair": {"name": "tempest-keypair-1172159682", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:32.460607 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-caef0a1f-c661-4c9c-8f02-02e96eb155c0 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Getting quotas for project 81506548c3b44b50839cbaa818db1f00. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:29:32.472952 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-caef0a1f-c661-4c9c-8f02-02e96eb155c0 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Getting quotas for user 12e5f4dc85b34ab6947f58d305531b39 and project 81506548c3b44b50839cbaa818db1f00. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:29:32.503270 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3dbd2e04-eccf-4603-8f92-0bf588e4d95c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action" status: 202 len: 0 microversion: 2.1 time: 0.183685 Aug 07 01:29:32.504997 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2126/3907] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:29:32 2022] POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 01:29:32.508963 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-caef0a1f-c661-4c9c-8f02-02e96eb155c0 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.093379 Aug 07 01:29:32.510996 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1782/3908] 10.222.0.39 () {62 vars in 1199 bytes} [Sun Aug 7 01:29:32 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 96 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 07 01:29:32.517686 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dd8dc878-8053-4298-a3e6-c16e9e499686 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:32.518666 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-dd8dc878-8053-4298-a3e6-c16e9e499686 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:32.525146 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4ba15aa5-b78d-48d1-9c0e-a18433fa3739 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Calling method '.version_select at 0x7f9e299e9af0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:32.529580 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd8dc878-8053-4298-a3e6-c16e9e499686 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:32.530431 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd8dc878-8053-4298-a3e6-c16e9e499686 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:32.531383 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd8dc878-8053-4298-a3e6-c16e9e499686 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:32.532523 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd8dc878-8053-4298-a3e6-c16e9e499686 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:32.533176 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd8dc878-8053-4298-a3e6-c16e9e499686 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:32.533806 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd8dc878-8053-4298-a3e6-c16e9e499686 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:32.572977 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4ba15aa5-b78d-48d1-9c0e-a18433fa3739 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1172159682" status: 204 len: 0 microversion: 2.2 time: 0.055454 Aug 07 01:29:32.573684 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1783/3909] 10.222.0.39 () {60 vars in 1261 bytes} [Sun Aug 7 01:29:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1172159682 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 07 01:29:32.587164 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c1a474b9-d6c1-4488-9ab1-1af20cf2468a tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Action: 'create', calling method: .version_select at 0x7f9e298005e0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1038389269", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcxwR/qNeCanRxTvDhtJKpp/yk8ycNqK1exrvinovL+EVWJ8rk3YK+WzG5un6f0nIUa+kormhTgDUYobW0Me0/MFZWYmNG5dXG1nMN4vM3wJ9cZ5SjTQcxDYHducLz2iw=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:32.621006 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-c1a474b9-d6c1-4488-9ab1-1af20cf2468a tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Getting quotas for project 81506548c3b44b50839cbaa818db1f00. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:29:32.631078 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-c1a474b9-d6c1-4488-9ab1-1af20cf2468a tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Getting quotas for user 12e5f4dc85b34ab6947f58d305531b39 and project 81506548c3b44b50839cbaa818db1f00. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:29:32.665460 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c1a474b9-d6c1-4488-9ab1-1af20cf2468a tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.083406 Aug 07 01:29:32.667023 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1784/3910] 10.222.0.39 () {62 vars in 1199 bytes} [Sun Aug 7 01:29:32 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 86 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 07 01:29:32.682516 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-828a2656-2639-4bbc-8d9c-9c78326ff8e6 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Action: 'create', calling method: .version_select at 0x7f9e29800550>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1115644396", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTYyG6gWlGU5TKeD9TdVUWk9YE4pREK2ShgyKL+HZy5UhDFSQJ6UrgP5pm56zpa9A0ZFyK2cYbyueRdxQy1yf7oMG+BetYpOFFtEk/wABsUr6L9jHxH4VoZRuYMNqt7qw=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:32.702209 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-828a2656-2639-4bbc-8d9c-9c78326ff8e6 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Getting quotas for project 81506548c3b44b50839cbaa818db1f00. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:29:32.708702 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-828a2656-2639-4bbc-8d9c-9c78326ff8e6 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Getting quotas for user 12e5f4dc85b34ab6947f58d305531b39 and project 81506548c3b44b50839cbaa818db1f00. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:29:32.757561 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-828a2656-2639-4bbc-8d9c-9c78326ff8e6 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.080880 Aug 07 01:29:32.758193 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1785/3911] 10.222.0.39 () {62 vars in 1199 bytes} [Sun Aug 7 01:29:32 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 83 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 07 01:29:32.773466 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a6b02c3e-ac82-4079-a613-12d69772c359 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Action: 'create', calling method: .version_select at 0x7f9e297fe700>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-744464781", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4WBgVH7Ff49idm9Y+7CM3faWort1XDBaVY78bL3IcUIY5lpbyim7a9iq9H6XjDXe+mXP2wfwMcU5R/H1gz+lSscZNwhlcgFS9YKhIwkv0UNj8tCessYRuvfwMX/H4h7A=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:32.798008 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-a6b02c3e-ac82-4079-a613-12d69772c359 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Getting quotas for project 81506548c3b44b50839cbaa818db1f00. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:29:32.806696 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-a6b02c3e-ac82-4079-a613-12d69772c359 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Getting quotas for user 12e5f4dc85b34ab6947f58d305531b39 and project 81506548c3b44b50839cbaa818db1f00. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:29:32.843320 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a6b02c3e-ac82-4079-a613-12d69772c359 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.075870 Aug 07 01:29:32.845339 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1786/3912] 10.222.0.39 () {62 vars in 1199 bytes} [Sun Aug 7 01:29:32 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 78 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 07 01:29:32.857411 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3a74b40c-6669-407e-97df-1bb2a73def5d tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Calling method '.version_select at 0x7f9e297e7160>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:32.863028 n-d-master-1 devstack@n-api.service[119517]: WARNING oslo_db.sqlalchemy.utils [None req-3a74b40c-6669-407e-97df-1bb2a73def5d tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 07 01:29:32.872130 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3a74b40c-6669-407e-97df-1bb2a73def5d tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] 10.222.0.39 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.019587 Aug 07 01:29:32.873098 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1787/3913] 10.222.0.39 () {60 vars in 1177 bytes} [Sun Aug 7 01:29:32 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:32.886772 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3ef30dfc-0372-4db7-b193-291902681afb tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Calling method '.version_select at 0x7f9e297e73a0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:32.912614 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3ef30dfc-0372-4db7-b193-291902681afb tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-744464781" status: 204 len: 0 microversion: 2.2 time: 0.032155 Aug 07 01:29:32.917566 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1788/3914] 10.222.0.39 () {60 vars in 1318 bytes} [Sun Aug 7 01:29:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-744464781 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:29:32.924739 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ed33d97c-98a2-4d46-8025-94d32d5da1be tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:32.925388 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ed33d97c-98a2-4d46-8025-94d32d5da1be tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:32.934579 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed33d97c-98a2-4d46-8025-94d32d5da1be tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:32.935149 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed33d97c-98a2-4d46-8025-94d32d5da1be tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:32.935718 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed33d97c-98a2-4d46-8025-94d32d5da1be tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:32.936858 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed33d97c-98a2-4d46-8025-94d32d5da1be tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:32.937323 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed33d97c-98a2-4d46-8025-94d32d5da1be tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:32.938346 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed33d97c-98a2-4d46-8025-94d32d5da1be tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:33.169560 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ed33d97c-98a2-4d46-8025-94d32d5da1be tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:33.186322 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ed33d97c-98a2-4d46-8025-94d32d5da1be tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1529 microversion: 2.1 time: 0.267472 Aug 07 01:29:33.190853 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1789/3915] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:32 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1529 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:33.210881 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1f2159cb-2a00-46ab-98be-314a8991b4ef tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Calling method '.version_select at 0x7f9e2985dca0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:33.246801 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-dd8dc878-8053-4298-a3e6-c16e9e499686 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:33.258231 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1f2159cb-2a00-46ab-98be-314a8991b4ef tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1115644396" status: 204 len: 0 microversion: 2.2 time: 0.069113 Aug 07 01:29:33.261002 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1790/3916] 10.222.0.39 () {60 vars in 1321 bytes} [Sun Aug 7 01:29:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1115644396 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:29:33.261796 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-dd8dc878-8053-4298-a3e6-c16e9e499686 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1669 microversion: 2.1 time: 0.750532 Aug 07 01:29:33.262724 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2127/3917] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:32 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1669 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:33.272156 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2070637d-8869-4279-90ed-208d741454a1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:33.273349 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e560b1f1-b117-455f-9a5a-215ad72e078f tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Calling method '.version_select at 0x7f9e17aaf160>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:33.274215 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2070637d-8869-4279-90ed-208d741454a1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:33.289778 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2070637d-8869-4279-90ed-208d741454a1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:33.290439 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2070637d-8869-4279-90ed-208d741454a1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:33.291027 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2070637d-8869-4279-90ed-208d741454a1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:33.291867 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2070637d-8869-4279-90ed-208d741454a1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:33.293909 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2070637d-8869-4279-90ed-208d741454a1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:33.294495 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2070637d-8869-4279-90ed-208d741454a1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:33.316445 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e560b1f1-b117-455f-9a5a-215ad72e078f tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1038389269" status: 204 len: 0 microversion: 2.2 time: 0.049121 Aug 07 01:29:33.317934 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2128/3918] 10.222.0.39 () {60 vars in 1321 bytes} [Sun Aug 7 01:29:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1038389269 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:29:33.325370 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4b3c2da8-5581-42f1-b433-b9cea4b344b3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:33.326470 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4b3c2da8-5581-42f1-b433-b9cea4b344b3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:33.351406 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b3c2da8-5581-42f1-b433-b9cea4b344b3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:33.352090 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b3c2da8-5581-42f1-b433-b9cea4b344b3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:33.352654 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b3c2da8-5581-42f1-b433-b9cea4b344b3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:33.353535 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b3c2da8-5581-42f1-b433-b9cea4b344b3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:33.354265 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b3c2da8-5581-42f1-b433-b9cea4b344b3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:33.354930 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b3c2da8-5581-42f1-b433-b9cea4b344b3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:33.521412 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2070637d-8869-4279-90ed-208d741454a1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:33.531597 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2070637d-8869-4279-90ed-208d741454a1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1512 microversion: 2.1 time: 0.267927 Aug 07 01:29:33.532770 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1791/3919] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:33 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1512 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:33.537374 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d4c89ed9-3575-4b17-9a9e-9f3464619734 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Action: 'create', calling method: .version_select at 0x7f9e242c8dc0>, body: {"keypair": {"name": "tempest-keypair-179661128", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVXX63i1LEY5IInDhsAF/tWbwIK21mM2v7PLIehExVOviArlYLCD4SPqjUf9g1hSO8vSilDhoZnRZzjSfp7ExrfgGZp8D7tBxwDdKaFZUWmdWgmlZkqjyCbBWvZlQxMrg=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:33.553824 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-d4c89ed9-3575-4b17-9a9e-9f3464619734 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Getting quotas for project 81506548c3b44b50839cbaa818db1f00. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:29:33.560695 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-d4c89ed9-3575-4b17-9a9e-9f3464619734 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Getting quotas for user 12e5f4dc85b34ab6947f58d305531b39 and project 81506548c3b44b50839cbaa818db1f00. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:29:33.562775 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:DELETE=5 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:33.592745 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d4c89ed9-3575-4b17-9a9e-9f3464619734 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.058810 Aug 07 01:29:33.594691 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1792/3920] 10.222.0.39 () {62 vars in 1199 bytes} [Sun Aug 7 01:29:33 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 61 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 07 01:29:33.602762 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4b3c2da8-5581-42f1-b433-b9cea4b344b3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:33.611980 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2bc9ee48-3ee6-4996-aa22-3d33ee65148f tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Calling method '.version_select at 0x7f9e298003a0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:33.616297 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4b3c2da8-5581-42f1-b433-b9cea4b344b3 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1506 microversion: 2.1 time: 0.296770 Aug 07 01:29:33.617788 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2129/3921] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:33 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1506 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:33.628440 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2bc9ee48-3ee6-4996-aa22-3d33ee65148f tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] 10.222.0.39 "GET /compute/v2.1/os-keypairs/tempest-keypair-179661128" status: 200 len: 512 microversion: 2.2 time: 0.022886 Aug 07 01:29:33.629336 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1793/3922] 10.222.0.39 () {60 vars in 1255 bytes} [Sun Aug 7 01:29:33 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-179661128 => generated 512 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:29:33.644513 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-02515e8a-7f91-4275-aac9-3eff541611a1 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Calling method '.version_select at 0x7f9e24884940>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:33.648877 n-d-master-1 devstack@n-api.service[119516]: WARNING oslo_db.sqlalchemy.utils [None req-02515e8a-7f91-4275-aac9-3eff541611a1 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 07 01:29:33.666078 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-02515e8a-7f91-4275-aac9-3eff541611a1 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] 10.222.0.39 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.026194 Aug 07 01:29:33.669077 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2130/3923] 10.222.0.39 () {60 vars in 1177 bytes} [Sun Aug 7 01:29:33 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:29:33.679730 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c3147a85-3bea-4f23-bffa-661dc3d1137f tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Calling method '.version_select at 0x7f9e297fc940>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:33.718055 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c3147a85-3bea-4f23-bffa-661dc3d1137f tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-179661128" status: 204 len: 0 microversion: 2.2 time: 0.041411 Aug 07 01:29:33.718762 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1794/3924] 10.222.0.39 () {60 vars in 1258 bytes} [Sun Aug 7 01:29:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-179661128 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:29:33.732079 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0242139e-db37-4633-b2d9-701dbc703bc5 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Action: 'create', calling method: .version_select at 0x7f9e249b5700>, body: {"keypair": {"name": "tempest-keypair-1225510867", "type": "x509"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:33.769946 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-0242139e-db37-4633-b2d9-701dbc703bc5 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Getting quotas for project 81506548c3b44b50839cbaa818db1f00. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:29:33.775985 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-0242139e-db37-4633-b2d9-701dbc703bc5 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Getting quotas for user 12e5f4dc85b34ab6947f58d305531b39 and project 81506548c3b44b50839cbaa818db1f00. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:29:33.793012 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.processutils [None req-0242139e-db37-4633-b2d9-701dbc703bc5 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp4gd1gt5y/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp4gd1gt5y/temp.key -subj /CN=12e5f4dc85b34ab6947f58d305531b39 -extensions v3_req_client {{(pid=119516) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 07 01:29:34.074649 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.processutils [None req-0242139e-db37-4633-b2d9-701dbc703bc5 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp4gd1gt5y/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp4gd1gt5y/temp.key -subj /CN=12e5f4dc85b34ab6947f58d305531b39 -extensions v3_req_client" returned: 0 in 0.281s {{(pid=119516) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 07 01:29:34.077363 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.processutils [None req-0242139e-db37-4633-b2d9-701dbc703bc5 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp4gd1gt5y/temp.key -password pass: {{(pid=119516) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 07 01:29:34.113936 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.processutils [None req-0242139e-db37-4633-b2d9-701dbc703bc5 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp4gd1gt5y/temp.key -password pass:" returned: 0 in 0.037s {{(pid=119516) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 07 01:29:34.167722 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-0242139e-db37-4633-b2d9-701dbc703bc5 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Getting quotas for project 81506548c3b44b50839cbaa818db1f00. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:29:34.174038 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-0242139e-db37-4633-b2d9-701dbc703bc5 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Getting quotas for user 12e5f4dc85b34ab6947f58d305531b39 and project 81506548c3b44b50839cbaa818db1f00. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:29:34.193800 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0242139e-db37-4633-b2d9-701dbc703bc5 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.466320 Aug 07 01:29:34.200291 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2131/3925] 10.222.0.39 () {62 vars in 1198 bytes} [Sun Aug 7 01:29:33 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 474 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:29:34.210393 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9580aeb2-d620-4e45-8939-dbcea280b8cf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:34.211200 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9580aeb2-d620-4e45-8939-dbcea280b8cf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:34.211771 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-daa2cd1f-cab7-43e6-8c22-e4f92b96e5af tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Calling method '.version_select at 0x7f9e297fc8b0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:34.219501 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9580aeb2-d620-4e45-8939-dbcea280b8cf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:34.220211 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9580aeb2-d620-4e45-8939-dbcea280b8cf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:34.220964 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9580aeb2-d620-4e45-8939-dbcea280b8cf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:34.222001 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9580aeb2-d620-4e45-8939-dbcea280b8cf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:34.222865 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9580aeb2-d620-4e45-8939-dbcea280b8cf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:34.223989 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9580aeb2-d620-4e45-8939-dbcea280b8cf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:34.243707 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-daa2cd1f-cab7-43e6-8c22-e4f92b96e5af tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] 10.222.0.39 "GET /compute/v2.1/os-keypairs/tempest-keypair-1225510867" status: 200 len: 1534 microversion: 2.2 time: 0.040931 Aug 07 01:29:34.244756 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1795/3926] 10.222.0.39 () {60 vars in 1258 bytes} [Sun Aug 7 01:29:34 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1225510867 => generated 1534 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:34.260520 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-67f36d73-d324-4551-afa1-b0edccd6a9b8 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Calling method '.version_select at 0x7f9e298001f0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:34.264773 n-d-master-1 devstack@n-api.service[119517]: WARNING oslo_db.sqlalchemy.utils [None req-67f36d73-d324-4551-afa1-b0edccd6a9b8 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 07 01:29:34.277734 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-67f36d73-d324-4551-afa1-b0edccd6a9b8 tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] 10.222.0.39 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.022774 Aug 07 01:29:34.278630 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1796/3927] 10.222.0.39 () {60 vars in 1177 bytes} [Sun Aug 7 01:29:34 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:34.290479 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-be5793eb-0905-4f12-8ff1-9f4d1fd755df tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:34.292010 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-be5793eb-0905-4f12-8ff1-9f4d1fd755df tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:34.308901 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-be5793eb-0905-4f12-8ff1-9f4d1fd755df tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:34.339519 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-be5793eb-0905-4f12-8ff1-9f4d1fd755df tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:34.339519 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-be5793eb-0905-4f12-8ff1-9f4d1fd755df tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:34.339519 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-be5793eb-0905-4f12-8ff1-9f4d1fd755df tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:34.339519 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-be5793eb-0905-4f12-8ff1-9f4d1fd755df tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:34.339519 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-be5793eb-0905-4f12-8ff1-9f4d1fd755df tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:34.534029 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-be5793eb-0905-4f12-8ff1-9f4d1fd755df tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:34.546362 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-be5793eb-0905-4f12-8ff1-9f4d1fd755df tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1674 microversion: 2.1 time: 0.264768 Aug 07 01:29:34.562626 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1797/3928] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:34 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1674 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:34.569726 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-02e2d04d-47a5-4bbd-bd3a-96f0a89f5acb tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] Calling method '.version_select at 0x7f9e242c8160>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:34.600608 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9580aeb2-d620-4e45-8939-dbcea280b8cf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:34.604504 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-02e2d04d-47a5-4bbd-bd3a-96f0a89f5acb tempest-KeyPairsV22TestJSON-2052438993 tempest-KeyPairsV22TestJSON-2052438993-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1225510867" status: 204 len: 0 microversion: 2.2 time: 0.040513 Aug 07 01:29:34.605492 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1798/3929] 10.222.0.39 () {60 vars in 1261 bytes} [Sun Aug 7 01:29:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1225510867 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:29:34.609743 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-b502592a-5220-4d77-84a9-41db6d2e54cf req-9aea308b-52d7-4544-a87e-36171197187c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aacc9718-ff8d-4ef4-8380-7d863a4b5cd1", "name": "network-vif-plugged", "status": "completed", "tag": "6eee3035-8373-408c-81bd-fa491c09b2b5"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:34.612587 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9580aeb2-d620-4e45-8939-dbcea280b8cf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1524 microversion: 2.1 time: 0.407287 Aug 07 01:29:34.613730 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2132/3930] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:34 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1524 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:34.627161 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-afa4435a-e7f4-41d0-a018-28cafcd093d0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:34.636874 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-afa4435a-e7f4-41d0-a018-28cafcd093d0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:34.651402 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-afa4435a-e7f4-41d0-a018-28cafcd093d0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:34.652001 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-afa4435a-e7f4-41d0-a018-28cafcd093d0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:34.652548 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-afa4435a-e7f4-41d0-a018-28cafcd093d0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:34.653066 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b502592a-5220-4d77-84a9-41db6d2e54cf req-9aea308b-52d7-4544-a87e-36171197187c service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:34.653447 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-afa4435a-e7f4-41d0-a018-28cafcd093d0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:34.653861 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b502592a-5220-4d77-84a9-41db6d2e54cf req-9aea308b-52d7-4544-a87e-36171197187c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:34.654026 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-afa4435a-e7f4-41d0-a018-28cafcd093d0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:34.654432 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b502592a-5220-4d77-84a9-41db6d2e54cf req-9aea308b-52d7-4544-a87e-36171197187c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:34.654629 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-afa4435a-e7f4-41d0-a018-28cafcd093d0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:34.684850 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-b502592a-5220-4d77-84a9-41db6d2e54cf req-9aea308b-52d7-4544-a87e-36171197187c service nova] Creating event network-vif-plugged:6eee3035-8373-408c-81bd-fa491c09b2b5 for instance aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 on n-h2-master-1 Aug 07 01:29:34.692662 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-b502592a-5220-4d77-84a9-41db6d2e54cf req-9aea308b-52d7-4544-a87e-36171197187c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086098 Aug 07 01:29:34.694470 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1799/3931] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:29:34.705951 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-33b05e30-51cc-4341-9514-296117faefa4 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:34.706737 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-33b05e30-51cc-4341-9514-296117faefa4 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:34.715669 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-33b05e30-51cc-4341-9514-296117faefa4 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:34.717185 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-33b05e30-51cc-4341-9514-296117faefa4 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:34.717811 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-33b05e30-51cc-4341-9514-296117faefa4 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:34.718790 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-33b05e30-51cc-4341-9514-296117faefa4 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:34.720001 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-33b05e30-51cc-4341-9514-296117faefa4 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:34.720997 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-33b05e30-51cc-4341-9514-296117faefa4 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:34.891236 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-afa4435a-e7f4-41d0-a018-28cafcd093d0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:34.905060 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-afa4435a-e7f4-41d0-a018-28cafcd093d0 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1512 microversion: 2.1 time: 0.282694 Aug 07 01:29:34.905688 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2133/3932] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:34 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1512 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:34.971212 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-33b05e30-51cc-4341-9514-296117faefa4 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:34.990735 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-33b05e30-51cc-4341-9514-296117faefa4 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1506 microversion: 2.1 time: 0.294506 Aug 07 01:29:34.991331 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1800/3933] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:34 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1506 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:35.569338 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0f0eed0e-f826-4ad0-a02d-fb20b41a00bd tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:35.570208 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0f0eed0e-f826-4ad0-a02d-fb20b41a00bd tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:35.584157 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f0eed0e-f826-4ad0-a02d-fb20b41a00bd tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:35.586789 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f0eed0e-f826-4ad0-a02d-fb20b41a00bd tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:35.588851 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f0eed0e-f826-4ad0-a02d-fb20b41a00bd tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:35.590773 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f0eed0e-f826-4ad0-a02d-fb20b41a00bd tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:35.591847 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f0eed0e-f826-4ad0-a02d-fb20b41a00bd tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:35.592809 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f0eed0e-f826-4ad0-a02d-fb20b41a00bd tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:35.643699 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9310a2dd-72a7-4f61-adb9-b4d9a0452bf0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:35.644401 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9310a2dd-72a7-4f61-adb9-b4d9a0452bf0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:35.663655 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9310a2dd-72a7-4f61-adb9-b4d9a0452bf0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:35.664481 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9310a2dd-72a7-4f61-adb9-b4d9a0452bf0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:35.665123 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9310a2dd-72a7-4f61-adb9-b4d9a0452bf0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:35.666117 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9310a2dd-72a7-4f61-adb9-b4d9a0452bf0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:35.666730 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9310a2dd-72a7-4f61-adb9-b4d9a0452bf0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:35.668297 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9310a2dd-72a7-4f61-adb9-b4d9a0452bf0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:35.826421 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0f0eed0e-f826-4ad0-a02d-fb20b41a00bd tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:35.839975 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0f0eed0e-f826-4ad0-a02d-fb20b41a00bd tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.274359 Aug 07 01:29:35.851928 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2134/3934] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:35 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:35.929676 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2d6702f4-0456-4aba-87c9-6689d4a82460 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:35.930838 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2d6702f4-0456-4aba-87c9-6689d4a82460 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:35.938985 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2d6702f4-0456-4aba-87c9-6689d4a82460 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:35.942643 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2d6702f4-0456-4aba-87c9-6689d4a82460 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:35.943624 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2d6702f4-0456-4aba-87c9-6689d4a82460 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:35.945066 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2d6702f4-0456-4aba-87c9-6689d4a82460 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:35.945803 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2d6702f4-0456-4aba-87c9-6689d4a82460 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:35.946446 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2d6702f4-0456-4aba-87c9-6689d4a82460 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:36.136352 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2d6702f4-0456-4aba-87c9-6689d4a82460 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:36.145447 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2d6702f4-0456-4aba-87c9-6689d4a82460 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1512 microversion: 2.1 time: 0.220376 Aug 07 01:29:36.147737 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2135/3935] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:35 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1512 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:29:36.154433 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8d4f98a0-c3f6-47c9-b93f-1eb01ec88aa6 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:36.155746 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8d4f98a0-c3f6-47c9-b93f-1eb01ec88aa6 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:36.167263 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d4f98a0-c3f6-47c9-b93f-1eb01ec88aa6 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:36.167263 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d4f98a0-c3f6-47c9-b93f-1eb01ec88aa6 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:36.176193 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d4f98a0-c3f6-47c9-b93f-1eb01ec88aa6 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:36.178677 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d4f98a0-c3f6-47c9-b93f-1eb01ec88aa6 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:36.179320 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d4f98a0-c3f6-47c9-b93f-1eb01ec88aa6 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:36.180654 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d4f98a0-c3f6-47c9-b93f-1eb01ec88aa6 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:36.679498 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8d4f98a0-c3f6-47c9-b93f-1eb01ec88aa6 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:36.702679 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8d4f98a0-c3f6-47c9-b93f-1eb01ec88aa6 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1506 microversion: 2.1 time: 0.553419 Aug 07 01:29:36.708477 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2136/3936] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:36 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1506 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:36.947559 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9310a2dd-72a7-4f61-adb9-b4d9a0452bf0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:36.963695 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9310a2dd-72a7-4f61-adb9-b4d9a0452bf0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1524 microversion: 2.1 time: 1.328368 Aug 07 01:29:36.972473 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1801/3937] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:35 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1524 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:37.171927 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6320a3ed-4306-456c-84bf-7bde9313d83c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:37.173071 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6320a3ed-4306-456c-84bf-7bde9313d83c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:37.190477 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6320a3ed-4306-456c-84bf-7bde9313d83c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:37.191648 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6320a3ed-4306-456c-84bf-7bde9313d83c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:37.192225 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6320a3ed-4306-456c-84bf-7bde9313d83c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:37.193156 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6320a3ed-4306-456c-84bf-7bde9313d83c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:37.193742 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6320a3ed-4306-456c-84bf-7bde9313d83c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:37.195753 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6320a3ed-4306-456c-84bf-7bde9313d83c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:37.567424 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6320a3ed-4306-456c-84bf-7bde9313d83c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:37.581065 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6320a3ed-4306-456c-84bf-7bde9313d83c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1512 microversion: 2.1 time: 0.410812 Aug 07 01:29:37.581822 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2137/3938] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:37 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1512 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:37.733324 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-664df8da-1226-4bca-8760-df95cda92f51 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:37.734321 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-664df8da-1226-4bca-8760-df95cda92f51 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:37.741751 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-664df8da-1226-4bca-8760-df95cda92f51 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:37.742586 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-664df8da-1226-4bca-8760-df95cda92f51 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:37.743223 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-664df8da-1226-4bca-8760-df95cda92f51 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:37.744813 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-664df8da-1226-4bca-8760-df95cda92f51 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:37.745474 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-664df8da-1226-4bca-8760-df95cda92f51 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:37.746099 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-664df8da-1226-4bca-8760-df95cda92f51 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:38.004087 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e6cee815-3e00-4485-aaeb-03ded7450b81 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:38.004983 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e6cee815-3e00-4485-aaeb-03ded7450b81 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:38.033818 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6cee815-3e00-4485-aaeb-03ded7450b81 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:38.034602 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6cee815-3e00-4485-aaeb-03ded7450b81 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:38.035291 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6cee815-3e00-4485-aaeb-03ded7450b81 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:38.036883 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6cee815-3e00-4485-aaeb-03ded7450b81 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:38.037613 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6cee815-3e00-4485-aaeb-03ded7450b81 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:38.038198 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6cee815-3e00-4485-aaeb-03ded7450b81 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:38.137140 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-664df8da-1226-4bca-8760-df95cda92f51 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:38.150848 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-664df8da-1226-4bca-8760-df95cda92f51 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1506 microversion: 2.1 time: 0.421028 Aug 07 01:29:38.171025 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1802/3939] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:37 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1506 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:38.605014 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cad0adbd-e859-41b1-bbf4-23404176d55b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:38.605815 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-cad0adbd-e859-41b1-bbf4-23404176d55b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:38.613989 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cad0adbd-e859-41b1-bbf4-23404176d55b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:38.615228 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cad0adbd-e859-41b1-bbf4-23404176d55b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:38.616322 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cad0adbd-e859-41b1-bbf4-23404176d55b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:38.619099 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cad0adbd-e859-41b1-bbf4-23404176d55b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:38.619739 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cad0adbd-e859-41b1-bbf4-23404176d55b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:38.620966 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cad0adbd-e859-41b1-bbf4-23404176d55b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:38.703194 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e6cee815-3e00-4485-aaeb-03ded7450b81 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:38.719330 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e6cee815-3e00-4485-aaeb-03ded7450b81 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1524 microversion: 2.1 time: 0.723588 Aug 07 01:29:38.720466 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2138/3940] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:37 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1524 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:39.044134 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-cad0adbd-e859-41b1-bbf4-23404176d55b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:39.052471 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cad0adbd-e859-41b1-bbf4-23404176d55b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1533 microversion: 2.1 time: 0.452657 Aug 07 01:29:39.052996 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1803/3941] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:38 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1533 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:29:39.183956 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-09273e4f-7ffd-4661-937d-591ed18c0754 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:39.186594 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-09273e4f-7ffd-4661-937d-591ed18c0754 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:39.194257 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-09273e4f-7ffd-4661-937d-591ed18c0754 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:39.195805 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-09273e4f-7ffd-4661-937d-591ed18c0754 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:39.197484 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-09273e4f-7ffd-4661-937d-591ed18c0754 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:39.198441 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-09273e4f-7ffd-4661-937d-591ed18c0754 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:39.199140 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-09273e4f-7ffd-4661-937d-591ed18c0754 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:39.199789 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-09273e4f-7ffd-4661-937d-591ed18c0754 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:39.745239 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-86d2f04d-79b7-426b-9e57-a2de7f6199d4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:39.747158 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-86d2f04d-79b7-426b-9e57-a2de7f6199d4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:39.760518 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-86d2f04d-79b7-426b-9e57-a2de7f6199d4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:39.770108 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-86d2f04d-79b7-426b-9e57-a2de7f6199d4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:39.771168 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-86d2f04d-79b7-426b-9e57-a2de7f6199d4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:39.772229 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-86d2f04d-79b7-426b-9e57-a2de7f6199d4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:39.773320 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-86d2f04d-79b7-426b-9e57-a2de7f6199d4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:39.773985 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-86d2f04d-79b7-426b-9e57-a2de7f6199d4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:39.954900 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-09273e4f-7ffd-4661-937d-591ed18c0754 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:39.968635 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-09273e4f-7ffd-4661-937d-591ed18c0754 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1506 microversion: 2.1 time: 0.790377 Aug 07 01:29:39.969283 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2139/3942] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:39 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1506 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:40.075591 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7cfb041a-8056-48fc-a201-b37afad86fef tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:40.076516 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7cfb041a-8056-48fc-a201-b37afad86fef tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:40.084775 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7cfb041a-8056-48fc-a201-b37afad86fef tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:40.085645 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7cfb041a-8056-48fc-a201-b37afad86fef tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:40.086238 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7cfb041a-8056-48fc-a201-b37afad86fef tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:40.087115 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7cfb041a-8056-48fc-a201-b37afad86fef tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:40.088260 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7cfb041a-8056-48fc-a201-b37afad86fef tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:40.088919 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7cfb041a-8056-48fc-a201-b37afad86fef tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:40.229145 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-86d2f04d-79b7-426b-9e57-a2de7f6199d4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:40.239146 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-86d2f04d-79b7-426b-9e57-a2de7f6199d4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1524 microversion: 2.1 time: 0.498459 Aug 07 01:29:40.255927 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1804/3943] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:39 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1524 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:40.524012 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7cfb041a-8056-48fc-a201-b37afad86fef tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:40.536809 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7cfb041a-8056-48fc-a201-b37afad86fef tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1533 microversion: 2.1 time: 0.465920 Aug 07 01:29:40.554658 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2140/3944] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:40 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1533 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:29:40.997588 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-582a1ca0-b935-4e71-aead-55e2cb29c7fd tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:40.998820 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-582a1ca0-b935-4e71-aead-55e2cb29c7fd tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:41.011820 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-582a1ca0-b935-4e71-aead-55e2cb29c7fd tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:41.013740 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-582a1ca0-b935-4e71-aead-55e2cb29c7fd tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:41.043310 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-582a1ca0-b935-4e71-aead-55e2cb29c7fd tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:41.054584 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-582a1ca0-b935-4e71-aead-55e2cb29c7fd tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:41.055365 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-582a1ca0-b935-4e71-aead-55e2cb29c7fd tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:41.056665 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-582a1ca0-b935-4e71-aead-55e2cb29c7fd tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:41.263333 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ca2d0491-444b-4a3e-82d5-a581c1683aff tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:41.264169 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ca2d0491-444b-4a3e-82d5-a581c1683aff tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:41.279904 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca2d0491-444b-4a3e-82d5-a581c1683aff tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:41.282101 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca2d0491-444b-4a3e-82d5-a581c1683aff tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:41.283524 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca2d0491-444b-4a3e-82d5-a581c1683aff tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:41.284667 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca2d0491-444b-4a3e-82d5-a581c1683aff tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:41.287402 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca2d0491-444b-4a3e-82d5-a581c1683aff tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:41.296299 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca2d0491-444b-4a3e-82d5-a581c1683aff tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:41.650855 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-582a1ca0-b935-4e71-aead-55e2cb29c7fd tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:41.662902 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-582a1ca0-b935-4e71-aead-55e2cb29c7fd tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1506 microversion: 2.1 time: 0.672561 Aug 07 01:29:41.678602 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1805/3945] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:40 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1506 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:41.691410 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d3872abe-0846-46e5-9cbb-acb7258268e9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:41.692387 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d3872abe-0846-46e5-9cbb-acb7258268e9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:41.701817 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d3872abe-0846-46e5-9cbb-acb7258268e9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:41.703095 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d3872abe-0846-46e5-9cbb-acb7258268e9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:41.703826 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d3872abe-0846-46e5-9cbb-acb7258268e9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:41.706842 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d3872abe-0846-46e5-9cbb-acb7258268e9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:41.707452 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d3872abe-0846-46e5-9cbb-acb7258268e9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:41.708236 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d3872abe-0846-46e5-9cbb-acb7258268e9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:41.916364 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ca2d0491-444b-4a3e-82d5-a581c1683aff tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:41.926738 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ca2d0491-444b-4a3e-82d5-a581c1683aff tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1524 microversion: 2.1 time: 0.668619 Aug 07 01:29:41.932462 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2141/3946] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:41 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1524 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:29:42.689757 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4411b251-77fc-4c4b-a231-4d991b2d4901 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:42.691461 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4411b251-77fc-4c4b-a231-4d991b2d4901 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:42.702668 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4411b251-77fc-4c4b-a231-4d991b2d4901 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:42.705721 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4411b251-77fc-4c4b-a231-4d991b2d4901 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:42.706469 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4411b251-77fc-4c4b-a231-4d991b2d4901 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:42.709383 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4411b251-77fc-4c4b-a231-4d991b2d4901 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:42.710135 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4411b251-77fc-4c4b-a231-4d991b2d4901 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:42.717330 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4411b251-77fc-4c4b-a231-4d991b2d4901 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:43.049024 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d3872abe-0846-46e5-9cbb-acb7258268e9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:43.062741 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d3872abe-0846-46e5-9cbb-acb7258268e9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1528 microversion: 2.1 time: 1.378021 Aug 07 01:29:43.078204 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1806/3947] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:41 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1528 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:43.078204 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-b38bb47d-5740-4dc1-85d3-86399c4d9835 req-3b9bc88d-b8e3-4abb-ae6b-f0ac7508ccd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9b1883a-c95a-4c49-ad6d-335ecf03b015", "name": "network-vif-plugged", "status": "completed", "tag": "cb3c2bf2-1cb1-4779-8b61-f6d977daac69"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:43.105216 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b38bb47d-5740-4dc1-85d3-86399c4d9835 req-3b9bc88d-b8e3-4abb-ae6b-f0ac7508ccd4 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:43.105711 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b38bb47d-5740-4dc1-85d3-86399c4d9835 req-3b9bc88d-b8e3-4abb-ae6b-f0ac7508ccd4 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:43.109911 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b38bb47d-5740-4dc1-85d3-86399c4d9835 req-3b9bc88d-b8e3-4abb-ae6b-f0ac7508ccd4 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:43.138195 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-b38bb47d-5740-4dc1-85d3-86399c4d9835 req-3b9bc88d-b8e3-4abb-ae6b-f0ac7508ccd4 service nova] Creating event network-vif-plugged:cb3c2bf2-1cb1-4779-8b61-f6d977daac69 for instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 on n-h2-master-1 Aug 07 01:29:43.153648 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-b38bb47d-5740-4dc1-85d3-86399c4d9835 req-3b9bc88d-b8e3-4abb-ae6b-f0ac7508ccd4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085054 Aug 07 01:29:43.154679 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1807/3948] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:29:43.168348 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-be04929b-88ca-463f-b464-59db26568d92 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:43.169068 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-be04929b-88ca-463f-b464-59db26568d92 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:43.175914 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4411b251-77fc-4c4b-a231-4d991b2d4901 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:43.186018 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4411b251-77fc-4c4b-a231-4d991b2d4901 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1506 microversion: 2.1 time: 0.500428 Aug 07 01:29:43.186635 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2142/3949] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:42 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1506 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:43.200072 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-be04929b-88ca-463f-b464-59db26568d92 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:43.200072 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-be04929b-88ca-463f-b464-59db26568d92 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:43.200072 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-be04929b-88ca-463f-b464-59db26568d92 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:43.200072 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-be04929b-88ca-463f-b464-59db26568d92 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:43.200072 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-be04929b-88ca-463f-b464-59db26568d92 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:43.200072 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-be04929b-88ca-463f-b464-59db26568d92 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:43.572300 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=28 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:43.755170 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-be04929b-88ca-463f-b464-59db26568d92 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:43.777583 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-be04929b-88ca-463f-b464-59db26568d92 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1524 microversion: 2.1 time: 0.619692 Aug 07 01:29:43.780965 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1808/3950] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:43 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1524 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:44.088910 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-06479472-d7b5-4073-93e8-1620eb00eb1f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:44.089966 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-06479472-d7b5-4073-93e8-1620eb00eb1f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:44.106968 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-06479472-d7b5-4073-93e8-1620eb00eb1f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:44.107590 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-06479472-d7b5-4073-93e8-1620eb00eb1f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:44.116305 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-06479472-d7b5-4073-93e8-1620eb00eb1f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:44.117201 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-06479472-d7b5-4073-93e8-1620eb00eb1f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:44.117696 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-06479472-d7b5-4073-93e8-1620eb00eb1f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:44.118148 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-06479472-d7b5-4073-93e8-1620eb00eb1f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:44.193817 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=8 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:44.210564 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-354c7bc6-97f7-4092-a668-390b36bb0635 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:44.211970 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-354c7bc6-97f7-4092-a668-390b36bb0635 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:44.230278 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-354c7bc6-97f7-4092-a668-390b36bb0635 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:44.230773 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-354c7bc6-97f7-4092-a668-390b36bb0635 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:44.231212 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-354c7bc6-97f7-4092-a668-390b36bb0635 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:44.242112 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-354c7bc6-97f7-4092-a668-390b36bb0635 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:44.242879 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-354c7bc6-97f7-4092-a668-390b36bb0635 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:44.252613 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-354c7bc6-97f7-4092-a668-390b36bb0635 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:44.522450 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-354c7bc6-97f7-4092-a668-390b36bb0635 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:44.537402 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-354c7bc6-97f7-4092-a668-390b36bb0635 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1506 microversion: 2.1 time: 0.330493 Aug 07 01:29:44.547918 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1809/3951] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:44 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1506 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:44.802332 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e89dbca6-7533-4106-846c-22295469c071 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:44.802872 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e89dbca6-7533-4106-846c-22295469c071 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:44.819765 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e89dbca6-7533-4106-846c-22295469c071 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:44.820776 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e89dbca6-7533-4106-846c-22295469c071 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:44.821598 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e89dbca6-7533-4106-846c-22295469c071 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:44.822986 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e89dbca6-7533-4106-846c-22295469c071 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:44.827700 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e89dbca6-7533-4106-846c-22295469c071 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:44.828863 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e89dbca6-7533-4106-846c-22295469c071 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:45.217791 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e89dbca6-7533-4106-846c-22295469c071 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:45.233715 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e89dbca6-7533-4106-846c-22295469c071 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1524 microversion: 2.1 time: 0.435503 Aug 07 01:29:45.234870 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1810/3952] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:44 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1524 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:29:45.561614 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0d814fa5-e9f0-4aa4-8f6a-8a5efc3a0755 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:45.562621 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0d814fa5-e9f0-4aa4-8f6a-8a5efc3a0755 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:45.614374 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d814fa5-e9f0-4aa4-8f6a-8a5efc3a0755 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:45.615235 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d814fa5-e9f0-4aa4-8f6a-8a5efc3a0755 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:45.615953 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d814fa5-e9f0-4aa4-8f6a-8a5efc3a0755 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:45.616937 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d814fa5-e9f0-4aa4-8f6a-8a5efc3a0755 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:45.617686 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d814fa5-e9f0-4aa4-8f6a-8a5efc3a0755 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:45.619033 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d814fa5-e9f0-4aa4-8f6a-8a5efc3a0755 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:45.976607 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0d814fa5-e9f0-4aa4-8f6a-8a5efc3a0755 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:45.992358 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0d814fa5-e9f0-4aa4-8f6a-8a5efc3a0755 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1506 microversion: 2.1 time: 0.434706 Aug 07 01:29:46.001184 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1811/3953] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:45 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1506 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:46.043179 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-06479472-d7b5-4073-93e8-1620eb00eb1f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:46.053613 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-06479472-d7b5-4073-93e8-1620eb00eb1f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1528 microversion: 2.1 time: 1.971532 Aug 07 01:29:46.070559 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2143/3954] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:44 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1528 bytes in 1989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:46.262060 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-13bc2fdf-0c74-4e5b-89b9-6f2e5356e55e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:46.262611 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-13bc2fdf-0c74-4e5b-89b9-6f2e5356e55e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:46.291550 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13bc2fdf-0c74-4e5b-89b9-6f2e5356e55e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:46.294052 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13bc2fdf-0c74-4e5b-89b9-6f2e5356e55e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:46.294662 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13bc2fdf-0c74-4e5b-89b9-6f2e5356e55e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:46.299235 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13bc2fdf-0c74-4e5b-89b9-6f2e5356e55e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:46.301319 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13bc2fdf-0c74-4e5b-89b9-6f2e5356e55e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:46.306918 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-13bc2fdf-0c74-4e5b-89b9-6f2e5356e55e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:47.002605 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-13bc2fdf-0c74-4e5b-89b9-6f2e5356e55e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:47.010918 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-13bc2fdf-0c74-4e5b-89b9-6f2e5356e55e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1524 microversion: 2.1 time: 0.754188 Aug 07 01:29:47.022498 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4515ac27-6c73-4260-8aac-ed0ee629f0d7 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:47.023126 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4515ac27-6c73-4260-8aac-ed0ee629f0d7 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:47.032950 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1812/3955] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:46 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1524 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:47.038408 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4515ac27-6c73-4260-8aac-ed0ee629f0d7 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:47.046040 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4515ac27-6c73-4260-8aac-ed0ee629f0d7 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:47.047348 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4515ac27-6c73-4260-8aac-ed0ee629f0d7 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:47.048310 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4515ac27-6c73-4260-8aac-ed0ee629f0d7 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:47.049001 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4515ac27-6c73-4260-8aac-ed0ee629f0d7 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:47.053494 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4515ac27-6c73-4260-8aac-ed0ee629f0d7 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:47.077983 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4b284cb0-41b4-43ed-8b43-eca3bb23c393 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:47.078869 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4b284cb0-41b4-43ed-8b43-eca3bb23c393 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:47.091923 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b284cb0-41b4-43ed-8b43-eca3bb23c393 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:47.102437 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b284cb0-41b4-43ed-8b43-eca3bb23c393 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:47.103045 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b284cb0-41b4-43ed-8b43-eca3bb23c393 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:47.103812 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b284cb0-41b4-43ed-8b43-eca3bb23c393 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:47.113405 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b284cb0-41b4-43ed-8b43-eca3bb23c393 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:47.113873 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b284cb0-41b4-43ed-8b43-eca3bb23c393 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:47.171876 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:47.585189 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4b284cb0-41b4-43ed-8b43-eca3bb23c393 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:47.605814 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4b284cb0-41b4-43ed-8b43-eca3bb23c393 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1528 microversion: 2.1 time: 0.522657 Aug 07 01:29:47.606561 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1813/3956] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:47 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1528 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:29:47.644296 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4515ac27-6c73-4260-8aac-ed0ee629f0d7 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:47.660584 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4515ac27-6c73-4260-8aac-ed0ee629f0d7 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1506 microversion: 2.1 time: 0.639364 Aug 07 01:29:47.677844 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2144/3957] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:47 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1506 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:29:48.061755 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bca446a9-668a-4e2e-a656-97e0e26115bf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:48.062454 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bca446a9-668a-4e2e-a656-97e0e26115bf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:48.085924 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bca446a9-668a-4e2e-a656-97e0e26115bf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:48.086794 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bca446a9-668a-4e2e-a656-97e0e26115bf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:48.087493 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bca446a9-668a-4e2e-a656-97e0e26115bf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:48.088482 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bca446a9-668a-4e2e-a656-97e0e26115bf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:48.089122 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bca446a9-668a-4e2e-a656-97e0e26115bf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:48.089710 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bca446a9-668a-4e2e-a656-97e0e26115bf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:48.499382 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bca446a9-668a-4e2e-a656-97e0e26115bf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:48.514673 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bca446a9-668a-4e2e-a656-97e0e26115bf tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1524 microversion: 2.1 time: 0.456699 Aug 07 01:29:48.534215 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1814/3958] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:48 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1524 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:48.627775 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2314f59d-0bf8-4a77-bd2a-851dd2f41f79 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:48.629871 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2314f59d-0bf8-4a77-bd2a-851dd2f41f79 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:48.656595 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2314f59d-0bf8-4a77-bd2a-851dd2f41f79 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:48.657380 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2314f59d-0bf8-4a77-bd2a-851dd2f41f79 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:48.657969 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2314f59d-0bf8-4a77-bd2a-851dd2f41f79 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:48.659340 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2314f59d-0bf8-4a77-bd2a-851dd2f41f79 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:48.660092 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2314f59d-0bf8-4a77-bd2a-851dd2f41f79 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:48.661244 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2314f59d-0bf8-4a77-bd2a-851dd2f41f79 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:48.690128 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b5b04aed-0e93-4da8-a90d-59b6c80bfb27 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:48.691492 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b5b04aed-0e93-4da8-a90d-59b6c80bfb27 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:48.705403 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5b04aed-0e93-4da8-a90d-59b6c80bfb27 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:48.706263 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5b04aed-0e93-4da8-a90d-59b6c80bfb27 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:48.721063 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5b04aed-0e93-4da8-a90d-59b6c80bfb27 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:48.722253 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5b04aed-0e93-4da8-a90d-59b6c80bfb27 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:48.723057 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5b04aed-0e93-4da8-a90d-59b6c80bfb27 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:48.723721 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5b04aed-0e93-4da8-a90d-59b6c80bfb27 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:48.733880 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:49.075459 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b5b04aed-0e93-4da8-a90d-59b6c80bfb27 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:49.091621 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b5b04aed-0e93-4da8-a90d-59b6c80bfb27 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1506 microversion: 2.1 time: 0.407865 Aug 07 01:29:49.108012 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1815/3959] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:48 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1506 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:49.546227 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-adbab187-076a-40fd-9e7e-634cc2c97498 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:49.547153 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-adbab187-076a-40fd-9e7e-634cc2c97498 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:49.564412 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-adbab187-076a-40fd-9e7e-634cc2c97498 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:49.592155 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-adbab187-076a-40fd-9e7e-634cc2c97498 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:49.592796 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-adbab187-076a-40fd-9e7e-634cc2c97498 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:49.593919 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-adbab187-076a-40fd-9e7e-634cc2c97498 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:49.594509 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-adbab187-076a-40fd-9e7e-634cc2c97498 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:49.595180 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-adbab187-076a-40fd-9e7e-634cc2c97498 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:49.672736 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2314f59d-0bf8-4a77-bd2a-851dd2f41f79 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:49.686853 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2314f59d-0bf8-4a77-bd2a-851dd2f41f79 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1528 microversion: 2.1 time: 1.062984 Aug 07 01:29:49.701430 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2145/3960] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:48 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1528 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:49.952595 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-adbab187-076a-40fd-9e7e-634cc2c97498 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:49.964571 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-adbab187-076a-40fd-9e7e-634cc2c97498 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1524 microversion: 2.1 time: 0.422798 Aug 07 01:29:49.975205 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1816/3961] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:49 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1524 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:29:50.124699 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7f925122-21a5-43c0-b2bc-b7c7f2861301 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:50.127300 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7f925122-21a5-43c0-b2bc-b7c7f2861301 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:50.149446 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:50.168327 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f925122-21a5-43c0-b2bc-b7c7f2861301 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:50.170429 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f925122-21a5-43c0-b2bc-b7c7f2861301 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:50.172590 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f925122-21a5-43c0-b2bc-b7c7f2861301 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:50.176745 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f925122-21a5-43c0-b2bc-b7c7f2861301 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:50.177623 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f925122-21a5-43c0-b2bc-b7c7f2861301 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:50.182796 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f925122-21a5-43c0-b2bc-b7c7f2861301 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:50.628938 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7f925122-21a5-43c0-b2bc-b7c7f2861301 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:50.641777 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7f925122-21a5-43c0-b2bc-b7c7f2861301 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1506 microversion: 2.1 time: 0.523491 Aug 07 01:29:50.642935 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2146/3962] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:50 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1506 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:50.647856 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e2be6aa3-cedb-4e3c-8d98-534635a6bac2 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-712763339", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "49ed1b6c-d367-41b9-9377-24ae364943cd"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:50.716293 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cc83cb38-581f-43fb-818d-277925ea9d4b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:50.716912 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cc83cb38-581f-43fb-818d-277925ea9d4b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:50.743936 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc83cb38-581f-43fb-818d-277925ea9d4b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:50.744833 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc83cb38-581f-43fb-818d-277925ea9d4b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:50.745435 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc83cb38-581f-43fb-818d-277925ea9d4b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:50.746324 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc83cb38-581f-43fb-818d-277925ea9d4b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:50.751975 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc83cb38-581f-43fb-818d-277925ea9d4b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:50.752632 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc83cb38-581f-43fb-818d-277925ea9d4b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:51.201818 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cc83cb38-581f-43fb-818d-277925ea9d4b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:51.213384 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cc83cb38-581f-43fb-818d-277925ea9d4b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1528 microversion: 2.1 time: 0.498439 Aug 07 01:29:51.214383 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2147/3963] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:50 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1528 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:51.231957 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c9edb05e-d281-4620-aaca-0842cb814fa7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:51.240301 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c9edb05e-d281-4620-aaca-0842cb814fa7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:51.251930 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c9edb05e-d281-4620-aaca-0842cb814fa7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:51.264703 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c9edb05e-d281-4620-aaca-0842cb814fa7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:51.267553 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c9edb05e-d281-4620-aaca-0842cb814fa7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:51.272690 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c9edb05e-d281-4620-aaca-0842cb814fa7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:51.275822 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c9edb05e-d281-4620-aaca-0842cb814fa7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:51.278487 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c9edb05e-d281-4620-aaca-0842cb814fa7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:51.703834 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c9edb05e-d281-4620-aaca-0842cb814fa7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:51.715624 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c9edb05e-d281-4620-aaca-0842cb814fa7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1524 microversion: 2.1 time: 0.499784 Aug 07 01:29:51.720893 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2148/3964] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:51 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1524 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:51.757903 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d68ace59-038f-46c6-a75c-62550d1f00cf tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:51.758596 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d68ace59-038f-46c6-a75c-62550d1f00cf tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:51.778823 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d68ace59-038f-46c6-a75c-62550d1f00cf tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:51.783531 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d68ace59-038f-46c6-a75c-62550d1f00cf tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:51.785712 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d68ace59-038f-46c6-a75c-62550d1f00cf tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:51.790682 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d68ace59-038f-46c6-a75c-62550d1f00cf tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:51.791569 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d68ace59-038f-46c6-a75c-62550d1f00cf tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:51.794175 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d68ace59-038f-46c6-a75c-62550d1f00cf tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:52.244084 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d68ace59-038f-46c6-a75c-62550d1f00cf tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:52.256450 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d68ace59-038f-46c6-a75c-62550d1f00cf tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1506 microversion: 2.1 time: 0.533009 Aug 07 01:29:52.274113 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2149/3965] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:51 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1506 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:52.284706 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6d46eb73-d5b5-4842-bfa2-5172eefae6a4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:52.286997 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6d46eb73-d5b5-4842-bfa2-5172eefae6a4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:52.297826 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6d46eb73-d5b5-4842-bfa2-5172eefae6a4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:52.298621 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6d46eb73-d5b5-4842-bfa2-5172eefae6a4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:52.299396 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6d46eb73-d5b5-4842-bfa2-5172eefae6a4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:52.300357 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6d46eb73-d5b5-4842-bfa2-5172eefae6a4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:52.301026 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6d46eb73-d5b5-4842-bfa2-5172eefae6a4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:52.301721 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6d46eb73-d5b5-4842-bfa2-5172eefae6a4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:52.516710 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6d46eb73-d5b5-4842-bfa2-5172eefae6a4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:52.530066 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6d46eb73-d5b5-4842-bfa2-5172eefae6a4 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1528 microversion: 2.1 time: 0.253883 Aug 07 01:29:52.553126 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2150/3966] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:52 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1528 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:52.741890 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-537ce739-5d7f-4891-9a53-eae419bc48da tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:52.744121 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-537ce739-5d7f-4891-9a53-eae419bc48da tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:52.764209 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-537ce739-5d7f-4891-9a53-eae419bc48da tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:52.765037 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-537ce739-5d7f-4891-9a53-eae419bc48da tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:52.765733 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-537ce739-5d7f-4891-9a53-eae419bc48da tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:52.766888 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-537ce739-5d7f-4891-9a53-eae419bc48da tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:52.767602 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-537ce739-5d7f-4891-9a53-eae419bc48da tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:52.768291 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-537ce739-5d7f-4891-9a53-eae419bc48da tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:53.117214 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-537ce739-5d7f-4891-9a53-eae419bc48da tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:53.144076 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-537ce739-5d7f-4891-9a53-eae419bc48da tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1524 microversion: 2.1 time: 0.404930 Aug 07 01:29:53.146875 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2151/3967] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:52 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1524 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:29:53.152915 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-e2be6aa3-cedb-4e3c-8d98-534635a6bac2 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] validate_networks() for [('49ed1b6c-d367-41b9-9377-24ae364943cd', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:29:53.283741 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e4f83bda-df2d-46ed-ac1e-2e3ba1472525 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:53.284637 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e4f83bda-df2d-46ed-ac1e-2e3ba1472525 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:53.297933 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4f83bda-df2d-46ed-ac1e-2e3ba1472525 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:53.302835 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4f83bda-df2d-46ed-ac1e-2e3ba1472525 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:53.316396 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4f83bda-df2d-46ed-ac1e-2e3ba1472525 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:53.323847 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4f83bda-df2d-46ed-ac1e-2e3ba1472525 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:53.326022 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4f83bda-df2d-46ed-ac1e-2e3ba1472525 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:53.326598 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4f83bda-df2d-46ed-ac1e-2e3ba1472525 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:53.544689 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e4f83bda-df2d-46ed-ac1e-2e3ba1472525 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:53.558078 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e4f83bda-df2d-46ed-ac1e-2e3ba1472525 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1506 microversion: 2.1 time: 0.275452 Aug 07 01:29:53.583796 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2152/3968] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:53 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1506 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:53.589596 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ca49e4ca-304c-4909-a924-b266d1dd413d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:53.590232 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ca49e4ca-304c-4909-a924-b266d1dd413d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:53.596964 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca49e4ca-304c-4909-a924-b266d1dd413d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:53.597339 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca49e4ca-304c-4909-a924-b266d1dd413d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:53.597792 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca49e4ca-304c-4909-a924-b266d1dd413d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:53.598528 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca49e4ca-304c-4909-a924-b266d1dd413d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:53.598997 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca49e4ca-304c-4909-a924-b266d1dd413d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:53.599438 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca49e4ca-304c-4909-a924-b266d1dd413d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:53.837420 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ca49e4ca-304c-4909-a924-b266d1dd413d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:53.849135 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ca49e4ca-304c-4909-a924-b266d1dd413d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1528 microversion: 2.1 time: 0.264099 Aug 07 01:29:53.849983 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2153/3969] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:53 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1528 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:54.172605 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fe30ac92-f2da-46b2-bb30-b94728abd00c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:54.173483 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fe30ac92-f2da-46b2-bb30-b94728abd00c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:54.188697 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe30ac92-f2da-46b2-bb30-b94728abd00c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:54.189199 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe30ac92-f2da-46b2-bb30-b94728abd00c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:54.194476 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe30ac92-f2da-46b2-bb30-b94728abd00c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:54.195423 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe30ac92-f2da-46b2-bb30-b94728abd00c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:54.195998 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe30ac92-f2da-46b2-bb30-b94728abd00c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:54.196451 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe30ac92-f2da-46b2-bb30-b94728abd00c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:54.394431 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-e2be6aa3-cedb-4e3c-8d98-534635a6bac2 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:29:54.396063 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-e2be6aa3-cedb-4e3c-8d98-534635a6bac2 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:29:54.398052 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-e2be6aa3-cedb-4e3c-8d98-534635a6bac2 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:29:54.400171 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-e2be6aa3-cedb-4e3c-8d98-534635a6bac2 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:29:54.402074 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-e2be6aa3-cedb-4e3c-8d98-534635a6bac2 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:29:54.427337 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e2be6aa3-cedb-4e3c-8d98-534635a6bac2 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:54.428178 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e2be6aa3-cedb-4e3c-8d98-534635a6bac2 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:54.428884 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e2be6aa3-cedb-4e3c-8d98-534635a6bac2 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:54.429970 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e2be6aa3-cedb-4e3c-8d98-534635a6bac2 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:54.430727 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e2be6aa3-cedb-4e3c-8d98-534635a6bac2 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:54.431396 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e2be6aa3-cedb-4e3c-8d98-534635a6bac2 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:54.514923 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-e2be6aa3-cedb-4e3c-8d98-534635a6bac2 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Getting quotas for project 2cbe49718bfe40c5b0f9587413635a2e. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:29:54.551317 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-e2be6aa3-cedb-4e3c-8d98-534635a6bac2 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Getting quotas for user 12d82ae0bf5f46668b0ff0e38ad77674 and project 2cbe49718bfe40c5b0f9587413635a2e. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:29:54.582540 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e2be6aa3-cedb-4e3c-8d98-534635a6bac2 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:29:54.591057 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e2be6aa3-cedb-4e3c-8d98-534635a6bac2 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] [instance: f2db3d5e-a955-44c7-8714-1f280d7a0a4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:29:54.620927 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fe30ac92-f2da-46b2-bb30-b94728abd00c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:54.631481 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fe30ac92-f2da-46b2-bb30-b94728abd00c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1506 microversion: 2.1 time: 0.464326 Aug 07 01:29:54.652138 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2154/3970] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:54 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1506 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:54.657531 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a103bccc-7614-4b90-b750-aaa955bbd70f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:54.658191 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a103bccc-7614-4b90-b750-aaa955bbd70f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:54.674458 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a103bccc-7614-4b90-b750-aaa955bbd70f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:54.675219 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a103bccc-7614-4b90-b750-aaa955bbd70f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:54.675868 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a103bccc-7614-4b90-b750-aaa955bbd70f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:54.676856 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a103bccc-7614-4b90-b750-aaa955bbd70f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:54.680606 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a103bccc-7614-4b90-b750-aaa955bbd70f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:54.681373 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a103bccc-7614-4b90-b750-aaa955bbd70f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:54.736001 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e2be6aa3-cedb-4e3c-8d98-534635a6bac2 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 4.191350 Aug 07 01:29:54.753583 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1817/3971] 10.222.0.39 () {62 vars in 1188 bytes} [Sun Aug 7 01:29:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 4213 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 07 01:29:54.775803 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-40e4ac0a-6a40-4d28-916a-d12eb2022ded tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:54.777849 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-40e4ac0a-6a40-4d28-916a-d12eb2022ded tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] [instance: f2db3d5e-a955-44c7-8714-1f280d7a0a4f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:54.891278 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-40e4ac0a-6a40-4d28-916a-d12eb2022ded tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:54.911270 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-40e4ac0a-6a40-4d28-916a-d12eb2022ded tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:54.916645 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-40e4ac0a-6a40-4d28-916a-d12eb2022ded tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:54.920283 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-40e4ac0a-6a40-4d28-916a-d12eb2022ded tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] 10.222.0.39 "GET /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f" status: 200 len: 1258 microversion: 2.21 time: 0.165305 Aug 07 01:29:54.921093 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1818/3972] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:29:54 2022] GET /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:29:54.935042 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2343e33b-edab-4378-9966-4bbc26977497 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:54.936135 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2343e33b-edab-4378-9966-4bbc26977497 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:54.951866 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2343e33b-edab-4378-9966-4bbc26977497 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:54.952559 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2343e33b-edab-4378-9966-4bbc26977497 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:54.953067 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2343e33b-edab-4378-9966-4bbc26977497 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:54.953875 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2343e33b-edab-4378-9966-4bbc26977497 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:54.954389 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2343e33b-edab-4378-9966-4bbc26977497 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:54.954977 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2343e33b-edab-4378-9966-4bbc26977497 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:55.409758 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2343e33b-edab-4378-9966-4bbc26977497 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:55.418418 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2343e33b-edab-4378-9966-4bbc26977497 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1528 microversion: 2.1 time: 0.494667 Aug 07 01:29:55.419007 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1819/3973] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:54 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1528 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:55.447418 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a103bccc-7614-4b90-b750-aaa955bbd70f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:55.461345 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a103bccc-7614-4b90-b750-aaa955bbd70f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1506 microversion: 2.1 time: 0.807909 Aug 07 01:29:55.472729 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2155/3974] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:54 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1506 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:55.659871 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5ce1972d-43e2-4b25-95db-6a0cc9f96755 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:55.661267 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5ce1972d-43e2-4b25-95db-6a0cc9f96755 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:55.672579 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5ce1972d-43e2-4b25-95db-6a0cc9f96755 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:55.674405 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5ce1972d-43e2-4b25-95db-6a0cc9f96755 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:55.675037 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5ce1972d-43e2-4b25-95db-6a0cc9f96755 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:55.678416 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5ce1972d-43e2-4b25-95db-6a0cc9f96755 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:55.679019 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5ce1972d-43e2-4b25-95db-6a0cc9f96755 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:55.679619 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5ce1972d-43e2-4b25-95db-6a0cc9f96755 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:55.943154 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f15f8ad7-6bb3-4d2e-ac5e-c1e31d5261f7 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:55.944099 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f15f8ad7-6bb3-4d2e-ac5e-c1e31d5261f7 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] [instance: f2db3d5e-a955-44c7-8714-1f280d7a0a4f] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:55.952286 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f15f8ad7-6bb3-4d2e-ac5e-c1e31d5261f7 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:55.973858 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f15f8ad7-6bb3-4d2e-ac5e-c1e31d5261f7 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:55.988870 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f15f8ad7-6bb3-4d2e-ac5e-c1e31d5261f7 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:55.990995 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f15f8ad7-6bb3-4d2e-ac5e-c1e31d5261f7 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:55.995283 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f15f8ad7-6bb3-4d2e-ac5e-c1e31d5261f7 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:55.996034 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f15f8ad7-6bb3-4d2e-ac5e-c1e31d5261f7 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:56.138203 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5ce1972d-43e2-4b25-95db-6a0cc9f96755 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:56.152598 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5ce1972d-43e2-4b25-95db-6a0cc9f96755 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1506 microversion: 2.1 time: 0.497677 Aug 07 01:29:56.157265 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1820/3975] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:55 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1506 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:56.191940 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f15f8ad7-6bb3-4d2e-ac5e-c1e31d5261f7 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:56.207456 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f15f8ad7-6bb3-4d2e-ac5e-c1e31d5261f7 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:56.217655 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f15f8ad7-6bb3-4d2e-ac5e-c1e31d5261f7 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:56.222916 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f15f8ad7-6bb3-4d2e-ac5e-c1e31d5261f7 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] 10.222.0.39 "GET /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f" status: 200 len: 1254 microversion: 2.21 time: 0.282876 Aug 07 01:29:56.226399 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2156/3976] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:29:55 2022] GET /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f => generated 1254 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:29:56.442161 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-52c124d6-1b7c-4ac6-b2f9-de1555a84ea9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:56.443281 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-52c124d6-1b7c-4ac6-b2f9-de1555a84ea9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:56.453999 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52c124d6-1b7c-4ac6-b2f9-de1555a84ea9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:56.454958 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52c124d6-1b7c-4ac6-b2f9-de1555a84ea9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:56.455571 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52c124d6-1b7c-4ac6-b2f9-de1555a84ea9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:56.457446 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52c124d6-1b7c-4ac6-b2f9-de1555a84ea9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:56.458452 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52c124d6-1b7c-4ac6-b2f9-de1555a84ea9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:56.459036 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52c124d6-1b7c-4ac6-b2f9-de1555a84ea9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:56.487043 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-27b94425-988f-4fa9-8250-ec35963ac426 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:56.488352 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-27b94425-988f-4fa9-8250-ec35963ac426 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:56.513871 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27b94425-988f-4fa9-8250-ec35963ac426 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:56.514380 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27b94425-988f-4fa9-8250-ec35963ac426 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:56.528631 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27b94425-988f-4fa9-8250-ec35963ac426 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:56.529633 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27b94425-988f-4fa9-8250-ec35963ac426 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:56.530291 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27b94425-988f-4fa9-8250-ec35963ac426 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:56.530871 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27b94425-988f-4fa9-8250-ec35963ac426 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:56.870726 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-52c124d6-1b7c-4ac6-b2f9-de1555a84ea9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:56.887975 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-52c124d6-1b7c-4ac6-b2f9-de1555a84ea9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1528 microversion: 2.1 time: 0.447556 Aug 07 01:29:56.891540 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1821/3977] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:56 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1528 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:56.905868 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-31731b96-3d98-48dc-a96a-3a9acaebe551 req-9b6cce2d-275f-4b6c-9206-c43d667ce952 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aacc9718-ff8d-4ef4-8380-7d863a4b5cd1", "name": "network-vif-unplugged", "status": "completed", "tag": "6eee3035-8373-408c-81bd-fa491c09b2b5"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:29:56.943035 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-31731b96-3d98-48dc-a96a-3a9acaebe551 req-9b6cce2d-275f-4b6c-9206-c43d667ce952 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:56.943518 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-31731b96-3d98-48dc-a96a-3a9acaebe551 req-9b6cce2d-275f-4b6c-9206-c43d667ce952 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:56.943970 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-31731b96-3d98-48dc-a96a-3a9acaebe551 req-9b6cce2d-275f-4b6c-9206-c43d667ce952 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:56.991780 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-31731b96-3d98-48dc-a96a-3a9acaebe551 req-9b6cce2d-275f-4b6c-9206-c43d667ce952 service nova] Creating event network-vif-unplugged:6eee3035-8373-408c-81bd-fa491c09b2b5 for instance aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 on n-h2-master-1 Aug 07 01:29:56.999361 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-31731b96-3d98-48dc-a96a-3a9acaebe551 req-9b6cce2d-275f-4b6c-9206-c43d667ce952 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104866 Aug 07 01:29:57.001523 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1822/3978] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:29:57.155381 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-27b94425-988f-4fa9-8250-ec35963ac426 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:57.179443 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4d5bf1c9-60d3-4b7b-a79b-52a5ce64fd1a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:57.180210 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4d5bf1c9-60d3-4b7b-a79b-52a5ce64fd1a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:57.186961 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-27b94425-988f-4fa9-8250-ec35963ac426 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1506 microversion: 2.1 time: 0.701913 Aug 07 01:29:57.200434 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2157/3979] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:56 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1506 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:57.202610 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d5bf1c9-60d3-4b7b-a79b-52a5ce64fd1a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:57.203122 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d5bf1c9-60d3-4b7b-a79b-52a5ce64fd1a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:57.208935 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d5bf1c9-60d3-4b7b-a79b-52a5ce64fd1a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:57.210316 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d5bf1c9-60d3-4b7b-a79b-52a5ce64fd1a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:57.211066 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d5bf1c9-60d3-4b7b-a79b-52a5ce64fd1a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:57.211857 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d5bf1c9-60d3-4b7b-a79b-52a5ce64fd1a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:57.251750 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2586270e-535a-48c7-a586-d782bbad0c34 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:57.254422 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2586270e-535a-48c7-a586-d782bbad0c34 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] [instance: f2db3d5e-a955-44c7-8714-1f280d7a0a4f] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:57.268608 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2586270e-535a-48c7-a586-d782bbad0c34 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:57.274858 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2586270e-535a-48c7-a586-d782bbad0c34 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:57.275323 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2586270e-535a-48c7-a586-d782bbad0c34 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:57.276121 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2586270e-535a-48c7-a586-d782bbad0c34 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:57.276712 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2586270e-535a-48c7-a586-d782bbad0c34 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:57.277092 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2586270e-535a-48c7-a586-d782bbad0c34 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:57.445123 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2586270e-535a-48c7-a586-d782bbad0c34 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:57.459818 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2586270e-535a-48c7-a586-d782bbad0c34 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:57.472075 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2586270e-535a-48c7-a586-d782bbad0c34 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:57.474745 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2586270e-535a-48c7-a586-d782bbad0c34 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] 10.222.0.39 "GET /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f" status: 200 len: 1316 microversion: 2.21 time: 0.227237 Aug 07 01:29:57.479555 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2158/3980] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:29:57 2022] GET /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f => generated 1316 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:29:57.915554 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3c835ce6-080c-48c6-982c-5a9144b240f7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:57.917035 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3c835ce6-080c-48c6-982c-5a9144b240f7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:57.928336 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c835ce6-080c-48c6-982c-5a9144b240f7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:57.933332 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c835ce6-080c-48c6-982c-5a9144b240f7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:57.933997 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c835ce6-080c-48c6-982c-5a9144b240f7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:57.935038 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c835ce6-080c-48c6-982c-5a9144b240f7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:57.935686 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c835ce6-080c-48c6-982c-5a9144b240f7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:57.936380 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c835ce6-080c-48c6-982c-5a9144b240f7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:58.405718 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3c835ce6-080c-48c6-982c-5a9144b240f7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:58.421445 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3c835ce6-080c-48c6-982c-5a9144b240f7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1528 microversion: 2.1 time: 0.512041 Aug 07 01:29:58.422077 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2159/3981] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:57 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1528 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:58.439456 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5b575a60-4b20-4d9f-905f-11c28463c3ce tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:58.440332 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5b575a60-4b20-4d9f-905f-11c28463c3ce tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:58.448991 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5b575a60-4b20-4d9f-905f-11c28463c3ce tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:58.450239 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5b575a60-4b20-4d9f-905f-11c28463c3ce tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:58.450850 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5b575a60-4b20-4d9f-905f-11c28463c3ce tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:58.451793 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5b575a60-4b20-4d9f-905f-11c28463c3ce tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:58.452555 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5b575a60-4b20-4d9f-905f-11c28463c3ce tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:58.453197 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5b575a60-4b20-4d9f-905f-11c28463c3ce tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:58.821388 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4d5bf1c9-60d3-4b7b-a79b-52a5ce64fd1a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:58.831079 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4d5bf1c9-60d3-4b7b-a79b-52a5ce64fd1a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 200 len: 1509 microversion: 2.1 time: 1.656094 Aug 07 01:29:58.843735 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1823/3982] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:57 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 1509 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:58.849163 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-86465f54-9d41-4c3d-8183-a75dd59eb0a0 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:58.857405 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-86465f54-9d41-4c3d-8183-a75dd59eb0a0 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] [instance: f2db3d5e-a955-44c7-8714-1f280d7a0a4f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:58.873638 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-86465f54-9d41-4c3d-8183-a75dd59eb0a0 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:58.875964 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-86465f54-9d41-4c3d-8183-a75dd59eb0a0 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:58.881165 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-86465f54-9d41-4c3d-8183-a75dd59eb0a0 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:58.882398 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-86465f54-9d41-4c3d-8183-a75dd59eb0a0 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:58.885029 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-86465f54-9d41-4c3d-8183-a75dd59eb0a0 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:58.885676 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-86465f54-9d41-4c3d-8183-a75dd59eb0a0 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:59.185193 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-86465f54-9d41-4c3d-8183-a75dd59eb0a0 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:59.193809 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-86465f54-9d41-4c3d-8183-a75dd59eb0a0 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:59.195563 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-86465f54-9d41-4c3d-8183-a75dd59eb0a0 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:59.197814 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-86465f54-9d41-4c3d-8183-a75dd59eb0a0 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] 10.222.0.39 "GET /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f" status: 200 len: 1358 microversion: 2.21 time: 0.352678 Aug 07 01:29:59.202473 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1824/3983] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:29:58 2022] GET /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f => generated 1358 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:29:59.207526 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-06483d26-e35b-444f-93fb-14162ddd653b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:59.213112 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-06483d26-e35b-444f-93fb-14162ddd653b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:59.237783 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06483d26-e35b-444f-93fb-14162ddd653b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:59.238643 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06483d26-e35b-444f-93fb-14162ddd653b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:59.239278 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06483d26-e35b-444f-93fb-14162ddd653b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:59.240233 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06483d26-e35b-444f-93fb-14162ddd653b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:59.240898 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06483d26-e35b-444f-93fb-14162ddd653b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:59.241520 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06483d26-e35b-444f-93fb-14162ddd653b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:59.292866 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-06483d26-e35b-444f-93fb-14162ddd653b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:29:59.304529 n-d-master-1 devstack@n-api.service[119517]: INFO nova.compute.api [None req-06483d26-e35b-444f-93fb-14162ddd653b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Working on deleting snapshot 499cd7e6-f8ad-4027-96a2-0429ef50ca6e from shelved instance... Aug 07 01:29:59.325024 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5b575a60-4b20-4d9f-905f-11c28463c3ce tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:59.336280 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5b575a60-4b20-4d9f-905f-11c28463c3ce tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1506 microversion: 2.1 time: 0.906834 Aug 07 01:29:59.355414 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2160/3984] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:58 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1506 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:29:59.442827 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3c5b9589-51a1-413d-9ea9-93302a22d078 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:29:59.443897 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3c5b9589-51a1-413d-9ea9-93302a22d078 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:29:59.451202 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c5b9589-51a1-413d-9ea9-93302a22d078 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:59.452136 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c5b9589-51a1-413d-9ea9-93302a22d078 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:59.452817 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c5b9589-51a1-413d-9ea9-93302a22d078 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:59.453733 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c5b9589-51a1-413d-9ea9-93302a22d078 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:29:59.454386 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c5b9589-51a1-413d-9ea9-93302a22d078 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:29:59.455038 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c5b9589-51a1-413d-9ea9-93302a22d078 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:29:59.954828 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3c5b9589-51a1-413d-9ea9-93302a22d078 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:29:59.960664 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:59.987837 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3c5b9589-51a1-413d-9ea9-93302a22d078 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1528 microversion: 2.1 time: 0.548672 Aug 07 01:29:59.989782 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2161/3985] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:29:59 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1528 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:00.221213 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-bacb0ae5-09d6-4a78-a35b-6a18a307e02d req-0da1a940-7fff-4e4c-a675-bfd7cbaf2c9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2db3d5e-a955-44c7-8714-1f280d7a0a4f", "tag": "de6202e3-4f73-4ff5-8918-d619ed5d6300"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:00.259409 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-bacb0ae5-09d6-4a78-a35b-6a18a307e02d req-0da1a940-7fff-4e4c-a675-bfd7cbaf2c9e service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:00.259922 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-bacb0ae5-09d6-4a78-a35b-6a18a307e02d req-0da1a940-7fff-4e4c-a675-bfd7cbaf2c9e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:00.260372 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-bacb0ae5-09d6-4a78-a35b-6a18a307e02d req-0da1a940-7fff-4e4c-a675-bfd7cbaf2c9e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:00.297186 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-bacb0ae5-09d6-4a78-a35b-6a18a307e02d req-0da1a940-7fff-4e4c-a675-bfd7cbaf2c9e service nova] Creating event network-changed:de6202e3-4f73-4ff5-8918-d619ed5d6300 for instance f2db3d5e-a955-44c7-8714-1f280d7a0a4f on n-h1-master-1 Aug 07 01:30:00.317356 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-bacb0ae5-09d6-4a78-a35b-6a18a307e02d req-0da1a940-7fff-4e4c-a675-bfd7cbaf2c9e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102052 Aug 07 01:30:00.317984 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2162/3986] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:30:00.334611 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d626a5e5-4a55-42c5-9878-6754c0ddb6db tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:00.340536 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d626a5e5-4a55-42c5-9878-6754c0ddb6db tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] [instance: f2db3d5e-a955-44c7-8714-1f280d7a0a4f] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:00.357463 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d626a5e5-4a55-42c5-9878-6754c0ddb6db tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:00.361060 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d626a5e5-4a55-42c5-9878-6754c0ddb6db tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:00.361698 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d626a5e5-4a55-42c5-9878-6754c0ddb6db tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:00.364480 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d626a5e5-4a55-42c5-9878-6754c0ddb6db tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:00.366680 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d626a5e5-4a55-42c5-9878-6754c0ddb6db tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:00.367301 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d626a5e5-4a55-42c5-9878-6754c0ddb6db tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:00.439662 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-06483d26-e35b-444f-93fb-14162ddd653b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Doing local delete in cell 946acc3b-7b72-45d6-9151-44f3ad85fe4f(cell1) {{(pid=119517) _delete /opt/stack/nova/nova/compute/api.py:2491}} Aug 07 01:30:00.441688 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06483d26-e35b-444f-93fb-14162ddd653b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:00.442299 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06483d26-e35b-444f-93fb-14162ddd653b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:00.444455 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06483d26-e35b-444f-93fb-14162ddd653b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:00.445202 n-d-master-1 devstack@n-api.service[119517]: INFO nova.compute.api [None req-06483d26-e35b-444f-93fb-14162ddd653b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 07 01:30:00.455414 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-06483d26-e35b-444f-93fb-14162ddd653b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] deallocate_for_instance() {{(pid=119517) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 07 01:30:00.625554 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d626a5e5-4a55-42c5-9878-6754c0ddb6db tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:00.636802 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d626a5e5-4a55-42c5-9878-6754c0ddb6db tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:00.638358 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d626a5e5-4a55-42c5-9878-6754c0ddb6db tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:00.639534 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d626a5e5-4a55-42c5-9878-6754c0ddb6db tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] 10.222.0.39 "GET /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f" status: 200 len: 1358 microversion: 2.21 time: 0.312662 Aug 07 01:30:00.640242 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2163/3987] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:30:00 2022] GET /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f => generated 1358 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:30:00.659677 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d81a3366-af45-4c95-b333-461d4a8f5166 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:00.660583 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d81a3366-af45-4c95-b333-461d4a8f5166 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:00.667211 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d81a3366-af45-4c95-b333-461d4a8f5166 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:00.668107 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d81a3366-af45-4c95-b333-461d4a8f5166 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:00.668764 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d81a3366-af45-4c95-b333-461d4a8f5166 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:00.669719 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d81a3366-af45-4c95-b333-461d4a8f5166 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:00.670373 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d81a3366-af45-4c95-b333-461d4a8f5166 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:00.670998 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d81a3366-af45-4c95-b333-461d4a8f5166 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:00.986970 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d81a3366-af45-4c95-b333-461d4a8f5166 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:00.997497 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d81a3366-af45-4c95-b333-461d4a8f5166 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1486 microversion: 2.1 time: 0.352237 Aug 07 01:30:00.998412 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2164/3988] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:00 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1486 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:01.013949 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ebc4f3a9-066e-4b4e-abc5-51853b172efe tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:01.015242 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ebc4f3a9-066e-4b4e-abc5-51853b172efe tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:01.026180 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ebc4f3a9-066e-4b4e-abc5-51853b172efe tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:01.026692 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ebc4f3a9-066e-4b4e-abc5-51853b172efe tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:01.027152 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ebc4f3a9-066e-4b4e-abc5-51853b172efe tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:01.027960 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ebc4f3a9-066e-4b4e-abc5-51853b172efe tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:01.028745 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ebc4f3a9-066e-4b4e-abc5-51853b172efe tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:01.029366 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ebc4f3a9-066e-4b4e-abc5-51853b172efe tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:01.231164 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ebc4f3a9-066e-4b4e-abc5-51853b172efe tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:01.244833 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ebc4f3a9-066e-4b4e-abc5-51853b172efe tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1528 microversion: 2.1 time: 0.237477 Aug 07 01:30:01.246249 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2165/3989] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:01 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1528 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:01.252536 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9266bd9c-83a1-4c78-a109-277e1bc0c58d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:01.253364 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9266bd9c-83a1-4c78-a109-277e1bc0c58d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:01.260907 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9266bd9c-83a1-4c78-a109-277e1bc0c58d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:01.261773 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9266bd9c-83a1-4c78-a109-277e1bc0c58d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:01.262277 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9266bd9c-83a1-4c78-a109-277e1bc0c58d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:01.263873 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9266bd9c-83a1-4c78-a109-277e1bc0c58d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:01.263873 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9266bd9c-83a1-4c78-a109-277e1bc0c58d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:01.264331 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9266bd9c-83a1-4c78-a109-277e1bc0c58d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:01.354787 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9266bd9c-83a1-4c78-a109-277e1bc0c58d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "POST /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17/action" status: 202 len: 0 microversion: 2.1 time: 0.106154 Aug 07 01:30:01.358917 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2166/3990] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:30:01 2022] POST /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:30:01.392174 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ec30418a-6655-451f-b60f-3c99c7c6f14d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:01.393809 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ec30418a-6655-451f-b60f-3c99c7c6f14d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:01.415228 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec30418a-6655-451f-b60f-3c99c7c6f14d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:01.415939 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec30418a-6655-451f-b60f-3c99c7c6f14d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:01.416429 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec30418a-6655-451f-b60f-3c99c7c6f14d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:01.420016 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec30418a-6655-451f-b60f-3c99c7c6f14d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:01.420016 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec30418a-6655-451f-b60f-3c99c7c6f14d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:01.420016 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec30418a-6655-451f-b60f-3c99c7c6f14d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:01.605642 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ec30418a-6655-451f-b60f-3c99c7c6f14d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:01.614084 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ec30418a-6655-451f-b60f-3c99c7c6f14d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1494 microversion: 2.1 time: 0.236808 Aug 07 01:30:01.615091 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2167/3991] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:01 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1494 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:01.676955 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6e75bbaf-08b0-4bd4-bddd-957192fc3134 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:01.677484 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6e75bbaf-08b0-4bd4-bddd-957192fc3134 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] [instance: f2db3d5e-a955-44c7-8714-1f280d7a0a4f] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:01.692646 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e75bbaf-08b0-4bd4-bddd-957192fc3134 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:01.693317 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e75bbaf-08b0-4bd4-bddd-957192fc3134 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:01.694459 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e75bbaf-08b0-4bd4-bddd-957192fc3134 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:01.696154 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e75bbaf-08b0-4bd4-bddd-957192fc3134 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:01.697065 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e75bbaf-08b0-4bd4-bddd-957192fc3134 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:01.697648 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e75bbaf-08b0-4bd4-bddd-957192fc3134 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:01.873529 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-06483d26-e35b-444f-93fb-14162ddd653b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Updating instance_info_cache with network_info: [] {{(pid=119517) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 07 01:30:02.009293 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6e75bbaf-08b0-4bd4-bddd-957192fc3134 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:02.021873 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6e75bbaf-08b0-4bd4-bddd-957192fc3134 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:02.035135 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6e75bbaf-08b0-4bd4-bddd-957192fc3134 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:02.040598 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6e75bbaf-08b0-4bd4-bddd-957192fc3134 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] 10.222.0.39 "GET /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f" status: 200 len: 1358 microversion: 2.21 time: 0.371309 Aug 07 01:30:02.042952 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2168/3992] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:30:01 2022] GET /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f => generated 1358 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:30:02.087025 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-ca530c91-ca6b-4697-97be-09725846af10 req-b7c21572-ec1a-433c-8c26-4148c44f847c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aacc9718-ff8d-4ef4-8380-7d863a4b5cd1", "name": "network-vif-deleted", "tag": "6eee3035-8373-408c-81bd-fa491c09b2b5"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:02.132368 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-ca530c91-ca6b-4697-97be-09725846af10 req-b7c21572-ec1a-433c-8c26-4148c44f847c service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:02.133256 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-ca530c91-ca6b-4697-97be-09725846af10 req-b7c21572-ec1a-433c-8c26-4148c44f847c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:02.135614 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-ca530c91-ca6b-4697-97be-09725846af10 req-b7c21572-ec1a-433c-8c26-4148c44f847c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:02.167516 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.compute.server_external_events [req-ca530c91-ca6b-4697-97be-09725846af10 req-b7c21572-ec1a-433c-8c26-4148c44f847c service nova] Unable to find a host for instance aacc9718-ff8d-4ef4-8380-7d863a4b5cd1. Dropping event network-vif-deleted {{(pid=119516) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 07 01:30:02.168476 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-ca530c91-ca6b-4697-97be-09725846af10 req-b7c21572-ec1a-433c-8c26-4148c44f847c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.109492 Aug 07 01:30:02.169354 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2169/3993] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 114 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 07 01:30:02.268234 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cbd7ca6e-15b0-4069-889c-7551c5ac6662 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:02.269380 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cbd7ca6e-15b0-4069-889c-7551c5ac6662 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:02.276662 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cbd7ca6e-15b0-4069-889c-7551c5ac6662 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:02.277416 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cbd7ca6e-15b0-4069-889c-7551c5ac6662 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:02.278182 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cbd7ca6e-15b0-4069-889c-7551c5ac6662 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:02.279223 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cbd7ca6e-15b0-4069-889c-7551c5ac6662 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:02.279858 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cbd7ca6e-15b0-4069-889c-7551c5ac6662 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:02.280481 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cbd7ca6e-15b0-4069-889c-7551c5ac6662 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:02.395018 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-06483d26-e35b-444f-93fb-14162ddd653b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "DELETE /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 204 len: 0 microversion: 2.1 time: 3.191191 Aug 07 01:30:02.396515 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1825/3994] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:29:59 2022] DELETE /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 0 bytes in 3193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:30:02.404569 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-31bf5383-2869-45a0-984f-3aad1591fa89 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:02.405195 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-31bf5383-2869-45a0-984f-3aad1591fa89 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:02.411211 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:02.413075 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-31bf5383-2869-45a0-984f-3aad1591fa89 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:02.413579 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-31bf5383-2869-45a0-984f-3aad1591fa89 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:02.414016 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-31bf5383-2869-45a0-984f-3aad1591fa89 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:02.415440 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-31bf5383-2869-45a0-984f-3aad1591fa89 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:02.416248 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-31bf5383-2869-45a0-984f-3aad1591fa89 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:02.416862 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-31bf5383-2869-45a0-984f-3aad1591fa89 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:02.434619 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:02.436476 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-31bf5383-2869-45a0-984f-3aad1591fa89 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] HTTP exception thrown: Instance aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 could not be found. Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-31bf5383-2869-45a0-984f-3aad1591fa89 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Request method failure captured: Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 HTTP/1.1 Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xRoqM1ZK4H7GtvmxWX9ofAmOsKF2OdU6k1rehi-6yk86CpmfTNVcE0kwd9G1ahgJHyDlEB2bKz4XbnD5Ku_zcl240Q-kfWeKv3HfC_GyXmFAQWa4hNXP2nUgxgBXBe_oBb5a-t1xlRXFxfo9n87AmGbLBI9ZdV03LZwWshVd2n0WvE Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5506f7c95c1a46c5b3966597764b0111", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d1f0c01c340940388b440932d51988ff Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: exception: Instance aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 could not be found. Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'aacc9718-ff8d-4ef4-8380-7d863a4b5cd1'} Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 could not be found. Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 could not be found. Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:30:02.438507 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:02.441998 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:30:02.441998 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:30:02.441998 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:30:02.441998 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:30:02.441998 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:30:02.441998 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 could not be found. Aug 07 01:30:02.441998 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:02.444014 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-31bf5383-2869-45a0-984f-3aad1591fa89 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Returning 404 to user: Instance aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:30:02.445114 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-31bf5383-2869-45a0-984f-3aad1591fa89 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 404 len: 111 microversion: 2.1 time: 0.044602 Aug 07 01:30:02.446838 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1826/3995] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:02 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:30:02.516323 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-184b3d59-73a6-4eb4-b833-34e69e44f730 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-805207366", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "554905b9-fa00-4877-bc90-609c81108292"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:02.606913 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-184b3d59-73a6-4eb4-b833-34e69e44f730 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] validate_networks() for [('554905b9-fa00-4877-bc90-609c81108292', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:30:02.614110 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cbd7ca6e-15b0-4069-889c-7551c5ac6662 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:02.623855 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cbd7ca6e-15b0-4069-889c-7551c5ac6662 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1528 microversion: 2.1 time: 0.360715 Aug 07 01:30:02.625950 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2170/3996] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:02 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1528 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:02.638012 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a981a93a-49bb-4c94-81bf-3875b02f2be2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:02.641024 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a981a93a-49bb-4c94-81bf-3875b02f2be2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:02.651820 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a981a93a-49bb-4c94-81bf-3875b02f2be2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:02.652575 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a981a93a-49bb-4c94-81bf-3875b02f2be2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:02.653192 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a981a93a-49bb-4c94-81bf-3875b02f2be2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:02.654066 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a981a93a-49bb-4c94-81bf-3875b02f2be2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:02.654677 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a981a93a-49bb-4c94-81bf-3875b02f2be2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:02.655262 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a981a93a-49bb-4c94-81bf-3875b02f2be2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:02.839565 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a981a93a-49bb-4c94-81bf-3875b02f2be2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:02.849323 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a981a93a-49bb-4c94-81bf-3875b02f2be2 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1494 microversion: 2.1 time: 0.216186 Aug 07 01:30:02.850591 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2171/3997] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:02 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1494 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:30:03.068226 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e2661362-6e03-4582-a2f1-3f571819bd85 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:03.069002 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e2661362-6e03-4582-a2f1-3f571819bd85 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] [instance: f2db3d5e-a955-44c7-8714-1f280d7a0a4f] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:03.076532 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e2661362-6e03-4582-a2f1-3f571819bd85 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:03.077026 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e2661362-6e03-4582-a2f1-3f571819bd85 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:03.077639 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e2661362-6e03-4582-a2f1-3f571819bd85 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:03.078363 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e2661362-6e03-4582-a2f1-3f571819bd85 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:03.078990 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e2661362-6e03-4582-a2f1-3f571819bd85 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:03.079249 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e2661362-6e03-4582-a2f1-3f571819bd85 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:03.230177 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e2661362-6e03-4582-a2f1-3f571819bd85 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:03.239061 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e2661362-6e03-4582-a2f1-3f571819bd85 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:03.240742 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e2661362-6e03-4582-a2f1-3f571819bd85 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:03.241884 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e2661362-6e03-4582-a2f1-3f571819bd85 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] 10.222.0.39 "GET /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f" status: 200 len: 1358 microversion: 2.21 time: 0.178216 Aug 07 01:30:03.242469 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2172/3998] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:30:03 2022] GET /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:30:03.646855 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-84ffd29a-5979-4ebc-854a-4e51134953a1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:03.647463 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-84ffd29a-5979-4ebc-854a-4e51134953a1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:03.653662 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84ffd29a-5979-4ebc-854a-4e51134953a1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:03.654143 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84ffd29a-5979-4ebc-854a-4e51134953a1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:03.654578 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84ffd29a-5979-4ebc-854a-4e51134953a1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:03.655276 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84ffd29a-5979-4ebc-854a-4e51134953a1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:03.655730 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84ffd29a-5979-4ebc-854a-4e51134953a1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:03.656182 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84ffd29a-5979-4ebc-854a-4e51134953a1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:03.826157 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-84ffd29a-5979-4ebc-854a-4e51134953a1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:03.835470 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-84ffd29a-5979-4ebc-854a-4e51134953a1 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1510 microversion: 2.1 time: 0.192691 Aug 07 01:30:03.836646 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2173/3999] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:03 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1510 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:30:03.856640 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-184b3d59-73a6-4eb4-b833-34e69e44f730 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:30:03.857166 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-184b3d59-73a6-4eb4-b833-34e69e44f730 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:30:03.857533 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-184b3d59-73a6-4eb4-b833-34e69e44f730 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:30:03.857946 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-184b3d59-73a6-4eb4-b833-34e69e44f730 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:30:03.858366 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-184b3d59-73a6-4eb4-b833-34e69e44f730 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:30:03.868631 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-184b3d59-73a6-4eb4-b833-34e69e44f730 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:03.869127 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-184b3d59-73a6-4eb4-b833-34e69e44f730 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:03.869578 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-184b3d59-73a6-4eb4-b833-34e69e44f730 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:03.870442 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-184b3d59-73a6-4eb4-b833-34e69e44f730 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:03.870775 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-184b3d59-73a6-4eb4-b833-34e69e44f730 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:03.871330 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-184b3d59-73a6-4eb4-b833-34e69e44f730 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:03.871443 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-aa6a146f-adc7-4439-aad8-7b2ee56ec493 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:03.872066 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-aa6a146f-adc7-4439-aad8-7b2ee56ec493 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:03.881628 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa6a146f-adc7-4439-aad8-7b2ee56ec493 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:03.881993 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa6a146f-adc7-4439-aad8-7b2ee56ec493 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:03.882654 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa6a146f-adc7-4439-aad8-7b2ee56ec493 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:03.883793 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa6a146f-adc7-4439-aad8-7b2ee56ec493 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:03.884347 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa6a146f-adc7-4439-aad8-7b2ee56ec493 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:03.885615 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa6a146f-adc7-4439-aad8-7b2ee56ec493 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:03.892862 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-184b3d59-73a6-4eb4-b833-34e69e44f730 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Getting quotas for project 5506f7c95c1a46c5b3966597764b0111. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:30:03.899416 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-184b3d59-73a6-4eb4-b833-34e69e44f730 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Getting quotas for user d1f0c01c340940388b440932d51988ff and project 5506f7c95c1a46c5b3966597764b0111. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:30:03.920021 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-184b3d59-73a6-4eb4-b833-34e69e44f730 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:30:03.923861 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-184b3d59-73a6-4eb4-b833-34e69e44f730 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: dbc593a0-5c59-4d1b-a538-157daf632f2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:30:04.003080 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-184b3d59-73a6-4eb4-b833-34e69e44f730 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.494504 Aug 07 01:30:04.004082 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1827/4000] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:30:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:30:04.023295 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-717bb93f-0f2a-4992-8245-b21747a1e3a4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:04.027998 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-717bb93f-0f2a-4992-8245-b21747a1e3a4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: dbc593a0-5c59-4d1b-a538-157daf632f2e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:04.083816 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-aa6a146f-adc7-4439-aad8-7b2ee56ec493 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:04.096279 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-aa6a146f-adc7-4439-aad8-7b2ee56ec493 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1494 microversion: 2.1 time: 0.229314 Aug 07 01:30:04.097122 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2174/4001] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:03 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1494 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:30:04.184832 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-717bb93f-0f2a-4992-8245-b21747a1e3a4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:04.191636 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-717bb93f-0f2a-4992-8245-b21747a1e3a4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e" status: 200 len: 1214 microversion: 2.1 time: 0.179453 Aug 07 01:30:04.192848 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1828/4002] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:04 2022] GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e => generated 1214 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:04.265614 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bb9beffa-37b6-4a09-a2bc-96da2c7ddd66 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:04.266327 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bb9beffa-37b6-4a09-a2bc-96da2c7ddd66 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] [instance: f2db3d5e-a955-44c7-8714-1f280d7a0a4f] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:04.273009 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb9beffa-37b6-4a09-a2bc-96da2c7ddd66 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:04.273576 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb9beffa-37b6-4a09-a2bc-96da2c7ddd66 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:04.274106 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb9beffa-37b6-4a09-a2bc-96da2c7ddd66 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:04.274896 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb9beffa-37b6-4a09-a2bc-96da2c7ddd66 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:04.276855 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb9beffa-37b6-4a09-a2bc-96da2c7ddd66 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:04.277725 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb9beffa-37b6-4a09-a2bc-96da2c7ddd66 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:04.450880 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bb9beffa-37b6-4a09-a2bc-96da2c7ddd66 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:04.459265 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bb9beffa-37b6-4a09-a2bc-96da2c7ddd66 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:04.462450 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bb9beffa-37b6-4a09-a2bc-96da2c7ddd66 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:04.462450 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bb9beffa-37b6-4a09-a2bc-96da2c7ddd66 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] 10.222.0.39 "GET /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f" status: 200 len: 1358 microversion: 2.21 time: 0.201137 Aug 07 01:30:04.463320 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2175/4003] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:30:04 2022] GET /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:30:04.858487 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-070ad63a-5223-4454-bf82-634febc3a364 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:04.859632 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-070ad63a-5223-4454-bf82-634febc3a364 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:04.866549 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-070ad63a-5223-4454-bf82-634febc3a364 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:04.868642 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-070ad63a-5223-4454-bf82-634febc3a364 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:04.870308 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-070ad63a-5223-4454-bf82-634febc3a364 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:04.871398 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-070ad63a-5223-4454-bf82-634febc3a364 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:04.872058 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-070ad63a-5223-4454-bf82-634febc3a364 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:04.872630 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-070ad63a-5223-4454-bf82-634febc3a364 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:05.118993 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cce2b447-37c9-494b-9357-ab301ed4f812 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:05.120237 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cce2b447-37c9-494b-9357-ab301ed4f812 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:05.129018 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cce2b447-37c9-494b-9357-ab301ed4f812 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:05.131233 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cce2b447-37c9-494b-9357-ab301ed4f812 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:05.132118 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cce2b447-37c9-494b-9357-ab301ed4f812 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:05.133091 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cce2b447-37c9-494b-9357-ab301ed4f812 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:05.133742 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cce2b447-37c9-494b-9357-ab301ed4f812 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:05.134375 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cce2b447-37c9-494b-9357-ab301ed4f812 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:05.296176 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-070ad63a-5223-4454-bf82-634febc3a364 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:05.316792 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-070ad63a-5223-4454-bf82-634febc3a364 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1510 microversion: 2.1 time: 0.462491 Aug 07 01:30:05.318034 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1829/4004] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:04 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1510 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:05.330300 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0ba2f170-5801-4096-ba67-06d1fb69a618 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:05.333075 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0ba2f170-5801-4096-ba67-06d1fb69a618 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: dbc593a0-5c59-4d1b-a538-157daf632f2e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:05.354487 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ba2f170-5801-4096-ba67-06d1fb69a618 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:05.355327 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ba2f170-5801-4096-ba67-06d1fb69a618 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:05.357094 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ba2f170-5801-4096-ba67-06d1fb69a618 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:05.358080 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ba2f170-5801-4096-ba67-06d1fb69a618 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:05.358763 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ba2f170-5801-4096-ba67-06d1fb69a618 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:05.359398 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ba2f170-5801-4096-ba67-06d1fb69a618 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:05.553924 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0ba2f170-5801-4096-ba67-06d1fb69a618 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:05.571463 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0ba2f170-5801-4096-ba67-06d1fb69a618 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e" status: 200 len: 1284 microversion: 2.1 time: 0.250138 Aug 07 01:30:05.574219 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1830/4005] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:05 2022] GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e => generated 1284 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:05.580276 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3f4674ca-2e02-4ecf-9ca1-2ac2e4c48161 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:05.581186 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3f4674ca-2e02-4ecf-9ca1-2ac2e4c48161 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] [instance: f2db3d5e-a955-44c7-8714-1f280d7a0a4f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:05.592232 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3f4674ca-2e02-4ecf-9ca1-2ac2e4c48161 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:05.593198 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3f4674ca-2e02-4ecf-9ca1-2ac2e4c48161 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:05.593837 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3f4674ca-2e02-4ecf-9ca1-2ac2e4c48161 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:05.594772 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3f4674ca-2e02-4ecf-9ca1-2ac2e4c48161 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:05.595410 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3f4674ca-2e02-4ecf-9ca1-2ac2e4c48161 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:05.596071 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3f4674ca-2e02-4ecf-9ca1-2ac2e4c48161 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:05.673485 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cce2b447-37c9-494b-9357-ab301ed4f812 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:05.682835 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cce2b447-37c9-494b-9357-ab301ed4f812 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1500 microversion: 2.1 time: 0.568193 Aug 07 01:30:05.684129 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2176/4006] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:05 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1500 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:30:05.689117 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-e2634053-9dca-457b-8491-67b668577eb1 req-f667d59b-1949-465a-a466-b4e4146a032c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2db3d5e-a955-44c7-8714-1f280d7a0a4f", "name": "network-vif-plugged", "status": "completed", "tag": "de6202e3-4f73-4ff5-8918-d619ed5d6300"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:05.698992 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e2634053-9dca-457b-8491-67b668577eb1 req-f667d59b-1949-465a-a466-b4e4146a032c service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:05.699754 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e2634053-9dca-457b-8491-67b668577eb1 req-f667d59b-1949-465a-a466-b4e4146a032c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:05.700461 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e2634053-9dca-457b-8491-67b668577eb1 req-f667d59b-1949-465a-a466-b4e4146a032c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:05.718279 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-e2634053-9dca-457b-8491-67b668577eb1 req-f667d59b-1949-465a-a466-b4e4146a032c service nova] Creating event network-vif-plugged:de6202e3-4f73-4ff5-8918-d619ed5d6300 for instance f2db3d5e-a955-44c7-8714-1f280d7a0a4f on n-h1-master-1 Aug 07 01:30:05.725991 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-e2634053-9dca-457b-8491-67b668577eb1 req-f667d59b-1949-465a-a466-b4e4146a032c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040029 Aug 07 01:30:05.728041 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2177/4007] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:30:05.736646 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ec7ebb5a-04b5-401d-9db9-384c782d0b3d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:05.737804 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ec7ebb5a-04b5-401d-9db9-384c782d0b3d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:05.749196 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec7ebb5a-04b5-401d-9db9-384c782d0b3d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:05.750353 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec7ebb5a-04b5-401d-9db9-384c782d0b3d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:05.751182 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec7ebb5a-04b5-401d-9db9-384c782d0b3d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:05.752281 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec7ebb5a-04b5-401d-9db9-384c782d0b3d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:05.752850 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec7ebb5a-04b5-401d-9db9-384c782d0b3d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:05.753365 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec7ebb5a-04b5-401d-9db9-384c782d0b3d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:05.791794 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ec7ebb5a-04b5-401d-9db9-384c782d0b3d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:30:05.823450 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:05.849149 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3f4674ca-2e02-4ecf-9ca1-2ac2e4c48161 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:05.857982 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3f4674ca-2e02-4ecf-9ca1-2ac2e4c48161 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:05.859483 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3f4674ca-2e02-4ecf-9ca1-2ac2e4c48161 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:05.860695 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3f4674ca-2e02-4ecf-9ca1-2ac2e4c48161 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] 10.222.0.39 "GET /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f" status: 200 len: 1358 microversion: 2.21 time: 0.285211 Aug 07 01:30:05.861262 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1831/4008] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:30:05 2022] GET /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f => generated 1358 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:30:05.904639 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ec7ebb5a-04b5-401d-9db9-384c782d0b3d tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "DELETE /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 204 len: 0 microversion: 2.1 time: 0.173850 Aug 07 01:30:05.906358 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2178/4009] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:30:05 2022] DELETE /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:30:05.917718 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b02975bb-35bd-4c5f-9558-ace7e1a868a4 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:05.918348 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b02975bb-35bd-4c5f-9558-ace7e1a868a4 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:05.926775 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b02975bb-35bd-4c5f-9558-ace7e1a868a4 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:05.927271 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b02975bb-35bd-4c5f-9558-ace7e1a868a4 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:05.927707 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b02975bb-35bd-4c5f-9558-ace7e1a868a4 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:05.928461 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b02975bb-35bd-4c5f-9558-ace7e1a868a4 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:05.929798 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b02975bb-35bd-4c5f-9558-ace7e1a868a4 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:05.930294 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b02975bb-35bd-4c5f-9558-ace7e1a868a4 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:06.128143 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b02975bb-35bd-4c5f-9558-ace7e1a868a4 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:06.140520 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b02975bb-35bd-4c5f-9558-ace7e1a868a4 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1506 microversion: 2.1 time: 0.229800 Aug 07 01:30:06.141111 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1832/4010] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:05 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1506 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:06.340159 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-40790f0a-b708-446b-9c76-4f434a58d8f9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:06.341694 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-40790f0a-b708-446b-9c76-4f434a58d8f9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:06.349037 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-40790f0a-b708-446b-9c76-4f434a58d8f9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:06.350109 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-40790f0a-b708-446b-9c76-4f434a58d8f9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:06.350688 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-40790f0a-b708-446b-9c76-4f434a58d8f9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:06.352551 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-40790f0a-b708-446b-9c76-4f434a58d8f9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:06.353204 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-40790f0a-b708-446b-9c76-4f434a58d8f9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:06.353794 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-40790f0a-b708-446b-9c76-4f434a58d8f9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:06.597522 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-97c0231c-a47c-4b9d-bfe0-de986c75b725 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:06.598421 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-97c0231c-a47c-4b9d-bfe0-de986c75b725 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: dbc593a0-5c59-4d1b-a538-157daf632f2e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:06.606091 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-97c0231c-a47c-4b9d-bfe0-de986c75b725 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:06.606776 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-97c0231c-a47c-4b9d-bfe0-de986c75b725 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:06.607357 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-97c0231c-a47c-4b9d-bfe0-de986c75b725 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:06.608301 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-97c0231c-a47c-4b9d-bfe0-de986c75b725 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:06.608905 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-97c0231c-a47c-4b9d-bfe0-de986c75b725 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:06.609461 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-97c0231c-a47c-4b9d-bfe0-de986c75b725 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:06.697857 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-40790f0a-b708-446b-9c76-4f434a58d8f9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:06.711326 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-40790f0a-b708-446b-9c76-4f434a58d8f9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1510 microversion: 2.1 time: 0.374491 Aug 07 01:30:06.712366 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2179/4011] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:06 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1510 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:06.863025 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-97c0231c-a47c-4b9d-bfe0-de986c75b725 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:06.872481 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-97c0231c-a47c-4b9d-bfe0-de986c75b725 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e" status: 200 len: 1314 microversion: 2.1 time: 0.278607 Aug 07 01:30:06.873343 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1833/4012] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:06 2022] GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:30:06.895072 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7335401e-e438-4f1c-8f99-7381dbf0e9c0 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:06.896480 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7335401e-e438-4f1c-8f99-7381dbf0e9c0 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] [instance: f2db3d5e-a955-44c7-8714-1f280d7a0a4f] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:06.903240 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7335401e-e438-4f1c-8f99-7381dbf0e9c0 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:06.903982 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7335401e-e438-4f1c-8f99-7381dbf0e9c0 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:06.904614 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7335401e-e438-4f1c-8f99-7381dbf0e9c0 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:06.905323 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7335401e-e438-4f1c-8f99-7381dbf0e9c0 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:06.906557 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7335401e-e438-4f1c-8f99-7381dbf0e9c0 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:06.907150 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7335401e-e438-4f1c-8f99-7381dbf0e9c0 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:07.149955 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7335401e-e438-4f1c-8f99-7381dbf0e9c0 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:07.162267 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d132e6e1-6017-44ec-9640-e150e588501a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:07.163107 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d132e6e1-6017-44ec-9640-e150e588501a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:07.175815 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7335401e-e438-4f1c-8f99-7381dbf0e9c0 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:07.176487 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d132e6e1-6017-44ec-9640-e150e588501a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:07.178154 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d132e6e1-6017-44ec-9640-e150e588501a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:07.179527 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7335401e-e438-4f1c-8f99-7381dbf0e9c0 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:07.180493 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d132e6e1-6017-44ec-9640-e150e588501a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:07.183322 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7335401e-e438-4f1c-8f99-7381dbf0e9c0 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] 10.222.0.39 "GET /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f" status: 200 len: 1358 microversion: 2.21 time: 0.293003 Aug 07 01:30:07.184573 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d132e6e1-6017-44ec-9640-e150e588501a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:07.186123 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d132e6e1-6017-44ec-9640-e150e588501a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:07.186757 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d132e6e1-6017-44ec-9640-e150e588501a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:07.191879 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2180/4013] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:30:06 2022] GET /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f => generated 1358 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:30:07.407819 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d132e6e1-6017-44ec-9640-e150e588501a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:07.417269 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d132e6e1-6017-44ec-9640-e150e588501a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1506 microversion: 2.1 time: 0.258757 Aug 07 01:30:07.418018 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1834/4014] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:07 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:30:07.733163 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9332606d-60a5-460a-9903-7e2a70f8da50 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:07.733798 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9332606d-60a5-460a-9903-7e2a70f8da50 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:07.742307 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9332606d-60a5-460a-9903-7e2a70f8da50 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:07.743736 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9332606d-60a5-460a-9903-7e2a70f8da50 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:07.744362 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9332606d-60a5-460a-9903-7e2a70f8da50 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:07.745931 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9332606d-60a5-460a-9903-7e2a70f8da50 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:07.746318 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-ff03d790-0312-4543-a832-ce2af16cad3e req-65cf53fa-fc3f-4729-bb3b-00d2f5dc683c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9b1883a-c95a-4c49-ad6d-335ecf03b015", "name": "network-vif-unplugged", "status": "completed", "tag": "cb3c2bf2-1cb1-4779-8b61-f6d977daac69"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:07.746952 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9332606d-60a5-460a-9903-7e2a70f8da50 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:07.747524 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9332606d-60a5-460a-9903-7e2a70f8da50 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:07.761644 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-ff03d790-0312-4543-a832-ce2af16cad3e req-65cf53fa-fc3f-4729-bb3b-00d2f5dc683c service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:07.762476 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-ff03d790-0312-4543-a832-ce2af16cad3e req-65cf53fa-fc3f-4729-bb3b-00d2f5dc683c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:07.763029 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-ff03d790-0312-4543-a832-ce2af16cad3e req-65cf53fa-fc3f-4729-bb3b-00d2f5dc683c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:07.777482 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-ff03d790-0312-4543-a832-ce2af16cad3e req-65cf53fa-fc3f-4729-bb3b-00d2f5dc683c service nova] Creating event network-vif-unplugged:cb3c2bf2-1cb1-4779-8b61-f6d977daac69 for instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 on n-h2-master-1 Aug 07 01:30:07.784796 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-ff03d790-0312-4543-a832-ce2af16cad3e req-65cf53fa-fc3f-4729-bb3b-00d2f5dc683c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047265 Aug 07 01:30:07.785851 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1835/4015] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:30:07.896074 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f63a9e14-2da6-4942-94f0-1d5d2dc85a8f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:07.897809 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f63a9e14-2da6-4942-94f0-1d5d2dc85a8f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: dbc593a0-5c59-4d1b-a538-157daf632f2e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:07.906142 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f63a9e14-2da6-4942-94f0-1d5d2dc85a8f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:07.907015 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f63a9e14-2da6-4942-94f0-1d5d2dc85a8f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:07.907601 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f63a9e14-2da6-4942-94f0-1d5d2dc85a8f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:07.908919 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f63a9e14-2da6-4942-94f0-1d5d2dc85a8f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:07.910269 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f63a9e14-2da6-4942-94f0-1d5d2dc85a8f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:07.910865 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f63a9e14-2da6-4942-94f0-1d5d2dc85a8f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:08.124343 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f63a9e14-2da6-4942-94f0-1d5d2dc85a8f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:08.140472 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f63a9e14-2da6-4942-94f0-1d5d2dc85a8f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e" status: 200 len: 1314 microversion: 2.1 time: 0.247149 Aug 07 01:30:08.140472 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1836/4016] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:07 2022] GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:08.144979 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-164ca3c1-6bdf-4bec-9dfe-63bd36af6bbd req-cef06191-333d-465c-98bd-3ce7f7d08a92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbc593a0-5c59-4d1b-a538-157daf632f2e", "tag": "cf795ae8-1c76-4ce2-921e-03697c19e1be"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:08.156331 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-164ca3c1-6bdf-4bec-9dfe-63bd36af6bbd req-cef06191-333d-465c-98bd-3ce7f7d08a92 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:08.156900 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-164ca3c1-6bdf-4bec-9dfe-63bd36af6bbd req-cef06191-333d-465c-98bd-3ce7f7d08a92 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:08.157338 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-164ca3c1-6bdf-4bec-9dfe-63bd36af6bbd req-cef06191-333d-465c-98bd-3ce7f7d08a92 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:08.174649 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-164ca3c1-6bdf-4bec-9dfe-63bd36af6bbd req-cef06191-333d-465c-98bd-3ce7f7d08a92 service nova] Creating event network-changed:cf795ae8-1c76-4ce2-921e-03697c19e1be for instance dbc593a0-5c59-4d1b-a538-157daf632f2e on n-h1-master-1 Aug 07 01:30:08.177493 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9332606d-60a5-460a-9903-7e2a70f8da50 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:08.180037 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-164ca3c1-6bdf-4bec-9dfe-63bd36af6bbd req-cef06191-333d-465c-98bd-3ce7f7d08a92 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039615 Aug 07 01:30:08.181095 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1837/4017] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:30:08.190431 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9332606d-60a5-460a-9903-7e2a70f8da50 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1510 microversion: 2.1 time: 0.461045 Aug 07 01:30:08.197357 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2181/4018] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:07 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1510 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:08.218837 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b5f15621-5009-40d3-b51e-164ad77133ef tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:08.220138 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b5f15621-5009-40d3-b51e-164ad77133ef tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] [instance: f2db3d5e-a955-44c7-8714-1f280d7a0a4f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:08.227815 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5f15621-5009-40d3-b51e-164ad77133ef tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:08.228336 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5f15621-5009-40d3-b51e-164ad77133ef tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:08.228824 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5f15621-5009-40d3-b51e-164ad77133ef tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:08.229577 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5f15621-5009-40d3-b51e-164ad77133ef tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:08.230039 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5f15621-5009-40d3-b51e-164ad77133ef tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:08.230471 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5f15621-5009-40d3-b51e-164ad77133ef tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:08.378118 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b5f15621-5009-40d3-b51e-164ad77133ef tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:08.393470 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b5f15621-5009-40d3-b51e-164ad77133ef tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:08.395226 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b5f15621-5009-40d3-b51e-164ad77133ef tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:08.397134 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b5f15621-5009-40d3-b51e-164ad77133ef tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] 10.222.0.39 "GET /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f" status: 200 len: 1551 microversion: 2.21 time: 0.186166 Aug 07 01:30:08.398019 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1838/4019] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:30:08 2022] GET /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f => generated 1551 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:30:08.431805 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ce2f07be-b3d0-4f45-bc70-d46ba016d14b tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:08.433008 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ce2f07be-b3d0-4f45-bc70-d46ba016d14b tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] [instance: f2db3d5e-a955-44c7-8714-1f280d7a0a4f] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:08.446418 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f0688a60-fd12-4253-bbf6-30b39683bdcf tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:08.446780 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce2f07be-b3d0-4f45-bc70-d46ba016d14b tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:08.447631 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce2f07be-b3d0-4f45-bc70-d46ba016d14b tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:08.448430 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce2f07be-b3d0-4f45-bc70-d46ba016d14b tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:08.449099 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f0688a60-fd12-4253-bbf6-30b39683bdcf tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:08.450957 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce2f07be-b3d0-4f45-bc70-d46ba016d14b tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:08.452347 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce2f07be-b3d0-4f45-bc70-d46ba016d14b tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:08.453308 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce2f07be-b3d0-4f45-bc70-d46ba016d14b tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:08.457969 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f0688a60-fd12-4253-bbf6-30b39683bdcf tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:08.458632 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f0688a60-fd12-4253-bbf6-30b39683bdcf tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:08.459332 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f0688a60-fd12-4253-bbf6-30b39683bdcf tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:08.460207 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f0688a60-fd12-4253-bbf6-30b39683bdcf tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:08.461916 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f0688a60-fd12-4253-bbf6-30b39683bdcf tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:08.462749 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f0688a60-fd12-4253-bbf6-30b39683bdcf tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:08.496790 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ce2f07be-b3d0-4f45-bc70-d46ba016d14b tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] [instance: f2db3d5e-a955-44c7-8714-1f280d7a0a4f] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:30:08.602333 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ce2f07be-b3d0-4f45-bc70-d46ba016d14b tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f" status: 204 len: 0 microversion: 2.21 time: 0.176358 Aug 07 01:30:08.603975 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2182/4020] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Aug 7 01:30:08 2022] DELETE /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 01:30:08.623580 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f0688a60-fd12-4253-bbf6-30b39683bdcf tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:08.627524 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8eda4acf-191b-4caf-9c01-f72b16da2bb4 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:08.628611 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8eda4acf-191b-4caf-9c01-f72b16da2bb4 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] [instance: f2db3d5e-a955-44c7-8714-1f280d7a0a4f] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:08.635117 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f0688a60-fd12-4253-bbf6-30b39683bdcf tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1506 microversion: 2.1 time: 0.196238 Aug 07 01:30:08.636115 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1839/4021] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:08 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1506 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:08.637261 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8eda4acf-191b-4caf-9c01-f72b16da2bb4 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:08.637922 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8eda4acf-191b-4caf-9c01-f72b16da2bb4 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:08.638631 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8eda4acf-191b-4caf-9c01-f72b16da2bb4 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:08.639559 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8eda4acf-191b-4caf-9c01-f72b16da2bb4 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:08.640237 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8eda4acf-191b-4caf-9c01-f72b16da2bb4 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:08.640856 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8eda4acf-191b-4caf-9c01-f72b16da2bb4 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:09.063542 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8eda4acf-191b-4caf-9c01-f72b16da2bb4 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:09.073939 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8eda4acf-191b-4caf-9c01-f72b16da2bb4 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:09.075854 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8eda4acf-191b-4caf-9c01-f72b16da2bb4 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:09.077334 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8eda4acf-191b-4caf-9c01-f72b16da2bb4 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] 10.222.0.39 "GET /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f" status: 200 len: 1557 microversion: 2.21 time: 0.467860 Aug 07 01:30:09.078417 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2183/4022] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:30:08 2022] GET /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f => generated 1557 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:30:09.163297 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ee9cd0f3-3027-46e9-841e-c09f1a95c4d6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:09.164020 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ee9cd0f3-3027-46e9-841e-c09f1a95c4d6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: dbc593a0-5c59-4d1b-a538-157daf632f2e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:09.183304 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee9cd0f3-3027-46e9-841e-c09f1a95c4d6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:09.183822 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee9cd0f3-3027-46e9-841e-c09f1a95c4d6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:09.187634 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee9cd0f3-3027-46e9-841e-c09f1a95c4d6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:09.189727 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee9cd0f3-3027-46e9-841e-c09f1a95c4d6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:09.190227 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee9cd0f3-3027-46e9-841e-c09f1a95c4d6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:09.190707 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee9cd0f3-3027-46e9-841e-c09f1a95c4d6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:09.211268 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cb5a5344-39ab-46a8-84f6-3a8d6c8115ea tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:09.212508 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cb5a5344-39ab-46a8-84f6-3a8d6c8115ea tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:09.227411 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb5a5344-39ab-46a8-84f6-3a8d6c8115ea tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:09.227630 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb5a5344-39ab-46a8-84f6-3a8d6c8115ea tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:09.234232 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb5a5344-39ab-46a8-84f6-3a8d6c8115ea tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:09.235254 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb5a5344-39ab-46a8-84f6-3a8d6c8115ea tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:09.235759 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb5a5344-39ab-46a8-84f6-3a8d6c8115ea tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:09.236247 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb5a5344-39ab-46a8-84f6-3a8d6c8115ea tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:09.522357 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cb5a5344-39ab-46a8-84f6-3a8d6c8115ea tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:09.535931 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cb5a5344-39ab-46a8-84f6-3a8d6c8115ea tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1510 microversion: 2.1 time: 0.326860 Aug 07 01:30:09.537320 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2184/4023] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:09 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1510 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:09.661269 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-10d240f8-c61e-4b58-8448-0c1bd8a4febf tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:09.661908 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-10d240f8-c61e-4b58-8448-0c1bd8a4febf tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:09.673640 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10d240f8-c61e-4b58-8448-0c1bd8a4febf tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:09.674145 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10d240f8-c61e-4b58-8448-0c1bd8a4febf tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:09.674585 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10d240f8-c61e-4b58-8448-0c1bd8a4febf tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:09.675311 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10d240f8-c61e-4b58-8448-0c1bd8a4febf tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:09.675771 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10d240f8-c61e-4b58-8448-0c1bd8a4febf tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:09.681567 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10d240f8-c61e-4b58-8448-0c1bd8a4febf tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:09.838393 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ee9cd0f3-3027-46e9-841e-c09f1a95c4d6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:09.850157 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ee9cd0f3-3027-46e9-841e-c09f1a95c4d6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e" status: 200 len: 1314 microversion: 2.1 time: 0.691441 Aug 07 01:30:09.851183 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1840/4024] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:09 2022] GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e => generated 1314 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:10.000061 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-10d240f8-c61e-4b58-8448-0c1bd8a4febf tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:10.008185 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-10d240f8-c61e-4b58-8448-0c1bd8a4febf tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1506 microversion: 2.1 time: 0.350783 Aug 07 01:30:10.008788 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2185/4025] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:09 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1506 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:10.099954 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-28bcdd57-309f-405a-919e-064ca46e402a tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:10.100557 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-28bcdd57-309f-405a-919e-064ca46e402a tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] [instance: f2db3d5e-a955-44c7-8714-1f280d7a0a4f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:10.108247 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28bcdd57-309f-405a-919e-064ca46e402a tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:10.108737 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28bcdd57-309f-405a-919e-064ca46e402a tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:10.109173 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28bcdd57-309f-405a-919e-064ca46e402a tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:10.110120 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28bcdd57-309f-405a-919e-064ca46e402a tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:10.111216 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28bcdd57-309f-405a-919e-064ca46e402a tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:10.111659 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28bcdd57-309f-405a-919e-064ca46e402a tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:10.262768 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-28bcdd57-309f-405a-919e-064ca46e402a tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:10.276924 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-28bcdd57-309f-405a-919e-064ca46e402a tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:10.278879 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-28bcdd57-309f-405a-919e-064ca46e402a tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:10.285888 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-28bcdd57-309f-405a-919e-064ca46e402a tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] 10.222.0.39 "GET /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f" status: 200 len: 1557 microversion: 2.21 time: 0.184162 Aug 07 01:30:10.286700 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1841/4026] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:30:10 2022] GET /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f => generated 1557 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:30:10.571637 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a02d2e93-c941-4760-8ad2-6a7369a6bd27 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:10.573702 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a02d2e93-c941-4760-8ad2-6a7369a6bd27 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:10.583340 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a02d2e93-c941-4760-8ad2-6a7369a6bd27 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:10.584538 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a02d2e93-c941-4760-8ad2-6a7369a6bd27 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:10.585409 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a02d2e93-c941-4760-8ad2-6a7369a6bd27 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:10.587628 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a02d2e93-c941-4760-8ad2-6a7369a6bd27 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:10.589068 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a02d2e93-c941-4760-8ad2-6a7369a6bd27 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:10.590280 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a02d2e93-c941-4760-8ad2-6a7369a6bd27 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:10.883345 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0d3e6b3f-de26-429d-b8cd-b8d7d9e8f0c0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:10.883986 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0d3e6b3f-de26-429d-b8cd-b8d7d9e8f0c0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: dbc593a0-5c59-4d1b-a538-157daf632f2e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:10.890066 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d3e6b3f-de26-429d-b8cd-b8d7d9e8f0c0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:10.890548 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d3e6b3f-de26-429d-b8cd-b8d7d9e8f0c0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:10.890980 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d3e6b3f-de26-429d-b8cd-b8d7d9e8f0c0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:10.891685 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d3e6b3f-de26-429d-b8cd-b8d7d9e8f0c0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:10.892167 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d3e6b3f-de26-429d-b8cd-b8d7d9e8f0c0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:10.892596 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d3e6b3f-de26-429d-b8cd-b8d7d9e8f0c0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:10.894783 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a02d2e93-c941-4760-8ad2-6a7369a6bd27 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:10.917541 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a02d2e93-c941-4760-8ad2-6a7369a6bd27 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1510 microversion: 2.1 time: 0.360496 Aug 07 01:30:10.918716 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2186/4027] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:10 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1510 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:11.029905 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-121587c2-1e9d-45f5-a8d1-e5643ab4eebe tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:11.030537 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-121587c2-1e9d-45f5-a8d1-e5643ab4eebe tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:11.037149 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-121587c2-1e9d-45f5-a8d1-e5643ab4eebe tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:11.037933 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-121587c2-1e9d-45f5-a8d1-e5643ab4eebe tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:11.038555 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-121587c2-1e9d-45f5-a8d1-e5643ab4eebe tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:11.039328 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-121587c2-1e9d-45f5-a8d1-e5643ab4eebe tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:11.039785 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-121587c2-1e9d-45f5-a8d1-e5643ab4eebe tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:11.040410 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-121587c2-1e9d-45f5-a8d1-e5643ab4eebe tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:11.212771 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0d3e6b3f-de26-429d-b8cd-b8d7d9e8f0c0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:11.224400 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0d3e6b3f-de26-429d-b8cd-b8d7d9e8f0c0 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e" status: 200 len: 1314 microversion: 2.1 time: 0.344039 Aug 07 01:30:11.231501 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1842/4028] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:10 2022] GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:30:11.319779 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b2e86ce7-0627-4481-8339-1d1bb2be5946 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:11.321612 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b2e86ce7-0627-4481-8339-1d1bb2be5946 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] [instance: f2db3d5e-a955-44c7-8714-1f280d7a0a4f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:11.332000 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2e86ce7-0627-4481-8339-1d1bb2be5946 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:11.332735 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2e86ce7-0627-4481-8339-1d1bb2be5946 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:11.333376 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2e86ce7-0627-4481-8339-1d1bb2be5946 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:11.334548 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2e86ce7-0627-4481-8339-1d1bb2be5946 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:11.337232 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2e86ce7-0627-4481-8339-1d1bb2be5946 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:11.337996 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2e86ce7-0627-4481-8339-1d1bb2be5946 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:11.562818 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-121587c2-1e9d-45f5-a8d1-e5643ab4eebe tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:11.588891 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-121587c2-1e9d-45f5-a8d1-e5643ab4eebe tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1506 microversion: 2.1 time: 0.562746 Aug 07 01:30:11.603446 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2187/4029] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:11 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1506 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:30:11.729213 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b2e86ce7-0627-4481-8339-1d1bb2be5946 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:11.751038 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b2e86ce7-0627-4481-8339-1d1bb2be5946 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:11.753771 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b2e86ce7-0627-4481-8339-1d1bb2be5946 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12d82ae0bf5f46668b0ff0e38ad77674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cbe49718bfe40c5b0f9587413635a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:11.755416 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b2e86ce7-0627-4481-8339-1d1bb2be5946 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] 10.222.0.39 "GET /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f" status: 200 len: 1557 microversion: 2.21 time: 0.445258 Aug 07 01:30:11.756584 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1843/4030] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:30:11 2022] GET /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f => generated 1557 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:30:11.939663 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1d0846f6-9dfa-4d83-895c-6f8195075a66 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:11.940650 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1d0846f6-9dfa-4d83-895c-6f8195075a66 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:11.963643 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d0846f6-9dfa-4d83-895c-6f8195075a66 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:11.967768 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d0846f6-9dfa-4d83-895c-6f8195075a66 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:11.968709 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d0846f6-9dfa-4d83-895c-6f8195075a66 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:11.969725 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d0846f6-9dfa-4d83-895c-6f8195075a66 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:11.970634 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d0846f6-9dfa-4d83-895c-6f8195075a66 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:11.972434 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d0846f6-9dfa-4d83-895c-6f8195075a66 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:12.045503 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-f665ca67-e287-4264-9c2c-238d2110fe86 req-6afafa60-db5b-4552-8285-62ebfe7cb4d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2db3d5e-a955-44c7-8714-1f280d7a0a4f", "name": "network-vif-deleted", "tag": "de6202e3-4f73-4ff5-8918-d619ed5d6300"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:12.065953 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f665ca67-e287-4264-9c2c-238d2110fe86 req-6afafa60-db5b-4552-8285-62ebfe7cb4d8 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:12.066858 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f665ca67-e287-4264-9c2c-238d2110fe86 req-6afafa60-db5b-4552-8285-62ebfe7cb4d8 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:12.067690 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f665ca67-e287-4264-9c2c-238d2110fe86 req-6afafa60-db5b-4552-8285-62ebfe7cb4d8 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:12.093779 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-f665ca67-e287-4264-9c2c-238d2110fe86 req-6afafa60-db5b-4552-8285-62ebfe7cb4d8 service nova] Creating event network-vif-deleted:de6202e3-4f73-4ff5-8918-d619ed5d6300 for instance f2db3d5e-a955-44c7-8714-1f280d7a0a4f on n-h1-master-1 Aug 07 01:30:12.099213 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-f665ca67-e287-4264-9c2c-238d2110fe86 req-6afafa60-db5b-4552-8285-62ebfe7cb4d8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057403 Aug 07 01:30:12.100559 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1844/4031] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:30:12.250163 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b4733189-6392-4011-bb95-834b6dbc08b9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:12.250855 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b4733189-6392-4011-bb95-834b6dbc08b9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: dbc593a0-5c59-4d1b-a538-157daf632f2e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:12.275102 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b4733189-6392-4011-bb95-834b6dbc08b9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:12.276135 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b4733189-6392-4011-bb95-834b6dbc08b9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:12.276816 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b4733189-6392-4011-bb95-834b6dbc08b9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:12.279457 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b4733189-6392-4011-bb95-834b6dbc08b9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:12.284324 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b4733189-6392-4011-bb95-834b6dbc08b9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:12.285081 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b4733189-6392-4011-bb95-834b6dbc08b9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:12.384241 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1d0846f6-9dfa-4d83-895c-6f8195075a66 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:12.393950 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1d0846f6-9dfa-4d83-895c-6f8195075a66 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1453 microversion: 2.1 time: 0.458864 Aug 07 01:30:12.416781 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2188/4032] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:11 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1453 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:12.441662 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a79f1725-4551-46ac-86b2-b4bd6fcda229 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:12.448098 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a79f1725-4551-46ac-86b2-b4bd6fcda229 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:12.467136 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a79f1725-4551-46ac-86b2-b4bd6fcda229 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:12.467741 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a79f1725-4551-46ac-86b2-b4bd6fcda229 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:12.469498 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a79f1725-4551-46ac-86b2-b4bd6fcda229 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:12.470484 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a79f1725-4551-46ac-86b2-b4bd6fcda229 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:12.470970 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a79f1725-4551-46ac-86b2-b4bd6fcda229 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:12.471408 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a79f1725-4551-46ac-86b2-b4bd6fcda229 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:12.626663 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b4733189-6392-4011-bb95-834b6dbc08b9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:12.636920 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b4733189-6392-4011-bb95-834b6dbc08b9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e" status: 200 len: 1314 microversion: 2.1 time: 0.394099 Aug 07 01:30:12.637991 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1845/4033] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:12 2022] GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:30:12.665271 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-f9c2d408-edf8-4223-bd85-43497bf746c5 req-bc75afea-8506-4ff8-9bc8-ca1daba948bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c50292-4191-4cb3-955b-757ad1575a17", "name": "network-vif-deleted", "tag": "c76a6bcd-5ca4-451e-a693-b5ee6ea2941a"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:12.677928 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f9c2d408-edf8-4223-bd85-43497bf746c5 req-bc75afea-8506-4ff8-9bc8-ca1daba948bd service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:12.678873 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f9c2d408-edf8-4223-bd85-43497bf746c5 req-bc75afea-8506-4ff8-9bc8-ca1daba948bd service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:12.679539 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f9c2d408-edf8-4223-bd85-43497bf746c5 req-bc75afea-8506-4ff8-9bc8-ca1daba948bd service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:12.713236 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-f9c2d408-edf8-4223-bd85-43497bf746c5 req-bc75afea-8506-4ff8-9bc8-ca1daba948bd service nova] Creating event network-vif-deleted:c76a6bcd-5ca4-451e-a693-b5ee6ea2941a for instance 70c50292-4191-4cb3-955b-757ad1575a17 on n-h2-master-1 Aug 07 01:30:12.723904 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-f9c2d408-edf8-4223-bd85-43497bf746c5 req-bc75afea-8506-4ff8-9bc8-ca1daba948bd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068424 Aug 07 01:30:12.726121 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1846/4034] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:30:12.735564 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-dfe12309-5472-4f8f-80cc-bc23d103121a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:12.736436 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-dfe12309-5472-4f8f-80cc-bc23d103121a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:12.744502 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dfe12309-5472-4f8f-80cc-bc23d103121a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:12.746050 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dfe12309-5472-4f8f-80cc-bc23d103121a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:12.746532 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dfe12309-5472-4f8f-80cc-bc23d103121a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:12.747412 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dfe12309-5472-4f8f-80cc-bc23d103121a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:12.747984 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dfe12309-5472-4f8f-80cc-bc23d103121a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:12.748416 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dfe12309-5472-4f8f-80cc-bc23d103121a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:12.790177 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dfe12309-5472-4f8f-80cc-bc23d103121a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:12.790594 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dfe12309-5472-4f8f-80cc-bc23d103121a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:12.791853 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dfe12309-5472-4f8f-80cc-bc23d103121a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:12.792527 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-dfe12309-5472-4f8f-80cc-bc23d103121a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lazy-loading 'fault' on Instance uuid 70c50292-4191-4cb3-955b-757ad1575a17 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:30:12.796233 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:12.839853 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-dfe12309-5472-4f8f-80cc-bc23d103121a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:12.843758 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a79f1725-4551-46ac-86b2-b4bd6fcda229 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:12.849147 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-dfe12309-5472-4f8f-80cc-bc23d103121a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 200 len: 1304 microversion: 2.1 time: 0.120783 Aug 07 01:30:12.850554 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1847/4035] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:12 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 1304 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:12.857404 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d00f3a93-7158-4cc9-8362-e56afd21ceff tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:12.858766 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d00f3a93-7158-4cc9-8362-e56afd21ceff tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] [instance: f2db3d5e-a955-44c7-8714-1f280d7a0a4f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:12.860187 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a79f1725-4551-46ac-86b2-b4bd6fcda229 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1453 microversion: 2.1 time: 0.441809 Aug 07 01:30:12.863401 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2189/4036] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:12 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1453 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:12.877587 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d00f3a93-7158-4cc9-8362-e56afd21ceff tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:12.878076 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d00f3a93-7158-4cc9-8362-e56afd21ceff tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:12.884539 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d00f3a93-7158-4cc9-8362-e56afd21ceff tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:12.885673 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d00f3a93-7158-4cc9-8362-e56afd21ceff tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:12.886452 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d00f3a93-7158-4cc9-8362-e56afd21ceff tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:12.887251 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d00f3a93-7158-4cc9-8362-e56afd21ceff tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:12.912591 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-d00f3a93-7158-4cc9-8362-e56afd21ceff tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] HTTP exception thrown: Instance f2db3d5e-a955-44c7-8714-1f280d7a0a4f could not be found. Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d00f3a93-7158-4cc9-8362-e56afd21ceff tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Request method failure captured: Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f HTTP/1.1 Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xWOu5noJca0KyUB5HVCvHLUzJdw27Xw_voddkeK4hvDiAa4OpXPCpMOOr4Miygf54iFZk__xP7OJV7sCJqJUS9zDswQQrbrdjn89k2oUbNUrQrsXFa5V7tmR1mVGhymcq2Kti2iFwLX-VnKBusqTNcYTjZh4ViJzdbb3wawmU7YIeE Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: X-Openstack-Nova-Api-Version: 2.21 Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 2cbe49718bfe40c5b0f9587413635a2e Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1858284062 Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2cbe49718bfe40c5b0f9587413635a2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2cbe49718bfe40c5b0f9587413635a2e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2cbe49718bfe40c5b0f9587413635a2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2cbe49718bfe40c5b0f9587413635a2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-InstanceActionsV221TestJSON-1858284062 Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 2cbe49718bfe40c5b0f9587413635a2e Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1858284062 Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-InstanceActionsV221TestJSON-1858284062-project Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 12d82ae0bf5f46668b0ff0e38ad77674 Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-InstanceActionsV221TestJSON-1858284062-project Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: exception: Instance f2db3d5e-a955-44c7-8714-1f280d7a0a4f could not be found. Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'f2db3d5e-a955-44c7-8714-1f280d7a0a4f'} Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2db3d5e-a955-44c7-8714-1f280d7a0a4f could not be found. Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2db3d5e-a955-44c7-8714-1f280d7a0a4f could not be found. Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:12.916022 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:30:12.921418 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:12.921418 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:30:12.921418 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:30:12.921418 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:30:12.921418 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:30:12.921418 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:30:12.921418 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2db3d5e-a955-44c7-8714-1f280d7a0a4f could not be found. Aug 07 01:30:12.921418 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:12.922342 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9190af6a-bc3a-4de3-873d-3742773e0b00 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:12.922342 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9190af6a-bc3a-4de3-873d-3742773e0b00 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:12.922342 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:12.924116 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d00f3a93-7158-4cc9-8362-e56afd21ceff tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Returning 404 to user: Instance f2db3d5e-a955-44c7-8714-1f280d7a0a4f could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:30:12.925604 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d00f3a93-7158-4cc9-8362-e56afd21ceff tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] 10.222.0.39 "GET /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f" status: 404 len: 111 microversion: 2.21 time: 0.073856 Aug 07 01:30:12.925960 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9190af6a-bc3a-4de3-873d-3742773e0b00 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:12.926498 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9190af6a-bc3a-4de3-873d-3742773e0b00 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:12.926946 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9190af6a-bc3a-4de3-873d-3742773e0b00 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:12.927384 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1848/4037] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:30:12 2022] GET /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:30:12.928876 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9190af6a-bc3a-4de3-873d-3742773e0b00 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:12.930243 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9190af6a-bc3a-4de3-873d-3742773e0b00 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:12.930859 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9190af6a-bc3a-4de3-873d-3742773e0b00 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:12.938701 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fa2973d8-f7b0-4a0d-b468-ae60943e512f tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Calling method '.version_select at 0x7f9e1788a3a0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:12.941391 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fa2973d8-f7b0-4a0d-b468-ae60943e512f tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] [instance: f2db3d5e-a955-44c7-8714-1f280d7a0a4f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:12.954241 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa2973d8-f7b0-4a0d-b468-ae60943e512f tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:12.955285 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa2973d8-f7b0-4a0d-b468-ae60943e512f tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:12.956055 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa2973d8-f7b0-4a0d-b468-ae60943e512f tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:12.958120 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa2973d8-f7b0-4a0d-b468-ae60943e512f tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:12.959390 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa2973d8-f7b0-4a0d-b468-ae60943e512f tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:12.962394 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa2973d8-f7b0-4a0d-b468-ae60943e512f tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:12.967520 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-9190af6a-bc3a-4de3-873d-3742773e0b00 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lazy-loading 'flavor' on Instance uuid d9b1883a-c95a-4c49-ad6d-335ecf03b015 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:30:12.984320 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-9190af6a-bc3a-4de3-873d-3742773e0b00 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] HTTP exception thrown: Cannot 'shelve' instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 while it is in vm_state shelved_offloaded Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9190af6a-bc3a-4de3-873d-3742773e0b00 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015/action HTTP/1.1 Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 14 Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: {"shelve": {}} Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: exception: Cannot 'shelve' instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 while it is in vm_state shelved_offloaded Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'd9b1883a-c95a-4c49-ad6d-335ecf03b015', 'body': {'shelve': {}}} Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 07 01:30:12.986262 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 07 01:30:12.991501 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 07 01:30:12.991501 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 07 01:30:12.991501 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 while it is in vm_state shelved_offloaded Aug 07 01:30:12.991501 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:30:12.991501 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:30:12.991501 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:30:12.991501 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:30:12.991501 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:30:12.991501 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:30:12.991501 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:30:12.991501 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:30:12.991501 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 while it is in vm_state shelved_offloaded Aug 07 01:30:12.991501 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:30:12.991501 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9190af6a-bc3a-4de3-873d-3742773e0b00 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 409 to user: Cannot 'shelve' instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 while it is in vm_state shelved_offloaded {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:30:12.991501 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9190af6a-bc3a-4de3-873d-3742773e0b00 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015/action" status: 409 len: 155 microversion: 2.1 time: 0.075102 Aug 07 01:30:12.991501 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2190/4038] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:30:12 2022] POST /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015/action => generated 155 bytes in 77 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:30:13.017494 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ac17a9d8-bf5b-46d5-81d7-ad3bf018294c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:13.018298 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ac17a9d8-bf5b-46d5-81d7-ad3bf018294c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:13.027187 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac17a9d8-bf5b-46d5-81d7-ad3bf018294c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:13.027796 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac17a9d8-bf5b-46d5-81d7-ad3bf018294c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:13.028358 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac17a9d8-bf5b-46d5-81d7-ad3bf018294c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:13.029243 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac17a9d8-bf5b-46d5-81d7-ad3bf018294c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:13.030092 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac17a9d8-bf5b-46d5-81d7-ad3bf018294c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:13.030718 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac17a9d8-bf5b-46d5-81d7-ad3bf018294c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:13.086453 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fa2973d8-f7b0-4a0d-b468-ae60943e512f tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] 10.222.0.39 "GET /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.153657 Aug 07 01:30:13.087916 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1849/4039] 10.222.0.39 () {60 vars in 1337 bytes} [Sun Aug 7 01:30:12 2022] GET /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f/os-instance-actions => generated 611 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:30:13.105661 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0e121de6-0645-4e25-8b24-5fba982416f4 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:13.105981 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ac17a9d8-bf5b-46d5-81d7-ad3bf018294c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119516) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 07 01:30:13.106802 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0e121de6-0645-4e25-8b24-5fba982416f4 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] [instance: f2db3d5e-a955-44c7-8714-1f280d7a0a4f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:13.136964 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e121de6-0645-4e25-8b24-5fba982416f4 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:13.138675 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e121de6-0645-4e25-8b24-5fba982416f4 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:13.139342 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e121de6-0645-4e25-8b24-5fba982416f4 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:13.142240 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e121de6-0645-4e25-8b24-5fba982416f4 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:13.144832 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e121de6-0645-4e25-8b24-5fba982416f4 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:13.146681 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e121de6-0645-4e25-8b24-5fba982416f4 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:13.185370 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-0e121de6-0645-4e25-8b24-5fba982416f4 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] HTTP exception thrown: Instance f2db3d5e-a955-44c7-8714-1f280d7a0a4f could not be found. Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0e121de6-0645-4e25-8b24-5fba982416f4 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Request method failure captured: Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f HTTP/1.1 Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xWOu5noJca0KyUB5HVCvHLUzJdw27Xw_voddkeK4hvDiAa4OpXPCpMOOr4Miygf54iFZk__xP7OJV7sCJqJUS9zDswQQrbrdjn89k2oUbNUrQrsXFa5V7tmR1mVGhymcq2Kti2iFwLX-VnKBusqTNcYTjZh4ViJzdbb3wawmU7YIeE Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: X-Openstack-Nova-Api-Version: 2.21 Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 2cbe49718bfe40c5b0f9587413635a2e Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1858284062 Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2cbe49718bfe40c5b0f9587413635a2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2cbe49718bfe40c5b0f9587413635a2e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2cbe49718bfe40c5b0f9587413635a2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2cbe49718bfe40c5b0f9587413635a2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-InstanceActionsV221TestJSON-1858284062 Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 2cbe49718bfe40c5b0f9587413635a2e Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1858284062 Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-InstanceActionsV221TestJSON-1858284062-project Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 12d82ae0bf5f46668b0ff0e38ad77674 Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-InstanceActionsV221TestJSON-1858284062-project Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: exception: Instance f2db3d5e-a955-44c7-8714-1f280d7a0a4f could not be found. Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'f2db3d5e-a955-44c7-8714-1f280d7a0a4f'} Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2db3d5e-a955-44c7-8714-1f280d7a0a4f could not be found. Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:30:13.189642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:30:13.193708 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2db3d5e-a955-44c7-8714-1f280d7a0a4f could not be found. Aug 07 01:30:13.193708 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:13.193708 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:30:13.193708 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:13.193708 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:30:13.193708 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:30:13.193708 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:30:13.193708 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:30:13.193708 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:30:13.193708 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2db3d5e-a955-44c7-8714-1f280d7a0a4f could not be found. Aug 07 01:30:13.193708 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:13.193708 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0e121de6-0645-4e25-8b24-5fba982416f4 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Returning 404 to user: Instance f2db3d5e-a955-44c7-8714-1f280d7a0a4f could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:30:13.193708 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0e121de6-0645-4e25-8b24-5fba982416f4 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f" status: 404 len: 111 microversion: 2.21 time: 0.093652 Aug 07 01:30:13.193708 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1850/4040] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Aug 7 01:30:13 2022] DELETE /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:30:13.203674 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-092a5d4d-45aa-4fb5-aabf-067d31a98e59 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:13.204328 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:13.204718 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-092a5d4d-45aa-4fb5-aabf-067d31a98e59 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] [instance: f2db3d5e-a955-44c7-8714-1f280d7a0a4f] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:13.221657 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-092a5d4d-45aa-4fb5-aabf-067d31a98e59 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:13.222233 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-092a5d4d-45aa-4fb5-aabf-067d31a98e59 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:13.222404 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ac17a9d8-bf5b-46d5-81d7-ad3bf018294c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015/action" status: 202 len: 0 microversion: 2.1 time: 0.211382 Aug 07 01:30:13.223316 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-092a5d4d-45aa-4fb5-aabf-067d31a98e59 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:13.223489 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-092a5d4d-45aa-4fb5-aabf-067d31a98e59 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:13.228238 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-092a5d4d-45aa-4fb5-aabf-067d31a98e59 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:13.228866 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-092a5d4d-45aa-4fb5-aabf-067d31a98e59 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:13.229901 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2191/4041] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:30:13 2022] POST /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:30:13.237127 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1b7df4fa-577f-48eb-b89b-a5e313132bcd tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:13.238012 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1b7df4fa-577f-48eb-b89b-a5e313132bcd tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:13.249778 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b7df4fa-577f-48eb-b89b-a5e313132bcd tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:13.250763 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b7df4fa-577f-48eb-b89b-a5e313132bcd tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:13.251613 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b7df4fa-577f-48eb-b89b-a5e313132bcd tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:13.253259 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b7df4fa-577f-48eb-b89b-a5e313132bcd tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:13.254021 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b7df4fa-577f-48eb-b89b-a5e313132bcd tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:13.254175 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-092a5d4d-45aa-4fb5-aabf-067d31a98e59 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] HTTP exception thrown: Instance f2db3d5e-a955-44c7-8714-1f280d7a0a4f could not be found. Aug 07 01:30:13.255129 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b7df4fa-577f-48eb-b89b-a5e313132bcd tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-092a5d4d-45aa-4fb5-aabf-067d31a98e59 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Request method failure captured: Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f HTTP/1.1 Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xWOu5noJca0KyUB5HVCvHLUzJdw27Xw_voddkeK4hvDiAa4OpXPCpMOOr4Miygf54iFZk__xP7OJV7sCJqJUS9zDswQQrbrdjn89k2oUbNUrQrsXFa5V7tmR1mVGhymcq2Kti2iFwLX-VnKBusqTNcYTjZh4ViJzdbb3wawmU7YIeE Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: X-Openstack-Nova-Api-Version: 2.21 Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 2cbe49718bfe40c5b0f9587413635a2e Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1858284062 Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2cbe49718bfe40c5b0f9587413635a2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2cbe49718bfe40c5b0f9587413635a2e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2cbe49718bfe40c5b0f9587413635a2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2cbe49718bfe40c5b0f9587413635a2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-InstanceActionsV221TestJSON-1858284062 Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 2cbe49718bfe40c5b0f9587413635a2e Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1858284062 Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-InstanceActionsV221TestJSON-1858284062-project Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 12d82ae0bf5f46668b0ff0e38ad77674 Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-InstanceActionsV221TestJSON-1858284062-project Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: exception: Instance f2db3d5e-a955-44c7-8714-1f280d7a0a4f could not be found. Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'f2db3d5e-a955-44c7-8714-1f280d7a0a4f'} Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2db3d5e-a955-44c7-8714-1f280d7a0a4f could not be found. Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2db3d5e-a955-44c7-8714-1f280d7a0a4f could not be found. Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:13.256430 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:30:13.264223 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:13.264223 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:30:13.264223 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:30:13.264223 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:30:13.264223 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:30:13.264223 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:30:13.264223 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2db3d5e-a955-44c7-8714-1f280d7a0a4f could not be found. Aug 07 01:30:13.264223 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:13.264223 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-092a5d4d-45aa-4fb5-aabf-067d31a98e59 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] Returning 404 to user: Instance f2db3d5e-a955-44c7-8714-1f280d7a0a4f could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:30:13.264223 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-092a5d4d-45aa-4fb5-aabf-067d31a98e59 tempest-InstanceActionsV221TestJSON-1858284062 tempest-InstanceActionsV221TestJSON-1858284062-project] 10.222.0.39 "GET /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f" status: 404 len: 111 microversion: 2.21 time: 0.061425 Aug 07 01:30:13.264223 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1851/4042] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:30:13 2022] GET /compute/v2.1/servers/f2db3d5e-a955-44c7-8714-1f280d7a0a4f => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 07 01:30:13.668225 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-079cec23-05fa-4b19-a1c9-1da8c6ff4995 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:13.668902 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-079cec23-05fa-4b19-a1c9-1da8c6ff4995 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: dbc593a0-5c59-4d1b-a538-157daf632f2e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:13.675817 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-079cec23-05fa-4b19-a1c9-1da8c6ff4995 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:13.676560 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-079cec23-05fa-4b19-a1c9-1da8c6ff4995 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:13.677300 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-079cec23-05fa-4b19-a1c9-1da8c6ff4995 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:13.678051 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-079cec23-05fa-4b19-a1c9-1da8c6ff4995 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:13.678726 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-079cec23-05fa-4b19-a1c9-1da8c6ff4995 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:13.679365 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-079cec23-05fa-4b19-a1c9-1da8c6ff4995 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:13.883759 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=4 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:13.944667 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-079cec23-05fa-4b19-a1c9-1da8c6ff4995 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:13.955302 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-079cec23-05fa-4b19-a1c9-1da8c6ff4995 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e" status: 200 len: 1314 microversion: 2.1 time: 0.293062 Aug 07 01:30:13.956270 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1852/4043] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:13 2022] GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:13.963383 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-21c80e26-2a81-4cde-a57f-cb68341a2330 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:13.964929 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-21c80e26-2a81-4cde-a57f-cb68341a2330 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 70c50292-4191-4cb3-955b-757ad1575a17] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:13.977020 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21c80e26-2a81-4cde-a57f-cb68341a2330 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:13.978307 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21c80e26-2a81-4cde-a57f-cb68341a2330 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:13.979172 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21c80e26-2a81-4cde-a57f-cb68341a2330 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:13.980208 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21c80e26-2a81-4cde-a57f-cb68341a2330 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:13.980803 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21c80e26-2a81-4cde-a57f-cb68341a2330 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:13.981419 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21c80e26-2a81-4cde-a57f-cb68341a2330 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:14.010679 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-21c80e26-2a81-4cde-a57f-cb68341a2330 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] HTTP exception thrown: Instance 70c50292-4191-4cb3-955b-757ad1575a17 could not be found. Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-21c80e26-2a81-4cde-a57f-cb68341a2330 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Request method failure captured: Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 HTTP/1.1 Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xUjTGOBsVQ2tlky-dk22xF4n-F1jDvk6xs6bnkwRK2HIsBPysUQFsgcLT6Ozu2XnIvhqm9F6Al2T06FIV9E-9AqnILpW0BR5HPcAypI3bvRbhGVw7kwA-KJTIz8VlF-zeLRpJrrvE3O__OP5CRoNgG9NEHPJstxQlDX1YkC468Wp0E Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: d8face435f3549b5adbadf2f94707712 Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServerRescueTestJSON-1756641241 Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d8face435f3549b5adbadf2f94707712"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d8face435f3549b5adbadf2f94707712", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d8face435f3549b5adbadf2f94707712"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d8face435f3549b5adbadf2f94707712"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServerRescueTestJSON-1756641241 Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: d8face435f3549b5adbadf2f94707712 Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServerRescueTestJSON-1756641241 Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServerRescueTestJSON-1756641241-project Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 845cd61b22924fd3a915186a6093ac12 Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServerRescueTestJSON-1756641241-project Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 70c50292-4191-4cb3-955b-757ad1575a17 could not be found. Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '70c50292-4191-4cb3-955b-757ad1575a17'} Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70c50292-4191-4cb3-955b-757ad1575a17 could not be found. Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70c50292-4191-4cb3-955b-757ad1575a17 could not be found. Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:30:14.012698 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:14.022891 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:30:14.022891 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:30:14.022891 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:30:14.022891 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:30:14.022891 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:30:14.022891 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70c50292-4191-4cb3-955b-757ad1575a17 could not be found. Aug 07 01:30:14.022891 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:14.022891 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-21c80e26-2a81-4cde-a57f-cb68341a2330 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Returning 404 to user: Instance 70c50292-4191-4cb3-955b-757ad1575a17 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:30:14.022891 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-21c80e26-2a81-4cde-a57f-cb68341a2330 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17" status: 404 len: 111 microversion: 2.1 time: 0.057046 Aug 07 01:30:14.022891 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1853/4044] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:13 2022] GET /compute/v2.1/servers/70c50292-4191-4cb3-955b-757ad1575a17 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:30:14.028974 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8aed33e7-0656-42f7-9a3c-2cf92343f35f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:14.030264 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8aed33e7-0656-42f7-9a3c-2cf92343f35f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:14.038563 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8aed33e7-0656-42f7-9a3c-2cf92343f35f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:14.039275 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8aed33e7-0656-42f7-9a3c-2cf92343f35f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:14.039812 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8aed33e7-0656-42f7-9a3c-2cf92343f35f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:14.040956 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8aed33e7-0656-42f7-9a3c-2cf92343f35f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:14.041546 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8aed33e7-0656-42f7-9a3c-2cf92343f35f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:14.042168 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8aed33e7-0656-42f7-9a3c-2cf92343f35f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:14.063282 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1b7df4fa-577f-48eb-b89b-a5e313132bcd tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:14.074583 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1b7df4fa-577f-48eb-b89b-a5e313132bcd tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1461 microversion: 2.1 time: 0.843418 Aug 07 01:30:14.075517 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2192/4045] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:13 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1461 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:14.098918 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8aed33e7-0656-42f7-9a3c-2cf92343f35f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:30:14.189783 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=16 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:14.199657 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-91fa9ac8-01ac-45dd-938d-fe933598cf47 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:14.200335 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-91fa9ac8-01ac-45dd-938d-fe933598cf47 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:14.214941 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91fa9ac8-01ac-45dd-938d-fe933598cf47 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:14.219782 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91fa9ac8-01ac-45dd-938d-fe933598cf47 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:14.220622 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91fa9ac8-01ac-45dd-938d-fe933598cf47 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:14.221579 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91fa9ac8-01ac-45dd-938d-fe933598cf47 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:14.222284 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91fa9ac8-01ac-45dd-938d-fe933598cf47 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:14.222977 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91fa9ac8-01ac-45dd-938d-fe933598cf47 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:14.224143 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8aed33e7-0656-42f7-9a3c-2cf92343f35f tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "DELETE /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 204 len: 0 microversion: 2.1 time: 0.200926 Aug 07 01:30:14.228084 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1854/4046] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:30:14 2022] DELETE /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:30:14.238243 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-aab92c91-9a15-490e-b91f-dcba171606a0 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:14.239686 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-aab92c91-9a15-490e-b91f-dcba171606a0 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:14.258392 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aab92c91-9a15-490e-b91f-dcba171606a0 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:14.260150 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aab92c91-9a15-490e-b91f-dcba171606a0 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:14.260846 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aab92c91-9a15-490e-b91f-dcba171606a0 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:14.263322 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aab92c91-9a15-490e-b91f-dcba171606a0 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:14.264023 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aab92c91-9a15-490e-b91f-dcba171606a0 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:14.266892 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aab92c91-9a15-490e-b91f-dcba171606a0 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:14.515569 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-91fa9ac8-01ac-45dd-938d-fe933598cf47 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:14.527836 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-91fa9ac8-01ac-45dd-938d-fe933598cf47 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.333572 Aug 07 01:30:14.535594 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2193/4047] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:14 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:14.547219 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-aab92c91-9a15-490e-b91f-dcba171606a0 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:14.559345 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-aab92c91-9a15-490e-b91f-dcba171606a0 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1490 microversion: 2.1 time: 0.329688 Aug 07 01:30:14.562538 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1855/4048] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:14 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1490 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:14.565649 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-67412d7c-1c3c-4e6a-abf5-63da9e436241 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:14.573661 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-67412d7c-1c3c-4e6a-abf5-63da9e436241 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:14.591412 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67412d7c-1c3c-4e6a-abf5-63da9e436241 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:14.591669 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-0685d15e-f32f-4641-8cb0-2ff894500648 req-342b48cd-b677-4281-8b15-768a70d12a22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc593a0-5c59-4d1b-a538-157daf632f2e", "name": "network-vif-plugged", "status": "completed", "tag": "cf795ae8-1c76-4ce2-921e-03697c19e1be"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:14.592516 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67412d7c-1c3c-4e6a-abf5-63da9e436241 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:14.593171 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67412d7c-1c3c-4e6a-abf5-63da9e436241 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:14.594219 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67412d7c-1c3c-4e6a-abf5-63da9e436241 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:14.594219 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67412d7c-1c3c-4e6a-abf5-63da9e436241 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:14.595224 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67412d7c-1c3c-4e6a-abf5-63da9e436241 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:14.622489 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0685d15e-f32f-4641-8cb0-2ff894500648 req-342b48cd-b677-4281-8b15-768a70d12a22 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:14.623144 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0685d15e-f32f-4641-8cb0-2ff894500648 req-342b48cd-b677-4281-8b15-768a70d12a22 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:14.626320 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0685d15e-f32f-4641-8cb0-2ff894500648 req-342b48cd-b677-4281-8b15-768a70d12a22 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:14.658450 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-0685d15e-f32f-4641-8cb0-2ff894500648 req-342b48cd-b677-4281-8b15-768a70d12a22 service nova] Creating event network-vif-plugged:cf795ae8-1c76-4ce2-921e-03697c19e1be for instance dbc593a0-5c59-4d1b-a538-157daf632f2e on n-h1-master-1 Aug 07 01:30:14.669047 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-0685d15e-f32f-4641-8cb0-2ff894500648 req-342b48cd-b677-4281-8b15-768a70d12a22 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085687 Aug 07 01:30:14.670575 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1856/4049] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:30:14.920532 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-67412d7c-1c3c-4e6a-abf5-63da9e436241 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:14.948058 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-67412d7c-1c3c-4e6a-abf5-63da9e436241 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.388789 Aug 07 01:30:14.948700 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2194/4050] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:14 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:14.977068 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-68c73d7f-b3dd-45d5-a28b-93b36562ea5c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:14.978667 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-68c73d7f-b3dd-45d5-a28b-93b36562ea5c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:14.994452 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a8eb2055-e88e-469b-bb05-0b679ca67348 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:14.995960 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a8eb2055-e88e-469b-bb05-0b679ca67348 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: dbc593a0-5c59-4d1b-a538-157daf632f2e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:15.001304 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68c73d7f-b3dd-45d5-a28b-93b36562ea5c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:15.005758 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68c73d7f-b3dd-45d5-a28b-93b36562ea5c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:15.009021 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68c73d7f-b3dd-45d5-a28b-93b36562ea5c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:15.012223 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8eb2055-e88e-469b-bb05-0b679ca67348 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:15.012571 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68c73d7f-b3dd-45d5-a28b-93b36562ea5c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:15.013758 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68c73d7f-b3dd-45d5-a28b-93b36562ea5c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:15.014975 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68c73d7f-b3dd-45d5-a28b-93b36562ea5c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:15.016130 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8eb2055-e88e-469b-bb05-0b679ca67348 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:15.017034 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8eb2055-e88e-469b-bb05-0b679ca67348 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:15.019725 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8eb2055-e88e-469b-bb05-0b679ca67348 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:15.022043 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8eb2055-e88e-469b-bb05-0b679ca67348 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:15.024136 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8eb2055-e88e-469b-bb05-0b679ca67348 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:15.338520 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-68c73d7f-b3dd-45d5-a28b-93b36562ea5c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:15.348797 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-68c73d7f-b3dd-45d5-a28b-93b36562ea5c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.378401 Aug 07 01:30:15.350021 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1857/4051] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:14 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:15.373045 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c6ddcad3-326d-46cc-8508-18c83dc89090 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:15.373831 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c6ddcad3-326d-46cc-8508-18c83dc89090 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:15.381005 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6ddcad3-326d-46cc-8508-18c83dc89090 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:15.381660 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6ddcad3-326d-46cc-8508-18c83dc89090 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:15.382326 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6ddcad3-326d-46cc-8508-18c83dc89090 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:15.383265 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6ddcad3-326d-46cc-8508-18c83dc89090 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:15.383821 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6ddcad3-326d-46cc-8508-18c83dc89090 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:15.384361 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6ddcad3-326d-46cc-8508-18c83dc89090 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:15.408629 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a8eb2055-e88e-469b-bb05-0b679ca67348 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:15.421636 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a8eb2055-e88e-469b-bb05-0b679ca67348 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e" status: 200 len: 1314 microversion: 2.1 time: 0.433451 Aug 07 01:30:15.424449 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2195/4052] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:14 2022] GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:15.432454 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0a13223a-fc9c-45e0-b0fb-e41bfdc74167 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:15.438748 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0a13223a-fc9c-45e0-b0fb-e41bfdc74167 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:15.446212 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a13223a-fc9c-45e0-b0fb-e41bfdc74167 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:15.446970 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a13223a-fc9c-45e0-b0fb-e41bfdc74167 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:15.447773 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a13223a-fc9c-45e0-b0fb-e41bfdc74167 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:15.448699 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a13223a-fc9c-45e0-b0fb-e41bfdc74167 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:15.449415 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a13223a-fc9c-45e0-b0fb-e41bfdc74167 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:15.450207 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a13223a-fc9c-45e0-b0fb-e41bfdc74167 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:15.760237 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0a13223a-fc9c-45e0-b0fb-e41bfdc74167 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:15.777262 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0a13223a-fc9c-45e0-b0fb-e41bfdc74167 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.349417 Aug 07 01:30:15.778028 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2196/4053] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:15 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:15.784454 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-798733e9-4181-4b5b-b4db-0392c11217fc tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:15.785318 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-798733e9-4181-4b5b-b4db-0392c11217fc tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:15.793149 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-798733e9-4181-4b5b-b4db-0392c11217fc tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:15.793660 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-798733e9-4181-4b5b-b4db-0392c11217fc tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:15.794228 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-798733e9-4181-4b5b-b4db-0392c11217fc tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:15.795044 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-798733e9-4181-4b5b-b4db-0392c11217fc tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:15.795516 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-798733e9-4181-4b5b-b4db-0392c11217fc tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:15.796418 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-798733e9-4181-4b5b-b4db-0392c11217fc tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:16.047939 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-798733e9-4181-4b5b-b4db-0392c11217fc tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:16.062721 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-798733e9-4181-4b5b-b4db-0392c11217fc tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1490 microversion: 2.1 time: 0.283385 Aug 07 01:30:16.063479 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2197/4054] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:15 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1490 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:16.068594 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-85d4e371-42d7-4d45-924f-70eb6fd6ca47 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1206229242", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "38e7289f-8c36-40c7-bc8a-a94f77b67d92"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:16.111877 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c6ddcad3-326d-46cc-8508-18c83dc89090 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:16.136241 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c6ddcad3-326d-46cc-8508-18c83dc89090 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1519 microversion: 2.1 time: 0.782212 Aug 07 01:30:16.137862 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1858/4055] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:15 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1519 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:16.163690 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-85d4e371-42d7-4d45-924f-70eb6fd6ca47 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] validate_networks() for [('38e7289f-8c36-40c7-bc8a-a94f77b67d92', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:30:16.449457 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1e2ad1f8-5f6e-4b62-b4d6-9bec3b17847f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:16.450603 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1e2ad1f8-5f6e-4b62-b4d6-9bec3b17847f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: dbc593a0-5c59-4d1b-a538-157daf632f2e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:16.463105 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e2ad1f8-5f6e-4b62-b4d6-9bec3b17847f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:16.464443 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e2ad1f8-5f6e-4b62-b4d6-9bec3b17847f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:16.465076 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e2ad1f8-5f6e-4b62-b4d6-9bec3b17847f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:16.467871 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e2ad1f8-5f6e-4b62-b4d6-9bec3b17847f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:16.468871 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e2ad1f8-5f6e-4b62-b4d6-9bec3b17847f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:16.470131 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e2ad1f8-5f6e-4b62-b4d6-9bec3b17847f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:16.847651 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-85d4e371-42d7-4d45-924f-70eb6fd6ca47 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:30:16.848151 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-85d4e371-42d7-4d45-924f-70eb6fd6ca47 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:30:16.848610 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-85d4e371-42d7-4d45-924f-70eb6fd6ca47 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:30:16.849014 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-85d4e371-42d7-4d45-924f-70eb6fd6ca47 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:30:16.849443 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-85d4e371-42d7-4d45-924f-70eb6fd6ca47 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:30:16.869165 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-85d4e371-42d7-4d45-924f-70eb6fd6ca47 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:16.869876 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-85d4e371-42d7-4d45-924f-70eb6fd6ca47 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:16.870415 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-85d4e371-42d7-4d45-924f-70eb6fd6ca47 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:16.871257 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-85d4e371-42d7-4d45-924f-70eb6fd6ca47 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:16.872754 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-85d4e371-42d7-4d45-924f-70eb6fd6ca47 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:16.873410 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-85d4e371-42d7-4d45-924f-70eb6fd6ca47 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:16.932843 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-85d4e371-42d7-4d45-924f-70eb6fd6ca47 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Getting quotas for project 939fea7fa6ea4deda8d4fbef70a4e510. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:30:16.951145 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-85d4e371-42d7-4d45-924f-70eb6fd6ca47 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Getting quotas for user ef29bd35cca547c39d76c54058d32979 and project 939fea7fa6ea4deda8d4fbef70a4e510. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:30:16.987070 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-85d4e371-42d7-4d45-924f-70eb6fd6ca47 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:30:16.994962 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-85d4e371-42d7-4d45-924f-70eb6fd6ca47 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 6ddf1e46-f885-4128-9530-5118bc687cde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:30:17.100892 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1e2ad1f8-5f6e-4b62-b4d6-9bec3b17847f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:17.135209 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1e2ad1f8-5f6e-4b62-b4d6-9bec3b17847f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e" status: 200 len: 1314 microversion: 2.1 time: 0.691338 Aug 07 01:30:17.154915 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1859/4056] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:16 2022] GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e => generated 1314 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:17.183256 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-85d4e371-42d7-4d45-924f-70eb6fd6ca47 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.118555 Aug 07 01:30:17.183948 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2198/4057] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:30:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:30:17.193470 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-52bf274b-09e9-4d7a-b19e-dbc513dbfe3a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:17.193985 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-52bf274b-09e9-4d7a-b19e-dbc513dbfe3a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:17.228951 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-324a767e-53c8-4421-a973-0911e4f967b9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:17.229605 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-324a767e-53c8-4421-a973-0911e4f967b9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:17.252230 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52bf274b-09e9-4d7a-b19e-dbc513dbfe3a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:17.252764 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52bf274b-09e9-4d7a-b19e-dbc513dbfe3a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:17.253217 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52bf274b-09e9-4d7a-b19e-dbc513dbfe3a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:17.253952 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52bf274b-09e9-4d7a-b19e-dbc513dbfe3a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:17.254660 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52bf274b-09e9-4d7a-b19e-dbc513dbfe3a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:17.254841 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52bf274b-09e9-4d7a-b19e-dbc513dbfe3a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:17.275376 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-324a767e-53c8-4421-a973-0911e4f967b9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:17.276345 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-324a767e-53c8-4421-a973-0911e4f967b9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:17.276975 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-324a767e-53c8-4421-a973-0911e4f967b9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:17.281083 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-324a767e-53c8-4421-a973-0911e4f967b9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:17.281985 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-324a767e-53c8-4421-a973-0911e4f967b9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:17.288220 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-324a767e-53c8-4421-a973-0911e4f967b9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:17.598166 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-52bf274b-09e9-4d7a-b19e-dbc513dbfe3a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:17.618458 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-52bf274b-09e9-4d7a-b19e-dbc513dbfe3a tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1448 microversion: 2.1 time: 0.457994 Aug 07 01:30:17.619443 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1860/4058] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:17 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1448 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:17.628367 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-87232516-4dd8-4d7c-b936-3ca1229123c9 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:17.632004 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-87232516-4dd8-4d7c-b936-3ca1229123c9 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 6ddf1e46-f885-4128-9530-5118bc687cde] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:17.768622 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-87232516-4dd8-4d7c-b936-3ca1229123c9 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:17.824427 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-87232516-4dd8-4d7c-b936-3ca1229123c9 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde" status: 200 len: 1215 microversion: 2.1 time: 0.203608 Aug 07 01:30:17.841089 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1861/4059] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:17 2022] GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde => generated 1215 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:17.841089 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-760e349a-acee-4057-9b14-95d98861ba2b req-b74c5fb8-9288-4a75-abe8-916bccb48886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e64da4-c05c-4bdc-a42c-7fbb858c846a", "name": "network-vif-deleted", "tag": "738890f4-f9c5-48ca-8d3f-3d153d3b482d"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:17.850877 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-324a767e-53c8-4421-a973-0911e4f967b9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:17.859434 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-324a767e-53c8-4421-a973-0911e4f967b9 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1519 microversion: 2.1 time: 0.672133 Aug 07 01:30:17.873356 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2199/4060] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:17 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1519 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:17.877436 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-760e349a-acee-4057-9b14-95d98861ba2b req-b74c5fb8-9288-4a75-abe8-916bccb48886 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:17.878252 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-760e349a-acee-4057-9b14-95d98861ba2b req-b74c5fb8-9288-4a75-abe8-916bccb48886 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:17.880323 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-760e349a-acee-4057-9b14-95d98861ba2b req-b74c5fb8-9288-4a75-abe8-916bccb48886 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:17.922414 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-760e349a-acee-4057-9b14-95d98861ba2b req-b74c5fb8-9288-4a75-abe8-916bccb48886 service nova] Creating event network-vif-deleted:738890f4-f9c5-48ca-8d3f-3d153d3b482d for instance 92e64da4-c05c-4bdc-a42c-7fbb858c846a on n-h1-master-1 Aug 07 01:30:17.943449 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-760e349a-acee-4057-9b14-95d98861ba2b req-b74c5fb8-9288-4a75-abe8-916bccb48886 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116075 Aug 07 01:30:17.945958 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1862/4061] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:30:18.162987 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8acffa5b-9139-46e1-95a1-df823f33b54d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:18.165340 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8acffa5b-9139-46e1-95a1-df823f33b54d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: dbc593a0-5c59-4d1b-a538-157daf632f2e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:18.173449 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8acffa5b-9139-46e1-95a1-df823f33b54d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:18.174155 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8acffa5b-9139-46e1-95a1-df823f33b54d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:18.174752 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8acffa5b-9139-46e1-95a1-df823f33b54d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:18.175683 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8acffa5b-9139-46e1-95a1-df823f33b54d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:18.176328 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8acffa5b-9139-46e1-95a1-df823f33b54d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:18.176914 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8acffa5b-9139-46e1-95a1-df823f33b54d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:18.380497 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8acffa5b-9139-46e1-95a1-df823f33b54d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:18.400667 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8acffa5b-9139-46e1-95a1-df823f33b54d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e" status: 200 len: 1314 microversion: 2.1 time: 0.242550 Aug 07 01:30:18.416073 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2200/4062] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:18 2022] GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:18.653692 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c6e13877-87f3-4968-980d-9e7d70aaeb1e tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:18.659725 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c6e13877-87f3-4968-980d-9e7d70aaeb1e tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:18.664624 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:18.677594 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6e13877-87f3-4968-980d-9e7d70aaeb1e tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:18.680021 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6e13877-87f3-4968-980d-9e7d70aaeb1e tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:18.681210 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6e13877-87f3-4968-980d-9e7d70aaeb1e tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:18.681977 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6e13877-87f3-4968-980d-9e7d70aaeb1e tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:18.682449 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6e13877-87f3-4968-980d-9e7d70aaeb1e tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:18.682892 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6e13877-87f3-4968-980d-9e7d70aaeb1e tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:18.761486 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6e13877-87f3-4968-980d-9e7d70aaeb1e tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:18.762231 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6e13877-87f3-4968-980d-9e7d70aaeb1e tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:18.762893 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6e13877-87f3-4968-980d-9e7d70aaeb1e tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:18.765968 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-c6e13877-87f3-4968-980d-9e7d70aaeb1e tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lazy-loading 'fault' on Instance uuid 92e64da4-c05c-4bdc-a42c-7fbb858c846a {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:30:18.858717 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e301ebf0-ea45-404d-b94f-a10490345e60 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:18.859438 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e301ebf0-ea45-404d-b94f-a10490345e60 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 6ddf1e46-f885-4128-9530-5118bc687cde] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:18.870200 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e301ebf0-ea45-404d-b94f-a10490345e60 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:18.870972 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e301ebf0-ea45-404d-b94f-a10490345e60 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:18.871341 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e301ebf0-ea45-404d-b94f-a10490345e60 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:18.874006 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e301ebf0-ea45-404d-b94f-a10490345e60 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:18.874608 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e301ebf0-ea45-404d-b94f-a10490345e60 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:18.874956 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e301ebf0-ea45-404d-b94f-a10490345e60 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:18.972718 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c6e13877-87f3-4968-980d-9e7d70aaeb1e tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845cd61b22924fd3a915186a6093ac12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8face435f3549b5adbadf2f94707712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:18.999987 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e301ebf0-ea45-404d-b94f-a10490345e60 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:19.015023 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c6e13877-87f3-4968-980d-9e7d70aaeb1e tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 200 len: 1303 microversion: 2.1 time: 0.377311 Aug 07 01:30:19.025728 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1863/4063] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:18 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 1303 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:19.032175 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e301ebf0-ea45-404d-b94f-a10490345e60 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde" status: 200 len: 1267 microversion: 2.1 time: 0.173656 Aug 07 01:30:19.033248 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2201/4064] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:18 2022] GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:30:19.041633 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-903dd503-54e1-4d28-a65c-41e95b7a0b10 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:19.046280 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-903dd503-54e1-4d28-a65c-41e95b7a0b10 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:19.065065 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-903dd503-54e1-4d28-a65c-41e95b7a0b10 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:19.067602 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-903dd503-54e1-4d28-a65c-41e95b7a0b10 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:19.069183 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-903dd503-54e1-4d28-a65c-41e95b7a0b10 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:19.071318 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-903dd503-54e1-4d28-a65c-41e95b7a0b10 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:19.072756 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-903dd503-54e1-4d28-a65c-41e95b7a0b10 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:19.073881 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-903dd503-54e1-4d28-a65c-41e95b7a0b10 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:19.423613 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-20f3ad3e-b9db-4c85-afdd-23c81f7f9763 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:19.425469 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-20f3ad3e-b9db-4c85-afdd-23c81f7f9763 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: dbc593a0-5c59-4d1b-a538-157daf632f2e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:19.438370 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20f3ad3e-b9db-4c85-afdd-23c81f7f9763 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:19.444978 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20f3ad3e-b9db-4c85-afdd-23c81f7f9763 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:19.446220 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20f3ad3e-b9db-4c85-afdd-23c81f7f9763 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:19.448207 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20f3ad3e-b9db-4c85-afdd-23c81f7f9763 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:19.449792 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20f3ad3e-b9db-4c85-afdd-23c81f7f9763 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:19.450601 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20f3ad3e-b9db-4c85-afdd-23c81f7f9763 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:19.573374 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-903dd503-54e1-4d28-a65c-41e95b7a0b10 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:19.589605 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-903dd503-54e1-4d28-a65c-41e95b7a0b10 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1519 microversion: 2.1 time: 0.558161 Aug 07 01:30:19.590125 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1864/4065] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:19 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1519 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:19.750765 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-20f3ad3e-b9db-4c85-afdd-23c81f7f9763 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:19.779059 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-20f3ad3e-b9db-4c85-afdd-23c81f7f9763 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e" status: 200 len: 1502 microversion: 2.1 time: 0.359440 Aug 07 01:30:19.780369 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2202/4066] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:19 2022] GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e => generated 1502 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:30:19.801666 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2d7dcaab-2158-45c2-b006-98d206eb7564 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:19.820363 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d7dcaab-2158-45c2-b006-98d206eb7564 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:19.821298 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d7dcaab-2158-45c2-b006-98d206eb7564 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:19.821910 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d7dcaab-2158-45c2-b006-98d206eb7564 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:19.852378 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2d7dcaab-2158-45c2-b006-98d206eb7564 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: dbc593a0-5c59-4d1b-a538-157daf632f2e] Going to try to stop instance {{(pid=119517) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 07 01:30:19.949324 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2d7dcaab-2158-45c2-b006-98d206eb7564 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "POST /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e/action" status: 202 len: 0 microversion: 2.1 time: 0.152559 Aug 07 01:30:19.950667 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1865/4067] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:30:19 2022] POST /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:30:19.959443 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6f2b4497-8d68-422c-9870-0be28c46a70b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:19.961038 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6f2b4497-8d68-422c-9870-0be28c46a70b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: dbc593a0-5c59-4d1b-a538-157daf632f2e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:19.976611 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f2b4497-8d68-422c-9870-0be28c46a70b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:19.987670 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f2b4497-8d68-422c-9870-0be28c46a70b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:19.988407 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f2b4497-8d68-422c-9870-0be28c46a70b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:19.992415 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f2b4497-8d68-422c-9870-0be28c46a70b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:19.993982 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f2b4497-8d68-422c-9870-0be28c46a70b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:19.996503 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f2b4497-8d68-422c-9870-0be28c46a70b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:20.039071 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cc1a6d5c-306c-4647-8193-45fcc408d013 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:20.040079 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-cc1a6d5c-306c-4647-8193-45fcc408d013 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] [instance: 92e64da4-c05c-4bdc-a42c-7fbb858c846a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:20.050588 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc1a6d5c-306c-4647-8193-45fcc408d013 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:20.052474 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc1a6d5c-306c-4647-8193-45fcc408d013 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:20.057541 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc1a6d5c-306c-4647-8193-45fcc408d013 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:20.058842 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc1a6d5c-306c-4647-8193-45fcc408d013 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:20.059682 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc1a6d5c-306c-4647-8193-45fcc408d013 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:20.060327 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc1a6d5c-306c-4647-8193-45fcc408d013 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:20.072968 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:20.097978 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-cc1a6d5c-306c-4647-8193-45fcc408d013 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] HTTP exception thrown: Instance 92e64da4-c05c-4bdc-a42c-7fbb858c846a could not be found. Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cc1a6d5c-306c-4647-8193-45fcc408d013 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Request method failure captured: Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a HTTP/1.1 Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xUjTGOBsVQ2tlky-dk22xF4n-F1jDvk6xs6bnkwRK2HIsBPysUQFsgcLT6Ozu2XnIvhqm9F6Al2T06FIV9E-9AqnILpW0BR5HPcAypI3bvRbhGVw7kwA-KJTIz8VlF-zeLRpJrrvE3O__OP5CRoNgG9NEHPJstxQlDX1YkC468Wp0E Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: d8face435f3549b5adbadf2f94707712 Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServerRescueTestJSON-1756641241 Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d8face435f3549b5adbadf2f94707712"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d8face435f3549b5adbadf2f94707712", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d8face435f3549b5adbadf2f94707712"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d8face435f3549b5adbadf2f94707712"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServerRescueTestJSON-1756641241 Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: d8face435f3549b5adbadf2f94707712 Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServerRescueTestJSON-1756641241 Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServerRescueTestJSON-1756641241-project Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 845cd61b22924fd3a915186a6093ac12 Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServerRescueTestJSON-1756641241-project Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 92e64da4-c05c-4bdc-a42c-7fbb858c846a could not be found. Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '92e64da4-c05c-4bdc-a42c-7fbb858c846a'} Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92e64da4-c05c-4bdc-a42c-7fbb858c846a could not be found. Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92e64da4-c05c-4bdc-a42c-7fbb858c846a could not be found. Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:30:20.102115 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:20.106477 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:30:20.106477 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:30:20.106477 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:30:20.106477 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:30:20.106477 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:30:20.106477 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92e64da4-c05c-4bdc-a42c-7fbb858c846a could not be found. Aug 07 01:30:20.106477 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:20.109382 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cc1a6d5c-306c-4647-8193-45fcc408d013 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] Returning 404 to user: Instance 92e64da4-c05c-4bdc-a42c-7fbb858c846a could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:30:20.111086 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cc1a6d5c-306c-4647-8193-45fcc408d013 tempest-ServerRescueTestJSON-1756641241 tempest-ServerRescueTestJSON-1756641241-project] 10.222.0.39 "GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a" status: 404 len: 111 microversion: 2.1 time: 0.076654 Aug 07 01:30:20.112668 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1866/4068] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:20 2022] GET /compute/v2.1/servers/92e64da4-c05c-4bdc-a42c-7fbb858c846a => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:30:20.122643 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9b77762a-5459-469c-a026-241059fcd426 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:20.123654 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9b77762a-5459-469c-a026-241059fcd426 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 6ddf1e46-f885-4128-9530-5118bc687cde] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:20.131094 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9b77762a-5459-469c-a026-241059fcd426 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:20.132165 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9b77762a-5459-469c-a026-241059fcd426 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:20.133418 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9b77762a-5459-469c-a026-241059fcd426 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:20.134574 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9b77762a-5459-469c-a026-241059fcd426 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:20.135264 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9b77762a-5459-469c-a026-241059fcd426 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:20.135943 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9b77762a-5459-469c-a026-241059fcd426 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:20.340734 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9b77762a-5459-469c-a026-241059fcd426 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:20.353653 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9b77762a-5459-469c-a026-241059fcd426 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde" status: 200 len: 1285 microversion: 2.1 time: 0.238970 Aug 07 01:30:20.361384 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1867/4069] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:20 2022] GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde => generated 1285 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:20.610634 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d2813d7c-98ce-431b-b583-08f63fdff0dc tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:20.614720 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d2813d7c-98ce-431b-b583-08f63fdff0dc tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:20.645454 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2813d7c-98ce-431b-b583-08f63fdff0dc tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:20.646074 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2813d7c-98ce-431b-b583-08f63fdff0dc tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:20.646597 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2813d7c-98ce-431b-b583-08f63fdff0dc tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:20.647388 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2813d7c-98ce-431b-b583-08f63fdff0dc tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:20.648846 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2813d7c-98ce-431b-b583-08f63fdff0dc tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:20.648960 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2813d7c-98ce-431b-b583-08f63fdff0dc tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:20.776374 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6f2b4497-8d68-422c-9870-0be28c46a70b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:20.787807 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6f2b4497-8d68-422c-9870-0be28c46a70b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e" status: 200 len: 1512 microversion: 2.1 time: 0.832632 Aug 07 01:30:20.791241 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2203/4070] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:19 2022] GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e => generated 1512 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:21.112557 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d2813d7c-98ce-431b-b583-08f63fdff0dc tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:21.125356 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d2813d7c-98ce-431b-b583-08f63fdff0dc tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1519 microversion: 2.1 time: 0.518561 Aug 07 01:30:21.126045 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1868/4071] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:20 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1519 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:30:21.383167 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9320f578-3b37-4e0c-a416-d07a5a904121 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:21.383998 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9320f578-3b37-4e0c-a416-d07a5a904121 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 6ddf1e46-f885-4128-9530-5118bc687cde] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:21.399770 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9320f578-3b37-4e0c-a416-d07a5a904121 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:21.400328 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9320f578-3b37-4e0c-a416-d07a5a904121 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:21.400778 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9320f578-3b37-4e0c-a416-d07a5a904121 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:21.401514 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9320f578-3b37-4e0c-a416-d07a5a904121 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:21.401978 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9320f578-3b37-4e0c-a416-d07a5a904121 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:21.402412 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9320f578-3b37-4e0c-a416-d07a5a904121 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:21.513136 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9320f578-3b37-4e0c-a416-d07a5a904121 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:21.528777 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9320f578-3b37-4e0c-a416-d07a5a904121 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde" status: 200 len: 1273 microversion: 2.1 time: 0.148496 Aug 07 01:30:21.531583 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2204/4072] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:21 2022] GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde => generated 1273 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:21.812093 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a75cabd7-0f75-4be3-82f1-c4723e00f901 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:21.813076 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a75cabd7-0f75-4be3-82f1-c4723e00f901 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: dbc593a0-5c59-4d1b-a538-157daf632f2e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:21.832163 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a75cabd7-0f75-4be3-82f1-c4723e00f901 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:21.835655 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a75cabd7-0f75-4be3-82f1-c4723e00f901 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:21.836497 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a75cabd7-0f75-4be3-82f1-c4723e00f901 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:21.837599 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a75cabd7-0f75-4be3-82f1-c4723e00f901 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:21.841670 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a75cabd7-0f75-4be3-82f1-c4723e00f901 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:21.842483 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a75cabd7-0f75-4be3-82f1-c4723e00f901 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:22.147100 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2c3b6084-6ea6-4a91-b7dc-4075d06aca91 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:22.148553 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2c3b6084-6ea6-4a91-b7dc-4075d06aca91 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:22.158546 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c3b6084-6ea6-4a91-b7dc-4075d06aca91 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:22.165021 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c3b6084-6ea6-4a91-b7dc-4075d06aca91 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:22.171174 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c3b6084-6ea6-4a91-b7dc-4075d06aca91 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:22.172242 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c3b6084-6ea6-4a91-b7dc-4075d06aca91 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:22.172865 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c3b6084-6ea6-4a91-b7dc-4075d06aca91 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:22.173436 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c3b6084-6ea6-4a91-b7dc-4075d06aca91 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:23.752895 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a75cabd7-0f75-4be3-82f1-c4723e00f901 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:23.767139 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a75cabd7-0f75-4be3-82f1-c4723e00f901 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e" status: 200 len: 1512 microversion: 2.1 time: 1.959100 Aug 07 01:30:23.767747 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1869/4073] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:21 2022] GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e => generated 1512 bytes in 1960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:23.780344 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c6736b95-d530-4a5e-892c-4a2fef61e051 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:23.783507 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c6736b95-d530-4a5e-892c-4a2fef61e051 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 6ddf1e46-f885-4128-9530-5118bc687cde] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:23.805121 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6736b95-d530-4a5e-892c-4a2fef61e051 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:23.805677 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6736b95-d530-4a5e-892c-4a2fef61e051 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:23.806143 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6736b95-d530-4a5e-892c-4a2fef61e051 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:23.806908 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6736b95-d530-4a5e-892c-4a2fef61e051 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:23.813425 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6736b95-d530-4a5e-892c-4a2fef61e051 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:23.813890 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6736b95-d530-4a5e-892c-4a2fef61e051 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:23.814771 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2c3b6084-6ea6-4a91-b7dc-4075d06aca91 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:23.827860 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2c3b6084-6ea6-4a91-b7dc-4075d06aca91 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1519 microversion: 2.1 time: 1.684863 Aug 07 01:30:23.833551 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2205/4074] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:22 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1519 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:24.472204 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c6736b95-d530-4a5e-892c-4a2fef61e051 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:24.510514 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c6736b95-d530-4a5e-892c-4a2fef61e051 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde" status: 200 len: 1315 microversion: 2.1 time: 0.734720 Aug 07 01:30:24.521526 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1870/4075] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:23 2022] GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde => generated 1315 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:24.795469 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2389436b-4efd-4b7d-9415-a14dc472d515 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:24.796269 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2389436b-4efd-4b7d-9415-a14dc472d515 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: dbc593a0-5c59-4d1b-a538-157daf632f2e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:24.809272 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2389436b-4efd-4b7d-9415-a14dc472d515 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:24.811725 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2389436b-4efd-4b7d-9415-a14dc472d515 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:24.814672 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2389436b-4efd-4b7d-9415-a14dc472d515 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:24.816861 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2389436b-4efd-4b7d-9415-a14dc472d515 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:24.819113 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2389436b-4efd-4b7d-9415-a14dc472d515 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:24.820688 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2389436b-4efd-4b7d-9415-a14dc472d515 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:24.866656 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cd59a7dc-7e48-457c-b7d5-7ab898ae9471 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:24.867379 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-cd59a7dc-7e48-457c-b7d5-7ab898ae9471 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:24.875187 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cd59a7dc-7e48-457c-b7d5-7ab898ae9471 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:24.889181 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cd59a7dc-7e48-457c-b7d5-7ab898ae9471 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:24.892913 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cd59a7dc-7e48-457c-b7d5-7ab898ae9471 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:24.898464 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cd59a7dc-7e48-457c-b7d5-7ab898ae9471 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:24.899905 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cd59a7dc-7e48-457c-b7d5-7ab898ae9471 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:24.902450 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cd59a7dc-7e48-457c-b7d5-7ab898ae9471 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:25.176724 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2389436b-4efd-4b7d-9415-a14dc472d515 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:25.197854 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2389436b-4efd-4b7d-9415-a14dc472d515 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e" status: 200 len: 1512 microversion: 2.1 time: 0.408875 Aug 07 01:30:25.201322 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2206/4076] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:24 2022] GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e => generated 1512 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:25.545862 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9bf8320d-61af-4c93-99c3-b0b108b6e1ad tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:25.546888 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9bf8320d-61af-4c93-99c3-b0b108b6e1ad tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 6ddf1e46-f885-4128-9530-5118bc687cde] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:25.559337 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9bf8320d-61af-4c93-99c3-b0b108b6e1ad tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:25.560578 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9bf8320d-61af-4c93-99c3-b0b108b6e1ad tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:25.561938 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9bf8320d-61af-4c93-99c3-b0b108b6e1ad tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:25.564535 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9bf8320d-61af-4c93-99c3-b0b108b6e1ad tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:25.570148 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9bf8320d-61af-4c93-99c3-b0b108b6e1ad tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:25.572695 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9bf8320d-61af-4c93-99c3-b0b108b6e1ad tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:25.838044 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9bf8320d-61af-4c93-99c3-b0b108b6e1ad tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:25.846738 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9bf8320d-61af-4c93-99c3-b0b108b6e1ad tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde" status: 200 len: 1315 microversion: 2.1 time: 0.304968 Aug 07 01:30:25.857652 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2207/4077] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:25 2022] GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:30:26.236378 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3305509f-92de-4a4d-8d9f-be76126e0079 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:26.236626 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3305509f-92de-4a4d-8d9f-be76126e0079 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: dbc593a0-5c59-4d1b-a538-157daf632f2e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:26.247564 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3305509f-92de-4a4d-8d9f-be76126e0079 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:26.250288 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3305509f-92de-4a4d-8d9f-be76126e0079 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:26.262099 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3305509f-92de-4a4d-8d9f-be76126e0079 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:26.263148 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3305509f-92de-4a4d-8d9f-be76126e0079 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:26.264957 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3305509f-92de-4a4d-8d9f-be76126e0079 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:26.267771 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3305509f-92de-4a4d-8d9f-be76126e0079 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:26.479476 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-cd59a7dc-7e48-457c-b7d5-7ab898ae9471 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:26.495231 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cd59a7dc-7e48-457c-b7d5-7ab898ae9471 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1519 microversion: 2.1 time: 1.633518 Aug 07 01:30:26.497756 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1871/4078] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:24 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1519 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:26.565061 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3305509f-92de-4a4d-8d9f-be76126e0079 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:26.583373 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3305509f-92de-4a4d-8d9f-be76126e0079 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e" status: 200 len: 1512 microversion: 2.1 time: 0.353037 Aug 07 01:30:26.586007 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2208/4079] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:26 2022] GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e => generated 1512 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:26.883085 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-59f93914-e7a2-4878-82d9-eafa60c6f4ce tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:26.885234 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-59f93914-e7a2-4878-82d9-eafa60c6f4ce tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 6ddf1e46-f885-4128-9530-5118bc687cde] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:26.900632 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59f93914-e7a2-4878-82d9-eafa60c6f4ce tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:26.902701 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59f93914-e7a2-4878-82d9-eafa60c6f4ce tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:26.905126 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59f93914-e7a2-4878-82d9-eafa60c6f4ce tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:26.906821 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59f93914-e7a2-4878-82d9-eafa60c6f4ce tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:26.908048 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59f93914-e7a2-4878-82d9-eafa60c6f4ce tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:26.911124 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59f93914-e7a2-4878-82d9-eafa60c6f4ce tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:27.533209 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-59f93914-e7a2-4878-82d9-eafa60c6f4ce tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:27.534502 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5708ee05-3685-44ae-99d5-816ca240b077 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:27.537881 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5708ee05-3685-44ae-99d5-816ca240b077 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:27.545208 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-59f93914-e7a2-4878-82d9-eafa60c6f4ce tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde" status: 200 len: 1315 microversion: 2.1 time: 0.668338 Aug 07 01:30:27.546669 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1872/4080] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:26 2022] GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde => generated 1315 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:27.554720 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-29f14bc7-b5b6-45d1-9aed-3e99dba1d686 req-0f89a9a1-3ccc-49a2-bdc9-133253122564 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ddf1e46-f885-4128-9530-5118bc687cde", "tag": "80d83a5c-0316-4c2a-870a-d8eb535ee6a2"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:27.571395 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-29f14bc7-b5b6-45d1-9aed-3e99dba1d686 req-0f89a9a1-3ccc-49a2-bdc9-133253122564 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:27.572716 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-29f14bc7-b5b6-45d1-9aed-3e99dba1d686 req-0f89a9a1-3ccc-49a2-bdc9-133253122564 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:27.573516 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-29f14bc7-b5b6-45d1-9aed-3e99dba1d686 req-0f89a9a1-3ccc-49a2-bdc9-133253122564 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:27.588136 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-29f14bc7-b5b6-45d1-9aed-3e99dba1d686 req-0f89a9a1-3ccc-49a2-bdc9-133253122564 service nova] Creating event network-changed:80d83a5c-0316-4c2a-870a-d8eb535ee6a2 for instance 6ddf1e46-f885-4128-9530-5118bc687cde on n-h2-master-1 Aug 07 01:30:27.591947 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:27.592755 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:27.597865 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-29f14bc7-b5b6-45d1-9aed-3e99dba1d686 req-0f89a9a1-3ccc-49a2-bdc9-133253122564 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049259 Aug 07 01:30:27.599378 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1873/4081] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:30:27.617337 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5708ee05-3685-44ae-99d5-816ca240b077 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:27.618311 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5708ee05-3685-44ae-99d5-816ca240b077 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:27.619160 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5708ee05-3685-44ae-99d5-816ca240b077 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:27.620358 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5708ee05-3685-44ae-99d5-816ca240b077 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:27.621008 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5708ee05-3685-44ae-99d5-816ca240b077 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:27.621794 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5708ee05-3685-44ae-99d5-816ca240b077 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:27.626349 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-444b241d-be14-42b3-9ce7-bde53725aa5e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:27.627680 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:27.633184 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-444b241d-be14-42b3-9ce7-bde53725aa5e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: dbc593a0-5c59-4d1b-a538-157daf632f2e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:27.650471 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-444b241d-be14-42b3-9ce7-bde53725aa5e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:27.652079 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-444b241d-be14-42b3-9ce7-bde53725aa5e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:27.652079 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-444b241d-be14-42b3-9ce7-bde53725aa5e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:27.658559 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-444b241d-be14-42b3-9ce7-bde53725aa5e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:27.660211 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-444b241d-be14-42b3-9ce7-bde53725aa5e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:27.660977 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-444b241d-be14-42b3-9ce7-bde53725aa5e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:27.805402 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:28.033783 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5708ee05-3685-44ae-99d5-816ca240b077 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:28.046277 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5708ee05-3685-44ae-99d5-816ca240b077 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1519 microversion: 2.1 time: 0.526409 Aug 07 01:30:28.049986 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2209/4082] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:27 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1519 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:28.224348 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-444b241d-be14-42b3-9ce7-bde53725aa5e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:28.233724 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-444b241d-be14-42b3-9ce7-bde53725aa5e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e" status: 200 len: 1512 microversion: 2.1 time: 0.626083 Aug 07 01:30:28.234327 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1874/4083] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:27 2022] GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e => generated 1512 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:28.570999 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c89553ff-f952-46fd-91a1-20418f762420 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:28.573470 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c89553ff-f952-46fd-91a1-20418f762420 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 6ddf1e46-f885-4128-9530-5118bc687cde] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:28.610147 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c89553ff-f952-46fd-91a1-20418f762420 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:28.611260 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c89553ff-f952-46fd-91a1-20418f762420 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:28.621502 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c89553ff-f952-46fd-91a1-20418f762420 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:28.634163 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c89553ff-f952-46fd-91a1-20418f762420 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:28.635011 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c89553ff-f952-46fd-91a1-20418f762420 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:28.635725 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c89553ff-f952-46fd-91a1-20418f762420 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:29.063131 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c89553ff-f952-46fd-91a1-20418f762420 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:29.071701 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-75d3459e-c89e-44f7-b8c4-d01a5c0be029 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:29.073410 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-75d3459e-c89e-44f7-b8c4-d01a5c0be029 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:29.077720 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c89553ff-f952-46fd-91a1-20418f762420 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde" status: 200 len: 1315 microversion: 2.1 time: 0.511564 Aug 07 01:30:29.088050 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2210/4084] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:28 2022] GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde => generated 1315 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:29.098825 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75d3459e-c89e-44f7-b8c4-d01a5c0be029 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:29.099250 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75d3459e-c89e-44f7-b8c4-d01a5c0be029 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:29.099918 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75d3459e-c89e-44f7-b8c4-d01a5c0be029 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:29.101489 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75d3459e-c89e-44f7-b8c4-d01a5c0be029 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:29.102055 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75d3459e-c89e-44f7-b8c4-d01a5c0be029 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:29.102555 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75d3459e-c89e-44f7-b8c4-d01a5c0be029 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:29.266772 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2659215a-ac81-4ee0-b824-18b0e01ee566 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:29.267788 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2659215a-ac81-4ee0-b824-18b0e01ee566 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: dbc593a0-5c59-4d1b-a538-157daf632f2e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:29.293652 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2659215a-ac81-4ee0-b824-18b0e01ee566 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:29.293652 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2659215a-ac81-4ee0-b824-18b0e01ee566 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:29.294848 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2659215a-ac81-4ee0-b824-18b0e01ee566 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:29.298375 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2659215a-ac81-4ee0-b824-18b0e01ee566 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:29.299134 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2659215a-ac81-4ee0-b824-18b0e01ee566 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:29.299801 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2659215a-ac81-4ee0-b824-18b0e01ee566 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:29.543559 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-75d3459e-c89e-44f7-b8c4-d01a5c0be029 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:29.554768 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-75d3459e-c89e-44f7-b8c4-d01a5c0be029 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1519 microversion: 2.1 time: 0.488189 Aug 07 01:30:29.555948 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1875/4085] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:29 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1519 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:30:29.660552 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2659215a-ac81-4ee0-b824-18b0e01ee566 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:29.671045 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2659215a-ac81-4ee0-b824-18b0e01ee566 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e" status: 200 len: 1512 microversion: 2.1 time: 0.411456 Aug 07 01:30:29.672344 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2211/4086] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:29 2022] GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e => generated 1512 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:30.105196 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-93ecfd6b-f786-4659-a5b1-2b238296d183 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:30.107207 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-93ecfd6b-f786-4659-a5b1-2b238296d183 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 6ddf1e46-f885-4128-9530-5118bc687cde] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:30.121922 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93ecfd6b-f786-4659-a5b1-2b238296d183 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:30.122614 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93ecfd6b-f786-4659-a5b1-2b238296d183 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:30.123057 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93ecfd6b-f786-4659-a5b1-2b238296d183 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:30.123806 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93ecfd6b-f786-4659-a5b1-2b238296d183 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:30.124316 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93ecfd6b-f786-4659-a5b1-2b238296d183 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:30.124903 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93ecfd6b-f786-4659-a5b1-2b238296d183 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:30.329881 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-63534e98-a70e-48e4-85d5-540e04930bc3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1928549615", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "b3425e7d-df0f-45af-b2cc-93cd8cf488f1"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:30.348652 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-93ecfd6b-f786-4659-a5b1-2b238296d183 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:30.361024 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-93ecfd6b-f786-4659-a5b1-2b238296d183 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde" status: 200 len: 1315 microversion: 2.1 time: 0.262844 Aug 07 01:30:30.377395 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1876/4087] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:30 2022] GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:30.412032 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-63534e98-a70e-48e4-85d5-540e04930bc3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] validate_networks() for [('b3425e7d-df0f-45af-b2cc-93cd8cf488f1', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:30:30.578161 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3b779a8a-1226-4d57-b819-faf7012ec2b6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:30.580182 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3b779a8a-1226-4d57-b819-faf7012ec2b6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:30.596043 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b779a8a-1226-4d57-b819-faf7012ec2b6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:30.598043 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b779a8a-1226-4d57-b819-faf7012ec2b6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:30.599760 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b779a8a-1226-4d57-b819-faf7012ec2b6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:30.601985 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b779a8a-1226-4d57-b819-faf7012ec2b6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:30.602472 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b779a8a-1226-4d57-b819-faf7012ec2b6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:30.605211 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b779a8a-1226-4d57-b819-faf7012ec2b6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:31.039629 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3b779a8a-1226-4d57-b819-faf7012ec2b6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:31.066727 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3b779a8a-1226-4d57-b819-faf7012ec2b6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1519 microversion: 2.1 time: 0.491724 Aug 07 01:30:31.069458 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1877/4088] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:30 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1519 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:31.074437 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d1d9b37b-502e-4719-8628-1cf3fa3c29f9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:31.075065 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d1d9b37b-502e-4719-8628-1cf3fa3c29f9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: dbc593a0-5c59-4d1b-a538-157daf632f2e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:31.100390 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1d9b37b-502e-4719-8628-1cf3fa3c29f9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:31.101988 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1d9b37b-502e-4719-8628-1cf3fa3c29f9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:31.102448 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1d9b37b-502e-4719-8628-1cf3fa3c29f9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:31.103183 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1d9b37b-502e-4719-8628-1cf3fa3c29f9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:31.103645 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1d9b37b-502e-4719-8628-1cf3fa3c29f9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:31.104286 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1d9b37b-502e-4719-8628-1cf3fa3c29f9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:31.381615 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d1d9b37b-502e-4719-8628-1cf3fa3c29f9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:31.389778 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d1d9b37b-502e-4719-8628-1cf3fa3c29f9 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e" status: 200 len: 1512 microversion: 2.1 time: 0.319227 Aug 07 01:30:31.404959 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1878/4089] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:31 2022] GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e => generated 1512 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:31.414108 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6eaf0877-5307-47a4-ab1a-9949003fa1fb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:31.415447 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6eaf0877-5307-47a4-ab1a-9949003fa1fb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 6ddf1e46-f885-4128-9530-5118bc687cde] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:31.422603 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6eaf0877-5307-47a4-ab1a-9949003fa1fb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:31.423217 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6eaf0877-5307-47a4-ab1a-9949003fa1fb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:31.424168 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6eaf0877-5307-47a4-ab1a-9949003fa1fb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:31.425574 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6eaf0877-5307-47a4-ab1a-9949003fa1fb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:31.426205 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6eaf0877-5307-47a4-ab1a-9949003fa1fb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:31.426669 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6eaf0877-5307-47a4-ab1a-9949003fa1fb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:31.523849 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-63534e98-a70e-48e4-85d5-540e04930bc3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:30:31.525000 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-63534e98-a70e-48e4-85d5-540e04930bc3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:30:31.525572 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-63534e98-a70e-48e4-85d5-540e04930bc3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:30:31.526199 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-63534e98-a70e-48e4-85d5-540e04930bc3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:30:31.534422 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-63534e98-a70e-48e4-85d5-540e04930bc3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:30:31.549067 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-63534e98-a70e-48e4-85d5-540e04930bc3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:31.551355 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-63534e98-a70e-48e4-85d5-540e04930bc3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:31.553161 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-63534e98-a70e-48e4-85d5-540e04930bc3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:31.554155 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-63534e98-a70e-48e4-85d5-540e04930bc3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:31.558763 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-63534e98-a70e-48e4-85d5-540e04930bc3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:31.559254 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-63534e98-a70e-48e4-85d5-540e04930bc3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:31.625109 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-63534e98-a70e-48e4-85d5-540e04930bc3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Getting quotas for project 5f88662ebb674ad99a4d36651dee967a. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:30:31.640967 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-63534e98-a70e-48e4-85d5-540e04930bc3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Getting quotas for user 474a78f0b2784e01b3d2a6ff6694b8bb and project 5f88662ebb674ad99a4d36651dee967a. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:30:31.679536 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-63534e98-a70e-48e4-85d5-540e04930bc3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:30:31.682034 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-63534e98-a70e-48e4-85d5-540e04930bc3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 425b6340-2984-4339-9728-2914b55bd418] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:30:31.686473 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6eaf0877-5307-47a4-ab1a-9949003fa1fb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:31.701152 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6eaf0877-5307-47a4-ab1a-9949003fa1fb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde" status: 200 len: 1315 microversion: 2.1 time: 0.294790 Aug 07 01:30:31.702990 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1879/4090] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:31 2022] GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:31.830738 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-63534e98-a70e-48e4-85d5-540e04930bc3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.720037 Aug 07 01:30:31.831414 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2212/4091] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:30:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 07 01:30:32.094206 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fb951060-7c0e-435d-b78a-61c717dac523 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:32.095345 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fb951060-7c0e-435d-b78a-61c717dac523 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:32.110430 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb951060-7c0e-435d-b78a-61c717dac523 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:32.111415 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb951060-7c0e-435d-b78a-61c717dac523 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:32.112388 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb951060-7c0e-435d-b78a-61c717dac523 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:32.113283 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb951060-7c0e-435d-b78a-61c717dac523 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:32.114123 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb951060-7c0e-435d-b78a-61c717dac523 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:32.114681 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb951060-7c0e-435d-b78a-61c717dac523 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:32.154718 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-76bcca54-9ef3-4529-9f6c-50d4d42bfae2 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-266584889", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "b3425e7d-df0f-45af-b2cc-93cd8cf488f1"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:32.363417 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-76bcca54-9ef3-4529-9f6c-50d4d42bfae2 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] validate_networks() for [('b3425e7d-df0f-45af-b2cc-93cd8cf488f1', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:30:33.043586 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fb951060-7c0e-435d-b78a-61c717dac523 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:33.057600 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fb951060-7c0e-435d-b78a-61c717dac523 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1519 microversion: 2.1 time: 0.963658 Aug 07 01:30:33.058835 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1880/4092] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:32 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1519 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:33.074206 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c2677137-f47e-4aef-b93b-dc820428e224 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:33.075116 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c2677137-f47e-4aef-b93b-dc820428e224 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: dbc593a0-5c59-4d1b-a538-157daf632f2e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:33.084462 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2677137-f47e-4aef-b93b-dc820428e224 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:33.085550 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2677137-f47e-4aef-b93b-dc820428e224 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:33.086001 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2677137-f47e-4aef-b93b-dc820428e224 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:33.086637 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2677137-f47e-4aef-b93b-dc820428e224 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:33.087091 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2677137-f47e-4aef-b93b-dc820428e224 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:33.088564 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2677137-f47e-4aef-b93b-dc820428e224 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:33.963861 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c2677137-f47e-4aef-b93b-dc820428e224 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:33.977417 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c2677137-f47e-4aef-b93b-dc820428e224 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e" status: 200 len: 1512 microversion: 2.1 time: 0.916998 Aug 07 01:30:33.979269 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1881/4093] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:33 2022] GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e => generated 1512 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:33.993694 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4ec9926b-4a0c-4294-9394-195bab35d137 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:33.996941 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4ec9926b-4a0c-4294-9394-195bab35d137 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 6ddf1e46-f885-4128-9530-5118bc687cde] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:34.011701 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ec9926b-4a0c-4294-9394-195bab35d137 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:34.014248 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ec9926b-4a0c-4294-9394-195bab35d137 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:34.014909 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ec9926b-4a0c-4294-9394-195bab35d137 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:34.015919 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ec9926b-4a0c-4294-9394-195bab35d137 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:34.019773 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ec9926b-4a0c-4294-9394-195bab35d137 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:34.020694 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ec9926b-4a0c-4294-9394-195bab35d137 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:34.363917 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4ec9926b-4a0c-4294-9394-195bab35d137 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:34.402264 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4ec9926b-4a0c-4294-9394-195bab35d137 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde" status: 200 len: 1315 microversion: 2.1 time: 0.414100 Aug 07 01:30:34.402919 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1882/4094] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:33 2022] GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde => generated 1315 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:34.418948 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6e572b4a-a67c-41fe-b575-269f06e0e0f2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:34.419583 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6e572b4a-a67c-41fe-b575-269f06e0e0f2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:34.435650 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6e572b4a-a67c-41fe-b575-269f06e0e0f2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:34.436166 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6e572b4a-a67c-41fe-b575-269f06e0e0f2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:34.436773 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6e572b4a-a67c-41fe-b575-269f06e0e0f2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:34.437681 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6e572b4a-a67c-41fe-b575-269f06e0e0f2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:34.439169 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6e572b4a-a67c-41fe-b575-269f06e0e0f2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:34.439764 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6e572b4a-a67c-41fe-b575-269f06e0e0f2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:34.804583 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-76bcca54-9ef3-4529-9f6c-50d4d42bfae2 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:30:34.805098 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-76bcca54-9ef3-4529-9f6c-50d4d42bfae2 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:30:34.805480 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-76bcca54-9ef3-4529-9f6c-50d4d42bfae2 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:30:34.806549 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-76bcca54-9ef3-4529-9f6c-50d4d42bfae2 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:30:34.807124 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-76bcca54-9ef3-4529-9f6c-50d4d42bfae2 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:30:34.822906 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-76bcca54-9ef3-4529-9f6c-50d4d42bfae2 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:34.823410 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-76bcca54-9ef3-4529-9f6c-50d4d42bfae2 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:34.827291 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-76bcca54-9ef3-4529-9f6c-50d4d42bfae2 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:34.828356 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-76bcca54-9ef3-4529-9f6c-50d4d42bfae2 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:34.829045 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-76bcca54-9ef3-4529-9f6c-50d4d42bfae2 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:34.830741 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-76bcca54-9ef3-4529-9f6c-50d4d42bfae2 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:34.934160 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-76bcca54-9ef3-4529-9f6c-50d4d42bfae2 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Getting quotas for project 5f88662ebb674ad99a4d36651dee967a. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:30:34.959684 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-76bcca54-9ef3-4529-9f6c-50d4d42bfae2 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Getting quotas for user 474a78f0b2784e01b3d2a6ff6694b8bb and project 5f88662ebb674ad99a4d36651dee967a. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:30:35.001581 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6e572b4a-a67c-41fe-b575-269f06e0e0f2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:35.014348 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6e572b4a-a67c-41fe-b575-269f06e0e0f2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1519 microversion: 2.1 time: 0.606924 Aug 07 01:30:35.018332 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-76bcca54-9ef3-4529-9f6c-50d4d42bfae2 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:30:35.023177 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-76bcca54-9ef3-4529-9f6c-50d4d42bfae2 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: cd399490-133f-43a2-b0b7-ed5448e52dab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:30:35.035500 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1883/4095] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:34 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1519 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:35.048984 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-be9bc666-4477-454f-89bb-2cf9edbef9f4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:35.049873 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-be9bc666-4477-454f-89bb-2cf9edbef9f4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: dbc593a0-5c59-4d1b-a538-157daf632f2e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:35.071868 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-be9bc666-4477-454f-89bb-2cf9edbef9f4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:35.073937 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-be9bc666-4477-454f-89bb-2cf9edbef9f4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:35.076515 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-be9bc666-4477-454f-89bb-2cf9edbef9f4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:35.082597 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-be9bc666-4477-454f-89bb-2cf9edbef9f4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:35.083400 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-be9bc666-4477-454f-89bb-2cf9edbef9f4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:35.084065 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-be9bc666-4477-454f-89bb-2cf9edbef9f4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:35.114344 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:35.151698 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-76bcca54-9ef3-4529-9f6c-50d4d42bfae2 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.002073 Aug 07 01:30:35.152958 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2213/4096] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:30:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 3005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:30:35.315610 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0731eeff-6d42-4535-87ab-8c1ee157b5a1 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-570549873", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "451", "networks": [{"uuid": "b3425e7d-df0f-45af-b2cc-93cd8cf488f1"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:35.454859 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-0731eeff-6d42-4535-87ab-8c1ee157b5a1 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] validate_networks() for [('b3425e7d-df0f-45af-b2cc-93cd8cf488f1', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:30:35.601312 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-be9bc666-4477-454f-89bb-2cf9edbef9f4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:35.613457 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-be9bc666-4477-454f-89bb-2cf9edbef9f4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e" status: 200 len: 1512 microversion: 2.1 time: 0.576643 Aug 07 01:30:35.614302 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1884/4097] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:35 2022] GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e => generated 1512 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:35.632310 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a0715a29-40b8-4916-be0c-5019c8f4165f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:35.633357 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a0715a29-40b8-4916-be0c-5019c8f4165f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 6ddf1e46-f885-4128-9530-5118bc687cde] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:35.644164 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a0715a29-40b8-4916-be0c-5019c8f4165f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:35.644901 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a0715a29-40b8-4916-be0c-5019c8f4165f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:35.648103 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a0715a29-40b8-4916-be0c-5019c8f4165f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:35.649046 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a0715a29-40b8-4916-be0c-5019c8f4165f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:35.650547 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a0715a29-40b8-4916-be0c-5019c8f4165f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:35.653164 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a0715a29-40b8-4916-be0c-5019c8f4165f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:36.762447 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a0715a29-40b8-4916-be0c-5019c8f4165f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:36.773122 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a0715a29-40b8-4916-be0c-5019c8f4165f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde" status: 200 len: 1315 microversion: 2.1 time: 1.157027 Aug 07 01:30:36.773310 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1885/4098] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:35 2022] GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde => generated 1315 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:36.791821 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8ca4f41a-119e-4847-bdf8-7a0474545b55 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:36.794931 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8ca4f41a-119e-4847-bdf8-7a0474545b55 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:36.811767 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8ca4f41a-119e-4847-bdf8-7a0474545b55 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:36.812573 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8ca4f41a-119e-4847-bdf8-7a0474545b55 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:36.814373 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8ca4f41a-119e-4847-bdf8-7a0474545b55 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:36.815640 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8ca4f41a-119e-4847-bdf8-7a0474545b55 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:36.817473 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8ca4f41a-119e-4847-bdf8-7a0474545b55 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:36.818130 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8ca4f41a-119e-4847-bdf8-7a0474545b55 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:37.547012 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8ca4f41a-119e-4847-bdf8-7a0474545b55 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:37.565624 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8ca4f41a-119e-4847-bdf8-7a0474545b55 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1519 microversion: 2.1 time: 0.791369 Aug 07 01:30:37.568598 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1886/4099] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:36 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1519 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:37.601970 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-22e412d2-1ba4-4f31-befd-e04fa4111232 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:37.603409 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-22e412d2-1ba4-4f31-befd-e04fa4111232 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: dbc593a0-5c59-4d1b-a538-157daf632f2e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:37.628641 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22e412d2-1ba4-4f31-befd-e04fa4111232 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:37.633432 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22e412d2-1ba4-4f31-befd-e04fa4111232 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:37.634916 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22e412d2-1ba4-4f31-befd-e04fa4111232 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:37.636243 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22e412d2-1ba4-4f31-befd-e04fa4111232 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:37.645909 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22e412d2-1ba4-4f31-befd-e04fa4111232 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:37.646224 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22e412d2-1ba4-4f31-befd-e04fa4111232 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:38.101441 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-0731eeff-6d42-4535-87ab-8c1ee157b5a1 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:30:38.103198 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-0731eeff-6d42-4535-87ab-8c1ee157b5a1 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:30:38.105125 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-0731eeff-6d42-4535-87ab-8c1ee157b5a1 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:30:38.106383 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-0731eeff-6d42-4535-87ab-8c1ee157b5a1 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:30:38.107677 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-0731eeff-6d42-4535-87ab-8c1ee157b5a1 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:30:38.126052 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0731eeff-6d42-4535-87ab-8c1ee157b5a1 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:38.127948 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0731eeff-6d42-4535-87ab-8c1ee157b5a1 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:38.129097 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0731eeff-6d42-4535-87ab-8c1ee157b5a1 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:38.130145 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0731eeff-6d42-4535-87ab-8c1ee157b5a1 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:38.132100 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0731eeff-6d42-4535-87ab-8c1ee157b5a1 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:38.133954 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0731eeff-6d42-4535-87ab-8c1ee157b5a1 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:38.187680 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-0731eeff-6d42-4535-87ab-8c1ee157b5a1 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Getting quotas for project 5f88662ebb674ad99a4d36651dee967a. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:30:38.194230 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:38.221101 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-0731eeff-6d42-4535-87ab-8c1ee157b5a1 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Getting quotas for user 474a78f0b2784e01b3d2a6ff6694b8bb and project 5f88662ebb674ad99a4d36651dee967a. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:30:38.255467 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0731eeff-6d42-4535-87ab-8c1ee157b5a1 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:30:38.266393 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0731eeff-6d42-4535-87ab-8c1ee157b5a1 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 283ecb61-1e24-4f11-938e-ff33e79c34cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:30:38.367697 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0731eeff-6d42-4535-87ab-8c1ee157b5a1 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.056836 Aug 07 01:30:38.369314 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2214/4100] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:30:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 3059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 07 01:30:38.385337 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7eb49a0c-0948-4689-83bf-1951c69ff5e9 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:38.386278 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7eb49a0c-0948-4689-83bf-1951c69ff5e9 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 6ddf1e46-f885-4128-9530-5118bc687cde] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:38.403520 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7eb49a0c-0948-4689-83bf-1951c69ff5e9 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:38.405111 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7eb49a0c-0948-4689-83bf-1951c69ff5e9 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:38.408982 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7eb49a0c-0948-4689-83bf-1951c69ff5e9 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:38.410099 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7eb49a0c-0948-4689-83bf-1951c69ff5e9 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:38.410609 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7eb49a0c-0948-4689-83bf-1951c69ff5e9 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:38.413267 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7eb49a0c-0948-4689-83bf-1951c69ff5e9 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:38.827053 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-22e412d2-1ba4-4f31-befd-e04fa4111232 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:38.839390 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-22e412d2-1ba4-4f31-befd-e04fa4111232 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e" status: 200 len: 1512 microversion: 2.1 time: 1.268885 Aug 07 01:30:38.840320 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1887/4101] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:37 2022] GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e => generated 1512 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:39.346834 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-cfcf38a6-a03a-4d81-a249-a4c59396fa93 req-0c1accc4-5a52-463e-a526-77f40cf30c1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9b1883a-c95a-4c49-ad6d-335ecf03b015", "name": "network-vif-plugged", "status": "completed", "tag": "cb3c2bf2-1cb1-4779-8b61-f6d977daac69"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:39.396094 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-cfcf38a6-a03a-4d81-a249-a4c59396fa93 req-0c1accc4-5a52-463e-a526-77f40cf30c1c service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:39.400774 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-cfcf38a6-a03a-4d81-a249-a4c59396fa93 req-0c1accc4-5a52-463e-a526-77f40cf30c1c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:39.402333 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-cfcf38a6-a03a-4d81-a249-a4c59396fa93 req-0c1accc4-5a52-463e-a526-77f40cf30c1c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:39.454378 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-cfcf38a6-a03a-4d81-a249-a4c59396fa93 req-0c1accc4-5a52-463e-a526-77f40cf30c1c service nova] Creating event network-vif-plugged:cb3c2bf2-1cb1-4779-8b61-f6d977daac69 for instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 on n-h2-master-1 Aug 07 01:30:39.499628 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-cfcf38a6-a03a-4d81-a249-a4c59396fa93 req-0c1accc4-5a52-463e-a526-77f40cf30c1c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.649426 Aug 07 01:30:39.504270 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1888/4102] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:30:39.531998 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-035386e5-9b1f-4b53-a303-557af73edcf0 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:39.539141 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-035386e5-9b1f-4b53-a303-557af73edcf0 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 283ecb61-1e24-4f11-938e-ff33e79c34cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:39.746767 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7eb49a0c-0948-4689-83bf-1951c69ff5e9 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:39.779850 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7eb49a0c-0948-4689-83bf-1951c69ff5e9 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde" status: 200 len: 1315 microversion: 2.1 time: 1.406363 Aug 07 01:30:39.782446 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2215/4103] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:38 2022] GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde => generated 1315 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:39.804709 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1efa5aec-0993-4e6d-9f0b-9fc9af593a69 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:39.807450 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1efa5aec-0993-4e6d-9f0b-9fc9af593a69 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:39.837506 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1efa5aec-0993-4e6d-9f0b-9fc9af593a69 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:39.838111 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1efa5aec-0993-4e6d-9f0b-9fc9af593a69 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:39.838578 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1efa5aec-0993-4e6d-9f0b-9fc9af593a69 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:39.843916 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1efa5aec-0993-4e6d-9f0b-9fc9af593a69 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:39.847604 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1efa5aec-0993-4e6d-9f0b-9fc9af593a69 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:39.848393 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1efa5aec-0993-4e6d-9f0b-9fc9af593a69 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:39.957734 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-035386e5-9b1f-4b53-a303-557af73edcf0 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:39.986320 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-035386e5-9b1f-4b53-a303-557af73edcf0 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd" status: 200 len: 1220 microversion: 2.1 time: 0.476886 Aug 07 01:30:39.986909 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1889/4104] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:39 2022] GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd => generated 1220 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:40.038435 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-64a5071c-4a4c-4c3e-a33e-e47fe61dff1e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:40.042163 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-64a5071c-4a4c-4c3e-a33e-e47fe61dff1e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: dbc593a0-5c59-4d1b-a538-157daf632f2e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:40.051525 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64a5071c-4a4c-4c3e-a33e-e47fe61dff1e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:40.052394 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64a5071c-4a4c-4c3e-a33e-e47fe61dff1e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:40.054220 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64a5071c-4a4c-4c3e-a33e-e47fe61dff1e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:40.056477 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64a5071c-4a4c-4c3e-a33e-e47fe61dff1e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:40.061288 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64a5071c-4a4c-4c3e-a33e-e47fe61dff1e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:40.062119 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64a5071c-4a4c-4c3e-a33e-e47fe61dff1e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:40.314836 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1efa5aec-0993-4e6d-9f0b-9fc9af593a69 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:40.336247 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1efa5aec-0993-4e6d-9f0b-9fc9af593a69 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1519 microversion: 2.1 time: 0.552029 Aug 07 01:30:40.337597 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2216/4105] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:39 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1519 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:40.813185 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3a83e6e4-c103-4a85-8d21-ed4661496cd2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:40.820172 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3a83e6e4-c103-4a85-8d21-ed4661496cd2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 6ddf1e46-f885-4128-9530-5118bc687cde] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:40.850531 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a83e6e4-c103-4a85-8d21-ed4661496cd2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:40.852611 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a83e6e4-c103-4a85-8d21-ed4661496cd2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:40.853952 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a83e6e4-c103-4a85-8d21-ed4661496cd2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:40.855188 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a83e6e4-c103-4a85-8d21-ed4661496cd2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:40.860082 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a83e6e4-c103-4a85-8d21-ed4661496cd2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:40.861010 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a83e6e4-c103-4a85-8d21-ed4661496cd2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:41.391782 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3a83e6e4-c103-4a85-8d21-ed4661496cd2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:41.408833 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-64a5071c-4a4c-4c3e-a33e-e47fe61dff1e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:41.425046 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3a83e6e4-c103-4a85-8d21-ed4661496cd2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde" status: 200 len: 1315 microversion: 2.1 time: 0.621002 Aug 07 01:30:41.426486 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2217/4106] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:40 2022] GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde => generated 1315 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:41.442067 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-49ee87bb-8bdf-426a-b4ed-d73ea70506ed tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:41.442893 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-49ee87bb-8bdf-426a-b4ed-d73ea70506ed tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 283ecb61-1e24-4f11-938e-ff33e79c34cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:41.470920 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-49ee87bb-8bdf-426a-b4ed-d73ea70506ed tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:41.471867 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-49ee87bb-8bdf-426a-b4ed-d73ea70506ed tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:41.472680 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-49ee87bb-8bdf-426a-b4ed-d73ea70506ed tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:41.473380 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-64a5071c-4a4c-4c3e-a33e-e47fe61dff1e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e" status: 200 len: 1512 microversion: 2.1 time: 1.476208 Aug 07 01:30:41.474293 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-49ee87bb-8bdf-426a-b4ed-d73ea70506ed tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:41.474412 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1890/4107] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:39 2022] GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e => generated 1512 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:41.476189 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-49ee87bb-8bdf-426a-b4ed-d73ea70506ed tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:41.477204 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-49ee87bb-8bdf-426a-b4ed-d73ea70506ed tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:41.486900 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-03c60fec-d210-40e1-8c05-2aaf7c6c631c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:41.494049 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-03c60fec-d210-40e1-8c05-2aaf7c6c631c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:41.505755 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-03c60fec-d210-40e1-8c05-2aaf7c6c631c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:41.507637 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-03c60fec-d210-40e1-8c05-2aaf7c6c631c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:41.509259 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-03c60fec-d210-40e1-8c05-2aaf7c6c631c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:41.510405 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-03c60fec-d210-40e1-8c05-2aaf7c6c631c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:41.512109 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-03c60fec-d210-40e1-8c05-2aaf7c6c631c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:41.512414 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-03c60fec-d210-40e1-8c05-2aaf7c6c631c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:41.775280 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-49ee87bb-8bdf-426a-b4ed-d73ea70506ed tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:41.792299 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-49ee87bb-8bdf-426a-b4ed-d73ea70506ed tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd" status: 200 len: 1278 microversion: 2.1 time: 0.364459 Aug 07 01:30:41.803916 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2218/4108] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:41 2022] GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd => generated 1278 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:41.812640 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-3ff7c0e4-0bb6-4a55-a7bb-608b86171101 req-67d1661b-9ecb-43c8-bf43-2f8a6e742332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ddf1e46-f885-4128-9530-5118bc687cde", "name": "network-vif-plugged", "status": "completed", "tag": "80d83a5c-0316-4c2a-870a-d8eb535ee6a2"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:41.859740 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3ff7c0e4-0bb6-4a55-a7bb-608b86171101 req-67d1661b-9ecb-43c8-bf43-2f8a6e742332 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:41.873889 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3ff7c0e4-0bb6-4a55-a7bb-608b86171101 req-67d1661b-9ecb-43c8-bf43-2f8a6e742332 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:41.874937 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3ff7c0e4-0bb6-4a55-a7bb-608b86171101 req-67d1661b-9ecb-43c8-bf43-2f8a6e742332 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:41.923177 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-3ff7c0e4-0bb6-4a55-a7bb-608b86171101 req-67d1661b-9ecb-43c8-bf43-2f8a6e742332 service nova] Creating event network-vif-plugged:80d83a5c-0316-4c2a-870a-d8eb535ee6a2 for instance 6ddf1e46-f885-4128-9530-5118bc687cde on n-h2-master-1 Aug 07 01:30:41.970756 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-3ff7c0e4-0bb6-4a55-a7bb-608b86171101 req-67d1661b-9ecb-43c8-bf43-2f8a6e742332 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167766 Aug 07 01:30:41.972064 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2219/4109] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:30:42.453644 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-244b9264-98c7-4009-b2a5-b62382a4a1fb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:42.454375 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-244b9264-98c7-4009-b2a5-b62382a4a1fb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 6ddf1e46-f885-4128-9530-5118bc687cde] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:42.477892 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-244b9264-98c7-4009-b2a5-b62382a4a1fb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:42.478606 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-244b9264-98c7-4009-b2a5-b62382a4a1fb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:42.479250 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-244b9264-98c7-4009-b2a5-b62382a4a1fb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:42.481319 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-244b9264-98c7-4009-b2a5-b62382a4a1fb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:42.482396 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-244b9264-98c7-4009-b2a5-b62382a4a1fb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:42.486976 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-244b9264-98c7-4009-b2a5-b62382a4a1fb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:43.217464 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-03c60fec-d210-40e1-8c05-2aaf7c6c631c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:43.241582 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-03c60fec-d210-40e1-8c05-2aaf7c6c631c tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1519 microversion: 2.1 time: 1.763499 Aug 07 01:30:43.243015 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1891/4110] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:41 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1519 bytes in 1768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:43.250074 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4bf44215-7a80-4b58-8632-7046724d0da4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:43.251060 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4bf44215-7a80-4b58-8632-7046724d0da4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: dbc593a0-5c59-4d1b-a538-157daf632f2e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:43.262278 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4bf44215-7a80-4b58-8632-7046724d0da4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:43.263160 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4bf44215-7a80-4b58-8632-7046724d0da4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:43.263844 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4bf44215-7a80-4b58-8632-7046724d0da4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:43.265610 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4bf44215-7a80-4b58-8632-7046724d0da4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:43.266410 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4bf44215-7a80-4b58-8632-7046724d0da4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:43.266854 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4bf44215-7a80-4b58-8632-7046724d0da4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:43.313583 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-244b9264-98c7-4009-b2a5-b62382a4a1fb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:43.341594 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-244b9264-98c7-4009-b2a5-b62382a4a1fb tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde" status: 200 len: 1315 microversion: 2.1 time: 0.893816 Aug 07 01:30:43.343643 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2220/4111] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:42 2022] GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde => generated 1315 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:30:43.363467 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fb2b4a09-def8-4823-8ec7-32be44739fb5 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:43.364633 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fb2b4a09-def8-4823-8ec7-32be44739fb5 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 283ecb61-1e24-4f11-938e-ff33e79c34cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:43.379350 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fb2b4a09-def8-4823-8ec7-32be44739fb5 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:43.380305 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fb2b4a09-def8-4823-8ec7-32be44739fb5 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:43.380956 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fb2b4a09-def8-4823-8ec7-32be44739fb5 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:43.382261 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fb2b4a09-def8-4823-8ec7-32be44739fb5 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:43.382975 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fb2b4a09-def8-4823-8ec7-32be44739fb5 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:43.383650 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fb2b4a09-def8-4823-8ec7-32be44739fb5 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:43.507021 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fb2b4a09-def8-4823-8ec7-32be44739fb5 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:43.517935 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fb2b4a09-def8-4823-8ec7-32be44739fb5 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd" status: 200 len: 1278 microversion: 2.1 time: 0.172567 Aug 07 01:30:43.519080 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2221/4112] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:43 2022] GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd => generated 1278 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:43.618924 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-7a24af32-9a49-4e34-88f7-7735a19d4be8 req-8f3e2e3b-d111-437a-8f3f-d9ad97f942bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "425b6340-2984-4339-9728-2914b55bd418", "tag": "4ce8dd93-d7bb-4619-9c47-482e9af09d28"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:43.647923 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-7a24af32-9a49-4e34-88f7-7735a19d4be8 req-8f3e2e3b-d111-437a-8f3f-d9ad97f942bb service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:43.650660 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-7a24af32-9a49-4e34-88f7-7735a19d4be8 req-8f3e2e3b-d111-437a-8f3f-d9ad97f942bb service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:43.651318 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-7a24af32-9a49-4e34-88f7-7735a19d4be8 req-8f3e2e3b-d111-437a-8f3f-d9ad97f942bb service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:43.695124 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-7a24af32-9a49-4e34-88f7-7735a19d4be8 req-8f3e2e3b-d111-437a-8f3f-d9ad97f942bb service nova] Creating event network-changed:4ce8dd93-d7bb-4619-9c47-482e9af09d28 for instance 425b6340-2984-4339-9728-2914b55bd418 on n-h1-master-1 Aug 07 01:30:43.700863 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4bf44215-7a80-4b58-8632-7046724d0da4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:43.730807 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4bf44215-7a80-4b58-8632-7046724d0da4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e" status: 200 len: 1512 microversion: 2.1 time: 0.486263 Aug 07 01:30:43.732365 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1892/4113] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:43 2022] GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e => generated 1512 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:43.737746 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-7a24af32-9a49-4e34-88f7-7735a19d4be8 req-8f3e2e3b-d111-437a-8f3f-d9ad97f942bb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130811 Aug 07 01:30:43.741231 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2222/4114] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:30:44.270384 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5d54da52-5970-4285-ac76-9cf604a5bb4a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:44.271766 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5d54da52-5970-4285-ac76-9cf604a5bb4a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:44.288591 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d54da52-5970-4285-ac76-9cf604a5bb4a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:44.289940 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d54da52-5970-4285-ac76-9cf604a5bb4a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:44.293501 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d54da52-5970-4285-ac76-9cf604a5bb4a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:44.295356 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d54da52-5970-4285-ac76-9cf604a5bb4a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:44.296342 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d54da52-5970-4285-ac76-9cf604a5bb4a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:44.297040 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d54da52-5970-4285-ac76-9cf604a5bb4a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:44.366957 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-67bd1b09-70b0-4a42-a5ff-aa7a4ec967d6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:44.368122 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-67bd1b09-70b0-4a42-a5ff-aa7a4ec967d6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 6ddf1e46-f885-4128-9530-5118bc687cde] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:44.379601 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67bd1b09-70b0-4a42-a5ff-aa7a4ec967d6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:44.380196 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67bd1b09-70b0-4a42-a5ff-aa7a4ec967d6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:44.380650 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67bd1b09-70b0-4a42-a5ff-aa7a4ec967d6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:44.382897 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67bd1b09-70b0-4a42-a5ff-aa7a4ec967d6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:44.383602 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67bd1b09-70b0-4a42-a5ff-aa7a4ec967d6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:44.384245 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67bd1b09-70b0-4a42-a5ff-aa7a4ec967d6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:44.875352 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-67bd1b09-70b0-4a42-a5ff-aa7a4ec967d6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:44.895637 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-67bd1b09-70b0-4a42-a5ff-aa7a4ec967d6 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde" status: 200 len: 1501 microversion: 2.1 time: 0.533146 Aug 07 01:30:44.897498 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2223/4115] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:44 2022] GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde => generated 1501 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:30:44.910552 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5d54da52-5970-4285-ac76-9cf604a5bb4a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:44.921217 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ba9c2297-082e-4252-acdb-25273fa7d436 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:44.922395 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ba9c2297-082e-4252-acdb-25273fa7d436 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 283ecb61-1e24-4f11-938e-ff33e79c34cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:44.926186 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5d54da52-5970-4285-ac76-9cf604a5bb4a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.661507 Aug 07 01:30:44.939963 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1893/4116] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:44 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:44.939963 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b49b890f-0e62-49fc-a1e7-6e380f904860 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:44.939963 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b49b890f-0e62-49fc-a1e7-6e380f904860 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: dbc593a0-5c59-4d1b-a538-157daf632f2e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:44.952219 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ba9c2297-082e-4252-acdb-25273fa7d436 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:44.952812 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ba9c2297-082e-4252-acdb-25273fa7d436 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:44.953277 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ba9c2297-082e-4252-acdb-25273fa7d436 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:44.954050 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ba9c2297-082e-4252-acdb-25273fa7d436 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:44.954526 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ba9c2297-082e-4252-acdb-25273fa7d436 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:44.954966 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ba9c2297-082e-4252-acdb-25273fa7d436 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:44.961677 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b49b890f-0e62-49fc-a1e7-6e380f904860 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:44.968432 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b49b890f-0e62-49fc-a1e7-6e380f904860 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:44.968971 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b49b890f-0e62-49fc-a1e7-6e380f904860 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:44.971799 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b49b890f-0e62-49fc-a1e7-6e380f904860 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:44.973451 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b49b890f-0e62-49fc-a1e7-6e380f904860 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:44.976043 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b49b890f-0e62-49fc-a1e7-6e380f904860 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:45.148930 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ba9c2297-082e-4252-acdb-25273fa7d436 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:45.163299 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ba9c2297-082e-4252-acdb-25273fa7d436 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd" status: 200 len: 1278 microversion: 2.1 time: 0.264236 Aug 07 01:30:45.169085 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2224/4117] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:44 2022] GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd => generated 1278 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:45.187848 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f2dc69d0-484e-4162-b516-8db5d351fd3f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:45.191379 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f2dc69d0-484e-4162-b516-8db5d351fd3f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 6ddf1e46-f885-4128-9530-5118bc687cde] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:45.207439 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2dc69d0-484e-4162-b516-8db5d351fd3f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:45.210246 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2dc69d0-484e-4162-b516-8db5d351fd3f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:45.211476 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2dc69d0-484e-4162-b516-8db5d351fd3f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:45.211655 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2dc69d0-484e-4162-b516-8db5d351fd3f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:45.212255 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2dc69d0-484e-4162-b516-8db5d351fd3f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:45.212725 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2dc69d0-484e-4162-b516-8db5d351fd3f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:45.661467 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b49b890f-0e62-49fc-a1e7-6e380f904860 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:45.698605 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b49b890f-0e62-49fc-a1e7-6e380f904860 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e" status: 200 len: 1512 microversion: 2.1 time: 0.766923 Aug 07 01:30:45.704186 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1894/4118] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:44 2022] GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e => generated 1512 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:45.711227 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5ef59056-e5cb-4e8b-a675-ad3e7e9f22f6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:45.716820 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5ef59056-e5cb-4e8b-a675-ad3e7e9f22f6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:45.750525 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5ef59056-e5cb-4e8b-a675-ad3e7e9f22f6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:45.751761 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5ef59056-e5cb-4e8b-a675-ad3e7e9f22f6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:45.752828 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5ef59056-e5cb-4e8b-a675-ad3e7e9f22f6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:45.754379 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5ef59056-e5cb-4e8b-a675-ad3e7e9f22f6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:45.768228 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5ef59056-e5cb-4e8b-a675-ad3e7e9f22f6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:45.769549 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5ef59056-e5cb-4e8b-a675-ad3e7e9f22f6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:46.660433 n-d-master-1 devstack@n-api.service[119516]: INFO nova.network.security_group_api [None req-f2dc69d0-484e-4162-b516-8db5d351fd3f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Removing security group d5151502-74a8-400d-a2d6-75caa073d90d from port 80d83a5c-0316-4c2a-870a-d8eb535ee6a2 Aug 07 01:30:46.769524 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5ef59056-e5cb-4e8b-a675-ad3e7e9f22f6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:46.787147 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5ef59056-e5cb-4e8b-a675-ad3e7e9f22f6 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 1.081462 Aug 07 01:30:46.789378 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1895/4119] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:45 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:46.800841 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d178c851-7e2b-4a4c-bb5c-3da9ed2c6faf tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:46.802002 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d178c851-7e2b-4a4c-bb5c-3da9ed2c6faf tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 283ecb61-1e24-4f11-938e-ff33e79c34cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:46.816995 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d178c851-7e2b-4a4c-bb5c-3da9ed2c6faf tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:46.821119 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d178c851-7e2b-4a4c-bb5c-3da9ed2c6faf tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:46.827747 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d178c851-7e2b-4a4c-bb5c-3da9ed2c6faf tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:46.831126 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d178c851-7e2b-4a4c-bb5c-3da9ed2c6faf tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:46.832460 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d178c851-7e2b-4a4c-bb5c-3da9ed2c6faf tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:46.835826 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d178c851-7e2b-4a4c-bb5c-3da9ed2c6faf tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:47.972246 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d178c851-7e2b-4a4c-bb5c-3da9ed2c6faf tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:47.984725 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d178c851-7e2b-4a4c-bb5c-3da9ed2c6faf tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd" status: 200 len: 1320 microversion: 2.1 time: 1.192945 Aug 07 01:30:47.986832 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1896/4120] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:46 2022] GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd => generated 1320 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:47.993061 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e064ffec-2184-4322-9152-41ae9bf80a48 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:47.993916 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e064ffec-2184-4322-9152-41ae9bf80a48 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: dbc593a0-5c59-4d1b-a538-157daf632f2e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:48.001282 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e064ffec-2184-4322-9152-41ae9bf80a48 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:48.002068 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e064ffec-2184-4322-9152-41ae9bf80a48 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:48.002668 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e064ffec-2184-4322-9152-41ae9bf80a48 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:48.003623 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e064ffec-2184-4322-9152-41ae9bf80a48 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:48.004273 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e064ffec-2184-4322-9152-41ae9bf80a48 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:48.005182 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e064ffec-2184-4322-9152-41ae9bf80a48 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:48.135763 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f2dc69d0-484e-4162-b516-8db5d351fd3f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde/action" status: 202 len: 0 microversion: 2.1 time: 2.964942 Aug 07 01:30:48.139758 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2225/4121] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:30:45 2022] POST /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde/action => generated 0 bytes in 2970 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:30:48.162020 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ff3c3a4c-d373-4669-bac3-8886b5332ea8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:48.169811 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ff3c3a4c-d373-4669-bac3-8886b5332ea8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:48.180218 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:48.183117 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ff3c3a4c-d373-4669-bac3-8886b5332ea8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:48.183823 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ff3c3a4c-d373-4669-bac3-8886b5332ea8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:48.184671 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ff3c3a4c-d373-4669-bac3-8886b5332ea8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:48.185857 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ff3c3a4c-d373-4669-bac3-8886b5332ea8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:48.186783 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ff3c3a4c-d373-4669-bac3-8886b5332ea8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:48.187667 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ff3c3a4c-d373-4669-bac3-8886b5332ea8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:48.259790 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=18 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:48.604018 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ff3c3a4c-d373-4669-bac3-8886b5332ea8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:48.632758 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ff3c3a4c-d373-4669-bac3-8886b5332ea8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.485003 Aug 07 01:30:48.634015 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2226/4122] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:48 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:48.639548 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-948ca517-1631-49e3-a9e4-9b9b62e96539 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:48.640546 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-948ca517-1631-49e3-a9e4-9b9b62e96539 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 6ddf1e46-f885-4128-9530-5118bc687cde] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:48.648232 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-948ca517-1631-49e3-a9e4-9b9b62e96539 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:48.649585 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-948ca517-1631-49e3-a9e4-9b9b62e96539 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:48.650195 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-948ca517-1631-49e3-a9e4-9b9b62e96539 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:48.655083 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-948ca517-1631-49e3-a9e4-9b9b62e96539 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:48.656980 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-948ca517-1631-49e3-a9e4-9b9b62e96539 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:48.659526 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-948ca517-1631-49e3-a9e4-9b9b62e96539 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:48.793387 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-948ca517-1631-49e3-a9e4-9b9b62e96539 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:48.832728 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-948ca517-1631-49e3-a9e4-9b9b62e96539 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde" status: 200 len: 1459 microversion: 2.1 time: 0.197365 Aug 07 01:30:48.849431 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2227/4123] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:48 2022] GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde => generated 1459 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:48.855494 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-bc83b6ae-8437-45a8-a1eb-7f524e46c398 req-2b8da9b0-f029-4ac8-a349-12b5af12b271 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ddf1e46-f885-4128-9530-5118bc687cde", "tag": "80d83a5c-0316-4c2a-870a-d8eb535ee6a2"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:48.866695 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-bc83b6ae-8437-45a8-a1eb-7f524e46c398 req-2b8da9b0-f029-4ac8-a349-12b5af12b271 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:48.867343 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-bc83b6ae-8437-45a8-a1eb-7f524e46c398 req-2b8da9b0-f029-4ac8-a349-12b5af12b271 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:48.867801 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-bc83b6ae-8437-45a8-a1eb-7f524e46c398 req-2b8da9b0-f029-4ac8-a349-12b5af12b271 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:48.893111 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-bc83b6ae-8437-45a8-a1eb-7f524e46c398 req-2b8da9b0-f029-4ac8-a349-12b5af12b271 service nova] Creating event network-changed:80d83a5c-0316-4c2a-870a-d8eb535ee6a2 for instance 6ddf1e46-f885-4128-9530-5118bc687cde on n-h2-master-1 Aug 07 01:30:48.909297 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-bc83b6ae-8437-45a8-a1eb-7f524e46c398 req-2b8da9b0-f029-4ac8-a349-12b5af12b271 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057666 Aug 07 01:30:48.910114 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2228/4124] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:30:48.921916 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e3a6cd01-5a06-461e-8cf2-b67d2318609f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:48.931029 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-e3a6cd01-5a06-461e-8cf2-b67d2318609f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] HTTP exception thrown: Instance 75493926-e069-4a9b-9ec8-325562675e55 has no mapping to a cell. Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e3a6cd01-5a06-461e-8cf2-b67d2318609f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers/75493926-e069-4a9b-9ec8-325562675e55/action HTTP/1.1 Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 15 Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: {"os-stop": {}} Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 75493926-e069-4a9b-9ec8-325562675e55 has no mapping to a cell. Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '75493926-e069-4a9b-9ec8-325562675e55', 'body': {'os-stop': {}}} Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 75493926-e069-4a9b-9ec8-325562675e55 has no mapping to a cell. Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:30:48.946031 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75493926-e069-4a9b-9ec8-325562675e55 has no mapping to a cell. Aug 07 01:30:48.954873 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:30:48.954873 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:30:48.954873 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:30:48.954873 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:30:48.954873 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:30:48.954873 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:30:48.954873 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:30:48.954873 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:30:48.954873 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75493926-e069-4a9b-9ec8-325562675e55 has no mapping to a cell. Aug 07 01:30:48.954873 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:30:48.954873 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e3a6cd01-5a06-461e-8cf2-b67d2318609f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 404 to user: Instance 75493926-e069-4a9b-9ec8-325562675e55 has no mapping to a cell. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:30:48.954873 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e3a6cd01-5a06-461e-8cf2-b67d2318609f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers/75493926-e069-4a9b-9ec8-325562675e55/action" status: 404 len: 117 microversion: 2.1 time: 0.033204 Aug 07 01:30:48.954873 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2229/4125] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:30:48 2022] POST /compute/v2.1/servers/75493926-e069-4a9b-9ec8-325562675e55/action => generated 117 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:30:49.073205 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-19cd9116-3a94-409b-8d44-abf5f5cf09e9 req-676dae4f-5e3c-4235-820f-f6024c7fd274 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd399490-133f-43a2-b0b7-ed5448e52dab", "tag": "9c6b6772-80fb-4b2a-8f4c-bbf5f1af23ef"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:49.084277 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-19cd9116-3a94-409b-8d44-abf5f5cf09e9 req-676dae4f-5e3c-4235-820f-f6024c7fd274 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:49.084750 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-19cd9116-3a94-409b-8d44-abf5f5cf09e9 req-676dae4f-5e3c-4235-820f-f6024c7fd274 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:49.085178 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-19cd9116-3a94-409b-8d44-abf5f5cf09e9 req-676dae4f-5e3c-4235-820f-f6024c7fd274 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:49.102196 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-19cd9116-3a94-409b-8d44-abf5f5cf09e9 req-676dae4f-5e3c-4235-820f-f6024c7fd274 service nova] Creating event network-changed:9c6b6772-80fb-4b2a-8f4c-bbf5f1af23ef for instance cd399490-133f-43a2-b0b7-ed5448e52dab on n-h2-master-1 Aug 07 01:30:49.107109 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-19cd9116-3a94-409b-8d44-abf5f5cf09e9 req-676dae4f-5e3c-4235-820f-f6024c7fd274 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152139 Aug 07 01:30:49.107723 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2230/4126] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:30:49.113744 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-acf382b0-fdde-46af-8c06-3137e1d30bc4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:49.113893 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e064ffec-2184-4322-9152-41ae9bf80a48 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:49.115159 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-acf382b0-fdde-46af-8c06-3137e1d30bc4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:49.123064 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-acf382b0-fdde-46af-8c06-3137e1d30bc4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:49.123811 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-acf382b0-fdde-46af-8c06-3137e1d30bc4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:49.124454 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-acf382b0-fdde-46af-8c06-3137e1d30bc4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:49.125351 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-acf382b0-fdde-46af-8c06-3137e1d30bc4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:49.125985 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-acf382b0-fdde-46af-8c06-3137e1d30bc4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:49.126629 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e064ffec-2184-4322-9152-41ae9bf80a48 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e" status: 200 len: 1489 microversion: 2.1 time: 1.138404 Aug 07 01:30:49.126745 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-acf382b0-fdde-46af-8c06-3137e1d30bc4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:49.132762 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1897/4127] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:47 2022] GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e => generated 1489 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:49.140392 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-adb7b8a6-3eee-426e-ac29-17a58f95ea48 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:49.141354 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-adb7b8a6-3eee-426e-ac29-17a58f95ea48 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:49.145554 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=74 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:49.151724 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-adb7b8a6-3eee-426e-ac29-17a58f95ea48 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:49.154308 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-adb7b8a6-3eee-426e-ac29-17a58f95ea48 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:49.155114 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-adb7b8a6-3eee-426e-ac29-17a58f95ea48 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:49.157471 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-adb7b8a6-3eee-426e-ac29-17a58f95ea48 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:49.158794 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-adb7b8a6-3eee-426e-ac29-17a58f95ea48 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:49.159871 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-adb7b8a6-3eee-426e-ac29-17a58f95ea48 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:49.311486 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-acf382b0-fdde-46af-8c06-3137e1d30bc4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:49.320272 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:49.323143 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-acf382b0-fdde-46af-8c06-3137e1d30bc4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.213849 Aug 07 01:30:49.324133 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2231/4128] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:49 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:49.329082 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bd4af14e-c186-4ad1-bdda-b8e2c49ee155 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:49.329829 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bd4af14e-c186-4ad1-bdda-b8e2c49ee155 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 283ecb61-1e24-4f11-938e-ff33e79c34cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:49.347441 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd4af14e-c186-4ad1-bdda-b8e2c49ee155 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:49.348110 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd4af14e-c186-4ad1-bdda-b8e2c49ee155 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:49.348879 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd4af14e-c186-4ad1-bdda-b8e2c49ee155 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:49.349746 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd4af14e-c186-4ad1-bdda-b8e2c49ee155 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:49.350693 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd4af14e-c186-4ad1-bdda-b8e2c49ee155 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:49.351125 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd4af14e-c186-4ad1-bdda-b8e2c49ee155 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:49.621132 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bd4af14e-c186-4ad1-bdda-b8e2c49ee155 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:49.632375 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bd4af14e-c186-4ad1-bdda-b8e2c49ee155 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd" status: 200 len: 1320 microversion: 2.1 time: 0.306817 Aug 07 01:30:49.632988 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2232/4129] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:49 2022] GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd => generated 1320 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:49.679573 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-44f6a824-bc36-4089-a473-43224c155344 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:49.682533 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-44f6a824-bc36-4089-a473-43224c155344 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: dbc593a0-5c59-4d1b-a538-157daf632f2e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:49.700163 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-44f6a824-bc36-4089-a473-43224c155344 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:49.702540 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-44f6a824-bc36-4089-a473-43224c155344 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:49.703205 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-44f6a824-bc36-4089-a473-43224c155344 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:49.705989 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-44f6a824-bc36-4089-a473-43224c155344 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:49.706733 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-44f6a824-bc36-4089-a473-43224c155344 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:49.708442 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-44f6a824-bc36-4089-a473-43224c155344 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:49.749775 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-44f6a824-bc36-4089-a473-43224c155344 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: dbc593a0-5c59-4d1b-a538-157daf632f2e] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:30:49.850675 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-adb7b8a6-3eee-426e-ac29-17a58f95ea48 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:49.862552 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-44f6a824-bc36-4089-a473-43224c155344 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "DELETE /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e" status: 204 len: 0 microversion: 2.1 time: 0.201927 Aug 07 01:30:49.867697 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2233/4130] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:30:49 2022] DELETE /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:30:49.869077 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-adb7b8a6-3eee-426e-ac29-17a58f95ea48 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.733254 Aug 07 01:30:49.871097 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1898/4131] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:49 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:49.871229 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3e621c62-4554-4959-a8c9-47d546647597 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:49.871907 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3e621c62-4554-4959-a8c9-47d546647597 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:49.878991 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7e1c0f60-e434-441b-a9e3-04a9ff587c96 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:49.880985 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e621c62-4554-4959-a8c9-47d546647597 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:49.881384 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e621c62-4554-4959-a8c9-47d546647597 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:49.881783 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7e1c0f60-e434-441b-a9e3-04a9ff587c96 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: dbc593a0-5c59-4d1b-a538-157daf632f2e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:49.882007 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e621c62-4554-4959-a8c9-47d546647597 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:49.883463 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e621c62-4554-4959-a8c9-47d546647597 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:49.883862 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e621c62-4554-4959-a8c9-47d546647597 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:49.884329 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e621c62-4554-4959-a8c9-47d546647597 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:49.891234 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e1c0f60-e434-441b-a9e3-04a9ff587c96 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:49.892178 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e1c0f60-e434-441b-a9e3-04a9ff587c96 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:49.893008 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e1c0f60-e434-441b-a9e3-04a9ff587c96 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:49.894129 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e1c0f60-e434-441b-a9e3-04a9ff587c96 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:49.895095 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e1c0f60-e434-441b-a9e3-04a9ff587c96 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:49.895974 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e1c0f60-e434-441b-a9e3-04a9ff587c96 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:49.975857 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:50.170325 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3e621c62-4554-4959-a8c9-47d546647597 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:50.187441 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3e621c62-4554-4959-a8c9-47d546647597 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.322437 Aug 07 01:30:50.201390 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2234/4132] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:49 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:50.210431 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-18e09412-2a63-4489-91f0-9f72f7bab697 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:50.211937 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-18e09412-2a63-4489-91f0-9f72f7bab697 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:50.218621 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-18e09412-2a63-4489-91f0-9f72f7bab697 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:50.219393 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-18e09412-2a63-4489-91f0-9f72f7bab697 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:50.220024 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-18e09412-2a63-4489-91f0-9f72f7bab697 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:50.222835 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-18e09412-2a63-4489-91f0-9f72f7bab697 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:50.223589 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-18e09412-2a63-4489-91f0-9f72f7bab697 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:50.225709 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-18e09412-2a63-4489-91f0-9f72f7bab697 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:50.517143 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-18e09412-2a63-4489-91f0-9f72f7bab697 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:50.527132 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-18e09412-2a63-4489-91f0-9f72f7bab697 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.324412 Aug 07 01:30:50.528409 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2235/4133] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:50 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:50.533933 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4b1e2648-0486-408d-b9df-29918278b840 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:50.535002 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4b1e2648-0486-408d-b9df-29918278b840 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:50.547454 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b1e2648-0486-408d-b9df-29918278b840 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:50.548144 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b1e2648-0486-408d-b9df-29918278b840 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:50.549180 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b1e2648-0486-408d-b9df-29918278b840 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:50.550163 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b1e2648-0486-408d-b9df-29918278b840 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:50.550874 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b1e2648-0486-408d-b9df-29918278b840 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:50.552305 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b1e2648-0486-408d-b9df-29918278b840 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:50.610226 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7e1c0f60-e434-441b-a9e3-04a9ff587c96 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:50.622897 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7e1c0f60-e434-441b-a9e3-04a9ff587c96 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e" status: 200 len: 1495 microversion: 2.1 time: 0.749685 Aug 07 01:30:50.623661 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1899/4134] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:49 2022] GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e => generated 1495 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:50.629029 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9ab14be0-463a-4f42-bfbb-7238aa00626b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:50.629889 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9ab14be0-463a-4f42-bfbb-7238aa00626b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 5a54a28b-cb17-4f70-95cc-c554d0bc1a55] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:50.637098 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-9ab14be0-463a-4f42-bfbb-7238aa00626b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] HTTP exception thrown: Instance 5a54a28b-cb17-4f70-95cc-c554d0bc1a55 could not be found. Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9ab14be0-463a-4f42-bfbb-7238aa00626b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/servers/5a54a28b-cb17-4f70-95cc-c554d0bc1a55/action HTTP/1.1 Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 15 Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: {"suspend": {}} Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 5a54a28b-cb17-4f70-95cc-c554d0bc1a55 could not be found. Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '5a54a28b-cb17-4f70-95cc-c554d0bc1a55', 'body': {'suspend': {}}} Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a54a28b-cb17-4f70-95cc-c554d0bc1a55 could not be found. Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a54a28b-cb17-4f70-95cc-c554d0bc1a55 could not be found. Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:30:50.639681 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:30:50.648555 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:30:50.648555 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:30:50.648555 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a54a28b-cb17-4f70-95cc-c554d0bc1a55 could not be found. Aug 07 01:30:50.648555 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:50.648555 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9ab14be0-463a-4f42-bfbb-7238aa00626b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 404 to user: Instance 5a54a28b-cb17-4f70-95cc-c554d0bc1a55 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:30:50.648555 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9ab14be0-463a-4f42-bfbb-7238aa00626b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers/5a54a28b-cb17-4f70-95cc-c554d0bc1a55/action" status: 404 len: 111 microversion: 2.1 time: 0.016264 Aug 07 01:30:50.648555 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1900/4135] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:30:50 2022] POST /compute/v2.1/servers/5a54a28b-cb17-4f70-95cc-c554d0bc1a55/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:30:50.668796 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4f43b984-5f6c-4a4e-b8ad-71fbe60541ad tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:50.669637 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4f43b984-5f6c-4a4e-b8ad-71fbe60541ad tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:50.680335 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f43b984-5f6c-4a4e-b8ad-71fbe60541ad tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:50.681195 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f43b984-5f6c-4a4e-b8ad-71fbe60541ad tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:50.681869 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f43b984-5f6c-4a4e-b8ad-71fbe60541ad tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:50.682889 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f43b984-5f6c-4a4e-b8ad-71fbe60541ad tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:50.683737 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f43b984-5f6c-4a4e-b8ad-71fbe60541ad tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:50.685808 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f43b984-5f6c-4a4e-b8ad-71fbe60541ad tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:50.846294 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4b1e2648-0486-408d-b9df-29918278b840 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:50.856920 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4b1e2648-0486-408d-b9df-29918278b840 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.327104 Aug 07 01:30:50.873181 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2236/4136] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:50 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:50.882519 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f6821bab-e120-4732-b1b2-70cf2a30c063 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:50.884020 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f6821bab-e120-4732-b1b2-70cf2a30c063 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 283ecb61-1e24-4f11-938e-ff33e79c34cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:50.890770 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f6821bab-e120-4732-b1b2-70cf2a30c063 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:50.893711 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f6821bab-e120-4732-b1b2-70cf2a30c063 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:50.894486 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f6821bab-e120-4732-b1b2-70cf2a30c063 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:50.896327 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f6821bab-e120-4732-b1b2-70cf2a30c063 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:50.897168 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f6821bab-e120-4732-b1b2-70cf2a30c063 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:50.897951 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f6821bab-e120-4732-b1b2-70cf2a30c063 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:51.188127 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f6821bab-e120-4732-b1b2-70cf2a30c063 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:51.204270 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f6821bab-e120-4732-b1b2-70cf2a30c063 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd" status: 200 len: 1320 microversion: 2.1 time: 0.329463 Aug 07 01:30:51.205819 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2237/4137] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:50 2022] GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd => generated 1320 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:51.230140 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3c7ef202-868e-412e-a83e-f235737b5fe1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:51.231480 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3c7ef202-868e-412e-a83e-f235737b5fe1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:51.240881 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c7ef202-868e-412e-a83e-f235737b5fe1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:51.243165 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c7ef202-868e-412e-a83e-f235737b5fe1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:51.243917 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c7ef202-868e-412e-a83e-f235737b5fe1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:51.246048 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c7ef202-868e-412e-a83e-f235737b5fe1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:51.246550 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c7ef202-868e-412e-a83e-f235737b5fe1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:51.247008 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c7ef202-868e-412e-a83e-f235737b5fe1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:51.500498 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4f43b984-5f6c-4a4e-b8ad-71fbe60541ad tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:51.513283 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4f43b984-5f6c-4a4e-b8ad-71fbe60541ad tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.848588 Aug 07 01:30:51.514660 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1901/4138] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:50 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:30:51.520704 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-c2f6b862-363e-407a-8d8c-fb9150068812 req-e6aa55b4-7cf9-43b1-af15-0d0a7c944754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "425b6340-2984-4339-9728-2914b55bd418", "name": "network-vif-plugged", "status": "completed", "tag": "4ce8dd93-d7bb-4619-9c47-482e9af09d28"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:51.540884 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c2f6b862-363e-407a-8d8c-fb9150068812 req-e6aa55b4-7cf9-43b1-af15-0d0a7c944754 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:51.542441 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c2f6b862-363e-407a-8d8c-fb9150068812 req-e6aa55b4-7cf9-43b1-af15-0d0a7c944754 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:51.543127 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c2f6b862-363e-407a-8d8c-fb9150068812 req-e6aa55b4-7cf9-43b1-af15-0d0a7c944754 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:51.563249 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-c2f6b862-363e-407a-8d8c-fb9150068812 req-e6aa55b4-7cf9-43b1-af15-0d0a7c944754 service nova] Creating event network-vif-plugged:4ce8dd93-d7bb-4619-9c47-482e9af09d28 for instance 425b6340-2984-4339-9728-2914b55bd418 on n-h1-master-1 Aug 07 01:30:51.571558 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-c2f6b862-363e-407a-8d8c-fb9150068812 req-e6aa55b4-7cf9-43b1-af15-0d0a7c944754 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055094 Aug 07 01:30:51.572537 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1902/4139] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:30:51.579372 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-d0fd4e6e-4780-43b1-8ee6-b3840695fd9d req-5bfbe2e3-7a0d-42b4-8817-3a4a10645c95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "283ecb61-1e24-4f11-938e-ff33e79c34cd", "tag": "3c0c60e2-4754-4ef5-ac53-b399e63f2365"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:51.591544 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d0fd4e6e-4780-43b1-8ee6-b3840695fd9d req-5bfbe2e3-7a0d-42b4-8817-3a4a10645c95 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:51.591993 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3c7ef202-868e-412e-a83e-f235737b5fe1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:51.593025 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d0fd4e6e-4780-43b1-8ee6-b3840695fd9d req-5bfbe2e3-7a0d-42b4-8817-3a4a10645c95 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:51.593672 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d0fd4e6e-4780-43b1-8ee6-b3840695fd9d req-5bfbe2e3-7a0d-42b4-8817-3a4a10645c95 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:51.603103 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3c7ef202-868e-412e-a83e-f235737b5fe1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.395379 Aug 07 01:30:51.609493 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-d0fd4e6e-4780-43b1-8ee6-b3840695fd9d req-5bfbe2e3-7a0d-42b4-8817-3a4a10645c95 service nova] Creating event network-changed:3c0c60e2-4754-4ef5-ac53-b399e63f2365 for instance 283ecb61-1e24-4f11-938e-ff33e79c34cd on n-h1-master-1 Aug 07 01:30:51.613404 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2238/4140] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:51 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:51.620225 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a8de96cd-21d9-4f76-b537-8202f4a547f3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:51.621073 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a8de96cd-21d9-4f76-b537-8202f4a547f3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:51.623000 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-d0fd4e6e-4780-43b1-8ee6-b3840695fd9d req-5bfbe2e3-7a0d-42b4-8817-3a4a10645c95 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048608 Aug 07 01:30:51.626775 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1903/4141] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:30:51.638531 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8de96cd-21d9-4f76-b537-8202f4a547f3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:51.639021 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8de96cd-21d9-4f76-b537-8202f4a547f3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:51.639460 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8de96cd-21d9-4f76-b537-8202f4a547f3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:51.640583 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8de96cd-21d9-4f76-b537-8202f4a547f3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:51.641042 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8de96cd-21d9-4f76-b537-8202f4a547f3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:51.641470 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8de96cd-21d9-4f76-b537-8202f4a547f3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:51.646444 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f79ceaf6-f16b-452b-8801-bb30853ffe3a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:51.657771 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f79ceaf6-f16b-452b-8801-bb30853ffe3a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: dbc593a0-5c59-4d1b-a538-157daf632f2e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:51.673128 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f79ceaf6-f16b-452b-8801-bb30853ffe3a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:51.679215 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f79ceaf6-f16b-452b-8801-bb30853ffe3a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:51.679844 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f79ceaf6-f16b-452b-8801-bb30853ffe3a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:51.680771 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f79ceaf6-f16b-452b-8801-bb30853ffe3a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:51.681482 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f79ceaf6-f16b-452b-8801-bb30853ffe3a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:51.682506 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f79ceaf6-f16b-452b-8801-bb30853ffe3a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:52.092468 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a8de96cd-21d9-4f76-b537-8202f4a547f3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:52.102463 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a8de96cd-21d9-4f76-b537-8202f4a547f3 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.487632 Aug 07 01:30:52.103046 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2239/4142] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:51 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:52.125224 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e4d7cce5-9981-4895-935d-379219f42411 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1183114602", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "38e7289f-8c36-40c7-bc8a-a94f77b67d92"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:52.189333 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-e4d7cce5-9981-4895-935d-379219f42411 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] validate_networks() for [('38e7289f-8c36-40c7-bc8a-a94f77b67d92', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:30:52.208944 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f79ceaf6-f16b-452b-8801-bb30853ffe3a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:52.217096 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:52.224591 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f79ceaf6-f16b-452b-8801-bb30853ffe3a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e" status: 200 len: 1495 microversion: 2.1 time: 0.582957 Aug 07 01:30:52.231774 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1904/4143] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:51 2022] GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e => generated 1495 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:30:52.242191 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a54579e4-84ca-4b26-8b5f-9c28d057f599 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:52.242983 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a54579e4-84ca-4b26-8b5f-9c28d057f599 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:52.252121 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a54579e4-84ca-4b26-8b5f-9c28d057f599 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:52.252852 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a54579e4-84ca-4b26-8b5f-9c28d057f599 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:52.253556 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a54579e4-84ca-4b26-8b5f-9c28d057f599 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:52.254442 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a54579e4-84ca-4b26-8b5f-9c28d057f599 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:52.255036 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a54579e4-84ca-4b26-8b5f-9c28d057f599 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:52.255613 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a54579e4-84ca-4b26-8b5f-9c28d057f599 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:52.292164 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-a54579e4-84ca-4b26-8b5f-9c28d057f599 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lazy-loading 'flavor' on Instance uuid d9b1883a-c95a-4c49-ad6d-335ecf03b015 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:30:52.804427 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a54579e4-84ca-4b26-8b5f-9c28d057f599 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015/action" status: 202 len: 0 microversion: 2.1 time: 0.570545 Aug 07 01:30:52.809285 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1905/4144] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:30:52 2022] POST /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015/action => generated 0 bytes in 576 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:30:52.815032 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3cb8243b-4f25-49b5-ac65-0e8f61d46b8c tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:52.816098 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3cb8243b-4f25-49b5-ac65-0e8f61d46b8c tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 283ecb61-1e24-4f11-938e-ff33e79c34cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:52.825868 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3cb8243b-4f25-49b5-ac65-0e8f61d46b8c tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:52.827010 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3cb8243b-4f25-49b5-ac65-0e8f61d46b8c tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:52.828370 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3cb8243b-4f25-49b5-ac65-0e8f61d46b8c tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:52.829829 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3cb8243b-4f25-49b5-ac65-0e8f61d46b8c tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:52.830896 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3cb8243b-4f25-49b5-ac65-0e8f61d46b8c tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:52.831579 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3cb8243b-4f25-49b5-ac65-0e8f61d46b8c tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:53.157233 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3cb8243b-4f25-49b5-ac65-0e8f61d46b8c tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:53.169623 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3cb8243b-4f25-49b5-ac65-0e8f61d46b8c tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd" status: 200 len: 1320 microversion: 2.1 time: 0.358878 Aug 07 01:30:53.182848 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1906/4145] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:52 2022] GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd => generated 1320 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:53.188575 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-237facd6-39e8-4c6a-b162-e191299fdfc2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:53.189262 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-237facd6-39e8-4c6a-b162-e191299fdfc2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:53.195955 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-237facd6-39e8-4c6a-b162-e191299fdfc2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:53.197125 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-237facd6-39e8-4c6a-b162-e191299fdfc2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:53.197125 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-237facd6-39e8-4c6a-b162-e191299fdfc2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:53.197620 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-237facd6-39e8-4c6a-b162-e191299fdfc2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:53.198082 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-237facd6-39e8-4c6a-b162-e191299fdfc2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:53.198514 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-237facd6-39e8-4c6a-b162-e191299fdfc2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:53.447243 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e4d7cce5-9981-4895-935d-379219f42411 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:30:53.447811 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e4d7cce5-9981-4895-935d-379219f42411 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:30:53.448248 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e4d7cce5-9981-4895-935d-379219f42411 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:30:53.448661 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e4d7cce5-9981-4895-935d-379219f42411 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:30:53.449623 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e4d7cce5-9981-4895-935d-379219f42411 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:30:53.473825 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4d7cce5-9981-4895-935d-379219f42411 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:53.476845 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4d7cce5-9981-4895-935d-379219f42411 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:53.477304 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4d7cce5-9981-4895-935d-379219f42411 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:53.478109 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4d7cce5-9981-4895-935d-379219f42411 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:53.479329 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4d7cce5-9981-4895-935d-379219f42411 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:53.479769 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4d7cce5-9981-4895-935d-379219f42411 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:53.507921 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-237facd6-39e8-4c6a-b162-e191299fdfc2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:53.524780 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-e4d7cce5-9981-4895-935d-379219f42411 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Getting quotas for project 939fea7fa6ea4deda8d4fbef70a4e510. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:30:53.533147 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-e4d7cce5-9981-4895-935d-379219f42411 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Getting quotas for user ef29bd35cca547c39d76c54058d32979 and project 939fea7fa6ea4deda8d4fbef70a4e510. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:30:53.540785 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-237facd6-39e8-4c6a-b162-e191299fdfc2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1514 microversion: 2.1 time: 0.348036 Aug 07 01:30:53.551278 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e4d7cce5-9981-4895-935d-379219f42411 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:30:53.554346 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e4d7cce5-9981-4895-935d-379219f42411 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:30:53.556158 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1907/4146] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:53 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1514 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:53.561017 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-c5e0ba12-4e5d-44a4-add0-ca38717c18d3 req-d677856b-134d-42e7-b145-4c66d2374c41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc593a0-5c59-4d1b-a538-157daf632f2e", "name": "network-vif-deleted", "tag": "cf795ae8-1c76-4ce2-921e-03697c19e1be"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:53.580683 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c5e0ba12-4e5d-44a4-add0-ca38717c18d3 req-d677856b-134d-42e7-b145-4c66d2374c41 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:53.581188 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c5e0ba12-4e5d-44a4-add0-ca38717c18d3 req-d677856b-134d-42e7-b145-4c66d2374c41 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:53.581634 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c5e0ba12-4e5d-44a4-add0-ca38717c18d3 req-d677856b-134d-42e7-b145-4c66d2374c41 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:53.607444 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-c5e0ba12-4e5d-44a4-add0-ca38717c18d3 req-d677856b-134d-42e7-b145-4c66d2374c41 service nova] Creating event network-vif-deleted:cf795ae8-1c76-4ce2-921e-03697c19e1be for instance dbc593a0-5c59-4d1b-a538-157daf632f2e on n-h1-master-1 Aug 07 01:30:53.613871 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-c5e0ba12-4e5d-44a4-add0-ca38717c18d3 req-d677856b-134d-42e7-b145-4c66d2374c41 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056397 Aug 07 01:30:53.619369 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1908/4147] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:30:53.626313 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-945d2aaf-b979-4e0a-90ba-04567eb96311 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:53.627262 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-945d2aaf-b979-4e0a-90ba-04567eb96311 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: dbc593a0-5c59-4d1b-a538-157daf632f2e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:53.636588 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-945d2aaf-b979-4e0a-90ba-04567eb96311 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:53.637524 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-945d2aaf-b979-4e0a-90ba-04567eb96311 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:53.639341 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-945d2aaf-b979-4e0a-90ba-04567eb96311 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:53.640799 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-945d2aaf-b979-4e0a-90ba-04567eb96311 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:53.641475 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-945d2aaf-b979-4e0a-90ba-04567eb96311 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:53.642064 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-945d2aaf-b979-4e0a-90ba-04567eb96311 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:53.649837 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e4d7cce5-9981-4895-935d-379219f42411 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.545083 Aug 07 01:30:53.656130 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2240/4148] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:30:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:30:53.676269 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-498c49e0-b483-4368-9950-9955a09b0bfc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:53.677302 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-498c49e0-b483-4368-9950-9955a09b0bfc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:53.782292 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-945d2aaf-b979-4e0a-90ba-04567eb96311 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:53.784044 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-498c49e0-b483-4368-9950-9955a09b0bfc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:53.791940 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-498c49e0-b483-4368-9950-9955a09b0bfc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 200 len: 1215 microversion: 2.1 time: 0.127723 Aug 07 01:30:53.793683 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2241/4149] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:53 2022] GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 1215 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:53.794952 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-945d2aaf-b979-4e0a-90ba-04567eb96311 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e" status: 200 len: 1453 microversion: 2.1 time: 0.173954 Aug 07 01:30:53.812174 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1909/4150] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:53 2022] GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e => generated 1453 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:54.191827 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-42308a37-3434-4253-be46-4a9df02c2c4e tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:54.193287 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-42308a37-3434-4253-be46-4a9df02c2c4e tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 283ecb61-1e24-4f11-938e-ff33e79c34cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:54.220617 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42308a37-3434-4253-be46-4a9df02c2c4e tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:54.221351 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42308a37-3434-4253-be46-4a9df02c2c4e tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:54.222056 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42308a37-3434-4253-be46-4a9df02c2c4e tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:54.223035 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42308a37-3434-4253-be46-4a9df02c2c4e tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:54.223805 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42308a37-3434-4253-be46-4a9df02c2c4e tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:54.225160 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42308a37-3434-4253-be46-4a9df02c2c4e tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:54.563797 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f4136910-b5e2-4bf5-b34d-072ba4a3dd5f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:54.564435 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f4136910-b5e2-4bf5-b34d-072ba4a3dd5f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:54.584026 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4136910-b5e2-4bf5-b34d-072ba4a3dd5f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:54.586228 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4136910-b5e2-4bf5-b34d-072ba4a3dd5f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:54.588519 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4136910-b5e2-4bf5-b34d-072ba4a3dd5f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:54.592560 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4136910-b5e2-4bf5-b34d-072ba4a3dd5f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:54.595641 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4136910-b5e2-4bf5-b34d-072ba4a3dd5f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:54.598455 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4136910-b5e2-4bf5-b34d-072ba4a3dd5f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:54.868419 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-42308a37-3434-4253-be46-4a9df02c2c4e tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:54.885638 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-42308a37-3434-4253-be46-4a9df02c2c4e tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd" status: 200 len: 1320 microversion: 2.1 time: 0.699275 Aug 07 01:30:54.900687 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2242/4151] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:54 2022] GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd => generated 1320 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:54.907007 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fe2a1060-f511-4798-9473-cd88a967c44e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:54.908180 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fe2a1060-f511-4798-9473-cd88a967c44e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:54.917503 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe2a1060-f511-4798-9473-cd88a967c44e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:54.918341 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe2a1060-f511-4798-9473-cd88a967c44e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:54.919033 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe2a1060-f511-4798-9473-cd88a967c44e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:54.920033 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe2a1060-f511-4798-9473-cd88a967c44e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:54.921591 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe2a1060-f511-4798-9473-cd88a967c44e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:54.922849 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe2a1060-f511-4798-9473-cd88a967c44e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:55.125046 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f4136910-b5e2-4bf5-b34d-072ba4a3dd5f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:55.140383 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f4136910-b5e2-4bf5-b34d-072ba4a3dd5f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1497 microversion: 2.1 time: 0.580893 Aug 07 01:30:55.145161 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1910/4152] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:54 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1497 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:55.155029 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b8d65502-dd0b-4a2b-9fb3-1776b50ac17f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:55.164009 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b8d65502-dd0b-4a2b-9fb3-1776b50ac17f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: dbc593a0-5c59-4d1b-a538-157daf632f2e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:55.185791 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b8d65502-dd0b-4a2b-9fb3-1776b50ac17f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:55.186299 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b8d65502-dd0b-4a2b-9fb3-1776b50ac17f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:55.186744 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b8d65502-dd0b-4a2b-9fb3-1776b50ac17f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:55.187486 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b8d65502-dd0b-4a2b-9fb3-1776b50ac17f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:55.196345 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b8d65502-dd0b-4a2b-9fb3-1776b50ac17f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:55.197728 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b8d65502-dd0b-4a2b-9fb3-1776b50ac17f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:55.246673 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-b8d65502-dd0b-4a2b-9fb3-1776b50ac17f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] HTTP exception thrown: Instance dbc593a0-5c59-4d1b-a538-157daf632f2e could not be found. Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b8d65502-dd0b-4a2b-9fb3-1776b50ac17f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Request method failure captured: Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e HTTP/1.1 Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xRoqM1ZK4H7GtvmxWX9ofAmOsKF2OdU6k1rehi-6yk86CpmfTNVcE0kwd9G1ahgJHyDlEB2bKz4XbnD5Ku_zcl240Q-kfWeKv3HfC_GyXmFAQWa4hNXP2nUgxgBXBe_oBb5a-t1xlRXFxfo9n87AmGbLBI9ZdV03LZwWshVd2n0WvE Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5506f7c95c1a46c5b3966597764b0111", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d1f0c01c340940388b440932d51988ff Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: exception: Instance dbc593a0-5c59-4d1b-a538-157daf632f2e could not be found. Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'dbc593a0-5c59-4d1b-a538-157daf632f2e'} Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbc593a0-5c59-4d1b-a538-157daf632f2e could not be found. Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbc593a0-5c59-4d1b-a538-157daf632f2e could not be found. Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:30:55.249249 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:55.252980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:30:55.252980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:30:55.252980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:30:55.252980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:30:55.252980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:30:55.252980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbc593a0-5c59-4d1b-a538-157daf632f2e could not be found. Aug 07 01:30:55.252980 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:55.260074 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b8d65502-dd0b-4a2b-9fb3-1776b50ac17f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Returning 404 to user: Instance dbc593a0-5c59-4d1b-a538-157daf632f2e could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:30:55.261348 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b8d65502-dd0b-4a2b-9fb3-1776b50ac17f tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e" status: 404 len: 111 microversion: 2.1 time: 0.113673 Aug 07 01:30:55.266102 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1911/4153] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:55 2022] GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:30:55.284882 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-afdfa1db-b16c-4e23-a817-7f2738cf6777 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:55.285690 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-afdfa1db-b16c-4e23-a817-7f2738cf6777 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:55.299523 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-afdfa1db-b16c-4e23-a817-7f2738cf6777 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:55.306388 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-afdfa1db-b16c-4e23-a817-7f2738cf6777 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:55.307436 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-afdfa1db-b16c-4e23-a817-7f2738cf6777 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:55.309511 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-afdfa1db-b16c-4e23-a817-7f2738cf6777 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:55.309674 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fe2a1060-f511-4798-9473-cd88a967c44e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:55.313802 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-afdfa1db-b16c-4e23-a817-7f2738cf6777 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:55.315509 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-afdfa1db-b16c-4e23-a817-7f2738cf6777 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:55.321510 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fe2a1060-f511-4798-9473-cd88a967c44e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 200 len: 1219 microversion: 2.1 time: 0.419447 Aug 07 01:30:55.330250 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2243/4154] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:54 2022] GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 1219 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:55.402030 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-afdfa1db-b16c-4e23-a817-7f2738cf6777 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lazy-loading 'flavor' on Instance uuid d9b1883a-c95a-4c49-ad6d-335ecf03b015 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:30:55.457913 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-afdfa1db-b16c-4e23-a817-7f2738cf6777 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] HTTP exception thrown: Cannot 'suspend' instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 while it is in vm_state suspended Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-afdfa1db-b16c-4e23-a817-7f2738cf6777 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015/action HTTP/1.1 Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 15 Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: {"suspend": {}} Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: exception: Cannot 'suspend' instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 while it is in vm_state suspended Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'd9b1883a-c95a-4c49-ad6d-335ecf03b015', 'body': {'suspend': {}}} Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 in vm_state suspended. Cannot suspend while the instance is in this state. Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 07 01:30:55.463776 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 07 01:30:55.467346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 07 01:30:55.467346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 07 01:30:55.467346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 while it is in vm_state suspended Aug 07 01:30:55.467346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:55.467346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:30:55.467346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:55.467346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:30:55.467346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:30:55.467346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:30:55.467346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:30:55.467346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:30:55.467346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 while it is in vm_state suspended Aug 07 01:30:55.467346 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:30:55.470694 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-afdfa1db-b16c-4e23-a817-7f2738cf6777 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 409 to user: Cannot 'suspend' instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 while it is in vm_state suspended {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:30:55.473453 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-afdfa1db-b16c-4e23-a817-7f2738cf6777 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015/action" status: 409 len: 148 microversion: 2.1 time: 0.205063 Aug 07 01:30:55.477182 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1912/4155] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:30:55 2022] POST /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015/action => generated 148 bytes in 210 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:30:55.483843 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-aea1201d-49cc-416b-8334-999761202416 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:55.484434 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-aea1201d-49cc-416b-8334-999761202416 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:55.492606 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aea1201d-49cc-416b-8334-999761202416 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:55.493370 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aea1201d-49cc-416b-8334-999761202416 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:55.494694 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aea1201d-49cc-416b-8334-999761202416 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:55.495604 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aea1201d-49cc-416b-8334-999761202416 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:55.496364 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aea1201d-49cc-416b-8334-999761202416 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:55.497039 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aea1201d-49cc-416b-8334-999761202416 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:55.520857 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f12a1689-1d82-4f08-ae76-4a2fbf929d98 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-630964927", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "554905b9-fa00-4877-bc90-609c81108292"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:30:55.626171 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-f12a1689-1d82-4f08-ae76-4a2fbf929d98 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] validate_networks() for [('554905b9-fa00-4877-bc90-609c81108292', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:30:55.697692 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-aea1201d-49cc-416b-8334-999761202416 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015/action" status: 202 len: 0 microversion: 2.1 time: 0.217724 Aug 07 01:30:55.699061 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2244/4156] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:30:55 2022] POST /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:30:55.720512 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-91b04c06-66f9-48b0-9806-205072df6990 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:55.735701 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-91b04c06-66f9-48b0-9806-205072df6990 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:55.756169 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91b04c06-66f9-48b0-9806-205072df6990 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:55.758960 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91b04c06-66f9-48b0-9806-205072df6990 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:55.761685 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91b04c06-66f9-48b0-9806-205072df6990 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:55.776251 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91b04c06-66f9-48b0-9806-205072df6990 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:55.777004 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91b04c06-66f9-48b0-9806-205072df6990 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:55.777466 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91b04c06-66f9-48b0-9806-205072df6990 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:56.303620 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-91b04c06-66f9-48b0-9806-205072df6990 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:56.313925 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-91b04c06-66f9-48b0-9806-205072df6990 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1503 microversion: 2.1 time: 0.603174 Aug 07 01:30:56.314852 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2245/4157] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:55 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1503 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:56.329255 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e55baab8-279a-4548-9adb-69c562945075 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:56.331562 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e55baab8-279a-4548-9adb-69c562945075 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 283ecb61-1e24-4f11-938e-ff33e79c34cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:56.346924 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e55baab8-279a-4548-9adb-69c562945075 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:56.349723 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e55baab8-279a-4548-9adb-69c562945075 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:56.350397 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e55baab8-279a-4548-9adb-69c562945075 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:56.351355 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e55baab8-279a-4548-9adb-69c562945075 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:56.352302 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e55baab8-279a-4548-9adb-69c562945075 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:56.353489 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e55baab8-279a-4548-9adb-69c562945075 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:56.786859 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e55baab8-279a-4548-9adb-69c562945075 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:56.807670 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e55baab8-279a-4548-9adb-69c562945075 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd" status: 200 len: 1320 microversion: 2.1 time: 0.491509 Aug 07 01:30:56.808655 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2246/4158] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:56 2022] GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd => generated 1320 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:56.814643 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7dced5e9-b58f-4720-9816-3db3086e86c1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:56.815332 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7dced5e9-b58f-4720-9816-3db3086e86c1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:56.828636 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7dced5e9-b58f-4720-9816-3db3086e86c1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:56.829143 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7dced5e9-b58f-4720-9816-3db3086e86c1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:56.829628 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7dced5e9-b58f-4720-9816-3db3086e86c1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:56.830366 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7dced5e9-b58f-4720-9816-3db3086e86c1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:56.830848 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7dced5e9-b58f-4720-9816-3db3086e86c1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:56.831294 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7dced5e9-b58f-4720-9816-3db3086e86c1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:56.858561 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:56.948531 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7dced5e9-b58f-4720-9816-3db3086e86c1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:56.960199 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7dced5e9-b58f-4720-9816-3db3086e86c1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 200 len: 1273 microversion: 2.1 time: 0.150168 Aug 07 01:30:56.961082 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2247/4159] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:56 2022] GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 1273 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:57.340592 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9b3cdf98-28f2-41ee-b0bd-cc4c65fa017d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:57.341351 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9b3cdf98-28f2-41ee-b0bd-cc4c65fa017d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:57.356498 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b3cdf98-28f2-41ee-b0bd-cc4c65fa017d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:57.357373 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b3cdf98-28f2-41ee-b0bd-cc4c65fa017d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:57.358020 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b3cdf98-28f2-41ee-b0bd-cc4c65fa017d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:57.359775 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b3cdf98-28f2-41ee-b0bd-cc4c65fa017d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:57.360525 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b3cdf98-28f2-41ee-b0bd-cc4c65fa017d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:57.361184 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b3cdf98-28f2-41ee-b0bd-cc4c65fa017d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:57.869236 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9b3cdf98-28f2-41ee-b0bd-cc4c65fa017d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:57.888451 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9b3cdf98-28f2-41ee-b0bd-cc4c65fa017d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1503 microversion: 2.1 time: 0.553120 Aug 07 01:30:57.890205 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2248/4160] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:57 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1503 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:57.896189 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4e5b7d61-b32f-4e42-8916-8bba90391ae9 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:57.897298 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4e5b7d61-b32f-4e42-8916-8bba90391ae9 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 283ecb61-1e24-4f11-938e-ff33e79c34cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:57.903952 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:57.907598 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4e5b7d61-b32f-4e42-8916-8bba90391ae9 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:57.909604 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4e5b7d61-b32f-4e42-8916-8bba90391ae9 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:57.910424 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4e5b7d61-b32f-4e42-8916-8bba90391ae9 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:57.912889 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4e5b7d61-b32f-4e42-8916-8bba90391ae9 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:57.913598 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4e5b7d61-b32f-4e42-8916-8bba90391ae9 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:57.914258 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4e5b7d61-b32f-4e42-8916-8bba90391ae9 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:58.202863 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4e5b7d61-b32f-4e42-8916-8bba90391ae9 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:58.212617 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4e5b7d61-b32f-4e42-8916-8bba90391ae9 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd" status: 200 len: 1320 microversion: 2.1 time: 0.320869 Aug 07 01:30:58.223671 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2249/4161] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:57 2022] GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd => generated 1320 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:58.240144 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fb50f8ce-0ebd-4ed7-87b3-b9c5cc524673 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:58.245274 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fb50f8ce-0ebd-4ed7-87b3-b9c5cc524673 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:58.256932 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fb50f8ce-0ebd-4ed7-87b3-b9c5cc524673 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:58.257809 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fb50f8ce-0ebd-4ed7-87b3-b9c5cc524673 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:58.258270 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fb50f8ce-0ebd-4ed7-87b3-b9c5cc524673 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:58.259114 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fb50f8ce-0ebd-4ed7-87b3-b9c5cc524673 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:58.259473 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fb50f8ce-0ebd-4ed7-87b3-b9c5cc524673 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:58.259951 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fb50f8ce-0ebd-4ed7-87b3-b9c5cc524673 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:58.350530 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fb50f8ce-0ebd-4ed7-87b3-b9c5cc524673 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:58.372905 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fb50f8ce-0ebd-4ed7-87b3-b9c5cc524673 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 200 len: 1273 microversion: 2.1 time: 0.152871 Aug 07 01:30:58.374194 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2250/4162] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:58 2022] GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 1273 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:58.386940 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-f12a1689-1d82-4f08-ae76-4a2fbf929d98 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:30:58.387474 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-f12a1689-1d82-4f08-ae76-4a2fbf929d98 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:30:58.388067 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-f12a1689-1d82-4f08-ae76-4a2fbf929d98 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:30:58.388609 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-f12a1689-1d82-4f08-ae76-4a2fbf929d98 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:30:58.389126 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-f12a1689-1d82-4f08-ae76-4a2fbf929d98 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:30:58.405249 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f12a1689-1d82-4f08-ae76-4a2fbf929d98 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:58.405802 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f12a1689-1d82-4f08-ae76-4a2fbf929d98 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:58.406305 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f12a1689-1d82-4f08-ae76-4a2fbf929d98 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:58.407056 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f12a1689-1d82-4f08-ae76-4a2fbf929d98 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:58.407568 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f12a1689-1d82-4f08-ae76-4a2fbf929d98 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:58.408118 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f12a1689-1d82-4f08-ae76-4a2fbf929d98 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:58.441574 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-f12a1689-1d82-4f08-ae76-4a2fbf929d98 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Getting quotas for project 5506f7c95c1a46c5b3966597764b0111. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:30:58.448344 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-f12a1689-1d82-4f08-ae76-4a2fbf929d98 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Getting quotas for user d1f0c01c340940388b440932d51988ff and project 5506f7c95c1a46c5b3966597764b0111. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:30:58.467708 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f12a1689-1d82-4f08-ae76-4a2fbf929d98 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:30:58.471324 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f12a1689-1d82-4f08-ae76-4a2fbf929d98 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: f6b31167-8c76-4749-88b4-d8380d9b9a84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:30:58.558678 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f12a1689-1d82-4f08-ae76-4a2fbf929d98 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.049702 Aug 07 01:30:58.566743 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1913/4163] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:30:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:30:58.571920 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5d5aacfe-e41f-47c6-9990-01aedab8837d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:58.572881 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5d5aacfe-e41f-47c6-9990-01aedab8837d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: f6b31167-8c76-4749-88b4-d8380d9b9a84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:58.664964 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5d5aacfe-e41f-47c6-9990-01aedab8837d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:58.672460 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5d5aacfe-e41f-47c6-9990-01aedab8837d tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84" status: 200 len: 1214 microversion: 2.1 time: 0.105409 Aug 07 01:30:58.681196 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2251/4164] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:58 2022] GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84 => generated 1214 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:30:58.912123 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-57f4b30c-8def-415f-8dc4-9ecc4555dc96 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:58.912768 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-57f4b30c-8def-415f-8dc4-9ecc4555dc96 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:58.923513 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-57f4b30c-8def-415f-8dc4-9ecc4555dc96 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:58.924041 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-57f4b30c-8def-415f-8dc4-9ecc4555dc96 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:58.926497 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-57f4b30c-8def-415f-8dc4-9ecc4555dc96 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:58.927974 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-57f4b30c-8def-415f-8dc4-9ecc4555dc96 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:58.928466 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-57f4b30c-8def-415f-8dc4-9ecc4555dc96 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:58.937308 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-57f4b30c-8def-415f-8dc4-9ecc4555dc96 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:59.238897 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2c0a99bd-ff4f-4a68-a3b1-5d21df086316 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:59.240438 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2c0a99bd-ff4f-4a68-a3b1-5d21df086316 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 283ecb61-1e24-4f11-938e-ff33e79c34cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:59.252567 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c0a99bd-ff4f-4a68-a3b1-5d21df086316 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:59.253038 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c0a99bd-ff4f-4a68-a3b1-5d21df086316 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:59.253492 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c0a99bd-ff4f-4a68-a3b1-5d21df086316 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:59.254229 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c0a99bd-ff4f-4a68-a3b1-5d21df086316 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:59.254694 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c0a99bd-ff4f-4a68-a3b1-5d21df086316 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:59.255129 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c0a99bd-ff4f-4a68-a3b1-5d21df086316 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:59.387377 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-57f4b30c-8def-415f-8dc4-9ecc4555dc96 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:59.417779 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-57f4b30c-8def-415f-8dc4-9ecc4555dc96 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1503 microversion: 2.1 time: 0.510627 Aug 07 01:30:59.420398 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1914/4165] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:58 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1503 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:59.426469 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-98926766-6eee-46f1-9fda-d3c1c5c19ec8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:59.427274 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-98926766-6eee-46f1-9fda-d3c1c5c19ec8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:59.437438 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-98926766-6eee-46f1-9fda-d3c1c5c19ec8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:59.439065 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-98926766-6eee-46f1-9fda-d3c1c5c19ec8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:59.439722 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-98926766-6eee-46f1-9fda-d3c1c5c19ec8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:59.447572 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-98926766-6eee-46f1-9fda-d3c1c5c19ec8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:59.448976 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-98926766-6eee-46f1-9fda-d3c1c5c19ec8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:59.450096 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-98926766-6eee-46f1-9fda-d3c1c5c19ec8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:59.676336 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2c0a99bd-ff4f-4a68-a3b1-5d21df086316 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:59.713633 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2c0a99bd-ff4f-4a68-a3b1-5d21df086316 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd" status: 200 len: 1320 microversion: 2.1 time: 0.477211 Aug 07 01:30:59.721304 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2252/4166] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:59 2022] GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd => generated 1320 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:30:59.742055 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6bddf678-4da5-45c8-9b63-4e1bebe24a8c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:30:59.747776 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6bddf678-4da5-45c8-9b63-4e1bebe24a8c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: f6b31167-8c76-4749-88b4-d8380d9b9a84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:30:59.768222 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6bddf678-4da5-45c8-9b63-4e1bebe24a8c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:59.770209 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6bddf678-4da5-45c8-9b63-4e1bebe24a8c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:59.773047 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6bddf678-4da5-45c8-9b63-4e1bebe24a8c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:59.774217 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6bddf678-4da5-45c8-9b63-4e1bebe24a8c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:30:59.777835 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6bddf678-4da5-45c8-9b63-4e1bebe24a8c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:30:59.778544 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6bddf678-4da5-45c8-9b63-4e1bebe24a8c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:30:59.907489 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-98926766-6eee-46f1-9fda-d3c1c5c19ec8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:30:59.940872 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-98926766-6eee-46f1-9fda-d3c1c5c19ec8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 200 len: 1315 microversion: 2.1 time: 0.516852 Aug 07 01:30:59.947397 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1915/4167] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:59 2022] GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 1315 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:00.020659 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6bddf678-4da5-45c8-9b63-4e1bebe24a8c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:00.034348 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6bddf678-4da5-45c8-9b63-4e1bebe24a8c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84" status: 200 len: 1210 microversion: 2.1 time: 0.311140 Aug 07 01:31:00.035345 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2253/4168] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:30:59 2022] GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84 => generated 1210 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:00.189707 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-f2877825-ca37-4745-9539-2da9b8657891 req-f8ca89f9-fd99-42fc-8c7c-775bc1fb21cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "283ecb61-1e24-4f11-938e-ff33e79c34cd", "name": "network-vif-plugged", "status": "completed", "tag": "3c0c60e2-4754-4ef5-ac53-b399e63f2365"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:00.215751 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f2877825-ca37-4745-9539-2da9b8657891 req-f8ca89f9-fd99-42fc-8c7c-775bc1fb21cb service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:00.216598 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f2877825-ca37-4745-9539-2da9b8657891 req-f8ca89f9-fd99-42fc-8c7c-775bc1fb21cb service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:00.221030 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f2877825-ca37-4745-9539-2da9b8657891 req-f8ca89f9-fd99-42fc-8c7c-775bc1fb21cb service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:00.240355 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-f2877825-ca37-4745-9539-2da9b8657891 req-f8ca89f9-fd99-42fc-8c7c-775bc1fb21cb service nova] Creating event network-vif-plugged:3c0c60e2-4754-4ef5-ac53-b399e63f2365 for instance 283ecb61-1e24-4f11-938e-ff33e79c34cd on n-h1-master-1 Aug 07 01:31:00.250607 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-f2877825-ca37-4745-9539-2da9b8657891 req-f8ca89f9-fd99-42fc-8c7c-775bc1fb21cb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066442 Aug 07 01:31:00.252343 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1916/4169] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:00.443920 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2071382f-1548-4247-b321-54578f404f0b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:00.444928 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2071382f-1548-4247-b321-54578f404f0b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:00.462025 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2071382f-1548-4247-b321-54578f404f0b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:00.462549 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2071382f-1548-4247-b321-54578f404f0b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:00.463002 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2071382f-1548-4247-b321-54578f404f0b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:00.467537 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2071382f-1548-4247-b321-54578f404f0b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:00.469202 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2071382f-1548-4247-b321-54578f404f0b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:00.471894 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2071382f-1548-4247-b321-54578f404f0b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:00.747398 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6337c209-5337-4b44-a7a8-72bad272febe tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:00.748301 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6337c209-5337-4b44-a7a8-72bad272febe tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 283ecb61-1e24-4f11-938e-ff33e79c34cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:00.768722 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6337c209-5337-4b44-a7a8-72bad272febe tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:00.769384 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6337c209-5337-4b44-a7a8-72bad272febe tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:00.770209 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6337c209-5337-4b44-a7a8-72bad272febe tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:00.773569 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6337c209-5337-4b44-a7a8-72bad272febe tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:00.776653 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6337c209-5337-4b44-a7a8-72bad272febe tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:00.777299 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6337c209-5337-4b44-a7a8-72bad272febe tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:01.085740 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2071382f-1548-4247-b321-54578f404f0b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:01.104166 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2071382f-1548-4247-b321-54578f404f0b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.666287 Aug 07 01:31:01.104784 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2254/4170] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:00 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:01.127542 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d3dac23e-aa73-415f-8a6a-5137ed10b804 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:01.128564 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d3dac23e-aa73-415f-8a6a-5137ed10b804 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:01.137306 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3dac23e-aa73-415f-8a6a-5137ed10b804 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:01.137805 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3dac23e-aa73-415f-8a6a-5137ed10b804 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:01.139019 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3dac23e-aa73-415f-8a6a-5137ed10b804 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:01.139774 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3dac23e-aa73-415f-8a6a-5137ed10b804 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:01.140340 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3dac23e-aa73-415f-8a6a-5137ed10b804 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:01.140773 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3dac23e-aa73-415f-8a6a-5137ed10b804 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:01.384029 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d3dac23e-aa73-415f-8a6a-5137ed10b804 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:01.398267 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d3dac23e-aa73-415f-8a6a-5137ed10b804 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 200 len: 1315 microversion: 2.1 time: 0.282579 Aug 07 01:31:01.399540 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2255/4171] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:01 2022] GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:01.407464 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d6757360-848c-433f-bcd5-591362033179 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:01.408333 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d6757360-848c-433f-bcd5-591362033179 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: f6b31167-8c76-4749-88b4-d8380d9b9a84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:01.420343 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6757360-848c-433f-bcd5-591362033179 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:01.421208 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6757360-848c-433f-bcd5-591362033179 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:01.422353 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6757360-848c-433f-bcd5-591362033179 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:01.423931 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6757360-848c-433f-bcd5-591362033179 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:01.425935 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6757360-848c-433f-bcd5-591362033179 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:01.427198 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6757360-848c-433f-bcd5-591362033179 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:01.569794 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d6757360-848c-433f-bcd5-591362033179 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:01.581831 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d6757360-848c-433f-bcd5-591362033179 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84" status: 200 len: 1272 microversion: 2.1 time: 0.180013 Aug 07 01:31:01.585177 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2256/4172] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:01 2022] GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84 => generated 1272 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:01.594083 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-27f613dc-7d78-47c0-9f23-b1fac7be3237 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:01.595211 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-27f613dc-7d78-47c0-9f23-b1fac7be3237 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:01.620437 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27f613dc-7d78-47c0-9f23-b1fac7be3237 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:01.622131 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27f613dc-7d78-47c0-9f23-b1fac7be3237 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:01.624754 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27f613dc-7d78-47c0-9f23-b1fac7be3237 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:01.625742 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27f613dc-7d78-47c0-9f23-b1fac7be3237 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:01.627497 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27f613dc-7d78-47c0-9f23-b1fac7be3237 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:01.630735 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27f613dc-7d78-47c0-9f23-b1fac7be3237 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:01.635363 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6337c209-5337-4b44-a7a8-72bad272febe tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:01.644597 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6337c209-5337-4b44-a7a8-72bad272febe tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd" status: 200 len: 1320 microversion: 2.1 time: 0.901942 Aug 07 01:31:01.645462 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1917/4173] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:00 2022] GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd => generated 1320 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:02.096718 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-27f613dc-7d78-47c0-9f23-b1fac7be3237 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:02.105378 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-27f613dc-7d78-47c0-9f23-b1fac7be3237 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.518085 Aug 07 01:31:02.109077 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2257/4174] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:01 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:02.128463 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1776dad2-d468-4a63-830f-cd7935968490 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:02.129662 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1776dad2-d468-4a63-830f-cd7935968490 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 306ce219-d573-41a3-8d42-e7102d473d1a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:02.152192 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-1776dad2-d468-4a63-830f-cd7935968490 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] HTTP exception thrown: Instance 306ce219-d573-41a3-8d42-e7102d473d1a could not be found. Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1776dad2-d468-4a63-830f-cd7935968490 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/servers/306ce219-d573-41a3-8d42-e7102d473d1a/action HTTP/1.1 Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 15 Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: {"unpause": {}} Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 306ce219-d573-41a3-8d42-e7102d473d1a could not be found. Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '306ce219-d573-41a3-8d42-e7102d473d1a', 'body': {'unpause': {}}} Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 306ce219-d573-41a3-8d42-e7102d473d1a could not be found. Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 306ce219-d573-41a3-8d42-e7102d473d1a could not be found. Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:02.166087 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:02.170462 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:31:02.170462 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:31:02.170462 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 306ce219-d573-41a3-8d42-e7102d473d1a could not be found. Aug 07 01:31:02.170462 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:02.171651 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1776dad2-d468-4a63-830f-cd7935968490 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 404 to user: Instance 306ce219-d573-41a3-8d42-e7102d473d1a could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:31:02.172792 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1776dad2-d468-4a63-830f-cd7935968490 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers/306ce219-d573-41a3-8d42-e7102d473d1a/action" status: 404 len: 111 microversion: 2.1 time: 0.049967 Aug 07 01:31:02.173553 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1918/4175] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:31:02 2022] POST /compute/v2.1/servers/306ce219-d573-41a3-8d42-e7102d473d1a/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:31:02.182819 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7293a8ec-4baf-4efa-871b-aed5d7d94e6a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:02.183618 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7293a8ec-4baf-4efa-871b-aed5d7d94e6a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:02.195779 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7293a8ec-4baf-4efa-871b-aed5d7d94e6a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:02.196596 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7293a8ec-4baf-4efa-871b-aed5d7d94e6a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:02.197658 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7293a8ec-4baf-4efa-871b-aed5d7d94e6a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:02.199035 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7293a8ec-4baf-4efa-871b-aed5d7d94e6a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:02.201979 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7293a8ec-4baf-4efa-871b-aed5d7d94e6a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:02.202634 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7293a8ec-4baf-4efa-871b-aed5d7d94e6a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:02.320972 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-3a9bf09b-13a5-44df-946c-bf35cb6e1d4b req-eb5fcb86-0c1b-4aa9-81d1-5e7ed1f43e72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd399490-133f-43a2-b0b7-ed5448e52dab", "name": "network-vif-plugged", "status": "completed", "tag": "9c6b6772-80fb-4b2a-8f4c-bbf5f1af23ef"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:02.344049 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3a9bf09b-13a5-44df-946c-bf35cb6e1d4b req-eb5fcb86-0c1b-4aa9-81d1-5e7ed1f43e72 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:02.344815 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3a9bf09b-13a5-44df-946c-bf35cb6e1d4b req-eb5fcb86-0c1b-4aa9-81d1-5e7ed1f43e72 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:02.345413 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3a9bf09b-13a5-44df-946c-bf35cb6e1d4b req-eb5fcb86-0c1b-4aa9-81d1-5e7ed1f43e72 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:02.362070 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-3a9bf09b-13a5-44df-946c-bf35cb6e1d4b req-eb5fcb86-0c1b-4aa9-81d1-5e7ed1f43e72 service nova] Creating event network-vif-plugged:9c6b6772-80fb-4b2a-8f4c-bbf5f1af23ef for instance cd399490-133f-43a2-b0b7-ed5448e52dab on n-h2-master-1 Aug 07 01:31:02.377493 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-3a9bf09b-13a5-44df-946c-bf35cb6e1d4b req-eb5fcb86-0c1b-4aa9-81d1-5e7ed1f43e72 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060112 Aug 07 01:31:02.382231 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1919/4176] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:31:02.424072 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-aa8ad610-3045-4e1c-b61a-5f0668c033c0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:02.425050 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-aa8ad610-3045-4e1c-b61a-5f0668c033c0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:02.435918 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa8ad610-3045-4e1c-b61a-5f0668c033c0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:02.439126 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa8ad610-3045-4e1c-b61a-5f0668c033c0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:02.442763 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa8ad610-3045-4e1c-b61a-5f0668c033c0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:02.443789 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa8ad610-3045-4e1c-b61a-5f0668c033c0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:02.444449 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa8ad610-3045-4e1c-b61a-5f0668c033c0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:02.452812 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa8ad610-3045-4e1c-b61a-5f0668c033c0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:02.484994 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7293a8ec-4baf-4efa-871b-aed5d7d94e6a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:02.496993 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7293a8ec-4baf-4efa-871b-aed5d7d94e6a tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.318194 Aug 07 01:31:02.502295 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2258/4177] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:02 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:02.528004 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1190630b-4dd0-4925-a706-09764e4c8e6f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:02.529508 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1190630b-4dd0-4925-a706-09764e4c8e6f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:02.553665 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1190630b-4dd0-4925-a706-09764e4c8e6f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:02.555269 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1190630b-4dd0-4925-a706-09764e4c8e6f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:02.555723 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1190630b-4dd0-4925-a706-09764e4c8e6f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:02.558315 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1190630b-4dd0-4925-a706-09764e4c8e6f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:02.560738 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1190630b-4dd0-4925-a706-09764e4c8e6f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:02.562239 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1190630b-4dd0-4925-a706-09764e4c8e6f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:02.934343 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1190630b-4dd0-4925-a706-09764e4c8e6f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:02.944759 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1190630b-4dd0-4925-a706-09764e4c8e6f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.420559 Aug 07 01:31:02.948871 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2259/4178] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:02 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:02.959993 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-20407731-22e4-41a5-9822-6e06f20f1526 req-daf5f4e3-5c9c-43e1-87b8-fc7abf57d06b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a00f6b81-d0b5-434f-a861-53cbcf107219", "tag": "d195799a-8bcf-49dd-ada2-d86a279b6b61"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:02.979486 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-20407731-22e4-41a5-9822-6e06f20f1526 req-daf5f4e3-5c9c-43e1-87b8-fc7abf57d06b service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:02.985783 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-20407731-22e4-41a5-9822-6e06f20f1526 req-daf5f4e3-5c9c-43e1-87b8-fc7abf57d06b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:02.990143 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-20407731-22e4-41a5-9822-6e06f20f1526 req-daf5f4e3-5c9c-43e1-87b8-fc7abf57d06b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:03.017994 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-20407731-22e4-41a5-9822-6e06f20f1526 req-daf5f4e3-5c9c-43e1-87b8-fc7abf57d06b service nova] Creating event network-changed:d195799a-8bcf-49dd-ada2-d86a279b6b61 for instance a00f6b81-d0b5-434f-a861-53cbcf107219 on n-h1-master-1 Aug 07 01:31:03.042005 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-20407731-22e4-41a5-9822-6e06f20f1526 req-daf5f4e3-5c9c-43e1-87b8-fc7abf57d06b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080521 Aug 07 01:31:03.043396 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2260/4179] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:03.049379 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e820c336-9e4e-4c72-8445-b526e729844e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:03.050823 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e820c336-9e4e-4c72-8445-b526e729844e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: f6b31167-8c76-4749-88b4-d8380d9b9a84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:03.071109 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e820c336-9e4e-4c72-8445-b526e729844e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:03.072159 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e820c336-9e4e-4c72-8445-b526e729844e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:03.072836 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e820c336-9e4e-4c72-8445-b526e729844e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:03.073832 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e820c336-9e4e-4c72-8445-b526e729844e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:03.074518 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e820c336-9e4e-4c72-8445-b526e729844e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:03.075190 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e820c336-9e4e-4c72-8445-b526e729844e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:03.075436 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-aa8ad610-3045-4e1c-b61a-5f0668c033c0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:03.118215 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-aa8ad610-3045-4e1c-b61a-5f0668c033c0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 200 len: 1315 microversion: 2.1 time: 0.697787 Aug 07 01:31:03.118844 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1920/4180] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:02 2022] GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 1315 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:03.136699 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e6b5690b-5757-4b00-95b9-69e6556a2c13 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:03.146857 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e6b5690b-5757-4b00-95b9-69e6556a2c13 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 283ecb61-1e24-4f11-938e-ff33e79c34cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:03.158456 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e6b5690b-5757-4b00-95b9-69e6556a2c13 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:03.159007 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e6b5690b-5757-4b00-95b9-69e6556a2c13 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:03.160161 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e6b5690b-5757-4b00-95b9-69e6556a2c13 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:03.163641 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e6b5690b-5757-4b00-95b9-69e6556a2c13 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:03.164470 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e6b5690b-5757-4b00-95b9-69e6556a2c13 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:03.167023 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e6b5690b-5757-4b00-95b9-69e6556a2c13 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:03.497074 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:03.519359 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e820c336-9e4e-4c72-8445-b526e729844e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:03.535043 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e820c336-9e4e-4c72-8445-b526e729844e tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84" status: 200 len: 1272 microversion: 2.1 time: 0.489934 Aug 07 01:31:03.538308 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2261/4181] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:03 2022] GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84 => generated 1272 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:03.544076 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-df18085f-3052-46ee-83c3-84f5d8df5ebb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:03.545549 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-df18085f-3052-46ee-83c3-84f5d8df5ebb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:03.553230 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df18085f-3052-46ee-83c3-84f5d8df5ebb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:03.554122 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df18085f-3052-46ee-83c3-84f5d8df5ebb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:03.554797 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df18085f-3052-46ee-83c3-84f5d8df5ebb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:03.555793 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df18085f-3052-46ee-83c3-84f5d8df5ebb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:03.556604 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df18085f-3052-46ee-83c3-84f5d8df5ebb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:03.557262 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df18085f-3052-46ee-83c3-84f5d8df5ebb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:03.613915 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-df18085f-3052-46ee-83c3-84f5d8df5ebb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] HTTP exception thrown: Cannot 'unpause' instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 while it is in vm_state active Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-df18085f-3052-46ee-83c3-84f5d8df5ebb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015/action HTTP/1.1 Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 15 Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: {"unpause": {}} Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: exception: Cannot 'unpause' instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 while it is in vm_state active Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'd9b1883a-c95a-4c49-ad6d-335ecf03b015', 'body': {'unpause': {}}} Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 in vm_state active. Cannot unpause while the instance is in this state. Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 while it is in vm_state active Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:03.617581 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:03.622219 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:03.622219 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:31:03.622219 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:31:03.622219 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 while it is in vm_state active Aug 07 01:31:03.622219 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:03.622219 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-df18085f-3052-46ee-83c3-84f5d8df5ebb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 409 to user: Cannot 'unpause' instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 while it is in vm_state active {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:31:03.622219 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-df18085f-3052-46ee-83c3-84f5d8df5ebb tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015/action" status: 409 len: 145 microversion: 2.1 time: 0.081260 Aug 07 01:31:03.626356 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2262/4182] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:31:03 2022] POST /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015/action => generated 145 bytes in 87 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:31:03.644328 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7b0b8780-4b0a-4ffc-b5d9-248258afc0dd tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:03.653363 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e6b5690b-5757-4b00-95b9-69e6556a2c13 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:03.656284 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7b0b8780-4b0a-4ffc-b5d9-248258afc0dd tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:03.665595 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b0b8780-4b0a-4ffc-b5d9-248258afc0dd tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:03.666228 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b0b8780-4b0a-4ffc-b5d9-248258afc0dd tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:03.666678 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b0b8780-4b0a-4ffc-b5d9-248258afc0dd tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:03.667410 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b0b8780-4b0a-4ffc-b5d9-248258afc0dd tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:03.667866 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b0b8780-4b0a-4ffc-b5d9-248258afc0dd tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:03.668329 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b0b8780-4b0a-4ffc-b5d9-248258afc0dd tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:03.671763 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e6b5690b-5757-4b00-95b9-69e6556a2c13 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd" status: 200 len: 1511 microversion: 2.1 time: 0.551794 Aug 07 01:31:03.675001 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1921/4183] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:03 2022] GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd => generated 1511 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:03.704937 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a955310e-49bc-48cf-930e-1c6bf37d8372 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:03.704937 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a955310e-49bc-48cf-930e-1c6bf37d8372 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 425b6340-2984-4339-9728-2914b55bd418] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:03.720736 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a955310e-49bc-48cf-930e-1c6bf37d8372 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:03.721241 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a955310e-49bc-48cf-930e-1c6bf37d8372 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:03.721689 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a955310e-49bc-48cf-930e-1c6bf37d8372 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:03.722422 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a955310e-49bc-48cf-930e-1c6bf37d8372 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:03.722887 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a955310e-49bc-48cf-930e-1c6bf37d8372 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:03.723316 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a955310e-49bc-48cf-930e-1c6bf37d8372 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:04.049705 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a955310e-49bc-48cf-930e-1c6bf37d8372 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:04.060327 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a955310e-49bc-48cf-930e-1c6bf37d8372 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418" status: 200 len: 1513 microversion: 2.1 time: 0.369298 Aug 07 01:31:04.065402 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1922/4184] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:03 2022] GET /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418 => generated 1513 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:04.086221 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a48e2de4-37d2-40ea-b1b9-0ccd49a4d745 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:04.086854 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a48e2de4-37d2-40ea-b1b9-0ccd49a4d745 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: cd399490-133f-43a2-b0b7-ed5448e52dab] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:04.093813 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a48e2de4-37d2-40ea-b1b9-0ccd49a4d745 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:04.094314 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a48e2de4-37d2-40ea-b1b9-0ccd49a4d745 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:04.094758 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a48e2de4-37d2-40ea-b1b9-0ccd49a4d745 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:04.095490 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a48e2de4-37d2-40ea-b1b9-0ccd49a4d745 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:04.095986 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a48e2de4-37d2-40ea-b1b9-0ccd49a4d745 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:04.096421 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a48e2de4-37d2-40ea-b1b9-0ccd49a4d745 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:04.201502 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7b0b8780-4b0a-4ffc-b5d9-248258afc0dd tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:04.217410 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7b0b8780-4b0a-4ffc-b5d9-248258afc0dd tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.589878 Aug 07 01:31:04.234535 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2263/4185] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:03 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:04.240409 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-90c574ac-18da-4397-9760-4635912fc146 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:04.241295 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-90c574ac-18da-4397-9760-4635912fc146 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:04.249013 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90c574ac-18da-4397-9760-4635912fc146 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:04.251337 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90c574ac-18da-4397-9760-4635912fc146 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:04.252010 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90c574ac-18da-4397-9760-4635912fc146 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:04.253104 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90c574ac-18da-4397-9760-4635912fc146 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:04.253706 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90c574ac-18da-4397-9760-4635912fc146 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:04.254292 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90c574ac-18da-4397-9760-4635912fc146 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:04.479866 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a48e2de4-37d2-40ea-b1b9-0ccd49a4d745 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:04.493742 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a48e2de4-37d2-40ea-b1b9-0ccd49a4d745 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/cd399490-133f-43a2-b0b7-ed5448e52dab" status: 200 len: 1320 microversion: 2.1 time: 0.411292 Aug 07 01:31:04.497057 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1923/4186] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:04 2022] GET /compute/v2.1/servers/cd399490-133f-43a2-b0b7-ed5448e52dab => generated 1320 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:04.513044 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d66add5e-8352-4562-b7d6-e8fc507c9f1d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:04.514131 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d66add5e-8352-4562-b7d6-e8fc507c9f1d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:04.535801 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d66add5e-8352-4562-b7d6-e8fc507c9f1d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:04.554364 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d66add5e-8352-4562-b7d6-e8fc507c9f1d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:04.558499 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d66add5e-8352-4562-b7d6-e8fc507c9f1d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:04.559571 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d66add5e-8352-4562-b7d6-e8fc507c9f1d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:04.560267 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d66add5e-8352-4562-b7d6-e8fc507c9f1d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:04.564445 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d66add5e-8352-4562-b7d6-e8fc507c9f1d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:04.574631 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:04.891773 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d66add5e-8352-4562-b7d6-e8fc507c9f1d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:04.900135 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-90c574ac-18da-4397-9760-4635912fc146 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:04.906523 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d66add5e-8352-4562-b7d6-e8fc507c9f1d tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.400278 Aug 07 01:31:04.907704 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1924/4187] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:04 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:04.921831 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0f4bc47c-f643-48d1-bbf3-a620c4ab6f70 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:04.927039 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0f4bc47c-f643-48d1-bbf3-a620c4ab6f70 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: f6b31167-8c76-4749-88b4-d8380d9b9a84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:04.927331 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-90c574ac-18da-4397-9760-4635912fc146 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 200 len: 1315 microversion: 2.1 time: 0.687260 Aug 07 01:31:04.940548 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0f4bc47c-f643-48d1-bbf3-a620c4ab6f70 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:04.941955 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2264/4188] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:04 2022] GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 1315 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:04.948294 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0f4bc47c-f643-48d1-bbf3-a620c4ab6f70 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:04.948757 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0f4bc47c-f643-48d1-bbf3-a620c4ab6f70 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:04.949513 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0f4bc47c-f643-48d1-bbf3-a620c4ab6f70 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:04.949979 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0f4bc47c-f643-48d1-bbf3-a620c4ab6f70 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:04.950415 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0f4bc47c-f643-48d1-bbf3-a620c4ab6f70 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:04.961017 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4098274b-342e-486f-b316-6ee67f9680a7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:04.966335 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4098274b-342e-486f-b316-6ee67f9680a7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: be420f13-724a-4d7c-8e93-b8db8427e329] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:04.984515 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-4098274b-342e-486f-b316-6ee67f9680a7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] HTTP exception thrown: Instance be420f13-724a-4d7c-8e93-b8db8427e329 could not be found. Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4098274b-342e-486f-b316-6ee67f9680a7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers/be420f13-724a-4d7c-8e93-b8db8427e329/action HTTP/1.1 Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 18 Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: {"unshelve": null} Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: exception: Instance be420f13-724a-4d7c-8e93-b8db8427e329 could not be found. Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'be420f13-724a-4d7c-8e93-b8db8427e329', 'body': {'unshelve': None}} Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be420f13-724a-4d7c-8e93-b8db8427e329 could not be found. Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be420f13-724a-4d7c-8e93-b8db8427e329 could not be found. Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:04.987010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:04.993094 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:04.993094 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:04.993094 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:04.993094 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:04.993094 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:31:04.993094 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:31:04.993094 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be420f13-724a-4d7c-8e93-b8db8427e329 could not be found. Aug 07 01:31:04.993094 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:04.995284 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4098274b-342e-486f-b316-6ee67f9680a7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 404 to user: Instance be420f13-724a-4d7c-8e93-b8db8427e329 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:31:04.996429 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4098274b-342e-486f-b316-6ee67f9680a7 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers/be420f13-724a-4d7c-8e93-b8db8427e329/action" status: 404 len: 111 microversion: 2.1 time: 0.051171 Aug 07 01:31:04.997181 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2265/4189] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:31:04 2022] POST /compute/v2.1/servers/be420f13-724a-4d7c-8e93-b8db8427e329/action => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:31:05.009316 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-415862ed-7713-4d7b-b94d-19f553083f5b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:05.010362 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-415862ed-7713-4d7b-b94d-19f553083f5b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:05.022182 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-415862ed-7713-4d7b-b94d-19f553083f5b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:05.023047 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-415862ed-7713-4d7b-b94d-19f553083f5b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:05.023830 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-415862ed-7713-4d7b-b94d-19f553083f5b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:05.026821 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-415862ed-7713-4d7b-b94d-19f553083f5b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:05.027586 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-415862ed-7713-4d7b-b94d-19f553083f5b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:05.028282 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-415862ed-7713-4d7b-b94d-19f553083f5b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:05.266543 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0f4bc47c-f643-48d1-bbf3-a620c4ab6f70 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:05.305685 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0f4bc47c-f643-48d1-bbf3-a620c4ab6f70 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84" status: 200 len: 1314 microversion: 2.1 time: 0.396623 Aug 07 01:31:05.339752 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1925/4190] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:04 2022] GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84 => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:05.518599 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-420d809b-8f84-4952-8d79-31e7a448073c tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:05.519256 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-420d809b-8f84-4952-8d79-31e7a448073c tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: cd399490-133f-43a2-b0b7-ed5448e52dab] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:05.532130 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-420d809b-8f84-4952-8d79-31e7a448073c tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:05.532919 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-420d809b-8f84-4952-8d79-31e7a448073c tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:05.533549 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-420d809b-8f84-4952-8d79-31e7a448073c tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:05.535671 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-420d809b-8f84-4952-8d79-31e7a448073c tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:05.537764 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-420d809b-8f84-4952-8d79-31e7a448073c tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:05.538394 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-420d809b-8f84-4952-8d79-31e7a448073c tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:05.990113 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-415862ed-7713-4d7b-b94d-19f553083f5b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:06.001256 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-415862ed-7713-4d7b-b94d-19f553083f5b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.996935 Aug 07 01:31:06.024232 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2266/4191] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:05 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:06.073088 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-20396b10-c6e2-44ca-86a0-56ca2c5c8b4e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:06.073734 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-20396b10-c6e2-44ca-86a0-56ca2c5c8b4e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:06.082458 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-420d809b-8f84-4952-8d79-31e7a448073c tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:06.096669 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-420d809b-8f84-4952-8d79-31e7a448073c tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/cd399490-133f-43a2-b0b7-ed5448e52dab" status: 200 len: 1511 microversion: 2.1 time: 0.582099 Aug 07 01:31:06.097345 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1926/4192] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:05 2022] GET /compute/v2.1/servers/cd399490-133f-43a2-b0b7-ed5448e52dab => generated 1511 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:31:06.102407 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-92a1ce5a-b3bb-4bcc-87cd-cff76fb0a936 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:06.105774 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20396b10-c6e2-44ca-86a0-56ca2c5c8b4e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:06.106430 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20396b10-c6e2-44ca-86a0-56ca2c5c8b4e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:06.106881 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20396b10-c6e2-44ca-86a0-56ca2c5c8b4e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:06.107614 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20396b10-c6e2-44ca-86a0-56ca2c5c8b4e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:06.108113 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20396b10-c6e2-44ca-86a0-56ca2c5c8b4e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:06.108550 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20396b10-c6e2-44ca-86a0-56ca2c5c8b4e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:06.113592 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-92a1ce5a-b3bb-4bcc-87cd-cff76fb0a936 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:06.123530 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:06.133400 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-92a1ce5a-b3bb-4bcc-87cd-cff76fb0a936 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:06.133907 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-92a1ce5a-b3bb-4bcc-87cd-cff76fb0a936 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:06.134353 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-92a1ce5a-b3bb-4bcc-87cd-cff76fb0a936 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:06.137919 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-92a1ce5a-b3bb-4bcc-87cd-cff76fb0a936 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:06.138439 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-92a1ce5a-b3bb-4bcc-87cd-cff76fb0a936 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:06.138898 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-92a1ce5a-b3bb-4bcc-87cd-cff76fb0a936 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:06.515250 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-20396b10-c6e2-44ca-86a0-56ca2c5c8b4e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:06.524256 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-20396b10-c6e2-44ca-86a0-56ca2c5c8b4e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 200 len: 1315 microversion: 2.1 time: 0.498690 Aug 07 01:31:06.540111 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2267/4193] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:06 2022] GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 1315 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:06.546355 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a4af23c8-9b5e-4654-a103-f5a6c8ae586a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:06.553901 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a4af23c8-9b5e-4654-a103-f5a6c8ae586a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:06.555182 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a4af23c8-9b5e-4654-a103-f5a6c8ae586a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '5f88662ebb674ad99a4d36651dee967a'} {{(pid=119516) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:31:06.573911 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4af23c8-9b5e-4654-a103-f5a6c8ae586a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:06.574756 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4af23c8-9b5e-4654-a103-f5a6c8ae586a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:06.575428 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4af23c8-9b5e-4654-a103-f5a6c8ae586a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:06.576498 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4af23c8-9b5e-4654-a103-f5a6c8ae586a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:06.577169 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4af23c8-9b5e-4654-a103-f5a6c8ae586a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:06.578228 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4af23c8-9b5e-4654-a103-f5a6c8ae586a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:06.599712 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-92a1ce5a-b3bb-4bcc-87cd-cff76fb0a936 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:06.607483 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-92a1ce5a-b3bb-4bcc-87cd-cff76fb0a936 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.508799 Aug 07 01:31:06.612599 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1927/4194] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:06 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:06.618018 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f733ae3a-6a81-4f2a-a8c8-5381a7eaba69 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:06.618638 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f733ae3a-6a81-4f2a-a8c8-5381a7eaba69 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: f6b31167-8c76-4749-88b4-d8380d9b9a84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:06.643703 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f733ae3a-6a81-4f2a-a8c8-5381a7eaba69 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:06.644219 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f733ae3a-6a81-4f2a-a8c8-5381a7eaba69 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:06.647206 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f733ae3a-6a81-4f2a-a8c8-5381a7eaba69 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:06.648177 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f733ae3a-6a81-4f2a-a8c8-5381a7eaba69 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:06.648660 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f733ae3a-6a81-4f2a-a8c8-5381a7eaba69 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:06.649191 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f733ae3a-6a81-4f2a-a8c8-5381a7eaba69 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:06.716525 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.multi_cell_list [None req-a4af23c8-9b5e-4654-a103-f5a6c8ae586a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 01:31:06.805686 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a4af23c8-9b5e-4654-a103-f5a6c8ae586a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:06.815709 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4af23c8-9b5e-4654-a103-f5a6c8ae586a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:06.817017 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4af23c8-9b5e-4654-a103-f5a6c8ae586a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:06.818221 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4af23c8-9b5e-4654-a103-f5a6c8ae586a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:07.015269 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f733ae3a-6a81-4f2a-a8c8-5381a7eaba69 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:07.026544 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f733ae3a-6a81-4f2a-a8c8-5381a7eaba69 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84" status: 200 len: 1314 microversion: 2.1 time: 0.412701 Aug 07 01:31:07.031997 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1928/4195] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:06 2022] GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84 => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:07.039786 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d283bb13-1935-448d-8493-fd6c58c14a6b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:07.040689 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d283bb13-1935-448d-8493-fd6c58c14a6b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:07.059182 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d283bb13-1935-448d-8493-fd6c58c14a6b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:07.060026 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d283bb13-1935-448d-8493-fd6c58c14a6b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:07.060694 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d283bb13-1935-448d-8493-fd6c58c14a6b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:07.064379 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d283bb13-1935-448d-8493-fd6c58c14a6b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:07.067176 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d283bb13-1935-448d-8493-fd6c58c14a6b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:07.068827 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d283bb13-1935-448d-8493-fd6c58c14a6b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:07.166597 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-d283bb13-1935-448d-8493-fd6c58c14a6b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] HTTP exception thrown: Cannot 'unshelve' instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 while it is in vm_state active Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d283bb13-1935-448d-8493-fd6c58c14a6b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015/action HTTP/1.1 Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 18 Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: {"unshelve": null} Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: exception: Cannot 'unshelve' instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 while it is in vm_state active Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'd9b1883a-c95a-4c49-ad6d-335ecf03b015', 'body': {'unshelve': None}} Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 in vm_state active. Cannot unshelve while the instance is in this state. Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 07 01:31:07.168958 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 07 01:31:07.173322 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 while it is in vm_state active Aug 07 01:31:07.173322 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:07.173322 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:07.173322 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:07.173322 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:07.173322 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:07.173322 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:07.173322 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:31:07.173322 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:31:07.173322 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 while it is in vm_state active Aug 07 01:31:07.173322 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:07.174844 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d283bb13-1935-448d-8493-fd6c58c14a6b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 409 to user: Cannot 'unshelve' instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 while it is in vm_state active {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:31:07.175918 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d283bb13-1935-448d-8493-fd6c58c14a6b tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "POST /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015/action" status: 409 len: 146 microversion: 2.1 time: 0.142621 Aug 07 01:31:07.177488 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1929/4196] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:31:07 2022] POST /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015/action => generated 146 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:31:07.182241 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-f3b69cc6-2c14-45a8-a743-70decac42b5f req-34e9dda8-8cf5-4fd2-87fa-5c10bba48f52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6b31167-8c76-4749-88b4-d8380d9b9a84", "tag": "4ce61a79-bcb4-4377-8c9e-966c9c1e1752"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:07.207035 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f3b69cc6-2c14-45a8-a743-70decac42b5f req-34e9dda8-8cf5-4fd2-87fa-5c10bba48f52 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:07.207713 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f3b69cc6-2c14-45a8-a743-70decac42b5f req-34e9dda8-8cf5-4fd2-87fa-5c10bba48f52 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:07.210602 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f3b69cc6-2c14-45a8-a743-70decac42b5f req-34e9dda8-8cf5-4fd2-87fa-5c10bba48f52 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:07.228384 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a4af23c8-9b5e-4654-a103-f5a6c8ae586a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.686286 Aug 07 01:31:07.229945 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2268/4197] 10.222.0.39 () {58 vars in 1167 bytes} [Sun Aug 7 01:31:06 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:07.236745 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a570045d-cc62-4aa7-9a82-83485a7047e8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:07.238552 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a570045d-cc62-4aa7-9a82-83485a7047e8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:07.250895 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a570045d-cc62-4aa7-9a82-83485a7047e8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:07.250895 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a570045d-cc62-4aa7-9a82-83485a7047e8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:07.252267 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-f3b69cc6-2c14-45a8-a743-70decac42b5f req-34e9dda8-8cf5-4fd2-87fa-5c10bba48f52 service nova] Creating event network-changed:4ce61a79-bcb4-4377-8c9e-966c9c1e1752 for instance f6b31167-8c76-4749-88b4-d8380d9b9a84 on n-h2-master-1 Aug 07 01:31:07.253257 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a570045d-cc62-4aa7-9a82-83485a7047e8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:07.258222 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-f3b69cc6-2c14-45a8-a743-70decac42b5f req-34e9dda8-8cf5-4fd2-87fa-5c10bba48f52 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079229 Aug 07 01:31:07.259477 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1930/4198] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:07.262761 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a570045d-cc62-4aa7-9a82-83485a7047e8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:07.263252 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a570045d-cc62-4aa7-9a82-83485a7047e8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:07.263693 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a570045d-cc62-4aa7-9a82-83485a7047e8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:07.500455 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9280b31c-0bf0-409f-a443-81c861890db5 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-621790232", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "2ec79aa5-3459-49b2-ab11-40c8ea945d4e"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:07.578795 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-9280b31c-0bf0-409f-a443-81c861890db5 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] validate_networks() for [('2ec79aa5-3459-49b2-ab11-40c8ea945d4e', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:31:07.643733 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a570045d-cc62-4aa7-9a82-83485a7047e8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:07.655782 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a570045d-cc62-4aa7-9a82-83485a7047e8 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.424619 Aug 07 01:31:07.660069 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2269/4199] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:07 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:07.676432 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-72ea99f3-6162-452f-b1c7-03c53ef2cbef tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:07.685130 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-72ea99f3-6162-452f-b1c7-03c53ef2cbef tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:07.686419 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-72ea99f3-6162-452f-b1c7-03c53ef2cbef tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1928549615', 'deleted': False, 'project_id': '5f88662ebb674ad99a4d36651dee967a'} {{(pid=119516) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:31:07.693207 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72ea99f3-6162-452f-b1c7-03c53ef2cbef tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:07.694033 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72ea99f3-6162-452f-b1c7-03c53ef2cbef tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:07.694702 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72ea99f3-6162-452f-b1c7-03c53ef2cbef tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:07.695801 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72ea99f3-6162-452f-b1c7-03c53ef2cbef tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:07.697135 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72ea99f3-6162-452f-b1c7-03c53ef2cbef tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:07.697821 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72ea99f3-6162-452f-b1c7-03c53ef2cbef tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:07.849280 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.multi_cell_list [None req-72ea99f3-6162-452f-b1c7-03c53ef2cbef tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 01:31:08.028962 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-72ea99f3-6162-452f-b1c7-03c53ef2cbef tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:08.040515 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72ea99f3-6162-452f-b1c7-03c53ef2cbef tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:08.043664 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72ea99f3-6162-452f-b1c7-03c53ef2cbef tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:08.044470 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72ea99f3-6162-452f-b1c7-03c53ef2cbef tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:08.308646 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-72ea99f3-6162-452f-b1c7-03c53ef2cbef tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1928549615" status: 200 len: 1516 microversion: 2.1 time: 0.647256 Aug 07 01:31:08.311502 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2270/4200] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Aug 7 01:31:07 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1928549615 => generated 1516 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:08.319707 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0579db04-165d-4897-9e2c-f4c4aa182a19 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:08.320988 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0579db04-165d-4897-9e2c-f4c4aa182a19 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:08.329253 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0579db04-165d-4897-9e2c-f4c4aa182a19 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:08.330167 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0579db04-165d-4897-9e2c-f4c4aa182a19 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:08.330777 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0579db04-165d-4897-9e2c-f4c4aa182a19 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:08.331348 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0579db04-165d-4897-9e2c-f4c4aa182a19 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:08.332475 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0579db04-165d-4897-9e2c-f4c4aa182a19 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:08.341228 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0579db04-165d-4897-9e2c-f4c4aa182a19 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:08.436924 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:08.457233 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:08.768849 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0579db04-165d-4897-9e2c-f4c4aa182a19 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:08.771291 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-9280b31c-0bf0-409f-a443-81c861890db5 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:31:08.771926 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-9280b31c-0bf0-409f-a443-81c861890db5 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:31:08.772561 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-9280b31c-0bf0-409f-a443-81c861890db5 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:31:08.773161 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-9280b31c-0bf0-409f-a443-81c861890db5 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:31:08.773587 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-9280b31c-0bf0-409f-a443-81c861890db5 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:31:08.779876 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0579db04-165d-4897-9e2c-f4c4aa182a19 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 200 len: 1315 microversion: 2.1 time: 0.465546 Aug 07 01:31:08.781782 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2271/4201] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:08 2022] GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 1315 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:08.788205 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-370624b0-4f0f-457e-92a9-35bf0576ae33 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:08.789051 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9280b31c-0bf0-409f-a443-81c861890db5 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:08.789609 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9280b31c-0bf0-409f-a443-81c861890db5 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:08.790258 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9280b31c-0bf0-409f-a443-81c861890db5 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:08.790407 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-370624b0-4f0f-457e-92a9-35bf0576ae33 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:08.794717 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9280b31c-0bf0-409f-a443-81c861890db5 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:08.795200 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9280b31c-0bf0-409f-a443-81c861890db5 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:08.795646 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9280b31c-0bf0-409f-a443-81c861890db5 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:08.801692 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-370624b0-4f0f-457e-92a9-35bf0576ae33 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:08.804202 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-370624b0-4f0f-457e-92a9-35bf0576ae33 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:08.804913 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-370624b0-4f0f-457e-92a9-35bf0576ae33 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:08.806032 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-370624b0-4f0f-457e-92a9-35bf0576ae33 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:08.807182 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-370624b0-4f0f-457e-92a9-35bf0576ae33 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:08.807804 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-370624b0-4f0f-457e-92a9-35bf0576ae33 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:08.834107 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-9280b31c-0bf0-409f-a443-81c861890db5 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Getting quotas for project ec14c7253bf944819d3b6e203ea4b9ae. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:31:08.849608 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-9280b31c-0bf0-409f-a443-81c861890db5 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Getting quotas for user 8f2c4d9c50fe4c08b3619994e94470c6 and project ec14c7253bf944819d3b6e203ea4b9ae. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:31:08.873406 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9280b31c-0bf0-409f-a443-81c861890db5 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:31:08.883046 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9280b31c-0bf0-409f-a443-81c861890db5 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] [instance: da55749a-1b96-4341-a947-9062b0d33eb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:31:09.004755 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9280b31c-0bf0-409f-a443-81c861890db5 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.742776 Aug 07 01:31:09.009958 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1931/4202] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:31:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:31:09.028980 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-69695f4a-31a1-4362-a2b4-24fa678c4564 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:09.031463 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-69695f4a-31a1-4362-a2b4-24fa678c4564 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: f6b31167-8c76-4749-88b4-d8380d9b9a84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:09.054501 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-69695f4a-31a1-4362-a2b4-24fa678c4564 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:09.055511 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-69695f4a-31a1-4362-a2b4-24fa678c4564 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:09.056313 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-69695f4a-31a1-4362-a2b4-24fa678c4564 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:09.057364 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-69695f4a-31a1-4362-a2b4-24fa678c4564 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:09.057983 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-69695f4a-31a1-4362-a2b4-24fa678c4564 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:09.058572 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-69695f4a-31a1-4362-a2b4-24fa678c4564 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:09.385545 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-370624b0-4f0f-457e-92a9-35bf0576ae33 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:09.409192 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-370624b0-4f0f-457e-92a9-35bf0576ae33 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.625910 Aug 07 01:31:09.409828 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2272/4203] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:08 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:09.415870 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ecd4d958-5838-4321-95fb-2694e9a8b8d7 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:09.422310 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ecd4d958-5838-4321-95fb-2694e9a8b8d7 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:09.423440 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ecd4d958-5838-4321-95fb-2694e9a8b8d7 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '5f88662ebb674ad99a4d36651dee967a'} {{(pid=119516) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:31:09.430712 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecd4d958-5838-4321-95fb-2694e9a8b8d7 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:09.431272 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecd4d958-5838-4321-95fb-2694e9a8b8d7 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:09.431876 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecd4d958-5838-4321-95fb-2694e9a8b8d7 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:09.432718 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecd4d958-5838-4321-95fb-2694e9a8b8d7 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:09.433644 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecd4d958-5838-4321-95fb-2694e9a8b8d7 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:09.434166 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecd4d958-5838-4321-95fb-2694e9a8b8d7 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:09.568083 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-69695f4a-31a1-4362-a2b4-24fa678c4564 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:09.596427 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-69695f4a-31a1-4362-a2b4-24fa678c4564 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84" status: 200 len: 1314 microversion: 2.1 time: 0.585228 Aug 07 01:31:09.597026 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1932/4204] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:09 2022] GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84 => generated 1314 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:09.617916 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.multi_cell_list [None req-ecd4d958-5838-4321-95fb-2694e9a8b8d7 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 01:31:09.618260 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-41d7f415-5405-4556-b92b-1bf0e8e58d2b tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:09.619116 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-41d7f415-5405-4556-b92b-1bf0e8e58d2b tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] [instance: da55749a-1b96-4341-a947-9062b0d33eb2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:09.639601 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:09.723179 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-41d7f415-5405-4556-b92b-1bf0e8e58d2b tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2c4d9c50fe4c08b3619994e94470c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14c7253bf944819d3b6e203ea4b9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:09.739429 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-41d7f415-5405-4556-b92b-1bf0e8e58d2b tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] 10.222.0.39 "GET /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2" status: 200 len: 1227 microversion: 2.1 time: 0.138686 Aug 07 01:31:09.741868 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1933/4205] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:09 2022] GET /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2 => generated 1227 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:09.751689 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ecd4d958-5838-4321-95fb-2694e9a8b8d7 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:09.759211 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-37222091-d7d4-48a2-a348-9409bb83db5e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1071550080_updated"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:09.763082 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecd4d958-5838-4321-95fb-2694e9a8b8d7 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:09.763556 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecd4d958-5838-4321-95fb-2694e9a8b8d7 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:09.764081 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecd4d958-5838-4321-95fb-2694e9a8b8d7 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:09.765241 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-37222091-d7d4-48a2-a348-9409bb83db5e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: bdd464bb-d470-4dee-b787-36fcea799d9a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:09.783576 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-37222091-d7d4-48a2-a348-9409bb83db5e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] HTTP exception thrown: Instance bdd464bb-d470-4dee-b787-36fcea799d9a could not be found. Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-37222091-d7d4-48a2-a348-9409bb83db5e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: request: PUT /compute/v2.1/servers/bdd464bb-d470-4dee-b787-36fcea799d9a HTTP/1.1 Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 81 Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1071550080_updated"}} Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: exception: Instance bdd464bb-d470-4dee-b787-36fcea799d9a could not be found. Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'bdd464bb-d470-4dee-b787-36fcea799d9a', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1071550080_updated'}}} Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdd464bb-d470-4dee-b787-36fcea799d9a could not be found. Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 07 01:31:09.791146 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:31:09.795603 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:31:09.795603 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:31:09.795603 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:31:09.795603 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdd464bb-d470-4dee-b787-36fcea799d9a could not be found. Aug 07 01:31:09.795603 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:09.795603 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:09.795603 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:09.795603 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:09.795603 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:09.795603 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:09.795603 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:31:09.795603 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:31:09.795603 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdd464bb-d470-4dee-b787-36fcea799d9a could not be found. Aug 07 01:31:09.795603 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:09.797753 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-37222091-d7d4-48a2-a348-9409bb83db5e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 404 to user: Instance bdd464bb-d470-4dee-b787-36fcea799d9a could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:31:09.805916 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-37222091-d7d4-48a2-a348-9409bb83db5e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "PUT /compute/v2.1/servers/bdd464bb-d470-4dee-b787-36fcea799d9a" status: 404 len: 111 microversion: 2.1 time: 0.057313 Aug 07 01:31:09.807561 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1934/4206] 10.222.0.39 () {60 vars in 1256 bytes} [Sun Aug 7 01:31:09 2022] PUT /compute/v2.1/servers/bdd464bb-d470-4dee-b787-36fcea799d9a => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:31:09.812978 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-93c8d34b-d313-4ac7-8fb0-26c86d45116f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:09.814076 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-93c8d34b-d313-4ac7-8fb0-26c86d45116f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:09.829128 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93c8d34b-d313-4ac7-8fb0-26c86d45116f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:09.829751 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93c8d34b-d313-4ac7-8fb0-26c86d45116f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:09.830400 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93c8d34b-d313-4ac7-8fb0-26c86d45116f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:09.833140 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93c8d34b-d313-4ac7-8fb0-26c86d45116f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:09.835560 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93c8d34b-d313-4ac7-8fb0-26c86d45116f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:09.836941 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93c8d34b-d313-4ac7-8fb0-26c86d45116f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:10.008895 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ecd4d958-5838-4321-95fb-2694e9a8b8d7 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4518 microversion: 2.1 time: 0.597977 Aug 07 01:31:10.009692 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2273/4207] 10.222.0.39 () {58 vars in 1173 bytes} [Sun Aug 7 01:31:09 2022] GET /compute/v2.1/servers/detail?status=active => generated 4518 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:10.014926 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-82f73b82-7770-47be-9ec2-5aee7339b82e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:10.015778 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-82f73b82-7770-47be-9ec2-5aee7339b82e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:10.023021 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-82f73b82-7770-47be-9ec2-5aee7339b82e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:10.023514 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-82f73b82-7770-47be-9ec2-5aee7339b82e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:10.023984 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-82f73b82-7770-47be-9ec2-5aee7339b82e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:10.024905 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-82f73b82-7770-47be-9ec2-5aee7339b82e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:10.025529 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-82f73b82-7770-47be-9ec2-5aee7339b82e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:10.026328 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-82f73b82-7770-47be-9ec2-5aee7339b82e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:10.316568 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-93c8d34b-d313-4ac7-8fb0-26c86d45116f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:10.336882 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-93c8d34b-d313-4ac7-8fb0-26c86d45116f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 200 len: 1315 microversion: 2.1 time: 0.527848 Aug 07 01:31:10.337601 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1935/4208] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:09 2022] GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 1315 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:10.338521 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-82f73b82-7770-47be-9ec2-5aee7339b82e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:10.351324 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-82f73b82-7770-47be-9ec2-5aee7339b82e tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.339096 Aug 07 01:31:10.352162 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2274/4209] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:10 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:10.352637 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3c3bdcd8-4f54-4f01-b57d-3af203dc9d70 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:10.366011 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3c3bdcd8-4f54-4f01-b57d-3af203dc9d70 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:10.366473 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.compute.servers [None req-3c3bdcd8-4f54-4f01-b57d-3af203dc9d70 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Removing options 'limit' from query {{(pid=119517) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 07 01:31:10.370680 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3c3bdcd8-4f54-4f01-b57d-3af203dc9d70 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Searching by: {'deleted': False, 'project_id': '5f88662ebb674ad99a4d36651dee967a'} {{(pid=119517) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:31:10.384584 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ce674843-0b01-4c16-a690-0a5d15a6315f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:10.386898 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c3bdcd8-4f54-4f01-b57d-3af203dc9d70 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:10.387607 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c3bdcd8-4f54-4f01-b57d-3af203dc9d70 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:10.388237 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c3bdcd8-4f54-4f01-b57d-3af203dc9d70 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:10.389350 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c3bdcd8-4f54-4f01-b57d-3af203dc9d70 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:10.389996 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c3bdcd8-4f54-4f01-b57d-3af203dc9d70 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:10.390274 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ce674843-0b01-4c16-a690-0a5d15a6315f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:10.391083 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c3bdcd8-4f54-4f01-b57d-3af203dc9d70 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:10.400657 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce674843-0b01-4c16-a690-0a5d15a6315f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:10.401715 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce674843-0b01-4c16-a690-0a5d15a6315f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:10.402497 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce674843-0b01-4c16-a690-0a5d15a6315f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:10.404850 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce674843-0b01-4c16-a690-0a5d15a6315f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:10.406198 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce674843-0b01-4c16-a690-0a5d15a6315f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:10.406799 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce674843-0b01-4c16-a690-0a5d15a6315f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:10.460502 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3c3bdcd8-4f54-4f01-b57d-3af203dc9d70 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:10.482387 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c3bdcd8-4f54-4f01-b57d-3af203dc9d70 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:10.482884 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c3bdcd8-4f54-4f01-b57d-3af203dc9d70 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:10.483323 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c3bdcd8-4f54-4f01-b57d-3af203dc9d70 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:10.601664 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ce674843-0b01-4c16-a690-0a5d15a6315f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:10.617484 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ce674843-0b01-4c16-a690-0a5d15a6315f tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.240611 Aug 07 01:31:10.618167 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2275/4210] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:10 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:10.625421 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-86e919a9-4dce-4c54-b0ab-f86e8dab4741 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:10.626649 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-86e919a9-4dce-4c54-b0ab-f86e8dab4741 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: f6b31167-8c76-4749-88b4-d8380d9b9a84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:10.636933 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86e919a9-4dce-4c54-b0ab-f86e8dab4741 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:10.637723 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86e919a9-4dce-4c54-b0ab-f86e8dab4741 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:10.638348 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86e919a9-4dce-4c54-b0ab-f86e8dab4741 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:10.639283 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86e919a9-4dce-4c54-b0ab-f86e8dab4741 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:10.639947 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86e919a9-4dce-4c54-b0ab-f86e8dab4741 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:10.640972 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86e919a9-4dce-4c54-b0ab-f86e8dab4741 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:10.963057 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3c3bdcd8-4f54-4f01-b57d-3af203dc9d70 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.624312 Aug 07 01:31:10.964675 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1936/4211] 10.222.0.39 () {58 vars in 1161 bytes} [Sun Aug 7 01:31:10 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:10.971731 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c683c1ee-2619-4043-a291-6e3854ad43ec tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c683c1ee-2619-4043-a291-6e3854ad43ec tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: request: PUT /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 HTTP/1.1 Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 280 Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'd9b1883a-c95a-4c49-ad6d-335ecf03b015', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:10.990392 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:10.993876 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:10.993876 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:10.993876 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:31:10.993876 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:31:10.993876 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:31:10.993876 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:31:10.993876 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:31:10.993876 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:31:10.993876 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:31:10.993876 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:31:10.993876 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:31:10.993876 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:31:10.993876 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:31:10.993876 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:31:10.993876 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 07 01:31:10.993876 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:10.993876 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:10.993876 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:10.993876 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:10.993876 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:10.993876 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:10.993876 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:31:10.993876 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:31:10.993876 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 07 01:31:10.993876 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:10.998494 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c683c1ee-2619-4043-a291-6e3854ad43ec tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:31:11.000579 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c683c1ee-2619-4043-a291-6e3854ad43ec tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "PUT /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 400 len: 619 microversion: 2.1 time: 0.034754 Aug 07 01:31:11.012942 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1937/4212] 10.222.0.39 () {60 vars in 1257 bytes} [Sun Aug 7 01:31:10 2022] PUT /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 619 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:31:11.022910 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-166316fb-1143-4084-acb1-8c251658e7da tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:11.023530 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-166316fb-1143-4084-acb1-8c251658e7da tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] [instance: da55749a-1b96-4341-a947-9062b0d33eb2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:11.043346 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-166316fb-1143-4084-acb1-8c251658e7da tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:11.044830 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-166316fb-1143-4084-acb1-8c251658e7da tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:11.047025 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-166316fb-1143-4084-acb1-8c251658e7da tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:11.048580 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-166316fb-1143-4084-acb1-8c251658e7da tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:11.052917 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-166316fb-1143-4084-acb1-8c251658e7da tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:11.070164 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-166316fb-1143-4084-acb1-8c251658e7da tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:11.158272 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-86e919a9-4dce-4c54-b0ab-f86e8dab4741 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:11.169305 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-86e919a9-4dce-4c54-b0ab-f86e8dab4741 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84" status: 200 len: 1314 microversion: 2.1 time: 0.549753 Aug 07 01:31:11.175081 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2276/4213] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:10 2022] GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84 => generated 1314 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:11.206148 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-846cf31a-05a4-4945-96f6-2565d008f63b tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:11.214287 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-846cf31a-05a4-4945-96f6-2565d008f63b tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:11.219193 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-846cf31a-05a4-4945-96f6-2565d008f63b tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '5f88662ebb674ad99a4d36651dee967a'} {{(pid=119516) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:31:11.230371 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-846cf31a-05a4-4945-96f6-2565d008f63b tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:11.234595 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-846cf31a-05a4-4945-96f6-2565d008f63b tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:11.236054 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-846cf31a-05a4-4945-96f6-2565d008f63b tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:11.238541 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-846cf31a-05a4-4945-96f6-2565d008f63b tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:11.240093 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-846cf31a-05a4-4945-96f6-2565d008f63b tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:11.240840 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-846cf31a-05a4-4945-96f6-2565d008f63b tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:11.333572 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-166316fb-1143-4084-acb1-8c251658e7da tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2c4d9c50fe4c08b3619994e94470c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14c7253bf944819d3b6e203ea4b9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:11.350726 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-166316fb-1143-4084-acb1-8c251658e7da tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] 10.222.0.39 "GET /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2" status: 200 len: 1285 microversion: 2.1 time: 0.333791 Aug 07 01:31:11.352048 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1938/4214] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:11 2022] GET /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2 => generated 1285 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:11.368301 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ddcd98c6-ca9e-495f-a4cb-d14db09e7dee tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:11.369955 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ddcd98c6-ca9e-495f-a4cb-d14db09e7dee tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:11.377187 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ddcd98c6-ca9e-495f-a4cb-d14db09e7dee tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:11.378027 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ddcd98c6-ca9e-495f-a4cb-d14db09e7dee tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:11.379139 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ddcd98c6-ca9e-495f-a4cb-d14db09e7dee tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:11.380453 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ddcd98c6-ca9e-495f-a4cb-d14db09e7dee tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:11.381162 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ddcd98c6-ca9e-495f-a4cb-d14db09e7dee tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:11.381827 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ddcd98c6-ca9e-495f-a4cb-d14db09e7dee tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:11.410029 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.multi_cell_list [None req-846cf31a-05a4-4945-96f6-2565d008f63b tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 01:31:11.569056 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-846cf31a-05a4-4945-96f6-2565d008f63b tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.378728 Aug 07 01:31:11.572058 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2277/4215] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Aug 7 01:31:11 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:11.584570 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bee1386d-85f6-4cb5-83aa-5e8ead47e70f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:11.585213 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bee1386d-85f6-4cb5-83aa-5e8ead47e70f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:11.608601 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bee1386d-85f6-4cb5-83aa-5e8ead47e70f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:11.609131 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bee1386d-85f6-4cb5-83aa-5e8ead47e70f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:11.618114 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bee1386d-85f6-4cb5-83aa-5e8ead47e70f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:11.619001 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bee1386d-85f6-4cb5-83aa-5e8ead47e70f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:11.619500 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bee1386d-85f6-4cb5-83aa-5e8ead47e70f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:11.620213 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bee1386d-85f6-4cb5-83aa-5e8ead47e70f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:11.745177 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ddcd98c6-ca9e-495f-a4cb-d14db09e7dee tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:11.757538 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ddcd98c6-ca9e-495f-a4cb-d14db09e7dee tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.401425 Aug 07 01:31:11.769035 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1939/4216] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:11 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:11.781829 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-619e43e3-60e9-40ee-ba79-b75c95f94d66 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:11.790571 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-619e43e3-60e9-40ee-ba79-b75c95f94d66 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:11.791407 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.compute.servers [None req-619e43e3-60e9-40ee-ba79-b75c95f94d66 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Removing options 'limit' from query {{(pid=119517) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 07 01:31:11.792999 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-619e43e3-60e9-40ee-ba79-b75c95f94d66 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Searching by: {'deleted': False, 'project_id': '5f88662ebb674ad99a4d36651dee967a'} {{(pid=119517) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:31:11.802763 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-619e43e3-60e9-40ee-ba79-b75c95f94d66 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:11.803641 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-619e43e3-60e9-40ee-ba79-b75c95f94d66 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:11.804414 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-619e43e3-60e9-40ee-ba79-b75c95f94d66 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:11.805831 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-619e43e3-60e9-40ee-ba79-b75c95f94d66 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:11.806837 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-619e43e3-60e9-40ee-ba79-b75c95f94d66 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:11.807729 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-619e43e3-60e9-40ee-ba79-b75c95f94d66 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:11.865630 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.multi_cell_list [None req-619e43e3-60e9-40ee-ba79-b75c95f94d66 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 01:31:11.929465 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-619e43e3-60e9-40ee-ba79-b75c95f94d66 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.152053 Aug 07 01:31:11.930750 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1940/4217] 10.222.0.39 () {58 vars in 1150 bytes} [Sun Aug 7 01:31:11 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:11.937736 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0b299ff4-1a93-4432-b34f-eb925efffd50 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:11.938797 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0b299ff4-1a93-4432-b34f-eb925efffd50 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:11.949970 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b299ff4-1a93-4432-b34f-eb925efffd50 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:11.950702 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b299ff4-1a93-4432-b34f-eb925efffd50 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:11.951299 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b299ff4-1a93-4432-b34f-eb925efffd50 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:11.952393 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b299ff4-1a93-4432-b34f-eb925efffd50 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:11.953746 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b299ff4-1a93-4432-b34f-eb925efffd50 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:11.954412 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b299ff4-1a93-4432-b34f-eb925efffd50 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:12.031026 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bee1386d-85f6-4cb5-83aa-5e8ead47e70f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:12.045289 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bee1386d-85f6-4cb5-83aa-5e8ead47e70f tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 200 len: 1315 microversion: 2.1 time: 0.468456 Aug 07 01:31:12.046012 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2278/4218] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:11 2022] GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 1315 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:12.052962 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-2f26ff7e-96c9-4ab4-9acd-163a7774c767 req-4f278dfa-dc25-4cf7-b7db-7bf972d9db16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a00f6b81-d0b5-434f-a861-53cbcf107219", "name": "network-vif-plugged", "status": "completed", "tag": "d195799a-8bcf-49dd-ada2-d86a279b6b61"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:12.081765 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2f26ff7e-96c9-4ab4-9acd-163a7774c767 req-4f278dfa-dc25-4cf7-b7db-7bf972d9db16 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:12.083067 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2f26ff7e-96c9-4ab4-9acd-163a7774c767 req-4f278dfa-dc25-4cf7-b7db-7bf972d9db16 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:12.084512 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2f26ff7e-96c9-4ab4-9acd-163a7774c767 req-4f278dfa-dc25-4cf7-b7db-7bf972d9db16 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:12.112761 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-2f26ff7e-96c9-4ab4-9acd-163a7774c767 req-4f278dfa-dc25-4cf7-b7db-7bf972d9db16 service nova] Creating event network-vif-plugged:d195799a-8bcf-49dd-ada2-d86a279b6b61 for instance a00f6b81-d0b5-434f-a861-53cbcf107219 on n-h1-master-1 Aug 07 01:31:12.133521 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-2f26ff7e-96c9-4ab4-9acd-163a7774c767 req-4f278dfa-dc25-4cf7-b7db-7bf972d9db16 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086134 Aug 07 01:31:12.138234 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2279/4219] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:12.179311 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4d082fea-8d1f-4532-9a23-135cc9a39da7 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:12.192969 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4d082fea-8d1f-4532-9a23-135cc9a39da7 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:12.194483 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4d082fea-8d1f-4532-9a23-135cc9a39da7 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Searching by: {'deleted': False, 'project_id': '5f88662ebb674ad99a4d36651dee967a'} {{(pid=119516) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:31:12.214180 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d082fea-8d1f-4532-9a23-135cc9a39da7 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:12.216453 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d082fea-8d1f-4532-9a23-135cc9a39da7 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:12.219162 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d082fea-8d1f-4532-9a23-135cc9a39da7 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:12.224533 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d082fea-8d1f-4532-9a23-135cc9a39da7 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:12.226336 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d082fea-8d1f-4532-9a23-135cc9a39da7 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:12.230620 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d082fea-8d1f-4532-9a23-135cc9a39da7 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:12.347593 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.multi_cell_list [None req-4d082fea-8d1f-4532-9a23-135cc9a39da7 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 01:31:12.363347 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0b299ff4-1a93-4432-b34f-eb925efffd50 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:12.375640 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0b299ff4-1a93-4432-b34f-eb925efffd50 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.442975 Aug 07 01:31:12.376264 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1941/4220] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:11 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:12.390517 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-75066cef-9a21-4194-a9f4-551b04ec1973 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:12.391240 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-75066cef-9a21-4194-a9f4-551b04ec1973 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: f6b31167-8c76-4749-88b4-d8380d9b9a84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:12.403468 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75066cef-9a21-4194-a9f4-551b04ec1973 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:12.405409 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75066cef-9a21-4194-a9f4-551b04ec1973 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:12.406408 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75066cef-9a21-4194-a9f4-551b04ec1973 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:12.407491 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75066cef-9a21-4194-a9f4-551b04ec1973 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:12.410815 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75066cef-9a21-4194-a9f4-551b04ec1973 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:12.411667 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75066cef-9a21-4194-a9f4-551b04ec1973 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:12.415686 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4d082fea-8d1f-4532-9a23-135cc9a39da7 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.274772 Aug 07 01:31:12.417458 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2280/4221] 10.222.0.39 () {58 vars in 1125 bytes} [Sun Aug 7 01:31:12 2022] GET /compute/v2.1/servers => generated 1010 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:12.425818 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d181fc67-12e2-4f46-b9c2-32da26a25661 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:12.427330 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d181fc67-12e2-4f46-b9c2-32da26a25661 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] [instance: da55749a-1b96-4341-a947-9062b0d33eb2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:12.435421 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d181fc67-12e2-4f46-b9c2-32da26a25661 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:12.436242 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d181fc67-12e2-4f46-b9c2-32da26a25661 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:12.436869 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d181fc67-12e2-4f46-b9c2-32da26a25661 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:12.437851 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d181fc67-12e2-4f46-b9c2-32da26a25661 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:12.438604 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d181fc67-12e2-4f46-b9c2-32da26a25661 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:12.439387 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d181fc67-12e2-4f46-b9c2-32da26a25661 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:12.539312 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d181fc67-12e2-4f46-b9c2-32da26a25661 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2c4d9c50fe4c08b3619994e94470c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14c7253bf944819d3b6e203ea4b9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:12.542812 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:12.553919 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d181fc67-12e2-4f46-b9c2-32da26a25661 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] 10.222.0.39 "GET /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2" status: 200 len: 1285 microversion: 2.1 time: 0.134627 Aug 07 01:31:12.557831 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2281/4222] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:12 2022] GET /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2 => generated 1285 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:12.574383 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f2f0240c-05e3-47e9-894e-5dd08a7c41e2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f2f0240c-05e3-47e9-894e-5dd08a7c41e2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: request: PUT /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 HTTP/1.1 Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 24 Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: {"server": {"name": ""}} Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'd9b1883a-c95a-4c49-ad6d-335ecf03b015', 'body': {'server': {'name': ''}}} Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi '' Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:31:12.581560 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:31:12.585912 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 07 01:31:12.585912 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:12.585912 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:12.585912 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:12.585912 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:12.585912 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:12.585912 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:12.585912 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:31:12.585912 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:31:12.585912 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 07 01:31:12.585912 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:12.590060 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f2f0240c-05e3-47e9-894e-5dd08a7c41e2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:31:12.591181 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f2f0240c-05e3-47e9-894e-5dd08a7c41e2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "PUT /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 400 len: 108 microversion: 2.1 time: 0.032073 Aug 07 01:31:12.595713 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2282/4223] 10.222.0.39 () {60 vars in 1256 bytes} [Sun Aug 7 01:31:12 2022] PUT /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 108 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:31:12.604274 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c355b1a2-f7d4-48e2-bb8d-5fb3fe647a96 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:12.611781 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c355b1a2-f7d4-48e2-bb8d-5fb3fe647a96 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:12.613057 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c355b1a2-f7d4-48e2-bb8d-5fb3fe647a96 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '5f88662ebb674ad99a4d36651dee967a'} {{(pid=119516) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:31:12.627251 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c355b1a2-f7d4-48e2-bb8d-5fb3fe647a96 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:12.628256 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c355b1a2-f7d4-48e2-bb8d-5fb3fe647a96 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:12.629312 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c355b1a2-f7d4-48e2-bb8d-5fb3fe647a96 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:12.631004 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c355b1a2-f7d4-48e2-bb8d-5fb3fe647a96 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:12.631702 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c355b1a2-f7d4-48e2-bb8d-5fb3fe647a96 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:12.632394 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c355b1a2-f7d4-48e2-bb8d-5fb3fe647a96 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:12.789004 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.multi_cell_list [None req-c355b1a2-f7d4-48e2-bb8d-5fb3fe647a96 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 01:31:12.798339 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-75066cef-9a21-4194-a9f4-551b04ec1973 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:12.811490 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-75066cef-9a21-4194-a9f4-551b04ec1973 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84" status: 200 len: 1314 microversion: 2.1 time: 0.433609 Aug 07 01:31:12.813922 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1942/4224] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:12 2022] GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84 => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:12.825075 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-00de4303-278b-4806-ae10-4dc2e6506d16 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:12.826078 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-00de4303-278b-4806-ae10-4dc2e6506d16 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:12.847345 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00de4303-278b-4806-ae10-4dc2e6506d16 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:12.850286 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00de4303-278b-4806-ae10-4dc2e6506d16 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:12.852385 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00de4303-278b-4806-ae10-4dc2e6506d16 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:12.854169 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00de4303-278b-4806-ae10-4dc2e6506d16 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:12.855738 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00de4303-278b-4806-ae10-4dc2e6506d16 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:12.858566 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00de4303-278b-4806-ae10-4dc2e6506d16 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:12.955444 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c355b1a2-f7d4-48e2-bb8d-5fb3fe647a96 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.357602 Aug 07 01:31:12.963376 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2283/4225] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:31:12 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:12.977555 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-93ef38f7-aa9c-4b74-a6cf-366b8ea452ef tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:12.982895 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-93ef38f7-aa9c-4b74-a6cf-366b8ea452ef tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:12.985918 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.compute.servers [None req-93ef38f7-aa9c-4b74-a6cf-366b8ea452ef tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Removing options 'limit' from query {{(pid=119516) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 07 01:31:12.988624 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-93ef38f7-aa9c-4b74-a6cf-366b8ea452ef tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Searching by: {'deleted': False, 'project_id': '5f88662ebb674ad99a4d36651dee967a'} {{(pid=119516) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:31:13.007318 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93ef38f7-aa9c-4b74-a6cf-366b8ea452ef tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:13.007809 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93ef38f7-aa9c-4b74-a6cf-366b8ea452ef tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:13.008290 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93ef38f7-aa9c-4b74-a6cf-366b8ea452ef tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:13.009200 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93ef38f7-aa9c-4b74-a6cf-366b8ea452ef tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:13.009482 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93ef38f7-aa9c-4b74-a6cf-366b8ea452ef tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:13.009925 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93ef38f7-aa9c-4b74-a6cf-366b8ea452ef tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:13.092504 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-93ef38f7-aa9c-4b74-a6cf-366b8ea452ef tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.119775 Aug 07 01:31:13.094259 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2284/4226] 10.222.0.39 () {58 vars in 1140 bytes} [Sun Aug 7 01:31:12 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:13.110498 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0275456f-b14b-446c-b3f7-d7a04499ab55 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:13.111552 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0275456f-b14b-446c-b3f7-d7a04499ab55 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:13.121011 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0275456f-b14b-446c-b3f7-d7a04499ab55 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:13.123108 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0275456f-b14b-446c-b3f7-d7a04499ab55 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:13.124096 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0275456f-b14b-446c-b3f7-d7a04499ab55 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:13.128693 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0275456f-b14b-446c-b3f7-d7a04499ab55 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:13.130779 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0275456f-b14b-446c-b3f7-d7a04499ab55 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:13.131841 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0275456f-b14b-446c-b3f7-d7a04499ab55 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:13.350056 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-00de4303-278b-4806-ae10-4dc2e6506d16 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:13.363441 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-00de4303-278b-4806-ae10-4dc2e6506d16 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1506 microversion: 2.1 time: 0.548080 Aug 07 01:31:13.365552 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1943/4227] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:12 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1506 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:13.374353 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0fd35c5e-5856-4652-be69-2693c88b7470 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:13.391959 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0fd35c5e-5856-4652-be69-2693c88b7470 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:13.392723 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0fd35c5e-5856-4652-be69-2693c88b7470 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1928549615', 'deleted': False, 'project_id': '5f88662ebb674ad99a4d36651dee967a'} {{(pid=119517) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:31:13.408330 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0fd35c5e-5856-4652-be69-2693c88b7470 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:13.408827 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0fd35c5e-5856-4652-be69-2693c88b7470 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:13.409587 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0fd35c5e-5856-4652-be69-2693c88b7470 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:13.410010 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0fd35c5e-5856-4652-be69-2693c88b7470 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:13.410471 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0fd35c5e-5856-4652-be69-2693c88b7470 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:13.410934 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0fd35c5e-5856-4652-be69-2693c88b7470 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:13.444033 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0275456f-b14b-446c-b3f7-d7a04499ab55 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:13.461802 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0275456f-b14b-446c-b3f7-d7a04499ab55 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 200 len: 1315 microversion: 2.1 time: 0.366089 Aug 07 01:31:13.463856 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2285/4228] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:13 2022] GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:13.584342 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ce47ba14-5de9-4870-b021-d6bd01dd8f29 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:13.584990 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ce47ba14-5de9-4870-b021-d6bd01dd8f29 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] [instance: da55749a-1b96-4341-a947-9062b0d33eb2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:13.593888 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce47ba14-5de9-4870-b021-d6bd01dd8f29 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:13.596677 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.multi_cell_list [None req-0fd35c5e-5856-4652-be69-2693c88b7470 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 01:31:13.600680 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce47ba14-5de9-4870-b021-d6bd01dd8f29 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:13.601056 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce47ba14-5de9-4870-b021-d6bd01dd8f29 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:13.601850 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce47ba14-5de9-4870-b021-d6bd01dd8f29 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:13.602276 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce47ba14-5de9-4870-b021-d6bd01dd8f29 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:13.602701 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce47ba14-5de9-4870-b021-d6bd01dd8f29 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:13.730412 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0fd35c5e-5856-4652-be69-2693c88b7470 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1928549615" status: 200 len: 346 microversion: 2.1 time: 0.361608 Aug 07 01:31:13.731015 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1944/4229] 10.222.0.39 () {58 vars in 1242 bytes} [Sun Aug 7 01:31:13 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1928549615 => generated 346 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:13.745490 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-23e7394b-09d1-462d-ab13-fd3e3f89b643 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:13.757142 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23e7394b-09d1-462d-ab13-fd3e3f89b643 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:13.757903 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23e7394b-09d1-462d-ab13-fd3e3f89b643 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:13.758505 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23e7394b-09d1-462d-ab13-fd3e3f89b643 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:13.765857 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:13.818094 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-23e7394b-09d1-462d-ab13-fd3e3f89b643 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 425b6340-2984-4339-9728-2914b55bd418] Going to try to stop instance {{(pid=119517) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 07 01:31:13.912772 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-23e7394b-09d1-462d-ab13-fd3e3f89b643 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "POST /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418/action" status: 202 len: 0 microversion: 2.1 time: 0.171358 Aug 07 01:31:13.913714 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1945/4230] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:31:13 2022] POST /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:31:13.925442 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a4f8153e-6c41-4c0d-9478-0f7b6384b13c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:13.929237 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a4f8153e-6c41-4c0d-9478-0f7b6384b13c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: f6b31167-8c76-4749-88b4-d8380d9b9a84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:13.944915 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4f8153e-6c41-4c0d-9478-0f7b6384b13c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:13.945799 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4f8153e-6c41-4c0d-9478-0f7b6384b13c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:13.949261 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4f8153e-6c41-4c0d-9478-0f7b6384b13c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:13.950395 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4f8153e-6c41-4c0d-9478-0f7b6384b13c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:13.951030 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4f8153e-6c41-4c0d-9478-0f7b6384b13c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:13.951621 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4f8153e-6c41-4c0d-9478-0f7b6384b13c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:13.955839 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ce47ba14-5de9-4870-b021-d6bd01dd8f29 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2c4d9c50fe4c08b3619994e94470c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14c7253bf944819d3b6e203ea4b9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:13.977485 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ce47ba14-5de9-4870-b021-d6bd01dd8f29 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] 10.222.0.39 "GET /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2" status: 200 len: 1327 microversion: 2.1 time: 0.394595 Aug 07 01:31:13.979436 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2286/4231] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:13 2022] GET /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2 => generated 1327 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:31:14.003026 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f7224338-9675-4f34-9f8b-4c75f0565e58 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:14.011205 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f7224338-9675-4f34-9f8b-4c75f0565e58 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 425b6340-2984-4339-9728-2914b55bd418] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:14.019832 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f7224338-9675-4f34-9f8b-4c75f0565e58 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:14.021021 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f7224338-9675-4f34-9f8b-4c75f0565e58 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:14.021678 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f7224338-9675-4f34-9f8b-4c75f0565e58 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:14.022895 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f7224338-9675-4f34-9f8b-4c75f0565e58 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:14.024000 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f7224338-9675-4f34-9f8b-4c75f0565e58 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:14.024937 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f7224338-9675-4f34-9f8b-4c75f0565e58 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:14.402361 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a4f8153e-6c41-4c0d-9478-0f7b6384b13c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:14.412663 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a4f8153e-6c41-4c0d-9478-0f7b6384b13c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84" status: 200 len: 1314 microversion: 2.1 time: 0.497665 Aug 07 01:31:14.417025 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1946/4232] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:13 2022] GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84 => generated 1314 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:14.482694 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ee4a274d-0e0b-4b9a-889f-63f4d9dfde8d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:14.488116 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ee4a274d-0e0b-4b9a-889f-63f4d9dfde8d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:14.508634 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee4a274d-0e0b-4b9a-889f-63f4d9dfde8d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:14.508634 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee4a274d-0e0b-4b9a-889f-63f4d9dfde8d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:14.508634 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee4a274d-0e0b-4b9a-889f-63f4d9dfde8d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:14.509370 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee4a274d-0e0b-4b9a-889f-63f4d9dfde8d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:14.509830 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee4a274d-0e0b-4b9a-889f-63f4d9dfde8d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:14.510261 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee4a274d-0e0b-4b9a-889f-63f4d9dfde8d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:14.581641 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f7224338-9675-4f34-9f8b-4c75f0565e58 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:14.594425 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f7224338-9675-4f34-9f8b-4c75f0565e58 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418" status: 200 len: 1523 microversion: 2.1 time: 0.609147 Aug 07 01:31:14.595283 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2287/4233] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:13 2022] GET /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418 => generated 1523 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:14.915819 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ee4a274d-0e0b-4b9a-889f-63f4d9dfde8d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:14.925557 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-2050b239-a04b-4f5f-9671-3da59535baed req-117de49e-5cca-4e02-bee5-338ed1f06d49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da55749a-1b96-4341-a947-9062b0d33eb2", "tag": "ff9b5ea2-bd6c-4b45-a67e-5fc180b46ce3"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:14.943321 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ee4a274d-0e0b-4b9a-889f-63f4d9dfde8d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 200 len: 1315 microversion: 2.1 time: 0.464392 Aug 07 01:31:14.949832 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1947/4234] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:14 2022] GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:31:14.955244 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2050b239-a04b-4f5f-9671-3da59535baed req-117de49e-5cca-4e02-bee5-338ed1f06d49 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:14.955748 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2050b239-a04b-4f5f-9671-3da59535baed req-117de49e-5cca-4e02-bee5-338ed1f06d49 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:14.956978 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2050b239-a04b-4f5f-9671-3da59535baed req-117de49e-5cca-4e02-bee5-338ed1f06d49 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:14.974539 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-2050b239-a04b-4f5f-9671-3da59535baed req-117de49e-5cca-4e02-bee5-338ed1f06d49 service nova] Creating event network-changed:ff9b5ea2-bd6c-4b45-a67e-5fc180b46ce3 for instance da55749a-1b96-4341-a947-9062b0d33eb2 on n-h1-master-1 Aug 07 01:31:14.980936 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-2050b239-a04b-4f5f-9671-3da59535baed req-117de49e-5cca-4e02-bee5-338ed1f06d49 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078826 Aug 07 01:31:14.997043 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2288/4235] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:15.001746 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e701528b-ac26-4386-8f41-ed202353e04b tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:15.002600 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e701528b-ac26-4386-8f41-ed202353e04b tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] [instance: da55749a-1b96-4341-a947-9062b0d33eb2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:15.011496 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e701528b-ac26-4386-8f41-ed202353e04b tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:15.013333 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e701528b-ac26-4386-8f41-ed202353e04b tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:15.014254 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e701528b-ac26-4386-8f41-ed202353e04b tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:15.015524 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e701528b-ac26-4386-8f41-ed202353e04b tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:15.016501 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e701528b-ac26-4386-8f41-ed202353e04b tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:15.017945 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e701528b-ac26-4386-8f41-ed202353e04b tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:15.354531 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e701528b-ac26-4386-8f41-ed202353e04b tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2c4d9c50fe4c08b3619994e94470c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14c7253bf944819d3b6e203ea4b9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:15.356774 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-de06ba71-74a1-4679-901e-dfe3d88c4400 req-277200a7-6e29-4670-b4e3-67bf45209817 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6b31167-8c76-4749-88b4-d8380d9b9a84", "name": "network-vif-plugged", "status": "completed", "tag": "4ce61a79-bcb4-4377-8c9e-966c9c1e1752"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:15.365185 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e701528b-ac26-4386-8f41-ed202353e04b tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] 10.222.0.39 "GET /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2" status: 200 len: 1327 microversion: 2.1 time: 0.369983 Aug 07 01:31:15.366155 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1948/4236] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:14 2022] GET /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2 => generated 1327 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:15.390553 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-de06ba71-74a1-4679-901e-dfe3d88c4400 req-277200a7-6e29-4670-b4e3-67bf45209817 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:15.391043 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-de06ba71-74a1-4679-901e-dfe3d88c4400 req-277200a7-6e29-4670-b4e3-67bf45209817 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:15.391500 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-de06ba71-74a1-4679-901e-dfe3d88c4400 req-277200a7-6e29-4670-b4e3-67bf45209817 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:15.428531 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-de06ba71-74a1-4679-901e-dfe3d88c4400 req-277200a7-6e29-4670-b4e3-67bf45209817 service nova] Creating event network-vif-plugged:4ce61a79-bcb4-4377-8c9e-966c9c1e1752 for instance f6b31167-8c76-4749-88b4-d8380d9b9a84 on n-h2-master-1 Aug 07 01:31:15.439375 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-de06ba71-74a1-4679-901e-dfe3d88c4400 req-277200a7-6e29-4670-b4e3-67bf45209817 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087034 Aug 07 01:31:15.440054 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fc00faff-7e74-42c2-9125-35debebef7bc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:15.440679 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fc00faff-7e74-42c2-9125-35debebef7bc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: f6b31167-8c76-4749-88b4-d8380d9b9a84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:15.441314 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2289/4237] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:31:15.452058 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fc00faff-7e74-42c2-9125-35debebef7bc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:15.452839 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fc00faff-7e74-42c2-9125-35debebef7bc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:15.453712 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fc00faff-7e74-42c2-9125-35debebef7bc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:15.454806 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fc00faff-7e74-42c2-9125-35debebef7bc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:15.455484 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fc00faff-7e74-42c2-9125-35debebef7bc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:15.458129 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fc00faff-7e74-42c2-9125-35debebef7bc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:15.620396 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4bfab5f8-4c78-42c6-9691-fca034834bbc tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:15.621748 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4bfab5f8-4c78-42c6-9691-fca034834bbc tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 425b6340-2984-4339-9728-2914b55bd418] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:15.633712 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4bfab5f8-4c78-42c6-9691-fca034834bbc tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:15.634210 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4bfab5f8-4c78-42c6-9691-fca034834bbc tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:15.634647 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4bfab5f8-4c78-42c6-9691-fca034834bbc tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:15.635356 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4bfab5f8-4c78-42c6-9691-fca034834bbc tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:15.635805 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4bfab5f8-4c78-42c6-9691-fca034834bbc tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:15.640657 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4bfab5f8-4c78-42c6-9691-fca034834bbc tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:15.901270 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fc00faff-7e74-42c2-9125-35debebef7bc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:15.913733 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fc00faff-7e74-42c2-9125-35debebef7bc tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84" status: 200 len: 1314 microversion: 2.1 time: 0.479813 Aug 07 01:31:15.914970 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1949/4238] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:15 2022] GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84 => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:31:15.971391 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e635b492-337f-4c06-9643-5043702b9947 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:15.972096 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e635b492-337f-4c06-9643-5043702b9947 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:15.997081 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e635b492-337f-4c06-9643-5043702b9947 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:15.997850 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e635b492-337f-4c06-9643-5043702b9947 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:15.998574 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e635b492-337f-4c06-9643-5043702b9947 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:15.999598 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e635b492-337f-4c06-9643-5043702b9947 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:16.000381 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e635b492-337f-4c06-9643-5043702b9947 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:16.001155 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e635b492-337f-4c06-9643-5043702b9947 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:16.252045 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e635b492-337f-4c06-9643-5043702b9947 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:16.267613 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e635b492-337f-4c06-9643-5043702b9947 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 200 len: 1501 microversion: 2.1 time: 0.306532 Aug 07 01:31:16.281070 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1950/4239] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:15 2022] GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 1501 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:16.443757 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e5a9fc4f-26b0-4d5b-924d-f9c080c9c50f tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:16.445285 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e5a9fc4f-26b0-4d5b-924d-f9c080c9c50f tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:16.454299 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e5a9fc4f-26b0-4d5b-924d-f9c080c9c50f tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:16.455176 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e5a9fc4f-26b0-4d5b-924d-f9c080c9c50f tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:16.455776 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e5a9fc4f-26b0-4d5b-924d-f9c080c9c50f tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:16.456714 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e5a9fc4f-26b0-4d5b-924d-f9c080c9c50f tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:16.457475 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e5a9fc4f-26b0-4d5b-924d-f9c080c9c50f tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:16.458618 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e5a9fc4f-26b0-4d5b-924d-f9c080c9c50f tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:16.501096 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e5a9fc4f-26b0-4d5b-924d-f9c080c9c50f tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:31:16.579121 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4bfab5f8-4c78-42c6-9691-fca034834bbc tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:16.591774 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4bfab5f8-4c78-42c6-9691-fca034834bbc tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418" status: 200 len: 1523 microversion: 2.1 time: 0.975320 Aug 07 01:31:16.594863 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2290/4240] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:15 2022] GET /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418 => generated 1523 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:16.601432 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6833489e-bdc0-4081-99d5-9214e922a8c3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:16.602337 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6833489e-bdc0-4081-99d5-9214e922a8c3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:16.610530 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6833489e-bdc0-4081-99d5-9214e922a8c3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:16.611905 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6833489e-bdc0-4081-99d5-9214e922a8c3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:16.624862 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6833489e-bdc0-4081-99d5-9214e922a8c3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:16.629557 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6833489e-bdc0-4081-99d5-9214e922a8c3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:16.631461 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6833489e-bdc0-4081-99d5-9214e922a8c3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:16.633646 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6833489e-bdc0-4081-99d5-9214e922a8c3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:16.662559 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e5a9fc4f-26b0-4d5b-924d-f9c080c9c50f tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "DELETE /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 204 len: 0 microversion: 2.32 time: 0.380091 Aug 07 01:31:16.664019 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1951/4241] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Aug 7 01:31:16 2022] DELETE /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 01:31:16.670020 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bcf4f3c9-c757-4847-8dc0-bca8bb9a679c tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:16.670987 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bcf4f3c9-c757-4847-8dc0-bca8bb9a679c tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] [instance: da55749a-1b96-4341-a947-9062b0d33eb2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:16.678717 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bcf4f3c9-c757-4847-8dc0-bca8bb9a679c tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:16.680810 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bcf4f3c9-c757-4847-8dc0-bca8bb9a679c tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:16.681652 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bcf4f3c9-c757-4847-8dc0-bca8bb9a679c tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:16.682870 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bcf4f3c9-c757-4847-8dc0-bca8bb9a679c tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:16.684708 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bcf4f3c9-c757-4847-8dc0-bca8bb9a679c tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:16.685625 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bcf4f3c9-c757-4847-8dc0-bca8bb9a679c tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:16.803564 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6833489e-bdc0-4081-99d5-9214e922a8c3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219/action" status: 202 len: 0 microversion: 2.1 time: 0.204016 Aug 07 01:31:16.804273 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2291/4242] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:31:16 2022] POST /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:31:16.824579 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9bd7814d-d4c3-431f-8023-305516930e77 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:16.827150 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9bd7814d-d4c3-431f-8023-305516930e77 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:16.842377 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9bd7814d-d4c3-431f-8023-305516930e77 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:16.846443 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9bd7814d-d4c3-431f-8023-305516930e77 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:16.847182 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9bd7814d-d4c3-431f-8023-305516930e77 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:16.849807 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9bd7814d-d4c3-431f-8023-305516930e77 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:16.851745 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9bd7814d-d4c3-431f-8023-305516930e77 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:16.853899 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9bd7814d-d4c3-431f-8023-305516930e77 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:16.887525 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bcf4f3c9-c757-4847-8dc0-bca8bb9a679c tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2c4d9c50fe4c08b3619994e94470c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14c7253bf944819d3b6e203ea4b9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:16.900305 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bcf4f3c9-c757-4847-8dc0-bca8bb9a679c tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] 10.222.0.39 "GET /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2" status: 200 len: 1327 microversion: 2.1 time: 0.234648 Aug 07 01:31:16.900918 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1952/4243] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:16 2022] GET /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2 => generated 1327 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:16.928200 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ae54d815-98b8-44a9-83d9-5463495417ca tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:16.929138 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ae54d815-98b8-44a9-83d9-5463495417ca tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:16.941614 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ae54d815-98b8-44a9-83d9-5463495417ca tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:16.944719 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ae54d815-98b8-44a9-83d9-5463495417ca tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:16.946581 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ae54d815-98b8-44a9-83d9-5463495417ca tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:16.947533 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ae54d815-98b8-44a9-83d9-5463495417ca tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:16.950769 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ae54d815-98b8-44a9-83d9-5463495417ca tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:16.951430 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ae54d815-98b8-44a9-83d9-5463495417ca tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:17.246087 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ae54d815-98b8-44a9-83d9-5463495417ca tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:17.258424 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ae54d815-98b8-44a9-83d9-5463495417ca tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 200 len: 1506 microversion: 2.1 time: 0.342070 Aug 07 01:31:17.273005 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1953/4244] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:16 2022] GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 1506 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:17.273005 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-327c5561-930d-402f-9317-c835d62746a4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:17.273005 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-327c5561-930d-402f-9317-c835d62746a4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: f6b31167-8c76-4749-88b4-d8380d9b9a84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:17.273329 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-327c5561-930d-402f-9317-c835d62746a4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:17.273603 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-327c5561-930d-402f-9317-c835d62746a4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:17.274065 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-327c5561-930d-402f-9317-c835d62746a4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:17.275413 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-327c5561-930d-402f-9317-c835d62746a4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:17.278826 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-327c5561-930d-402f-9317-c835d62746a4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:17.279286 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-327c5561-930d-402f-9317-c835d62746a4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:17.616518 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-327c5561-930d-402f-9317-c835d62746a4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:17.626982 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-327c5561-930d-402f-9317-c835d62746a4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84" status: 200 len: 1314 microversion: 2.1 time: 0.364978 Aug 07 01:31:17.627973 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1954/4245] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:17 2022] GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84 => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:17.633062 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7641b57b-e160-482c-b874-5775e837d699 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:17.633895 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7641b57b-e160-482c-b874-5775e837d699 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 425b6340-2984-4339-9728-2914b55bd418] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:17.642828 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7641b57b-e160-482c-b874-5775e837d699 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:17.643706 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7641b57b-e160-482c-b874-5775e837d699 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:17.644342 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7641b57b-e160-482c-b874-5775e837d699 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:17.646780 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7641b57b-e160-482c-b874-5775e837d699 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:17.647429 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7641b57b-e160-482c-b874-5775e837d699 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:17.647978 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7641b57b-e160-482c-b874-5775e837d699 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:17.728806 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9bd7814d-d4c3-431f-8023-305516930e77 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:17.743848 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9bd7814d-d4c3-431f-8023-305516930e77 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:17.748604 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9bd7814d-d4c3-431f-8023-305516930e77 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:17.751451 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9bd7814d-d4c3-431f-8023-305516930e77 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 2945 microversion: 2.32 time: 0.940191 Aug 07 01:31:17.756395 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2292/4246] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:31:16 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 2945 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:31:17.890916 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7641b57b-e160-482c-b874-5775e837d699 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:17.899313 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7641b57b-e160-482c-b874-5775e837d699 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418" status: 200 len: 1523 microversion: 2.1 time: 0.270071 Aug 07 01:31:17.901293 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1955/4247] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:17 2022] GET /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418 => generated 1523 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:17.926884 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dcf45611-ac46-4f11-a8c2-6efe74d43fd2 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:17.928435 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-dcf45611-ac46-4f11-a8c2-6efe74d43fd2 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] [instance: da55749a-1b96-4341-a947-9062b0d33eb2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:17.937169 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dcf45611-ac46-4f11-a8c2-6efe74d43fd2 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:17.937891 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dcf45611-ac46-4f11-a8c2-6efe74d43fd2 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:17.938494 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dcf45611-ac46-4f11-a8c2-6efe74d43fd2 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:17.939499 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dcf45611-ac46-4f11-a8c2-6efe74d43fd2 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:17.940162 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dcf45611-ac46-4f11-a8c2-6efe74d43fd2 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:17.940743 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dcf45611-ac46-4f11-a8c2-6efe74d43fd2 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:18.283034 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f5777f7b-2ed0-4ab5-9e4e-587d35c16e9a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:18.283672 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f5777f7b-2ed0-4ab5-9e4e-587d35c16e9a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:18.304319 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f5777f7b-2ed0-4ab5-9e4e-587d35c16e9a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:18.305160 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f5777f7b-2ed0-4ab5-9e4e-587d35c16e9a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:18.305792 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f5777f7b-2ed0-4ab5-9e4e-587d35c16e9a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:18.306925 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f5777f7b-2ed0-4ab5-9e4e-587d35c16e9a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:18.311597 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f5777f7b-2ed0-4ab5-9e4e-587d35c16e9a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:18.312377 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f5777f7b-2ed0-4ab5-9e4e-587d35c16e9a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:18.376278 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-dcf45611-ac46-4f11-a8c2-6efe74d43fd2 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2c4d9c50fe4c08b3619994e94470c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14c7253bf944819d3b6e203ea4b9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:18.388578 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-dcf45611-ac46-4f11-a8c2-6efe74d43fd2 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] 10.222.0.39 "GET /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2" status: 200 len: 1327 microversion: 2.1 time: 0.466303 Aug 07 01:31:18.389816 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2293/4248] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:17 2022] GET /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2 => generated 1327 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:18.571191 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f5777f7b-2ed0-4ab5-9e4e-587d35c16e9a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:18.589132 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f5777f7b-2ed0-4ab5-9e4e-587d35c16e9a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 200 len: 1506 microversion: 2.1 time: 0.312173 Aug 07 01:31:18.592077 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1956/4249] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:18 2022] GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 1506 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:18.650821 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d20f824e-c9ba-48ad-94d5-bba95ba48dfa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:18.652585 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d20f824e-c9ba-48ad-94d5-bba95ba48dfa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: f6b31167-8c76-4749-88b4-d8380d9b9a84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:18.662754 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:18.664870 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d20f824e-c9ba-48ad-94d5-bba95ba48dfa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:18.667211 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d20f824e-c9ba-48ad-94d5-bba95ba48dfa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:18.668803 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d20f824e-c9ba-48ad-94d5-bba95ba48dfa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:18.670285 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d20f824e-c9ba-48ad-94d5-bba95ba48dfa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:18.671002 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d20f824e-c9ba-48ad-94d5-bba95ba48dfa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:18.671669 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d20f824e-c9ba-48ad-94d5-bba95ba48dfa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:18.781946 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2b98cca0-a367-4128-8459-6335fd6388c0 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:18.783554 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2b98cca0-a367-4128-8459-6335fd6388c0 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:18.793053 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b98cca0-a367-4128-8459-6335fd6388c0 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:18.794062 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b98cca0-a367-4128-8459-6335fd6388c0 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:18.794749 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b98cca0-a367-4128-8459-6335fd6388c0 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:18.795740 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b98cca0-a367-4128-8459-6335fd6388c0 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:18.796576 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b98cca0-a367-4128-8459-6335fd6388c0 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:18.797244 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b98cca0-a367-4128-8459-6335fd6388c0 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:18.959481 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d20f824e-c9ba-48ad-94d5-bba95ba48dfa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:18.985924 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d20f824e-c9ba-48ad-94d5-bba95ba48dfa tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84" status: 200 len: 1502 microversion: 2.1 time: 0.341746 Aug 07 01:31:19.003001 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2294/4250] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:18 2022] GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84 => generated 1502 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:19.011530 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9a104620-fd14-49d9-99ad-821e5addcd1f tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:19.012659 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9a104620-fd14-49d9-99ad-821e5addcd1f tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 425b6340-2984-4339-9728-2914b55bd418] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:19.022081 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9a104620-fd14-49d9-99ad-821e5addcd1f tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:19.022954 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9a104620-fd14-49d9-99ad-821e5addcd1f tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:19.023564 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9a104620-fd14-49d9-99ad-821e5addcd1f tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:19.025213 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9a104620-fd14-49d9-99ad-821e5addcd1f tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:19.025902 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9a104620-fd14-49d9-99ad-821e5addcd1f tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:19.026487 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9a104620-fd14-49d9-99ad-821e5addcd1f tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:19.063013 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2b98cca0-a367-4128-8459-6335fd6388c0 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:19.076315 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2b98cca0-a367-4128-8459-6335fd6388c0 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:19.078309 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2b98cca0-a367-4128-8459-6335fd6388c0 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:19.083352 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2b98cca0-a367-4128-8459-6335fd6388c0 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 2945 microversion: 2.32 time: 0.304687 Aug 07 01:31:19.086818 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1957/4251] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:31:18 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 2945 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:31:19.109579 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f6972a7d-37ea-40f2-b0ee-787c8c3e87ec tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:19.110956 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f6972a7d-37ea-40f2-b0ee-787c8c3e87ec tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: f6b31167-8c76-4749-88b4-d8380d9b9a84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:19.120044 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f6972a7d-37ea-40f2-b0ee-787c8c3e87ec tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:19.120601 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f6972a7d-37ea-40f2-b0ee-787c8c3e87ec tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:19.121060 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f6972a7d-37ea-40f2-b0ee-787c8c3e87ec tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:19.121855 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f6972a7d-37ea-40f2-b0ee-787c8c3e87ec tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:19.122445 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f6972a7d-37ea-40f2-b0ee-787c8c3e87ec tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:19.123064 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f6972a7d-37ea-40f2-b0ee-787c8c3e87ec tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:19.156651 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-f6972a7d-37ea-40f2-b0ee-787c8c3e87ec tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lazy-loading 'flavor' on Instance uuid f6b31167-8c76-4749-88b4-d8380d9b9a84 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:31:19.184078 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:19.264720 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f6972a7d-37ea-40f2-b0ee-787c8c3e87ec tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "POST /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84/action" status: 202 len: 0 microversion: 2.1 time: 0.177228 Aug 07 01:31:19.266125 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1958/4252] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:31:19 2022] POST /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:31:19.292119 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9a104620-fd14-49d9-99ad-821e5addcd1f tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:19.298140 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-322f0791-ed86-40d7-a1d2-ae09714171c5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:19.299453 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-322f0791-ed86-40d7-a1d2-ae09714171c5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: f6b31167-8c76-4749-88b4-d8380d9b9a84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:19.311775 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-322f0791-ed86-40d7-a1d2-ae09714171c5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:19.312109 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-322f0791-ed86-40d7-a1d2-ae09714171c5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:19.312478 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-322f0791-ed86-40d7-a1d2-ae09714171c5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:19.313203 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-322f0791-ed86-40d7-a1d2-ae09714171c5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:19.313402 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9a104620-fd14-49d9-99ad-821e5addcd1f tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418" status: 200 len: 1523 microversion: 2.1 time: 0.308436 Aug 07 01:31:19.313675 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-322f0791-ed86-40d7-a1d2-ae09714171c5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:19.314607 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-322f0791-ed86-40d7-a1d2-ae09714171c5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:19.344433 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2295/4253] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:19 2022] GET /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418 => generated 1523 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:19.413535 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2430fa8c-6418-4e45-9cc4-2cd2a93f8ce6 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:19.414191 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2430fa8c-6418-4e45-9cc4-2cd2a93f8ce6 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] [instance: da55749a-1b96-4341-a947-9062b0d33eb2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:19.422455 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2430fa8c-6418-4e45-9cc4-2cd2a93f8ce6 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:19.422958 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2430fa8c-6418-4e45-9cc4-2cd2a93f8ce6 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:19.423402 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2430fa8c-6418-4e45-9cc4-2cd2a93f8ce6 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:19.424163 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2430fa8c-6418-4e45-9cc4-2cd2a93f8ce6 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:19.424839 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2430fa8c-6418-4e45-9cc4-2cd2a93f8ce6 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:19.425571 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2430fa8c-6418-4e45-9cc4-2cd2a93f8ce6 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:19.516400 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-322f0791-ed86-40d7-a1d2-ae09714171c5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:19.524991 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-322f0791-ed86-40d7-a1d2-ae09714171c5 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84" status: 200 len: 1510 microversion: 2.1 time: 0.241466 Aug 07 01:31:19.526210 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1959/4254] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:19 2022] GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84 => generated 1510 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:19.619575 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fb94e0cb-5c39-4eea-83fd-29f84f8f5c02 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:19.620972 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fb94e0cb-5c39-4eea-83fd-29f84f8f5c02 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:19.628740 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb94e0cb-5c39-4eea-83fd-29f84f8f5c02 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:19.630015 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb94e0cb-5c39-4eea-83fd-29f84f8f5c02 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:19.631841 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb94e0cb-5c39-4eea-83fd-29f84f8f5c02 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:19.632864 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb94e0cb-5c39-4eea-83fd-29f84f8f5c02 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:19.634002 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb94e0cb-5c39-4eea-83fd-29f84f8f5c02 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:19.634887 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb94e0cb-5c39-4eea-83fd-29f84f8f5c02 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:19.750285 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=16 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:19.806669 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2430fa8c-6418-4e45-9cc4-2cd2a93f8ce6 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2c4d9c50fe4c08b3619994e94470c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14c7253bf944819d3b6e203ea4b9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:19.835632 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2430fa8c-6418-4e45-9cc4-2cd2a93f8ce6 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] 10.222.0.39 "GET /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2" status: 200 len: 1327 microversion: 2.1 time: 0.425094 Aug 07 01:31:19.837155 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2296/4255] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:19 2022] GET /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2 => generated 1327 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:31:20.058405 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fb94e0cb-5c39-4eea-83fd-29f84f8f5c02 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:20.068678 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fb94e0cb-5c39-4eea-83fd-29f84f8f5c02 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 200 len: 1506 microversion: 2.1 time: 0.457089 Aug 07 01:31:20.069952 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1960/4256] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:19 2022] GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 1506 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:20.121062 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d17dba86-7f3b-48fd-9f1d-16b999992197 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:20.122858 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d17dba86-7f3b-48fd-9f1d-16b999992197 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:20.138302 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d17dba86-7f3b-48fd-9f1d-16b999992197 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:20.138858 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d17dba86-7f3b-48fd-9f1d-16b999992197 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:20.139309 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d17dba86-7f3b-48fd-9f1d-16b999992197 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:20.141212 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d17dba86-7f3b-48fd-9f1d-16b999992197 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:20.141827 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d17dba86-7f3b-48fd-9f1d-16b999992197 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:20.142136 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d17dba86-7f3b-48fd-9f1d-16b999992197 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:20.314759 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cf469795-f08d-447b-a987-659dc004b945 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:20.315685 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-cf469795-f08d-447b-a987-659dc004b945 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 19784b1a-63aa-44b2-bbd5-d8dda713efdd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:20.330655 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cf469795-f08d-447b-a987-659dc004b945 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:20.331272 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cf469795-f08d-447b-a987-659dc004b945 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:20.331720 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cf469795-f08d-447b-a987-659dc004b945 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:20.332620 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cf469795-f08d-447b-a987-659dc004b945 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:20.333246 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cf469795-f08d-447b-a987-659dc004b945 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:20.333709 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cf469795-f08d-447b-a987-659dc004b945 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:20.354746 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-cf469795-f08d-447b-a987-659dc004b945 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] HTTP exception thrown: Instance 19784b1a-63aa-44b2-bbd5-d8dda713efdd could not be found. Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cf469795-f08d-447b-a987-659dc004b945 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd HTTP/1.1 Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 19784b1a-63aa-44b2-bbd5-d8dda713efdd could not be found. Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '19784b1a-63aa-44b2-bbd5-d8dda713efdd'} Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19784b1a-63aa-44b2-bbd5-d8dda713efdd could not be found. Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:31:20.357642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:31:20.361066 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19784b1a-63aa-44b2-bbd5-d8dda713efdd could not be found. Aug 07 01:31:20.361066 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:20.361066 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:20.361066 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:20.361066 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:20.361066 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:20.361066 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:20.361066 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:31:20.361066 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:31:20.361066 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19784b1a-63aa-44b2-bbd5-d8dda713efdd could not be found. Aug 07 01:31:20.361066 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:20.361066 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cf469795-f08d-447b-a987-659dc004b945 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 404 to user: Instance 19784b1a-63aa-44b2-bbd5-d8dda713efdd could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:31:20.361066 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cf469795-f08d-447b-a987-659dc004b945 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "DELETE /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd" status: 404 len: 111 microversion: 2.1 time: 0.049028 Aug 07 01:31:20.363278 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1961/4257] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:31:20 2022] DELETE /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:31:20.369412 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d84d6536-300b-4f20-a226-e6c953539087 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:20.370363 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d84d6536-300b-4f20-a226-e6c953539087 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 425b6340-2984-4339-9728-2914b55bd418] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:20.376655 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d84d6536-300b-4f20-a226-e6c953539087 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:20.377254 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d84d6536-300b-4f20-a226-e6c953539087 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:20.377876 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d84d6536-300b-4f20-a226-e6c953539087 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:20.378683 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d84d6536-300b-4f20-a226-e6c953539087 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:20.379140 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d84d6536-300b-4f20-a226-e6c953539087 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:20.380379 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d84d6536-300b-4f20-a226-e6c953539087 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:20.450683 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=10 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:20.853558 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d17dba86-7f3b-48fd-9f1d-16b999992197 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:20.873016 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d17dba86-7f3b-48fd-9f1d-16b999992197 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:20.874582 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d17dba86-7f3b-48fd-9f1d-16b999992197 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:20.875953 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d17dba86-7f3b-48fd-9f1d-16b999992197 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 2945 microversion: 2.32 time: 0.762810 Aug 07 01:31:20.887372 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2297/4258] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:31:20 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 2945 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:31:20.911711 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-07f5de28-e6ef-4617-bba0-8777d0306556 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:20.919581 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-07f5de28-e6ef-4617-bba0-8777d0306556 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: 19784b1a-63aa-44b2-bbd5-d8dda713efdd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:20.936831 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-07f5de28-e6ef-4617-bba0-8777d0306556 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:20.938690 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-07f5de28-e6ef-4617-bba0-8777d0306556 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:20.939502 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-07f5de28-e6ef-4617-bba0-8777d0306556 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:20.940427 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-07f5de28-e6ef-4617-bba0-8777d0306556 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:20.941151 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-07f5de28-e6ef-4617-bba0-8777d0306556 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:20.941950 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-07f5de28-e6ef-4617-bba0-8777d0306556 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:20.981834 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-07f5de28-e6ef-4617-bba0-8777d0306556 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] HTTP exception thrown: Instance 19784b1a-63aa-44b2-bbd5-d8dda713efdd could not be found. Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-07f5de28-e6ef-4617-bba0-8777d0306556 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd HTTP/1.1 Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 19784b1a-63aa-44b2-bbd5-d8dda713efdd could not be found. Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '19784b1a-63aa-44b2-bbd5-d8dda713efdd'} Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19784b1a-63aa-44b2-bbd5-d8dda713efdd could not be found. Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19784b1a-63aa-44b2-bbd5-d8dda713efdd could not be found. Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:20.983867 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:20.987400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:20.987400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:20.987400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:20.987400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:31:20.987400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:31:20.987400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19784b1a-63aa-44b2-bbd5-d8dda713efdd could not be found. Aug 07 01:31:20.987400 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:20.999417 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-07f5de28-e6ef-4617-bba0-8777d0306556 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 404 to user: Instance 19784b1a-63aa-44b2-bbd5-d8dda713efdd could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:31:21.001336 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-07f5de28-e6ef-4617-bba0-8777d0306556 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd" status: 404 len: 111 microversion: 2.1 time: 0.112300 Aug 07 01:31:21.007632 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2298/4259] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:20 2022] GET /compute/v2.1/servers/19784b1a-63aa-44b2-bbd5-d8dda713efdd => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:31:21.022660 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a689c3b2-7740-475e-9b56-b8176b7018ca tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:21.044305 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a689c3b2-7740-475e-9b56-b8176b7018ca tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: f6b31167-8c76-4749-88b4-d8380d9b9a84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:21.053203 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a689c3b2-7740-475e-9b56-b8176b7018ca tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:21.054125 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a689c3b2-7740-475e-9b56-b8176b7018ca tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:21.054790 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a689c3b2-7740-475e-9b56-b8176b7018ca tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:21.055938 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a689c3b2-7740-475e-9b56-b8176b7018ca tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:21.056640 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a689c3b2-7740-475e-9b56-b8176b7018ca tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:21.057304 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a689c3b2-7740-475e-9b56-b8176b7018ca tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:21.401523 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a689c3b2-7740-475e-9b56-b8176b7018ca tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:21.409586 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a689c3b2-7740-475e-9b56-b8176b7018ca tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84" status: 200 len: 1493 microversion: 2.1 time: 0.399123 Aug 07 01:31:21.414826 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2299/4260] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:21 2022] GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84 => generated 1493 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:21.434167 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-375ab39c-d313-4d61-9cea-07bfffcfb004 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:21.434933 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-375ab39c-d313-4d61-9cea-07bfffcfb004 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] [instance: da55749a-1b96-4341-a947-9062b0d33eb2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:21.446328 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-375ab39c-d313-4d61-9cea-07bfffcfb004 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:21.446821 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-375ab39c-d313-4d61-9cea-07bfffcfb004 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:21.447260 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-375ab39c-d313-4d61-9cea-07bfffcfb004 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:21.448002 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-375ab39c-d313-4d61-9cea-07bfffcfb004 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:21.448631 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-375ab39c-d313-4d61-9cea-07bfffcfb004 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:21.449217 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-375ab39c-d313-4d61-9cea-07bfffcfb004 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:21.481247 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:21.514323 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d84d6536-300b-4f20-a226-e6c953539087 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:21.525494 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d84d6536-300b-4f20-a226-e6c953539087 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418" status: 200 len: 1523 microversion: 2.1 time: 1.160315 Aug 07 01:31:21.526337 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1962/4261] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:20 2022] GET /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418 => generated 1523 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:21.532891 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bbd60bbc-84cc-4954-a38f-7bee95bee008 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:21.533963 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bbd60bbc-84cc-4954-a38f-7bee95bee008 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:21.556972 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbd60bbc-84cc-4954-a38f-7bee95bee008 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:21.557527 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbd60bbc-84cc-4954-a38f-7bee95bee008 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:21.566535 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbd60bbc-84cc-4954-a38f-7bee95bee008 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:21.571801 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbd60bbc-84cc-4954-a38f-7bee95bee008 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:21.572396 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbd60bbc-84cc-4954-a38f-7bee95bee008 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:21.573309 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbd60bbc-84cc-4954-a38f-7bee95bee008 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:21.639472 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bbd60bbc-84cc-4954-a38f-7bee95bee008 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:31:21.828525 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bbd60bbc-84cc-4954-a38f-7bee95bee008 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 204 len: 0 microversion: 2.1 time: 0.299028 Aug 07 01:31:21.833069 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1963/4262] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:31:21 2022] DELETE /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:31:21.840584 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-12501710-1279-46bf-b501-bb11543fe077 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:21.841843 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-12501710-1279-46bf-b501-bb11543fe077 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:21.850209 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12501710-1279-46bf-b501-bb11543fe077 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:21.850747 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12501710-1279-46bf-b501-bb11543fe077 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:21.851158 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12501710-1279-46bf-b501-bb11543fe077 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:21.852077 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12501710-1279-46bf-b501-bb11543fe077 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:21.852716 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12501710-1279-46bf-b501-bb11543fe077 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:21.853312 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12501710-1279-46bf-b501-bb11543fe077 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:22.057204 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-375ab39c-d313-4d61-9cea-07bfffcfb004 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2c4d9c50fe4c08b3619994e94470c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14c7253bf944819d3b6e203ea4b9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:22.068535 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-375ab39c-d313-4d61-9cea-07bfffcfb004 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] 10.222.0.39 "GET /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2" status: 200 len: 1327 microversion: 2.1 time: 0.652365 Aug 07 01:31:22.084652 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2300/4263] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:21 2022] GET /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2 => generated 1327 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:22.091762 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4c42bd56-16de-413b-949c-5cdd9bb2eda7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:22.092530 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4c42bd56-16de-413b-949c-5cdd9bb2eda7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: f6b31167-8c76-4749-88b4-d8380d9b9a84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:22.100363 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c42bd56-16de-413b-949c-5cdd9bb2eda7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:22.101305 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c42bd56-16de-413b-949c-5cdd9bb2eda7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:22.101949 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c42bd56-16de-413b-949c-5cdd9bb2eda7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:22.102928 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c42bd56-16de-413b-949c-5cdd9bb2eda7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:22.103587 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c42bd56-16de-413b-949c-5cdd9bb2eda7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:22.104825 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c42bd56-16de-413b-949c-5cdd9bb2eda7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:22.114699 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-12501710-1279-46bf-b501-bb11543fe077 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:22.124483 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-12501710-1279-46bf-b501-bb11543fe077 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 200 len: 1486 microversion: 2.1 time: 0.289597 Aug 07 01:31:22.151629 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1964/4264] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:21 2022] GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 1486 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:22.156887 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-28fdf2dd-1d61-40d9-981b-cb41448909bd tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:22.157527 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-28fdf2dd-1d61-40d9-981b-cb41448909bd tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:22.164478 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28fdf2dd-1d61-40d9-981b-cb41448909bd tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:22.165342 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28fdf2dd-1d61-40d9-981b-cb41448909bd tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:22.165342 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28fdf2dd-1d61-40d9-981b-cb41448909bd tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:22.166090 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28fdf2dd-1d61-40d9-981b-cb41448909bd tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:22.170650 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28fdf2dd-1d61-40d9-981b-cb41448909bd tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:22.171011 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28fdf2dd-1d61-40d9-981b-cb41448909bd tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:22.174490 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4c42bd56-16de-413b-949c-5cdd9bb2eda7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: f6b31167-8c76-4749-88b4-d8380d9b9a84] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:31:22.277026 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4c42bd56-16de-413b-949c-5cdd9bb2eda7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84" status: 204 len: 0 microversion: 2.1 time: 0.190078 Aug 07 01:31:22.281261 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2301/4265] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:31:22 2022] DELETE /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:31:22.289172 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0e6e68dc-240c-42fe-9d47-902327485be3 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:22.289172 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0e6e68dc-240c-42fe-9d47-902327485be3 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:22.296360 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0e6e68dc-240c-42fe-9d47-902327485be3 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:22.303988 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0e6e68dc-240c-42fe-9d47-902327485be3 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:22.305020 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0e6e68dc-240c-42fe-9d47-902327485be3 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:22.305996 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0e6e68dc-240c-42fe-9d47-902327485be3 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:22.306533 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0e6e68dc-240c-42fe-9d47-902327485be3 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:22.307072 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0e6e68dc-240c-42fe-9d47-902327485be3 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:22.439628 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-28fdf2dd-1d61-40d9-981b-cb41448909bd tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:22.452375 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-28fdf2dd-1d61-40d9-981b-cb41448909bd tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1512 microversion: 2.1 time: 0.299001 Aug 07 01:31:22.453063 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1965/4266] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:22 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1512 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:22.467982 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-184f8853-d38a-4ccd-ab43-8a9960b75ffc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:22.469439 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-184f8853-d38a-4ccd-ab43-8a9960b75ffc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:22.480791 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-184f8853-d38a-4ccd-ab43-8a9960b75ffc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:22.481753 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-184f8853-d38a-4ccd-ab43-8a9960b75ffc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:22.482538 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-184f8853-d38a-4ccd-ab43-8a9960b75ffc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:22.483600 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-184f8853-d38a-4ccd-ab43-8a9960b75ffc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:22.484664 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-184f8853-d38a-4ccd-ab43-8a9960b75ffc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:22.485389 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-184f8853-d38a-4ccd-ab43-8a9960b75ffc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:22.523334 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-184f8853-d38a-4ccd-ab43-8a9960b75ffc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lazy-loading 'flavor' on Instance uuid a00f6b81-d0b5-434f-a861-53cbcf107219 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:31:22.911630 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-184f8853-d38a-4ccd-ab43-8a9960b75ffc tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219/action" status: 202 len: 0 microversion: 2.1 time: 0.456466 Aug 07 01:31:22.913671 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1966/4267] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:31:22 2022] POST /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219/action => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:31:22.929117 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2815f650-8ab1-4329-9b49-290b17435bb4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:22.930225 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2815f650-8ab1-4329-9b49-290b17435bb4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: f6b31167-8c76-4749-88b4-d8380d9b9a84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:22.947572 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2815f650-8ab1-4329-9b49-290b17435bb4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:22.948339 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2815f650-8ab1-4329-9b49-290b17435bb4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:22.949315 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2815f650-8ab1-4329-9b49-290b17435bb4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:22.950979 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2815f650-8ab1-4329-9b49-290b17435bb4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:22.954980 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2815f650-8ab1-4329-9b49-290b17435bb4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:22.955676 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2815f650-8ab1-4329-9b49-290b17435bb4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:23.031706 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=14 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:23.332317 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2815f650-8ab1-4329-9b49-290b17435bb4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:23.343672 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2815f650-8ab1-4329-9b49-290b17435bb4 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84" status: 200 len: 1499 microversion: 2.1 time: 0.428566 Aug 07 01:31:23.350795 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1967/4268] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:22 2022] GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84 => generated 1499 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:23.372864 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4ea01762-3117-4baf-99e9-ad679ae7cbe8 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:23.373510 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4ea01762-3117-4baf-99e9-ad679ae7cbe8 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 425b6340-2984-4339-9728-2914b55bd418] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:23.381353 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ea01762-3117-4baf-99e9-ad679ae7cbe8 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:23.381867 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ea01762-3117-4baf-99e9-ad679ae7cbe8 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:23.382300 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ea01762-3117-4baf-99e9-ad679ae7cbe8 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:23.383038 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ea01762-3117-4baf-99e9-ad679ae7cbe8 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:23.383503 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ea01762-3117-4baf-99e9-ad679ae7cbe8 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:23.383967 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ea01762-3117-4baf-99e9-ad679ae7cbe8 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:23.478974 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=8 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:23.559297 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0e6e68dc-240c-42fe-9d47-902327485be3 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:23.578322 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0e6e68dc-240c-42fe-9d47-902327485be3 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:23.584360 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0e6e68dc-240c-42fe-9d47-902327485be3 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:23.585876 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0e6e68dc-240c-42fe-9d47-902327485be3 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 2924 microversion: 2.32 time: 1.303289 Aug 07 01:31:23.588227 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2302/4269] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:31:22 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 2924 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:31:23.594675 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-51f86692-6b59-4774-8aae-c23d6db62d55 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:23.598530 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-51f86692-6b59-4774-8aae-c23d6db62d55 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:23.631024 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51f86692-6b59-4774-8aae-c23d6db62d55 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:23.632511 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51f86692-6b59-4774-8aae-c23d6db62d55 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:23.637693 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51f86692-6b59-4774-8aae-c23d6db62d55 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:23.638657 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51f86692-6b59-4774-8aae-c23d6db62d55 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:23.644702 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51f86692-6b59-4774-8aae-c23d6db62d55 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:23.648290 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51f86692-6b59-4774-8aae-c23d6db62d55 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:23.781334 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4ea01762-3117-4baf-99e9-ad679ae7cbe8 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:23.807523 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4ea01762-3117-4baf-99e9-ad679ae7cbe8 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418" status: 200 len: 1523 microversion: 2.1 time: 0.438157 Aug 07 01:31:23.808299 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1968/4270] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:23 2022] GET /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418 => generated 1523 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:23.826365 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-db45bc3a-858c-4987-8abf-bd2cb8f5c9ff tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:23.827248 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-db45bc3a-858c-4987-8abf-bd2cb8f5c9ff tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] [instance: da55749a-1b96-4341-a947-9062b0d33eb2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:23.842311 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db45bc3a-858c-4987-8abf-bd2cb8f5c9ff tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:23.842825 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db45bc3a-858c-4987-8abf-bd2cb8f5c9ff tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:23.843284 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db45bc3a-858c-4987-8abf-bd2cb8f5c9ff tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:23.849508 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db45bc3a-858c-4987-8abf-bd2cb8f5c9ff tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:23.850108 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db45bc3a-858c-4987-8abf-bd2cb8f5c9ff tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:23.850569 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db45bc3a-858c-4987-8abf-bd2cb8f5c9ff tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:24.104544 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-51f86692-6b59-4774-8aae-c23d6db62d55 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:24.118807 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-51f86692-6b59-4774-8aae-c23d6db62d55 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 200 len: 1513 microversion: 2.1 time: 0.528985 Aug 07 01:31:24.132588 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2303/4271] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:23 2022] GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 1513 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:24.132588 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c55136a8-bb43-4c38-a59f-cafa5a67f178 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:24.133173 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c55136a8-bb43-4c38-a59f-cafa5a67f178 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:24.146220 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c55136a8-bb43-4c38-a59f-cafa5a67f178 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:24.147190 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-db45bc3a-858c-4987-8abf-bd2cb8f5c9ff tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2c4d9c50fe4c08b3619994e94470c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14c7253bf944819d3b6e203ea4b9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:24.152472 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c55136a8-bb43-4c38-a59f-cafa5a67f178 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:24.154761 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c55136a8-bb43-4c38-a59f-cafa5a67f178 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:24.156729 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c55136a8-bb43-4c38-a59f-cafa5a67f178 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:24.161289 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c55136a8-bb43-4c38-a59f-cafa5a67f178 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:24.163464 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c55136a8-bb43-4c38-a59f-cafa5a67f178 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:24.163616 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-db45bc3a-858c-4987-8abf-bd2cb8f5c9ff tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] 10.222.0.39 "GET /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2" status: 200 len: 1327 microversion: 2.1 time: 0.353637 Aug 07 01:31:24.168395 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1969/4272] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:23 2022] GET /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2 => generated 1327 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:24.185504 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-39daacfa-2ca1-4201-ad7f-43a4c227c8af req-69b1723d-4c70-4572-b45d-47cefb4c8b17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da55749a-1b96-4341-a947-9062b0d33eb2", "name": "network-vif-plugged", "status": "completed", "tag": "ff9b5ea2-bd6c-4b45-a67e-5fc180b46ce3"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:24.218921 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-39daacfa-2ca1-4201-ad7f-43a4c227c8af req-69b1723d-4c70-4572-b45d-47cefb4c8b17 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:24.225398 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-39daacfa-2ca1-4201-ad7f-43a4c227c8af req-69b1723d-4c70-4572-b45d-47cefb4c8b17 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:24.225979 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-39daacfa-2ca1-4201-ad7f-43a4c227c8af req-69b1723d-4c70-4572-b45d-47cefb4c8b17 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:24.247963 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-39daacfa-2ca1-4201-ad7f-43a4c227c8af req-69b1723d-4c70-4572-b45d-47cefb4c8b17 service nova] Creating event network-vif-plugged:ff9b5ea2-bd6c-4b45-a67e-5fc180b46ce3 for instance da55749a-1b96-4341-a947-9062b0d33eb2 on n-h1-master-1 Aug 07 01:31:24.254254 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-39daacfa-2ca1-4201-ad7f-43a4c227c8af req-69b1723d-4c70-4572-b45d-47cefb4c8b17 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084056 Aug 07 01:31:24.255343 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1970/4273] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:24.380157 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0551b2aa-9f19-4ece-a9e2-cff5c4d60eb3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:24.381962 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0551b2aa-9f19-4ece-a9e2-cff5c4d60eb3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: f6b31167-8c76-4749-88b4-d8380d9b9a84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:24.391353 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0551b2aa-9f19-4ece-a9e2-cff5c4d60eb3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:24.391935 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0551b2aa-9f19-4ece-a9e2-cff5c4d60eb3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:24.392332 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0551b2aa-9f19-4ece-a9e2-cff5c4d60eb3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:24.393117 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0551b2aa-9f19-4ece-a9e2-cff5c4d60eb3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:24.393581 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0551b2aa-9f19-4ece-a9e2-cff5c4d60eb3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:24.394046 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0551b2aa-9f19-4ece-a9e2-cff5c4d60eb3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:24.624723 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c55136a8-bb43-4c38-a59f-cafa5a67f178 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:24.637666 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c55136a8-bb43-4c38-a59f-cafa5a67f178 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1512 microversion: 2.1 time: 0.516346 Aug 07 01:31:24.643301 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2304/4274] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:24 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1512 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:24.654906 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-db37bcb1-82c9-4a6a-8104-ea02edc8dc25 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:24.659407 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-db37bcb1-82c9-4a6a-8104-ea02edc8dc25 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:24.683261 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-db37bcb1-82c9-4a6a-8104-ea02edc8dc25 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:24.699059 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-db37bcb1-82c9-4a6a-8104-ea02edc8dc25 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:24.703072 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-db37bcb1-82c9-4a6a-8104-ea02edc8dc25 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:24.704705 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-db37bcb1-82c9-4a6a-8104-ea02edc8dc25 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:24.708726 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-db37bcb1-82c9-4a6a-8104-ea02edc8dc25 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:24.709474 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-db37bcb1-82c9-4a6a-8104-ea02edc8dc25 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:24.835220 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0551b2aa-9f19-4ece-a9e2-cff5c4d60eb3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:24.844618 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:UPDATE=5,nova_cell1:SELECT=92,nova_cell1:INSERT=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:24.853007 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0551b2aa-9f19-4ece-a9e2-cff5c4d60eb3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84" status: 200 len: 1499 microversion: 2.1 time: 0.481013 Aug 07 01:31:24.855808 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1971/4275] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:24 2022] GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84 => generated 1499 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:24.863543 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9a1f9d9f-b359-433b-9c9a-fd86d3111e56 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:24.873614 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9a1f9d9f-b359-433b-9c9a-fd86d3111e56 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 425b6340-2984-4339-9728-2914b55bd418] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:24.882010 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a1f9d9f-b359-433b-9c9a-fd86d3111e56 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:24.882524 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a1f9d9f-b359-433b-9c9a-fd86d3111e56 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:24.882971 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a1f9d9f-b359-433b-9c9a-fd86d3111e56 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:24.883697 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a1f9d9f-b359-433b-9c9a-fd86d3111e56 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:24.896434 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a1f9d9f-b359-433b-9c9a-fd86d3111e56 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:24.897052 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a1f9d9f-b359-433b-9c9a-fd86d3111e56 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:25.097341 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-db37bcb1-82c9-4a6a-8104-ea02edc8dc25 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:25.118988 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-db37bcb1-82c9-4a6a-8104-ea02edc8dc25 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:25.146369 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-db37bcb1-82c9-4a6a-8104-ea02edc8dc25 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:25.147743 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-db37bcb1-82c9-4a6a-8104-ea02edc8dc25 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 2903 microversion: 2.32 time: 0.501487 Aug 07 01:31:25.148366 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2305/4276] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:31:24 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 2903 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:31:25.166215 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-829eb200-7031-4ced-91c8-c53ef9e51700 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:25.166842 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-829eb200-7031-4ced-91c8-c53ef9e51700 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:25.196795 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-829eb200-7031-4ced-91c8-c53ef9e51700 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:25.197764 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-829eb200-7031-4ced-91c8-c53ef9e51700 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:25.198437 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-829eb200-7031-4ced-91c8-c53ef9e51700 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:25.199619 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-829eb200-7031-4ced-91c8-c53ef9e51700 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:25.200714 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-829eb200-7031-4ced-91c8-c53ef9e51700 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:25.201373 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-829eb200-7031-4ced-91c8-c53ef9e51700 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:25.547427 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9a1f9d9f-b359-433b-9c9a-fd86d3111e56 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:25.556095 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9a1f9d9f-b359-433b-9c9a-fd86d3111e56 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418" status: 200 len: 1500 microversion: 2.1 time: 0.698895 Aug 07 01:31:25.572204 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1972/4277] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:24 2022] GET /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418 => generated 1500 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:25.572204 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-839e8a6e-73f8-484c-b674-5d245842cd04 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:25.572204 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-839e8a6e-73f8-484c-b674-5d245842cd04 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] [instance: da55749a-1b96-4341-a947-9062b0d33eb2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:25.593606 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-839e8a6e-73f8-484c-b674-5d245842cd04 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:25.594528 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-839e8a6e-73f8-484c-b674-5d245842cd04 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:25.594980 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-839e8a6e-73f8-484c-b674-5d245842cd04 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:25.595718 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-839e8a6e-73f8-484c-b674-5d245842cd04 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:25.596218 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-839e8a6e-73f8-484c-b674-5d245842cd04 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:25.596652 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-839e8a6e-73f8-484c-b674-5d245842cd04 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:25.633541 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-829eb200-7031-4ced-91c8-c53ef9e51700 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:25.647556 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-829eb200-7031-4ced-91c8-c53ef9e51700 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 200 len: 1513 microversion: 2.1 time: 0.498084 Aug 07 01:31:25.648511 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2306/4278] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:25 2022] GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 1513 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:25.661412 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fd6cf257-de95-4d0d-a5c6-2e6422a05869 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:25.677514 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fd6cf257-de95-4d0d-a5c6-2e6422a05869 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:25.678445 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fd6cf257-de95-4d0d-a5c6-2e6422a05869 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '5f88662ebb674ad99a4d36651dee967a'} {{(pid=119516) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:31:25.696187 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd6cf257-de95-4d0d-a5c6-2e6422a05869 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:25.696928 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd6cf257-de95-4d0d-a5c6-2e6422a05869 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:25.697669 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd6cf257-de95-4d0d-a5c6-2e6422a05869 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:25.698636 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd6cf257-de95-4d0d-a5c6-2e6422a05869 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:25.699296 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd6cf257-de95-4d0d-a5c6-2e6422a05869 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:25.699941 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd6cf257-de95-4d0d-a5c6-2e6422a05869 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:25.751931 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.multi_cell_list [None req-fd6cf257-de95-4d0d-a5c6-2e6422a05869 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 01:31:25.808370 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fd6cf257-de95-4d0d-a5c6-2e6422a05869 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.158693 Aug 07 01:31:25.816102 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2307/4279] 10.222.0.39 () {58 vars in 1154 bytes} [Sun Aug 7 01:31:25 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:25.824599 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a5309118-8fc7-4e88-b96e-9f1e9b4e32b2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:25.825582 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a5309118-8fc7-4e88-b96e-9f1e9b4e32b2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:25.870432 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a5309118-8fc7-4e88-b96e-9f1e9b4e32b2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:25.873234 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a5309118-8fc7-4e88-b96e-9f1e9b4e32b2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:25.873711 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a5309118-8fc7-4e88-b96e-9f1e9b4e32b2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:25.877154 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a5309118-8fc7-4e88-b96e-9f1e9b4e32b2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:25.877758 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a5309118-8fc7-4e88-b96e-9f1e9b4e32b2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:25.880160 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a5309118-8fc7-4e88-b96e-9f1e9b4e32b2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:25.916641 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-839e8a6e-73f8-484c-b674-5d245842cd04 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2c4d9c50fe4c08b3619994e94470c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14c7253bf944819d3b6e203ea4b9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:25.926696 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-839e8a6e-73f8-484c-b674-5d245842cd04 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] 10.222.0.39 "GET /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2" status: 200 len: 1327 microversion: 2.1 time: 0.363657 Aug 07 01:31:25.933046 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1973/4280] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:25 2022] GET /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2 => generated 1327 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:25.946073 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1a7921bf-a699-4c07-924b-6b6851187f0a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:25.957516 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1a7921bf-a699-4c07-924b-6b6851187f0a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:25.958347 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1a7921bf-a699-4c07-924b-6b6851187f0a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:25.959029 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1a7921bf-a699-4c07-924b-6b6851187f0a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:26.006627 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1a7921bf-a699-4c07-924b-6b6851187f0a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 425b6340-2984-4339-9728-2914b55bd418] Going to try to start instance {{(pid=119517) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 07 01:31:26.067665 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1a7921bf-a699-4c07-924b-6b6851187f0a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "POST /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418/action" status: 202 len: 0 microversion: 2.1 time: 0.132227 Aug 07 01:31:26.069172 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1974/4281] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:31:25 2022] POST /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:31:26.079943 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2bf964c2-4980-4d04-a1ff-e82c728f6705 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:26.082648 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2bf964c2-4980-4d04-a1ff-e82c728f6705 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: f6b31167-8c76-4749-88b4-d8380d9b9a84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:26.100580 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2bf964c2-4980-4d04-a1ff-e82c728f6705 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:26.101427 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2bf964c2-4980-4d04-a1ff-e82c728f6705 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:26.102115 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2bf964c2-4980-4d04-a1ff-e82c728f6705 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:26.103401 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2bf964c2-4980-4d04-a1ff-e82c728f6705 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:26.104650 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2bf964c2-4980-4d04-a1ff-e82c728f6705 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:26.106011 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2bf964c2-4980-4d04-a1ff-e82c728f6705 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:26.274886 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a5309118-8fc7-4e88-b96e-9f1e9b4e32b2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a2c261b4e794705a8725b3b7126bd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b7f4c69d5542a88fa2870354d507ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:26.296736 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a5309118-8fc7-4e88-b96e-9f1e9b4e32b2 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 200 len: 1512 microversion: 2.1 time: 0.481265 Aug 07 01:31:26.302853 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2308/4282] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:25 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 1512 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:26.321520 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b75c3a92-c8b5-4eee-9bf9-52a36be11094 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:26.324822 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b75c3a92-c8b5-4eee-9bf9-52a36be11094 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 425b6340-2984-4339-9728-2914b55bd418] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:26.351005 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b75c3a92-c8b5-4eee-9bf9-52a36be11094 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:26.356159 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b75c3a92-c8b5-4eee-9bf9-52a36be11094 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:26.358516 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b75c3a92-c8b5-4eee-9bf9-52a36be11094 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:26.364160 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b75c3a92-c8b5-4eee-9bf9-52a36be11094 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:26.367573 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b75c3a92-c8b5-4eee-9bf9-52a36be11094 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:26.368332 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b75c3a92-c8b5-4eee-9bf9-52a36be11094 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:26.463489 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2bf964c2-4980-4d04-a1ff-e82c728f6705 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f0c01c340940388b440932d51988ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5506f7c95c1a46c5b3966597764b0111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:26.473115 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2bf964c2-4980-4d04-a1ff-e82c728f6705 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84" status: 200 len: 1499 microversion: 2.1 time: 0.402323 Aug 07 01:31:26.479047 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1975/4283] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:26 2022] GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84 => generated 1499 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:26.494251 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-bad591e0-662e-437b-b85c-8918e294d9d9 req-33643bd5-48e5-4485-8c80-f0e4b5db1d1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77ed645e-669e-4167-ae78-8ce69770babf", "name": "network-vif-deleted", "tag": "b49b5afb-08c7-4f77-bad9-32ce23dd63c7"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:26.534123 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-bad591e0-662e-437b-b85c-8918e294d9d9 req-33643bd5-48e5-4485-8c80-f0e4b5db1d1f service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:26.536550 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-bad591e0-662e-437b-b85c-8918e294d9d9 req-33643bd5-48e5-4485-8c80-f0e4b5db1d1f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:26.537139 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-bad591e0-662e-437b-b85c-8918e294d9d9 req-33643bd5-48e5-4485-8c80-f0e4b5db1d1f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:26.584728 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-bad591e0-662e-437b-b85c-8918e294d9d9 req-33643bd5-48e5-4485-8c80-f0e4b5db1d1f service nova] Creating event network-vif-deleted:b49b5afb-08c7-4f77-bad9-32ce23dd63c7 for instance 77ed645e-669e-4167-ae78-8ce69770babf on n-h1-master-1 Aug 07 01:31:26.594670 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-bad591e0-662e-437b-b85c-8918e294d9d9 req-33643bd5-48e5-4485-8c80-f0e4b5db1d1f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106377 Aug 07 01:31:26.604539 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1976/4284] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:26.610350 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-937cabf5-3ad4-465d-b2e3-986d1477b8c0 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:26.611193 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-937cabf5-3ad4-465d-b2e3-986d1477b8c0 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:26.621996 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:26.634377 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-937cabf5-3ad4-465d-b2e3-986d1477b8c0 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:26.635274 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-937cabf5-3ad4-465d-b2e3-986d1477b8c0 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:26.635973 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-937cabf5-3ad4-465d-b2e3-986d1477b8c0 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:26.636997 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-937cabf5-3ad4-465d-b2e3-986d1477b8c0 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:26.637693 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-937cabf5-3ad4-465d-b2e3-986d1477b8c0 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:26.638338 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-937cabf5-3ad4-465d-b2e3-986d1477b8c0 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:26.987040 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b75c3a92-c8b5-4eee-9bf9-52a36be11094 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:26.998763 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b75c3a92-c8b5-4eee-9bf9-52a36be11094 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418" status: 200 len: 1509 microversion: 2.1 time: 0.691417 Aug 07 01:31:27.000150 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2309/4285] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:26 2022] GET /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418 => generated 1509 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:27.008015 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-1ebbd963-f5b7-4587-8078-f8525e3f16db req-6b6143cf-bee7-4f3f-9357-e975fbcf2219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77ed645e-669e-4167-ae78-8ce69770babf", "name": "network-vif-unplugged", "status": "completed", "tag": "20e0f822-dbb7-40fe-862e-071c9953a3bf"}, {"server_uuid": "77ed645e-669e-4167-ae78-8ce69770babf", "name": "network-vif-unplugged", "status": "completed", "tag": "840656e7-e0bc-4bee-89df-d4b7a1945712"}, {"server_uuid": "77ed645e-669e-4167-ae78-8ce69770babf", "name": "network-vif-unplugged", "status": "completed", "tag": "1268da76-b550-4f84-ab0c-afc461703feb"}, {"server_uuid": "77ed645e-669e-4167-ae78-8ce69770babf", "name": "network-vif-unplugged", "status": "completed", "tag": "266d9506-a2b8-4b18-a0fc-163e3269dd34"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:27.025435 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-1ebbd963-f5b7-4587-8078-f8525e3f16db req-6b6143cf-bee7-4f3f-9357-e975fbcf2219 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:27.026709 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-1ebbd963-f5b7-4587-8078-f8525e3f16db req-6b6143cf-bee7-4f3f-9357-e975fbcf2219 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:27.027749 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-1ebbd963-f5b7-4587-8078-f8525e3f16db req-6b6143cf-bee7-4f3f-9357-e975fbcf2219 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:27.043597 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-1ebbd963-f5b7-4587-8078-f8525e3f16db req-6b6143cf-bee7-4f3f-9357-e975fbcf2219 service nova] Creating event network-vif-unplugged:20e0f822-dbb7-40fe-862e-071c9953a3bf for instance 77ed645e-669e-4167-ae78-8ce69770babf on n-h1-master-1 Aug 07 01:31:27.044539 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-1ebbd963-f5b7-4587-8078-f8525e3f16db req-6b6143cf-bee7-4f3f-9357-e975fbcf2219 service nova] Creating event network-vif-unplugged:840656e7-e0bc-4bee-89df-d4b7a1945712 for instance 77ed645e-669e-4167-ae78-8ce69770babf on n-h1-master-1 Aug 07 01:31:27.045328 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-1ebbd963-f5b7-4587-8078-f8525e3f16db req-6b6143cf-bee7-4f3f-9357-e975fbcf2219 service nova] Creating event network-vif-unplugged:1268da76-b550-4f84-ab0c-afc461703feb for instance 77ed645e-669e-4167-ae78-8ce69770babf on n-h1-master-1 Aug 07 01:31:27.046099 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-1ebbd963-f5b7-4587-8078-f8525e3f16db req-6b6143cf-bee7-4f3f-9357-e975fbcf2219 service nova] Creating event network-vif-unplugged:266d9506-a2b8-4b18-a0fc-163e3269dd34 for instance 77ed645e-669e-4167-ae78-8ce69770babf on n-h1-master-1 Aug 07 01:31:27.054858 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-1ebbd963-f5b7-4587-8078-f8525e3f16db req-6b6143cf-bee7-4f3f-9357-e975fbcf2219 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.052884 Aug 07 01:31:27.055943 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2310/4286] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:27.071825 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b447713c-3620-48e7-8c2f-512efb51bb12 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:27.073327 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b447713c-3620-48e7-8c2f-512efb51bb12 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:27.087527 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b447713c-3620-48e7-8c2f-512efb51bb12 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:27.088656 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b447713c-3620-48e7-8c2f-512efb51bb12 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:27.089347 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b447713c-3620-48e7-8c2f-512efb51bb12 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:27.090357 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b447713c-3620-48e7-8c2f-512efb51bb12 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:27.091104 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b447713c-3620-48e7-8c2f-512efb51bb12 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:27.091778 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b447713c-3620-48e7-8c2f-512efb51bb12 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:27.157959 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-937cabf5-3ad4-465d-b2e3-986d1477b8c0 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:27.182486 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-937cabf5-3ad4-465d-b2e3-986d1477b8c0 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:27.185539 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-937cabf5-3ad4-465d-b2e3-986d1477b8c0 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:27.194357 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-937cabf5-3ad4-465d-b2e3-986d1477b8c0 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 2858 microversion: 2.32 time: 0.586695 Aug 07 01:31:27.195587 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1977/4287] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:31:26 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 2858 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:31:27.219231 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8e9f41d1-1f54-4b59-89aa-c7aa826e9084 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:27.220450 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8e9f41d1-1f54-4b59-89aa-c7aa826e9084 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] [instance: da55749a-1b96-4341-a947-9062b0d33eb2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:27.251909 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8e9f41d1-1f54-4b59-89aa-c7aa826e9084 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:27.252997 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8e9f41d1-1f54-4b59-89aa-c7aa826e9084 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:27.254913 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8e9f41d1-1f54-4b59-89aa-c7aa826e9084 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:27.256578 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8e9f41d1-1f54-4b59-89aa-c7aa826e9084 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:27.257290 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8e9f41d1-1f54-4b59-89aa-c7aa826e9084 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:27.258048 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8e9f41d1-1f54-4b59-89aa-c7aa826e9084 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:28.205398 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8e9f41d1-1f54-4b59-89aa-c7aa826e9084 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2c4d9c50fe4c08b3619994e94470c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14c7253bf944819d3b6e203ea4b9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:28.225237 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8e9f41d1-1f54-4b59-89aa-c7aa826e9084 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] 10.222.0.39 "GET /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2" status: 200 len: 1527 microversion: 2.1 time: 1.023904 Aug 07 01:31:28.227745 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1978/4288] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:27 2022] GET /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2 => generated 1527 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:28.258443 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-6d99c529-c437-4b8f-856d-abb3f24a9568 req-19fc9905-158a-4229-a08a-2239e2d25cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9b1883a-c95a-4c49-ad6d-335ecf03b015", "name": "network-vif-deleted", "tag": "cb3c2bf2-1cb1-4779-8b61-f6d977daac69"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:28.296434 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6d99c529-c437-4b8f-856d-abb3f24a9568 req-19fc9905-158a-4229-a08a-2239e2d25cc7 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:28.301248 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6d99c529-c437-4b8f-856d-abb3f24a9568 req-19fc9905-158a-4229-a08a-2239e2d25cc7 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:28.302980 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6d99c529-c437-4b8f-856d-abb3f24a9568 req-19fc9905-158a-4229-a08a-2239e2d25cc7 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:28.359213 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-6d99c529-c437-4b8f-856d-abb3f24a9568 req-19fc9905-158a-4229-a08a-2239e2d25cc7 service nova] Creating event network-vif-deleted:cb3c2bf2-1cb1-4779-8b61-f6d977daac69 for instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 on n-h2-master-1 Aug 07 01:31:28.384284 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-6d99c529-c437-4b8f-856d-abb3f24a9568 req-19fc9905-158a-4229-a08a-2239e2d25cc7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151591 Aug 07 01:31:28.385561 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1979/4289] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:28.404986 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ba5e7340-d38c-42af-b233-0e76d74fb190 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:28.405715 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ba5e7340-d38c-42af-b233-0e76d74fb190 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] [instance: d9b1883a-c95a-4c49-ad6d-335ecf03b015] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:28.406883 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b447713c-3620-48e7-8c2f-512efb51bb12 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:28.419686 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b447713c-3620-48e7-8c2f-512efb51bb12 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 200 len: 1508 microversion: 2.1 time: 1.361485 Aug 07 01:31:28.420711 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2311/4290] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:27 2022] GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 1508 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:28.445726 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ba5e7340-d38c-42af-b233-0e76d74fb190 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:28.446227 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ba5e7340-d38c-42af-b233-0e76d74fb190 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:28.446654 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ba5e7340-d38c-42af-b233-0e76d74fb190 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:28.447377 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ba5e7340-d38c-42af-b233-0e76d74fb190 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:28.447837 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ba5e7340-d38c-42af-b233-0e76d74fb190 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:28.448288 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ba5e7340-d38c-42af-b233-0e76d74fb190 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:28.452765 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7fc5c7f4-adaa-4456-ba59-eb50f73ced80 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:28.453805 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7fc5c7f4-adaa-4456-ba59-eb50f73ced80 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: f6b31167-8c76-4749-88b4-d8380d9b9a84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:28.473756 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7fc5c7f4-adaa-4456-ba59-eb50f73ced80 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:28.474422 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7fc5c7f4-adaa-4456-ba59-eb50f73ced80 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:28.475153 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7fc5c7f4-adaa-4456-ba59-eb50f73ced80 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:28.476548 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-ba5e7340-d38c-42af-b233-0e76d74fb190 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] HTTP exception thrown: Instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 could not be found. Aug 07 01:31:28.477319 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7fc5c7f4-adaa-4456-ba59-eb50f73ced80 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:28.478318 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7fc5c7f4-adaa-4456-ba59-eb50f73ced80 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:28.480132 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7fc5c7f4-adaa-4456-ba59-eb50f73ced80 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ba5e7340-d38c-42af-b233-0e76d74fb190 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Request method failure captured: Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 HTTP/1.1 Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xT5Rqpo5bwUqXTgKAeLFeIninvpL0TIzRVrl4Lz8AuKP3VJsz3LK83qAziEN05429QZ0V1vTYR57pBaXGsQ2Ej2foFA8ebzQ8Fl0YXddTho6iAvv3UpWxUfX-QvVqkAYk8K1yH-V1UNCx4IEh6dMYMmaACYdVZqGFrx76H5Lz-S7ZQ Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38b7f4c69d5542a88fa2870354d507ce", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38b7f4c69d5542a88fa2870354d507ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 38b7f4c69d5542a88fa2870354d507ce Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1398490963 Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 8a2c261b4e794705a8725b3b7126bd73 Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersNegativeTestJSON-1398490963-project Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: exception: Instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 could not be found. Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'd9b1883a-c95a-4c49-ad6d-335ecf03b015'} Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 could not be found. Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 could not be found. Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:28.492871 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:28.497614 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:28.497614 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:28.497614 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:28.497614 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:31:28.497614 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:31:28.497614 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 could not be found. Aug 07 01:31:28.497614 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:28.499527 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ba5e7340-d38c-42af-b233-0e76d74fb190 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] Returning 404 to user: Instance d9b1883a-c95a-4c49-ad6d-335ecf03b015 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:31:28.500609 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ba5e7340-d38c-42af-b233-0e76d74fb190 tempest-ServersNegativeTestJSON-1398490963 tempest-ServersNegativeTestJSON-1398490963-project] 10.222.0.39 "GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015" status: 404 len: 111 microversion: 2.1 time: 0.113930 Aug 07 01:31:28.501519 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1980/4291] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:28 2022] GET /compute/v2.1/servers/d9b1883a-c95a-4c49-ad6d-335ecf03b015 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:31:28.522718 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-542738fc-1a38-4ffe-9fc5-13e6127bc867 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:28.525199 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-542738fc-1a38-4ffe-9fc5-13e6127bc867 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 425b6340-2984-4339-9728-2914b55bd418] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:28.538488 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-7fc5c7f4-adaa-4456-ba59-eb50f73ced80 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] HTTP exception thrown: Instance f6b31167-8c76-4749-88b4-d8380d9b9a84 could not be found. Aug 07 01:31:28.543583 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-542738fc-1a38-4ffe-9fc5-13e6127bc867 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:28.548977 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-542738fc-1a38-4ffe-9fc5-13e6127bc867 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:28.549767 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-542738fc-1a38-4ffe-9fc5-13e6127bc867 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7fc5c7f4-adaa-4456-ba59-eb50f73ced80 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Request method failure captured: Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84 HTTP/1.1 Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xRoqM1ZK4H7GtvmxWX9ofAmOsKF2OdU6k1rehi-6yk86CpmfTNVcE0kwd9G1ahgJHyDlEB2bKz4XbnD5Ku_zcl240Q-kfWeKv3HfC_GyXmFAQWa4hNXP2nUgxgBXBe_oBb5a-t1xlRXFxfo9n87AmGbLBI9ZdV03LZwWshVd2n0WvE Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5506f7c95c1a46c5b3966597764b0111", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: d1f0c01c340940388b440932d51988ff Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: exception: Instance f6b31167-8c76-4749-88b4-d8380d9b9a84 could not be found. Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'f6b31167-8c76-4749-88b4-d8380d9b9a84'} Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6b31167-8c76-4749-88b4-d8380d9b9a84 could not be found. Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6b31167-8c76-4749-88b4-d8380d9b9a84 could not be found. Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:28.550244 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:28.556570 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:28.556570 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:28.556570 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:28.556570 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:31:28.556570 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:31:28.556570 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6b31167-8c76-4749-88b4-d8380d9b9a84 could not be found. Aug 07 01:31:28.556570 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:28.558407 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7fc5c7f4-adaa-4456-ba59-eb50f73ced80 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Returning 404 to user: Instance f6b31167-8c76-4749-88b4-d8380d9b9a84 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:31:28.559551 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-542738fc-1a38-4ffe-9fc5-13e6127bc867 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:28.570664 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7fc5c7f4-adaa-4456-ba59-eb50f73ced80 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84" status: 404 len: 111 microversion: 2.1 time: 0.126250 Aug 07 01:31:28.572350 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2312/4292] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:28 2022] GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:31:28.574467 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-542738fc-1a38-4ffe-9fc5-13e6127bc867 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:28.576461 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-542738fc-1a38-4ffe-9fc5-13e6127bc867 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:28.581160 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-24267b38-482e-4dc9-ba87-7612145ca2c7 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:28.581793 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-24267b38-482e-4dc9-ba87-7612145ca2c7 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:28.609300 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24267b38-482e-4dc9-ba87-7612145ca2c7 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:28.609811 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24267b38-482e-4dc9-ba87-7612145ca2c7 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:28.610266 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24267b38-482e-4dc9-ba87-7612145ca2c7 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:28.611137 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24267b38-482e-4dc9-ba87-7612145ca2c7 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:28.611527 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24267b38-482e-4dc9-ba87-7612145ca2c7 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:28.611869 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24267b38-482e-4dc9-ba87-7612145ca2c7 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:28.919819 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-542738fc-1a38-4ffe-9fc5-13e6127bc867 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:28.933500 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-542738fc-1a38-4ffe-9fc5-13e6127bc867 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418" status: 200 len: 1509 microversion: 2.1 time: 0.430678 Aug 07 01:31:28.934651 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1981/4293] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:28 2022] GET /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418 => generated 1509 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:28.941302 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5f057052-fbb9-4915-b66f-4e5166be79ad tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:28.942171 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5f057052-fbb9-4915-b66f-4e5166be79ad tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] [instance: da55749a-1b96-4341-a947-9062b0d33eb2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:28.948902 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f057052-fbb9-4915-b66f-4e5166be79ad tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:28.949638 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f057052-fbb9-4915-b66f-4e5166be79ad tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:28.950493 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f057052-fbb9-4915-b66f-4e5166be79ad tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:28.951665 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f057052-fbb9-4915-b66f-4e5166be79ad tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:28.952636 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f057052-fbb9-4915-b66f-4e5166be79ad tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:28.953409 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f057052-fbb9-4915-b66f-4e5166be79ad tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:29.165194 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5f057052-fbb9-4915-b66f-4e5166be79ad tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2c4d9c50fe4c08b3619994e94470c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14c7253bf944819d3b6e203ea4b9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:29.175372 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5f057052-fbb9-4915-b66f-4e5166be79ad tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] 10.222.0.39 "GET /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2" status: 200 len: 1527 microversion: 2.1 time: 0.239374 Aug 07 01:31:29.191998 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1982/4294] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:28 2022] GET /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2 => generated 1527 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:29.191998 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2bdced73-3221-4153-bcea-770f0eaab943 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:29.191998 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2bdced73-3221-4153-bcea-770f0eaab943 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: f6b31167-8c76-4749-88b4-d8380d9b9a84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:29.201416 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2bdced73-3221-4153-bcea-770f0eaab943 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:29.201929 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2bdced73-3221-4153-bcea-770f0eaab943 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:29.202382 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2bdced73-3221-4153-bcea-770f0eaab943 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:29.203127 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2bdced73-3221-4153-bcea-770f0eaab943 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:29.203600 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2bdced73-3221-4153-bcea-770f0eaab943 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:29.216845 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2bdced73-3221-4153-bcea-770f0eaab943 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:29.266640 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-2bdced73-3221-4153-bcea-770f0eaab943 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] HTTP exception thrown: Instance f6b31167-8c76-4749-88b4-d8380d9b9a84 could not be found. Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2bdced73-3221-4153-bcea-770f0eaab943 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Request method failure captured: Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84 HTTP/1.1 Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xRoqM1ZK4H7GtvmxWX9ofAmOsKF2OdU6k1rehi-6yk86CpmfTNVcE0kwd9G1ahgJHyDlEB2bKz4XbnD5Ku_zcl240Q-kfWeKv3HfC_GyXmFAQWa4hNXP2nUgxgBXBe_oBb5a-t1xlRXFxfo9n87AmGbLBI9ZdV03LZwWshVd2n0WvE Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5506f7c95c1a46c5b3966597764b0111", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d1f0c01c340940388b440932d51988ff Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: exception: Instance f6b31167-8c76-4749-88b4-d8380d9b9a84 could not be found. Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'f6b31167-8c76-4749-88b4-d8380d9b9a84'} Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6b31167-8c76-4749-88b4-d8380d9b9a84 could not be found. Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:31:29.268514 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:31:29.274034 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6b31167-8c76-4749-88b4-d8380d9b9a84 could not be found. Aug 07 01:31:29.274034 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:29.274034 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:29.274034 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:29.274034 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:29.274034 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:29.274034 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:29.274034 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:31:29.274034 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:31:29.274034 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6b31167-8c76-4749-88b4-d8380d9b9a84 could not be found. Aug 07 01:31:29.274034 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:29.276121 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2bdced73-3221-4153-bcea-770f0eaab943 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Returning 404 to user: Instance f6b31167-8c76-4749-88b4-d8380d9b9a84 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:31:29.277228 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2bdced73-3221-4153-bcea-770f0eaab943 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84" status: 404 len: 111 microversion: 2.1 time: 0.097920 Aug 07 01:31:29.277989 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1983/4295] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:31:29 2022] DELETE /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:31:29.283254 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-d407b4cb-8726-4ae1-8645-9a2cbb41cbea req-0233cd12-7448-4000-9c23-3c72856edfc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a00f6b81-d0b5-434f-a861-53cbcf107219", "name": "network-vif-plugged", "status": "completed", "tag": "d195799a-8bcf-49dd-ada2-d86a279b6b61"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:29.296749 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d407b4cb-8726-4ae1-8645-9a2cbb41cbea req-0233cd12-7448-4000-9c23-3c72856edfc7 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:29.297558 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d407b4cb-8726-4ae1-8645-9a2cbb41cbea req-0233cd12-7448-4000-9c23-3c72856edfc7 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:29.298179 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d407b4cb-8726-4ae1-8645-9a2cbb41cbea req-0233cd12-7448-4000-9c23-3c72856edfc7 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:29.312836 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-d407b4cb-8726-4ae1-8645-9a2cbb41cbea req-0233cd12-7448-4000-9c23-3c72856edfc7 service nova] Creating event network-vif-plugged:d195799a-8bcf-49dd-ada2-d86a279b6b61 for instance a00f6b81-d0b5-434f-a861-53cbcf107219 on n-h1-master-1 Aug 07 01:31:29.321133 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-d407b4cb-8726-4ae1-8645-9a2cbb41cbea req-0233cd12-7448-4000-9c23-3c72856edfc7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041624 Aug 07 01:31:29.322372 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1984/4296] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:29.424705 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-794d4ea6-bdcd-46c5-8db3-6885777815bf tempest-ServersNegativeTestMultiTenantJSON-963390291 tempest-ServersNegativeTestMultiTenantJSON-963390291-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:29.425307 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-794d4ea6-bdcd-46c5-8db3-6885777815bf tempest-ServersNegativeTestMultiTenantJSON-963390291 tempest-ServersNegativeTestMultiTenantJSON-963390291-project] [instance: da55749a-1b96-4341-a947-9062b0d33eb2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:29.454223 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-794d4ea6-bdcd-46c5-8db3-6885777815bf tempest-ServersNegativeTestMultiTenantJSON-963390291 tempest-ServersNegativeTestMultiTenantJSON-963390291-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:29.454732 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-794d4ea6-bdcd-46c5-8db3-6885777815bf tempest-ServersNegativeTestMultiTenantJSON-963390291 tempest-ServersNegativeTestMultiTenantJSON-963390291-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:29.455184 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-794d4ea6-bdcd-46c5-8db3-6885777815bf tempest-ServersNegativeTestMultiTenantJSON-963390291 tempest-ServersNegativeTestMultiTenantJSON-963390291-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:29.455933 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-794d4ea6-bdcd-46c5-8db3-6885777815bf tempest-ServersNegativeTestMultiTenantJSON-963390291 tempest-ServersNegativeTestMultiTenantJSON-963390291-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:29.456407 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-794d4ea6-bdcd-46c5-8db3-6885777815bf tempest-ServersNegativeTestMultiTenantJSON-963390291 tempest-ServersNegativeTestMultiTenantJSON-963390291-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:29.456836 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-794d4ea6-bdcd-46c5-8db3-6885777815bf tempest-ServersNegativeTestMultiTenantJSON-963390291 tempest-ServersNegativeTestMultiTenantJSON-963390291-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:29.487766 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-794d4ea6-bdcd-46c5-8db3-6885777815bf tempest-ServersNegativeTestMultiTenantJSON-963390291 tempest-ServersNegativeTestMultiTenantJSON-963390291-project] HTTP exception thrown: Instance da55749a-1b96-4341-a947-9062b0d33eb2 could not be found. Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-794d4ea6-bdcd-46c5-8db3-6885777815bf tempest-ServersNegativeTestMultiTenantJSON-963390291 tempest-ServersNegativeTestMultiTenantJSON-963390291-project] Request method failure captured: Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2 HTTP/1.1 Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xXad_UGhbcEIMleunG0EbAlWzlq9wi2kWX7BzB9SqcrSGIpWj2RVAPVzlw3QS7jwLFNY-S5qcqF2Ycgo5BrSAhyRmQgxvsaKNt32cnSYgmrQP-cJDQjLf9OC2U453PR5yO58GOx8dGk7fkyV5Jy60EUyYJ2o1n6GlhAf9p1KqjjuRY Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 3340c6539459423b8d0dc6d92bb16d21 Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-963390291 Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3340c6539459423b8d0dc6d92bb16d21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3340c6539459423b8d0dc6d92bb16d21", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3340c6539459423b8d0dc6d92bb16d21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3340c6539459423b8d0dc6d92bb16d21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-963390291 Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 3340c6539459423b8d0dc6d92bb16d21 Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-963390291 Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersNegativeTestMultiTenantJSON-963390291-project Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 16e2dae4260e4f00bca7e6f928f118ec Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-963390291-project Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: exception: Instance da55749a-1b96-4341-a947-9062b0d33eb2 could not be found. Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'da55749a-1b96-4341-a947-9062b0d33eb2'} Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da55749a-1b96-4341-a947-9062b0d33eb2 could not be found. Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:31:29.490471 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:31:29.494341 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da55749a-1b96-4341-a947-9062b0d33eb2 could not be found. Aug 07 01:31:29.494341 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:29.494341 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:29.494341 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:29.494341 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:29.494341 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:29.494341 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:29.494341 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:31:29.494341 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:31:29.494341 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da55749a-1b96-4341-a947-9062b0d33eb2 could not be found. Aug 07 01:31:29.494341 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:29.496762 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-794d4ea6-bdcd-46c5-8db3-6885777815bf tempest-ServersNegativeTestMultiTenantJSON-963390291 tempest-ServersNegativeTestMultiTenantJSON-963390291-project] Returning 404 to user: Instance da55749a-1b96-4341-a947-9062b0d33eb2 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:31:29.497998 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-794d4ea6-bdcd-46c5-8db3-6885777815bf tempest-ServersNegativeTestMultiTenantJSON-963390291 tempest-ServersNegativeTestMultiTenantJSON-963390291-project] 10.222.0.39 "DELETE /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2" status: 404 len: 111 microversion: 2.1 time: 0.174343 Aug 07 01:31:29.499137 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1985/4297] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:31:29 2022] DELETE /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2 => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:31:29.506617 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c12a74a1-554c-44c3-afe2-eaa0c7c2ada3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:29.507581 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c12a74a1-554c-44c3-afe2-eaa0c7c2ada3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: f6b31167-8c76-4749-88b4-d8380d9b9a84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:29.517170 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c12a74a1-554c-44c3-afe2-eaa0c7c2ada3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:29.518108 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c12a74a1-554c-44c3-afe2-eaa0c7c2ada3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:29.518776 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c12a74a1-554c-44c3-afe2-eaa0c7c2ada3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:29.520116 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c12a74a1-554c-44c3-afe2-eaa0c7c2ada3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:29.520817 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c12a74a1-554c-44c3-afe2-eaa0c7c2ada3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:29.521508 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c12a74a1-554c-44c3-afe2-eaa0c7c2ada3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:29.538889 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-c12a74a1-554c-44c3-afe2-eaa0c7c2ada3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] HTTP exception thrown: Instance f6b31167-8c76-4749-88b4-d8380d9b9a84 could not be found. Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c12a74a1-554c-44c3-afe2-eaa0c7c2ada3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Request method failure captured: Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84 HTTP/1.1 Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xRoqM1ZK4H7GtvmxWX9ofAmOsKF2OdU6k1rehi-6yk86CpmfTNVcE0kwd9G1ahgJHyDlEB2bKz4XbnD5Ku_zcl240Q-kfWeKv3HfC_GyXmFAQWa4hNXP2nUgxgBXBe_oBb5a-t1xlRXFxfo9n87AmGbLBI9ZdV03LZwWshVd2n0WvE Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5506f7c95c1a46c5b3966597764b0111", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d1f0c01c340940388b440932d51988ff Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: exception: Instance f6b31167-8c76-4749-88b4-d8380d9b9a84 could not be found. Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'f6b31167-8c76-4749-88b4-d8380d9b9a84'} Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6b31167-8c76-4749-88b4-d8380d9b9a84 could not be found. Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6b31167-8c76-4749-88b4-d8380d9b9a84 could not be found. Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:29.540785 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:29.544440 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:29.544440 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:29.544440 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:29.544440 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:31:29.544440 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:31:29.544440 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6b31167-8c76-4749-88b4-d8380d9b9a84 could not be found. Aug 07 01:31:29.544440 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:29.546210 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c12a74a1-554c-44c3-afe2-eaa0c7c2ada3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Returning 404 to user: Instance f6b31167-8c76-4749-88b4-d8380d9b9a84 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:31:29.547323 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c12a74a1-554c-44c3-afe2-eaa0c7c2ada3 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84" status: 404 len: 111 microversion: 2.1 time: 0.046901 Aug 07 01:31:29.548675 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1986/4298] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:29 2022] GET /compute/v2.1/servers/f6b31167-8c76-4749-88b4-d8380d9b9a84 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:31:29.554567 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b6eb5dab-6595-40f2-91fe-37d96d6f3905 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:29.555514 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b6eb5dab-6595-40f2-91fe-37d96d6f3905 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:29.563073 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b6eb5dab-6595-40f2-91fe-37d96d6f3905 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:29.563962 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b6eb5dab-6595-40f2-91fe-37d96d6f3905 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:29.564641 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b6eb5dab-6595-40f2-91fe-37d96d6f3905 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:29.565593 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b6eb5dab-6595-40f2-91fe-37d96d6f3905 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:29.566270 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b6eb5dab-6595-40f2-91fe-37d96d6f3905 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:29.567449 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b6eb5dab-6595-40f2-91fe-37d96d6f3905 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:29.784410 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b6eb5dab-6595-40f2-91fe-37d96d6f3905 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:29.793097 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b6eb5dab-6595-40f2-91fe-37d96d6f3905 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 200 len: 1508 microversion: 2.1 time: 0.243077 Aug 07 01:31:29.797900 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1987/4299] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:29 2022] GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 1508 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:29.807600 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-121101bb-d1a5-43fb-bbf4-c0c7da93268f tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:29.808629 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-121101bb-d1a5-43fb-bbf4-c0c7da93268f tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] [instance: da55749a-1b96-4341-a947-9062b0d33eb2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:29.821021 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-121101bb-d1a5-43fb-bbf4-c0c7da93268f tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:29.821875 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-121101bb-d1a5-43fb-bbf4-c0c7da93268f tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:29.823115 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-121101bb-d1a5-43fb-bbf4-c0c7da93268f tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:29.824698 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-121101bb-d1a5-43fb-bbf4-c0c7da93268f tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:29.825832 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-121101bb-d1a5-43fb-bbf4-c0c7da93268f tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:29.826519 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-121101bb-d1a5-43fb-bbf4-c0c7da93268f tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:29.902149 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-24267b38-482e-4dc9-ba87-7612145ca2c7 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:29.913510 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-24267b38-482e-4dc9-ba87-7612145ca2c7 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:29.915096 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-24267b38-482e-4dc9-ba87-7612145ca2c7 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:29.924262 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-24267b38-482e-4dc9-ba87-7612145ca2c7 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 2699 microversion: 2.32 time: 1.350569 Aug 07 01:31:29.928680 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2313/4300] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:31:28 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 2699 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:31:29.933959 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a9300182-65a1-46f1-82ef-c5a190f63b1c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:29.938641 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a9300182-65a1-46f1-82ef-c5a190f63b1c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: dbc593a0-5c59-4d1b-a538-157daf632f2e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:29.958231 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a9300182-65a1-46f1-82ef-c5a190f63b1c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:29.961455 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a9300182-65a1-46f1-82ef-c5a190f63b1c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:29.961771 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a9300182-65a1-46f1-82ef-c5a190f63b1c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:29.962524 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a9300182-65a1-46f1-82ef-c5a190f63b1c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:29.962981 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a9300182-65a1-46f1-82ef-c5a190f63b1c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:29.963408 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a9300182-65a1-46f1-82ef-c5a190f63b1c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:29.996206 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-a9300182-65a1-46f1-82ef-c5a190f63b1c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] HTTP exception thrown: Instance dbc593a0-5c59-4d1b-a538-157daf632f2e could not be found. Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a9300182-65a1-46f1-82ef-c5a190f63b1c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Request method failure captured: Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e HTTP/1.1 Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xRoqM1ZK4H7GtvmxWX9ofAmOsKF2OdU6k1rehi-6yk86CpmfTNVcE0kwd9G1ahgJHyDlEB2bKz4XbnD5Ku_zcl240Q-kfWeKv3HfC_GyXmFAQWa4hNXP2nUgxgBXBe_oBb5a-t1xlRXFxfo9n87AmGbLBI9ZdV03LZwWshVd2n0WvE Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5506f7c95c1a46c5b3966597764b0111", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: d1f0c01c340940388b440932d51988ff Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: exception: Instance dbc593a0-5c59-4d1b-a538-157daf632f2e could not be found. Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'dbc593a0-5c59-4d1b-a538-157daf632f2e'} Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbc593a0-5c59-4d1b-a538-157daf632f2e could not be found. Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:31:29.997820 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:31:30.001307 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbc593a0-5c59-4d1b-a538-157daf632f2e could not be found. Aug 07 01:31:30.001307 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:30.001307 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:30.001307 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:30.001307 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:30.001307 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:30.001307 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:30.001307 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:31:30.001307 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:31:30.001307 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbc593a0-5c59-4d1b-a538-157daf632f2e could not be found. Aug 07 01:31:30.001307 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:30.001307 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a9300182-65a1-46f1-82ef-c5a190f63b1c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Returning 404 to user: Instance dbc593a0-5c59-4d1b-a538-157daf632f2e could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:31:30.001307 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a9300182-65a1-46f1-82ef-c5a190f63b1c tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "DELETE /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e" status: 404 len: 111 microversion: 2.1 time: 0.069238 Aug 07 01:31:30.023313 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2314/4301] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:31:29 2022] DELETE /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:31:30.091656 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-121101bb-d1a5-43fb-bbf4-c0c7da93268f tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2c4d9c50fe4c08b3619994e94470c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14c7253bf944819d3b6e203ea4b9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:30.101425 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-121101bb-d1a5-43fb-bbf4-c0c7da93268f tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] 10.222.0.39 "GET /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2" status: 200 len: 1527 microversion: 2.1 time: 0.301417 Aug 07 01:31:30.113914 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1988/4302] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:29 2022] GET /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2 => generated 1527 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:30.130494 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0cf86c0e-4896-439d-9a43-2c30c1e23cce tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:30.131059 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0cf86c0e-4896-439d-9a43-2c30c1e23cce tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 425b6340-2984-4339-9728-2914b55bd418] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:30.138026 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0cf86c0e-4896-439d-9a43-2c30c1e23cce tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:30.138749 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0cf86c0e-4896-439d-9a43-2c30c1e23cce tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:30.138943 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0cf86c0e-4896-439d-9a43-2c30c1e23cce tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:30.139663 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0cf86c0e-4896-439d-9a43-2c30c1e23cce tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:30.140916 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0cf86c0e-4896-439d-9a43-2c30c1e23cce tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:30.141503 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0cf86c0e-4896-439d-9a43-2c30c1e23cce tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:30.275138 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-402f5a4f-2a5a-4c11-90b2-f22d1621294f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:30.276084 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-402f5a4f-2a5a-4c11-90b2-f22d1621294f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:30.288839 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-402f5a4f-2a5a-4c11-90b2-f22d1621294f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:30.289432 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-402f5a4f-2a5a-4c11-90b2-f22d1621294f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:30.289876 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-402f5a4f-2a5a-4c11-90b2-f22d1621294f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:30.290962 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-402f5a4f-2a5a-4c11-90b2-f22d1621294f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:30.291094 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-402f5a4f-2a5a-4c11-90b2-f22d1621294f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:30.291465 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-402f5a4f-2a5a-4c11-90b2-f22d1621294f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:30.343844 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-402f5a4f-2a5a-4c11-90b2-f22d1621294f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:31:30.404877 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0cf86c0e-4896-439d-9a43-2c30c1e23cce tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:30.434919 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0cf86c0e-4896-439d-9a43-2c30c1e23cce tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418" status: 200 len: 1513 microversion: 2.1 time: 0.320651 Aug 07 01:31:30.438168 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1989/4303] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:30 2022] GET /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418 => generated 1513 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:30.443913 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:30.466481 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-86af2eec-ed37-4bd1-89b7-3684a970b201 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:30.474442 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-86af2eec-ed37-4bd1-89b7-3684a970b201 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: dbc593a0-5c59-4d1b-a538-157daf632f2e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:30.492422 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-86af2eec-ed37-4bd1-89b7-3684a970b201 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:30.493914 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-86af2eec-ed37-4bd1-89b7-3684a970b201 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:30.494597 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-86af2eec-ed37-4bd1-89b7-3684a970b201 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:30.510163 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-86af2eec-ed37-4bd1-89b7-3684a970b201 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:30.511077 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-86af2eec-ed37-4bd1-89b7-3684a970b201 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:30.511729 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-86af2eec-ed37-4bd1-89b7-3684a970b201 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:30.520273 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-402f5a4f-2a5a-4c11-90b2-f22d1621294f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "DELETE /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 204 len: 0 microversion: 2.42 time: 0.494522 Aug 07 01:31:30.535801 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2315/4304] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Aug 7 01:31:30 2022] DELETE /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 01:31:30.541119 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0acf79c9-5660-40f9-bd63-e40fa93b0543 tempest-ServersNegativeTestMultiTenantJSON-963390291 tempest-ServersNegativeTestMultiTenantJSON-963390291-project] Action: 'update', calling method: >, body: {"server": {"name": "da55749a-1b96-4341-a947-9062b0d33eb2_new"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:30.542457 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-86af2eec-ed37-4bd1-89b7-3684a970b201 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] HTTP exception thrown: Instance dbc593a0-5c59-4d1b-a538-157daf632f2e could not be found. Aug 07 01:31:30.543779 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0acf79c9-5660-40f9-bd63-e40fa93b0543 tempest-ServersNegativeTestMultiTenantJSON-963390291 tempest-ServersNegativeTestMultiTenantJSON-963390291-project] [instance: da55749a-1b96-4341-a947-9062b0d33eb2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-86af2eec-ed37-4bd1-89b7-3684a970b201 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Request method failure captured: Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e HTTP/1.1 Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xRoqM1ZK4H7GtvmxWX9ofAmOsKF2OdU6k1rehi-6yk86CpmfTNVcE0kwd9G1ahgJHyDlEB2bKz4XbnD5Ku_zcl240Q-kfWeKv3HfC_GyXmFAQWa4hNXP2nUgxgBXBe_oBb5a-t1xlRXFxfo9n87AmGbLBI9ZdV03LZwWshVd2n0WvE Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5506f7c95c1a46c5b3966597764b0111", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d1f0c01c340940388b440932d51988ff Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: exception: Instance dbc593a0-5c59-4d1b-a538-157daf632f2e could not be found. Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'dbc593a0-5c59-4d1b-a538-157daf632f2e'} Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbc593a0-5c59-4d1b-a538-157daf632f2e could not be found. Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbc593a0-5c59-4d1b-a538-157daf632f2e could not be found. Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:30.545703 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:30.549558 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:30.549558 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:30.549558 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:30.549558 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:31:30.549558 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:31:30.549558 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbc593a0-5c59-4d1b-a538-157daf632f2e could not be found. Aug 07 01:31:30.549558 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:30.559142 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-86af2eec-ed37-4bd1-89b7-3684a970b201 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Returning 404 to user: Instance dbc593a0-5c59-4d1b-a538-157daf632f2e could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:31:30.560437 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-86af2eec-ed37-4bd1-89b7-3684a970b201 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e" status: 404 len: 111 microversion: 2.1 time: 0.121190 Aug 07 01:31:30.562056 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1990/4305] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:30 2022] GET /compute/v2.1/servers/dbc593a0-5c59-4d1b-a538-157daf632f2e => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:31:30.573189 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5e1686fc-1cfa-4ee2-95ac-06e7342ffdb3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:30.586997 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5e1686fc-1cfa-4ee2-95ac-06e7342ffdb3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:30.592798 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.compute.servers [None req-5e1686fc-1cfa-4ee2-95ac-06e7342ffdb3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Removing options 'limit' from query {{(pid=119517) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 07 01:31:30.594075 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5e1686fc-1cfa-4ee2-95ac-06e7342ffdb3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Searching by: {'deleted': False, 'project_id': '5f88662ebb674ad99a4d36651dee967a'} {{(pid=119517) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:31:30.595560 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e1686fc-1cfa-4ee2-95ac-06e7342ffdb3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:30.596443 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e1686fc-1cfa-4ee2-95ac-06e7342ffdb3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:30.597106 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e1686fc-1cfa-4ee2-95ac-06e7342ffdb3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:30.602362 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e1686fc-1cfa-4ee2-95ac-06e7342ffdb3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:30.603377 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e1686fc-1cfa-4ee2-95ac-06e7342ffdb3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:30.604151 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e1686fc-1cfa-4ee2-95ac-06e7342ffdb3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:30.604837 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0acf79c9-5660-40f9-bd63-e40fa93b0543 tempest-ServersNegativeTestMultiTenantJSON-963390291 tempest-ServersNegativeTestMultiTenantJSON-963390291-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:30.605342 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0acf79c9-5660-40f9-bd63-e40fa93b0543 tempest-ServersNegativeTestMultiTenantJSON-963390291 tempest-ServersNegativeTestMultiTenantJSON-963390291-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:30.605788 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0acf79c9-5660-40f9-bd63-e40fa93b0543 tempest-ServersNegativeTestMultiTenantJSON-963390291 tempest-ServersNegativeTestMultiTenantJSON-963390291-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:30.607871 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5e1686fc-1cfa-4ee2-95ac-06e7342ffdb3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.044412 Aug 07 01:31:30.613816 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1991/4306] 10.222.0.39 () {58 vars in 1140 bytes} [Sun Aug 7 01:31:30 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:31:30.622602 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0acf79c9-5660-40f9-bd63-e40fa93b0543 tempest-ServersNegativeTestMultiTenantJSON-963390291 tempest-ServersNegativeTestMultiTenantJSON-963390291-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:30.623560 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-72ab33b3-bf7d-4129-b680-90b429bdeaa6 req-dc7002b1-885d-4496-8c99-5b2dcee16176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6b31167-8c76-4749-88b4-d8380d9b9a84", "name": "network-vif-deleted", "tag": "4ce61a79-bcb4-4377-8c9e-966c9c1e1752"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:30.626262 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0acf79c9-5660-40f9-bd63-e40fa93b0543 tempest-ServersNegativeTestMultiTenantJSON-963390291 tempest-ServersNegativeTestMultiTenantJSON-963390291-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:30.629477 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0acf79c9-5660-40f9-bd63-e40fa93b0543 tempest-ServersNegativeTestMultiTenantJSON-963390291 tempest-ServersNegativeTestMultiTenantJSON-963390291-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:30.652637 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-72ab33b3-bf7d-4129-b680-90b429bdeaa6 req-dc7002b1-885d-4496-8c99-5b2dcee16176 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:30.654065 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-72ab33b3-bf7d-4129-b680-90b429bdeaa6 req-dc7002b1-885d-4496-8c99-5b2dcee16176 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:30.656456 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-72ab33b3-bf7d-4129-b680-90b429bdeaa6 req-dc7002b1-885d-4496-8c99-5b2dcee16176 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:30.670658 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-0acf79c9-5660-40f9-bd63-e40fa93b0543 tempest-ServersNegativeTestMultiTenantJSON-963390291 tempest-ServersNegativeTestMultiTenantJSON-963390291-project] HTTP exception thrown: Instance da55749a-1b96-4341-a947-9062b0d33eb2 could not be found. Aug 07 01:31:30.686495 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-72ab33b3-bf7d-4129-b680-90b429bdeaa6 req-dc7002b1-885d-4496-8c99-5b2dcee16176 service nova] Creating event network-vif-deleted:4ce61a79-bcb4-4377-8c9e-966c9c1e1752 for instance f6b31167-8c76-4749-88b4-d8380d9b9a84 on n-h2-master-1 Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0acf79c9-5660-40f9-bd63-e40fa93b0543 tempest-ServersNegativeTestMultiTenantJSON-963390291 tempest-ServersNegativeTestMultiTenantJSON-963390291-project] Request method failure captured: Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: request: PUT /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2 HTTP/1.1 Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 64 Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xXad_UGhbcEIMleunG0EbAlWzlq9wi2kWX7BzB9SqcrSGIpWj2RVAPVzlw3QS7jwLFNY-S5qcqF2Ycgo5BrSAhyRmQgxvsaKNt32cnSYgmrQP-cJDQjLf9OC2U453PR5yO58GOx8dGk7fkyV5Jy60EUyYJ2o1n6GlhAf9p1KqjjuRY Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 3340c6539459423b8d0dc6d92bb16d21 Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-963390291 Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3340c6539459423b8d0dc6d92bb16d21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3340c6539459423b8d0dc6d92bb16d21", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3340c6539459423b8d0dc6d92bb16d21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3340c6539459423b8d0dc6d92bb16d21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-963390291 Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 3340c6539459423b8d0dc6d92bb16d21 Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-963390291 Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersNegativeTestMultiTenantJSON-963390291-project Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 16e2dae4260e4f00bca7e6f928f118ec Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-963390291-project Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: {"server": {"name": "da55749a-1b96-4341-a947-9062b0d33eb2_new"}} Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: exception: Instance da55749a-1b96-4341-a947-9062b0d33eb2 could not be found. Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'da55749a-1b96-4341-a947-9062b0d33eb2', 'body': {'server': {'name': 'da55749a-1b96-4341-a947-9062b0d33eb2_new'}}} Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da55749a-1b96-4341-a947-9062b0d33eb2 could not be found. Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:31:30.691756 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 07 01:31:30.695512 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 07 01:31:30.695512 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 07 01:31:30.695512 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:31:30.695512 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:31:30.695512 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:31:30.695512 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:31:30.695512 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da55749a-1b96-4341-a947-9062b0d33eb2 could not be found. Aug 07 01:31:30.695512 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:30.695512 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:30.695512 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:30.695512 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:30.695512 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:30.695512 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:30.695512 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:31:30.695512 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:31:30.695512 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da55749a-1b96-4341-a947-9062b0d33eb2 could not be found. Aug 07 01:31:30.695512 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:30.695512 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0acf79c9-5660-40f9-bd63-e40fa93b0543 tempest-ServersNegativeTestMultiTenantJSON-963390291 tempest-ServersNegativeTestMultiTenantJSON-963390291-project] Returning 404 to user: Instance da55749a-1b96-4341-a947-9062b0d33eb2 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:31:30.701013 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0acf79c9-5660-40f9-bd63-e40fa93b0543 tempest-ServersNegativeTestMultiTenantJSON-963390291 tempest-ServersNegativeTestMultiTenantJSON-963390291-project] 10.222.0.39 "PUT /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2" status: 404 len: 111 microversion: 2.1 time: 0.157512 Aug 07 01:31:30.704280 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2316/4307] 10.222.0.39 () {60 vars in 1256 bytes} [Sun Aug 7 01:31:30 2022] PUT /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2 => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:31:30.713468 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-72ab33b3-bf7d-4129-b680-90b429bdeaa6 req-dc7002b1-885d-4496-8c99-5b2dcee16176 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097971 Aug 07 01:31:30.715745 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f0f163b6-022f-45b2-881d-db57535c87c6 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:30.716421 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f0f163b6-022f-45b2-881d-db57535c87c6 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:30.717283 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1992/4308] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:30.735564 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a22fba0a-472e-42a9-86d2-e07dd5b82f28 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:30.736197 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a22fba0a-472e-42a9-86d2-e07dd5b82f28 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:30.737959 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f0f163b6-022f-45b2-881d-db57535c87c6 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:30.738690 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f0f163b6-022f-45b2-881d-db57535c87c6 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:30.739404 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f0f163b6-022f-45b2-881d-db57535c87c6 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:30.740361 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f0f163b6-022f-45b2-881d-db57535c87c6 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:30.741001 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f0f163b6-022f-45b2-881d-db57535c87c6 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:30.741612 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f0f163b6-022f-45b2-881d-db57535c87c6 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:30.753175 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a22fba0a-472e-42a9-86d2-e07dd5b82f28 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:30.754825 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a22fba0a-472e-42a9-86d2-e07dd5b82f28 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:30.755766 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a22fba0a-472e-42a9-86d2-e07dd5b82f28 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:30.762954 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a22fba0a-472e-42a9-86d2-e07dd5b82f28 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:30.763554 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a22fba0a-472e-42a9-86d2-e07dd5b82f28 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:30.764044 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a22fba0a-472e-42a9-86d2-e07dd5b82f28 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:30.801845 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-a22fba0a-472e-42a9-86d2-e07dd5b82f28 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] HTTP exception thrown: Instance aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 could not be found. Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a22fba0a-472e-42a9-86d2-e07dd5b82f28 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Request method failure captured: Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 HTTP/1.1 Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xRoqM1ZK4H7GtvmxWX9ofAmOsKF2OdU6k1rehi-6yk86CpmfTNVcE0kwd9G1ahgJHyDlEB2bKz4XbnD5Ku_zcl240Q-kfWeKv3HfC_GyXmFAQWa4hNXP2nUgxgBXBe_oBb5a-t1xlRXFxfo9n87AmGbLBI9ZdV03LZwWshVd2n0WvE Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5506f7c95c1a46c5b3966597764b0111", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d1f0c01c340940388b440932d51988ff Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: exception: Instance aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 could not be found. Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'aacc9718-ff8d-4ef4-8380-7d863a4b5cd1'} Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 could not be found. Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:31:30.804416 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:31:30.808709 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 could not be found. Aug 07 01:31:30.808709 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:30.808709 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:30.808709 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:30.808709 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:30.808709 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:30.808709 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:30.808709 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:31:30.808709 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:31:30.808709 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 could not be found. Aug 07 01:31:30.808709 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:30.812722 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a22fba0a-472e-42a9-86d2-e07dd5b82f28 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Returning 404 to user: Instance aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:31:30.814968 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a22fba0a-472e-42a9-86d2-e07dd5b82f28 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "DELETE /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 404 len: 111 microversion: 2.1 time: 0.093072 Aug 07 01:31:30.818160 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1993/4309] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:31:30 2022] DELETE /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:31:30.826361 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-0c348f2c-05d0-433e-8c4e-162583ce78b6 req-3104bf21-7ed7-4530-8b42-438a688b872d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77ed645e-669e-4167-ae78-8ce69770babf", "name": "network-vif-deleted", "tag": "20e0f822-dbb7-40fe-862e-071c9953a3bf"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:30.868210 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0c348f2c-05d0-433e-8c4e-162583ce78b6 req-3104bf21-7ed7-4530-8b42-438a688b872d service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:30.868732 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0c348f2c-05d0-433e-8c4e-162583ce78b6 req-3104bf21-7ed7-4530-8b42-438a688b872d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:30.869167 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0c348f2c-05d0-433e-8c4e-162583ce78b6 req-3104bf21-7ed7-4530-8b42-438a688b872d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:30.892514 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-0c348f2c-05d0-433e-8c4e-162583ce78b6 req-3104bf21-7ed7-4530-8b42-438a688b872d service nova] Creating event network-vif-deleted:20e0f822-dbb7-40fe-862e-071c9953a3bf for instance 77ed645e-669e-4167-ae78-8ce69770babf on n-h1-master-1 Aug 07 01:31:30.911751 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-0c348f2c-05d0-433e-8c4e-162583ce78b6 req-3104bf21-7ed7-4530-8b42-438a688b872d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089602 Aug 07 01:31:30.912408 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1994/4310] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:30.938916 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8a729f14-3466-411d-941f-dad6be522b5a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:30.939704 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8a729f14-3466-411d-941f-dad6be522b5a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 425b6340-2984-4339-9728-2914b55bd418] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:30.966056 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a729f14-3466-411d-941f-dad6be522b5a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:30.966542 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a729f14-3466-411d-941f-dad6be522b5a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:30.966990 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a729f14-3466-411d-941f-dad6be522b5a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:30.967723 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a729f14-3466-411d-941f-dad6be522b5a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:30.980454 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a729f14-3466-411d-941f-dad6be522b5a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:30.981337 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a729f14-3466-411d-941f-dad6be522b5a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:31.147031 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f0f163b6-022f-45b2-881d-db57535c87c6 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:31.159310 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f0f163b6-022f-45b2-881d-db57535c87c6 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:31.166174 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f0f163b6-022f-45b2-881d-db57535c87c6 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:31.169336 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f0f163b6-022f-45b2-881d-db57535c87c6 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 2956 microversion: 2.42 time: 0.464010 Aug 07 01:31:31.174274 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2317/4311] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:31:30 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 2956 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:31:31.185715 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4ab461b6-4eb4-4b9d-bc9e-0e01ebb914c6 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:31.186500 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4ab461b6-4eb4-4b9d-bc9e-0e01ebb914c6 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] [instance: da55749a-1b96-4341-a947-9062b0d33eb2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:31.207054 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4ab461b6-4eb4-4b9d-bc9e-0e01ebb914c6 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:31.207831 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4ab461b6-4eb4-4b9d-bc9e-0e01ebb914c6 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:31.211555 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4ab461b6-4eb4-4b9d-bc9e-0e01ebb914c6 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:31.212624 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4ab461b6-4eb4-4b9d-bc9e-0e01ebb914c6 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:31.213253 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4ab461b6-4eb4-4b9d-bc9e-0e01ebb914c6 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:31.213843 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4ab461b6-4eb4-4b9d-bc9e-0e01ebb914c6 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:31.236092 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8a729f14-3466-411d-941f-dad6be522b5a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:31.239361 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:31.250396 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8a729f14-3466-411d-941f-dad6be522b5a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418" status: 200 len: 1513 microversion: 2.1 time: 0.328644 Aug 07 01:31:31.260103 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1995/4312] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:30 2022] GET /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418 => generated 1513 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:31.292652 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2f6116da-1b54-45dc-8db7-c2488d23cc0c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:31.293300 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2f6116da-1b54-45dc-8db7-c2488d23cc0c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:31.317221 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f6116da-1b54-45dc-8db7-c2488d23cc0c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:31.317960 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f6116da-1b54-45dc-8db7-c2488d23cc0c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:31.318160 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f6116da-1b54-45dc-8db7-c2488d23cc0c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:31.318888 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f6116da-1b54-45dc-8db7-c2488d23cc0c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:31.319341 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f6116da-1b54-45dc-8db7-c2488d23cc0c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:31.319770 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f6116da-1b54-45dc-8db7-c2488d23cc0c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:31.322044 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4ab461b6-4eb4-4b9d-bc9e-0e01ebb914c6 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] [instance: da55749a-1b96-4341-a947-9062b0d33eb2] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:31:31.459067 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4ab461b6-4eb4-4b9d-bc9e-0e01ebb914c6 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] 10.222.0.39 "DELETE /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2" status: 204 len: 0 microversion: 2.1 time: 0.283003 Aug 07 01:31:31.463658 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2318/4313] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:31:31 2022] DELETE /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:31:31.471077 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-315a481a-261f-4ccb-acac-cf61b1c506ee tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:31.472178 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-315a481a-261f-4ccb-acac-cf61b1c506ee tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: aacc9718-ff8d-4ef4-8380-7d863a4b5cd1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:31.482035 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-315a481a-261f-4ccb-acac-cf61b1c506ee tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:31.482866 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-315a481a-261f-4ccb-acac-cf61b1c506ee tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:31.483580 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-315a481a-261f-4ccb-acac-cf61b1c506ee tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:31.484808 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-315a481a-261f-4ccb-acac-cf61b1c506ee tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:31.486001 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-315a481a-261f-4ccb-acac-cf61b1c506ee tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:31.486629 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-315a481a-261f-4ccb-acac-cf61b1c506ee tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:31.515277 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-315a481a-261f-4ccb-acac-cf61b1c506ee tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] HTTP exception thrown: Instance aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 could not be found. Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-315a481a-261f-4ccb-acac-cf61b1c506ee tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Request method failure captured: Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 HTTP/1.1 Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xRoqM1ZK4H7GtvmxWX9ofAmOsKF2OdU6k1rehi-6yk86CpmfTNVcE0kwd9G1ahgJHyDlEB2bKz4XbnD5Ku_zcl240Q-kfWeKv3HfC_GyXmFAQWa4hNXP2nUgxgBXBe_oBb5a-t1xlRXFxfo9n87AmGbLBI9ZdV03LZwWshVd2n0WvE Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5506f7c95c1a46c5b3966597764b0111", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: d1f0c01c340940388b440932d51988ff Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: exception: Instance aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 could not be found. Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'aacc9718-ff8d-4ef4-8380-7d863a4b5cd1'} Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 could not be found. Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 could not be found. Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:31.522304 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:31.526141 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:31.526141 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:31.526141 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:31.526141 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:31:31.526141 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:31:31.526141 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 could not be found. Aug 07 01:31:31.526141 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:31.529677 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-315a481a-261f-4ccb-acac-cf61b1c506ee tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Returning 404 to user: Instance aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:31:31.531837 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-315a481a-261f-4ccb-acac-cf61b1c506ee tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1" status: 404 len: 111 microversion: 2.1 time: 0.066038 Aug 07 01:31:31.533849 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2319/4314] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:31 2022] GET /compute/v2.1/servers/aacc9718-ff8d-4ef4-8380-7d863a4b5cd1 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:31:31.543677 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9fd8d5ac-9f17-4bae-a501-d285bb13ad99 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:31.545594 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9fd8d5ac-9f17-4bae-a501-d285bb13ad99 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:31.556620 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9fd8d5ac-9f17-4bae-a501-d285bb13ad99 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:31.557507 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9fd8d5ac-9f17-4bae-a501-d285bb13ad99 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:31.558252 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9fd8d5ac-9f17-4bae-a501-d285bb13ad99 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:31.560703 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9fd8d5ac-9f17-4bae-a501-d285bb13ad99 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:31.561675 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9fd8d5ac-9f17-4bae-a501-d285bb13ad99 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:31.562363 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9fd8d5ac-9f17-4bae-a501-d285bb13ad99 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:31.614601 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2f6116da-1b54-45dc-8db7-c2488d23cc0c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:31.638820 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2f6116da-1b54-45dc-8db7-c2488d23cc0c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 200 len: 1508 microversion: 2.1 time: 0.376250 Aug 07 01:31:31.640243 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1996/4315] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:31 2022] GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 1508 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:31.646864 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-42235ea6-bffa-40f3-8ff2-40c5d19f3494 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:31.647868 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-42235ea6-bffa-40f3-8ff2-40c5d19f3494 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: cd399490-133f-43a2-b0b7-ed5448e52dab] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:31.654541 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-42235ea6-bffa-40f3-8ff2-40c5d19f3494 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:31.655355 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-42235ea6-bffa-40f3-8ff2-40c5d19f3494 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:31.656078 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-42235ea6-bffa-40f3-8ff2-40c5d19f3494 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:31.657033 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-42235ea6-bffa-40f3-8ff2-40c5d19f3494 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:31.657750 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-42235ea6-bffa-40f3-8ff2-40c5d19f3494 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:31.658380 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-42235ea6-bffa-40f3-8ff2-40c5d19f3494 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:31.918136 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-42235ea6-bffa-40f3-8ff2-40c5d19f3494 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:31.926812 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-42235ea6-bffa-40f3-8ff2-40c5d19f3494 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/cd399490-133f-43a2-b0b7-ed5448e52dab" status: 200 len: 1511 microversion: 2.1 time: 0.285055 Aug 07 01:31:31.940860 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1997/4316] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:31 2022] GET /compute/v2.1/servers/cd399490-133f-43a2-b0b7-ed5448e52dab => generated 1511 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:31.948955 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bbdcc146-6890-421d-8453-a8a29a38ee56 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:31.949755 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bbdcc146-6890-421d-8453-a8a29a38ee56 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] [instance: da55749a-1b96-4341-a947-9062b0d33eb2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:31.956323 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbdcc146-6890-421d-8453-a8a29a38ee56 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:31.957216 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbdcc146-6890-421d-8453-a8a29a38ee56 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:31.958055 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbdcc146-6890-421d-8453-a8a29a38ee56 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:31.959049 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbdcc146-6890-421d-8453-a8a29a38ee56 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:31.959655 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbdcc146-6890-421d-8453-a8a29a38ee56 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:31.960271 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbdcc146-6890-421d-8453-a8a29a38ee56 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:32.175231 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bbdcc146-6890-421d-8453-a8a29a38ee56 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2c4d9c50fe4c08b3619994e94470c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14c7253bf944819d3b6e203ea4b9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:32.185523 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bbdcc146-6890-421d-8453-a8a29a38ee56 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] 10.222.0.39 "GET /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2" status: 200 len: 1533 microversion: 2.1 time: 0.242474 Aug 07 01:31:32.186857 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1998/4317] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:31 2022] GET /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2 => generated 1533 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:32.192435 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-265565fd-290d-4f21-964b-96fa9481bd4b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:32.193242 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-265565fd-290d-4f21-964b-96fa9481bd4b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6d4bf33c-473a-445e-8194-29cbf0b4f1ac] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:32.200482 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-265565fd-290d-4f21-964b-96fa9481bd4b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:32.201252 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-265565fd-290d-4f21-964b-96fa9481bd4b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:32.201871 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-265565fd-290d-4f21-964b-96fa9481bd4b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:32.202806 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-265565fd-290d-4f21-964b-96fa9481bd4b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:32.203447 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-265565fd-290d-4f21-964b-96fa9481bd4b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:32.204185 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-265565fd-290d-4f21-964b-96fa9481bd4b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:32.222118 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-265565fd-290d-4f21-964b-96fa9481bd4b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] HTTP exception thrown: Instance 6d4bf33c-473a-445e-8194-29cbf0b4f1ac could not be found. Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-265565fd-290d-4f21-964b-96fa9481bd4b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Request method failure captured: Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac HTTP/1.1 Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xRoqM1ZK4H7GtvmxWX9ofAmOsKF2OdU6k1rehi-6yk86CpmfTNVcE0kwd9G1ahgJHyDlEB2bKz4XbnD5Ku_zcl240Q-kfWeKv3HfC_GyXmFAQWa4hNXP2nUgxgBXBe_oBb5a-t1xlRXFxfo9n87AmGbLBI9ZdV03LZwWshVd2n0WvE Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5506f7c95c1a46c5b3966597764b0111", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d1f0c01c340940388b440932d51988ff Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 6d4bf33c-473a-445e-8194-29cbf0b4f1ac could not be found. Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '6d4bf33c-473a-445e-8194-29cbf0b4f1ac'} Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d4bf33c-473a-445e-8194-29cbf0b4f1ac could not be found. Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:31:32.224230 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:31:32.227707 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d4bf33c-473a-445e-8194-29cbf0b4f1ac could not be found. Aug 07 01:31:32.227707 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:32.227707 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:32.227707 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:32.227707 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:32.227707 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:32.227707 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:32.227707 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:31:32.227707 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:31:32.227707 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d4bf33c-473a-445e-8194-29cbf0b4f1ac could not be found. Aug 07 01:31:32.227707 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:32.230053 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-265565fd-290d-4f21-964b-96fa9481bd4b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Returning 404 to user: Instance 6d4bf33c-473a-445e-8194-29cbf0b4f1ac could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:31:32.231161 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-265565fd-290d-4f21-964b-96fa9481bd4b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac" status: 404 len: 111 microversion: 2.1 time: 0.043088 Aug 07 01:31:32.231968 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 1999/4318] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:31:32 2022] DELETE /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:31:32.237374 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-18d4f1b4-cb8f-4c58-bdf1-76a205d79901 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:32.238843 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-18d4f1b4-cb8f-4c58-bdf1-76a205d79901 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 283ecb61-1e24-4f11-938e-ff33e79c34cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:32.246074 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-18d4f1b4-cb8f-4c58-bdf1-76a205d79901 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:32.246912 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-18d4f1b4-cb8f-4c58-bdf1-76a205d79901 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:32.247555 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-18d4f1b4-cb8f-4c58-bdf1-76a205d79901 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:32.248589 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-18d4f1b4-cb8f-4c58-bdf1-76a205d79901 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:32.249344 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-18d4f1b4-cb8f-4c58-bdf1-76a205d79901 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:32.250720 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-18d4f1b4-cb8f-4c58-bdf1-76a205d79901 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:32.416575 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9fd8d5ac-9f17-4bae-a501-d285bb13ad99 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:32.428051 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9fd8d5ac-9f17-4bae-a501-d285bb13ad99 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:32.437584 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9fd8d5ac-9f17-4bae-a501-d285bb13ad99 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:32.441805 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9fd8d5ac-9f17-4bae-a501-d285bb13ad99 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 2699 microversion: 2.32 time: 0.905055 Aug 07 01:31:32.459923 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2320/4319] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:31:31 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 2699 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:31:32.459923 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2dd75a2b-a13e-4124-a04e-e1ee7ddcf812 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:32.459923 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2dd75a2b-a13e-4124-a04e-e1ee7ddcf812 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:32.472267 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2dd75a2b-a13e-4124-a04e-e1ee7ddcf812 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:32.476113 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2dd75a2b-a13e-4124-a04e-e1ee7ddcf812 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:32.476590 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2dd75a2b-a13e-4124-a04e-e1ee7ddcf812 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:32.477362 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2dd75a2b-a13e-4124-a04e-e1ee7ddcf812 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:32.477841 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2dd75a2b-a13e-4124-a04e-e1ee7ddcf812 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:32.478281 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2dd75a2b-a13e-4124-a04e-e1ee7ddcf812 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:32.509232 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-18d4f1b4-cb8f-4c58-bdf1-76a205d79901 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:32.517430 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-18d4f1b4-cb8f-4c58-bdf1-76a205d79901 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd" status: 200 len: 1511 microversion: 2.1 time: 0.284119 Aug 07 01:31:32.525470 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2000/4320] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:32 2022] GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd => generated 1511 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:32.530812 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3bfae3ba-1be8-4c3d-b66c-7c4f99d04628 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:32.535942 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3bfae3ba-1be8-4c3d-b66c-7c4f99d04628 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6d4bf33c-473a-445e-8194-29cbf0b4f1ac] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:32.547597 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3bfae3ba-1be8-4c3d-b66c-7c4f99d04628 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:32.548409 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3bfae3ba-1be8-4c3d-b66c-7c4f99d04628 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:32.549023 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3bfae3ba-1be8-4c3d-b66c-7c4f99d04628 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:32.555816 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3bfae3ba-1be8-4c3d-b66c-7c4f99d04628 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:32.556568 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3bfae3ba-1be8-4c3d-b66c-7c4f99d04628 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:32.557161 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3bfae3ba-1be8-4c3d-b66c-7c4f99d04628 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:32.590066 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-3bfae3ba-1be8-4c3d-b66c-7c4f99d04628 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] HTTP exception thrown: Instance 6d4bf33c-473a-445e-8194-29cbf0b4f1ac could not be found. Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3bfae3ba-1be8-4c3d-b66c-7c4f99d04628 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Request method failure captured: Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac HTTP/1.1 Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xRoqM1ZK4H7GtvmxWX9ofAmOsKF2OdU6k1rehi-6yk86CpmfTNVcE0kwd9G1ahgJHyDlEB2bKz4XbnD5Ku_zcl240Q-kfWeKv3HfC_GyXmFAQWa4hNXP2nUgxgBXBe_oBb5a-t1xlRXFxfo9n87AmGbLBI9ZdV03LZwWshVd2n0WvE Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5506f7c95c1a46c5b3966597764b0111", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d1f0c01c340940388b440932d51988ff Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 6d4bf33c-473a-445e-8194-29cbf0b4f1ac could not be found. Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '6d4bf33c-473a-445e-8194-29cbf0b4f1ac'} Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d4bf33c-473a-445e-8194-29cbf0b4f1ac could not be found. Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d4bf33c-473a-445e-8194-29cbf0b4f1ac could not be found. Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:32.595795 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:32.599922 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:32.599922 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:32.599922 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:32.599922 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:31:32.599922 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:31:32.599922 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d4bf33c-473a-445e-8194-29cbf0b4f1ac could not be found. Aug 07 01:31:32.599922 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:32.599922 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3bfae3ba-1be8-4c3d-b66c-7c4f99d04628 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Returning 404 to user: Instance 6d4bf33c-473a-445e-8194-29cbf0b4f1ac could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:31:32.599922 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3bfae3ba-1be8-4c3d-b66c-7c4f99d04628 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac" status: 404 len: 111 microversion: 2.1 time: 0.070659 Aug 07 01:31:32.608292 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2001/4321] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:32 2022] GET /compute/v2.1/servers/6d4bf33c-473a-445e-8194-29cbf0b4f1ac => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:31:32.616829 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e5170db3-60e6-4018-bc02-9145c9b6fd4a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:32.632594 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e5170db3-60e6-4018-bc02-9145c9b6fd4a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:32.633582 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e5170db3-60e6-4018-bc02-9145c9b6fd4a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Searching by: {'ip': '172.20.0.10', 'deleted': False, 'project_id': '5f88662ebb674ad99a4d36651dee967a'} {{(pid=119517) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:31:32.780784 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e5170db3-60e6-4018-bc02-9145c9b6fd4a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:32.780951 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e5170db3-60e6-4018-bc02-9145c9b6fd4a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:32.781500 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e5170db3-60e6-4018-bc02-9145c9b6fd4a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:32.782537 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e5170db3-60e6-4018-bc02-9145c9b6fd4a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:32.782703 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e5170db3-60e6-4018-bc02-9145c9b6fd4a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:32.783137 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e5170db3-60e6-4018-bc02-9145c9b6fd4a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:32.996708 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.multi_cell_list [None req-e5170db3-60e6-4018-bc02-9145c9b6fd4a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 01:31:33.122503 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e5170db3-60e6-4018-bc02-9145c9b6fd4a tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers?ip=172.20.0.10" status: 200 len: 346 microversion: 2.1 time: 0.510141 Aug 07 01:31:33.123111 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2002/4322] 10.222.0.39 () {58 vars in 1154 bytes} [Sun Aug 7 01:31:32 2022] GET /compute/v2.1/servers?ip=172.20.0.10 => generated 346 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:33.141709 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-402352a6-cef5-4c5e-857e-e7689847068a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:33.142754 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-402352a6-cef5-4c5e-857e-e7689847068a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 8f35f41f-1a7c-45c0-8958-216eb837382c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:33.150375 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-402352a6-cef5-4c5e-857e-e7689847068a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:33.151091 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-402352a6-cef5-4c5e-857e-e7689847068a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:33.151703 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-402352a6-cef5-4c5e-857e-e7689847068a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:33.152803 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-402352a6-cef5-4c5e-857e-e7689847068a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:33.153415 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-402352a6-cef5-4c5e-857e-e7689847068a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:33.154284 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-402352a6-cef5-4c5e-857e-e7689847068a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:33.173772 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-402352a6-cef5-4c5e-857e-e7689847068a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] HTTP exception thrown: Instance 8f35f41f-1a7c-45c0-8958-216eb837382c could not be found. Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-402352a6-cef5-4c5e-857e-e7689847068a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Request method failure captured: Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c HTTP/1.1 Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xRoqM1ZK4H7GtvmxWX9ofAmOsKF2OdU6k1rehi-6yk86CpmfTNVcE0kwd9G1ahgJHyDlEB2bKz4XbnD5Ku_zcl240Q-kfWeKv3HfC_GyXmFAQWa4hNXP2nUgxgBXBe_oBb5a-t1xlRXFxfo9n87AmGbLBI9ZdV03LZwWshVd2n0WvE Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5506f7c95c1a46c5b3966597764b0111", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d1f0c01c340940388b440932d51988ff Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 8f35f41f-1a7c-45c0-8958-216eb837382c could not be found. Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '8f35f41f-1a7c-45c0-8958-216eb837382c'} Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f35f41f-1a7c-45c0-8958-216eb837382c could not be found. Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:31:33.175713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:31:33.179827 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f35f41f-1a7c-45c0-8958-216eb837382c could not be found. Aug 07 01:31:33.179827 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:33.179827 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:33.179827 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:33.179827 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:33.179827 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:33.179827 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:33.179827 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:31:33.179827 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:31:33.179827 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f35f41f-1a7c-45c0-8958-216eb837382c could not be found. Aug 07 01:31:33.179827 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:33.181658 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-402352a6-cef5-4c5e-857e-e7689847068a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Returning 404 to user: Instance 8f35f41f-1a7c-45c0-8958-216eb837382c could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:31:33.182914 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-402352a6-cef5-4c5e-857e-e7689847068a tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c" status: 404 len: 111 microversion: 2.1 time: 0.045646 Aug 07 01:31:33.183687 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2003/4323] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:31:33 2022] DELETE /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:31:33.194114 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e1526639-aec1-4cf0-be00-7a814a402229 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:33.194977 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e1526639-aec1-4cf0-be00-7a814a402229 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:33.202912 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1526639-aec1-4cf0-be00-7a814a402229 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:33.205582 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1526639-aec1-4cf0-be00-7a814a402229 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:33.206249 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1526639-aec1-4cf0-be00-7a814a402229 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:33.207854 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1526639-aec1-4cf0-be00-7a814a402229 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:33.208610 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1526639-aec1-4cf0-be00-7a814a402229 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:33.209244 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1526639-aec1-4cf0-be00-7a814a402229 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:33.361388 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2dd75a2b-a13e-4124-a04e-e1ee7ddcf812 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:33.375149 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2dd75a2b-a13e-4124-a04e-e1ee7ddcf812 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:33.376715 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2dd75a2b-a13e-4124-a04e-e1ee7ddcf812 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:33.378194 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2dd75a2b-a13e-4124-a04e-e1ee7ddcf812 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 2956 microversion: 2.42 time: 0.932137 Aug 07 01:31:33.379277 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2321/4324] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:31:32 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 2956 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:31:33.408653 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c29cccaf-bc97-4bdf-9c75-3379be7eeba6 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:33.409681 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c29cccaf-bc97-4bdf-9c75-3379be7eeba6 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 425b6340-2984-4339-9728-2914b55bd418] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:33.410569 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e1526639-aec1-4cf0-be00-7a814a402229 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:33.420049 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e1526639-aec1-4cf0-be00-7a814a402229 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 200 len: 1508 microversion: 2.1 time: 0.231659 Aug 07 01:31:33.421255 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2004/4325] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:33 2022] GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 1508 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:33.425241 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c29cccaf-bc97-4bdf-9c75-3379be7eeba6 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:33.426505 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c29cccaf-bc97-4bdf-9c75-3379be7eeba6 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:33.427182 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c29cccaf-bc97-4bdf-9c75-3379be7eeba6 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:33.428142 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c29cccaf-bc97-4bdf-9c75-3379be7eeba6 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:33.428273 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-160e6c37-3488-45ff-ae4e-2de9e0d46eb6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:33.428917 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c29cccaf-bc97-4bdf-9c75-3379be7eeba6 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:33.429030 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-160e6c37-3488-45ff-ae4e-2de9e0d46eb6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 8f35f41f-1a7c-45c0-8958-216eb837382c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:33.429638 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c29cccaf-bc97-4bdf-9c75-3379be7eeba6 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:33.436297 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-160e6c37-3488-45ff-ae4e-2de9e0d46eb6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:33.437546 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-160e6c37-3488-45ff-ae4e-2de9e0d46eb6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:33.438055 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-160e6c37-3488-45ff-ae4e-2de9e0d46eb6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:33.438781 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-160e6c37-3488-45ff-ae4e-2de9e0d46eb6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:33.439366 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-160e6c37-3488-45ff-ae4e-2de9e0d46eb6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:33.439797 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-160e6c37-3488-45ff-ae4e-2de9e0d46eb6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:33.467702 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-160e6c37-3488-45ff-ae4e-2de9e0d46eb6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] HTTP exception thrown: Instance 8f35f41f-1a7c-45c0-8958-216eb837382c could not be found. Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-160e6c37-3488-45ff-ae4e-2de9e0d46eb6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Request method failure captured: Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c HTTP/1.1 Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xRoqM1ZK4H7GtvmxWX9ofAmOsKF2OdU6k1rehi-6yk86CpmfTNVcE0kwd9G1ahgJHyDlEB2bKz4XbnD5Ku_zcl240Q-kfWeKv3HfC_GyXmFAQWa4hNXP2nUgxgBXBe_oBb5a-t1xlRXFxfo9n87AmGbLBI9ZdV03LZwWshVd2n0WvE Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5506f7c95c1a46c5b3966597764b0111", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d1f0c01c340940388b440932d51988ff Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 8f35f41f-1a7c-45c0-8958-216eb837382c could not be found. Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '8f35f41f-1a7c-45c0-8958-216eb837382c'} Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f35f41f-1a7c-45c0-8958-216eb837382c could not be found. Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f35f41f-1a7c-45c0-8958-216eb837382c could not be found. Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:33.474032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:33.477770 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:33.477770 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:33.477770 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:33.477770 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:31:33.477770 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:31:33.477770 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f35f41f-1a7c-45c0-8958-216eb837382c could not be found. Aug 07 01:31:33.477770 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:33.477770 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-160e6c37-3488-45ff-ae4e-2de9e0d46eb6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Returning 404 to user: Instance 8f35f41f-1a7c-45c0-8958-216eb837382c could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:31:33.477770 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-160e6c37-3488-45ff-ae4e-2de9e0d46eb6 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c" status: 404 len: 111 microversion: 2.1 time: 0.053616 Aug 07 01:31:33.477770 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2005/4326] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:33 2022] GET /compute/v2.1/servers/8f35f41f-1a7c-45c0-8958-216eb837382c => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:31:33.501857 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ff77bbca-bdbb-4463-aee8-44cbcbe9536d tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:33.508351 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ff77bbca-bdbb-4463-aee8-44cbcbe9536d tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] [instance: da55749a-1b96-4341-a947-9062b0d33eb2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:33.521413 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ff77bbca-bdbb-4463-aee8-44cbcbe9536d tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:33.522411 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ff77bbca-bdbb-4463-aee8-44cbcbe9536d tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:33.526356 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ff77bbca-bdbb-4463-aee8-44cbcbe9536d tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:33.528449 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ff77bbca-bdbb-4463-aee8-44cbcbe9536d tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:33.530024 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ff77bbca-bdbb-4463-aee8-44cbcbe9536d tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:33.531981 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ff77bbca-bdbb-4463-aee8-44cbcbe9536d tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:33.772523 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ff77bbca-bdbb-4463-aee8-44cbcbe9536d tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2c4d9c50fe4c08b3619994e94470c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14c7253bf944819d3b6e203ea4b9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:33.781079 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ff77bbca-bdbb-4463-aee8-44cbcbe9536d tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] 10.222.0.39 "GET /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2" status: 200 len: 1533 microversion: 2.1 time: 0.302030 Aug 07 01:31:33.787561 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2006/4327] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:33 2022] GET /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2 => generated 1533 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:33.787802 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-209a05bf-bf10-4825-9a06-5745b27e3b56 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:33.788550 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-209a05bf-bf10-4825-9a06-5745b27e3b56 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:33.795631 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-209a05bf-bf10-4825-9a06-5745b27e3b56 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:33.796324 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-209a05bf-bf10-4825-9a06-5745b27e3b56 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:33.796891 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-209a05bf-bf10-4825-9a06-5745b27e3b56 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:33.797760 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-209a05bf-bf10-4825-9a06-5745b27e3b56 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:33.838292 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-209a05bf-bf10-4825-9a06-5745b27e3b56 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:33.838292 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-209a05bf-bf10-4825-9a06-5745b27e3b56 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:34.091442 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-209a05bf-bf10-4825-9a06-5745b27e3b56 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:34.107600 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-209a05bf-bf10-4825-9a06-5745b27e3b56 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:34.108875 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-209a05bf-bf10-4825-9a06-5745b27e3b56 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:34.110130 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-209a05bf-bf10-4825-9a06-5745b27e3b56 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 2413 microversion: 2.32 time: 0.327096 Aug 07 01:31:34.110691 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2007/4328] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:31:33 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 2413 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:31:34.338740 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c29cccaf-bc97-4bdf-9c75-3379be7eeba6 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:34.351424 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c29cccaf-bc97-4bdf-9c75-3379be7eeba6 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418" status: 200 len: 1513 microversion: 2.1 time: 0.958970 Aug 07 01:31:34.365714 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2322/4329] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:33 2022] GET /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418 => generated 1513 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:34.375409 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-01c4c801-da3e-4c5f-9e0d-a97af4734382 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:34.376962 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-01c4c801-da3e-4c5f-9e0d-a97af4734382 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: cd399490-133f-43a2-b0b7-ed5448e52dab] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:34.396571 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-01c4c801-da3e-4c5f-9e0d-a97af4734382 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:34.397110 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-01c4c801-da3e-4c5f-9e0d-a97af4734382 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:34.397564 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-01c4c801-da3e-4c5f-9e0d-a97af4734382 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:34.398317 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-01c4c801-da3e-4c5f-9e0d-a97af4734382 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:34.399204 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-01c4c801-da3e-4c5f-9e0d-a97af4734382 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:34.399642 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-01c4c801-da3e-4c5f-9e0d-a97af4734382 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:34.408799 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-153e76fa-234a-4d77-a8a5-da050c0064a5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:34.409429 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-153e76fa-234a-4d77-a8a5-da050c0064a5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:34.419490 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-153e76fa-234a-4d77-a8a5-da050c0064a5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:34.420022 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-153e76fa-234a-4d77-a8a5-da050c0064a5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:34.420469 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-153e76fa-234a-4d77-a8a5-da050c0064a5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:34.421195 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-153e76fa-234a-4d77-a8a5-da050c0064a5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:34.421656 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-153e76fa-234a-4d77-a8a5-da050c0064a5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:34.430478 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-153e76fa-234a-4d77-a8a5-da050c0064a5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:34.848724 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-01c4c801-da3e-4c5f-9e0d-a97af4734382 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:34.864147 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-01c4c801-da3e-4c5f-9e0d-a97af4734382 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/cd399490-133f-43a2-b0b7-ed5448e52dab" status: 200 len: 1511 microversion: 2.1 time: 0.492897 Aug 07 01:31:34.878239 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2008/4330] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:34 2022] GET /compute/v2.1/servers/cd399490-133f-43a2-b0b7-ed5448e52dab => generated 1511 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:34.894007 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-279c1620-89b8-4fb2-9037-46bede6d426b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:34.896785 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-279c1620-89b8-4fb2-9037-46bede6d426b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:34.904643 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-279c1620-89b8-4fb2-9037-46bede6d426b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:34.905403 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-279c1620-89b8-4fb2-9037-46bede6d426b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:34.906077 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-279c1620-89b8-4fb2-9037-46bede6d426b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:34.907076 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-279c1620-89b8-4fb2-9037-46bede6d426b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:34.907747 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-279c1620-89b8-4fb2-9037-46bede6d426b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:34.909121 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-279c1620-89b8-4fb2-9037-46bede6d426b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:35.285505 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-153e76fa-234a-4d77-a8a5-da050c0064a5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:35.301744 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-153e76fa-234a-4d77-a8a5-da050c0064a5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:35.304009 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-153e76fa-234a-4d77-a8a5-da050c0064a5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:35.310510 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-153e76fa-234a-4d77-a8a5-da050c0064a5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 2956 microversion: 2.42 time: 0.905694 Aug 07 01:31:35.325889 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2323/4331] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:31:34 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 2956 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:31:35.342091 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d331aa48-1e83-4a58-9d80-3f5d2734e5c1 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:35.343024 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d331aa48-1e83-4a58-9d80-3f5d2734e5c1 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] [instance: da55749a-1b96-4341-a947-9062b0d33eb2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:35.354014 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d331aa48-1e83-4a58-9d80-3f5d2734e5c1 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:35.354787 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d331aa48-1e83-4a58-9d80-3f5d2734e5c1 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:35.355623 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d331aa48-1e83-4a58-9d80-3f5d2734e5c1 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:35.356664 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d331aa48-1e83-4a58-9d80-3f5d2734e5c1 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:35.357779 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d331aa48-1e83-4a58-9d80-3f5d2734e5c1 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:35.358701 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d331aa48-1e83-4a58-9d80-3f5d2734e5c1 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:35.727318 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d331aa48-1e83-4a58-9d80-3f5d2734e5c1 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2c4d9c50fe4c08b3619994e94470c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec14c7253bf944819d3b6e203ea4b9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:35.729766 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:35.736973 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d331aa48-1e83-4a58-9d80-3f5d2734e5c1 tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] 10.222.0.39 "GET /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2" status: 200 len: 1533 microversion: 2.1 time: 0.409648 Aug 07 01:31:35.748801 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2324/4332] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:35 2022] GET /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2 => generated 1533 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:35.754461 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1d775d50-da85-4356-a980-ddb87488be27 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:35.755400 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1d775d50-da85-4356-a980-ddb87488be27 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 283ecb61-1e24-4f11-938e-ff33e79c34cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:35.768948 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d775d50-da85-4356-a980-ddb87488be27 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:35.770071 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d775d50-da85-4356-a980-ddb87488be27 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:35.770583 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d775d50-da85-4356-a980-ddb87488be27 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:35.771388 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d775d50-da85-4356-a980-ddb87488be27 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:35.772840 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d775d50-da85-4356-a980-ddb87488be27 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:35.775783 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d775d50-da85-4356-a980-ddb87488be27 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:35.968389 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-279c1620-89b8-4fb2-9037-46bede6d426b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:35.990327 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-279c1620-89b8-4fb2-9037-46bede6d426b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 200 len: 1508 microversion: 2.1 time: 1.104887 Aug 07 01:31:35.990647 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2009/4333] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:34 2022] GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 1508 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:36.017631 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-91c408bd-07e4-448a-9647-57ee18b3dce6 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:36.018260 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-91c408bd-07e4-448a-9647-57ee18b3dce6 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:36.049909 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-91c408bd-07e4-448a-9647-57ee18b3dce6 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:36.052505 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-91c408bd-07e4-448a-9647-57ee18b3dce6 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:36.052995 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-91c408bd-07e4-448a-9647-57ee18b3dce6 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:36.056006 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-91c408bd-07e4-448a-9647-57ee18b3dce6 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:36.056503 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-91c408bd-07e4-448a-9647-57ee18b3dce6 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:36.056940 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-91c408bd-07e4-448a-9647-57ee18b3dce6 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:37.102915 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-91c408bd-07e4-448a-9647-57ee18b3dce6 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:37.123541 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-91c408bd-07e4-448a-9647-57ee18b3dce6 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:37.135201 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-91c408bd-07e4-448a-9647-57ee18b3dce6 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:37.140661 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-91c408bd-07e4-448a-9647-57ee18b3dce6 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 2368 microversion: 2.32 time: 1.148489 Aug 07 01:31:37.147393 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2010/4334] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:31:35 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 2368 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:31:37.161388 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-cf47040d-431b-4f0b-a372-bba9e06072af req-345a90d2-f674-4669-be6e-8240276d31e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77ed645e-669e-4167-ae78-8ce69770babf", "name": "network-vif-deleted", "tag": "840656e7-e0bc-4bee-89df-d4b7a1945712"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:37.203369 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-cf47040d-431b-4f0b-a372-bba9e06072af req-345a90d2-f674-4669-be6e-8240276d31e0 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:37.209305 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-cf47040d-431b-4f0b-a372-bba9e06072af req-345a90d2-f674-4669-be6e-8240276d31e0 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:37.210050 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-cf47040d-431b-4f0b-a372-bba9e06072af req-345a90d2-f674-4669-be6e-8240276d31e0 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:37.210811 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1d775d50-da85-4356-a980-ddb87488be27 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:37.221928 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1d775d50-da85-4356-a980-ddb87488be27 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd" status: 200 len: 1511 microversion: 2.1 time: 1.469283 Aug 07 01:31:37.250365 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2325/4335] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:35 2022] GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd => generated 1511 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:37.255653 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-20910d9e-1225-4240-a2b3-603cde9d69ba req-596ecbb5-6531-49bf-b646-425fe1cb93fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da55749a-1b96-4341-a947-9062b0d33eb2", "name": "network-vif-deleted", "tag": "ff9b5ea2-bd6c-4b45-a67e-5fc180b46ce3"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:37.256001 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-cf47040d-431b-4f0b-a372-bba9e06072af req-345a90d2-f674-4669-be6e-8240276d31e0 service nova] Creating event network-vif-deleted:840656e7-e0bc-4bee-89df-d4b7a1945712 for instance 77ed645e-669e-4167-ae78-8ce69770babf on n-h1-master-1 Aug 07 01:31:37.274552 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-cf47040d-431b-4f0b-a372-bba9e06072af req-345a90d2-f674-4669-be6e-8240276d31e0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124889 Aug 07 01:31:37.279201 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-20910d9e-1225-4240-a2b3-603cde9d69ba req-596ecbb5-6531-49bf-b646-425fe1cb93fb service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:37.279693 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-20910d9e-1225-4240-a2b3-603cde9d69ba req-596ecbb5-6531-49bf-b646-425fe1cb93fb service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:37.279812 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2011/4336] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:37.280170 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-20910d9e-1225-4240-a2b3-603cde9d69ba req-596ecbb5-6531-49bf-b646-425fe1cb93fb service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:37.297992 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6a5ebe72-0fa2-47e4-a255-3a37ebd6bdb1 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:37.298717 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6a5ebe72-0fa2-47e4-a255-3a37ebd6bdb1 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:37.315287 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-20910d9e-1225-4240-a2b3-603cde9d69ba req-596ecbb5-6531-49bf-b646-425fe1cb93fb service nova] Creating event network-vif-deleted:ff9b5ea2-bd6c-4b45-a67e-5fc180b46ce3 for instance da55749a-1b96-4341-a947-9062b0d33eb2 on n-h1-master-1 Aug 07 01:31:37.329423 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-20910d9e-1225-4240-a2b3-603cde9d69ba req-596ecbb5-6531-49bf-b646-425fe1cb93fb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077681 Aug 07 01:31:37.330044 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2326/4337] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:37.340905 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a5ebe72-0fa2-47e4-a255-3a37ebd6bdb1 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:37.344451 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a5ebe72-0fa2-47e4-a255-3a37ebd6bdb1 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:37.344950 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a5ebe72-0fa2-47e4-a255-3a37ebd6bdb1 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:37.347993 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-355b2001-60d9-43df-8049-a75283fba95e tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:37.350598 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-355b2001-60d9-43df-8049-a75283fba95e tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] [instance: da55749a-1b96-4341-a947-9062b0d33eb2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:37.351129 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a5ebe72-0fa2-47e4-a255-3a37ebd6bdb1 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:37.353076 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a5ebe72-0fa2-47e4-a255-3a37ebd6bdb1 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:37.353546 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a5ebe72-0fa2-47e4-a255-3a37ebd6bdb1 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:37.364404 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-355b2001-60d9-43df-8049-a75283fba95e tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:37.371502 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-355b2001-60d9-43df-8049-a75283fba95e tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:37.375998 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-355b2001-60d9-43df-8049-a75283fba95e tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:37.385696 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-355b2001-60d9-43df-8049-a75283fba95e tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:37.386596 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-355b2001-60d9-43df-8049-a75283fba95e tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:37.388036 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-355b2001-60d9-43df-8049-a75283fba95e tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:37.423512 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-355b2001-60d9-43df-8049-a75283fba95e tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] HTTP exception thrown: Instance da55749a-1b96-4341-a947-9062b0d33eb2 could not be found. Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-355b2001-60d9-43df-8049-a75283fba95e tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Request method failure captured: Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2 HTTP/1.1 Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xXNIU2SAGXc2jJybkqo7i5e8EywGlkh5iu9dPjLDNyHhXrQIAHMAYxvg81mqsL_sWKMGXkg6qu8CId3JWWrvQ2QDkuNWx7KZPxfLZe0o9cgVlYm_KwgVyuOufK0f47h7nCOiuGUbX6F7_28wSHpCOcDe3O4_UdBlDMBDZZ2ijrdWtw Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: ec14c7253bf944819d3b6e203ea4b9ae Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-830345171 Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ec14c7253bf944819d3b6e203ea4b9ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ec14c7253bf944819d3b6e203ea4b9ae", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ec14c7253bf944819d3b6e203ea4b9ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ec14c7253bf944819d3b6e203ea4b9ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-830345171 Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: ec14c7253bf944819d3b6e203ea4b9ae Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-830345171 Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersNegativeTestMultiTenantJSON-830345171-project Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 8f2c4d9c50fe4c08b3619994e94470c6 Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-830345171-project Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: exception: Instance da55749a-1b96-4341-a947-9062b0d33eb2 could not be found. Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'da55749a-1b96-4341-a947-9062b0d33eb2'} Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da55749a-1b96-4341-a947-9062b0d33eb2 could not be found. Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da55749a-1b96-4341-a947-9062b0d33eb2 could not be found. Aug 07 01:31:37.426531 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:37.430080 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:37.430080 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:37.430080 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:37.430080 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:37.430080 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:37.430080 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:31:37.430080 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:31:37.430080 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da55749a-1b96-4341-a947-9062b0d33eb2 could not be found. Aug 07 01:31:37.430080 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:37.433773 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-355b2001-60d9-43df-8049-a75283fba95e tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] Returning 404 to user: Instance da55749a-1b96-4341-a947-9062b0d33eb2 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:31:37.437479 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-355b2001-60d9-43df-8049-a75283fba95e tempest-ServersNegativeTestMultiTenantJSON-830345171 tempest-ServersNegativeTestMultiTenantJSON-830345171-project] 10.222.0.39 "GET /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2" status: 404 len: 111 microversion: 2.1 time: 0.102712 Aug 07 01:31:37.440772 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2327/4338] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:37 2022] GET /compute/v2.1/servers/da55749a-1b96-4341-a947-9062b0d33eb2 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:31:37.453109 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-35ffdae9-3e30-4dc1-9ab6-b20fb1f00079 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:37.454082 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-35ffdae9-3e30-4dc1-9ab6-b20fb1f00079 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:37.469591 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-35ffdae9-3e30-4dc1-9ab6-b20fb1f00079 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:37.471909 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-35ffdae9-3e30-4dc1-9ab6-b20fb1f00079 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:37.476500 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-35ffdae9-3e30-4dc1-9ab6-b20fb1f00079 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:37.480203 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-35ffdae9-3e30-4dc1-9ab6-b20fb1f00079 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:37.480957 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-35ffdae9-3e30-4dc1-9ab6-b20fb1f00079 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:37.481595 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-35ffdae9-3e30-4dc1-9ab6-b20fb1f00079 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:38.021105 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6a5ebe72-0fa2-47e4-a255-3a37ebd6bdb1 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:38.036740 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6a5ebe72-0fa2-47e4-a255-3a37ebd6bdb1 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:38.046866 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6a5ebe72-0fa2-47e4-a255-3a37ebd6bdb1 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:38.048777 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6a5ebe72-0fa2-47e4-a255-3a37ebd6bdb1 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 2956 microversion: 2.42 time: 0.766867 Aug 07 01:31:38.056406 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2012/4339] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:31:37 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 2956 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:31:38.062286 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-abfc498b-464a-4fb2-9063-370e112fb672 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:38.072711 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-abfc498b-464a-4fb2-9063-370e112fb672 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:38.079140 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-abfc498b-464a-4fb2-9063-370e112fb672 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Searching by: {'deleted': False, 'project_id': '5f88662ebb674ad99a4d36651dee967a'} {{(pid=119517) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:31:38.091903 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-abfc498b-464a-4fb2-9063-370e112fb672 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:38.094173 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-abfc498b-464a-4fb2-9063-370e112fb672 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:38.099319 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-abfc498b-464a-4fb2-9063-370e112fb672 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:38.100550 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-abfc498b-464a-4fb2-9063-370e112fb672 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:38.101189 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-abfc498b-464a-4fb2-9063-370e112fb672 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:38.101775 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-abfc498b-464a-4fb2-9063-370e112fb672 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:38.193463 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.multi_cell_list [None req-abfc498b-464a-4fb2-9063-370e112fb672 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 01:31:38.320476 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-abfc498b-464a-4fb2-9063-370e112fb672 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:38.329214 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-abfc498b-464a-4fb2-9063-370e112fb672 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:38.329893 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-abfc498b-464a-4fb2-9063-370e112fb672 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:38.330482 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-abfc498b-464a-4fb2-9063-370e112fb672 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:39.255207 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-35ffdae9-3e30-4dc1-9ab6-b20fb1f00079 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:39.268471 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-35ffdae9-3e30-4dc1-9ab6-b20fb1f00079 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 200 len: 1508 microversion: 2.1 time: 1.821317 Aug 07 01:31:39.270273 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2328/4340] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:37 2022] GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 1508 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:39.299879 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-63fbbfc2-eb88-4d66-b850-f00f23980a54 req-21e96835-84fc-414d-89f6-8ae7b75e8b28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "799e740e-2304-4bdf-ad6e-ea4817a92b15", "name": "network-vif-unplugged", "status": "completed", "tag": "ed270649-5cff-4279-a1a6-2363fa515342"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:39.329492 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-63fbbfc2-eb88-4d66-b850-f00f23980a54 req-21e96835-84fc-414d-89f6-8ae7b75e8b28 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:39.339163 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-63fbbfc2-eb88-4d66-b850-f00f23980a54 req-21e96835-84fc-414d-89f6-8ae7b75e8b28 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:39.340423 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-63fbbfc2-eb88-4d66-b850-f00f23980a54 req-21e96835-84fc-414d-89f6-8ae7b75e8b28 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:39.370652 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-63fbbfc2-eb88-4d66-b850-f00f23980a54 req-21e96835-84fc-414d-89f6-8ae7b75e8b28 service nova] Creating event network-vif-unplugged:ed270649-5cff-4279-a1a6-2363fa515342 for instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 on n-h1-master-1 Aug 07 01:31:39.393087 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-63fbbfc2-eb88-4d66-b850-f00f23980a54 req-21e96835-84fc-414d-89f6-8ae7b75e8b28 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105549 Aug 07 01:31:39.399213 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2329/4341] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:39.420227 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d38efff3-63f3-49b8-8d1a-5744d9f77a62 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:39.426692 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d38efff3-63f3-49b8-8d1a-5744d9f77a62 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:39.440451 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d38efff3-63f3-49b8-8d1a-5744d9f77a62 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:39.444649 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d38efff3-63f3-49b8-8d1a-5744d9f77a62 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:39.446173 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d38efff3-63f3-49b8-8d1a-5744d9f77a62 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:39.451835 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d38efff3-63f3-49b8-8d1a-5744d9f77a62 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:39.452715 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d38efff3-63f3-49b8-8d1a-5744d9f77a62 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:39.453534 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d38efff3-63f3-49b8-8d1a-5744d9f77a62 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:39.499865 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-abfc498b-464a-4fb2-9063-370e112fb672 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/detail" status: 200 len: 4518 microversion: 2.1 time: 1.442121 Aug 07 01:31:39.500635 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2013/4342] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:31:38 2022] GET /compute/v2.1/servers/detail => generated 4518 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:39.505604 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1db5e3e5-a996-49cb-a727-35c56e3c1b8e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:39.506534 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1db5e3e5-a996-49cb-a727-35c56e3c1b8e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:39.522835 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1db5e3e5-a996-49cb-a727-35c56e3c1b8e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:39.527351 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1db5e3e5-a996-49cb-a727-35c56e3c1b8e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:39.531127 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1db5e3e5-a996-49cb-a727-35c56e3c1b8e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:39.533533 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1db5e3e5-a996-49cb-a727-35c56e3c1b8e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:39.537946 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1db5e3e5-a996-49cb-a727-35c56e3c1b8e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:39.538708 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1db5e3e5-a996-49cb-a727-35c56e3c1b8e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:40.447288 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d38efff3-63f3-49b8-8d1a-5744d9f77a62 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:40.465068 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d38efff3-63f3-49b8-8d1a-5744d9f77a62 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:40.468134 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d38efff3-63f3-49b8-8d1a-5744d9f77a62 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:40.473302 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d38efff3-63f3-49b8-8d1a-5744d9f77a62 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 2209 microversion: 2.32 time: 1.072460 Aug 07 01:31:40.473901 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2330/4343] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:31:39 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 2209 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:31:40.485795 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c21083c8-1e3f-4b73-91c0-ceaa5f1f2978 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:40.487008 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c21083c8-1e3f-4b73-91c0-ceaa5f1f2978 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 2a78e835-73be-4ac9-bfd9-9b13009845ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:40.515317 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c21083c8-1e3f-4b73-91c0-ceaa5f1f2978 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:40.516843 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c21083c8-1e3f-4b73-91c0-ceaa5f1f2978 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:40.518437 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c21083c8-1e3f-4b73-91c0-ceaa5f1f2978 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:40.523547 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c21083c8-1e3f-4b73-91c0-ceaa5f1f2978 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:40.524492 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c21083c8-1e3f-4b73-91c0-ceaa5f1f2978 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:40.525106 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c21083c8-1e3f-4b73-91c0-ceaa5f1f2978 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:40.562116 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-c21083c8-1e3f-4b73-91c0-ceaa5f1f2978 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] HTTP exception thrown: Instance 2a78e835-73be-4ac9-bfd9-9b13009845ca could not be found. Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c21083c8-1e3f-4b73-91c0-ceaa5f1f2978 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Request method failure captured: Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca HTTP/1.1 Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xRoqM1ZK4H7GtvmxWX9ofAmOsKF2OdU6k1rehi-6yk86CpmfTNVcE0kwd9G1ahgJHyDlEB2bKz4XbnD5Ku_zcl240Q-kfWeKv3HfC_GyXmFAQWa4hNXP2nUgxgBXBe_oBb5a-t1xlRXFxfo9n87AmGbLBI9ZdV03LZwWshVd2n0WvE Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5506f7c95c1a46c5b3966597764b0111", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: d1f0c01c340940388b440932d51988ff Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 2a78e835-73be-4ac9-bfd9-9b13009845ca could not be found. Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '2a78e835-73be-4ac9-bfd9-9b13009845ca'} Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a78e835-73be-4ac9-bfd9-9b13009845ca could not be found. Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:31:40.564192 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:31:40.569064 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a78e835-73be-4ac9-bfd9-9b13009845ca could not be found. Aug 07 01:31:40.569064 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:40.569064 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:40.569064 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:40.569064 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:40.569064 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:40.569064 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:40.569064 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:31:40.569064 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:31:40.569064 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a78e835-73be-4ac9-bfd9-9b13009845ca could not be found. Aug 07 01:31:40.569064 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:40.573095 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c21083c8-1e3f-4b73-91c0-ceaa5f1f2978 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Returning 404 to user: Instance 2a78e835-73be-4ac9-bfd9-9b13009845ca could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:31:40.582997 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c21083c8-1e3f-4b73-91c0-ceaa5f1f2978 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca" status: 404 len: 111 microversion: 2.1 time: 0.104307 Aug 07 01:31:40.584020 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2331/4344] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:31:40 2022] DELETE /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:31:40.601611 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-2c0bab1d-450e-4a3f-911f-8721531f9c63 req-ac21eb42-08dd-4649-b28a-8b4659e98e40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77ed645e-669e-4167-ae78-8ce69770babf", "name": "network-vif-deleted", "tag": "266d9506-a2b8-4b18-a0fc-163e3269dd34"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:40.626437 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2c0bab1d-450e-4a3f-911f-8721531f9c63 req-ac21eb42-08dd-4649-b28a-8b4659e98e40 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:40.629761 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2c0bab1d-450e-4a3f-911f-8721531f9c63 req-ac21eb42-08dd-4649-b28a-8b4659e98e40 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:40.633273 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2c0bab1d-450e-4a3f-911f-8721531f9c63 req-ac21eb42-08dd-4649-b28a-8b4659e98e40 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:40.674350 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-2c0bab1d-450e-4a3f-911f-8721531f9c63 req-ac21eb42-08dd-4649-b28a-8b4659e98e40 service nova] Creating event network-vif-deleted:266d9506-a2b8-4b18-a0fc-163e3269dd34 for instance 77ed645e-669e-4167-ae78-8ce69770babf on n-h1-master-1 Aug 07 01:31:40.690451 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-2c0bab1d-450e-4a3f-911f-8721531f9c63 req-ac21eb42-08dd-4649-b28a-8b4659e98e40 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101579 Aug 07 01:31:40.691609 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2332/4345] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:40.707702 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7f805a0f-1040-4ca5-8ccd-ffded8ffcc61 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:40.723365 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7f805a0f-1040-4ca5-8ccd-ffded8ffcc61 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:40.733004 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7f805a0f-1040-4ca5-8ccd-ffded8ffcc61 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '5f88662ebb674ad99a4d36651dee967a'} {{(pid=119516) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:31:40.906153 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f805a0f-1040-4ca5-8ccd-ffded8ffcc61 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:40.911644 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f805a0f-1040-4ca5-8ccd-ffded8ffcc61 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:40.912293 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f805a0f-1040-4ca5-8ccd-ffded8ffcc61 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:40.913446 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f805a0f-1040-4ca5-8ccd-ffded8ffcc61 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:40.914194 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f805a0f-1040-4ca5-8ccd-ffded8ffcc61 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:40.914854 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f805a0f-1040-4ca5-8ccd-ffded8ffcc61 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:41.129801 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.multi_cell_list [None req-7f805a0f-1040-4ca5-8ccd-ffded8ffcc61 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 01:31:41.280011 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7f805a0f-1040-4ca5-8ccd-ffded8ffcc61 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.576487 Aug 07 01:31:41.291491 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2333/4346] 10.222.0.39 () {58 vars in 1150 bytes} [Sun Aug 7 01:31:40 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:41.315547 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6c155cd1-f0bf-459b-a3dc-ce1f35169c78 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:41.317019 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6c155cd1-f0bf-459b-a3dc-ce1f35169c78 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:41.334936 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c155cd1-f0bf-459b-a3dc-ce1f35169c78 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:41.335602 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c155cd1-f0bf-459b-a3dc-ce1f35169c78 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:41.336187 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c155cd1-f0bf-459b-a3dc-ce1f35169c78 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:41.337101 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c155cd1-f0bf-459b-a3dc-ce1f35169c78 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:41.337676 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c155cd1-f0bf-459b-a3dc-ce1f35169c78 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:41.340827 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c155cd1-f0bf-459b-a3dc-ce1f35169c78 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:41.354217 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1db5e3e5-a996-49cb-a727-35c56e3c1b8e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:41.357597 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:41.375718 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1db5e3e5-a996-49cb-a727-35c56e3c1b8e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:41.382765 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1db5e3e5-a996-49cb-a727-35c56e3c1b8e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:41.390738 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1db5e3e5-a996-49cb-a727-35c56e3c1b8e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 2935 microversion: 2.42 time: 1.882551 Aug 07 01:31:41.394677 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2014/4347] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:31:39 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 2935 bytes in 1893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:31:41.407928 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e7ac71ed-b714-4ca3-8968-3aad4601878b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:41.419208 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e7ac71ed-b714-4ca3-8968-3aad4601878b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 2a78e835-73be-4ac9-bfd9-9b13009845ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:41.436967 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7ac71ed-b714-4ca3-8968-3aad4601878b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:41.438903 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7ac71ed-b714-4ca3-8968-3aad4601878b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:41.440992 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7ac71ed-b714-4ca3-8968-3aad4601878b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:41.444513 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7ac71ed-b714-4ca3-8968-3aad4601878b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:41.445147 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7ac71ed-b714-4ca3-8968-3aad4601878b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:41.445702 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7ac71ed-b714-4ca3-8968-3aad4601878b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:41.462135 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-e7ac71ed-b714-4ca3-8968-3aad4601878b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] HTTP exception thrown: Instance 2a78e835-73be-4ac9-bfd9-9b13009845ca could not be found. Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e7ac71ed-b714-4ca3-8968-3aad4601878b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Request method failure captured: Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca HTTP/1.1 Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xRoqM1ZK4H7GtvmxWX9ofAmOsKF2OdU6k1rehi-6yk86CpmfTNVcE0kwd9G1ahgJHyDlEB2bKz4XbnD5Ku_zcl240Q-kfWeKv3HfC_GyXmFAQWa4hNXP2nUgxgBXBe_oBb5a-t1xlRXFxfo9n87AmGbLBI9ZdV03LZwWshVd2n0WvE Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5506f7c95c1a46c5b3966597764b0111", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d1f0c01c340940388b440932d51988ff Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 2a78e835-73be-4ac9-bfd9-9b13009845ca could not be found. Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '2a78e835-73be-4ac9-bfd9-9b13009845ca'} Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a78e835-73be-4ac9-bfd9-9b13009845ca could not be found. Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a78e835-73be-4ac9-bfd9-9b13009845ca could not be found. Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:41.464013 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:41.468235 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:41.468235 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:41.468235 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:41.468235 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:31:41.468235 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:31:41.468235 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a78e835-73be-4ac9-bfd9-9b13009845ca could not be found. Aug 07 01:31:41.468235 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:41.469464 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e7ac71ed-b714-4ca3-8968-3aad4601878b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Returning 404 to user: Instance 2a78e835-73be-4ac9-bfd9-9b13009845ca could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:31:41.471041 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e7ac71ed-b714-4ca3-8968-3aad4601878b tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca" status: 404 len: 111 microversion: 2.1 time: 0.074605 Aug 07 01:31:41.472631 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2015/4348] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:41 2022] GET /compute/v2.1/servers/2a78e835-73be-4ac9-bfd9-9b13009845ca => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:31:41.478376 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c27781ec-a428-42dd-a0bd-513e3cd32722 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:41.485283 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c27781ec-a428-42dd-a0bd-513e3cd32722 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:41.486128 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c27781ec-a428-42dd-a0bd-513e3cd32722 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '5f88662ebb674ad99a4d36651dee967a'} {{(pid=119517) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:31:41.498987 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c27781ec-a428-42dd-a0bd-513e3cd32722 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:41.500067 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c27781ec-a428-42dd-a0bd-513e3cd32722 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:41.500758 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c27781ec-a428-42dd-a0bd-513e3cd32722 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:41.502222 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c27781ec-a428-42dd-a0bd-513e3cd32722 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:41.503136 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c27781ec-a428-42dd-a0bd-513e3cd32722 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:41.503833 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c27781ec-a428-42dd-a0bd-513e3cd32722 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:41.624674 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.multi_cell_list [None req-c27781ec-a428-42dd-a0bd-513e3cd32722 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 01:31:41.726522 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c27781ec-a428-42dd-a0bd-513e3cd32722 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.252552 Aug 07 01:31:41.728277 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2016/4349] 10.222.0.39 () {58 vars in 1212 bytes} [Sun Aug 7 01:31:41 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:41.733477 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-29a387a3-4959-48ec-95e1-4b6462048294 req-2d45be0d-4ce1-4309-855e-2857176c7383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "799e740e-2304-4bdf-ad6e-ea4817a92b15", "name": "network-vif-unplugged", "status": "completed", "tag": "57dd2ceb-1878-4d37-b462-7fa515b4642e"}, {"server_uuid": "799e740e-2304-4bdf-ad6e-ea4817a92b15", "name": "network-vif-unplugged", "status": "completed", "tag": "d4a336ca-825e-45ea-b60b-7c5fc663a27f"}, {"server_uuid": "799e740e-2304-4bdf-ad6e-ea4817a92b15", "name": "network-vif-unplugged", "status": "completed", "tag": "d11b2113-f2e1-4422-8f6b-9bf9b38eea92"}, {"server_uuid": "799e740e-2304-4bdf-ad6e-ea4817a92b15", "name": "network-vif-unplugged", "status": "completed", "tag": "66d655ef-9cf7-49d7-a3ac-b463c6c5f801"}, {"server_uuid": "799e740e-2304-4bdf-ad6e-ea4817a92b15", "name": "network-vif-unplugged", "status": "completed", "tag": "bae6d831-aaf8-4653-86fb-18251963e1b9"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:41.746422 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-29a387a3-4959-48ec-95e1-4b6462048294 req-2d45be0d-4ce1-4309-855e-2857176c7383 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:41.747068 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-29a387a3-4959-48ec-95e1-4b6462048294 req-2d45be0d-4ce1-4309-855e-2857176c7383 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:41.747620 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-29a387a3-4959-48ec-95e1-4b6462048294 req-2d45be0d-4ce1-4309-855e-2857176c7383 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:41.764959 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-29a387a3-4959-48ec-95e1-4b6462048294 req-2d45be0d-4ce1-4309-855e-2857176c7383 service nova] Creating event network-vif-unplugged:57dd2ceb-1878-4d37-b462-7fa515b4642e for instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 on n-h1-master-1 Aug 07 01:31:41.765668 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-29a387a3-4959-48ec-95e1-4b6462048294 req-2d45be0d-4ce1-4309-855e-2857176c7383 service nova] Creating event network-vif-unplugged:d4a336ca-825e-45ea-b60b-7c5fc663a27f for instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 on n-h1-master-1 Aug 07 01:31:41.766176 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-29a387a3-4959-48ec-95e1-4b6462048294 req-2d45be0d-4ce1-4309-855e-2857176c7383 service nova] Creating event network-vif-unplugged:d11b2113-f2e1-4422-8f6b-9bf9b38eea92 for instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 on n-h1-master-1 Aug 07 01:31:41.766675 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-29a387a3-4959-48ec-95e1-4b6462048294 req-2d45be0d-4ce1-4309-855e-2857176c7383 service nova] Creating event network-vif-unplugged:66d655ef-9cf7-49d7-a3ac-b463c6c5f801 for instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 on n-h1-master-1 Aug 07 01:31:41.767174 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-29a387a3-4959-48ec-95e1-4b6462048294 req-2d45be0d-4ce1-4309-855e-2857176c7383 service nova] Creating event network-vif-unplugged:bae6d831-aaf8-4653-86fb-18251963e1b9 for instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 on n-h1-master-1 Aug 07 01:31:41.774557 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-29a387a3-4959-48ec-95e1-4b6462048294 req-2d45be0d-4ce1-4309-855e-2857176c7383 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.044709 Aug 07 01:31:41.782045 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2017/4350] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:41.790843 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2d89126a-cf44-4b75-8276-5f3a61d7cb34 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:41.791704 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2d89126a-cf44-4b75-8276-5f3a61d7cb34 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6492010f-c0b5-4782-b58b-e46c498fe667] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:41.799115 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d89126a-cf44-4b75-8276-5f3a61d7cb34 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:41.799951 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d89126a-cf44-4b75-8276-5f3a61d7cb34 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:41.800653 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d89126a-cf44-4b75-8276-5f3a61d7cb34 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:41.801559 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d89126a-cf44-4b75-8276-5f3a61d7cb34 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:41.803186 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d89126a-cf44-4b75-8276-5f3a61d7cb34 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:41.803829 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d89126a-cf44-4b75-8276-5f3a61d7cb34 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:41.822327 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-2d89126a-cf44-4b75-8276-5f3a61d7cb34 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] HTTP exception thrown: Instance 6492010f-c0b5-4782-b58b-e46c498fe667 could not be found. Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2d89126a-cf44-4b75-8276-5f3a61d7cb34 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Request method failure captured: Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667 HTTP/1.1 Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xRoqM1ZK4H7GtvmxWX9ofAmOsKF2OdU6k1rehi-6yk86CpmfTNVcE0kwd9G1ahgJHyDlEB2bKz4XbnD5Ku_zcl240Q-kfWeKv3HfC_GyXmFAQWa4hNXP2nUgxgBXBe_oBb5a-t1xlRXFxfo9n87AmGbLBI9ZdV03LZwWshVd2n0WvE Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5506f7c95c1a46c5b3966597764b0111", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d1f0c01c340940388b440932d51988ff Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 6492010f-c0b5-4782-b58b-e46c498fe667 could not be found. Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '6492010f-c0b5-4782-b58b-e46c498fe667'} Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6492010f-c0b5-4782-b58b-e46c498fe667 could not be found. Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:31:41.830171 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:31:41.836028 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6492010f-c0b5-4782-b58b-e46c498fe667 could not be found. Aug 07 01:31:41.836028 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:41.836028 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:41.836028 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:41.836028 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:41.836028 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:41.836028 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:41.836028 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:31:41.836028 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:31:41.836028 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6492010f-c0b5-4782-b58b-e46c498fe667 could not be found. Aug 07 01:31:41.836028 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:31:41.838320 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2d89126a-cf44-4b75-8276-5f3a61d7cb34 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Returning 404 to user: Instance 6492010f-c0b5-4782-b58b-e46c498fe667 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:31:41.839389 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2d89126a-cf44-4b75-8276-5f3a61d7cb34 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667" status: 404 len: 111 microversion: 2.1 time: 0.055944 Aug 07 01:31:41.840738 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2018/4351] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:31:41 2022] DELETE /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:31:41.845653 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b3ce26a5-a2a3-4441-a7f6-b665ecd96d9a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:41.846621 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b3ce26a5-a2a3-4441-a7f6-b665ecd96d9a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:41.854319 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b3ce26a5-a2a3-4441-a7f6-b665ecd96d9a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:41.855067 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b3ce26a5-a2a3-4441-a7f6-b665ecd96d9a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:41.855701 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b3ce26a5-a2a3-4441-a7f6-b665ecd96d9a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:41.856635 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b3ce26a5-a2a3-4441-a7f6-b665ecd96d9a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:41.857251 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b3ce26a5-a2a3-4441-a7f6-b665ecd96d9a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:41.857838 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b3ce26a5-a2a3-4441-a7f6-b665ecd96d9a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:42.064016 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6c155cd1-f0bf-459b-a3dc-ce1f35169c78 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:42.071201 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:42.117044 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6c155cd1-f0bf-459b-a3dc-ce1f35169c78 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 200 len: 1508 microversion: 2.1 time: 0.821969 Aug 07 01:31:42.136378 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2334/4352] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:41 2022] GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 1508 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:42.163750 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2a898d69-443e-4e7f-9a95-3fc7ab44e920 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:42.180668 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2a898d69-443e-4e7f-9a95-3fc7ab44e920 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:42.182394 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2a898d69-443e-4e7f-9a95-3fc7ab44e920 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '5f88662ebb674ad99a4d36651dee967a'} {{(pid=119516) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:31:42.189668 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a898d69-443e-4e7f-9a95-3fc7ab44e920 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:42.190495 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a898d69-443e-4e7f-9a95-3fc7ab44e920 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:42.193673 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a898d69-443e-4e7f-9a95-3fc7ab44e920 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:42.195141 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a898d69-443e-4e7f-9a95-3fc7ab44e920 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:42.196063 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a898d69-443e-4e7f-9a95-3fc7ab44e920 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:42.197688 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a898d69-443e-4e7f-9a95-3fc7ab44e920 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:42.424983 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.multi_cell_list [None req-2a898d69-443e-4e7f-9a95-3fc7ab44e920 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 01:31:42.611158 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2a898d69-443e-4e7f-9a95-3fc7ab44e920 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.473054 Aug 07 01:31:42.612391 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2335/4353] 10.222.0.39 () {58 vars in 1196 bytes} [Sun Aug 7 01:31:42 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:42.623538 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-89f8b7ae-4572-4e77-9dc2-9a39790cd2a7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:42.642165 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-89f8b7ae-4572-4e77-9dc2-9a39790cd2a7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] [instance: 6492010f-c0b5-4782-b58b-e46c498fe667] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:42.662012 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:42.664280 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-89f8b7ae-4572-4e77-9dc2-9a39790cd2a7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:42.664964 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-89f8b7ae-4572-4e77-9dc2-9a39790cd2a7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:42.665422 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-89f8b7ae-4572-4e77-9dc2-9a39790cd2a7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:42.666176 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-89f8b7ae-4572-4e77-9dc2-9a39790cd2a7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:42.666643 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-89f8b7ae-4572-4e77-9dc2-9a39790cd2a7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:42.667508 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-89f8b7ae-4572-4e77-9dc2-9a39790cd2a7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:42.721227 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-89f8b7ae-4572-4e77-9dc2-9a39790cd2a7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] HTTP exception thrown: Instance 6492010f-c0b5-4782-b58b-e46c498fe667 could not be found. Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-89f8b7ae-4572-4e77-9dc2-9a39790cd2a7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Request method failure captured: Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667 HTTP/1.1 Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xRoqM1ZK4H7GtvmxWX9ofAmOsKF2OdU6k1rehi-6yk86CpmfTNVcE0kwd9G1ahgJHyDlEB2bKz4XbnD5Ku_zcl240Q-kfWeKv3HfC_GyXmFAQWa4hNXP2nUgxgBXBe_oBb5a-t1xlRXFxfo9n87AmGbLBI9ZdV03LZwWshVd2n0WvE Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5506f7c95c1a46c5b3966597764b0111", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5506f7c95c1a46c5b3966597764b0111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 5506f7c95c1a46c5b3966597764b0111 Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-DeleteServersTestJSON-1156747590 Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: d1f0c01c340940388b440932d51988ff Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-DeleteServersTestJSON-1156747590-project Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 6492010f-c0b5-4782-b58b-e46c498fe667 could not be found. Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '6492010f-c0b5-4782-b58b-e46c498fe667'} Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6492010f-c0b5-4782-b58b-e46c498fe667 could not be found. Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6492010f-c0b5-4782-b58b-e46c498fe667 could not be found. Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:42.723125 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:42.727060 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:42.727060 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:42.727060 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:42.727060 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:31:42.727060 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:31:42.727060 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6492010f-c0b5-4782-b58b-e46c498fe667 could not be found. Aug 07 01:31:42.727060 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:42.727060 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-89f8b7ae-4572-4e77-9dc2-9a39790cd2a7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] Returning 404 to user: Instance 6492010f-c0b5-4782-b58b-e46c498fe667 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:31:42.727060 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-89f8b7ae-4572-4e77-9dc2-9a39790cd2a7 tempest-DeleteServersTestJSON-1156747590 tempest-DeleteServersTestJSON-1156747590-project] 10.222.0.39 "GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667" status: 404 len: 111 microversion: 2.1 time: 0.111695 Aug 07 01:31:42.728315 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2336/4354] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:42 2022] GET /compute/v2.1/servers/6492010f-c0b5-4782-b58b-e46c498fe667 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:31:42.739975 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0e6407fe-c920-4148-b7b8-0e00e36e91f5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:42.740654 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0e6407fe-c920-4148-b7b8-0e00e36e91f5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:42.757875 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0e6407fe-c920-4148-b7b8-0e00e36e91f5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:42.758062 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0e6407fe-c920-4148-b7b8-0e00e36e91f5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:42.759036 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0e6407fe-c920-4148-b7b8-0e00e36e91f5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:42.760775 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0e6407fe-c920-4148-b7b8-0e00e36e91f5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:42.761289 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0e6407fe-c920-4148-b7b8-0e00e36e91f5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:42.763411 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0e6407fe-c920-4148-b7b8-0e00e36e91f5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:42.803658 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b3ce26a5-a2a3-4441-a7f6-b665ecd96d9a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:42.823176 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b3ce26a5-a2a3-4441-a7f6-b665ecd96d9a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:42.829465 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b3ce26a5-a2a3-4441-a7f6-b665ecd96d9a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:42.837314 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b3ce26a5-a2a3-4441-a7f6-b665ecd96d9a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1986 microversion: 2.32 time: 0.995361 Aug 07 01:31:42.853839 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2019/4355] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:31:41 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1986 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:31:42.877415 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6fc277a0-59f2-419c-8298-ac57b832a624 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:42.895450 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6fc277a0-59f2-419c-8298-ac57b832a624 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:42.901796 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6fc277a0-59f2-419c-8298-ac57b832a624 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Searching by: {'name': '1928549615', 'deleted': False, 'project_id': '5f88662ebb674ad99a4d36651dee967a'} {{(pid=119517) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:31:42.925749 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6fc277a0-59f2-419c-8298-ac57b832a624 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:42.926255 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6fc277a0-59f2-419c-8298-ac57b832a624 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:42.935069 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6fc277a0-59f2-419c-8298-ac57b832a624 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:42.936071 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6fc277a0-59f2-419c-8298-ac57b832a624 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:42.936518 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6fc277a0-59f2-419c-8298-ac57b832a624 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:42.942212 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6fc277a0-59f2-419c-8298-ac57b832a624 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:43.165543 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.multi_cell_list [None req-6fc277a0-59f2-419c-8298-ac57b832a624 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 01:31:43.285833 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6fc277a0-59f2-419c-8298-ac57b832a624 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers?name=1928549615" status: 200 len: 346 microversion: 2.1 time: 0.430490 Aug 07 01:31:43.295086 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2020/4356] 10.222.0.39 () {58 vars in 1156 bytes} [Sun Aug 7 01:31:42 2022] GET /compute/v2.1/servers?name=1928549615 => generated 346 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:43.304168 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-18ac20a3-46b9-4431-9d1f-5ec9035213d5 req-75a574c1-fd3d-4ac3-b66f-4853f0f0da1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77ed645e-669e-4167-ae78-8ce69770babf", "name": "network-vif-deleted", "tag": "1268da76-b550-4f84-ab0c-afc461703feb"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:43.340180 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-18ac20a3-46b9-4431-9d1f-5ec9035213d5 req-75a574c1-fd3d-4ac3-b66f-4853f0f0da1d service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:43.340983 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-18ac20a3-46b9-4431-9d1f-5ec9035213d5 req-75a574c1-fd3d-4ac3-b66f-4853f0f0da1d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:43.342515 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-18ac20a3-46b9-4431-9d1f-5ec9035213d5 req-75a574c1-fd3d-4ac3-b66f-4853f0f0da1d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:43.374960 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-18ac20a3-46b9-4431-9d1f-5ec9035213d5 req-75a574c1-fd3d-4ac3-b66f-4853f0f0da1d service nova] Creating event network-vif-deleted:1268da76-b550-4f84-ab0c-afc461703feb for instance 77ed645e-669e-4167-ae78-8ce69770babf on n-h1-master-1 Aug 07 01:31:43.395980 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-18ac20a3-46b9-4431-9d1f-5ec9035213d5 req-75a574c1-fd3d-4ac3-b66f-4853f0f0da1d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099255 Aug 07 01:31:43.401597 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2021/4357] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:43.416172 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-dfc07473-ad56-4d8a-bf02-36d841b8ce3e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:43.419033 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-dfc07473-ad56-4d8a-bf02-36d841b8ce3e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:43.436297 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dfc07473-ad56-4d8a-bf02-36d841b8ce3e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:43.437222 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dfc07473-ad56-4d8a-bf02-36d841b8ce3e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:43.441291 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dfc07473-ad56-4d8a-bf02-36d841b8ce3e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:43.442243 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dfc07473-ad56-4d8a-bf02-36d841b8ce3e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:43.442875 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dfc07473-ad56-4d8a-bf02-36d841b8ce3e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:43.443725 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dfc07473-ad56-4d8a-bf02-36d841b8ce3e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:43.673129 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0e6407fe-c920-4148-b7b8-0e00e36e91f5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:43.686514 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0e6407fe-c920-4148-b7b8-0e00e36e91f5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:43.694880 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0e6407fe-c920-4148-b7b8-0e00e36e91f5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:43.696410 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0e6407fe-c920-4148-b7b8-0e00e36e91f5 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 2914 microversion: 2.42 time: 0.967004 Aug 07 01:31:43.697361 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2337/4358] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:31:42 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 2914 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:31:43.706404 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ccd0f122-49f1-4636-a755-f38e39f3a835 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:43.727219 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ccd0f122-49f1-4636-a755-f38e39f3a835 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:43.727976 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ccd0f122-49f1-4636-a755-f38e39f3a835 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '5f88662ebb674ad99a4d36651dee967a'} {{(pid=119516) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:31:43.747261 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ccd0f122-49f1-4636-a755-f38e39f3a835 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:43.747902 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ccd0f122-49f1-4636-a755-f38e39f3a835 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:43.751873 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ccd0f122-49f1-4636-a755-f38e39f3a835 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:43.754894 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ccd0f122-49f1-4636-a755-f38e39f3a835 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:43.755396 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ccd0f122-49f1-4636-a755-f38e39f3a835 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:43.756224 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ccd0f122-49f1-4636-a755-f38e39f3a835 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:43.995040 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-dfc07473-ad56-4d8a-bf02-36d841b8ce3e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:44.009963 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-dfc07473-ad56-4d8a-bf02-36d841b8ce3e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 200 len: 1508 microversion: 2.1 time: 0.604635 Aug 07 01:31:44.014427 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2022/4359] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:43 2022] GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 1508 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:44.026648 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-aa14abbd-859f-45ef-9391-efbed0eae9bb tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:44.033534 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-aa14abbd-859f-45ef-9391-efbed0eae9bb tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:44.057292 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa14abbd-859f-45ef-9391-efbed0eae9bb tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:44.058920 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa14abbd-859f-45ef-9391-efbed0eae9bb tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:44.061506 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa14abbd-859f-45ef-9391-efbed0eae9bb tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:44.062541 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa14abbd-859f-45ef-9391-efbed0eae9bb tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:44.063384 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa14abbd-859f-45ef-9391-efbed0eae9bb tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:44.066323 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa14abbd-859f-45ef-9391-efbed0eae9bb tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:44.104551 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.multi_cell_list [None req-ccd0f122-49f1-4636-a755-f38e39f3a835 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 01:31:44.218718 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ccd0f122-49f1-4636-a755-f38e39f3a835 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.520153 Aug 07 01:31:44.219661 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2338/4360] 10.222.0.39 () {58 vars in 1154 bytes} [Sun Aug 7 01:31:43 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:44.239635 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-838be0d3-b627-486b-a861-1a5a10edde20 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:44.254073 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-838be0d3-b627-486b-a861-1a5a10edde20 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:44.264939 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-838be0d3-b627-486b-a861-1a5a10edde20 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-192854961', 'deleted': False, 'project_id': '5f88662ebb674ad99a4d36651dee967a'} {{(pid=119516) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:31:44.277707 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-838be0d3-b627-486b-a861-1a5a10edde20 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:44.278367 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-838be0d3-b627-486b-a861-1a5a10edde20 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:44.278823 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-838be0d3-b627-486b-a861-1a5a10edde20 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:44.279226 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-aa14abbd-859f-45ef-9391-efbed0eae9bb tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:44.279584 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-838be0d3-b627-486b-a861-1a5a10edde20 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:44.280082 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-838be0d3-b627-486b-a861-1a5a10edde20 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:44.280517 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-838be0d3-b627-486b-a861-1a5a10edde20 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:44.291580 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-aa14abbd-859f-45ef-9391-efbed0eae9bb tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:44.297965 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-aa14abbd-859f-45ef-9391-efbed0eae9bb tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:44.303325 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-aa14abbd-859f-45ef-9391-efbed0eae9bb tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1604 microversion: 2.32 time: 0.287522 Aug 07 01:31:44.316620 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2023/4361] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:31:44 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1604 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:31:44.523460 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.multi_cell_list [None req-838be0d3-b627-486b-a861-1a5a10edde20 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 01:31:44.688555 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-838be0d3-b627-486b-a861-1a5a10edde20 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-192854961" status: 200 len: 346 microversion: 2.1 time: 0.460779 Aug 07 01:31:44.699471 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2339/4362] 10.222.0.39 () {58 vars in 1228 bytes} [Sun Aug 7 01:31:44 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-192854961 => generated 346 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:44.705308 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-217e96c1-e9d6-4ef9-a6b4-f79049312864 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:44.705956 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-217e96c1-e9d6-4ef9-a6b4-f79049312864 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 283ecb61-1e24-4f11-938e-ff33e79c34cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:44.721065 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-217e96c1-e9d6-4ef9-a6b4-f79049312864 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:44.726687 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1d2d644d-2d63-4abc-a214-eb4d516d5454 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:44.727566 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-217e96c1-e9d6-4ef9-a6b4-f79049312864 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:44.727722 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1d2d644d-2d63-4abc-a214-eb4d516d5454 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:44.736436 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-217e96c1-e9d6-4ef9-a6b4-f79049312864 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:44.738048 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-217e96c1-e9d6-4ef9-a6b4-f79049312864 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:44.742463 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-217e96c1-e9d6-4ef9-a6b4-f79049312864 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:44.742802 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d2d644d-2d63-4abc-a214-eb4d516d5454 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:44.743395 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-217e96c1-e9d6-4ef9-a6b4-f79049312864 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:44.744267 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d2d644d-2d63-4abc-a214-eb4d516d5454 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:44.744725 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d2d644d-2d63-4abc-a214-eb4d516d5454 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:44.745461 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d2d644d-2d63-4abc-a214-eb4d516d5454 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:44.745928 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d2d644d-2d63-4abc-a214-eb4d516d5454 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:44.746360 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d2d644d-2d63-4abc-a214-eb4d516d5454 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:44.812690 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-217e96c1-e9d6-4ef9-a6b4-f79049312864 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 283ecb61-1e24-4f11-938e-ff33e79c34cd] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:31:45.040572 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-217e96c1-e9d6-4ef9-a6b4-f79049312864 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "DELETE /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd" status: 204 len: 0 microversion: 2.1 time: 0.339814 Aug 07 01:31:45.041883 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2024/4363] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:31:44 2022] DELETE /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:31:45.050446 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6823541a-67d3-46f2-9b5b-b179eae7e924 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:45.060865 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6823541a-67d3-46f2-9b5b-b179eae7e924 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:45.063347 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:45.079656 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6823541a-67d3-46f2-9b5b-b179eae7e924 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:45.080616 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6823541a-67d3-46f2-9b5b-b179eae7e924 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:45.082453 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6823541a-67d3-46f2-9b5b-b179eae7e924 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:45.083320 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6823541a-67d3-46f2-9b5b-b179eae7e924 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:45.087766 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6823541a-67d3-46f2-9b5b-b179eae7e924 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:45.088392 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6823541a-67d3-46f2-9b5b-b179eae7e924 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:45.361888 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6823541a-67d3-46f2-9b5b-b179eae7e924 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:45.370344 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6823541a-67d3-46f2-9b5b-b179eae7e924 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 200 len: 1508 microversion: 2.1 time: 0.327106 Aug 07 01:31:45.376145 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2025/4364] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:45 2022] GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 1508 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:45.381830 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-12f3f28e-fa52-4f9a-939f-6641ae58dc8b tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:45.388802 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-12f3f28e-fa52-4f9a-939f-6641ae58dc8b tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 283ecb61-1e24-4f11-938e-ff33e79c34cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:45.408897 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12f3f28e-fa52-4f9a-939f-6641ae58dc8b tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:45.410232 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12f3f28e-fa52-4f9a-939f-6641ae58dc8b tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:45.410931 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12f3f28e-fa52-4f9a-939f-6641ae58dc8b tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:45.411901 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12f3f28e-fa52-4f9a-939f-6641ae58dc8b tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:45.416404 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12f3f28e-fa52-4f9a-939f-6641ae58dc8b tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:45.417221 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12f3f28e-fa52-4f9a-939f-6641ae58dc8b tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:45.675568 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1d2d644d-2d63-4abc-a214-eb4d516d5454 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:45.692914 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1d2d644d-2d63-4abc-a214-eb4d516d5454 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:45.696501 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1d2d644d-2d63-4abc-a214-eb4d516d5454 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:45.698087 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1d2d644d-2d63-4abc-a214-eb4d516d5454 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 2868 microversion: 2.42 time: 0.977285 Aug 07 01:31:45.705085 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2340/4365] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:31:44 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 2868 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:31:45.710508 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-e5b7e624-ee5a-4d5a-a123-6a2a476a167b req-1b1aff5f-2eee-4c1a-abc2-df69b33ba51f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "799e740e-2304-4bdf-ad6e-ea4817a92b15", "name": "network-vif-deleted", "tag": "d11b2113-f2e1-4422-8f6b-9bf9b38eea92"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:45.742443 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e5b7e624-ee5a-4d5a-a123-6a2a476a167b req-1b1aff5f-2eee-4c1a-abc2-df69b33ba51f service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:45.748413 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e5b7e624-ee5a-4d5a-a123-6a2a476a167b req-1b1aff5f-2eee-4c1a-abc2-df69b33ba51f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:45.749213 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e5b7e624-ee5a-4d5a-a123-6a2a476a167b req-1b1aff5f-2eee-4c1a-abc2-df69b33ba51f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:45.774459 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-e5b7e624-ee5a-4d5a-a123-6a2a476a167b req-1b1aff5f-2eee-4c1a-abc2-df69b33ba51f service nova] Creating event network-vif-deleted:d11b2113-f2e1-4422-8f6b-9bf9b38eea92 for instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 on n-h1-master-1 Aug 07 01:31:45.788075 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-e5b7e624-ee5a-4d5a-a123-6a2a476a167b req-1b1aff5f-2eee-4c1a-abc2-df69b33ba51f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081213 Aug 07 01:31:45.789303 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2341/4366] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:45.795166 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a867896d-5af9-465c-a517-66ff7d02d077 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:45.796296 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a867896d-5af9-465c-a517-66ff7d02d077 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:45.805188 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a867896d-5af9-465c-a517-66ff7d02d077 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:45.805941 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a867896d-5af9-465c-a517-66ff7d02d077 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:45.806618 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a867896d-5af9-465c-a517-66ff7d02d077 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:45.807644 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a867896d-5af9-465c-a517-66ff7d02d077 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:45.808375 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a867896d-5af9-465c-a517-66ff7d02d077 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:45.809598 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a867896d-5af9-465c-a517-66ff7d02d077 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:46.036243 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a867896d-5af9-465c-a517-66ff7d02d077 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:46.075606 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a867896d-5af9-465c-a517-66ff7d02d077 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:46.083237 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a867896d-5af9-465c-a517-66ff7d02d077 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:46.085847 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a867896d-5af9-465c-a517-66ff7d02d077 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1604 microversion: 2.32 time: 0.295037 Aug 07 01:31:46.100246 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2342/4367] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:31:45 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1604 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:31:46.322777 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-12f3f28e-fa52-4f9a-939f-6641ae58dc8b tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:46.332807 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-12f3f28e-fa52-4f9a-939f-6641ae58dc8b tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd" status: 200 len: 1517 microversion: 2.1 time: 0.955171 Aug 07 01:31:46.333401 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2026/4368] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:45 2022] GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd => generated 1517 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:46.398986 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6f8944bb-87b1-42c6-9a94-5baa6e825a4d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:46.399870 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6f8944bb-87b1-42c6-9a94-5baa6e825a4d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:46.413146 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f8944bb-87b1-42c6-9a94-5baa6e825a4d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:46.413525 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f8944bb-87b1-42c6-9a94-5baa6e825a4d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:46.414063 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f8944bb-87b1-42c6-9a94-5baa6e825a4d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:46.414981 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f8944bb-87b1-42c6-9a94-5baa6e825a4d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:46.424579 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f8944bb-87b1-42c6-9a94-5baa6e825a4d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:46.425313 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f8944bb-87b1-42c6-9a94-5baa6e825a4d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:46.732249 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c3e65295-0acb-4a74-b069-8465e0cc73b9 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:46.733136 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c3e65295-0acb-4a74-b069-8465e0cc73b9 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:46.745353 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3e65295-0acb-4a74-b069-8465e0cc73b9 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:46.749407 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3e65295-0acb-4a74-b069-8465e0cc73b9 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:46.750070 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3e65295-0acb-4a74-b069-8465e0cc73b9 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:46.750979 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3e65295-0acb-4a74-b069-8465e0cc73b9 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:46.751593 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3e65295-0acb-4a74-b069-8465e0cc73b9 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:46.757988 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3e65295-0acb-4a74-b069-8465e0cc73b9 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:46.850259 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6f8944bb-87b1-42c6-9a94-5baa6e825a4d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:46.862204 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6f8944bb-87b1-42c6-9a94-5baa6e825a4d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 200 len: 1508 microversion: 2.1 time: 0.469020 Aug 07 01:31:46.876812 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2343/4369] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:46 2022] GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 1508 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:47.118888 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-be8fb3e3-3e38-40bd-9677-2fe66f993e03 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:47.119868 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-be8fb3e3-3e38-40bd-9677-2fe66f993e03 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:47.135013 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-be8fb3e3-3e38-40bd-9677-2fe66f993e03 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:47.141899 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-be8fb3e3-3e38-40bd-9677-2fe66f993e03 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:47.142922 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-be8fb3e3-3e38-40bd-9677-2fe66f993e03 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:47.144721 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-be8fb3e3-3e38-40bd-9677-2fe66f993e03 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:47.146852 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-be8fb3e3-3e38-40bd-9677-2fe66f993e03 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:47.150239 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-be8fb3e3-3e38-40bd-9677-2fe66f993e03 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:47.597495 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-be8fb3e3-3e38-40bd-9677-2fe66f993e03 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:47.615853 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-be8fb3e3-3e38-40bd-9677-2fe66f993e03 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:47.620003 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-be8fb3e3-3e38-40bd-9677-2fe66f993e03 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:47.622824 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-be8fb3e3-3e38-40bd-9677-2fe66f993e03 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1604 microversion: 2.32 time: 0.507288 Aug 07 01:31:47.625031 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2344/4370] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:31:47 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1604 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:31:47.633922 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f0819f89-71c8-4575-958f-5298b7c07967 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:47.640082 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f0819f89-71c8-4575-958f-5298b7c07967 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 283ecb61-1e24-4f11-938e-ff33e79c34cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:47.657968 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f0819f89-71c8-4575-958f-5298b7c07967 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:47.658966 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f0819f89-71c8-4575-958f-5298b7c07967 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:47.660205 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f0819f89-71c8-4575-958f-5298b7c07967 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:47.661206 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f0819f89-71c8-4575-958f-5298b7c07967 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:47.664620 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f0819f89-71c8-4575-958f-5298b7c07967 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:47.665405 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f0819f89-71c8-4575-958f-5298b7c07967 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:48.304288 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:48.488828 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c3e65295-0acb-4a74-b069-8465e0cc73b9 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:48.508070 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c3e65295-0acb-4a74-b069-8465e0cc73b9 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:48.514390 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c3e65295-0acb-4a74-b069-8465e0cc73b9 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:48.521592 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c3e65295-0acb-4a74-b069-8465e0cc73b9 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 2754 microversion: 2.42 time: 1.794559 Aug 07 01:31:48.522861 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2027/4371] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:31:46 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 2754 bytes in 1796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:31:48.531399 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4f2bbf07-adae-4e3f-9f60-874df482308c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:48.533945 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4f2bbf07-adae-4e3f-9f60-874df482308c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:48.546282 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f2bbf07-adae-4e3f-9f60-874df482308c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:48.551545 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f2bbf07-adae-4e3f-9f60-874df482308c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:48.552269 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f2bbf07-adae-4e3f-9f60-874df482308c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:48.553176 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f2bbf07-adae-4e3f-9f60-874df482308c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:48.556593 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f2bbf07-adae-4e3f-9f60-874df482308c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:48.557291 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f2bbf07-adae-4e3f-9f60-874df482308c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:48.580924 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f0819f89-71c8-4575-958f-5298b7c07967 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:48.593528 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f0819f89-71c8-4575-958f-5298b7c07967 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd" status: 200 len: 1517 microversion: 2.1 time: 0.966827 Aug 07 01:31:48.595552 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2345/4372] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:47 2022] GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd => generated 1517 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:48.647426 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e2c0301d-2cab-45f2-8879-678c52dd0ecf tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:48.648244 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e2c0301d-2cab-45f2-8879-678c52dd0ecf tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:48.658756 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e2c0301d-2cab-45f2-8879-678c52dd0ecf tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:48.662165 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e2c0301d-2cab-45f2-8879-678c52dd0ecf tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:48.663597 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e2c0301d-2cab-45f2-8879-678c52dd0ecf tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:48.669162 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e2c0301d-2cab-45f2-8879-678c52dd0ecf tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:48.669859 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e2c0301d-2cab-45f2-8879-678c52dd0ecf tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:48.670550 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e2c0301d-2cab-45f2-8879-678c52dd0ecf tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:48.843975 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e2c0301d-2cab-45f2-8879-678c52dd0ecf tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:48.867100 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e2c0301d-2cab-45f2-8879-678c52dd0ecf tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:48.877163 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e2c0301d-2cab-45f2-8879-678c52dd0ecf tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:48.883446 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e2c0301d-2cab-45f2-8879-678c52dd0ecf tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1604 microversion: 2.32 time: 0.241059 Aug 07 01:31:48.901087 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2346/4373] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:31:48 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1604 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:31:49.103224 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e2c0301d-2cab-45f2-8879-678c52dd0ecf tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:49.104246 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e2c0301d-2cab-45f2-8879-678c52dd0ecf tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001387 Aug 07 01:31:49.104598 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2347/4374] 10.222.0.39 () {56 vars in 886 bytes} [Sun Aug 7 01:31:49 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 07 01:31:49.112286 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e2c0301d-2cab-45f2-8879-678c52dd0ecf tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:49.113712 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e2c0301d-2cab-45f2-8879-678c52dd0ecf tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001918 Aug 07 01:31:49.114119 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2348/4375] 10.222.0.39 () {54 vars in 1035 bytes} [Sun Aug 7 01:31:49 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Aug 07 01:31:49.121129 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e2c0301d-2cab-45f2-8879-678c52dd0ecf tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:49.122148 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e2c0301d-2cab-45f2-8879-678c52dd0ecf tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001427 Aug 07 01:31:49.122955 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2349/4376] 10.222.0.39 () {54 vars in 1041 bytes} [Sun Aug 7 01:31:49 2022] GET /compute/v2.1/ => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:31:49.131308 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e2c0301d-2cab-45f2-8879-678c52dd0ecf tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:49.134177 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e2c0301d-2cab-45f2-8879-678c52dd0ecf tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003118 Aug 07 01:31:49.134849 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2350/4377] 10.222.0.39 () {56 vars in 886 bytes} [Sun Aug 7 01:31:49 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Aug 07 01:31:49.551526 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c43e4068-12bb-441c-8cc3-8792b6478e77 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:49.553211 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c43e4068-12bb-441c-8cc3-8792b6478e77 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:49.559017 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4f2bbf07-adae-4e3f-9f60-874df482308c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:49.571926 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4f2bbf07-adae-4e3f-9f60-874df482308c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 200 len: 1508 microversion: 2.1 time: 1.047687 Aug 07 01:31:49.576310 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2028/4378] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:48 2022] GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 1508 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:49.590868 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-1c9c117f-6326-4cb9-936c-2c6ab46b176c req-48014b98-9507-4c01-9a56-cfd79a405406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "283ecb61-1e24-4f11-938e-ff33e79c34cd", "name": "network-vif-deleted", "tag": "3c0c60e2-4754-4ef5-ac53-b399e63f2365"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:49.611625 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c43e4068-12bb-441c-8cc3-8792b6478e77 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:49.612748 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c43e4068-12bb-441c-8cc3-8792b6478e77 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:49.614814 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-1c9c117f-6326-4cb9-936c-2c6ab46b176c req-48014b98-9507-4c01-9a56-cfd79a405406 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:49.617724 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c43e4068-12bb-441c-8cc3-8792b6478e77 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:49.621197 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-1c9c117f-6326-4cb9-936c-2c6ab46b176c req-48014b98-9507-4c01-9a56-cfd79a405406 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:49.621575 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c43e4068-12bb-441c-8cc3-8792b6478e77 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:49.622003 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-1c9c117f-6326-4cb9-936c-2c6ab46b176c req-48014b98-9507-4c01-9a56-cfd79a405406 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:49.622168 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c43e4068-12bb-441c-8cc3-8792b6478e77 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:49.622626 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c43e4068-12bb-441c-8cc3-8792b6478e77 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:49.650372 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-1c9c117f-6326-4cb9-936c-2c6ab46b176c req-48014b98-9507-4c01-9a56-cfd79a405406 service nova] Creating event network-vif-deleted:3c0c60e2-4754-4ef5-ac53-b399e63f2365 for instance 283ecb61-1e24-4f11-938e-ff33e79c34cd on n-h1-master-1 Aug 07 01:31:49.671712 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-1c9c117f-6326-4cb9-936c-2c6ab46b176c req-48014b98-9507-4c01-9a56-cfd79a405406 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090781 Aug 07 01:31:49.674445 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2029/4379] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:31:49.695463 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7477cfba-edf1-443d-a09b-d6f3f48e6947 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:49.696876 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7477cfba-edf1-443d-a09b-d6f3f48e6947 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 283ecb61-1e24-4f11-938e-ff33e79c34cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:49.712258 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7477cfba-edf1-443d-a09b-d6f3f48e6947 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:49.712995 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7477cfba-edf1-443d-a09b-d6f3f48e6947 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:49.713591 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7477cfba-edf1-443d-a09b-d6f3f48e6947 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:49.714474 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7477cfba-edf1-443d-a09b-d6f3f48e6947 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:49.716511 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7477cfba-edf1-443d-a09b-d6f3f48e6947 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:49.717159 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7477cfba-edf1-443d-a09b-d6f3f48e6947 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:50.133088 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7477cfba-edf1-443d-a09b-d6f3f48e6947 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:50.150384 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7477cfba-edf1-443d-a09b-d6f3f48e6947 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd" status: 200 len: 1305 microversion: 2.1 time: 0.473554 Aug 07 01:31:50.159798 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2030/4380] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:49 2022] GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd => generated 1305 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:50.172258 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4b49d8ae-db32-4346-b30f-aabfc4f83325 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:50.173049 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4b49d8ae-db32-4346-b30f-aabfc4f83325 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:50.218248 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b49d8ae-db32-4346-b30f-aabfc4f83325 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:50.219543 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b49d8ae-db32-4346-b30f-aabfc4f83325 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:50.221489 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b49d8ae-db32-4346-b30f-aabfc4f83325 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:50.228524 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b49d8ae-db32-4346-b30f-aabfc4f83325 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:50.250358 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b49d8ae-db32-4346-b30f-aabfc4f83325 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:50.254132 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b49d8ae-db32-4346-b30f-aabfc4f83325 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:50.977186 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4b49d8ae-db32-4346-b30f-aabfc4f83325 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:50.990131 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4b49d8ae-db32-4346-b30f-aabfc4f83325 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:50.997234 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4b49d8ae-db32-4346-b30f-aabfc4f83325 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:51.001410 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4b49d8ae-db32-4346-b30f-aabfc4f83325 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1604 microversion: 2.32 time: 0.840232 Aug 07 01:31:51.002518 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2031/4381] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:31:50 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1604 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:31:51.014204 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-dc1b4d4e-ec2c-47d7-ba2b-7207b9cca0cd tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:51.019023 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-dc1b4d4e-ec2c-47d7-ba2b-7207b9cca0cd tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:51.033336 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c43e4068-12bb-441c-8cc3-8792b6478e77 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:51.043443 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dc1b4d4e-ec2c-47d7-ba2b-7207b9cca0cd tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:51.046395 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dc1b4d4e-ec2c-47d7-ba2b-7207b9cca0cd tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:51.048292 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dc1b4d4e-ec2c-47d7-ba2b-7207b9cca0cd tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:51.049231 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dc1b4d4e-ec2c-47d7-ba2b-7207b9cca0cd tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:51.052068 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dc1b4d4e-ec2c-47d7-ba2b-7207b9cca0cd tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:51.052708 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dc1b4d4e-ec2c-47d7-ba2b-7207b9cca0cd tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:51.059327 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c43e4068-12bb-441c-8cc3-8792b6478e77 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:51.067474 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c43e4068-12bb-441c-8cc3-8792b6478e77 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:51.073428 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c43e4068-12bb-441c-8cc3-8792b6478e77 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 2708 microversion: 2.42 time: 1.525198 Aug 07 01:31:51.076889 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2351/4382] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:31:49 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 2708 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:31:51.117680 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:51.179506 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0a400f42-3f65-48b3-944b-5bf0f25439cf tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:51.180629 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0a400f42-3f65-48b3-944b-5bf0f25439cf tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 283ecb61-1e24-4f11-938e-ff33e79c34cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:51.198161 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a400f42-3f65-48b3-944b-5bf0f25439cf tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:51.201165 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a400f42-3f65-48b3-944b-5bf0f25439cf tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:51.201917 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a400f42-3f65-48b3-944b-5bf0f25439cf tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:51.209493 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a400f42-3f65-48b3-944b-5bf0f25439cf tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:51.211609 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a400f42-3f65-48b3-944b-5bf0f25439cf tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:51.215307 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a400f42-3f65-48b3-944b-5bf0f25439cf tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:51.266852 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-0a400f42-3f65-48b3-944b-5bf0f25439cf tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] HTTP exception thrown: Instance 283ecb61-1e24-4f11-938e-ff33e79c34cd could not be found. Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0a400f42-3f65-48b3-944b-5bf0f25439cf tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Request method failure captured: Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd HTTP/1.1 Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xW1dOl_AyZ5CYYyy1b3ivsdu38cqQpYoovUZbdUC6IO0RHcpAeNJD1cKC1UV6c_n9z0-0ZLM93LqqIj3QUT0NFt_2ErIFHSDjhfe__hMfOjWZTQSmk9cKUIciW2yy0w02vHuv-kCaPI1l5NRsklez5961SIJ32IMVOJg36MKy8fYfE Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 5f88662ebb674ad99a4d36651dee967a Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ListServerFiltersTestJSON-625885988 Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5f88662ebb674ad99a4d36651dee967a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5f88662ebb674ad99a4d36651dee967a", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5f88662ebb674ad99a4d36651dee967a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5f88662ebb674ad99a4d36651dee967a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ListServerFiltersTestJSON-625885988 Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 5f88662ebb674ad99a4d36651dee967a Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-625885988 Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ListServerFiltersTestJSON-625885988-project Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 474a78f0b2784e01b3d2a6ff6694b8bb Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ListServerFiltersTestJSON-625885988-project Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 283ecb61-1e24-4f11-938e-ff33e79c34cd could not be found. Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '283ecb61-1e24-4f11-938e-ff33e79c34cd'} Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 283ecb61-1e24-4f11-938e-ff33e79c34cd could not be found. Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 283ecb61-1e24-4f11-938e-ff33e79c34cd could not be found. Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:51.279630 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:51.284889 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:51.284889 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:51.284889 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:51.284889 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:31:51.284889 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:31:51.284889 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 283ecb61-1e24-4f11-938e-ff33e79c34cd could not be found. Aug 07 01:31:51.284889 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:51.284889 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0a400f42-3f65-48b3-944b-5bf0f25439cf tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Returning 404 to user: Instance 283ecb61-1e24-4f11-938e-ff33e79c34cd could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:31:51.284889 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0a400f42-3f65-48b3-944b-5bf0f25439cf tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd" status: 404 len: 111 microversion: 2.1 time: 0.106676 Aug 07 01:31:51.288988 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2352/4383] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:51 2022] GET /compute/v2.1/servers/283ecb61-1e24-4f11-938e-ff33e79c34cd => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:31:51.305027 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c01b1c8f-f900-482e-9321-da3101bf540c tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:51.305671 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c01b1c8f-f900-482e-9321-da3101bf540c tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: cd399490-133f-43a2-b0b7-ed5448e52dab] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:51.317766 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c01b1c8f-f900-482e-9321-da3101bf540c tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:51.318261 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c01b1c8f-f900-482e-9321-da3101bf540c tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:51.318715 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c01b1c8f-f900-482e-9321-da3101bf540c tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:51.324218 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c01b1c8f-f900-482e-9321-da3101bf540c tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:51.325006 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c01b1c8f-f900-482e-9321-da3101bf540c tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:51.325461 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c01b1c8f-f900-482e-9321-da3101bf540c tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:51.415193 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c01b1c8f-f900-482e-9321-da3101bf540c tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: cd399490-133f-43a2-b0b7-ed5448e52dab] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:31:51.629704 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c01b1c8f-f900-482e-9321-da3101bf540c tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "DELETE /compute/v2.1/servers/cd399490-133f-43a2-b0b7-ed5448e52dab" status: 204 len: 0 microversion: 2.1 time: 0.338663 Aug 07 01:31:51.636309 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2353/4384] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:31:51 2022] DELETE /compute/v2.1/servers/cd399490-133f-43a2-b0b7-ed5448e52dab => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:31:51.645800 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b05eec8e-ab7d-4adb-86c9-41fcfbf3a1b3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:51.647052 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b05eec8e-ab7d-4adb-86c9-41fcfbf3a1b3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: cd399490-133f-43a2-b0b7-ed5448e52dab] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:51.655199 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b05eec8e-ab7d-4adb-86c9-41fcfbf3a1b3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:51.655814 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b05eec8e-ab7d-4adb-86c9-41fcfbf3a1b3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:51.656295 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b05eec8e-ab7d-4adb-86c9-41fcfbf3a1b3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:51.657449 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b05eec8e-ab7d-4adb-86c9-41fcfbf3a1b3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:51.657927 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b05eec8e-ab7d-4adb-86c9-41fcfbf3a1b3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:51.658362 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b05eec8e-ab7d-4adb-86c9-41fcfbf3a1b3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:52.368955 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-dc1b4d4e-ec2c-47d7-ba2b-7207b9cca0cd tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:52.383805 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-dc1b4d4e-ec2c-47d7-ba2b-7207b9cca0cd tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 200 len: 1508 microversion: 2.1 time: 1.378870 Aug 07 01:31:52.399699 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2032/4385] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:51 2022] GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 1508 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:52.399699 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-e3096d87-691e-4cfc-9a01-1a0796a6096f req-cce326f5-3536-443b-a651-bc316f35a93f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "799e740e-2304-4bdf-ad6e-ea4817a92b15", "name": "network-vif-deleted", "tag": "66d655ef-9cf7-49d7-a3ac-b463c6c5f801"}, {"server_uuid": "799e740e-2304-4bdf-ad6e-ea4817a92b15", "name": "network-vif-deleted", "tag": "57dd2ceb-1878-4d37-b462-7fa515b4642e"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:52.424181 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-e3096d87-691e-4cfc-9a01-1a0796a6096f req-cce326f5-3536-443b-a651-bc316f35a93f service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:52.425228 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-e3096d87-691e-4cfc-9a01-1a0796a6096f req-cce326f5-3536-443b-a651-bc316f35a93f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:52.425678 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-e3096d87-691e-4cfc-9a01-1a0796a6096f req-cce326f5-3536-443b-a651-bc316f35a93f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:52.454312 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-e3096d87-691e-4cfc-9a01-1a0796a6096f req-cce326f5-3536-443b-a651-bc316f35a93f service nova] Creating event network-vif-deleted:66d655ef-9cf7-49d7-a3ac-b463c6c5f801 for instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 on n-h1-master-1 Aug 07 01:31:52.454851 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-e3096d87-691e-4cfc-9a01-1a0796a6096f req-cce326f5-3536-443b-a651-bc316f35a93f service nova] Creating event network-vif-deleted:57dd2ceb-1878-4d37-b462-7fa515b4642e for instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 on n-h1-master-1 Aug 07 01:31:52.482920 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-e3096d87-691e-4cfc-9a01-1a0796a6096f req-cce326f5-3536-443b-a651-bc316f35a93f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.091619 Aug 07 01:31:52.483615 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2033/4386] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:52.498622 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bf7259f5-f734-48d7-b06a-e7a4eff6f476 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:52.508931 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bf7259f5-f734-48d7-b06a-e7a4eff6f476 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:52.516860 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf7259f5-f734-48d7-b06a-e7a4eff6f476 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:52.517626 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf7259f5-f734-48d7-b06a-e7a4eff6f476 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:52.518220 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf7259f5-f734-48d7-b06a-e7a4eff6f476 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:52.519412 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf7259f5-f734-48d7-b06a-e7a4eff6f476 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:52.520404 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf7259f5-f734-48d7-b06a-e7a4eff6f476 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:52.520982 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf7259f5-f734-48d7-b06a-e7a4eff6f476 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:52.596496 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b05eec8e-ab7d-4adb-86c9-41fcfbf3a1b3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:52.601216 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:52.614223 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b05eec8e-ab7d-4adb-86c9-41fcfbf3a1b3 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/cd399490-133f-43a2-b0b7-ed5448e52dab" status: 200 len: 1517 microversion: 2.1 time: 0.975159 Aug 07 01:31:52.617905 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2354/4387] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:51 2022] GET /compute/v2.1/servers/cd399490-133f-43a2-b0b7-ed5448e52dab => generated 1517 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:52.636655 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a0a487cc-9252-4805-8e3c-476e4dcfaffc tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:52.637213 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a0a487cc-9252-4805-8e3c-476e4dcfaffc tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:52.656376 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a0a487cc-9252-4805-8e3c-476e4dcfaffc tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:52.656923 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a0a487cc-9252-4805-8e3c-476e4dcfaffc tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:52.657469 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a0a487cc-9252-4805-8e3c-476e4dcfaffc tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:52.658395 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a0a487cc-9252-4805-8e3c-476e4dcfaffc tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:52.658745 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a0a487cc-9252-4805-8e3c-476e4dcfaffc tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:52.663595 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a0a487cc-9252-4805-8e3c-476e4dcfaffc tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:52.902982 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bf7259f5-f734-48d7-b06a-e7a4eff6f476 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:52.922282 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bf7259f5-f734-48d7-b06a-e7a4eff6f476 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:52.925992 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bf7259f5-f734-48d7-b06a-e7a4eff6f476 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:52.929596 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bf7259f5-f734-48d7-b06a-e7a4eff6f476 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1604 microversion: 2.32 time: 0.444571 Aug 07 01:31:52.932580 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2034/4388] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:31:52 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1604 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:31:53.024466 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a0a487cc-9252-4805-8e3c-476e4dcfaffc tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:53.039126 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a0a487cc-9252-4805-8e3c-476e4dcfaffc tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:53.044331 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a0a487cc-9252-4805-8e3c-476e4dcfaffc tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:53.045630 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a0a487cc-9252-4805-8e3c-476e4dcfaffc tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 2257 microversion: 2.42 time: 0.426547 Aug 07 01:31:53.061050 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2355/4389] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:31:52 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 2257 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:31:53.416048 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-49d3eeb1-5d56-4777-af28-704dcd600684 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:53.418995 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-49d3eeb1-5d56-4777-af28-704dcd600684 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:53.449540 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=8 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:53.454536 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49d3eeb1-5d56-4777-af28-704dcd600684 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:53.456996 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49d3eeb1-5d56-4777-af28-704dcd600684 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:53.459135 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49d3eeb1-5d56-4777-af28-704dcd600684 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:53.462827 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49d3eeb1-5d56-4777-af28-704dcd600684 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:53.463858 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49d3eeb1-5d56-4777-af28-704dcd600684 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:53.464523 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49d3eeb1-5d56-4777-af28-704dcd600684 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:53.635465 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6463cc09-6da1-4448-98de-f794ed539ba8 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:53.636818 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6463cc09-6da1-4448-98de-f794ed539ba8 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: cd399490-133f-43a2-b0b7-ed5448e52dab] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:53.645619 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6463cc09-6da1-4448-98de-f794ed539ba8 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:53.646413 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6463cc09-6da1-4448-98de-f794ed539ba8 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:53.647086 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6463cc09-6da1-4448-98de-f794ed539ba8 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:53.648044 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6463cc09-6da1-4448-98de-f794ed539ba8 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:53.648687 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6463cc09-6da1-4448-98de-f794ed539ba8 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:53.649296 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6463cc09-6da1-4448-98de-f794ed539ba8 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:54.050763 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6463cc09-6da1-4448-98de-f794ed539ba8 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:54.061593 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6463cc09-6da1-4448-98de-f794ed539ba8 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/cd399490-133f-43a2-b0b7-ed5448e52dab" status: 200 len: 1517 microversion: 2.1 time: 0.430184 Aug 07 01:31:54.068394 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2356/4390] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:53 2022] GET /compute/v2.1/servers/cd399490-133f-43a2-b0b7-ed5448e52dab => generated 1517 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:54.074934 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6e105ce6-f114-4383-a362-90097ee28955 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:54.077769 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6e105ce6-f114-4383-a362-90097ee28955 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:54.096163 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e105ce6-f114-4383-a362-90097ee28955 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:54.097324 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e105ce6-f114-4383-a362-90097ee28955 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:54.097783 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e105ce6-f114-4383-a362-90097ee28955 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:54.100179 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e105ce6-f114-4383-a362-90097ee28955 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:54.101661 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e105ce6-f114-4383-a362-90097ee28955 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:54.104134 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e105ce6-f114-4383-a362-90097ee28955 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:54.224525 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6e105ce6-f114-4383-a362-90097ee28955 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:54.240425 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6e105ce6-f114-4383-a362-90097ee28955 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:54.243502 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6e105ce6-f114-4383-a362-90097ee28955 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:54.248647 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6e105ce6-f114-4383-a362-90097ee28955 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1604 microversion: 2.32 time: 0.178853 Aug 07 01:31:54.249986 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2357/4391] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:31:54 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1604 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:31:54.269739 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4a3fac9b-5222-4dbb-b40a-53f549b614ce tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:54.271321 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4a3fac9b-5222-4dbb-b40a-53f549b614ce tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:54.293311 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a3fac9b-5222-4dbb-b40a-53f549b614ce tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:54.296285 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a3fac9b-5222-4dbb-b40a-53f549b614ce tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:54.297046 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a3fac9b-5222-4dbb-b40a-53f549b614ce tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:54.300962 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a3fac9b-5222-4dbb-b40a-53f549b614ce tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:54.301659 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a3fac9b-5222-4dbb-b40a-53f549b614ce tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:54.302311 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a3fac9b-5222-4dbb-b40a-53f549b614ce tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:54.370637 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=8 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:54.680244 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4a3fac9b-5222-4dbb-b40a-53f549b614ce tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:54.698085 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4a3fac9b-5222-4dbb-b40a-53f549b614ce tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:54.699876 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4a3fac9b-5222-4dbb-b40a-53f549b614ce tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:54.706559 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4a3fac9b-5222-4dbb-b40a-53f549b614ce tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 2211 microversion: 2.42 time: 0.453306 Aug 07 01:31:54.724959 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2358/4392] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:31:54 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 2211 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:31:54.802016 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-f70fb334-66db-438c-a144-e0a46d6160ee req-ef7b53e4-7950-4bbf-baa4-619577c72804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "799e740e-2304-4bdf-ad6e-ea4817a92b15", "name": "network-vif-deleted", "tag": "ed270649-5cff-4279-a1a6-2363fa515342"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:54.816587 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f70fb334-66db-438c-a144-e0a46d6160ee req-ef7b53e4-7950-4bbf-baa4-619577c72804 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:54.817065 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f70fb334-66db-438c-a144-e0a46d6160ee req-ef7b53e4-7950-4bbf-baa4-619577c72804 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:54.817501 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f70fb334-66db-438c-a144-e0a46d6160ee req-ef7b53e4-7950-4bbf-baa4-619577c72804 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:54.848167 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-f70fb334-66db-438c-a144-e0a46d6160ee req-ef7b53e4-7950-4bbf-baa4-619577c72804 service nova] Creating event network-vif-deleted:ed270649-5cff-4279-a1a6-2363fa515342 for instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 on n-h1-master-1 Aug 07 01:31:54.856177 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-f70fb334-66db-438c-a144-e0a46d6160ee req-ef7b53e4-7950-4bbf-baa4-619577c72804 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058399 Aug 07 01:31:54.859918 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2359/4393] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:55.084050 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a205a907-16a9-4fce-bcdb-dc02c37c395d tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:55.085158 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a205a907-16a9-4fce-bcdb-dc02c37c395d tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: cd399490-133f-43a2-b0b7-ed5448e52dab] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:55.097776 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a205a907-16a9-4fce-bcdb-dc02c37c395d tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:55.100648 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a205a907-16a9-4fce-bcdb-dc02c37c395d tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:55.101853 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a205a907-16a9-4fce-bcdb-dc02c37c395d tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:55.109561 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a205a907-16a9-4fce-bcdb-dc02c37c395d tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:55.110449 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a205a907-16a9-4fce-bcdb-dc02c37c395d tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:55.111262 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a205a907-16a9-4fce-bcdb-dc02c37c395d tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:55.458652 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-49d3eeb1-5d56-4777-af28-704dcd600684 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:55.483973 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-49d3eeb1-5d56-4777-af28-704dcd600684 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 200 len: 1508 microversion: 2.1 time: 2.080800 Aug 07 01:31:55.504038 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2035/4394] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:53 2022] GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 1508 bytes in 2104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:55.513905 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6a9a109d-7f03-4031-922b-e67e7acaaa73 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:55.514829 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6a9a109d-7f03-4031-922b-e67e7acaaa73 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:55.537149 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a9a109d-7f03-4031-922b-e67e7acaaa73 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:55.537149 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a9a109d-7f03-4031-922b-e67e7acaaa73 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:55.546952 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a9a109d-7f03-4031-922b-e67e7acaaa73 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:55.549069 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a9a109d-7f03-4031-922b-e67e7acaaa73 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:55.550977 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a9a109d-7f03-4031-922b-e67e7acaaa73 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:55.552495 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a9a109d-7f03-4031-922b-e67e7acaaa73 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:55.704955 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a205a907-16a9-4fce-bcdb-dc02c37c395d tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:55.719494 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a205a907-16a9-4fce-bcdb-dc02c37c395d tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/cd399490-133f-43a2-b0b7-ed5448e52dab" status: 200 len: 1517 microversion: 2.1 time: 0.640208 Aug 07 01:31:55.720135 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2360/4395] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:55 2022] GET /compute/v2.1/servers/cd399490-133f-43a2-b0b7-ed5448e52dab => generated 1517 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:55.744891 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-70fa8001-a406-4dd8-902c-4bf741d5333f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:55.745521 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-70fa8001-a406-4dd8-902c-4bf741d5333f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:55.758144 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-70fa8001-a406-4dd8-902c-4bf741d5333f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:55.758652 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-70fa8001-a406-4dd8-902c-4bf741d5333f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:55.759381 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-70fa8001-a406-4dd8-902c-4bf741d5333f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:55.760176 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-70fa8001-a406-4dd8-902c-4bf741d5333f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:55.760643 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-70fa8001-a406-4dd8-902c-4bf741d5333f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:55.761077 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-70fa8001-a406-4dd8-902c-4bf741d5333f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:55.815764 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6a9a109d-7f03-4031-922b-e67e7acaaa73 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:55.825640 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6a9a109d-7f03-4031-922b-e67e7acaaa73 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:55.827150 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6a9a109d-7f03-4031-922b-e67e7acaaa73 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:55.828400 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6a9a109d-7f03-4031-922b-e67e7acaaa73 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1604 microversion: 2.32 time: 0.322547 Aug 07 01:31:55.828963 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2036/4396] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:31:55 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1604 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:31:56.205781 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-70fa8001-a406-4dd8-902c-4bf741d5333f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:56.237588 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-70fa8001-a406-4dd8-902c-4bf741d5333f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:56.247714 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-70fa8001-a406-4dd8-902c-4bf741d5333f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:56.250741 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-70fa8001-a406-4dd8-902c-4bf741d5333f tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 2053 microversion: 2.42 time: 0.508942 Aug 07 01:31:56.253263 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2361/4397] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:31:55 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 2053 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:31:56.509453 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4fcdbdcc-84ea-48c3-824a-78a28d3c24fe tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:56.511235 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4fcdbdcc-84ea-48c3-824a-78a28d3c24fe tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:56.528141 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4fcdbdcc-84ea-48c3-824a-78a28d3c24fe tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:56.528643 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4fcdbdcc-84ea-48c3-824a-78a28d3c24fe tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:56.529089 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4fcdbdcc-84ea-48c3-824a-78a28d3c24fe tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:56.529810 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4fcdbdcc-84ea-48c3-824a-78a28d3c24fe tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:56.535973 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4fcdbdcc-84ea-48c3-824a-78a28d3c24fe tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:56.536564 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4fcdbdcc-84ea-48c3-824a-78a28d3c24fe tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:56.744478 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-60194f83-1e20-40af-9d62-e9d7c3a643c0 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:56.745844 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-60194f83-1e20-40af-9d62-e9d7c3a643c0 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: cd399490-133f-43a2-b0b7-ed5448e52dab] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:56.766282 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60194f83-1e20-40af-9d62-e9d7c3a643c0 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:56.767193 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60194f83-1e20-40af-9d62-e9d7c3a643c0 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:56.768034 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60194f83-1e20-40af-9d62-e9d7c3a643c0 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:56.771721 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60194f83-1e20-40af-9d62-e9d7c3a643c0 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:56.778039 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60194f83-1e20-40af-9d62-e9d7c3a643c0 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:56.782133 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60194f83-1e20-40af-9d62-e9d7c3a643c0 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:56.801042 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-60194f83-1e20-40af-9d62-e9d7c3a643c0 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] HTTP exception thrown: Instance cd399490-133f-43a2-b0b7-ed5448e52dab could not be found. Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-60194f83-1e20-40af-9d62-e9d7c3a643c0 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Request method failure captured: Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/cd399490-133f-43a2-b0b7-ed5448e52dab HTTP/1.1 Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xW1dOl_AyZ5CYYyy1b3ivsdu38cqQpYoovUZbdUC6IO0RHcpAeNJD1cKC1UV6c_n9z0-0ZLM93LqqIj3QUT0NFt_2ErIFHSDjhfe__hMfOjWZTQSmk9cKUIciW2yy0w02vHuv-kCaPI1l5NRsklez5961SIJ32IMVOJg36MKy8fYfE Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 5f88662ebb674ad99a4d36651dee967a Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ListServerFiltersTestJSON-625885988 Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5f88662ebb674ad99a4d36651dee967a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5f88662ebb674ad99a4d36651dee967a", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5f88662ebb674ad99a4d36651dee967a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5f88662ebb674ad99a4d36651dee967a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ListServerFiltersTestJSON-625885988 Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 5f88662ebb674ad99a4d36651dee967a Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-625885988 Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ListServerFiltersTestJSON-625885988-project Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 474a78f0b2784e01b3d2a6ff6694b8bb Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ListServerFiltersTestJSON-625885988-project Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: exception: Instance cd399490-133f-43a2-b0b7-ed5448e52dab could not be found. Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'cd399490-133f-43a2-b0b7-ed5448e52dab'} Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd399490-133f-43a2-b0b7-ed5448e52dab could not be found. Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd399490-133f-43a2-b0b7-ed5448e52dab could not be found. Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:31:56.803380 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:56.808021 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:31:56.808021 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:31:56.808021 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:31:56.808021 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:31:56.808021 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:31:56.808021 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd399490-133f-43a2-b0b7-ed5448e52dab could not be found. Aug 07 01:31:56.808021 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:31:56.812193 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-60194f83-1e20-40af-9d62-e9d7c3a643c0 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Returning 404 to user: Instance cd399490-133f-43a2-b0b7-ed5448e52dab could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:31:56.813552 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-60194f83-1e20-40af-9d62-e9d7c3a643c0 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/cd399490-133f-43a2-b0b7-ed5448e52dab" status: 404 len: 111 microversion: 2.1 time: 0.075511 Aug 07 01:31:56.818341 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2362/4398] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:56 2022] GET /compute/v2.1/servers/cd399490-133f-43a2-b0b7-ed5448e52dab => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:31:56.824267 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b4b4a51c-e5f1-4f3f-8d50-6b2626d985a8 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:56.825153 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b4b4a51c-e5f1-4f3f-8d50-6b2626d985a8 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 425b6340-2984-4339-9728-2914b55bd418] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:56.832581 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4b4a51c-e5f1-4f3f-8d50-6b2626d985a8 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:56.833707 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4b4a51c-e5f1-4f3f-8d50-6b2626d985a8 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:56.834444 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4b4a51c-e5f1-4f3f-8d50-6b2626d985a8 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:56.835493 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4b4a51c-e5f1-4f3f-8d50-6b2626d985a8 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:56.836265 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4b4a51c-e5f1-4f3f-8d50-6b2626d985a8 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:56.836930 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4b4a51c-e5f1-4f3f-8d50-6b2626d985a8 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:56.881614 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b4b4a51c-e5f1-4f3f-8d50-6b2626d985a8 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 425b6340-2984-4339-9728-2914b55bd418] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:31:57.047714 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b4b4a51c-e5f1-4f3f-8d50-6b2626d985a8 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "DELETE /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418" status: 204 len: 0 microversion: 2.1 time: 0.225850 Aug 07 01:31:57.055021 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2363/4399] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:31:56 2022] DELETE /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:31:57.073534 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0c7573ba-ec67-41e5-a954-cd9079b865ae tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:57.074660 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0c7573ba-ec67-41e5-a954-cd9079b865ae tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:57.084809 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c7573ba-ec67-41e5-a954-cd9079b865ae tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:57.085541 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c7573ba-ec67-41e5-a954-cd9079b865ae tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:57.086229 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c7573ba-ec67-41e5-a954-cd9079b865ae tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:57.087191 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c7573ba-ec67-41e5-a954-cd9079b865ae tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:57.088290 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c7573ba-ec67-41e5-a954-cd9079b865ae tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:57.089745 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c7573ba-ec67-41e5-a954-cd9079b865ae tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:57.212080 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0c7573ba-ec67-41e5-a954-cd9079b865ae tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:57.237182 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0c7573ba-ec67-41e5-a954-cd9079b865ae tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:57.241990 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0c7573ba-ec67-41e5-a954-cd9079b865ae tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:57.245542 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0c7573ba-ec67-41e5-a954-cd9079b865ae tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1604 microversion: 2.32 time: 0.186483 Aug 07 01:31:57.248825 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2364/4400] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:31:57 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1604 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:31:57.263339 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b4190e50-3418-4e04-b4f2-16839f4aeb43 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:57.268805 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b4190e50-3418-4e04-b4f2-16839f4aeb43 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 425b6340-2984-4339-9728-2914b55bd418] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:57.286920 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4190e50-3418-4e04-b4f2-16839f4aeb43 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:57.287661 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4190e50-3418-4e04-b4f2-16839f4aeb43 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:57.288335 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4190e50-3418-4e04-b4f2-16839f4aeb43 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:57.289389 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4190e50-3418-4e04-b4f2-16839f4aeb43 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:57.290098 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4190e50-3418-4e04-b4f2-16839f4aeb43 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:57.290896 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4190e50-3418-4e04-b4f2-16839f4aeb43 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:57.813641 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4fcdbdcc-84ea-48c3-824a-78a28d3c24fe tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:57.824177 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4fcdbdcc-84ea-48c3-824a-78a28d3c24fe tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 200 len: 1505 microversion: 2.1 time: 1.318527 Aug 07 01:31:57.829128 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2037/4401] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:56 2022] GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 1505 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:57.841206 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-593afca9-6e40-46ce-b08e-612e7a7b3d5e req-b2ea189b-4550-40ae-8487-e9521a992551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd399490-133f-43a2-b0b7-ed5448e52dab", "name": "network-vif-deleted", "tag": "9c6b6772-80fb-4b2a-8f4c-bbf5f1af23ef"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:57.864540 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-593afca9-6e40-46ce-b08e-612e7a7b3d5e req-b2ea189b-4550-40ae-8487-e9521a992551 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:57.876535 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-593afca9-6e40-46ce-b08e-612e7a7b3d5e req-b2ea189b-4550-40ae-8487-e9521a992551 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:57.877022 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-593afca9-6e40-46ce-b08e-612e7a7b3d5e req-b2ea189b-4550-40ae-8487-e9521a992551 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:57.889978 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-593afca9-6e40-46ce-b08e-612e7a7b3d5e req-b2ea189b-4550-40ae-8487-e9521a992551 service nova] Creating event network-vif-deleted:9c6b6772-80fb-4b2a-8f4c-bbf5f1af23ef for instance cd399490-133f-43a2-b0b7-ed5448e52dab on n-h2-master-1 Aug 07 01:31:57.896394 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-593afca9-6e40-46ce-b08e-612e7a7b3d5e req-b2ea189b-4550-40ae-8487-e9521a992551 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065450 Aug 07 01:31:57.898253 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2038/4402] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:57.905523 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-adb34824-fc11-42ac-a025-c611ae52e5d4 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:57.906634 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-adb34824-fc11-42ac-a025-c611ae52e5d4 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:57.914684 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-adb34824-fc11-42ac-a025-c611ae52e5d4 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:57.915552 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-adb34824-fc11-42ac-a025-c611ae52e5d4 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:57.916495 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-adb34824-fc11-42ac-a025-c611ae52e5d4 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:57.918341 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-adb34824-fc11-42ac-a025-c611ae52e5d4 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:57.919330 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-adb34824-fc11-42ac-a025-c611ae52e5d4 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:57.920324 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-adb34824-fc11-42ac-a025-c611ae52e5d4 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:58.052861 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-adb34824-fc11-42ac-a025-c611ae52e5d4 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:58.067959 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-adb34824-fc11-42ac-a025-c611ae52e5d4 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:58.072863 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-adb34824-fc11-42ac-a025-c611ae52e5d4 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:58.074697 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-adb34824-fc11-42ac-a025-c611ae52e5d4 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1986 microversion: 2.42 time: 0.174749 Aug 07 01:31:58.082039 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2039/4403] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:31:57 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1986 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:31:58.092497 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-8b70af0d-d5cc-4e4c-94fc-072986303085 req-fcf88390-a324-4544-906b-4cf5b6424c37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a00f6b81-d0b5-434f-a861-53cbcf107219", "name": "network-vif-unplugged", "status": "completed", "tag": "d195799a-8bcf-49dd-ada2-d86a279b6b61"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:58.118046 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-8b70af0d-d5cc-4e4c-94fc-072986303085 req-fcf88390-a324-4544-906b-4cf5b6424c37 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:58.118835 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-8b70af0d-d5cc-4e4c-94fc-072986303085 req-fcf88390-a324-4544-906b-4cf5b6424c37 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:58.119451 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-8b70af0d-d5cc-4e4c-94fc-072986303085 req-fcf88390-a324-4544-906b-4cf5b6424c37 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:58.140064 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-8b70af0d-d5cc-4e4c-94fc-072986303085 req-fcf88390-a324-4544-906b-4cf5b6424c37 service nova] Creating event network-vif-unplugged:d195799a-8bcf-49dd-ada2-d86a279b6b61 for instance a00f6b81-d0b5-434f-a861-53cbcf107219 on n-h1-master-1 Aug 07 01:31:58.155965 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-8b70af0d-d5cc-4e4c-94fc-072986303085 req-fcf88390-a324-4544-906b-4cf5b6424c37 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070451 Aug 07 01:31:58.159105 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2040/4404] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:31:58.277718 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-951696ba-fd55-4d45-a39a-661d43d3b28f tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:58.278507 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-951696ba-fd55-4d45-a39a-661d43d3b28f tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:58.293258 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-951696ba-fd55-4d45-a39a-661d43d3b28f tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:58.293809 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-951696ba-fd55-4d45-a39a-661d43d3b28f tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:58.294672 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-951696ba-fd55-4d45-a39a-661d43d3b28f tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:58.296111 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-951696ba-fd55-4d45-a39a-661d43d3b28f tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:58.301804 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-951696ba-fd55-4d45-a39a-661d43d3b28f tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:58.304964 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-951696ba-fd55-4d45-a39a-661d43d3b28f tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:58.378785 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b4190e50-3418-4e04-b4f2-16839f4aeb43 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:58.388448 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b4190e50-3418-4e04-b4f2-16839f4aeb43 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418" status: 200 len: 1519 microversion: 2.1 time: 1.138417 Aug 07 01:31:58.393419 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2365/4405] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:57 2022] GET /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418 => generated 1519 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:58.651772 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-951696ba-fd55-4d45-a39a-661d43d3b28f tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:58.668139 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-951696ba-fd55-4d45-a39a-661d43d3b28f tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:58.677471 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-951696ba-fd55-4d45-a39a-661d43d3b28f tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:58.679097 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-951696ba-fd55-4d45-a39a-661d43d3b28f tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1604 microversion: 2.32 time: 0.406766 Aug 07 01:31:58.680377 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2041/4406] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:31:58 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1604 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:31:58.852385 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9f497ae8-3f32-4cd2-9b21-25fae52128b1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:58.853038 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9f497ae8-3f32-4cd2-9b21-25fae52128b1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:58.870485 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f497ae8-3f32-4cd2-9b21-25fae52128b1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:58.870485 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f497ae8-3f32-4cd2-9b21-25fae52128b1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:58.870485 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f497ae8-3f32-4cd2-9b21-25fae52128b1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:58.871162 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f497ae8-3f32-4cd2-9b21-25fae52128b1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:58.871652 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f497ae8-3f32-4cd2-9b21-25fae52128b1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:58.877529 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f497ae8-3f32-4cd2-9b21-25fae52128b1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:59.109288 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-50fdfa64-e1ec-4c1e-bc08-37111a14e42d tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:59.109992 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-50fdfa64-e1ec-4c1e-bc08-37111a14e42d tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:59.122882 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-50fdfa64-e1ec-4c1e-bc08-37111a14e42d tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:59.123428 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-50fdfa64-e1ec-4c1e-bc08-37111a14e42d tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:59.123876 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-50fdfa64-e1ec-4c1e-bc08-37111a14e42d tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:59.128752 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-50fdfa64-e1ec-4c1e-bc08-37111a14e42d tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:59.129241 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-50fdfa64-e1ec-4c1e-bc08-37111a14e42d tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:59.129870 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-50fdfa64-e1ec-4c1e-bc08-37111a14e42d tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:59.537954 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9f497ae8-3f32-4cd2-9b21-25fae52128b1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:59.550781 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9f497ae8-3f32-4cd2-9b21-25fae52128b1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 200 len: 1505 microversion: 2.1 time: 0.700146 Aug 07 01:31:59.553659 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2366/4407] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:58 2022] GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 1505 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:59.565012 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-25628faf-4af9-4442-acef-2c88caa30135 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:59.566319 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-25628faf-4af9-4442-acef-2c88caa30135 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 425b6340-2984-4339-9728-2914b55bd418] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:59.574395 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-25628faf-4af9-4442-acef-2c88caa30135 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:59.575287 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-25628faf-4af9-4442-acef-2c88caa30135 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:59.576060 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-25628faf-4af9-4442-acef-2c88caa30135 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:59.577346 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-25628faf-4af9-4442-acef-2c88caa30135 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:59.578027 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-25628faf-4af9-4442-acef-2c88caa30135 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:59.578655 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-25628faf-4af9-4442-acef-2c88caa30135 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:59.661653 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-50fdfa64-e1ec-4c1e-bc08-37111a14e42d tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:59.680249 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-50fdfa64-e1ec-4c1e-bc08-37111a14e42d tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:59.682493 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-50fdfa64-e1ec-4c1e-bc08-37111a14e42d tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:59.684253 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-50fdfa64-e1ec-4c1e-bc08-37111a14e42d tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1986 microversion: 2.42 time: 0.578735 Aug 07 01:31:59.686051 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2042/4408] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:31:59 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1986 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:31:59.711356 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d441ab35-656f-4c7f-a80a-cb616d03dfd9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:31:59.717719 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d441ab35-656f-4c7f-a80a-cb616d03dfd9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:31:59.725780 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d441ab35-656f-4c7f-a80a-cb616d03dfd9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:59.727310 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d441ab35-656f-4c7f-a80a-cb616d03dfd9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:59.727607 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d441ab35-656f-4c7f-a80a-cb616d03dfd9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:59.728934 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d441ab35-656f-4c7f-a80a-cb616d03dfd9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:59.729397 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d441ab35-656f-4c7f-a80a-cb616d03dfd9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:59.729885 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d441ab35-656f-4c7f-a80a-cb616d03dfd9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:59.898702 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-25628faf-4af9-4442-acef-2c88caa30135 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:59.927361 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d441ab35-656f-4c7f-a80a-cb616d03dfd9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:59.931838 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-25628faf-4af9-4442-acef-2c88caa30135 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418" status: 200 len: 1519 microversion: 2.1 time: 0.375524 Aug 07 01:31:59.933671 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2367/4409] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:31:59 2022] GET /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418 => generated 1519 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:31:59.938681 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-dd0f963f-becc-4048-9908-0db315b6c037 req-217b6755-10b3-4f28-a25c-432f51049f12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "799e740e-2304-4bdf-ad6e-ea4817a92b15", "name": "network-vif-deleted", "tag": "bae6d831-aaf8-4653-86fb-18251963e1b9"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:31:59.952092 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-dd0f963f-becc-4048-9908-0db315b6c037 req-217b6755-10b3-4f28-a25c-432f51049f12 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:31:59.953152 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-dd0f963f-becc-4048-9908-0db315b6c037 req-217b6755-10b3-4f28-a25c-432f51049f12 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:31:59.954186 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-dd0f963f-becc-4048-9908-0db315b6c037 req-217b6755-10b3-4f28-a25c-432f51049f12 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:31:59.961693 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d441ab35-656f-4c7f-a80a-cb616d03dfd9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:59.966270 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d441ab35-656f-4c7f-a80a-cb616d03dfd9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:31:59.969200 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d441ab35-656f-4c7f-a80a-cb616d03dfd9 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1604 microversion: 2.32 time: 0.261629 Aug 07 01:31:59.973821 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2043/4410] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:31:59 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1604 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:31:59.977053 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-dd0f963f-becc-4048-9908-0db315b6c037 req-217b6755-10b3-4f28-a25c-432f51049f12 service nova] Creating event network-vif-deleted:bae6d831-aaf8-4653-86fb-18251963e1b9 for instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 on n-h1-master-1 Aug 07 01:31:59.993160 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-dd0f963f-becc-4048-9908-0db315b6c037 req-217b6755-10b3-4f28-a25c-432f51049f12 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057932 Aug 07 01:31:59.997933 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2368/4411] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:32:00.575922 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-85291d86-c3fb-48db-8e96-93a6fe252306 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:00.577368 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-85291d86-c3fb-48db-8e96-93a6fe252306 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:00.599449 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-85291d86-c3fb-48db-8e96-93a6fe252306 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:00.600375 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-85291d86-c3fb-48db-8e96-93a6fe252306 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:00.601182 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-85291d86-c3fb-48db-8e96-93a6fe252306 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:00.603216 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-85291d86-c3fb-48db-8e96-93a6fe252306 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:00.604825 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-85291d86-c3fb-48db-8e96-93a6fe252306 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:00.606580 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-85291d86-c3fb-48db-8e96-93a6fe252306 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:00.713244 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-56ca12a5-85a2-4961-9915-df3ca55b6264 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:00.713952 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-56ca12a5-85a2-4961-9915-df3ca55b6264 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:00.729274 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-56ca12a5-85a2-4961-9915-df3ca55b6264 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:00.729767 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-56ca12a5-85a2-4961-9915-df3ca55b6264 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:00.732312 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-56ca12a5-85a2-4961-9915-df3ca55b6264 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:00.734552 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-56ca12a5-85a2-4961-9915-df3ca55b6264 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:00.736212 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-56ca12a5-85a2-4961-9915-df3ca55b6264 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:00.741180 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-56ca12a5-85a2-4961-9915-df3ca55b6264 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:00.957677 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-56ca12a5-85a2-4961-9915-df3ca55b6264 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:00.979802 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-56ca12a5-85a2-4961-9915-df3ca55b6264 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:00.989274 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-56ca12a5-85a2-4961-9915-df3ca55b6264 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:00.990829 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-56ca12a5-85a2-4961-9915-df3ca55b6264 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1604 microversion: 2.42 time: 0.281636 Aug 07 01:32:00.992022 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2369/4412] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:00 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1604 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:01.004877 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c55fc07b-1672-4785-8c33-b83e3c5bd709 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:01.005855 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c55fc07b-1672-4785-8c33-b83e3c5bd709 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 425b6340-2984-4339-9728-2914b55bd418] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:01.024872 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c55fc07b-1672-4785-8c33-b83e3c5bd709 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:01.030202 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c55fc07b-1672-4785-8c33-b83e3c5bd709 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:01.030929 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c55fc07b-1672-4785-8c33-b83e3c5bd709 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:01.032095 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c55fc07b-1672-4785-8c33-b83e3c5bd709 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:01.032721 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c55fc07b-1672-4785-8c33-b83e3c5bd709 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:01.033404 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c55fc07b-1672-4785-8c33-b83e3c5bd709 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:01.450531 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c55fc07b-1672-4785-8c33-b83e3c5bd709 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:01.469605 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c55fc07b-1672-4785-8c33-b83e3c5bd709 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418" status: 200 len: 1519 microversion: 2.1 time: 0.469422 Aug 07 01:32:01.470562 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2370/4413] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:00 2022] GET /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418 => generated 1519 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:01.475971 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8230485f-d312-4833-aa77-49bf93a90d72 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:01.478407 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8230485f-d312-4833-aa77-49bf93a90d72 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:01.489537 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8230485f-d312-4833-aa77-49bf93a90d72 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:01.501297 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8230485f-d312-4833-aa77-49bf93a90d72 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:01.504605 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8230485f-d312-4833-aa77-49bf93a90d72 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:01.508296 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8230485f-d312-4833-aa77-49bf93a90d72 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:01.509024 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8230485f-d312-4833-aa77-49bf93a90d72 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:01.509672 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8230485f-d312-4833-aa77-49bf93a90d72 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:01.639395 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8230485f-d312-4833-aa77-49bf93a90d72 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:01.644744 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:01.657684 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8230485f-d312-4833-aa77-49bf93a90d72 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:01.679704 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8230485f-d312-4833-aa77-49bf93a90d72 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:01.681224 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8230485f-d312-4833-aa77-49bf93a90d72 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1604 microversion: 2.32 time: 0.209392 Aug 07 01:32:01.694399 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2371/4414] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:01 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1604 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:01.911876 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-85291d86-c3fb-48db-8e96-93a6fe252306 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:01.935253 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-85291d86-c3fb-48db-8e96-93a6fe252306 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 200 len: 1508 microversion: 2.1 time: 1.364489 Aug 07 01:32:01.955265 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2044/4415] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:00 2022] GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 1508 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:01.962493 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-88fe9ea4-15fd-41ad-893f-00a6d90d21b0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:01.964019 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-88fe9ea4-15fd-41ad-893f-00a6d90d21b0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:01.992664 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-88fe9ea4-15fd-41ad-893f-00a6d90d21b0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:01.993218 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-88fe9ea4-15fd-41ad-893f-00a6d90d21b0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:01.993679 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-88fe9ea4-15fd-41ad-893f-00a6d90d21b0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:01.996756 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-88fe9ea4-15fd-41ad-893f-00a6d90d21b0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:01.997242 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-88fe9ea4-15fd-41ad-893f-00a6d90d21b0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:01.997688 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-88fe9ea4-15fd-41ad-893f-00a6d90d21b0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:02.020229 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8a16b4c6-47c3-4147-b27e-c4720ec9e865 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:02.020865 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8a16b4c6-47c3-4147-b27e-c4720ec9e865 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:02.037635 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a16b4c6-47c3-4147-b27e-c4720ec9e865 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:02.038146 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a16b4c6-47c3-4147-b27e-c4720ec9e865 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:02.038587 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a16b4c6-47c3-4147-b27e-c4720ec9e865 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:02.039311 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a16b4c6-47c3-4147-b27e-c4720ec9e865 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:02.039767 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a16b4c6-47c3-4147-b27e-c4720ec9e865 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:02.040226 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a16b4c6-47c3-4147-b27e-c4720ec9e865 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:02.299719 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8a16b4c6-47c3-4147-b27e-c4720ec9e865 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:02.314351 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8a16b4c6-47c3-4147-b27e-c4720ec9e865 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:02.317594 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8a16b4c6-47c3-4147-b27e-c4720ec9e865 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:02.322716 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8a16b4c6-47c3-4147-b27e-c4720ec9e865 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1604 microversion: 2.42 time: 0.307897 Aug 07 01:32:02.325657 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2045/4416] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:02 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1604 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:02.336604 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-9233a3c2-457d-4337-a91d-c22907a088a5 req-38f55214-fec5-43d7-8aeb-285853a3e109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "425b6340-2984-4339-9728-2914b55bd418", "name": "network-vif-deleted", "tag": "4ce8dd93-d7bb-4619-9c47-482e9af09d28"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:32:02.369277 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-9233a3c2-457d-4337-a91d-c22907a088a5 req-38f55214-fec5-43d7-8aeb-285853a3e109 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:02.370272 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-9233a3c2-457d-4337-a91d-c22907a088a5 req-38f55214-fec5-43d7-8aeb-285853a3e109 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:02.377854 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-9233a3c2-457d-4337-a91d-c22907a088a5 req-38f55214-fec5-43d7-8aeb-285853a3e109 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:02.425796 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-9233a3c2-457d-4337-a91d-c22907a088a5 req-38f55214-fec5-43d7-8aeb-285853a3e109 service nova] Creating event network-vif-deleted:4ce8dd93-d7bb-4619-9c47-482e9af09d28 for instance 425b6340-2984-4339-9728-2914b55bd418 on n-h1-master-1 Aug 07 01:32:02.442343 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-9233a3c2-457d-4337-a91d-c22907a088a5 req-38f55214-fec5-43d7-8aeb-285853a3e109 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112959 Aug 07 01:32:02.445623 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2046/4417] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:32:02.493116 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1ada8672-c008-431f-82b6-2380954be65e tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:02.493895 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1ada8672-c008-431f-82b6-2380954be65e tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 425b6340-2984-4339-9728-2914b55bd418] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:02.522833 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ada8672-c008-431f-82b6-2380954be65e tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:02.523593 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ada8672-c008-431f-82b6-2380954be65e tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:02.524237 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ada8672-c008-431f-82b6-2380954be65e tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:02.525265 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ada8672-c008-431f-82b6-2380954be65e tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:02.528605 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ada8672-c008-431f-82b6-2380954be65e tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:02.529413 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ada8672-c008-431f-82b6-2380954be65e tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:02.618511 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ada8672-c008-431f-82b6-2380954be65e tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:02.621911 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ada8672-c008-431f-82b6-2380954be65e tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:02.631747 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ada8672-c008-431f-82b6-2380954be65e tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:02.632660 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-1ada8672-c008-431f-82b6-2380954be65e tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lazy-loading 'fault' on Instance uuid 425b6340-2984-4339-9728-2914b55bd418 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:32:02.733891 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-88fe9ea4-15fd-41ad-893f-00a6d90d21b0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:02.742657 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-88fe9ea4-15fd-41ad-893f-00a6d90d21b0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.785263 Aug 07 01:32:02.763758 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2372/4418] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:01 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:02.778763 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-27be492c-97d8-493a-ac95-7337a2cd3cfa tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:02.780957 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-27be492c-97d8-493a-ac95-7337a2cd3cfa tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:02.797591 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1ada8672-c008-431f-82b6-2380954be65e tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474a78f0b2784e01b3d2a6ff6694b8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f88662ebb674ad99a4d36651dee967a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:02.813579 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1ada8672-c008-431f-82b6-2380954be65e tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418" status: 200 len: 1311 microversion: 2.1 time: 0.325613 Aug 07 01:32:02.814266 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27be492c-97d8-493a-ac95-7337a2cd3cfa tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:02.817880 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27be492c-97d8-493a-ac95-7337a2cd3cfa tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:02.818517 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2047/4419] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:02 2022] GET /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418 => generated 1311 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:02.819919 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27be492c-97d8-493a-ac95-7337a2cd3cfa tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:02.821845 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27be492c-97d8-493a-ac95-7337a2cd3cfa tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:02.824862 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27be492c-97d8-493a-ac95-7337a2cd3cfa tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:02.825927 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27be492c-97d8-493a-ac95-7337a2cd3cfa tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:02.836941 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d8610f98-8759-47cc-976a-687d8268d80d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:02.842384 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d8610f98-8759-47cc-976a-687d8268d80d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:02.889426 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d8610f98-8759-47cc-976a-687d8268d80d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:02.890909 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d8610f98-8759-47cc-976a-687d8268d80d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:02.893771 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d8610f98-8759-47cc-976a-687d8268d80d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:02.895253 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d8610f98-8759-47cc-976a-687d8268d80d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:02.896399 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d8610f98-8759-47cc-976a-687d8268d80d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:02.897749 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d8610f98-8759-47cc-976a-687d8268d80d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:03.052048 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-27be492c-97d8-493a-ac95-7337a2cd3cfa tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:03.069878 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-27be492c-97d8-493a-ac95-7337a2cd3cfa tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:03.075584 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-27be492c-97d8-493a-ac95-7337a2cd3cfa tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:03.078163 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-27be492c-97d8-493a-ac95-7337a2cd3cfa tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1604 microversion: 2.32 time: 0.313089 Aug 07 01:32:03.082876 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2373/4420] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:02 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1604 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:03.347870 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4c064e01-e6c9-4c86-a4e5-81be716e656b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:03.348816 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4c064e01-e6c9-4c86-a4e5-81be716e656b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:03.358109 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c064e01-e6c9-4c86-a4e5-81be716e656b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:03.365345 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c064e01-e6c9-4c86-a4e5-81be716e656b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:03.366059 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c064e01-e6c9-4c86-a4e5-81be716e656b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:03.367197 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c064e01-e6c9-4c86-a4e5-81be716e656b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:03.367828 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c064e01-e6c9-4c86-a4e5-81be716e656b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:03.368480 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c064e01-e6c9-4c86-a4e5-81be716e656b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:03.561159 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4c064e01-e6c9-4c86-a4e5-81be716e656b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:03.572395 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4c064e01-e6c9-4c86-a4e5-81be716e656b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:03.573937 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4c064e01-e6c9-4c86-a4e5-81be716e656b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:03.587319 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4c064e01-e6c9-4c86-a4e5-81be716e656b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1604 microversion: 2.42 time: 0.243810 Aug 07 01:32:03.594923 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2374/4421] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:03 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1604 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:03.716693 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d8610f98-8759-47cc-976a-687d8268d80d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:03.749337 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d8610f98-8759-47cc-976a-687d8268d80d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.915644 Aug 07 01:32:03.754288 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2048/4422] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:02 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:03.780215 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-394e4a0a-bc02-4260-a01b-ff61a77bc7f1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:03.781187 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-394e4a0a-bc02-4260-a01b-ff61a77bc7f1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:03.793443 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-394e4a0a-bc02-4260-a01b-ff61a77bc7f1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:03.794275 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-394e4a0a-bc02-4260-a01b-ff61a77bc7f1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:03.800567 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-394e4a0a-bc02-4260-a01b-ff61a77bc7f1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:03.801544 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-394e4a0a-bc02-4260-a01b-ff61a77bc7f1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:03.802166 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-394e4a0a-bc02-4260-a01b-ff61a77bc7f1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:03.802748 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-394e4a0a-bc02-4260-a01b-ff61a77bc7f1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:03.847091 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2ab8df08-6e52-4f52-98a3-e40a384f9f26 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:03.848137 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2ab8df08-6e52-4f52-98a3-e40a384f9f26 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] [instance: 425b6340-2984-4339-9728-2914b55bd418] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:03.859292 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2ab8df08-6e52-4f52-98a3-e40a384f9f26 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:03.860714 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2ab8df08-6e52-4f52-98a3-e40a384f9f26 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:03.861431 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2ab8df08-6e52-4f52-98a3-e40a384f9f26 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:03.863063 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2ab8df08-6e52-4f52-98a3-e40a384f9f26 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:03.863768 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2ab8df08-6e52-4f52-98a3-e40a384f9f26 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:03.864580 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2ab8df08-6e52-4f52-98a3-e40a384f9f26 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:03.886584 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-2ab8df08-6e52-4f52-98a3-e40a384f9f26 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] HTTP exception thrown: Instance 425b6340-2984-4339-9728-2914b55bd418 could not be found. Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2ab8df08-6e52-4f52-98a3-e40a384f9f26 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Request method failure captured: Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418 HTTP/1.1 Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xW1dOl_AyZ5CYYyy1b3ivsdu38cqQpYoovUZbdUC6IO0RHcpAeNJD1cKC1UV6c_n9z0-0ZLM93LqqIj3QUT0NFt_2ErIFHSDjhfe__hMfOjWZTQSmk9cKUIciW2yy0w02vHuv-kCaPI1l5NRsklez5961SIJ32IMVOJg36MKy8fYfE Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 5f88662ebb674ad99a4d36651dee967a Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ListServerFiltersTestJSON-625885988 Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5f88662ebb674ad99a4d36651dee967a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5f88662ebb674ad99a4d36651dee967a", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5f88662ebb674ad99a4d36651dee967a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5f88662ebb674ad99a4d36651dee967a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ListServerFiltersTestJSON-625885988 Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 5f88662ebb674ad99a4d36651dee967a Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-625885988 Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ListServerFiltersTestJSON-625885988-project Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 474a78f0b2784e01b3d2a6ff6694b8bb Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ListServerFiltersTestJSON-625885988-project Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 425b6340-2984-4339-9728-2914b55bd418 could not be found. Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '425b6340-2984-4339-9728-2914b55bd418'} Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 425b6340-2984-4339-9728-2914b55bd418 could not be found. Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 425b6340-2984-4339-9728-2914b55bd418 could not be found. Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:32:03.889962 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:32:03.894409 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:32:03.894409 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:32:03.894409 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:32:03.894409 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:32:03.894409 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:32:03.894409 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 425b6340-2984-4339-9728-2914b55bd418 could not be found. Aug 07 01:32:03.894409 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:32:03.897732 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2ab8df08-6e52-4f52-98a3-e40a384f9f26 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] Returning 404 to user: Instance 425b6340-2984-4339-9728-2914b55bd418 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:32:03.899315 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2ab8df08-6e52-4f52-98a3-e40a384f9f26 tempest-ListServerFiltersTestJSON-625885988 tempest-ListServerFiltersTestJSON-625885988-project] 10.222.0.39 "GET /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418" status: 404 len: 111 microversion: 2.1 time: 0.058634 Aug 07 01:32:03.900794 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2049/4423] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:03 2022] GET /compute/v2.1/servers/425b6340-2984-4339-9728-2914b55bd418 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:32:04.113822 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f92b96fc-cf26-49d0-9ba3-0e1a38890751 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:04.115117 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f92b96fc-cf26-49d0-9ba3-0e1a38890751 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:04.125021 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f92b96fc-cf26-49d0-9ba3-0e1a38890751 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:04.125511 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f92b96fc-cf26-49d0-9ba3-0e1a38890751 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:04.125947 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f92b96fc-cf26-49d0-9ba3-0e1a38890751 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:04.132516 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f92b96fc-cf26-49d0-9ba3-0e1a38890751 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:04.133612 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f92b96fc-cf26-49d0-9ba3-0e1a38890751 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:04.134250 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f92b96fc-cf26-49d0-9ba3-0e1a38890751 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:04.433562 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-394e4a0a-bc02-4260-a01b-ff61a77bc7f1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:04.435090 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f92b96fc-cf26-49d0-9ba3-0e1a38890751 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:04.474263 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f92b96fc-cf26-49d0-9ba3-0e1a38890751 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:04.476199 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f92b96fc-cf26-49d0-9ba3-0e1a38890751 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:04.477442 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f92b96fc-cf26-49d0-9ba3-0e1a38890751 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1604 microversion: 2.32 time: 0.370262 Aug 07 01:32:04.492739 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2050/4424] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:04 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1604 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:32:04.504979 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-394e4a0a-bc02-4260-a01b-ff61a77bc7f1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.718095 Aug 07 01:32:04.524346 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2375/4425] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:03 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:04.530227 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b50279d1-5ae7-42c1-9441-bb33b0e5ee4c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:04.530853 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b50279d1-5ae7-42c1-9441-bb33b0e5ee4c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:04.537833 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b50279d1-5ae7-42c1-9441-bb33b0e5ee4c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:04.538447 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b50279d1-5ae7-42c1-9441-bb33b0e5ee4c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:04.538888 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b50279d1-5ae7-42c1-9441-bb33b0e5ee4c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:04.539592 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b50279d1-5ae7-42c1-9441-bb33b0e5ee4c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:04.540087 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b50279d1-5ae7-42c1-9441-bb33b0e5ee4c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:04.540518 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b50279d1-5ae7-42c1-9441-bb33b0e5ee4c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:04.615501 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ed0fb531-92f0-4c5c-9307-a15836915a3b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:04.616160 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ed0fb531-92f0-4c5c-9307-a15836915a3b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:04.627811 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ed0fb531-92f0-4c5c-9307-a15836915a3b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:04.636355 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ed0fb531-92f0-4c5c-9307-a15836915a3b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:04.637038 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ed0fb531-92f0-4c5c-9307-a15836915a3b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:04.638016 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ed0fb531-92f0-4c5c-9307-a15836915a3b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:04.638500 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ed0fb531-92f0-4c5c-9307-a15836915a3b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:04.638936 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ed0fb531-92f0-4c5c-9307-a15836915a3b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:04.823464 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ed0fb531-92f0-4c5c-9307-a15836915a3b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:04.834780 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ed0fb531-92f0-4c5c-9307-a15836915a3b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:04.842056 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ed0fb531-92f0-4c5c-9307-a15836915a3b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:04.853995 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ed0fb531-92f0-4c5c-9307-a15836915a3b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1604 microversion: 2.42 time: 0.236975 Aug 07 01:32:04.859487 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2376/4426] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:04 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1604 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:32:05.326188 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b50279d1-5ae7-42c1-9441-bb33b0e5ee4c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:05.342269 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b50279d1-5ae7-42c1-9441-bb33b0e5ee4c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.815522 Aug 07 01:32:05.346944 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2051/4427] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:04 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:05.368932 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7e90ce99-2abe-4fd0-9503-5626243853b2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:32:05.383022 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e90ce99-2abe-4fd0-9503-5626243853b2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:05.383799 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e90ce99-2abe-4fd0-9503-5626243853b2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:05.384453 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e90ce99-2abe-4fd0-9503-5626243853b2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:05.461699 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7e90ce99-2abe-4fd0-9503-5626243853b2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Going to try to stop instance {{(pid=119516) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 07 01:32:05.504386 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-72e7f7cd-f316-4dc9-bee9-48be3e748fac tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:05.505261 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-72e7f7cd-f316-4dc9-bee9-48be3e748fac tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:05.526784 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-72e7f7cd-f316-4dc9-bee9-48be3e748fac tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:05.528129 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-72e7f7cd-f316-4dc9-bee9-48be3e748fac tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:05.529063 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-72e7f7cd-f316-4dc9-bee9-48be3e748fac tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:05.532808 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-72e7f7cd-f316-4dc9-bee9-48be3e748fac tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:05.535867 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-72e7f7cd-f316-4dc9-bee9-48be3e748fac tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:05.536936 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-72e7f7cd-f316-4dc9-bee9-48be3e748fac tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:05.550201 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:05.564360 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7e90ce99-2abe-4fd0-9503-5626243853b2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action" status: 202 len: 0 microversion: 2.1 time: 0.198610 Aug 07 01:32:05.565782 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2377/4428] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:32:05 2022] POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:32:05.588040 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0bc18c05-fc00-49aa-a19c-042fa58a03a1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:05.591016 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0bc18c05-fc00-49aa-a19c-042fa58a03a1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:05.608673 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0bc18c05-fc00-49aa-a19c-042fa58a03a1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:05.609579 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0bc18c05-fc00-49aa-a19c-042fa58a03a1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:05.610227 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0bc18c05-fc00-49aa-a19c-042fa58a03a1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:05.612732 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0bc18c05-fc00-49aa-a19c-042fa58a03a1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:05.615329 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0bc18c05-fc00-49aa-a19c-042fa58a03a1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:05.616252 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0bc18c05-fc00-49aa-a19c-042fa58a03a1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:05.744010 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-72e7f7cd-f316-4dc9-bee9-48be3e748fac tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:05.757647 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-72e7f7cd-f316-4dc9-bee9-48be3e748fac tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:05.761446 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-72e7f7cd-f316-4dc9-bee9-48be3e748fac tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:05.763143 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-72e7f7cd-f316-4dc9-bee9-48be3e748fac tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1604 microversion: 2.32 time: 0.264497 Aug 07 01:32:05.785214 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2052/4429] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:05 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1604 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:05.881847 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-19f961d2-b140-464e-b8ce-8214447f2274 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:05.883095 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-19f961d2-b140-464e-b8ce-8214447f2274 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:05.897253 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-19f961d2-b140-464e-b8ce-8214447f2274 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:05.898227 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-19f961d2-b140-464e-b8ce-8214447f2274 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:05.899085 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-19f961d2-b140-464e-b8ce-8214447f2274 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:05.900110 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-19f961d2-b140-464e-b8ce-8214447f2274 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:05.900942 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-19f961d2-b140-464e-b8ce-8214447f2274 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:05.901587 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-19f961d2-b140-464e-b8ce-8214447f2274 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:06.317807 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0bc18c05-fc00-49aa-a19c-042fa58a03a1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:06.319408 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-19f961d2-b140-464e-b8ce-8214447f2274 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:06.327084 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0bc18c05-fc00-49aa-a19c-042fa58a03a1 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1677 microversion: 2.1 time: 0.755002 Aug 07 01:32:06.331166 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-19f961d2-b140-464e-b8ce-8214447f2274 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:06.332843 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2378/4430] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:05 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1677 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:06.358592 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-19f961d2-b140-464e-b8ce-8214447f2274 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:06.359848 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-19f961d2-b140-464e-b8ce-8214447f2274 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1604 microversion: 2.42 time: 0.483895 Aug 07 01:32:06.367647 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2053/4431] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:05 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1604 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:06.791336 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-49401593-4717-4adf-a782-34361cf0ec57 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:06.792623 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-49401593-4717-4adf-a782-34361cf0ec57 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:06.803556 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-49401593-4717-4adf-a782-34361cf0ec57 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:06.812745 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-49401593-4717-4adf-a782-34361cf0ec57 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:06.813461 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-49401593-4717-4adf-a782-34361cf0ec57 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:06.816359 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-49401593-4717-4adf-a782-34361cf0ec57 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:06.817043 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-49401593-4717-4adf-a782-34361cf0ec57 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:06.817645 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-49401593-4717-4adf-a782-34361cf0ec57 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:07.027130 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-49401593-4717-4adf-a782-34361cf0ec57 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:07.055220 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-49401593-4717-4adf-a782-34361cf0ec57 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:07.057765 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-49401593-4717-4adf-a782-34361cf0ec57 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:07.069178 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-49401593-4717-4adf-a782-34361cf0ec57 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1604 microversion: 2.32 time: 0.278446 Aug 07 01:32:07.074882 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2379/4432] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:06 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1604 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:07.364454 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1b2a072a-7aee-4658-9524-e4f835a6fcb2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:07.365090 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1b2a072a-7aee-4658-9524-e4f835a6fcb2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:07.375292 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b2a072a-7aee-4658-9524-e4f835a6fcb2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:07.375800 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b2a072a-7aee-4658-9524-e4f835a6fcb2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:07.376263 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b2a072a-7aee-4658-9524-e4f835a6fcb2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:07.379385 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b2a072a-7aee-4658-9524-e4f835a6fcb2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:07.382776 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b2a072a-7aee-4658-9524-e4f835a6fcb2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:07.383475 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b2a072a-7aee-4658-9524-e4f835a6fcb2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:07.390396 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8ec6fad8-44e4-492b-893f-c6037a42982c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:07.391516 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8ec6fad8-44e4-492b-893f-c6037a42982c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:07.406438 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8ec6fad8-44e4-492b-893f-c6037a42982c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:07.413064 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8ec6fad8-44e4-492b-893f-c6037a42982c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:07.416529 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8ec6fad8-44e4-492b-893f-c6037a42982c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:07.417297 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8ec6fad8-44e4-492b-893f-c6037a42982c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:07.417787 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8ec6fad8-44e4-492b-893f-c6037a42982c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:07.418234 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8ec6fad8-44e4-492b-893f-c6037a42982c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:07.845411 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8ec6fad8-44e4-492b-893f-c6037a42982c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:07.876434 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8ec6fad8-44e4-492b-893f-c6037a42982c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:07.878544 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8ec6fad8-44e4-492b-893f-c6037a42982c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:07.881531 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8ec6fad8-44e4-492b-893f-c6037a42982c tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1604 microversion: 2.42 time: 0.495605 Aug 07 01:32:07.888046 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2380/4433] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:07 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1604 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:07.897681 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1b2a072a-7aee-4658-9524-e4f835a6fcb2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:07.921144 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1b2a072a-7aee-4658-9524-e4f835a6fcb2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1677 microversion: 2.1 time: 0.560685 Aug 07 01:32:07.924563 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2054/4434] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:07 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1677 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:08.097256 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cb06282e-99d8-4ef2-9677-f8fb835b25be tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:08.098048 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cb06282e-99d8-4ef2-9677-f8fb835b25be tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:08.120188 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb06282e-99d8-4ef2-9677-f8fb835b25be tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:08.120840 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb06282e-99d8-4ef2-9677-f8fb835b25be tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:08.121300 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb06282e-99d8-4ef2-9677-f8fb835b25be tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:08.122245 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb06282e-99d8-4ef2-9677-f8fb835b25be tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:08.122871 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb06282e-99d8-4ef2-9677-f8fb835b25be tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:08.123734 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb06282e-99d8-4ef2-9677-f8fb835b25be tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:08.422572 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cb06282e-99d8-4ef2-9677-f8fb835b25be tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:08.460408 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cb06282e-99d8-4ef2-9677-f8fb835b25be tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:08.469954 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cb06282e-99d8-4ef2-9677-f8fb835b25be tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:08.474282 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cb06282e-99d8-4ef2-9677-f8fb835b25be tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1604 microversion: 2.32 time: 0.381014 Aug 07 01:32:08.474877 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2381/4435] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:08 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1604 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:08.899588 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-45911c27-95c5-4a24-b49b-5cd781f3fd23 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Action: 'create', calling method: .version_select at 0x7f9e240500d0>, body: {"keypair": {"name": "tempest-keypair-64422711", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJJPe8cv7qkLrlvloH+gi6XAyXJYlzMANnSK19Ikc9pAUGF3BZV8QaxUF67Qw5jm6mLNk/SDCtIy/Seh9LCPVihXMso7IlRv1MVlI54VAznazVcXqehLB7ChEHH1qNUPA=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:32:08.913838 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8a8140eb-2128-4a0f-916f-e0a6787a6546 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:08.915555 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8a8140eb-2128-4a0f-916f-e0a6787a6546 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:08.948220 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a8140eb-2128-4a0f-916f-e0a6787a6546 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:08.960458 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a8140eb-2128-4a0f-916f-e0a6787a6546 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:08.962411 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a8140eb-2128-4a0f-916f-e0a6787a6546 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:08.969238 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a8140eb-2128-4a0f-916f-e0a6787a6546 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:08.972213 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a8140eb-2128-4a0f-916f-e0a6787a6546 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:08.972449 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a8140eb-2128-4a0f-916f-e0a6787a6546 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:09.000190 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-45911c27-95c5-4a24-b49b-5cd781f3fd23 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Getting quotas for project 284c227cd03a4c1294ed40d7b1594d56. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:32:09.008943 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-45911c27-95c5-4a24-b49b-5cd781f3fd23 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Getting quotas for user bed65a4d62184f52af3d2dd322eeec47 and project 284c227cd03a4c1294ed40d7b1594d56. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:32:09.093502 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-45911c27-95c5-4a24-b49b-5cd781f3fd23 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.503308 Aug 07 01:32:09.108308 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2055/4436] 10.222.0.39 () {62 vars in 1200 bytes} [Sun Aug 7 01:32:08 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 519 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 07 01:32:09.114085 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-354facfb-a3b3-456f-b13f-451c3470cf53 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:09.124957 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-354facfb-a3b3-456f-b13f-451c3470cf53 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:09.134418 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-354facfb-a3b3-456f-b13f-451c3470cf53 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:09.135159 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-354facfb-a3b3-456f-b13f-451c3470cf53 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:09.135746 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-354facfb-a3b3-456f-b13f-451c3470cf53 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:09.136661 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-354facfb-a3b3-456f-b13f-451c3470cf53 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:09.137372 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-354facfb-a3b3-456f-b13f-451c3470cf53 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:09.145406 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-354facfb-a3b3-456f-b13f-451c3470cf53 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:09.329499 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8a8140eb-2128-4a0f-916f-e0a6787a6546 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:09.350632 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8a8140eb-2128-4a0f-916f-e0a6787a6546 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:09.352258 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8a8140eb-2128-4a0f-916f-e0a6787a6546 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:09.353605 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8a8140eb-2128-4a0f-916f-e0a6787a6546 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1604 microversion: 2.42 time: 0.445510 Aug 07 01:32:09.369064 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2382/4437] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:08 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1604 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:09.498756 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9620d22c-b791-45d2-85bf-69efe24c7a6e tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:09.499394 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9620d22c-b791-45d2-85bf-69efe24c7a6e tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:09.513347 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9620d22c-b791-45d2-85bf-69efe24c7a6e tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:09.514121 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9620d22c-b791-45d2-85bf-69efe24c7a6e tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:09.514907 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9620d22c-b791-45d2-85bf-69efe24c7a6e tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:09.515848 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9620d22c-b791-45d2-85bf-69efe24c7a6e tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:09.516484 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9620d22c-b791-45d2-85bf-69efe24c7a6e tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:09.517094 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9620d22c-b791-45d2-85bf-69efe24c7a6e tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:09.734080 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9620d22c-b791-45d2-85bf-69efe24c7a6e tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:09.766607 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9620d22c-b791-45d2-85bf-69efe24c7a6e tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:09.782554 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9620d22c-b791-45d2-85bf-69efe24c7a6e tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:09.785679 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9620d22c-b791-45d2-85bf-69efe24c7a6e tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1604 microversion: 2.32 time: 0.291110 Aug 07 01:32:09.786298 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2383/4438] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:09 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1604 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:32:10.382150 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-aef58aff-3f02-4408-b8f2-443c546c6a0b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:10.382794 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-aef58aff-3f02-4408-b8f2-443c546c6a0b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:10.394225 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:10.395767 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aef58aff-3f02-4408-b8f2-443c546c6a0b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:10.400792 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aef58aff-3f02-4408-b8f2-443c546c6a0b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:10.401266 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aef58aff-3f02-4408-b8f2-443c546c6a0b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:10.402051 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aef58aff-3f02-4408-b8f2-443c546c6a0b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:10.402526 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aef58aff-3f02-4408-b8f2-443c546c6a0b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:10.402963 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aef58aff-3f02-4408-b8f2-443c546c6a0b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:10.594909 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-354facfb-a3b3-456f-b13f-451c3470cf53 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:10.629497 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-354facfb-a3b3-456f-b13f-451c3470cf53 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1677 microversion: 2.1 time: 1.519541 Aug 07 01:32:10.631288 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2056/4439] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:09 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1677 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:10.685387 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-aef58aff-3f02-4408-b8f2-443c546c6a0b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:10.726563 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-aef58aff-3f02-4408-b8f2-443c546c6a0b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:10.728515 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-aef58aff-3f02-4408-b8f2-443c546c6a0b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:10.730102 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-aef58aff-3f02-4408-b8f2-443c546c6a0b tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1604 microversion: 2.42 time: 0.351968 Aug 07 01:32:10.740663 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2384/4440] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:10 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1604 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:10.819588 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-522c146e-843a-4cfc-a987-35875406b64f tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:10.820546 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-522c146e-843a-4cfc-a987-35875406b64f tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:10.838121 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-522c146e-843a-4cfc-a987-35875406b64f tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:10.845370 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-522c146e-843a-4cfc-a987-35875406b64f tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:10.846819 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-522c146e-843a-4cfc-a987-35875406b64f tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:10.853920 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-522c146e-843a-4cfc-a987-35875406b64f tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:10.857316 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-522c146e-843a-4cfc-a987-35875406b64f tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:10.860697 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-522c146e-843a-4cfc-a987-35875406b64f tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:11.122245 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-522c146e-843a-4cfc-a987-35875406b64f tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:11.142115 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-522c146e-843a-4cfc-a987-35875406b64f tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:11.159482 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-522c146e-843a-4cfc-a987-35875406b64f tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:11.163349 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-522c146e-843a-4cfc-a987-35875406b64f tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1604 microversion: 2.32 time: 0.347803 Aug 07 01:32:11.164997 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2057/4441] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:10 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1604 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:11.634270 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2e02ee28-3949-4c0b-abbe-4201e9ee8ea3 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1257375188", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": "none"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:32:11.651189 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9a2015ef-ad34-4c7a-b6c5-5b498f25544d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:11.652640 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9a2015ef-ad34-4c7a-b6c5-5b498f25544d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:11.663560 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a2015ef-ad34-4c7a-b6c5-5b498f25544d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:11.664093 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a2015ef-ad34-4c7a-b6c5-5b498f25544d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:11.664535 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a2015ef-ad34-4c7a-b6c5-5b498f25544d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:11.665262 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a2015ef-ad34-4c7a-b6c5-5b498f25544d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:11.665720 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a2015ef-ad34-4c7a-b6c5-5b498f25544d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:11.666150 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a2015ef-ad34-4c7a-b6c5-5b498f25544d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:11.774661 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-2e02ee28-3949-4c0b-abbe-4201e9ee8ea3 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:32:11.775258 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-2e02ee28-3949-4c0b-abbe-4201e9ee8ea3 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:32:11.775854 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-2e02ee28-3949-4c0b-abbe-4201e9ee8ea3 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:32:11.776412 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-2e02ee28-3949-4c0b-abbe-4201e9ee8ea3 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:32:11.776958 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-2e02ee28-3949-4c0b-abbe-4201e9ee8ea3 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:32:11.809082 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2e02ee28-3949-4c0b-abbe-4201e9ee8ea3 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:11.810894 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2e02ee28-3949-4c0b-abbe-4201e9ee8ea3 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:11.812280 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2e02ee28-3949-4c0b-abbe-4201e9ee8ea3 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:11.821958 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2e02ee28-3949-4c0b-abbe-4201e9ee8ea3 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:11.821958 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2e02ee28-3949-4c0b-abbe-4201e9ee8ea3 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:11.823834 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2e02ee28-3949-4c0b-abbe-4201e9ee8ea3 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:11.911834 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-2e02ee28-3949-4c0b-abbe-4201e9ee8ea3 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Getting quotas for project 3a1d54252c734d47954009cc5aa6f974. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:32:11.935175 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-2e02ee28-3949-4c0b-abbe-4201e9ee8ea3 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Getting quotas for user 19818a0199054900ba2991c3f8712430 and project 3a1d54252c734d47954009cc5aa6f974. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:32:12.003812 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2e02ee28-3949-4c0b-abbe-4201e9ee8ea3 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:32:12.008093 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2e02ee28-3949-4c0b-abbe-4201e9ee8ea3 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] [instance: 91892278-cbe1-42ac-8251-965a9a2d814c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:32:12.133092 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2e02ee28-3949-4c0b-abbe-4201e9ee8ea3 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.136091 Aug 07 01:32:12.147538 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2385/4442] 10.222.0.39 () {62 vars in 1188 bytes} [Sun Aug 7 01:32:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1145 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 07 01:32:12.153775 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e5a6440b-2610-4979-bee7-978cd5d28042 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:12.154829 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e5a6440b-2610-4979-bee7-978cd5d28042 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:12.172599 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5a6440b-2610-4979-bee7-978cd5d28042 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:12.173348 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5a6440b-2610-4979-bee7-978cd5d28042 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:12.176283 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5a6440b-2610-4979-bee7-978cd5d28042 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:12.177297 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5a6440b-2610-4979-bee7-978cd5d28042 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:12.177782 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5a6440b-2610-4979-bee7-978cd5d28042 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:12.178225 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5a6440b-2610-4979-bee7-978cd5d28042 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:12.793277 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e5a6440b-2610-4979-bee7-978cd5d28042 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:12.806302 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9a2015ef-ad34-4c7a-b6c5-5b498f25544d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:12.815661 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9a2015ef-ad34-4c7a-b6c5-5b498f25544d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1677 microversion: 2.1 time: 1.168199 Aug 07 01:32:12.816125 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e5a6440b-2610-4979-bee7-978cd5d28042 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:12.825081 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2058/4443] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:11 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1677 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:32:12.826175 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e5a6440b-2610-4979-bee7-978cd5d28042 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:12.827432 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e5a6440b-2610-4979-bee7-978cd5d28042 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1604 microversion: 2.42 time: 0.678527 Aug 07 01:32:12.836196 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a087013b-b593-4350-9435-68e914098729 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:12.836332 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2386/4444] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:12 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1604 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:12.836430 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a087013b-b593-4350-9435-68e914098729 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] [instance: 91892278-cbe1-42ac-8251-965a9a2d814c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:12.857562 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b87b68c0-dee0-499b-a82e-5b54d9098391 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:12.858309 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b87b68c0-dee0-499b-a82e-5b54d9098391 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:12.884820 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b87b68c0-dee0-499b-a82e-5b54d9098391 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:12.886028 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b87b68c0-dee0-499b-a82e-5b54d9098391 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:12.893198 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b87b68c0-dee0-499b-a82e-5b54d9098391 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:12.895326 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b87b68c0-dee0-499b-a82e-5b54d9098391 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:12.906135 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b87b68c0-dee0-499b-a82e-5b54d9098391 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:12.906965 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b87b68c0-dee0-499b-a82e-5b54d9098391 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:13.176073 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b87b68c0-dee0-499b-a82e-5b54d9098391 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:13.197682 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b87b68c0-dee0-499b-a82e-5b54d9098391 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:13.202687 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b87b68c0-dee0-499b-a82e-5b54d9098391 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:13.204341 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b87b68c0-dee0-499b-a82e-5b54d9098391 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1604 microversion: 2.32 time: 0.368551 Aug 07 01:32:13.206521 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2387/4445] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:12 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1604 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:13.308752 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a087013b-b593-4350-9435-68e914098729 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19818a0199054900ba2991c3f8712430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1d54252c734d47954009cc5aa6f974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:13.325038 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a087013b-b593-4350-9435-68e914098729 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19818a0199054900ba2991c3f8712430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1d54252c734d47954009cc5aa6f974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:13.333366 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a087013b-b593-4350-9435-68e914098729 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19818a0199054900ba2991c3f8712430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1d54252c734d47954009cc5aa6f974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:13.338544 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a087013b-b593-4350-9435-68e914098729 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] 10.222.0.39 "GET /compute/v2.1/servers/91892278-cbe1-42ac-8251-965a9a2d814c" status: 200 len: 1281 microversion: 2.47 time: 0.509655 Aug 07 01:32:13.358902 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2059/4446] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:12 2022] GET /compute/v2.1/servers/91892278-cbe1-42ac-8251-965a9a2d814c => generated 1281 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:13.852917 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fca7c862-095c-419d-baa2-b024590c34ac tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:13.854306 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fca7c862-095c-419d-baa2-b024590c34ac tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:13.856918 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0afb1748-2054-444c-992d-6557ad1bcf72 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:13.858130 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0afb1748-2054-444c-992d-6557ad1bcf72 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:13.882718 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fca7c862-095c-419d-baa2-b024590c34ac tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:13.886818 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fca7c862-095c-419d-baa2-b024590c34ac tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:13.888540 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0afb1748-2054-444c-992d-6557ad1bcf72 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:13.890112 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fca7c862-095c-419d-baa2-b024590c34ac tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:13.891909 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fca7c862-095c-419d-baa2-b024590c34ac tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:13.893454 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0afb1748-2054-444c-992d-6557ad1bcf72 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:13.895236 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0afb1748-2054-444c-992d-6557ad1bcf72 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:13.896374 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fca7c862-095c-419d-baa2-b024590c34ac tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:13.897446 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fca7c862-095c-419d-baa2-b024590c34ac tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:13.898223 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0afb1748-2054-444c-992d-6557ad1bcf72 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:13.899048 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0afb1748-2054-444c-992d-6557ad1bcf72 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:13.903500 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0afb1748-2054-444c-992d-6557ad1bcf72 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:13.925000 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:14.249476 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fca7c862-095c-419d-baa2-b024590c34ac tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:14.260366 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fca7c862-095c-419d-baa2-b024590c34ac tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:14.271698 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fca7c862-095c-419d-baa2-b024590c34ac tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:14.276391 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fca7c862-095c-419d-baa2-b024590c34ac tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1604 microversion: 2.42 time: 0.427696 Aug 07 01:32:14.283480 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2060/4447] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:13 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1604 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:14.310649 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-75d34d07-0372-44b5-ada8-a8171d19ef26 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:14.326066 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-75d34d07-0372-44b5-ada8-a8171d19ef26 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:14.349733 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75d34d07-0372-44b5-ada8-a8171d19ef26 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:14.351683 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75d34d07-0372-44b5-ada8-a8171d19ef26 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:14.354763 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75d34d07-0372-44b5-ada8-a8171d19ef26 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:14.358546 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75d34d07-0372-44b5-ada8-a8171d19ef26 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:14.359370 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75d34d07-0372-44b5-ada8-a8171d19ef26 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:14.361692 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75d34d07-0372-44b5-ada8-a8171d19ef26 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:14.604647 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-75d34d07-0372-44b5-ada8-a8171d19ef26 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:14.618037 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-75d34d07-0372-44b5-ada8-a8171d19ef26 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:14.622895 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-75d34d07-0372-44b5-ada8-a8171d19ef26 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:14.637410 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-75d34d07-0372-44b5-ada8-a8171d19ef26 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1604 microversion: 2.32 time: 0.349605 Aug 07 01:32:14.640711 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2061/4448] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:14 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1604 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:14.657147 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f3bee9cf-fcc5-48bb-8830-3bb10133d213 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:14.668009 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f3bee9cf-fcc5-48bb-8830-3bb10133d213 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] [instance: 91892278-cbe1-42ac-8251-965a9a2d814c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:14.694804 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f3bee9cf-fcc5-48bb-8830-3bb10133d213 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:14.705007 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f3bee9cf-fcc5-48bb-8830-3bb10133d213 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:14.712810 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f3bee9cf-fcc5-48bb-8830-3bb10133d213 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:14.721987 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f3bee9cf-fcc5-48bb-8830-3bb10133d213 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:14.730342 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f3bee9cf-fcc5-48bb-8830-3bb10133d213 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:14.731115 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f3bee9cf-fcc5-48bb-8830-3bb10133d213 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:15.043544 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f3bee9cf-fcc5-48bb-8830-3bb10133d213 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19818a0199054900ba2991c3f8712430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1d54252c734d47954009cc5aa6f974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:15.059245 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f3bee9cf-fcc5-48bb-8830-3bb10133d213 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19818a0199054900ba2991c3f8712430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1d54252c734d47954009cc5aa6f974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:15.063237 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f3bee9cf-fcc5-48bb-8830-3bb10133d213 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19818a0199054900ba2991c3f8712430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1d54252c734d47954009cc5aa6f974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:15.068478 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f3bee9cf-fcc5-48bb-8830-3bb10133d213 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] 10.222.0.39 "GET /compute/v2.1/servers/91892278-cbe1-42ac-8251-965a9a2d814c" status: 200 len: 1339 microversion: 2.47 time: 0.426203 Aug 07 01:32:15.069667 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2062/4449] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:14 2022] GET /compute/v2.1/servers/91892278-cbe1-42ac-8251-965a9a2d814c => generated 1339 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:15.307294 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-afc5b54f-bb9d-4d40-a085-332f69d669a9 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:15.308107 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-afc5b54f-bb9d-4d40-a085-332f69d669a9 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:15.312955 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:15.338440 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-afc5b54f-bb9d-4d40-a085-332f69d669a9 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:15.339004 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-afc5b54f-bb9d-4d40-a085-332f69d669a9 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:15.342702 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-afc5b54f-bb9d-4d40-a085-332f69d669a9 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:15.345093 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-afc5b54f-bb9d-4d40-a085-332f69d669a9 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:15.345821 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-afc5b54f-bb9d-4d40-a085-332f69d669a9 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:15.346275 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-afc5b54f-bb9d-4d40-a085-332f69d669a9 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:15.532485 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0afb1748-2054-444c-992d-6557ad1bcf72 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:15.603546 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0afb1748-2054-444c-992d-6557ad1bcf72 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1677 microversion: 2.1 time: 1.758802 Aug 07 01:32:15.622394 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2388/4450] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:13 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1677 bytes in 1778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:15.677923 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-afc5b54f-bb9d-4d40-a085-332f69d669a9 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:15.699013 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-afc5b54f-bb9d-4d40-a085-332f69d669a9 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:15.700597 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-afc5b54f-bb9d-4d40-a085-332f69d669a9 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:15.706964 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-afc5b54f-bb9d-4d40-a085-332f69d669a9 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1604 microversion: 2.42 time: 0.399174 Aug 07 01:32:15.721067 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2063/4451] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:15 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1604 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:32:15.734345 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-dd2751a3-81ea-4593-b695-dc17153b0da2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:15.735418 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-dd2751a3-81ea-4593-b695-dc17153b0da2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:15.749627 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd2751a3-81ea-4593-b695-dc17153b0da2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:15.753891 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd2751a3-81ea-4593-b695-dc17153b0da2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:15.754758 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd2751a3-81ea-4593-b695-dc17153b0da2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:15.755701 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd2751a3-81ea-4593-b695-dc17153b0da2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:15.757827 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd2751a3-81ea-4593-b695-dc17153b0da2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:15.759806 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd2751a3-81ea-4593-b695-dc17153b0da2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:15.922576 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c887c0d6-ece9-4cf4-941f-f08c960a5a79 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] Calling method '.version_select at 0x7f9e24743670>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:16.047426 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c887c0d6-ece9-4cf4-941f-f08c960a5a79 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/cc2e01ef7bf24c1e920beed5c3ea5cc4/defaults" status: 200 len: 371 microversion: 2.1 time: 0.415601 Aug 07 01:32:16.048437 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2389/4452] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Aug 7 01:32:15 2022] GET /compute/v2.1/os-quota-sets/cc2e01ef7bf24c1e920beed5c3ea5cc4/defaults => generated 371 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:32:16.051282 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-dd2751a3-81ea-4593-b695-dc17153b0da2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:16.055019 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f30b9b57-0489-4de3-8ca0-53e66f7d2f6f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1100393226", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "292dddd5-ed28-43d0-b5c6-61ff270beb56"}], "security_groups": [{"name": "tempest-securitygroup--1912567532"}], "key_name": "tempest-keypair-64422711", "user_data": "}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:32:16.067394 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-dd2751a3-81ea-4593-b695-dc17153b0da2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:16.072368 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-dd2751a3-81ea-4593-b695-dc17153b0da2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:16.074765 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-dd2751a3-81ea-4593-b695-dc17153b0da2 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1604 microversion: 2.32 time: 0.351677 Aug 07 01:32:16.075498 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2064/4453] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:15 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1604 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:16.106507 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-aec9c302-3b72-48a7-8b18-0aaa72c1bd59 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] Calling method '.version_select at 0x7f9e240501f0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:16.223043 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-f30b9b57-0489-4de3-8ca0-53e66f7d2f6f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] validate_networks() for [('292dddd5-ed28-43d0-b5c6-61ff270beb56', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:32:16.232006 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-aec9c302-3b72-48a7-8b18-0aaa72c1bd59 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/cc2e01ef7bf24c1e920beed5c3ea5cc4" status: 200 len: 371 microversion: 2.1 time: 0.155080 Aug 07 01:32:16.232943 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2065/4454] 10.222.0.39 () {58 vars in 1242 bytes} [Sun Aug 7 01:32:16 2022] GET /compute/v2.1/os-quota-sets/cc2e01ef7bf24c1e920beed5c3ea5cc4 => generated 371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:32:16.238669 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-11376cc3-b932-4821-aa45-4dc209ad4c8a tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:16.239428 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-11376cc3-b932-4821-aa45-4dc209ad4c8a tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] [instance: 91892278-cbe1-42ac-8251-965a9a2d814c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:16.248721 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-11376cc3-b932-4821-aa45-4dc209ad4c8a tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:16.249731 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-11376cc3-b932-4821-aa45-4dc209ad4c8a tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:16.250343 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-11376cc3-b932-4821-aa45-4dc209ad4c8a tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:16.251282 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-11376cc3-b932-4821-aa45-4dc209ad4c8a tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:16.252589 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-11376cc3-b932-4821-aa45-4dc209ad4c8a tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:16.253189 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-11376cc3-b932-4821-aa45-4dc209ad4c8a tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:16.402194 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-11376cc3-b932-4821-aa45-4dc209ad4c8a tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19818a0199054900ba2991c3f8712430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1d54252c734d47954009cc5aa6f974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:16.411686 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-11376cc3-b932-4821-aa45-4dc209ad4c8a tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19818a0199054900ba2991c3f8712430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1d54252c734d47954009cc5aa6f974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:16.414206 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-11376cc3-b932-4821-aa45-4dc209ad4c8a tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19818a0199054900ba2991c3f8712430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1d54252c734d47954009cc5aa6f974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:16.418430 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-11376cc3-b932-4821-aa45-4dc209ad4c8a tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] 10.222.0.39 "GET /compute/v2.1/servers/91892278-cbe1-42ac-8251-965a9a2d814c" status: 200 len: 1339 microversion: 2.47 time: 0.184352 Aug 07 01:32:16.438817 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2066/4455] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:16 2022] GET /compute/v2.1/servers/91892278-cbe1-42ac-8251-965a9a2d814c => generated 1339 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:16.460360 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-17f1a7f8-c7d3-4269-8b7b-3c625c3bf63b tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] Calling method '.version_select at 0x7f9e2409daf0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:16.583661 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-17f1a7f8-c7d3-4269-8b7b-3c625c3bf63b tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/cc2e01ef7bf24c1e920beed5c3ea5cc4/defaults" status: 200 len: 371 microversion: 2.1 time: 0.140932 Aug 07 01:32:16.586300 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2067/4456] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Aug 7 01:32:16 2022] GET /compute/v2.1/os-quota-sets/cc2e01ef7bf24c1e920beed5c3ea5cc4/defaults => generated 371 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:32:16.599061 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c93cc45a-00eb-4b9c-a995-51ddaf7425c6 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] Calling method '.version_select at 0x7f9e29800940>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:16.748641 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c93cc45a-00eb-4b9c-a995-51ddaf7425c6 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/cc2e01ef7bf24c1e920beed5c3ea5cc4" status: 200 len: 371 microversion: 2.1 time: 0.154009 Aug 07 01:32:16.749232 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2068/4457] 10.222.0.39 () {58 vars in 1242 bytes} [Sun Aug 7 01:32:16 2022] GET /compute/v2.1/os-quota-sets/cc2e01ef7bf24c1e920beed5c3ea5cc4 => generated 371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:32:16.810011 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-eb094cf3-5eb3-403d-a7c4-88d8e7fa16bf tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:16.811508 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-eb094cf3-5eb3-403d-a7c4-88d8e7fa16bf tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:16.842180 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb094cf3-5eb3-403d-a7c4-88d8e7fa16bf tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:16.843942 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb094cf3-5eb3-403d-a7c4-88d8e7fa16bf tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:16.845071 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb094cf3-5eb3-403d-a7c4-88d8e7fa16bf tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:16.847257 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb094cf3-5eb3-403d-a7c4-88d8e7fa16bf tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:16.851874 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb094cf3-5eb3-403d-a7c4-88d8e7fa16bf tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:16.853909 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb094cf3-5eb3-403d-a7c4-88d8e7fa16bf tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:17.402117 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-f30b9b57-0489-4de3-8ca0-53e66f7d2f6f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:32:17.403184 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-f30b9b57-0489-4de3-8ca0-53e66f7d2f6f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:32:17.403698 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-f30b9b57-0489-4de3-8ca0-53e66f7d2f6f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:32:17.404145 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-f30b9b57-0489-4de3-8ca0-53e66f7d2f6f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:32:17.404559 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-f30b9b57-0489-4de3-8ca0-53e66f7d2f6f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:32:17.432553 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f30b9b57-0489-4de3-8ca0-53e66f7d2f6f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:17.434526 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f30b9b57-0489-4de3-8ca0-53e66f7d2f6f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:17.436313 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f30b9b57-0489-4de3-8ca0-53e66f7d2f6f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:17.443223 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f30b9b57-0489-4de3-8ca0-53e66f7d2f6f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:17.444336 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f30b9b57-0489-4de3-8ca0-53e66f7d2f6f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:17.445104 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f30b9b57-0489-4de3-8ca0-53e66f7d2f6f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:17.512712 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-f30b9b57-0489-4de3-8ca0-53e66f7d2f6f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Getting quotas for project 284c227cd03a4c1294ed40d7b1594d56. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:32:17.522792 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-f30b9b57-0489-4de3-8ca0-53e66f7d2f6f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Getting quotas for user bed65a4d62184f52af3d2dd322eeec47 and project 284c227cd03a4c1294ed40d7b1594d56. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:32:17.560061 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f30b9b57-0489-4de3-8ca0-53e66f7d2f6f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:32:17.562650 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f30b9b57-0489-4de3-8ca0-53e66f7d2f6f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:32:17.662592 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f30b9b57-0489-4de3-8ca0-53e66f7d2f6f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.612604 Aug 07 01:32:17.664003 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2390/4458] 10.222.0.39 () {62 vars in 1188 bytes} [Sun Aug 7 01:32:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 1615 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 07 01:32:17.668863 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d0532808-7a56-4567-b4fb-db23492cb723 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:17.669485 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d0532808-7a56-4567-b4fb-db23492cb723 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:17.684173 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0532808-7a56-4567-b4fb-db23492cb723 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:17.685021 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0532808-7a56-4567-b4fb-db23492cb723 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:17.685975 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0532808-7a56-4567-b4fb-db23492cb723 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:17.689310 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0532808-7a56-4567-b4fb-db23492cb723 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:17.690280 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0532808-7a56-4567-b4fb-db23492cb723 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:17.691131 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0532808-7a56-4567-b4fb-db23492cb723 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:17.823183 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d0532808-7a56-4567-b4fb-db23492cb723 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:17.836670 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d0532808-7a56-4567-b4fb-db23492cb723 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:17.838403 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d0532808-7a56-4567-b4fb-db23492cb723 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:17.840202 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d0532808-7a56-4567-b4fb-db23492cb723 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1604 microversion: 2.42 time: 0.174823 Aug 07 01:32:17.841361 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2391/4459] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:17 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1604 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:17.848504 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-998846e0-9453-4004-a16f-36519caf6df0 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] Calling method '.version_select at 0x7f9e24900940>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:17.924165 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-eb094cf3-5eb3-403d-a7c4-88d8e7fa16bf tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:17.936421 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-eb094cf3-5eb3-403d-a7c4-88d8e7fa16bf tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1654 microversion: 2.1 time: 1.180656 Aug 07 01:32:17.957813 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2069/4460] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:16 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1654 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:17.966104 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1e8e2bb6-1958-45e2-8f25-b73e430f01a8 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:17.967628 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1e8e2bb6-1958-45e2-8f25-b73e430f01a8 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:17.987757 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-998846e0-9453-4004-a16f-36519caf6df0 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/cc2e01ef7bf24c1e920beed5c3ea5cc4?user_id=5c8e279ad95d4f8e9241da4cd97ae682" status: 200 len: 371 microversion: 2.1 time: 0.143846 Aug 07 01:32:17.990585 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e8e2bb6-1958-45e2-8f25-b73e430f01a8 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:17.991932 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e8e2bb6-1958-45e2-8f25-b73e430f01a8 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:18.001341 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e8e2bb6-1958-45e2-8f25-b73e430f01a8 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:18.002316 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2392/4461] 10.222.0.39 () {58 vars in 1323 bytes} [Sun Aug 7 01:32:17 2022] GET /compute/v2.1/os-quota-sets/cc2e01ef7bf24c1e920beed5c3ea5cc4?user_id=5c8e279ad95d4f8e9241da4cd97ae682 => generated 371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:32:18.002848 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e8e2bb6-1958-45e2-8f25-b73e430f01a8 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:18.002848 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e8e2bb6-1958-45e2-8f25-b73e430f01a8 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:18.002848 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e8e2bb6-1958-45e2-8f25-b73e430f01a8 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:18.021095 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8015020f-6e67-4c87-94cd-4a60f46ad701 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:18.023725 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8015020f-6e67-4c87-94cd-4a60f46ad701 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] [instance: 91892278-cbe1-42ac-8251-965a9a2d814c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:18.040629 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8015020f-6e67-4c87-94cd-4a60f46ad701 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:18.041207 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8015020f-6e67-4c87-94cd-4a60f46ad701 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:18.042416 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8015020f-6e67-4c87-94cd-4a60f46ad701 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:18.043720 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8015020f-6e67-4c87-94cd-4a60f46ad701 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:18.046247 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8015020f-6e67-4c87-94cd-4a60f46ad701 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:18.050197 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8015020f-6e67-4c87-94cd-4a60f46ad701 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:18.094110 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e8e2bb6-1958-45e2-8f25-b73e430f01a8 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:18.097167 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e8e2bb6-1958-45e2-8f25-b73e430f01a8 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:18.098269 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e8e2bb6-1958-45e2-8f25-b73e430f01a8 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:18.100943 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-1e8e2bb6-1958-45e2-8f25-b73e430f01a8 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lazy-loading 'fault' on Instance uuid 77ed645e-669e-4167-ae78-8ce69770babf {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:32:18.217162 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8015020f-6e67-4c87-94cd-4a60f46ad701 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19818a0199054900ba2991c3f8712430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1d54252c734d47954009cc5aa6f974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:18.258950 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8015020f-6e67-4c87-94cd-4a60f46ad701 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19818a0199054900ba2991c3f8712430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1d54252c734d47954009cc5aa6f974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:18.261037 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8015020f-6e67-4c87-94cd-4a60f46ad701 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19818a0199054900ba2991c3f8712430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1d54252c734d47954009cc5aa6f974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:18.262293 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8015020f-6e67-4c87-94cd-4a60f46ad701 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] 10.222.0.39 "GET /compute/v2.1/servers/91892278-cbe1-42ac-8251-965a9a2d814c" status: 200 len: 1360 microversion: 2.47 time: 0.267236 Aug 07 01:32:18.291140 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2393/4462] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:17 2022] GET /compute/v2.1/servers/91892278-cbe1-42ac-8251-965a9a2d814c => generated 1360 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:18.309578 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-aa25d10e-e0a0-44bb-80eb-f252773c530b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:18.313150 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-aa25d10e-e0a0-44bb-80eb-f252773c530b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:18.400015 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-aa25d10e-e0a0-44bb-80eb-f252773c530b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:18.427028 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-aa25d10e-e0a0-44bb-80eb-f252773c530b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:18.433499 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-aa25d10e-e0a0-44bb-80eb-f252773c530b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:18.440004 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-aa25d10e-e0a0-44bb-80eb-f252773c530b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1280 microversion: 2.20 time: 0.142635 Aug 07 01:32:18.442820 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2394/4463] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:18 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1280 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:18.463401 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8bf0ed41-3332-41b6-bbe8-ff0d182b8b25 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:32:18.485177 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8bf0ed41-3332-41b6-bbe8-ff0d182b8b25 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:18.485968 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8bf0ed41-3332-41b6-bbe8-ff0d182b8b25 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:18.486602 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8bf0ed41-3332-41b6-bbe8-ff0d182b8b25 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:18.532053 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8bf0ed41-3332-41b6-bbe8-ff0d182b8b25 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Going to try to start instance {{(pid=119516) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 07 01:32:18.623720 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8bf0ed41-3332-41b6-bbe8-ff0d182b8b25 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action" status: 202 len: 0 microversion: 2.1 time: 0.159435 Aug 07 01:32:18.628727 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2395/4464] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:32:18 2022] POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:32:18.670047 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7887705c-c6d2-4d13-88f5-fa888fde6433 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-546154122"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:32:18.678744 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7887705c-c6d2-4d13-88f5-fa888fde6433 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] [instance: 91892278-cbe1-42ac-8251-965a9a2d814c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:18.692564 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7887705c-c6d2-4d13-88f5-fa888fde6433 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:18.704743 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7887705c-c6d2-4d13-88f5-fa888fde6433 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:18.705200 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7887705c-c6d2-4d13-88f5-fa888fde6433 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:18.706152 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7887705c-c6d2-4d13-88f5-fa888fde6433 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:18.706619 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7887705c-c6d2-4d13-88f5-fa888fde6433 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:18.707056 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7887705c-c6d2-4d13-88f5-fa888fde6433 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:18.800860 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1e8e2bb6-1958-45e2-8f25-b73e430f01a8 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:18.815058 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1e8e2bb6-1958-45e2-8f25-b73e430f01a8 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:18.822684 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1e8e2bb6-1958-45e2-8f25-b73e430f01a8 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e379b67e2bb248b3ad25b92b2082b0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:18.826803 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1e8e2bb6-1958-45e2-8f25-b73e430f01a8 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 200 len: 1371 microversion: 2.32 time: 0.867495 Aug 07 01:32:18.831075 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2070/4465] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:17 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 1371 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:18.853662 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-284dbaec-36d0-437a-9782-c4a58ab3511d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:18.854473 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-284dbaec-36d0-437a-9782-c4a58ab3511d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:18.867354 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-284dbaec-36d0-437a-9782-c4a58ab3511d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:18.870097 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-284dbaec-36d0-437a-9782-c4a58ab3511d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:18.870744 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-284dbaec-36d0-437a-9782-c4a58ab3511d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:18.871656 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-284dbaec-36d0-437a-9782-c4a58ab3511d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:18.872335 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-284dbaec-36d0-437a-9782-c4a58ab3511d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:18.872835 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-284dbaec-36d0-437a-9782-c4a58ab3511d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:19.115225 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7887705c-c6d2-4d13-88f5-fa888fde6433 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] 10.222.0.39 "POST /compute/v2.1/servers/91892278-cbe1-42ac-8251-965a9a2d814c/action" status: 202 len: 52 microversion: 2.47 time: 0.483778 Aug 07 01:32:19.115978 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2396/4466] 10.222.0.39 () {62 vars in 1319 bytes} [Sun Aug 7 01:32:18 2022] POST /compute/v2.1/servers/91892278-cbe1-42ac-8251-965a9a2d814c/action => generated 52 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Aug 07 01:32:19.146458 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1f312a62-f54c-4ede-9d68-3ac7882e51ed tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:19.148341 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1f312a62-f54c-4ede-9d68-3ac7882e51ed tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:19.161921 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f312a62-f54c-4ede-9d68-3ac7882e51ed tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:19.162429 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f312a62-f54c-4ede-9d68-3ac7882e51ed tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:19.162871 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f312a62-f54c-4ede-9d68-3ac7882e51ed tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:19.168661 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f312a62-f54c-4ede-9d68-3ac7882e51ed tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:19.170494 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f312a62-f54c-4ede-9d68-3ac7882e51ed tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:19.172005 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f312a62-f54c-4ede-9d68-3ac7882e51ed tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:19.319234 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1f312a62-f54c-4ede-9d68-3ac7882e51ed tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:19.335921 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1f312a62-f54c-4ede-9d68-3ac7882e51ed tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:19.340807 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1f312a62-f54c-4ede-9d68-3ac7882e51ed tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:19.342200 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1f312a62-f54c-4ede-9d68-3ac7882e51ed tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1604 microversion: 2.42 time: 0.225111 Aug 07 01:32:19.354684 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2397/4467] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:19 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1604 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:19.359773 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3168f5f7-678c-4fa3-9423-9b6a9b5cedd0 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:19.360066 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3168f5f7-678c-4fa3-9423-9b6a9b5cedd0 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] [instance: 91892278-cbe1-42ac-8251-965a9a2d814c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:19.382791 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3168f5f7-678c-4fa3-9423-9b6a9b5cedd0 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:19.382791 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3168f5f7-678c-4fa3-9423-9b6a9b5cedd0 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:19.383008 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3168f5f7-678c-4fa3-9423-9b6a9b5cedd0 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:19.383780 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3168f5f7-678c-4fa3-9423-9b6a9b5cedd0 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:19.384348 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3168f5f7-678c-4fa3-9423-9b6a9b5cedd0 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:19.384876 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3168f5f7-678c-4fa3-9423-9b6a9b5cedd0 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:19.436916 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3168f5f7-678c-4fa3-9423-9b6a9b5cedd0 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] [instance: 91892278-cbe1-42ac-8251-965a9a2d814c] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:32:19.644095 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3168f5f7-678c-4fa3-9423-9b6a9b5cedd0 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] 10.222.0.39 "DELETE /compute/v2.1/servers/91892278-cbe1-42ac-8251-965a9a2d814c" status: 204 len: 0 microversion: 2.47 time: 0.292522 Aug 07 01:32:19.645355 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2398/4468] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Aug 7 01:32:19 2022] DELETE /compute/v2.1/servers/91892278-cbe1-42ac-8251-965a9a2d814c => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 01:32:19.665390 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-741c6075-d8e2-4802-a2f6-5fd3351ea494 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:19.667205 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-741c6075-d8e2-4802-a2f6-5fd3351ea494 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:19.690223 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-741c6075-d8e2-4802-a2f6-5fd3351ea494 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:19.690684 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-741c6075-d8e2-4802-a2f6-5fd3351ea494 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:19.691135 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-741c6075-d8e2-4802-a2f6-5fd3351ea494 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:19.691914 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-741c6075-d8e2-4802-a2f6-5fd3351ea494 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:19.692398 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-741c6075-d8e2-4802-a2f6-5fd3351ea494 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:19.692829 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-741c6075-d8e2-4802-a2f6-5fd3351ea494 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:19.851302 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-741c6075-d8e2-4802-a2f6-5fd3351ea494 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:19.871930 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-741c6075-d8e2-4802-a2f6-5fd3351ea494 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:19.873853 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-741c6075-d8e2-4802-a2f6-5fd3351ea494 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:19.875127 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-741c6075-d8e2-4802-a2f6-5fd3351ea494 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1340 microversion: 2.20 time: 0.224169 Aug 07 01:32:19.876082 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2399/4469] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:19 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1340 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:19.895356 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-79afe7a3-20af-4146-be1c-376e1d1e8235 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:19.896122 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-79afe7a3-20af-4146-be1c-376e1d1e8235 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] [instance: 91892278-cbe1-42ac-8251-965a9a2d814c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:19.912709 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-79afe7a3-20af-4146-be1c-376e1d1e8235 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:19.913353 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-79afe7a3-20af-4146-be1c-376e1d1e8235 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:19.913808 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-79afe7a3-20af-4146-be1c-376e1d1e8235 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:19.914750 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-79afe7a3-20af-4146-be1c-376e1d1e8235 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:19.915439 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-79afe7a3-20af-4146-be1c-376e1d1e8235 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:19.918156 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-79afe7a3-20af-4146-be1c-376e1d1e8235 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:20.056315 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-79afe7a3-20af-4146-be1c-376e1d1e8235 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19818a0199054900ba2991c3f8712430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1d54252c734d47954009cc5aa6f974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:20.067196 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-79afe7a3-20af-4146-be1c-376e1d1e8235 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19818a0199054900ba2991c3f8712430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1d54252c734d47954009cc5aa6f974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:20.068902 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-79afe7a3-20af-4146-be1c-376e1d1e8235 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19818a0199054900ba2991c3f8712430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1d54252c734d47954009cc5aa6f974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:20.070122 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-79afe7a3-20af-4146-be1c-376e1d1e8235 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] 10.222.0.39 "GET /compute/v2.1/servers/91892278-cbe1-42ac-8251-965a9a2d814c" status: 200 len: 1366 microversion: 2.47 time: 0.192476 Aug 07 01:32:20.071021 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2400/4470] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:19 2022] GET /compute/v2.1/servers/91892278-cbe1-42ac-8251-965a9a2d814c => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:20.075737 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d3742e75-f395-4ba5-b9d6-b167a1e12326 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:20.076400 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d3742e75-f395-4ba5-b9d6-b167a1e12326 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:20.106816 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3742e75-f395-4ba5-b9d6-b167a1e12326 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:20.107560 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3742e75-f395-4ba5-b9d6-b167a1e12326 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:20.108312 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3742e75-f395-4ba5-b9d6-b167a1e12326 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:20.109881 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3742e75-f395-4ba5-b9d6-b167a1e12326 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:20.110521 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3742e75-f395-4ba5-b9d6-b167a1e12326 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:20.111309 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3742e75-f395-4ba5-b9d6-b167a1e12326 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:20.135799 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-d3742e75-f395-4ba5-b9d6-b167a1e12326 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] HTTP exception thrown: Instance 77ed645e-669e-4167-ae78-8ce69770babf could not be found. Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d3742e75-f395-4ba5-b9d6-b167a1e12326 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Request method failure captured: Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf HTTP/1.1 Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xRRR67dDPG5CRb0Fu7BdplYiyQQVJSJFsqydip_k5hAO28x9NPyn0qghXJrztcIvSBYuoVxdfQujVqrJ49kFSTw1L6_JaJ_hQzLz0ShSPjLENbXhlF0Nemm1uJn97z5mh9Q3Vykn-x2GGjZa9CFyETd0ShFrnMvI3pReaSkp8Sde5c Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: X-Openstack-Nova-Api-Version: 2.32 Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 9ecc3d5efbe54d76ae9e6ed5f7633c1d Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-TaggedBootDevicesTest-1171090422 Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9ecc3d5efbe54d76ae9e6ed5f7633c1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9ecc3d5efbe54d76ae9e6ed5f7633c1d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9ecc3d5efbe54d76ae9e6ed5f7633c1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9ecc3d5efbe54d76ae9e6ed5f7633c1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-TaggedBootDevicesTest-1171090422 Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 9ecc3d5efbe54d76ae9e6ed5f7633c1d Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1171090422 Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-TaggedBootDevicesTest-1171090422-project Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: e379b67e2bb248b3ad25b92b2082b0fe Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-TaggedBootDevicesTest-1171090422-project Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 77ed645e-669e-4167-ae78-8ce69770babf could not be found. Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '77ed645e-669e-4167-ae78-8ce69770babf'} Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77ed645e-669e-4167-ae78-8ce69770babf could not be found. Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77ed645e-669e-4167-ae78-8ce69770babf could not be found. Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:32:20.141161 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:32:20.147167 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:32:20.147167 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:32:20.147167 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:32:20.147167 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:32:20.147167 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:32:20.147167 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:32:20.147167 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77ed645e-669e-4167-ae78-8ce69770babf could not be found. Aug 07 01:32:20.147167 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:32:20.162370 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d3742e75-f395-4ba5-b9d6-b167a1e12326 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Returning 404 to user: Instance 77ed645e-669e-4167-ae78-8ce69770babf could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:32:20.164073 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d3742e75-f395-4ba5-b9d6-b167a1e12326 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 404 len: 111 microversion: 2.32 time: 0.091752 Aug 07 01:32:20.164823 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2401/4471] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:20 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:32:20.178380 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bd4afda6-7b42-40dc-a41f-5e3294a8dc97 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '.version_select at 0x7f9e24414160>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:20.225848 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bd4afda6-7b42-40dc-a41f-5e3294a8dc97 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2116889065" status: 204 len: 0 microversion: 2.32 time: 0.054721 Aug 07 01:32:20.230148 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2402/4472] 10.222.0.39 () {60 vars in 1262 bytes} [Sun Aug 7 01:32:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2116889065 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 01:32:20.258271 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-284dbaec-36d0-437a-9782-c4a58ab3511d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:20.267175 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-284dbaec-36d0-437a-9782-c4a58ab3511d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1663 microversion: 2.1 time: 1.434599 Aug 07 01:32:20.287354 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2071/4473] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:18 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1663 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:20.374063 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0a381c57-0f1d-4d60-a420-49018637c545 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:20.374993 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0a381c57-0f1d-4d60-a420-49018637c545 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:20.405523 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a381c57-0f1d-4d60-a420-49018637c545 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:20.406214 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a381c57-0f1d-4d60-a420-49018637c545 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:20.408653 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a381c57-0f1d-4d60-a420-49018637c545 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:20.410823 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a381c57-0f1d-4d60-a420-49018637c545 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:20.412799 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a381c57-0f1d-4d60-a420-49018637c545 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:20.413427 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a381c57-0f1d-4d60-a420-49018637c545 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:20.610114 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0a381c57-0f1d-4d60-a420-49018637c545 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:20.625985 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0a381c57-0f1d-4d60-a420-49018637c545 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:20.628283 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0a381c57-0f1d-4d60-a420-49018637c545 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:20.629533 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0a381c57-0f1d-4d60-a420-49018637c545 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1604 microversion: 2.42 time: 0.260082 Aug 07 01:32:20.630101 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2403/4474] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:20 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1604 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:20.910572 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e26c2551-e96a-4207-ad7b-60ecfc0b3b06 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:20.911528 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e26c2551-e96a-4207-ad7b-60ecfc0b3b06 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:20.925253 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e26c2551-e96a-4207-ad7b-60ecfc0b3b06 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:20.927440 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e26c2551-e96a-4207-ad7b-60ecfc0b3b06 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:20.930036 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e26c2551-e96a-4207-ad7b-60ecfc0b3b06 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:20.930976 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e26c2551-e96a-4207-ad7b-60ecfc0b3b06 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:20.931762 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e26c2551-e96a-4207-ad7b-60ecfc0b3b06 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:20.932478 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e26c2551-e96a-4207-ad7b-60ecfc0b3b06 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:21.100288 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bab51d95-50d4-4179-9670-b7ad9de91ce3 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:21.100545 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bab51d95-50d4-4179-9670-b7ad9de91ce3 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] [instance: 91892278-cbe1-42ac-8251-965a9a2d814c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:21.117968 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bab51d95-50d4-4179-9670-b7ad9de91ce3 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:21.118478 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bab51d95-50d4-4179-9670-b7ad9de91ce3 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:21.118925 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bab51d95-50d4-4179-9670-b7ad9de91ce3 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:21.119649 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bab51d95-50d4-4179-9670-b7ad9de91ce3 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:21.120144 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bab51d95-50d4-4179-9670-b7ad9de91ce3 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:21.120579 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bab51d95-50d4-4179-9670-b7ad9de91ce3 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:21.211357 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e26c2551-e96a-4207-ad7b-60ecfc0b3b06 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:21.224739 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e26c2551-e96a-4207-ad7b-60ecfc0b3b06 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:21.230580 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e26c2551-e96a-4207-ad7b-60ecfc0b3b06 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:21.232622 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e26c2551-e96a-4207-ad7b-60ecfc0b3b06 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1338 microversion: 2.20 time: 0.327960 Aug 07 01:32:21.233696 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2072/4475] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:20 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1338 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:21.281382 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bab51d95-50d4-4179-9670-b7ad9de91ce3 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19818a0199054900ba2991c3f8712430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1d54252c734d47954009cc5aa6f974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:21.300285 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7063edc2-361e-4995-a011-ad34037fa77a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:21.302261 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7063edc2-361e-4995-a011-ad34037fa77a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:21.310212 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bab51d95-50d4-4179-9670-b7ad9de91ce3 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19818a0199054900ba2991c3f8712430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1d54252c734d47954009cc5aa6f974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:21.313336 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7063edc2-361e-4995-a011-ad34037fa77a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:21.315449 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bab51d95-50d4-4179-9670-b7ad9de91ce3 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19818a0199054900ba2991c3f8712430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1d54252c734d47954009cc5aa6f974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:21.327876 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7063edc2-361e-4995-a011-ad34037fa77a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:21.330069 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7063edc2-361e-4995-a011-ad34037fa77a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:21.331868 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bab51d95-50d4-4179-9670-b7ad9de91ce3 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] 10.222.0.39 "GET /compute/v2.1/servers/91892278-cbe1-42ac-8251-965a9a2d814c" status: 200 len: 1366 microversion: 2.47 time: 0.233341 Aug 07 01:32:21.332946 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7063edc2-361e-4995-a011-ad34037fa77a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:21.349320 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7063edc2-361e-4995-a011-ad34037fa77a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:21.349320 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7063edc2-361e-4995-a011-ad34037fa77a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:21.352643 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2404/4476] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:21 2022] GET /compute/v2.1/servers/91892278-cbe1-42ac-8251-965a9a2d814c => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:32:21.374037 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:21.659780 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5d13f153-a674-4a27-bb8f-d4cf31655216 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:21.661405 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5d13f153-a674-4a27-bb8f-d4cf31655216 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:21.698928 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5d13f153-a674-4a27-bb8f-d4cf31655216 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:21.702565 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5d13f153-a674-4a27-bb8f-d4cf31655216 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:21.703111 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5d13f153-a674-4a27-bb8f-d4cf31655216 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:21.704059 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5d13f153-a674-4a27-bb8f-d4cf31655216 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:21.704469 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5d13f153-a674-4a27-bb8f-d4cf31655216 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:21.720277 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5d13f153-a674-4a27-bb8f-d4cf31655216 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:21.937760 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5d13f153-a674-4a27-bb8f-d4cf31655216 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:21.993075 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5d13f153-a674-4a27-bb8f-d4cf31655216 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:22.000537 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5d13f153-a674-4a27-bb8f-d4cf31655216 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:22.003236 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5d13f153-a674-4a27-bb8f-d4cf31655216 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1604 microversion: 2.42 time: 0.348447 Aug 07 01:32:22.005798 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2405/4477] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:21 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1604 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:22.007968 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5d13f153-a674-4a27-bb8f-d4cf31655216 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:22.009849 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5d13f153-a674-4a27-bb8f-d4cf31655216 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002335 Aug 07 01:32:22.010485 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2406/4478] 10.222.0.39 () {56 vars in 886 bytes} [Sun Aug 7 01:32:22 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 07 01:32:22.209378 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7063edc2-361e-4995-a011-ad34037fa77a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:22.224201 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7063edc2-361e-4995-a011-ad34037fa77a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1663 microversion: 2.1 time: 0.931658 Aug 07 01:32:22.239262 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2073/4479] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:21 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1663 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:22.257398 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-463be5fc-2c4e-49a5-a555-d2b12aee5e62 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:22.258031 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-463be5fc-2c4e-49a5-a555-d2b12aee5e62 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:22.277119 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-463be5fc-2c4e-49a5-a555-d2b12aee5e62 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:22.277636 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-463be5fc-2c4e-49a5-a555-d2b12aee5e62 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:22.278087 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-463be5fc-2c4e-49a5-a555-d2b12aee5e62 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:22.278820 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-463be5fc-2c4e-49a5-a555-d2b12aee5e62 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:22.279275 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-463be5fc-2c4e-49a5-a555-d2b12aee5e62 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:22.280092 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-463be5fc-2c4e-49a5-a555-d2b12aee5e62 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:22.359324 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-36ead4cb-ccf0-4424-86ac-b104ba170175 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:22.360897 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-36ead4cb-ccf0-4424-86ac-b104ba170175 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] [instance: 91892278-cbe1-42ac-8251-965a9a2d814c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:22.373182 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:22.377451 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36ead4cb-ccf0-4424-86ac-b104ba170175 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:22.378075 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36ead4cb-ccf0-4424-86ac-b104ba170175 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:22.378713 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36ead4cb-ccf0-4424-86ac-b104ba170175 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:22.380018 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36ead4cb-ccf0-4424-86ac-b104ba170175 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:22.381833 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36ead4cb-ccf0-4424-86ac-b104ba170175 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:22.382951 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36ead4cb-ccf0-4424-86ac-b104ba170175 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:22.591644 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-36ead4cb-ccf0-4424-86ac-b104ba170175 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19818a0199054900ba2991c3f8712430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1d54252c734d47954009cc5aa6f974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:22.605408 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-36ead4cb-ccf0-4424-86ac-b104ba170175 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19818a0199054900ba2991c3f8712430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1d54252c734d47954009cc5aa6f974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:22.607642 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-36ead4cb-ccf0-4424-86ac-b104ba170175 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19818a0199054900ba2991c3f8712430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1d54252c734d47954009cc5aa6f974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:22.614158 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-463be5fc-2c4e-49a5-a555-d2b12aee5e62 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:22.614987 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-36ead4cb-ccf0-4424-86ac-b104ba170175 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] 10.222.0.39 "GET /compute/v2.1/servers/91892278-cbe1-42ac-8251-965a9a2d814c" status: 200 len: 1366 microversion: 2.47 time: 0.261906 Aug 07 01:32:22.622795 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2074/4480] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:22 2022] GET /compute/v2.1/servers/91892278-cbe1-42ac-8251-965a9a2d814c => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:22.628895 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-463be5fc-2c4e-49a5-a555-d2b12aee5e62 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:22.635219 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-463be5fc-2c4e-49a5-a555-d2b12aee5e62 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:22.640981 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-463be5fc-2c4e-49a5-a555-d2b12aee5e62 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1338 microversion: 2.20 time: 0.383020 Aug 07 01:32:22.643437 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2407/4481] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:22 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1338 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:23.031077 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a437bbb3-059c-417c-b1c2-162cda89ac3e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:23.033242 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a437bbb3-059c-417c-b1c2-162cda89ac3e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:23.049659 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a437bbb3-059c-417c-b1c2-162cda89ac3e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:23.065987 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a437bbb3-059c-417c-b1c2-162cda89ac3e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:23.066788 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a437bbb3-059c-417c-b1c2-162cda89ac3e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:23.067863 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a437bbb3-059c-417c-b1c2-162cda89ac3e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:23.070021 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a437bbb3-059c-417c-b1c2-162cda89ac3e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:23.072469 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a437bbb3-059c-417c-b1c2-162cda89ac3e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:23.248898 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b02f13f6-b90c-4197-b553-ed619a4479a4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:23.249580 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b02f13f6-b90c-4197-b553-ed619a4479a4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:23.270949 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b02f13f6-b90c-4197-b553-ed619a4479a4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:23.271452 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b02f13f6-b90c-4197-b553-ed619a4479a4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:23.278960 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b02f13f6-b90c-4197-b553-ed619a4479a4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:23.281897 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b02f13f6-b90c-4197-b553-ed619a4479a4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:23.282924 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b02f13f6-b90c-4197-b553-ed619a4479a4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:23.286416 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b02f13f6-b90c-4197-b553-ed619a4479a4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:23.304571 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a437bbb3-059c-417c-b1c2-162cda89ac3e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:23.334514 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a437bbb3-059c-417c-b1c2-162cda89ac3e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:23.346288 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a437bbb3-059c-417c-b1c2-162cda89ac3e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:23.350078 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a437bbb3-059c-417c-b1c2-162cda89ac3e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1604 microversion: 2.42 time: 0.322907 Aug 07 01:32:23.354558 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2075/4482] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:23 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1604 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:23.669748 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b9ec58db-d0a7-4dbd-ab20-00806ffc22c4 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:23.672647 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b9ec58db-d0a7-4dbd-ab20-00806ffc22c4 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] [instance: 91892278-cbe1-42ac-8251-965a9a2d814c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:23.690030 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9ec58db-d0a7-4dbd-ab20-00806ffc22c4 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:23.696827 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9ec58db-d0a7-4dbd-ab20-00806ffc22c4 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:23.697721 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9ec58db-d0a7-4dbd-ab20-00806ffc22c4 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:23.698823 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9ec58db-d0a7-4dbd-ab20-00806ffc22c4 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:23.699657 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9ec58db-d0a7-4dbd-ab20-00806ffc22c4 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:23.700502 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9ec58db-d0a7-4dbd-ab20-00806ffc22c4 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:23.823910 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9ec58db-d0a7-4dbd-ab20-00806ffc22c4 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:23.827330 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9ec58db-d0a7-4dbd-ab20-00806ffc22c4 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:23.828335 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9ec58db-d0a7-4dbd-ab20-00806ffc22c4 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:23.829823 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-b9ec58db-d0a7-4dbd-ab20-00806ffc22c4 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lazy-loading 'fault' on Instance uuid 91892278-cbe1-42ac-8251-965a9a2d814c {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:32:23.930479 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b02f13f6-b90c-4197-b553-ed619a4479a4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:23.946135 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b02f13f6-b90c-4197-b553-ed619a4479a4 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1663 microversion: 2.1 time: 0.702165 Aug 07 01:32:23.947319 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2408/4483] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:23 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1663 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:23.961551 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3c3551bb-15e7-4b5b-95c2-ec9130142f69 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:23.962512 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3c3551bb-15e7-4b5b-95c2-ec9130142f69 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:23.992248 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c3551bb-15e7-4b5b-95c2-ec9130142f69 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:23.993737 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c3551bb-15e7-4b5b-95c2-ec9130142f69 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:23.994716 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c3551bb-15e7-4b5b-95c2-ec9130142f69 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:23.996247 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c3551bb-15e7-4b5b-95c2-ec9130142f69 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:24.008865 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c3551bb-15e7-4b5b-95c2-ec9130142f69 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:24.009901 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c3551bb-15e7-4b5b-95c2-ec9130142f69 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:24.534861 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b9ec58db-d0a7-4dbd-ab20-00806ffc22c4 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19818a0199054900ba2991c3f8712430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1d54252c734d47954009cc5aa6f974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:24.546203 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b9ec58db-d0a7-4dbd-ab20-00806ffc22c4 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19818a0199054900ba2991c3f8712430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1d54252c734d47954009cc5aa6f974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:24.548321 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b9ec58db-d0a7-4dbd-ab20-00806ffc22c4 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19818a0199054900ba2991c3f8712430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1d54252c734d47954009cc5aa6f974', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:24.552184 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b9ec58db-d0a7-4dbd-ab20-00806ffc22c4 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] 10.222.0.39 "GET /compute/v2.1/servers/91892278-cbe1-42ac-8251-965a9a2d814c" status: 200 len: 1371 microversion: 2.47 time: 0.889179 Aug 07 01:32:24.566572 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2076/4484] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:23 2022] GET /compute/v2.1/servers/91892278-cbe1-42ac-8251-965a9a2d814c => generated 1371 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:24.573376 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6fc8cf82-e701-4267-b4a3-ad6bd481f2d7 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:24.574651 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6fc8cf82-e701-4267-b4a3-ad6bd481f2d7 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:24.587416 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6fc8cf82-e701-4267-b4a3-ad6bd481f2d7 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:24.588460 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6fc8cf82-e701-4267-b4a3-ad6bd481f2d7 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:24.589374 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6fc8cf82-e701-4267-b4a3-ad6bd481f2d7 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:24.593313 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6fc8cf82-e701-4267-b4a3-ad6bd481f2d7 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:24.594655 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6fc8cf82-e701-4267-b4a3-ad6bd481f2d7 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:24.596316 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6fc8cf82-e701-4267-b4a3-ad6bd481f2d7 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:24.797667 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6fc8cf82-e701-4267-b4a3-ad6bd481f2d7 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:24.810332 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6fc8cf82-e701-4267-b4a3-ad6bd481f2d7 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:24.819347 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6fc8cf82-e701-4267-b4a3-ad6bd481f2d7 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:24.820902 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6fc8cf82-e701-4267-b4a3-ad6bd481f2d7 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1604 microversion: 2.42 time: 0.252882 Aug 07 01:32:24.821713 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2077/4485] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:24 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1604 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:24.973383 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-eb55bfc5-2f1f-406e-b126-cab0859a3612 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:24.973960 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-eb55bfc5-2f1f-406e-b126-cab0859a3612 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:24.988476 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb55bfc5-2f1f-406e-b126-cab0859a3612 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:24.989305 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb55bfc5-2f1f-406e-b126-cab0859a3612 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:24.989896 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb55bfc5-2f1f-406e-b126-cab0859a3612 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:24.990842 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb55bfc5-2f1f-406e-b126-cab0859a3612 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:24.991631 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb55bfc5-2f1f-406e-b126-cab0859a3612 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:24.992440 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb55bfc5-2f1f-406e-b126-cab0859a3612 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:25.571832 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3c3551bb-15e7-4b5b-95c2-ec9130142f69 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:25.596577 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3c3551bb-15e7-4b5b-95c2-ec9130142f69 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:25.607054 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3c3551bb-15e7-4b5b-95c2-ec9130142f69 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:25.608310 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3c3551bb-15e7-4b5b-95c2-ec9130142f69 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1406 microversion: 2.20 time: 1.659857 Aug 07 01:32:25.612603 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-eb55bfc5-2f1f-406e-b126-cab0859a3612 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:25.615308 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2409/4486] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:23 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1406 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:25.632247 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fef8ab8a-9ce8-41a3-bbad-7b8a3f52e025 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:25.633171 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fef8ab8a-9ce8-41a3-bbad-7b8a3f52e025 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] [instance: 91892278-cbe1-42ac-8251-965a9a2d814c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:25.654412 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fef8ab8a-9ce8-41a3-bbad-7b8a3f52e025 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:25.655181 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fef8ab8a-9ce8-41a3-bbad-7b8a3f52e025 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:25.655779 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fef8ab8a-9ce8-41a3-bbad-7b8a3f52e025 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:25.656754 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fef8ab8a-9ce8-41a3-bbad-7b8a3f52e025 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:25.658323 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fef8ab8a-9ce8-41a3-bbad-7b8a3f52e025 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:25.658971 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fef8ab8a-9ce8-41a3-bbad-7b8a3f52e025 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:25.668111 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-eb55bfc5-2f1f-406e-b126-cab0859a3612 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.695295 Aug 07 01:32:25.672677 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2078/4487] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:24 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:32:25.697296 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-fef8ab8a-9ce8-41a3-bbad-7b8a3f52e025 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] HTTP exception thrown: Instance 91892278-cbe1-42ac-8251-965a9a2d814c could not be found. Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fef8ab8a-9ce8-41a3-bbad-7b8a3f52e025 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Request method failure captured: Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/91892278-cbe1-42ac-8251-965a9a2d814c HTTP/1.1 Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xYa6wIJb8Dd0dLJNfLpD1xfSO9bLJOUitlNux1EjCxgH-uiVgaWxaKqh5wosnkF-oTy8lFfzpnAWmsPrUxkMk5cOL5jhvy0UWar9Qunl6kgW1WyTuwDXBrw0pLX1HSuc3DfPlN8e9XRiZ7v9IYqqkV0UVJiaLoDc0GzaD62MBIWfhU Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: X-Openstack-Nova-Api-Version: 2.47 Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 3a1d54252c734d47954009cc5aa6f974 Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersAaction247Test-626034095 Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3a1d54252c734d47954009cc5aa6f974"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3a1d54252c734d47954009cc5aa6f974", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3a1d54252c734d47954009cc5aa6f974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3a1d54252c734d47954009cc5aa6f974"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersAaction247Test-626034095 Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 3a1d54252c734d47954009cc5aa6f974 Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersAaction247Test-626034095 Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersAaction247Test-626034095-project Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 19818a0199054900ba2991c3f8712430 Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersAaction247Test-626034095-project Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 91892278-cbe1-42ac-8251-965a9a2d814c could not be found. Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '91892278-cbe1-42ac-8251-965a9a2d814c'} Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91892278-cbe1-42ac-8251-965a9a2d814c could not be found. Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91892278-cbe1-42ac-8251-965a9a2d814c could not be found. Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:32:25.703082 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:32:25.708480 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:32:25.708480 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:32:25.708480 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:32:25.708480 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:32:25.708480 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:32:25.708480 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91892278-cbe1-42ac-8251-965a9a2d814c could not be found. Aug 07 01:32:25.708480 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:32:25.708994 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d12a30e7-836c-40b4-9cd3-4021d765c561 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:25.709995 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fef8ab8a-9ce8-41a3-bbad-7b8a3f52e025 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] Returning 404 to user: Instance 91892278-cbe1-42ac-8251-965a9a2d814c could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:32:25.710298 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d12a30e7-836c-40b4-9cd3-4021d765c561 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:25.711378 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fef8ab8a-9ce8-41a3-bbad-7b8a3f52e025 tempest-ServersAaction247Test-626034095 tempest-ServersAaction247Test-626034095-project] 10.222.0.39 "GET /compute/v2.1/servers/91892278-cbe1-42ac-8251-965a9a2d814c" status: 404 len: 111 microversion: 2.47 time: 0.095077 Aug 07 01:32:25.721188 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2410/4488] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:25 2022] GET /compute/v2.1/servers/91892278-cbe1-42ac-8251-965a9a2d814c => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:32:25.758972 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d12a30e7-836c-40b4-9cd3-4021d765c561 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:25.761763 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d12a30e7-836c-40b4-9cd3-4021d765c561 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:25.763822 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d12a30e7-836c-40b4-9cd3-4021d765c561 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:25.769391 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d12a30e7-836c-40b4-9cd3-4021d765c561 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:25.770267 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d12a30e7-836c-40b4-9cd3-4021d765c561 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:25.771127 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d12a30e7-836c-40b4-9cd3-4021d765c561 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:25.845603 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-90dc79bc-f7ee-4eb1-b514-eef00a9b6353 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:25.846570 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-90dc79bc-f7ee-4eb1-b514-eef00a9b6353 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:25.855810 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90dc79bc-f7ee-4eb1-b514-eef00a9b6353 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:25.870159 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90dc79bc-f7ee-4eb1-b514-eef00a9b6353 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:25.870904 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90dc79bc-f7ee-4eb1-b514-eef00a9b6353 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:25.872059 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90dc79bc-f7ee-4eb1-b514-eef00a9b6353 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:25.873144 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90dc79bc-f7ee-4eb1-b514-eef00a9b6353 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:25.873726 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90dc79bc-f7ee-4eb1-b514-eef00a9b6353 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:26.609352 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-90dc79bc-f7ee-4eb1-b514-eef00a9b6353 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:26.646884 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-90dc79bc-f7ee-4eb1-b514-eef00a9b6353 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:26.648960 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-90dc79bc-f7ee-4eb1-b514-eef00a9b6353 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:26.658739 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-90dc79bc-f7ee-4eb1-b514-eef00a9b6353 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1604 microversion: 2.42 time: 0.817346 Aug 07 01:32:26.659946 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2411/4489] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:25 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1604 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:32:26.668088 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-cfdb860d-5f77-40b4-99fd-694319f8af18 req-7d93e585-c8a4-4e25-acb8-ac06c64e092f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4071f699-43c7-4c36-ada4-8f0dceb6cc91", "tag": "a4d2050c-f5b0-4218-a72d-272334938cd5"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:32:26.703220 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-cfdb860d-5f77-40b4-99fd-694319f8af18 req-7d93e585-c8a4-4e25-acb8-ac06c64e092f service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:26.703752 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-cfdb860d-5f77-40b4-99fd-694319f8af18 req-7d93e585-c8a4-4e25-acb8-ac06c64e092f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:26.704751 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-cfdb860d-5f77-40b4-99fd-694319f8af18 req-7d93e585-c8a4-4e25-acb8-ac06c64e092f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:26.724948 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=10 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:26.745487 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-cfdb860d-5f77-40b4-99fd-694319f8af18 req-7d93e585-c8a4-4e25-acb8-ac06c64e092f service nova] Creating event network-changed:a4d2050c-f5b0-4218-a72d-272334938cd5 for instance 4071f699-43c7-4c36-ada4-8f0dceb6cc91 on n-h2-master-1 Aug 07 01:32:26.757984 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-cfdb860d-5f77-40b4-99fd-694319f8af18 req-7d93e585-c8a4-4e25-acb8-ac06c64e092f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096331 Aug 07 01:32:26.758995 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2412/4490] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:32:26.773388 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3cafde6e-4c4d-4b54-badf-ca2f05568da4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:26.774879 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3cafde6e-4c4d-4b54-badf-ca2f05568da4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:26.785005 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:26.803034 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3cafde6e-4c4d-4b54-badf-ca2f05568da4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:26.804474 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3cafde6e-4c4d-4b54-badf-ca2f05568da4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:26.805570 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3cafde6e-4c4d-4b54-badf-ca2f05568da4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:26.806861 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3cafde6e-4c4d-4b54-badf-ca2f05568da4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:26.810470 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3cafde6e-4c4d-4b54-badf-ca2f05568da4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:26.811287 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3cafde6e-4c4d-4b54-badf-ca2f05568da4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:27.492458 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=4 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:27.576659 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3cafde6e-4c4d-4b54-badf-ca2f05568da4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:27.614426 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3cafde6e-4c4d-4b54-badf-ca2f05568da4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:27.624849 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3cafde6e-4c4d-4b54-badf-ca2f05568da4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:27.627537 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3cafde6e-4c4d-4b54-badf-ca2f05568da4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1406 microversion: 2.20 time: 0.867427 Aug 07 01:32:27.628349 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2413/4491] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:26 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1406 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:27.633663 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d12a30e7-836c-40b4-9cd3-4021d765c561 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:27.651241 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d12a30e7-836c-40b4-9cd3-4021d765c561 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 1.953586 Aug 07 01:32:27.651850 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2079/4492] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:25 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 1955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:27.692781 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1ca1596f-feb4-4a1a-bbee-8bd620f00db2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:27.693660 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1ca1596f-feb4-4a1a-bbee-8bd620f00db2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:27.695234 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-33c4caef-973a-494a-a642-fefff2875576 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:27.707591 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-33c4caef-973a-494a-a642-fefff2875576 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:27.712128 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ca1596f-feb4-4a1a-bbee-8bd620f00db2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:27.712632 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ca1596f-feb4-4a1a-bbee-8bd620f00db2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:27.716866 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-33c4caef-973a-494a-a642-fefff2875576 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:27.718242 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-33c4caef-973a-494a-a642-fefff2875576 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:27.718883 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-33c4caef-973a-494a-a642-fefff2875576 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:27.719877 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-33c4caef-973a-494a-a642-fefff2875576 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:27.720581 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-33c4caef-973a-494a-a642-fefff2875576 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:27.723927 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ca1596f-feb4-4a1a-bbee-8bd620f00db2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:27.724822 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ca1596f-feb4-4a1a-bbee-8bd620f00db2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:27.725498 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ca1596f-feb4-4a1a-bbee-8bd620f00db2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:27.726100 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ca1596f-feb4-4a1a-bbee-8bd620f00db2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:27.726230 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-33c4caef-973a-494a-a642-fefff2875576 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:27.925018 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-33c4caef-973a-494a-a642-fefff2875576 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:27.941398 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-33c4caef-973a-494a-a642-fefff2875576 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:27.943075 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-33c4caef-973a-494a-a642-fefff2875576 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:27.944370 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-33c4caef-973a-494a-a642-fefff2875576 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1604 microversion: 2.42 time: 0.257228 Aug 07 01:32:27.956775 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2080/4493] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:27 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1604 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:32:28.177678 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1ca1596f-feb4-4a1a-bbee-8bd620f00db2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:28.187925 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1ca1596f-feb4-4a1a-bbee-8bd620f00db2 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.503708 Aug 07 01:32:28.208720 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2414/4494] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:27 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:28.214557 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c7b0b51f-7c32-4327-a44f-e011616b0d12 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:28.215483 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c7b0b51f-7c32-4327-a44f-e011616b0d12 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:28.225980 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7b0b51f-7c32-4327-a44f-e011616b0d12 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:28.226721 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7b0b51f-7c32-4327-a44f-e011616b0d12 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:28.227319 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7b0b51f-7c32-4327-a44f-e011616b0d12 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:28.228562 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7b0b51f-7c32-4327-a44f-e011616b0d12 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:28.229228 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7b0b51f-7c32-4327-a44f-e011616b0d12 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:28.230125 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7b0b51f-7c32-4327-a44f-e011616b0d12 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:28.678794 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-918bb83a-f186-493c-b397-dd3573c95e92 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:28.679400 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-918bb83a-f186-493c-b397-dd3573c95e92 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:28.689619 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=18 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:28.697008 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-918bb83a-f186-493c-b397-dd3573c95e92 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:28.697882 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-918bb83a-f186-493c-b397-dd3573c95e92 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:28.699107 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-918bb83a-f186-493c-b397-dd3573c95e92 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:28.701234 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c7b0b51f-7c32-4327-a44f-e011616b0d12 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:28.713620 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c7b0b51f-7c32-4327-a44f-e011616b0d12 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.502877 Aug 07 01:32:28.714407 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2081/4495] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:28 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:28.730001 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-918bb83a-f186-493c-b397-dd3573c95e92 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:28.730631 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-918bb83a-f186-493c-b397-dd3573c95e92 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:28.731102 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-918bb83a-f186-493c-b397-dd3573c95e92 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:28.738392 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ca094019-04a4-4a78-a615-1bc71635c645 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:28.739034 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ca094019-04a4-4a78-a615-1bc71635c645 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:28.748083 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca094019-04a4-4a78-a615-1bc71635c645 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:28.751427 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca094019-04a4-4a78-a615-1bc71635c645 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:28.751945 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca094019-04a4-4a78-a615-1bc71635c645 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:28.757076 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca094019-04a4-4a78-a615-1bc71635c645 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:28.757783 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca094019-04a4-4a78-a615-1bc71635c645 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:28.758534 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca094019-04a4-4a78-a615-1bc71635c645 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:29.292369 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ca094019-04a4-4a78-a615-1bc71635c645 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:29.311765 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ca094019-04a4-4a78-a615-1bc71635c645 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.578438 Aug 07 01:32:29.312403 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2082/4496] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:28 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:32:29.325761 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4050b13d-8c08-4273-a393-30492a426ddf tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:29.326662 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4050b13d-8c08-4273-a393-30492a426ddf tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:29.338071 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4050b13d-8c08-4273-a393-30492a426ddf tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:29.340218 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4050b13d-8c08-4273-a393-30492a426ddf tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:29.340843 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4050b13d-8c08-4273-a393-30492a426ddf tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:29.348861 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4050b13d-8c08-4273-a393-30492a426ddf tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:29.349596 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4050b13d-8c08-4273-a393-30492a426ddf tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:29.350212 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4050b13d-8c08-4273-a393-30492a426ddf tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:29.476130 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4050b13d-8c08-4273-a393-30492a426ddf tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:29.486814 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4050b13d-8c08-4273-a393-30492a426ddf tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:29.488324 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4050b13d-8c08-4273-a393-30492a426ddf tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:29.489534 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4050b13d-8c08-4273-a393-30492a426ddf tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1604 microversion: 2.42 time: 0.176204 Aug 07 01:32:29.490102 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2083/4497] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:29 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1604 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:29.498985 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-93721919-0206-4580-b178-1060f61d849b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:32:29.501231 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-93721919-0206-4580-b178-1060f61d849b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:29.510653 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-918bb83a-f186-493c-b397-dd3573c95e92 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:29.519689 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-918bb83a-f186-493c-b397-dd3573c95e92 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:29.528662 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93721919-0206-4580-b178-1060f61d849b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:29.530816 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93721919-0206-4580-b178-1060f61d849b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:29.539409 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93721919-0206-4580-b178-1060f61d849b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:29.540538 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93721919-0206-4580-b178-1060f61d849b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:29.541071 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-918bb83a-f186-493c-b397-dd3573c95e92 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:29.541948 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93721919-0206-4580-b178-1060f61d849b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:29.542371 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-918bb83a-f186-493c-b397-dd3573c95e92 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1406 microversion: 2.20 time: 0.867417 Aug 07 01:32:29.542736 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93721919-0206-4580-b178-1060f61d849b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:29.548788 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2415/4498] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:28 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1406 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:32:29.600079 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-93721919-0206-4580-b178-1060f61d849b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lazy-loading 'flavor' on Instance uuid e39f0d23-55ab-417b-818e-92de14de44c0 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:32:29.774962 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-93721919-0206-4580-b178-1060f61d849b tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action" status: 202 len: 0 microversion: 2.1 time: 0.280003 Aug 07 01:32:29.781149 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2084/4499] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:32:29 2022] POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:32:29.788886 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e3517c1b-1729-4cbe-bcfd-416874c05015 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:29.789574 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e3517c1b-1729-4cbe-bcfd-416874c05015 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:29.814771 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3517c1b-1729-4cbe-bcfd-416874c05015 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:29.815381 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3517c1b-1729-4cbe-bcfd-416874c05015 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:29.821371 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3517c1b-1729-4cbe-bcfd-416874c05015 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:29.822986 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3517c1b-1729-4cbe-bcfd-416874c05015 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:29.826428 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3517c1b-1729-4cbe-bcfd-416874c05015 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:29.832451 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3517c1b-1729-4cbe-bcfd-416874c05015 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:29.966654 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3fb9e0bf-0fe6-4665-98eb-7d297e1e8073 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:29.967729 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3fb9e0bf-0fe6-4665-98eb-7d297e1e8073 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:29.987111 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3fb9e0bf-0fe6-4665-98eb-7d297e1e8073 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:29.993959 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3fb9e0bf-0fe6-4665-98eb-7d297e1e8073 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:29.998531 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3fb9e0bf-0fe6-4665-98eb-7d297e1e8073 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:30.002089 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3fb9e0bf-0fe6-4665-98eb-7d297e1e8073 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:30.002920 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3fb9e0bf-0fe6-4665-98eb-7d297e1e8073 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:30.009322 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3fb9e0bf-0fe6-4665-98eb-7d297e1e8073 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:30.055475 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-3fb9e0bf-0fe6-4665-98eb-7d297e1e8073 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] HTTP exception thrown: Instance 77ed645e-669e-4167-ae78-8ce69770babf could not be found. Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3fb9e0bf-0fe6-4665-98eb-7d297e1e8073 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Request method failure captured: Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf HTTP/1.1 Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xRRR67dDPG5CRb0Fu7BdplYiyQQVJSJFsqydip_k5hAO28x9NPyn0qghXJrztcIvSBYuoVxdfQujVqrJ49kFSTw1L6_JaJ_hQzLz0ShSPjLENbXhlF0Nemm1uJn97z5mh9Q3Vykn-x2GGjZa9CFyETd0ShFrnMvI3pReaSkp8Sde5c Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: X-Openstack-Nova-Api-Version: 2.32 Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 9ecc3d5efbe54d76ae9e6ed5f7633c1d Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-TaggedBootDevicesTest-1171090422 Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9ecc3d5efbe54d76ae9e6ed5f7633c1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9ecc3d5efbe54d76ae9e6ed5f7633c1d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9ecc3d5efbe54d76ae9e6ed5f7633c1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9ecc3d5efbe54d76ae9e6ed5f7633c1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-TaggedBootDevicesTest-1171090422 Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 9ecc3d5efbe54d76ae9e6ed5f7633c1d Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1171090422 Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-TaggedBootDevicesTest-1171090422-project Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: e379b67e2bb248b3ad25b92b2082b0fe Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-TaggedBootDevicesTest-1171090422-project Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 77ed645e-669e-4167-ae78-8ce69770babf could not be found. Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '77ed645e-669e-4167-ae78-8ce69770babf'} Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77ed645e-669e-4167-ae78-8ce69770babf could not be found. Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:32:30.061676 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:32:30.067521 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77ed645e-669e-4167-ae78-8ce69770babf could not be found. Aug 07 01:32:30.067521 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:32:30.067521 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:32:30.067521 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:32:30.067521 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:32:30.067521 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:32:30.067521 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:32:30.067521 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:32:30.067521 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:32:30.067521 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77ed645e-669e-4167-ae78-8ce69770babf could not be found. Aug 07 01:32:30.067521 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:32:30.067521 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3fb9e0bf-0fe6-4665-98eb-7d297e1e8073 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Returning 404 to user: Instance 77ed645e-669e-4167-ae78-8ce69770babf could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:32:30.067521 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3fb9e0bf-0fe6-4665-98eb-7d297e1e8073 tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "DELETE /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 404 len: 111 microversion: 2.32 time: 0.103315 Aug 07 01:32:30.067521 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2085/4500] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Aug 7 01:32:29 2022] DELETE /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 07 01:32:30.091362 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-befccd76-a0bf-463b-b25d-24d6c2e4766a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:30.092937 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-befccd76-a0bf-463b-b25d-24d6c2e4766a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] [instance: 77ed645e-669e-4167-ae78-8ce69770babf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:30.107625 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-befccd76-a0bf-463b-b25d-24d6c2e4766a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:30.108199 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-befccd76-a0bf-463b-b25d-24d6c2e4766a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:30.108864 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-befccd76-a0bf-463b-b25d-24d6c2e4766a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:30.109604 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-befccd76-a0bf-463b-b25d-24d6c2e4766a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:30.110067 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-befccd76-a0bf-463b-b25d-24d6c2e4766a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:30.112810 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-befccd76-a0bf-463b-b25d-24d6c2e4766a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:30.149348 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-befccd76-a0bf-463b-b25d-24d6c2e4766a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] HTTP exception thrown: Instance 77ed645e-669e-4167-ae78-8ce69770babf could not be found. Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-befccd76-a0bf-463b-b25d-24d6c2e4766a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Request method failure captured: Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf HTTP/1.1 Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xRRR67dDPG5CRb0Fu7BdplYiyQQVJSJFsqydip_k5hAO28x9NPyn0qghXJrztcIvSBYuoVxdfQujVqrJ49kFSTw1L6_JaJ_hQzLz0ShSPjLENbXhlF0Nemm1uJn97z5mh9Q3Vykn-x2GGjZa9CFyETd0ShFrnMvI3pReaSkp8Sde5c Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: X-Openstack-Nova-Api-Version: 2.32 Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 9ecc3d5efbe54d76ae9e6ed5f7633c1d Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-TaggedBootDevicesTest-1171090422 Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9ecc3d5efbe54d76ae9e6ed5f7633c1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9ecc3d5efbe54d76ae9e6ed5f7633c1d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9ecc3d5efbe54d76ae9e6ed5f7633c1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9ecc3d5efbe54d76ae9e6ed5f7633c1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-TaggedBootDevicesTest-1171090422 Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 9ecc3d5efbe54d76ae9e6ed5f7633c1d Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1171090422 Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-TaggedBootDevicesTest-1171090422-project Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: e379b67e2bb248b3ad25b92b2082b0fe Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-TaggedBootDevicesTest-1171090422-project Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 77ed645e-669e-4167-ae78-8ce69770babf could not be found. Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '77ed645e-669e-4167-ae78-8ce69770babf'} Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77ed645e-669e-4167-ae78-8ce69770babf could not be found. Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77ed645e-669e-4167-ae78-8ce69770babf could not be found. Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:32:30.150917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:32:30.155518 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:32:30.155518 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:32:30.155518 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:32:30.155518 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:32:30.155518 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:32:30.155518 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:32:30.155518 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77ed645e-669e-4167-ae78-8ce69770babf could not be found. Aug 07 01:32:30.155518 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:32:30.160075 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-befccd76-a0bf-463b-b25d-24d6c2e4766a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] Returning 404 to user: Instance 77ed645e-669e-4167-ae78-8ce69770babf could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:32:30.161026 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-befccd76-a0bf-463b-b25d-24d6c2e4766a tempest-TaggedBootDevicesTest-1171090422 tempest-TaggedBootDevicesTest-1171090422-project] 10.222.0.39 "GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf" status: 404 len: 111 microversion: 2.32 time: 0.088139 Aug 07 01:32:30.167484 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2086/4501] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:30 2022] GET /compute/v2.1/servers/77ed645e-669e-4167-ae78-8ce69770babf => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:32:30.517495 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c9a5a080-3a96-49e8-879c-a1e16a8e70d2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:30.518118 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c9a5a080-3a96-49e8-879c-a1e16a8e70d2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:30.534589 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c9a5a080-3a96-49e8-879c-a1e16a8e70d2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:30.535086 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c9a5a080-3a96-49e8-879c-a1e16a8e70d2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:30.535522 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c9a5a080-3a96-49e8-879c-a1e16a8e70d2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:30.541768 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c9a5a080-3a96-49e8-879c-a1e16a8e70d2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:30.542518 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c9a5a080-3a96-49e8-879c-a1e16a8e70d2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:30.543116 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c9a5a080-3a96-49e8-879c-a1e16a8e70d2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:30.772678 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c9a5a080-3a96-49e8-879c-a1e16a8e70d2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:30.800120 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c9a5a080-3a96-49e8-879c-a1e16a8e70d2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:30.802746 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c9a5a080-3a96-49e8-879c-a1e16a8e70d2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:30.805150 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c9a5a080-3a96-49e8-879c-a1e16a8e70d2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1604 microversion: 2.42 time: 0.292241 Aug 07 01:32:30.809235 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2087/4502] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:30 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1604 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:30.820437 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-28cd19dd-5d2a-4985-adb7-419d43613356 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:30.836866 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-28cd19dd-5d2a-4985-adb7-419d43613356 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:30.862394 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28cd19dd-5d2a-4985-adb7-419d43613356 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:30.872212 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28cd19dd-5d2a-4985-adb7-419d43613356 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:30.872886 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28cd19dd-5d2a-4985-adb7-419d43613356 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:30.873916 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28cd19dd-5d2a-4985-adb7-419d43613356 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:30.879740 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28cd19dd-5d2a-4985-adb7-419d43613356 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:30.880536 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28cd19dd-5d2a-4985-adb7-419d43613356 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:31.435752 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e3517c1b-1729-4cbe-bcfd-416874c05015 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:31.454594 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e3517c1b-1729-4cbe-bcfd-416874c05015 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1675 microversion: 2.1 time: 1.673110 Aug 07 01:32:31.472114 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2416/4503] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:29 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1675 bytes in 1680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:32:31.841945 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-311cf33a-9dbe-4dbe-9d20-af30971c9dcd tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:31.842833 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-311cf33a-9dbe-4dbe-9d20-af30971c9dcd tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:31.868110 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-311cf33a-9dbe-4dbe-9d20-af30971c9dcd tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:31.869142 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-311cf33a-9dbe-4dbe-9d20-af30971c9dcd tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:31.882508 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-311cf33a-9dbe-4dbe-9d20-af30971c9dcd tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:31.883630 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-311cf33a-9dbe-4dbe-9d20-af30971c9dcd tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:31.884351 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-311cf33a-9dbe-4dbe-9d20-af30971c9dcd tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:31.884997 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-311cf33a-9dbe-4dbe-9d20-af30971c9dcd tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:32.168079 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-311cf33a-9dbe-4dbe-9d20-af30971c9dcd tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:32.182674 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-311cf33a-9dbe-4dbe-9d20-af30971c9dcd tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:32.184549 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-311cf33a-9dbe-4dbe-9d20-af30971c9dcd tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:32.185867 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-311cf33a-9dbe-4dbe-9d20-af30971c9dcd tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1604 microversion: 2.42 time: 0.350433 Aug 07 01:32:32.188358 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2417/4504] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:31 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1604 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:32:32.490695 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a9fda056-8c5d-4185-99d0-cd9ed6a58b2c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:32.492319 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a9fda056-8c5d-4185-99d0-cd9ed6a58b2c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:32.500711 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a9fda056-8c5d-4185-99d0-cd9ed6a58b2c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:32.501612 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a9fda056-8c5d-4185-99d0-cd9ed6a58b2c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:32.503216 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a9fda056-8c5d-4185-99d0-cd9ed6a58b2c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:32.504540 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a9fda056-8c5d-4185-99d0-cd9ed6a58b2c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:32.505668 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a9fda056-8c5d-4185-99d0-cd9ed6a58b2c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:32.506866 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a9fda056-8c5d-4185-99d0-cd9ed6a58b2c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:32.830986 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a9fda056-8c5d-4185-99d0-cd9ed6a58b2c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:32.840487 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a9fda056-8c5d-4185-99d0-cd9ed6a58b2c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1658 microversion: 2.1 time: 0.355691 Aug 07 01:32:32.855776 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2418/4505] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:32 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1658 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:32.889110 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6c091979-4647-4b27-83ea-c8a6195ab38a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:32:32.889977 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6c091979-4647-4b27-83ea-c8a6195ab38a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:32.903772 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c091979-4647-4b27-83ea-c8a6195ab38a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:32.904389 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c091979-4647-4b27-83ea-c8a6195ab38a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:32.905028 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c091979-4647-4b27-83ea-c8a6195ab38a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:32.907102 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c091979-4647-4b27-83ea-c8a6195ab38a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:32.909984 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c091979-4647-4b27-83ea-c8a6195ab38a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:32.911075 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c091979-4647-4b27-83ea-c8a6195ab38a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:33.027524 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6c091979-4647-4b27-83ea-c8a6195ab38a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action" status: 202 len: 0 microversion: 2.1 time: 0.153098 Aug 07 01:32:33.031181 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2419/4506] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:32:32 2022] POST /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:32:33.058085 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7eabc0e5-724a-42ad-8d35-d666ed2a520e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:33.058809 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7eabc0e5-724a-42ad-8d35-d666ed2a520e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:33.069710 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7eabc0e5-724a-42ad-8d35-d666ed2a520e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:33.070226 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7eabc0e5-724a-42ad-8d35-d666ed2a520e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:33.070751 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7eabc0e5-724a-42ad-8d35-d666ed2a520e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:33.071843 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7eabc0e5-724a-42ad-8d35-d666ed2a520e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:33.072543 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7eabc0e5-724a-42ad-8d35-d666ed2a520e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:33.073184 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7eabc0e5-724a-42ad-8d35-d666ed2a520e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:33.352720 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7eabc0e5-724a-42ad-8d35-d666ed2a520e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:33.379074 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7eabc0e5-724a-42ad-8d35-d666ed2a520e tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1664 microversion: 2.1 time: 0.332685 Aug 07 01:32:33.382866 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2420/4507] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:33 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1664 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:33.388360 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-594e0ea0-b9b2-41dd-a174-1f05282b508e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:33.389186 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-594e0ea0-b9b2-41dd-a174-1f05282b508e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:33.398973 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-594e0ea0-b9b2-41dd-a174-1f05282b508e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:33.400013 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-594e0ea0-b9b2-41dd-a174-1f05282b508e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:33.400924 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-594e0ea0-b9b2-41dd-a174-1f05282b508e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:33.402069 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-594e0ea0-b9b2-41dd-a174-1f05282b508e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:33.402730 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-594e0ea0-b9b2-41dd-a174-1f05282b508e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:33.403493 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-594e0ea0-b9b2-41dd-a174-1f05282b508e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:33.509862 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-594e0ea0-b9b2-41dd-a174-1f05282b508e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:33.520426 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-594e0ea0-b9b2-41dd-a174-1f05282b508e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:33.522102 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-594e0ea0-b9b2-41dd-a174-1f05282b508e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:33.523499 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-594e0ea0-b9b2-41dd-a174-1f05282b508e tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1604 microversion: 2.42 time: 0.139052 Aug 07 01:32:33.538755 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2421/4508] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:33 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1604 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:33.550554 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-28cd19dd-5d2a-4985-adb7-419d43613356 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:33.582628 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-28cd19dd-5d2a-4985-adb7-419d43613356 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:33.586857 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-28cd19dd-5d2a-4985-adb7-419d43613356 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:33.589593 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-28cd19dd-5d2a-4985-adb7-419d43613356 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1406 microversion: 2.20 time: 2.778822 Aug 07 01:32:33.590966 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2088/4509] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:30 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1406 bytes in 2781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:34.088562 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-3bd76298-3c93-4390-8734-e2b2579fe01a req-3a032807-7377-4c86-80d2-e359a7a40964 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4071f699-43c7-4c36-ada4-8f0dceb6cc91", "name": "network-vif-plugged", "status": "completed", "tag": "a4d2050c-f5b0-4218-a72d-272334938cd5"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:32:34.111697 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3bd76298-3c93-4390-8734-e2b2579fe01a req-3a032807-7377-4c86-80d2-e359a7a40964 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:34.113823 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3bd76298-3c93-4390-8734-e2b2579fe01a req-3a032807-7377-4c86-80d2-e359a7a40964 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:34.114974 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3bd76298-3c93-4390-8734-e2b2579fe01a req-3a032807-7377-4c86-80d2-e359a7a40964 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:34.152532 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-3bd76298-3c93-4390-8734-e2b2579fe01a req-3a032807-7377-4c86-80d2-e359a7a40964 service nova] Creating event network-vif-plugged:a4d2050c-f5b0-4218-a72d-272334938cd5 for instance 4071f699-43c7-4c36-ada4-8f0dceb6cc91 on n-h2-master-1 Aug 07 01:32:34.185896 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-3bd76298-3c93-4390-8734-e2b2579fe01a req-3a032807-7377-4c86-80d2-e359a7a40964 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102747 Aug 07 01:32:34.187634 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2422/4510] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:32:34.407170 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a1ee0d3f-8ccd-4591-a08c-ea6fa56ef1ec tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:34.407852 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a1ee0d3f-8ccd-4591-a08c-ea6fa56ef1ec tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:34.415699 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a1ee0d3f-8ccd-4591-a08c-ea6fa56ef1ec tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:34.416622 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a1ee0d3f-8ccd-4591-a08c-ea6fa56ef1ec tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:34.417704 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a1ee0d3f-8ccd-4591-a08c-ea6fa56ef1ec tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:34.419133 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a1ee0d3f-8ccd-4591-a08c-ea6fa56ef1ec tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:34.419793 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a1ee0d3f-8ccd-4591-a08c-ea6fa56ef1ec tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:34.420520 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a1ee0d3f-8ccd-4591-a08c-ea6fa56ef1ec tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:34.444881 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:34.553883 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3ac91872-eea2-46fb-8c56-620d82647aae tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:34.555356 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3ac91872-eea2-46fb-8c56-620d82647aae tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:34.597285 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ac91872-eea2-46fb-8c56-620d82647aae tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:34.598060 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ac91872-eea2-46fb-8c56-620d82647aae tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:34.600781 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ac91872-eea2-46fb-8c56-620d82647aae tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:34.603578 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ac91872-eea2-46fb-8c56-620d82647aae tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:34.604684 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ac91872-eea2-46fb-8c56-620d82647aae tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:34.619736 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ac91872-eea2-46fb-8c56-620d82647aae tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:34.789701 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ac91872-eea2-46fb-8c56-620d82647aae tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:34.790210 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ac91872-eea2-46fb-8c56-620d82647aae tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:34.790665 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ac91872-eea2-46fb-8c56-620d82647aae tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:34.791132 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-3ac91872-eea2-46fb-8c56-620d82647aae tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lazy-loading 'fault' on Instance uuid 799e740e-2304-4bdf-ad6e-ea4817a92b15 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:32:34.904282 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3ac91872-eea2-46fb-8c56-620d82647aae tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:34.922563 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3ac91872-eea2-46fb-8c56-620d82647aae tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:34.924923 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3ac91872-eea2-46fb-8c56-620d82647aae tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '106559a2b8754c54b1c41ba8cadd1a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3e59419be4d2b892f498e527cb2e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:34.926656 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3ac91872-eea2-46fb-8c56-620d82647aae tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 200 len: 1609 microversion: 2.42 time: 0.379729 Aug 07 01:32:34.929430 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2423/4511] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:34 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 1609 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:34.936530 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5f00d10d-9267-49fe-91ad-a8cffe87c418 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:34.941706 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5f00d10d-9267-49fe-91ad-a8cffe87c418 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:34.957902 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f00d10d-9267-49fe-91ad-a8cffe87c418 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:34.958799 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f00d10d-9267-49fe-91ad-a8cffe87c418 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:34.959418 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f00d10d-9267-49fe-91ad-a8cffe87c418 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:34.960509 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f00d10d-9267-49fe-91ad-a8cffe87c418 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:34.961121 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f00d10d-9267-49fe-91ad-a8cffe87c418 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:34.961707 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f00d10d-9267-49fe-91ad-a8cffe87c418 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:34.971166 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a1ee0d3f-8ccd-4591-a08c-ea6fa56ef1ec tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:34.984380 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a1ee0d3f-8ccd-4591-a08c-ea6fa56ef1ec tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1664 microversion: 2.1 time: 0.579822 Aug 07 01:32:34.987526 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2089/4512] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:34 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1664 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:35.005979 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:35.403571 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5f00d10d-9267-49fe-91ad-a8cffe87c418 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:35.414897 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5f00d10d-9267-49fe-91ad-a8cffe87c418 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:35.416499 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5f00d10d-9267-49fe-91ad-a8cffe87c418 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:35.417660 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5f00d10d-9267-49fe-91ad-a8cffe87c418 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1406 microversion: 2.20 time: 0.485065 Aug 07 01:32:35.418232 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2424/4513] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:34 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1406 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:35.964593 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-19ee373f-98e4-4668-9cab-7d319d2c7bf2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:35.965577 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-19ee373f-98e4-4668-9cab-7d319d2c7bf2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:35.974070 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-19ee373f-98e4-4668-9cab-7d319d2c7bf2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:35.975274 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-19ee373f-98e4-4668-9cab-7d319d2c7bf2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:35.975951 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-19ee373f-98e4-4668-9cab-7d319d2c7bf2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:35.977050 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-19ee373f-98e4-4668-9cab-7d319d2c7bf2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:35.977689 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-19ee373f-98e4-4668-9cab-7d319d2c7bf2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:35.978282 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-19ee373f-98e4-4668-9cab-7d319d2c7bf2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:36.008423 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-19ee373f-98e4-4668-9cab-7d319d2c7bf2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] HTTP exception thrown: Instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 could not be found. Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-19ee373f-98e4-4668-9cab-7d319d2c7bf2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Request method failure captured: Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 HTTP/1.1 Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xRSoIRrVFwtMZ_IZ06LzD8Ye3SSsfn3Bx3ZyHXPGEnq4h6wn7NvGwqT0nOv6bsV6zigsjtumgVPj99nYHcDZ-CA4QjyBDYOZb5GiirmAFdw8GKm_DYsDVKeOT9RJ36SiANEi7XCAe3c8coz9qfEveKtglDz8eyl4WdoGvBE6idNTGY Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: X-Openstack-Nova-Api-Version: 2.42 Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: f5f3e59419be4d2b892f498e527cb2e8 Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1173123380 Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f5f3e59419be4d2b892f498e527cb2e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f5f3e59419be4d2b892f498e527cb2e8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f5f3e59419be4d2b892f498e527cb2e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f5f3e59419be4d2b892f498e527cb2e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1173123380 Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: f5f3e59419be4d2b892f498e527cb2e8 Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1173123380 Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-TaggedBootDevicesTest_v242-1173123380-project Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 106559a2b8754c54b1c41ba8cadd1a97 Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1173123380-project Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 could not be found. Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '799e740e-2304-4bdf-ad6e-ea4817a92b15'} Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 could not be found. Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 could not be found. Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:32:36.018713 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:32:36.023737 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:32:36.023737 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:32:36.023737 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:32:36.023737 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:32:36.023737 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:32:36.023737 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:32:36.023737 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 could not be found. Aug 07 01:32:36.023737 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:32:36.025627 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-19ee373f-98e4-4668-9cab-7d319d2c7bf2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Returning 404 to user: Instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:32:36.026226 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3036d51b-4ca0-4640-bfcd-38b55bc666c3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:36.026948 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3036d51b-4ca0-4640-bfcd-38b55bc666c3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:36.027843 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-19ee373f-98e4-4668-9cab-7d319d2c7bf2 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 404 len: 111 microversion: 2.42 time: 0.068819 Aug 07 01:32:36.029045 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2090/4514] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:35 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:32:36.039648 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c3f02bcc-1ab4-4703-8ac6-ea93e11d5020 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '.version_select at 0x7f9e24a41f70>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:36.043182 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3036d51b-4ca0-4640-bfcd-38b55bc666c3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:36.043805 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3036d51b-4ca0-4640-bfcd-38b55bc666c3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:36.048612 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3036d51b-4ca0-4640-bfcd-38b55bc666c3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:36.049507 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3036d51b-4ca0-4640-bfcd-38b55bc666c3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:36.050223 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3036d51b-4ca0-4640-bfcd-38b55bc666c3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:36.056565 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3036d51b-4ca0-4640-bfcd-38b55bc666c3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:36.078131 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c3f02bcc-1ab4-4703-8ac6-ea93e11d5020 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1694686018" status: 204 len: 0 microversion: 2.42 time: 0.044249 Aug 07 01:32:36.079926 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2091/4515] 10.222.0.39 () {60 vars in 1262 bytes} [Sun Aug 7 01:32:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1694686018 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 01:32:36.444009 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-66430eb2-17b7-4ed7-b37d-a18269487375 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:36.444783 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-66430eb2-17b7-4ed7-b37d-a18269487375 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:36.461219 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-66430eb2-17b7-4ed7-b37d-a18269487375 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:36.461728 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-66430eb2-17b7-4ed7-b37d-a18269487375 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:36.462190 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-66430eb2-17b7-4ed7-b37d-a18269487375 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:36.468915 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-66430eb2-17b7-4ed7-b37d-a18269487375 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:36.472583 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-66430eb2-17b7-4ed7-b37d-a18269487375 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:36.474962 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-66430eb2-17b7-4ed7-b37d-a18269487375 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:36.601266 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3036d51b-4ca0-4640-bfcd-38b55bc666c3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:36.612215 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3036d51b-4ca0-4640-bfcd-38b55bc666c3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1664 microversion: 2.1 time: 0.595429 Aug 07 01:32:36.614999 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2425/4516] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:36 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1664 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:36.947302 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-66430eb2-17b7-4ed7-b37d-a18269487375 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:36.957716 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-66430eb2-17b7-4ed7-b37d-a18269487375 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:36.970320 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-66430eb2-17b7-4ed7-b37d-a18269487375 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:36.975192 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-66430eb2-17b7-4ed7-b37d-a18269487375 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1406 microversion: 2.20 time: 0.537675 Aug 07 01:32:36.999639 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2092/4517] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:36 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1406 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:32:37.636884 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-999fd4ea-cd61-44f8-9b1b-321d810b12c5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:37.638536 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-999fd4ea-cd61-44f8-9b1b-321d810b12c5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:37.653350 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-999fd4ea-cd61-44f8-9b1b-321d810b12c5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:37.656436 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-999fd4ea-cd61-44f8-9b1b-321d810b12c5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:37.659096 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-999fd4ea-cd61-44f8-9b1b-321d810b12c5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:37.660090 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-999fd4ea-cd61-44f8-9b1b-321d810b12c5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:37.664597 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-999fd4ea-cd61-44f8-9b1b-321d810b12c5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:37.668547 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-999fd4ea-cd61-44f8-9b1b-321d810b12c5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:38.022051 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-360440e3-2f36-4ae3-9212-aa0720ea3681 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:38.026659 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-360440e3-2f36-4ae3-9212-aa0720ea3681 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:38.065021 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-360440e3-2f36-4ae3-9212-aa0720ea3681 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:38.068159 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-360440e3-2f36-4ae3-9212-aa0720ea3681 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:38.069040 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-360440e3-2f36-4ae3-9212-aa0720ea3681 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:38.076944 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-360440e3-2f36-4ae3-9212-aa0720ea3681 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:38.081703 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-360440e3-2f36-4ae3-9212-aa0720ea3681 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:38.112372 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-360440e3-2f36-4ae3-9212-aa0720ea3681 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:38.169368 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-999fd4ea-cd61-44f8-9b1b-321d810b12c5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:38.185572 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-999fd4ea-cd61-44f8-9b1b-321d810b12c5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.552175 Aug 07 01:32:38.188078 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2426/4518] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:37 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:38.219747 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-eea1627e-3e3a-487f-a526-f5537a7a2763 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:38.221316 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-eea1627e-3e3a-487f-a526-f5537a7a2763 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:38.235650 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eea1627e-3e3a-487f-a526-f5537a7a2763 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:38.236244 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eea1627e-3e3a-487f-a526-f5537a7a2763 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:38.236699 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eea1627e-3e3a-487f-a526-f5537a7a2763 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:38.241775 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eea1627e-3e3a-487f-a526-f5537a7a2763 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:38.244306 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eea1627e-3e3a-487f-a526-f5537a7a2763 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:38.245047 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eea1627e-3e3a-487f-a526-f5537a7a2763 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:38.580270 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-eea1627e-3e3a-487f-a526-f5537a7a2763 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:38.594222 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-eea1627e-3e3a-487f-a526-f5537a7a2763 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1667 microversion: 2.1 time: 0.386958 Aug 07 01:32:38.607914 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2427/4519] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:38 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1667 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:38.634240 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-af299c47-064a-46e4-81b3-50bdeff916da tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:38.636656 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-af299c47-064a-46e4-81b3-50bdeff916da tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:38.654051 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af299c47-064a-46e4-81b3-50bdeff916da tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:38.655702 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af299c47-064a-46e4-81b3-50bdeff916da tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:38.656129 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af299c47-064a-46e4-81b3-50bdeff916da tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:38.659227 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af299c47-064a-46e4-81b3-50bdeff916da tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:38.659724 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af299c47-064a-46e4-81b3-50bdeff916da tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:38.660217 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af299c47-064a-46e4-81b3-50bdeff916da tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:38.742081 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-af299c47-064a-46e4-81b3-50bdeff916da tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:32:38.758634 n-d-master-1 devstack@n-api.service[119516]: INFO nova.compute.api [None req-af299c47-064a-46e4-81b3-50bdeff916da tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Working on deleting snapshot f02e28ba-3dd9-4873-a62d-eadf9881da23 from shelved instance... Aug 07 01:32:39.577032 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-360440e3-2f36-4ae3-9212-aa0720ea3681 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:39.599746 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-360440e3-2f36-4ae3-9212-aa0720ea3681 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:39.601829 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-360440e3-2f36-4ae3-9212-aa0720ea3681 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:39.603056 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-360440e3-2f36-4ae3-9212-aa0720ea3681 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1598 microversion: 2.20 time: 1.593924 Aug 07 01:32:39.603615 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2093/4520] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:38 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1598 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:32:39.633595 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3c97c505-56ec-4af2-8015-fc96c1bae56a tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:39.634106 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3c97c505-56ec-4af2-8015-fc96c1bae56a tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:39.647930 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c97c505-56ec-4af2-8015-fc96c1bae56a tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:39.648433 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c97c505-56ec-4af2-8015-fc96c1bae56a tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:39.648868 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c97c505-56ec-4af2-8015-fc96c1bae56a tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:39.649635 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c97c505-56ec-4af2-8015-fc96c1bae56a tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:39.650091 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c97c505-56ec-4af2-8015-fc96c1bae56a tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:39.650516 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c97c505-56ec-4af2-8015-fc96c1bae56a tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:39.881294 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3c97c505-56ec-4af2-8015-fc96c1bae56a tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.251731 Aug 07 01:32:39.882062 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2094/4521] 10.222.0.39 () {60 vars in 1316 bytes} [Sun Aug 7 01:32:39 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-interface => generated 284 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 01:32:40.463207 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-af299c47-064a-46e4-81b3-50bdeff916da tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Doing local delete in cell 946acc3b-7b72-45d6-9151-44f3ad85fe4f(cell1) {{(pid=119516) _delete /opt/stack/nova/nova/compute/api.py:2491}} Aug 07 01:32:40.467275 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af299c47-064a-46e4-81b3-50bdeff916da tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:40.468138 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af299c47-064a-46e4-81b3-50bdeff916da tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:40.468752 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af299c47-064a-46e4-81b3-50bdeff916da tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:40.470224 n-d-master-1 devstack@n-api.service[119516]: INFO nova.compute.api [None req-af299c47-064a-46e4-81b3-50bdeff916da tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 07 01:32:40.480437 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-af299c47-064a-46e4-81b3-50bdeff916da tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] deallocate_for_instance() {{(pid=119516) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 07 01:32:41.555340 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3c97c505-56ec-4af2-8015-fc96c1bae56a tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:41.556976 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3c97c505-56ec-4af2-8015-fc96c1bae56a tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001982 Aug 07 01:32:41.557553 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2095/4522] 10.222.0.39 () {56 vars in 886 bytes} [Sun Aug 7 01:32:41 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Aug 07 01:32:43.420251 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-af299c47-064a-46e4-81b3-50bdeff916da tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Updating instance_info_cache with network_info: [] {{(pid=119516) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 07 01:32:43.783628 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-2745cb2e-7f74-4c27-ba30-d89949f98d7b req-9aeae8f9-b589-47f4-9bee-22c48f0833b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a00f6b81-d0b5-434f-a861-53cbcf107219", "name": "network-vif-deleted", "tag": "d195799a-8bcf-49dd-ada2-d86a279b6b61"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:32:43.806917 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-2745cb2e-7f74-4c27-ba30-d89949f98d7b req-9aeae8f9-b589-47f4-9bee-22c48f0833b5 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:43.812584 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-2745cb2e-7f74-4c27-ba30-d89949f98d7b req-9aeae8f9-b589-47f4-9bee-22c48f0833b5 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:43.813222 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-2745cb2e-7f74-4c27-ba30-d89949f98d7b req-9aeae8f9-b589-47f4-9bee-22c48f0833b5 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:43.840516 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.compute.server_external_events [req-2745cb2e-7f74-4c27-ba30-d89949f98d7b req-9aeae8f9-b589-47f4-9bee-22c48f0833b5 service nova] Unable to find a host for instance a00f6b81-d0b5-434f-a861-53cbcf107219. Dropping event network-vif-deleted {{(pid=119517) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 07 01:32:43.841905 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-2745cb2e-7f74-4c27-ba30-d89949f98d7b req-9aeae8f9-b589-47f4-9bee-22c48f0833b5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.413263 Aug 07 01:32:43.843077 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2096/4523] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 415 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 07 01:32:44.396741 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-af299c47-064a-46e4-81b3-50bdeff916da tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 204 len: 0 microversion: 2.1 time: 5.778170 Aug 07 01:32:44.398077 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2428/4524] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:32:38 2022] DELETE /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 0 bytes in 5781 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 07 01:32:44.406206 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-abc10d0e-a451-4a70-975e-9f2801c33070 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:44.407738 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-abc10d0e-a451-4a70-975e-9f2801c33070 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: a00f6b81-d0b5-434f-a861-53cbcf107219] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:44.417898 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-abc10d0e-a451-4a70-975e-9f2801c33070 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:44.420728 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-abc10d0e-a451-4a70-975e-9f2801c33070 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:44.422804 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-abc10d0e-a451-4a70-975e-9f2801c33070 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:44.425000 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-abc10d0e-a451-4a70-975e-9f2801c33070 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:44.425968 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-abc10d0e-a451-4a70-975e-9f2801c33070 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:44.427980 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-abc10d0e-a451-4a70-975e-9f2801c33070 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:44.468096 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-abc10d0e-a451-4a70-975e-9f2801c33070 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] HTTP exception thrown: Instance a00f6b81-d0b5-434f-a861-53cbcf107219 could not be found. Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-abc10d0e-a451-4a70-975e-9f2801c33070 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Request method failure captured: Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 HTTP/1.1 Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xQCEJk-j7q5GMRny_lsGnif3Sdi6J_PRK48HvBw7IFCGAd_4S8dbT6u0ir6pCNKAcDzgjJe8K3EgGxRXM_bdEmqwJ2s26cJoZ1m0Ije37wqG_FgPxW47Mp_NsDH3oUqaT1pJwDbOh-Nmz7ouIQa3E2NiKYv614rH5Vd5TuR7lUPJkQ Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 939fea7fa6ea4deda8d4fbef70a4e510 Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServerActionsTestJSON-447960584 Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/939fea7fa6ea4deda8d4fbef70a4e510"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_939fea7fa6ea4deda8d4fbef70a4e510", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/939fea7fa6ea4deda8d4fbef70a4e510"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/939fea7fa6ea4deda8d4fbef70a4e510"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServerActionsTestJSON-447960584 Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 939fea7fa6ea4deda8d4fbef70a4e510 Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServerActionsTestJSON-447960584 Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServerActionsTestJSON-447960584-project Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: ef29bd35cca547c39d76c54058d32979 Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServerActionsTestJSON-447960584-project Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: exception: Instance a00f6b81-d0b5-434f-a861-53cbcf107219 could not be found. Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'a00f6b81-d0b5-434f-a861-53cbcf107219'} Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a00f6b81-d0b5-434f-a861-53cbcf107219 could not be found. Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a00f6b81-d0b5-434f-a861-53cbcf107219 could not be found. Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:32:44.471556 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:32:44.476405 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:32:44.476405 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:32:44.476405 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:32:44.476405 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:32:44.476405 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:32:44.476405 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a00f6b81-d0b5-434f-a861-53cbcf107219 could not be found. Aug 07 01:32:44.476405 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:32:44.486871 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-abc10d0e-a451-4a70-975e-9f2801c33070 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Returning 404 to user: Instance a00f6b81-d0b5-434f-a861-53cbcf107219 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:32:44.489015 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-abc10d0e-a451-4a70-975e-9f2801c33070 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219" status: 404 len: 111 microversion: 2.1 time: 0.087052 Aug 07 01:32:44.492360 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2097/4525] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:44 2022] GET /compute/v2.1/servers/a00f6b81-d0b5-434f-a861-53cbcf107219 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:32:44.503450 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e59cd994-871c-43a4-be3a-75d45b63f1b7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:44.504721 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e59cd994-871c-43a4-be3a-75d45b63f1b7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 6ddf1e46-f885-4128-9530-5118bc687cde] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:44.519489 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e59cd994-871c-43a4-be3a-75d45b63f1b7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:44.521222 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e59cd994-871c-43a4-be3a-75d45b63f1b7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:44.522015 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e59cd994-871c-43a4-be3a-75d45b63f1b7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:44.524251 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e59cd994-871c-43a4-be3a-75d45b63f1b7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:44.525095 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e59cd994-871c-43a4-be3a-75d45b63f1b7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:44.527483 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e59cd994-871c-43a4-be3a-75d45b63f1b7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:44.582548 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e59cd994-871c-43a4-be3a-75d45b63f1b7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 6ddf1e46-f885-4128-9530-5118bc687cde] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:32:44.722293 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e59cd994-871c-43a4-be3a-75d45b63f1b7 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde" status: 204 len: 0 microversion: 2.1 time: 0.222632 Aug 07 01:32:44.726943 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2429/4526] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:32:44 2022] DELETE /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:32:44.736269 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-47b5db64-26e1-490a-8ca9-b13206f71921 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:44.737439 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-47b5db64-26e1-490a-8ca9-b13206f71921 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 6ddf1e46-f885-4128-9530-5118bc687cde] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:44.751733 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-47b5db64-26e1-490a-8ca9-b13206f71921 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:44.752674 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-47b5db64-26e1-490a-8ca9-b13206f71921 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:44.756152 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-47b5db64-26e1-490a-8ca9-b13206f71921 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:44.757477 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-47b5db64-26e1-490a-8ca9-b13206f71921 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:44.758190 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-47b5db64-26e1-490a-8ca9-b13206f71921 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:44.760388 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-47b5db64-26e1-490a-8ca9-b13206f71921 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:45.280552 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-47b5db64-26e1-490a-8ca9-b13206f71921 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:45.299060 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-47b5db64-26e1-490a-8ca9-b13206f71921 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde" status: 200 len: 1465 microversion: 2.1 time: 0.566185 Aug 07 01:32:45.299719 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2098/4527] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:44 2022] GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde => generated 1465 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:46.338748 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d3f99390-682b-4888-88b5-f3da2b345344 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:46.340739 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d3f99390-682b-4888-88b5-f3da2b345344 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 6ddf1e46-f885-4128-9530-5118bc687cde] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:46.361813 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3f99390-682b-4888-88b5-f3da2b345344 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:46.363545 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3f99390-682b-4888-88b5-f3da2b345344 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:46.364339 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3f99390-682b-4888-88b5-f3da2b345344 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:46.365544 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3f99390-682b-4888-88b5-f3da2b345344 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:46.366258 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3f99390-682b-4888-88b5-f3da2b345344 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:46.366936 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3f99390-682b-4888-88b5-f3da2b345344 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:46.697102 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d3f99390-682b-4888-88b5-f3da2b345344 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:46.711744 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d3f99390-682b-4888-88b5-f3da2b345344 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde" status: 200 len: 1465 microversion: 2.1 time: 0.387893 Aug 07 01:32:46.719815 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2430/4528] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:46 2022] GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde => generated 1465 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:47.428603 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-6287ccb3-6714-4abc-9be1-c4e0e8c81dc6 req-620022e1-86ff-4550-b231-9082fdce1b17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4071f699-43c7-4c36-ada4-8f0dceb6cc91", "tag": "a4d2050c-f5b0-4218-a72d-272334938cd5"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:32:47.480682 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:47.490854 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6287ccb3-6714-4abc-9be1-c4e0e8c81dc6 req-620022e1-86ff-4550-b231-9082fdce1b17 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:47.491398 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6287ccb3-6714-4abc-9be1-c4e0e8c81dc6 req-620022e1-86ff-4550-b231-9082fdce1b17 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:47.491956 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6287ccb3-6714-4abc-9be1-c4e0e8c81dc6 req-620022e1-86ff-4550-b231-9082fdce1b17 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:47.549697 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-6287ccb3-6714-4abc-9be1-c4e0e8c81dc6 req-620022e1-86ff-4550-b231-9082fdce1b17 service nova] Creating event network-changed:a4d2050c-f5b0-4218-a72d-272334938cd5 for instance 4071f699-43c7-4c36-ada4-8f0dceb6cc91 on n-h2-master-1 Aug 07 01:32:47.580230 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-6287ccb3-6714-4abc-9be1-c4e0e8c81dc6 req-620022e1-86ff-4550-b231-9082fdce1b17 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155622 Aug 07 01:32:47.585313 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2099/4529] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:32:47.735194 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f2e9a5af-2e32-49dc-a246-d6a8b9333fda tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:47.735868 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f2e9a5af-2e32-49dc-a246-d6a8b9333fda tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 6ddf1e46-f885-4128-9530-5118bc687cde] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:47.771919 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2e9a5af-2e32-49dc-a246-d6a8b9333fda tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:47.777494 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2e9a5af-2e32-49dc-a246-d6a8b9333fda tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:47.778204 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2e9a5af-2e32-49dc-a246-d6a8b9333fda tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:47.778986 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2e9a5af-2e32-49dc-a246-d6a8b9333fda tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:47.779909 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2e9a5af-2e32-49dc-a246-d6a8b9333fda tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:47.784822 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2e9a5af-2e32-49dc-a246-d6a8b9333fda tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:48.097651 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f2e9a5af-2e32-49dc-a246-d6a8b9333fda tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:48.109206 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f2e9a5af-2e32-49dc-a246-d6a8b9333fda tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde" status: 200 len: 1465 microversion: 2.1 time: 0.379702 Aug 07 01:32:48.112233 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2431/4530] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:47 2022] GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde => generated 1465 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:48.674448 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-af9d94f9-887b-429e-8d13-334d3ea7e0e3 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2130916681", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "13364274-84bc-4faf-89c7-d9dfb647f995"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:32:48.790276 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-af9d94f9-887b-429e-8d13-334d3ea7e0e3 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] validate_networks() for [('13364274-84bc-4faf-89c7-d9dfb647f995', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:32:49.134110 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b8067904-9cef-4861-b717-e71751b5331a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:49.134753 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b8067904-9cef-4861-b717-e71751b5331a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 6ddf1e46-f885-4128-9530-5118bc687cde] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:49.159329 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b8067904-9cef-4861-b717-e71751b5331a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:49.159973 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b8067904-9cef-4861-b717-e71751b5331a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:49.160438 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b8067904-9cef-4861-b717-e71751b5331a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:49.161204 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b8067904-9cef-4861-b717-e71751b5331a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:49.161673 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b8067904-9cef-4861-b717-e71751b5331a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:49.162116 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b8067904-9cef-4861-b717-e71751b5331a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:49.403660 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b8067904-9cef-4861-b717-e71751b5331a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:49.418169 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b8067904-9cef-4861-b717-e71751b5331a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde" status: 200 len: 1465 microversion: 2.1 time: 0.288047 Aug 07 01:32:49.418776 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2432/4531] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:49 2022] GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde => generated 1465 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:32:50.122048 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-231ffd53-8ea8-4562-85a1-693011e8a728 tempest-VolumesTestJSON-447084263 tempest-VolumesTestJSON-447084263-project] Calling method '.version_select at 0x7f9e299693a0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:50.210967 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-231ffd53-8ea8-4562-85a1-693011e8a728 tempest-VolumesTestJSON-447084263 tempest-VolumesTestJSON-447084263-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/f737f50f-d707-4583-ad42-93c52495a8fb" status: 200 len: 350 microversion: 2.1 time: 0.102144 Aug 07 01:32:50.211554 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2433/4532] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Aug 7 01:32:50 2022] GET /compute/v2.1/os-volumes/f737f50f-d707-4583-ad42-93c52495a8fb => generated 350 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:32:50.374573 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-92c8599d-e61e-40cd-849f-86f2c247be5a req-da9abf6b-a6ca-4696-bcc3-cdbcaf52fa22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ddf1e46-f885-4128-9530-5118bc687cde", "name": "network-vif-unplugged", "status": "completed", "tag": "80d83a5c-0316-4c2a-870a-d8eb535ee6a2"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:32:50.403834 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-92c8599d-e61e-40cd-849f-86f2c247be5a req-da9abf6b-a6ca-4696-bcc3-cdbcaf52fa22 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:50.407007 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-92c8599d-e61e-40cd-849f-86f2c247be5a req-da9abf6b-a6ca-4696-bcc3-cdbcaf52fa22 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:50.407514 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-92c8599d-e61e-40cd-849f-86f2c247be5a req-da9abf6b-a6ca-4696-bcc3-cdbcaf52fa22 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:50.419593 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:50.443582 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-92c8599d-e61e-40cd-849f-86f2c247be5a req-da9abf6b-a6ca-4696-bcc3-cdbcaf52fa22 service nova] Creating event network-vif-unplugged:80d83a5c-0316-4c2a-870a-d8eb535ee6a2 for instance 6ddf1e46-f885-4128-9530-5118bc687cde on n-h2-master-1 Aug 07 01:32:50.458042 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-92c8599d-e61e-40cd-849f-86f2c247be5a req-da9abf6b-a6ca-4696-bcc3-cdbcaf52fa22 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086179 Aug 07 01:32:50.460283 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2434/4533] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:32:50.477678 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-77a1d1b1-7a04-4607-b7f6-6fbab9acb97a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:50.484003 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-77a1d1b1-7a04-4607-b7f6-6fbab9acb97a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 6ddf1e46-f885-4128-9530-5118bc687cde] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:50.503177 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77a1d1b1-7a04-4607-b7f6-6fbab9acb97a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:50.504618 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77a1d1b1-7a04-4607-b7f6-6fbab9acb97a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:50.505983 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77a1d1b1-7a04-4607-b7f6-6fbab9acb97a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:50.508195 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77a1d1b1-7a04-4607-b7f6-6fbab9acb97a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:50.509028 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77a1d1b1-7a04-4607-b7f6-6fbab9acb97a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:50.510315 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77a1d1b1-7a04-4607-b7f6-6fbab9acb97a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:50.689154 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-77a1d1b1-7a04-4607-b7f6-6fbab9acb97a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:50.698755 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-77a1d1b1-7a04-4607-b7f6-6fbab9acb97a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde" status: 200 len: 1465 microversion: 2.1 time: 0.234267 Aug 07 01:32:50.699357 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2435/4534] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:50 2022] GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde => generated 1465 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:51.507714 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-d146731f-cb25-44cb-b541-47d93a243dfc req-75f931fb-a97e-4af2-bc11-d57d232982fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ddf1e46-f885-4128-9530-5118bc687cde", "name": "network-vif-deleted", "tag": "80d83a5c-0316-4c2a-870a-d8eb535ee6a2"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:32:51.585561 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d146731f-cb25-44cb-b541-47d93a243dfc req-75f931fb-a97e-4af2-bc11-d57d232982fa service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:51.591220 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d146731f-cb25-44cb-b541-47d93a243dfc req-75f931fb-a97e-4af2-bc11-d57d232982fa service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:51.591802 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d146731f-cb25-44cb-b541-47d93a243dfc req-75f931fb-a97e-4af2-bc11-d57d232982fa service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:51.648844 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-d146731f-cb25-44cb-b541-47d93a243dfc req-75f931fb-a97e-4af2-bc11-d57d232982fa service nova] Creating event network-vif-deleted:80d83a5c-0316-4c2a-870a-d8eb535ee6a2 for instance 6ddf1e46-f885-4128-9530-5118bc687cde on n-h2-master-1 Aug 07 01:32:51.670862 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-d146731f-cb25-44cb-b541-47d93a243dfc req-75f931fb-a97e-4af2-bc11-d57d232982fa service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172318 Aug 07 01:32:51.672017 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2436/4535] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:32:51.765347 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-22fb93f9-197c-4790-a9dd-6b18b66769e8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:51.766225 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-22fb93f9-197c-4790-a9dd-6b18b66769e8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 6ddf1e46-f885-4128-9530-5118bc687cde] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:51.784346 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22fb93f9-197c-4790-a9dd-6b18b66769e8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:51.784742 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22fb93f9-197c-4790-a9dd-6b18b66769e8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:51.785187 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22fb93f9-197c-4790-a9dd-6b18b66769e8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:51.785909 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22fb93f9-197c-4790-a9dd-6b18b66769e8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:51.786369 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22fb93f9-197c-4790-a9dd-6b18b66769e8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:51.786796 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22fb93f9-197c-4790-a9dd-6b18b66769e8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:51.893930 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22fb93f9-197c-4790-a9dd-6b18b66769e8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:51.901591 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22fb93f9-197c-4790-a9dd-6b18b66769e8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:51.902298 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22fb93f9-197c-4790-a9dd-6b18b66769e8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:51.903031 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-22fb93f9-197c-4790-a9dd-6b18b66769e8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lazy-loading 'fault' on Instance uuid 6ddf1e46-f885-4128-9530-5118bc687cde {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:32:52.068934 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-22fb93f9-197c-4790-a9dd-6b18b66769e8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:52.084165 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-22fb93f9-197c-4790-a9dd-6b18b66769e8 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde" status: 200 len: 1305 microversion: 2.1 time: 0.324219 Aug 07 01:32:52.085742 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2437/4536] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:51 2022] GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde => generated 1305 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:52.106413 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-af9d94f9-887b-429e-8d13-334d3ea7e0e3 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:32:52.107754 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-af9d94f9-887b-429e-8d13-334d3ea7e0e3 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:32:52.118692 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-af9d94f9-887b-429e-8d13-334d3ea7e0e3 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:32:52.119374 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-af9d94f9-887b-429e-8d13-334d3ea7e0e3 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:32:52.120558 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-af9d94f9-887b-429e-8d13-334d3ea7e0e3 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:32:52.141329 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-af9d94f9-887b-429e-8d13-334d3ea7e0e3 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:52.143837 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-af9d94f9-887b-429e-8d13-334d3ea7e0e3 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:52.145387 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-af9d94f9-887b-429e-8d13-334d3ea7e0e3 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:52.147529 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-af9d94f9-887b-429e-8d13-334d3ea7e0e3 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:52.150359 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-af9d94f9-887b-429e-8d13-334d3ea7e0e3 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:52.152014 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-af9d94f9-887b-429e-8d13-334d3ea7e0e3 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:52.251796 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-af9d94f9-887b-429e-8d13-334d3ea7e0e3 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Getting quotas for project 307db42ddfad40db8c2efe752c185a84. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:32:52.264585 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-af9d94f9-887b-429e-8d13-334d3ea7e0e3 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Getting quotas for user 1b06d31773ee4b9389ee2ea8a12f0f29 and project 307db42ddfad40db8c2efe752c185a84. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:32:52.318331 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-af9d94f9-887b-429e-8d13-334d3ea7e0e3 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:32:52.333456 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-af9d94f9-887b-429e-8d13-334d3ea7e0e3 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] [instance: 9d411485-9146-4dc0-9f22-b94251834d8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:32:52.408198 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-500e497a-9915-407a-b3a2-87f312795088 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Action: 'create', calling method: .version_select at 0x7f9e24bd25e0>, body: {"keypair": {"name": "tempest-keypair-1833659768", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3wBBt9U9skBweVwdpsv7lkVcONU6YvVuK7fyESlHRmnqbv+6wVkfhaGWFOLyYt+nSynYI6mYdROykt0q77qN2aD7qPn4vmh+VUlkhS9/ZQLfy8mQIIXpJV19cvFKCcSw=="}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:32:52.454013 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-af9d94f9-887b-429e-8d13-334d3ea7e0e3 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.183118 Aug 07 01:32:52.456204 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2100/4537] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:32:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 4186 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:32:52.468373 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2bd12983-14aa-46f8-8995-7684bb5a2858 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:52.469319 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2bd12983-14aa-46f8-8995-7684bb5a2858 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] [instance: 9d411485-9146-4dc0-9f22-b94251834d8b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:52.474508 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-500e497a-9915-407a-b3a2-87f312795088 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Getting quotas for project b630a4c3bb824b90b4c1898a92b47aa7. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:32:52.504856 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-500e497a-9915-407a-b3a2-87f312795088 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Getting quotas for user d556a8ae0d524894a93203ce3f70d420 and project b630a4c3bb824b90b4c1898a92b47aa7. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:32:52.590513 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-500e497a-9915-407a-b3a2-87f312795088 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.495579 Aug 07 01:32:52.595320 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2438/4538] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:32:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:32:52.645179 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2bd12983-14aa-46f8-8995-7684bb5a2858 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b06d31773ee4b9389ee2ea8a12f0f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307db42ddfad40db8c2efe752c185a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:52.659917 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2bd12983-14aa-46f8-8995-7684bb5a2858 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] 10.222.0.39 "GET /compute/v2.1/servers/9d411485-9146-4dc0-9f22-b94251834d8b" status: 200 len: 1224 microversion: 2.1 time: 0.196941 Aug 07 01:32:52.675509 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2101/4539] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:52 2022] GET /compute/v2.1/servers/9d411485-9146-4dc0-9f22-b94251834d8b => generated 1224 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:53.110939 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7b1c4c72-6e8d-490a-bab6-ede8d440ba61 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:53.111562 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7b1c4c72-6e8d-490a-bab6-ede8d440ba61 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 6ddf1e46-f885-4128-9530-5118bc687cde] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:53.135311 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b1c4c72-6e8d-490a-bab6-ede8d440ba61 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:53.138443 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b1c4c72-6e8d-490a-bab6-ede8d440ba61 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:53.139319 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b1c4c72-6e8d-490a-bab6-ede8d440ba61 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:53.145025 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b1c4c72-6e8d-490a-bab6-ede8d440ba61 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:53.145598 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b1c4c72-6e8d-490a-bab6-ede8d440ba61 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:53.146049 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b1c4c72-6e8d-490a-bab6-ede8d440ba61 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:53.207330 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-7b1c4c72-6e8d-490a-bab6-ede8d440ba61 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] HTTP exception thrown: Instance 6ddf1e46-f885-4128-9530-5118bc687cde could not be found. Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7b1c4c72-6e8d-490a-bab6-ede8d440ba61 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Request method failure captured: Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde HTTP/1.1 Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xQCEJk-j7q5GMRny_lsGnif3Sdi6J_PRK48HvBw7IFCGAd_4S8dbT6u0ir6pCNKAcDzgjJe8K3EgGxRXM_bdEmqwJ2s26cJoZ1m0Ije37wqG_FgPxW47Mp_NsDH3oUqaT1pJwDbOh-Nmz7ouIQa3E2NiKYv614rH5Vd5TuR7lUPJkQ Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 939fea7fa6ea4deda8d4fbef70a4e510 Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServerActionsTestJSON-447960584 Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/939fea7fa6ea4deda8d4fbef70a4e510"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_939fea7fa6ea4deda8d4fbef70a4e510", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/939fea7fa6ea4deda8d4fbef70a4e510"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/939fea7fa6ea4deda8d4fbef70a4e510"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServerActionsTestJSON-447960584 Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 939fea7fa6ea4deda8d4fbef70a4e510 Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServerActionsTestJSON-447960584 Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServerActionsTestJSON-447960584-project Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: ef29bd35cca547c39d76c54058d32979 Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServerActionsTestJSON-447960584-project Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 6ddf1e46-f885-4128-9530-5118bc687cde could not be found. Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '6ddf1e46-f885-4128-9530-5118bc687cde'} Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ddf1e46-f885-4128-9530-5118bc687cde could not be found. Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ddf1e46-f885-4128-9530-5118bc687cde could not be found. Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:32:53.211550 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:32:53.221016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:32:53.221016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:32:53.221016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:32:53.221016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:32:53.221016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:32:53.221016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ddf1e46-f885-4128-9530-5118bc687cde could not be found. Aug 07 01:32:53.221016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:32:53.221016 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7b1c4c72-6e8d-490a-bab6-ede8d440ba61 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Returning 404 to user: Instance 6ddf1e46-f885-4128-9530-5118bc687cde could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:32:53.221016 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7b1c4c72-6e8d-490a-bab6-ede8d440ba61 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde" status: 404 len: 111 microversion: 2.1 time: 0.110981 Aug 07 01:32:53.221016 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2439/4540] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:53 2022] GET /compute/v2.1/servers/6ddf1e46-f885-4128-9530-5118bc687cde => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:32:53.226240 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e356ccb5-2bcc-47c4-9f42-831967ef335c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:53.227247 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e356ccb5-2bcc-47c4-9f42-831967ef335c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: edea7d5b-2ad8-4b91-b389-8d3a6dd3f118] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:53.255178 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e356ccb5-2bcc-47c4-9f42-831967ef335c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:53.255676 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e356ccb5-2bcc-47c4-9f42-831967ef335c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:53.256140 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e356ccb5-2bcc-47c4-9f42-831967ef335c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:53.256862 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e356ccb5-2bcc-47c4-9f42-831967ef335c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:53.257318 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e356ccb5-2bcc-47c4-9f42-831967ef335c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:53.257737 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e356ccb5-2bcc-47c4-9f42-831967ef335c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:53.329720 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e356ccb5-2bcc-47c4-9f42-831967ef335c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: edea7d5b-2ad8-4b91-b389-8d3a6dd3f118] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:32:53.556223 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e356ccb5-2bcc-47c4-9f42-831967ef335c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "DELETE /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118" status: 204 len: 0 microversion: 2.1 time: 0.335002 Aug 07 01:32:53.558003 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2102/4541] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:32:53 2022] DELETE /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:32:53.566858 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-08496a0b-70df-4b4b-a288-3bcfe68a9d12 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:53.567496 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-08496a0b-70df-4b4b-a288-3bcfe68a9d12 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: edea7d5b-2ad8-4b91-b389-8d3a6dd3f118] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:53.581621 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08496a0b-70df-4b4b-a288-3bcfe68a9d12 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:53.582028 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08496a0b-70df-4b4b-a288-3bcfe68a9d12 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:53.582472 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08496a0b-70df-4b4b-a288-3bcfe68a9d12 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:53.583199 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08496a0b-70df-4b4b-a288-3bcfe68a9d12 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:53.583661 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08496a0b-70df-4b4b-a288-3bcfe68a9d12 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:53.587812 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08496a0b-70df-4b4b-a288-3bcfe68a9d12 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:53.687097 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6db074bd-1db6-4591-8587-76b7c6563540 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:53.688297 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6db074bd-1db6-4591-8587-76b7c6563540 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] [instance: 9d411485-9146-4dc0-9f22-b94251834d8b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:53.703787 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6db074bd-1db6-4591-8587-76b7c6563540 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:53.704908 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6db074bd-1db6-4591-8587-76b7c6563540 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:53.705630 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6db074bd-1db6-4591-8587-76b7c6563540 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:53.708756 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6db074bd-1db6-4591-8587-76b7c6563540 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:53.709336 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6db074bd-1db6-4591-8587-76b7c6563540 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:53.710696 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6db074bd-1db6-4591-8587-76b7c6563540 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:53.898275 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6db074bd-1db6-4591-8587-76b7c6563540 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b06d31773ee4b9389ee2ea8a12f0f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307db42ddfad40db8c2efe752c185a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:53.919294 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6db074bd-1db6-4591-8587-76b7c6563540 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] 10.222.0.39 "GET /compute/v2.1/servers/9d411485-9146-4dc0-9f22-b94251834d8b" status: 200 len: 1228 microversion: 2.1 time: 0.236001 Aug 07 01:32:53.920371 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2103/4542] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:53 2022] GET /compute/v2.1/servers/9d411485-9146-4dc0-9f22-b94251834d8b => generated 1228 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:54.149404 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cd2e90a3-d638-4684-a2fc-a1e938a65d0a tempest-VolumesTestJSON-447084263 tempest-VolumesTestJSON-447084263-project] Calling method '.version_select at 0x7f9e2436aaf0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:54.248324 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cd2e90a3-d638-4684-a2fc-a1e938a65d0a tempest-VolumesTestJSON-447084263 tempest-VolumesTestJSON-447084263-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/35bcfbc2-2ceb-4ce1-858f-195aaef8e67e" status: 200 len: 351 microversion: 2.1 time: 0.105453 Aug 07 01:32:54.249291 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2104/4543] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Aug 7 01:32:54 2022] GET /compute/v2.1/os-volumes/35bcfbc2-2ceb-4ce1-858f-195aaef8e67e => generated 351 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:32:54.419512 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-08496a0b-70df-4b4b-a288-3bcfe68a9d12 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:54.434711 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-08496a0b-70df-4b4b-a288-3bcfe68a9d12 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118" status: 200 len: 1508 microversion: 2.1 time: 0.872177 Aug 07 01:32:54.435637 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2440/4544] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:53 2022] GET /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118 => generated 1508 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:54.943140 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-765e1123-d0a0-40e3-ab59-5177c9b7cbfc tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:54.943770 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-765e1123-d0a0-40e3-ab59-5177c9b7cbfc tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] [instance: 9d411485-9146-4dc0-9f22-b94251834d8b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:54.963458 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-765e1123-d0a0-40e3-ab59-5177c9b7cbfc tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:54.964755 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-765e1123-d0a0-40e3-ab59-5177c9b7cbfc tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:54.967211 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-765e1123-d0a0-40e3-ab59-5177c9b7cbfc tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:54.968191 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-765e1123-d0a0-40e3-ab59-5177c9b7cbfc tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:54.974932 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-765e1123-d0a0-40e3-ab59-5177c9b7cbfc tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:54.977671 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-765e1123-d0a0-40e3-ab59-5177c9b7cbfc tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:55.273099 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-765e1123-d0a0-40e3-ab59-5177c9b7cbfc tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b06d31773ee4b9389ee2ea8a12f0f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307db42ddfad40db8c2efe752c185a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:55.291490 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-765e1123-d0a0-40e3-ab59-5177c9b7cbfc tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] 10.222.0.39 "GET /compute/v2.1/servers/9d411485-9146-4dc0-9f22-b94251834d8b" status: 200 len: 1282 microversion: 2.1 time: 0.346684 Aug 07 01:32:55.299276 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2105/4545] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:54 2022] GET /compute/v2.1/servers/9d411485-9146-4dc0-9f22-b94251834d8b => generated 1282 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:55.460640 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ffce1fe5-4cd3-44c3-a925-23d1b836cf5c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:55.461915 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ffce1fe5-4cd3-44c3-a925-23d1b836cf5c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: edea7d5b-2ad8-4b91-b389-8d3a6dd3f118] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:55.475123 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ffce1fe5-4cd3-44c3-a925-23d1b836cf5c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:55.475975 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ffce1fe5-4cd3-44c3-a925-23d1b836cf5c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:55.477037 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ffce1fe5-4cd3-44c3-a925-23d1b836cf5c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:55.480020 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ffce1fe5-4cd3-44c3-a925-23d1b836cf5c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:55.480735 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ffce1fe5-4cd3-44c3-a925-23d1b836cf5c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:55.481377 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ffce1fe5-4cd3-44c3-a925-23d1b836cf5c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:55.795226 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ffce1fe5-4cd3-44c3-a925-23d1b836cf5c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:55.805244 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ffce1fe5-4cd3-44c3-a925-23d1b836cf5c tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118" status: 200 len: 1508 microversion: 2.1 time: 0.349205 Aug 07 01:32:55.808202 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2441/4546] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:55 2022] GET /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118 => generated 1508 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:56.312193 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bd15a10d-77a3-476a-80f2-c23d9e3421d1 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:56.312755 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bd15a10d-77a3-476a-80f2-c23d9e3421d1 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] [instance: 9d411485-9146-4dc0-9f22-b94251834d8b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:56.332127 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bd15a10d-77a3-476a-80f2-c23d9e3421d1 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:56.332704 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bd15a10d-77a3-476a-80f2-c23d9e3421d1 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:56.333152 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bd15a10d-77a3-476a-80f2-c23d9e3421d1 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:56.336642 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bd15a10d-77a3-476a-80f2-c23d9e3421d1 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:56.337151 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bd15a10d-77a3-476a-80f2-c23d9e3421d1 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:56.337605 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bd15a10d-77a3-476a-80f2-c23d9e3421d1 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:56.842382 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-94d8d293-4cdf-4b99-ab53-9493035e350a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:56.844266 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-94d8d293-4cdf-4b99-ab53-9493035e350a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: edea7d5b-2ad8-4b91-b389-8d3a6dd3f118] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:56.861165 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94d8d293-4cdf-4b99-ab53-9493035e350a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:56.862010 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94d8d293-4cdf-4b99-ab53-9493035e350a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:56.862642 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94d8d293-4cdf-4b99-ab53-9493035e350a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:56.863669 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94d8d293-4cdf-4b99-ab53-9493035e350a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:56.864393 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94d8d293-4cdf-4b99-ab53-9493035e350a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:56.864993 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94d8d293-4cdf-4b99-ab53-9493035e350a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:57.214257 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-94d8d293-4cdf-4b99-ab53-9493035e350a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:57.225503 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-94d8d293-4cdf-4b99-ab53-9493035e350a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118" status: 200 len: 1508 microversion: 2.1 time: 0.392627 Aug 07 01:32:57.228615 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2442/4547] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:56 2022] GET /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118 => generated 1508 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:57.233645 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ac5a7ee4-56a3-4682-b90b-12ee26097f44 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:57.236938 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ac5a7ee4-56a3-4682-b90b-12ee26097f44 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:57.243852 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:57.253359 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac5a7ee4-56a3-4682-b90b-12ee26097f44 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:57.258948 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac5a7ee4-56a3-4682-b90b-12ee26097f44 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:57.259531 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac5a7ee4-56a3-4682-b90b-12ee26097f44 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:57.260434 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac5a7ee4-56a3-4682-b90b-12ee26097f44 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:57.262171 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac5a7ee4-56a3-4682-b90b-12ee26097f44 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:57.263507 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac5a7ee4-56a3-4682-b90b-12ee26097f44 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:57.315025 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-ac5a7ee4-56a3-4682-b90b-12ee26097f44 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] HTTP exception thrown: Instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 could not be found. Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ac5a7ee4-56a3-4682-b90b-12ee26097f44 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Request method failure captured: Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 HTTP/1.1 Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xRSoIRrVFwtMZ_IZ06LzD8Ye3SSsfn3Bx3ZyHXPGEnq4h6wn7NvGwqT0nOv6bsV6zigsjtumgVPj99nYHcDZ-CA4QjyBDYOZb5GiirmAFdw8GKm_DYsDVKeOT9RJ36SiANEi7XCAe3c8coz9qfEveKtglDz8eyl4WdoGvBE6idNTGY Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: X-Openstack-Nova-Api-Version: 2.42 Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: f5f3e59419be4d2b892f498e527cb2e8 Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1173123380 Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f5f3e59419be4d2b892f498e527cb2e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f5f3e59419be4d2b892f498e527cb2e8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f5f3e59419be4d2b892f498e527cb2e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f5f3e59419be4d2b892f498e527cb2e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1173123380 Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: f5f3e59419be4d2b892f498e527cb2e8 Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1173123380 Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-TaggedBootDevicesTest_v242-1173123380-project Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 106559a2b8754c54b1c41ba8cadd1a97 Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1173123380-project Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 could not be found. Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '799e740e-2304-4bdf-ad6e-ea4817a92b15'} Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 could not be found. Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:32:57.317171 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:32:57.320940 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 could not be found. Aug 07 01:32:57.320940 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:32:57.320940 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:32:57.320940 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:32:57.320940 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:32:57.320940 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:32:57.320940 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:32:57.320940 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:32:57.320940 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:32:57.320940 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 could not be found. Aug 07 01:32:57.320940 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:32:57.326536 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ac5a7ee4-56a3-4682-b90b-12ee26097f44 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Returning 404 to user: Instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:32:57.330460 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ac5a7ee4-56a3-4682-b90b-12ee26097f44 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "DELETE /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 404 len: 111 microversion: 2.42 time: 0.100354 Aug 07 01:32:57.332580 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2443/4548] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Aug 7 01:32:57 2022] DELETE /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:32:57.338593 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9522e5d2-802c-44eb-88e3-2318fb082774 tempest-VolumesTestJSON-447084263 tempest-VolumesTestJSON-447084263-project] Calling method '.version_select at 0x7f9e17aaf040>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:57.431799 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9522e5d2-802c-44eb-88e3-2318fb082774 tempest-VolumesTestJSON-447084263 tempest-VolumesTestJSON-447084263-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/eb4be30c-a352-49e6-b9cd-af7499c26257" status: 200 len: 351 microversion: 2.1 time: 0.096976 Aug 07 01:32:57.432529 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2444/4549] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Aug 7 01:32:57 2022] GET /compute/v2.1/os-volumes/eb4be30c-a352-49e6-b9cd-af7499c26257 => generated 351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:32:57.437529 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1714ddf6-b92c-4dd8-882e-9f7629bcd9f7 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:57.438225 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bd15a10d-77a3-476a-80f2-c23d9e3421d1 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b06d31773ee4b9389ee2ea8a12f0f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307db42ddfad40db8c2efe752c185a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:57.439236 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1714ddf6-b92c-4dd8-882e-9f7629bcd9f7 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] [instance: 799e740e-2304-4bdf-ad6e-ea4817a92b15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:57.457030 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bd15a10d-77a3-476a-80f2-c23d9e3421d1 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] 10.222.0.39 "GET /compute/v2.1/servers/9d411485-9146-4dc0-9f22-b94251834d8b" status: 200 len: 1282 microversion: 2.1 time: 1.148822 Aug 07 01:32:57.457876 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2106/4550] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:56 2022] GET /compute/v2.1/servers/9d411485-9146-4dc0-9f22-b94251834d8b => generated 1282 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:57.495272 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1714ddf6-b92c-4dd8-882e-9f7629bcd9f7 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:57.500341 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1714ddf6-b92c-4dd8-882e-9f7629bcd9f7 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:57.500886 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1714ddf6-b92c-4dd8-882e-9f7629bcd9f7 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:57.501643 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1714ddf6-b92c-4dd8-882e-9f7629bcd9f7 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:57.502119 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1714ddf6-b92c-4dd8-882e-9f7629bcd9f7 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:57.502547 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1714ddf6-b92c-4dd8-882e-9f7629bcd9f7 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:57.510176 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e27e0d21-1b1e-494b-be5b-310ac3eaf3a4 tempest-VolumesTestJSON-447084263 tempest-VolumesTestJSON-447084263-project] Calling method '.version_select at 0x7f9e242fddc0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:57.549065 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-1714ddf6-b92c-4dd8-882e-9f7629bcd9f7 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] HTTP exception thrown: Instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 could not be found. Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1714ddf6-b92c-4dd8-882e-9f7629bcd9f7 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Request method failure captured: Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 HTTP/1.1 Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xRSoIRrVFwtMZ_IZ06LzD8Ye3SSsfn3Bx3ZyHXPGEnq4h6wn7NvGwqT0nOv6bsV6zigsjtumgVPj99nYHcDZ-CA4QjyBDYOZb5GiirmAFdw8GKm_DYsDVKeOT9RJ36SiANEi7XCAe3c8coz9qfEveKtglDz8eyl4WdoGvBE6idNTGY Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: X-Openstack-Nova-Api-Version: 2.42 Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: f5f3e59419be4d2b892f498e527cb2e8 Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1173123380 Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f5f3e59419be4d2b892f498e527cb2e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f5f3e59419be4d2b892f498e527cb2e8", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f5f3e59419be4d2b892f498e527cb2e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f5f3e59419be4d2b892f498e527cb2e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1173123380 Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: f5f3e59419be4d2b892f498e527cb2e8 Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1173123380 Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-TaggedBootDevicesTest_v242-1173123380-project Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 106559a2b8754c54b1c41ba8cadd1a97 Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1173123380-project Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 could not be found. Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '799e740e-2304-4bdf-ad6e-ea4817a92b15'} Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 could not be found. Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 could not be found. Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:32:57.554880 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:32:57.559658 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:32:57.559658 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:32:57.559658 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:32:57.559658 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:32:57.559658 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:32:57.559658 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:32:57.559658 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 could not be found. Aug 07 01:32:57.559658 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:32:57.559658 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1714ddf6-b92c-4dd8-882e-9f7629bcd9f7 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] Returning 404 to user: Instance 799e740e-2304-4bdf-ad6e-ea4817a92b15 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:32:57.559658 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1714ddf6-b92c-4dd8-882e-9f7629bcd9f7 tempest-TaggedBootDevicesTest_v242-1173123380 tempest-TaggedBootDevicesTest_v242-1173123380-project] 10.222.0.39 "GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15" status: 404 len: 111 microversion: 2.42 time: 0.123230 Aug 07 01:32:57.561051 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2445/4551] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:32:57 2022] GET /compute/v2.1/servers/799e740e-2304-4bdf-ad6e-ea4817a92b15 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:32:57.673908 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e27e0d21-1b1e-494b-be5b-310ac3eaf3a4 tempest-VolumesTestJSON-447084263 tempest-VolumesTestJSON-447084263-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.184718 Aug 07 01:32:57.688269 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2107/4552] 10.222.0.39 () {58 vars in 1134 bytes} [Sun Aug 7 01:32:57 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:57.689292 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-99703a24-2385-4f63-98ea-20d5772f0368 tempest-VolumesTestJSON-447084263 tempest-VolumesTestJSON-447084263-project] Calling method '.version_select at 0x7f9e2508f310>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:57.865691 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-99703a24-2385-4f63-98ea-20d5772f0368 tempest-VolumesTestJSON-447084263 tempest-VolumesTestJSON-447084263-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.180614 Aug 07 01:32:57.866291 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2446/4553] 10.222.0.39 () {58 vars in 1149 bytes} [Sun Aug 7 01:32:57 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:32:57.880519 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1a9d5a55-3678-4181-b9c6-e0280c3d3ce2 tempest-VolumesTestJSON-447084263 tempest-VolumesTestJSON-447084263-project] Calling method '.version_select at 0x7f9e24900b80>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:58.061560 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1a9d5a55-3678-4181-b9c6-e0280c3d3ce2 tempest-VolumesTestJSON-447084263 tempest-VolumesTestJSON-447084263-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.184689 Aug 07 01:32:58.076497 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2108/4554] 10.222.0.39 () {58 vars in 1134 bytes} [Sun Aug 7 01:32:57 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:58.078853 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b12eddcd-10ba-4e44-8399-3f2d09547d24 tempest-VolumesTestJSON-447084263 tempest-VolumesTestJSON-447084263-project] Calling method '.version_select at 0x7f9e24bd21f0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:58.210126 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b12eddcd-10ba-4e44-8399-3f2d09547d24 tempest-VolumesTestJSON-447084263 tempest-VolumesTestJSON-447084263-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.137562 Aug 07 01:32:58.224256 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2447/4555] 10.222.0.39 () {58 vars in 1167 bytes} [Sun Aug 7 01:32:58 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:32:58.224920 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-651f8de4-e821-441a-8b88-fa10f53b4ffd tempest-VolumesTestJSON-447084263 tempest-VolumesTestJSON-447084263-project] Calling method '.version_select at 0x7f9e24050d30>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:58.251921 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-10e731c7-bee0-4079-aa7b-82795f535b51 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:58.252853 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-10e731c7-bee0-4079-aa7b-82795f535b51 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: edea7d5b-2ad8-4b91-b389-8d3a6dd3f118] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:58.260785 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10e731c7-bee0-4079-aa7b-82795f535b51 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:58.262002 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10e731c7-bee0-4079-aa7b-82795f535b51 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:58.262712 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10e731c7-bee0-4079-aa7b-82795f535b51 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:58.264137 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10e731c7-bee0-4079-aa7b-82795f535b51 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:58.264774 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10e731c7-bee0-4079-aa7b-82795f535b51 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:58.265457 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10e731c7-bee0-4079-aa7b-82795f535b51 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:58.399219 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-651f8de4-e821-441a-8b88-fa10f53b4ffd tempest-VolumesTestJSON-447084263 tempest-VolumesTestJSON-447084263-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.178422 Aug 07 01:32:58.417560 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2109/4556] 10.222.0.39 () {58 vars in 1170 bytes} [Sun Aug 7 01:32:58 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:32:58.426706 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-66ace432-2894-4c54-affc-339f0fa6a4a4 tempest-VolumesTestJSON-447084263 tempest-VolumesTestJSON-447084263-project] Calling method '.version_select at 0x7f9e2436a5e0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:58.517844 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-10e731c7-bee0-4079-aa7b-82795f535b51 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:58.532885 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-10e731c7-bee0-4079-aa7b-82795f535b51 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118" status: 200 len: 1508 microversion: 2.1 time: 0.282222 Aug 07 01:32:58.535142 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2448/4557] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:58 2022] GET /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118 => generated 1508 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:58.553452 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-064f54aa-259a-45d3-9f85-d34e105c6b0d tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:58.554767 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-064f54aa-259a-45d3-9f85-d34e105c6b0d tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] [instance: 9d411485-9146-4dc0-9f22-b94251834d8b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:58.566017 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-064f54aa-259a-45d3-9f85-d34e105c6b0d tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:58.568589 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-064f54aa-259a-45d3-9f85-d34e105c6b0d tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:58.569314 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-064f54aa-259a-45d3-9f85-d34e105c6b0d tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:58.570280 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-064f54aa-259a-45d3-9f85-d34e105c6b0d tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:58.570964 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-064f54aa-259a-45d3-9f85-d34e105c6b0d tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:58.571610 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-064f54aa-259a-45d3-9f85-d34e105c6b0d tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:58.618339 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-66ace432-2894-4c54-affc-339f0fa6a4a4 tempest-VolumesTestJSON-447084263 tempest-VolumesTestJSON-447084263-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.199539 Aug 07 01:32:58.629721 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2110/4558] 10.222.0.39 () {58 vars in 1155 bytes} [Sun Aug 7 01:32:58 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:58.653416 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a2655a62-1a92-4f66-b460-808a1c64b050 tempest-VolumesTestJSON-447084263 tempest-VolumesTestJSON-447084263-project] Calling method '.version_select at 0x7f9e2985d3a0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:58.921969 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a2655a62-1a92-4f66-b460-808a1c64b050 tempest-VolumesTestJSON-447084263 tempest-VolumesTestJSON-447084263-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.289512 Aug 07 01:32:58.922780 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2111/4559] 10.222.0.39 () {58 vars in 1188 bytes} [Sun Aug 7 01:32:58 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:32:58.944690 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ee96ead2-5347-4c31-b9a8-66f3d4822d30 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1129832573", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "16f1e04e-f3dd-4247-8125-839e2140524d"}], "security_groups": [{"name": "tempest-securitygroup--2104870779"}], "key_name": "tempest-keypair-1833659768", "user_data": "}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:32:58.964235 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-064f54aa-259a-45d3-9f85-d34e105c6b0d tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b06d31773ee4b9389ee2ea8a12f0f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307db42ddfad40db8c2efe752c185a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:58.977365 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-064f54aa-259a-45d3-9f85-d34e105c6b0d tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] 10.222.0.39 "GET /compute/v2.1/servers/9d411485-9146-4dc0-9f22-b94251834d8b" status: 200 len: 1324 microversion: 2.1 time: 0.440696 Aug 07 01:32:58.980347 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2449/4560] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:58 2022] GET /compute/v2.1/servers/9d411485-9146-4dc0-9f22-b94251834d8b => generated 1324 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:58.990938 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-effa10c0-56d1-4f23-ac50-ebad1b6bb6c0 tempest-VolumesTestJSON-447084263 tempest-VolumesTestJSON-447084263-project] Calling method '.version_select at 0x7f9e24ca7d30>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:59.174203 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-effa10c0-56d1-4f23-ac50-ebad1b6bb6c0 tempest-VolumesTestJSON-447084263 tempest-VolumesTestJSON-447084263-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.192493 Aug 07 01:32:59.175582 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2450/4561] 10.222.0.39 () {58 vars in 1155 bytes} [Sun Aug 7 01:32:58 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:32:59.472974 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-ee96ead2-5347-4c31-b9a8-66f3d4822d30 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] validate_networks() for [('16f1e04e-f3dd-4247-8125-839e2140524d', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:32:59.556052 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ec6e3567-95e8-46f8-ae6c-95e07ce0aa50 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:32:59.556952 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ec6e3567-95e8-46f8-ae6c-95e07ce0aa50 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: edea7d5b-2ad8-4b91-b389-8d3a6dd3f118] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:32:59.566113 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec6e3567-95e8-46f8-ae6c-95e07ce0aa50 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:59.566897 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec6e3567-95e8-46f8-ae6c-95e07ce0aa50 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:59.567520 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec6e3567-95e8-46f8-ae6c-95e07ce0aa50 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:59.569027 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec6e3567-95e8-46f8-ae6c-95e07ce0aa50 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:32:59.569675 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec6e3567-95e8-46f8-ae6c-95e07ce0aa50 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:32:59.570270 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec6e3567-95e8-46f8-ae6c-95e07ce0aa50 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:32:59.648297 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ec6e3567-95e8-46f8-ae6c-95e07ce0aa50 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:32:59.656550 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ec6e3567-95e8-46f8-ae6c-95e07ce0aa50 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118" status: 200 len: 1466 microversion: 2.1 time: 0.105798 Aug 07 01:32:59.658757 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2451/4562] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:59 2022] GET /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118 => generated 1466 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:33:00.002144 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a47e6056-3672-4222-ade3-0cd9fb0d4382 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:00.003009 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a47e6056-3672-4222-ade3-0cd9fb0d4382 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] [instance: 9d411485-9146-4dc0-9f22-b94251834d8b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:00.019691 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a47e6056-3672-4222-ade3-0cd9fb0d4382 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:00.023376 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a47e6056-3672-4222-ade3-0cd9fb0d4382 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:00.025365 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a47e6056-3672-4222-ade3-0cd9fb0d4382 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:00.027539 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a47e6056-3672-4222-ade3-0cd9fb0d4382 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:00.029197 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a47e6056-3672-4222-ade3-0cd9fb0d4382 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:00.032483 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a47e6056-3672-4222-ade3-0cd9fb0d4382 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:00.465062 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a47e6056-3672-4222-ade3-0cd9fb0d4382 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b06d31773ee4b9389ee2ea8a12f0f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307db42ddfad40db8c2efe752c185a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:00.477461 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a47e6056-3672-4222-ade3-0cd9fb0d4382 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] 10.222.0.39 "GET /compute/v2.1/servers/9d411485-9146-4dc0-9f22-b94251834d8b" status: 200 len: 1324 microversion: 2.1 time: 0.482091 Aug 07 01:33:00.478569 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2452/4563] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:32:59 2022] GET /compute/v2.1/servers/9d411485-9146-4dc0-9f22-b94251834d8b => generated 1324 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:33:00.485461 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-388f07f1-6c61-4aa7-9a50-8686361e01f6 req-c4249aec-8fbb-4b77-9269-5be010175b57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edea7d5b-2ad8-4b91-b389-8d3a6dd3f118", "name": "network-vif-deleted", "tag": "eea9c425-f243-40e7-b3d0-3627b460e54c"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:33:00.506722 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-388f07f1-6c61-4aa7-9a50-8686361e01f6 req-c4249aec-8fbb-4b77-9269-5be010175b57 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:00.507227 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-388f07f1-6c61-4aa7-9a50-8686361e01f6 req-c4249aec-8fbb-4b77-9269-5be010175b57 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:00.507671 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-388f07f1-6c61-4aa7-9a50-8686361e01f6 req-c4249aec-8fbb-4b77-9269-5be010175b57 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:00.554994 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-388f07f1-6c61-4aa7-9a50-8686361e01f6 req-c4249aec-8fbb-4b77-9269-5be010175b57 service nova] Creating event network-vif-deleted:eea9c425-f243-40e7-b3d0-3627b460e54c for instance edea7d5b-2ad8-4b91-b389-8d3a6dd3f118 on n-h2-master-1 Aug 07 01:33:00.574041 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-388f07f1-6c61-4aa7-9a50-8686361e01f6 req-c4249aec-8fbb-4b77-9269-5be010175b57 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093956 Aug 07 01:33:00.575273 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2453/4564] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:33:00.682605 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0a7b8f77-7400-440d-9aad-9d00c98a1454 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:00.683823 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0a7b8f77-7400-440d-9aad-9d00c98a1454 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: edea7d5b-2ad8-4b91-b389-8d3a6dd3f118] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:00.705505 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a7b8f77-7400-440d-9aad-9d00c98a1454 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:00.711174 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a7b8f77-7400-440d-9aad-9d00c98a1454 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:00.712285 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a7b8f77-7400-440d-9aad-9d00c98a1454 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:00.714482 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a7b8f77-7400-440d-9aad-9d00c98a1454 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:00.715319 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a7b8f77-7400-440d-9aad-9d00c98a1454 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:00.716007 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a7b8f77-7400-440d-9aad-9d00c98a1454 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:00.813687 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a7b8f77-7400-440d-9aad-9d00c98a1454 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:00.819271 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a7b8f77-7400-440d-9aad-9d00c98a1454 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:00.822526 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a7b8f77-7400-440d-9aad-9d00c98a1454 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:00.823166 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-0a7b8f77-7400-440d-9aad-9d00c98a1454 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lazy-loading 'fault' on Instance uuid edea7d5b-2ad8-4b91-b389-8d3a6dd3f118 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:33:00.934601 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0a7b8f77-7400-440d-9aad-9d00c98a1454 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:00.951519 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0a7b8f77-7400-440d-9aad-9d00c98a1454 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118" status: 200 len: 1305 microversion: 2.1 time: 0.273605 Aug 07 01:33:00.952380 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2454/4565] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:00 2022] GET /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118 => generated 1305 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:33:01.050129 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-ee96ead2-5347-4c31-b9a8-66f3d4822d30 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:33:01.051217 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-ee96ead2-5347-4c31-b9a8-66f3d4822d30 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:33:01.052257 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-ee96ead2-5347-4c31-b9a8-66f3d4822d30 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:33:01.052973 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-ee96ead2-5347-4c31-b9a8-66f3d4822d30 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:33:01.053488 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-ee96ead2-5347-4c31-b9a8-66f3d4822d30 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:33:01.071513 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee96ead2-5347-4c31-b9a8-66f3d4822d30 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:01.074324 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee96ead2-5347-4c31-b9a8-66f3d4822d30 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:01.074872 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee96ead2-5347-4c31-b9a8-66f3d4822d30 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:01.085070 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee96ead2-5347-4c31-b9a8-66f3d4822d30 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:01.085948 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee96ead2-5347-4c31-b9a8-66f3d4822d30 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:01.086671 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee96ead2-5347-4c31-b9a8-66f3d4822d30 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:01.132319 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-ee96ead2-5347-4c31-b9a8-66f3d4822d30 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Getting quotas for project b630a4c3bb824b90b4c1898a92b47aa7. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:33:01.161975 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-ee96ead2-5347-4c31-b9a8-66f3d4822d30 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Getting quotas for user d556a8ae0d524894a93203ce3f70d420 and project b630a4c3bb824b90b4c1898a92b47aa7. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:33:01.209878 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ee96ead2-5347-4c31-b9a8-66f3d4822d30 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:33:01.220406 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ee96ead2-5347-4c31-b9a8-66f3d4822d30 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:33:01.361887 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ee96ead2-5347-4c31-b9a8-66f3d4822d30 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.428745 Aug 07 01:33:01.369901 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2112/4566] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:32:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 2438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:33:01.374359 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3ee797e8-fdbb-4b1c-8b57-24bf8d3d339d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:01.375561 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3ee797e8-fdbb-4b1c-8b57-24bf8d3d339d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:01.457732 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3ee797e8-fdbb-4b1c-8b57-24bf8d3d339d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:01.468586 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3ee797e8-fdbb-4b1c-8b57-24bf8d3d339d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2" status: 200 len: 1242 microversion: 2.1 time: 0.097507 Aug 07 01:33:01.471002 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2455/4567] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:01 2022] GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2 => generated 1242 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:33:01.511276 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b549867d-de02-4314-bf8b-e8e8f4091721 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:01.512011 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b549867d-de02-4314-bf8b-e8e8f4091721 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] [instance: 9d411485-9146-4dc0-9f22-b94251834d8b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:01.528951 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b549867d-de02-4314-bf8b-e8e8f4091721 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:01.529453 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b549867d-de02-4314-bf8b-e8e8f4091721 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:01.539604 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b549867d-de02-4314-bf8b-e8e8f4091721 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:01.540513 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b549867d-de02-4314-bf8b-e8e8f4091721 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:01.542303 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b549867d-de02-4314-bf8b-e8e8f4091721 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:01.542769 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b549867d-de02-4314-bf8b-e8e8f4091721 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:01.980727 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4e1cd595-980f-49c9-819b-b1d81866922a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:01.981683 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4e1cd595-980f-49c9-819b-b1d81866922a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: edea7d5b-2ad8-4b91-b389-8d3a6dd3f118] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:01.992669 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4e1cd595-980f-49c9-819b-b1d81866922a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:01.993700 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4e1cd595-980f-49c9-819b-b1d81866922a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:01.994633 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4e1cd595-980f-49c9-819b-b1d81866922a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:01.996133 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4e1cd595-980f-49c9-819b-b1d81866922a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:01.996827 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4e1cd595-980f-49c9-819b-b1d81866922a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:01.997459 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4e1cd595-980f-49c9-819b-b1d81866922a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:02.050524 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-4e1cd595-980f-49c9-819b-b1d81866922a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] HTTP exception thrown: Instance edea7d5b-2ad8-4b91-b389-8d3a6dd3f118 could not be found. Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4e1cd595-980f-49c9-819b-b1d81866922a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Request method failure captured: Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118 HTTP/1.1 Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xQCEJk-j7q5GMRny_lsGnif3Sdi6J_PRK48HvBw7IFCGAd_4S8dbT6u0ir6pCNKAcDzgjJe8K3EgGxRXM_bdEmqwJ2s26cJoZ1m0Ije37wqG_FgPxW47Mp_NsDH3oUqaT1pJwDbOh-Nmz7ouIQa3E2NiKYv614rH5Vd5TuR7lUPJkQ Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 939fea7fa6ea4deda8d4fbef70a4e510 Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServerActionsTestJSON-447960584 Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/939fea7fa6ea4deda8d4fbef70a4e510"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_939fea7fa6ea4deda8d4fbef70a4e510", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/939fea7fa6ea4deda8d4fbef70a4e510"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/939fea7fa6ea4deda8d4fbef70a4e510"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServerActionsTestJSON-447960584 Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 939fea7fa6ea4deda8d4fbef70a4e510 Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServerActionsTestJSON-447960584 Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServerActionsTestJSON-447960584-project Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: ef29bd35cca547c39d76c54058d32979 Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServerActionsTestJSON-447960584-project Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: exception: Instance edea7d5b-2ad8-4b91-b389-8d3a6dd3f118 could not be found. Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'edea7d5b-2ad8-4b91-b389-8d3a6dd3f118'} Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edea7d5b-2ad8-4b91-b389-8d3a6dd3f118 could not be found. Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edea7d5b-2ad8-4b91-b389-8d3a6dd3f118 could not be found. Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:02.054841 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:33:02.060777 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:02.060777 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:02.060777 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:02.060777 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:33:02.060777 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:33:02.060777 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edea7d5b-2ad8-4b91-b389-8d3a6dd3f118 could not be found. Aug 07 01:33:02.060777 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:33:02.063553 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4e1cd595-980f-49c9-819b-b1d81866922a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Returning 404 to user: Instance edea7d5b-2ad8-4b91-b389-8d3a6dd3f118 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:33:02.075037 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4e1cd595-980f-49c9-819b-b1d81866922a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118" status: 404 len: 111 microversion: 2.1 time: 0.091408 Aug 07 01:33:02.076418 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2456/4568] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:01 2022] GET /compute/v2.1/servers/edea7d5b-2ad8-4b91-b389-8d3a6dd3f118 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:33:02.085830 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-32d5e487-371e-4218-bbd3-7d960fd3225d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:02.086661 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-32d5e487-371e-4218-bbd3-7d960fd3225d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 69381f01-4547-4f10-845d-04b426d685cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:02.097337 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32d5e487-371e-4218-bbd3-7d960fd3225d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:02.100897 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32d5e487-371e-4218-bbd3-7d960fd3225d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:02.102583 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32d5e487-371e-4218-bbd3-7d960fd3225d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:02.105485 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32d5e487-371e-4218-bbd3-7d960fd3225d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:02.106914 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32d5e487-371e-4218-bbd3-7d960fd3225d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:02.111494 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32d5e487-371e-4218-bbd3-7d960fd3225d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:02.190970 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-32d5e487-371e-4218-bbd3-7d960fd3225d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 69381f01-4547-4f10-845d-04b426d685cd] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:33:02.271020 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b549867d-de02-4314-bf8b-e8e8f4091721 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b06d31773ee4b9389ee2ea8a12f0f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307db42ddfad40db8c2efe752c185a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:02.300339 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b549867d-de02-4314-bf8b-e8e8f4091721 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] 10.222.0.39 "GET /compute/v2.1/servers/9d411485-9146-4dc0-9f22-b94251834d8b" status: 200 len: 1324 microversion: 2.1 time: 0.799648 Aug 07 01:33:02.302272 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2113/4569] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:01 2022] GET /compute/v2.1/servers/9d411485-9146-4dc0-9f22-b94251834d8b => generated 1324 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:33:02.456421 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-32d5e487-371e-4218-bbd3-7d960fd3225d tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "DELETE /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd" status: 204 len: 0 microversion: 2.1 time: 0.374621 Aug 07 01:33:02.457928 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2457/4570] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:33:02 2022] DELETE /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 07 01:33:02.466191 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bf642f81-493f-4b83-88ca-f20f6054f208 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:02.466870 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bf642f81-493f-4b83-88ca-f20f6054f208 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 69381f01-4547-4f10-845d-04b426d685cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:02.479382 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf642f81-493f-4b83-88ca-f20f6054f208 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:02.479893 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf642f81-493f-4b83-88ca-f20f6054f208 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:02.480342 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf642f81-493f-4b83-88ca-f20f6054f208 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:02.481068 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf642f81-493f-4b83-88ca-f20f6054f208 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:02.481525 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf642f81-493f-4b83-88ca-f20f6054f208 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:02.481954 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf642f81-493f-4b83-88ca-f20f6054f208 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:02.491719 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-510c805d-58c7-4406-b0d7-73b2729fde2d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:02.492462 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-510c805d-58c7-4406-b0d7-73b2729fde2d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:02.513131 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-510c805d-58c7-4406-b0d7-73b2729fde2d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:02.513634 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-510c805d-58c7-4406-b0d7-73b2729fde2d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:02.514076 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-510c805d-58c7-4406-b0d7-73b2729fde2d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:02.517132 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-510c805d-58c7-4406-b0d7-73b2729fde2d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:02.522475 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-510c805d-58c7-4406-b0d7-73b2729fde2d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:02.523136 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-510c805d-58c7-4406-b0d7-73b2729fde2d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:02.622419 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-510c805d-58c7-4406-b0d7-73b2729fde2d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:02.632988 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-510c805d-58c7-4406-b0d7-73b2729fde2d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2" status: 200 len: 1238 microversion: 2.1 time: 0.146201 Aug 07 01:33:02.644140 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2458/4571] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:02 2022] GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2 => generated 1238 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:33:02.709973 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-e3208da0-62c2-4703-8d53-3fe53e9abd4d req-a2c3868f-ced0-42ed-adbf-aed382c3c546 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d411485-9146-4dc0-9f22-b94251834d8b", "tag": "41fef98e-bd39-4c37-9882-03d8d7f12f0f"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:33:02.725660 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e3208da0-62c2-4703-8d53-3fe53e9abd4d req-a2c3868f-ced0-42ed-adbf-aed382c3c546 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:02.728251 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e3208da0-62c2-4703-8d53-3fe53e9abd4d req-a2c3868f-ced0-42ed-adbf-aed382c3c546 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:02.729222 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e3208da0-62c2-4703-8d53-3fe53e9abd4d req-a2c3868f-ced0-42ed-adbf-aed382c3c546 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:02.738061 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:02.757047 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-e3208da0-62c2-4703-8d53-3fe53e9abd4d req-a2c3868f-ced0-42ed-adbf-aed382c3c546 service nova] Creating event network-changed:41fef98e-bd39-4c37-9882-03d8d7f12f0f for instance 9d411485-9146-4dc0-9f22-b94251834d8b on n-h1-master-1 Aug 07 01:33:02.779275 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-e3208da0-62c2-4703-8d53-3fe53e9abd4d req-a2c3868f-ced0-42ed-adbf-aed382c3c546 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074269 Aug 07 01:33:02.782467 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2459/4572] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:33:03.322981 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3f5980ec-a985-4c4d-b7d0-d81aedf3102c tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:03.323693 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3f5980ec-a985-4c4d-b7d0-d81aedf3102c tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] [instance: 9d411485-9146-4dc0-9f22-b94251834d8b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:03.338096 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f5980ec-a985-4c4d-b7d0-d81aedf3102c tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:03.338915 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f5980ec-a985-4c4d-b7d0-d81aedf3102c tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:03.339643 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f5980ec-a985-4c4d-b7d0-d81aedf3102c tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:03.340775 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f5980ec-a985-4c4d-b7d0-d81aedf3102c tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:03.341680 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f5980ec-a985-4c4d-b7d0-d81aedf3102c tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:03.342286 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f5980ec-a985-4c4d-b7d0-d81aedf3102c tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:03.605256 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3f5980ec-a985-4c4d-b7d0-d81aedf3102c tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b06d31773ee4b9389ee2ea8a12f0f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307db42ddfad40db8c2efe752c185a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:03.618532 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3f5980ec-a985-4c4d-b7d0-d81aedf3102c tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] 10.222.0.39 "GET /compute/v2.1/servers/9d411485-9146-4dc0-9f22-b94251834d8b" status: 200 len: 1324 microversion: 2.1 time: 0.300717 Aug 07 01:33:03.619245 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2460/4573] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:03 2022] GET /compute/v2.1/servers/9d411485-9146-4dc0-9f22-b94251834d8b => generated 1324 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:33:03.658473 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3312018f-24ce-4d12-80c5-c903ddf2d333 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:03.659665 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3312018f-24ce-4d12-80c5-c903ddf2d333 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:03.667143 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3312018f-24ce-4d12-80c5-c903ddf2d333 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:03.668071 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3312018f-24ce-4d12-80c5-c903ddf2d333 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:03.668802 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3312018f-24ce-4d12-80c5-c903ddf2d333 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:03.670035 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3312018f-24ce-4d12-80c5-c903ddf2d333 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:03.672222 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3312018f-24ce-4d12-80c5-c903ddf2d333 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:03.672958 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3312018f-24ce-4d12-80c5-c903ddf2d333 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:03.736632 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bf642f81-493f-4b83-88ca-f20f6054f208 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:03.748390 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bf642f81-493f-4b83-88ca-f20f6054f208 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd" status: 200 len: 1495 microversion: 2.1 time: 1.285828 Aug 07 01:33:03.751122 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2114/4574] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:02 2022] GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd => generated 1495 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:33:03.817266 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3312018f-24ce-4d12-80c5-c903ddf2d333 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:03.832007 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3312018f-24ce-4d12-80c5-c903ddf2d333 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2" status: 200 len: 1302 microversion: 2.1 time: 0.178362 Aug 07 01:33:03.833412 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2461/4575] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:03 2022] GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2 => generated 1302 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:33:04.647259 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e3eff8a6-203d-4b81-ab63-c386a014b870 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:04.647989 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e3eff8a6-203d-4b81-ab63-c386a014b870 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] [instance: 9d411485-9146-4dc0-9f22-b94251834d8b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:04.668395 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3eff8a6-203d-4b81-ab63-c386a014b870 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:04.669000 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3eff8a6-203d-4b81-ab63-c386a014b870 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:04.671401 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3eff8a6-203d-4b81-ab63-c386a014b870 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:04.675442 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3eff8a6-203d-4b81-ab63-c386a014b870 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:04.679774 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3eff8a6-203d-4b81-ab63-c386a014b870 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:04.680268 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3eff8a6-203d-4b81-ab63-c386a014b870 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:04.770959 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8e3ed64c-8770-4c77-b1e0-abf1fe1b0b97 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:04.772155 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8e3ed64c-8770-4c77-b1e0-abf1fe1b0b97 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 69381f01-4547-4f10-845d-04b426d685cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:04.796736 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8e3ed64c-8770-4c77-b1e0-abf1fe1b0b97 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:04.797436 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8e3ed64c-8770-4c77-b1e0-abf1fe1b0b97 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:04.798429 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8e3ed64c-8770-4c77-b1e0-abf1fe1b0b97 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:04.799379 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:04.801466 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8e3ed64c-8770-4c77-b1e0-abf1fe1b0b97 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:04.801960 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8e3ed64c-8770-4c77-b1e0-abf1fe1b0b97 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:04.808035 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8e3ed64c-8770-4c77-b1e0-abf1fe1b0b97 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:05.163814 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8e3ed64c-8770-4c77-b1e0-abf1fe1b0b97 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:05.172312 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8e3ed64c-8770-4c77-b1e0-abf1fe1b0b97 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd" status: 200 len: 1495 microversion: 2.1 time: 0.405471 Aug 07 01:33:05.172909 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2462/4576] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:04 2022] GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd => generated 1495 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:33:05.201038 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8799678b-9a87-4e3a-b334-f80b1029ec26 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:05.201667 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8799678b-9a87-4e3a-b334-f80b1029ec26 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:05.221363 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8799678b-9a87-4e3a-b334-f80b1029ec26 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:05.221906 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8799678b-9a87-4e3a-b334-f80b1029ec26 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:05.222357 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8799678b-9a87-4e3a-b334-f80b1029ec26 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:05.223159 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8799678b-9a87-4e3a-b334-f80b1029ec26 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:05.227152 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8799678b-9a87-4e3a-b334-f80b1029ec26 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:05.228005 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8799678b-9a87-4e3a-b334-f80b1029ec26 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:05.326202 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8799678b-9a87-4e3a-b334-f80b1029ec26 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:05.334532 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8799678b-9a87-4e3a-b334-f80b1029ec26 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2" status: 200 len: 1300 microversion: 2.1 time: 0.137372 Aug 07 01:33:05.336710 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2463/4577] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:05 2022] GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2 => generated 1300 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:33:05.775364 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-67d5745a-abfe-43e3-828a-c0b4000ae867 req-cc61467a-7b93-4691-94bd-862d5adb15ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69381f01-4547-4f10-845d-04b426d685cd", "name": "network-vif-deleted", "tag": "6339ef02-96a8-47d9-8b82-d7536d6c4120"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:33:05.822652 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-67d5745a-abfe-43e3-828a-c0b4000ae867 req-cc61467a-7b93-4691-94bd-862d5adb15ea service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:05.828586 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-67d5745a-abfe-43e3-828a-c0b4000ae867 req-cc61467a-7b93-4691-94bd-862d5adb15ea service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:05.836502 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-67d5745a-abfe-43e3-828a-c0b4000ae867 req-cc61467a-7b93-4691-94bd-862d5adb15ea service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:05.882231 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-67d5745a-abfe-43e3-828a-c0b4000ae867 req-cc61467a-7b93-4691-94bd-862d5adb15ea service nova] Creating event network-vif-deleted:6339ef02-96a8-47d9-8b82-d7536d6c4120 for instance 69381f01-4547-4f10-845d-04b426d685cd on n-h2-master-1 Aug 07 01:33:05.913763 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-67d5745a-abfe-43e3-828a-c0b4000ae867 req-cc61467a-7b93-4691-94bd-862d5adb15ea service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146436 Aug 07 01:33:05.914619 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2464/4578] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:33:06.100443 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e3eff8a6-203d-4b81-ab63-c386a014b870 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b06d31773ee4b9389ee2ea8a12f0f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307db42ddfad40db8c2efe752c185a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:06.118486 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e3eff8a6-203d-4b81-ab63-c386a014b870 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] 10.222.0.39 "GET /compute/v2.1/servers/9d411485-9146-4dc0-9f22-b94251834d8b" status: 200 len: 1324 microversion: 2.1 time: 1.480280 Aug 07 01:33:06.125308 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2115/4579] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:04 2022] GET /compute/v2.1/servers/9d411485-9146-4dc0-9f22-b94251834d8b => generated 1324 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:33:06.206685 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8afeaee6-8502-45ed-a5ef-488e541f4bc5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:06.207678 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8afeaee6-8502-45ed-a5ef-488e541f4bc5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 69381f01-4547-4f10-845d-04b426d685cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:06.227345 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8afeaee6-8502-45ed-a5ef-488e541f4bc5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:06.228664 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8afeaee6-8502-45ed-a5ef-488e541f4bc5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:06.235526 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8afeaee6-8502-45ed-a5ef-488e541f4bc5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:06.236809 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8afeaee6-8502-45ed-a5ef-488e541f4bc5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:06.237306 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8afeaee6-8502-45ed-a5ef-488e541f4bc5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:06.237761 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8afeaee6-8502-45ed-a5ef-488e541f4bc5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:06.313638 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8afeaee6-8502-45ed-a5ef-488e541f4bc5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:06.315403 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8afeaee6-8502-45ed-a5ef-488e541f4bc5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:06.316092 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8afeaee6-8502-45ed-a5ef-488e541f4bc5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:06.318344 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-8afeaee6-8502-45ed-a5ef-488e541f4bc5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lazy-loading 'fault' on Instance uuid 69381f01-4547-4f10-845d-04b426d685cd {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:33:06.361704 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-58e2b988-a65e-4755-b3e4-06d65aa6f9f3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:06.362813 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-58e2b988-a65e-4755-b3e4-06d65aa6f9f3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:06.376009 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-58e2b988-a65e-4755-b3e4-06d65aa6f9f3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:06.384897 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-58e2b988-a65e-4755-b3e4-06d65aa6f9f3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:06.387873 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-58e2b988-a65e-4755-b3e4-06d65aa6f9f3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:06.392168 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8afeaee6-8502-45ed-a5ef-488e541f4bc5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:06.396983 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-58e2b988-a65e-4755-b3e4-06d65aa6f9f3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:06.397507 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-58e2b988-a65e-4755-b3e4-06d65aa6f9f3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:06.398430 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-58e2b988-a65e-4755-b3e4-06d65aa6f9f3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:06.410425 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8afeaee6-8502-45ed-a5ef-488e541f4bc5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd" status: 200 len: 1305 microversion: 2.1 time: 0.219492 Aug 07 01:33:06.416307 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2465/4580] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:06 2022] GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd => generated 1305 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:33:06.822921 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-58e2b988-a65e-4755-b3e4-06d65aa6f9f3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:06.831130 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-58e2b988-a65e-4755-b3e4-06d65aa6f9f3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2" status: 200 len: 1300 microversion: 2.1 time: 0.474404 Aug 07 01:33:06.834396 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2116/4581] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:06 2022] GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2 => generated 1300 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:33:07.150619 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-93fab0fd-f109-4480-9f47-99e86ce92c3d tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:07.154837 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-93fab0fd-f109-4480-9f47-99e86ce92c3d tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] [instance: 9d411485-9146-4dc0-9f22-b94251834d8b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:07.169808 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93fab0fd-f109-4480-9f47-99e86ce92c3d tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:07.173722 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93fab0fd-f109-4480-9f47-99e86ce92c3d tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:07.177723 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93fab0fd-f109-4480-9f47-99e86ce92c3d tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:07.178763 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93fab0fd-f109-4480-9f47-99e86ce92c3d tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:07.181432 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93fab0fd-f109-4480-9f47-99e86ce92c3d tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:07.185130 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93fab0fd-f109-4480-9f47-99e86ce92c3d tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:07.439274 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-843c8071-13dd-4eb5-8ba9-bac08f7f5a76 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:07.440703 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-843c8071-13dd-4eb5-8ba9-bac08f7f5a76 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: 69381f01-4547-4f10-845d-04b426d685cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:07.465226 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-843c8071-13dd-4eb5-8ba9-bac08f7f5a76 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:07.465652 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-843c8071-13dd-4eb5-8ba9-bac08f7f5a76 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:07.466100 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-843c8071-13dd-4eb5-8ba9-bac08f7f5a76 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:07.466836 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-843c8071-13dd-4eb5-8ba9-bac08f7f5a76 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:07.476429 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-843c8071-13dd-4eb5-8ba9-bac08f7f5a76 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:07.477037 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-843c8071-13dd-4eb5-8ba9-bac08f7f5a76 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:07.524471 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-93fab0fd-f109-4480-9f47-99e86ce92c3d tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b06d31773ee4b9389ee2ea8a12f0f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307db42ddfad40db8c2efe752c185a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:07.540916 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-93fab0fd-f109-4480-9f47-99e86ce92c3d tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] 10.222.0.39 "GET /compute/v2.1/servers/9d411485-9146-4dc0-9f22-b94251834d8b" status: 200 len: 1324 microversion: 2.1 time: 0.394560 Aug 07 01:33:07.541808 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2466/4582] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:07 2022] GET /compute/v2.1/servers/9d411485-9146-4dc0-9f22-b94251834d8b => generated 1324 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:33:07.562355 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-843c8071-13dd-4eb5-8ba9-bac08f7f5a76 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] HTTP exception thrown: Instance 69381f01-4547-4f10-845d-04b426d685cd could not be found. Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-843c8071-13dd-4eb5-8ba9-bac08f7f5a76 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Request method failure captured: Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd HTTP/1.1 Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xQCEJk-j7q5GMRny_lsGnif3Sdi6J_PRK48HvBw7IFCGAd_4S8dbT6u0ir6pCNKAcDzgjJe8K3EgGxRXM_bdEmqwJ2s26cJoZ1m0Ije37wqG_FgPxW47Mp_NsDH3oUqaT1pJwDbOh-Nmz7ouIQa3E2NiKYv614rH5Vd5TuR7lUPJkQ Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 939fea7fa6ea4deda8d4fbef70a4e510 Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServerActionsTestJSON-447960584 Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/939fea7fa6ea4deda8d4fbef70a4e510"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_939fea7fa6ea4deda8d4fbef70a4e510", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/939fea7fa6ea4deda8d4fbef70a4e510"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/939fea7fa6ea4deda8d4fbef70a4e510"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServerActionsTestJSON-447960584 Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 939fea7fa6ea4deda8d4fbef70a4e510 Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServerActionsTestJSON-447960584 Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServerActionsTestJSON-447960584-project Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: ef29bd35cca547c39d76c54058d32979 Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServerActionsTestJSON-447960584-project Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 69381f01-4547-4f10-845d-04b426d685cd could not be found. Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '69381f01-4547-4f10-845d-04b426d685cd'} Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69381f01-4547-4f10-845d-04b426d685cd could not be found. Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69381f01-4547-4f10-845d-04b426d685cd could not be found. Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:07.570448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:33:07.575328 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:07.575328 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:07.575328 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:07.575328 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:33:07.575328 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:33:07.575328 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69381f01-4547-4f10-845d-04b426d685cd could not be found. Aug 07 01:33:07.575328 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:33:07.575328 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-843c8071-13dd-4eb5-8ba9-bac08f7f5a76 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Returning 404 to user: Instance 69381f01-4547-4f10-845d-04b426d685cd could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:33:07.578599 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-843c8071-13dd-4eb5-8ba9-bac08f7f5a76 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd" status: 404 len: 111 microversion: 2.1 time: 0.138078 Aug 07 01:33:07.579268 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2117/4583] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:07 2022] GET /compute/v2.1/servers/69381f01-4547-4f10-845d-04b426d685cd => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:33:07.588940 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1bce2612-9e80-4fc1-b7d0-67fd8f9e6c70 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:07.589774 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1bce2612-9e80-4fc1-b7d0-67fd8f9e6c70 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:07.605908 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1bce2612-9e80-4fc1-b7d0-67fd8f9e6c70 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:07.611004 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1bce2612-9e80-4fc1-b7d0-67fd8f9e6c70 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:07.620534 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1bce2612-9e80-4fc1-b7d0-67fd8f9e6c70 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:07.621552 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1bce2612-9e80-4fc1-b7d0-67fd8f9e6c70 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:07.629197 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1bce2612-9e80-4fc1-b7d0-67fd8f9e6c70 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:07.629783 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1bce2612-9e80-4fc1-b7d0-67fd8f9e6c70 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:07.712506 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1bce2612-9e80-4fc1-b7d0-67fd8f9e6c70 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:33:07.855730 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2976b541-fbff-4708-9f57-1f25accd151a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:07.856448 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2976b541-fbff-4708-9f57-1f25accd151a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:07.875269 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2976b541-fbff-4708-9f57-1f25accd151a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:07.878538 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2976b541-fbff-4708-9f57-1f25accd151a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:07.882473 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2976b541-fbff-4708-9f57-1f25accd151a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:07.883964 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2976b541-fbff-4708-9f57-1f25accd151a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:07.886613 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2976b541-fbff-4708-9f57-1f25accd151a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:07.887159 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2976b541-fbff-4708-9f57-1f25accd151a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:07.903822 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1bce2612-9e80-4fc1-b7d0-67fd8f9e6c70 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 204 len: 0 microversion: 2.1 time: 0.319616 Aug 07 01:33:07.910968 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2467/4584] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:33:07 2022] DELETE /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:33:07.926172 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-71dc50b4-a7d5-4562-996a-b3825a3b4827 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:07.926895 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-71dc50b4-a7d5-4562-996a-b3825a3b4827 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:07.944883 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-71dc50b4-a7d5-4562-996a-b3825a3b4827 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:07.945460 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-71dc50b4-a7d5-4562-996a-b3825a3b4827 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:07.945924 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-71dc50b4-a7d5-4562-996a-b3825a3b4827 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:07.946672 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-71dc50b4-a7d5-4562-996a-b3825a3b4827 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:07.948102 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-71dc50b4-a7d5-4562-996a-b3825a3b4827 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:07.948562 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-71dc50b4-a7d5-4562-996a-b3825a3b4827 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:08.441434 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-71dc50b4-a7d5-4562-996a-b3825a3b4827 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:08.459758 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-71dc50b4-a7d5-4562-996a-b3825a3b4827 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1673 microversion: 2.1 time: 0.546916 Aug 07 01:33:08.462643 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2468/4585] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:07 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1673 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:33:08.571063 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6292dfa2-b84a-47b1-af4a-090c7b3bea07 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:08.583789 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6292dfa2-b84a-47b1-af4a-090c7b3bea07 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] [instance: 9d411485-9146-4dc0-9f22-b94251834d8b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:08.624396 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6292dfa2-b84a-47b1-af4a-090c7b3bea07 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:08.625198 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6292dfa2-b84a-47b1-af4a-090c7b3bea07 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:08.625753 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2976b541-fbff-4708-9f57-1f25accd151a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:08.626337 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6292dfa2-b84a-47b1-af4a-090c7b3bea07 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:08.627605 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6292dfa2-b84a-47b1-af4a-090c7b3bea07 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:08.630318 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6292dfa2-b84a-47b1-af4a-090c7b3bea07 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:08.631213 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6292dfa2-b84a-47b1-af4a-090c7b3bea07 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:08.634514 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2976b541-fbff-4708-9f57-1f25accd151a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2" status: 200 len: 1368 microversion: 2.1 time: 0.783331 Aug 07 01:33:08.639586 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2118/4586] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:07 2022] GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2 => generated 1368 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:33:09.006752 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6292dfa2-b84a-47b1-af4a-090c7b3bea07 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b06d31773ee4b9389ee2ea8a12f0f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307db42ddfad40db8c2efe752c185a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:09.018649 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6292dfa2-b84a-47b1-af4a-090c7b3bea07 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] 10.222.0.39 "GET /compute/v2.1/servers/9d411485-9146-4dc0-9f22-b94251834d8b" status: 200 len: 1324 microversion: 2.1 time: 0.454804 Aug 07 01:33:09.023966 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2469/4587] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:08 2022] GET /compute/v2.1/servers/9d411485-9146-4dc0-9f22-b94251834d8b => generated 1324 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:33:09.491901 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a5ee96fc-3dde-4cba-aa2f-ddbb75945ac0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:09.495193 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a5ee96fc-3dde-4cba-aa2f-ddbb75945ac0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:09.527182 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a5ee96fc-3dde-4cba-aa2f-ddbb75945ac0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:09.528263 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a5ee96fc-3dde-4cba-aa2f-ddbb75945ac0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:09.528880 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a5ee96fc-3dde-4cba-aa2f-ddbb75945ac0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:09.529797 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a5ee96fc-3dde-4cba-aa2f-ddbb75945ac0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:09.530923 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a5ee96fc-3dde-4cba-aa2f-ddbb75945ac0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:09.531527 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a5ee96fc-3dde-4cba-aa2f-ddbb75945ac0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:09.663771 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ab1b3efd-ea1b-4b37-9dae-6f059a915b13 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:09.664433 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ab1b3efd-ea1b-4b37-9dae-6f059a915b13 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:09.681071 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ab1b3efd-ea1b-4b37-9dae-6f059a915b13 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:09.682445 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ab1b3efd-ea1b-4b37-9dae-6f059a915b13 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:09.683006 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ab1b3efd-ea1b-4b37-9dae-6f059a915b13 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:09.684904 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ab1b3efd-ea1b-4b37-9dae-6f059a915b13 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:09.685439 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ab1b3efd-ea1b-4b37-9dae-6f059a915b13 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:09.687237 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ab1b3efd-ea1b-4b37-9dae-6f059a915b13 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:10.416431 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ab1b3efd-ea1b-4b37-9dae-6f059a915b13 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:10.439860 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ab1b3efd-ea1b-4b37-9dae-6f059a915b13 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2" status: 200 len: 1368 microversion: 2.1 time: 0.780473 Aug 07 01:33:10.444622 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2470/4588] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:09 2022] GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2 => generated 1368 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:33:10.444810 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a5ee96fc-3dde-4cba-aa2f-ddbb75945ac0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:10.465019 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-cae14122-5e10-484f-86a8-8a05f71cd3cf req-3505deed-257e-4d98-aacb-2770d8219268 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d411485-9146-4dc0-9f22-b94251834d8b", "name": "network-vif-plugged", "status": "completed", "tag": "41fef98e-bd39-4c37-9882-03d8d7f12f0f"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:33:10.468255 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a5ee96fc-3dde-4cba-aa2f-ddbb75945ac0 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1673 microversion: 2.1 time: 0.985139 Aug 07 01:33:10.471155 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2119/4589] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:09 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1673 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:33:10.497261 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5dfa824b-3bcc-4e8e-8af2-2857ca73e139 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:10.502606 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5dfa824b-3bcc-4e8e-8af2-2857ca73e139 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] [instance: 9d411485-9146-4dc0-9f22-b94251834d8b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:10.515023 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-cae14122-5e10-484f-86a8-8a05f71cd3cf req-3505deed-257e-4d98-aacb-2770d8219268 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:10.516496 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-cae14122-5e10-484f-86a8-8a05f71cd3cf req-3505deed-257e-4d98-aacb-2770d8219268 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:10.517107 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-cae14122-5e10-484f-86a8-8a05f71cd3cf req-3505deed-257e-4d98-aacb-2770d8219268 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:10.530440 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5dfa824b-3bcc-4e8e-8af2-2857ca73e139 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:10.535856 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5dfa824b-3bcc-4e8e-8af2-2857ca73e139 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:10.536656 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5dfa824b-3bcc-4e8e-8af2-2857ca73e139 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:10.537438 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5dfa824b-3bcc-4e8e-8af2-2857ca73e139 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:10.537918 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5dfa824b-3bcc-4e8e-8af2-2857ca73e139 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:10.538356 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5dfa824b-3bcc-4e8e-8af2-2857ca73e139 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:10.542372 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-cae14122-5e10-484f-86a8-8a05f71cd3cf req-3505deed-257e-4d98-aacb-2770d8219268 service nova] Creating event network-vif-plugged:41fef98e-bd39-4c37-9882-03d8d7f12f0f for instance 9d411485-9146-4dc0-9f22-b94251834d8b on n-h1-master-1 Aug 07 01:33:10.560974 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-cae14122-5e10-484f-86a8-8a05f71cd3cf req-3505deed-257e-4d98-aacb-2770d8219268 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111166 Aug 07 01:33:10.562314 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2471/4590] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:33:10.676128 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-2784a8c4-2be2-45ee-923f-73289d56bb00 req-7ed6b2c3-57a3-406e-9275-1f69e7f2342c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2778f5f5-ea59-43c9-860f-17210bcbbbd2", "tag": "5ee9e334-5554-4e37-809a-d105e888e112"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:33:10.694563 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2784a8c4-2be2-45ee-923f-73289d56bb00 req-7ed6b2c3-57a3-406e-9275-1f69e7f2342c service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:10.694963 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2784a8c4-2be2-45ee-923f-73289d56bb00 req-7ed6b2c3-57a3-406e-9275-1f69e7f2342c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:10.696347 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2784a8c4-2be2-45ee-923f-73289d56bb00 req-7ed6b2c3-57a3-406e-9275-1f69e7f2342c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:10.718358 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-2784a8c4-2be2-45ee-923f-73289d56bb00 req-7ed6b2c3-57a3-406e-9275-1f69e7f2342c service nova] Creating event network-changed:5ee9e334-5554-4e37-809a-d105e888e112 for instance 2778f5f5-ea59-43c9-860f-17210bcbbbd2 on n-h1-master-1 Aug 07 01:33:10.731924 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-2784a8c4-2be2-45ee-923f-73289d56bb00 req-7ed6b2c3-57a3-406e-9275-1f69e7f2342c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062416 Aug 07 01:33:10.735958 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2472/4591] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:33:11.097134 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=4 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:11.181006 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=14 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:11.467022 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:11.471473 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0f19d71c-7848-4ddd-bcd9-50fcc1ac610a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:11.472459 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0f19d71c-7848-4ddd-bcd9-50fcc1ac610a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:11.491939 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f19d71c-7848-4ddd-bcd9-50fcc1ac610a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:11.499793 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f19d71c-7848-4ddd-bcd9-50fcc1ac610a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:11.500777 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f19d71c-7848-4ddd-bcd9-50fcc1ac610a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:11.501751 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f19d71c-7848-4ddd-bcd9-50fcc1ac610a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:11.502450 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f19d71c-7848-4ddd-bcd9-50fcc1ac610a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:11.504045 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f19d71c-7848-4ddd-bcd9-50fcc1ac610a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:11.826279 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5dfa824b-3bcc-4e8e-8af2-2857ca73e139 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b06d31773ee4b9389ee2ea8a12f0f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307db42ddfad40db8c2efe752c185a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:11.844903 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5dfa824b-3bcc-4e8e-8af2-2857ca73e139 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] 10.222.0.39 "GET /compute/v2.1/servers/9d411485-9146-4dc0-9f22-b94251834d8b" status: 200 len: 1324 microversion: 2.1 time: 1.365672 Aug 07 01:33:11.845646 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2120/4592] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:10 2022] GET /compute/v2.1/servers/9d411485-9146-4dc0-9f22-b94251834d8b => generated 1324 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:33:11.870230 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8e20914b-71fd-4270-aea9-8a83d92b70e5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:11.870866 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8e20914b-71fd-4270-aea9-8a83d92b70e5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:11.884109 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8e20914b-71fd-4270-aea9-8a83d92b70e5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:11.884846 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8e20914b-71fd-4270-aea9-8a83d92b70e5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:11.885482 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8e20914b-71fd-4270-aea9-8a83d92b70e5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:11.888755 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8e20914b-71fd-4270-aea9-8a83d92b70e5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:11.890155 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8e20914b-71fd-4270-aea9-8a83d92b70e5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:11.890795 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8e20914b-71fd-4270-aea9-8a83d92b70e5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:12.070394 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0f19d71c-7848-4ddd-bcd9-50fcc1ac610a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:12.082761 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0f19d71c-7848-4ddd-bcd9-50fcc1ac610a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2" status: 200 len: 1368 microversion: 2.1 time: 0.616605 Aug 07 01:33:12.084147 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2473/4593] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:11 2022] GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2 => generated 1368 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:33:12.551222 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8e20914b-71fd-4270-aea9-8a83d92b70e5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:12.567351 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8e20914b-71fd-4270-aea9-8a83d92b70e5 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1673 microversion: 2.1 time: 0.705510 Aug 07 01:33:12.570573 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2121/4594] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:11 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1673 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:33:12.866360 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6b5cd08b-4b5e-4990-ba68-ff0dac3ca462 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:12.866994 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6b5cd08b-4b5e-4990-ba68-ff0dac3ca462 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] [instance: 9d411485-9146-4dc0-9f22-b94251834d8b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:12.877641 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b5cd08b-4b5e-4990-ba68-ff0dac3ca462 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:12.878135 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b5cd08b-4b5e-4990-ba68-ff0dac3ca462 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:12.878576 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b5cd08b-4b5e-4990-ba68-ff0dac3ca462 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:12.885242 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d7775b3a-9809-4e76-877e-05892eaae86e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:12.885907 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d7775b3a-9809-4e76-877e-05892eaae86e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:12.902226 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7775b3a-9809-4e76-877e-05892eaae86e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:12.906507 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b5cd08b-4b5e-4990-ba68-ff0dac3ca462 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:12.907089 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b5cd08b-4b5e-4990-ba68-ff0dac3ca462 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:12.909198 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7775b3a-9809-4e76-877e-05892eaae86e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:12.914637 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b5cd08b-4b5e-4990-ba68-ff0dac3ca462 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:12.915937 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7775b3a-9809-4e76-877e-05892eaae86e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:12.917105 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7775b3a-9809-4e76-877e-05892eaae86e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:12.917599 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7775b3a-9809-4e76-877e-05892eaae86e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:12.918040 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7775b3a-9809-4e76-877e-05892eaae86e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:12.995089 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d7775b3a-9809-4e76-877e-05892eaae86e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/ips" status: 200 len: 152 microversion: 2.20 time: 0.114910 Aug 07 01:33:12.996489 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2122/4595] 10.222.0.39 () {60 vars in 1289 bytes} [Sun Aug 7 01:33:12 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/ips => generated 152 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:33:13.105920 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ab83d0a6-409e-451e-ae02-3be1d5d88f68 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:13.106928 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ab83d0a6-409e-451e-ae02-3be1d5d88f68 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:13.117455 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab83d0a6-409e-451e-ae02-3be1d5d88f68 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:13.122803 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab83d0a6-409e-451e-ae02-3be1d5d88f68 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:13.124101 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab83d0a6-409e-451e-ae02-3be1d5d88f68 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:13.131142 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab83d0a6-409e-451e-ae02-3be1d5d88f68 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:13.131943 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab83d0a6-409e-451e-ae02-3be1d5d88f68 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:13.138891 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab83d0a6-409e-451e-ae02-3be1d5d88f68 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:13.530717 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6b5cd08b-4b5e-4990-ba68-ff0dac3ca462 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b06d31773ee4b9389ee2ea8a12f0f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307db42ddfad40db8c2efe752c185a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:13.550449 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6b5cd08b-4b5e-4990-ba68-ff0dac3ca462 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] 10.222.0.39 "GET /compute/v2.1/servers/9d411485-9146-4dc0-9f22-b94251834d8b" status: 200 len: 1520 microversion: 2.1 time: 0.678751 Aug 07 01:33:13.554870 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2474/4596] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:12 2022] GET /compute/v2.1/servers/9d411485-9146-4dc0-9f22-b94251834d8b => generated 1520 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:33:13.579561 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-67cc955e-e037-47d0-a922-0c8f9b135255 req-9caaa763-f81b-412c-8bf9-7a5fe3f271d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e39f0d23-55ab-417b-818e-92de14de44c0", "name": "network-vif-deleted", "tag": "04267581-58b6-42a6-92a4-4f79278a63aa"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:33:13.608939 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ab83d0a6-409e-451e-ae02-3be1d5d88f68 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:13.611026 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-67cc955e-e037-47d0-a922-0c8f9b135255 req-9caaa763-f81b-412c-8bf9-7a5fe3f271d1 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:13.614558 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-67cc955e-e037-47d0-a922-0c8f9b135255 req-9caaa763-f81b-412c-8bf9-7a5fe3f271d1 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:13.615717 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-67cc955e-e037-47d0-a922-0c8f9b135255 req-9caaa763-f81b-412c-8bf9-7a5fe3f271d1 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:13.617064 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ab83d0a6-409e-451e-ae02-3be1d5d88f68 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2" status: 200 len: 1368 microversion: 2.1 time: 0.515534 Aug 07 01:33:13.617653 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2123/4597] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:13 2022] GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2 => generated 1368 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:33:13.632857 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bc51f3a9-441a-4b2c-b32b-09e426719d56 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:13.640391 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bc51f3a9-441a-4b2c-b32b-09e426719d56 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:13.650310 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-67cc955e-e037-47d0-a922-0c8f9b135255 req-9caaa763-f81b-412c-8bf9-7a5fe3f271d1 service nova] Creating event network-vif-deleted:04267581-58b6-42a6-92a4-4f79278a63aa for instance e39f0d23-55ab-417b-818e-92de14de44c0 on n-h2-master-1 Aug 07 01:33:13.664326 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-67cc955e-e037-47d0-a922-0c8f9b135255 req-9caaa763-f81b-412c-8bf9-7a5fe3f271d1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103365 Aug 07 01:33:13.668152 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2475/4598] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:33:13.670023 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc51f3a9-441a-4b2c-b32b-09e426719d56 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:13.670594 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc51f3a9-441a-4b2c-b32b-09e426719d56 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:13.671043 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc51f3a9-441a-4b2c-b32b-09e426719d56 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:13.671782 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc51f3a9-441a-4b2c-b32b-09e426719d56 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:13.672281 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc51f3a9-441a-4b2c-b32b-09e426719d56 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:13.672719 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc51f3a9-441a-4b2c-b32b-09e426719d56 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:13.779959 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc51f3a9-441a-4b2c-b32b-09e426719d56 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:13.780462 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc51f3a9-441a-4b2c-b32b-09e426719d56 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:13.780910 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc51f3a9-441a-4b2c-b32b-09e426719d56 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:13.781368 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-bc51f3a9-441a-4b2c-b32b-09e426719d56 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lazy-loading 'fault' on Instance uuid e39f0d23-55ab-417b-818e-92de14de44c0 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:33:13.897022 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bc51f3a9-441a-4b2c-b32b-09e426719d56 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef29bd35cca547c39d76c54058d32979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '939fea7fa6ea4deda8d4fbef70a4e510', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:13.913631 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bc51f3a9-441a-4b2c-b32b-09e426719d56 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 200 len: 1327 microversion: 2.1 time: 0.285891 Aug 07 01:33:13.916543 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2124/4599] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:13 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 1327 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:33:13.917409 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bc63fdae-56c0-427d-ae9a-c4bd2d8d967a tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-600590092", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "13364274-84bc-4faf-89c7-d9dfb647f995"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bc63fdae-56c0-427d-ae9a-c4bd2d8d967a tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Request method failure captured: Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 242 Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xY_r2bZGRrTCX7Ql24Dpr_MeTck7LEn-DFJm8OHYwTyHdgmSALqCaoBqr9FvpS38yarP1tVohknqwsrEG7s3ZB-wYzHRNrsxI3XkXFaUVJ7AH836uN7CJLxeSkR8ag9yDVQP2nyhhT1-O1puxEtrCA3zPOuYUHNatcU7H-ptJqKjaI Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 307db42ddfad40db8c2efe752c185a84 Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-65452944 Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/307db42ddfad40db8c2efe752c185a84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_307db42ddfad40db8c2efe752c185a84", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/307db42ddfad40db8c2efe752c185a84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/307db42ddfad40db8c2efe752c185a84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-65452944 Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 307db42ddfad40db8c2efe752c185a84 Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-65452944 Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServerMetadataNegativeTestJSON-65452944-project Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 1b06d31773ee4b9389ee2ea8a12f0f29 Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-65452944-project Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-600590092", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "13364274-84bc-4faf-89c7-d9dfb647f995"}]}} Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-600590092', 'imageRef': 'e825bd61-bf05-4bd4-aa72-78daf2231731', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '13364274-84bc-4faf-89c7-d9dfb647f995'}]}}} Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:33:13.926805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:33:13.931495 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:33:13.931495 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:33:13.931495 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:33:13.931495 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:33:13.931495 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:33:13.931495 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:33:13.931495 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 07 01:33:13.931495 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:33:13.931495 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:13.931495 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:33:13.931495 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:13.931495 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:13.931495 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:13.931495 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:33:13.931495 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:33:13.931495 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 07 01:33:13.931495 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:33:13.939394 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bc63fdae-56c0-427d-ae9a-c4bd2d8d967a tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:33:13.940557 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bc63fdae-56c0-427d-ae9a-c4bd2d8d967a tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.028878 Aug 07 01:33:13.944461 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2476/4600] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:33:13 2022] POST /compute/v2.1/servers => generated 175 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 07 01:33:13.959086 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5d3983c2-806c-4b74-a0e7-5c19a6091224 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:13.959771 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5d3983c2-806c-4b74-a0e7-5c19a6091224 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] [instance: e3768dfb-1f4d-4237-a858-f15f3b1f168d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:13.984642 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-5d3983c2-806c-4b74-a0e7-5c19a6091224 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] HTTP exception thrown: Instance e3768dfb-1f4d-4237-a858-f15f3b1f168d could not be found. Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5d3983c2-806c-4b74-a0e7-5c19a6091224 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Request method failure captured: Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/e3768dfb-1f4d-4237-a858-f15f3b1f168d/metadata HTTP/1.1 Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xY_r2bZGRrTCX7Ql24Dpr_MeTck7LEn-DFJm8OHYwTyHdgmSALqCaoBqr9FvpS38yarP1tVohknqwsrEG7s3ZB-wYzHRNrsxI3XkXFaUVJ7AH836uN7CJLxeSkR8ag9yDVQP2nyhhT1-O1puxEtrCA3zPOuYUHNatcU7H-ptJqKjaI Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 307db42ddfad40db8c2efe752c185a84 Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-65452944 Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/307db42ddfad40db8c2efe752c185a84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_307db42ddfad40db8c2efe752c185a84", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/307db42ddfad40db8c2efe752c185a84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/307db42ddfad40db8c2efe752c185a84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-65452944 Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 307db42ddfad40db8c2efe752c185a84 Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-65452944 Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServerMetadataNegativeTestJSON-65452944-project Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 1b06d31773ee4b9389ee2ea8a12f0f29 Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-65452944-project Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: exception: Instance e3768dfb-1f4d-4237-a858-f15f3b1f168d could not be found. Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: action_args: {'server_id': 'e3768dfb-1f4d-4237-a858-f15f3b1f168d'} Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3768dfb-1f4d-4237-a858-f15f3b1f168d could not be found. Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3768dfb-1f4d-4237-a858-f15f3b1f168d could not be found. Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:14.002032 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:14.006116 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:33:14.006116 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:33:14.006116 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3768dfb-1f4d-4237-a858-f15f3b1f168d could not be found. Aug 07 01:33:14.006116 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:33:14.006116 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5d3983c2-806c-4b74-a0e7-5c19a6091224 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Returning 404 to user: Instance e3768dfb-1f4d-4237-a858-f15f3b1f168d could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:33:14.006116 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5d3983c2-806c-4b74-a0e7-5c19a6091224 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] 10.222.0.39 "GET /compute/v2.1/servers/e3768dfb-1f4d-4237-a858-f15f3b1f168d/metadata" status: 404 len: 111 microversion: 2.1 time: 0.051190 Aug 07 01:33:14.016574 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2125/4601] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Aug 7 01:33:13 2022] GET /compute/v2.1/servers/e3768dfb-1f4d-4237-a858-f15f3b1f168d/metadata => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:33:14.149096 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-350b102d-0983-44d5-a348-c314b82eff91 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1450704670", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "13364274-84bc-4faf-89c7-d9dfb647f995"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-350b102d-0983-44d5-a348-c314b82eff91 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Request method failure captured: Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 499 Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xY_r2bZGRrTCX7Ql24Dpr_MeTck7LEn-DFJm8OHYwTyHdgmSALqCaoBqr9FvpS38yarP1tVohknqwsrEG7s3ZB-wYzHRNrsxI3XkXFaUVJ7AH836uN7CJLxeSkR8ag9yDVQP2nyhhT1-O1puxEtrCA3zPOuYUHNatcU7H-ptJqKjaI Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 307db42ddfad40db8c2efe752c185a84 Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-65452944 Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/307db42ddfad40db8c2efe752c185a84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_307db42ddfad40db8c2efe752c185a84", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/307db42ddfad40db8c2efe752c185a84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/307db42ddfad40db8c2efe752c185a84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-65452944 Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 307db42ddfad40db8c2efe752c185a84 Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-65452944 Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServerMetadataNegativeTestJSON-65452944-project Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 1b06d31773ee4b9389ee2ea8a12f0f29 Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-65452944-project Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1450704670", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "13364274-84bc-4faf-89c7-d9dfb647f995"}]}} Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1450704670', 'imageRef': 'e825bd61-bf05-4bd4-aa72-78daf2231731', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '13364274-84bc-4faf-89c7-d9dfb647f995'}]}}} Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 07 01:33:14.155021 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 07 01:33:14.158559 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 07 01:33:14.158559 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:33:14.158559 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 07 01:33:14.158559 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 07 01:33:14.158559 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:33:14.158559 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:14.158559 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:33:14.158559 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:14.158559 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:14.158559 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:14.158559 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:33:14.158559 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:33:14.158559 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:33:14.158559 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:33:14.158559 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:33:14.158559 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:33:14.158559 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:33:14.158559 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:33:14.158559 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:33:14.158559 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:33:14.158559 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:33:14.158559 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:33:14.158559 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 07 01:33:14.158559 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:33:14.158559 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:14.158559 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:33:14.158559 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:14.158559 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:14.158559 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:14.158559 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:33:14.158559 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:33:14.158559 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 07 01:33:14.158559 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:33:14.171461 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-350b102d-0983-44d5-a348-c314b82eff91 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:33:14.174227 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-350b102d-0983-44d5-a348-c314b82eff91 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.031590 Aug 07 01:33:14.183114 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2477/4602] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:33:14 2022] POST /compute/v2.1/servers => generated 687 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:33:14.336366 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-391f1405-076a-42f0-8c6a-96d2ac61ba3a tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1316273480", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "13364274-84bc-4faf-89c7-d9dfb647f995"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-391f1405-076a-42f0-8c6a-96d2ac61ba3a tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Request method failure captured: Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 500 Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xY_r2bZGRrTCX7Ql24Dpr_MeTck7LEn-DFJm8OHYwTyHdgmSALqCaoBqr9FvpS38yarP1tVohknqwsrEG7s3ZB-wYzHRNrsxI3XkXFaUVJ7AH836uN7CJLxeSkR8ag9yDVQP2nyhhT1-O1puxEtrCA3zPOuYUHNatcU7H-ptJqKjaI Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 307db42ddfad40db8c2efe752c185a84 Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-65452944 Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/307db42ddfad40db8c2efe752c185a84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_307db42ddfad40db8c2efe752c185a84", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/307db42ddfad40db8c2efe752c185a84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/307db42ddfad40db8c2efe752c185a84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-65452944 Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 307db42ddfad40db8c2efe752c185a84 Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-65452944 Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServerMetadataNegativeTestJSON-65452944-project Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 1b06d31773ee4b9389ee2ea8a12f0f29 Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-65452944-project Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1316273480", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "13364274-84bc-4faf-89c7-d9dfb647f995"}]}} Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1316273480', 'imageRef': 'e825bd61-bf05-4bd4-aa72-78daf2231731', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '13364274-84bc-4faf-89c7-d9dfb647f995'}]}}} Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 07 01:33:14.342063 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 07 01:33:14.346185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 07 01:33:14.346185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:33:14.346185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 07 01:33:14.346185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 07 01:33:14.346185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:33:14.346185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:14.346185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:33:14.346185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:14.346185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:14.346185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:14.346185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:33:14.346185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:33:14.346185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:33:14.346185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:33:14.346185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:33:14.346185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:33:14.346185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:33:14.346185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:33:14.346185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:33:14.346185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:33:14.346185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:33:14.346185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:33:14.346185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 07 01:33:14.346185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:33:14.346185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:14.346185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:33:14.346185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:14.346185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:14.346185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:14.346185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:33:14.346185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:33:14.346185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 07 01:33:14.346185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:33:14.351307 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-391f1405-076a-42f0-8c6a-96d2ac61ba3a tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:33:14.352425 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-391f1405-076a-42f0-8c6a-96d2ac61ba3a tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.020653 Aug 07 01:33:14.357999 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2126/4603] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:33:14 2022] POST /compute/v2.1/servers => generated 689 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:33:14.494710 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-105b26c1-039a-4277-a634-54ac7cf83b66 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1100011534", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "13364274-84bc-4faf-89c7-d9dfb647f995"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-105b26c1-039a-4277-a634-54ac7cf83b66 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Request method failure captured: Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 754 Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xY_r2bZGRrTCX7Ql24Dpr_MeTck7LEn-DFJm8OHYwTyHdgmSALqCaoBqr9FvpS38yarP1tVohknqwsrEG7s3ZB-wYzHRNrsxI3XkXFaUVJ7AH836uN7CJLxeSkR8ag9yDVQP2nyhhT1-O1puxEtrCA3zPOuYUHNatcU7H-ptJqKjaI Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 307db42ddfad40db8c2efe752c185a84 Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-65452944 Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/307db42ddfad40db8c2efe752c185a84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_307db42ddfad40db8c2efe752c185a84", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/307db42ddfad40db8c2efe752c185a84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/307db42ddfad40db8c2efe752c185a84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-65452944 Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 307db42ddfad40db8c2efe752c185a84 Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-65452944 Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServerMetadataNegativeTestJSON-65452944-project Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 1b06d31773ee4b9389ee2ea8a12f0f29 Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-65452944-project Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1100011534", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "13364274-84bc-4faf-89c7-d9dfb647f995"}]}} Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1100011534', 'imageRef': 'e825bd61-bf05-4bd4-aa72-78daf2231731', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '13364274-84bc-4faf-89c7-d9dfb647f995'}]}}} Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:33:14.513412 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:33:14.517034 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:33:14.517034 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 07 01:33:14.517034 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:33:14.517034 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 07 01:33:14.517034 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 07 01:33:14.517034 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 07 01:33:14.517034 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 07 01:33:14.517034 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 07 01:33:14.517034 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:33:14.517034 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 07 01:33:14.517034 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 07 01:33:14.517034 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:33:14.517034 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:14.517034 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:33:14.517034 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:14.517034 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:14.517034 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:14.517034 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:33:14.517034 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:33:14.517034 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:33:14.517034 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:33:14.517034 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:33:14.517034 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:33:14.517034 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:33:14.517034 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:33:14.517034 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:33:14.517034 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:33:14.517034 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:33:14.517034 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:33:14.517034 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 07 01:33:14.517034 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:33:14.517034 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:14.517034 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:33:14.517034 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:14.517034 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:14.517034 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:14.517034 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:33:14.517034 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:33:14.520035 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 07 01:33:14.520035 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:33:14.526299 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-105b26c1-039a-4277-a634-54ac7cf83b66 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:33:14.533575 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-105b26c1-039a-4277-a634-54ac7cf83b66 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.044166 Aug 07 01:33:14.534321 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2478/4604] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:33:14 2022] POST /compute/v2.1/servers => generated 1197 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 07 01:33:14.644936 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f2a479ab-2813-4010-99a2-efec9e832a1e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:14.646828 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f2a479ab-2813-4010-99a2-efec9e832a1e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:14.647504 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5f106cec-b29c-4002-b145-c23f2dc195b2 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1406930731", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "13364274-84bc-4faf-89c7-d9dfb647f995"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:33:14.665032 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5f106cec-b29c-4002-b145-c23f2dc195b2 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Request method failure captured: Aug 07 01:33:14.665032 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 07 01:33:14.665032 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:33:14.665032 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:33:14.665032 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:33:14.665032 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 1266 Aug 07 01:33:14.665032 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:33:14.665032 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:33:14.665032 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:33:14.665032 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:33:14.665032 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xY_r2bZGRrTCX7Ql24Dpr_MeTck7LEn-DFJm8OHYwTyHdgmSALqCaoBqr9FvpS38yarP1tVohknqwsrEG7s3ZB-wYzHRNrsxI3XkXFaUVJ7AH836uN7CJLxeSkR8ag9yDVQP2nyhhT1-O1puxEtrCA3zPOuYUHNatcU7H-ptJqKjaI Aug 07 01:33:14.665032 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:33:14.665032 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:33:14.665032 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:33:14.665032 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:33:14.665032 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:33:14.665032 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:33:14.665032 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 307db42ddfad40db8c2efe752c185a84 Aug 07 01:33:14.665032 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-65452944 Aug 07 01:33:14.665032 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:33:14.665032 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:33:14.665032 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/307db42ddfad40db8c2efe752c185a84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_307db42ddfad40db8c2efe752c185a84", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/307db42ddfad40db8c2efe752c185a84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/307db42ddfad40db8c2efe752c185a84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:33:14.665032 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-65452944 Aug 07 01:33:14.665032 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 307db42ddfad40db8c2efe752c185a84 Aug 07 01:33:14.665032 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-65452944 Aug 07 01:33:14.665032 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServerMetadataNegativeTestJSON-65452944-project Aug 07 01:33:14.665032 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:33:14.665032 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:33:14.665032 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 1b06d31773ee4b9389ee2ea8a12f0f29 Aug 07 01:33:14.665032 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-65452944-project Aug 07 01:33:14.665032 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:33:14.665032 n-d-master-1 devstack@n-api.service[119517]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1406930731", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "13364274-84bc-4faf-89c7-d9dfb647f995"}]}} Aug 07 01:33:14.665032 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:33:14.667439 n-d-master-1 devstack@n-api.service[119517]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 07 01:33:14.667439 n-d-master-1 devstack@n-api.service[119517]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1406930731', 'imageRef': 'e825bd61-bf05-4bd4-aa72-78daf2231731', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '13364274-84bc-4faf-89c7-d9dfb647f995'}]}}} Aug 07 01:33:14.667439 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:33:14.667439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:14.667439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:33:14.667439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:33:14.667439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:33:14.667439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:33:14.667439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 07 01:33:14.667439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:33:14.667439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 07 01:33:14.667439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 07 01:33:14.667439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 07 01:33:14.667439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 07 01:33:14.667439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 07 01:33:14.667439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:33:14.667439 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 07 01:33:14.668950 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 07 01:33:14.668950 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:33:14.668950 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:14.668950 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:33:14.668950 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:14.668950 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:14.668950 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:14.668950 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:33:14.668950 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:33:14.668950 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:33:14.668950 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:33:14.668950 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:33:14.668950 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:33:14.668950 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:33:14.668950 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:33:14.668950 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:33:14.668950 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:33:14.668950 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:33:14.668950 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:33:14.668950 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 07 01:33:14.668950 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:33:14.668950 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:14.668950 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:33:14.668950 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:14.668950 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:14.668950 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:14.668950 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:33:14.668950 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:33:14.671460 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 07 01:33:14.671460 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:33:14.671460 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5f106cec-b29c-4002-b145-c23f2dc195b2 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:33:14.671460 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5f106cec-b29c-4002-b145-c23f2dc195b2 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.035060 Aug 07 01:33:14.673555 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2a479ab-2813-4010-99a2-efec9e832a1e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:14.674176 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2a479ab-2813-4010-99a2-efec9e832a1e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:14.674638 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2a479ab-2813-4010-99a2-efec9e832a1e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:14.675408 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2a479ab-2813-4010-99a2-efec9e832a1e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:14.675907 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2a479ab-2813-4010-99a2-efec9e832a1e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:14.676350 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2a479ab-2813-4010-99a2-efec9e832a1e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:14.677627 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2127/4605] 10.222.0.39 () {60 vars in 1148 bytes} [Sun Aug 7 01:33:14 2022] POST /compute/v2.1/servers => generated 2221 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 07 01:33:14.691021 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ff01d69f-c954-4e5d-b45a-f6246df9677f tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:14.691730 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ff01d69f-c954-4e5d-b45a-f6246df9677f tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] [instance: e130966b-d754-4284-a5f4-42e1b9d51777] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:14.717764 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-ff01d69f-c954-4e5d-b45a-f6246df9677f tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] HTTP exception thrown: Instance e130966b-d754-4284-a5f4-42e1b9d51777 could not be found. Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ff01d69f-c954-4e5d-b45a-f6246df9677f tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Request method failure captured: Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/e130966b-d754-4284-a5f4-42e1b9d51777/metadata/test2 HTTP/1.1 Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xY_r2bZGRrTCX7Ql24Dpr_MeTck7LEn-DFJm8OHYwTyHdgmSALqCaoBqr9FvpS38yarP1tVohknqwsrEG7s3ZB-wYzHRNrsxI3XkXFaUVJ7AH836uN7CJLxeSkR8ag9yDVQP2nyhhT1-O1puxEtrCA3zPOuYUHNatcU7H-ptJqKjaI Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 307db42ddfad40db8c2efe752c185a84 Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-65452944 Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/307db42ddfad40db8c2efe752c185a84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_307db42ddfad40db8c2efe752c185a84", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/307db42ddfad40db8c2efe752c185a84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/307db42ddfad40db8c2efe752c185a84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-65452944 Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 307db42ddfad40db8c2efe752c185a84 Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-65452944 Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServerMetadataNegativeTestJSON-65452944-project Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 1b06d31773ee4b9389ee2ea8a12f0f29 Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-65452944-project Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: exception: Instance e130966b-d754-4284-a5f4-42e1b9d51777 could not be found. Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: action_args: {'server_id': 'e130966b-d754-4284-a5f4-42e1b9d51777', 'id': 'test2'} Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e130966b-d754-4284-a5f4-42e1b9d51777 could not be found. Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e130966b-d754-4284-a5f4-42e1b9d51777 could not be found. Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:14.725721 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:14.730320 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:33:14.730320 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:33:14.730320 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e130966b-d754-4284-a5f4-42e1b9d51777 could not be found. Aug 07 01:33:14.730320 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:33:14.731112 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ff01d69f-c954-4e5d-b45a-f6246df9677f tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Returning 404 to user: Instance e130966b-d754-4284-a5f4-42e1b9d51777 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:33:14.732287 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ff01d69f-c954-4e5d-b45a-f6246df9677f tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] 10.222.0.39 "GET /compute/v2.1/servers/e130966b-d754-4284-a5f4-42e1b9d51777/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.053564 Aug 07 01:33:14.733495 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2128/4606] 10.222.0.39 () {58 vars in 1281 bytes} [Sun Aug 7 01:33:14 2022] GET /compute/v2.1/servers/e130966b-d754-4284-a5f4-42e1b9d51777/metadata/test2 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:33:14.750498 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-36681c53-43d9-4205-abfb-a36775ae4bfe tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:14.751000 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-36681c53-43d9-4205-abfb-a36775ae4bfe tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] [instance: 9d411485-9146-4dc0-9f22-b94251834d8b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:14.760271 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36681c53-43d9-4205-abfb-a36775ae4bfe tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:14.760767 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36681c53-43d9-4205-abfb-a36775ae4bfe tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:14.761208 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36681c53-43d9-4205-abfb-a36775ae4bfe tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:14.761997 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36681c53-43d9-4205-abfb-a36775ae4bfe tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:14.762461 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36681c53-43d9-4205-abfb-a36775ae4bfe tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:14.762893 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36681c53-43d9-4205-abfb-a36775ae4bfe tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:14.802348 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-36681c53-43d9-4205-abfb-a36775ae4bfe tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] [instance: 9d411485-9146-4dc0-9f22-b94251834d8b] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:33:14.973325 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-36681c53-43d9-4205-abfb-a36775ae4bfe tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9d411485-9146-4dc0-9f22-b94251834d8b" status: 204 len: 0 microversion: 2.1 time: 0.229419 Aug 07 01:33:14.975682 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2129/4607] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:33:14 2022] DELETE /compute/v2.1/servers/9d411485-9146-4dc0-9f22-b94251834d8b => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 07 01:33:14.987403 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d8b5a1f2-f1dc-4561-a32d-4bdda36c3be3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:14.993881 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d8b5a1f2-f1dc-4561-a32d-4bdda36c3be3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] [instance: e39f0d23-55ab-417b-818e-92de14de44c0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:15.001584 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d8b5a1f2-f1dc-4561-a32d-4bdda36c3be3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:15.002329 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d8b5a1f2-f1dc-4561-a32d-4bdda36c3be3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:15.003045 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d8b5a1f2-f1dc-4561-a32d-4bdda36c3be3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:15.003964 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d8b5a1f2-f1dc-4561-a32d-4bdda36c3be3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:15.004674 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d8b5a1f2-f1dc-4561-a32d-4bdda36c3be3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:15.005570 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d8b5a1f2-f1dc-4561-a32d-4bdda36c3be3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:15.024936 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-d8b5a1f2-f1dc-4561-a32d-4bdda36c3be3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] HTTP exception thrown: Instance e39f0d23-55ab-417b-818e-92de14de44c0 could not be found. Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d8b5a1f2-f1dc-4561-a32d-4bdda36c3be3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Request method failure captured: Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 HTTP/1.1 Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xQCEJk-j7q5GMRny_lsGnif3Sdi6J_PRK48HvBw7IFCGAd_4S8dbT6u0ir6pCNKAcDzgjJe8K3EgGxRXM_bdEmqwJ2s26cJoZ1m0Ije37wqG_FgPxW47Mp_NsDH3oUqaT1pJwDbOh-Nmz7ouIQa3E2NiKYv614rH5Vd5TuR7lUPJkQ Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 939fea7fa6ea4deda8d4fbef70a4e510 Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServerActionsTestJSON-447960584 Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/939fea7fa6ea4deda8d4fbef70a4e510"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_939fea7fa6ea4deda8d4fbef70a4e510", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/939fea7fa6ea4deda8d4fbef70a4e510"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/939fea7fa6ea4deda8d4fbef70a4e510"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServerActionsTestJSON-447960584 Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 939fea7fa6ea4deda8d4fbef70a4e510 Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServerActionsTestJSON-447960584 Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServerActionsTestJSON-447960584-project Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: ef29bd35cca547c39d76c54058d32979 Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServerActionsTestJSON-447960584-project Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: exception: Instance e39f0d23-55ab-417b-818e-92de14de44c0 could not be found. Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'e39f0d23-55ab-417b-818e-92de14de44c0'} Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e39f0d23-55ab-417b-818e-92de14de44c0 could not be found. Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e39f0d23-55ab-417b-818e-92de14de44c0 could not be found. Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:15.033069 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:33:15.037747 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:15.037747 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:15.037747 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:15.037747 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:33:15.037747 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:33:15.037747 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e39f0d23-55ab-417b-818e-92de14de44c0 could not be found. Aug 07 01:33:15.037747 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:33:15.039196 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d8b5a1f2-f1dc-4561-a32d-4bdda36c3be3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Returning 404 to user: Instance e39f0d23-55ab-417b-818e-92de14de44c0 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:33:15.040339 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d8b5a1f2-f1dc-4561-a32d-4bdda36c3be3 tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0" status: 404 len: 111 microversion: 2.1 time: 0.059889 Aug 07 01:33:15.041460 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2130/4608] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:14 2022] GET /compute/v2.1/servers/e39f0d23-55ab-417b-818e-92de14de44c0 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:33:15.047283 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2f84cddf-cee7-483c-8b9d-75ed2aa85a9f tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:15.048123 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2f84cddf-cee7-483c-8b9d-75ed2aa85a9f tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] [instance: 9d411485-9146-4dc0-9f22-b94251834d8b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:15.054912 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f84cddf-cee7-483c-8b9d-75ed2aa85a9f tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:15.055641 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f84cddf-cee7-483c-8b9d-75ed2aa85a9f tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:15.056402 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f84cddf-cee7-483c-8b9d-75ed2aa85a9f tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:15.057472 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f84cddf-cee7-483c-8b9d-75ed2aa85a9f tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:15.058104 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f84cddf-cee7-483c-8b9d-75ed2aa85a9f tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:15.059450 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f84cddf-cee7-483c-8b9d-75ed2aa85a9f tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:15.398303 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f2a479ab-2813-4010-99a2-efec9e832a1e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:15.410861 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f2a479ab-2813-4010-99a2-efec9e832a1e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2" status: 200 len: 1368 microversion: 2.1 time: 0.771534 Aug 07 01:33:15.416569 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2f84cddf-cee7-483c-8b9d-75ed2aa85a9f tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b06d31773ee4b9389ee2ea8a12f0f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307db42ddfad40db8c2efe752c185a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:15.425934 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2479/4609] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:14 2022] GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2 => generated 1368 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:33:15.427704 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2f84cddf-cee7-483c-8b9d-75ed2aa85a9f tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] 10.222.0.39 "GET /compute/v2.1/servers/9d411485-9146-4dc0-9f22-b94251834d8b" status: 200 len: 1526 microversion: 2.1 time: 0.384548 Aug 07 01:33:15.429192 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2131/4610] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:15 2022] GET /compute/v2.1/servers/9d411485-9146-4dc0-9f22-b94251834d8b => generated 1526 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:33:15.442636 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-69b26ce0-bc0e-4579-b3b5-59097801c77a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] Calling method '.version_select at 0x7f9e24900e50>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:15.497975 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-69b26ce0-bc0e-4579-b3b5-59097801c77a tempest-ServerActionsTestJSON-447960584 tempest-ServerActionsTestJSON-447960584-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-514522053" status: 202 len: 0 microversion: 2.1 time: 0.070360 Aug 07 01:33:15.498882 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2480/4611] 10.222.0.39 () {58 vars in 1218 bytes} [Sun Aug 7 01:33:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-514522053 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:33:16.433894 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fc16641d-e4b6-497f-b68d-6c76bf231288 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:16.434543 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fc16641d-e4b6-497f-b68d-6c76bf231288 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:16.454234 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fc16641d-e4b6-497f-b68d-6c76bf231288 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:16.454736 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fc16641d-e4b6-497f-b68d-6c76bf231288 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:16.455177 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fc16641d-e4b6-497f-b68d-6c76bf231288 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:16.455995 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fc16641d-e4b6-497f-b68d-6c76bf231288 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:16.456373 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fc16641d-e4b6-497f-b68d-6c76bf231288 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:16.462829 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fc16641d-e4b6-497f-b68d-6c76bf231288 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:16.463499 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-95d92608-4d3d-4bee-bdb1-4a3f157730e1 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:16.464414 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-95d92608-4d3d-4bee-bdb1-4a3f157730e1 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] [instance: 9d411485-9146-4dc0-9f22-b94251834d8b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:16.482884 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-95d92608-4d3d-4bee-bdb1-4a3f157730e1 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:16.488486 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-95d92608-4d3d-4bee-bdb1-4a3f157730e1 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:16.489118 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-95d92608-4d3d-4bee-bdb1-4a3f157730e1 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:16.492264 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-95d92608-4d3d-4bee-bdb1-4a3f157730e1 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:16.495063 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-95d92608-4d3d-4bee-bdb1-4a3f157730e1 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:16.495757 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-95d92608-4d3d-4bee-bdb1-4a3f157730e1 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:16.521559 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:17.107318 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fc16641d-e4b6-497f-b68d-6c76bf231288 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:17.114099 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-95d92608-4d3d-4bee-bdb1-4a3f157730e1 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b06d31773ee4b9389ee2ea8a12f0f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307db42ddfad40db8c2efe752c185a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:17.120794 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fc16641d-e4b6-497f-b68d-6c76bf231288 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2" status: 200 len: 1368 microversion: 2.1 time: 0.691436 Aug 07 01:33:17.122363 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2132/4612] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:16 2022] GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2 => generated 1368 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:33:17.132384 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fded76c8-9294-4509-99f3-580e9f5906d4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:33:17.133423 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fded76c8-9294-4509-99f3-580e9f5906d4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:17.134918 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-95d92608-4d3d-4bee-bdb1-4a3f157730e1 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] 10.222.0.39 "GET /compute/v2.1/servers/9d411485-9146-4dc0-9f22-b94251834d8b" status: 200 len: 1526 microversion: 2.1 time: 0.688409 Aug 07 01:33:17.137922 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2481/4613] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:16 2022] GET /compute/v2.1/servers/9d411485-9146-4dc0-9f22-b94251834d8b => generated 1526 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:33:17.142198 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fded76c8-9294-4509-99f3-580e9f5906d4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:17.143392 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fded76c8-9294-4509-99f3-580e9f5906d4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:17.144022 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fded76c8-9294-4509-99f3-580e9f5906d4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:17.144899 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fded76c8-9294-4509-99f3-580e9f5906d4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:17.145514 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fded76c8-9294-4509-99f3-580e9f5906d4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:17.146122 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fded76c8-9294-4509-99f3-580e9f5906d4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:17.199552 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-fded76c8-9294-4509-99f3-580e9f5906d4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lazy-loading 'flavor' on Instance uuid 4071f699-43c7-4c36-ada4-8f0dceb6cc91 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:33:17.364726 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:17.718053 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fded76c8-9294-4509-99f3-580e9f5906d4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "POST /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/action" status: 202 len: 0 microversion: 2.20 time: 0.588756 Aug 07 01:33:17.720894 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2133/4614] 10.222.0.39 () {62 vars in 1319 bytes} [Sun Aug 7 01:33:17 2022] POST /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/action => generated 0 bytes in 596 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:33:17.728874 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3e9646be-c2d1-48e6-b800-4e5066591f50 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:17.729806 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3e9646be-c2d1-48e6-b800-4e5066591f50 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:17.745672 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e9646be-c2d1-48e6-b800-4e5066591f50 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:17.750303 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e9646be-c2d1-48e6-b800-4e5066591f50 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:17.750880 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e9646be-c2d1-48e6-b800-4e5066591f50 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:17.758692 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e9646be-c2d1-48e6-b800-4e5066591f50 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:17.762988 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e9646be-c2d1-48e6-b800-4e5066591f50 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:17.763552 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e9646be-c2d1-48e6-b800-4e5066591f50 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:17.803206 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-dcd2d34c-41d2-41dc-8be1-88d224dbe884 req-3671e964-76de-470a-862f-e80bf76254dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d411485-9146-4dc0-9f22-b94251834d8b", "name": "network-vif-deleted", "tag": "41fef98e-bd39-4c37-9882-03d8d7f12f0f"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:33:17.839118 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:17.845918 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-dcd2d34c-41d2-41dc-8be1-88d224dbe884 req-3671e964-76de-470a-862f-e80bf76254dd service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:17.849621 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-dcd2d34c-41d2-41dc-8be1-88d224dbe884 req-3671e964-76de-470a-862f-e80bf76254dd service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:17.850493 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-dcd2d34c-41d2-41dc-8be1-88d224dbe884 req-3671e964-76de-470a-862f-e80bf76254dd service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:17.883587 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-dcd2d34c-41d2-41dc-8be1-88d224dbe884 req-3671e964-76de-470a-862f-e80bf76254dd service nova] Creating event network-vif-deleted:41fef98e-bd39-4c37-9882-03d8d7f12f0f for instance 9d411485-9146-4dc0-9f22-b94251834d8b on n-h1-master-1 Aug 07 01:33:17.929585 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-dcd2d34c-41d2-41dc-8be1-88d224dbe884 req-3671e964-76de-470a-862f-e80bf76254dd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134162 Aug 07 01:33:17.937634 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2134/4615] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:33:18.012820 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-c28522a9-8989-4e5c-9c25-66d7aaf81e0d req-93b91db9-9220-4339-af3c-d780b6aea28c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2778f5f5-ea59-43c9-860f-17210bcbbbd2", "name": "network-vif-plugged", "status": "completed", "tag": "5ee9e334-5554-4e37-809a-d105e888e112"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:33:18.042643 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c28522a9-8989-4e5c-9c25-66d7aaf81e0d req-93b91db9-9220-4339-af3c-d780b6aea28c service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:18.043577 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c28522a9-8989-4e5c-9c25-66d7aaf81e0d req-93b91db9-9220-4339-af3c-d780b6aea28c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:18.044128 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c28522a9-8989-4e5c-9c25-66d7aaf81e0d req-93b91db9-9220-4339-af3c-d780b6aea28c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:18.060560 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-c28522a9-8989-4e5c-9c25-66d7aaf81e0d req-93b91db9-9220-4339-af3c-d780b6aea28c service nova] Creating event network-vif-plugged:5ee9e334-5554-4e37-809a-d105e888e112 for instance 2778f5f5-ea59-43c9-860f-17210bcbbbd2 on n-h1-master-1 Aug 07 01:33:18.069565 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-c28522a9-8989-4e5c-9c25-66d7aaf81e0d req-93b91db9-9220-4339-af3c-d780b6aea28c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062547 Aug 07 01:33:18.077483 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2135/4616] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:33:18.145737 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a2853c5f-c7b4-45b8-8e44-778587bb25ee tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:18.146781 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a2853c5f-c7b4-45b8-8e44-778587bb25ee tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:18.168186 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2853c5f-c7b4-45b8-8e44-778587bb25ee tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:18.172131 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2853c5f-c7b4-45b8-8e44-778587bb25ee tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:18.173191 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2853c5f-c7b4-45b8-8e44-778587bb25ee tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:18.176534 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2853c5f-c7b4-45b8-8e44-778587bb25ee tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:18.179630 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2853c5f-c7b4-45b8-8e44-778587bb25ee tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:18.183846 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2853c5f-c7b4-45b8-8e44-778587bb25ee tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:18.281068 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3e9646be-c2d1-48e6-b800-4e5066591f50 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:18.298100 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3e9646be-c2d1-48e6-b800-4e5066591f50 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:18.303133 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3e9646be-c2d1-48e6-b800-4e5066591f50 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:18.304941 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3e9646be-c2d1-48e6-b800-4e5066591f50 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1723 microversion: 2.20 time: 0.579853 Aug 07 01:33:18.316671 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2482/4617] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:33:17 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1723 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:33:18.324137 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fbddaf9b-1912-4df3-9670-0146fd319635 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:18.328936 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fbddaf9b-1912-4df3-9670-0146fd319635 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] [instance: 9d411485-9146-4dc0-9f22-b94251834d8b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:18.340439 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fbddaf9b-1912-4df3-9670-0146fd319635 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:18.343771 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fbddaf9b-1912-4df3-9670-0146fd319635 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:18.345298 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fbddaf9b-1912-4df3-9670-0146fd319635 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:18.346190 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fbddaf9b-1912-4df3-9670-0146fd319635 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:18.348758 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fbddaf9b-1912-4df3-9670-0146fd319635 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:18.349348 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fbddaf9b-1912-4df3-9670-0146fd319635 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:18.407874 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a2853c5f-c7b4-45b8-8e44-778587bb25ee tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:18.421805 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a2853c5f-c7b4-45b8-8e44-778587bb25ee tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2" status: 200 len: 1368 microversion: 2.1 time: 0.282834 Aug 07 01:33:18.426553 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2136/4618] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:18 2022] GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2 => generated 1368 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:33:18.486445 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fbddaf9b-1912-4df3-9670-0146fd319635 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:18.490023 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fbddaf9b-1912-4df3-9670-0146fd319635 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:18.492377 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fbddaf9b-1912-4df3-9670-0146fd319635 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:18.492812 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-fbddaf9b-1912-4df3-9670-0146fd319635 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lazy-loading 'fault' on Instance uuid 9d411485-9146-4dc0-9f22-b94251834d8b {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:33:18.909471 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fbddaf9b-1912-4df3-9670-0146fd319635 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b06d31773ee4b9389ee2ea8a12f0f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307db42ddfad40db8c2efe752c185a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:18.922036 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fbddaf9b-1912-4df3-9670-0146fd319635 tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] 10.222.0.39 "GET /compute/v2.1/servers/9d411485-9146-4dc0-9f22-b94251834d8b" status: 200 len: 1314 microversion: 2.1 time: 0.603904 Aug 07 01:33:18.922634 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2483/4619] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:18 2022] GET /compute/v2.1/servers/9d411485-9146-4dc0-9f22-b94251834d8b => generated 1314 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:33:19.343088 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8caba1db-0dab-4376-bb7f-e811fd6024f5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:19.343688 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8caba1db-0dab-4376-bb7f-e811fd6024f5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:19.361476 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8caba1db-0dab-4376-bb7f-e811fd6024f5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:19.362273 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8caba1db-0dab-4376-bb7f-e811fd6024f5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:19.363258 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8caba1db-0dab-4376-bb7f-e811fd6024f5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:19.364189 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8caba1db-0dab-4376-bb7f-e811fd6024f5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:19.364827 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8caba1db-0dab-4376-bb7f-e811fd6024f5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:19.365432 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8caba1db-0dab-4376-bb7f-e811fd6024f5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:19.446686 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-93e8f47d-bf19-4308-8fb1-555f089db79d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:19.447515 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-93e8f47d-bf19-4308-8fb1-555f089db79d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:19.457727 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93e8f47d-bf19-4308-8fb1-555f089db79d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:19.458460 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93e8f47d-bf19-4308-8fb1-555f089db79d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:19.460382 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93e8f47d-bf19-4308-8fb1-555f089db79d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:19.461280 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93e8f47d-bf19-4308-8fb1-555f089db79d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:19.469221 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93e8f47d-bf19-4308-8fb1-555f089db79d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:19.470208 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93e8f47d-bf19-4308-8fb1-555f089db79d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:20.106727 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-93e8f47d-bf19-4308-8fb1-555f089db79d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:20.137778 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8caba1db-0dab-4376-bb7f-e811fd6024f5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:20.143856 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-93e8f47d-bf19-4308-8fb1-555f089db79d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2" status: 200 len: 1368 microversion: 2.1 time: 0.700680 Aug 07 01:33:20.144531 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2484/4620] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:19 2022] GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2 => generated 1368 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:33:20.155531 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8caba1db-0dab-4376-bb7f-e811fd6024f5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:20.157315 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8caba1db-0dab-4376-bb7f-e811fd6024f5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:20.169031 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7b0c9145-2aab-4cc4-ba29-7fce800f987f tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:20.173598 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8caba1db-0dab-4376-bb7f-e811fd6024f5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1723 microversion: 2.20 time: 0.834565 Aug 07 01:33:20.174643 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2137/4621] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:33:19 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1723 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:33:20.196877 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7b0c9145-2aab-4cc4-ba29-7fce800f987f tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] [instance: 9d411485-9146-4dc0-9f22-b94251834d8b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:20.225951 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b0c9145-2aab-4cc4-ba29-7fce800f987f tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:20.226844 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b0c9145-2aab-4cc4-ba29-7fce800f987f tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:20.227655 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b0c9145-2aab-4cc4-ba29-7fce800f987f tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:20.231241 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b0c9145-2aab-4cc4-ba29-7fce800f987f tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:20.233345 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b0c9145-2aab-4cc4-ba29-7fce800f987f tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:20.235146 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b0c9145-2aab-4cc4-ba29-7fce800f987f tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:20.286908 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-7b0c9145-2aab-4cc4-ba29-7fce800f987f tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] HTTP exception thrown: Instance 9d411485-9146-4dc0-9f22-b94251834d8b could not be found. Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7b0c9145-2aab-4cc4-ba29-7fce800f987f tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Request method failure captured: Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/9d411485-9146-4dc0-9f22-b94251834d8b HTTP/1.1 Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xY_r2bZGRrTCX7Ql24Dpr_MeTck7LEn-DFJm8OHYwTyHdgmSALqCaoBqr9FvpS38yarP1tVohknqwsrEG7s3ZB-wYzHRNrsxI3XkXFaUVJ7AH836uN7CJLxeSkR8ag9yDVQP2nyhhT1-O1puxEtrCA3zPOuYUHNatcU7H-ptJqKjaI Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 307db42ddfad40db8c2efe752c185a84 Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-65452944 Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/307db42ddfad40db8c2efe752c185a84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_307db42ddfad40db8c2efe752c185a84", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/307db42ddfad40db8c2efe752c185a84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/307db42ddfad40db8c2efe752c185a84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-65452944 Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 307db42ddfad40db8c2efe752c185a84 Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-65452944 Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServerMetadataNegativeTestJSON-65452944-project Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 1b06d31773ee4b9389ee2ea8a12f0f29 Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-65452944-project Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 9d411485-9146-4dc0-9f22-b94251834d8b could not be found. Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '9d411485-9146-4dc0-9f22-b94251834d8b'} Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d411485-9146-4dc0-9f22-b94251834d8b could not be found. Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d411485-9146-4dc0-9f22-b94251834d8b could not be found. Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:33:20.292641 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:33:20.297661 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:33:20.297661 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:33:20.297661 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:33:20.297661 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:33:20.297661 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:33:20.297661 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:33:20.297661 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d411485-9146-4dc0-9f22-b94251834d8b could not be found. Aug 07 01:33:20.297661 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:33:20.301132 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7b0c9145-2aab-4cc4-ba29-7fce800f987f tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] Returning 404 to user: Instance 9d411485-9146-4dc0-9f22-b94251834d8b could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:33:20.306734 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7b0c9145-2aab-4cc4-ba29-7fce800f987f tempest-ServerMetadataNegativeTestJSON-65452944 tempest-ServerMetadataNegativeTestJSON-65452944-project] 10.222.0.39 "GET /compute/v2.1/servers/9d411485-9146-4dc0-9f22-b94251834d8b" status: 404 len: 111 microversion: 2.1 time: 0.161083 Aug 07 01:33:20.307953 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2485/4622] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:20 2022] GET /compute/v2.1/servers/9d411485-9146-4dc0-9f22-b94251834d8b => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:33:21.170874 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-40cd2ff6-940a-4cc7-a66e-610ec4c6432e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:21.171416 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-40cd2ff6-940a-4cc7-a66e-610ec4c6432e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:21.184623 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-40cd2ff6-940a-4cc7-a66e-610ec4c6432e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:21.185136 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-40cd2ff6-940a-4cc7-a66e-610ec4c6432e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:21.185556 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-40cd2ff6-940a-4cc7-a66e-610ec4c6432e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:21.186319 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-40cd2ff6-940a-4cc7-a66e-610ec4c6432e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:21.186777 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-40cd2ff6-940a-4cc7-a66e-610ec4c6432e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:21.187220 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-40cd2ff6-940a-4cc7-a66e-610ec4c6432e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:21.219494 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f25e7aa8-0920-4f7f-8815-ccbb1f16e745 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:21.220793 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f25e7aa8-0920-4f7f-8815-ccbb1f16e745 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:21.236528 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f25e7aa8-0920-4f7f-8815-ccbb1f16e745 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:21.237304 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f25e7aa8-0920-4f7f-8815-ccbb1f16e745 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:21.237921 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f25e7aa8-0920-4f7f-8815-ccbb1f16e745 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:21.238827 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f25e7aa8-0920-4f7f-8815-ccbb1f16e745 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:21.239518 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f25e7aa8-0920-4f7f-8815-ccbb1f16e745 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:21.243169 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f25e7aa8-0920-4f7f-8815-ccbb1f16e745 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:21.957921 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f25e7aa8-0920-4f7f-8815-ccbb1f16e745 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:21.979191 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f25e7aa8-0920-4f7f-8815-ccbb1f16e745 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:21.994373 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f25e7aa8-0920-4f7f-8815-ccbb1f16e745 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:21.995750 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f25e7aa8-0920-4f7f-8815-ccbb1f16e745 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1723 microversion: 2.20 time: 0.780943 Aug 07 01:33:22.009676 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2486/4623] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:33:21 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1723 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:33:22.271983 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-40cd2ff6-940a-4cc7-a66e-610ec4c6432e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:22.288271 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-40cd2ff6-940a-4cc7-a66e-610ec4c6432e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2" status: 200 len: 1557 microversion: 2.1 time: 1.120440 Aug 07 01:33:22.309977 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2138/4624] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:21 2022] GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2 => generated 1557 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:33:22.314219 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5feb3c8b-07bd-4c73-8ca7-d1a3b0de5ca3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:22.314739 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5feb3c8b-07bd-4c73-8ca7-d1a3b0de5ca3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:22.334704 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5feb3c8b-07bd-4c73-8ca7-d1a3b0de5ca3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:22.335799 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5feb3c8b-07bd-4c73-8ca7-d1a3b0de5ca3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:22.336877 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5feb3c8b-07bd-4c73-8ca7-d1a3b0de5ca3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:22.339408 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5feb3c8b-07bd-4c73-8ca7-d1a3b0de5ca3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:22.340250 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5feb3c8b-07bd-4c73-8ca7-d1a3b0de5ca3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:22.340949 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5feb3c8b-07bd-4c73-8ca7-d1a3b0de5ca3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:22.558022 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5feb3c8b-07bd-4c73-8ca7-d1a3b0de5ca3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.248465 Aug 07 01:33:22.558999 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2487/4625] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Aug 7 01:33:22 2022] GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2/os-interface => generated 284 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:33:23.057578 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e574aa74-a3a2-42fa-9f90-b9ddcad2e10b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:23.057578 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e574aa74-a3a2-42fa-9f90-b9ddcad2e10b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:23.082894 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e574aa74-a3a2-42fa-9f90-b9ddcad2e10b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:23.086147 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e574aa74-a3a2-42fa-9f90-b9ddcad2e10b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:23.089450 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e574aa74-a3a2-42fa-9f90-b9ddcad2e10b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:23.094282 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e574aa74-a3a2-42fa-9f90-b9ddcad2e10b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:23.106214 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e574aa74-a3a2-42fa-9f90-b9ddcad2e10b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:23.107167 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e574aa74-a3a2-42fa-9f90-b9ddcad2e10b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:24.084274 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e574aa74-a3a2-42fa-9f90-b9ddcad2e10b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:24.093339 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e574aa74-a3a2-42fa-9f90-b9ddcad2e10b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:24.094944 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e574aa74-a3a2-42fa-9f90-b9ddcad2e10b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:24.099402 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e574aa74-a3a2-42fa-9f90-b9ddcad2e10b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1723 microversion: 2.20 time: 1.048243 Aug 07 01:33:24.100172 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2139/4626] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:33:23 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1723 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:33:25.148328 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5f9cc564-ea2d-418a-be18-64b4eab3b354 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:25.149244 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5f9cc564-ea2d-418a-be18-64b4eab3b354 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:25.162103 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f9cc564-ea2d-418a-be18-64b4eab3b354 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:25.162606 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f9cc564-ea2d-418a-be18-64b4eab3b354 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:25.163053 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f9cc564-ea2d-418a-be18-64b4eab3b354 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:25.163791 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f9cc564-ea2d-418a-be18-64b4eab3b354 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:25.171396 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f9cc564-ea2d-418a-be18-64b4eab3b354 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:25.171860 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f9cc564-ea2d-418a-be18-64b4eab3b354 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:25.534005 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5f9cc564-ea2d-418a-be18-64b4eab3b354 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:25.563849 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5f9cc564-ea2d-418a-be18-64b4eab3b354 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:25.566497 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5f9cc564-ea2d-418a-be18-64b4eab3b354 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:25.568182 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5f9cc564-ea2d-418a-be18-64b4eab3b354 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1723 microversion: 2.20 time: 0.425850 Aug 07 01:33:25.569248 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2488/4627] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:33:25 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1723 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:33:26.596267 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6d8901b9-c98f-49e8-b5e6-a8e6909416e8 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:26.596897 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6d8901b9-c98f-49e8-b5e6-a8e6909416e8 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:26.617969 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6d8901b9-c98f-49e8-b5e6-a8e6909416e8 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:26.620899 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6d8901b9-c98f-49e8-b5e6-a8e6909416e8 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:26.621362 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6d8901b9-c98f-49e8-b5e6-a8e6909416e8 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:26.622304 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6d8901b9-c98f-49e8-b5e6-a8e6909416e8 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:26.622782 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6d8901b9-c98f-49e8-b5e6-a8e6909416e8 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:26.634559 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6d8901b9-c98f-49e8-b5e6-a8e6909416e8 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:26.807344 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-671e8ad4-fafe-48c2-844b-db88fb0354cc req-4621bc1b-a2ba-4cd0-a6e7-613d046b8e0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2778f5f5-ea59-43c9-860f-17210bcbbbd2", "tag": "5ee9e334-5554-4e37-809a-d105e888e112"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:33:26.818562 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:26.826828 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-671e8ad4-fafe-48c2-844b-db88fb0354cc req-4621bc1b-a2ba-4cd0-a6e7-613d046b8e0c service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:26.827481 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-671e8ad4-fafe-48c2-844b-db88fb0354cc req-4621bc1b-a2ba-4cd0-a6e7-613d046b8e0c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:26.828066 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-671e8ad4-fafe-48c2-844b-db88fb0354cc req-4621bc1b-a2ba-4cd0-a6e7-613d046b8e0c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:26.845956 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-671e8ad4-fafe-48c2-844b-db88fb0354cc req-4621bc1b-a2ba-4cd0-a6e7-613d046b8e0c service nova] Creating event network-changed:5ee9e334-5554-4e37-809a-d105e888e112 for instance 2778f5f5-ea59-43c9-860f-17210bcbbbd2 on n-h1-master-1 Aug 07 01:33:26.853595 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-671e8ad4-fafe-48c2-844b-db88fb0354cc req-4621bc1b-a2ba-4cd0-a6e7-613d046b8e0c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049827 Aug 07 01:33:26.854928 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2489/4628] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:33:28.240035 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6d8901b9-c98f-49e8-b5e6-a8e6909416e8 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:28.259364 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6d8901b9-c98f-49e8-b5e6-a8e6909416e8 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:28.272411 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6d8901b9-c98f-49e8-b5e6-a8e6909416e8 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:28.273758 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6d8901b9-c98f-49e8-b5e6-a8e6909416e8 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1723 microversion: 2.20 time: 1.682043 Aug 07 01:33:28.274679 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2140/4629] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:33:26 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1723 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:33:29.330921 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ac272c5b-0ccf-4b0e-8bd3-1c554ad8548c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:29.331647 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ac272c5b-0ccf-4b0e-8bd3-1c554ad8548c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:29.367754 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac272c5b-0ccf-4b0e-8bd3-1c554ad8548c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:29.368768 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac272c5b-0ccf-4b0e-8bd3-1c554ad8548c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:29.369234 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac272c5b-0ccf-4b0e-8bd3-1c554ad8548c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:29.370157 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac272c5b-0ccf-4b0e-8bd3-1c554ad8548c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:29.376019 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac272c5b-0ccf-4b0e-8bd3-1c554ad8548c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:29.376486 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac272c5b-0ccf-4b0e-8bd3-1c554ad8548c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:30.026503 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ac272c5b-0ccf-4b0e-8bd3-1c554ad8548c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:30.067204 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ac272c5b-0ccf-4b0e-8bd3-1c554ad8548c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:30.072723 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ac272c5b-0ccf-4b0e-8bd3-1c554ad8548c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:30.078806 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ac272c5b-0ccf-4b0e-8bd3-1c554ad8548c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1723 microversion: 2.20 time: 0.761306 Aug 07 01:33:30.083324 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2490/4630] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:33:29 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1723 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:33:31.113244 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0411f8c0-e3d5-48bb-8a1e-fc2ffef32027 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:31.114111 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0411f8c0-e3d5-48bb-8a1e-fc2ffef32027 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:31.135002 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0411f8c0-e3d5-48bb-8a1e-fc2ffef32027 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:31.135517 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0411f8c0-e3d5-48bb-8a1e-fc2ffef32027 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:31.197386 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0411f8c0-e3d5-48bb-8a1e-fc2ffef32027 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:31.198322 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0411f8c0-e3d5-48bb-8a1e-fc2ffef32027 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:31.200270 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0411f8c0-e3d5-48bb-8a1e-fc2ffef32027 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:31.201541 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0411f8c0-e3d5-48bb-8a1e-fc2ffef32027 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:31.952525 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0411f8c0-e3d5-48bb-8a1e-fc2ffef32027 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:32.011990 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0411f8c0-e3d5-48bb-8a1e-fc2ffef32027 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:32.023968 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0411f8c0-e3d5-48bb-8a1e-fc2ffef32027 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:32.030083 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0411f8c0-e3d5-48bb-8a1e-fc2ffef32027 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1723 microversion: 2.20 time: 0.927483 Aug 07 01:33:32.032938 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2141/4631] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:33:31 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1723 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:33:33.073485 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-67dfdbde-2f1b-46f7-a7eb-42a67a5f5b8e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:33.074308 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-67dfdbde-2f1b-46f7-a7eb-42a67a5f5b8e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:33.098657 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67dfdbde-2f1b-46f7-a7eb-42a67a5f5b8e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:33.099627 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67dfdbde-2f1b-46f7-a7eb-42a67a5f5b8e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:33.100111 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67dfdbde-2f1b-46f7-a7eb-42a67a5f5b8e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:33.100946 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67dfdbde-2f1b-46f7-a7eb-42a67a5f5b8e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:33.101415 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67dfdbde-2f1b-46f7-a7eb-42a67a5f5b8e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:33.101853 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67dfdbde-2f1b-46f7-a7eb-42a67a5f5b8e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:34.366645 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-67dfdbde-2f1b-46f7-a7eb-42a67a5f5b8e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:34.387253 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-67dfdbde-2f1b-46f7-a7eb-42a67a5f5b8e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:34.392951 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-67dfdbde-2f1b-46f7-a7eb-42a67a5f5b8e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:34.397140 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-67dfdbde-2f1b-46f7-a7eb-42a67a5f5b8e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1723 microversion: 2.20 time: 1.328001 Aug 07 01:33:34.404553 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2491/4632] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:33:33 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1723 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:33:35.432204 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8ebd6c7c-0de1-4e51-a36a-db54e97ac16b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:35.432795 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8ebd6c7c-0de1-4e51-a36a-db54e97ac16b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:35.446268 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8ebd6c7c-0de1-4e51-a36a-db54e97ac16b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:35.446777 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8ebd6c7c-0de1-4e51-a36a-db54e97ac16b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:35.448944 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8ebd6c7c-0de1-4e51-a36a-db54e97ac16b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:35.449726 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8ebd6c7c-0de1-4e51-a36a-db54e97ac16b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:35.450582 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8ebd6c7c-0de1-4e51-a36a-db54e97ac16b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:35.451302 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8ebd6c7c-0de1-4e51-a36a-db54e97ac16b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:36.737602 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8ebd6c7c-0de1-4e51-a36a-db54e97ac16b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:36.753011 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8ebd6c7c-0de1-4e51-a36a-db54e97ac16b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:36.759448 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8ebd6c7c-0de1-4e51-a36a-db54e97ac16b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:36.768814 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8ebd6c7c-0de1-4e51-a36a-db54e97ac16b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1744 microversion: 2.20 time: 1.337476 Aug 07 01:33:36.772555 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2142/4633] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:33:35 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1744 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:33:36.993824 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2783ab36-f383-453e-931d-87910039f29e tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1522660443", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": "none"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:33:37.113094 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-2783ab36-f383-453e-931d-87910039f29e tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:33:37.118174 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-2783ab36-f383-453e-931d-87910039f29e tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:33:37.123066 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-2783ab36-f383-453e-931d-87910039f29e tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:33:37.123998 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-2783ab36-f383-453e-931d-87910039f29e tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:33:37.130849 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-2783ab36-f383-453e-931d-87910039f29e tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:33:37.150126 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2783ab36-f383-453e-931d-87910039f29e tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:37.153919 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2783ab36-f383-453e-931d-87910039f29e tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:37.156440 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2783ab36-f383-453e-931d-87910039f29e tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:37.157449 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2783ab36-f383-453e-931d-87910039f29e tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:37.158163 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2783ab36-f383-453e-931d-87910039f29e tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:37.159783 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2783ab36-f383-453e-931d-87910039f29e tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:37.211752 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-2783ab36-f383-453e-931d-87910039f29e tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Getting quotas for project 859b28071c284ab292ba507e96df8d3f. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:33:37.223946 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-2783ab36-f383-453e-931d-87910039f29e tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Getting quotas for user 0a3d46fd03134a16becae95c52ea0b55 and project 859b28071c284ab292ba507e96df8d3f. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:33:37.258678 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2783ab36-f383-453e-931d-87910039f29e tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:33:37.261230 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2783ab36-f383-453e-931d-87910039f29e tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] [instance: f9f5819b-6f54-4981-a640-53651d3416ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:33:37.354313 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2783ab36-f383-453e-931d-87910039f29e tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.680606 Aug 07 01:33:37.354979 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2492/4634] 10.222.0.39 () {62 vars in 1188 bytes} [Sun Aug 7 01:33:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 07 01:33:37.382337 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5118e57d-382e-4323-8e94-f39f29675e61 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:37.387064 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5118e57d-382e-4323-8e94-f39f29675e61 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] [instance: f9f5819b-6f54-4981-a640-53651d3416ba] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:37.746436 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5118e57d-382e-4323-8e94-f39f29675e61 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:37.761846 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5118e57d-382e-4323-8e94-f39f29675e61 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:37.771864 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5118e57d-382e-4323-8e94-f39f29675e61 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:37.774384 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5118e57d-382e-4323-8e94-f39f29675e61 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] 10.222.0.39 "GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba" status: 200 len: 1278 microversion: 2.54 time: 0.409609 Aug 07 01:33:37.775492 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2143/4635] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:33:37 2022] GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba => generated 1278 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:33:37.798575 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cc78af82-e4d2-4e7e-a60e-6b52cef9db3c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:37.799200 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cc78af82-e4d2-4e7e-a60e-6b52cef9db3c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:37.826254 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc78af82-e4d2-4e7e-a60e-6b52cef9db3c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:37.826707 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc78af82-e4d2-4e7e-a60e-6b52cef9db3c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:37.827152 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc78af82-e4d2-4e7e-a60e-6b52cef9db3c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:37.828165 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc78af82-e4d2-4e7e-a60e-6b52cef9db3c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:37.828623 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc78af82-e4d2-4e7e-a60e-6b52cef9db3c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:37.829224 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc78af82-e4d2-4e7e-a60e-6b52cef9db3c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:38.511777 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cc78af82-e4d2-4e7e-a60e-6b52cef9db3c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:38.521005 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cc78af82-e4d2-4e7e-a60e-6b52cef9db3c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:38.522533 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cc78af82-e4d2-4e7e-a60e-6b52cef9db3c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:38.523749 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cc78af82-e4d2-4e7e-a60e-6b52cef9db3c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1739 microversion: 2.20 time: 0.729153 Aug 07 01:33:38.532026 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2493/4636] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:33:37 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1739 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:33:38.815004 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b5b88692-b88b-44db-bda5-f145faaba384 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:38.815837 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b5b88692-b88b-44db-bda5-f145faaba384 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] [instance: f9f5819b-6f54-4981-a640-53651d3416ba] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:38.834290 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5b88692-b88b-44db-bda5-f145faaba384 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:38.834849 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5b88692-b88b-44db-bda5-f145faaba384 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:38.835299 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5b88692-b88b-44db-bda5-f145faaba384 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:38.841999 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5b88692-b88b-44db-bda5-f145faaba384 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:38.843129 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5b88692-b88b-44db-bda5-f145faaba384 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:38.846482 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5b88692-b88b-44db-bda5-f145faaba384 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:39.357960 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b5b88692-b88b-44db-bda5-f145faaba384 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:39.366835 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b5b88692-b88b-44db-bda5-f145faaba384 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:39.378712 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b5b88692-b88b-44db-bda5-f145faaba384 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:39.390852 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b5b88692-b88b-44db-bda5-f145faaba384 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] 10.222.0.39 "GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba" status: 200 len: 1282 microversion: 2.54 time: 0.587849 Aug 07 01:33:39.397835 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2144/4637] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:33:38 2022] GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba => generated 1282 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:33:39.551788 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-776fe72f-547e-4e40-9762-59b0d25c571a tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:39.552555 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-776fe72f-547e-4e40-9762-59b0d25c571a tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:39.578206 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-776fe72f-547e-4e40-9762-59b0d25c571a tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:39.584412 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-776fe72f-547e-4e40-9762-59b0d25c571a tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:39.587480 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-776fe72f-547e-4e40-9762-59b0d25c571a tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:39.588495 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-776fe72f-547e-4e40-9762-59b0d25c571a tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:39.589004 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-776fe72f-547e-4e40-9762-59b0d25c571a tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:39.589424 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-776fe72f-547e-4e40-9762-59b0d25c571a tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:40.414473 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0b8a2fdf-472e-406b-bb64-263ad8d86c36 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:40.415681 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0b8a2fdf-472e-406b-bb64-263ad8d86c36 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] [instance: f9f5819b-6f54-4981-a640-53651d3416ba] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:40.427722 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b8a2fdf-472e-406b-bb64-263ad8d86c36 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:40.432353 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b8a2fdf-472e-406b-bb64-263ad8d86c36 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:40.433028 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b8a2fdf-472e-406b-bb64-263ad8d86c36 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:40.433939 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b8a2fdf-472e-406b-bb64-263ad8d86c36 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:40.439306 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b8a2fdf-472e-406b-bb64-263ad8d86c36 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:40.439990 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b8a2fdf-472e-406b-bb64-263ad8d86c36 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:40.593419 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-776fe72f-547e-4e40-9762-59b0d25c571a tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:40.605966 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-776fe72f-547e-4e40-9762-59b0d25c571a tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:40.607763 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-776fe72f-547e-4e40-9762-59b0d25c571a tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:40.612407 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-776fe72f-547e-4e40-9762-59b0d25c571a tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1739 microversion: 2.20 time: 1.061140 Aug 07 01:33:40.621153 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2494/4638] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:33:39 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1739 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:33:40.816788 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0b8a2fdf-472e-406b-bb64-263ad8d86c36 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:40.831223 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0b8a2fdf-472e-406b-bb64-263ad8d86c36 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:40.836940 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0b8a2fdf-472e-406b-bb64-263ad8d86c36 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:40.838168 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0b8a2fdf-472e-406b-bb64-263ad8d86c36 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] 10.222.0.39 "GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba" status: 200 len: 1336 microversion: 2.54 time: 0.427673 Aug 07 01:33:40.838748 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2145/4639] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:33:40 2022] GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba => generated 1336 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:33:41.438580 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-b706dbef-da15-4357-8f22-0ec3f0b6bdc1 req-536f9dd7-983e-4e40-8277-0b2b44237f99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4071f699-43c7-4c36-ada4-8f0dceb6cc91", "name": "network-vif-plugged", "status": "completed", "tag": "a4d2050c-f5b0-4218-a72d-272334938cd5"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:33:41.485072 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b706dbef-da15-4357-8f22-0ec3f0b6bdc1 req-536f9dd7-983e-4e40-8277-0b2b44237f99 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:41.485557 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b706dbef-da15-4357-8f22-0ec3f0b6bdc1 req-536f9dd7-983e-4e40-8277-0b2b44237f99 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:41.490274 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b706dbef-da15-4357-8f22-0ec3f0b6bdc1 req-536f9dd7-983e-4e40-8277-0b2b44237f99 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:41.545165 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-b706dbef-da15-4357-8f22-0ec3f0b6bdc1 req-536f9dd7-983e-4e40-8277-0b2b44237f99 service nova] Creating event network-vif-plugged:a4d2050c-f5b0-4218-a72d-272334938cd5 for instance 4071f699-43c7-4c36-ada4-8f0dceb6cc91 on n-h2-master-1 Aug 07 01:33:41.555443 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-b706dbef-da15-4357-8f22-0ec3f0b6bdc1 req-536f9dd7-983e-4e40-8277-0b2b44237f99 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121447 Aug 07 01:33:41.557174 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2495/4640] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:33:41.642953 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-33916d57-88c6-49f5-bbc0-d2443c931438 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:41.644145 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-33916d57-88c6-49f5-bbc0-d2443c931438 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:41.666189 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-33916d57-88c6-49f5-bbc0-d2443c931438 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:41.671169 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-33916d57-88c6-49f5-bbc0-d2443c931438 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:41.672166 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-33916d57-88c6-49f5-bbc0-d2443c931438 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:41.682354 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-33916d57-88c6-49f5-bbc0-d2443c931438 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:41.682863 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-33916d57-88c6-49f5-bbc0-d2443c931438 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:41.683312 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-33916d57-88c6-49f5-bbc0-d2443c931438 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:41.878167 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1517a778-6b21-4f7a-83c7-fbc1386e78f3 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:41.879499 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1517a778-6b21-4f7a-83c7-fbc1386e78f3 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] [instance: f9f5819b-6f54-4981-a640-53651d3416ba] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:41.893750 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1517a778-6b21-4f7a-83c7-fbc1386e78f3 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:41.896087 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1517a778-6b21-4f7a-83c7-fbc1386e78f3 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:41.897568 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1517a778-6b21-4f7a-83c7-fbc1386e78f3 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:41.898503 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1517a778-6b21-4f7a-83c7-fbc1386e78f3 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:41.902189 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1517a778-6b21-4f7a-83c7-fbc1386e78f3 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:41.908479 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1517a778-6b21-4f7a-83c7-fbc1386e78f3 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:42.122882 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1517a778-6b21-4f7a-83c7-fbc1386e78f3 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:42.142837 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1517a778-6b21-4f7a-83c7-fbc1386e78f3 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:42.145029 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1517a778-6b21-4f7a-83c7-fbc1386e78f3 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:42.146292 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1517a778-6b21-4f7a-83c7-fbc1386e78f3 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] 10.222.0.39 "GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba" status: 200 len: 1336 microversion: 2.54 time: 0.273062 Aug 07 01:33:42.160055 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2496/4641] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:33:41 2022] GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba => generated 1336 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:33:42.169269 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-33916d57-88c6-49f5-bbc0-d2443c931438 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:42.178533 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-33916d57-88c6-49f5-bbc0-d2443c931438 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:42.186330 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-33916d57-88c6-49f5-bbc0-d2443c931438 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:42.187830 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-33916d57-88c6-49f5-bbc0-d2443c931438 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1739 microversion: 2.20 time: 0.553042 Aug 07 01:33:42.195182 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2146/4642] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:33:41 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1739 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:33:43.176942 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a85f214e-527f-434a-81c4-5495af81a3b3 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:43.177755 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a85f214e-527f-434a-81c4-5495af81a3b3 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] [instance: f9f5819b-6f54-4981-a640-53651d3416ba] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:43.197245 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a85f214e-527f-434a-81c4-5495af81a3b3 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:43.198312 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a85f214e-527f-434a-81c4-5495af81a3b3 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:43.199592 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a85f214e-527f-434a-81c4-5495af81a3b3 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:43.205248 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a85f214e-527f-434a-81c4-5495af81a3b3 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:43.207110 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a85f214e-527f-434a-81c4-5495af81a3b3 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:43.210787 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a85f214e-527f-434a-81c4-5495af81a3b3 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:43.222509 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-29237890-a9f9-41be-beda-b61b8ed02aae tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:43.224195 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-29237890-a9f9-41be-beda-b61b8ed02aae tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:43.249388 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-29237890-a9f9-41be-beda-b61b8ed02aae tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:43.250274 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-29237890-a9f9-41be-beda-b61b8ed02aae tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:43.251003 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-29237890-a9f9-41be-beda-b61b8ed02aae tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:43.251999 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-29237890-a9f9-41be-beda-b61b8ed02aae tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:43.252494 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-29237890-a9f9-41be-beda-b61b8ed02aae tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:43.252917 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-29237890-a9f9-41be-beda-b61b8ed02aae tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:44.043236 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a85f214e-527f-434a-81c4-5495af81a3b3 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:44.052615 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a85f214e-527f-434a-81c4-5495af81a3b3 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:44.054135 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a85f214e-527f-434a-81c4-5495af81a3b3 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:44.059977 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a85f214e-527f-434a-81c4-5495af81a3b3 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] 10.222.0.39 "GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba" status: 200 len: 1357 microversion: 2.54 time: 0.889463 Aug 07 01:33:44.060579 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2497/4643] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:33:43 2022] GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba => generated 1357 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:33:44.093472 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bad079aa-f432-43de-98cb-186ba1e5ac83 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Action: 'create', calling method: .version_select at 0x7f9e243c93a0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1632573971", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpW3KdWAV+ngfhEwBCC559/8WHRLO3EdxbXfIBvJ685szlHxIsvoWnVlclQLGCTAxeIgjTGaA8plHcdWwim4rb6uWSJOqYI52sb3+dW9ry6fYyu4Tw3gNZeE7ednwWCyg=="}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:33:44.152204 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-bad079aa-f432-43de-98cb-186ba1e5ac83 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Getting quotas for project 859b28071c284ab292ba507e96df8d3f. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:33:44.173120 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-bad079aa-f432-43de-98cb-186ba1e5ac83 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Getting quotas for user 0a3d46fd03134a16becae95c52ea0b55 and project 859b28071c284ab292ba507e96df8d3f. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:33:44.261493 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bad079aa-f432-43de-98cb-186ba1e5ac83 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.169668 Aug 07 01:33:44.269232 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2498/4644] 10.222.0.39 () {62 vars in 1200 bytes} [Sun Aug 7 01:33:44 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 181 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 07 01:33:44.291293 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d3129472-1927-4e3b-9def-b95b0cf1fb37 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1632573971", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:33:44.294816 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d3129472-1927-4e3b-9def-b95b0cf1fb37 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] [instance: f9f5819b-6f54-4981-a640-53651d3416ba] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:44.319428 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3129472-1927-4e3b-9def-b95b0cf1fb37 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:44.319948 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3129472-1927-4e3b-9def-b95b0cf1fb37 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:44.320399 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3129472-1927-4e3b-9def-b95b0cf1fb37 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:44.321123 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3129472-1927-4e3b-9def-b95b0cf1fb37 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:44.321602 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3129472-1927-4e3b-9def-b95b0cf1fb37 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:44.322021 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3129472-1927-4e3b-9def-b95b0cf1fb37 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:44.432929 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-29237890-a9f9-41be-beda-b61b8ed02aae tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:44.441368 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-29237890-a9f9-41be-beda-b61b8ed02aae tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:44.456341 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-29237890-a9f9-41be-beda-b61b8ed02aae tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:44.458273 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-29237890-a9f9-41be-beda-b61b8ed02aae tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1739 microversion: 2.20 time: 1.239771 Aug 07 01:33:44.460929 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2147/4645] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:33:43 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1739 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:33:44.512739 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-d3129472-1927-4e3b-9def-b95b0cf1fb37 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:33:44.513445 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-d3129472-1927-4e3b-9def-b95b0cf1fb37 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:33:44.514158 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-d3129472-1927-4e3b-9def-b95b0cf1fb37 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:33:44.514801 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-d3129472-1927-4e3b-9def-b95b0cf1fb37 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:33:44.515397 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-d3129472-1927-4e3b-9def-b95b0cf1fb37 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:33:44.676312 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:44.713804 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d3129472-1927-4e3b-9def-b95b0cf1fb37 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] [instance: f9f5819b-6f54-4981-a640-53651d3416ba] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:44.744296 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3129472-1927-4e3b-9def-b95b0cf1fb37 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:44.744795 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3129472-1927-4e3b-9def-b95b0cf1fb37 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:44.749950 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3129472-1927-4e3b-9def-b95b0cf1fb37 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:44.750964 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3129472-1927-4e3b-9def-b95b0cf1fb37 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:44.751598 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3129472-1927-4e3b-9def-b95b0cf1fb37 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:44.753630 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3129472-1927-4e3b-9def-b95b0cf1fb37 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:44.847243 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d3129472-1927-4e3b-9def-b95b0cf1fb37 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] 10.222.0.39 "POST /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba/action" status: 202 len: 1140 microversion: 2.54 time: 0.557407 Aug 07 01:33:44.870193 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2499/4646] 10.222.0.39 () {62 vars in 1320 bytes} [Sun Aug 7 01:33:44 2022] POST /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba/action => generated 1140 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 07 01:33:44.876214 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d8c1480c-fa0e-4d0c-8c0b-bce40b284591 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:44.877616 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d8c1480c-fa0e-4d0c-8c0b-bce40b284591 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] [instance: f9f5819b-6f54-4981-a640-53651d3416ba] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:44.910520 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d8c1480c-fa0e-4d0c-8c0b-bce40b284591 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:44.912172 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d8c1480c-fa0e-4d0c-8c0b-bce40b284591 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:44.912625 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d8c1480c-fa0e-4d0c-8c0b-bce40b284591 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:44.913395 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d8c1480c-fa0e-4d0c-8c0b-bce40b284591 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:44.913934 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d8c1480c-fa0e-4d0c-8c0b-bce40b284591 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:44.919848 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d8c1480c-fa0e-4d0c-8c0b-bce40b284591 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:45.155543 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d8c1480c-fa0e-4d0c-8c0b-bce40b284591 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:45.176863 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d8c1480c-fa0e-4d0c-8c0b-bce40b284591 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:45.193899 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d8c1480c-fa0e-4d0c-8c0b-bce40b284591 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:45.196343 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d8c1480c-fa0e-4d0c-8c0b-bce40b284591 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] 10.222.0.39 "GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba" status: 200 len: 1409 microversion: 2.54 time: 0.325663 Aug 07 01:33:45.196976 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2148/4647] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:33:44 2022] GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba => generated 1409 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:33:45.484118 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8f52b15e-0d2d-4ca4-894f-a00d27c7464d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:45.485445 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8f52b15e-0d2d-4ca4-894f-a00d27c7464d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:45.499275 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f52b15e-0d2d-4ca4-894f-a00d27c7464d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:45.502915 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f52b15e-0d2d-4ca4-894f-a00d27c7464d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:45.504734 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f52b15e-0d2d-4ca4-894f-a00d27c7464d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:45.508240 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f52b15e-0d2d-4ca4-894f-a00d27c7464d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:45.509052 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f52b15e-0d2d-4ca4-894f-a00d27c7464d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:45.509724 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f52b15e-0d2d-4ca4-894f-a00d27c7464d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:46.175353 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-45a75157-c048-4015-b419-748b7bb1f089 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-786994149", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "8ac63cf8-be4c-4bcf-93d5-e227f883e6d1"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:33:46.261740 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8f52b15e-0d2d-4ca4-894f-a00d27c7464d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:46.276742 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8f52b15e-0d2d-4ca4-894f-a00d27c7464d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:46.284582 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8f52b15e-0d2d-4ca4-894f-a00d27c7464d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:46.288905 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8f52b15e-0d2d-4ca4-894f-a00d27c7464d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1739 microversion: 2.20 time: 0.808709 Aug 07 01:33:46.309259 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2149/4648] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:33:45 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1739 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:33:46.323332 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c0b97e1c-7b21-4dd6-a0a4-c189fab010a6 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:46.324305 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c0b97e1c-7b21-4dd6-a0a4-c189fab010a6 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] [instance: f9f5819b-6f54-4981-a640-53651d3416ba] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:46.338247 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c0b97e1c-7b21-4dd6-a0a4-c189fab010a6 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:46.338748 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c0b97e1c-7b21-4dd6-a0a4-c189fab010a6 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:46.339190 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c0b97e1c-7b21-4dd6-a0a4-c189fab010a6 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:46.354937 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-45a75157-c048-4015-b419-748b7bb1f089 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] validate_networks() for [('8ac63cf8-be4c-4bcf-93d5-e227f883e6d1', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:33:46.355349 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c0b97e1c-7b21-4dd6-a0a4-c189fab010a6 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:46.356170 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c0b97e1c-7b21-4dd6-a0a4-c189fab010a6 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:46.357368 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c0b97e1c-7b21-4dd6-a0a4-c189fab010a6 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:46.618729 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c0b97e1c-7b21-4dd6-a0a4-c189fab010a6 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:46.639504 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c0b97e1c-7b21-4dd6-a0a4-c189fab010a6 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:46.641926 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c0b97e1c-7b21-4dd6-a0a4-c189fab010a6 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:46.644599 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c0b97e1c-7b21-4dd6-a0a4-c189fab010a6 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] 10.222.0.39 "GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba" status: 200 len: 1409 microversion: 2.54 time: 0.333854 Aug 07 01:33:46.649759 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2150/4649] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:33:46 2022] GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba => generated 1409 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:33:47.185537 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:47.312220 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7493773f-3c6c-404b-96b4-3cbdf9f7fc8c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:47.312850 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7493773f-3c6c-404b-96b4-3cbdf9f7fc8c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:47.322807 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7493773f-3c6c-404b-96b4-3cbdf9f7fc8c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:47.323303 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7493773f-3c6c-404b-96b4-3cbdf9f7fc8c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:47.325443 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7493773f-3c6c-404b-96b4-3cbdf9f7fc8c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:47.327744 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7493773f-3c6c-404b-96b4-3cbdf9f7fc8c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:47.333247 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7493773f-3c6c-404b-96b4-3cbdf9f7fc8c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:47.334050 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7493773f-3c6c-404b-96b4-3cbdf9f7fc8c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:47.752561 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:48.383560 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-45a75157-c048-4015-b419-748b7bb1f089 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:33:48.384857 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-45a75157-c048-4015-b419-748b7bb1f089 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:33:48.385960 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-45a75157-c048-4015-b419-748b7bb1f089 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:33:48.390023 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-45a75157-c048-4015-b419-748b7bb1f089 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:33:48.390873 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-45a75157-c048-4015-b419-748b7bb1f089 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:33:48.406830 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-45a75157-c048-4015-b419-748b7bb1f089 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:48.407623 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-45a75157-c048-4015-b419-748b7bb1f089 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:48.408289 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-45a75157-c048-4015-b419-748b7bb1f089 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:48.409242 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-45a75157-c048-4015-b419-748b7bb1f089 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:48.409856 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-45a75157-c048-4015-b419-748b7bb1f089 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:48.410461 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-45a75157-c048-4015-b419-748b7bb1f089 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:48.437961 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-45a75157-c048-4015-b419-748b7bb1f089 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Getting quotas for project 5a300727d7874d83970c301327780abc. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:33:48.475034 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7493773f-3c6c-404b-96b4-3cbdf9f7fc8c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:48.481758 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-45a75157-c048-4015-b419-748b7bb1f089 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Getting quotas for user 5f0ed400a2cb48cbbc9fa5bae0e2b1c2 and project 5a300727d7874d83970c301327780abc. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:33:48.482928 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=95 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:48.491522 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7493773f-3c6c-404b-96b4-3cbdf9f7fc8c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:48.511703 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7493773f-3c6c-404b-96b4-3cbdf9f7fc8c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:48.521578 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7493773f-3c6c-404b-96b4-3cbdf9f7fc8c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1739 microversion: 2.20 time: 1.213091 Aug 07 01:33:48.524691 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-45a75157-c048-4015-b419-748b7bb1f089 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Going to run 2 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:33:48.535654 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2151/4650] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:33:47 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1739 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:33:48.540498 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-45a75157-c048-4015-b419-748b7bb1f089 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: 09c893ea-9683-476d-88fa-5b05a5373d68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:33:48.557789 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7e259eeb-2479-4a57-a551-bbf4b47205c9 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:48.560170 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7e259eeb-2479-4a57-a551-bbf4b47205c9 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] [instance: f9f5819b-6f54-4981-a640-53651d3416ba] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:48.573107 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=38 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:48.580572 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e259eeb-2479-4a57-a551-bbf4b47205c9 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:48.581527 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e259eeb-2479-4a57-a551-bbf4b47205c9 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:48.582424 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e259eeb-2479-4a57-a551-bbf4b47205c9 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:48.583513 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e259eeb-2479-4a57-a551-bbf4b47205c9 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:48.585323 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e259eeb-2479-4a57-a551-bbf4b47205c9 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:48.585967 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e259eeb-2479-4a57-a551-bbf4b47205c9 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:48.657905 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-45a75157-c048-4015-b419-748b7bb1f089 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: 15bc1c11-5c46-4e17-8d01-519f3438d5e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=09c893ea-9683-476d-88fa-5b05a5373d68,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:33:48.867275 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-45a75157-c048-4015-b419-748b7bb1f089 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.451333 Aug 07 01:33:48.880331 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2500/4651] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:33:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 3465 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:33:48.885886 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-54c97e6e-8844-4df3-ad70-be272a2845c8 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:48.897685 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-54c97e6e-8844-4df3-ad70-be272a2845c8 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:48.900295 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-54c97e6e-8844-4df3-ad70-be272a2845c8 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Searching by: {'deleted': False, 'project_id': '5a300727d7874d83970c301327780abc'} {{(pid=119516) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:33:48.946359 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-54c97e6e-8844-4df3-ad70-be272a2845c8 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:48.947291 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-54c97e6e-8844-4df3-ad70-be272a2845c8 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:48.948991 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-54c97e6e-8844-4df3-ad70-be272a2845c8 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:48.950347 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-54c97e6e-8844-4df3-ad70-be272a2845c8 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:48.952507 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-54c97e6e-8844-4df3-ad70-be272a2845c8 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:48.953141 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-54c97e6e-8844-4df3-ad70-be272a2845c8 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:48.996264 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-54c97e6e-8844-4df3-ad70-be272a2845c8 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.114664 Aug 07 01:33:49.009656 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2501/4652] 10.222.0.39 () {58 vars in 1125 bytes} [Sun Aug 7 01:33:48 2022] GET /compute/v2.1/servers => generated 675 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:33:49.019697 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-233d3e0b-9a78-45db-804c-ebcb1b827d0e tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:49.024914 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-233d3e0b-9a78-45db-804c-ebcb1b827d0e tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: 15bc1c11-5c46-4e17-8d01-519f3438d5e6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:49.139797 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-233d3e0b-9a78-45db-804c-ebcb1b827d0e tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:49.170679 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-233d3e0b-9a78-45db-804c-ebcb1b827d0e tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6" status: 200 len: 1219 microversion: 2.1 time: 0.153859 Aug 07 01:33:49.186180 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2502/4653] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:49 2022] GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6 => generated 1219 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:33:49.558348 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-25c4a053-3acc-436c-b3e1-f06c933a1646 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:49.559969 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-25c4a053-3acc-436c-b3e1-f06c933a1646 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:49.579136 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-25c4a053-3acc-436c-b3e1-f06c933a1646 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:49.579561 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-25c4a053-3acc-436c-b3e1-f06c933a1646 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:49.580038 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-25c4a053-3acc-436c-b3e1-f06c933a1646 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:49.580768 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-25c4a053-3acc-436c-b3e1-f06c933a1646 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:49.589084 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-25c4a053-3acc-436c-b3e1-f06c933a1646 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:49.589583 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-25c4a053-3acc-436c-b3e1-f06c933a1646 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:49.719017 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7e259eeb-2479-4a57-a551-bbf4b47205c9 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:49.749323 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7e259eeb-2479-4a57-a551-bbf4b47205c9 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:49.751044 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7e259eeb-2479-4a57-a551-bbf4b47205c9 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:49.776330 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7e259eeb-2479-4a57-a551-bbf4b47205c9 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] 10.222.0.39 "GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba" status: 200 len: 1409 microversion: 2.54 time: 1.214452 Aug 07 01:33:49.781929 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2152/4654] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:33:48 2022] GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba => generated 1409 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:33:50.198212 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-09745b0c-9fc0-459b-9470-10765add81a9 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:50.199313 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-09745b0c-9fc0-459b-9470-10765add81a9 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: 15bc1c11-5c46-4e17-8d01-519f3438d5e6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:50.238504 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-25c4a053-3acc-436c-b3e1-f06c933a1646 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:50.257032 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-25c4a053-3acc-436c-b3e1-f06c933a1646 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:50.258723 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-25c4a053-3acc-436c-b3e1-f06c933a1646 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:50.260121 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-25c4a053-3acc-436c-b3e1-f06c933a1646 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1739 microversion: 2.20 time: 0.705984 Aug 07 01:33:50.261311 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2503/4655] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:33:49 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1739 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:33:50.786479 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-09745b0c-9fc0-459b-9470-10765add81a9 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:50.810260 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7fc20699-2010-4c49-a9b7-d0151d29b33e tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:50.811282 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7fc20699-2010-4c49-a9b7-d0151d29b33e tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] [instance: f9f5819b-6f54-4981-a640-53651d3416ba] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:50.813650 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-09745b0c-9fc0-459b-9470-10765add81a9 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6" status: 200 len: 1219 microversion: 2.1 time: 0.615912 Aug 07 01:33:50.817998 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2153/4656] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:50 2022] GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6 => generated 1219 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:33:50.840066 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7fc20699-2010-4c49-a9b7-d0151d29b33e tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:50.840723 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7fc20699-2010-4c49-a9b7-d0151d29b33e tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:50.841146 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7fc20699-2010-4c49-a9b7-d0151d29b33e tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:50.841935 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7fc20699-2010-4c49-a9b7-d0151d29b33e tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:50.842454 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7fc20699-2010-4c49-a9b7-d0151d29b33e tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:50.842829 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7fc20699-2010-4c49-a9b7-d0151d29b33e tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:51.115503 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7fc20699-2010-4c49-a9b7-d0151d29b33e tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:51.134539 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7fc20699-2010-4c49-a9b7-d0151d29b33e tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:51.144347 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7fc20699-2010-4c49-a9b7-d0151d29b33e tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:51.163070 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7fc20699-2010-4c49-a9b7-d0151d29b33e tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] 10.222.0.39 "GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba" status: 200 len: 1409 microversion: 2.54 time: 0.357660 Aug 07 01:33:51.170854 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2504/4657] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:33:50 2022] GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba => generated 1409 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:33:51.283790 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a5dab7b6-aa6f-4f84-ac6a-bbc8ecf3e006 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:51.284794 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a5dab7b6-aa6f-4f84-ac6a-bbc8ecf3e006 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:51.299947 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a5dab7b6-aa6f-4f84-ac6a-bbc8ecf3e006 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:51.304553 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a5dab7b6-aa6f-4f84-ac6a-bbc8ecf3e006 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:51.313811 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a5dab7b6-aa6f-4f84-ac6a-bbc8ecf3e006 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:51.315297 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a5dab7b6-aa6f-4f84-ac6a-bbc8ecf3e006 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:51.316571 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a5dab7b6-aa6f-4f84-ac6a-bbc8ecf3e006 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:51.328807 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a5dab7b6-aa6f-4f84-ac6a-bbc8ecf3e006 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:51.845170 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a35197d7-bb37-4bb9-9476-4ad6e6aa56e3 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:51.852481 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a35197d7-bb37-4bb9-9476-4ad6e6aa56e3 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: 15bc1c11-5c46-4e17-8d01-519f3438d5e6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:51.870711 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a35197d7-bb37-4bb9-9476-4ad6e6aa56e3 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:51.876406 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a35197d7-bb37-4bb9-9476-4ad6e6aa56e3 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:51.881651 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a35197d7-bb37-4bb9-9476-4ad6e6aa56e3 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:51.882882 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a35197d7-bb37-4bb9-9476-4ad6e6aa56e3 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:51.883466 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a35197d7-bb37-4bb9-9476-4ad6e6aa56e3 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:51.884174 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a35197d7-bb37-4bb9-9476-4ad6e6aa56e3 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:52.124321 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a35197d7-bb37-4bb9-9476-4ad6e6aa56e3 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:52.137794 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a35197d7-bb37-4bb9-9476-4ad6e6aa56e3 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6" status: 200 len: 1271 microversion: 2.1 time: 0.297756 Aug 07 01:33:52.164080 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2505/4658] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:51 2022] GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6 => generated 1271 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:33:52.201801 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-abddcf59-a82e-46f1-819e-ecb66d8cd75b tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:52.206273 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-abddcf59-a82e-46f1-819e-ecb66d8cd75b tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] [instance: f9f5819b-6f54-4981-a640-53651d3416ba] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:52.225734 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-abddcf59-a82e-46f1-819e-ecb66d8cd75b tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:52.226638 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-abddcf59-a82e-46f1-819e-ecb66d8cd75b tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:52.227543 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-abddcf59-a82e-46f1-819e-ecb66d8cd75b tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:52.231341 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-abddcf59-a82e-46f1-819e-ecb66d8cd75b tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:52.234680 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-abddcf59-a82e-46f1-819e-ecb66d8cd75b tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:52.235322 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-abddcf59-a82e-46f1-819e-ecb66d8cd75b tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:52.664024 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-abddcf59-a82e-46f1-819e-ecb66d8cd75b tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:52.685149 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-abddcf59-a82e-46f1-819e-ecb66d8cd75b tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:52.688476 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-abddcf59-a82e-46f1-819e-ecb66d8cd75b tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:52.698001 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-abddcf59-a82e-46f1-819e-ecb66d8cd75b tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] 10.222.0.39 "GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba" status: 200 len: 1409 microversion: 2.54 time: 0.505019 Aug 07 01:33:52.744079 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2506/4659] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:33:52 2022] GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba => generated 1409 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:33:52.763843 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-589da0e4-b871-482f-94fb-93ae7b09f964 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:52.767854 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-589da0e4-b871-482f-94fb-93ae7b09f964 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:52.794160 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-589da0e4-b871-482f-94fb-93ae7b09f964 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:52.794667 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-589da0e4-b871-482f-94fb-93ae7b09f964 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:52.795111 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-589da0e4-b871-482f-94fb-93ae7b09f964 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:52.797015 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-589da0e4-b871-482f-94fb-93ae7b09f964 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:52.807116 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-589da0e4-b871-482f-94fb-93ae7b09f964 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:52.808096 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-589da0e4-b871-482f-94fb-93ae7b09f964 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:52.870766 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-589da0e4-b871-482f-94fb-93ae7b09f964 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2/ips" status: 200 len: 149 microversion: 2.1 time: 0.123924 Aug 07 01:33:52.873567 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2507/4660] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Aug 7 01:33:52 2022] GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2/ips => generated 149 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:33:53.181537 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c99fcc8c-43df-4308-8ab6-21e1e305a762 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:53.185289 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c99fcc8c-43df-4308-8ab6-21e1e305a762 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: 15bc1c11-5c46-4e17-8d01-519f3438d5e6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:53.239331 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c99fcc8c-43df-4308-8ab6-21e1e305a762 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:53.239838 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c99fcc8c-43df-4308-8ab6-21e1e305a762 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:53.244868 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c99fcc8c-43df-4308-8ab6-21e1e305a762 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:53.250037 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c99fcc8c-43df-4308-8ab6-21e1e305a762 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:53.253991 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c99fcc8c-43df-4308-8ab6-21e1e305a762 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:53.254663 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c99fcc8c-43df-4308-8ab6-21e1e305a762 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:53.541579 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a5dab7b6-aa6f-4f84-ac6a-bbc8ecf3e006 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:53.546013 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c99fcc8c-43df-4308-8ab6-21e1e305a762 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:53.564198 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c99fcc8c-43df-4308-8ab6-21e1e305a762 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6" status: 200 len: 1277 microversion: 2.1 time: 0.400162 Aug 07 01:33:53.576229 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2508/4661] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:53 2022] GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6 => generated 1277 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:33:53.576414 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a5dab7b6-aa6f-4f84-ac6a-bbc8ecf3e006 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:53.576414 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a5dab7b6-aa6f-4f84-ac6a-bbc8ecf3e006 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:53.595921 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a5dab7b6-aa6f-4f84-ac6a-bbc8ecf3e006 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1739 microversion: 2.20 time: 2.298925 Aug 07 01:33:53.614466 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2154/4662] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:33:51 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1739 bytes in 2336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:33:53.746536 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4cc659d0-fdc2-43b3-abf6-6dccf26077c9 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:53.747310 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4cc659d0-fdc2-43b3-abf6-6dccf26077c9 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] [instance: f9f5819b-6f54-4981-a640-53651d3416ba] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:53.767703 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4cc659d0-fdc2-43b3-abf6-6dccf26077c9 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:53.771833 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4cc659d0-fdc2-43b3-abf6-6dccf26077c9 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:53.772996 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4cc659d0-fdc2-43b3-abf6-6dccf26077c9 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:53.779788 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4cc659d0-fdc2-43b3-abf6-6dccf26077c9 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:53.781069 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4cc659d0-fdc2-43b3-abf6-6dccf26077c9 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:53.781760 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4cc659d0-fdc2-43b3-abf6-6dccf26077c9 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:54.021050 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4cc659d0-fdc2-43b3-abf6-6dccf26077c9 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:54.052386 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4cc659d0-fdc2-43b3-abf6-6dccf26077c9 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:54.057499 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4cc659d0-fdc2-43b3-abf6-6dccf26077c9 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:54.064129 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4cc659d0-fdc2-43b3-abf6-6dccf26077c9 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] 10.222.0.39 "GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba" status: 200 len: 1409 microversion: 2.54 time: 0.329315 Aug 07 01:33:54.067913 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2509/4663] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:33:53 2022] GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba => generated 1409 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:33:54.613309 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-647d26bc-bed5-4818-bebf-3a7892458513 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:54.613923 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f1d647f6-b355-4263-9fc9-5eee90b4959b tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:54.614087 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f1d647f6-b355-4263-9fc9-5eee90b4959b tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: 15bc1c11-5c46-4e17-8d01-519f3438d5e6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:54.614241 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-647d26bc-bed5-4818-bebf-3a7892458513 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:54.627646 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f1d647f6-b355-4263-9fc9-5eee90b4959b tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:54.636814 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f1d647f6-b355-4263-9fc9-5eee90b4959b tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:54.642723 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f1d647f6-b355-4263-9fc9-5eee90b4959b tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:54.649089 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-647d26bc-bed5-4818-bebf-3a7892458513 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:54.649645 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-647d26bc-bed5-4818-bebf-3a7892458513 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:54.650101 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-647d26bc-bed5-4818-bebf-3a7892458513 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:54.651229 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f1d647f6-b355-4263-9fc9-5eee90b4959b tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:54.655735 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f1d647f6-b355-4263-9fc9-5eee90b4959b tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:54.656249 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f1d647f6-b355-4263-9fc9-5eee90b4959b tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:54.659060 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-647d26bc-bed5-4818-bebf-3a7892458513 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:54.659566 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-647d26bc-bed5-4818-bebf-3a7892458513 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:54.660045 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-647d26bc-bed5-4818-bebf-3a7892458513 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:54.886088 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f1d647f6-b355-4263-9fc9-5eee90b4959b tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:54.895330 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f1d647f6-b355-4263-9fc9-5eee90b4959b tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6" status: 200 len: 1277 microversion: 2.1 time: 0.286074 Aug 07 01:33:54.895959 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2510/4664] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:54 2022] GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6 => generated 1277 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:33:55.093985 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d1ecbcdb-9f9a-4750-88d4-4095aa1bf488 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:55.094706 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d1ecbcdb-9f9a-4750-88d4-4095aa1bf488 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] [instance: f9f5819b-6f54-4981-a640-53651d3416ba] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:55.104938 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d1ecbcdb-9f9a-4750-88d4-4095aa1bf488 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:55.105436 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d1ecbcdb-9f9a-4750-88d4-4095aa1bf488 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:55.105954 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d1ecbcdb-9f9a-4750-88d4-4095aa1bf488 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:55.118604 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d1ecbcdb-9f9a-4750-88d4-4095aa1bf488 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:55.119392 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d1ecbcdb-9f9a-4750-88d4-4095aa1bf488 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:55.120061 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d1ecbcdb-9f9a-4750-88d4-4095aa1bf488 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:55.313550 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d1ecbcdb-9f9a-4750-88d4-4095aa1bf488 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:55.334082 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d1ecbcdb-9f9a-4750-88d4-4095aa1bf488 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:55.339065 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d1ecbcdb-9f9a-4750-88d4-4095aa1bf488 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:55.342457 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d1ecbcdb-9f9a-4750-88d4-4095aa1bf488 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] 10.222.0.39 "GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba" status: 200 len: 1409 microversion: 2.54 time: 0.253755 Aug 07 01:33:55.357593 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2511/4665] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:33:55 2022] GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba => generated 1409 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:33:55.919690 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-320f3510-9e32-4ba6-94c8-4fe78cf8b854 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:55.920571 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-320f3510-9e32-4ba6-94c8-4fe78cf8b854 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: 15bc1c11-5c46-4e17-8d01-519f3438d5e6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:55.934720 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-320f3510-9e32-4ba6-94c8-4fe78cf8b854 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:55.945959 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-320f3510-9e32-4ba6-94c8-4fe78cf8b854 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:55.946537 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-320f3510-9e32-4ba6-94c8-4fe78cf8b854 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:55.949582 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-320f3510-9e32-4ba6-94c8-4fe78cf8b854 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:55.953669 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-320f3510-9e32-4ba6-94c8-4fe78cf8b854 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:55.954270 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-320f3510-9e32-4ba6-94c8-4fe78cf8b854 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:56.298200 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-320f3510-9e32-4ba6-94c8-4fe78cf8b854 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:56.323020 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-320f3510-9e32-4ba6-94c8-4fe78cf8b854 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6" status: 200 len: 1277 microversion: 2.1 time: 0.400783 Aug 07 01:33:56.329967 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2512/4666] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:55 2022] GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6 => generated 1277 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:33:56.368110 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5594ed01-82f7-4136-b1d0-4bba039ab1e1 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:56.369152 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5594ed01-82f7-4136-b1d0-4bba039ab1e1 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] [instance: f9f5819b-6f54-4981-a640-53651d3416ba] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:56.386371 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5594ed01-82f7-4136-b1d0-4bba039ab1e1 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:56.388164 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5594ed01-82f7-4136-b1d0-4bba039ab1e1 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:56.388724 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5594ed01-82f7-4136-b1d0-4bba039ab1e1 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:56.393652 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5594ed01-82f7-4136-b1d0-4bba039ab1e1 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:56.394251 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5594ed01-82f7-4136-b1d0-4bba039ab1e1 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:56.397280 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5594ed01-82f7-4136-b1d0-4bba039ab1e1 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:56.564951 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5594ed01-82f7-4136-b1d0-4bba039ab1e1 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:56.572481 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5594ed01-82f7-4136-b1d0-4bba039ab1e1 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:56.584240 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5594ed01-82f7-4136-b1d0-4bba039ab1e1 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:56.587553 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5594ed01-82f7-4136-b1d0-4bba039ab1e1 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] 10.222.0.39 "GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba" status: 200 len: 1409 microversion: 2.54 time: 0.223273 Aug 07 01:33:56.612800 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2513/4667] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:33:56 2022] GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba => generated 1409 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:33:56.734704 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-647d26bc-bed5-4818-bebf-3a7892458513 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:56.745820 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-647d26bc-bed5-4818-bebf-3a7892458513 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:56.749498 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-647d26bc-bed5-4818-bebf-3a7892458513 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:56.753580 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-647d26bc-bed5-4818-bebf-3a7892458513 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1739 microversion: 2.20 time: 2.148889 Aug 07 01:33:56.755531 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2155/4668] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:33:54 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1739 bytes in 2151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:33:57.339092 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f5263653-cb0c-48e7-8082-9462c5250693 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "872b66d8-b72e-4dee-8a6d-9d1c0e3771e1"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:33:57.348162 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-26d254d9-b303-4ac6-bc61-715cc57566d6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:57.348449 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f5263653-cb0c-48e7-8082-9462c5250693 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:57.349223 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-26d254d9-b303-4ac6-bc61-715cc57566d6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: 15bc1c11-5c46-4e17-8d01-519f3438d5e6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:57.360495 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-26d254d9-b303-4ac6-bc61-715cc57566d6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:57.361174 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-26d254d9-b303-4ac6-bc61-715cc57566d6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:57.361798 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-26d254d9-b303-4ac6-bc61-715cc57566d6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:57.362754 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-26d254d9-b303-4ac6-bc61-715cc57566d6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:57.365392 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-26d254d9-b303-4ac6-bc61-715cc57566d6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:57.366056 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-26d254d9-b303-4ac6-bc61-715cc57566d6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:57.379967 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:57.402117 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f5263653-cb0c-48e7-8082-9462c5250693 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:57.409314 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f5263653-cb0c-48e7-8082-9462c5250693 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:57.409840 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f5263653-cb0c-48e7-8082-9462c5250693 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:57.425163 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f5263653-cb0c-48e7-8082-9462c5250693 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:57.425813 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f5263653-cb0c-48e7-8082-9462c5250693 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:57.426268 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f5263653-cb0c-48e7-8082-9462c5250693 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:57.500393 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-26d254d9-b303-4ac6-bc61-715cc57566d6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:57.512850 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-26d254d9-b303-4ac6-bc61-715cc57566d6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6" status: 200 len: 1277 microversion: 2.1 time: 0.167924 Aug 07 01:33:57.513411 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2156/4669] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:57 2022] GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6 => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:33:57.612998 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c0bf584b-de7d-4237-84da-04ba7c6ba401 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:57.613620 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c0bf584b-de7d-4237-84da-04ba7c6ba401 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] [instance: f9f5819b-6f54-4981-a640-53651d3416ba] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:57.625942 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c0bf584b-de7d-4237-84da-04ba7c6ba401 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:57.626438 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c0bf584b-de7d-4237-84da-04ba7c6ba401 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:57.627082 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c0bf584b-de7d-4237-84da-04ba7c6ba401 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:57.628982 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c0bf584b-de7d-4237-84da-04ba7c6ba401 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:57.629701 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c0bf584b-de7d-4237-84da-04ba7c6ba401 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:57.632055 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c0bf584b-de7d-4237-84da-04ba7c6ba401 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:57.890324 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c0bf584b-de7d-4237-84da-04ba7c6ba401 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:57.906492 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c0bf584b-de7d-4237-84da-04ba7c6ba401 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:57.908055 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c0bf584b-de7d-4237-84da-04ba7c6ba401 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:57.909272 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c0bf584b-de7d-4237-84da-04ba7c6ba401 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] 10.222.0.39 "GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba" status: 200 len: 1409 microversion: 2.54 time: 0.300182 Aug 07 01:33:57.920171 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2157/4670] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:33:57 2022] GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba => generated 1409 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:33:57.930934 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fff455a2-8847-4212-a827-269f960fe4ef tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:57.930934 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fff455a2-8847-4212-a827-269f960fe4ef tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:57.948838 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fff455a2-8847-4212-a827-269f960fe4ef tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:57.949353 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fff455a2-8847-4212-a827-269f960fe4ef tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:57.949803 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fff455a2-8847-4212-a827-269f960fe4ef tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:57.960149 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fff455a2-8847-4212-a827-269f960fe4ef tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:57.960724 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fff455a2-8847-4212-a827-269f960fe4ef tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:57.961180 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fff455a2-8847-4212-a827-269f960fe4ef tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:58.062359 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f5263653-cb0c-48e7-8082-9462c5250693 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "POST /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.728257 Aug 07 01:33:58.068758 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2514/4671] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Aug 7 01:33:57 2022] POST /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2/os-volume_attachments => generated 194 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:33:58.537155 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f28f62e1-100a-4d67-968d-711d846796b6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:58.537863 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f28f62e1-100a-4d67-968d-711d846796b6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: 15bc1c11-5c46-4e17-8d01-519f3438d5e6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:58.551780 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f28f62e1-100a-4d67-968d-711d846796b6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:58.567163 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f28f62e1-100a-4d67-968d-711d846796b6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:58.567625 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f28f62e1-100a-4d67-968d-711d846796b6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:58.576030 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f28f62e1-100a-4d67-968d-711d846796b6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:58.579359 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f28f62e1-100a-4d67-968d-711d846796b6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:58.579879 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f28f62e1-100a-4d67-968d-711d846796b6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:58.752431 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f28f62e1-100a-4d67-968d-711d846796b6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:58.778356 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f28f62e1-100a-4d67-968d-711d846796b6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6" status: 200 len: 1277 microversion: 2.1 time: 0.230670 Aug 07 01:33:58.779633 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2515/4672] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:58 2022] GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6 => generated 1277 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:33:58.945570 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-07a6fa62-bb70-4e4e-81cd-debff121794b tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:58.946468 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-07a6fa62-bb70-4e4e-81cd-debff121794b tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] [instance: f9f5819b-6f54-4981-a640-53651d3416ba] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:58.974481 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-07a6fa62-bb70-4e4e-81cd-debff121794b tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:58.975622 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-07a6fa62-bb70-4e4e-81cd-debff121794b tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:58.993752 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-07a6fa62-bb70-4e4e-81cd-debff121794b tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:58.993752 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-07a6fa62-bb70-4e4e-81cd-debff121794b tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:58.993752 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-07a6fa62-bb70-4e4e-81cd-debff121794b tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:58.993752 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-07a6fa62-bb70-4e4e-81cd-debff121794b tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:58.994483 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=4 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:59.146968 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-07a6fa62-bb70-4e4e-81cd-debff121794b tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:59.152452 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=18 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:59.177479 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-07a6fa62-bb70-4e4e-81cd-debff121794b tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:59.186056 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-07a6fa62-bb70-4e4e-81cd-debff121794b tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:59.193473 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-07a6fa62-bb70-4e4e-81cd-debff121794b tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] 10.222.0.39 "GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba" status: 200 len: 1409 microversion: 2.54 time: 0.253836 Aug 07 01:33:59.213244 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2516/4673] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:33:58 2022] GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba => generated 1409 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:33:59.323734 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fff455a2-8847-4212-a827-269f960fe4ef tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:59.338750 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fff455a2-8847-4212-a827-269f960fe4ef tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:59.344429 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fff455a2-8847-4212-a827-269f960fe4ef tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:33:59.345678 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fff455a2-8847-4212-a827-269f960fe4ef tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1739 microversion: 2.20 time: 1.424993 Aug 07 01:33:59.355340 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2158/4674] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:33:57 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1739 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:33:59.814525 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f20968d8-76f7-4a97-9087-3fa7887c8a65 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:33:59.815863 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f20968d8-76f7-4a97-9087-3fa7887c8a65 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: 15bc1c11-5c46-4e17-8d01-519f3438d5e6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:33:59.865034 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f20968d8-76f7-4a97-9087-3fa7887c8a65 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:59.865851 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f20968d8-76f7-4a97-9087-3fa7887c8a65 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:59.866474 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f20968d8-76f7-4a97-9087-3fa7887c8a65 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:59.867396 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f20968d8-76f7-4a97-9087-3fa7887c8a65 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:33:59.868069 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f20968d8-76f7-4a97-9087-3fa7887c8a65 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:33:59.868666 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f20968d8-76f7-4a97-9087-3fa7887c8a65 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:33:59.874611 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:00.206002 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f20968d8-76f7-4a97-9087-3fa7887c8a65 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:00.217743 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f20968d8-76f7-4a97-9087-3fa7887c8a65 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6" status: 200 len: 1319 microversion: 2.1 time: 0.410897 Aug 07 01:34:00.220976 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3ca52135-ee17-4921-a86d-a4c107f696a4 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:00.234682 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3ca52135-ee17-4921-a86d-a4c107f696a4 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] [instance: f9f5819b-6f54-4981-a640-53651d3416ba] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:00.235145 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2517/4675] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:33:59 2022] GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6 => generated 1319 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:00.257360 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ca52135-ee17-4921-a86d-a4c107f696a4 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:00.258035 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ca52135-ee17-4921-a86d-a4c107f696a4 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:00.261614 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ca52135-ee17-4921-a86d-a4c107f696a4 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:00.266916 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ca52135-ee17-4921-a86d-a4c107f696a4 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:00.267961 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ca52135-ee17-4921-a86d-a4c107f696a4 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:00.273943 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ca52135-ee17-4921-a86d-a4c107f696a4 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:00.371564 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e57b4353-e38c-4af1-9d3e-c338d1ea50d0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:00.372385 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e57b4353-e38c-4af1-9d3e-c338d1ea50d0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:00.381156 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e57b4353-e38c-4af1-9d3e-c338d1ea50d0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:00.400397 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e57b4353-e38c-4af1-9d3e-c338d1ea50d0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:00.407706 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e57b4353-e38c-4af1-9d3e-c338d1ea50d0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:00.408618 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e57b4353-e38c-4af1-9d3e-c338d1ea50d0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:00.413186 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e57b4353-e38c-4af1-9d3e-c338d1ea50d0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:00.415501 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e57b4353-e38c-4af1-9d3e-c338d1ea50d0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:00.780436 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3ca52135-ee17-4921-a86d-a4c107f696a4 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:00.794110 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3ca52135-ee17-4921-a86d-a4c107f696a4 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:00.795686 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3ca52135-ee17-4921-a86d-a4c107f696a4 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:00.827541 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e57b4353-e38c-4af1-9d3e-c338d1ea50d0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:00.833401 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3ca52135-ee17-4921-a86d-a4c107f696a4 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] 10.222.0.39 "GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba" status: 200 len: 1409 microversion: 2.54 time: 0.600232 Aug 07 01:34:00.834066 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2159/4676] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:00 2022] GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba => generated 1409 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:34:00.851452 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e57b4353-e38c-4af1-9d3e-c338d1ea50d0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:00.861949 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e57b4353-e38c-4af1-9d3e-c338d1ea50d0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:00.865610 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:00.874080 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e57b4353-e38c-4af1-9d3e-c338d1ea50d0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1739 microversion: 2.20 time: 0.507230 Aug 07 01:34:00.875670 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2518/4677] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:00 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1739 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:34:01.242914 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d6558841-202c-49a9-9a08-e01c2090511d tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:01.243943 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d6558841-202c-49a9-9a08-e01c2090511d tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: 15bc1c11-5c46-4e17-8d01-519f3438d5e6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:01.263974 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6558841-202c-49a9-9a08-e01c2090511d tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:01.268541 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6558841-202c-49a9-9a08-e01c2090511d tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:01.269255 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6558841-202c-49a9-9a08-e01c2090511d tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:01.270906 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6558841-202c-49a9-9a08-e01c2090511d tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:01.273537 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6558841-202c-49a9-9a08-e01c2090511d tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:01.275690 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6558841-202c-49a9-9a08-e01c2090511d tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:01.312282 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b9f8e0ff-2b19-44f6-b133-2c28d53cfb52 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-796535065", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:34:01.453028 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-b9f8e0ff-2b19-44f6-b133-2c28d53cfb52 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] validate_networks() for [('adf96141-07d9-42cc-8458-bc4b41607467', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:34:01.782394 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d6558841-202c-49a9-9a08-e01c2090511d tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:01.790270 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d6558841-202c-49a9-9a08-e01c2090511d tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6" status: 200 len: 1319 microversion: 2.1 time: 0.551675 Aug 07 01:34:01.790849 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2519/4678] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:01 2022] GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6 => generated 1319 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:34:01.862550 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-38b02582-9d5d-490b-8db9-5aa5b076850f tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:01.863270 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-38b02582-9d5d-490b-8db9-5aa5b076850f tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] [instance: f9f5819b-6f54-4981-a640-53651d3416ba] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:01.872529 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38b02582-9d5d-490b-8db9-5aa5b076850f tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:01.873054 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38b02582-9d5d-490b-8db9-5aa5b076850f tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:01.873498 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38b02582-9d5d-490b-8db9-5aa5b076850f tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:01.874213 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38b02582-9d5d-490b-8db9-5aa5b076850f tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:01.874668 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38b02582-9d5d-490b-8db9-5aa5b076850f tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:01.875100 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38b02582-9d5d-490b-8db9-5aa5b076850f tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:02.188547 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-38b02582-9d5d-490b-8db9-5aa5b076850f tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:02.224251 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-38b02582-9d5d-490b-8db9-5aa5b076850f tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:02.227360 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-38b02582-9d5d-490b-8db9-5aa5b076850f tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:02.238338 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-38b02582-9d5d-490b-8db9-5aa5b076850f tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] 10.222.0.39 "GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba" status: 200 len: 1409 microversion: 2.54 time: 0.379538 Aug 07 01:34:02.244553 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2520/4679] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:01 2022] GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba => generated 1409 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:34:02.271241 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f6f9a49b-c207-4da1-84e3-74a8becba274 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:02.274301 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f6f9a49b-c207-4da1-84e3-74a8becba274 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:02.305043 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f6f9a49b-c207-4da1-84e3-74a8becba274 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:02.311419 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f6f9a49b-c207-4da1-84e3-74a8becba274 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:02.312549 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f6f9a49b-c207-4da1-84e3-74a8becba274 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:02.317991 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f6f9a49b-c207-4da1-84e3-74a8becba274 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:02.319177 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f6f9a49b-c207-4da1-84e3-74a8becba274 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:02.322312 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f6f9a49b-c207-4da1-84e3-74a8becba274 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:02.647210 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f6f9a49b-c207-4da1-84e3-74a8becba274 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:02.659010 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f6f9a49b-c207-4da1-84e3-74a8becba274 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:02.661034 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f6f9a49b-c207-4da1-84e3-74a8becba274 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:02.662553 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f6f9a49b-c207-4da1-84e3-74a8becba274 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1739 microversion: 2.20 time: 0.416186 Aug 07 01:34:02.663486 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2521/4680] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:02 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1739 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:34:02.817670 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3a913c79-48d7-45cf-8d2a-1c10d5eaf024 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:02.818869 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3a913c79-48d7-45cf-8d2a-1c10d5eaf024 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: 15bc1c11-5c46-4e17-8d01-519f3438d5e6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:02.833120 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a913c79-48d7-45cf-8d2a-1c10d5eaf024 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:02.847461 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a913c79-48d7-45cf-8d2a-1c10d5eaf024 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:02.852150 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a913c79-48d7-45cf-8d2a-1c10d5eaf024 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:02.854704 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a913c79-48d7-45cf-8d2a-1c10d5eaf024 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:02.867704 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a913c79-48d7-45cf-8d2a-1c10d5eaf024 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:02.868453 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a913c79-48d7-45cf-8d2a-1c10d5eaf024 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:03.425441 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3a913c79-48d7-45cf-8d2a-1c10d5eaf024 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:03.447541 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3a913c79-48d7-45cf-8d2a-1c10d5eaf024 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6" status: 200 len: 1319 microversion: 2.1 time: 0.632169 Aug 07 01:34:03.452483 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2522/4681] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:02 2022] GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6 => generated 1319 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:34:03.473195 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-15195244-bf57-4900-ba2a-d261df0c9126 req-05f1bf9d-27cb-4757-bbfa-fe75e74c562d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09c893ea-9683-476d-88fa-5b05a5373d68", "tag": "0fecb544-34bf-4d56-ab2c-8eaec81edefc"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:34:03.506937 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-15195244-bf57-4900-ba2a-d261df0c9126 req-05f1bf9d-27cb-4757-bbfa-fe75e74c562d service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:03.507426 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-15195244-bf57-4900-ba2a-d261df0c9126 req-05f1bf9d-27cb-4757-bbfa-fe75e74c562d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:03.511062 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-15195244-bf57-4900-ba2a-d261df0c9126 req-05f1bf9d-27cb-4757-bbfa-fe75e74c562d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:03.537578 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-15195244-bf57-4900-ba2a-d261df0c9126 req-05f1bf9d-27cb-4757-bbfa-fe75e74c562d service nova] Creating event network-changed:0fecb544-34bf-4d56-ab2c-8eaec81edefc for instance 09c893ea-9683-476d-88fa-5b05a5373d68 on n-h1-master-1 Aug 07 01:34:03.570024 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-15195244-bf57-4900-ba2a-d261df0c9126 req-05f1bf9d-27cb-4757-bbfa-fe75e74c562d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110829 Aug 07 01:34:03.576115 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2523/4682] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:34:03.582030 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-06ea29d6-178e-48e0-b9a4-01788a58c3e5 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:03.597542 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-06ea29d6-178e-48e0-b9a4-01788a58c3e5 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] [instance: f9f5819b-6f54-4981-a640-53651d3416ba] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:03.623071 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-06ea29d6-178e-48e0-b9a4-01788a58c3e5 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:03.624462 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-06ea29d6-178e-48e0-b9a4-01788a58c3e5 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:03.626237 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-06ea29d6-178e-48e0-b9a4-01788a58c3e5 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:03.627166 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-06ea29d6-178e-48e0-b9a4-01788a58c3e5 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:03.628989 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-06ea29d6-178e-48e0-b9a4-01788a58c3e5 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:03.630682 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-06ea29d6-178e-48e0-b9a4-01788a58c3e5 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:03.810627 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-06ea29d6-178e-48e0-b9a4-01788a58c3e5 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:03.822392 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-06ea29d6-178e-48e0-b9a4-01788a58c3e5 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:03.828743 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-06ea29d6-178e-48e0-b9a4-01788a58c3e5 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:03.837608 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-06ea29d6-178e-48e0-b9a4-01788a58c3e5 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] 10.222.0.39 "GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba" status: 200 len: 1409 microversion: 2.54 time: 0.259884 Aug 07 01:34:03.838794 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2524/4683] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:03 2022] GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba => generated 1409 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:34:03.844374 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1fc8ee81-80c0-4a72-8509-68c87f916b37 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:03.847495 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1fc8ee81-80c0-4a72-8509-68c87f916b37 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:03.861132 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1fc8ee81-80c0-4a72-8509-68c87f916b37 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:03.863973 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1fc8ee81-80c0-4a72-8509-68c87f916b37 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:03.864639 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1fc8ee81-80c0-4a72-8509-68c87f916b37 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:03.871606 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1fc8ee81-80c0-4a72-8509-68c87f916b37 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:03.872966 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1fc8ee81-80c0-4a72-8509-68c87f916b37 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:03.873602 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1fc8ee81-80c0-4a72-8509-68c87f916b37 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:04.359726 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1fc8ee81-80c0-4a72-8509-68c87f916b37 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:04.375324 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1fc8ee81-80c0-4a72-8509-68c87f916b37 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:04.380845 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1fc8ee81-80c0-4a72-8509-68c87f916b37 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:04.386534 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1fc8ee81-80c0-4a72-8509-68c87f916b37 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1739 microversion: 2.20 time: 0.544621 Aug 07 01:34:04.386968 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2525/4684] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:03 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1739 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:34:04.474364 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a24baff0-15d2-490a-b5ac-8bb28b967e86 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:04.474999 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a24baff0-15d2-490a-b5ac-8bb28b967e86 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: 15bc1c11-5c46-4e17-8d01-519f3438d5e6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:04.484534 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a24baff0-15d2-490a-b5ac-8bb28b967e86 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:04.485035 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a24baff0-15d2-490a-b5ac-8bb28b967e86 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:04.485487 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a24baff0-15d2-490a-b5ac-8bb28b967e86 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:04.486219 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a24baff0-15d2-490a-b5ac-8bb28b967e86 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:04.486686 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a24baff0-15d2-490a-b5ac-8bb28b967e86 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:04.487123 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a24baff0-15d2-490a-b5ac-8bb28b967e86 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:04.758636 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a24baff0-15d2-490a-b5ac-8bb28b967e86 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:04.794313 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a24baff0-15d2-490a-b5ac-8bb28b967e86 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6" status: 200 len: 1319 microversion: 2.1 time: 0.323969 Aug 07 01:34:04.811387 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2526/4685] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:04 2022] GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6 => generated 1319 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:04.866584 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8670b676-01e8-4341-b24b-8f12fc1d7e93 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:04.868753 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8670b676-01e8-4341-b24b-8f12fc1d7e93 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] [instance: f9f5819b-6f54-4981-a640-53651d3416ba] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:04.879588 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8670b676-01e8-4341-b24b-8f12fc1d7e93 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:04.882865 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8670b676-01e8-4341-b24b-8f12fc1d7e93 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:04.883614 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8670b676-01e8-4341-b24b-8f12fc1d7e93 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:04.890110 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8670b676-01e8-4341-b24b-8f12fc1d7e93 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:04.891600 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8670b676-01e8-4341-b24b-8f12fc1d7e93 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:04.892741 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8670b676-01e8-4341-b24b-8f12fc1d7e93 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:05.057865 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8670b676-01e8-4341-b24b-8f12fc1d7e93 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:05.075363 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8670b676-01e8-4341-b24b-8f12fc1d7e93 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:05.088515 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8670b676-01e8-4341-b24b-8f12fc1d7e93 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:05.090500 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8670b676-01e8-4341-b24b-8f12fc1d7e93 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] 10.222.0.39 "GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba" status: 200 len: 1409 microversion: 2.54 time: 0.227191 Aug 07 01:34:05.095982 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2527/4686] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:04 2022] GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba => generated 1409 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:34:05.418820 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2a18bafd-d110-451a-8117-fde41d08ebfb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:05.419454 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2a18bafd-d110-451a-8117-fde41d08ebfb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:05.446148 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a18bafd-d110-451a-8117-fde41d08ebfb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:05.446796 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a18bafd-d110-451a-8117-fde41d08ebfb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:05.447255 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a18bafd-d110-451a-8117-fde41d08ebfb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:05.452403 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a18bafd-d110-451a-8117-fde41d08ebfb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:05.452928 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a18bafd-d110-451a-8117-fde41d08ebfb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:05.453379 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a18bafd-d110-451a-8117-fde41d08ebfb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:06.098039 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-b9f8e0ff-2b19-44f6-b133-2c28d53cfb52 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:34:06.098585 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-b9f8e0ff-2b19-44f6-b133-2c28d53cfb52 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:34:06.098935 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-b9f8e0ff-2b19-44f6-b133-2c28d53cfb52 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:34:06.099354 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-b9f8e0ff-2b19-44f6-b133-2c28d53cfb52 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:34:06.100180 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-b9f8e0ff-2b19-44f6-b133-2c28d53cfb52 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:34:06.115364 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9f8e0ff-2b19-44f6-b133-2c28d53cfb52 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:06.123983 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9f8e0ff-2b19-44f6-b133-2c28d53cfb52 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:06.124939 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9f8e0ff-2b19-44f6-b133-2c28d53cfb52 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:06.126647 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9f8e0ff-2b19-44f6-b133-2c28d53cfb52 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:06.127414 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9f8e0ff-2b19-44f6-b133-2c28d53cfb52 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:06.129469 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9f8e0ff-2b19-44f6-b133-2c28d53cfb52 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:06.205697 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-b9f8e0ff-2b19-44f6-b133-2c28d53cfb52 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Getting quotas for project 64c8da97f8334f7da1cd25716cc7da0d. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:34:06.224792 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-b9f8e0ff-2b19-44f6-b133-2c28d53cfb52 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Getting quotas for user 6b33e07001cb4a2db36fec14bded07f5 and project 64c8da97f8334f7da1cd25716cc7da0d. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:34:06.264134 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b9f8e0ff-2b19-44f6-b133-2c28d53cfb52 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:34:06.274480 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b9f8e0ff-2b19-44f6-b133-2c28d53cfb52 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:34:06.404811 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b9f8e0ff-2b19-44f6-b133-2c28d53cfb52 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.568192 Aug 07 01:34:06.416890 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2160/4687] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:34:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 5581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:34:06.435620 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fb4eb1d8-ea0b-4778-b303-5d420b47a7f6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:06.439704 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fb4eb1d8-ea0b-4778-b303-5d420b47a7f6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: 15bc1c11-5c46-4e17-8d01-519f3438d5e6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:06.475407 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb4eb1d8-ea0b-4778-b303-5d420b47a7f6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:06.476366 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb4eb1d8-ea0b-4778-b303-5d420b47a7f6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:06.477944 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb4eb1d8-ea0b-4778-b303-5d420b47a7f6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:06.481261 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb4eb1d8-ea0b-4778-b303-5d420b47a7f6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:06.481979 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb4eb1d8-ea0b-4778-b303-5d420b47a7f6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:06.483209 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb4eb1d8-ea0b-4778-b303-5d420b47a7f6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:06.766570 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2a18bafd-d110-451a-8117-fde41d08ebfb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:06.778423 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2a18bafd-d110-451a-8117-fde41d08ebfb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:06.791948 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2a18bafd-d110-451a-8117-fde41d08ebfb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:06.794593 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2a18bafd-d110-451a-8117-fde41d08ebfb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1739 microversion: 2.20 time: 1.385963 Aug 07 01:34:06.805908 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2528/4688] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:05 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1739 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:34:06.812492 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-58b80bd9-39be-4147-952d-ce1109ddf8a8 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:06.816046 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-58b80bd9-39be-4147-952d-ce1109ddf8a8 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] [instance: f9f5819b-6f54-4981-a640-53651d3416ba] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:06.836926 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-58b80bd9-39be-4147-952d-ce1109ddf8a8 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:06.838470 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-58b80bd9-39be-4147-952d-ce1109ddf8a8 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:06.840369 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-58b80bd9-39be-4147-952d-ce1109ddf8a8 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:06.841484 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-58b80bd9-39be-4147-952d-ce1109ddf8a8 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:06.844369 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-58b80bd9-39be-4147-952d-ce1109ddf8a8 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:06.845808 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-58b80bd9-39be-4147-952d-ce1109ddf8a8 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:07.149063 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fb4eb1d8-ea0b-4778-b303-5d420b47a7f6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:07.169398 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-58b80bd9-39be-4147-952d-ce1109ddf8a8 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:07.179958 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-58b80bd9-39be-4147-952d-ce1109ddf8a8 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:07.186308 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-58b80bd9-39be-4147-952d-ce1109ddf8a8 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:07.189555 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fb4eb1d8-ea0b-4778-b303-5d420b47a7f6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6" status: 200 len: 1319 microversion: 2.1 time: 0.768298 Aug 07 01:34:07.190956 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-58b80bd9-39be-4147-952d-ce1109ddf8a8 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] 10.222.0.39 "GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba" status: 200 len: 1409 microversion: 2.54 time: 0.383615 Aug 07 01:34:07.191562 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2161/4689] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:06 2022] GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6 => generated 1319 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:07.206961 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d964ea45-d4ec-473b-b215-6262b8b01155 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:07.219913 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d964ea45-d4ec-473b-b215-6262b8b01155 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:07.220329 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2529/4690] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:06 2022] GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba => generated 1409 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:34:07.225578 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-c6567277-b8d3-4af0-8d25-df5fc7c70e94 req-c08eb8e8-94d0-41fe-a9c5-88f3f240c609 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15bc1c11-5c46-4e17-8d01-519f3438d5e6", "tag": "87952749-1146-452c-8afa-d83b7ade25da"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:34:07.262835 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c6567277-b8d3-4af0-8d25-df5fc7c70e94 req-c08eb8e8-94d0-41fe-a9c5-88f3f240c609 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:07.264418 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c6567277-b8d3-4af0-8d25-df5fc7c70e94 req-c08eb8e8-94d0-41fe-a9c5-88f3f240c609 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:07.270095 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c6567277-b8d3-4af0-8d25-df5fc7c70e94 req-c08eb8e8-94d0-41fe-a9c5-88f3f240c609 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:07.299001 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-c6567277-b8d3-4af0-8d25-df5fc7c70e94 req-c08eb8e8-94d0-41fe-a9c5-88f3f240c609 service nova] Creating event network-changed:87952749-1146-452c-8afa-d83b7ade25da for instance 15bc1c11-5c46-4e17-8d01-519f3438d5e6 on n-h1-master-1 Aug 07 01:34:07.321800 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-c6567277-b8d3-4af0-8d25-df5fc7c70e94 req-c08eb8e8-94d0-41fe-a9c5-88f3f240c609 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108026 Aug 07 01:34:07.328315 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2530/4691] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:34:07.597532 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d964ea45-d4ec-473b-b215-6262b8b01155 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:07.615074 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d964ea45-d4ec-473b-b215-6262b8b01155 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1222 microversion: 2.1 time: 0.420597 Aug 07 01:34:07.616038 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2162/4692] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:07 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1222 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:07.830290 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8cc5d870-c720-4d6d-86ac-c04e7287cf65 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:07.831127 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8cc5d870-c720-4d6d-86ac-c04e7287cf65 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:07.861653 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8cc5d870-c720-4d6d-86ac-c04e7287cf65 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:07.865000 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8cc5d870-c720-4d6d-86ac-c04e7287cf65 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:07.865950 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8cc5d870-c720-4d6d-86ac-c04e7287cf65 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:07.870287 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8cc5d870-c720-4d6d-86ac-c04e7287cf65 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:07.871083 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8cc5d870-c720-4d6d-86ac-c04e7287cf65 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:07.872933 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8cc5d870-c720-4d6d-86ac-c04e7287cf65 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:08.214535 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c668def6-add8-473a-89c5-a8e2783ee6ab tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:08.215571 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c668def6-add8-473a-89c5-a8e2783ee6ab tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: 15bc1c11-5c46-4e17-8d01-519f3438d5e6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:08.273200 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c668def6-add8-473a-89c5-a8e2783ee6ab tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:08.273730 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c668def6-add8-473a-89c5-a8e2783ee6ab tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:08.282223 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c668def6-add8-473a-89c5-a8e2783ee6ab tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:08.283100 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c668def6-add8-473a-89c5-a8e2783ee6ab tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:08.283589 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c668def6-add8-473a-89c5-a8e2783ee6ab tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:08.284064 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c668def6-add8-473a-89c5-a8e2783ee6ab tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:08.988753 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8cc5d870-c720-4d6d-86ac-c04e7287cf65 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:09.005738 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8cc5d870-c720-4d6d-86ac-c04e7287cf65 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:09.007600 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8cc5d870-c720-4d6d-86ac-c04e7287cf65 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:09.013528 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8cc5d870-c720-4d6d-86ac-c04e7287cf65 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1739 microversion: 2.20 time: 1.189530 Aug 07 01:34:09.021700 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2531/4693] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:07 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1739 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:34:09.038139 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-94e44bea-4144-472e-9eac-118c4c009210 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:09.038139 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-94e44bea-4144-472e-9eac-118c4c009210 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] [instance: f9f5819b-6f54-4981-a640-53651d3416ba] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:09.046590 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94e44bea-4144-472e-9eac-118c4c009210 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:09.047339 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94e44bea-4144-472e-9eac-118c4c009210 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:09.048330 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94e44bea-4144-472e-9eac-118c4c009210 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:09.049585 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94e44bea-4144-472e-9eac-118c4c009210 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:09.050332 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94e44bea-4144-472e-9eac-118c4c009210 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:09.051077 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94e44bea-4144-472e-9eac-118c4c009210 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:09.313253 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-94e44bea-4144-472e-9eac-118c4c009210 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:09.324129 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-94e44bea-4144-472e-9eac-118c4c009210 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:09.331537 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-94e44bea-4144-472e-9eac-118c4c009210 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:09.337288 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-94e44bea-4144-472e-9eac-118c4c009210 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] 10.222.0.39 "GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba" status: 200 len: 1409 microversion: 2.54 time: 0.304062 Aug 07 01:34:09.342704 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2532/4694] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:09 2022] GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba => generated 1409 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:34:09.360327 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6bcf83f2-726c-441a-a53e-41651a78a48d tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:09.361215 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6bcf83f2-726c-441a-a53e-41651a78a48d tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:09.375040 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6bcf83f2-726c-441a-a53e-41651a78a48d tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:09.375819 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6bcf83f2-726c-441a-a53e-41651a78a48d tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:09.376481 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6bcf83f2-726c-441a-a53e-41651a78a48d tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:09.377393 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6bcf83f2-726c-441a-a53e-41651a78a48d tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:09.378017 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6bcf83f2-726c-441a-a53e-41651a78a48d tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:09.378615 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6bcf83f2-726c-441a-a53e-41651a78a48d tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:09.601659 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c668def6-add8-473a-89c5-a8e2783ee6ab tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:09.613244 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c668def6-add8-473a-89c5-a8e2783ee6ab tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6" status: 200 len: 1319 microversion: 2.1 time: 1.403997 Aug 07 01:34:09.618861 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2163/4695] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:08 2022] GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6 => generated 1319 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:34:09.672022 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6bcf83f2-726c-441a-a53e-41651a78a48d tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:09.688859 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6bcf83f2-726c-441a-a53e-41651a78a48d tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1280 microversion: 2.1 time: 0.344752 Aug 07 01:34:09.690238 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2533/4696] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:09 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1280 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:10.046454 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-705d4090-958d-47f4-bd7f-1039c24ae0b9 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:10.047194 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-705d4090-958d-47f4-bd7f-1039c24ae0b9 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:10.064670 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-705d4090-958d-47f4-bd7f-1039c24ae0b9 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:10.071006 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-705d4090-958d-47f4-bd7f-1039c24ae0b9 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:10.071505 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-705d4090-958d-47f4-bd7f-1039c24ae0b9 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:10.072306 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-705d4090-958d-47f4-bd7f-1039c24ae0b9 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:10.072779 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-705d4090-958d-47f4-bd7f-1039c24ae0b9 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:10.073205 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-705d4090-958d-47f4-bd7f-1039c24ae0b9 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:10.394277 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a4bd517a-de4f-4c33-b201-fc4e6f09ca77 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:10.397028 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a4bd517a-de4f-4c33-b201-fc4e6f09ca77 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] [instance: f9f5819b-6f54-4981-a640-53651d3416ba] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:10.422436 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4bd517a-de4f-4c33-b201-fc4e6f09ca77 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:10.423164 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4bd517a-de4f-4c33-b201-fc4e6f09ca77 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:10.423679 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4bd517a-de4f-4c33-b201-fc4e6f09ca77 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:10.426308 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4bd517a-de4f-4c33-b201-fc4e6f09ca77 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:10.427624 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4bd517a-de4f-4c33-b201-fc4e6f09ca77 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:10.450646 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4bd517a-de4f-4c33-b201-fc4e6f09ca77 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:11.002110 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a4bd517a-de4f-4c33-b201-fc4e6f09ca77 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:11.021894 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a4bd517a-de4f-4c33-b201-fc4e6f09ca77 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:11.027931 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a4bd517a-de4f-4c33-b201-fc4e6f09ca77 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:11.040475 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a4bd517a-de4f-4c33-b201-fc4e6f09ca77 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] 10.222.0.39 "GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba" status: 200 len: 1409 microversion: 2.54 time: 0.647825 Aug 07 01:34:11.057056 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2534/4697] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:10 2022] GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba => generated 1409 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:34:11.081575 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d04711b0-80a7-4cc9-a31e-f535b97e5b80 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:11.087615 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d04711b0-80a7-4cc9-a31e-f535b97e5b80 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: 15bc1c11-5c46-4e17-8d01-519f3438d5e6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:11.120311 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d04711b0-80a7-4cc9-a31e-f535b97e5b80 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:11.120537 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d04711b0-80a7-4cc9-a31e-f535b97e5b80 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:11.121496 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d04711b0-80a7-4cc9-a31e-f535b97e5b80 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:11.126327 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d04711b0-80a7-4cc9-a31e-f535b97e5b80 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:11.126850 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d04711b0-80a7-4cc9-a31e-f535b97e5b80 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:11.127292 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d04711b0-80a7-4cc9-a31e-f535b97e5b80 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:11.134645 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:11.217801 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-705d4090-958d-47f4-bd7f-1039c24ae0b9 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:11.236885 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-705d4090-958d-47f4-bd7f-1039c24ae0b9 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:11.242748 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-705d4090-958d-47f4-bd7f-1039c24ae0b9 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:11.252468 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-705d4090-958d-47f4-bd7f-1039c24ae0b9 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1739 microversion: 2.20 time: 1.206900 Aug 07 01:34:11.253284 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2164/4698] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:10 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1739 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:34:11.270290 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bf2b7fca-65b0-45aa-8fff-766f154de3fc tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:11.273950 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bf2b7fca-65b0-45aa-8fff-766f154de3fc tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:11.295595 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf2b7fca-65b0-45aa-8fff-766f154de3fc tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:11.297662 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf2b7fca-65b0-45aa-8fff-766f154de3fc tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:11.298288 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf2b7fca-65b0-45aa-8fff-766f154de3fc tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:11.301560 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf2b7fca-65b0-45aa-8fff-766f154de3fc tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:11.303542 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf2b7fca-65b0-45aa-8fff-766f154de3fc tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:11.305071 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf2b7fca-65b0-45aa-8fff-766f154de3fc tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:11.444978 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bf2b7fca-65b0-45aa-8fff-766f154de3fc tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:11.458396 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bf2b7fca-65b0-45aa-8fff-766f154de3fc tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1280 microversion: 2.1 time: 0.202131 Aug 07 01:34:11.459003 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2165/4699] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:11 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1280 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:11.600119 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d04711b0-80a7-4cc9-a31e-f535b97e5b80 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:11.624246 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d04711b0-80a7-4cc9-a31e-f535b97e5b80 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6" status: 200 len: 1319 microversion: 2.1 time: 0.565609 Aug 07 01:34:11.624822 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2535/4700] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:11 2022] GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6 => generated 1319 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:12.073830 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c3e0ed44-5af7-47e2-adb3-3b17b648cd03 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:12.075225 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c3e0ed44-5af7-47e2-adb3-3b17b648cd03 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] [instance: f9f5819b-6f54-4981-a640-53651d3416ba] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:12.095580 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3e0ed44-5af7-47e2-adb3-3b17b648cd03 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:12.096445 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3e0ed44-5af7-47e2-adb3-3b17b648cd03 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:12.096910 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3e0ed44-5af7-47e2-adb3-3b17b648cd03 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:12.097873 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3e0ed44-5af7-47e2-adb3-3b17b648cd03 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:12.121225 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3e0ed44-5af7-47e2-adb3-3b17b648cd03 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:12.121693 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3e0ed44-5af7-47e2-adb3-3b17b648cd03 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:12.279407 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d3f8131b-849b-420a-b258-4eb2a5bbc10c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:12.281362 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d3f8131b-849b-420a-b258-4eb2a5bbc10c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:12.302661 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3f8131b-849b-420a-b258-4eb2a5bbc10c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:12.303193 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3f8131b-849b-420a-b258-4eb2a5bbc10c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:12.303647 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3f8131b-849b-420a-b258-4eb2a5bbc10c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:12.304406 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3f8131b-849b-420a-b258-4eb2a5bbc10c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:12.304876 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3f8131b-849b-420a-b258-4eb2a5bbc10c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:12.305310 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3f8131b-849b-420a-b258-4eb2a5bbc10c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:12.405998 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c3e0ed44-5af7-47e2-adb3-3b17b648cd03 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:12.420525 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c3e0ed44-5af7-47e2-adb3-3b17b648cd03 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:12.429069 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c3e0ed44-5af7-47e2-adb3-3b17b648cd03 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:12.432180 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c3e0ed44-5af7-47e2-adb3-3b17b648cd03 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] 10.222.0.39 "GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba" status: 200 len: 1427 microversion: 2.54 time: 0.363623 Aug 07 01:34:12.434254 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2166/4701] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:12 2022] GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba => generated 1427 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:34:12.479224 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-018f13c0-0cab-4395-90b3-9934166bc90e tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:12.480601 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-018f13c0-0cab-4395-90b3-9934166bc90e tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:12.496055 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-018f13c0-0cab-4395-90b3-9934166bc90e tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:12.501316 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-018f13c0-0cab-4395-90b3-9934166bc90e tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:12.502091 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-018f13c0-0cab-4395-90b3-9934166bc90e tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:12.504642 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-018f13c0-0cab-4395-90b3-9934166bc90e tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:12.510234 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-018f13c0-0cab-4395-90b3-9934166bc90e tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:12.510813 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-018f13c0-0cab-4395-90b3-9934166bc90e tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:12.907073 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d3f8131b-849b-420a-b258-4eb2a5bbc10c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:12.918841 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d3f8131b-849b-420a-b258-4eb2a5bbc10c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:12.920542 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d3f8131b-849b-420a-b258-4eb2a5bbc10c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:12.921771 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d3f8131b-849b-420a-b258-4eb2a5bbc10c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1721 microversion: 2.20 time: 0.646320 Aug 07 01:34:12.922342 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2536/4702] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:12 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1721 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:34:12.952162 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2ea863ae-87ec-42c9-b7bb-639314fde08e tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:12.952897 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2ea863ae-87ec-42c9-b7bb-639314fde08e tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: 15bc1c11-5c46-4e17-8d01-519f3438d5e6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:12.985546 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2ea863ae-87ec-42c9-b7bb-639314fde08e tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:12.988378 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2ea863ae-87ec-42c9-b7bb-639314fde08e tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:12.993709 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2ea863ae-87ec-42c9-b7bb-639314fde08e tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:12.995322 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2ea863ae-87ec-42c9-b7bb-639314fde08e tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:12.997207 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2ea863ae-87ec-42c9-b7bb-639314fde08e tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:12.997991 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2ea863ae-87ec-42c9-b7bb-639314fde08e tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:13.281989 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2ea863ae-87ec-42c9-b7bb-639314fde08e tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:13.296959 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2ea863ae-87ec-42c9-b7bb-639314fde08e tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6" status: 200 len: 1319 microversion: 2.1 time: 0.364919 Aug 07 01:34:13.299519 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2537/4703] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:12 2022] GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6 => generated 1319 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:13.310153 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-c7d3289e-af30-4426-987e-f561eeefdc7c req-47948825-e944-4230-826e-c621c91c8eff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09c893ea-9683-476d-88fa-5b05a5373d68", "name": "network-vif-plugged", "status": "completed", "tag": "0fecb544-34bf-4d56-ab2c-8eaec81edefc"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:34:13.339981 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c7d3289e-af30-4426-987e-f561eeefdc7c req-47948825-e944-4230-826e-c621c91c8eff service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:13.340840 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c7d3289e-af30-4426-987e-f561eeefdc7c req-47948825-e944-4230-826e-c621c91c8eff service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:13.341269 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c7d3289e-af30-4426-987e-f561eeefdc7c req-47948825-e944-4230-826e-c621c91c8eff service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:13.368084 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-c7d3289e-af30-4426-987e-f561eeefdc7c req-47948825-e944-4230-826e-c621c91c8eff service nova] Creating event network-vif-plugged:0fecb544-34bf-4d56-ab2c-8eaec81edefc for instance 09c893ea-9683-476d-88fa-5b05a5373d68 on n-h1-master-1 Aug 07 01:34:13.389427 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-c7d3289e-af30-4426-987e-f561eeefdc7c req-47948825-e944-4230-826e-c621c91c8eff service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086735 Aug 07 01:34:13.390574 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2538/4704] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:34:13.478075 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-228d079d-1f89-48f6-a78b-2f34b2206bad tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:13.479554 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-228d079d-1f89-48f6-a78b-2f34b2206bad tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] [instance: f9f5819b-6f54-4981-a640-53651d3416ba] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:13.496746 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-228d079d-1f89-48f6-a78b-2f34b2206bad tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:13.497353 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-228d079d-1f89-48f6-a78b-2f34b2206bad tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:13.498147 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-228d079d-1f89-48f6-a78b-2f34b2206bad tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:13.500111 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-228d079d-1f89-48f6-a78b-2f34b2206bad tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:13.500905 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-228d079d-1f89-48f6-a78b-2f34b2206bad tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:13.501505 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-228d079d-1f89-48f6-a78b-2f34b2206bad tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:13.560651 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-018f13c0-0cab-4395-90b3-9934166bc90e tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:13.576490 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-018f13c0-0cab-4395-90b3-9934166bc90e tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1322 microversion: 2.1 time: 1.100487 Aug 07 01:34:13.578170 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2167/4705] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:12 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1322 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:13.650217 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-228d079d-1f89-48f6-a78b-2f34b2206bad tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:13.666230 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-228d079d-1f89-48f6-a78b-2f34b2206bad tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:13.673221 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-228d079d-1f89-48f6-a78b-2f34b2206bad tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:13.674518 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-228d079d-1f89-48f6-a78b-2f34b2206bad tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] 10.222.0.39 "GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba" status: 200 len: 1415 microversion: 2.54 time: 0.204297 Aug 07 01:34:13.675750 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2539/4706] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:13 2022] GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba => generated 1415 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:34:13.954229 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0e4308ad-c48e-43ee-894a-ca86efcaaec3 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:13.955374 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0e4308ad-c48e-43ee-894a-ca86efcaaec3 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:13.979033 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e4308ad-c48e-43ee-894a-ca86efcaaec3 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:13.979843 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e4308ad-c48e-43ee-894a-ca86efcaaec3 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:13.980486 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e4308ad-c48e-43ee-894a-ca86efcaaec3 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:13.988094 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e4308ad-c48e-43ee-894a-ca86efcaaec3 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:13.988966 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e4308ad-c48e-43ee-894a-ca86efcaaec3 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:13.989570 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e4308ad-c48e-43ee-894a-ca86efcaaec3 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:14.319166 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2df8f6e9-5c0e-4828-906c-ca6462564779 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:14.319780 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2df8f6e9-5c0e-4828-906c-ca6462564779 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: 15bc1c11-5c46-4e17-8d01-519f3438d5e6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:14.329018 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2df8f6e9-5c0e-4828-906c-ca6462564779 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:14.329526 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2df8f6e9-5c0e-4828-906c-ca6462564779 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:14.330001 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2df8f6e9-5c0e-4828-906c-ca6462564779 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:14.355364 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2df8f6e9-5c0e-4828-906c-ca6462564779 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:14.356216 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2df8f6e9-5c0e-4828-906c-ca6462564779 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:14.375805 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2df8f6e9-5c0e-4828-906c-ca6462564779 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:14.629223 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0e4308ad-c48e-43ee-894a-ca86efcaaec3 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:14.646622 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0e4308ad-c48e-43ee-894a-ca86efcaaec3 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:14.648261 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0e4308ad-c48e-43ee-894a-ca86efcaaec3 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:14.649503 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0e4308ad-c48e-43ee-894a-ca86efcaaec3 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1721 microversion: 2.20 time: 0.702558 Aug 07 01:34:14.674273 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2168/4707] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:13 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1721 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:34:14.690182 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2fe3fdd1-8349-4f73-a7b1-612659c4a2ef tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:14.695931 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2fe3fdd1-8349-4f73-a7b1-612659c4a2ef tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:14.719188 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2fe3fdd1-8349-4f73-a7b1-612659c4a2ef tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:14.719857 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2fe3fdd1-8349-4f73-a7b1-612659c4a2ef tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:14.720341 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2fe3fdd1-8349-4f73-a7b1-612659c4a2ef tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:14.723765 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2fe3fdd1-8349-4f73-a7b1-612659c4a2ef tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:14.726072 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2fe3fdd1-8349-4f73-a7b1-612659c4a2ef tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:14.728170 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2fe3fdd1-8349-4f73-a7b1-612659c4a2ef tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:15.037552 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2df8f6e9-5c0e-4828-906c-ca6462564779 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:15.064238 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2df8f6e9-5c0e-4828-906c-ca6462564779 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6" status: 200 len: 1319 microversion: 2.1 time: 0.748950 Aug 07 01:34:15.074441 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2540/4708] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:14 2022] GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6 => generated 1319 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:15.084987 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4c4d3601-565d-48ab-b6c1-edf5ce060851 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:15.085667 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4c4d3601-565d-48ab-b6c1-edf5ce060851 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] [instance: f9f5819b-6f54-4981-a640-53651d3416ba] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:15.108340 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c4d3601-565d-48ab-b6c1-edf5ce060851 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:15.108838 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c4d3601-565d-48ab-b6c1-edf5ce060851 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:15.109277 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c4d3601-565d-48ab-b6c1-edf5ce060851 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:15.109992 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c4d3601-565d-48ab-b6c1-edf5ce060851 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:15.117315 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c4d3601-565d-48ab-b6c1-edf5ce060851 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:15.118001 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c4d3601-565d-48ab-b6c1-edf5ce060851 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:15.304744 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4c4d3601-565d-48ab-b6c1-edf5ce060851 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:15.327084 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4c4d3601-565d-48ab-b6c1-edf5ce060851 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:15.330447 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4c4d3601-565d-48ab-b6c1-edf5ce060851 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:15.331691 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4c4d3601-565d-48ab-b6c1-edf5ce060851 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] 10.222.0.39 "GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba" status: 200 len: 1400 microversion: 2.54 time: 0.256135 Aug 07 01:34:15.343354 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2541/4709] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:15 2022] GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba => generated 1400 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:34:15.362116 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f63fa5f1-c61f-4f2b-ba7a-378104d14d67 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Calling method '.version_select at 0x7f9e24bd2c10>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:15.418298 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f63fa5f1-c61f-4f2b-ba7a-378104d14d67 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1632573971" status: 204 len: 0 microversion: 2.54 time: 0.063331 Aug 07 01:34:15.423333 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2542/4710] 10.222.0.39 () {60 vars in 1319 bytes} [Sun Aug 7 01:34:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1632573971 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 01:34:15.448806 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-55717334-d0c4-4d80-893e-3112b62bc888 req-41960d15-17a3-4a64-bd78-446f41dc1543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4071f699-43c7-4c36-ada4-8f0dceb6cc91", "name": "network-vif-unplugged", "status": "completed", "tag": "a4d2050c-f5b0-4218-a72d-272334938cd5"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:34:15.472014 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-55717334-d0c4-4d80-893e-3112b62bc888 req-41960d15-17a3-4a64-bd78-446f41dc1543 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:15.473872 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-55717334-d0c4-4d80-893e-3112b62bc888 req-41960d15-17a3-4a64-bd78-446f41dc1543 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:15.475449 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-55717334-d0c4-4d80-893e-3112b62bc888 req-41960d15-17a3-4a64-bd78-446f41dc1543 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:15.507248 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-55717334-d0c4-4d80-893e-3112b62bc888 req-41960d15-17a3-4a64-bd78-446f41dc1543 service nova] Creating event network-vif-unplugged:a4d2050c-f5b0-4218-a72d-272334938cd5 for instance 4071f699-43c7-4c36-ada4-8f0dceb6cc91 on n-h2-master-1 Aug 07 01:34:15.518540 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-55717334-d0c4-4d80-893e-3112b62bc888 req-41960d15-17a3-4a64-bd78-446f41dc1543 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093672 Aug 07 01:34:15.519677 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2fe3fdd1-8349-4f73-a7b1-612659c4a2ef tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:15.520784 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2543/4711] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:34:15.531989 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-62d32ab4-a359-49c2-9603-6170b452f220 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:15.535573 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-62d32ab4-a359-49c2-9603-6170b452f220 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] [instance: f9f5819b-6f54-4981-a640-53651d3416ba] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:15.542987 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2fe3fdd1-8349-4f73-a7b1-612659c4a2ef tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1322 microversion: 2.1 time: 0.858676 Aug 07 01:34:15.553273 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2169/4712] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:14 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1322 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:15.554481 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62d32ab4-a359-49c2-9603-6170b452f220 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:15.555262 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62d32ab4-a359-49c2-9603-6170b452f220 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:15.555724 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62d32ab4-a359-49c2-9603-6170b452f220 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:15.556492 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62d32ab4-a359-49c2-9603-6170b452f220 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:15.556958 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62d32ab4-a359-49c2-9603-6170b452f220 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:15.557459 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62d32ab4-a359-49c2-9603-6170b452f220 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:15.614751 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-b6c46555-110b-4834-b370-83b4a8c2b860 req-2b0eeef7-48da-4135-b0e4-856f27d43951 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afe29183-ebc5-4f1b-af8b-1eb2bbbfffad", "tag": "d21f91e9-787f-44e2-996b-ca2635e32ba6"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:34:15.628258 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-62d32ab4-a359-49c2-9603-6170b452f220 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] [instance: f9f5819b-6f54-4981-a640-53651d3416ba] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:34:15.672107 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b6c46555-110b-4834-b370-83b4a8c2b860 req-2b0eeef7-48da-4135-b0e4-856f27d43951 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:15.673484 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b6c46555-110b-4834-b370-83b4a8c2b860 req-2b0eeef7-48da-4135-b0e4-856f27d43951 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:15.675428 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b6c46555-110b-4834-b370-83b4a8c2b860 req-2b0eeef7-48da-4135-b0e4-856f27d43951 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:15.718680 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-b6c46555-110b-4834-b370-83b4a8c2b860 req-2b0eeef7-48da-4135-b0e4-856f27d43951 service nova] Creating event network-changed:d21f91e9-787f-44e2-996b-ca2635e32ba6 for instance afe29183-ebc5-4f1b-af8b-1eb2bbbfffad on n-h2-master-1 Aug 07 01:34:15.728400 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-b6c46555-110b-4834-b370-83b4a8c2b860 req-2b0eeef7-48da-4135-b0e4-856f27d43951 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120188 Aug 07 01:34:15.733210 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2170/4713] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:34:15.751492 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e873ae62-1418-42ee-8057-7ce640dbc6a4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:15.752316 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e873ae62-1418-42ee-8057-7ce640dbc6a4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:15.763193 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-62d32ab4-a359-49c2-9603-6170b452f220 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba" status: 204 len: 0 microversion: 2.54 time: 0.237283 Aug 07 01:34:15.771309 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e873ae62-1418-42ee-8057-7ce640dbc6a4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:15.771987 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2544/4714] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Aug 7 01:34:15 2022] DELETE /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 01:34:15.772586 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e873ae62-1418-42ee-8057-7ce640dbc6a4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:15.793782 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e873ae62-1418-42ee-8057-7ce640dbc6a4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:15.794854 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e873ae62-1418-42ee-8057-7ce640dbc6a4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:15.795622 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e873ae62-1418-42ee-8057-7ce640dbc6a4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:15.796391 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e873ae62-1418-42ee-8057-7ce640dbc6a4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:15.806622 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2215c593-7ae0-41f9-a64f-aa3b47e16dbf tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:15.806622 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2215c593-7ae0-41f9-a64f-aa3b47e16dbf tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] [instance: f9f5819b-6f54-4981-a640-53651d3416ba] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:15.807639 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2215c593-7ae0-41f9-a64f-aa3b47e16dbf tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:15.808874 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2215c593-7ae0-41f9-a64f-aa3b47e16dbf tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:15.809640 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2215c593-7ae0-41f9-a64f-aa3b47e16dbf tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:15.810555 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2215c593-7ae0-41f9-a64f-aa3b47e16dbf tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:15.811212 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2215c593-7ae0-41f9-a64f-aa3b47e16dbf tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:15.811786 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2215c593-7ae0-41f9-a64f-aa3b47e16dbf tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:15.963213 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2215c593-7ae0-41f9-a64f-aa3b47e16dbf tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:15.978673 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2215c593-7ae0-41f9-a64f-aa3b47e16dbf tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:15.983317 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2215c593-7ae0-41f9-a64f-aa3b47e16dbf tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:15.986478 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2215c593-7ae0-41f9-a64f-aa3b47e16dbf tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] 10.222.0.39 "GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba" status: 200 len: 1406 microversion: 2.54 time: 0.211847 Aug 07 01:34:15.987075 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2545/4715] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:15 2022] GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:34:16.083586 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e873ae62-1418-42ee-8057-7ce640dbc6a4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:16.092981 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-85f4d8e7-e2d3-4523-b68e-b8b041e3405c tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:16.093987 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-85f4d8e7-e2d3-4523-b68e-b8b041e3405c tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: 15bc1c11-5c46-4e17-8d01-519f3438d5e6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:16.096931 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:16.114236 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-85f4d8e7-e2d3-4523-b68e-b8b041e3405c tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:16.117016 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-85f4d8e7-e2d3-4523-b68e-b8b041e3405c tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:16.117736 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-85f4d8e7-e2d3-4523-b68e-b8b041e3405c tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:16.118704 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-85f4d8e7-e2d3-4523-b68e-b8b041e3405c tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:16.122602 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-85f4d8e7-e2d3-4523-b68e-b8b041e3405c tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:16.123319 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-85f4d8e7-e2d3-4523-b68e-b8b041e3405c tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:16.123996 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e873ae62-1418-42ee-8057-7ce640dbc6a4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:16.126584 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e873ae62-1418-42ee-8057-7ce640dbc6a4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:16.128958 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e873ae62-1418-42ee-8057-7ce640dbc6a4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1721 microversion: 2.20 time: 0.394621 Aug 07 01:34:16.133238 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2171/4716] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:15 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1721 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:34:16.487722 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-85f4d8e7-e2d3-4523-b68e-b8b041e3405c tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:16.498554 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-85f4d8e7-e2d3-4523-b68e-b8b041e3405c tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6" status: 200 len: 1319 microversion: 2.1 time: 0.410600 Aug 07 01:34:16.499771 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2546/4717] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:16 2022] GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6 => generated 1319 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:16.566472 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fcfa7622-c1c5-4512-b35c-b99fb60be8e4 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:16.569356 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fcfa7622-c1c5-4512-b35c-b99fb60be8e4 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:16.578381 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:16.590345 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fcfa7622-c1c5-4512-b35c-b99fb60be8e4 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:16.592675 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fcfa7622-c1c5-4512-b35c-b99fb60be8e4 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:16.593399 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fcfa7622-c1c5-4512-b35c-b99fb60be8e4 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:16.594397 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fcfa7622-c1c5-4512-b35c-b99fb60be8e4 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:16.596707 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fcfa7622-c1c5-4512-b35c-b99fb60be8e4 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:16.597285 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fcfa7622-c1c5-4512-b35c-b99fb60be8e4 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:16.795756 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fcfa7622-c1c5-4512-b35c-b99fb60be8e4 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:16.806143 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fcfa7622-c1c5-4512-b35c-b99fb60be8e4 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1322 microversion: 2.1 time: 0.243017 Aug 07 01:34:16.807402 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2172/4718] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:16 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:17.010876 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cf821a60-f8ff-49f0-a274-f607ad849b84 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:17.012279 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-cf821a60-f8ff-49f0-a274-f607ad849b84 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] [instance: f9f5819b-6f54-4981-a640-53651d3416ba] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:17.025796 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cf821a60-f8ff-49f0-a274-f607ad849b84 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:17.030759 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cf821a60-f8ff-49f0-a274-f607ad849b84 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:17.031502 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cf821a60-f8ff-49f0-a274-f607ad849b84 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:17.032656 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cf821a60-f8ff-49f0-a274-f607ad849b84 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:17.034799 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cf821a60-f8ff-49f0-a274-f607ad849b84 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:17.035432 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cf821a60-f8ff-49f0-a274-f607ad849b84 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:17.188557 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fe9d2c47-6bbe-41fa-a1a8-a1055b9a20a6 tempest-ServerGroup264TestJSON-857555293 tempest-ServerGroup264TestJSON-857555293-project] Action: 'create', calling method: .version_select at 0x7f9e177dc790>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:34:17.208055 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-fe9d2c47-6bbe-41fa-a1a8-a1055b9a20a6 tempest-ServerGroup264TestJSON-857555293 tempest-ServerGroup264TestJSON-857555293-project] Getting quotas for project 9a871883160d4b9483b7009fbe485690. Resources: {'server_groups'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:34:17.218414 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-fe9d2c47-6bbe-41fa-a1a8-a1055b9a20a6 tempest-ServerGroup264TestJSON-857555293 tempest-ServerGroup264TestJSON-857555293-project] Getting quotas for user 063427be95f64488bfa71df1f90e1400 and project 9a871883160d4b9483b7009fbe485690. Resources: {'server_groups'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:34:17.292036 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-fe9d2c47-6bbe-41fa-a1a8-a1055b9a20a6 tempest-ServerGroup264TestJSON-857555293 tempest-ServerGroup264TestJSON-857555293-project] Getting quotas for project 9a871883160d4b9483b7009fbe485690. Resources: {'server_groups'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:34:17.300157 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-cf821a60-f8ff-49f0-a274-f607ad849b84 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:17.320127 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-fe9d2c47-6bbe-41fa-a1a8-a1055b9a20a6 tempest-ServerGroup264TestJSON-857555293 tempest-ServerGroup264TestJSON-857555293-project] Getting quotas for user 063427be95f64488bfa71df1f90e1400 and project 9a871883160d4b9483b7009fbe485690. Resources: {'server_groups'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:34:17.321558 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-cf821a60-f8ff-49f0-a274-f607ad849b84 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:17.325389 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-cf821a60-f8ff-49f0-a274-f607ad849b84 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:17.326854 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cf821a60-f8ff-49f0-a274-f607ad849b84 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] 10.222.0.39 "GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba" status: 200 len: 1406 microversion: 2.54 time: 0.319973 Aug 07 01:34:17.327949 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2173/4719] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:17 2022] GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba => generated 1406 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:34:17.340381 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-dc7e042b-cc27-467c-bc30-c03e8d44e08f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:17.342411 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-dc7e042b-cc27-467c-bc30-c03e8d44e08f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:17.357782 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dc7e042b-cc27-467c-bc30-c03e8d44e08f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:17.359727 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:17.364087 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dc7e042b-cc27-467c-bc30-c03e8d44e08f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:17.364655 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dc7e042b-cc27-467c-bc30-c03e8d44e08f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:17.365428 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dc7e042b-cc27-467c-bc30-c03e8d44e08f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:17.366210 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dc7e042b-cc27-467c-bc30-c03e8d44e08f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:17.366651 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dc7e042b-cc27-467c-bc30-c03e8d44e08f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:17.373222 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fe9d2c47-6bbe-41fa-a1a8-a1055b9a20a6 tempest-ServerGroup264TestJSON-857555293 tempest-ServerGroup264TestJSON-857555293-project] 10.222.0.39 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.477739 Aug 07 01:34:17.378309 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2547/4720] 10.222.0.39 () {62 vars in 1214 bytes} [Sun Aug 7 01:34:16 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:34:17.403579 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bb02da7c-ca10-4e99-aeac-3457dfc32ea7 tempest-ServerGroup264TestJSON-857555293 tempest-ServerGroup264TestJSON-857555293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:17.435256 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bb02da7c-ca10-4e99-aeac-3457dfc32ea7 tempest-ServerGroup264TestJSON-857555293 tempest-ServerGroup264TestJSON-857555293-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.049207 Aug 07 01:34:17.436637 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2548/4721] 10.222.0.39 () {60 vars in 1193 bytes} [Sun Aug 7 01:34:17 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 01:34:17.449332 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ea4ff7eb-8ce3-4759-8e82-149685c2d575 tempest-ServerGroup264TestJSON-857555293 tempest-ServerGroup264TestJSON-857555293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:17.467396 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ea4ff7eb-8ce3-4759-8e82-149685c2d575 tempest-ServerGroup264TestJSON-857555293 tempest-ServerGroup264TestJSON-857555293-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups/9824ea63-69a3-42a7-8567-24543a61762f" status: 200 len: 235 microversion: 2.64 time: 0.023588 Aug 07 01:34:17.467983 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2549/4722] 10.222.0.39 () {60 vars in 1304 bytes} [Sun Aug 7 01:34:17 2022] GET /compute/v2.1/os-server-groups/9824ea63-69a3-42a7-8567-24543a61762f => generated 235 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:34:17.481137 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-435291b6-1e16-4095-b227-678816bf8d44 tempest-ServerGroup264TestJSON-857555293 tempest-ServerGroup264TestJSON-857555293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:17.517362 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-435291b6-1e16-4095-b227-678816bf8d44 tempest-ServerGroup264TestJSON-857555293 tempest-ServerGroup264TestJSON-857555293-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/9824ea63-69a3-42a7-8567-24543a61762f" status: 204 len: 0 microversion: 2.64 time: 0.042390 Aug 07 01:34:17.518312 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2550/4723] 10.222.0.39 () {60 vars in 1307 bytes} [Sun Aug 7 01:34:17 2022] DELETE /compute/v2.1/os-server-groups/9824ea63-69a3-42a7-8567-24543a61762f => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 07 01:34:17.534519 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-599b9f08-5010-47d8-8427-1e595ec84c05 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:17.534519 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-599b9f08-5010-47d8-8427-1e595ec84c05 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: 15bc1c11-5c46-4e17-8d01-519f3438d5e6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:17.558626 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-599b9f08-5010-47d8-8427-1e595ec84c05 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:17.559388 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-599b9f08-5010-47d8-8427-1e595ec84c05 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:17.561720 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-599b9f08-5010-47d8-8427-1e595ec84c05 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:17.563865 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-599b9f08-5010-47d8-8427-1e595ec84c05 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:17.565221 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-599b9f08-5010-47d8-8427-1e595ec84c05 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:17.565941 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-599b9f08-5010-47d8-8427-1e595ec84c05 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:17.608300 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=8 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:17.826916 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-599b9f08-5010-47d8-8427-1e595ec84c05 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:17.839805 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-599b9f08-5010-47d8-8427-1e595ec84c05 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6" status: 200 len: 1319 microversion: 2.1 time: 0.319020 Aug 07 01:34:17.841669 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2551/4724] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:17 2022] GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6 => generated 1319 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:17.847772 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e73a23ed-f693-4ac1-8a21-1f06591f3250 tempest-ServerGroup264TestJSON-857555293 tempest-ServerGroup264TestJSON-857555293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:17.854150 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-e73a23ed-f693-4ac1-8a21-1f06591f3250 tempest-ServerGroup264TestJSON-857555293 tempest-ServerGroup264TestJSON-857555293-project] HTTP exception thrown: Instance group 9824ea63-69a3-42a7-8567-24543a61762f could not be found. Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e73a23ed-f693-4ac1-8a21-1f06591f3250 tempest-ServerGroup264TestJSON-857555293 tempest-ServerGroup264TestJSON-857555293-project] Request method failure captured: Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/os-server-groups/9824ea63-69a3-42a7-8567-24543a61762f HTTP/1.1 Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xaYAw6CnXROHuzdDmPBkN7sPxehvtsbPiaK-fnwcl5sYwM4XRzlTVeC_F3_M9IpHGdaHIj3lLCWfZj8ihVNgX-EAVAeU1Zs9iDlQFCNBJzuc7tivhD3UK8WpooiN_T8bNnRdMbnADb0yt6orFh5IQOQ6SEnWGdUiDmI16v1IkmxAwM Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: X-Openstack-Nova-Api-Version: 2.64 Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 9a871883160d4b9483b7009fbe485690 Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServerGroup264TestJSON-857555293 Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9a871883160d4b9483b7009fbe485690"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9a871883160d4b9483b7009fbe485690", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9a871883160d4b9483b7009fbe485690"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9a871883160d4b9483b7009fbe485690"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServerGroup264TestJSON-857555293 Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 9a871883160d4b9483b7009fbe485690 Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServerGroup264TestJSON-857555293 Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServerGroup264TestJSON-857555293-project Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 063427be95f64488bfa71df1f90e1400 Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServerGroup264TestJSON-857555293-project Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: exception: Instance group 9824ea63-69a3-42a7-8567-24543a61762f could not be found. Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '9824ea63-69a3-42a7-8567-24543a61762f'} Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 9824ea63-69a3-42a7-8567-24543a61762f could not be found. Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 9824ea63-69a3-42a7-8567-24543a61762f could not be found. Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:34:17.860589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:34:17.864852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:34:17.864852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:34:17.864852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:34:17.864852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:34:17.864852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 9824ea63-69a3-42a7-8567-24543a61762f could not be found. Aug 07 01:34:17.864852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:34:17.864852 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e73a23ed-f693-4ac1-8a21-1f06591f3250 tempest-ServerGroup264TestJSON-857555293 tempest-ServerGroup264TestJSON-857555293-project] Returning 404 to user: Instance group 9824ea63-69a3-42a7-8567-24543a61762f could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:34:17.864852 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e73a23ed-f693-4ac1-8a21-1f06591f3250 tempest-ServerGroup264TestJSON-857555293 tempest-ServerGroup264TestJSON-857555293-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/9824ea63-69a3-42a7-8567-24543a61762f" status: 404 len: 117 microversion: 2.64 time: 0.019029 Aug 07 01:34:17.864852 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2552/4725] 10.222.0.39 () {60 vars in 1307 bytes} [Sun Aug 7 01:34:17 2022] DELETE /compute/v2.1/os-server-groups/9824ea63-69a3-42a7-8567-24543a61762f => generated 117 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:34:17.870881 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-81fee10d-cd03-499e-b8bd-ea89b240cfaf req-a4a6c74c-30ba-4812-b2d3-a66fbbdbf64e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15bc1c11-5c46-4e17-8d01-519f3438d5e6", "name": "network-vif-plugged", "status": "completed", "tag": "87952749-1146-452c-8afa-d83b7ade25da"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:34:17.884827 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-81fee10d-cd03-499e-b8bd-ea89b240cfaf req-a4a6c74c-30ba-4812-b2d3-a66fbbdbf64e service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:17.887063 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-81fee10d-cd03-499e-b8bd-ea89b240cfaf req-a4a6c74c-30ba-4812-b2d3-a66fbbdbf64e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:17.887750 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-81fee10d-cd03-499e-b8bd-ea89b240cfaf req-a4a6c74c-30ba-4812-b2d3-a66fbbdbf64e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:17.904967 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-81fee10d-cd03-499e-b8bd-ea89b240cfaf req-a4a6c74c-30ba-4812-b2d3-a66fbbdbf64e service nova] Creating event network-vif-plugged:87952749-1146-452c-8afa-d83b7ade25da for instance 15bc1c11-5c46-4e17-8d01-519f3438d5e6 on n-h1-master-1 Aug 07 01:34:17.911247 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-81fee10d-cd03-499e-b8bd-ea89b240cfaf req-a4a6c74c-30ba-4812-b2d3-a66fbbdbf64e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047484 Aug 07 01:34:17.912994 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2553/4726] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:34:17.919909 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-59f6c33a-f11a-442e-8769-7d1b9f3e2cf4 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:17.921214 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-59f6c33a-f11a-442e-8769-7d1b9f3e2cf4 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:17.929419 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-59f6c33a-f11a-442e-8769-7d1b9f3e2cf4 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:17.930997 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-59f6c33a-f11a-442e-8769-7d1b9f3e2cf4 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:17.931693 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-59f6c33a-f11a-442e-8769-7d1b9f3e2cf4 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:17.932707 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-59f6c33a-f11a-442e-8769-7d1b9f3e2cf4 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:17.934143 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-59f6c33a-f11a-442e-8769-7d1b9f3e2cf4 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:17.934806 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-59f6c33a-f11a-442e-8769-7d1b9f3e2cf4 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:18.068532 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-dc7e042b-cc27-467c-bc30-c03e8d44e08f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:18.079769 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-dc7e042b-cc27-467c-bc30-c03e8d44e08f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:18.093380 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-dc7e042b-cc27-467c-bc30-c03e8d44e08f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:18.094616 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-dc7e042b-cc27-467c-bc30-c03e8d44e08f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1724 microversion: 2.20 time: 0.765503 Aug 07 01:34:18.095257 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2174/4727] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:17 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1724 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:34:18.125926 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4c7ab4de-81b1-432f-a2b7-719bb9ca5375 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0ab3bfc-7b95-4efb-bee2-153f7bde3afd"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:34:18.128755 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4c7ab4de-81b1-432f-a2b7-719bb9ca5375 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:18.165558 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4c7ab4de-81b1-432f-a2b7-719bb9ca5375 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:18.166052 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4c7ab4de-81b1-432f-a2b7-719bb9ca5375 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:18.171830 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4c7ab4de-81b1-432f-a2b7-719bb9ca5375 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:18.172646 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4c7ab4de-81b1-432f-a2b7-719bb9ca5375 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:18.173129 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4c7ab4de-81b1-432f-a2b7-719bb9ca5375 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:18.173570 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4c7ab4de-81b1-432f-a2b7-719bb9ca5375 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:18.533517 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-59f6c33a-f11a-442e-8769-7d1b9f3e2cf4 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:18.547108 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-59f6c33a-f11a-442e-8769-7d1b9f3e2cf4 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1322 microversion: 2.1 time: 0.632581 Aug 07 01:34:18.550217 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2554/4728] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:17 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1322 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:18.566557 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1fa8ece3-a93c-43eb-b08e-6c5d928b8ab4 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Action: 'create', calling method: .version_select at 0x7f9e174ac820>, body: {"keypair": {"name": "tempest-keypair-1057754462", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBkU7nYdZBvv2SVOeu8i1eo+oJ22VkJhu6ZPOXHhf4BD3dkM580XSKJhBWqTUwpqP9CzLU02NIItguMwYucVyuok0C8LyHY438c1LnGt2bdDLr2OU2sUlGe7VFlzBdbBQ=="}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:34:18.593302 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-1fa8ece3-a93c-43eb-b08e-6c5d928b8ab4 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Getting quotas for project b630a4c3bb824b90b4c1898a92b47aa7. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:34:18.598992 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-1fa8ece3-a93c-43eb-b08e-6c5d928b8ab4 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Getting quotas for user d556a8ae0d524894a93203ce3f70d420 and project b630a4c3bb824b90b4c1898a92b47aa7. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:34:18.629770 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1fa8ece3-a93c-43eb-b08e-6c5d928b8ab4 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.076787 Aug 07 01:34:18.636341 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2555/4729] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:34:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:34:18.642912 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-87a67299-65f2-476e-a9ab-a7bcd866ff9f tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:18.643809 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-87a67299-65f2-476e-a9ab-a7bcd866ff9f tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] [instance: f9f5819b-6f54-4981-a640-53651d3416ba] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:18.650800 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-87a67299-65f2-476e-a9ab-a7bcd866ff9f tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:18.652190 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-87a67299-65f2-476e-a9ab-a7bcd866ff9f tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:18.652850 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-87a67299-65f2-476e-a9ab-a7bcd866ff9f tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:18.653834 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-87a67299-65f2-476e-a9ab-a7bcd866ff9f tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:18.654506 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-87a67299-65f2-476e-a9ab-a7bcd866ff9f tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:18.655147 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-87a67299-65f2-476e-a9ab-a7bcd866ff9f tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:18.820688 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4c7ab4de-81b1-432f-a2b7-719bb9ca5375 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "POST /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.698396 Aug 07 01:34:18.821452 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2175/4730] 10.222.0.39 () {62 vars in 1364 bytes} [Sun Aug 7 01:34:18 2022] POST /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments => generated 188 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 01:34:18.867177 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5f7a8f80-c32b-4145-8efc-fd4c038f254f tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:18.867844 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5f7a8f80-c32b-4145-8efc-fd4c038f254f tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: 15bc1c11-5c46-4e17-8d01-519f3438d5e6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:18.881725 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:18.919705 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f7a8f80-c32b-4145-8efc-fd4c038f254f tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:18.922153 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f7a8f80-c32b-4145-8efc-fd4c038f254f tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:18.922688 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f7a8f80-c32b-4145-8efc-fd4c038f254f tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:18.925855 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f7a8f80-c32b-4145-8efc-fd4c038f254f tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:18.926669 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f7a8f80-c32b-4145-8efc-fd4c038f254f tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:18.941048 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f7a8f80-c32b-4145-8efc-fd4c038f254f tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:19.487382 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5f7a8f80-c32b-4145-8efc-fd4c038f254f tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:19.497528 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5f7a8f80-c32b-4145-8efc-fd4c038f254f tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6" status: 200 len: 1319 microversion: 2.1 time: 0.639928 Aug 07 01:34:19.516654 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2176/4731] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:18 2022] GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6 => generated 1319 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:19.533333 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f4fb8f11-b3e6-4b2f-a9c7-6bb03524b534 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:34:19.534247 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f4fb8f11-b3e6-4b2f-a9c7-6bb03524b534 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:19.554085 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4fb8f11-b3e6-4b2f-a9c7-6bb03524b534 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:19.554926 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4fb8f11-b3e6-4b2f-a9c7-6bb03524b534 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:19.555549 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4fb8f11-b3e6-4b2f-a9c7-6bb03524b534 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:19.570608 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4fb8f11-b3e6-4b2f-a9c7-6bb03524b534 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:19.572100 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4fb8f11-b3e6-4b2f-a9c7-6bb03524b534 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:19.575824 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4fb8f11-b3e6-4b2f-a9c7-6bb03524b534 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:19.646705 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f4fb8f11-b3e6-4b2f-a9c7-6bb03524b534 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119517) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 07 01:34:19.720091 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-87a67299-65f2-476e-a9ab-a7bcd866ff9f tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:19.763369 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-87a67299-65f2-476e-a9ab-a7bcd866ff9f tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:19.788460 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-87a67299-65f2-476e-a9ab-a7bcd866ff9f tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3d46fd03134a16becae95c52ea0b55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859b28071c284ab292ba507e96df8d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:19.792805 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-87a67299-65f2-476e-a9ab-a7bcd866ff9f tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] 10.222.0.39 "GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba" status: 200 len: 1406 microversion: 2.54 time: 1.158307 Aug 07 01:34:19.809891 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2556/4732] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:18 2022] GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba => generated 1406 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:34:19.812325 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e2b8fbef-9dc0-42d0-94d8-4886cf67a2d9 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:19.817735 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e2b8fbef-9dc0-42d0-94d8-4886cf67a2d9 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:19.835925 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e2b8fbef-9dc0-42d0-94d8-4886cf67a2d9 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:19.836665 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e2b8fbef-9dc0-42d0-94d8-4886cf67a2d9 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:19.842254 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e2b8fbef-9dc0-42d0-94d8-4886cf67a2d9 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:19.843226 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e2b8fbef-9dc0-42d0-94d8-4886cf67a2d9 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:19.848464 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e2b8fbef-9dc0-42d0-94d8-4886cf67a2d9 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:19.849142 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e2b8fbef-9dc0-42d0-94d8-4886cf67a2d9 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:19.855710 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f4fb8f11-b3e6-4b2f-a9c7-6bb03524b534 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "POST /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/action" status: 202 len: 0 microversion: 2.20 time: 0.337151 Aug 07 01:34:19.857577 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2177/4733] 10.222.0.39 () {62 vars in 1319 bytes} [Sun Aug 7 01:34:19 2022] POST /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:34:19.869789 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ca3f6647-8fe7-4de0-bc72-36b2c841473f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:19.871877 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ca3f6647-8fe7-4de0-bc72-36b2c841473f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:19.887558 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca3f6647-8fe7-4de0-bc72-36b2c841473f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:19.898787 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca3f6647-8fe7-4de0-bc72-36b2c841473f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:19.900430 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca3f6647-8fe7-4de0-bc72-36b2c841473f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:19.902108 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca3f6647-8fe7-4de0-bc72-36b2c841473f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:19.908291 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca3f6647-8fe7-4de0-bc72-36b2c841473f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:19.909153 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca3f6647-8fe7-4de0-bc72-36b2c841473f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:20.442303 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ca3f6647-8fe7-4de0-bc72-36b2c841473f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:20.465223 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ca3f6647-8fe7-4de0-bc72-36b2c841473f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:20.468552 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ca3f6647-8fe7-4de0-bc72-36b2c841473f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:20.470586 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ca3f6647-8fe7-4de0-bc72-36b2c841473f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1750 microversion: 2.20 time: 0.608368 Aug 07 01:34:20.471600 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2178/4734] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:19 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1750 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:34:20.532343 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-36bf074d-8bfd-492d-990f-b24401901f9e tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:20.537243 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-36bf074d-8bfd-492d-990f-b24401901f9e tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: 15bc1c11-5c46-4e17-8d01-519f3438d5e6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:20.558020 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36bf074d-8bfd-492d-990f-b24401901f9e tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:20.559312 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36bf074d-8bfd-492d-990f-b24401901f9e tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:20.559773 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36bf074d-8bfd-492d-990f-b24401901f9e tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:20.560691 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36bf074d-8bfd-492d-990f-b24401901f9e tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:20.561178 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36bf074d-8bfd-492d-990f-b24401901f9e tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:20.562449 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36bf074d-8bfd-492d-990f-b24401901f9e tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:20.623358 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e2b8fbef-9dc0-42d0-94d8-4886cf67a2d9 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:20.633184 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e2b8fbef-9dc0-42d0-94d8-4886cf67a2d9 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1322 microversion: 2.1 time: 0.826749 Aug 07 01:34:20.636526 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2557/4735] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:19 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1322 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:20.817738 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-df35e3c9-a44f-45b4-a655-015219c57807 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:20.818467 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-df35e3c9-a44f-45b4-a655-015219c57807 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] [instance: f9f5819b-6f54-4981-a640-53651d3416ba] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:20.826238 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df35e3c9-a44f-45b4-a655-015219c57807 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:20.831388 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df35e3c9-a44f-45b4-a655-015219c57807 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:20.831851 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df35e3c9-a44f-45b4-a655-015219c57807 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:20.835552 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df35e3c9-a44f-45b4-a655-015219c57807 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:20.836279 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df35e3c9-a44f-45b4-a655-015219c57807 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:20.836728 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df35e3c9-a44f-45b4-a655-015219c57807 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:20.878292 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-df35e3c9-a44f-45b4-a655-015219c57807 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] HTTP exception thrown: Instance f9f5819b-6f54-4981-a640-53651d3416ba could not be found. Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-df35e3c9-a44f-45b4-a655-015219c57807 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Request method failure captured: Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba HTTP/1.1 Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xZwSf0-K3dxnOycYasRU9N_zNTBHa0dE_IS1VOZJsuo_6YWE7xM9Pw67TmholrVQR7RtXeze1NZfLyEz9Nw8DxQydliviYW9ewFJx2e8wGIAMoP0jzCsX4ZHS5IEwVMFECbMaPEbAaDt3WpJBH1v-n4Gjt84aGMkPiegQfiUOqydhI Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: X-Openstack-Nova-Api-Version: 2.54 Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 859b28071c284ab292ba507e96df8d3f Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServerShowV254Test-1976483217 Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/859b28071c284ab292ba507e96df8d3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_859b28071c284ab292ba507e96df8d3f", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/859b28071c284ab292ba507e96df8d3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/859b28071c284ab292ba507e96df8d3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServerShowV254Test-1976483217 Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 859b28071c284ab292ba507e96df8d3f Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServerShowV254Test-1976483217 Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServerShowV254Test-1976483217-project Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 0a3d46fd03134a16becae95c52ea0b55 Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServerShowV254Test-1976483217-project Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: exception: Instance f9f5819b-6f54-4981-a640-53651d3416ba could not be found. Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'f9f5819b-6f54-4981-a640-53651d3416ba'} Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9f5819b-6f54-4981-a640-53651d3416ba could not be found. Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9f5819b-6f54-4981-a640-53651d3416ba could not be found. Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:34:20.884016 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:34:20.888231 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:34:20.888231 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:34:20.888231 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:34:20.888231 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:34:20.888231 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:34:20.888231 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9f5819b-6f54-4981-a640-53651d3416ba could not be found. Aug 07 01:34:20.888231 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:34:20.888231 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-df35e3c9-a44f-45b4-a655-015219c57807 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] Returning 404 to user: Instance f9f5819b-6f54-4981-a640-53651d3416ba could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:34:20.888231 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-df35e3c9-a44f-45b4-a655-015219c57807 tempest-ServerShowV254Test-1976483217 tempest-ServerShowV254Test-1976483217-project] 10.222.0.39 "GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba" status: 404 len: 111 microversion: 2.54 time: 0.072389 Aug 07 01:34:20.891680 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2558/4736] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:20 2022] GET /compute/v2.1/servers/f9f5819b-6f54-4981-a640-53651d3416ba => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 07 01:34:20.894407 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-36bf074d-8bfd-492d-990f-b24401901f9e tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:20.905292 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-36bf074d-8bfd-492d-990f-b24401901f9e tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6" status: 200 len: 1506 microversion: 2.1 time: 0.385210 Aug 07 01:34:20.909586 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2179/4737] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:20 2022] GET /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6 => generated 1506 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:20.929624 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-61779f68-2b32-4774-ad5e-7e5469080437 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:20.930460 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-61779f68-2b32-4774-ad5e-7e5469080437 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: 09c893ea-9683-476d-88fa-5b05a5373d68] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:20.940587 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-61779f68-2b32-4774-ad5e-7e5469080437 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:20.941915 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-61779f68-2b32-4774-ad5e-7e5469080437 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:20.942516 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-61779f68-2b32-4774-ad5e-7e5469080437 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:20.944247 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-61779f68-2b32-4774-ad5e-7e5469080437 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:20.945051 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-61779f68-2b32-4774-ad5e-7e5469080437 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:20.945779 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-61779f68-2b32-4774-ad5e-7e5469080437 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:21.496105 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3e3c7afa-afa5-4afa-8e60-24aaae7a5d7c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:21.497333 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3e3c7afa-afa5-4afa-8e60-24aaae7a5d7c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:21.506096 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3e3c7afa-afa5-4afa-8e60-24aaae7a5d7c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:21.507287 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3e3c7afa-afa5-4afa-8e60-24aaae7a5d7c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:21.508280 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3e3c7afa-afa5-4afa-8e60-24aaae7a5d7c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:21.509407 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3e3c7afa-afa5-4afa-8e60-24aaae7a5d7c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:21.510117 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3e3c7afa-afa5-4afa-8e60-24aaae7a5d7c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:21.510855 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3e3c7afa-afa5-4afa-8e60-24aaae7a5d7c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:21.676347 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-61779f68-2b32-4774-ad5e-7e5469080437 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:21.684360 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:21.690716 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-61779f68-2b32-4774-ad5e-7e5469080437 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/09c893ea-9683-476d-88fa-5b05a5373d68" status: 200 len: 1507 microversion: 2.1 time: 0.766504 Aug 07 01:34:21.693062 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2559/4738] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:20 2022] GET /compute/v2.1/servers/09c893ea-9683-476d-88fa-5b05a5373d68 => generated 1507 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:21.712197 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-04397f82-1c11-4952-bea7-e98b789d2278 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:21.712927 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-04397f82-1c11-4952-bea7-e98b789d2278 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:21.737047 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-04397f82-1c11-4952-bea7-e98b789d2278 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:21.737558 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-04397f82-1c11-4952-bea7-e98b789d2278 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:21.738046 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-04397f82-1c11-4952-bea7-e98b789d2278 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:21.738778 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-04397f82-1c11-4952-bea7-e98b789d2278 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:21.739237 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-04397f82-1c11-4952-bea7-e98b789d2278 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:21.739668 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-04397f82-1c11-4952-bea7-e98b789d2278 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:21.925706 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3e3c7afa-afa5-4afa-8e60-24aaae7a5d7c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:21.941182 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3e3c7afa-afa5-4afa-8e60-24aaae7a5d7c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:21.949818 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3e3c7afa-afa5-4afa-8e60-24aaae7a5d7c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:21.951820 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3e3c7afa-afa5-4afa-8e60-24aaae7a5d7c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1750 microversion: 2.20 time: 0.459820 Aug 07 01:34:21.953223 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2180/4739] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:21 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1750 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:34:21.958300 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8c423b88-9bd0-4236-a8f5-2934d4ea7d94 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:21.959103 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8c423b88-9bd0-4236-a8f5-2934d4ea7d94 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: 09c893ea-9683-476d-88fa-5b05a5373d68] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:21.981073 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8c423b88-9bd0-4236-a8f5-2934d4ea7d94 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:21.981821 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8c423b88-9bd0-4236-a8f5-2934d4ea7d94 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:21.982331 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8c423b88-9bd0-4236-a8f5-2934d4ea7d94 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:21.986485 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8c423b88-9bd0-4236-a8f5-2934d4ea7d94 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:21.987048 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8c423b88-9bd0-4236-a8f5-2934d4ea7d94 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:21.987562 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8c423b88-9bd0-4236-a8f5-2934d4ea7d94 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:22.034445 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8c423b88-9bd0-4236-a8f5-2934d4ea7d94 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: 09c893ea-9683-476d-88fa-5b05a5373d68] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:34:22.309339 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8c423b88-9bd0-4236-a8f5-2934d4ea7d94 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "DELETE /compute/v2.1/servers/09c893ea-9683-476d-88fa-5b05a5373d68" status: 204 len: 0 microversion: 2.1 time: 0.351866 Aug 07 01:34:22.313822 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2181/4740] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:34:21 2022] DELETE /compute/v2.1/servers/09c893ea-9683-476d-88fa-5b05a5373d68 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:34:22.324395 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-68d9701e-683f-469d-9bb5-b1442814f292 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:22.325198 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-68d9701e-683f-469d-9bb5-b1442814f292 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: 15bc1c11-5c46-4e17-8d01-519f3438d5e6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:22.343778 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68d9701e-683f-469d-9bb5-b1442814f292 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:22.345842 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68d9701e-683f-469d-9bb5-b1442814f292 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:22.346803 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68d9701e-683f-469d-9bb5-b1442814f292 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:22.347677 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68d9701e-683f-469d-9bb5-b1442814f292 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:22.348958 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68d9701e-683f-469d-9bb5-b1442814f292 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:22.349400 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68d9701e-683f-469d-9bb5-b1442814f292 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:22.507729 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-68d9701e-683f-469d-9bb5-b1442814f292 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: 15bc1c11-5c46-4e17-8d01-519f3438d5e6] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:34:22.624755 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=5,nova_cell1:UPDATE=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:22.743760 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-68d9701e-683f-469d-9bb5-b1442814f292 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "DELETE /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6" status: 204 len: 0 microversion: 2.1 time: 0.427539 Aug 07 01:34:22.745235 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2182/4741] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:34:22 2022] DELETE /compute/v2.1/servers/15bc1c11-5c46-4e17-8d01-519f3438d5e6 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 07 01:34:22.895567 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-52880fa7-cc40-480b-9c51-54bffadb05b6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1306413183", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "8ac63cf8-be4c-4bcf-93d5-e227f883e6d1"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:34:22.977153 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-52880fa7-cc40-480b-9c51-54bffadb05b6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] validate_networks() for [('8ac63cf8-be4c-4bcf-93d5-e227f883e6d1', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:34:23.131384 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-04397f82-1c11-4952-bea7-e98b789d2278 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:23.146304 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-04397f82-1c11-4952-bea7-e98b789d2278 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1322 microversion: 2.1 time: 1.449245 Aug 07 01:34:23.149656 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2560/4742] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:21 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1322 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:23.161497 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e626903e-f142-4296-9b3c-75676fd1231f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:23.165235 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e626903e-f142-4296-9b3c-75676fd1231f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:23.178946 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e626903e-f142-4296-9b3c-75676fd1231f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:23.179365 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e626903e-f142-4296-9b3c-75676fd1231f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:23.179810 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e626903e-f142-4296-9b3c-75676fd1231f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:23.182890 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e626903e-f142-4296-9b3c-75676fd1231f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:23.183379 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e626903e-f142-4296-9b3c-75676fd1231f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:23.183822 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e626903e-f142-4296-9b3c-75676fd1231f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:23.727843 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-52880fa7-cc40-480b-9c51-54bffadb05b6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:34:23.728435 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-52880fa7-cc40-480b-9c51-54bffadb05b6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:34:23.729077 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-52880fa7-cc40-480b-9c51-54bffadb05b6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:34:23.729663 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-52880fa7-cc40-480b-9c51-54bffadb05b6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:34:23.731206 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-52880fa7-cc40-480b-9c51-54bffadb05b6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:34:23.747160 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52880fa7-cc40-480b-9c51-54bffadb05b6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:23.750426 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52880fa7-cc40-480b-9c51-54bffadb05b6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:23.750994 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52880fa7-cc40-480b-9c51-54bffadb05b6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:23.752360 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52880fa7-cc40-480b-9c51-54bffadb05b6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:23.753042 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52880fa7-cc40-480b-9c51-54bffadb05b6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:23.753815 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52880fa7-cc40-480b-9c51-54bffadb05b6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:23.782272 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-52880fa7-cc40-480b-9c51-54bffadb05b6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Getting quotas for project 5a300727d7874d83970c301327780abc. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:34:23.796814 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-52880fa7-cc40-480b-9c51-54bffadb05b6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Getting quotas for user 5f0ed400a2cb48cbbc9fa5bae0e2b1c2 and project 5a300727d7874d83970c301327780abc. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:34:23.801377 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e626903e-f142-4296-9b3c-75676fd1231f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:23.811945 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e626903e-f142-4296-9b3c-75676fd1231f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:23.814439 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e626903e-f142-4296-9b3c-75676fd1231f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:23.816313 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e626903e-f142-4296-9b3c-75676fd1231f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1752 microversion: 2.20 time: 0.662280 Aug 07 01:34:23.816876 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2561/4743] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:23 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1752 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:34:23.831776 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-52880fa7-cc40-480b-9c51-54bffadb05b6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Going to run 2 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:34:23.834390 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-52880fa7-cc40-480b-9c51-54bffadb05b6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:34:23.899421 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-52880fa7-cc40-480b-9c51-54bffadb05b6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: cfa709be-49f5-434c-8c0e-cb4671f40105] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:34:24.016627 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-52880fa7-cc40-480b-9c51-54bffadb05b6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.131373 Aug 07 01:34:24.018527 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2183/4744] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:34:22 2022] POST /compute/v2.1/servers => generated 32 bytes in 1135 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 07 01:34:24.027240 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ac9ad7fa-2af6-4ca9-80c5-471e0e729945 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:24.032206 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ac9ad7fa-2af6-4ca9-80c5-471e0e729945 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:24.032990 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ac9ad7fa-2af6-4ca9-80c5-471e0e729945 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Searching by: {'deleted': False, 'project_id': '5a300727d7874d83970c301327780abc'} {{(pid=119516) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:34:24.096754 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac9ad7fa-2af6-4ca9-80c5-471e0e729945 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:24.097250 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac9ad7fa-2af6-4ca9-80c5-471e0e729945 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:24.097693 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac9ad7fa-2af6-4ca9-80c5-471e0e729945 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:24.107650 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac9ad7fa-2af6-4ca9-80c5-471e0e729945 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:24.108177 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac9ad7fa-2af6-4ca9-80c5-471e0e729945 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:24.108628 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac9ad7fa-2af6-4ca9-80c5-471e0e729945 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:24.175634 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-83cfe3f8-fe64-4bb0-b6ad-8cffeeca4e6a tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:24.176444 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-83cfe3f8-fe64-4bb0-b6ad-8cffeeca4e6a tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:24.198093 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-83cfe3f8-fe64-4bb0-b6ad-8cffeeca4e6a tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:24.199324 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-83cfe3f8-fe64-4bb0-b6ad-8cffeeca4e6a tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:24.203807 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.multi_cell_list [None req-ac9ad7fa-2af6-4ca9-80c5-471e0e729945 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=119516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 01:34:24.204434 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-83cfe3f8-fe64-4bb0-b6ad-8cffeeca4e6a tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:24.204787 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-83cfe3f8-fe64-4bb0-b6ad-8cffeeca4e6a tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:24.205275 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-83cfe3f8-fe64-4bb0-b6ad-8cffeeca4e6a tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:24.205720 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-83cfe3f8-fe64-4bb0-b6ad-8cffeeca4e6a tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:24.271187 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ac9ad7fa-2af6-4ca9-80c5-471e0e729945 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.247630 Aug 07 01:34:24.275315 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2562/4745] 10.222.0.39 () {58 vars in 1125 bytes} [Sun Aug 7 01:34:24 2022] GET /compute/v2.1/servers => generated 1335 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:24.288788 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2c4c6824-f893-4562-8357-aee5d0fbc948 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:24.289672 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2c4c6824-f893-4562-8357-aee5d0fbc948 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: cfa709be-49f5-434c-8c0e-cb4671f40105] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:24.442671 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2c4c6824-f893-4562-8357-aee5d0fbc948 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:24.459802 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2c4c6824-f893-4562-8357-aee5d0fbc948 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105" status: 200 len: 1218 microversion: 2.1 time: 0.175467 Aug 07 01:34:24.460770 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2563/4746] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:24 2022] GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105 => generated 1218 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:24.635049 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-83cfe3f8-fe64-4bb0-b6ad-8cffeeca4e6a tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:24.665720 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-83cfe3f8-fe64-4bb0-b6ad-8cffeeca4e6a tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1322 microversion: 2.1 time: 0.485257 Aug 07 01:34:24.666603 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2184/4747] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:24 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1322 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:24.845789 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f33019da-943f-4dda-8cf3-70f5d2185b44 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:24.846429 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f33019da-943f-4dda-8cf3-70f5d2185b44 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:24.862723 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f33019da-943f-4dda-8cf3-70f5d2185b44 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:24.863223 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f33019da-943f-4dda-8cf3-70f5d2185b44 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:24.863675 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f33019da-943f-4dda-8cf3-70f5d2185b44 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:24.864452 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f33019da-943f-4dda-8cf3-70f5d2185b44 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:24.864915 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f33019da-943f-4dda-8cf3-70f5d2185b44 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:24.865820 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f33019da-943f-4dda-8cf3-70f5d2185b44 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:25.486302 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ac7f4d62-c9fe-4efc-93af-39aded12d864 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:25.486995 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ac7f4d62-c9fe-4efc-93af-39aded12d864 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: cfa709be-49f5-434c-8c0e-cb4671f40105] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:25.832229 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ac7f4d62-c9fe-4efc-93af-39aded12d864 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:25.858198 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ac7f4d62-c9fe-4efc-93af-39aded12d864 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105" status: 200 len: 1218 microversion: 2.1 time: 0.361644 Aug 07 01:34:25.858881 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2185/4748] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:25 2022] GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105 => generated 1218 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:25.891224 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d9b8cb23-08c1-4eb9-a237-2feaf486e294 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:25.898674 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d9b8cb23-08c1-4eb9-a237-2feaf486e294 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:25.924628 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9b8cb23-08c1-4eb9-a237-2feaf486e294 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:25.925124 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9b8cb23-08c1-4eb9-a237-2feaf486e294 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:25.925569 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9b8cb23-08c1-4eb9-a237-2feaf486e294 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:25.926312 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9b8cb23-08c1-4eb9-a237-2feaf486e294 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:25.926775 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9b8cb23-08c1-4eb9-a237-2feaf486e294 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:25.958649 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9b8cb23-08c1-4eb9-a237-2feaf486e294 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:26.393475 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f33019da-943f-4dda-8cf3-70f5d2185b44 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:26.405412 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f33019da-943f-4dda-8cf3-70f5d2185b44 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:26.406952 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f33019da-943f-4dda-8cf3-70f5d2185b44 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:26.429202 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f33019da-943f-4dda-8cf3-70f5d2185b44 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1752 microversion: 2.20 time: 1.587471 Aug 07 01:34:26.433546 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2564/4749] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:24 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1752 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:34:26.456006 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e531a11d-810a-4ce1-8552-e5778167007b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1575548723", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "16f1e04e-f3dd-4247-8125-839e2140524d"}], "security_groups": [{"name": "tempest-securitygroup--1782130740"}], "key_name": "tempest-keypair-1057754462", "user_data": "}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:34:26.586155 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d9b8cb23-08c1-4eb9-a237-2feaf486e294 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:26.600759 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d9b8cb23-08c1-4eb9-a237-2feaf486e294 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1322 microversion: 2.1 time: 0.731552 Aug 07 01:34:26.604489 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2186/4750] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:25 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1322 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:26.888445 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-77ce1e54-53e4-4158-a9e5-a360f894a604 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:26.889127 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-77ce1e54-53e4-4158-a9e5-a360f894a604 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: cfa709be-49f5-434c-8c0e-cb4671f40105] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:26.918724 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-77ce1e54-53e4-4158-a9e5-a360f894a604 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:26.919241 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-77ce1e54-53e4-4158-a9e5-a360f894a604 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:26.919685 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-77ce1e54-53e4-4158-a9e5-a360f894a604 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:26.920436 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-77ce1e54-53e4-4158-a9e5-a360f894a604 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:26.920896 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-77ce1e54-53e4-4158-a9e5-a360f894a604 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:26.921321 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-77ce1e54-53e4-4158-a9e5-a360f894a604 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:27.517438 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-e531a11d-810a-4ce1-8552-e5778167007b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] validate_networks() for [('16f1e04e-f3dd-4247-8125-839e2140524d', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:34:28.135831 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-77ce1e54-53e4-4158-a9e5-a360f894a604 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:28.156968 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-77ce1e54-53e4-4158-a9e5-a360f894a604 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105" status: 200 len: 1270 microversion: 2.1 time: 1.282083 Aug 07 01:34:28.160273 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2187/4751] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:26 2022] GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105 => generated 1270 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:28.187944 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-87e3050a-f988-41e6-a7c2-00c94f7d7916 req-a734bd32-8938-4ea6-bcc4-1359fa85e621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afe29183-ebc5-4f1b-af8b-1eb2bbbfffad", "name": "network-vif-plugged", "status": "completed", "tag": "d21f91e9-787f-44e2-996b-ca2635e32ba6"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:34:28.242783 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-87e3050a-f988-41e6-a7c2-00c94f7d7916 req-a734bd32-8938-4ea6-bcc4-1359fa85e621 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:28.246933 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-87e3050a-f988-41e6-a7c2-00c94f7d7916 req-a734bd32-8938-4ea6-bcc4-1359fa85e621 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:28.252651 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-87e3050a-f988-41e6-a7c2-00c94f7d7916 req-a734bd32-8938-4ea6-bcc4-1359fa85e621 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:28.299404 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-87e3050a-f988-41e6-a7c2-00c94f7d7916 req-a734bd32-8938-4ea6-bcc4-1359fa85e621 service nova] Creating event network-vif-plugged:d21f91e9-787f-44e2-996b-ca2635e32ba6 for instance afe29183-ebc5-4f1b-af8b-1eb2bbbfffad on n-h2-master-1 Aug 07 01:34:28.306140 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-87e3050a-f988-41e6-a7c2-00c94f7d7916 req-a734bd32-8938-4ea6-bcc4-1359fa85e621 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141776 Aug 07 01:34:28.318221 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2188/4752] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:34:28.333011 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-15c0af35-da6c-40f1-b323-38067b4c3f9b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:28.336001 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-15c0af35-da6c-40f1-b323-38067b4c3f9b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:28.365507 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15c0af35-da6c-40f1-b323-38067b4c3f9b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:28.366370 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15c0af35-da6c-40f1-b323-38067b4c3f9b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:28.371123 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15c0af35-da6c-40f1-b323-38067b4c3f9b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:28.372844 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15c0af35-da6c-40f1-b323-38067b4c3f9b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:28.374573 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15c0af35-da6c-40f1-b323-38067b4c3f9b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:28.377187 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15c0af35-da6c-40f1-b323-38067b4c3f9b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:29.159729 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e531a11d-810a-4ce1-8552-e5778167007b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:34:29.160969 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e531a11d-810a-4ce1-8552-e5778167007b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:34:29.161755 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e531a11d-810a-4ce1-8552-e5778167007b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:34:29.162321 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e531a11d-810a-4ce1-8552-e5778167007b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:34:29.162967 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e531a11d-810a-4ce1-8552-e5778167007b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:34:29.192727 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e531a11d-810a-4ce1-8552-e5778167007b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:29.197369 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e531a11d-810a-4ce1-8552-e5778167007b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:29.198890 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e531a11d-810a-4ce1-8552-e5778167007b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:29.201177 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e531a11d-810a-4ce1-8552-e5778167007b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:29.201907 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e531a11d-810a-4ce1-8552-e5778167007b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:29.203408 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e531a11d-810a-4ce1-8552-e5778167007b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:29.263476 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-e531a11d-810a-4ce1-8552-e5778167007b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Getting quotas for project b630a4c3bb824b90b4c1898a92b47aa7. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:34:29.277903 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-e531a11d-810a-4ce1-8552-e5778167007b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Getting quotas for user d556a8ae0d524894a93203ce3f70d420 and project b630a4c3bb824b90b4c1898a92b47aa7. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:34:29.314492 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e531a11d-810a-4ce1-8552-e5778167007b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:34:29.316876 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e531a11d-810a-4ce1-8552-e5778167007b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 57ef5095-2f80-41c5-abc9-ca37439f3384] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:34:29.538799 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e531a11d-810a-4ce1-8552-e5778167007b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.087203 Aug 07 01:34:29.540235 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2565/4753] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:34:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 3089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:34:29.558012 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-521449e7-2199-43b4-ab7d-2149706844c2 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:29.558818 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-521449e7-2199-43b4-ab7d-2149706844c2 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:29.577911 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-521449e7-2199-43b4-ab7d-2149706844c2 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:29.578666 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-521449e7-2199-43b4-ab7d-2149706844c2 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:29.579297 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-521449e7-2199-43b4-ab7d-2149706844c2 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:29.580403 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-521449e7-2199-43b4-ab7d-2149706844c2 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:29.581325 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-521449e7-2199-43b4-ab7d-2149706844c2 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:29.582021 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-521449e7-2199-43b4-ab7d-2149706844c2 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:30.376917 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-521449e7-2199-43b4-ab7d-2149706844c2 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:30.412427 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-521449e7-2199-43b4-ab7d-2149706844c2 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1322 microversion: 2.1 time: 0.870735 Aug 07 01:34:30.422743 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2566/4754] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:29 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1322 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:30.452099 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a072fbde-16c6-4c22-a66f-39305fbf9915 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:30.454017 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a072fbde-16c6-4c22-a66f-39305fbf9915 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: cfa709be-49f5-434c-8c0e-cb4671f40105] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:30.506304 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a072fbde-16c6-4c22-a66f-39305fbf9915 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:30.507019 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a072fbde-16c6-4c22-a66f-39305fbf9915 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:30.522652 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a072fbde-16c6-4c22-a66f-39305fbf9915 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:30.524356 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a072fbde-16c6-4c22-a66f-39305fbf9915 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:30.529644 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a072fbde-16c6-4c22-a66f-39305fbf9915 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:30.530947 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a072fbde-16c6-4c22-a66f-39305fbf9915 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:30.717446 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-15c0af35-da6c-40f1-b323-38067b4c3f9b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:30.761441 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-15c0af35-da6c-40f1-b323-38067b4c3f9b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:30.767960 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-15c0af35-da6c-40f1-b323-38067b4c3f9b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:30.776737 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-15c0af35-da6c-40f1-b323-38067b4c3f9b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1752 microversion: 2.20 time: 2.453023 Aug 07 01:34:30.798353 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2189/4755] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:28 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1752 bytes in 2478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:34:30.851218 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-135bdba9-3b7b-43c8-9f50-7649115f10e9 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:30.856207 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-135bdba9-3b7b-43c8-9f50-7649115f10e9 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 57ef5095-2f80-41c5-abc9-ca37439f3384] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:30.865461 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-135bdba9-3b7b-43c8-9f50-7649115f10e9 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:30.866207 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-135bdba9-3b7b-43c8-9f50-7649115f10e9 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:30.868280 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-135bdba9-3b7b-43c8-9f50-7649115f10e9 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:30.869405 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-135bdba9-3b7b-43c8-9f50-7649115f10e9 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:30.870713 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-135bdba9-3b7b-43c8-9f50-7649115f10e9 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:30.871355 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-135bdba9-3b7b-43c8-9f50-7649115f10e9 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:30.920549 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a072fbde-16c6-4c22-a66f-39305fbf9915 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:30.931563 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a072fbde-16c6-4c22-a66f-39305fbf9915 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105" status: 200 len: 1276 microversion: 2.1 time: 0.507390 Aug 07 01:34:30.938419 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2567/4756] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:30 2022] GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105 => generated 1276 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:30.968519 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-70f1b70f-7098-427d-81c9-33c1a0630069 req-94cdce70-0d40-4be0-b5b0-415249420787 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09c893ea-9683-476d-88fa-5b05a5373d68", "name": "network-vif-unplugged", "status": "completed", "tag": "0fecb544-34bf-4d56-ab2c-8eaec81edefc"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:34:30.985986 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-70f1b70f-7098-427d-81c9-33c1a0630069 req-94cdce70-0d40-4be0-b5b0-415249420787 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:30.987415 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-70f1b70f-7098-427d-81c9-33c1a0630069 req-94cdce70-0d40-4be0-b5b0-415249420787 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:30.988198 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-70f1b70f-7098-427d-81c9-33c1a0630069 req-94cdce70-0d40-4be0-b5b0-415249420787 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:31.024360 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-70f1b70f-7098-427d-81c9-33c1a0630069 req-94cdce70-0d40-4be0-b5b0-415249420787 service nova] Creating event network-vif-unplugged:0fecb544-34bf-4d56-ab2c-8eaec81edefc for instance 09c893ea-9683-476d-88fa-5b05a5373d68 on n-h1-master-1 Aug 07 01:34:31.046082 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-70f1b70f-7098-427d-81c9-33c1a0630069 req-94cdce70-0d40-4be0-b5b0-415249420787 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103360 Aug 07 01:34:31.047264 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2568/4757] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:34:31.068123 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-a7dd4e80-e993-472c-85e5-62be2fee61d3 req-22b2c892-b30c-48b5-8672-c2f6a00d3e34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09c893ea-9683-476d-88fa-5b05a5373d68", "name": "network-vif-deleted", "tag": "0fecb544-34bf-4d56-ab2c-8eaec81edefc"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:34:31.075708 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-135bdba9-3b7b-43c8-9f50-7649115f10e9 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:31.087073 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-135bdba9-3b7b-43c8-9f50-7649115f10e9 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384" status: 200 len: 1246 microversion: 2.1 time: 0.271597 Aug 07 01:34:31.097368 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2190/4758] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:30 2022] GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384 => generated 1246 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:31.108542 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a7dd4e80-e993-472c-85e5-62be2fee61d3 req-22b2c892-b30c-48b5-8672-c2f6a00d3e34 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:31.109023 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a7dd4e80-e993-472c-85e5-62be2fee61d3 req-22b2c892-b30c-48b5-8672-c2f6a00d3e34 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:31.114238 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a7dd4e80-e993-472c-85e5-62be2fee61d3 req-22b2c892-b30c-48b5-8672-c2f6a00d3e34 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:31.145478 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-a7dd4e80-e993-472c-85e5-62be2fee61d3 req-22b2c892-b30c-48b5-8672-c2f6a00d3e34 service nova] Creating event network-vif-deleted:0fecb544-34bf-4d56-ab2c-8eaec81edefc for instance 09c893ea-9683-476d-88fa-5b05a5373d68 on n-h1-master-1 Aug 07 01:34:31.168430 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-a7dd4e80-e993-472c-85e5-62be2fee61d3 req-22b2c892-b30c-48b5-8672-c2f6a00d3e34 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117006 Aug 07 01:34:31.174694 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2569/4759] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:34:31.452230 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ed693005-f798-4df4-9e91-889e7a6c4b0b tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:31.453470 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ed693005-f798-4df4-9e91-889e7a6c4b0b tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:31.476220 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed693005-f798-4df4-9e91-889e7a6c4b0b tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:31.479987 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed693005-f798-4df4-9e91-889e7a6c4b0b tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:31.482157 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed693005-f798-4df4-9e91-889e7a6c4b0b tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:31.483323 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed693005-f798-4df4-9e91-889e7a6c4b0b tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:31.485446 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed693005-f798-4df4-9e91-889e7a6c4b0b tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:31.486708 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed693005-f798-4df4-9e91-889e7a6c4b0b tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:31.810275 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-174db8dc-3268-4127-b001-1d27651d5b5d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:31.814515 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-174db8dc-3268-4127-b001-1d27651d5b5d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:31.842475 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-174db8dc-3268-4127-b001-1d27651d5b5d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:31.842975 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-174db8dc-3268-4127-b001-1d27651d5b5d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:31.843433 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-174db8dc-3268-4127-b001-1d27651d5b5d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:31.850182 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-174db8dc-3268-4127-b001-1d27651d5b5d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:31.852624 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-174db8dc-3268-4127-b001-1d27651d5b5d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:31.853292 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-174db8dc-3268-4127-b001-1d27651d5b5d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:32.344173 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ed693005-f798-4df4-9e91-889e7a6c4b0b tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:32.363178 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ed693005-f798-4df4-9e91-889e7a6c4b0b tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1518 microversion: 2.1 time: 0.916567 Aug 07 01:34:32.372365 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2191/4760] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:31 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1518 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:32.379711 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-489c24c4-3d8f-420f-b170-30cd8a9b6cd7 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:32.388773 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-489c24c4-3d8f-420f-b170-30cd8a9b6cd7 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: cfa709be-49f5-434c-8c0e-cb4671f40105] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:32.411155 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-489c24c4-3d8f-420f-b170-30cd8a9b6cd7 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:32.413289 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-489c24c4-3d8f-420f-b170-30cd8a9b6cd7 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:32.415092 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-489c24c4-3d8f-420f-b170-30cd8a9b6cd7 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:32.417087 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-489c24c4-3d8f-420f-b170-30cd8a9b6cd7 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:32.417253 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-174db8dc-3268-4127-b001-1d27651d5b5d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:32.418281 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-489c24c4-3d8f-420f-b170-30cd8a9b6cd7 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:32.419173 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-489c24c4-3d8f-420f-b170-30cd8a9b6cd7 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:32.435126 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-174db8dc-3268-4127-b001-1d27651d5b5d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:32.436743 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-174db8dc-3268-4127-b001-1d27651d5b5d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:32.449921 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-174db8dc-3268-4127-b001-1d27651d5b5d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1752 microversion: 2.20 time: 0.647702 Aug 07 01:34:32.457773 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2570/4761] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:31 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1752 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:34:32.480660 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-495c123b-3dae-4705-81d4-11706a35f55e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:32.481291 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-495c123b-3dae-4705-81d4-11706a35f55e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 57ef5095-2f80-41c5-abc9-ca37439f3384] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:32.511475 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-495c123b-3dae-4705-81d4-11706a35f55e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:32.512009 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-495c123b-3dae-4705-81d4-11706a35f55e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:32.512457 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-495c123b-3dae-4705-81d4-11706a35f55e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:32.513190 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-495c123b-3dae-4705-81d4-11706a35f55e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:32.519454 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-495c123b-3dae-4705-81d4-11706a35f55e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:32.520033 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-495c123b-3dae-4705-81d4-11706a35f55e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:32.677633 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-495c123b-3dae-4705-81d4-11706a35f55e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:32.694641 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-495c123b-3dae-4705-81d4-11706a35f55e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384" status: 200 len: 1302 microversion: 2.1 time: 0.227765 Aug 07 01:34:32.699954 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2571/4762] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:32 2022] GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384 => generated 1302 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:32.707978 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6939047c-d657-4a4b-80dd-063d810e1a33 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:34:32.712344 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6939047c-d657-4a4b-80dd-063d810e1a33 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:32.720200 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6939047c-d657-4a4b-80dd-063d810e1a33 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:32.720793 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6939047c-d657-4a4b-80dd-063d810e1a33 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:32.721307 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6939047c-d657-4a4b-80dd-063d810e1a33 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:32.722101 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6939047c-d657-4a4b-80dd-063d810e1a33 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:32.722633 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6939047c-d657-4a4b-80dd-063d810e1a33 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:32.723159 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6939047c-d657-4a4b-80dd-063d810e1a33 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:32.777485 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-6939047c-d657-4a4b-80dd-063d810e1a33 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lazy-loading 'flavor' on Instance uuid afe29183-ebc5-4f1b-af8b-1eb2bbbfffad {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:34:33.000260 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6939047c-d657-4a4b-80dd-063d810e1a33 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "POST /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad/action" status: 200 len: 32 microversion: 2.1 time: 0.298253 Aug 07 01:34:33.004965 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2572/4763] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:34:32 2022] POST /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad/action => generated 32 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:34:33.023969 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b7dcec7a-5c9e-4e3d-b170-f83ca42c22d6 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:33.024998 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b7dcec7a-5c9e-4e3d-b170-f83ca42c22d6 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:33.045202 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7dcec7a-5c9e-4e3d-b170-f83ca42c22d6 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:33.050898 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7dcec7a-5c9e-4e3d-b170-f83ca42c22d6 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:33.052826 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7dcec7a-5c9e-4e3d-b170-f83ca42c22d6 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:33.054136 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7dcec7a-5c9e-4e3d-b170-f83ca42c22d6 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:33.054833 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7dcec7a-5c9e-4e3d-b170-f83ca42c22d6 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:33.055573 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7dcec7a-5c9e-4e3d-b170-f83ca42c22d6 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:33.310011 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b7dcec7a-5c9e-4e3d-b170-f83ca42c22d6 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:33.332893 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b7dcec7a-5c9e-4e3d-b170-f83ca42c22d6 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1524 microversion: 2.1 time: 0.308089 Aug 07 01:34:33.339227 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2573/4764] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:33 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1524 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:33.362314 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-4ad0da39-6171-4235-87c3-b942a4f2aa3f req-79d41fad-d959-49c7-89c0-25b6a359e52a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15bc1c11-5c46-4e17-8d01-519f3438d5e6", "name": "network-vif-deleted", "tag": "87952749-1146-452c-8afa-d83b7ade25da"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:34:33.398287 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4ad0da39-6171-4235-87c3-b942a4f2aa3f req-79d41fad-d959-49c7-89c0-25b6a359e52a service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:33.398778 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4ad0da39-6171-4235-87c3-b942a4f2aa3f req-79d41fad-d959-49c7-89c0-25b6a359e52a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:33.399217 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4ad0da39-6171-4235-87c3-b942a4f2aa3f req-79d41fad-d959-49c7-89c0-25b6a359e52a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:33.428678 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-4ad0da39-6171-4235-87c3-b942a4f2aa3f req-79d41fad-d959-49c7-89c0-25b6a359e52a service nova] Creating event network-vif-deleted:87952749-1146-452c-8afa-d83b7ade25da for instance 15bc1c11-5c46-4e17-8d01-519f3438d5e6 on n-h1-master-1 Aug 07 01:34:33.435177 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-4ad0da39-6171-4235-87c3-b942a4f2aa3f req-79d41fad-d959-49c7-89c0-25b6a359e52a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093407 Aug 07 01:34:33.436110 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2574/4765] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:34:33.485109 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9262305f-7ed9-48b5-b1b0-ca9353c1234a tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:33.486389 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9262305f-7ed9-48b5-b1b0-ca9353c1234a tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:33.501214 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9262305f-7ed9-48b5-b1b0-ca9353c1234a tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:33.502737 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9262305f-7ed9-48b5-b1b0-ca9353c1234a tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:33.503283 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9262305f-7ed9-48b5-b1b0-ca9353c1234a tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:33.504839 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9262305f-7ed9-48b5-b1b0-ca9353c1234a tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:33.505597 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9262305f-7ed9-48b5-b1b0-ca9353c1234a tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:33.508139 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9262305f-7ed9-48b5-b1b0-ca9353c1234a tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:33.598929 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-489c24c4-3d8f-420f-b170-30cd8a9b6cd7 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:33.617794 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-489c24c4-3d8f-420f-b170-30cd8a9b6cd7 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105" status: 200 len: 1318 microversion: 2.1 time: 1.243710 Aug 07 01:34:33.635202 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2192/4766] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:32 2022] GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105 => generated 1318 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:33.720433 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fe4ed311-bbdc-417b-8a8c-0bcabf796135 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:33.721066 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fe4ed311-bbdc-417b-8a8c-0bcabf796135 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 57ef5095-2f80-41c5-abc9-ca37439f3384] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:33.733756 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fe4ed311-bbdc-417b-8a8c-0bcabf796135 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:33.736407 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fe4ed311-bbdc-417b-8a8c-0bcabf796135 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:33.737276 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fe4ed311-bbdc-417b-8a8c-0bcabf796135 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:33.738444 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fe4ed311-bbdc-417b-8a8c-0bcabf796135 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:33.739233 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fe4ed311-bbdc-417b-8a8c-0bcabf796135 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:33.740669 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fe4ed311-bbdc-417b-8a8c-0bcabf796135 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:33.774214 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:33.854653 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9262305f-7ed9-48b5-b1b0-ca9353c1234a tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:33.866121 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9262305f-7ed9-48b5-b1b0-ca9353c1234a tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:33.868627 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9262305f-7ed9-48b5-b1b0-ca9353c1234a tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:33.870225 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9262305f-7ed9-48b5-b1b0-ca9353c1234a tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1752 microversion: 2.20 time: 0.391697 Aug 07 01:34:33.871949 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2575/4767] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:33 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1752 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:34:33.979584 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fe4ed311-bbdc-417b-8a8c-0bcabf796135 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:34.006197 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fe4ed311-bbdc-417b-8a8c-0bcabf796135 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384" status: 200 len: 1300 microversion: 2.1 time: 0.289088 Aug 07 01:34:34.019933 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2193/4768] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:33 2022] GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384 => generated 1300 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:34.366280 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-72fa6ca9-f9e6-4ecc-9500-1b0d9e788cc5 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:34.366942 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-72fa6ca9-f9e6-4ecc-9500-1b0d9e788cc5 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:34.378508 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72fa6ca9-f9e6-4ecc-9500-1b0d9e788cc5 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:34.379015 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72fa6ca9-f9e6-4ecc-9500-1b0d9e788cc5 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:34.384704 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72fa6ca9-f9e6-4ecc-9500-1b0d9e788cc5 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:34.385800 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72fa6ca9-f9e6-4ecc-9500-1b0d9e788cc5 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:34.386437 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72fa6ca9-f9e6-4ecc-9500-1b0d9e788cc5 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:34.387041 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72fa6ca9-f9e6-4ecc-9500-1b0d9e788cc5 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:34.660585 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-36da563f-f982-4b92-ac20-aecaa6558898 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:34.661189 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-36da563f-f982-4b92-ac20-aecaa6558898 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: cfa709be-49f5-434c-8c0e-cb4671f40105] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:34.674035 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36da563f-f982-4b92-ac20-aecaa6558898 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:34.677300 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36da563f-f982-4b92-ac20-aecaa6558898 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:34.678929 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36da563f-f982-4b92-ac20-aecaa6558898 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:34.681372 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36da563f-f982-4b92-ac20-aecaa6558898 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:34.687270 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36da563f-f982-4b92-ac20-aecaa6558898 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:34.687737 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36da563f-f982-4b92-ac20-aecaa6558898 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:34.752952 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-72fa6ca9-f9e6-4ecc-9500-1b0d9e788cc5 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:34.768182 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-72fa6ca9-f9e6-4ecc-9500-1b0d9e788cc5 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1524 microversion: 2.1 time: 0.406348 Aug 07 01:34:34.770378 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2576/4769] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:34 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1524 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:34.896469 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0c1b4f28-b4bf-42bc-b2fe-fcd3a30c1b2d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:34.898229 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0c1b4f28-b4bf-42bc-b2fe-fcd3a30c1b2d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:34.906957 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c1b4f28-b4bf-42bc-b2fe-fcd3a30c1b2d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:34.907734 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c1b4f28-b4bf-42bc-b2fe-fcd3a30c1b2d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:34.908366 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c1b4f28-b4bf-42bc-b2fe-fcd3a30c1b2d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:34.909361 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c1b4f28-b4bf-42bc-b2fe-fcd3a30c1b2d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:34.909993 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c1b4f28-b4bf-42bc-b2fe-fcd3a30c1b2d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:34.910906 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c1b4f28-b4bf-42bc-b2fe-fcd3a30c1b2d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:35.227063 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0c1b4f28-b4bf-42bc-b2fe-fcd3a30c1b2d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:35.234965 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:35.242019 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0c1b4f28-b4bf-42bc-b2fe-fcd3a30c1b2d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:35.245834 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0c1b4f28-b4bf-42bc-b2fe-fcd3a30c1b2d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:35.247563 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0c1b4f28-b4bf-42bc-b2fe-fcd3a30c1b2d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1752 microversion: 2.20 time: 0.355778 Aug 07 01:34:35.248665 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2577/4770] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:34 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1752 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:34:35.255678 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5ef038b5-fe16-42ba-a936-087c86e90f0a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:35.256709 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5ef038b5-fe16-42ba-a936-087c86e90f0a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 57ef5095-2f80-41c5-abc9-ca37439f3384] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:35.266167 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5ef038b5-fe16-42ba-a936-087c86e90f0a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:35.267291 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5ef038b5-fe16-42ba-a936-087c86e90f0a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:35.268032 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5ef038b5-fe16-42ba-a936-087c86e90f0a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:35.269297 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5ef038b5-fe16-42ba-a936-087c86e90f0a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:35.270157 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5ef038b5-fe16-42ba-a936-087c86e90f0a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:35.270980 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5ef038b5-fe16-42ba-a936-087c86e90f0a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:35.359002 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5ef038b5-fe16-42ba-a936-087c86e90f0a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:35.368437 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5ef038b5-fe16-42ba-a936-087c86e90f0a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384" status: 200 len: 1300 microversion: 2.1 time: 0.118087 Aug 07 01:34:35.392555 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2578/4771] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:35 2022] GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384 => generated 1300 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:35.795154 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-eaf502e0-a7ff-4786-8260-a2f96cf79f0d tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:35.795968 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-eaf502e0-a7ff-4786-8260-a2f96cf79f0d tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:35.808594 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eaf502e0-a7ff-4786-8260-a2f96cf79f0d tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:35.810189 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eaf502e0-a7ff-4786-8260-a2f96cf79f0d tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:35.810766 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eaf502e0-a7ff-4786-8260-a2f96cf79f0d tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:35.811565 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eaf502e0-a7ff-4786-8260-a2f96cf79f0d tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:35.812059 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eaf502e0-a7ff-4786-8260-a2f96cf79f0d tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:35.813088 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eaf502e0-a7ff-4786-8260-a2f96cf79f0d tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:35.836904 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=8 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:35.983693 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-36da563f-f982-4b92-ac20-aecaa6558898 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:35.994760 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-36da563f-f982-4b92-ac20-aecaa6558898 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105" status: 200 len: 1318 microversion: 2.1 time: 1.338320 Aug 07 01:34:36.010161 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2194/4772] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:34 2022] GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105 => generated 1318 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:36.155547 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-eaf502e0-a7ff-4786-8260-a2f96cf79f0d tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:36.164988 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-eaf502e0-a7ff-4786-8260-a2f96cf79f0d tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1524 microversion: 2.1 time: 0.375052 Aug 07 01:34:36.165577 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2579/4773] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:35 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1524 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:34:36.284520 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-677cc442-015b-48b8-9f7c-f23da9b8d38d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:36.285961 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-677cc442-015b-48b8-9f7c-f23da9b8d38d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:36.311074 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-677cc442-015b-48b8-9f7c-f23da9b8d38d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:36.311596 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-677cc442-015b-48b8-9f7c-f23da9b8d38d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:36.319189 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-677cc442-015b-48b8-9f7c-f23da9b8d38d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:36.320382 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-677cc442-015b-48b8-9f7c-f23da9b8d38d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:36.321309 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-677cc442-015b-48b8-9f7c-f23da9b8d38d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:36.321816 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-677cc442-015b-48b8-9f7c-f23da9b8d38d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:36.402441 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f2f4812f-9834-466a-93bd-5565128e510e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:36.403071 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f2f4812f-9834-466a-93bd-5565128e510e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 57ef5095-2f80-41c5-abc9-ca37439f3384] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:36.413377 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:36.422805 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2f4812f-9834-466a-93bd-5565128e510e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:36.423356 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2f4812f-9834-466a-93bd-5565128e510e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:36.423802 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2f4812f-9834-466a-93bd-5565128e510e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:36.424730 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2f4812f-9834-466a-93bd-5565128e510e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:36.425191 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2f4812f-9834-466a-93bd-5565128e510e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:36.425701 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2f4812f-9834-466a-93bd-5565128e510e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:36.677711 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f2f4812f-9834-466a-93bd-5565128e510e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:36.688756 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f2f4812f-9834-466a-93bd-5565128e510e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384" status: 200 len: 1300 microversion: 2.1 time: 0.289010 Aug 07 01:34:36.691921 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2580/4774] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:36 2022] GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384 => generated 1300 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:36.697510 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-63e6ebe4-fadc-4543-b479-2af5459b7b5c req-8618a231-adef-46e2-81d0-f476eaa310fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfa709be-49f5-434c-8c0e-cb4671f40105", "tag": "6117126d-ff0c-4996-bf60-4a7445604f1e"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:34:36.729674 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-63e6ebe4-fadc-4543-b479-2af5459b7b5c req-8618a231-adef-46e2-81d0-f476eaa310fe service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:36.732276 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-63e6ebe4-fadc-4543-b479-2af5459b7b5c req-8618a231-adef-46e2-81d0-f476eaa310fe service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:36.734145 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-63e6ebe4-fadc-4543-b479-2af5459b7b5c req-8618a231-adef-46e2-81d0-f476eaa310fe service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:36.763588 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-63e6ebe4-fadc-4543-b479-2af5459b7b5c req-8618a231-adef-46e2-81d0-f476eaa310fe service nova] Creating event network-changed:6117126d-ff0c-4996-bf60-4a7445604f1e for instance cfa709be-49f5-434c-8c0e-cb4671f40105 on n-h2-master-1 Aug 07 01:34:36.775086 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-63e6ebe4-fadc-4543-b479-2af5459b7b5c req-8618a231-adef-46e2-81d0-f476eaa310fe service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081651 Aug 07 01:34:36.777207 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2581/4775] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:34:37.019295 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0752bb09-d126-4873-931c-fe67f7fbd02b tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:37.020192 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0752bb09-d126-4873-931c-fe67f7fbd02b tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: cfa709be-49f5-434c-8c0e-cb4671f40105] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:37.038451 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0752bb09-d126-4873-931c-fe67f7fbd02b tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:37.040493 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0752bb09-d126-4873-931c-fe67f7fbd02b tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:37.042626 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0752bb09-d126-4873-931c-fe67f7fbd02b tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:37.048082 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0752bb09-d126-4873-931c-fe67f7fbd02b tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:37.050467 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0752bb09-d126-4873-931c-fe67f7fbd02b tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:37.052456 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0752bb09-d126-4873-931c-fe67f7fbd02b tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:37.645812 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0752bb09-d126-4873-931c-fe67f7fbd02b tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:37.667048 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-677cc442-015b-48b8-9f7c-f23da9b8d38d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:37.677821 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-677cc442-015b-48b8-9f7c-f23da9b8d38d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:37.679340 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-677cc442-015b-48b8-9f7c-f23da9b8d38d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:37.680596 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-677cc442-015b-48b8-9f7c-f23da9b8d38d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1752 microversion: 2.20 time: 1.402499 Aug 07 01:34:37.681160 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2195/4776] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:36 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1752 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:34:37.685376 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0752bb09-d126-4873-931c-fe67f7fbd02b tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105" status: 200 len: 1318 microversion: 2.1 time: 0.649522 Aug 07 01:34:37.688244 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2582/4777] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:37 2022] GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105 => generated 1318 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:34:37.718687 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-520add5d-e6c8-4f3f-9aae-02c1f541e27a tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:37.719323 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-520add5d-e6c8-4f3f-9aae-02c1f541e27a tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:37.722293 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6c7b1361-8161-4ef6-8ad2-5d500426cadd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:37.728429 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-520add5d-e6c8-4f3f-9aae-02c1f541e27a tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:37.729230 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-520add5d-e6c8-4f3f-9aae-02c1f541e27a tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:37.729844 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-520add5d-e6c8-4f3f-9aae-02c1f541e27a tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:37.730255 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6c7b1361-8161-4ef6-8ad2-5d500426cadd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 57ef5095-2f80-41c5-abc9-ca37439f3384] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:37.730903 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-520add5d-e6c8-4f3f-9aae-02c1f541e27a tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:37.731985 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-520add5d-e6c8-4f3f-9aae-02c1f541e27a tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:37.732582 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-520add5d-e6c8-4f3f-9aae-02c1f541e27a tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:37.763277 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c7b1361-8161-4ef6-8ad2-5d500426cadd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:37.764852 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c7b1361-8161-4ef6-8ad2-5d500426cadd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:37.765409 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c7b1361-8161-4ef6-8ad2-5d500426cadd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:37.767432 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c7b1361-8161-4ef6-8ad2-5d500426cadd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:37.779932 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c7b1361-8161-4ef6-8ad2-5d500426cadd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:37.780785 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c7b1361-8161-4ef6-8ad2-5d500426cadd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:38.048216 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6c7b1361-8161-4ef6-8ad2-5d500426cadd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:38.058769 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6c7b1361-8161-4ef6-8ad2-5d500426cadd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384" status: 200 len: 1368 microversion: 2.1 time: 0.346998 Aug 07 01:34:38.060257 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2583/4778] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:37 2022] GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384 => generated 1368 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:38.589799 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-520add5d-e6c8-4f3f-9aae-02c1f541e27a tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:38.598479 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-520add5d-e6c8-4f3f-9aae-02c1f541e27a tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1524 microversion: 2.1 time: 0.900111 Aug 07 01:34:38.602211 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2196/4779] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:37 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1524 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:38.723245 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f9cf4af4-ec9c-456b-84b1-52cf0fd3c94c tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:38.723245 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f9cf4af4-ec9c-456b-84b1-52cf0fd3c94c tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: cfa709be-49f5-434c-8c0e-cb4671f40105] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:38.729326 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3ea2ccc5-78be-48bf-8d85-5f104db3eb8f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:38.730695 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3ea2ccc5-78be-48bf-8d85-5f104db3eb8f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:38.734173 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f9cf4af4-ec9c-456b-84b1-52cf0fd3c94c tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:38.736718 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f9cf4af4-ec9c-456b-84b1-52cf0fd3c94c tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:38.738879 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f9cf4af4-ec9c-456b-84b1-52cf0fd3c94c tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:38.740486 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f9cf4af4-ec9c-456b-84b1-52cf0fd3c94c tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:38.742251 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f9cf4af4-ec9c-456b-84b1-52cf0fd3c94c tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:38.743819 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ea2ccc5-78be-48bf-8d85-5f104db3eb8f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:38.744264 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f9cf4af4-ec9c-456b-84b1-52cf0fd3c94c tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:38.744597 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ea2ccc5-78be-48bf-8d85-5f104db3eb8f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:38.745054 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ea2ccc5-78be-48bf-8d85-5f104db3eb8f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:38.745803 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ea2ccc5-78be-48bf-8d85-5f104db3eb8f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:38.746263 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ea2ccc5-78be-48bf-8d85-5f104db3eb8f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:38.750700 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ea2ccc5-78be-48bf-8d85-5f104db3eb8f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:39.228254 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=4 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:39.300477 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=20 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:39.487065 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f9cf4af4-ec9c-456b-84b1-52cf0fd3c94c tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:39.500048 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f9cf4af4-ec9c-456b-84b1-52cf0fd3c94c tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105" status: 200 len: 1318 microversion: 2.1 time: 0.781775 Aug 07 01:34:39.504190 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2584/4780] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:38 2022] GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105 => generated 1318 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:39.533799 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-3adede91-f761-4c44-9a9d-6509de11ed32 req-f7a67b48-6161-4de8-87bb-6dc7599821dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87", "tag": "c8937c88-9bc5-4e2e-abe3-b2ac180cecef"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:34:39.561010 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3adede91-f761-4c44-9a9d-6509de11ed32 req-f7a67b48-6161-4de8-87bb-6dc7599821dd service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:39.561606 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3adede91-f761-4c44-9a9d-6509de11ed32 req-f7a67b48-6161-4de8-87bb-6dc7599821dd service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:39.562426 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3adede91-f761-4c44-9a9d-6509de11ed32 req-f7a67b48-6161-4de8-87bb-6dc7599821dd service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:39.584986 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-3adede91-f761-4c44-9a9d-6509de11ed32 req-f7a67b48-6161-4de8-87bb-6dc7599821dd service nova] Creating event network-changed:c8937c88-9bc5-4e2e-abe3-b2ac180cecef for instance d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87 on n-h2-master-1 Aug 07 01:34:39.593887 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-3adede91-f761-4c44-9a9d-6509de11ed32 req-f7a67b48-6161-4de8-87bb-6dc7599821dd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075902 Aug 07 01:34:39.596380 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2585/4781] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:34:39.607368 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-009e16b3-d33e-4309-be99-bd106a998484 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:39.608706 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-009e16b3-d33e-4309-be99-bd106a998484 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 57ef5095-2f80-41c5-abc9-ca37439f3384] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:39.620841 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-009e16b3-d33e-4309-be99-bd106a998484 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:39.621978 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-009e16b3-d33e-4309-be99-bd106a998484 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:39.622851 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-009e16b3-d33e-4309-be99-bd106a998484 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:39.625029 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-009e16b3-d33e-4309-be99-bd106a998484 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:39.625546 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-009e16b3-d33e-4309-be99-bd106a998484 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:39.625994 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-009e16b3-d33e-4309-be99-bd106a998484 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:39.826367 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3ea2ccc5-78be-48bf-8d85-5f104db3eb8f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:39.843123 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3ea2ccc5-78be-48bf-8d85-5f104db3eb8f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:39.845610 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3ea2ccc5-78be-48bf-8d85-5f104db3eb8f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:39.847250 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3ea2ccc5-78be-48bf-8d85-5f104db3eb8f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1808 microversion: 2.20 time: 1.122687 Aug 07 01:34:39.850273 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2197/4782] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:38 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1808 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:34:39.861187 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d42f7836-3bff-4821-8282-5381f5110338 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:39.865201 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d42f7836-3bff-4821-8282-5381f5110338 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:39.879696 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d42f7836-3bff-4821-8282-5381f5110338 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:39.880513 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d42f7836-3bff-4821-8282-5381f5110338 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:39.881137 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d42f7836-3bff-4821-8282-5381f5110338 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:39.882037 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d42f7836-3bff-4821-8282-5381f5110338 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:39.882503 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d42f7836-3bff-4821-8282-5381f5110338 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:39.886712 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d42f7836-3bff-4821-8282-5381f5110338 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:40.561258 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-009e16b3-d33e-4309-be99-bd106a998484 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:40.574735 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-009e16b3-d33e-4309-be99-bd106a998484 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384" status: 200 len: 1368 microversion: 2.1 time: 0.972269 Aug 07 01:34:40.575596 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2586/4783] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:39 2022] GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384 => generated 1368 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:40.595013 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8813dac9-67f2-4c09-ab2a-1916f1e9e050 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:40.595640 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8813dac9-67f2-4c09-ab2a-1916f1e9e050 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: cfa709be-49f5-434c-8c0e-cb4671f40105] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:40.625320 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d42f7836-3bff-4821-8282-5381f5110338 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:40.642999 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d42f7836-3bff-4821-8282-5381f5110338 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1524 microversion: 2.1 time: 0.790867 Aug 07 01:34:40.648131 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8813dac9-67f2-4c09-ab2a-1916f1e9e050 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:40.648680 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8813dac9-67f2-4c09-ab2a-1916f1e9e050 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:40.649065 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8813dac9-67f2-4c09-ab2a-1916f1e9e050 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:40.657700 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8813dac9-67f2-4c09-ab2a-1916f1e9e050 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:40.658785 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8813dac9-67f2-4c09-ab2a-1916f1e9e050 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:40.659275 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2198/4784] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:39 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1524 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:40.663268 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8813dac9-67f2-4c09-ab2a-1916f1e9e050 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:40.876078 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2e842b22-2325-4c96-a5a2-55d7cb5db1cb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:40.876848 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2e842b22-2325-4c96-a5a2-55d7cb5db1cb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:40.887837 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2e842b22-2325-4c96-a5a2-55d7cb5db1cb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:40.888501 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2e842b22-2325-4c96-a5a2-55d7cb5db1cb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:40.889167 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2e842b22-2325-4c96-a5a2-55d7cb5db1cb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:40.893433 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2e842b22-2325-4c96-a5a2-55d7cb5db1cb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:40.894036 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2e842b22-2325-4c96-a5a2-55d7cb5db1cb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:40.894570 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2e842b22-2325-4c96-a5a2-55d7cb5db1cb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:41.206857 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8813dac9-67f2-4c09-ab2a-1916f1e9e050 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:41.215032 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8813dac9-67f2-4c09-ab2a-1916f1e9e050 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105" status: 200 len: 1318 microversion: 2.1 time: 0.637193 Aug 07 01:34:41.217813 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2587/4785] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:40 2022] GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105 => generated 1318 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:41.596471 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d2765c10-3bb5-44bd-8626-8ed526a93b30 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:41.598480 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d2765c10-3bb5-44bd-8626-8ed526a93b30 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 57ef5095-2f80-41c5-abc9-ca37439f3384] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:41.613946 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2765c10-3bb5-44bd-8626-8ed526a93b30 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:41.615039 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2765c10-3bb5-44bd-8626-8ed526a93b30 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:41.615821 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2765c10-3bb5-44bd-8626-8ed526a93b30 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:41.616807 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2765c10-3bb5-44bd-8626-8ed526a93b30 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:41.617536 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2765c10-3bb5-44bd-8626-8ed526a93b30 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:41.618206 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2765c10-3bb5-44bd-8626-8ed526a93b30 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:41.841910 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d2765c10-3bb5-44bd-8626-8ed526a93b30 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:41.849929 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d2765c10-3bb5-44bd-8626-8ed526a93b30 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384" status: 200 len: 1368 microversion: 2.1 time: 0.257386 Aug 07 01:34:41.851910 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2588/4786] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:41 2022] GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384 => generated 1368 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:34:41.859439 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6f67d292-3b5e-4d5e-88d3-3ce46d0c927a tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:41.863769 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6f67d292-3b5e-4d5e-88d3-3ce46d0c927a tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:41.871717 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f67d292-3b5e-4d5e-88d3-3ce46d0c927a tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:41.872488 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f67d292-3b5e-4d5e-88d3-3ce46d0c927a tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:41.874021 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f67d292-3b5e-4d5e-88d3-3ce46d0c927a tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:41.875003 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f67d292-3b5e-4d5e-88d3-3ce46d0c927a tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:41.875789 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f67d292-3b5e-4d5e-88d3-3ce46d0c927a tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:41.876791 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f67d292-3b5e-4d5e-88d3-3ce46d0c927a tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:42.132172 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6f67d292-3b5e-4d5e-88d3-3ce46d0c927a tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:42.143553 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6f67d292-3b5e-4d5e-88d3-3ce46d0c927a tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1524 microversion: 2.1 time: 0.288005 Aug 07 01:34:42.144737 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2589/4787] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:41 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1524 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:42.244528 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5cf5b94f-b26a-4de8-99e7-cbd338827504 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:42.245526 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5cf5b94f-b26a-4de8-99e7-cbd338827504 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: cfa709be-49f5-434c-8c0e-cb4671f40105] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:42.260897 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cf5b94f-b26a-4de8-99e7-cbd338827504 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:42.264344 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cf5b94f-b26a-4de8-99e7-cbd338827504 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:42.265930 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cf5b94f-b26a-4de8-99e7-cbd338827504 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:42.270230 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cf5b94f-b26a-4de8-99e7-cbd338827504 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:42.277402 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cf5b94f-b26a-4de8-99e7-cbd338827504 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:42.285553 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cf5b94f-b26a-4de8-99e7-cbd338827504 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:42.384382 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2e842b22-2325-4c96-a5a2-55d7cb5db1cb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:42.399868 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2e842b22-2325-4c96-a5a2-55d7cb5db1cb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:42.405117 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2e842b22-2325-4c96-a5a2-55d7cb5db1cb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:42.407727 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2e842b22-2325-4c96-a5a2-55d7cb5db1cb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1808 microversion: 2.20 time: 1.537924 Aug 07 01:34:42.429649 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2199/4788] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:40 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1808 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:34:42.618768 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5cf5b94f-b26a-4de8-99e7-cbd338827504 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:42.633151 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5cf5b94f-b26a-4de8-99e7-cbd338827504 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105" status: 200 len: 1318 microversion: 2.1 time: 0.396601 Aug 07 01:34:42.637326 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2590/4789] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:42 2022] GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105 => generated 1318 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:42.875310 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-dd1a8cc6-747f-4079-93f2-23d46265887c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:42.879475 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-dd1a8cc6-747f-4079-93f2-23d46265887c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 57ef5095-2f80-41c5-abc9-ca37439f3384] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:42.902896 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd1a8cc6-747f-4079-93f2-23d46265887c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:42.918026 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd1a8cc6-747f-4079-93f2-23d46265887c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:42.922722 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd1a8cc6-747f-4079-93f2-23d46265887c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:42.923968 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd1a8cc6-747f-4079-93f2-23d46265887c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:42.928129 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd1a8cc6-747f-4079-93f2-23d46265887c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:42.929426 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd1a8cc6-747f-4079-93f2-23d46265887c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:43.001541 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:43.171135 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b0327247-8da3-422b-81c1-3dd5511e27d7 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:43.172172 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b0327247-8da3-422b-81c1-3dd5511e27d7 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:43.186586 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b0327247-8da3-422b-81c1-3dd5511e27d7 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:43.187323 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b0327247-8da3-422b-81c1-3dd5511e27d7 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:43.188732 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b0327247-8da3-422b-81c1-3dd5511e27d7 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:43.190908 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b0327247-8da3-422b-81c1-3dd5511e27d7 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:43.192598 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b0327247-8da3-422b-81c1-3dd5511e27d7 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:43.193211 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b0327247-8da3-422b-81c1-3dd5511e27d7 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:43.548120 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b0327247-8da3-422b-81c1-3dd5511e27d7 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:43.558612 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b0327247-8da3-422b-81c1-3dd5511e27d7 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1524 microversion: 2.1 time: 0.391613 Aug 07 01:34:43.568435 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2591/4790] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:43 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1524 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:43.590028 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3e489a59-2952-4a22-bfa5-94f0204ca7c1 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:43.592301 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3e489a59-2952-4a22-bfa5-94f0204ca7c1 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:43.628221 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e489a59-2952-4a22-bfa5-94f0204ca7c1 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:43.631530 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e489a59-2952-4a22-bfa5-94f0204ca7c1 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:43.632286 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e489a59-2952-4a22-bfa5-94f0204ca7c1 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:43.635986 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e489a59-2952-4a22-bfa5-94f0204ca7c1 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:43.638201 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e489a59-2952-4a22-bfa5-94f0204ca7c1 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:43.639648 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e489a59-2952-4a22-bfa5-94f0204ca7c1 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:44.098919 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3e489a59-2952-4a22-bfa5-94f0204ca7c1 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:44.112297 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3e489a59-2952-4a22-bfa5-94f0204ca7c1 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:44.116674 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3e489a59-2952-4a22-bfa5-94f0204ca7c1 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:44.126172 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3e489a59-2952-4a22-bfa5-94f0204ca7c1 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1808 microversion: 2.20 time: 0.555536 Aug 07 01:34:44.128716 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2592/4791] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:43 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1808 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:34:44.134762 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fb717539-a4cc-4e86-994d-015c3c7917e2 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:44.141057 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fb717539-a4cc-4e86-994d-015c3c7917e2 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: cfa709be-49f5-434c-8c0e-cb4671f40105] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:44.171847 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fb717539-a4cc-4e86-994d-015c3c7917e2 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:44.172509 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fb717539-a4cc-4e86-994d-015c3c7917e2 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:44.176691 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fb717539-a4cc-4e86-994d-015c3c7917e2 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:44.177585 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fb717539-a4cc-4e86-994d-015c3c7917e2 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:44.182326 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fb717539-a4cc-4e86-994d-015c3c7917e2 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:44.182899 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fb717539-a4cc-4e86-994d-015c3c7917e2 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:44.546552 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fb717539-a4cc-4e86-994d-015c3c7917e2 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:44.557657 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fb717539-a4cc-4e86-994d-015c3c7917e2 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105" status: 200 len: 1318 microversion: 2.1 time: 0.424802 Aug 07 01:34:44.558992 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2593/4792] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:44 2022] GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105 => generated 1318 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:44.586626 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-e52df62e-f3d2-432c-8e4e-76ccddc0446d req-6b682e7e-a40f-436b-b448-30d2a034adb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57ef5095-2f80-41c5-abc9-ca37439f3384", "tag": "d4ad23ab-8771-4aec-b8a5-442eb0265864"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:34:44.623138 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e52df62e-f3d2-432c-8e4e-76ccddc0446d req-6b682e7e-a40f-436b-b448-30d2a034adb9 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:44.623870 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e52df62e-f3d2-432c-8e4e-76ccddc0446d req-6b682e7e-a40f-436b-b448-30d2a034adb9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:44.627361 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e52df62e-f3d2-432c-8e4e-76ccddc0446d req-6b682e7e-a40f-436b-b448-30d2a034adb9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:44.665350 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-e52df62e-f3d2-432c-8e4e-76ccddc0446d req-6b682e7e-a40f-436b-b448-30d2a034adb9 service nova] Creating event network-changed:d4ad23ab-8771-4aec-b8a5-442eb0265864 for instance 57ef5095-2f80-41c5-abc9-ca37439f3384 on n-h1-master-1 Aug 07 01:34:44.678731 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-e52df62e-f3d2-432c-8e4e-76ccddc0446d req-6b682e7e-a40f-436b-b448-30d2a034adb9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101953 Aug 07 01:34:44.683262 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2594/4793] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:34:44.700745 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-29ed9bd1-8034-4028-ba90-ef4b15a0aad5 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:44.703330 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-29ed9bd1-8034-4028-ba90-ef4b15a0aad5 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:44.727994 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-29ed9bd1-8034-4028-ba90-ef4b15a0aad5 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:44.729579 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-29ed9bd1-8034-4028-ba90-ef4b15a0aad5 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:44.734463 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-29ed9bd1-8034-4028-ba90-ef4b15a0aad5 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:44.735777 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-29ed9bd1-8034-4028-ba90-ef4b15a0aad5 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:44.736723 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-29ed9bd1-8034-4028-ba90-ef4b15a0aad5 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:44.738510 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-29ed9bd1-8034-4028-ba90-ef4b15a0aad5 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:45.028640 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-dd1a8cc6-747f-4079-93f2-23d46265887c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:45.040018 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-dd1a8cc6-747f-4079-93f2-23d46265887c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384" status: 200 len: 1368 microversion: 2.1 time: 2.168836 Aug 07 01:34:45.060754 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2200/4794] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:42 2022] GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384 => generated 1368 bytes in 2190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:45.157950 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f926f205-9348-4f82-9128-e0e6046dbdd5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:45.158851 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f926f205-9348-4f82-9128-e0e6046dbdd5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:45.179560 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f926f205-9348-4f82-9128-e0e6046dbdd5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:45.180107 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f926f205-9348-4f82-9128-e0e6046dbdd5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:45.182575 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f926f205-9348-4f82-9128-e0e6046dbdd5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:45.185463 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f926f205-9348-4f82-9128-e0e6046dbdd5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:45.186937 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f926f205-9348-4f82-9128-e0e6046dbdd5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:45.188374 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f926f205-9348-4f82-9128-e0e6046dbdd5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:45.326457 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-29ed9bd1-8034-4028-ba90-ef4b15a0aad5 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:45.341240 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-29ed9bd1-8034-4028-ba90-ef4b15a0aad5 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1524 microversion: 2.1 time: 0.650467 Aug 07 01:34:45.342481 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2595/4795] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:44 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1524 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:45.581440 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8af37317-46c3-40c4-adac-a747d4747edd tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:45.582443 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8af37317-46c3-40c4-adac-a747d4747edd tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: cfa709be-49f5-434c-8c0e-cb4671f40105] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:45.605786 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8af37317-46c3-40c4-adac-a747d4747edd tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:45.606548 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8af37317-46c3-40c4-adac-a747d4747edd tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:45.612824 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8af37317-46c3-40c4-adac-a747d4747edd tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:45.616588 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8af37317-46c3-40c4-adac-a747d4747edd tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:45.617462 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8af37317-46c3-40c4-adac-a747d4747edd tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:45.621346 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8af37317-46c3-40c4-adac-a747d4747edd tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:45.683731 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:45.977067 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8af37317-46c3-40c4-adac-a747d4747edd tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:46.008050 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8af37317-46c3-40c4-adac-a747d4747edd tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105" status: 200 len: 1318 microversion: 2.1 time: 0.424459 Aug 07 01:34:46.010735 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2596/4796] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:45 2022] GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105 => generated 1318 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:34:46.067244 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-48a1708d-809d-4497-a591-00aea5733924 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:46.068184 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-48a1708d-809d-4497-a591-00aea5733924 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 57ef5095-2f80-41c5-abc9-ca37439f3384] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:46.077853 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48a1708d-809d-4497-a591-00aea5733924 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:46.084598 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48a1708d-809d-4497-a591-00aea5733924 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:46.086258 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48a1708d-809d-4497-a591-00aea5733924 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:46.089340 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48a1708d-809d-4497-a591-00aea5733924 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:46.090024 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48a1708d-809d-4497-a591-00aea5733924 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:46.091392 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48a1708d-809d-4497-a591-00aea5733924 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:46.487588 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-48a1708d-809d-4497-a591-00aea5733924 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:46.498679 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-48a1708d-809d-4497-a591-00aea5733924 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384" status: 200 len: 1368 microversion: 2.1 time: 0.435159 Aug 07 01:34:46.502254 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2597/4797] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:46 2022] GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384 => generated 1368 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:46.519168 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d243c814-178c-4a05-8635-08e66603c972 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:46.519795 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d243c814-178c-4a05-8635-08e66603c972 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:46.547420 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d243c814-178c-4a05-8635-08e66603c972 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:46.547981 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d243c814-178c-4a05-8635-08e66603c972 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:46.548401 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d243c814-178c-4a05-8635-08e66603c972 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:46.549136 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d243c814-178c-4a05-8635-08e66603c972 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:46.549589 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d243c814-178c-4a05-8635-08e66603c972 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:46.550013 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d243c814-178c-4a05-8635-08e66603c972 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:46.666588 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f926f205-9348-4f82-9128-e0e6046dbdd5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:46.678484 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f926f205-9348-4f82-9128-e0e6046dbdd5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:46.680699 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f926f205-9348-4f82-9128-e0e6046dbdd5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:46.682518 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f926f205-9348-4f82-9128-e0e6046dbdd5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1808 microversion: 2.20 time: 1.530102 Aug 07 01:34:46.683593 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2201/4798] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:45 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1808 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:34:46.984170 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d243c814-178c-4a05-8635-08e66603c972 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:46.995222 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d243c814-178c-4a05-8635-08e66603c972 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1524 microversion: 2.1 time: 0.491839 Aug 07 01:34:46.995835 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2598/4799] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:46 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1524 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:47.037520 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-286a65fd-4b19-4ad6-adc9-4ef9679f97b2 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:47.038175 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-286a65fd-4b19-4ad6-adc9-4ef9679f97b2 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: cfa709be-49f5-434c-8c0e-cb4671f40105] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:47.059108 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-286a65fd-4b19-4ad6-adc9-4ef9679f97b2 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:47.061613 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-286a65fd-4b19-4ad6-adc9-4ef9679f97b2 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:47.068146 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-286a65fd-4b19-4ad6-adc9-4ef9679f97b2 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:47.069361 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-286a65fd-4b19-4ad6-adc9-4ef9679f97b2 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:47.072543 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-286a65fd-4b19-4ad6-adc9-4ef9679f97b2 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:47.074343 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-286a65fd-4b19-4ad6-adc9-4ef9679f97b2 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:47.542276 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-665e6173-9dfd-4b2f-a66a-d0ce67794f80 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:47.543019 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-665e6173-9dfd-4b2f-a66a-d0ce67794f80 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 57ef5095-2f80-41c5-abc9-ca37439f3384] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:47.566769 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-665e6173-9dfd-4b2f-a66a-d0ce67794f80 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:47.567469 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-665e6173-9dfd-4b2f-a66a-d0ce67794f80 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:47.568273 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-665e6173-9dfd-4b2f-a66a-d0ce67794f80 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:47.571007 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-665e6173-9dfd-4b2f-a66a-d0ce67794f80 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:47.571552 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-665e6173-9dfd-4b2f-a66a-d0ce67794f80 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:47.572520 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-665e6173-9dfd-4b2f-a66a-d0ce67794f80 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:47.848521 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-286a65fd-4b19-4ad6-adc9-4ef9679f97b2 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:47.870783 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-286a65fd-4b19-4ad6-adc9-4ef9679f97b2 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105" status: 200 len: 1318 microversion: 2.1 time: 0.831724 Aug 07 01:34:47.871723 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2202/4800] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:47 2022] GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105 => generated 1318 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:47.895036 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-477edda4-1ff7-4ff3-bb86-8094fd1356c6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:47.903246 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-477edda4-1ff7-4ff3-bb86-8094fd1356c6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:47.927098 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-477edda4-1ff7-4ff3-bb86-8094fd1356c6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:47.927608 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-477edda4-1ff7-4ff3-bb86-8094fd1356c6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:47.928089 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-477edda4-1ff7-4ff3-bb86-8094fd1356c6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:47.929909 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-477edda4-1ff7-4ff3-bb86-8094fd1356c6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:47.930380 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-477edda4-1ff7-4ff3-bb86-8094fd1356c6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:47.934450 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-477edda4-1ff7-4ff3-bb86-8094fd1356c6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:47.958308 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-665e6173-9dfd-4b2f-a66a-d0ce67794f80 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:47.980291 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-665e6173-9dfd-4b2f-a66a-d0ce67794f80 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384" status: 200 len: 1368 microversion: 2.1 time: 0.443478 Aug 07 01:34:47.991994 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2599/4801] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:47 2022] GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384 => generated 1368 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:48.020047 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ddbae059-f76f-4862-9a95-a14189f59788 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:48.020284 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ddbae059-f76f-4862-9a95-a14189f59788 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:48.033223 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddbae059-f76f-4862-9a95-a14189f59788 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:48.033842 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddbae059-f76f-4862-9a95-a14189f59788 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:48.034285 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddbae059-f76f-4862-9a95-a14189f59788 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:48.038417 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddbae059-f76f-4862-9a95-a14189f59788 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:48.048869 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddbae059-f76f-4862-9a95-a14189f59788 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:48.048869 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddbae059-f76f-4862-9a95-a14189f59788 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:48.509995 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ddbae059-f76f-4862-9a95-a14189f59788 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:48.527688 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ddbae059-f76f-4862-9a95-a14189f59788 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1524 microversion: 2.1 time: 0.507009 Aug 07 01:34:48.528960 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2600/4802] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:48 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1524 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:48.538858 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-dcbf4e67-d000-4759-bce4-667d64069465 req-36d07e36-baaa-4f17-8d87-71eae6445379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfa709be-49f5-434c-8c0e-cb4671f40105", "name": "network-vif-plugged", "status": "completed", "tag": "6117126d-ff0c-4996-bf60-4a7445604f1e"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:34:48.582974 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-dcbf4e67-d000-4759-bce4-667d64069465 req-36d07e36-baaa-4f17-8d87-71eae6445379 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:48.583485 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-dcbf4e67-d000-4759-bce4-667d64069465 req-36d07e36-baaa-4f17-8d87-71eae6445379 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:48.584165 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-dcbf4e67-d000-4759-bce4-667d64069465 req-36d07e36-baaa-4f17-8d87-71eae6445379 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:48.656596 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-dcbf4e67-d000-4759-bce4-667d64069465 req-36d07e36-baaa-4f17-8d87-71eae6445379 service nova] Creating event network-vif-plugged:6117126d-ff0c-4996-bf60-4a7445604f1e for instance cfa709be-49f5-434c-8c0e-cb4671f40105 on n-h2-master-1 Aug 07 01:34:48.683597 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-dcbf4e67-d000-4759-bce4-667d64069465 req-36d07e36-baaa-4f17-8d87-71eae6445379 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152708 Aug 07 01:34:48.691974 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2601/4803] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:34:48.897703 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3b2b0ba9-9a2a-4d1f-bd2c-b8e1cbc5ee64 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:48.898412 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3b2b0ba9-9a2a-4d1f-bd2c-b8e1cbc5ee64 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: cfa709be-49f5-434c-8c0e-cb4671f40105] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:48.915267 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b2b0ba9-9a2a-4d1f-bd2c-b8e1cbc5ee64 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:48.918300 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b2b0ba9-9a2a-4d1f-bd2c-b8e1cbc5ee64 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:48.922419 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b2b0ba9-9a2a-4d1f-bd2c-b8e1cbc5ee64 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:48.923454 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b2b0ba9-9a2a-4d1f-bd2c-b8e1cbc5ee64 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:48.926555 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b2b0ba9-9a2a-4d1f-bd2c-b8e1cbc5ee64 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:48.928565 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b2b0ba9-9a2a-4d1f-bd2c-b8e1cbc5ee64 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:49.449397 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3b2b0ba9-9a2a-4d1f-bd2c-b8e1cbc5ee64 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:49.473539 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3b2b0ba9-9a2a-4d1f-bd2c-b8e1cbc5ee64 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105" status: 200 len: 1318 microversion: 2.1 time: 0.581762 Aug 07 01:34:49.480456 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2602/4804] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:48 2022] GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105 => generated 1318 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:49.517228 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-01a9098f-5dbe-451c-a4ff-43a971508cb0 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:49.517993 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-01a9098f-5dbe-451c-a4ff-43a971508cb0 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 57ef5095-2f80-41c5-abc9-ca37439f3384] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:49.572004 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-01a9098f-5dbe-451c-a4ff-43a971508cb0 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:49.572645 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-01a9098f-5dbe-451c-a4ff-43a971508cb0 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:49.573173 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-01a9098f-5dbe-451c-a4ff-43a971508cb0 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:49.574021 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-01a9098f-5dbe-451c-a4ff-43a971508cb0 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:49.584032 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-01a9098f-5dbe-451c-a4ff-43a971508cb0 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:49.584676 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-01a9098f-5dbe-451c-a4ff-43a971508cb0 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:49.878151 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-477edda4-1ff7-4ff3-bb86-8094fd1356c6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:49.896949 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-477edda4-1ff7-4ff3-bb86-8094fd1356c6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:49.898597 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-477edda4-1ff7-4ff3-bb86-8094fd1356c6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:49.900060 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-477edda4-1ff7-4ff3-bb86-8094fd1356c6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1808 microversion: 2.20 time: 2.022874 Aug 07 01:34:49.923172 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2203/4805] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:47 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1808 bytes in 2049 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:34:49.930145 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9de8a4ad-7bf3-4b93-af62-a0b04c6981a2 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:49.930779 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9de8a4ad-7bf3-4b93-af62-a0b04c6981a2 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:49.934755 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=3,nova_api:INSERT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:49.989076 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9de8a4ad-7bf3-4b93-af62-a0b04c6981a2 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:49.989587 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9de8a4ad-7bf3-4b93-af62-a0b04c6981a2 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:49.990032 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9de8a4ad-7bf3-4b93-af62-a0b04c6981a2 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:49.990765 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9de8a4ad-7bf3-4b93-af62-a0b04c6981a2 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:49.991227 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9de8a4ad-7bf3-4b93-af62-a0b04c6981a2 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:49.991660 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9de8a4ad-7bf3-4b93-af62-a0b04c6981a2 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:50.142290 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-01a9098f-5dbe-451c-a4ff-43a971508cb0 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:50.158567 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-01a9098f-5dbe-451c-a4ff-43a971508cb0 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384" status: 200 len: 1368 microversion: 2.1 time: 0.676850 Aug 07 01:34:50.162918 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2603/4806] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:49 2022] GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384 => generated 1368 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:50.499500 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7ddf785d-f9b0-415a-85d4-9a4402696787 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:50.500222 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7ddf785d-f9b0-415a-85d4-9a4402696787 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: cfa709be-49f5-434c-8c0e-cb4671f40105] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:50.523289 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ddf785d-f9b0-415a-85d4-9a4402696787 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:50.532229 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ddf785d-f9b0-415a-85d4-9a4402696787 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:50.534282 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ddf785d-f9b0-415a-85d4-9a4402696787 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:50.535255 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ddf785d-f9b0-415a-85d4-9a4402696787 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:50.542442 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ddf785d-f9b0-415a-85d4-9a4402696787 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:50.543327 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ddf785d-f9b0-415a-85d4-9a4402696787 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:50.938466 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9de8a4ad-7bf3-4b93-af62-a0b04c6981a2 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:50.954951 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9de8a4ad-7bf3-4b93-af62-a0b04c6981a2 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1524 microversion: 2.1 time: 1.030515 Aug 07 01:34:50.961110 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2204/4807] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:49 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1524 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:50.980216 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1978dd34-9478-4874-9d5e-0224310f8c5c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:50.981844 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1978dd34-9478-4874-9d5e-0224310f8c5c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:51.012835 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1978dd34-9478-4874-9d5e-0224310f8c5c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:51.014256 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7ddf785d-f9b0-415a-85d4-9a4402696787 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:51.016153 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1978dd34-9478-4874-9d5e-0224310f8c5c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:51.017862 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1978dd34-9478-4874-9d5e-0224310f8c5c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:51.021002 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1978dd34-9478-4874-9d5e-0224310f8c5c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:51.025432 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1978dd34-9478-4874-9d5e-0224310f8c5c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:51.030946 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1978dd34-9478-4874-9d5e-0224310f8c5c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:51.050563 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7ddf785d-f9b0-415a-85d4-9a4402696787 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105" status: 200 len: 1318 microversion: 2.1 time: 0.550754 Aug 07 01:34:51.081385 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2604/4808] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:50 2022] GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105 => generated 1318 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:51.183934 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b1287e45-2537-4bea-961f-38bed3ac7bd8 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:51.184495 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b1287e45-2537-4bea-961f-38bed3ac7bd8 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 57ef5095-2f80-41c5-abc9-ca37439f3384] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:51.194512 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b1287e45-2537-4bea-961f-38bed3ac7bd8 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:51.195009 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b1287e45-2537-4bea-961f-38bed3ac7bd8 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:51.195449 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b1287e45-2537-4bea-961f-38bed3ac7bd8 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:51.196195 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b1287e45-2537-4bea-961f-38bed3ac7bd8 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:51.196678 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b1287e45-2537-4bea-961f-38bed3ac7bd8 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:51.197099 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b1287e45-2537-4bea-961f-38bed3ac7bd8 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:51.342235 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1978dd34-9478-4874-9d5e-0224310f8c5c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:51.355637 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1978dd34-9478-4874-9d5e-0224310f8c5c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:51.357216 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1978dd34-9478-4874-9d5e-0224310f8c5c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:51.358444 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1978dd34-9478-4874-9d5e-0224310f8c5c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1808 microversion: 2.20 time: 0.394789 Aug 07 01:34:51.361023 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2205/4809] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:50 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1808 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:34:51.391800 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-a742abf3-abba-4db5-bffd-844c3e1e78bd req-54275330-82d6-43a9-8f14-297592bd1fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57ef5095-2f80-41c5-abc9-ca37439f3384", "name": "network-vif-plugged", "status": "completed", "tag": "d4ad23ab-8771-4aec-b8a5-442eb0265864"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:34:51.423923 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a742abf3-abba-4db5-bffd-844c3e1e78bd req-54275330-82d6-43a9-8f14-297592bd1fb9 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:51.429816 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a742abf3-abba-4db5-bffd-844c3e1e78bd req-54275330-82d6-43a9-8f14-297592bd1fb9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:51.430690 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a742abf3-abba-4db5-bffd-844c3e1e78bd req-54275330-82d6-43a9-8f14-297592bd1fb9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:51.469937 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-a742abf3-abba-4db5-bffd-844c3e1e78bd req-54275330-82d6-43a9-8f14-297592bd1fb9 service nova] Creating event network-vif-plugged:d4ad23ab-8771-4aec-b8a5-442eb0265864 for instance 57ef5095-2f80-41c5-abc9-ca37439f3384 on n-h1-master-1 Aug 07 01:34:51.486420 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-a742abf3-abba-4db5-bffd-844c3e1e78bd req-54275330-82d6-43a9-8f14-297592bd1fb9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122456 Aug 07 01:34:51.487833 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2206/4810] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:34:51.987943 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c557c9c6-c08a-4bab-b6fa-23485e581311 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:51.988617 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c557c9c6-c08a-4bab-b6fa-23485e581311 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:52.013825 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c557c9c6-c08a-4bab-b6fa-23485e581311 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:52.014494 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c557c9c6-c08a-4bab-b6fa-23485e581311 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:52.017880 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c557c9c6-c08a-4bab-b6fa-23485e581311 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:52.020794 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c557c9c6-c08a-4bab-b6fa-23485e581311 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:52.021295 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c557c9c6-c08a-4bab-b6fa-23485e581311 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:52.022393 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c557c9c6-c08a-4bab-b6fa-23485e581311 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:52.042012 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b1287e45-2537-4bea-961f-38bed3ac7bd8 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:52.051675 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b1287e45-2537-4bea-961f-38bed3ac7bd8 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384" status: 200 len: 1368 microversion: 2.1 time: 0.872170 Aug 07 01:34:52.055762 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2605/4811] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:51 2022] GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384 => generated 1368 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:34:52.088473 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-47b76622-525a-4e92-a466-13f216b20c40 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:52.092331 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-47b76622-525a-4e92-a466-13f216b20c40 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: cfa709be-49f5-434c-8c0e-cb4671f40105] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:52.117316 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-47b76622-525a-4e92-a466-13f216b20c40 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:52.117452 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-47b76622-525a-4e92-a466-13f216b20c40 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:52.117791 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-47b76622-525a-4e92-a466-13f216b20c40 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:52.119152 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-47b76622-525a-4e92-a466-13f216b20c40 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:52.119625 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-47b76622-525a-4e92-a466-13f216b20c40 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:52.141212 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-47b76622-525a-4e92-a466-13f216b20c40 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:52.440491 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c557c9c6-c08a-4bab-b6fa-23485e581311 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:52.455490 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c557c9c6-c08a-4bab-b6fa-23485e581311 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1524 microversion: 2.1 time: 0.477325 Aug 07 01:34:52.456618 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2207/4812] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:51 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1524 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:52.473787 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-566cfbb8-a093-4448-b6b7-738695316643 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:52.474288 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-566cfbb8-a093-4448-b6b7-738695316643 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:52.483326 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-566cfbb8-a093-4448-b6b7-738695316643 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:52.484149 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-566cfbb8-a093-4448-b6b7-738695316643 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:52.484825 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-566cfbb8-a093-4448-b6b7-738695316643 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:52.486656 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-566cfbb8-a093-4448-b6b7-738695316643 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:52.487742 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-566cfbb8-a093-4448-b6b7-738695316643 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:52.488374 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-566cfbb8-a093-4448-b6b7-738695316643 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:52.909114 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-47b76622-525a-4e92-a466-13f216b20c40 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:52.921093 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-47b76622-525a-4e92-a466-13f216b20c40 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105" status: 200 len: 1318 microversion: 2.1 time: 0.837510 Aug 07 01:34:52.937345 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-566cfbb8-a093-4448-b6b7-738695316643 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:52.964639 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2606/4813] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:52 2022] GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105 => generated 1318 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:52.966347 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-566cfbb8-a093-4448-b6b7-738695316643 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:52.977273 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-566cfbb8-a093-4448-b6b7-738695316643 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:52.988498 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-566cfbb8-a093-4448-b6b7-738695316643 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1808 microversion: 2.20 time: 0.521861 Aug 07 01:34:52.990459 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2208/4814] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:52 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1808 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:34:53.081883 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-16e6d56f-5168-45be-8f7e-f92546ca3ced tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:53.083833 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-16e6d56f-5168-45be-8f7e-f92546ca3ced tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 57ef5095-2f80-41c5-abc9-ca37439f3384] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:53.101750 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-16e6d56f-5168-45be-8f7e-f92546ca3ced tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:53.105667 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-16e6d56f-5168-45be-8f7e-f92546ca3ced tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:53.107859 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-16e6d56f-5168-45be-8f7e-f92546ca3ced tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:53.123397 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-16e6d56f-5168-45be-8f7e-f92546ca3ced tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:53.126290 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-16e6d56f-5168-45be-8f7e-f92546ca3ced tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:53.132070 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-16e6d56f-5168-45be-8f7e-f92546ca3ced tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:53.482047 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e89c4374-b08d-44b7-912e-9dc4407dd837 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:53.482832 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e89c4374-b08d-44b7-912e-9dc4407dd837 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:53.499750 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e89c4374-b08d-44b7-912e-9dc4407dd837 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:53.504728 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e89c4374-b08d-44b7-912e-9dc4407dd837 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:53.505370 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e89c4374-b08d-44b7-912e-9dc4407dd837 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:53.506262 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e89c4374-b08d-44b7-912e-9dc4407dd837 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:53.511772 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e89c4374-b08d-44b7-912e-9dc4407dd837 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:53.517613 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e89c4374-b08d-44b7-912e-9dc4407dd837 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:54.048131 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e89c4374-b08d-44b7-912e-9dc4407dd837 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:54.050179 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-16e6d56f-5168-45be-8f7e-f92546ca3ced tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:54.066411 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e89c4374-b08d-44b7-912e-9dc4407dd837 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1524 microversion: 2.1 time: 0.589048 Aug 07 01:34:54.073306 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-16e6d56f-5168-45be-8f7e-f92546ca3ced tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384" status: 200 len: 1368 microversion: 2.1 time: 0.995941 Aug 07 01:34:54.075061 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2607/4815] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:53 2022] GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384 => generated 1368 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:54.075628 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2209/4816] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:53 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1524 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:54.086722 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-d30203ad-e8fc-48c1-8b6a-752e9d4cb2aa req-bc713ee2-8866-4b07-9630-7938ae8fc8a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87", "name": "network-vif-plugged", "status": "completed", "tag": "c8937c88-9bc5-4e2e-abe3-b2ac180cecef"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:34:54.111079 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bf73f68c-8889-4fa1-8056-1dc22e244ab9 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:54.118277 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bf73f68c-8889-4fa1-8056-1dc22e244ab9 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: cfa709be-49f5-434c-8c0e-cb4671f40105] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:54.135679 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bf73f68c-8889-4fa1-8056-1dc22e244ab9 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:54.140106 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d30203ad-e8fc-48c1-8b6a-752e9d4cb2aa req-bc713ee2-8866-4b07-9630-7938ae8fc8a6 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:54.141159 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bf73f68c-8889-4fa1-8056-1dc22e244ab9 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:54.148713 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bf73f68c-8889-4fa1-8056-1dc22e244ab9 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:54.150438 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d30203ad-e8fc-48c1-8b6a-752e9d4cb2aa req-bc713ee2-8866-4b07-9630-7938ae8fc8a6 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:54.151489 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bf73f68c-8889-4fa1-8056-1dc22e244ab9 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:54.153268 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bf73f68c-8889-4fa1-8056-1dc22e244ab9 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:54.154221 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bf73f68c-8889-4fa1-8056-1dc22e244ab9 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:54.154733 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d30203ad-e8fc-48c1-8b6a-752e9d4cb2aa req-bc713ee2-8866-4b07-9630-7938ae8fc8a6 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:54.194775 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-d30203ad-e8fc-48c1-8b6a-752e9d4cb2aa req-bc713ee2-8866-4b07-9630-7938ae8fc8a6 service nova] Creating event network-vif-plugged:c8937c88-9bc5-4e2e-abe3-b2ac180cecef for instance d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87 on n-h2-master-1 Aug 07 01:34:54.218274 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-d30203ad-e8fc-48c1-8b6a-752e9d4cb2aa req-bc713ee2-8866-4b07-9630-7938ae8fc8a6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140844 Aug 07 01:34:54.223398 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2210/4817] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:34:54.240146 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-dbafcb5c-6f50-47f8-a20a-628933ee6f46 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:54.253942 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-dbafcb5c-6f50-47f8-a20a-628933ee6f46 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:54.267745 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dbafcb5c-6f50-47f8-a20a-628933ee6f46 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:54.273551 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dbafcb5c-6f50-47f8-a20a-628933ee6f46 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:54.274437 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dbafcb5c-6f50-47f8-a20a-628933ee6f46 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:54.276393 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dbafcb5c-6f50-47f8-a20a-628933ee6f46 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:54.277215 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dbafcb5c-6f50-47f8-a20a-628933ee6f46 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:54.280504 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dbafcb5c-6f50-47f8-a20a-628933ee6f46 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:54.568107 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bf73f68c-8889-4fa1-8056-1dc22e244ab9 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:54.579090 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bf73f68c-8889-4fa1-8056-1dc22e244ab9 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105" status: 200 len: 1506 microversion: 2.1 time: 0.500796 Aug 07 01:34:54.583127 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2608/4818] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:54 2022] GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105 => generated 1506 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:54.607108 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-aca1d082-fe2a-467d-87df-671f96572b52 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:54.608187 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-aca1d082-fe2a-467d-87df-671f96572b52 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:54.630634 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aca1d082-fe2a-467d-87df-671f96572b52 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:54.640633 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aca1d082-fe2a-467d-87df-671f96572b52 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:54.641779 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aca1d082-fe2a-467d-87df-671f96572b52 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:54.655092 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aca1d082-fe2a-467d-87df-671f96572b52 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:54.659987 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aca1d082-fe2a-467d-87df-671f96572b52 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:54.662412 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aca1d082-fe2a-467d-87df-671f96572b52 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:55.172558 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-aca1d082-fe2a-467d-87df-671f96572b52 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:55.193328 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-aca1d082-fe2a-467d-87df-671f96572b52 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87" status: 200 len: 1318 microversion: 2.1 time: 0.590487 Aug 07 01:34:55.194684 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2609/4819] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:54 2022] GET /compute/v2.1/servers/d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87 => generated 1318 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:55.207594 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-dbafcb5c-6f50-47f8-a20a-628933ee6f46 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:55.209693 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ef4ef5a5-cd49-47a4-96d5-cf8bb00ba1d0 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:55.214312 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ef4ef5a5-cd49-47a4-96d5-cf8bb00ba1d0 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:55.233243 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef4ef5a5-cd49-47a4-96d5-cf8bb00ba1d0 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:55.234347 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef4ef5a5-cd49-47a4-96d5-cf8bb00ba1d0 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:55.236236 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef4ef5a5-cd49-47a4-96d5-cf8bb00ba1d0 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:55.238014 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef4ef5a5-cd49-47a4-96d5-cf8bb00ba1d0 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:55.243902 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-dbafcb5c-6f50-47f8-a20a-628933ee6f46 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:55.245091 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef4ef5a5-cd49-47a4-96d5-cf8bb00ba1d0 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:55.246296 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef4ef5a5-cd49-47a4-96d5-cf8bb00ba1d0 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:55.251918 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-dbafcb5c-6f50-47f8-a20a-628933ee6f46 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:55.257357 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-dbafcb5c-6f50-47f8-a20a-628933ee6f46 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1808 microversion: 2.20 time: 1.032258 Aug 07 01:34:55.262542 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2211/4820] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:54 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1808 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:34:55.296781 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-16344c02-2487-452c-a73d-27d4048cb30b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:55.298034 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-16344c02-2487-452c-a73d-27d4048cb30b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 57ef5095-2f80-41c5-abc9-ca37439f3384] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:55.312414 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16344c02-2487-452c-a73d-27d4048cb30b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:55.313739 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16344c02-2487-452c-a73d-27d4048cb30b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:55.314204 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16344c02-2487-452c-a73d-27d4048cb30b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:55.314937 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16344c02-2487-452c-a73d-27d4048cb30b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:55.315437 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16344c02-2487-452c-a73d-27d4048cb30b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:55.315841 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16344c02-2487-452c-a73d-27d4048cb30b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:55.562329 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ef4ef5a5-cd49-47a4-96d5-cf8bb00ba1d0 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:55.582521 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ef4ef5a5-cd49-47a4-96d5-cf8bb00ba1d0 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1524 microversion: 2.1 time: 0.386310 Aug 07 01:34:55.598529 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2610/4821] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:55 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1524 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:55.898139 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-16344c02-2487-452c-a73d-27d4048cb30b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:55.908162 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-16344c02-2487-452c-a73d-27d4048cb30b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384" status: 200 len: 1557 microversion: 2.1 time: 0.633762 Aug 07 01:34:55.914374 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2212/4822] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:55 2022] GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384 => generated 1557 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:55.943871 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7bca0b4d-4fdb-4cc8-bca1-eb45e3035a75 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:55.944988 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7bca0b4d-4fdb-4cc8-bca1-eb45e3035a75 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 57ef5095-2f80-41c5-abc9-ca37439f3384] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:55.953902 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7bca0b4d-4fdb-4cc8-bca1-eb45e3035a75 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:55.954776 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7bca0b4d-4fdb-4cc8-bca1-eb45e3035a75 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:55.955456 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7bca0b4d-4fdb-4cc8-bca1-eb45e3035a75 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:55.956503 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7bca0b4d-4fdb-4cc8-bca1-eb45e3035a75 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:55.957226 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7bca0b4d-4fdb-4cc8-bca1-eb45e3035a75 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:55.966049 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7bca0b4d-4fdb-4cc8-bca1-eb45e3035a75 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:56.222424 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8ad95420-8290-4195-8545-e326a372da8f tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:56.223065 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8ad95420-8290-4195-8545-e326a372da8f tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:56.234084 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8ad95420-8290-4195-8545-e326a372da8f tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:56.234590 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8ad95420-8290-4195-8545-e326a372da8f tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:56.235028 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8ad95420-8290-4195-8545-e326a372da8f tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:56.235760 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8ad95420-8290-4195-8545-e326a372da8f tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:56.236240 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8ad95420-8290-4195-8545-e326a372da8f tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:56.241896 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8ad95420-8290-4195-8545-e326a372da8f tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:56.693675 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7bca0b4d-4fdb-4cc8-bca1-eb45e3035a75 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.756042 Aug 07 01:34:56.696054 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2611/4823] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Aug 7 01:34:55 2022] GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384/os-interface => generated 284 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:34:56.708445 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-93648daf-b2c3-4baa-8d75-84f9f8a69e1d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:56.709336 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-93648daf-b2c3-4baa-8d75-84f9f8a69e1d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:56.738840 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93648daf-b2c3-4baa-8d75-84f9f8a69e1d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:56.740497 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93648daf-b2c3-4baa-8d75-84f9f8a69e1d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:56.741979 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93648daf-b2c3-4baa-8d75-84f9f8a69e1d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:56.747439 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93648daf-b2c3-4baa-8d75-84f9f8a69e1d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:56.748200 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93648daf-b2c3-4baa-8d75-84f9f8a69e1d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:56.748978 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-93648daf-b2c3-4baa-8d75-84f9f8a69e1d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:57.218973 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8ad95420-8290-4195-8545-e326a372da8f tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:57.250837 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8ad95420-8290-4195-8545-e326a372da8f tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87" status: 200 len: 1318 microversion: 2.1 time: 1.025541 Aug 07 01:34:57.251709 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2213/4824] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:56 2022] GET /compute/v2.1/servers/d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87 => generated 1318 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:57.281803 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1356b4a1-5006-466a-b839-aea7d58621fb tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:57.286133 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1356b4a1-5006-466a-b839-aea7d58621fb tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:57.309887 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1356b4a1-5006-466a-b839-aea7d58621fb tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:57.310385 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1356b4a1-5006-466a-b839-aea7d58621fb tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:57.310827 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1356b4a1-5006-466a-b839-aea7d58621fb tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:57.316153 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1356b4a1-5006-466a-b839-aea7d58621fb tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:57.320300 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1356b4a1-5006-466a-b839-aea7d58621fb tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:57.320842 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1356b4a1-5006-466a-b839-aea7d58621fb tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:57.775195 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-93648daf-b2c3-4baa-8d75-84f9f8a69e1d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:57.796080 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-93648daf-b2c3-4baa-8d75-84f9f8a69e1d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:57.798907 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-93648daf-b2c3-4baa-8d75-84f9f8a69e1d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:57.801173 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-93648daf-b2c3-4baa-8d75-84f9f8a69e1d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1808 microversion: 2.20 time: 1.103800 Aug 07 01:34:57.818011 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2612/4825] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:56 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1808 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:34:58.276824 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-317b9884-cdde-4e80-b25b-699822d6a122 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:58.277785 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-317b9884-cdde-4e80-b25b-699822d6a122 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:58.296474 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-317b9884-cdde-4e80-b25b-699822d6a122 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:58.297270 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-317b9884-cdde-4e80-b25b-699822d6a122 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:58.297989 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-317b9884-cdde-4e80-b25b-699822d6a122 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:58.309075 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-317b9884-cdde-4e80-b25b-699822d6a122 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:58.309968 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-317b9884-cdde-4e80-b25b-699822d6a122 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:58.310773 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-317b9884-cdde-4e80-b25b-699822d6a122 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:58.668156 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-317b9884-cdde-4e80-b25b-699822d6a122 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:58.678364 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-317b9884-cdde-4e80-b25b-699822d6a122 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87" status: 200 len: 1505 microversion: 2.1 time: 0.406171 Aug 07 01:34:58.680005 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2613/4826] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:58 2022] GET /compute/v2.1/servers/d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87 => generated 1505 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:34:58.703032 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bbc2d7dc-2418-4938-b92f-f8f841084439 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:58.703752 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bbc2d7dc-2418-4938-b92f-f8f841084439 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:58.710649 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bbc2d7dc-2418-4938-b92f-f8f841084439 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:58.713797 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bbc2d7dc-2418-4938-b92f-f8f841084439 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:58.716196 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bbc2d7dc-2418-4938-b92f-f8f841084439 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:58.717179 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bbc2d7dc-2418-4938-b92f-f8f841084439 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:58.717808 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bbc2d7dc-2418-4938-b92f-f8f841084439 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:58.718424 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bbc2d7dc-2418-4938-b92f-f8f841084439 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:58.724569 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:58.731824 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1356b4a1-5006-466a-b839-aea7d58621fb tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:58.741209 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1356b4a1-5006-466a-b839-aea7d58621fb tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1524 microversion: 2.1 time: 1.487489 Aug 07 01:34:58.741803 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2214/4827] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:57 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1524 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:34:58.771127 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bbc2d7dc-2418-4938-b92f-f8f841084439 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:34:58.832784 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e299c7a2-d76f-4562-afb2-695e25662058 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:58.833488 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e299c7a2-d76f-4562-afb2-695e25662058 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:58.844238 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e299c7a2-d76f-4562-afb2-695e25662058 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:58.845414 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e299c7a2-d76f-4562-afb2-695e25662058 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:58.846385 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e299c7a2-d76f-4562-afb2-695e25662058 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:58.847832 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e299c7a2-d76f-4562-afb2-695e25662058 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:58.848720 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e299c7a2-d76f-4562-afb2-695e25662058 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:58.849470 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e299c7a2-d76f-4562-afb2-695e25662058 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:58.997781 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bbc2d7dc-2418-4938-b92f-f8f841084439 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87" status: 204 len: 0 microversion: 2.1 time: 0.282990 Aug 07 01:34:59.004286 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2614/4828] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:34:58 2022] DELETE /compute/v2.1/servers/d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 07 01:34:59.017302 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-30b17beb-2eb5-4283-9c60-7ef0cb2b4cd1 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:59.017907 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-30b17beb-2eb5-4283-9c60-7ef0cb2b4cd1 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: cfa709be-49f5-434c-8c0e-cb4671f40105] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:59.039770 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-30b17beb-2eb5-4283-9c60-7ef0cb2b4cd1 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:59.042840 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-30b17beb-2eb5-4283-9c60-7ef0cb2b4cd1 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:59.043628 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-30b17beb-2eb5-4283-9c60-7ef0cb2b4cd1 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:59.044745 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-30b17beb-2eb5-4283-9c60-7ef0cb2b4cd1 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:59.045916 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-30b17beb-2eb5-4283-9c60-7ef0cb2b4cd1 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:59.046553 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-30b17beb-2eb5-4283-9c60-7ef0cb2b4cd1 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:59.088548 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-30b17beb-2eb5-4283-9c60-7ef0cb2b4cd1 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: cfa709be-49f5-434c-8c0e-cb4671f40105] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:34:59.210605 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-30b17beb-2eb5-4283-9c60-7ef0cb2b4cd1 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "DELETE /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105" status: 204 len: 0 microversion: 2.1 time: 0.201837 Aug 07 01:34:59.216758 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2615/4829] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:34:59 2022] DELETE /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:34:59.225213 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-21768b88-740c-495c-b5dc-a219bf0f6499 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:59.225928 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-21768b88-740c-495c-b5dc-a219bf0f6499 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:59.243548 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21768b88-740c-495c-b5dc-a219bf0f6499 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:59.246970 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21768b88-740c-495c-b5dc-a219bf0f6499 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:59.247397 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21768b88-740c-495c-b5dc-a219bf0f6499 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:59.248366 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21768b88-740c-495c-b5dc-a219bf0f6499 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:59.248991 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21768b88-740c-495c-b5dc-a219bf0f6499 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:59.249586 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21768b88-740c-495c-b5dc-a219bf0f6499 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:59.382473 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e299c7a2-d76f-4562-afb2-695e25662058 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:59.401928 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e299c7a2-d76f-4562-afb2-695e25662058 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:59.403473 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e299c7a2-d76f-4562-afb2-695e25662058 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:34:59.404767 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e299c7a2-d76f-4562-afb2-695e25662058 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1808 microversion: 2.20 time: 0.578104 Aug 07 01:34:59.406041 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2215/4830] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:34:58 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1808 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:34:59.763246 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-37cf9285-ac17-463f-a3c3-8c0c63f09c98 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:34:59.763969 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-37cf9285-ac17-463f-a3c3-8c0c63f09c98 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:34:59.776513 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37cf9285-ac17-463f-a3c3-8c0c63f09c98 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:59.778772 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37cf9285-ac17-463f-a3c3-8c0c63f09c98 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:59.779405 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37cf9285-ac17-463f-a3c3-8c0c63f09c98 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:34:59.781849 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37cf9285-ac17-463f-a3c3-8c0c63f09c98 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:34:59.783940 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37cf9285-ac17-463f-a3c3-8c0c63f09c98 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:34:59.784858 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37cf9285-ac17-463f-a3c3-8c0c63f09c98 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:00.257646 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-37cf9285-ac17-463f-a3c3-8c0c63f09c98 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:00.269442 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-37cf9285-ac17-463f-a3c3-8c0c63f09c98 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1524 microversion: 2.1 time: 0.510558 Aug 07 01:35:00.273773 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2216/4831] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:59 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1524 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:00.388098 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-21768b88-740c-495c-b5dc-a219bf0f6499 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:00.399126 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-21768b88-740c-495c-b5dc-a219bf0f6499 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87" status: 200 len: 1511 microversion: 2.1 time: 1.178085 Aug 07 01:35:00.407909 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2616/4832] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:34:59 2022] GET /compute/v2.1/servers/d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87 => generated 1511 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:35:00.432908 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7d3fd15c-d61f-4b00-8b5c-9ddc2ac5300c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:00.433532 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7d3fd15c-d61f-4b00-8b5c-9ddc2ac5300c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:00.460990 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d3fd15c-d61f-4b00-8b5c-9ddc2ac5300c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:00.463093 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d3fd15c-d61f-4b00-8b5c-9ddc2ac5300c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:00.463547 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d3fd15c-d61f-4b00-8b5c-9ddc2ac5300c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:00.464356 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d3fd15c-d61f-4b00-8b5c-9ddc2ac5300c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:00.464817 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d3fd15c-d61f-4b00-8b5c-9ddc2ac5300c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:00.465246 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d3fd15c-d61f-4b00-8b5c-9ddc2ac5300c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:00.634389 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-40fc3dd8-d81f-4060-8fa6-1c453e6a7b0f tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Action: 'create', calling method: .version_select at 0x7f9e29a47280>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-431798789", "policies": ["affinity"]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:35:00.707512 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-40fc3dd8-d81f-4060-8fa6-1c453e6a7b0f tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Getting quotas for project 5bc9ff987bb541d6a11324aaca07182d. Resources: {'server_groups'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:35:00.719241 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-40fc3dd8-d81f-4060-8fa6-1c453e6a7b0f tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Getting quotas for user 0344a81c981b434689ac476b815b8f02 and project 5bc9ff987bb541d6a11324aaca07182d. Resources: {'server_groups'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:35:00.843584 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-40fc3dd8-d81f-4060-8fa6-1c453e6a7b0f tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Getting quotas for project 5bc9ff987bb541d6a11324aaca07182d. Resources: {'server_groups'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:35:00.858130 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-40fc3dd8-d81f-4060-8fa6-1c453e6a7b0f tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Getting quotas for user 0344a81c981b434689ac476b815b8f02 and project 5bc9ff987bb541d6a11324aaca07182d. Resources: {'server_groups'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:35:00.892295 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-40fc3dd8-d81f-4060-8fa6-1c453e6a7b0f tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.614721 Aug 07 01:35:00.900565 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2217/4833] 10.222.0.39 () {60 vars in 1174 bytes} [Sun Aug 7 01:35:00 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:35:00.905911 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-fc855764-a6dc-4dbf-8a99-4ebb504bdeac req-7dd1329d-ccd7-4e7b-b132-fafb75677d8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57ef5095-2f80-41c5-abc9-ca37439f3384", "tag": "d4ad23ab-8771-4aec-b8a5-442eb0265864"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:35:00.941631 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-fc855764-a6dc-4dbf-8a99-4ebb504bdeac req-7dd1329d-ccd7-4e7b-b132-fafb75677d8f service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:00.942119 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-fc855764-a6dc-4dbf-8a99-4ebb504bdeac req-7dd1329d-ccd7-4e7b-b132-fafb75677d8f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:00.942408 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-fc855764-a6dc-4dbf-8a99-4ebb504bdeac req-7dd1329d-ccd7-4e7b-b132-fafb75677d8f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:00.991639 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-fc855764-a6dc-4dbf-8a99-4ebb504bdeac req-7dd1329d-ccd7-4e7b-b132-fafb75677d8f service nova] Creating event network-changed:d4ad23ab-8771-4aec-b8a5-442eb0265864 for instance 57ef5095-2f80-41c5-abc9-ca37439f3384 on n-h1-master-1 Aug 07 01:35:01.014654 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-fc855764-a6dc-4dbf-8a99-4ebb504bdeac req-7dd1329d-ccd7-4e7b-b132-fafb75677d8f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109114 Aug 07 01:35:01.016546 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2218/4834] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:35:01.031438 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-77074375-a516-417a-90e5-0ee6f6fd9cd5 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Action: 'create', calling method: .version_select at 0x7f9e246b7160>, body: {"server_group": {"name": "tempest-server-group-460269170", "policies": ["affinity"]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:35:01.140631 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7d3fd15c-d61f-4b00-8b5c-9ddc2ac5300c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:01.258525 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-77074375-a516-417a-90e5-0ee6f6fd9cd5 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Getting quotas for project 5bc9ff987bb541d6a11324aaca07182d. Resources: {'server_groups'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:35:01.258525 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-77074375-a516-417a-90e5-0ee6f6fd9cd5 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Getting quotas for user 0344a81c981b434689ac476b815b8f02 and project 5bc9ff987bb541d6a11324aaca07182d. Resources: {'server_groups'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:35:01.260659 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7d3fd15c-d61f-4b00-8b5c-9ddc2ac5300c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:01.260659 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7d3fd15c-d61f-4b00-8b5c-9ddc2ac5300c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:01.260659 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7d3fd15c-d61f-4b00-8b5c-9ddc2ac5300c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1808 microversion: 2.20 time: 0.756681 Aug 07 01:35:01.260659 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2617/4835] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:35:00 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1808 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:35:01.262167 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-77074375-a516-417a-90e5-0ee6f6fd9cd5 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Getting quotas for project 5bc9ff987bb541d6a11324aaca07182d. Resources: {'server_groups'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:35:01.275904 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-77074375-a516-417a-90e5-0ee6f6fd9cd5 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Getting quotas for user 0344a81c981b434689ac476b815b8f02 and project 5bc9ff987bb541d6a11324aaca07182d. Resources: {'server_groups'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:35:01.294888 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c80688d2-546d-432c-9b1d-ec17cb40e4c5 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:01.299725 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c80688d2-546d-432c-9b1d-ec17cb40e4c5 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:01.311121 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-77074375-a516-417a-90e5-0ee6f6fd9cd5 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.290491 Aug 07 01:35:01.311735 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2219/4836] 10.222.0.39 () {60 vars in 1173 bytes} [Sun Aug 7 01:35:01 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:35:01.322455 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c80688d2-546d-432c-9b1d-ec17cb40e4c5 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:01.324228 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c80688d2-546d-432c-9b1d-ec17cb40e4c5 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:01.325189 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c80688d2-546d-432c-9b1d-ec17cb40e4c5 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:01.333848 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d447bb42-6114-4d76-b712-36761c463b0a tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Action: 'create', calling method: .version_select at 0x7f9e29a28310>, body: {"server_group": {"name": "tempest-server-group-460269170", "policies": ["affinity"]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:35:01.342182 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c80688d2-546d-432c-9b1d-ec17cb40e4c5 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:01.343106 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c80688d2-546d-432c-9b1d-ec17cb40e4c5 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:01.346084 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c80688d2-546d-432c-9b1d-ec17cb40e4c5 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:01.376254 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-d447bb42-6114-4d76-b712-36761c463b0a tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Getting quotas for project 5bc9ff987bb541d6a11324aaca07182d. Resources: {'server_groups'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:35:01.392298 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-d447bb42-6114-4d76-b712-36761c463b0a tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Getting quotas for user 0344a81c981b434689ac476b815b8f02 and project 5bc9ff987bb541d6a11324aaca07182d. Resources: {'server_groups'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:35:01.529579 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:01.568648 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-d447bb42-6114-4d76-b712-36761c463b0a tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Getting quotas for project 5bc9ff987bb541d6a11324aaca07182d. Resources: {'server_groups'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:35:01.581700 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-d447bb42-6114-4d76-b712-36761c463b0a tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Getting quotas for user 0344a81c981b434689ac476b815b8f02 and project 5bc9ff987bb541d6a11324aaca07182d. Resources: {'server_groups'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:35:01.623136 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d447bb42-6114-4d76-b712-36761c463b0a tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.300004 Aug 07 01:35:01.632381 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2220/4837] 10.222.0.39 () {60 vars in 1173 bytes} [Sun Aug 7 01:35:01 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:35:01.645802 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a8246b36-551b-4ede-a5f4-a216401f5059 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:01.647648 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a8246b36-551b-4ede-a5f4-a216401f5059 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:01.665432 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a8246b36-551b-4ede-a5f4-a216401f5059 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:01.670374 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a8246b36-551b-4ede-a5f4-a216401f5059 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:01.670915 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a8246b36-551b-4ede-a5f4-a216401f5059 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:01.671741 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a8246b36-551b-4ede-a5f4-a216401f5059 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:01.672304 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a8246b36-551b-4ede-a5f4-a216401f5059 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:01.673035 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a8246b36-551b-4ede-a5f4-a216401f5059 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:01.764260 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c80688d2-546d-432c-9b1d-ec17cb40e4c5 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:01.775819 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c80688d2-546d-432c-9b1d-ec17cb40e4c5 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1524 microversion: 2.1 time: 0.484884 Aug 07 01:35:01.776456 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2618/4838] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:01 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1524 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:01.794155 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-76c6d3b3-aa68-456a-95b5-2d12e80dc5d0 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:01.855870 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-76c6d3b3-aa68-456a-95b5-2d12e80dc5d0 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/5e4bd4a4-290e-4b10-b9a1-a30940626ea2" status: 204 len: 0 microversion: 2.1 time: 0.076194 Aug 07 01:35:01.856658 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2619/4839] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Aug 7 01:35:01 2022] DELETE /compute/v2.1/os-server-groups/5e4bd4a4-290e-4b10-b9a1-a30940626ea2 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:35:01.879072 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d8a90ffd-f0c0-4417-a78e-397765d22e4b tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:01.914468 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d8a90ffd-f0c0-4417-a78e-397765d22e4b tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.052801 Aug 07 01:35:01.921177 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2620/4840] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Aug 7 01:35:01 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:35:01.932070 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5e626711-bfdc-4b7b-82cc-700f6bdab5a3 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:01.937778 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:02.023566 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5e626711-bfdc-4b7b-82cc-700f6bdab5a3 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/3c9e2db7-7b44-4b73-8d8a-7df67e80f0f7" status: 204 len: 0 microversion: 2.1 time: 0.099041 Aug 07 01:35:02.025652 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2621/4841] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Aug 7 01:35:01 2022] DELETE /compute/v2.1/os-server-groups/3c9e2db7-7b44-4b73-8d8a-7df67e80f0f7 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:35:02.033973 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-83bf1a6b-dda7-4389-9eaa-6a0c638a608c tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:02.076824 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-83bf1a6b-dda7-4389-9eaa-6a0c638a608c tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.044664 Aug 07 01:35:02.083243 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2622/4842] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Aug 7 01:35:02 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:35:02.113021 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ddefb566-d9f2-41ac-8d72-c44826812972 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Action: 'create', calling method: .version_select at 0x7f9e171051f0>, body: {"server_group": {"name": "tempest-server-group-80696955", "policies": ["affinity"]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:35:02.171122 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-ddefb566-d9f2-41ac-8d72-c44826812972 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Getting quotas for project 5bc9ff987bb541d6a11324aaca07182d. Resources: {'server_groups'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:35:02.194521 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-ddefb566-d9f2-41ac-8d72-c44826812972 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Getting quotas for user 0344a81c981b434689ac476b815b8f02 and project 5bc9ff987bb541d6a11324aaca07182d. Resources: {'server_groups'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:35:02.256978 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a8246b36-551b-4ede-a5f4-a216401f5059 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:02.294579 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a8246b36-551b-4ede-a5f4-a216401f5059 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87" status: 200 len: 1511 microversion: 2.1 time: 0.650587 Aug 07 01:35:02.309169 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2221/4843] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:01 2022] GET /compute/v2.1/servers/d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87 => generated 1511 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:02.325554 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a4ddeeea-4142-4102-a8d7-6d370cab6e11 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:02.326193 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a4ddeeea-4142-4102-a8d7-6d370cab6e11 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:02.357162 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4ddeeea-4142-4102-a8d7-6d370cab6e11 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:02.358103 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4ddeeea-4142-4102-a8d7-6d370cab6e11 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:02.360619 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4ddeeea-4142-4102-a8d7-6d370cab6e11 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:02.364333 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4ddeeea-4142-4102-a8d7-6d370cab6e11 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:02.367639 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4ddeeea-4142-4102-a8d7-6d370cab6e11 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:02.369580 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4ddeeea-4142-4102-a8d7-6d370cab6e11 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:02.398282 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-ddefb566-d9f2-41ac-8d72-c44826812972 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Getting quotas for project 5bc9ff987bb541d6a11324aaca07182d. Resources: {'server_groups'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:35:02.408327 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:02.427810 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-ddefb566-d9f2-41ac-8d72-c44826812972 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Getting quotas for user 0344a81c981b434689ac476b815b8f02 and project 5bc9ff987bb541d6a11324aaca07182d. Resources: {'server_groups'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:35:02.480739 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ddefb566-d9f2-41ac-8d72-c44826812972 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "POST /compute/v2.1/os-server-groups" status: 200 len: 162 microversion: 2.1 time: 0.392954 Aug 07 01:35:02.481882 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2623/4844] 10.222.0.39 () {60 vars in 1173 bytes} [Sun Aug 7 01:35:02 2022] POST /compute/v2.1/os-server-groups => generated 162 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:35:02.493387 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-84cd8870-573a-4194-81e7-012ff59237ba tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:02.573380 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-84cd8870-573a-4194-81e7-012ff59237ba tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/6e64115a-1a3e-4e80-9d37-e606d4b135a5" status: 204 len: 0 microversion: 2.1 time: 0.084822 Aug 07 01:35:02.576745 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2624/4845] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Aug 7 01:35:02 2022] DELETE /compute/v2.1/os-server-groups/6e64115a-1a3e-4e80-9d37-e606d4b135a5 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 07 01:35:02.582756 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0bf2200d-167c-4bf6-bd1f-f05ebbb67f05 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:02.599709 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0bf2200d-167c-4bf6-bd1f-f05ebbb67f05 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.021309 Aug 07 01:35:02.606992 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2625/4846] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Aug 7 01:35:02 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:35:02.615167 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-20ea9d1d-a427-4d23-8ab1-8d5e8e90bed0 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Action: 'create', calling method: .version_select at 0x7f9e1715d790>, body: {"server_group": {"name": "tempest-server-group-1910154380", "policies": ["anti-affinity"]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:35:02.683817 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-20ea9d1d-a427-4d23-8ab1-8d5e8e90bed0 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Getting quotas for project 5bc9ff987bb541d6a11324aaca07182d. Resources: {'server_groups'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:35:02.698410 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-20ea9d1d-a427-4d23-8ab1-8d5e8e90bed0 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Getting quotas for user 0344a81c981b434689ac476b815b8f02 and project 5bc9ff987bb541d6a11324aaca07182d. Resources: {'server_groups'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:35:02.802965 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-20ea9d1d-a427-4d23-8ab1-8d5e8e90bed0 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Getting quotas for project 5bc9ff987bb541d6a11324aaca07182d. Resources: {'server_groups'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:35:02.822658 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-20ea9d1d-a427-4d23-8ab1-8d5e8e90bed0 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Getting quotas for user 0344a81c981b434689ac476b815b8f02 and project 5bc9ff987bb541d6a11324aaca07182d. Resources: {'server_groups'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:35:02.897293 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-20ea9d1d-a427-4d23-8ab1-8d5e8e90bed0 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.287841 Aug 07 01:35:02.898274 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2626/4847] 10.222.0.39 () {60 vars in 1173 bytes} [Sun Aug 7 01:35:02 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:35:02.911133 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7d975b8a-0618-416c-b79a-a8b26e86d149 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:02.912136 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7d975b8a-0618-416c-b79a-a8b26e86d149 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:02.920902 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d975b8a-0618-416c-b79a-a8b26e86d149 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:02.921728 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d975b8a-0618-416c-b79a-a8b26e86d149 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:02.922460 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d975b8a-0618-416c-b79a-a8b26e86d149 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:02.923346 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d975b8a-0618-416c-b79a-a8b26e86d149 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:02.924295 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d975b8a-0618-416c-b79a-a8b26e86d149 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:02.925517 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d975b8a-0618-416c-b79a-a8b26e86d149 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:03.255337 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a4ddeeea-4142-4102-a8d7-6d370cab6e11 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:03.282041 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a4ddeeea-4142-4102-a8d7-6d370cab6e11 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:03.284694 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a4ddeeea-4142-4102-a8d7-6d370cab6e11 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:03.291136 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7d975b8a-0618-416c-b79a-a8b26e86d149 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:03.293773 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a4ddeeea-4142-4102-a8d7-6d370cab6e11 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1808 microversion: 2.20 time: 0.977763 Aug 07 01:35:03.294600 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2222/4848] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:35:02 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1808 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:35:03.317134 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c58c565d-d062-495f-835f-df3203901602 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:03.337378 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7d975b8a-0618-416c-b79a-a8b26e86d149 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1524 microversion: 2.1 time: 0.429310 Aug 07 01:35:03.338005 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2627/4849] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:02 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1524 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:03.364213 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c58c565d-d062-495f-835f-df3203901602 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/ebb3d13f-93ab-4619-85ff-cfa8e3ef3764" status: 204 len: 0 microversion: 2.1 time: 0.065881 Aug 07 01:35:03.365156 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2223/4850] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Aug 7 01:35:03 2022] DELETE /compute/v2.1/os-server-groups/ebb3d13f-93ab-4619-85ff-cfa8e3ef3764 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:35:03.371693 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a38a984f-a29f-42a0-a0db-a660518f413c tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:03.372351 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a38a984f-a29f-42a0-a0db-a660518f413c tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:03.374422 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5d230a9f-db77-4f27-9d74-bbccd1dd4da5 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:03.406390 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a38a984f-a29f-42a0-a0db-a660518f413c tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:03.409067 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a38a984f-a29f-42a0-a0db-a660518f413c tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:03.417732 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a38a984f-a29f-42a0-a0db-a660518f413c tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:03.420100 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a38a984f-a29f-42a0-a0db-a660518f413c tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:03.420922 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a38a984f-a29f-42a0-a0db-a660518f413c tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:03.422329 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a38a984f-a29f-42a0-a0db-a660518f413c tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:03.431563 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5d230a9f-db77-4f27-9d74-bbccd1dd4da5 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.060567 Aug 07 01:35:03.440322 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2224/4851] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Aug 7 01:35:03 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:35:03.717223 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-73671524-850b-4740-a95e-9dbb94cc9d36 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1466125172", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "6c83947c-9fab-4b78-a997-2b3365d21d6a"}]}, "os:scheduler_hints": {"group": "53f6a54a-7637-431b-96ac-514331db59ba"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:35:03.803906 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a38a984f-a29f-42a0-a0db-a660518f413c tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:03.813552 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a38a984f-a29f-42a0-a0db-a660518f413c tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87" status: 200 len: 1511 microversion: 2.1 time: 0.464061 Aug 07 01:35:03.815981 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2628/4852] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:03 2022] GET /compute/v2.1/servers/d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87 => generated 1511 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:03.845809 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-73671524-850b-4740-a95e-9dbb94cc9d36 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] validate_networks() for [('6c83947c-9fab-4b78-a997-2b3365d21d6a', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:35:04.325432 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fe50b3ac-91a0-40d2-a994-f9c4dba9a730 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:04.326546 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fe50b3ac-91a0-40d2-a994-f9c4dba9a730 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:04.340178 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe50b3ac-91a0-40d2-a994-f9c4dba9a730 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:04.341716 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe50b3ac-91a0-40d2-a994-f9c4dba9a730 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:04.342219 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe50b3ac-91a0-40d2-a994-f9c4dba9a730 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:04.342962 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe50b3ac-91a0-40d2-a994-f9c4dba9a730 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:04.343413 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe50b3ac-91a0-40d2-a994-f9c4dba9a730 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:04.344078 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe50b3ac-91a0-40d2-a994-f9c4dba9a730 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:04.599713 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fe50b3ac-91a0-40d2-a994-f9c4dba9a730 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:04.610166 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fe50b3ac-91a0-40d2-a994-f9c4dba9a730 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:04.612171 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fe50b3ac-91a0-40d2-a994-f9c4dba9a730 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:04.613562 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fe50b3ac-91a0-40d2-a994-f9c4dba9a730 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1808 microversion: 2.20 time: 0.295802 Aug 07 01:35:04.629301 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2629/4853] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:35:04 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1808 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:35:04.636126 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d0536f1a-8080-412d-a81b-28bcb3495c99 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:04.636948 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d0536f1a-8080-412d-a81b-28bcb3495c99 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:04.645867 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0536f1a-8080-412d-a81b-28bcb3495c99 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:04.646820 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0536f1a-8080-412d-a81b-28bcb3495c99 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:04.647602 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0536f1a-8080-412d-a81b-28bcb3495c99 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:04.648837 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0536f1a-8080-412d-a81b-28bcb3495c99 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:04.650198 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0536f1a-8080-412d-a81b-28bcb3495c99 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:04.650796 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0536f1a-8080-412d-a81b-28bcb3495c99 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:04.899136 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d0536f1a-8080-412d-a81b-28bcb3495c99 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:04.910134 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d0536f1a-8080-412d-a81b-28bcb3495c99 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1524 microversion: 2.1 time: 0.279483 Aug 07 01:35:04.912069 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2630/4854] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:04 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1524 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:04.925002 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-064f9475-ac11-47cc-966b-c65e93e36692 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:04.926110 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-064f9475-ac11-47cc-966b-c65e93e36692 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:04.958401 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-064f9475-ac11-47cc-966b-c65e93e36692 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:04.958838 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-064f9475-ac11-47cc-966b-c65e93e36692 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:04.965894 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-064f9475-ac11-47cc-966b-c65e93e36692 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:04.969492 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-064f9475-ac11-47cc-966b-c65e93e36692 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:04.971750 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-064f9475-ac11-47cc-966b-c65e93e36692 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:04.973274 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-064f9475-ac11-47cc-966b-c65e93e36692 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:05.465523 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-064f9475-ac11-47cc-966b-c65e93e36692 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:05.474700 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-064f9475-ac11-47cc-966b-c65e93e36692 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87" status: 200 len: 1511 microversion: 2.1 time: 0.559813 Aug 07 01:35:05.476101 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2631/4855] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:04 2022] GET /compute/v2.1/servers/d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87 => generated 1511 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:05.640951 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1aace290-e600-4792-8cd3-be882d1fecf4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:05.641944 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1aace290-e600-4792-8cd3-be882d1fecf4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:05.663612 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1aace290-e600-4792-8cd3-be882d1fecf4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:05.664469 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1aace290-e600-4792-8cd3-be882d1fecf4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:05.665398 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1aace290-e600-4792-8cd3-be882d1fecf4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:05.666556 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1aace290-e600-4792-8cd3-be882d1fecf4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:05.667370 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1aace290-e600-4792-8cd3-be882d1fecf4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:05.668047 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1aace290-e600-4792-8cd3-be882d1fecf4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:05.902431 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1aace290-e600-4792-8cd3-be882d1fecf4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:05.911865 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1aace290-e600-4792-8cd3-be882d1fecf4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:05.916125 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1aace290-e600-4792-8cd3-be882d1fecf4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:05.917758 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1aace290-e600-4792-8cd3-be882d1fecf4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1808 microversion: 2.20 time: 0.282293 Aug 07 01:35:05.918839 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2632/4856] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:35:05 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1808 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:35:05.947745 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-221cb02f-204b-4972-8d5c-ed7a6cf0f035 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:05.948974 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-221cb02f-204b-4972-8d5c-ed7a6cf0f035 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:05.958159 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-221cb02f-204b-4972-8d5c-ed7a6cf0f035 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:05.959412 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-221cb02f-204b-4972-8d5c-ed7a6cf0f035 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:05.959864 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-221cb02f-204b-4972-8d5c-ed7a6cf0f035 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:05.960669 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-221cb02f-204b-4972-8d5c-ed7a6cf0f035 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:05.972346 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-221cb02f-204b-4972-8d5c-ed7a6cf0f035 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:05.972979 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-221cb02f-204b-4972-8d5c-ed7a6cf0f035 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:06.203331 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-221cb02f-204b-4972-8d5c-ed7a6cf0f035 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:06.206678 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-73671524-850b-4740-a95e-9dbb94cc9d36 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:35:06.207219 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-73671524-850b-4740-a95e-9dbb94cc9d36 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:35:06.207675 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-73671524-850b-4740-a95e-9dbb94cc9d36 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:35:06.208425 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-73671524-850b-4740-a95e-9dbb94cc9d36 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:35:06.209044 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-73671524-850b-4740-a95e-9dbb94cc9d36 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:35:06.234040 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-221cb02f-204b-4972-8d5c-ed7a6cf0f035 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1524 microversion: 2.1 time: 0.290112 Aug 07 01:35:06.237597 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2633/4857] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:05 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1524 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:35:06.254660 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-29d67edd-2a22-4cd0-812f-0ef666e8b0e9 req-98658946-d0a5-4dac-a756-5b18550c425d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87", "name": "network-vif-deleted", "tag": "c8937c88-9bc5-4e2e-abe3-b2ac180cecef"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:35:06.267429 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-29d67edd-2a22-4cd0-812f-0ef666e8b0e9 req-98658946-d0a5-4dac-a756-5b18550c425d service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:06.268329 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-29d67edd-2a22-4cd0-812f-0ef666e8b0e9 req-98658946-d0a5-4dac-a756-5b18550c425d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:06.269007 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-29d67edd-2a22-4cd0-812f-0ef666e8b0e9 req-98658946-d0a5-4dac-a756-5b18550c425d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:06.269610 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-73671524-850b-4740-a95e-9dbb94cc9d36 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:06.270409 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-73671524-850b-4740-a95e-9dbb94cc9d36 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:06.271186 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-73671524-850b-4740-a95e-9dbb94cc9d36 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:06.275348 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-73671524-850b-4740-a95e-9dbb94cc9d36 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:06.292171 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-73671524-850b-4740-a95e-9dbb94cc9d36 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:06.294679 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-73671524-850b-4740-a95e-9dbb94cc9d36 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:06.299130 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-29d67edd-2a22-4cd0-812f-0ef666e8b0e9 req-98658946-d0a5-4dac-a756-5b18550c425d service nova] Creating event network-vif-deleted:c8937c88-9bc5-4e2e-abe3-b2ac180cecef for instance d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87 on n-h2-master-1 Aug 07 01:35:06.309425 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-29d67edd-2a22-4cd0-812f-0ef666e8b0e9 req-98658946-d0a5-4dac-a756-5b18550c425d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064436 Aug 07 01:35:06.310570 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2634/4858] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:35:06.326768 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-73671524-850b-4740-a95e-9dbb94cc9d36 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Getting quotas for project 5bc9ff987bb541d6a11324aaca07182d. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:35:06.333316 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-73671524-850b-4740-a95e-9dbb94cc9d36 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Getting quotas for user 0344a81c981b434689ac476b815b8f02 and project 5bc9ff987bb541d6a11324aaca07182d. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:35:06.350063 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-73671524-850b-4740-a95e-9dbb94cc9d36 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:35:06.353328 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-73671524-850b-4740-a95e-9dbb94cc9d36 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] [instance: 1a6ec1ce-d60b-4757-8b95-4c1031876a49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:35:06.508071 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-73671524-850b-4740-a95e-9dbb94cc9d36 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Getting quotas for project 5bc9ff987bb541d6a11324aaca07182d. Resources: {'server_group_members'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:35:06.508279 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-beb59f4d-258d-44d7-b2f3-ca98a8e60e1f tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:06.510562 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-beb59f4d-258d-44d7-b2f3-ca98a8e60e1f tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:06.529893 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-beb59f4d-258d-44d7-b2f3-ca98a8e60e1f tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:06.530700 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-beb59f4d-258d-44d7-b2f3-ca98a8e60e1f tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:06.531488 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-73671524-850b-4740-a95e-9dbb94cc9d36 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Getting quotas for user 0344a81c981b434689ac476b815b8f02 and project 5bc9ff987bb541d6a11324aaca07182d. Resources: {'server_group_members'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:35:06.532122 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-beb59f4d-258d-44d7-b2f3-ca98a8e60e1f tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:06.577213 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-beb59f4d-258d-44d7-b2f3-ca98a8e60e1f tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:06.577864 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-beb59f4d-258d-44d7-b2f3-ca98a8e60e1f tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.045s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:06.578860 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-beb59f4d-258d-44d7-b2f3-ca98a8e60e1f tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:06.629057 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-73671524-850b-4740-a95e-9dbb94cc9d36 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Getting quotas for project 5bc9ff987bb541d6a11324aaca07182d. Resources: {'server_group_members'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:35:06.648434 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-73671524-850b-4740-a95e-9dbb94cc9d36 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Getting quotas for user 0344a81c981b434689ac476b815b8f02 and project 5bc9ff987bb541d6a11324aaca07182d. Resources: {'server_group_members'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:35:06.649867 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-beb59f4d-258d-44d7-b2f3-ca98a8e60e1f tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:06.655053 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-beb59f4d-258d-44d7-b2f3-ca98a8e60e1f tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:06.655693 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-beb59f4d-258d-44d7-b2f3-ca98a8e60e1f tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:06.656241 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-beb59f4d-258d-44d7-b2f3-ca98a8e60e1f tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lazy-loading 'fault' on Instance uuid d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:35:06.781154 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-beb59f4d-258d-44d7-b2f3-ca98a8e60e1f tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:06.781364 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-73671524-850b-4740-a95e-9dbb94cc9d36 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.071829 Aug 07 01:35:06.783124 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2225/4859] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:35:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 3074 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:35:06.786288 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:06.796531 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-beb59f4d-258d-44d7-b2f3-ca98a8e60e1f tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87" status: 200 len: 1308 microversion: 2.1 time: 0.301905 Aug 07 01:35:06.797397 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2635/4860] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:06 2022] GET /compute/v2.1/servers/d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87 => generated 1308 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:06.808805 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ef6f852d-9bcd-41af-bb4f-84aff5acac5a tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:06.808805 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ef6f852d-9bcd-41af-bb4f-84aff5acac5a tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] [instance: 1a6ec1ce-d60b-4757-8b95-4c1031876a49] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:06.943060 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b9cd4952-2ee1-4bf0-9a63-53b40e69ae3c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:06.943759 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b9cd4952-2ee1-4bf0-9a63-53b40e69ae3c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:06.975416 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b9cd4952-2ee1-4bf0-9a63-53b40e69ae3c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:06.975914 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b9cd4952-2ee1-4bf0-9a63-53b40e69ae3c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:06.987453 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b9cd4952-2ee1-4bf0-9a63-53b40e69ae3c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:06.988336 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b9cd4952-2ee1-4bf0-9a63-53b40e69ae3c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:06.988834 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b9cd4952-2ee1-4bf0-9a63-53b40e69ae3c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:06.989282 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b9cd4952-2ee1-4bf0-9a63-53b40e69ae3c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:07.027143 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ef6f852d-9bcd-41af-bb4f-84aff5acac5a tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0344a81c981b434689ac476b815b8f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc9ff987bb541d6a11324aaca07182d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:07.063539 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ef6f852d-9bcd-41af-bb4f-84aff5acac5a tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "GET /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49" status: 200 len: 1213 microversion: 2.1 time: 0.256331 Aug 07 01:35:07.083247 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2226/4861] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:06 2022] GET /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49 => generated 1213 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:07.264015 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e58f0ec5-9780-4d24-bb7b-583c290203e6 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:07.264700 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e58f0ec5-9780-4d24-bb7b-583c290203e6 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:07.284394 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e58f0ec5-9780-4d24-bb7b-583c290203e6 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:07.286415 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e58f0ec5-9780-4d24-bb7b-583c290203e6 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:07.287825 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e58f0ec5-9780-4d24-bb7b-583c290203e6 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:07.289102 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e58f0ec5-9780-4d24-bb7b-583c290203e6 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:07.291452 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e58f0ec5-9780-4d24-bb7b-583c290203e6 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:07.293588 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e58f0ec5-9780-4d24-bb7b-583c290203e6 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:07.461197 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b9cd4952-2ee1-4bf0-9a63-53b40e69ae3c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:07.473075 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b9cd4952-2ee1-4bf0-9a63-53b40e69ae3c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:07.475258 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b9cd4952-2ee1-4bf0-9a63-53b40e69ae3c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:07.476784 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b9cd4952-2ee1-4bf0-9a63-53b40e69ae3c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1808 microversion: 2.20 time: 0.538342 Aug 07 01:35:07.478001 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2636/4862] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:35:06 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1808 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:35:07.685433 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e58f0ec5-9780-4d24-bb7b-583c290203e6 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:07.697468 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e58f0ec5-9780-4d24-bb7b-583c290203e6 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1524 microversion: 2.1 time: 0.440535 Aug 07 01:35:07.699138 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2227/4863] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:07 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1524 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:35:07.732660 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-35c22474-07a0-4455-ae15-124f1535157c req-2f80c332-85df-450c-9047-0de74673bf0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4071f699-43c7-4c36-ada4-8f0dceb6cc91", "name": "network-vif-plugged", "status": "completed", "tag": "a4d2050c-f5b0-4218-a72d-272334938cd5"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:35:07.750980 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-35c22474-07a0-4455-ae15-124f1535157c req-2f80c332-85df-450c-9047-0de74673bf0e service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:07.751518 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-35c22474-07a0-4455-ae15-124f1535157c req-2f80c332-85df-450c-9047-0de74673bf0e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:07.756513 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-35c22474-07a0-4455-ae15-124f1535157c req-2f80c332-85df-450c-9047-0de74673bf0e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:07.778099 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-35c22474-07a0-4455-ae15-124f1535157c req-2f80c332-85df-450c-9047-0de74673bf0e service nova] Creating event network-vif-plugged:a4d2050c-f5b0-4218-a72d-272334938cd5 for instance 4071f699-43c7-4c36-ada4-8f0dceb6cc91 on n-h2-master-1 Aug 07 01:35:07.784109 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-35c22474-07a0-4455-ae15-124f1535157c req-2f80c332-85df-450c-9047-0de74673bf0e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059936 Aug 07 01:35:07.785739 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2637/4864] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:35:07.825683 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-525993d5-f089-453c-b6f8-37d839a59115 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:07.826414 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-525993d5-f089-453c-b6f8-37d839a59115 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:07.861813 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-525993d5-f089-453c-b6f8-37d839a59115 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:07.864511 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-525993d5-f089-453c-b6f8-37d839a59115 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:07.865044 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-525993d5-f089-453c-b6f8-37d839a59115 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:07.865955 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-525993d5-f089-453c-b6f8-37d839a59115 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:07.866594 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-525993d5-f089-453c-b6f8-37d839a59115 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:07.867395 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-525993d5-f089-453c-b6f8-37d839a59115 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:07.887978 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-525993d5-f089-453c-b6f8-37d839a59115 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] HTTP exception thrown: Instance d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87 could not be found. Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-525993d5-f089-453c-b6f8-37d839a59115 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Request method failure captured: Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87 HTTP/1.1 Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xZ4cqhknOu7KbgmQDBZm-l7QM9gsRhFK_k9nMqqK3k7ve0q3VnvKXYeou2kR2vl-vyyf9MpZ863HZsv7s2u8Peu8KTxefah8X1W4EXcHPnF_nTGVg9UtBlp51XhNbakDHdOnkA8CSVKq3mtU-wnJPMyB8_xsl2k2fAwm9LOhmAMax4 Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 5a300727d7874d83970c301327780abc Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-MultipleCreateTestJSON-188947588 Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5a300727d7874d83970c301327780abc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5a300727d7874d83970c301327780abc", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5a300727d7874d83970c301327780abc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5a300727d7874d83970c301327780abc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-MultipleCreateTestJSON-188947588 Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 5a300727d7874d83970c301327780abc Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-MultipleCreateTestJSON-188947588 Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-MultipleCreateTestJSON-188947588-project Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 5f0ed400a2cb48cbbc9fa5bae0e2b1c2 Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-MultipleCreateTestJSON-188947588-project Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: exception: Instance d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87 could not be found. Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'd4fc7ee1-29ea-43e6-8c6d-0e571fa71e87'} Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87 could not be found. Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87 could not be found. Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:35:07.890457 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:35:07.896185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:07.896185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:35:07.896185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:35:07.896185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:35:07.896185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:35:07.896185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87 could not be found. Aug 07 01:35:07.896185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:35:07.896185 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-525993d5-f089-453c-b6f8-37d839a59115 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Returning 404 to user: Instance d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:35:07.896185 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-525993d5-f089-453c-b6f8-37d839a59115 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87" status: 404 len: 111 microversion: 2.1 time: 0.077807 Aug 07 01:35:07.901778 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2228/4865] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:07 2022] GET /compute/v2.1/servers/d4fc7ee1-29ea-43e6-8c6d-0e571fa71e87 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:35:07.910647 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-75177ca5-dd9b-4220-9eb6-2a7962e228de tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:07.911363 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-75177ca5-dd9b-4220-9eb6-2a7962e228de tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: cfa709be-49f5-434c-8c0e-cb4671f40105] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:07.926425 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75177ca5-dd9b-4220-9eb6-2a7962e228de tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:07.927480 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75177ca5-dd9b-4220-9eb6-2a7962e228de tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:07.928568 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75177ca5-dd9b-4220-9eb6-2a7962e228de tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:07.930916 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75177ca5-dd9b-4220-9eb6-2a7962e228de tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:07.932036 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75177ca5-dd9b-4220-9eb6-2a7962e228de tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:07.932763 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75177ca5-dd9b-4220-9eb6-2a7962e228de tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:08.001398 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=6,nova_api:INSERT=4 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:08.013116 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75177ca5-dd9b-4220-9eb6-2a7962e228de tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:08.014209 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75177ca5-dd9b-4220-9eb6-2a7962e228de tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:08.015517 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75177ca5-dd9b-4220-9eb6-2a7962e228de tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:08.016542 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-75177ca5-dd9b-4220-9eb6-2a7962e228de tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lazy-loading 'fault' on Instance uuid cfa709be-49f5-434c-8c0e-cb4671f40105 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:35:08.085130 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ca7d105f-d1cd-44dd-8aa6-86565d5cf4bc tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:08.085940 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ca7d105f-d1cd-44dd-8aa6-86565d5cf4bc tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] [instance: 1a6ec1ce-d60b-4757-8b95-4c1031876a49] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:08.105754 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca7d105f-d1cd-44dd-8aa6-86565d5cf4bc tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:08.108710 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca7d105f-d1cd-44dd-8aa6-86565d5cf4bc tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:08.109414 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca7d105f-d1cd-44dd-8aa6-86565d5cf4bc tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:08.110438 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca7d105f-d1cd-44dd-8aa6-86565d5cf4bc tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:08.110799 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca7d105f-d1cd-44dd-8aa6-86565d5cf4bc tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:08.113057 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca7d105f-d1cd-44dd-8aa6-86565d5cf4bc tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:08.115351 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-75177ca5-dd9b-4220-9eb6-2a7962e228de tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a300727d7874d83970c301327780abc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:08.137416 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-75177ca5-dd9b-4220-9eb6-2a7962e228de tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105" status: 200 len: 1308 microversion: 2.1 time: 0.236165 Aug 07 01:35:08.138968 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2638/4866] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:07 2022] GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105 => generated 1308 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:08.306305 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ca7d105f-d1cd-44dd-8aa6-86565d5cf4bc tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0344a81c981b434689ac476b815b8f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc9ff987bb541d6a11324aaca07182d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:08.330338 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ca7d105f-d1cd-44dd-8aa6-86565d5cf4bc tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "GET /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49" status: 200 len: 1209 microversion: 2.1 time: 0.249645 Aug 07 01:35:08.342481 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2229/4867] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:08 2022] GET /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49 => generated 1209 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:35:08.356846 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-38144dc5-f5e1-48a4-9a10-e0a29a2156a8 req-34bb13a1-2654-4c24-a3a3-e377e30d9b14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfa709be-49f5-434c-8c0e-cb4671f40105", "name": "network-vif-deleted", "tag": "6117126d-ff0c-4996-bf60-4a7445604f1e"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:35:08.370020 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-38144dc5-f5e1-48a4-9a10-e0a29a2156a8 req-34bb13a1-2654-4c24-a3a3-e377e30d9b14 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:08.371036 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-38144dc5-f5e1-48a4-9a10-e0a29a2156a8 req-34bb13a1-2654-4c24-a3a3-e377e30d9b14 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:08.371650 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-38144dc5-f5e1-48a4-9a10-e0a29a2156a8 req-34bb13a1-2654-4c24-a3a3-e377e30d9b14 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:08.406282 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-38144dc5-f5e1-48a4-9a10-e0a29a2156a8 req-34bb13a1-2654-4c24-a3a3-e377e30d9b14 service nova] Creating event network-vif-deleted:6117126d-ff0c-4996-bf60-4a7445604f1e for instance cfa709be-49f5-434c-8c0e-cb4671f40105 on n-h2-master-1 Aug 07 01:35:08.411826 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-38144dc5-f5e1-48a4-9a10-e0a29a2156a8 req-34bb13a1-2654-4c24-a3a3-e377e30d9b14 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063908 Aug 07 01:35:08.413385 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2639/4868] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:35:08.505710 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a0e04c5b-432b-4c06-9f7a-cc55a3a7f894 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:08.507328 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a0e04c5b-432b-4c06-9f7a-cc55a3a7f894 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:08.516701 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a0e04c5b-432b-4c06-9f7a-cc55a3a7f894 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:08.517611 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a0e04c5b-432b-4c06-9f7a-cc55a3a7f894 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:08.518486 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a0e04c5b-432b-4c06-9f7a-cc55a3a7f894 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:08.519915 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a0e04c5b-432b-4c06-9f7a-cc55a3a7f894 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:08.521143 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a0e04c5b-432b-4c06-9f7a-cc55a3a7f894 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:08.521793 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a0e04c5b-432b-4c06-9f7a-cc55a3a7f894 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:08.725972 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-224ea223-b62c-4de7-98a3-23faf31874d1 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:08.727511 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-224ea223-b62c-4de7-98a3-23faf31874d1 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:08.740407 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-224ea223-b62c-4de7-98a3-23faf31874d1 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:08.740802 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-224ea223-b62c-4de7-98a3-23faf31874d1 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:08.741253 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-224ea223-b62c-4de7-98a3-23faf31874d1 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:08.741982 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-224ea223-b62c-4de7-98a3-23faf31874d1 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:08.742444 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-224ea223-b62c-4de7-98a3-23faf31874d1 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:08.743456 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-224ea223-b62c-4de7-98a3-23faf31874d1 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:08.913648 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a0e04c5b-432b-4c06-9f7a-cc55a3a7f894 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:08.928433 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a0e04c5b-432b-4c06-9f7a-cc55a3a7f894 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:08.931175 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a0e04c5b-432b-4c06-9f7a-cc55a3a7f894 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:08.933138 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a0e04c5b-432b-4c06-9f7a-cc55a3a7f894 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1808 microversion: 2.20 time: 0.432261 Aug 07 01:35:08.948008 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2230/4869] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:35:08 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1808 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:35:08.956023 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-224ea223-b62c-4de7-98a3-23faf31874d1 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:08.974632 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-224ea223-b62c-4de7-98a3-23faf31874d1 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1524 microversion: 2.1 time: 0.257921 Aug 07 01:35:08.976638 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2640/4870] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:08 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1524 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:09.161814 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b77b74d8-8b1d-4156-96f3-75f43574b9e6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:09.165483 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b77b74d8-8b1d-4156-96f3-75f43574b9e6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] [instance: cfa709be-49f5-434c-8c0e-cb4671f40105] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:09.181097 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b77b74d8-8b1d-4156-96f3-75f43574b9e6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:09.181662 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b77b74d8-8b1d-4156-96f3-75f43574b9e6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:09.182331 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b77b74d8-8b1d-4156-96f3-75f43574b9e6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:09.183164 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b77b74d8-8b1d-4156-96f3-75f43574b9e6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:09.184477 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b77b74d8-8b1d-4156-96f3-75f43574b9e6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:09.185068 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b77b74d8-8b1d-4156-96f3-75f43574b9e6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:09.213610 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-b77b74d8-8b1d-4156-96f3-75f43574b9e6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] HTTP exception thrown: Instance cfa709be-49f5-434c-8c0e-cb4671f40105 could not be found. Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b77b74d8-8b1d-4156-96f3-75f43574b9e6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Request method failure captured: Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105 HTTP/1.1 Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xZ4cqhknOu7KbgmQDBZm-l7QM9gsRhFK_k9nMqqK3k7ve0q3VnvKXYeou2kR2vl-vyyf9MpZ863HZsv7s2u8Peu8KTxefah8X1W4EXcHPnF_nTGVg9UtBlp51XhNbakDHdOnkA8CSVKq3mtU-wnJPMyB8_xsl2k2fAwm9LOhmAMax4 Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 5a300727d7874d83970c301327780abc Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-MultipleCreateTestJSON-188947588 Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5a300727d7874d83970c301327780abc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5a300727d7874d83970c301327780abc", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5a300727d7874d83970c301327780abc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5a300727d7874d83970c301327780abc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-MultipleCreateTestJSON-188947588 Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 5a300727d7874d83970c301327780abc Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-MultipleCreateTestJSON-188947588 Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-MultipleCreateTestJSON-188947588-project Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 5f0ed400a2cb48cbbc9fa5bae0e2b1c2 Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-MultipleCreateTestJSON-188947588-project Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: exception: Instance cfa709be-49f5-434c-8c0e-cb4671f40105 could not be found. Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'cfa709be-49f5-434c-8c0e-cb4671f40105'} Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfa709be-49f5-434c-8c0e-cb4671f40105 could not be found. Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfa709be-49f5-434c-8c0e-cb4671f40105 could not be found. Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:35:09.215809 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:35:09.220543 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:09.220543 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:35:09.220543 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:35:09.220543 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:35:09.220543 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:35:09.220543 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfa709be-49f5-434c-8c0e-cb4671f40105 could not be found. Aug 07 01:35:09.220543 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:35:09.226450 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b77b74d8-8b1d-4156-96f3-75f43574b9e6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] Returning 404 to user: Instance cfa709be-49f5-434c-8c0e-cb4671f40105 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:35:09.234649 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b77b74d8-8b1d-4156-96f3-75f43574b9e6 tempest-MultipleCreateTestJSON-188947588 tempest-MultipleCreateTestJSON-188947588-project] 10.222.0.39 "GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105" status: 404 len: 111 microversion: 2.1 time: 0.077942 Aug 07 01:35:09.236039 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2231/4871] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:09 2022] GET /compute/v2.1/servers/cfa709be-49f5-434c-8c0e-cb4671f40105 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:35:09.359396 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-92e95318-596d-46d6-a82a-cce3c144779a tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:09.360061 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-92e95318-596d-46d6-a82a-cce3c144779a tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] [instance: 1a6ec1ce-d60b-4757-8b95-4c1031876a49] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:09.381150 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92e95318-596d-46d6-a82a-cce3c144779a tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:09.381641 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92e95318-596d-46d6-a82a-cce3c144779a tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:09.383064 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92e95318-596d-46d6-a82a-cce3c144779a tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:09.385388 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92e95318-596d-46d6-a82a-cce3c144779a tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:09.385878 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92e95318-596d-46d6-a82a-cce3c144779a tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:09.386318 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-92e95318-596d-46d6-a82a-cce3c144779a tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:09.477920 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-92e95318-596d-46d6-a82a-cce3c144779a tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0344a81c981b434689ac476b815b8f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc9ff987bb541d6a11324aaca07182d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:09.487208 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-92e95318-596d-46d6-a82a-cce3c144779a tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "GET /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49" status: 200 len: 1271 microversion: 2.1 time: 0.131485 Aug 07 01:35:09.488293 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2641/4872] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:09 2022] GET /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49 => generated 1271 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:09.963122 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e9af3cde-de9e-4ebd-9c90-6fc58951cbd2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:09.964809 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e9af3cde-de9e-4ebd-9c90-6fc58951cbd2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:09.976688 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9af3cde-de9e-4ebd-9c90-6fc58951cbd2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:09.977978 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9af3cde-de9e-4ebd-9c90-6fc58951cbd2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:09.979062 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9af3cde-de9e-4ebd-9c90-6fc58951cbd2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:09.981092 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9af3cde-de9e-4ebd-9c90-6fc58951cbd2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:09.982105 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9af3cde-de9e-4ebd-9c90-6fc58951cbd2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:09.982883 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9af3cde-de9e-4ebd-9c90-6fc58951cbd2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:10.002127 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9cdee690-1ff7-4b5e-877e-8ad54436e5a1 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:10.002846 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9cdee690-1ff7-4b5e-877e-8ad54436e5a1 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:10.046701 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9cdee690-1ff7-4b5e-877e-8ad54436e5a1 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:10.048637 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9cdee690-1ff7-4b5e-877e-8ad54436e5a1 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:10.051128 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9cdee690-1ff7-4b5e-877e-8ad54436e5a1 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:10.052881 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9cdee690-1ff7-4b5e-877e-8ad54436e5a1 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:10.057968 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9cdee690-1ff7-4b5e-877e-8ad54436e5a1 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:10.059002 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9cdee690-1ff7-4b5e-877e-8ad54436e5a1 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:10.386853 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e9af3cde-de9e-4ebd-9c90-6fc58951cbd2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:10.429734 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e9af3cde-de9e-4ebd-9c90-6fc58951cbd2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:10.442567 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e9af3cde-de9e-4ebd-9c90-6fc58951cbd2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:10.445481 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e9af3cde-de9e-4ebd-9c90-6fc58951cbd2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1808 microversion: 2.20 time: 0.487149 Aug 07 01:35:10.463920 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2232/4873] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:35:09 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1808 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:35:10.510742 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-91fd2369-a235-4065-a67e-dae163f9a086 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:10.511812 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-91fd2369-a235-4065-a67e-dae163f9a086 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] [instance: 1a6ec1ce-d60b-4757-8b95-4c1031876a49] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:10.526075 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-91fd2369-a235-4065-a67e-dae163f9a086 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:10.526950 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-91fd2369-a235-4065-a67e-dae163f9a086 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:10.527654 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-91fd2369-a235-4065-a67e-dae163f9a086 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:10.528662 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-91fd2369-a235-4065-a67e-dae163f9a086 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:10.529639 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-91fd2369-a235-4065-a67e-dae163f9a086 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:10.530305 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-91fd2369-a235-4065-a67e-dae163f9a086 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:10.630113 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9cdee690-1ff7-4b5e-877e-8ad54436e5a1 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:10.642039 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9cdee690-1ff7-4b5e-877e-8ad54436e5a1 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1504 microversion: 2.1 time: 0.642219 Aug 07 01:35:10.659387 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2642/4874] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:09 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1504 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:10.674781 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-00c8bdf7-dd9b-42ed-bbaa-2aac71095a06 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Action: 'create', calling method: .version_select at 0x7f9e174f00d0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-2011194400", "description": "tempest-description-1298188820"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:35:11.132869 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-91fd2369-a235-4065-a67e-dae163f9a086 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0344a81c981b434689ac476b815b8f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc9ff987bb541d6a11324aaca07182d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:11.147202 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-91fd2369-a235-4065-a67e-dae163f9a086 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "GET /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49" status: 200 len: 1313 microversion: 2.1 time: 0.640882 Aug 07 01:35:11.154075 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2233/4875] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:10 2022] GET /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49 => generated 1313 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:11.423035 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-00c8bdf7-dd9b-42ed-bbaa-2aac71095a06 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.751743 Aug 07 01:35:11.424466 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2643/4876] 10.222.0.39 () {60 vars in 1180 bytes} [Sun Aug 7 01:35:10 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:35:11.436588 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5e2cc39e-5944-4d83-8b47-ceb616260d92 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-2011194400"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:35:11.437147 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5e2cc39e-5944-4d83-8b47-ceb616260d92 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:11.446558 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e2cc39e-5944-4d83-8b47-ceb616260d92 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:11.448258 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e2cc39e-5944-4d83-8b47-ceb616260d92 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:11.449126 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e2cc39e-5944-4d83-8b47-ceb616260d92 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:11.452886 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e2cc39e-5944-4d83-8b47-ceb616260d92 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:11.453612 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e2cc39e-5944-4d83-8b47-ceb616260d92 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:11.456326 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e2cc39e-5944-4d83-8b47-ceb616260d92 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:11.474501 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6ec785c8-9432-4d58-a02e-2ca506cd8d8c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:11.475464 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6ec785c8-9432-4d58-a02e-2ca506cd8d8c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:11.511807 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ec785c8-9432-4d58-a02e-2ca506cd8d8c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:11.512257 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ec785c8-9432-4d58-a02e-2ca506cd8d8c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:11.512709 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ec785c8-9432-4d58-a02e-2ca506cd8d8c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:11.513463 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ec785c8-9432-4d58-a02e-2ca506cd8d8c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:11.513915 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ec785c8-9432-4d58-a02e-2ca506cd8d8c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:11.514348 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ec785c8-9432-4d58-a02e-2ca506cd8d8c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:11.709369 n-d-master-1 devstack@n-api.service[119517]: INFO nova.network.security_group_api [None req-5e2cc39e-5944-4d83-8b47-ceb616260d92 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Adding security group 0add019e-7ae2-4ea2-986b-fb4b13743f88 to port d21f91e9-787f-44e2-996b-ca2635e32ba6 Aug 07 01:35:11.929034 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6ec785c8-9432-4d58-a02e-2ca506cd8d8c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:11.943953 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6ec785c8-9432-4d58-a02e-2ca506cd8d8c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:11.951447 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6ec785c8-9432-4d58-a02e-2ca506cd8d8c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:11.953176 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6ec785c8-9432-4d58-a02e-2ca506cd8d8c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1808 microversion: 2.20 time: 0.484026 Aug 07 01:35:11.955668 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2644/4877] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:35:11 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1808 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:35:12.182922 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a3c472a5-9b5f-4eb8-9cd5-92d51031ad5d tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:12.184888 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a3c472a5-9b5f-4eb8-9cd5-92d51031ad5d tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] [instance: 1a6ec1ce-d60b-4757-8b95-4c1031876a49] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:12.194831 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3c472a5-9b5f-4eb8-9cd5-92d51031ad5d tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:12.197121 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3c472a5-9b5f-4eb8-9cd5-92d51031ad5d tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:12.198676 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3c472a5-9b5f-4eb8-9cd5-92d51031ad5d tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:12.199676 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3c472a5-9b5f-4eb8-9cd5-92d51031ad5d tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:12.202413 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3c472a5-9b5f-4eb8-9cd5-92d51031ad5d tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:12.204079 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3c472a5-9b5f-4eb8-9cd5-92d51031ad5d tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:12.480300 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5e2cc39e-5944-4d83-8b47-ceb616260d92 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "POST /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad/action" status: 202 len: 0 microversion: 2.1 time: 1.047584 Aug 07 01:35:12.481554 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2234/4878] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:35:11 2022] POST /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad/action => generated 0 bytes in 1050 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:35:12.492187 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-1dafc799-d22b-4677-a911-31ca3f488cdd req-c1b592f1-cc9d-4c77-9610-bbd03eb6831d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a6ec1ce-d60b-4757-8b95-4c1031876a49", "tag": "dde4ebd3-2427-49b7-aca1-1e6c3918c096"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:35:12.528128 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-1dafc799-d22b-4677-a911-31ca3f488cdd req-c1b592f1-cc9d-4c77-9610-bbd03eb6831d service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:12.529161 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-1dafc799-d22b-4677-a911-31ca3f488cdd req-c1b592f1-cc9d-4c77-9610-bbd03eb6831d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:12.529790 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-1dafc799-d22b-4677-a911-31ca3f488cdd req-c1b592f1-cc9d-4c77-9610-bbd03eb6831d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:12.551574 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-1dafc799-d22b-4677-a911-31ca3f488cdd req-c1b592f1-cc9d-4c77-9610-bbd03eb6831d service nova] Creating event network-changed:dde4ebd3-2427-49b7-aca1-1e6c3918c096 for instance 1a6ec1ce-d60b-4757-8b95-4c1031876a49 on n-h1-master-1 Aug 07 01:35:12.569609 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-1dafc799-d22b-4677-a911-31ca3f488cdd req-c1b592f1-cc9d-4c77-9610-bbd03eb6831d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083276 Aug 07 01:35:12.571414 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2235/4879] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:35:12.582442 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-049c02af-77d7-4c31-b1c3-8d55d81d3735 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-2011194400"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:35:12.587787 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-049c02af-77d7-4c31-b1c3-8d55d81d3735 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:12.628181 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-049c02af-77d7-4c31-b1c3-8d55d81d3735 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:12.634736 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-049c02af-77d7-4c31-b1c3-8d55d81d3735 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:12.635291 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-049c02af-77d7-4c31-b1c3-8d55d81d3735 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:12.636112 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-049c02af-77d7-4c31-b1c3-8d55d81d3735 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:12.642612 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-049c02af-77d7-4c31-b1c3-8d55d81d3735 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:12.642916 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-049c02af-77d7-4c31-b1c3-8d55d81d3735 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:12.889031 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=16 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:13.118092 n-d-master-1 devstack@n-api.service[119517]: INFO nova.network.security_group_api [None req-049c02af-77d7-4c31-b1c3-8d55d81d3735 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Removing security group 0add019e-7ae2-4ea2-986b-fb4b13743f88 from port d21f91e9-787f-44e2-996b-ca2635e32ba6 Aug 07 01:35:13.533061 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a3c472a5-9b5f-4eb8-9cd5-92d51031ad5d tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0344a81c981b434689ac476b815b8f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc9ff987bb541d6a11324aaca07182d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:13.551042 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a3c472a5-9b5f-4eb8-9cd5-92d51031ad5d tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "GET /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49" status: 200 len: 1313 microversion: 2.1 time: 1.373179 Aug 07 01:35:13.552804 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2645/4880] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:12 2022] GET /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49 => generated 1313 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:13.569289 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3c288dae-8cd3-456d-9afd-9e76964ef524 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:13.575172 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3c288dae-8cd3-456d-9afd-9e76964ef524 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:13.583317 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c288dae-8cd3-456d-9afd-9e76964ef524 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:13.584353 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c288dae-8cd3-456d-9afd-9e76964ef524 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:13.585296 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c288dae-8cd3-456d-9afd-9e76964ef524 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:13.588157 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c288dae-8cd3-456d-9afd-9e76964ef524 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:13.588910 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c288dae-8cd3-456d-9afd-9e76964ef524 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:13.589754 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c288dae-8cd3-456d-9afd-9e76964ef524 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:13.973614 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3c288dae-8cd3-456d-9afd-9e76964ef524 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:13.993717 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3c288dae-8cd3-456d-9afd-9e76964ef524 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:13.995118 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3c288dae-8cd3-456d-9afd-9e76964ef524 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:13.996394 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3c288dae-8cd3-456d-9afd-9e76964ef524 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1795 microversion: 2.20 time: 0.438862 Aug 07 01:35:14.019452 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2646/4881] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:35:13 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1795 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:35:14.027943 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-049c02af-77d7-4c31-b1c3-8d55d81d3735 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "POST /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad/action" status: 202 len: 0 microversion: 2.1 time: 1.454929 Aug 07 01:35:14.029175 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2236/4882] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:35:12 2022] POST /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad/action => generated 0 bytes in 1457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:35:14.037885 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e3f00e83-4498-4679-afb1-59bbeb26f66f tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Action: 'create', calling method: .version_select at 0x7f9e1712f280>, body: {"pool": null} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:35:14.575077 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6d9a4978-5b4f-4530-9cf4-2597ac7a6115 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:14.576828 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6d9a4978-5b4f-4530-9cf4-2597ac7a6115 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] [instance: 1a6ec1ce-d60b-4757-8b95-4c1031876a49] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:14.596660 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6d9a4978-5b4f-4530-9cf4-2597ac7a6115 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:14.599493 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6d9a4978-5b4f-4530-9cf4-2597ac7a6115 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:14.601247 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6d9a4978-5b4f-4530-9cf4-2597ac7a6115 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:14.604666 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6d9a4978-5b4f-4530-9cf4-2597ac7a6115 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:14.607068 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6d9a4978-5b4f-4530-9cf4-2597ac7a6115 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:14.607545 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6d9a4978-5b4f-4530-9cf4-2597ac7a6115 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:15.080584 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6d9a4978-5b4f-4530-9cf4-2597ac7a6115 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0344a81c981b434689ac476b815b8f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc9ff987bb541d6a11324aaca07182d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:15.094336 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6d9a4978-5b4f-4530-9cf4-2597ac7a6115 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "GET /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49" status: 200 len: 1313 microversion: 2.1 time: 0.524060 Aug 07 01:35:15.112295 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2237/4883] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:14 2022] GET /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49 => generated 1313 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:35:15.117312 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-837a188e-5054-44a3-8dbb-56e9a1fd2dcf req-d73ff698-135e-483b-ad07-d161f2a98d4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afe29183-ebc5-4f1b-af8b-1eb2bbbfffad", "tag": "d21f91e9-787f-44e2-996b-ca2635e32ba6"}, {"name": "network-changed", "server_uuid": "afe29183-ebc5-4f1b-af8b-1eb2bbbfffad", "tag": "d21f91e9-787f-44e2-996b-ca2635e32ba6"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:35:15.150361 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-837a188e-5054-44a3-8dbb-56e9a1fd2dcf req-d73ff698-135e-483b-ad07-d161f2a98d4e service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:15.151224 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-837a188e-5054-44a3-8dbb-56e9a1fd2dcf req-d73ff698-135e-483b-ad07-d161f2a98d4e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:15.151903 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-837a188e-5054-44a3-8dbb-56e9a1fd2dcf req-d73ff698-135e-483b-ad07-d161f2a98d4e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:15.172781 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-837a188e-5054-44a3-8dbb-56e9a1fd2dcf req-d73ff698-135e-483b-ad07-d161f2a98d4e service nova] Creating event network-changed:d21f91e9-787f-44e2-996b-ca2635e32ba6 for instance afe29183-ebc5-4f1b-af8b-1eb2bbbfffad on n-h2-master-1 Aug 07 01:35:15.177909 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-837a188e-5054-44a3-8dbb-56e9a1fd2dcf req-d73ff698-135e-483b-ad07-d161f2a98d4e service nova] Creating event network-changed:d21f91e9-787f-44e2-996b-ca2635e32ba6 for instance afe29183-ebc5-4f1b-af8b-1eb2bbbfffad on n-h2-master-1 Aug 07 01:35:15.197158 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-837a188e-5054-44a3-8dbb-56e9a1fd2dcf req-d73ff698-135e-483b-ad07-d161f2a98d4e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.083380 Aug 07 01:35:15.197937 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2238/4884] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:35:16.123288 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3edc4e3d-e427-4724-b810-467c513b19a6 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:16.125261 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3edc4e3d-e427-4724-b810-467c513b19a6 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] [instance: 1a6ec1ce-d60b-4757-8b95-4c1031876a49] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:16.136204 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3edc4e3d-e427-4724-b810-467c513b19a6 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:16.137258 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3edc4e3d-e427-4724-b810-467c513b19a6 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:16.137964 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3edc4e3d-e427-4724-b810-467c513b19a6 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:16.139088 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3edc4e3d-e427-4724-b810-467c513b19a6 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:16.139738 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3edc4e3d-e427-4724-b810-467c513b19a6 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:16.140380 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3edc4e3d-e427-4724-b810-467c513b19a6 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:16.316010 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:16.832084 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3edc4e3d-e427-4724-b810-467c513b19a6 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0344a81c981b434689ac476b815b8f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc9ff987bb541d6a11324aaca07182d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:16.850447 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3edc4e3d-e427-4724-b810-467c513b19a6 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "GET /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49" status: 200 len: 1313 microversion: 2.1 time: 0.735275 Aug 07 01:35:16.851414 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2239/4885] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:16 2022] GET /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49 => generated 1313 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:17.227470 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e3f00e83-4498-4679-afb1-59bbeb26f66f tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.192800 Aug 07 01:35:17.228996 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2647/4886] 10.222.0.39 () {60 vars in 1170 bytes} [Sun Aug 7 01:35:14 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:35:17.244419 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4ea85256-53aa-4c8c-950c-3967d26ad8c7 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.36"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:35:17.249299 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4ea85256-53aa-4c8c-950c-3967d26ad8c7 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:17.260354 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=40 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:17.270374 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ea85256-53aa-4c8c-950c-3967d26ad8c7 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:17.271171 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ea85256-53aa-4c8c-950c-3967d26ad8c7 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:17.271776 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ea85256-53aa-4c8c-950c-3967d26ad8c7 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:17.272706 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ea85256-53aa-4c8c-950c-3967d26ad8c7 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:17.273402 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ea85256-53aa-4c8c-950c-3967d26ad8c7 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:17.274279 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ea85256-53aa-4c8c-950c-3967d26ad8c7 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:17.322685 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ea85256-53aa-4c8c-950c-3967d26ad8c7 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "refresh_cache-afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" {{(pid=119517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 07 01:35:17.323357 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ea85256-53aa-4c8c-950c-3967d26ad8c7 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquired lock "refresh_cache-afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" {{(pid=119517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 07 01:35:17.875205 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a895980b-fd53-4e8f-a464-11b6e77ad640 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:17.876055 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a895980b-fd53-4e8f-a464-11b6e77ad640 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] [instance: 1a6ec1ce-d60b-4757-8b95-4c1031876a49] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:17.913647 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a895980b-fd53-4e8f-a464-11b6e77ad640 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:17.915590 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a895980b-fd53-4e8f-a464-11b6e77ad640 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:17.917386 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a895980b-fd53-4e8f-a464-11b6e77ad640 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:17.921818 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a895980b-fd53-4e8f-a464-11b6e77ad640 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:17.923229 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a895980b-fd53-4e8f-a464-11b6e77ad640 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:17.924757 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a895980b-fd53-4e8f-a464-11b6e77ad640 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:18.256739 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a895980b-fd53-4e8f-a464-11b6e77ad640 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0344a81c981b434689ac476b815b8f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc9ff987bb541d6a11324aaca07182d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:18.287197 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a895980b-fd53-4e8f-a464-11b6e77ad640 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "GET /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49" status: 200 len: 1313 microversion: 2.1 time: 0.418467 Aug 07 01:35:18.288293 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2648/4887] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:17 2022] GET /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49 => generated 1313 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:19.318047 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6c2d3cb5-421a-480b-abeb-40f662bd0187 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:19.318778 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6c2d3cb5-421a-480b-abeb-40f662bd0187 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] [instance: 1a6ec1ce-d60b-4757-8b95-4c1031876a49] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:19.356680 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c2d3cb5-421a-480b-abeb-40f662bd0187 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:19.358849 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c2d3cb5-421a-480b-abeb-40f662bd0187 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:19.360544 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c2d3cb5-421a-480b-abeb-40f662bd0187 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:19.363410 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c2d3cb5-421a-480b-abeb-40f662bd0187 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:19.364268 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c2d3cb5-421a-480b-abeb-40f662bd0187 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:19.367105 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c2d3cb5-421a-480b-abeb-40f662bd0187 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:19.691516 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6c2d3cb5-421a-480b-abeb-40f662bd0187 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0344a81c981b434689ac476b815b8f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc9ff987bb541d6a11324aaca07182d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:19.710156 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6c2d3cb5-421a-480b-abeb-40f662bd0187 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "GET /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49" status: 200 len: 1313 microversion: 2.1 time: 0.403596 Aug 07 01:35:19.713506 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2649/4888] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:19 2022] GET /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49 => generated 1313 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:35:20.732927 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dc700d9d-3dc9-4606-824b-308678261ec8 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:20.734614 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-dc700d9d-3dc9-4606-824b-308678261ec8 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] [instance: 1a6ec1ce-d60b-4757-8b95-4c1031876a49] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:20.755096 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc700d9d-3dc9-4606-824b-308678261ec8 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:20.757080 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc700d9d-3dc9-4606-824b-308678261ec8 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:20.758513 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc700d9d-3dc9-4606-824b-308678261ec8 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:20.762790 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc700d9d-3dc9-4606-824b-308678261ec8 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:20.765456 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc700d9d-3dc9-4606-824b-308678261ec8 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:20.767725 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc700d9d-3dc9-4606-824b-308678261ec8 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:21.071352 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-4ea85256-53aa-4c8c-950c-3967d26ad8c7 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Building network info cache for instance {{(pid=119517) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 07 01:35:21.287785 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-dc700d9d-3dc9-4606-824b-308678261ec8 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0344a81c981b434689ac476b815b8f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc9ff987bb541d6a11324aaca07182d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:21.305194 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-dc700d9d-3dc9-4606-824b-308678261ec8 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "GET /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49" status: 200 len: 1313 microversion: 2.1 time: 0.572604 Aug 07 01:35:21.306475 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2650/4889] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:20 2022] GET /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49 => generated 1313 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:21.312888 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-93b37929-a61a-4ab5-8e77-9b6fee273a8e req-56063c2c-9794-4bd6-9229-00fbe3a79cea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afe29183-ebc5-4f1b-af8b-1eb2bbbfffad", "tag": "d21f91e9-787f-44e2-996b-ca2635e32ba6"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:35:21.324609 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-93b37929-a61a-4ab5-8e77-9b6fee273a8e req-56063c2c-9794-4bd6-9229-00fbe3a79cea service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:21.325390 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-93b37929-a61a-4ab5-8e77-9b6fee273a8e req-56063c2c-9794-4bd6-9229-00fbe3a79cea service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:21.326003 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-93b37929-a61a-4ab5-8e77-9b6fee273a8e req-56063c2c-9794-4bd6-9229-00fbe3a79cea service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:21.339825 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-93b37929-a61a-4ab5-8e77-9b6fee273a8e req-56063c2c-9794-4bd6-9229-00fbe3a79cea service nova] Creating event network-changed:d21f91e9-787f-44e2-996b-ca2635e32ba6 for instance afe29183-ebc5-4f1b-af8b-1eb2bbbfffad on n-h2-master-1 Aug 07 01:35:21.345700 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-93b37929-a61a-4ab5-8e77-9b6fee273a8e req-56063c2c-9794-4bd6-9229-00fbe3a79cea service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037032 Aug 07 01:35:21.347315 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2651/4890] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:35:21.810891 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-99e4029d-22eb-473b-bd40-78476633159f req-95ad85b1-311d-49b7-ad79-72ecdd93ed45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a6ec1ce-d60b-4757-8b95-4c1031876a49", "name": "network-vif-plugged", "status": "completed", "tag": "dde4ebd3-2427-49b7-aca1-1e6c3918c096"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:35:21.837152 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-99e4029d-22eb-473b-bd40-78476633159f req-95ad85b1-311d-49b7-ad79-72ecdd93ed45 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:21.839972 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-99e4029d-22eb-473b-bd40-78476633159f req-95ad85b1-311d-49b7-ad79-72ecdd93ed45 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:21.841993 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-99e4029d-22eb-473b-bd40-78476633159f req-95ad85b1-311d-49b7-ad79-72ecdd93ed45 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:21.863177 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-99e4029d-22eb-473b-bd40-78476633159f req-95ad85b1-311d-49b7-ad79-72ecdd93ed45 service nova] Creating event network-vif-plugged:dde4ebd3-2427-49b7-aca1-1e6c3918c096 for instance 1a6ec1ce-d60b-4757-8b95-4c1031876a49 on n-h1-master-1 Aug 07 01:35:21.899042 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-99e4029d-22eb-473b-bd40-78476633159f req-95ad85b1-311d-49b7-ad79-72ecdd93ed45 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091991 Aug 07 01:35:21.904946 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2652/4891] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:35:22.343128 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5c1b7d58-5e2a-4e6a-84fc-38e4757d352d tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:22.345757 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5c1b7d58-5e2a-4e6a-84fc-38e4757d352d tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] [instance: 1a6ec1ce-d60b-4757-8b95-4c1031876a49] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:22.373235 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5c1b7d58-5e2a-4e6a-84fc-38e4757d352d tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:22.373745 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5c1b7d58-5e2a-4e6a-84fc-38e4757d352d tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:22.374196 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5c1b7d58-5e2a-4e6a-84fc-38e4757d352d tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:22.374926 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5c1b7d58-5e2a-4e6a-84fc-38e4757d352d tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:22.375381 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5c1b7d58-5e2a-4e6a-84fc-38e4757d352d tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:22.375812 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5c1b7d58-5e2a-4e6a-84fc-38e4757d352d tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:22.947122 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-4ea85256-53aa-4c8c-950c-3967d26ad8c7 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Updating instance_info_cache with network_info: [{"id": "d21f91e9-787f-44e2-996b-ca2635e32ba6", "address": "fa:16:3e:cd:4c:9e", "network": {"id": "adf96141-07d9-42cc-8458-bc4b41607467", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1632315539-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "64c8da97f8334f7da1cd25716cc7da0d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd21f91e9-78", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119517) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 07 01:35:22.968660 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ea85256-53aa-4c8c-950c-3967d26ad8c7 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Releasing lock "refresh_cache-afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" {{(pid=119517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 07 01:35:22.971078 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4ea85256-53aa-4c8c-950c-3967d26ad8c7 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "POST /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad/action" status: 202 len: 0 microversion: 2.1 time: 5.732274 Aug 07 01:35:22.979630 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2240/4892] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:35:17 2022] POST /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad/action => generated 0 bytes in 5741 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 07 01:35:23.004345 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cc54720c-ba4c-4ab7-98e9-f06fee095e42 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.36"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:35:23.238572 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5c1b7d58-5e2a-4e6a-84fc-38e4757d352d tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0344a81c981b434689ac476b815b8f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc9ff987bb541d6a11324aaca07182d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:23.271487 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5c1b7d58-5e2a-4e6a-84fc-38e4757d352d tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "GET /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49" status: 200 len: 1313 microversion: 2.1 time: 0.945956 Aug 07 01:35:23.293061 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2653/4893] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:22 2022] GET /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49 => generated 1313 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:23.474912 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-cc54720c-ba4c-4ab7-98e9-f06fee095e42 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:23.483141 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc54720c-ba4c-4ab7-98e9-f06fee095e42 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:23.483983 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc54720c-ba4c-4ab7-98e9-f06fee095e42 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:23.484600 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc54720c-ba4c-4ab7-98e9-f06fee095e42 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:23.486197 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc54720c-ba4c-4ab7-98e9-f06fee095e42 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:23.490634 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc54720c-ba4c-4ab7-98e9-f06fee095e42 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:23.492542 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc54720c-ba4c-4ab7-98e9-f06fee095e42 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:24.155556 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc54720c-ba4c-4ab7-98e9-f06fee095e42 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "refresh_cache-afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" {{(pid=119517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 07 01:35:24.156981 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc54720c-ba4c-4ab7-98e9-f06fee095e42 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquired lock "refresh_cache-afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" {{(pid=119517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 07 01:35:24.295998 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ef925409-5d94-4465-9b36-f597438fad12 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:24.297315 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ef925409-5d94-4465-9b36-f597438fad12 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] [instance: 1a6ec1ce-d60b-4757-8b95-4c1031876a49] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:24.311969 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef925409-5d94-4465-9b36-f597438fad12 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:24.318282 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef925409-5d94-4465-9b36-f597438fad12 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:24.319693 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef925409-5d94-4465-9b36-f597438fad12 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:24.321566 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef925409-5d94-4465-9b36-f597438fad12 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:24.322535 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef925409-5d94-4465-9b36-f597438fad12 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:24.324921 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef925409-5d94-4465-9b36-f597438fad12 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:24.803903 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ef925409-5d94-4465-9b36-f597438fad12 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0344a81c981b434689ac476b815b8f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc9ff987bb541d6a11324aaca07182d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:24.816817 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ef925409-5d94-4465-9b36-f597438fad12 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "GET /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49" status: 200 len: 1498 microversion: 2.1 time: 0.524969 Aug 07 01:35:24.818088 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2654/4894] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:24 2022] GET /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49 => generated 1498 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:24.838767 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-248bdfc4-5b8d-411a-b081-078592ccdc9b tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:24.872221 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.compute.server_groups [None req-248bdfc4-5b8d-411a-b081-078592ccdc9b tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Querying cell 946acc3b-7b72-45d6-9151-44f3ad85fe4f(cell1) for 1 instances {{(pid=119516) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 07 01:35:24.873819 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-248bdfc4-5b8d-411a-b081-078592ccdc9b tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:24.878097 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-248bdfc4-5b8d-411a-b081-078592ccdc9b tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:24.879653 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-248bdfc4-5b8d-411a-b081-078592ccdc9b tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:24.931061 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-248bdfc4-5b8d-411a-b081-078592ccdc9b tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups/53f6a54a-7637-431b-96ac-514331db59ba" status: 200 len: 221 microversion: 2.1 time: 0.097510 Aug 07 01:35:24.934989 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2655/4895] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Aug 7 01:35:24 2022] GET /compute/v2.1/os-server-groups/53f6a54a-7637-431b-96ac-514331db59ba => generated 221 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:35:24.947110 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f292bae0-84c2-4964-8298-db492eba0720 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:24.947627 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f292bae0-84c2-4964-8298-db492eba0720 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] [instance: 1a6ec1ce-d60b-4757-8b95-4c1031876a49] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:24.954833 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f292bae0-84c2-4964-8298-db492eba0720 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:24.955338 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f292bae0-84c2-4964-8298-db492eba0720 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:24.955788 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f292bae0-84c2-4964-8298-db492eba0720 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:24.956620 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f292bae0-84c2-4964-8298-db492eba0720 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:24.957668 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f292bae0-84c2-4964-8298-db492eba0720 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:24.958363 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f292bae0-84c2-4964-8298-db492eba0720 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:24.997375 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f292bae0-84c2-4964-8298-db492eba0720 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] [instance: 1a6ec1ce-d60b-4757-8b95-4c1031876a49] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:35:25.077074 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:25.202685 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f292bae0-84c2-4964-8298-db492eba0720 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49" status: 204 len: 0 microversion: 2.1 time: 0.258212 Aug 07 01:35:25.205430 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2656/4896] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:35:24 2022] DELETE /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 07 01:35:25.220577 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-80f1eb11-0d22-4cea-906e-62e47ec4c4ae tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:25.227415 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-80f1eb11-0d22-4cea-906e-62e47ec4c4ae tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] [instance: 1a6ec1ce-d60b-4757-8b95-4c1031876a49] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:25.238962 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80f1eb11-0d22-4cea-906e-62e47ec4c4ae tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:25.239906 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80f1eb11-0d22-4cea-906e-62e47ec4c4ae tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:25.240532 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80f1eb11-0d22-4cea-906e-62e47ec4c4ae tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:25.243267 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80f1eb11-0d22-4cea-906e-62e47ec4c4ae tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:25.244158 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80f1eb11-0d22-4cea-906e-62e47ec4c4ae tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:25.244839 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80f1eb11-0d22-4cea-906e-62e47ec4c4ae tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:26.238913 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-80f1eb11-0d22-4cea-906e-62e47ec4c4ae tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0344a81c981b434689ac476b815b8f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc9ff987bb541d6a11324aaca07182d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:26.257880 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-80f1eb11-0d22-4cea-906e-62e47ec4c4ae tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "GET /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49" status: 200 len: 1504 microversion: 2.1 time: 1.045062 Aug 07 01:35:26.259283 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2657/4897] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:25 2022] GET /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49 => generated 1504 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:35:26.814589 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8a1b6019-f7bf-4b8b-b064-d2b235df9bcd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:26.820991 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8a1b6019-f7bf-4b8b-b064-d2b235df9bcd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 57ef5095-2f80-41c5-abc9-ca37439f3384] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:26.871972 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a1b6019-f7bf-4b8b-b064-d2b235df9bcd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:26.872778 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a1b6019-f7bf-4b8b-b064-d2b235df9bcd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:26.873298 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a1b6019-f7bf-4b8b-b064-d2b235df9bcd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:26.874226 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a1b6019-f7bf-4b8b-b064-d2b235df9bcd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:26.896135 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a1b6019-f7bf-4b8b-b064-d2b235df9bcd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:26.897249 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a1b6019-f7bf-4b8b-b064-d2b235df9bcd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:27.010429 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8a1b6019-f7bf-4b8b-b064-d2b235df9bcd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384/ips" status: 200 len: 149 microversion: 2.1 time: 0.219402 Aug 07 01:35:27.019298 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2658/4898] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Aug 7 01:35:26 2022] GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384/ips => generated 149 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:35:27.041536 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8352cb06-0ddd-4ab2-b1db-b2494ac1c382 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "872b66d8-b72e-4dee-8a6d-9d1c0e3771e1"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:35:27.051204 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8352cb06-0ddd-4ab2-b1db-b2494ac1c382 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 57ef5095-2f80-41c5-abc9-ca37439f3384] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:27.073717 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8352cb06-0ddd-4ab2-b1db-b2494ac1c382 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:27.074211 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8352cb06-0ddd-4ab2-b1db-b2494ac1c382 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:27.074664 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8352cb06-0ddd-4ab2-b1db-b2494ac1c382 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:27.077091 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8352cb06-0ddd-4ab2-b1db-b2494ac1c382 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:27.077596 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8352cb06-0ddd-4ab2-b1db-b2494ac1c382 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:27.078049 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8352cb06-0ddd-4ab2-b1db-b2494ac1c382 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:27.171504 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-cc54720c-ba4c-4ab7-98e9-f06fee095e42 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Building network info cache for instance {{(pid=119517) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 07 01:35:27.232475 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-8352cb06-0ddd-4ab2-b1db-b2494ac1c382 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] HTTP exception thrown: Invalid volume: volume 872b66d8-b72e-4dee-8a6d-9d1c0e3771e1 is already attached to instances: 2778f5f5-ea59-43c9-860f-17210bcbbbd2 Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8352cb06-0ddd-4ab2-b1db-b2494ac1c382 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Request method failure captured: Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384/os-volume_attachments HTTP/1.1 Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 74 Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xZDq6RH3D4bnr1UijP-nk3uo95NJjh7SbfPDqAVgj126rgmdcLbKlTvq4r9AHLnAVbqooFNQ3b97yry4NtGcTnZJETXBytnxiV1irP15oNSC1nhov4fsRvKuKlTNLjRN8RkNUdoouf8PCfkhvGYmSqoJN36Q7GHr7rf2nNkd41nqV4 Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: b630a4c3bb824b90b4c1898a92b47aa7 Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b630a4c3bb824b90b4c1898a92b47aa7", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: b630a4c3bb824b90b4c1898a92b47aa7 Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-AttachVolumeNegativeTest-1422960247-project Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: d556a8ae0d524894a93203ce3f70d420 Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-AttachVolumeNegativeTest-1422960247-project Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: {"volumeAttachment": {"volumeId": "872b66d8-b72e-4dee-8a6d-9d1c0e3771e1"}} Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: exception: Invalid volume: volume 872b66d8-b72e-4dee-8a6d-9d1c0e3771e1 is already attached to instances: 2778f5f5-ea59-43c9-860f-17210bcbbbd2 Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: action_args: {'server_id': '57ef5095-2f80-41c5-abc9-ca37439f3384', 'body': {'volumeAttachment': {'volumeId': '872b66d8-b72e-4dee-8a6d-9d1c0e3771e1'}}} Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 872b66d8-b72e-4dee-8a6d-9d1c0e3771e1 is already attached to instances: 2778f5f5-ea59-43c9-860f-17210bcbbbd2 Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:35:27.237068 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:35:27.242913 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:35:27.242913 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:35:27.242913 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 07 01:35:27.242913 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 07 01:35:27.242913 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 872b66d8-b72e-4dee-8a6d-9d1c0e3771e1 is already attached to instances: 2778f5f5-ea59-43c9-860f-17210bcbbbd2 Aug 07 01:35:27.242913 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:27.242913 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:35:27.242913 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:27.242913 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:27.242913 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:35:27.242913 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:35:27.242913 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:35:27.242913 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:35:27.242913 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 872b66d8-b72e-4dee-8a6d-9d1c0e3771e1 is already attached to instances: 2778f5f5-ea59-43c9-860f-17210bcbbbd2 Aug 07 01:35:27.242913 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:27.242913 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8352cb06-0ddd-4ab2-b1db-b2494ac1c382 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Returning 400 to user: Invalid volume: volume 872b66d8-b72e-4dee-8a6d-9d1c0e3771e1 is already attached to instances: 2778f5f5-ea59-43c9-860f-17210bcbbbd2 {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:35:27.242913 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8352cb06-0ddd-4ab2-b1db-b2494ac1c382 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "POST /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.210572 Aug 07 01:35:27.249519 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2659/4899] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Aug 7 01:35:27 2022] POST /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384/os-volume_attachments => generated 174 bytes in 223 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:35:27.263142 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-43017fbc-1c29-476d-996d-cebedb1f5944 req-5f74d692-877d-4627-a075-56ccf3028bcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afe29183-ebc5-4f1b-af8b-1eb2bbbfffad", "tag": "d21f91e9-787f-44e2-996b-ca2635e32ba6"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:35:27.290955 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-43017fbc-1c29-476d-996d-cebedb1f5944 req-5f74d692-877d-4627-a075-56ccf3028bcf service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:27.297588 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-43017fbc-1c29-476d-996d-cebedb1f5944 req-5f74d692-877d-4627-a075-56ccf3028bcf service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:27.298876 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-43017fbc-1c29-476d-996d-cebedb1f5944 req-5f74d692-877d-4627-a075-56ccf3028bcf service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:27.340844 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-43017fbc-1c29-476d-996d-cebedb1f5944 req-5f74d692-877d-4627-a075-56ccf3028bcf service nova] Creating event network-changed:d21f91e9-787f-44e2-996b-ca2635e32ba6 for instance afe29183-ebc5-4f1b-af8b-1eb2bbbfffad on n-h2-master-1 Aug 07 01:35:27.354610 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-43017fbc-1c29-476d-996d-cebedb1f5944 req-5f74d692-877d-4627-a075-56ccf3028bcf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103925 Aug 07 01:35:27.355699 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2660/4900] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:35:27.362709 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-46f3ad33-cfd4-4537-a2b8-321d177a6e9a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:27.363633 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-46f3ad33-cfd4-4537-a2b8-321d177a6e9a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 57ef5095-2f80-41c5-abc9-ca37439f3384] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:27.374817 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-46f3ad33-cfd4-4537-a2b8-321d177a6e9a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:27.381225 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-46f3ad33-cfd4-4537-a2b8-321d177a6e9a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:27.381225 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-46f3ad33-cfd4-4537-a2b8-321d177a6e9a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:27.382030 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-46f3ad33-cfd4-4537-a2b8-321d177a6e9a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:27.384798 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-46f3ad33-cfd4-4537-a2b8-321d177a6e9a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:27.385515 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-46f3ad33-cfd4-4537-a2b8-321d177a6e9a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:27.445344 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-46f3ad33-cfd4-4537-a2b8-321d177a6e9a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 57ef5095-2f80-41c5-abc9-ca37439f3384] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:35:27.662002 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-46f3ad33-cfd4-4537-a2b8-321d177a6e9a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "DELETE /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384" status: 204 len: 0 microversion: 2.1 time: 0.304650 Aug 07 01:35:27.662601 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2661/4901] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:35:27 2022] DELETE /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:35:27.673559 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-37edd7d5-8147-4cb0-a7ac-d84dbef981fd tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:27.674283 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-37edd7d5-8147-4cb0-a7ac-d84dbef981fd tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] [instance: 1a6ec1ce-d60b-4757-8b95-4c1031876a49] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:27.693091 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-37edd7d5-8147-4cb0-a7ac-d84dbef981fd tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:27.693594 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-37edd7d5-8147-4cb0-a7ac-d84dbef981fd tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:27.694089 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-37edd7d5-8147-4cb0-a7ac-d84dbef981fd tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:27.696029 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-37edd7d5-8147-4cb0-a7ac-d84dbef981fd tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:27.696029 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-37edd7d5-8147-4cb0-a7ac-d84dbef981fd tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:27.696274 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-37edd7d5-8147-4cb0-a7ac-d84dbef981fd tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:29.017676 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-37edd7d5-8147-4cb0-a7ac-d84dbef981fd tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0344a81c981b434689ac476b815b8f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc9ff987bb541d6a11324aaca07182d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:29.039504 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-37edd7d5-8147-4cb0-a7ac-d84dbef981fd tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "GET /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49" status: 200 len: 1504 microversion: 2.1 time: 1.374052 Aug 07 01:35:29.045879 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2662/4902] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:27 2022] GET /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49 => generated 1504 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:29.062820 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-12b5c4d0-c3d3-4f8e-852b-7304f50b05c7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:29.065517 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-12b5c4d0-c3d3-4f8e-852b-7304f50b05c7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 57ef5095-2f80-41c5-abc9-ca37439f3384] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:29.091427 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-12b5c4d0-c3d3-4f8e-852b-7304f50b05c7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:29.095655 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-12b5c4d0-c3d3-4f8e-852b-7304f50b05c7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:29.096488 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-12b5c4d0-c3d3-4f8e-852b-7304f50b05c7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:29.097984 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-12b5c4d0-c3d3-4f8e-852b-7304f50b05c7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:29.106243 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-12b5c4d0-c3d3-4f8e-852b-7304f50b05c7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:29.107522 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-12b5c4d0-c3d3-4f8e-852b-7304f50b05c7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:29.718739 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-12b5c4d0-c3d3-4f8e-852b-7304f50b05c7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:29.733312 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-12b5c4d0-c3d3-4f8e-852b-7304f50b05c7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384" status: 200 len: 1682 microversion: 2.1 time: 0.685529 Aug 07 01:35:29.748046 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2663/4903] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:29 2022] GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384 => generated 1682 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:29.931248 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-d3040633-f766-4c78-83ee-5a89dd984f38 req-536fd6b0-8dab-41c2-93fd-7673d61183d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a6ec1ce-d60b-4757-8b95-4c1031876a49", "name": "network-vif-deleted", "tag": "dde4ebd3-2427-49b7-aca1-1e6c3918c096"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:35:29.963206 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d3040633-f766-4c78-83ee-5a89dd984f38 req-536fd6b0-8dab-41c2-93fd-7673d61183d2 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:29.968333 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d3040633-f766-4c78-83ee-5a89dd984f38 req-536fd6b0-8dab-41c2-93fd-7673d61183d2 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:29.969178 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d3040633-f766-4c78-83ee-5a89dd984f38 req-536fd6b0-8dab-41c2-93fd-7673d61183d2 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:30.002363 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-d3040633-f766-4c78-83ee-5a89dd984f38 req-536fd6b0-8dab-41c2-93fd-7673d61183d2 service nova] Creating event network-vif-deleted:dde4ebd3-2427-49b7-aca1-1e6c3918c096 for instance 1a6ec1ce-d60b-4757-8b95-4c1031876a49 on n-h1-master-1 Aug 07 01:35:30.018802 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-d3040633-f766-4c78-83ee-5a89dd984f38 req-536fd6b0-8dab-41c2-93fd-7673d61183d2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091635 Aug 07 01:35:30.021902 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2664/4904] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:35:30.065801 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-167f99d3-19f0-4c12-8b11-0595e6ac037f tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:30.066817 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-167f99d3-19f0-4c12-8b11-0595e6ac037f tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] [instance: 1a6ec1ce-d60b-4757-8b95-4c1031876a49] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:30.080115 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-167f99d3-19f0-4c12-8b11-0595e6ac037f tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:30.081064 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-167f99d3-19f0-4c12-8b11-0595e6ac037f tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:30.083588 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-167f99d3-19f0-4c12-8b11-0595e6ac037f tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:30.084738 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-167f99d3-19f0-4c12-8b11-0595e6ac037f tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:30.086021 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-167f99d3-19f0-4c12-8b11-0595e6ac037f tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:30.088324 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-167f99d3-19f0-4c12-8b11-0595e6ac037f tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:30.164771 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-167f99d3-19f0-4c12-8b11-0595e6ac037f tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:30.165988 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-167f99d3-19f0-4c12-8b11-0595e6ac037f tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:30.166660 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-167f99d3-19f0-4c12-8b11-0595e6ac037f tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:30.167769 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-167f99d3-19f0-4c12-8b11-0595e6ac037f tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lazy-loading 'fault' on Instance uuid 1a6ec1ce-d60b-4757-8b95-4c1031876a49 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:35:30.416903 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-167f99d3-19f0-4c12-8b11-0595e6ac037f tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0344a81c981b434689ac476b815b8f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc9ff987bb541d6a11324aaca07182d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:30.432117 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-167f99d3-19f0-4c12-8b11-0595e6ac037f tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "GET /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49" status: 200 len: 1303 microversion: 2.1 time: 0.370678 Aug 07 01:35:30.438226 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2665/4905] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:30 2022] GET /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49 => generated 1303 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:30.775094 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6d2f9664-77bf-460f-908c-829dbc540ce3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:30.775912 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6d2f9664-77bf-460f-908c-829dbc540ce3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 57ef5095-2f80-41c5-abc9-ca37439f3384] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:30.795069 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6d2f9664-77bf-460f-908c-829dbc540ce3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:30.800621 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6d2f9664-77bf-460f-908c-829dbc540ce3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:30.801488 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6d2f9664-77bf-460f-908c-829dbc540ce3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:30.806758 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6d2f9664-77bf-460f-908c-829dbc540ce3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:30.807707 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6d2f9664-77bf-460f-908c-829dbc540ce3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:30.808480 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6d2f9664-77bf-460f-908c-829dbc540ce3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:31.180026 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-cc54720c-ba4c-4ab7-98e9-f06fee095e42 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Updating instance_info_cache with network_info: [{"id": "d21f91e9-787f-44e2-996b-ca2635e32ba6", "address": "fa:16:3e:cd:4c:9e", "network": {"id": "adf96141-07d9-42cc-8458-bc4b41607467", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1632315539-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "64c8da97f8334f7da1cd25716cc7da0d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd21f91e9-78", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119517) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 07 01:35:31.188422 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc54720c-ba4c-4ab7-98e9-f06fee095e42 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Releasing lock "refresh_cache-afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" {{(pid=119517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 07 01:35:31.189306 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cc54720c-ba4c-4ab7-98e9-f06fee095e42 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "POST /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad/action" status: 202 len: 0 microversion: 2.1 time: 8.205388 Aug 07 01:35:31.194792 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2241/4906] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:35:22 2022] POST /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad/action => generated 0 bytes in 8211 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 07 01:35:31.208579 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-79d5e659-1c98-4267-a527-92d59620cbae tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '.version_select at 0x7f9e24018700>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:32.358948 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6d2f9664-77bf-460f-908c-829dbc540ce3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:32.383466 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6d2f9664-77bf-460f-908c-829dbc540ce3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384" status: 200 len: 1682 microversion: 2.1 time: 1.611797 Aug 07 01:35:32.403929 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2666/4907] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:30 2022] GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384 => generated 1682 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:32.408197 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0ec6cbdf-0399-4012-9692-e7bffd6a443e tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:32.408197 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0ec6cbdf-0399-4012-9692-e7bffd6a443e tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] [instance: 1a6ec1ce-d60b-4757-8b95-4c1031876a49] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:32.434924 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ec6cbdf-0399-4012-9692-e7bffd6a443e tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:32.435536 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ec6cbdf-0399-4012-9692-e7bffd6a443e tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:32.436121 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ec6cbdf-0399-4012-9692-e7bffd6a443e tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:32.436967 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ec6cbdf-0399-4012-9692-e7bffd6a443e tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:32.437509 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ec6cbdf-0399-4012-9692-e7bffd6a443e tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:32.439135 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0ec6cbdf-0399-4012-9692-e7bffd6a443e tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:32.456984 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-0ec6cbdf-0399-4012-9692-e7bffd6a443e tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] HTTP exception thrown: Instance 1a6ec1ce-d60b-4757-8b95-4c1031876a49 could not be found. Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0ec6cbdf-0399-4012-9692-e7bffd6a443e tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Request method failure captured: Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49 HTTP/1.1 Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xbDNT8wR9vKHczVp-rzrP7CMRe-kHnkRfAoMJKFU2ooXIQ5-Pg05THbmCTgfscmgEYBZuoYumAV-lxBKvHVNFCJmKzbpCqaOQGryWZ9VVM8RNg3LYn9FqOW5I24uLH1Fzm_K9PzOL5EZgIyrO_oO1BzYllNbGVues9Pi3THUynDNYk Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 5bc9ff987bb541d6a11324aaca07182d Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServerGroupTestJSON-463772798 Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5bc9ff987bb541d6a11324aaca07182d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5bc9ff987bb541d6a11324aaca07182d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5bc9ff987bb541d6a11324aaca07182d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5bc9ff987bb541d6a11324aaca07182d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServerGroupTestJSON-463772798 Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 5bc9ff987bb541d6a11324aaca07182d Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServerGroupTestJSON-463772798 Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServerGroupTestJSON-463772798-project Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 0344a81c981b434689ac476b815b8f02 Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServerGroupTestJSON-463772798-project Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 1a6ec1ce-d60b-4757-8b95-4c1031876a49 could not be found. Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '1a6ec1ce-d60b-4757-8b95-4c1031876a49'} Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a6ec1ce-d60b-4757-8b95-4c1031876a49 could not be found. Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a6ec1ce-d60b-4757-8b95-4c1031876a49 could not be found. Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:35:32.458925 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:32.463765 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:32.463765 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:35:32.463765 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:35:32.463765 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:35:32.463765 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:35:32.463765 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a6ec1ce-d60b-4757-8b95-4c1031876a49 could not be found. Aug 07 01:35:32.463765 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:32.463765 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0ec6cbdf-0399-4012-9692-e7bffd6a443e tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Returning 404 to user: Instance 1a6ec1ce-d60b-4757-8b95-4c1031876a49 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:35:32.463765 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0ec6cbdf-0399-4012-9692-e7bffd6a443e tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "GET /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49" status: 404 len: 111 microversion: 2.1 time: 0.065660 Aug 07 01:35:32.467965 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2667/4908] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:32 2022] GET /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:35:32.475537 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-141deb0d-5d27-4974-8417-9de16f6385f6 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:32.496411 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.compute.server_groups [None req-141deb0d-5d27-4974-8417-9de16f6385f6 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Querying cell 946acc3b-7b72-45d6-9151-44f3ad85fe4f(cell1) for 1 instances {{(pid=119516) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 07 01:35:32.497486 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-141deb0d-5d27-4974-8417-9de16f6385f6 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:32.498119 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-141deb0d-5d27-4974-8417-9de16f6385f6 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:32.498832 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-141deb0d-5d27-4974-8417-9de16f6385f6 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:32.528194 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-141deb0d-5d27-4974-8417-9de16f6385f6 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.058696 Aug 07 01:35:32.537937 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2668/4909] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Aug 7 01:35:32 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:35:32.549534 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a87d2e19-e60e-4596-84f6-197ad25d15d6 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:32.567698 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.compute.server_groups [None req-a87d2e19-e60e-4596-84f6-197ad25d15d6 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Querying cell 946acc3b-7b72-45d6-9151-44f3ad85fe4f(cell1) for 1 instances {{(pid=119516) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 07 01:35:32.568725 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a87d2e19-e60e-4596-84f6-197ad25d15d6 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:32.569435 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a87d2e19-e60e-4596-84f6-197ad25d15d6 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:32.570585 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a87d2e19-e60e-4596-84f6-197ad25d15d6 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:32.584116 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a87d2e19-e60e-4596-84f6-197ad25d15d6 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups/53f6a54a-7637-431b-96ac-514331db59ba" status: 200 len: 183 microversion: 2.1 time: 0.044034 Aug 07 01:35:32.586261 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2669/4910] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Aug 7 01:35:32 2022] GET /compute/v2.1/os-server-groups/53f6a54a-7637-431b-96ac-514331db59ba => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:35:32.596499 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-69030efb-aac7-4548-8766-dfb787bdb4f2 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:32.597006 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-69030efb-aac7-4548-8766-dfb787bdb4f2 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] [instance: 1a6ec1ce-d60b-4757-8b95-4c1031876a49] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:32.603472 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-69030efb-aac7-4548-8766-dfb787bdb4f2 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:32.603975 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-69030efb-aac7-4548-8766-dfb787bdb4f2 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:32.604425 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-69030efb-aac7-4548-8766-dfb787bdb4f2 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:32.605223 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-69030efb-aac7-4548-8766-dfb787bdb4f2 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:32.605587 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-69030efb-aac7-4548-8766-dfb787bdb4f2 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:32.606017 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-69030efb-aac7-4548-8766-dfb787bdb4f2 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:32.621915 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-69030efb-aac7-4548-8766-dfb787bdb4f2 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] HTTP exception thrown: Instance 1a6ec1ce-d60b-4757-8b95-4c1031876a49 could not be found. Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-69030efb-aac7-4548-8766-dfb787bdb4f2 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Request method failure captured: Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49 HTTP/1.1 Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xbDNT8wR9vKHczVp-rzrP7CMRe-kHnkRfAoMJKFU2ooXIQ5-Pg05THbmCTgfscmgEYBZuoYumAV-lxBKvHVNFCJmKzbpCqaOQGryWZ9VVM8RNg3LYn9FqOW5I24uLH1Fzm_K9PzOL5EZgIyrO_oO1BzYllNbGVues9Pi3THUynDNYk Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 5bc9ff987bb541d6a11324aaca07182d Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServerGroupTestJSON-463772798 Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5bc9ff987bb541d6a11324aaca07182d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5bc9ff987bb541d6a11324aaca07182d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5bc9ff987bb541d6a11324aaca07182d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5bc9ff987bb541d6a11324aaca07182d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServerGroupTestJSON-463772798 Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 5bc9ff987bb541d6a11324aaca07182d Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServerGroupTestJSON-463772798 Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServerGroupTestJSON-463772798-project Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 0344a81c981b434689ac476b815b8f02 Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServerGroupTestJSON-463772798-project Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 1a6ec1ce-d60b-4757-8b95-4c1031876a49 could not be found. Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '1a6ec1ce-d60b-4757-8b95-4c1031876a49'} Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a6ec1ce-d60b-4757-8b95-4c1031876a49 could not be found. Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:35:32.624534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:35:32.629798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a6ec1ce-d60b-4757-8b95-4c1031876a49 could not be found. Aug 07 01:35:32.629798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:32.629798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:35:32.629798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:32.629798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:32.629798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:35:32.629798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:35:32.629798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:35:32.629798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:35:32.629798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a6ec1ce-d60b-4757-8b95-4c1031876a49 could not be found. Aug 07 01:35:32.629798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:32.631503 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-69030efb-aac7-4548-8766-dfb787bdb4f2 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Returning 404 to user: Instance 1a6ec1ce-d60b-4757-8b95-4c1031876a49 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:35:32.633381 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-69030efb-aac7-4548-8766-dfb787bdb4f2 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49" status: 404 len: 111 microversion: 2.1 time: 0.040928 Aug 07 01:35:32.637841 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2670/4911] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:35:32 2022] DELETE /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:35:32.644681 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2dbf5940-d422-435a-b9fa-a0b0e3cac39c tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:32.645518 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2dbf5940-d422-435a-b9fa-a0b0e3cac39c tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] [instance: 1a6ec1ce-d60b-4757-8b95-4c1031876a49] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:32.652155 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2dbf5940-d422-435a-b9fa-a0b0e3cac39c tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:32.652942 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2dbf5940-d422-435a-b9fa-a0b0e3cac39c tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:32.653551 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2dbf5940-d422-435a-b9fa-a0b0e3cac39c tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:32.654778 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2dbf5940-d422-435a-b9fa-a0b0e3cac39c tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:32.655422 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2dbf5940-d422-435a-b9fa-a0b0e3cac39c tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:32.656373 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2dbf5940-d422-435a-b9fa-a0b0e3cac39c tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:32.686492 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-2dbf5940-d422-435a-b9fa-a0b0e3cac39c tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] HTTP exception thrown: Instance 1a6ec1ce-d60b-4757-8b95-4c1031876a49 could not be found. Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2dbf5940-d422-435a-b9fa-a0b0e3cac39c tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Request method failure captured: Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49 HTTP/1.1 Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xbDNT8wR9vKHczVp-rzrP7CMRe-kHnkRfAoMJKFU2ooXIQ5-Pg05THbmCTgfscmgEYBZuoYumAV-lxBKvHVNFCJmKzbpCqaOQGryWZ9VVM8RNg3LYn9FqOW5I24uLH1Fzm_K9PzOL5EZgIyrO_oO1BzYllNbGVues9Pi3THUynDNYk Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 5bc9ff987bb541d6a11324aaca07182d Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServerGroupTestJSON-463772798 Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5bc9ff987bb541d6a11324aaca07182d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5bc9ff987bb541d6a11324aaca07182d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5bc9ff987bb541d6a11324aaca07182d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5bc9ff987bb541d6a11324aaca07182d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServerGroupTestJSON-463772798 Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 5bc9ff987bb541d6a11324aaca07182d Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServerGroupTestJSON-463772798 Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServerGroupTestJSON-463772798-project Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 0344a81c981b434689ac476b815b8f02 Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServerGroupTestJSON-463772798-project Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 1a6ec1ce-d60b-4757-8b95-4c1031876a49 could not be found. Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '1a6ec1ce-d60b-4757-8b95-4c1031876a49'} Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a6ec1ce-d60b-4757-8b95-4c1031876a49 could not be found. Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a6ec1ce-d60b-4757-8b95-4c1031876a49 could not be found. Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:35:32.688361 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:32.693374 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:32.693374 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:35:32.693374 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:35:32.693374 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:35:32.693374 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:35:32.693374 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a6ec1ce-d60b-4757-8b95-4c1031876a49 could not be found. Aug 07 01:35:32.693374 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:32.696965 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2dbf5940-d422-435a-b9fa-a0b0e3cac39c tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Returning 404 to user: Instance 1a6ec1ce-d60b-4757-8b95-4c1031876a49 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:35:32.698013 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2dbf5940-d422-435a-b9fa-a0b0e3cac39c tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "GET /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49" status: 404 len: 111 microversion: 2.1 time: 0.058206 Aug 07 01:35:32.702353 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2671/4912] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:32 2022] GET /compute/v2.1/servers/1a6ec1ce-d60b-4757-8b95-4c1031876a49 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:35:32.708658 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-19e2c8fb-27c6-4e89-936e-71a3d504f751 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:32.715828 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-19e2c8fb-27c6-4e89-936e-71a3d504f751 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] HTTP exception thrown: Instance group ebb3d13f-93ab-4619-85ff-cfa8e3ef3764 could not be found. Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-19e2c8fb-27c6-4e89-936e-71a3d504f751 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Request method failure captured: Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/os-server-groups/ebb3d13f-93ab-4619-85ff-cfa8e3ef3764 HTTP/1.1 Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xbDNT8wR9vKHczVp-rzrP7CMRe-kHnkRfAoMJKFU2ooXIQ5-Pg05THbmCTgfscmgEYBZuoYumAV-lxBKvHVNFCJmKzbpCqaOQGryWZ9VVM8RNg3LYn9FqOW5I24uLH1Fzm_K9PzOL5EZgIyrO_oO1BzYllNbGVues9Pi3THUynDNYk Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 5bc9ff987bb541d6a11324aaca07182d Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServerGroupTestJSON-463772798 Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5bc9ff987bb541d6a11324aaca07182d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5bc9ff987bb541d6a11324aaca07182d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5bc9ff987bb541d6a11324aaca07182d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5bc9ff987bb541d6a11324aaca07182d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServerGroupTestJSON-463772798 Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 5bc9ff987bb541d6a11324aaca07182d Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServerGroupTestJSON-463772798 Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServerGroupTestJSON-463772798-project Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 0344a81c981b434689ac476b815b8f02 Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServerGroupTestJSON-463772798-project Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: exception: Instance group ebb3d13f-93ab-4619-85ff-cfa8e3ef3764 could not be found. Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'ebb3d13f-93ab-4619-85ff-cfa8e3ef3764'} Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ebb3d13f-93ab-4619-85ff-cfa8e3ef3764 could not be found. Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ebb3d13f-93ab-4619-85ff-cfa8e3ef3764 could not be found. Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:32.717798 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:32.722720 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:35:32.722720 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:35:32.722720 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:35:32.722720 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:35:32.722720 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ebb3d13f-93ab-4619-85ff-cfa8e3ef3764 could not be found. Aug 07 01:35:32.722720 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:32.725009 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-19e2c8fb-27c6-4e89-936e-71a3d504f751 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Returning 404 to user: Instance group ebb3d13f-93ab-4619-85ff-cfa8e3ef3764 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:35:32.726600 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-19e2c8fb-27c6-4e89-936e-71a3d504f751 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/ebb3d13f-93ab-4619-85ff-cfa8e3ef3764" status: 404 len: 117 microversion: 2.1 time: 0.021905 Aug 07 01:35:32.731826 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2672/4913] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Aug 7 01:35:32 2022] DELETE /compute/v2.1/os-server-groups/ebb3d13f-93ab-4619-85ff-cfa8e3ef3764 => generated 117 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:35:32.737675 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-79a94640-eb02-41cf-b553-f12f114f3b54 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:32.748885 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-79a94640-eb02-41cf-b553-f12f114f3b54 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] HTTP exception thrown: Instance group 6e64115a-1a3e-4e80-9d37-e606d4b135a5 could not be found. Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-79a94640-eb02-41cf-b553-f12f114f3b54 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Request method failure captured: Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/os-server-groups/6e64115a-1a3e-4e80-9d37-e606d4b135a5 HTTP/1.1 Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xbDNT8wR9vKHczVp-rzrP7CMRe-kHnkRfAoMJKFU2ooXIQ5-Pg05THbmCTgfscmgEYBZuoYumAV-lxBKvHVNFCJmKzbpCqaOQGryWZ9VVM8RNg3LYn9FqOW5I24uLH1Fzm_K9PzOL5EZgIyrO_oO1BzYllNbGVues9Pi3THUynDNYk Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 5bc9ff987bb541d6a11324aaca07182d Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServerGroupTestJSON-463772798 Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5bc9ff987bb541d6a11324aaca07182d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5bc9ff987bb541d6a11324aaca07182d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5bc9ff987bb541d6a11324aaca07182d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5bc9ff987bb541d6a11324aaca07182d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServerGroupTestJSON-463772798 Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 5bc9ff987bb541d6a11324aaca07182d Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServerGroupTestJSON-463772798 Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServerGroupTestJSON-463772798-project Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 0344a81c981b434689ac476b815b8f02 Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServerGroupTestJSON-463772798-project Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: exception: Instance group 6e64115a-1a3e-4e80-9d37-e606d4b135a5 could not be found. Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '6e64115a-1a3e-4e80-9d37-e606d4b135a5'} Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 6e64115a-1a3e-4e80-9d37-e606d4b135a5 could not be found. Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 6e64115a-1a3e-4e80-9d37-e606d4b135a5 could not be found. Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:32.750781 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:32.755600 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:35:32.755600 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:35:32.755600 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:35:32.755600 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:35:32.755600 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 6e64115a-1a3e-4e80-9d37-e606d4b135a5 could not be found. Aug 07 01:35:32.755600 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:32.757425 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-79a94640-eb02-41cf-b553-f12f114f3b54 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Returning 404 to user: Instance group 6e64115a-1a3e-4e80-9d37-e606d4b135a5 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:35:32.758593 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-79a94640-eb02-41cf-b553-f12f114f3b54 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/6e64115a-1a3e-4e80-9d37-e606d4b135a5" status: 404 len: 117 microversion: 2.1 time: 0.025254 Aug 07 01:35:32.759366 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2673/4914] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Aug 7 01:35:32 2022] DELETE /compute/v2.1/os-server-groups/6e64115a-1a3e-4e80-9d37-e606d4b135a5 => generated 117 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:35:32.773824 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8ee7d405-1540-429e-a66b-047b3abbbc09 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:32.785615 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-8ee7d405-1540-429e-a66b-047b3abbbc09 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] HTTP exception thrown: Instance group 3c9e2db7-7b44-4b73-8d8a-7df67e80f0f7 could not be found. Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8ee7d405-1540-429e-a66b-047b3abbbc09 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Request method failure captured: Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/os-server-groups/3c9e2db7-7b44-4b73-8d8a-7df67e80f0f7 HTTP/1.1 Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xbDNT8wR9vKHczVp-rzrP7CMRe-kHnkRfAoMJKFU2ooXIQ5-Pg05THbmCTgfscmgEYBZuoYumAV-lxBKvHVNFCJmKzbpCqaOQGryWZ9VVM8RNg3LYn9FqOW5I24uLH1Fzm_K9PzOL5EZgIyrO_oO1BzYllNbGVues9Pi3THUynDNYk Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 5bc9ff987bb541d6a11324aaca07182d Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServerGroupTestJSON-463772798 Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5bc9ff987bb541d6a11324aaca07182d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5bc9ff987bb541d6a11324aaca07182d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5bc9ff987bb541d6a11324aaca07182d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5bc9ff987bb541d6a11324aaca07182d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServerGroupTestJSON-463772798 Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 5bc9ff987bb541d6a11324aaca07182d Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServerGroupTestJSON-463772798 Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServerGroupTestJSON-463772798-project Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 0344a81c981b434689ac476b815b8f02 Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServerGroupTestJSON-463772798-project Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: exception: Instance group 3c9e2db7-7b44-4b73-8d8a-7df67e80f0f7 could not be found. Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '3c9e2db7-7b44-4b73-8d8a-7df67e80f0f7'} Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 3c9e2db7-7b44-4b73-8d8a-7df67e80f0f7 could not be found. Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 3c9e2db7-7b44-4b73-8d8a-7df67e80f0f7 could not be found. Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:32.788739 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:32.793580 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:35:32.793580 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:35:32.793580 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:35:32.793580 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:35:32.793580 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 3c9e2db7-7b44-4b73-8d8a-7df67e80f0f7 could not be found. Aug 07 01:35:32.793580 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:32.794239 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8ee7d405-1540-429e-a66b-047b3abbbc09 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Returning 404 to user: Instance group 3c9e2db7-7b44-4b73-8d8a-7df67e80f0f7 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:35:32.800388 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8ee7d405-1540-429e-a66b-047b3abbbc09 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/3c9e2db7-7b44-4b73-8d8a-7df67e80f0f7" status: 404 len: 117 microversion: 2.1 time: 0.030560 Aug 07 01:35:32.800388 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2674/4915] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Aug 7 01:35:32 2022] DELETE /compute/v2.1/os-server-groups/3c9e2db7-7b44-4b73-8d8a-7df67e80f0f7 => generated 117 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:35:32.806317 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2678c384-fb40-4e17-b757-55b8d11452de tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:32.814994 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-2678c384-fb40-4e17-b757-55b8d11452de tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] HTTP exception thrown: Instance group 5e4bd4a4-290e-4b10-b9a1-a30940626ea2 could not be found. Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2678c384-fb40-4e17-b757-55b8d11452de tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Request method failure captured: Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/os-server-groups/5e4bd4a4-290e-4b10-b9a1-a30940626ea2 HTTP/1.1 Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xbDNT8wR9vKHczVp-rzrP7CMRe-kHnkRfAoMJKFU2ooXIQ5-Pg05THbmCTgfscmgEYBZuoYumAV-lxBKvHVNFCJmKzbpCqaOQGryWZ9VVM8RNg3LYn9FqOW5I24uLH1Fzm_K9PzOL5EZgIyrO_oO1BzYllNbGVues9Pi3THUynDNYk Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 5bc9ff987bb541d6a11324aaca07182d Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServerGroupTestJSON-463772798 Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5bc9ff987bb541d6a11324aaca07182d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5bc9ff987bb541d6a11324aaca07182d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5bc9ff987bb541d6a11324aaca07182d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5bc9ff987bb541d6a11324aaca07182d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServerGroupTestJSON-463772798 Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 5bc9ff987bb541d6a11324aaca07182d Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServerGroupTestJSON-463772798 Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServerGroupTestJSON-463772798-project Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 0344a81c981b434689ac476b815b8f02 Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServerGroupTestJSON-463772798-project Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: exception: Instance group 5e4bd4a4-290e-4b10-b9a1-a30940626ea2 could not be found. Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '5e4bd4a4-290e-4b10-b9a1-a30940626ea2'} Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 5e4bd4a4-290e-4b10-b9a1-a30940626ea2 could not be found. Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 5e4bd4a4-290e-4b10-b9a1-a30940626ea2 could not be found. Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:32.817083 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:32.821388 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:35:32.821388 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:35:32.821388 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:35:32.821388 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:35:32.821388 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 5e4bd4a4-290e-4b10-b9a1-a30940626ea2 could not be found. Aug 07 01:35:32.821388 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:32.826859 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2678c384-fb40-4e17-b757-55b8d11452de tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Returning 404 to user: Instance group 5e4bd4a4-290e-4b10-b9a1-a30940626ea2 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:35:32.828007 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2678c384-fb40-4e17-b757-55b8d11452de tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/5e4bd4a4-290e-4b10-b9a1-a30940626ea2" status: 404 len: 117 microversion: 2.1 time: 0.026890 Aug 07 01:35:32.832075 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2675/4916] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Aug 7 01:35:32 2022] DELETE /compute/v2.1/os-server-groups/5e4bd4a4-290e-4b10-b9a1-a30940626ea2 => generated 117 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:35:32.837923 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6f3f21f7-2f02-49ef-a2f9-abbf220d6ba3 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:32.875418 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6f3f21f7-2f02-49ef-a2f9-abbf220d6ba3 tempest-ServerGroupTestJSON-463772798 tempest-ServerGroupTestJSON-463772798-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/53f6a54a-7637-431b-96ac-514331db59ba" status: 204 len: 0 microversion: 2.1 time: 0.041877 Aug 07 01:35:32.878751 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2676/4917] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Aug 7 01:35:32 2022] DELETE /compute/v2.1/os-server-groups/53f6a54a-7637-431b-96ac-514331db59ba => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:35:32.953336 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-9c927305-103d-4c7a-9d62-acb464c5025b req-ea64d0ea-3744-4e57-aa89-43e15a5bae7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57ef5095-2f80-41c5-abc9-ca37439f3384", "name": "network-vif-unplugged", "status": "completed", "tag": "d4ad23ab-8771-4aec-b8a5-442eb0265864"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:35:33.012982 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:33.024719 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-9c927305-103d-4c7a-9d62-acb464c5025b req-ea64d0ea-3744-4e57-aa89-43e15a5bae7a service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:33.025667 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-9c927305-103d-4c7a-9d62-acb464c5025b req-ea64d0ea-3744-4e57-aa89-43e15a5bae7a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:33.027829 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-9c927305-103d-4c7a-9d62-acb464c5025b req-ea64d0ea-3744-4e57-aa89-43e15a5bae7a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:33.072644 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-9c927305-103d-4c7a-9d62-acb464c5025b req-ea64d0ea-3744-4e57-aa89-43e15a5bae7a service nova] Creating event network-vif-unplugged:d4ad23ab-8771-4aec-b8a5-442eb0265864 for instance 57ef5095-2f80-41c5-abc9-ca37439f3384 on n-h1-master-1 Aug 07 01:35:33.093554 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-9c927305-103d-4c7a-9d62-acb464c5025b req-ea64d0ea-3744-4e57-aa89-43e15a5bae7a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.145274 Aug 07 01:35:33.097035 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2677/4918] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:35:33.417060 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0bacd590-6f72-4918-9388-f026bfa7aa50 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:33.419026 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0bacd590-6f72-4918-9388-f026bfa7aa50 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 57ef5095-2f80-41c5-abc9-ca37439f3384] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:33.435489 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0bacd590-6f72-4918-9388-f026bfa7aa50 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:33.437834 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0bacd590-6f72-4918-9388-f026bfa7aa50 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:33.438415 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0bacd590-6f72-4918-9388-f026bfa7aa50 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:33.439327 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0bacd590-6f72-4918-9388-f026bfa7aa50 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:33.440751 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0bacd590-6f72-4918-9388-f026bfa7aa50 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:33.441305 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0bacd590-6f72-4918-9388-f026bfa7aa50 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:33.484090 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:34.029314 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0bacd590-6f72-4918-9388-f026bfa7aa50 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:34.041409 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0bacd590-6f72-4918-9388-f026bfa7aa50 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384" status: 200 len: 1682 microversion: 2.1 time: 0.628963 Aug 07 01:35:34.042501 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2678/4919] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:33 2022] GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384 => generated 1682 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:35.064282 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f41e98e5-3f7f-4bb9-9e14-b807157dcaf2 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:35.065918 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f41e98e5-3f7f-4bb9-9e14-b807157dcaf2 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 57ef5095-2f80-41c5-abc9-ca37439f3384] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:35.074121 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f41e98e5-3f7f-4bb9-9e14-b807157dcaf2 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:35.075522 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f41e98e5-3f7f-4bb9-9e14-b807157dcaf2 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:35.076155 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f41e98e5-3f7f-4bb9-9e14-b807157dcaf2 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:35.077191 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f41e98e5-3f7f-4bb9-9e14-b807157dcaf2 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:35.078108 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f41e98e5-3f7f-4bb9-9e14-b807157dcaf2 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:35.078694 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f41e98e5-3f7f-4bb9-9e14-b807157dcaf2 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:35.931977 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f41e98e5-3f7f-4bb9-9e14-b807157dcaf2 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:35.969480 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f41e98e5-3f7f-4bb9-9e14-b807157dcaf2 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384" status: 200 len: 1614 microversion: 2.1 time: 0.905288 Aug 07 01:35:35.980023 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2679/4920] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:35 2022] GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384 => generated 1614 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:35:35.988147 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-f3a00440-15f6-4e0f-880b-992d00e7e4bc req-16c8795e-c4fb-4d45-a17c-da3f8deb5977 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57ef5095-2f80-41c5-abc9-ca37439f3384", "name": "network-vif-deleted", "tag": "d4ad23ab-8771-4aec-b8a5-442eb0265864"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:35:36.029050 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f3a00440-15f6-4e0f-880b-992d00e7e4bc req-16c8795e-c4fb-4d45-a17c-da3f8deb5977 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:36.029545 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f3a00440-15f6-4e0f-880b-992d00e7e4bc req-16c8795e-c4fb-4d45-a17c-da3f8deb5977 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:36.029991 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f3a00440-15f6-4e0f-880b-992d00e7e4bc req-16c8795e-c4fb-4d45-a17c-da3f8deb5977 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:36.056461 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-79d5e659-1c98-4267-a527-92d59620cbae tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/efae9cb3-a314-4c60-97c0-28882c74953a" status: 202 len: 0 microversion: 2.1 time: 4.858708 Aug 07 01:35:36.057084 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2242/4921] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Aug 7 01:35:31 2022] DELETE /compute/v2.1/os-floating-ips/efae9cb3-a314-4c60-97c0-28882c74953a => generated 0 bytes in 4860 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:35:36.067262 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a93a765e-d5c5-4969-a139-615bc7583cfd tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '.version_select at 0x7f9e29a2f3a0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:36.074738 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-f3a00440-15f6-4e0f-880b-992d00e7e4bc req-16c8795e-c4fb-4d45-a17c-da3f8deb5977 service nova] Creating event network-vif-deleted:d4ad23ab-8771-4aec-b8a5-442eb0265864 for instance 57ef5095-2f80-41c5-abc9-ca37439f3384 on n-h1-master-1 Aug 07 01:35:36.079787 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-f3a00440-15f6-4e0f-880b-992d00e7e4bc req-16c8795e-c4fb-4d45-a17c-da3f8deb5977 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108424 Aug 07 01:35:36.080839 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2680/4922] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:35:37.001388 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4d75957b-ada1-4b7e-b9c1-034777346e81 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:37.002100 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4d75957b-ada1-4b7e-b9c1-034777346e81 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 57ef5095-2f80-41c5-abc9-ca37439f3384] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:37.009161 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d75957b-ada1-4b7e-b9c1-034777346e81 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:37.020272 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d75957b-ada1-4b7e-b9c1-034777346e81 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:37.023014 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d75957b-ada1-4b7e-b9c1-034777346e81 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:37.042003 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d75957b-ada1-4b7e-b9c1-034777346e81 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:37.045485 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d75957b-ada1-4b7e-b9c1-034777346e81 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:37.050931 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d75957b-ada1-4b7e-b9c1-034777346e81 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:37.085936 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-4d75957b-ada1-4b7e-b9c1-034777346e81 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] HTTP exception thrown: Instance 57ef5095-2f80-41c5-abc9-ca37439f3384 could not be found. Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4d75957b-ada1-4b7e-b9c1-034777346e81 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Request method failure captured: Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384 HTTP/1.1 Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xZDq6RH3D4bnr1UijP-nk3uo95NJjh7SbfPDqAVgj126rgmdcLbKlTvq4r9AHLnAVbqooFNQ3b97yry4NtGcTnZJETXBytnxiV1irP15oNSC1nhov4fsRvKuKlTNLjRN8RkNUdoouf8PCfkhvGYmSqoJN36Q7GHr7rf2nNkd41nqV4 Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: b630a4c3bb824b90b4c1898a92b47aa7 Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b630a4c3bb824b90b4c1898a92b47aa7", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: b630a4c3bb824b90b4c1898a92b47aa7 Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-AttachVolumeNegativeTest-1422960247-project Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: d556a8ae0d524894a93203ce3f70d420 Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-AttachVolumeNegativeTest-1422960247-project Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 57ef5095-2f80-41c5-abc9-ca37439f3384 could not be found. Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '57ef5095-2f80-41c5-abc9-ca37439f3384'} Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57ef5095-2f80-41c5-abc9-ca37439f3384 could not be found. Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57ef5095-2f80-41c5-abc9-ca37439f3384 could not be found. Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:35:37.090534 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:37.101745 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:37.101745 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:35:37.101745 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:35:37.101745 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:35:37.101745 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:35:37.101745 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57ef5095-2f80-41c5-abc9-ca37439f3384 could not be found. Aug 07 01:35:37.101745 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:37.109684 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4d75957b-ada1-4b7e-b9c1-034777346e81 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Returning 404 to user: Instance 57ef5095-2f80-41c5-abc9-ca37439f3384 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:35:37.123119 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4d75957b-ada1-4b7e-b9c1-034777346e81 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384" status: 404 len: 111 microversion: 2.1 time: 0.122760 Aug 07 01:35:37.124408 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2681/4923] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:36 2022] GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:35:37.136608 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-20d45c98-3c11-44ee-96f8-bc29441e958c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '.version_select at 0x7f9e170d00d0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:37.180939 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-20d45c98-3c11-44ee-96f8-bc29441e958c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1057754462" status: 202 len: 0 microversion: 2.1 time: 0.051374 Aug 07 01:35:37.182216 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2682/4924] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Aug 7 01:35:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1057754462 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:35:37.359834 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a93a765e-d5c5-4969-a139-615bc7583cfd tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/0add019e-7ae2-4ea2-986b-fb4b13743f88" status: 202 len: 0 microversion: 2.1 time: 1.297585 Aug 07 01:35:37.361288 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2243/4925] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 01:35:36 2022] DELETE /compute/v2.1/os-security-groups/0add019e-7ae2-4ea2-986b-fb4b13743f88 => generated 0 bytes in 1300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 01:35:37.369799 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5dea2a0f-d3b9-4ffd-9d7e-75be54e5bd63 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:37.370735 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5dea2a0f-d3b9-4ffd-9d7e-75be54e5bd63 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:37.382189 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5dea2a0f-d3b9-4ffd-9d7e-75be54e5bd63 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:37.382692 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5dea2a0f-d3b9-4ffd-9d7e-75be54e5bd63 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:37.388679 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5dea2a0f-d3b9-4ffd-9d7e-75be54e5bd63 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:37.389479 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5dea2a0f-d3b9-4ffd-9d7e-75be54e5bd63 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:37.390569 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5dea2a0f-d3b9-4ffd-9d7e-75be54e5bd63 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:37.393133 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5dea2a0f-d3b9-4ffd-9d7e-75be54e5bd63 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:37.407985 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:37.485136 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5dea2a0f-d3b9-4ffd-9d7e-75be54e5bd63 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:35:37.701077 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5dea2a0f-d3b9-4ffd-9d7e-75be54e5bd63 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "DELETE /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 204 len: 0 microversion: 2.1 time: 0.335252 Aug 07 01:35:37.702099 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2683/4926] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:35:37 2022] DELETE /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:35:37.713316 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-201bdf01-6f90-4fcc-b4af-49ae1a788d3b tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:37.713958 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-201bdf01-6f90-4fcc-b4af-49ae1a788d3b tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:37.729994 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-201bdf01-6f90-4fcc-b4af-49ae1a788d3b tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:37.730540 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-201bdf01-6f90-4fcc-b4af-49ae1a788d3b tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:37.730978 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-201bdf01-6f90-4fcc-b4af-49ae1a788d3b tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:37.731867 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-201bdf01-6f90-4fcc-b4af-49ae1a788d3b tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:37.732368 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-201bdf01-6f90-4fcc-b4af-49ae1a788d3b tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:37.732795 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-201bdf01-6f90-4fcc-b4af-49ae1a788d3b tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:37.745436 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=82,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=1,nova_cell1:RELEASE=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:38.830618 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-201bdf01-6f90-4fcc-b4af-49ae1a788d3b tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:38.840830 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-201bdf01-6f90-4fcc-b4af-49ae1a788d3b tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1510 microversion: 2.1 time: 1.132709 Aug 07 01:35:38.841706 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2244/4927] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:37 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1510 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:39.706654 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3eec6844-4761-406d-a0f0-abb07c3f26f3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:39.708189 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3eec6844-4761-406d-a0f0-abb07c3f26f3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:39.727476 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3eec6844-4761-406d-a0f0-abb07c3f26f3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:39.728304 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3eec6844-4761-406d-a0f0-abb07c3f26f3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:39.728754 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3eec6844-4761-406d-a0f0-abb07c3f26f3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:39.729492 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3eec6844-4761-406d-a0f0-abb07c3f26f3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:39.729948 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3eec6844-4761-406d-a0f0-abb07c3f26f3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:39.730373 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3eec6844-4761-406d-a0f0-abb07c3f26f3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:39.863432 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-093a769e-f87c-4ef9-a6a7-e4f91fa6b965 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:39.864196 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-093a769e-f87c-4ef9-a6a7-e4f91fa6b965 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:39.877715 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-093a769e-f87c-4ef9-a6a7-e4f91fa6b965 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:39.884592 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-093a769e-f87c-4ef9-a6a7-e4f91fa6b965 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:39.885303 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-093a769e-f87c-4ef9-a6a7-e4f91fa6b965 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:39.886181 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-093a769e-f87c-4ef9-a6a7-e4f91fa6b965 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:39.886896 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-093a769e-f87c-4ef9-a6a7-e4f91fa6b965 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:39.887811 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-093a769e-f87c-4ef9-a6a7-e4f91fa6b965 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:39.898533 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-3eec6844-4761-406d-a0f0-abb07c3f26f3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lazy-loading 'services' on Instance uuid 2778f5f5-ea59-43c9-860f-17210bcbbbd2 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:35:40.066981 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3eec6844-4761-406d-a0f0-abb07c3f26f3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2/os-volume_attachments/872b66d8-b72e-4dee-8a6d-9d1c0e3771e1" status: 202 len: 0 microversion: 2.1 time: 0.363520 Aug 07 01:35:40.069162 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2684/4928] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Aug 7 01:35:39 2022] DELETE /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2/os-volume_attachments/872b66d8-b72e-4dee-8a6d-9d1c0e3771e1 => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:35:40.078662 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0b31f1a9-0689-43fc-9c0b-b96d4747d81e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:40.082111 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0b31f1a9-0689-43fc-9c0b-b96d4747d81e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:40.090379 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b31f1a9-0689-43fc-9c0b-b96d4747d81e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:40.091467 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b31f1a9-0689-43fc-9c0b-b96d4747d81e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:40.092113 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b31f1a9-0689-43fc-9c0b-b96d4747d81e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:40.093182 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b31f1a9-0689-43fc-9c0b-b96d4747d81e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:40.093984 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b31f1a9-0689-43fc-9c0b-b96d4747d81e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:40.094657 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b31f1a9-0689-43fc-9c0b-b96d4747d81e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:40.131088 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0b31f1a9-0689-43fc-9c0b-b96d4747d81e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056834 Aug 07 01:35:40.138644 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2685/4929] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:35:40 2022] GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:35:40.728569 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-093a769e-f87c-4ef9-a6a7-e4f91fa6b965 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:40.742519 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-093a769e-f87c-4ef9-a6a7-e4f91fa6b965 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1510 microversion: 2.1 time: 0.883945 Aug 07 01:35:40.743408 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2245/4930] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:39 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1510 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:41.144661 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1f8dd78e-5a65-49a1-9304-071d55ea7c77 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:41.149185 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1f8dd78e-5a65-49a1-9304-071d55ea7c77 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:41.172679 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f8dd78e-5a65-49a1-9304-071d55ea7c77 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:41.173464 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f8dd78e-5a65-49a1-9304-071d55ea7c77 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:41.174061 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f8dd78e-5a65-49a1-9304-071d55ea7c77 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:41.174959 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f8dd78e-5a65-49a1-9304-071d55ea7c77 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:41.175573 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f8dd78e-5a65-49a1-9304-071d55ea7c77 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:41.176201 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f8dd78e-5a65-49a1-9304-071d55ea7c77 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:41.238100 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1f8dd78e-5a65-49a1-9304-071d55ea7c77 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097963 Aug 07 01:35:41.244718 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2686/4931] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:35:41 2022] GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:35:41.768327 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-66f9f50d-91fd-4631-9000-44825ec0d112 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:41.769545 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-66f9f50d-91fd-4631-9000-44825ec0d112 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:41.782128 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-66f9f50d-91fd-4631-9000-44825ec0d112 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:41.785009 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-66f9f50d-91fd-4631-9000-44825ec0d112 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:41.787103 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-66f9f50d-91fd-4631-9000-44825ec0d112 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:41.790015 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-66f9f50d-91fd-4631-9000-44825ec0d112 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:41.791069 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-66f9f50d-91fd-4631-9000-44825ec0d112 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:41.791711 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-66f9f50d-91fd-4631-9000-44825ec0d112 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:42.252107 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4f16ccb1-b2f2-469f-a550-8bceb6a46a70 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:42.254348 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4f16ccb1-b2f2-469f-a550-8bceb6a46a70 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:42.273735 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f16ccb1-b2f2-469f-a550-8bceb6a46a70 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:42.274302 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f16ccb1-b2f2-469f-a550-8bceb6a46a70 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:42.280342 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f16ccb1-b2f2-469f-a550-8bceb6a46a70 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:42.281326 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f16ccb1-b2f2-469f-a550-8bceb6a46a70 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:42.281822 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f16ccb1-b2f2-469f-a550-8bceb6a46a70 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:42.282541 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f16ccb1-b2f2-469f-a550-8bceb6a46a70 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:42.342028 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4f16ccb1-b2f2-469f-a550-8bceb6a46a70 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094019 Aug 07 01:35:42.347927 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2687/4932] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:35:42 2022] GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:35:42.502624 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-66f9f50d-91fd-4631-9000-44825ec0d112 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:42.511836 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-66f9f50d-91fd-4631-9000-44825ec0d112 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1510 microversion: 2.1 time: 0.748626 Aug 07 01:35:42.517311 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2246/4933] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:41 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1510 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:43.034168 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-3ba3317f-847d-4bfe-ba76-4dce0f5effd5 req-bfa4fd60-3426-4518-b0d1-48489a013855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afe29183-ebc5-4f1b-af8b-1eb2bbbfffad", "name": "network-vif-deleted", "tag": "d21f91e9-787f-44e2-996b-ca2635e32ba6"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:35:43.064064 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3ba3317f-847d-4bfe-ba76-4dce0f5effd5 req-bfa4fd60-3426-4518-b0d1-48489a013855 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:43.070757 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3ba3317f-847d-4bfe-ba76-4dce0f5effd5 req-bfa4fd60-3426-4518-b0d1-48489a013855 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:43.071502 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3ba3317f-847d-4bfe-ba76-4dce0f5effd5 req-bfa4fd60-3426-4518-b0d1-48489a013855 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:43.142088 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-3ba3317f-847d-4bfe-ba76-4dce0f5effd5 req-bfa4fd60-3426-4518-b0d1-48489a013855 service nova] Creating event network-vif-deleted:d21f91e9-787f-44e2-996b-ca2635e32ba6 for instance afe29183-ebc5-4f1b-af8b-1eb2bbbfffad on n-h2-master-1 Aug 07 01:35:43.158742 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-3ba3317f-847d-4bfe-ba76-4dce0f5effd5 req-bfa4fd60-3426-4518-b0d1-48489a013855 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127787 Aug 07 01:35:43.160825 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2688/4934] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:35:43.355432 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2d02e1b3-3885-4540-8f30-d716b6018d00 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:43.358024 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2d02e1b3-3885-4540-8f30-d716b6018d00 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:43.374462 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d02e1b3-3885-4540-8f30-d716b6018d00 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:43.375219 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d02e1b3-3885-4540-8f30-d716b6018d00 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:43.375769 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d02e1b3-3885-4540-8f30-d716b6018d00 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:43.376970 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d02e1b3-3885-4540-8f30-d716b6018d00 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:43.377548 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d02e1b3-3885-4540-8f30-d716b6018d00 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:43.378977 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d02e1b3-3885-4540-8f30-d716b6018d00 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:43.475097 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2d02e1b3-3885-4540-8f30-d716b6018d00 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123498 Aug 07 01:35:43.478231 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2247/4935] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:35:43 2022] GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:35:43.541458 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-072e77ad-6c26-4567-bad9-16e70a989250 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:43.542169 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-072e77ad-6c26-4567-bad9-16e70a989250 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:43.560202 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-072e77ad-6c26-4567-bad9-16e70a989250 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:43.560955 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-072e77ad-6c26-4567-bad9-16e70a989250 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:43.561598 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-072e77ad-6c26-4567-bad9-16e70a989250 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:43.562490 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-072e77ad-6c26-4567-bad9-16e70a989250 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:43.563108 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-072e77ad-6c26-4567-bad9-16e70a989250 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:43.563715 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-072e77ad-6c26-4567-bad9-16e70a989250 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:43.600805 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-072e77ad-6c26-4567-bad9-16e70a989250 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:43.601560 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-072e77ad-6c26-4567-bad9-16e70a989250 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:43.602159 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-072e77ad-6c26-4567-bad9-16e70a989250 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:43.602775 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-072e77ad-6c26-4567-bad9-16e70a989250 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lazy-loading 'fault' on Instance uuid afe29183-ebc5-4f1b-af8b-1eb2bbbfffad {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:35:44.288528 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-072e77ad-6c26-4567-bad9-16e70a989250 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b33e07001cb4a2db36fec14bded07f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c8da97f8334f7da1cd25716cc7da0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:44.305234 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-072e77ad-6c26-4567-bad9-16e70a989250 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 200 len: 1312 microversion: 2.1 time: 0.768501 Aug 07 01:35:44.306385 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2689/4936] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:43 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 1312 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:44.344218 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d46e465e-83b9-45a2-8a51-203221e40afc tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-424630866", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "57cfcd0a-e867-4c5a-b675-b5d590014906"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:35:44.467095 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-d46e465e-83b9-45a2-8a51-203221e40afc tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] validate_networks() for [('57cfcd0a-e867-4c5a-b675-b5d590014906', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:35:44.489496 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4a919297-b59d-48d9-b3fb-20ce41e8d511 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:44.492403 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4a919297-b59d-48d9-b3fb-20ce41e8d511 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:44.517603 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a919297-b59d-48d9-b3fb-20ce41e8d511 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:44.518624 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a919297-b59d-48d9-b3fb-20ce41e8d511 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:44.519484 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a919297-b59d-48d9-b3fb-20ce41e8d511 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:44.521413 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a919297-b59d-48d9-b3fb-20ce41e8d511 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:44.526666 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a919297-b59d-48d9-b3fb-20ce41e8d511 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:44.527212 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a919297-b59d-48d9-b3fb-20ce41e8d511 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:44.598486 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4a919297-b59d-48d9-b3fb-20ce41e8d511 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114407 Aug 07 01:35:44.601939 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2690/4937] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:35:44 2022] GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:35:44.607403 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-73d3d7cc-5d87-479e-952a-37ef4754dd0e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:44.608411 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-73d3d7cc-5d87-479e-952a-37ef4754dd0e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:44.616486 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73d3d7cc-5d87-479e-952a-37ef4754dd0e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:44.617251 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73d3d7cc-5d87-479e-952a-37ef4754dd0e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:44.617929 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73d3d7cc-5d87-479e-952a-37ef4754dd0e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:44.618862 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73d3d7cc-5d87-479e-952a-37ef4754dd0e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:44.619556 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73d3d7cc-5d87-479e-952a-37ef4754dd0e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:44.620315 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73d3d7cc-5d87-479e-952a-37ef4754dd0e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:44.658883 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-73d3d7cc-5d87-479e-952a-37ef4754dd0e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments/b0ab3bfc-7b95-4efb-bee2-153f7bde3afd" status: 200 len: 194 microversion: 2.20 time: 0.055142 Aug 07 01:35:44.660163 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2691/4938] 10.222.0.39 () {60 vars in 1454 bytes} [Sun Aug 7 01:35:44 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments/b0ab3bfc-7b95-4efb-bee2-153f7bde3afd => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:35:44.746070 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-23639da0-d4a4-4430-9676-c1dca562fe00 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:44.747220 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-23639da0-d4a4-4430-9676-c1dca562fe00 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:44.766441 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-23639da0-d4a4-4430-9676-c1dca562fe00 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:44.767168 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-23639da0-d4a4-4430-9676-c1dca562fe00 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:44.767822 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-23639da0-d4a4-4430-9676-c1dca562fe00 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:44.770941 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-23639da0-d4a4-4430-9676-c1dca562fe00 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:44.771696 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-23639da0-d4a4-4430-9676-c1dca562fe00 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:44.772426 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-23639da0-d4a4-4430-9676-c1dca562fe00 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:45.105552 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-23639da0-d4a4-4430-9676-c1dca562fe00 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lazy-loading 'services' on Instance uuid 4071f699-43c7-4c36-ada4-8f0dceb6cc91 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:35:45.339905 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-23639da0-d4a4-4430-9676-c1dca562fe00 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments/b0ab3bfc-7b95-4efb-bee2-153f7bde3afd" status: 202 len: 0 microversion: 2.20 time: 0.597763 Aug 07 01:35:45.341113 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2692/4939] 10.222.0.39 () {60 vars in 1457 bytes} [Sun Aug 7 01:35:44 2022] DELETE /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments/b0ab3bfc-7b95-4efb-bee2-153f7bde3afd => generated 0 bytes in 601 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 07 01:35:45.354611 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4af50b2e-ddf0-472a-9fc0-13ceb18573c8 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:45.361910 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4af50b2e-ddf0-472a-9fc0-13ceb18573c8 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] [instance: afe29183-ebc5-4f1b-af8b-1eb2bbbfffad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:45.374854 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4af50b2e-ddf0-472a-9fc0-13ceb18573c8 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:45.377571 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4af50b2e-ddf0-472a-9fc0-13ceb18573c8 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:45.378153 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4af50b2e-ddf0-472a-9fc0-13ceb18573c8 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:45.380731 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4af50b2e-ddf0-472a-9fc0-13ceb18573c8 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:45.383997 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4af50b2e-ddf0-472a-9fc0-13ceb18573c8 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:45.384346 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4af50b2e-ddf0-472a-9fc0-13ceb18573c8 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:45.414501 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-4af50b2e-ddf0-472a-9fc0-13ceb18573c8 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] HTTP exception thrown: Instance afe29183-ebc5-4f1b-af8b-1eb2bbbfffad could not be found. Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4af50b2e-ddf0-472a-9fc0-13ceb18573c8 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Request method failure captured: Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad HTTP/1.1 Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xaIgHaY4HhB55yT0QrruTIbYBhfJ60NDo1TafxewKSxf7ZhbIMrzL83vJ34KvDj4W2VNUGbESJKqMVKQPDYa-5zmB1-1HtXBZECuAQZYgxLXtoAPF3oLNfIdY8smClQq56k4DDUI_f6gqlcApOzuf_mNAYjQO6e4Mr2VDNZQe2_gk0 Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 64c8da97f8334f7da1cd25716cc7da0d Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1839174447 Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/64c8da97f8334f7da1cd25716cc7da0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_64c8da97f8334f7da1cd25716cc7da0d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/64c8da97f8334f7da1cd25716cc7da0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/64c8da97f8334f7da1cd25716cc7da0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1839174447 Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 64c8da97f8334f7da1cd25716cc7da0d Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1839174447 Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServerRescueTestJSONUnderV235-1839174447-project Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 6b33e07001cb4a2db36fec14bded07f5 Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1839174447-project Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: exception: Instance afe29183-ebc5-4f1b-af8b-1eb2bbbfffad could not be found. Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'afe29183-ebc5-4f1b-af8b-1eb2bbbfffad'} Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afe29183-ebc5-4f1b-af8b-1eb2bbbfffad could not be found. Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afe29183-ebc5-4f1b-af8b-1eb2bbbfffad could not be found. Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:45.416321 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:35:45.421323 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:45.421323 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:45.421323 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:35:45.421323 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:35:45.421323 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:35:45.421323 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:35:45.421323 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afe29183-ebc5-4f1b-af8b-1eb2bbbfffad could not be found. Aug 07 01:35:45.421323 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:35:45.424991 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4af50b2e-ddf0-472a-9fc0-13ceb18573c8 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] Returning 404 to user: Instance afe29183-ebc5-4f1b-af8b-1eb2bbbfffad could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:35:45.429274 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4af50b2e-ddf0-472a-9fc0-13ceb18573c8 tempest-ServerRescueTestJSONUnderV235-1839174447 tempest-ServerRescueTestJSONUnderV235-1839174447-project] 10.222.0.39 "GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad" status: 404 len: 111 microversion: 2.1 time: 0.086915 Aug 07 01:35:45.434311 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2693/4940] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:45 2022] GET /compute/v2.1/servers/afe29183-ebc5-4f1b-af8b-1eb2bbbfffad => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:35:45.442892 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7f2dc930-bad4-4148-b5f5-ea0c0e8e422b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:45.451301 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7f2dc930-bad4-4148-b5f5-ea0c0e8e422b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:45.471560 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f2dc930-bad4-4148-b5f5-ea0c0e8e422b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:45.472425 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f2dc930-bad4-4148-b5f5-ea0c0e8e422b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:45.473092 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f2dc930-bad4-4148-b5f5-ea0c0e8e422b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:45.474032 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f2dc930-bad4-4148-b5f5-ea0c0e8e422b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:45.474685 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f2dc930-bad4-4148-b5f5-ea0c0e8e422b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:45.478539 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f2dc930-bad4-4148-b5f5-ea0c0e8e422b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:45.564867 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7f2dc930-bad4-4148-b5f5-ea0c0e8e422b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.129073 Aug 07 01:35:45.565826 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2694/4941] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Aug 7 01:35:45 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:35:45.616286 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9123a7ca-b147-4aff-9037-4e44e9aa1889 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:45.620534 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9123a7ca-b147-4aff-9037-4e44e9aa1889 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:45.650776 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9123a7ca-b147-4aff-9037-4e44e9aa1889 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:45.657909 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9123a7ca-b147-4aff-9037-4e44e9aa1889 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:45.658450 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9123a7ca-b147-4aff-9037-4e44e9aa1889 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:45.662117 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9123a7ca-b147-4aff-9037-4e44e9aa1889 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:45.663555 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9123a7ca-b147-4aff-9037-4e44e9aa1889 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:45.664035 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9123a7ca-b147-4aff-9037-4e44e9aa1889 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:45.760598 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9123a7ca-b147-4aff-9037-4e44e9aa1889 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150294 Aug 07 01:35:45.761216 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2695/4942] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:35:45 2022] GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:35:46.578044 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7037886a-703a-4e8b-b7da-0fdefd3b184b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:46.593673 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7037886a-703a-4e8b-b7da-0fdefd3b184b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:46.620542 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7037886a-703a-4e8b-b7da-0fdefd3b184b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:46.621207 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7037886a-703a-4e8b-b7da-0fdefd3b184b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:46.623288 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7037886a-703a-4e8b-b7da-0fdefd3b184b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:46.624165 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7037886a-703a-4e8b-b7da-0fdefd3b184b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:46.624885 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7037886a-703a-4e8b-b7da-0fdefd3b184b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:46.629052 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7037886a-703a-4e8b-b7da-0fdefd3b184b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:46.703966 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7037886a-703a-4e8b-b7da-0fdefd3b184b tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.129768 Aug 07 01:35:46.704657 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2696/4943] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Aug 7 01:35:46 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:35:46.773817 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4f9bfdbc-a1a3-4095-9d07-b343f86b57bc tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:46.776170 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4f9bfdbc-a1a3-4095-9d07-b343f86b57bc tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:46.783704 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f9bfdbc-a1a3-4095-9d07-b343f86b57bc tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:46.784510 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f9bfdbc-a1a3-4095-9d07-b343f86b57bc tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:46.785006 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f9bfdbc-a1a3-4095-9d07-b343f86b57bc tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:46.786081 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f9bfdbc-a1a3-4095-9d07-b343f86b57bc tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:46.786600 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f9bfdbc-a1a3-4095-9d07-b343f86b57bc tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:46.787092 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f9bfdbc-a1a3-4095-9d07-b343f86b57bc tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:46.838934 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:46.844738 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4f9bfdbc-a1a3-4095-9d07-b343f86b57bc tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075451 Aug 07 01:35:46.845857 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2697/4944] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:35:46 2022] GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:35:46.999390 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-d46e465e-83b9-45a2-8a51-203221e40afc tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:35:47.000687 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-d46e465e-83b9-45a2-8a51-203221e40afc tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:35:47.001186 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-d46e465e-83b9-45a2-8a51-203221e40afc tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:35:47.001971 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-d46e465e-83b9-45a2-8a51-203221e40afc tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:35:47.002428 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-d46e465e-83b9-45a2-8a51-203221e40afc tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:35:47.017923 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d46e465e-83b9-45a2-8a51-203221e40afc tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:47.018420 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d46e465e-83b9-45a2-8a51-203221e40afc tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:47.018861 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d46e465e-83b9-45a2-8a51-203221e40afc tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:47.019601 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d46e465e-83b9-45a2-8a51-203221e40afc tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:47.020089 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d46e465e-83b9-45a2-8a51-203221e40afc tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:47.020530 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d46e465e-83b9-45a2-8a51-203221e40afc tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:47.091675 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-d46e465e-83b9-45a2-8a51-203221e40afc tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Getting quotas for project 610bac63014f490db55c2cdbb89bc46a. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:35:47.114665 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-d46e465e-83b9-45a2-8a51-203221e40afc tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Getting quotas for user 2dd25a3a76ca4b399ddaf730a1d96878 and project 610bac63014f490db55c2cdbb89bc46a. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:35:47.142927 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d46e465e-83b9-45a2-8a51-203221e40afc tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:35:47.150683 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d46e465e-83b9-45a2-8a51-203221e40afc tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] [instance: 182a97f3-ed16-4941-83b2-e15f51e02f84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:35:47.222938 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d46e465e-83b9-45a2-8a51-203221e40afc tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.144095 Aug 07 01:35:47.240539 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7a42d692-7f55-4c2b-a7d4-e5740fc035b5 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:47.242743 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7a42d692-7f55-4c2b-a7d4-e5740fc035b5 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] [instance: 182a97f3-ed16-4941-83b2-e15f51e02f84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:47.255165 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2248/4945] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:35:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 3177 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 07 01:35:47.447485 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7a42d692-7f55-4c2b-a7d4-e5740fc035b5 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd25a3a76ca4b399ddaf730a1d96878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '610bac63014f490db55c2cdbb89bc46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:47.472217 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7a42d692-7f55-4c2b-a7d4-e5740fc035b5 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] 10.222.0.39 "GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84" status: 200 len: 1216 microversion: 2.1 time: 0.237687 Aug 07 01:35:47.490336 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2698/4946] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:47 2022] GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84 => generated 1216 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:47.719324 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1dc2cd91-190f-4b4a-8ac1-c48a02bcff33 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:47.725148 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1dc2cd91-190f-4b4a-8ac1-c48a02bcff33 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:47.734619 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1dc2cd91-190f-4b4a-8ac1-c48a02bcff33 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:47.738823 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1dc2cd91-190f-4b4a-8ac1-c48a02bcff33 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:47.739421 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1dc2cd91-190f-4b4a-8ac1-c48a02bcff33 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:47.742223 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1dc2cd91-190f-4b4a-8ac1-c48a02bcff33 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:47.744549 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1dc2cd91-190f-4b4a-8ac1-c48a02bcff33 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:47.745236 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1dc2cd91-190f-4b4a-8ac1-c48a02bcff33 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:47.826571 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1dc2cd91-190f-4b4a-8ac1-c48a02bcff33 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.113518 Aug 07 01:35:47.829607 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2249/4947] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Aug 7 01:35:47 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:35:47.857897 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-11aa8e65-5b56-4d24-9871-b1160e66d1ad tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:47.860900 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-11aa8e65-5b56-4d24-9871-b1160e66d1ad tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:47.879368 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-11aa8e65-5b56-4d24-9871-b1160e66d1ad tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:47.879848 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-11aa8e65-5b56-4d24-9871-b1160e66d1ad tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:47.880322 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-11aa8e65-5b56-4d24-9871-b1160e66d1ad tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:47.881055 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-11aa8e65-5b56-4d24-9871-b1160e66d1ad tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:47.881612 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-11aa8e65-5b56-4d24-9871-b1160e66d1ad tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:47.881936 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-11aa8e65-5b56-4d24-9871-b1160e66d1ad tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:48.001695 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-11aa8e65-5b56-4d24-9871-b1160e66d1ad tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147003 Aug 07 01:35:48.002308 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2699/4948] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:35:47 2022] GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:35:48.498398 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1b87246e-7abf-4b49-83f1-abce483ef917 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:48.500173 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1b87246e-7abf-4b49-83f1-abce483ef917 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] [instance: 182a97f3-ed16-4941-83b2-e15f51e02f84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:48.514418 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b87246e-7abf-4b49-83f1-abce483ef917 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:48.515213 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b87246e-7abf-4b49-83f1-abce483ef917 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:48.516103 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b87246e-7abf-4b49-83f1-abce483ef917 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:48.516992 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b87246e-7abf-4b49-83f1-abce483ef917 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:48.517614 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b87246e-7abf-4b49-83f1-abce483ef917 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:48.519005 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b87246e-7abf-4b49-83f1-abce483ef917 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:48.733666 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1b87246e-7abf-4b49-83f1-abce483ef917 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd25a3a76ca4b399ddaf730a1d96878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '610bac63014f490db55c2cdbb89bc46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:48.743674 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1b87246e-7abf-4b49-83f1-abce483ef917 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] 10.222.0.39 "GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84" status: 200 len: 1220 microversion: 2.1 time: 0.250087 Aug 07 01:35:48.749689 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2250/4949] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:48 2022] GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84 => generated 1220 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:48.841656 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-81130aaf-c44c-4887-a0eb-bfccbfcfee85 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:48.845098 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-81130aaf-c44c-4887-a0eb-bfccbfcfee85 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:48.860319 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-81130aaf-c44c-4887-a0eb-bfccbfcfee85 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:48.861673 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-81130aaf-c44c-4887-a0eb-bfccbfcfee85 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:48.862460 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-81130aaf-c44c-4887-a0eb-bfccbfcfee85 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:48.863516 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-81130aaf-c44c-4887-a0eb-bfccbfcfee85 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:48.864398 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-81130aaf-c44c-4887-a0eb-bfccbfcfee85 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:48.865094 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-81130aaf-c44c-4887-a0eb-bfccbfcfee85 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:48.920663 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-81130aaf-c44c-4887-a0eb-bfccbfcfee85 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083596 Aug 07 01:35:48.921779 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2700/4950] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Aug 7 01:35:48 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:35:49.020693 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f02fefad-1f5c-4957-ad07-28a53bf4b76a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:49.027913 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f02fefad-1f5c-4957-ad07-28a53bf4b76a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:49.042153 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f02fefad-1f5c-4957-ad07-28a53bf4b76a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:49.049509 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f02fefad-1f5c-4957-ad07-28a53bf4b76a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:49.062329 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f02fefad-1f5c-4957-ad07-28a53bf4b76a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:49.063634 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f02fefad-1f5c-4957-ad07-28a53bf4b76a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:49.064310 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f02fefad-1f5c-4957-ad07-28a53bf4b76a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:49.064917 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f02fefad-1f5c-4957-ad07-28a53bf4b76a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:49.154267 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f02fefad-1f5c-4957-ad07-28a53bf4b76a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143037 Aug 07 01:35:49.154876 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2251/4951] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:35:49 2022] GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:35:49.770761 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6cffe0d7-e41a-4ee8-a93d-d54d857fbe8b tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:49.771302 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6cffe0d7-e41a-4ee8-a93d-d54d857fbe8b tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] [instance: 182a97f3-ed16-4941-83b2-e15f51e02f84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:49.782401 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cffe0d7-e41a-4ee8-a93d-d54d857fbe8b tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:49.793769 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cffe0d7-e41a-4ee8-a93d-d54d857fbe8b tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:49.795281 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cffe0d7-e41a-4ee8-a93d-d54d857fbe8b tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:49.797307 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cffe0d7-e41a-4ee8-a93d-d54d857fbe8b tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:49.804830 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cffe0d7-e41a-4ee8-a93d-d54d857fbe8b tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:49.807080 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cffe0d7-e41a-4ee8-a93d-d54d857fbe8b tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:49.935415 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6f79747c-5f19-4910-91a0-2f372e74ceac tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:49.936567 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6cffe0d7-e41a-4ee8-a93d-d54d857fbe8b tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd25a3a76ca4b399ddaf730a1d96878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '610bac63014f490db55c2cdbb89bc46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:49.937838 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6f79747c-5f19-4910-91a0-2f372e74ceac tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:49.958520 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6cffe0d7-e41a-4ee8-a93d-d54d857fbe8b tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] 10.222.0.39 "GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84" status: 200 len: 1286 microversion: 2.1 time: 0.189147 Aug 07 01:35:49.958744 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f79747c-5f19-4910-91a0-2f372e74ceac tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:49.959807 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f79747c-5f19-4910-91a0-2f372e74ceac tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:49.963645 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2701/4952] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:49 2022] GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84 => generated 1286 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:49.964276 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f79747c-5f19-4910-91a0-2f372e74ceac tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:49.965059 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f79747c-5f19-4910-91a0-2f372e74ceac tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:49.965539 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f79747c-5f19-4910-91a0-2f372e74ceac tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:49.965980 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f79747c-5f19-4910-91a0-2f372e74ceac tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:50.026581 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6f79747c-5f19-4910-91a0-2f372e74ceac tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.095969 Aug 07 01:35:50.031567 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2252/4953] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Aug 7 01:35:49 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 01:35:50.172673 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4dc0f9ff-8ec2-49ed-aa4c-7b9fb07d5d8e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:50.179759 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4dc0f9ff-8ec2-49ed-aa4c-7b9fb07d5d8e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:50.198812 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4dc0f9ff-8ec2-49ed-aa4c-7b9fb07d5d8e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:50.199457 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4dc0f9ff-8ec2-49ed-aa4c-7b9fb07d5d8e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:50.200052 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4dc0f9ff-8ec2-49ed-aa4c-7b9fb07d5d8e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:50.202579 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4dc0f9ff-8ec2-49ed-aa4c-7b9fb07d5d8e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:50.204362 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4dc0f9ff-8ec2-49ed-aa4c-7b9fb07d5d8e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:50.205975 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4dc0f9ff-8ec2-49ed-aa4c-7b9fb07d5d8e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:50.274149 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4dc0f9ff-8ec2-49ed-aa4c-7b9fb07d5d8e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111736 Aug 07 01:35:50.277489 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2702/4954] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:35:50 2022] GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:35:50.987773 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f2365324-03ab-4902-87c7-48994ce82cbc tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:50.988444 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f2365324-03ab-4902-87c7-48994ce82cbc tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] [instance: 182a97f3-ed16-4941-83b2-e15f51e02f84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:51.009886 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f2365324-03ab-4902-87c7-48994ce82cbc tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:51.010396 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f2365324-03ab-4902-87c7-48994ce82cbc tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:51.010915 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f2365324-03ab-4902-87c7-48994ce82cbc tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:51.011558 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f2365324-03ab-4902-87c7-48994ce82cbc tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:51.012049 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f2365324-03ab-4902-87c7-48994ce82cbc tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:51.012482 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f2365324-03ab-4902-87c7-48994ce82cbc tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:51.048204 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0c7104d9-0139-4929-bec2-41113df4b771 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:51.058023 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0c7104d9-0139-4929-bec2-41113df4b771 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:51.071735 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c7104d9-0139-4929-bec2-41113df4b771 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:51.073145 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c7104d9-0139-4929-bec2-41113df4b771 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:51.073768 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c7104d9-0139-4929-bec2-41113df4b771 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:51.075172 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c7104d9-0139-4929-bec2-41113df4b771 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:51.075944 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c7104d9-0139-4929-bec2-41113df4b771 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:51.076545 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c7104d9-0139-4929-bec2-41113df4b771 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:51.117873 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0c7104d9-0139-4929-bec2-41113df4b771 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.081743 Aug 07 01:35:51.119053 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2703/4955] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Aug 7 01:35:51 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:35:51.190788 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f2365324-03ab-4902-87c7-48994ce82cbc tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd25a3a76ca4b399ddaf730a1d96878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '610bac63014f490db55c2cdbb89bc46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:51.198787 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f2365324-03ab-4902-87c7-48994ce82cbc tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] 10.222.0.39 "GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84" status: 200 len: 1274 microversion: 2.1 time: 0.217554 Aug 07 01:35:51.199374 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2253/4956] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:50 2022] GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84 => generated 1274 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:51.291327 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4831a4ed-7764-4d20-a24f-29a575631d49 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:51.294189 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4831a4ed-7764-4d20-a24f-29a575631d49 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:51.316944 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4831a4ed-7764-4d20-a24f-29a575631d49 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:51.317987 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4831a4ed-7764-4d20-a24f-29a575631d49 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:51.319791 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4831a4ed-7764-4d20-a24f-29a575631d49 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:51.320952 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4831a4ed-7764-4d20-a24f-29a575631d49 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:51.322694 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4831a4ed-7764-4d20-a24f-29a575631d49 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:51.323323 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4831a4ed-7764-4d20-a24f-29a575631d49 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:51.373010 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4831a4ed-7764-4d20-a24f-29a575631d49 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.087969 Aug 07 01:35:51.374892 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2704/4957] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:35:51 2022] GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2/os-volume_attachments => generated 25 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:35:51.466007 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9064517d-69e3-435b-9276-aaa9e22850bd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:51.466510 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9064517d-69e3-435b-9276-aaa9e22850bd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:51.475261 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9064517d-69e3-435b-9276-aaa9e22850bd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:51.475757 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9064517d-69e3-435b-9276-aaa9e22850bd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:51.484099 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9064517d-69e3-435b-9276-aaa9e22850bd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:51.484930 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9064517d-69e3-435b-9276-aaa9e22850bd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:51.485429 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9064517d-69e3-435b-9276-aaa9e22850bd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:51.485859 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9064517d-69e3-435b-9276-aaa9e22850bd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:51.554522 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9064517d-69e3-435b-9276-aaa9e22850bd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:35:51.714234 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9064517d-69e3-435b-9276-aaa9e22850bd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2" status: 204 len: 0 microversion: 2.1 time: 0.250630 Aug 07 01:35:51.719187 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2254/4958] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:35:51 2022] DELETE /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:35:51.724205 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0f5628c4-ade5-44ae-9802-2f795db418b5 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:51.725617 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0f5628c4-ade5-44ae-9802-2f795db418b5 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:51.737218 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f5628c4-ade5-44ae-9802-2f795db418b5 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:51.737711 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f5628c4-ade5-44ae-9802-2f795db418b5 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:51.738332 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f5628c4-ade5-44ae-9802-2f795db418b5 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:51.739233 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f5628c4-ade5-44ae-9802-2f795db418b5 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:51.742564 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f5628c4-ade5-44ae-9802-2f795db418b5 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:51.743792 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f5628c4-ade5-44ae-9802-2f795db418b5 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:52.132593 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d81e6015-3112-4ded-bede-ee8cee2b7bfd tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:52.135543 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d81e6015-3112-4ded-bede-ee8cee2b7bfd tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:52.147480 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d81e6015-3112-4ded-bede-ee8cee2b7bfd tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:52.148454 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d81e6015-3112-4ded-bede-ee8cee2b7bfd tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:52.149964 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d81e6015-3112-4ded-bede-ee8cee2b7bfd tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:52.151008 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d81e6015-3112-4ded-bede-ee8cee2b7bfd tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:52.152747 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d81e6015-3112-4ded-bede-ee8cee2b7bfd tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:52.154096 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d81e6015-3112-4ded-bede-ee8cee2b7bfd tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:52.205838 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d81e6015-3112-4ded-bede-ee8cee2b7bfd tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078848 Aug 07 01:35:52.206746 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2255/4959] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Aug 7 01:35:52 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 01:35:52.225176 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-267b8184-198c-4705-977f-94e7bd2342f0 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:52.226499 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-267b8184-198c-4705-977f-94e7bd2342f0 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] [instance: 182a97f3-ed16-4941-83b2-e15f51e02f84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:52.236023 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-267b8184-198c-4705-977f-94e7bd2342f0 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:52.236878 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-267b8184-198c-4705-977f-94e7bd2342f0 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:52.237542 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-267b8184-198c-4705-977f-94e7bd2342f0 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:52.238881 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-267b8184-198c-4705-977f-94e7bd2342f0 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:52.242084 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-267b8184-198c-4705-977f-94e7bd2342f0 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:52.242811 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-267b8184-198c-4705-977f-94e7bd2342f0 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:52.492233 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0f5628c4-ade5-44ae-9802-2f795db418b5 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:52.502402 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0f5628c4-ade5-44ae-9802-2f795db418b5 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2" status: 200 len: 1682 microversion: 2.1 time: 0.782091 Aug 07 01:35:52.503940 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2705/4960] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:51 2022] GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2 => generated 1682 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:35:52.660095 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-267b8184-198c-4705-977f-94e7bd2342f0 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd25a3a76ca4b399ddaf730a1d96878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '610bac63014f490db55c2cdbb89bc46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:52.676795 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-267b8184-198c-4705-977f-94e7bd2342f0 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] 10.222.0.39 "GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84" status: 200 len: 1316 microversion: 2.1 time: 0.456910 Aug 07 01:35:52.677458 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2256/4961] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:52 2022] GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84 => generated 1316 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:53.220583 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2cc35e28-e5c5-4fe2-a639-c8754b1dd4f7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:53.223529 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2cc35e28-e5c5-4fe2-a639-c8754b1dd4f7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:53.244732 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2cc35e28-e5c5-4fe2-a639-c8754b1dd4f7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:53.245303 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2cc35e28-e5c5-4fe2-a639-c8754b1dd4f7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:53.245808 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2cc35e28-e5c5-4fe2-a639-c8754b1dd4f7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:53.246730 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2cc35e28-e5c5-4fe2-a639-c8754b1dd4f7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:53.247355 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2cc35e28-e5c5-4fe2-a639-c8754b1dd4f7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:53.248422 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2cc35e28-e5c5-4fe2-a639-c8754b1dd4f7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:53.320828 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2cc35e28-e5c5-4fe2-a639-c8754b1dd4f7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.105949 Aug 07 01:35:53.321420 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2706/4962] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Aug 7 01:35:53 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:35:53.528439 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2238712d-7f57-439b-a547-3501e0145c2a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:53.529057 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2238712d-7f57-439b-a547-3501e0145c2a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:53.538391 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2238712d-7f57-439b-a547-3501e0145c2a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:53.538900 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2238712d-7f57-439b-a547-3501e0145c2a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:53.539772 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2238712d-7f57-439b-a547-3501e0145c2a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:53.540593 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2238712d-7f57-439b-a547-3501e0145c2a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:53.548776 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2238712d-7f57-439b-a547-3501e0145c2a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:53.549353 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2238712d-7f57-439b-a547-3501e0145c2a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:53.699849 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9f1c771b-5bbd-410c-9c82-2b7baf3fcab4 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:53.704315 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9f1c771b-5bbd-410c-9c82-2b7baf3fcab4 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] [instance: 182a97f3-ed16-4941-83b2-e15f51e02f84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:53.746937 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f1c771b-5bbd-410c-9c82-2b7baf3fcab4 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:53.751062 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f1c771b-5bbd-410c-9c82-2b7baf3fcab4 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:53.752337 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f1c771b-5bbd-410c-9c82-2b7baf3fcab4 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:53.754769 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f1c771b-5bbd-410c-9c82-2b7baf3fcab4 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:53.758899 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f1c771b-5bbd-410c-9c82-2b7baf3fcab4 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:53.759566 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9f1c771b-5bbd-410c-9c82-2b7baf3fcab4 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:54.146067 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9f1c771b-5bbd-410c-9c82-2b7baf3fcab4 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd25a3a76ca4b399ddaf730a1d96878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '610bac63014f490db55c2cdbb89bc46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:54.159150 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9f1c771b-5bbd-410c-9c82-2b7baf3fcab4 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] 10.222.0.39 "GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84" status: 200 len: 1316 microversion: 2.1 time: 0.464517 Aug 07 01:35:54.172913 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2707/4963] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:53 2022] GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84 => generated 1316 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:54.338777 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fdc75f37-ca41-40f8-bf6e-8d667e93d8b0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:54.342496 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fdc75f37-ca41-40f8-bf6e-8d667e93d8b0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:54.357511 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fdc75f37-ca41-40f8-bf6e-8d667e93d8b0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:54.358801 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fdc75f37-ca41-40f8-bf6e-8d667e93d8b0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:54.359620 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fdc75f37-ca41-40f8-bf6e-8d667e93d8b0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:54.360828 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fdc75f37-ca41-40f8-bf6e-8d667e93d8b0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:54.361741 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fdc75f37-ca41-40f8-bf6e-8d667e93d8b0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:54.363734 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fdc75f37-ca41-40f8-bf6e-8d667e93d8b0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:54.427490 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fdc75f37-ca41-40f8-bf6e-8d667e93d8b0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.096420 Aug 07 01:35:54.432791 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2708/4964] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Aug 7 01:35:54 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:35:54.466658 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2238712d-7f57-439b-a547-3501e0145c2a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:54.481859 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2238712d-7f57-439b-a547-3501e0145c2a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2" status: 200 len: 1682 microversion: 2.1 time: 0.957591 Aug 07 01:35:54.482957 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2257/4965] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:53 2022] GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2 => generated 1682 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:55.180757 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6a7c8a14-e555-4d1f-88f7-065b85557595 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:55.181385 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6a7c8a14-e555-4d1f-88f7-065b85557595 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] [instance: 182a97f3-ed16-4941-83b2-e15f51e02f84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:55.191160 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a7c8a14-e555-4d1f-88f7-065b85557595 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:55.191663 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a7c8a14-e555-4d1f-88f7-065b85557595 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:55.192150 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a7c8a14-e555-4d1f-88f7-065b85557595 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:55.193855 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a7c8a14-e555-4d1f-88f7-065b85557595 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:55.194695 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a7c8a14-e555-4d1f-88f7-065b85557595 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:55.195462 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a7c8a14-e555-4d1f-88f7-065b85557595 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:55.443761 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e1c00d69-a763-4609-8a3a-944b58e1b4cf tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:55.447044 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e1c00d69-a763-4609-8a3a-944b58e1b4cf tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:55.463633 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1c00d69-a763-4609-8a3a-944b58e1b4cf tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:55.464182 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1c00d69-a763-4609-8a3a-944b58e1b4cf tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:55.464633 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1c00d69-a763-4609-8a3a-944b58e1b4cf tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:55.465359 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1c00d69-a763-4609-8a3a-944b58e1b4cf tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:55.465819 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1c00d69-a763-4609-8a3a-944b58e1b4cf tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:55.470743 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1c00d69-a763-4609-8a3a-944b58e1b4cf tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:55.592728 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e1c00d69-a763-4609-8a3a-944b58e1b4cf tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.154741 Aug 07 01:35:55.596339 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2258/4966] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Aug 7 01:35:55 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 01:35:55.608899 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b415a9b8-5fa8-49f3-88b1-ee5cf590bfa0 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:55.611082 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b415a9b8-5fa8-49f3-88b1-ee5cf590bfa0 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:55.632437 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b415a9b8-5fa8-49f3-88b1-ee5cf590bfa0 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:55.634433 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b415a9b8-5fa8-49f3-88b1-ee5cf590bfa0 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:55.634990 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b415a9b8-5fa8-49f3-88b1-ee5cf590bfa0 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:55.636893 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b415a9b8-5fa8-49f3-88b1-ee5cf590bfa0 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:55.639292 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b415a9b8-5fa8-49f3-88b1-ee5cf590bfa0 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:55.640891 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b415a9b8-5fa8-49f3-88b1-ee5cf590bfa0 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:56.266181 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6a7c8a14-e555-4d1f-88f7-065b85557595 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd25a3a76ca4b399ddaf730a1d96878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '610bac63014f490db55c2cdbb89bc46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:56.281567 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6a7c8a14-e555-4d1f-88f7-065b85557595 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] 10.222.0.39 "GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84" status: 200 len: 1316 microversion: 2.1 time: 1.105877 Aug 07 01:35:56.286023 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2709/4967] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:55 2022] GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84 => generated 1316 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:56.608896 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3cb7ea95-5e4c-409e-aa2c-4f236f6939d4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:56.611077 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3cb7ea95-5e4c-409e-aa2c-4f236f6939d4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:56.624767 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3cb7ea95-5e4c-409e-aa2c-4f236f6939d4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:56.625553 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3cb7ea95-5e4c-409e-aa2c-4f236f6939d4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:56.636597 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3cb7ea95-5e4c-409e-aa2c-4f236f6939d4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:56.637699 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3cb7ea95-5e4c-409e-aa2c-4f236f6939d4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:56.638352 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3cb7ea95-5e4c-409e-aa2c-4f236f6939d4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:56.638976 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3cb7ea95-5e4c-409e-aa2c-4f236f6939d4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:56.748853 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3cb7ea95-5e4c-409e-aa2c-4f236f6939d4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.143926 Aug 07 01:35:56.750592 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2710/4968] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Aug 7 01:35:56 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 01:35:56.760140 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b415a9b8-5fa8-49f3-88b1-ee5cf590bfa0 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:56.764866 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:56.780483 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b415a9b8-5fa8-49f3-88b1-ee5cf590bfa0 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2" status: 200 len: 1682 microversion: 2.1 time: 1.182608 Aug 07 01:35:56.793236 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2259/4969] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:55 2022] GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2 => generated 1682 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:57.310389 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-52c6d4ba-e3c4-407e-9034-22927038b29e tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:57.312252 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-52c6d4ba-e3c4-407e-9034-22927038b29e tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] [instance: 182a97f3-ed16-4941-83b2-e15f51e02f84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:57.327161 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52c6d4ba-e3c4-407e-9034-22927038b29e tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:57.328017 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52c6d4ba-e3c4-407e-9034-22927038b29e tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:57.337903 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52c6d4ba-e3c4-407e-9034-22927038b29e tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:57.341790 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52c6d4ba-e3c4-407e-9034-22927038b29e tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:57.348625 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52c6d4ba-e3c4-407e-9034-22927038b29e tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:57.352708 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52c6d4ba-e3c4-407e-9034-22927038b29e tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:57.470333 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:57.763660 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f4d991d5-16bd-4f13-b1c0-c50671794da6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:57.766363 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f4d991d5-16bd-4f13-b1c0-c50671794da6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:57.786981 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:57.792415 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:57.796857 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4d991d5-16bd-4f13-b1c0-c50671794da6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:57.797352 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4d991d5-16bd-4f13-b1c0-c50671794da6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:57.797788 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4d991d5-16bd-4f13-b1c0-c50671794da6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:57.798500 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4d991d5-16bd-4f13-b1c0-c50671794da6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:57.805675 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4d991d5-16bd-4f13-b1c0-c50671794da6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:57.811441 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4d991d5-16bd-4f13-b1c0-c50671794da6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:57.948533 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f4d991d5-16bd-4f13-b1c0-c50671794da6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.183569 Aug 07 01:35:57.949413 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2260/4970] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Aug 7 01:35:57 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:35:57.968954 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c25a6723-67a9-40c9-8c03-1d4f8e05c5ef tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:57.975989 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c25a6723-67a9-40c9-8c03-1d4f8e05c5ef tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:57.999818 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c25a6723-67a9-40c9-8c03-1d4f8e05c5ef tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:58.004202 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c25a6723-67a9-40c9-8c03-1d4f8e05c5ef tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:58.004983 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c25a6723-67a9-40c9-8c03-1d4f8e05c5ef tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:58.006519 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c25a6723-67a9-40c9-8c03-1d4f8e05c5ef tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:58.009454 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c25a6723-67a9-40c9-8c03-1d4f8e05c5ef tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:58.010104 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c25a6723-67a9-40c9-8c03-1d4f8e05c5ef tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:58.185428 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-52c6d4ba-e3c4-407e-9034-22927038b29e tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd25a3a76ca4b399ddaf730a1d96878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '610bac63014f490db55c2cdbb89bc46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:58.218300 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-52c6d4ba-e3c4-407e-9034-22927038b29e tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] 10.222.0.39 "GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84" status: 200 len: 1316 microversion: 2.1 time: 0.912012 Aug 07 01:35:58.218928 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2711/4971] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:57 2022] GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84 => generated 1316 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:58.348148 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c25a6723-67a9-40c9-8c03-1d4f8e05c5ef tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:35:58.364361 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c25a6723-67a9-40c9-8c03-1d4f8e05c5ef tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2" status: 200 len: 1614 microversion: 2.1 time: 0.411401 Aug 07 01:35:58.365788 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2261/4972] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:57 2022] GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2 => generated 1614 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:35:59.057560 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-e980123e-6de6-40b4-b720-b7b2e057b6a8 req-595112e1-4370-4afb-b9c4-ce685ba749f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "182a97f3-ed16-4941-83b2-e15f51e02f84", "tag": "eb0460e9-ec73-48d2-a85f-25d802440bf7"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:35:59.089976 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e980123e-6de6-40b4-b720-b7b2e057b6a8 req-595112e1-4370-4afb-b9c4-ce685ba749f7 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:59.094104 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e980123e-6de6-40b4-b720-b7b2e057b6a8 req-595112e1-4370-4afb-b9c4-ce685ba749f7 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:59.095738 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e980123e-6de6-40b4-b720-b7b2e057b6a8 req-595112e1-4370-4afb-b9c4-ce685ba749f7 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:59.156335 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-e980123e-6de6-40b4-b720-b7b2e057b6a8 req-595112e1-4370-4afb-b9c4-ce685ba749f7 service nova] Creating event network-changed:eb0460e9-ec73-48d2-a85f-25d802440bf7 for instance 182a97f3-ed16-4941-83b2-e15f51e02f84 on n-h1-master-1 Aug 07 01:35:59.168505 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-e980123e-6de6-40b4-b720-b7b2e057b6a8 req-595112e1-4370-4afb-b9c4-ce685ba749f7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.665399 Aug 07 01:35:59.171050 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2712/4973] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:35:59.185955 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-83621842-6c6a-4893-b035-2f7a1cd4d973 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:59.190462 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-83621842-6c6a-4893-b035-2f7a1cd4d973 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:59.209256 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83621842-6c6a-4893-b035-2f7a1cd4d973 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:59.209762 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83621842-6c6a-4893-b035-2f7a1cd4d973 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:59.210204 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83621842-6c6a-4893-b035-2f7a1cd4d973 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:59.222397 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2e17e0cf-cc0d-4dc4-be51-eda066a83617 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1557092691", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": "none"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:35:59.229344 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83621842-6c6a-4893-b035-2f7a1cd4d973 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:59.234256 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83621842-6c6a-4893-b035-2f7a1cd4d973 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:59.236997 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83621842-6c6a-4893-b035-2f7a1cd4d973 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:59.322095 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-83621842-6c6a-4893-b035-2f7a1cd4d973 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.149745 Aug 07 01:35:59.323296 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2713/4974] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Aug 7 01:35:59 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:35:59.338933 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-50d93eae-6a2e-490d-abc1-ca80ac7b1868 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:59.339868 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-50d93eae-6a2e-490d-abc1-ca80ac7b1868 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] [instance: 182a97f3-ed16-4941-83b2-e15f51e02f84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:59.365888 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-50d93eae-6a2e-490d-abc1-ca80ac7b1868 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:59.373619 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-2e17e0cf-cc0d-4dc4-be51-eda066a83617 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:35:59.374583 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-50d93eae-6a2e-490d-abc1-ca80ac7b1868 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:59.374867 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-2e17e0cf-cc0d-4dc4-be51-eda066a83617 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:35:59.375472 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-50d93eae-6a2e-490d-abc1-ca80ac7b1868 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:59.375993 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-2e17e0cf-cc0d-4dc4-be51-eda066a83617 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:35:59.376781 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-2e17e0cf-cc0d-4dc4-be51-eda066a83617 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:35:59.377369 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-50d93eae-6a2e-490d-abc1-ca80ac7b1868 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:59.378195 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-2e17e0cf-cc0d-4dc4-be51-eda066a83617 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:35:59.383037 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-50d93eae-6a2e-490d-abc1-ca80ac7b1868 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:59.384074 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-50d93eae-6a2e-490d-abc1-ca80ac7b1868 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:59.433756 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2e17e0cf-cc0d-4dc4-be51-eda066a83617 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:59.434506 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2e17e0cf-cc0d-4dc4-be51-eda066a83617 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:59.435389 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2e17e0cf-cc0d-4dc4-be51-eda066a83617 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:59.437258 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2e17e0cf-cc0d-4dc4-be51-eda066a83617 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:59.457045 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2e17e0cf-cc0d-4dc4-be51-eda066a83617 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:59.468867 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2e17e0cf-cc0d-4dc4-be51-eda066a83617 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:59.525985 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-2e17e0cf-cc0d-4dc4-be51-eda066a83617 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Getting quotas for project f3e3bf9d373e43bea6c02b31d2e2e2ed. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:35:59.532329 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-2e17e0cf-cc0d-4dc4-be51-eda066a83617 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Getting quotas for user 1e08144123ad4d3e93e6b6fbe2acf03a and project f3e3bf9d373e43bea6c02b31d2e2e2ed. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:35:59.550780 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2e17e0cf-cc0d-4dc4-be51-eda066a83617 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:35:59.554202 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2e17e0cf-cc0d-4dc4-be51-eda066a83617 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: 6c6fe9cb-d330-478c-ac33-4e865087d6d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:35:59.716890 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2e17e0cf-cc0d-4dc4-be51-eda066a83617 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.846041 Aug 07 01:35:59.723435 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2262/4975] 10.222.0.39 () {62 vars in 1188 bytes} [Sun Aug 7 01:35:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 07 01:35:59.729362 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-860ac962-057a-4319-9fe5-03bc92b3b241 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:59.729997 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-860ac962-057a-4319-9fe5-03bc92b3b241 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:35:59.747127 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-860ac962-057a-4319-9fe5-03bc92b3b241 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:59.748181 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-860ac962-057a-4319-9fe5-03bc92b3b241 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:59.748636 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-860ac962-057a-4319-9fe5-03bc92b3b241 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:59.751049 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-860ac962-057a-4319-9fe5-03bc92b3b241 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:35:59.751049 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-860ac962-057a-4319-9fe5-03bc92b3b241 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:35:59.754237 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-860ac962-057a-4319-9fe5-03bc92b3b241 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:35:59.831832 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-860ac962-057a-4319-9fe5-03bc92b3b241 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] HTTP exception thrown: Instance 2778f5f5-ea59-43c9-860f-17210bcbbbd2 could not be found. Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-860ac962-057a-4319-9fe5-03bc92b3b241 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Request method failure captured: Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2 HTTP/1.1 Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xZDq6RH3D4bnr1UijP-nk3uo95NJjh7SbfPDqAVgj126rgmdcLbKlTvq4r9AHLnAVbqooFNQ3b97yry4NtGcTnZJETXBytnxiV1irP15oNSC1nhov4fsRvKuKlTNLjRN8RkNUdoouf8PCfkhvGYmSqoJN36Q7GHr7rf2nNkd41nqV4 Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: b630a4c3bb824b90b4c1898a92b47aa7 Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b630a4c3bb824b90b4c1898a92b47aa7", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: b630a4c3bb824b90b4c1898a92b47aa7 Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-AttachVolumeNegativeTest-1422960247-project Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d556a8ae0d524894a93203ce3f70d420 Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-AttachVolumeNegativeTest-1422960247-project Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 2778f5f5-ea59-43c9-860f-17210bcbbbd2 could not be found. Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '2778f5f5-ea59-43c9-860f-17210bcbbbd2'} Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2778f5f5-ea59-43c9-860f-17210bcbbbd2 could not be found. Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2778f5f5-ea59-43c9-860f-17210bcbbbd2 could not be found. Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:35:59.835806 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:35:59.840877 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:35:59.840877 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:35:59.840877 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:35:59.840877 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:35:59.840877 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:35:59.840877 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2778f5f5-ea59-43c9-860f-17210bcbbbd2 could not be found. Aug 07 01:35:59.840877 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:35:59.840877 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-860ac962-057a-4319-9fe5-03bc92b3b241 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Returning 404 to user: Instance 2778f5f5-ea59-43c9-860f-17210bcbbbd2 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:35:59.840877 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-860ac962-057a-4319-9fe5-03bc92b3b241 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2" status: 404 len: 111 microversion: 2.1 time: 0.118228 Aug 07 01:35:59.851308 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2263/4976] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:59 2022] GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:35:59.869320 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7530a788-6333-4df6-a3b4-873fa1eee94f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:35:59.871212 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7530a788-6333-4df6-a3b4-873fa1eee94f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: 6c6fe9cb-d330-478c-ac33-4e865087d6d1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:00.277170 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-50d93eae-6a2e-490d-abc1-ca80ac7b1868 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd25a3a76ca4b399ddaf730a1d96878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '610bac63014f490db55c2cdbb89bc46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:00.290375 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-50d93eae-6a2e-490d-abc1-ca80ac7b1868 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] 10.222.0.39 "GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84" status: 200 len: 1316 microversion: 2.1 time: 0.965649 Aug 07 01:36:00.295238 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2714/4977] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:35:59 2022] GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84 => generated 1316 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:00.315564 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5abb9745-2b87-4d59-be0f-b811c729c180 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '.version_select at 0x7f9e170f1b80>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:00.376790 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5abb9745-2b87-4d59-be0f-b811c729c180 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1833659768" status: 202 len: 0 microversion: 2.1 time: 0.079451 Aug 07 01:36:00.377943 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2715/4978] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Aug 7 01:36:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1833659768 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:36:00.389343 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ebcef414-0765-4d4c-9dc8-61dcb3d30c80 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:00.409327 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ebcef414-0765-4d4c-9dc8-61dcb3d30c80 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:00.430609 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ebcef414-0765-4d4c-9dc8-61dcb3d30c80 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:00.437379 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ebcef414-0765-4d4c-9dc8-61dcb3d30c80 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:00.438145 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ebcef414-0765-4d4c-9dc8-61dcb3d30c80 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:00.439014 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ebcef414-0765-4d4c-9dc8-61dcb3d30c80 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:00.447513 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ebcef414-0765-4d4c-9dc8-61dcb3d30c80 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:00.448291 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ebcef414-0765-4d4c-9dc8-61dcb3d30c80 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:00.547566 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7530a788-6333-4df6-a3b4-873fa1eee94f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:00.582058 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7530a788-6333-4df6-a3b4-873fa1eee94f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:00.586618 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ebcef414-0765-4d4c-9dc8-61dcb3d30c80 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.207033 Aug 07 01:36:00.588772 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7530a788-6333-4df6-a3b4-873fa1eee94f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:00.591047 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7530a788-6333-4df6-a3b4-873fa1eee94f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/6c6fe9cb-d330-478c-ac33-4e865087d6d1" status: 200 len: 1278 microversion: 2.47 time: 0.738712 Aug 07 01:36:00.593995 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2716/4980] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Aug 7 01:36:00 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments => generated 197 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:36:00.600781 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2264/4980] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:35:59 2022] GET /compute/v2.1/servers/6c6fe9cb-d330-478c-ac33-4e865087d6d1 => generated 1278 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:00.870565 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d77c6d90-b1a9-4d92-bd03-fdaef86e0d0c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-714040569", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": "none"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:36:01.004099 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-d77c6d90-b1a9-4d92-bd03-fdaef86e0d0c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:36:01.004923 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-d77c6d90-b1a9-4d92-bd03-fdaef86e0d0c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:36:01.006365 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-d77c6d90-b1a9-4d92-bd03-fdaef86e0d0c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:36:01.009229 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-d77c6d90-b1a9-4d92-bd03-fdaef86e0d0c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:36:01.010126 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-d77c6d90-b1a9-4d92-bd03-fdaef86e0d0c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:36:01.028153 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d77c6d90-b1a9-4d92-bd03-fdaef86e0d0c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:01.029154 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d77c6d90-b1a9-4d92-bd03-fdaef86e0d0c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:01.030255 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d77c6d90-b1a9-4d92-bd03-fdaef86e0d0c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:01.032580 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d77c6d90-b1a9-4d92-bd03-fdaef86e0d0c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:01.035569 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d77c6d90-b1a9-4d92-bd03-fdaef86e0d0c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:01.037889 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d77c6d90-b1a9-4d92-bd03-fdaef86e0d0c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:01.066438 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:01.081078 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-d77c6d90-b1a9-4d92-bd03-fdaef86e0d0c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Getting quotas for project f3e3bf9d373e43bea6c02b31d2e2e2ed. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:36:01.088853 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:01.091142 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-d77c6d90-b1a9-4d92-bd03-fdaef86e0d0c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Getting quotas for user 1e08144123ad4d3e93e6b6fbe2acf03a and project f3e3bf9d373e43bea6c02b31d2e2e2ed. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:36:01.129623 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d77c6d90-b1a9-4d92-bd03-fdaef86e0d0c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:36:01.132938 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d77c6d90-b1a9-4d92-bd03-fdaef86e0d0c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:36:01.263587 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d77c6d90-b1a9-4d92-bd03-fdaef86e0d0c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.399641 Aug 07 01:36:01.273247 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2717/4981] 10.222.0.39 () {62 vars in 1188 bytes} [Sun Aug 7 01:36:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 410 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 07 01:36:01.287154 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ed8899a2-a702-49d3-a8d6-f7a933744ca8 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:36:01.289958 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ed8899a2-a702-49d3-a8d6-f7a933744ca8 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:01.325722 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f88aa8b1-51fa-40d4-8cd3-5baade282bf6 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:01.326975 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f88aa8b1-51fa-40d4-8cd3-5baade282bf6 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] [instance: 182a97f3-ed16-4941-83b2-e15f51e02f84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:01.348658 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f88aa8b1-51fa-40d4-8cd3-5baade282bf6 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:01.353766 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f88aa8b1-51fa-40d4-8cd3-5baade282bf6 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:01.356155 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f88aa8b1-51fa-40d4-8cd3-5baade282bf6 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:01.358279 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f88aa8b1-51fa-40d4-8cd3-5baade282bf6 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:01.362105 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f88aa8b1-51fa-40d4-8cd3-5baade282bf6 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:01.362960 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f88aa8b1-51fa-40d4-8cd3-5baade282bf6 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:01.479274 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ed8899a2-a702-49d3-a8d6-f7a933744ca8 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "PUT /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7" status: 200 len: 991 microversion: 2.47 time: 0.200282 Aug 07 01:36:01.480602 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2265/4982] 10.222.0.39 () {62 vars in 1297 bytes} [Sun Aug 7 01:36:01 2022] PUT /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7 => generated 991 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:36:01.502449 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-24ff4e8b-1103-4721-8367-f966be8299ef tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:01.503063 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-24ff4e8b-1103-4721-8367-f966be8299ef tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:01.916912 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-24ff4e8b-1103-4721-8367-f966be8299ef tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:01.933200 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-24ff4e8b-1103-4721-8367-f966be8299ef tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:01.939249 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-24ff4e8b-1103-4721-8367-f966be8299ef tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:01.944262 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-24ff4e8b-1103-4721-8367-f966be8299ef tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7" status: 200 len: 1277 microversion: 2.47 time: 0.446156 Aug 07 01:36:01.947687 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2266/4983] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:01 2022] GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7 => generated 1277 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:01.976042 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e9c0b11e-d9c4-4161-b895-90d4e8b45140 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:01.988014 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e9c0b11e-d9c4-4161-b895-90d4e8b45140 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:02.001087 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9c0b11e-d9c4-4161-b895-90d4e8b45140 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:02.007249 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9c0b11e-d9c4-4161-b895-90d4e8b45140 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:02.007966 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9c0b11e-d9c4-4161-b895-90d4e8b45140 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:02.010956 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9c0b11e-d9c4-4161-b895-90d4e8b45140 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:02.014313 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9c0b11e-d9c4-4161-b895-90d4e8b45140 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:02.018783 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9c0b11e-d9c4-4161-b895-90d4e8b45140 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:02.134579 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e9c0b11e-d9c4-4161-b895-90d4e8b45140 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.185505 Aug 07 01:36:02.147437 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2267/4984] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Aug 7 01:36:01 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments => generated 197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:36:02.232817 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f88aa8b1-51fa-40d4-8cd3-5baade282bf6 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd25a3a76ca4b399ddaf730a1d96878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '610bac63014f490db55c2cdbb89bc46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:02.254304 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f88aa8b1-51fa-40d4-8cd3-5baade282bf6 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] 10.222.0.39 "GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84" status: 200 len: 1316 microversion: 2.1 time: 0.934611 Aug 07 01:36:02.267917 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2718/4985] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:01 2022] GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84 => generated 1316 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:02.457310 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-b3862d93-4288-49be-8dbf-ad675aa6f1c2 req-d6248aec-5dba-423e-8ea2-7b7a851fd945 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2778f5f5-ea59-43c9-860f-17210bcbbbd2", "name": "network-vif-deleted", "tag": "5ee9e334-5554-4e37-809a-d105e888e112"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:36:02.498791 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b3862d93-4288-49be-8dbf-ad675aa6f1c2 req-d6248aec-5dba-423e-8ea2-7b7a851fd945 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:02.503601 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b3862d93-4288-49be-8dbf-ad675aa6f1c2 req-d6248aec-5dba-423e-8ea2-7b7a851fd945 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:02.504310 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b3862d93-4288-49be-8dbf-ad675aa6f1c2 req-d6248aec-5dba-423e-8ea2-7b7a851fd945 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:02.550060 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-b3862d93-4288-49be-8dbf-ad675aa6f1c2 req-d6248aec-5dba-423e-8ea2-7b7a851fd945 service nova] Creating event network-vif-deleted:5ee9e334-5554-4e37-809a-d105e888e112 for instance 2778f5f5-ea59-43c9-860f-17210bcbbbd2 on n-h1-master-1 Aug 07 01:36:02.572243 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-b3862d93-4288-49be-8dbf-ad675aa6f1c2 req-d6248aec-5dba-423e-8ea2-7b7a851fd945 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122101 Aug 07 01:36:02.574997 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2268/4986] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:36:02.978695 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8b8b5a43-8526-4003-9807-a10f5475f2df tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:02.979382 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8b8b5a43-8526-4003-9807-a10f5475f2df tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:03.000376 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b8b5a43-8526-4003-9807-a10f5475f2df tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:03.000998 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b8b5a43-8526-4003-9807-a10f5475f2df tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:03.001451 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b8b5a43-8526-4003-9807-a10f5475f2df tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:03.002202 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b8b5a43-8526-4003-9807-a10f5475f2df tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:03.006965 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b8b5a43-8526-4003-9807-a10f5475f2df tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:03.007464 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b8b5a43-8526-4003-9807-a10f5475f2df tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:03.148644 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-90d2b320-795a-4c11-b5c5-4bc2b6e6e6cb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:03.151138 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-90d2b320-795a-4c11-b5c5-4bc2b6e6e6cb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:03.166761 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90d2b320-795a-4c11-b5c5-4bc2b6e6e6cb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:03.168769 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90d2b320-795a-4c11-b5c5-4bc2b6e6e6cb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:03.169291 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90d2b320-795a-4c11-b5c5-4bc2b6e6e6cb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:03.170027 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90d2b320-795a-4c11-b5c5-4bc2b6e6e6cb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:03.171323 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90d2b320-795a-4c11-b5c5-4bc2b6e6e6cb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:03.172619 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90d2b320-795a-4c11-b5c5-4bc2b6e6e6cb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:03.236314 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-90d2b320-795a-4c11-b5c5-4bc2b6e6e6cb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.092631 Aug 07 01:36:03.237379 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2269/4987] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Aug 7 01:36:03 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:36:03.278036 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5cfad91f-8a06-4e53-a045-57770b4097aa tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:03.278859 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5cfad91f-8a06-4e53-a045-57770b4097aa tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] [instance: 182a97f3-ed16-4941-83b2-e15f51e02f84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:03.291384 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5cfad91f-8a06-4e53-a045-57770b4097aa tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:03.291909 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5cfad91f-8a06-4e53-a045-57770b4097aa tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:03.293487 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5cfad91f-8a06-4e53-a045-57770b4097aa tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:03.294260 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5cfad91f-8a06-4e53-a045-57770b4097aa tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:03.294801 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5cfad91f-8a06-4e53-a045-57770b4097aa tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:03.295242 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5cfad91f-8a06-4e53-a045-57770b4097aa tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:03.574729 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5cfad91f-8a06-4e53-a045-57770b4097aa tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd25a3a76ca4b399ddaf730a1d96878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '610bac63014f490db55c2cdbb89bc46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:03.594986 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5cfad91f-8a06-4e53-a045-57770b4097aa tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] 10.222.0.39 "GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84" status: 200 len: 1316 microversion: 2.1 time: 0.321523 Aug 07 01:36:03.608613 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2270/4988] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:03 2022] GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84 => generated 1316 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:36:03.631990 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8b8b5a43-8526-4003-9807-a10f5475f2df tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:03.641578 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8b8b5a43-8526-4003-9807-a10f5475f2df tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:03.644354 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8b8b5a43-8526-4003-9807-a10f5475f2df tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:03.647152 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8b8b5a43-8526-4003-9807-a10f5475f2df tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7" status: 200 len: 1281 microversion: 2.47 time: 0.672505 Aug 07 01:36:03.647745 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2719/4989] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:02 2022] GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7 => generated 1281 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:36:04.247921 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-59239520-3848-430b-a2e0-fe34d4f03feb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:04.250168 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-59239520-3848-430b-a2e0-fe34d4f03feb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:04.253852 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:04.269604 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59239520-3848-430b-a2e0-fe34d4f03feb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:04.292312 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59239520-3848-430b-a2e0-fe34d4f03feb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:04.292895 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59239520-3848-430b-a2e0-fe34d4f03feb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:04.293922 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59239520-3848-430b-a2e0-fe34d4f03feb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:04.294618 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59239520-3848-430b-a2e0-fe34d4f03feb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:04.295289 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59239520-3848-430b-a2e0-fe34d4f03feb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:04.346463 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-59239520-3848-430b-a2e0-fe34d4f03feb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.102493 Aug 07 01:36:04.370782 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2271/4990] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Aug 7 01:36:04 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91/os-volume_attachments => generated 25 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:04.472191 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-189764cf-8fbf-4ac7-969b-5e9142578dfd tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:04.473303 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-189764cf-8fbf-4ac7-969b-5e9142578dfd tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:04.481260 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-189764cf-8fbf-4ac7-969b-5e9142578dfd tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:04.482237 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-189764cf-8fbf-4ac7-969b-5e9142578dfd tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:04.482997 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-189764cf-8fbf-4ac7-969b-5e9142578dfd tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:04.484184 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-189764cf-8fbf-4ac7-969b-5e9142578dfd tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:04.485262 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-189764cf-8fbf-4ac7-969b-5e9142578dfd tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:04.486153 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-189764cf-8fbf-4ac7-969b-5e9142578dfd tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:04.523125 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-189764cf-8fbf-4ac7-969b-5e9142578dfd tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:36:04.622822 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-69b00089-f4b6-461d-ac49-f1a7cbd4099f tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:04.623943 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-69b00089-f4b6-461d-ac49-f1a7cbd4099f tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] [instance: 182a97f3-ed16-4941-83b2-e15f51e02f84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:04.634432 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-69b00089-f4b6-461d-ac49-f1a7cbd4099f tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:04.638227 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-69b00089-f4b6-461d-ac49-f1a7cbd4099f tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:04.638910 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-69b00089-f4b6-461d-ac49-f1a7cbd4099f tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:04.642525 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-69b00089-f4b6-461d-ac49-f1a7cbd4099f tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:04.645442 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-69b00089-f4b6-461d-ac49-f1a7cbd4099f tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:04.646839 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-69b00089-f4b6-461d-ac49-f1a7cbd4099f tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:04.699050 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-189764cf-8fbf-4ac7-969b-5e9142578dfd tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 204 len: 0 microversion: 2.20 time: 0.233089 Aug 07 01:36:04.700101 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2720/4991] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Aug 7 01:36:04 2022] DELETE /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 01:36:04.707739 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3493ce07-7b33-4609-96f9-8fbe2ab70cff tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:04.709389 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3493ce07-7b33-4609-96f9-8fbe2ab70cff tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:04.717846 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3493ce07-7b33-4609-96f9-8fbe2ab70cff tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:04.718666 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3493ce07-7b33-4609-96f9-8fbe2ab70cff tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:04.719334 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3493ce07-7b33-4609-96f9-8fbe2ab70cff tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:04.721737 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3493ce07-7b33-4609-96f9-8fbe2ab70cff tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:04.722411 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3493ce07-7b33-4609-96f9-8fbe2ab70cff tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:04.723035 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3493ce07-7b33-4609-96f9-8fbe2ab70cff tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:04.844330 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3493ce07-7b33-4609-96f9-8fbe2ab70cff tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:04.854171 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3493ce07-7b33-4609-96f9-8fbe2ab70cff tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:04.862059 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3493ce07-7b33-4609-96f9-8fbe2ab70cff tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:04.863272 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3493ce07-7b33-4609-96f9-8fbe2ab70cff tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7" status: 200 len: 1329 microversion: 2.47 time: 0.161295 Aug 07 01:36:04.863861 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2721/4992] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:04 2022] GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7 => generated 1329 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:04.881771 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-38533b34-9f7b-4900-bb4f-0d18c825448f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:04.882476 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-38533b34-9f7b-4900-bb4f-0d18c825448f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:04.909801 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38533b34-9f7b-4900-bb4f-0d18c825448f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:04.910327 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38533b34-9f7b-4900-bb4f-0d18c825448f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:04.910768 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38533b34-9f7b-4900-bb4f-0d18c825448f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:04.911599 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38533b34-9f7b-4900-bb4f-0d18c825448f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:04.912532 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38533b34-9f7b-4900-bb4f-0d18c825448f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:04.912964 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38533b34-9f7b-4900-bb4f-0d18c825448f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:05.100383 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-69b00089-f4b6-461d-ac49-f1a7cbd4099f tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd25a3a76ca4b399ddaf730a1d96878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '610bac63014f490db55c2cdbb89bc46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:05.114793 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-69b00089-f4b6-461d-ac49-f1a7cbd4099f tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] 10.222.0.39 "GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84" status: 200 len: 1316 microversion: 2.1 time: 0.497153 Aug 07 01:36:05.120045 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2272/4993] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:04 2022] GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84 => generated 1316 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:05.127499 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ea3329c0-2909-49e0-80c7-2251b4fed47c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Action: 'create', calling method: .version_select at 0x7f9e175aaca0>, body: {"keypair": {"name": "tempest-keypair-521865895", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKO3b2inLqDaj1jy2Y0Gg1Z6wCMHND4HveMVtNgw7MjWGEdg1wfbPdpqzDi65WLr7ASF+sTL+yvyWGV7WNKSBTPgfdConJrD8TuCDLAJGAaLGEQKqW5M2YT9FT2/mWbHQA=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:36:05.151292 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-ea3329c0-2909-49e0-80c7-2251b4fed47c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Getting quotas for project b630a4c3bb824b90b4c1898a92b47aa7. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:36:05.166643 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-ea3329c0-2909-49e0-80c7-2251b4fed47c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Getting quotas for user d556a8ae0d524894a93203ce3f70d420 and project b630a4c3bb824b90b4c1898a92b47aa7. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:36:05.213861 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ea3329c0-2909-49e0-80c7-2251b4fed47c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.092243 Aug 07 01:36:05.215665 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2273/4994] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:36:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:36:05.467616 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-38533b34-9f7b-4900-bb4f-0d18c825448f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:05.482601 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-38533b34-9f7b-4900-bb4f-0d18c825448f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:05.493640 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-38533b34-9f7b-4900-bb4f-0d18c825448f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:05.495032 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-38533b34-9f7b-4900-bb4f-0d18c825448f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1723 microversion: 2.20 time: 0.621574 Aug 07 01:36:05.495732 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2722/4995] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:04 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1723 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:05.891444 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-aa25139f-1e8e-4c4c-909b-1e805de09689 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:05.892550 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-aa25139f-1e8e-4c4c-909b-1e805de09689 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:05.910919 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa25139f-1e8e-4c4c-909b-1e805de09689 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:05.913030 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa25139f-1e8e-4c4c-909b-1e805de09689 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:05.914637 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa25139f-1e8e-4c4c-909b-1e805de09689 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:05.917202 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa25139f-1e8e-4c4c-909b-1e805de09689 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:05.919119 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa25139f-1e8e-4c4c-909b-1e805de09689 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:05.921107 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa25139f-1e8e-4c4c-909b-1e805de09689 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:06.156588 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1fff623a-3eb6-44ce-bdf4-57f30f9c18f4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1124475244", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:36:06.176108 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-aa25139f-1e8e-4c4c-909b-1e805de09689 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:06.185274 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-aa25139f-1e8e-4c4c-909b-1e805de09689 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:06.197666 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-aa25139f-1e8e-4c4c-909b-1e805de09689 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:06.201745 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-aa25139f-1e8e-4c4c-909b-1e805de09689 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7" status: 200 len: 1337 microversion: 2.47 time: 0.314934 Aug 07 01:36:06.215911 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2723/4996] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:05 2022] GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7 => generated 1337 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:36:06.215911 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-059ec015-cfd7-4111-a987-7d4fac512098 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:06.229907 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-059ec015-cfd7-4111-a987-7d4fac512098 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] [instance: 182a97f3-ed16-4941-83b2-e15f51e02f84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:06.282044 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-059ec015-cfd7-4111-a987-7d4fac512098 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:06.284868 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-059ec015-cfd7-4111-a987-7d4fac512098 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:06.288308 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-059ec015-cfd7-4111-a987-7d4fac512098 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:06.288308 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-059ec015-cfd7-4111-a987-7d4fac512098 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:06.288730 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-059ec015-cfd7-4111-a987-7d4fac512098 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:06.289179 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-059ec015-cfd7-4111-a987-7d4fac512098 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:06.314658 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-1fff623a-3eb6-44ce-bdf4-57f30f9c18f4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] validate_networks() for [('c0b29de8-90e5-40f4-96e9-6f7364b06446', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:36:06.735626 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-059ec015-cfd7-4111-a987-7d4fac512098 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd25a3a76ca4b399ddaf730a1d96878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '610bac63014f490db55c2cdbb89bc46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:06.746150 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-059ec015-cfd7-4111-a987-7d4fac512098 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] 10.222.0.39 "GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84" status: 200 len: 1316 microversion: 2.1 time: 0.540224 Aug 07 01:36:06.747739 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2724/4997] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:06 2022] GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84 => generated 1316 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:06.752880 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-daffaabf-2345-40b2-bda2-c8a099e674de tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:06.753742 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-daffaabf-2345-40b2-bda2-c8a099e674de tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:06.760529 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-daffaabf-2345-40b2-bda2-c8a099e674de tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:06.761327 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-daffaabf-2345-40b2-bda2-c8a099e674de tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:06.761919 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-daffaabf-2345-40b2-bda2-c8a099e674de tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:06.762832 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-daffaabf-2345-40b2-bda2-c8a099e674de tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:06.763455 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-daffaabf-2345-40b2-bda2-c8a099e674de tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:06.764098 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-daffaabf-2345-40b2-bda2-c8a099e674de tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:06.973641 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-daffaabf-2345-40b2-bda2-c8a099e674de tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:06.985686 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-daffaabf-2345-40b2-bda2-c8a099e674de tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:06.997069 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-daffaabf-2345-40b2-bda2-c8a099e674de tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:06.998906 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-daffaabf-2345-40b2-bda2-c8a099e674de tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1723 microversion: 2.20 time: 0.249813 Aug 07 01:36:07.013287 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2725/4998] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:06 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:07.230350 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c8f44de9-8bfb-44f5-9be1-00d8719c4ebb tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:07.231345 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c8f44de9-8bfb-44f5-9be1-00d8719c4ebb tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:07.243152 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c8f44de9-8bfb-44f5-9be1-00d8719c4ebb tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:07.244457 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c8f44de9-8bfb-44f5-9be1-00d8719c4ebb tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:07.246310 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c8f44de9-8bfb-44f5-9be1-00d8719c4ebb tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:07.248003 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c8f44de9-8bfb-44f5-9be1-00d8719c4ebb tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:07.252241 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c8f44de9-8bfb-44f5-9be1-00d8719c4ebb tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:07.253643 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c8f44de9-8bfb-44f5-9be1-00d8719c4ebb tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:08.114524 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c8f44de9-8bfb-44f5-9be1-00d8719c4ebb tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:08.131829 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c8f44de9-8bfb-44f5-9be1-00d8719c4ebb tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:08.135459 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c8f44de9-8bfb-44f5-9be1-00d8719c4ebb tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:08.137876 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c8f44de9-8bfb-44f5-9be1-00d8719c4ebb tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7" status: 200 len: 1335 microversion: 2.47 time: 0.910751 Aug 07 01:36:08.138988 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2726/4999] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:07 2022] GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7 => generated 1335 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:08.270258 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-4c16a0b7-ef21-4288-9d74-9b5419845ddf req-2e31d138-0a43-43b8-ba61-ede3d4bb8d5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "182a97f3-ed16-4941-83b2-e15f51e02f84", "name": "network-vif-plugged", "status": "completed", "tag": "eb0460e9-ec73-48d2-a85f-25d802440bf7"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:36:08.290463 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4c16a0b7-ef21-4288-9d74-9b5419845ddf req-2e31d138-0a43-43b8-ba61-ede3d4bb8d5b service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:08.292630 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4c16a0b7-ef21-4288-9d74-9b5419845ddf req-2e31d138-0a43-43b8-ba61-ede3d4bb8d5b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:08.295585 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4c16a0b7-ef21-4288-9d74-9b5419845ddf req-2e31d138-0a43-43b8-ba61-ede3d4bb8d5b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:08.319995 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-4c16a0b7-ef21-4288-9d74-9b5419845ddf req-2e31d138-0a43-43b8-ba61-ede3d4bb8d5b service nova] Creating event network-vif-plugged:eb0460e9-ec73-48d2-a85f-25d802440bf7 for instance 182a97f3-ed16-4941-83b2-e15f51e02f84 on n-h1-master-1 Aug 07 01:36:08.342053 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-4c16a0b7-ef21-4288-9d74-9b5419845ddf req-2e31d138-0a43-43b8-ba61-ede3d4bb8d5b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194123 Aug 07 01:36:08.342858 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2727/5000] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:36:08.351593 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cfcb004b-faa7-4ecf-9b8e-f2ed2498c4d0 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:08.352981 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cfcb004b-faa7-4ecf-9b8e-f2ed2498c4d0 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] [instance: 182a97f3-ed16-4941-83b2-e15f51e02f84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:08.369927 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfcb004b-faa7-4ecf-9b8e-f2ed2498c4d0 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:08.372634 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfcb004b-faa7-4ecf-9b8e-f2ed2498c4d0 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:08.374546 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfcb004b-faa7-4ecf-9b8e-f2ed2498c4d0 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:08.377981 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfcb004b-faa7-4ecf-9b8e-f2ed2498c4d0 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:08.378727 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfcb004b-faa7-4ecf-9b8e-f2ed2498c4d0 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:08.382183 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfcb004b-faa7-4ecf-9b8e-f2ed2498c4d0 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:09.319022 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cfcb004b-faa7-4ecf-9b8e-f2ed2498c4d0 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd25a3a76ca4b399ddaf730a1d96878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '610bac63014f490db55c2cdbb89bc46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:09.333485 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cfcb004b-faa7-4ecf-9b8e-f2ed2498c4d0 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] 10.222.0.39 "GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84" status: 200 len: 1316 microversion: 2.1 time: 0.989226 Aug 07 01:36:09.337979 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2728/5001] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:08 2022] GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84 => generated 1316 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:09.344488 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4d125d86-6063-49d3-b692-23a8a4cbfad3 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:09.349749 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4d125d86-6063-49d3-b692-23a8a4cbfad3 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:09.369642 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d125d86-6063-49d3-b692-23a8a4cbfad3 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:09.371081 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d125d86-6063-49d3-b692-23a8a4cbfad3 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:09.371544 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d125d86-6063-49d3-b692-23a8a4cbfad3 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:09.372402 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d125d86-6063-49d3-b692-23a8a4cbfad3 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:09.372871 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d125d86-6063-49d3-b692-23a8a4cbfad3 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:09.373308 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d125d86-6063-49d3-b692-23a8a4cbfad3 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:09.502812 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-1fff623a-3eb6-44ce-bdf4-57f30f9c18f4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:36:09.504100 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-1fff623a-3eb6-44ce-bdf4-57f30f9c18f4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:36:09.504617 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-1fff623a-3eb6-44ce-bdf4-57f30f9c18f4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:36:09.505083 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-1fff623a-3eb6-44ce-bdf4-57f30f9c18f4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:36:09.506300 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-1fff623a-3eb6-44ce-bdf4-57f30f9c18f4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:36:09.514324 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:09.531657 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1fff623a-3eb6-44ce-bdf4-57f30f9c18f4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:09.534066 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1fff623a-3eb6-44ce-bdf4-57f30f9c18f4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:09.534748 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1fff623a-3eb6-44ce-bdf4-57f30f9c18f4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:09.541223 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1fff623a-3eb6-44ce-bdf4-57f30f9c18f4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:09.542011 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1fff623a-3eb6-44ce-bdf4-57f30f9c18f4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:09.542643 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1fff623a-3eb6-44ce-bdf4-57f30f9c18f4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:09.590401 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-1fff623a-3eb6-44ce-bdf4-57f30f9c18f4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Getting quotas for project 70f17360f0c84562bd99b006b659736e. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:36:09.600774 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-1fff623a-3eb6-44ce-bdf4-57f30f9c18f4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Getting quotas for user 2f5acf7da18b43f89e24760744cfdb49 and project 70f17360f0c84562bd99b006b659736e. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:36:09.632678 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1fff623a-3eb6-44ce-bdf4-57f30f9c18f4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:36:09.635313 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1fff623a-3eb6-44ce-bdf4-57f30f9c18f4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:36:09.717158 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1fff623a-3eb6-44ce-bdf4-57f30f9c18f4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.835233 Aug 07 01:36:09.718114 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2274/5002] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:36:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 3837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 07 01:36:09.732539 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f1631d0e-dfc8-4dbe-8a27-775786e6ef3e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:09.735918 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f1631d0e-dfc8-4dbe-8a27-775786e6ef3e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:09.759414 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1631d0e-dfc8-4dbe-8a27-775786e6ef3e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:09.760314 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1631d0e-dfc8-4dbe-8a27-775786e6ef3e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:09.763657 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1631d0e-dfc8-4dbe-8a27-775786e6ef3e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:09.764749 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1631d0e-dfc8-4dbe-8a27-775786e6ef3e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:09.766680 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1631d0e-dfc8-4dbe-8a27-775786e6ef3e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:09.767368 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1631d0e-dfc8-4dbe-8a27-775786e6ef3e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:09.893079 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4d125d86-6063-49d3-b692-23a8a4cbfad3 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:09.934907 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4d125d86-6063-49d3-b692-23a8a4cbfad3 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:09.938072 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4d125d86-6063-49d3-b692-23a8a4cbfad3 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:09.940447 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4d125d86-6063-49d3-b692-23a8a4cbfad3 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1723 microversion: 2.20 time: 0.601219 Aug 07 01:36:09.958496 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2729/5003] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:09 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1723 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:09.967568 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-79ce2def-c115-484f-93e6-23cc05f99bca tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:09.968608 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-79ce2def-c115-484f-93e6-23cc05f99bca tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:10.040970 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f1631d0e-dfc8-4dbe-8a27-775786e6ef3e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:10.074860 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f1631d0e-dfc8-4dbe-8a27-775786e6ef3e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:10.083343 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f1631d0e-dfc8-4dbe-8a27-775786e6ef3e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:10.084604 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f1631d0e-dfc8-4dbe-8a27-775786e6ef3e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7" status: 200 len: 1335 microversion: 2.47 time: 0.362340 Aug 07 01:36:10.099202 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2275/5004] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:09 2022] GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7 => generated 1335 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:10.139565 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-79ce2def-c115-484f-93e6-23cc05f99bca tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:10.149513 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-79ce2def-c115-484f-93e6-23cc05f99bca tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d" status: 200 len: 1222 microversion: 2.1 time: 0.185168 Aug 07 01:36:10.152781 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2730/5005] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:09 2022] GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d => generated 1222 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:10.284368 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-977bd5f6-96b7-4412-ae43-46411a191884 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1548128809", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:36:10.358585 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c483199c-29fa-4273-90a8-66a7d54c490f tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:10.359112 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c483199c-29fa-4273-90a8-66a7d54c490f tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] [instance: 182a97f3-ed16-4941-83b2-e15f51e02f84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:10.390538 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c483199c-29fa-4273-90a8-66a7d54c490f tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:10.391041 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c483199c-29fa-4273-90a8-66a7d54c490f tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:10.391478 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c483199c-29fa-4273-90a8-66a7d54c490f tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:10.395663 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c483199c-29fa-4273-90a8-66a7d54c490f tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:10.398430 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c483199c-29fa-4273-90a8-66a7d54c490f tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:10.400439 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c483199c-29fa-4273-90a8-66a7d54c490f tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:10.410871 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-977bd5f6-96b7-4412-ae43-46411a191884 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] validate_networks() for [('c0b29de8-90e5-40f4-96e9-6f7364b06446', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:36:11.004071 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c483199c-29fa-4273-90a8-66a7d54c490f tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd25a3a76ca4b399ddaf730a1d96878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '610bac63014f490db55c2cdbb89bc46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:11.017159 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c483199c-29fa-4273-90a8-66a7d54c490f tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] 10.222.0.39 "GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84" status: 200 len: 1316 microversion: 2.1 time: 0.662865 Aug 07 01:36:11.020245 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2731/5006] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:10 2022] GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84 => generated 1316 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:11.029325 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-86f00b32-c0c6-4912-ae81-aaeb13ed28b5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:11.031020 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-86f00b32-c0c6-4912-ae81-aaeb13ed28b5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:11.046738 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86f00b32-c0c6-4912-ae81-aaeb13ed28b5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:11.047569 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86f00b32-c0c6-4912-ae81-aaeb13ed28b5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:11.048274 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86f00b32-c0c6-4912-ae81-aaeb13ed28b5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:11.049237 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86f00b32-c0c6-4912-ae81-aaeb13ed28b5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:11.049957 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86f00b32-c0c6-4912-ae81-aaeb13ed28b5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:11.058288 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86f00b32-c0c6-4912-ae81-aaeb13ed28b5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:11.069730 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:11.359946 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-86f00b32-c0c6-4912-ae81-aaeb13ed28b5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:11.371477 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-86f00b32-c0c6-4912-ae81-aaeb13ed28b5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:11.373135 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-86f00b32-c0c6-4912-ae81-aaeb13ed28b5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:11.374736 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-86f00b32-c0c6-4912-ae81-aaeb13ed28b5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1723 microversion: 2.20 time: 0.353022 Aug 07 01:36:11.389223 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2732/5007] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:11 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1723 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:11.399972 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7cd9fbd8-5d54-4c32-83d9-7e3c234b2914 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:11.400688 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7cd9fbd8-5d54-4c32-83d9-7e3c234b2914 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:11.410421 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7cd9fbd8-5d54-4c32-83d9-7e3c234b2914 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:11.412616 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7cd9fbd8-5d54-4c32-83d9-7e3c234b2914 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:11.413264 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7cd9fbd8-5d54-4c32-83d9-7e3c234b2914 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:11.414173 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7cd9fbd8-5d54-4c32-83d9-7e3c234b2914 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:11.414854 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7cd9fbd8-5d54-4c32-83d9-7e3c234b2914 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:11.415446 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7cd9fbd8-5d54-4c32-83d9-7e3c234b2914 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:11.526941 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7cd9fbd8-5d54-4c32-83d9-7e3c234b2914 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:11.540675 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7cd9fbd8-5d54-4c32-83d9-7e3c234b2914 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:11.542917 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7cd9fbd8-5d54-4c32-83d9-7e3c234b2914 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:11.545237 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7cd9fbd8-5d54-4c32-83d9-7e3c234b2914 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7" status: 200 len: 1356 microversion: 2.47 time: 0.154689 Aug 07 01:36:11.561543 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2733/5008] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:11 2022] GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7 => generated 1356 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:11.562050 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4481073e-0f93-41ef-84d1-96c4428346e2 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-796856348", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "16f1e04e-f3dd-4247-8125-839e2140524d"}], "security_groups": [{"name": "tempest-securitygroup--450925192"}], "key_name": "tempest-keypair-521865895", "user_data": "}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:36:11.785414 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-4481073e-0f93-41ef-84d1-96c4428346e2 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] validate_networks() for [('16f1e04e-f3dd-4247-8125-839e2140524d', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:36:12.433477 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-4481073e-0f93-41ef-84d1-96c4428346e2 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:36:12.434945 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-4481073e-0f93-41ef-84d1-96c4428346e2 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:36:12.435859 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-4481073e-0f93-41ef-84d1-96c4428346e2 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:36:12.436719 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-4481073e-0f93-41ef-84d1-96c4428346e2 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:36:12.437240 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-4481073e-0f93-41ef-84d1-96c4428346e2 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:36:12.450588 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4481073e-0f93-41ef-84d1-96c4428346e2 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:12.451176 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4481073e-0f93-41ef-84d1-96c4428346e2 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:12.451697 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4481073e-0f93-41ef-84d1-96c4428346e2 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:12.452731 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4481073e-0f93-41ef-84d1-96c4428346e2 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:12.453435 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4481073e-0f93-41ef-84d1-96c4428346e2 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:12.454466 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4481073e-0f93-41ef-84d1-96c4428346e2 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:12.488984 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-4481073e-0f93-41ef-84d1-96c4428346e2 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Getting quotas for project b630a4c3bb824b90b4c1898a92b47aa7. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:36:12.497685 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-4481073e-0f93-41ef-84d1-96c4428346e2 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Getting quotas for user d556a8ae0d524894a93203ce3f70d420 and project b630a4c3bb824b90b4c1898a92b47aa7. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:36:12.512935 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4481073e-0f93-41ef-84d1-96c4428346e2 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:36:12.515833 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4481073e-0f93-41ef-84d1-96c4428346e2 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 0658227f-88e6-40fd-bb8f-aa6267addc84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:36:12.588749 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4481073e-0f93-41ef-84d1-96c4428346e2 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.039199 Aug 07 01:36:12.590950 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2734/5009] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:36:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 1042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:36:12.597301 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-977bd5f6-96b7-4412-ae43-46411a191884 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:36:12.598033 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-86de04a8-749f-456d-9568-2a0e8fef055f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:36:12.599051 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-977bd5f6-96b7-4412-ae43-46411a191884 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:36:12.599842 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-977bd5f6-96b7-4412-ae43-46411a191884 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:36:12.600445 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-977bd5f6-96b7-4412-ae43-46411a191884 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:36:12.601031 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-977bd5f6-96b7-4412-ae43-46411a191884 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:36:12.607616 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-86de04a8-749f-456d-9568-2a0e8fef055f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:12.621571 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-977bd5f6-96b7-4412-ae43-46411a191884 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:12.622710 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-977bd5f6-96b7-4412-ae43-46411a191884 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:12.623157 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-977bd5f6-96b7-4412-ae43-46411a191884 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:12.623976 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-977bd5f6-96b7-4412-ae43-46411a191884 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:12.627724 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-977bd5f6-96b7-4412-ae43-46411a191884 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:12.628423 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-977bd5f6-96b7-4412-ae43-46411a191884 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:12.629513 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86de04a8-749f-456d-9568-2a0e8fef055f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:12.630050 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86de04a8-749f-456d-9568-2a0e8fef055f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:12.630491 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86de04a8-749f-456d-9568-2a0e8fef055f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:12.631212 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86de04a8-749f-456d-9568-2a0e8fef055f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:12.633517 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86de04a8-749f-456d-9568-2a0e8fef055f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:12.633724 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86de04a8-749f-456d-9568-2a0e8fef055f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:12.639260 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:12.680813 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-977bd5f6-96b7-4412-ae43-46411a191884 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Getting quotas for project 70f17360f0c84562bd99b006b659736e. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:36:12.734817 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-977bd5f6-96b7-4412-ae43-46411a191884 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Getting quotas for user 2f5acf7da18b43f89e24760744cfdb49 and project 70f17360f0c84562bd99b006b659736e. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:36:12.766799 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-977bd5f6-96b7-4412-ae43-46411a191884 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:36:12.769202 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-977bd5f6-96b7-4412-ae43-46411a191884 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:36:12.835922 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-86de04a8-749f-456d-9568-2a0e8fef055f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:36:12.836660 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-86de04a8-749f-456d-9568-2a0e8fef055f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:36:12.839625 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-86de04a8-749f-456d-9568-2a0e8fef055f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:36:12.840306 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-86de04a8-749f-456d-9568-2a0e8fef055f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:36:12.841863 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-86de04a8-749f-456d-9568-2a0e8fef055f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:36:12.849905 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-977bd5f6-96b7-4412-ae43-46411a191884 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.568616 Aug 07 01:36:12.851500 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2276/5010] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:36:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 2572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:36:12.860591 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a6d748ab-848f-4188-bb24-6dd67f82a131 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:12.862514 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a6d748ab-848f-4188-bb24-6dd67f82a131 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] [instance: 182a97f3-ed16-4941-83b2-e15f51e02f84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:12.876041 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a6d748ab-848f-4188-bb24-6dd67f82a131 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:12.877077 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a6d748ab-848f-4188-bb24-6dd67f82a131 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:12.877681 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a6d748ab-848f-4188-bb24-6dd67f82a131 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:12.879234 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a6d748ab-848f-4188-bb24-6dd67f82a131 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:12.880993 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a6d748ab-848f-4188-bb24-6dd67f82a131 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:12.881661 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a6d748ab-848f-4188-bb24-6dd67f82a131 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:13.024697 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-86de04a8-749f-456d-9568-2a0e8fef055f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:13.047183 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86de04a8-749f-456d-9568-2a0e8fef055f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:13.049315 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86de04a8-749f-456d-9568-2a0e8fef055f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:13.049892 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86de04a8-749f-456d-9568-2a0e8fef055f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:13.050641 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86de04a8-749f-456d-9568-2a0e8fef055f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:13.053280 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86de04a8-749f-456d-9568-2a0e8fef055f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:13.055650 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86de04a8-749f-456d-9568-2a0e8fef055f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:13.143389 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-86de04a8-749f-456d-9568-2a0e8fef055f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "POST /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7/action" status: 202 len: 1078 microversion: 2.47 time: 0.551074 Aug 07 01:36:13.144700 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2735/5011] 10.222.0.39 () {62 vars in 1319 bytes} [Sun Aug 7 01:36:12 2022] POST /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7/action => generated 1078 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 07 01:36:13.159741 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dff29f85-cfc2-4e06-8d45-eeded55f1e4d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:13.163537 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-dff29f85-cfc2-4e06-8d45-eeded55f1e4d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:13.184934 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dff29f85-cfc2-4e06-8d45-eeded55f1e4d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:13.186128 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dff29f85-cfc2-4e06-8d45-eeded55f1e4d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:13.187263 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dff29f85-cfc2-4e06-8d45-eeded55f1e4d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:13.189676 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dff29f85-cfc2-4e06-8d45-eeded55f1e4d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:13.190729 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dff29f85-cfc2-4e06-8d45-eeded55f1e4d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:13.191677 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dff29f85-cfc2-4e06-8d45-eeded55f1e4d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:13.347566 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-dff29f85-cfc2-4e06-8d45-eeded55f1e4d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:13.378436 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-dff29f85-cfc2-4e06-8d45-eeded55f1e4d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:13.382540 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-dff29f85-cfc2-4e06-8d45-eeded55f1e4d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:13.384706 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-dff29f85-cfc2-4e06-8d45-eeded55f1e4d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1655 microversion: 2.20 time: 0.238063 Aug 07 01:36:13.385653 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2736/5012] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:13 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1655 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:13.397471 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f0d57765-876a-479c-a61a-10ce9ea0b53e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:13.398588 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f0d57765-876a-479c-a61a-10ce9ea0b53e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 0658227f-88e6-40fd-bb8f-aa6267addc84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:13.502552 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f0d57765-876a-479c-a61a-10ce9ea0b53e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:13.524082 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f0d57765-876a-479c-a61a-10ce9ea0b53e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84" status: 200 len: 1240 microversion: 2.1 time: 0.135080 Aug 07 01:36:13.545937 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2737/5013] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:13 2022] GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84 => generated 1240 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:13.554310 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-83d0bfdf-82cb-4145-ade2-92b15501805f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:13.556086 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-83d0bfdf-82cb-4145-ade2-92b15501805f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:13.686614 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-83d0bfdf-82cb-4145-ade2-92b15501805f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:13.704073 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-83d0bfdf-82cb-4145-ade2-92b15501805f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7" status: 200 len: 1222 microversion: 2.1 time: 0.156791 Aug 07 01:36:13.706930 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2738/5014] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:13 2022] GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 => generated 1222 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:13.717857 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ddd9d40b-3489-41c6-a004-0b5754db2d1d tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:13.718858 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ddd9d40b-3489-41c6-a004-0b5754db2d1d tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:13.733320 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddd9d40b-3489-41c6-a004-0b5754db2d1d tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:13.735998 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddd9d40b-3489-41c6-a004-0b5754db2d1d tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:13.749215 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddd9d40b-3489-41c6-a004-0b5754db2d1d tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:13.752748 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddd9d40b-3489-41c6-a004-0b5754db2d1d tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:13.758181 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddd9d40b-3489-41c6-a004-0b5754db2d1d tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:13.758843 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddd9d40b-3489-41c6-a004-0b5754db2d1d tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:14.037346 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ddd9d40b-3489-41c6-a004-0b5754db2d1d tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:14.049189 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ddd9d40b-3489-41c6-a004-0b5754db2d1d tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:14.055210 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ddd9d40b-3489-41c6-a004-0b5754db2d1d tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:14.057747 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ddd9d40b-3489-41c6-a004-0b5754db2d1d tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7" status: 200 len: 1365 microversion: 2.47 time: 0.347465 Aug 07 01:36:14.059245 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2739/5015] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:13 2022] GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7 => generated 1365 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:14.415374 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-314bb90d-6709-48e3-8e0d-e9bf8a4a1982 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:14.416218 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-314bb90d-6709-48e3-8e0d-e9bf8a4a1982 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:14.427480 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a6d748ab-848f-4188-bb24-6dd67f82a131 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd25a3a76ca4b399ddaf730a1d96878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '610bac63014f490db55c2cdbb89bc46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:14.432322 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-314bb90d-6709-48e3-8e0d-e9bf8a4a1982 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:14.433186 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-314bb90d-6709-48e3-8e0d-e9bf8a4a1982 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:14.436483 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-314bb90d-6709-48e3-8e0d-e9bf8a4a1982 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:14.437354 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-314bb90d-6709-48e3-8e0d-e9bf8a4a1982 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:14.439183 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-314bb90d-6709-48e3-8e0d-e9bf8a4a1982 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:14.439646 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-314bb90d-6709-48e3-8e0d-e9bf8a4a1982 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:14.495533 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a6d748ab-848f-4188-bb24-6dd67f82a131 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] 10.222.0.39 "GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84" status: 200 len: 1506 microversion: 2.1 time: 1.642134 Aug 07 01:36:14.499366 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2277/5016] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:12 2022] GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84 => generated 1506 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:14.526262 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d52942c5-b4ca-416c-bd59-3933414f8913 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:14.527140 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d52942c5-b4ca-416c-bd59-3933414f8913 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] [instance: 182a97f3-ed16-4941-83b2-e15f51e02f84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:14.553410 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d52942c5-b4ca-416c-bd59-3933414f8913 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:14.553909 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d52942c5-b4ca-416c-bd59-3933414f8913 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:14.562540 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d52942c5-b4ca-416c-bd59-3933414f8913 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:14.564940 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d52942c5-b4ca-416c-bd59-3933414f8913 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:14.569663 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d52942c5-b4ca-416c-bd59-3933414f8913 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:14.571573 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d52942c5-b4ca-416c-bd59-3933414f8913 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:14.605159 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-314bb90d-6709-48e3-8e0d-e9bf8a4a1982 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:14.641665 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-314bb90d-6709-48e3-8e0d-e9bf8a4a1982 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:14.643218 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-314bb90d-6709-48e3-8e0d-e9bf8a4a1982 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:14.652684 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-314bb90d-6709-48e3-8e0d-e9bf8a4a1982 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 200 len: 1655 microversion: 2.20 time: 0.242781 Aug 07 01:36:14.658199 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2740/5017] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:14 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 1655 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:14.669480 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4b2bfb6f-2554-49c0-98cc-f9913396d35a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:14.672851 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4b2bfb6f-2554-49c0-98cc-f9913396d35a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 0658227f-88e6-40fd-bb8f-aa6267addc84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:14.679833 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d52942c5-b4ca-416c-bd59-3933414f8913 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] 10.222.0.39 "GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84/ips" status: 200 len: 110 microversion: 2.1 time: 0.159394 Aug 07 01:36:14.682230 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2278/5018] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Aug 7 01:36:14 2022] GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84/ips => generated 110 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:36:14.698341 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b2bfb6f-2554-49c0-98cc-f9913396d35a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:14.699007 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-a01086e6-cd9c-4ca1-a8ba-5b3a83f0a1fe req-ac3ef106-78a1-4b08-8d29-1020a3f7fd87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4071f699-43c7-4c36-ada4-8f0dceb6cc91", "name": "network-vif-deleted", "tag": "a4d2050c-f5b0-4218-a72d-272334938cd5"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:36:14.700697 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b2bfb6f-2554-49c0-98cc-f9913396d35a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:14.710350 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b2bfb6f-2554-49c0-98cc-f9913396d35a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:14.711188 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b2bfb6f-2554-49c0-98cc-f9913396d35a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:14.732918 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b2bfb6f-2554-49c0-98cc-f9913396d35a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:14.734280 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b2bfb6f-2554-49c0-98cc-f9913396d35a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:14.775083 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a01086e6-cd9c-4ca1-a8ba-5b3a83f0a1fe req-ac3ef106-78a1-4b08-8d29-1020a3f7fd87 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:14.775833 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a01086e6-cd9c-4ca1-a8ba-5b3a83f0a1fe req-ac3ef106-78a1-4b08-8d29-1020a3f7fd87 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:14.777444 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a01086e6-cd9c-4ca1-a8ba-5b3a83f0a1fe req-ac3ef106-78a1-4b08-8d29-1020a3f7fd87 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:14.825040 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-a01086e6-cd9c-4ca1-a8ba-5b3a83f0a1fe req-ac3ef106-78a1-4b08-8d29-1020a3f7fd87 service nova] Creating event network-vif-deleted:a4d2050c-f5b0-4218-a72d-272334938cd5 for instance 4071f699-43c7-4c36-ada4-8f0dceb6cc91 on n-h2-master-1 Aug 07 01:36:14.854638 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-a01086e6-cd9c-4ca1-a8ba-5b3a83f0a1fe req-ac3ef106-78a1-4b08-8d29-1020a3f7fd87 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168322 Aug 07 01:36:14.855305 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2279/5019] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:36:14.882570 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f0e57f8b-9dad-41ac-b662-26b53c182b58 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:14.883223 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f0e57f8b-9dad-41ac-b662-26b53c182b58 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] [instance: 182a97f3-ed16-4941-83b2-e15f51e02f84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:14.928409 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f0e57f8b-9dad-41ac-b662-26b53c182b58 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:14.929719 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f0e57f8b-9dad-41ac-b662-26b53c182b58 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:14.936150 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4b2bfb6f-2554-49c0-98cc-f9913396d35a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:14.939324 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f0e57f8b-9dad-41ac-b662-26b53c182b58 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:14.941960 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f0e57f8b-9dad-41ac-b662-26b53c182b58 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:14.945705 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f0e57f8b-9dad-41ac-b662-26b53c182b58 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:14.947176 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f0e57f8b-9dad-41ac-b662-26b53c182b58 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:14.953837 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4b2bfb6f-2554-49c0-98cc-f9913396d35a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84" status: 200 len: 1292 microversion: 2.1 time: 0.288265 Aug 07 01:36:14.977792 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2741/5020] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:14 2022] GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84 => generated 1292 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:14.978730 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-516984a2-6146-460b-a1e1-17fb0e156247 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:14.979021 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-516984a2-6146-460b-a1e1-17fb0e156247 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:15.007244 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-516984a2-6146-460b-a1e1-17fb0e156247 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:15.007760 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-516984a2-6146-460b-a1e1-17fb0e156247 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:15.009165 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-516984a2-6146-460b-a1e1-17fb0e156247 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:15.011143 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-516984a2-6146-460b-a1e1-17fb0e156247 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:15.011629 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-516984a2-6146-460b-a1e1-17fb0e156247 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:15.012097 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-516984a2-6146-460b-a1e1-17fb0e156247 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:15.014557 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f0e57f8b-9dad-41ac-b662-26b53c182b58 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] 10.222.0.39 "GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84/ips" status: 200 len: 110 microversion: 2.1 time: 0.154858 Aug 07 01:36:15.020641 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2280/5021] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Aug 7 01:36:14 2022] GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84/ips => generated 110 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:36:15.035278 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fe671747-eb31-486d-ac41-87adf6c7cbcd tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:15.036669 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fe671747-eb31-486d-ac41-87adf6c7cbcd tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] [instance: 182a97f3-ed16-4941-83b2-e15f51e02f84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:15.043335 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fe671747-eb31-486d-ac41-87adf6c7cbcd tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:15.044239 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fe671747-eb31-486d-ac41-87adf6c7cbcd tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:15.044935 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fe671747-eb31-486d-ac41-87adf6c7cbcd tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:15.045857 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fe671747-eb31-486d-ac41-87adf6c7cbcd tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:15.046528 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fe671747-eb31-486d-ac41-87adf6c7cbcd tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:15.047167 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fe671747-eb31-486d-ac41-87adf6c7cbcd tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:15.105201 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fe671747-eb31-486d-ac41-87adf6c7cbcd tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] 10.222.0.39 "GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84/ips/tempest-ServerAddressesTestJSON-2097248022-network" status: 200 len: 95 microversion: 2.1 time: 0.074759 Aug 07 01:36:15.107327 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2281/5022] 10.222.0.39 () {58 vars in 1401 bytes} [Sun Aug 7 01:36:15 2022] GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84/ips/tempest-ServerAddressesTestJSON-2097248022-network => generated 95 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 07 01:36:15.122302 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1bf7b0bd-e1af-4b16-a970-435b23263f0c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:15.125063 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1bf7b0bd-e1af-4b16-a970-435b23263f0c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:15.141426 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1bf7b0bd-e1af-4b16-a970-435b23263f0c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:15.152158 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-516984a2-6146-460b-a1e1-17fb0e156247 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:15.154461 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1bf7b0bd-e1af-4b16-a970-435b23263f0c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:15.157402 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1bf7b0bd-e1af-4b16-a970-435b23263f0c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:15.158485 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1bf7b0bd-e1af-4b16-a970-435b23263f0c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:15.159259 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1bf7b0bd-e1af-4b16-a970-435b23263f0c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:15.164079 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1bf7b0bd-e1af-4b16-a970-435b23263f0c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:15.166600 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-516984a2-6146-460b-a1e1-17fb0e156247 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7" status: 200 len: 1274 microversion: 2.1 time: 0.200456 Aug 07 01:36:15.169450 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2742/5023] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:14 2022] GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 => generated 1274 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:15.174894 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fa216863-48c3-4d08-9be7-befd87ed471e tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:15.175961 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fa216863-48c3-4d08-9be7-befd87ed471e tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] [instance: 182a97f3-ed16-4941-83b2-e15f51e02f84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:15.186861 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa216863-48c3-4d08-9be7-befd87ed471e tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:15.208589 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa216863-48c3-4d08-9be7-befd87ed471e tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:15.211445 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa216863-48c3-4d08-9be7-befd87ed471e tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:15.215107 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa216863-48c3-4d08-9be7-befd87ed471e tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:15.216353 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa216863-48c3-4d08-9be7-befd87ed471e tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:15.216917 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa216863-48c3-4d08-9be7-befd87ed471e tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:15.318470 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fa216863-48c3-4d08-9be7-befd87ed471e tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] [instance: 182a97f3-ed16-4941-83b2-e15f51e02f84] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:36:15.518354 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fa216863-48c3-4d08-9be7-befd87ed471e tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] 10.222.0.39 "DELETE /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84" status: 204 len: 0 microversion: 2.1 time: 0.343325 Aug 07 01:36:15.519075 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2743/5024] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:36:15 2022] DELETE /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:36:15.529804 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-42b0455f-a2df-457e-87a0-bb10d7e01867 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:15.531788 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-42b0455f-a2df-457e-87a0-bb10d7e01867 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] [instance: 182a97f3-ed16-4941-83b2-e15f51e02f84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:15.550194 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:15.554590 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42b0455f-a2df-457e-87a0-bb10d7e01867 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:15.556374 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42b0455f-a2df-457e-87a0-bb10d7e01867 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:15.557071 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42b0455f-a2df-457e-87a0-bb10d7e01867 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:15.560225 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42b0455f-a2df-457e-87a0-bb10d7e01867 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:15.561761 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42b0455f-a2df-457e-87a0-bb10d7e01867 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:15.563503 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42b0455f-a2df-457e-87a0-bb10d7e01867 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:15.825757 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1bf7b0bd-e1af-4b16-a970-435b23263f0c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:15.853124 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1bf7b0bd-e1af-4b16-a970-435b23263f0c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:15.858895 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1bf7b0bd-e1af-4b16-a970-435b23263f0c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:15.860152 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1bf7b0bd-e1af-4b16-a970-435b23263f0c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7" status: 200 len: 1365 microversion: 2.47 time: 0.747150 Aug 07 01:36:15.860721 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2282/5025] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:15 2022] GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7 => generated 1365 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:15.886596 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-68444c05-70bf-4fe3-8374-d32215ef41bd tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:15.887017 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-68444c05-70bf-4fe3-8374-d32215ef41bd tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:15.900213 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68444c05-70bf-4fe3-8374-d32215ef41bd tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:15.900728 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68444c05-70bf-4fe3-8374-d32215ef41bd tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:15.903328 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68444c05-70bf-4fe3-8374-d32215ef41bd tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:15.904201 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68444c05-70bf-4fe3-8374-d32215ef41bd tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:15.904682 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68444c05-70bf-4fe3-8374-d32215ef41bd tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:15.905119 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68444c05-70bf-4fe3-8374-d32215ef41bd tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:15.944348 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-68444c05-70bf-4fe3-8374-d32215ef41bd tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] HTTP exception thrown: Instance 4071f699-43c7-4c36-ada4-8f0dceb6cc91 could not be found. Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-68444c05-70bf-4fe3-8374-d32215ef41bd tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Request method failure captured: Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 HTTP/1.1 Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xYYE_Y2FKv6zZ-7Zkxg2nvfkmjHNhq8c_yKwZxcLvYOOyyIq8uAferdUqGnDwpFS2QC6mWyOffIFr9qPy7uHg72JIuPriVMKOHOuSjKFlawCqsqSD8KzCrH58SWYZ4TQRVX3TPFeio4AWgC3hNQePrvrMuhXhOysJV4QaOUSTy-8aQ Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: X-Openstack-Nova-Api-Version: 2.20 Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 284c227cd03a4c1294ed40d7b1594d56 Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-660714485 Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/284c227cd03a4c1294ed40d7b1594d56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_284c227cd03a4c1294ed40d7b1594d56", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/284c227cd03a4c1294ed40d7b1594d56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/284c227cd03a4c1294ed40d7b1594d56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-AttachVolumeShelveTestJSON-660714485 Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 284c227cd03a4c1294ed40d7b1594d56 Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-660714485 Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-AttachVolumeShelveTestJSON-660714485-project Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: bed65a4d62184f52af3d2dd322eeec47 Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-AttachVolumeShelveTestJSON-660714485-project Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 4071f699-43c7-4c36-ada4-8f0dceb6cc91 could not be found. Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '4071f699-43c7-4c36-ada4-8f0dceb6cc91'} Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4071f699-43c7-4c36-ada4-8f0dceb6cc91 could not be found. Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4071f699-43c7-4c36-ada4-8f0dceb6cc91 could not be found. Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:36:15.952450 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:36:15.956538 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:36:15.956538 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:36:15.956538 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:36:15.956538 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:36:15.956538 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:36:15.956538 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:36:15.956538 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4071f699-43c7-4c36-ada4-8f0dceb6cc91 could not be found. Aug 07 01:36:15.956538 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:36:15.959169 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-68444c05-70bf-4fe3-8374-d32215ef41bd tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Returning 404 to user: Instance 4071f699-43c7-4c36-ada4-8f0dceb6cc91 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:36:15.960211 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-68444c05-70bf-4fe3-8374-d32215ef41bd tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 404 len: 111 microversion: 2.20 time: 0.093975 Aug 07 01:36:15.960794 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2283/5026] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:15 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:36:15.995800 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c9455937-12ca-43a9-90df-2cad8ea8a6de tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '.version_select at 0x7f9e297fd3a0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:16.052795 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c9455937-12ca-43a9-90df-2cad8ea8a6de tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-64422711" status: 204 len: 0 microversion: 2.20 time: 0.071857 Aug 07 01:36:16.054284 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2284/5027] 10.222.0.39 () {60 vars in 1256 bytes} [Sun Aug 7 01:36:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-64422711 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 01:36:16.070004 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2f990dab-eecb-45db-bd91-598b8789c1a5 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:16.070724 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2f990dab-eecb-45db-bd91-598b8789c1a5 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 0658227f-88e6-40fd-bb8f-aa6267addc84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:16.080254 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f990dab-eecb-45db-bd91-598b8789c1a5 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:16.080608 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f990dab-eecb-45db-bd91-598b8789c1a5 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:16.081224 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f990dab-eecb-45db-bd91-598b8789c1a5 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:16.082641 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f990dab-eecb-45db-bd91-598b8789c1a5 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:16.083264 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f990dab-eecb-45db-bd91-598b8789c1a5 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:16.083849 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f990dab-eecb-45db-bd91-598b8789c1a5 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:16.168593 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-42b0455f-a2df-457e-87a0-bb10d7e01867 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd25a3a76ca4b399ddaf730a1d96878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '610bac63014f490db55c2cdbb89bc46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:16.181545 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-42b0455f-a2df-457e-87a0-bb10d7e01867 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] 10.222.0.39 "GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84" status: 200 len: 1512 microversion: 2.1 time: 0.655782 Aug 07 01:36:16.183863 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2744/5028] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:15 2022] GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84 => generated 1512 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:36:16.192652 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3768a38c-a448-4034-b590-eae51dd26a7b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:16.193561 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3768a38c-a448-4034-b590-eae51dd26a7b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:16.202068 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3768a38c-a448-4034-b590-eae51dd26a7b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:16.203213 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3768a38c-a448-4034-b590-eae51dd26a7b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:16.203906 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3768a38c-a448-4034-b590-eae51dd26a7b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:16.204864 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3768a38c-a448-4034-b590-eae51dd26a7b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:16.205548 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3768a38c-a448-4034-b590-eae51dd26a7b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:16.206224 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3768a38c-a448-4034-b590-eae51dd26a7b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:16.267017 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2f990dab-eecb-45db-bd91-598b8789c1a5 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:16.279451 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2f990dab-eecb-45db-bd91-598b8789c1a5 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84" status: 200 len: 1298 microversion: 2.1 time: 0.223942 Aug 07 01:36:16.293575 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2285/5029] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:16 2022] GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84 => generated 1298 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:16.441190 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3768a38c-a448-4034-b590-eae51dd26a7b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:16.454329 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3768a38c-a448-4034-b590-eae51dd26a7b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7" status: 200 len: 1280 microversion: 2.1 time: 0.264864 Aug 07 01:36:16.455575 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2745/5030] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:16 2022] GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 => generated 1280 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:16.889193 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-535f73a2-ba0a-4a3b-98c6-1568261e11b7 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:16.892249 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-535f73a2-ba0a-4a3b-98c6-1568261e11b7 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:16.902201 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-535f73a2-ba0a-4a3b-98c6-1568261e11b7 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:16.903162 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-535f73a2-ba0a-4a3b-98c6-1568261e11b7 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:16.904017 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-535f73a2-ba0a-4a3b-98c6-1568261e11b7 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:16.904995 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-535f73a2-ba0a-4a3b-98c6-1568261e11b7 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:16.906141 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-535f73a2-ba0a-4a3b-98c6-1568261e11b7 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:16.906790 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-535f73a2-ba0a-4a3b-98c6-1568261e11b7 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:17.024551 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-535f73a2-ba0a-4a3b-98c6-1568261e11b7 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:17.049902 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-535f73a2-ba0a-4a3b-98c6-1568261e11b7 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:17.062684 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-535f73a2-ba0a-4a3b-98c6-1568261e11b7 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:17.066445 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-535f73a2-ba0a-4a3b-98c6-1568261e11b7 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7" status: 200 len: 1365 microversion: 2.47 time: 0.183009 Aug 07 01:36:17.090555 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2286/5031] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:16 2022] GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7 => generated 1365 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:17.212430 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2e5a27e6-b1f8-432c-ac31-ff331efc5356 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:17.213942 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2e5a27e6-b1f8-432c-ac31-ff331efc5356 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] [instance: 182a97f3-ed16-4941-83b2-e15f51e02f84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:17.222544 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2e5a27e6-b1f8-432c-ac31-ff331efc5356 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:17.224000 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2e5a27e6-b1f8-432c-ac31-ff331efc5356 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:17.224677 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2e5a27e6-b1f8-432c-ac31-ff331efc5356 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:17.225656 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2e5a27e6-b1f8-432c-ac31-ff331efc5356 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:17.226457 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2e5a27e6-b1f8-432c-ac31-ff331efc5356 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:17.227201 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2e5a27e6-b1f8-432c-ac31-ff331efc5356 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:17.304003 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4c59c194-9529-48f9-aae0-2a3504a4b2fb tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:17.304818 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4c59c194-9529-48f9-aae0-2a3504a4b2fb tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 0658227f-88e6-40fd-bb8f-aa6267addc84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:17.323658 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4c59c194-9529-48f9-aae0-2a3504a4b2fb tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:17.324424 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4c59c194-9529-48f9-aae0-2a3504a4b2fb tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:17.325731 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4c59c194-9529-48f9-aae0-2a3504a4b2fb tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:17.330050 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4c59c194-9529-48f9-aae0-2a3504a4b2fb tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:17.332339 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4c59c194-9529-48f9-aae0-2a3504a4b2fb tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:17.333886 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4c59c194-9529-48f9-aae0-2a3504a4b2fb tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:17.347339 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:17.667787 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4c59c194-9529-48f9-aae0-2a3504a4b2fb tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:17.684165 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4c59c194-9529-48f9-aae0-2a3504a4b2fb tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84" status: 200 len: 1298 microversion: 2.1 time: 0.387559 Aug 07 01:36:17.700626 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2287/5032] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:17 2022] GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84 => generated 1298 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:36:17.712561 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d85c962f-e064-4f94-ad49-7bdb4c34e2ae tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:17.714328 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d85c962f-e064-4f94-ad49-7bdb4c34e2ae tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:17.746024 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d85c962f-e064-4f94-ad49-7bdb4c34e2ae tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:17.748201 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d85c962f-e064-4f94-ad49-7bdb4c34e2ae tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:17.750240 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d85c962f-e064-4f94-ad49-7bdb4c34e2ae tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:17.752135 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d85c962f-e064-4f94-ad49-7bdb4c34e2ae tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:17.758142 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d85c962f-e064-4f94-ad49-7bdb4c34e2ae tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:17.763095 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d85c962f-e064-4f94-ad49-7bdb4c34e2ae tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:17.867464 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2e5a27e6-b1f8-432c-ac31-ff331efc5356 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd25a3a76ca4b399ddaf730a1d96878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '610bac63014f490db55c2cdbb89bc46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:17.875262 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2e5a27e6-b1f8-432c-ac31-ff331efc5356 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] 10.222.0.39 "GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84" status: 200 len: 1512 microversion: 2.1 time: 0.668368 Aug 07 01:36:17.875849 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2746/5033] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:17 2022] GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84 => generated 1512 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:17.987430 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d85c962f-e064-4f94-ad49-7bdb4c34e2ae tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:17.996540 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d85c962f-e064-4f94-ad49-7bdb4c34e2ae tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7" status: 200 len: 1280 microversion: 2.1 time: 0.296971 Aug 07 01:36:17.997819 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2288/5034] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:17 2022] GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 => generated 1280 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:18.094365 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-63a9d61c-42d4-4403-b7e8-d9dd7d54cde8 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:18.095003 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-63a9d61c-42d4-4403-b7e8-d9dd7d54cde8 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:18.104684 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-63a9d61c-42d4-4403-b7e8-d9dd7d54cde8 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:18.105175 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-63a9d61c-42d4-4403-b7e8-d9dd7d54cde8 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:18.105617 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-63a9d61c-42d4-4403-b7e8-d9dd7d54cde8 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:18.106331 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-63a9d61c-42d4-4403-b7e8-d9dd7d54cde8 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:18.106786 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-63a9d61c-42d4-4403-b7e8-d9dd7d54cde8 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:18.107345 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-63a9d61c-42d4-4403-b7e8-d9dd7d54cde8 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:18.246328 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-63a9d61c-42d4-4403-b7e8-d9dd7d54cde8 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:18.262775 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-63a9d61c-42d4-4403-b7e8-d9dd7d54cde8 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:18.264462 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-63a9d61c-42d4-4403-b7e8-d9dd7d54cde8 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:18.266962 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-63a9d61c-42d4-4403-b7e8-d9dd7d54cde8 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7" status: 200 len: 1365 microversion: 2.47 time: 0.176411 Aug 07 01:36:18.268072 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2747/5035] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:18 2022] GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:18.571518 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-3cdae5ca-5b3f-46b8-8e1f-115f96496793 req-4627429a-0cb9-4c59-8087-daff98a387c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "182a97f3-ed16-4941-83b2-e15f51e02f84", "name": "network-vif-deleted", "tag": "eb0460e9-ec73-48d2-a85f-25d802440bf7"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:36:18.596580 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3cdae5ca-5b3f-46b8-8e1f-115f96496793 req-4627429a-0cb9-4c59-8087-daff98a387c1 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:18.597063 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3cdae5ca-5b3f-46b8-8e1f-115f96496793 req-4627429a-0cb9-4c59-8087-daff98a387c1 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:18.597500 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3cdae5ca-5b3f-46b8-8e1f-115f96496793 req-4627429a-0cb9-4c59-8087-daff98a387c1 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:18.619346 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-3cdae5ca-5b3f-46b8-8e1f-115f96496793 req-4627429a-0cb9-4c59-8087-daff98a387c1 service nova] Creating event network-vif-deleted:eb0460e9-ec73-48d2-a85f-25d802440bf7 for instance 182a97f3-ed16-4941-83b2-e15f51e02f84 on n-h1-master-1 Aug 07 01:36:18.639227 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-3cdae5ca-5b3f-46b8-8e1f-115f96496793 req-4627429a-0cb9-4c59-8087-daff98a387c1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071213 Aug 07 01:36:18.641722 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2289/5036] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:36:18.712618 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4372fdca-6af5-4d6e-a74a-84b7a55e21ac tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:18.713507 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4372fdca-6af5-4d6e-a74a-84b7a55e21ac tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 0658227f-88e6-40fd-bb8f-aa6267addc84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:18.729800 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4372fdca-6af5-4d6e-a74a-84b7a55e21ac tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:18.731774 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4372fdca-6af5-4d6e-a74a-84b7a55e21ac tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:18.733034 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4372fdca-6af5-4d6e-a74a-84b7a55e21ac tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:18.734090 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4372fdca-6af5-4d6e-a74a-84b7a55e21ac tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:18.735929 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4372fdca-6af5-4d6e-a74a-84b7a55e21ac tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:18.738610 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4372fdca-6af5-4d6e-a74a-84b7a55e21ac tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:18.901893 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-310fb089-6964-4d41-8bd5-92ced395f6c2 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:18.902863 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4372fdca-6af5-4d6e-a74a-84b7a55e21ac tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:18.903355 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-310fb089-6964-4d41-8bd5-92ced395f6c2 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] [instance: 182a97f3-ed16-4941-83b2-e15f51e02f84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:18.916452 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4372fdca-6af5-4d6e-a74a-84b7a55e21ac tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84" status: 200 len: 1298 microversion: 2.1 time: 0.205611 Aug 07 01:36:18.928170 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2748/5037] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:18 2022] GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84 => generated 1298 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:18.954912 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-310fb089-6964-4d41-8bd5-92ced395f6c2 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:18.956094 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-310fb089-6964-4d41-8bd5-92ced395f6c2 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:18.958619 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-310fb089-6964-4d41-8bd5-92ced395f6c2 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:18.962538 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-310fb089-6964-4d41-8bd5-92ced395f6c2 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:18.964491 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-310fb089-6964-4d41-8bd5-92ced395f6c2 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:18.966076 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-310fb089-6964-4d41-8bd5-92ced395f6c2 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:19.018632 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6ede38a5-984e-4ce1-a920-702bfbff1fc1 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:19.019789 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6ede38a5-984e-4ce1-a920-702bfbff1fc1 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:19.032663 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ede38a5-984e-4ce1-a920-702bfbff1fc1 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:19.033420 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ede38a5-984e-4ce1-a920-702bfbff1fc1 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:19.034054 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ede38a5-984e-4ce1-a920-702bfbff1fc1 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:19.034913 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-310fb089-6964-4d41-8bd5-92ced395f6c2 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:19.035395 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ede38a5-984e-4ce1-a920-702bfbff1fc1 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:19.035395 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ede38a5-984e-4ce1-a920-702bfbff1fc1 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:19.036445 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ede38a5-984e-4ce1-a920-702bfbff1fc1 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:19.037096 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-310fb089-6964-4d41-8bd5-92ced395f6c2 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:19.038376 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-310fb089-6964-4d41-8bd5-92ced395f6c2 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:19.039215 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-310fb089-6964-4d41-8bd5-92ced395f6c2 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lazy-loading 'fault' on Instance uuid 182a97f3-ed16-4941-83b2-e15f51e02f84 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:36:19.193665 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-310fb089-6964-4d41-8bd5-92ced395f6c2 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd25a3a76ca4b399ddaf730a1d96878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '610bac63014f490db55c2cdbb89bc46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:19.210142 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-310fb089-6964-4d41-8bd5-92ced395f6c2 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] 10.222.0.39 "GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84" status: 200 len: 1306 microversion: 2.1 time: 0.315809 Aug 07 01:36:19.220503 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2290/5038] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:18 2022] GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84 => generated 1306 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:19.291337 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-aebe8b61-91af-4d75-9707-795198ed63be tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:19.292624 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-aebe8b61-91af-4d75-9707-795198ed63be tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:19.302913 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aebe8b61-91af-4d75-9707-795198ed63be tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:19.304360 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aebe8b61-91af-4d75-9707-795198ed63be tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:19.305166 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aebe8b61-91af-4d75-9707-795198ed63be tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:19.306277 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aebe8b61-91af-4d75-9707-795198ed63be tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:19.306973 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aebe8b61-91af-4d75-9707-795198ed63be tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:19.307672 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aebe8b61-91af-4d75-9707-795198ed63be tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:19.510168 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-aebe8b61-91af-4d75-9707-795198ed63be tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:19.513362 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6ede38a5-984e-4ce1-a920-702bfbff1fc1 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:19.522139 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6ede38a5-984e-4ce1-a920-702bfbff1fc1 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7" status: 200 len: 1322 microversion: 2.1 time: 0.507632 Aug 07 01:36:19.522737 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2749/5039] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:19 2022] GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 => generated 1322 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:19.527708 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-aebe8b61-91af-4d75-9707-795198ed63be tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:19.530376 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-aebe8b61-91af-4d75-9707-795198ed63be tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:19.536379 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a7bd5971-1e53-42df-a968-4c4df4304b3e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Action: 'create', calling method: .version_select at 0x7f9e17089280>, body: {"keypair": {"name": "tempest-keypair-1667813352", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWndJ+ZfrkZ7vNLl+aLgZSeBV3jEt06zHtmSzBf+MHhIHRDZR2eVQobP6/vPP28yhIXYFGXEux1n+hR3mXLkrCjRhsNuFQ3yfPPBDW8TF2F6Cb9sjT3UT6iLC9QMJQNNg=="}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:36:19.541637 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-aebe8b61-91af-4d75-9707-795198ed63be tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7" status: 200 len: 1365 microversion: 2.47 time: 0.253420 Aug 07 01:36:19.543501 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2291/5040] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:19 2022] GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7 => generated 1365 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:19.572909 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-a7bd5971-1e53-42df-a968-4c4df4304b3e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Getting quotas for project 284c227cd03a4c1294ed40d7b1594d56. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:36:19.579412 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-a7bd5971-1e53-42df-a968-4c4df4304b3e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Getting quotas for user bed65a4d62184f52af3d2dd322eeec47 and project 284c227cd03a4c1294ed40d7b1594d56. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:36:19.620290 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a7bd5971-1e53-42df-a968-4c4df4304b3e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.096145 Aug 07 01:36:19.621386 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2750/5041] 10.222.0.39 () {62 vars in 1200 bytes} [Sun Aug 7 01:36:19 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 98 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 07 01:36:19.992903 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2dcf0d76-5738-41c7-af32-bd6d0bf2d124 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:19.994886 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2dcf0d76-5738-41c7-af32-bd6d0bf2d124 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 0658227f-88e6-40fd-bb8f-aa6267addc84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:20.027698 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2dcf0d76-5738-41c7-af32-bd6d0bf2d124 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:20.034821 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2dcf0d76-5738-41c7-af32-bd6d0bf2d124 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:20.041729 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2dcf0d76-5738-41c7-af32-bd6d0bf2d124 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:20.055134 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2dcf0d76-5738-41c7-af32-bd6d0bf2d124 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:20.058983 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2dcf0d76-5738-41c7-af32-bd6d0bf2d124 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:20.062710 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2dcf0d76-5738-41c7-af32-bd6d0bf2d124 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:20.236339 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-097328f6-0621-40b9-b963-fe240ec0b0c9 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:20.237562 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-097328f6-0621-40b9-b963-fe240ec0b0c9 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] [instance: 182a97f3-ed16-4941-83b2-e15f51e02f84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:20.263401 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-097328f6-0621-40b9-b963-fe240ec0b0c9 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:20.265430 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-097328f6-0621-40b9-b963-fe240ec0b0c9 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:20.267021 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-097328f6-0621-40b9-b963-fe240ec0b0c9 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:20.269521 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-097328f6-0621-40b9-b963-fe240ec0b0c9 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:20.271346 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-097328f6-0621-40b9-b963-fe240ec0b0c9 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:20.271942 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-097328f6-0621-40b9-b963-fe240ec0b0c9 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:20.283752 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:20.321561 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-097328f6-0621-40b9-b963-fe240ec0b0c9 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] HTTP exception thrown: Instance 182a97f3-ed16-4941-83b2-e15f51e02f84 could not be found. Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-097328f6-0621-40b9-b963-fe240ec0b0c9 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Request method failure captured: Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84 HTTP/1.1 Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xbv8ag_pb5jh8vpU5d8HKa6bAyzGWP1zm6MkCa0uuC-1XPkQl9iwHAcz357FtH5NuHZCfK0DPbjfIrg3u48WwmLX7tRbcrMlWptK_ea_nJcTtcVrp2FXZ7r5kpZuODn-27NCs-41sfE4K2HUSCWwBDkECpiJhATnaQ7qCzo1IVRsHs Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 610bac63014f490db55c2cdbb89bc46a Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServerAddressesTestJSON-296230028 Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/610bac63014f490db55c2cdbb89bc46a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_610bac63014f490db55c2cdbb89bc46a", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/610bac63014f490db55c2cdbb89bc46a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/610bac63014f490db55c2cdbb89bc46a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServerAddressesTestJSON-296230028 Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 610bac63014f490db55c2cdbb89bc46a Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServerAddressesTestJSON-296230028 Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServerAddressesTestJSON-296230028-project Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 2dd25a3a76ca4b399ddaf730a1d96878 Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServerAddressesTestJSON-296230028-project Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 182a97f3-ed16-4941-83b2-e15f51e02f84 could not be found. Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '182a97f3-ed16-4941-83b2-e15f51e02f84'} Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 182a97f3-ed16-4941-83b2-e15f51e02f84 could not be found. Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 182a97f3-ed16-4941-83b2-e15f51e02f84 could not be found. Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:36:20.324805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:36:20.330251 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:36:20.330251 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:36:20.330251 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:36:20.330251 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:36:20.330251 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:36:20.330251 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 182a97f3-ed16-4941-83b2-e15f51e02f84 could not be found. Aug 07 01:36:20.330251 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:36:20.330251 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-097328f6-0621-40b9-b963-fe240ec0b0c9 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] Returning 404 to user: Instance 182a97f3-ed16-4941-83b2-e15f51e02f84 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:36:20.330251 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-097328f6-0621-40b9-b963-fe240ec0b0c9 tempest-ServerAddressesTestJSON-296230028 tempest-ServerAddressesTestJSON-296230028-project] 10.222.0.39 "GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84" status: 404 len: 111 microversion: 2.1 time: 0.098992 Aug 07 01:36:20.350942 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2751/5042] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:20 2022] GET /compute/v2.1/servers/182a97f3-ed16-4941-83b2-e15f51e02f84 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:36:20.551799 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ed845f0f-3e14-44e5-9f61-fa0f21859feb tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:20.553281 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ed845f0f-3e14-44e5-9f61-fa0f21859feb tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:20.570235 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ed845f0f-3e14-44e5-9f61-fa0f21859feb tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:20.572923 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ed845f0f-3e14-44e5-9f61-fa0f21859feb tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:20.573587 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ed845f0f-3e14-44e5-9f61-fa0f21859feb tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:20.574347 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ed845f0f-3e14-44e5-9f61-fa0f21859feb tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:20.576731 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ed845f0f-3e14-44e5-9f61-fa0f21859feb tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:20.577647 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ed845f0f-3e14-44e5-9f61-fa0f21859feb tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:21.000818 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2dcf0d76-5738-41c7-af32-bd6d0bf2d124 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:21.009564 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2dcf0d76-5738-41c7-af32-bd6d0bf2d124 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84" status: 200 len: 1365 microversion: 2.1 time: 1.067588 Aug 07 01:36:21.020409 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2292/5043] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:19 2022] GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84 => generated 1365 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:21.036520 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-007d75d8-c653-43a6-921a-623c19c41718 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:21.037421 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-007d75d8-c653-43a6-921a-623c19c41718 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:21.046531 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-007d75d8-c653-43a6-921a-623c19c41718 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:21.047159 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-007d75d8-c653-43a6-921a-623c19c41718 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:21.047454 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-007d75d8-c653-43a6-921a-623c19c41718 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:21.050586 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-007d75d8-c653-43a6-921a-623c19c41718 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:21.057278 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-007d75d8-c653-43a6-921a-623c19c41718 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:21.057769 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-007d75d8-c653-43a6-921a-623c19c41718 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:21.180747 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-007d75d8-c653-43a6-921a-623c19c41718 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:21.191403 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-007d75d8-c653-43a6-921a-623c19c41718 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:21.193019 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-007d75d8-c653-43a6-921a-623c19c41718 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:21.197521 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-007d75d8-c653-43a6-921a-623c19c41718 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7" status: 200 len: 1365 microversion: 2.47 time: 0.175868 Aug 07 01:36:21.214665 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2293/5044] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:21 2022] GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7 => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:21.214665 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-701c6e14-f092-421a-bd7d-d0e59ecd55c8 req-a030bf1f-21da-4072-aa14-91fc90142dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67905784-e195-4938-9ea1-7e0fb23ffd4d", "tag": "4710e5d5-f96e-42f2-99ea-feeb68044c68"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:36:21.236675 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-701c6e14-f092-421a-bd7d-d0e59ecd55c8 req-a030bf1f-21da-4072-aa14-91fc90142dc9 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:21.237180 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-701c6e14-f092-421a-bd7d-d0e59ecd55c8 req-a030bf1f-21da-4072-aa14-91fc90142dc9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:21.237624 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-701c6e14-f092-421a-bd7d-d0e59ecd55c8 req-a030bf1f-21da-4072-aa14-91fc90142dc9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:21.259502 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-701c6e14-f092-421a-bd7d-d0e59ecd55c8 req-a030bf1f-21da-4072-aa14-91fc90142dc9 service nova] Creating event network-changed:4710e5d5-f96e-42f2-99ea-feeb68044c68 for instance 67905784-e195-4938-9ea1-7e0fb23ffd4d on n-h1-master-1 Aug 07 01:36:21.274278 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-701c6e14-f092-421a-bd7d-d0e59ecd55c8 req-a030bf1f-21da-4072-aa14-91fc90142dc9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069602 Aug 07 01:36:21.275233 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2294/5045] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:36:21.280267 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-c7321cea-956b-4cb5-9db6-c608e47414e5 req-e5af4408-dd49-4261-bb44-bf961b06b243 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40fafd12-87a1-49ad-9152-5b47f28a80b7", "tag": "ce724099-1eb9-4a4e-a13c-2ca5bf4b41ad"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:36:21.325370 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c7321cea-956b-4cb5-9db6-c608e47414e5 req-e5af4408-dd49-4261-bb44-bf961b06b243 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:21.326200 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c7321cea-956b-4cb5-9db6-c608e47414e5 req-e5af4408-dd49-4261-bb44-bf961b06b243 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:21.326830 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c7321cea-956b-4cb5-9db6-c608e47414e5 req-e5af4408-dd49-4261-bb44-bf961b06b243 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:21.359108 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-c7321cea-956b-4cb5-9db6-c608e47414e5 req-e5af4408-dd49-4261-bb44-bf961b06b243 service nova] Creating event network-changed:ce724099-1eb9-4a4e-a13c-2ca5bf4b41ad for instance 40fafd12-87a1-49ad-9152-5b47f28a80b7 on n-h1-master-1 Aug 07 01:36:21.372746 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-c7321cea-956b-4cb5-9db6-c608e47414e5 req-e5af4408-dd49-4261-bb44-bf961b06b243 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096129 Aug 07 01:36:21.373358 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2295/5046] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:36:21.420082 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ed845f0f-3e14-44e5-9f61-fa0f21859feb tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:21.429407 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ed845f0f-3e14-44e5-9f61-fa0f21859feb tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7" status: 200 len: 1322 microversion: 2.1 time: 0.889867 Aug 07 01:36:21.435396 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2752/5047] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:20 2022] GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 => generated 1322 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:22.048076 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-12244d3d-b2a3-459c-a666-d93f39babff0 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:22.055177 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-12244d3d-b2a3-459c-a666-d93f39babff0 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 0658227f-88e6-40fd-bb8f-aa6267addc84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:22.069094 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12244d3d-b2a3-459c-a666-d93f39babff0 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:22.070336 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12244d3d-b2a3-459c-a666-d93f39babff0 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:22.071405 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12244d3d-b2a3-459c-a666-d93f39babff0 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:22.074240 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12244d3d-b2a3-459c-a666-d93f39babff0 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:22.075262 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12244d3d-b2a3-459c-a666-d93f39babff0 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:22.077530 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12244d3d-b2a3-459c-a666-d93f39babff0 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:22.221456 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-78f9ee4c-f653-4b2c-bef2-6f8f96ff925d tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:22.222945 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-78f9ee4c-f653-4b2c-bef2-6f8f96ff925d tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:22.238381 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-78f9ee4c-f653-4b2c-bef2-6f8f96ff925d tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:22.239520 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-78f9ee4c-f653-4b2c-bef2-6f8f96ff925d tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:22.239988 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-78f9ee4c-f653-4b2c-bef2-6f8f96ff925d tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:22.240726 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-78f9ee4c-f653-4b2c-bef2-6f8f96ff925d tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:22.241185 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-78f9ee4c-f653-4b2c-bef2-6f8f96ff925d tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:22.252967 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-78f9ee4c-f653-4b2c-bef2-6f8f96ff925d tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:22.463740 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:22.469496 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-78f9ee4c-f653-4b2c-bef2-6f8f96ff925d tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:22.490133 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-78f9ee4c-f653-4b2c-bef2-6f8f96ff925d tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:22.491653 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-78f9ee4c-f653-4b2c-bef2-6f8f96ff925d tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:22.492955 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-78f9ee4c-f653-4b2c-bef2-6f8f96ff925d tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7" status: 200 len: 1365 microversion: 2.47 time: 0.275590 Aug 07 01:36:22.508109 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2753/5048] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:22 2022] GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7 => generated 1365 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:22.533104 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5b2af7c5-7d46-4db3-92d8-ecb428978a02 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:22.535287 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5b2af7c5-7d46-4db3-92d8-ecb428978a02 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:22.563290 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5b2af7c5-7d46-4db3-92d8-ecb428978a02 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:22.568347 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5b2af7c5-7d46-4db3-92d8-ecb428978a02 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:22.569308 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5b2af7c5-7d46-4db3-92d8-ecb428978a02 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:22.571190 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5b2af7c5-7d46-4db3-92d8-ecb428978a02 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:22.573877 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5b2af7c5-7d46-4db3-92d8-ecb428978a02 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:22.574839 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5b2af7c5-7d46-4db3-92d8-ecb428978a02 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:22.661775 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=4 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:22.753837 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=26 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:22.936080 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5b2af7c5-7d46-4db3-92d8-ecb428978a02 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:22.955413 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5b2af7c5-7d46-4db3-92d8-ecb428978a02 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7" status: 200 len: 1322 microversion: 2.1 time: 0.445256 Aug 07 01:36:22.959057 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2754/5049] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:22 2022] GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 => generated 1322 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:22.965093 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-12244d3d-b2a3-459c-a666-d93f39babff0 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:22.981144 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-12244d3d-b2a3-459c-a666-d93f39babff0 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84" status: 200 len: 1365 microversion: 2.1 time: 0.939836 Aug 07 01:36:22.983481 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2296/5050] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:22 2022] GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84 => generated 1365 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:23.314876 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-494bf4fa-0bd3-40ab-9b92-cd521c82a710 req-b7cbbd99-2784-438d-9839-12df0d52f16d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0658227f-88e6-40fd-bb8f-aa6267addc84", "tag": "7a3c38b5-4424-4a27-9219-94e88ef4a328"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:36:23.335908 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-494bf4fa-0bd3-40ab-9b92-cd521c82a710 req-b7cbbd99-2784-438d-9839-12df0d52f16d service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:23.338088 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-494bf4fa-0bd3-40ab-9b92-cd521c82a710 req-b7cbbd99-2784-438d-9839-12df0d52f16d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:23.340430 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-494bf4fa-0bd3-40ab-9b92-cd521c82a710 req-b7cbbd99-2784-438d-9839-12df0d52f16d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:23.356491 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-494bf4fa-0bd3-40ab-9b92-cd521c82a710 req-b7cbbd99-2784-438d-9839-12df0d52f16d service nova] Creating event network-changed:7a3c38b5-4424-4a27-9219-94e88ef4a328 for instance 0658227f-88e6-40fd-bb8f-aa6267addc84 on n-h1-master-1 Aug 07 01:36:23.362450 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-494bf4fa-0bd3-40ab-9b92-cd521c82a710 req-b7cbbd99-2784-438d-9839-12df0d52f16d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056885 Aug 07 01:36:23.363661 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2755/5051] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:36:23.538870 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-de9a6353-0a00-497c-a5c9-048048ec38cd tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:23.543336 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-de9a6353-0a00-497c-a5c9-048048ec38cd tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:23.569787 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-de9a6353-0a00-497c-a5c9-048048ec38cd tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:23.570700 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-de9a6353-0a00-497c-a5c9-048048ec38cd tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:23.571160 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-de9a6353-0a00-497c-a5c9-048048ec38cd tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:23.572049 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-de9a6353-0a00-497c-a5c9-048048ec38cd tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:23.572680 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-de9a6353-0a00-497c-a5c9-048048ec38cd tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:23.573269 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-de9a6353-0a00-497c-a5c9-048048ec38cd tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:23.744971 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-de9a6353-0a00-497c-a5c9-048048ec38cd tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:23.771339 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-de9a6353-0a00-497c-a5c9-048048ec38cd tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:23.773534 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-de9a6353-0a00-497c-a5c9-048048ec38cd tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:23.776413 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-de9a6353-0a00-497c-a5c9-048048ec38cd tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7" status: 200 len: 1365 microversion: 2.47 time: 0.262085 Aug 07 01:36:23.777328 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2297/5052] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:23 2022] GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7 => generated 1365 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:23.978496 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-33e8e818-6fb8-4b4f-a2a0-4504fefd4889 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:23.978830 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-33e8e818-6fb8-4b4f-a2a0-4504fefd4889 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:23.994636 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33e8e818-6fb8-4b4f-a2a0-4504fefd4889 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:23.994791 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33e8e818-6fb8-4b4f-a2a0-4504fefd4889 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:23.995453 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33e8e818-6fb8-4b4f-a2a0-4504fefd4889 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:23.996474 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33e8e818-6fb8-4b4f-a2a0-4504fefd4889 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:23.997129 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33e8e818-6fb8-4b4f-a2a0-4504fefd4889 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:24.004167 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-650f79d1-978d-473b-b911-70099af1defa tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:24.004983 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-650f79d1-978d-473b-b911-70099af1defa tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 0658227f-88e6-40fd-bb8f-aa6267addc84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:24.010641 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33e8e818-6fb8-4b4f-a2a0-4504fefd4889 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:24.016065 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-650f79d1-978d-473b-b911-70099af1defa tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:24.016576 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-650f79d1-978d-473b-b911-70099af1defa tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:24.018167 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-650f79d1-978d-473b-b911-70099af1defa tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:24.021323 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-650f79d1-978d-473b-b911-70099af1defa tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:24.022720 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-650f79d1-978d-473b-b911-70099af1defa tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:24.024158 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-650f79d1-978d-473b-b911-70099af1defa tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:24.446424 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-650f79d1-978d-473b-b911-70099af1defa tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:24.456769 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-650f79d1-978d-473b-b911-70099af1defa tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84" status: 200 len: 1365 microversion: 2.1 time: 0.457898 Aug 07 01:36:24.459617 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2298/5053] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:23 2022] GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84 => generated 1365 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:36:24.693580 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-33e8e818-6fb8-4b4f-a2a0-4504fefd4889 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:24.705236 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-33e8e818-6fb8-4b4f-a2a0-4504fefd4889 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7" status: 200 len: 1322 microversion: 2.1 time: 0.731884 Aug 07 01:36:24.720555 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2756/5054] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:23 2022] GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 => generated 1322 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:24.813051 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f4b31b68-019c-4211-9a3d-c6a6f1d27a2f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:24.815520 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f4b31b68-019c-4211-9a3d-c6a6f1d27a2f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:24.831989 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4b31b68-019c-4211-9a3d-c6a6f1d27a2f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:24.833426 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4b31b68-019c-4211-9a3d-c6a6f1d27a2f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:24.834154 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4b31b68-019c-4211-9a3d-c6a6f1d27a2f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:24.834978 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4b31b68-019c-4211-9a3d-c6a6f1d27a2f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:24.836032 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4b31b68-019c-4211-9a3d-c6a6f1d27a2f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:24.847900 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4b31b68-019c-4211-9a3d-c6a6f1d27a2f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:24.998343 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f4b31b68-019c-4211-9a3d-c6a6f1d27a2f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:25.020675 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f4b31b68-019c-4211-9a3d-c6a6f1d27a2f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:25.034119 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f4b31b68-019c-4211-9a3d-c6a6f1d27a2f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:25.035990 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f4b31b68-019c-4211-9a3d-c6a6f1d27a2f tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7" status: 200 len: 1365 microversion: 2.47 time: 0.238294 Aug 07 01:36:25.036749 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2299/5055] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:24 2022] GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7 => generated 1365 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:25.479388 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5cc91e29-237d-4abe-b2b8-468a97b759fc tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:25.480299 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5cc91e29-237d-4abe-b2b8-468a97b759fc tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 0658227f-88e6-40fd-bb8f-aa6267addc84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:25.487596 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cc91e29-237d-4abe-b2b8-468a97b759fc tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:25.488372 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cc91e29-237d-4abe-b2b8-468a97b759fc tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:25.488990 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cc91e29-237d-4abe-b2b8-468a97b759fc tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:25.489935 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cc91e29-237d-4abe-b2b8-468a97b759fc tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:25.490568 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cc91e29-237d-4abe-b2b8-468a97b759fc tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:25.491173 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cc91e29-237d-4abe-b2b8-468a97b759fc tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:25.733059 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-14297bee-127b-40ae-b99f-b4aac9647de3 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:25.733995 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-14297bee-127b-40ae-b99f-b4aac9647de3 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:25.737725 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:25.745004 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-14297bee-127b-40ae-b99f-b4aac9647de3 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:25.756330 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-14297bee-127b-40ae-b99f-b4aac9647de3 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:25.757070 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-14297bee-127b-40ae-b99f-b4aac9647de3 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:25.758267 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-14297bee-127b-40ae-b99f-b4aac9647de3 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:25.758947 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-14297bee-127b-40ae-b99f-b4aac9647de3 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:25.759578 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-14297bee-127b-40ae-b99f-b4aac9647de3 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:25.924095 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-14297bee-127b-40ae-b99f-b4aac9647de3 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:25.936956 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-14297bee-127b-40ae-b99f-b4aac9647de3 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7" status: 200 len: 1322 microversion: 2.1 time: 0.209976 Aug 07 01:36:25.940673 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2300/5056] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:25 2022] GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:36:26.069701 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e602fdf6-edd7-4d31-b406-61170a752108 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:26.072112 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e602fdf6-edd7-4d31-b406-61170a752108 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:26.080304 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e602fdf6-edd7-4d31-b406-61170a752108 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:26.082408 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e602fdf6-edd7-4d31-b406-61170a752108 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:26.083129 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e602fdf6-edd7-4d31-b406-61170a752108 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:26.084269 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e602fdf6-edd7-4d31-b406-61170a752108 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:26.084987 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e602fdf6-edd7-4d31-b406-61170a752108 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:26.085708 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e602fdf6-edd7-4d31-b406-61170a752108 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:26.178307 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e602fdf6-edd7-4d31-b406-61170a752108 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:26.188116 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e602fdf6-edd7-4d31-b406-61170a752108 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:26.189976 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e602fdf6-edd7-4d31-b406-61170a752108 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:26.191189 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e602fdf6-edd7-4d31-b406-61170a752108 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7" status: 200 len: 1365 microversion: 2.47 time: 0.130928 Aug 07 01:36:26.191837 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2301/5057] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:26 2022] GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7 => generated 1365 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:36:26.617397 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5cc91e29-237d-4abe-b2b8-468a97b759fc tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:26.627166 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5cc91e29-237d-4abe-b2b8-468a97b759fc tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84" status: 200 len: 1365 microversion: 2.1 time: 1.151722 Aug 07 01:36:26.628029 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2757/5058] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:25 2022] GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84 => generated 1365 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:26.962161 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4baa105e-068a-4307-9d07-57f2b55ba9c9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:26.963481 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4baa105e-068a-4307-9d07-57f2b55ba9c9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:26.974098 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4baa105e-068a-4307-9d07-57f2b55ba9c9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:26.975129 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4baa105e-068a-4307-9d07-57f2b55ba9c9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:26.975785 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4baa105e-068a-4307-9d07-57f2b55ba9c9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:26.976842 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4baa105e-068a-4307-9d07-57f2b55ba9c9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:26.977373 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4baa105e-068a-4307-9d07-57f2b55ba9c9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:26.978023 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4baa105e-068a-4307-9d07-57f2b55ba9c9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:27.225544 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2789859f-eaf5-4b91-8ea5-c6fe40c25c0e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:27.235280 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2789859f-eaf5-4b91-8ea5-c6fe40c25c0e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:27.254205 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4baa105e-068a-4307-9d07-57f2b55ba9c9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:27.256759 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2789859f-eaf5-4b91-8ea5-c6fe40c25c0e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:27.257723 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2789859f-eaf5-4b91-8ea5-c6fe40c25c0e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:27.257723 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2789859f-eaf5-4b91-8ea5-c6fe40c25c0e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:27.258420 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2789859f-eaf5-4b91-8ea5-c6fe40c25c0e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:27.259076 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2789859f-eaf5-4b91-8ea5-c6fe40c25c0e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:27.259670 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2789859f-eaf5-4b91-8ea5-c6fe40c25c0e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:27.262310 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4baa105e-068a-4307-9d07-57f2b55ba9c9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7" status: 200 len: 1322 microversion: 2.1 time: 0.305609 Aug 07 01:36:27.280387 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2302/5059] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:26 2022] GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 => generated 1322 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:27.386803 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2789859f-eaf5-4b91-8ea5-c6fe40c25c0e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:27.411779 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2789859f-eaf5-4b91-8ea5-c6fe40c25c0e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:27.418366 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2789859f-eaf5-4b91-8ea5-c6fe40c25c0e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:27.421326 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2789859f-eaf5-4b91-8ea5-c6fe40c25c0e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7" status: 200 len: 1365 microversion: 2.47 time: 0.208981 Aug 07 01:36:27.423725 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2758/5060] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:27 2022] GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7 => generated 1365 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:36:27.462410 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-78480c34-9ebe-4573-93b6-27a591c3fb46 req-0d90d1ef-1c0d-4a2d-a688-6dea043d30bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40fafd12-87a1-49ad-9152-5b47f28a80b7", "name": "network-vif-plugged", "status": "completed", "tag": "ce724099-1eb9-4a4e-a13c-2ca5bf4b41ad"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:36:27.495546 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-78480c34-9ebe-4573-93b6-27a591c3fb46 req-0d90d1ef-1c0d-4a2d-a688-6dea043d30bf service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:27.504724 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-78480c34-9ebe-4573-93b6-27a591c3fb46 req-0d90d1ef-1c0d-4a2d-a688-6dea043d30bf service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:27.505452 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-78480c34-9ebe-4573-93b6-27a591c3fb46 req-0d90d1ef-1c0d-4a2d-a688-6dea043d30bf service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:27.534457 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-78480c34-9ebe-4573-93b6-27a591c3fb46 req-0d90d1ef-1c0d-4a2d-a688-6dea043d30bf service nova] Creating event network-vif-plugged:ce724099-1eb9-4a4e-a13c-2ca5bf4b41ad for instance 40fafd12-87a1-49ad-9152-5b47f28a80b7 on n-h1-master-1 Aug 07 01:36:27.557728 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-78480c34-9ebe-4573-93b6-27a591c3fb46 req-0d90d1ef-1c0d-4a2d-a688-6dea043d30bf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099353 Aug 07 01:36:27.558374 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2303/5061] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:36:27.559044 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ef3b9435-1e2e-4baf-9863-9e12c1e3ff6f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1345123025", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "292dddd5-ed28-43d0-b5c6-61ff270beb56"}], "security_groups": [{"name": "tempest-securitygroup--726542936"}], "key_name": "tempest-keypair-1667813352", "user_data": "}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:36:27.664337 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-95d0d88b-09c0-4ea7-ad5d-0519164ed430 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:27.665056 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-95d0d88b-09c0-4ea7-ad5d-0519164ed430 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 0658227f-88e6-40fd-bb8f-aa6267addc84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:27.689061 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-95d0d88b-09c0-4ea7-ad5d-0519164ed430 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:27.689621 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-95d0d88b-09c0-4ea7-ad5d-0519164ed430 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:27.690532 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-95d0d88b-09c0-4ea7-ad5d-0519164ed430 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:27.705205 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-95d0d88b-09c0-4ea7-ad5d-0519164ed430 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:27.706674 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-95d0d88b-09c0-4ea7-ad5d-0519164ed430 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:27.707375 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-95d0d88b-09c0-4ea7-ad5d-0519164ed430 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:28.026487 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-ef3b9435-1e2e-4baf-9863-9e12c1e3ff6f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] validate_networks() for [('292dddd5-ed28-43d0-b5c6-61ff270beb56', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:36:28.058335 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-95d0d88b-09c0-4ea7-ad5d-0519164ed430 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:28.066298 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-95d0d88b-09c0-4ea7-ad5d-0519164ed430 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84" status: 200 len: 1365 microversion: 2.1 time: 0.407165 Aug 07 01:36:28.070854 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2304/5062] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:27 2022] GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84 => generated 1365 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:36:28.288395 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b5f7b975-016f-4fb4-87ee-11a2c010b6f1 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:28.289014 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b5f7b975-016f-4fb4-87ee-11a2c010b6f1 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:28.298165 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5f7b975-016f-4fb4-87ee-11a2c010b6f1 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:28.298667 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5f7b975-016f-4fb4-87ee-11a2c010b6f1 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:28.299101 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5f7b975-016f-4fb4-87ee-11a2c010b6f1 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:28.299813 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5f7b975-016f-4fb4-87ee-11a2c010b6f1 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:28.300289 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5f7b975-016f-4fb4-87ee-11a2c010b6f1 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:28.300746 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5f7b975-016f-4fb4-87ee-11a2c010b6f1 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:28.661024 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b5f7b975-016f-4fb4-87ee-11a2c010b6f1 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:28.670026 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b5f7b975-016f-4fb4-87ee-11a2c010b6f1 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7" status: 200 len: 1322 microversion: 2.1 time: 0.385996 Aug 07 01:36:28.670620 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2305/5063] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:28 2022] GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 => generated 1322 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:36:28.684006 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8a917a38-fc65-4324-90b6-600620b339e9 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:28.684693 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8a917a38-fc65-4324-90b6-600620b339e9 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:28.697401 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a917a38-fc65-4324-90b6-600620b339e9 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:28.697899 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a917a38-fc65-4324-90b6-600620b339e9 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:28.698339 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a917a38-fc65-4324-90b6-600620b339e9 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:28.699056 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a917a38-fc65-4324-90b6-600620b339e9 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:28.699512 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a917a38-fc65-4324-90b6-600620b339e9 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:28.699985 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a917a38-fc65-4324-90b6-600620b339e9 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:28.767684 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:28.858884 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8a917a38-fc65-4324-90b6-600620b339e9 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:28.892060 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8a917a38-fc65-4324-90b6-600620b339e9 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:28.895686 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8a917a38-fc65-4324-90b6-600620b339e9 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:28.898153 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8a917a38-fc65-4324-90b6-600620b339e9 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7" status: 200 len: 1365 microversion: 2.47 time: 0.226495 Aug 07 01:36:28.899275 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2306/5064] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:28 2022] GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7 => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:29.091084 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f7748369-2c4b-490f-b1b4-907e9b599116 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:29.092208 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f7748369-2c4b-490f-b1b4-907e9b599116 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 0658227f-88e6-40fd-bb8f-aa6267addc84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:29.100418 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f7748369-2c4b-490f-b1b4-907e9b599116 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:29.100931 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f7748369-2c4b-490f-b1b4-907e9b599116 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:29.101480 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f7748369-2c4b-490f-b1b4-907e9b599116 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:29.103554 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f7748369-2c4b-490f-b1b4-907e9b599116 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:29.104244 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f7748369-2c4b-490f-b1b4-907e9b599116 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:29.104905 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f7748369-2c4b-490f-b1b4-907e9b599116 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:29.422148 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f7748369-2c4b-490f-b1b4-907e9b599116 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:29.439189 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f7748369-2c4b-490f-b1b4-907e9b599116 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84" status: 200 len: 1365 microversion: 2.1 time: 0.353675 Aug 07 01:36:29.441130 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2307/5065] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:29 2022] GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84 => generated 1365 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:36:29.591378 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=22 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:29.634697 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-ff754a0f-9109-4245-931c-c9abdcdf77a2 req-825a7ddb-25f4-4086-a8e3-970772ad86aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67905784-e195-4938-9ea1-7e0fb23ffd4d", "name": "network-vif-plugged", "status": "completed", "tag": "4710e5d5-f96e-42f2-99ea-feeb68044c68"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:36:29.656889 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-ff754a0f-9109-4245-931c-c9abdcdf77a2 req-825a7ddb-25f4-4086-a8e3-970772ad86aa service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:29.666412 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-ff754a0f-9109-4245-931c-c9abdcdf77a2 req-825a7ddb-25f4-4086-a8e3-970772ad86aa service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:29.667154 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-ff754a0f-9109-4245-931c-c9abdcdf77a2 req-825a7ddb-25f4-4086-a8e3-970772ad86aa service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:29.696037 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-ff754a0f-9109-4245-931c-c9abdcdf77a2 req-825a7ddb-25f4-4086-a8e3-970772ad86aa service nova] Creating event network-vif-plugged:4710e5d5-f96e-42f2-99ea-feeb68044c68 for instance 67905784-e195-4938-9ea1-7e0fb23ffd4d on n-h1-master-1 Aug 07 01:36:29.706297 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-ff754a0f-9109-4245-931c-c9abdcdf77a2 req-825a7ddb-25f4-4086-a8e3-970772ad86aa service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077374 Aug 07 01:36:29.716527 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2308/5066] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:36:29.724149 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f29bef1e-3dbd-40b7-8f0d-833092f543f9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:29.725164 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f29bef1e-3dbd-40b7-8f0d-833092f543f9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:29.739600 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f29bef1e-3dbd-40b7-8f0d-833092f543f9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:29.750838 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f29bef1e-3dbd-40b7-8f0d-833092f543f9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:29.754755 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f29bef1e-3dbd-40b7-8f0d-833092f543f9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:29.756683 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f29bef1e-3dbd-40b7-8f0d-833092f543f9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:29.762854 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f29bef1e-3dbd-40b7-8f0d-833092f543f9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:29.764205 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f29bef1e-3dbd-40b7-8f0d-833092f543f9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:29.944895 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-ef3b9435-1e2e-4baf-9863-9e12c1e3ff6f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:36:29.945400 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-ef3b9435-1e2e-4baf-9863-9e12c1e3ff6f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:36:29.945960 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-ef3b9435-1e2e-4baf-9863-9e12c1e3ff6f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:36:29.946448 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-ef3b9435-1e2e-4baf-9863-9e12c1e3ff6f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:36:29.947100 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-ef3b9435-1e2e-4baf-9863-9e12c1e3ff6f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:36:29.972071 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef3b9435-1e2e-4baf-9863-9e12c1e3ff6f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:29.973496 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef3b9435-1e2e-4baf-9863-9e12c1e3ff6f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:29.974207 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef3b9435-1e2e-4baf-9863-9e12c1e3ff6f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:29.975303 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef3b9435-1e2e-4baf-9863-9e12c1e3ff6f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:29.989891 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef3b9435-1e2e-4baf-9863-9e12c1e3ff6f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:29.990762 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef3b9435-1e2e-4baf-9863-9e12c1e3ff6f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:30.021152 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-ef3b9435-1e2e-4baf-9863-9e12c1e3ff6f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Getting quotas for project 284c227cd03a4c1294ed40d7b1594d56. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:36:30.030737 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-ef3b9435-1e2e-4baf-9863-9e12c1e3ff6f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Getting quotas for user bed65a4d62184f52af3d2dd322eeec47 and project 284c227cd03a4c1294ed40d7b1594d56. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:36:30.053833 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ef3b9435-1e2e-4baf-9863-9e12c1e3ff6f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:36:30.057076 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ef3b9435-1e2e-4baf-9863-9e12c1e3ff6f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:36:30.153782 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ef3b9435-1e2e-4baf-9863-9e12c1e3ff6f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.600539 Aug 07 01:36:30.164288 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2759/5067] 10.222.0.39 () {62 vars in 1188 bytes} [Sun Aug 7 01:36:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 2611 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 07 01:36:30.171574 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-35fc9ab9-e1a4-472a-a320-c9a533a1f630 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:30.183641 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-35fc9ab9-e1a4-472a-a320-c9a533a1f630 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:30.204021 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-35fc9ab9-e1a4-472a-a320-c9a533a1f630 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:30.204525 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-35fc9ab9-e1a4-472a-a320-c9a533a1f630 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:30.204974 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-35fc9ab9-e1a4-472a-a320-c9a533a1f630 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:30.206008 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-35fc9ab9-e1a4-472a-a320-c9a533a1f630 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:30.206485 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-35fc9ab9-e1a4-472a-a320-c9a533a1f630 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:30.207484 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-35fc9ab9-e1a4-472a-a320-c9a533a1f630 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:30.327574 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f29bef1e-3dbd-40b7-8f0d-833092f543f9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:30.365900 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f29bef1e-3dbd-40b7-8f0d-833092f543f9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7" status: 200 len: 1515 microversion: 2.1 time: 0.647146 Aug 07 01:36:30.366649 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2309/5068] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:29 2022] GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 => generated 1515 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:30.395212 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d52aa887-ab52-42df-aec6-6f08f6533ca7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:30.397181 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d52aa887-ab52-42df-aec6-6f08f6533ca7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:30.544485 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d52aa887-ab52-42df-aec6-6f08f6533ca7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:30.560682 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d52aa887-ab52-42df-aec6-6f08f6533ca7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:30.562404 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d52aa887-ab52-42df-aec6-6f08f6533ca7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:30.570621 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d52aa887-ab52-42df-aec6-6f08f6533ca7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1282 microversion: 2.20 time: 0.200327 Aug 07 01:36:30.590171 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2310/5069] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:30 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1282 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:30.599392 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cc51dd85-4ba9-4007-8c12-ff865a0535a6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:36:30.606396 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-cc51dd85-4ba9-4007-8c12-ff865a0535a6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:30.648036 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc51dd85-4ba9-4007-8c12-ff865a0535a6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:30.648555 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc51dd85-4ba9-4007-8c12-ff865a0535a6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:30.649003 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc51dd85-4ba9-4007-8c12-ff865a0535a6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:30.649750 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc51dd85-4ba9-4007-8c12-ff865a0535a6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:30.650210 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc51dd85-4ba9-4007-8c12-ff865a0535a6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:30.650642 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc51dd85-4ba9-4007-8c12-ff865a0535a6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:30.717984 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-cc51dd85-4ba9-4007-8c12-ff865a0535a6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lazy-loading 'flavor' on Instance uuid 40fafd12-87a1-49ad-9152-5b47f28a80b7 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:36:30.840760 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cc51dd85-4ba9-4007-8c12-ff865a0535a6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "POST /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7/action" status: 200 len: 32 microversion: 2.1 time: 0.248645 Aug 07 01:36:30.842007 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2311/5070] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:36:30 2022] POST /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7/action => generated 32 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:36:30.849681 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ee8d1504-a6ae-47a6-827f-cd3e322f44e7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:30.850459 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ee8d1504-a6ae-47a6-827f-cd3e322f44e7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 0658227f-88e6-40fd-bb8f-aa6267addc84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:30.860541 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee8d1504-a6ae-47a6-827f-cd3e322f44e7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:30.860699 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee8d1504-a6ae-47a6-827f-cd3e322f44e7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:30.861117 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee8d1504-a6ae-47a6-827f-cd3e322f44e7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:30.862442 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee8d1504-a6ae-47a6-827f-cd3e322f44e7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:30.862943 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee8d1504-a6ae-47a6-827f-cd3e322f44e7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:30.864273 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee8d1504-a6ae-47a6-827f-cd3e322f44e7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:30.925874 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-35fc9ab9-e1a4-472a-a320-c9a533a1f630 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:30.946138 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-35fc9ab9-e1a4-472a-a320-c9a533a1f630 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:30.948055 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-35fc9ab9-e1a4-472a-a320-c9a533a1f630 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:30.949369 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-35fc9ab9-e1a4-472a-a320-c9a533a1f630 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7" status: 200 len: 1365 microversion: 2.47 time: 0.784401 Aug 07 01:36:30.951024 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2760/5071] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:30 2022] GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7 => generated 1365 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:30.963821 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bba832b0-dbd9-4a35-aeb3-a63fa2f9e6d3 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:30.964509 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bba832b0-dbd9-4a35-aeb3-a63fa2f9e6d3 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:30.983238 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bba832b0-dbd9-4a35-aeb3-a63fa2f9e6d3 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:30.983749 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bba832b0-dbd9-4a35-aeb3-a63fa2f9e6d3 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:30.984454 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bba832b0-dbd9-4a35-aeb3-a63fa2f9e6d3 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:30.985382 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bba832b0-dbd9-4a35-aeb3-a63fa2f9e6d3 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:30.986015 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bba832b0-dbd9-4a35-aeb3-a63fa2f9e6d3 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:30.986862 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bba832b0-dbd9-4a35-aeb3-a63fa2f9e6d3 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:31.638732 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ee8d1504-a6ae-47a6-827f-cd3e322f44e7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:31.652025 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ee8d1504-a6ae-47a6-827f-cd3e322f44e7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84" status: 200 len: 1365 microversion: 2.1 time: 0.808558 Aug 07 01:36:31.656771 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2312/5072] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:30 2022] GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84 => generated 1365 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:31.668931 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-72ac87fd-3405-47eb-8cb5-e3b47afbb8a4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:31.669869 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-72ac87fd-3405-47eb-8cb5-e3b47afbb8a4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:31.684021 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-72ac87fd-3405-47eb-8cb5-e3b47afbb8a4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:31.689246 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-72ac87fd-3405-47eb-8cb5-e3b47afbb8a4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:31.690026 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-72ac87fd-3405-47eb-8cb5-e3b47afbb8a4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:31.705892 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-72ac87fd-3405-47eb-8cb5-e3b47afbb8a4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:31.708667 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-72ac87fd-3405-47eb-8cb5-e3b47afbb8a4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:31.715363 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-72ac87fd-3405-47eb-8cb5-e3b47afbb8a4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:31.892912 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bba832b0-dbd9-4a35-aeb3-a63fa2f9e6d3 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:31.896473 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-72ac87fd-3405-47eb-8cb5-e3b47afbb8a4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:31.904966 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-72ac87fd-3405-47eb-8cb5-e3b47afbb8a4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:31.906735 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bba832b0-dbd9-4a35-aeb3-a63fa2f9e6d3 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7" status: 200 len: 1521 microversion: 2.1 time: 0.953644 Aug 07 01:36:31.920704 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2761/5073] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:30 2022] GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 => generated 1521 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:31.920833 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-72ac87fd-3405-47eb-8cb5-e3b47afbb8a4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:31.923003 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-72ac87fd-3405-47eb-8cb5-e3b47afbb8a4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1278 microversion: 2.20 time: 0.264847 Aug 07 01:36:31.930906 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-b4f421dd-d780-4035-a3f5-2c4b86b68434 req-978b3381-a5a1-4965-a9a0-42e092a3319b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0658227f-88e6-40fd-bb8f-aa6267addc84", "name": "network-vif-plugged", "status": "completed", "tag": "7a3c38b5-4424-4a27-9219-94e88ef4a328"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:36:31.946773 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2313/5074] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:31 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1278 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:31.977893 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2e3d8968-24de-41e0-bf79-640612348674 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:31.978786 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2e3d8968-24de-41e0-bf79-640612348674 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:32.000482 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2e3d8968-24de-41e0-bf79-640612348674 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:32.007811 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2e3d8968-24de-41e0-bf79-640612348674 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:32.008308 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2e3d8968-24de-41e0-bf79-640612348674 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:32.009074 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2e3d8968-24de-41e0-bf79-640612348674 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:32.009551 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2e3d8968-24de-41e0-bf79-640612348674 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:32.009987 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2e3d8968-24de-41e0-bf79-640612348674 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:32.016579 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b4f421dd-d780-4035-a3f5-2c4b86b68434 req-978b3381-a5a1-4965-a9a0-42e092a3319b service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:32.018137 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b4f421dd-d780-4035-a3f5-2c4b86b68434 req-978b3381-a5a1-4965-a9a0-42e092a3319b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:32.018948 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b4f421dd-d780-4035-a3f5-2c4b86b68434 req-978b3381-a5a1-4965-a9a0-42e092a3319b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:32.068071 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-b4f421dd-d780-4035-a3f5-2c4b86b68434 req-978b3381-a5a1-4965-a9a0-42e092a3319b service nova] Creating event network-vif-plugged:7a3c38b5-4424-4a27-9219-94e88ef4a328 for instance 0658227f-88e6-40fd-bb8f-aa6267addc84 on n-h1-master-1 Aug 07 01:36:32.106721 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-b4f421dd-d780-4035-a3f5-2c4b86b68434 req-978b3381-a5a1-4965-a9a0-42e092a3319b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190223 Aug 07 01:36:32.116628 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2762/5075] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:36:32.204916 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2e3d8968-24de-41e0-bf79-640612348674 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:32.214569 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2e3d8968-24de-41e0-bf79-640612348674 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:32.219835 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2e3d8968-24de-41e0-bf79-640612348674 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:32.224381 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2e3d8968-24de-41e0-bf79-640612348674 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7" status: 200 len: 1365 microversion: 2.47 time: 0.251456 Aug 07 01:36:32.227402 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2314/5076] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:31 2022] GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7 => generated 1365 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:36:32.689496 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-84389d8b-87e9-470c-b7dc-b35dada1ea0b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:32.690722 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-84389d8b-87e9-470c-b7dc-b35dada1ea0b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 0658227f-88e6-40fd-bb8f-aa6267addc84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:32.713051 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84389d8b-87e9-470c-b7dc-b35dada1ea0b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:32.717148 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84389d8b-87e9-470c-b7dc-b35dada1ea0b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:32.717918 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84389d8b-87e9-470c-b7dc-b35dada1ea0b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:32.720060 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84389d8b-87e9-470c-b7dc-b35dada1ea0b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:32.722110 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84389d8b-87e9-470c-b7dc-b35dada1ea0b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:32.727304 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84389d8b-87e9-470c-b7dc-b35dada1ea0b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:32.936191 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-12ea2ccd-23d5-4d2d-bb41-9d8b06cb2e64 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:32.937496 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-12ea2ccd-23d5-4d2d-bb41-9d8b06cb2e64 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:32.945645 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12ea2ccd-23d5-4d2d-bb41-9d8b06cb2e64 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:32.949081 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12ea2ccd-23d5-4d2d-bb41-9d8b06cb2e64 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:32.949779 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12ea2ccd-23d5-4d2d-bb41-9d8b06cb2e64 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:32.953017 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12ea2ccd-23d5-4d2d-bb41-9d8b06cb2e64 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:32.953920 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12ea2ccd-23d5-4d2d-bb41-9d8b06cb2e64 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:32.954713 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12ea2ccd-23d5-4d2d-bb41-9d8b06cb2e64 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:33.408516 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-84389d8b-87e9-470c-b7dc-b35dada1ea0b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:33.421064 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-84389d8b-87e9-470c-b7dc-b35dada1ea0b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84" status: 200 len: 1365 microversion: 2.1 time: 0.738013 Aug 07 01:36:33.421683 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2763/5077] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:32 2022] GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84 => generated 1365 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:33.449851 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-72e10afe-9215-4603-9ba6-a4403c8095f0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:33.450481 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-72e10afe-9215-4603-9ba6-a4403c8095f0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:33.461372 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72e10afe-9215-4603-9ba6-a4403c8095f0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:33.461865 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72e10afe-9215-4603-9ba6-a4403c8095f0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:33.462310 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72e10afe-9215-4603-9ba6-a4403c8095f0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:33.467172 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72e10afe-9215-4603-9ba6-a4403c8095f0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:33.473704 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72e10afe-9215-4603-9ba6-a4403c8095f0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:33.474413 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72e10afe-9215-4603-9ba6-a4403c8095f0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:33.644048 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-72e10afe-9215-4603-9ba6-a4403c8095f0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:33.655404 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-72e10afe-9215-4603-9ba6-a4403c8095f0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:33.658647 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-72e10afe-9215-4603-9ba6-a4403c8095f0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:33.660824 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-72e10afe-9215-4603-9ba6-a4403c8095f0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1340 microversion: 2.20 time: 0.221760 Aug 07 01:36:33.661663 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2764/5078] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:33 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1340 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:33.666938 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-26a94eb9-65b7-46be-956b-8715893fc7a1 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:33.667933 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-26a94eb9-65b7-46be-956b-8715893fc7a1 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:33.675098 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-26a94eb9-65b7-46be-956b-8715893fc7a1 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:33.676697 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-26a94eb9-65b7-46be-956b-8715893fc7a1 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:33.677397 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-26a94eb9-65b7-46be-956b-8715893fc7a1 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:33.678437 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-26a94eb9-65b7-46be-956b-8715893fc7a1 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:33.679331 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-26a94eb9-65b7-46be-956b-8715893fc7a1 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:33.680128 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-26a94eb9-65b7-46be-956b-8715893fc7a1 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:33.887546 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-26a94eb9-65b7-46be-956b-8715893fc7a1 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:33.904169 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-26a94eb9-65b7-46be-956b-8715893fc7a1 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:33.905848 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-26a94eb9-65b7-46be-956b-8715893fc7a1 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:33.907146 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-26a94eb9-65b7-46be-956b-8715893fc7a1 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7" status: 200 len: 1365 microversion: 2.47 time: 0.244224 Aug 07 01:36:33.907730 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2765/5079] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:33 2022] GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7 => generated 1365 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:34.150692 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-12ea2ccd-23d5-4d2d-bb41-9d8b06cb2e64 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:34.162403 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-12ea2ccd-23d5-4d2d-bb41-9d8b06cb2e64 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7" status: 200 len: 1521 microversion: 2.1 time: 1.233279 Aug 07 01:36:34.162998 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2315/5080] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:32 2022] GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 => generated 1521 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:34.447521 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ee5b499a-7420-4f05-9791-b1a4efff683d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:34.448821 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ee5b499a-7420-4f05-9791-b1a4efff683d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 0658227f-88e6-40fd-bb8f-aa6267addc84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:34.457797 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee5b499a-7420-4f05-9791-b1a4efff683d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:34.458392 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee5b499a-7420-4f05-9791-b1a4efff683d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:34.459289 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee5b499a-7420-4f05-9791-b1a4efff683d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:34.460282 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee5b499a-7420-4f05-9791-b1a4efff683d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:34.460986 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee5b499a-7420-4f05-9791-b1a4efff683d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:34.461633 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee5b499a-7420-4f05-9791-b1a4efff683d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:34.687138 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a980331a-f07b-450a-8359-59cfb21a6087 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:34.687766 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a980331a-f07b-450a-8359-59cfb21a6087 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:34.693164 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ee5b499a-7420-4f05-9791-b1a4efff683d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:34.697635 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a980331a-f07b-450a-8359-59cfb21a6087 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:34.699311 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a980331a-f07b-450a-8359-59cfb21a6087 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:34.700601 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a980331a-f07b-450a-8359-59cfb21a6087 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:34.702544 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a980331a-f07b-450a-8359-59cfb21a6087 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:34.704167 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a980331a-f07b-450a-8359-59cfb21a6087 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:34.704618 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a980331a-f07b-450a-8359-59cfb21a6087 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:34.707497 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ee5b499a-7420-4f05-9791-b1a4efff683d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84" status: 200 len: 1555 microversion: 2.1 time: 0.264244 Aug 07 01:36:34.715245 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2766/5081] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:34 2022] GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84 => generated 1555 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:34.735579 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-64d46aa7-6f23-43a1-8b34-63eab051a32f tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:34.736508 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-64d46aa7-6f23-43a1-8b34-63eab051a32f tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 0658227f-88e6-40fd-bb8f-aa6267addc84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:34.753446 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64d46aa7-6f23-43a1-8b34-63eab051a32f tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:34.755087 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64d46aa7-6f23-43a1-8b34-63eab051a32f tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:34.758400 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64d46aa7-6f23-43a1-8b34-63eab051a32f tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:34.760063 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64d46aa7-6f23-43a1-8b34-63eab051a32f tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:34.763005 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64d46aa7-6f23-43a1-8b34-63eab051a32f tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:34.765255 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64d46aa7-6f23-43a1-8b34-63eab051a32f tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:34.995130 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a980331a-f07b-450a-8359-59cfb21a6087 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:35.015491 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a980331a-f07b-450a-8359-59cfb21a6087 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:35.018020 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a980331a-f07b-450a-8359-59cfb21a6087 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:35.019315 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a980331a-f07b-450a-8359-59cfb21a6087 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1340 microversion: 2.20 time: 0.336363 Aug 07 01:36:35.020485 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2316/5082] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:34 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1340 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:36:35.025734 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-64d46aa7-6f23-43a1-8b34-63eab051a32f tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.296525 Aug 07 01:36:35.026533 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2767/5083] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Aug 7 01:36:34 2022] GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84/os-interface => generated 285 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:36:35.051820 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6c2f17f2-39bd-4f89-8385-3f25871eaebf tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:35.052534 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6c2f17f2-39bd-4f89-8385-3f25871eaebf tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:35.068356 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c2f17f2-39bd-4f89-8385-3f25871eaebf tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:35.069154 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c2f17f2-39bd-4f89-8385-3f25871eaebf tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:35.069658 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c2f17f2-39bd-4f89-8385-3f25871eaebf tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:35.070441 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c2f17f2-39bd-4f89-8385-3f25871eaebf tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:35.071266 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c2f17f2-39bd-4f89-8385-3f25871eaebf tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:35.073687 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c2f17f2-39bd-4f89-8385-3f25871eaebf tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:35.187141 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-915b8d6a-3cc7-4c78-b38e-a83ca7ad914e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:35.188241 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-915b8d6a-3cc7-4c78-b38e-a83ca7ad914e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:35.198487 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-915b8d6a-3cc7-4c78-b38e-a83ca7ad914e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:35.202330 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-915b8d6a-3cc7-4c78-b38e-a83ca7ad914e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:35.203207 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-915b8d6a-3cc7-4c78-b38e-a83ca7ad914e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:35.206429 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-915b8d6a-3cc7-4c78-b38e-a83ca7ad914e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:35.207200 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-915b8d6a-3cc7-4c78-b38e-a83ca7ad914e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:35.207876 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-915b8d6a-3cc7-4c78-b38e-a83ca7ad914e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:35.379473 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6c2f17f2-39bd-4f89-8385-3f25871eaebf tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:35.390739 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6c2f17f2-39bd-4f89-8385-3f25871eaebf tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:35.392824 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6c2f17f2-39bd-4f89-8385-3f25871eaebf tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:35.394829 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6c2f17f2-39bd-4f89-8385-3f25871eaebf tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7" status: 200 len: 1365 microversion: 2.47 time: 0.372614 Aug 07 01:36:35.409272 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2317/5084] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:35 2022] GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7 => generated 1365 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:35.428738 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-915b8d6a-3cc7-4c78-b38e-a83ca7ad914e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:35.439363 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-915b8d6a-3cc7-4c78-b38e-a83ca7ad914e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7" status: 200 len: 1521 microversion: 2.1 time: 0.256644 Aug 07 01:36:35.442100 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2768/5085] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:35 2022] GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:36:36.044546 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bc59d790-0dc3-4c6f-add5-5537154d663f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:36.045104 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bc59d790-0dc3-4c6f-add5-5537154d663f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:36.069086 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc59d790-0dc3-4c6f-add5-5537154d663f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:36.069837 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc59d790-0dc3-4c6f-add5-5537154d663f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:36.070544 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc59d790-0dc3-4c6f-add5-5537154d663f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:36.072222 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc59d790-0dc3-4c6f-add5-5537154d663f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:36.073934 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc59d790-0dc3-4c6f-add5-5537154d663f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:36.075848 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc59d790-0dc3-4c6f-add5-5537154d663f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:36.423178 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5638ec91-99a6-4984-9726-e979f4b40681 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:36.423962 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5638ec91-99a6-4984-9726-e979f4b40681 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:36.445676 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5638ec91-99a6-4984-9726-e979f4b40681 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:36.458402 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5638ec91-99a6-4984-9726-e979f4b40681 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:36.459571 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5638ec91-99a6-4984-9726-e979f4b40681 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:36.461036 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5638ec91-99a6-4984-9726-e979f4b40681 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:36.461787 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5638ec91-99a6-4984-9726-e979f4b40681 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:36.462430 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5638ec91-99a6-4984-9726-e979f4b40681 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:36.651509 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5638ec91-99a6-4984-9726-e979f4b40681 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:36.684902 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5638ec91-99a6-4984-9726-e979f4b40681 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:36.703501 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5638ec91-99a6-4984-9726-e979f4b40681 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:36.704938 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5638ec91-99a6-4984-9726-e979f4b40681 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7" status: 200 len: 1365 microversion: 2.47 time: 0.288182 Aug 07 01:36:36.705533 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2769/5086] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:36 2022] GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7 => generated 1365 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:36.723219 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e839795a-12ad-403d-a870-78c4dd476676 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:36.724192 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e839795a-12ad-403d-a870-78c4dd476676 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:36.735744 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e839795a-12ad-403d-a870-78c4dd476676 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:36.736748 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e839795a-12ad-403d-a870-78c4dd476676 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:36.739052 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e839795a-12ad-403d-a870-78c4dd476676 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:36.741507 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e839795a-12ad-403d-a870-78c4dd476676 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:36.742302 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e839795a-12ad-403d-a870-78c4dd476676 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:36.743026 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e839795a-12ad-403d-a870-78c4dd476676 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:36.884662 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bc59d790-0dc3-4c6f-add5-5537154d663f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:36.904546 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bc59d790-0dc3-4c6f-add5-5537154d663f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:36.932808 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bc59d790-0dc3-4c6f-add5-5537154d663f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:36.935845 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bc59d790-0dc3-4c6f-add5-5537154d663f tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1407 microversion: 2.20 time: 0.895847 Aug 07 01:36:36.947919 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2318/5087] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:36 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1407 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:37.243968 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e839795a-12ad-403d-a870-78c4dd476676 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:37.252571 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:37.262212 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e839795a-12ad-403d-a870-78c4dd476676 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7" status: 200 len: 1521 microversion: 2.1 time: 0.548199 Aug 07 01:36:37.262934 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2770/5088] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:36 2022] GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 => generated 1521 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:37.737200 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ebe4f5b6-07ca-43df-ad0d-98a6449b37fa tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:37.738927 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ebe4f5b6-07ca-43df-ad0d-98a6449b37fa tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:37.748215 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ebe4f5b6-07ca-43df-ad0d-98a6449b37fa tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:37.749230 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ebe4f5b6-07ca-43df-ad0d-98a6449b37fa tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:37.749900 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ebe4f5b6-07ca-43df-ad0d-98a6449b37fa tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:37.751764 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ebe4f5b6-07ca-43df-ad0d-98a6449b37fa tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:37.752512 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ebe4f5b6-07ca-43df-ad0d-98a6449b37fa tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:37.753257 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ebe4f5b6-07ca-43df-ad0d-98a6449b37fa tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:37.893686 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ebe4f5b6-07ca-43df-ad0d-98a6449b37fa tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:37.907310 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ebe4f5b6-07ca-43df-ad0d-98a6449b37fa tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:37.909794 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ebe4f5b6-07ca-43df-ad0d-98a6449b37fa tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:37.911913 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ebe4f5b6-07ca-43df-ad0d-98a6449b37fa tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7" status: 200 len: 1365 microversion: 2.47 time: 0.184943 Aug 07 01:36:37.923909 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2319/5089] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:37 2022] GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7 => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:37.971071 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5e4164dc-0900-44b7-b72a-e6d3f73d6318 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:37.973452 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5e4164dc-0900-44b7-b72a-e6d3f73d6318 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:38.013749 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e4164dc-0900-44b7-b72a-e6d3f73d6318 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:38.014270 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e4164dc-0900-44b7-b72a-e6d3f73d6318 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:38.017816 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e4164dc-0900-44b7-b72a-e6d3f73d6318 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:38.018791 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e4164dc-0900-44b7-b72a-e6d3f73d6318 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:38.019494 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e4164dc-0900-44b7-b72a-e6d3f73d6318 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:38.020121 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e4164dc-0900-44b7-b72a-e6d3f73d6318 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:38.284341 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-49e52683-1763-40a8-85ca-68195e820ee7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:38.285338 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-49e52683-1763-40a8-85ca-68195e820ee7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:38.296338 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49e52683-1763-40a8-85ca-68195e820ee7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:38.296839 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49e52683-1763-40a8-85ca-68195e820ee7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:38.297403 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49e52683-1763-40a8-85ca-68195e820ee7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:38.297990 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49e52683-1763-40a8-85ca-68195e820ee7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:38.298443 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49e52683-1763-40a8-85ca-68195e820ee7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:38.298869 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49e52683-1763-40a8-85ca-68195e820ee7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:38.693834 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5e4164dc-0900-44b7-b72a-e6d3f73d6318 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:38.726343 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5e4164dc-0900-44b7-b72a-e6d3f73d6318 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:38.739257 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5e4164dc-0900-44b7-b72a-e6d3f73d6318 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:38.742402 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5e4164dc-0900-44b7-b72a-e6d3f73d6318 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1407 microversion: 2.20 time: 0.775316 Aug 07 01:36:38.744616 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2771/5090] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:37 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1407 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:38.954279 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b52f33b9-3e2d-4697-a461-c95157d91571 tempest-ComputeTenantNetworksTest-511900751 tempest-ComputeTenantNetworksTest-511900751-project] Calling method '.version_select at 0x7f9e17178f70>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:39.239095 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b52f33b9-3e2d-4697-a461-c95157d91571 tempest-ComputeTenantNetworksTest-511900751 tempest-ComputeTenantNetworksTest-511900751-project] 10.222.0.39 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.492677 Aug 07 01:36:39.247009 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2772/5091] 10.222.0.39 () {58 vars in 1158 bytes} [Sun Aug 7 01:36:38 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:36:39.253841 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-068e5e1b-1ae4-4d4d-8d9d-b3244bca545c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:39.255684 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-068e5e1b-1ae4-4d4d-8d9d-b3244bca545c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:39.271644 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-068e5e1b-1ae4-4d4d-8d9d-b3244bca545c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:39.272704 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-068e5e1b-1ae4-4d4d-8d9d-b3244bca545c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:39.273502 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-068e5e1b-1ae4-4d4d-8d9d-b3244bca545c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:39.275770 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-068e5e1b-1ae4-4d4d-8d9d-b3244bca545c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:39.276742 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-068e5e1b-1ae4-4d4d-8d9d-b3244bca545c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:39.277527 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-068e5e1b-1ae4-4d4d-8d9d-b3244bca545c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:39.409652 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-49e52683-1763-40a8-85ca-68195e820ee7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:39.419301 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-49e52683-1763-40a8-85ca-68195e820ee7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7" status: 200 len: 1521 microversion: 2.1 time: 1.140597 Aug 07 01:36:39.419957 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2320/5092] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:38 2022] GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 => generated 1521 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:36:39.435697 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a9615b9f-49dd-4e42-b15d-1a2b3695d83a tempest-ComputeTenantNetworksTest-511900751 tempest-ComputeTenantNetworksTest-511900751-project] Calling method '.version_select at 0x7f9e24af24c0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:39.466587 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-068e5e1b-1ae4-4d4d-8d9d-b3244bca545c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:39.479620 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-068e5e1b-1ae4-4d4d-8d9d-b3244bca545c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:39.482071 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-068e5e1b-1ae4-4d4d-8d9d-b3244bca545c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:39.483627 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-068e5e1b-1ae4-4d4d-8d9d-b3244bca545c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7" status: 200 len: 1365 microversion: 2.47 time: 0.235217 Aug 07 01:36:39.492018 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2773/5093] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:39 2022] GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7 => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:39.676782 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a9615b9f-49dd-4e42-b15d-1a2b3695d83a tempest-ComputeTenantNetworksTest-511900751 tempest-ComputeTenantNetworksTest-511900751-project] 10.222.0.39 "GET /compute/v2.1/os-tenant-networks/e5ce8b81-0186-405a-9269-2d76248d0959" status: 200 len: 139 microversion: 2.1 time: 0.247770 Aug 07 01:36:39.679614 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2321/5094] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Aug 7 01:36:39 2022] GET /compute/v2.1/os-tenant-networks/e5ce8b81-0186-405a-9269-2d76248d0959 => generated 139 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:36:39.771004 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-27e07ae2-6e6c-447c-8f30-da4d79989d81 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:39.773731 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-27e07ae2-6e6c-447c-8f30-da4d79989d81 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:39.780851 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27e07ae2-6e6c-447c-8f30-da4d79989d81 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:39.787515 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27e07ae2-6e6c-447c-8f30-da4d79989d81 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:39.788270 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27e07ae2-6e6c-447c-8f30-da4d79989d81 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:39.789139 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27e07ae2-6e6c-447c-8f30-da4d79989d81 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:39.789705 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27e07ae2-6e6c-447c-8f30-da4d79989d81 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:39.790223 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27e07ae2-6e6c-447c-8f30-da4d79989d81 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:40.002735 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:40.044363 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:40.055441 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-27e07ae2-6e6c-447c-8f30-da4d79989d81 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:40.079323 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-27e07ae2-6e6c-447c-8f30-da4d79989d81 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:40.081028 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-27e07ae2-6e6c-447c-8f30-da4d79989d81 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:40.087250 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-27e07ae2-6e6c-447c-8f30-da4d79989d81 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1407 microversion: 2.20 time: 0.320990 Aug 07 01:36:40.101528 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2774/5095] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:39 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1407 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:40.129967 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-6a4ddad4-1a3a-4245-9cde-a91d94915bcd req-dd66002b-0d2a-4cb0-abad-162488f63c95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0658227f-88e6-40fd-bb8f-aa6267addc84", "tag": "7a3c38b5-4424-4a27-9219-94e88ef4a328"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:36:40.155362 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6a4ddad4-1a3a-4245-9cde-a91d94915bcd req-dd66002b-0d2a-4cb0-abad-162488f63c95 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:40.155908 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6a4ddad4-1a3a-4245-9cde-a91d94915bcd req-dd66002b-0d2a-4cb0-abad-162488f63c95 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:40.156345 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6a4ddad4-1a3a-4245-9cde-a91d94915bcd req-dd66002b-0d2a-4cb0-abad-162488f63c95 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:40.196300 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-6a4ddad4-1a3a-4245-9cde-a91d94915bcd req-dd66002b-0d2a-4cb0-abad-162488f63c95 service nova] Creating event network-changed:7a3c38b5-4424-4a27-9219-94e88ef4a328 for instance 0658227f-88e6-40fd-bb8f-aa6267addc84 on n-h1-master-1 Aug 07 01:36:40.213757 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-6a4ddad4-1a3a-4245-9cde-a91d94915bcd req-dd66002b-0d2a-4cb0-abad-162488f63c95 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087296 Aug 07 01:36:40.213757 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2322/5096] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:36:40.442678 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0b047fa0-7ff1-4522-b0ad-3390196ad0f7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:40.443303 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0b047fa0-7ff1-4522-b0ad-3390196ad0f7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:40.456382 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b047fa0-7ff1-4522-b0ad-3390196ad0f7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:40.456901 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b047fa0-7ff1-4522-b0ad-3390196ad0f7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:40.457377 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b047fa0-7ff1-4522-b0ad-3390196ad0f7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:40.458107 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b047fa0-7ff1-4522-b0ad-3390196ad0f7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:40.460492 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b047fa0-7ff1-4522-b0ad-3390196ad0f7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:40.464768 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b047fa0-7ff1-4522-b0ad-3390196ad0f7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:40.516674 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-92b43be0-5063-4026-88b2-25d598eff212 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:40.518732 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-92b43be0-5063-4026-88b2-25d598eff212 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:40.547713 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-92b43be0-5063-4026-88b2-25d598eff212 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:40.561536 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-92b43be0-5063-4026-88b2-25d598eff212 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:40.562200 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-92b43be0-5063-4026-88b2-25d598eff212 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:40.563270 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-92b43be0-5063-4026-88b2-25d598eff212 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:40.563944 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-92b43be0-5063-4026-88b2-25d598eff212 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:40.564544 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-92b43be0-5063-4026-88b2-25d598eff212 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:40.565325 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:40.816446 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0b047fa0-7ff1-4522-b0ad-3390196ad0f7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:40.830970 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0b047fa0-7ff1-4522-b0ad-3390196ad0f7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7" status: 200 len: 1521 microversion: 2.1 time: 0.391981 Aug 07 01:36:40.848207 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2775/5097] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:40 2022] GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 => generated 1521 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:41.083297 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-92b43be0-5063-4026-88b2-25d598eff212 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:41.098851 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-92b43be0-5063-4026-88b2-25d598eff212 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:41.110801 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-43959244-6c9c-4d62-9da7-7005971a28f0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:41.111424 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-43959244-6c9c-4d62-9da7-7005971a28f0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:41.117912 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-92b43be0-5063-4026-88b2-25d598eff212 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:41.127922 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43959244-6c9c-4d62-9da7-7005971a28f0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:41.129754 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-92b43be0-5063-4026-88b2-25d598eff212 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7" status: 200 len: 1371 microversion: 2.47 time: 0.620015 Aug 07 01:36:41.130376 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2323/5098] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:40 2022] GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7 => generated 1371 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:41.130716 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43959244-6c9c-4d62-9da7-7005971a28f0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:41.131317 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43959244-6c9c-4d62-9da7-7005971a28f0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:41.133322 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43959244-6c9c-4d62-9da7-7005971a28f0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:41.135482 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43959244-6c9c-4d62-9da7-7005971a28f0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:41.137232 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43959244-6c9c-4d62-9da7-7005971a28f0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:41.505015 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-43959244-6c9c-4d62-9da7-7005971a28f0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:41.538424 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-43959244-6c9c-4d62-9da7-7005971a28f0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:41.542745 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-43959244-6c9c-4d62-9da7-7005971a28f0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:41.547854 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-43959244-6c9c-4d62-9da7-7005971a28f0 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1407 microversion: 2.20 time: 0.441052 Aug 07 01:36:41.550972 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2776/5099] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:41 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1407 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:36:41.864090 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6c815e48-a328-40c1-a94f-4c6521c5da2a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:41.865858 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6c815e48-a328-40c1-a94f-4c6521c5da2a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:41.891533 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c815e48-a328-40c1-a94f-4c6521c5da2a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:41.892540 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c815e48-a328-40c1-a94f-4c6521c5da2a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:41.893330 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c815e48-a328-40c1-a94f-4c6521c5da2a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:41.901485 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c815e48-a328-40c1-a94f-4c6521c5da2a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:41.902367 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c815e48-a328-40c1-a94f-4c6521c5da2a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:41.903067 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c815e48-a328-40c1-a94f-4c6521c5da2a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:41.941250 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:42.174500 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b8fabed9-0714-40f7-bf4c-e761d86a5cea tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:42.175725 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b8fabed9-0714-40f7-bf4c-e761d86a5cea tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:42.209630 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b8fabed9-0714-40f7-bf4c-e761d86a5cea tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:42.214693 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b8fabed9-0714-40f7-bf4c-e761d86a5cea tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:42.215556 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b8fabed9-0714-40f7-bf4c-e761d86a5cea tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:42.219928 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b8fabed9-0714-40f7-bf4c-e761d86a5cea tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:42.223983 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b8fabed9-0714-40f7-bf4c-e761d86a5cea tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:42.224796 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b8fabed9-0714-40f7-bf4c-e761d86a5cea tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:42.464586 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b8fabed9-0714-40f7-bf4c-e761d86a5cea tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:42.480834 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b8fabed9-0714-40f7-bf4c-e761d86a5cea tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:42.489184 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b8fabed9-0714-40f7-bf4c-e761d86a5cea tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:42.493364 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b8fabed9-0714-40f7-bf4c-e761d86a5cea tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7" status: 200 len: 1371 microversion: 2.47 time: 0.338546 Aug 07 01:36:42.504915 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2777/5100] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:42 2022] GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7 => generated 1371 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:42.510874 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-5cf50c52-31cd-455f-ade9-f72cb1d8edaf req-5318c210-78cb-4537-8d58-54c75446069f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c2503ba-46e2-4b06-9675-c4cb842783ca", "tag": "e89117b2-5b89-4cd2-bc23-8423fcc10e38"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:36:42.522845 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-5cf50c52-31cd-455f-ade9-f72cb1d8edaf req-5318c210-78cb-4537-8d58-54c75446069f service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:42.523612 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-5cf50c52-31cd-455f-ade9-f72cb1d8edaf req-5318c210-78cb-4537-8d58-54c75446069f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:42.524249 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-5cf50c52-31cd-455f-ade9-f72cb1d8edaf req-5318c210-78cb-4537-8d58-54c75446069f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:42.565461 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-5cf50c52-31cd-455f-ade9-f72cb1d8edaf req-5318c210-78cb-4537-8d58-54c75446069f service nova] Creating event network-changed:e89117b2-5b89-4cd2-bc23-8423fcc10e38 for instance 2c2503ba-46e2-4b06-9675-c4cb842783ca on n-h2-master-1 Aug 07 01:36:42.583674 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-5cf50c52-31cd-455f-ade9-f72cb1d8edaf req-5318c210-78cb-4537-8d58-54c75446069f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077110 Aug 07 01:36:42.584590 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2778/5101] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:36:42.589930 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d923bf47-e399-4ef1-8289-f8b32c5dc2e2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:42.590642 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d923bf47-e399-4ef1-8289-f8b32c5dc2e2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:42.607944 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d923bf47-e399-4ef1-8289-f8b32c5dc2e2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:42.608783 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d923bf47-e399-4ef1-8289-f8b32c5dc2e2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:42.609408 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d923bf47-e399-4ef1-8289-f8b32c5dc2e2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:42.610314 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d923bf47-e399-4ef1-8289-f8b32c5dc2e2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:42.611056 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d923bf47-e399-4ef1-8289-f8b32c5dc2e2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:42.611770 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d923bf47-e399-4ef1-8289-f8b32c5dc2e2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:42.814057 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6c815e48-a328-40c1-a94f-4c6521c5da2a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:42.829053 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6c815e48-a328-40c1-a94f-4c6521c5da2a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7" status: 200 len: 1521 microversion: 2.1 time: 0.976409 Aug 07 01:36:42.836859 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2324/5102] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:41 2022] GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 => generated 1521 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:43.120831 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d923bf47-e399-4ef1-8289-f8b32c5dc2e2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:43.145614 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d923bf47-e399-4ef1-8289-f8b32c5dc2e2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:43.150925 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d923bf47-e399-4ef1-8289-f8b32c5dc2e2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:43.164531 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d923bf47-e399-4ef1-8289-f8b32c5dc2e2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1407 microversion: 2.20 time: 0.578589 Aug 07 01:36:43.176246 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2779/5103] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:42 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1407 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:43.527295 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9ab358e8-90a2-497d-9480-07bc75f79f4e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:43.527935 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9ab358e8-90a2-497d-9480-07bc75f79f4e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:43.537037 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ab358e8-90a2-497d-9480-07bc75f79f4e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:43.537791 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ab358e8-90a2-497d-9480-07bc75f79f4e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:43.538561 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ab358e8-90a2-497d-9480-07bc75f79f4e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:43.539459 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ab358e8-90a2-497d-9480-07bc75f79f4e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:43.540187 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ab358e8-90a2-497d-9480-07bc75f79f4e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:43.540785 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ab358e8-90a2-497d-9480-07bc75f79f4e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:43.675627 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9ab358e8-90a2-497d-9480-07bc75f79f4e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:43.694067 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9ab358e8-90a2-497d-9480-07bc75f79f4e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:43.696088 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9ab358e8-90a2-497d-9480-07bc75f79f4e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:43.697764 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9ab358e8-90a2-497d-9480-07bc75f79f4e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7" status: 200 len: 1356 microversion: 2.47 time: 0.174992 Aug 07 01:36:43.714950 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2325/5104] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:43 2022] GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7 => generated 1356 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:43.726273 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4dc046f7-6bf3-44eb-a58f-5bd960e29cf9 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:43.731495 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4dc046f7-6bf3-44eb-a58f-5bd960e29cf9 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:43.732414 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4dc046f7-6bf3-44eb-a58f-5bd960e29cf9 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Searching by: {'deleted': False, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed'} {{(pid=119516) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 01:36:43.741428 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4dc046f7-6bf3-44eb-a58f-5bd960e29cf9 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:43.741932 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4dc046f7-6bf3-44eb-a58f-5bd960e29cf9 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:43.742468 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4dc046f7-6bf3-44eb-a58f-5bd960e29cf9 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:43.743728 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4dc046f7-6bf3-44eb-a58f-5bd960e29cf9 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:43.744237 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4dc046f7-6bf3-44eb-a58f-5bd960e29cf9 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:43.744836 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4dc046f7-6bf3-44eb-a58f-5bd960e29cf9 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:43.852861 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2118d861-e119-4cf9-8307-5066f739afb0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:43.853548 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2118d861-e119-4cf9-8307-5066f739afb0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:43.868216 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2118d861-e119-4cf9-8307-5066f739afb0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:43.871088 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2118d861-e119-4cf9-8307-5066f739afb0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:43.874770 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2118d861-e119-4cf9-8307-5066f739afb0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:43.876443 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2118d861-e119-4cf9-8307-5066f739afb0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:43.881746 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2118d861-e119-4cf9-8307-5066f739afb0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:43.882247 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2118d861-e119-4cf9-8307-5066f739afb0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:44.058295 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.multi_cell_list [None req-4dc046f7-6bf3-44eb-a58f-5bd960e29cf9 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 01:36:44.226148 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4dc046f7-6bf3-44eb-a58f-5bd960e29cf9 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:44.245113 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2118d861-e119-4cf9-8307-5066f739afb0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:44.250477 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4dc046f7-6bf3-44eb-a58f-5bd960e29cf9 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:44.251203 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4dc046f7-6bf3-44eb-a58f-5bd960e29cf9 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:44.252090 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4dc046f7-6bf3-44eb-a58f-5bd960e29cf9 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:44.274544 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4dc046f7-6bf3-44eb-a58f-5bd960e29cf9 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:44.276889 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4dc046f7-6bf3-44eb-a58f-5bd960e29cf9 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:44.279498 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2118d861-e119-4cf9-8307-5066f739afb0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7" status: 200 len: 1521 microversion: 2.1 time: 0.429174 Aug 07 01:36:44.281747 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2326/5105] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:43 2022] GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 => generated 1521 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:44.289374 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-68572b49-60f0-4cce-b5f5-900b71eacdf6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:44.290869 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-68572b49-60f0-4cce-b5f5-900b71eacdf6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:44.321166 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68572b49-60f0-4cce-b5f5-900b71eacdf6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:44.321857 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68572b49-60f0-4cce-b5f5-900b71eacdf6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:44.322555 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68572b49-60f0-4cce-b5f5-900b71eacdf6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:44.323512 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68572b49-60f0-4cce-b5f5-900b71eacdf6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:44.324187 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68572b49-60f0-4cce-b5f5-900b71eacdf6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:44.324790 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68572b49-60f0-4cce-b5f5-900b71eacdf6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:44.903096 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4dc046f7-6bf3-44eb-a58f-5bd960e29cf9 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 1.181253 Aug 07 01:36:44.904163 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2780/5106] 10.222.0.39 () {60 vars in 1187 bytes} [Sun Aug 7 01:36:43 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:44.944165 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d77cf475-fedb-4999-a3fb-a4b36279260e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:44.945034 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d77cf475-fedb-4999-a3fb-a4b36279260e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:44.954137 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:44.959370 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d77cf475-fedb-4999-a3fb-a4b36279260e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:44.961375 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d77cf475-fedb-4999-a3fb-a4b36279260e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:44.962052 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d77cf475-fedb-4999-a3fb-a4b36279260e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:44.966335 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d77cf475-fedb-4999-a3fb-a4b36279260e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:44.967121 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d77cf475-fedb-4999-a3fb-a4b36279260e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:44.968058 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d77cf475-fedb-4999-a3fb-a4b36279260e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:45.042351 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d77cf475-fedb-4999-a3fb-a4b36279260e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:36:45.170254 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d77cf475-fedb-4999-a3fb-a4b36279260e tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7" status: 204 len: 0 microversion: 2.47 time: 0.230356 Aug 07 01:36:45.171595 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2781/5107] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Aug 7 01:36:44 2022] DELETE /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 01:36:45.181043 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d6ed9dc4-7ac7-4d32-b75b-d751fcbb76c8 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:45.182014 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d6ed9dc4-7ac7-4d32-b75b-d751fcbb76c8 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:45.189587 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6ed9dc4-7ac7-4d32-b75b-d751fcbb76c8 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:45.191049 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6ed9dc4-7ac7-4d32-b75b-d751fcbb76c8 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:45.191049 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6ed9dc4-7ac7-4d32-b75b-d751fcbb76c8 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:45.192044 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6ed9dc4-7ac7-4d32-b75b-d751fcbb76c8 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:45.192653 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6ed9dc4-7ac7-4d32-b75b-d751fcbb76c8 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:45.193231 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6ed9dc4-7ac7-4d32-b75b-d751fcbb76c8 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:45.295438 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d6ed9dc4-7ac7-4d32-b75b-d751fcbb76c8 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:45.308150 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d6ed9dc4-7ac7-4d32-b75b-d751fcbb76c8 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:45.310562 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d6ed9dc4-7ac7-4d32-b75b-d751fcbb76c8 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:45.312242 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d6ed9dc4-7ac7-4d32-b75b-d751fcbb76c8 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7" status: 200 len: 1362 microversion: 2.47 time: 0.136060 Aug 07 01:36:45.313613 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2782/5108] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:45 2022] GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7 => generated 1362 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:36:45.321060 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bb0fdc27-718b-4e5b-8b70-1a48a1753887 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:45.322004 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bb0fdc27-718b-4e5b-8b70-1a48a1753887 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:45.330782 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb0fdc27-718b-4e5b-8b70-1a48a1753887 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:45.331970 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb0fdc27-718b-4e5b-8b70-1a48a1753887 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:45.332730 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb0fdc27-718b-4e5b-8b70-1a48a1753887 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:45.334588 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb0fdc27-718b-4e5b-8b70-1a48a1753887 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:45.335638 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb0fdc27-718b-4e5b-8b70-1a48a1753887 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:45.336347 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb0fdc27-718b-4e5b-8b70-1a48a1753887 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:45.460199 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-68572b49-60f0-4cce-b5f5-900b71eacdf6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:45.470529 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-68572b49-60f0-4cce-b5f5-900b71eacdf6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:45.474670 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-68572b49-60f0-4cce-b5f5-900b71eacdf6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:45.476154 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-68572b49-60f0-4cce-b5f5-900b71eacdf6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1407 microversion: 2.20 time: 1.193056 Aug 07 01:36:45.489015 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2327/5109] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:44 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1407 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:45.623361 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bb0fdc27-718b-4e5b-8b70-1a48a1753887 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:45.631651 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bb0fdc27-718b-4e5b-8b70-1a48a1753887 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7" status: 200 len: 1521 microversion: 2.1 time: 0.316266 Aug 07 01:36:45.636155 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2783/5110] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:45 2022] GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:46.338590 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f1a08ee4-f7df-4c90-83e7-5192028d47ba tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:46.339256 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f1a08ee4-f7df-4c90-83e7-5192028d47ba tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:46.354043 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1a08ee4-f7df-4c90-83e7-5192028d47ba tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:46.354511 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1a08ee4-f7df-4c90-83e7-5192028d47ba tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:46.354962 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1a08ee4-f7df-4c90-83e7-5192028d47ba tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:46.355688 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1a08ee4-f7df-4c90-83e7-5192028d47ba tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:46.356251 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1a08ee4-f7df-4c90-83e7-5192028d47ba tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:46.356598 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1a08ee4-f7df-4c90-83e7-5192028d47ba tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:46.501130 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-497cfea0-0810-4775-97b3-a52773502e75 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:46.504332 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-497cfea0-0810-4775-97b3-a52773502e75 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:46.526309 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-497cfea0-0810-4775-97b3-a52773502e75 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:46.526816 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-497cfea0-0810-4775-97b3-a52773502e75 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:46.532050 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-497cfea0-0810-4775-97b3-a52773502e75 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:46.532846 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-497cfea0-0810-4775-97b3-a52773502e75 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:46.533734 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-497cfea0-0810-4775-97b3-a52773502e75 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:46.534218 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-497cfea0-0810-4775-97b3-a52773502e75 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:46.546703 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f1a08ee4-f7df-4c90-83e7-5192028d47ba tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:46.557216 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f1a08ee4-f7df-4c90-83e7-5192028d47ba tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:46.558767 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f1a08ee4-f7df-4c90-83e7-5192028d47ba tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:46.559990 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f1a08ee4-f7df-4c90-83e7-5192028d47ba tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7" status: 200 len: 1362 microversion: 2.47 time: 0.225345 Aug 07 01:36:46.560563 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2328/5111] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:46 2022] GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7 => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:46.654819 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-563f5e01-39c7-4a14-be88-dd67d71fbb99 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:46.655449 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-563f5e01-39c7-4a14-be88-dd67d71fbb99 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:46.664979 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-563f5e01-39c7-4a14-be88-dd67d71fbb99 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:46.665762 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-563f5e01-39c7-4a14-be88-dd67d71fbb99 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:46.667251 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-563f5e01-39c7-4a14-be88-dd67d71fbb99 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:46.669231 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-563f5e01-39c7-4a14-be88-dd67d71fbb99 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:46.670004 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-563f5e01-39c7-4a14-be88-dd67d71fbb99 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:46.671721 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-563f5e01-39c7-4a14-be88-dd67d71fbb99 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:47.219943 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-497cfea0-0810-4775-97b3-a52773502e75 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:47.228802 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-563f5e01-39c7-4a14-be88-dd67d71fbb99 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:47.237091 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-497cfea0-0810-4775-97b3-a52773502e75 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:47.239564 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-497cfea0-0810-4775-97b3-a52773502e75 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:47.241529 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-497cfea0-0810-4775-97b3-a52773502e75 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1407 microversion: 2.20 time: 0.744366 Aug 07 01:36:47.243658 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-563f5e01-39c7-4a14-be88-dd67d71fbb99 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7" status: 200 len: 1521 microversion: 2.1 time: 0.588717 Aug 07 01:36:47.254824 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2784/5112] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:46 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1407 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:47.264882 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2329/5113] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:46 2022] GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 => generated 1521 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:47.584626 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a3be3782-d427-49bb-89dd-bc50f31b9e39 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:47.585608 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a3be3782-d427-49bb-89dd-bc50f31b9e39 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:47.600689 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3be3782-d427-49bb-89dd-bc50f31b9e39 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:47.602692 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3be3782-d427-49bb-89dd-bc50f31b9e39 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:47.605719 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3be3782-d427-49bb-89dd-bc50f31b9e39 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:47.606795 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3be3782-d427-49bb-89dd-bc50f31b9e39 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:47.607489 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3be3782-d427-49bb-89dd-bc50f31b9e39 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:47.608181 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3be3782-d427-49bb-89dd-bc50f31b9e39 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:47.664530 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3be3782-d427-49bb-89dd-bc50f31b9e39 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:47.665178 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3be3782-d427-49bb-89dd-bc50f31b9e39 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:47.665808 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a3be3782-d427-49bb-89dd-bc50f31b9e39 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:47.666537 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-a3be3782-d427-49bb-89dd-bc50f31b9e39 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lazy-loading 'fault' on Instance uuid b916c334-3e0e-40c6-ac77-0cb349c76ef7 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:36:47.740042 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a3be3782-d427-49bb-89dd-bc50f31b9e39 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:47.750721 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a3be3782-d427-49bb-89dd-bc50f31b9e39 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:47.753159 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a3be3782-d427-49bb-89dd-bc50f31b9e39 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:47.754968 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a3be3782-d427-49bb-89dd-bc50f31b9e39 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7" status: 200 len: 1367 microversion: 2.47 time: 0.175521 Aug 07 01:36:47.769696 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2785/5114] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:47 2022] GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:48.267743 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a86271d1-2fb8-4649-b6c3-20853b711e8d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:48.268300 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a86271d1-2fb8-4649-b6c3-20853b711e8d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:48.272352 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c71f12c7-8864-4ad8-b842-54f3a207b962 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:48.276736 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c71f12c7-8864-4ad8-b842-54f3a207b962 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:48.287922 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c71f12c7-8864-4ad8-b842-54f3a207b962 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:48.288396 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a86271d1-2fb8-4649-b6c3-20853b711e8d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:48.289266 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a86271d1-2fb8-4649-b6c3-20853b711e8d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:48.289955 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c71f12c7-8864-4ad8-b842-54f3a207b962 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:48.290591 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a86271d1-2fb8-4649-b6c3-20853b711e8d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:48.291220 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c71f12c7-8864-4ad8-b842-54f3a207b962 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:48.292222 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a86271d1-2fb8-4649-b6c3-20853b711e8d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:48.293171 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c71f12c7-8864-4ad8-b842-54f3a207b962 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:48.293807 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a86271d1-2fb8-4649-b6c3-20853b711e8d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:48.294569 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c71f12c7-8864-4ad8-b842-54f3a207b962 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:48.295302 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a86271d1-2fb8-4649-b6c3-20853b711e8d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:48.300585 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c71f12c7-8864-4ad8-b842-54f3a207b962 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:48.340803 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:48.522483 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c71f12c7-8864-4ad8-b842-54f3a207b962 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:48.530657 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c71f12c7-8864-4ad8-b842-54f3a207b962 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7" status: 200 len: 1521 microversion: 2.1 time: 0.269452 Aug 07 01:36:48.531243 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2330/5115] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:48 2022] GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:48.782753 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6768df92-efbb-4f25-8591-bb22fa29c9b3 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:48.783472 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6768df92-efbb-4f25-8591-bb22fa29c9b3 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: b916c334-3e0e-40c6-ac77-0cb349c76ef7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:48.790874 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6768df92-efbb-4f25-8591-bb22fa29c9b3 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:48.791470 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6768df92-efbb-4f25-8591-bb22fa29c9b3 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:48.792102 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6768df92-efbb-4f25-8591-bb22fa29c9b3 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:48.792959 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6768df92-efbb-4f25-8591-bb22fa29c9b3 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:48.793574 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6768df92-efbb-4f25-8591-bb22fa29c9b3 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:48.794083 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6768df92-efbb-4f25-8591-bb22fa29c9b3 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:48.812583 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-6768df92-efbb-4f25-8591-bb22fa29c9b3 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] HTTP exception thrown: Instance b916c334-3e0e-40c6-ac77-0cb349c76ef7 could not be found. Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6768df92-efbb-4f25-8591-bb22fa29c9b3 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Request method failure captured: Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7 HTTP/1.1 Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xb-Co7nJKL9T7i0Q5y1XfYITLoz7DVK8IQcWiQtvVURisrnXT2TQbz8bf_KkknoZyQVkCU6xfBrgPZofGH_sknjqtmtcjpZtptROMenW7pOB9zKKko9saS8qwjkMnjvCgjDqVoSKYE7gYt7M_0Bwm7XMbF-hrtJ6REjW9fAIKfeWXY Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: X-Openstack-Nova-Api-Version: 2.47 Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: f3e3bf9d373e43bea6c02b31d2e2e2ed Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServerShowV247Test-60607851 Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f3e3bf9d373e43bea6c02b31d2e2e2ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f3e3bf9d373e43bea6c02b31d2e2e2ed", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f3e3bf9d373e43bea6c02b31d2e2e2ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f3e3bf9d373e43bea6c02b31d2e2e2ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServerShowV247Test-60607851 Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: f3e3bf9d373e43bea6c02b31d2e2e2ed Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServerShowV247Test-60607851 Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServerShowV247Test-60607851-project Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 1e08144123ad4d3e93e6b6fbe2acf03a Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServerShowV247Test-60607851-project Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: exception: Instance b916c334-3e0e-40c6-ac77-0cb349c76ef7 could not be found. Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'b916c334-3e0e-40c6-ac77-0cb349c76ef7'} Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b916c334-3e0e-40c6-ac77-0cb349c76ef7 could not be found. Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b916c334-3e0e-40c6-ac77-0cb349c76ef7 could not be found. Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:36:48.814378 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:36:48.821652 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:36:48.821652 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:36:48.821652 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:36:48.821652 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:36:48.821652 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:36:48.821652 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b916c334-3e0e-40c6-ac77-0cb349c76ef7 could not be found. Aug 07 01:36:48.821652 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:36:48.821652 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6768df92-efbb-4f25-8591-bb22fa29c9b3 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Returning 404 to user: Instance b916c334-3e0e-40c6-ac77-0cb349c76ef7 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:36:48.821652 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6768df92-efbb-4f25-8591-bb22fa29c9b3 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7" status: 404 len: 111 microversion: 2.47 time: 0.038142 Aug 07 01:36:48.821652 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2331/5116] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:48 2022] GET /compute/v2.1/servers/b916c334-3e0e-40c6-ac77-0cb349c76ef7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 07 01:36:48.831976 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-137012e2-b680-4adc-acd8-29333fbee275 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:48.832597 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-137012e2-b680-4adc-acd8-29333fbee275 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: 6c6fe9cb-d330-478c-ac33-4e865087d6d1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:48.840149 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-137012e2-b680-4adc-acd8-29333fbee275 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:48.840729 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-137012e2-b680-4adc-acd8-29333fbee275 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:48.841242 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-137012e2-b680-4adc-acd8-29333fbee275 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:48.842065 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-137012e2-b680-4adc-acd8-29333fbee275 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:48.842578 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-137012e2-b680-4adc-acd8-29333fbee275 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:48.843120 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-137012e2-b680-4adc-acd8-29333fbee275 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:48.870052 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-137012e2-b680-4adc-acd8-29333fbee275 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: 6c6fe9cb-d330-478c-ac33-4e865087d6d1] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:36:48.890389 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a86271d1-2fb8-4649-b6c3-20853b711e8d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:48.924230 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a86271d1-2fb8-4649-b6c3-20853b711e8d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:48.926866 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a86271d1-2fb8-4649-b6c3-20853b711e8d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:48.929328 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a86271d1-2fb8-4649-b6c3-20853b711e8d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1407 microversion: 2.20 time: 0.665696 Aug 07 01:36:48.947366 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2786/5117] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:48 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1407 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:48.990658 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-137012e2-b680-4adc-acd8-29333fbee275 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6c6fe9cb-d330-478c-ac33-4e865087d6d1" status: 204 len: 0 microversion: 2.47 time: 0.164048 Aug 07 01:36:48.991950 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2332/5118] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Aug 7 01:36:48 2022] DELETE /compute/v2.1/servers/6c6fe9cb-d330-478c-ac33-4e865087d6d1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 01:36:49.000174 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3c97322a-72d3-499c-9d9d-fab86c76a3a4 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:49.000795 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3c97322a-72d3-499c-9d9d-fab86c76a3a4 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: 6c6fe9cb-d330-478c-ac33-4e865087d6d1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:49.007489 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c97322a-72d3-499c-9d9d-fab86c76a3a4 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:49.008000 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c97322a-72d3-499c-9d9d-fab86c76a3a4 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:49.009063 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c97322a-72d3-499c-9d9d-fab86c76a3a4 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:49.010004 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c97322a-72d3-499c-9d9d-fab86c76a3a4 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:49.014428 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c97322a-72d3-499c-9d9d-fab86c76a3a4 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:49.015398 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c97322a-72d3-499c-9d9d-fab86c76a3a4 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:49.118301 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3c97322a-72d3-499c-9d9d-fab86c76a3a4 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:49.143069 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3c97322a-72d3-499c-9d9d-fab86c76a3a4 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:49.145671 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3c97322a-72d3-499c-9d9d-fab86c76a3a4 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:49.148021 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3c97322a-72d3-499c-9d9d-fab86c76a3a4 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/6c6fe9cb-d330-478c-ac33-4e865087d6d1" status: 200 len: 1363 microversion: 2.47 time: 0.151279 Aug 07 01:36:49.148622 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2787/5119] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:48 2022] GET /compute/v2.1/servers/6c6fe9cb-d330-478c-ac33-4e865087d6d1 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:49.406933 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-7e06925e-27f4-4031-b99c-49db70fdbb97 req-18d67383-fd1d-4a1c-a95b-37eff7395f7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c2503ba-46e2-4b06-9675-c4cb842783ca", "name": "network-vif-plugged", "status": "completed", "tag": "e89117b2-5b89-4cd2-bc23-8423fcc10e38"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:36:49.421755 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-7e06925e-27f4-4031-b99c-49db70fdbb97 req-18d67383-fd1d-4a1c-a95b-37eff7395f7d service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:49.422537 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-7e06925e-27f4-4031-b99c-49db70fdbb97 req-18d67383-fd1d-4a1c-a95b-37eff7395f7d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:49.423715 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-7e06925e-27f4-4031-b99c-49db70fdbb97 req-18d67383-fd1d-4a1c-a95b-37eff7395f7d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:49.447475 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-7e06925e-27f4-4031-b99c-49db70fdbb97 req-18d67383-fd1d-4a1c-a95b-37eff7395f7d service nova] Creating event network-vif-plugged:e89117b2-5b89-4cd2-bc23-8423fcc10e38 for instance 2c2503ba-46e2-4b06-9675-c4cb842783ca on n-h2-master-1 Aug 07 01:36:49.457444 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-7e06925e-27f4-4031-b99c-49db70fdbb97 req-18d67383-fd1d-4a1c-a95b-37eff7395f7d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054402 Aug 07 01:36:49.459165 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2333/5120] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:36:49.563285 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-30249d71-d412-43d6-8380-ee87465925d6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:49.564422 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-30249d71-d412-43d6-8380-ee87465925d6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:49.573342 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-30249d71-d412-43d6-8380-ee87465925d6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:49.574247 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-30249d71-d412-43d6-8380-ee87465925d6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:49.574868 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-30249d71-d412-43d6-8380-ee87465925d6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:49.576107 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-30249d71-d412-43d6-8380-ee87465925d6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:49.576724 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-30249d71-d412-43d6-8380-ee87465925d6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:49.577252 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-30249d71-d412-43d6-8380-ee87465925d6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:49.955226 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-64c6eb19-d264-4971-b1a4-3b83f3930759 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:49.956351 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-64c6eb19-d264-4971-b1a4-3b83f3930759 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:49.965436 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64c6eb19-d264-4971-b1a4-3b83f3930759 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:49.966259 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64c6eb19-d264-4971-b1a4-3b83f3930759 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:49.967359 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64c6eb19-d264-4971-b1a4-3b83f3930759 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:49.968399 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64c6eb19-d264-4971-b1a4-3b83f3930759 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:49.969396 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64c6eb19-d264-4971-b1a4-3b83f3930759 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:49.970068 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64c6eb19-d264-4971-b1a4-3b83f3930759 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:50.056692 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-30249d71-d412-43d6-8380-ee87465925d6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:50.070530 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-30249d71-d412-43d6-8380-ee87465925d6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7" status: 200 len: 1521 microversion: 2.1 time: 0.520322 Aug 07 01:36:50.089061 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2788/5121] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:49 2022] GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 => generated 1521 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:50.172403 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-23bdf9d2-59c4-4b1b-ba18-1b6a39ae340b tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:50.180113 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-23bdf9d2-59c4-4b1b-ba18-1b6a39ae340b tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: 6c6fe9cb-d330-478c-ac33-4e865087d6d1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:50.189480 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-23bdf9d2-59c4-4b1b-ba18-1b6a39ae340b tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:50.191425 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-23bdf9d2-59c4-4b1b-ba18-1b6a39ae340b tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:50.191966 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-23bdf9d2-59c4-4b1b-ba18-1b6a39ae340b tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:50.193224 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-23bdf9d2-59c4-4b1b-ba18-1b6a39ae340b tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:50.194656 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-23bdf9d2-59c4-4b1b-ba18-1b6a39ae340b tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:50.195353 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-23bdf9d2-59c4-4b1b-ba18-1b6a39ae340b tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:50.318999 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-64c6eb19-d264-4971-b1a4-3b83f3930759 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:50.330182 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-64c6eb19-d264-4971-b1a4-3b83f3930759 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:50.333609 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-64c6eb19-d264-4971-b1a4-3b83f3930759 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:50.334795 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-64c6eb19-d264-4971-b1a4-3b83f3930759 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1407 microversion: 2.20 time: 0.384196 Aug 07 01:36:50.344716 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2334/5122] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:49 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1407 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:50.413396 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-23bdf9d2-59c4-4b1b-ba18-1b6a39ae340b tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:50.425569 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-23bdf9d2-59c4-4b1b-ba18-1b6a39ae340b tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:50.427307 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-23bdf9d2-59c4-4b1b-ba18-1b6a39ae340b tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:50.437831 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-23bdf9d2-59c4-4b1b-ba18-1b6a39ae340b tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/6c6fe9cb-d330-478c-ac33-4e865087d6d1" status: 200 len: 1363 microversion: 2.47 time: 0.270863 Aug 07 01:36:50.451023 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2789/5123] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:50 2022] GET /compute/v2.1/servers/6c6fe9cb-d330-478c-ac33-4e865087d6d1 => generated 1363 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:51.091701 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-87fb04ca-bbf6-426e-8449-2bf3c68e6f83 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:51.092457 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-87fb04ca-bbf6-426e-8449-2bf3c68e6f83 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:51.123552 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-87fb04ca-bbf6-426e-8449-2bf3c68e6f83 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:51.126075 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-87fb04ca-bbf6-426e-8449-2bf3c68e6f83 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:51.126946 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-87fb04ca-bbf6-426e-8449-2bf3c68e6f83 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:51.130515 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-87fb04ca-bbf6-426e-8449-2bf3c68e6f83 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:51.131120 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-87fb04ca-bbf6-426e-8449-2bf3c68e6f83 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:51.132047 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-87fb04ca-bbf6-426e-8449-2bf3c68e6f83 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:51.370899 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-19eb881d-a8c1-4cc4-af82-766fdd649602 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:51.372294 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-19eb881d-a8c1-4cc4-af82-766fdd649602 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:51.390006 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-19eb881d-a8c1-4cc4-af82-766fdd649602 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:51.391256 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-19eb881d-a8c1-4cc4-af82-766fdd649602 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:51.394928 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-19eb881d-a8c1-4cc4-af82-766fdd649602 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:51.397651 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-19eb881d-a8c1-4cc4-af82-766fdd649602 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:51.398333 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-19eb881d-a8c1-4cc4-af82-766fdd649602 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:51.401615 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-19eb881d-a8c1-4cc4-af82-766fdd649602 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:51.780037 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-19eb881d-a8c1-4cc4-af82-766fdd649602 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:51.799280 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-19eb881d-a8c1-4cc4-af82-766fdd649602 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:51.802822 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-19eb881d-a8c1-4cc4-af82-766fdd649602 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:51.804489 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-19eb881d-a8c1-4cc4-af82-766fdd649602 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1407 microversion: 2.20 time: 0.439037 Aug 07 01:36:51.806656 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2790/5124] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:51 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1407 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:51.824445 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5861e9cf-7bb2-4b2c-9305-077f8c71746c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:51.825245 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5861e9cf-7bb2-4b2c-9305-077f8c71746c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: 6c6fe9cb-d330-478c-ac33-4e865087d6d1] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:51.839682 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5861e9cf-7bb2-4b2c-9305-077f8c71746c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:51.849795 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5861e9cf-7bb2-4b2c-9305-077f8c71746c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:51.850861 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5861e9cf-7bb2-4b2c-9305-077f8c71746c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:51.853376 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5861e9cf-7bb2-4b2c-9305-077f8c71746c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:51.856314 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5861e9cf-7bb2-4b2c-9305-077f8c71746c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:51.856916 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5861e9cf-7bb2-4b2c-9305-077f8c71746c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:51.940726 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5861e9cf-7bb2-4b2c-9305-077f8c71746c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:51.944462 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5861e9cf-7bb2-4b2c-9305-077f8c71746c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:51.948448 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5861e9cf-7bb2-4b2c-9305-077f8c71746c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:51.948939 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-5861e9cf-7bb2-4b2c-9305-077f8c71746c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lazy-loading 'fault' on Instance uuid 6c6fe9cb-d330-478c-ac33-4e865087d6d1 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:36:52.037281 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-87fb04ca-bbf6-426e-8449-2bf3c68e6f83 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:52.057591 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-87fb04ca-bbf6-426e-8449-2bf3c68e6f83 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7" status: 200 len: 1521 microversion: 2.1 time: 0.964885 Aug 07 01:36:52.068305 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2335/5125] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:51 2022] GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 => generated 1521 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:52.132008 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5861e9cf-7bb2-4b2c-9305-077f8c71746c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:52.159139 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5861e9cf-7bb2-4b2c-9305-077f8c71746c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:52.163820 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5861e9cf-7bb2-4b2c-9305-077f8c71746c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e08144123ad4d3e93e6b6fbe2acf03a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:52.181747 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5861e9cf-7bb2-4b2c-9305-077f8c71746c tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/6c6fe9cb-d330-478c-ac33-4e865087d6d1" status: 200 len: 1368 microversion: 2.47 time: 0.372136 Aug 07 01:36:52.195955 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2791/5126] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:51 2022] GET /compute/v2.1/servers/6c6fe9cb-d330-478c-ac33-4e865087d6d1 => generated 1368 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:52.832810 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-46f76650-1d2e-47c5-b4fa-435d39bfc451 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:52.833500 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-46f76650-1d2e-47c5-b4fa-435d39bfc451 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:52.843690 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-46f76650-1d2e-47c5-b4fa-435d39bfc451 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:52.844429 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-46f76650-1d2e-47c5-b4fa-435d39bfc451 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:52.845255 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-46f76650-1d2e-47c5-b4fa-435d39bfc451 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:52.847214 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-46f76650-1d2e-47c5-b4fa-435d39bfc451 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:52.847824 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-46f76650-1d2e-47c5-b4fa-435d39bfc451 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:52.848447 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-46f76650-1d2e-47c5-b4fa-435d39bfc451 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:53.087133 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-69c8246e-011a-4310-a837-c0cf89ec7942 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:53.087979 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-69c8246e-011a-4310-a837-c0cf89ec7942 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:53.109529 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-69c8246e-011a-4310-a837-c0cf89ec7942 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:53.110041 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-69c8246e-011a-4310-a837-c0cf89ec7942 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:53.110490 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-69c8246e-011a-4310-a837-c0cf89ec7942 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:53.111216 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-69c8246e-011a-4310-a837-c0cf89ec7942 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:53.114995 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-69c8246e-011a-4310-a837-c0cf89ec7942 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:53.116167 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-69c8246e-011a-4310-a837-c0cf89ec7942 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:53.283508 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-46f76650-1d2e-47c5-b4fa-435d39bfc451 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:53.297064 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-46f76650-1d2e-47c5-b4fa-435d39bfc451 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:53.302428 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-46f76650-1d2e-47c5-b4fa-435d39bfc451 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:53.303692 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-46f76650-1d2e-47c5-b4fa-435d39bfc451 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1600 microversion: 2.20 time: 0.476663 Aug 07 01:36:53.316466 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2336/5127] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:52 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1600 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:36:53.327987 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3aae74af-71d4-4b4e-aed7-9d5d15632373 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:53.328973 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3aae74af-71d4-4b4e-aed7-9d5d15632373 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] [instance: 6c6fe9cb-d330-478c-ac33-4e865087d6d1] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:53.342873 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3aae74af-71d4-4b4e-aed7-9d5d15632373 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:53.344434 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3aae74af-71d4-4b4e-aed7-9d5d15632373 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:53.344939 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3aae74af-71d4-4b4e-aed7-9d5d15632373 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:53.346066 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3aae74af-71d4-4b4e-aed7-9d5d15632373 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:53.347118 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3aae74af-71d4-4b4e-aed7-9d5d15632373 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:53.347560 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3aae74af-71d4-4b4e-aed7-9d5d15632373 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:53.384622 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-3aae74af-71d4-4b4e-aed7-9d5d15632373 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] HTTP exception thrown: Instance 6c6fe9cb-d330-478c-ac33-4e865087d6d1 could not be found. Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3aae74af-71d4-4b4e-aed7-9d5d15632373 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Request method failure captured: Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/6c6fe9cb-d330-478c-ac33-4e865087d6d1 HTTP/1.1 Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xb-Co7nJKL9T7i0Q5y1XfYITLoz7DVK8IQcWiQtvVURisrnXT2TQbz8bf_KkknoZyQVkCU6xfBrgPZofGH_sknjqtmtcjpZtptROMenW7pOB9zKKko9saS8qwjkMnjvCgjDqVoSKYE7gYt7M_0Bwm7XMbF-hrtJ6REjW9fAIKfeWXY Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: X-Openstack-Nova-Api-Version: 2.47 Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: f3e3bf9d373e43bea6c02b31d2e2e2ed Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServerShowV247Test-60607851 Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f3e3bf9d373e43bea6c02b31d2e2e2ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f3e3bf9d373e43bea6c02b31d2e2e2ed", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f3e3bf9d373e43bea6c02b31d2e2e2ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f3e3bf9d373e43bea6c02b31d2e2e2ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServerShowV247Test-60607851 Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: f3e3bf9d373e43bea6c02b31d2e2e2ed Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServerShowV247Test-60607851 Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServerShowV247Test-60607851-project Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 1e08144123ad4d3e93e6b6fbe2acf03a Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServerShowV247Test-60607851-project Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 6c6fe9cb-d330-478c-ac33-4e865087d6d1 could not be found. Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '6c6fe9cb-d330-478c-ac33-4e865087d6d1'} Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c6fe9cb-d330-478c-ac33-4e865087d6d1 could not be found. Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c6fe9cb-d330-478c-ac33-4e865087d6d1 could not be found. Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:36:53.390636 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:36:53.397077 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:36:53.397077 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:36:53.397077 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:36:53.397077 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:36:53.397077 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:36:53.397077 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c6fe9cb-d330-478c-ac33-4e865087d6d1 could not be found. Aug 07 01:36:53.397077 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:36:53.397077 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3aae74af-71d4-4b4e-aed7-9d5d15632373 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] Returning 404 to user: Instance 6c6fe9cb-d330-478c-ac33-4e865087d6d1 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:36:53.397077 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3aae74af-71d4-4b4e-aed7-9d5d15632373 tempest-ServerShowV247Test-60607851 tempest-ServerShowV247Test-60607851-project] 10.222.0.39 "GET /compute/v2.1/servers/6c6fe9cb-d330-478c-ac33-4e865087d6d1" status: 404 len: 111 microversion: 2.47 time: 0.074822 Aug 07 01:36:53.397077 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2337/5128] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:36:53 2022] GET /compute/v2.1/servers/6c6fe9cb-d330-478c-ac33-4e865087d6d1 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:36:53.428440 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bbd32a62-e1c2-41b9-9699-707b791bc60d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:53.428954 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bbd32a62-e1c2-41b9-9699-707b791bc60d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:53.436012 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbd32a62-e1c2-41b9-9699-707b791bc60d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:53.436522 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbd32a62-e1c2-41b9-9699-707b791bc60d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:53.436963 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbd32a62-e1c2-41b9-9699-707b791bc60d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:53.437687 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbd32a62-e1c2-41b9-9699-707b791bc60d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:53.438840 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbd32a62-e1c2-41b9-9699-707b791bc60d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:53.439307 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbd32a62-e1c2-41b9-9699-707b791bc60d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:53.605212 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-69c8246e-011a-4310-a837-c0cf89ec7942 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:53.617835 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-69c8246e-011a-4310-a837-c0cf89ec7942 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7" status: 200 len: 1521 microversion: 2.1 time: 0.535022 Aug 07 01:36:53.624063 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2792/5129] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:53 2022] GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 => generated 1521 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:53.751643 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bbd32a62-e1c2-41b9-9699-707b791bc60d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.357056 Aug 07 01:36:53.752281 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2338/5130] 10.222.0.39 () {60 vars in 1316 bytes} [Sun Aug 7 01:36:53 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca/os-interface => generated 285 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:36:54.640348 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fd524d41-a6ba-442e-bd17-8cf19bf535f0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:54.641060 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fd524d41-a6ba-442e-bd17-8cf19bf535f0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:54.643085 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:54.650118 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:54.666706 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd524d41-a6ba-442e-bd17-8cf19bf535f0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:54.667210 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd524d41-a6ba-442e-bd17-8cf19bf535f0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:54.667651 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd524d41-a6ba-442e-bd17-8cf19bf535f0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:54.668406 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd524d41-a6ba-442e-bd17-8cf19bf535f0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:54.668865 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd524d41-a6ba-442e-bd17-8cf19bf535f0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:54.669302 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd524d41-a6ba-442e-bd17-8cf19bf535f0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:55.372546 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fd524d41-a6ba-442e-bd17-8cf19bf535f0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:55.388487 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fd524d41-a6ba-442e-bd17-8cf19bf535f0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7" status: 200 len: 1521 microversion: 2.1 time: 0.750587 Aug 07 01:36:55.390383 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2793/5131] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:54 2022] GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 => generated 1521 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:56.412930 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-aa78e399-88e7-45cd-a766-e11ca8971b31 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:56.414586 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-aa78e399-88e7-45cd-a766-e11ca8971b31 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:56.421884 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:56.448240 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa78e399-88e7-45cd-a766-e11ca8971b31 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:56.448822 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa78e399-88e7-45cd-a766-e11ca8971b31 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:56.457171 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa78e399-88e7-45cd-a766-e11ca8971b31 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:56.457171 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa78e399-88e7-45cd-a766-e11ca8971b31 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:56.457632 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa78e399-88e7-45cd-a766-e11ca8971b31 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:56.458080 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa78e399-88e7-45cd-a766-e11ca8971b31 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:57.021543 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-78653573-5e74-4b05-9349-9e1005a1cbc7 req-307bd0e3-5fbe-45b9-b1bc-d4c57e5e521a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c2503ba-46e2-4b06-9675-c4cb842783ca", "tag": "e89117b2-5b89-4cd2-bc23-8423fcc10e38"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:36:57.031349 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-aa78e399-88e7-45cd-a766-e11ca8971b31 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:57.040578 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-78653573-5e74-4b05-9349-9e1005a1cbc7 req-307bd0e3-5fbe-45b9-b1bc-d4c57e5e521a service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:57.041043 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-78653573-5e74-4b05-9349-9e1005a1cbc7 req-307bd0e3-5fbe-45b9-b1bc-d4c57e5e521a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:57.041473 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-78653573-5e74-4b05-9349-9e1005a1cbc7 req-307bd0e3-5fbe-45b9-b1bc-d4c57e5e521a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:57.046430 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-aa78e399-88e7-45cd-a766-e11ca8971b31 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7" status: 200 len: 1521 microversion: 2.1 time: 0.638803 Aug 07 01:36:57.050283 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2339/5132] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:56 2022] GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 => generated 1521 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:36:57.086942 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-78653573-5e74-4b05-9349-9e1005a1cbc7 req-307bd0e3-5fbe-45b9-b1bc-d4c57e5e521a service nova] Creating event network-changed:e89117b2-5b89-4cd2-bc23-8423fcc10e38 for instance 2c2503ba-46e2-4b06-9675-c4cb842783ca on n-h2-master-1 Aug 07 01:36:57.104727 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-78653573-5e74-4b05-9349-9e1005a1cbc7 req-307bd0e3-5fbe-45b9-b1bc-d4c57e5e521a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086764 Aug 07 01:36:57.118742 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2794/5133] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:36:58.072279 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4935a2a4-04aa-457b-ae85-bd3b9663184b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:58.072921 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4935a2a4-04aa-457b-ae85-bd3b9663184b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:58.090359 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4935a2a4-04aa-457b-ae85-bd3b9663184b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:58.090873 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4935a2a4-04aa-457b-ae85-bd3b9663184b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:58.091319 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4935a2a4-04aa-457b-ae85-bd3b9663184b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:58.101150 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4935a2a4-04aa-457b-ae85-bd3b9663184b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:58.101668 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4935a2a4-04aa-457b-ae85-bd3b9663184b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:58.106107 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4935a2a4-04aa-457b-ae85-bd3b9663184b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:58.501322 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4935a2a4-04aa-457b-ae85-bd3b9663184b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:36:58.512832 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4935a2a4-04aa-457b-ae85-bd3b9663184b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7" status: 200 len: 1521 microversion: 2.1 time: 0.445290 Aug 07 01:36:58.514120 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2340/5134] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:58 2022] GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 => generated 1521 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:36:59.540931 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-36d01c85-0e73-4648-b9fe-9bf7c152149c tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:36:59.542802 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-36d01c85-0e73-4648-b9fe-9bf7c152149c tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:36:59.552937 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-36d01c85-0e73-4648-b9fe-9bf7c152149c tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:59.553944 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-36d01c85-0e73-4648-b9fe-9bf7c152149c tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:59.554661 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-36d01c85-0e73-4648-b9fe-9bf7c152149c tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:36:59.555678 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-36d01c85-0e73-4648-b9fe-9bf7c152149c tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:36:59.556521 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-36d01c85-0e73-4648-b9fe-9bf7c152149c tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:36:59.557187 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-36d01c85-0e73-4648-b9fe-9bf7c152149c tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:00.424980 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-36d01c85-0e73-4648-b9fe-9bf7c152149c tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:00.456499 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-36d01c85-0e73-4648-b9fe-9bf7c152149c tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7" status: 200 len: 1521 microversion: 2.1 time: 0.923460 Aug 07 01:37:00.460726 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2795/5135] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:36:59 2022] GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 => generated 1521 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:01.489022 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d2f742cd-ba0e-42e2-a1a1-4e4e07c3e898 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:01.489852 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d2f742cd-ba0e-42e2-a1a1-4e4e07c3e898 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:01.504180 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2f742cd-ba0e-42e2-a1a1-4e4e07c3e898 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:01.504691 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2f742cd-ba0e-42e2-a1a1-4e4e07c3e898 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:01.505140 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2f742cd-ba0e-42e2-a1a1-4e4e07c3e898 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:01.505890 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2f742cd-ba0e-42e2-a1a1-4e4e07c3e898 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:01.511203 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2f742cd-ba0e-42e2-a1a1-4e4e07c3e898 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:01.513912 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2f742cd-ba0e-42e2-a1a1-4e4e07c3e898 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:01.556796 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:01.915192 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d2f742cd-ba0e-42e2-a1a1-4e4e07c3e898 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:01.928462 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d2f742cd-ba0e-42e2-a1a1-4e4e07c3e898 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7" status: 200 len: 1521 microversion: 2.1 time: 0.446767 Aug 07 01:37:01.931293 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2341/5136] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:01 2022] GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 => generated 1521 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:02.951536 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-df0862bf-3acc-4d74-89b0-4c8f54cd67c4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:02.952357 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-df0862bf-3acc-4d74-89b0-4c8f54cd67c4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:02.976181 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df0862bf-3acc-4d74-89b0-4c8f54cd67c4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:02.985971 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df0862bf-3acc-4d74-89b0-4c8f54cd67c4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:02.989155 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df0862bf-3acc-4d74-89b0-4c8f54cd67c4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:02.990157 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df0862bf-3acc-4d74-89b0-4c8f54cd67c4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:02.994701 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df0862bf-3acc-4d74-89b0-4c8f54cd67c4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:02.995454 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df0862bf-3acc-4d74-89b0-4c8f54cd67c4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:03.560985 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-df0862bf-3acc-4d74-89b0-4c8f54cd67c4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:03.570272 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-df0862bf-3acc-4d74-89b0-4c8f54cd67c4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7" status: 200 len: 1501 microversion: 2.1 time: 0.623361 Aug 07 01:37:03.576821 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2796/5137] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:02 2022] GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 => generated 1501 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:03.600979 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-43192669-bd8a-4b0b-ab33-371470537b94 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:03.602098 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-43192669-bd8a-4b0b-ab33-371470537b94 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:03.617546 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-43192669-bd8a-4b0b-ab33-371470537b94 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:03.618739 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-43192669-bd8a-4b0b-ab33-371470537b94 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:03.622459 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-43192669-bd8a-4b0b-ab33-371470537b94 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:03.623578 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-43192669-bd8a-4b0b-ab33-371470537b94 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:03.624313 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-43192669-bd8a-4b0b-ab33-371470537b94 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:03.624963 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-43192669-bd8a-4b0b-ab33-371470537b94 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:03.901780 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-43192669-bd8a-4b0b-ab33-371470537b94 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:03.918421 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-43192669-bd8a-4b0b-ab33-371470537b94 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d" status: 200 len: 1516 microversion: 2.1 time: 0.321812 Aug 07 01:37:03.919203 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2342/5138] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:03 2022] GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d => generated 1516 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:03.945545 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2a450373-b82c-4d34-801f-d2d15ca3be64 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:37:03.949283 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2a450373-b82c-4d34-801f-d2d15ca3be64 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: e4a452db-eb1f-45ee-8eb1-5c468c342520] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:03.970625 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-2a450373-b82c-4d34-801f-d2d15ca3be64 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] HTTP exception thrown: Instance e4a452db-eb1f-45ee-8eb1-5c468c342520 could not be found. Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2a450373-b82c-4d34-801f-d2d15ca3be64 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Request method failure captured: Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers/e4a452db-eb1f-45ee-8eb1-5c468c342520/action HTTP/1.1 Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 14 Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xcFUTwOrsKbLuCg4An479LA9G9aDuSE7GEjV8VWyLtq1rxOhZ9Q8jcwtkvN3VeO8ggfh8KvRRX8HWvqee02PsBBf0WFvhZisgorTKvdssuK7IJ1NUIDzU8DRVfm2J3najrfJ74eq56eKh78U1nPClJkssFs7yS7oVt53yn2dEShWXQ Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 70f17360f0c84562bd99b006b659736e Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1195249405 Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/70f17360f0c84562bd99b006b659736e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_70f17360f0c84562bd99b006b659736e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/70f17360f0c84562bd99b006b659736e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/70f17360f0c84562bd99b006b659736e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1195249405 Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 70f17360f0c84562bd99b006b659736e Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1195249405 Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServerRescueNegativeTestJSON-1195249405-project Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 2f5acf7da18b43f89e24760744cfdb49 Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1195249405-project Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: {"rescue": {}} Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: exception: Instance e4a452db-eb1f-45ee-8eb1-5c468c342520 could not be found. Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'e4a452db-eb1f-45ee-8eb1-5c468c342520', 'body': {'rescue': {}}} Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4a452db-eb1f-45ee-8eb1-5c468c342520 could not be found. Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4a452db-eb1f-45ee-8eb1-5c468c342520 could not be found. Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:37:03.982852 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:37:03.990418 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:37:03.990418 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:37:03.990418 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:37:03.990418 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:37:03.990418 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4a452db-eb1f-45ee-8eb1-5c468c342520 could not be found. Aug 07 01:37:03.990418 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:37:03.990418 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2a450373-b82c-4d34-801f-d2d15ca3be64 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Returning 404 to user: Instance e4a452db-eb1f-45ee-8eb1-5c468c342520 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:37:03.990418 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2a450373-b82c-4d34-801f-d2d15ca3be64 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "POST /compute/v2.1/servers/e4a452db-eb1f-45ee-8eb1-5c468c342520/action" status: 404 len: 111 microversion: 2.1 time: 0.045373 Aug 07 01:37:03.990418 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2797/5139] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:37:03 2022] POST /compute/v2.1/servers/e4a452db-eb1f-45ee-8eb1-5c468c342520/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:37:03.998199 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8100fb2c-d203-4f23-b4f5-2ed9495873e9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:37:03.998764 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8100fb2c-d203-4f23-b4f5-2ed9495873e9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:04.005409 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8100fb2c-d203-4f23-b4f5-2ed9495873e9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:04.006534 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8100fb2c-d203-4f23-b4f5-2ed9495873e9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:04.007316 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8100fb2c-d203-4f23-b4f5-2ed9495873e9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:04.008764 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8100fb2c-d203-4f23-b4f5-2ed9495873e9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:04.009414 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8100fb2c-d203-4f23-b4f5-2ed9495873e9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:04.010027 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8100fb2c-d203-4f23-b4f5-2ed9495873e9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:04.123824 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8100fb2c-d203-4f23-b4f5-2ed9495873e9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "POST /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d/action" status: 202 len: 0 microversion: 2.1 time: 0.131396 Aug 07 01:37:04.128147 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2343/5140] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:37:03 2022] POST /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:37:04.142364 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cc4db07f-d6ea-48b3-ac45-76961e187790 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:04.145001 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cc4db07f-d6ea-48b3-ac45-76961e187790 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:04.169166 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc4db07f-d6ea-48b3-ac45-76961e187790 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:04.171153 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc4db07f-d6ea-48b3-ac45-76961e187790 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:04.171916 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc4db07f-d6ea-48b3-ac45-76961e187790 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:04.174850 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc4db07f-d6ea-48b3-ac45-76961e187790 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:04.175363 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc4db07f-d6ea-48b3-ac45-76961e187790 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:04.175815 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc4db07f-d6ea-48b3-ac45-76961e187790 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:05.073422 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cc4db07f-d6ea-48b3-ac45-76961e187790 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:05.082677 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cc4db07f-d6ea-48b3-ac45-76961e187790 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d" status: 200 len: 1521 microversion: 2.1 time: 0.951153 Aug 07 01:37:05.083276 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2798/5141] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:04 2022] GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d => generated 1521 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:06.115422 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6312e811-9536-4106-941f-2f21eb2031ab tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:06.117157 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6312e811-9536-4106-941f-2f21eb2031ab tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:06.141428 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6312e811-9536-4106-941f-2f21eb2031ab tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:06.142248 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6312e811-9536-4106-941f-2f21eb2031ab tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:06.143222 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6312e811-9536-4106-941f-2f21eb2031ab tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:06.144020 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6312e811-9536-4106-941f-2f21eb2031ab tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:06.152503 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6312e811-9536-4106-941f-2f21eb2031ab tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:06.152503 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6312e811-9536-4106-941f-2f21eb2031ab tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:06.569372 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6312e811-9536-4106-941f-2f21eb2031ab tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:06.582646 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6312e811-9536-4106-941f-2f21eb2031ab tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d" status: 200 len: 1501 microversion: 2.1 time: 0.473843 Aug 07 01:37:06.583571 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2344/5142] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:06 2022] GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d => generated 1501 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:06.606449 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e3171555-2dfd-4071-b31d-93b498ac7462 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:37:06.609651 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e3171555-2dfd-4071-b31d-93b498ac7462 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:06.625511 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3171555-2dfd-4071-b31d-93b498ac7462 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:06.626283 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3171555-2dfd-4071-b31d-93b498ac7462 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:06.626934 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3171555-2dfd-4071-b31d-93b498ac7462 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:06.633726 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3171555-2dfd-4071-b31d-93b498ac7462 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:06.634461 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3171555-2dfd-4071-b31d-93b498ac7462 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:06.635064 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3171555-2dfd-4071-b31d-93b498ac7462 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:06.670841 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-e3171555-2dfd-4071-b31d-93b498ac7462 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lazy-loading 'flavor' on Instance uuid 67905784-e195-4938-9ea1-7e0fb23ffd4d {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:37:06.688318 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-e3171555-2dfd-4071-b31d-93b498ac7462 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] HTTP exception thrown: Cannot 'rescue' instance 67905784-e195-4938-9ea1-7e0fb23ffd4d while it is in vm_state paused Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e3171555-2dfd-4071-b31d-93b498ac7462 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Request method failure captured: Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d/action HTTP/1.1 Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 14 Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xcFUTwOrsKbLuCg4An479LA9G9aDuSE7GEjV8VWyLtq1rxOhZ9Q8jcwtkvN3VeO8ggfh8KvRRX8HWvqee02PsBBf0WFvhZisgorTKvdssuK7IJ1NUIDzU8DRVfm2J3najrfJ74eq56eKh78U1nPClJkssFs7yS7oVt53yn2dEShWXQ Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 70f17360f0c84562bd99b006b659736e Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1195249405 Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/70f17360f0c84562bd99b006b659736e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_70f17360f0c84562bd99b006b659736e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/70f17360f0c84562bd99b006b659736e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/70f17360f0c84562bd99b006b659736e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1195249405 Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 70f17360f0c84562bd99b006b659736e Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1195249405 Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServerRescueNegativeTestJSON-1195249405-project Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 2f5acf7da18b43f89e24760744cfdb49 Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1195249405-project Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: {"rescue": {}} Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: exception: Cannot 'rescue' instance 67905784-e195-4938-9ea1-7e0fb23ffd4d while it is in vm_state paused Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '67905784-e195-4938-9ea1-7e0fb23ffd4d', 'body': {'rescue': {}}} Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 67905784-e195-4938-9ea1-7e0fb23ffd4d in vm_state paused. Cannot rescue while the instance is in this state. Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 67905784-e195-4938-9ea1-7e0fb23ffd4d while it is in vm_state paused Aug 07 01:37:06.690157 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:37:06.695547 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:37:06.695547 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:37:06.695547 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:37:06.695547 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:37:06.695547 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:37:06.695547 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:37:06.695547 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:37:06.695547 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 67905784-e195-4938-9ea1-7e0fb23ffd4d while it is in vm_state paused Aug 07 01:37:06.695547 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:37:06.697449 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e3171555-2dfd-4071-b31d-93b498ac7462 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Returning 409 to user: Cannot 'rescue' instance 67905784-e195-4938-9ea1-7e0fb23ffd4d while it is in vm_state paused {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:37:06.698480 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e3171555-2dfd-4071-b31d-93b498ac7462 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "POST /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d/action" status: 409 len: 144 microversion: 2.1 time: 0.096231 Aug 07 01:37:06.702908 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2799/5143] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:37:06 2022] POST /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d/action => generated 144 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:37:06.707763 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-97d5c607-ad07-436a-95bc-a43141150afd tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:37:06.708493 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-97d5c607-ad07-436a-95bc-a43141150afd tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:06.724056 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-97d5c607-ad07-436a-95bc-a43141150afd tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:06.724557 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-97d5c607-ad07-436a-95bc-a43141150afd tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:06.725005 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-97d5c607-ad07-436a-95bc-a43141150afd tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:06.725977 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-97d5c607-ad07-436a-95bc-a43141150afd tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:06.726641 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-97d5c607-ad07-436a-95bc-a43141150afd tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:06.727282 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-97d5c607-ad07-436a-95bc-a43141150afd tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:06.865187 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-97d5c607-ad07-436a-95bc-a43141150afd tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "POST /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d/action" status: 202 len: 0 microversion: 2.1 time: 0.161140 Aug 07 01:37:06.869157 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2345/5144] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:37:06 2022] POST /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 01:37:06.880888 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7ee4d27b-f9a7-4055-950f-d1884a014b1d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:06.881510 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7ee4d27b-f9a7-4055-950f-d1884a014b1d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:06.896410 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ee4d27b-f9a7-4055-950f-d1884a014b1d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:06.900929 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ee4d27b-f9a7-4055-950f-d1884a014b1d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:06.901435 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ee4d27b-f9a7-4055-950f-d1884a014b1d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:06.902196 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ee4d27b-f9a7-4055-950f-d1884a014b1d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:06.902741 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ee4d27b-f9a7-4055-950f-d1884a014b1d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:06.903185 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ee4d27b-f9a7-4055-950f-d1884a014b1d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:07.386320 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7ee4d27b-f9a7-4055-950f-d1884a014b1d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:07.398943 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7ee4d27b-f9a7-4055-950f-d1884a014b1d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d" status: 200 len: 1508 microversion: 2.1 time: 0.524998 Aug 07 01:37:07.401959 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2800/5145] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:06 2022] GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d => generated 1508 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:08.427745 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d3fb74d7-7824-4ec0-ad83-de42fa952caf tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:08.429389 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d3fb74d7-7824-4ec0-ad83-de42fa952caf tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:08.442082 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d3fb74d7-7824-4ec0-ad83-de42fa952caf tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:08.446513 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d3fb74d7-7824-4ec0-ad83-de42fa952caf tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:08.447424 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d3fb74d7-7824-4ec0-ad83-de42fa952caf tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:08.448517 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d3fb74d7-7824-4ec0-ad83-de42fa952caf tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:08.451009 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d3fb74d7-7824-4ec0-ad83-de42fa952caf tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:08.451753 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d3fb74d7-7824-4ec0-ad83-de42fa952caf tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:09.102179 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d3fb74d7-7824-4ec0-ad83-de42fa952caf tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:09.115332 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d3fb74d7-7824-4ec0-ad83-de42fa952caf tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d" status: 200 len: 1516 microversion: 2.1 time: 0.692135 Aug 07 01:37:09.116335 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2346/5146] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:08 2022] GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d => generated 1516 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:11.691461 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6ba1bd2b-c8af-45da-b8e5-013497f4f03c tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Action: 'create', calling method: .version_select at 0x7f9e178ad820>, body: {"keypair": {"name": "tempest-keypair-1165152169", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcxxIv9aXmCJtASj4SHWE76T1TIytlcpngHkxZ0MgJ3l7re4CRhlUIHzL5cX8KJ389uT4dRBgCS0EjRVZ3N04girWTG8XhJlYY0OiWFta+YgJQgaDscPZialHkWYQSYQw=="}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:37:11.746274 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-6ba1bd2b-c8af-45da-b8e5-013497f4f03c tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Getting quotas for project fd244ec665474b3896678f34d6491574. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:37:11.758320 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-6ba1bd2b-c8af-45da-b8e5-013497f4f03c tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Getting quotas for user 2d8e76eb694846cabc55fc8e825c8e43 and project fd244ec665474b3896678f34d6491574. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:37:11.797302 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6ba1bd2b-c8af-45da-b8e5-013497f4f03c tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.477280 Aug 07 01:37:11.801419 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2801/5147] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:37:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:37:12.002524 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-78e0211e-97d4-4c1c-a6af-22903701f538 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:37:12.006010 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-78e0211e-97d4-4c1c-a6af-22903701f538 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:12.024840 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78e0211e-97d4-4c1c-a6af-22903701f538 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:12.026544 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78e0211e-97d4-4c1c-a6af-22903701f538 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:12.028850 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78e0211e-97d4-4c1c-a6af-22903701f538 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:12.031208 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78e0211e-97d4-4c1c-a6af-22903701f538 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:12.031839 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78e0211e-97d4-4c1c-a6af-22903701f538 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:12.032428 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78e0211e-97d4-4c1c-a6af-22903701f538 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:12.097461 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-78e0211e-97d4-4c1c-a6af-22903701f538 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lazy-loading 'flavor' on Instance uuid 67905784-e195-4938-9ea1-7e0fb23ffd4d {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:37:12.244544 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-78e0211e-97d4-4c1c-a6af-22903701f538 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "POST /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d/action" status: 200 len: 32 microversion: 2.1 time: 0.246142 Aug 07 01:37:12.246376 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2347/5148] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:37:11 2022] POST /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d/action => generated 32 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:37:12.258858 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6e858710-aa13-45cc-a325-763d9f90c73d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:12.261238 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6e858710-aa13-45cc-a325-763d9f90c73d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:12.279815 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e858710-aa13-45cc-a325-763d9f90c73d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:12.281931 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e858710-aa13-45cc-a325-763d9f90c73d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:12.282879 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e858710-aa13-45cc-a325-763d9f90c73d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:12.285255 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e858710-aa13-45cc-a325-763d9f90c73d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:12.286930 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e858710-aa13-45cc-a325-763d9f90c73d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:12.288767 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e858710-aa13-45cc-a325-763d9f90c73d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:12.689064 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a32c5f94-6a91-400b-be95-81931b2f3354 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:12.689926 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a32c5f94-6a91-400b-be95-81931b2f3354 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 0658227f-88e6-40fd-bb8f-aa6267addc84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:12.702004 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a32c5f94-6a91-400b-be95-81931b2f3354 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:12.703055 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a32c5f94-6a91-400b-be95-81931b2f3354 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:12.706169 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a32c5f94-6a91-400b-be95-81931b2f3354 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:12.708442 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a32c5f94-6a91-400b-be95-81931b2f3354 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:12.710739 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a32c5f94-6a91-400b-be95-81931b2f3354 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:12.713607 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a32c5f94-6a91-400b-be95-81931b2f3354 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:12.769217 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a32c5f94-6a91-400b-be95-81931b2f3354 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84/ips" status: 200 len: 149 microversion: 2.1 time: 0.084362 Aug 07 01:37:12.775245 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2348/5149] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Aug 7 01:37:12 2022] GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84/ips => generated 149 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:37:13.044357 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6e858710-aa13-45cc-a325-763d9f90c73d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:13.060934 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6e858710-aa13-45cc-a325-763d9f90c73d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d" status: 200 len: 1522 microversion: 2.1 time: 0.805357 Aug 07 01:37:13.062079 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2802/5150] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:12 2022] GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d => generated 1522 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:14.085897 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4f13a0c7-5c9c-40dd-9602-619fdc10d91d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:14.087317 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4f13a0c7-5c9c-40dd-9602-619fdc10d91d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:14.108789 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f13a0c7-5c9c-40dd-9602-619fdc10d91d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:14.109515 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f13a0c7-5c9c-40dd-9602-619fdc10d91d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:14.110143 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f13a0c7-5c9c-40dd-9602-619fdc10d91d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:14.111657 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f13a0c7-5c9c-40dd-9602-619fdc10d91d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:14.112346 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f13a0c7-5c9c-40dd-9602-619fdc10d91d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:14.116502 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f13a0c7-5c9c-40dd-9602-619fdc10d91d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:14.696671 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4f13a0c7-5c9c-40dd-9602-619fdc10d91d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:14.706092 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4f13a0c7-5c9c-40dd-9602-619fdc10d91d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d" status: 200 len: 1522 microversion: 2.1 time: 0.624379 Aug 07 01:37:14.711032 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2349/5151] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:14 2022] GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d => generated 1522 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:15.603901 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dc9bfda9-2b25-48a1-a9ef-9eb6d45d8c89 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c441234-906a-455e-a87d-7ec446f611ec"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:37:15.606593 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-dc9bfda9-2b25-48a1-a9ef-9eb6d45d8c89 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 0658227f-88e6-40fd-bb8f-aa6267addc84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:15.625795 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:15.629333 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc9bfda9-2b25-48a1-a9ef-9eb6d45d8c89 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:15.629829 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc9bfda9-2b25-48a1-a9ef-9eb6d45d8c89 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:15.630273 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc9bfda9-2b25-48a1-a9ef-9eb6d45d8c89 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:15.631211 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc9bfda9-2b25-48a1-a9ef-9eb6d45d8c89 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:15.638297 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc9bfda9-2b25-48a1-a9ef-9eb6d45d8c89 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:15.639300 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc9bfda9-2b25-48a1-a9ef-9eb6d45d8c89 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:15.734712 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1c4dfe10-1abd-4b8b-a1a3-20971d2b711e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:15.735363 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1c4dfe10-1abd-4b8b-a1a3-20971d2b711e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:15.753265 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c4dfe10-1abd-4b8b-a1a3-20971d2b711e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:15.755089 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c4dfe10-1abd-4b8b-a1a3-20971d2b711e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:15.755587 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c4dfe10-1abd-4b8b-a1a3-20971d2b711e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:15.756384 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c4dfe10-1abd-4b8b-a1a3-20971d2b711e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:15.756860 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c4dfe10-1abd-4b8b-a1a3-20971d2b711e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:15.768488 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c4dfe10-1abd-4b8b-a1a3-20971d2b711e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:16.265757 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-dc9bfda9-2b25-48a1-a9ef-9eb6d45d8c89 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "POST /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.664025 Aug 07 01:37:16.275078 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2803/5152] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Aug 7 01:37:15 2022] POST /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84/os-volume_attachments => generated 194 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:37:16.371805 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1c4dfe10-1abd-4b8b-a1a3-20971d2b711e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:16.384605 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1c4dfe10-1abd-4b8b-a1a3-20971d2b711e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d" status: 200 len: 1522 microversion: 2.1 time: 0.655884 Aug 07 01:37:16.399912 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2350/5153] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:15 2022] GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d => generated 1522 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:17.416615 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-10ce0991-5e9c-47ee-86f3-0a867d1d93d9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:17.417642 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-10ce0991-5e9c-47ee-86f3-0a867d1d93d9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:17.436551 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10ce0991-5e9c-47ee-86f3-0a867d1d93d9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:17.442166 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10ce0991-5e9c-47ee-86f3-0a867d1d93d9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:17.444345 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10ce0991-5e9c-47ee-86f3-0a867d1d93d9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:17.447919 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10ce0991-5e9c-47ee-86f3-0a867d1d93d9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:17.449673 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10ce0991-5e9c-47ee-86f3-0a867d1d93d9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:17.451779 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10ce0991-5e9c-47ee-86f3-0a867d1d93d9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:17.553335 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:17.767692 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8ee8ecda-3481-4269-9f7e-8fbf9caf034d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-725430455", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5a8fd548-5445-4e87-8951-075bc1da39df"}], "security_groups": [{"name": "tempest-securitygroup--1805078717"}], "key_name": "tempest-keypair-1165152169", "user_data": "}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:37:18.108403 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-8ee8ecda-3481-4269-9f7e-8fbf9caf034d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] validate_networks() for [('5a8fd548-5445-4e87-8951-075bc1da39df', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:37:18.421025 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-10ce0991-5e9c-47ee-86f3-0a867d1d93d9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:18.433610 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-10ce0991-5e9c-47ee-86f3-0a867d1d93d9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d" status: 200 len: 1522 microversion: 2.1 time: 1.022897 Aug 07 01:37:18.435342 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2804/5154] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:17 2022] GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d => generated 1522 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:19.380632 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-8ee8ecda-3481-4269-9f7e-8fbf9caf034d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:37:19.381167 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-8ee8ecda-3481-4269-9f7e-8fbf9caf034d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:37:19.381851 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-8ee8ecda-3481-4269-9f7e-8fbf9caf034d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:37:19.382553 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-8ee8ecda-3481-4269-9f7e-8fbf9caf034d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:37:19.383357 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-8ee8ecda-3481-4269-9f7e-8fbf9caf034d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:37:19.399474 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8ee8ecda-3481-4269-9f7e-8fbf9caf034d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:19.409607 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8ee8ecda-3481-4269-9f7e-8fbf9caf034d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:19.414172 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8ee8ecda-3481-4269-9f7e-8fbf9caf034d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:19.415391 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8ee8ecda-3481-4269-9f7e-8fbf9caf034d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:19.420227 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8ee8ecda-3481-4269-9f7e-8fbf9caf034d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:19.424277 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8ee8ecda-3481-4269-9f7e-8fbf9caf034d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:19.457426 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a651b3d2-a7eb-4d69-8951-49384ea08549 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:19.458777 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a651b3d2-a7eb-4d69-8951-49384ea08549 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:19.480787 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a651b3d2-a7eb-4d69-8951-49384ea08549 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:19.482905 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a651b3d2-a7eb-4d69-8951-49384ea08549 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:19.483541 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a651b3d2-a7eb-4d69-8951-49384ea08549 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:19.496864 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a651b3d2-a7eb-4d69-8951-49384ea08549 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:19.498879 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a651b3d2-a7eb-4d69-8951-49384ea08549 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:19.500620 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a651b3d2-a7eb-4d69-8951-49384ea08549 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:19.511274 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-8ee8ecda-3481-4269-9f7e-8fbf9caf034d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Getting quotas for project fd244ec665474b3896678f34d6491574. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:37:19.518640 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-8ee8ecda-3481-4269-9f7e-8fbf9caf034d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Getting quotas for user 2d8e76eb694846cabc55fc8e825c8e43 and project fd244ec665474b3896678f34d6491574. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:37:19.538208 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8ee8ecda-3481-4269-9f7e-8fbf9caf034d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:37:19.540859 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8ee8ecda-3481-4269-9f7e-8fbf9caf034d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:37:19.604505 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8ee8ecda-3481-4269-9f7e-8fbf9caf034d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.845789 Aug 07 01:37:19.605533 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2351/5155] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:37:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 1848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:37:19.619229 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-11e0855b-cb61-4825-9991-23ed15629cf1 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:19.621059 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-11e0855b-cb61-4825-9991-23ed15629cf1 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:19.753710 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a651b3d2-a7eb-4d69-8951-49384ea08549 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:19.766234 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a651b3d2-a7eb-4d69-8951-49384ea08549 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d" status: 200 len: 1522 microversion: 2.1 time: 0.313585 Aug 07 01:37:19.768061 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2805/5156] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:19 2022] GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:37:19.834974 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-11e0855b-cb61-4825-9991-23ed15629cf1 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:19.844172 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-11e0855b-cb61-4825-9991-23ed15629cf1 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1237 microversion: 2.1 time: 0.231341 Aug 07 01:37:19.848504 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2352/5157] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:19 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1237 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:20.791968 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e905f7a8-7f9d-483c-a40a-95cdd8607a5b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:20.792620 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e905f7a8-7f9d-483c-a40a-95cdd8607a5b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:20.817703 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e905f7a8-7f9d-483c-a40a-95cdd8607a5b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:20.819439 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e905f7a8-7f9d-483c-a40a-95cdd8607a5b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:20.821011 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e905f7a8-7f9d-483c-a40a-95cdd8607a5b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:20.823438 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e905f7a8-7f9d-483c-a40a-95cdd8607a5b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:20.824925 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e905f7a8-7f9d-483c-a40a-95cdd8607a5b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:20.825616 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e905f7a8-7f9d-483c-a40a-95cdd8607a5b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:20.868387 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ab3e5b56-7e52-4b9c-a4fb-a70446512414 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:20.869679 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ab3e5b56-7e52-4b9c-a4fb-a70446512414 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:20.893154 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab3e5b56-7e52-4b9c-a4fb-a70446512414 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:20.896572 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab3e5b56-7e52-4b9c-a4fb-a70446512414 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:20.902749 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab3e5b56-7e52-4b9c-a4fb-a70446512414 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:20.903834 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab3e5b56-7e52-4b9c-a4fb-a70446512414 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:20.906677 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab3e5b56-7e52-4b9c-a4fb-a70446512414 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:20.907944 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab3e5b56-7e52-4b9c-a4fb-a70446512414 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:21.125889 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e905f7a8-7f9d-483c-a40a-95cdd8607a5b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:21.136837 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e905f7a8-7f9d-483c-a40a-95cdd8607a5b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d" status: 200 len: 1522 microversion: 2.1 time: 0.352924 Aug 07 01:37:21.137788 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2806/5158] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:20 2022] GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d => generated 1522 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:21.344343 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ab3e5b56-7e52-4b9c-a4fb-a70446512414 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:21.385406 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ab3e5b56-7e52-4b9c-a4fb-a70446512414 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1289 microversion: 2.1 time: 0.506429 Aug 07 01:37:21.387695 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2353/5159] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:20 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1289 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:22.159721 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c87f0409-1036-41eb-a60f-0aa83742be01 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:22.161259 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c87f0409-1036-41eb-a60f-0aa83742be01 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:22.169981 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=4 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:22.179032 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c87f0409-1036-41eb-a60f-0aa83742be01 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:22.180136 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c87f0409-1036-41eb-a60f-0aa83742be01 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:22.184080 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c87f0409-1036-41eb-a60f-0aa83742be01 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:22.189961 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c87f0409-1036-41eb-a60f-0aa83742be01 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:22.191683 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c87f0409-1036-41eb-a60f-0aa83742be01 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:22.192401 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c87f0409-1036-41eb-a60f-0aa83742be01 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:22.413379 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-265f3dc2-8fb1-49ed-8035-9a2a6eba745f tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:22.414175 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-265f3dc2-8fb1-49ed-8035-9a2a6eba745f tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:22.437786 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-265f3dc2-8fb1-49ed-8035-9a2a6eba745f tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:22.440667 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-265f3dc2-8fb1-49ed-8035-9a2a6eba745f tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:22.441521 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-265f3dc2-8fb1-49ed-8035-9a2a6eba745f tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:22.442736 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-265f3dc2-8fb1-49ed-8035-9a2a6eba745f tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:22.444160 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-265f3dc2-8fb1-49ed-8035-9a2a6eba745f tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:22.447040 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-265f3dc2-8fb1-49ed-8035-9a2a6eba745f tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:22.967719 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c87f0409-1036-41eb-a60f-0aa83742be01 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:22.978963 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c87f0409-1036-41eb-a60f-0aa83742be01 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d" status: 200 len: 1522 microversion: 2.1 time: 0.824021 Aug 07 01:37:22.998883 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2807/5160] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:22 2022] GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d => generated 1522 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:23.203475 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-265f3dc2-8fb1-49ed-8035-9a2a6eba745f tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:23.212362 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-265f3dc2-8fb1-49ed-8035-9a2a6eba745f tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1295 microversion: 2.1 time: 0.802021 Aug 07 01:37:23.229882 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2354/5161] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:22 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1295 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:24.003462 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-581db603-9b86-412f-b8e3-50d23d042109 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:24.005280 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-581db603-9b86-412f-b8e3-50d23d042109 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:24.018485 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-581db603-9b86-412f-b8e3-50d23d042109 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:24.018985 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-581db603-9b86-412f-b8e3-50d23d042109 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:24.020636 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-581db603-9b86-412f-b8e3-50d23d042109 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:24.023760 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-581db603-9b86-412f-b8e3-50d23d042109 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:24.024316 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-581db603-9b86-412f-b8e3-50d23d042109 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:24.024768 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-581db603-9b86-412f-b8e3-50d23d042109 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:24.239167 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ba400b25-335b-407a-9c39-4f3a38997116 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:24.240021 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ba400b25-335b-407a-9c39-4f3a38997116 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:24.249574 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ba400b25-335b-407a-9c39-4f3a38997116 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:24.250482 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ba400b25-335b-407a-9c39-4f3a38997116 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:24.251227 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ba400b25-335b-407a-9c39-4f3a38997116 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:24.252268 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ba400b25-335b-407a-9c39-4f3a38997116 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:24.253002 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ba400b25-335b-407a-9c39-4f3a38997116 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:24.253744 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ba400b25-335b-407a-9c39-4f3a38997116 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:24.463124 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-581db603-9b86-412f-b8e3-50d23d042109 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:24.477386 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-581db603-9b86-412f-b8e3-50d23d042109 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d" status: 200 len: 1522 microversion: 2.1 time: 0.478090 Aug 07 01:37:24.478940 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2808/5162] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:23 2022] GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d => generated 1522 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:24.816938 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ba400b25-335b-407a-9c39-4f3a38997116 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:24.830972 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ba400b25-335b-407a-9c39-4f3a38997116 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1363 microversion: 2.1 time: 0.597534 Aug 07 01:37:24.835342 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2355/5163] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:24 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1363 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:37:24.967168 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-778c8fba-f3a4-4b8c-8f0b-7588290165aa tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:24.967897 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-778c8fba-f3a4-4b8c-8f0b-7588290165aa tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:24.984408 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-778c8fba-f3a4-4b8c-8f0b-7588290165aa tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:24.987020 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-778c8fba-f3a4-4b8c-8f0b-7588290165aa tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:24.989037 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-778c8fba-f3a4-4b8c-8f0b-7588290165aa tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:24.991473 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-778c8fba-f3a4-4b8c-8f0b-7588290165aa tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:24.992924 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-778c8fba-f3a4-4b8c-8f0b-7588290165aa tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:24.994193 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-778c8fba-f3a4-4b8c-8f0b-7588290165aa tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:25.078309 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-778c8fba-f3a4-4b8c-8f0b-7588290165aa tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca/ips" status: 200 len: 153 microversion: 2.20 time: 0.576978 Aug 07 01:37:25.087162 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2809/5164] 10.222.0.39 () {60 vars in 1289 bytes} [Sun Aug 7 01:37:24 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca/ips => generated 153 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:37:25.505422 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8949d3df-fdf7-4c09-9d8e-55e3f938ea76 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:25.506228 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8949d3df-fdf7-4c09-9d8e-55e3f938ea76 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:25.524301 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8949d3df-fdf7-4c09-9d8e-55e3f938ea76 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:25.525358 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8949d3df-fdf7-4c09-9d8e-55e3f938ea76 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:25.526164 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8949d3df-fdf7-4c09-9d8e-55e3f938ea76 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:25.527087 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8949d3df-fdf7-4c09-9d8e-55e3f938ea76 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:25.527728 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8949d3df-fdf7-4c09-9d8e-55e3f938ea76 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:25.528361 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8949d3df-fdf7-4c09-9d8e-55e3f938ea76 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:25.542348 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:25.811380 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-ad288070-c21f-4ca7-819a-8949055fa4c9 req-29830193-8150-4767-8f8a-17833e6d88b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d2f04ca-7c24-4d1a-a723-7cf3a8782976", "tag": "df05b03a-bb99-46f1-ae77-4d31e797b6a3"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:37:25.839582 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-ad288070-c21f-4ca7-819a-8949055fa4c9 req-29830193-8150-4767-8f8a-17833e6d88b9 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:25.840727 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-ad288070-c21f-4ca7-819a-8949055fa4c9 req-29830193-8150-4767-8f8a-17833e6d88b9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:25.846302 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-ad288070-c21f-4ca7-819a-8949055fa4c9 req-29830193-8150-4767-8f8a-17833e6d88b9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:25.884835 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-ad288070-c21f-4ca7-819a-8949055fa4c9 req-29830193-8150-4767-8f8a-17833e6d88b9 service nova] Creating event network-changed:df05b03a-bb99-46f1-ae77-4d31e797b6a3 for instance 0d2f04ca-7c24-4d1a-a723-7cf3a8782976 on n-h2-master-1 Aug 07 01:37:25.909792 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-ad288070-c21f-4ca7-819a-8949055fa4c9 req-29830193-8150-4767-8f8a-17833e6d88b9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102879 Aug 07 01:37:25.915059 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2810/5165] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:37:25.929629 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a6cc43f2-1b9a-4f6b-894b-dcacbefcd133 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:25.930655 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a6cc43f2-1b9a-4f6b-894b-dcacbefcd133 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:25.940085 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a6cc43f2-1b9a-4f6b-894b-dcacbefcd133 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:25.940980 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a6cc43f2-1b9a-4f6b-894b-dcacbefcd133 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:25.941660 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a6cc43f2-1b9a-4f6b-894b-dcacbefcd133 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:25.942849 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a6cc43f2-1b9a-4f6b-894b-dcacbefcd133 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:25.943660 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a6cc43f2-1b9a-4f6b-894b-dcacbefcd133 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:25.944358 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a6cc43f2-1b9a-4f6b-894b-dcacbefcd133 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:26.315477 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a6cc43f2-1b9a-4f6b-894b-dcacbefcd133 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:26.328238 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a6cc43f2-1b9a-4f6b-894b-dcacbefcd133 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1363 microversion: 2.1 time: 0.411670 Aug 07 01:37:26.355229 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2811/5166] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:25 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1363 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:26.718803 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8949d3df-fdf7-4c09-9d8e-55e3f938ea76 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:26.738129 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8949d3df-fdf7-4c09-9d8e-55e3f938ea76 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d" status: 200 len: 1522 microversion: 2.1 time: 1.238520 Aug 07 01:37:26.744230 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2356/5167] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:25 2022] GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d => generated 1522 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:27.364393 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-90204b5d-25d9-40c9-aff0-cd2c33e62585 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:27.365779 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-90204b5d-25d9-40c9-aff0-cd2c33e62585 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:27.374802 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90204b5d-25d9-40c9-aff0-cd2c33e62585 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:27.375854 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90204b5d-25d9-40c9-aff0-cd2c33e62585 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:27.376558 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90204b5d-25d9-40c9-aff0-cd2c33e62585 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:27.377520 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90204b5d-25d9-40c9-aff0-cd2c33e62585 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:27.378214 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90204b5d-25d9-40c9-aff0-cd2c33e62585 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:27.378938 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90204b5d-25d9-40c9-aff0-cd2c33e62585 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:27.765809 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4d7a08d8-67be-4b76-80cf-334902b33682 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:27.766574 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4d7a08d8-67be-4b76-80cf-334902b33682 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:27.769387 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:27.777972 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d7a08d8-67be-4b76-80cf-334902b33682 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:27.778671 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d7a08d8-67be-4b76-80cf-334902b33682 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:27.779294 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d7a08d8-67be-4b76-80cf-334902b33682 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:27.780264 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d7a08d8-67be-4b76-80cf-334902b33682 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:27.780910 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d7a08d8-67be-4b76-80cf-334902b33682 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:27.781518 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d7a08d8-67be-4b76-80cf-334902b33682 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:28.113566 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4d7a08d8-67be-4b76-80cf-334902b33682 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:28.125962 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4d7a08d8-67be-4b76-80cf-334902b33682 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d" status: 200 len: 1522 microversion: 2.1 time: 0.364320 Aug 07 01:37:28.128281 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2357/5168] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:27 2022] GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d => generated 1522 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:28.162656 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-90204b5d-25d9-40c9-aff0-cd2c33e62585 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:28.174366 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-90204b5d-25d9-40c9-aff0-cd2c33e62585 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1363 microversion: 2.1 time: 0.815558 Aug 07 01:37:28.175642 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2812/5169] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:27 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1363 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:28.642962 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bb42bb52-85dc-4957-9080-436f2d27eb42 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:37:28.643863 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bb42bb52-85dc-4957-9080-436f2d27eb42 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:28.653091 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bb42bb52-85dc-4957-9080-436f2d27eb42 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:28.654390 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bb42bb52-85dc-4957-9080-436f2d27eb42 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:28.655543 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bb42bb52-85dc-4957-9080-436f2d27eb42 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:28.656987 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bb42bb52-85dc-4957-9080-436f2d27eb42 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:28.658447 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bb42bb52-85dc-4957-9080-436f2d27eb42 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:28.659342 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bb42bb52-85dc-4957-9080-436f2d27eb42 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:28.698699 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-bb42bb52-85dc-4957-9080-436f2d27eb42 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lazy-loading 'flavor' on Instance uuid 2c2503ba-46e2-4b06-9675-c4cb842783ca {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:37:29.040704 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bb42bb52-85dc-4957-9080-436f2d27eb42 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "POST /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca/action" status: 202 len: 0 microversion: 2.20 time: 0.402849 Aug 07 01:37:29.043059 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2358/5170] 10.222.0.39 () {62 vars in 1319 bytes} [Sun Aug 7 01:37:28 2022] POST /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca/action => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:37:29.053798 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4df19f32-330a-49ee-abe0-5b1afd151300 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:29.054562 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4df19f32-330a-49ee-abe0-5b1afd151300 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:29.066157 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4df19f32-330a-49ee-abe0-5b1afd151300 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:29.067075 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4df19f32-330a-49ee-abe0-5b1afd151300 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:29.068532 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4df19f32-330a-49ee-abe0-5b1afd151300 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:29.069884 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4df19f32-330a-49ee-abe0-5b1afd151300 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:29.070535 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4df19f32-330a-49ee-abe0-5b1afd151300 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:29.071139 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4df19f32-330a-49ee-abe0-5b1afd151300 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:29.152071 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-42e3db9a-dbe5-4d0d-ab98-abd2ac78ca7f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:29.153764 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-42e3db9a-dbe5-4d0d-ab98-abd2ac78ca7f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:29.162739 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-42e3db9a-dbe5-4d0d-ab98-abd2ac78ca7f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:29.164601 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-42e3db9a-dbe5-4d0d-ab98-abd2ac78ca7f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:29.165298 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-42e3db9a-dbe5-4d0d-ab98-abd2ac78ca7f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:29.166285 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-42e3db9a-dbe5-4d0d-ab98-abd2ac78ca7f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:29.166979 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-42e3db9a-dbe5-4d0d-ab98-abd2ac78ca7f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:29.168171 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-42e3db9a-dbe5-4d0d-ab98-abd2ac78ca7f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:29.448597 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:29.555433 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4df19f32-330a-49ee-abe0-5b1afd151300 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:29.565426 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4df19f32-330a-49ee-abe0-5b1afd151300 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:29.567858 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4df19f32-330a-49ee-abe0-5b1afd151300 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:29.571639 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4df19f32-330a-49ee-abe0-5b1afd151300 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1725 microversion: 2.20 time: 0.523977 Aug 07 01:37:29.575247 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2813/5171] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:37:29 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1725 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:37:29.592793 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b105b14a-b699-4ee8-af80-e2732621a429 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:29.595097 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-42e3db9a-dbe5-4d0d-ab98-abd2ac78ca7f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:29.599119 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b105b14a-b699-4ee8-af80-e2732621a429 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:29.606500 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-42e3db9a-dbe5-4d0d-ab98-abd2ac78ca7f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d" status: 200 len: 1522 microversion: 2.1 time: 0.460197 Aug 07 01:37:29.609684 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2359/5172] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:29 2022] GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d => generated 1522 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:29.616197 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b105b14a-b699-4ee8-af80-e2732621a429 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:29.617519 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b105b14a-b699-4ee8-af80-e2732621a429 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:29.621303 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b105b14a-b699-4ee8-af80-e2732621a429 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:29.622469 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b105b14a-b699-4ee8-af80-e2732621a429 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:29.623691 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b105b14a-b699-4ee8-af80-e2732621a429 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:29.626929 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b105b14a-b699-4ee8-af80-e2732621a429 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:30.044528 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b105b14a-b699-4ee8-af80-e2732621a429 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:30.059922 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b105b14a-b699-4ee8-af80-e2732621a429 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1363 microversion: 2.1 time: 0.479298 Aug 07 01:37:30.061614 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2814/5173] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:29 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1363 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:30.599068 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=8 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:30.603835 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f8968378-ebdf-4b90-840d-4dc46d646820 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:30.604503 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f8968378-ebdf-4b90-840d-4dc46d646820 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:30.615393 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f8968378-ebdf-4b90-840d-4dc46d646820 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:30.615921 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f8968378-ebdf-4b90-840d-4dc46d646820 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:30.616344 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f8968378-ebdf-4b90-840d-4dc46d646820 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:30.628825 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5193786f-cf9f-485c-b9ad-75acf41f49ff tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:30.629674 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5193786f-cf9f-485c-b9ad-75acf41f49ff tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:30.634411 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f8968378-ebdf-4b90-840d-4dc46d646820 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:30.637098 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f8968378-ebdf-4b90-840d-4dc46d646820 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:30.637546 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f8968378-ebdf-4b90-840d-4dc46d646820 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:30.642618 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5193786f-cf9f-485c-b9ad-75acf41f49ff tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:30.643089 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5193786f-cf9f-485c-b9ad-75acf41f49ff tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:30.648535 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5193786f-cf9f-485c-b9ad-75acf41f49ff tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:30.649321 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5193786f-cf9f-485c-b9ad-75acf41f49ff tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:30.649798 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5193786f-cf9f-485c-b9ad-75acf41f49ff tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:30.652425 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5193786f-cf9f-485c-b9ad-75acf41f49ff tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:30.996882 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f8968378-ebdf-4b90-840d-4dc46d646820 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:31.005773 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f8968378-ebdf-4b90-840d-4dc46d646820 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:31.007304 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f8968378-ebdf-4b90-840d-4dc46d646820 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:31.008531 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f8968378-ebdf-4b90-840d-4dc46d646820 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1725 microversion: 2.20 time: 0.411102 Aug 07 01:37:31.026060 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2360/5174] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:37:30 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1725 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:37:31.092147 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2133cd02-d31f-497d-8347-b6ca46add1df tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:31.093918 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2133cd02-d31f-497d-8347-b6ca46add1df tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:31.107129 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2133cd02-d31f-497d-8347-b6ca46add1df tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:31.109535 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2133cd02-d31f-497d-8347-b6ca46add1df tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:31.111041 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2133cd02-d31f-497d-8347-b6ca46add1df tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:31.112353 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2133cd02-d31f-497d-8347-b6ca46add1df tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:31.113047 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2133cd02-d31f-497d-8347-b6ca46add1df tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:31.113824 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2133cd02-d31f-497d-8347-b6ca46add1df tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:31.146626 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5193786f-cf9f-485c-b9ad-75acf41f49ff tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:31.166499 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5193786f-cf9f-485c-b9ad-75acf41f49ff tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d" status: 200 len: 1522 microversion: 2.1 time: 0.539051 Aug 07 01:37:31.168302 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2815/5175] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:30 2022] GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d => generated 1522 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:37:31.658115 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2133cd02-d31f-497d-8347-b6ca46add1df tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:31.667391 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2133cd02-d31f-497d-8347-b6ca46add1df tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1363 microversion: 2.1 time: 0.588542 Aug 07 01:37:31.680711 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2361/5176] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:31 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1363 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:37:32.034061 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e8048c60-1b8b-407b-9746-ab8eec4de3e2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:32.035232 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e8048c60-1b8b-407b-9746-ab8eec4de3e2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:32.048954 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e8048c60-1b8b-407b-9746-ab8eec4de3e2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:32.051854 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e8048c60-1b8b-407b-9746-ab8eec4de3e2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:32.053632 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e8048c60-1b8b-407b-9746-ab8eec4de3e2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:32.054695 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e8048c60-1b8b-407b-9746-ab8eec4de3e2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:32.057680 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e8048c60-1b8b-407b-9746-ab8eec4de3e2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:32.060894 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e8048c60-1b8b-407b-9746-ab8eec4de3e2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:32.191169 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b7ce33d5-d489-4c0c-82d4-4e04a5e82ef6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:32.191779 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b7ce33d5-d489-4c0c-82d4-4e04a5e82ef6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:32.204825 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b7ce33d5-d489-4c0c-82d4-4e04a5e82ef6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:32.205516 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b7ce33d5-d489-4c0c-82d4-4e04a5e82ef6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:32.205972 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b7ce33d5-d489-4c0c-82d4-4e04a5e82ef6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:32.206713 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b7ce33d5-d489-4c0c-82d4-4e04a5e82ef6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:32.207181 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b7ce33d5-d489-4c0c-82d4-4e04a5e82ef6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:32.207616 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b7ce33d5-d489-4c0c-82d4-4e04a5e82ef6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:32.638728 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e8048c60-1b8b-407b-9746-ab8eec4de3e2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:32.652584 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e8048c60-1b8b-407b-9746-ab8eec4de3e2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:32.654806 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e8048c60-1b8b-407b-9746-ab8eec4de3e2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:32.656692 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e8048c60-1b8b-407b-9746-ab8eec4de3e2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1725 microversion: 2.20 time: 0.626889 Aug 07 01:37:32.658008 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2816/5177] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:37:32 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1725 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:37:32.664289 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-0c7b056f-6d1f-4bd2-b078-46e769422abd req-aa112e69-dfa3-4e6c-b167-c0356ab23cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d2f04ca-7c24-4d1a-a723-7cf3a8782976", "name": "network-vif-plugged", "status": "completed", "tag": "df05b03a-bb99-46f1-ae77-4d31e797b6a3"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:37:32.676020 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0c7b056f-6d1f-4bd2-b078-46e769422abd req-aa112e69-dfa3-4e6c-b167-c0356ab23cf2 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:32.677047 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0c7b056f-6d1f-4bd2-b078-46e769422abd req-aa112e69-dfa3-4e6c-b167-c0356ab23cf2 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:32.677589 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0c7b056f-6d1f-4bd2-b078-46e769422abd req-aa112e69-dfa3-4e6c-b167-c0356ab23cf2 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:32.691488 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-0c7b056f-6d1f-4bd2-b078-46e769422abd req-aa112e69-dfa3-4e6c-b167-c0356ab23cf2 service nova] Creating event network-vif-plugged:df05b03a-bb99-46f1-ae77-4d31e797b6a3 for instance 0d2f04ca-7c24-4d1a-a723-7cf3a8782976 on n-h2-master-1 Aug 07 01:37:32.697856 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-0c7b056f-6d1f-4bd2-b078-46e769422abd req-aa112e69-dfa3-4e6c-b167-c0356ab23cf2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038337 Aug 07 01:37:32.698871 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2817/5178] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:37:32.706899 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d6fb43a4-ecde-4678-9407-20b01bef8543 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:32.707877 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d6fb43a4-ecde-4678-9407-20b01bef8543 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:32.715612 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6fb43a4-ecde-4678-9407-20b01bef8543 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:32.716492 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6fb43a4-ecde-4678-9407-20b01bef8543 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:32.717167 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6fb43a4-ecde-4678-9407-20b01bef8543 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:32.718114 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6fb43a4-ecde-4678-9407-20b01bef8543 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:32.718798 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6fb43a4-ecde-4678-9407-20b01bef8543 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:32.720076 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6fb43a4-ecde-4678-9407-20b01bef8543 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:33.008306 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b7ce33d5-d489-4c0c-82d4-4e04a5e82ef6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:33.019847 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b7ce33d5-d489-4c0c-82d4-4e04a5e82ef6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d" status: 200 len: 1522 microversion: 2.1 time: 0.832907 Aug 07 01:37:33.028134 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2362/5179] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:32 2022] GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d => generated 1522 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:37:33.167848 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d6fb43a4-ecde-4678-9407-20b01bef8543 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:33.176051 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d6fb43a4-ecde-4678-9407-20b01bef8543 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1363 microversion: 2.1 time: 0.475716 Aug 07 01:37:33.176638 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2818/5180] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:32 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1363 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:33.603174 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d08ae074-92ea-42f4-a77e-dedb055a7447 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c441234-906a-455e-a87d-7ec446f611ec"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:37:33.606022 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d08ae074-92ea-42f4-a77e-dedb055a7447 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 0658227f-88e6-40fd-bb8f-aa6267addc84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:33.616055 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d08ae074-92ea-42f4-a77e-dedb055a7447 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:33.616762 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d08ae074-92ea-42f4-a77e-dedb055a7447 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:33.617771 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d08ae074-92ea-42f4-a77e-dedb055a7447 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:33.619193 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d08ae074-92ea-42f4-a77e-dedb055a7447 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:33.619827 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d08ae074-92ea-42f4-a77e-dedb055a7447 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:33.622632 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d08ae074-92ea-42f4-a77e-dedb055a7447 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:33.682049 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4784cb49-a321-421d-a976-ac26e21c6ddf tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:33.683797 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4784cb49-a321-421d-a976-ac26e21c6ddf tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:33.697144 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4784cb49-a321-421d-a976-ac26e21c6ddf tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:33.699013 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4784cb49-a321-421d-a976-ac26e21c6ddf tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:33.700410 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4784cb49-a321-421d-a976-ac26e21c6ddf tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:33.701842 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4784cb49-a321-421d-a976-ac26e21c6ddf tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:33.704443 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4784cb49-a321-421d-a976-ac26e21c6ddf tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:33.706209 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4784cb49-a321-421d-a976-ac26e21c6ddf tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:33.742053 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-d08ae074-92ea-42f4-a77e-dedb055a7447 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] HTTP exception thrown: Invalid volume: volume 8c441234-906a-455e-a87d-7ec446f611ec is already attached to instances: 0658227f-88e6-40fd-bb8f-aa6267addc84 Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d08ae074-92ea-42f4-a77e-dedb055a7447 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Request method failure captured: Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84/os-volume_attachments HTTP/1.1 Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 74 Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xZDq6RH3D4bnr1UijP-nk3uo95NJjh7SbfPDqAVgj126rgmdcLbKlTvq4r9AHLnAVbqooFNQ3b97yry4NtGcTnZJETXBytnxiV1irP15oNSC1nhov4fsRvKuKlTNLjRN8RkNUdoouf8PCfkhvGYmSqoJN36Q7GHr7rf2nNkd41nqV4 Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: b630a4c3bb824b90b4c1898a92b47aa7 Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b630a4c3bb824b90b4c1898a92b47aa7", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: b630a4c3bb824b90b4c1898a92b47aa7 Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-AttachVolumeNegativeTest-1422960247-project Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d556a8ae0d524894a93203ce3f70d420 Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-AttachVolumeNegativeTest-1422960247-project Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: {"volumeAttachment": {"volumeId": "8c441234-906a-455e-a87d-7ec446f611ec"}} Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: exception: Invalid volume: volume 8c441234-906a-455e-a87d-7ec446f611ec is already attached to instances: 0658227f-88e6-40fd-bb8f-aa6267addc84 Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: action_args: {'server_id': '0658227f-88e6-40fd-bb8f-aa6267addc84', 'body': {'volumeAttachment': {'volumeId': '8c441234-906a-455e-a87d-7ec446f611ec'}}} Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8c441234-906a-455e-a87d-7ec446f611ec is already attached to instances: 0658227f-88e6-40fd-bb8f-aa6267addc84 Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:37:33.745936 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:37:33.753961 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:37:33.753961 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:37:33.753961 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 07 01:37:33.753961 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 07 01:37:33.753961 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8c441234-906a-455e-a87d-7ec446f611ec is already attached to instances: 0658227f-88e6-40fd-bb8f-aa6267addc84 Aug 07 01:37:33.753961 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:37:33.753961 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:37:33.753961 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:37:33.753961 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:37:33.753961 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:37:33.753961 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:37:33.753961 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:37:33.753961 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:37:33.753961 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8c441234-906a-455e-a87d-7ec446f611ec is already attached to instances: 0658227f-88e6-40fd-bb8f-aa6267addc84 Aug 07 01:37:33.753961 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:37:33.758538 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d08ae074-92ea-42f4-a77e-dedb055a7447 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Returning 400 to user: Invalid volume: volume 8c441234-906a-455e-a87d-7ec446f611ec is already attached to instances: 0658227f-88e6-40fd-bb8f-aa6267addc84 {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:37:33.760166 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d08ae074-92ea-42f4-a77e-dedb055a7447 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "POST /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.162212 Aug 07 01:37:33.769190 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2363/5181] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Aug 7 01:37:33 2022] POST /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84/os-volume_attachments => generated 174 bytes in 168 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:37:33.858211 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cc5530dc-df20-4f48-8722-0644ae17394d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:33.859100 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-cc5530dc-df20-4f48-8722-0644ae17394d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 0658227f-88e6-40fd-bb8f-aa6267addc84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:33.867262 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc5530dc-df20-4f48-8722-0644ae17394d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:33.868353 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc5530dc-df20-4f48-8722-0644ae17394d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:33.874353 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc5530dc-df20-4f48-8722-0644ae17394d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:33.875397 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc5530dc-df20-4f48-8722-0644ae17394d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:33.876199 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc5530dc-df20-4f48-8722-0644ae17394d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:33.876921 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc5530dc-df20-4f48-8722-0644ae17394d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:34.002735 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-cc5530dc-df20-4f48-8722-0644ae17394d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lazy-loading 'services' on Instance uuid 0658227f-88e6-40fd-bb8f-aa6267addc84 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:37:34.084228 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cc5530dc-df20-4f48-8722-0644ae17394d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84/os-volume_attachments/8c441234-906a-455e-a87d-7ec446f611ec" status: 202 len: 0 microversion: 2.1 time: 0.232169 Aug 07 01:37:34.085512 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2364/5182] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Aug 7 01:37:33 2022] DELETE /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84/os-volume_attachments/8c441234-906a-455e-a87d-7ec446f611ec => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:37:34.092067 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6544b199-21c2-4a5f-9ef7-c5c9503cff97 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:34.093063 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6544b199-21c2-4a5f-9ef7-c5c9503cff97 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:34.094393 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4784cb49-a321-421d-a976-ac26e21c6ddf tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:34.101688 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6544b199-21c2-4a5f-9ef7-c5c9503cff97 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:34.101688 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6544b199-21c2-4a5f-9ef7-c5c9503cff97 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:34.102003 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6544b199-21c2-4a5f-9ef7-c5c9503cff97 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:34.103361 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6544b199-21c2-4a5f-9ef7-c5c9503cff97 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:34.104400 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6544b199-21c2-4a5f-9ef7-c5c9503cff97 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:34.105096 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6544b199-21c2-4a5f-9ef7-c5c9503cff97 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:34.129402 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4784cb49-a321-421d-a976-ac26e21c6ddf tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:34.133189 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4784cb49-a321-421d-a976-ac26e21c6ddf tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:34.137706 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4784cb49-a321-421d-a976-ac26e21c6ddf tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1725 microversion: 2.20 time: 0.458336 Aug 07 01:37:34.139546 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2819/5183] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:37:33 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1725 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:37:34.156083 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-970bea56-08cd-4944-8f0e-cf6955dfb49a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:34.159068 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-970bea56-08cd-4944-8f0e-cf6955dfb49a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 0658227f-88e6-40fd-bb8f-aa6267addc84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:34.170547 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-970bea56-08cd-4944-8f0e-cf6955dfb49a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:34.171913 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-970bea56-08cd-4944-8f0e-cf6955dfb49a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:34.186230 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-970bea56-08cd-4944-8f0e-cf6955dfb49a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:34.187795 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-970bea56-08cd-4944-8f0e-cf6955dfb49a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:34.188842 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-970bea56-08cd-4944-8f0e-cf6955dfb49a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:34.193049 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-970bea56-08cd-4944-8f0e-cf6955dfb49a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:34.281120 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-970bea56-08cd-4944-8f0e-cf6955dfb49a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140169 Aug 07 01:37:34.308539 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2820/5184] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:37:34 2022] GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:37:34.317219 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-015e3677-e697-4dac-a0a0-76f53dace4e2 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:34.318883 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-015e3677-e697-4dac-a0a0-76f53dace4e2 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:34.330620 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-015e3677-e697-4dac-a0a0-76f53dace4e2 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:34.331263 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-015e3677-e697-4dac-a0a0-76f53dace4e2 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:34.331825 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-015e3677-e697-4dac-a0a0-76f53dace4e2 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:34.336488 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-015e3677-e697-4dac-a0a0-76f53dace4e2 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:34.337223 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-015e3677-e697-4dac-a0a0-76f53dace4e2 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:34.337683 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-015e3677-e697-4dac-a0a0-76f53dace4e2 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:34.614799 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6544b199-21c2-4a5f-9ef7-c5c9503cff97 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:34.627429 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6544b199-21c2-4a5f-9ef7-c5c9503cff97 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d" status: 200 len: 1522 microversion: 2.1 time: 0.540281 Aug 07 01:37:34.628410 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2365/5185] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:34 2022] GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d => generated 1522 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:34.795127 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-015e3677-e697-4dac-a0a0-76f53dace4e2 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:34.806478 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-015e3677-e697-4dac-a0a0-76f53dace4e2 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1363 microversion: 2.1 time: 0.496572 Aug 07 01:37:34.813849 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2821/5186] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:34 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1363 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:35.162418 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9b3ceb1f-924c-4dcf-a01b-73a24f6cadad tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:35.163035 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9b3ceb1f-924c-4dcf-a01b-73a24f6cadad tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:35.181972 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9b3ceb1f-924c-4dcf-a01b-73a24f6cadad tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:35.182479 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9b3ceb1f-924c-4dcf-a01b-73a24f6cadad tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:35.182924 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9b3ceb1f-924c-4dcf-a01b-73a24f6cadad tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:35.183646 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9b3ceb1f-924c-4dcf-a01b-73a24f6cadad tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:35.184323 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9b3ceb1f-924c-4dcf-a01b-73a24f6cadad tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:35.184919 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9b3ceb1f-924c-4dcf-a01b-73a24f6cadad tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:35.315756 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0a699409-2d23-41c2-b3c0-48095e7b3bdc tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:35.318176 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0a699409-2d23-41c2-b3c0-48095e7b3bdc tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 0658227f-88e6-40fd-bb8f-aa6267addc84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:35.333912 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a699409-2d23-41c2-b3c0-48095e7b3bdc tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:35.335198 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a699409-2d23-41c2-b3c0-48095e7b3bdc tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:35.336177 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a699409-2d23-41c2-b3c0-48095e7b3bdc tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:35.338272 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a699409-2d23-41c2-b3c0-48095e7b3bdc tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:35.339764 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a699409-2d23-41c2-b3c0-48095e7b3bdc tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:35.340361 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a699409-2d23-41c2-b3c0-48095e7b3bdc tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:35.379674 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:35.417367 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0a699409-2d23-41c2-b3c0-48095e7b3bdc tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106261 Aug 07 01:37:35.419836 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2822/5187] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:37:35 2022] GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:37:35.481165 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9b3ceb1f-924c-4dcf-a01b-73a24f6cadad tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:35.496392 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9b3ceb1f-924c-4dcf-a01b-73a24f6cadad tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:35.497991 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9b3ceb1f-924c-4dcf-a01b-73a24f6cadad tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:35.499218 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9b3ceb1f-924c-4dcf-a01b-73a24f6cadad tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1725 microversion: 2.20 time: 0.340798 Aug 07 01:37:35.521144 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2366/5188] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:37:35 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1725 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:37:35.652129 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-81c777b3-3bce-44e8-8959-4f15d6a27eea tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:35.652129 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-81c777b3-3bce-44e8-8959-4f15d6a27eea tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:35.665385 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-81c777b3-3bce-44e8-8959-4f15d6a27eea tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:35.665940 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-81c777b3-3bce-44e8-8959-4f15d6a27eea tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:35.666451 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-81c777b3-3bce-44e8-8959-4f15d6a27eea tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:35.667269 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-81c777b3-3bce-44e8-8959-4f15d6a27eea tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:35.667806 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-81c777b3-3bce-44e8-8959-4f15d6a27eea tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:35.668393 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-81c777b3-3bce-44e8-8959-4f15d6a27eea tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:35.831602 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e4f10813-65c6-4b47-8a25-a8641c978952 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:35.831602 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e4f10813-65c6-4b47-8a25-a8641c978952 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:35.847865 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4f10813-65c6-4b47-8a25-a8641c978952 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:35.848480 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4f10813-65c6-4b47-8a25-a8641c978952 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:35.848928 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4f10813-65c6-4b47-8a25-a8641c978952 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:35.849743 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4f10813-65c6-4b47-8a25-a8641c978952 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:35.850205 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4f10813-65c6-4b47-8a25-a8641c978952 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:35.850631 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4f10813-65c6-4b47-8a25-a8641c978952 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:36.010996 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-81c777b3-3bce-44e8-8959-4f15d6a27eea tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:36.024434 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-81c777b3-3bce-44e8-8959-4f15d6a27eea tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d" status: 200 len: 1502 microversion: 2.1 time: 0.377545 Aug 07 01:37:36.027572 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2823/5189] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:35 2022] GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d => generated 1502 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:36.049058 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0a85872f-ea53-44c5-907e-3d0d70fb34d8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4031bdf-bf75-4c0e-b7fd-8053ac4de629"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:37:36.053079 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0a85872f-ea53-44c5-907e-3d0d70fb34d8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:36.060550 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a85872f-ea53-44c5-907e-3d0d70fb34d8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:36.063406 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a85872f-ea53-44c5-907e-3d0d70fb34d8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:36.064127 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a85872f-ea53-44c5-907e-3d0d70fb34d8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:36.065111 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a85872f-ea53-44c5-907e-3d0d70fb34d8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:36.066694 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a85872f-ea53-44c5-907e-3d0d70fb34d8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:36.067339 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a85872f-ea53-44c5-907e-3d0d70fb34d8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:36.101812 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-0a85872f-ea53-44c5-907e-3d0d70fb34d8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] HTTP exception thrown: Cannot 'attach_volume' instance 67905784-e195-4938-9ea1-7e0fb23ffd4d while it is in vm_state rescued Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0a85872f-ea53-44c5-907e-3d0d70fb34d8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Request method failure captured: Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d/os-volume_attachments HTTP/1.1 Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 74 Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xcFUTwOrsKbLuCg4An479LA9G9aDuSE7GEjV8VWyLtq1rxOhZ9Q8jcwtkvN3VeO8ggfh8KvRRX8HWvqee02PsBBf0WFvhZisgorTKvdssuK7IJ1NUIDzU8DRVfm2J3najrfJ74eq56eKh78U1nPClJkssFs7yS7oVt53yn2dEShWXQ Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 70f17360f0c84562bd99b006b659736e Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1195249405 Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/70f17360f0c84562bd99b006b659736e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_70f17360f0c84562bd99b006b659736e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/70f17360f0c84562bd99b006b659736e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/70f17360f0c84562bd99b006b659736e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1195249405 Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 70f17360f0c84562bd99b006b659736e Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1195249405 Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServerRescueNegativeTestJSON-1195249405-project Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 2f5acf7da18b43f89e24760744cfdb49 Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1195249405-project Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: {"volumeAttachment": {"volumeId": "a4031bdf-bf75-4c0e-b7fd-8053ac4de629"}} Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: exception: Cannot 'attach_volume' instance 67905784-e195-4938-9ea1-7e0fb23ffd4d while it is in vm_state rescued Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: action_args: {'server_id': '67905784-e195-4938-9ea1-7e0fb23ffd4d', 'body': {'volumeAttachment': {'volumeId': 'a4031bdf-bf75-4c0e-b7fd-8053ac4de629'}}} Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 67905784-e195-4938-9ea1-7e0fb23ffd4d in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 07 01:37:36.104903 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 07 01:37:36.112589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 07 01:37:36.112589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 07 01:37:36.112589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 67905784-e195-4938-9ea1-7e0fb23ffd4d while it is in vm_state rescued Aug 07 01:37:36.112589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:37:36.112589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:37:36.112589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:37:36.112589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:37:36.112589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:37:36.112589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:37:36.112589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:37:36.112589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:37:36.112589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 67905784-e195-4938-9ea1-7e0fb23ffd4d while it is in vm_state rescued Aug 07 01:37:36.112589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:37:36.115999 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0a85872f-ea53-44c5-907e-3d0d70fb34d8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Returning 409 to user: Cannot 'attach_volume' instance 67905784-e195-4938-9ea1-7e0fb23ffd4d while it is in vm_state rescued {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:37:36.117095 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0a85872f-ea53-44c5-907e-3d0d70fb34d8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "POST /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.073868 Aug 07 01:37:36.118498 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2824/5190] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Aug 7 01:37:36 2022] POST /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d/os-volume_attachments => generated 152 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 07 01:37:36.135829 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-db23daec-993d-46d2-9a44-4552668468f2 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:37:36.136410 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-db23daec-993d-46d2-9a44-4552668468f2 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:36.154979 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-db23daec-993d-46d2-9a44-4552668468f2 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:36.155482 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-db23daec-993d-46d2-9a44-4552668468f2 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:36.156025 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-db23daec-993d-46d2-9a44-4552668468f2 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:36.156733 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-db23daec-993d-46d2-9a44-4552668468f2 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:36.157137 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-db23daec-993d-46d2-9a44-4552668468f2 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:36.157568 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-db23daec-993d-46d2-9a44-4552668468f2 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:36.322054 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-db23daec-993d-46d2-9a44-4552668468f2 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "POST /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d/action" status: 202 len: 0 microversion: 2.1 time: 0.195412 Aug 07 01:37:36.338956 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2825/5191] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:37:36 2022] POST /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:37:36.358027 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-641969dc-b13a-46d5-8ddb-515a4f0acde3 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:36.358947 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-641969dc-b13a-46d5-8ddb-515a4f0acde3 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:36.382821 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-641969dc-b13a-46d5-8ddb-515a4f0acde3 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:36.383706 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-641969dc-b13a-46d5-8ddb-515a4f0acde3 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:36.384398 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-641969dc-b13a-46d5-8ddb-515a4f0acde3 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:36.385505 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-641969dc-b13a-46d5-8ddb-515a4f0acde3 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:36.386791 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-641969dc-b13a-46d5-8ddb-515a4f0acde3 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:36.387667 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-641969dc-b13a-46d5-8ddb-515a4f0acde3 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:36.410489 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e4f10813-65c6-4b47-8a25-a8641c978952 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:36.419219 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e4f10813-65c6-4b47-8a25-a8641c978952 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1549 microversion: 2.1 time: 0.592880 Aug 07 01:37:36.423078 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2367/5192] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:35 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1549 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:36.439235 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2714b203-f94b-4b56-b9aa-2f2317068927 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:36.446444 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2714b203-f94b-4b56-b9aa-2f2317068927 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 0658227f-88e6-40fd-bb8f-aa6267addc84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:36.463317 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2714b203-f94b-4b56-b9aa-2f2317068927 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:36.464195 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2714b203-f94b-4b56-b9aa-2f2317068927 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:36.465715 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2714b203-f94b-4b56-b9aa-2f2317068927 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:36.467501 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2714b203-f94b-4b56-b9aa-2f2317068927 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:36.471550 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2714b203-f94b-4b56-b9aa-2f2317068927 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:36.472269 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2714b203-f94b-4b56-b9aa-2f2317068927 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:36.543304 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2714b203-f94b-4b56-b9aa-2f2317068927 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117175 Aug 07 01:37:36.543915 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2368/5193] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:37:36 2022] GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:37:36.560858 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8dc59415-329a-4969-9b19-8429f9f9cedb tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:36.561671 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8dc59415-329a-4969-9b19-8429f9f9cedb tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:36.569602 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8dc59415-329a-4969-9b19-8429f9f9cedb tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:36.570419 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8dc59415-329a-4969-9b19-8429f9f9cedb tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:36.570866 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8dc59415-329a-4969-9b19-8429f9f9cedb tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:36.582377 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8dc59415-329a-4969-9b19-8429f9f9cedb tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:36.583166 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8dc59415-329a-4969-9b19-8429f9f9cedb tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:36.583779 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8dc59415-329a-4969-9b19-8429f9f9cedb tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:37.023601 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-641969dc-b13a-46d5-8ddb-515a4f0acde3 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:37.036673 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-641969dc-b13a-46d5-8ddb-515a4f0acde3 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d" status: 200 len: 1510 microversion: 2.1 time: 0.691678 Aug 07 01:37:37.037591 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2826/5194] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:36 2022] GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d => generated 1510 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:37.042321 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-28da757d-6b14-4175-ba96-f09b3118d009 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:37.042933 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-28da757d-6b14-4175-ba96-f09b3118d009 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:37.059094 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-28da757d-6b14-4175-ba96-f09b3118d009 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:37.059590 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-28da757d-6b14-4175-ba96-f09b3118d009 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:37.060048 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-28da757d-6b14-4175-ba96-f09b3118d009 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:37.061542 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-28da757d-6b14-4175-ba96-f09b3118d009 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:37.065240 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-28da757d-6b14-4175-ba96-f09b3118d009 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:37.069035 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-28da757d-6b14-4175-ba96-f09b3118d009 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:37.319214 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8dc59415-329a-4969-9b19-8429f9f9cedb tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.773929 Aug 07 01:37:37.320100 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2369/5195] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Aug 7 01:37:36 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976/os-interface => generated 284 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:37:37.520101 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-28da757d-6b14-4175-ba96-f09b3118d009 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:37.537859 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-28da757d-6b14-4175-ba96-f09b3118d009 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:37.540045 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-28da757d-6b14-4175-ba96-f09b3118d009 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:37.541584 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-28da757d-6b14-4175-ba96-f09b3118d009 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1725 microversion: 2.20 time: 0.502966 Aug 07 01:37:37.553531 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2827/5196] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:37:37 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1725 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:37:37.557573 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ed62ea51-ac1b-4b04-98f4-2baf478148bb tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:37.559810 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ed62ea51-ac1b-4b04-98f4-2baf478148bb tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 0658227f-88e6-40fd-bb8f-aa6267addc84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:37.589393 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed62ea51-ac1b-4b04-98f4-2baf478148bb tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:37.589893 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed62ea51-ac1b-4b04-98f4-2baf478148bb tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:37.590329 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed62ea51-ac1b-4b04-98f4-2baf478148bb tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:37.592555 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed62ea51-ac1b-4b04-98f4-2baf478148bb tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:37.593017 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed62ea51-ac1b-4b04-98f4-2baf478148bb tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:37.593446 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed62ea51-ac1b-4b04-98f4-2baf478148bb tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:37.635166 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:37.698057 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ed62ea51-ac1b-4b04-98f4-2baf478148bb tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145407 Aug 07 01:37:37.698958 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2370/5197] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:37:37 2022] GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:37:38.063041 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-eb290af7-6eac-4cd3-a849-b63734f87cb4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:38.067393 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-eb290af7-6eac-4cd3-a849-b63734f87cb4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:38.094846 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb290af7-6eac-4cd3-a849-b63734f87cb4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:38.096418 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb290af7-6eac-4cd3-a849-b63734f87cb4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:38.097100 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb290af7-6eac-4cd3-a849-b63734f87cb4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:38.098063 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb290af7-6eac-4cd3-a849-b63734f87cb4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:38.098701 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb290af7-6eac-4cd3-a849-b63734f87cb4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:38.099334 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb290af7-6eac-4cd3-a849-b63734f87cb4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:38.386909 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-eb290af7-6eac-4cd3-a849-b63734f87cb4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:38.448881 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-eb290af7-6eac-4cd3-a849-b63734f87cb4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d" status: 200 len: 1510 microversion: 2.1 time: 0.394367 Aug 07 01:37:38.455180 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2828/5198] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:38 2022] GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d => generated 1510 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:38.583336 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-93aa4bab-0abb-49cc-8860-e6ad9d1048b6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:38.584016 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-93aa4bab-0abb-49cc-8860-e6ad9d1048b6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:38.603659 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93aa4bab-0abb-49cc-8860-e6ad9d1048b6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:38.604996 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93aa4bab-0abb-49cc-8860-e6ad9d1048b6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:38.610843 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93aa4bab-0abb-49cc-8860-e6ad9d1048b6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:38.611918 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93aa4bab-0abb-49cc-8860-e6ad9d1048b6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:38.612955 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93aa4bab-0abb-49cc-8860-e6ad9d1048b6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:38.613614 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93aa4bab-0abb-49cc-8860-e6ad9d1048b6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:38.714727 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c7227a47-544d-4938-ba59-74c65875ac95 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:38.718027 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c7227a47-544d-4938-ba59-74c65875ac95 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 0658227f-88e6-40fd-bb8f-aa6267addc84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:38.733900 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c7227a47-544d-4938-ba59-74c65875ac95 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:38.734480 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c7227a47-544d-4938-ba59-74c65875ac95 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:38.735448 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c7227a47-544d-4938-ba59-74c65875ac95 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:38.736232 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c7227a47-544d-4938-ba59-74c65875ac95 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:38.736704 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c7227a47-544d-4938-ba59-74c65875ac95 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:38.737142 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c7227a47-544d-4938-ba59-74c65875ac95 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:38.830815 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c7227a47-544d-4938-ba59-74c65875ac95 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121531 Aug 07 01:37:38.831943 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2829/5199] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:37:38 2022] GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:37:39.149705 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-93aa4bab-0abb-49cc-8860-e6ad9d1048b6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:39.160705 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-93aa4bab-0abb-49cc-8860-e6ad9d1048b6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:39.168043 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-93aa4bab-0abb-49cc-8860-e6ad9d1048b6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:39.174511 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-93aa4bab-0abb-49cc-8860-e6ad9d1048b6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1725 microversion: 2.20 time: 0.596744 Aug 07 01:37:39.175290 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2371/5200] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:37:38 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1725 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:37:39.476020 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7dbec4d4-ae44-45ba-9083-8cf46b360268 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:39.476638 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7dbec4d4-ae44-45ba-9083-8cf46b360268 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:39.489059 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7dbec4d4-ae44-45ba-9083-8cf46b360268 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:39.489601 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7dbec4d4-ae44-45ba-9083-8cf46b360268 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:39.490554 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7dbec4d4-ae44-45ba-9083-8cf46b360268 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:39.508239 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7dbec4d4-ae44-45ba-9083-8cf46b360268 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:39.511735 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7dbec4d4-ae44-45ba-9083-8cf46b360268 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:39.516486 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7dbec4d4-ae44-45ba-9083-8cf46b360268 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:39.842917 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c5c2bb18-cebd-49e6-a52d-22e997ac3079 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:39.845927 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c5c2bb18-cebd-49e6-a52d-22e997ac3079 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 0658227f-88e6-40fd-bb8f-aa6267addc84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:39.856660 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c5c2bb18-cebd-49e6-a52d-22e997ac3079 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:39.868927 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c5c2bb18-cebd-49e6-a52d-22e997ac3079 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:39.869745 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c5c2bb18-cebd-49e6-a52d-22e997ac3079 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:39.870719 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c5c2bb18-cebd-49e6-a52d-22e997ac3079 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:39.871382 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c5c2bb18-cebd-49e6-a52d-22e997ac3079 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:39.872037 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c5c2bb18-cebd-49e6-a52d-22e997ac3079 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:39.927224 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7dbec4d4-ae44-45ba-9083-8cf46b360268 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:39.942181 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c5c2bb18-cebd-49e6-a52d-22e997ac3079 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103206 Aug 07 01:37:39.943101 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2372/5201] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:37:39 2022] GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:37:39.955771 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7dbec4d4-ae44-45ba-9083-8cf46b360268 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d" status: 200 len: 1510 microversion: 2.1 time: 0.481820 Aug 07 01:37:39.957386 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2830/5202] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:39 2022] GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d => generated 1510 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:40.202166 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1e2ee21a-0b44-4da8-bda6-45eb7b25656e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:40.202946 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1e2ee21a-0b44-4da8-bda6-45eb7b25656e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:40.221008 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e2ee21a-0b44-4da8-bda6-45eb7b25656e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:40.221839 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e2ee21a-0b44-4da8-bda6-45eb7b25656e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:40.222486 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e2ee21a-0b44-4da8-bda6-45eb7b25656e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:40.223441 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e2ee21a-0b44-4da8-bda6-45eb7b25656e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:40.224135 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e2ee21a-0b44-4da8-bda6-45eb7b25656e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:40.225437 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e2ee21a-0b44-4da8-bda6-45eb7b25656e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:40.784347 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1e2ee21a-0b44-4da8-bda6-45eb7b25656e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:40.799120 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1e2ee21a-0b44-4da8-bda6-45eb7b25656e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:40.807543 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1e2ee21a-0b44-4da8-bda6-45eb7b25656e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:40.809843 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1e2ee21a-0b44-4da8-bda6-45eb7b25656e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1725 microversion: 2.20 time: 0.611190 Aug 07 01:37:40.837528 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2373/5203] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:37:40 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1725 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:37:40.956421 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-26aa67d1-d47c-4165-8b3f-954ef3eeae38 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:40.960906 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-26aa67d1-d47c-4165-8b3f-954ef3eeae38 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 0658227f-88e6-40fd-bb8f-aa6267addc84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:40.987570 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-26aa67d1-d47c-4165-8b3f-954ef3eeae38 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:40.988645 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-26aa67d1-d47c-4165-8b3f-954ef3eeae38 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:40.990176 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5bb58aad-e25f-4e91-9de8-6f6925e65999 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:40.991350 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5bb58aad-e25f-4e91-9de8-6f6925e65999 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:40.993646 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-26aa67d1-d47c-4165-8b3f-954ef3eeae38 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:40.995054 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-26aa67d1-d47c-4165-8b3f-954ef3eeae38 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:40.998099 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-26aa67d1-d47c-4165-8b3f-954ef3eeae38 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:41.000769 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-26aa67d1-d47c-4165-8b3f-954ef3eeae38 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:41.008926 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5bb58aad-e25f-4e91-9de8-6f6925e65999 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:41.009891 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5bb58aad-e25f-4e91-9de8-6f6925e65999 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:41.011971 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5bb58aad-e25f-4e91-9de8-6f6925e65999 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:41.013071 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5bb58aad-e25f-4e91-9de8-6f6925e65999 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:41.014257 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5bb58aad-e25f-4e91-9de8-6f6925e65999 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:41.017105 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5bb58aad-e25f-4e91-9de8-6f6925e65999 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:41.172703 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-26aa67d1-d47c-4165-8b3f-954ef3eeae38 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.220338 Aug 07 01:37:41.173427 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2831/5204] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:37:40 2022] GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84/os-volume_attachments => generated 197 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:37:41.413162 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5bb58aad-e25f-4e91-9de8-6f6925e65999 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:41.424812 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5bb58aad-e25f-4e91-9de8-6f6925e65999 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d" status: 200 len: 1516 microversion: 2.1 time: 0.450449 Aug 07 01:37:41.447222 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2374/5205] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:40 2022] GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d => generated 1516 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:41.834331 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8f48fba8-b820-4733-88f8-d9566eb944d6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:41.835131 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8f48fba8-b820-4733-88f8-d9566eb944d6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:41.845818 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8f48fba8-b820-4733-88f8-d9566eb944d6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:41.846632 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8f48fba8-b820-4733-88f8-d9566eb944d6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:41.849293 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8f48fba8-b820-4733-88f8-d9566eb944d6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:41.850344 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8f48fba8-b820-4733-88f8-d9566eb944d6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:41.851039 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8f48fba8-b820-4733-88f8-d9566eb944d6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:41.854825 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8f48fba8-b820-4733-88f8-d9566eb944d6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:42.158686 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-c5090077-471b-4923-9fbc-8b3b822b460d req-f448899f-e2bc-4996-8b54-713d53f02e9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d2f04ca-7c24-4d1a-a723-7cf3a8782976", "tag": "df05b03a-bb99-46f1-ae77-4d31e797b6a3"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:37:42.174935 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c5090077-471b-4923-9fbc-8b3b822b460d req-f448899f-e2bc-4996-8b54-713d53f02e9d service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:42.177785 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c5090077-471b-4923-9fbc-8b3b822b460d req-f448899f-e2bc-4996-8b54-713d53f02e9d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:42.178622 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c5090077-471b-4923-9fbc-8b3b822b460d req-f448899f-e2bc-4996-8b54-713d53f02e9d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:42.204702 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-c5090077-471b-4923-9fbc-8b3b822b460d req-f448899f-e2bc-4996-8b54-713d53f02e9d service nova] Creating event network-changed:df05b03a-bb99-46f1-ae77-4d31e797b6a3 for instance 0d2f04ca-7c24-4d1a-a723-7cf3a8782976 on n-h2-master-1 Aug 07 01:37:42.213388 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-c5090077-471b-4923-9fbc-8b3b822b460d req-f448899f-e2bc-4996-8b54-713d53f02e9d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061963 Aug 07 01:37:42.214485 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2375/5206] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:37:42.222885 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-51ff6292-c942-45af-abb2-8837a82ab4dc tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:42.226425 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-51ff6292-c942-45af-abb2-8837a82ab4dc tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 0658227f-88e6-40fd-bb8f-aa6267addc84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:42.235210 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-51ff6292-c942-45af-abb2-8837a82ab4dc tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:42.236130 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-51ff6292-c942-45af-abb2-8837a82ab4dc tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:42.236804 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-51ff6292-c942-45af-abb2-8837a82ab4dc tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:42.237928 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-51ff6292-c942-45af-abb2-8837a82ab4dc tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:42.238697 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-51ff6292-c942-45af-abb2-8837a82ab4dc tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:42.239239 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-51ff6292-c942-45af-abb2-8837a82ab4dc tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:42.281142 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-51ff6292-c942-45af-abb2-8837a82ab4dc tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064997 Aug 07 01:37:42.281840 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2376/5207] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:37:42 2022] GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:37:42.491357 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8f48fba8-b820-4733-88f8-d9566eb944d6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:42.505617 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8f48fba8-b820-4733-88f8-d9566eb944d6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:42.510487 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8f48fba8-b820-4733-88f8-d9566eb944d6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:42.518704 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8f48fba8-b820-4733-88f8-d9566eb944d6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1725 microversion: 2.20 time: 0.686238 Aug 07 01:37:42.519610 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2832/5208] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:37:41 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1725 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:37:43.294936 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-57d01408-66b2-4630-90ab-1569bebf496b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:43.297367 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-57d01408-66b2-4630-90ab-1569bebf496b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 0658227f-88e6-40fd-bb8f-aa6267addc84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:43.306130 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-57d01408-66b2-4630-90ab-1569bebf496b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:43.306625 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-57d01408-66b2-4630-90ab-1569bebf496b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:43.309377 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-57d01408-66b2-4630-90ab-1569bebf496b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:43.310410 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-57d01408-66b2-4630-90ab-1569bebf496b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:43.311058 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-57d01408-66b2-4630-90ab-1569bebf496b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:43.311816 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-57d01408-66b2-4630-90ab-1569bebf496b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:43.413130 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-57d01408-66b2-4630-90ab-1569bebf496b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.123292 Aug 07 01:37:43.417543 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2377/5209] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:37:43 2022] GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84/os-volume_attachments => generated 25 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:37:43.497988 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6dfb535c-d9d1-43df-8045-3dc06810b659 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:43.498753 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6dfb535c-d9d1-43df-8045-3dc06810b659 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 0658227f-88e6-40fd-bb8f-aa6267addc84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:43.517710 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6dfb535c-d9d1-43df-8045-3dc06810b659 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:43.521566 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6dfb535c-d9d1-43df-8045-3dc06810b659 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:43.522223 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6dfb535c-d9d1-43df-8045-3dc06810b659 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:43.523273 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6dfb535c-d9d1-43df-8045-3dc06810b659 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:43.524216 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6dfb535c-d9d1-43df-8045-3dc06810b659 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:43.525155 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6dfb535c-d9d1-43df-8045-3dc06810b659 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:43.545659 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4bfa93df-3da0-494b-8789-62c098b0b45c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:43.546622 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4bfa93df-3da0-494b-8789-62c098b0b45c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:43.571220 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4bfa93df-3da0-494b-8789-62c098b0b45c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:43.584402 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4bfa93df-3da0-494b-8789-62c098b0b45c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:43.585162 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4bfa93df-3da0-494b-8789-62c098b0b45c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:43.588338 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4bfa93df-3da0-494b-8789-62c098b0b45c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:43.589470 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4bfa93df-3da0-494b-8789-62c098b0b45c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:43.591593 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4bfa93df-3da0-494b-8789-62c098b0b45c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:43.693168 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6dfb535c-d9d1-43df-8045-3dc06810b659 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 0658227f-88e6-40fd-bb8f-aa6267addc84] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:37:43.960436 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6dfb535c-d9d1-43df-8045-3dc06810b659 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84" status: 204 len: 0 microversion: 2.1 time: 0.467714 Aug 07 01:37:43.964917 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2833/5210] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:37:43 2022] DELETE /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:37:43.980456 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-967b12ef-107d-4a31-affa-b0a3703a362d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:43.986623 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-967b12ef-107d-4a31-affa-b0a3703a362d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 0658227f-88e6-40fd-bb8f-aa6267addc84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:44.022968 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-967b12ef-107d-4a31-affa-b0a3703a362d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:44.024362 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-967b12ef-107d-4a31-affa-b0a3703a362d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:44.024815 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-967b12ef-107d-4a31-affa-b0a3703a362d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:44.032586 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-967b12ef-107d-4a31-affa-b0a3703a362d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:44.033215 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-967b12ef-107d-4a31-affa-b0a3703a362d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:44.033687 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-967b12ef-107d-4a31-affa-b0a3703a362d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:44.695068 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-967b12ef-107d-4a31-affa-b0a3703a362d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:44.703930 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-967b12ef-107d-4a31-affa-b0a3703a362d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84" status: 200 len: 1679 microversion: 2.1 time: 0.736232 Aug 07 01:37:44.713943 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2834/5211] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:43 2022] GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84 => generated 1679 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:44.735589 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ba346da3-109a-422f-ad50-12aaa60cf6bd tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Action: 'create', calling method: .version_select at 0x7f9e24723a60>, body: {"keypair": {"name": "tempest-keypair-1175283255", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnQiDdSZ2Tn9yWV/YN6CLYj6YqYDx0hmEQb+RvVnRLWuUsTbiQxJDjcMKT1cOK4ROEa8NRQpdUGZglkTlQSfWGcwaXmUHPw8VhFKUNsOUG45fNYZ/7+ovHiCSbxNmujqg=="}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:37:44.793865 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-ba346da3-109a-422f-ad50-12aaa60cf6bd tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Getting quotas for project 70f17360f0c84562bd99b006b659736e. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:37:44.805562 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-ba346da3-109a-422f-ad50-12aaa60cf6bd tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Getting quotas for user 2f5acf7da18b43f89e24760744cfdb49 and project 70f17360f0c84562bd99b006b659736e. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:37:44.884599 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ba346da3-109a-422f-ad50-12aaa60cf6bd tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.152818 Aug 07 01:37:44.885224 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2835/5212] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:37:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:37:44.988088 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4bfa93df-3da0-494b-8789-62c098b0b45c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:45.001583 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4bfa93df-3da0-494b-8789-62c098b0b45c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:45.002992 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4bfa93df-3da0-494b-8789-62c098b0b45c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:45.015267 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4bfa93df-3da0-494b-8789-62c098b0b45c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1725 microversion: 2.20 time: 1.462646 Aug 07 01:37:45.019190 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2378/5213] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:37:43 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1725 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:37:45.738316 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3d1e3cb2-bec0-43ad-8670-9d87c74b2a18 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:45.739044 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3d1e3cb2-bec0-43ad-8670-9d87c74b2a18 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 0658227f-88e6-40fd-bb8f-aa6267addc84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:45.741865 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:45.756291 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3d1e3cb2-bec0-43ad-8670-9d87c74b2a18 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:45.760849 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3d1e3cb2-bec0-43ad-8670-9d87c74b2a18 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:45.766554 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3d1e3cb2-bec0-43ad-8670-9d87c74b2a18 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:45.767963 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3d1e3cb2-bec0-43ad-8670-9d87c74b2a18 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:45.768559 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3d1e3cb2-bec0-43ad-8670-9d87c74b2a18 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:45.769105 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3d1e3cb2-bec0-43ad-8670-9d87c74b2a18 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:46.043154 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3c6993d6-6b6d-432d-9a32-62fa7b6b50a7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:46.043790 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3c6993d6-6b6d-432d-9a32-62fa7b6b50a7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:46.061577 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c6993d6-6b6d-432d-9a32-62fa7b6b50a7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:46.063864 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c6993d6-6b6d-432d-9a32-62fa7b6b50a7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:46.064826 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c6993d6-6b6d-432d-9a32-62fa7b6b50a7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:46.065771 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c6993d6-6b6d-432d-9a32-62fa7b6b50a7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:46.068085 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c6993d6-6b6d-432d-9a32-62fa7b6b50a7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:46.088402 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c6993d6-6b6d-432d-9a32-62fa7b6b50a7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:46.660374 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3d1e3cb2-bec0-43ad-8670-9d87c74b2a18 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:46.682608 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3d1e3cb2-bec0-43ad-8670-9d87c74b2a18 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84" status: 200 len: 1679 microversion: 2.1 time: 0.951226 Aug 07 01:37:46.696864 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2836/5214] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:45 2022] GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84 => generated 1679 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:46.887769 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3c6993d6-6b6d-432d-9a32-62fa7b6b50a7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:46.907818 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3c6993d6-6b6d-432d-9a32-62fa7b6b50a7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:46.909721 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3c6993d6-6b6d-432d-9a32-62fa7b6b50a7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:46.914235 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3c6993d6-6b6d-432d-9a32-62fa7b6b50a7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1746 microversion: 2.20 time: 0.875196 Aug 07 01:37:46.915088 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2379/5215] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:37:46 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1746 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:37:47.705881 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-34817b9c-f0e1-487f-b75c-771e181a5e5c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:47.707712 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-34817b9c-f0e1-487f-b75c-771e181a5e5c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 0658227f-88e6-40fd-bb8f-aa6267addc84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:47.730199 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34817b9c-f0e1-487f-b75c-771e181a5e5c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:47.731315 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34817b9c-f0e1-487f-b75c-771e181a5e5c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:47.734118 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34817b9c-f0e1-487f-b75c-771e181a5e5c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:47.737449 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34817b9c-f0e1-487f-b75c-771e181a5e5c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:47.738452 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34817b9c-f0e1-487f-b75c-771e181a5e5c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:47.739286 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34817b9c-f0e1-487f-b75c-771e181a5e5c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:47.863876 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-11b73b53-3134-4de5-ad62-af417aaeb292 req-e034195e-5ddc-47c5-9d25-674c3a5cf53d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c2503ba-46e2-4b06-9675-c4cb842783ca", "name": "network-vif-plugged", "status": "completed", "tag": "e89117b2-5b89-4cd2-bc23-8423fcc10e38"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:37:47.895597 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-11b73b53-3134-4de5-ad62-af417aaeb292 req-e034195e-5ddc-47c5-9d25-674c3a5cf53d service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:47.897763 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-11b73b53-3134-4de5-ad62-af417aaeb292 req-e034195e-5ddc-47c5-9d25-674c3a5cf53d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:47.901728 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-11b73b53-3134-4de5-ad62-af417aaeb292 req-e034195e-5ddc-47c5-9d25-674c3a5cf53d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:47.948841 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-11b73b53-3134-4de5-ad62-af417aaeb292 req-e034195e-5ddc-47c5-9d25-674c3a5cf53d service nova] Creating event network-vif-plugged:e89117b2-5b89-4cd2-bc23-8423fcc10e38 for instance 2c2503ba-46e2-4b06-9675-c4cb842783ca on n-h2-master-1 Aug 07 01:37:47.959660 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-11b73b53-3134-4de5-ad62-af417aaeb292 req-e034195e-5ddc-47c5-9d25-674c3a5cf53d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100845 Aug 07 01:37:47.960953 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2380/5216] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:37:47.989097 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ce3ffca8-c666-4879-842d-d4e7ebd734af tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:47.990773 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ce3ffca8-c666-4879-842d-d4e7ebd734af tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:47.998468 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce3ffca8-c666-4879-842d-d4e7ebd734af tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:47.999293 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce3ffca8-c666-4879-842d-d4e7ebd734af tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:47.999977 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce3ffca8-c666-4879-842d-d4e7ebd734af tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:48.000888 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce3ffca8-c666-4879-842d-d4e7ebd734af tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:48.001557 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce3ffca8-c666-4879-842d-d4e7ebd734af tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:48.002353 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce3ffca8-c666-4879-842d-d4e7ebd734af tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:48.790454 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ce3ffca8-c666-4879-842d-d4e7ebd734af tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:48.810404 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ce3ffca8-c666-4879-842d-d4e7ebd734af tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:48.818842 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ce3ffca8-c666-4879-842d-d4e7ebd734af tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:48.821150 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ce3ffca8-c666-4879-842d-d4e7ebd734af tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1741 microversion: 2.20 time: 0.845359 Aug 07 01:37:48.823130 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2381/5217] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:37:47 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1741 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:37:49.004797 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-34817b9c-f0e1-487f-b75c-771e181a5e5c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:49.012499 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:49.015090 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-34817b9c-f0e1-487f-b75c-771e181a5e5c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84" status: 200 len: 1679 microversion: 2.1 time: 1.314151 Aug 07 01:37:49.027309 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2837/5218] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:47 2022] GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84 => generated 1679 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:49.851982 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ab71be91-042e-4a8a-8a21-99b843f4e1f6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:49.854175 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ab71be91-042e-4a8a-8a21-99b843f4e1f6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:49.914120 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab71be91-042e-4a8a-8a21-99b843f4e1f6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:49.917911 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab71be91-042e-4a8a-8a21-99b843f4e1f6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:49.919767 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab71be91-042e-4a8a-8a21-99b843f4e1f6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:49.924043 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab71be91-042e-4a8a-8a21-99b843f4e1f6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:49.928076 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab71be91-042e-4a8a-8a21-99b843f4e1f6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:49.933097 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab71be91-042e-4a8a-8a21-99b843f4e1f6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:50.042215 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ddfd6338-6093-44d8-8b70-903cfefa6c8d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:50.043536 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ddfd6338-6093-44d8-8b70-903cfefa6c8d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 0658227f-88e6-40fd-bb8f-aa6267addc84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:50.072061 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddfd6338-6093-44d8-8b70-903cfefa6c8d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:50.074815 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddfd6338-6093-44d8-8b70-903cfefa6c8d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:50.075487 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddfd6338-6093-44d8-8b70-903cfefa6c8d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:50.076564 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddfd6338-6093-44d8-8b70-903cfefa6c8d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:50.082140 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddfd6338-6093-44d8-8b70-903cfefa6c8d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:50.082849 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddfd6338-6093-44d8-8b70-903cfefa6c8d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:50.569251 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ab71be91-042e-4a8a-8a21-99b843f4e1f6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:50.578809 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ab71be91-042e-4a8a-8a21-99b843f4e1f6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:50.588707 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ab71be91-042e-4a8a-8a21-99b843f4e1f6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:50.591223 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ab71be91-042e-4a8a-8a21-99b843f4e1f6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1741 microversion: 2.20 time: 0.748873 Aug 07 01:37:50.592251 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2382/5219] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:37:49 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1741 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:37:50.748266 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-5a0e8403-a3d5-4537-952a-9900444b2331 req-156ecca6-4b8d-4009-a9d2-27f0446f543d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0658227f-88e6-40fd-bb8f-aa6267addc84", "name": "network-vif-deleted", "tag": "7a3c38b5-4424-4a27-9219-94e88ef4a328"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:37:50.768961 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-5a0e8403-a3d5-4537-952a-9900444b2331 req-156ecca6-4b8d-4009-a9d2-27f0446f543d service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:50.769732 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-5a0e8403-a3d5-4537-952a-9900444b2331 req-156ecca6-4b8d-4009-a9d2-27f0446f543d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:50.771706 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-5a0e8403-a3d5-4537-952a-9900444b2331 req-156ecca6-4b8d-4009-a9d2-27f0446f543d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:50.784877 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-5a0e8403-a3d5-4537-952a-9900444b2331 req-156ecca6-4b8d-4009-a9d2-27f0446f543d service nova] Creating event network-vif-deleted:7a3c38b5-4424-4a27-9219-94e88ef4a328 for instance 0658227f-88e6-40fd-bb8f-aa6267addc84 on n-h1-master-1 Aug 07 01:37:50.788239 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ddfd6338-6093-44d8-8b70-903cfefa6c8d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:50.796939 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ddfd6338-6093-44d8-8b70-903cfefa6c8d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84" status: 200 len: 1612 microversion: 2.1 time: 0.759947 Aug 07 01:37:50.801215 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2838/5220] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:50 2022] GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84 => generated 1612 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:50.804858 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-5a0e8403-a3d5-4537-952a-9900444b2331 req-156ecca6-4b8d-4009-a9d2-27f0446f543d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064443 Aug 07 01:37:50.809677 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2383/5221] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:37:51.619620 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-07d4f5a1-e07a-4977-95d1-240a16e24942 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:51.620472 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-07d4f5a1-e07a-4977-95d1-240a16e24942 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:51.640181 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-07d4f5a1-e07a-4977-95d1-240a16e24942 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:51.643537 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-07d4f5a1-e07a-4977-95d1-240a16e24942 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:51.644773 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-07d4f5a1-e07a-4977-95d1-240a16e24942 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:51.655137 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-07d4f5a1-e07a-4977-95d1-240a16e24942 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:51.656876 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-07d4f5a1-e07a-4977-95d1-240a16e24942 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:51.657603 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-07d4f5a1-e07a-4977-95d1-240a16e24942 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:51.826740 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-774a1efb-8e17-476e-8f7f-429d271feb89 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:51.828983 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-774a1efb-8e17-476e-8f7f-429d271feb89 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 0658227f-88e6-40fd-bb8f-aa6267addc84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:51.848268 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-774a1efb-8e17-476e-8f7f-429d271feb89 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:51.853245 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-774a1efb-8e17-476e-8f7f-429d271feb89 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:51.855332 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-774a1efb-8e17-476e-8f7f-429d271feb89 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:51.857771 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-774a1efb-8e17-476e-8f7f-429d271feb89 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:51.859452 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-774a1efb-8e17-476e-8f7f-429d271feb89 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:51.861686 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-774a1efb-8e17-476e-8f7f-429d271feb89 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:51.963472 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-774a1efb-8e17-476e-8f7f-429d271feb89 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] HTTP exception thrown: Instance 0658227f-88e6-40fd-bb8f-aa6267addc84 could not be found. Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-774a1efb-8e17-476e-8f7f-429d271feb89 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Request method failure captured: Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84 HTTP/1.1 Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xZDq6RH3D4bnr1UijP-nk3uo95NJjh7SbfPDqAVgj126rgmdcLbKlTvq4r9AHLnAVbqooFNQ3b97yry4NtGcTnZJETXBytnxiV1irP15oNSC1nhov4fsRvKuKlTNLjRN8RkNUdoouf8PCfkhvGYmSqoJN36Q7GHr7rf2nNkd41nqV4 Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: b630a4c3bb824b90b4c1898a92b47aa7 Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b630a4c3bb824b90b4c1898a92b47aa7", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: b630a4c3bb824b90b4c1898a92b47aa7 Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-AttachVolumeNegativeTest-1422960247-project Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d556a8ae0d524894a93203ce3f70d420 Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-AttachVolumeNegativeTest-1422960247-project Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 0658227f-88e6-40fd-bb8f-aa6267addc84 could not be found. Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '0658227f-88e6-40fd-bb8f-aa6267addc84'} Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0658227f-88e6-40fd-bb8f-aa6267addc84 could not be found. Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0658227f-88e6-40fd-bb8f-aa6267addc84 could not be found. Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:37:51.965753 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:37:51.971280 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:37:51.971280 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:37:51.971280 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:37:51.971280 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:37:51.971280 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:37:51.971280 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0658227f-88e6-40fd-bb8f-aa6267addc84 could not be found. Aug 07 01:37:51.971280 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:37:51.973263 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-774a1efb-8e17-476e-8f7f-429d271feb89 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Returning 404 to user: Instance 0658227f-88e6-40fd-bb8f-aa6267addc84 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:37:51.977117 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-774a1efb-8e17-476e-8f7f-429d271feb89 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84" status: 404 len: 111 microversion: 2.1 time: 0.156634 Aug 07 01:37:51.983101 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2384/5222] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:51 2022] GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:37:52.569657 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-63812cdf-3dcd-4bed-b794-e1ba406560c5 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '.version_select at 0x7f9e245d94c0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:52.643530 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-63812cdf-3dcd-4bed-b794-e1ba406560c5 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-521865895" status: 202 len: 0 microversion: 2.1 time: 0.655245 Aug 07 01:37:52.655359 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2385/5223] 10.222.0.39 () {58 vars in 1218 bytes} [Sun Aug 7 01:37:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-521865895 => generated 0 bytes in 665 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:37:52.915690 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-07d4f5a1-e07a-4977-95d1-240a16e24942 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:52.934797 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-07d4f5a1-e07a-4977-95d1-240a16e24942 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:52.963050 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-07d4f5a1-e07a-4977-95d1-240a16e24942 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:52.966342 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-07d4f5a1-e07a-4977-95d1-240a16e24942 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1741 microversion: 2.20 time: 1.351883 Aug 07 01:37:52.989204 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2839/5224] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:37:51 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1741 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:37:53.362310 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fd5cf137-2b4c-4b87-b343-7bb6368ac17b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-314867638", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c0b29de8-90e5-40f4-96e9-6f7364b06446"}], "security_groups": [{"name": "tempest-securitygroup--1356056652"}], "key_name": "tempest-keypair-1175283255", "user_data": "}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:37:53.995148 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f129550b-018f-4235-b417-8f5c83c534cc tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:53.995766 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f129550b-018f-4235-b417-8f5c83c534cc tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:54.006568 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f129550b-018f-4235-b417-8f5c83c534cc tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:54.007572 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f129550b-018f-4235-b417-8f5c83c534cc tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:54.008623 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f129550b-018f-4235-b417-8f5c83c534cc tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:54.009771 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f129550b-018f-4235-b417-8f5c83c534cc tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:54.010395 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f129550b-018f-4235-b417-8f5c83c534cc tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:54.011749 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f129550b-018f-4235-b417-8f5c83c534cc tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:54.375244 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-fd5cf137-2b4c-4b87-b343-7bb6368ac17b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] validate_networks() for [('c0b29de8-90e5-40f4-96e9-6f7364b06446', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:37:54.535595 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f129550b-018f-4235-b417-8f5c83c534cc tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:54.547637 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f129550b-018f-4235-b417-8f5c83c534cc tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:54.549183 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f129550b-018f-4235-b417-8f5c83c534cc tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:54.550395 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f129550b-018f-4235-b417-8f5c83c534cc tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1741 microversion: 2.20 time: 0.559269 Aug 07 01:37:54.556042 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2840/5225] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:37:53 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1741 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:37:55.574208 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c8de2ecb-b830-4848-ad10-82a6354d2054 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:55.574992 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c8de2ecb-b830-4848-ad10-82a6354d2054 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:55.577188 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=4 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:55.591412 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c8de2ecb-b830-4848-ad10-82a6354d2054 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:55.594121 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c8de2ecb-b830-4848-ad10-82a6354d2054 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:55.596732 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c8de2ecb-b830-4848-ad10-82a6354d2054 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:55.599932 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c8de2ecb-b830-4848-ad10-82a6354d2054 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:55.600731 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c8de2ecb-b830-4848-ad10-82a6354d2054 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:55.603442 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c8de2ecb-b830-4848-ad10-82a6354d2054 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:56.411014 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c8de2ecb-b830-4848-ad10-82a6354d2054 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:56.428038 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c8de2ecb-b830-4848-ad10-82a6354d2054 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:56.430275 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c8de2ecb-b830-4848-ad10-82a6354d2054 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:56.431495 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c8de2ecb-b830-4848-ad10-82a6354d2054 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1741 microversion: 2.20 time: 0.861886 Aug 07 01:37:56.432247 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2841/5226] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:37:55 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1741 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:37:56.446744 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-506c2682-9658-41fc-aaa1-808d78a7c148 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Action: 'create', calling method: .version_select at 0x7f9e170d0280>, body: {"keypair": {"name": "tempest-keypair-1065281610", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAA56dgTDbfwKbaMjd8AgBnMcAjBgYa6VCVWesJzE2speatv95VKYIcSEagAMeTno/McLeJwZ3uso4p0xg2/r6nsB1uhcmikDgKL4wg14LtD2dsCdYgbryE/vRIKrEKUgg=="}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:37:56.477284 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-506c2682-9658-41fc-aaa1-808d78a7c148 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Getting quotas for project b630a4c3bb824b90b4c1898a92b47aa7. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:37:56.485174 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-506c2682-9658-41fc-aaa1-808d78a7c148 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Getting quotas for user d556a8ae0d524894a93203ce3f70d420 and project b630a4c3bb824b90b4c1898a92b47aa7. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:37:56.529405 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-506c2682-9658-41fc-aaa1-808d78a7c148 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.095461 Aug 07 01:37:56.530062 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2842/5227] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:37:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:37:56.758959 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-fd5cf137-2b4c-4b87-b343-7bb6368ac17b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:37:56.759578 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-fd5cf137-2b4c-4b87-b343-7bb6368ac17b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:37:56.760378 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-fd5cf137-2b4c-4b87-b343-7bb6368ac17b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:37:56.761180 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-fd5cf137-2b4c-4b87-b343-7bb6368ac17b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:37:56.762043 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-fd5cf137-2b4c-4b87-b343-7bb6368ac17b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:37:56.797566 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd5cf137-2b4c-4b87-b343-7bb6368ac17b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:56.804078 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd5cf137-2b4c-4b87-b343-7bb6368ac17b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:56.804569 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd5cf137-2b4c-4b87-b343-7bb6368ac17b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:56.805408 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd5cf137-2b4c-4b87-b343-7bb6368ac17b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:56.805888 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd5cf137-2b4c-4b87-b343-7bb6368ac17b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:56.811605 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd5cf137-2b4c-4b87-b343-7bb6368ac17b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:56.891441 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-fd5cf137-2b4c-4b87-b343-7bb6368ac17b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Getting quotas for project 70f17360f0c84562bd99b006b659736e. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:37:56.914186 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-fd5cf137-2b4c-4b87-b343-7bb6368ac17b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Getting quotas for user 2f5acf7da18b43f89e24760744cfdb49 and project 70f17360f0c84562bd99b006b659736e. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:37:56.984849 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fd5cf137-2b4c-4b87-b343-7bb6368ac17b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:37:56.988027 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fd5cf137-2b4c-4b87-b343-7bb6368ac17b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:37:57.095390 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fd5cf137-2b4c-4b87-b343-7bb6368ac17b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.744380 Aug 07 01:37:57.102835 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2386/5228] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:37:53 2022] POST /compute/v2.1/servers => generated 409 bytes in 3752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:37:57.109832 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-954f44a7-34d4-48da-8f3d-93d5e1f4aa62 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:57.111171 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-954f44a7-34d4-48da-8f3d-93d5e1f4aa62 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:57.209230 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-954f44a7-34d4-48da-8f3d-93d5e1f4aa62 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:57.217473 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-954f44a7-34d4-48da-8f3d-93d5e1f4aa62 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1245 microversion: 2.1 time: 0.112718 Aug 07 01:37:57.221085 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2843/5229] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:57 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1245 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:57.458729 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a098ad27-71bc-4ad8-ad55-4e7a937ca69c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:57.459768 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a098ad27-71bc-4ad8-ad55-4e7a937ca69c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:57.482256 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a098ad27-71bc-4ad8-ad55-4e7a937ca69c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:57.487586 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a098ad27-71bc-4ad8-ad55-4e7a937ca69c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:57.489879 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a098ad27-71bc-4ad8-ad55-4e7a937ca69c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:57.491695 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a098ad27-71bc-4ad8-ad55-4e7a937ca69c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:57.495540 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a098ad27-71bc-4ad8-ad55-4e7a937ca69c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:57.498742 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a098ad27-71bc-4ad8-ad55-4e7a937ca69c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:58.048202 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a098ad27-71bc-4ad8-ad55-4e7a937ca69c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:58.066481 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a098ad27-71bc-4ad8-ad55-4e7a937ca69c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:58.074755 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a098ad27-71bc-4ad8-ad55-4e7a937ca69c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:58.078486 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a098ad27-71bc-4ad8-ad55-4e7a937ca69c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1741 microversion: 2.20 time: 0.623495 Aug 07 01:37:58.081442 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2387/5230] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:37:57 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1741 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:37:58.242357 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6579da9d-e3ca-4da5-b2b0-edb69c4d0769 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:58.243295 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6579da9d-e3ca-4da5-b2b0-edb69c4d0769 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:58.258800 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6579da9d-e3ca-4da5-b2b0-edb69c4d0769 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:58.259473 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6579da9d-e3ca-4da5-b2b0-edb69c4d0769 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:58.260217 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6579da9d-e3ca-4da5-b2b0-edb69c4d0769 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:58.261506 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6579da9d-e3ca-4da5-b2b0-edb69c4d0769 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:58.262088 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6579da9d-e3ca-4da5-b2b0-edb69c4d0769 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:58.262633 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6579da9d-e3ca-4da5-b2b0-edb69c4d0769 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:58.429985 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6579da9d-e3ca-4da5-b2b0-edb69c4d0769 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:58.444436 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6579da9d-e3ca-4da5-b2b0-edb69c4d0769 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1249 microversion: 2.1 time: 0.207057 Aug 07 01:37:58.447751 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2844/5231] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:58 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1249 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:37:59.108414 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e2838b40-a556-44d8-a0b9-bdb4b13eeaf6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:59.109199 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e2838b40-a556-44d8-a0b9-bdb4b13eeaf6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:59.125995 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:59.128163 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e2838b40-a556-44d8-a0b9-bdb4b13eeaf6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:59.130369 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e2838b40-a556-44d8-a0b9-bdb4b13eeaf6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:59.132605 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e2838b40-a556-44d8-a0b9-bdb4b13eeaf6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:59.136228 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e2838b40-a556-44d8-a0b9-bdb4b13eeaf6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:59.137183 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e2838b40-a556-44d8-a0b9-bdb4b13eeaf6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:59.140352 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e2838b40-a556-44d8-a0b9-bdb4b13eeaf6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:59.469896 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ce3501db-4d9a-45f3-b981-bf1029be36d9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:37:59.470516 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ce3501db-4d9a-45f3-b981-bf1029be36d9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:37:59.487183 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce3501db-4d9a-45f3-b981-bf1029be36d9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:59.487726 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce3501db-4d9a-45f3-b981-bf1029be36d9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:59.488130 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce3501db-4d9a-45f3-b981-bf1029be36d9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:59.488850 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce3501db-4d9a-45f3-b981-bf1029be36d9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:37:59.496171 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce3501db-4d9a-45f3-b981-bf1029be36d9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:37:59.496671 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce3501db-4d9a-45f3-b981-bf1029be36d9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:37:59.789764 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ce3501db-4d9a-45f3-b981-bf1029be36d9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:37:59.809722 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ce3501db-4d9a-45f3-b981-bf1029be36d9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1315 microversion: 2.1 time: 0.333289 Aug 07 01:37:59.816662 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2845/5232] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:37:59 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:38:00.835246 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-18328ace-0a31-4691-9c3a-bfd8c7bf8273 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:00.836085 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-18328ace-0a31-4691-9c3a-bfd8c7bf8273 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:00.846486 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-18328ace-0a31-4691-9c3a-bfd8c7bf8273 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:00.846979 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-18328ace-0a31-4691-9c3a-bfd8c7bf8273 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:00.847414 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-18328ace-0a31-4691-9c3a-bfd8c7bf8273 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:00.860853 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-18328ace-0a31-4691-9c3a-bfd8c7bf8273 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:00.861444 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-18328ace-0a31-4691-9c3a-bfd8c7bf8273 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:00.861928 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-18328ace-0a31-4691-9c3a-bfd8c7bf8273 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:01.073540 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-18328ace-0a31-4691-9c3a-bfd8c7bf8273 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:01.099360 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-18328ace-0a31-4691-9c3a-bfd8c7bf8273 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1303 microversion: 2.1 time: 0.265534 Aug 07 01:38:01.104082 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2846/5233] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:00 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1303 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:38:01.284071 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e2838b40-a556-44d8-a0b9-bdb4b13eeaf6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:01.310212 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e2838b40-a556-44d8-a0b9-bdb4b13eeaf6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:01.320663 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e2838b40-a556-44d8-a0b9-bdb4b13eeaf6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:01.321904 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e2838b40-a556-44d8-a0b9-bdb4b13eeaf6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1741 microversion: 2.20 time: 2.219142 Aug 07 01:38:01.322463 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2388/5234] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:37:59 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1741 bytes in 2220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:38:02.129009 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e5ac7dc3-b315-4242-8290-f6263c1b8603 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:02.130259 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e5ac7dc3-b315-4242-8290-f6263c1b8603 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:02.140177 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5ac7dc3-b315-4242-8290-f6263c1b8603 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:02.142212 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5ac7dc3-b315-4242-8290-f6263c1b8603 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:02.143748 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5ac7dc3-b315-4242-8290-f6263c1b8603 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:02.145426 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5ac7dc3-b315-4242-8290-f6263c1b8603 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:02.146183 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5ac7dc3-b315-4242-8290-f6263c1b8603 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:02.147537 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5ac7dc3-b315-4242-8290-f6263c1b8603 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:02.348698 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b5631b6d-e975-4a52-8a81-8bce473a0ff4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:02.349513 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b5631b6d-e975-4a52-8a81-8bce473a0ff4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:02.357505 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e5ac7dc3-b315-4242-8290-f6263c1b8603 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:02.380601 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e5ac7dc3-b315-4242-8290-f6263c1b8603 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1303 microversion: 2.1 time: 0.257285 Aug 07 01:38:02.380871 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5631b6d-e975-4a52-8a81-8bce473a0ff4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:02.382103 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5631b6d-e975-4a52-8a81-8bce473a0ff4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:02.382668 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5631b6d-e975-4a52-8a81-8bce473a0ff4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:02.383514 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5631b6d-e975-4a52-8a81-8bce473a0ff4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:02.384156 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2847/5235] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:02 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1303 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:38:02.387221 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5631b6d-e975-4a52-8a81-8bce473a0ff4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:02.388999 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5631b6d-e975-4a52-8a81-8bce473a0ff4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:02.956244 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b5631b6d-e975-4a52-8a81-8bce473a0ff4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:02.966421 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b5631b6d-e975-4a52-8a81-8bce473a0ff4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:02.980945 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b5631b6d-e975-4a52-8a81-8bce473a0ff4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:02.987831 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b5631b6d-e975-4a52-8a81-8bce473a0ff4 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1741 microversion: 2.20 time: 0.644288 Aug 07 01:38:02.990091 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2389/5236] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:38:02 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1741 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:38:03.404642 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-08d3ed4c-ea6c-4369-939e-6f149a799148 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:03.406281 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-08d3ed4c-ea6c-4369-939e-6f149a799148 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:03.424831 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08d3ed4c-ea6c-4369-939e-6f149a799148 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:03.429984 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08d3ed4c-ea6c-4369-939e-6f149a799148 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:03.432072 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08d3ed4c-ea6c-4369-939e-6f149a799148 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:03.434334 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08d3ed4c-ea6c-4369-939e-6f149a799148 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:03.434865 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08d3ed4c-ea6c-4369-939e-6f149a799148 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:03.438729 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08d3ed4c-ea6c-4369-939e-6f149a799148 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:04.009521 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-08d3ed4c-ea6c-4369-939e-6f149a799148 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:04.021529 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-08d3ed4c-ea6c-4369-939e-6f149a799148 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1371 microversion: 2.1 time: 0.622635 Aug 07 01:38:04.030113 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2848/5237] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:03 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1371 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:38:04.054027 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a0e18acf-5ea6-4943-bd4f-e50d898d59ca tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:04.055457 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a0e18acf-5ea6-4943-bd4f-e50d898d59ca tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:04.074744 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a0e18acf-5ea6-4943-bd4f-e50d898d59ca tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:04.078114 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a0e18acf-5ea6-4943-bd4f-e50d898d59ca tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:04.078917 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a0e18acf-5ea6-4943-bd4f-e50d898d59ca tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:04.082636 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a0e18acf-5ea6-4943-bd4f-e50d898d59ca tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:04.083748 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a0e18acf-5ea6-4943-bd4f-e50d898d59ca tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:04.084575 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a0e18acf-5ea6-4943-bd4f-e50d898d59ca tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:05.054927 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-584514ea-bc4d-4a7c-b785-5aaf5db5e6ea tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:05.055547 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-584514ea-bc4d-4a7c-b785-5aaf5db5e6ea tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:05.063725 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-584514ea-bc4d-4a7c-b785-5aaf5db5e6ea tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:05.064238 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-584514ea-bc4d-4a7c-b785-5aaf5db5e6ea tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:05.064670 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-584514ea-bc4d-4a7c-b785-5aaf5db5e6ea tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:05.065383 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-584514ea-bc4d-4a7c-b785-5aaf5db5e6ea tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:05.065836 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-584514ea-bc4d-4a7c-b785-5aaf5db5e6ea tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:05.076324 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-584514ea-bc4d-4a7c-b785-5aaf5db5e6ea tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:05.082058 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a0e18acf-5ea6-4943-bd4f-e50d898d59ca tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:05.112820 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a0e18acf-5ea6-4943-bd4f-e50d898d59ca tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:05.114355 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a0e18acf-5ea6-4943-bd4f-e50d898d59ca tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:05.123367 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a0e18acf-5ea6-4943-bd4f-e50d898d59ca tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1741 microversion: 2.20 time: 1.075628 Aug 07 01:38:05.145192 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2390/5238] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:38:04 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1741 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:38:05.659377 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-584514ea-bc4d-4a7c-b785-5aaf5db5e6ea tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:05.668457 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-584514ea-bc4d-4a7c-b785-5aaf5db5e6ea tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1371 microversion: 2.1 time: 0.618680 Aug 07 01:38:05.677799 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2849/5239] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:05 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1371 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:38:06.150865 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1585f3f9-2854-4015-b5a7-ca6e6d951d63 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:06.151564 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1585f3f9-2854-4015-b5a7-ca6e6d951d63 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:06.169082 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1585f3f9-2854-4015-b5a7-ca6e6d951d63 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:06.169579 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1585f3f9-2854-4015-b5a7-ca6e6d951d63 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:06.170011 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1585f3f9-2854-4015-b5a7-ca6e6d951d63 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:06.179466 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1585f3f9-2854-4015-b5a7-ca6e6d951d63 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:06.182237 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1585f3f9-2854-4015-b5a7-ca6e6d951d63 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:06.182771 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1585f3f9-2854-4015-b5a7-ca6e6d951d63 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:06.236516 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:06.383850 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-52f7d562-9603-46ff-84ee-9c0a6973e1cd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1302723338", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "16f1e04e-f3dd-4247-8125-839e2140524d"}], "security_groups": [{"name": "tempest-securitygroup--387901449"}], "key_name": "tempest-keypair-1065281610", "user_data": "}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:38:06.627604 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-52f7d562-9603-46ff-84ee-9c0a6973e1cd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] validate_networks() for [('16f1e04e-f3dd-4247-8125-839e2140524d', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:38:06.836521 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:06.946731 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:07.213797 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:07.318165 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1585f3f9-2854-4015-b5a7-ca6e6d951d63 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:07.342413 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1585f3f9-2854-4015-b5a7-ca6e6d951d63 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:07.348736 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1585f3f9-2854-4015-b5a7-ca6e6d951d63 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:07.352078 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1585f3f9-2854-4015-b5a7-ca6e6d951d63 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1741 microversion: 2.20 time: 1.205731 Aug 07 01:38:07.370563 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2391/5240] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:38:06 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1741 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:38:07.406764 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b06b181f-746b-4548-8a6e-bb03523658db tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:07.408226 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b06b181f-746b-4548-8a6e-bb03523658db tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:07.428731 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b06b181f-746b-4548-8a6e-bb03523658db tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:07.429520 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b06b181f-746b-4548-8a6e-bb03523658db tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:07.432272 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b06b181f-746b-4548-8a6e-bb03523658db tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:07.433357 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b06b181f-746b-4548-8a6e-bb03523658db tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:07.434443 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b06b181f-746b-4548-8a6e-bb03523658db tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:07.436679 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b06b181f-746b-4548-8a6e-bb03523658db tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:08.225837 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-52f7d562-9603-46ff-84ee-9c0a6973e1cd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:38:08.226409 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-52f7d562-9603-46ff-84ee-9c0a6973e1cd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:38:08.226765 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-52f7d562-9603-46ff-84ee-9c0a6973e1cd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:38:08.227378 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-52f7d562-9603-46ff-84ee-9c0a6973e1cd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:38:08.228061 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-52f7d562-9603-46ff-84ee-9c0a6973e1cd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:38:08.245671 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52f7d562-9603-46ff-84ee-9c0a6973e1cd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:08.248807 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52f7d562-9603-46ff-84ee-9c0a6973e1cd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:08.251135 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52f7d562-9603-46ff-84ee-9c0a6973e1cd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:08.253494 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52f7d562-9603-46ff-84ee-9c0a6973e1cd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:08.254138 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52f7d562-9603-46ff-84ee-9c0a6973e1cd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:08.257086 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52f7d562-9603-46ff-84ee-9c0a6973e1cd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:08.303099 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-52f7d562-9603-46ff-84ee-9c0a6973e1cd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Getting quotas for project b630a4c3bb824b90b4c1898a92b47aa7. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:38:08.312875 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-52f7d562-9603-46ff-84ee-9c0a6973e1cd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Getting quotas for user d556a8ae0d524894a93203ce3f70d420 and project b630a4c3bb824b90b4c1898a92b47aa7. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:38:08.335683 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-52f7d562-9603-46ff-84ee-9c0a6973e1cd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:38:08.340787 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-52f7d562-9603-46ff-84ee-9c0a6973e1cd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:38:08.418612 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-52f7d562-9603-46ff-84ee-9c0a6973e1cd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.039578 Aug 07 01:38:08.420725 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2850/5241] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:38:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 2042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 07 01:38:08.426943 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b06b181f-746b-4548-8a6e-bb03523658db tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:08.439686 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b06b181f-746b-4548-8a6e-bb03523658db tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1371 microversion: 2.1 time: 1.067187 Aug 07 01:38:08.455486 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-17ed8570-6b4a-4ddb-be6d-09e0b435e11e req-e41429fc-4ecc-40b4-a7e2-58e7ada07a4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d91eb969-4da0-4789-a33c-73a27d5cef97", "tag": "561b9998-3694-4cb6-8ce2-0630e19b986b"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:38:08.457301 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2392/5242] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:07 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1371 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:38:08.463871 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2954661d-b8ce-4903-843c-5af36f2c54fa tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:08.465062 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2954661d-b8ce-4903-843c-5af36f2c54fa tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:08.471792 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-17ed8570-6b4a-4ddb-be6d-09e0b435e11e req-e41429fc-4ecc-40b4-a7e2-58e7ada07a4d service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:08.472527 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-17ed8570-6b4a-4ddb-be6d-09e0b435e11e req-e41429fc-4ecc-40b4-a7e2-58e7ada07a4d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:08.473294 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-17ed8570-6b4a-4ddb-be6d-09e0b435e11e req-e41429fc-4ecc-40b4-a7e2-58e7ada07a4d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:08.476708 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2954661d-b8ce-4903-843c-5af36f2c54fa tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:08.477766 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2954661d-b8ce-4903-843c-5af36f2c54fa tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:08.478676 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2954661d-b8ce-4903-843c-5af36f2c54fa tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:08.479670 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2954661d-b8ce-4903-843c-5af36f2c54fa tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:08.480520 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2954661d-b8ce-4903-843c-5af36f2c54fa tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:08.482350 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2954661d-b8ce-4903-843c-5af36f2c54fa tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:08.489129 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-17ed8570-6b4a-4ddb-be6d-09e0b435e11e req-e41429fc-4ecc-40b4-a7e2-58e7ada07a4d service nova] Creating event network-changed:561b9998-3694-4cb6-8ce2-0630e19b986b for instance d91eb969-4da0-4789-a33c-73a27d5cef97 on n-h1-master-1 Aug 07 01:38:08.494707 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-17ed8570-6b4a-4ddb-be6d-09e0b435e11e req-e41429fc-4ecc-40b4-a7e2-58e7ada07a4d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050522 Aug 07 01:38:08.496732 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2851/5243] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:38:08.502610 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-33e34de1-14aa-44ad-8ad8-f0274af7bd14 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:08.503878 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-33e34de1-14aa-44ad-8ad8-f0274af7bd14 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:08.629569 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-33e34de1-14aa-44ad-8ad8-f0274af7bd14 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:08.644410 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-33e34de1-14aa-44ad-8ad8-f0274af7bd14 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9" status: 200 len: 1242 microversion: 2.1 time: 0.142349 Aug 07 01:38:08.659947 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2852/5244] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:08 2022] GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9 => generated 1242 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:38:09.472564 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9e8c66ec-dc7b-478a-8e3b-13970724867b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:09.473281 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9e8c66ec-dc7b-478a-8e3b-13970724867b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:09.496686 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e8c66ec-dc7b-478a-8e3b-13970724867b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:09.497305 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e8c66ec-dc7b-478a-8e3b-13970724867b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:09.497824 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e8c66ec-dc7b-478a-8e3b-13970724867b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:09.499521 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e8c66ec-dc7b-478a-8e3b-13970724867b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:09.502436 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e8c66ec-dc7b-478a-8e3b-13970724867b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:09.502976 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e8c66ec-dc7b-478a-8e3b-13970724867b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:09.678013 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2954661d-b8ce-4903-843c-5af36f2c54fa tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:09.707768 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2954661d-b8ce-4903-843c-5af36f2c54fa tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:09.713115 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2954661d-b8ce-4903-843c-5af36f2c54fa tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:09.716841 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2954661d-b8ce-4903-843c-5af36f2c54fa tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1741 microversion: 2.20 time: 1.258303 Aug 07 01:38:09.721105 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2393/5245] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:38:08 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1741 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:38:09.734426 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0cca27f0-80ee-4474-947a-e4591c7ad5ad tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:09.738601 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0cca27f0-80ee-4474-947a-e4591c7ad5ad tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:09.756004 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0cca27f0-80ee-4474-947a-e4591c7ad5ad tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:09.758876 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0cca27f0-80ee-4474-947a-e4591c7ad5ad tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:09.759508 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0cca27f0-80ee-4474-947a-e4591c7ad5ad tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:09.763009 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0cca27f0-80ee-4474-947a-e4591c7ad5ad tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:09.765641 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0cca27f0-80ee-4474-947a-e4591c7ad5ad tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:09.766247 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0cca27f0-80ee-4474-947a-e4591c7ad5ad tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:10.012079 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0cca27f0-80ee-4474-947a-e4591c7ad5ad tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:10.026729 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0cca27f0-80ee-4474-947a-e4591c7ad5ad tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9" status: 200 len: 1238 microversion: 2.1 time: 0.304015 Aug 07 01:38:10.033618 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2394/5246] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:09 2022] GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9 => generated 1238 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:38:10.350264 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9e8c66ec-dc7b-478a-8e3b-13970724867b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:10.364653 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9e8c66ec-dc7b-478a-8e3b-13970724867b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1371 microversion: 2.1 time: 0.898306 Aug 07 01:38:10.365586 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2853/5247] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:09 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1371 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:38:10.746477 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f4218fb1-274c-4769-acc7-3ea90ee8f287 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:10.748108 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f4218fb1-274c-4769-acc7-3ea90ee8f287 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:10.770236 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4218fb1-274c-4769-acc7-3ea90ee8f287 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:10.771293 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4218fb1-274c-4769-acc7-3ea90ee8f287 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:10.771984 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4218fb1-274c-4769-acc7-3ea90ee8f287 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:10.773480 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4218fb1-274c-4769-acc7-3ea90ee8f287 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:10.774194 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4218fb1-274c-4769-acc7-3ea90ee8f287 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:10.774852 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4218fb1-274c-4769-acc7-3ea90ee8f287 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:11.053100 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3ec90cc6-a290-44fd-8f9f-af1057b42acf tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:11.053718 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3ec90cc6-a290-44fd-8f9f-af1057b42acf tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:11.071970 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ec90cc6-a290-44fd-8f9f-af1057b42acf tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:11.072473 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ec90cc6-a290-44fd-8f9f-af1057b42acf tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:11.072914 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ec90cc6-a290-44fd-8f9f-af1057b42acf tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:11.073633 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ec90cc6-a290-44fd-8f9f-af1057b42acf tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:11.074082 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ec90cc6-a290-44fd-8f9f-af1057b42acf tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:11.074507 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ec90cc6-a290-44fd-8f9f-af1057b42acf tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:11.235853 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3ec90cc6-a290-44fd-8f9f-af1057b42acf tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:11.250276 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3ec90cc6-a290-44fd-8f9f-af1057b42acf tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9" status: 200 len: 1312 microversion: 2.1 time: 0.200546 Aug 07 01:38:11.268239 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2854/5248] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:11 2022] GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9 => generated 1312 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:38:11.325156 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f4218fb1-274c-4769-acc7-3ea90ee8f287 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:11.338206 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f4218fb1-274c-4769-acc7-3ea90ee8f287 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:11.340164 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f4218fb1-274c-4769-acc7-3ea90ee8f287 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:11.343425 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f4218fb1-274c-4769-acc7-3ea90ee8f287 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1741 microversion: 2.20 time: 0.601544 Aug 07 01:38:11.346035 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2395/5249] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:38:10 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1741 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:38:11.386453 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-13acaa3b-80af-4f4b-af9b-8cae0de0153d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:11.387184 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-13acaa3b-80af-4f4b-af9b-8cae0de0153d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:11.394143 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-13acaa3b-80af-4f4b-af9b-8cae0de0153d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:11.394645 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-13acaa3b-80af-4f4b-af9b-8cae0de0153d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:11.395093 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-13acaa3b-80af-4f4b-af9b-8cae0de0153d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:11.395806 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-13acaa3b-80af-4f4b-af9b-8cae0de0153d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:11.396479 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-13acaa3b-80af-4f4b-af9b-8cae0de0153d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:11.397095 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-13acaa3b-80af-4f4b-af9b-8cae0de0153d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:12.111013 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-13acaa3b-80af-4f4b-af9b-8cae0de0153d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:12.134757 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-13acaa3b-80af-4f4b-af9b-8cae0de0153d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1371 microversion: 2.1 time: 0.749466 Aug 07 01:38:12.140683 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2855/5250] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:11 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1371 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:38:12.276467 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7b45e2c3-770c-442b-986f-98361667353b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:12.277790 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7b45e2c3-770c-442b-986f-98361667353b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:12.294729 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b45e2c3-770c-442b-986f-98361667353b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:12.295764 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b45e2c3-770c-442b-986f-98361667353b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:12.296246 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b45e2c3-770c-442b-986f-98361667353b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:12.296964 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b45e2c3-770c-442b-986f-98361667353b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:12.297415 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b45e2c3-770c-442b-986f-98361667353b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:12.297838 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b45e2c3-770c-442b-986f-98361667353b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:12.370165 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-43470114-9c71-441b-82ae-ee727382dda2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:12.371237 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-43470114-9c71-441b-82ae-ee727382dda2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:12.382169 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43470114-9c71-441b-82ae-ee727382dda2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:12.383436 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43470114-9c71-441b-82ae-ee727382dda2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:12.384878 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43470114-9c71-441b-82ae-ee727382dda2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:12.385559 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43470114-9c71-441b-82ae-ee727382dda2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:12.386027 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43470114-9c71-441b-82ae-ee727382dda2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:12.386463 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43470114-9c71-441b-82ae-ee727382dda2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:12.513718 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7b45e2c3-770c-442b-986f-98361667353b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:12.521908 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7b45e2c3-770c-442b-986f-98361667353b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9" status: 200 len: 1300 microversion: 2.1 time: 0.249795 Aug 07 01:38:12.532332 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2396/5251] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:12 2022] GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9 => generated 1300 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:38:12.943864 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-43470114-9c71-441b-82ae-ee727382dda2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:12.958444 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-43470114-9c71-441b-82ae-ee727382dda2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:13.002210 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-43470114-9c71-441b-82ae-ee727382dda2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:13.009306 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-43470114-9c71-441b-82ae-ee727382dda2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1723 microversion: 2.20 time: 0.641479 Aug 07 01:38:13.010085 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2856/5252] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:38:12 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1723 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:38:13.162756 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-991b6608-986c-4c22-97e4-b0d2aa60213d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:13.163602 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-991b6608-986c-4c22-97e4-b0d2aa60213d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:13.175731 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-991b6608-986c-4c22-97e4-b0d2aa60213d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:13.176573 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-991b6608-986c-4c22-97e4-b0d2aa60213d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:13.177194 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-991b6608-986c-4c22-97e4-b0d2aa60213d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:13.178092 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-991b6608-986c-4c22-97e4-b0d2aa60213d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:13.178734 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-991b6608-986c-4c22-97e4-b0d2aa60213d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:13.179341 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-991b6608-986c-4c22-97e4-b0d2aa60213d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:13.547410 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1f989fb8-55b5-4edd-87e3-6c48c81de914 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:13.548792 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1f989fb8-55b5-4edd-87e3-6c48c81de914 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:13.561504 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f989fb8-55b5-4edd-87e3-6c48c81de914 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:13.562637 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f989fb8-55b5-4edd-87e3-6c48c81de914 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:13.564745 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f989fb8-55b5-4edd-87e3-6c48c81de914 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:13.566801 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f989fb8-55b5-4edd-87e3-6c48c81de914 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:13.567342 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f989fb8-55b5-4edd-87e3-6c48c81de914 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:13.568189 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f989fb8-55b5-4edd-87e3-6c48c81de914 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:13.786602 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1f989fb8-55b5-4edd-87e3-6c48c81de914 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:13.800672 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1f989fb8-55b5-4edd-87e3-6c48c81de914 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9" status: 200 len: 1300 microversion: 2.1 time: 0.258574 Aug 07 01:38:13.803320 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2857/5253] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:13 2022] GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9 => generated 1300 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:38:13.867746 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-991b6608-986c-4c22-97e4-b0d2aa60213d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:13.880665 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-991b6608-986c-4c22-97e4-b0d2aa60213d tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1371 microversion: 2.1 time: 0.721835 Aug 07 01:38:13.881650 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2397/5254] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:13 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1371 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:38:14.046803 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b1384d15-4f4a-49e7-b6a4-94efaf765943 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:14.047795 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b1384d15-4f4a-49e7-b6a4-94efaf765943 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:14.055569 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b1384d15-4f4a-49e7-b6a4-94efaf765943 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:14.056907 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b1384d15-4f4a-49e7-b6a4-94efaf765943 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:14.057643 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b1384d15-4f4a-49e7-b6a4-94efaf765943 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:14.058801 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b1384d15-4f4a-49e7-b6a4-94efaf765943 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:14.059449 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b1384d15-4f4a-49e7-b6a4-94efaf765943 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:14.060157 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b1384d15-4f4a-49e7-b6a4-94efaf765943 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:14.266869 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-8b362178-1cf0-45f9-9e95-524909ff005c req-71516168-033c-41f6-9b4e-9a7a8752e7b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d91eb969-4da0-4789-a33c-73a27d5cef97", "name": "network-vif-plugged", "status": "completed", "tag": "561b9998-3694-4cb6-8ce2-0630e19b986b"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:38:14.318950 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-8b362178-1cf0-45f9-9e95-524909ff005c req-71516168-033c-41f6-9b4e-9a7a8752e7b9 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:14.320246 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-8b362178-1cf0-45f9-9e95-524909ff005c req-71516168-033c-41f6-9b4e-9a7a8752e7b9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:14.320970 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-8b362178-1cf0-45f9-9e95-524909ff005c req-71516168-033c-41f6-9b4e-9a7a8752e7b9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:14.397049 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-8b362178-1cf0-45f9-9e95-524909ff005c req-71516168-033c-41f6-9b4e-9a7a8752e7b9 service nova] Creating event network-vif-plugged:561b9998-3694-4cb6-8ce2-0630e19b986b for instance d91eb969-4da0-4789-a33c-73a27d5cef97 on n-h1-master-1 Aug 07 01:38:14.405922 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-8b362178-1cf0-45f9-9e95-524909ff005c req-71516168-033c-41f6-9b4e-9a7a8752e7b9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142936 Aug 07 01:38:14.405922 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2398/5255] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:38:14.431511 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b1384d15-4f4a-49e7-b6a4-94efaf765943 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:14.438039 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:14.446121 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b1384d15-4f4a-49e7-b6a4-94efaf765943 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:14.448164 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b1384d15-4f4a-49e7-b6a4-94efaf765943 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:14.452395 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b1384d15-4f4a-49e7-b6a4-94efaf765943 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1723 microversion: 2.20 time: 0.419094 Aug 07 01:38:14.453883 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2858/5256] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:38:14 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1723 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:38:14.610352 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-41681bce-841d-4707-837d-1cd868c02884 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:14.611264 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-41681bce-841d-4707-837d-1cd868c02884 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:14.621058 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-41681bce-841d-4707-837d-1cd868c02884 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:14.636660 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-41681bce-841d-4707-837d-1cd868c02884 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:14.637803 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-41681bce-841d-4707-837d-1cd868c02884 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:14.640357 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-41681bce-841d-4707-837d-1cd868c02884 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:14.641285 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-41681bce-841d-4707-837d-1cd868c02884 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:14.641975 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-41681bce-841d-4707-837d-1cd868c02884 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:14.676207 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-41681bce-841d-4707-837d-1cd868c02884 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976/ips" status: 200 len: 146 microversion: 2.1 time: 0.078906 Aug 07 01:38:14.677503 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2399/5257] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Aug 7 01:38:14 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976/ips => generated 146 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:38:14.846793 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dd7d36c2-638c-48cf-be9d-8afc9028482c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:14.860080 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-dd7d36c2-638c-48cf-be9d-8afc9028482c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:14.898391 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd7d36c2-638c-48cf-be9d-8afc9028482c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:14.899532 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd7d36c2-638c-48cf-be9d-8afc9028482c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:14.901067 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd7d36c2-638c-48cf-be9d-8afc9028482c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:14.902882 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd7d36c2-638c-48cf-be9d-8afc9028482c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:14.903830 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd7d36c2-638c-48cf-be9d-8afc9028482c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:14.904969 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-787c0957-31ae-4d0a-8216-7381289798f7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:14.906334 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-787c0957-31ae-4d0a-8216-7381289798f7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:14.906505 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd7d36c2-638c-48cf-be9d-8afc9028482c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:14.920864 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-787c0957-31ae-4d0a-8216-7381289798f7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:14.925127 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-787c0957-31ae-4d0a-8216-7381289798f7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:14.929185 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-787c0957-31ae-4d0a-8216-7381289798f7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:14.930484 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-787c0957-31ae-4d0a-8216-7381289798f7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:14.934525 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-787c0957-31ae-4d0a-8216-7381289798f7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:14.936674 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-787c0957-31ae-4d0a-8216-7381289798f7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:15.385097 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-dd7d36c2-638c-48cf-be9d-8afc9028482c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:15.400135 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-dd7d36c2-638c-48cf-be9d-8afc9028482c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9" status: 200 len: 1367 microversion: 2.1 time: 0.577885 Aug 07 01:38:15.427429 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2859/5258] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:14 2022] GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9 => generated 1367 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:38:15.494745 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-01f81590-b40a-4882-8efd-c1c46ad84454 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:15.495387 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-01f81590-b40a-4882-8efd-c1c46ad84454 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:15.506300 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-01f81590-b40a-4882-8efd-c1c46ad84454 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:15.506300 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-01f81590-b40a-4882-8efd-c1c46ad84454 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:15.508854 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-01f81590-b40a-4882-8efd-c1c46ad84454 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:15.510918 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-01f81590-b40a-4882-8efd-c1c46ad84454 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:15.511579 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-01f81590-b40a-4882-8efd-c1c46ad84454 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:15.513648 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-01f81590-b40a-4882-8efd-c1c46ad84454 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:16.517011 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-787c0957-31ae-4d0a-8216-7381289798f7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:16.533295 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-787c0957-31ae-4d0a-8216-7381289798f7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1371 microversion: 2.1 time: 1.633029 Aug 07 01:38:16.553526 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2400/5259] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:14 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1371 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:38:16.575320 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-275501a9-9436-48ce-a120-df33cbd5e785 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:16.580821 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-275501a9-9436-48ce-a120-df33cbd5e785 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:16.610069 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-275501a9-9436-48ce-a120-df33cbd5e785 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:16.619626 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-275501a9-9436-48ce-a120-df33cbd5e785 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:16.621312 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-275501a9-9436-48ce-a120-df33cbd5e785 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:16.622201 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-275501a9-9436-48ce-a120-df33cbd5e785 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:16.624269 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-275501a9-9436-48ce-a120-df33cbd5e785 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:16.625032 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-275501a9-9436-48ce-a120-df33cbd5e785 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:17.220395 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-01f81590-b40a-4882-8efd-c1c46ad84454 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:17.233767 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-01f81590-b40a-4882-8efd-c1c46ad84454 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:17.235297 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-01f81590-b40a-4882-8efd-c1c46ad84454 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:17.239682 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-01f81590-b40a-4882-8efd-c1c46ad84454 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1723 microversion: 2.20 time: 1.757842 Aug 07 01:38:17.242142 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2860/5260] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:38:15 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1723 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:38:17.270909 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-7cfb5744-9050-457a-8905-e5e6305662e3 req-1cec8250-6143-47fb-a5f5-c07e41978d3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c2503ba-46e2-4b06-9675-c4cb842783ca", "name": "network-vif-unplugged", "status": "completed", "tag": "e89117b2-5b89-4cd2-bc23-8423fcc10e38"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:38:17.282911 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:17.307590 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-7cfb5744-9050-457a-8905-e5e6305662e3 req-1cec8250-6143-47fb-a5f5-c07e41978d3c service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:17.310002 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-7cfb5744-9050-457a-8905-e5e6305662e3 req-1cec8250-6143-47fb-a5f5-c07e41978d3c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:17.313542 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-7cfb5744-9050-457a-8905-e5e6305662e3 req-1cec8250-6143-47fb-a5f5-c07e41978d3c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:17.358799 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.compute.server_external_events [req-7cfb5744-9050-457a-8905-e5e6305662e3 req-1cec8250-6143-47fb-a5f5-c07e41978d3c service nova] Unable to find a host for instance 2c2503ba-46e2-4b06-9675-c4cb842783ca. Dropping event network-vif-unplugged {{(pid=119516) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 07 01:38:17.360764 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-7cfb5744-9050-457a-8905-e5e6305662e3 req-1cec8250-6143-47fb-a5f5-c07e41978d3c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.115765 Aug 07 01:38:17.361416 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2861/5261] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 117 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 07 01:38:17.564262 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c14814c9-40c9-4b0a-b4cc-b8e8301631d9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:17.566387 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c14814c9-40c9-4b0a-b4cc-b8e8301631d9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:17.577742 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-275501a9-9436-48ce-a120-df33cbd5e785 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:17.582062 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c14814c9-40c9-4b0a-b4cc-b8e8301631d9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:17.584798 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c14814c9-40c9-4b0a-b4cc-b8e8301631d9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:17.586637 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c14814c9-40c9-4b0a-b4cc-b8e8301631d9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:17.589760 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c14814c9-40c9-4b0a-b4cc-b8e8301631d9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:17.591477 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-275501a9-9436-48ce-a120-df33cbd5e785 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9" status: 200 len: 1367 microversion: 2.1 time: 1.032160 Aug 07 01:38:17.592275 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c14814c9-40c9-4b0a-b4cc-b8e8301631d9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:17.592899 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c14814c9-40c9-4b0a-b4cc-b8e8301631d9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:17.594071 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2401/5262] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:16 2022] GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9 => generated 1367 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:38:18.032016 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c14814c9-40c9-4b0a-b4cc-b8e8301631d9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:18.043212 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c14814c9-40c9-4b0a-b4cc-b8e8301631d9 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1564 microversion: 2.1 time: 0.485522 Aug 07 01:38:18.045678 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2862/5263] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:17 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1564 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:38:18.073911 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-21bbf8bf-fe06-4ab4-b940-ca1545f0b8cc tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:18.074417 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-21bbf8bf-fe06-4ab4-b940-ca1545f0b8cc tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:18.090799 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21bbf8bf-fe06-4ab4-b940-ca1545f0b8cc tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:18.092408 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21bbf8bf-fe06-4ab4-b940-ca1545f0b8cc tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:18.093141 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21bbf8bf-fe06-4ab4-b940-ca1545f0b8cc tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:18.094749 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21bbf8bf-fe06-4ab4-b940-ca1545f0b8cc tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:18.095438 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21bbf8bf-fe06-4ab4-b940-ca1545f0b8cc tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:18.096192 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21bbf8bf-fe06-4ab4-b940-ca1545f0b8cc tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:18.268264 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-62d8b26f-faf0-410c-8ee1-09c96cf86568 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:18.268880 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-62d8b26f-faf0-410c-8ee1-09c96cf86568 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:18.286273 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:18.290112 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62d8b26f-faf0-410c-8ee1-09c96cf86568 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:18.290612 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62d8b26f-faf0-410c-8ee1-09c96cf86568 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:18.291049 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62d8b26f-faf0-410c-8ee1-09c96cf86568 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:18.292017 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62d8b26f-faf0-410c-8ee1-09c96cf86568 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:18.292252 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62d8b26f-faf0-410c-8ee1-09c96cf86568 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:18.292676 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62d8b26f-faf0-410c-8ee1-09c96cf86568 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:18.401272 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-21bbf8bf-fe06-4ab4-b940-ca1545f0b8cc tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.326764 Aug 07 01:38:18.403436 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2402/5264] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Aug 7 01:38:18 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-interface => generated 284 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:38:18.462030 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fe64851c-05d8-46d9-b094-76eb97a7df7c tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8bcd6df0-c4b1-461a-bf09-7c0d4273af73"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:38:18.464547 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fe64851c-05d8-46d9-b094-76eb97a7df7c tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:18.472452 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fe64851c-05d8-46d9-b094-76eb97a7df7c tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:18.473120 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fe64851c-05d8-46d9-b094-76eb97a7df7c tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:18.473731 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fe64851c-05d8-46d9-b094-76eb97a7df7c tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:18.474639 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fe64851c-05d8-46d9-b094-76eb97a7df7c tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:18.475262 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fe64851c-05d8-46d9-b094-76eb97a7df7c tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:18.476063 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fe64851c-05d8-46d9-b094-76eb97a7df7c tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:18.581342 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-62d8b26f-faf0-410c-8ee1-09c96cf86568 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:18.595874 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-62d8b26f-faf0-410c-8ee1-09c96cf86568 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:18.597659 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-62d8b26f-faf0-410c-8ee1-09c96cf86568 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:18.598882 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-62d8b26f-faf0-410c-8ee1-09c96cf86568 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1666 microversion: 2.20 time: 0.335114 Aug 07 01:38:18.599462 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2863/5265] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:38:18 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1666 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:38:18.624016 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3661000a-b461-4f7f-864c-0d8d90286f71 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:18.624016 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3661000a-b461-4f7f-864c-0d8d90286f71 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:18.631175 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3661000a-b461-4f7f-864c-0d8d90286f71 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:18.631745 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3661000a-b461-4f7f-864c-0d8d90286f71 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:18.632568 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3661000a-b461-4f7f-864c-0d8d90286f71 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:18.633505 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3661000a-b461-4f7f-864c-0d8d90286f71 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:18.635132 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3661000a-b461-4f7f-864c-0d8d90286f71 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:18.635798 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3661000a-b461-4f7f-864c-0d8d90286f71 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:18.636491 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=8 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:18.860622 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fe64851c-05d8-46d9-b094-76eb97a7df7c tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "POST /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.399803 Aug 07 01:38:18.867098 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2403/5266] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Aug 7 01:38:18 2022] POST /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976/os-volume_attachments => generated 194 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:38:18.876866 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-49e1bf8c-e759-4a9e-8647-e4ab27c4faa6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1d042c7-4e3b-4db0-99fa-eb3c2a4271fd"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:38:18.916820 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-49e1bf8c-e759-4a9e-8647-e4ab27c4faa6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:18.943294 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49e1bf8c-e759-4a9e-8647-e4ab27c4faa6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:18.944064 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49e1bf8c-e759-4a9e-8647-e4ab27c4faa6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:18.945478 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49e1bf8c-e759-4a9e-8647-e4ab27c4faa6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:18.946664 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49e1bf8c-e759-4a9e-8647-e4ab27c4faa6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:18.947689 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49e1bf8c-e759-4a9e-8647-e4ab27c4faa6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:18.949044 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49e1bf8c-e759-4a9e-8647-e4ab27c4faa6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:19.368573 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-49e1bf8c-e759-4a9e-8647-e4ab27c4faa6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "POST /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.502518 Aug 07 01:38:19.369672 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2404/5267] 10.222.0.39 () {62 vars in 1364 bytes} [Sun Aug 7 01:38:18 2022] POST /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca/os-volume_attachments => generated 188 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:38:19.377861 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3661000a-b461-4f7f-864c-0d8d90286f71 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:19.392231 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3661000a-b461-4f7f-864c-0d8d90286f71 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9" status: 200 len: 1367 microversion: 2.1 time: 0.781075 Aug 07 01:38:19.406007 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2864/5268] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:18 2022] GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9 => generated 1367 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:38:19.565857 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-533883f4-4b96-4046-a98c-1f98c8401f22 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:19.566701 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-533883f4-4b96-4046-a98c-1f98c8401f22 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:19.577457 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-533883f4-4b96-4046-a98c-1f98c8401f22 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:19.581363 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-533883f4-4b96-4046-a98c-1f98c8401f22 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:19.583509 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-533883f4-4b96-4046-a98c-1f98c8401f22 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:19.584916 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-533883f4-4b96-4046-a98c-1f98c8401f22 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:19.585603 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-533883f4-4b96-4046-a98c-1f98c8401f22 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:19.586227 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-533883f4-4b96-4046-a98c-1f98c8401f22 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:19.613232 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:19.976518 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-533883f4-4b96-4046-a98c-1f98c8401f22 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca/os-volume_attachments/c1d042c7-4e3b-4db0-99fa-eb3c2a4271fd" status: 202 len: 0 microversion: 2.20 time: 0.415237 Aug 07 01:38:19.995334 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2405/5269] 10.222.0.39 () {60 vars in 1457 bytes} [Sun Aug 7 01:38:19 2022] DELETE /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca/os-volume_attachments/c1d042c7-4e3b-4db0-99fa-eb3c2a4271fd => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:38:20.074914 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6638e647-9958-4eaa-93b2-f22ef9a40932 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:38:20.076942 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6638e647-9958-4eaa-93b2-f22ef9a40932 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:20.095553 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6638e647-9958-4eaa-93b2-f22ef9a40932 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:20.098001 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6638e647-9958-4eaa-93b2-f22ef9a40932 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:20.101582 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6638e647-9958-4eaa-93b2-f22ef9a40932 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:20.103124 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6638e647-9958-4eaa-93b2-f22ef9a40932 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:20.104141 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6638e647-9958-4eaa-93b2-f22ef9a40932 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:20.108759 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6638e647-9958-4eaa-93b2-f22ef9a40932 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:20.203996 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6638e647-9958-4eaa-93b2-f22ef9a40932 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119516) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 07 01:38:20.308434 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6638e647-9958-4eaa-93b2-f22ef9a40932 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "POST /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca/action" status: 202 len: 0 microversion: 2.20 time: 0.237320 Aug 07 01:38:20.314031 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2865/5270] 10.222.0.39 () {62 vars in 1319 bytes} [Sun Aug 7 01:38:20 2022] POST /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:38:20.318621 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9910df23-544e-4a8a-a426-3b2ed2410fd6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:20.319463 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9910df23-544e-4a8a-a426-3b2ed2410fd6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:20.332402 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9910df23-544e-4a8a-a426-3b2ed2410fd6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:20.333187 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9910df23-544e-4a8a-a426-3b2ed2410fd6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:20.333492 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9910df23-544e-4a8a-a426-3b2ed2410fd6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:20.335280 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9910df23-544e-4a8a-a426-3b2ed2410fd6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:20.337141 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9910df23-544e-4a8a-a426-3b2ed2410fd6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:20.340091 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9910df23-544e-4a8a-a426-3b2ed2410fd6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:20.414832 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-86ec0a2c-31fb-46ce-bd24-c290d996618d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:20.415739 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-86ec0a2c-31fb-46ce-bd24-c290d996618d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:20.427867 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86ec0a2c-31fb-46ce-bd24-c290d996618d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:20.429132 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86ec0a2c-31fb-46ce-bd24-c290d996618d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:20.430343 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86ec0a2c-31fb-46ce-bd24-c290d996618d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:20.433350 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86ec0a2c-31fb-46ce-bd24-c290d996618d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:20.434103 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86ec0a2c-31fb-46ce-bd24-c290d996618d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:20.436291 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86ec0a2c-31fb-46ce-bd24-c290d996618d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:21.118617 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-86ec0a2c-31fb-46ce-bd24-c290d996618d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:21.142189 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-86ec0a2c-31fb-46ce-bd24-c290d996618d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9" status: 200 len: 1367 microversion: 2.1 time: 0.731738 Aug 07 01:38:21.143221 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2866/5271] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:20 2022] GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9 => generated 1367 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:38:21.149783 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-a9a04823-7328-4d64-9919-1cd7193083e2 req-c249073c-520b-49fb-8582-ca262c9f7db2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac218e0a-d325-4062-a13d-501e130105f9", "tag": "8d0ba5dc-69f1-418b-8da4-2b1c5cf0de12"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:38:21.172118 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9910df23-544e-4a8a-a426-3b2ed2410fd6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:21.189780 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9910df23-544e-4a8a-a426-3b2ed2410fd6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:21.191306 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9910df23-544e-4a8a-a426-3b2ed2410fd6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:21.192542 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9910df23-544e-4a8a-a426-3b2ed2410fd6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1674 microversion: 2.20 time: 0.878181 Aug 07 01:38:21.193108 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2406/5272] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:38:20 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1674 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:38:21.205390 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a9a04823-7328-4d64-9919-1cd7193083e2 req-c249073c-520b-49fb-8582-ca262c9f7db2 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:21.206099 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a9a04823-7328-4d64-9919-1cd7193083e2 req-c249073c-520b-49fb-8582-ca262c9f7db2 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:21.208532 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a9a04823-7328-4d64-9919-1cd7193083e2 req-c249073c-520b-49fb-8582-ca262c9f7db2 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:21.238558 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-a9a04823-7328-4d64-9919-1cd7193083e2 req-c249073c-520b-49fb-8582-ca262c9f7db2 service nova] Creating event network-changed:8d0ba5dc-69f1-418b-8da4-2b1c5cf0de12 for instance ac218e0a-d325-4062-a13d-501e130105f9 on n-h2-master-1 Aug 07 01:38:21.248772 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-a9a04823-7328-4d64-9919-1cd7193083e2 req-c249073c-520b-49fb-8582-ca262c9f7db2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102779 Aug 07 01:38:21.249981 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2867/5273] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:38:22.165167 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8a1bd32c-40a7-404b-84f9-ca651176dfda tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:22.165799 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8a1bd32c-40a7-404b-84f9-ca651176dfda tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:22.181145 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a1bd32c-40a7-404b-84f9-ca651176dfda tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:22.181839 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a1bd32c-40a7-404b-84f9-ca651176dfda tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:22.182075 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a1bd32c-40a7-404b-84f9-ca651176dfda tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:22.182813 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a1bd32c-40a7-404b-84f9-ca651176dfda tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:22.183277 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a1bd32c-40a7-404b-84f9-ca651176dfda tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:22.183714 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a1bd32c-40a7-404b-84f9-ca651176dfda tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:22.220085 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6e5e53e4-3c34-4f9c-9e31-15e27231a917 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:22.220704 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6e5e53e4-3c34-4f9c-9e31-15e27231a917 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:22.296439 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e5e53e4-3c34-4f9c-9e31-15e27231a917 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:22.315917 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e5e53e4-3c34-4f9c-9e31-15e27231a917 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:22.316625 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e5e53e4-3c34-4f9c-9e31-15e27231a917 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:22.318287 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e5e53e4-3c34-4f9c-9e31-15e27231a917 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:22.319579 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e5e53e4-3c34-4f9c-9e31-15e27231a917 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:22.321361 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e5e53e4-3c34-4f9c-9e31-15e27231a917 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:22.728098 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8a1bd32c-40a7-404b-84f9-ca651176dfda tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:22.742325 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8a1bd32c-40a7-404b-84f9-ca651176dfda tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9" status: 200 len: 1367 microversion: 2.1 time: 0.581022 Aug 07 01:38:22.746413 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2407/5274] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:22 2022] GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9 => generated 1367 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:38:22.828826 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6e5e53e4-3c34-4f9c-9e31-15e27231a917 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:22.852514 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6e5e53e4-3c34-4f9c-9e31-15e27231a917 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:22.859274 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6e5e53e4-3c34-4f9c-9e31-15e27231a917 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:22.864128 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6e5e53e4-3c34-4f9c-9e31-15e27231a917 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1674 microversion: 2.20 time: 0.649085 Aug 07 01:38:22.882713 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2868/5275] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:38:22 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1674 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:38:23.287094 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-107cacd7-1a5c-44db-977a-3a3dbd913c9e req-028f049b-c8cf-4069-b874-b8e890d7d8c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d91eb969-4da0-4789-a33c-73a27d5cef97", "tag": "561b9998-3694-4cb6-8ce2-0630e19b986b"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:38:23.315493 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-107cacd7-1a5c-44db-977a-3a3dbd913c9e req-028f049b-c8cf-4069-b874-b8e890d7d8c9 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:23.316013 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-107cacd7-1a5c-44db-977a-3a3dbd913c9e req-028f049b-c8cf-4069-b874-b8e890d7d8c9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:23.316452 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-107cacd7-1a5c-44db-977a-3a3dbd913c9e req-028f049b-c8cf-4069-b874-b8e890d7d8c9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:23.368499 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-107cacd7-1a5c-44db-977a-3a3dbd913c9e req-028f049b-c8cf-4069-b874-b8e890d7d8c9 service nova] Creating event network-changed:561b9998-3694-4cb6-8ce2-0630e19b986b for instance d91eb969-4da0-4789-a33c-73a27d5cef97 on n-h1-master-1 Aug 07 01:38:23.379855 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-107cacd7-1a5c-44db-977a-3a3dbd913c9e req-028f049b-c8cf-4069-b874-b8e890d7d8c9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096375 Aug 07 01:38:23.384358 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2408/5276] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:38:23.767641 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-338abe25-211f-41e6-b489-4dc6ed765668 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:23.768624 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-338abe25-211f-41e6-b489-4dc6ed765668 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:23.799613 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-338abe25-211f-41e6-b489-4dc6ed765668 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:23.800383 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-338abe25-211f-41e6-b489-4dc6ed765668 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:23.800999 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-338abe25-211f-41e6-b489-4dc6ed765668 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:23.801930 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-338abe25-211f-41e6-b489-4dc6ed765668 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:23.805997 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-338abe25-211f-41e6-b489-4dc6ed765668 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:23.807246 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-338abe25-211f-41e6-b489-4dc6ed765668 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:23.898412 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-62e834e7-feed-4d01-a2b1-8d32c0cd2783 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:23.899589 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-62e834e7-feed-4d01-a2b1-8d32c0cd2783 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:23.922400 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-62e834e7-feed-4d01-a2b1-8d32c0cd2783 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:23.926931 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-62e834e7-feed-4d01-a2b1-8d32c0cd2783 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:23.930950 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-62e834e7-feed-4d01-a2b1-8d32c0cd2783 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:23.934343 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-62e834e7-feed-4d01-a2b1-8d32c0cd2783 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:23.935565 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-62e834e7-feed-4d01-a2b1-8d32c0cd2783 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:23.940923 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-62e834e7-feed-4d01-a2b1-8d32c0cd2783 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:25.512779 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-338abe25-211f-41e6-b489-4dc6ed765668 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:25.538915 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-338abe25-211f-41e6-b489-4dc6ed765668 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9" status: 200 len: 1367 microversion: 2.1 time: 1.771208 Aug 07 01:38:25.539943 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2869/5277] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:23 2022] GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9 => generated 1367 bytes in 1778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:38:25.639122 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-62e834e7-feed-4d01-a2b1-8d32c0cd2783 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:25.658750 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-62e834e7-feed-4d01-a2b1-8d32c0cd2783 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:25.662450 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-62e834e7-feed-4d01-a2b1-8d32c0cd2783 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:25.666425 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-62e834e7-feed-4d01-a2b1-8d32c0cd2783 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1732 microversion: 2.20 time: 1.772373 Aug 07 01:38:25.669415 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2409/5278] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:38:23 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1732 bytes in 1776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:38:26.561586 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b4af8c7f-1fa7-47a1-8489-6d6a34bdb41e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:26.562432 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b4af8c7f-1fa7-47a1-8489-6d6a34bdb41e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:26.582458 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4af8c7f-1fa7-47a1-8489-6d6a34bdb41e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:26.585941 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4af8c7f-1fa7-47a1-8489-6d6a34bdb41e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:26.588495 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4af8c7f-1fa7-47a1-8489-6d6a34bdb41e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:26.589500 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4af8c7f-1fa7-47a1-8489-6d6a34bdb41e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:26.595711 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4af8c7f-1fa7-47a1-8489-6d6a34bdb41e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:26.596500 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4af8c7f-1fa7-47a1-8489-6d6a34bdb41e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:26.694609 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1e1be965-ae9e-4159-ad4e-3811535be915 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:26.695221 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1e1be965-ae9e-4159-ad4e-3811535be915 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:26.712375 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e1be965-ae9e-4159-ad4e-3811535be915 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:26.714230 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e1be965-ae9e-4159-ad4e-3811535be915 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:26.718063 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e1be965-ae9e-4159-ad4e-3811535be915 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:26.719621 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e1be965-ae9e-4159-ad4e-3811535be915 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:26.725784 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e1be965-ae9e-4159-ad4e-3811535be915 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:26.726307 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e1be965-ae9e-4159-ad4e-3811535be915 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:27.254179 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b4af8c7f-1fa7-47a1-8489-6d6a34bdb41e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:27.271382 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b4af8c7f-1fa7-47a1-8489-6d6a34bdb41e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9" status: 200 len: 1367 microversion: 2.1 time: 0.714518 Aug 07 01:38:27.272293 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2870/5279] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:26 2022] GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9 => generated 1367 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:38:27.556585 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1e1be965-ae9e-4159-ad4e-3811535be915 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:27.566474 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1e1be965-ae9e-4159-ad4e-3811535be915 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:27.568014 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1e1be965-ae9e-4159-ad4e-3811535be915 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:27.569206 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1e1be965-ae9e-4159-ad4e-3811535be915 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1732 microversion: 2.20 time: 0.880955 Aug 07 01:38:27.592488 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2410/5280] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:38:26 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1732 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:38:28.303964 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e8269acc-0d79-4720-9226-3de134c01a59 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:28.306160 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e8269acc-0d79-4720-9226-3de134c01a59 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:28.336792 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e8269acc-0d79-4720-9226-3de134c01a59 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:28.340558 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e8269acc-0d79-4720-9226-3de134c01a59 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:28.341561 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e8269acc-0d79-4720-9226-3de134c01a59 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:28.343829 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e8269acc-0d79-4720-9226-3de134c01a59 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:28.346940 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e8269acc-0d79-4720-9226-3de134c01a59 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:28.347737 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e8269acc-0d79-4720-9226-3de134c01a59 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:28.597489 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d5f6764a-9341-45df-8458-6b48a8919b18 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:28.597975 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d5f6764a-9341-45df-8458-6b48a8919b18 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:28.608069 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d5f6764a-9341-45df-8458-6b48a8919b18 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:28.608569 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d5f6764a-9341-45df-8458-6b48a8919b18 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:28.609011 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d5f6764a-9341-45df-8458-6b48a8919b18 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:28.609744 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d5f6764a-9341-45df-8458-6b48a8919b18 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:28.610224 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d5f6764a-9341-45df-8458-6b48a8919b18 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:28.610849 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d5f6764a-9341-45df-8458-6b48a8919b18 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:29.182311 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e8269acc-0d79-4720-9226-3de134c01a59 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:29.191362 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e8269acc-0d79-4720-9226-3de134c01a59 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9" status: 200 len: 1367 microversion: 2.1 time: 0.895541 Aug 07 01:38:29.196804 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2871/5281] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:28 2022] GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9 => generated 1367 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:38:30.219577 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-48adf6f4-8dd7-4786-88db-eda1e712a1a9 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:30.220424 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-48adf6f4-8dd7-4786-88db-eda1e712a1a9 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:30.236268 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48adf6f4-8dd7-4786-88db-eda1e712a1a9 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:30.236802 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48adf6f4-8dd7-4786-88db-eda1e712a1a9 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:30.238055 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48adf6f4-8dd7-4786-88db-eda1e712a1a9 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:30.240458 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48adf6f4-8dd7-4786-88db-eda1e712a1a9 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:30.247138 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48adf6f4-8dd7-4786-88db-eda1e712a1a9 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:30.248459 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48adf6f4-8dd7-4786-88db-eda1e712a1a9 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:30.470932 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d5f6764a-9341-45df-8458-6b48a8919b18 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:30.483217 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d5f6764a-9341-45df-8458-6b48a8919b18 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:30.545377 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d5f6764a-9341-45df-8458-6b48a8919b18 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:30.551072 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d5f6764a-9341-45df-8458-6b48a8919b18 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1732 microversion: 2.20 time: 1.946160 Aug 07 01:38:30.552237 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2411/5282] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:38:28 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1732 bytes in 1959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:38:31.124720 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-48adf6f4-8dd7-4786-88db-eda1e712a1a9 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:31.132887 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-48adf6f4-8dd7-4786-88db-eda1e712a1a9 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9" status: 200 len: 1367 microversion: 2.1 time: 0.918636 Aug 07 01:38:31.136325 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2872/5283] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:30 2022] GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9 => generated 1367 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:38:31.577368 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-17644788-9650-42d3-9438-a66946220ab7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:31.577992 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-17644788-9650-42d3-9438-a66946220ab7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:31.598030 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=48 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:31.600014 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-17644788-9650-42d3-9438-a66946220ab7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:31.600513 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-17644788-9650-42d3-9438-a66946220ab7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:31.600945 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-17644788-9650-42d3-9438-a66946220ab7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:31.601664 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-17644788-9650-42d3-9438-a66946220ab7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:31.602111 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-17644788-9650-42d3-9438-a66946220ab7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:31.612672 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-17644788-9650-42d3-9438-a66946220ab7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:32.171459 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-34310efc-1346-4d13-a205-e87facc2527c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:32.172830 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-34310efc-1346-4d13-a205-e87facc2527c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:32.186158 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34310efc-1346-4d13-a205-e87facc2527c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:32.186646 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34310efc-1346-4d13-a205-e87facc2527c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:32.187088 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34310efc-1346-4d13-a205-e87facc2527c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:32.187958 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34310efc-1346-4d13-a205-e87facc2527c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:32.188374 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34310efc-1346-4d13-a205-e87facc2527c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:32.188728 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34310efc-1346-4d13-a205-e87facc2527c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:32.759099 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-34310efc-1346-4d13-a205-e87facc2527c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:32.787947 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-34310efc-1346-4d13-a205-e87facc2527c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9" status: 200 len: 1367 microversion: 2.1 time: 0.616497 Aug 07 01:38:32.788908 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2873/5284] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:32 2022] GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9 => generated 1367 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:38:32.860540 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-17644788-9650-42d3-9438-a66946220ab7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:32.879345 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-17644788-9650-42d3-9438-a66946220ab7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:32.885042 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-17644788-9650-42d3-9438-a66946220ab7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:32.889119 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-17644788-9650-42d3-9438-a66946220ab7 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1732 microversion: 2.20 time: 1.316279 Aug 07 01:38:32.910962 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2412/5285] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:38:31 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1732 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:38:33.817116 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d7fc33d6-a442-4904-a2d8-d5e1b7cb499f tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:33.822966 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d7fc33d6-a442-4904-a2d8-d5e1b7cb499f tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:33.841660 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d7fc33d6-a442-4904-a2d8-d5e1b7cb499f tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:33.845220 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d7fc33d6-a442-4904-a2d8-d5e1b7cb499f tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:33.845714 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d7fc33d6-a442-4904-a2d8-d5e1b7cb499f tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:33.846439 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d7fc33d6-a442-4904-a2d8-d5e1b7cb499f tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:33.852570 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d7fc33d6-a442-4904-a2d8-d5e1b7cb499f tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:33.853797 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d7fc33d6-a442-4904-a2d8-d5e1b7cb499f tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:33.927407 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6db5c289-e34b-4d4d-8b8b-32a18d5da724 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:33.930141 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6db5c289-e34b-4d4d-8b8b-32a18d5da724 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:33.946809 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6db5c289-e34b-4d4d-8b8b-32a18d5da724 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:33.947315 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6db5c289-e34b-4d4d-8b8b-32a18d5da724 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:33.947764 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6db5c289-e34b-4d4d-8b8b-32a18d5da724 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:33.948799 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6db5c289-e34b-4d4d-8b8b-32a18d5da724 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:33.949622 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6db5c289-e34b-4d4d-8b8b-32a18d5da724 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:33.950728 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6db5c289-e34b-4d4d-8b8b-32a18d5da724 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:34.603928 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6db5c289-e34b-4d4d-8b8b-32a18d5da724 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:34.638911 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6db5c289-e34b-4d4d-8b8b-32a18d5da724 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:34.653902 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6db5c289-e34b-4d4d-8b8b-32a18d5da724 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:34.659943 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6db5c289-e34b-4d4d-8b8b-32a18d5da724 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1732 microversion: 2.20 time: 0.738971 Aug 07 01:38:34.671946 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2413/5286] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:38:33 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1732 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:38:34.681477 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-dac205a4-b3e5-4e1f-926c-14d6bc42020e req-d837385f-fc65-47de-a21e-205cab7b42c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac218e0a-d325-4062-a13d-501e130105f9", "name": "network-vif-plugged", "status": "completed", "tag": "8d0ba5dc-69f1-418b-8da4-2b1c5cf0de12"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:38:34.701237 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-dac205a4-b3e5-4e1f-926c-14d6bc42020e req-d837385f-fc65-47de-a21e-205cab7b42c3 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:34.708447 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-dac205a4-b3e5-4e1f-926c-14d6bc42020e req-d837385f-fc65-47de-a21e-205cab7b42c3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:34.708848 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-dac205a4-b3e5-4e1f-926c-14d6bc42020e req-d837385f-fc65-47de-a21e-205cab7b42c3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:34.761504 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-dac205a4-b3e5-4e1f-926c-14d6bc42020e req-d837385f-fc65-47de-a21e-205cab7b42c3 service nova] Creating event network-vif-plugged:8d0ba5dc-69f1-418b-8da4-2b1c5cf0de12 for instance ac218e0a-d325-4062-a13d-501e130105f9 on n-h2-master-1 Aug 07 01:38:34.772398 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-dac205a4-b3e5-4e1f-926c-14d6bc42020e req-d837385f-fc65-47de-a21e-205cab7b42c3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107784 Aug 07 01:38:34.778755 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2414/5287] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:38:35.221947 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d7fc33d6-a442-4904-a2d8-d5e1b7cb499f tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:35.230852 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d7fc33d6-a442-4904-a2d8-d5e1b7cb499f tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9" status: 200 len: 1367 microversion: 2.1 time: 1.420571 Aug 07 01:38:35.257113 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2874/5288] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:33 2022] GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9 => generated 1367 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:38:35.694791 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ab66c5f5-26c4-49c1-9519-3c67cca12713 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:35.696101 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ab66c5f5-26c4-49c1-9519-3c67cca12713 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:35.758098 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab66c5f5-26c4-49c1-9519-3c67cca12713 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:35.763055 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab66c5f5-26c4-49c1-9519-3c67cca12713 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:35.763799 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab66c5f5-26c4-49c1-9519-3c67cca12713 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:35.767187 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab66c5f5-26c4-49c1-9519-3c67cca12713 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:35.771451 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab66c5f5-26c4-49c1-9519-3c67cca12713 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:35.787421 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab66c5f5-26c4-49c1-9519-3c67cca12713 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:36.224697 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e524d995-2c39-4369-beee-15f0a8028b38 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:38:36.242806 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e524d995-2c39-4369-beee-15f0a8028b38 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:36.248394 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e524d995-2c39-4369-beee-15f0a8028b38 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:36.248993 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e524d995-2c39-4369-beee-15f0a8028b38 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:36.299646 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e524d995-2c39-4369-beee-15f0a8028b38 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Going to try to stop instance {{(pid=119516) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 07 01:38:36.355255 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:36.387309 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e524d995-2c39-4369-beee-15f0a8028b38 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "POST /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976/action" status: 202 len: 0 microversion: 2.1 time: 0.166328 Aug 07 01:38:36.388929 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2875/5289] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:38:36 2022] POST /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 01:38:36.403424 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e51a2d3c-6c17-4f3d-83ae-50fa994ae13c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:36.409274 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e51a2d3c-6c17-4f3d-83ae-50fa994ae13c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:36.423204 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e51a2d3c-6c17-4f3d-83ae-50fa994ae13c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:36.426729 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e51a2d3c-6c17-4f3d-83ae-50fa994ae13c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:36.431091 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e51a2d3c-6c17-4f3d-83ae-50fa994ae13c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:36.432203 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e51a2d3c-6c17-4f3d-83ae-50fa994ae13c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:36.432880 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e51a2d3c-6c17-4f3d-83ae-50fa994ae13c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:36.433508 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e51a2d3c-6c17-4f3d-83ae-50fa994ae13c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:36.859161 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e51a2d3c-6c17-4f3d-83ae-50fa994ae13c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:36.871228 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e51a2d3c-6c17-4f3d-83ae-50fa994ae13c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9" status: 200 len: 1367 microversion: 2.1 time: 0.477755 Aug 07 01:38:36.872269 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2876/5290] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:36 2022] GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9 => generated 1367 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:38:36.893708 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d0c91ee9-1ac6-4b19-884b-bfa9da8bda5a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:36.898259 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d0c91ee9-1ac6-4b19-884b-bfa9da8bda5a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:36.910905 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0c91ee9-1ac6-4b19-884b-bfa9da8bda5a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:36.913670 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0c91ee9-1ac6-4b19-884b-bfa9da8bda5a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:36.914353 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0c91ee9-1ac6-4b19-884b-bfa9da8bda5a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:36.917474 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0c91ee9-1ac6-4b19-884b-bfa9da8bda5a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:36.919262 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0c91ee9-1ac6-4b19-884b-bfa9da8bda5a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:36.920399 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0c91ee9-1ac6-4b19-884b-bfa9da8bda5a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:37.295080 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ab66c5f5-26c4-49c1-9519-3c67cca12713 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:37.312610 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ab66c5f5-26c4-49c1-9519-3c67cca12713 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:37.324440 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ab66c5f5-26c4-49c1-9519-3c67cca12713 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:37.326016 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ab66c5f5-26c4-49c1-9519-3c67cca12713 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1732 microversion: 2.20 time: 1.639407 Aug 07 01:38:37.345164 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2415/5291] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:38:35 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1732 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:38:37.878902 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d0c91ee9-1ac6-4b19-884b-bfa9da8bda5a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:37.896797 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d0c91ee9-1ac6-4b19-884b-bfa9da8bda5a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1724 microversion: 2.1 time: 1.006759 Aug 07 01:38:37.899140 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-adc655d9-97b1-4afb-9aa9-057a25e3b28c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:37.900353 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2877/5292] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:36 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1724 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:38:37.916508 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-adc655d9-97b1-4afb-9aa9-057a25e3b28c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:37.958409 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-adc655d9-97b1-4afb-9aa9-057a25e3b28c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:37.959232 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-adc655d9-97b1-4afb-9aa9-057a25e3b28c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:37.962714 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-adc655d9-97b1-4afb-9aa9-057a25e3b28c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:37.963909 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-adc655d9-97b1-4afb-9aa9-057a25e3b28c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:37.966695 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-adc655d9-97b1-4afb-9aa9-057a25e3b28c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:37.967430 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-adc655d9-97b1-4afb-9aa9-057a25e3b28c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:38.351704 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3665529a-3bef-4e19-a2a1-ac5b0e98ca24 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:38.352370 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3665529a-3bef-4e19-a2a1-ac5b0e98ca24 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:38.372318 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3665529a-3bef-4e19-a2a1-ac5b0e98ca24 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:38.373802 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3665529a-3bef-4e19-a2a1-ac5b0e98ca24 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:38.375088 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3665529a-3bef-4e19-a2a1-ac5b0e98ca24 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:38.376736 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3665529a-3bef-4e19-a2a1-ac5b0e98ca24 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:38.378734 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3665529a-3bef-4e19-a2a1-ac5b0e98ca24 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:38.380108 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3665529a-3bef-4e19-a2a1-ac5b0e98ca24 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:39.024481 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-adc655d9-97b1-4afb-9aa9-057a25e3b28c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:39.041618 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-adc655d9-97b1-4afb-9aa9-057a25e3b28c tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9" status: 200 len: 1367 microversion: 2.1 time: 1.148386 Aug 07 01:38:39.042749 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2416/5293] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:37 2022] GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9 => generated 1367 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:38:39.068122 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8ef4cb4d-b226-4e57-8089-37436723f164 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:39.068901 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8ef4cb4d-b226-4e57-8089-37436723f164 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:39.088300 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8ef4cb4d-b226-4e57-8089-37436723f164 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:39.088888 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8ef4cb4d-b226-4e57-8089-37436723f164 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:39.089342 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8ef4cb4d-b226-4e57-8089-37436723f164 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:39.090853 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8ef4cb4d-b226-4e57-8089-37436723f164 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:39.091410 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8ef4cb4d-b226-4e57-8089-37436723f164 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:39.091855 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8ef4cb4d-b226-4e57-8089-37436723f164 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:39.921005 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3665529a-3bef-4e19-a2a1-ac5b0e98ca24 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:39.947135 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3665529a-3bef-4e19-a2a1-ac5b0e98ca24 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:39.957440 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3665529a-3bef-4e19-a2a1-ac5b0e98ca24 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:39.977629 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3665529a-3bef-4e19-a2a1-ac5b0e98ca24 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1732 microversion: 2.20 time: 1.625054 Aug 07 01:38:40.006280 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2878/5294] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:38:38 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1732 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:38:40.068722 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4d6e8751-d613-44be-81fa-a35c259f55cf tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:40.070043 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4d6e8751-d613-44be-81fa-a35c259f55cf tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:40.082285 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d6e8751-d613-44be-81fa-a35c259f55cf tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:40.086313 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d6e8751-d613-44be-81fa-a35c259f55cf tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:40.087107 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d6e8751-d613-44be-81fa-a35c259f55cf tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:40.092500 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d6e8751-d613-44be-81fa-a35c259f55cf tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:40.101942 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d6e8751-d613-44be-81fa-a35c259f55cf tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:40.102970 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d6e8751-d613-44be-81fa-a35c259f55cf tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:40.327785 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8ef4cb4d-b226-4e57-8089-37436723f164 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:40.354308 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8ef4cb4d-b226-4e57-8089-37436723f164 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1724 microversion: 2.1 time: 1.310245 Aug 07 01:38:40.361741 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2417/5295] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:39 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1724 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:38:41.010678 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ac782b64-7f84-409c-a95b-3f11b3de64cf tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:41.011759 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ac782b64-7f84-409c-a95b-3f11b3de64cf tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:41.033569 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ac782b64-7f84-409c-a95b-3f11b3de64cf tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:41.035197 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ac782b64-7f84-409c-a95b-3f11b3de64cf tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:41.037670 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ac782b64-7f84-409c-a95b-3f11b3de64cf tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:41.038623 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ac782b64-7f84-409c-a95b-3f11b3de64cf tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:41.040799 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ac782b64-7f84-409c-a95b-3f11b3de64cf tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:41.046554 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ac782b64-7f84-409c-a95b-3f11b3de64cf tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:41.769897 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ac782b64-7f84-409c-a95b-3f11b3de64cf tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:41.792257 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ac782b64-7f84-409c-a95b-3f11b3de64cf tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:41.799922 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ac782b64-7f84-409c-a95b-3f11b3de64cf tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:41.801548 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ac782b64-7f84-409c-a95b-3f11b3de64cf tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1732 microversion: 2.20 time: 0.794882 Aug 07 01:38:41.807439 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2418/5296] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:38:41 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1732 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:38:41.828525 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-40b8c946-d4c4-4861-b4fc-8452208b1d6f tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:41.832732 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-40b8c946-d4c4-4861-b4fc-8452208b1d6f tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:41.841993 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-40b8c946-d4c4-4861-b4fc-8452208b1d6f tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:41.842661 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-40b8c946-d4c4-4861-b4fc-8452208b1d6f tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:41.843566 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-40b8c946-d4c4-4861-b4fc-8452208b1d6f tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:41.844462 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-40b8c946-d4c4-4861-b4fc-8452208b1d6f tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:41.845200 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-40b8c946-d4c4-4861-b4fc-8452208b1d6f tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:41.845939 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-40b8c946-d4c4-4861-b4fc-8452208b1d6f tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:41.929664 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4d6e8751-d613-44be-81fa-a35c259f55cf tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:41.945045 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4d6e8751-d613-44be-81fa-a35c259f55cf tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9" status: 200 len: 1557 microversion: 2.1 time: 1.885917 Aug 07 01:38:41.946114 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2879/5297] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:40 2022] GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9 => generated 1557 bytes in 1888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:38:41.987845 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d9e2a83e-c91c-4a3c-ae49-8f21f2a9ff98 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:41.991898 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d9e2a83e-c91c-4a3c-ae49-8f21f2a9ff98 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:42.025375 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d9e2a83e-c91c-4a3c-ae49-8f21f2a9ff98 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:42.026448 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d9e2a83e-c91c-4a3c-ae49-8f21f2a9ff98 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:42.029149 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d9e2a83e-c91c-4a3c-ae49-8f21f2a9ff98 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:42.030447 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d9e2a83e-c91c-4a3c-ae49-8f21f2a9ff98 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:42.032521 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d9e2a83e-c91c-4a3c-ae49-8f21f2a9ff98 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:42.035016 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d9e2a83e-c91c-4a3c-ae49-8f21f2a9ff98 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:42.360359 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-40b8c946-d4c4-4861-b4fc-8452208b1d6f tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:42.382883 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-40b8c946-d4c4-4861-b4fc-8452208b1d6f tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1724 microversion: 2.1 time: 0.572197 Aug 07 01:38:42.384822 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2419/5298] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:41 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1724 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:38:42.837890 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-eabc98a8-aa73-44f2-9313-e8265477dce2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:42.838695 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-eabc98a8-aa73-44f2-9313-e8265477dce2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:42.860052 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eabc98a8-aa73-44f2-9313-e8265477dce2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:42.860548 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eabc98a8-aa73-44f2-9313-e8265477dce2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:42.860986 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eabc98a8-aa73-44f2-9313-e8265477dce2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:42.861698 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eabc98a8-aa73-44f2-9313-e8265477dce2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:42.862153 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eabc98a8-aa73-44f2-9313-e8265477dce2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:42.862581 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eabc98a8-aa73-44f2-9313-e8265477dce2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:43.176136 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d9e2a83e-c91c-4a3c-ae49-8f21f2a9ff98 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9/os-interface" status: 200 len: 285 microversion: 2.1 time: 1.207133 Aug 07 01:38:43.176745 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2880/5299] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Aug 7 01:38:41 2022] GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9/os-interface => generated 285 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:38:43.313060 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-eabc98a8-aa73-44f2-9313-e8265477dce2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:43.317469 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:43.333828 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-eabc98a8-aa73-44f2-9313-e8265477dce2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:43.336067 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-eabc98a8-aa73-44f2-9313-e8265477dce2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:43.337651 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-eabc98a8-aa73-44f2-9313-e8265477dce2 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1732 microversion: 2.20 time: 0.503725 Aug 07 01:38:43.339370 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2420/5300] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:38:42 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1732 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:38:43.407030 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-680eac70-e134-44c3-b87a-47238c9f5360 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:43.407844 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-680eac70-e134-44c3-b87a-47238c9f5360 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:43.415126 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-680eac70-e134-44c3-b87a-47238c9f5360 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:43.415857 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-680eac70-e134-44c3-b87a-47238c9f5360 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:43.416556 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-680eac70-e134-44c3-b87a-47238c9f5360 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:43.417456 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-680eac70-e134-44c3-b87a-47238c9f5360 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:43.418064 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-680eac70-e134-44c3-b87a-47238c9f5360 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:43.419397 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-680eac70-e134-44c3-b87a-47238c9f5360 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:43.875771 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-680eac70-e134-44c3-b87a-47238c9f5360 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:43.929405 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-680eac70-e134-44c3-b87a-47238c9f5360 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1724 microversion: 2.1 time: 0.521792 Aug 07 01:38:43.946727 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2881/5301] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:43 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1724 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:38:44.364596 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-34e03ac8-240f-485d-87aa-f751e0d5c83d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:44.365090 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-34e03ac8-240f-485d-87aa-f751e0d5c83d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:44.393057 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-34e03ac8-240f-485d-87aa-f751e0d5c83d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:44.393561 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-34e03ac8-240f-485d-87aa-f751e0d5c83d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:44.394014 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-34e03ac8-240f-485d-87aa-f751e0d5c83d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:44.399611 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-34e03ac8-240f-485d-87aa-f751e0d5c83d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:44.400540 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-34e03ac8-240f-485d-87aa-f751e0d5c83d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:44.404483 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-34e03ac8-240f-485d-87aa-f751e0d5c83d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:44.963634 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8832f2d0-db2d-4043-b7af-b5d658a50526 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:44.967290 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8832f2d0-db2d-4043-b7af-b5d658a50526 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:45.005694 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8832f2d0-db2d-4043-b7af-b5d658a50526 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:45.006552 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8832f2d0-db2d-4043-b7af-b5d658a50526 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:45.007228 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8832f2d0-db2d-4043-b7af-b5d658a50526 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:45.008246 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8832f2d0-db2d-4043-b7af-b5d658a50526 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:45.008918 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8832f2d0-db2d-4043-b7af-b5d658a50526 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:45.009576 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8832f2d0-db2d-4043-b7af-b5d658a50526 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:45.180296 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-34e03ac8-240f-485d-87aa-f751e0d5c83d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:45.204562 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-34e03ac8-240f-485d-87aa-f751e0d5c83d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:45.209387 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-34e03ac8-240f-485d-87aa-f751e0d5c83d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:45.216211 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-34e03ac8-240f-485d-87aa-f751e0d5c83d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1732 microversion: 2.20 time: 0.855972 Aug 07 01:38:45.217794 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2421/5302] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:38:44 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1732 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:38:45.676432 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8832f2d0-db2d-4043-b7af-b5d658a50526 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:45.690585 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8832f2d0-db2d-4043-b7af-b5d658a50526 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1724 microversion: 2.1 time: 0.737769 Aug 07 01:38:45.691173 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2882/5303] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:44 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1724 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:38:46.241085 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f24ad0d5-e1c2-4f9d-a2a2-ff265d6d5edb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:46.242378 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f24ad0d5-e1c2-4f9d-a2a2-ff265d6d5edb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:46.247906 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-0988ef54-74d4-4a61-8743-286530c7d6a9 req-34bd77ab-3ada-406f-ba2e-df3ff2caca47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac218e0a-d325-4062-a13d-501e130105f9", "tag": "8d0ba5dc-69f1-418b-8da4-2b1c5cf0de12"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:38:46.251740 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f24ad0d5-e1c2-4f9d-a2a2-ff265d6d5edb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:46.256385 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f24ad0d5-e1c2-4f9d-a2a2-ff265d6d5edb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:46.258045 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f24ad0d5-e1c2-4f9d-a2a2-ff265d6d5edb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:46.261117 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f24ad0d5-e1c2-4f9d-a2a2-ff265d6d5edb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:46.263183 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f24ad0d5-e1c2-4f9d-a2a2-ff265d6d5edb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:46.265607 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f24ad0d5-e1c2-4f9d-a2a2-ff265d6d5edb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:46.281459 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0988ef54-74d4-4a61-8743-286530c7d6a9 req-34bd77ab-3ada-406f-ba2e-df3ff2caca47 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:46.283186 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0988ef54-74d4-4a61-8743-286530c7d6a9 req-34bd77ab-3ada-406f-ba2e-df3ff2caca47 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:46.285881 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0988ef54-74d4-4a61-8743-286530c7d6a9 req-34bd77ab-3ada-406f-ba2e-df3ff2caca47 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:46.322523 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-0988ef54-74d4-4a61-8743-286530c7d6a9 req-34bd77ab-3ada-406f-ba2e-df3ff2caca47 service nova] Creating event network-changed:8d0ba5dc-69f1-418b-8da4-2b1c5cf0de12 for instance ac218e0a-d325-4062-a13d-501e130105f9 on n-h2-master-1 Aug 07 01:38:46.336585 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-0988ef54-74d4-4a61-8743-286530c7d6a9 req-34bd77ab-3ada-406f-ba2e-df3ff2caca47 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092750 Aug 07 01:38:46.337527 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2883/5304] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:38:46.720178 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c1872309-8104-49d3-ac79-d14d05f83b3a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:46.721392 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c1872309-8104-49d3-ac79-d14d05f83b3a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:46.736209 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1872309-8104-49d3-ac79-d14d05f83b3a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:46.739179 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1872309-8104-49d3-ac79-d14d05f83b3a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:46.740742 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1872309-8104-49d3-ac79-d14d05f83b3a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:46.741676 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1872309-8104-49d3-ac79-d14d05f83b3a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:46.743122 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1872309-8104-49d3-ac79-d14d05f83b3a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:46.745225 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1872309-8104-49d3-ac79-d14d05f83b3a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:47.214857 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f24ad0d5-e1c2-4f9d-a2a2-ff265d6d5edb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:47.231577 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f24ad0d5-e1c2-4f9d-a2a2-ff265d6d5edb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:47.235489 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f24ad0d5-e1c2-4f9d-a2a2-ff265d6d5edb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:47.241180 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f24ad0d5-e1c2-4f9d-a2a2-ff265d6d5edb tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1732 microversion: 2.20 time: 1.004062 Aug 07 01:38:47.258492 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2422/5305] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:38:46 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1732 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:38:47.375207 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c1872309-8104-49d3-ac79-d14d05f83b3a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:47.398032 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c1872309-8104-49d3-ac79-d14d05f83b3a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1724 microversion: 2.1 time: 0.683043 Aug 07 01:38:47.405618 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2884/5306] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:46 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1724 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:38:48.295868 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f785af74-eb13-4cf3-a893-f1902a67799c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:48.299216 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f785af74-eb13-4cf3-a893-f1902a67799c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:48.312907 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f785af74-eb13-4cf3-a893-f1902a67799c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:48.316458 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f785af74-eb13-4cf3-a893-f1902a67799c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:48.317113 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f785af74-eb13-4cf3-a893-f1902a67799c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:48.318013 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f785af74-eb13-4cf3-a893-f1902a67799c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:48.321382 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f785af74-eb13-4cf3-a893-f1902a67799c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:48.322193 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f785af74-eb13-4cf3-a893-f1902a67799c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:48.425391 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ddb46c92-c6e1-480a-9bdc-fa1a6f9711f4 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:48.429666 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ddb46c92-c6e1-480a-9bdc-fa1a6f9711f4 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:48.433004 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:48.449635 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddb46c92-c6e1-480a-9bdc-fa1a6f9711f4 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:48.450403 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddb46c92-c6e1-480a-9bdc-fa1a6f9711f4 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:48.451909 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddb46c92-c6e1-480a-9bdc-fa1a6f9711f4 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:48.456185 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddb46c92-c6e1-480a-9bdc-fa1a6f9711f4 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:48.456899 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddb46c92-c6e1-480a-9bdc-fa1a6f9711f4 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:48.457481 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddb46c92-c6e1-480a-9bdc-fa1a6f9711f4 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:49.020578 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f785af74-eb13-4cf3-a893-f1902a67799c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:49.037095 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f785af74-eb13-4cf3-a893-f1902a67799c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:49.039580 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f785af74-eb13-4cf3-a893-f1902a67799c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:49.041405 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f785af74-eb13-4cf3-a893-f1902a67799c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1732 microversion: 2.20 time: 0.772171 Aug 07 01:38:49.057205 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2423/5307] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:38:48 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1732 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:38:49.219836 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ddb46c92-c6e1-480a-9bdc-fa1a6f9711f4 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:49.236833 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ddb46c92-c6e1-480a-9bdc-fa1a6f9711f4 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1724 microversion: 2.1 time: 0.815200 Aug 07 01:38:49.245792 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2885/5308] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:48 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1724 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:38:50.069130 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-547eb880-d78d-43dd-9203-10322b3d65e5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:50.069765 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-547eb880-d78d-43dd-9203-10322b3d65e5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:50.086480 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-547eb880-d78d-43dd-9203-10322b3d65e5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:50.086660 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-547eb880-d78d-43dd-9203-10322b3d65e5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:50.087316 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-547eb880-d78d-43dd-9203-10322b3d65e5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:50.088269 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-547eb880-d78d-43dd-9203-10322b3d65e5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:50.088722 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-547eb880-d78d-43dd-9203-10322b3d65e5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:50.089161 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-547eb880-d78d-43dd-9203-10322b3d65e5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:50.267233 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a7091380-6e87-44f3-969a-2996816eed94 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:50.268485 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a7091380-6e87-44f3-969a-2996816eed94 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:50.280981 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7091380-6e87-44f3-969a-2996816eed94 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:50.281577 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7091380-6e87-44f3-969a-2996816eed94 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:50.281936 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7091380-6e87-44f3-969a-2996816eed94 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:50.282679 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7091380-6e87-44f3-969a-2996816eed94 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:50.283141 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7091380-6e87-44f3-969a-2996816eed94 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:50.283578 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7091380-6e87-44f3-969a-2996816eed94 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:50.769904 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a7091380-6e87-44f3-969a-2996816eed94 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:50.783727 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a7091380-6e87-44f3-969a-2996816eed94 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1724 microversion: 2.1 time: 0.521250 Aug 07 01:38:50.784602 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2886/5309] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:50 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1724 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:38:50.982303 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-547eb880-d78d-43dd-9203-10322b3d65e5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:51.002202 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-547eb880-d78d-43dd-9203-10322b3d65e5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:51.004080 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-547eb880-d78d-43dd-9203-10322b3d65e5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:51.005342 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-547eb880-d78d-43dd-9203-10322b3d65e5 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1732 microversion: 2.20 time: 0.940270 Aug 07 01:38:51.016764 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2424/5310] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:38:50 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1732 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:38:51.458240 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-3e807676-0e29-4092-b3c8-492d5425952a req-306c96ad-0153-4a81-9d12-9e17761b0c6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c2503ba-46e2-4b06-9675-c4cb842783ca", "name": "network-vif-plugged", "status": "completed", "tag": "e89117b2-5b89-4cd2-bc23-8423fcc10e38"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:38:51.502324 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3e807676-0e29-4092-b3c8-492d5425952a req-306c96ad-0153-4a81-9d12-9e17761b0c6a service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:51.516319 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3e807676-0e29-4092-b3c8-492d5425952a req-306c96ad-0153-4a81-9d12-9e17761b0c6a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:51.516965 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3e807676-0e29-4092-b3c8-492d5425952a req-306c96ad-0153-4a81-9d12-9e17761b0c6a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:51.573310 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-3e807676-0e29-4092-b3c8-492d5425952a req-306c96ad-0153-4a81-9d12-9e17761b0c6a service nova] Creating event network-vif-plugged:e89117b2-5b89-4cd2-bc23-8423fcc10e38 for instance 2c2503ba-46e2-4b06-9675-c4cb842783ca on n-h2-master-1 Aug 07 01:38:51.594194 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-3e807676-0e29-4092-b3c8-492d5425952a req-306c96ad-0153-4a81-9d12-9e17761b0c6a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140014 Aug 07 01:38:51.595080 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2887/5311] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:38:51.805494 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6850c8b1-d81e-4c3f-9c1e-16cd7ea478bf tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:51.822630 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6850c8b1-d81e-4c3f-9c1e-16cd7ea478bf tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:51.848121 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6850c8b1-d81e-4c3f-9c1e-16cd7ea478bf tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:51.848956 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6850c8b1-d81e-4c3f-9c1e-16cd7ea478bf tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:51.851755 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6850c8b1-d81e-4c3f-9c1e-16cd7ea478bf tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:51.853330 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6850c8b1-d81e-4c3f-9c1e-16cd7ea478bf tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:51.857057 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6850c8b1-d81e-4c3f-9c1e-16cd7ea478bf tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:51.860307 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6850c8b1-d81e-4c3f-9c1e-16cd7ea478bf tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:52.040523 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-eeaa95ec-3293-40a0-9b5a-ee6e59714405 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:52.041492 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-eeaa95ec-3293-40a0-9b5a-ee6e59714405 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:52.071821 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eeaa95ec-3293-40a0-9b5a-ee6e59714405 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:52.072345 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eeaa95ec-3293-40a0-9b5a-ee6e59714405 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:52.077098 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eeaa95ec-3293-40a0-9b5a-ee6e59714405 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:52.078050 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eeaa95ec-3293-40a0-9b5a-ee6e59714405 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:52.079310 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eeaa95ec-3293-40a0-9b5a-ee6e59714405 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:52.082344 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eeaa95ec-3293-40a0-9b5a-ee6e59714405 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:52.405483 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6850c8b1-d81e-4c3f-9c1e-16cd7ea478bf tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:52.414460 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6850c8b1-d81e-4c3f-9c1e-16cd7ea478bf tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1724 microversion: 2.1 time: 0.612807 Aug 07 01:38:52.418100 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2425/5312] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:51 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1724 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:38:52.747034 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-eeaa95ec-3293-40a0-9b5a-ee6e59714405 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:52.764279 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-eeaa95ec-3293-40a0-9b5a-ee6e59714405 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:52.776518 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-eeaa95ec-3293-40a0-9b5a-ee6e59714405 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:52.778977 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-eeaa95ec-3293-40a0-9b5a-ee6e59714405 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1732 microversion: 2.20 time: 0.743106 Aug 07 01:38:52.782029 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2888/5313] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:38:52 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1732 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:38:53.441076 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c1ddf7f8-bf74-438d-bbf5-689acb3e12a8 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:53.447551 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c1ddf7f8-bf74-438d-bbf5-689acb3e12a8 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:53.484798 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c1ddf7f8-bf74-438d-bbf5-689acb3e12a8 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:53.498067 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c1ddf7f8-bf74-438d-bbf5-689acb3e12a8 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:53.498673 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c1ddf7f8-bf74-438d-bbf5-689acb3e12a8 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:53.499836 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c1ddf7f8-bf74-438d-bbf5-689acb3e12a8 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:53.501729 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c1ddf7f8-bf74-438d-bbf5-689acb3e12a8 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:53.504075 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c1ddf7f8-bf74-438d-bbf5-689acb3e12a8 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:53.812441 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3de8be3f-cf04-4bfc-a39d-5e67adea5e62 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:53.813138 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3de8be3f-cf04-4bfc-a39d-5e67adea5e62 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:53.837482 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3de8be3f-cf04-4bfc-a39d-5e67adea5e62 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:53.842166 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3de8be3f-cf04-4bfc-a39d-5e67adea5e62 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:53.842777 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3de8be3f-cf04-4bfc-a39d-5e67adea5e62 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:53.856237 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3de8be3f-cf04-4bfc-a39d-5e67adea5e62 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:53.856237 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3de8be3f-cf04-4bfc-a39d-5e67adea5e62 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:53.856237 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3de8be3f-cf04-4bfc-a39d-5e67adea5e62 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:54.048293 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c1ddf7f8-bf74-438d-bbf5-689acb3e12a8 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:54.066365 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c1ddf7f8-bf74-438d-bbf5-689acb3e12a8 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1724 microversion: 2.1 time: 0.632602 Aug 07 01:38:54.067351 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2426/5314] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:53 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1724 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:38:54.496740 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3de8be3f-cf04-4bfc-a39d-5e67adea5e62 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:54.506191 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3de8be3f-cf04-4bfc-a39d-5e67adea5e62 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:54.507702 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3de8be3f-cf04-4bfc-a39d-5e67adea5e62 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:54.512259 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3de8be3f-cf04-4bfc-a39d-5e67adea5e62 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1732 microversion: 2.20 time: 0.705349 Aug 07 01:38:54.513090 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2889/5315] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:38:53 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1732 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:38:55.099764 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1c8c1059-ed4a-41a9-87fe-7da77c4dbde7 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:55.101874 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1c8c1059-ed4a-41a9-87fe-7da77c4dbde7 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:55.119362 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c8c1059-ed4a-41a9-87fe-7da77c4dbde7 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:55.120464 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c8c1059-ed4a-41a9-87fe-7da77c4dbde7 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:55.121931 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c8c1059-ed4a-41a9-87fe-7da77c4dbde7 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:55.128864 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c8c1059-ed4a-41a9-87fe-7da77c4dbde7 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:55.130068 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c8c1059-ed4a-41a9-87fe-7da77c4dbde7 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:55.131156 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c8c1059-ed4a-41a9-87fe-7da77c4dbde7 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:55.302368 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-91daedd5-8168-43e1-8418-6310479175fb tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "baa19700-e95c-4e01-b0f6-2933f1bf3b7a"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:38:55.304868 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-91daedd5-8168-43e1-8418-6310479175fb tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:55.322600 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91daedd5-8168-43e1-8418-6310479175fb tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:55.323227 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91daedd5-8168-43e1-8418-6310479175fb tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:55.323706 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91daedd5-8168-43e1-8418-6310479175fb tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:55.324677 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91daedd5-8168-43e1-8418-6310479175fb tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:55.329829 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91daedd5-8168-43e1-8418-6310479175fb tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:55.331381 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91daedd5-8168-43e1-8418-6310479175fb tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:55.800246 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-91daedd5-8168-43e1-8418-6310479175fb tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "POST /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.501806 Aug 07 01:38:55.825198 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2890/5316] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Aug 7 01:38:55 2022] POST /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-volume_attachments => generated 194 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:38:55.844677 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-249db481-d4b8-44fd-9c39-d4c6f914a9ea tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:55.845673 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-249db481-d4b8-44fd-9c39-d4c6f914a9ea tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:55.862578 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-249db481-d4b8-44fd-9c39-d4c6f914a9ea tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:55.863690 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-249db481-d4b8-44fd-9c39-d4c6f914a9ea tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:55.864223 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-249db481-d4b8-44fd-9c39-d4c6f914a9ea tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:55.865650 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-249db481-d4b8-44fd-9c39-d4c6f914a9ea tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:55.866531 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-249db481-d4b8-44fd-9c39-d4c6f914a9ea tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:55.867340 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-249db481-d4b8-44fd-9c39-d4c6f914a9ea tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:56.091798 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1c8c1059-ed4a-41a9-87fe-7da77c4dbde7 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:56.108190 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1c8c1059-ed4a-41a9-87fe-7da77c4dbde7 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1724 microversion: 2.1 time: 1.012869 Aug 07 01:38:56.114359 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2427/5317] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:55 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1724 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:38:56.378987 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-249db481-d4b8-44fd-9c39-d4c6f914a9ea tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:56.385914 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:56.392850 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-249db481-d4b8-44fd-9c39-d4c6f914a9ea tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:56.398766 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-249db481-d4b8-44fd-9c39-d4c6f914a9ea tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:56.402034 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-249db481-d4b8-44fd-9c39-d4c6f914a9ea tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1719 microversion: 2.20 time: 0.572680 Aug 07 01:38:56.409218 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2891/5318] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:38:55 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1719 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:38:57.147640 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c3c27f75-a955-4005-ae18-da026fbc884a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:57.149603 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c3c27f75-a955-4005-ae18-da026fbc884a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:57.165224 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3c27f75-a955-4005-ae18-da026fbc884a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:57.169648 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3c27f75-a955-4005-ae18-da026fbc884a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:57.171260 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3c27f75-a955-4005-ae18-da026fbc884a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:57.172903 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3c27f75-a955-4005-ae18-da026fbc884a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:57.174349 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3c27f75-a955-4005-ae18-da026fbc884a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:57.176393 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3c27f75-a955-4005-ae18-da026fbc884a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:57.434796 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c3c27f75-a955-4005-ae18-da026fbc884a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:57.468888 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c3c27f75-a955-4005-ae18-da026fbc884a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1724 microversion: 2.1 time: 0.319905 Aug 07 01:38:57.476450 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2428/5319] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:57 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1724 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:38:58.492340 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-32aebed8-7596-43f9-96de-b0a619a6f77b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:58.492966 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-32aebed8-7596-43f9-96de-b0a619a6f77b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:58.523137 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32aebed8-7596-43f9-96de-b0a619a6f77b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:58.526530 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32aebed8-7596-43f9-96de-b0a619a6f77b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:58.527914 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32aebed8-7596-43f9-96de-b0a619a6f77b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:58.531860 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32aebed8-7596-43f9-96de-b0a619a6f77b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:58.536402 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32aebed8-7596-43f9-96de-b0a619a6f77b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:58.539359 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32aebed8-7596-43f9-96de-b0a619a6f77b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:58.903353 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-32aebed8-7596-43f9-96de-b0a619a6f77b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:38:58.915062 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-32aebed8-7596-43f9-96de-b0a619a6f77b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1724 microversion: 2.1 time: 0.426567 Aug 07 01:38:58.923976 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2892/5320] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:58 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1724 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:38:59.949710 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8ff609d1-5ddb-42c6-9cde-6ab7f370c569 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:38:59.952147 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8ff609d1-5ddb-42c6-9cde-6ab7f370c569 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:38:59.970546 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8ff609d1-5ddb-42c6-9cde-6ab7f370c569 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:59.972235 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8ff609d1-5ddb-42c6-9cde-6ab7f370c569 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:59.973697 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8ff609d1-5ddb-42c6-9cde-6ab7f370c569 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:38:59.976500 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8ff609d1-5ddb-42c6-9cde-6ab7f370c569 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:38:59.978392 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8ff609d1-5ddb-42c6-9cde-6ab7f370c569 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:38:59.981369 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8ff609d1-5ddb-42c6-9cde-6ab7f370c569 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:00.463149 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8ff609d1-5ddb-42c6-9cde-6ab7f370c569 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:00.474673 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8ff609d1-5ddb-42c6-9cde-6ab7f370c569 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1724 microversion: 2.1 time: 0.529864 Aug 07 01:39:00.478719 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2429/5321] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:38:59 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1724 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:39:01.501803 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7f1a7497-a41c-4a27-9d16-f152f3abb9ff tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:01.503043 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7f1a7497-a41c-4a27-9d16-f152f3abb9ff tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:01.513667 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f1a7497-a41c-4a27-9d16-f152f3abb9ff tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:01.514481 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f1a7497-a41c-4a27-9d16-f152f3abb9ff tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:01.515153 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f1a7497-a41c-4a27-9d16-f152f3abb9ff tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:01.516003 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f1a7497-a41c-4a27-9d16-f152f3abb9ff tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:01.516657 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f1a7497-a41c-4a27-9d16-f152f3abb9ff tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:01.517320 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f1a7497-a41c-4a27-9d16-f152f3abb9ff tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:01.794523 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7f1a7497-a41c-4a27-9d16-f152f3abb9ff tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:01.818619 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7f1a7497-a41c-4a27-9d16-f152f3abb9ff tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1724 microversion: 2.1 time: 0.320570 Aug 07 01:39:01.822536 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2893/5322] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:39:01 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1724 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:39:02.846048 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-65b04b71-0a95-4056-8451-6884571520db tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:02.847810 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-65b04b71-0a95-4056-8451-6884571520db tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:02.852121 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=36 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:39:02.870116 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-65b04b71-0a95-4056-8451-6884571520db tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:02.872693 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-65b04b71-0a95-4056-8451-6884571520db tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:02.874016 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-65b04b71-0a95-4056-8451-6884571520db tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:02.875667 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-65b04b71-0a95-4056-8451-6884571520db tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:02.878533 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-65b04b71-0a95-4056-8451-6884571520db tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:02.880253 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-65b04b71-0a95-4056-8451-6884571520db tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:03.576594 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-65b04b71-0a95-4056-8451-6884571520db tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:03.590169 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-65b04b71-0a95-4056-8451-6884571520db tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1701 microversion: 2.1 time: 0.747758 Aug 07 01:39:03.591931 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2430/5323] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:39:02 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1701 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:39:03.622288 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1d81faf7-d5f7-4393-bd96-64f4d985c134 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:39:03.640589 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d81faf7-d5f7-4393-bd96-64f4d985c134 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:03.641105 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d81faf7-d5f7-4393-bd96-64f4d985c134 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:03.641562 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d81faf7-d5f7-4393-bd96-64f4d985c134 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:03.686569 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1d81faf7-d5f7-4393-bd96-64f4d985c134 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Going to try to start instance {{(pid=119516) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 07 01:39:03.757209 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1d81faf7-d5f7-4393-bd96-64f4d985c134 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "POST /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976/action" status: 202 len: 0 microversion: 2.1 time: 0.142699 Aug 07 01:39:03.767801 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-32659ba2-5ce6-436f-869f-6cd588823073 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:03.768477 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-32659ba2-5ce6-436f-869f-6cd588823073 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:03.774597 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2894/5324] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:39:03 2022] POST /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:39:03.779985 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-32659ba2-5ce6-436f-869f-6cd588823073 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:03.780546 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-32659ba2-5ce6-436f-869f-6cd588823073 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:03.781507 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-32659ba2-5ce6-436f-869f-6cd588823073 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:03.784375 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-32659ba2-5ce6-436f-869f-6cd588823073 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:03.785715 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-32659ba2-5ce6-436f-869f-6cd588823073 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:03.786352 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-32659ba2-5ce6-436f-869f-6cd588823073 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:04.838646 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-32659ba2-5ce6-436f-869f-6cd588823073 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:04.876590 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-32659ba2-5ce6-436f-869f-6cd588823073 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1710 microversion: 2.1 time: 1.112841 Aug 07 01:39:04.893858 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2431/5325] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:39:03 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1710 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:39:05.918403 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-82a99747-6216-42f6-b3d5-da286dc60e42 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:05.922577 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-82a99747-6216-42f6-b3d5-da286dc60e42 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:05.938654 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-82a99747-6216-42f6-b3d5-da286dc60e42 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:05.947795 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-82a99747-6216-42f6-b3d5-da286dc60e42 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:05.949200 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-82a99747-6216-42f6-b3d5-da286dc60e42 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:05.956990 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-82a99747-6216-42f6-b3d5-da286dc60e42 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:05.957709 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-82a99747-6216-42f6-b3d5-da286dc60e42 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:05.958170 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-82a99747-6216-42f6-b3d5-da286dc60e42 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:07.418436 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-82a99747-6216-42f6-b3d5-da286dc60e42 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:07.445507 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-82a99747-6216-42f6-b3d5-da286dc60e42 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1710 microversion: 2.1 time: 1.531452 Aug 07 01:39:07.447367 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2895/5326] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:39:05 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1710 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:39:08.471229 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-96386a65-d727-4a53-a2a2-b8e1afc76c83 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:08.472004 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-96386a65-d727-4a53-a2a2-b8e1afc76c83 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:08.485891 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-96386a65-d727-4a53-a2a2-b8e1afc76c83 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:08.488898 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-96386a65-d727-4a53-a2a2-b8e1afc76c83 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:08.489695 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-96386a65-d727-4a53-a2a2-b8e1afc76c83 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:08.492739 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-96386a65-d727-4a53-a2a2-b8e1afc76c83 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:08.493490 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-96386a65-d727-4a53-a2a2-b8e1afc76c83 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:08.494038 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-96386a65-d727-4a53-a2a2-b8e1afc76c83 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:09.502100 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-96386a65-d727-4a53-a2a2-b8e1afc76c83 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:09.513000 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-96386a65-d727-4a53-a2a2-b8e1afc76c83 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1714 microversion: 2.1 time: 1.046127 Aug 07 01:39:09.513594 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2432/5327] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:39:08 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1714 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:39:12.205155 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-05e9d5ab-5a43-48b2-9f87-6be2721504ed tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:39:12.207877 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-05e9d5ab-5a43-48b2-9f87-6be2721504ed tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:12.239458 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05e9d5ab-5a43-48b2-9f87-6be2721504ed tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:12.239997 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05e9d5ab-5a43-48b2-9f87-6be2721504ed tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:12.240447 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05e9d5ab-5a43-48b2-9f87-6be2721504ed tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:12.245187 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05e9d5ab-5a43-48b2-9f87-6be2721504ed tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:12.261568 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05e9d5ab-5a43-48b2-9f87-6be2721504ed tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:12.262545 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-05e9d5ab-5a43-48b2-9f87-6be2721504ed tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:12.339912 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-05e9d5ab-5a43-48b2-9f87-6be2721504ed tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lazy-loading 'flavor' on Instance uuid d91eb969-4da0-4789-a33c-73a27d5cef97 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:39:12.533125 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-05e9d5ab-5a43-48b2-9f87-6be2721504ed tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "POST /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/action" status: 200 len: 32 microversion: 2.1 time: 0.332028 Aug 07 01:39:12.535276 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2896/5328] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:39:12 2022] POST /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/action => generated 32 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:39:12.546153 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6c7877a4-9fdb-4250-9f50-45d6e8b1e86a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:12.546884 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6c7877a4-9fdb-4250-9f50-45d6e8b1e86a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:12.561393 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c7877a4-9fdb-4250-9f50-45d6e8b1e86a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:12.562848 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c7877a4-9fdb-4250-9f50-45d6e8b1e86a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:12.564359 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c7877a4-9fdb-4250-9f50-45d6e8b1e86a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:12.566445 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c7877a4-9fdb-4250-9f50-45d6e8b1e86a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:12.567002 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c7877a4-9fdb-4250-9f50-45d6e8b1e86a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:12.568028 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c7877a4-9fdb-4250-9f50-45d6e8b1e86a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:13.136069 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6c7877a4-9fdb-4250-9f50-45d6e8b1e86a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:13.146953 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6c7877a4-9fdb-4250-9f50-45d6e8b1e86a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1735 microversion: 2.1 time: 0.605990 Aug 07 01:39:13.162202 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2433/5329] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:39:12 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1735 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:39:14.172754 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-194af4f7-7c56-42b7-a09d-9623ad7982f8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:14.173487 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-194af4f7-7c56-42b7-a09d-9623ad7982f8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:14.194001 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-194af4f7-7c56-42b7-a09d-9623ad7982f8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:14.194503 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-194af4f7-7c56-42b7-a09d-9623ad7982f8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:14.194950 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-194af4f7-7c56-42b7-a09d-9623ad7982f8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:14.195673 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-194af4f7-7c56-42b7-a09d-9623ad7982f8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:14.201500 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-194af4f7-7c56-42b7-a09d-9623ad7982f8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:14.201869 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-194af4f7-7c56-42b7-a09d-9623ad7982f8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:14.690839 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-194af4f7-7c56-42b7-a09d-9623ad7982f8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:14.708820 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-194af4f7-7c56-42b7-a09d-9623ad7982f8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1735 microversion: 2.1 time: 0.541737 Aug 07 01:39:14.710176 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2897/5330] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:39:14 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1735 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:39:15.730738 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-81ec0df0-3901-4d16-8f88-5177bcbd214e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:15.732003 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-81ec0df0-3901-4d16-8f88-5177bcbd214e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:15.749295 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-81ec0df0-3901-4d16-8f88-5177bcbd214e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:15.750571 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-81ec0df0-3901-4d16-8f88-5177bcbd214e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:15.755170 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-81ec0df0-3901-4d16-8f88-5177bcbd214e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:15.764513 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-81ec0df0-3901-4d16-8f88-5177bcbd214e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:15.765779 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-81ec0df0-3901-4d16-8f88-5177bcbd214e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:15.766776 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-81ec0df0-3901-4d16-8f88-5177bcbd214e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:15.782215 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=79 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:39:16.042705 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-81ec0df0-3901-4d16-8f88-5177bcbd214e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:16.053045 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-81ec0df0-3901-4d16-8f88-5177bcbd214e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1735 microversion: 2.1 time: 0.326161 Aug 07 01:39:16.055035 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2434/5331] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:39:15 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1735 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:39:17.076645 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-014adbf8-85ca-4ed7-b242-d88b16abe074 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:17.077273 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-014adbf8-85ca-4ed7-b242-d88b16abe074 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:17.089856 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-014adbf8-85ca-4ed7-b242-d88b16abe074 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:17.090365 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-014adbf8-85ca-4ed7-b242-d88b16abe074 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:17.090813 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-014adbf8-85ca-4ed7-b242-d88b16abe074 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:17.091549 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-014adbf8-85ca-4ed7-b242-d88b16abe074 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:17.092042 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-014adbf8-85ca-4ed7-b242-d88b16abe074 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:17.092479 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-014adbf8-85ca-4ed7-b242-d88b16abe074 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:17.098929 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4fecbfcc-a1dc-4d4f-9b22-67c63c87475d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:17.100496 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4fecbfcc-a1dc-4d4f-9b22-67c63c87475d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:17.109586 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4fecbfcc-a1dc-4d4f-9b22-67c63c87475d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:17.112188 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4fecbfcc-a1dc-4d4f-9b22-67c63c87475d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:17.112925 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4fecbfcc-a1dc-4d4f-9b22-67c63c87475d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:17.114051 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4fecbfcc-a1dc-4d4f-9b22-67c63c87475d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:17.114767 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4fecbfcc-a1dc-4d4f-9b22-67c63c87475d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:17.115446 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4fecbfcc-a1dc-4d4f-9b22-67c63c87475d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:17.164529 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4fecbfcc-a1dc-4d4f-9b22-67c63c87475d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9/ips" status: 200 len: 149 microversion: 2.1 time: 0.076121 Aug 07 01:39:17.185892 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2435/5332] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Aug 7 01:39:17 2022] GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9/ips => generated 149 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:39:17.570290 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-014adbf8-85ca-4ed7-b242-d88b16abe074 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:17.580664 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-014adbf8-85ca-4ed7-b242-d88b16abe074 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1735 microversion: 2.1 time: 0.508546 Aug 07 01:39:17.585147 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2898/5333] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:39:17 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1735 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:39:18.607458 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-44f475f0-1e8b-4fcd-8815-a28d4a430100 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:18.608977 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-44f475f0-1e8b-4fcd-8815-a28d4a430100 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:18.621431 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44f475f0-1e8b-4fcd-8815-a28d4a430100 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:18.622753 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44f475f0-1e8b-4fcd-8815-a28d4a430100 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:18.623487 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44f475f0-1e8b-4fcd-8815-a28d4a430100 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:18.624511 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44f475f0-1e8b-4fcd-8815-a28d4a430100 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:18.625319 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44f475f0-1e8b-4fcd-8815-a28d4a430100 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:18.626678 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44f475f0-1e8b-4fcd-8815-a28d4a430100 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:19.315491 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-44f475f0-1e8b-4fcd-8815-a28d4a430100 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:19.324276 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-44f475f0-1e8b-4fcd-8815-a28d4a430100 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1735 microversion: 2.1 time: 0.722245 Aug 07 01:39:19.324859 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2436/5334] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:39:18 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1735 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:39:19.863924 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-945a1a39-c466-413e-8a55-70318e08f251 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76a3cd62-2c24-4894-8ada-e694f7225141"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:39:19.867097 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-945a1a39-c466-413e-8a55-70318e08f251 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:19.874014 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=28 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:39:19.875786 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-945a1a39-c466-413e-8a55-70318e08f251 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:19.879824 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-945a1a39-c466-413e-8a55-70318e08f251 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:19.880610 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-945a1a39-c466-413e-8a55-70318e08f251 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:19.881582 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-945a1a39-c466-413e-8a55-70318e08f251 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:19.882254 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-945a1a39-c466-413e-8a55-70318e08f251 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:19.882896 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-945a1a39-c466-413e-8a55-70318e08f251 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:20.346572 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ed5749c3-130f-42d3-85c1-a2d082d70502 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:20.347195 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ed5749c3-130f-42d3-85c1-a2d082d70502 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:20.354410 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-945a1a39-c466-413e-8a55-70318e08f251 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "POST /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.494355 Aug 07 01:39:20.355698 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2899/5335] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Aug 7 01:39:19 2022] POST /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9/os-volume_attachments => generated 194 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:39:20.362599 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed5749c3-130f-42d3-85c1-a2d082d70502 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:20.363093 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed5749c3-130f-42d3-85c1-a2d082d70502 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:20.363534 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed5749c3-130f-42d3-85c1-a2d082d70502 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:20.368727 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed5749c3-130f-42d3-85c1-a2d082d70502 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:20.369266 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed5749c3-130f-42d3-85c1-a2d082d70502 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:20.369822 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed5749c3-130f-42d3-85c1-a2d082d70502 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:20.798596 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ed5749c3-130f-42d3-85c1-a2d082d70502 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:20.812116 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ed5749c3-130f-42d3-85c1-a2d082d70502 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1735 microversion: 2.1 time: 0.469555 Aug 07 01:39:20.823965 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2437/5336] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:39:20 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1735 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:39:21.840471 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e6a4d5c4-24a3-425a-8322-5ddac039c2dc tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:21.841285 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e6a4d5c4-24a3-425a-8322-5ddac039c2dc tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:21.861502 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6a4d5c4-24a3-425a-8322-5ddac039c2dc tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:21.862309 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6a4d5c4-24a3-425a-8322-5ddac039c2dc tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:21.862911 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6a4d5c4-24a3-425a-8322-5ddac039c2dc tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:21.863715 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6a4d5c4-24a3-425a-8322-5ddac039c2dc tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:21.877556 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6a4d5c4-24a3-425a-8322-5ddac039c2dc tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:21.884715 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6a4d5c4-24a3-425a-8322-5ddac039c2dc tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:22.173729 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e6a4d5c4-24a3-425a-8322-5ddac039c2dc tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:22.190181 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e6a4d5c4-24a3-425a-8322-5ddac039c2dc tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1735 microversion: 2.1 time: 0.354058 Aug 07 01:39:22.205470 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2900/5337] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:39:21 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1735 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:39:23.216750 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-efeda173-8f9c-4322-a1bc-525c31ca69f7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:23.217647 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-efeda173-8f9c-4322-a1bc-525c31ca69f7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:23.234850 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-efeda173-8f9c-4322-a1bc-525c31ca69f7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:23.236750 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-efeda173-8f9c-4322-a1bc-525c31ca69f7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:23.241770 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-efeda173-8f9c-4322-a1bc-525c31ca69f7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:23.243090 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-efeda173-8f9c-4322-a1bc-525c31ca69f7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:23.243751 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-efeda173-8f9c-4322-a1bc-525c31ca69f7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:23.245935 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-efeda173-8f9c-4322-a1bc-525c31ca69f7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:24.070694 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-efeda173-8f9c-4322-a1bc-525c31ca69f7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:24.089020 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-efeda173-8f9c-4322-a1bc-525c31ca69f7 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1735 microversion: 2.1 time: 0.876211 Aug 07 01:39:24.090357 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2438/5338] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:39:23 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1735 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:39:25.113950 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a7277eff-7113-4448-9dee-721f8a8a44c4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:25.114574 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a7277eff-7113-4448-9dee-721f8a8a44c4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:25.128721 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7277eff-7113-4448-9dee-721f8a8a44c4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:25.129273 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7277eff-7113-4448-9dee-721f8a8a44c4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:25.129666 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7277eff-7113-4448-9dee-721f8a8a44c4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:25.130368 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7277eff-7113-4448-9dee-721f8a8a44c4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:25.130824 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7277eff-7113-4448-9dee-721f8a8a44c4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:25.131250 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7277eff-7113-4448-9dee-721f8a8a44c4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:26.429963 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a7277eff-7113-4448-9dee-721f8a8a44c4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:26.446034 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a7277eff-7113-4448-9dee-721f8a8a44c4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1735 microversion: 2.1 time: 1.334527 Aug 07 01:39:26.451148 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2901/5339] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:39:25 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1735 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:39:27.472181 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c9cc1e62-528e-4e12-9d5a-c0b925031780 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:27.472808 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c9cc1e62-528e-4e12-9d5a-c0b925031780 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:27.485497 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c9cc1e62-528e-4e12-9d5a-c0b925031780 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:27.488291 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c9cc1e62-528e-4e12-9d5a-c0b925031780 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:27.491121 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c9cc1e62-528e-4e12-9d5a-c0b925031780 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:27.492092 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c9cc1e62-528e-4e12-9d5a-c0b925031780 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:27.493609 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c9cc1e62-528e-4e12-9d5a-c0b925031780 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:27.496061 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c9cc1e62-528e-4e12-9d5a-c0b925031780 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:27.805803 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c9cc1e62-528e-4e12-9d5a-c0b925031780 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:27.814801 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c9cc1e62-528e-4e12-9d5a-c0b925031780 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1735 microversion: 2.1 time: 0.346648 Aug 07 01:39:27.815387 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2439/5340] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:39:27 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1735 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:39:28.842546 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-eb0b499c-5b08-48b8-ba4d-c6a0c10db981 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:28.843362 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-eb0b499c-5b08-48b8-ba4d-c6a0c10db981 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:28.859107 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb0b499c-5b08-48b8-ba4d-c6a0c10db981 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:28.859774 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb0b499c-5b08-48b8-ba4d-c6a0c10db981 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:28.860356 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb0b499c-5b08-48b8-ba4d-c6a0c10db981 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:28.861194 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb0b499c-5b08-48b8-ba4d-c6a0c10db981 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:28.864422 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb0b499c-5b08-48b8-ba4d-c6a0c10db981 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:28.865108 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb0b499c-5b08-48b8-ba4d-c6a0c10db981 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:28.901056 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:39:29.217940 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-eb0b499c-5b08-48b8-ba4d-c6a0c10db981 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:29.228361 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-eb0b499c-5b08-48b8-ba4d-c6a0c10db981 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1735 microversion: 2.1 time: 0.391740 Aug 07 01:39:29.248745 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2902/5341] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:39:28 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1735 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:39:29.779606 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0a1997eb-bc91-494b-92b4-5c9e5406ca50 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:29.785984 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0a1997eb-bc91-494b-92b4-5c9e5406ca50 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:29.806047 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a1997eb-bc91-494b-92b4-5c9e5406ca50 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:29.810372 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a1997eb-bc91-494b-92b4-5c9e5406ca50 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:29.811035 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a1997eb-bc91-494b-92b4-5c9e5406ca50 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:29.811826 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a1997eb-bc91-494b-92b4-5c9e5406ca50 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:29.814936 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a1997eb-bc91-494b-92b4-5c9e5406ca50 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:29.818547 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a1997eb-bc91-494b-92b4-5c9e5406ca50 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:29.908569 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0a1997eb-bc91-494b-92b4-5c9e5406ca50 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.133907 Aug 07 01:39:29.909605 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2440/5342] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Aug 7 01:39:29 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca/os-volume_attachments => generated 25 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:39:30.022858 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2ca9d61d-6c4f-41e3-807c-97e3c0a56f0c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:30.023399 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2ca9d61d-6c4f-41e3-807c-97e3c0a56f0c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:30.034726 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2ca9d61d-6c4f-41e3-807c-97e3c0a56f0c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:30.035436 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2ca9d61d-6c4f-41e3-807c-97e3c0a56f0c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:30.036087 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2ca9d61d-6c4f-41e3-807c-97e3c0a56f0c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:30.037065 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2ca9d61d-6c4f-41e3-807c-97e3c0a56f0c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:30.037723 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2ca9d61d-6c4f-41e3-807c-97e3c0a56f0c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:30.038346 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2ca9d61d-6c4f-41e3-807c-97e3c0a56f0c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:30.068776 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2ca9d61d-6c4f-41e3-807c-97e3c0a56f0c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:39:30.221852 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2ca9d61d-6c4f-41e3-807c-97e3c0a56f0c tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 204 len: 0 microversion: 2.20 time: 0.203716 Aug 07 01:39:30.223465 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2903/5343] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Aug 7 01:39:30 2022] DELETE /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 01:39:30.232182 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c269e14d-dc05-4682-a868-f565b714dec9 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:30.233155 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c269e14d-dc05-4682-a868-f565b714dec9 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:30.246317 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c269e14d-dc05-4682-a868-f565b714dec9 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:30.246824 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c269e14d-dc05-4682-a868-f565b714dec9 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:30.250557 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c269e14d-dc05-4682-a868-f565b714dec9 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:30.251626 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c269e14d-dc05-4682-a868-f565b714dec9 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:30.252297 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c269e14d-dc05-4682-a868-f565b714dec9 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:30.253282 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c269e14d-dc05-4682-a868-f565b714dec9 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:30.257334 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6f9950b8-923d-4005-98db-22be9e454c72 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:30.258039 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6f9950b8-923d-4005-98db-22be9e454c72 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:30.275715 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f9950b8-923d-4005-98db-22be9e454c72 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:30.276331 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f9950b8-923d-4005-98db-22be9e454c72 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:30.276973 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f9950b8-923d-4005-98db-22be9e454c72 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:30.278030 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f9950b8-923d-4005-98db-22be9e454c72 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:30.278640 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f9950b8-923d-4005-98db-22be9e454c72 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:30.280478 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f9950b8-923d-4005-98db-22be9e454c72 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:30.763488 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c269e14d-dc05-4682-a868-f565b714dec9 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:30.777275 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c269e14d-dc05-4682-a868-f565b714dec9 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:30.779057 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c269e14d-dc05-4682-a868-f565b714dec9 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:30.780494 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c269e14d-dc05-4682-a868-f565b714dec9 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1725 microversion: 2.20 time: 0.552874 Aug 07 01:39:30.786477 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2441/5344] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:39:30 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1725 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:39:30.874451 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6f9950b8-923d-4005-98db-22be9e454c72 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:30.896422 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6f9950b8-923d-4005-98db-22be9e454c72 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1735 microversion: 2.1 time: 0.643893 Aug 07 01:39:30.899778 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2904/5345] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:39:30 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1735 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:39:31.825732 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-868eac5d-2b37-42ce-bc87-aba5912b9a2d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:31.828766 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-868eac5d-2b37-42ce-bc87-aba5912b9a2d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:31.841000 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-868eac5d-2b37-42ce-bc87-aba5912b9a2d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:31.844877 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-868eac5d-2b37-42ce-bc87-aba5912b9a2d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:31.848220 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-868eac5d-2b37-42ce-bc87-aba5912b9a2d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:31.850710 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-868eac5d-2b37-42ce-bc87-aba5912b9a2d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:31.851302 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-868eac5d-2b37-42ce-bc87-aba5912b9a2d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:31.851761 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-868eac5d-2b37-42ce-bc87-aba5912b9a2d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:31.918168 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1f16fa53-c542-49da-a63c-9e3dba2bf68b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:31.918816 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1f16fa53-c542-49da-a63c-9e3dba2bf68b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:31.947872 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f16fa53-c542-49da-a63c-9e3dba2bf68b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:31.952954 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f16fa53-c542-49da-a63c-9e3dba2bf68b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:31.957960 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f16fa53-c542-49da-a63c-9e3dba2bf68b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:31.958787 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f16fa53-c542-49da-a63c-9e3dba2bf68b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:31.961274 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f16fa53-c542-49da-a63c-9e3dba2bf68b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:31.961779 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f16fa53-c542-49da-a63c-9e3dba2bf68b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:32.595111 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1f16fa53-c542-49da-a63c-9e3dba2bf68b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:32.612540 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1f16fa53-c542-49da-a63c-9e3dba2bf68b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1735 microversion: 2.1 time: 0.697984 Aug 07 01:39:32.615943 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2905/5346] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:39:31 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1735 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:39:33.199098 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-868eac5d-2b37-42ce-bc87-aba5912b9a2d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:33.214502 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-868eac5d-2b37-42ce-bc87-aba5912b9a2d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:33.217467 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-868eac5d-2b37-42ce-bc87-aba5912b9a2d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:33.220079 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-868eac5d-2b37-42ce-bc87-aba5912b9a2d tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1725 microversion: 2.20 time: 1.402470 Aug 07 01:39:33.232662 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2442/5347] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:39:31 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1725 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:39:33.635630 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8428c393-3cd4-46e2-b75d-3fde793516c6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:33.636482 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8428c393-3cd4-46e2-b75d-3fde793516c6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:33.646096 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8428c393-3cd4-46e2-b75d-3fde793516c6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:33.652765 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8428c393-3cd4-46e2-b75d-3fde793516c6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:33.653332 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8428c393-3cd4-46e2-b75d-3fde793516c6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:33.654490 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8428c393-3cd4-46e2-b75d-3fde793516c6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:33.655378 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8428c393-3cd4-46e2-b75d-3fde793516c6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:33.657176 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8428c393-3cd4-46e2-b75d-3fde793516c6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:34.045785 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8428c393-3cd4-46e2-b75d-3fde793516c6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:34.055265 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8428c393-3cd4-46e2-b75d-3fde793516c6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1735 microversion: 2.1 time: 0.424188 Aug 07 01:39:34.057094 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2906/5348] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:39:33 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1735 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:39:34.249589 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-62f4522b-ca1d-42ea-8594-b858bae46c3e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:34.251146 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-62f4522b-ca1d-42ea-8594-b858bae46c3e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:34.254479 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=26 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:39:34.276634 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-62f4522b-ca1d-42ea-8594-b858bae46c3e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:34.277758 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-62f4522b-ca1d-42ea-8594-b858bae46c3e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:34.280049 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-62f4522b-ca1d-42ea-8594-b858bae46c3e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:34.282041 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-62f4522b-ca1d-42ea-8594-b858bae46c3e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:34.282769 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-62f4522b-ca1d-42ea-8594-b858bae46c3e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:34.283950 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-62f4522b-ca1d-42ea-8594-b858bae46c3e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:34.742404 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-62f4522b-ca1d-42ea-8594-b858bae46c3e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:34.762084 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-62f4522b-ca1d-42ea-8594-b858bae46c3e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:34.763851 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-62f4522b-ca1d-42ea-8594-b858bae46c3e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:34.765293 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-62f4522b-ca1d-42ea-8594-b858bae46c3e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1725 microversion: 2.20 time: 0.521541 Aug 07 01:39:34.792376 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2443/5349] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:39:34 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1725 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:39:35.080148 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a34a9ad7-e7f4-4526-a60d-ecf5c41a7ce8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:35.080779 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a34a9ad7-e7f4-4526-a60d-ecf5c41a7ce8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:35.092215 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a34a9ad7-e7f4-4526-a60d-ecf5c41a7ce8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:35.093027 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a34a9ad7-e7f4-4526-a60d-ecf5c41a7ce8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:35.093632 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a34a9ad7-e7f4-4526-a60d-ecf5c41a7ce8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:35.094571 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a34a9ad7-e7f4-4526-a60d-ecf5c41a7ce8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:35.095256 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a34a9ad7-e7f4-4526-a60d-ecf5c41a7ce8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:35.098042 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a34a9ad7-e7f4-4526-a60d-ecf5c41a7ce8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:35.623594 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-bd07e6d7-e203-414e-aa95-c5c885f88d92 req-c010eeb6-b20a-4e1f-ac4c-e148b96f405d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c2503ba-46e2-4b06-9675-c4cb842783ca", "name": "network-vif-deleted", "tag": "e89117b2-5b89-4cd2-bc23-8423fcc10e38"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:39:35.647502 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-bd07e6d7-e203-414e-aa95-c5c885f88d92 req-c010eeb6-b20a-4e1f-ac4c-e148b96f405d service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:35.647918 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-bd07e6d7-e203-414e-aa95-c5c885f88d92 req-c010eeb6-b20a-4e1f-ac4c-e148b96f405d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:35.648518 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-bd07e6d7-e203-414e-aa95-c5c885f88d92 req-c010eeb6-b20a-4e1f-ac4c-e148b96f405d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:35.676204 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-bd07e6d7-e203-414e-aa95-c5c885f88d92 req-c010eeb6-b20a-4e1f-ac4c-e148b96f405d service nova] Creating event network-vif-deleted:e89117b2-5b89-4cd2-bc23-8423fcc10e38 for instance 2c2503ba-46e2-4b06-9675-c4cb842783ca on n-h2-master-1 Aug 07 01:39:35.692971 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-bd07e6d7-e203-414e-aa95-c5c885f88d92 req-c010eeb6-b20a-4e1f-ac4c-e148b96f405d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073873 Aug 07 01:39:35.692971 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2444/5350] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:39:35.727815 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a34a9ad7-e7f4-4526-a60d-ecf5c41a7ce8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:35.748296 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a34a9ad7-e7f4-4526-a60d-ecf5c41a7ce8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1735 microversion: 2.1 time: 0.670506 Aug 07 01:39:35.750723 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2907/5351] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:39:35 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1735 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:39:35.793705 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6117bf52-1551-4893-9432-956920a6b253 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:35.794686 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6117bf52-1551-4893-9432-956920a6b253 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:35.815298 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6117bf52-1551-4893-9432-956920a6b253 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:35.816040 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6117bf52-1551-4893-9432-956920a6b253 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:35.816430 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6117bf52-1551-4893-9432-956920a6b253 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:35.820685 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6117bf52-1551-4893-9432-956920a6b253 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:35.821268 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6117bf52-1551-4893-9432-956920a6b253 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:35.821747 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6117bf52-1551-4893-9432-956920a6b253 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:35.917079 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6117bf52-1551-4893-9432-956920a6b253 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:35.917571 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6117bf52-1551-4893-9432-956920a6b253 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:35.918013 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6117bf52-1551-4893-9432-956920a6b253 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:35.918476 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-6117bf52-1551-4893-9432-956920a6b253 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lazy-loading 'fault' on Instance uuid 2c2503ba-46e2-4b06-9675-c4cb842783ca {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:39:35.995567 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6117bf52-1551-4893-9432-956920a6b253 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:36.004453 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6117bf52-1551-4893-9432-956920a6b253 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:36.009823 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6117bf52-1551-4893-9432-956920a6b253 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bed65a4d62184f52af3d2dd322eeec47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '284c227cd03a4c1294ed40d7b1594d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:36.013225 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6117bf52-1551-4893-9432-956920a6b253 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 200 len: 1372 microversion: 2.20 time: 0.224416 Aug 07 01:39:36.019349 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2445/5352] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:39:35 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 1372 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:39:36.770640 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8c8c108b-0ee6-4c72-a878-26abf119856c tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:36.771276 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8c8c108b-0ee6-4c72-a878-26abf119856c tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:36.789407 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8c8c108b-0ee6-4c72-a878-26abf119856c tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:36.790154 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8c8c108b-0ee6-4c72-a878-26abf119856c tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:36.791359 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8c8c108b-0ee6-4c72-a878-26abf119856c tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:36.792278 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8c8c108b-0ee6-4c72-a878-26abf119856c tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:36.792917 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8c8c108b-0ee6-4c72-a878-26abf119856c tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:36.793508 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8c8c108b-0ee6-4c72-a878-26abf119856c tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:37.043685 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-47d77d77-fa0d-4cb9-bc8f-83d3b1e46010 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:37.044330 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-47d77d77-fa0d-4cb9-bc8f-83d3b1e46010 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:37.062877 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-47d77d77-fa0d-4cb9-bc8f-83d3b1e46010 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:37.063379 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-47d77d77-fa0d-4cb9-bc8f-83d3b1e46010 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:37.063825 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-47d77d77-fa0d-4cb9-bc8f-83d3b1e46010 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:37.065136 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-47d77d77-fa0d-4cb9-bc8f-83d3b1e46010 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:37.065540 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-47d77d77-fa0d-4cb9-bc8f-83d3b1e46010 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:37.069122 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-47d77d77-fa0d-4cb9-bc8f-83d3b1e46010 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:37.090481 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-47d77d77-fa0d-4cb9-bc8f-83d3b1e46010 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] HTTP exception thrown: Instance 2c2503ba-46e2-4b06-9675-c4cb842783ca could not be found. Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-47d77d77-fa0d-4cb9-bc8f-83d3b1e46010 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Request method failure captured: Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca HTTP/1.1 Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xYYE_Y2FKv6zZ-7Zkxg2nvfkmjHNhq8c_yKwZxcLvYOOyyIq8uAferdUqGnDwpFS2QC6mWyOffIFr9qPy7uHg72JIuPriVMKOHOuSjKFlawCqsqSD8KzCrH58SWYZ4TQRVX3TPFeio4AWgC3hNQePrvrMuhXhOysJV4QaOUSTy-8aQ Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: X-Openstack-Nova-Api-Version: 2.20 Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 284c227cd03a4c1294ed40d7b1594d56 Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-660714485 Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/284c227cd03a4c1294ed40d7b1594d56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_284c227cd03a4c1294ed40d7b1594d56", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/284c227cd03a4c1294ed40d7b1594d56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/284c227cd03a4c1294ed40d7b1594d56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-AttachVolumeShelveTestJSON-660714485 Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 284c227cd03a4c1294ed40d7b1594d56 Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-660714485 Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-AttachVolumeShelveTestJSON-660714485-project Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: bed65a4d62184f52af3d2dd322eeec47 Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-AttachVolumeShelveTestJSON-660714485-project Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 2c2503ba-46e2-4b06-9675-c4cb842783ca could not be found. Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '2c2503ba-46e2-4b06-9675-c4cb842783ca'} Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c2503ba-46e2-4b06-9675-c4cb842783ca could not be found. Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c2503ba-46e2-4b06-9675-c4cb842783ca could not be found. Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:39:37.097917 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:39:37.101411 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:39:37.101411 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:39:37.101411 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:39:37.101411 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:39:37.101411 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:39:37.101411 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:39:37.101411 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c2503ba-46e2-4b06-9675-c4cb842783ca could not be found. Aug 07 01:39:37.101411 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:39:37.101411 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-47d77d77-fa0d-4cb9-bc8f-83d3b1e46010 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Returning 404 to user: Instance 2c2503ba-46e2-4b06-9675-c4cb842783ca could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:39:37.101411 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-47d77d77-fa0d-4cb9-bc8f-83d3b1e46010 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 404 len: 111 microversion: 2.20 time: 0.061563 Aug 07 01:39:37.112788 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2446/5353] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:39:37 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:39:37.118001 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5b5d1e22-e6b1-43de-8519-74d484d2ffdf tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '.version_select at 0x7f9e240d73a0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:37.178434 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5b5d1e22-e6b1-43de-8519-74d484d2ffdf tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1667813352" status: 204 len: 0 microversion: 2.20 time: 0.064385 Aug 07 01:39:37.179027 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2447/5354] 10.222.0.39 () {60 vars in 1262 bytes} [Sun Aug 7 01:39:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1667813352 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 01:39:37.640623 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8c8c108b-0ee6-4c72-a878-26abf119856c tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:37.659994 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8c8c108b-0ee6-4c72-a878-26abf119856c tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1735 microversion: 2.1 time: 0.892620 Aug 07 01:39:37.663387 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2908/5355] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:39:36 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1735 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:39:38.686862 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-783b77da-3657-4263-a0f3-3a12892aab01 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:38.688400 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-783b77da-3657-4263-a0f3-3a12892aab01 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:38.713205 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-783b77da-3657-4263-a0f3-3a12892aab01 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:38.714103 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-783b77da-3657-4263-a0f3-3a12892aab01 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:38.718743 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-783b77da-3657-4263-a0f3-3a12892aab01 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:38.721143 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-783b77da-3657-4263-a0f3-3a12892aab01 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:38.728495 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-783b77da-3657-4263-a0f3-3a12892aab01 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:38.729184 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-783b77da-3657-4263-a0f3-3a12892aab01 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:39.831862 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-783b77da-3657-4263-a0f3-3a12892aab01 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:39.848797 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-783b77da-3657-4263-a0f3-3a12892aab01 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1735 microversion: 2.1 time: 1.166043 Aug 07 01:39:39.849938 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2448/5356] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:39:38 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1735 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:39:40.815942 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-02dc0270-7909-490a-b167-6ca7dacaa3b3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:40.817099 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-02dc0270-7909-490a-b167-6ca7dacaa3b3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:40.825182 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-02dc0270-7909-490a-b167-6ca7dacaa3b3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:40.825996 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-02dc0270-7909-490a-b167-6ca7dacaa3b3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:40.826663 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-02dc0270-7909-490a-b167-6ca7dacaa3b3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:40.828142 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-02dc0270-7909-490a-b167-6ca7dacaa3b3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:40.828823 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-02dc0270-7909-490a-b167-6ca7dacaa3b3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:40.829630 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-02dc0270-7909-490a-b167-6ca7dacaa3b3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:40.871236 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-31529360-ab7d-4499-a834-76935f034585 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:40.872506 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-31529360-ab7d-4499-a834-76935f034585 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:40.882295 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-31529360-ab7d-4499-a834-76935f034585 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:40.883190 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-31529360-ab7d-4499-a834-76935f034585 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:40.883855 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-31529360-ab7d-4499-a834-76935f034585 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:40.885673 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-31529360-ab7d-4499-a834-76935f034585 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:40.886337 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-31529360-ab7d-4499-a834-76935f034585 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:40.887878 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-31529360-ab7d-4499-a834-76935f034585 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:41.166972 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-31529360-ab7d-4499-a834-76935f034585 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:41.179151 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-31529360-ab7d-4499-a834-76935f034585 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1735 microversion: 2.1 time: 0.312494 Aug 07 01:39:41.180217 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2449/5357] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:39:40 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1735 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:39:41.201316 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-02dc0270-7909-490a-b167-6ca7dacaa3b3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lazy-loading 'services' on Instance uuid ac218e0a-d325-4062-a13d-501e130105f9 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:39:41.330334 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-02dc0270-7909-490a-b167-6ca7dacaa3b3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9/os-volume_attachments/76a3cd62-2c24-4894-8ada-e694f7225141" status: 202 len: 0 microversion: 2.1 time: 0.519762 Aug 07 01:39:41.331661 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2909/5358] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Aug 7 01:39:40 2022] DELETE /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9/os-volume_attachments/76a3cd62-2c24-4894-8ada-e694f7225141 => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:39:41.342232 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1205ed63-4572-461c-8ee4-dffeaead119a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:41.346636 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1205ed63-4572-461c-8ee4-dffeaead119a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:41.357209 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1205ed63-4572-461c-8ee4-dffeaead119a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:41.357458 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1205ed63-4572-461c-8ee4-dffeaead119a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:41.358864 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1205ed63-4572-461c-8ee4-dffeaead119a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:41.360148 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1205ed63-4572-461c-8ee4-dffeaead119a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:41.361239 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1205ed63-4572-461c-8ee4-dffeaead119a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:41.361927 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1205ed63-4572-461c-8ee4-dffeaead119a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:41.405267 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1205ed63-4572-461c-8ee4-dffeaead119a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068806 Aug 07 01:39:41.406664 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2450/5359] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:39:41 2022] GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:39:42.206748 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cda3cbd7-139d-4fea-8e1d-0fe0b6e77528 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:42.208351 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cda3cbd7-139d-4fea-8e1d-0fe0b6e77528 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:42.233232 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cda3cbd7-139d-4fea-8e1d-0fe0b6e77528 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:42.236073 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cda3cbd7-139d-4fea-8e1d-0fe0b6e77528 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:42.236774 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cda3cbd7-139d-4fea-8e1d-0fe0b6e77528 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:42.248568 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cda3cbd7-139d-4fea-8e1d-0fe0b6e77528 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:42.257348 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cda3cbd7-139d-4fea-8e1d-0fe0b6e77528 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:42.264395 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cda3cbd7-139d-4fea-8e1d-0fe0b6e77528 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:42.432251 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5c4c8096-90ab-47c7-b32d-e1054d820cfe tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:42.441891 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5c4c8096-90ab-47c7-b32d-e1054d820cfe tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:42.460166 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c4c8096-90ab-47c7-b32d-e1054d820cfe tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:42.463716 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c4c8096-90ab-47c7-b32d-e1054d820cfe tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:42.464921 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c4c8096-90ab-47c7-b32d-e1054d820cfe tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:42.469255 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c4c8096-90ab-47c7-b32d-e1054d820cfe tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:42.474738 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c4c8096-90ab-47c7-b32d-e1054d820cfe tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:42.475325 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c4c8096-90ab-47c7-b32d-e1054d820cfe tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:42.568763 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5c4c8096-90ab-47c7-b32d-e1054d820cfe tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153760 Aug 07 01:39:42.585643 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2451/5360] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:39:42 2022] GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:39:42.832505 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ed172881-1acc-4b5a-b9a5-867aec4aab81 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:42.833032 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ed172881-1acc-4b5a-b9a5-867aec4aab81 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:42.840715 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed172881-1acc-4b5a-b9a5-867aec4aab81 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:42.841242 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed172881-1acc-4b5a-b9a5-867aec4aab81 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:42.841684 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed172881-1acc-4b5a-b9a5-867aec4aab81 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:42.842510 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed172881-1acc-4b5a-b9a5-867aec4aab81 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:42.843459 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed172881-1acc-4b5a-b9a5-867aec4aab81 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:42.843922 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed172881-1acc-4b5a-b9a5-867aec4aab81 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:43.105896 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-ed172881-1acc-4b5a-b9a5-867aec4aab81 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lazy-loading 'services' on Instance uuid 0d2f04ca-7c24-4d1a-a723-7cf3a8782976 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:39:43.144139 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:39:43.272740 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ed172881-1acc-4b5a-b9a5-867aec4aab81 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976/os-volume_attachments/8bcd6df0-c4b1-461a-bf09-7c0d4273af73" status: 202 len: 0 microversion: 2.1 time: 0.442016 Aug 07 01:39:43.277452 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2452/5361] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Aug 7 01:39:42 2022] DELETE /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976/os-volume_attachments/8bcd6df0-c4b1-461a-bf09-7c0d4273af73 => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 01:39:43.324401 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d6f93a66-eb0a-4a53-8cd5-d3f4eb82d7d1 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:43.325147 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d6f93a66-eb0a-4a53-8cd5-d3f4eb82d7d1 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:43.333520 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d6f93a66-eb0a-4a53-8cd5-d3f4eb82d7d1 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:43.334429 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d6f93a66-eb0a-4a53-8cd5-d3f4eb82d7d1 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:43.335193 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d6f93a66-eb0a-4a53-8cd5-d3f4eb82d7d1 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:43.336181 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d6f93a66-eb0a-4a53-8cd5-d3f4eb82d7d1 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:43.338279 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d6f93a66-eb0a-4a53-8cd5-d3f4eb82d7d1 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:43.339582 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d6f93a66-eb0a-4a53-8cd5-d3f4eb82d7d1 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:43.377583 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-d6f93a66-eb0a-4a53-8cd5-d3f4eb82d7d1 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] HTTP exception thrown: Instance 2c2503ba-46e2-4b06-9675-c4cb842783ca could not be found. Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d6f93a66-eb0a-4a53-8cd5-d3f4eb82d7d1 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Request method failure captured: Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca HTTP/1.1 Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xYYE_Y2FKv6zZ-7Zkxg2nvfkmjHNhq8c_yKwZxcLvYOOyyIq8uAferdUqGnDwpFS2QC6mWyOffIFr9qPy7uHg72JIuPriVMKOHOuSjKFlawCqsqSD8KzCrH58SWYZ4TQRVX3TPFeio4AWgC3hNQePrvrMuhXhOysJV4QaOUSTy-8aQ Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: X-Openstack-Nova-Api-Version: 2.20 Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 284c227cd03a4c1294ed40d7b1594d56 Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-660714485 Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/284c227cd03a4c1294ed40d7b1594d56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_284c227cd03a4c1294ed40d7b1594d56", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/284c227cd03a4c1294ed40d7b1594d56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/284c227cd03a4c1294ed40d7b1594d56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-AttachVolumeShelveTestJSON-660714485 Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 284c227cd03a4c1294ed40d7b1594d56 Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-660714485 Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-AttachVolumeShelveTestJSON-660714485-project Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: bed65a4d62184f52af3d2dd322eeec47 Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-AttachVolumeShelveTestJSON-660714485-project Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 2c2503ba-46e2-4b06-9675-c4cb842783ca could not be found. Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '2c2503ba-46e2-4b06-9675-c4cb842783ca'} Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c2503ba-46e2-4b06-9675-c4cb842783ca could not be found. Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:39:43.406120 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:39:43.410286 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c2503ba-46e2-4b06-9675-c4cb842783ca could not be found. Aug 07 01:39:43.410286 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:39:43.410286 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:39:43.410286 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:39:43.410286 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:39:43.410286 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:39:43.410286 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:39:43.410286 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:39:43.410286 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:39:43.410286 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c2503ba-46e2-4b06-9675-c4cb842783ca could not be found. Aug 07 01:39:43.410286 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:39:43.417341 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d6f93a66-eb0a-4a53-8cd5-d3f4eb82d7d1 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Returning 404 to user: Instance 2c2503ba-46e2-4b06-9675-c4cb842783ca could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:39:43.418853 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d6f93a66-eb0a-4a53-8cd5-d3f4eb82d7d1 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 404 len: 111 microversion: 2.20 time: 0.100700 Aug 07 01:39:43.419993 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2453/5362] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Aug 7 01:39:43 2022] DELETE /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 07 01:39:43.435810 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5a73e28f-92d3-451c-8916-864d7101ae1e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:43.437055 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5a73e28f-92d3-451c-8916-864d7101ae1e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 2c2503ba-46e2-4b06-9675-c4cb842783ca] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:43.445271 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a73e28f-92d3-451c-8916-864d7101ae1e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:43.446149 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a73e28f-92d3-451c-8916-864d7101ae1e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:43.447471 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a73e28f-92d3-451c-8916-864d7101ae1e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:43.448602 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a73e28f-92d3-451c-8916-864d7101ae1e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:43.449379 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a73e28f-92d3-451c-8916-864d7101ae1e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:43.450003 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a73e28f-92d3-451c-8916-864d7101ae1e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:43.486613 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-5a73e28f-92d3-451c-8916-864d7101ae1e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] HTTP exception thrown: Instance 2c2503ba-46e2-4b06-9675-c4cb842783ca could not be found. Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5a73e28f-92d3-451c-8916-864d7101ae1e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Request method failure captured: Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca HTTP/1.1 Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xYYE_Y2FKv6zZ-7Zkxg2nvfkmjHNhq8c_yKwZxcLvYOOyyIq8uAferdUqGnDwpFS2QC6mWyOffIFr9qPy7uHg72JIuPriVMKOHOuSjKFlawCqsqSD8KzCrH58SWYZ4TQRVX3TPFeio4AWgC3hNQePrvrMuhXhOysJV4QaOUSTy-8aQ Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: X-Openstack-Nova-Api-Version: 2.20 Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 284c227cd03a4c1294ed40d7b1594d56 Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-660714485 Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/284c227cd03a4c1294ed40d7b1594d56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_284c227cd03a4c1294ed40d7b1594d56", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/284c227cd03a4c1294ed40d7b1594d56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/284c227cd03a4c1294ed40d7b1594d56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-AttachVolumeShelveTestJSON-660714485 Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 284c227cd03a4c1294ed40d7b1594d56 Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-660714485 Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-AttachVolumeShelveTestJSON-660714485-project Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: bed65a4d62184f52af3d2dd322eeec47 Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-AttachVolumeShelveTestJSON-660714485-project Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 2c2503ba-46e2-4b06-9675-c4cb842783ca could not be found. Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '2c2503ba-46e2-4b06-9675-c4cb842783ca'} Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c2503ba-46e2-4b06-9675-c4cb842783ca could not be found. Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c2503ba-46e2-4b06-9675-c4cb842783ca could not be found. Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:39:43.492532 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:39:43.496773 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:39:43.496773 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:39:43.496773 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:39:43.496773 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:39:43.496773 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:39:43.496773 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:39:43.496773 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c2503ba-46e2-4b06-9675-c4cb842783ca could not be found. Aug 07 01:39:43.496773 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:39:43.496773 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5a73e28f-92d3-451c-8916-864d7101ae1e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Returning 404 to user: Instance 2c2503ba-46e2-4b06-9675-c4cb842783ca could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:39:43.496773 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5a73e28f-92d3-451c-8916-864d7101ae1e tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca" status: 404 len: 111 microversion: 2.20 time: 0.069972 Aug 07 01:39:43.500834 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2454/5363] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:39:43 2022] GET /compute/v2.1/servers/2c2503ba-46e2-4b06-9675-c4cb842783ca => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:39:43.592114 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-06a3b5b4-d1a6-4d04-b71e-613f0472dbd3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:43.594595 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-06a3b5b4-d1a6-4d04-b71e-613f0472dbd3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:43.610850 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06a3b5b4-d1a6-4d04-b71e-613f0472dbd3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:43.611589 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06a3b5b4-d1a6-4d04-b71e-613f0472dbd3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:43.612180 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06a3b5b4-d1a6-4d04-b71e-613f0472dbd3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:43.612905 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06a3b5b4-d1a6-4d04-b71e-613f0472dbd3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:43.615267 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06a3b5b4-d1a6-4d04-b71e-613f0472dbd3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:43.617518 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06a3b5b4-d1a6-4d04-b71e-613f0472dbd3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:43.705067 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-06a3b5b4-d1a6-4d04-b71e-613f0472dbd3 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117982 Aug 07 01:39:43.710271 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2455/5364] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:39:43 2022] GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:39:44.154212 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cda3cbd7-139d-4fea-8e1d-0fe0b6e77528 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:44.164773 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cda3cbd7-139d-4fea-8e1d-0fe0b6e77528 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1715 microversion: 2.1 time: 1.963185 Aug 07 01:39:44.177814 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2910/5365] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:39:42 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1715 bytes in 1977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:39:44.435762 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-433663c3-cc84-4e98-807d-640bb4623039 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:44.436518 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-433663c3-cc84-4e98-807d-640bb4623039 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:44.447579 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-433663c3-cc84-4e98-807d-640bb4623039 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:44.448153 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-433663c3-cc84-4e98-807d-640bb4623039 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:44.455546 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-433663c3-cc84-4e98-807d-640bb4623039 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:44.476871 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-433663c3-cc84-4e98-807d-640bb4623039 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:44.477780 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-433663c3-cc84-4e98-807d-640bb4623039 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:44.478590 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-433663c3-cc84-4e98-807d-640bb4623039 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:44.721724 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b3784371-0561-435a-856c-2988e6816b25 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:44.723341 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b3784371-0561-435a-856c-2988e6816b25 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:44.748979 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b3784371-0561-435a-856c-2988e6816b25 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:44.752898 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b3784371-0561-435a-856c-2988e6816b25 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:44.753533 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b3784371-0561-435a-856c-2988e6816b25 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:44.754488 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b3784371-0561-435a-856c-2988e6816b25 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:44.755095 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b3784371-0561-435a-856c-2988e6816b25 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:44.756586 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b3784371-0561-435a-856c-2988e6816b25 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:44.852380 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b3784371-0561-435a-856c-2988e6816b25 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138231 Aug 07 01:39:44.853085 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2911/5366] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:39:44 2022] GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:39:45.865736 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-96b58c3b-eb22-4eaf-900c-8a053155a8ea tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:45.868210 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-96b58c3b-eb22-4eaf-900c-8a053155a8ea tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:45.884376 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-96b58c3b-eb22-4eaf-900c-8a053155a8ea tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:45.885097 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-96b58c3b-eb22-4eaf-900c-8a053155a8ea tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:45.885731 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-96b58c3b-eb22-4eaf-900c-8a053155a8ea tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:45.886910 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-96b58c3b-eb22-4eaf-900c-8a053155a8ea tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:45.887542 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-96b58c3b-eb22-4eaf-900c-8a053155a8ea tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:45.888408 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-96b58c3b-eb22-4eaf-900c-8a053155a8ea tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:45.928047 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-96b58c3b-eb22-4eaf-900c-8a053155a8ea tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067314 Aug 07 01:39:45.929534 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2912/5367] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:39:45 2022] GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:39:46.976479 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-835d1d8a-0ec9-4330-b284-3ea2fd32c237 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:46.984656 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-835d1d8a-0ec9-4330-b284-3ea2fd32c237 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:46.994312 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-835d1d8a-0ec9-4330-b284-3ea2fd32c237 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:46.994984 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-835d1d8a-0ec9-4330-b284-3ea2fd32c237 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:46.995612 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-835d1d8a-0ec9-4330-b284-3ea2fd32c237 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:46.997198 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-835d1d8a-0ec9-4330-b284-3ea2fd32c237 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:46.997814 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-835d1d8a-0ec9-4330-b284-3ea2fd32c237 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:46.998394 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-835d1d8a-0ec9-4330-b284-3ea2fd32c237 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:47.051024 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-835d1d8a-0ec9-4330-b284-3ea2fd32c237 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114021 Aug 07 01:39:47.053095 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2913/5368] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:39:46 2022] GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:39:48.066011 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-347790f6-c415-438e-9954-fbb0d683095d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:48.068444 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-347790f6-c415-438e-9954-fbb0d683095d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:48.088761 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-347790f6-c415-438e-9954-fbb0d683095d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:48.092955 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-347790f6-c415-438e-9954-fbb0d683095d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:48.097431 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-347790f6-c415-438e-9954-fbb0d683095d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:48.101333 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-347790f6-c415-438e-9954-fbb0d683095d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:48.102006 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-347790f6-c415-438e-9954-fbb0d683095d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:48.102658 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-347790f6-c415-438e-9954-fbb0d683095d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:48.172302 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-347790f6-c415-438e-9954-fbb0d683095d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108490 Aug 07 01:39:48.176480 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2914/5369] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:39:48 2022] GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:39:49.188193 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c1a56f0c-af9c-4f02-b276-ff2f4e5fa7b7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:49.190938 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c1a56f0c-af9c-4f02-b276-ff2f4e5fa7b7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:49.207685 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1a56f0c-af9c-4f02-b276-ff2f4e5fa7b7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:49.208365 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1a56f0c-af9c-4f02-b276-ff2f4e5fa7b7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:49.208940 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1a56f0c-af9c-4f02-b276-ff2f4e5fa7b7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:49.209928 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1a56f0c-af9c-4f02-b276-ff2f4e5fa7b7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:49.210498 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1a56f0c-af9c-4f02-b276-ff2f4e5fa7b7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:49.211222 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1a56f0c-af9c-4f02-b276-ff2f4e5fa7b7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:49.249391 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c1a56f0c-af9c-4f02-b276-ff2f4e5fa7b7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065210 Aug 07 01:39:49.250241 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2915/5370] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:39:49 2022] GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:39:50.263813 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e38172a1-cbc3-49d2-bd23-3ea9f7ea3e8b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:50.266714 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e38172a1-cbc3-49d2-bd23-3ea9f7ea3e8b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:50.282963 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:39:50.292564 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e38172a1-cbc3-49d2-bd23-3ea9f7ea3e8b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:50.296544 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e38172a1-cbc3-49d2-bd23-3ea9f7ea3e8b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:50.297091 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e38172a1-cbc3-49d2-bd23-3ea9f7ea3e8b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:50.298066 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e38172a1-cbc3-49d2-bd23-3ea9f7ea3e8b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:50.299848 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e38172a1-cbc3-49d2-bd23-3ea9f7ea3e8b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:50.300540 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e38172a1-cbc3-49d2-bd23-3ea9f7ea3e8b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:50.364847 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:39:50.394051 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e38172a1-cbc3-49d2-bd23-3ea9f7ea3e8b tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135695 Aug 07 01:39:50.404772 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2916/5371] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:39:50 2022] GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:39:51.325088 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-433663c3-cc84-4e98-807d-640bb4623039 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] HTTP exception thrown: Cannot 'detach_volume' instance d91eb969-4da0-4789-a33c-73a27d5cef97 while it is in vm_state rescued Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-433663c3-cc84-4e98-807d-640bb4623039 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Request method failure captured: Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-volume_attachments/baa19700-e95c-4e01-b0f6-2933f1bf3b7a HTTP/1.1 Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xcFUTwOrsKbLuCg4An479LA9G9aDuSE7GEjV8VWyLtq1rxOhZ9Q8jcwtkvN3VeO8ggfh8KvRRX8HWvqee02PsBBf0WFvhZisgorTKvdssuK7IJ1NUIDzU8DRVfm2J3najrfJ74eq56eKh78U1nPClJkssFs7yS7oVt53yn2dEShWXQ Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 70f17360f0c84562bd99b006b659736e Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1195249405 Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/70f17360f0c84562bd99b006b659736e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_70f17360f0c84562bd99b006b659736e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/70f17360f0c84562bd99b006b659736e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/70f17360f0c84562bd99b006b659736e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1195249405 Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 70f17360f0c84562bd99b006b659736e Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1195249405 Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServerRescueNegativeTestJSON-1195249405-project Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 2f5acf7da18b43f89e24760744cfdb49 Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1195249405-project Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: exception: Cannot 'detach_volume' instance d91eb969-4da0-4789-a33c-73a27d5cef97 while it is in vm_state rescued Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: action_args: {'server_id': 'd91eb969-4da0-4789-a33c-73a27d5cef97', 'id': 'baa19700-e95c-4e01-b0f6-2933f1bf3b7a'} Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d91eb969-4da0-4789-a33c-73a27d5cef97 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d91eb969-4da0-4789-a33c-73a27d5cef97 while it is in vm_state rescued Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:39:51.326890 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:39:51.331002 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:39:51.331002 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:39:51.331002 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:39:51.331002 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:39:51.331002 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d91eb969-4da0-4789-a33c-73a27d5cef97 while it is in vm_state rescued Aug 07 01:39:51.331002 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:39:51.333062 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-433663c3-cc84-4e98-807d-640bb4623039 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Returning 409 to user: Cannot 'detach_volume' instance d91eb969-4da0-4789-a33c-73a27d5cef97 while it is in vm_state rescued {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:39:51.334460 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-433663c3-cc84-4e98-807d-640bb4623039 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-volume_attachments/baa19700-e95c-4e01-b0f6-2933f1bf3b7a" status: 409 len: 152 microversion: 2.1 time: 6.904388 Aug 07 01:39:51.340149 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2456/5372] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Aug 7 01:39:44 2022] DELETE /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-volume_attachments/baa19700-e95c-4e01-b0f6-2933f1bf3b7a => generated 152 bytes in 6911 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:39:51.348917 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fec97cd2-8e8c-475e-b633-0cf308d17432 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:39:51.350087 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fec97cd2-8e8c-475e-b633-0cf308d17432 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:51.366406 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fec97cd2-8e8c-475e-b633-0cf308d17432 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:51.370471 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fec97cd2-8e8c-475e-b633-0cf308d17432 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:51.373595 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fec97cd2-8e8c-475e-b633-0cf308d17432 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:51.374592 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fec97cd2-8e8c-475e-b633-0cf308d17432 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:51.375229 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fec97cd2-8e8c-475e-b633-0cf308d17432 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:51.380802 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fec97cd2-8e8c-475e-b633-0cf308d17432 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:51.416993 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6a879319-e97f-4a2d-8b4b-03283e8c9eaa tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:51.419551 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6a879319-e97f-4a2d-8b4b-03283e8c9eaa tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:51.433082 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a879319-e97f-4a2d-8b4b-03283e8c9eaa tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:51.435631 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a879319-e97f-4a2d-8b4b-03283e8c9eaa tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:51.451288 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a879319-e97f-4a2d-8b4b-03283e8c9eaa tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:51.452344 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a879319-e97f-4a2d-8b4b-03283e8c9eaa tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:51.453012 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a879319-e97f-4a2d-8b4b-03283e8c9eaa tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:51.453613 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a879319-e97f-4a2d-8b4b-03283e8c9eaa tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:51.527010 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6a879319-e97f-4a2d-8b4b-03283e8c9eaa tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.114034 Aug 07 01:39:51.534905 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2457/5373] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:39:51 2022] GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9/os-volume_attachments => generated 25 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 07 01:39:51.604537 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fec97cd2-8e8c-475e-b633-0cf308d17432 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "POST /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/action" status: 202 len: 0 microversion: 2.1 time: 0.259932 Aug 07 01:39:51.625270 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5f58e8fb-8f20-4aec-ac81-63aaa0494d81 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:51.625896 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5f58e8fb-8f20-4aec-ac81-63aaa0494d81 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:51.637155 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2917/5374] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:39:51 2022] POST /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:39:51.639247 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f58e8fb-8f20-4aec-ac81-63aaa0494d81 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:51.639621 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f58e8fb-8f20-4aec-ac81-63aaa0494d81 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:51.640500 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f58e8fb-8f20-4aec-ac81-63aaa0494d81 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:51.641466 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f58e8fb-8f20-4aec-ac81-63aaa0494d81 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:51.642087 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f58e8fb-8f20-4aec-ac81-63aaa0494d81 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:51.644443 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f58e8fb-8f20-4aec-ac81-63aaa0494d81 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:51.691126 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-df20988f-949d-487e-842f-67a847a1af53 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:51.691986 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-df20988f-949d-487e-842f-67a847a1af53 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:51.705120 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df20988f-949d-487e-842f-67a847a1af53 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:51.705627 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df20988f-949d-487e-842f-67a847a1af53 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:51.706078 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df20988f-949d-487e-842f-67a847a1af53 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:51.706812 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df20988f-949d-487e-842f-67a847a1af53 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:51.707270 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df20988f-949d-487e-842f-67a847a1af53 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:51.707701 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df20988f-949d-487e-842f-67a847a1af53 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:51.818367 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-df20988f-949d-487e-842f-67a847a1af53 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:39:52.047508 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-df20988f-949d-487e-842f-67a847a1af53 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9" status: 204 len: 0 microversion: 2.1 time: 0.360405 Aug 07 01:39:52.051395 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2918/5375] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:39:51 2022] DELETE /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 07 01:39:52.060966 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0b00d419-aa09-4b87-ab00-db3a123a6fdf tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:52.061771 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0b00d419-aa09-4b87-ab00-db3a123a6fdf tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:52.077119 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b00d419-aa09-4b87-ab00-db3a123a6fdf tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:52.077795 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b00d419-aa09-4b87-ab00-db3a123a6fdf tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:52.079002 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b00d419-aa09-4b87-ab00-db3a123a6fdf tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:52.079938 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b00d419-aa09-4b87-ab00-db3a123a6fdf tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:52.083213 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b00d419-aa09-4b87-ab00-db3a123a6fdf tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:52.084037 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b00d419-aa09-4b87-ab00-db3a123a6fdf tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:52.525504 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5f58e8fb-8f20-4aec-ac81-63aaa0494d81 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:52.542210 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5f58e8fb-8f20-4aec-ac81-63aaa0494d81 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1723 microversion: 2.1 time: 0.920635 Aug 07 01:39:52.548763 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2458/5376] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:39:51 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1723 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:39:52.979728 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0b00d419-aa09-4b87-ab00-db3a123a6fdf tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:52.999222 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0b00d419-aa09-4b87-ab00-db3a123a6fdf tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9" status: 200 len: 1681 microversion: 2.1 time: 0.940260 Aug 07 01:39:53.012880 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2919/5377] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:39:52 2022] GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9 => generated 1681 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:39:53.569379 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-39fb8926-fed4-4403-817e-8b4e5d397ca4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:53.570015 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-39fb8926-fed4-4403-817e-8b4e5d397ca4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:53.580159 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39fb8926-fed4-4403-817e-8b4e5d397ca4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:53.580655 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39fb8926-fed4-4403-817e-8b4e5d397ca4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:53.581094 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39fb8926-fed4-4403-817e-8b4e5d397ca4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:53.588937 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39fb8926-fed4-4403-817e-8b4e5d397ca4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:53.589733 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39fb8926-fed4-4403-817e-8b4e5d397ca4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:53.590330 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39fb8926-fed4-4403-817e-8b4e5d397ca4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:54.026836 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b2233a77-c816-40f8-9dc5-8cc67af658d6 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:54.027472 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b2233a77-c816-40f8-9dc5-8cc67af658d6 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:54.043768 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b2233a77-c816-40f8-9dc5-8cc67af658d6 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:54.077298 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b2233a77-c816-40f8-9dc5-8cc67af658d6 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:54.079262 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b2233a77-c816-40f8-9dc5-8cc67af658d6 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:54.082939 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b2233a77-c816-40f8-9dc5-8cc67af658d6 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:54.083811 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b2233a77-c816-40f8-9dc5-8cc67af658d6 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:54.093211 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b2233a77-c816-40f8-9dc5-8cc67af658d6 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:54.822224 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-39fb8926-fed4-4403-817e-8b4e5d397ca4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:54.840803 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-39fb8926-fed4-4403-817e-8b4e5d397ca4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1723 microversion: 2.1 time: 1.275332 Aug 07 01:39:54.843371 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2459/5378] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:39:53 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1723 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:39:54.998840 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b2233a77-c816-40f8-9dc5-8cc67af658d6 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:55.009704 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b2233a77-c816-40f8-9dc5-8cc67af658d6 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9" status: 200 len: 1681 microversion: 2.1 time: 0.988214 Aug 07 01:39:55.016977 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2920/5379] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:39:54 2022] GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9 => generated 1681 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:39:55.875579 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9fa3b32e-ab9d-4773-bbbd-818a3f973fb4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:55.876293 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9fa3b32e-ab9d-4773-bbbd-818a3f973fb4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:55.895797 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9fa3b32e-ab9d-4773-bbbd-818a3f973fb4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:55.896342 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9fa3b32e-ab9d-4773-bbbd-818a3f973fb4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:55.904210 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9fa3b32e-ab9d-4773-bbbd-818a3f973fb4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:55.906163 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9fa3b32e-ab9d-4773-bbbd-818a3f973fb4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:55.907112 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9fa3b32e-ab9d-4773-bbbd-818a3f973fb4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:55.908913 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9fa3b32e-ab9d-4773-bbbd-818a3f973fb4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:56.042019 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7e51140e-66b9-4bde-b67d-6357cd72dcda tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:56.043264 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7e51140e-66b9-4bde-b67d-6357cd72dcda tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:56.061816 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e51140e-66b9-4bde-b67d-6357cd72dcda tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:56.067270 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e51140e-66b9-4bde-b67d-6357cd72dcda tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:56.072581 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e51140e-66b9-4bde-b67d-6357cd72dcda tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:56.073610 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e51140e-66b9-4bde-b67d-6357cd72dcda tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:56.074243 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e51140e-66b9-4bde-b67d-6357cd72dcda tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:56.077165 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e51140e-66b9-4bde-b67d-6357cd72dcda tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:56.348819 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7e51140e-66b9-4bde-b67d-6357cd72dcda tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:56.357052 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7e51140e-66b9-4bde-b67d-6357cd72dcda tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9" status: 200 len: 1614 microversion: 2.1 time: 0.319419 Aug 07 01:39:56.377291 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2921/5380] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:39:56 2022] GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9 => generated 1614 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:39:56.764183 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9fa3b32e-ab9d-4773-bbbd-818a3f973fb4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:56.775786 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9fa3b32e-ab9d-4773-bbbd-818a3f973fb4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1723 microversion: 2.1 time: 0.910512 Aug 07 01:39:56.784333 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2460/5381] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:39:55 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1723 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:39:57.386692 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ea69ea45-6cea-4076-9afa-c6e0a11bae3e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:57.387349 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ea69ea45-6cea-4076-9afa-c6e0a11bae3e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:57.418430 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea69ea45-6cea-4076-9afa-c6e0a11bae3e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:57.420000 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea69ea45-6cea-4076-9afa-c6e0a11bae3e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:57.420527 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea69ea45-6cea-4076-9afa-c6e0a11bae3e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:57.424541 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea69ea45-6cea-4076-9afa-c6e0a11bae3e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:57.424657 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea69ea45-6cea-4076-9afa-c6e0a11bae3e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:57.427386 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea69ea45-6cea-4076-9afa-c6e0a11bae3e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:57.682384 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ea69ea45-6cea-4076-9afa-c6e0a11bae3e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:57.696595 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ea69ea45-6cea-4076-9afa-c6e0a11bae3e tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9" status: 200 len: 1614 microversion: 2.1 time: 0.313149 Aug 07 01:39:57.704163 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2922/5382] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:39:57 2022] GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9 => generated 1614 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:39:57.805638 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f6691f15-8ff3-40a1-b969-413051acf4be tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:57.806817 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f6691f15-8ff3-40a1-b969-413051acf4be tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:57.822995 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f6691f15-8ff3-40a1-b969-413051acf4be tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:57.823722 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f6691f15-8ff3-40a1-b969-413051acf4be tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:57.824364 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f6691f15-8ff3-40a1-b969-413051acf4be tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:57.842494 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f6691f15-8ff3-40a1-b969-413051acf4be tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:57.843296 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f6691f15-8ff3-40a1-b969-413051acf4be tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:57.843979 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f6691f15-8ff3-40a1-b969-413051acf4be tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:58.149711 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c3790bca-65db-42e9-bda0-dc225a4e04b6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:58.150618 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c3790bca-65db-42e9-bda0-dc225a4e04b6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:58.165808 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3790bca-65db-42e9-bda0-dc225a4e04b6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:58.172756 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3790bca-65db-42e9-bda0-dc225a4e04b6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:58.173699 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3790bca-65db-42e9-bda0-dc225a4e04b6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:58.175962 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3790bca-65db-42e9-bda0-dc225a4e04b6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:58.176624 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3790bca-65db-42e9-bda0-dc225a4e04b6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:58.180644 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3790bca-65db-42e9-bda0-dc225a4e04b6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:58.218346 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-c3790bca-65db-42e9-bda0-dc225a4e04b6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] HTTP exception thrown: Instance 4071f699-43c7-4c36-ada4-8f0dceb6cc91 could not be found. Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c3790bca-65db-42e9-bda0-dc225a4e04b6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Request method failure captured: Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 HTTP/1.1 Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xYYE_Y2FKv6zZ-7Zkxg2nvfkmjHNhq8c_yKwZxcLvYOOyyIq8uAferdUqGnDwpFS2QC6mWyOffIFr9qPy7uHg72JIuPriVMKOHOuSjKFlawCqsqSD8KzCrH58SWYZ4TQRVX3TPFeio4AWgC3hNQePrvrMuhXhOysJV4QaOUSTy-8aQ Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: X-Openstack-Nova-Api-Version: 2.20 Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 284c227cd03a4c1294ed40d7b1594d56 Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-660714485 Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/284c227cd03a4c1294ed40d7b1594d56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_284c227cd03a4c1294ed40d7b1594d56", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/284c227cd03a4c1294ed40d7b1594d56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/284c227cd03a4c1294ed40d7b1594d56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-AttachVolumeShelveTestJSON-660714485 Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 284c227cd03a4c1294ed40d7b1594d56 Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-660714485 Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-AttachVolumeShelveTestJSON-660714485-project Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: bed65a4d62184f52af3d2dd322eeec47 Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-AttachVolumeShelveTestJSON-660714485-project Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 4071f699-43c7-4c36-ada4-8f0dceb6cc91 could not be found. Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '4071f699-43c7-4c36-ada4-8f0dceb6cc91'} Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4071f699-43c7-4c36-ada4-8f0dceb6cc91 could not be found. Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:39:58.244680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:39:58.248177 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4071f699-43c7-4c36-ada4-8f0dceb6cc91 could not be found. Aug 07 01:39:58.248177 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:39:58.248177 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:39:58.248177 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:39:58.248177 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:39:58.248177 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:39:58.248177 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:39:58.248177 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:39:58.248177 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:39:58.248177 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4071f699-43c7-4c36-ada4-8f0dceb6cc91 could not be found. Aug 07 01:39:58.248177 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:39:58.250864 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c3790bca-65db-42e9-bda0-dc225a4e04b6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Returning 404 to user: Instance 4071f699-43c7-4c36-ada4-8f0dceb6cc91 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:39:58.251960 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c3790bca-65db-42e9-bda0-dc225a4e04b6 tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 404 len: 111 microversion: 2.20 time: 0.107759 Aug 07 01:39:58.253055 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2923/5383] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Aug 7 01:39:58 2022] DELETE /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:39:58.262142 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9bc9950b-5ad0-42ac-ad60-6029949b49af tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:58.265383 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9bc9950b-5ad0-42ac-ad60-6029949b49af tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] [instance: 4071f699-43c7-4c36-ada4-8f0dceb6cc91] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:58.281360 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9bc9950b-5ad0-42ac-ad60-6029949b49af tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:58.281360 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9bc9950b-5ad0-42ac-ad60-6029949b49af tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:58.281360 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9bc9950b-5ad0-42ac-ad60-6029949b49af tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:58.284881 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9bc9950b-5ad0-42ac-ad60-6029949b49af tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:58.285478 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9bc9950b-5ad0-42ac-ad60-6029949b49af tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:58.288121 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9bc9950b-5ad0-42ac-ad60-6029949b49af tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:58.326290 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-9bc9950b-5ad0-42ac-ad60-6029949b49af tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] HTTP exception thrown: Instance 4071f699-43c7-4c36-ada4-8f0dceb6cc91 could not be found. Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9bc9950b-5ad0-42ac-ad60-6029949b49af tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Request method failure captured: Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 HTTP/1.1 Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xYYE_Y2FKv6zZ-7Zkxg2nvfkmjHNhq8c_yKwZxcLvYOOyyIq8uAferdUqGnDwpFS2QC6mWyOffIFr9qPy7uHg72JIuPriVMKOHOuSjKFlawCqsqSD8KzCrH58SWYZ4TQRVX3TPFeio4AWgC3hNQePrvrMuhXhOysJV4QaOUSTy-8aQ Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: X-Openstack-Nova-Api-Version: 2.20 Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 284c227cd03a4c1294ed40d7b1594d56 Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-660714485 Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/284c227cd03a4c1294ed40d7b1594d56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_284c227cd03a4c1294ed40d7b1594d56", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/284c227cd03a4c1294ed40d7b1594d56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/284c227cd03a4c1294ed40d7b1594d56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-AttachVolumeShelveTestJSON-660714485 Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 284c227cd03a4c1294ed40d7b1594d56 Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-660714485 Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-AttachVolumeShelveTestJSON-660714485-project Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: bed65a4d62184f52af3d2dd322eeec47 Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-AttachVolumeShelveTestJSON-660714485-project Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 4071f699-43c7-4c36-ada4-8f0dceb6cc91 could not be found. Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '4071f699-43c7-4c36-ada4-8f0dceb6cc91'} Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4071f699-43c7-4c36-ada4-8f0dceb6cc91 could not be found. Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4071f699-43c7-4c36-ada4-8f0dceb6cc91 could not be found. Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:39:58.331986 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:39:58.335360 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:39:58.335360 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:39:58.335360 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:39:58.335360 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:39:58.335360 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:39:58.335360 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:39:58.335360 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4071f699-43c7-4c36-ada4-8f0dceb6cc91 could not be found. Aug 07 01:39:58.335360 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:39:58.345885 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9bc9950b-5ad0-42ac-ad60-6029949b49af tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] Returning 404 to user: Instance 4071f699-43c7-4c36-ada4-8f0dceb6cc91 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:39:58.347539 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9bc9950b-5ad0-42ac-ad60-6029949b49af tempest-AttachVolumeShelveTestJSON-660714485 tempest-AttachVolumeShelveTestJSON-660714485-project] 10.222.0.39 "GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91" status: 404 len: 111 microversion: 2.20 time: 0.090523 Aug 07 01:39:58.348754 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2924/5384] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:39:58 2022] GET /compute/v2.1/servers/4071f699-43c7-4c36-ada4-8f0dceb6cc91 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 07 01:39:58.728127 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7431a84f-91b1-4ae7-98e6-9a5d366229d7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:58.728891 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7431a84f-91b1-4ae7-98e6-9a5d366229d7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:58.739678 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7431a84f-91b1-4ae7-98e6-9a5d366229d7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:58.747692 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7431a84f-91b1-4ae7-98e6-9a5d366229d7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:58.749786 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7431a84f-91b1-4ae7-98e6-9a5d366229d7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:58.751385 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7431a84f-91b1-4ae7-98e6-9a5d366229d7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:58.752549 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7431a84f-91b1-4ae7-98e6-9a5d366229d7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:58.754061 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7431a84f-91b1-4ae7-98e6-9a5d366229d7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:58.983783 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7431a84f-91b1-4ae7-98e6-9a5d366229d7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd556a8ae0d524894a93203ce3f70d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b630a4c3bb824b90b4c1898a92b47aa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:59.013798 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7431a84f-91b1-4ae7-98e6-9a5d366229d7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9" status: 200 len: 1614 microversion: 2.1 time: 0.289487 Aug 07 01:39:59.020436 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2925/5385] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:39:58 2022] GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9 => generated 1614 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:39:59.042369 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-493a3678-6a27-4ace-a1ff-aa8581628ce3 req-1f169d7e-6653-4f6e-bb6a-1b7d1488f04c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac218e0a-d325-4062-a13d-501e130105f9", "name": "network-vif-deleted", "tag": "8d0ba5dc-69f1-418b-8da4-2b1c5cf0de12"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:39:59.081607 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-493a3678-6a27-4ace-a1ff-aa8581628ce3 req-1f169d7e-6653-4f6e-bb6a-1b7d1488f04c service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:59.090773 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-493a3678-6a27-4ace-a1ff-aa8581628ce3 req-1f169d7e-6653-4f6e-bb6a-1b7d1488f04c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:59.092033 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-493a3678-6a27-4ace-a1ff-aa8581628ce3 req-1f169d7e-6653-4f6e-bb6a-1b7d1488f04c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:59.126077 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-493a3678-6a27-4ace-a1ff-aa8581628ce3 req-1f169d7e-6653-4f6e-bb6a-1b7d1488f04c service nova] Creating event network-vif-deleted:8d0ba5dc-69f1-418b-8da4-2b1c5cf0de12 for instance ac218e0a-d325-4062-a13d-501e130105f9 on n-h2-master-1 Aug 07 01:39:59.138599 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-493a3678-6a27-4ace-a1ff-aa8581628ce3 req-1f169d7e-6653-4f6e-bb6a-1b7d1488f04c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113945 Aug 07 01:39:59.139393 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2926/5386] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:39:59.441552 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f6691f15-8ff3-40a1-b969-413051acf4be tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:39:59.482977 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f6691f15-8ff3-40a1-b969-413051acf4be tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1729 microversion: 2.1 time: 1.665561 Aug 07 01:39:59.488802 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2461/5387] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:39:57 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1729 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:39:59.516567 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-037eb70a-cc3a-433f-a64d-cb4e5686b799 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:39:59.518307 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-037eb70a-cc3a-433f-a64d-cb4e5686b799 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:39:59.534118 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-037eb70a-cc3a-433f-a64d-cb4e5686b799 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:59.540329 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-037eb70a-cc3a-433f-a64d-cb4e5686b799 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:59.542097 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-037eb70a-cc3a-433f-a64d-cb4e5686b799 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:59.548080 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-037eb70a-cc3a-433f-a64d-cb4e5686b799 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:39:59.550913 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-037eb70a-cc3a-433f-a64d-cb4e5686b799 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:39:59.552577 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-037eb70a-cc3a-433f-a64d-cb4e5686b799 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:39:59.812784 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-037eb70a-cc3a-433f-a64d-cb4e5686b799 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.302958 Aug 07 01:39:59.813793 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2927/5388] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Aug 7 01:39:59 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-interface => generated 284 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:40:00.041667 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-47fbeed1-4c92-4930-9092-5e7b6e244011 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:00.042804 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-47fbeed1-4c92-4930-9092-5e7b6e244011 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:00.057436 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-47fbeed1-4c92-4930-9092-5e7b6e244011 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:00.058297 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-47fbeed1-4c92-4930-9092-5e7b6e244011 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:00.058966 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-47fbeed1-4c92-4930-9092-5e7b6e244011 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:00.059915 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-47fbeed1-4c92-4930-9092-5e7b6e244011 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:00.060578 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-47fbeed1-4c92-4930-9092-5e7b6e244011 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:00.063442 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-47fbeed1-4c92-4930-9092-5e7b6e244011 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:00.095137 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-47fbeed1-4c92-4930-9092-5e7b6e244011 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] HTTP exception thrown: Instance ac218e0a-d325-4062-a13d-501e130105f9 could not be found. Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-47fbeed1-4c92-4930-9092-5e7b6e244011 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Request method failure captured: Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9 HTTP/1.1 Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xZDq6RH3D4bnr1UijP-nk3uo95NJjh7SbfPDqAVgj126rgmdcLbKlTvq4r9AHLnAVbqooFNQ3b97yry4NtGcTnZJETXBytnxiV1irP15oNSC1nhov4fsRvKuKlTNLjRN8RkNUdoouf8PCfkhvGYmSqoJN36Q7GHr7rf2nNkd41nqV4 Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: b630a4c3bb824b90b4c1898a92b47aa7 Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b630a4c3bb824b90b4c1898a92b47aa7", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: b630a4c3bb824b90b4c1898a92b47aa7 Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-AttachVolumeNegativeTest-1422960247-project Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d556a8ae0d524894a93203ce3f70d420 Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-AttachVolumeNegativeTest-1422960247-project Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: exception: Instance ac218e0a-d325-4062-a13d-501e130105f9 could not be found. Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'ac218e0a-d325-4062-a13d-501e130105f9'} Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac218e0a-d325-4062-a13d-501e130105f9 could not be found. Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac218e0a-d325-4062-a13d-501e130105f9 could not be found. Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:40:00.099045 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:40:00.102861 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:40:00.102861 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:40:00.102861 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:40:00.102861 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:40:00.102861 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:40:00.102861 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac218e0a-d325-4062-a13d-501e130105f9 could not be found. Aug 07 01:40:00.102861 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:40:00.110436 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-47fbeed1-4c92-4930-9092-5e7b6e244011 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Returning 404 to user: Instance ac218e0a-d325-4062-a13d-501e130105f9 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:40:00.117380 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-47fbeed1-4c92-4930-9092-5e7b6e244011 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9" status: 404 len: 111 microversion: 2.1 time: 0.079865 Aug 07 01:40:00.122677 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2462/5389] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:40:00 2022] GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:40:00.127686 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-96b65376-6c98-4cc4-adfb-e3195ab24787 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '.version_select at 0x7f9e250c8940>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:00.201459 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-96b65376-6c98-4cc4-adfb-e3195ab24787 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1065281610" status: 202 len: 0 microversion: 2.1 time: 0.077594 Aug 07 01:40:00.208716 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2928/5390] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Aug 7 01:40:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1065281610 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:40:02.485183 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f435cbb5-fe88-4847-bf07-440018c84891 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:40:02.492876 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f435cbb5-fe88-4847-bf07-440018c84891 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:02.493483 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f435cbb5-fe88-4847-bf07-440018c84891 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:02.493804 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f435cbb5-fe88-4847-bf07-440018c84891 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:02.560623 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f435cbb5-fe88-4847-bf07-440018c84891 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Going to try to stop instance {{(pid=119517) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 07 01:40:02.676480 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f435cbb5-fe88-4847-bf07-440018c84891 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "POST /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976/action" status: 202 len: 0 microversion: 2.1 time: 0.194938 Aug 07 01:40:02.677483 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2463/5391] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:40:02 2022] POST /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:40:02.686245 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3104db21-92d8-4556-bf50-612cd2390b54 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:02.687085 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3104db21-92d8-4556-bf50-612cd2390b54 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:02.698496 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3104db21-92d8-4556-bf50-612cd2390b54 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:02.703504 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3104db21-92d8-4556-bf50-612cd2390b54 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:02.704227 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3104db21-92d8-4556-bf50-612cd2390b54 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:02.705298 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3104db21-92d8-4556-bf50-612cd2390b54 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:02.706361 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3104db21-92d8-4556-bf50-612cd2390b54 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:02.708357 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3104db21-92d8-4556-bf50-612cd2390b54 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:03.700282 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3104db21-92d8-4556-bf50-612cd2390b54 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:40:03.717610 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3104db21-92d8-4556-bf50-612cd2390b54 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1678 microversion: 2.1 time: 1.035212 Aug 07 01:40:03.718768 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2929/5392] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:40:02 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1678 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:40:04.059028 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-6ec5d92b-eb84-497e-be98-5f3d73ec8ea7 req-e5701f45-9f95-4b8a-bfc1-5da91c377b09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d91eb969-4da0-4789-a33c-73a27d5cef97", "tag": "561b9998-3694-4cb6-8ce2-0630e19b986b"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:40:04.079195 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6ec5d92b-eb84-497e-be98-5f3d73ec8ea7 req-e5701f45-9f95-4b8a-bfc1-5da91c377b09 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:04.082236 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6ec5d92b-eb84-497e-be98-5f3d73ec8ea7 req-e5701f45-9f95-4b8a-bfc1-5da91c377b09 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:04.083760 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6ec5d92b-eb84-497e-be98-5f3d73ec8ea7 req-e5701f45-9f95-4b8a-bfc1-5da91c377b09 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:04.105373 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-6ec5d92b-eb84-497e-be98-5f3d73ec8ea7 req-e5701f45-9f95-4b8a-bfc1-5da91c377b09 service nova] Creating event network-changed:561b9998-3694-4cb6-8ce2-0630e19b986b for instance d91eb969-4da0-4789-a33c-73a27d5cef97 on n-h1-master-1 Aug 07 01:40:04.113021 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-6ec5d92b-eb84-497e-be98-5f3d73ec8ea7 req-e5701f45-9f95-4b8a-bfc1-5da91c377b09 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.326853 Aug 07 01:40:04.114188 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2464/5393] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:40:04.748186 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6036f29d-d32b-47c2-bc4c-2dc148b89812 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:04.748779 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6036f29d-d32b-47c2-bc4c-2dc148b89812 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:04.775261 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6036f29d-d32b-47c2-bc4c-2dc148b89812 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:04.776613 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6036f29d-d32b-47c2-bc4c-2dc148b89812 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:04.777344 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6036f29d-d32b-47c2-bc4c-2dc148b89812 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:04.778332 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6036f29d-d32b-47c2-bc4c-2dc148b89812 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:04.779319 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6036f29d-d32b-47c2-bc4c-2dc148b89812 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:04.781373 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6036f29d-d32b-47c2-bc4c-2dc148b89812 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:05.165450 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6036f29d-d32b-47c2-bc4c-2dc148b89812 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:40:05.175965 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6036f29d-d32b-47c2-bc4c-2dc148b89812 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1678 microversion: 2.1 time: 0.434044 Aug 07 01:40:05.191916 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2930/5394] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:40:04 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1678 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:40:06.199824 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-e31d4ace-eae9-4c46-9723-d48790d8e701 req-b21672f2-e367-475c-bbec-9a4230df7e4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d91eb969-4da0-4789-a33c-73a27d5cef97", "tag": "561b9998-3694-4cb6-8ce2-0630e19b986b"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:40:06.213884 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5dd4fb8a-a8f9-467e-a02c-6b899a8b36d1 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:06.215134 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5dd4fb8a-a8f9-467e-a02c-6b899a8b36d1 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:06.229606 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5dd4fb8a-a8f9-467e-a02c-6b899a8b36d1 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:06.230262 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5dd4fb8a-a8f9-467e-a02c-6b899a8b36d1 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:06.230889 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5dd4fb8a-a8f9-467e-a02c-6b899a8b36d1 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:06.231866 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5dd4fb8a-a8f9-467e-a02c-6b899a8b36d1 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:06.236997 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5dd4fb8a-a8f9-467e-a02c-6b899a8b36d1 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:06.237867 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5dd4fb8a-a8f9-467e-a02c-6b899a8b36d1 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:06.245626 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:06.247866 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-e31d4ace-eae9-4c46-9723-d48790d8e701 req-b21672f2-e367-475c-bbec-9a4230df7e4f service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:06.256690 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-e31d4ace-eae9-4c46-9723-d48790d8e701 req-b21672f2-e367-475c-bbec-9a4230df7e4f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:06.259831 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-e31d4ace-eae9-4c46-9723-d48790d8e701 req-b21672f2-e367-475c-bbec-9a4230df7e4f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:06.316781 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-e31d4ace-eae9-4c46-9723-d48790d8e701 req-b21672f2-e367-475c-bbec-9a4230df7e4f service nova] Creating event network-changed:561b9998-3694-4cb6-8ce2-0630e19b986b for instance d91eb969-4da0-4789-a33c-73a27d5cef97 on n-h1-master-1 Aug 07 01:40:06.342993 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-e31d4ace-eae9-4c46-9723-d48790d8e701 req-b21672f2-e367-475c-bbec-9a4230df7e4f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149096 Aug 07 01:40:06.348967 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2465/5395] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:40:06.613758 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5dd4fb8a-a8f9-467e-a02c-6b899a8b36d1 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:40:06.638176 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5dd4fb8a-a8f9-467e-a02c-6b899a8b36d1 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1678 microversion: 2.1 time: 0.424700 Aug 07 01:40:06.639814 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2931/5396] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:40:06 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1678 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:40:07.662368 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bc13d317-de31-4399-b35c-24bd0a8aa82f tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:07.663081 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bc13d317-de31-4399-b35c-24bd0a8aa82f tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:07.681886 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc13d317-de31-4399-b35c-24bd0a8aa82f tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:07.682387 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc13d317-de31-4399-b35c-24bd0a8aa82f tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:07.682830 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc13d317-de31-4399-b35c-24bd0a8aa82f tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:07.683558 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc13d317-de31-4399-b35c-24bd0a8aa82f tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:07.684040 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc13d317-de31-4399-b35c-24bd0a8aa82f tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:07.684466 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc13d317-de31-4399-b35c-24bd0a8aa82f tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:08.078952 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bc13d317-de31-4399-b35c-24bd0a8aa82f tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:40:08.090725 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bc13d317-de31-4399-b35c-24bd0a8aa82f tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1678 microversion: 2.1 time: 0.433676 Aug 07 01:40:08.093743 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2466/5397] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:40:07 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1678 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:40:09.120077 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2cfbd06c-6df6-45ac-893c-b770afffa175 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:09.120818 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2cfbd06c-6df6-45ac-893c-b770afffa175 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:09.146669 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2cfbd06c-6df6-45ac-893c-b770afffa175 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:09.151298 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2cfbd06c-6df6-45ac-893c-b770afffa175 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:09.153581 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2cfbd06c-6df6-45ac-893c-b770afffa175 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:09.156491 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2cfbd06c-6df6-45ac-893c-b770afffa175 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:09.160325 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2cfbd06c-6df6-45ac-893c-b770afffa175 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:09.160325 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2cfbd06c-6df6-45ac-893c-b770afffa175 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:10.060691 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2cfbd06c-6df6-45ac-893c-b770afffa175 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:40:10.074588 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2cfbd06c-6df6-45ac-893c-b770afffa175 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1678 microversion: 2.1 time: 0.960457 Aug 07 01:40:10.076393 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2932/5398] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:40:09 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1678 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:40:10.817699 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-eb18091c-fbd3-4370-982b-cbe7c61f17fb tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:10.818358 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-eb18091c-fbd3-4370-982b-cbe7c61f17fb tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:10.857646 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb18091c-fbd3-4370-982b-cbe7c61f17fb tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:10.858510 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb18091c-fbd3-4370-982b-cbe7c61f17fb tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:10.859172 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb18091c-fbd3-4370-982b-cbe7c61f17fb tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:10.860149 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb18091c-fbd3-4370-982b-cbe7c61f17fb tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:10.860845 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb18091c-fbd3-4370-982b-cbe7c61f17fb tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:10.861487 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb18091c-fbd3-4370-982b-cbe7c61f17fb tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:10.891257 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-eb18091c-fbd3-4370-982b-cbe7c61f17fb tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] HTTP exception thrown: Instance ac218e0a-d325-4062-a13d-501e130105f9 could not be found. Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-eb18091c-fbd3-4370-982b-cbe7c61f17fb tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Request method failure captured: Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9 HTTP/1.1 Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xZDq6RH3D4bnr1UijP-nk3uo95NJjh7SbfPDqAVgj126rgmdcLbKlTvq4r9AHLnAVbqooFNQ3b97yry4NtGcTnZJETXBytnxiV1irP15oNSC1nhov4fsRvKuKlTNLjRN8RkNUdoouf8PCfkhvGYmSqoJN36Q7GHr7rf2nNkd41nqV4 Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: b630a4c3bb824b90b4c1898a92b47aa7 Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b630a4c3bb824b90b4c1898a92b47aa7", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: b630a4c3bb824b90b4c1898a92b47aa7 Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-AttachVolumeNegativeTest-1422960247-project Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d556a8ae0d524894a93203ce3f70d420 Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-AttachVolumeNegativeTest-1422960247-project Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: exception: Instance ac218e0a-d325-4062-a13d-501e130105f9 could not be found. Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'ac218e0a-d325-4062-a13d-501e130105f9'} Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac218e0a-d325-4062-a13d-501e130105f9 could not be found. Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:40:10.893654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:40:10.899248 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac218e0a-d325-4062-a13d-501e130105f9 could not be found. Aug 07 01:40:10.899248 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:40:10.899248 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:40:10.899248 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:40:10.899248 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:40:10.899248 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:40:10.899248 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:40:10.899248 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:40:10.899248 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:40:10.899248 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac218e0a-d325-4062-a13d-501e130105f9 could not be found. Aug 07 01:40:10.899248 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:40:10.902852 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-eb18091c-fbd3-4370-982b-cbe7c61f17fb tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Returning 404 to user: Instance ac218e0a-d325-4062-a13d-501e130105f9 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:40:10.904536 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-eb18091c-fbd3-4370-982b-cbe7c61f17fb tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9" status: 404 len: 111 microversion: 2.1 time: 0.091771 Aug 07 01:40:10.905704 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2467/5399] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:40:10 2022] DELETE /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:40:10.915190 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3945cf2c-2f73-4ef8-8ca8-b2a8a360944d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:10.916803 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3945cf2c-2f73-4ef8-8ca8-b2a8a360944d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: ac218e0a-d325-4062-a13d-501e130105f9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:10.930175 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3945cf2c-2f73-4ef8-8ca8-b2a8a360944d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:10.931361 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3945cf2c-2f73-4ef8-8ca8-b2a8a360944d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:10.934263 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3945cf2c-2f73-4ef8-8ca8-b2a8a360944d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:10.936116 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3945cf2c-2f73-4ef8-8ca8-b2a8a360944d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:10.938915 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3945cf2c-2f73-4ef8-8ca8-b2a8a360944d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:10.939626 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3945cf2c-2f73-4ef8-8ca8-b2a8a360944d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:11.012567 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-3945cf2c-2f73-4ef8-8ca8-b2a8a360944d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] HTTP exception thrown: Instance ac218e0a-d325-4062-a13d-501e130105f9 could not be found. Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3945cf2c-2f73-4ef8-8ca8-b2a8a360944d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Request method failure captured: Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9 HTTP/1.1 Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xZDq6RH3D4bnr1UijP-nk3uo95NJjh7SbfPDqAVgj126rgmdcLbKlTvq4r9AHLnAVbqooFNQ3b97yry4NtGcTnZJETXBytnxiV1irP15oNSC1nhov4fsRvKuKlTNLjRN8RkNUdoouf8PCfkhvGYmSqoJN36Q7GHr7rf2nNkd41nqV4 Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: b630a4c3bb824b90b4c1898a92b47aa7 Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b630a4c3bb824b90b4c1898a92b47aa7", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: b630a4c3bb824b90b4c1898a92b47aa7 Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-AttachVolumeNegativeTest-1422960247-project Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: d556a8ae0d524894a93203ce3f70d420 Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-AttachVolumeNegativeTest-1422960247-project Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: exception: Instance ac218e0a-d325-4062-a13d-501e130105f9 could not be found. Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'ac218e0a-d325-4062-a13d-501e130105f9'} Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac218e0a-d325-4062-a13d-501e130105f9 could not be found. Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac218e0a-d325-4062-a13d-501e130105f9 could not be found. Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:40:11.018403 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:40:11.024754 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:40:11.024754 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:40:11.024754 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:40:11.024754 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:40:11.024754 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:40:11.024754 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac218e0a-d325-4062-a13d-501e130105f9 could not be found. Aug 07 01:40:11.024754 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:40:11.024754 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3945cf2c-2f73-4ef8-8ca8-b2a8a360944d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Returning 404 to user: Instance ac218e0a-d325-4062-a13d-501e130105f9 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:40:11.026163 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3945cf2c-2f73-4ef8-8ca8-b2a8a360944d tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9" status: 404 len: 111 microversion: 2.1 time: 0.115967 Aug 07 01:40:11.026551 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2933/5400] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:40:10 2022] GET /compute/v2.1/servers/ac218e0a-d325-4062-a13d-501e130105f9 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:40:11.102423 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6f2bcc51-2d4f-480c-bcca-a767a4bdd5b2 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:11.103437 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6f2bcc51-2d4f-480c-bcca-a767a4bdd5b2 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:11.133585 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f2bcc51-2d4f-480c-bcca-a767a4bdd5b2 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:11.140041 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f2bcc51-2d4f-480c-bcca-a767a4bdd5b2 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:11.141923 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f2bcc51-2d4f-480c-bcca-a767a4bdd5b2 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:11.178190 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f2bcc51-2d4f-480c-bcca-a767a4bdd5b2 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:11.185095 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f2bcc51-2d4f-480c-bcca-a767a4bdd5b2 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:11.189069 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f2bcc51-2d4f-480c-bcca-a767a4bdd5b2 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:11.797867 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6f2bcc51-2d4f-480c-bcca-a767a4bdd5b2 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:40:11.811280 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6f2bcc51-2d4f-480c-bcca-a767a4bdd5b2 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1678 microversion: 2.1 time: 0.710864 Aug 07 01:40:11.814054 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2468/5401] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:40:11 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1678 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:40:12.836145 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ba44f5c0-1b93-48cc-b65d-4a2717c43227 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:12.838394 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ba44f5c0-1b93-48cc-b65d-4a2717c43227 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:12.856509 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ba44f5c0-1b93-48cc-b65d-4a2717c43227 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:12.861850 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ba44f5c0-1b93-48cc-b65d-4a2717c43227 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:12.862647 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ba44f5c0-1b93-48cc-b65d-4a2717c43227 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:12.864913 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ba44f5c0-1b93-48cc-b65d-4a2717c43227 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:12.865807 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ba44f5c0-1b93-48cc-b65d-4a2717c43227 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:12.870880 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ba44f5c0-1b93-48cc-b65d-4a2717c43227 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:13.082796 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:14.150975 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ba44f5c0-1b93-48cc-b65d-4a2717c43227 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:40:14.165909 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ba44f5c0-1b93-48cc-b65d-4a2717c43227 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1678 microversion: 2.1 time: 1.330929 Aug 07 01:40:14.171946 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2934/5402] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:40:12 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1678 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:40:15.203879 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cd89b828-9139-4adf-8d29-6158289f0aa2 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:15.208671 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-cd89b828-9139-4adf-8d29-6158289f0aa2 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:15.222599 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cd89b828-9139-4adf-8d29-6158289f0aa2 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:15.223109 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cd89b828-9139-4adf-8d29-6158289f0aa2 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:15.228479 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cd89b828-9139-4adf-8d29-6158289f0aa2 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:15.232857 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cd89b828-9139-4adf-8d29-6158289f0aa2 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:15.233360 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cd89b828-9139-4adf-8d29-6158289f0aa2 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:15.233810 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cd89b828-9139-4adf-8d29-6158289f0aa2 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:15.336003 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:16.084409 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-cd89b828-9139-4adf-8d29-6158289f0aa2 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:40:16.110015 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cd89b828-9139-4adf-8d29-6158289f0aa2 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1655 microversion: 2.1 time: 0.920691 Aug 07 01:40:16.112978 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2469/5403] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:40:15 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1655 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:40:16.146806 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0c9cd685-5049-4f53-86b7-9c5ef6c10afb tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:40:16.184341 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c9cd685-5049-4f53-86b7-9c5ef6c10afb tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:16.184940 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c9cd685-5049-4f53-86b7-9c5ef6c10afb tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:16.189891 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c9cd685-5049-4f53-86b7-9c5ef6c10afb tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:16.267459 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0c9cd685-5049-4f53-86b7-9c5ef6c10afb tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Going to try to start instance {{(pid=119516) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 07 01:40:16.440350 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0c9cd685-5049-4f53-86b7-9c5ef6c10afb tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "POST /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976/action" status: 202 len: 0 microversion: 2.1 time: 0.306944 Aug 07 01:40:16.441672 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2935/5404] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:40:16 2022] POST /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:40:16.452275 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f96f64a1-efe5-4688-876e-c0979ee41361 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:16.454220 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f96f64a1-efe5-4688-876e-c0979ee41361 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:16.464224 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f96f64a1-efe5-4688-876e-c0979ee41361 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:16.469069 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f96f64a1-efe5-4688-876e-c0979ee41361 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:16.469882 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f96f64a1-efe5-4688-876e-c0979ee41361 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:16.470842 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f96f64a1-efe5-4688-876e-c0979ee41361 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:16.471564 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f96f64a1-efe5-4688-876e-c0979ee41361 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:16.472244 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f96f64a1-efe5-4688-876e-c0979ee41361 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:17.726969 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f96f64a1-efe5-4688-876e-c0979ee41361 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:40:17.743859 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f96f64a1-efe5-4688-876e-c0979ee41361 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1664 microversion: 2.1 time: 1.295086 Aug 07 01:40:17.746507 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2470/5405] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:40:16 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1664 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:40:18.768171 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-80df1f36-0cdd-45bc-a6c6-a349a89ec775 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:18.769032 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-80df1f36-0cdd-45bc-a6c6-a349a89ec775 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:18.781621 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80df1f36-0cdd-45bc-a6c6-a349a89ec775 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:18.798519 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80df1f36-0cdd-45bc-a6c6-a349a89ec775 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:18.801050 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80df1f36-0cdd-45bc-a6c6-a349a89ec775 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:18.802096 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80df1f36-0cdd-45bc-a6c6-a349a89ec775 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:18.802575 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80df1f36-0cdd-45bc-a6c6-a349a89ec775 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:18.803015 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80df1f36-0cdd-45bc-a6c6-a349a89ec775 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:19.568550 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-80df1f36-0cdd-45bc-a6c6-a349a89ec775 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:40:19.580927 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-80df1f36-0cdd-45bc-a6c6-a349a89ec775 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1664 microversion: 2.1 time: 0.817220 Aug 07 01:40:19.597279 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2936/5406] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:40:18 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1664 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:40:20.286973 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d8141d84-9009-4f64-ba67-1167d42d106a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:20.287614 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d8141d84-9009-4f64-ba67-1167d42d106a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 0658227f-88e6-40fd-bb8f-aa6267addc84] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:20.311319 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d8141d84-9009-4f64-ba67-1167d42d106a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:20.318035 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d8141d84-9009-4f64-ba67-1167d42d106a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:20.318497 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d8141d84-9009-4f64-ba67-1167d42d106a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:20.328012 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d8141d84-9009-4f64-ba67-1167d42d106a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:20.328336 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d8141d84-9009-4f64-ba67-1167d42d106a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:20.328691 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d8141d84-9009-4f64-ba67-1167d42d106a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:20.391130 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-d8141d84-9009-4f64-ba67-1167d42d106a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] HTTP exception thrown: Instance 0658227f-88e6-40fd-bb8f-aa6267addc84 could not be found. Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d8141d84-9009-4f64-ba67-1167d42d106a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Request method failure captured: Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84 HTTP/1.1 Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xZDq6RH3D4bnr1UijP-nk3uo95NJjh7SbfPDqAVgj126rgmdcLbKlTvq4r9AHLnAVbqooFNQ3b97yry4NtGcTnZJETXBytnxiV1irP15oNSC1nhov4fsRvKuKlTNLjRN8RkNUdoouf8PCfkhvGYmSqoJN36Q7GHr7rf2nNkd41nqV4 Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: b630a4c3bb824b90b4c1898a92b47aa7 Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b630a4c3bb824b90b4c1898a92b47aa7", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: b630a4c3bb824b90b4c1898a92b47aa7 Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-AttachVolumeNegativeTest-1422960247-project Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d556a8ae0d524894a93203ce3f70d420 Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-AttachVolumeNegativeTest-1422960247-project Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 0658227f-88e6-40fd-bb8f-aa6267addc84 could not be found. Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '0658227f-88e6-40fd-bb8f-aa6267addc84'} Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0658227f-88e6-40fd-bb8f-aa6267addc84 could not be found. Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:40:20.428212 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:40:20.431764 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0658227f-88e6-40fd-bb8f-aa6267addc84 could not be found. Aug 07 01:40:20.431764 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:40:20.431764 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:40:20.431764 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:40:20.431764 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:40:20.431764 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:40:20.431764 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:40:20.431764 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:40:20.431764 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:40:20.431764 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0658227f-88e6-40fd-bb8f-aa6267addc84 could not be found. Aug 07 01:40:20.431764 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:40:20.431764 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d8141d84-9009-4f64-ba67-1167d42d106a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Returning 404 to user: Instance 0658227f-88e6-40fd-bb8f-aa6267addc84 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:40:20.445031 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d8141d84-9009-4f64-ba67-1167d42d106a tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84" status: 404 len: 111 microversion: 2.1 time: 0.154291 Aug 07 01:40:20.446241 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2471/5407] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:40:20 2022] DELETE /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:40:20.465569 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5e32ecf8-6eab-4f99-b591-fb9d652f7437 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:20.466819 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5e32ecf8-6eab-4f99-b591-fb9d652f7437 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 0658227f-88e6-40fd-bb8f-aa6267addc84] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:20.505871 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:20.536616 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e32ecf8-6eab-4f99-b591-fb9d652f7437 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:20.537138 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e32ecf8-6eab-4f99-b591-fb9d652f7437 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:20.537655 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e32ecf8-6eab-4f99-b591-fb9d652f7437 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:20.538996 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e32ecf8-6eab-4f99-b591-fb9d652f7437 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:20.539453 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e32ecf8-6eab-4f99-b591-fb9d652f7437 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:20.539904 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e32ecf8-6eab-4f99-b591-fb9d652f7437 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:20.597412 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-5e32ecf8-6eab-4f99-b591-fb9d652f7437 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] HTTP exception thrown: Instance 0658227f-88e6-40fd-bb8f-aa6267addc84 could not be found. Aug 07 01:40:20.603832 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-da72f1b1-0e55-4162-a232-9b3bc7ea9981 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:20.604497 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-da72f1b1-0e55-4162-a232-9b3bc7ea9981 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:20.633331 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da72f1b1-0e55-4162-a232-9b3bc7ea9981 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5e32ecf8-6eab-4f99-b591-fb9d652f7437 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Request method failure captured: Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84 HTTP/1.1 Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xZDq6RH3D4bnr1UijP-nk3uo95NJjh7SbfPDqAVgj126rgmdcLbKlTvq4r9AHLnAVbqooFNQ3b97yry4NtGcTnZJETXBytnxiV1irP15oNSC1nhov4fsRvKuKlTNLjRN8RkNUdoouf8PCfkhvGYmSqoJN36Q7GHr7rf2nNkd41nqV4 Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: b630a4c3bb824b90b4c1898a92b47aa7 Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b630a4c3bb824b90b4c1898a92b47aa7", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: b630a4c3bb824b90b4c1898a92b47aa7 Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-AttachVolumeNegativeTest-1422960247-project Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: d556a8ae0d524894a93203ce3f70d420 Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-AttachVolumeNegativeTest-1422960247-project Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 0658227f-88e6-40fd-bb8f-aa6267addc84 could not be found. Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '0658227f-88e6-40fd-bb8f-aa6267addc84'} Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0658227f-88e6-40fd-bb8f-aa6267addc84 could not be found. Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0658227f-88e6-40fd-bb8f-aa6267addc84 could not be found. Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:40:20.634009 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:40:20.638368 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:40:20.638368 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:40:20.638368 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:40:20.638368 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:40:20.638368 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:40:20.638368 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0658227f-88e6-40fd-bb8f-aa6267addc84 could not be found. Aug 07 01:40:20.638368 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:40:20.638368 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5e32ecf8-6eab-4f99-b591-fb9d652f7437 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Returning 404 to user: Instance 0658227f-88e6-40fd-bb8f-aa6267addc84 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:40:20.638908 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5e32ecf8-6eab-4f99-b591-fb9d652f7437 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84" status: 404 len: 111 microversion: 2.1 time: 0.182332 Aug 07 01:40:20.639320 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2937/5408] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:40:20 2022] GET /compute/v2.1/servers/0658227f-88e6-40fd-bb8f-aa6267addc84 => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:40:20.642270 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da72f1b1-0e55-4162-a232-9b3bc7ea9981 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:20.645333 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da72f1b1-0e55-4162-a232-9b3bc7ea9981 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:20.646685 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da72f1b1-0e55-4162-a232-9b3bc7ea9981 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:20.650540 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da72f1b1-0e55-4162-a232-9b3bc7ea9981 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:20.654559 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da72f1b1-0e55-4162-a232-9b3bc7ea9981 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:20.668055 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b727be65-c66d-47ed-888a-54d8912723dd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:20.670867 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b727be65-c66d-47ed-888a-54d8912723dd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 57ef5095-2f80-41c5-abc9-ca37439f3384] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:20.691638 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b727be65-c66d-47ed-888a-54d8912723dd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:20.698397 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b727be65-c66d-47ed-888a-54d8912723dd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:20.698945 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b727be65-c66d-47ed-888a-54d8912723dd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:20.699702 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b727be65-c66d-47ed-888a-54d8912723dd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:20.704322 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b727be65-c66d-47ed-888a-54d8912723dd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:20.704795 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b727be65-c66d-47ed-888a-54d8912723dd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:20.770300 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-b727be65-c66d-47ed-888a-54d8912723dd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] HTTP exception thrown: Instance 57ef5095-2f80-41c5-abc9-ca37439f3384 could not be found. Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b727be65-c66d-47ed-888a-54d8912723dd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Request method failure captured: Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384 HTTP/1.1 Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xZDq6RH3D4bnr1UijP-nk3uo95NJjh7SbfPDqAVgj126rgmdcLbKlTvq4r9AHLnAVbqooFNQ3b97yry4NtGcTnZJETXBytnxiV1irP15oNSC1nhov4fsRvKuKlTNLjRN8RkNUdoouf8PCfkhvGYmSqoJN36Q7GHr7rf2nNkd41nqV4 Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: b630a4c3bb824b90b4c1898a92b47aa7 Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b630a4c3bb824b90b4c1898a92b47aa7", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: b630a4c3bb824b90b4c1898a92b47aa7 Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-AttachVolumeNegativeTest-1422960247-project Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: d556a8ae0d524894a93203ce3f70d420 Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-AttachVolumeNegativeTest-1422960247-project Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 57ef5095-2f80-41c5-abc9-ca37439f3384 could not be found. Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '57ef5095-2f80-41c5-abc9-ca37439f3384'} Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57ef5095-2f80-41c5-abc9-ca37439f3384 could not be found. Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:40:20.773698 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:40:20.777810 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57ef5095-2f80-41c5-abc9-ca37439f3384 could not be found. Aug 07 01:40:20.777810 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:40:20.777810 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:40:20.777810 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:40:20.777810 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:40:20.777810 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:40:20.777810 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:40:20.777810 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:40:20.777810 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:40:20.777810 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57ef5095-2f80-41c5-abc9-ca37439f3384 could not be found. Aug 07 01:40:20.777810 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:40:20.782868 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b727be65-c66d-47ed-888a-54d8912723dd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Returning 404 to user: Instance 57ef5095-2f80-41c5-abc9-ca37439f3384 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:40:20.784082 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b727be65-c66d-47ed-888a-54d8912723dd tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "DELETE /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384" status: 404 len: 111 microversion: 2.1 time: 0.135953 Aug 07 01:40:20.784820 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2938/5409] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:40:20 2022] DELETE /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:40:20.793865 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-87dba4ea-3612-4513-b504-c0408314c344 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:20.797102 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-87dba4ea-3612-4513-b504-c0408314c344 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 57ef5095-2f80-41c5-abc9-ca37439f3384] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:20.813402 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-87dba4ea-3612-4513-b504-c0408314c344 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:20.814115 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-87dba4ea-3612-4513-b504-c0408314c344 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:20.814713 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-87dba4ea-3612-4513-b504-c0408314c344 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:20.815631 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-87dba4ea-3612-4513-b504-c0408314c344 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:20.816258 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-87dba4ea-3612-4513-b504-c0408314c344 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:20.816991 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-87dba4ea-3612-4513-b504-c0408314c344 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:20.893334 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-87dba4ea-3612-4513-b504-c0408314c344 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] HTTP exception thrown: Instance 57ef5095-2f80-41c5-abc9-ca37439f3384 could not be found. Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-87dba4ea-3612-4513-b504-c0408314c344 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Request method failure captured: Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384 HTTP/1.1 Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xZDq6RH3D4bnr1UijP-nk3uo95NJjh7SbfPDqAVgj126rgmdcLbKlTvq4r9AHLnAVbqooFNQ3b97yry4NtGcTnZJETXBytnxiV1irP15oNSC1nhov4fsRvKuKlTNLjRN8RkNUdoouf8PCfkhvGYmSqoJN36Q7GHr7rf2nNkd41nqV4 Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: b630a4c3bb824b90b4c1898a92b47aa7 Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b630a4c3bb824b90b4c1898a92b47aa7", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: b630a4c3bb824b90b4c1898a92b47aa7 Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-AttachVolumeNegativeTest-1422960247-project Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: d556a8ae0d524894a93203ce3f70d420 Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-AttachVolumeNegativeTest-1422960247-project Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 57ef5095-2f80-41c5-abc9-ca37439f3384 could not be found. Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '57ef5095-2f80-41c5-abc9-ca37439f3384'} Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57ef5095-2f80-41c5-abc9-ca37439f3384 could not be found. Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57ef5095-2f80-41c5-abc9-ca37439f3384 could not be found. Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:40:20.907179 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:40:20.911166 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:40:20.911166 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:40:20.911166 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:40:20.911166 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:40:20.911166 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:40:20.911166 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57ef5095-2f80-41c5-abc9-ca37439f3384 could not be found. Aug 07 01:40:20.911166 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:40:20.922534 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-87dba4ea-3612-4513-b504-c0408314c344 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Returning 404 to user: Instance 57ef5095-2f80-41c5-abc9-ca37439f3384 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:40:20.929015 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-87dba4ea-3612-4513-b504-c0408314c344 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384" status: 404 len: 111 microversion: 2.1 time: 0.138788 Aug 07 01:40:20.932820 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2939/5410] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:40:20 2022] GET /compute/v2.1/servers/57ef5095-2f80-41c5-abc9-ca37439f3384 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:40:22.570218 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-da72f1b1-0e55-4162-a232-9b3bc7ea9981 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:40:22.607392 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-da72f1b1-0e55-4162-a232-9b3bc7ea9981 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1664 microversion: 2.1 time: 2.008132 Aug 07 01:40:22.620506 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2472/5411] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:40:20 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1664 bytes in 2022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:40:23.640543 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b9bc5ad8-382f-4a39-a03a-e3a71d68299b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:23.641748 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b9bc5ad8-382f-4a39-a03a-e3a71d68299b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:23.670762 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b9bc5ad8-382f-4a39-a03a-e3a71d68299b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:23.671818 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b9bc5ad8-382f-4a39-a03a-e3a71d68299b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:23.676144 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b9bc5ad8-382f-4a39-a03a-e3a71d68299b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:23.677166 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b9bc5ad8-382f-4a39-a03a-e3a71d68299b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:23.677791 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b9bc5ad8-382f-4a39-a03a-e3a71d68299b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:23.679573 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b9bc5ad8-382f-4a39-a03a-e3a71d68299b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:24.285214 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b9bc5ad8-382f-4a39-a03a-e3a71d68299b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:40:24.294428 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b9bc5ad8-382f-4a39-a03a-e3a71d68299b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1668 microversion: 2.1 time: 0.659502 Aug 07 01:40:24.299659 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2940/5412] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:40:23 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1668 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:40:27.145419 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0c98b383-d7fb-4972-a68b-9678849ebcb2 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:27.145924 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0c98b383-d7fb-4972-a68b-9678849ebcb2 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:27.168076 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0c98b383-d7fb-4972-a68b-9678849ebcb2 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:27.170701 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0c98b383-d7fb-4972-a68b-9678849ebcb2 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:27.173986 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0c98b383-d7fb-4972-a68b-9678849ebcb2 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:27.174957 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0c98b383-d7fb-4972-a68b-9678849ebcb2 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:27.175618 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0c98b383-d7fb-4972-a68b-9678849ebcb2 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:27.184563 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0c98b383-d7fb-4972-a68b-9678849ebcb2 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:27.430844 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-0c98b383-d7fb-4972-a68b-9678849ebcb2 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lazy-loading 'services' on Instance uuid d91eb969-4da0-4789-a33c-73a27d5cef97 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:40:27.588489 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0c98b383-d7fb-4972-a68b-9678849ebcb2 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-volume_attachments/baa19700-e95c-4e01-b0f6-2933f1bf3b7a" status: 202 len: 0 microversion: 2.1 time: 0.447185 Aug 07 01:40:27.596141 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2473/5413] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Aug 7 01:40:27 2022] DELETE /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-volume_attachments/baa19700-e95c-4e01-b0f6-2933f1bf3b7a => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:40:27.601492 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-15ae8a57-598c-4850-a27f-2c8815615fc8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:27.609288 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-15ae8a57-598c-4850-a27f-2c8815615fc8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:27.636501 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-15ae8a57-598c-4850-a27f-2c8815615fc8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:27.636942 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-15ae8a57-598c-4850-a27f-2c8815615fc8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:27.637539 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-15ae8a57-598c-4850-a27f-2c8815615fc8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:27.640402 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-15ae8a57-598c-4850-a27f-2c8815615fc8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:27.641128 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-15ae8a57-598c-4850-a27f-2c8815615fc8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:27.641781 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-15ae8a57-598c-4850-a27f-2c8815615fc8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:27.739929 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-15ae8a57-598c-4850-a27f-2c8815615fc8 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140418 Aug 07 01:40:27.744321 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2941/5414] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:40:27 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:40:28.201331 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cef088fa-6693-4b21-9fae-668078f8e2e7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:28.202096 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-cef088fa-6693-4b21-9fae-668078f8e2e7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:28.255375 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cef088fa-6693-4b21-9fae-668078f8e2e7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:28.259178 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cef088fa-6693-4b21-9fae-668078f8e2e7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:28.262332 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cef088fa-6693-4b21-9fae-668078f8e2e7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:28.265777 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cef088fa-6693-4b21-9fae-668078f8e2e7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:28.270378 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cef088fa-6693-4b21-9fae-668078f8e2e7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:28.272320 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cef088fa-6693-4b21-9fae-668078f8e2e7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:28.389105 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-cef088fa-6693-4b21-9fae-668078f8e2e7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] HTTP exception thrown: Instance 2778f5f5-ea59-43c9-860f-17210bcbbbd2 could not be found. Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cef088fa-6693-4b21-9fae-668078f8e2e7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Request method failure captured: Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2 HTTP/1.1 Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xZDq6RH3D4bnr1UijP-nk3uo95NJjh7SbfPDqAVgj126rgmdcLbKlTvq4r9AHLnAVbqooFNQ3b97yry4NtGcTnZJETXBytnxiV1irP15oNSC1nhov4fsRvKuKlTNLjRN8RkNUdoouf8PCfkhvGYmSqoJN36Q7GHr7rf2nNkd41nqV4 Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: b630a4c3bb824b90b4c1898a92b47aa7 Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b630a4c3bb824b90b4c1898a92b47aa7", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: b630a4c3bb824b90b4c1898a92b47aa7 Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-AttachVolumeNegativeTest-1422960247-project Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: d556a8ae0d524894a93203ce3f70d420 Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-AttachVolumeNegativeTest-1422960247-project Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 2778f5f5-ea59-43c9-860f-17210bcbbbd2 could not be found. Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '2778f5f5-ea59-43c9-860f-17210bcbbbd2'} Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2778f5f5-ea59-43c9-860f-17210bcbbbd2 could not be found. Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:40:28.390855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:40:28.394252 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2778f5f5-ea59-43c9-860f-17210bcbbbd2 could not be found. Aug 07 01:40:28.394252 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:40:28.394252 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:40:28.394252 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:40:28.394252 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:40:28.394252 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:40:28.394252 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:40:28.394252 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:40:28.394252 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:40:28.394252 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2778f5f5-ea59-43c9-860f-17210bcbbbd2 could not be found. Aug 07 01:40:28.394252 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:40:28.399151 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cef088fa-6693-4b21-9fae-668078f8e2e7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Returning 404 to user: Instance 2778f5f5-ea59-43c9-860f-17210bcbbbd2 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:40:28.399151 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cef088fa-6693-4b21-9fae-668078f8e2e7 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2" status: 404 len: 111 microversion: 2.1 time: 0.202212 Aug 07 01:40:28.400900 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2474/5415] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:40:28 2022] DELETE /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2 => generated 111 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:40:28.406717 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7bba50f2-fab1-4e1c-8266-c27886dd3533 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:28.407443 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7bba50f2-fab1-4e1c-8266-c27886dd3533 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] [instance: 2778f5f5-ea59-43c9-860f-17210bcbbbd2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:28.416269 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7bba50f2-fab1-4e1c-8266-c27886dd3533 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:28.416757 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7bba50f2-fab1-4e1c-8266-c27886dd3533 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:28.417206 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7bba50f2-fab1-4e1c-8266-c27886dd3533 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:28.417896 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7bba50f2-fab1-4e1c-8266-c27886dd3533 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:28.418349 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7bba50f2-fab1-4e1c-8266-c27886dd3533 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:28.418771 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7bba50f2-fab1-4e1c-8266-c27886dd3533 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:28.485084 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-7bba50f2-fab1-4e1c-8266-c27886dd3533 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] HTTP exception thrown: Instance 2778f5f5-ea59-43c9-860f-17210bcbbbd2 could not be found. Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7bba50f2-fab1-4e1c-8266-c27886dd3533 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Request method failure captured: Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2 HTTP/1.1 Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xZDq6RH3D4bnr1UijP-nk3uo95NJjh7SbfPDqAVgj126rgmdcLbKlTvq4r9AHLnAVbqooFNQ3b97yry4NtGcTnZJETXBytnxiV1irP15oNSC1nhov4fsRvKuKlTNLjRN8RkNUdoouf8PCfkhvGYmSqoJN36Q7GHr7rf2nNkd41nqV4 Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: b630a4c3bb824b90b4c1898a92b47aa7 Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b630a4c3bb824b90b4c1898a92b47aa7", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b630a4c3bb824b90b4c1898a92b47aa7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: b630a4c3bb824b90b4c1898a92b47aa7 Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1422960247 Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-AttachVolumeNegativeTest-1422960247-project Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: d556a8ae0d524894a93203ce3f70d420 Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-AttachVolumeNegativeTest-1422960247-project Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 2778f5f5-ea59-43c9-860f-17210bcbbbd2 could not be found. Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '2778f5f5-ea59-43c9-860f-17210bcbbbd2'} Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2778f5f5-ea59-43c9-860f-17210bcbbbd2 could not be found. Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2778f5f5-ea59-43c9-860f-17210bcbbbd2 could not be found. Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:40:28.487862 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:40:28.491831 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:40:28.491831 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:40:28.491831 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:40:28.491831 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:40:28.491831 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:40:28.491831 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2778f5f5-ea59-43c9-860f-17210bcbbbd2 could not be found. Aug 07 01:40:28.491831 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:40:28.497604 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7bba50f2-fab1-4e1c-8266-c27886dd3533 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] Returning 404 to user: Instance 2778f5f5-ea59-43c9-860f-17210bcbbbd2 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:40:28.499346 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7bba50f2-fab1-4e1c-8266-c27886dd3533 tempest-AttachVolumeNegativeTest-1422960247 tempest-AttachVolumeNegativeTest-1422960247-project] 10.222.0.39 "GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2" status: 404 len: 111 microversion: 2.1 time: 0.096449 Aug 07 01:40:28.502038 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2942/5416] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:40:28 2022] GET /compute/v2.1/servers/2778f5f5-ea59-43c9-860f-17210bcbbbd2 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:40:28.755508 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ce021f81-55fb-487c-953a-6352bf45418a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:28.759922 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ce021f81-55fb-487c-953a-6352bf45418a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:28.787831 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce021f81-55fb-487c-953a-6352bf45418a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:28.792046 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce021f81-55fb-487c-953a-6352bf45418a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:28.792507 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce021f81-55fb-487c-953a-6352bf45418a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:28.793264 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce021f81-55fb-487c-953a-6352bf45418a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:28.793735 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce021f81-55fb-487c-953a-6352bf45418a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:28.808354 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce021f81-55fb-487c-953a-6352bf45418a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:28.868881 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ce021f81-55fb-487c-953a-6352bf45418a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118002 Aug 07 01:40:28.874037 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2475/5417] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:40:28 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:40:29.882609 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f355f019-d201-470f-88ab-2f99a505d658 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:29.890406 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f355f019-d201-470f-88ab-2f99a505d658 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:29.910012 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f355f019-d201-470f-88ab-2f99a505d658 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:29.910360 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f355f019-d201-470f-88ab-2f99a505d658 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:29.910800 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f355f019-d201-470f-88ab-2f99a505d658 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:29.911520 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f355f019-d201-470f-88ab-2f99a505d658 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:29.912006 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f355f019-d201-470f-88ab-2f99a505d658 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:29.922544 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f355f019-d201-470f-88ab-2f99a505d658 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:30.079427 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f355f019-d201-470f-88ab-2f99a505d658 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.200927 Aug 07 01:40:30.089031 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2943/5418] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:40:29 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-volume_attachments => generated 197 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:40:31.092222 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7ea93fe3-97ac-4c03-8558-f27377dadde0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:31.094426 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7ea93fe3-97ac-4c03-8558-f27377dadde0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:31.106961 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ea93fe3-97ac-4c03-8558-f27377dadde0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:31.109333 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ea93fe3-97ac-4c03-8558-f27377dadde0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:31.109827 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ea93fe3-97ac-4c03-8558-f27377dadde0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:31.110578 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ea93fe3-97ac-4c03-8558-f27377dadde0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:31.111049 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ea93fe3-97ac-4c03-8558-f27377dadde0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:31.111487 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ea93fe3-97ac-4c03-8558-f27377dadde0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:31.226804 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7ea93fe3-97ac-4c03-8558-f27377dadde0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127957 Aug 07 01:40:31.227713 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2476/5419] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:40:31 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:40:32.238904 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-629defad-bd86-4b12-96af-b1dffb5e3dd4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:32.242929 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-629defad-bd86-4b12-96af-b1dffb5e3dd4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:32.269949 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-629defad-bd86-4b12-96af-b1dffb5e3dd4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:32.272847 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-629defad-bd86-4b12-96af-b1dffb5e3dd4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:32.274531 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-629defad-bd86-4b12-96af-b1dffb5e3dd4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:32.278395 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-629defad-bd86-4b12-96af-b1dffb5e3dd4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:32.281460 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-629defad-bd86-4b12-96af-b1dffb5e3dd4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:32.282218 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-629defad-bd86-4b12-96af-b1dffb5e3dd4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:32.440592 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-629defad-bd86-4b12-96af-b1dffb5e3dd4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.205627 Aug 07 01:40:32.453583 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2944/5420] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:40:32 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-volume_attachments => generated 197 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:40:33.458748 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b8674ff8-25cd-4d53-acc1-ee3d151eecac tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:33.462735 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b8674ff8-25cd-4d53-acc1-ee3d151eecac tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:33.490573 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b8674ff8-25cd-4d53-acc1-ee3d151eecac tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:33.491522 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b8674ff8-25cd-4d53-acc1-ee3d151eecac tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:33.492276 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b8674ff8-25cd-4d53-acc1-ee3d151eecac tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:33.498808 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b8674ff8-25cd-4d53-acc1-ee3d151eecac tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:33.500514 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b8674ff8-25cd-4d53-acc1-ee3d151eecac tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:33.502941 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b8674ff8-25cd-4d53-acc1-ee3d151eecac tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:33.628142 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b8674ff8-25cd-4d53-acc1-ee3d151eecac tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.173653 Aug 07 01:40:33.636496 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2477/5421] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:40:33 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:40:34.641726 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5ce0c447-df88-4af2-ae22-51ceb41da37b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:34.644872 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5ce0c447-df88-4af2-ae22-51ceb41da37b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:34.666255 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5ce0c447-df88-4af2-ae22-51ceb41da37b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:34.666675 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5ce0c447-df88-4af2-ae22-51ceb41da37b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:34.667129 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5ce0c447-df88-4af2-ae22-51ceb41da37b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:34.667870 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5ce0c447-df88-4af2-ae22-51ceb41da37b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:34.680709 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5ce0c447-df88-4af2-ae22-51ceb41da37b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:34.681290 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5ce0c447-df88-4af2-ae22-51ceb41da37b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:34.791241 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5ce0c447-df88-4af2-ae22-51ceb41da37b tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153536 Aug 07 01:40:34.792201 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2945/5422] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:40:34 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:40:35.808682 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c7172d10-4456-49cb-869f-08e6ad8bcbc5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:35.814669 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c7172d10-4456-49cb-869f-08e6ad8bcbc5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:35.829482 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7172d10-4456-49cb-869f-08e6ad8bcbc5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:35.832652 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7172d10-4456-49cb-869f-08e6ad8bcbc5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:35.833538 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7172d10-4456-49cb-869f-08e6ad8bcbc5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:35.835750 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7172d10-4456-49cb-869f-08e6ad8bcbc5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:35.838961 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7172d10-4456-49cb-869f-08e6ad8bcbc5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:35.840811 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7172d10-4456-49cb-869f-08e6ad8bcbc5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:35.915546 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c7172d10-4456-49cb-869f-08e6ad8bcbc5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116294 Aug 07 01:40:35.919506 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2478/5423] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:40:35 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:40:36.932000 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-aa212890-d44b-4366-adf5-f814f41b8034 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:36.934261 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-aa212890-d44b-4366-adf5-f814f41b8034 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:36.951875 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa212890-d44b-4366-adf5-f814f41b8034 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:36.952436 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa212890-d44b-4366-adf5-f814f41b8034 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:36.953008 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa212890-d44b-4366-adf5-f814f41b8034 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:36.953743 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa212890-d44b-4366-adf5-f814f41b8034 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:36.954332 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa212890-d44b-4366-adf5-f814f41b8034 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:36.959993 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa212890-d44b-4366-adf5-f814f41b8034 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:37.117527 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-aa212890-d44b-4366-adf5-f814f41b8034 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.187848 Aug 07 01:40:37.125213 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2946/5424] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:40:36 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-volume_attachments => generated 197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:40:38.134091 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ecece087-ea4a-4068-8f6f-46cda90f5a5f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:38.136667 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ecece087-ea4a-4068-8f6f-46cda90f5a5f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:38.147178 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=28 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:38.160416 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ecece087-ea4a-4068-8f6f-46cda90f5a5f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:38.160918 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ecece087-ea4a-4068-8f6f-46cda90f5a5f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:38.161359 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ecece087-ea4a-4068-8f6f-46cda90f5a5f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:38.162116 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ecece087-ea4a-4068-8f6f-46cda90f5a5f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:38.162572 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ecece087-ea4a-4068-8f6f-46cda90f5a5f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:38.163003 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ecece087-ea4a-4068-8f6f-46cda90f5a5f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:38.272905 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ecece087-ea4a-4068-8f6f-46cda90f5a5f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145189 Aug 07 01:40:38.278029 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2479/5425] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:40:38 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:40:39.285254 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e284e5a1-3201-49ee-bcec-bbd41edcad0c tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:39.289343 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e284e5a1-3201-49ee-bcec-bbd41edcad0c tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:39.336412 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e284e5a1-3201-49ee-bcec-bbd41edcad0c tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:39.341759 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e284e5a1-3201-49ee-bcec-bbd41edcad0c tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:39.344856 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e284e5a1-3201-49ee-bcec-bbd41edcad0c tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:39.348849 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e284e5a1-3201-49ee-bcec-bbd41edcad0c tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:39.352610 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e284e5a1-3201-49ee-bcec-bbd41edcad0c tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:39.357310 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e284e5a1-3201-49ee-bcec-bbd41edcad0c tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:39.516151 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e284e5a1-3201-49ee-bcec-bbd41edcad0c tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.232471 Aug 07 01:40:39.519394 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2947/5426] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:40:39 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-volume_attachments => generated 197 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:40:40.531731 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-478db000-7a4e-4072-a3e1-e7556b4475fe tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:40.536460 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-478db000-7a4e-4072-a3e1-e7556b4475fe tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:40.560434 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-478db000-7a4e-4072-a3e1-e7556b4475fe tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:40.564844 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-478db000-7a4e-4072-a3e1-e7556b4475fe tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:40.565459 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-478db000-7a4e-4072-a3e1-e7556b4475fe tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:40.566345 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-478db000-7a4e-4072-a3e1-e7556b4475fe tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:40.577608 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-478db000-7a4e-4072-a3e1-e7556b4475fe tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:40.578183 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-478db000-7a4e-4072-a3e1-e7556b4475fe tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:40.671797 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-478db000-7a4e-4072-a3e1-e7556b4475fe tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146218 Aug 07 01:40:40.687011 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2480/5427] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:40:40 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:40:41.686792 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c014ba0a-5fee-4472-bdcc-db39fd057d07 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:41.691544 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c014ba0a-5fee-4472-bdcc-db39fd057d07 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:41.730297 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c014ba0a-5fee-4472-bdcc-db39fd057d07 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:41.745652 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c014ba0a-5fee-4472-bdcc-db39fd057d07 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:41.746927 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c014ba0a-5fee-4472-bdcc-db39fd057d07 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:41.749020 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c014ba0a-5fee-4472-bdcc-db39fd057d07 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:41.752082 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c014ba0a-5fee-4472-bdcc-db39fd057d07 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:41.753332 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c014ba0a-5fee-4472-bdcc-db39fd057d07 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:41.838600 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c014ba0a-5fee-4472-bdcc-db39fd057d07 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155683 Aug 07 01:40:41.845221 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2948/5428] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:40:41 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:40:42.854583 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-54e5f1d6-dc84-42c6-9620-f16e2ca27acf tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:42.863616 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-54e5f1d6-dc84-42c6-9620-f16e2ca27acf tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:42.884367 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54e5f1d6-dc84-42c6-9620-f16e2ca27acf tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:42.884878 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54e5f1d6-dc84-42c6-9620-f16e2ca27acf tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:42.885573 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54e5f1d6-dc84-42c6-9620-f16e2ca27acf tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:42.886315 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54e5f1d6-dc84-42c6-9620-f16e2ca27acf tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:42.893142 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54e5f1d6-dc84-42c6-9620-f16e2ca27acf tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:42.893611 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54e5f1d6-dc84-42c6-9620-f16e2ca27acf tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:42.992724 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-54e5f1d6-dc84-42c6-9620-f16e2ca27acf tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.145636 Aug 07 01:40:42.999745 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2481/5429] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:40:42 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97/os-volume_attachments => generated 25 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:40:43.129589 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a87d7e72-07bb-4ddb-a617-ce00094a3bee tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:40:43.136138 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a87d7e72-07bb-4ddb-a617-ce00094a3bee tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:43.160244 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a87d7e72-07bb-4ddb-a617-ce00094a3bee tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:43.161644 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a87d7e72-07bb-4ddb-a617-ce00094a3bee tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:43.163284 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a87d7e72-07bb-4ddb-a617-ce00094a3bee tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:43.165001 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a87d7e72-07bb-4ddb-a617-ce00094a3bee tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:43.166990 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a87d7e72-07bb-4ddb-a617-ce00094a3bee tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:43.168893 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a87d7e72-07bb-4ddb-a617-ce00094a3bee tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:43.207325 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:43.238425 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-a87d7e72-07bb-4ddb-a617-ce00094a3bee tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] HTTP exception thrown: Cannot 'reboot' instance 40fafd12-87a1-49ad-9152-5b47f28a80b7 while it is in vm_state rescued Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a87d7e72-07bb-4ddb-a617-ce00094a3bee tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Request method failure captured: Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7/action HTTP/1.1 Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 28 Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xcFUTwOrsKbLuCg4An479LA9G9aDuSE7GEjV8VWyLtq1rxOhZ9Q8jcwtkvN3VeO8ggfh8KvRRX8HWvqee02PsBBf0WFvhZisgorTKvdssuK7IJ1NUIDzU8DRVfm2J3najrfJ74eq56eKh78U1nPClJkssFs7yS7oVt53yn2dEShWXQ Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 70f17360f0c84562bd99b006b659736e Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1195249405 Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/70f17360f0c84562bd99b006b659736e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_70f17360f0c84562bd99b006b659736e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/70f17360f0c84562bd99b006b659736e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/70f17360f0c84562bd99b006b659736e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1195249405 Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 70f17360f0c84562bd99b006b659736e Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1195249405 Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServerRescueNegativeTestJSON-1195249405-project Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 2f5acf7da18b43f89e24760744cfdb49 Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1195249405-project Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: {"reboot": {"type": "HARD"}} Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: exception: Cannot 'reboot' instance 40fafd12-87a1-49ad-9152-5b47f28a80b7 while it is in vm_state rescued Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '40fafd12-87a1-49ad-9152-5b47f28a80b7', 'body': {'reboot': {'type': 'HARD'}}} Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3499, in reboot Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 40fafd12-87a1-49ad-9152-5b47f28a80b7 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 07 01:40:43.244764 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 07 01:40:43.248506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 40fafd12-87a1-49ad-9152-5b47f28a80b7 while it is in vm_state rescued Aug 07 01:40:43.248506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:40:43.248506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:40:43.248506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:40:43.248506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:40:43.248506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:40:43.248506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:40:43.248506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:40:43.248506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:40:43.248506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 40fafd12-87a1-49ad-9152-5b47f28a80b7 while it is in vm_state rescued Aug 07 01:40:43.248506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:40:43.253367 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a87d7e72-07bb-4ddb-a617-ce00094a3bee tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Returning 409 to user: Cannot 'reboot' instance 40fafd12-87a1-49ad-9152-5b47f28a80b7 while it is in vm_state rescued {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:40:43.256383 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a87d7e72-07bb-4ddb-a617-ce00094a3bee tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "POST /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7/action" status: 409 len: 145 microversion: 2.1 time: 0.134161 Aug 07 01:40:43.259006 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2949/5430] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:40:43 2022] POST /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7/action => generated 145 bytes in 138 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:40:43.274349 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ce420cf1-bf1d-4895-a998-11134118d688 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:40:43.277259 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ce420cf1-bf1d-4895-a998-11134118d688 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:43.297884 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce420cf1-bf1d-4895-a998-11134118d688 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:43.298805 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce420cf1-bf1d-4895-a998-11134118d688 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:43.299606 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce420cf1-bf1d-4895-a998-11134118d688 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:43.315102 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce420cf1-bf1d-4895-a998-11134118d688 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:43.315777 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce420cf1-bf1d-4895-a998-11134118d688 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:43.317507 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce420cf1-bf1d-4895-a998-11134118d688 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:43.456718 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-ce420cf1-bf1d-4895-a998-11134118d688 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] HTTP exception thrown: Cannot 'rebuild' instance 40fafd12-87a1-49ad-9152-5b47f28a80b7 while it is in vm_state rescued Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ce420cf1-bf1d-4895-a998-11134118d688 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Request method failure captured: Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7/action HTTP/1.1 Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 65 Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xcFUTwOrsKbLuCg4An479LA9G9aDuSE7GEjV8VWyLtq1rxOhZ9Q8jcwtkvN3VeO8ggfh8KvRRX8HWvqee02PsBBf0WFvhZisgorTKvdssuK7IJ1NUIDzU8DRVfm2J3najrfJ74eq56eKh78U1nPClJkssFs7yS7oVt53yn2dEShWXQ Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 70f17360f0c84562bd99b006b659736e Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1195249405 Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/70f17360f0c84562bd99b006b659736e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_70f17360f0c84562bd99b006b659736e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/70f17360f0c84562bd99b006b659736e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/70f17360f0c84562bd99b006b659736e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1195249405 Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 70f17360f0c84562bd99b006b659736e Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1195249405 Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServerRescueNegativeTestJSON-1195249405-project Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 2f5acf7da18b43f89e24760744cfdb49 Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1195249405-project Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: {"rebuild": {"imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731"}} Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: exception: Cannot 'rebuild' instance 40fafd12-87a1-49ad-9152-5b47f28a80b7 while it is in vm_state rescued Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '40fafd12-87a1-49ad-9152-5b47f28a80b7', 'body': {'rebuild': {'imageRef': 'e825bd61-bf05-4bd4-aa72-78daf2231731'}}} Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 40fafd12-87a1-49ad-9152-5b47f28a80b7 in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:40:43.468333 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 01:40:43.472654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 01:40:43.472654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 07 01:40:43.472654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Aug 07 01:40:43.472654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 07 01:40:43.472654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 07 01:40:43.472654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 07 01:40:43.472654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 40fafd12-87a1-49ad-9152-5b47f28a80b7 while it is in vm_state rescued Aug 07 01:40:43.472654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:40:43.472654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:40:43.472654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:40:43.472654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:40:43.472654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:40:43.472654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:40:43.472654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:40:43.472654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:40:43.472654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 40fafd12-87a1-49ad-9152-5b47f28a80b7 while it is in vm_state rescued Aug 07 01:40:43.472654 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:40:43.472654 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ce420cf1-bf1d-4895-a998-11134118d688 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Returning 409 to user: Cannot 'rebuild' instance 40fafd12-87a1-49ad-9152-5b47f28a80b7 while it is in vm_state rescued {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:40:43.476998 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ce420cf1-bf1d-4895-a998-11134118d688 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "POST /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7/action" status: 409 len: 146 microversion: 2.1 time: 0.206156 Aug 07 01:40:43.481380 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2482/5431] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:40:43 2022] POST /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7/action => generated 146 bytes in 212 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:40:43.489883 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-db0137f9-34c8-4bd9-b347-400586be0e5e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:43.490676 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-db0137f9-34c8-4bd9-b347-400586be0e5e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:43.501810 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-db0137f9-34c8-4bd9-b347-400586be0e5e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:43.502396 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-db0137f9-34c8-4bd9-b347-400586be0e5e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:43.502908 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-db0137f9-34c8-4bd9-b347-400586be0e5e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:43.506810 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-db0137f9-34c8-4bd9-b347-400586be0e5e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:43.507392 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-db0137f9-34c8-4bd9-b347-400586be0e5e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:43.507944 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-db0137f9-34c8-4bd9-b347-400586be0e5e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:43.589970 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-db0137f9-34c8-4bd9-b347-400586be0e5e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:40:43.887431 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-db0137f9-34c8-4bd9-b347-400586be0e5e tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 204 len: 0 microversion: 2.1 time: 0.401698 Aug 07 01:40:43.890706 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2950/5432] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:40:43 2022] DELETE /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:40:43.900173 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c4a9a515-b67d-40f4-9b28-32694d7e5da0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:43.901287 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c4a9a515-b67d-40f4-9b28-32694d7e5da0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:43.913817 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c4a9a515-b67d-40f4-9b28-32694d7e5da0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:43.916470 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c4a9a515-b67d-40f4-9b28-32694d7e5da0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:43.918073 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c4a9a515-b67d-40f4-9b28-32694d7e5da0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:43.922555 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c4a9a515-b67d-40f4-9b28-32694d7e5da0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:43.923342 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c4a9a515-b67d-40f4-9b28-32694d7e5da0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:43.925749 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c4a9a515-b67d-40f4-9b28-32694d7e5da0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:45.036281 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c4a9a515-b67d-40f4-9b28-32694d7e5da0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:40:45.089350 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c4a9a515-b67d-40f4-9b28-32694d7e5da0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1689 microversion: 2.1 time: 1.194480 Aug 07 01:40:45.093039 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2483/5433] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:40:43 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1689 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:40:46.118406 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6f83ce86-f52b-4348-951d-1d9ea7eed605 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:46.119119 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6f83ce86-f52b-4348-951d-1d9ea7eed605 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:46.138001 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f83ce86-f52b-4348-951d-1d9ea7eed605 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:46.139828 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f83ce86-f52b-4348-951d-1d9ea7eed605 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:46.140751 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f83ce86-f52b-4348-951d-1d9ea7eed605 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:46.141012 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f83ce86-f52b-4348-951d-1d9ea7eed605 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:46.148653 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f83ce86-f52b-4348-951d-1d9ea7eed605 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:46.149117 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f83ce86-f52b-4348-951d-1d9ea7eed605 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:46.624711 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6f83ce86-f52b-4348-951d-1d9ea7eed605 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:40:46.636007 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6f83ce86-f52b-4348-951d-1d9ea7eed605 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1689 microversion: 2.1 time: 0.522357 Aug 07 01:40:46.637494 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2951/5434] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:40:46 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1689 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:40:47.658711 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7a5f2971-c02e-4c6a-acc1-bba0835df861 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:47.660082 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7a5f2971-c02e-4c6a-acc1-bba0835df861 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:47.682225 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a5f2971-c02e-4c6a-acc1-bba0835df861 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:47.689315 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a5f2971-c02e-4c6a-acc1-bba0835df861 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:47.690245 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a5f2971-c02e-4c6a-acc1-bba0835df861 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:47.691188 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a5f2971-c02e-4c6a-acc1-bba0835df861 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:47.693838 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a5f2971-c02e-4c6a-acc1-bba0835df861 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:47.699343 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a5f2971-c02e-4c6a-acc1-bba0835df861 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:47.714630 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:48.401019 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7a5f2971-c02e-4c6a-acc1-bba0835df861 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:40:48.408973 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7a5f2971-c02e-4c6a-acc1-bba0835df861 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1689 microversion: 2.1 time: 0.755004 Aug 07 01:40:48.412247 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2484/5435] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:40:47 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1689 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:40:49.431013 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f8f736af-6ab1-4a20-a618-ebd30a855088 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:49.431818 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f8f736af-6ab1-4a20-a618-ebd30a855088 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:49.445749 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f8f736af-6ab1-4a20-a618-ebd30a855088 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:49.458600 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f8f736af-6ab1-4a20-a618-ebd30a855088 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:49.459274 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f8f736af-6ab1-4a20-a618-ebd30a855088 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:49.460214 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f8f736af-6ab1-4a20-a618-ebd30a855088 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:49.462174 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f8f736af-6ab1-4a20-a618-ebd30a855088 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:49.462659 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f8f736af-6ab1-4a20-a618-ebd30a855088 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:49.808141 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f8f736af-6ab1-4a20-a618-ebd30a855088 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:40:49.829085 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f8f736af-6ab1-4a20-a618-ebd30a855088 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1689 microversion: 2.1 time: 0.402290 Aug 07 01:40:49.830599 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2952/5436] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:40:49 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1689 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:40:50.561259 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-9022163c-548f-4fdb-b9c9-33661fa3256e req-de2a5350-8e2f-46f5-b18b-a606ec13bc1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d91eb969-4da0-4789-a33c-73a27d5cef97", "name": "network-vif-deleted", "tag": "561b9998-3694-4cb6-8ce2-0630e19b986b"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:40:50.593747 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-9022163c-548f-4fdb-b9c9-33661fa3256e req-de2a5350-8e2f-46f5-b18b-a606ec13bc1c service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:50.600631 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-9022163c-548f-4fdb-b9c9-33661fa3256e req-de2a5350-8e2f-46f5-b18b-a606ec13bc1c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:50.601442 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-9022163c-548f-4fdb-b9c9-33661fa3256e req-de2a5350-8e2f-46f5-b18b-a606ec13bc1c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:50.641010 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-9022163c-548f-4fdb-b9c9-33661fa3256e req-de2a5350-8e2f-46f5-b18b-a606ec13bc1c service nova] Creating event network-vif-deleted:561b9998-3694-4cb6-8ce2-0630e19b986b for instance d91eb969-4da0-4789-a33c-73a27d5cef97 on n-h1-master-1 Aug 07 01:40:50.655925 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-9022163c-548f-4fdb-b9c9-33661fa3256e req-de2a5350-8e2f-46f5-b18b-a606ec13bc1c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098528 Aug 07 01:40:50.664669 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2485/5437] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:40:50.854341 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-62611f1b-e739-4e67-b1d0-bdb64672962f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:50.855747 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-62611f1b-e739-4e67-b1d0-bdb64672962f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:50.880917 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:50.883290 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62611f1b-e739-4e67-b1d0-bdb64672962f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:50.883959 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62611f1b-e739-4e67-b1d0-bdb64672962f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:50.886887 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62611f1b-e739-4e67-b1d0-bdb64672962f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:50.886887 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62611f1b-e739-4e67-b1d0-bdb64672962f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:50.903432 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62611f1b-e739-4e67-b1d0-bdb64672962f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:50.904265 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62611f1b-e739-4e67-b1d0-bdb64672962f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:51.086923 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62611f1b-e739-4e67-b1d0-bdb64672962f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:51.091253 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62611f1b-e739-4e67-b1d0-bdb64672962f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:51.092531 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62611f1b-e739-4e67-b1d0-bdb64672962f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:51.094309 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-62611f1b-e739-4e67-b1d0-bdb64672962f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lazy-loading 'fault' on Instance uuid d91eb969-4da0-4789-a33c-73a27d5cef97 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:40:51.291464 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-62611f1b-e739-4e67-b1d0-bdb64672962f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:40:51.301071 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-62611f1b-e739-4e67-b1d0-bdb64672962f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 200 len: 1335 microversion: 2.1 time: 0.453612 Aug 07 01:40:51.324867 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2953/5438] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:40:50 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 1335 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:40:52.327347 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3eb29b77-3bc7-4e39-a81c-37b888f400b5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:52.328086 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3eb29b77-3bc7-4e39-a81c-37b888f400b5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: d91eb969-4da0-4789-a33c-73a27d5cef97] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:52.341582 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3eb29b77-3bc7-4e39-a81c-37b888f400b5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:52.342222 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3eb29b77-3bc7-4e39-a81c-37b888f400b5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:52.342654 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3eb29b77-3bc7-4e39-a81c-37b888f400b5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:52.343434 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3eb29b77-3bc7-4e39-a81c-37b888f400b5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:52.343910 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3eb29b77-3bc7-4e39-a81c-37b888f400b5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:52.350024 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3eb29b77-3bc7-4e39-a81c-37b888f400b5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:52.375572 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-3eb29b77-3bc7-4e39-a81c-37b888f400b5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] HTTP exception thrown: Instance d91eb969-4da0-4789-a33c-73a27d5cef97 could not be found. Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3eb29b77-3bc7-4e39-a81c-37b888f400b5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Request method failure captured: Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 HTTP/1.1 Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xcFUTwOrsKbLuCg4An479LA9G9aDuSE7GEjV8VWyLtq1rxOhZ9Q8jcwtkvN3VeO8ggfh8KvRRX8HWvqee02PsBBf0WFvhZisgorTKvdssuK7IJ1NUIDzU8DRVfm2J3najrfJ74eq56eKh78U1nPClJkssFs7yS7oVt53yn2dEShWXQ Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 70f17360f0c84562bd99b006b659736e Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1195249405 Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/70f17360f0c84562bd99b006b659736e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_70f17360f0c84562bd99b006b659736e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/70f17360f0c84562bd99b006b659736e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/70f17360f0c84562bd99b006b659736e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1195249405 Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 70f17360f0c84562bd99b006b659736e Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1195249405 Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServerRescueNegativeTestJSON-1195249405-project Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 2f5acf7da18b43f89e24760744cfdb49 Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1195249405-project Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: exception: Instance d91eb969-4da0-4789-a33c-73a27d5cef97 could not be found. Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'd91eb969-4da0-4789-a33c-73a27d5cef97'} Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d91eb969-4da0-4789-a33c-73a27d5cef97 could not be found. Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d91eb969-4da0-4789-a33c-73a27d5cef97 could not be found. Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:40:52.381849 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:40:52.386500 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:40:52.386500 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:40:52.386500 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:40:52.386500 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:40:52.386500 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:40:52.386500 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:40:52.386500 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d91eb969-4da0-4789-a33c-73a27d5cef97 could not be found. Aug 07 01:40:52.386500 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:40:52.387732 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3eb29b77-3bc7-4e39-a81c-37b888f400b5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Returning 404 to user: Instance d91eb969-4da0-4789-a33c-73a27d5cef97 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:40:52.388799 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3eb29b77-3bc7-4e39-a81c-37b888f400b5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97" status: 404 len: 111 microversion: 2.1 time: 0.065674 Aug 07 01:40:52.391691 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2486/5439] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:40:52 2022] GET /compute/v2.1/servers/d91eb969-4da0-4789-a33c-73a27d5cef97 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:40:52.399874 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8c4fdeb4-0532-43cd-ab01-0fcade406e18 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '.version_select at 0x7f9e2439cb80>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:52.440879 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8c4fdeb4-0532-43cd-ab01-0fcade406e18 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1175283255" status: 202 len: 0 microversion: 2.1 time: 0.045772 Aug 07 01:40:52.442336 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2954/5440] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Aug 7 01:40:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1175283255 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:40:57.214441 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-dd2799de-19df-4755-b5b8-e33644b44a9b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:57.219845 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-dd2799de-19df-4755-b5b8-e33644b44a9b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:57.255477 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd2799de-19df-4755-b5b8-e33644b44a9b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:57.256004 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd2799de-19df-4755-b5b8-e33644b44a9b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:57.262572 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd2799de-19df-4755-b5b8-e33644b44a9b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:57.263344 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd2799de-19df-4755-b5b8-e33644b44a9b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:57.263817 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd2799de-19df-4755-b5b8-e33644b44a9b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:57.269235 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dd2799de-19df-4755-b5b8-e33644b44a9b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:57.382880 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-dd2799de-19df-4755-b5b8-e33644b44a9b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.172426 Aug 07 01:40:57.384420 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2487/5441] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:40:57 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976/os-volume_attachments => generated 25 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:40:57.631277 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3ea784e7-1324-4789-a783-fca142f13ff0 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:57.632579 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3ea784e7-1324-4789-a783-fca142f13ff0 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:57.730228 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ea784e7-1324-4789-a783-fca142f13ff0 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:57.730800 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ea784e7-1324-4789-a783-fca142f13ff0 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.044s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:57.740245 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ea784e7-1324-4789-a783-fca142f13ff0 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:57.743231 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ea784e7-1324-4789-a783-fca142f13ff0 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:57.745988 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ea784e7-1324-4789-a783-fca142f13ff0 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:57.751049 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ea784e7-1324-4789-a783-fca142f13ff0 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:57.849900 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3ea784e7-1324-4789-a783-fca142f13ff0 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:40:58.034968 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3ea784e7-1324-4789-a783-fca142f13ff0 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 204 len: 0 microversion: 2.1 time: 0.409461 Aug 07 01:40:58.036195 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2955/5442] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:40:57 2022] DELETE /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:40:58.045729 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a9a85eed-06e9-4583-8477-39efe5dbcc5a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:58.046550 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a9a85eed-06e9-4583-8477-39efe5dbcc5a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:58.056697 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a9a85eed-06e9-4583-8477-39efe5dbcc5a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:58.057557 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a9a85eed-06e9-4583-8477-39efe5dbcc5a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:58.060026 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a9a85eed-06e9-4583-8477-39efe5dbcc5a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:58.060956 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a9a85eed-06e9-4583-8477-39efe5dbcc5a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:58.062252 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a9a85eed-06e9-4583-8477-39efe5dbcc5a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:58.064418 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a9a85eed-06e9-4583-8477-39efe5dbcc5a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:58.413807 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a9a85eed-06e9-4583-8477-39efe5dbcc5a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:40:58.432820 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a9a85eed-06e9-4583-8477-39efe5dbcc5a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1674 microversion: 2.1 time: 0.392470 Aug 07 01:40:58.444171 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2488/5443] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:40:58 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1674 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:40:59.459386 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-27287269-f3a6-4385-b499-e5ffdce0689d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:40:59.460177 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-27287269-f3a6-4385-b499-e5ffdce0689d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:40:59.481000 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27287269-f3a6-4385-b499-e5ffdce0689d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:59.481525 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27287269-f3a6-4385-b499-e5ffdce0689d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:59.481949 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27287269-f3a6-4385-b499-e5ffdce0689d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:40:59.482679 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27287269-f3a6-4385-b499-e5ffdce0689d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:40:59.491282 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27287269-f3a6-4385-b499-e5ffdce0689d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:40:59.491987 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27287269-f3a6-4385-b499-e5ffdce0689d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:00.175634 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-27287269-f3a6-4385-b499-e5ffdce0689d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:00.188615 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-27287269-f3a6-4385-b499-e5ffdce0689d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1674 microversion: 2.1 time: 0.733706 Aug 07 01:41:00.203351 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2956/5444] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:40:59 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1674 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:41:01.211187 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-40346584-7625-4e31-94b6-9b884da58001 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:01.212532 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-40346584-7625-4e31-94b6-9b884da58001 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:01.227386 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-40346584-7625-4e31-94b6-9b884da58001 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:01.232430 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-40346584-7625-4e31-94b6-9b884da58001 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:01.237247 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-40346584-7625-4e31-94b6-9b884da58001 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:01.238511 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-40346584-7625-4e31-94b6-9b884da58001 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:01.242617 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-40346584-7625-4e31-94b6-9b884da58001 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:01.243397 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-40346584-7625-4e31-94b6-9b884da58001 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:02.290018 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-40346584-7625-4e31-94b6-9b884da58001 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:02.299056 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-40346584-7625-4e31-94b6-9b884da58001 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1674 microversion: 2.1 time: 1.092581 Aug 07 01:41:02.306718 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2489/5445] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:41:01 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1674 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:41:03.323608 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-83756a81-0815-43b2-baee-911ee8c8aa4b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:03.324877 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-83756a81-0815-43b2-baee-911ee8c8aa4b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:03.334892 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83756a81-0815-43b2-baee-911ee8c8aa4b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:03.356354 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83756a81-0815-43b2-baee-911ee8c8aa4b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:03.358382 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83756a81-0815-43b2-baee-911ee8c8aa4b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:03.359683 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83756a81-0815-43b2-baee-911ee8c8aa4b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:03.363007 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83756a81-0815-43b2-baee-911ee8c8aa4b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:03.369886 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83756a81-0815-43b2-baee-911ee8c8aa4b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:03.802765 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-83756a81-0815-43b2-baee-911ee8c8aa4b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:03.816452 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-83756a81-0815-43b2-baee-911ee8c8aa4b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 200 len: 1322 microversion: 2.1 time: 0.496728 Aug 07 01:41:03.825206 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2957/5446] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:41:03 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 1322 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:41:03.924978 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-7c127b49-1e9a-4064-832a-dcb5bba22b5e req-89b8b0f8-c134-481b-a562-2c6176e6d80b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d2f04ca-7c24-4d1a-a723-7cf3a8782976", "name": "network-vif-deleted", "tag": "df05b03a-bb99-46f1-ae77-4d31e797b6a3"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:41:03.938634 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-7c127b49-1e9a-4064-832a-dcb5bba22b5e req-89b8b0f8-c134-481b-a562-2c6176e6d80b service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:03.939123 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-7c127b49-1e9a-4064-832a-dcb5bba22b5e req-89b8b0f8-c134-481b-a562-2c6176e6d80b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:03.939564 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-7c127b49-1e9a-4064-832a-dcb5bba22b5e req-89b8b0f8-c134-481b-a562-2c6176e6d80b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:03.996969 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-7c127b49-1e9a-4064-832a-dcb5bba22b5e req-89b8b0f8-c134-481b-a562-2c6176e6d80b service nova] Creating event network-vif-deleted:df05b03a-bb99-46f1-ae77-4d31e797b6a3 for instance 0d2f04ca-7c24-4d1a-a723-7cf3a8782976 on n-h2-master-1 Aug 07 01:41:04.010390 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-7c127b49-1e9a-4064-832a-dcb5bba22b5e req-89b8b0f8-c134-481b-a562-2c6176e6d80b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.607900 Aug 07 01:41:04.016801 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2490/5447] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:41:04.849448 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-63651478-079d-42db-b8b4-4205214bd51d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:04.852778 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-63651478-079d-42db-b8b4-4205214bd51d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:04.880898 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-63651478-079d-42db-b8b4-4205214bd51d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:04.887196 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-63651478-079d-42db-b8b4-4205214bd51d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:04.889983 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-63651478-079d-42db-b8b4-4205214bd51d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:04.891910 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-63651478-079d-42db-b8b4-4205214bd51d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:04.895586 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-63651478-079d-42db-b8b4-4205214bd51d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:04.896285 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-63651478-079d-42db-b8b4-4205214bd51d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:04.936940 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-63651478-079d-42db-b8b4-4205214bd51d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] HTTP exception thrown: Instance 0d2f04ca-7c24-4d1a-a723-7cf3a8782976 could not be found. Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-63651478-079d-42db-b8b4-4205214bd51d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Request method failure captured: Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 HTTP/1.1 Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xdHeORiS6YWMHnUJygRGszSNIG1JhGoKcoBSmXw0JuemXQOUZ7u2oZVNnGzA3TBr4c7vXwq1ZMaruUYdg1nhcCvtacS7m-HVh9cvqJkdgIvMA9_zdpwP_5c3M05G_7pXM09STwSj5ER44J8qlDDM7BzjCwL1d7yDBkzz3MYyqojQrk Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: fd244ec665474b3896678f34d6491574 Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-AttachVolumeTestJSON-730710293 Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd244ec665474b3896678f34d6491574"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fd244ec665474b3896678f34d6491574", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd244ec665474b3896678f34d6491574"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fd244ec665474b3896678f34d6491574"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-AttachVolumeTestJSON-730710293 Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: fd244ec665474b3896678f34d6491574 Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-AttachVolumeTestJSON-730710293 Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-AttachVolumeTestJSON-730710293-project Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 2d8e76eb694846cabc55fc8e825c8e43 Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-AttachVolumeTestJSON-730710293-project Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 0d2f04ca-7c24-4d1a-a723-7cf3a8782976 could not be found. Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '0d2f04ca-7c24-4d1a-a723-7cf3a8782976'} Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d2f04ca-7c24-4d1a-a723-7cf3a8782976 could not be found. Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d2f04ca-7c24-4d1a-a723-7cf3a8782976 could not be found. Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:41:04.945184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:41:04.948870 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:41:04.948870 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:41:04.948870 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:41:04.948870 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:41:04.948870 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:41:04.948870 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d2f04ca-7c24-4d1a-a723-7cf3a8782976 could not be found. Aug 07 01:41:04.948870 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:41:04.952808 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-63651478-079d-42db-b8b4-4205214bd51d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Returning 404 to user: Instance 0d2f04ca-7c24-4d1a-a723-7cf3a8782976 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:41:04.954721 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-63651478-079d-42db-b8b4-4205214bd51d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 404 len: 111 microversion: 2.1 time: 0.114006 Aug 07 01:41:04.957999 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2958/5448] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:41:04 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:41:04.967528 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-056af7fd-3c6a-4b6f-9a03-8b0c3b106a2d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '.version_select at 0x7f9e246424c0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:05.038979 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-056af7fd-3c6a-4b6f-9a03-8b0c3b106a2d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1165152169" status: 202 len: 0 microversion: 2.1 time: 0.075638 Aug 07 01:41:05.040155 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2491/5449] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Aug 7 01:41:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1165152169 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:41:07.544629 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-558d9517-f8f2-40a5-9e3a-22c5a2df0108 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Action: 'create', calling method: .version_select at 0x7f9e24884820>, body: {"keypair": {"name": "tempest-keypair-521699372", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOrlsTnaqfS8UumrEuGzrdcG2JhwsepzVXZO0XElGxwybWINRfl3V/ySqhrt91Ugj3wAGOSxJNKDdbXRTy+uFJI/k8rZhGczfPNy8pYKPfTahRiu6szczT+kvnqldLKBKA=="}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:41:07.587469 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-558d9517-f8f2-40a5-9e3a-22c5a2df0108 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Getting quotas for project fd244ec665474b3896678f34d6491574. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:41:07.602911 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-558d9517-f8f2-40a5-9e3a-22c5a2df0108 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Getting quotas for user 2d8e76eb694846cabc55fc8e825c8e43 and project fd244ec665474b3896678f34d6491574. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:41:07.669536 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-558d9517-f8f2-40a5-9e3a-22c5a2df0108 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.130994 Aug 07 01:41:07.681039 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2959/5450] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:41:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:41:07.881273 n-d-master-1 devstack@n-api.service[119517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 01:41:07.882038 n-d-master-1 devstack@n-api.service[119517]: Sun Aug 7 01:41:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 01:41:08.013804 n-d-master-1 devstack@n-api.service[119516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 01:41:08.014149 n-d-master-1 devstack@n-api.service[119516]: Sun Aug 7 01:41:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 01:41:10.729457 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2ff569d2-7f44-4a83-b22b-0e426e60b443 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:10.733042 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2ff569d2-7f44-4a83-b22b-0e426e60b443 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:10.746955 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:10.762557 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2ff569d2-7f44-4a83-b22b-0e426e60b443 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:10.764498 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2ff569d2-7f44-4a83-b22b-0e426e60b443 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:10.765497 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2ff569d2-7f44-4a83-b22b-0e426e60b443 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:10.768455 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2ff569d2-7f44-4a83-b22b-0e426e60b443 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:10.772329 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2ff569d2-7f44-4a83-b22b-0e426e60b443 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:10.774629 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2ff569d2-7f44-4a83-b22b-0e426e60b443 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:10.843552 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2ff569d2-7f44-4a83-b22b-0e426e60b443 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:41:11.198569 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2ff569d2-7f44-4a83-b22b-0e426e60b443 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "DELETE /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7" status: 204 len: 0 microversion: 2.1 time: 0.486359 Aug 07 01:41:11.204068 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2492/5451] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:41:10 2022] DELETE /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:41:11.210405 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0dba4ec5-4c92-4924-9879-6c8b0ad552c4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:11.211307 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0dba4ec5-4c92-4924-9879-6c8b0ad552c4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:11.229567 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0dba4ec5-4c92-4924-9879-6c8b0ad552c4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:11.237733 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0dba4ec5-4c92-4924-9879-6c8b0ad552c4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:11.244568 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0dba4ec5-4c92-4924-9879-6c8b0ad552c4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:11.245670 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0dba4ec5-4c92-4924-9879-6c8b0ad552c4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:11.247496 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0dba4ec5-4c92-4924-9879-6c8b0ad552c4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:11.250834 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0dba4ec5-4c92-4924-9879-6c8b0ad552c4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:12.307638 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0dba4ec5-4c92-4924-9879-6c8b0ad552c4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:12.325713 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0dba4ec5-4c92-4924-9879-6c8b0ad552c4 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7" status: 200 len: 1507 microversion: 2.1 time: 1.120353 Aug 07 01:41:12.327012 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2960/5452] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:41:11 2022] GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 => generated 1507 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:41:12.860294 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-52d1afa6-462a-4ee4-8e63-ec6b1ce8b586 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-826210427", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5a8fd548-5445-4e87-8951-075bc1da39df"}], "security_groups": [{"name": "tempest-securitygroup--1708323178"}], "key_name": "tempest-keypair-521699372", "user_data": "}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:41:13.361104 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-99494dec-8732-451f-945f-8b2fa3592ea2 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:13.366820 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-99494dec-8732-451f-945f-8b2fa3592ea2 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:13.430020 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99494dec-8732-451f-945f-8b2fa3592ea2 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:13.435089 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99494dec-8732-451f-945f-8b2fa3592ea2 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:13.446938 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99494dec-8732-451f-945f-8b2fa3592ea2 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:13.475004 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99494dec-8732-451f-945f-8b2fa3592ea2 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:13.478933 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99494dec-8732-451f-945f-8b2fa3592ea2 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:13.493810 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-99494dec-8732-451f-945f-8b2fa3592ea2 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:13.555283 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:13.712329 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-52d1afa6-462a-4ee4-8e63-ec6b1ce8b586 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] validate_networks() for [('5a8fd548-5445-4e87-8951-075bc1da39df', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:41:14.367728 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-99494dec-8732-451f-945f-8b2fa3592ea2 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:14.379249 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-99494dec-8732-451f-945f-8b2fa3592ea2 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7" status: 200 len: 1507 microversion: 2.1 time: 1.024422 Aug 07 01:41:14.407026 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2961/5453] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:41:13 2022] GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 => generated 1507 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:41:15.405940 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7191f769-8862-47ce-af7b-be457be040e5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:15.406857 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7191f769-8862-47ce-af7b-be457be040e5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:15.419071 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7191f769-8862-47ce-af7b-be457be040e5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:15.424167 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7191f769-8862-47ce-af7b-be457be040e5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:15.424895 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7191f769-8862-47ce-af7b-be457be040e5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:15.430535 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7191f769-8862-47ce-af7b-be457be040e5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:15.434652 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7191f769-8862-47ce-af7b-be457be040e5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:15.435713 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7191f769-8862-47ce-af7b-be457be040e5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:16.043313 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7191f769-8862-47ce-af7b-be457be040e5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:16.054852 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7191f769-8862-47ce-af7b-be457be040e5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7" status: 200 len: 1507 microversion: 2.1 time: 0.653367 Aug 07 01:41:16.061070 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2962/5454] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:41:15 2022] GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 => generated 1507 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:41:16.945976 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-bc67e6d4-030a-498e-96df-542ddcabfd7e req-2c236de9-e3d2-4bd1-85b7-fb45faa880ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40fafd12-87a1-49ad-9152-5b47f28a80b7", "name": "network-vif-deleted", "tag": "ce724099-1eb9-4a4e-a13c-2ca5bf4b41ad"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:41:16.975752 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-bc67e6d4-030a-498e-96df-542ddcabfd7e req-2c236de9-e3d2-4bd1-85b7-fb45faa880ee service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:16.977736 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-bc67e6d4-030a-498e-96df-542ddcabfd7e req-2c236de9-e3d2-4bd1-85b7-fb45faa880ee service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:16.978471 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-bc67e6d4-030a-498e-96df-542ddcabfd7e req-2c236de9-e3d2-4bd1-85b7-fb45faa880ee service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:17.004433 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-52d1afa6-462a-4ee4-8e63-ec6b1ce8b586 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:41:17.004433 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-52d1afa6-462a-4ee4-8e63-ec6b1ce8b586 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:41:17.004433 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-52d1afa6-462a-4ee4-8e63-ec6b1ce8b586 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:41:17.004433 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-52d1afa6-462a-4ee4-8e63-ec6b1ce8b586 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:41:17.005138 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-52d1afa6-462a-4ee4-8e63-ec6b1ce8b586 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:41:17.009524 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-bc67e6d4-030a-498e-96df-542ddcabfd7e req-2c236de9-e3d2-4bd1-85b7-fb45faa880ee service nova] Creating event network-vif-deleted:ce724099-1eb9-4a4e-a13c-2ca5bf4b41ad for instance 40fafd12-87a1-49ad-9152-5b47f28a80b7 on n-h1-master-1 Aug 07 01:41:17.022005 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-bc67e6d4-030a-498e-96df-542ddcabfd7e req-2c236de9-e3d2-4bd1-85b7-fb45faa880ee service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080616 Aug 07 01:41:17.024612 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2963/5455] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:41:17.026683 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52d1afa6-462a-4ee4-8e63-ec6b1ce8b586 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:17.027137 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52d1afa6-462a-4ee4-8e63-ec6b1ce8b586 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:17.027563 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52d1afa6-462a-4ee4-8e63-ec6b1ce8b586 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:17.030507 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52d1afa6-462a-4ee4-8e63-ec6b1ce8b586 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:17.031970 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52d1afa6-462a-4ee4-8e63-ec6b1ce8b586 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:17.034018 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52d1afa6-462a-4ee4-8e63-ec6b1ce8b586 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:17.083390 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-52d1afa6-462a-4ee4-8e63-ec6b1ce8b586 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Getting quotas for project fd244ec665474b3896678f34d6491574. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:41:17.093506 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a67de316-a967-4d35-bb2e-7c1c52ae9254 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:17.094222 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a67de316-a967-4d35-bb2e-7c1c52ae9254 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:17.097229 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-52d1afa6-462a-4ee4-8e63-ec6b1ce8b586 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Getting quotas for user 2d8e76eb694846cabc55fc8e825c8e43 and project fd244ec665474b3896678f34d6491574. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:41:17.113061 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a67de316-a967-4d35-bb2e-7c1c52ae9254 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:17.113587 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a67de316-a967-4d35-bb2e-7c1c52ae9254 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:17.114040 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a67de316-a967-4d35-bb2e-7c1c52ae9254 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:17.114793 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a67de316-a967-4d35-bb2e-7c1c52ae9254 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:17.115261 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a67de316-a967-4d35-bb2e-7c1c52ae9254 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:17.115698 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a67de316-a967-4d35-bb2e-7c1c52ae9254 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:17.138881 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-52d1afa6-462a-4ee4-8e63-ec6b1ce8b586 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:41:17.145394 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-52d1afa6-462a-4ee4-8e63-ec6b1ce8b586 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: a6704b77-3a73-4dc8-85af-8eb60c16899a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:41:17.180600 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a67de316-a967-4d35-bb2e-7c1c52ae9254 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:17.181373 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a67de316-a967-4d35-bb2e-7c1c52ae9254 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:17.182217 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a67de316-a967-4d35-bb2e-7c1c52ae9254 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:17.184184 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-a67de316-a967-4d35-bb2e-7c1c52ae9254 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lazy-loading 'fault' on Instance uuid 40fafd12-87a1-49ad-9152-5b47f28a80b7 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:41:17.290461 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a67de316-a967-4d35-bb2e-7c1c52ae9254 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:17.302607 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a67de316-a967-4d35-bb2e-7c1c52ae9254 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7" status: 200 len: 1312 microversion: 2.1 time: 0.213547 Aug 07 01:41:17.302822 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-52d1afa6-462a-4ee4-8e63-ec6b1ce8b586 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.451140 Aug 07 01:41:17.308268 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2964/5456] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:41:17 2022] GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 => generated 1312 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:41:17.313409 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2493/5457] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:41:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 4465 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:41:17.318633 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-829aad99-409e-4241-8da2-d3299f98c544 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:17.318633 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-829aad99-409e-4241-8da2-d3299f98c544 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: a6704b77-3a73-4dc8-85af-8eb60c16899a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:17.616895 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=4 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:17.680651 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-829aad99-409e-4241-8da2-d3299f98c544 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:17.689884 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-829aad99-409e-4241-8da2-d3299f98c544 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a" status: 200 len: 1236 microversion: 2.1 time: 0.379449 Aug 07 01:41:17.693415 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2965/5458] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:41:17 2022] GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a => generated 1236 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:41:18.339842 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7b5744e4-04e6-466a-a4a8-f5dd4083c4e0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:18.340921 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7b5744e4-04e6-466a-a4a8-f5dd4083c4e0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 40fafd12-87a1-49ad-9152-5b47f28a80b7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:18.411363 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b5744e4-04e6-466a-a4a8-f5dd4083c4e0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:18.415464 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b5744e4-04e6-466a-a4a8-f5dd4083c4e0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:18.417434 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b5744e4-04e6-466a-a4a8-f5dd4083c4e0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:18.418285 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b5744e4-04e6-466a-a4a8-f5dd4083c4e0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:18.419372 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b5744e4-04e6-466a-a4a8-f5dd4083c4e0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:18.421032 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7b5744e4-04e6-466a-a4a8-f5dd4083c4e0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:18.458027 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:18.481335 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-7b5744e4-04e6-466a-a4a8-f5dd4083c4e0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] HTTP exception thrown: Instance 40fafd12-87a1-49ad-9152-5b47f28a80b7 could not be found. Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7b5744e4-04e6-466a-a4a8-f5dd4083c4e0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Request method failure captured: Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 HTTP/1.1 Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xcFUTwOrsKbLuCg4An479LA9G9aDuSE7GEjV8VWyLtq1rxOhZ9Q8jcwtkvN3VeO8ggfh8KvRRX8HWvqee02PsBBf0WFvhZisgorTKvdssuK7IJ1NUIDzU8DRVfm2J3najrfJ74eq56eKh78U1nPClJkssFs7yS7oVt53yn2dEShWXQ Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 70f17360f0c84562bd99b006b659736e Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1195249405 Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/70f17360f0c84562bd99b006b659736e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_70f17360f0c84562bd99b006b659736e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/70f17360f0c84562bd99b006b659736e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/70f17360f0c84562bd99b006b659736e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1195249405 Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 70f17360f0c84562bd99b006b659736e Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1195249405 Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServerRescueNegativeTestJSON-1195249405-project Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 2f5acf7da18b43f89e24760744cfdb49 Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1195249405-project Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 40fafd12-87a1-49ad-9152-5b47f28a80b7 could not be found. Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '40fafd12-87a1-49ad-9152-5b47f28a80b7'} Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40fafd12-87a1-49ad-9152-5b47f28a80b7 could not be found. Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40fafd12-87a1-49ad-9152-5b47f28a80b7 could not be found. Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:41:18.483732 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:41:18.488611 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:41:18.488611 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:41:18.488611 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:41:18.488611 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:41:18.488611 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:41:18.488611 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:41:18.488611 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40fafd12-87a1-49ad-9152-5b47f28a80b7 could not be found. Aug 07 01:41:18.488611 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:41:18.488611 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7b5744e4-04e6-466a-a4a8-f5dd4083c4e0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Returning 404 to user: Instance 40fafd12-87a1-49ad-9152-5b47f28a80b7 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:41:18.488611 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7b5744e4-04e6-466a-a4a8-f5dd4083c4e0 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7" status: 404 len: 111 microversion: 2.1 time: 0.154570 Aug 07 01:41:18.488611 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2494/5459] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:41:18 2022] GET /compute/v2.1/servers/40fafd12-87a1-49ad-9152-5b47f28a80b7 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:41:18.497780 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6977d184-040e-42fd-a84b-8ac139be1daa tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:18.498596 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6977d184-040e-42fd-a84b-8ac139be1daa tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:18.511263 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6977d184-040e-42fd-a84b-8ac139be1daa tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:18.513293 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6977d184-040e-42fd-a84b-8ac139be1daa tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:18.513805 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6977d184-040e-42fd-a84b-8ac139be1daa tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:18.515709 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6977d184-040e-42fd-a84b-8ac139be1daa tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:18.517624 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6977d184-040e-42fd-a84b-8ac139be1daa tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:18.518100 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6977d184-040e-42fd-a84b-8ac139be1daa tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:18.588605 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6977d184-040e-42fd-a84b-8ac139be1daa tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:41:18.715878 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8db14906-c9b3-4190-859c-4bb6ff40d6c9 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:18.716792 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8db14906-c9b3-4190-859c-4bb6ff40d6c9 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: a6704b77-3a73-4dc8-85af-8eb60c16899a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:18.826270 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6977d184-040e-42fd-a84b-8ac139be1daa tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "DELETE /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d" status: 204 len: 0 microversion: 2.1 time: 0.329824 Aug 07 01:41:18.840284 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2966/5460] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:41:18 2022] DELETE /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 07 01:41:18.866519 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6f5ee21b-2cd1-4eb1-8b2c-14f34a975acd tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:18.870274 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6f5ee21b-2cd1-4eb1-8b2c-14f34a975acd tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:18.891195 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f5ee21b-2cd1-4eb1-8b2c-14f34a975acd tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:18.891701 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f5ee21b-2cd1-4eb1-8b2c-14f34a975acd tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:18.892167 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f5ee21b-2cd1-4eb1-8b2c-14f34a975acd tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:18.892883 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f5ee21b-2cd1-4eb1-8b2c-14f34a975acd tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:18.900693 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f5ee21b-2cd1-4eb1-8b2c-14f34a975acd tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:18.901256 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f5ee21b-2cd1-4eb1-8b2c-14f34a975acd tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:18.904891 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8db14906-c9b3-4190-859c-4bb6ff40d6c9 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:18.918263 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8db14906-c9b3-4190-859c-4bb6ff40d6c9 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a" status: 200 len: 1236 microversion: 2.1 time: 0.209157 Aug 07 01:41:18.919801 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2495/5461] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:41:18 2022] GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a => generated 1236 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:41:19.551229 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6f5ee21b-2cd1-4eb1-8b2c-14f34a975acd tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:19.582924 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6f5ee21b-2cd1-4eb1-8b2c-14f34a975acd tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d" status: 200 len: 1522 microversion: 2.1 time: 0.733833 Aug 07 01:41:19.586700 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2967/5462] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:41:18 2022] GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d => generated 1522 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:41:19.949629 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d1e88a23-2d6e-431e-a978-99f61ca218fb tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:19.950817 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d1e88a23-2d6e-431e-a978-99f61ca218fb tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: a6704b77-3a73-4dc8-85af-8eb60c16899a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:19.982056 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1e88a23-2d6e-431e-a978-99f61ca218fb tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:19.984704 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1e88a23-2d6e-431e-a978-99f61ca218fb tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:19.999273 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1e88a23-2d6e-431e-a978-99f61ca218fb tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:20.000237 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1e88a23-2d6e-431e-a978-99f61ca218fb tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:20.003593 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1e88a23-2d6e-431e-a978-99f61ca218fb tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:20.019129 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1e88a23-2d6e-431e-a978-99f61ca218fb tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:20.532814 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d1e88a23-2d6e-431e-a978-99f61ca218fb tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:20.549870 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d1e88a23-2d6e-431e-a978-99f61ca218fb tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a" status: 200 len: 1296 microversion: 2.1 time: 0.601309 Aug 07 01:41:20.560591 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2496/5463] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:41:19 2022] GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a => generated 1296 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:41:20.604737 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0c28ca01-9866-4407-a43e-e24b4a1a365a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:20.605334 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0c28ca01-9866-4407-a43e-e24b4a1a365a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:20.618563 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c28ca01-9866-4407-a43e-e24b4a1a365a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:20.619068 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c28ca01-9866-4407-a43e-e24b4a1a365a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:20.619529 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c28ca01-9866-4407-a43e-e24b4a1a365a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:20.620308 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c28ca01-9866-4407-a43e-e24b4a1a365a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:20.620705 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c28ca01-9866-4407-a43e-e24b4a1a365a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:20.621199 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c28ca01-9866-4407-a43e-e24b4a1a365a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:21.535035 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0c28ca01-9866-4407-a43e-e24b4a1a365a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:21.546370 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0c28ca01-9866-4407-a43e-e24b4a1a365a tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d" status: 200 len: 1522 microversion: 2.1 time: 0.945671 Aug 07 01:41:21.549846 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2968/5464] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:41:20 2022] GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d => generated 1522 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:41:21.576935 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e5c59289-5ba9-4e54-97a2-bc7959da7243 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:21.577482 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e5c59289-5ba9-4e54-97a2-bc7959da7243 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: a6704b77-3a73-4dc8-85af-8eb60c16899a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:21.616905 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e5c59289-5ba9-4e54-97a2-bc7959da7243 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:21.617436 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e5c59289-5ba9-4e54-97a2-bc7959da7243 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:21.621118 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e5c59289-5ba9-4e54-97a2-bc7959da7243 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:21.653081 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e5c59289-5ba9-4e54-97a2-bc7959da7243 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:21.659182 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e5c59289-5ba9-4e54-97a2-bc7959da7243 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:21.659967 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e5c59289-5ba9-4e54-97a2-bc7959da7243 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:21.865525 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e5c59289-5ba9-4e54-97a2-bc7959da7243 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:21.880613 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e5c59289-5ba9-4e54-97a2-bc7959da7243 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a" status: 200 len: 1294 microversion: 2.1 time: 0.307894 Aug 07 01:41:21.881865 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2497/5465] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:41:21 2022] GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a => generated 1294 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:41:22.572840 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-722a349d-c7a2-4bd1-9dfa-195bc0e0090f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:22.574221 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-722a349d-c7a2-4bd1-9dfa-195bc0e0090f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:22.585371 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:22.625077 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-722a349d-c7a2-4bd1-9dfa-195bc0e0090f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:22.626324 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-722a349d-c7a2-4bd1-9dfa-195bc0e0090f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:22.627166 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-722a349d-c7a2-4bd1-9dfa-195bc0e0090f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:22.629792 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-722a349d-c7a2-4bd1-9dfa-195bc0e0090f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:22.640613 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-722a349d-c7a2-4bd1-9dfa-195bc0e0090f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:22.643065 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-722a349d-c7a2-4bd1-9dfa-195bc0e0090f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:22.906909 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9f5e172f-6908-4827-9db7-0a27959966da tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:22.907521 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9f5e172f-6908-4827-9db7-0a27959966da tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: a6704b77-3a73-4dc8-85af-8eb60c16899a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:22.944333 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9f5e172f-6908-4827-9db7-0a27959966da tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:22.945251 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9f5e172f-6908-4827-9db7-0a27959966da tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:22.945749 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9f5e172f-6908-4827-9db7-0a27959966da tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:22.952859 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9f5e172f-6908-4827-9db7-0a27959966da tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:22.957435 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9f5e172f-6908-4827-9db7-0a27959966da tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:22.957435 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9f5e172f-6908-4827-9db7-0a27959966da tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:23.164419 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-722a349d-c7a2-4bd1-9dfa-195bc0e0090f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:23.177438 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-722a349d-c7a2-4bd1-9dfa-195bc0e0090f tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d" status: 200 len: 1522 microversion: 2.1 time: 0.609765 Aug 07 01:41:23.178040 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2969/5466] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:41:22 2022] GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d => generated 1522 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:41:24.157214 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-86c054f1-320f-479d-88f0-68be872329db req-bbbf0bb3-7be2-4b03-a838-18869e6d3778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67905784-e195-4938-9ea1-7e0fb23ffd4d", "name": "network-vif-deleted", "tag": "4710e5d5-f96e-42f2-99ea-feeb68044c68"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:41:24.189994 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-86c054f1-320f-479d-88f0-68be872329db req-bbbf0bb3-7be2-4b03-a838-18869e6d3778 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:24.191588 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-86c054f1-320f-479d-88f0-68be872329db req-bbbf0bb3-7be2-4b03-a838-18869e6d3778 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:24.192107 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-86c054f1-320f-479d-88f0-68be872329db req-bbbf0bb3-7be2-4b03-a838-18869e6d3778 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:24.227253 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-86c054f1-320f-479d-88f0-68be872329db req-bbbf0bb3-7be2-4b03-a838-18869e6d3778 service nova] Creating event network-vif-deleted:4710e5d5-f96e-42f2-99ea-feeb68044c68 for instance 67905784-e195-4938-9ea1-7e0fb23ffd4d on n-h1-master-1 Aug 07 01:41:24.250049 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-86c054f1-320f-479d-88f0-68be872329db req-bbbf0bb3-7be2-4b03-a838-18869e6d3778 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088447 Aug 07 01:41:24.250049 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2970/5467] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:41:24.262776 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-afc2bc29-cfed-4e5b-b3fd-93c7de9fd8a6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:24.263709 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-afc2bc29-cfed-4e5b-b3fd-93c7de9fd8a6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:24.280523 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-afc2bc29-cfed-4e5b-b3fd-93c7de9fd8a6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:24.287858 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-afc2bc29-cfed-4e5b-b3fd-93c7de9fd8a6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:24.288450 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-afc2bc29-cfed-4e5b-b3fd-93c7de9fd8a6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:24.298561 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-afc2bc29-cfed-4e5b-b3fd-93c7de9fd8a6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:24.301332 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-afc2bc29-cfed-4e5b-b3fd-93c7de9fd8a6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:24.304567 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-afc2bc29-cfed-4e5b-b3fd-93c7de9fd8a6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:24.407133 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-afc2bc29-cfed-4e5b-b3fd-93c7de9fd8a6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:24.407873 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-afc2bc29-cfed-4e5b-b3fd-93c7de9fd8a6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:24.410869 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-afc2bc29-cfed-4e5b-b3fd-93c7de9fd8a6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:24.415203 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-afc2bc29-cfed-4e5b-b3fd-93c7de9fd8a6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lazy-loading 'fault' on Instance uuid 67905784-e195-4938-9ea1-7e0fb23ffd4d {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:41:24.595862 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-afc2bc29-cfed-4e5b-b3fd-93c7de9fd8a6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f5acf7da18b43f89e24760744cfdb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f17360f0c84562bd99b006b659736e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:24.612983 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-afc2bc29-cfed-4e5b-b3fd-93c7de9fd8a6 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d" status: 200 len: 1312 microversion: 2.1 time: 0.371133 Aug 07 01:41:24.625077 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9f5e172f-6908-4827-9db7-0a27959966da tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:24.636517 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2971/5468] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:41:24 2022] GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d => generated 1312 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:41:24.637049 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9f5e172f-6908-4827-9db7-0a27959966da tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a" status: 200 len: 1362 microversion: 2.1 time: 1.733916 Aug 07 01:41:24.640417 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2498/5469] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:41:22 2022] GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a => generated 1362 bytes in 1738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:41:25.647697 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4138366a-14fd-4b6c-bd58-3c110bf4a5d5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:25.648578 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4138366a-14fd-4b6c-bd58-3c110bf4a5d5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] [instance: 67905784-e195-4938-9ea1-7e0fb23ffd4d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:25.663972 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a3bbaa2a-9f0a-4532-a4ff-424eca7ca546 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:25.665050 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a3bbaa2a-9f0a-4532-a4ff-424eca7ca546 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: a6704b77-3a73-4dc8-85af-8eb60c16899a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:25.673275 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4138366a-14fd-4b6c-bd58-3c110bf4a5d5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:25.678853 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4138366a-14fd-4b6c-bd58-3c110bf4a5d5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:25.679447 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4138366a-14fd-4b6c-bd58-3c110bf4a5d5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:25.680496 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4138366a-14fd-4b6c-bd58-3c110bf4a5d5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:25.687553 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4138366a-14fd-4b6c-bd58-3c110bf4a5d5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:25.688352 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4138366a-14fd-4b6c-bd58-3c110bf4a5d5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:25.693440 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3bbaa2a-9f0a-4532-a4ff-424eca7ca546 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:25.695664 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3bbaa2a-9f0a-4532-a4ff-424eca7ca546 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:25.696151 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3bbaa2a-9f0a-4532-a4ff-424eca7ca546 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:25.702671 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3bbaa2a-9f0a-4532-a4ff-424eca7ca546 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:25.703182 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3bbaa2a-9f0a-4532-a4ff-424eca7ca546 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:25.706240 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3bbaa2a-9f0a-4532-a4ff-424eca7ca546 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:25.737059 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-4138366a-14fd-4b6c-bd58-3c110bf4a5d5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] HTTP exception thrown: Instance 67905784-e195-4938-9ea1-7e0fb23ffd4d could not be found. Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4138366a-14fd-4b6c-bd58-3c110bf4a5d5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Request method failure captured: Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d HTTP/1.1 Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xcFUTwOrsKbLuCg4An479LA9G9aDuSE7GEjV8VWyLtq1rxOhZ9Q8jcwtkvN3VeO8ggfh8KvRRX8HWvqee02PsBBf0WFvhZisgorTKvdssuK7IJ1NUIDzU8DRVfm2J3najrfJ74eq56eKh78U1nPClJkssFs7yS7oVt53yn2dEShWXQ Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 70f17360f0c84562bd99b006b659736e Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1195249405 Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/70f17360f0c84562bd99b006b659736e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_70f17360f0c84562bd99b006b659736e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/70f17360f0c84562bd99b006b659736e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/70f17360f0c84562bd99b006b659736e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1195249405 Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 70f17360f0c84562bd99b006b659736e Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1195249405 Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServerRescueNegativeTestJSON-1195249405-project Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 2f5acf7da18b43f89e24760744cfdb49 Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1195249405-project Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 67905784-e195-4938-9ea1-7e0fb23ffd4d could not be found. Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '67905784-e195-4938-9ea1-7e0fb23ffd4d'} Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67905784-e195-4938-9ea1-7e0fb23ffd4d could not be found. Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67905784-e195-4938-9ea1-7e0fb23ffd4d could not be found. Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:41:25.745249 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:41:25.749954 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:41:25.749954 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:41:25.749954 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:41:25.749954 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:41:25.749954 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:41:25.749954 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:41:25.749954 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67905784-e195-4938-9ea1-7e0fb23ffd4d could not be found. Aug 07 01:41:25.749954 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:41:25.759302 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4138366a-14fd-4b6c-bd58-3c110bf4a5d5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] Returning 404 to user: Instance 67905784-e195-4938-9ea1-7e0fb23ffd4d could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:41:25.762475 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4138366a-14fd-4b6c-bd58-3c110bf4a5d5 tempest-ServerRescueNegativeTestJSON-1195249405 tempest-ServerRescueNegativeTestJSON-1195249405-project] 10.222.0.39 "GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d" status: 404 len: 111 microversion: 2.1 time: 0.119728 Aug 07 01:41:25.769990 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2972/5470] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:41:25 2022] GET /compute/v2.1/servers/67905784-e195-4938-9ea1-7e0fb23ffd4d => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:41:26.881068 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a3bbaa2a-9f0a-4532-a4ff-424eca7ca546 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:26.893152 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a3bbaa2a-9f0a-4532-a4ff-424eca7ca546 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a" status: 200 len: 1362 microversion: 2.1 time: 1.234083 Aug 07 01:41:26.907824 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2499/5471] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:41:25 2022] GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a => generated 1362 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:41:27.353005 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-bb2de3ad-f505-4790-b93d-b6c58f5188c7 req-1752509b-6221-4f1a-a444-1b0f09f380a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6704b77-3a73-4dc8-85af-8eb60c16899a", "tag": "9a87e0aa-6b46-49c8-b248-fea8df7922b7"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:41:27.376277 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-bb2de3ad-f505-4790-b93d-b6c58f5188c7 req-1752509b-6221-4f1a-a444-1b0f09f380a3 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:27.377913 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-bb2de3ad-f505-4790-b93d-b6c58f5188c7 req-1752509b-6221-4f1a-a444-1b0f09f380a3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:27.381244 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-bb2de3ad-f505-4790-b93d-b6c58f5188c7 req-1752509b-6221-4f1a-a444-1b0f09f380a3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:27.426611 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-bb2de3ad-f505-4790-b93d-b6c58f5188c7 req-1752509b-6221-4f1a-a444-1b0f09f380a3 service nova] Creating event network-changed:9a87e0aa-6b46-49c8-b248-fea8df7922b7 for instance a6704b77-3a73-4dc8-85af-8eb60c16899a on n-h2-master-1 Aug 07 01:41:27.439339 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-bb2de3ad-f505-4790-b93d-b6c58f5188c7 req-1752509b-6221-4f1a-a444-1b0f09f380a3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092157 Aug 07 01:41:27.443489 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2973/5472] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:41:27.915196 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b9d6476b-41f1-4741-924e-aafedcb7b788 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:27.915812 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b9d6476b-41f1-4741-924e-aafedcb7b788 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: a6704b77-3a73-4dc8-85af-8eb60c16899a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:27.923570 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:27.957991 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9d6476b-41f1-4741-924e-aafedcb7b788 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:27.975208 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9d6476b-41f1-4741-924e-aafedcb7b788 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:27.988684 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9d6476b-41f1-4741-924e-aafedcb7b788 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:27.990165 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9d6476b-41f1-4741-924e-aafedcb7b788 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:27.993161 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9d6476b-41f1-4741-924e-aafedcb7b788 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:28.000826 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9d6476b-41f1-4741-924e-aafedcb7b788 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:28.519955 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b9d6476b-41f1-4741-924e-aafedcb7b788 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:28.529039 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b9d6476b-41f1-4741-924e-aafedcb7b788 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a" status: 200 len: 1362 microversion: 2.1 time: 0.617769 Aug 07 01:41:28.535049 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2500/5473] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:41:27 2022] GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a => generated 1362 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:41:29.558254 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-63954ac0-39d2-4baa-b852-133986a165f3 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:29.559732 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-63954ac0-39d2-4baa-b852-133986a165f3 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: a6704b77-3a73-4dc8-85af-8eb60c16899a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:29.563313 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:29.590723 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-63954ac0-39d2-4baa-b852-133986a165f3 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:29.591250 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-63954ac0-39d2-4baa-b852-133986a165f3 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:29.591853 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-63954ac0-39d2-4baa-b852-133986a165f3 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:29.592623 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-63954ac0-39d2-4baa-b852-133986a165f3 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:29.595213 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-63954ac0-39d2-4baa-b852-133986a165f3 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:29.595679 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-63954ac0-39d2-4baa-b852-133986a165f3 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:29.966784 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-63954ac0-39d2-4baa-b852-133986a165f3 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:29.975790 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-63954ac0-39d2-4baa-b852-133986a165f3 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a" status: 200 len: 1362 microversion: 2.1 time: 0.421945 Aug 07 01:41:29.992572 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2974/5474] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:41:29 2022] GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a => generated 1362 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:41:31.003637 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ddc5a41c-e3f4-4566-99fb-ba7a6a0eb7ad tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:31.005528 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ddc5a41c-e3f4-4566-99fb-ba7a6a0eb7ad tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: a6704b77-3a73-4dc8-85af-8eb60c16899a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:31.014836 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=8 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:31.026547 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ddc5a41c-e3f4-4566-99fb-ba7a6a0eb7ad tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:31.027303 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ddc5a41c-e3f4-4566-99fb-ba7a6a0eb7ad tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:31.027930 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ddc5a41c-e3f4-4566-99fb-ba7a6a0eb7ad tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:31.028855 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ddc5a41c-e3f4-4566-99fb-ba7a6a0eb7ad tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:31.038492 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ddc5a41c-e3f4-4566-99fb-ba7a6a0eb7ad tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:31.040782 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ddc5a41c-e3f4-4566-99fb-ba7a6a0eb7ad tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:31.916643 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ddc5a41c-e3f4-4566-99fb-ba7a6a0eb7ad tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:31.926272 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ddc5a41c-e3f4-4566-99fb-ba7a6a0eb7ad tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a" status: 200 len: 1362 microversion: 2.1 time: 0.926947 Aug 07 01:41:31.955021 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2501/5475] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:41:30 2022] GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a => generated 1362 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:41:32.958020 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3eb631fe-dadb-4b95-ab7e-f6c47efc02e5 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:32.959253 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3eb631fe-dadb-4b95-ab7e-f6c47efc02e5 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: a6704b77-3a73-4dc8-85af-8eb60c16899a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:33.006849 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3eb631fe-dadb-4b95-ab7e-f6c47efc02e5 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:33.007422 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3eb631fe-dadb-4b95-ab7e-f6c47efc02e5 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:33.008011 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3eb631fe-dadb-4b95-ab7e-f6c47efc02e5 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:33.008647 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3eb631fe-dadb-4b95-ab7e-f6c47efc02e5 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:33.012108 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3eb631fe-dadb-4b95-ab7e-f6c47efc02e5 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:33.012777 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3eb631fe-dadb-4b95-ab7e-f6c47efc02e5 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:33.944030 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-c957b3fb-a19f-4161-9ee2-3f9ca477d312 req-68ae1a7b-70bc-4c3c-bc83-3192c5f4ad1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6704b77-3a73-4dc8-85af-8eb60c16899a", "name": "network-vif-plugged", "status": "completed", "tag": "9a87e0aa-6b46-49c8-b248-fea8df7922b7"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:41:33.986157 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c957b3fb-a19f-4161-9ee2-3f9ca477d312 req-68ae1a7b-70bc-4c3c-bc83-3192c5f4ad1b service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:33.986729 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c957b3fb-a19f-4161-9ee2-3f9ca477d312 req-68ae1a7b-70bc-4c3c-bc83-3192c5f4ad1b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:33.991132 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c957b3fb-a19f-4161-9ee2-3f9ca477d312 req-68ae1a7b-70bc-4c3c-bc83-3192c5f4ad1b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:34.033741 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3eb631fe-dadb-4b95-ab7e-f6c47efc02e5 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:34.034986 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-c957b3fb-a19f-4161-9ee2-3f9ca477d312 req-68ae1a7b-70bc-4c3c-bc83-3192c5f4ad1b service nova] Creating event network-vif-plugged:9a87e0aa-6b46-49c8-b248-fea8df7922b7 for instance a6704b77-3a73-4dc8-85af-8eb60c16899a on n-h2-master-1 Aug 07 01:41:34.044955 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3eb631fe-dadb-4b95-ab7e-f6c47efc02e5 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a" status: 200 len: 1362 microversion: 2.1 time: 1.091461 Aug 07 01:41:34.045547 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2975/5476] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:41:32 2022] GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a => generated 1362 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:41:34.060113 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-c957b3fb-a19f-4161-9ee2-3f9ca477d312 req-68ae1a7b-70bc-4c3c-bc83-3192c5f4ad1b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.792997 Aug 07 01:41:34.061079 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2502/5477] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:41:35.077888 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-406e14fb-9422-4137-8129-2591fc894891 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:35.078589 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-406e14fb-9422-4137-8129-2591fc894891 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: a6704b77-3a73-4dc8-85af-8eb60c16899a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:35.087748 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-406e14fb-9422-4137-8129-2591fc894891 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:35.088653 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-406e14fb-9422-4137-8129-2591fc894891 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:35.089338 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-406e14fb-9422-4137-8129-2591fc894891 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:35.100350 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-406e14fb-9422-4137-8129-2591fc894891 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:35.104204 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-406e14fb-9422-4137-8129-2591fc894891 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:35.109738 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-406e14fb-9422-4137-8129-2591fc894891 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:35.653749 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-406e14fb-9422-4137-8129-2591fc894891 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:35.666424 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-406e14fb-9422-4137-8129-2591fc894891 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a" status: 200 len: 1362 microversion: 2.1 time: 0.598094 Aug 07 01:41:35.667044 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2976/5478] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:41:35 2022] GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a => generated 1362 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:41:36.691651 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1c890595-f898-45cf-8d80-c527d2745629 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:36.693535 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1c890595-f898-45cf-8d80-c527d2745629 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: a6704b77-3a73-4dc8-85af-8eb60c16899a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:36.716405 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c890595-f898-45cf-8d80-c527d2745629 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:36.717228 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c890595-f898-45cf-8d80-c527d2745629 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:36.719116 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c890595-f898-45cf-8d80-c527d2745629 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:36.720120 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c890595-f898-45cf-8d80-c527d2745629 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:36.722892 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c890595-f898-45cf-8d80-c527d2745629 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:36.727013 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c890595-f898-45cf-8d80-c527d2745629 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:37.348519 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1c890595-f898-45cf-8d80-c527d2745629 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:37.359746 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1c890595-f898-45cf-8d80-c527d2745629 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a" status: 200 len: 1548 microversion: 2.1 time: 0.672792 Aug 07 01:41:37.364177 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2503/5479] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:41:36 2022] GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a => generated 1548 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:41:37.408126 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d151befb-fb06-4dc7-b2d9-056c51a389d7 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:37.408681 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d151befb-fb06-4dc7-b2d9-056c51a389d7 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: a6704b77-3a73-4dc8-85af-8eb60c16899a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:37.425882 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d151befb-fb06-4dc7-b2d9-056c51a389d7 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:37.429586 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d151befb-fb06-4dc7-b2d9-056c51a389d7 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:37.430010 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d151befb-fb06-4dc7-b2d9-056c51a389d7 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:37.430761 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d151befb-fb06-4dc7-b2d9-056c51a389d7 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:37.431230 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d151befb-fb06-4dc7-b2d9-056c51a389d7 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:37.441383 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d151befb-fb06-4dc7-b2d9-056c51a389d7 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:37.663875 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d151befb-fb06-4dc7-b2d9-056c51a389d7 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.263011 Aug 07 01:41:37.672441 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2977/5480] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Aug 7 01:41:37 2022] GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a/os-interface => generated 284 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:41:40.223835 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-7dd5d52b-d834-4a67-a199-3767dd28adf6 req-1d01399e-7502-43ad-a2e2-6b488f5d1481 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6704b77-3a73-4dc8-85af-8eb60c16899a", "tag": "9a87e0aa-6b46-49c8-b248-fea8df7922b7"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:41:40.234721 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-7dd5d52b-d834-4a67-a199-3767dd28adf6 req-1d01399e-7502-43ad-a2e2-6b488f5d1481 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:40.235464 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-7dd5d52b-d834-4a67-a199-3767dd28adf6 req-1d01399e-7502-43ad-a2e2-6b488f5d1481 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:40.236091 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-7dd5d52b-d834-4a67-a199-3767dd28adf6 req-1d01399e-7502-43ad-a2e2-6b488f5d1481 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:40.249478 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-7dd5d52b-d834-4a67-a199-3767dd28adf6 req-1d01399e-7502-43ad-a2e2-6b488f5d1481 service nova] Creating event network-changed:9a87e0aa-6b46-49c8-b248-fea8df7922b7 for instance a6704b77-3a73-4dc8-85af-8eb60c16899a on n-h2-master-1 Aug 07 01:41:40.256263 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-7dd5d52b-d834-4a67-a199-3767dd28adf6 req-1d01399e-7502-43ad-a2e2-6b488f5d1481 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036415 Aug 07 01:41:40.262312 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2504/5481] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:41:43.632936 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a5dcef31-b521-429c-aa0c-c5baebe51ad5 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1634669286", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": "none"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:41:43.774585 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-a5dcef31-b521-429c-aa0c-c5baebe51ad5 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:41:43.775260 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-a5dcef31-b521-429c-aa0c-c5baebe51ad5 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:41:43.777686 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-a5dcef31-b521-429c-aa0c-c5baebe51ad5 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:41:43.784499 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-a5dcef31-b521-429c-aa0c-c5baebe51ad5 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:41:43.787081 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-a5dcef31-b521-429c-aa0c-c5baebe51ad5 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:41:43.815432 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a5dcef31-b521-429c-aa0c-c5baebe51ad5 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:43.816165 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a5dcef31-b521-429c-aa0c-c5baebe51ad5 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:43.816777 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a5dcef31-b521-429c-aa0c-c5baebe51ad5 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:43.817681 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a5dcef31-b521-429c-aa0c-c5baebe51ad5 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:43.818457 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a5dcef31-b521-429c-aa0c-c5baebe51ad5 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:43.819059 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a5dcef31-b521-429c-aa0c-c5baebe51ad5 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:43.843336 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:43.863861 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-a5dcef31-b521-429c-aa0c-c5baebe51ad5 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Getting quotas for project 019b0c4dadba463e99513297ede55f3c. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:41:43.873257 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-a5dcef31-b521-429c-aa0c-c5baebe51ad5 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Getting quotas for user 7d4cd041ba884cedb08c70ea8083d027 and project 019b0c4dadba463e99513297ede55f3c. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:41:43.890057 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a5dcef31-b521-429c-aa0c-c5baebe51ad5 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:41:43.893489 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a5dcef31-b521-429c-aa0c-c5baebe51ad5 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] [instance: 266283a7-8c46-44f7-9e50-1996551f3bbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:41:43.944088 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a5dcef31-b521-429c-aa0c-c5baebe51ad5 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.526134 Aug 07 01:41:43.944937 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2978/5482] 10.222.0.39 () {62 vars in 1188 bytes} [Sun Aug 7 01:41:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 07 01:41:43.961017 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bf5e5522-61fc-4ce1-9601-4f5141bd4029 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:43.962053 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bf5e5522-61fc-4ce1-9601-4f5141bd4029 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] [instance: 266283a7-8c46-44f7-9e50-1996551f3bbd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:43.976749 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:44.360480 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bf5e5522-61fc-4ce1-9601-4f5141bd4029 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:44.373358 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bf5e5522-61fc-4ce1-9601-4f5141bd4029 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:44.380318 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bf5e5522-61fc-4ce1-9601-4f5141bd4029 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:44.403588 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bf5e5522-61fc-4ce1-9601-4f5141bd4029 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] 10.222.0.39 "GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd" status: 200 len: 1278 microversion: 2.57 time: 0.433074 Aug 07 01:41:44.408980 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2505/5483] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:41:43 2022] GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd => generated 1278 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:41:45.433012 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-75ede5ea-9ebf-48d3-ba90-3f61be97ba1e tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:45.433779 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-75ede5ea-9ebf-48d3-ba90-3f61be97ba1e tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] [instance: 266283a7-8c46-44f7-9e50-1996551f3bbd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:45.449382 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75ede5ea-9ebf-48d3-ba90-3f61be97ba1e tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:45.451466 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75ede5ea-9ebf-48d3-ba90-3f61be97ba1e tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:45.452646 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75ede5ea-9ebf-48d3-ba90-3f61be97ba1e tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:45.454714 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75ede5ea-9ebf-48d3-ba90-3f61be97ba1e tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:45.456509 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75ede5ea-9ebf-48d3-ba90-3f61be97ba1e tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:45.458485 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75ede5ea-9ebf-48d3-ba90-3f61be97ba1e tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:45.644361 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-75ede5ea-9ebf-48d3-ba90-3f61be97ba1e tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:45.665327 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-75ede5ea-9ebf-48d3-ba90-3f61be97ba1e tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:45.668256 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-75ede5ea-9ebf-48d3-ba90-3f61be97ba1e tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:45.669975 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-75ede5ea-9ebf-48d3-ba90-3f61be97ba1e tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] 10.222.0.39 "GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd" status: 200 len: 1330 microversion: 2.57 time: 0.242715 Aug 07 01:41:45.671608 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2979/5484] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:41:45 2022] GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd => generated 1330 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:41:46.698512 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ab7a06f9-50de-4d71-9905-736f9bc48f66 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:46.699634 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ab7a06f9-50de-4d71-9905-736f9bc48f66 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] [instance: 266283a7-8c46-44f7-9e50-1996551f3bbd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:46.730647 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab7a06f9-50de-4d71-9905-736f9bc48f66 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:46.731162 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab7a06f9-50de-4d71-9905-736f9bc48f66 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:46.737149 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab7a06f9-50de-4d71-9905-736f9bc48f66 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:46.738202 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab7a06f9-50de-4d71-9905-736f9bc48f66 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:46.738705 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab7a06f9-50de-4d71-9905-736f9bc48f66 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:46.739164 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab7a06f9-50de-4d71-9905-736f9bc48f66 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:46.918121 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ab7a06f9-50de-4d71-9905-736f9bc48f66 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:46.930536 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ab7a06f9-50de-4d71-9905-736f9bc48f66 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:46.932967 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ab7a06f9-50de-4d71-9905-736f9bc48f66 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:46.934377 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ab7a06f9-50de-4d71-9905-736f9bc48f66 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] 10.222.0.39 "GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd" status: 200 len: 1336 microversion: 2.57 time: 0.241581 Aug 07 01:41:46.935831 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2506/5485] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:41:46 2022] GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd => generated 1336 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:41:47.959288 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cbf60a9c-05e7-4aa4-b94c-3890016e9a58 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:47.960023 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cbf60a9c-05e7-4aa4-b94c-3890016e9a58 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] [instance: 266283a7-8c46-44f7-9e50-1996551f3bbd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:47.974698 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cbf60a9c-05e7-4aa4-b94c-3890016e9a58 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:47.975207 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cbf60a9c-05e7-4aa4-b94c-3890016e9a58 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:47.975858 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cbf60a9c-05e7-4aa4-b94c-3890016e9a58 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:47.977869 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cbf60a9c-05e7-4aa4-b94c-3890016e9a58 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:47.978166 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cbf60a9c-05e7-4aa4-b94c-3890016e9a58 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:47.978606 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cbf60a9c-05e7-4aa4-b94c-3890016e9a58 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:48.095868 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cbf60a9c-05e7-4aa4-b94c-3890016e9a58 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:48.104845 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cbf60a9c-05e7-4aa4-b94c-3890016e9a58 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:48.106357 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cbf60a9c-05e7-4aa4-b94c-3890016e9a58 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:48.109811 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cbf60a9c-05e7-4aa4-b94c-3890016e9a58 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] 10.222.0.39 "GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd" status: 200 len: 1336 microversion: 2.57 time: 0.155295 Aug 07 01:41:48.116298 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2980/5486] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:41:47 2022] GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd => generated 1336 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:41:49.139938 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-75197b51-f0fb-4a36-a813-2c2c29bd3e85 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:49.140754 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-75197b51-f0fb-4a36-a813-2c2c29bd3e85 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] [instance: 266283a7-8c46-44f7-9e50-1996551f3bbd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:49.157502 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75197b51-f0fb-4a36-a813-2c2c29bd3e85 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:49.158544 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75197b51-f0fb-4a36-a813-2c2c29bd3e85 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:49.159004 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75197b51-f0fb-4a36-a813-2c2c29bd3e85 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:49.162367 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75197b51-f0fb-4a36-a813-2c2c29bd3e85 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:49.162864 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75197b51-f0fb-4a36-a813-2c2c29bd3e85 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:49.163321 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75197b51-f0fb-4a36-a813-2c2c29bd3e85 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:49.223774 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=54 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:49.348012 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-75197b51-f0fb-4a36-a813-2c2c29bd3e85 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:49.367312 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-75197b51-f0fb-4a36-a813-2c2c29bd3e85 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:49.372989 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-75197b51-f0fb-4a36-a813-2c2c29bd3e85 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:49.377691 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-75197b51-f0fb-4a36-a813-2c2c29bd3e85 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] 10.222.0.39 "GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd" status: 200 len: 1357 microversion: 2.57 time: 0.243247 Aug 07 01:41:49.380448 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2507/5487] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:41:49 2022] GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd => generated 1357 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:41:49.408852 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e7d2f7c2-0f20-45a7-a846-13b2274b69ca tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:41:49.413141 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e7d2f7c2-0f20-45a7-a846-13b2274b69ca tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] [instance: 266283a7-8c46-44f7-9e50-1996551f3bbd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:49.442513 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7d2f7c2-0f20-45a7-a846-13b2274b69ca tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:49.446948 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7d2f7c2-0f20-45a7-a846-13b2274b69ca tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:49.448367 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7d2f7c2-0f20-45a7-a846-13b2274b69ca tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:49.450109 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7d2f7c2-0f20-45a7-a846-13b2274b69ca tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:49.453707 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7d2f7c2-0f20-45a7-a846-13b2274b69ca tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:49.455611 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7d2f7c2-0f20-45a7-a846-13b2274b69ca tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:49.693742 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e7d2f7c2-0f20-45a7-a846-13b2274b69ca tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:41:49.696063 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e7d2f7c2-0f20-45a7-a846-13b2274b69ca tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:41:49.697488 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e7d2f7c2-0f20-45a7-a846-13b2274b69ca tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:41:49.699137 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e7d2f7c2-0f20-45a7-a846-13b2274b69ca tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:41:49.703265 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e7d2f7c2-0f20-45a7-a846-13b2274b69ca tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:41:49.910900 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e7d2f7c2-0f20-45a7-a846-13b2274b69ca tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] [instance: 266283a7-8c46-44f7-9e50-1996551f3bbd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:49.929598 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7d2f7c2-0f20-45a7-a846-13b2274b69ca tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:49.938699 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7d2f7c2-0f20-45a7-a846-13b2274b69ca tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:49.940926 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7d2f7c2-0f20-45a7-a846-13b2274b69ca tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:49.942177 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7d2f7c2-0f20-45a7-a846-13b2274b69ca tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:49.945135 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7d2f7c2-0f20-45a7-a846-13b2274b69ca tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:49.947470 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7d2f7c2-0f20-45a7-a846-13b2274b69ca tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:50.019580 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e7d2f7c2-0f20-45a7-a846-13b2274b69ca tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] 10.222.0.39 "POST /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd/action" status: 202 len: 1138 microversion: 2.57 time: 0.616587 Aug 07 01:41:50.026064 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2981/5488] 10.222.0.39 () {62 vars in 1320 bytes} [Sun Aug 7 01:41:49 2022] POST /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd/action => generated 1138 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 07 01:41:50.047533 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-54a0e975-6ba9-46fa-a793-007f9bfa7058 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:50.048349 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-54a0e975-6ba9-46fa-a793-007f9bfa7058 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] [instance: 266283a7-8c46-44f7-9e50-1996551f3bbd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:50.059148 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54a0e975-6ba9-46fa-a793-007f9bfa7058 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:50.062424 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54a0e975-6ba9-46fa-a793-007f9bfa7058 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:50.064485 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54a0e975-6ba9-46fa-a793-007f9bfa7058 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:50.065390 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54a0e975-6ba9-46fa-a793-007f9bfa7058 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:50.068515 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54a0e975-6ba9-46fa-a793-007f9bfa7058 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:50.069117 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54a0e975-6ba9-46fa-a793-007f9bfa7058 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:50.312274 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-54a0e975-6ba9-46fa-a793-007f9bfa7058 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:50.351474 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-54a0e975-6ba9-46fa-a793-007f9bfa7058 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:50.358646 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-54a0e975-6ba9-46fa-a793-007f9bfa7058 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:50.364971 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-54a0e975-6ba9-46fa-a793-007f9bfa7058 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] 10.222.0.39 "GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd" status: 200 len: 1366 microversion: 2.57 time: 0.321517 Aug 07 01:41:50.367333 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2508/5489] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:41:50 2022] GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd => generated 1366 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:41:51.394280 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d537d692-1255-4e70-b3b4-2142447ef89c tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:51.395158 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d537d692-1255-4e70-b3b4-2142447ef89c tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] [instance: 266283a7-8c46-44f7-9e50-1996551f3bbd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:51.411174 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d537d692-1255-4e70-b3b4-2142447ef89c tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:51.413165 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d537d692-1255-4e70-b3b4-2142447ef89c tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:51.414645 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d537d692-1255-4e70-b3b4-2142447ef89c tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:51.417355 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d537d692-1255-4e70-b3b4-2142447ef89c tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:51.427037 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d537d692-1255-4e70-b3b4-2142447ef89c tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:51.430128 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d537d692-1255-4e70-b3b4-2142447ef89c tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:51.559230 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d537d692-1255-4e70-b3b4-2142447ef89c tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:51.568600 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d537d692-1255-4e70-b3b4-2142447ef89c tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:51.575519 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d537d692-1255-4e70-b3b4-2142447ef89c tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:51.577603 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d537d692-1255-4e70-b3b4-2142447ef89c tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] 10.222.0.39 "GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd" status: 200 len: 1366 microversion: 2.57 time: 0.188601 Aug 07 01:41:51.578824 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2982/5490] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:41:51 2022] GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:41:52.607611 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bdf0ff5d-f485-4977-ae91-475745d3678b tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:52.608962 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bdf0ff5d-f485-4977-ae91-475745d3678b tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] [instance: 266283a7-8c46-44f7-9e50-1996551f3bbd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:52.617353 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bdf0ff5d-f485-4977-ae91-475745d3678b tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:52.618125 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bdf0ff5d-f485-4977-ae91-475745d3678b tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:52.618747 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bdf0ff5d-f485-4977-ae91-475745d3678b tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:52.620038 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bdf0ff5d-f485-4977-ae91-475745d3678b tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:52.620748 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bdf0ff5d-f485-4977-ae91-475745d3678b tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:52.621423 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bdf0ff5d-f485-4977-ae91-475745d3678b tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:52.757085 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bdf0ff5d-f485-4977-ae91-475745d3678b tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:52.766387 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bdf0ff5d-f485-4977-ae91-475745d3678b tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:52.772584 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bdf0ff5d-f485-4977-ae91-475745d3678b tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:52.778753 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bdf0ff5d-f485-4977-ae91-475745d3678b tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] 10.222.0.39 "GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd" status: 200 len: 1366 microversion: 2.57 time: 0.174457 Aug 07 01:41:52.780632 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2509/5491] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:41:52 2022] GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:41:53.812260 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8a6f422e-e320-487d-b70c-eee0010b3a8a tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:53.819676 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8a6f422e-e320-487d-b70c-eee0010b3a8a tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] [instance: 266283a7-8c46-44f7-9e50-1996551f3bbd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:53.830743 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:53.857585 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:53.909734 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a6f422e-e320-487d-b70c-eee0010b3a8a tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:53.911940 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a6f422e-e320-487d-b70c-eee0010b3a8a tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:53.914230 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a6f422e-e320-487d-b70c-eee0010b3a8a tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:53.915293 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a6f422e-e320-487d-b70c-eee0010b3a8a tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:53.927557 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a6f422e-e320-487d-b70c-eee0010b3a8a tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:53.936236 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a6f422e-e320-487d-b70c-eee0010b3a8a tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:53.937301 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:54.147509 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8a6f422e-e320-487d-b70c-eee0010b3a8a tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:54.160189 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8a6f422e-e320-487d-b70c-eee0010b3a8a tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:54.163714 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8a6f422e-e320-487d-b70c-eee0010b3a8a tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:54.170375 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8a6f422e-e320-487d-b70c-eee0010b3a8a tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] 10.222.0.39 "GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd" status: 200 len: 1366 microversion: 2.57 time: 0.365339 Aug 07 01:41:54.172886 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2983/5492] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:41:53 2022] GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd => generated 1366 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:41:55.212663 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6db9a725-8931-40b7-bc09-176003f41ce1 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:55.213557 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6db9a725-8931-40b7-bc09-176003f41ce1 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] [instance: 266283a7-8c46-44f7-9e50-1996551f3bbd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:55.235641 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:55.238941 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6db9a725-8931-40b7-bc09-176003f41ce1 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:55.240247 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6db9a725-8931-40b7-bc09-176003f41ce1 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:55.241279 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6db9a725-8931-40b7-bc09-176003f41ce1 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:55.242579 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6db9a725-8931-40b7-bc09-176003f41ce1 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:55.246803 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6db9a725-8931-40b7-bc09-176003f41ce1 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:55.247650 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6db9a725-8931-40b7-bc09-176003f41ce1 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:55.444137 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6db9a725-8931-40b7-bc09-176003f41ce1 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:55.474431 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6db9a725-8931-40b7-bc09-176003f41ce1 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:55.478917 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6db9a725-8931-40b7-bc09-176003f41ce1 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:55.482421 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6db9a725-8931-40b7-bc09-176003f41ce1 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] 10.222.0.39 "GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd" status: 200 len: 1366 microversion: 2.57 time: 0.287490 Aug 07 01:41:55.500748 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2510/5493] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:41:55 2022] GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:41:56.515416 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-63843a00-9e26-44f3-b3b0-ebacf7121cc3 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:56.516656 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-63843a00-9e26-44f3-b3b0-ebacf7121cc3 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] [instance: 266283a7-8c46-44f7-9e50-1996551f3bbd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:56.531130 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-63843a00-9e26-44f3-b3b0-ebacf7121cc3 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:56.544622 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-63843a00-9e26-44f3-b3b0-ebacf7121cc3 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:56.546949 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-63843a00-9e26-44f3-b3b0-ebacf7121cc3 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:56.550425 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-63843a00-9e26-44f3-b3b0-ebacf7121cc3 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:56.551151 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-63843a00-9e26-44f3-b3b0-ebacf7121cc3 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:56.555308 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-63843a00-9e26-44f3-b3b0-ebacf7121cc3 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:56.823067 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-63843a00-9e26-44f3-b3b0-ebacf7121cc3 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:56.823067 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-63843a00-9e26-44f3-b3b0-ebacf7121cc3 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:56.823067 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-63843a00-9e26-44f3-b3b0-ebacf7121cc3 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:56.823067 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-63843a00-9e26-44f3-b3b0-ebacf7121cc3 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] 10.222.0.39 "GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd" status: 200 len: 1366 microversion: 2.57 time: 0.275299 Aug 07 01:41:56.823067 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2984/5494] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:41:56 2022] GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd => generated 1366 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:41:57.808912 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-516ecfeb-1e4a-4186-bbaf-e27cdec1ac03 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:57.809681 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-516ecfeb-1e4a-4186-bbaf-e27cdec1ac03 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] [instance: 266283a7-8c46-44f7-9e50-1996551f3bbd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:57.819488 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-516ecfeb-1e4a-4186-bbaf-e27cdec1ac03 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:57.820532 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-516ecfeb-1e4a-4186-bbaf-e27cdec1ac03 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:57.821691 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-516ecfeb-1e4a-4186-bbaf-e27cdec1ac03 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:57.822684 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-516ecfeb-1e4a-4186-bbaf-e27cdec1ac03 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:57.824970 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-516ecfeb-1e4a-4186-bbaf-e27cdec1ac03 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:57.825770 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-516ecfeb-1e4a-4186-bbaf-e27cdec1ac03 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:57.980173 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-516ecfeb-1e4a-4186-bbaf-e27cdec1ac03 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:57.993125 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-516ecfeb-1e4a-4186-bbaf-e27cdec1ac03 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:58.006041 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-516ecfeb-1e4a-4186-bbaf-e27cdec1ac03 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:58.010347 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-516ecfeb-1e4a-4186-bbaf-e27cdec1ac03 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] 10.222.0.39 "GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd" status: 200 len: 1366 microversion: 2.57 time: 0.207147 Aug 07 01:41:58.010933 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2511/5495] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:41:57 2022] GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:41:59.037462 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9c89a801-e70e-4753-a99f-b518a6be50fc tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:41:59.038164 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9c89a801-e70e-4753-a99f-b518a6be50fc tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] [instance: 266283a7-8c46-44f7-9e50-1996551f3bbd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:41:59.051351 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c89a801-e70e-4753-a99f-b518a6be50fc tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:59.051853 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c89a801-e70e-4753-a99f-b518a6be50fc tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:59.052337 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c89a801-e70e-4753-a99f-b518a6be50fc tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:59.057431 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c89a801-e70e-4753-a99f-b518a6be50fc tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:41:59.057431 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c89a801-e70e-4753-a99f-b518a6be50fc tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:41:59.057431 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c89a801-e70e-4753-a99f-b518a6be50fc tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:41:59.165261 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9c89a801-e70e-4753-a99f-b518a6be50fc tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:59.175639 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9c89a801-e70e-4753-a99f-b518a6be50fc tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:59.177702 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9c89a801-e70e-4753-a99f-b518a6be50fc tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:41:59.179699 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9c89a801-e70e-4753-a99f-b518a6be50fc tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] 10.222.0.39 "GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd" status: 200 len: 1366 microversion: 2.57 time: 0.146668 Aug 07 01:41:59.181167 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2985/5496] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:41:59 2022] GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:42:00.208466 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-af737496-8678-41e0-a2fd-9b4389a44081 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:00.209678 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-af737496-8678-41e0-a2fd-9b4389a44081 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] [instance: 266283a7-8c46-44f7-9e50-1996551f3bbd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:42:00.219199 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-af737496-8678-41e0-a2fd-9b4389a44081 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:00.220488 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-af737496-8678-41e0-a2fd-9b4389a44081 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:00.221122 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-af737496-8678-41e0-a2fd-9b4389a44081 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:00.222022 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-af737496-8678-41e0-a2fd-9b4389a44081 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:00.222887 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-af737496-8678-41e0-a2fd-9b4389a44081 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:00.223617 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-af737496-8678-41e0-a2fd-9b4389a44081 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:00.342996 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-af737496-8678-41e0-a2fd-9b4389a44081 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:00.354197 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-af737496-8678-41e0-a2fd-9b4389a44081 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:00.357993 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-af737496-8678-41e0-a2fd-9b4389a44081 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:00.359455 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-af737496-8678-41e0-a2fd-9b4389a44081 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] 10.222.0.39 "GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd" status: 200 len: 1366 microversion: 2.57 time: 0.157144 Aug 07 01:42:00.361385 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2512/5497] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:42:00 2022] GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:42:01.392454 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f8e43e9d-b89f-4853-b6e9-da2068ce2e0d tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:01.394332 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f8e43e9d-b89f-4853-b6e9-da2068ce2e0d tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] [instance: 266283a7-8c46-44f7-9e50-1996551f3bbd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:42:01.439692 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f8e43e9d-b89f-4853-b6e9-da2068ce2e0d tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:01.440597 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f8e43e9d-b89f-4853-b6e9-da2068ce2e0d tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:01.449181 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f8e43e9d-b89f-4853-b6e9-da2068ce2e0d tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:01.449181 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f8e43e9d-b89f-4853-b6e9-da2068ce2e0d tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:01.449418 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f8e43e9d-b89f-4853-b6e9-da2068ce2e0d tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:01.450718 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f8e43e9d-b89f-4853-b6e9-da2068ce2e0d tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:01.612049 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f8e43e9d-b89f-4853-b6e9-da2068ce2e0d tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:01.636918 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f8e43e9d-b89f-4853-b6e9-da2068ce2e0d tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:01.642804 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f8e43e9d-b89f-4853-b6e9-da2068ce2e0d tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:01.647489 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f8e43e9d-b89f-4853-b6e9-da2068ce2e0d tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] 10.222.0.39 "GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd" status: 200 len: 1366 microversion: 2.57 time: 0.264934 Aug 07 01:42:01.664915 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2986/5498] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:42:01 2022] GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd => generated 1366 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:42:02.677804 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-50437dd0-3f64-42a5-bbae-7934d077224a tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:02.679574 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-50437dd0-3f64-42a5-bbae-7934d077224a tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] [instance: 266283a7-8c46-44f7-9e50-1996551f3bbd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:42:02.689975 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-50437dd0-3f64-42a5-bbae-7934d077224a tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:02.691458 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-50437dd0-3f64-42a5-bbae-7934d077224a tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:02.692877 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-50437dd0-3f64-42a5-bbae-7934d077224a tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:02.693945 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-50437dd0-3f64-42a5-bbae-7934d077224a tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:02.694945 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-50437dd0-3f64-42a5-bbae-7934d077224a tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:02.696167 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-50437dd0-3f64-42a5-bbae-7934d077224a tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:02.934427 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-50437dd0-3f64-42a5-bbae-7934d077224a tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:02.952319 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-50437dd0-3f64-42a5-bbae-7934d077224a tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:02.956944 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-50437dd0-3f64-42a5-bbae-7934d077224a tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:02.963640 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-50437dd0-3f64-42a5-bbae-7934d077224a tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] 10.222.0.39 "GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd" status: 200 len: 1366 microversion: 2.57 time: 0.288115 Aug 07 01:42:02.964636 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2513/5499] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:42:02 2022] GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd => generated 1366 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:42:03.987623 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-80524299-3dcd-4b1b-aefd-58c6bf61a001 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:03.988143 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-80524299-3dcd-4b1b-aefd-58c6bf61a001 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] [instance: 266283a7-8c46-44f7-9e50-1996551f3bbd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:42:04.000586 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80524299-3dcd-4b1b-aefd-58c6bf61a001 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:04.002936 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80524299-3dcd-4b1b-aefd-58c6bf61a001 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:04.003610 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80524299-3dcd-4b1b-aefd-58c6bf61a001 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:04.004687 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80524299-3dcd-4b1b-aefd-58c6bf61a001 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:04.010236 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80524299-3dcd-4b1b-aefd-58c6bf61a001 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:04.010995 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80524299-3dcd-4b1b-aefd-58c6bf61a001 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:04.311450 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-80524299-3dcd-4b1b-aefd-58c6bf61a001 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:04.335409 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-80524299-3dcd-4b1b-aefd-58c6bf61a001 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:04.343328 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-80524299-3dcd-4b1b-aefd-58c6bf61a001 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:04.346101 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-80524299-3dcd-4b1b-aefd-58c6bf61a001 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] 10.222.0.39 "GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd" status: 200 len: 1366 microversion: 2.57 time: 0.363291 Aug 07 01:42:04.362349 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2987/5500] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:42:03 2022] GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd => generated 1366 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:42:05.375135 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d18dc9c4-0441-4d5f-a886-9cc19ec89e87 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:05.377444 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d18dc9c4-0441-4d5f-a886-9cc19ec89e87 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] [instance: 266283a7-8c46-44f7-9e50-1996551f3bbd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:42:05.399438 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d18dc9c4-0441-4d5f-a886-9cc19ec89e87 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:05.400359 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d18dc9c4-0441-4d5f-a886-9cc19ec89e87 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:05.401195 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d18dc9c4-0441-4d5f-a886-9cc19ec89e87 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:05.402127 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d18dc9c4-0441-4d5f-a886-9cc19ec89e87 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:05.403508 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d18dc9c4-0441-4d5f-a886-9cc19ec89e87 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:05.405743 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d18dc9c4-0441-4d5f-a886-9cc19ec89e87 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:05.521361 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d18dc9c4-0441-4d5f-a886-9cc19ec89e87 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:05.530794 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d18dc9c4-0441-4d5f-a886-9cc19ec89e87 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:05.537724 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d18dc9c4-0441-4d5f-a886-9cc19ec89e87 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:05.541395 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d18dc9c4-0441-4d5f-a886-9cc19ec89e87 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] 10.222.0.39 "GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd" status: 200 len: 1366 microversion: 2.57 time: 0.170391 Aug 07 01:42:05.542584 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2514/5501] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:42:05 2022] GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 01:42:06.566602 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3327f082-44eb-47a7-8404-42abbca58bc3 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:06.567199 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3327f082-44eb-47a7-8404-42abbca58bc3 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] [instance: 266283a7-8c46-44f7-9e50-1996551f3bbd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:42:06.581013 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3327f082-44eb-47a7-8404-42abbca58bc3 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:06.581518 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3327f082-44eb-47a7-8404-42abbca58bc3 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:06.581960 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3327f082-44eb-47a7-8404-42abbca58bc3 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:06.582686 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3327f082-44eb-47a7-8404-42abbca58bc3 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:06.583148 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3327f082-44eb-47a7-8404-42abbca58bc3 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:06.583578 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3327f082-44eb-47a7-8404-42abbca58bc3 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:06.773532 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3327f082-44eb-47a7-8404-42abbca58bc3 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:06.805832 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3327f082-44eb-47a7-8404-42abbca58bc3 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:06.816672 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3327f082-44eb-47a7-8404-42abbca58bc3 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:06.817930 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3327f082-44eb-47a7-8404-42abbca58bc3 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] 10.222.0.39 "GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd" status: 200 len: 1366 microversion: 2.57 time: 0.255592 Aug 07 01:42:06.818513 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2988/5502] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:42:06 2022] GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:42:07.850346 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-598f8df6-67b7-4f15-9f02-2f1764c97bf6 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:07.851012 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-598f8df6-67b7-4f15-9f02-2f1764c97bf6 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] [instance: 266283a7-8c46-44f7-9e50-1996551f3bbd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:42:07.869820 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-598f8df6-67b7-4f15-9f02-2f1764c97bf6 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:07.870546 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-598f8df6-67b7-4f15-9f02-2f1764c97bf6 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:07.875337 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-598f8df6-67b7-4f15-9f02-2f1764c97bf6 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:07.884743 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-598f8df6-67b7-4f15-9f02-2f1764c97bf6 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:07.885236 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-598f8df6-67b7-4f15-9f02-2f1764c97bf6 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:07.885686 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-598f8df6-67b7-4f15-9f02-2f1764c97bf6 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:08.578878 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-598f8df6-67b7-4f15-9f02-2f1764c97bf6 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:08.614509 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-598f8df6-67b7-4f15-9f02-2f1764c97bf6 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:08.619833 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-598f8df6-67b7-4f15-9f02-2f1764c97bf6 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:08.622566 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-598f8df6-67b7-4f15-9f02-2f1764c97bf6 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] 10.222.0.39 "GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd" status: 200 len: 1366 microversion: 2.57 time: 0.776011 Aug 07 01:42:08.624536 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2515/5503] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:42:07 2022] GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd => generated 1366 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:42:09.673850 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-088b256f-87b8-4c70-804e-bc1a43bc512f tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:09.674548 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-088b256f-87b8-4c70-804e-bc1a43bc512f tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] [instance: 266283a7-8c46-44f7-9e50-1996551f3bbd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:42:09.703003 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-088b256f-87b8-4c70-804e-bc1a43bc512f tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:09.708756 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-088b256f-87b8-4c70-804e-bc1a43bc512f tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:09.710936 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-088b256f-87b8-4c70-804e-bc1a43bc512f tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:09.711926 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-088b256f-87b8-4c70-804e-bc1a43bc512f tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:09.713732 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-088b256f-87b8-4c70-804e-bc1a43bc512f tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:09.714557 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-088b256f-87b8-4c70-804e-bc1a43bc512f tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:09.987730 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-088b256f-87b8-4c70-804e-bc1a43bc512f tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:10.007633 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-088b256f-87b8-4c70-804e-bc1a43bc512f tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:10.010106 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-088b256f-87b8-4c70-804e-bc1a43bc512f tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:10.020692 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-088b256f-87b8-4c70-804e-bc1a43bc512f tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] 10.222.0.39 "GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd" status: 200 len: 1366 microversion: 2.57 time: 0.351790 Aug 07 01:42:10.026743 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2989/5504] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:42:09 2022] GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd => generated 1366 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:42:11.053247 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5dfeca67-4cc0-4461-afd4-c4016e6a155b tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:11.053944 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5dfeca67-4cc0-4461-afd4-c4016e6a155b tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] [instance: 266283a7-8c46-44f7-9e50-1996551f3bbd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:42:11.076173 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5dfeca67-4cc0-4461-afd4-c4016e6a155b tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:11.080089 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5dfeca67-4cc0-4461-afd4-c4016e6a155b tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:11.082713 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5dfeca67-4cc0-4461-afd4-c4016e6a155b tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:11.083516 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5dfeca67-4cc0-4461-afd4-c4016e6a155b tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:11.089529 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5dfeca67-4cc0-4461-afd4-c4016e6a155b tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:11.093608 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5dfeca67-4cc0-4461-afd4-c4016e6a155b tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:11.361763 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5dfeca67-4cc0-4461-afd4-c4016e6a155b tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:11.382456 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5dfeca67-4cc0-4461-afd4-c4016e6a155b tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:11.396308 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5dfeca67-4cc0-4461-afd4-c4016e6a155b tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:11.406039 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5dfeca67-4cc0-4461-afd4-c4016e6a155b tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] 10.222.0.39 "GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd" status: 200 len: 1366 microversion: 2.57 time: 0.351033 Aug 07 01:42:11.408386 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2516/5505] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:42:11 2022] GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd => generated 1366 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:42:12.435824 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5e5fa912-4f74-430b-9991-10b17de7abe6 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:12.436478 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5e5fa912-4f74-430b-9991-10b17de7abe6 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] [instance: 266283a7-8c46-44f7-9e50-1996551f3bbd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:42:12.451118 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e5fa912-4f74-430b-9991-10b17de7abe6 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:12.451614 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e5fa912-4f74-430b-9991-10b17de7abe6 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:12.452159 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e5fa912-4f74-430b-9991-10b17de7abe6 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:12.452896 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e5fa912-4f74-430b-9991-10b17de7abe6 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:12.453398 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e5fa912-4f74-430b-9991-10b17de7abe6 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:12.454288 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e5fa912-4f74-430b-9991-10b17de7abe6 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:12.621687 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5e5fa912-4f74-430b-9991-10b17de7abe6 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:12.636480 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5e5fa912-4f74-430b-9991-10b17de7abe6 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:12.639747 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5e5fa912-4f74-430b-9991-10b17de7abe6 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:12.641227 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5e5fa912-4f74-430b-9991-10b17de7abe6 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] 10.222.0.39 "GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd" status: 200 len: 1366 microversion: 2.57 time: 0.209378 Aug 07 01:42:12.644838 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2990/5506] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:42:12 2022] GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:42:13.674562 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-52993365-207d-4365-bf5a-c510ac6d9115 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:13.675599 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-52993365-207d-4365-bf5a-c510ac6d9115 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] [instance: 266283a7-8c46-44f7-9e50-1996551f3bbd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:42:13.690748 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52993365-207d-4365-bf5a-c510ac6d9115 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:13.691246 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52993365-207d-4365-bf5a-c510ac6d9115 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:13.701911 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52993365-207d-4365-bf5a-c510ac6d9115 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:13.709390 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52993365-207d-4365-bf5a-c510ac6d9115 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:13.709887 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52993365-207d-4365-bf5a-c510ac6d9115 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:13.720725 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5893920f-e913-4da4-a456-9fccdf375168 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:13.723613 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5893920f-e913-4da4-a456-9fccdf375168 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: a6704b77-3a73-4dc8-85af-8eb60c16899a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:42:13.728247 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52993365-207d-4365-bf5a-c510ac6d9115 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:13.735441 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5893920f-e913-4da4-a456-9fccdf375168 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:13.738936 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5893920f-e913-4da4-a456-9fccdf375168 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:13.739707 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5893920f-e913-4da4-a456-9fccdf375168 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:13.740742 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5893920f-e913-4da4-a456-9fccdf375168 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:13.743766 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5893920f-e913-4da4-a456-9fccdf375168 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:13.744693 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5893920f-e913-4da4-a456-9fccdf375168 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:13.793268 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5893920f-e913-4da4-a456-9fccdf375168 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a/ips" status: 200 len: 146 microversion: 2.1 time: 0.811678 Aug 07 01:42:13.800141 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2517/5507] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Aug 7 01:42:12 2022] GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a/ips => generated 146 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:42:15.153968 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-52993365-207d-4365-bf5a-c510ac6d9115 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:15.156108 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:15.174207 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-52993365-207d-4365-bf5a-c510ac6d9115 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:15.182495 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-52993365-207d-4365-bf5a-c510ac6d9115 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:15.188612 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-52993365-207d-4365-bf5a-c510ac6d9115 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] 10.222.0.39 "GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd" status: 200 len: 1366 microversion: 2.57 time: 1.519232 Aug 07 01:42:15.189814 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2991/5508] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:42:13 2022] GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd => generated 1366 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:42:16.216969 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-449620b3-3656-4c83-93ff-802360bfd96c tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:16.219670 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-449620b3-3656-4c83-93ff-802360bfd96c tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] [instance: 266283a7-8c46-44f7-9e50-1996551f3bbd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:42:16.228308 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=28 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:16.230654 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-449620b3-3656-4c83-93ff-802360bfd96c tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:16.231572 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-449620b3-3656-4c83-93ff-802360bfd96c tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:16.232407 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-449620b3-3656-4c83-93ff-802360bfd96c tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:16.233460 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-449620b3-3656-4c83-93ff-802360bfd96c tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:16.234192 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-449620b3-3656-4c83-93ff-802360bfd96c tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:16.235376 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-449620b3-3656-4c83-93ff-802360bfd96c tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:16.471556 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-449620b3-3656-4c83-93ff-802360bfd96c tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:16.494141 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-449620b3-3656-4c83-93ff-802360bfd96c tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:16.495672 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-449620b3-3656-4c83-93ff-802360bfd96c tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:16.496968 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-449620b3-3656-4c83-93ff-802360bfd96c tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] 10.222.0.39 "GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd" status: 200 len: 1366 microversion: 2.57 time: 0.284317 Aug 07 01:42:16.499594 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2518/5509] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:42:16 2022] GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:42:17.532496 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-13bd1f31-c9f1-40a0-8319-a0b3c31c405a tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:17.533857 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-13bd1f31-c9f1-40a0-8319-a0b3c31c405a tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] [instance: 266283a7-8c46-44f7-9e50-1996551f3bbd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:42:17.554534 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-13bd1f31-c9f1-40a0-8319-a0b3c31c405a tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:17.555494 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-13bd1f31-c9f1-40a0-8319-a0b3c31c405a tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:17.556160 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-13bd1f31-c9f1-40a0-8319-a0b3c31c405a tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:17.556933 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-13bd1f31-c9f1-40a0-8319-a0b3c31c405a tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:17.557493 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-13bd1f31-c9f1-40a0-8319-a0b3c31c405a tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:17.563435 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-13bd1f31-c9f1-40a0-8319-a0b3c31c405a tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:17.746758 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-77940387-bfbb-4d09-a4ca-d767158f779d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f634ebb-5a4a-4b92-99a6-314a3fd9e9a0"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:42:17.749939 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-77940387-bfbb-4d09-a4ca-d767158f779d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: a6704b77-3a73-4dc8-85af-8eb60c16899a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:42:17.771419 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-77940387-bfbb-4d09-a4ca-d767158f779d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:17.772033 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-77940387-bfbb-4d09-a4ca-d767158f779d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:17.772482 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-77940387-bfbb-4d09-a4ca-d767158f779d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:17.773240 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-77940387-bfbb-4d09-a4ca-d767158f779d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:17.773834 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-77940387-bfbb-4d09-a4ca-d767158f779d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:17.774305 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-77940387-bfbb-4d09-a4ca-d767158f779d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:18.215409 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-13bd1f31-c9f1-40a0-8319-a0b3c31c405a tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:18.237797 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-13bd1f31-c9f1-40a0-8319-a0b3c31c405a tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:18.242064 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-13bd1f31-c9f1-40a0-8319-a0b3c31c405a tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:18.249747 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-13bd1f31-c9f1-40a0-8319-a0b3c31c405a tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] 10.222.0.39 "GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd" status: 200 len: 1372 microversion: 2.57 time: 0.725289 Aug 07 01:42:18.252151 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2992/5510] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:42:17 2022] GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd => generated 1372 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:42:18.398363 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-77940387-bfbb-4d09-a4ca-d767158f779d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "POST /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.653003 Aug 07 01:42:18.408779 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2519/5511] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Aug 7 01:42:17 2022] POST /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a/os-volume_attachments => generated 194 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:42:19.278807 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-61f18cab-b1b5-453f-940e-741146543275 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:19.280089 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-61f18cab-b1b5-453f-940e-741146543275 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] [instance: 266283a7-8c46-44f7-9e50-1996551f3bbd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:42:19.295155 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-61f18cab-b1b5-453f-940e-741146543275 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:19.300322 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-61f18cab-b1b5-453f-940e-741146543275 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:19.301469 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-61f18cab-b1b5-453f-940e-741146543275 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:19.302517 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-61f18cab-b1b5-453f-940e-741146543275 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:19.308319 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-61f18cab-b1b5-453f-940e-741146543275 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:19.311611 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-61f18cab-b1b5-453f-940e-741146543275 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:19.543815 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-61f18cab-b1b5-453f-940e-741146543275 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:19.558587 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-61f18cab-b1b5-453f-940e-741146543275 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:19.564068 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-61f18cab-b1b5-453f-940e-741146543275 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:19.567667 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-61f18cab-b1b5-453f-940e-741146543275 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] 10.222.0.39 "GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd" status: 200 len: 1372 microversion: 2.57 time: 0.291868 Aug 07 01:42:19.569637 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2993/5512] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:42:19 2022] GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd => generated 1372 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:42:20.602331 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ad0b749f-e97a-453a-be09-7be60759ac64 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:20.603068 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ad0b749f-e97a-453a-be09-7be60759ac64 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] [instance: 266283a7-8c46-44f7-9e50-1996551f3bbd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:42:20.617081 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad0b749f-e97a-453a-be09-7be60759ac64 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:20.617503 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad0b749f-e97a-453a-be09-7be60759ac64 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:20.621102 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad0b749f-e97a-453a-be09-7be60759ac64 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:20.622056 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad0b749f-e97a-453a-be09-7be60759ac64 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:20.628777 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad0b749f-e97a-453a-be09-7be60759ac64 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:20.629739 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ad0b749f-e97a-453a-be09-7be60759ac64 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:20.660677 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:20.720424 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ad0b749f-e97a-453a-be09-7be60759ac64 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:20.734101 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ad0b749f-e97a-453a-be09-7be60759ac64 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:20.736080 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ad0b749f-e97a-453a-be09-7be60759ac64 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:20.737997 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ad0b749f-e97a-453a-be09-7be60759ac64 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] 10.222.0.39 "GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd" status: 200 len: 1357 microversion: 2.57 time: 0.141554 Aug 07 01:42:20.739112 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2520/5513] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:42:20 2022] GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd => generated 1357 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:42:20.772322 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a425a99d-7bbd-4ca6-afce-1807104a4ee1 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:20.786847 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a425a99d-7bbd-4ca6-afce-1807104a4ee1 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] [instance: 266283a7-8c46-44f7-9e50-1996551f3bbd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:42:20.798717 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a425a99d-7bbd-4ca6-afce-1807104a4ee1 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:20.799525 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a425a99d-7bbd-4ca6-afce-1807104a4ee1 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:20.800191 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a425a99d-7bbd-4ca6-afce-1807104a4ee1 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:20.801158 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a425a99d-7bbd-4ca6-afce-1807104a4ee1 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:20.801962 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a425a99d-7bbd-4ca6-afce-1807104a4ee1 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:20.802598 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a425a99d-7bbd-4ca6-afce-1807104a4ee1 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:20.868677 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a425a99d-7bbd-4ca6-afce-1807104a4ee1 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] [instance: 266283a7-8c46-44f7-9e50-1996551f3bbd] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:42:21.060093 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a425a99d-7bbd-4ca6-afce-1807104a4ee1 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] 10.222.0.39 "DELETE /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd" status: 204 len: 0 microversion: 2.57 time: 0.291153 Aug 07 01:42:21.067409 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2994/5514] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Aug 7 01:42:20 2022] DELETE /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 01:42:21.079482 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c05d74af-e40e-4d8f-89aa-b4572f985378 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:21.084375 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c05d74af-e40e-4d8f-89aa-b4572f985378 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] [instance: 266283a7-8c46-44f7-9e50-1996551f3bbd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:42:21.097505 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c05d74af-e40e-4d8f-89aa-b4572f985378 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:21.098109 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c05d74af-e40e-4d8f-89aa-b4572f985378 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:21.098626 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c05d74af-e40e-4d8f-89aa-b4572f985378 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:21.099426 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c05d74af-e40e-4d8f-89aa-b4572f985378 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:21.100042 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c05d74af-e40e-4d8f-89aa-b4572f985378 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:21.100542 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c05d74af-e40e-4d8f-89aa-b4572f985378 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:21.428277 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c05d74af-e40e-4d8f-89aa-b4572f985378 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:21.467818 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c05d74af-e40e-4d8f-89aa-b4572f985378 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:21.470521 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c05d74af-e40e-4d8f-89aa-b4572f985378 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:21.483033 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c05d74af-e40e-4d8f-89aa-b4572f985378 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] 10.222.0.39 "GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd" status: 200 len: 1363 microversion: 2.57 time: 0.413215 Aug 07 01:42:21.516511 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2521/5515] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:42:21 2022] GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd => generated 1363 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:42:22.511504 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d5631f56-90da-435c-b27e-03a46044a0d8 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:22.512856 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d5631f56-90da-435c-b27e-03a46044a0d8 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] [instance: 266283a7-8c46-44f7-9e50-1996551f3bbd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:42:22.541927 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d5631f56-90da-435c-b27e-03a46044a0d8 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:22.545500 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d5631f56-90da-435c-b27e-03a46044a0d8 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:22.549781 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d5631f56-90da-435c-b27e-03a46044a0d8 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:22.555600 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d5631f56-90da-435c-b27e-03a46044a0d8 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:22.558225 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d5631f56-90da-435c-b27e-03a46044a0d8 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:22.561323 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d5631f56-90da-435c-b27e-03a46044a0d8 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:23.124132 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d5631f56-90da-435c-b27e-03a46044a0d8 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:23.134769 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d5631f56-90da-435c-b27e-03a46044a0d8 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:23.166287 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d5631f56-90da-435c-b27e-03a46044a0d8 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d4cd041ba884cedb08c70ea8083d027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019b0c4dadba463e99513297ede55f3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:23.171474 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d5631f56-90da-435c-b27e-03a46044a0d8 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] 10.222.0.39 "GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd" status: 200 len: 1363 microversion: 2.57 time: 0.664862 Aug 07 01:42:23.180636 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2995/5516] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:42:22 2022] GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd => generated 1363 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 01:42:24.211136 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5d5dd9c7-ac16-4fdb-9cdf-87831926dc66 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:24.211869 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5d5dd9c7-ac16-4fdb-9cdf-87831926dc66 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] [instance: 266283a7-8c46-44f7-9e50-1996551f3bbd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:42:24.262753 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d5dd9c7-ac16-4fdb-9cdf-87831926dc66 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:24.263272 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d5dd9c7-ac16-4fdb-9cdf-87831926dc66 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:24.263724 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d5dd9c7-ac16-4fdb-9cdf-87831926dc66 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:24.272375 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d5dd9c7-ac16-4fdb-9cdf-87831926dc66 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:24.276895 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d5dd9c7-ac16-4fdb-9cdf-87831926dc66 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:24.286177 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d5dd9c7-ac16-4fdb-9cdf-87831926dc66 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:24.367717 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-5d5dd9c7-ac16-4fdb-9cdf-87831926dc66 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] HTTP exception thrown: Instance 266283a7-8c46-44f7-9e50-1996551f3bbd could not be found. Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5d5dd9c7-ac16-4fdb-9cdf-87831926dc66 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Request method failure captured: Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd HTTP/1.1 Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xhXuSS8DnYW9sKAMGWTYCY4s_eIQxgE5IcDGGUxjUb96acnW8Q1gHnQymr1lIJYw74cBjnmBT_wi-Bky3yJ0HZq_5qBwygAIcC1wgLXPujNwrsyToTPxneQjlb88hq7DGR_nNI65pFxQQRxeKot3D8h8Oydfw9wkl2ZH1aZ3pPdPVg Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: X-Openstack-Nova-Api-Version: 2.57 Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 019b0c4dadba463e99513297ede55f3c Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServerShowV257Test-659640123 Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/019b0c4dadba463e99513297ede55f3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_019b0c4dadba463e99513297ede55f3c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/019b0c4dadba463e99513297ede55f3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/019b0c4dadba463e99513297ede55f3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServerShowV257Test-659640123 Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 019b0c4dadba463e99513297ede55f3c Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServerShowV257Test-659640123 Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServerShowV257Test-659640123-project Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 7d4cd041ba884cedb08c70ea8083d027 Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServerShowV257Test-659640123-project Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 266283a7-8c46-44f7-9e50-1996551f3bbd could not be found. Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '266283a7-8c46-44f7-9e50-1996551f3bbd'} Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 266283a7-8c46-44f7-9e50-1996551f3bbd could not be found. Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 266283a7-8c46-44f7-9e50-1996551f3bbd could not be found. Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:42:24.375459 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:42:24.380579 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:42:24.380579 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:42:24.380579 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:42:24.380579 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:42:24.380579 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:42:24.380579 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 266283a7-8c46-44f7-9e50-1996551f3bbd could not be found. Aug 07 01:42:24.380579 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:42:24.380579 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5d5dd9c7-ac16-4fdb-9cdf-87831926dc66 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] Returning 404 to user: Instance 266283a7-8c46-44f7-9e50-1996551f3bbd could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:42:24.381250 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5d5dd9c7-ac16-4fdb-9cdf-87831926dc66 tempest-ServerShowV257Test-659640123 tempest-ServerShowV257Test-659640123-project] 10.222.0.39 "GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd" status: 404 len: 111 microversion: 2.57 time: 0.177364 Aug 07 01:42:24.381461 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2522/5517] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Aug 7 01:42:24 2022] GET /compute/v2.1/servers/266283a7-8c46-44f7-9e50-1996551f3bbd => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:42:30.620084 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9578e40e-824e-4a5c-8bdc-75631e2a41c4 tempest-ExtensionsTest-1889020481 tempest-ExtensionsTest-1889020481-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:30.621818 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9578e40e-824e-4a5c-8bdc-75631e2a41c4 tempest-ExtensionsTest-1889020481 tempest-ExtensionsTest-1889020481-project] 10.222.0.39 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.261523 Aug 07 01:42:30.622701 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2996/5518] 10.222.0.39 () {58 vars in 1170 bytes} [Sun Aug 7 01:42:30 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:42:30.634919 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-069e9dab-bdbe-4395-9557-edcbdf27898c tempest-ExtensionsTest-1889020481 tempest-ExtensionsTest-1889020481-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:30.637690 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-069e9dab-bdbe-4395-9557-edcbdf27898c tempest-ExtensionsTest-1889020481 tempest-ExtensionsTest-1889020481-project] 10.222.0.39 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.007436 Aug 07 01:42:30.639156 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2523/5519] 10.222.0.39 () {58 vars in 1134 bytes} [Sun Aug 7 01:42:30 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:42:36.503655 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:36.505261 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:37.157739 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ec3f6ae6-4365-410b-80d8-21a19fe31cc9 tempest-VolumesGetTestJSON-1383182495 tempest-VolumesGetTestJSON-1383182495-project] Action: 'create', calling method: .version_select at 0x7f9e170d0280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-331841358", "metadata": {"Type": "work"}}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:42:37.786330 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ec3f6ae6-4365-410b-80d8-21a19fe31cc9 tempest-VolumesGetTestJSON-1383182495 tempest-VolumesGetTestJSON-1383182495-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.288404 Aug 07 01:42:37.787267 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2997/5520] 10.222.0.39 () {60 vars in 1156 bytes} [Sun Aug 7 01:42:36 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1290 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 07 01:42:37.801969 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-04162ea4-20f5-49f0-90e4-d3b8719a5b57 tempest-VolumesGetTestJSON-1383182495 tempest-VolumesGetTestJSON-1383182495-project] Calling method '.version_select at 0x7f9e297fe160>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:37.825753 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=9 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:37.827014 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=13 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:37.885147 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-04162ea4-20f5-49f0-90e4-d3b8719a5b57 tempest-VolumesGetTestJSON-1383182495 tempest-VolumesGetTestJSON-1383182495-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/fb70bcb1-6ebc-46a6-8783-b153bc771b59" status: 200 len: 352 microversion: 2.1 time: 0.089065 Aug 07 01:42:37.885986 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2524/5521] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Aug 7 01:42:37 2022] GET /compute/v2.1/os-volumes/fb70bcb1-6ebc-46a6-8783-b153bc771b59 => generated 352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:42:38.874288 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-486ecc1e-28c9-4037-b8ac-ac74399ecfc1 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Action: 'create', calling method: .version_select at 0x7f9e24074790>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1383916573", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErw8J+cYsAlBDns2C2Ykvtz8qXG7KqGRJ9yQipSzOjMSjbTAQxUu0x21bxlkLLwrPIFWTSe9oqvr+dO4R+baaVUEx42p4EL6nw+2caEac055KuC2SSu0DnvQwvYfnYlzg=="}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:42:38.901258 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-23d6d5b5-9efe-4727-b304-4d010397600c tempest-VolumesGetTestJSON-1383182495 tempest-VolumesGetTestJSON-1383182495-project] Calling method '.version_select at 0x7f9e298001f0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:38.917293 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-486ecc1e-28c9-4037-b8ac-ac74399ecfc1 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Getting quotas for project 3139e77141f84e2485d2ba5d305f4ec7. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:42:38.935826 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-486ecc1e-28c9-4037-b8ac-ac74399ecfc1 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Getting quotas for user 68324eedf5c840f4806f4c4ae410774f and project 3139e77141f84e2485d2ba5d305f4ec7. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:42:39.012874 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-486ecc1e-28c9-4037-b8ac-ac74399ecfc1 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.144716 Aug 07 01:42:39.013804 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2998/5522] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:42:38 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:42:39.027680 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-23d6d5b5-9efe-4727-b304-4d010397600c tempest-VolumesGetTestJSON-1383182495 tempest-VolumesGetTestJSON-1383182495-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/fb70bcb1-6ebc-46a6-8783-b153bc771b59" status: 200 len: 353 microversion: 2.1 time: 0.130579 Aug 07 01:42:39.036315 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2525/5523] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Aug 7 01:42:38 2022] GET /compute/v2.1/os-volumes/fb70bcb1-6ebc-46a6-8783-b153bc771b59 => generated 353 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:42:39.042438 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e36e282b-ad54-4756-9753-50fdb89fba4b tempest-VolumesGetTestJSON-1383182495 tempest-VolumesGetTestJSON-1383182495-project] Calling method '.version_select at 0x7f9e17af98b0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:39.159036 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e36e282b-ad54-4756-9753-50fdb89fba4b tempest-VolumesGetTestJSON-1383182495 tempest-VolumesGetTestJSON-1383182495-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/fb70bcb1-6ebc-46a6-8783-b153bc771b59" status: 200 len: 353 microversion: 2.1 time: 0.120184 Aug 07 01:42:39.160201 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 2999/5524] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Aug 7 01:42:39 2022] GET /compute/v2.1/os-volumes/fb70bcb1-6ebc-46a6-8783-b153bc771b59 => generated 353 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:42:39.175349 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3231014d-0c6d-4bf8-afdc-4090135600e1 tempest-VolumesGetTestJSON-1383182495 tempest-VolumesGetTestJSON-1383182495-project] Calling method '.version_select at 0x7f9e298000d0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:39.336810 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3231014d-0c6d-4bf8-afdc-4090135600e1 tempest-VolumesGetTestJSON-1383182495 tempest-VolumesGetTestJSON-1383182495-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/fb70bcb1-6ebc-46a6-8783-b153bc771b59" status: 202 len: 0 microversion: 2.1 time: 0.165817 Aug 07 01:42:39.337620 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2526/5525] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Aug 7 01:42:39 2022] DELETE /compute/v2.1/os-volumes/fb70bcb1-6ebc-46a6-8783-b153bc771b59 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:42:39.348339 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e80772cd-a634-40dc-a94f-f82027172211 tempest-VolumesGetTestJSON-1383182495 tempest-VolumesGetTestJSON-1383182495-project] Calling method '.version_select at 0x7f9e245b7430>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:39.457835 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e80772cd-a634-40dc-a94f-f82027172211 tempest-VolumesGetTestJSON-1383182495 tempest-VolumesGetTestJSON-1383182495-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/fb70bcb1-6ebc-46a6-8783-b153bc771b59" status: 200 len: 352 microversion: 2.1 time: 0.115901 Aug 07 01:42:39.458818 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3000/5526] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Aug 7 01:42:39 2022] GET /compute/v2.1/os-volumes/fb70bcb1-6ebc-46a6-8783-b153bc771b59 => generated 352 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:42:40.475476 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f653599a-5d5e-418b-adcb-bf1e34cae325 tempest-VolumesGetTestJSON-1383182495 tempest-VolumesGetTestJSON-1383182495-project] Calling method '.version_select at 0x7f9e29a5a550>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:40.677184 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f653599a-5d5e-418b-adcb-bf1e34cae325 tempest-VolumesGetTestJSON-1383182495 tempest-VolumesGetTestJSON-1383182495-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/fb70bcb1-6ebc-46a6-8783-b153bc771b59" status: 200 len: 352 microversion: 2.1 time: 0.208150 Aug 07 01:42:40.678127 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2527/5527] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Aug 7 01:42:40 2022] GET /compute/v2.1/os-volumes/fb70bcb1-6ebc-46a6-8783-b153bc771b59 => generated 352 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:42:41.276259 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d089a080-13a8-45fa-91d7-e7858de39798 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:41.279464 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d089a080-13a8-45fa-91d7-e7858de39798 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: a6704b77-3a73-4dc8-85af-8eb60c16899a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:42:41.307442 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d089a080-13a8-45fa-91d7-e7858de39798 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:41.309395 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d089a080-13a8-45fa-91d7-e7858de39798 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:41.312863 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d089a080-13a8-45fa-91d7-e7858de39798 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:41.314105 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d089a080-13a8-45fa-91d7-e7858de39798 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:41.316919 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d089a080-13a8-45fa-91d7-e7858de39798 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:41.317583 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d089a080-13a8-45fa-91d7-e7858de39798 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:41.404428 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d089a080-13a8-45fa-91d7-e7858de39798 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132681 Aug 07 01:42:41.406670 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3001/5528] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:42:41 2022] GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:42:41.420849 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d7d751c1-850f-4f6c-a42e-6bde1011a50b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:41.421536 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d7d751c1-850f-4f6c-a42e-6bde1011a50b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: a6704b77-3a73-4dc8-85af-8eb60c16899a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:42:41.450690 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7d751c1-850f-4f6c-a42e-6bde1011a50b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:41.454360 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7d751c1-850f-4f6c-a42e-6bde1011a50b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:41.458995 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7d751c1-850f-4f6c-a42e-6bde1011a50b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:41.468363 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7d751c1-850f-4f6c-a42e-6bde1011a50b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:41.469343 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7d751c1-850f-4f6c-a42e-6bde1011a50b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:41.470774 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7d751c1-850f-4f6c-a42e-6bde1011a50b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:41.591966 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d7d751c1-850f-4f6c-a42e-6bde1011a50b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a/os-volume_attachments/7f634ebb-5a4a-4b92-99a6-314a3fd9e9a0" status: 200 len: 194 microversion: 2.1 time: 0.178257 Aug 07 01:42:41.597533 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2528/5529] 10.222.0.39 () {58 vars in 1413 bytes} [Sun Aug 7 01:42:41 2022] GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a/os-volume_attachments/7f634ebb-5a4a-4b92-99a6-314a3fd9e9a0 => generated 194 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:42:41.692212 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-92b80456-a93a-4040-b39d-d486c215dcca tempest-VolumesGetTestJSON-1383182495 tempest-VolumesGetTestJSON-1383182495-project] Calling method '.version_select at 0x7f9e248828b0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:41.987049 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-92b80456-a93a-4040-b39d-d486c215dcca tempest-VolumesGetTestJSON-1383182495 tempest-VolumesGetTestJSON-1383182495-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/fb70bcb1-6ebc-46a6-8783-b153bc771b59" status: 200 len: 352 microversion: 2.1 time: 0.299746 Aug 07 01:42:41.994526 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3002/5530] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Aug 7 01:42:41 2022] GET /compute/v2.1/os-volumes/fb70bcb1-6ebc-46a6-8783-b153bc771b59 => generated 352 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:42:43.001429 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-df8c516a-8081-4c0f-9afe-56c1fd0e98ba tempest-VolumesGetTestJSON-1383182495 tempest-VolumesGetTestJSON-1383182495-project] Calling method '.version_select at 0x7f9e17e653a0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:43.217441 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-21d58ded-323f-4598-acd4-651235bd18d6 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1215690239", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "08810d8a-fb14-4a0f-830d-3622891f038f", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1383916573", "security_groups": [{"name": "tempest-secgroup-smoke-1537630263"}], "networks": [{"uuid": "9a43abec-df1f-499d-a30b-9d154a4b67cb"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:42:43.224539 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-df8c516a-8081-4c0f-9afe-56c1fd0e98ba tempest-VolumesGetTestJSON-1383182495 tempest-VolumesGetTestJSON-1383182495-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/fb70bcb1-6ebc-46a6-8783-b153bc771b59" status: 200 len: 352 microversion: 2.1 time: 0.227024 Aug 07 01:42:43.225323 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2529/5531] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Aug 7 01:42:42 2022] GET /compute/v2.1/os-volumes/fb70bcb1-6ebc-46a6-8783-b153bc771b59 => generated 352 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:42:44.242142 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-36b0bbcb-01e1-47a8-8c59-6c1bd7e6a879 tempest-VolumesGetTestJSON-1383182495 tempest-VolumesGetTestJSON-1383182495-project] Calling method '.version_select at 0x7f9e297fc940>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:44.368876 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-36b0bbcb-01e1-47a8-8c59-6c1bd7e6a879 tempest-VolumesGetTestJSON-1383182495 tempest-VolumesGetTestJSON-1383182495-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/fb70bcb1-6ebc-46a6-8783-b153bc771b59" status: 200 len: 352 microversion: 2.1 time: 0.131876 Aug 07 01:42:44.369785 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2530/5532] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Aug 7 01:42:44 2022] GET /compute/v2.1/os-volumes/fb70bcb1-6ebc-46a6-8783-b153bc771b59 => generated 352 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:42:44.531194 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-21d58ded-323f-4598-acd4-651235bd18d6 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] validate_networks() for [('9a43abec-df1f-499d-a30b-9d154a4b67cb', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:42:45.384639 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-840baf14-b1b3-4082-b9f2-a0e379249908 tempest-VolumesGetTestJSON-1383182495 tempest-VolumesGetTestJSON-1383182495-project] Calling method '.version_select at 0x7f9e240ffaf0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:45.452612 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-840baf14-b1b3-4082-b9f2-a0e379249908 tempest-VolumesGetTestJSON-1383182495 tempest-VolumesGetTestJSON-1383182495-project] HTTP exception thrown: Volume fb70bcb1-6ebc-46a6-8783-b153bc771b59 could not be found. Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-840baf14-b1b3-4082-b9f2-a0e379249908 tempest-VolumesGetTestJSON-1383182495 tempest-VolumesGetTestJSON-1383182495-project] Request method failure captured: Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/os-volumes/fb70bcb1-6ebc-46a6-8783-b153bc771b59 HTTP/1.1 Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xiMFrV11Vm8dtxKDQ4CrZv4vnJ6ng7lKwuADI9P45ZBkIADu_MU2XIOW664Kjkk3bcPeBXiD-JsNhKgY5bqMLYC53DDfKZKQpboWOy2loRHMR0OCrNdyDS40zYGAW49zMl7d1u6V8CpZYLqNeQ9jIl7AAAFKBEUygSQGF0EnzocP2g Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 344ac056616e401ea468c643140ad6dd Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-VolumesGetTestJSON-1383182495 Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/344ac056616e401ea468c643140ad6dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_344ac056616e401ea468c643140ad6dd", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/344ac056616e401ea468c643140ad6dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/344ac056616e401ea468c643140ad6dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-VolumesGetTestJSON-1383182495 Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 344ac056616e401ea468c643140ad6dd Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-VolumesGetTestJSON-1383182495 Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-VolumesGetTestJSON-1383182495-project Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 9fc871740d3543ec85bb04cedbefdd00 Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-VolumesGetTestJSON-1383182495-project Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: exception: Volume fb70bcb1-6ebc-46a6-8783-b153bc771b59 could not be found. Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'fb70bcb1-6ebc-46a6-8783-b153bc771b59'} Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fb70bcb1-6ebc-46a6-8783-b153bc771b59 could not be found. (HTTP 404) (Request-ID: req-82e2c5ea-80fc-4e46-8f28-5dcb3e66476e) Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 01:42:45.458967 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fb70bcb1-6ebc-46a6-8783-b153bc771b59 could not be found. Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fb70bcb1-6ebc-46a6-8783-b153bc771b59 could not be found. Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fb70bcb1-6ebc-46a6-8783-b153bc771b59 could not be found. Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-840baf14-b1b3-4082-b9f2-a0e379249908 tempest-VolumesGetTestJSON-1383182495 tempest-VolumesGetTestJSON-1383182495-project] Returning 404 to user: Volume fb70bcb1-6ebc-46a6-8783-b153bc771b59 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:42:45.463355 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-840baf14-b1b3-4082-b9f2-a0e379249908 tempest-VolumesGetTestJSON-1383182495 tempest-VolumesGetTestJSON-1383182495-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/fb70bcb1-6ebc-46a6-8783-b153bc771b59" status: 404 len: 109 microversion: 2.1 time: 0.082732 Aug 07 01:42:45.479983 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2531/5533] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Aug 7 01:42:45 2022] GET /compute/v2.1/os-volumes/fb70bcb1-6ebc-46a6-8783-b153bc771b59 => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:42:45.959421 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-189a5cee-715e-42a1-a21e-a330c15eec7a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ccb3f4b3-0c7e-4b14-ba5d-e63ff2957c0d"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:42:45.962472 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-189a5cee-715e-42a1-a21e-a330c15eec7a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: a6704b77-3a73-4dc8-85af-8eb60c16899a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:42:45.979095 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-189a5cee-715e-42a1-a21e-a330c15eec7a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:45.987753 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-189a5cee-715e-42a1-a21e-a330c15eec7a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:45.988503 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-189a5cee-715e-42a1-a21e-a330c15eec7a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:45.988994 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-189a5cee-715e-42a1-a21e-a330c15eec7a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:45.989468 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-189a5cee-715e-42a1-a21e-a330c15eec7a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:45.989908 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-189a5cee-715e-42a1-a21e-a330c15eec7a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:46.571217 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-189a5cee-715e-42a1-a21e-a330c15eec7a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "POST /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.614346 Aug 07 01:42:46.575080 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2532/5534] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Aug 7 01:42:45 2022] POST /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a/os-volume_attachments => generated 194 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:42:47.580540 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-21d58ded-323f-4598-acd4-651235bd18d6 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:42:47.581090 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-21d58ded-323f-4598-acd4-651235bd18d6 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:42:47.581706 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-21d58ded-323f-4598-acd4-651235bd18d6 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:42:47.582231 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-21d58ded-323f-4598-acd4-651235bd18d6 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:42:47.582756 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-21d58ded-323f-4598-acd4-651235bd18d6 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:42:47.604257 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21d58ded-323f-4598-acd4-651235bd18d6 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:47.608857 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21d58ded-323f-4598-acd4-651235bd18d6 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:47.609453 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21d58ded-323f-4598-acd4-651235bd18d6 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:47.610394 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21d58ded-323f-4598-acd4-651235bd18d6 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:47.610978 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21d58ded-323f-4598-acd4-651235bd18d6 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:47.614924 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21d58ded-323f-4598-acd4-651235bd18d6 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:47.683850 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-21d58ded-323f-4598-acd4-651235bd18d6 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Getting quotas for project 3139e77141f84e2485d2ba5d305f4ec7. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:42:47.703788 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-21d58ded-323f-4598-acd4-651235bd18d6 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Getting quotas for user 68324eedf5c840f4806f4c4ae410774f and project 3139e77141f84e2485d2ba5d305f4ec7. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:42:47.945814 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-21d58ded-323f-4598-acd4-651235bd18d6 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:42:47.945814 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-21d58ded-323f-4598-acd4-651235bd18d6 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] [instance: a4d9c0ea-c890-4629-929b-29c720603db9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='08810d8a-fb14-4a0f-830d-3622891f038f',volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:42:48.300509 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-21d58ded-323f-4598-acd4-651235bd18d6 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 5.090104 Aug 07 01:42:48.318749 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3003/5535] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:42:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 5109 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:42:48.325247 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e58ae8c8-aead-4f53-bb0a-5931a3efaf69 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:48.325964 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e58ae8c8-aead-4f53-bb0a-5931a3efaf69 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] [instance: a4d9c0ea-c890-4629-929b-29c720603db9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:42:48.640159 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e58ae8c8-aead-4f53-bb0a-5931a3efaf69 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68324eedf5c840f4806f4c4ae410774f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3139e77141f84e2485d2ba5d305f4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:48.656923 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e58ae8c8-aead-4f53-bb0a-5931a3efaf69 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] 10.222.0.39 "GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9" status: 200 len: 1099 microversion: 2.1 time: 0.336704 Aug 07 01:42:48.658814 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2533/5536] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:42:48 2022] GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9 => generated 1099 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:42:49.681767 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f57229b8-cc7d-409c-9b5f-cc5b56da4e0c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:49.683664 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f57229b8-cc7d-409c-9b5f-cc5b56da4e0c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] [instance: a4d9c0ea-c890-4629-929b-29c720603db9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:42:49.720721 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f57229b8-cc7d-409c-9b5f-cc5b56da4e0c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:49.726927 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f57229b8-cc7d-409c-9b5f-cc5b56da4e0c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:49.727563 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f57229b8-cc7d-409c-9b5f-cc5b56da4e0c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:49.728379 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f57229b8-cc7d-409c-9b5f-cc5b56da4e0c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:49.728921 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f57229b8-cc7d-409c-9b5f-cc5b56da4e0c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:49.729289 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f57229b8-cc7d-409c-9b5f-cc5b56da4e0c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:50.002826 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f57229b8-cc7d-409c-9b5f-cc5b56da4e0c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68324eedf5c840f4806f4c4ae410774f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3139e77141f84e2485d2ba5d305f4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:50.031819 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f57229b8-cc7d-409c-9b5f-cc5b56da4e0c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] 10.222.0.39 "GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9" status: 200 len: 1141 microversion: 2.1 time: 0.355660 Aug 07 01:42:50.034867 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3004/5537] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:42:49 2022] GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9 => generated 1141 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:42:50.445211 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-45f86165-5602-48ca-af99-8fce95b861dc tempest-VolumesNegativeTest-592662859 tempest-VolumesNegativeTest-592662859-project] Action: 'create', calling method: .version_select at 0x7f9e297fcee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-619924408", "metadata": {"Type": "work"}}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-45f86165-5602-48ca-af99-8fce95b861dc tempest-VolumesNegativeTest-592662859 tempest-VolumesNegativeTest-592662859-project] Request method failure captured: Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 121 Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xiZytdNhZzmye61ZFpagAE0LOFx5vqzkg6g5BW-QSEd5OJ8YXirMqe3yFppdgzqs5Zw8KWEWsqsRGmJ5vtGg8IZUCz3J4_9YYNGNrHUCN91ZvcJI8aIN70Ie0R1KE8NFMDsb8-zEyPS8l9SrxRj-b4h8BXm2-AZPsZYKJ1EqcWDJdg Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 11a1f9e4b922401aa96de5155bd7be99 Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-VolumesNegativeTest-592662859 Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/11a1f9e4b922401aa96de5155bd7be99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_11a1f9e4b922401aa96de5155bd7be99", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/11a1f9e4b922401aa96de5155bd7be99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/11a1f9e4b922401aa96de5155bd7be99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-VolumesNegativeTest-592662859 Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 11a1f9e4b922401aa96de5155bd7be99 Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-VolumesNegativeTest-592662859 Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-VolumesNegativeTest-592662859-project Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 37e91addb101485c9a80de707baf44ad Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-VolumesNegativeTest-592662859-project Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-619924408", "metadata": {"Type": "work"}}} Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-619924408', 'metadata': {'Type': 'work'}}}} Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi '#$%' Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:42:50.453372 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:42:50.459850 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 07 01:42:50.459850 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:42:50.459850 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:42:50.459850 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:42:50.459850 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:42:50.459850 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:42:50.459850 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:42:50.459850 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:42:50.459850 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:42:50.459850 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 07 01:42:50.459850 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:42:50.459850 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-45f86165-5602-48ca-af99-8fce95b861dc tempest-VolumesNegativeTest-592662859 tempest-VolumesNegativeTest-592662859-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:42:50.459850 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-45f86165-5602-48ca-af99-8fce95b861dc tempest-VolumesNegativeTest-592662859 tempest-VolumesNegativeTest-592662859-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.342883 Aug 07 01:42:50.459850 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2534/5538] 10.222.0.39 () {60 vars in 1156 bytes} [Sun Aug 7 01:42:50 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 345 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:42:50.466448 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-87942759-5826-4c9c-93fe-f723b6c06c7a tempest-VolumesNegativeTest-592662859 tempest-VolumesNegativeTest-592662859-project] Action: 'create', calling method: .version_select at 0x7f9e174f5d30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1687565085", "metadata": {"Type": "work"}}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-87942759-5826-4c9c-93fe-f723b6c06c7a tempest-VolumesNegativeTest-592662859 tempest-VolumesNegativeTest-592662859-project] Request method failure captured: Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 120 Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xiZytdNhZzmye61ZFpagAE0LOFx5vqzkg6g5BW-QSEd5OJ8YXirMqe3yFppdgzqs5Zw8KWEWsqsRGmJ5vtGg8IZUCz3J4_9YYNGNrHUCN91ZvcJI8aIN70Ie0R1KE8NFMDsb8-zEyPS8l9SrxRj-b4h8BXm2-AZPsZYKJ1EqcWDJdg Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 11a1f9e4b922401aa96de5155bd7be99 Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-VolumesNegativeTest-592662859 Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/11a1f9e4b922401aa96de5155bd7be99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_11a1f9e4b922401aa96de5155bd7be99", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/11a1f9e4b922401aa96de5155bd7be99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/11a1f9e4b922401aa96de5155bd7be99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-VolumesNegativeTest-592662859 Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 11a1f9e4b922401aa96de5155bd7be99 Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-VolumesNegativeTest-592662859 Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-VolumesNegativeTest-592662859-project Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 37e91addb101485c9a80de707baf44ad Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-VolumesNegativeTest-592662859-project Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1687565085", "metadata": {"Type": "work"}}} Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1687565085', 'metadata': {'Type': 'work'}}}} Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi '0' Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:42:50.473205 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:42:50.477506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 07 01:42:50.477506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:42:50.477506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:42:50.477506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:42:50.477506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:42:50.477506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:42:50.477506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:42:50.477506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:42:50.477506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:42:50.477506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 07 01:42:50.477506 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:42:50.477506 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-87942759-5826-4c9c-93fe-f723b6c06c7a tempest-VolumesNegativeTest-592662859 tempest-VolumesNegativeTest-592662859-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:42:50.479040 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-87942759-5826-4c9c-93fe-f723b6c06c7a tempest-VolumesNegativeTest-592662859 tempest-VolumesNegativeTest-592662859-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016722 Aug 07 01:42:50.480584 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3005/5539] 10.222.0.39 () {60 vars in 1156 bytes} [Sun Aug 7 01:42:50 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:42:50.492710 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e5a062f7-f61f-4e1e-97c5-fb211ca66824 tempest-VolumesNegativeTest-592662859 tempest-VolumesNegativeTest-592662859-project] Action: 'create', calling method: .version_select at 0x7f9e24ca8f70>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-539186223", "metadata": {"Type": "work"}}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e5a062f7-f61f-4e1e-97c5-fb211ca66824 tempest-VolumesNegativeTest-592662859 tempest-VolumesNegativeTest-592662859-project] Request method failure captured: Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 118 Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xiZytdNhZzmye61ZFpagAE0LOFx5vqzkg6g5BW-QSEd5OJ8YXirMqe3yFppdgzqs5Zw8KWEWsqsRGmJ5vtGg8IZUCz3J4_9YYNGNrHUCN91ZvcJI8aIN70Ie0R1KE8NFMDsb8-zEyPS8l9SrxRj-b4h8BXm2-AZPsZYKJ1EqcWDJdg Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 11a1f9e4b922401aa96de5155bd7be99 Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-VolumesNegativeTest-592662859 Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/11a1f9e4b922401aa96de5155bd7be99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_11a1f9e4b922401aa96de5155bd7be99", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/11a1f9e4b922401aa96de5155bd7be99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/11a1f9e4b922401aa96de5155bd7be99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-VolumesNegativeTest-592662859 Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 11a1f9e4b922401aa96de5155bd7be99 Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-VolumesNegativeTest-592662859 Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-VolumesNegativeTest-592662859-project Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 37e91addb101485c9a80de707baf44ad Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-VolumesNegativeTest-592662859-project Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-539186223", "metadata": {"Type": "work"}}} Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-539186223', 'metadata': {'Type': 'work'}}}} Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise error Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi '' Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 01:42:50.504923 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 01:42:50.509595 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 07 01:42:50.509595 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:42:50.509595 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:42:50.509595 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:42:50.509595 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:42:50.509595 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:42:50.509595 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:42:50.509595 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 01:42:50.509595 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 01:42:50.509595 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 07 01:42:50.509595 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:42:50.512091 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e5a062f7-f61f-4e1e-97c5-fb211ca66824 tempest-VolumesNegativeTest-592662859 tempest-VolumesNegativeTest-592662859-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:42:50.516777 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e5a062f7-f61f-4e1e-97c5-fb211ca66824 tempest-VolumesNegativeTest-592662859 tempest-VolumesNegativeTest-592662859-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.031582 Aug 07 01:42:50.518642 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2535/5540] 10.222.0.39 () {60 vars in 1156 bytes} [Sun Aug 7 01:42:50 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 01:42:50.527414 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c54d8838-2d8a-4117-89de-476767eddd7e tempest-VolumesNegativeTest-592662859 tempest-VolumesNegativeTest-592662859-project] Calling method '.version_select at 0x7f9e17ac0700>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:50.609233 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-c54d8838-2d8a-4117-89de-476767eddd7e tempest-VolumesNegativeTest-592662859 tempest-VolumesNegativeTest-592662859-project] HTTP exception thrown: Volume tempest-invalid-957639234 could not be found. Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c54d8838-2d8a-4117-89de-476767eddd7e tempest-VolumesNegativeTest-592662859 tempest-VolumesNegativeTest-592662859-project] Request method failure captured: Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-957639234 HTTP/1.1 Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xiZytdNhZzmye61ZFpagAE0LOFx5vqzkg6g5BW-QSEd5OJ8YXirMqe3yFppdgzqs5Zw8KWEWsqsRGmJ5vtGg8IZUCz3J4_9YYNGNrHUCN91ZvcJI8aIN70Ie0R1KE8NFMDsb8-zEyPS8l9SrxRj-b4h8BXm2-AZPsZYKJ1EqcWDJdg Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 11a1f9e4b922401aa96de5155bd7be99 Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-VolumesNegativeTest-592662859 Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/11a1f9e4b922401aa96de5155bd7be99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_11a1f9e4b922401aa96de5155bd7be99", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/11a1f9e4b922401aa96de5155bd7be99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/11a1f9e4b922401aa96de5155bd7be99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-VolumesNegativeTest-592662859 Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 11a1f9e4b922401aa96de5155bd7be99 Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-VolumesNegativeTest-592662859 Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-VolumesNegativeTest-592662859-project Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 37e91addb101485c9a80de707baf44ad Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-VolumesNegativeTest-592662859-project Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: exception: Volume tempest-invalid-957639234 could not be found. Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'tempest-invalid-957639234'} Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-957639234 could not be found. (HTTP 404) (Request-ID: req-f0c4fe09-9721-4f71-8209-fc928af66d7e) Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 01:42:50.612230 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 01:42:50.616226 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 07 01:42:50.616226 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 07 01:42:50.616226 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 07 01:42:50.616226 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 07 01:42:50.616226 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 07 01:42:50.616226 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 07 01:42:50.616226 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 07 01:42:50.616226 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 07 01:42:50.616226 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 01:42:50.616226 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 01:42:50.616226 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 01:42:50.616226 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 01:42:50.616226 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-957639234 could not be found. Aug 07 01:42:50.616226 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:42:50.616226 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:42:50.616226 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:42:50.616226 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:42:50.616226 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:42:50.616226 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:42:50.616226 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:42:50.616226 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:42:50.616226 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:42:50.616226 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:42:50.616226 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:42:50.616226 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:42:50.616226 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 07 01:42:50.616226 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:42:50.616226 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-957639234 could not be found. Aug 07 01:42:50.616226 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:42:50.616226 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:42:50.616226 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:42:50.616226 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:42:50.616226 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:42:50.616226 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:42:50.616226 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:42:50.616226 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:42:50.616226 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-957639234 could not be found. Aug 07 01:42:50.616226 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:42:50.621419 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c54d8838-2d8a-4117-89de-476767eddd7e tempest-VolumesNegativeTest-592662859 tempest-VolumesNegativeTest-592662859-project] Returning 404 to user: Volume tempest-invalid-957639234 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:42:50.622643 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c54d8838-2d8a-4117-89de-476767eddd7e tempest-VolumesNegativeTest-592662859 tempest-VolumesNegativeTest-592662859-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/tempest-invalid-957639234" status: 404 len: 98 microversion: 2.1 time: 0.099791 Aug 07 01:42:50.623457 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3006/5541] 10.222.0.39 () {58 vars in 1215 bytes} [Sun Aug 7 01:42:50 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-957639234 => generated 98 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 07 01:42:50.633831 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0ff28d57-c4e6-4e78-9b9e-bb549d5fc0d9 tempest-VolumesNegativeTest-592662859 tempest-VolumesNegativeTest-592662859-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004582 Aug 07 01:42:50.634999 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2536/5542] 10.222.0.39 () {58 vars in 1140 bytes} [Sun Aug 7 01:42:50 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 07 01:42:50.646990 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-857ed6ca-9126-4865-8546-297e4aa86592 tempest-VolumesNegativeTest-592662859 tempest-VolumesNegativeTest-592662859-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005134 Aug 07 01:42:50.648506 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3007/5543] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Aug 7 01:42:50 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 07 01:42:50.658701 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7c0102e3-3733-4700-a0a5-35888185a93e tempest-VolumesNegativeTest-592662859 tempest-VolumesNegativeTest-592662859-project] Calling method '.version_select at 0x7f9e242c8940>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:50.885632 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-7c0102e3-3733-4700-a0a5-35888185a93e tempest-VolumesNegativeTest-592662859 tempest-VolumesNegativeTest-592662859-project] HTTP exception thrown: Volume 7ced8f73-a745-4218-94ca-fe38685cfbe2 could not be found. Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7c0102e3-3733-4700-a0a5-35888185a93e tempest-VolumesNegativeTest-592662859 tempest-VolumesNegativeTest-592662859-project] Request method failure captured: Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/os-volumes/7ced8f73-a745-4218-94ca-fe38685cfbe2 HTTP/1.1 Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xiZytdNhZzmye61ZFpagAE0LOFx5vqzkg6g5BW-QSEd5OJ8YXirMqe3yFppdgzqs5Zw8KWEWsqsRGmJ5vtGg8IZUCz3J4_9YYNGNrHUCN91ZvcJI8aIN70Ie0R1KE8NFMDsb8-zEyPS8l9SrxRj-b4h8BXm2-AZPsZYKJ1EqcWDJdg Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 11a1f9e4b922401aa96de5155bd7be99 Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-VolumesNegativeTest-592662859 Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/11a1f9e4b922401aa96de5155bd7be99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_11a1f9e4b922401aa96de5155bd7be99", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/11a1f9e4b922401aa96de5155bd7be99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/11a1f9e4b922401aa96de5155bd7be99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-VolumesNegativeTest-592662859 Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 11a1f9e4b922401aa96de5155bd7be99 Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-VolumesNegativeTest-592662859 Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-VolumesNegativeTest-592662859-project Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 37e91addb101485c9a80de707baf44ad Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-VolumesNegativeTest-592662859-project Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: method: Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: exception: Volume 7ced8f73-a745-4218-94ca-fe38685cfbe2 could not be found. Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '7ced8f73-a745-4218-94ca-fe38685cfbe2'} Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7ced8f73-a745-4218-94ca-fe38685cfbe2 could not be found. (HTTP 404) (Request-ID: req-d4f33782-69aa-4204-8b22-caa94154dcd7) Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 01:42:50.893948 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7ced8f73-a745-4218-94ca-fe38685cfbe2 could not be found. Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7ced8f73-a745-4218-94ca-fe38685cfbe2 could not be found. Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7ced8f73-a745-4218-94ca-fe38685cfbe2 could not be found. Aug 07 01:42:50.898338 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:42:50.903038 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7c0102e3-3733-4700-a0a5-35888185a93e tempest-VolumesNegativeTest-592662859 tempest-VolumesNegativeTest-592662859-project] Returning 404 to user: Volume 7ced8f73-a745-4218-94ca-fe38685cfbe2 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:42:50.904081 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7c0102e3-3733-4700-a0a5-35888185a93e tempest-VolumesNegativeTest-592662859 tempest-VolumesNegativeTest-592662859-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/7ced8f73-a745-4218-94ca-fe38685cfbe2" status: 404 len: 109 microversion: 2.1 time: 0.250081 Aug 07 01:42:50.905590 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2537/5544] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Aug 7 01:42:50 2022] DELETE /compute/v2.1/os-volumes/7ced8f73-a745-4218-94ca-fe38685cfbe2 => generated 109 bytes in 252 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:42:50.917507 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d64addde-9034-44cf-836d-882279a653f7 tempest-VolumesNegativeTest-592662859 tempest-VolumesNegativeTest-592662859-project] Calling method '.version_select at 0x7f9e29969ee0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:51.081179 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-09d78f23-fd54-4ee8-ab3c-ae3b7e69b574 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:51.081932 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-09d78f23-fd54-4ee8-ab3c-ae3b7e69b574 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] [instance: a4d9c0ea-c890-4629-929b-29c720603db9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:42:51.102049 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-09d78f23-fd54-4ee8-ab3c-ae3b7e69b574 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:51.102598 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-09d78f23-fd54-4ee8-ab3c-ae3b7e69b574 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:51.103080 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-09d78f23-fd54-4ee8-ab3c-ae3b7e69b574 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:51.113305 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-09d78f23-fd54-4ee8-ab3c-ae3b7e69b574 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:51.114979 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-09d78f23-fd54-4ee8-ab3c-ae3b7e69b574 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:51.116358 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-09d78f23-fd54-4ee8-ab3c-ae3b7e69b574 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:51.376112 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-09d78f23-fd54-4ee8-ab3c-ae3b7e69b574 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68324eedf5c840f4806f4c4ae410774f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3139e77141f84e2485d2ba5d305f4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:51.411841 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-09d78f23-fd54-4ee8-ab3c-ae3b7e69b574 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] 10.222.0.39 "GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9" status: 200 len: 1215 microversion: 2.1 time: 0.346298 Aug 07 01:42:51.433820 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2538/5545] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:42:51 2022] GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9 => generated 1215 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:42:52.441160 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7fd3e746-35ef-449b-849a-110edc13514c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:52.442447 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7fd3e746-35ef-449b-849a-110edc13514c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] [instance: a4d9c0ea-c890-4629-929b-29c720603db9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:42:52.459855 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7fd3e746-35ef-449b-849a-110edc13514c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:52.461253 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7fd3e746-35ef-449b-849a-110edc13514c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:52.462060 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7fd3e746-35ef-449b-849a-110edc13514c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:52.464788 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7fd3e746-35ef-449b-849a-110edc13514c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:52.465744 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7fd3e746-35ef-449b-849a-110edc13514c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:52.470034 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7fd3e746-35ef-449b-849a-110edc13514c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:53.125592 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7fd3e746-35ef-449b-849a-110edc13514c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68324eedf5c840f4806f4c4ae410774f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3139e77141f84e2485d2ba5d305f4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:53.134619 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7fd3e746-35ef-449b-849a-110edc13514c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] 10.222.0.39 "GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9" status: 200 len: 1215 microversion: 2.1 time: 0.694729 Aug 07 01:42:53.153632 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2539/5546] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:42:52 2022] GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9 => generated 1215 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:42:54.160491 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-34ddc48b-d6e1-46b7-aae2-86a016eae2f9 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:54.162104 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-34ddc48b-d6e1-46b7-aae2-86a016eae2f9 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] [instance: a4d9c0ea-c890-4629-929b-29c720603db9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:42:54.176324 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-34ddc48b-d6e1-46b7-aae2-86a016eae2f9 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:54.179041 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-34ddc48b-d6e1-46b7-aae2-86a016eae2f9 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:54.180699 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-34ddc48b-d6e1-46b7-aae2-86a016eae2f9 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:54.183646 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-34ddc48b-d6e1-46b7-aae2-86a016eae2f9 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:54.185474 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-34ddc48b-d6e1-46b7-aae2-86a016eae2f9 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:54.188645 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-34ddc48b-d6e1-46b7-aae2-86a016eae2f9 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:54.688860 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-34ddc48b-d6e1-46b7-aae2-86a016eae2f9 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68324eedf5c840f4806f4c4ae410774f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3139e77141f84e2485d2ba5d305f4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:54.708141 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-34ddc48b-d6e1-46b7-aae2-86a016eae2f9 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] 10.222.0.39 "GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9" status: 200 len: 1283 microversion: 2.1 time: 0.551383 Aug 07 01:42:54.711219 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2540/5547] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:42:54 2022] GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9 => generated 1283 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:42:55.738729 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b72b161c-01bc-46a6-b13e-e907dde3e245 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:55.739378 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b72b161c-01bc-46a6-b13e-e907dde3e245 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] [instance: a4d9c0ea-c890-4629-929b-29c720603db9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:42:55.756002 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b72b161c-01bc-46a6-b13e-e907dde3e245 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:55.759422 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b72b161c-01bc-46a6-b13e-e907dde3e245 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:55.760125 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b72b161c-01bc-46a6-b13e-e907dde3e245 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:55.761043 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b72b161c-01bc-46a6-b13e-e907dde3e245 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:55.762875 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b72b161c-01bc-46a6-b13e-e907dde3e245 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:55.763492 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b72b161c-01bc-46a6-b13e-e907dde3e245 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:56.207134 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b72b161c-01bc-46a6-b13e-e907dde3e245 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68324eedf5c840f4806f4c4ae410774f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3139e77141f84e2485d2ba5d305f4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:56.222473 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b72b161c-01bc-46a6-b13e-e907dde3e245 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] 10.222.0.39 "GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9" status: 200 len: 1283 microversion: 2.1 time: 0.489033 Aug 07 01:42:56.224054 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2541/5548] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:42:55 2022] GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9 => generated 1283 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:42:56.705647 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-8b60dea2-81a5-4841-a89f-cfde74800aba req-6753ebe2-11dd-4459-a93e-9a5d1a297484 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4d9c0ea-c890-4629-929b-29c720603db9", "tag": "64cd98dc-f0a6-48bf-8d28-c436245cd37a"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:42:56.724471 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-8b60dea2-81a5-4841-a89f-cfde74800aba req-6753ebe2-11dd-4459-a93e-9a5d1a297484 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:56.728183 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-8b60dea2-81a5-4841-a89f-cfde74800aba req-6753ebe2-11dd-4459-a93e-9a5d1a297484 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:56.729081 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-8b60dea2-81a5-4841-a89f-cfde74800aba req-6753ebe2-11dd-4459-a93e-9a5d1a297484 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:56.786677 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-8b60dea2-81a5-4841-a89f-cfde74800aba req-6753ebe2-11dd-4459-a93e-9a5d1a297484 service nova] Creating event network-changed:64cd98dc-f0a6-48bf-8d28-c436245cd37a for instance a4d9c0ea-c890-4629-929b-29c720603db9 on n-h1-master-1 Aug 07 01:42:56.801502 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-8b60dea2-81a5-4841-a89f-cfde74800aba req-6753ebe2-11dd-4459-a93e-9a5d1a297484 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099057 Aug 07 01:42:56.804365 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2542/5549] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:42:57.244908 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-253d0321-26ba-45bf-a463-875ffd79af2a tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:57.245771 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-253d0321-26ba-45bf-a463-875ffd79af2a tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] [instance: a4d9c0ea-c890-4629-929b-29c720603db9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:42:57.259024 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-253d0321-26ba-45bf-a463-875ffd79af2a tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:57.261128 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-253d0321-26ba-45bf-a463-875ffd79af2a tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:57.261681 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-253d0321-26ba-45bf-a463-875ffd79af2a tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:57.265346 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-253d0321-26ba-45bf-a463-875ffd79af2a tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:57.265951 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-253d0321-26ba-45bf-a463-875ffd79af2a tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:57.266693 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-253d0321-26ba-45bf-a463-875ffd79af2a tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:57.599584 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-253d0321-26ba-45bf-a463-875ffd79af2a tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68324eedf5c840f4806f4c4ae410774f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3139e77141f84e2485d2ba5d305f4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:57.613436 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-253d0321-26ba-45bf-a463-875ffd79af2a tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] 10.222.0.39 "GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9" status: 200 len: 1283 microversion: 2.1 time: 0.372749 Aug 07 01:42:57.619914 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2543/5550] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:42:57 2022] GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9 => generated 1283 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:42:57.653391 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:57.726722 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=10 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:58.636710 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f32645c8-cf0a-4a16-8c3a-476734e32b8f tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:42:58.637335 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f32645c8-cf0a-4a16-8c3a-476734e32b8f tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] [instance: a4d9c0ea-c890-4629-929b-29c720603db9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:42:58.652621 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f32645c8-cf0a-4a16-8c3a-476734e32b8f tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:58.653119 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f32645c8-cf0a-4a16-8c3a-476734e32b8f tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:58.653560 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f32645c8-cf0a-4a16-8c3a-476734e32b8f tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:58.654821 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f32645c8-cf0a-4a16-8c3a-476734e32b8f tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:42:58.655282 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f32645c8-cf0a-4a16-8c3a-476734e32b8f tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:42:58.655711 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f32645c8-cf0a-4a16-8c3a-476734e32b8f tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:42:58.656320 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:59.045119 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f32645c8-cf0a-4a16-8c3a-476734e32b8f tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68324eedf5c840f4806f4c4ae410774f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3139e77141f84e2485d2ba5d305f4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:42:59.077697 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f32645c8-cf0a-4a16-8c3a-476734e32b8f tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] 10.222.0.39 "GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9" status: 200 len: 1283 microversion: 2.1 time: 0.441283 Aug 07 01:42:59.083286 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2544/5551] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:42:58 2022] GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9 => generated 1283 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:42:59.688840 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=4 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:00.023452 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=14 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:00.123022 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-335fa825-3143-400a-ade0-5bd76edb24c0 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:43:00.123867 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-335fa825-3143-400a-ade0-5bd76edb24c0 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] [instance: a4d9c0ea-c890-4629-929b-29c720603db9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:43:00.136462 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-335fa825-3143-400a-ade0-5bd76edb24c0 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:00.140810 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-335fa825-3143-400a-ade0-5bd76edb24c0 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:00.141406 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-335fa825-3143-400a-ade0-5bd76edb24c0 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:00.144843 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-335fa825-3143-400a-ade0-5bd76edb24c0 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:00.145502 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-335fa825-3143-400a-ade0-5bd76edb24c0 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:00.146042 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-335fa825-3143-400a-ade0-5bd76edb24c0 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:00.521951 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-335fa825-3143-400a-ade0-5bd76edb24c0 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68324eedf5c840f4806f4c4ae410774f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3139e77141f84e2485d2ba5d305f4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:43:00.535708 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-335fa825-3143-400a-ade0-5bd76edb24c0 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] 10.222.0.39 "GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9" status: 200 len: 1283 microversion: 2.1 time: 0.417437 Aug 07 01:43:00.536805 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2545/5552] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:43:00 2022] GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9 => generated 1283 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:43:01.556970 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-05841ea9-874c-4820-a203-0809d2747cca tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:43:01.557606 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-05841ea9-874c-4820-a203-0809d2747cca tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] [instance: a4d9c0ea-c890-4629-929b-29c720603db9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:43:01.564880 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05841ea9-874c-4820-a203-0809d2747cca tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:01.565624 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05841ea9-874c-4820-a203-0809d2747cca tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:01.566221 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05841ea9-874c-4820-a203-0809d2747cca tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:01.566957 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05841ea9-874c-4820-a203-0809d2747cca tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:01.567410 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05841ea9-874c-4820-a203-0809d2747cca tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:01.568040 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05841ea9-874c-4820-a203-0809d2747cca tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:01.750367 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-d64addde-9034-44cf-836d-882279a653f7 tempest-VolumesNegativeTest-592662859 tempest-VolumesNegativeTest-592662859-project] HTTP exception thrown: Volume 7be94674-588e-449b-874a-02d7860d21aa could not be found. Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d64addde-9034-44cf-836d-882279a653f7 tempest-VolumesNegativeTest-592662859 tempest-VolumesNegativeTest-592662859-project] Request method failure captured: Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/os-volumes/7be94674-588e-449b-874a-02d7860d21aa HTTP/1.1 Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xiZytdNhZzmye61ZFpagAE0LOFx5vqzkg6g5BW-QSEd5OJ8YXirMqe3yFppdgzqs5Zw8KWEWsqsRGmJ5vtGg8IZUCz3J4_9YYNGNrHUCN91ZvcJI8aIN70Ie0R1KE8NFMDsb8-zEyPS8l9SrxRj-b4h8BXm2-AZPsZYKJ1EqcWDJdg Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 11a1f9e4b922401aa96de5155bd7be99 Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-VolumesNegativeTest-592662859 Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/11a1f9e4b922401aa96de5155bd7be99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_11a1f9e4b922401aa96de5155bd7be99", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/11a1f9e4b922401aa96de5155bd7be99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/11a1f9e4b922401aa96de5155bd7be99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-VolumesNegativeTest-592662859 Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 11a1f9e4b922401aa96de5155bd7be99 Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-VolumesNegativeTest-592662859 Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-VolumesNegativeTest-592662859-project Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 37e91addb101485c9a80de707baf44ad Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-VolumesNegativeTest-592662859-project Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: method: Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: exception: Volume 7be94674-588e-449b-874a-02d7860d21aa could not be found. Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '7be94674-588e-449b-874a-02d7860d21aa'} Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7be94674-588e-449b-874a-02d7860d21aa could not be found. (HTTP 404) (Request-ID: req-d8bbd3c9-e860-43dd-872b-b7266fabe991) Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 01:43:01.752374 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7be94674-588e-449b-874a-02d7860d21aa could not be found. Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7be94674-588e-449b-874a-02d7860d21aa could not be found. Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7be94674-588e-449b-874a-02d7860d21aa could not be found. Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d64addde-9034-44cf-836d-882279a653f7 tempest-VolumesNegativeTest-592662859 tempest-VolumesNegativeTest-592662859-project] Returning 404 to user: Volume 7be94674-588e-449b-874a-02d7860d21aa could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d64addde-9034-44cf-836d-882279a653f7 tempest-VolumesNegativeTest-592662859 tempest-VolumesNegativeTest-592662859-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/7be94674-588e-449b-874a-02d7860d21aa" status: 404 len: 109 microversion: 2.1 time: 10.842253 Aug 07 01:43:01.757522 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3008/5553] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Aug 7 01:42:50 2022] GET /compute/v2.1/os-volumes/7be94674-588e-449b-874a-02d7860d21aa => generated 109 bytes in 10844 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:43:01.961797 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-05841ea9-874c-4820-a203-0809d2747cca tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68324eedf5c840f4806f4c4ae410774f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3139e77141f84e2485d2ba5d305f4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:43:01.993393 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-05841ea9-874c-4820-a203-0809d2747cca tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] 10.222.0.39 "GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9" status: 200 len: 1283 microversion: 2.1 time: 0.439944 Aug 07 01:43:02.012901 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2546/5554] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:43:01 2022] GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9 => generated 1283 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:43:03.017960 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b19a7ec8-40fa-4d94-8d11-15a0291d294b tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:43:03.018605 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b19a7ec8-40fa-4d94-8d11-15a0291d294b tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] [instance: a4d9c0ea-c890-4629-929b-29c720603db9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:43:03.031080 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b19a7ec8-40fa-4d94-8d11-15a0291d294b tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:03.031634 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b19a7ec8-40fa-4d94-8d11-15a0291d294b tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:03.040746 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b19a7ec8-40fa-4d94-8d11-15a0291d294b tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:03.041593 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b19a7ec8-40fa-4d94-8d11-15a0291d294b tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:03.042140 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b19a7ec8-40fa-4d94-8d11-15a0291d294b tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:03.042633 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b19a7ec8-40fa-4d94-8d11-15a0291d294b tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:03.338296 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b19a7ec8-40fa-4d94-8d11-15a0291d294b tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68324eedf5c840f4806f4c4ae410774f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3139e77141f84e2485d2ba5d305f4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:43:03.352043 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b19a7ec8-40fa-4d94-8d11-15a0291d294b tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] 10.222.0.39 "GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9" status: 200 len: 1283 microversion: 2.1 time: 0.335787 Aug 07 01:43:03.355357 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3009/5555] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:43:03 2022] GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9 => generated 1283 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:43:04.378694 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5deb0aa7-3d5c-4171-a04c-b2381b83280c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:43:04.380254 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5deb0aa7-3d5c-4171-a04c-b2381b83280c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] [instance: a4d9c0ea-c890-4629-929b-29c720603db9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:43:04.398319 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5deb0aa7-3d5c-4171-a04c-b2381b83280c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:04.399089 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5deb0aa7-3d5c-4171-a04c-b2381b83280c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:04.400102 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5deb0aa7-3d5c-4171-a04c-b2381b83280c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:04.401191 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5deb0aa7-3d5c-4171-a04c-b2381b83280c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:04.408834 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5deb0aa7-3d5c-4171-a04c-b2381b83280c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:04.410138 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5deb0aa7-3d5c-4171-a04c-b2381b83280c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:05.043650 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5deb0aa7-3d5c-4171-a04c-b2381b83280c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68324eedf5c840f4806f4c4ae410774f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3139e77141f84e2485d2ba5d305f4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:43:05.057725 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5deb0aa7-3d5c-4171-a04c-b2381b83280c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] 10.222.0.39 "GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9" status: 200 len: 1283 microversion: 2.1 time: 0.685277 Aug 07 01:43:05.059798 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2547/5556] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:43:04 2022] GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9 => generated 1283 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:43:06.084516 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-27a3e85d-b499-4687-b415-552da3ac4eb3 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:43:06.085208 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-27a3e85d-b499-4687-b415-552da3ac4eb3 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] [instance: a4d9c0ea-c890-4629-929b-29c720603db9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:43:06.100734 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27a3e85d-b499-4687-b415-552da3ac4eb3 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:06.104763 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27a3e85d-b499-4687-b415-552da3ac4eb3 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:06.105510 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27a3e85d-b499-4687-b415-552da3ac4eb3 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:06.106573 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27a3e85d-b499-4687-b415-552da3ac4eb3 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:06.107756 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27a3e85d-b499-4687-b415-552da3ac4eb3 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:06.111484 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-27a3e85d-b499-4687-b415-552da3ac4eb3 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:06.515400 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-27a3e85d-b499-4687-b415-552da3ac4eb3 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68324eedf5c840f4806f4c4ae410774f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3139e77141f84e2485d2ba5d305f4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:43:06.529590 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-27a3e85d-b499-4687-b415-552da3ac4eb3 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] 10.222.0.39 "GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9" status: 200 len: 1271 microversion: 2.1 time: 0.449642 Aug 07 01:43:06.545377 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3010/5557] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:43:06 2022] GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9 => generated 1271 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:43:07.553696 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8b0f222d-8d5f-4f1c-9179-11dce991f940 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:43:07.557059 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8b0f222d-8d5f-4f1c-9179-11dce991f940 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] [instance: a4d9c0ea-c890-4629-929b-29c720603db9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:43:07.599412 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8b0f222d-8d5f-4f1c-9179-11dce991f940 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:07.601565 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8b0f222d-8d5f-4f1c-9179-11dce991f940 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:07.603087 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8b0f222d-8d5f-4f1c-9179-11dce991f940 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:07.606117 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8b0f222d-8d5f-4f1c-9179-11dce991f940 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:07.608895 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8b0f222d-8d5f-4f1c-9179-11dce991f940 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:07.609348 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8b0f222d-8d5f-4f1c-9179-11dce991f940 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:08.306325 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8b0f222d-8d5f-4f1c-9179-11dce991f940 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68324eedf5c840f4806f4c4ae410774f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3139e77141f84e2485d2ba5d305f4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:43:08.315153 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:08.329834 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8b0f222d-8d5f-4f1c-9179-11dce991f940 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] 10.222.0.39 "GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9" status: 200 len: 1271 microversion: 2.1 time: 0.780539 Aug 07 01:43:08.336450 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2548/5558] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:43:07 2022] GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9 => generated 1271 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:43:08.819624 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a889b556-5d8f-452d-8131-abf38dc0eb67 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:43:08.823088 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a889b556-5d8f-452d-8131-abf38dc0eb67 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: a6704b77-3a73-4dc8-85af-8eb60c16899a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:43:08.868063 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a889b556-5d8f-452d-8131-abf38dc0eb67 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:08.869137 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a889b556-5d8f-452d-8131-abf38dc0eb67 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:08.869780 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a889b556-5d8f-452d-8131-abf38dc0eb67 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:08.872429 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a889b556-5d8f-452d-8131-abf38dc0eb67 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:08.873920 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a889b556-5d8f-452d-8131-abf38dc0eb67 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:08.877178 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a889b556-5d8f-452d-8131-abf38dc0eb67 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:08.981363 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a889b556-5d8f-452d-8131-abf38dc0eb67 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.166292 Aug 07 01:43:08.983170 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3011/5559] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:43:08 2022] GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a/os-volume_attachments => generated 371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:43:09.130888 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9390a980-3054-49d0-b7e0-b393b71ef461 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:43:09.132188 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9390a980-3054-49d0-b7e0-b393b71ef461 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: a6704b77-3a73-4dc8-85af-8eb60c16899a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:43:09.140143 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=31 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:09.168403 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9390a980-3054-49d0-b7e0-b393b71ef461 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:09.168910 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9390a980-3054-49d0-b7e0-b393b71ef461 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:09.169735 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9390a980-3054-49d0-b7e0-b393b71ef461 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:09.175407 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9390a980-3054-49d0-b7e0-b393b71ef461 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:09.177543 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9390a980-3054-49d0-b7e0-b393b71ef461 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:09.178509 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9390a980-3054-49d0-b7e0-b393b71ef461 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:09.268599 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9390a980-3054-49d0-b7e0-b393b71ef461 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a/os-volume_attachments/7f634ebb-5a4a-4b92-99a6-314a3fd9e9a0" status: 200 len: 194 microversion: 2.1 time: 0.142002 Aug 07 01:43:09.275813 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2549/5560] 10.222.0.39 () {58 vars in 1413 bytes} [Sun Aug 7 01:43:09 2022] GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a/os-volume_attachments/7f634ebb-5a4a-4b92-99a6-314a3fd9e9a0 => generated 194 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:43:09.290522 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-50ad0c2c-b744-4759-ace7-1b25cb4cb7c3 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:43:09.291033 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-50ad0c2c-b744-4759-ace7-1b25cb4cb7c3 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: a6704b77-3a73-4dc8-85af-8eb60c16899a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:43:09.304726 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-50ad0c2c-b744-4759-ace7-1b25cb4cb7c3 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:09.305242 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-50ad0c2c-b744-4759-ace7-1b25cb4cb7c3 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:09.306463 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-50ad0c2c-b744-4759-ace7-1b25cb4cb7c3 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:09.313565 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-50ad0c2c-b744-4759-ace7-1b25cb4cb7c3 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:09.313565 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-50ad0c2c-b744-4759-ace7-1b25cb4cb7c3 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:09.313565 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-50ad0c2c-b744-4759-ace7-1b25cb4cb7c3 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:09.359426 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-81e6f562-0e71-466a-9517-3e290091342c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:43:09.360135 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-81e6f562-0e71-466a-9517-3e290091342c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] [instance: a4d9c0ea-c890-4629-929b-29c720603db9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:43:09.387363 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-81e6f562-0e71-466a-9517-3e290091342c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:09.387909 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-81e6f562-0e71-466a-9517-3e290091342c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:09.388360 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-81e6f562-0e71-466a-9517-3e290091342c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:09.389079 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-81e6f562-0e71-466a-9517-3e290091342c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:09.389535 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-81e6f562-0e71-466a-9517-3e290091342c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:09.389960 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-81e6f562-0e71-466a-9517-3e290091342c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:09.536660 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-50ad0c2c-b744-4759-ace7-1b25cb4cb7c3 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lazy-loading 'services' on Instance uuid a6704b77-3a73-4dc8-85af-8eb60c16899a {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:43:09.716032 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-50ad0c2c-b744-4759-ace7-1b25cb4cb7c3 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a/os-volume_attachments/7f634ebb-5a4a-4b92-99a6-314a3fd9e9a0" status: 202 len: 0 microversion: 2.1 time: 0.434759 Aug 07 01:43:09.717329 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3012/5561] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Aug 7 01:43:09 2022] DELETE /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a/os-volume_attachments/7f634ebb-5a4a-4b92-99a6-314a3fd9e9a0 => generated 0 bytes in 437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:43:09.749941 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-81e6f562-0e71-466a-9517-3e290091342c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68324eedf5c840f4806f4c4ae410774f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3139e77141f84e2485d2ba5d305f4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:43:09.768902 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-81e6f562-0e71-466a-9517-3e290091342c tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] 10.222.0.39 "GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9" status: 200 len: 1271 microversion: 2.1 time: 0.412370 Aug 07 01:43:09.771867 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2550/5562] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:43:09 2022] GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9 => generated 1271 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:43:10.794681 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-48d3f2b4-3dd6-48ba-ae5a-4fdbcc99099a tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:43:10.795421 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-48d3f2b4-3dd6-48ba-ae5a-4fdbcc99099a tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] [instance: a4d9c0ea-c890-4629-929b-29c720603db9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:43:10.813554 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48d3f2b4-3dd6-48ba-ae5a-4fdbcc99099a tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:10.814732 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48d3f2b4-3dd6-48ba-ae5a-4fdbcc99099a tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:10.815199 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48d3f2b4-3dd6-48ba-ae5a-4fdbcc99099a tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:10.815996 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48d3f2b4-3dd6-48ba-ae5a-4fdbcc99099a tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:10.816472 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48d3f2b4-3dd6-48ba-ae5a-4fdbcc99099a tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:10.816904 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48d3f2b4-3dd6-48ba-ae5a-4fdbcc99099a tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:11.417547 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-48d3f2b4-3dd6-48ba-ae5a-4fdbcc99099a tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68324eedf5c840f4806f4c4ae410774f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3139e77141f84e2485d2ba5d305f4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:43:11.431475 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-48d3f2b4-3dd6-48ba-ae5a-4fdbcc99099a tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] 10.222.0.39 "GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9" status: 200 len: 1271 microversion: 2.1 time: 0.643806 Aug 07 01:43:11.437357 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3013/5563] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:43:10 2022] GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9 => generated 1271 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:43:12.474196 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c36a822c-0306-4a5d-a21b-1881317a5749 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:43:12.475594 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c36a822c-0306-4a5d-a21b-1881317a5749 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] [instance: a4d9c0ea-c890-4629-929b-29c720603db9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:43:12.494724 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c36a822c-0306-4a5d-a21b-1881317a5749 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:12.496822 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c36a822c-0306-4a5d-a21b-1881317a5749 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:12.500089 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c36a822c-0306-4a5d-a21b-1881317a5749 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:12.501089 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c36a822c-0306-4a5d-a21b-1881317a5749 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:12.504008 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c36a822c-0306-4a5d-a21b-1881317a5749 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:12.504671 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c36a822c-0306-4a5d-a21b-1881317a5749 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:13.849293 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c36a822c-0306-4a5d-a21b-1881317a5749 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68324eedf5c840f4806f4c4ae410774f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3139e77141f84e2485d2ba5d305f4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:43:13.859431 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c36a822c-0306-4a5d-a21b-1881317a5749 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] 10.222.0.39 "GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9" status: 200 len: 1271 microversion: 2.1 time: 1.390092 Aug 07 01:43:13.863252 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2551/5564] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:43:12 2022] GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9 => generated 1271 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:43:14.883978 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3f20d9e3-9c80-40df-9e76-3ec162f31b74 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:43:14.889080 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3f20d9e3-9c80-40df-9e76-3ec162f31b74 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] [instance: a4d9c0ea-c890-4629-929b-29c720603db9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:43:14.898973 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f20d9e3-9c80-40df-9e76-3ec162f31b74 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:14.903858 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f20d9e3-9c80-40df-9e76-3ec162f31b74 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:14.906374 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f20d9e3-9c80-40df-9e76-3ec162f31b74 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:14.907392 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f20d9e3-9c80-40df-9e76-3ec162f31b74 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:14.908987 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f20d9e3-9c80-40df-9e76-3ec162f31b74 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:14.913123 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f20d9e3-9c80-40df-9e76-3ec162f31b74 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:17.052449 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3f20d9e3-9c80-40df-9e76-3ec162f31b74 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68324eedf5c840f4806f4c4ae410774f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3139e77141f84e2485d2ba5d305f4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:43:17.062586 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3f20d9e3-9c80-40df-9e76-3ec162f31b74 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] 10.222.0.39 "GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9" status: 200 len: 1271 microversion: 2.1 time: 2.182806 Aug 07 01:43:17.080076 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3014/5565] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:43:14 2022] GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9 => generated 1271 bytes in 2200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:43:18.086922 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c7e36af2-d7eb-4ec3-a679-e198729e65dc tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:43:18.088279 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c7e36af2-d7eb-4ec3-a679-e198729e65dc tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] [instance: a4d9c0ea-c890-4629-929b-29c720603db9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:43:18.097496 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7e36af2-d7eb-4ec3-a679-e198729e65dc tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:18.098299 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7e36af2-d7eb-4ec3-a679-e198729e65dc tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:18.099007 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7e36af2-d7eb-4ec3-a679-e198729e65dc tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:18.100180 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7e36af2-d7eb-4ec3-a679-e198729e65dc tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:18.100893 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7e36af2-d7eb-4ec3-a679-e198729e65dc tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:18.101864 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7e36af2-d7eb-4ec3-a679-e198729e65dc tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:18.888047 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c7e36af2-d7eb-4ec3-a679-e198729e65dc tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68324eedf5c840f4806f4c4ae410774f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3139e77141f84e2485d2ba5d305f4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:43:18.908138 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c7e36af2-d7eb-4ec3-a679-e198729e65dc tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] 10.222.0.39 "GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9" status: 200 len: 1271 microversion: 2.1 time: 0.824535 Aug 07 01:43:18.913053 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2552/5566] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:43:18 2022] GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9 => generated 1271 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:43:19.303142 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-e5181ce2-5f3e-4238-8038-257f1acc4aeb req-18637245-10ad-4222-9479-c7c5a3af304f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d9c0ea-c890-4629-929b-29c720603db9", "name": "network-vif-plugged", "status": "completed", "tag": "64cd98dc-f0a6-48bf-8d28-c436245cd37a"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:43:19.334017 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e5181ce2-5f3e-4238-8038-257f1acc4aeb req-18637245-10ad-4222-9479-c7c5a3af304f service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:19.338348 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e5181ce2-5f3e-4238-8038-257f1acc4aeb req-18637245-10ad-4222-9479-c7c5a3af304f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:19.344272 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e5181ce2-5f3e-4238-8038-257f1acc4aeb req-18637245-10ad-4222-9479-c7c5a3af304f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:19.390602 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-e5181ce2-5f3e-4238-8038-257f1acc4aeb req-18637245-10ad-4222-9479-c7c5a3af304f service nova] Creating event network-vif-plugged:64cd98dc-f0a6-48bf-8d28-c436245cd37a for instance a4d9c0ea-c890-4629-929b-29c720603db9 on n-h1-master-1 Aug 07 01:43:19.411561 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-e5181ce2-5f3e-4238-8038-257f1acc4aeb req-18637245-10ad-4222-9479-c7c5a3af304f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114123 Aug 07 01:43:19.416158 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3015/5567] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:43:19.932015 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6d921cd5-7662-4b2e-af57-d3934fcaf365 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:43:19.933326 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6d921cd5-7662-4b2e-af57-d3934fcaf365 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] [instance: a4d9c0ea-c890-4629-929b-29c720603db9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:43:19.951795 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6d921cd5-7662-4b2e-af57-d3934fcaf365 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:19.952583 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6d921cd5-7662-4b2e-af57-d3934fcaf365 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:19.952838 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6d921cd5-7662-4b2e-af57-d3934fcaf365 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:19.953791 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6d921cd5-7662-4b2e-af57-d3934fcaf365 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:19.958671 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6d921cd5-7662-4b2e-af57-d3934fcaf365 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:19.960174 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6d921cd5-7662-4b2e-af57-d3934fcaf365 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:20.575680 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6d921cd5-7662-4b2e-af57-d3934fcaf365 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68324eedf5c840f4806f4c4ae410774f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3139e77141f84e2485d2ba5d305f4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:43:20.584599 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6d921cd5-7662-4b2e-af57-d3934fcaf365 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] 10.222.0.39 "GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9" status: 200 len: 1271 microversion: 2.1 time: 0.656524 Aug 07 01:43:20.585206 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2553/5568] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:43:19 2022] GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9 => generated 1271 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:43:21.607560 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-249d29ca-d148-49a7-8c93-ac8477d7a5ba tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:43:21.608344 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-249d29ca-d148-49a7-8c93-ac8477d7a5ba tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] [instance: a4d9c0ea-c890-4629-929b-29c720603db9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:43:21.618879 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-249d29ca-d148-49a7-8c93-ac8477d7a5ba tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:21.619379 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-249d29ca-d148-49a7-8c93-ac8477d7a5ba tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:21.619826 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-249d29ca-d148-49a7-8c93-ac8477d7a5ba tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:21.626604 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-249d29ca-d148-49a7-8c93-ac8477d7a5ba tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:21.627101 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-249d29ca-d148-49a7-8c93-ac8477d7a5ba tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:21.627554 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-249d29ca-d148-49a7-8c93-ac8477d7a5ba tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:21.980801 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-249d29ca-d148-49a7-8c93-ac8477d7a5ba tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68324eedf5c840f4806f4c4ae410774f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3139e77141f84e2485d2ba5d305f4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:43:22.003081 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-249d29ca-d148-49a7-8c93-ac8477d7a5ba tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] 10.222.0.39 "GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9" status: 200 len: 1458 microversion: 2.1 time: 0.399751 Aug 07 01:43:22.004565 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3016/5569] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:43:21 2022] GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9 => generated 1458 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:43:22.025270 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3b414a7f-6512-4973-a936-0e129f27e5ea tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:43:22.026524 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3b414a7f-6512-4973-a936-0e129f27e5ea tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] [instance: a4d9c0ea-c890-4629-929b-29c720603db9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:43:22.042948 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b414a7f-6512-4973-a936-0e129f27e5ea tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:22.044293 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b414a7f-6512-4973-a936-0e129f27e5ea tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:22.044916 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b414a7f-6512-4973-a936-0e129f27e5ea tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:22.045830 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b414a7f-6512-4973-a936-0e129f27e5ea tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:22.048485 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b414a7f-6512-4973-a936-0e129f27e5ea tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:22.049124 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b414a7f-6512-4973-a936-0e129f27e5ea tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:22.695082 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3b414a7f-6512-4973-a936-0e129f27e5ea tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68324eedf5c840f4806f4c4ae410774f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3139e77141f84e2485d2ba5d305f4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:43:22.708249 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3b414a7f-6512-4973-a936-0e129f27e5ea tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] 10.222.0.39 "GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9" status: 200 len: 1458 microversion: 2.1 time: 0.686877 Aug 07 01:43:22.712911 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2554/5570] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:43:22 2022] GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9 => generated 1458 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:43:23.811767 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6718ad80-e532-4697-91ce-66e18335d49b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:43:23.812565 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6718ad80-e532-4697-91ce-66e18335d49b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: a6704b77-3a73-4dc8-85af-8eb60c16899a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:43:23.837080 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6718ad80-e532-4697-91ce-66e18335d49b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:23.838313 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6718ad80-e532-4697-91ce-66e18335d49b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:23.842750 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6718ad80-e532-4697-91ce-66e18335d49b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:23.844861 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6718ad80-e532-4697-91ce-66e18335d49b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:23.846760 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6718ad80-e532-4697-91ce-66e18335d49b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:23.847491 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6718ad80-e532-4697-91ce-66e18335d49b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:23.976460 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6718ad80-e532-4697-91ce-66e18335d49b tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a/os-volume_attachments/ccb3f4b3-0c7e-4b14-ba5d-e63ff2957c0d" status: 200 len: 194 microversion: 2.1 time: 0.181325 Aug 07 01:43:23.990506 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3017/5571] 10.222.0.39 () {58 vars in 1413 bytes} [Sun Aug 7 01:43:23 2022] GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a/os-volume_attachments/ccb3f4b3-0c7e-4b14-ba5d-e63ff2957c0d => generated 194 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:43:24.000649 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3a9f7483-8455-41b5-b1d6-c626d40e93fb tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:43:24.001535 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3a9f7483-8455-41b5-b1d6-c626d40e93fb tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: a6704b77-3a73-4dc8-85af-8eb60c16899a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:43:24.045977 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3a9f7483-8455-41b5-b1d6-c626d40e93fb tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:24.048789 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3a9f7483-8455-41b5-b1d6-c626d40e93fb tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:24.049741 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3a9f7483-8455-41b5-b1d6-c626d40e93fb tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:24.052472 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3a9f7483-8455-41b5-b1d6-c626d40e93fb tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:24.052974 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3a9f7483-8455-41b5-b1d6-c626d40e93fb tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:24.053421 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3a9f7483-8455-41b5-b1d6-c626d40e93fb tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:24.281175 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-3a9f7483-8455-41b5-b1d6-c626d40e93fb tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lazy-loading 'services' on Instance uuid a6704b77-3a73-4dc8-85af-8eb60c16899a {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:43:24.450480 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3a9f7483-8455-41b5-b1d6-c626d40e93fb tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a/os-volume_attachments/ccb3f4b3-0c7e-4b14-ba5d-e63ff2957c0d" status: 202 len: 0 microversion: 2.1 time: 0.458093 Aug 07 01:43:24.467691 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2555/5572] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Aug 7 01:43:23 2022] DELETE /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a/os-volume_attachments/ccb3f4b3-0c7e-4b14-ba5d-e63ff2957c0d => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:43:28.003114 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-e80efcf6-f3f1-4808-8824-cf0dfe5ffb06 req-67ac131d-aba8-433c-9b9a-a0026c17503f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4d9c0ea-c890-4629-929b-29c720603db9", "tag": "64cd98dc-f0a6-48bf-8d28-c436245cd37a"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:43:28.057276 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e80efcf6-f3f1-4808-8824-cf0dfe5ffb06 req-67ac131d-aba8-433c-9b9a-a0026c17503f service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:28.064046 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e80efcf6-f3f1-4808-8824-cf0dfe5ffb06 req-67ac131d-aba8-433c-9b9a-a0026c17503f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:28.065186 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e80efcf6-f3f1-4808-8824-cf0dfe5ffb06 req-67ac131d-aba8-433c-9b9a-a0026c17503f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:28.129269 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-e80efcf6-f3f1-4808-8824-cf0dfe5ffb06 req-67ac131d-aba8-433c-9b9a-a0026c17503f service nova] Creating event network-changed:64cd98dc-f0a6-48bf-8d28-c436245cd37a for instance a4d9c0ea-c890-4629-929b-29c720603db9 on n-h1-master-1 Aug 07 01:43:28.144809 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-e80efcf6-f3f1-4808-8824-cf0dfe5ffb06 req-67ac131d-aba8-433c-9b9a-a0026c17503f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145798 Aug 07 01:43:28.155813 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3018/5573] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:43:33.624813 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-151b7536-bde6-49ea-bef9-3bc29dfe75a4 req-6e8024ab-ad33-4490-b6ba-b3fe5d2a133c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4d9c0ea-c890-4629-929b-29c720603db9", "tag": "64cd98dc-f0a6-48bf-8d28-c436245cd37a"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:43:33.670046 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-151b7536-bde6-49ea-bef9-3bc29dfe75a4 req-6e8024ab-ad33-4490-b6ba-b3fe5d2a133c service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:33.682943 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-151b7536-bde6-49ea-bef9-3bc29dfe75a4 req-6e8024ab-ad33-4490-b6ba-b3fe5d2a133c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:33.684456 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-151b7536-bde6-49ea-bef9-3bc29dfe75a4 req-6e8024ab-ad33-4490-b6ba-b3fe5d2a133c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:33.735865 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-151b7536-bde6-49ea-bef9-3bc29dfe75a4 req-6e8024ab-ad33-4490-b6ba-b3fe5d2a133c service nova] Creating event network-changed:64cd98dc-f0a6-48bf-8d28-c436245cd37a for instance a4d9c0ea-c890-4629-929b-29c720603db9 on n-h1-master-1 Aug 07 01:43:33.757461 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-151b7536-bde6-49ea-bef9-3bc29dfe75a4 req-6e8024ab-ad33-4490-b6ba-b3fe5d2a133c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171046 Aug 07 01:43:33.758378 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2556/5574] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:43:35.914193 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-0e5df724-d137-489d-b09a-158955246556 req-0cef53de-3362-44b3-8a4c-d735260c5629 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4d9c0ea-c890-4629-929b-29c720603db9", "tag": "64cd98dc-f0a6-48bf-8d28-c436245cd37a"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:43:35.945777 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=21 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:35.948320 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0e5df724-d137-489d-b09a-158955246556 req-0cef53de-3362-44b3-8a4c-d735260c5629 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:35.948835 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0e5df724-d137-489d-b09a-158955246556 req-0cef53de-3362-44b3-8a4c-d735260c5629 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:35.951487 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0e5df724-d137-489d-b09a-158955246556 req-0cef53de-3362-44b3-8a4c-d735260c5629 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:35.963584 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=56,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:35.995637 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-0e5df724-d137-489d-b09a-158955246556 req-0cef53de-3362-44b3-8a4c-d735260c5629 service nova] Creating event network-changed:64cd98dc-f0a6-48bf-8d28-c436245cd37a for instance a4d9c0ea-c890-4629-929b-29c720603db9 on n-h1-master-1 Aug 07 01:43:36.040706 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-0e5df724-d137-489d-b09a-158955246556 req-0cef53de-3362-44b3-8a4c-d735260c5629 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129669 Aug 07 01:43:36.043551 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3019/5575] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:43:37.607650 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2a40b05f-7d69-4539-8d75-12275617d942 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:43:37.610807 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2a40b05f-7d69-4539-8d75-12275617d942 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: a6704b77-3a73-4dc8-85af-8eb60c16899a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:43:37.634601 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2a40b05f-7d69-4539-8d75-12275617d942 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:37.635260 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2a40b05f-7d69-4539-8d75-12275617d942 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:37.635507 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2a40b05f-7d69-4539-8d75-12275617d942 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:37.638735 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2a40b05f-7d69-4539-8d75-12275617d942 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:37.639653 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2a40b05f-7d69-4539-8d75-12275617d942 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:37.640391 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2a40b05f-7d69-4539-8d75-12275617d942 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:37.775987 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2a40b05f-7d69-4539-8d75-12275617d942 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.171269 Aug 07 01:43:37.777385 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2557/5576] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:43:37 2022] GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a/os-volume_attachments => generated 25 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:43:38.019908 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7d790570-de0d-4c23-ab3b-6c7447927fb3 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:43:38.022040 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7d790570-de0d-4c23-ab3b-6c7447927fb3 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: a6704b77-3a73-4dc8-85af-8eb60c16899a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:43:38.030790 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d790570-de0d-4c23-ab3b-6c7447927fb3 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:38.031276 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d790570-de0d-4c23-ab3b-6c7447927fb3 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:38.056706 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d790570-de0d-4c23-ab3b-6c7447927fb3 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:38.061911 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d790570-de0d-4c23-ab3b-6c7447927fb3 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:38.062509 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d790570-de0d-4c23-ab3b-6c7447927fb3 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:38.064436 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d790570-de0d-4c23-ab3b-6c7447927fb3 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:38.168810 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7d790570-de0d-4c23-ab3b-6c7447927fb3 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.153959 Aug 07 01:43:38.173993 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3020/5577] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:43:38 2022] GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a/os-volume_attachments => generated 25 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 01:43:38.298954 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-94e4d2fa-2cfe-481f-9d46-5985d908b41a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:43:38.299533 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-94e4d2fa-2cfe-481f-9d46-5985d908b41a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: a6704b77-3a73-4dc8-85af-8eb60c16899a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:43:38.317630 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94e4d2fa-2cfe-481f-9d46-5985d908b41a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:38.318394 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94e4d2fa-2cfe-481f-9d46-5985d908b41a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:38.320502 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94e4d2fa-2cfe-481f-9d46-5985d908b41a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:38.321362 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94e4d2fa-2cfe-481f-9d46-5985d908b41a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:38.328427 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94e4d2fa-2cfe-481f-9d46-5985d908b41a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:38.328982 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94e4d2fa-2cfe-481f-9d46-5985d908b41a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:38.416483 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-94e4d2fa-2cfe-481f-9d46-5985d908b41a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: a6704b77-3a73-4dc8-85af-8eb60c16899a] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:43:38.625293 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-94e4d2fa-2cfe-481f-9d46-5985d908b41a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a" status: 204 len: 0 microversion: 2.1 time: 0.328994 Aug 07 01:43:38.627045 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2558/5578] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:43:38 2022] DELETE /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 07 01:43:38.636452 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b8710e35-dfeb-4625-aca7-21992845ab18 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:43:38.638181 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b8710e35-dfeb-4625-aca7-21992845ab18 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: a6704b77-3a73-4dc8-85af-8eb60c16899a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:43:38.650634 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b8710e35-dfeb-4625-aca7-21992845ab18 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:38.651667 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b8710e35-dfeb-4625-aca7-21992845ab18 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:38.653713 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b8710e35-dfeb-4625-aca7-21992845ab18 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:38.654677 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b8710e35-dfeb-4625-aca7-21992845ab18 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:38.656541 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b8710e35-dfeb-4625-aca7-21992845ab18 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:38.658043 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b8710e35-dfeb-4625-aca7-21992845ab18 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:39.791267 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b8710e35-dfeb-4625-aca7-21992845ab18 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:43:39.809274 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b8710e35-dfeb-4625-aca7-21992845ab18 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a" status: 200 len: 1673 microversion: 2.1 time: 1.176174 Aug 07 01:43:39.810967 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3021/5579] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:43:38 2022] GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a => generated 1673 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:43:40.838915 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a05dd4ff-d030-4863-86da-b93cf3202ae4 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:43:40.839661 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a05dd4ff-d030-4863-86da-b93cf3202ae4 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: a6704b77-3a73-4dc8-85af-8eb60c16899a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:43:40.848148 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:40.849555 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a05dd4ff-d030-4863-86da-b93cf3202ae4 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:40.850046 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a05dd4ff-d030-4863-86da-b93cf3202ae4 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:40.850577 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a05dd4ff-d030-4863-86da-b93cf3202ae4 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:40.851694 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a05dd4ff-d030-4863-86da-b93cf3202ae4 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:40.852085 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a05dd4ff-d030-4863-86da-b93cf3202ae4 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:40.869968 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a05dd4ff-d030-4863-86da-b93cf3202ae4 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:41.003069 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:42.863538 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a05dd4ff-d030-4863-86da-b93cf3202ae4 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:43:42.880276 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a05dd4ff-d030-4863-86da-b93cf3202ae4 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a" status: 200 len: 1673 microversion: 2.1 time: 2.044971 Aug 07 01:43:42.880732 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2559/5580] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:43:40 2022] GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a => generated 1673 bytes in 2047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:43:43.576190 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-1ef7dbbe-9f62-49ec-97bf-52eea892404e req-90f94dc0-07c8-4545-864c-413c21c55a38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6704b77-3a73-4dc8-85af-8eb60c16899a", "name": "network-vif-deleted", "tag": "9a87e0aa-6b46-49c8-b248-fea8df7922b7"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:43:43.614399 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-1ef7dbbe-9f62-49ec-97bf-52eea892404e req-90f94dc0-07c8-4545-864c-413c21c55a38 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:43.615175 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-1ef7dbbe-9f62-49ec-97bf-52eea892404e req-90f94dc0-07c8-4545-864c-413c21c55a38 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:43.618290 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-1ef7dbbe-9f62-49ec-97bf-52eea892404e req-90f94dc0-07c8-4545-864c-413c21c55a38 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:43.665227 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-1ef7dbbe-9f62-49ec-97bf-52eea892404e req-90f94dc0-07c8-4545-864c-413c21c55a38 service nova] Creating event network-vif-deleted:9a87e0aa-6b46-49c8-b248-fea8df7922b7 for instance a6704b77-3a73-4dc8-85af-8eb60c16899a on n-h2-master-1 Aug 07 01:43:43.679966 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-1ef7dbbe-9f62-49ec-97bf-52eea892404e req-90f94dc0-07c8-4545-864c-413c21c55a38 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108490 Aug 07 01:43:43.682667 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3022/5581] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:43:43.915225 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3226a90e-fed5-4a3d-8dd0-f1444173dfbd tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:43:43.917798 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3226a90e-fed5-4a3d-8dd0-f1444173dfbd tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: a6704b77-3a73-4dc8-85af-8eb60c16899a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:43:43.957285 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3226a90e-fed5-4a3d-8dd0-f1444173dfbd tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:43.964382 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3226a90e-fed5-4a3d-8dd0-f1444173dfbd tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:43.964850 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3226a90e-fed5-4a3d-8dd0-f1444173dfbd tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:43.965693 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3226a90e-fed5-4a3d-8dd0-f1444173dfbd tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:43.972689 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3226a90e-fed5-4a3d-8dd0-f1444173dfbd tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:43.976405 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3226a90e-fed5-4a3d-8dd0-f1444173dfbd tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:44.263194 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3226a90e-fed5-4a3d-8dd0-f1444173dfbd tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:43:44.305393 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3226a90e-fed5-4a3d-8dd0-f1444173dfbd tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a" status: 200 len: 1321 microversion: 2.1 time: 0.393960 Aug 07 01:43:44.306726 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2560/5582] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:43:43 2022] GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a => generated 1321 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:43:45.332994 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-31802db0-50b1-4cb6-a49c-f3871f3d739a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:43:45.333800 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-31802db0-50b1-4cb6-a49c-f3871f3d739a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: a6704b77-3a73-4dc8-85af-8eb60c16899a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:43:45.363798 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31802db0-50b1-4cb6-a49c-f3871f3d739a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:45.367437 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31802db0-50b1-4cb6-a49c-f3871f3d739a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:45.367921 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31802db0-50b1-4cb6-a49c-f3871f3d739a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:45.368699 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31802db0-50b1-4cb6-a49c-f3871f3d739a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:45.369180 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31802db0-50b1-4cb6-a49c-f3871f3d739a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:45.377641 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31802db0-50b1-4cb6-a49c-f3871f3d739a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:45.520140 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31802db0-50b1-4cb6-a49c-f3871f3d739a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:45.529492 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31802db0-50b1-4cb6-a49c-f3871f3d739a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:45.531534 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31802db0-50b1-4cb6-a49c-f3871f3d739a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:45.537657 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-31802db0-50b1-4cb6-a49c-f3871f3d739a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lazy-loading 'fault' on Instance uuid a6704b77-3a73-4dc8-85af-8eb60c16899a {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:43:45.791972 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-31802db0-50b1-4cb6-a49c-f3871f3d739a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d8e76eb694846cabc55fc8e825c8e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd244ec665474b3896678f34d6491574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:43:45.832701 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-31802db0-50b1-4cb6-a49c-f3871f3d739a tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a" status: 200 len: 1326 microversion: 2.1 time: 0.504869 Aug 07 01:43:45.837220 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3023/5583] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:43:45 2022] GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a => generated 1326 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:43:46.864383 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-787d6a32-09d8-4d56-9f45-56dcaf400e4c tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:43:46.866037 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-787d6a32-09d8-4d56-9f45-56dcaf400e4c tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: a6704b77-3a73-4dc8-85af-8eb60c16899a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:43:46.889492 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-787d6a32-09d8-4d56-9f45-56dcaf400e4c tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:46.890220 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-787d6a32-09d8-4d56-9f45-56dcaf400e4c tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:46.890864 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-787d6a32-09d8-4d56-9f45-56dcaf400e4c tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:46.894413 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-787d6a32-09d8-4d56-9f45-56dcaf400e4c tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:43:46.895125 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-787d6a32-09d8-4d56-9f45-56dcaf400e4c tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:43:46.896175 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-787d6a32-09d8-4d56-9f45-56dcaf400e4c tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:43:46.937939 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-787d6a32-09d8-4d56-9f45-56dcaf400e4c tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] HTTP exception thrown: Instance a6704b77-3a73-4dc8-85af-8eb60c16899a could not be found. Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-787d6a32-09d8-4d56-9f45-56dcaf400e4c tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Request method failure captured: Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a HTTP/1.1 Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xdHeORiS6YWMHnUJygRGszSNIG1JhGoKcoBSmXw0JuemXQOUZ7u2oZVNnGzA3TBr4c7vXwq1ZMaruUYdg1nhcCvtacS7m-HVh9cvqJkdgIvMA9_zdpwP_5c3M05G_7pXM09STwSj5ER44J8qlDDM7BzjCwL1d7yDBkzz3MYyqojQrk Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: fd244ec665474b3896678f34d6491574 Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-AttachVolumeTestJSON-730710293 Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd244ec665474b3896678f34d6491574"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fd244ec665474b3896678f34d6491574", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd244ec665474b3896678f34d6491574"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fd244ec665474b3896678f34d6491574"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-AttachVolumeTestJSON-730710293 Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: fd244ec665474b3896678f34d6491574 Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-AttachVolumeTestJSON-730710293 Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-AttachVolumeTestJSON-730710293-project Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 2d8e76eb694846cabc55fc8e825c8e43 Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-AttachVolumeTestJSON-730710293-project Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: exception: Instance a6704b77-3a73-4dc8-85af-8eb60c16899a could not be found. Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'a6704b77-3a73-4dc8-85af-8eb60c16899a'} Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6704b77-3a73-4dc8-85af-8eb60c16899a could not be found. Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6704b77-3a73-4dc8-85af-8eb60c16899a could not be found. Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:43:46.942137 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:43:46.949125 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:43:46.949125 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:43:46.949125 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:43:46.949125 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:43:46.949125 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:43:46.949125 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6704b77-3a73-4dc8-85af-8eb60c16899a could not be found. Aug 07 01:43:46.949125 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:43:46.956154 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-787d6a32-09d8-4d56-9f45-56dcaf400e4c tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Returning 404 to user: Instance a6704b77-3a73-4dc8-85af-8eb60c16899a could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:43:46.959189 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-787d6a32-09d8-4d56-9f45-56dcaf400e4c tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a" status: 404 len: 111 microversion: 2.1 time: 0.099408 Aug 07 01:43:46.960553 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2561/5584] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:43:46 2022] GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:43:46.969638 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-50efaa9c-2572-4c41-9607-89b5a1f47f54 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '.version_select at 0x7f9e29969ee0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:43:47.022478 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-50efaa9c-2572-4c41-9607-89b5a1f47f54 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-521699372" status: 202 len: 0 microversion: 2.1 time: 0.055836 Aug 07 01:43:47.024729 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3024/5585] 10.222.0.39 () {58 vars in 1218 bytes} [Sun Aug 7 01:43:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-521699372 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:44:06.464248 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-452ba0a9-89f9-45dc-a453-d313dfda6595 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:44:06.465508 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-452ba0a9-89f9-45dc-a453-d313dfda6595 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] [instance: a4d9c0ea-c890-4629-929b-29c720603db9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:44:06.480939 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=23 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:06.483019 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:06.490292 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-2b23eef4-453f-4283-a3fc-c9becaa5852e req-dc4233cb-6f8a-48c7-8a7e-5b33302b40da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4d9c0ea-c890-4629-929b-29c720603db9", "tag": "64cd98dc-f0a6-48bf-8d28-c436245cd37a"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:44:06.492333 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=5 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:06.497155 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=13 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:06.517391 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-452ba0a9-89f9-45dc-a453-d313dfda6595 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:06.521348 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-452ba0a9-89f9-45dc-a453-d313dfda6595 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:06.524640 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-452ba0a9-89f9-45dc-a453-d313dfda6595 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:06.530062 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-452ba0a9-89f9-45dc-a453-d313dfda6595 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:06.532664 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-452ba0a9-89f9-45dc-a453-d313dfda6595 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:06.535225 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-452ba0a9-89f9-45dc-a453-d313dfda6595 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:06.560272 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2b23eef4-453f-4283-a3fc-c9becaa5852e req-dc4233cb-6f8a-48c7-8a7e-5b33302b40da service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:06.564559 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2b23eef4-453f-4283-a3fc-c9becaa5852e req-dc4233cb-6f8a-48c7-8a7e-5b33302b40da service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:06.570682 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2b23eef4-453f-4283-a3fc-c9becaa5852e req-dc4233cb-6f8a-48c7-8a7e-5b33302b40da service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:06.601782 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-2b23eef4-453f-4283-a3fc-c9becaa5852e req-dc4233cb-6f8a-48c7-8a7e-5b33302b40da service nova] Creating event network-changed:64cd98dc-f0a6-48bf-8d28-c436245cd37a for instance a4d9c0ea-c890-4629-929b-29c720603db9 on n-h1-master-1 Aug 07 01:44:06.615919 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-2b23eef4-453f-4283-a3fc-c9becaa5852e req-dc4233cb-6f8a-48c7-8a7e-5b33302b40da service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135137 Aug 07 01:44:06.621878 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3025/5586] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:44:06.633600 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-da3ed57c-c9b6-4add-9a59-16e9e3659596 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:44:06.636936 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-452ba0a9-89f9-45dc-a453-d313dfda6595 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] [instance: a4d9c0ea-c890-4629-929b-29c720603db9] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:44:06.637656 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-da3ed57c-c9b6-4add-9a59-16e9e3659596 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: a6704b77-3a73-4dc8-85af-8eb60c16899a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:44:06.686814 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da3ed57c-c9b6-4add-9a59-16e9e3659596 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:06.687654 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da3ed57c-c9b6-4add-9a59-16e9e3659596 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:06.688292 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da3ed57c-c9b6-4add-9a59-16e9e3659596 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:06.694336 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da3ed57c-c9b6-4add-9a59-16e9e3659596 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:06.696285 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da3ed57c-c9b6-4add-9a59-16e9e3659596 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:06.696935 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da3ed57c-c9b6-4add-9a59-16e9e3659596 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:06.737323 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-da3ed57c-c9b6-4add-9a59-16e9e3659596 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] HTTP exception thrown: Instance a6704b77-3a73-4dc8-85af-8eb60c16899a could not be found. Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-da3ed57c-c9b6-4add-9a59-16e9e3659596 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Request method failure captured: Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a HTTP/1.1 Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xdHeORiS6YWMHnUJygRGszSNIG1JhGoKcoBSmXw0JuemXQOUZ7u2oZVNnGzA3TBr4c7vXwq1ZMaruUYdg1nhcCvtacS7m-HVh9cvqJkdgIvMA9_zdpwP_5c3M05G_7pXM09STwSj5ER44J8qlDDM7BzjCwL1d7yDBkzz3MYyqojQrk Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: fd244ec665474b3896678f34d6491574 Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-AttachVolumeTestJSON-730710293 Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd244ec665474b3896678f34d6491574"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fd244ec665474b3896678f34d6491574", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd244ec665474b3896678f34d6491574"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fd244ec665474b3896678f34d6491574"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-AttachVolumeTestJSON-730710293 Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: fd244ec665474b3896678f34d6491574 Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-AttachVolumeTestJSON-730710293 Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-AttachVolumeTestJSON-730710293-project Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 2d8e76eb694846cabc55fc8e825c8e43 Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-AttachVolumeTestJSON-730710293-project Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: exception: Instance a6704b77-3a73-4dc8-85af-8eb60c16899a could not be found. Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'a6704b77-3a73-4dc8-85af-8eb60c16899a'} Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6704b77-3a73-4dc8-85af-8eb60c16899a could not be found. Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:44:06.739313 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:44:06.743676 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6704b77-3a73-4dc8-85af-8eb60c16899a could not be found. Aug 07 01:44:06.743676 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:44:06.743676 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:44:06.743676 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:44:06.743676 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:44:06.743676 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:44:06.743676 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:44:06.743676 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:44:06.743676 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:44:06.743676 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6704b77-3a73-4dc8-85af-8eb60c16899a could not be found. Aug 07 01:44:06.743676 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:44:06.745858 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-da3ed57c-c9b6-4add-9a59-16e9e3659596 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Returning 404 to user: Instance a6704b77-3a73-4dc8-85af-8eb60c16899a could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:44:06.746907 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-da3ed57c-c9b6-4add-9a59-16e9e3659596 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a" status: 404 len: 111 microversion: 2.1 time: 0.123711 Aug 07 01:44:06.748877 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3026/5587] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:44:06 2022] DELETE /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:44:06.757925 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9c3992f9-4295-4de0-89a7-11c06206eebc tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:44:06.762821 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9c3992f9-4295-4de0-89a7-11c06206eebc tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: a6704b77-3a73-4dc8-85af-8eb60c16899a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:44:06.779923 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c3992f9-4295-4de0-89a7-11c06206eebc tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:06.781059 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c3992f9-4295-4de0-89a7-11c06206eebc tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:06.784720 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c3992f9-4295-4de0-89a7-11c06206eebc tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:06.785806 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c3992f9-4295-4de0-89a7-11c06206eebc tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:06.786494 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c3992f9-4295-4de0-89a7-11c06206eebc tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:06.787143 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c3992f9-4295-4de0-89a7-11c06206eebc tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:06.844404 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-452ba0a9-89f9-45dc-a453-d313dfda6595 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9" status: 204 len: 0 microversion: 2.1 time: 0.383699 Aug 07 01:44:06.849335 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2562/5588] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:44:06 2022] DELETE /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:44:06.866568 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-673bfae8-d3f7-4004-816d-b1d8be4847f4 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:44:06.889123 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-673bfae8-d3f7-4004-816d-b1d8be4847f4 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] [instance: a4d9c0ea-c890-4629-929b-29c720603db9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:44:06.912232 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-673bfae8-d3f7-4004-816d-b1d8be4847f4 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:06.917074 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-673bfae8-d3f7-4004-816d-b1d8be4847f4 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:06.918575 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-673bfae8-d3f7-4004-816d-b1d8be4847f4 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:06.927265 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-9c3992f9-4295-4de0-89a7-11c06206eebc tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] HTTP exception thrown: Instance a6704b77-3a73-4dc8-85af-8eb60c16899a could not be found. Aug 07 01:44:06.928232 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-673bfae8-d3f7-4004-816d-b1d8be4847f4 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:06.928988 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-673bfae8-d3f7-4004-816d-b1d8be4847f4 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:06.929662 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-673bfae8-d3f7-4004-816d-b1d8be4847f4 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9c3992f9-4295-4de0-89a7-11c06206eebc tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Request method failure captured: Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a HTTP/1.1 Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xdHeORiS6YWMHnUJygRGszSNIG1JhGoKcoBSmXw0JuemXQOUZ7u2oZVNnGzA3TBr4c7vXwq1ZMaruUYdg1nhcCvtacS7m-HVh9cvqJkdgIvMA9_zdpwP_5c3M05G_7pXM09STwSj5ER44J8qlDDM7BzjCwL1d7yDBkzz3MYyqojQrk Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: fd244ec665474b3896678f34d6491574 Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-AttachVolumeTestJSON-730710293 Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd244ec665474b3896678f34d6491574"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fd244ec665474b3896678f34d6491574", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd244ec665474b3896678f34d6491574"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fd244ec665474b3896678f34d6491574"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-AttachVolumeTestJSON-730710293 Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: fd244ec665474b3896678f34d6491574 Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-AttachVolumeTestJSON-730710293 Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-AttachVolumeTestJSON-730710293-project Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 2d8e76eb694846cabc55fc8e825c8e43 Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-AttachVolumeTestJSON-730710293-project Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: exception: Instance a6704b77-3a73-4dc8-85af-8eb60c16899a could not be found. Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'a6704b77-3a73-4dc8-85af-8eb60c16899a'} Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6704b77-3a73-4dc8-85af-8eb60c16899a could not be found. Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6704b77-3a73-4dc8-85af-8eb60c16899a could not be found. Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:44:06.946206 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:44:06.951130 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:44:06.951130 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:44:06.951130 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:44:06.951130 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:44:06.951130 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:44:06.951130 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6704b77-3a73-4dc8-85af-8eb60c16899a could not be found. Aug 07 01:44:06.951130 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:44:06.955506 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9c3992f9-4295-4de0-89a7-11c06206eebc tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Returning 404 to user: Instance a6704b77-3a73-4dc8-85af-8eb60c16899a could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:44:06.960794 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9c3992f9-4295-4de0-89a7-11c06206eebc tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a" status: 404 len: 111 microversion: 2.1 time: 0.208565 Aug 07 01:44:06.966688 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3027/5589] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:44:06 2022] GET /compute/v2.1/servers/a6704b77-3a73-4dc8-85af-8eb60c16899a => generated 111 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:44:07.505451 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-673bfae8-d3f7-4004-816d-b1d8be4847f4 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68324eedf5c840f4806f4c4ae410774f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3139e77141f84e2485d2ba5d305f4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:44:07.519002 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-673bfae8-d3f7-4004-816d-b1d8be4847f4 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] 10.222.0.39 "GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9" status: 200 len: 1583 microversion: 2.1 time: 0.661175 Aug 07 01:44:07.521897 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2563/5590] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:44:06 2022] GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9 => generated 1583 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:44:08.544855 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-73a4fef2-6cc6-4607-af9b-550ab7e3924f tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:44:08.546601 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-73a4fef2-6cc6-4607-af9b-550ab7e3924f tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] [instance: a4d9c0ea-c890-4629-929b-29c720603db9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:44:08.570504 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73a4fef2-6cc6-4607-af9b-550ab7e3924f tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:08.573080 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73a4fef2-6cc6-4607-af9b-550ab7e3924f tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:08.573857 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73a4fef2-6cc6-4607-af9b-550ab7e3924f tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:08.576909 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73a4fef2-6cc6-4607-af9b-550ab7e3924f tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:08.578837 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73a4fef2-6cc6-4607-af9b-550ab7e3924f tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:08.579460 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73a4fef2-6cc6-4607-af9b-550ab7e3924f tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:09.409717 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-73a4fef2-6cc6-4607-af9b-550ab7e3924f tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68324eedf5c840f4806f4c4ae410774f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3139e77141f84e2485d2ba5d305f4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:44:09.442452 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-73a4fef2-6cc6-4607-af9b-550ab7e3924f tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] 10.222.0.39 "GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9" status: 200 len: 1583 microversion: 2.1 time: 0.902105 Aug 07 01:44:09.442936 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3028/5591] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:44:08 2022] GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9 => generated 1583 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:44:10.472329 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f9ef1b60-e8ea-4d9b-808d-71bc6abeaa0f tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:44:10.474002 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f9ef1b60-e8ea-4d9b-808d-71bc6abeaa0f tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] [instance: a4d9c0ea-c890-4629-929b-29c720603db9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:44:10.508814 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f9ef1b60-e8ea-4d9b-808d-71bc6abeaa0f tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:10.509304 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f9ef1b60-e8ea-4d9b-808d-71bc6abeaa0f tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:10.510020 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f9ef1b60-e8ea-4d9b-808d-71bc6abeaa0f tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:10.510910 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f9ef1b60-e8ea-4d9b-808d-71bc6abeaa0f tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:10.511534 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f9ef1b60-e8ea-4d9b-808d-71bc6abeaa0f tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:10.514043 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f9ef1b60-e8ea-4d9b-808d-71bc6abeaa0f tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:10.886117 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f9ef1b60-e8ea-4d9b-808d-71bc6abeaa0f tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68324eedf5c840f4806f4c4ae410774f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3139e77141f84e2485d2ba5d305f4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:44:10.899545 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f9ef1b60-e8ea-4d9b-808d-71bc6abeaa0f tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] 10.222.0.39 "GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9" status: 200 len: 1396 microversion: 2.1 time: 0.430978 Aug 07 01:44:10.905355 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2564/5592] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:44:10 2022] GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9 => generated 1396 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:44:11.927199 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6f6aaae2-fad9-4047-8353-2a6073d78498 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:44:11.929355 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6f6aaae2-fad9-4047-8353-2a6073d78498 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] [instance: a4d9c0ea-c890-4629-929b-29c720603db9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:44:11.938523 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f6aaae2-fad9-4047-8353-2a6073d78498 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:11.939465 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f6aaae2-fad9-4047-8353-2a6073d78498 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:11.940159 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f6aaae2-fad9-4047-8353-2a6073d78498 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:11.941055 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f6aaae2-fad9-4047-8353-2a6073d78498 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:11.941666 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f6aaae2-fad9-4047-8353-2a6073d78498 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:11.942237 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f6aaae2-fad9-4047-8353-2a6073d78498 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:12.390341 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-b3d77967-3639-4613-988c-fad159222779 req-9fc62c06-c364-4b86-a45a-d31bc4158fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d9c0ea-c890-4629-929b-29c720603db9", "name": "network-vif-deleted", "tag": "64cd98dc-f0a6-48bf-8d28-c436245cd37a"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:44:12.422629 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b3d77967-3639-4613-988c-fad159222779 req-9fc62c06-c364-4b86-a45a-d31bc4158fa5 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:12.423162 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b3d77967-3639-4613-988c-fad159222779 req-9fc62c06-c364-4b86-a45a-d31bc4158fa5 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:12.430350 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b3d77967-3639-4613-988c-fad159222779 req-9fc62c06-c364-4b86-a45a-d31bc4158fa5 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:12.474000 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-b3d77967-3639-4613-988c-fad159222779 req-9fc62c06-c364-4b86-a45a-d31bc4158fa5 service nova] Creating event network-vif-deleted:64cd98dc-f0a6-48bf-8d28-c436245cd37a for instance a4d9c0ea-c890-4629-929b-29c720603db9 on n-h1-master-1 Aug 07 01:44:12.485707 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-b3d77967-3639-4613-988c-fad159222779 req-9fc62c06-c364-4b86-a45a-d31bc4158fa5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099600 Aug 07 01:44:12.486880 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2565/5593] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:44:12.554685 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6f6aaae2-fad9-4047-8353-2a6073d78498 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68324eedf5c840f4806f4c4ae410774f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3139e77141f84e2485d2ba5d305f4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:44:12.565590 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6f6aaae2-fad9-4047-8353-2a6073d78498 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] 10.222.0.39 "GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9" status: 200 len: 1230 microversion: 2.1 time: 0.643552 Aug 07 01:44:12.571490 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3029/5594] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:44:11 2022] GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9 => generated 1230 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:44:13.587146 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b2395d62-af40-413e-932a-3c6b652ede0e tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:44:13.588536 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b2395d62-af40-413e-932a-3c6b652ede0e tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] [instance: a4d9c0ea-c890-4629-929b-29c720603db9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:44:13.609398 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2395d62-af40-413e-932a-3c6b652ede0e tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:13.610261 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2395d62-af40-413e-932a-3c6b652ede0e tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:13.617749 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2395d62-af40-413e-932a-3c6b652ede0e tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:13.621177 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2395d62-af40-413e-932a-3c6b652ede0e tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:13.622262 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2395d62-af40-413e-932a-3c6b652ede0e tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:13.622685 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2395d62-af40-413e-932a-3c6b652ede0e tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:13.816891 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b2395d62-af40-413e-932a-3c6b652ede0e tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68324eedf5c840f4806f4c4ae410774f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3139e77141f84e2485d2ba5d305f4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:44:13.834378 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b2395d62-af40-413e-932a-3c6b652ede0e tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] 10.222.0.39 "GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9" status: 200 len: 1230 microversion: 2.1 time: 0.251358 Aug 07 01:44:13.834981 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2566/5595] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:44:13 2022] GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9 => generated 1230 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:44:14.856184 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f9b6ffda-1ae1-4f52-8942-ffee343a5262 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:44:14.857540 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f9b6ffda-1ae1-4f52-8942-ffee343a5262 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] [instance: a4d9c0ea-c890-4629-929b-29c720603db9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:44:14.870253 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f9b6ffda-1ae1-4f52-8942-ffee343a5262 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:14.873918 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f9b6ffda-1ae1-4f52-8942-ffee343a5262 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:14.874686 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f9b6ffda-1ae1-4f52-8942-ffee343a5262 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:14.876967 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f9b6ffda-1ae1-4f52-8942-ffee343a5262 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:14.878746 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f9b6ffda-1ae1-4f52-8942-ffee343a5262 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:14.880835 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f9b6ffda-1ae1-4f52-8942-ffee343a5262 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:15.117820 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f9b6ffda-1ae1-4f52-8942-ffee343a5262 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68324eedf5c840f4806f4c4ae410774f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3139e77141f84e2485d2ba5d305f4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:44:15.164040 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f9b6ffda-1ae1-4f52-8942-ffee343a5262 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] 10.222.0.39 "GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9" status: 200 len: 1230 microversion: 2.1 time: 0.311224 Aug 07 01:44:15.182566 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3030/5596] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:44:14 2022] GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9 => generated 1230 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:44:15.605006 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-442ad767-ad0f-4938-9c5c-b8c29c9ce396 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:44:15.605673 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-442ad767-ad0f-4938-9c5c-b8c29c9ce396 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:44:15.622523 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-442ad767-ad0f-4938-9c5c-b8c29c9ce396 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:15.623178 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-442ad767-ad0f-4938-9c5c-b8c29c9ce396 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:15.624478 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-442ad767-ad0f-4938-9c5c-b8c29c9ce396 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:15.625724 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-442ad767-ad0f-4938-9c5c-b8c29c9ce396 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:15.626408 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-442ad767-ad0f-4938-9c5c-b8c29c9ce396 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:15.627059 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-442ad767-ad0f-4938-9c5c-b8c29c9ce396 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:15.674675 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-442ad767-ad0f-4938-9c5c-b8c29c9ce396 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] HTTP exception thrown: Instance 0d2f04ca-7c24-4d1a-a723-7cf3a8782976 could not be found. Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-442ad767-ad0f-4938-9c5c-b8c29c9ce396 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Request method failure captured: Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 HTTP/1.1 Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xdHeORiS6YWMHnUJygRGszSNIG1JhGoKcoBSmXw0JuemXQOUZ7u2oZVNnGzA3TBr4c7vXwq1ZMaruUYdg1nhcCvtacS7m-HVh9cvqJkdgIvMA9_zdpwP_5c3M05G_7pXM09STwSj5ER44J8qlDDM7BzjCwL1d7yDBkzz3MYyqojQrk Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: fd244ec665474b3896678f34d6491574 Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-AttachVolumeTestJSON-730710293 Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd244ec665474b3896678f34d6491574"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fd244ec665474b3896678f34d6491574", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd244ec665474b3896678f34d6491574"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fd244ec665474b3896678f34d6491574"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-AttachVolumeTestJSON-730710293 Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: fd244ec665474b3896678f34d6491574 Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-AttachVolumeTestJSON-730710293 Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-AttachVolumeTestJSON-730710293-project Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 2d8e76eb694846cabc55fc8e825c8e43 Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-AttachVolumeTestJSON-730710293-project Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 0d2f04ca-7c24-4d1a-a723-7cf3a8782976 could not be found. Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '0d2f04ca-7c24-4d1a-a723-7cf3a8782976'} Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d2f04ca-7c24-4d1a-a723-7cf3a8782976 could not be found. Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:44:15.678680 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:44:15.682802 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d2f04ca-7c24-4d1a-a723-7cf3a8782976 could not be found. Aug 07 01:44:15.682802 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:44:15.682802 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:44:15.682802 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:44:15.682802 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:44:15.682802 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:44:15.682802 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:44:15.682802 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:44:15.682802 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:44:15.682802 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d2f04ca-7c24-4d1a-a723-7cf3a8782976 could not be found. Aug 07 01:44:15.682802 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:44:15.686173 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-442ad767-ad0f-4938-9c5c-b8c29c9ce396 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Returning 404 to user: Instance 0d2f04ca-7c24-4d1a-a723-7cf3a8782976 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:44:15.689510 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-442ad767-ad0f-4938-9c5c-b8c29c9ce396 tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 404 len: 111 microversion: 2.1 time: 0.089674 Aug 07 01:44:15.691527 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2567/5597] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:44:15 2022] DELETE /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:44:15.699664 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1bdfea30-532f-4764-93cb-564ef243911d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:44:15.700526 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1bdfea30-532f-4764-93cb-564ef243911d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] [instance: 0d2f04ca-7c24-4d1a-a723-7cf3a8782976] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:44:15.726589 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1bdfea30-532f-4764-93cb-564ef243911d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:15.730092 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1bdfea30-532f-4764-93cb-564ef243911d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:15.734218 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1bdfea30-532f-4764-93cb-564ef243911d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:15.735044 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1bdfea30-532f-4764-93cb-564ef243911d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:15.735527 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1bdfea30-532f-4764-93cb-564ef243911d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:15.740950 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1bdfea30-532f-4764-93cb-564ef243911d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:15.797495 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-1bdfea30-532f-4764-93cb-564ef243911d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] HTTP exception thrown: Instance 0d2f04ca-7c24-4d1a-a723-7cf3a8782976 could not be found. Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1bdfea30-532f-4764-93cb-564ef243911d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Request method failure captured: Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 HTTP/1.1 Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xdHeORiS6YWMHnUJygRGszSNIG1JhGoKcoBSmXw0JuemXQOUZ7u2oZVNnGzA3TBr4c7vXwq1ZMaruUYdg1nhcCvtacS7m-HVh9cvqJkdgIvMA9_zdpwP_5c3M05G_7pXM09STwSj5ER44J8qlDDM7BzjCwL1d7yDBkzz3MYyqojQrk Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: fd244ec665474b3896678f34d6491574 Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-AttachVolumeTestJSON-730710293 Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd244ec665474b3896678f34d6491574"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fd244ec665474b3896678f34d6491574", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd244ec665474b3896678f34d6491574"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fd244ec665474b3896678f34d6491574"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-AttachVolumeTestJSON-730710293 Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: fd244ec665474b3896678f34d6491574 Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-AttachVolumeTestJSON-730710293 Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-AttachVolumeTestJSON-730710293-project Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 2d8e76eb694846cabc55fc8e825c8e43 Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-AttachVolumeTestJSON-730710293-project Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 0d2f04ca-7c24-4d1a-a723-7cf3a8782976 could not be found. Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '0d2f04ca-7c24-4d1a-a723-7cf3a8782976'} Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d2f04ca-7c24-4d1a-a723-7cf3a8782976 could not be found. Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d2f04ca-7c24-4d1a-a723-7cf3a8782976 could not be found. Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:44:15.800886 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:44:15.805807 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:44:15.805807 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:44:15.805807 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:44:15.805807 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:44:15.805807 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:44:15.805807 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d2f04ca-7c24-4d1a-a723-7cf3a8782976 could not be found. Aug 07 01:44:15.805807 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:44:15.820258 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1bdfea30-532f-4764-93cb-564ef243911d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] Returning 404 to user: Instance 0d2f04ca-7c24-4d1a-a723-7cf3a8782976 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:44:15.830891 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1bdfea30-532f-4764-93cb-564ef243911d tempest-AttachVolumeTestJSON-730710293 tempest-AttachVolumeTestJSON-730710293-project] 10.222.0.39 "GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976" status: 404 len: 111 microversion: 2.1 time: 0.133941 Aug 07 01:44:15.833608 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3031/5598] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:44:15 2022] GET /compute/v2.1/servers/0d2f04ca-7c24-4d1a-a723-7cf3a8782976 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:44:16.188618 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-94706b8a-c14c-41e3-b69b-540c5def41d2 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:44:16.188948 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-94706b8a-c14c-41e3-b69b-540c5def41d2 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] [instance: a4d9c0ea-c890-4629-929b-29c720603db9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:44:16.196190 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94706b8a-c14c-41e3-b69b-540c5def41d2 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:16.202724 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94706b8a-c14c-41e3-b69b-540c5def41d2 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:16.203395 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94706b8a-c14c-41e3-b69b-540c5def41d2 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:16.212849 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94706b8a-c14c-41e3-b69b-540c5def41d2 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:16.216161 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94706b8a-c14c-41e3-b69b-540c5def41d2 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:16.216815 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94706b8a-c14c-41e3-b69b-540c5def41d2 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:16.905910 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-94706b8a-c14c-41e3-b69b-540c5def41d2 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68324eedf5c840f4806f4c4ae410774f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3139e77141f84e2485d2ba5d305f4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:44:16.920675 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-94706b8a-c14c-41e3-b69b-540c5def41d2 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] 10.222.0.39 "GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9" status: 200 len: 1230 microversion: 2.1 time: 0.735958 Aug 07 01:44:16.921688 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2568/5599] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:44:16 2022] GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9 => generated 1230 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:44:17.948206 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-33079161-a326-449d-933d-50d7d8431c8b tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:44:17.949465 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-33079161-a326-449d-933d-50d7d8431c8b tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] [instance: a4d9c0ea-c890-4629-929b-29c720603db9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:44:17.962882 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33079161-a326-449d-933d-50d7d8431c8b tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:17.972946 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33079161-a326-449d-933d-50d7d8431c8b tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:17.973679 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33079161-a326-449d-933d-50d7d8431c8b tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:17.980939 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33079161-a326-449d-933d-50d7d8431c8b tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:17.981698 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33079161-a326-449d-933d-50d7d8431c8b tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:17.982302 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33079161-a326-449d-933d-50d7d8431c8b tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:18.162459 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-33079161-a326-449d-933d-50d7d8431c8b tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68324eedf5c840f4806f4c4ae410774f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3139e77141f84e2485d2ba5d305f4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:44:18.183395 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-33079161-a326-449d-933d-50d7d8431c8b tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] 10.222.0.39 "GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9" status: 200 len: 1230 microversion: 2.1 time: 0.238973 Aug 07 01:44:18.184751 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3032/5600] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:44:17 2022] GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9 => generated 1230 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:44:19.211494 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-32761a89-c43a-4eae-9f5b-3122ddceb66a tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:44:19.213054 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-32761a89-c43a-4eae-9f5b-3122ddceb66a tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] [instance: a4d9c0ea-c890-4629-929b-29c720603db9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:44:19.245384 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-32761a89-c43a-4eae-9f5b-3122ddceb66a tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:19.245820 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-32761a89-c43a-4eae-9f5b-3122ddceb66a tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:19.246273 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-32761a89-c43a-4eae-9f5b-3122ddceb66a tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:19.251470 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-32761a89-c43a-4eae-9f5b-3122ddceb66a tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:19.252030 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-32761a89-c43a-4eae-9f5b-3122ddceb66a tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:19.252486 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-32761a89-c43a-4eae-9f5b-3122ddceb66a tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:19.564689 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-32761a89-c43a-4eae-9f5b-3122ddceb66a tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68324eedf5c840f4806f4c4ae410774f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3139e77141f84e2485d2ba5d305f4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:44:19.579462 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-32761a89-c43a-4eae-9f5b-3122ddceb66a tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] 10.222.0.39 "GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9" status: 200 len: 1230 microversion: 2.1 time: 0.373820 Aug 07 01:44:19.584502 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2569/5601] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:44:19 2022] GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9 => generated 1230 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:44:20.619504 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-87e32c45-d11e-41dd-80de-1aced2f2d21b tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:44:20.624898 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-87e32c45-d11e-41dd-80de-1aced2f2d21b tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] [instance: a4d9c0ea-c890-4629-929b-29c720603db9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:44:20.652223 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-87e32c45-d11e-41dd-80de-1aced2f2d21b tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:20.659386 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-87e32c45-d11e-41dd-80de-1aced2f2d21b tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:20.660219 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-87e32c45-d11e-41dd-80de-1aced2f2d21b tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:20.661080 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-87e32c45-d11e-41dd-80de-1aced2f2d21b tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:20.661726 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-87e32c45-d11e-41dd-80de-1aced2f2d21b tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:20.662769 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-87e32c45-d11e-41dd-80de-1aced2f2d21b tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:21.086503 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-87e32c45-d11e-41dd-80de-1aced2f2d21b tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68324eedf5c840f4806f4c4ae410774f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3139e77141f84e2485d2ba5d305f4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:44:21.100484 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-87e32c45-d11e-41dd-80de-1aced2f2d21b tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] 10.222.0.39 "GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9" status: 200 len: 1230 microversion: 2.1 time: 0.495226 Aug 07 01:44:21.108413 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3033/5602] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:44:20 2022] GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9 => generated 1230 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:44:22.146710 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-208644e8-6398-47d1-a873-12d7f06937c0 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:44:22.147336 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-208644e8-6398-47d1-a873-12d7f06937c0 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] [instance: a4d9c0ea-c890-4629-929b-29c720603db9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:44:22.166336 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-208644e8-6398-47d1-a873-12d7f06937c0 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:22.166833 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-208644e8-6398-47d1-a873-12d7f06937c0 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:22.167275 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-208644e8-6398-47d1-a873-12d7f06937c0 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:22.168115 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-208644e8-6398-47d1-a873-12d7f06937c0 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:22.168579 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-208644e8-6398-47d1-a873-12d7f06937c0 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:22.169010 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-208644e8-6398-47d1-a873-12d7f06937c0 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:22.213854 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-208644e8-6398-47d1-a873-12d7f06937c0 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] HTTP exception thrown: Instance a4d9c0ea-c890-4629-929b-29c720603db9 could not be found. Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-208644e8-6398-47d1-a873-12d7f06937c0 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Request method failure captured: Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9 HTTP/1.1 Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xeNS6ECUnKxEDtr0pbSiGLoqtSzo5YuQc1RxSVZhr42jn2L5ji8p4x01uiUXtLmTP6hBQz_3gZs1zGlxIjgWx_3zQ6oeBN6g1BpXvgxpJ9FNY4IQsITSMwkh8Kel_9SZdJABH3yaQ5HcVADCgxrDK3K92oZG1s_loplFUBednaEw2A Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 3139e77141f84e2485d2ba5d305f4ec7 Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-TestVolumeBackupRestore-1861286021 Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3139e77141f84e2485d2ba5d305f4ec7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3139e77141f84e2485d2ba5d305f4ec7", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3139e77141f84e2485d2ba5d305f4ec7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3139e77141f84e2485d2ba5d305f4ec7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-TestVolumeBackupRestore-1861286021 Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 3139e77141f84e2485d2ba5d305f4ec7 Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1861286021 Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-TestVolumeBackupRestore-1861286021-project Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 68324eedf5c840f4806f4c4ae410774f Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-TestVolumeBackupRestore-1861286021-project Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: exception: Instance a4d9c0ea-c890-4629-929b-29c720603db9 could not be found. Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'a4d9c0ea-c890-4629-929b-29c720603db9'} Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4d9c0ea-c890-4629-929b-29c720603db9 could not be found. Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4d9c0ea-c890-4629-929b-29c720603db9 could not be found. Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:44:22.215969 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:44:22.223983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:44:22.223983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:44:22.223983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:44:22.223983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:44:22.223983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:44:22.223983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4d9c0ea-c890-4629-929b-29c720603db9 could not be found. Aug 07 01:44:22.223983 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:44:22.223983 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-208644e8-6398-47d1-a873-12d7f06937c0 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Returning 404 to user: Instance a4d9c0ea-c890-4629-929b-29c720603db9 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:44:22.223983 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-208644e8-6398-47d1-a873-12d7f06937c0 tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] 10.222.0.39 "GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9" status: 404 len: 111 microversion: 2.1 time: 0.084284 Aug 07 01:44:22.223983 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2570/5603] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:44:22 2022] GET /compute/v2.1/servers/a4d9c0ea-c890-4629-929b-29c720603db9 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:44:23.181616 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-231a838c-8ad1-4531-bd34-2d03e9d64f9b tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] Calling method '.version_select at 0x7f9e24900160>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:44:23.245398 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-231a838c-8ad1-4531-bd34-2d03e9d64f9b tempest-TestVolumeBackupRestore-1861286021 tempest-TestVolumeBackupRestore-1861286021-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1383916573" status: 202 len: 0 microversion: 2.1 time: 0.068834 Aug 07 01:44:23.245935 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3034/5604] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Aug 7 01:44:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1383916573 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:44:27.891700 n-d-master-1 devstack@n-api.service[119517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 01:44:27.892309 n-d-master-1 devstack@n-api.service[119517]: Sun Aug 7 01:44:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 01:44:39.880068 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d7b928f7-20ae-442c-aa90-827eaba4ebd0 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2114297931", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "b110fa06-2b5e-46cb-9935-8484b07654f4"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:44:39.908893 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:39.913078 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:40.858447 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-d7b928f7-20ae-442c-aa90-827eaba4ebd0 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] validate_networks() for [('b110fa06-2b5e-46cb-9935-8484b07654f4', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:44:42.212861 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=38 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:42.213646 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:42.228916 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-aed93c61-861d-4f3d-bd3a-14b9ff16eb09 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1799581909", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:44:42.977611 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-aed93c61-861d-4f3d-bd3a-14b9ff16eb09 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] validate_networks() for None {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:44:44.150537 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-d7b928f7-20ae-442c-aa90-827eaba4ebd0 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:44:44.152404 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-d7b928f7-20ae-442c-aa90-827eaba4ebd0 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:44:44.156953 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-d7b928f7-20ae-442c-aa90-827eaba4ebd0 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:44:44.158854 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-d7b928f7-20ae-442c-aa90-827eaba4ebd0 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:44:44.161304 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-d7b928f7-20ae-442c-aa90-827eaba4ebd0 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:44:44.183573 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7b928f7-20ae-442c-aa90-827eaba4ebd0 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:44.185453 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7b928f7-20ae-442c-aa90-827eaba4ebd0 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:44.186198 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7b928f7-20ae-442c-aa90-827eaba4ebd0 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:44.187795 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7b928f7-20ae-442c-aa90-827eaba4ebd0 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:44.188533 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7b928f7-20ae-442c-aa90-827eaba4ebd0 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:44.189176 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7b928f7-20ae-442c-aa90-827eaba4ebd0 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:44.285759 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-d7b928f7-20ae-442c-aa90-827eaba4ebd0 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Getting quotas for project 5e7d677cea9a4349bc788e6717763915. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:44:44.312363 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-d7b928f7-20ae-442c-aa90-827eaba4ebd0 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Getting quotas for user 84e60500a5354328990e61423f46f381 and project 5e7d677cea9a4349bc788e6717763915. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:44:44.347459 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d7b928f7-20ae-442c-aa90-827eaba4ebd0 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:44:44.349832 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d7b928f7-20ae-442c-aa90-827eaba4ebd0 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 3cb0cd43-054e-4054-b2ca-bfe00c79471e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:44:44.371065 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-aed93c61-861d-4f3d-bd3a-14b9ff16eb09 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:44:44.372373 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-aed93c61-861d-4f3d-bd3a-14b9ff16eb09 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:44:44.372926 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-aed93c61-861d-4f3d-bd3a-14b9ff16eb09 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:44:44.373408 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-aed93c61-861d-4f3d-bd3a-14b9ff16eb09 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:44:44.373838 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-aed93c61-861d-4f3d-bd3a-14b9ff16eb09 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:44:44.414662 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aed93c61-861d-4f3d-bd3a-14b9ff16eb09 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:44.415255 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aed93c61-861d-4f3d-bd3a-14b9ff16eb09 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:44.419748 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aed93c61-861d-4f3d-bd3a-14b9ff16eb09 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:44.423745 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aed93c61-861d-4f3d-bd3a-14b9ff16eb09 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:44.426562 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aed93c61-861d-4f3d-bd3a-14b9ff16eb09 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:44.427038 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aed93c61-861d-4f3d-bd3a-14b9ff16eb09 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:44.491146 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d7b928f7-20ae-442c-aa90-827eaba4ebd0 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.615893 Aug 07 01:44:44.497483 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2571/5605] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:44:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 4623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:44:44.509048 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-aed93c61-861d-4f3d-bd3a-14b9ff16eb09 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Getting quotas for project 7bbd14acc689493b84d8fa6d0137bdbf. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:44:44.516620 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4bc95bc7-2dd3-4ca7-92a9-4c8c7d874a88 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:44:44.517250 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4bc95bc7-2dd3-4ca7-92a9-4c8c7d874a88 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 3cb0cd43-054e-4054-b2ca-bfe00c79471e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:44:44.528967 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-aed93c61-861d-4f3d-bd3a-14b9ff16eb09 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Getting quotas for user fe0eddcab4c14931b7c20f86f3115981 and project 7bbd14acc689493b84d8fa6d0137bdbf. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:44:44.581448 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-aed93c61-861d-4f3d-bd3a-14b9ff16eb09 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:44:44.588862 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-aed93c61-861d-4f3d-bd3a-14b9ff16eb09 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] [instance: a271510f-d551-4e39-a247-eeedd504cedf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:44:44.733113 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-aed93c61-861d-4f3d-bd3a-14b9ff16eb09 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.522805 Aug 07 01:44:44.746992 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3035/5606] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:44:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 07 01:44:44.765589 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ed87fdfc-2290-40b7-bbc2-1e2bb804a921 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:44:44.766829 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ed87fdfc-2290-40b7-bbc2-1e2bb804a921 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] [instance: a271510f-d551-4e39-a247-eeedd504cedf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:44:44.997709 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ed87fdfc-2290-40b7-bbc2-1e2bb804a921 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0eddcab4c14931b7c20f86f3115981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbd14acc689493b84d8fa6d0137bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:44:45.011858 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ed87fdfc-2290-40b7-bbc2-1e2bb804a921 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] 10.222.0.39 "GET /compute/v2.1/servers/a271510f-d551-4e39-a247-eeedd504cedf" status: 200 len: 1214 microversion: 2.1 time: 0.259598 Aug 07 01:44:45.030507 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3036/5607] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:44:44 2022] GET /compute/v2.1/servers/a271510f-d551-4e39-a247-eeedd504cedf => generated 1214 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:44:45.213111 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4bc95bc7-2dd3-4ca7-92a9-4c8c7d874a88 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e60500a5354328990e61423f46f381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d677cea9a4349bc788e6717763915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:44:45.236955 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4bc95bc7-2dd3-4ca7-92a9-4c8c7d874a88 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e" status: 200 len: 1214 microversion: 2.1 time: 0.732332 Aug 07 01:44:45.240923 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2572/5608] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:44:44 2022] GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e => generated 1214 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:44:46.050474 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3b02d670-f9bf-4f35-9dc5-ad1b26a4beb0 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:44:46.051124 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3b02d670-f9bf-4f35-9dc5-ad1b26a4beb0 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] [instance: a271510f-d551-4e39-a247-eeedd504cedf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:44:46.200885 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b02d670-f9bf-4f35-9dc5-ad1b26a4beb0 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:46.201053 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b02d670-f9bf-4f35-9dc5-ad1b26a4beb0 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:46.201705 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b02d670-f9bf-4f35-9dc5-ad1b26a4beb0 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:46.203746 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b02d670-f9bf-4f35-9dc5-ad1b26a4beb0 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:46.206600 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b02d670-f9bf-4f35-9dc5-ad1b26a4beb0 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:46.208409 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b02d670-f9bf-4f35-9dc5-ad1b26a4beb0 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:46.259604 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-58d32363-a599-448a-94af-c969e988d416 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:44:46.262957 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-58d32363-a599-448a-94af-c969e988d416 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 3cb0cd43-054e-4054-b2ca-bfe00c79471e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:44:46.297166 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-58d32363-a599-448a-94af-c969e988d416 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:46.306885 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-58d32363-a599-448a-94af-c969e988d416 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:46.307332 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-58d32363-a599-448a-94af-c969e988d416 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:46.310257 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-58d32363-a599-448a-94af-c969e988d416 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:46.314975 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-58d32363-a599-448a-94af-c969e988d416 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:46.316093 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-58d32363-a599-448a-94af-c969e988d416 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:46.577596 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3b02d670-f9bf-4f35-9dc5-ad1b26a4beb0 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0eddcab4c14931b7c20f86f3115981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbd14acc689493b84d8fa6d0137bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:44:46.591065 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3b02d670-f9bf-4f35-9dc5-ad1b26a4beb0 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] 10.222.0.39 "GET /compute/v2.1/servers/a271510f-d551-4e39-a247-eeedd504cedf" status: 200 len: 1218 microversion: 2.1 time: 0.558090 Aug 07 01:44:46.594787 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3037/5609] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:44:46 2022] GET /compute/v2.1/servers/a271510f-d551-4e39-a247-eeedd504cedf => generated 1218 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:44:47.235748 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-58d32363-a599-448a-94af-c969e988d416 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e60500a5354328990e61423f46f381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d677cea9a4349bc788e6717763915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:44:47.295071 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-58d32363-a599-448a-94af-c969e988d416 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e" status: 200 len: 1210 microversion: 2.1 time: 1.033546 Aug 07 01:44:47.298670 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2573/5610] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:44:46 2022] GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e => generated 1210 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:44:47.624653 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-af9da895-9e13-4fc2-9750-735e5cec370a tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:44:47.625387 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-af9da895-9e13-4fc2-9750-735e5cec370a tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] [instance: a271510f-d551-4e39-a247-eeedd504cedf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:44:47.637275 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af9da895-9e13-4fc2-9750-735e5cec370a tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:47.645407 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af9da895-9e13-4fc2-9750-735e5cec370a tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:47.646448 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af9da895-9e13-4fc2-9750-735e5cec370a tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:47.650904 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af9da895-9e13-4fc2-9750-735e5cec370a tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:47.653455 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af9da895-9e13-4fc2-9750-735e5cec370a tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:47.654003 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-af9da895-9e13-4fc2-9750-735e5cec370a tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:48.327588 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-967a5e02-1973-40c4-88ab-8bd1e007f41b tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:44:48.328411 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-967a5e02-1973-40c4-88ab-8bd1e007f41b tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 3cb0cd43-054e-4054-b2ca-bfe00c79471e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:44:48.344583 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-967a5e02-1973-40c4-88ab-8bd1e007f41b tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:48.350379 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-967a5e02-1973-40c4-88ab-8bd1e007f41b tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:48.352561 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-967a5e02-1973-40c4-88ab-8bd1e007f41b tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:48.353354 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-967a5e02-1973-40c4-88ab-8bd1e007f41b tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:48.353839 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-967a5e02-1973-40c4-88ab-8bd1e007f41b tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:48.354275 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-967a5e02-1973-40c4-88ab-8bd1e007f41b tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:48.378821 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-af9da895-9e13-4fc2-9750-735e5cec370a tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0eddcab4c14931b7c20f86f3115981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbd14acc689493b84d8fa6d0137bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:44:48.393359 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-af9da895-9e13-4fc2-9750-735e5cec370a tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] 10.222.0.39 "GET /compute/v2.1/servers/a271510f-d551-4e39-a247-eeedd504cedf" status: 200 len: 1284 microversion: 2.1 time: 0.780739 Aug 07 01:44:48.409097 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3038/5611] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:44:47 2022] GET /compute/v2.1/servers/a271510f-d551-4e39-a247-eeedd504cedf => generated 1284 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:44:48.700209 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-967a5e02-1973-40c4-88ab-8bd1e007f41b tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e60500a5354328990e61423f46f381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d677cea9a4349bc788e6717763915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:44:48.709605 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-967a5e02-1973-40c4-88ab-8bd1e007f41b tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e" status: 200 len: 1272 microversion: 2.1 time: 0.390911 Aug 07 01:44:48.714114 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2574/5612] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:44:48 2022] GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e => generated 1272 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:44:49.419171 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-28404527-c30a-4596-9071-10fdb1cecbd2 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:44:49.419796 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-28404527-c30a-4596-9071-10fdb1cecbd2 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] [instance: a271510f-d551-4e39-a247-eeedd504cedf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:44:49.434332 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-28404527-c30a-4596-9071-10fdb1cecbd2 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:49.437799 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-28404527-c30a-4596-9071-10fdb1cecbd2 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:49.440041 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-28404527-c30a-4596-9071-10fdb1cecbd2 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:49.443843 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-28404527-c30a-4596-9071-10fdb1cecbd2 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:49.444452 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-28404527-c30a-4596-9071-10fdb1cecbd2 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:49.446772 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-28404527-c30a-4596-9071-10fdb1cecbd2 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:49.736269 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-59c3e783-a91f-4d3f-a36a-310a6885e763 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:44:49.737555 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-59c3e783-a91f-4d3f-a36a-310a6885e763 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 3cb0cd43-054e-4054-b2ca-bfe00c79471e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:44:49.754891 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59c3e783-a91f-4d3f-a36a-310a6885e763 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:49.755980 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59c3e783-a91f-4d3f-a36a-310a6885e763 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:49.756578 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59c3e783-a91f-4d3f-a36a-310a6885e763 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:49.758049 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59c3e783-a91f-4d3f-a36a-310a6885e763 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:49.758671 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59c3e783-a91f-4d3f-a36a-310a6885e763 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:49.759257 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59c3e783-a91f-4d3f-a36a-310a6885e763 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:49.941899 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-59c3e783-a91f-4d3f-a36a-310a6885e763 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e60500a5354328990e61423f46f381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d677cea9a4349bc788e6717763915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:44:49.953324 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-59c3e783-a91f-4d3f-a36a-310a6885e763 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e" status: 200 len: 1272 microversion: 2.1 time: 0.221072 Aug 07 01:44:49.967591 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2575/5613] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:44:49 2022] GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e => generated 1272 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:44:50.440981 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-28404527-c30a-4596-9071-10fdb1cecbd2 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0eddcab4c14931b7c20f86f3115981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbd14acc689493b84d8fa6d0137bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:44:50.453368 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-28404527-c30a-4596-9071-10fdb1cecbd2 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] 10.222.0.39 "GET /compute/v2.1/servers/a271510f-d551-4e39-a247-eeedd504cedf" status: 200 len: 1314 microversion: 2.1 time: 1.038503 Aug 07 01:44:50.471671 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3039/5614] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:44:49 2022] GET /compute/v2.1/servers/a271510f-d551-4e39-a247-eeedd504cedf => generated 1314 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:44:50.976979 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3cddc1b7-79e9-486a-9395-596d6b7d0f18 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:44:50.977605 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3cddc1b7-79e9-486a-9395-596d6b7d0f18 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 3cb0cd43-054e-4054-b2ca-bfe00c79471e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:44:51.005255 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3cddc1b7-79e9-486a-9395-596d6b7d0f18 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:51.007661 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3cddc1b7-79e9-486a-9395-596d6b7d0f18 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:51.010187 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3cddc1b7-79e9-486a-9395-596d6b7d0f18 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:51.021653 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3cddc1b7-79e9-486a-9395-596d6b7d0f18 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:51.027134 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3cddc1b7-79e9-486a-9395-596d6b7d0f18 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:51.032104 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3cddc1b7-79e9-486a-9395-596d6b7d0f18 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:51.290797 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3cddc1b7-79e9-486a-9395-596d6b7d0f18 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e60500a5354328990e61423f46f381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d677cea9a4349bc788e6717763915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:44:51.298691 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3cddc1b7-79e9-486a-9395-596d6b7d0f18 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e" status: 200 len: 1272 microversion: 2.1 time: 0.328326 Aug 07 01:44:51.299620 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2576/5615] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:44:50 2022] GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e => generated 1272 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:44:51.474534 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-905abb2d-bc1a-44bd-8fa3-3265ff977237 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:44:51.475152 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-905abb2d-bc1a-44bd-8fa3-3265ff977237 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] [instance: a271510f-d551-4e39-a247-eeedd504cedf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:44:51.490520 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-905abb2d-bc1a-44bd-8fa3-3265ff977237 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:51.491015 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-905abb2d-bc1a-44bd-8fa3-3265ff977237 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:51.491510 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-905abb2d-bc1a-44bd-8fa3-3265ff977237 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:51.492800 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-905abb2d-bc1a-44bd-8fa3-3265ff977237 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:51.493255 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-905abb2d-bc1a-44bd-8fa3-3265ff977237 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:51.493683 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-905abb2d-bc1a-44bd-8fa3-3265ff977237 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:51.556228 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-3da31188-1bf7-4b22-8005-f9e6c514a00b req-eb55c975-1473-494d-b802-3a7f6cd1a7f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a271510f-d551-4e39-a247-eeedd504cedf", "tag": "900f5a08-751a-48a0-8f10-e5ebc808fca2"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:44:51.576230 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3da31188-1bf7-4b22-8005-f9e6c514a00b req-eb55c975-1473-494d-b802-3a7f6cd1a7f9 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:51.576705 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3da31188-1bf7-4b22-8005-f9e6c514a00b req-eb55c975-1473-494d-b802-3a7f6cd1a7f9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:51.577342 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3da31188-1bf7-4b22-8005-f9e6c514a00b req-eb55c975-1473-494d-b802-3a7f6cd1a7f9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:51.605030 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-3da31188-1bf7-4b22-8005-f9e6c514a00b req-eb55c975-1473-494d-b802-3a7f6cd1a7f9 service nova] Creating event network-changed:900f5a08-751a-48a0-8f10-e5ebc808fca2 for instance a271510f-d551-4e39-a247-eeedd504cedf on n-h1-master-1 Aug 07 01:44:51.615443 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-3da31188-1bf7-4b22-8005-f9e6c514a00b req-eb55c975-1473-494d-b802-3a7f6cd1a7f9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064227 Aug 07 01:44:51.621159 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2577/5616] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:44:52.161619 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-905abb2d-bc1a-44bd-8fa3-3265ff977237 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0eddcab4c14931b7c20f86f3115981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbd14acc689493b84d8fa6d0137bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:44:52.178981 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-905abb2d-bc1a-44bd-8fa3-3265ff977237 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] 10.222.0.39 "GET /compute/v2.1/servers/a271510f-d551-4e39-a247-eeedd504cedf" status: 200 len: 1314 microversion: 2.1 time: 0.708086 Aug 07 01:44:52.197984 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3040/5617] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:44:51 2022] GET /compute/v2.1/servers/a271510f-d551-4e39-a247-eeedd504cedf => generated 1314 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:44:52.332166 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fa4dcfdc-b44d-46e0-8475-16df312a4c53 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:44:52.333636 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fa4dcfdc-b44d-46e0-8475-16df312a4c53 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 3cb0cd43-054e-4054-b2ca-bfe00c79471e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:44:52.340991 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa4dcfdc-b44d-46e0-8475-16df312a4c53 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:52.341844 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa4dcfdc-b44d-46e0-8475-16df312a4c53 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:52.342546 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa4dcfdc-b44d-46e0-8475-16df312a4c53 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:52.343768 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa4dcfdc-b44d-46e0-8475-16df312a4c53 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:52.344489 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa4dcfdc-b44d-46e0-8475-16df312a4c53 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:52.345167 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa4dcfdc-b44d-46e0-8475-16df312a4c53 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:52.762387 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fa4dcfdc-b44d-46e0-8475-16df312a4c53 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e60500a5354328990e61423f46f381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d677cea9a4349bc788e6717763915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:44:52.771621 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fa4dcfdc-b44d-46e0-8475-16df312a4c53 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e" status: 200 len: 1314 microversion: 2.1 time: 0.444546 Aug 07 01:44:52.772451 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2578/5618] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:44:52 2022] GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e => generated 1314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:44:53.204713 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-473893a4-3848-4d47-901e-f3cda4422373 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:44:53.205383 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-473893a4-3848-4d47-901e-f3cda4422373 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] [instance: a271510f-d551-4e39-a247-eeedd504cedf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:44:53.221044 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-473893a4-3848-4d47-901e-f3cda4422373 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:53.222970 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-473893a4-3848-4d47-901e-f3cda4422373 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:53.224808 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-473893a4-3848-4d47-901e-f3cda4422373 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:53.227091 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-473893a4-3848-4d47-901e-f3cda4422373 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:53.227808 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-473893a4-3848-4d47-901e-f3cda4422373 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:53.228453 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-473893a4-3848-4d47-901e-f3cda4422373 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:53.795690 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-efa98ccf-618d-46e8-9fdb-196a055956e7 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:44:53.796249 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-efa98ccf-618d-46e8-9fdb-196a055956e7 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 3cb0cd43-054e-4054-b2ca-bfe00c79471e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:44:53.815681 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-efa98ccf-618d-46e8-9fdb-196a055956e7 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:53.816224 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-efa98ccf-618d-46e8-9fdb-196a055956e7 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:53.816672 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-efa98ccf-618d-46e8-9fdb-196a055956e7 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:53.817410 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-efa98ccf-618d-46e8-9fdb-196a055956e7 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:53.817865 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-efa98ccf-618d-46e8-9fdb-196a055956e7 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:53.818352 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-efa98ccf-618d-46e8-9fdb-196a055956e7 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:53.839491 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-473893a4-3848-4d47-901e-f3cda4422373 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0eddcab4c14931b7c20f86f3115981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbd14acc689493b84d8fa6d0137bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:44:53.859999 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-473893a4-3848-4d47-901e-f3cda4422373 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] 10.222.0.39 "GET /compute/v2.1/servers/a271510f-d551-4e39-a247-eeedd504cedf" status: 200 len: 1314 microversion: 2.1 time: 0.661214 Aug 07 01:44:53.862686 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3041/5619] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:44:53 2022] GET /compute/v2.1/servers/a271510f-d551-4e39-a247-eeedd504cedf => generated 1314 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:44:54.237506 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:54.609297 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-efa98ccf-618d-46e8-9fdb-196a055956e7 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e60500a5354328990e61423f46f381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d677cea9a4349bc788e6717763915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:44:54.625236 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-efa98ccf-618d-46e8-9fdb-196a055956e7 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e" status: 200 len: 1314 microversion: 2.1 time: 0.835735 Aug 07 01:44:54.626490 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2579/5620] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:44:53 2022] GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e => generated 1314 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:44:54.888462 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-10f412bd-682f-4eee-aaf4-a70370c3f5bb tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:44:54.889094 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-10f412bd-682f-4eee-aaf4-a70370c3f5bb tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] [instance: a271510f-d551-4e39-a247-eeedd504cedf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:44:54.898035 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:54.908701 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10f412bd-682f-4eee-aaf4-a70370c3f5bb tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:54.910002 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10f412bd-682f-4eee-aaf4-a70370c3f5bb tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:54.910377 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10f412bd-682f-4eee-aaf4-a70370c3f5bb tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:54.911122 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10f412bd-682f-4eee-aaf4-a70370c3f5bb tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:54.911591 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10f412bd-682f-4eee-aaf4-a70370c3f5bb tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:54.916710 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10f412bd-682f-4eee-aaf4-a70370c3f5bb tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:55.021440 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=8 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:55.647017 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f3112770-dab5-4fde-aa44-1fab2845c922 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:44:55.647731 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f3112770-dab5-4fde-aa44-1fab2845c922 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 3cb0cd43-054e-4054-b2ca-bfe00c79471e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:44:55.655807 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=8 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:55.673780 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f3112770-dab5-4fde-aa44-1fab2845c922 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:55.674545 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f3112770-dab5-4fde-aa44-1fab2845c922 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:55.675199 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f3112770-dab5-4fde-aa44-1fab2845c922 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:55.676190 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f3112770-dab5-4fde-aa44-1fab2845c922 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:55.676917 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f3112770-dab5-4fde-aa44-1fab2845c922 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:55.677578 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f3112770-dab5-4fde-aa44-1fab2845c922 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:56.336822 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f3112770-dab5-4fde-aa44-1fab2845c922 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e60500a5354328990e61423f46f381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d677cea9a4349bc788e6717763915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:44:56.345705 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f3112770-dab5-4fde-aa44-1fab2845c922 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e" status: 200 len: 1314 microversion: 2.1 time: 0.702924 Aug 07 01:44:56.346279 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2580/5621] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:44:55 2022] GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e => generated 1314 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:44:56.356876 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-10f412bd-682f-4eee-aaf4-a70370c3f5bb tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0eddcab4c14931b7c20f86f3115981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbd14acc689493b84d8fa6d0137bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:44:56.366328 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-10f412bd-682f-4eee-aaf4-a70370c3f5bb tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] 10.222.0.39 "GET /compute/v2.1/servers/a271510f-d551-4e39-a247-eeedd504cedf" status: 200 len: 1314 microversion: 2.1 time: 1.482343 Aug 07 01:44:56.367436 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3042/5622] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:44:54 2022] GET /compute/v2.1/servers/a271510f-d551-4e39-a247-eeedd504cedf => generated 1314 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:44:56.369069 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-c2f4ce3b-bb72-4372-98fe-3dda3a43e420 req-649c7b1d-7483-4e89-ae8c-139a6b95b741 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cb0cd43-054e-4054-b2ca-bfe00c79471e", "tag": "9f029e18-1454-4448-b784-31f2278983e1"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:44:56.400081 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c2f4ce3b-bb72-4372-98fe-3dda3a43e420 req-649c7b1d-7483-4e89-ae8c-139a6b95b741 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:56.400545 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c2f4ce3b-bb72-4372-98fe-3dda3a43e420 req-649c7b1d-7483-4e89-ae8c-139a6b95b741 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:56.400990 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c2f4ce3b-bb72-4372-98fe-3dda3a43e420 req-649c7b1d-7483-4e89-ae8c-139a6b95b741 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:56.426888 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-c2f4ce3b-bb72-4372-98fe-3dda3a43e420 req-649c7b1d-7483-4e89-ae8c-139a6b95b741 service nova] Creating event network-changed:9f029e18-1454-4448-b784-31f2278983e1 for instance 3cb0cd43-054e-4054-b2ca-bfe00c79471e on n-h1-master-1 Aug 07 01:44:56.438345 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-c2f4ce3b-bb72-4372-98fe-3dda3a43e420 req-649c7b1d-7483-4e89-ae8c-139a6b95b741 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082090 Aug 07 01:44:56.440484 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2581/5623] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:44:57.367317 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2c6d07ae-04cc-44d8-9566-7bf0332a5ff8 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:44:57.368671 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2c6d07ae-04cc-44d8-9566-7bf0332a5ff8 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 3cb0cd43-054e-4054-b2ca-bfe00c79471e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:44:57.388733 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c6d07ae-04cc-44d8-9566-7bf0332a5ff8 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:57.389339 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c6d07ae-04cc-44d8-9566-7bf0332a5ff8 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:57.389776 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c6d07ae-04cc-44d8-9566-7bf0332a5ff8 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:57.394590 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c6d07ae-04cc-44d8-9566-7bf0332a5ff8 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:57.399135 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2061a76c-d30c-4198-b1fb-23c9604b389b tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:44:57.399834 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2061a76c-d30c-4198-b1fb-23c9604b389b tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] [instance: a271510f-d551-4e39-a247-eeedd504cedf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:44:57.401001 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c6d07ae-04cc-44d8-9566-7bf0332a5ff8 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:57.404648 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c6d07ae-04cc-44d8-9566-7bf0332a5ff8 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:57.422758 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2061a76c-d30c-4198-b1fb-23c9604b389b tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:57.424368 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2061a76c-d30c-4198-b1fb-23c9604b389b tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:57.424812 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2061a76c-d30c-4198-b1fb-23c9604b389b tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:57.427392 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2061a76c-d30c-4198-b1fb-23c9604b389b tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:57.427877 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2061a76c-d30c-4198-b1fb-23c9604b389b tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:57.435735 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2061a76c-d30c-4198-b1fb-23c9604b389b tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:58.064593 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2061a76c-d30c-4198-b1fb-23c9604b389b tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0eddcab4c14931b7c20f86f3115981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbd14acc689493b84d8fa6d0137bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:44:58.087133 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2061a76c-d30c-4198-b1fb-23c9604b389b tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] 10.222.0.39 "GET /compute/v2.1/servers/a271510f-d551-4e39-a247-eeedd504cedf" status: 200 len: 1314 microversion: 2.1 time: 0.693711 Aug 07 01:44:58.102453 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2582/5624] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:44:57 2022] GET /compute/v2.1/servers/a271510f-d551-4e39-a247-eeedd504cedf => generated 1314 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:44:58.118448 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-84e402b0-2639-4ff0-9c79-cddf6df0c3a3 req-64f366f7-9c17-4d87-9699-25ba78606e63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a271510f-d551-4e39-a247-eeedd504cedf", "name": "network-vif-plugged", "status": "completed", "tag": "900f5a08-751a-48a0-8f10-e5ebc808fca2"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:44:58.161524 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-84e402b0-2639-4ff0-9c79-cddf6df0c3a3 req-64f366f7-9c17-4d87-9699-25ba78606e63 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:58.167597 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-84e402b0-2639-4ff0-9c79-cddf6df0c3a3 req-64f366f7-9c17-4d87-9699-25ba78606e63 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:58.168296 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-84e402b0-2639-4ff0-9c79-cddf6df0c3a3 req-64f366f7-9c17-4d87-9699-25ba78606e63 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:58.185348 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-84e402b0-2639-4ff0-9c79-cddf6df0c3a3 req-64f366f7-9c17-4d87-9699-25ba78606e63 service nova] Creating event network-vif-plugged:900f5a08-751a-48a0-8f10-e5ebc808fca2 for instance a271510f-d551-4e39-a247-eeedd504cedf on n-h1-master-1 Aug 07 01:44:58.205061 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-84e402b0-2639-4ff0-9c79-cddf6df0c3a3 req-64f366f7-9c17-4d87-9699-25ba78606e63 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095455 Aug 07 01:44:58.206164 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2583/5625] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:44:58.577069 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2c6d07ae-04cc-44d8-9566-7bf0332a5ff8 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e60500a5354328990e61423f46f381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d677cea9a4349bc788e6717763915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:44:58.590219 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2c6d07ae-04cc-44d8-9566-7bf0332a5ff8 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e" status: 200 len: 1314 microversion: 2.1 time: 1.224716 Aug 07 01:44:58.593455 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3043/5626] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:44:57 2022] GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e => generated 1314 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:44:59.160284 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-844c7ec5-2582-4e8b-b8a4-c0dcc5482fff tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:44:59.162552 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-844c7ec5-2582-4e8b-b8a4-c0dcc5482fff tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] [instance: a271510f-d551-4e39-a247-eeedd504cedf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:44:59.216736 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-844c7ec5-2582-4e8b-b8a4-c0dcc5482fff tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:59.217768 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-844c7ec5-2582-4e8b-b8a4-c0dcc5482fff tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:59.218854 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-844c7ec5-2582-4e8b-b8a4-c0dcc5482fff tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:59.219757 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-844c7ec5-2582-4e8b-b8a4-c0dcc5482fff tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:59.220468 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-844c7ec5-2582-4e8b-b8a4-c0dcc5482fff tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:59.221230 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-844c7ec5-2582-4e8b-b8a4-c0dcc5482fff tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:59.617724 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f376d106-8429-4fb3-9779-a43362c04e0c tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:44:59.619110 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f376d106-8429-4fb3-9779-a43362c04e0c tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 3cb0cd43-054e-4054-b2ca-bfe00c79471e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:44:59.642711 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f376d106-8429-4fb3-9779-a43362c04e0c tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:59.644096 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f376d106-8429-4fb3-9779-a43362c04e0c tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:59.645239 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f376d106-8429-4fb3-9779-a43362c04e0c tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:59.651080 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f376d106-8429-4fb3-9779-a43362c04e0c tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:44:59.652226 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f376d106-8429-4fb3-9779-a43362c04e0c tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:44:59.654146 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f376d106-8429-4fb3-9779-a43362c04e0c tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:44:59.691965 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-844c7ec5-2582-4e8b-b8a4-c0dcc5482fff tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0eddcab4c14931b7c20f86f3115981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbd14acc689493b84d8fa6d0137bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:44:59.703147 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-844c7ec5-2582-4e8b-b8a4-c0dcc5482fff tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] 10.222.0.39 "GET /compute/v2.1/servers/a271510f-d551-4e39-a247-eeedd504cedf" status: 200 len: 1314 microversion: 2.1 time: 0.549938 Aug 07 01:44:59.709352 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2584/5627] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:44:59 2022] GET /compute/v2.1/servers/a271510f-d551-4e39-a247-eeedd504cedf => generated 1314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:45:00.739382 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1ddb5db4-48ef-41e3-8824-7ff2ff9644aa tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:45:00.740778 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1ddb5db4-48ef-41e3-8824-7ff2ff9644aa tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] [instance: a271510f-d551-4e39-a247-eeedd504cedf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:45:00.748952 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ddb5db4-48ef-41e3-8824-7ff2ff9644aa tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:00.749454 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ddb5db4-48ef-41e3-8824-7ff2ff9644aa tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:00.749894 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ddb5db4-48ef-41e3-8824-7ff2ff9644aa tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:00.750797 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ddb5db4-48ef-41e3-8824-7ff2ff9644aa tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:00.751413 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ddb5db4-48ef-41e3-8824-7ff2ff9644aa tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:00.752186 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ddb5db4-48ef-41e3-8824-7ff2ff9644aa tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:00.891526 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f376d106-8429-4fb3-9779-a43362c04e0c tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e60500a5354328990e61423f46f381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d677cea9a4349bc788e6717763915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:45:00.904186 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f376d106-8429-4fb3-9779-a43362c04e0c tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e" status: 200 len: 1314 microversion: 2.1 time: 1.292439 Aug 07 01:45:00.916832 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3044/5628] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:44:59 2022] GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e => generated 1314 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:45:01.237099 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1ddb5db4-48ef-41e3-8824-7ff2ff9644aa tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0eddcab4c14931b7c20f86f3115981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbd14acc689493b84d8fa6d0137bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:45:01.248913 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1ddb5db4-48ef-41e3-8824-7ff2ff9644aa tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] 10.222.0.39 "GET /compute/v2.1/servers/a271510f-d551-4e39-a247-eeedd504cedf" status: 200 len: 1463 microversion: 2.1 time: 0.518210 Aug 07 01:45:01.267695 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2585/5629] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:45:00 2022] GET /compute/v2.1/servers/a271510f-d551-4e39-a247-eeedd504cedf => generated 1463 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:45:01.273669 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-91899df4-1f37-4e39-977c-dd58f8389b15 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9ced1e8-3f27-4922-becc-00b612781999", "device": "/dev/sdb"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:45:01.279030 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-91899df4-1f37-4e39-977c-dd58f8389b15 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] [instance: a271510f-d551-4e39-a247-eeedd504cedf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:45:01.293937 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91899df4-1f37-4e39-977c-dd58f8389b15 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:01.296553 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91899df4-1f37-4e39-977c-dd58f8389b15 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:01.304548 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91899df4-1f37-4e39-977c-dd58f8389b15 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:01.307416 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91899df4-1f37-4e39-977c-dd58f8389b15 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:01.308314 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91899df4-1f37-4e39-977c-dd58f8389b15 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:01.309735 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91899df4-1f37-4e39-977c-dd58f8389b15 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:01.941673 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-23944da2-156a-43cc-8dc8-0e8786d8935d tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:45:01.942593 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-23944da2-156a-43cc-8dc8-0e8786d8935d tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 3cb0cd43-054e-4054-b2ca-bfe00c79471e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:45:01.959516 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23944da2-156a-43cc-8dc8-0e8786d8935d tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:01.960568 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23944da2-156a-43cc-8dc8-0e8786d8935d tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:01.961137 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23944da2-156a-43cc-8dc8-0e8786d8935d tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:01.962107 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23944da2-156a-43cc-8dc8-0e8786d8935d tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:01.962779 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23944da2-156a-43cc-8dc8-0e8786d8935d tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:01.963432 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23944da2-156a-43cc-8dc8-0e8786d8935d tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:01.966876 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-91899df4-1f37-4e39-977c-dd58f8389b15 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] 10.222.0.39 "POST /compute/v2.1/servers/a271510f-d551-4e39-a247-eeedd504cedf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.697134 Aug 07 01:45:01.968907 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3045/5630] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Aug 7 01:45:01 2022] POST /compute/v2.1/servers/a271510f-d551-4e39-a247-eeedd504cedf/os-volume_attachments => generated 194 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:45:02.934406 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-23944da2-156a-43cc-8dc8-0e8786d8935d tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e60500a5354328990e61423f46f381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d677cea9a4349bc788e6717763915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:45:02.943558 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-23944da2-156a-43cc-8dc8-0e8786d8935d tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e" status: 200 len: 1314 microversion: 2.1 time: 1.015976 Aug 07 01:45:02.949894 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2586/5631] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:45:01 2022] GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e => generated 1314 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:45:04.000786 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-74646928-30fb-4ee9-8419-e4febb239dbc tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:45:04.002174 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-74646928-30fb-4ee9-8419-e4febb239dbc tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 3cb0cd43-054e-4054-b2ca-bfe00c79471e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:45:04.020832 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-74646928-30fb-4ee9-8419-e4febb239dbc tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:04.021634 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-74646928-30fb-4ee9-8419-e4febb239dbc tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:04.022978 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-74646928-30fb-4ee9-8419-e4febb239dbc tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:04.023914 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-74646928-30fb-4ee9-8419-e4febb239dbc tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:04.024531 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-74646928-30fb-4ee9-8419-e4febb239dbc tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:04.025122 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-74646928-30fb-4ee9-8419-e4febb239dbc tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:05.114764 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-74646928-30fb-4ee9-8419-e4febb239dbc tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e60500a5354328990e61423f46f381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d677cea9a4349bc788e6717763915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:45:05.131092 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-74646928-30fb-4ee9-8419-e4febb239dbc tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e" status: 200 len: 1314 microversion: 2.1 time: 1.153180 Aug 07 01:45:05.133812 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3046/5632] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:45:03 2022] GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e => generated 1314 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:45:06.159529 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-62a18ae0-9e97-47ad-9541-98484903125f tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:45:06.160126 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-62a18ae0-9e97-47ad-9541-98484903125f tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 3cb0cd43-054e-4054-b2ca-bfe00c79471e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:45:06.182650 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-62a18ae0-9e97-47ad-9541-98484903125f tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:06.183143 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-62a18ae0-9e97-47ad-9541-98484903125f tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:06.183578 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-62a18ae0-9e97-47ad-9541-98484903125f tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:06.184331 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-62a18ae0-9e97-47ad-9541-98484903125f tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:06.184786 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-62a18ae0-9e97-47ad-9541-98484903125f tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:06.185212 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-62a18ae0-9e97-47ad-9541-98484903125f tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:06.560608 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-62a18ae0-9e97-47ad-9541-98484903125f tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e60500a5354328990e61423f46f381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d677cea9a4349bc788e6717763915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:45:06.581022 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-62a18ae0-9e97-47ad-9541-98484903125f tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e" status: 200 len: 1314 microversion: 2.1 time: 0.426082 Aug 07 01:45:06.581533 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2587/5633] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:45:06 2022] GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e => generated 1314 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:45:07.609216 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-72a18878-fc2a-408a-8362-686715519d85 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:45:07.615236 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-72a18878-fc2a-408a-8362-686715519d85 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 3cb0cd43-054e-4054-b2ca-bfe00c79471e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:45:07.627511 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72a18878-fc2a-408a-8362-686715519d85 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:07.630576 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72a18878-fc2a-408a-8362-686715519d85 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:07.632237 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72a18878-fc2a-408a-8362-686715519d85 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:07.633257 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72a18878-fc2a-408a-8362-686715519d85 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:07.636626 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72a18878-fc2a-408a-8362-686715519d85 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:07.637341 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-72a18878-fc2a-408a-8362-686715519d85 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:07.958937 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-6f45b95b-9fba-439f-9e48-dfc2d3aa6612 req-d48b3c30-137d-41c8-a8ac-fdb709eedb10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cb0cd43-054e-4054-b2ca-bfe00c79471e", "name": "network-vif-plugged", "status": "completed", "tag": "9f029e18-1454-4448-b784-31f2278983e1"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:45:07.999432 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6f45b95b-9fba-439f-9e48-dfc2d3aa6612 req-d48b3c30-137d-41c8-a8ac-fdb709eedb10 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:08.001590 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6f45b95b-9fba-439f-9e48-dfc2d3aa6612 req-d48b3c30-137d-41c8-a8ac-fdb709eedb10 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:08.002245 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6f45b95b-9fba-439f-9e48-dfc2d3aa6612 req-d48b3c30-137d-41c8-a8ac-fdb709eedb10 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:08.038009 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-6f45b95b-9fba-439f-9e48-dfc2d3aa6612 req-d48b3c30-137d-41c8-a8ac-fdb709eedb10 service nova] Creating event network-vif-plugged:9f029e18-1454-4448-b784-31f2278983e1 for instance 3cb0cd43-054e-4054-b2ca-bfe00c79471e on n-h1-master-1 Aug 07 01:45:08.044300 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-6f45b95b-9fba-439f-9e48-dfc2d3aa6612 req-d48b3c30-137d-41c8-a8ac-fdb709eedb10 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093248 Aug 07 01:45:08.045399 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2588/5634] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:45:09.469936 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-72a18878-fc2a-408a-8362-686715519d85 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e60500a5354328990e61423f46f381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d677cea9a4349bc788e6717763915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:45:09.478383 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-72a18878-fc2a-408a-8362-686715519d85 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e" status: 200 len: 1314 microversion: 2.1 time: 1.873057 Aug 07 01:45:09.481319 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3047/5635] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:45:07 2022] GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e => generated 1314 bytes in 1877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:45:10.509791 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1862a7a5-8739-4bce-bcaa-dff8fe9aa21b tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:45:10.526902 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1862a7a5-8739-4bce-bcaa-dff8fe9aa21b tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 3cb0cd43-054e-4054-b2ca-bfe00c79471e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:45:10.529020 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:10.543932 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1862a7a5-8739-4bce-bcaa-dff8fe9aa21b tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:10.548278 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1862a7a5-8739-4bce-bcaa-dff8fe9aa21b tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:10.550445 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1862a7a5-8739-4bce-bcaa-dff8fe9aa21b tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:10.551638 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1862a7a5-8739-4bce-bcaa-dff8fe9aa21b tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:10.556793 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1862a7a5-8739-4bce-bcaa-dff8fe9aa21b tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:10.560435 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1862a7a5-8739-4bce-bcaa-dff8fe9aa21b tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:10.617887 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=83 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:10.942398 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1862a7a5-8739-4bce-bcaa-dff8fe9aa21b tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e60500a5354328990e61423f46f381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d677cea9a4349bc788e6717763915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:45:10.960771 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1862a7a5-8739-4bce-bcaa-dff8fe9aa21b tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e" status: 200 len: 1498 microversion: 2.1 time: 0.462777 Aug 07 01:45:10.962044 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2589/5636] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:45:10 2022] GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e => generated 1498 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:45:11.810116 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-52757091-a341-4397-9184-98ee3be9cd81 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:45:11.811275 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-52757091-a341-4397-9184-98ee3be9cd81 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 3cb0cd43-054e-4054-b2ca-bfe00c79471e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:45:11.826354 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52757091-a341-4397-9184-98ee3be9cd81 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:11.826964 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52757091-a341-4397-9184-98ee3be9cd81 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:11.827503 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52757091-a341-4397-9184-98ee3be9cd81 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:11.829235 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52757091-a341-4397-9184-98ee3be9cd81 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:11.830616 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52757091-a341-4397-9184-98ee3be9cd81 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:11.833492 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52757091-a341-4397-9184-98ee3be9cd81 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:11.879816 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-52757091-a341-4397-9184-98ee3be9cd81 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 3cb0cd43-054e-4054-b2ca-bfe00c79471e] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:45:12.041004 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-52757091-a341-4397-9184-98ee3be9cd81 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e" status: 204 len: 0 microversion: 2.1 time: 0.234529 Aug 07 01:45:12.044503 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3048/5637] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:45:11 2022] DELETE /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:45:12.061257 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d4322493-2129-4e03-a0d7-be3ab4ee4ac9 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:45:12.065926 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d4322493-2129-4e03-a0d7-be3ab4ee4ac9 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 3cb0cd43-054e-4054-b2ca-bfe00c79471e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:45:12.084329 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d4322493-2129-4e03-a0d7-be3ab4ee4ac9 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:12.085366 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d4322493-2129-4e03-a0d7-be3ab4ee4ac9 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:12.091773 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d4322493-2129-4e03-a0d7-be3ab4ee4ac9 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:12.093009 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d4322493-2129-4e03-a0d7-be3ab4ee4ac9 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:12.093722 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d4322493-2129-4e03-a0d7-be3ab4ee4ac9 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:12.094445 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d4322493-2129-4e03-a0d7-be3ab4ee4ac9 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:12.569081 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d4322493-2129-4e03-a0d7-be3ab4ee4ac9 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e60500a5354328990e61423f46f381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d677cea9a4349bc788e6717763915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:45:12.593168 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d4322493-2129-4e03-a0d7-be3ab4ee4ac9 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e" status: 200 len: 1504 microversion: 2.1 time: 0.526337 Aug 07 01:45:12.595378 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2590/5638] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:45:12 2022] GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e => generated 1504 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:45:13.623448 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-977f01ac-40fa-440b-9def-ea4bd44a0f2a tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:45:13.624407 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-977f01ac-40fa-440b-9def-ea4bd44a0f2a tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 3cb0cd43-054e-4054-b2ca-bfe00c79471e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:45:13.645007 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:13.649621 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-977f01ac-40fa-440b-9def-ea4bd44a0f2a tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:13.652576 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-977f01ac-40fa-440b-9def-ea4bd44a0f2a tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:13.657004 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-977f01ac-40fa-440b-9def-ea4bd44a0f2a tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:13.660148 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-977f01ac-40fa-440b-9def-ea4bd44a0f2a tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:13.661838 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-977f01ac-40fa-440b-9def-ea4bd44a0f2a tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:13.669506 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-977f01ac-40fa-440b-9def-ea4bd44a0f2a tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:13.775350 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:14.362278 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-977f01ac-40fa-440b-9def-ea4bd44a0f2a tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e60500a5354328990e61423f46f381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d677cea9a4349bc788e6717763915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:45:14.382334 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-977f01ac-40fa-440b-9def-ea4bd44a0f2a tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e" status: 200 len: 1504 microversion: 2.1 time: 0.766942 Aug 07 01:45:14.383784 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3049/5639] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:45:13 2022] GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e => generated 1504 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:45:15.406748 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ab6348be-b87b-4f83-b771-aa1c7dcdace3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:45:15.407920 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ab6348be-b87b-4f83-b771-aa1c7dcdace3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 3cb0cd43-054e-4054-b2ca-bfe00c79471e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:45:15.429051 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab6348be-b87b-4f83-b771-aa1c7dcdace3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:15.430057 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab6348be-b87b-4f83-b771-aa1c7dcdace3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:15.430925 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab6348be-b87b-4f83-b771-aa1c7dcdace3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:15.432533 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab6348be-b87b-4f83-b771-aa1c7dcdace3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:15.433715 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab6348be-b87b-4f83-b771-aa1c7dcdace3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:15.434658 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab6348be-b87b-4f83-b771-aa1c7dcdace3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:15.547861 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ab6348be-b87b-4f83-b771-aa1c7dcdace3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e60500a5354328990e61423f46f381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d677cea9a4349bc788e6717763915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:45:15.557868 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ab6348be-b87b-4f83-b771-aa1c7dcdace3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e" status: 200 len: 1462 microversion: 2.1 time: 0.155753 Aug 07 01:45:15.561409 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2591/5640] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:45:15 2022] GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e => generated 1462 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:45:16.080833 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-4e89e65b-6639-48f9-af92-e86cd1f71097 req-00cfdf5a-3e18-44d9-880f-0ace87b6b070 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cb0cd43-054e-4054-b2ca-bfe00c79471e", "name": "network-vif-deleted", "tag": "9f029e18-1454-4448-b784-31f2278983e1"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:45:16.107993 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4e89e65b-6639-48f9-af92-e86cd1f71097 req-00cfdf5a-3e18-44d9-880f-0ace87b6b070 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:16.115530 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4e89e65b-6639-48f9-af92-e86cd1f71097 req-00cfdf5a-3e18-44d9-880f-0ace87b6b070 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:16.119543 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4e89e65b-6639-48f9-af92-e86cd1f71097 req-00cfdf5a-3e18-44d9-880f-0ace87b6b070 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:16.152559 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-4e89e65b-6639-48f9-af92-e86cd1f71097 req-00cfdf5a-3e18-44d9-880f-0ace87b6b070 service nova] Creating event network-vif-deleted:9f029e18-1454-4448-b784-31f2278983e1 for instance 3cb0cd43-054e-4054-b2ca-bfe00c79471e on n-h1-master-1 Aug 07 01:45:16.187597 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-4e89e65b-6639-48f9-af92-e86cd1f71097 req-00cfdf5a-3e18-44d9-880f-0ace87b6b070 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.627924 Aug 07 01:45:16.188285 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3050/5641] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:45:16.586333 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bcf59c9c-97da-4821-8c28-f8fa79eceed5 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:45:16.588360 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bcf59c9c-97da-4821-8c28-f8fa79eceed5 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 3cb0cd43-054e-4054-b2ca-bfe00c79471e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:45:16.622181 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bcf59c9c-97da-4821-8c28-f8fa79eceed5 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:16.623818 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bcf59c9c-97da-4821-8c28-f8fa79eceed5 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:16.624506 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bcf59c9c-97da-4821-8c28-f8fa79eceed5 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:16.625614 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bcf59c9c-97da-4821-8c28-f8fa79eceed5 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:16.627855 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bcf59c9c-97da-4821-8c28-f8fa79eceed5 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:16.628530 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bcf59c9c-97da-4821-8c28-f8fa79eceed5 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:16.698092 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-bcf59c9c-97da-4821-8c28-f8fa79eceed5 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] HTTP exception thrown: Instance 3cb0cd43-054e-4054-b2ca-bfe00c79471e could not be found. Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bcf59c9c-97da-4821-8c28-f8fa79eceed5 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Request method failure captured: Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e HTTP/1.1 Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xkC54dcZglXV2LC6jRusiFzWpuB5HDVwpH_qG8RV9_lChMC_shHfvsmxFGwpXm3892j3N4sfti3JTL_486b3aFD6I6e1wy8YQYjuQ4DyWLzE8jrxmm_Ti1kaXK7T3qQHwKTLHEQxlbBg4_fOWViaIb6gBT_TR2CXANWz6Ei3EIyADU Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 5e7d677cea9a4349bc788e6717763915 Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-VolumesActionsTest-261393750 Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5e7d677cea9a4349bc788e6717763915"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5e7d677cea9a4349bc788e6717763915", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5e7d677cea9a4349bc788e6717763915"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5e7d677cea9a4349bc788e6717763915"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-VolumesActionsTest-261393750 Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 5e7d677cea9a4349bc788e6717763915 Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-VolumesActionsTest-261393750 Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-VolumesActionsTest-261393750-project Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 84e60500a5354328990e61423f46f381 Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-VolumesActionsTest-261393750-project Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 3cb0cd43-054e-4054-b2ca-bfe00c79471e could not be found. Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '3cb0cd43-054e-4054-b2ca-bfe00c79471e'} Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cb0cd43-054e-4054-b2ca-bfe00c79471e could not be found. Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cb0cd43-054e-4054-b2ca-bfe00c79471e could not be found. Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:45:16.700351 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:45:16.705192 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:45:16.705192 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:45:16.705192 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:45:16.705192 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:45:16.705192 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:45:16.705192 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cb0cd43-054e-4054-b2ca-bfe00c79471e could not be found. Aug 07 01:45:16.705192 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:45:16.707011 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bcf59c9c-97da-4821-8c28-f8fa79eceed5 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Returning 404 to user: Instance 3cb0cd43-054e-4054-b2ca-bfe00c79471e could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:45:16.708125 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bcf59c9c-97da-4821-8c28-f8fa79eceed5 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e" status: 404 len: 111 microversion: 2.1 time: 0.128362 Aug 07 01:45:16.709758 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2592/5642] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:45:16 2022] GET /compute/v2.1/servers/3cb0cd43-054e-4054-b2ca-bfe00c79471e => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:45:17.016288 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-862baf9a-12b4-4f77-b153-532054c541c1 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-605312767", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "b110fa06-2b5e-46cb-9935-8484b07654f4"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:45:17.141864 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-862baf9a-12b4-4f77-b153-532054c541c1 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] validate_networks() for [('b110fa06-2b5e-46cb-9935-8484b07654f4', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:45:19.486041 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-862baf9a-12b4-4f77-b153-532054c541c1 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:45:19.487366 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-862baf9a-12b4-4f77-b153-532054c541c1 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:45:19.488047 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-862baf9a-12b4-4f77-b153-532054c541c1 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:45:19.488621 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-862baf9a-12b4-4f77-b153-532054c541c1 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:45:19.489640 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-862baf9a-12b4-4f77-b153-532054c541c1 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:45:19.512595 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-862baf9a-12b4-4f77-b153-532054c541c1 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:19.513333 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-862baf9a-12b4-4f77-b153-532054c541c1 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:19.513947 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-862baf9a-12b4-4f77-b153-532054c541c1 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:19.518626 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-862baf9a-12b4-4f77-b153-532054c541c1 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:19.519342 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-862baf9a-12b4-4f77-b153-532054c541c1 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:19.519981 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-862baf9a-12b4-4f77-b153-532054c541c1 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:19.591046 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-862baf9a-12b4-4f77-b153-532054c541c1 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Getting quotas for project 5e7d677cea9a4349bc788e6717763915. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:45:19.608274 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-862baf9a-12b4-4f77-b153-532054c541c1 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Getting quotas for user 84e60500a5354328990e61423f46f381 and project 5e7d677cea9a4349bc788e6717763915. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:45:19.652395 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-862baf9a-12b4-4f77-b153-532054c541c1 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:45:19.654936 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-862baf9a-12b4-4f77-b153-532054c541c1 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 1a2e2269-1c83-4cd0-8f98-1c672e45926c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:45:19.793197 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-862baf9a-12b4-4f77-b153-532054c541c1 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.782271 Aug 07 01:45:19.800286 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3051/5643] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:45:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:45:19.808634 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2b8cbcc1-b6de-48ac-b187-65bc44a56b88 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:45:19.809451 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2b8cbcc1-b6de-48ac-b187-65bc44a56b88 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 1a2e2269-1c83-4cd0-8f98-1c672e45926c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:45:20.079050 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2b8cbcc1-b6de-48ac-b187-65bc44a56b88 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e60500a5354328990e61423f46f381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d677cea9a4349bc788e6717763915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:45:20.128066 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2b8cbcc1-b6de-48ac-b187-65bc44a56b88 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c" status: 200 len: 1213 microversion: 2.1 time: 0.323170 Aug 07 01:45:20.145748 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2593/5644] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:45:19 2022] GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c => generated 1213 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:45:21.158686 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5a8a26c9-3076-4030-8131-f0e8d916dec3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:45:21.160060 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5a8a26c9-3076-4030-8131-f0e8d916dec3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 1a2e2269-1c83-4cd0-8f98-1c672e45926c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:45:21.175822 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a8a26c9-3076-4030-8131-f0e8d916dec3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:21.176465 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a8a26c9-3076-4030-8131-f0e8d916dec3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:21.177690 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a8a26c9-3076-4030-8131-f0e8d916dec3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:21.178533 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a8a26c9-3076-4030-8131-f0e8d916dec3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:21.179013 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a8a26c9-3076-4030-8131-f0e8d916dec3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:21.179450 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a8a26c9-3076-4030-8131-f0e8d916dec3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:22.060706 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5a8a26c9-3076-4030-8131-f0e8d916dec3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e60500a5354328990e61423f46f381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d677cea9a4349bc788e6717763915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:45:22.075685 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5a8a26c9-3076-4030-8131-f0e8d916dec3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c" status: 200 len: 1209 microversion: 2.1 time: 0.921396 Aug 07 01:45:22.076784 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3052/5645] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:45:21 2022] GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c => generated 1209 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:45:23.113059 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-794ade6c-4ef5-40f3-9db1-dc7461c43b8d tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:45:23.114200 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-794ade6c-4ef5-40f3-9db1-dc7461c43b8d tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 1a2e2269-1c83-4cd0-8f98-1c672e45926c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:45:23.161877 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-794ade6c-4ef5-40f3-9db1-dc7461c43b8d tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:23.171866 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-794ade6c-4ef5-40f3-9db1-dc7461c43b8d tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:23.173408 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-794ade6c-4ef5-40f3-9db1-dc7461c43b8d tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:23.175027 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-794ade6c-4ef5-40f3-9db1-dc7461c43b8d tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:23.178471 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-794ade6c-4ef5-40f3-9db1-dc7461c43b8d tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:23.183587 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-794ade6c-4ef5-40f3-9db1-dc7461c43b8d tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:23.656088 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-794ade6c-4ef5-40f3-9db1-dc7461c43b8d tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e60500a5354328990e61423f46f381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d677cea9a4349bc788e6717763915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:45:23.699009 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-794ade6c-4ef5-40f3-9db1-dc7461c43b8d tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c" status: 200 len: 1271 microversion: 2.1 time: 0.594640 Aug 07 01:45:23.699439 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2594/5646] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:45:23 2022] GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c => generated 1271 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:45:24.723086 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b3db99af-7948-4668-b64e-320c4caebfbc tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:45:24.725436 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b3db99af-7948-4668-b64e-320c4caebfbc tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 1a2e2269-1c83-4cd0-8f98-1c672e45926c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:45:24.737157 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b3db99af-7948-4668-b64e-320c4caebfbc tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:24.738177 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b3db99af-7948-4668-b64e-320c4caebfbc tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:24.741411 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b3db99af-7948-4668-b64e-320c4caebfbc tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:24.742356 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b3db99af-7948-4668-b64e-320c4caebfbc tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:24.744487 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b3db99af-7948-4668-b64e-320c4caebfbc tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:24.745296 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b3db99af-7948-4668-b64e-320c4caebfbc tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:24.879120 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b3db99af-7948-4668-b64e-320c4caebfbc tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e60500a5354328990e61423f46f381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d677cea9a4349bc788e6717763915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:45:24.888935 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b3db99af-7948-4668-b64e-320c4caebfbc tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c" status: 200 len: 1271 microversion: 2.1 time: 0.171601 Aug 07 01:45:24.896280 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3053/5647] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:45:24 2022] GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c => generated 1271 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:45:25.917896 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c279c4fe-659a-4c9e-abc2-4465663d4096 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:45:25.918800 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c279c4fe-659a-4c9e-abc2-4465663d4096 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 1a2e2269-1c83-4cd0-8f98-1c672e45926c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:45:25.938964 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c279c4fe-659a-4c9e-abc2-4465663d4096 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:25.939741 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c279c4fe-659a-4c9e-abc2-4465663d4096 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:25.940749 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c279c4fe-659a-4c9e-abc2-4465663d4096 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:25.942101 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c279c4fe-659a-4c9e-abc2-4465663d4096 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:25.943211 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c279c4fe-659a-4c9e-abc2-4465663d4096 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:25.943966 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c279c4fe-659a-4c9e-abc2-4465663d4096 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:26.800653 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c279c4fe-659a-4c9e-abc2-4465663d4096 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e60500a5354328990e61423f46f381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d677cea9a4349bc788e6717763915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:45:26.819721 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c279c4fe-659a-4c9e-abc2-4465663d4096 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c" status: 200 len: 1313 microversion: 2.1 time: 0.906120 Aug 07 01:45:26.822362 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2595/5648] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:45:25 2022] GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c => generated 1313 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:45:27.845387 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1af5c62c-4b1a-44fd-b37b-032c4d029d7b tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:45:27.846288 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1af5c62c-4b1a-44fd-b37b-032c4d029d7b tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 1a2e2269-1c83-4cd0-8f98-1c672e45926c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:45:27.880223 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1af5c62c-4b1a-44fd-b37b-032c4d029d7b tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:27.888399 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1af5c62c-4b1a-44fd-b37b-032c4d029d7b tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:27.891057 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1af5c62c-4b1a-44fd-b37b-032c4d029d7b tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:27.903149 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1af5c62c-4b1a-44fd-b37b-032c4d029d7b tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:27.907013 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1af5c62c-4b1a-44fd-b37b-032c4d029d7b tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:27.908042 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1af5c62c-4b1a-44fd-b37b-032c4d029d7b tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:28.401803 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1af5c62c-4b1a-44fd-b37b-032c4d029d7b tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e60500a5354328990e61423f46f381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d677cea9a4349bc788e6717763915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:45:28.416919 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1af5c62c-4b1a-44fd-b37b-032c4d029d7b tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c" status: 200 len: 1313 microversion: 2.1 time: 0.575433 Aug 07 01:45:28.419007 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3054/5649] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:45:27 2022] GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c => generated 1313 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:45:29.443175 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b05c07c4-2db6-41de-97c4-70515b450ca3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:45:29.447028 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b05c07c4-2db6-41de-97c4-70515b450ca3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 1a2e2269-1c83-4cd0-8f98-1c672e45926c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:45:29.466662 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b05c07c4-2db6-41de-97c4-70515b450ca3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:29.473436 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b05c07c4-2db6-41de-97c4-70515b450ca3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:29.476861 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b05c07c4-2db6-41de-97c4-70515b450ca3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:29.480757 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b05c07c4-2db6-41de-97c4-70515b450ca3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:29.481574 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b05c07c4-2db6-41de-97c4-70515b450ca3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:29.483295 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b05c07c4-2db6-41de-97c4-70515b450ca3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:30.083584 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:30.761952 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b05c07c4-2db6-41de-97c4-70515b450ca3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e60500a5354328990e61423f46f381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d677cea9a4349bc788e6717763915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:45:30.776945 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b05c07c4-2db6-41de-97c4-70515b450ca3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c" status: 200 len: 1313 microversion: 2.1 time: 1.336462 Aug 07 01:45:30.784257 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2596/5650] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:45:29 2022] GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c => generated 1313 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:45:31.806130 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d0ef9800-89b4-4058-ad31-cd8169b2eca3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:45:31.807499 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d0ef9800-89b4-4058-ad31-cd8169b2eca3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 1a2e2269-1c83-4cd0-8f98-1c672e45926c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:45:31.823133 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:31.824678 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:31.826407 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0ef9800-89b4-4058-ad31-cd8169b2eca3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:31.826916 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0ef9800-89b4-4058-ad31-cd8169b2eca3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:31.827378 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0ef9800-89b4-4058-ad31-cd8169b2eca3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:31.844082 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0ef9800-89b4-4058-ad31-cd8169b2eca3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:31.844600 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0ef9800-89b4-4058-ad31-cd8169b2eca3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:31.845058 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0ef9800-89b4-4058-ad31-cd8169b2eca3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:32.389805 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-ca5459ed-fe07-4dd9-b224-e52535b86eb4 req-c639ea44-fb23-4afc-8157-e537b018a071 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a2e2269-1c83-4cd0-8f98-1c672e45926c", "tag": "c230bb0a-d634-439b-8bbb-6ad23d29263e"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:45:32.428626 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-ca5459ed-fe07-4dd9-b224-e52535b86eb4 req-c639ea44-fb23-4afc-8157-e537b018a071 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:32.430514 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-ca5459ed-fe07-4dd9-b224-e52535b86eb4 req-c639ea44-fb23-4afc-8157-e537b018a071 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:32.432364 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-ca5459ed-fe07-4dd9-b224-e52535b86eb4 req-c639ea44-fb23-4afc-8157-e537b018a071 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:32.457486 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-ca5459ed-fe07-4dd9-b224-e52535b86eb4 req-c639ea44-fb23-4afc-8157-e537b018a071 service nova] Creating event network-changed:c230bb0a-d634-439b-8bbb-6ad23d29263e for instance 1a2e2269-1c83-4cd0-8f98-1c672e45926c on n-h2-master-1 Aug 07 01:45:32.463676 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-ca5459ed-fe07-4dd9-b224-e52535b86eb4 req-c639ea44-fb23-4afc-8157-e537b018a071 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093174 Aug 07 01:45:32.465301 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2597/5651] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:45:32.467740 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d0ef9800-89b4-4058-ad31-cd8169b2eca3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e60500a5354328990e61423f46f381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d677cea9a4349bc788e6717763915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:45:32.477363 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d0ef9800-89b4-4058-ad31-cd8169b2eca3 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c" status: 200 len: 1313 microversion: 2.1 time: 0.675755 Aug 07 01:45:32.490839 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3055/5652] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:45:31 2022] GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c => generated 1313 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:45:33.502396 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c5192b92-0e05-40f3-9e5d-6bd47bd02b95 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:45:33.503872 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c5192b92-0e05-40f3-9e5d-6bd47bd02b95 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 1a2e2269-1c83-4cd0-8f98-1c672e45926c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:45:33.534073 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c5192b92-0e05-40f3-9e5d-6bd47bd02b95 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:33.543753 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c5192b92-0e05-40f3-9e5d-6bd47bd02b95 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:33.550582 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c5192b92-0e05-40f3-9e5d-6bd47bd02b95 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:33.556938 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c5192b92-0e05-40f3-9e5d-6bd47bd02b95 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:33.557760 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c5192b92-0e05-40f3-9e5d-6bd47bd02b95 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:33.558634 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c5192b92-0e05-40f3-9e5d-6bd47bd02b95 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:34.524070 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c5192b92-0e05-40f3-9e5d-6bd47bd02b95 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e60500a5354328990e61423f46f381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d677cea9a4349bc788e6717763915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:45:34.547565 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c5192b92-0e05-40f3-9e5d-6bd47bd02b95 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c" status: 200 len: 1313 microversion: 2.1 time: 1.042790 Aug 07 01:45:34.571597 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2598/5653] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:45:33 2022] GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c => generated 1313 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:45:35.574755 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-53f4993b-885e-4806-a47a-522be5e59b3c tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:45:35.575372 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-53f4993b-885e-4806-a47a-522be5e59b3c tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 1a2e2269-1c83-4cd0-8f98-1c672e45926c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:45:35.585981 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-53f4993b-885e-4806-a47a-522be5e59b3c tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:35.602738 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-53f4993b-885e-4806-a47a-522be5e59b3c tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:35.604115 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-53f4993b-885e-4806-a47a-522be5e59b3c tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:35.610164 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-53f4993b-885e-4806-a47a-522be5e59b3c tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:35.610855 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-53f4993b-885e-4806-a47a-522be5e59b3c tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:35.611477 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-53f4993b-885e-4806-a47a-522be5e59b3c tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:36.336577 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-53f4993b-885e-4806-a47a-522be5e59b3c tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e60500a5354328990e61423f46f381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d677cea9a4349bc788e6717763915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:45:36.346692 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-53f4993b-885e-4806-a47a-522be5e59b3c tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c" status: 200 len: 1313 microversion: 2.1 time: 0.775760 Aug 07 01:45:36.347950 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3056/5654] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:45:35 2022] GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c => generated 1313 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:45:37.370373 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f4da67c3-944f-4c6a-a6ff-5d2ffed754d4 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:45:37.371099 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f4da67c3-944f-4c6a-a6ff-5d2ffed754d4 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 1a2e2269-1c83-4cd0-8f98-1c672e45926c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:45:37.383672 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4da67c3-944f-4c6a-a6ff-5d2ffed754d4 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:37.384495 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4da67c3-944f-4c6a-a6ff-5d2ffed754d4 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:37.386006 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4da67c3-944f-4c6a-a6ff-5d2ffed754d4 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:37.388173 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4da67c3-944f-4c6a-a6ff-5d2ffed754d4 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:37.389598 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4da67c3-944f-4c6a-a6ff-5d2ffed754d4 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:37.391140 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f4da67c3-944f-4c6a-a6ff-5d2ffed754d4 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:37.829651 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f4da67c3-944f-4c6a-a6ff-5d2ffed754d4 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e60500a5354328990e61423f46f381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d677cea9a4349bc788e6717763915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:45:37.840611 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f4da67c3-944f-4c6a-a6ff-5d2ffed754d4 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c" status: 200 len: 1313 microversion: 2.1 time: 0.474671 Aug 07 01:45:37.841803 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2599/5655] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:45:37 2022] GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c => generated 1313 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:45:38.863039 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b8c9406d-7d84-4fd4-8ffa-6b65441f0389 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:45:38.864553 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b8c9406d-7d84-4fd4-8ffa-6b65441f0389 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 1a2e2269-1c83-4cd0-8f98-1c672e45926c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:45:38.877661 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b8c9406d-7d84-4fd4-8ffa-6b65441f0389 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:38.878511 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b8c9406d-7d84-4fd4-8ffa-6b65441f0389 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:38.884172 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b8c9406d-7d84-4fd4-8ffa-6b65441f0389 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:38.885255 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b8c9406d-7d84-4fd4-8ffa-6b65441f0389 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:38.885909 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b8c9406d-7d84-4fd4-8ffa-6b65441f0389 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:38.886501 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b8c9406d-7d84-4fd4-8ffa-6b65441f0389 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:38.935875 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b205ef4c-1b5b-4393-8d38-52eaf9957bef tempest-PortsAdminExtendedAttrsIpV6TestJSON-712816852 tempest-PortsAdminExtendedAttrsIpV6TestJSON-712816852-project-admin] Calling method '.version_select at 0x7f9e299799d0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:45:38.938072 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:45:38.938072 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:45:38.939913 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b205ef4c-1b5b-4393-8d38-52eaf9957bef tempest-PortsAdminExtendedAttrsIpV6TestJSON-712816852 tempest-PortsAdminExtendedAttrsIpV6TestJSON-712816852-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:38.941101 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b205ef4c-1b5b-4393-8d38-52eaf9957bef tempest-PortsAdminExtendedAttrsIpV6TestJSON-712816852 tempest-PortsAdminExtendedAttrsIpV6TestJSON-712816852-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:38.942728 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b205ef4c-1b5b-4393-8d38-52eaf9957bef tempest-PortsAdminExtendedAttrsIpV6TestJSON-712816852 tempest-PortsAdminExtendedAttrsIpV6TestJSON-712816852-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:38.971263 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b205ef4c-1b5b-4393-8d38-52eaf9957bef tempest-PortsAdminExtendedAttrsIpV6TestJSON-712816852 tempest-PortsAdminExtendedAttrsIpV6TestJSON-712816852-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:38.976016 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b205ef4c-1b5b-4393-8d38-52eaf9957bef tempest-PortsAdminExtendedAttrsIpV6TestJSON-712816852 tempest-PortsAdminExtendedAttrsIpV6TestJSON-712816852-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:38.977011 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b205ef4c-1b5b-4393-8d38-52eaf9957bef tempest-PortsAdminExtendedAttrsIpV6TestJSON-712816852 tempest-PortsAdminExtendedAttrsIpV6TestJSON-712816852-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:39.002139 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b205ef4c-1b5b-4393-8d38-52eaf9957bef tempest-PortsAdminExtendedAttrsIpV6TestJSON-712816852 tempest-PortsAdminExtendedAttrsIpV6TestJSON-712816852-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:39.003135 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b205ef4c-1b5b-4393-8d38-52eaf9957bef tempest-PortsAdminExtendedAttrsIpV6TestJSON-712816852 tempest-PortsAdminExtendedAttrsIpV6TestJSON-712816852-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:39.003795 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b205ef4c-1b5b-4393-8d38-52eaf9957bef tempest-PortsAdminExtendedAttrsIpV6TestJSON-712816852 tempest-PortsAdminExtendedAttrsIpV6TestJSON-712816852-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:39.015983 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b205ef4c-1b5b-4393-8d38-52eaf9957bef tempest-PortsAdminExtendedAttrsIpV6TestJSON-712816852 tempest-PortsAdminExtendedAttrsIpV6TestJSON-712816852-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.350790 Aug 07 01:45:39.017256 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3057/5656] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:45:38 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:45:39.206720 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b8c9406d-7d84-4fd4-8ffa-6b65441f0389 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e60500a5354328990e61423f46f381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d677cea9a4349bc788e6717763915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:45:39.221722 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b8c9406d-7d84-4fd4-8ffa-6b65441f0389 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c" status: 200 len: 1313 microversion: 2.1 time: 0.360415 Aug 07 01:45:39.222951 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2600/5657] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:45:38 2022] GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c => generated 1313 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:45:40.256118 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e5a5bb9d-e1c1-49ee-9e47-738c100baab4 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:45:40.258354 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e5a5bb9d-e1c1-49ee-9e47-738c100baab4 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 1a2e2269-1c83-4cd0-8f98-1c672e45926c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:45:40.281520 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5a5bb9d-e1c1-49ee-9e47-738c100baab4 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:40.282871 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5a5bb9d-e1c1-49ee-9e47-738c100baab4 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:40.285386 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5a5bb9d-e1c1-49ee-9e47-738c100baab4 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:40.317450 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5a5bb9d-e1c1-49ee-9e47-738c100baab4 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:40.319370 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5a5bb9d-e1c1-49ee-9e47-738c100baab4 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:40.320342 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5a5bb9d-e1c1-49ee-9e47-738c100baab4 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:41.712787 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e5a5bb9d-e1c1-49ee-9e47-738c100baab4 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e60500a5354328990e61423f46f381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d677cea9a4349bc788e6717763915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:45:41.751518 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e5a5bb9d-e1c1-49ee-9e47-738c100baab4 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c" status: 200 len: 1313 microversion: 2.1 time: 1.511486 Aug 07 01:45:41.761237 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3058/5658] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:45:40 2022] GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c => generated 1313 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:45:42.443101 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-97f0f3ab-b633-4c51-80c5-9ea4c3528759 req-91a08343-b7a3-4aa6-bd42-b8e55df96a08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a2e2269-1c83-4cd0-8f98-1c672e45926c", "name": "network-vif-plugged", "status": "completed", "tag": "c230bb0a-d634-439b-8bbb-6ad23d29263e"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:45:42.477747 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=26 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:42.495248 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-97f0f3ab-b633-4c51-80c5-9ea4c3528759 req-91a08343-b7a3-4aa6-bd42-b8e55df96a08 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:42.495606 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-97f0f3ab-b633-4c51-80c5-9ea4c3528759 req-91a08343-b7a3-4aa6-bd42-b8e55df96a08 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:42.496064 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-97f0f3ab-b633-4c51-80c5-9ea4c3528759 req-91a08343-b7a3-4aa6-bd42-b8e55df96a08 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:42.553494 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=58 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:42.558012 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-97f0f3ab-b633-4c51-80c5-9ea4c3528759 req-91a08343-b7a3-4aa6-bd42-b8e55df96a08 service nova] Creating event network-vif-plugged:c230bb0a-d634-439b-8bbb-6ad23d29263e for instance 1a2e2269-1c83-4cd0-8f98-1c672e45926c on n-h2-master-1 Aug 07 01:45:42.579551 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-97f0f3ab-b633-4c51-80c5-9ea4c3528759 req-91a08343-b7a3-4aa6-bd42-b8e55df96a08 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147115 Aug 07 01:45:42.580929 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2601/5659] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:45:42.778623 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-56f82a47-3eca-4235-9c0a-e6714783ebac tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:45:42.780084 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-56f82a47-3eca-4235-9c0a-e6714783ebac tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 1a2e2269-1c83-4cd0-8f98-1c672e45926c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:45:42.794348 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-56f82a47-3eca-4235-9c0a-e6714783ebac tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:42.796129 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-56f82a47-3eca-4235-9c0a-e6714783ebac tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:42.798382 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-56f82a47-3eca-4235-9c0a-e6714783ebac tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:42.802561 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-56f82a47-3eca-4235-9c0a-e6714783ebac tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:42.803676 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-56f82a47-3eca-4235-9c0a-e6714783ebac tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:42.807043 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-56f82a47-3eca-4235-9c0a-e6714783ebac tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:43.778440 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-56f82a47-3eca-4235-9c0a-e6714783ebac tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e60500a5354328990e61423f46f381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d677cea9a4349bc788e6717763915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:45:43.797524 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-56f82a47-3eca-4235-9c0a-e6714783ebac tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c" status: 200 len: 1313 microversion: 2.1 time: 1.018139 Aug 07 01:45:43.804096 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3059/5660] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:45:42 2022] GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c => generated 1313 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:45:44.824514 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a33c8033-ad2a-4c1e-9200-e7bb7897b08e tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:45:44.825248 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a33c8033-ad2a-4c1e-9200-e7bb7897b08e tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 1a2e2269-1c83-4cd0-8f98-1c672e45926c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:45:44.835915 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a33c8033-ad2a-4c1e-9200-e7bb7897b08e tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:44.839841 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a33c8033-ad2a-4c1e-9200-e7bb7897b08e tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:44.841153 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a33c8033-ad2a-4c1e-9200-e7bb7897b08e tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:44.842651 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a33c8033-ad2a-4c1e-9200-e7bb7897b08e tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:44.845038 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a33c8033-ad2a-4c1e-9200-e7bb7897b08e tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:44.846413 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a33c8033-ad2a-4c1e-9200-e7bb7897b08e tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:45.353061 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a33c8033-ad2a-4c1e-9200-e7bb7897b08e tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e60500a5354328990e61423f46f381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d677cea9a4349bc788e6717763915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:45:45.378051 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a33c8033-ad2a-4c1e-9200-e7bb7897b08e tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c" status: 200 len: 1313 microversion: 2.1 time: 0.556910 Aug 07 01:45:45.380908 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2602/5661] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:45:44 2022] GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c => generated 1313 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:45:46.403717 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9c476d27-c217-4d8a-9cf3-a64285c2dfbc tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:45:46.405590 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9c476d27-c217-4d8a-9cf3-a64285c2dfbc tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 1a2e2269-1c83-4cd0-8f98-1c672e45926c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:45:46.409138 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:46.428736 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c476d27-c217-4d8a-9cf3-a64285c2dfbc tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:46.431518 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c476d27-c217-4d8a-9cf3-a64285c2dfbc tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:46.432729 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c476d27-c217-4d8a-9cf3-a64285c2dfbc tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:46.436450 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c476d27-c217-4d8a-9cf3-a64285c2dfbc tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:46.437296 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c476d27-c217-4d8a-9cf3-a64285c2dfbc tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:46.439401 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9c476d27-c217-4d8a-9cf3-a64285c2dfbc tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:46.454953 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=58 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:47.100305 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9c476d27-c217-4d8a-9cf3-a64285c2dfbc tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e60500a5354328990e61423f46f381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d677cea9a4349bc788e6717763915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:45:47.113178 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9c476d27-c217-4d8a-9cf3-a64285c2dfbc tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c" status: 200 len: 1498 microversion: 2.1 time: 0.711139 Aug 07 01:45:47.115999 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3060/5662] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:45:46 2022] GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c => generated 1498 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:45:47.979136 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c3ea8845-6eb1-4ce8-9c0c-3c34de81ff96 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:45:47.980579 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c3ea8845-6eb1-4ce8-9c0c-3c34de81ff96 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 1a2e2269-1c83-4cd0-8f98-1c672e45926c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:45:48.010387 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3ea8845-6eb1-4ce8-9c0c-3c34de81ff96 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:48.010961 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3ea8845-6eb1-4ce8-9c0c-3c34de81ff96 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:48.011325 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3ea8845-6eb1-4ce8-9c0c-3c34de81ff96 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:48.012164 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3ea8845-6eb1-4ce8-9c0c-3c34de81ff96 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:48.022585 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3ea8845-6eb1-4ce8-9c0c-3c34de81ff96 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:48.047837 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3ea8845-6eb1-4ce8-9c0c-3c34de81ff96 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:48.158858 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c3ea8845-6eb1-4ce8-9c0c-3c34de81ff96 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 1a2e2269-1c83-4cd0-8f98-1c672e45926c] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:45:48.352525 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c3ea8845-6eb1-4ce8-9c0c-3c34de81ff96 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c" status: 204 len: 0 microversion: 2.1 time: 0.377736 Aug 07 01:45:48.358185 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2603/5663] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:45:47 2022] DELETE /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:45:48.369034 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7845d023-7975-48ad-8141-9c4c49888c6d tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:45:48.370012 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7845d023-7975-48ad-8141-9c4c49888c6d tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 1a2e2269-1c83-4cd0-8f98-1c672e45926c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:45:48.402158 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7845d023-7975-48ad-8141-9c4c49888c6d tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:48.410752 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7845d023-7975-48ad-8141-9c4c49888c6d tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:48.414247 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7845d023-7975-48ad-8141-9c4c49888c6d tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:48.417019 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7845d023-7975-48ad-8141-9c4c49888c6d tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:48.417773 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7845d023-7975-48ad-8141-9c4c49888c6d tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:48.423803 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7845d023-7975-48ad-8141-9c4c49888c6d tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:48.834365 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7845d023-7975-48ad-8141-9c4c49888c6d tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e60500a5354328990e61423f46f381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d677cea9a4349bc788e6717763915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:45:48.842300 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7845d023-7975-48ad-8141-9c4c49888c6d tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c" status: 200 len: 1504 microversion: 2.1 time: 0.478066 Aug 07 01:45:48.860369 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3061/5664] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:45:48 2022] GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c => generated 1504 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:45:49.876431 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2d568ed2-124a-4ee8-a7b2-2e2dbb433f8c tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:45:49.880919 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2d568ed2-124a-4ee8-a7b2-2e2dbb433f8c tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 1a2e2269-1c83-4cd0-8f98-1c672e45926c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:45:49.901285 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d568ed2-124a-4ee8-a7b2-2e2dbb433f8c tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:49.903929 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d568ed2-124a-4ee8-a7b2-2e2dbb433f8c tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:49.904780 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d568ed2-124a-4ee8-a7b2-2e2dbb433f8c tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:49.906606 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d568ed2-124a-4ee8-a7b2-2e2dbb433f8c tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:49.907980 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d568ed2-124a-4ee8-a7b2-2e2dbb433f8c tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:49.909717 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d568ed2-124a-4ee8-a7b2-2e2dbb433f8c tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:51.002955 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2d568ed2-124a-4ee8-a7b2-2e2dbb433f8c tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e60500a5354328990e61423f46f381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d677cea9a4349bc788e6717763915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:45:51.016158 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2d568ed2-124a-4ee8-a7b2-2e2dbb433f8c tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c" status: 200 len: 1504 microversion: 2.1 time: 1.154591 Aug 07 01:45:51.029394 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2604/5665] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:45:49 2022] GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c => generated 1504 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:45:52.041341 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-691eddb4-7413-4017-aa09-ad08640af713 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:45:52.041968 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-691eddb4-7413-4017-aa09-ad08640af713 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 1a2e2269-1c83-4cd0-8f98-1c672e45926c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:45:52.057296 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-691eddb4-7413-4017-aa09-ad08640af713 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:52.057793 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-691eddb4-7413-4017-aa09-ad08640af713 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:52.068544 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-691eddb4-7413-4017-aa09-ad08640af713 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:52.069591 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-691eddb4-7413-4017-aa09-ad08640af713 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:52.070247 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-691eddb4-7413-4017-aa09-ad08640af713 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:52.070903 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-691eddb4-7413-4017-aa09-ad08640af713 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:52.273945 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-691eddb4-7413-4017-aa09-ad08640af713 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84e60500a5354328990e61423f46f381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7d677cea9a4349bc788e6717763915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:45:52.302949 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-691eddb4-7413-4017-aa09-ad08640af713 tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c" status: 200 len: 1462 microversion: 2.1 time: 0.265280 Aug 07 01:45:52.308074 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3062/5666] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:45:52 2022] GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c => generated 1462 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:45:52.624987 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-737309a0-ffbf-481f-bc04-ac416d7ed8a9 req-0e4a5609-33f4-4c03-a864-01dca2b70d32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a2e2269-1c83-4cd0-8f98-1c672e45926c", "name": "network-vif-deleted", "tag": "c230bb0a-d634-439b-8bbb-6ad23d29263e"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:45:52.646784 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-737309a0-ffbf-481f-bc04-ac416d7ed8a9 req-0e4a5609-33f4-4c03-a864-01dca2b70d32 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:52.648886 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-737309a0-ffbf-481f-bc04-ac416d7ed8a9 req-0e4a5609-33f4-4c03-a864-01dca2b70d32 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:52.649374 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-737309a0-ffbf-481f-bc04-ac416d7ed8a9 req-0e4a5609-33f4-4c03-a864-01dca2b70d32 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:52.681194 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-737309a0-ffbf-481f-bc04-ac416d7ed8a9 req-0e4a5609-33f4-4c03-a864-01dca2b70d32 service nova] Creating event network-vif-deleted:c230bb0a-d634-439b-8bbb-6ad23d29263e for instance 1a2e2269-1c83-4cd0-8f98-1c672e45926c on n-h2-master-1 Aug 07 01:45:52.701210 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-737309a0-ffbf-481f-bc04-ac416d7ed8a9 req-0e4a5609-33f4-4c03-a864-01dca2b70d32 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079337 Aug 07 01:45:52.702707 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2605/5667] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:45:53.326239 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3b8bf192-7d6e-4cd8-bdd9-761b6fa3f0ec tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:45:53.327482 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3b8bf192-7d6e-4cd8-bdd9-761b6fa3f0ec tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] [instance: 1a2e2269-1c83-4cd0-8f98-1c672e45926c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:45:53.361681 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b8bf192-7d6e-4cd8-bdd9-761b6fa3f0ec tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:53.362505 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b8bf192-7d6e-4cd8-bdd9-761b6fa3f0ec tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:53.363777 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b8bf192-7d6e-4cd8-bdd9-761b6fa3f0ec tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:53.377681 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b8bf192-7d6e-4cd8-bdd9-761b6fa3f0ec tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:45:53.378396 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b8bf192-7d6e-4cd8-bdd9-761b6fa3f0ec tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:45:53.379965 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b8bf192-7d6e-4cd8-bdd9-761b6fa3f0ec tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:45:53.409176 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-3b8bf192-7d6e-4cd8-bdd9-761b6fa3f0ec tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] HTTP exception thrown: Instance 1a2e2269-1c83-4cd0-8f98-1c672e45926c could not be found. Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3b8bf192-7d6e-4cd8-bdd9-761b6fa3f0ec tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Request method failure captured: Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c HTTP/1.1 Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xkC54dcZglXV2LC6jRusiFzWpuB5HDVwpH_qG8RV9_lChMC_shHfvsmxFGwpXm3892j3N4sfti3JTL_486b3aFD6I6e1wy8YQYjuQ4DyWLzE8jrxmm_Ti1kaXK7T3qQHwKTLHEQxlbBg4_fOWViaIb6gBT_TR2CXANWz6Ei3EIyADU Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 5e7d677cea9a4349bc788e6717763915 Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-VolumesActionsTest-261393750 Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5e7d677cea9a4349bc788e6717763915"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5e7d677cea9a4349bc788e6717763915", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5e7d677cea9a4349bc788e6717763915"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5e7d677cea9a4349bc788e6717763915"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-VolumesActionsTest-261393750 Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 5e7d677cea9a4349bc788e6717763915 Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-VolumesActionsTest-261393750 Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-VolumesActionsTest-261393750-project Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 84e60500a5354328990e61423f46f381 Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-VolumesActionsTest-261393750-project Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 1a2e2269-1c83-4cd0-8f98-1c672e45926c could not be found. Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '1a2e2269-1c83-4cd0-8f98-1c672e45926c'} Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a2e2269-1c83-4cd0-8f98-1c672e45926c could not be found. Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a2e2269-1c83-4cd0-8f98-1c672e45926c could not be found. Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:45:53.411472 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:45:53.417250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:45:53.417250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:45:53.417250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:45:53.417250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:45:53.417250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:45:53.417250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a2e2269-1c83-4cd0-8f98-1c672e45926c could not be found. Aug 07 01:45:53.417250 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:45:53.417250 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3b8bf192-7d6e-4cd8-bdd9-761b6fa3f0ec tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] Returning 404 to user: Instance 1a2e2269-1c83-4cd0-8f98-1c672e45926c could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:45:53.417250 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3b8bf192-7d6e-4cd8-bdd9-761b6fa3f0ec tempest-VolumesActionsTest-261393750 tempest-VolumesActionsTest-261393750-project] 10.222.0.39 "GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c" status: 404 len: 111 microversion: 2.1 time: 0.091175 Aug 07 01:45:53.417250 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3063/5668] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:45:53 2022] GET /compute/v2.1/servers/1a2e2269-1c83-4cd0-8f98-1c672e45926c => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:46:07.801759 n-d-master-1 devstack@n-api.service[119517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 01:46:07.802325 n-d-master-1 devstack@n-api.service[119517]: Sun Aug 7 01:46:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 01:46:17.821521 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:46:17.822662 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:46:18.453259 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7e5976de-0381-4d9e-8efc-32429e108efb tempest-PortsAdminExtendedAttrsTestJSON-1646139404 tempest-PortsAdminExtendedAttrsTestJSON-1646139404-project-admin] Calling method '.version_select at 0x7f9e24635790>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:46:18.454160 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:46:18.454160 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:46:18.455961 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e5976de-0381-4d9e-8efc-32429e108efb tempest-PortsAdminExtendedAttrsTestJSON-1646139404 tempest-PortsAdminExtendedAttrsTestJSON-1646139404-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:46:18.456447 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e5976de-0381-4d9e-8efc-32429e108efb tempest-PortsAdminExtendedAttrsTestJSON-1646139404 tempest-PortsAdminExtendedAttrsTestJSON-1646139404-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:46:18.456889 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e5976de-0381-4d9e-8efc-32429e108efb tempest-PortsAdminExtendedAttrsTestJSON-1646139404 tempest-PortsAdminExtendedAttrsTestJSON-1646139404-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:46:18.545906 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e5976de-0381-4d9e-8efc-32429e108efb tempest-PortsAdminExtendedAttrsTestJSON-1646139404 tempest-PortsAdminExtendedAttrsTestJSON-1646139404-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:46:18.548132 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e5976de-0381-4d9e-8efc-32429e108efb tempest-PortsAdminExtendedAttrsTestJSON-1646139404 tempest-PortsAdminExtendedAttrsTestJSON-1646139404-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:46:18.553238 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e5976de-0381-4d9e-8efc-32429e108efb tempest-PortsAdminExtendedAttrsTestJSON-1646139404 tempest-PortsAdminExtendedAttrsTestJSON-1646139404-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:46:18.587795 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e5976de-0381-4d9e-8efc-32429e108efb tempest-PortsAdminExtendedAttrsTestJSON-1646139404 tempest-PortsAdminExtendedAttrsTestJSON-1646139404-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:46:18.587795 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e5976de-0381-4d9e-8efc-32429e108efb tempest-PortsAdminExtendedAttrsTestJSON-1646139404 tempest-PortsAdminExtendedAttrsTestJSON-1646139404-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:46:18.587795 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e5976de-0381-4d9e-8efc-32429e108efb tempest-PortsAdminExtendedAttrsTestJSON-1646139404 tempest-PortsAdminExtendedAttrsTestJSON-1646139404-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:46:18.611508 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7e5976de-0381-4d9e-8efc-32429e108efb tempest-PortsAdminExtendedAttrsTestJSON-1646139404 tempest-PortsAdminExtendedAttrsTestJSON-1646139404-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.794692 Aug 07 01:46:18.613728 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2606/5669] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:46:17 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:47:25.851177 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=7 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:47:25.861458 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=19 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:47:25.866350 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4889620a-f6d1-46fa-9839-b91e217b7829 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:47:25.866893 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4889620a-f6d1-46fa-9839-b91e217b7829 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] [instance: a271510f-d551-4e39-a247-eeedd504cedf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:47:25.905983 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4889620a-f6d1-46fa-9839-b91e217b7829 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:47:25.906577 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4889620a-f6d1-46fa-9839-b91e217b7829 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:47:25.906951 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4889620a-f6d1-46fa-9839-b91e217b7829 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:47:25.907692 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4889620a-f6d1-46fa-9839-b91e217b7829 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:47:25.908563 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4889620a-f6d1-46fa-9839-b91e217b7829 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:47:25.908715 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4889620a-f6d1-46fa-9839-b91e217b7829 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:47:26.180938 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-4889620a-f6d1-46fa-9839-b91e217b7829 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lazy-loading 'services' on Instance uuid a271510f-d551-4e39-a247-eeedd504cedf {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:47:26.486282 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4889620a-f6d1-46fa-9839-b91e217b7829 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a271510f-d551-4e39-a247-eeedd504cedf/os-volume_attachments/c9ced1e8-3f27-4922-becc-00b612781999" status: 202 len: 0 microversion: 2.1 time: 0.622029 Aug 07 01:47:26.490307 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3064/5670] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Aug 7 01:47:25 2022] DELETE /compute/v2.1/servers/a271510f-d551-4e39-a247-eeedd504cedf/os-volume_attachments/c9ced1e8-3f27-4922-becc-00b612781999 => generated 0 bytes in 645 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:47:41.449544 n-d-master-1 devstack@n-api.service[119517]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cc2209bc-4fce-4284-bf5f-e0375e6343bd] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 07 01:47:41.454276 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-abf1c608-34ea-40fc-9fd1-acc2ed1ff9c0 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:47:41.454907 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-abf1c608-34ea-40fc-9fd1-acc2ed1ff9c0 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] [instance: a271510f-d551-4e39-a247-eeedd504cedf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:47:41.469110 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=4 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:47:41.478651 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:47:41.489613 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-abf1c608-34ea-40fc-9fd1-acc2ed1ff9c0 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:47:41.492661 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-abf1c608-34ea-40fc-9fd1-acc2ed1ff9c0 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:47:41.495634 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-abf1c608-34ea-40fc-9fd1-acc2ed1ff9c0 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:47:41.496859 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-abf1c608-34ea-40fc-9fd1-acc2ed1ff9c0 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:47:41.497552 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-abf1c608-34ea-40fc-9fd1-acc2ed1ff9c0 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:47:41.498186 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-abf1c608-34ea-40fc-9fd1-acc2ed1ff9c0 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:47:41.599577 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-abf1c608-34ea-40fc-9fd1-acc2ed1ff9c0 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] [instance: a271510f-d551-4e39-a247-eeedd504cedf] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:47:41.857915 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-abf1c608-34ea-40fc-9fd1-acc2ed1ff9c0 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a271510f-d551-4e39-a247-eeedd504cedf" status: 204 len: 0 microversion: 2.1 time: 0.409689 Aug 07 01:47:41.860204 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2607/5671] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:47:41 2022] DELETE /compute/v2.1/servers/a271510f-d551-4e39-a247-eeedd504cedf => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:47:41.871288 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-16437672-c72f-4412-90ff-f46ae798cd3e tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:47:41.872777 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-16437672-c72f-4412-90ff-f46ae798cd3e tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] [instance: a271510f-d551-4e39-a247-eeedd504cedf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:47:41.880184 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:47:41.881025 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:47:41.882814 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-16437672-c72f-4412-90ff-f46ae798cd3e tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:47:41.883454 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-16437672-c72f-4412-90ff-f46ae798cd3e tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:47:41.884036 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-16437672-c72f-4412-90ff-f46ae798cd3e tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:47:41.885008 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-16437672-c72f-4412-90ff-f46ae798cd3e tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:47:41.885591 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-16437672-c72f-4412-90ff-f46ae798cd3e tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:47:41.886295 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-16437672-c72f-4412-90ff-f46ae798cd3e tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:47:42.219124 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-16437672-c72f-4412-90ff-f46ae798cd3e tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0eddcab4c14931b7c20f86f3115981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbd14acc689493b84d8fa6d0137bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:47:42.259843 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-16437672-c72f-4412-90ff-f46ae798cd3e tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] 10.222.0.39 "GET /compute/v2.1/servers/a271510f-d551-4e39-a247-eeedd504cedf" status: 200 len: 1469 microversion: 2.1 time: 0.391294 Aug 07 01:47:42.261375 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3065/5672] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:47:41 2022] GET /compute/v2.1/servers/a271510f-d551-4e39-a247-eeedd504cedf => generated 1469 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:47:43.287108 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-acb7ccdf-1717-4585-a8d5-d3ea57beb6bb tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:47:43.289819 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-acb7ccdf-1717-4585-a8d5-d3ea57beb6bb tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] [instance: a271510f-d551-4e39-a247-eeedd504cedf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:47:43.315634 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-acb7ccdf-1717-4585-a8d5-d3ea57beb6bb tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:47:43.316548 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-acb7ccdf-1717-4585-a8d5-d3ea57beb6bb tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:47:43.319048 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-acb7ccdf-1717-4585-a8d5-d3ea57beb6bb tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:47:43.323042 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-acb7ccdf-1717-4585-a8d5-d3ea57beb6bb tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:47:43.326777 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-acb7ccdf-1717-4585-a8d5-d3ea57beb6bb tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:47:43.327739 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-acb7ccdf-1717-4585-a8d5-d3ea57beb6bb tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:47:43.377942 n-d-master-1 devstack@n-api.service[119517]: INFO oslo.messaging._drivers.impl_rabbit [-] [cc2209bc-4fce-4284-bf5f-e0375e6343bd] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 45778. Aug 07 01:47:44.008384 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-acb7ccdf-1717-4585-a8d5-d3ea57beb6bb tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0eddcab4c14931b7c20f86f3115981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbd14acc689493b84d8fa6d0137bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:47:44.025082 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-acb7ccdf-1717-4585-a8d5-d3ea57beb6bb tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] 10.222.0.39 "GET /compute/v2.1/servers/a271510f-d551-4e39-a247-eeedd504cedf" status: 200 len: 1469 microversion: 2.1 time: 0.746363 Aug 07 01:47:44.025673 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2608/5673] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:47:43 2022] GET /compute/v2.1/servers/a271510f-d551-4e39-a247-eeedd504cedf => generated 1469 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:47:45.052844 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cc4b91df-a629-4d15-bb7b-073e1e4fb084 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:47:45.054276 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cc4b91df-a629-4d15-bb7b-073e1e4fb084 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] [instance: a271510f-d551-4e39-a247-eeedd504cedf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:47:45.082412 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc4b91df-a629-4d15-bb7b-073e1e4fb084 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:47:45.084118 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc4b91df-a629-4d15-bb7b-073e1e4fb084 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:47:45.085322 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc4b91df-a629-4d15-bb7b-073e1e4fb084 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:47:45.087157 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc4b91df-a629-4d15-bb7b-073e1e4fb084 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:47:45.089167 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc4b91df-a629-4d15-bb7b-073e1e4fb084 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:47:45.090814 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc4b91df-a629-4d15-bb7b-073e1e4fb084 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:47:45.748280 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cc4b91df-a629-4d15-bb7b-073e1e4fb084 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0eddcab4c14931b7c20f86f3115981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbd14acc689493b84d8fa6d0137bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:47:45.756740 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cc4b91df-a629-4d15-bb7b-073e1e4fb084 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] 10.222.0.39 "GET /compute/v2.1/servers/a271510f-d551-4e39-a247-eeedd504cedf" status: 200 len: 1469 microversion: 2.1 time: 0.708514 Aug 07 01:47:45.775021 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3066/5674] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:47:45 2022] GET /compute/v2.1/servers/a271510f-d551-4e39-a247-eeedd504cedf => generated 1469 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:47:46.760416 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-e2e7bf2c-12b5-4a73-90d1-d82747641670 req-edd4d7b1-1958-44cb-821f-491090a39e12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a271510f-d551-4e39-a247-eeedd504cedf", "name": "network-vif-deleted", "tag": "900f5a08-751a-48a0-8f10-e5ebc808fca2"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:47:46.788900 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4e320963-e609-4d38-895f-f2b2a0a2a672 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:47:46.790051 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4e320963-e609-4d38-895f-f2b2a0a2a672 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] [instance: a271510f-d551-4e39-a247-eeedd504cedf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:47:46.805840 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-e2e7bf2c-12b5-4a73-90d1-d82747641670 req-edd4d7b1-1958-44cb-821f-491090a39e12 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:47:46.806429 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-e2e7bf2c-12b5-4a73-90d1-d82747641670 req-edd4d7b1-1958-44cb-821f-491090a39e12 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:47:46.806983 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-e2e7bf2c-12b5-4a73-90d1-d82747641670 req-edd4d7b1-1958-44cb-821f-491090a39e12 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:47:46.808296 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4e320963-e609-4d38-895f-f2b2a0a2a672 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:47:46.808774 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4e320963-e609-4d38-895f-f2b2a0a2a672 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:47:46.809212 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4e320963-e609-4d38-895f-f2b2a0a2a672 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:47:46.810541 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4e320963-e609-4d38-895f-f2b2a0a2a672 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:47:46.815715 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4e320963-e609-4d38-895f-f2b2a0a2a672 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:47:46.816520 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4e320963-e609-4d38-895f-f2b2a0a2a672 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:47:46.849087 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-e2e7bf2c-12b5-4a73-90d1-d82747641670 req-edd4d7b1-1958-44cb-821f-491090a39e12 service nova] Creating event network-vif-deleted:900f5a08-751a-48a0-8f10-e5ebc808fca2 for instance a271510f-d551-4e39-a247-eeedd504cedf on n-h1-master-1 Aug 07 01:47:46.861964 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-e2e7bf2c-12b5-4a73-90d1-d82747641670 req-edd4d7b1-1958-44cb-821f-491090a39e12 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104927 Aug 07 01:47:46.862721 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2609/5675] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:47:47.078953 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4e320963-e609-4d38-895f-f2b2a0a2a672 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0eddcab4c14931b7c20f86f3115981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bbd14acc689493b84d8fa6d0137bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:47:47.087357 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4e320963-e609-4d38-895f-f2b2a0a2a672 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] 10.222.0.39 "GET /compute/v2.1/servers/a271510f-d551-4e39-a247-eeedd504cedf" status: 200 len: 1299 microversion: 2.1 time: 0.309487 Aug 07 01:47:47.088156 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3067/5676] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:47:46 2022] GET /compute/v2.1/servers/a271510f-d551-4e39-a247-eeedd504cedf => generated 1299 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:47:47.929068 n-d-master-1 devstack@n-api.service[119517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 01:47:47.929525 n-d-master-1 devstack@n-api.service[119517]: Sun Aug 7 01:47:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 01:47:48.113507 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4f085ddc-2906-4994-adce-8699beb9ada1 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:47:48.114275 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4f085ddc-2906-4994-adce-8699beb9ada1 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] [instance: a271510f-d551-4e39-a247-eeedd504cedf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:47:48.128514 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f085ddc-2906-4994-adce-8699beb9ada1 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:47:48.129017 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f085ddc-2906-4994-adce-8699beb9ada1 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:47:48.129488 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f085ddc-2906-4994-adce-8699beb9ada1 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:47:48.130241 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f085ddc-2906-4994-adce-8699beb9ada1 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:47:48.130705 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f085ddc-2906-4994-adce-8699beb9ada1 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:47:48.131139 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f085ddc-2906-4994-adce-8699beb9ada1 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:47:48.156403 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-4f085ddc-2906-4994-adce-8699beb9ada1 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] HTTP exception thrown: Instance a271510f-d551-4e39-a247-eeedd504cedf could not be found. Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4f085ddc-2906-4994-adce-8699beb9ada1 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Request method failure captured: Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/a271510f-d551-4e39-a247-eeedd504cedf HTTP/1.1 Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xkGj2oU-QFkhL2_D_NRe8vDt23ZqQRMzTAqLiSaIqeOvninFqsQoaUufcN2qzf12DwjkSetpDdOV5Z49b0DAE56ecuZW_23UkhUyn1Ro8fI4NFKofKGyxwu9uyTE6dU4cDIMyZv7Y8nvtFwxis3fhox8hSF_IIiqUpyhCb1paLzuJY Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 7bbd14acc689493b84d8fa6d0137bdbf Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-VolumesBackupsTest-159241814 Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7bbd14acc689493b84d8fa6d0137bdbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7bbd14acc689493b84d8fa6d0137bdbf", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7bbd14acc689493b84d8fa6d0137bdbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7bbd14acc689493b84d8fa6d0137bdbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-VolumesBackupsTest-159241814 Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 7bbd14acc689493b84d8fa6d0137bdbf Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-VolumesBackupsTest-159241814 Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-VolumesBackupsTest-159241814-project Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: fe0eddcab4c14931b7c20f86f3115981 Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-VolumesBackupsTest-159241814-project Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: exception: Instance a271510f-d551-4e39-a247-eeedd504cedf could not be found. Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'a271510f-d551-4e39-a247-eeedd504cedf'} Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a271510f-d551-4e39-a247-eeedd504cedf could not be found. Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a271510f-d551-4e39-a247-eeedd504cedf could not be found. Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:47:48.158312 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:47:48.161418 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:47:48.161418 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:47:48.161418 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:47:48.161418 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:47:48.161418 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:47:48.161418 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a271510f-d551-4e39-a247-eeedd504cedf could not be found. Aug 07 01:47:48.161418 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:47:48.162549 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4f085ddc-2906-4994-adce-8699beb9ada1 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] Returning 404 to user: Instance a271510f-d551-4e39-a247-eeedd504cedf could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:47:48.163431 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4f085ddc-2906-4994-adce-8699beb9ada1 tempest-VolumesBackupsTest-159241814 tempest-VolumesBackupsTest-159241814-project] 10.222.0.39 "GET /compute/v2.1/servers/a271510f-d551-4e39-a247-eeedd504cedf" status: 404 len: 111 microversion: 2.1 time: 0.058044 Aug 07 01:47:48.164484 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2610/5677] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:47:48 2022] GET /compute/v2.1/servers/a271510f-d551-4e39-a247-eeedd504cedf => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:48:47.932891 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:47.933794 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=18 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:48.891919 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ccf03a82-8208-41b7-a2af-d97035ad4d54 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-141215517", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "054f4353-f16c-4a49-b344-c010d99dade0"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:48:49.043001 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-ccf03a82-8208-41b7-a2af-d97035ad4d54 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] validate_networks() for [('054f4353-f16c-4a49-b344-c010d99dade0', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:48:50.492532 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-ccf03a82-8208-41b7-a2af-d97035ad4d54 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:48:50.493343 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-ccf03a82-8208-41b7-a2af-d97035ad4d54 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:48:50.494241 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-ccf03a82-8208-41b7-a2af-d97035ad4d54 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:48:50.494980 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-ccf03a82-8208-41b7-a2af-d97035ad4d54 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:48:50.495691 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-ccf03a82-8208-41b7-a2af-d97035ad4d54 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:48:50.533011 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ccf03a82-8208-41b7-a2af-d97035ad4d54 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:48:50.533767 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ccf03a82-8208-41b7-a2af-d97035ad4d54 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:48:50.534602 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ccf03a82-8208-41b7-a2af-d97035ad4d54 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:48:50.536041 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ccf03a82-8208-41b7-a2af-d97035ad4d54 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:48:50.536876 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ccf03a82-8208-41b7-a2af-d97035ad4d54 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:48:50.537630 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ccf03a82-8208-41b7-a2af-d97035ad4d54 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:48:50.613362 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-ccf03a82-8208-41b7-a2af-d97035ad4d54 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Getting quotas for project 1a9db9d793594df2aa9c2658abad18c3. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:48:50.621407 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-ccf03a82-8208-41b7-a2af-d97035ad4d54 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Getting quotas for user aa475ec9a7ff4bc999bc83c53eb1f5eb and project 1a9db9d793594df2aa9c2658abad18c3. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:48:50.657105 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ccf03a82-8208-41b7-a2af-d97035ad4d54 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:48:50.685307 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ccf03a82-8208-41b7-a2af-d97035ad4d54 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] [instance: f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:48:50.857301 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ccf03a82-8208-41b7-a2af-d97035ad4d54 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.926590 Aug 07 01:48:50.859229 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3068/5678] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:48:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 07 01:48:50.871365 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:50.872786 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:50.899223 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7ff1ec0a-d148-41c6-80dd-9e3247d73d52 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:48:50.900573 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7ff1ec0a-d148-41c6-80dd-9e3247d73d52 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] [instance: f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:48:51.113396 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7ff1ec0a-d148-41c6-80dd-9e3247d73d52 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa475ec9a7ff4bc999bc83c53eb1f5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9db9d793594df2aa9c2658abad18c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:48:51.135248 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7ff1ec0a-d148-41c6-80dd-9e3247d73d52 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] 10.222.0.39 "GET /compute/v2.1/servers/f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a" status: 200 len: 1213 microversion: 2.1 time: 0.267772 Aug 07 01:48:51.150347 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2611/5679] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:48:50 2022] GET /compute/v2.1/servers/f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a => generated 1213 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:48:52.174740 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3208410b-6ec1-4d3b-a512-f3271befb19d tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:48:52.175933 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3208410b-6ec1-4d3b-a512-f3271befb19d tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] [instance: f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:48:52.381717 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3208410b-6ec1-4d3b-a512-f3271befb19d tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa475ec9a7ff4bc999bc83c53eb1f5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9db9d793594df2aa9c2658abad18c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:48:52.403746 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3208410b-6ec1-4d3b-a512-f3271befb19d tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] 10.222.0.39 "GET /compute/v2.1/servers/f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a" status: 200 len: 1213 microversion: 2.1 time: 0.236318 Aug 07 01:48:52.407530 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3069/5680] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:48:52 2022] GET /compute/v2.1/servers/f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a => generated 1213 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:48:53.428147 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8bd30262-3a37-44d3-8854-f1f307fd30d2 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:48:53.429137 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8bd30262-3a37-44d3-8854-f1f307fd30d2 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] [instance: f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:48:53.452284 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8bd30262-3a37-44d3-8854-f1f307fd30d2 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:48:53.452993 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8bd30262-3a37-44d3-8854-f1f307fd30d2 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:48:53.453461 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8bd30262-3a37-44d3-8854-f1f307fd30d2 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:48:53.455672 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8bd30262-3a37-44d3-8854-f1f307fd30d2 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:48:53.457350 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8bd30262-3a37-44d3-8854-f1f307fd30d2 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:48:53.457835 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8bd30262-3a37-44d3-8854-f1f307fd30d2 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:48:53.770594 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8bd30262-3a37-44d3-8854-f1f307fd30d2 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa475ec9a7ff4bc999bc83c53eb1f5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9db9d793594df2aa9c2658abad18c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:48:53.785039 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8bd30262-3a37-44d3-8854-f1f307fd30d2 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] 10.222.0.39 "GET /compute/v2.1/servers/f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a" status: 200 len: 1283 microversion: 2.1 time: 0.362421 Aug 07 01:48:53.788241 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2612/5681] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:48:53 2022] GET /compute/v2.1/servers/f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a => generated 1283 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:48:54.818427 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b882051f-7e42-499c-8dce-feb77e3ce2c0 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:48:54.819052 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b882051f-7e42-499c-8dce-feb77e3ce2c0 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] [instance: f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:48:54.850939 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b882051f-7e42-499c-8dce-feb77e3ce2c0 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:48:54.862214 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b882051f-7e42-499c-8dce-feb77e3ce2c0 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:48:54.862692 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b882051f-7e42-499c-8dce-feb77e3ce2c0 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:48:54.868987 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b882051f-7e42-499c-8dce-feb77e3ce2c0 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:48:54.869711 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b882051f-7e42-499c-8dce-feb77e3ce2c0 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:48:54.870942 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b882051f-7e42-499c-8dce-feb77e3ce2c0 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:48:55.501320 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b882051f-7e42-499c-8dce-feb77e3ce2c0 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa475ec9a7ff4bc999bc83c53eb1f5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9db9d793594df2aa9c2658abad18c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:48:55.515479 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b882051f-7e42-499c-8dce-feb77e3ce2c0 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] 10.222.0.39 "GET /compute/v2.1/servers/f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a" status: 200 len: 1313 microversion: 2.1 time: 0.701630 Aug 07 01:48:55.516950 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3070/5682] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:48:54 2022] GET /compute/v2.1/servers/f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a => generated 1313 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:48:56.268643 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-25d8209f-40d7-41c4-9cf1-6259c1c85ffc req-fb0023d2-ac18-4bc2-883b-3701f04c9b93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a", "tag": "35fd22ee-8427-4df1-aba4-41dffa557826"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:48:56.320683 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-25d8209f-40d7-41c4-9cf1-6259c1c85ffc req-fb0023d2-ac18-4bc2-883b-3701f04c9b93 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:48:56.322276 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-25d8209f-40d7-41c4-9cf1-6259c1c85ffc req-fb0023d2-ac18-4bc2-883b-3701f04c9b93 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:48:56.324359 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-25d8209f-40d7-41c4-9cf1-6259c1c85ffc req-fb0023d2-ac18-4bc2-883b-3701f04c9b93 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:48:56.355356 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-25d8209f-40d7-41c4-9cf1-6259c1c85ffc req-fb0023d2-ac18-4bc2-883b-3701f04c9b93 service nova] Creating event network-changed:35fd22ee-8427-4df1-aba4-41dffa557826 for instance f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a on n-h1-master-1 Aug 07 01:48:56.375228 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-25d8209f-40d7-41c4-9cf1-6259c1c85ffc req-fb0023d2-ac18-4bc2-883b-3701f04c9b93 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112793 Aug 07 01:48:56.377782 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2613/5683] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:48:56.537440 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-eb0a0f76-a8eb-4c43-b111-634c4f076a86 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:48:56.538069 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-eb0a0f76-a8eb-4c43-b111-634c4f076a86 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] [instance: f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:48:56.551091 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb0a0f76-a8eb-4c43-b111-634c4f076a86 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:48:56.551593 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb0a0f76-a8eb-4c43-b111-634c4f076a86 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:48:56.558762 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb0a0f76-a8eb-4c43-b111-634c4f076a86 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:48:56.561010 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb0a0f76-a8eb-4c43-b111-634c4f076a86 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:48:56.562673 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb0a0f76-a8eb-4c43-b111-634c4f076a86 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:48:56.565871 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb0a0f76-a8eb-4c43-b111-634c4f076a86 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:48:56.925493 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-eb0a0f76-a8eb-4c43-b111-634c4f076a86 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa475ec9a7ff4bc999bc83c53eb1f5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9db9d793594df2aa9c2658abad18c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:48:56.943581 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-eb0a0f76-a8eb-4c43-b111-634c4f076a86 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] 10.222.0.39 "GET /compute/v2.1/servers/f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a" status: 200 len: 1313 microversion: 2.1 time: 0.402572 Aug 07 01:48:56.955984 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3071/5684] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:48:56 2022] GET /compute/v2.1/servers/f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a => generated 1313 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:48:57.969395 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-10ea7cde-ba90-4158-ba42-765d49ca2c9d tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:48:57.970753 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-10ea7cde-ba90-4158-ba42-765d49ca2c9d tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] [instance: f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:48:57.980029 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10ea7cde-ba90-4158-ba42-765d49ca2c9d tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:48:57.980980 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10ea7cde-ba90-4158-ba42-765d49ca2c9d tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:48:57.981793 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10ea7cde-ba90-4158-ba42-765d49ca2c9d tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:48:57.983281 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10ea7cde-ba90-4158-ba42-765d49ca2c9d tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:48:57.984038 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10ea7cde-ba90-4158-ba42-765d49ca2c9d tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:48:57.984694 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10ea7cde-ba90-4158-ba42-765d49ca2c9d tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:48:58.253346 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-10ea7cde-ba90-4158-ba42-765d49ca2c9d tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa475ec9a7ff4bc999bc83c53eb1f5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9db9d793594df2aa9c2658abad18c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:48:58.287093 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-10ea7cde-ba90-4158-ba42-765d49ca2c9d tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] 10.222.0.39 "GET /compute/v2.1/servers/f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a" status: 200 len: 1313 microversion: 2.1 time: 0.320385 Aug 07 01:48:58.288573 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2614/5685] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:48:57 2022] GET /compute/v2.1/servers/f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a => generated 1313 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:48:59.314899 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e9d7414d-b963-4fb8-9498-1522f55658c0 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:48:59.316851 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e9d7414d-b963-4fb8-9498-1522f55658c0 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] [instance: f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:48:59.334465 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9d7414d-b963-4fb8-9498-1522f55658c0 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:48:59.335927 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9d7414d-b963-4fb8-9498-1522f55658c0 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:48:59.338142 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9d7414d-b963-4fb8-9498-1522f55658c0 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:48:59.341616 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9d7414d-b963-4fb8-9498-1522f55658c0 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:48:59.342315 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9d7414d-b963-4fb8-9498-1522f55658c0 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:48:59.344829 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9d7414d-b963-4fb8-9498-1522f55658c0 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:49:00.123234 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e9d7414d-b963-4fb8-9498-1522f55658c0 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa475ec9a7ff4bc999bc83c53eb1f5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9db9d793594df2aa9c2658abad18c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:49:00.137772 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e9d7414d-b963-4fb8-9498-1522f55658c0 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] 10.222.0.39 "GET /compute/v2.1/servers/f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a" status: 200 len: 1313 microversion: 2.1 time: 0.828075 Aug 07 01:49:00.138709 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3072/5686] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:48:59 2022] GET /compute/v2.1/servers/f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a => generated 1313 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:49:01.167666 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2bff9c54-a446-4138-9f7f-e1a90f735f5f tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:49:01.169073 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2bff9c54-a446-4138-9f7f-e1a90f735f5f tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] [instance: f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:49:01.172325 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:01.195259 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2bff9c54-a446-4138-9f7f-e1a90f735f5f tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:49:01.197439 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2bff9c54-a446-4138-9f7f-e1a90f735f5f tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:49:01.198057 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2bff9c54-a446-4138-9f7f-e1a90f735f5f tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:49:01.198951 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2bff9c54-a446-4138-9f7f-e1a90f735f5f tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:49:01.200699 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2bff9c54-a446-4138-9f7f-e1a90f735f5f tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:49:01.202250 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2bff9c54-a446-4138-9f7f-e1a90f735f5f tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:49:01.578153 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2bff9c54-a446-4138-9f7f-e1a90f735f5f tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa475ec9a7ff4bc999bc83c53eb1f5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9db9d793594df2aa9c2658abad18c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:49:01.590655 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2bff9c54-a446-4138-9f7f-e1a90f735f5f tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] 10.222.0.39 "GET /compute/v2.1/servers/f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a" status: 200 len: 1313 microversion: 2.1 time: 0.427462 Aug 07 01:49:01.591833 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2615/5687] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:49:01 2022] GET /compute/v2.1/servers/f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a => generated 1313 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:49:02.613913 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-122fba77-bdde-4f09-91d2-b645b43affd5 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:49:02.614839 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-122fba77-bdde-4f09-91d2-b645b43affd5 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] [instance: f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:49:02.636214 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:02.641138 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=8 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:02.652013 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-122fba77-bdde-4f09-91d2-b645b43affd5 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:49:02.653761 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-122fba77-bdde-4f09-91d2-b645b43affd5 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:49:02.655810 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-122fba77-bdde-4f09-91d2-b645b43affd5 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:49:02.661914 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-122fba77-bdde-4f09-91d2-b645b43affd5 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:49:02.662508 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-122fba77-bdde-4f09-91d2-b645b43affd5 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:49:02.662971 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-122fba77-bdde-4f09-91d2-b645b43affd5 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:49:03.089199 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-122fba77-bdde-4f09-91d2-b645b43affd5 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa475ec9a7ff4bc999bc83c53eb1f5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9db9d793594df2aa9c2658abad18c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:49:03.102541 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-122fba77-bdde-4f09-91d2-b645b43affd5 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] 10.222.0.39 "GET /compute/v2.1/servers/f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a" status: 200 len: 1313 microversion: 2.1 time: 0.492306 Aug 07 01:49:03.106644 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3073/5688] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:49:02 2022] GET /compute/v2.1/servers/f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a => generated 1313 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:49:03.448230 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-7372d953-ff26-4b34-a429-da5fd0905b7a req-8922e43c-ed6e-4c02-93ca-51a1d48f500a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a", "name": "network-vif-plugged", "status": "completed", "tag": "35fd22ee-8427-4df1-aba4-41dffa557826"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:49:03.459620 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-7372d953-ff26-4b34-a429-da5fd0905b7a req-8922e43c-ed6e-4c02-93ca-51a1d48f500a service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:49:03.460664 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-7372d953-ff26-4b34-a429-da5fd0905b7a req-8922e43c-ed6e-4c02-93ca-51a1d48f500a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:49:03.461720 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-7372d953-ff26-4b34-a429-da5fd0905b7a req-8922e43c-ed6e-4c02-93ca-51a1d48f500a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:49:03.478067 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-7372d953-ff26-4b34-a429-da5fd0905b7a req-8922e43c-ed6e-4c02-93ca-51a1d48f500a service nova] Creating event network-vif-plugged:35fd22ee-8427-4df1-aba4-41dffa557826 for instance f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a on n-h1-master-1 Aug 07 01:49:03.485620 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-7372d953-ff26-4b34-a429-da5fd0905b7a req-8922e43c-ed6e-4c02-93ca-51a1d48f500a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.563316 Aug 07 01:49:03.490972 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2616/5689] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:49:04.130154 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9d7c1051-2565-40af-b4d2-8eeba381dc24 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:49:04.131133 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9d7c1051-2565-40af-b4d2-8eeba381dc24 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] [instance: f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:49:04.147582 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d7c1051-2565-40af-b4d2-8eeba381dc24 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:49:04.150248 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d7c1051-2565-40af-b4d2-8eeba381dc24 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:49:04.150982 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d7c1051-2565-40af-b4d2-8eeba381dc24 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:49:04.152623 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d7c1051-2565-40af-b4d2-8eeba381dc24 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:49:04.153230 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d7c1051-2565-40af-b4d2-8eeba381dc24 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:49:04.153988 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d7c1051-2565-40af-b4d2-8eeba381dc24 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:49:04.428146 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9d7c1051-2565-40af-b4d2-8eeba381dc24 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa475ec9a7ff4bc999bc83c53eb1f5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9db9d793594df2aa9c2658abad18c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:49:04.442499 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9d7c1051-2565-40af-b4d2-8eeba381dc24 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] 10.222.0.39 "GET /compute/v2.1/servers/f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a" status: 200 len: 1313 microversion: 2.1 time: 0.317691 Aug 07 01:49:04.447969 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3074/5690] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:49:04 2022] GET /compute/v2.1/servers/f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a => generated 1313 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:49:05.478895 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-612098d4-5f57-4882-82e9-feb436c72d78 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:49:05.483925 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-612098d4-5f57-4882-82e9-feb436c72d78 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] [instance: f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:49:05.509935 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-612098d4-5f57-4882-82e9-feb436c72d78 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:49:05.509935 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-612098d4-5f57-4882-82e9-feb436c72d78 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:49:05.510221 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-612098d4-5f57-4882-82e9-feb436c72d78 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:49:05.518214 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-612098d4-5f57-4882-82e9-feb436c72d78 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:49:05.519111 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-612098d4-5f57-4882-82e9-feb436c72d78 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:49:05.519937 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-612098d4-5f57-4882-82e9-feb436c72d78 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:49:05.848440 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-612098d4-5f57-4882-82e9-feb436c72d78 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa475ec9a7ff4bc999bc83c53eb1f5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9db9d793594df2aa9c2658abad18c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:49:05.864349 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-612098d4-5f57-4882-82e9-feb436c72d78 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] 10.222.0.39 "GET /compute/v2.1/servers/f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a" status: 200 len: 1497 microversion: 2.1 time: 0.398460 Aug 07 01:49:05.878609 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2617/5691] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:49:05 2022] GET /compute/v2.1/servers/f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a => generated 1497 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:49:11.283701 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a4f0722a-3683-4bce-a5ae-791e43f3c24d tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:49:11.287474 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a4f0722a-3683-4bce-a5ae-791e43f3c24d tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] [instance: f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:49:11.312265 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4f0722a-3683-4bce-a5ae-791e43f3c24d tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:49:11.314069 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4f0722a-3683-4bce-a5ae-791e43f3c24d tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:49:11.315073 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4f0722a-3683-4bce-a5ae-791e43f3c24d tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:49:11.316675 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4f0722a-3683-4bce-a5ae-791e43f3c24d tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:49:11.320152 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4f0722a-3683-4bce-a5ae-791e43f3c24d tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:49:11.322702 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4f0722a-3683-4bce-a5ae-791e43f3c24d tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:49:11.401442 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a4f0722a-3683-4bce-a5ae-791e43f3c24d tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] [instance: f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:49:11.604613 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a4f0722a-3683-4bce-a5ae-791e43f3c24d tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a" status: 204 len: 0 microversion: 2.1 time: 0.329546 Aug 07 01:49:11.606228 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3075/5692] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:49:11 2022] DELETE /compute/v2.1/servers/f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:49:11.615267 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ba48cb6a-43e5-4441-a129-52b1b27e522d tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:49:11.615925 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ba48cb6a-43e5-4441-a129-52b1b27e522d tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] [instance: f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:49:11.627009 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ba48cb6a-43e5-4441-a129-52b1b27e522d tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:49:11.627548 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ba48cb6a-43e5-4441-a129-52b1b27e522d tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:49:11.628051 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ba48cb6a-43e5-4441-a129-52b1b27e522d tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:49:11.636170 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ba48cb6a-43e5-4441-a129-52b1b27e522d tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:49:11.636170 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ba48cb6a-43e5-4441-a129-52b1b27e522d tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:49:11.636510 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ba48cb6a-43e5-4441-a129-52b1b27e522d tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:49:11.980650 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ba48cb6a-43e5-4441-a129-52b1b27e522d tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa475ec9a7ff4bc999bc83c53eb1f5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9db9d793594df2aa9c2658abad18c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:49:11.997228 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ba48cb6a-43e5-4441-a129-52b1b27e522d tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] 10.222.0.39 "GET /compute/v2.1/servers/f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a" status: 200 len: 1503 microversion: 2.1 time: 0.386310 Aug 07 01:49:11.998079 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2618/5693] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:49:11 2022] GET /compute/v2.1/servers/f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a => generated 1503 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:49:13.019777 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-87a2c7dd-386d-4b6f-8d41-a2492c3e09ab tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:49:13.020580 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-87a2c7dd-386d-4b6f-8d41-a2492c3e09ab tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] [instance: f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:49:13.038750 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-87a2c7dd-386d-4b6f-8d41-a2492c3e09ab tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:49:13.041979 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-87a2c7dd-386d-4b6f-8d41-a2492c3e09ab tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:49:13.043539 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-87a2c7dd-386d-4b6f-8d41-a2492c3e09ab tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:49:13.044398 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-87a2c7dd-386d-4b6f-8d41-a2492c3e09ab tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:49:13.046411 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-87a2c7dd-386d-4b6f-8d41-a2492c3e09ab tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:49:13.048380 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-87a2c7dd-386d-4b6f-8d41-a2492c3e09ab tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:49:13.682565 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-87a2c7dd-386d-4b6f-8d41-a2492c3e09ab tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa475ec9a7ff4bc999bc83c53eb1f5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9db9d793594df2aa9c2658abad18c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:49:13.695648 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-87a2c7dd-386d-4b6f-8d41-a2492c3e09ab tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] 10.222.0.39 "GET /compute/v2.1/servers/f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a" status: 200 len: 1503 microversion: 2.1 time: 0.680146 Aug 07 01:49:13.698548 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3076/5694] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:49:13 2022] GET /compute/v2.1/servers/f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a => generated 1503 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:49:14.487018 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-960ab8a4-efe9-463e-b991-b13304dacd00 req-a52d5199-e209-4914-94c6-75a80918f3ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a", "name": "network-vif-deleted", "tag": "35fd22ee-8427-4df1-aba4-41dffa557826"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:49:14.519068 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-960ab8a4-efe9-463e-b991-b13304dacd00 req-a52d5199-e209-4914-94c6-75a80918f3ac service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:49:14.519567 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-960ab8a4-efe9-463e-b991-b13304dacd00 req-a52d5199-e209-4914-94c6-75a80918f3ac service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:49:14.520097 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-960ab8a4-efe9-463e-b991-b13304dacd00 req-a52d5199-e209-4914-94c6-75a80918f3ac service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:49:14.549218 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-960ab8a4-efe9-463e-b991-b13304dacd00 req-a52d5199-e209-4914-94c6-75a80918f3ac service nova] Creating event network-vif-deleted:35fd22ee-8427-4df1-aba4-41dffa557826 for instance f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a on n-h1-master-1 Aug 07 01:49:14.558493 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-960ab8a4-efe9-463e-b991-b13304dacd00 req-a52d5199-e209-4914-94c6-75a80918f3ac service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081267 Aug 07 01:49:14.563237 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2619/5695] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:49:14.718991 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-960cfc11-43c1-4504-a4f7-6e274dc3aeb1 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:49:14.719614 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-960cfc11-43c1-4504-a4f7-6e274dc3aeb1 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] [instance: f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:49:14.727274 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-960cfc11-43c1-4504-a4f7-6e274dc3aeb1 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:49:14.727772 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-960cfc11-43c1-4504-a4f7-6e274dc3aeb1 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:49:14.740526 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-960cfc11-43c1-4504-a4f7-6e274dc3aeb1 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:49:14.741342 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-960cfc11-43c1-4504-a4f7-6e274dc3aeb1 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:49:14.741834 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-960cfc11-43c1-4504-a4f7-6e274dc3aeb1 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:49:14.742812 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-960cfc11-43c1-4504-a4f7-6e274dc3aeb1 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:49:14.796125 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-960cfc11-43c1-4504-a4f7-6e274dc3aeb1 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:49:14.809840 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-960cfc11-43c1-4504-a4f7-6e274dc3aeb1 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:49:14.818087 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-960cfc11-43c1-4504-a4f7-6e274dc3aeb1 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:49:14.818789 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-960cfc11-43c1-4504-a4f7-6e274dc3aeb1 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lazy-loading 'fault' on Instance uuid f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:49:15.011654 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-960cfc11-43c1-4504-a4f7-6e274dc3aeb1 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa475ec9a7ff4bc999bc83c53eb1f5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a9db9d793594df2aa9c2658abad18c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:49:15.028428 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-960cfc11-43c1-4504-a4f7-6e274dc3aeb1 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] 10.222.0.39 "GET /compute/v2.1/servers/f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a" status: 200 len: 1303 microversion: 2.1 time: 0.313416 Aug 07 01:49:15.029476 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3077/5696] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:49:14 2022] GET /compute/v2.1/servers/f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a => generated 1303 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:49:16.055190 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3fbe7610-657b-4bb2-93e4-9be1a263d4a5 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:49:16.056517 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3fbe7610-657b-4bb2-93e4-9be1a263d4a5 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] [instance: f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:49:16.074838 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3fbe7610-657b-4bb2-93e4-9be1a263d4a5 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:49:16.075858 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3fbe7610-657b-4bb2-93e4-9be1a263d4a5 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:49:16.076199 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3fbe7610-657b-4bb2-93e4-9be1a263d4a5 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:49:16.077065 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3fbe7610-657b-4bb2-93e4-9be1a263d4a5 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:49:16.077594 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3fbe7610-657b-4bb2-93e4-9be1a263d4a5 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:49:16.078089 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3fbe7610-657b-4bb2-93e4-9be1a263d4a5 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:49:16.108139 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-3fbe7610-657b-4bb2-93e4-9be1a263d4a5 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] HTTP exception thrown: Instance f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a could not be found. Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3fbe7610-657b-4bb2-93e4-9be1a263d4a5 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Request method failure captured: Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a HTTP/1.1 Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xn8HiW0pKjJueMVAvrdMKb7c3JoPXBU0vjn4YdxQR3GjTB_sYhs0_ZAY6Lc8pCNPvR8pLY-0GeWeGj4VjCgZ6Hjfd6fifhjciy2_vvxJL0GbqHxUYDrjmoXyIIVvZLGNUgRxoivcbPKYr0-cNEMkfbUeE7XHhipOM5v2wfROc7xL9o Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 1a9db9d793594df2aa9c2658abad18c3 Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-VolumesActionsTest-231105328 Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1a9db9d793594df2aa9c2658abad18c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1a9db9d793594df2aa9c2658abad18c3", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1a9db9d793594df2aa9c2658abad18c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1a9db9d793594df2aa9c2658abad18c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-VolumesActionsTest-231105328 Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 1a9db9d793594df2aa9c2658abad18c3 Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-VolumesActionsTest-231105328 Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-VolumesActionsTest-231105328-project Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: aa475ec9a7ff4bc999bc83c53eb1f5eb Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-VolumesActionsTest-231105328-project Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: exception: Instance f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a could not be found. Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a'} Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a could not be found. Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a could not be found. Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:49:16.112443 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:49:16.117014 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:49:16.117014 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:49:16.117014 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:49:16.117014 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:49:16.117014 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:49:16.117014 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a could not be found. Aug 07 01:49:16.117014 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:49:16.117014 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3fbe7610-657b-4bb2-93e4-9be1a263d4a5 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] Returning 404 to user: Instance f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:49:16.117014 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3fbe7610-657b-4bb2-93e4-9be1a263d4a5 tempest-VolumesActionsTest-231105328 tempest-VolumesActionsTest-231105328-project] 10.222.0.39 "GET /compute/v2.1/servers/f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a" status: 404 len: 111 microversion: 2.1 time: 0.060527 Aug 07 01:49:16.119202 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2620/5697] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:49:16 2022] GET /compute/v2.1/servers/f8f6cec9-c76a-41c5-b8cd-a93e9bb48c7a => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:49:27.827152 n-d-master-1 devstack@n-api.service[119517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 01:49:27.828136 n-d-master-1 devstack@n-api.service[119517]: Sun Aug 7 01:49:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 01:49:28.032300 n-d-master-1 devstack@n-api.service[119516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 01:49:28.032863 n-d-master-1 devstack@n-api.service[119516]: Sun Aug 7 01:49:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 01:51:06.512565 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:51:06.515067 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:51:06.533004 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1a08004f-ce8b-4c7f-8d13-3570f6cef68b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-662607964", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "7a69fddc-c582-4a1f-a932-54499c68d8c7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "620c0b3f-63f9-404f-acf4-ca02927e0de7"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:51:07.067536 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-1a08004f-ce8b-4c7f-8d13-3570f6cef68b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] validate_networks() for [('620c0b3f-63f9-404f-acf4-ca02927e0de7', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:51:07.940061 n-d-master-1 devstack@n-api.service[119517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 01:51:07.940061 n-d-master-1 devstack@n-api.service[119517]: Sun Aug 7 01:51:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 01:51:08.043322 n-d-master-1 devstack@n-api.service[119516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 01:51:08.044037 n-d-master-1 devstack@n-api.service[119516]: Sun Aug 7 01:51:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.39) !!! Aug 07 01:51:08.087861 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-1a08004f-ce8b-4c7f-8d13-3570f6cef68b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:51:08.088319 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-1a08004f-ce8b-4c7f-8d13-3570f6cef68b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:51:08.088801 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-1a08004f-ce8b-4c7f-8d13-3570f6cef68b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:51:08.089215 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-1a08004f-ce8b-4c7f-8d13-3570f6cef68b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:51:08.089635 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-1a08004f-ce8b-4c7f-8d13-3570f6cef68b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:51:08.115590 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1a08004f-ce8b-4c7f-8d13-3570f6cef68b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:08.123300 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1a08004f-ce8b-4c7f-8d13-3570f6cef68b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:08.131147 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1a08004f-ce8b-4c7f-8d13-3570f6cef68b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:08.132537 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1a08004f-ce8b-4c7f-8d13-3570f6cef68b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:08.133070 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1a08004f-ce8b-4c7f-8d13-3570f6cef68b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:08.133652 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1a08004f-ce8b-4c7f-8d13-3570f6cef68b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:08.187548 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-1a08004f-ce8b-4c7f-8d13-3570f6cef68b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Getting quotas for project bf36f5153ba648008cdaceb9dc538e53. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:51:08.202394 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-1a08004f-ce8b-4c7f-8d13-3570f6cef68b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Getting quotas for user 661f6c9aa7da4e348a9b0d91840078c2 and project bf36f5153ba648008cdaceb9dc538e53. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:51:08.331081 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1a08004f-ce8b-4c7f-8d13-3570f6cef68b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:51:08.333287 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1a08004f-ce8b-4c7f-8d13-3570f6cef68b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: f323a1e9-9aaa-40f4-8228-9b787bcc9a39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7a69fddc-c582-4a1f-a932-54499c68d8c7',volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:51:08.647987 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1a08004f-ce8b-4c7f-8d13-3570f6cef68b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.138959 Aug 07 01:51:08.649304 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3078/5698] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:51:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2142 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 07 01:51:08.664220 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c61e2496-18a6-4ce6-98d6-961465bb1a15 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:08.664855 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c61e2496-18a6-4ce6-98d6-961465bb1a15 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: f323a1e9-9aaa-40f4-8228-9b787bcc9a39] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:08.682795 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=22 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:51:08.689749 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=38 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:51:09.177934 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c61e2496-18a6-4ce6-98d6-961465bb1a15 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:09.185460 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c61e2496-18a6-4ce6-98d6-961465bb1a15 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39" status: 200 len: 1056 microversion: 2.1 time: 0.526274 Aug 07 01:51:09.189434 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2621/5699] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:08 2022] GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39 => generated 1056 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:10.215157 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ada4dec7-a5cd-42f1-a98b-9ed7b7aefaba tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:10.216371 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ada4dec7-a5cd-42f1-a98b-9ed7b7aefaba tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: f323a1e9-9aaa-40f4-8228-9b787bcc9a39] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:10.340275 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ada4dec7-a5cd-42f1-a98b-9ed7b7aefaba tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:10.353142 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ada4dec7-a5cd-42f1-a98b-9ed7b7aefaba tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39" status: 200 len: 1056 microversion: 2.1 time: 0.138108 Aug 07 01:51:10.354244 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3079/5700] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:10 2022] GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39 => generated 1056 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:11.375866 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f39ce380-0b56-4dfc-af87-87928bde646d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:11.378368 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f39ce380-0b56-4dfc-af87-87928bde646d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: f323a1e9-9aaa-40f4-8228-9b787bcc9a39] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:11.551581 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f39ce380-0b56-4dfc-af87-87928bde646d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:11.581354 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f39ce380-0b56-4dfc-af87-87928bde646d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39" status: 200 len: 1056 microversion: 2.1 time: 0.207750 Aug 07 01:51:11.582221 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2622/5701] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:11 2022] GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39 => generated 1056 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:12.606992 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8db10d71-02f2-4c8f-8bf6-52ec1b36e9a0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:12.607674 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8db10d71-02f2-4c8f-8bf6-52ec1b36e9a0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: f323a1e9-9aaa-40f4-8228-9b787bcc9a39] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:12.770443 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8db10d71-02f2-4c8f-8bf6-52ec1b36e9a0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:12.779197 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8db10d71-02f2-4c8f-8bf6-52ec1b36e9a0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39" status: 200 len: 1056 microversion: 2.1 time: 0.179603 Aug 07 01:51:12.804268 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3080/5702] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:12 2022] GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39 => generated 1056 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:13.809632 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9260e890-d571-46a0-b711-eef27e3262a9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:13.810266 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9260e890-d571-46a0-b711-eef27e3262a9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: f323a1e9-9aaa-40f4-8228-9b787bcc9a39] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:13.828177 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9260e890-d571-46a0-b711-eef27e3262a9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:13.830863 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9260e890-d571-46a0-b711-eef27e3262a9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:13.833034 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9260e890-d571-46a0-b711-eef27e3262a9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:13.835154 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9260e890-d571-46a0-b711-eef27e3262a9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:13.838094 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9260e890-d571-46a0-b711-eef27e3262a9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:13.838830 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9260e890-d571-46a0-b711-eef27e3262a9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:14.315631 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9260e890-d571-46a0-b711-eef27e3262a9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:14.377903 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9260e890-d571-46a0-b711-eef27e3262a9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39" status: 200 len: 1106 microversion: 2.1 time: 0.557679 Aug 07 01:51:14.378836 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2623/5703] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:13 2022] GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39 => generated 1106 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:15.339919 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1da42d1b-0ac1-4e9f-a161-b9891bfadf47 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Action: 'create', calling method: .version_select at 0x7f9e17af9a60>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-468167867", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbicwGoww1qKYQaHWtLJwJDmf9YHab3TqTshJu9F2qDnh3/oKJTrlOrTDdiBJ1s5XUWm6qEem9+zIEly7uqT3uNASJiSiYe2G1QZfZC+prCqQhl9/AErGEdo+Ds/ozkag=="}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:51:15.416883 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-355c5fd8-f937-455e-84f7-2b9043562296 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:15.417263 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-355c5fd8-f937-455e-84f7-2b9043562296 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: f323a1e9-9aaa-40f4-8228-9b787bcc9a39] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:15.426483 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-355c5fd8-f937-455e-84f7-2b9043562296 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:15.426743 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-1da42d1b-0ac1-4e9f-a161-b9891bfadf47 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Getting quotas for project 2bd8662019804060a7b712456d095ad2. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:51:15.427413 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-355c5fd8-f937-455e-84f7-2b9043562296 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:15.427977 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-355c5fd8-f937-455e-84f7-2b9043562296 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:15.429316 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-355c5fd8-f937-455e-84f7-2b9043562296 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:15.430144 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-355c5fd8-f937-455e-84f7-2b9043562296 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:15.438907 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-355c5fd8-f937-455e-84f7-2b9043562296 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:15.472091 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-1da42d1b-0ac1-4e9f-a161-b9891bfadf47 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Getting quotas for user 073f0cff787a466a9fbf9fb43b03b726 and project 2bd8662019804060a7b712456d095ad2. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:51:15.573480 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1da42d1b-0ac1-4e9f-a161-b9891bfadf47 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.238130 Aug 07 01:51:15.574107 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3081/5704] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:51:15 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:51:15.754275 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-355c5fd8-f937-455e-84f7-2b9043562296 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:15.778754 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-355c5fd8-f937-455e-84f7-2b9043562296 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39" status: 200 len: 1172 microversion: 2.1 time: 0.363399 Aug 07 01:51:15.781208 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2624/5705] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:15 2022] GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39 => generated 1172 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:16.808070 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a57c6367-0c9a-4c5f-aa07-25ea165ba6df tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:16.809414 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a57c6367-0c9a-4c5f-aa07-25ea165ba6df tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: f323a1e9-9aaa-40f4-8228-9b787bcc9a39] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:16.826885 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a57c6367-0c9a-4c5f-aa07-25ea165ba6df tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:16.827640 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a57c6367-0c9a-4c5f-aa07-25ea165ba6df tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:16.829909 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a57c6367-0c9a-4c5f-aa07-25ea165ba6df tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:16.832706 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a57c6367-0c9a-4c5f-aa07-25ea165ba6df tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:16.837994 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a57c6367-0c9a-4c5f-aa07-25ea165ba6df tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:16.838842 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a57c6367-0c9a-4c5f-aa07-25ea165ba6df tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:17.133549 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a57c6367-0c9a-4c5f-aa07-25ea165ba6df tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:17.181914 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a57c6367-0c9a-4c5f-aa07-25ea165ba6df tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39" status: 200 len: 1172 microversion: 2.1 time: 0.378860 Aug 07 01:51:17.191611 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3082/5706] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:16 2022] GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39 => generated 1172 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:18.206337 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-10ef8e19-e586-4044-88fd-b65bc94d994e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:18.207767 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-10ef8e19-e586-4044-88fd-b65bc94d994e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: f323a1e9-9aaa-40f4-8228-9b787bcc9a39] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:18.243554 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10ef8e19-e586-4044-88fd-b65bc94d994e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:18.268245 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10ef8e19-e586-4044-88fd-b65bc94d994e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:18.292562 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10ef8e19-e586-4044-88fd-b65bc94d994e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:18.294310 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10ef8e19-e586-4044-88fd-b65bc94d994e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:18.295053 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10ef8e19-e586-4044-88fd-b65bc94d994e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:18.295711 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10ef8e19-e586-4044-88fd-b65bc94d994e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:18.846852 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-10ef8e19-e586-4044-88fd-b65bc94d994e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:18.874068 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-10ef8e19-e586-4044-88fd-b65bc94d994e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39" status: 200 len: 1214 microversion: 2.1 time: 0.672015 Aug 07 01:51:18.874946 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2625/5707] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:18 2022] GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39 => generated 1214 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:19.898009 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ecf1e42e-1d97-4e15-8a2a-27482819db3e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:19.898653 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ecf1e42e-1d97-4e15-8a2a-27482819db3e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: f323a1e9-9aaa-40f4-8228-9b787bcc9a39] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:19.901485 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:51:19.934723 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecf1e42e-1d97-4e15-8a2a-27482819db3e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:19.935172 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecf1e42e-1d97-4e15-8a2a-27482819db3e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:19.935592 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecf1e42e-1d97-4e15-8a2a-27482819db3e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:19.936358 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecf1e42e-1d97-4e15-8a2a-27482819db3e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:19.936813 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecf1e42e-1d97-4e15-8a2a-27482819db3e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:19.944725 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecf1e42e-1d97-4e15-8a2a-27482819db3e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:20.567820 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ecf1e42e-1d97-4e15-8a2a-27482819db3e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:20.583366 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ecf1e42e-1d97-4e15-8a2a-27482819db3e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39" status: 200 len: 1214 microversion: 2.1 time: 0.686268 Aug 07 01:51:20.584099 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3083/5708] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:19 2022] GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39 => generated 1214 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:21.364015 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-fd24dc07-6065-4a8c-acf0-d87136ebae18 req-8175809b-13df-4d85-8152-1bb4e1bfad70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f323a1e9-9aaa-40f4-8228-9b787bcc9a39", "tag": "6fc585a5-ffb4-4db4-871c-0fd552c6e2a3"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:51:21.401795 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7081c03c-651c-4882-ad18-749c510e210a tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-801088454", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "bca7e847-5a88-4615-9903-452d5e6e2073"}], "key_name": "tempest-TestNetworkBasicOps-468167867", "security_groups": [{"name": "tempest-secgroup-smoke-2138487402"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:51:21.414694 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-fd24dc07-6065-4a8c-acf0-d87136ebae18 req-8175809b-13df-4d85-8152-1bb4e1bfad70 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:21.419851 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-fd24dc07-6065-4a8c-acf0-d87136ebae18 req-8175809b-13df-4d85-8152-1bb4e1bfad70 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:21.420577 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-fd24dc07-6065-4a8c-acf0-d87136ebae18 req-8175809b-13df-4d85-8152-1bb4e1bfad70 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:21.503030 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-fd24dc07-6065-4a8c-acf0-d87136ebae18 req-8175809b-13df-4d85-8152-1bb4e1bfad70 service nova] Creating event network-changed:6fc585a5-ffb4-4db4-871c-0fd552c6e2a3 for instance f323a1e9-9aaa-40f4-8228-9b787bcc9a39 on n-h1-master-1 Aug 07 01:51:21.528636 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-fd24dc07-6065-4a8c-acf0-d87136ebae18 req-8175809b-13df-4d85-8152-1bb4e1bfad70 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.890246 Aug 07 01:51:21.529314 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2626/5709] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:51:21.606131 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=4 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:51:21.611507 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4f114237-92e1-41dc-98fd-3fa2a5b6dd3d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:21.612779 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4f114237-92e1-41dc-98fd-3fa2a5b6dd3d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: f323a1e9-9aaa-40f4-8228-9b787bcc9a39] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:21.632717 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f114237-92e1-41dc-98fd-3fa2a5b6dd3d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:21.633185 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f114237-92e1-41dc-98fd-3fa2a5b6dd3d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:21.654315 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f114237-92e1-41dc-98fd-3fa2a5b6dd3d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:21.655157 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f114237-92e1-41dc-98fd-3fa2a5b6dd3d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:21.662073 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f114237-92e1-41dc-98fd-3fa2a5b6dd3d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:21.662560 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4f114237-92e1-41dc-98fd-3fa2a5b6dd3d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:21.807170 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-7081c03c-651c-4882-ad18-749c510e210a tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] validate_networks() for [('bca7e847-5a88-4615-9903-452d5e6e2073', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:51:22.278933 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4f114237-92e1-41dc-98fd-3fa2a5b6dd3d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:22.303200 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4f114237-92e1-41dc-98fd-3fa2a5b6dd3d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39" status: 200 len: 1214 microversion: 2.1 time: 0.697860 Aug 07 01:51:22.303795 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2627/5710] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:21 2022] GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39 => generated 1214 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:51:23.246079 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-7081c03c-651c-4882-ad18-749c510e210a tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:51:23.246618 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-7081c03c-651c-4882-ad18-749c510e210a tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:51:23.246978 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-7081c03c-651c-4882-ad18-749c510e210a tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:51:23.247395 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-7081c03c-651c-4882-ad18-749c510e210a tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:51:23.248243 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-7081c03c-651c-4882-ad18-749c510e210a tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:51:23.265069 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7081c03c-651c-4882-ad18-749c510e210a tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:23.265605 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7081c03c-651c-4882-ad18-749c510e210a tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:23.266611 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7081c03c-651c-4882-ad18-749c510e210a tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:23.267422 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7081c03c-651c-4882-ad18-749c510e210a tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:23.267903 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7081c03c-651c-4882-ad18-749c510e210a tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:23.276259 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7081c03c-651c-4882-ad18-749c510e210a tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:23.336978 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-64891788-cf9f-4e3c-a1ce-d52285c889ce tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:23.339709 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-64891788-cf9f-4e3c-a1ce-d52285c889ce tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: f323a1e9-9aaa-40f4-8228-9b787bcc9a39] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:23.369784 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64891788-cf9f-4e3c-a1ce-d52285c889ce tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:23.376720 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64891788-cf9f-4e3c-a1ce-d52285c889ce tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:23.377384 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64891788-cf9f-4e3c-a1ce-d52285c889ce tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:23.383122 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64891788-cf9f-4e3c-a1ce-d52285c889ce tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:23.383789 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64891788-cf9f-4e3c-a1ce-d52285c889ce tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:23.385604 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64891788-cf9f-4e3c-a1ce-d52285c889ce tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:23.394664 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-7081c03c-651c-4882-ad18-749c510e210a tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Getting quotas for project 2bd8662019804060a7b712456d095ad2. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:51:23.419200 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-7081c03c-651c-4882-ad18-749c510e210a tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Getting quotas for user 073f0cff787a466a9fbf9fb43b03b726 and project 2bd8662019804060a7b712456d095ad2. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:51:23.492921 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7081c03c-651c-4882-ad18-749c510e210a tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:51:23.510816 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7081c03c-651c-4882-ad18-749c510e210a tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: d05d75dd-2cc4-468e-80ca-0e64698d8497] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:51:23.663141 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7081c03c-651c-4882-ad18-749c510e210a tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.265390 Aug 07 01:51:23.668866 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3084/5711] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:51:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 2272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:51:23.706837 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0ce6472a-c330-43df-886d-6d4c1f23fb8f tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:23.711557 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0ce6472a-c330-43df-886d-6d4c1f23fb8f tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: d05d75dd-2cc4-468e-80ca-0e64698d8497] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:24.043245 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0ce6472a-c330-43df-886d-6d4c1f23fb8f tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:24.051910 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0ce6472a-c330-43df-886d-6d4c1f23fb8f tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/d05d75dd-2cc4-468e-80ca-0e64698d8497" status: 200 len: 1247 microversion: 2.1 time: 0.366654 Aug 07 01:51:24.059012 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3085/5712] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:23 2022] GET /compute/v2.1/servers/d05d75dd-2cc4-468e-80ca-0e64698d8497 => generated 1247 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:24.198429 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-64891788-cf9f-4e3c-a1ce-d52285c889ce tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:24.213864 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-64891788-cf9f-4e3c-a1ce-d52285c889ce tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39" status: 200 len: 1214 microversion: 2.1 time: 0.888245 Aug 07 01:51:24.214484 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2628/5713] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:23 2022] GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39 => generated 1214 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:51:25.080974 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7d5b1752-d52b-4607-81a3-495c10c0d51b tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:25.082373 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7d5b1752-d52b-4607-81a3-495c10c0d51b tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: d05d75dd-2cc4-468e-80ca-0e64698d8497] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:25.117057 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d5b1752-d52b-4607-81a3-495c10c0d51b tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:25.121204 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d5b1752-d52b-4607-81a3-495c10c0d51b tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:25.123693 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d5b1752-d52b-4607-81a3-495c10c0d51b tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:25.126803 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d5b1752-d52b-4607-81a3-495c10c0d51b tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:25.167340 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d5b1752-d52b-4607-81a3-495c10c0d51b tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.040s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:25.173128 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d5b1752-d52b-4607-81a3-495c10c0d51b tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:25.239315 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1ed47b5c-6f0a-4450-be3b-96069fdb99e7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:25.250850 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1ed47b5c-6f0a-4450-be3b-96069fdb99e7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: f323a1e9-9aaa-40f4-8228-9b787bcc9a39] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:25.272020 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ed47b5c-6f0a-4450-be3b-96069fdb99e7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:25.274097 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ed47b5c-6f0a-4450-be3b-96069fdb99e7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:25.277069 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ed47b5c-6f0a-4450-be3b-96069fdb99e7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:25.278248 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ed47b5c-6f0a-4450-be3b-96069fdb99e7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:25.280192 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ed47b5c-6f0a-4450-be3b-96069fdb99e7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:25.283157 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ed47b5c-6f0a-4450-be3b-96069fdb99e7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:25.296529 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7d5b1752-d52b-4607-81a3-495c10c0d51b tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:25.304974 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7d5b1752-d52b-4607-81a3-495c10c0d51b tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/d05d75dd-2cc4-468e-80ca-0e64698d8497" status: 200 len: 1243 microversion: 2.1 time: 0.229002 Aug 07 01:51:25.319916 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3086/5714] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:25 2022] GET /compute/v2.1/servers/d05d75dd-2cc4-468e-80ca-0e64698d8497 => generated 1243 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:25.773026 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1ed47b5c-6f0a-4450-be3b-96069fdb99e7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:25.788040 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1ed47b5c-6f0a-4450-be3b-96069fdb99e7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39" status: 200 len: 1214 microversion: 2.1 time: 0.556070 Aug 07 01:51:25.802355 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2629/5715] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:25 2022] GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39 => generated 1214 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:26.342813 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8360bcdd-6896-42fc-8b89-1213115b170c tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:26.344334 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8360bcdd-6896-42fc-8b89-1213115b170c tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: d05d75dd-2cc4-468e-80ca-0e64698d8497] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:26.355521 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8360bcdd-6896-42fc-8b89-1213115b170c tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:26.362010 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8360bcdd-6896-42fc-8b89-1213115b170c tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:26.362729 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8360bcdd-6896-42fc-8b89-1213115b170c tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:26.363980 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8360bcdd-6896-42fc-8b89-1213115b170c tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:26.364628 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8360bcdd-6896-42fc-8b89-1213115b170c tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:26.365225 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8360bcdd-6896-42fc-8b89-1213115b170c tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:26.719826 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8360bcdd-6896-42fc-8b89-1213115b170c tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:26.729406 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8360bcdd-6896-42fc-8b89-1213115b170c tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/d05d75dd-2cc4-468e-80ca-0e64698d8497" status: 200 len: 1305 microversion: 2.1 time: 0.390340 Aug 07 01:51:26.739370 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3087/5716] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:26 2022] GET /compute/v2.1/servers/d05d75dd-2cc4-468e-80ca-0e64698d8497 => generated 1305 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:26.823356 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-49d249b4-7d0f-4e21-95c4-398d1cbfa43b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:26.824174 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-49d249b4-7d0f-4e21-95c4-398d1cbfa43b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: f323a1e9-9aaa-40f4-8228-9b787bcc9a39] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:26.844942 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49d249b4-7d0f-4e21-95c4-398d1cbfa43b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:26.848962 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49d249b4-7d0f-4e21-95c4-398d1cbfa43b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:26.857369 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49d249b4-7d0f-4e21-95c4-398d1cbfa43b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:26.859037 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49d249b4-7d0f-4e21-95c4-398d1cbfa43b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:26.861869 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49d249b4-7d0f-4e21-95c4-398d1cbfa43b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:26.862446 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-49d249b4-7d0f-4e21-95c4-398d1cbfa43b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:27.764068 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d5fa4b6d-ae60-42bc-9218-e12b1accab37 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:27.764703 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d5fa4b6d-ae60-42bc-9218-e12b1accab37 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: d05d75dd-2cc4-468e-80ca-0e64698d8497] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:27.790735 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d5fa4b6d-ae60-42bc-9218-e12b1accab37 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:27.791242 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d5fa4b6d-ae60-42bc-9218-e12b1accab37 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:27.791682 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d5fa4b6d-ae60-42bc-9218-e12b1accab37 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:27.797841 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d5fa4b6d-ae60-42bc-9218-e12b1accab37 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:27.798262 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d5fa4b6d-ae60-42bc-9218-e12b1accab37 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:27.798713 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d5fa4b6d-ae60-42bc-9218-e12b1accab37 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:28.036983 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d5fa4b6d-ae60-42bc-9218-e12b1accab37 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:28.045725 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d5fa4b6d-ae60-42bc-9218-e12b1accab37 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/d05d75dd-2cc4-468e-80ca-0e64698d8497" status: 200 len: 1305 microversion: 2.1 time: 0.286878 Aug 07 01:51:28.047262 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3088/5717] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:27 2022] GET /compute/v2.1/servers/d05d75dd-2cc4-468e-80ca-0e64698d8497 => generated 1305 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:28.416582 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-49d249b4-7d0f-4e21-95c4-398d1cbfa43b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:28.427266 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-49d249b4-7d0f-4e21-95c4-398d1cbfa43b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39" status: 200 len: 1214 microversion: 2.1 time: 1.607829 Aug 07 01:51:28.430735 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2630/5718] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:26 2022] GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39 => generated 1214 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:29.070645 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5923c563-40fd-40cd-a9e0-ce86890f2007 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:29.072083 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5923c563-40fd-40cd-a9e0-ce86890f2007 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: d05d75dd-2cc4-468e-80ca-0e64698d8497] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:29.095314 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5923c563-40fd-40cd-a9e0-ce86890f2007 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:29.103113 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5923c563-40fd-40cd-a9e0-ce86890f2007 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:29.104256 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5923c563-40fd-40cd-a9e0-ce86890f2007 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:29.110666 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5923c563-40fd-40cd-a9e0-ce86890f2007 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:29.111579 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5923c563-40fd-40cd-a9e0-ce86890f2007 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:29.113490 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5923c563-40fd-40cd-a9e0-ce86890f2007 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:29.453913 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c3c60bbf-520b-4acf-b295-b2dfb4b78a9d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:29.455113 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c3c60bbf-520b-4acf-b295-b2dfb4b78a9d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: f323a1e9-9aaa-40f4-8228-9b787bcc9a39] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:29.465247 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3c60bbf-520b-4acf-b295-b2dfb4b78a9d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:29.472742 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3c60bbf-520b-4acf-b295-b2dfb4b78a9d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:29.475371 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3c60bbf-520b-4acf-b295-b2dfb4b78a9d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:29.478461 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3c60bbf-520b-4acf-b295-b2dfb4b78a9d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:29.480599 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3c60bbf-520b-4acf-b295-b2dfb4b78a9d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:29.481312 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3c60bbf-520b-4acf-b295-b2dfb4b78a9d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:29.596778 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5923c563-40fd-40cd-a9e0-ce86890f2007 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:29.609904 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5923c563-40fd-40cd-a9e0-ce86890f2007 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/d05d75dd-2cc4-468e-80ca-0e64698d8497" status: 200 len: 1373 microversion: 2.1 time: 0.545948 Aug 07 01:51:29.614097 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3089/5719] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:29 2022] GET /compute/v2.1/servers/d05d75dd-2cc4-468e-80ca-0e64698d8497 => generated 1373 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:29.925728 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c3c60bbf-520b-4acf-b295-b2dfb4b78a9d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:29.946426 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c3c60bbf-520b-4acf-b295-b2dfb4b78a9d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39" status: 200 len: 1202 microversion: 2.1 time: 0.496736 Aug 07 01:51:29.950231 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2631/5720] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:29 2022] GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39 => generated 1202 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:30.518671 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5fdfcbc6-1413-4019-9a68-f53dee05e56d tempest-TestAggregatesBasicOps-2143341749 tempest-TestAggregatesBasicOps-2143341749-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-187909811", "availability_zone": "foo_zone"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:51:30.522003 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:51:30.522003 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:51:30.525742 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.aggregate [None req-5fdfcbc6-1413-4019-9a68-f53dee05e56d tempest-TestAggregatesBasicOps-2143341749 tempest-TestAggregatesBasicOps-2143341749-project-admin] Generated uuid c6b325eb-f9d6-4eae-8190-8453a008d4b5 for aggregate {{(pid=119516) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 07 01:51:30.627320 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5fdfcbc6-1413-4019-9a68-f53dee05e56d tempest-TestAggregatesBasicOps-2143341749 tempest-TestAggregatesBasicOps-2143341749-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.213064 Aug 07 01:51:30.630548 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b864a3bf-800b-41e3-8dfb-852c3769ab73 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:30.631177 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b864a3bf-800b-41e3-8dfb-852c3769ab73 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: d05d75dd-2cc4-468e-80ca-0e64698d8497] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:30.637144 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3090/5721] 10.222.0.39 () {60 vars in 1164 bytes} [Sun Aug 7 01:51:30 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:51:30.645763 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b864a3bf-800b-41e3-8dfb-852c3769ab73 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:30.646271 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b864a3bf-800b-41e3-8dfb-852c3769ab73 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:30.646715 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b864a3bf-800b-41e3-8dfb-852c3769ab73 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:30.647439 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b864a3bf-800b-41e3-8dfb-852c3769ab73 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:30.647974 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b864a3bf-800b-41e3-8dfb-852c3769ab73 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:30.648087 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-04d1c56c-578f-44d8-94d3-9fa70100da25 tempest-TestAggregatesBasicOps-2143341749 tempest-TestAggregatesBasicOps-2143341749-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:51:30.648363 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b864a3bf-800b-41e3-8dfb-852c3769ab73 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:30.661696 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:51:30.661696 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:51:30.705294 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-04d1c56c-578f-44d8-94d3-9fa70100da25 tempest-TestAggregatesBasicOps-2143341749 tempest-TestAggregatesBasicOps-2143341749-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.066747 Aug 07 01:51:30.707716 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3091/5722] 10.222.0.39 () {60 vars in 1194 bytes} [Sun Aug 7 01:51:30 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:51:30.725824 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3ff70106-b7f7-4937-9067-164ffb5e7c9b tempest-TestAggregatesBasicOps-2143341749 tempest-TestAggregatesBasicOps-2143341749-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:30.736523 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:51:30.736523 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:51:30.738771 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ff70106-b7f7-4937-9067-164ffb5e7c9b tempest-TestAggregatesBasicOps-2143341749 tempest-TestAggregatesBasicOps-2143341749-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:30.740237 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ff70106-b7f7-4937-9067-164ffb5e7c9b tempest-TestAggregatesBasicOps-2143341749 tempest-TestAggregatesBasicOps-2143341749-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:30.741464 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ff70106-b7f7-4937-9067-164ffb5e7c9b tempest-TestAggregatesBasicOps-2143341749 tempest-TestAggregatesBasicOps-2143341749-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:30.744240 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ff70106-b7f7-4937-9067-164ffb5e7c9b tempest-TestAggregatesBasicOps-2143341749 tempest-TestAggregatesBasicOps-2143341749-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:30.744927 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ff70106-b7f7-4937-9067-164ffb5e7c9b tempest-TestAggregatesBasicOps-2143341749 tempest-TestAggregatesBasicOps-2143341749-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:30.745872 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3ff70106-b7f7-4937-9067-164ffb5e7c9b tempest-TestAggregatesBasicOps-2143341749 tempest-TestAggregatesBasicOps-2143341749-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:30.807070 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3ff70106-b7f7-4937-9067-164ffb5e7c9b tempest-TestAggregatesBasicOps-2143341749 tempest-TestAggregatesBasicOps-2143341749-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.091256 Aug 07 01:51:30.815068 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3092/5723] 10.222.0.39 () {58 vars in 1176 bytes} [Sun Aug 7 01:51:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:51:30.820153 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-89810015-720b-4d3d-8126-f6b1a46d3bbe tempest-TestAggregatesBasicOps-2143341749 tempest-TestAggregatesBasicOps-2143341749-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:30.821202 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:51:30.821202 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:51:30.839336 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-89810015-720b-4d3d-8126-f6b1a46d3bbe tempest-TestAggregatesBasicOps-2143341749 tempest-TestAggregatesBasicOps-2143341749-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.022538 Aug 07 01:51:30.840813 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3093/5724] 10.222.0.39 () {58 vars in 1143 bytes} [Sun Aug 7 01:51:30 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:51:30.859481 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7d4b9b26-3bdb-441f-85d0-9050ad25a565 tempest-TestAggregatesBasicOps-2143341749 tempest-TestAggregatesBasicOps-2143341749-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:51:30.864147 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:51:30.864147 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:51:30.876158 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d4b9b26-3bdb-441f-85d0-9050ad25a565 tempest-TestAggregatesBasicOps-2143341749 tempest-TestAggregatesBasicOps-2143341749-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:30.877011 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d4b9b26-3bdb-441f-85d0-9050ad25a565 tempest-TestAggregatesBasicOps-2143341749 tempest-TestAggregatesBasicOps-2143341749-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:30.877653 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7d4b9b26-3bdb-441f-85d0-9050ad25a565 tempest-TestAggregatesBasicOps-2143341749 tempest-TestAggregatesBasicOps-2143341749-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:31.090804 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b864a3bf-800b-41e3-8dfb-852c3769ab73 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:31.119849 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b864a3bf-800b-41e3-8dfb-852c3769ab73 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/d05d75dd-2cc4-468e-80ca-0e64698d8497" status: 200 len: 1373 microversion: 2.1 time: 0.492957 Aug 07 01:51:31.120476 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2632/5725] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:30 2022] GET /compute/v2.1/servers/d05d75dd-2cc4-468e-80ca-0e64698d8497 => generated 1373 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:51:31.126550 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a62114c2-1445-428a-9b73-b7275c342259 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:31.127452 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a62114c2-1445-428a-9b73-b7275c342259 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: f323a1e9-9aaa-40f4-8228-9b787bcc9a39] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:31.133968 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a62114c2-1445-428a-9b73-b7275c342259 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:31.134652 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a62114c2-1445-428a-9b73-b7275c342259 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:31.135373 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a62114c2-1445-428a-9b73-b7275c342259 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:31.136298 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a62114c2-1445-428a-9b73-b7275c342259 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:31.137545 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a62114c2-1445-428a-9b73-b7275c342259 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:31.138134 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a62114c2-1445-428a-9b73-b7275c342259 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:31.301162 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:51:31.314311 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7d4b9b26-3bdb-441f-85d0-9050ad25a565 tempest-TestAggregatesBasicOps-2143341749 tempest-TestAggregatesBasicOps-2143341749-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.460293 Aug 07 01:51:31.331711 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3094/5726] 10.222.0.39 () {60 vars in 1194 bytes} [Sun Aug 7 01:51:30 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:51:31.356229 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b7ce2264-3a76-48c1-b8b5-af4ef905f793 tempest-TestAggregatesBasicOps-2143341749 tempest-TestAggregatesBasicOps-2143341749-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:31.358536 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:51:31.358536 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:51:31.380365 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b7ce2264-3a76-48c1-b8b5-af4ef905f793 tempest-TestAggregatesBasicOps-2143341749 tempest-TestAggregatesBasicOps-2143341749-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.040999 Aug 07 01:51:31.381123 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3095/5727] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Aug 7 01:51:31 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:51:31.523557 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-66a5af28-15b6-4346-bf07-88af3f6d1e81 req-fce6c820-dae4-4683-85e1-b54935121e00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d05d75dd-2cc4-468e-80ca-0e64698d8497", "tag": "17efe68c-e73a-4706-99ff-f40a8ec26d19"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:51:31.566714 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-66a5af28-15b6-4346-bf07-88af3f6d1e81 req-fce6c820-dae4-4683-85e1-b54935121e00 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:31.567196 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-66a5af28-15b6-4346-bf07-88af3f6d1e81 req-fce6c820-dae4-4683-85e1-b54935121e00 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:31.567817 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-66a5af28-15b6-4346-bf07-88af3f6d1e81 req-fce6c820-dae4-4683-85e1-b54935121e00 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:31.596694 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-66a5af28-15b6-4346-bf07-88af3f6d1e81 req-fce6c820-dae4-4683-85e1-b54935121e00 service nova] Creating event network-changed:17efe68c-e73a-4706-99ff-f40a8ec26d19 for instance d05d75dd-2cc4-468e-80ca-0e64698d8497 on n-h2-master-1 Aug 07 01:51:31.608324 n-d-master-1 devstack@n-api.service[119516]: ERROR oslo.messaging._drivers.impl_rabbit [req-66a5af28-15b6-4346-bf07-88af3f6d1e81 req-fce6c820-dae4-4683-85e1-b54935121e00 service nova] [c004c88d-f2ea-4d6a-a6e8-c0712551140b] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 07 01:51:31.669846 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a62114c2-1445-428a-9b73-b7275c342259 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:31.681742 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a62114c2-1445-428a-9b73-b7275c342259 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39" status: 200 len: 1202 microversion: 2.1 time: 0.559905 Aug 07 01:51:31.682968 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2633/5728] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:31 2022] GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39 => generated 1202 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:31.689234 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7986b48d-c0fb-4584-9aae-1a03326ec095 tempest-TestAggregatesBasicOps-2143341749 tempest-TestAggregatesBasicOps-2143341749-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1122119092", "availability_zone": "foo_zone"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:51:31.832532 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:51:31.832532 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:51:31.974703 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7986b48d-c0fb-4584-9aae-1a03326ec095 tempest-TestAggregatesBasicOps-2143341749 tempest-TestAggregatesBasicOps-2143341749-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.289940 Aug 07 01:51:31.975739 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2634/5729] 10.222.0.39 () {60 vars in 1173 bytes} [Sun Aug 7 01:51:31 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:51:32.001721 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8fdf9dd7-fa79-4248-88f6-e034f82c4a51 tempest-TestAggregatesBasicOps-2143341749 tempest-TestAggregatesBasicOps-2143341749-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:51:32.006967 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:51:32.006967 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:51:32.041015 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8fdf9dd7-fa79-4248-88f6-e034f82c4a51 tempest-TestAggregatesBasicOps-2143341749 tempest-TestAggregatesBasicOps-2143341749-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.056198 Aug 07 01:51:32.042028 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2635/5730] 10.222.0.39 () {60 vars in 1194 bytes} [Sun Aug 7 01:51:31 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:51:32.058020 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-92e13517-ff1d-4061-a757-ba707e938613 tempest-TestAggregatesBasicOps-2143341749 tempest-TestAggregatesBasicOps-2143341749-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:32.059643 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:51:32.059643 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:51:32.074343 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-92e13517-ff1d-4061-a757-ba707e938613 tempest-TestAggregatesBasicOps-2143341749 tempest-TestAggregatesBasicOps-2143341749-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.021123 Aug 07 01:51:32.075667 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2636/5731] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Aug 7 01:51:32 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:51:32.094980 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7538a725-cf1e-4126-addf-263994aa76b9 tempest-TestAggregatesBasicOps-2143341749 tempest-TestAggregatesBasicOps-2143341749-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:51:32.100980 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:51:32.100980 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 01:51:32.123677 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7538a725-cf1e-4126-addf-263994aa76b9 tempest-TestAggregatesBasicOps-2143341749 tempest-TestAggregatesBasicOps-2143341749-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:32.124201 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7538a725-cf1e-4126-addf-263994aa76b9 tempest-TestAggregatesBasicOps-2143341749 tempest-TestAggregatesBasicOps-2143341749-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:32.127558 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7538a725-cf1e-4126-addf-263994aa76b9 tempest-TestAggregatesBasicOps-2143341749 tempest-TestAggregatesBasicOps-2143341749-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:32.580152 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7538a725-cf1e-4126-addf-263994aa76b9 tempest-TestAggregatesBasicOps-2143341749 tempest-TestAggregatesBasicOps-2143341749-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.494030 Aug 07 01:51:32.581181 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2637/5732] 10.222.0.39 () {60 vars in 1194 bytes} [Sun Aug 7 01:51:32 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:51:32.586389 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-478b5579-30d8-4eef-b051-3c5a5947f18d tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:32.587192 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-478b5579-30d8-4eef-b051-3c5a5947f18d tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: d05d75dd-2cc4-468e-80ca-0e64698d8497] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:32.599093 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-478b5579-30d8-4eef-b051-3c5a5947f18d tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:32.599797 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-478b5579-30d8-4eef-b051-3c5a5947f18d tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:32.600378 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-478b5579-30d8-4eef-b051-3c5a5947f18d tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:32.604054 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-478b5579-30d8-4eef-b051-3c5a5947f18d tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:32.606659 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-478b5579-30d8-4eef-b051-3c5a5947f18d tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:32.607562 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-478b5579-30d8-4eef-b051-3c5a5947f18d tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:32.617628 n-d-master-1 devstack@n-api.service[119516]: INFO oslo.messaging._drivers.impl_rabbit [req-66a5af28-15b6-4346-bf07-88af3f6d1e81 req-fce6c820-dae4-4683-85e1-b54935121e00 service nova] [c004c88d-f2ea-4d6a-a6e8-c0712551140b] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 52576. Aug 07 01:51:32.621480 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-66a5af28-15b6-4346-bf07-88af3f6d1e81 req-fce6c820-dae4-4683-85e1-b54935121e00 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.232667 Aug 07 01:51:32.622255 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3096/5733] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:51:32.634532 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-210821b5-4fe1-49f0-8729-8a590200463a tempest-TestAggregatesBasicOps-2143341749 tempest-TestAggregatesBasicOps-2143341749-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:32.635422 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:51:32.635422 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:51:32.696640 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-210821b5-4fe1-49f0-8729-8a590200463a tempest-TestAggregatesBasicOps-2143341749 tempest-TestAggregatesBasicOps-2143341749-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.068915 Aug 07 01:51:32.697160 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3097/5734] 10.222.0.39 () {58 vars in 1155 bytes} [Sun Aug 7 01:51:32 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 07 01:51:32.707082 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d828b2ec-ec74-4083-87a0-f2e0403726af tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:32.720447 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d828b2ec-ec74-4083-87a0-f2e0403726af tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: f323a1e9-9aaa-40f4-8228-9b787bcc9a39] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:32.753016 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d828b2ec-ec74-4083-87a0-f2e0403726af tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:32.755349 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d828b2ec-ec74-4083-87a0-f2e0403726af tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:32.756525 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d828b2ec-ec74-4083-87a0-f2e0403726af tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:32.758216 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d828b2ec-ec74-4083-87a0-f2e0403726af tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:32.772839 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d828b2ec-ec74-4083-87a0-f2e0403726af tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:32.773609 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d828b2ec-ec74-4083-87a0-f2e0403726af tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:32.946751 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-478b5579-30d8-4eef-b051-3c5a5947f18d tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:32.960609 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-478b5579-30d8-4eef-b051-3c5a5947f18d tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/d05d75dd-2cc4-468e-80ca-0e64698d8497" status: 200 len: 1373 microversion: 2.1 time: 0.378240 Aug 07 01:51:32.963456 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2638/5735] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:32 2022] GET /compute/v2.1/servers/d05d75dd-2cc4-468e-80ca-0e64698d8497 => generated 1373 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:33.152949 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d828b2ec-ec74-4083-87a0-f2e0403726af tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:33.166271 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d828b2ec-ec74-4083-87a0-f2e0403726af tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39" status: 200 len: 1202 microversion: 2.1 time: 0.462324 Aug 07 01:51:33.167334 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3098/5736] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:32 2022] GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39 => generated 1202 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:33.987442 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1c49be0c-ccc0-45fd-89df-eb6d661caff4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:33.988858 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1c49be0c-ccc0-45fd-89df-eb6d661caff4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: d05d75dd-2cc4-468e-80ca-0e64698d8497] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:34.012987 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c49be0c-ccc0-45fd-89df-eb6d661caff4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:34.013564 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c49be0c-ccc0-45fd-89df-eb6d661caff4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:34.015046 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c49be0c-ccc0-45fd-89df-eb6d661caff4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:34.017511 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c49be0c-ccc0-45fd-89df-eb6d661caff4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:34.018406 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c49be0c-ccc0-45fd-89df-eb6d661caff4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:34.024460 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c49be0c-ccc0-45fd-89df-eb6d661caff4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:34.193220 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e827dae4-72f9-49a4-ba92-5e9a9521855b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:34.193861 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e827dae4-72f9-49a4-ba92-5e9a9521855b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: f323a1e9-9aaa-40f4-8228-9b787bcc9a39] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:34.207209 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=22 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:51:34.209255 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e827dae4-72f9-49a4-ba92-5e9a9521855b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:34.209547 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e827dae4-72f9-49a4-ba92-5e9a9521855b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:34.210179 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e827dae4-72f9-49a4-ba92-5e9a9521855b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:34.211099 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e827dae4-72f9-49a4-ba92-5e9a9521855b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:34.217941 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e827dae4-72f9-49a4-ba92-5e9a9521855b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:34.219094 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e827dae4-72f9-49a4-ba92-5e9a9521855b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:34.514893 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1c49be0c-ccc0-45fd-89df-eb6d661caff4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:34.525863 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1c49be0c-ccc0-45fd-89df-eb6d661caff4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/d05d75dd-2cc4-468e-80ca-0e64698d8497" status: 200 len: 1373 microversion: 2.1 time: 0.545081 Aug 07 01:51:34.531972 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2639/5737] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:33 2022] GET /compute/v2.1/servers/d05d75dd-2cc4-468e-80ca-0e64698d8497 => generated 1373 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:51:34.574753 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e827dae4-72f9-49a4-ba92-5e9a9521855b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:34.590595 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e827dae4-72f9-49a4-ba92-5e9a9521855b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39" status: 200 len: 1202 microversion: 2.1 time: 0.401148 Aug 07 01:51:34.591201 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3099/5738] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:34 2022] GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39 => generated 1202 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:51:35.557709 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0581ef57-e41e-4d26-9e27-97bd4ae3ded4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:35.559494 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0581ef57-e41e-4d26-9e27-97bd4ae3ded4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: d05d75dd-2cc4-468e-80ca-0e64698d8497] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:35.582538 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0581ef57-e41e-4d26-9e27-97bd4ae3ded4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:35.584611 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0581ef57-e41e-4d26-9e27-97bd4ae3ded4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:35.586338 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0581ef57-e41e-4d26-9e27-97bd4ae3ded4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:35.588435 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0581ef57-e41e-4d26-9e27-97bd4ae3ded4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:35.589229 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0581ef57-e41e-4d26-9e27-97bd4ae3ded4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:35.591193 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0581ef57-e41e-4d26-9e27-97bd4ae3ded4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:35.615389 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-21a7cf96-eb86-41ef-9d31-05d73b7c98f3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:35.616734 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-21a7cf96-eb86-41ef-9d31-05d73b7c98f3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: f323a1e9-9aaa-40f4-8228-9b787bcc9a39] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:35.636355 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21a7cf96-eb86-41ef-9d31-05d73b7c98f3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:35.639597 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21a7cf96-eb86-41ef-9d31-05d73b7c98f3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:35.640431 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21a7cf96-eb86-41ef-9d31-05d73b7c98f3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:35.640914 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21a7cf96-eb86-41ef-9d31-05d73b7c98f3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:35.641375 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21a7cf96-eb86-41ef-9d31-05d73b7c98f3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:35.641798 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21a7cf96-eb86-41ef-9d31-05d73b7c98f3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:36.030096 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-21a7cf96-eb86-41ef-9d31-05d73b7c98f3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:36.049464 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-21a7cf96-eb86-41ef-9d31-05d73b7c98f3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39" status: 200 len: 1202 microversion: 2.1 time: 0.438184 Aug 07 01:51:36.050083 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3100/5739] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:35 2022] GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39 => generated 1202 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:36.064785 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-f26adf01-20d3-4a65-838e-004fd7e6cb24 req-822d4923-7944-4c64-882f-f484d4e14ed1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d05d75dd-2cc4-468e-80ca-0e64698d8497", "name": "network-vif-plugged", "status": "completed", "tag": "17efe68c-e73a-4706-99ff-f40a8ec26d19"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:51:36.079426 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f26adf01-20d3-4a65-838e-004fd7e6cb24 req-822d4923-7944-4c64-882f-f484d4e14ed1 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:36.080404 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f26adf01-20d3-4a65-838e-004fd7e6cb24 req-822d4923-7944-4c64-882f-f484d4e14ed1 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:36.080987 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f26adf01-20d3-4a65-838e-004fd7e6cb24 req-822d4923-7944-4c64-882f-f484d4e14ed1 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:36.101539 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-f26adf01-20d3-4a65-838e-004fd7e6cb24 req-822d4923-7944-4c64-882f-f484d4e14ed1 service nova] Creating event network-vif-plugged:17efe68c-e73a-4706-99ff-f40a8ec26d19 for instance d05d75dd-2cc4-468e-80ca-0e64698d8497 on n-h2-master-1 Aug 07 01:51:36.117515 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-f26adf01-20d3-4a65-838e-004fd7e6cb24 req-822d4923-7944-4c64-882f-f484d4e14ed1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060678 Aug 07 01:51:36.118401 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3101/5740] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:51:36.496319 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0581ef57-e41e-4d26-9e27-97bd4ae3ded4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:36.520488 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0581ef57-e41e-4d26-9e27-97bd4ae3ded4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/d05d75dd-2cc4-468e-80ca-0e64698d8497" status: 200 len: 1373 microversion: 2.1 time: 0.966783 Aug 07 01:51:36.526335 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2640/5741] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:35 2022] GET /compute/v2.1/servers/d05d75dd-2cc4-468e-80ca-0e64698d8497 => generated 1373 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:37.077878 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4d417eb6-b879-4e02-9eda-c1503241bab4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:37.078744 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4d417eb6-b879-4e02-9eda-c1503241bab4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: f323a1e9-9aaa-40f4-8228-9b787bcc9a39] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:37.094503 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d417eb6-b879-4e02-9eda-c1503241bab4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:37.095071 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d417eb6-b879-4e02-9eda-c1503241bab4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:37.095366 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d417eb6-b879-4e02-9eda-c1503241bab4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:37.096193 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d417eb6-b879-4e02-9eda-c1503241bab4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:37.096932 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d417eb6-b879-4e02-9eda-c1503241bab4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:37.097196 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d417eb6-b879-4e02-9eda-c1503241bab4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:37.100790 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=69 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:51:37.273654 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4d417eb6-b879-4e02-9eda-c1503241bab4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:37.286721 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4d417eb6-b879-4e02-9eda-c1503241bab4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39" status: 200 len: 1202 microversion: 2.1 time: 0.213354 Aug 07 01:51:37.287318 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3102/5742] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:37 2022] GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39 => generated 1202 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:37.547540 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-566228ee-6e50-48d2-932f-e9f6d902bd2d tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:37.548191 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-566228ee-6e50-48d2-932f-e9f6d902bd2d tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: d05d75dd-2cc4-468e-80ca-0e64698d8497] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:37.560883 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-566228ee-6e50-48d2-932f-e9f6d902bd2d tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:37.561552 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-566228ee-6e50-48d2-932f-e9f6d902bd2d tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:37.563050 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-566228ee-6e50-48d2-932f-e9f6d902bd2d tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:37.564035 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-566228ee-6e50-48d2-932f-e9f6d902bd2d tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:37.564759 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-566228ee-6e50-48d2-932f-e9f6d902bd2d tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:37.565414 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-566228ee-6e50-48d2-932f-e9f6d902bd2d tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:37.832688 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-566228ee-6e50-48d2-932f-e9f6d902bd2d tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:37.845778 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-566228ee-6e50-48d2-932f-e9f6d902bd2d tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/d05d75dd-2cc4-468e-80ca-0e64698d8497" status: 200 len: 1373 microversion: 2.1 time: 0.302125 Aug 07 01:51:37.846636 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2641/5743] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:37 2022] GET /compute/v2.1/servers/d05d75dd-2cc4-468e-80ca-0e64698d8497 => generated 1373 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:51:38.316919 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9aa7c398-52bd-43d1-b479-bc0a7df5f908 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:38.318177 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9aa7c398-52bd-43d1-b479-bc0a7df5f908 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: f323a1e9-9aaa-40f4-8228-9b787bcc9a39] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:38.328264 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9aa7c398-52bd-43d1-b479-bc0a7df5f908 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:38.328977 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9aa7c398-52bd-43d1-b479-bc0a7df5f908 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:38.329649 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9aa7c398-52bd-43d1-b479-bc0a7df5f908 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:38.330637 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9aa7c398-52bd-43d1-b479-bc0a7df5f908 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:38.331323 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9aa7c398-52bd-43d1-b479-bc0a7df5f908 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:38.332364 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9aa7c398-52bd-43d1-b479-bc0a7df5f908 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:38.531233 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9aa7c398-52bd-43d1-b479-bc0a7df5f908 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:38.543544 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9aa7c398-52bd-43d1-b479-bc0a7df5f908 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39" status: 200 len: 1202 microversion: 2.1 time: 0.233122 Aug 07 01:51:38.551358 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3103/5744] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:38 2022] GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39 => generated 1202 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:38.870384 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-10817fbb-d2ab-4011-81d8-2a860722fc76 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:38.872018 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-10817fbb-d2ab-4011-81d8-2a860722fc76 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: d05d75dd-2cc4-468e-80ca-0e64698d8497] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:38.881822 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:51:38.887649 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10817fbb-d2ab-4011-81d8-2a860722fc76 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:38.889348 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10817fbb-d2ab-4011-81d8-2a860722fc76 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:38.890030 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10817fbb-d2ab-4011-81d8-2a860722fc76 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:38.894775 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10817fbb-d2ab-4011-81d8-2a860722fc76 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:38.895478 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10817fbb-d2ab-4011-81d8-2a860722fc76 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:38.896154 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10817fbb-d2ab-4011-81d8-2a860722fc76 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:38.925829 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=91 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:51:39.234921 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-10817fbb-d2ab-4011-81d8-2a860722fc76 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:39.250529 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-10817fbb-d2ab-4011-81d8-2a860722fc76 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/d05d75dd-2cc4-468e-80ca-0e64698d8497" status: 200 len: 1545 microversion: 2.1 time: 0.384351 Aug 07 01:51:39.253516 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2642/5745] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:38 2022] GET /compute/v2.1/servers/d05d75dd-2cc4-468e-80ca-0e64698d8497 => generated 1545 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:39.281475 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-092ac203-c668-410b-94c7-a56a57d625b8 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:39.282670 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-092ac203-c668-410b-94c7-a56a57d625b8 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: d05d75dd-2cc4-468e-80ca-0e64698d8497] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:39.304786 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-092ac203-c668-410b-94c7-a56a57d625b8 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:39.309648 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-092ac203-c668-410b-94c7-a56a57d625b8 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:39.310125 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-092ac203-c668-410b-94c7-a56a57d625b8 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:39.310858 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-092ac203-c668-410b-94c7-a56a57d625b8 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:39.311316 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-092ac203-c668-410b-94c7-a56a57d625b8 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:39.311832 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-092ac203-c668-410b-94c7-a56a57d625b8 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:39.536008 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-de81a0da-92e6-444c-b613-a982383aeb4d req-d99abbd2-b331-4f28-a91d-3d02a22ffc86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f323a1e9-9aaa-40f4-8228-9b787bcc9a39", "name": "network-vif-plugged", "status": "completed", "tag": "6fc585a5-ffb4-4db4-871c-0fd552c6e2a3"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:51:39.555275 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-de81a0da-92e6-444c-b613-a982383aeb4d req-d99abbd2-b331-4f28-a91d-3d02a22ffc86 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:39.555868 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-de81a0da-92e6-444c-b613-a982383aeb4d req-d99abbd2-b331-4f28-a91d-3d02a22ffc86 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:39.557641 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-de81a0da-92e6-444c-b613-a982383aeb4d req-d99abbd2-b331-4f28-a91d-3d02a22ffc86 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:39.585441 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-de81a0da-92e6-444c-b613-a982383aeb4d req-d99abbd2-b331-4f28-a91d-3d02a22ffc86 service nova] Creating event network-vif-plugged:6fc585a5-ffb4-4db4-871c-0fd552c6e2a3 for instance f323a1e9-9aaa-40f4-8228-9b787bcc9a39 on n-h1-master-1 Aug 07 01:51:39.600157 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-de81a0da-92e6-444c-b613-a982383aeb4d req-d99abbd2-b331-4f28-a91d-3d02a22ffc86 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067828 Aug 07 01:51:39.601020 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2643/5746] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:51:39.612545 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b2a605a9-5c94-41cd-8134-e9c1b6fc0855 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:39.621655 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b2a605a9-5c94-41cd-8134-e9c1b6fc0855 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: f323a1e9-9aaa-40f4-8228-9b787bcc9a39] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:39.634095 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2a605a9-5c94-41cd-8134-e9c1b6fc0855 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:39.635678 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2a605a9-5c94-41cd-8134-e9c1b6fc0855 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:39.636688 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2a605a9-5c94-41cd-8134-e9c1b6fc0855 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:39.637652 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2a605a9-5c94-41cd-8134-e9c1b6fc0855 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:39.640518 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2a605a9-5c94-41cd-8134-e9c1b6fc0855 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:39.643319 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2a605a9-5c94-41cd-8134-e9c1b6fc0855 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:39.661072 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-092ac203-c668-410b-94c7-a56a57d625b8 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:39.676603 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-092ac203-c668-410b-94c7-a56a57d625b8 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/d05d75dd-2cc4-468e-80ca-0e64698d8497" status: 200 len: 1545 microversion: 2.1 time: 0.401377 Aug 07 01:51:39.678286 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3104/5747] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:39 2022] GET /compute/v2.1/servers/d05d75dd-2cc4-468e-80ca-0e64698d8497 => generated 1545 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:39.940806 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b2a605a9-5c94-41cd-8134-e9c1b6fc0855 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:39.957387 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b2a605a9-5c94-41cd-8134-e9c1b6fc0855 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39" status: 200 len: 1202 microversion: 2.1 time: 0.352468 Aug 07 01:51:39.958145 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2644/5748] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:39 2022] GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39 => generated 1202 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:40.979875 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6ce7f0bb-b9d0-4f5a-8320-b8e4804a854d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:40.980580 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6ce7f0bb-b9d0-4f5a-8320-b8e4804a854d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: f323a1e9-9aaa-40f4-8228-9b787bcc9a39] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:40.986995 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=4 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:51:41.013516 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ce7f0bb-b9d0-4f5a-8320-b8e4804a854d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:41.014026 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ce7f0bb-b9d0-4f5a-8320-b8e4804a854d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:41.014469 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ce7f0bb-b9d0-4f5a-8320-b8e4804a854d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:41.020112 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ce7f0bb-b9d0-4f5a-8320-b8e4804a854d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:41.020938 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ce7f0bb-b9d0-4f5a-8320-b8e4804a854d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:41.021598 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ce7f0bb-b9d0-4f5a-8320-b8e4804a854d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:41.573791 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6ce7f0bb-b9d0-4f5a-8320-b8e4804a854d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:41.590026 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6ce7f0bb-b9d0-4f5a-8320-b8e4804a854d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39" status: 200 len: 1202 microversion: 2.1 time: 0.612865 Aug 07 01:51:41.613020 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3105/5749] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:40 2022] GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39 => generated 1202 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:42.271473 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-0b036a11-7620-4158-8029-d2f2d5ab8101 req-d48c5dc3-4bc2-4de3-a58e-ae7cbfd4ad72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d05d75dd-2cc4-468e-80ca-0e64698d8497", "tag": "17efe68c-e73a-4706-99ff-f40a8ec26d19"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:51:42.314747 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0b036a11-7620-4158-8029-d2f2d5ab8101 req-d48c5dc3-4bc2-4de3-a58e-ae7cbfd4ad72 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:42.318896 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0b036a11-7620-4158-8029-d2f2d5ab8101 req-d48c5dc3-4bc2-4de3-a58e-ae7cbfd4ad72 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:42.321092 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0b036a11-7620-4158-8029-d2f2d5ab8101 req-d48c5dc3-4bc2-4de3-a58e-ae7cbfd4ad72 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:42.355115 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-0b036a11-7620-4158-8029-d2f2d5ab8101 req-d48c5dc3-4bc2-4de3-a58e-ae7cbfd4ad72 service nova] Creating event network-changed:17efe68c-e73a-4706-99ff-f40a8ec26d19 for instance d05d75dd-2cc4-468e-80ca-0e64698d8497 on n-h2-master-1 Aug 07 01:51:42.370568 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-0b036a11-7620-4158-8029-d2f2d5ab8101 req-d48c5dc3-4bc2-4de3-a58e-ae7cbfd4ad72 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106938 Aug 07 01:51:42.371659 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2645/5750] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:51:42.620539 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5edebb87-f9cb-4600-a004-8f87216a59e7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:42.621162 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5edebb87-f9cb-4600-a004-8f87216a59e7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: f323a1e9-9aaa-40f4-8228-9b787bcc9a39] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:42.631829 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5edebb87-f9cb-4600-a004-8f87216a59e7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:42.636249 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5edebb87-f9cb-4600-a004-8f87216a59e7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:42.636980 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5edebb87-f9cb-4600-a004-8f87216a59e7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:42.637947 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5edebb87-f9cb-4600-a004-8f87216a59e7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:42.640441 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5edebb87-f9cb-4600-a004-8f87216a59e7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:42.641051 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5edebb87-f9cb-4600-a004-8f87216a59e7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:43.076033 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5edebb87-f9cb-4600-a004-8f87216a59e7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:43.084202 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5edebb87-f9cb-4600-a004-8f87216a59e7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39" status: 200 len: 1389 microversion: 2.1 time: 0.467532 Aug 07 01:51:43.084804 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3106/5751] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:42 2022] GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39 => generated 1389 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:43.111157 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3ea573d6-d90e-482f-aedf-b4335ccebb6d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:43.111977 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3ea573d6-d90e-482f-aedf-b4335ccebb6d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: f323a1e9-9aaa-40f4-8228-9b787bcc9a39] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:43.151196 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ea573d6-d90e-482f-aedf-b4335ccebb6d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:43.152058 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ea573d6-d90e-482f-aedf-b4335ccebb6d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:43.152715 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ea573d6-d90e-482f-aedf-b4335ccebb6d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:43.153633 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ea573d6-d90e-482f-aedf-b4335ccebb6d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:43.154285 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ea573d6-d90e-482f-aedf-b4335ccebb6d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:43.154901 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ea573d6-d90e-482f-aedf-b4335ccebb6d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:43.972873 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3ea573d6-d90e-482f-aedf-b4335ccebb6d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:44.019366 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3ea573d6-d90e-482f-aedf-b4335ccebb6d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39" status: 200 len: 1389 microversion: 2.1 time: 0.916626 Aug 07 01:51:44.032346 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2646/5752] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:43 2022] GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39 => generated 1389 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:44.039547 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e7840663-fcbd-460a-b75c-cb6deaf1f073 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:44.040294 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e7840663-fcbd-460a-b75c-cb6deaf1f073 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: f323a1e9-9aaa-40f4-8228-9b787bcc9a39] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:44.066039 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7840663-fcbd-460a-b75c-cb6deaf1f073 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:44.066893 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7840663-fcbd-460a-b75c-cb6deaf1f073 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:44.067490 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7840663-fcbd-460a-b75c-cb6deaf1f073 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:44.068411 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7840663-fcbd-460a-b75c-cb6deaf1f073 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:44.070522 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7840663-fcbd-460a-b75c-cb6deaf1f073 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:44.071159 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7840663-fcbd-460a-b75c-cb6deaf1f073 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:44.462086 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e7840663-fcbd-460a-b75c-cb6deaf1f073 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:44.489676 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e7840663-fcbd-460a-b75c-cb6deaf1f073 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39" status: 200 len: 1389 microversion: 2.1 time: 0.451937 Aug 07 01:51:44.491648 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3107/5753] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:44 2022] GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39 => generated 1389 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:44.529033 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-817bff79-e09d-4280-acfe-cdab6544aeb9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:44.530252 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-817bff79-e09d-4280-acfe-cdab6544aeb9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: f323a1e9-9aaa-40f4-8228-9b787bcc9a39] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:44.557055 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-817bff79-e09d-4280-acfe-cdab6544aeb9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:44.562787 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-817bff79-e09d-4280-acfe-cdab6544aeb9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:44.564698 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-817bff79-e09d-4280-acfe-cdab6544aeb9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:44.567649 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-817bff79-e09d-4280-acfe-cdab6544aeb9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:44.571261 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-817bff79-e09d-4280-acfe-cdab6544aeb9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:44.575042 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-817bff79-e09d-4280-acfe-cdab6544aeb9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:44.655400 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-817bff79-e09d-4280-acfe-cdab6544aeb9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: f323a1e9-9aaa-40f4-8228-9b787bcc9a39] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:51:44.823184 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-817bff79-e09d-4280-acfe-cdab6544aeb9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39" status: 204 len: 0 microversion: 2.1 time: 0.310845 Aug 07 01:51:44.824362 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2647/5754] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:51:44 2022] DELETE /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:51:44.837956 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5989b590-87d8-4688-b5d4-c7a4562f73eb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:44.838676 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5989b590-87d8-4688-b5d4-c7a4562f73eb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: f323a1e9-9aaa-40f4-8228-9b787bcc9a39] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:44.859253 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5989b590-87d8-4688-b5d4-c7a4562f73eb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:44.859763 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5989b590-87d8-4688-b5d4-c7a4562f73eb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:44.861943 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5989b590-87d8-4688-b5d4-c7a4562f73eb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:44.863023 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5989b590-87d8-4688-b5d4-c7a4562f73eb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:44.863853 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5989b590-87d8-4688-b5d4-c7a4562f73eb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:44.864778 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5989b590-87d8-4688-b5d4-c7a4562f73eb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:45.121606 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5989b590-87d8-4688-b5d4-c7a4562f73eb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:45.132543 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5989b590-87d8-4688-b5d4-c7a4562f73eb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39" status: 200 len: 1395 microversion: 2.1 time: 0.303123 Aug 07 01:51:45.133064 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3108/5755] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:44 2022] GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39 => generated 1395 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:46.154631 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7d761be1-653c-444c-a316-2a7920d85dde tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:46.156034 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7d761be1-653c-444c-a316-2a7920d85dde tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: f323a1e9-9aaa-40f4-8228-9b787bcc9a39] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:46.172760 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7d761be1-653c-444c-a316-2a7920d85dde tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:46.174343 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7d761be1-653c-444c-a316-2a7920d85dde tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:46.174803 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7d761be1-653c-444c-a316-2a7920d85dde tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:46.175619 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7d761be1-653c-444c-a316-2a7920d85dde tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:46.176114 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7d761be1-653c-444c-a316-2a7920d85dde tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:46.176618 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7d761be1-653c-444c-a316-2a7920d85dde tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:46.341975 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7d761be1-653c-444c-a316-2a7920d85dde tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:46.350805 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7d761be1-653c-444c-a316-2a7920d85dde tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39" status: 200 len: 1395 microversion: 2.1 time: 0.200299 Aug 07 01:51:46.351709 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2648/5756] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:46 2022] GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39 => generated 1395 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:47.145731 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-6948eada-c28c-4cf4-aaa9-3849c3cbeb82 req-9d2251f5-951a-4d7a-bc69-556366a391cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f323a1e9-9aaa-40f4-8228-9b787bcc9a39", "name": "network-vif-deleted", "tag": "6fc585a5-ffb4-4db4-871c-0fd552c6e2a3"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:51:47.159334 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6948eada-c28c-4cf4-aaa9-3849c3cbeb82 req-9d2251f5-951a-4d7a-bc69-556366a391cb service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:47.160216 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6948eada-c28c-4cf4-aaa9-3849c3cbeb82 req-9d2251f5-951a-4d7a-bc69-556366a391cb service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:47.160365 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6948eada-c28c-4cf4-aaa9-3849c3cbeb82 req-9d2251f5-951a-4d7a-bc69-556366a391cb service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:47.210218 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-6948eada-c28c-4cf4-aaa9-3849c3cbeb82 req-9d2251f5-951a-4d7a-bc69-556366a391cb service nova] Creating event network-vif-deleted:6fc585a5-ffb4-4db4-871c-0fd552c6e2a3 for instance f323a1e9-9aaa-40f4-8228-9b787bcc9a39 on n-h1-master-1 Aug 07 01:51:47.222496 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-6948eada-c28c-4cf4-aaa9-3849c3cbeb82 req-9d2251f5-951a-4d7a-bc69-556366a391cb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080193 Aug 07 01:51:47.223476 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3109/5757] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:51:47.375066 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-44326b6a-dc07-45bb-a6d4-c0fde1442941 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:47.375781 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-44326b6a-dc07-45bb-a6d4-c0fde1442941 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: f323a1e9-9aaa-40f4-8228-9b787bcc9a39] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:47.391392 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44326b6a-dc07-45bb-a6d4-c0fde1442941 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:47.391913 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44326b6a-dc07-45bb-a6d4-c0fde1442941 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:47.392376 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44326b6a-dc07-45bb-a6d4-c0fde1442941 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:47.393094 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44326b6a-dc07-45bb-a6d4-c0fde1442941 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:47.394638 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44326b6a-dc07-45bb-a6d4-c0fde1442941 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:47.402048 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44326b6a-dc07-45bb-a6d4-c0fde1442941 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:47.491441 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-44326b6a-dc07-45bb-a6d4-c0fde1442941 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:47.502419 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-44326b6a-dc07-45bb-a6d4-c0fde1442941 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39" status: 200 len: 1187 microversion: 2.1 time: 0.133393 Aug 07 01:51:47.503852 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2649/5758] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:47 2022] GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39 => generated 1187 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:48.528384 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b810744a-a546-4f2b-a1f9-22416780ce93 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:48.529089 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b810744a-a546-4f2b-a1f9-22416780ce93 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: f323a1e9-9aaa-40f4-8228-9b787bcc9a39] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:48.542358 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b810744a-a546-4f2b-a1f9-22416780ce93 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:48.542766 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b810744a-a546-4f2b-a1f9-22416780ce93 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:48.546625 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b810744a-a546-4f2b-a1f9-22416780ce93 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:48.549353 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b810744a-a546-4f2b-a1f9-22416780ce93 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:48.551114 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b810744a-a546-4f2b-a1f9-22416780ce93 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:48.551753 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b810744a-a546-4f2b-a1f9-22416780ce93 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:48.708273 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b810744a-a546-4f2b-a1f9-22416780ce93 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:48.719242 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b810744a-a546-4f2b-a1f9-22416780ce93 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39" status: 200 len: 1187 microversion: 2.1 time: 0.193744 Aug 07 01:51:48.721105 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3110/5759] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:48 2022] GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39 => generated 1187 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:49.748440 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0b8d71c3-a65b-441b-8072-79374182c8c7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:49.751339 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0b8d71c3-a65b-441b-8072-79374182c8c7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: f323a1e9-9aaa-40f4-8228-9b787bcc9a39] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:49.762375 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b8d71c3-a65b-441b-8072-79374182c8c7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:49.763615 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b8d71c3-a65b-441b-8072-79374182c8c7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:49.765201 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b8d71c3-a65b-441b-8072-79374182c8c7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:49.766115 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b8d71c3-a65b-441b-8072-79374182c8c7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:49.767166 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b8d71c3-a65b-441b-8072-79374182c8c7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:49.767771 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b8d71c3-a65b-441b-8072-79374182c8c7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:49.847549 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0b8d71c3-a65b-441b-8072-79374182c8c7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:49.857761 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0b8d71c3-a65b-441b-8072-79374182c8c7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39" status: 200 len: 1187 microversion: 2.1 time: 0.119665 Aug 07 01:51:49.868570 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2650/5760] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:49 2022] GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39 => generated 1187 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:50.881249 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6b41ea9d-a514-4877-b42f-d1122675760f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:50.881963 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6b41ea9d-a514-4877-b42f-d1122675760f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: f323a1e9-9aaa-40f4-8228-9b787bcc9a39] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:50.902842 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b41ea9d-a514-4877-b42f-d1122675760f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:50.903325 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b41ea9d-a514-4877-b42f-d1122675760f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:50.903766 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b41ea9d-a514-4877-b42f-d1122675760f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:50.904522 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b41ea9d-a514-4877-b42f-d1122675760f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:50.905096 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b41ea9d-a514-4877-b42f-d1122675760f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:50.905530 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b41ea9d-a514-4877-b42f-d1122675760f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:51.070012 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6b41ea9d-a514-4877-b42f-d1122675760f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:51.084996 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6b41ea9d-a514-4877-b42f-d1122675760f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39" status: 200 len: 1187 microversion: 2.1 time: 0.208697 Aug 07 01:51:51.085915 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3111/5761] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:50 2022] GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39 => generated 1187 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:51.834990 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a86642c3-904c-44f0-a648-2d95e3ad54d8 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1261522305", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "bc21cb95-c714-42eb-b4e2-50e44f6554bf"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:51:51.910064 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-a86642c3-904c-44f0-a648-2d95e3ad54d8 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] validate_networks() for [('bc21cb95-c714-42eb-b4e2-50e44f6554bf', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:51:52.105893 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b09be611-1e10-45fd-910f-af13fe0e938e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:52.106654 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b09be611-1e10-45fd-910f-af13fe0e938e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: f323a1e9-9aaa-40f4-8228-9b787bcc9a39] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:52.117170 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b09be611-1e10-45fd-910f-af13fe0e938e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:52.117952 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b09be611-1e10-45fd-910f-af13fe0e938e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:52.118558 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b09be611-1e10-45fd-910f-af13fe0e938e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:52.119443 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b09be611-1e10-45fd-910f-af13fe0e938e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:52.120088 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b09be611-1e10-45fd-910f-af13fe0e938e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:52.120675 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b09be611-1e10-45fd-910f-af13fe0e938e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:52.210133 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b09be611-1e10-45fd-910f-af13fe0e938e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:52.220588 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b09be611-1e10-45fd-910f-af13fe0e938e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39" status: 200 len: 1187 microversion: 2.1 time: 0.119498 Aug 07 01:51:52.233418 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3112/5762] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:52 2022] GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39 => generated 1187 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:52.522736 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-a86642c3-904c-44f0-a648-2d95e3ad54d8 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:51:52.523405 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-a86642c3-904c-44f0-a648-2d95e3ad54d8 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:51:52.523973 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-a86642c3-904c-44f0-a648-2d95e3ad54d8 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:51:52.524468 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-a86642c3-904c-44f0-a648-2d95e3ad54d8 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:51:52.524959 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-a86642c3-904c-44f0-a648-2d95e3ad54d8 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:51:52.536564 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a86642c3-904c-44f0-a648-2d95e3ad54d8 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:52.537367 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a86642c3-904c-44f0-a648-2d95e3ad54d8 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:52.538076 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a86642c3-904c-44f0-a648-2d95e3ad54d8 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:52.539017 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a86642c3-904c-44f0-a648-2d95e3ad54d8 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:52.539696 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a86642c3-904c-44f0-a648-2d95e3ad54d8 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:52.540348 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a86642c3-904c-44f0-a648-2d95e3ad54d8 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:52.561996 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-a86642c3-904c-44f0-a648-2d95e3ad54d8 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Getting quotas for project 5001c6dfc09f4b03b4d29836165eddc1. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:51:52.567686 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-a86642c3-904c-44f0-a648-2d95e3ad54d8 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Getting quotas for user efb5f9eb544a4785908e9f35ce065a37 and project 5001c6dfc09f4b03b4d29836165eddc1. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:51:52.582363 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a86642c3-904c-44f0-a648-2d95e3ad54d8 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:51:52.584765 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a86642c3-904c-44f0-a648-2d95e3ad54d8 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] [instance: 6f385148-639f-4f89-8bdc-491d80fb2ac4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:51:52.635317 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a86642c3-904c-44f0-a648-2d95e3ad54d8 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.972800 Aug 07 01:51:52.636468 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2651/5763] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:51:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:51:52.647775 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b97f6e2a-fa18-4404-9580-c58bac89a82c tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:52.648531 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b97f6e2a-fa18-4404-9580-c58bac89a82c tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] [instance: 6f385148-639f-4f89-8bdc-491d80fb2ac4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:52.738409 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b97f6e2a-fa18-4404-9580-c58bac89a82c tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb5f9eb544a4785908e9f35ce065a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5001c6dfc09f4b03b4d29836165eddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:52.746314 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b97f6e2a-fa18-4404-9580-c58bac89a82c tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] 10.222.0.39 "GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4" status: 200 len: 1215 microversion: 2.1 time: 0.102173 Aug 07 01:51:52.747228 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3113/5764] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:52 2022] GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4 => generated 1215 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:53.244434 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0260d456-3a29-4269-9739-863d7a4dde29 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:53.245764 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0260d456-3a29-4269-9739-863d7a4dde29 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: f323a1e9-9aaa-40f4-8228-9b787bcc9a39] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:53.267453 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0260d456-3a29-4269-9739-863d7a4dde29 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:53.268581 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0260d456-3a29-4269-9739-863d7a4dde29 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:53.269522 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0260d456-3a29-4269-9739-863d7a4dde29 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:53.270410 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0260d456-3a29-4269-9739-863d7a4dde29 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:53.271415 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0260d456-3a29-4269-9739-863d7a4dde29 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:53.272821 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0260d456-3a29-4269-9739-863d7a4dde29 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:53.299814 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-0260d456-3a29-4269-9739-863d7a4dde29 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] HTTP exception thrown: Instance f323a1e9-9aaa-40f4-8228-9b787bcc9a39 could not be found. Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0260d456-3a29-4269-9739-863d7a4dde29 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Request method failure captured: Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39 HTTP/1.1 Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xp6rUdIsYnfs49nr8p-3tgit6VpNtF0E4NPSidukXDEQntBhlyx_gwU6AjnU2O7Q5BLuafO4z_ZO55y2txpq1OJeOibLbj_karsXsR0GpyTHp3BnitplkO9r1bHquRHPgg2Nq4jyNzT0obzTHzoVjdq8NdzVY4LztormmeY7retjUI Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: bf36f5153ba648008cdaceb9dc538e53 Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-TestVolumeBootPattern-121766107 Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bf36f5153ba648008cdaceb9dc538e53", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-TestVolumeBootPattern-121766107 Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: bf36f5153ba648008cdaceb9dc538e53 Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-TestVolumeBootPattern-121766107 Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-TestVolumeBootPattern-121766107-project Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 661f6c9aa7da4e348a9b0d91840078c2 Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-TestVolumeBootPattern-121766107-project Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: exception: Instance f323a1e9-9aaa-40f4-8228-9b787bcc9a39 could not be found. Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'f323a1e9-9aaa-40f4-8228-9b787bcc9a39'} Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f323a1e9-9aaa-40f4-8228-9b787bcc9a39 could not be found. Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f323a1e9-9aaa-40f4-8228-9b787bcc9a39 could not be found. Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:51:53.301953 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:51:53.307189 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:51:53.307189 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:51:53.307189 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:51:53.307189 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:51:53.307189 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:51:53.307189 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f323a1e9-9aaa-40f4-8228-9b787bcc9a39 could not be found. Aug 07 01:51:53.307189 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:51:53.310297 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0260d456-3a29-4269-9739-863d7a4dde29 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Returning 404 to user: Instance f323a1e9-9aaa-40f4-8228-9b787bcc9a39 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:51:53.311485 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0260d456-3a29-4269-9739-863d7a4dde29 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39" status: 404 len: 111 microversion: 2.1 time: 0.073276 Aug 07 01:51:53.312301 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2652/5765] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:53 2022] GET /compute/v2.1/servers/f323a1e9-9aaa-40f4-8228-9b787bcc9a39 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:51:53.777874 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6b52f32c-7b3f-48d4-aa4c-b55976538a83 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:53.779194 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6b52f32c-7b3f-48d4-aa4c-b55976538a83 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] [instance: 6f385148-639f-4f89-8bdc-491d80fb2ac4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:53.787522 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b52f32c-7b3f-48d4-aa4c-b55976538a83 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:53.788030 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b52f32c-7b3f-48d4-aa4c-b55976538a83 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:53.788716 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b52f32c-7b3f-48d4-aa4c-b55976538a83 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:53.791920 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b52f32c-7b3f-48d4-aa4c-b55976538a83 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:53.791920 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b52f32c-7b3f-48d4-aa4c-b55976538a83 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:53.791920 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b52f32c-7b3f-48d4-aa4c-b55976538a83 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:53.886167 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6b52f32c-7b3f-48d4-aa4c-b55976538a83 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb5f9eb544a4785908e9f35ce065a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5001c6dfc09f4b03b4d29836165eddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:53.899302 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6b52f32c-7b3f-48d4-aa4c-b55976538a83 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] 10.222.0.39 "GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4" status: 200 len: 1267 microversion: 2.1 time: 0.122561 Aug 07 01:51:53.899302 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3114/5766] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:53 2022] GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4 => generated 1267 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:54.929598 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-68057f25-65c4-459d-8b91-5faf7b9883d8 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:54.931318 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-68057f25-65c4-459d-8b91-5faf7b9883d8 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] [instance: 6f385148-639f-4f89-8bdc-491d80fb2ac4] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:54.948114 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68057f25-65c4-459d-8b91-5faf7b9883d8 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:54.948884 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68057f25-65c4-459d-8b91-5faf7b9883d8 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:54.949525 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68057f25-65c4-459d-8b91-5faf7b9883d8 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:54.950526 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68057f25-65c4-459d-8b91-5faf7b9883d8 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:54.951400 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68057f25-65c4-459d-8b91-5faf7b9883d8 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:54.952350 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-68057f25-65c4-459d-8b91-5faf7b9883d8 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:55.214821 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-68057f25-65c4-459d-8b91-5faf7b9883d8 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb5f9eb544a4785908e9f35ce065a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5001c6dfc09f4b03b4d29836165eddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:55.250575 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-68057f25-65c4-459d-8b91-5faf7b9883d8 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] 10.222.0.39 "GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4" status: 200 len: 1315 microversion: 2.1 time: 0.326822 Aug 07 01:51:55.251164 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2653/5767] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:54 2022] GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4 => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:55.645599 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-ee9e6291-7da9-4bb4-863a-9300cf96ce87 req-f4ab3588-42f7-4fdc-95b6-466fd9dd4f94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f385148-639f-4f89-8bdc-491d80fb2ac4", "tag": "ffe06532-72dd-4c10-81ba-d643292f6dc7"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:51:55.658669 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-ee9e6291-7da9-4bb4-863a-9300cf96ce87 req-f4ab3588-42f7-4fdc-95b6-466fd9dd4f94 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:55.659153 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-ee9e6291-7da9-4bb4-863a-9300cf96ce87 req-f4ab3588-42f7-4fdc-95b6-466fd9dd4f94 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:55.659584 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-ee9e6291-7da9-4bb4-863a-9300cf96ce87 req-f4ab3588-42f7-4fdc-95b6-466fd9dd4f94 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:55.672300 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-ee9e6291-7da9-4bb4-863a-9300cf96ce87 req-f4ab3588-42f7-4fdc-95b6-466fd9dd4f94 service nova] Creating event network-changed:ffe06532-72dd-4c10-81ba-d643292f6dc7 for instance 6f385148-639f-4f89-8bdc-491d80fb2ac4 on n-h2-master-1 Aug 07 01:51:55.677250 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-ee9e6291-7da9-4bb4-863a-9300cf96ce87 req-f4ab3588-42f7-4fdc-95b6-466fd9dd4f94 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035656 Aug 07 01:51:55.680448 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3115/5768] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:51:56.271956 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e8137e5d-daaa-457c-a190-491d09d28f34 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:56.273235 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e8137e5d-daaa-457c-a190-491d09d28f34 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] [instance: 6f385148-639f-4f89-8bdc-491d80fb2ac4] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:56.281026 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e8137e5d-daaa-457c-a190-491d09d28f34 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:56.281798 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e8137e5d-daaa-457c-a190-491d09d28f34 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:56.282398 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e8137e5d-daaa-457c-a190-491d09d28f34 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:56.283312 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e8137e5d-daaa-457c-a190-491d09d28f34 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:56.283963 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e8137e5d-daaa-457c-a190-491d09d28f34 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:56.284555 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e8137e5d-daaa-457c-a190-491d09d28f34 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:56.510530 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e8137e5d-daaa-457c-a190-491d09d28f34 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb5f9eb544a4785908e9f35ce065a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5001c6dfc09f4b03b4d29836165eddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:56.519716 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e8137e5d-daaa-457c-a190-491d09d28f34 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] 10.222.0.39 "GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4" status: 200 len: 1315 microversion: 2.1 time: 0.251559 Aug 07 01:51:56.535705 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2654/5769] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:56 2022] GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4 => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:57.549026 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-08ef7b8d-30a7-4cd0-b0b6-2eb67b77aa85 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:57.550818 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-08ef7b8d-30a7-4cd0-b0b6-2eb67b77aa85 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] [instance: 6f385148-639f-4f89-8bdc-491d80fb2ac4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:57.558286 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08ef7b8d-30a7-4cd0-b0b6-2eb67b77aa85 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:57.558781 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08ef7b8d-30a7-4cd0-b0b6-2eb67b77aa85 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:57.559482 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08ef7b8d-30a7-4cd0-b0b6-2eb67b77aa85 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:57.560695 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08ef7b8d-30a7-4cd0-b0b6-2eb67b77aa85 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:57.561454 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08ef7b8d-30a7-4cd0-b0b6-2eb67b77aa85 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:57.562204 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08ef7b8d-30a7-4cd0-b0b6-2eb67b77aa85 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:57.815658 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-08ef7b8d-30a7-4cd0-b0b6-2eb67b77aa85 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb5f9eb544a4785908e9f35ce065a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5001c6dfc09f4b03b4d29836165eddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:57.823878 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-08ef7b8d-30a7-4cd0-b0b6-2eb67b77aa85 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] 10.222.0.39 "GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4" status: 200 len: 1315 microversion: 2.1 time: 0.283787 Aug 07 01:51:57.840002 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3116/5770] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:57 2022] GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:51:58.846771 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fbf73cae-e070-41f4-a2c0-08b9ca7244f6 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:51:58.847458 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fbf73cae-e070-41f4-a2c0-08b9ca7244f6 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] [instance: 6f385148-639f-4f89-8bdc-491d80fb2ac4] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:51:58.854768 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fbf73cae-e070-41f4-a2c0-08b9ca7244f6 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:58.855430 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fbf73cae-e070-41f4-a2c0-08b9ca7244f6 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:58.855912 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fbf73cae-e070-41f4-a2c0-08b9ca7244f6 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:58.856632 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fbf73cae-e070-41f4-a2c0-08b9ca7244f6 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:51:58.857097 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fbf73cae-e070-41f4-a2c0-08b9ca7244f6 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:51:58.858058 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fbf73cae-e070-41f4-a2c0-08b9ca7244f6 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:51:59.011008 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fbf73cae-e070-41f4-a2c0-08b9ca7244f6 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb5f9eb544a4785908e9f35ce065a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5001c6dfc09f4b03b4d29836165eddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:51:59.021432 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fbf73cae-e070-41f4-a2c0-08b9ca7244f6 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] 10.222.0.39 "GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4" status: 200 len: 1315 microversion: 2.1 time: 0.178604 Aug 07 01:51:59.022029 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2655/5771] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:51:58 2022] GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:00.046812 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-de74b25b-80ef-4683-8de4-e77f2d64b3ca tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:00.047441 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-de74b25b-80ef-4683-8de4-e77f2d64b3ca tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] [instance: 6f385148-639f-4f89-8bdc-491d80fb2ac4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:00.056850 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-de74b25b-80ef-4683-8de4-e77f2d64b3ca tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:00.058279 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-de74b25b-80ef-4683-8de4-e77f2d64b3ca tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:00.066231 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-de74b25b-80ef-4683-8de4-e77f2d64b3ca tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:00.067112 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-de74b25b-80ef-4683-8de4-e77f2d64b3ca tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:00.068272 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-de74b25b-80ef-4683-8de4-e77f2d64b3ca tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:00.068808 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-de74b25b-80ef-4683-8de4-e77f2d64b3ca tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:00.122267 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-becddc14-1dc3-4cc9-a835-5abe2c67df85 req-de5dc8f1-3b90-451a-abef-cda3df4be6a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f385148-639f-4f89-8bdc-491d80fb2ac4", "name": "network-vif-plugged", "status": "completed", "tag": "ffe06532-72dd-4c10-81ba-d643292f6dc7"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:52:00.144661 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-becddc14-1dc3-4cc9-a835-5abe2c67df85 req-de5dc8f1-3b90-451a-abef-cda3df4be6a1 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:00.146217 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-becddc14-1dc3-4cc9-a835-5abe2c67df85 req-de5dc8f1-3b90-451a-abef-cda3df4be6a1 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:00.147474 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-becddc14-1dc3-4cc9-a835-5abe2c67df85 req-de5dc8f1-3b90-451a-abef-cda3df4be6a1 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:00.192767 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-becddc14-1dc3-4cc9-a835-5abe2c67df85 req-de5dc8f1-3b90-451a-abef-cda3df4be6a1 service nova] Creating event network-vif-plugged:ffe06532-72dd-4c10-81ba-d643292f6dc7 for instance 6f385148-639f-4f89-8bdc-491d80fb2ac4 on n-h2-master-1 Aug 07 01:52:00.209360 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-becddc14-1dc3-4cc9-a835-5abe2c67df85 req-de5dc8f1-3b90-451a-abef-cda3df4be6a1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094216 Aug 07 01:52:00.212236 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2656/5772] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:52:00.374647 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-de74b25b-80ef-4683-8de4-e77f2d64b3ca tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb5f9eb544a4785908e9f35ce065a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5001c6dfc09f4b03b4d29836165eddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:00.389537 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-de74b25b-80ef-4683-8de4-e77f2d64b3ca tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] 10.222.0.39 "GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4" status: 200 len: 1315 microversion: 2.1 time: 0.346480 Aug 07 01:52:00.390467 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3117/5773] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:00 2022] GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4 => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:01.412368 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-75c994d2-5e15-4c08-9b15-8e79b18d1793 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:01.413059 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-75c994d2-5e15-4c08-9b15-8e79b18d1793 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] [instance: 6f385148-639f-4f89-8bdc-491d80fb2ac4] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:01.419621 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75c994d2-5e15-4c08-9b15-8e79b18d1793 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:01.420183 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75c994d2-5e15-4c08-9b15-8e79b18d1793 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:01.420631 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75c994d2-5e15-4c08-9b15-8e79b18d1793 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:01.421354 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75c994d2-5e15-4c08-9b15-8e79b18d1793 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:01.421819 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75c994d2-5e15-4c08-9b15-8e79b18d1793 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:01.422289 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75c994d2-5e15-4c08-9b15-8e79b18d1793 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:01.575855 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-75c994d2-5e15-4c08-9b15-8e79b18d1793 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb5f9eb544a4785908e9f35ce065a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5001c6dfc09f4b03b4d29836165eddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:01.590147 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-75c994d2-5e15-4c08-9b15-8e79b18d1793 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] 10.222.0.39 "GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4" status: 200 len: 1315 microversion: 2.1 time: 0.182669 Aug 07 01:52:01.598626 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2657/5774] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:01 2022] GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:01.815583 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7bb51d2c-3420-4fa1-96b8-95383bf1e77f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-804954377", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3742bd7b-f8f2-4b26-b431-e195ef494856", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "620c0b3f-63f9-404f-acf4-ca02927e0de7"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:52:01.836436 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:52:01.894917 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-7bb51d2c-3420-4fa1-96b8-95383bf1e77f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] validate_networks() for [('620c0b3f-63f9-404f-acf4-ca02927e0de7', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:52:02.341228 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-7bb51d2c-3420-4fa1-96b8-95383bf1e77f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:52:02.341714 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-7bb51d2c-3420-4fa1-96b8-95383bf1e77f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:52:02.342224 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-7bb51d2c-3420-4fa1-96b8-95383bf1e77f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:52:02.342686 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-7bb51d2c-3420-4fa1-96b8-95383bf1e77f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:52:02.343114 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-7bb51d2c-3420-4fa1-96b8-95383bf1e77f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:52:02.354601 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7bb51d2c-3420-4fa1-96b8-95383bf1e77f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:02.355120 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7bb51d2c-3420-4fa1-96b8-95383bf1e77f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:02.355568 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7bb51d2c-3420-4fa1-96b8-95383bf1e77f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:02.356945 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7bb51d2c-3420-4fa1-96b8-95383bf1e77f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:02.358078 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7bb51d2c-3420-4fa1-96b8-95383bf1e77f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:02.358512 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7bb51d2c-3420-4fa1-96b8-95383bf1e77f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:02.378113 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-7bb51d2c-3420-4fa1-96b8-95383bf1e77f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Getting quotas for project bf36f5153ba648008cdaceb9dc538e53. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:52:02.383504 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-7bb51d2c-3420-4fa1-96b8-95383bf1e77f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Getting quotas for user 661f6c9aa7da4e348a9b0d91840078c2 and project bf36f5153ba648008cdaceb9dc538e53. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:52:02.448049 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7bb51d2c-3420-4fa1-96b8-95383bf1e77f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:52:02.450129 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7bb51d2c-3420-4fa1-96b8-95383bf1e77f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 12508600-0c8e-4fcf-82b6-95ff4879847d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3742bd7b-f8f2-4b26-b431-e195ef494856',volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:52:02.606417 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7bb51d2c-3420-4fa1-96b8-95383bf1e77f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.794390 Aug 07 01:52:02.608193 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3118/5775] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:52:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:52:02.610706 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:52:02.611710 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:52:02.619971 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-89c5400e-277d-48fa-bd65-a3b2ea244075 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:02.620984 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-89c5400e-277d-48fa-bd65-a3b2ea244075 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 12508600-0c8e-4fcf-82b6-95ff4879847d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:02.625686 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7a928163-af06-4c6b-ab14-a47d9c8787a3 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:02.626344 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7a928163-af06-4c6b-ab14-a47d9c8787a3 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] [instance: 6f385148-639f-4f89-8bdc-491d80fb2ac4] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:02.647071 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a928163-af06-4c6b-ab14-a47d9c8787a3 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:02.649045 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a928163-af06-4c6b-ab14-a47d9c8787a3 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:02.649852 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a928163-af06-4c6b-ab14-a47d9c8787a3 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:02.651135 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a928163-af06-4c6b-ab14-a47d9c8787a3 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:02.651602 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a928163-af06-4c6b-ab14-a47d9c8787a3 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:02.652227 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7a928163-af06-4c6b-ab14-a47d9c8787a3 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:02.705967 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-89c5400e-277d-48fa-bd65-a3b2ea244075 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:02.724326 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-89c5400e-277d-48fa-bd65-a3b2ea244075 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d" status: 200 len: 1056 microversion: 2.1 time: 0.108569 Aug 07 01:52:02.725499 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3119/5776] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:02 2022] GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d => generated 1056 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:52:02.894114 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7a928163-af06-4c6b-ab14-a47d9c8787a3 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb5f9eb544a4785908e9f35ce065a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5001c6dfc09f4b03b4d29836165eddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:02.905902 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7a928163-af06-4c6b-ab14-a47d9c8787a3 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] 10.222.0.39 "GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4" status: 200 len: 1501 microversion: 2.1 time: 0.297088 Aug 07 01:52:02.907012 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2658/5777] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:02 2022] GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4 => generated 1501 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:02.926543 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-803bb60e-4120-4d95-a757-be04015ffa92 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:02.927715 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-803bb60e-4120-4d95-a757-be04015ffa92 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] [instance: 6f385148-639f-4f89-8bdc-491d80fb2ac4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:02.939106 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-803bb60e-4120-4d95-a757-be04015ffa92 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:02.940124 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-803bb60e-4120-4d95-a757-be04015ffa92 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:02.940737 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-803bb60e-4120-4d95-a757-be04015ffa92 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:02.941917 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-803bb60e-4120-4d95-a757-be04015ffa92 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:02.943084 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-803bb60e-4120-4d95-a757-be04015ffa92 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:02.943692 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-803bb60e-4120-4d95-a757-be04015ffa92 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:03.148023 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-803bb60e-4120-4d95-a757-be04015ffa92 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb5f9eb544a4785908e9f35ce065a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5001c6dfc09f4b03b4d29836165eddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:03.162499 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-803bb60e-4120-4d95-a757-be04015ffa92 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] 10.222.0.39 "GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4" status: 200 len: 1501 microversion: 2.1 time: 0.237694 Aug 07 01:52:03.165489 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3120/5778] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:02 2022] GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4 => generated 1501 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:03.196930 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-20fc1fce-78a1-44b9-a742-7625a2b5cc65 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:52:03.197525 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-20fc1fce-78a1-44b9-a742-7625a2b5cc65 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] [instance: 6f385148-639f-4f89-8bdc-491d80fb2ac4] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:03.212948 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-20fc1fce-78a1-44b9-a742-7625a2b5cc65 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:03.213442 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-20fc1fce-78a1-44b9-a742-7625a2b5cc65 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:03.213880 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-20fc1fce-78a1-44b9-a742-7625a2b5cc65 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:03.214603 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-20fc1fce-78a1-44b9-a742-7625a2b5cc65 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:03.215471 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-20fc1fce-78a1-44b9-a742-7625a2b5cc65 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:03.216213 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-20fc1fce-78a1-44b9-a742-7625a2b5cc65 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:03.243784 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-20fc1fce-78a1-44b9-a742-7625a2b5cc65 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lazy-loading 'flavor' on Instance uuid 6f385148-639f-4f89-8bdc-491d80fb2ac4 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:52:03.277003 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:52:03.333444 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-20fc1fce-78a1-44b9-a742-7625a2b5cc65 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] 10.222.0.39 "POST /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4/action" status: 202 len: 0 microversion: 2.1 time: 0.147743 Aug 07 01:52:03.334600 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2659/5779] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:52:03 2022] POST /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:52:03.342446 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3fc5fca9-812b-4aa8-9168-60bfd4bc33ab tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:03.343341 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3fc5fca9-812b-4aa8-9168-60bfd4bc33ab tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] [instance: 6f385148-639f-4f89-8bdc-491d80fb2ac4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:03.349888 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fc5fca9-812b-4aa8-9168-60bfd4bc33ab tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:03.350604 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fc5fca9-812b-4aa8-9168-60bfd4bc33ab tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:03.351203 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fc5fca9-812b-4aa8-9168-60bfd4bc33ab tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:03.352127 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fc5fca9-812b-4aa8-9168-60bfd4bc33ab tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:03.352877 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fc5fca9-812b-4aa8-9168-60bfd4bc33ab tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:03.353463 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3fc5fca9-812b-4aa8-9168-60bfd4bc33ab tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:03.518467 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3fc5fca9-812b-4aa8-9168-60bfd4bc33ab tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb5f9eb544a4785908e9f35ce065a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5001c6dfc09f4b03b4d29836165eddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:03.538834 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3fc5fca9-812b-4aa8-9168-60bfd4bc33ab tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] 10.222.0.39 "GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4" status: 200 len: 1509 microversion: 2.1 time: 0.200147 Aug 07 01:52:03.539431 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3121/5780] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:03 2022] GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4 => generated 1509 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:52:03.748705 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6fab5531-919d-4601-ae6b-8a9530b0af02 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:03.749528 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6fab5531-919d-4601-ae6b-8a9530b0af02 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 12508600-0c8e-4fcf-82b6-95ff4879847d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:03.755943 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6fab5531-919d-4601-ae6b-8a9530b0af02 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:03.756506 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6fab5531-919d-4601-ae6b-8a9530b0af02 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:03.757012 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6fab5531-919d-4601-ae6b-8a9530b0af02 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:03.757802 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6fab5531-919d-4601-ae6b-8a9530b0af02 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:03.758330 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6fab5531-919d-4601-ae6b-8a9530b0af02 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:03.758828 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6fab5531-919d-4601-ae6b-8a9530b0af02 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:03.842921 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6fab5531-919d-4601-ae6b-8a9530b0af02 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:03.852371 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6fab5531-919d-4601-ae6b-8a9530b0af02 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d" status: 200 len: 1154 microversion: 2.1 time: 0.109121 Aug 07 01:52:03.863848 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2660/5781] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:03 2022] GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d => generated 1154 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:03.962315 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6bed2a91-7969-41b1-9de1-d8c61fe6d7d4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:52:03.965387 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6bed2a91-7969-41b1-9de1-d8c61fe6d7d4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: d05d75dd-2cc4-468e-80ca-0e64698d8497] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:03.976853 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6bed2a91-7969-41b1-9de1-d8c61fe6d7d4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:03.980435 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6bed2a91-7969-41b1-9de1-d8c61fe6d7d4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:03.981099 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6bed2a91-7969-41b1-9de1-d8c61fe6d7d4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:03.982005 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6bed2a91-7969-41b1-9de1-d8c61fe6d7d4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:03.982680 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6bed2a91-7969-41b1-9de1-d8c61fe6d7d4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:03.983301 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6bed2a91-7969-41b1-9de1-d8c61fe6d7d4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:04.104874 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6bed2a91-7969-41b1-9de1-d8c61fe6d7d4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "POST /compute/v2.1/servers/d05d75dd-2cc4-468e-80ca-0e64698d8497/action" status: 200 len: 24571 microversion: 2.1 time: 0.148216 Aug 07 01:52:04.105436 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3122/5782] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:52:03 2022] POST /compute/v2.1/servers/d05d75dd-2cc4-468e-80ca-0e64698d8497/action => generated 24571 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:52:04.561099 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-956f5fbb-b9ff-4c28-9408-46566eed0bfd tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:04.561987 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-956f5fbb-b9ff-4c28-9408-46566eed0bfd tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] [instance: 6f385148-639f-4f89-8bdc-491d80fb2ac4] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:04.584404 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-956f5fbb-b9ff-4c28-9408-46566eed0bfd tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:04.585407 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-956f5fbb-b9ff-4c28-9408-46566eed0bfd tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:04.589940 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-956f5fbb-b9ff-4c28-9408-46566eed0bfd tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:04.591934 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-956f5fbb-b9ff-4c28-9408-46566eed0bfd tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:04.592848 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-956f5fbb-b9ff-4c28-9408-46566eed0bfd tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:04.594937 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-956f5fbb-b9ff-4c28-9408-46566eed0bfd tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:04.885169 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5cbb31d1-47dc-41df-afd5-98f56bf76b6d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:04.886189 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5cbb31d1-47dc-41df-afd5-98f56bf76b6d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 12508600-0c8e-4fcf-82b6-95ff4879847d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:04.895230 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cbb31d1-47dc-41df-afd5-98f56bf76b6d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:04.900596 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cbb31d1-47dc-41df-afd5-98f56bf76b6d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:04.901327 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cbb31d1-47dc-41df-afd5-98f56bf76b6d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:04.904846 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cbb31d1-47dc-41df-afd5-98f56bf76b6d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:04.908209 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cbb31d1-47dc-41df-afd5-98f56bf76b6d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:04.909047 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cbb31d1-47dc-41df-afd5-98f56bf76b6d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:04.912885 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:52:04.956342 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-956f5fbb-b9ff-4c28-9408-46566eed0bfd tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb5f9eb544a4785908e9f35ce065a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5001c6dfc09f4b03b4d29836165eddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:04.973971 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-956f5fbb-b9ff-4c28-9408-46566eed0bfd tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] 10.222.0.39 "GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4" status: 200 len: 1492 microversion: 2.1 time: 0.417919 Aug 07 01:52:04.999221 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2661/5783] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:04 2022] GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4 => generated 1492 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:05.012739 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e6a934e5-29f6-49f8-8521-8b9fdee66740 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:52:05.013855 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e6a934e5-29f6-49f8-8521-8b9fdee66740 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] [instance: 6f385148-639f-4f89-8bdc-491d80fb2ac4] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:05.030314 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e6a934e5-29f6-49f8-8521-8b9fdee66740 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:05.030825 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e6a934e5-29f6-49f8-8521-8b9fdee66740 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:05.031271 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e6a934e5-29f6-49f8-8521-8b9fdee66740 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:05.033968 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e6a934e5-29f6-49f8-8521-8b9fdee66740 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:05.034638 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e6a934e5-29f6-49f8-8521-8b9fdee66740 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:05.039448 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e6a934e5-29f6-49f8-8521-8b9fdee66740 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:05.080774 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5cbb31d1-47dc-41df-afd5-98f56bf76b6d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:05.090181 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5cbb31d1-47dc-41df-afd5-98f56bf76b6d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d" status: 200 len: 1172 microversion: 2.1 time: 0.209244 Aug 07 01:52:05.093721 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3123/5784] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:04 2022] GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d => generated 1172 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:52:05.169032 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e6a934e5-29f6-49f8-8521-8b9fdee66740 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] 10.222.0.39 "POST /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4/action" status: 202 len: 0 microversion: 2.1 time: 0.162117 Aug 07 01:52:05.169761 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2662/5785] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:52:05 2022] POST /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:52:05.181293 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f1bb816a-5dc4-4b79-9701-c48db65e12c1 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:05.182232 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f1bb816a-5dc4-4b79-9701-c48db65e12c1 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] [instance: 6f385148-639f-4f89-8bdc-491d80fb2ac4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:05.198612 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f1bb816a-5dc4-4b79-9701-c48db65e12c1 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:05.199561 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f1bb816a-5dc4-4b79-9701-c48db65e12c1 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:05.200369 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f1bb816a-5dc4-4b79-9701-c48db65e12c1 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:05.204360 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f1bb816a-5dc4-4b79-9701-c48db65e12c1 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:05.205175 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f1bb816a-5dc4-4b79-9701-c48db65e12c1 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:05.205829 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f1bb816a-5dc4-4b79-9701-c48db65e12c1 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:05.533455 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f1bb816a-5dc4-4b79-9701-c48db65e12c1 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb5f9eb544a4785908e9f35ce065a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5001c6dfc09f4b03b4d29836165eddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:05.548545 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f1bb816a-5dc4-4b79-9701-c48db65e12c1 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] 10.222.0.39 "GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4" status: 200 len: 1498 microversion: 2.1 time: 0.370986 Aug 07 01:52:05.564089 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3124/5786] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:05 2022] GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4 => generated 1498 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:06.117804 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-22a9a086-fac4-4842-a1e0-8cd560479b5c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:06.120875 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-22a9a086-fac4-4842-a1e0-8cd560479b5c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 12508600-0c8e-4fcf-82b6-95ff4879847d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:06.143349 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22a9a086-fac4-4842-a1e0-8cd560479b5c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:06.144854 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22a9a086-fac4-4842-a1e0-8cd560479b5c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:06.145880 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22a9a086-fac4-4842-a1e0-8cd560479b5c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:06.147233 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22a9a086-fac4-4842-a1e0-8cd560479b5c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:06.148354 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22a9a086-fac4-4842-a1e0-8cd560479b5c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:06.149245 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22a9a086-fac4-4842-a1e0-8cd560479b5c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:06.331000 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-e9ab005d-106b-4268-bcb5-5f7011c117be req-b3ca4bdf-27e8-453f-9384-e7849a672a02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12508600-0c8e-4fcf-82b6-95ff4879847d", "tag": "7e936417-6952-4a64-933b-de424c514d29"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:52:06.361270 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e9ab005d-106b-4268-bcb5-5f7011c117be req-b3ca4bdf-27e8-453f-9384-e7849a672a02 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:06.364734 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e9ab005d-106b-4268-bcb5-5f7011c117be req-b3ca4bdf-27e8-453f-9384-e7849a672a02 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:06.365218 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e9ab005d-106b-4268-bcb5-5f7011c117be req-b3ca4bdf-27e8-453f-9384-e7849a672a02 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:06.394100 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-e9ab005d-106b-4268-bcb5-5f7011c117be req-b3ca4bdf-27e8-453f-9384-e7849a672a02 service nova] Creating event network-changed:7e936417-6952-4a64-933b-de424c514d29 for instance 12508600-0c8e-4fcf-82b6-95ff4879847d on n-h1-master-1 Aug 07 01:52:06.399619 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-e9ab005d-106b-4268-bcb5-5f7011c117be req-b3ca4bdf-27e8-453f-9384-e7849a672a02 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073179 Aug 07 01:52:06.401013 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3125/5787] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:52:06.441821 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-22a9a086-fac4-4842-a1e0-8cd560479b5c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:06.453218 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-22a9a086-fac4-4842-a1e0-8cd560479b5c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d" status: 200 len: 1214 microversion: 2.1 time: 0.342027 Aug 07 01:52:06.455795 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2663/5788] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:06 2022] GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d => generated 1214 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:06.575297 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a5528bdd-0d14-489a-ba63-6883bb8cc2dc tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:06.576678 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a5528bdd-0d14-489a-ba63-6883bb8cc2dc tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] [instance: 6f385148-639f-4f89-8bdc-491d80fb2ac4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:06.593715 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a5528bdd-0d14-489a-ba63-6883bb8cc2dc tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:06.593842 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a5528bdd-0d14-489a-ba63-6883bb8cc2dc tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:06.594430 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a5528bdd-0d14-489a-ba63-6883bb8cc2dc tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:06.595095 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a5528bdd-0d14-489a-ba63-6883bb8cc2dc tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:06.595562 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a5528bdd-0d14-489a-ba63-6883bb8cc2dc tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:06.596028 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a5528bdd-0d14-489a-ba63-6883bb8cc2dc tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:06.981313 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a5528bdd-0d14-489a-ba63-6883bb8cc2dc tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb5f9eb544a4785908e9f35ce065a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5001c6dfc09f4b03b4d29836165eddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:06.993588 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a5528bdd-0d14-489a-ba63-6883bb8cc2dc tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] 10.222.0.39 "GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4" status: 200 len: 1498 microversion: 2.1 time: 0.422911 Aug 07 01:52:06.994525 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3126/5789] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:06 2022] GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4 => generated 1498 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:07.480895 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8e9c76ff-4d22-46a6-ba96-ca00d3c52ef8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:07.481586 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8e9c76ff-4d22-46a6-ba96-ca00d3c52ef8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 12508600-0c8e-4fcf-82b6-95ff4879847d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:07.489823 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8e9c76ff-4d22-46a6-ba96-ca00d3c52ef8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:07.490742 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8e9c76ff-4d22-46a6-ba96-ca00d3c52ef8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:07.491400 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8e9c76ff-4d22-46a6-ba96-ca00d3c52ef8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:07.492563 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8e9c76ff-4d22-46a6-ba96-ca00d3c52ef8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:07.494471 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8e9c76ff-4d22-46a6-ba96-ca00d3c52ef8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:07.495113 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8e9c76ff-4d22-46a6-ba96-ca00d3c52ef8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:07.683691 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8e9c76ff-4d22-46a6-ba96-ca00d3c52ef8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:07.693509 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8e9c76ff-4d22-46a6-ba96-ca00d3c52ef8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d" status: 200 len: 1214 microversion: 2.1 time: 0.216685 Aug 07 01:52:07.700768 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2664/5790] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:07 2022] GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d => generated 1214 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:08.017399 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2158b74e-282d-406f-9bc1-15ff29ae5395 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:08.018116 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2158b74e-282d-406f-9bc1-15ff29ae5395 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] [instance: 6f385148-639f-4f89-8bdc-491d80fb2ac4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:08.027256 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2158b74e-282d-406f-9bc1-15ff29ae5395 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:08.027936 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2158b74e-282d-406f-9bc1-15ff29ae5395 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:08.028537 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2158b74e-282d-406f-9bc1-15ff29ae5395 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:08.029862 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2158b74e-282d-406f-9bc1-15ff29ae5395 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:08.030484 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2158b74e-282d-406f-9bc1-15ff29ae5395 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:08.031074 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2158b74e-282d-406f-9bc1-15ff29ae5395 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:08.241067 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2158b74e-282d-406f-9bc1-15ff29ae5395 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb5f9eb544a4785908e9f35ce065a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5001c6dfc09f4b03b4d29836165eddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:08.251669 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2158b74e-282d-406f-9bc1-15ff29ae5395 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] 10.222.0.39 "GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4" status: 200 len: 1501 microversion: 2.1 time: 0.239043 Aug 07 01:52:08.252692 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3127/5791] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:08 2022] GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4 => generated 1501 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:08.274724 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0bfcae29-6de1-4f87-b4ad-0a60ece813e1 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:52:08.275278 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0bfcae29-6de1-4f87-b4ad-0a60ece813e1 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] [instance: 6f385148-639f-4f89-8bdc-491d80fb2ac4] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:08.282884 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0bfcae29-6de1-4f87-b4ad-0a60ece813e1 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:08.283439 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0bfcae29-6de1-4f87-b4ad-0a60ece813e1 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:08.283918 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0bfcae29-6de1-4f87-b4ad-0a60ece813e1 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:08.284763 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0bfcae29-6de1-4f87-b4ad-0a60ece813e1 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:08.285395 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0bfcae29-6de1-4f87-b4ad-0a60ece813e1 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:08.285988 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0bfcae29-6de1-4f87-b4ad-0a60ece813e1 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:08.318738 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-0bfcae29-6de1-4f87-b4ad-0a60ece813e1 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lazy-loading 'flavor' on Instance uuid 6f385148-639f-4f89-8bdc-491d80fb2ac4 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:52:08.444220 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0bfcae29-6de1-4f87-b4ad-0a60ece813e1 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] 10.222.0.39 "POST /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4/action" status: 202 len: 0 microversion: 2.1 time: 0.172206 Aug 07 01:52:08.446530 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2665/5792] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:52:08 2022] POST /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:52:08.457229 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cb8328e9-7b65-4aa7-8526-424348d62128 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:08.459237 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cb8328e9-7b65-4aa7-8526-424348d62128 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] [instance: 6f385148-639f-4f89-8bdc-491d80fb2ac4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:08.468260 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb8328e9-7b65-4aa7-8526-424348d62128 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:08.468826 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb8328e9-7b65-4aa7-8526-424348d62128 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:08.469182 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb8328e9-7b65-4aa7-8526-424348d62128 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:08.469950 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb8328e9-7b65-4aa7-8526-424348d62128 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:08.470405 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb8328e9-7b65-4aa7-8526-424348d62128 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:08.470871 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb8328e9-7b65-4aa7-8526-424348d62128 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:08.646335 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cb8328e9-7b65-4aa7-8526-424348d62128 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb5f9eb544a4785908e9f35ce065a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5001c6dfc09f4b03b4d29836165eddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:08.658094 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cb8328e9-7b65-4aa7-8526-424348d62128 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] 10.222.0.39 "GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4" status: 200 len: 1509 microversion: 2.1 time: 0.206319 Aug 07 01:52:08.658743 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3128/5793] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:08 2022] GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4 => generated 1509 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:08.721462 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a3d568f2-53dc-4a28-94b4-3615fb97139a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:08.722206 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a3d568f2-53dc-4a28-94b4-3615fb97139a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 12508600-0c8e-4fcf-82b6-95ff4879847d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:08.732184 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3d568f2-53dc-4a28-94b4-3615fb97139a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:08.733052 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3d568f2-53dc-4a28-94b4-3615fb97139a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:08.733728 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3d568f2-53dc-4a28-94b4-3615fb97139a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:08.734680 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3d568f2-53dc-4a28-94b4-3615fb97139a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:08.735706 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3d568f2-53dc-4a28-94b4-3615fb97139a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:08.737635 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3d568f2-53dc-4a28-94b4-3615fb97139a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:08.904501 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a3d568f2-53dc-4a28-94b4-3615fb97139a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:08.913172 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a3d568f2-53dc-4a28-94b4-3615fb97139a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d" status: 200 len: 1214 microversion: 2.1 time: 0.196204 Aug 07 01:52:08.913988 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2666/5794] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:08 2022] GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d => generated 1214 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:09.682880 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-06a24277-24ea-41d6-9418-552f406abc95 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:09.684124 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-06a24277-24ea-41d6-9418-552f406abc95 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] [instance: 6f385148-639f-4f89-8bdc-491d80fb2ac4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:09.696895 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-06a24277-24ea-41d6-9418-552f406abc95 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:09.697395 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-06a24277-24ea-41d6-9418-552f406abc95 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:09.701190 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-06a24277-24ea-41d6-9418-552f406abc95 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:09.702138 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-06a24277-24ea-41d6-9418-552f406abc95 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:09.702769 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-06a24277-24ea-41d6-9418-552f406abc95 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:09.703788 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-06a24277-24ea-41d6-9418-552f406abc95 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:09.890638 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-06a24277-24ea-41d6-9418-552f406abc95 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb5f9eb544a4785908e9f35ce065a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5001c6dfc09f4b03b4d29836165eddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:09.902092 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-06a24277-24ea-41d6-9418-552f406abc95 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] 10.222.0.39 "GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4" status: 200 len: 1492 microversion: 2.1 time: 0.222467 Aug 07 01:52:09.903000 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3129/5795] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:09 2022] GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4 => generated 1492 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:09.923571 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a2fa8048-ac94-41af-844e-bea71e49222c tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:52:09.924137 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a2fa8048-ac94-41af-844e-bea71e49222c tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] [instance: 6f385148-639f-4f89-8bdc-491d80fb2ac4] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:09.934250 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a8721aba-bcf8-4e1b-9d55-b10e5163e39d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:09.935003 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a8721aba-bcf8-4e1b-9d55-b10e5163e39d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 12508600-0c8e-4fcf-82b6-95ff4879847d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:09.941722 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:52:09.943224 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2fa8048-ac94-41af-844e-bea71e49222c tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:09.943712 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2fa8048-ac94-41af-844e-bea71e49222c tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:09.944172 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2fa8048-ac94-41af-844e-bea71e49222c tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:09.944875 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2fa8048-ac94-41af-844e-bea71e49222c tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:09.949181 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8721aba-bcf8-4e1b-9d55-b10e5163e39d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:09.953022 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8721aba-bcf8-4e1b-9d55-b10e5163e39d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:09.953645 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8721aba-bcf8-4e1b-9d55-b10e5163e39d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:09.955834 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2fa8048-ac94-41af-844e-bea71e49222c tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:09.956870 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8721aba-bcf8-4e1b-9d55-b10e5163e39d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:09.958145 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8721aba-bcf8-4e1b-9d55-b10e5163e39d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:09.958593 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8721aba-bcf8-4e1b-9d55-b10e5163e39d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:09.961077 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a2fa8048-ac94-41af-844e-bea71e49222c tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:10.142372 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a2fa8048-ac94-41af-844e-bea71e49222c tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] 10.222.0.39 "POST /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4/action" status: 202 len: 0 microversion: 2.1 time: 0.222971 Aug 07 01:52:10.143564 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2667/5796] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:52:09 2022] POST /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:52:10.159069 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bdcdc39c-7159-4e86-88ae-e7834b37380b tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:10.175953 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bdcdc39c-7159-4e86-88ae-e7834b37380b tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] [instance: 6f385148-639f-4f89-8bdc-491d80fb2ac4] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:10.188181 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bdcdc39c-7159-4e86-88ae-e7834b37380b tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:10.188746 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bdcdc39c-7159-4e86-88ae-e7834b37380b tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:10.189344 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bdcdc39c-7159-4e86-88ae-e7834b37380b tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:10.190311 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bdcdc39c-7159-4e86-88ae-e7834b37380b tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:10.191235 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bdcdc39c-7159-4e86-88ae-e7834b37380b tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:10.205889 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bdcdc39c-7159-4e86-88ae-e7834b37380b tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:10.282395 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a8721aba-bcf8-4e1b-9d55-b10e5163e39d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:10.296077 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a8721aba-bcf8-4e1b-9d55-b10e5163e39d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d" status: 200 len: 1214 microversion: 2.1 time: 0.365574 Aug 07 01:52:10.297217 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3130/5797] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:09 2022] GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d => generated 1214 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:52:10.524253 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-164c1a90-85e0-4ea6-a7e1-4e0b9baa372e tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-897136611", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "adfea483-2e62-44b6-8772-34ff48413660"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:52:10.587611 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bdcdc39c-7159-4e86-88ae-e7834b37380b tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb5f9eb544a4785908e9f35ce065a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5001c6dfc09f4b03b4d29836165eddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:10.598856 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bdcdc39c-7159-4e86-88ae-e7834b37380b tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] 10.222.0.39 "GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4" status: 200 len: 1498 microversion: 2.1 time: 0.443981 Aug 07 01:52:10.599445 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-164c1a90-85e0-4ea6-a7e1-4e0b9baa372e tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] validate_networks() for [('adfea483-2e62-44b6-8772-34ff48413660', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:52:10.602512 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2668/5798] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:10 2022] GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4 => generated 1498 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:11.146139 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-164c1a90-85e0-4ea6-a7e1-4e0b9baa372e tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:52:11.146758 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-164c1a90-85e0-4ea6-a7e1-4e0b9baa372e tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:52:11.147342 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-164c1a90-85e0-4ea6-a7e1-4e0b9baa372e tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:52:11.147851 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-164c1a90-85e0-4ea6-a7e1-4e0b9baa372e tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:52:11.148389 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-164c1a90-85e0-4ea6-a7e1-4e0b9baa372e tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:52:11.159601 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-164c1a90-85e0-4ea6-a7e1-4e0b9baa372e tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:11.160302 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-164c1a90-85e0-4ea6-a7e1-4e0b9baa372e tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:11.160849 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-164c1a90-85e0-4ea6-a7e1-4e0b9baa372e tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:11.161746 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-164c1a90-85e0-4ea6-a7e1-4e0b9baa372e tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:11.162311 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-164c1a90-85e0-4ea6-a7e1-4e0b9baa372e tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:11.163138 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-164c1a90-85e0-4ea6-a7e1-4e0b9baa372e tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:11.186101 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-164c1a90-85e0-4ea6-a7e1-4e0b9baa372e tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Getting quotas for project da2650b8d88f4992a09bcf0048bcc4c2. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:52:11.192612 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-164c1a90-85e0-4ea6-a7e1-4e0b9baa372e tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Getting quotas for user cc27d58f027d4fc3b398f6c184911e2e and project da2650b8d88f4992a09bcf0048bcc4c2. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:52:11.211247 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-164c1a90-85e0-4ea6-a7e1-4e0b9baa372e tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:52:11.213854 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-164c1a90-85e0-4ea6-a7e1-4e0b9baa372e tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] [instance: 6003ea94-8906-4657-85bd-999848adf23a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:52:11.276727 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-164c1a90-85e0-4ea6-a7e1-4e0b9baa372e tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.756135 Aug 07 01:52:11.277707 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3131/5799] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:52:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:52:11.288653 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9b6a52cb-0b63-4c3c-b65b-60a5560936f5 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:11.289530 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9b6a52cb-0b63-4c3c-b65b-60a5560936f5 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] [instance: 6003ea94-8906-4657-85bd-999848adf23a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:11.318337 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d4a86ffa-e98e-4e5a-bce0-528f66be7722 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:11.318593 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d4a86ffa-e98e-4e5a-bce0-528f66be7722 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 12508600-0c8e-4fcf-82b6-95ff4879847d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:11.350288 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d4a86ffa-e98e-4e5a-bce0-528f66be7722 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:11.350807 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d4a86ffa-e98e-4e5a-bce0-528f66be7722 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:11.354299 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d4a86ffa-e98e-4e5a-bce0-528f66be7722 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:11.355447 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d4a86ffa-e98e-4e5a-bce0-528f66be7722 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:11.355945 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d4a86ffa-e98e-4e5a-bce0-528f66be7722 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:11.356447 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d4a86ffa-e98e-4e5a-bce0-528f66be7722 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:11.515740 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9b6a52cb-0b63-4c3c-b65b-60a5560936f5 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc27d58f027d4fc3b398f6c184911e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2650b8d88f4992a09bcf0048bcc4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:11.537575 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9b6a52cb-0b63-4c3c-b65b-60a5560936f5 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] 10.222.0.39 "GET /compute/v2.1/servers/6003ea94-8906-4657-85bd-999848adf23a" status: 200 len: 1218 microversion: 2.1 time: 0.252809 Aug 07 01:52:11.540403 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2669/5800] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:11 2022] GET /compute/v2.1/servers/6003ea94-8906-4657-85bd-999848adf23a => generated 1218 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:11.620193 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-65e7d97d-a7a0-453c-9324-d410108291b9 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:11.620829 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-65e7d97d-a7a0-453c-9324-d410108291b9 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] [instance: 6f385148-639f-4f89-8bdc-491d80fb2ac4] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:11.634091 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-65e7d97d-a7a0-453c-9324-d410108291b9 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:11.634596 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-65e7d97d-a7a0-453c-9324-d410108291b9 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:11.635034 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-65e7d97d-a7a0-453c-9324-d410108291b9 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:11.639773 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-65e7d97d-a7a0-453c-9324-d410108291b9 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:11.640459 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-65e7d97d-a7a0-453c-9324-d410108291b9 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:11.641088 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-65e7d97d-a7a0-453c-9324-d410108291b9 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:11.717832 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d4a86ffa-e98e-4e5a-bce0-528f66be7722 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:11.730520 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d4a86ffa-e98e-4e5a-bce0-528f66be7722 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d" status: 200 len: 1214 microversion: 2.1 time: 0.413711 Aug 07 01:52:11.731382 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3132/5801] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:11 2022] GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d => generated 1214 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:12.019431 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-65e7d97d-a7a0-453c-9324-d410108291b9 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb5f9eb544a4785908e9f35ce065a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5001c6dfc09f4b03b4d29836165eddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:12.032265 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-65e7d97d-a7a0-453c-9324-d410108291b9 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] 10.222.0.39 "GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4" status: 200 len: 1498 microversion: 2.1 time: 0.415436 Aug 07 01:52:12.034542 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2670/5802] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:11 2022] GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4 => generated 1498 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:52:12.569191 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-acd66c15-b82c-4aa3-8561-2f6127ffcc5c tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:12.569861 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-acd66c15-b82c-4aa3-8561-2f6127ffcc5c tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] [instance: 6003ea94-8906-4657-85bd-999848adf23a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:12.576109 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-acd66c15-b82c-4aa3-8561-2f6127ffcc5c tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:12.576539 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-acd66c15-b82c-4aa3-8561-2f6127ffcc5c tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:12.576977 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-acd66c15-b82c-4aa3-8561-2f6127ffcc5c tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:12.577678 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-acd66c15-b82c-4aa3-8561-2f6127ffcc5c tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:12.578146 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-acd66c15-b82c-4aa3-8561-2f6127ffcc5c tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:12.578561 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-acd66c15-b82c-4aa3-8561-2f6127ffcc5c tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:12.649250 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-acd66c15-b82c-4aa3-8561-2f6127ffcc5c tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc27d58f027d4fc3b398f6c184911e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2650b8d88f4992a09bcf0048bcc4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:12.661497 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-acd66c15-b82c-4aa3-8561-2f6127ffcc5c tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] 10.222.0.39 "GET /compute/v2.1/servers/6003ea94-8906-4657-85bd-999848adf23a" status: 200 len: 1270 microversion: 2.1 time: 0.095888 Aug 07 01:52:12.662430 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3133/5803] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:12 2022] GET /compute/v2.1/servers/6003ea94-8906-4657-85bd-999848adf23a => generated 1270 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:12.751992 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4cec8681-1a8b-4c51-a2db-c9f93c8de0cb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:12.752828 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4cec8681-1a8b-4c51-a2db-c9f93c8de0cb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 12508600-0c8e-4fcf-82b6-95ff4879847d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:12.760480 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4cec8681-1a8b-4c51-a2db-c9f93c8de0cb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:12.761389 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4cec8681-1a8b-4c51-a2db-c9f93c8de0cb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:12.765859 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4cec8681-1a8b-4c51-a2db-c9f93c8de0cb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:12.765859 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4cec8681-1a8b-4c51-a2db-c9f93c8de0cb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:12.765859 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4cec8681-1a8b-4c51-a2db-c9f93c8de0cb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:12.765859 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4cec8681-1a8b-4c51-a2db-c9f93c8de0cb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:12.906407 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4cec8681-1a8b-4c51-a2db-c9f93c8de0cb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:12.914430 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4cec8681-1a8b-4c51-a2db-c9f93c8de0cb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d" status: 200 len: 1202 microversion: 2.1 time: 0.166443 Aug 07 01:52:12.915076 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2671/5804] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:12 2022] GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d => generated 1202 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:13.054953 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9b265f2d-fe61-4e4d-b53f-44c04ffd7cf4 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:13.055606 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9b265f2d-fe61-4e4d-b53f-44c04ffd7cf4 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] [instance: 6f385148-639f-4f89-8bdc-491d80fb2ac4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:13.063276 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b265f2d-fe61-4e4d-b53f-44c04ffd7cf4 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:13.063784 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b265f2d-fe61-4e4d-b53f-44c04ffd7cf4 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:13.064286 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b265f2d-fe61-4e4d-b53f-44c04ffd7cf4 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:13.065220 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b265f2d-fe61-4e4d-b53f-44c04ffd7cf4 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:13.065678 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b265f2d-fe61-4e4d-b53f-44c04ffd7cf4 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:13.066181 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b265f2d-fe61-4e4d-b53f-44c04ffd7cf4 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:13.264889 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9b265f2d-fe61-4e4d-b53f-44c04ffd7cf4 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb5f9eb544a4785908e9f35ce065a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5001c6dfc09f4b03b4d29836165eddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:13.280104 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9b265f2d-fe61-4e4d-b53f-44c04ffd7cf4 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] 10.222.0.39 "GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4" status: 200 len: 1501 microversion: 2.1 time: 0.228513 Aug 07 01:52:13.282671 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3134/5805] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:13 2022] GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4 => generated 1501 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:13.304586 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8c0b1d5b-b822-4d0f-9cb5-491f92807633 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:13.305158 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8c0b1d5b-b822-4d0f-9cb5-491f92807633 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] [instance: 6f385148-639f-4f89-8bdc-491d80fb2ac4] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:13.312342 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8c0b1d5b-b822-4d0f-9cb5-491f92807633 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:13.313160 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8c0b1d5b-b822-4d0f-9cb5-491f92807633 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:13.313538 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8c0b1d5b-b822-4d0f-9cb5-491f92807633 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:13.314273 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8c0b1d5b-b822-4d0f-9cb5-491f92807633 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:13.314725 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8c0b1d5b-b822-4d0f-9cb5-491f92807633 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:13.315147 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8c0b1d5b-b822-4d0f-9cb5-491f92807633 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:13.341950 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8c0b1d5b-b822-4d0f-9cb5-491f92807633 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] [instance: 6f385148-639f-4f89-8bdc-491d80fb2ac4] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:52:13.345874 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:52:13.429008 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8c0b1d5b-b822-4d0f-9cb5-491f92807633 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4" status: 204 len: 0 microversion: 2.1 time: 0.128203 Aug 07 01:52:13.429912 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2672/5806] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:52:13 2022] DELETE /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:52:13.439217 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e1998127-57f4-44c0-a8cb-91e93268d13c tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:13.440080 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e1998127-57f4-44c0-a8cb-91e93268d13c tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] [instance: 6f385148-639f-4f89-8bdc-491d80fb2ac4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:13.448229 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1998127-57f4-44c0-a8cb-91e93268d13c tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:13.451161 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1998127-57f4-44c0-a8cb-91e93268d13c tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:13.451896 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1998127-57f4-44c0-a8cb-91e93268d13c tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:13.453264 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1998127-57f4-44c0-a8cb-91e93268d13c tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:13.453994 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1998127-57f4-44c0-a8cb-91e93268d13c tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:13.454516 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e1998127-57f4-44c0-a8cb-91e93268d13c tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:13.656918 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e1998127-57f4-44c0-a8cb-91e93268d13c tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb5f9eb544a4785908e9f35ce065a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5001c6dfc09f4b03b4d29836165eddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:13.666761 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e1998127-57f4-44c0-a8cb-91e93268d13c tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] 10.222.0.39 "GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4" status: 200 len: 1507 microversion: 2.1 time: 0.232278 Aug 07 01:52:13.669583 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3135/5807] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:13 2022] GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4 => generated 1507 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:13.683146 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d74c92af-29ad-4347-9830-43ab1b82238a tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:13.683878 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d74c92af-29ad-4347-9830-43ab1b82238a tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] [instance: 6003ea94-8906-4657-85bd-999848adf23a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:13.693793 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d74c92af-29ad-4347-9830-43ab1b82238a tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:13.694237 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d74c92af-29ad-4347-9830-43ab1b82238a tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:13.694735 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d74c92af-29ad-4347-9830-43ab1b82238a tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:13.695470 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d74c92af-29ad-4347-9830-43ab1b82238a tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:13.696182 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d74c92af-29ad-4347-9830-43ab1b82238a tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:13.696383 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d74c92af-29ad-4347-9830-43ab1b82238a tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:13.784149 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d74c92af-29ad-4347-9830-43ab1b82238a tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc27d58f027d4fc3b398f6c184911e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2650b8d88f4992a09bcf0048bcc4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:13.792772 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d74c92af-29ad-4347-9830-43ab1b82238a tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] 10.222.0.39 "GET /compute/v2.1/servers/6003ea94-8906-4657-85bd-999848adf23a" status: 200 len: 1276 microversion: 2.1 time: 0.113769 Aug 07 01:52:13.802253 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2673/5808] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:13 2022] GET /compute/v2.1/servers/6003ea94-8906-4657-85bd-999848adf23a => generated 1276 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:13.935558 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-86d3021f-5258-4d2f-8d1d-d663cc87f52e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:13.936580 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-86d3021f-5258-4d2f-8d1d-d663cc87f52e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 12508600-0c8e-4fcf-82b6-95ff4879847d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:13.942879 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86d3021f-5258-4d2f-8d1d-d663cc87f52e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:13.943503 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86d3021f-5258-4d2f-8d1d-d663cc87f52e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:13.944071 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86d3021f-5258-4d2f-8d1d-d663cc87f52e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:13.944873 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86d3021f-5258-4d2f-8d1d-d663cc87f52e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:13.945412 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86d3021f-5258-4d2f-8d1d-d663cc87f52e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:13.946155 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86d3021f-5258-4d2f-8d1d-d663cc87f52e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:14.183758 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-86d3021f-5258-4d2f-8d1d-d663cc87f52e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:14.192121 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-86d3021f-5258-4d2f-8d1d-d663cc87f52e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d" status: 200 len: 1202 microversion: 2.1 time: 0.261362 Aug 07 01:52:14.192700 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3136/5809] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:13 2022] GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d => generated 1202 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:14.691397 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-82178568-e895-4017-8479-45caa1aaa1ec tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:14.692118 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-82178568-e895-4017-8479-45caa1aaa1ec tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] [instance: 6f385148-639f-4f89-8bdc-491d80fb2ac4] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:14.698634 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-82178568-e895-4017-8479-45caa1aaa1ec tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:14.699120 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-82178568-e895-4017-8479-45caa1aaa1ec tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:14.699559 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-82178568-e895-4017-8479-45caa1aaa1ec tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:14.700341 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-82178568-e895-4017-8479-45caa1aaa1ec tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:14.701303 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-82178568-e895-4017-8479-45caa1aaa1ec tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:14.701732 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-82178568-e895-4017-8479-45caa1aaa1ec tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:14.815523 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c34ce659-3df3-41f6-967d-3013263d7d12 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:14.816846 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c34ce659-3df3-41f6-967d-3013263d7d12 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] [instance: 6003ea94-8906-4657-85bd-999848adf23a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:14.825519 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c34ce659-3df3-41f6-967d-3013263d7d12 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:14.826340 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c34ce659-3df3-41f6-967d-3013263d7d12 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:14.826998 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c34ce659-3df3-41f6-967d-3013263d7d12 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:14.828132 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c34ce659-3df3-41f6-967d-3013263d7d12 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:14.828999 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c34ce659-3df3-41f6-967d-3013263d7d12 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:14.829664 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c34ce659-3df3-41f6-967d-3013263d7d12 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:14.880794 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-82178568-e895-4017-8479-45caa1aaa1ec tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb5f9eb544a4785908e9f35ce065a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5001c6dfc09f4b03b4d29836165eddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:14.889944 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-82178568-e895-4017-8479-45caa1aaa1ec tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] 10.222.0.39 "GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4" status: 200 len: 1507 microversion: 2.1 time: 0.202566 Aug 07 01:52:14.904028 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2674/5810] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:14 2022] GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4 => generated 1507 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:14.911106 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-514dbf60-3ae5-4ca9-9a9b-77eba26a0940 req-e0b3d79f-6e72-42e0-b2d9-e767b51734b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6003ea94-8906-4657-85bd-999848adf23a", "tag": "9126c914-b893-40d5-9dcf-99c991799c8f"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:52:14.927929 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-514dbf60-3ae5-4ca9-9a9b-77eba26a0940 req-e0b3d79f-6e72-42e0-b2d9-e767b51734b3 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:14.928708 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-514dbf60-3ae5-4ca9-9a9b-77eba26a0940 req-e0b3d79f-6e72-42e0-b2d9-e767b51734b3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:14.929153 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-514dbf60-3ae5-4ca9-9a9b-77eba26a0940 req-e0b3d79f-6e72-42e0-b2d9-e767b51734b3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:14.945385 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-514dbf60-3ae5-4ca9-9a9b-77eba26a0940 req-e0b3d79f-6e72-42e0-b2d9-e767b51734b3 service nova] Creating event network-changed:9126c914-b893-40d5-9dcf-99c991799c8f for instance 6003ea94-8906-4657-85bd-999848adf23a on n-h1-master-1 Aug 07 01:52:14.950759 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-514dbf60-3ae5-4ca9-9a9b-77eba26a0940 req-e0b3d79f-6e72-42e0-b2d9-e767b51734b3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048703 Aug 07 01:52:14.951453 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2675/5811] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:52:15.109158 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c34ce659-3df3-41f6-967d-3013263d7d12 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc27d58f027d4fc3b398f6c184911e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2650b8d88f4992a09bcf0048bcc4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:15.117285 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c34ce659-3df3-41f6-967d-3013263d7d12 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] 10.222.0.39 "GET /compute/v2.1/servers/6003ea94-8906-4657-85bd-999848adf23a" status: 200 len: 1318 microversion: 2.1 time: 0.305825 Aug 07 01:52:15.117981 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3137/5812] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:14 2022] GET /compute/v2.1/servers/6003ea94-8906-4657-85bd-999848adf23a => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:15.214017 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-05f4a3d1-eb85-411f-b36f-ab9474de75a3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:15.214637 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-05f4a3d1-eb85-411f-b36f-ab9474de75a3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 12508600-0c8e-4fcf-82b6-95ff4879847d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:15.223051 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05f4a3d1-eb85-411f-b36f-ab9474de75a3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:15.223727 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05f4a3d1-eb85-411f-b36f-ab9474de75a3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:15.224340 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05f4a3d1-eb85-411f-b36f-ab9474de75a3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:15.225229 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05f4a3d1-eb85-411f-b36f-ab9474de75a3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:15.227353 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05f4a3d1-eb85-411f-b36f-ab9474de75a3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:15.228155 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05f4a3d1-eb85-411f-b36f-ab9474de75a3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:15.383155 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-05f4a3d1-eb85-411f-b36f-ab9474de75a3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:15.393110 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-05f4a3d1-eb85-411f-b36f-ab9474de75a3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d" status: 200 len: 1202 microversion: 2.1 time: 0.183511 Aug 07 01:52:15.393737 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2676/5813] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:15 2022] GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d => generated 1202 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:15.914041 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4a54dfd3-8bc6-4c4b-a6f2-5d36df4885e8 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:15.914907 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4a54dfd3-8bc6-4c4b-a6f2-5d36df4885e8 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] [instance: 6f385148-639f-4f89-8bdc-491d80fb2ac4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:15.921270 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a54dfd3-8bc6-4c4b-a6f2-5d36df4885e8 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:15.921940 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a54dfd3-8bc6-4c4b-a6f2-5d36df4885e8 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:15.922552 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a54dfd3-8bc6-4c4b-a6f2-5d36df4885e8 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:15.923547 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a54dfd3-8bc6-4c4b-a6f2-5d36df4885e8 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:15.924329 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a54dfd3-8bc6-4c4b-a6f2-5d36df4885e8 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:15.924845 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a54dfd3-8bc6-4c4b-a6f2-5d36df4885e8 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:16.004609 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4a54dfd3-8bc6-4c4b-a6f2-5d36df4885e8 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efb5f9eb544a4785908e9f35ce065a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5001c6dfc09f4b03b4d29836165eddc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:16.014432 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4a54dfd3-8bc6-4c4b-a6f2-5d36df4885e8 tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] 10.222.0.39 "GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4" status: 200 len: 1465 microversion: 2.1 time: 0.104657 Aug 07 01:52:16.035023 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3138/5814] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:15 2022] GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4 => generated 1465 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:16.060248 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-162171ed-8efe-4701-96d5-00586a8320ee req-c6c0d19e-06e3-49fa-a7b2-3edae8a12d5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f385148-639f-4f89-8bdc-491d80fb2ac4", "name": "network-vif-deleted", "tag": "ffe06532-72dd-4c10-81ba-d643292f6dc7"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:52:16.071457 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-162171ed-8efe-4701-96d5-00586a8320ee req-c6c0d19e-06e3-49fa-a7b2-3edae8a12d5a service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:16.071991 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-162171ed-8efe-4701-96d5-00586a8320ee req-c6c0d19e-06e3-49fa-a7b2-3edae8a12d5a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:16.072427 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-162171ed-8efe-4701-96d5-00586a8320ee req-c6c0d19e-06e3-49fa-a7b2-3edae8a12d5a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:16.085991 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-162171ed-8efe-4701-96d5-00586a8320ee req-c6c0d19e-06e3-49fa-a7b2-3edae8a12d5a service nova] Creating event network-vif-deleted:ffe06532-72dd-4c10-81ba-d643292f6dc7 for instance 6f385148-639f-4f89-8bdc-491d80fb2ac4 on n-h2-master-1 Aug 07 01:52:16.091692 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-162171ed-8efe-4701-96d5-00586a8320ee req-c6c0d19e-06e3-49fa-a7b2-3edae8a12d5a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040025 Aug 07 01:52:16.092335 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2677/5815] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:52:16.139187 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b025e48f-a07d-4841-a9f0-d31e69cce4f6 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:16.139798 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b025e48f-a07d-4841-a9f0-d31e69cce4f6 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] [instance: 6003ea94-8906-4657-85bd-999848adf23a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:16.146507 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b025e48f-a07d-4841-a9f0-d31e69cce4f6 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:16.146983 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b025e48f-a07d-4841-a9f0-d31e69cce4f6 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:16.147412 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b025e48f-a07d-4841-a9f0-d31e69cce4f6 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:16.148132 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b025e48f-a07d-4841-a9f0-d31e69cce4f6 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:16.148585 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b025e48f-a07d-4841-a9f0-d31e69cce4f6 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:16.149005 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b025e48f-a07d-4841-a9f0-d31e69cce4f6 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:16.292501 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b025e48f-a07d-4841-a9f0-d31e69cce4f6 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc27d58f027d4fc3b398f6c184911e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2650b8d88f4992a09bcf0048bcc4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:16.300693 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b025e48f-a07d-4841-a9f0-d31e69cce4f6 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] 10.222.0.39 "GET /compute/v2.1/servers/6003ea94-8906-4657-85bd-999848adf23a" status: 200 len: 1318 microversion: 2.1 time: 0.165858 Aug 07 01:52:16.301261 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3139/5816] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:16 2022] GET /compute/v2.1/servers/6003ea94-8906-4657-85bd-999848adf23a => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:16.414402 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0cc0138f-bd3d-4137-a2c5-870edbd9258b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:16.415113 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0cc0138f-bd3d-4137-a2c5-870edbd9258b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 12508600-0c8e-4fcf-82b6-95ff4879847d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:16.421873 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0cc0138f-bd3d-4137-a2c5-870edbd9258b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:16.422510 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0cc0138f-bd3d-4137-a2c5-870edbd9258b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:16.423227 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0cc0138f-bd3d-4137-a2c5-870edbd9258b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:16.424117 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0cc0138f-bd3d-4137-a2c5-870edbd9258b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:16.424589 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0cc0138f-bd3d-4137-a2c5-870edbd9258b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:16.425056 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0cc0138f-bd3d-4137-a2c5-870edbd9258b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:16.574638 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0cc0138f-bd3d-4137-a2c5-870edbd9258b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:16.583250 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0cc0138f-bd3d-4137-a2c5-870edbd9258b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d" status: 200 len: 1202 microversion: 2.1 time: 0.173182 Aug 07 01:52:16.584081 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2678/5817] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:16 2022] GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d => generated 1202 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:17.042573 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d8f7611d-1144-4a8b-868f-3f2a20c2fd2f tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:17.043457 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d8f7611d-1144-4a8b-868f-3f2a20c2fd2f tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] [instance: 6f385148-639f-4f89-8bdc-491d80fb2ac4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:17.051558 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d8f7611d-1144-4a8b-868f-3f2a20c2fd2f tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:17.052163 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d8f7611d-1144-4a8b-868f-3f2a20c2fd2f tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:17.052548 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d8f7611d-1144-4a8b-868f-3f2a20c2fd2f tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:17.053273 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d8f7611d-1144-4a8b-868f-3f2a20c2fd2f tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:17.053886 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d8f7611d-1144-4a8b-868f-3f2a20c2fd2f tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:17.054350 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d8f7611d-1144-4a8b-868f-3f2a20c2fd2f tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:17.077217 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-d8f7611d-1144-4a8b-868f-3f2a20c2fd2f tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] HTTP exception thrown: Instance 6f385148-639f-4f89-8bdc-491d80fb2ac4 could not be found. Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d8f7611d-1144-4a8b-868f-3f2a20c2fd2f tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Request method failure captured: Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4 HTTP/1.1 Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xq1VLXzG_usEyRytrC5HumG6MAU9oV6mOhZ0bawp2rs0xPUm7Kc7oxW9jDi9XZDYIgcOI3xC0Z34jmA5aG-cV-DpLISeoXL_sUkxfewe8E_5XlgFAmhOYQh-7E7W3hu6NgM18SfJzbXi_SyRhodCf0fbO57LCiRkfM9EQHkKAqJsZU Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 5001c6dfc09f4b03b4d29836165eddc1 Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-TestServerAdvancedOps-747139166 Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5001c6dfc09f4b03b4d29836165eddc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5001c6dfc09f4b03b4d29836165eddc1", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5001c6dfc09f4b03b4d29836165eddc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5001c6dfc09f4b03b4d29836165eddc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-TestServerAdvancedOps-747139166 Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 5001c6dfc09f4b03b4d29836165eddc1 Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-TestServerAdvancedOps-747139166 Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-TestServerAdvancedOps-747139166-project Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: efb5f9eb544a4785908e9f35ce065a37 Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-TestServerAdvancedOps-747139166-project Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 6f385148-639f-4f89-8bdc-491d80fb2ac4 could not be found. Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '6f385148-639f-4f89-8bdc-491d80fb2ac4'} Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f385148-639f-4f89-8bdc-491d80fb2ac4 could not be found. Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f385148-639f-4f89-8bdc-491d80fb2ac4 could not be found. Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:52:17.078910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:52:17.084728 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:52:17.084728 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:52:17.084728 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:52:17.084728 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:52:17.084728 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:52:17.084728 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f385148-639f-4f89-8bdc-491d80fb2ac4 could not be found. Aug 07 01:52:17.084728 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:52:17.084728 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d8f7611d-1144-4a8b-868f-3f2a20c2fd2f tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] Returning 404 to user: Instance 6f385148-639f-4f89-8bdc-491d80fb2ac4 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:52:17.084728 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d8f7611d-1144-4a8b-868f-3f2a20c2fd2f tempest-TestServerAdvancedOps-747139166 tempest-TestServerAdvancedOps-747139166-project] 10.222.0.39 "GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4" status: 404 len: 111 microversion: 2.1 time: 0.042215 Aug 07 01:52:17.084728 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3140/5818] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:17 2022] GET /compute/v2.1/servers/6f385148-639f-4f89-8bdc-491d80fb2ac4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:52:17.322207 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-537ee811-6b15-4439-8dba-a236c0489ef7 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:17.322820 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-537ee811-6b15-4439-8dba-a236c0489ef7 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] [instance: 6003ea94-8906-4657-85bd-999848adf23a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:17.331774 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-537ee811-6b15-4439-8dba-a236c0489ef7 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:17.332333 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-537ee811-6b15-4439-8dba-a236c0489ef7 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:17.333534 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-537ee811-6b15-4439-8dba-a236c0489ef7 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:17.334251 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-537ee811-6b15-4439-8dba-a236c0489ef7 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:17.336614 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-537ee811-6b15-4439-8dba-a236c0489ef7 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:17.336614 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-537ee811-6b15-4439-8dba-a236c0489ef7 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:17.486864 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-537ee811-6b15-4439-8dba-a236c0489ef7 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc27d58f027d4fc3b398f6c184911e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2650b8d88f4992a09bcf0048bcc4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:17.496612 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-537ee811-6b15-4439-8dba-a236c0489ef7 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] 10.222.0.39 "GET /compute/v2.1/servers/6003ea94-8906-4657-85bd-999848adf23a" status: 200 len: 1318 microversion: 2.1 time: 0.177824 Aug 07 01:52:17.498062 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2679/5819] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:17 2022] GET /compute/v2.1/servers/6003ea94-8906-4657-85bd-999848adf23a => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:17.603785 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-38baeaad-4a06-4736-a522-1ecdae1cc8ba tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:17.604542 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-38baeaad-4a06-4736-a522-1ecdae1cc8ba tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 12508600-0c8e-4fcf-82b6-95ff4879847d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:17.621617 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38baeaad-4a06-4736-a522-1ecdae1cc8ba tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:17.624090 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38baeaad-4a06-4736-a522-1ecdae1cc8ba tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:17.624653 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38baeaad-4a06-4736-a522-1ecdae1cc8ba tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:17.626038 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38baeaad-4a06-4736-a522-1ecdae1cc8ba tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:17.626869 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38baeaad-4a06-4736-a522-1ecdae1cc8ba tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:17.627997 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38baeaad-4a06-4736-a522-1ecdae1cc8ba tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:17.810750 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-38baeaad-4a06-4736-a522-1ecdae1cc8ba tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:17.813284 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:52:17.827390 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-38baeaad-4a06-4736-a522-1ecdae1cc8ba tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d" status: 200 len: 1202 microversion: 2.1 time: 0.227429 Aug 07 01:52:17.830924 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3141/5820] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:17 2022] GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d => generated 1202 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:18.518887 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d0d675d2-b274-4ce0-a2f2-2d8873b4e74e tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:18.520192 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d0d675d2-b274-4ce0-a2f2-2d8873b4e74e tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] [instance: 6003ea94-8906-4657-85bd-999848adf23a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:18.529473 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d0d675d2-b274-4ce0-a2f2-2d8873b4e74e tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:18.530469 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d0d675d2-b274-4ce0-a2f2-2d8873b4e74e tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:18.531109 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d0d675d2-b274-4ce0-a2f2-2d8873b4e74e tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:18.532100 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d0d675d2-b274-4ce0-a2f2-2d8873b4e74e tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:18.532794 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d0d675d2-b274-4ce0-a2f2-2d8873b4e74e tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:18.533408 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d0d675d2-b274-4ce0-a2f2-2d8873b4e74e tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:18.806285 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d0d675d2-b274-4ce0-a2f2-2d8873b4e74e tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc27d58f027d4fc3b398f6c184911e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2650b8d88f4992a09bcf0048bcc4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:18.815489 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d0d675d2-b274-4ce0-a2f2-2d8873b4e74e tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] 10.222.0.39 "GET /compute/v2.1/servers/6003ea94-8906-4657-85bd-999848adf23a" status: 200 len: 1318 microversion: 2.1 time: 0.300063 Aug 07 01:52:18.830608 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2680/5821] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:18 2022] GET /compute/v2.1/servers/6003ea94-8906-4657-85bd-999848adf23a => generated 1318 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:18.852762 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-be532b77-a192-43eb-91fa-935a7f5b0c11 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:18.854221 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-be532b77-a192-43eb-91fa-935a7f5b0c11 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 12508600-0c8e-4fcf-82b6-95ff4879847d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:18.864142 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-be532b77-a192-43eb-91fa-935a7f5b0c11 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:18.864882 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-be532b77-a192-43eb-91fa-935a7f5b0c11 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:18.866136 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-be532b77-a192-43eb-91fa-935a7f5b0c11 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:18.867070 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-be532b77-a192-43eb-91fa-935a7f5b0c11 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:18.867726 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-be532b77-a192-43eb-91fa-935a7f5b0c11 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:18.868384 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-be532b77-a192-43eb-91fa-935a7f5b0c11 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:19.100666 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-be532b77-a192-43eb-91fa-935a7f5b0c11 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:19.112084 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-be532b77-a192-43eb-91fa-935a7f5b0c11 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d" status: 200 len: 1202 microversion: 2.1 time: 0.263318 Aug 07 01:52:19.115961 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3142/5822] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:18 2022] GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d => generated 1202 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:19.842215 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-330a773b-e919-40f9-b9bc-2fabb60447d1 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:19.843055 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-330a773b-e919-40f9-b9bc-2fabb60447d1 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] [instance: 6003ea94-8906-4657-85bd-999848adf23a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:19.854824 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-330a773b-e919-40f9-b9bc-2fabb60447d1 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:19.855471 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-330a773b-e919-40f9-b9bc-2fabb60447d1 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:19.856793 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-330a773b-e919-40f9-b9bc-2fabb60447d1 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:19.862916 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-330a773b-e919-40f9-b9bc-2fabb60447d1 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:19.864638 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-330a773b-e919-40f9-b9bc-2fabb60447d1 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:19.865506 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-330a773b-e919-40f9-b9bc-2fabb60447d1 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:20.135021 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-576cac9b-a129-42bf-a472-2e338327933b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:20.135747 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-576cac9b-a129-42bf-a472-2e338327933b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 12508600-0c8e-4fcf-82b6-95ff4879847d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:20.150624 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-576cac9b-a129-42bf-a472-2e338327933b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:20.153816 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-576cac9b-a129-42bf-a472-2e338327933b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:20.155670 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-576cac9b-a129-42bf-a472-2e338327933b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:20.157735 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-576cac9b-a129-42bf-a472-2e338327933b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:20.160140 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-576cac9b-a129-42bf-a472-2e338327933b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:20.160887 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-576cac9b-a129-42bf-a472-2e338327933b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:20.180364 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-330a773b-e919-40f9-b9bc-2fabb60447d1 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc27d58f027d4fc3b398f6c184911e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2650b8d88f4992a09bcf0048bcc4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:20.198755 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-330a773b-e919-40f9-b9bc-2fabb60447d1 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] 10.222.0.39 "GET /compute/v2.1/servers/6003ea94-8906-4657-85bd-999848adf23a" status: 200 len: 1318 microversion: 2.1 time: 0.362846 Aug 07 01:52:20.200680 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2681/5823] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:19 2022] GET /compute/v2.1/servers/6003ea94-8906-4657-85bd-999848adf23a => generated 1318 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:20.206625 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9103c973-3adc-426b-a266-525480e13e8e tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Action: 'create', calling method: .version_select at 0x7f9e29a48280>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1145022111", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHEJMaKP7Wmc3VKoEnDMg22JQphvsejj0rsX+E9dCTg6ouy06kq2GbaFo5QbTIyor03ZvBRwsqdOU3yQqZnevIFLfqTWRo4s9rDMvCJZZXoI/fwm19vFuukSfk8bpTZbnA=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:52:20.234210 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-9103c973-3adc-426b-a266-525480e13e8e tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Getting quotas for project 2bd8662019804060a7b712456d095ad2. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:52:20.245805 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-9103c973-3adc-426b-a266-525480e13e8e tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Getting quotas for user 073f0cff787a466a9fbf9fb43b03b726 and project 2bd8662019804060a7b712456d095ad2. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:52:20.344624 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9103c973-3adc-426b-a266-525480e13e8e tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.140999 Aug 07 01:52:20.352142 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2682/5824] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:52:20 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:52:20.472948 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-576cac9b-a129-42bf-a472-2e338327933b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:20.482349 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-576cac9b-a129-42bf-a472-2e338327933b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d" status: 200 len: 1202 microversion: 2.1 time: 0.352213 Aug 07 01:52:20.485621 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3143/5825] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:20 2022] GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d => generated 1202 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:21.234018 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4bd3137b-c3bb-4670-ab73-89a38a1d07a0 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:21.235152 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4bd3137b-c3bb-4670-ab73-89a38a1d07a0 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] [instance: 6003ea94-8906-4657-85bd-999848adf23a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:21.249086 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4bd3137b-c3bb-4670-ab73-89a38a1d07a0 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:21.249591 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4bd3137b-c3bb-4670-ab73-89a38a1d07a0 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:21.250031 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4bd3137b-c3bb-4670-ab73-89a38a1d07a0 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:21.251163 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4bd3137b-c3bb-4670-ab73-89a38a1d07a0 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:21.251790 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4bd3137b-c3bb-4670-ab73-89a38a1d07a0 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:21.252941 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4bd3137b-c3bb-4670-ab73-89a38a1d07a0 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:21.504255 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4bd3137b-c3bb-4670-ab73-89a38a1d07a0 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc27d58f027d4fc3b398f6c184911e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2650b8d88f4992a09bcf0048bcc4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:21.504514 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b4b48eaa-65ca-4377-a356-f8b3f6c07f02 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:21.505281 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b4b48eaa-65ca-4377-a356-f8b3f6c07f02 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 12508600-0c8e-4fcf-82b6-95ff4879847d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:21.507650 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=4 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:52:21.508935 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=16 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:52:21.520146 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4b48eaa-65ca-4377-a356-f8b3f6c07f02 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:21.520665 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4b48eaa-65ca-4377-a356-f8b3f6c07f02 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:21.521095 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4b48eaa-65ca-4377-a356-f8b3f6c07f02 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:21.521817 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4b48eaa-65ca-4377-a356-f8b3f6c07f02 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:21.522279 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4b48eaa-65ca-4377-a356-f8b3f6c07f02 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:21.522714 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4b48eaa-65ca-4377-a356-f8b3f6c07f02 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:21.524860 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4bd3137b-c3bb-4670-ab73-89a38a1d07a0 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] 10.222.0.39 "GET /compute/v2.1/servers/6003ea94-8906-4657-85bd-999848adf23a" status: 200 len: 1318 microversion: 2.1 time: 0.295984 Aug 07 01:52:21.537529 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2683/5826] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:21 2022] GET /compute/v2.1/servers/6003ea94-8906-4657-85bd-999848adf23a => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:52:21.742328 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b4b48eaa-65ca-4377-a356-f8b3f6c07f02 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:21.754975 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b4b48eaa-65ca-4377-a356-f8b3f6c07f02 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d" status: 200 len: 1202 microversion: 2.1 time: 0.251557 Aug 07 01:52:21.757180 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3144/5827] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:21 2022] GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d => generated 1202 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:21.847216 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-ff877261-6104-4c1e-a32c-9537f7c6a562 req-f6cd0450-e184-4a88-947a-2315f18dc5b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6003ea94-8906-4657-85bd-999848adf23a", "name": "network-vif-plugged", "status": "completed", "tag": "9126c914-b893-40d5-9dcf-99c991799c8f"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:52:21.872524 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-ff877261-6104-4c1e-a32c-9537f7c6a562 req-f6cd0450-e184-4a88-947a-2315f18dc5b2 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:21.873789 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-ff877261-6104-4c1e-a32c-9537f7c6a562 req-f6cd0450-e184-4a88-947a-2315f18dc5b2 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:21.874957 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-ff877261-6104-4c1e-a32c-9537f7c6a562 req-f6cd0450-e184-4a88-947a-2315f18dc5b2 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:21.902352 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-ff877261-6104-4c1e-a32c-9537f7c6a562 req-f6cd0450-e184-4a88-947a-2315f18dc5b2 service nova] Creating event network-vif-plugged:9126c914-b893-40d5-9dcf-99c991799c8f for instance 6003ea94-8906-4657-85bd-999848adf23a on n-h1-master-1 Aug 07 01:52:21.920630 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-ff877261-6104-4c1e-a32c-9537f7c6a562 req-f6cd0450-e184-4a88-947a-2315f18dc5b2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074219 Aug 07 01:52:21.921494 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2684/5828] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:52:21.925603 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-239964e7-c6e1-4761-9d21-6f7817634847 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-228396776", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "16b122aa-5f0b-44f0-ad52-94a92c8360f1"}], "key_name": "tempest-TestNetworkBasicOps-1145022111", "security_groups": [{"name": "tempest-secgroup-smoke-662826290"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:52:22.156152 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-239964e7-c6e1-4761-9d21-6f7817634847 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] validate_networks() for [('16b122aa-5f0b-44f0-ad52-94a92c8360f1', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:52:22.550710 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3d86ce8f-999f-4f52-92de-d972665df19c tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:22.552600 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3d86ce8f-999f-4f52-92de-d972665df19c tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] [instance: 6003ea94-8906-4657-85bd-999848adf23a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:22.561122 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3d86ce8f-999f-4f52-92de-d972665df19c tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:22.562309 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3d86ce8f-999f-4f52-92de-d972665df19c tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:22.562774 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3d86ce8f-999f-4f52-92de-d972665df19c tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:22.564004 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3d86ce8f-999f-4f52-92de-d972665df19c tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:22.565042 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3d86ce8f-999f-4f52-92de-d972665df19c tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:22.565484 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3d86ce8f-999f-4f52-92de-d972665df19c tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:22.649749 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-239964e7-c6e1-4761-9d21-6f7817634847 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:52:22.650259 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-239964e7-c6e1-4761-9d21-6f7817634847 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:52:22.650641 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-239964e7-c6e1-4761-9d21-6f7817634847 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:52:22.651062 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-239964e7-c6e1-4761-9d21-6f7817634847 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:52:22.651476 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-239964e7-c6e1-4761-9d21-6f7817634847 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:52:22.663657 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-239964e7-c6e1-4761-9d21-6f7817634847 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:22.664478 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-239964e7-c6e1-4761-9d21-6f7817634847 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:22.665135 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-239964e7-c6e1-4761-9d21-6f7817634847 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:22.666079 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-239964e7-c6e1-4761-9d21-6f7817634847 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:22.666754 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-239964e7-c6e1-4761-9d21-6f7817634847 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:22.667376 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-239964e7-c6e1-4761-9d21-6f7817634847 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:22.706444 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-239964e7-c6e1-4761-9d21-6f7817634847 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Getting quotas for project 2bd8662019804060a7b712456d095ad2. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:52:22.717714 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-239964e7-c6e1-4761-9d21-6f7817634847 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Getting quotas for user 073f0cff787a466a9fbf9fb43b03b726 and project 2bd8662019804060a7b712456d095ad2. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:52:22.746022 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3d86ce8f-999f-4f52-92de-d972665df19c tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc27d58f027d4fc3b398f6c184911e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2650b8d88f4992a09bcf0048bcc4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:22.746767 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-239964e7-c6e1-4761-9d21-6f7817634847 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:52:22.749003 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-239964e7-c6e1-4761-9d21-6f7817634847 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: b87160d2-fb11-43b6-8a65-bc703d4dcdc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:52:22.767828 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3d86ce8f-999f-4f52-92de-d972665df19c tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] 10.222.0.39 "GET /compute/v2.1/servers/6003ea94-8906-4657-85bd-999848adf23a" status: 200 len: 1318 microversion: 2.1 time: 0.222122 Aug 07 01:52:22.779918 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2685/5829] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:22 2022] GET /compute/v2.1/servers/6003ea94-8906-4657-85bd-999848adf23a => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:52:22.780345 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:52:22.780451 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e9bc4df7-f962-4110-a28c-74aaf883a4c5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:22.780451 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e9bc4df7-f962-4110-a28c-74aaf883a4c5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 12508600-0c8e-4fcf-82b6-95ff4879847d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:22.797194 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9bc4df7-f962-4110-a28c-74aaf883a4c5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:22.797689 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9bc4df7-f962-4110-a28c-74aaf883a4c5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:22.800293 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9bc4df7-f962-4110-a28c-74aaf883a4c5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:22.801026 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9bc4df7-f962-4110-a28c-74aaf883a4c5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:22.801487 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9bc4df7-f962-4110-a28c-74aaf883a4c5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:22.802255 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9bc4df7-f962-4110-a28c-74aaf883a4c5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:22.837267 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-239964e7-c6e1-4761-9d21-6f7817634847 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.916224 Aug 07 01:52:22.838307 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3145/5830] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:52:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:52:22.849835 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-adc2d294-281c-4a79-a89f-556a9a842423 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:22.850466 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-adc2d294-281c-4a79-a89f-556a9a842423 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: b87160d2-fb11-43b6-8a65-bc703d4dcdc7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:22.920108 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-adc2d294-281c-4a79-a89f-556a9a842423 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:22.927562 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-adc2d294-281c-4a79-a89f-556a9a842423 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/b87160d2-fb11-43b6-8a65-bc703d4dcdc7" status: 200 len: 1248 microversion: 2.1 time: 0.081578 Aug 07 01:52:22.956252 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3146/5831] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:22 2022] GET /compute/v2.1/servers/b87160d2-fb11-43b6-8a65-bc703d4dcdc7 => generated 1248 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:52:23.042927 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e9bc4df7-f962-4110-a28c-74aaf883a4c5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:23.052568 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e9bc4df7-f962-4110-a28c-74aaf883a4c5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d" status: 200 len: 1202 microversion: 2.1 time: 0.280313 Aug 07 01:52:23.053179 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2686/5832] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:22 2022] GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d => generated 1202 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:23.796031 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cd578378-de85-4459-b7df-62ac3f4c77fb tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:23.797476 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cd578378-de85-4459-b7df-62ac3f4c77fb tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] [instance: 6003ea94-8906-4657-85bd-999848adf23a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:23.807259 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd578378-de85-4459-b7df-62ac3f4c77fb tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:23.807754 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd578378-de85-4459-b7df-62ac3f4c77fb tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:23.808331 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd578378-de85-4459-b7df-62ac3f4c77fb tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:23.808934 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd578378-de85-4459-b7df-62ac3f4c77fb tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:23.809418 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd578378-de85-4459-b7df-62ac3f4c77fb tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:23.809843 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd578378-de85-4459-b7df-62ac3f4c77fb tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:23.955124 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a19d0d3d-00ec-41cf-a754-e89551337348 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:23.957416 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a19d0d3d-00ec-41cf-a754-e89551337348 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: b87160d2-fb11-43b6-8a65-bc703d4dcdc7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:23.966846 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a19d0d3d-00ec-41cf-a754-e89551337348 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:23.967988 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cd578378-de85-4459-b7df-62ac3f4c77fb tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc27d58f027d4fc3b398f6c184911e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2650b8d88f4992a09bcf0048bcc4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:23.972659 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a19d0d3d-00ec-41cf-a754-e89551337348 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:23.973787 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a19d0d3d-00ec-41cf-a754-e89551337348 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:23.975115 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a19d0d3d-00ec-41cf-a754-e89551337348 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:23.975920 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a19d0d3d-00ec-41cf-a754-e89551337348 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:23.977132 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cd578378-de85-4459-b7df-62ac3f4c77fb tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] 10.222.0.39 "GET /compute/v2.1/servers/6003ea94-8906-4657-85bd-999848adf23a" status: 200 len: 1506 microversion: 2.1 time: 0.186431 Aug 07 01:52:23.977858 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a19d0d3d-00ec-41cf-a754-e89551337348 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:23.988521 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3147/5833] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:23 2022] GET /compute/v2.1/servers/6003ea94-8906-4657-85bd-999848adf23a => generated 1506 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:24.074099 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-83d7fc45-8630-45bf-9526-c626180725cf tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:24.075610 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-83d7fc45-8630-45bf-9526-c626180725cf tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 12508600-0c8e-4fcf-82b6-95ff4879847d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:24.087623 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83d7fc45-8630-45bf-9526-c626180725cf tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:24.088266 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83d7fc45-8630-45bf-9526-c626180725cf tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:24.088990 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83d7fc45-8630-45bf-9526-c626180725cf tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:24.092220 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83d7fc45-8630-45bf-9526-c626180725cf tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:24.092997 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83d7fc45-8630-45bf-9526-c626180725cf tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:24.096466 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83d7fc45-8630-45bf-9526-c626180725cf tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:24.198067 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a19d0d3d-00ec-41cf-a754-e89551337348 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:24.221200 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a19d0d3d-00ec-41cf-a754-e89551337348 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/b87160d2-fb11-43b6-8a65-bc703d4dcdc7" status: 200 len: 1308 microversion: 2.1 time: 0.272410 Aug 07 01:52:24.228471 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2687/5834] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:23 2022] GET /compute/v2.1/servers/b87160d2-fb11-43b6-8a65-bc703d4dcdc7 => generated 1308 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:24.243773 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-5bab5ed3-3424-4deb-8756-3df4f902ac61 req-f3bbbf9d-3e39-46f5-930b-c1b8f6e68ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12508600-0c8e-4fcf-82b6-95ff4879847d", "name": "network-vif-plugged", "status": "completed", "tag": "7e936417-6952-4a64-933b-de424c514d29"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:52:24.259533 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-5bab5ed3-3424-4deb-8756-3df4f902ac61 req-f3bbbf9d-3e39-46f5-930b-c1b8f6e68ad9 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:24.263334 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-5bab5ed3-3424-4deb-8756-3df4f902ac61 req-f3bbbf9d-3e39-46f5-930b-c1b8f6e68ad9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:24.263795 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-5bab5ed3-3424-4deb-8756-3df4f902ac61 req-f3bbbf9d-3e39-46f5-930b-c1b8f6e68ad9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:24.299564 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-5bab5ed3-3424-4deb-8756-3df4f902ac61 req-f3bbbf9d-3e39-46f5-930b-c1b8f6e68ad9 service nova] Creating event network-vif-plugged:7e936417-6952-4a64-933b-de424c514d29 for instance 12508600-0c8e-4fcf-82b6-95ff4879847d on n-h1-master-1 Aug 07 01:52:24.315480 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-5bab5ed3-3424-4deb-8756-3df4f902ac61 req-f3bbbf9d-3e39-46f5-930b-c1b8f6e68ad9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085275 Aug 07 01:52:24.316577 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2688/5835] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:52:24.375514 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-83d7fc45-8630-45bf-9526-c626180725cf tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:24.390067 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-83d7fc45-8630-45bf-9526-c626180725cf tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d" status: 200 len: 1202 microversion: 2.1 time: 0.319869 Aug 07 01:52:24.390791 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3148/5836] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:24 2022] GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d => generated 1202 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:25.253542 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1e31f702-6701-4fc1-b285-825ee0655188 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:25.254606 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1e31f702-6701-4fc1-b285-825ee0655188 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: b87160d2-fb11-43b6-8a65-bc703d4dcdc7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:25.262279 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e31f702-6701-4fc1-b285-825ee0655188 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:25.263031 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e31f702-6701-4fc1-b285-825ee0655188 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:25.263494 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e31f702-6701-4fc1-b285-825ee0655188 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:25.264508 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e31f702-6701-4fc1-b285-825ee0655188 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:25.264983 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e31f702-6701-4fc1-b285-825ee0655188 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:25.265421 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e31f702-6701-4fc1-b285-825ee0655188 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:25.411830 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bb74c59f-15d7-435a-ad8f-0e93b41114cc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:25.413107 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bb74c59f-15d7-435a-ad8f-0e93b41114cc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 12508600-0c8e-4fcf-82b6-95ff4879847d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:25.421883 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb74c59f-15d7-435a-ad8f-0e93b41114cc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:25.422655 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb74c59f-15d7-435a-ad8f-0e93b41114cc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:25.423287 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb74c59f-15d7-435a-ad8f-0e93b41114cc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:25.424218 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb74c59f-15d7-435a-ad8f-0e93b41114cc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:25.424856 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb74c59f-15d7-435a-ad8f-0e93b41114cc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:25.425545 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb74c59f-15d7-435a-ad8f-0e93b41114cc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:25.555051 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1e31f702-6701-4fc1-b285-825ee0655188 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:25.565146 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1e31f702-6701-4fc1-b285-825ee0655188 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/b87160d2-fb11-43b6-8a65-bc703d4dcdc7" status: 200 len: 1373 microversion: 2.1 time: 0.317877 Aug 07 01:52:25.570762 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2689/5837] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:25 2022] GET /compute/v2.1/servers/b87160d2-fb11-43b6-8a65-bc703d4dcdc7 => generated 1373 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:25.618933 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bb74c59f-15d7-435a-ad8f-0e93b41114cc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:25.632881 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bb74c59f-15d7-435a-ad8f-0e93b41114cc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d" status: 200 len: 1202 microversion: 2.1 time: 0.225806 Aug 07 01:52:25.634359 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3149/5838] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:25 2022] GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d => generated 1202 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:52:26.077804 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-60e491aa-9295-463e-893e-335d36eeaae1 req-76b840c6-a6f1-4257-9699-1c8bbb581e82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b87160d2-fb11-43b6-8a65-bc703d4dcdc7", "tag": "f0024b02-6b33-46b6-8693-07011c9442a3"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:52:26.092035 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-60e491aa-9295-463e-893e-335d36eeaae1 req-76b840c6-a6f1-4257-9699-1c8bbb581e82 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:26.092921 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-60e491aa-9295-463e-893e-335d36eeaae1 req-76b840c6-a6f1-4257-9699-1c8bbb581e82 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:26.093588 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-60e491aa-9295-463e-893e-335d36eeaae1 req-76b840c6-a6f1-4257-9699-1c8bbb581e82 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:26.107008 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-60e491aa-9295-463e-893e-335d36eeaae1 req-76b840c6-a6f1-4257-9699-1c8bbb581e82 service nova] Creating event network-changed:f0024b02-6b33-46b6-8693-07011c9442a3 for instance b87160d2-fb11-43b6-8a65-bc703d4dcdc7 on n-h2-master-1 Aug 07 01:52:26.112920 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-60e491aa-9295-463e-893e-335d36eeaae1 req-76b840c6-a6f1-4257-9699-1c8bbb581e82 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039324 Aug 07 01:52:26.114033 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2690/5839] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:52:26.596918 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-26309765-8a9c-4827-b3f3-d8b3d39cc3e4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:26.597546 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-26309765-8a9c-4827-b3f3-d8b3d39cc3e4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: b87160d2-fb11-43b6-8a65-bc703d4dcdc7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:26.608272 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-26309765-8a9c-4827-b3f3-d8b3d39cc3e4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:26.609104 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-26309765-8a9c-4827-b3f3-d8b3d39cc3e4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:26.609902 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-26309765-8a9c-4827-b3f3-d8b3d39cc3e4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:26.610908 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-26309765-8a9c-4827-b3f3-d8b3d39cc3e4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:26.611456 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-26309765-8a9c-4827-b3f3-d8b3d39cc3e4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:26.611937 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-26309765-8a9c-4827-b3f3-d8b3d39cc3e4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:26.661739 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b55aecb9-0727-49d8-a419-995cd1d83339 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:26.662726 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b55aecb9-0727-49d8-a419-995cd1d83339 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 12508600-0c8e-4fcf-82b6-95ff4879847d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:26.673854 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b55aecb9-0727-49d8-a419-995cd1d83339 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:26.674414 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b55aecb9-0727-49d8-a419-995cd1d83339 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:26.674924 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b55aecb9-0727-49d8-a419-995cd1d83339 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:26.675703 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b55aecb9-0727-49d8-a419-995cd1d83339 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:26.677177 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b55aecb9-0727-49d8-a419-995cd1d83339 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:26.677636 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b55aecb9-0727-49d8-a419-995cd1d83339 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:26.770259 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-26309765-8a9c-4827-b3f3-d8b3d39cc3e4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:26.779448 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-26309765-8a9c-4827-b3f3-d8b3d39cc3e4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/b87160d2-fb11-43b6-8a65-bc703d4dcdc7" status: 200 len: 1373 microversion: 2.1 time: 0.192526 Aug 07 01:52:26.784905 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3150/5840] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:26 2022] GET /compute/v2.1/servers/b87160d2-fb11-43b6-8a65-bc703d4dcdc7 => generated 1373 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:26.834352 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b55aecb9-0727-49d8-a419-995cd1d83339 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:26.842722 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b55aecb9-0727-49d8-a419-995cd1d83339 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d" status: 200 len: 1389 microversion: 2.1 time: 0.192131 Aug 07 01:52:26.843301 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2691/5841] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:26 2022] GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d => generated 1389 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:26.863142 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ea0dd011-783c-43fc-a424-c6071771fef7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:26.863753 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ea0dd011-783c-43fc-a424-c6071771fef7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 12508600-0c8e-4fcf-82b6-95ff4879847d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:26.869976 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea0dd011-783c-43fc-a424-c6071771fef7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:26.870685 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea0dd011-783c-43fc-a424-c6071771fef7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:26.871128 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea0dd011-783c-43fc-a424-c6071771fef7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:26.872764 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea0dd011-783c-43fc-a424-c6071771fef7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:26.873466 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea0dd011-783c-43fc-a424-c6071771fef7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:26.873840 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea0dd011-783c-43fc-a424-c6071771fef7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:27.028918 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ea0dd011-783c-43fc-a424-c6071771fef7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:27.037738 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ea0dd011-783c-43fc-a424-c6071771fef7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d" status: 200 len: 1389 microversion: 2.1 time: 0.178481 Aug 07 01:52:27.038316 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3151/5842] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:26 2022] GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d => generated 1389 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:27.059554 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1f6fbf7c-e363-4ad2-b14a-7891289fc2f0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:27.060201 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1f6fbf7c-e363-4ad2-b14a-7891289fc2f0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 12508600-0c8e-4fcf-82b6-95ff4879847d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:27.066380 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1f6fbf7c-e363-4ad2-b14a-7891289fc2f0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:27.067506 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1f6fbf7c-e363-4ad2-b14a-7891289fc2f0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:27.068213 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1f6fbf7c-e363-4ad2-b14a-7891289fc2f0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:27.069831 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1f6fbf7c-e363-4ad2-b14a-7891289fc2f0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:27.071045 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1f6fbf7c-e363-4ad2-b14a-7891289fc2f0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:27.072492 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1f6fbf7c-e363-4ad2-b14a-7891289fc2f0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:27.076296 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:52:27.220946 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1f6fbf7c-e363-4ad2-b14a-7891289fc2f0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:27.229900 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1f6fbf7c-e363-4ad2-b14a-7891289fc2f0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d" status: 200 len: 1389 microversion: 2.1 time: 0.176050 Aug 07 01:52:27.231177 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2692/5843] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:27 2022] GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d => generated 1389 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:27.253757 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b0eb9c4d-3b6b-47e7-a6db-c718e2a9a588 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:27.254269 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b0eb9c4d-3b6b-47e7-a6db-c718e2a9a588 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 12508600-0c8e-4fcf-82b6-95ff4879847d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:27.264355 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b0eb9c4d-3b6b-47e7-a6db-c718e2a9a588 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:27.264851 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b0eb9c4d-3b6b-47e7-a6db-c718e2a9a588 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:27.265290 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b0eb9c4d-3b6b-47e7-a6db-c718e2a9a588 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:27.266056 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b0eb9c4d-3b6b-47e7-a6db-c718e2a9a588 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:27.266452 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b0eb9c4d-3b6b-47e7-a6db-c718e2a9a588 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:27.266882 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b0eb9c4d-3b6b-47e7-a6db-c718e2a9a588 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:27.296987 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b0eb9c4d-3b6b-47e7-a6db-c718e2a9a588 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 12508600-0c8e-4fcf-82b6-95ff4879847d] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:52:27.395339 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b0eb9c4d-3b6b-47e7-a6db-c718e2a9a588 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "DELETE /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d" status: 204 len: 0 microversion: 2.1 time: 0.148654 Aug 07 01:52:27.400214 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3152/5844] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:52:27 2022] DELETE /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:52:27.404907 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0ac58a50-4b42-4851-8ccf-b02b9ca12052 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:27.405558 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0ac58a50-4b42-4851-8ccf-b02b9ca12052 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 12508600-0c8e-4fcf-82b6-95ff4879847d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:27.411781 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ac58a50-4b42-4851-8ccf-b02b9ca12052 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:27.412498 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ac58a50-4b42-4851-8ccf-b02b9ca12052 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:27.413139 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ac58a50-4b42-4851-8ccf-b02b9ca12052 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:27.413876 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ac58a50-4b42-4851-8ccf-b02b9ca12052 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:27.414333 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ac58a50-4b42-4851-8ccf-b02b9ca12052 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:27.414975 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ac58a50-4b42-4851-8ccf-b02b9ca12052 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:27.641828 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0ac58a50-4b42-4851-8ccf-b02b9ca12052 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:27.649892 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0ac58a50-4b42-4851-8ccf-b02b9ca12052 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d" status: 200 len: 1395 microversion: 2.1 time: 0.249127 Aug 07 01:52:27.651102 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2693/5845] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:27 2022] GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d => generated 1395 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:27.806219 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3c09878c-40ef-4a26-9f7f-0ded919f0f24 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:27.808404 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3c09878c-40ef-4a26-9f7f-0ded919f0f24 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: b87160d2-fb11-43b6-8a65-bc703d4dcdc7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:27.819249 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c09878c-40ef-4a26-9f7f-0ded919f0f24 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:27.820517 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c09878c-40ef-4a26-9f7f-0ded919f0f24 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:27.821424 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c09878c-40ef-4a26-9f7f-0ded919f0f24 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:27.822632 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c09878c-40ef-4a26-9f7f-0ded919f0f24 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:27.823641 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c09878c-40ef-4a26-9f7f-0ded919f0f24 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:27.824324 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c09878c-40ef-4a26-9f7f-0ded919f0f24 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:28.063436 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3c09878c-40ef-4a26-9f7f-0ded919f0f24 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:28.072093 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3c09878c-40ef-4a26-9f7f-0ded919f0f24 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/b87160d2-fb11-43b6-8a65-bc703d4dcdc7" status: 200 len: 1373 microversion: 2.1 time: 0.270848 Aug 07 01:52:28.073015 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3153/5846] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:27 2022] GET /compute/v2.1/servers/b87160d2-fb11-43b6-8a65-bc703d4dcdc7 => generated 1373 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:28.673530 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b02bbe8a-05a5-4f7f-8512-632c4f8e5189 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:28.674082 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b02bbe8a-05a5-4f7f-8512-632c4f8e5189 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 12508600-0c8e-4fcf-82b6-95ff4879847d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:28.681037 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b02bbe8a-05a5-4f7f-8512-632c4f8e5189 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:28.681758 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b02bbe8a-05a5-4f7f-8512-632c4f8e5189 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:28.682836 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b02bbe8a-05a5-4f7f-8512-632c4f8e5189 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:28.690464 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b02bbe8a-05a5-4f7f-8512-632c4f8e5189 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:28.691533 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b02bbe8a-05a5-4f7f-8512-632c4f8e5189 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:28.692633 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b02bbe8a-05a5-4f7f-8512-632c4f8e5189 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:28.859148 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b02bbe8a-05a5-4f7f-8512-632c4f8e5189 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:28.867059 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b02bbe8a-05a5-4f7f-8512-632c4f8e5189 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d" status: 200 len: 1395 microversion: 2.1 time: 0.198592 Aug 07 01:52:28.867847 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2694/5847] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:28 2022] GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d => generated 1395 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:29.093689 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4d72e0fa-b4c9-4c8e-978f-060cbb526643 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:29.095011 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4d72e0fa-b4c9-4c8e-978f-060cbb526643 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: b87160d2-fb11-43b6-8a65-bc703d4dcdc7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:29.118494 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d72e0fa-b4c9-4c8e-978f-060cbb526643 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:29.119241 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d72e0fa-b4c9-4c8e-978f-060cbb526643 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:29.119679 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d72e0fa-b4c9-4c8e-978f-060cbb526643 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:29.120411 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d72e0fa-b4c9-4c8e-978f-060cbb526643 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:29.120862 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d72e0fa-b4c9-4c8e-978f-060cbb526643 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:29.132620 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4d72e0fa-b4c9-4c8e-978f-060cbb526643 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:29.382561 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4d72e0fa-b4c9-4c8e-978f-060cbb526643 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:29.392002 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4d72e0fa-b4c9-4c8e-978f-060cbb526643 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/b87160d2-fb11-43b6-8a65-bc703d4dcdc7" status: 200 len: 1373 microversion: 2.1 time: 0.302598 Aug 07 01:52:29.394069 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3154/5848] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:29 2022] GET /compute/v2.1/servers/b87160d2-fb11-43b6-8a65-bc703d4dcdc7 => generated 1373 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:29.709585 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-da532e3b-e101-4d6b-a0b9-af43894907bf req-de13724f-8bd5-4e14-a312-f868001cbe4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12508600-0c8e-4fcf-82b6-95ff4879847d", "name": "network-vif-deleted", "tag": "7e936417-6952-4a64-933b-de424c514d29"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:52:29.725972 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-da532e3b-e101-4d6b-a0b9-af43894907bf req-de13724f-8bd5-4e14-a312-f868001cbe4c service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:29.728663 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-da532e3b-e101-4d6b-a0b9-af43894907bf req-de13724f-8bd5-4e14-a312-f868001cbe4c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:29.729050 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-da532e3b-e101-4d6b-a0b9-af43894907bf req-de13724f-8bd5-4e14-a312-f868001cbe4c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:29.754825 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-da532e3b-e101-4d6b-a0b9-af43894907bf req-de13724f-8bd5-4e14-a312-f868001cbe4c service nova] Creating event network-vif-deleted:7e936417-6952-4a64-933b-de424c514d29 for instance 12508600-0c8e-4fcf-82b6-95ff4879847d on n-h1-master-1 Aug 07 01:52:29.762243 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-da532e3b-e101-4d6b-a0b9-af43894907bf req-de13724f-8bd5-4e14-a312-f868001cbe4c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055960 Aug 07 01:52:29.763758 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2695/5849] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:52:29.891042 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-eb6a5190-861a-4d44-a54a-0c783ceafcb9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:29.892004 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-eb6a5190-861a-4d44-a54a-0c783ceafcb9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 12508600-0c8e-4fcf-82b6-95ff4879847d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:29.903241 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb6a5190-861a-4d44-a54a-0c783ceafcb9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:29.922970 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb6a5190-861a-4d44-a54a-0c783ceafcb9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:29.923783 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb6a5190-861a-4d44-a54a-0c783ceafcb9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:29.924624 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb6a5190-861a-4d44-a54a-0c783ceafcb9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:29.927538 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb6a5190-861a-4d44-a54a-0c783ceafcb9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:29.946078 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb6a5190-861a-4d44-a54a-0c783ceafcb9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:30.026521 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-2a9c283a-d8e4-4c8c-8e29-c4c99baf19e8 req-b07b404a-4171-4644-8369-d078892ed427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b87160d2-fb11-43b6-8a65-bc703d4dcdc7", "name": "network-vif-plugged", "status": "completed", "tag": "f0024b02-6b33-46b6-8693-07011c9442a3"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:52:30.047219 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-2a9c283a-d8e4-4c8c-8e29-c4c99baf19e8 req-b07b404a-4171-4644-8369-d078892ed427 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:30.048292 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-2a9c283a-d8e4-4c8c-8e29-c4c99baf19e8 req-b07b404a-4171-4644-8369-d078892ed427 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:30.049487 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-2a9c283a-d8e4-4c8c-8e29-c4c99baf19e8 req-b07b404a-4171-4644-8369-d078892ed427 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:30.074810 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-2a9c283a-d8e4-4c8c-8e29-c4c99baf19e8 req-b07b404a-4171-4644-8369-d078892ed427 service nova] Creating event network-vif-plugged:f0024b02-6b33-46b6-8693-07011c9442a3 for instance b87160d2-fb11-43b6-8a65-bc703d4dcdc7 on n-h2-master-1 Aug 07 01:52:30.074810 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-2a9c283a-d8e4-4c8c-8e29-c4c99baf19e8 req-b07b404a-4171-4644-8369-d078892ed427 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049833 Aug 07 01:52:30.074810 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2696/5850] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:52:30.080618 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-eb6a5190-861a-4d44-a54a-0c783ceafcb9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:30.089252 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-eb6a5190-861a-4d44-a54a-0c783ceafcb9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d" status: 200 len: 1187 microversion: 2.1 time: 0.202332 Aug 07 01:52:30.090203 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3155/5851] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:29 2022] GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d => generated 1187 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:52:30.412406 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:52:30.417944 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-54a68480-7567-43bc-a5dd-36dd9596f805 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:30.419976 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-54a68480-7567-43bc-a5dd-36dd9596f805 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: b87160d2-fb11-43b6-8a65-bc703d4dcdc7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:30.427169 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54a68480-7567-43bc-a5dd-36dd9596f805 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:30.427919 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54a68480-7567-43bc-a5dd-36dd9596f805 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:30.428644 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54a68480-7567-43bc-a5dd-36dd9596f805 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:30.429532 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54a68480-7567-43bc-a5dd-36dd9596f805 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:30.430354 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54a68480-7567-43bc-a5dd-36dd9596f805 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:30.430977 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-54a68480-7567-43bc-a5dd-36dd9596f805 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:30.647562 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-54a68480-7567-43bc-a5dd-36dd9596f805 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:30.659732 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-54a68480-7567-43bc-a5dd-36dd9596f805 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/b87160d2-fb11-43b6-8a65-bc703d4dcdc7" status: 200 len: 1373 microversion: 2.1 time: 0.248172 Aug 07 01:52:30.661112 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2697/5852] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:30 2022] GET /compute/v2.1/servers/b87160d2-fb11-43b6-8a65-bc703d4dcdc7 => generated 1373 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:31.111236 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8348b531-be31-4c9e-b8e5-eb4b4619c1f8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:31.111846 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8348b531-be31-4c9e-b8e5-eb4b4619c1f8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 12508600-0c8e-4fcf-82b6-95ff4879847d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:31.124890 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8348b531-be31-4c9e-b8e5-eb4b4619c1f8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:31.125381 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8348b531-be31-4c9e-b8e5-eb4b4619c1f8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:31.125828 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8348b531-be31-4c9e-b8e5-eb4b4619c1f8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:31.126545 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8348b531-be31-4c9e-b8e5-eb4b4619c1f8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:31.127007 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8348b531-be31-4c9e-b8e5-eb4b4619c1f8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:31.127443 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8348b531-be31-4c9e-b8e5-eb4b4619c1f8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:31.223947 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8348b531-be31-4c9e-b8e5-eb4b4619c1f8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:31.238046 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8348b531-be31-4c9e-b8e5-eb4b4619c1f8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d" status: 200 len: 1187 microversion: 2.1 time: 0.131279 Aug 07 01:52:31.238771 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3156/5853] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:31 2022] GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d => generated 1187 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:31.681025 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0952cc29-ca5c-40db-9432-6b48c1ea13b0 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:31.682259 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0952cc29-ca5c-40db-9432-6b48c1ea13b0 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: b87160d2-fb11-43b6-8a65-bc703d4dcdc7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:31.693569 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0952cc29-ca5c-40db-9432-6b48c1ea13b0 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:31.694309 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0952cc29-ca5c-40db-9432-6b48c1ea13b0 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:31.694922 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0952cc29-ca5c-40db-9432-6b48c1ea13b0 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:31.701016 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0952cc29-ca5c-40db-9432-6b48c1ea13b0 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:31.701769 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0952cc29-ca5c-40db-9432-6b48c1ea13b0 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:31.702378 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0952cc29-ca5c-40db-9432-6b48c1ea13b0 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:31.888851 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0952cc29-ca5c-40db-9432-6b48c1ea13b0 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:31.899135 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0952cc29-ca5c-40db-9432-6b48c1ea13b0 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/b87160d2-fb11-43b6-8a65-bc703d4dcdc7" status: 200 len: 1546 microversion: 2.1 time: 0.221742 Aug 07 01:52:31.914986 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2698/5854] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:31 2022] GET /compute/v2.1/servers/b87160d2-fb11-43b6-8a65-bc703d4dcdc7 => generated 1546 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:31.921106 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b9586bff-c375-4a66-8212-50fb1654eeec tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:31.921726 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b9586bff-c375-4a66-8212-50fb1654eeec tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: b87160d2-fb11-43b6-8a65-bc703d4dcdc7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:31.930038 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b9586bff-c375-4a66-8212-50fb1654eeec tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:31.930528 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b9586bff-c375-4a66-8212-50fb1654eeec tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:31.931095 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b9586bff-c375-4a66-8212-50fb1654eeec tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:31.931929 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b9586bff-c375-4a66-8212-50fb1654eeec tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:31.932596 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b9586bff-c375-4a66-8212-50fb1654eeec tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:31.933222 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b9586bff-c375-4a66-8212-50fb1654eeec tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:32.139434 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b9586bff-c375-4a66-8212-50fb1654eeec tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:32.147659 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b9586bff-c375-4a66-8212-50fb1654eeec tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/b87160d2-fb11-43b6-8a65-bc703d4dcdc7" status: 200 len: 1546 microversion: 2.1 time: 0.230946 Aug 07 01:52:32.159923 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3157/5855] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:31 2022] GET /compute/v2.1/servers/b87160d2-fb11-43b6-8a65-bc703d4dcdc7 => generated 1546 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:32.260325 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c805c449-37c7-4f77-a748-578fc46d4def tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:32.269177 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c805c449-37c7-4f77-a748-578fc46d4def tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 12508600-0c8e-4fcf-82b6-95ff4879847d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:32.275779 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c805c449-37c7-4f77-a748-578fc46d4def tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:32.276325 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c805c449-37c7-4f77-a748-578fc46d4def tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:32.276773 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c805c449-37c7-4f77-a748-578fc46d4def tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:32.277561 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c805c449-37c7-4f77-a748-578fc46d4def tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:32.278019 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c805c449-37c7-4f77-a748-578fc46d4def tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:32.278430 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c805c449-37c7-4f77-a748-578fc46d4def tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:32.359314 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c805c449-37c7-4f77-a748-578fc46d4def tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:32.368179 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c805c449-37c7-4f77-a748-578fc46d4def tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d" status: 200 len: 1187 microversion: 2.1 time: 0.111788 Aug 07 01:52:32.379710 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2699/5856] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:32 2022] GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d => generated 1187 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:33.390394 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a837bfe3-8025-4e6b-a50d-5a61122e09f2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:33.391018 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a837bfe3-8025-4e6b-a50d-5a61122e09f2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 12508600-0c8e-4fcf-82b6-95ff4879847d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:33.393042 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:52:33.393752 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=8 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:52:33.409653 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a837bfe3-8025-4e6b-a50d-5a61122e09f2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:33.410641 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a837bfe3-8025-4e6b-a50d-5a61122e09f2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:33.411422 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a837bfe3-8025-4e6b-a50d-5a61122e09f2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:33.412655 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a837bfe3-8025-4e6b-a50d-5a61122e09f2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:33.413543 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a837bfe3-8025-4e6b-a50d-5a61122e09f2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:33.414410 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a837bfe3-8025-4e6b-a50d-5a61122e09f2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:33.453937 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:52:33.520406 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a837bfe3-8025-4e6b-a50d-5a61122e09f2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:33.541395 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a837bfe3-8025-4e6b-a50d-5a61122e09f2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d" status: 200 len: 1187 microversion: 2.1 time: 0.153780 Aug 07 01:52:33.552701 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3158/5857] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:33 2022] GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d => generated 1187 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:34.568920 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d2f9e551-8c00-4e96-bfb4-f786ab1cd5a7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:34.568920 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d2f9e551-8c00-4e96-bfb4-f786ab1cd5a7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 12508600-0c8e-4fcf-82b6-95ff4879847d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:34.577419 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2f9e551-8c00-4e96-bfb4-f786ab1cd5a7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:34.577920 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2f9e551-8c00-4e96-bfb4-f786ab1cd5a7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:34.578365 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2f9e551-8c00-4e96-bfb4-f786ab1cd5a7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:34.579090 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2f9e551-8c00-4e96-bfb4-f786ab1cd5a7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:34.579552 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2f9e551-8c00-4e96-bfb4-f786ab1cd5a7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:34.580021 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d2f9e551-8c00-4e96-bfb4-f786ab1cd5a7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:34.655713 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d2f9e551-8c00-4e96-bfb4-f786ab1cd5a7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:34.664739 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d2f9e551-8c00-4e96-bfb4-f786ab1cd5a7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d" status: 200 len: 1187 microversion: 2.1 time: 0.104291 Aug 07 01:52:34.665329 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2700/5858] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:34 2022] GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d => generated 1187 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:52:35.686865 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a579b820-e756-4eac-8e02-b610c6db6034 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:35.687481 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a579b820-e756-4eac-8e02-b610c6db6034 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 12508600-0c8e-4fcf-82b6-95ff4879847d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:35.694602 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a579b820-e756-4eac-8e02-b610c6db6034 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:35.696013 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a579b820-e756-4eac-8e02-b610c6db6034 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:35.696890 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a579b820-e756-4eac-8e02-b610c6db6034 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:35.697775 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a579b820-e756-4eac-8e02-b610c6db6034 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:35.698395 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a579b820-e756-4eac-8e02-b610c6db6034 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:35.699610 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a579b820-e756-4eac-8e02-b610c6db6034 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:35.718228 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-a579b820-e756-4eac-8e02-b610c6db6034 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] HTTP exception thrown: Instance 12508600-0c8e-4fcf-82b6-95ff4879847d could not be found. Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a579b820-e756-4eac-8e02-b610c6db6034 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Request method failure captured: Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d HTTP/1.1 Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xp6rUdIsYnfs49nr8p-3tgit6VpNtF0E4NPSidukXDEQntBhlyx_gwU6AjnU2O7Q5BLuafO4z_ZO55y2txpq1OJeOibLbj_karsXsR0GpyTHp3BnitplkO9r1bHquRHPgg2Nq4jyNzT0obzTHzoVjdq8NdzVY4LztormmeY7retjUI Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: bf36f5153ba648008cdaceb9dc538e53 Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-TestVolumeBootPattern-121766107 Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bf36f5153ba648008cdaceb9dc538e53", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-TestVolumeBootPattern-121766107 Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: bf36f5153ba648008cdaceb9dc538e53 Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-TestVolumeBootPattern-121766107 Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-TestVolumeBootPattern-121766107-project Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 661f6c9aa7da4e348a9b0d91840078c2 Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-TestVolumeBootPattern-121766107-project Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 12508600-0c8e-4fcf-82b6-95ff4879847d could not be found. Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '12508600-0c8e-4fcf-82b6-95ff4879847d'} Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12508600-0c8e-4fcf-82b6-95ff4879847d could not be found. Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12508600-0c8e-4fcf-82b6-95ff4879847d could not be found. Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:52:35.720412 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:52:35.724513 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:52:35.724513 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:52:35.724513 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:52:35.724513 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:52:35.724513 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:52:35.724513 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12508600-0c8e-4fcf-82b6-95ff4879847d could not be found. Aug 07 01:52:35.724513 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:52:35.726531 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a579b820-e756-4eac-8e02-b610c6db6034 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Returning 404 to user: Instance 12508600-0c8e-4fcf-82b6-95ff4879847d could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:52:35.727598 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a579b820-e756-4eac-8e02-b610c6db6034 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d" status: 404 len: 111 microversion: 2.1 time: 0.045295 Aug 07 01:52:35.728675 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3159/5859] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:35 2022] GET /compute/v2.1/servers/12508600-0c8e-4fcf-82b6-95ff4879847d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:52:45.267546 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5afdea8e-27dc-4d6d-b1e9-26f148d403b5 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47173c7e-bb44-4b16-9c7f-e69cabe3141b", "device": "/dev/sdb"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:52:45.270286 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5afdea8e-27dc-4d6d-b1e9-26f148d403b5 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] [instance: 6003ea94-8906-4657-85bd-999848adf23a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:45.273173 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:52:45.274126 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=45 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:52:45.281609 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5afdea8e-27dc-4d6d-b1e9-26f148d403b5 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:45.282238 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5afdea8e-27dc-4d6d-b1e9-26f148d403b5 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:45.282682 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5afdea8e-27dc-4d6d-b1e9-26f148d403b5 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:45.285809 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5afdea8e-27dc-4d6d-b1e9-26f148d403b5 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:45.286286 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5afdea8e-27dc-4d6d-b1e9-26f148d403b5 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:45.286728 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5afdea8e-27dc-4d6d-b1e9-26f148d403b5 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:45.601153 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5afdea8e-27dc-4d6d-b1e9-26f148d403b5 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] 10.222.0.39 "POST /compute/v2.1/servers/6003ea94-8906-4657-85bd-999848adf23a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.337872 Aug 07 01:52:45.603928 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2701/5860] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Aug 7 01:52:45 2022] POST /compute/v2.1/servers/6003ea94-8906-4657-85bd-999848adf23a/os-volume_attachments => generated 194 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:52:58.825436 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-31f6c347-da5f-49dd-a2c5-f3a227a8f70f tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:58.825965 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-31f6c347-da5f-49dd-a2c5-f3a227a8f70f tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: b87160d2-fb11-43b6-8a65-bc703d4dcdc7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:58.851845 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:52:58.852982 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=5 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:52:58.879679 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31f6c347-da5f-49dd-a2c5-f3a227a8f70f tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:58.881589 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31f6c347-da5f-49dd-a2c5-f3a227a8f70f tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:58.886700 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31f6c347-da5f-49dd-a2c5-f3a227a8f70f tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:58.889471 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31f6c347-da5f-49dd-a2c5-f3a227a8f70f tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:58.892030 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31f6c347-da5f-49dd-a2c5-f3a227a8f70f tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:58.895281 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31f6c347-da5f-49dd-a2c5-f3a227a8f70f tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:59.030044 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-31f6c347-da5f-49dd-a2c5-f3a227a8f70f tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: b87160d2-fb11-43b6-8a65-bc703d4dcdc7] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:52:59.245192 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-31f6c347-da5f-49dd-a2c5-f3a227a8f70f tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b87160d2-fb11-43b6-8a65-bc703d4dcdc7" status: 204 len: 0 microversion: 2.1 time: 0.425791 Aug 07 01:52:59.250562 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3160/5861] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:52:58 2022] DELETE /compute/v2.1/servers/b87160d2-fb11-43b6-8a65-bc703d4dcdc7 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:52:59.257953 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8b2ef357-1e2c-4a6f-b571-648ec15aa2c8 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:52:59.258840 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8b2ef357-1e2c-4a6f-b571-648ec15aa2c8 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: b87160d2-fb11-43b6-8a65-bc703d4dcdc7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:52:59.273815 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:52:59.279960 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:52:59.298217 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8b2ef357-1e2c-4a6f-b571-648ec15aa2c8 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:59.299017 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8b2ef357-1e2c-4a6f-b571-648ec15aa2c8 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:59.299969 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8b2ef357-1e2c-4a6f-b571-648ec15aa2c8 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:59.300977 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8b2ef357-1e2c-4a6f-b571-648ec15aa2c8 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:52:59.301667 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8b2ef357-1e2c-4a6f-b571-648ec15aa2c8 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:52:59.302173 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8b2ef357-1e2c-4a6f-b571-648ec15aa2c8 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:52:59.622717 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8b2ef357-1e2c-4a6f-b571-648ec15aa2c8 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:52:59.634933 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8b2ef357-1e2c-4a6f-b571-648ec15aa2c8 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/b87160d2-fb11-43b6-8a65-bc703d4dcdc7" status: 200 len: 1552 microversion: 2.1 time: 0.380962 Aug 07 01:52:59.637045 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2702/5862] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:52:59 2022] GET /compute/v2.1/servers/b87160d2-fb11-43b6-8a65-bc703d4dcdc7 => generated 1552 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:00.658756 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-337aa3f2-1298-4817-a197-a5d1f5f9cf29 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:00.660249 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-337aa3f2-1298-4817-a197-a5d1f5f9cf29 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: b87160d2-fb11-43b6-8a65-bc703d4dcdc7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:00.668949 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-337aa3f2-1298-4817-a197-a5d1f5f9cf29 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:00.670019 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-337aa3f2-1298-4817-a197-a5d1f5f9cf29 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:00.671155 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-337aa3f2-1298-4817-a197-a5d1f5f9cf29 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:00.672877 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-337aa3f2-1298-4817-a197-a5d1f5f9cf29 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:00.673651 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-337aa3f2-1298-4817-a197-a5d1f5f9cf29 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:00.674502 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-337aa3f2-1298-4817-a197-a5d1f5f9cf29 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:00.940277 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-337aa3f2-1298-4817-a197-a5d1f5f9cf29 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:00.962916 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-337aa3f2-1298-4817-a197-a5d1f5f9cf29 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/b87160d2-fb11-43b6-8a65-bc703d4dcdc7" status: 200 len: 1552 microversion: 2.1 time: 0.300109 Aug 07 01:53:00.966937 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3161/5863] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:00 2022] GET /compute/v2.1/servers/b87160d2-fb11-43b6-8a65-bc703d4dcdc7 => generated 1552 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:01.444829 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-b10f1a14-6b36-47f8-9354-4d29c1ed3903 req-7a9f2144-33fa-43ee-acfb-4851dc9f13a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b87160d2-fb11-43b6-8a65-bc703d4dcdc7", "name": "network-vif-deleted", "tag": "f0024b02-6b33-46b6-8693-07011c9442a3"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:53:01.468049 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b10f1a14-6b36-47f8-9354-4d29c1ed3903 req-7a9f2144-33fa-43ee-acfb-4851dc9f13a4 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:01.468532 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b10f1a14-6b36-47f8-9354-4d29c1ed3903 req-7a9f2144-33fa-43ee-acfb-4851dc9f13a4 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:01.469147 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b10f1a14-6b36-47f8-9354-4d29c1ed3903 req-7a9f2144-33fa-43ee-acfb-4851dc9f13a4 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:01.484964 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-b10f1a14-6b36-47f8-9354-4d29c1ed3903 req-7a9f2144-33fa-43ee-acfb-4851dc9f13a4 service nova] Creating event network-vif-deleted:f0024b02-6b33-46b6-8693-07011c9442a3 for instance b87160d2-fb11-43b6-8a65-bc703d4dcdc7 on n-h2-master-1 Aug 07 01:53:01.491823 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-b10f1a14-6b36-47f8-9354-4d29c1ed3903 req-7a9f2144-33fa-43ee-acfb-4851dc9f13a4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050876 Aug 07 01:53:01.492504 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2703/5864] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:53:01.993778 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d86eb53c-625f-4ae5-85f9-269011cbc4f4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:01.995921 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d86eb53c-625f-4ae5-85f9-269011cbc4f4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: b87160d2-fb11-43b6-8a65-bc703d4dcdc7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:02.007353 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d86eb53c-625f-4ae5-85f9-269011cbc4f4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:02.007836 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d86eb53c-625f-4ae5-85f9-269011cbc4f4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:02.008544 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d86eb53c-625f-4ae5-85f9-269011cbc4f4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:02.009270 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d86eb53c-625f-4ae5-85f9-269011cbc4f4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:02.009726 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d86eb53c-625f-4ae5-85f9-269011cbc4f4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:02.010312 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d86eb53c-625f-4ae5-85f9-269011cbc4f4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:02.055346 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d86eb53c-625f-4ae5-85f9-269011cbc4f4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:02.055863 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d86eb53c-625f-4ae5-85f9-269011cbc4f4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:02.056342 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d86eb53c-625f-4ae5-85f9-269011cbc4f4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:02.057517 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-d86eb53c-625f-4ae5-85f9-269011cbc4f4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lazy-loading 'fault' on Instance uuid b87160d2-fb11-43b6-8a65-bc703d4dcdc7 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:53:02.106708 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d86eb53c-625f-4ae5-85f9-269011cbc4f4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:02.117810 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d86eb53c-625f-4ae5-85f9-269011cbc4f4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/b87160d2-fb11-43b6-8a65-bc703d4dcdc7" status: 200 len: 1338 microversion: 2.1 time: 0.130167 Aug 07 01:53:02.118849 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3162/5865] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:01 2022] GET /compute/v2.1/servers/b87160d2-fb11-43b6-8a65-bc703d4dcdc7 => generated 1338 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:03.159716 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c3225e1e-330a-4aea-867a-1442115c2a84 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:03.160650 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c3225e1e-330a-4aea-867a-1442115c2a84 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: b87160d2-fb11-43b6-8a65-bc703d4dcdc7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:03.170829 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3225e1e-330a-4aea-867a-1442115c2a84 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:03.171286 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3225e1e-330a-4aea-867a-1442115c2a84 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:03.171976 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3225e1e-330a-4aea-867a-1442115c2a84 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:03.172722 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3225e1e-330a-4aea-867a-1442115c2a84 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:03.173374 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3225e1e-330a-4aea-867a-1442115c2a84 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:03.173822 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c3225e1e-330a-4aea-867a-1442115c2a84 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:03.192666 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-c3225e1e-330a-4aea-867a-1442115c2a84 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] HTTP exception thrown: Instance b87160d2-fb11-43b6-8a65-bc703d4dcdc7 could not be found. Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c3225e1e-330a-4aea-867a-1442115c2a84 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Request method failure captured: Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/b87160d2-fb11-43b6-8a65-bc703d4dcdc7 HTTP/1.1 Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xqD3Y6hpz0qjjIlqTvf6bL-avep3kbpCD86d6mV0Qg1gZrhr0EwzSd8p6sxw3q-lH5uqgaLHvennHRhVxrzfTEJTXDTDCcQdl51I4KXqZH6RTstyctnA9qJu1r_QSHQmPuNQdxXVK1absM7uGh656-MicP9C6mAcIiMGwlLipyfNmE Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 2bd8662019804060a7b712456d095ad2 Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-TestNetworkBasicOps-1812327257 Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2bd8662019804060a7b712456d095ad2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2bd8662019804060a7b712456d095ad2", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2bd8662019804060a7b712456d095ad2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2bd8662019804060a7b712456d095ad2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-TestNetworkBasicOps-1812327257 Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 2bd8662019804060a7b712456d095ad2 Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-TestNetworkBasicOps-1812327257 Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-TestNetworkBasicOps-1812327257-project Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 073f0cff787a466a9fbf9fb43b03b726 Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-TestNetworkBasicOps-1812327257-project Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: exception: Instance b87160d2-fb11-43b6-8a65-bc703d4dcdc7 could not be found. Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'b87160d2-fb11-43b6-8a65-bc703d4dcdc7'} Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b87160d2-fb11-43b6-8a65-bc703d4dcdc7 could not be found. Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b87160d2-fb11-43b6-8a65-bc703d4dcdc7 could not be found. Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:53:03.194710 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:53:03.201185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:53:03.201185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:53:03.201185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:53:03.201185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:53:03.201185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:53:03.201185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b87160d2-fb11-43b6-8a65-bc703d4dcdc7 could not be found. Aug 07 01:53:03.201185 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:53:03.203111 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c3225e1e-330a-4aea-867a-1442115c2a84 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Returning 404 to user: Instance b87160d2-fb11-43b6-8a65-bc703d4dcdc7 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:53:03.204057 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c3225e1e-330a-4aea-867a-1442115c2a84 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/b87160d2-fb11-43b6-8a65-bc703d4dcdc7" status: 404 len: 111 microversion: 2.1 time: 0.051974 Aug 07 01:53:03.204911 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2704/5866] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:03 2022] GET /compute/v2.1/servers/b87160d2-fb11-43b6-8a65-bc703d4dcdc7 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:53:03.638054 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1106eed7-997d-4bdb-9814-a4a8b9dec42b tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '.version_select at 0x7f9e16fb1d30>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:03.676866 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1106eed7-997d-4bdb-9814-a4a8b9dec42b tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1145022111" status: 202 len: 0 microversion: 2.1 time: 0.043503 Aug 07 01:53:03.677888 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3163/5867] 10.222.0.39 () {58 vars in 1257 bytes} [Sun Aug 7 01:53:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1145022111 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 01:53:04.072813 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-43a0c010-2a25-4764-a4e1-a2a8f712f65d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1997469026", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "b464f43c-557c-485f-be03-d361a46b665c", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "620c0b3f-63f9-404f-acf4-ca02927e0de7"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:53:04.243810 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-43a0c010-2a25-4764-a4e1-a2a8f712f65d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] validate_networks() for [('620c0b3f-63f9-404f-acf4-ca02927e0de7', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:53:04.982624 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-43a0c010-2a25-4764-a4e1-a2a8f712f65d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:53:04.984874 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-43a0c010-2a25-4764-a4e1-a2a8f712f65d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:53:04.985605 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-43a0c010-2a25-4764-a4e1-a2a8f712f65d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:53:04.986340 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-43a0c010-2a25-4764-a4e1-a2a8f712f65d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:53:04.987269 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-43a0c010-2a25-4764-a4e1-a2a8f712f65d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:53:05.001762 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-43a0c010-2a25-4764-a4e1-a2a8f712f65d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:05.002241 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-43a0c010-2a25-4764-a4e1-a2a8f712f65d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:05.002910 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-43a0c010-2a25-4764-a4e1-a2a8f712f65d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:05.003920 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-43a0c010-2a25-4764-a4e1-a2a8f712f65d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:05.004393 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-43a0c010-2a25-4764-a4e1-a2a8f712f65d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:05.004824 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-43a0c010-2a25-4764-a4e1-a2a8f712f65d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:05.024974 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-43a0c010-2a25-4764-a4e1-a2a8f712f65d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Getting quotas for project bf36f5153ba648008cdaceb9dc538e53. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:53:05.031078 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-43a0c010-2a25-4764-a4e1-a2a8f712f65d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Getting quotas for user 661f6c9aa7da4e348a9b0d91840078c2 and project bf36f5153ba648008cdaceb9dc538e53. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:53:05.046766 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-43a0c010-2a25-4764-a4e1-a2a8f712f65d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:53:05.048852 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-43a0c010-2a25-4764-a4e1-a2a8f712f65d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='b464f43c-557c-485f-be03-d361a46b665c',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:53:05.131566 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-43a0c010-2a25-4764-a4e1-a2a8f712f65d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.063181 Aug 07 01:53:05.132803 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2705/5868] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:53:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:53:05.154515 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4acf6f34-2fa6-48dc-ba98-46a55cec3137 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:05.155683 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4acf6f34-2fa6-48dc-ba98-46a55cec3137 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:05.230991 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4acf6f34-2fa6-48dc-ba98-46a55cec3137 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:05.238602 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4acf6f34-2fa6-48dc-ba98-46a55cec3137 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1057 microversion: 2.1 time: 0.098176 Aug 07 01:53:05.240821 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3164/5869] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:05 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1057 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:06.267565 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6c28fc8f-0980-4d25-8bb5-55b88d1209fe tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:06.276714 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6c28fc8f-0980-4d25-8bb5-55b88d1209fe tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:06.291275 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c28fc8f-0980-4d25-8bb5-55b88d1209fe tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:06.291767 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c28fc8f-0980-4d25-8bb5-55b88d1209fe tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:06.292229 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c28fc8f-0980-4d25-8bb5-55b88d1209fe tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:06.292971 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c28fc8f-0980-4d25-8bb5-55b88d1209fe tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:06.293423 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c28fc8f-0980-4d25-8bb5-55b88d1209fe tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:06.293844 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c28fc8f-0980-4d25-8bb5-55b88d1209fe tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:06.449431 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6c28fc8f-0980-4d25-8bb5-55b88d1209fe tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:06.468008 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6c28fc8f-0980-4d25-8bb5-55b88d1209fe tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1109 microversion: 2.1 time: 0.208346 Aug 07 01:53:06.473600 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2706/5870] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:06 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1109 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:07.218043 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0aa7d643-bec5-4dc4-bfa9-16cba9ca622b tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:07.219181 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0aa7d643-bec5-4dc4-bfa9-16cba9ca622b tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: d05d75dd-2cc4-468e-80ca-0e64698d8497] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:07.225508 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-e783418b-1ce5-4588-be58-67f049b9d4af req-0e65563f-9f83-4667-9a9a-cd295eae3e83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d05d75dd-2cc4-468e-80ca-0e64698d8497", "tag": "17efe68c-e73a-4706-99ff-f40a8ec26d19"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:53:07.240475 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0aa7d643-bec5-4dc4-bfa9-16cba9ca622b tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:07.243584 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0aa7d643-bec5-4dc4-bfa9-16cba9ca622b tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:07.244722 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0aa7d643-bec5-4dc4-bfa9-16cba9ca622b tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:07.247177 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0aa7d643-bec5-4dc4-bfa9-16cba9ca622b tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:07.247714 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0aa7d643-bec5-4dc4-bfa9-16cba9ca622b tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:07.249345 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0aa7d643-bec5-4dc4-bfa9-16cba9ca622b tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:07.252201 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-e783418b-1ce5-4588-be58-67f049b9d4af req-0e65563f-9f83-4667-9a9a-cd295eae3e83 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:07.252740 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-e783418b-1ce5-4588-be58-67f049b9d4af req-0e65563f-9f83-4667-9a9a-cd295eae3e83 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:07.253229 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-e783418b-1ce5-4588-be58-67f049b9d4af req-0e65563f-9f83-4667-9a9a-cd295eae3e83 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:07.304352 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-e783418b-1ce5-4588-be58-67f049b9d4af req-0e65563f-9f83-4667-9a9a-cd295eae3e83 service nova] Creating event network-changed:17efe68c-e73a-4706-99ff-f40a8ec26d19 for instance d05d75dd-2cc4-468e-80ca-0e64698d8497 on n-h2-master-1 Aug 07 01:53:07.308033 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0aa7d643-bec5-4dc4-bfa9-16cba9ca622b tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: d05d75dd-2cc4-468e-80ca-0e64698d8497] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:53:07.327066 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-e783418b-1ce5-4588-be58-67f049b9d4af req-0e65563f-9f83-4667-9a9a-cd295eae3e83 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104979 Aug 07 01:53:07.329827 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2707/5871] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:53:07.498606 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-64be225f-e16a-4faa-a781-bf5743409234 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:07.499221 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-64be225f-e16a-4faa-a781-bf5743409234 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:07.526554 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0aa7d643-bec5-4dc4-bfa9-16cba9ca622b tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d05d75dd-2cc4-468e-80ca-0e64698d8497" status: 204 len: 0 microversion: 2.1 time: 0.311573 Aug 07 01:53:07.527540 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64be225f-e16a-4faa-a781-bf5743409234 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:07.530198 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3165/5872] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:53:07 2022] DELETE /compute/v2.1/servers/d05d75dd-2cc4-468e-80ca-0e64698d8497 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:53:07.530565 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64be225f-e16a-4faa-a781-bf5743409234 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:07.531184 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64be225f-e16a-4faa-a781-bf5743409234 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:07.531978 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64be225f-e16a-4faa-a781-bf5743409234 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:07.532459 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64be225f-e16a-4faa-a781-bf5743409234 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:07.542306 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64be225f-e16a-4faa-a781-bf5743409234 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:07.551099 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-21b44394-02b4-4a1e-befe-10396d3940d6 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:07.551827 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-21b44394-02b4-4a1e-befe-10396d3940d6 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: d05d75dd-2cc4-468e-80ca-0e64698d8497] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:07.571738 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21b44394-02b4-4a1e-befe-10396d3940d6 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:07.572298 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21b44394-02b4-4a1e-befe-10396d3940d6 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:07.572735 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21b44394-02b4-4a1e-befe-10396d3940d6 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:07.573456 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21b44394-02b4-4a1e-befe-10396d3940d6 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:07.581101 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21b44394-02b4-4a1e-befe-10396d3940d6 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:07.581766 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21b44394-02b4-4a1e-befe-10396d3940d6 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:07.756794 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-64be225f-e16a-4faa-a781-bf5743409234 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:07.772592 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-64be225f-e16a-4faa-a781-bf5743409234 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1127 microversion: 2.1 time: 0.276480 Aug 07 01:53:07.773782 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2708/5873] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:07 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1127 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:53:07.825624 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-21b44394-02b4-4a1e-befe-10396d3940d6 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:07.835860 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-21b44394-02b4-4a1e-befe-10396d3940d6 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/d05d75dd-2cc4-468e-80ca-0e64698d8497" status: 200 len: 1669 microversion: 2.1 time: 0.301383 Aug 07 01:53:07.837188 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3166/5874] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:07 2022] GET /compute/v2.1/servers/d05d75dd-2cc4-468e-80ca-0e64698d8497 => generated 1669 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:08.809709 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-da5da795-bd84-4d17-9024-49bcad642974 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:08.810533 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-da5da795-bd84-4d17-9024-49bcad642974 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:08.827566 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da5da795-bd84-4d17-9024-49bcad642974 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:08.828290 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da5da795-bd84-4d17-9024-49bcad642974 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:08.828945 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da5da795-bd84-4d17-9024-49bcad642974 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:08.829865 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da5da795-bd84-4d17-9024-49bcad642974 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:08.830321 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da5da795-bd84-4d17-9024-49bcad642974 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:08.830759 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da5da795-bd84-4d17-9024-49bcad642974 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:08.868046 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cb745187-e299-4535-8391-2e51d314b650 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:08.869864 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cb745187-e299-4535-8391-2e51d314b650 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: d05d75dd-2cc4-468e-80ca-0e64698d8497] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:08.882048 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb745187-e299-4535-8391-2e51d314b650 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:08.882554 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb745187-e299-4535-8391-2e51d314b650 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:08.883330 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb745187-e299-4535-8391-2e51d314b650 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:08.884376 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb745187-e299-4535-8391-2e51d314b650 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:08.885139 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb745187-e299-4535-8391-2e51d314b650 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:08.885856 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb745187-e299-4535-8391-2e51d314b650 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:09.292563 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-da5da795-bd84-4d17-9024-49bcad642974 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:09.308125 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-da5da795-bd84-4d17-9024-49bcad642974 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1169 microversion: 2.1 time: 0.514154 Aug 07 01:53:09.309295 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2709/5875] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:08 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1169 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:09.624516 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cb745187-e299-4535-8391-2e51d314b650 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:09.664100 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cb745187-e299-4535-8391-2e51d314b650 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/d05d75dd-2cc4-468e-80ca-0e64698d8497" status: 200 len: 1669 microversion: 2.1 time: 0.802768 Aug 07 01:53:09.668934 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3167/5876] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:08 2022] GET /compute/v2.1/servers/d05d75dd-2cc4-468e-80ca-0e64698d8497 => generated 1669 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:09.776355 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-998ea444-92e8-4601-bbed-4fe57242fd86 req-aaaf0892-a82c-4b70-bf16-436ddc02fa75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d05d75dd-2cc4-468e-80ca-0e64698d8497", "name": "network-vif-deleted", "tag": "17efe68c-e73a-4706-99ff-f40a8ec26d19"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:53:09.838979 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-998ea444-92e8-4601-bbed-4fe57242fd86 req-aaaf0892-a82c-4b70-bf16-436ddc02fa75 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:09.839630 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-998ea444-92e8-4601-bbed-4fe57242fd86 req-aaaf0892-a82c-4b70-bf16-436ddc02fa75 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:09.839819 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-998ea444-92e8-4601-bbed-4fe57242fd86 req-aaaf0892-a82c-4b70-bf16-436ddc02fa75 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:09.852705 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-998ea444-92e8-4601-bbed-4fe57242fd86 req-aaaf0892-a82c-4b70-bf16-436ddc02fa75 service nova] Creating event network-vif-deleted:17efe68c-e73a-4706-99ff-f40a8ec26d19 for instance d05d75dd-2cc4-468e-80ca-0e64698d8497 on n-h2-master-1 Aug 07 01:53:09.873852 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-998ea444-92e8-4601-bbed-4fe57242fd86 req-aaaf0892-a82c-4b70-bf16-436ddc02fa75 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102613 Aug 07 01:53:09.875029 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2710/5877] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:53:10.107617 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-6c9c9e0a-e575-4b4b-9177-18e955d03a9b req-999f4123-0a9e-4ea6-96ef-6d816cc5e9e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e1e1fd5-843d-43bc-8db2-64300be0f1d0", "tag": "239d284e-48d9-4855-a1c1-a6149e35827d"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:53:10.115486 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6c9c9e0a-e575-4b4b-9177-18e955d03a9b req-999f4123-0a9e-4ea6-96ef-6d816cc5e9e6 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:10.116260 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6c9c9e0a-e575-4b4b-9177-18e955d03a9b req-999f4123-0a9e-4ea6-96ef-6d816cc5e9e6 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:10.117165 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6c9c9e0a-e575-4b4b-9177-18e955d03a9b req-999f4123-0a9e-4ea6-96ef-6d816cc5e9e6 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:10.133189 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-6c9c9e0a-e575-4b4b-9177-18e955d03a9b req-999f4123-0a9e-4ea6-96ef-6d816cc5e9e6 service nova] Creating event network-changed:239d284e-48d9-4855-a1c1-a6149e35827d for instance 2e1e1fd5-843d-43bc-8db2-64300be0f1d0 on n-h2-master-1 Aug 07 01:53:10.142788 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-6c9c9e0a-e575-4b4b-9177-18e955d03a9b req-999f4123-0a9e-4ea6-96ef-6d816cc5e9e6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051345 Aug 07 01:53:10.143423 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3168/5878] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:53:10.331553 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a263b197-fdad-4840-af32-1d18c1a5640a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:10.332570 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a263b197-fdad-4840-af32-1d18c1a5640a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:10.341653 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a263b197-fdad-4840-af32-1d18c1a5640a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:10.342529 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a263b197-fdad-4840-af32-1d18c1a5640a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:10.343219 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a263b197-fdad-4840-af32-1d18c1a5640a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:10.351653 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a263b197-fdad-4840-af32-1d18c1a5640a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:10.352634 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a263b197-fdad-4840-af32-1d18c1a5640a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:10.353979 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a263b197-fdad-4840-af32-1d18c1a5640a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:10.672718 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a263b197-fdad-4840-af32-1d18c1a5640a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:10.699790 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7848afe2-aa98-43a4-b8dd-ac5add3ea161 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:10.707164 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a263b197-fdad-4840-af32-1d18c1a5640a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1169 microversion: 2.1 time: 0.381222 Aug 07 01:53:10.719926 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7848afe2-aa98-43a4-b8dd-ac5add3ea161 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: d05d75dd-2cc4-468e-80ca-0e64698d8497] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:10.724396 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2711/5879] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:10 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1169 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:10.740237 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7848afe2-aa98-43a4-b8dd-ac5add3ea161 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:10.741278 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7848afe2-aa98-43a4-b8dd-ac5add3ea161 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:10.742081 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7848afe2-aa98-43a4-b8dd-ac5add3ea161 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:10.743423 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7848afe2-aa98-43a4-b8dd-ac5add3ea161 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:10.744323 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7848afe2-aa98-43a4-b8dd-ac5add3ea161 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:10.745099 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7848afe2-aa98-43a4-b8dd-ac5add3ea161 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:10.792288 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-7848afe2-aa98-43a4-b8dd-ac5add3ea161 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] HTTP exception thrown: Instance d05d75dd-2cc4-468e-80ca-0e64698d8497 could not be found. Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7848afe2-aa98-43a4-b8dd-ac5add3ea161 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Request method failure captured: Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/d05d75dd-2cc4-468e-80ca-0e64698d8497 HTTP/1.1 Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xqD3Y6hpz0qjjIlqTvf6bL-avep3kbpCD86d6mV0Qg1gZrhr0EwzSd8p6sxw3q-lH5uqgaLHvennHRhVxrzfTEJTXDTDCcQdl51I4KXqZH6RTstyctnA9qJu1r_QSHQmPuNQdxXVK1absM7uGh656-MicP9C6mAcIiMGwlLipyfNmE Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 2bd8662019804060a7b712456d095ad2 Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-TestNetworkBasicOps-1812327257 Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2bd8662019804060a7b712456d095ad2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2bd8662019804060a7b712456d095ad2", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2bd8662019804060a7b712456d095ad2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2bd8662019804060a7b712456d095ad2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-TestNetworkBasicOps-1812327257 Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 2bd8662019804060a7b712456d095ad2 Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-TestNetworkBasicOps-1812327257 Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-TestNetworkBasicOps-1812327257-project Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 073f0cff787a466a9fbf9fb43b03b726 Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-TestNetworkBasicOps-1812327257-project Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: exception: Instance d05d75dd-2cc4-468e-80ca-0e64698d8497 could not be found. Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'd05d75dd-2cc4-468e-80ca-0e64698d8497'} Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d05d75dd-2cc4-468e-80ca-0e64698d8497 could not be found. Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d05d75dd-2cc4-468e-80ca-0e64698d8497 could not be found. Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:53:10.795639 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:53:10.803199 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:53:10.803199 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:53:10.803199 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:53:10.803199 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:53:10.803199 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:53:10.803199 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d05d75dd-2cc4-468e-80ca-0e64698d8497 could not be found. Aug 07 01:53:10.803199 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:53:10.808252 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7848afe2-aa98-43a4-b8dd-ac5add3ea161 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Returning 404 to user: Instance d05d75dd-2cc4-468e-80ca-0e64698d8497 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:53:10.809779 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7848afe2-aa98-43a4-b8dd-ac5add3ea161 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/d05d75dd-2cc4-468e-80ca-0e64698d8497" status: 404 len: 111 microversion: 2.1 time: 0.118408 Aug 07 01:53:10.816494 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3169/5880] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:10 2022] GET /compute/v2.1/servers/d05d75dd-2cc4-468e-80ca-0e64698d8497 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:53:11.261476 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f900862b-6ebf-45eb-b81f-f60ec3433e4c tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '.version_select at 0x7f9e174c3670>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:11.307583 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f900862b-6ebf-45eb-b81f-f60ec3433e4c tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-468167867" status: 202 len: 0 microversion: 2.1 time: 0.052746 Aug 07 01:53:11.309892 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2712/5881] 10.222.0.39 () {58 vars in 1254 bytes} [Sun Aug 7 01:53:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-468167867 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:53:11.730386 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-51ebfc76-9e92-47a8-9ef1-15eb9a071619 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:11.731773 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-51ebfc76-9e92-47a8-9ef1-15eb9a071619 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:11.748421 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51ebfc76-9e92-47a8-9ef1-15eb9a071619 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:11.748990 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51ebfc76-9e92-47a8-9ef1-15eb9a071619 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:11.749529 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51ebfc76-9e92-47a8-9ef1-15eb9a071619 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:11.755109 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51ebfc76-9e92-47a8-9ef1-15eb9a071619 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:11.755820 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51ebfc76-9e92-47a8-9ef1-15eb9a071619 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:11.756382 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51ebfc76-9e92-47a8-9ef1-15eb9a071619 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:12.255176 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-51ebfc76-9e92-47a8-9ef1-15eb9a071619 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:12.283974 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-51ebfc76-9e92-47a8-9ef1-15eb9a071619 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1169 microversion: 2.1 time: 0.557594 Aug 07 01:53:12.290484 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3170/5882] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:11 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1169 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:53:13.311613 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d23e8cae-8e5a-45f4-b02d-2be05f552bc4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:13.312275 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d23e8cae-8e5a-45f4-b02d-2be05f552bc4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:13.324474 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d23e8cae-8e5a-45f4-b02d-2be05f552bc4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:13.325392 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d23e8cae-8e5a-45f4-b02d-2be05f552bc4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:13.325879 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d23e8cae-8e5a-45f4-b02d-2be05f552bc4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:13.326689 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d23e8cae-8e5a-45f4-b02d-2be05f552bc4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:13.327917 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d23e8cae-8e5a-45f4-b02d-2be05f552bc4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:13.329040 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d23e8cae-8e5a-45f4-b02d-2be05f552bc4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:13.731937 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d23e8cae-8e5a-45f4-b02d-2be05f552bc4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:13.759027 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d23e8cae-8e5a-45f4-b02d-2be05f552bc4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1169 microversion: 2.1 time: 0.453966 Aug 07 01:53:13.771133 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2713/5883] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:13 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1169 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:14.787177 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d2cb2c46-9359-4964-a0c9-311798cd5136 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:14.787816 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d2cb2c46-9359-4964-a0c9-311798cd5136 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:14.835703 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2cb2c46-9359-4964-a0c9-311798cd5136 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:14.836280 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2cb2c46-9359-4964-a0c9-311798cd5136 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:14.836751 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2cb2c46-9359-4964-a0c9-311798cd5136 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:14.845917 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2cb2c46-9359-4964-a0c9-311798cd5136 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:14.846439 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2cb2c46-9359-4964-a0c9-311798cd5136 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:14.848013 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2cb2c46-9359-4964-a0c9-311798cd5136 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:15.238439 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:53:15.307963 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d2cb2c46-9359-4964-a0c9-311798cd5136 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:15.330459 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d2cb2c46-9359-4964-a0c9-311798cd5136 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1169 microversion: 2.1 time: 0.547139 Aug 07 01:53:15.332767 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3171/5884] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:14 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1169 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:16.360270 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3fa7bec7-934e-400e-9b79-acc50b199710 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:16.361664 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3fa7bec7-934e-400e-9b79-acc50b199710 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:16.366476 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:53:16.367153 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:53:16.382554 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3fa7bec7-934e-400e-9b79-acc50b199710 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:16.383076 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3fa7bec7-934e-400e-9b79-acc50b199710 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:16.385283 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3fa7bec7-934e-400e-9b79-acc50b199710 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:16.385996 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3fa7bec7-934e-400e-9b79-acc50b199710 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:16.386434 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3fa7bec7-934e-400e-9b79-acc50b199710 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:16.386861 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3fa7bec7-934e-400e-9b79-acc50b199710 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:16.751791 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3fa7bec7-934e-400e-9b79-acc50b199710 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:16.776563 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3fa7bec7-934e-400e-9b79-acc50b199710 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1169 microversion: 2.1 time: 0.416388 Aug 07 01:53:16.779520 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2714/5885] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:16 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1169 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:17.804353 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7f944737-01f4-47d6-9d96-6c82e101110d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:17.806191 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7f944737-01f4-47d6-9d96-6c82e101110d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:17.818824 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f944737-01f4-47d6-9d96-6c82e101110d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:17.830015 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f944737-01f4-47d6-9d96-6c82e101110d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:17.831219 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f944737-01f4-47d6-9d96-6c82e101110d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:17.844754 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f944737-01f4-47d6-9d96-6c82e101110d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:17.848310 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f944737-01f4-47d6-9d96-6c82e101110d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:17.848310 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f944737-01f4-47d6-9d96-6c82e101110d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:18.262890 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7f944737-01f4-47d6-9d96-6c82e101110d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:18.321315 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7f944737-01f4-47d6-9d96-6c82e101110d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1169 microversion: 2.1 time: 0.519063 Aug 07 01:53:18.331837 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3172/5886] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:17 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1169 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:53:19.348808 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-64d213c2-07de-4b9c-bda7-5b94cff1ae51 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:19.349430 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-64d213c2-07de-4b9c-bda7-5b94cff1ae51 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:19.362803 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64d213c2-07de-4b9c-bda7-5b94cff1ae51 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:19.363455 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64d213c2-07de-4b9c-bda7-5b94cff1ae51 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:19.364160 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64d213c2-07de-4b9c-bda7-5b94cff1ae51 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:19.365129 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64d213c2-07de-4b9c-bda7-5b94cff1ae51 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:19.365807 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64d213c2-07de-4b9c-bda7-5b94cff1ae51 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:19.366869 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64d213c2-07de-4b9c-bda7-5b94cff1ae51 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:19.423581 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-90d99f38-6ae4-4149-836e-44f8299c428b tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:19.424154 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-90d99f38-6ae4-4149-836e-44f8299c428b tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] [instance: 6003ea94-8906-4657-85bd-999848adf23a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:19.436637 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90d99f38-6ae4-4149-836e-44f8299c428b tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:19.437135 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90d99f38-6ae4-4149-836e-44f8299c428b tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:19.437623 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90d99f38-6ae4-4149-836e-44f8299c428b tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:19.439403 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90d99f38-6ae4-4149-836e-44f8299c428b tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:19.440542 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90d99f38-6ae4-4149-836e-44f8299c428b tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:19.441091 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90d99f38-6ae4-4149-836e-44f8299c428b tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:19.549973 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-90d99f38-6ae4-4149-836e-44f8299c428b tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lazy-loading 'services' on Instance uuid 6003ea94-8906-4657-85bd-999848adf23a {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:53:19.623738 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-64d213c2-07de-4b9c-bda7-5b94cff1ae51 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:19.638209 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-64d213c2-07de-4b9c-bda7-5b94cff1ae51 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1169 microversion: 2.1 time: 0.293732 Aug 07 01:53:19.638808 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2715/5887] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:19 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1169 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:19.702013 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-90d99f38-6ae4-4149-836e-44f8299c428b tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6003ea94-8906-4657-85bd-999848adf23a/os-volume_attachments/47173c7e-bb44-4b16-9c7f-e69cabe3141b" status: 202 len: 0 microversion: 2.1 time: 0.282107 Aug 07 01:53:19.706313 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3173/5888] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Aug 7 01:53:19 2022] DELETE /compute/v2.1/servers/6003ea94-8906-4657-85bd-999848adf23a/os-volume_attachments/47173c7e-bb44-4b16-9c7f-e69cabe3141b => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:53:20.679552 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-90edc6a9-34c3-4465-848c-4fc767f46cbc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:20.680119 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-90edc6a9-34c3-4465-848c-4fc767f46cbc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:20.687614 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90edc6a9-34c3-4465-848c-4fc767f46cbc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:20.688186 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90edc6a9-34c3-4465-848c-4fc767f46cbc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:20.688628 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90edc6a9-34c3-4465-848c-4fc767f46cbc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:20.689348 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90edc6a9-34c3-4465-848c-4fc767f46cbc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:20.689810 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90edc6a9-34c3-4465-848c-4fc767f46cbc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:20.690242 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90edc6a9-34c3-4465-848c-4fc767f46cbc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:20.923401 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-90edc6a9-34c3-4465-848c-4fc767f46cbc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:20.933167 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-90edc6a9-34c3-4465-848c-4fc767f46cbc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1169 microversion: 2.1 time: 0.257518 Aug 07 01:53:20.933677 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2716/5889] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:20 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1169 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:21.954598 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f87d6d5c-1256-438d-9fa5-e161452ecb0a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:21.955317 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f87d6d5c-1256-438d-9fa5-e161452ecb0a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:21.967386 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f87d6d5c-1256-438d-9fa5-e161452ecb0a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:21.968059 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f87d6d5c-1256-438d-9fa5-e161452ecb0a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:21.968359 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f87d6d5c-1256-438d-9fa5-e161452ecb0a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:21.969093 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f87d6d5c-1256-438d-9fa5-e161452ecb0a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:21.969556 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f87d6d5c-1256-438d-9fa5-e161452ecb0a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:21.969988 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f87d6d5c-1256-438d-9fa5-e161452ecb0a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:22.260572 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f87d6d5c-1256-438d-9fa5-e161452ecb0a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:22.268909 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f87d6d5c-1256-438d-9fa5-e161452ecb0a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1169 microversion: 2.1 time: 0.318873 Aug 07 01:53:22.275510 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3174/5890] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:21 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1169 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:23.290718 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fcd52b99-c072-463e-844e-2fb389b90094 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:23.292104 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fcd52b99-c072-463e-844e-2fb389b90094 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:23.304887 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fcd52b99-c072-463e-844e-2fb389b90094 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:23.307256 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fcd52b99-c072-463e-844e-2fb389b90094 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:23.316788 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fcd52b99-c072-463e-844e-2fb389b90094 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:23.322907 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fcd52b99-c072-463e-844e-2fb389b90094 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:23.324103 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fcd52b99-c072-463e-844e-2fb389b90094 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:23.324820 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fcd52b99-c072-463e-844e-2fb389b90094 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:23.652192 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fcd52b99-c072-463e-844e-2fb389b90094 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:23.664141 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fcd52b99-c072-463e-844e-2fb389b90094 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1169 microversion: 2.1 time: 0.377099 Aug 07 01:53:23.668285 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2717/5891] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:23 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1169 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:24.689681 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1a0dd341-6ef5-4cda-a5c2-0840c5fb72dc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:24.691164 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1a0dd341-6ef5-4cda-a5c2-0840c5fb72dc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:24.699821 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1a0dd341-6ef5-4cda-a5c2-0840c5fb72dc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:24.700641 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1a0dd341-6ef5-4cda-a5c2-0840c5fb72dc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:24.701251 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1a0dd341-6ef5-4cda-a5c2-0840c5fb72dc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:24.702352 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1a0dd341-6ef5-4cda-a5c2-0840c5fb72dc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:24.703031 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1a0dd341-6ef5-4cda-a5c2-0840c5fb72dc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:24.703654 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1a0dd341-6ef5-4cda-a5c2-0840c5fb72dc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:24.739026 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:53:25.416799 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1a0dd341-6ef5-4cda-a5c2-0840c5fb72dc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:25.429200 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1a0dd341-6ef5-4cda-a5c2-0840c5fb72dc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1169 microversion: 2.1 time: 0.743449 Aug 07 01:53:25.443148 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3175/5892] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:24 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1169 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:26.451545 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2ed75843-8187-409a-bbfa-d6ca10a23127 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:26.452932 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2ed75843-8187-409a-bbfa-d6ca10a23127 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:26.467287 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2ed75843-8187-409a-bbfa-d6ca10a23127 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:26.468247 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2ed75843-8187-409a-bbfa-d6ca10a23127 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:26.468913 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2ed75843-8187-409a-bbfa-d6ca10a23127 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:26.476932 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2ed75843-8187-409a-bbfa-d6ca10a23127 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:26.478307 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2ed75843-8187-409a-bbfa-d6ca10a23127 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:26.478968 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2ed75843-8187-409a-bbfa-d6ca10a23127 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:26.843554 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2ed75843-8187-409a-bbfa-d6ca10a23127 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:26.858799 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1180b1bc-94e4-4508-9935-1f9f87bb5ba4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Action: 'create', calling method: .version_select at 0x7f9e16f19790>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1661870495", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1bdIEJtWtQjLgPwjh8VfsxihbEkaty4avE56+t19xR8V0nyoKl1T5J4xvL+9gHlOAKCtLytEO9kEp7/eLVDwZQQvnR2BBWSxag1k5n6CxHNVbrOkuiFLcFxXvOgDzeZg=="}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:53:26.863448 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2ed75843-8187-409a-bbfa-d6ca10a23127 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1169 microversion: 2.1 time: 0.416283 Aug 07 01:53:26.877154 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2718/5893] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:26 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1169 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:26.883243 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-1180b1bc-94e4-4508-9935-1f9f87bb5ba4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Getting quotas for project 2bd8662019804060a7b712456d095ad2. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:53:26.891504 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-1180b1bc-94e4-4508-9935-1f9f87bb5ba4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Getting quotas for user 073f0cff787a466a9fbf9fb43b03b726 and project 2bd8662019804060a7b712456d095ad2. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:53:26.922944 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1180b1bc-94e4-4508-9935-1f9f87bb5ba4 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.068034 Aug 07 01:53:26.923870 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3176/5894] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:53:26 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:53:27.094874 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5e218ed3-e874-4ca5-912f-a5dee9645ee1 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:27.095389 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5e218ed3-e874-4ca5-912f-a5dee9645ee1 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] [instance: 6003ea94-8906-4657-85bd-999848adf23a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:27.109619 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e218ed3-e874-4ca5-912f-a5dee9645ee1 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:27.110309 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e218ed3-e874-4ca5-912f-a5dee9645ee1 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:27.110575 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e218ed3-e874-4ca5-912f-a5dee9645ee1 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:27.111540 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e218ed3-e874-4ca5-912f-a5dee9645ee1 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:27.113446 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e218ed3-e874-4ca5-912f-a5dee9645ee1 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:27.114081 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e218ed3-e874-4ca5-912f-a5dee9645ee1 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:27.178047 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5e218ed3-e874-4ca5-912f-a5dee9645ee1 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] [instance: 6003ea94-8906-4657-85bd-999848adf23a] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:53:27.379471 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5e218ed3-e874-4ca5-912f-a5dee9645ee1 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6003ea94-8906-4657-85bd-999848adf23a" status: 204 len: 0 microversion: 2.1 time: 0.287911 Aug 07 01:53:27.380042 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2719/5895] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:53:27 2022] DELETE /compute/v2.1/servers/6003ea94-8906-4657-85bd-999848adf23a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:53:27.397086 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-eeb19451-522a-41a1-bb58-c7f8a835363d tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:27.397980 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-eeb19451-522a-41a1-bb58-c7f8a835363d tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] [instance: 6003ea94-8906-4657-85bd-999848adf23a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:27.404945 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eeb19451-522a-41a1-bb58-c7f8a835363d tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:27.405432 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eeb19451-522a-41a1-bb58-c7f8a835363d tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:27.406035 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eeb19451-522a-41a1-bb58-c7f8a835363d tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:27.406985 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eeb19451-522a-41a1-bb58-c7f8a835363d tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:27.408009 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eeb19451-522a-41a1-bb58-c7f8a835363d tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:27.408451 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eeb19451-522a-41a1-bb58-c7f8a835363d tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:27.617446 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-eeb19451-522a-41a1-bb58-c7f8a835363d tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc27d58f027d4fc3b398f6c184911e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2650b8d88f4992a09bcf0048bcc4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:27.634237 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-eeb19451-522a-41a1-bb58-c7f8a835363d tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] 10.222.0.39 "GET /compute/v2.1/servers/6003ea94-8906-4657-85bd-999848adf23a" status: 200 len: 1512 microversion: 2.1 time: 0.242615 Aug 07 01:53:27.635023 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3177/5896] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:27 2022] GET /compute/v2.1/servers/6003ea94-8906-4657-85bd-999848adf23a => generated 1512 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:27.887782 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b16006ec-d68b-4620-ad5c-35a9e333e8b9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:27.888494 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b16006ec-d68b-4620-ad5c-35a9e333e8b9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:27.900975 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b16006ec-d68b-4620-ad5c-35a9e333e8b9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:27.901480 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b16006ec-d68b-4620-ad5c-35a9e333e8b9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:27.901921 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b16006ec-d68b-4620-ad5c-35a9e333e8b9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:27.902633 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b16006ec-d68b-4620-ad5c-35a9e333e8b9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:27.903075 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b16006ec-d68b-4620-ad5c-35a9e333e8b9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:27.903505 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b16006ec-d68b-4620-ad5c-35a9e333e8b9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:28.095103 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b16006ec-d68b-4620-ad5c-35a9e333e8b9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:28.109219 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b16006ec-d68b-4620-ad5c-35a9e333e8b9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1169 microversion: 2.1 time: 0.225868 Aug 07 01:53:28.110153 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2720/5897] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:27 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1169 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:28.367724 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3a069b6d-515b-406e-9d83-2f8ab01cf24e tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1776327436", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "b94a18d1-0efd-4680-a03d-2d57bb18aadb"}], "key_name": "tempest-TestNetworkBasicOps-1661870495", "security_groups": [{"name": "tempest-secgroup-smoke-1478614259"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:53:28.502440 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-3a069b6d-515b-406e-9d83-2f8ab01cf24e tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] validate_networks() for [('b94a18d1-0efd-4680-a03d-2d57bb18aadb', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:53:28.656714 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3958cf26-a7c4-4145-8cc2-24aa2a4cc8ee tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:28.657338 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3958cf26-a7c4-4145-8cc2-24aa2a4cc8ee tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] [instance: 6003ea94-8906-4657-85bd-999848adf23a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:28.665576 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3958cf26-a7c4-4145-8cc2-24aa2a4cc8ee tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:28.668442 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3958cf26-a7c4-4145-8cc2-24aa2a4cc8ee tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:28.669132 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3958cf26-a7c4-4145-8cc2-24aa2a4cc8ee tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:28.670141 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3958cf26-a7c4-4145-8cc2-24aa2a4cc8ee tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:28.670783 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3958cf26-a7c4-4145-8cc2-24aa2a4cc8ee tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:28.671218 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3958cf26-a7c4-4145-8cc2-24aa2a4cc8ee tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:28.675994 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:53:28.873445 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3958cf26-a7c4-4145-8cc2-24aa2a4cc8ee tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc27d58f027d4fc3b398f6c184911e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2650b8d88f4992a09bcf0048bcc4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:28.883190 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3958cf26-a7c4-4145-8cc2-24aa2a4cc8ee tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] 10.222.0.39 "GET /compute/v2.1/servers/6003ea94-8906-4657-85bd-999848adf23a" status: 200 len: 1512 microversion: 2.1 time: 0.230363 Aug 07 01:53:28.884697 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2721/5898] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:28 2022] GET /compute/v2.1/servers/6003ea94-8906-4657-85bd-999848adf23a => generated 1512 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:29.004931 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-3a069b6d-515b-406e-9d83-2f8ab01cf24e tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:53:29.005430 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-3a069b6d-515b-406e-9d83-2f8ab01cf24e tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:53:29.006020 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-3a069b6d-515b-406e-9d83-2f8ab01cf24e tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:53:29.006521 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-3a069b6d-515b-406e-9d83-2f8ab01cf24e tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:53:29.007031 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-3a069b6d-515b-406e-9d83-2f8ab01cf24e tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:53:29.018395 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a069b6d-515b-406e-9d83-2f8ab01cf24e tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:29.018889 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a069b6d-515b-406e-9d83-2f8ab01cf24e tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:29.019401 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a069b6d-515b-406e-9d83-2f8ab01cf24e tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:29.020181 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a069b6d-515b-406e-9d83-2f8ab01cf24e tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:29.020639 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a069b6d-515b-406e-9d83-2f8ab01cf24e tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:29.021094 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3a069b6d-515b-406e-9d83-2f8ab01cf24e tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:29.045787 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-3a069b6d-515b-406e-9d83-2f8ab01cf24e tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Getting quotas for project 2bd8662019804060a7b712456d095ad2. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:53:29.051815 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-3a069b6d-515b-406e-9d83-2f8ab01cf24e tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Getting quotas for user 073f0cff787a466a9fbf9fb43b03b726 and project 2bd8662019804060a7b712456d095ad2. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:53:29.054318 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:53:29.068735 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3a069b6d-515b-406e-9d83-2f8ab01cf24e tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:53:29.073226 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3a069b6d-515b-406e-9d83-2f8ab01cf24e tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: 2b339161-2aae-4caa-94b3-7d04fd07923c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:53:29.131290 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d98141fe-1f70-4e03-88be-934c6186b057 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:29.132515 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d98141fe-1f70-4e03-88be-934c6186b057 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:29.144359 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d98141fe-1f70-4e03-88be-934c6186b057 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:29.144751 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3a069b6d-515b-406e-9d83-2f8ab01cf24e tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.776686 Aug 07 01:53:29.144889 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d98141fe-1f70-4e03-88be-934c6186b057 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:29.145291 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d98141fe-1f70-4e03-88be-934c6186b057 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:29.145669 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3178/5899] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:53:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:53:29.149923 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d98141fe-1f70-4e03-88be-934c6186b057 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:29.154576 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d98141fe-1f70-4e03-88be-934c6186b057 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:29.155303 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d98141fe-1f70-4e03-88be-934c6186b057 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:29.157120 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4c04cd70-c216-4363-9298-f23c03940c7e tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:29.157986 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4c04cd70-c216-4363-9298-f23c03940c7e tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: 2b339161-2aae-4caa-94b3-7d04fd07923c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:29.323560 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4c04cd70-c216-4363-9298-f23c03940c7e tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:29.335116 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4c04cd70-c216-4363-9298-f23c03940c7e tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/2b339161-2aae-4caa-94b3-7d04fd07923c" status: 200 len: 1249 microversion: 2.1 time: 0.181878 Aug 07 01:53:29.337028 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3179/5900] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:29 2022] GET /compute/v2.1/servers/2b339161-2aae-4caa-94b3-7d04fd07923c => generated 1249 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:53:29.362903 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d98141fe-1f70-4e03-88be-934c6186b057 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:29.372966 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d98141fe-1f70-4e03-88be-934c6186b057 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1169 microversion: 2.1 time: 0.245541 Aug 07 01:53:29.387115 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2722/5901] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:29 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1169 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:29.650423 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-a7446fc4-2fa2-45c9-87bc-7c8bb703c02c req-f72b2a17-50af-4c1d-8a5e-2830119c8ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6003ea94-8906-4657-85bd-999848adf23a", "name": "network-vif-deleted", "tag": "9126c914-b893-40d5-9dcf-99c991799c8f"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:53:29.662739 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a7446fc4-2fa2-45c9-87bc-7c8bb703c02c req-f72b2a17-50af-4c1d-8a5e-2830119c8ff2 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:29.663229 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a7446fc4-2fa2-45c9-87bc-7c8bb703c02c req-f72b2a17-50af-4c1d-8a5e-2830119c8ff2 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:29.663666 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a7446fc4-2fa2-45c9-87bc-7c8bb703c02c req-f72b2a17-50af-4c1d-8a5e-2830119c8ff2 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:29.675196 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-a7446fc4-2fa2-45c9-87bc-7c8bb703c02c req-f72b2a17-50af-4c1d-8a5e-2830119c8ff2 service nova] Creating event network-vif-deleted:9126c914-b893-40d5-9dcf-99c991799c8f for instance 6003ea94-8906-4657-85bd-999848adf23a on n-h1-master-1 Aug 07 01:53:29.681652 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-a7446fc4-2fa2-45c9-87bc-7c8bb703c02c req-f72b2a17-50af-4c1d-8a5e-2830119c8ff2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034904 Aug 07 01:53:29.683234 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3180/5902] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:53:29.908341 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-969ececb-dac2-4393-8362-9e0be44477b0 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:29.909092 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-969ececb-dac2-4393-8362-9e0be44477b0 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] [instance: 6003ea94-8906-4657-85bd-999848adf23a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:29.911164 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:53:29.920422 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-969ececb-dac2-4393-8362-9e0be44477b0 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:29.921860 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-969ececb-dac2-4393-8362-9e0be44477b0 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:29.922497 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-969ececb-dac2-4393-8362-9e0be44477b0 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:29.923405 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-969ececb-dac2-4393-8362-9e0be44477b0 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:29.924267 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-969ececb-dac2-4393-8362-9e0be44477b0 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:29.924900 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-969ececb-dac2-4393-8362-9e0be44477b0 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:29.964702 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-969ececb-dac2-4393-8362-9e0be44477b0 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:29.965206 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-969ececb-dac2-4393-8362-9e0be44477b0 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:29.965648 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-969ececb-dac2-4393-8362-9e0be44477b0 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:29.966116 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-969ececb-dac2-4393-8362-9e0be44477b0 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lazy-loading 'fault' on Instance uuid 6003ea94-8906-4657-85bd-999848adf23a {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:53:30.028679 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-969ececb-dac2-4393-8362-9e0be44477b0 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc27d58f027d4fc3b398f6c184911e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2650b8d88f4992a09bcf0048bcc4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:30.042386 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-969ececb-dac2-4393-8362-9e0be44477b0 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] 10.222.0.39 "GET /compute/v2.1/servers/6003ea94-8906-4657-85bd-999848adf23a" status: 200 len: 1308 microversion: 2.1 time: 0.140911 Aug 07 01:53:30.046967 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2723/5903] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:29 2022] GET /compute/v2.1/servers/6003ea94-8906-4657-85bd-999848adf23a => generated 1308 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:30.359783 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-183e264d-bc55-4223-8802-475e4b6d5471 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:30.360535 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-183e264d-bc55-4223-8802-475e4b6d5471 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: 2b339161-2aae-4caa-94b3-7d04fd07923c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:30.366793 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-183e264d-bc55-4223-8802-475e4b6d5471 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:30.367272 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-183e264d-bc55-4223-8802-475e4b6d5471 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:30.367750 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-183e264d-bc55-4223-8802-475e4b6d5471 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:30.368472 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-183e264d-bc55-4223-8802-475e4b6d5471 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:30.368921 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-183e264d-bc55-4223-8802-475e4b6d5471 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:30.369341 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-183e264d-bc55-4223-8802-475e4b6d5471 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:30.395353 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4b224567-3cf8-491d-93af-c96d0481940c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:30.396642 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4b224567-3cf8-491d-93af-c96d0481940c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:30.405168 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b224567-3cf8-491d-93af-c96d0481940c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:30.405781 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b224567-3cf8-491d-93af-c96d0481940c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:30.406219 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b224567-3cf8-491d-93af-c96d0481940c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:30.406925 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b224567-3cf8-491d-93af-c96d0481940c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:30.407378 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b224567-3cf8-491d-93af-c96d0481940c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:30.407802 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b224567-3cf8-491d-93af-c96d0481940c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:30.437019 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-183e264d-bc55-4223-8802-475e4b6d5471 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:30.445374 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-183e264d-bc55-4223-8802-475e4b6d5471 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/2b339161-2aae-4caa-94b3-7d04fd07923c" status: 200 len: 1301 microversion: 2.1 time: 0.089660 Aug 07 01:53:30.446487 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3181/5904] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:30 2022] GET /compute/v2.1/servers/2b339161-2aae-4caa-94b3-7d04fd07923c => generated 1301 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:30.591195 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4b224567-3cf8-491d-93af-c96d0481940c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:30.606689 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4b224567-3cf8-491d-93af-c96d0481940c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1169 microversion: 2.1 time: 0.215031 Aug 07 01:53:30.622395 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2724/5905] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:30 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1169 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:31.067309 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f4a573f9-71ee-4c45-8594-c62801c76f33 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:31.068483 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f4a573f9-71ee-4c45-8594-c62801c76f33 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] [instance: 6003ea94-8906-4657-85bd-999848adf23a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:31.079655 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f4a573f9-71ee-4c45-8594-c62801c76f33 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:31.081850 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f4a573f9-71ee-4c45-8594-c62801c76f33 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:31.082357 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f4a573f9-71ee-4c45-8594-c62801c76f33 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:31.083221 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f4a573f9-71ee-4c45-8594-c62801c76f33 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:31.083685 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f4a573f9-71ee-4c45-8594-c62801c76f33 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:31.084294 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f4a573f9-71ee-4c45-8594-c62801c76f33 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:31.137097 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-f4a573f9-71ee-4c45-8594-c62801c76f33 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] HTTP exception thrown: Instance 6003ea94-8906-4657-85bd-999848adf23a could not be found. Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f4a573f9-71ee-4c45-8594-c62801c76f33 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Request method failure captured: Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/6003ea94-8906-4657-85bd-999848adf23a HTTP/1.1 Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xpoq5UL7EN0goeKS2LLfDh7f_5dc1ha2OFZf7EP32jDtoaeXblLUqTMx-kyABv3xSaGsXw7BxbHlJKDSn9KuyCSwyTqwzUyXNDSVQ94coPocPAJ1UmRF7Svi5s-zHMxgMqK9tycwy3VKbq-ZEh55hA8w0InVDavDpumOe9j7loBJy8 Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: da2650b8d88f4992a09bcf0048bcc4c2 Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1434859046 Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/da2650b8d88f4992a09bcf0048bcc4c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_da2650b8d88f4992a09bcf0048bcc4c2", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/da2650b8d88f4992a09bcf0048bcc4c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/da2650b8d88f4992a09bcf0048bcc4c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-VolumesSnapshotTestJSON-1434859046 Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: da2650b8d88f4992a09bcf0048bcc4c2 Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1434859046 Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-VolumesSnapshotTestJSON-1434859046-project Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: cc27d58f027d4fc3b398f6c184911e2e Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-VolumesSnapshotTestJSON-1434859046-project Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 6003ea94-8906-4657-85bd-999848adf23a could not be found. Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '6003ea94-8906-4657-85bd-999848adf23a'} Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6003ea94-8906-4657-85bd-999848adf23a could not be found. Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6003ea94-8906-4657-85bd-999848adf23a could not be found. Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:53:31.143239 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:53:31.148762 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:53:31.148762 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:53:31.148762 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:53:31.148762 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:53:31.148762 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:53:31.148762 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6003ea94-8906-4657-85bd-999848adf23a could not be found. Aug 07 01:53:31.148762 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:53:31.151105 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f4a573f9-71ee-4c45-8594-c62801c76f33 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Returning 404 to user: Instance 6003ea94-8906-4657-85bd-999848adf23a could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:53:31.154209 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f4a573f9-71ee-4c45-8594-c62801c76f33 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] 10.222.0.39 "GET /compute/v2.1/servers/6003ea94-8906-4657-85bd-999848adf23a" status: 404 len: 111 microversion: 2.1 time: 0.089247 Aug 07 01:53:31.155006 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3182/5906] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:31 2022] GET /compute/v2.1/servers/6003ea94-8906-4657-85bd-999848adf23a => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:53:31.467412 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f509818b-7e55-4eef-bfcd-2929288d9fdd tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:31.468336 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f509818b-7e55-4eef-bfcd-2929288d9fdd tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: 2b339161-2aae-4caa-94b3-7d04fd07923c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:31.481116 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f509818b-7e55-4eef-bfcd-2929288d9fdd tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:31.483817 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f509818b-7e55-4eef-bfcd-2929288d9fdd tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:31.487138 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f509818b-7e55-4eef-bfcd-2929288d9fdd tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:31.488065 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f509818b-7e55-4eef-bfcd-2929288d9fdd tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:31.488678 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f509818b-7e55-4eef-bfcd-2929288d9fdd tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:31.489177 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f509818b-7e55-4eef-bfcd-2929288d9fdd tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:31.628067 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5e73e3cb-e2ae-488a-8bf2-d01ff16aa0bd tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:31.628884 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5e73e3cb-e2ae-488a-8bf2-d01ff16aa0bd tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:31.640185 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e73e3cb-e2ae-488a-8bf2-d01ff16aa0bd tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:31.645289 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e73e3cb-e2ae-488a-8bf2-d01ff16aa0bd tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:31.648071 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e73e3cb-e2ae-488a-8bf2-d01ff16aa0bd tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:31.649995 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e73e3cb-e2ae-488a-8bf2-d01ff16aa0bd tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:31.650643 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e73e3cb-e2ae-488a-8bf2-d01ff16aa0bd tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:31.653798 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e73e3cb-e2ae-488a-8bf2-d01ff16aa0bd tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:31.868346 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f509818b-7e55-4eef-bfcd-2929288d9fdd tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:31.897236 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f509818b-7e55-4eef-bfcd-2929288d9fdd tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/2b339161-2aae-4caa-94b3-7d04fd07923c" status: 200 len: 1375 microversion: 2.1 time: 0.432052 Aug 07 01:53:31.899768 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2725/5907] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:31 2022] GET /compute/v2.1/servers/2b339161-2aae-4caa-94b3-7d04fd07923c => generated 1375 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:32.158738 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5e73e3cb-e2ae-488a-8bf2-d01ff16aa0bd tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:32.167343 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5e73e3cb-e2ae-488a-8bf2-d01ff16aa0bd tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1169 microversion: 2.1 time: 0.543304 Aug 07 01:53:32.170149 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3183/5908] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:31 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1169 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:32.890175 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-1bc34ffa-1c37-4b27-b555-158a9dfb04b0 req-3f60eb7d-b903-4648-a3a4-706336a55452 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b339161-2aae-4caa-94b3-7d04fd07923c", "tag": "317a7e2c-04b0-42a7-aeaf-9d27a1726c7a"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:53:32.921414 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-1bc34ffa-1c37-4b27-b555-158a9dfb04b0 req-3f60eb7d-b903-4648-a3a4-706336a55452 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:32.922942 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-1bc34ffa-1c37-4b27-b555-158a9dfb04b0 req-3f60eb7d-b903-4648-a3a4-706336a55452 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:32.924919 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-1bc34ffa-1c37-4b27-b555-158a9dfb04b0 req-3f60eb7d-b903-4648-a3a4-706336a55452 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:32.931704 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-120695c0-516f-40b0-8fb6-f17bc389ad83 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:32.932449 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-120695c0-516f-40b0-8fb6-f17bc389ad83 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: 2b339161-2aae-4caa-94b3-7d04fd07923c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:32.948249 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-120695c0-516f-40b0-8fb6-f17bc389ad83 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:32.948748 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-120695c0-516f-40b0-8fb6-f17bc389ad83 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:32.950515 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-1bc34ffa-1c37-4b27-b555-158a9dfb04b0 req-3f60eb7d-b903-4648-a3a4-706336a55452 service nova] Creating event network-changed:317a7e2c-04b0-42a7-aeaf-9d27a1726c7a for instance 2b339161-2aae-4caa-94b3-7d04fd07923c on n-h1-master-1 Aug 07 01:53:32.951081 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-120695c0-516f-40b0-8fb6-f17bc389ad83 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:32.951841 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-120695c0-516f-40b0-8fb6-f17bc389ad83 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:32.952341 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-120695c0-516f-40b0-8fb6-f17bc389ad83 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:32.952775 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-120695c0-516f-40b0-8fb6-f17bc389ad83 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:32.962706 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-1bc34ffa-1c37-4b27-b555-158a9dfb04b0 req-3f60eb7d-b903-4648-a3a4-706336a55452 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073752 Aug 07 01:53:32.963357 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2726/5909] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:53:33.194499 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8616a3d4-0174-4e6a-ad82-63b8fb159af7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:33.195477 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8616a3d4-0174-4e6a-ad82-63b8fb159af7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:33.210718 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8616a3d4-0174-4e6a-ad82-63b8fb159af7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:33.211286 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8616a3d4-0174-4e6a-ad82-63b8fb159af7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:33.211734 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8616a3d4-0174-4e6a-ad82-63b8fb159af7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:33.218063 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8616a3d4-0174-4e6a-ad82-63b8fb159af7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:33.218574 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8616a3d4-0174-4e6a-ad82-63b8fb159af7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:33.219024 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8616a3d4-0174-4e6a-ad82-63b8fb159af7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:33.412546 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-120695c0-516f-40b0-8fb6-f17bc389ad83 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:33.438960 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-120695c0-516f-40b0-8fb6-f17bc389ad83 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/2b339161-2aae-4caa-94b3-7d04fd07923c" status: 200 len: 1375 microversion: 2.1 time: 0.518002 Aug 07 01:53:33.440071 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3184/5910] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:32 2022] GET /compute/v2.1/servers/2b339161-2aae-4caa-94b3-7d04fd07923c => generated 1375 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:53:33.451459 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8616a3d4-0174-4e6a-ad82-63b8fb159af7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:33.463739 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8616a3d4-0174-4e6a-ad82-63b8fb159af7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1215 microversion: 2.1 time: 0.278270 Aug 07 01:53:33.465604 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2727/5911] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:33 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1215 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:34.461980 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-42765d1a-1dd9-4f15-ba33-0c9580f1ec95 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:34.462526 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-42765d1a-1dd9-4f15-ba33-0c9580f1ec95 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: 2b339161-2aae-4caa-94b3-7d04fd07923c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:34.469757 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42765d1a-1dd9-4f15-ba33-0c9580f1ec95 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:34.470299 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42765d1a-1dd9-4f15-ba33-0c9580f1ec95 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:34.470743 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42765d1a-1dd9-4f15-ba33-0c9580f1ec95 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:34.471480 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42765d1a-1dd9-4f15-ba33-0c9580f1ec95 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:34.471968 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42765d1a-1dd9-4f15-ba33-0c9580f1ec95 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:34.472405 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42765d1a-1dd9-4f15-ba33-0c9580f1ec95 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:34.487784 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6ee1ebe5-36ad-4fd5-92d9-0dc407925554 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:34.488723 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6ee1ebe5-36ad-4fd5-92d9-0dc407925554 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:34.497002 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ee1ebe5-36ad-4fd5-92d9-0dc407925554 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:34.497494 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ee1ebe5-36ad-4fd5-92d9-0dc407925554 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:34.498165 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ee1ebe5-36ad-4fd5-92d9-0dc407925554 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:34.498882 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ee1ebe5-36ad-4fd5-92d9-0dc407925554 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:34.499360 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ee1ebe5-36ad-4fd5-92d9-0dc407925554 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:34.499798 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ee1ebe5-36ad-4fd5-92d9-0dc407925554 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:34.648514 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-42765d1a-1dd9-4f15-ba33-0c9580f1ec95 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:34.658898 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-42765d1a-1dd9-4f15-ba33-0c9580f1ec95 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/2b339161-2aae-4caa-94b3-7d04fd07923c" status: 200 len: 1375 microversion: 2.1 time: 0.200032 Aug 07 01:53:34.674664 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3185/5912] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:34 2022] GET /compute/v2.1/servers/2b339161-2aae-4caa-94b3-7d04fd07923c => generated 1375 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:34.683394 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6ee1ebe5-36ad-4fd5-92d9-0dc407925554 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:34.693049 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6ee1ebe5-36ad-4fd5-92d9-0dc407925554 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1203 microversion: 2.1 time: 0.210036 Aug 07 01:53:34.696415 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2728/5913] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:34 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1203 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:53:35.682576 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-22917708-4ae0-446c-b90d-4b5e72a9dc23 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:35.683901 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-22917708-4ae0-446c-b90d-4b5e72a9dc23 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: 2b339161-2aae-4caa-94b3-7d04fd07923c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:35.691126 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22917708-4ae0-446c-b90d-4b5e72a9dc23 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:35.692116 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22917708-4ae0-446c-b90d-4b5e72a9dc23 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:35.692743 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22917708-4ae0-446c-b90d-4b5e72a9dc23 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:35.693642 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22917708-4ae0-446c-b90d-4b5e72a9dc23 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:35.694277 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22917708-4ae0-446c-b90d-4b5e72a9dc23 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:35.694714 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-22917708-4ae0-446c-b90d-4b5e72a9dc23 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:35.717412 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4c1fd14f-6651-4814-9c90-f3fbc3de77c5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:35.718278 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4c1fd14f-6651-4814-9c90-f3fbc3de77c5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:35.732922 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4c1fd14f-6651-4814-9c90-f3fbc3de77c5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:35.733569 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4c1fd14f-6651-4814-9c90-f3fbc3de77c5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:35.734152 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4c1fd14f-6651-4814-9c90-f3fbc3de77c5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:35.735163 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4c1fd14f-6651-4814-9c90-f3fbc3de77c5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:35.735727 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4c1fd14f-6651-4814-9c90-f3fbc3de77c5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:35.736355 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4c1fd14f-6651-4814-9c90-f3fbc3de77c5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:35.922763 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-22917708-4ae0-446c-b90d-4b5e72a9dc23 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:35.933815 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-22917708-4ae0-446c-b90d-4b5e72a9dc23 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/2b339161-2aae-4caa-94b3-7d04fd07923c" status: 200 len: 1375 microversion: 2.1 time: 0.255693 Aug 07 01:53:35.948114 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3186/5914] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:35 2022] GET /compute/v2.1/servers/2b339161-2aae-4caa-94b3-7d04fd07923c => generated 1375 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:36.004594 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4c1fd14f-6651-4814-9c90-f3fbc3de77c5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:36.012893 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4c1fd14f-6651-4814-9c90-f3fbc3de77c5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1203 microversion: 2.1 time: 0.302040 Aug 07 01:53:36.035909 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2729/5915] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:35 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1203 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:53:36.958739 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fbcf0db3-e290-4573-9a2f-754d29fd540c tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:36.960286 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fbcf0db3-e290-4573-9a2f-754d29fd540c tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: 2b339161-2aae-4caa-94b3-7d04fd07923c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:36.968510 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fbcf0db3-e290-4573-9a2f-754d29fd540c tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:36.969254 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fbcf0db3-e290-4573-9a2f-754d29fd540c tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:36.969809 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fbcf0db3-e290-4573-9a2f-754d29fd540c tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:36.970615 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fbcf0db3-e290-4573-9a2f-754d29fd540c tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:36.971186 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fbcf0db3-e290-4573-9a2f-754d29fd540c tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:36.971714 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fbcf0db3-e290-4573-9a2f-754d29fd540c tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:37.046319 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-59e6bcdc-3f7c-47bc-9086-779c188e5a8d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:37.047535 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-59e6bcdc-3f7c-47bc-9086-779c188e5a8d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:37.061259 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59e6bcdc-3f7c-47bc-9086-779c188e5a8d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:37.062493 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59e6bcdc-3f7c-47bc-9086-779c188e5a8d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:37.062948 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59e6bcdc-3f7c-47bc-9086-779c188e5a8d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:37.072870 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59e6bcdc-3f7c-47bc-9086-779c188e5a8d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:37.073753 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59e6bcdc-3f7c-47bc-9086-779c188e5a8d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:37.074397 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59e6bcdc-3f7c-47bc-9086-779c188e5a8d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:37.160792 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fbcf0db3-e290-4573-9a2f-754d29fd540c tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:37.170190 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fbcf0db3-e290-4573-9a2f-754d29fd540c tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/2b339161-2aae-4caa-94b3-7d04fd07923c" status: 200 len: 1375 microversion: 2.1 time: 0.215517 Aug 07 01:53:37.180874 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3187/5916] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:36 2022] GET /compute/v2.1/servers/2b339161-2aae-4caa-94b3-7d04fd07923c => generated 1375 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:37.248907 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-59e6bcdc-3f7c-47bc-9086-779c188e5a8d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:37.256949 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-59e6bcdc-3f7c-47bc-9086-779c188e5a8d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1203 microversion: 2.1 time: 0.215272 Aug 07 01:53:37.270824 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2730/5917] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:37 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1203 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:53:37.890814 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-ba3a9bb3-8f05-46c3-ab1d-b0dbd80d303b req-eb56ce43-255d-436a-bc1d-220eb9903af3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b339161-2aae-4caa-94b3-7d04fd07923c", "name": "network-vif-plugged", "status": "completed", "tag": "317a7e2c-04b0-42a7-aeaf-9d27a1726c7a"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:53:37.901571 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-ba3a9bb3-8f05-46c3-ab1d-b0dbd80d303b req-eb56ce43-255d-436a-bc1d-220eb9903af3 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:37.902149 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-ba3a9bb3-8f05-46c3-ab1d-b0dbd80d303b req-eb56ce43-255d-436a-bc1d-220eb9903af3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:37.902900 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-ba3a9bb3-8f05-46c3-ab1d-b0dbd80d303b req-eb56ce43-255d-436a-bc1d-220eb9903af3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:37.914995 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-ba3a9bb3-8f05-46c3-ab1d-b0dbd80d303b req-eb56ce43-255d-436a-bc1d-220eb9903af3 service nova] Creating event network-vif-plugged:317a7e2c-04b0-42a7-aeaf-9d27a1726c7a for instance 2b339161-2aae-4caa-94b3-7d04fd07923c on n-h1-master-1 Aug 07 01:53:37.920298 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-ba3a9bb3-8f05-46c3-ab1d-b0dbd80d303b req-eb56ce43-255d-436a-bc1d-220eb9903af3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033283 Aug 07 01:53:37.921141 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3188/5918] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:53:38.042657 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c341b727-6396-4b97-8c8c-eecd5fa20a61 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-921455813", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:53:38.098989 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-c341b727-6396-4b97-8c8c-eecd5fa20a61 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] validate_networks() for None {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:53:38.195536 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-36c7cd7e-1549-4b52-8d63-999dec3108e5 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:38.196449 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-36c7cd7e-1549-4b52-8d63-999dec3108e5 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: 2b339161-2aae-4caa-94b3-7d04fd07923c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:38.203103 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-36c7cd7e-1549-4b52-8d63-999dec3108e5 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:38.203728 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-36c7cd7e-1549-4b52-8d63-999dec3108e5 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:38.204283 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-36c7cd7e-1549-4b52-8d63-999dec3108e5 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:38.205137 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-36c7cd7e-1549-4b52-8d63-999dec3108e5 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:38.205665 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-36c7cd7e-1549-4b52-8d63-999dec3108e5 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:38.206182 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-36c7cd7e-1549-4b52-8d63-999dec3108e5 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:38.363195 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-36c7cd7e-1549-4b52-8d63-999dec3108e5 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:38.373218 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-36c7cd7e-1549-4b52-8d63-999dec3108e5 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/2b339161-2aae-4caa-94b3-7d04fd07923c" status: 200 len: 1375 microversion: 2.1 time: 0.182586 Aug 07 01:53:38.373803 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3189/5919] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:38 2022] GET /compute/v2.1/servers/2b339161-2aae-4caa-94b3-7d04fd07923c => generated 1375 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:53:38.379606 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-987cfdb8-8711-4a39-83ee-b3fc1a943764 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:38.380894 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-987cfdb8-8711-4a39-83ee-b3fc1a943764 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:38.389230 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-987cfdb8-8711-4a39-83ee-b3fc1a943764 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:38.389716 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-987cfdb8-8711-4a39-83ee-b3fc1a943764 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:38.390146 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-987cfdb8-8711-4a39-83ee-b3fc1a943764 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:38.390881 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-987cfdb8-8711-4a39-83ee-b3fc1a943764 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:38.391327 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-987cfdb8-8711-4a39-83ee-b3fc1a943764 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:38.391752 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-987cfdb8-8711-4a39-83ee-b3fc1a943764 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:38.403743 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-c341b727-6396-4b97-8c8c-eecd5fa20a61 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:53:38.404389 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-c341b727-6396-4b97-8c8c-eecd5fa20a61 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:53:38.405268 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-c341b727-6396-4b97-8c8c-eecd5fa20a61 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:53:38.405682 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-c341b727-6396-4b97-8c8c-eecd5fa20a61 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:53:38.406096 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-c341b727-6396-4b97-8c8c-eecd5fa20a61 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:53:38.415330 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c341b727-6396-4b97-8c8c-eecd5fa20a61 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:38.415812 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c341b727-6396-4b97-8c8c-eecd5fa20a61 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:38.416279 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c341b727-6396-4b97-8c8c-eecd5fa20a61 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:38.417005 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c341b727-6396-4b97-8c8c-eecd5fa20a61 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:38.417455 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c341b727-6396-4b97-8c8c-eecd5fa20a61 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:38.417877 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c341b727-6396-4b97-8c8c-eecd5fa20a61 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:38.435810 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-c341b727-6396-4b97-8c8c-eecd5fa20a61 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Getting quotas for project e4c73cd4714f4b34bf5f7f6f15989b52. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:53:38.444167 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-c341b727-6396-4b97-8c8c-eecd5fa20a61 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Getting quotas for user 2bc4703b0111425f9a46d1fee4884278 and project e4c73cd4714f4b34bf5f7f6f15989b52. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:53:38.459344 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c341b727-6396-4b97-8c8c-eecd5fa20a61 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:53:38.462608 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c341b727-6396-4b97-8c8c-eecd5fa20a61 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] [instance: de6ef509-00e7-4c2f-8cb6-a09cd1072032] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:53:38.542395 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c341b727-6396-4b97-8c8c-eecd5fa20a61 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.503589 Aug 07 01:53:38.549362 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2731/5920] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:53:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:53:38.554611 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c215ac53-e95b-4523-8835-95e77dbdf885 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:38.556124 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c215ac53-e95b-4523-8835-95e77dbdf885 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] [instance: de6ef509-00e7-4c2f-8cb6-a09cd1072032] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:38.618546 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-987cfdb8-8711-4a39-83ee-b3fc1a943764 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:38.637128 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-987cfdb8-8711-4a39-83ee-b3fc1a943764 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1203 microversion: 2.1 time: 0.261937 Aug 07 01:53:38.638318 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3190/5921] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:38 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1203 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:38.650270 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c215ac53-e95b-4523-8835-95e77dbdf885 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc4703b0111425f9a46d1fee4884278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c73cd4714f4b34bf5f7f6f15989b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:38.657405 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c215ac53-e95b-4523-8835-95e77dbdf885 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] 10.222.0.39 "GET /compute/v2.1/servers/de6ef509-00e7-4c2f-8cb6-a09cd1072032" status: 200 len: 1214 microversion: 2.1 time: 0.106597 Aug 07 01:53:38.657982 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2732/5922] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:38 2022] GET /compute/v2.1/servers/de6ef509-00e7-4c2f-8cb6-a09cd1072032 => generated 1214 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:39.276189 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a4f59897-8226-4e1e-9b35-aba72c134d85 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-712859989", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "adfea483-2e62-44b6-8772-34ff48413660"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:53:39.284207 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:53:39.328519 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=12 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:53:39.336679 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-a4f59897-8226-4e1e-9b35-aba72c134d85 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] validate_networks() for [('adfea483-2e62-44b6-8772-34ff48413660', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:53:39.394610 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e826d350-eb0f-4d53-a2ba-17c62e9ae308 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:39.395227 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e826d350-eb0f-4d53-a2ba-17c62e9ae308 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: 2b339161-2aae-4caa-94b3-7d04fd07923c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:39.403094 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e826d350-eb0f-4d53-a2ba-17c62e9ae308 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:39.403610 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e826d350-eb0f-4d53-a2ba-17c62e9ae308 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:39.404093 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e826d350-eb0f-4d53-a2ba-17c62e9ae308 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:39.404814 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e826d350-eb0f-4d53-a2ba-17c62e9ae308 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:39.405262 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e826d350-eb0f-4d53-a2ba-17c62e9ae308 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:39.405994 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e826d350-eb0f-4d53-a2ba-17c62e9ae308 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:39.557673 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e826d350-eb0f-4d53-a2ba-17c62e9ae308 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:39.565442 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e826d350-eb0f-4d53-a2ba-17c62e9ae308 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/2b339161-2aae-4caa-94b3-7d04fd07923c" status: 200 len: 1547 microversion: 2.1 time: 0.174727 Aug 07 01:53:39.566019 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2733/5923] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:39 2022] GET /compute/v2.1/servers/2b339161-2aae-4caa-94b3-7d04fd07923c => generated 1547 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:53:39.586627 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c62bee06-c028-4bc8-9b50-1aa5bf9105d3 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:39.587290 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c62bee06-c028-4bc8-9b50-1aa5bf9105d3 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: 2b339161-2aae-4caa-94b3-7d04fd07923c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:39.593528 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c62bee06-c028-4bc8-9b50-1aa5bf9105d3 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:39.594018 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c62bee06-c028-4bc8-9b50-1aa5bf9105d3 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:39.594460 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c62bee06-c028-4bc8-9b50-1aa5bf9105d3 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:39.595177 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c62bee06-c028-4bc8-9b50-1aa5bf9105d3 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:39.595679 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c62bee06-c028-4bc8-9b50-1aa5bf9105d3 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:39.596135 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c62bee06-c028-4bc8-9b50-1aa5bf9105d3 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:39.712281 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-a4f59897-8226-4e1e-9b35-aba72c134d85 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:53:39.712707 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-a4f59897-8226-4e1e-9b35-aba72c134d85 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:53:39.713218 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-a4f59897-8226-4e1e-9b35-aba72c134d85 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:53:39.713636 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-a4f59897-8226-4e1e-9b35-aba72c134d85 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:53:39.714054 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-a4f59897-8226-4e1e-9b35-aba72c134d85 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:53:39.723587 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4f59897-8226-4e1e-9b35-aba72c134d85 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:39.724104 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4f59897-8226-4e1e-9b35-aba72c134d85 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:39.724556 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4f59897-8226-4e1e-9b35-aba72c134d85 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:39.725323 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4f59897-8226-4e1e-9b35-aba72c134d85 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:39.725814 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4f59897-8226-4e1e-9b35-aba72c134d85 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:39.726303 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4f59897-8226-4e1e-9b35-aba72c134d85 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:39.736698 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c62bee06-c028-4bc8-9b50-1aa5bf9105d3 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:39.745532 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c62bee06-c028-4bc8-9b50-1aa5bf9105d3 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/2b339161-2aae-4caa-94b3-7d04fd07923c" status: 200 len: 1547 microversion: 2.1 time: 0.162799 Aug 07 01:53:39.746114 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-a4f59897-8226-4e1e-9b35-aba72c134d85 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Getting quotas for project da2650b8d88f4992a09bcf0048bcc4c2. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:53:39.746292 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2734/5924] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:39 2022] GET /compute/v2.1/servers/2b339161-2aae-4caa-94b3-7d04fd07923c => generated 1547 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:39.750694 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f25f959f-a76a-40e8-89f2-09dcf4068b6c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:39.751454 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f25f959f-a76a-40e8-89f2-09dcf4068b6c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:39.752553 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-a4f59897-8226-4e1e-9b35-aba72c134d85 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Getting quotas for user cc27d58f027d4fc3b398f6c184911e2e and project da2650b8d88f4992a09bcf0048bcc4c2. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:53:39.759578 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f25f959f-a76a-40e8-89f2-09dcf4068b6c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:39.760098 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f25f959f-a76a-40e8-89f2-09dcf4068b6c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:39.760727 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f25f959f-a76a-40e8-89f2-09dcf4068b6c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:39.762374 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f25f959f-a76a-40e8-89f2-09dcf4068b6c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:39.762888 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f25f959f-a76a-40e8-89f2-09dcf4068b6c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:39.763337 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f25f959f-a76a-40e8-89f2-09dcf4068b6c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:39.766559 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a4f59897-8226-4e1e-9b35-aba72c134d85 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:53:39.769018 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a4f59897-8226-4e1e-9b35-aba72c134d85 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] [instance: 9eac877e-1520-4bc6-926a-41df6c09e3c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:53:39.831334 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a4f59897-8226-4e1e-9b35-aba72c134d85 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.559228 Aug 07 01:53:39.839534 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3191/5925] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:53:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:53:39.845291 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-26f323cd-1b29-40ad-b1b2-640f50ddfae0 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:39.846204 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-26f323cd-1b29-40ad-b1b2-640f50ddfae0 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] [instance: de6ef509-00e7-4c2f-8cb6-a09cd1072032] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:39.854405 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-26f323cd-1b29-40ad-b1b2-640f50ddfae0 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:39.855205 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-26f323cd-1b29-40ad-b1b2-640f50ddfae0 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:39.855940 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-26f323cd-1b29-40ad-b1b2-640f50ddfae0 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:39.856909 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-26f323cd-1b29-40ad-b1b2-640f50ddfae0 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:39.857538 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-26f323cd-1b29-40ad-b1b2-640f50ddfae0 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:39.858194 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-26f323cd-1b29-40ad-b1b2-640f50ddfae0 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:39.968635 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f25f959f-a76a-40e8-89f2-09dcf4068b6c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:39.982405 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f25f959f-a76a-40e8-89f2-09dcf4068b6c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1203 microversion: 2.1 time: 0.235227 Aug 07 01:53:39.983003 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2735/5926] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:39 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1203 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:39.992847 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-26f323cd-1b29-40ad-b1b2-640f50ddfae0 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc4703b0111425f9a46d1fee4884278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c73cd4714f4b34bf5f7f6f15989b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:40.001534 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3528fcc6-db72-4ee9-96c5-820d0bed2b94 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:40.002172 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3528fcc6-db72-4ee9-96c5-820d0bed2b94 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] [instance: 9eac877e-1520-4bc6-926a-41df6c09e3c2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:40.003481 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-26f323cd-1b29-40ad-b1b2-640f50ddfae0 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] 10.222.0.39 "GET /compute/v2.1/servers/de6ef509-00e7-4c2f-8cb6-a09cd1072032" status: 200 len: 1274 microversion: 2.1 time: 0.162282 Aug 07 01:53:40.005566 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3192/5927] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:39 2022] GET /compute/v2.1/servers/de6ef509-00e7-4c2f-8cb6-a09cd1072032 => generated 1274 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:40.080542 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3528fcc6-db72-4ee9-96c5-820d0bed2b94 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc27d58f027d4fc3b398f6c184911e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2650b8d88f4992a09bcf0048bcc4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:40.088591 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3528fcc6-db72-4ee9-96c5-820d0bed2b94 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] 10.222.0.39 "GET /compute/v2.1/servers/9eac877e-1520-4bc6-926a-41df6c09e3c2" status: 200 len: 1218 microversion: 2.1 time: 0.104344 Aug 07 01:53:40.089434 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2736/5928] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:39 2022] GET /compute/v2.1/servers/9eac877e-1520-4bc6-926a-41df6c09e3c2 => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:41.003741 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-df057760-f808-4513-9958-c5fb51225e7a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:41.004361 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-df057760-f808-4513-9958-c5fb51225e7a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:41.015398 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df057760-f808-4513-9958-c5fb51225e7a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:41.015930 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df057760-f808-4513-9958-c5fb51225e7a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:41.016555 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df057760-f808-4513-9958-c5fb51225e7a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:41.017445 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df057760-f808-4513-9958-c5fb51225e7a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:41.018070 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df057760-f808-4513-9958-c5fb51225e7a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:41.018696 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df057760-f808-4513-9958-c5fb51225e7a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:41.025905 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-df89719c-17ed-42f9-9705-b3e8874a05c5 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:41.027214 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-df89719c-17ed-42f9-9705-b3e8874a05c5 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] [instance: de6ef509-00e7-4c2f-8cb6-a09cd1072032] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:41.038787 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-df89719c-17ed-42f9-9705-b3e8874a05c5 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:41.045029 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-df89719c-17ed-42f9-9705-b3e8874a05c5 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:41.045578 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-df89719c-17ed-42f9-9705-b3e8874a05c5 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:41.046538 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-df89719c-17ed-42f9-9705-b3e8874a05c5 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:41.047241 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-df89719c-17ed-42f9-9705-b3e8874a05c5 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:41.047963 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-df89719c-17ed-42f9-9705-b3e8874a05c5 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:41.161126 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-df89719c-17ed-42f9-9705-b3e8874a05c5 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc4703b0111425f9a46d1fee4884278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c73cd4714f4b34bf5f7f6f15989b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:41.170839 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-df89719c-17ed-42f9-9705-b3e8874a05c5 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] 10.222.0.39 "GET /compute/v2.1/servers/de6ef509-00e7-4c2f-8cb6-a09cd1072032" status: 200 len: 1272 microversion: 2.1 time: 0.149230 Aug 07 01:53:41.171807 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2737/5929] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:41 2022] GET /compute/v2.1/servers/de6ef509-00e7-4c2f-8cb6-a09cd1072032 => generated 1272 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:53:41.178482 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cebe5e32-d6a5-48ab-aeef-2557d7f29eb5 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:41.179108 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-cebe5e32-d6a5-48ab-aeef-2557d7f29eb5 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] [instance: 9eac877e-1520-4bc6-926a-41df6c09e3c2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:41.185393 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cebe5e32-d6a5-48ab-aeef-2557d7f29eb5 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:41.185894 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cebe5e32-d6a5-48ab-aeef-2557d7f29eb5 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:41.186333 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cebe5e32-d6a5-48ab-aeef-2557d7f29eb5 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:41.187072 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cebe5e32-d6a5-48ab-aeef-2557d7f29eb5 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:41.187532 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cebe5e32-d6a5-48ab-aeef-2557d7f29eb5 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:41.188002 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cebe5e32-d6a5-48ab-aeef-2557d7f29eb5 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:41.261583 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-cebe5e32-d6a5-48ab-aeef-2557d7f29eb5 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc27d58f027d4fc3b398f6c184911e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2650b8d88f4992a09bcf0048bcc4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:41.270054 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cebe5e32-d6a5-48ab-aeef-2557d7f29eb5 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] 10.222.0.39 "GET /compute/v2.1/servers/9eac877e-1520-4bc6-926a-41df6c09e3c2" status: 200 len: 1276 microversion: 2.1 time: 0.097073 Aug 07 01:53:41.284632 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2738/5930] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:41 2022] GET /compute/v2.1/servers/9eac877e-1520-4bc6-926a-41df6c09e3c2 => generated 1276 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:41.473574 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-df057760-f808-4513-9958-c5fb51225e7a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:41.486069 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-df057760-f808-4513-9958-c5fb51225e7a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1203 microversion: 2.1 time: 0.486298 Aug 07 01:53:41.487073 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3193/5931] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:40 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1203 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:42.195556 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-28e435b1-a99b-4fd3-8ebc-b62ca9c71e87 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:42.196221 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-28e435b1-a99b-4fd3-8ebc-b62ca9c71e87 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] [instance: de6ef509-00e7-4c2f-8cb6-a09cd1072032] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:42.212811 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28e435b1-a99b-4fd3-8ebc-b62ca9c71e87 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:42.213220 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28e435b1-a99b-4fd3-8ebc-b62ca9c71e87 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:42.230174 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28e435b1-a99b-4fd3-8ebc-b62ca9c71e87 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:42.231314 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28e435b1-a99b-4fd3-8ebc-b62ca9c71e87 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:42.232084 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28e435b1-a99b-4fd3-8ebc-b62ca9c71e87 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:42.234463 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28e435b1-a99b-4fd3-8ebc-b62ca9c71e87 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:42.293296 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ccf70362-e9b3-43c6-bfe7-a17ec28dc3e1 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:42.294729 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ccf70362-e9b3-43c6-bfe7-a17ec28dc3e1 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] [instance: 9eac877e-1520-4bc6-926a-41df6c09e3c2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:42.303813 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ccf70362-e9b3-43c6-bfe7-a17ec28dc3e1 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:42.304714 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ccf70362-e9b3-43c6-bfe7-a17ec28dc3e1 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:42.305793 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ccf70362-e9b3-43c6-bfe7-a17ec28dc3e1 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:42.307236 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ccf70362-e9b3-43c6-bfe7-a17ec28dc3e1 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:42.308172 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ccf70362-e9b3-43c6-bfe7-a17ec28dc3e1 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:42.308952 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ccf70362-e9b3-43c6-bfe7-a17ec28dc3e1 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:42.701367 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ccf70362-e9b3-43c6-bfe7-a17ec28dc3e1 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc27d58f027d4fc3b398f6c184911e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2650b8d88f4992a09bcf0048bcc4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:42.709921 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ccf70362-e9b3-43c6-bfe7-a17ec28dc3e1 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] 10.222.0.39 "GET /compute/v2.1/servers/9eac877e-1520-4bc6-926a-41df6c09e3c2" status: 200 len: 1318 microversion: 2.1 time: 0.421149 Aug 07 01:53:42.725278 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3194/5932] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:42 2022] GET /compute/v2.1/servers/9eac877e-1520-4bc6-926a-41df6c09e3c2 => generated 1318 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:42.731834 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-c5a1ce52-5b14-4213-8f12-b14d35818006 req-40f3a8ec-f3d9-4db7-991e-c51b68e3ffa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e1e1fd5-843d-43bc-8db2-64300be0f1d0", "name": "network-vif-plugged", "status": "completed", "tag": "239d284e-48d9-4855-a1c1-a6149e35827d"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:53:42.743362 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c5a1ce52-5b14-4213-8f12-b14d35818006 req-40f3a8ec-f3d9-4db7-991e-c51b68e3ffa4 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:42.744295 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c5a1ce52-5b14-4213-8f12-b14d35818006 req-40f3a8ec-f3d9-4db7-991e-c51b68e3ffa4 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:42.745307 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c5a1ce52-5b14-4213-8f12-b14d35818006 req-40f3a8ec-f3d9-4db7-991e-c51b68e3ffa4 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:42.759585 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-c5a1ce52-5b14-4213-8f12-b14d35818006 req-40f3a8ec-f3d9-4db7-991e-c51b68e3ffa4 service nova] Creating event network-vif-plugged:239d284e-48d9-4855-a1c1-a6149e35827d for instance 2e1e1fd5-843d-43bc-8db2-64300be0f1d0 on n-h2-master-1 Aug 07 01:53:42.764939 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-c5a1ce52-5b14-4213-8f12-b14d35818006 req-40f3a8ec-f3d9-4db7-991e-c51b68e3ffa4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037548 Aug 07 01:53:42.766053 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3195/5933] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:53:42.771969 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1cd58370-8c59-4788-9e62-5d5d581eef49 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:42.772755 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1cd58370-8c59-4788-9e62-5d5d581eef49 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:42.779699 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1cd58370-8c59-4788-9e62-5d5d581eef49 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:42.780315 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1cd58370-8c59-4788-9e62-5d5d581eef49 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:42.780974 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1cd58370-8c59-4788-9e62-5d5d581eef49 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:42.781750 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1cd58370-8c59-4788-9e62-5d5d581eef49 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:42.782276 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1cd58370-8c59-4788-9e62-5d5d581eef49 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:42.782767 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1cd58370-8c59-4788-9e62-5d5d581eef49 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:42.807364 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-28e435b1-a99b-4fd3-8ebc-b62ca9c71e87 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc4703b0111425f9a46d1fee4884278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c73cd4714f4b34bf5f7f6f15989b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:42.829448 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-28e435b1-a99b-4fd3-8ebc-b62ca9c71e87 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] 10.222.0.39 "GET /compute/v2.1/servers/de6ef509-00e7-4c2f-8cb6-a09cd1072032" status: 200 len: 1314 microversion: 2.1 time: 0.640335 Aug 07 01:53:42.832376 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2739/5934] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:42 2022] GET /compute/v2.1/servers/de6ef509-00e7-4c2f-8cb6-a09cd1072032 => generated 1314 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:42.899014 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-a7747cbf-ffea-41e8-a945-4fb54c53fb13 req-1d8b023b-d6f1-4dcd-a97e-36ea4839858a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9eac877e-1520-4bc6-926a-41df6c09e3c2", "tag": "5a533663-cc92-4129-8d33-23b26e354b1e"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:53:42.915425 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a7747cbf-ffea-41e8-a945-4fb54c53fb13 req-1d8b023b-d6f1-4dcd-a97e-36ea4839858a service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:42.916293 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a7747cbf-ffea-41e8-a945-4fb54c53fb13 req-1d8b023b-d6f1-4dcd-a97e-36ea4839858a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:42.916825 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a7747cbf-ffea-41e8-a945-4fb54c53fb13 req-1d8b023b-d6f1-4dcd-a97e-36ea4839858a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:42.937407 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-a7747cbf-ffea-41e8-a945-4fb54c53fb13 req-1d8b023b-d6f1-4dcd-a97e-36ea4839858a service nova] Creating event network-changed:5a533663-cc92-4129-8d33-23b26e354b1e for instance 9eac877e-1520-4bc6-926a-41df6c09e3c2 on n-h2-master-1 Aug 07 01:53:42.945630 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-a7747cbf-ffea-41e8-a945-4fb54c53fb13 req-1d8b023b-d6f1-4dcd-a97e-36ea4839858a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052523 Aug 07 01:53:42.946253 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2740/5935] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:53:43.227816 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1cd58370-8c59-4788-9e62-5d5d581eef49 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:43.239095 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1cd58370-8c59-4788-9e62-5d5d581eef49 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1203 microversion: 2.1 time: 0.471604 Aug 07 01:53:43.239690 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3196/5936] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:42 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1203 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:43.607691 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-905a4ea7-910f-4eb4-b0f1-95e665882ba3 req-ec5f39ea-7d6a-4005-ab2e-10a26e9f7823 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de6ef509-00e7-4c2f-8cb6-a09cd1072032", "tag": "0701c4ac-00c9-45c7-bae3-e30525c6470f"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:53:43.618920 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-905a4ea7-910f-4eb4-b0f1-95e665882ba3 req-ec5f39ea-7d6a-4005-ab2e-10a26e9f7823 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:43.619997 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-905a4ea7-910f-4eb4-b0f1-95e665882ba3 req-ec5f39ea-7d6a-4005-ab2e-10a26e9f7823 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:43.620657 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-905a4ea7-910f-4eb4-b0f1-95e665882ba3 req-ec5f39ea-7d6a-4005-ab2e-10a26e9f7823 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:43.636231 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-905a4ea7-910f-4eb4-b0f1-95e665882ba3 req-ec5f39ea-7d6a-4005-ab2e-10a26e9f7823 service nova] Creating event network-changed:0701c4ac-00c9-45c7-bae3-e30525c6470f for instance de6ef509-00e7-4c2f-8cb6-a09cd1072032 on n-h1-master-1 Aug 07 01:53:43.651972 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-905a4ea7-910f-4eb4-b0f1-95e665882ba3 req-ec5f39ea-7d6a-4005-ab2e-10a26e9f7823 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040045 Aug 07 01:53:43.653353 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2741/5937] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:53:43.731350 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f45b0967-71cd-4b5a-94e4-5c264c6756bb tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:43.732725 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f45b0967-71cd-4b5a-94e4-5c264c6756bb tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] [instance: 9eac877e-1520-4bc6-926a-41df6c09e3c2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:43.740416 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f45b0967-71cd-4b5a-94e4-5c264c6756bb tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:43.740907 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f45b0967-71cd-4b5a-94e4-5c264c6756bb tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:43.741346 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f45b0967-71cd-4b5a-94e4-5c264c6756bb tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:43.742343 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f45b0967-71cd-4b5a-94e4-5c264c6756bb tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:43.742800 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f45b0967-71cd-4b5a-94e4-5c264c6756bb tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:43.743230 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f45b0967-71cd-4b5a-94e4-5c264c6756bb tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:43.854573 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a1ba1032-4284-4470-a169-c2e9f5185472 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:43.855448 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a1ba1032-4284-4470-a169-c2e9f5185472 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] [instance: de6ef509-00e7-4c2f-8cb6-a09cd1072032] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:43.865440 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a1ba1032-4284-4470-a169-c2e9f5185472 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:43.866302 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a1ba1032-4284-4470-a169-c2e9f5185472 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:43.867191 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a1ba1032-4284-4470-a169-c2e9f5185472 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:43.868992 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a1ba1032-4284-4470-a169-c2e9f5185472 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:43.869823 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a1ba1032-4284-4470-a169-c2e9f5185472 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:43.870329 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a1ba1032-4284-4470-a169-c2e9f5185472 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:43.875014 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:53:44.001291 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f45b0967-71cd-4b5a-94e4-5c264c6756bb tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc27d58f027d4fc3b398f6c184911e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2650b8d88f4992a09bcf0048bcc4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:44.009762 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f45b0967-71cd-4b5a-94e4-5c264c6756bb tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] 10.222.0.39 "GET /compute/v2.1/servers/9eac877e-1520-4bc6-926a-41df6c09e3c2" status: 200 len: 1318 microversion: 2.1 time: 0.282790 Aug 07 01:53:44.010929 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3197/5938] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:43 2022] GET /compute/v2.1/servers/9eac877e-1520-4bc6-926a-41df6c09e3c2 => generated 1318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:44.043346 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a1ba1032-4284-4470-a169-c2e9f5185472 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc4703b0111425f9a46d1fee4884278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c73cd4714f4b34bf5f7f6f15989b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:44.053656 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a1ba1032-4284-4470-a169-c2e9f5185472 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] 10.222.0.39 "GET /compute/v2.1/servers/de6ef509-00e7-4c2f-8cb6-a09cd1072032" status: 200 len: 1314 microversion: 2.1 time: 0.204468 Aug 07 01:53:44.054296 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2742/5939] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:43 2022] GET /compute/v2.1/servers/de6ef509-00e7-4c2f-8cb6-a09cd1072032 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:53:44.260361 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5524b4b0-fd75-4821-a1a5-54d53f819c90 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:44.260943 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5524b4b0-fd75-4821-a1a5-54d53f819c90 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:44.267487 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5524b4b0-fd75-4821-a1a5-54d53f819c90 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:44.268021 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5524b4b0-fd75-4821-a1a5-54d53f819c90 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:44.268469 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5524b4b0-fd75-4821-a1a5-54d53f819c90 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:44.269188 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5524b4b0-fd75-4821-a1a5-54d53f819c90 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:44.269648 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5524b4b0-fd75-4821-a1a5-54d53f819c90 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:44.270088 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5524b4b0-fd75-4821-a1a5-54d53f819c90 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:44.276421 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:53:44.577666 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5524b4b0-fd75-4821-a1a5-54d53f819c90 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:44.586239 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5524b4b0-fd75-4821-a1a5-54d53f819c90 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1203 microversion: 2.1 time: 0.329500 Aug 07 01:53:44.586821 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3198/5940] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:44 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1203 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:45.034960 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e1196d55-be64-4e0e-9b34-c1c50b7769c0 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:45.035531 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e1196d55-be64-4e0e-9b34-c1c50b7769c0 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] [instance: 9eac877e-1520-4bc6-926a-41df6c09e3c2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:45.043835 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1196d55-be64-4e0e-9b34-c1c50b7769c0 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:45.044526 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1196d55-be64-4e0e-9b34-c1c50b7769c0 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:45.045113 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1196d55-be64-4e0e-9b34-c1c50b7769c0 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:45.045983 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1196d55-be64-4e0e-9b34-c1c50b7769c0 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:45.046733 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1196d55-be64-4e0e-9b34-c1c50b7769c0 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:45.047388 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e1196d55-be64-4e0e-9b34-c1c50b7769c0 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:45.077932 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b09fb810-53d0-44d6-a9a7-f17749907d39 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:45.078784 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b09fb810-53d0-44d6-a9a7-f17749907d39 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] [instance: de6ef509-00e7-4c2f-8cb6-a09cd1072032] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:45.086399 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b09fb810-53d0-44d6-a9a7-f17749907d39 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:45.087220 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b09fb810-53d0-44d6-a9a7-f17749907d39 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:45.088163 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b09fb810-53d0-44d6-a9a7-f17749907d39 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:45.089148 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b09fb810-53d0-44d6-a9a7-f17749907d39 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:45.089711 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b09fb810-53d0-44d6-a9a7-f17749907d39 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:45.090447 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b09fb810-53d0-44d6-a9a7-f17749907d39 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:45.239296 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b09fb810-53d0-44d6-a9a7-f17749907d39 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc4703b0111425f9a46d1fee4884278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c73cd4714f4b34bf5f7f6f15989b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:45.247672 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b09fb810-53d0-44d6-a9a7-f17749907d39 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] 10.222.0.39 "GET /compute/v2.1/servers/de6ef509-00e7-4c2f-8cb6-a09cd1072032" status: 200 len: 1314 microversion: 2.1 time: 0.175958 Aug 07 01:53:45.248322 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3199/5941] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:45 2022] GET /compute/v2.1/servers/de6ef509-00e7-4c2f-8cb6-a09cd1072032 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:53:45.280963 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e1196d55-be64-4e0e-9b34-c1c50b7769c0 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc27d58f027d4fc3b398f6c184911e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2650b8d88f4992a09bcf0048bcc4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:45.289129 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e1196d55-be64-4e0e-9b34-c1c50b7769c0 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] 10.222.0.39 "GET /compute/v2.1/servers/9eac877e-1520-4bc6-926a-41df6c09e3c2" status: 200 len: 1318 microversion: 2.1 time: 0.262410 Aug 07 01:53:45.289707 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2743/5942] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:45 2022] GET /compute/v2.1/servers/9eac877e-1520-4bc6-926a-41df6c09e3c2 => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:45.607039 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2f89c91b-69a8-4f29-bbdd-fe2e6088307a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:45.607657 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2f89c91b-69a8-4f29-bbdd-fe2e6088307a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:45.613659 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f89c91b-69a8-4f29-bbdd-fe2e6088307a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:45.614146 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f89c91b-69a8-4f29-bbdd-fe2e6088307a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:45.614587 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f89c91b-69a8-4f29-bbdd-fe2e6088307a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:45.615287 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f89c91b-69a8-4f29-bbdd-fe2e6088307a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:45.615747 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f89c91b-69a8-4f29-bbdd-fe2e6088307a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:45.616201 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f89c91b-69a8-4f29-bbdd-fe2e6088307a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:45.711359 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-22788b4d-2c88-47f2-90ac-6a9c54452a31 req-a7ae9cd9-501a-4862-8361-96aa80873eff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b339161-2aae-4caa-94b3-7d04fd07923c", "tag": "317a7e2c-04b0-42a7-aeaf-9d27a1726c7a"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:53:45.720795 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-22788b4d-2c88-47f2-90ac-6a9c54452a31 req-a7ae9cd9-501a-4862-8361-96aa80873eff service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:45.721278 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-22788b4d-2c88-47f2-90ac-6a9c54452a31 req-a7ae9cd9-501a-4862-8361-96aa80873eff service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:45.721706 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-22788b4d-2c88-47f2-90ac-6a9c54452a31 req-a7ae9cd9-501a-4862-8361-96aa80873eff service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:45.734038 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-22788b4d-2c88-47f2-90ac-6a9c54452a31 req-a7ae9cd9-501a-4862-8361-96aa80873eff service nova] Creating event network-changed:317a7e2c-04b0-42a7-aeaf-9d27a1726c7a for instance 2b339161-2aae-4caa-94b3-7d04fd07923c on n-h1-master-1 Aug 07 01:53:45.739357 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-22788b4d-2c88-47f2-90ac-6a9c54452a31 req-a7ae9cd9-501a-4862-8361-96aa80873eff service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031615 Aug 07 01:53:45.740385 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2744/5943] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:53:45.856623 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2f89c91b-69a8-4f29-bbdd-fe2e6088307a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:45.864618 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2f89c91b-69a8-4f29-bbdd-fe2e6088307a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1391 microversion: 2.1 time: 0.261329 Aug 07 01:53:45.867172 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3200/5944] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:45 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1391 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:45.886446 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-847b40ae-5d83-4b49-8e0a-883d188fc4b3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:45.887232 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-847b40ae-5d83-4b49-8e0a-883d188fc4b3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:45.893635 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-847b40ae-5d83-4b49-8e0a-883d188fc4b3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:45.895314 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-847b40ae-5d83-4b49-8e0a-883d188fc4b3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:45.895314 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-847b40ae-5d83-4b49-8e0a-883d188fc4b3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:45.895314 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-847b40ae-5d83-4b49-8e0a-883d188fc4b3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:45.896027 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-847b40ae-5d83-4b49-8e0a-883d188fc4b3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:45.896760 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-847b40ae-5d83-4b49-8e0a-883d188fc4b3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:46.144624 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-847b40ae-5d83-4b49-8e0a-883d188fc4b3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:46.153824 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-847b40ae-5d83-4b49-8e0a-883d188fc4b3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1391 microversion: 2.1 time: 0.271729 Aug 07 01:53:46.154526 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2745/5945] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:45 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1391 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:46.174148 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dab444c8-e28e-464f-9946-ed3ad6a91637 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:46.175372 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-dab444c8-e28e-464f-9946-ed3ad6a91637 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:46.182017 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dab444c8-e28e-464f-9946-ed3ad6a91637 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:46.182770 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dab444c8-e28e-464f-9946-ed3ad6a91637 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:46.183204 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dab444c8-e28e-464f-9946-ed3ad6a91637 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:46.184237 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dab444c8-e28e-464f-9946-ed3ad6a91637 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:46.184865 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dab444c8-e28e-464f-9946-ed3ad6a91637 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:46.185315 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dab444c8-e28e-464f-9946-ed3ad6a91637 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:46.270231 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8a82746b-8e2d-4732-b212-7f1b7a36de59 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:46.270613 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8a82746b-8e2d-4732-b212-7f1b7a36de59 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] [instance: de6ef509-00e7-4c2f-8cb6-a09cd1072032] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:46.283308 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a82746b-8e2d-4732-b212-7f1b7a36de59 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:46.283793 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a82746b-8e2d-4732-b212-7f1b7a36de59 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:46.284442 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a82746b-8e2d-4732-b212-7f1b7a36de59 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:46.285309 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a82746b-8e2d-4732-b212-7f1b7a36de59 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:46.285919 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a82746b-8e2d-4732-b212-7f1b7a36de59 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:46.286501 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a82746b-8e2d-4732-b212-7f1b7a36de59 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:46.343159 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-dab444c8-e28e-464f-9946-ed3ad6a91637 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:46.353007 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-dab444c8-e28e-464f-9946-ed3ad6a91637 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1391 microversion: 2.1 time: 0.183032 Aug 07 01:53:46.353691 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3201/5946] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:46 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1391 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:46.359256 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b8801a10-9b7b-4a9f-b956-6a1841397adb tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:46.360408 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b8801a10-9b7b-4a9f-b956-6a1841397adb tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] [instance: 9eac877e-1520-4bc6-926a-41df6c09e3c2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:46.367448 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b8801a10-9b7b-4a9f-b956-6a1841397adb tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:46.368296 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b8801a10-9b7b-4a9f-b956-6a1841397adb tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:46.369106 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b8801a10-9b7b-4a9f-b956-6a1841397adb tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:46.370272 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b8801a10-9b7b-4a9f-b956-6a1841397adb tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:46.370789 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b8801a10-9b7b-4a9f-b956-6a1841397adb tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:46.371469 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b8801a10-9b7b-4a9f-b956-6a1841397adb tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:46.517384 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b8801a10-9b7b-4a9f-b956-6a1841397adb tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc27d58f027d4fc3b398f6c184911e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2650b8d88f4992a09bcf0048bcc4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:46.525218 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b8801a10-9b7b-4a9f-b956-6a1841397adb tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] 10.222.0.39 "GET /compute/v2.1/servers/9eac877e-1520-4bc6-926a-41df6c09e3c2" status: 200 len: 1318 microversion: 2.1 time: 0.170236 Aug 07 01:53:46.525793 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3202/5947] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:46 2022] GET /compute/v2.1/servers/9eac877e-1520-4bc6-926a-41df6c09e3c2 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:46.542874 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-847b5e91-b8b7-44f3-8de4-75d66509f845 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:46.543371 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-847b5e91-b8b7-44f3-8de4-75d66509f845 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:46.549703 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-847b5e91-b8b7-44f3-8de4-75d66509f845 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:46.550188 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-847b5e91-b8b7-44f3-8de4-75d66509f845 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:46.550620 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-847b5e91-b8b7-44f3-8de4-75d66509f845 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:46.551502 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-847b5e91-b8b7-44f3-8de4-75d66509f845 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:46.552164 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-847b5e91-b8b7-44f3-8de4-75d66509f845 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:46.552702 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-847b5e91-b8b7-44f3-8de4-75d66509f845 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:46.569545 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8a82746b-8e2d-4732-b212-7f1b7a36de59 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc4703b0111425f9a46d1fee4884278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c73cd4714f4b34bf5f7f6f15989b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:46.578769 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8a82746b-8e2d-4732-b212-7f1b7a36de59 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] 10.222.0.39 "GET /compute/v2.1/servers/de6ef509-00e7-4c2f-8cb6-a09cd1072032" status: 200 len: 1314 microversion: 2.1 time: 0.313031 Aug 07 01:53:46.579736 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2746/5948] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:46 2022] GET /compute/v2.1/servers/de6ef509-00e7-4c2f-8cb6-a09cd1072032 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:46.583307 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-847b5e91-b8b7-44f3-8de4-75d66509f845 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:53:46.667970 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-847b5e91-b8b7-44f3-8de4-75d66509f845 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 204 len: 0 microversion: 2.1 time: 0.128483 Aug 07 01:53:46.669293 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3203/5949] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:53:46 2022] DELETE /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:53:46.677263 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-526bf786-a370-40f9-9fbf-2fc9e9e2e093 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:46.678248 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-526bf786-a370-40f9-9fbf-2fc9e9e2e093 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:46.685061 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-526bf786-a370-40f9-9fbf-2fc9e9e2e093 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:46.685537 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-526bf786-a370-40f9-9fbf-2fc9e9e2e093 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:46.685966 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-526bf786-a370-40f9-9fbf-2fc9e9e2e093 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:46.686673 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-526bf786-a370-40f9-9fbf-2fc9e9e2e093 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:46.687229 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-526bf786-a370-40f9-9fbf-2fc9e9e2e093 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:46.687575 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-526bf786-a370-40f9-9fbf-2fc9e9e2e093 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:46.817910 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-526bf786-a370-40f9-9fbf-2fc9e9e2e093 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:46.826642 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-526bf786-a370-40f9-9fbf-2fc9e9e2e093 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1397 microversion: 2.1 time: 0.153230 Aug 07 01:53:46.827259 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2747/5950] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:46 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1397 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:47.546645 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a2dd342c-c890-463b-a439-5f20371ba9e8 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:47.547256 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a2dd342c-c890-463b-a439-5f20371ba9e8 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] [instance: 9eac877e-1520-4bc6-926a-41df6c09e3c2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:47.554236 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2dd342c-c890-463b-a439-5f20371ba9e8 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:47.554724 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2dd342c-c890-463b-a439-5f20371ba9e8 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:47.555165 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2dd342c-c890-463b-a439-5f20371ba9e8 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:47.555912 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2dd342c-c890-463b-a439-5f20371ba9e8 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:47.556372 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2dd342c-c890-463b-a439-5f20371ba9e8 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:47.556798 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2dd342c-c890-463b-a439-5f20371ba9e8 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:47.600862 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0d813dbc-11b4-4741-ae57-11ea9da7836c tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:47.602301 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0d813dbc-11b4-4741-ae57-11ea9da7836c tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] [instance: de6ef509-00e7-4c2f-8cb6-a09cd1072032] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:47.609950 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d813dbc-11b4-4741-ae57-11ea9da7836c tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:47.610454 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d813dbc-11b4-4741-ae57-11ea9da7836c tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:47.610918 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d813dbc-11b4-4741-ae57-11ea9da7836c tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:47.611613 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d813dbc-11b4-4741-ae57-11ea9da7836c tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:47.612111 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d813dbc-11b4-4741-ae57-11ea9da7836c tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:47.612546 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0d813dbc-11b4-4741-ae57-11ea9da7836c tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:47.697949 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a2dd342c-c890-463b-a439-5f20371ba9e8 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc27d58f027d4fc3b398f6c184911e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2650b8d88f4992a09bcf0048bcc4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:47.706446 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a2dd342c-c890-463b-a439-5f20371ba9e8 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] 10.222.0.39 "GET /compute/v2.1/servers/9eac877e-1520-4bc6-926a-41df6c09e3c2" status: 200 len: 1318 microversion: 2.1 time: 0.164026 Aug 07 01:53:47.707030 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3204/5951] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:47 2022] GET /compute/v2.1/servers/9eac877e-1520-4bc6-926a-41df6c09e3c2 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:47.748716 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0d813dbc-11b4-4741-ae57-11ea9da7836c tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc4703b0111425f9a46d1fee4884278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c73cd4714f4b34bf5f7f6f15989b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:47.756451 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0d813dbc-11b4-4741-ae57-11ea9da7836c tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] 10.222.0.39 "GET /compute/v2.1/servers/de6ef509-00e7-4c2f-8cb6-a09cd1072032" status: 200 len: 1314 microversion: 2.1 time: 0.160200 Aug 07 01:53:47.757042 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2748/5952] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:47 2022] GET /compute/v2.1/servers/de6ef509-00e7-4c2f-8cb6-a09cd1072032 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:47.847790 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fd238d76-844d-4624-bef4-534e16a7af9a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:47.848757 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fd238d76-844d-4624-bef4-534e16a7af9a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:47.856419 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd238d76-844d-4624-bef4-534e16a7af9a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:47.857082 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd238d76-844d-4624-bef4-534e16a7af9a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:47.857531 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd238d76-844d-4624-bef4-534e16a7af9a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:47.858287 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd238d76-844d-4624-bef4-534e16a7af9a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:47.858749 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd238d76-844d-4624-bef4-534e16a7af9a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:47.859182 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd238d76-844d-4624-bef4-534e16a7af9a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:47.997679 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fd238d76-844d-4624-bef4-534e16a7af9a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:48.005791 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fd238d76-844d-4624-bef4-534e16a7af9a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1397 microversion: 2.1 time: 0.163079 Aug 07 01:53:48.006371 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3205/5953] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:47 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1397 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:48.308217 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-d80428ed-2c93-4608-9849-b3f152015957 req-e53bc1a0-d485-46ca-9b2f-8f652bb95ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eac877e-1520-4bc6-926a-41df6c09e3c2", "name": "network-vif-plugged", "status": "completed", "tag": "5a533663-cc92-4129-8d33-23b26e354b1e"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:53:48.318154 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d80428ed-2c93-4608-9849-b3f152015957 req-e53bc1a0-d485-46ca-9b2f-8f652bb95ca2 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:48.318824 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d80428ed-2c93-4608-9849-b3f152015957 req-e53bc1a0-d485-46ca-9b2f-8f652bb95ca2 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:48.319404 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d80428ed-2c93-4608-9849-b3f152015957 req-e53bc1a0-d485-46ca-9b2f-8f652bb95ca2 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:48.338014 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-d80428ed-2c93-4608-9849-b3f152015957 req-e53bc1a0-d485-46ca-9b2f-8f652bb95ca2 service nova] Creating event network-vif-plugged:5a533663-cc92-4129-8d33-23b26e354b1e for instance 9eac877e-1520-4bc6-926a-41df6c09e3c2 on n-h2-master-1 Aug 07 01:53:48.343662 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-d80428ed-2c93-4608-9849-b3f152015957 req-e53bc1a0-d485-46ca-9b2f-8f652bb95ca2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039529 Aug 07 01:53:48.344616 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2749/5954] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:53:48.728799 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f497a1bf-86c5-464f-83b2-46f14d07e3d8 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:48.730010 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f497a1bf-86c5-464f-83b2-46f14d07e3d8 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] [instance: 9eac877e-1520-4bc6-926a-41df6c09e3c2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:48.736976 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f497a1bf-86c5-464f-83b2-46f14d07e3d8 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:48.737663 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f497a1bf-86c5-464f-83b2-46f14d07e3d8 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:48.738115 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f497a1bf-86c5-464f-83b2-46f14d07e3d8 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:48.738821 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f497a1bf-86c5-464f-83b2-46f14d07e3d8 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:48.740333 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f497a1bf-86c5-464f-83b2-46f14d07e3d8 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:48.740771 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f497a1bf-86c5-464f-83b2-46f14d07e3d8 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:48.779930 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e56b5944-ac64-4f93-9554-8033d73316c1 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:48.781298 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e56b5944-ac64-4f93-9554-8033d73316c1 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] [instance: de6ef509-00e7-4c2f-8cb6-a09cd1072032] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:48.783489 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:53:48.796383 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e56b5944-ac64-4f93-9554-8033d73316c1 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:48.796892 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e56b5944-ac64-4f93-9554-8033d73316c1 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:48.797334 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e56b5944-ac64-4f93-9554-8033d73316c1 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:48.798142 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e56b5944-ac64-4f93-9554-8033d73316c1 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:48.798498 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e56b5944-ac64-4f93-9554-8033d73316c1 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:48.798925 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e56b5944-ac64-4f93-9554-8033d73316c1 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:48.899847 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f497a1bf-86c5-464f-83b2-46f14d07e3d8 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc27d58f027d4fc3b398f6c184911e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2650b8d88f4992a09bcf0048bcc4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:48.908703 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f497a1bf-86c5-464f-83b2-46f14d07e3d8 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] 10.222.0.39 "GET /compute/v2.1/servers/9eac877e-1520-4bc6-926a-41df6c09e3c2" status: 200 len: 1318 microversion: 2.1 time: 0.184352 Aug 07 01:53:48.920374 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3206/5955] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:48 2022] GET /compute/v2.1/servers/9eac877e-1520-4bc6-926a-41df6c09e3c2 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:48.928248 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-027f3cf4-3a1f-4e4a-b0b9-e821794d012a req-b61d89a1-52bf-4df1-b320-3b10e0ad381b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e1e1fd5-843d-43bc-8db2-64300be0f1d0", "name": "network-vif-deleted", "tag": "239d284e-48d9-4855-a1c1-a6149e35827d"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:53:48.938647 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-027f3cf4-3a1f-4e4a-b0b9-e821794d012a req-b61d89a1-52bf-4df1-b320-3b10e0ad381b service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:48.939228 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-027f3cf4-3a1f-4e4a-b0b9-e821794d012a req-b61d89a1-52bf-4df1-b320-3b10e0ad381b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:48.939863 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-027f3cf4-3a1f-4e4a-b0b9-e821794d012a req-b61d89a1-52bf-4df1-b320-3b10e0ad381b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:48.952331 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-027f3cf4-3a1f-4e4a-b0b9-e821794d012a req-b61d89a1-52bf-4df1-b320-3b10e0ad381b service nova] Creating event network-vif-deleted:239d284e-48d9-4855-a1c1-a6149e35827d for instance 2e1e1fd5-843d-43bc-8db2-64300be0f1d0 on n-h2-master-1 Aug 07 01:53:48.957351 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-027f3cf4-3a1f-4e4a-b0b9-e821794d012a req-b61d89a1-52bf-4df1-b320-3b10e0ad381b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034611 Aug 07 01:53:48.958258 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3207/5956] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:53:48.997531 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e56b5944-ac64-4f93-9554-8033d73316c1 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc4703b0111425f9a46d1fee4884278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c73cd4714f4b34bf5f7f6f15989b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:49.005658 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e56b5944-ac64-4f93-9554-8033d73316c1 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] 10.222.0.39 "GET /compute/v2.1/servers/de6ef509-00e7-4c2f-8cb6-a09cd1072032" status: 200 len: 1314 microversion: 2.1 time: 0.229770 Aug 07 01:53:49.006477 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2750/5957] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:48 2022] GET /compute/v2.1/servers/de6ef509-00e7-4c2f-8cb6-a09cd1072032 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:49.027283 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0832c05e-24c8-40c0-a0a0-339d38e878d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:49.028189 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0832c05e-24c8-40c0-a0a0-339d38e878d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:49.035089 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0832c05e-24c8-40c0-a0a0-339d38e878d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:49.035665 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0832c05e-24c8-40c0-a0a0-339d38e878d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:49.036207 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0832c05e-24c8-40c0-a0a0-339d38e878d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:49.036994 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0832c05e-24c8-40c0-a0a0-339d38e878d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:49.037525 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0832c05e-24c8-40c0-a0a0-339d38e878d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:49.038023 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0832c05e-24c8-40c0-a0a0-339d38e878d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:49.104903 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0832c05e-24c8-40c0-a0a0-339d38e878d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:49.112834 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0832c05e-24c8-40c0-a0a0-339d38e878d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1188 microversion: 2.1 time: 0.089868 Aug 07 01:53:49.113532 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3208/5958] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:49 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1188 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:49.931930 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-32c6e953-b403-4e27-a52a-130dff3195d8 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:49.932742 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-32c6e953-b403-4e27-a52a-130dff3195d8 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] [instance: 9eac877e-1520-4bc6-926a-41df6c09e3c2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:49.939961 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-32c6e953-b403-4e27-a52a-130dff3195d8 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:49.940600 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-32c6e953-b403-4e27-a52a-130dff3195d8 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:49.941143 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-32c6e953-b403-4e27-a52a-130dff3195d8 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:49.942210 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-32c6e953-b403-4e27-a52a-130dff3195d8 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:49.942757 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-32c6e953-b403-4e27-a52a-130dff3195d8 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:49.943325 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-32c6e953-b403-4e27-a52a-130dff3195d8 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:50.027719 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d50d75f7-aa20-4e44-bc99-0d4a83438f63 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:50.030957 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d50d75f7-aa20-4e44-bc99-0d4a83438f63 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] [instance: de6ef509-00e7-4c2f-8cb6-a09cd1072032] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:50.035299 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:53:50.036026 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:53:50.042813 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d50d75f7-aa20-4e44-bc99-0d4a83438f63 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:50.043305 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d50d75f7-aa20-4e44-bc99-0d4a83438f63 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:50.044107 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d50d75f7-aa20-4e44-bc99-0d4a83438f63 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:50.044712 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d50d75f7-aa20-4e44-bc99-0d4a83438f63 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:50.045226 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d50d75f7-aa20-4e44-bc99-0d4a83438f63 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:50.045585 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d50d75f7-aa20-4e44-bc99-0d4a83438f63 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:50.085296 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=10 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:53:50.110713 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-32c6e953-b403-4e27-a52a-130dff3195d8 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc27d58f027d4fc3b398f6c184911e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2650b8d88f4992a09bcf0048bcc4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:50.120115 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-32c6e953-b403-4e27-a52a-130dff3195d8 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] 10.222.0.39 "GET /compute/v2.1/servers/9eac877e-1520-4bc6-926a-41df6c09e3c2" status: 200 len: 1506 microversion: 2.1 time: 0.193284 Aug 07 01:53:50.132298 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2751/5959] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:49 2022] GET /compute/v2.1/servers/9eac877e-1520-4bc6-926a-41df6c09e3c2 => generated 1506 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:50.141937 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ab9d0012-7bce-4530-ac0b-7087274ffbb5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:50.142564 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ab9d0012-7bce-4530-ac0b-7087274ffbb5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:50.149110 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab9d0012-7bce-4530-ac0b-7087274ffbb5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:50.149881 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab9d0012-7bce-4530-ac0b-7087274ffbb5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:50.150587 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab9d0012-7bce-4530-ac0b-7087274ffbb5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:50.152405 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab9d0012-7bce-4530-ac0b-7087274ffbb5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:50.153075 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab9d0012-7bce-4530-ac0b-7087274ffbb5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:50.153659 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ab9d0012-7bce-4530-ac0b-7087274ffbb5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:50.199925 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d50d75f7-aa20-4e44-bc99-0d4a83438f63 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc4703b0111425f9a46d1fee4884278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c73cd4714f4b34bf5f7f6f15989b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:50.208585 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d50d75f7-aa20-4e44-bc99-0d4a83438f63 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] 10.222.0.39 "GET /compute/v2.1/servers/de6ef509-00e7-4c2f-8cb6-a09cd1072032" status: 200 len: 1314 microversion: 2.1 time: 0.185425 Aug 07 01:53:50.220164 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3209/5960] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:50 2022] GET /compute/v2.1/servers/de6ef509-00e7-4c2f-8cb6-a09cd1072032 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:50.220164 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4bfbc0d9-e70d-4a99-aa2b-bf7089824367 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d92d266-c47a-470d-92c4-960d210c225c", "device": "/dev/sdb"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:53:50.220793 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4bfbc0d9-e70d-4a99-aa2b-bf7089824367 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] [instance: 9eac877e-1520-4bc6-926a-41df6c09e3c2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:50.228959 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4bfbc0d9-e70d-4a99-aa2b-bf7089824367 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:50.229496 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4bfbc0d9-e70d-4a99-aa2b-bf7089824367 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:50.230129 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4bfbc0d9-e70d-4a99-aa2b-bf7089824367 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:50.230866 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4bfbc0d9-e70d-4a99-aa2b-bf7089824367 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:50.231751 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4bfbc0d9-e70d-4a99-aa2b-bf7089824367 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:50.232038 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4bfbc0d9-e70d-4a99-aa2b-bf7089824367 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:50.237364 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ab9d0012-7bce-4530-ac0b-7087274ffbb5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:50.246041 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ab9d0012-7bce-4530-ac0b-7087274ffbb5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1188 microversion: 2.1 time: 0.112550 Aug 07 01:53:50.246968 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2752/5961] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:50 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1188 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:50.360194 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-5c046b13-c531-436d-b27f-35719bd5a937 req-945644c6-4dae-427d-aba9-9bb238a55792 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de6ef509-00e7-4c2f-8cb6-a09cd1072032", "name": "network-vif-plugged", "status": "completed", "tag": "0701c4ac-00c9-45c7-bae3-e30525c6470f"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:53:50.371829 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-5c046b13-c531-436d-b27f-35719bd5a937 req-945644c6-4dae-427d-aba9-9bb238a55792 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:50.372432 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-5c046b13-c531-436d-b27f-35719bd5a937 req-945644c6-4dae-427d-aba9-9bb238a55792 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:50.373218 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-5c046b13-c531-436d-b27f-35719bd5a937 req-945644c6-4dae-427d-aba9-9bb238a55792 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:50.387743 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-5c046b13-c531-436d-b27f-35719bd5a937 req-945644c6-4dae-427d-aba9-9bb238a55792 service nova] Creating event network-vif-plugged:0701c4ac-00c9-45c7-bae3-e30525c6470f for instance de6ef509-00e7-4c2f-8cb6-a09cd1072032 on n-h1-master-1 Aug 07 01:53:50.392522 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-5c046b13-c531-436d-b27f-35719bd5a937 req-945644c6-4dae-427d-aba9-9bb238a55792 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036168 Aug 07 01:53:50.393742 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2753/5962] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:53:50.528956 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4bfbc0d9-e70d-4a99-aa2b-bf7089824367 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] 10.222.0.39 "POST /compute/v2.1/servers/9eac877e-1520-4bc6-926a-41df6c09e3c2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318221 Aug 07 01:53:50.529576 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3210/5963] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Aug 7 01:53:50 2022] POST /compute/v2.1/servers/9eac877e-1520-4bc6-926a-41df6c09e3c2/os-volume_attachments => generated 194 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:53:51.232609 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6f2c18d0-bfe1-4b36-b2de-b91a7ccbdf9e tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:51.233554 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6f2c18d0-bfe1-4b36-b2de-b91a7ccbdf9e tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] [instance: de6ef509-00e7-4c2f-8cb6-a09cd1072032] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:51.240562 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f2c18d0-bfe1-4b36-b2de-b91a7ccbdf9e tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:51.241149 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f2c18d0-bfe1-4b36-b2de-b91a7ccbdf9e tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:51.242170 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f2c18d0-bfe1-4b36-b2de-b91a7ccbdf9e tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:51.242928 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f2c18d0-bfe1-4b36-b2de-b91a7ccbdf9e tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:51.243449 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f2c18d0-bfe1-4b36-b2de-b91a7ccbdf9e tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:51.244101 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f2c18d0-bfe1-4b36-b2de-b91a7ccbdf9e tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:51.268196 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7667a0de-71e5-416e-a836-bd4d82eb7d86 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:51.268897 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7667a0de-71e5-416e-a836-bd4d82eb7d86 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:51.275442 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7667a0de-71e5-416e-a836-bd4d82eb7d86 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:51.275970 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7667a0de-71e5-416e-a836-bd4d82eb7d86 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:51.276412 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7667a0de-71e5-416e-a836-bd4d82eb7d86 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:51.277309 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7667a0de-71e5-416e-a836-bd4d82eb7d86 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:51.277931 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7667a0de-71e5-416e-a836-bd4d82eb7d86 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:51.278565 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7667a0de-71e5-416e-a836-bd4d82eb7d86 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:51.351615 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7667a0de-71e5-416e-a836-bd4d82eb7d86 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:51.364111 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7667a0de-71e5-416e-a836-bd4d82eb7d86 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1188 microversion: 2.1 time: 0.101023 Aug 07 01:53:51.365357 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3211/5964] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:51 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1188 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:51.406732 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6f2c18d0-bfe1-4b36-b2de-b91a7ccbdf9e tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc4703b0111425f9a46d1fee4884278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c73cd4714f4b34bf5f7f6f15989b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:51.418579 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6f2c18d0-bfe1-4b36-b2de-b91a7ccbdf9e tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] 10.222.0.39 "GET /compute/v2.1/servers/de6ef509-00e7-4c2f-8cb6-a09cd1072032" status: 200 len: 1314 microversion: 2.1 time: 0.191365 Aug 07 01:53:51.419186 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2754/5965] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:51 2022] GET /compute/v2.1/servers/de6ef509-00e7-4c2f-8cb6-a09cd1072032 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:52.387183 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-39744b2d-9fce-444c-b621-c138cd8b603b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:52.387804 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-39744b2d-9fce-444c-b621-c138cd8b603b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:52.395032 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-39744b2d-9fce-444c-b621-c138cd8b603b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:52.395516 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-39744b2d-9fce-444c-b621-c138cd8b603b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:52.395977 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-39744b2d-9fce-444c-b621-c138cd8b603b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:52.397386 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-39744b2d-9fce-444c-b621-c138cd8b603b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:52.398493 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-39744b2d-9fce-444c-b621-c138cd8b603b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:52.398927 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-39744b2d-9fce-444c-b621-c138cd8b603b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:52.417704 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:53:52.440230 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5e420e8d-677e-419f-b459-b534e8693614 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:52.440848 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5e420e8d-677e-419f-b459-b534e8693614 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] [instance: de6ef509-00e7-4c2f-8cb6-a09cd1072032] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:52.448962 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e420e8d-677e-419f-b459-b534e8693614 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:52.449441 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e420e8d-677e-419f-b459-b534e8693614 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:52.449876 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e420e8d-677e-419f-b459-b534e8693614 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:52.450582 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e420e8d-677e-419f-b459-b534e8693614 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:52.451034 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e420e8d-677e-419f-b459-b534e8693614 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:52.451829 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e420e8d-677e-419f-b459-b534e8693614 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:52.467130 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-39744b2d-9fce-444c-b621-c138cd8b603b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:52.475439 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-39744b2d-9fce-444c-b621-c138cd8b603b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1188 microversion: 2.1 time: 0.092121 Aug 07 01:53:52.476669 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3212/5966] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:52 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1188 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:52.585973 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5e420e8d-677e-419f-b459-b534e8693614 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc4703b0111425f9a46d1fee4884278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c73cd4714f4b34bf5f7f6f15989b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:52.593689 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5e420e8d-677e-419f-b459-b534e8693614 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] 10.222.0.39 "GET /compute/v2.1/servers/de6ef509-00e7-4c2f-8cb6-a09cd1072032" status: 200 len: 1464 microversion: 2.1 time: 0.157367 Aug 07 01:53:52.594266 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2755/5967] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:52 2022] GET /compute/v2.1/servers/de6ef509-00e7-4c2f-8cb6-a09cd1072032 => generated 1464 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:53:53.195350 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cfcb695a-a9f2-4676-b06a-c00677e9427e tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:53.196132 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cfcb695a-a9f2-4676-b06a-c00677e9427e tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] [instance: de6ef509-00e7-4c2f-8cb6-a09cd1072032] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:53.202930 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfcb695a-a9f2-4676-b06a-c00677e9427e tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:53.203420 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfcb695a-a9f2-4676-b06a-c00677e9427e tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:53.203862 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfcb695a-a9f2-4676-b06a-c00677e9427e tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:53.204586 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfcb695a-a9f2-4676-b06a-c00677e9427e tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:53.205046 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfcb695a-a9f2-4676-b06a-c00677e9427e tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:53.205474 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfcb695a-a9f2-4676-b06a-c00677e9427e tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:53.236458 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cfcb695a-a9f2-4676-b06a-c00677e9427e tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] [instance: de6ef509-00e7-4c2f-8cb6-a09cd1072032] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:53:53.314191 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:53:53.337809 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cfcb695a-a9f2-4676-b06a-c00677e9427e tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] 10.222.0.39 "DELETE /compute/v2.1/servers/de6ef509-00e7-4c2f-8cb6-a09cd1072032" status: 204 len: 0 microversion: 2.1 time: 0.149079 Aug 07 01:53:53.338897 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3213/5968] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:53:53 2022] DELETE /compute/v2.1/servers/de6ef509-00e7-4c2f-8cb6-a09cd1072032 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:53:53.347127 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b47d7c47-0967-47d7-9b65-777b3c2dddcd tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:53.348900 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b47d7c47-0967-47d7-9b65-777b3c2dddcd tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] [instance: de6ef509-00e7-4c2f-8cb6-a09cd1072032] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:53.355008 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b47d7c47-0967-47d7-9b65-777b3c2dddcd tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:53.355485 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b47d7c47-0967-47d7-9b65-777b3c2dddcd tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:53.356139 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b47d7c47-0967-47d7-9b65-777b3c2dddcd tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:53.357020 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b47d7c47-0967-47d7-9b65-777b3c2dddcd tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:53.357473 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b47d7c47-0967-47d7-9b65-777b3c2dddcd tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:53.357894 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b47d7c47-0967-47d7-9b65-777b3c2dddcd tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:53.498896 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5a48bed3-0a7a-4347-9afb-6a52ebcfc3f5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:53.500233 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5a48bed3-0a7a-4347-9afb-6a52ebcfc3f5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:53.506793 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a48bed3-0a7a-4347-9afb-6a52ebcfc3f5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:53.508074 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a48bed3-0a7a-4347-9afb-6a52ebcfc3f5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:53.508692 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a48bed3-0a7a-4347-9afb-6a52ebcfc3f5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:53.509579 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a48bed3-0a7a-4347-9afb-6a52ebcfc3f5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:53.510195 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a48bed3-0a7a-4347-9afb-6a52ebcfc3f5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:53.510810 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a48bed3-0a7a-4347-9afb-6a52ebcfc3f5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:53.521811 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b47d7c47-0967-47d7-9b65-777b3c2dddcd tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc4703b0111425f9a46d1fee4884278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c73cd4714f4b34bf5f7f6f15989b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:53.531088 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b47d7c47-0967-47d7-9b65-777b3c2dddcd tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] 10.222.0.39 "GET /compute/v2.1/servers/de6ef509-00e7-4c2f-8cb6-a09cd1072032" status: 200 len: 1470 microversion: 2.1 time: 0.187879 Aug 07 01:53:53.545146 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a48bed3-0a7a-4347-9afb-6a52ebcfc3f5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:53.545832 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a48bed3-0a7a-4347-9afb-6a52ebcfc3f5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:53.546278 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a48bed3-0a7a-4347-9afb-6a52ebcfc3f5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:53.546430 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2756/5969] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:53 2022] GET /compute/v2.1/servers/de6ef509-00e7-4c2f-8cb6-a09cd1072032 => generated 1470 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:53.547033 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-5a48bed3-0a7a-4347-9afb-6a52ebcfc3f5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lazy-loading 'fault' on Instance uuid 2e1e1fd5-843d-43bc-8db2-64300be0f1d0 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:53:53.592160 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5a48bed3-0a7a-4347-9afb-6a52ebcfc3f5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:53.600433 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5a48bed3-0a7a-4347-9afb-6a52ebcfc3f5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 200 len: 1193 microversion: 2.1 time: 0.106148 Aug 07 01:53:53.601119 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3214/5970] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:53 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 1193 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:54.552419 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-41326d2a-ae4e-4e5a-a672-fd73166a415e tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:54.553045 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-41326d2a-ae4e-4e5a-a672-fd73166a415e tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] [instance: de6ef509-00e7-4c2f-8cb6-a09cd1072032] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:54.561081 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-41326d2a-ae4e-4e5a-a672-fd73166a415e tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:54.561749 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-41326d2a-ae4e-4e5a-a672-fd73166a415e tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:54.562233 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-41326d2a-ae4e-4e5a-a672-fd73166a415e tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:54.562957 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-41326d2a-ae4e-4e5a-a672-fd73166a415e tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:54.563410 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-41326d2a-ae4e-4e5a-a672-fd73166a415e tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:54.563860 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-41326d2a-ae4e-4e5a-a672-fd73166a415e tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:54.622147 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3b167137-12ca-4a8d-a87d-d80878b80018 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:54.623060 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3b167137-12ca-4a8d-a87d-d80878b80018 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:54.630867 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b167137-12ca-4a8d-a87d-d80878b80018 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:54.631483 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b167137-12ca-4a8d-a87d-d80878b80018 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:54.631960 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b167137-12ca-4a8d-a87d-d80878b80018 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:54.632692 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b167137-12ca-4a8d-a87d-d80878b80018 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:54.633181 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b167137-12ca-4a8d-a87d-d80878b80018 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:54.633612 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b167137-12ca-4a8d-a87d-d80878b80018 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:54.649526 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-3b167137-12ca-4a8d-a87d-d80878b80018 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] HTTP exception thrown: Instance 2e1e1fd5-843d-43bc-8db2-64300be0f1d0 could not be found. Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3b167137-12ca-4a8d-a87d-d80878b80018 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Request method failure captured: Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 HTTP/1.1 Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xp6rUdIsYnfs49nr8p-3tgit6VpNtF0E4NPSidukXDEQntBhlyx_gwU6AjnU2O7Q5BLuafO4z_ZO55y2txpq1OJeOibLbj_karsXsR0GpyTHp3BnitplkO9r1bHquRHPgg2Nq4jyNzT0obzTHzoVjdq8NdzVY4LztormmeY7retjUI Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: bf36f5153ba648008cdaceb9dc538e53 Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-TestVolumeBootPattern-121766107 Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bf36f5153ba648008cdaceb9dc538e53", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-TestVolumeBootPattern-121766107 Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: bf36f5153ba648008cdaceb9dc538e53 Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-TestVolumeBootPattern-121766107 Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-TestVolumeBootPattern-121766107-project Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 661f6c9aa7da4e348a9b0d91840078c2 Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-TestVolumeBootPattern-121766107-project Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 2e1e1fd5-843d-43bc-8db2-64300be0f1d0 could not be found. Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '2e1e1fd5-843d-43bc-8db2-64300be0f1d0'} Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e1e1fd5-843d-43bc-8db2-64300be0f1d0 could not be found. Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e1e1fd5-843d-43bc-8db2-64300be0f1d0 could not be found. Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:53:54.651259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:53:54.655618 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:53:54.655618 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:53:54.655618 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:53:54.655618 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:53:54.655618 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:53:54.655618 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e1e1fd5-843d-43bc-8db2-64300be0f1d0 could not be found. Aug 07 01:53:54.655618 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:53:54.655618 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3b167137-12ca-4a8d-a87d-d80878b80018 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Returning 404 to user: Instance 2e1e1fd5-843d-43bc-8db2-64300be0f1d0 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:53:54.655618 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3b167137-12ca-4a8d-a87d-d80878b80018 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 404 len: 111 microversion: 2.1 time: 0.035020 Aug 07 01:53:54.657180 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3215/5971] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:54 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:53:54.732001 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-41326d2a-ae4e-4e5a-a672-fd73166a415e tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc4703b0111425f9a46d1fee4884278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c73cd4714f4b34bf5f7f6f15989b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:54.740114 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-41326d2a-ae4e-4e5a-a672-fd73166a415e tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] 10.222.0.39 "GET /compute/v2.1/servers/de6ef509-00e7-4c2f-8cb6-a09cd1072032" status: 200 len: 1470 microversion: 2.1 time: 0.191599 Aug 07 01:53:54.740798 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2757/5972] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:54 2022] GET /compute/v2.1/servers/de6ef509-00e7-4c2f-8cb6-a09cd1072032 => generated 1470 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:55.421071 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-d844800d-7cc9-4b1a-9797-ca54ece90e27 req-62812cf0-60af-4b1d-92cb-cbb74e4cb755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de6ef509-00e7-4c2f-8cb6-a09cd1072032", "name": "network-vif-deleted", "tag": "0701c4ac-00c9-45c7-bae3-e30525c6470f"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:53:55.432583 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d844800d-7cc9-4b1a-9797-ca54ece90e27 req-62812cf0-60af-4b1d-92cb-cbb74e4cb755 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:55.433398 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d844800d-7cc9-4b1a-9797-ca54ece90e27 req-62812cf0-60af-4b1d-92cb-cbb74e4cb755 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:55.434178 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d844800d-7cc9-4b1a-9797-ca54ece90e27 req-62812cf0-60af-4b1d-92cb-cbb74e4cb755 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:55.451083 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-d844800d-7cc9-4b1a-9797-ca54ece90e27 req-62812cf0-60af-4b1d-92cb-cbb74e4cb755 service nova] Creating event network-vif-deleted:0701c4ac-00c9-45c7-bae3-e30525c6470f for instance de6ef509-00e7-4c2f-8cb6-a09cd1072032 on n-h1-master-1 Aug 07 01:53:55.456737 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-d844800d-7cc9-4b1a-9797-ca54ece90e27 req-62812cf0-60af-4b1d-92cb-cbb74e4cb755 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039895 Aug 07 01:53:55.458119 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3216/5973] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:53:55.773811 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c7fd6055-6598-4694-ad6f-2dc8ba8f4bc7 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:55.773811 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c7fd6055-6598-4694-ad6f-2dc8ba8f4bc7 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] [instance: de6ef509-00e7-4c2f-8cb6-a09cd1072032] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:55.773811 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7fd6055-6598-4694-ad6f-2dc8ba8f4bc7 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:55.773811 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7fd6055-6598-4694-ad6f-2dc8ba8f4bc7 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:55.773811 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7fd6055-6598-4694-ad6f-2dc8ba8f4bc7 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:55.774656 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7fd6055-6598-4694-ad6f-2dc8ba8f4bc7 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:55.774957 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7fd6055-6598-4694-ad6f-2dc8ba8f4bc7 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:55.775388 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7fd6055-6598-4694-ad6f-2dc8ba8f4bc7 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:55.814295 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7fd6055-6598-4694-ad6f-2dc8ba8f4bc7 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:55.814828 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7fd6055-6598-4694-ad6f-2dc8ba8f4bc7 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:55.815267 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7fd6055-6598-4694-ad6f-2dc8ba8f4bc7 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:55.815935 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-c7fd6055-6598-4694-ad6f-2dc8ba8f4bc7 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lazy-loading 'fault' on Instance uuid de6ef509-00e7-4c2f-8cb6-a09cd1072032 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:53:55.859536 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c7fd6055-6598-4694-ad6f-2dc8ba8f4bc7 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc4703b0111425f9a46d1fee4884278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c73cd4714f4b34bf5f7f6f15989b52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:53:55.869970 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c7fd6055-6598-4694-ad6f-2dc8ba8f4bc7 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] 10.222.0.39 "GET /compute/v2.1/servers/de6ef509-00e7-4c2f-8cb6-a09cd1072032" status: 200 len: 1304 microversion: 2.1 time: 0.110387 Aug 07 01:53:55.883952 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2758/5974] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:55 2022] GET /compute/v2.1/servers/de6ef509-00e7-4c2f-8cb6-a09cd1072032 => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:53:56.896630 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f4bcc953-90d0-436c-87b1-0e924d82b5a2 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:56.897621 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f4bcc953-90d0-436c-87b1-0e924d82b5a2 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] [instance: de6ef509-00e7-4c2f-8cb6-a09cd1072032] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:56.904462 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f4bcc953-90d0-436c-87b1-0e924d82b5a2 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:56.904951 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f4bcc953-90d0-436c-87b1-0e924d82b5a2 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:56.905384 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f4bcc953-90d0-436c-87b1-0e924d82b5a2 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:56.906101 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f4bcc953-90d0-436c-87b1-0e924d82b5a2 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:56.906558 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f4bcc953-90d0-436c-87b1-0e924d82b5a2 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:56.906976 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f4bcc953-90d0-436c-87b1-0e924d82b5a2 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:56.923841 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-f4bcc953-90d0-436c-87b1-0e924d82b5a2 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] HTTP exception thrown: Instance de6ef509-00e7-4c2f-8cb6-a09cd1072032 could not be found. Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f4bcc953-90d0-436c-87b1-0e924d82b5a2 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Request method failure captured: Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/de6ef509-00e7-4c2f-8cb6-a09cd1072032 HTTP/1.1 Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xsg2swPMu6ln3z8Z5pSasK5gjKoBA9aKCLIMxeY6BkOkpWGxa1QaNe1sQMHfPokBQdEBBGkxT7Cs3_MbXdriV4A-gUBmM2yviK2-ImHUTkS6v3WDJwktp-lmzST7NSp9OdbzSBtNoyc5tr23ch-rMG2_Wz7TWtXJgeqBcgzSeb3TsU Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: e4c73cd4714f4b34bf5f7f6f15989b52 Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-VolumesNegativeTest-332062963 Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e4c73cd4714f4b34bf5f7f6f15989b52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e4c73cd4714f4b34bf5f7f6f15989b52", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e4c73cd4714f4b34bf5f7f6f15989b52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e4c73cd4714f4b34bf5f7f6f15989b52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-VolumesNegativeTest-332062963 Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: e4c73cd4714f4b34bf5f7f6f15989b52 Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-VolumesNegativeTest-332062963 Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-VolumesNegativeTest-332062963-project Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 2bc4703b0111425f9a46d1fee4884278 Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-VolumesNegativeTest-332062963-project Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: exception: Instance de6ef509-00e7-4c2f-8cb6-a09cd1072032 could not be found. Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'de6ef509-00e7-4c2f-8cb6-a09cd1072032'} Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de6ef509-00e7-4c2f-8cb6-a09cd1072032 could not be found. Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de6ef509-00e7-4c2f-8cb6-a09cd1072032 could not be found. Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:53:56.924983 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:53:56.930010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:53:56.930010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:53:56.930010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:53:56.930010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:53:56.930010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:53:56.930010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de6ef509-00e7-4c2f-8cb6-a09cd1072032 could not be found. Aug 07 01:53:56.930010 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:53:56.930010 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f4bcc953-90d0-436c-87b1-0e924d82b5a2 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] Returning 404 to user: Instance de6ef509-00e7-4c2f-8cb6-a09cd1072032 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:53:56.930010 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f4bcc953-90d0-436c-87b1-0e924d82b5a2 tempest-VolumesNegativeTest-332062963 tempest-VolumesNegativeTest-332062963-project] 10.222.0.39 "GET /compute/v2.1/servers/de6ef509-00e7-4c2f-8cb6-a09cd1072032" status: 404 len: 111 microversion: 2.1 time: 0.035113 Aug 07 01:53:56.936377 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3217/5975] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:56 2022] GET /compute/v2.1/servers/de6ef509-00e7-4c2f-8cb6-a09cd1072032 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:53:58.921498 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-59522c2e-443d-4ed0-a91c-d3bec5220b7e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:58.922061 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-59522c2e-443d-4ed0-a91c-d3bec5220b7e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:58.933531 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59522c2e-443d-4ed0-a91c-d3bec5220b7e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:58.934032 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59522c2e-443d-4ed0-a91c-d3bec5220b7e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:58.934472 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59522c2e-443d-4ed0-a91c-d3bec5220b7e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:58.935188 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59522c2e-443d-4ed0-a91c-d3bec5220b7e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:58.935644 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59522c2e-443d-4ed0-a91c-d3bec5220b7e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:58.936128 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-59522c2e-443d-4ed0-a91c-d3bec5220b7e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:58.958146 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-59522c2e-443d-4ed0-a91c-d3bec5220b7e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] HTTP exception thrown: Instance 2e1e1fd5-843d-43bc-8db2-64300be0f1d0 could not be found. Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-59522c2e-443d-4ed0-a91c-d3bec5220b7e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Request method failure captured: Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 HTTP/1.1 Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xp6rUdIsYnfs49nr8p-3tgit6VpNtF0E4NPSidukXDEQntBhlyx_gwU6AjnU2O7Q5BLuafO4z_ZO55y2txpq1OJeOibLbj_karsXsR0GpyTHp3BnitplkO9r1bHquRHPgg2Nq4jyNzT0obzTHzoVjdq8NdzVY4LztormmeY7retjUI Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: bf36f5153ba648008cdaceb9dc538e53 Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-TestVolumeBootPattern-121766107 Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bf36f5153ba648008cdaceb9dc538e53", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-TestVolumeBootPattern-121766107 Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: bf36f5153ba648008cdaceb9dc538e53 Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-TestVolumeBootPattern-121766107 Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-TestVolumeBootPattern-121766107-project Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 661f6c9aa7da4e348a9b0d91840078c2 Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-TestVolumeBootPattern-121766107-project Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 2e1e1fd5-843d-43bc-8db2-64300be0f1d0 could not be found. Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '2e1e1fd5-843d-43bc-8db2-64300be0f1d0'} Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e1e1fd5-843d-43bc-8db2-64300be0f1d0 could not be found. Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:53:58.960419 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:53:58.965157 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e1e1fd5-843d-43bc-8db2-64300be0f1d0 could not be found. Aug 07 01:53:58.965157 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:53:58.965157 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:53:58.965157 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:53:58.965157 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:53:58.965157 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:53:58.965157 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:53:58.965157 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:53:58.965157 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:53:58.965157 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e1e1fd5-843d-43bc-8db2-64300be0f1d0 could not be found. Aug 07 01:53:58.965157 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:53:58.966786 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-59522c2e-443d-4ed0-a91c-d3bec5220b7e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Returning 404 to user: Instance 2e1e1fd5-843d-43bc-8db2-64300be0f1d0 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:53:58.967671 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-59522c2e-443d-4ed0-a91c-d3bec5220b7e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 404 len: 111 microversion: 2.1 time: 0.050179 Aug 07 01:53:58.968287 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2759/5976] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:53:58 2022] DELETE /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:53:58.977520 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-880773ac-9642-4eb3-9b49-d01535f547bb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:53:58.979150 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-880773ac-9642-4eb3-9b49-d01535f547bb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 2e1e1fd5-843d-43bc-8db2-64300be0f1d0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:53:58.998525 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-880773ac-9642-4eb3-9b49-d01535f547bb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:58.999311 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-880773ac-9642-4eb3-9b49-d01535f547bb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:58.999808 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-880773ac-9642-4eb3-9b49-d01535f547bb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:59.000898 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-880773ac-9642-4eb3-9b49-d01535f547bb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:53:59.001394 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-880773ac-9642-4eb3-9b49-d01535f547bb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:53:59.001867 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-880773ac-9642-4eb3-9b49-d01535f547bb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:53:59.019497 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-880773ac-9642-4eb3-9b49-d01535f547bb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] HTTP exception thrown: Instance 2e1e1fd5-843d-43bc-8db2-64300be0f1d0 could not be found. Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-880773ac-9642-4eb3-9b49-d01535f547bb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Request method failure captured: Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 HTTP/1.1 Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xp6rUdIsYnfs49nr8p-3tgit6VpNtF0E4NPSidukXDEQntBhlyx_gwU6AjnU2O7Q5BLuafO4z_ZO55y2txpq1OJeOibLbj_karsXsR0GpyTHp3BnitplkO9r1bHquRHPgg2Nq4jyNzT0obzTHzoVjdq8NdzVY4LztormmeY7retjUI Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: bf36f5153ba648008cdaceb9dc538e53 Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-TestVolumeBootPattern-121766107 Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bf36f5153ba648008cdaceb9dc538e53", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-TestVolumeBootPattern-121766107 Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: bf36f5153ba648008cdaceb9dc538e53 Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-TestVolumeBootPattern-121766107 Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-TestVolumeBootPattern-121766107-project Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 661f6c9aa7da4e348a9b0d91840078c2 Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-TestVolumeBootPattern-121766107-project Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 2e1e1fd5-843d-43bc-8db2-64300be0f1d0 could not be found. Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '2e1e1fd5-843d-43bc-8db2-64300be0f1d0'} Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e1e1fd5-843d-43bc-8db2-64300be0f1d0 could not be found. Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e1e1fd5-843d-43bc-8db2-64300be0f1d0 could not be found. Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:53:59.021090 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:53:59.026093 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:53:59.026093 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:53:59.026093 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:53:59.026093 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:53:59.026093 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:53:59.026093 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e1e1fd5-843d-43bc-8db2-64300be0f1d0 could not be found. Aug 07 01:53:59.026093 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:53:59.026093 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-880773ac-9642-4eb3-9b49-d01535f547bb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Returning 404 to user: Instance 2e1e1fd5-843d-43bc-8db2-64300be0f1d0 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:53:59.026093 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-880773ac-9642-4eb3-9b49-d01535f547bb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0" status: 404 len: 111 microversion: 2.1 time: 0.049505 Aug 07 01:53:59.026093 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3218/5977] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:53:58 2022] GET /compute/v2.1/servers/2e1e1fd5-843d-43bc-8db2-64300be0f1d0 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:54:04.420175 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-76c1e1fa-47f2-4601-9ce6-70b8baf1e1be tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Action: 'create', calling method: .version_select at 0x7f9e1755a670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1784247932", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQGETHyvWFLe5WE/Kr2ls3nt6xJ44B7cfF2i3I2YstdjLTF68UNBUc+lW5gVVebBtfJwJeWHb5UPV7hN/fVpavph+8RSNNRG8nXxBubv2NGLL0STQwj5g48oxqJQ5yFdA=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:54:04.425830 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:54:04.460617 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-76c1e1fa-47f2-4601-9ce6-70b8baf1e1be tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Getting quotas for project d37d8c916412400ba4b57ea10fceb39e. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:54:04.472955 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-76c1e1fa-47f2-4601-9ce6-70b8baf1e1be tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Getting quotas for user 830639b9b39a43a7b714b74c26fdf52c and project d37d8c916412400ba4b57ea10fceb39e. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:54:04.511849 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-76c1e1fa-47f2-4601-9ce6-70b8baf1e1be tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.310677 Aug 07 01:54:04.513261 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2760/5978] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:54:04 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:54:06.153897 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-20d0571d-2366-40ae-8bdd-136f8d7992aa tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:54:06.156327 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-20d0571d-2366-40ae-8bdd-136f8d7992aa tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: 2b339161-2aae-4caa-94b3-7d04fd07923c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:06.171202 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20d0571d-2366-40ae-8bdd-136f8d7992aa tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:06.172635 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20d0571d-2366-40ae-8bdd-136f8d7992aa tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:06.173274 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20d0571d-2366-40ae-8bdd-136f8d7992aa tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:06.175187 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20d0571d-2366-40ae-8bdd-136f8d7992aa tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:06.175979 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20d0571d-2366-40ae-8bdd-136f8d7992aa tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:06.176902 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20d0571d-2366-40ae-8bdd-136f8d7992aa tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:06.262376 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-20d0571d-2366-40ae-8bdd-136f8d7992aa tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "POST /compute/v2.1/servers/2b339161-2aae-4caa-94b3-7d04fd07923c/action" status: 200 len: 24561 microversion: 2.1 time: 0.112349 Aug 07 01:54:06.270176 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3219/5979] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:54:06 2022] POST /compute/v2.1/servers/2b339161-2aae-4caa-94b3-7d04fd07923c/action => generated 24561 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:54:11.912792 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=92 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:54:11.918872 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-08390477-4ae0-433f-a74c-2578c77dc51b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-657181395", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "9bbf4abd-9011-4cba-87dc-542153572eb6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1784247932", "security_groups": [{"name": "tempest-secgroup-smoke-709100158"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:54:12.126791 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-08390477-4ae0-433f-a74c-2578c77dc51b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] validate_networks() for [('9bbf4abd-9011-4cba-87dc-542153572eb6', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:54:12.870139 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bccbdd15-7ac4-40d9-8900-49c090bcc38e tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:54:12.874247 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bccbdd15-7ac4-40d9-8900-49c090bcc38e tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: 2b339161-2aae-4caa-94b3-7d04fd07923c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:12.884320 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bccbdd15-7ac4-40d9-8900-49c090bcc38e tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:12.885163 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bccbdd15-7ac4-40d9-8900-49c090bcc38e tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:12.885839 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bccbdd15-7ac4-40d9-8900-49c090bcc38e tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:12.888445 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bccbdd15-7ac4-40d9-8900-49c090bcc38e tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:12.889028 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bccbdd15-7ac4-40d9-8900-49c090bcc38e tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:12.889871 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bccbdd15-7ac4-40d9-8900-49c090bcc38e tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:12.901573 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-08390477-4ae0-433f-a74c-2578c77dc51b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:54:12.902368 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-08390477-4ae0-433f-a74c-2578c77dc51b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:54:12.903263 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-08390477-4ae0-433f-a74c-2578c77dc51b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:54:12.903841 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-08390477-4ae0-433f-a74c-2578c77dc51b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:54:12.904458 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-08390477-4ae0-433f-a74c-2578c77dc51b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:54:12.926801 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-08390477-4ae0-433f-a74c-2578c77dc51b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:12.932980 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-08390477-4ae0-433f-a74c-2578c77dc51b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:12.933435 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-08390477-4ae0-433f-a74c-2578c77dc51b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:12.934257 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-08390477-4ae0-433f-a74c-2578c77dc51b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:12.934716 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-08390477-4ae0-433f-a74c-2578c77dc51b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:12.935145 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-08390477-4ae0-433f-a74c-2578c77dc51b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:12.959370 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-08390477-4ae0-433f-a74c-2578c77dc51b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Getting quotas for project d37d8c916412400ba4b57ea10fceb39e. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:54:12.967625 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-08390477-4ae0-433f-a74c-2578c77dc51b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Getting quotas for user 830639b9b39a43a7b714b74c26fdf52c and project d37d8c916412400ba4b57ea10fceb39e. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:54:12.973765 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bccbdd15-7ac4-40d9-8900-49c090bcc38e tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "POST /compute/v2.1/servers/2b339161-2aae-4caa-94b3-7d04fd07923c/action" status: 200 len: 32634 microversion: 2.1 time: 0.110923 Aug 07 01:54:12.980971 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3220/5980] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:54:12 2022] POST /compute/v2.1/servers/2b339161-2aae-4caa-94b3-7d04fd07923c/action => generated 32634 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:54:13.002932 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-08390477-4ae0-433f-a74c-2578c77dc51b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:54:13.011059 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-08390477-4ae0-433f-a74c-2578c77dc51b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:54:13.128950 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-08390477-4ae0-433f-a74c-2578c77dc51b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.217757 Aug 07 01:54:13.133244 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2761/5981] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:54:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 1221 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:54:13.146356 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f0c17736-bed7-4f52-89f1-555743586b76 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:13.146356 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f0c17736-bed7-4f52-89f1-555743586b76 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:13.382335 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f0c17736-bed7-4f52-89f1-555743586b76 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:13.396190 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f0c17736-bed7-4f52-89f1-555743586b76 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1266 microversion: 2.1 time: 0.254030 Aug 07 01:54:13.397048 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3221/5982] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:13 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:14.424331 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1e4922df-c076-4535-bb45-f369c9050269 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:14.425023 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1e4922df-c076-4535-bb45-f369c9050269 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:14.441559 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e4922df-c076-4535-bb45-f369c9050269 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:14.442067 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e4922df-c076-4535-bb45-f369c9050269 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:14.442561 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e4922df-c076-4535-bb45-f369c9050269 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:14.444084 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e4922df-c076-4535-bb45-f369c9050269 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:14.444581 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e4922df-c076-4535-bb45-f369c9050269 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:14.445019 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e4922df-c076-4535-bb45-f369c9050269 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:14.591849 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1e4922df-c076-4535-bb45-f369c9050269 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:14.602111 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1e4922df-c076-4535-bb45-f369c9050269 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1262 microversion: 2.1 time: 0.184519 Aug 07 01:54:14.605547 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2762/5983] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:14 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1262 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:14.886809 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-4b7337c1-f49e-4fed-b0f5-07f6cea9aabe req-e9ef36a9-8f4a-4f33-a430-5cc83c7491bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b339161-2aae-4caa-94b3-7d04fd07923c", "tag": "317a7e2c-04b0-42a7-aeaf-9d27a1726c7a"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:54:14.889860 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a8a6f51f-4cba-471d-ab2f-8939c02d4f10 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:14.893809 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a8a6f51f-4cba-471d-ab2f-8939c02d4f10 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: 2b339161-2aae-4caa-94b3-7d04fd07923c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:14.911030 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8a6f51f-4cba-471d-ab2f-8939c02d4f10 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:14.915178 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-4b7337c1-f49e-4fed-b0f5-07f6cea9aabe req-e9ef36a9-8f4a-4f33-a430-5cc83c7491bd service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:14.921817 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8a6f51f-4cba-471d-ab2f-8939c02d4f10 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:14.922551 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8a6f51f-4cba-471d-ab2f-8939c02d4f10 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:14.923431 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-4b7337c1-f49e-4fed-b0f5-07f6cea9aabe req-e9ef36a9-8f4a-4f33-a430-5cc83c7491bd service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:14.924407 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8a6f51f-4cba-471d-ab2f-8939c02d4f10 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:14.932667 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-4b7337c1-f49e-4fed-b0f5-07f6cea9aabe req-e9ef36a9-8f4a-4f33-a430-5cc83c7491bd service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:14.933896 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8a6f51f-4cba-471d-ab2f-8939c02d4f10 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:14.934569 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8a6f51f-4cba-471d-ab2f-8939c02d4f10 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:14.989965 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-4b7337c1-f49e-4fed-b0f5-07f6cea9aabe req-e9ef36a9-8f4a-4f33-a430-5cc83c7491bd service nova] Creating event network-changed:317a7e2c-04b0-42a7-aeaf-9d27a1726c7a for instance 2b339161-2aae-4caa-94b3-7d04fd07923c on n-h1-master-1 Aug 07 01:54:15.014894 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-4b7337c1-f49e-4fed-b0f5-07f6cea9aabe req-e9ef36a9-8f4a-4f33-a430-5cc83c7491bd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131313 Aug 07 01:54:15.020432 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2763/5984] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:54:15.037548 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a8a6f51f-4cba-471d-ab2f-8939c02d4f10 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: 2b339161-2aae-4caa-94b3-7d04fd07923c] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:54:15.315296 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a8a6f51f-4cba-471d-ab2f-8939c02d4f10 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2b339161-2aae-4caa-94b3-7d04fd07923c" status: 204 len: 0 microversion: 2.1 time: 0.434499 Aug 07 01:54:15.317495 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3222/5985] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:54:14 2022] DELETE /compute/v2.1/servers/2b339161-2aae-4caa-94b3-7d04fd07923c => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:54:15.334734 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c97cfb68-026b-4da5-9809-0ffe6bebef3c tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:15.336044 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c97cfb68-026b-4da5-9809-0ffe6bebef3c tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: 2b339161-2aae-4caa-94b3-7d04fd07923c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:15.354356 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c97cfb68-026b-4da5-9809-0ffe6bebef3c tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:15.357156 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c97cfb68-026b-4da5-9809-0ffe6bebef3c tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:15.360058 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c97cfb68-026b-4da5-9809-0ffe6bebef3c tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:15.364020 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c97cfb68-026b-4da5-9809-0ffe6bebef3c tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:15.369623 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c97cfb68-026b-4da5-9809-0ffe6bebef3c tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:15.370383 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c97cfb68-026b-4da5-9809-0ffe6bebef3c tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:15.625485 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1f2ccf75-cbfd-415b-b57b-d8c28aa2fb22 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:15.626231 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1f2ccf75-cbfd-415b-b57b-d8c28aa2fb22 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:15.638789 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f2ccf75-cbfd-415b-b57b-d8c28aa2fb22 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:15.639288 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f2ccf75-cbfd-415b-b57b-d8c28aa2fb22 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:15.639734 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f2ccf75-cbfd-415b-b57b-d8c28aa2fb22 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:15.640510 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f2ccf75-cbfd-415b-b57b-d8c28aa2fb22 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:15.641149 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f2ccf75-cbfd-415b-b57b-d8c28aa2fb22 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:15.645268 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c97cfb68-026b-4da5-9809-0ffe6bebef3c tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:15.650356 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f2ccf75-cbfd-415b-b57b-d8c28aa2fb22 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:15.657696 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c97cfb68-026b-4da5-9809-0ffe6bebef3c tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/2b339161-2aae-4caa-94b3-7d04fd07923c" status: 200 len: 1672 microversion: 2.1 time: 0.333899 Aug 07 01:54:15.675016 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2764/5986] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:15 2022] GET /compute/v2.1/servers/2b339161-2aae-4caa-94b3-7d04fd07923c => generated 1672 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:15.757463 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1f2ccf75-cbfd-415b-b57b-d8c28aa2fb22 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:15.767437 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1f2ccf75-cbfd-415b-b57b-d8c28aa2fb22 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1324 microversion: 2.1 time: 0.147085 Aug 07 01:54:15.782719 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3223/5987] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:15 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1324 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:16.685852 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cd7998da-9591-4d66-aaf3-176d5d4bbddd tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:16.687539 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-cd7998da-9591-4d66-aaf3-176d5d4bbddd tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: 2b339161-2aae-4caa-94b3-7d04fd07923c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:16.696014 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cd7998da-9591-4d66-aaf3-176d5d4bbddd tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:16.696777 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cd7998da-9591-4d66-aaf3-176d5d4bbddd tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:16.697711 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cd7998da-9591-4d66-aaf3-176d5d4bbddd tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:16.699766 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cd7998da-9591-4d66-aaf3-176d5d4bbddd tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:16.700780 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cd7998da-9591-4d66-aaf3-176d5d4bbddd tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:16.701889 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cd7998da-9591-4d66-aaf3-176d5d4bbddd tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:16.790946 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-898a5f44-b364-49e9-b97b-2c4fc8902767 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:16.792790 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-898a5f44-b364-49e9-b97b-2c4fc8902767 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:16.820622 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-898a5f44-b364-49e9-b97b-2c4fc8902767 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:16.827070 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-898a5f44-b364-49e9-b97b-2c4fc8902767 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:16.827820 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-898a5f44-b364-49e9-b97b-2c4fc8902767 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:16.836373 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-898a5f44-b364-49e9-b97b-2c4fc8902767 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:16.837260 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-898a5f44-b364-49e9-b97b-2c4fc8902767 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:16.840170 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-898a5f44-b364-49e9-b97b-2c4fc8902767 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:17.213715 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-cd7998da-9591-4d66-aaf3-176d5d4bbddd tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:17.234391 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cd7998da-9591-4d66-aaf3-176d5d4bbddd tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/2b339161-2aae-4caa-94b3-7d04fd07923c" status: 200 len: 1672 microversion: 2.1 time: 0.546287 Aug 07 01:54:17.235569 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2765/5988] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:16 2022] GET /compute/v2.1/servers/2b339161-2aae-4caa-94b3-7d04fd07923c => generated 1672 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:17.381307 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5c96332a-7980-4cbc-81e8-d44693445a71 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:17.381853 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5c96332a-7980-4cbc-81e8-d44693445a71 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] [instance: 9eac877e-1520-4bc6-926a-41df6c09e3c2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:17.396834 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c96332a-7980-4cbc-81e8-d44693445a71 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:17.397646 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c96332a-7980-4cbc-81e8-d44693445a71 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:17.399803 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c96332a-7980-4cbc-81e8-d44693445a71 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:17.400913 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c96332a-7980-4cbc-81e8-d44693445a71 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:17.402714 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c96332a-7980-4cbc-81e8-d44693445a71 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:17.405773 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c96332a-7980-4cbc-81e8-d44693445a71 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:17.460515 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-898a5f44-b364-49e9-b97b-2c4fc8902767 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:17.476533 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-898a5f44-b364-49e9-b97b-2c4fc8902767 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1324 microversion: 2.1 time: 0.690403 Aug 07 01:54:17.477358 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3224/5989] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:16 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1324 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:17.555267 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-5c96332a-7980-4cbc-81e8-d44693445a71 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lazy-loading 'services' on Instance uuid 9eac877e-1520-4bc6-926a-41df6c09e3c2 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:54:17.702857 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5c96332a-7980-4cbc-81e8-d44693445a71 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9eac877e-1520-4bc6-926a-41df6c09e3c2/os-volume_attachments/2d92d266-c47a-470d-92c4-960d210c225c" status: 202 len: 0 microversion: 2.1 time: 0.330281 Aug 07 01:54:17.704332 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2766/5990] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Aug 7 01:54:17 2022] DELETE /compute/v2.1/servers/9eac877e-1520-4bc6-926a-41df6c09e3c2/os-volume_attachments/2d92d266-c47a-470d-92c4-960d210c225c => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 01:54:18.043959 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-a0c97351-4868-4572-92ac-0bcd83d7eab1 req-874d3704-52ff-4c06-99fd-f2e503564a8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b339161-2aae-4caa-94b3-7d04fd07923c", "name": "network-vif-deleted", "tag": "317a7e2c-04b0-42a7-aeaf-9d27a1726c7a"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:54:18.062225 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a0c97351-4868-4572-92ac-0bcd83d7eab1 req-874d3704-52ff-4c06-99fd-f2e503564a8c service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:18.063514 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a0c97351-4868-4572-92ac-0bcd83d7eab1 req-874d3704-52ff-4c06-99fd-f2e503564a8c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:18.065018 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a0c97351-4868-4572-92ac-0bcd83d7eab1 req-874d3704-52ff-4c06-99fd-f2e503564a8c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:18.082746 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-a0c97351-4868-4572-92ac-0bcd83d7eab1 req-874d3704-52ff-4c06-99fd-f2e503564a8c service nova] Creating event network-vif-deleted:317a7e2c-04b0-42a7-aeaf-9d27a1726c7a for instance 2b339161-2aae-4caa-94b3-7d04fd07923c on n-h1-master-1 Aug 07 01:54:18.093848 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-a0c97351-4868-4572-92ac-0bcd83d7eab1 req-874d3704-52ff-4c06-99fd-f2e503564a8c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053563 Aug 07 01:54:18.095625 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3225/5991] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:54:18.262455 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bf880704-2cde-4e97-832d-7f8a42485591 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:18.263582 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bf880704-2cde-4e97-832d-7f8a42485591 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: 2b339161-2aae-4caa-94b3-7d04fd07923c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:18.277537 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf880704-2cde-4e97-832d-7f8a42485591 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:18.278986 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf880704-2cde-4e97-832d-7f8a42485591 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:18.279819 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf880704-2cde-4e97-832d-7f8a42485591 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:18.280971 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf880704-2cde-4e97-832d-7f8a42485591 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:18.281687 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf880704-2cde-4e97-832d-7f8a42485591 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:18.282432 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf880704-2cde-4e97-832d-7f8a42485591 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:18.327163 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf880704-2cde-4e97-832d-7f8a42485591 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:18.328323 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf880704-2cde-4e97-832d-7f8a42485591 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:18.328968 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf880704-2cde-4e97-832d-7f8a42485591 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:18.341791 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-bf880704-2cde-4e97-832d-7f8a42485591 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lazy-loading 'fault' on Instance uuid 2b339161-2aae-4caa-94b3-7d04fd07923c {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:54:18.435261 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bf880704-2cde-4e97-832d-7f8a42485591 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073f0cff787a466a9fbf9fb43b03b726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd8662019804060a7b712456d095ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:18.444257 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bf880704-2cde-4e97-832d-7f8a42485591 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/2b339161-2aae-4caa-94b3-7d04fd07923c" status: 200 len: 1339 microversion: 2.1 time: 0.188288 Aug 07 01:54:18.446592 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2767/5992] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:18 2022] GET /compute/v2.1/servers/2b339161-2aae-4caa-94b3-7d04fd07923c => generated 1339 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:18.498821 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-81e53706-b3ef-44de-bbdd-fb64d26fabd0 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:18.499566 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-81e53706-b3ef-44de-bbdd-fb64d26fabd0 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:18.511961 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-81e53706-b3ef-44de-bbdd-fb64d26fabd0 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:18.512472 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-81e53706-b3ef-44de-bbdd-fb64d26fabd0 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:18.512923 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-81e53706-b3ef-44de-bbdd-fb64d26fabd0 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:18.517704 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-81e53706-b3ef-44de-bbdd-fb64d26fabd0 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:18.518454 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-81e53706-b3ef-44de-bbdd-fb64d26fabd0 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:18.519630 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-81e53706-b3ef-44de-bbdd-fb64d26fabd0 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:18.739403 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-81e53706-b3ef-44de-bbdd-fb64d26fabd0 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:18.752168 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-81e53706-b3ef-44de-bbdd-fb64d26fabd0 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1391 microversion: 2.1 time: 0.257315 Aug 07 01:54:18.753415 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3226/5993] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:18 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1391 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:18.994594 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-6603b8cc-3127-4b2e-a1f8-57f7a69a6312 req-ea0d7ba4-d9ed-40eb-959a-c934d5b53d43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ba17885-27b3-4f21-8cfa-dd2662fb4383", "tag": "29e9d8c4-0b0e-4323-a16e-2e544961b1ba"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:54:19.009987 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6603b8cc-3127-4b2e-a1f8-57f7a69a6312 req-ea0d7ba4-d9ed-40eb-959a-c934d5b53d43 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:19.010480 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6603b8cc-3127-4b2e-a1f8-57f7a69a6312 req-ea0d7ba4-d9ed-40eb-959a-c934d5b53d43 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:19.011196 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6603b8cc-3127-4b2e-a1f8-57f7a69a6312 req-ea0d7ba4-d9ed-40eb-959a-c934d5b53d43 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:19.040241 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-6603b8cc-3127-4b2e-a1f8-57f7a69a6312 req-ea0d7ba4-d9ed-40eb-959a-c934d5b53d43 service nova] Creating event network-changed:29e9d8c4-0b0e-4323-a16e-2e544961b1ba for instance 3ba17885-27b3-4f21-8cfa-dd2662fb4383 on n-h1-master-1 Aug 07 01:54:19.045969 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-6603b8cc-3127-4b2e-a1f8-57f7a69a6312 req-ea0d7ba4-d9ed-40eb-959a-c934d5b53d43 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055943 Aug 07 01:54:19.047388 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2768/5994] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:54:19.468298 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-68d2a128-eb76-431e-9a15-a87abf816e34 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:19.469458 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-68d2a128-eb76-431e-9a15-a87abf816e34 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] [instance: 2b339161-2aae-4caa-94b3-7d04fd07923c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:19.476968 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-68d2a128-eb76-431e-9a15-a87abf816e34 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:19.477540 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-68d2a128-eb76-431e-9a15-a87abf816e34 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:19.478057 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-68d2a128-eb76-431e-9a15-a87abf816e34 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:19.478860 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-68d2a128-eb76-431e-9a15-a87abf816e34 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:19.479541 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-68d2a128-eb76-431e-9a15-a87abf816e34 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:19.480213 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-68d2a128-eb76-431e-9a15-a87abf816e34 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:19.511329 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-68d2a128-eb76-431e-9a15-a87abf816e34 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] HTTP exception thrown: Instance 2b339161-2aae-4caa-94b3-7d04fd07923c could not be found. Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-68d2a128-eb76-431e-9a15-a87abf816e34 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Request method failure captured: Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/2b339161-2aae-4caa-94b3-7d04fd07923c HTTP/1.1 Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xqD3Y6hpz0qjjIlqTvf6bL-avep3kbpCD86d6mV0Qg1gZrhr0EwzSd8p6sxw3q-lH5uqgaLHvennHRhVxrzfTEJTXDTDCcQdl51I4KXqZH6RTstyctnA9qJu1r_QSHQmPuNQdxXVK1absM7uGh656-MicP9C6mAcIiMGwlLipyfNmE Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 2bd8662019804060a7b712456d095ad2 Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-TestNetworkBasicOps-1812327257 Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2bd8662019804060a7b712456d095ad2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2bd8662019804060a7b712456d095ad2", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2bd8662019804060a7b712456d095ad2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2bd8662019804060a7b712456d095ad2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-TestNetworkBasicOps-1812327257 Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 2bd8662019804060a7b712456d095ad2 Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-TestNetworkBasicOps-1812327257 Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-TestNetworkBasicOps-1812327257-project Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 073f0cff787a466a9fbf9fb43b03b726 Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-TestNetworkBasicOps-1812327257-project Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 2b339161-2aae-4caa-94b3-7d04fd07923c could not be found. Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '2b339161-2aae-4caa-94b3-7d04fd07923c'} Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b339161-2aae-4caa-94b3-7d04fd07923c could not be found. Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b339161-2aae-4caa-94b3-7d04fd07923c could not be found. Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:54:19.513809 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:54:19.518050 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:54:19.518050 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:54:19.518050 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:54:19.518050 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:54:19.518050 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:54:19.518050 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b339161-2aae-4caa-94b3-7d04fd07923c could not be found. Aug 07 01:54:19.518050 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:54:19.518050 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-68d2a128-eb76-431e-9a15-a87abf816e34 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Returning 404 to user: Instance 2b339161-2aae-4caa-94b3-7d04fd07923c could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:54:19.518050 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-68d2a128-eb76-431e-9a15-a87abf816e34 tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "GET /compute/v2.1/servers/2b339161-2aae-4caa-94b3-7d04fd07923c" status: 404 len: 111 microversion: 2.1 time: 0.052395 Aug 07 01:54:19.520225 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3227/5995] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:19 2022] GET /compute/v2.1/servers/2b339161-2aae-4caa-94b3-7d04fd07923c => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:54:19.713637 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ccfa9c38-5977-4eff-912e-7fef307c476c tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] Calling method '.version_select at 0x7f9e1744b430>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:19.742424 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ccfa9c38-5977-4eff-912e-7fef307c476c tempest-TestNetworkBasicOps-1812327257 tempest-TestNetworkBasicOps-1812327257-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1661870495" status: 202 len: 0 microversion: 2.1 time: 0.034812 Aug 07 01:54:19.743714 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2769/5996] 10.222.0.39 () {58 vars in 1257 bytes} [Sun Aug 7 01:54:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1661870495 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:54:19.774181 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0d4bf0ad-f512-431b-aa9b-3419bba50c63 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:19.775878 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0d4bf0ad-f512-431b-aa9b-3419bba50c63 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:19.783160 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0d4bf0ad-f512-431b-aa9b-3419bba50c63 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:19.784029 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0d4bf0ad-f512-431b-aa9b-3419bba50c63 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:19.784698 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0d4bf0ad-f512-431b-aa9b-3419bba50c63 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:19.785680 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0d4bf0ad-f512-431b-aa9b-3419bba50c63 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:19.786446 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0d4bf0ad-f512-431b-aa9b-3419bba50c63 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:19.787675 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0d4bf0ad-f512-431b-aa9b-3419bba50c63 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:19.962391 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0d4bf0ad-f512-431b-aa9b-3419bba50c63 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:19.972253 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0d4bf0ad-f512-431b-aa9b-3419bba50c63 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1391 microversion: 2.1 time: 0.202446 Aug 07 01:54:19.973428 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3228/5997] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:19 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1391 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:20.997742 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-befbd002-8c04-49b3-ab29-2f15fb9ee929 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:20.998498 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-befbd002-8c04-49b3-ab29-2f15fb9ee929 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:21.013203 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-befbd002-8c04-49b3-ab29-2f15fb9ee929 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:21.013709 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-befbd002-8c04-49b3-ab29-2f15fb9ee929 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:21.014159 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-befbd002-8c04-49b3-ab29-2f15fb9ee929 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:21.015595 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-befbd002-8c04-49b3-ab29-2f15fb9ee929 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:21.016129 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-befbd002-8c04-49b3-ab29-2f15fb9ee929 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:21.018219 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-befbd002-8c04-49b3-ab29-2f15fb9ee929 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:21.290910 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-befbd002-8c04-49b3-ab29-2f15fb9ee929 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:21.305157 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-befbd002-8c04-49b3-ab29-2f15fb9ee929 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1391 microversion: 2.1 time: 0.312152 Aug 07 01:54:21.306499 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2770/5998] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:20 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1391 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:22.328514 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-41873f8a-c5e9-49e8-b6ac-9cb1b0d5b42b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:22.329203 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-41873f8a-c5e9-49e8-b6ac-9cb1b0d5b42b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:22.342364 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-41873f8a-c5e9-49e8-b6ac-9cb1b0d5b42b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:22.342857 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-41873f8a-c5e9-49e8-b6ac-9cb1b0d5b42b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:22.348736 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-41873f8a-c5e9-49e8-b6ac-9cb1b0d5b42b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:22.349689 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-41873f8a-c5e9-49e8-b6ac-9cb1b0d5b42b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:22.350229 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-41873f8a-c5e9-49e8-b6ac-9cb1b0d5b42b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:22.350673 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-41873f8a-c5e9-49e8-b6ac-9cb1b0d5b42b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:22.684642 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-41873f8a-c5e9-49e8-b6ac-9cb1b0d5b42b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:22.689645 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:54:22.700114 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-41873f8a-c5e9-49e8-b6ac-9cb1b0d5b42b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1391 microversion: 2.1 time: 0.376501 Aug 07 01:54:22.701096 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3229/5999] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:22 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1391 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:23.721295 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-08082970-c807-4422-bfaa-a2fc3326d4d5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:23.721919 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-08082970-c807-4422-bfaa-a2fc3326d4d5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:23.724911 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:54:23.725630 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=10 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:54:23.737621 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-08082970-c807-4422-bfaa-a2fc3326d4d5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:23.738278 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-08082970-c807-4422-bfaa-a2fc3326d4d5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:23.738715 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-08082970-c807-4422-bfaa-a2fc3326d4d5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:23.739429 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-08082970-c807-4422-bfaa-a2fc3326d4d5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:23.740292 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-08082970-c807-4422-bfaa-a2fc3326d4d5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:23.741101 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-08082970-c807-4422-bfaa-a2fc3326d4d5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:23.910303 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-08082970-c807-4422-bfaa-a2fc3326d4d5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:23.918707 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-08082970-c807-4422-bfaa-a2fc3326d4d5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1391 microversion: 2.1 time: 0.201328 Aug 07 01:54:23.919468 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2771/6000] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:23 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1391 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:24.355831 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b0a12654-fd3d-4609-aa56-709d4a7ad488 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:24.357365 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b0a12654-fd3d-4609-aa56-709d4a7ad488 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] [instance: 9eac877e-1520-4bc6-926a-41df6c09e3c2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:24.361958 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:54:24.365580 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:54:24.372367 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b0a12654-fd3d-4609-aa56-709d4a7ad488 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:24.373136 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b0a12654-fd3d-4609-aa56-709d4a7ad488 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:24.373815 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b0a12654-fd3d-4609-aa56-709d4a7ad488 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:24.375392 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b0a12654-fd3d-4609-aa56-709d4a7ad488 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:24.376108 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b0a12654-fd3d-4609-aa56-709d4a7ad488 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:24.376748 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b0a12654-fd3d-4609-aa56-709d4a7ad488 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:24.407710 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b0a12654-fd3d-4609-aa56-709d4a7ad488 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] [instance: 9eac877e-1520-4bc6-926a-41df6c09e3c2] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:54:24.562907 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b0a12654-fd3d-4609-aa56-709d4a7ad488 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9eac877e-1520-4bc6-926a-41df6c09e3c2" status: 204 len: 0 microversion: 2.1 time: 0.210586 Aug 07 01:54:24.563330 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3230/6001] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:54:24 2022] DELETE /compute/v2.1/servers/9eac877e-1520-4bc6-926a-41df6c09e3c2 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:54:24.571835 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-359c5777-87e9-42d6-ad57-c8bc95b092d5 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:24.572581 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-359c5777-87e9-42d6-ad57-c8bc95b092d5 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] [instance: 9eac877e-1520-4bc6-926a-41df6c09e3c2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:24.588032 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-0554bbd4-aeda-4590-861a-35469c249981 req-dd920d97-049e-46e1-9763-9fe5819eb7ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ba17885-27b3-4f21-8cfa-dd2662fb4383", "name": "network-vif-plugged", "status": "completed", "tag": "29e9d8c4-0b0e-4323-a16e-2e544961b1ba"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:54:24.593153 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-359c5777-87e9-42d6-ad57-c8bc95b092d5 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:24.593979 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-359c5777-87e9-42d6-ad57-c8bc95b092d5 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:24.594709 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-359c5777-87e9-42d6-ad57-c8bc95b092d5 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:24.595686 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-359c5777-87e9-42d6-ad57-c8bc95b092d5 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:24.597491 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-359c5777-87e9-42d6-ad57-c8bc95b092d5 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:24.598196 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-359c5777-87e9-42d6-ad57-c8bc95b092d5 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:24.604552 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0554bbd4-aeda-4590-861a-35469c249981 req-dd920d97-049e-46e1-9763-9fe5819eb7ab service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:24.605036 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0554bbd4-aeda-4590-861a-35469c249981 req-dd920d97-049e-46e1-9763-9fe5819eb7ab service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:24.605468 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0554bbd4-aeda-4590-861a-35469c249981 req-dd920d97-049e-46e1-9763-9fe5819eb7ab service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:24.623605 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-0554bbd4-aeda-4590-861a-35469c249981 req-dd920d97-049e-46e1-9763-9fe5819eb7ab service nova] Creating event network-vif-plugged:29e9d8c4-0b0e-4323-a16e-2e544961b1ba for instance 3ba17885-27b3-4f21-8cfa-dd2662fb4383 on n-h1-master-1 Aug 07 01:54:24.629190 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-0554bbd4-aeda-4590-861a-35469c249981 req-dd920d97-049e-46e1-9763-9fe5819eb7ab service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184649 Aug 07 01:54:24.630346 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2772/6002] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:54:24.795435 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-359c5777-87e9-42d6-ad57-c8bc95b092d5 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc27d58f027d4fc3b398f6c184911e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2650b8d88f4992a09bcf0048bcc4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:24.810520 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-359c5777-87e9-42d6-ad57-c8bc95b092d5 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] 10.222.0.39 "GET /compute/v2.1/servers/9eac877e-1520-4bc6-926a-41df6c09e3c2" status: 200 len: 1512 microversion: 2.1 time: 0.242622 Aug 07 01:54:24.811487 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3231/6003] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:24 2022] GET /compute/v2.1/servers/9eac877e-1520-4bc6-926a-41df6c09e3c2 => generated 1512 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:54:24.943138 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f26df9db-a494-44fc-b743-ebf41aac5bfa tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:24.944539 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f26df9db-a494-44fc-b743-ebf41aac5bfa tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:24.951875 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f26df9db-a494-44fc-b743-ebf41aac5bfa tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:24.952394 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f26df9db-a494-44fc-b743-ebf41aac5bfa tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:24.952837 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f26df9db-a494-44fc-b743-ebf41aac5bfa tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:24.953552 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f26df9db-a494-44fc-b743-ebf41aac5bfa tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:24.954010 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f26df9db-a494-44fc-b743-ebf41aac5bfa tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:24.954440 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f26df9db-a494-44fc-b743-ebf41aac5bfa tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:25.143006 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f26df9db-a494-44fc-b743-ebf41aac5bfa tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:25.152820 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f26df9db-a494-44fc-b743-ebf41aac5bfa tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1391 microversion: 2.1 time: 0.216205 Aug 07 01:54:25.154081 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2773/6004] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:24 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1391 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:25.834981 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1daafc5c-83b0-450c-987f-8c2c4d894dd3 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:25.835776 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1daafc5c-83b0-450c-987f-8c2c4d894dd3 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] [instance: 9eac877e-1520-4bc6-926a-41df6c09e3c2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:25.860393 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1daafc5c-83b0-450c-987f-8c2c4d894dd3 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:25.869730 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1daafc5c-83b0-450c-987f-8c2c4d894dd3 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:25.869730 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1daafc5c-83b0-450c-987f-8c2c4d894dd3 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:25.870286 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1daafc5c-83b0-450c-987f-8c2c4d894dd3 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:25.870748 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1daafc5c-83b0-450c-987f-8c2c4d894dd3 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:25.871176 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1daafc5c-83b0-450c-987f-8c2c4d894dd3 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:26.085746 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1daafc5c-83b0-450c-987f-8c2c4d894dd3 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc27d58f027d4fc3b398f6c184911e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2650b8d88f4992a09bcf0048bcc4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:26.094193 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1daafc5c-83b0-450c-987f-8c2c4d894dd3 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] 10.222.0.39 "GET /compute/v2.1/servers/9eac877e-1520-4bc6-926a-41df6c09e3c2" status: 200 len: 1512 microversion: 2.1 time: 0.263535 Aug 07 01:54:26.094814 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3232/6005] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:25 2022] GET /compute/v2.1/servers/9eac877e-1520-4bc6-926a-41df6c09e3c2 => generated 1512 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:26.178204 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2d836165-733a-4d5f-999f-688c4bdd4a24 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:26.179143 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2d836165-733a-4d5f-999f-688c4bdd4a24 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:26.188421 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d836165-733a-4d5f-999f-688c4bdd4a24 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:26.189380 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d836165-733a-4d5f-999f-688c4bdd4a24 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:26.190002 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d836165-733a-4d5f-999f-688c4bdd4a24 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:26.191149 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d836165-733a-4d5f-999f-688c4bdd4a24 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:26.191952 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d836165-733a-4d5f-999f-688c4bdd4a24 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:26.192681 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d836165-733a-4d5f-999f-688c4bdd4a24 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:26.486016 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2d836165-733a-4d5f-999f-688c4bdd4a24 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:26.502622 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2d836165-733a-4d5f-999f-688c4bdd4a24 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1563 microversion: 2.1 time: 0.330303 Aug 07 01:54:26.507772 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2774/6006] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:26 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1563 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:54:26.525777 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-631db249-5fae-445b-a7fa-7832af1c00cc tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:26.526721 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-631db249-5fae-445b-a7fa-7832af1c00cc tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:26.533121 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-631db249-5fae-445b-a7fa-7832af1c00cc tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:26.533949 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-631db249-5fae-445b-a7fa-7832af1c00cc tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:26.534520 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-631db249-5fae-445b-a7fa-7832af1c00cc tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:26.535353 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-631db249-5fae-445b-a7fa-7832af1c00cc tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:26.535960 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-631db249-5fae-445b-a7fa-7832af1c00cc tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:26.536525 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-631db249-5fae-445b-a7fa-7832af1c00cc tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:26.704303 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-631db249-5fae-445b-a7fa-7832af1c00cc tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:26.713344 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-631db249-5fae-445b-a7fa-7832af1c00cc tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1563 microversion: 2.1 time: 0.191478 Aug 07 01:54:26.716263 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3233/6007] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:26 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1563 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:27.118022 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c582d637-d45e-4ab9-ba77-957b9c792aaf tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:27.118550 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c582d637-d45e-4ab9-ba77-957b9c792aaf tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] [instance: 9eac877e-1520-4bc6-926a-41df6c09e3c2] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:27.126174 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c582d637-d45e-4ab9-ba77-957b9c792aaf tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:27.126676 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c582d637-d45e-4ab9-ba77-957b9c792aaf tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:27.127104 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c582d637-d45e-4ab9-ba77-957b9c792aaf tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:27.128041 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c582d637-d45e-4ab9-ba77-957b9c792aaf tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:27.128655 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c582d637-d45e-4ab9-ba77-957b9c792aaf tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:27.129239 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c582d637-d45e-4ab9-ba77-957b9c792aaf tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:27.433228 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-23d21e6b-38d0-4adc-afe5-ccffc9e18b8a req-c2888290-6af4-434c-8d6c-3f26fff218c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eac877e-1520-4bc6-926a-41df6c09e3c2", "name": "network-vif-deleted", "tag": "5a533663-cc92-4129-8d33-23b26e354b1e"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:54:27.440256 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c582d637-d45e-4ab9-ba77-957b9c792aaf tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc27d58f027d4fc3b398f6c184911e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2650b8d88f4992a09bcf0048bcc4c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:27.447348 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-23d21e6b-38d0-4adc-afe5-ccffc9e18b8a req-c2888290-6af4-434c-8d6c-3f26fff218c3 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:27.448256 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-23d21e6b-38d0-4adc-afe5-ccffc9e18b8a req-c2888290-6af4-434c-8d6c-3f26fff218c3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:27.448890 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-23d21e6b-38d0-4adc-afe5-ccffc9e18b8a req-c2888290-6af4-434c-8d6c-3f26fff218c3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:27.457625 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c582d637-d45e-4ab9-ba77-957b9c792aaf tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] 10.222.0.39 "GET /compute/v2.1/servers/9eac877e-1520-4bc6-926a-41df6c09e3c2" status: 200 len: 1470 microversion: 2.1 time: 0.343793 Aug 07 01:54:27.469721 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-23d21e6b-38d0-4adc-afe5-ccffc9e18b8a req-c2888290-6af4-434c-8d6c-3f26fff218c3 service nova] Creating event network-vif-deleted:5a533663-cc92-4129-8d33-23b26e354b1e for instance 9eac877e-1520-4bc6-926a-41df6c09e3c2 on n-h2-master-1 Aug 07 01:54:27.473324 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2775/6008] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:27 2022] GET /compute/v2.1/servers/9eac877e-1520-4bc6-926a-41df6c09e3c2 => generated 1470 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:27.478894 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-23d21e6b-38d0-4adc-afe5-ccffc9e18b8a req-c2888290-6af4-434c-8d6c-3f26fff218c3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049510 Aug 07 01:54:27.480239 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3234/6009] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:54:28.246728 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4d075b90-e6ce-4a49-a2ba-2354ae856c22 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-42274636", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3c6417e2-a78a-48a3-a5a9-3ff4fdda40cd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "620c0b3f-63f9-404f-acf4-ca02927e0de7"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:54:28.318878 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-4d075b90-e6ce-4a49-a2ba-2354ae856c22 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] validate_networks() for [('620c0b3f-63f9-404f-acf4-ca02927e0de7', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:54:28.480188 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5018ffd0-8b39-49b6-a867-ad8034dce1c9 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:28.481475 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5018ffd0-8b39-49b6-a867-ad8034dce1c9 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] [instance: 9eac877e-1520-4bc6-926a-41df6c09e3c2] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:28.488049 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5018ffd0-8b39-49b6-a867-ad8034dce1c9 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:28.488773 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5018ffd0-8b39-49b6-a867-ad8034dce1c9 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:28.489893 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5018ffd0-8b39-49b6-a867-ad8034dce1c9 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:28.490802 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5018ffd0-8b39-49b6-a867-ad8034dce1c9 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:28.491601 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5018ffd0-8b39-49b6-a867-ad8034dce1c9 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:28.492259 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5018ffd0-8b39-49b6-a867-ad8034dce1c9 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:28.508117 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-5018ffd0-8b39-49b6-a867-ad8034dce1c9 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] HTTP exception thrown: Instance 9eac877e-1520-4bc6-926a-41df6c09e3c2 could not be found. Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5018ffd0-8b39-49b6-a867-ad8034dce1c9 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Request method failure captured: Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/9eac877e-1520-4bc6-926a-41df6c09e3c2 HTTP/1.1 Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xpoq5UL7EN0goeKS2LLfDh7f_5dc1ha2OFZf7EP32jDtoaeXblLUqTMx-kyABv3xSaGsXw7BxbHlJKDSn9KuyCSwyTqwzUyXNDSVQ94coPocPAJ1UmRF7Svi5s-zHMxgMqK9tycwy3VKbq-ZEh55hA8w0InVDavDpumOe9j7loBJy8 Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: da2650b8d88f4992a09bcf0048bcc4c2 Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1434859046 Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/da2650b8d88f4992a09bcf0048bcc4c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_da2650b8d88f4992a09bcf0048bcc4c2", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/da2650b8d88f4992a09bcf0048bcc4c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/da2650b8d88f4992a09bcf0048bcc4c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-VolumesSnapshotTestJSON-1434859046 Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: da2650b8d88f4992a09bcf0048bcc4c2 Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1434859046 Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-VolumesSnapshotTestJSON-1434859046-project Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: cc27d58f027d4fc3b398f6c184911e2e Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-VolumesSnapshotTestJSON-1434859046-project Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 9eac877e-1520-4bc6-926a-41df6c09e3c2 could not be found. Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '9eac877e-1520-4bc6-926a-41df6c09e3c2'} Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9eac877e-1520-4bc6-926a-41df6c09e3c2 could not be found. Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9eac877e-1520-4bc6-926a-41df6c09e3c2 could not be found. Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:54:28.510095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:54:28.515256 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:54:28.515256 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:54:28.515256 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:54:28.515256 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:54:28.515256 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:54:28.515256 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9eac877e-1520-4bc6-926a-41df6c09e3c2 could not be found. Aug 07 01:54:28.515256 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:54:28.516553 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5018ffd0-8b39-49b6-a867-ad8034dce1c9 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] Returning 404 to user: Instance 9eac877e-1520-4bc6-926a-41df6c09e3c2 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:54:28.517590 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5018ffd0-8b39-49b6-a867-ad8034dce1c9 tempest-VolumesSnapshotTestJSON-1434859046 tempest-VolumesSnapshotTestJSON-1434859046-project] 10.222.0.39 "GET /compute/v2.1/servers/9eac877e-1520-4bc6-926a-41df6c09e3c2" status: 404 len: 111 microversion: 2.1 time: 0.042585 Aug 07 01:54:28.518691 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3235/6010] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:28 2022] GET /compute/v2.1/servers/9eac877e-1520-4bc6-926a-41df6c09e3c2 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:54:29.228250 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-4d075b90-e6ce-4a49-a2ba-2354ae856c22 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:54:29.228908 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-4d075b90-e6ce-4a49-a2ba-2354ae856c22 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:54:29.229142 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-4d075b90-e6ce-4a49-a2ba-2354ae856c22 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:54:29.229568 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-4d075b90-e6ce-4a49-a2ba-2354ae856c22 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:54:29.229981 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-4d075b90-e6ce-4a49-a2ba-2354ae856c22 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:54:29.244057 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d075b90-e6ce-4a49-a2ba-2354ae856c22 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:29.244554 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d075b90-e6ce-4a49-a2ba-2354ae856c22 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:29.245002 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d075b90-e6ce-4a49-a2ba-2354ae856c22 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:29.245715 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d075b90-e6ce-4a49-a2ba-2354ae856c22 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:29.246570 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d075b90-e6ce-4a49-a2ba-2354ae856c22 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:29.247148 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d075b90-e6ce-4a49-a2ba-2354ae856c22 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:29.272369 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-4d075b90-e6ce-4a49-a2ba-2354ae856c22 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Getting quotas for project bf36f5153ba648008cdaceb9dc538e53. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:54:29.287509 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-4d075b90-e6ce-4a49-a2ba-2354ae856c22 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Getting quotas for user 661f6c9aa7da4e348a9b0d91840078c2 and project bf36f5153ba648008cdaceb9dc538e53. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:54:29.416137 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4d075b90-e6ce-4a49-a2ba-2354ae856c22 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:54:29.424991 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4d075b90-e6ce-4a49-a2ba-2354ae856c22 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 277f7152-8a1d-4143-bd17-7b5e290bbda3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3c6417e2-a78a-48a3-a5a9-3ff4fdda40cd',volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:54:29.710924 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4d075b90-e6ce-4a49-a2ba-2354ae856c22 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.468183 Aug 07 01:54:29.711671 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2776/6011] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:54:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:54:29.724684 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-89e5cbcd-d022-48a2-86a5-4474d2bcae72 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:29.725448 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-89e5cbcd-d022-48a2-86a5-4474d2bcae72 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 277f7152-8a1d-4143-bd17-7b5e290bbda3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:29.857056 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-89e5cbcd-d022-48a2-86a5-4474d2bcae72 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:29.866613 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-89e5cbcd-d022-48a2-86a5-4474d2bcae72 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3" status: 200 len: 1069 microversion: 2.1 time: 0.147294 Aug 07 01:54:29.867784 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3236/6012] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:29 2022] GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3 => generated 1069 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:30.359261 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-482103d7-d3ca-4c2e-b575-6202470ee167 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:30.360186 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-482103d7-d3ca-4c2e-b575-6202470ee167 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:30.377474 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-2dc2cdf9-826a-4249-9ce3-a178ebfed051 req-48c2f46e-75ca-4c8b-81f6-31e45ebd8c2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ba17885-27b3-4f21-8cfa-dd2662fb4383", "tag": "29e9d8c4-0b0e-4323-a16e-2e544961b1ba"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:54:30.378304 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-482103d7-d3ca-4c2e-b575-6202470ee167 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:30.379837 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-482103d7-d3ca-4c2e-b575-6202470ee167 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:30.381866 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-482103d7-d3ca-4c2e-b575-6202470ee167 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:30.383795 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-482103d7-d3ca-4c2e-b575-6202470ee167 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:30.384380 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-482103d7-d3ca-4c2e-b575-6202470ee167 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:30.386014 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-482103d7-d3ca-4c2e-b575-6202470ee167 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:30.400820 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2dc2cdf9-826a-4249-9ce3-a178ebfed051 req-48c2f46e-75ca-4c8b-81f6-31e45ebd8c2a service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:30.402582 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2dc2cdf9-826a-4249-9ce3-a178ebfed051 req-48c2f46e-75ca-4c8b-81f6-31e45ebd8c2a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:30.403809 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2dc2cdf9-826a-4249-9ce3-a178ebfed051 req-48c2f46e-75ca-4c8b-81f6-31e45ebd8c2a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:30.441911 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-2dc2cdf9-826a-4249-9ce3-a178ebfed051 req-48c2f46e-75ca-4c8b-81f6-31e45ebd8c2a service nova] Creating event network-changed:29e9d8c4-0b0e-4323-a16e-2e544961b1ba for instance 3ba17885-27b3-4f21-8cfa-dd2662fb4383 on n-h1-master-1 Aug 07 01:54:30.464650 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-2dc2cdf9-826a-4249-9ce3-a178ebfed051 req-48c2f46e-75ca-4c8b-81f6-31e45ebd8c2a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090387 Aug 07 01:54:30.475978 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3237/6013] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:54:30.800910 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-482103d7-d3ca-4c2e-b575-6202470ee167 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:30.813474 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-482103d7-d3ca-4c2e-b575-6202470ee167 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1563 microversion: 2.1 time: 0.459707 Aug 07 01:54:30.814862 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2777/6014] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:30 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1563 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:30.891535 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c7d1974c-4d4e-4311-a023-b6ed01226743 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:30.892613 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c7d1974c-4d4e-4311-a023-b6ed01226743 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 277f7152-8a1d-4143-bd17-7b5e290bbda3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:30.924507 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c7d1974c-4d4e-4311-a023-b6ed01226743 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:30.931146 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c7d1974c-4d4e-4311-a023-b6ed01226743 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:30.933346 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c7d1974c-4d4e-4311-a023-b6ed01226743 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:30.935564 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c7d1974c-4d4e-4311-a023-b6ed01226743 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:30.940501 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c7d1974c-4d4e-4311-a023-b6ed01226743 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:30.942589 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c7d1974c-4d4e-4311-a023-b6ed01226743 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:31.267102 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c7d1974c-4d4e-4311-a023-b6ed01226743 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:31.277930 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c7d1974c-4d4e-4311-a023-b6ed01226743 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3" status: 200 len: 1111 microversion: 2.1 time: 0.391943 Aug 07 01:54:31.280231 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3238/6015] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:30 2022] GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3 => generated 1111 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:32.306885 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e73c3154-1097-4865-96ea-002e21def431 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:32.309286 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e73c3154-1097-4865-96ea-002e21def431 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 277f7152-8a1d-4143-bd17-7b5e290bbda3] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:32.331089 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e73c3154-1097-4865-96ea-002e21def431 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:32.335572 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e73c3154-1097-4865-96ea-002e21def431 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:32.338619 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e73c3154-1097-4865-96ea-002e21def431 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:32.349707 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e73c3154-1097-4865-96ea-002e21def431 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:32.350459 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e73c3154-1097-4865-96ea-002e21def431 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:32.351101 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e73c3154-1097-4865-96ea-002e21def431 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:32.554102 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e73c3154-1097-4865-96ea-002e21def431 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:32.578225 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e73c3154-1097-4865-96ea-002e21def431 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3" status: 200 len: 1185 microversion: 2.1 time: 0.279172 Aug 07 01:54:32.578904 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2778/6016] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:32 2022] GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3 => generated 1185 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:33.616191 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-55829645-7476-40f3-b4be-a9b14ee0ae5d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:33.620000 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-55829645-7476-40f3-b4be-a9b14ee0ae5d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 277f7152-8a1d-4143-bd17-7b5e290bbda3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:33.638925 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-55829645-7476-40f3-b4be-a9b14ee0ae5d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:33.643164 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-55829645-7476-40f3-b4be-a9b14ee0ae5d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:33.643667 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-55829645-7476-40f3-b4be-a9b14ee0ae5d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:33.647130 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-55829645-7476-40f3-b4be-a9b14ee0ae5d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:33.647623 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-55829645-7476-40f3-b4be-a9b14ee0ae5d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:33.648109 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-55829645-7476-40f3-b4be-a9b14ee0ae5d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:34.115675 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-55829645-7476-40f3-b4be-a9b14ee0ae5d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:34.151611 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-55829645-7476-40f3-b4be-a9b14ee0ae5d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3" status: 200 len: 1227 microversion: 2.1 time: 0.550841 Aug 07 01:54:34.164703 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3239/6017] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:33 2022] GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3 => generated 1227 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:35.199849 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-177e5056-006b-45bf-a061-ad892db1f722 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:35.203944 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-177e5056-006b-45bf-a061-ad892db1f722 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 277f7152-8a1d-4143-bd17-7b5e290bbda3] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:35.213811 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:54:35.241837 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-177e5056-006b-45bf-a061-ad892db1f722 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:35.243066 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-177e5056-006b-45bf-a061-ad892db1f722 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:35.244935 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-177e5056-006b-45bf-a061-ad892db1f722 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:35.247716 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-177e5056-006b-45bf-a061-ad892db1f722 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:35.249026 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-177e5056-006b-45bf-a061-ad892db1f722 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:35.250171 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-177e5056-006b-45bf-a061-ad892db1f722 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:35.255874 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-08529434-6661-4512-8df4-e6ed25e5014e req-df524bdd-0e31-4ff3-901c-248f750e913c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "277f7152-8a1d-4143-bd17-7b5e290bbda3", "tag": "fae9ac07-9030-4d87-b25a-d363647e4013"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:54:35.311366 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-08529434-6661-4512-8df4-e6ed25e5014e req-df524bdd-0e31-4ff3-901c-248f750e913c service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:35.311874 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-08529434-6661-4512-8df4-e6ed25e5014e req-df524bdd-0e31-4ff3-901c-248f750e913c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:35.312351 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-08529434-6661-4512-8df4-e6ed25e5014e req-df524bdd-0e31-4ff3-901c-248f750e913c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:35.406402 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-08529434-6661-4512-8df4-e6ed25e5014e req-df524bdd-0e31-4ff3-901c-248f750e913c service nova] Creating event network-changed:fae9ac07-9030-4d87-b25a-d363647e4013 for instance 277f7152-8a1d-4143-bd17-7b5e290bbda3 on n-h2-master-1 Aug 07 01:54:35.422136 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-08529434-6661-4512-8df4-e6ed25e5014e req-df524bdd-0e31-4ff3-901c-248f750e913c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169370 Aug 07 01:54:35.424705 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3240/6018] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:54:35.832364 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-177e5056-006b-45bf-a061-ad892db1f722 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:35.867559 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-177e5056-006b-45bf-a061-ad892db1f722 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3" status: 200 len: 1227 microversion: 2.1 time: 0.685433 Aug 07 01:54:35.880914 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2779/6019] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:35 2022] GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3 => generated 1227 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:36.889837 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-31a52967-eb52-49ad-bcef-22902954b6b5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:36.890555 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-31a52967-eb52-49ad-bcef-22902954b6b5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 277f7152-8a1d-4143-bd17-7b5e290bbda3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:36.913384 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31a52967-eb52-49ad-bcef-22902954b6b5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:36.914590 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31a52967-eb52-49ad-bcef-22902954b6b5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:36.915477 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31a52967-eb52-49ad-bcef-22902954b6b5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:36.918119 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31a52967-eb52-49ad-bcef-22902954b6b5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:36.918728 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31a52967-eb52-49ad-bcef-22902954b6b5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:36.921929 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31a52967-eb52-49ad-bcef-22902954b6b5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:37.212587 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-31a52967-eb52-49ad-bcef-22902954b6b5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:37.245661 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-31a52967-eb52-49ad-bcef-22902954b6b5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3" status: 200 len: 1227 microversion: 2.1 time: 0.352188 Aug 07 01:54:37.246874 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3241/6020] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:36 2022] GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3 => generated 1227 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:38.267922 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e7377dd8-6b6a-45ea-b322-eaece0c14afc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:38.269187 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e7377dd8-6b6a-45ea-b322-eaece0c14afc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 277f7152-8a1d-4143-bd17-7b5e290bbda3] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:38.288155 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7377dd8-6b6a-45ea-b322-eaece0c14afc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:38.288925 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7377dd8-6b6a-45ea-b322-eaece0c14afc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:38.289583 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7377dd8-6b6a-45ea-b322-eaece0c14afc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:38.290482 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7377dd8-6b6a-45ea-b322-eaece0c14afc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:38.291295 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7377dd8-6b6a-45ea-b322-eaece0c14afc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:38.293183 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7377dd8-6b6a-45ea-b322-eaece0c14afc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:38.593094 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e7377dd8-6b6a-45ea-b322-eaece0c14afc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:38.597066 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:54:38.602355 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e7377dd8-6b6a-45ea-b322-eaece0c14afc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3" status: 200 len: 1227 microversion: 2.1 time: 0.338285 Aug 07 01:54:38.614536 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2780/6021] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:38 2022] GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3 => generated 1227 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:39.635079 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d423eff3-8690-4132-99ee-a1e3cb4de7dd tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:39.635710 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d423eff3-8690-4132-99ee-a1e3cb4de7dd tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 277f7152-8a1d-4143-bd17-7b5e290bbda3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:39.642737 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d423eff3-8690-4132-99ee-a1e3cb4de7dd tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:39.646197 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d423eff3-8690-4132-99ee-a1e3cb4de7dd tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:39.647054 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d423eff3-8690-4132-99ee-a1e3cb4de7dd tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:39.648223 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d423eff3-8690-4132-99ee-a1e3cb4de7dd tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:39.648899 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d423eff3-8690-4132-99ee-a1e3cb4de7dd tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:39.653352 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d423eff3-8690-4132-99ee-a1e3cb4de7dd tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:39.865577 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:54:40.040725 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d423eff3-8690-4132-99ee-a1e3cb4de7dd tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:40.050874 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d423eff3-8690-4132-99ee-a1e3cb4de7dd tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3" status: 200 len: 1227 microversion: 2.1 time: 0.419565 Aug 07 01:54:40.056574 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3242/6022] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:39 2022] GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3 => generated 1227 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:41.081896 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b5f053e5-2fce-43f7-b094-f09c4c3a1af5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:41.082813 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b5f053e5-2fce-43f7-b094-f09c4c3a1af5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 277f7152-8a1d-4143-bd17-7b5e290bbda3] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:41.086888 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:54:41.090403 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:54:41.108202 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5f053e5-2fce-43f7-b094-f09c4c3a1af5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:41.109264 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5f053e5-2fce-43f7-b094-f09c4c3a1af5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:41.109948 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5f053e5-2fce-43f7-b094-f09c4c3a1af5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:41.111401 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5f053e5-2fce-43f7-b094-f09c4c3a1af5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:41.114257 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5f053e5-2fce-43f7-b094-f09c4c3a1af5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:41.115437 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5f053e5-2fce-43f7-b094-f09c4c3a1af5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:41.465121 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b5f053e5-2fce-43f7-b094-f09c4c3a1af5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:41.485519 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b5f053e5-2fce-43f7-b094-f09c4c3a1af5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3" status: 200 len: 1215 microversion: 2.1 time: 0.406401 Aug 07 01:54:41.489133 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2781/6023] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:41 2022] GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3 => generated 1215 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:42.509051 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-32fde355-e2e5-4067-8ccc-7fdb40204601 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:42.510535 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-32fde355-e2e5-4067-8ccc-7fdb40204601 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 277f7152-8a1d-4143-bd17-7b5e290bbda3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:42.525891 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32fde355-e2e5-4067-8ccc-7fdb40204601 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:42.526480 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32fde355-e2e5-4067-8ccc-7fdb40204601 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:42.526991 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32fde355-e2e5-4067-8ccc-7fdb40204601 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:42.527782 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32fde355-e2e5-4067-8ccc-7fdb40204601 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:42.528775 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32fde355-e2e5-4067-8ccc-7fdb40204601 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:42.533381 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32fde355-e2e5-4067-8ccc-7fdb40204601 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:42.830303 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-32fde355-e2e5-4067-8ccc-7fdb40204601 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:42.844509 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-32fde355-e2e5-4067-8ccc-7fdb40204601 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3" status: 200 len: 1215 microversion: 2.1 time: 0.336862 Aug 07 01:54:42.845885 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3243/6024] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:42 2022] GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3 => generated 1215 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:43.446849 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-587fa75d-0096-4982-bc4d-11a50c678b03 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Action: 'create', calling method: .version_select at 0x7f9e174b4b80>, body: {"keypair": {"name": "tempest-TestServerBasicOps-790114507", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD43fUuV6nZLhXmnmETWgYv5LL8LqPHU25xlOb+P0XyLhOiWuEGqjqJtSPqQf61PloHPzeHm6/LYtsW6wZ7QAmokHVvX2yFRPnJ4nd2mD74In6kte+QXAqM2K4jmmaZ7Qw=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:54:43.471941 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-587fa75d-0096-4982-bc4d-11a50c678b03 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Getting quotas for project 7df97238e4904914ba19be69db5e228b. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:54:43.478721 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-587fa75d-0096-4982-bc4d-11a50c678b03 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Getting quotas for user 2ea9eff758654d1e8b7d02e6b4153a73 and project 7df97238e4904914ba19be69db5e228b. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:54:43.518371 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-587fa75d-0096-4982-bc4d-11a50c678b03 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.346315 Aug 07 01:54:43.519481 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2782/6025] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:54:43 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:54:43.871015 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-58e8f677-2d7a-45af-91d7-ccfa7c43c071 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:43.872048 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-58e8f677-2d7a-45af-91d7-ccfa7c43c071 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 277f7152-8a1d-4143-bd17-7b5e290bbda3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:43.881623 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-58e8f677-2d7a-45af-91d7-ccfa7c43c071 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:43.881932 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-58e8f677-2d7a-45af-91d7-ccfa7c43c071 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:43.882383 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-58e8f677-2d7a-45af-91d7-ccfa7c43c071 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:43.883106 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-58e8f677-2d7a-45af-91d7-ccfa7c43c071 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:43.883569 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-58e8f677-2d7a-45af-91d7-ccfa7c43c071 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:43.884039 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-58e8f677-2d7a-45af-91d7-ccfa7c43c071 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:44.047702 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-58e8f677-2d7a-45af-91d7-ccfa7c43c071 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:44.056948 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-58e8f677-2d7a-45af-91d7-ccfa7c43c071 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3" status: 200 len: 1215 microversion: 2.1 time: 0.193119 Aug 07 01:54:44.057902 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3244/6026] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:43 2022] GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3 => generated 1215 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:44.958130 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fb969789-9b2e-412a-8233-2d2bc452d89e tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1554483835", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-790114507", "security_groups": [{"name": "tempest-secgroup-smoke-170871928"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "98603ed2-1979-49c0-95a3-ee261533fd5e"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:54:45.083272 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7f22dd5d-babf-4fb3-beb9-f7896691c0bb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:45.085252 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7f22dd5d-babf-4fb3-beb9-f7896691c0bb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 277f7152-8a1d-4143-bd17-7b5e290bbda3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:45.097276 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f22dd5d-babf-4fb3-beb9-f7896691c0bb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:45.100407 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f22dd5d-babf-4fb3-beb9-f7896691c0bb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:45.101072 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f22dd5d-babf-4fb3-beb9-f7896691c0bb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:45.105349 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f22dd5d-babf-4fb3-beb9-f7896691c0bb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:45.106021 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f22dd5d-babf-4fb3-beb9-f7896691c0bb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:45.107024 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f22dd5d-babf-4fb3-beb9-f7896691c0bb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:45.120610 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-fb969789-9b2e-412a-8233-2d2bc452d89e tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] validate_networks() for [('98603ed2-1979-49c0-95a3-ee261533fd5e', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:54:45.270335 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7f22dd5d-babf-4fb3-beb9-f7896691c0bb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:45.278817 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7f22dd5d-babf-4fb3-beb9-f7896691c0bb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3" status: 200 len: 1215 microversion: 2.1 time: 0.201460 Aug 07 01:54:45.292956 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3245/6027] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:45 2022] GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3 => generated 1215 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:46.024476 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-fb969789-9b2e-412a-8233-2d2bc452d89e tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Getting quotas for project 7df97238e4904914ba19be69db5e228b. Resources: dict_keys(['metadata_items']) {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:54:46.031088 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-fb969789-9b2e-412a-8233-2d2bc452d89e tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Getting quotas for user 2ea9eff758654d1e8b7d02e6b4153a73 and project 7df97238e4904914ba19be69db5e228b. Resources: dict_keys(['metadata_items']) {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:54:46.045800 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-fb969789-9b2e-412a-8233-2d2bc452d89e tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:54:46.046227 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-fb969789-9b2e-412a-8233-2d2bc452d89e tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:54:46.046706 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-fb969789-9b2e-412a-8233-2d2bc452d89e tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:54:46.047120 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-fb969789-9b2e-412a-8233-2d2bc452d89e tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:54:46.047569 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-fb969789-9b2e-412a-8233-2d2bc452d89e tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:54:46.055658 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb969789-9b2e-412a-8233-2d2bc452d89e tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:46.056418 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb969789-9b2e-412a-8233-2d2bc452d89e tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:46.056860 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb969789-9b2e-412a-8233-2d2bc452d89e tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:46.057606 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb969789-9b2e-412a-8233-2d2bc452d89e tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:46.058063 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb969789-9b2e-412a-8233-2d2bc452d89e tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:46.058491 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb969789-9b2e-412a-8233-2d2bc452d89e tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:46.076303 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-fb969789-9b2e-412a-8233-2d2bc452d89e tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Getting quotas for project 7df97238e4904914ba19be69db5e228b. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:54:46.081931 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-fb969789-9b2e-412a-8233-2d2bc452d89e tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Getting quotas for user 2ea9eff758654d1e8b7d02e6b4153a73 and project 7df97238e4904914ba19be69db5e228b. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:54:46.095338 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fb969789-9b2e-412a-8233-2d2bc452d89e tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:54:46.097885 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fb969789-9b2e-412a-8233-2d2bc452d89e tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] [instance: e5734d92-ca17-495b-b666-b569ea15ddc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:54:46.147236 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fb969789-9b2e-412a-8233-2d2bc452d89e tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.194851 Aug 07 01:54:46.148090 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2783/6028] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:54:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 1196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:54:46.159108 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6ec8187c-b226-43aa-9cd8-e6c2e236886d tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:46.159732 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6ec8187c-b226-43aa-9cd8-e6c2e236886d tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] [instance: e5734d92-ca17-495b-b666-b569ea15ddc7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:46.218962 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6ec8187c-b226-43aa-9cd8-e6c2e236886d tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea9eff758654d1e8b7d02e6b4153a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df97238e4904914ba19be69db5e228b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:46.225961 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6ec8187c-b226-43aa-9cd8-e6c2e236886d tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] 10.222.0.39 "GET /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7" status: 200 len: 1302 microversion: 2.1 time: 0.070997 Aug 07 01:54:46.227120 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3246/6029] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:46 2022] GET /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7 => generated 1302 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:46.303402 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-152fd4d4-1570-4568-96dd-8e72a244a2aa tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:46.304150 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-152fd4d4-1570-4568-96dd-8e72a244a2aa tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 277f7152-8a1d-4143-bd17-7b5e290bbda3] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:46.310551 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-152fd4d4-1570-4568-96dd-8e72a244a2aa tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:46.311316 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-152fd4d4-1570-4568-96dd-8e72a244a2aa tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:46.312159 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-152fd4d4-1570-4568-96dd-8e72a244a2aa tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:46.312891 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-152fd4d4-1570-4568-96dd-8e72a244a2aa tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:46.313332 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-152fd4d4-1570-4568-96dd-8e72a244a2aa tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:46.313956 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-152fd4d4-1570-4568-96dd-8e72a244a2aa tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:46.482284 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-152fd4d4-1570-4568-96dd-8e72a244a2aa tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:46.496584 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-152fd4d4-1570-4568-96dd-8e72a244a2aa tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3" status: 200 len: 1215 microversion: 2.1 time: 0.195374 Aug 07 01:54:46.498482 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2784/6030] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:46 2022] GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3 => generated 1215 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:47.247351 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-837ef097-9bc8-477d-a645-c98accc7ddb2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:47.251785 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-837ef097-9bc8-477d-a645-c98accc7ddb2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] [instance: e5734d92-ca17-495b-b666-b569ea15ddc7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:47.262831 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-837ef097-9bc8-477d-a645-c98accc7ddb2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:47.263479 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-837ef097-9bc8-477d-a645-c98accc7ddb2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:47.264060 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-837ef097-9bc8-477d-a645-c98accc7ddb2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:47.264984 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-837ef097-9bc8-477d-a645-c98accc7ddb2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:47.265443 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-837ef097-9bc8-477d-a645-c98accc7ddb2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:47.265870 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-837ef097-9bc8-477d-a645-c98accc7ddb2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:47.346401 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-837ef097-9bc8-477d-a645-c98accc7ddb2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea9eff758654d1e8b7d02e6b4153a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df97238e4904914ba19be69db5e228b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:47.355413 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-837ef097-9bc8-477d-a645-c98accc7ddb2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] 10.222.0.39 "GET /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7" status: 200 len: 1354 microversion: 2.1 time: 0.112327 Aug 07 01:54:47.356055 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3247/6031] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:47 2022] GET /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7 => generated 1354 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:47.519992 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-de56b1db-a357-4dfa-aa28-26b812e05bb2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:47.520794 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-de56b1db-a357-4dfa-aa28-26b812e05bb2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 277f7152-8a1d-4143-bd17-7b5e290bbda3] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:47.540775 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-de56b1db-a357-4dfa-aa28-26b812e05bb2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:47.541704 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-de56b1db-a357-4dfa-aa28-26b812e05bb2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:47.542411 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-de56b1db-a357-4dfa-aa28-26b812e05bb2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:47.543350 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-de56b1db-a357-4dfa-aa28-26b812e05bb2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:47.544209 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-de56b1db-a357-4dfa-aa28-26b812e05bb2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:47.545131 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-de56b1db-a357-4dfa-aa28-26b812e05bb2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:47.783479 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-de56b1db-a357-4dfa-aa28-26b812e05bb2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:47.793100 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-de56b1db-a357-4dfa-aa28-26b812e05bb2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3" status: 200 len: 1215 microversion: 2.1 time: 0.278134 Aug 07 01:54:47.794445 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2785/6032] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:47 2022] GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3 => generated 1215 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:48.379523 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-412056c6-038a-4bf1-b84b-4e7b4d42d64f tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:48.381206 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-412056c6-038a-4bf1-b84b-4e7b4d42d64f tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] [instance: e5734d92-ca17-495b-b666-b569ea15ddc7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:48.389105 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-412056c6-038a-4bf1-b84b-4e7b4d42d64f tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:48.389770 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-412056c6-038a-4bf1-b84b-4e7b4d42d64f tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:48.390253 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-412056c6-038a-4bf1-b84b-4e7b4d42d64f tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:48.391118 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-412056c6-038a-4bf1-b84b-4e7b4d42d64f tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:48.391645 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-412056c6-038a-4bf1-b84b-4e7b4d42d64f tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:48.392397 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-412056c6-038a-4bf1-b84b-4e7b4d42d64f tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:48.580956 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-412056c6-038a-4bf1-b84b-4e7b4d42d64f tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea9eff758654d1e8b7d02e6b4153a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df97238e4904914ba19be69db5e228b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:48.592187 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-412056c6-038a-4bf1-b84b-4e7b4d42d64f tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] 10.222.0.39 "GET /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7" status: 200 len: 1427 microversion: 2.1 time: 0.216596 Aug 07 01:54:48.593236 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3248/6033] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:48 2022] GET /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7 => generated 1427 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:48.629464 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-9abdab52-e6b6-4ed2-b91f-0639d8732d80 req-e86fda89-28df-43ec-95e5-8d2ddbc49649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "277f7152-8a1d-4143-bd17-7b5e290bbda3", "name": "network-vif-plugged", "status": "completed", "tag": "fae9ac07-9030-4d87-b25a-d363647e4013"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:54:48.650486 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-9abdab52-e6b6-4ed2-b91f-0639d8732d80 req-e86fda89-28df-43ec-95e5-8d2ddbc49649 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:48.651451 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-9abdab52-e6b6-4ed2-b91f-0639d8732d80 req-e86fda89-28df-43ec-95e5-8d2ddbc49649 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:48.652607 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-9abdab52-e6b6-4ed2-b91f-0639d8732d80 req-e86fda89-28df-43ec-95e5-8d2ddbc49649 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:48.671058 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-9abdab52-e6b6-4ed2-b91f-0639d8732d80 req-e86fda89-28df-43ec-95e5-8d2ddbc49649 service nova] Creating event network-vif-plugged:fae9ac07-9030-4d87-b25a-d363647e4013 for instance 277f7152-8a1d-4143-bd17-7b5e290bbda3 on n-h2-master-1 Aug 07 01:54:48.678099 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-9abdab52-e6b6-4ed2-b91f-0639d8732d80 req-e86fda89-28df-43ec-95e5-8d2ddbc49649 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053020 Aug 07 01:54:48.679310 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2786/6034] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:54:48.817460 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-23b94ee3-765d-48ed-ab03-b0fd876062d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:48.820055 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-23b94ee3-765d-48ed-ab03-b0fd876062d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 277f7152-8a1d-4143-bd17-7b5e290bbda3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:48.827961 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-23b94ee3-765d-48ed-ab03-b0fd876062d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:48.828540 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-23b94ee3-765d-48ed-ab03-b0fd876062d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:48.829444 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-23b94ee3-765d-48ed-ab03-b0fd876062d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:48.830036 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-23b94ee3-765d-48ed-ab03-b0fd876062d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:48.830643 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-23b94ee3-765d-48ed-ab03-b0fd876062d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:48.831091 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-23b94ee3-765d-48ed-ab03-b0fd876062d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:48.882208 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:54:49.065997 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-23b94ee3-765d-48ed-ab03-b0fd876062d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:49.077449 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-23b94ee3-765d-48ed-ab03-b0fd876062d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3" status: 200 len: 1215 microversion: 2.1 time: 0.266271 Aug 07 01:54:49.078052 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3249/6035] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:48 2022] GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3 => generated 1215 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:54:49.406594 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-5205c17a-2161-4763-9c55-c73d97f0c13a req-2224cd07-cf73-4d96-81a1-95bfc8a784a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5734d92-ca17-495b-b666-b569ea15ddc7", "tag": "1ab783fd-84fe-49ff-a0f0-be6a02794aac"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:54:49.420295 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-5205c17a-2161-4763-9c55-c73d97f0c13a req-2224cd07-cf73-4d96-81a1-95bfc8a784a8 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:49.421446 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-5205c17a-2161-4763-9c55-c73d97f0c13a req-2224cd07-cf73-4d96-81a1-95bfc8a784a8 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:49.422128 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-5205c17a-2161-4763-9c55-c73d97f0c13a req-2224cd07-cf73-4d96-81a1-95bfc8a784a8 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:49.438470 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-5205c17a-2161-4763-9c55-c73d97f0c13a req-2224cd07-cf73-4d96-81a1-95bfc8a784a8 service nova] Creating event network-changed:1ab783fd-84fe-49ff-a0f0-be6a02794aac for instance e5734d92-ca17-495b-b666-b569ea15ddc7 on n-h1-master-1 Aug 07 01:54:49.443824 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-5205c17a-2161-4763-9c55-c73d97f0c13a req-2224cd07-cf73-4d96-81a1-95bfc8a784a8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041985 Aug 07 01:54:49.445143 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2787/6036] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:54:49.613848 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6745e57c-2618-492c-bde7-621015c4ede2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:49.614536 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6745e57c-2618-492c-bde7-621015c4ede2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] [instance: e5734d92-ca17-495b-b666-b569ea15ddc7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:49.622839 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6745e57c-2618-492c-bde7-621015c4ede2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:49.623340 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6745e57c-2618-492c-bde7-621015c4ede2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:49.623788 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6745e57c-2618-492c-bde7-621015c4ede2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:49.624539 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6745e57c-2618-492c-bde7-621015c4ede2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:49.625061 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6745e57c-2618-492c-bde7-621015c4ede2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:49.625460 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6745e57c-2618-492c-bde7-621015c4ede2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:49.781019 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6745e57c-2618-492c-bde7-621015c4ede2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea9eff758654d1e8b7d02e6b4153a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df97238e4904914ba19be69db5e228b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:49.789849 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6745e57c-2618-492c-bde7-621015c4ede2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] 10.222.0.39 "GET /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7" status: 200 len: 1427 microversion: 2.1 time: 0.179944 Aug 07 01:54:49.790475 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3250/6037] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:49 2022] GET /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7 => generated 1427 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:50.100841 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6582bf4e-17a8-429a-aa6e-b7a82bd3314e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:50.101667 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6582bf4e-17a8-429a-aa6e-b7a82bd3314e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 277f7152-8a1d-4143-bd17-7b5e290bbda3] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:50.115552 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6582bf4e-17a8-429a-aa6e-b7a82bd3314e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:50.117374 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6582bf4e-17a8-429a-aa6e-b7a82bd3314e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:50.117852 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6582bf4e-17a8-429a-aa6e-b7a82bd3314e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:50.121092 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6582bf4e-17a8-429a-aa6e-b7a82bd3314e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:50.121586 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6582bf4e-17a8-429a-aa6e-b7a82bd3314e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:50.122031 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6582bf4e-17a8-429a-aa6e-b7a82bd3314e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:50.335083 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6582bf4e-17a8-429a-aa6e-b7a82bd3314e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:50.342904 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6582bf4e-17a8-429a-aa6e-b7a82bd3314e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3" status: 200 len: 1215 microversion: 2.1 time: 0.248707 Aug 07 01:54:50.344533 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2788/6038] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:50 2022] GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3 => generated 1215 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:54:50.811165 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c35510cf-ce46-4ac2-8236-801ba0878ce9 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:50.811756 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c35510cf-ce46-4ac2-8236-801ba0878ce9 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] [instance: e5734d92-ca17-495b-b666-b569ea15ddc7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:50.818943 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c35510cf-ce46-4ac2-8236-801ba0878ce9 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:50.819465 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c35510cf-ce46-4ac2-8236-801ba0878ce9 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:50.819936 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c35510cf-ce46-4ac2-8236-801ba0878ce9 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:50.820655 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c35510cf-ce46-4ac2-8236-801ba0878ce9 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:50.821111 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c35510cf-ce46-4ac2-8236-801ba0878ce9 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:50.831818 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c35510cf-ce46-4ac2-8236-801ba0878ce9 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:51.015179 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c35510cf-ce46-4ac2-8236-801ba0878ce9 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea9eff758654d1e8b7d02e6b4153a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df97238e4904914ba19be69db5e228b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:51.025242 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c35510cf-ce46-4ac2-8236-801ba0878ce9 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] 10.222.0.39 "GET /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7" status: 200 len: 1427 microversion: 2.1 time: 0.218089 Aug 07 01:54:51.026138 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3251/6039] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:50 2022] GET /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7 => generated 1427 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:51.363869 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b66988b7-2da4-4ac2-8964-6d0265435aa5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:51.364454 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b66988b7-2da4-4ac2-8964-6d0265435aa5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 277f7152-8a1d-4143-bd17-7b5e290bbda3] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:51.371488 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b66988b7-2da4-4ac2-8964-6d0265435aa5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:51.371951 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b66988b7-2da4-4ac2-8964-6d0265435aa5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:51.372389 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b66988b7-2da4-4ac2-8964-6d0265435aa5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:51.373084 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b66988b7-2da4-4ac2-8964-6d0265435aa5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:51.373717 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b66988b7-2da4-4ac2-8964-6d0265435aa5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:51.374143 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b66988b7-2da4-4ac2-8964-6d0265435aa5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:51.527951 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b66988b7-2da4-4ac2-8964-6d0265435aa5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:51.536161 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b66988b7-2da4-4ac2-8964-6d0265435aa5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3" status: 200 len: 1402 microversion: 2.1 time: 0.176231 Aug 07 01:54:51.536760 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2789/6040] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:51 2022] GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3 => generated 1402 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:51.556499 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4b760620-cf59-48ac-9894-fb37c0216be4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:51.557127 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4b760620-cf59-48ac-9894-fb37c0216be4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 277f7152-8a1d-4143-bd17-7b5e290bbda3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:51.563742 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b760620-cf59-48ac-9894-fb37c0216be4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:51.564269 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b760620-cf59-48ac-9894-fb37c0216be4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:51.564715 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b760620-cf59-48ac-9894-fb37c0216be4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:51.565434 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b760620-cf59-48ac-9894-fb37c0216be4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:51.565901 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b760620-cf59-48ac-9894-fb37c0216be4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:51.566827 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4b760620-cf59-48ac-9894-fb37c0216be4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:51.967419 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-46f41987-6ac6-424a-99d0-cc6655c9c7fb tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:54:51.969853 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-46f41987-6ac6-424a-99d0-cc6655c9c7fb tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:51.975783 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4b760620-cf59-48ac-9894-fb37c0216be4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:51.977951 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-46f41987-6ac6-424a-99d0-cc6655c9c7fb tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:51.978444 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-46f41987-6ac6-424a-99d0-cc6655c9c7fb tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:51.978882 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-46f41987-6ac6-424a-99d0-cc6655c9c7fb tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:51.979596 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-46f41987-6ac6-424a-99d0-cc6655c9c7fb tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:51.980077 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-46f41987-6ac6-424a-99d0-cc6655c9c7fb tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:51.980528 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-46f41987-6ac6-424a-99d0-cc6655c9c7fb tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:51.991424 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4b760620-cf59-48ac-9894-fb37c0216be4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3" status: 200 len: 1402 microversion: 2.1 time: 0.438834 Aug 07 01:54:51.992613 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3252/6041] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:51 2022] GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3 => generated 1402 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:52.015085 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-21779a7c-d45e-4ea7-ac69-ef28765fc870 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-591491546"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:54:52.017505 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-21779a7c-d45e-4ea7-ac69-ef28765fc870 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 277f7152-8a1d-4143-bd17-7b5e290bbda3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:52.023974 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21779a7c-d45e-4ea7-ac69-ef28765fc870 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:52.024643 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21779a7c-d45e-4ea7-ac69-ef28765fc870 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:52.025166 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21779a7c-d45e-4ea7-ac69-ef28765fc870 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:52.025899 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21779a7c-d45e-4ea7-ac69-ef28765fc870 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:52.026364 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21779a7c-d45e-4ea7-ac69-ef28765fc870 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:52.026798 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21779a7c-d45e-4ea7-ac69-ef28765fc870 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:52.054362 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-46f41987-6ac6-424a-99d0-cc6655c9c7fb tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "POST /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383/action" status: 200 len: 24575 microversion: 2.1 time: 0.090831 Aug 07 01:54:52.057080 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2790/6042] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:54:51 2022] POST /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383/action => generated 24575 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:54:52.060937 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4d988e6d-1d5e-4b90-bd13-0442167dbcfa tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:52.061729 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4d988e6d-1d5e-4b90-bd13-0442167dbcfa tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] [instance: e5734d92-ca17-495b-b666-b569ea15ddc7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:52.069512 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d988e6d-1d5e-4b90-bd13-0442167dbcfa tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:52.070087 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d988e6d-1d5e-4b90-bd13-0442167dbcfa tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:52.070606 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d988e6d-1d5e-4b90-bd13-0442167dbcfa tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:52.071374 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d988e6d-1d5e-4b90-bd13-0442167dbcfa tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:52.071907 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d988e6d-1d5e-4b90-bd13-0442167dbcfa tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:52.072400 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d988e6d-1d5e-4b90-bd13-0442167dbcfa tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:52.134113 n-d-master-1 devstack@n-api.service[119516]: INFO nova.compute.api [None req-21779a7c-d45e-4ea7-ac69-ef28765fc870 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 277f7152-8a1d-4143-bd17-7b5e290bbda3] Attempting to quiesce instance before volume snapshot. Aug 07 01:54:52.212533 n-d-master-1 devstack@n-api.service[119516]: INFO nova.compute.api [None req-21779a7c-d45e-4ea7-ac69-ef28765fc870 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 277f7152-8a1d-4143-bd17-7b5e290bbda3] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Aug 07 01:54:52.225391 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4d988e6d-1d5e-4b90-bd13-0442167dbcfa tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea9eff758654d1e8b7d02e6b4153a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df97238e4904914ba19be69db5e228b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:52.242286 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4d988e6d-1d5e-4b90-bd13-0442167dbcfa tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] 10.222.0.39 "GET /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7" status: 200 len: 1427 microversion: 2.1 time: 0.185380 Aug 07 01:54:52.243733 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2791/6043] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:52 2022] GET /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7 => generated 1427 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:52.300756 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-21779a7c-d45e-4ea7-ac69-ef28765fc870 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 277f7152-8a1d-4143-bd17-7b5e290bbda3] Creating snapshot from volume 3c6417e2-a78a-48a3-a5a9-3ff4fdda40cd. {{(pid=119516) snapshot_instance /opt/stack/nova/nova/compute/api.py:3456}} Aug 07 01:54:53.265232 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-126dc6d3-d757-4cfd-8908-206fcc3a6b41 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:53.266827 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-126dc6d3-d757-4cfd-8908-206fcc3a6b41 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] [instance: e5734d92-ca17-495b-b666-b569ea15ddc7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:53.275069 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-126dc6d3-d757-4cfd-8908-206fcc3a6b41 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:53.275975 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-126dc6d3-d757-4cfd-8908-206fcc3a6b41 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:53.276914 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-126dc6d3-d757-4cfd-8908-206fcc3a6b41 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:53.277917 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-126dc6d3-d757-4cfd-8908-206fcc3a6b41 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:53.278605 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-126dc6d3-d757-4cfd-8908-206fcc3a6b41 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:53.279262 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-126dc6d3-d757-4cfd-8908-206fcc3a6b41 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:53.317558 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-21779a7c-d45e-4ea7-ac69-ef28765fc870 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "POST /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3/action" status: 202 len: 0 microversion: 2.1 time: 1.307766 Aug 07 01:54:53.324441 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3253/6044] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:54:52 2022] POST /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3/action => generated 0 bytes in 1315 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 07 01:54:53.449450 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-126dc6d3-d757-4cfd-8908-206fcc3a6b41 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea9eff758654d1e8b7d02e6b4153a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df97238e4904914ba19be69db5e228b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:53.457667 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-126dc6d3-d757-4cfd-8908-206fcc3a6b41 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] 10.222.0.39 "GET /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7" status: 200 len: 1427 microversion: 2.1 time: 0.197050 Aug 07 01:54:53.458237 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2792/6045] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:53 2022] GET /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7 => generated 1427 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:54:54.481026 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d48ea23a-dfb7-4457-9cb3-f271dbd15ce2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:54.482556 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d48ea23a-dfb7-4457-9cb3-f271dbd15ce2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] [instance: e5734d92-ca17-495b-b666-b569ea15ddc7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:54.494669 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:54:54.497541 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d48ea23a-dfb7-4457-9cb3-f271dbd15ce2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:54.498260 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d48ea23a-dfb7-4457-9cb3-f271dbd15ce2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:54.498883 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d48ea23a-dfb7-4457-9cb3-f271dbd15ce2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:54.500170 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d48ea23a-dfb7-4457-9cb3-f271dbd15ce2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:54.500977 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d48ea23a-dfb7-4457-9cb3-f271dbd15ce2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:54.502054 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d48ea23a-dfb7-4457-9cb3-f271dbd15ce2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:54.530819 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-1a15be57-b909-43cc-9354-60666b10f658 req-dc0051e4-5766-4a59-b8b2-bd2ac72b41a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5734d92-ca17-495b-b666-b569ea15ddc7", "name": "network-vif-plugged", "status": "completed", "tag": "1ab783fd-84fe-49ff-a0f0-be6a02794aac"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:54:54.560184 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-1a15be57-b909-43cc-9354-60666b10f658 req-dc0051e4-5766-4a59-b8b2-bd2ac72b41a2 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:54.560705 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-1a15be57-b909-43cc-9354-60666b10f658 req-dc0051e4-5766-4a59-b8b2-bd2ac72b41a2 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:54.561142 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-1a15be57-b909-43cc-9354-60666b10f658 req-dc0051e4-5766-4a59-b8b2-bd2ac72b41a2 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:54.581177 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-1a15be57-b909-43cc-9354-60666b10f658 req-dc0051e4-5766-4a59-b8b2-bd2ac72b41a2 service nova] Creating event network-vif-plugged:1ab783fd-84fe-49ff-a0f0-be6a02794aac for instance e5734d92-ca17-495b-b666-b569ea15ddc7 on n-h1-master-1 Aug 07 01:54:54.586501 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-1a15be57-b909-43cc-9354-60666b10f658 req-dc0051e4-5766-4a59-b8b2-bd2ac72b41a2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061452 Aug 07 01:54:54.587366 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2793/6046] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:54:54.593756 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7ca2129c-1dfd-431e-9453-221f8e9c9da8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-546508423", "imageRef": "7a10d145-c59b-4712-a565-2b09d01dcb73", "flavorRef": "452", "networks": [{"uuid": "620c0b3f-63f9-404f-acf4-ca02927e0de7"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:54:54.692289 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-7ca2129c-1dfd-431e-9453-221f8e9c9da8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] validate_networks() for [('620c0b3f-63f9-404f-acf4-ca02927e0de7', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:54:54.701933 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d48ea23a-dfb7-4457-9cb3-f271dbd15ce2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea9eff758654d1e8b7d02e6b4153a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df97238e4904914ba19be69db5e228b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:54.711090 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d48ea23a-dfb7-4457-9cb3-f271dbd15ce2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] 10.222.0.39 "GET /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7" status: 200 len: 1427 microversion: 2.1 time: 0.235763 Aug 07 01:54:54.711916 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3254/6047] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:54 2022] GET /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7 => generated 1427 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:55.196488 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-7ca2129c-1dfd-431e-9453-221f8e9c9da8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:54:55.196941 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-7ca2129c-1dfd-431e-9453-221f8e9c9da8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:54:55.197555 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-7ca2129c-1dfd-431e-9453-221f8e9c9da8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:54:55.197999 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-7ca2129c-1dfd-431e-9453-221f8e9c9da8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:54:55.198417 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-7ca2129c-1dfd-431e-9453-221f8e9c9da8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:54:55.209388 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ca2129c-1dfd-431e-9453-221f8e9c9da8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:55.209882 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ca2129c-1dfd-431e-9453-221f8e9c9da8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:55.210327 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ca2129c-1dfd-431e-9453-221f8e9c9da8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:55.211075 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ca2129c-1dfd-431e-9453-221f8e9c9da8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:55.211533 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ca2129c-1dfd-431e-9453-221f8e9c9da8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:55.212028 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7ca2129c-1dfd-431e-9453-221f8e9c9da8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:55.233662 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-7ca2129c-1dfd-431e-9453-221f8e9c9da8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Getting quotas for project bf36f5153ba648008cdaceb9dc538e53. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:54:55.240805 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-7ca2129c-1dfd-431e-9453-221f8e9c9da8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Getting quotas for user 661f6c9aa7da4e348a9b0d91840078c2 and project bf36f5153ba648008cdaceb9dc538e53. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:54:55.255666 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7ca2129c-1dfd-431e-9453-221f8e9c9da8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:54:55.256921 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7ca2129c-1dfd-431e-9453-221f8e9c9da8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='3fdad937-ddeb-4e60-947a-9bbf6a5a9914',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:54:55.341636 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7ca2129c-1dfd-431e-9453-221f8e9c9da8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.752789 Aug 07 01:54:55.342891 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2794/6048] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:54:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:54:55.354195 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-947f2b3d-71b0-43d2-b45e-f0672055d39f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:55.355176 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-947f2b3d-71b0-43d2-b45e-f0672055d39f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:55.422093 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-947f2b3d-71b0-43d2-b45e-f0672055d39f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:55.434384 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-947f2b3d-71b0-43d2-b45e-f0672055d39f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 200 len: 1229 microversion: 2.1 time: 0.084042 Aug 07 01:54:55.435254 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3255/6049] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:55 2022] GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 1229 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:54:55.735719 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d4af65d7-ca95-47e9-8b7e-848e4a95ce98 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:55.738022 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d4af65d7-ca95-47e9-8b7e-848e4a95ce98 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] [instance: e5734d92-ca17-495b-b666-b569ea15ddc7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:55.751437 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d4af65d7-ca95-47e9-8b7e-848e4a95ce98 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:55.752421 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d4af65d7-ca95-47e9-8b7e-848e4a95ce98 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:55.753149 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d4af65d7-ca95-47e9-8b7e-848e4a95ce98 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:55.755317 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d4af65d7-ca95-47e9-8b7e-848e4a95ce98 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:55.756057 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d4af65d7-ca95-47e9-8b7e-848e4a95ce98 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:55.756716 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d4af65d7-ca95-47e9-8b7e-848e4a95ce98 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:55.929193 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d4af65d7-ca95-47e9-8b7e-848e4a95ce98 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea9eff758654d1e8b7d02e6b4153a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df97238e4904914ba19be69db5e228b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:55.937520 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d4af65d7-ca95-47e9-8b7e-848e4a95ce98 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] 10.222.0.39 "GET /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7" status: 200 len: 1427 microversion: 2.1 time: 0.206829 Aug 07 01:54:55.938423 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2795/6050] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:55 2022] GET /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7 => generated 1427 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:56.458992 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3b61afcb-f7d2-4948-bd61-037ea013aa2c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:56.459562 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3b61afcb-f7d2-4948-bd61-037ea013aa2c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:56.467495 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b61afcb-f7d2-4948-bd61-037ea013aa2c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:56.468046 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b61afcb-f7d2-4948-bd61-037ea013aa2c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:56.468554 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b61afcb-f7d2-4948-bd61-037ea013aa2c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:56.469253 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b61afcb-f7d2-4948-bd61-037ea013aa2c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:56.469727 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b61afcb-f7d2-4948-bd61-037ea013aa2c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:56.470198 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b61afcb-f7d2-4948-bd61-037ea013aa2c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:56.535176 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3b61afcb-f7d2-4948-bd61-037ea013aa2c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:56.544686 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3b61afcb-f7d2-4948-bd61-037ea013aa2c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 200 len: 1225 microversion: 2.1 time: 0.089768 Aug 07 01:54:56.545265 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3256/6051] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:56 2022] GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:56.959762 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bf653d56-6645-4074-a4d9-4caa95c52886 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:56.961044 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bf653d56-6645-4074-a4d9-4caa95c52886 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] [instance: e5734d92-ca17-495b-b666-b569ea15ddc7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:56.981785 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf653d56-6645-4074-a4d9-4caa95c52886 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:56.982439 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf653d56-6645-4074-a4d9-4caa95c52886 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:56.984138 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf653d56-6645-4074-a4d9-4caa95c52886 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:56.984956 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf653d56-6645-4074-a4d9-4caa95c52886 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:56.986500 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf653d56-6645-4074-a4d9-4caa95c52886 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:56.987197 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf653d56-6645-4074-a4d9-4caa95c52886 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:57.247777 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bf653d56-6645-4074-a4d9-4caa95c52886 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea9eff758654d1e8b7d02e6b4153a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df97238e4904914ba19be69db5e228b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:57.264929 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bf653d56-6645-4074-a4d9-4caa95c52886 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] 10.222.0.39 "GET /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7" status: 200 len: 1607 microversion: 2.1 time: 0.308949 Aug 07 01:54:57.274668 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2796/6052] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:56 2022] GET /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7 => generated 1607 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:54:57.286545 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a5a59dc4-b211-4515-8d12-660ba778e139 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:57.288030 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a5a59dc4-b211-4515-8d12-660ba778e139 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] [instance: e5734d92-ca17-495b-b666-b569ea15ddc7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:57.294934 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a5a59dc4-b211-4515-8d12-660ba778e139 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:57.295628 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a5a59dc4-b211-4515-8d12-660ba778e139 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:57.296377 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a5a59dc4-b211-4515-8d12-660ba778e139 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:57.297302 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a5a59dc4-b211-4515-8d12-660ba778e139 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:57.297769 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a5a59dc4-b211-4515-8d12-660ba778e139 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:57.298522 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a5a59dc4-b211-4515-8d12-660ba778e139 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:57.471484 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a5a59dc4-b211-4515-8d12-660ba778e139 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea9eff758654d1e8b7d02e6b4153a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df97238e4904914ba19be69db5e228b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:57.482208 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a5a59dc4-b211-4515-8d12-660ba778e139 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] 10.222.0.39 "GET /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7" status: 200 len: 1607 microversion: 2.1 time: 0.199401 Aug 07 01:54:57.483393 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3257/6053] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:57 2022] GET /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7 => generated 1607 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:57.507498 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c04645ad-9464-4e50-b8b0-d022c5e356a2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:57.508407 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c04645ad-9464-4e50-b8b0-d022c5e356a2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] [instance: e5734d92-ca17-495b-b666-b569ea15ddc7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:57.516120 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c04645ad-9464-4e50-b8b0-d022c5e356a2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:57.516943 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c04645ad-9464-4e50-b8b0-d022c5e356a2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:57.517560 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c04645ad-9464-4e50-b8b0-d022c5e356a2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:57.518520 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c04645ad-9464-4e50-b8b0-d022c5e356a2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:57.519238 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c04645ad-9464-4e50-b8b0-d022c5e356a2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:57.519987 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c04645ad-9464-4e50-b8b0-d022c5e356a2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:57.567808 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f65b0ca9-7f38-4e60-8183-768b2ff6a762 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:57.568752 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f65b0ca9-7f38-4e60-8183-768b2ff6a762 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:57.576378 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f65b0ca9-7f38-4e60-8183-768b2ff6a762 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:57.577034 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f65b0ca9-7f38-4e60-8183-768b2ff6a762 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:57.579643 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f65b0ca9-7f38-4e60-8183-768b2ff6a762 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:57.580661 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f65b0ca9-7f38-4e60-8183-768b2ff6a762 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:57.581520 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f65b0ca9-7f38-4e60-8183-768b2ff6a762 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:57.587788 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f65b0ca9-7f38-4e60-8183-768b2ff6a762 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:57.676547 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f65b0ca9-7f38-4e60-8183-768b2ff6a762 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:57.687242 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f65b0ca9-7f38-4e60-8183-768b2ff6a762 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 200 len: 1299 microversion: 2.1 time: 0.123299 Aug 07 01:54:57.688576 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3258/6054] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:57 2022] GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 1299 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:54:57.747077 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c04645ad-9464-4e50-b8b0-d022c5e356a2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea9eff758654d1e8b7d02e6b4153a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df97238e4904914ba19be69db5e228b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:57.778022 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c04645ad-9464-4e50-b8b0-d022c5e356a2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] 10.222.0.39 "GET /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7" status: 200 len: 1607 microversion: 2.1 time: 0.275646 Aug 07 01:54:57.789122 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2797/6055] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:57 2022] GET /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7 => generated 1607 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:54:58.709968 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1ba1a0e9-5f66-4dae-8528-7abebc86c44a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:54:58.713151 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1ba1a0e9-5f66-4dae-8528-7abebc86c44a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:54:58.725307 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ba1a0e9-5f66-4dae-8528-7abebc86c44a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:58.726969 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ba1a0e9-5f66-4dae-8528-7abebc86c44a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:58.727635 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ba1a0e9-5f66-4dae-8528-7abebc86c44a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:58.729792 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ba1a0e9-5f66-4dae-8528-7abebc86c44a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:54:58.732957 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ba1a0e9-5f66-4dae-8528-7abebc86c44a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:54:58.733986 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ba1a0e9-5f66-4dae-8528-7abebc86c44a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:54:59.026496 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1ba1a0e9-5f66-4dae-8528-7abebc86c44a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:54:59.037738 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1ba1a0e9-5f66-4dae-8528-7abebc86c44a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 200 len: 1341 microversion: 2.1 time: 0.332158 Aug 07 01:54:59.038696 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3259/6056] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:54:58 2022] GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 1341 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:55:00.006991 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-5f789534-cc9e-43cb-968e-987418ed7379 req-fb06a317-3196-4ca6-8229-1262a068b527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5757297f-6c22-4e54-9a86-20cb632a3f7e", "tag": "f4733d4d-0e54-4bd8-80aa-3a724fc978dd"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:55:00.035823 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-5f789534-cc9e-43cb-968e-987418ed7379 req-fb06a317-3196-4ca6-8229-1262a068b527 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:00.038829 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-5f789534-cc9e-43cb-968e-987418ed7379 req-fb06a317-3196-4ca6-8229-1262a068b527 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:00.039487 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-5f789534-cc9e-43cb-968e-987418ed7379 req-fb06a317-3196-4ca6-8229-1262a068b527 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:00.063046 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-458a5b43-b07d-4f4d-aac0-8d4123be8e30 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:00.066565 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-458a5b43-b07d-4f4d-aac0-8d4123be8e30 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:00.074215 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-458a5b43-b07d-4f4d-aac0-8d4123be8e30 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:00.084638 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-458a5b43-b07d-4f4d-aac0-8d4123be8e30 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:00.085338 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-458a5b43-b07d-4f4d-aac0-8d4123be8e30 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:00.086267 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-458a5b43-b07d-4f4d-aac0-8d4123be8e30 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:00.086876 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-5f789534-cc9e-43cb-968e-987418ed7379 req-fb06a317-3196-4ca6-8229-1262a068b527 service nova] Creating event network-changed:f4733d4d-0e54-4bd8-80aa-3a724fc978dd for instance 5757297f-6c22-4e54-9a86-20cb632a3f7e on n-h2-master-1 Aug 07 01:55:00.087098 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-458a5b43-b07d-4f4d-aac0-8d4123be8e30 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:00.087645 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-458a5b43-b07d-4f4d-aac0-8d4123be8e30 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:00.111594 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-5f789534-cc9e-43cb-968e-987418ed7379 req-fb06a317-3196-4ca6-8229-1262a068b527 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107912 Aug 07 01:55:00.113343 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2798/6057] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:55:00.351211 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-458a5b43-b07d-4f4d-aac0-8d4123be8e30 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:00.358887 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-458a5b43-b07d-4f4d-aac0-8d4123be8e30 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 200 len: 1341 microversion: 2.1 time: 0.299754 Aug 07 01:55:00.359469 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3260/6058] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:00 2022] GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 1341 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:55:01.082873 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-dbd61080-8e06-42f9-bc5e-0322148aec97 req-dbb2e64c-be38-49c0-97a2-46625ab0a4ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5734d92-ca17-495b-b666-b569ea15ddc7", "tag": "1ab783fd-84fe-49ff-a0f0-be6a02794aac"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:55:01.136780 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-dbd61080-8e06-42f9-bc5e-0322148aec97 req-dbb2e64c-be38-49c0-97a2-46625ab0a4ff service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:01.140544 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-dbd61080-8e06-42f9-bc5e-0322148aec97 req-dbb2e64c-be38-49c0-97a2-46625ab0a4ff service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:01.141412 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-dbd61080-8e06-42f9-bc5e-0322148aec97 req-dbb2e64c-be38-49c0-97a2-46625ab0a4ff service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:01.194708 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-dbd61080-8e06-42f9-bc5e-0322148aec97 req-dbb2e64c-be38-49c0-97a2-46625ab0a4ff service nova] Creating event network-changed:1ab783fd-84fe-49ff-a0f0-be6a02794aac for instance e5734d92-ca17-495b-b666-b569ea15ddc7 on n-h1-master-1 Aug 07 01:55:01.218386 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-dbd61080-8e06-42f9-bc5e-0322148aec97 req-dbb2e64c-be38-49c0-97a2-46625ab0a4ff service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140503 Aug 07 01:55:01.224719 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2799/6059] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:55:01.393116 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9e102db1-6a50-4ad8-a455-b02079f93c8c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:01.394729 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9e102db1-6a50-4ad8-a455-b02079f93c8c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:01.413235 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e102db1-6a50-4ad8-a455-b02079f93c8c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:01.418492 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e102db1-6a50-4ad8-a455-b02079f93c8c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:01.419194 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e102db1-6a50-4ad8-a455-b02079f93c8c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:01.423671 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e102db1-6a50-4ad8-a455-b02079f93c8c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:01.428793 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e102db1-6a50-4ad8-a455-b02079f93c8c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:01.429591 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e102db1-6a50-4ad8-a455-b02079f93c8c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:01.943126 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9e102db1-6a50-4ad8-a455-b02079f93c8c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:01.952095 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9e102db1-6a50-4ad8-a455-b02079f93c8c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 200 len: 1341 microversion: 2.1 time: 0.566046 Aug 07 01:55:01.966513 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3261/6060] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:01 2022] GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 1341 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:02.974581 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d86dfa4d-f394-4529-aca8-0c152a35fb60 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:02.975201 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d86dfa4d-f394-4529-aca8-0c152a35fb60 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:02.991601 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d86dfa4d-f394-4529-aca8-0c152a35fb60 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:02.991601 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d86dfa4d-f394-4529-aca8-0c152a35fb60 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:02.991601 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d86dfa4d-f394-4529-aca8-0c152a35fb60 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:02.991601 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d86dfa4d-f394-4529-aca8-0c152a35fb60 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:02.991601 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d86dfa4d-f394-4529-aca8-0c152a35fb60 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:02.992151 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d86dfa4d-f394-4529-aca8-0c152a35fb60 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:03.013139 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2ec6b2f9-fb67-4fc7-8a19-f1b2180d54b4 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:03.013917 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2ec6b2f9-fb67-4fc7-8a19-f1b2180d54b4 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:03.032288 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2ec6b2f9-fb67-4fc7-8a19-f1b2180d54b4 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:03.033322 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2ec6b2f9-fb67-4fc7-8a19-f1b2180d54b4 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:03.034345 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2ec6b2f9-fb67-4fc7-8a19-f1b2180d54b4 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:03.035762 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2ec6b2f9-fb67-4fc7-8a19-f1b2180d54b4 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:03.036502 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2ec6b2f9-fb67-4fc7-8a19-f1b2180d54b4 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:03.037018 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2ec6b2f9-fb67-4fc7-8a19-f1b2180d54b4 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:03.232896 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d86dfa4d-f394-4529-aca8-0c152a35fb60 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:03.247242 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d86dfa4d-f394-4529-aca8-0c152a35fb60 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 200 len: 1341 microversion: 2.1 time: 0.276667 Aug 07 01:55:03.248243 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2800/6061] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:02 2022] GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 1341 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:03.446506 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2ec6b2f9-fb67-4fc7-8a19-f1b2180d54b4 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1833 microversion: 2.1 time: 0.438533 Aug 07 01:55:03.447099 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3262/6062] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:03 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1833 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:03.472485 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bbe02724-7ec3-4700-8fc6-e9ad53ee2f20 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:03.473088 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bbe02724-7ec3-4700-8fc6-e9ad53ee2f20 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:03.480608 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbe02724-7ec3-4700-8fc6-e9ad53ee2f20 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:03.481501 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbe02724-7ec3-4700-8fc6-e9ad53ee2f20 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:03.482318 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbe02724-7ec3-4700-8fc6-e9ad53ee2f20 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:03.483386 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbe02724-7ec3-4700-8fc6-e9ad53ee2f20 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:03.483901 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbe02724-7ec3-4700-8fc6-e9ad53ee2f20 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:03.484358 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbe02724-7ec3-4700-8fc6-e9ad53ee2f20 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:03.723924 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bbe02724-7ec3-4700-8fc6-e9ad53ee2f20 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:03.732394 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bbe02724-7ec3-4700-8fc6-e9ad53ee2f20 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1682 microversion: 2.1 time: 0.265429 Aug 07 01:55:03.748339 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2801/6063] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:03 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1682 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:03.865654 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c684fcae-f81a-4d05-a420-46974ce5c2c2 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:55:03.870187 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c684fcae-f81a-4d05-a420-46974ce5c2c2 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:03.886276 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c684fcae-f81a-4d05-a420-46974ce5c2c2 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:03.887252 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c684fcae-f81a-4d05-a420-46974ce5c2c2 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:03.888739 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c684fcae-f81a-4d05-a420-46974ce5c2c2 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:03.890354 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c684fcae-f81a-4d05-a420-46974ce5c2c2 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:03.892153 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c684fcae-f81a-4d05-a420-46974ce5c2c2 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:03.893284 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c684fcae-f81a-4d05-a420-46974ce5c2c2 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:04.015796 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c684fcae-f81a-4d05-a420-46974ce5c2c2 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "POST /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383/action" status: 200 len: 32643 microversion: 2.1 time: 0.162473 Aug 07 01:55:04.017034 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3263/6064] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:55:03 2022] POST /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383/action => generated 32643 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:55:04.180430 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f2eae590-6a80-44be-8664-7555f0aafd60 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:55:04.181139 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f2eae590-6a80-44be-8664-7555f0aafd60 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:04.195765 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f2eae590-6a80-44be-8664-7555f0aafd60 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:04.196740 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f2eae590-6a80-44be-8664-7555f0aafd60 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:04.198129 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f2eae590-6a80-44be-8664-7555f0aafd60 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:04.200340 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f2eae590-6a80-44be-8664-7555f0aafd60 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:04.201837 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f2eae590-6a80-44be-8664-7555f0aafd60 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:04.203528 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f2eae590-6a80-44be-8664-7555f0aafd60 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:04.277698 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-290b61fd-cacc-41cc-b80d-5d90681745a9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:04.279296 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-290b61fd-cacc-41cc-b80d-5d90681745a9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:04.292983 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-290b61fd-cacc-41cc-b80d-5d90681745a9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:04.293593 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-290b61fd-cacc-41cc-b80d-5d90681745a9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:04.294131 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-290b61fd-cacc-41cc-b80d-5d90681745a9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:04.295189 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f2eae590-6a80-44be-8664-7555f0aafd60 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2fde507388124f7e8d3449239f674c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2569e52ed8a440daa867d62aa63f95d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:04.295355 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-290b61fd-cacc-41cc-b80d-5d90681745a9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:04.295972 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f2eae590-6a80-44be-8664-7555f0aafd60 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] flavor_id is None. Assuming migration. {{(pid=119517) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 07 01:55:04.296733 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f2eae590-6a80-44be-8664-7555f0aafd60 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119517) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 07 01:55:04.297558 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-290b61fd-cacc-41cc-b80d-5d90681745a9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:04.298026 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-290b61fd-cacc-41cc-b80d-5d90681745a9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:04.544756 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-290b61fd-cacc-41cc-b80d-5d90681745a9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:04.567923 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-290b61fd-cacc-41cc-b80d-5d90681745a9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 200 len: 1341 microversion: 2.1 time: 0.301414 Aug 07 01:55:04.570514 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3264/6065] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:04 2022] GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 1341 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:04.638218 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:55:04.725888 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f2eae590-6a80-44be-8664-7555f0aafd60 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383/action" status: 202 len: 0 microversion: 2.1 time: 0.555041 Aug 07 01:55:04.726506 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2802/6066] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:55:04 2022] POST /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383/action => generated 0 bytes in 557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:55:04.737358 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0c37372f-72b5-4575-9ab7-a6adfb2b50a6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:04.741974 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0c37372f-72b5-4575-9ab7-a6adfb2b50a6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:04.754947 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c37372f-72b5-4575-9ab7-a6adfb2b50a6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:04.756276 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c37372f-72b5-4575-9ab7-a6adfb2b50a6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:04.756940 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c37372f-72b5-4575-9ab7-a6adfb2b50a6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:04.757955 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c37372f-72b5-4575-9ab7-a6adfb2b50a6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:04.760870 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c37372f-72b5-4575-9ab7-a6adfb2b50a6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:04.762030 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c37372f-72b5-4575-9ab7-a6adfb2b50a6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:04.775998 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:55:05.036930 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0c37372f-72b5-4575-9ab7-a6adfb2b50a6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:05.059407 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0c37372f-72b5-4575-9ab7-a6adfb2b50a6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1691 microversion: 2.1 time: 0.325970 Aug 07 01:55:05.061804 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3265/6067] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:04 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1691 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:05.610050 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c4279e35-5c34-4864-8be5-55c8dfa35773 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:05.611276 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c4279e35-5c34-4864-8be5-55c8dfa35773 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:05.619512 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=4 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:55:05.624323 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=20 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:55:05.626023 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:55:05.640179 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c4279e35-5c34-4864-8be5-55c8dfa35773 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:05.640676 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c4279e35-5c34-4864-8be5-55c8dfa35773 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:05.641213 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c4279e35-5c34-4864-8be5-55c8dfa35773 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:05.642383 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c4279e35-5c34-4864-8be5-55c8dfa35773 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:05.646111 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c4279e35-5c34-4864-8be5-55c8dfa35773 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:05.647310 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c4279e35-5c34-4864-8be5-55c8dfa35773 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:05.900968 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c4279e35-5c34-4864-8be5-55c8dfa35773 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:05.911807 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c4279e35-5c34-4864-8be5-55c8dfa35773 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 200 len: 1341 microversion: 2.1 time: 0.318465 Aug 07 01:55:05.913485 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2803/6068] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:05 2022] GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 1341 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:06.081138 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=4 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:55:06.086546 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4bb6aec3-f6b0-4856-8de2-2bcc42c85174 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:06.087186 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4bb6aec3-f6b0-4856-8de2-2bcc42c85174 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:06.094655 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4bb6aec3-f6b0-4856-8de2-2bcc42c85174 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:06.095163 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4bb6aec3-f6b0-4856-8de2-2bcc42c85174 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:06.095617 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4bb6aec3-f6b0-4856-8de2-2bcc42c85174 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:06.096695 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4bb6aec3-f6b0-4856-8de2-2bcc42c85174 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:06.096938 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4bb6aec3-f6b0-4856-8de2-2bcc42c85174 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:06.097562 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4bb6aec3-f6b0-4856-8de2-2bcc42c85174 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:06.353717 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4bb6aec3-f6b0-4856-8de2-2bcc42c85174 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:06.365393 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4bb6aec3-f6b0-4856-8de2-2bcc42c85174 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1691 microversion: 2.1 time: 0.285101 Aug 07 01:55:06.366400 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3266/6069] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:06 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1691 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:06.946093 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c7018b70-6086-4f31-a02c-ea98f025fb48 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:06.947325 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c7018b70-6086-4f31-a02c-ea98f025fb48 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:06.956891 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7018b70-6086-4f31-a02c-ea98f025fb48 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:06.957705 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7018b70-6086-4f31-a02c-ea98f025fb48 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:06.958275 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7018b70-6086-4f31-a02c-ea98f025fb48 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:06.959231 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7018b70-6086-4f31-a02c-ea98f025fb48 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:06.960027 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7018b70-6086-4f31-a02c-ea98f025fb48 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:06.961068 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7018b70-6086-4f31-a02c-ea98f025fb48 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:07.310433 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c7018b70-6086-4f31-a02c-ea98f025fb48 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:07.323320 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c7018b70-6086-4f31-a02c-ea98f025fb48 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 200 len: 1341 microversion: 2.1 time: 0.379801 Aug 07 01:55:07.337588 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2804/6070] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:06 2022] GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 1341 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:07.395659 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-14b85691-718d-436a-8bc1-4fa908da2c85 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:07.396333 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-14b85691-718d-436a-8bc1-4fa908da2c85 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:07.407912 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-14b85691-718d-436a-8bc1-4fa908da2c85 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:07.410649 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-14b85691-718d-436a-8bc1-4fa908da2c85 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:07.412150 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-14b85691-718d-436a-8bc1-4fa908da2c85 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:07.413465 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-14b85691-718d-436a-8bc1-4fa908da2c85 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:07.415937 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-14b85691-718d-436a-8bc1-4fa908da2c85 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:07.416581 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-14b85691-718d-436a-8bc1-4fa908da2c85 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:07.699350 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-14b85691-718d-436a-8bc1-4fa908da2c85 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:07.708380 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-14b85691-718d-436a-8bc1-4fa908da2c85 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1691 microversion: 2.1 time: 0.316616 Aug 07 01:55:07.720834 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3267/6071] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:07 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1691 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:55:08.352807 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-47d5b034-2cb8-44ce-bf08-9b2aeba2663c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:08.354810 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-47d5b034-2cb8-44ce-bf08-9b2aeba2663c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:08.363296 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-47d5b034-2cb8-44ce-bf08-9b2aeba2663c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:08.364213 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-47d5b034-2cb8-44ce-bf08-9b2aeba2663c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:08.365052 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-47d5b034-2cb8-44ce-bf08-9b2aeba2663c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:08.366134 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-47d5b034-2cb8-44ce-bf08-9b2aeba2663c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:08.366836 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-47d5b034-2cb8-44ce-bf08-9b2aeba2663c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:08.367482 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-47d5b034-2cb8-44ce-bf08-9b2aeba2663c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:08.528218 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-47d5b034-2cb8-44ce-bf08-9b2aeba2663c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:08.536071 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-47d5b034-2cb8-44ce-bf08-9b2aeba2663c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 200 len: 1341 microversion: 2.1 time: 0.189715 Aug 07 01:55:08.536641 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2805/6072] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:08 2022] GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 1341 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:08.744921 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e394f247-78d6-4f59-be49-91fd962b4a48 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:08.746517 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e394f247-78d6-4f59-be49-91fd962b4a48 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:08.755583 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e394f247-78d6-4f59-be49-91fd962b4a48 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:08.756559 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e394f247-78d6-4f59-be49-91fd962b4a48 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:08.757308 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e394f247-78d6-4f59-be49-91fd962b4a48 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:08.758415 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e394f247-78d6-4f59-be49-91fd962b4a48 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:08.759054 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e394f247-78d6-4f59-be49-91fd962b4a48 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:08.759653 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e394f247-78d6-4f59-be49-91fd962b4a48 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:08.958664 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e394f247-78d6-4f59-be49-91fd962b4a48 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:08.972303 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e394f247-78d6-4f59-be49-91fd962b4a48 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1696 microversion: 2.1 time: 0.232037 Aug 07 01:55:08.973127 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3268/6073] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:08 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1696 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:09.557036 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-93f22bd2-471b-4f4c-b82f-04da4223d305 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:09.557671 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-93f22bd2-471b-4f4c-b82f-04da4223d305 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:09.564501 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93f22bd2-471b-4f4c-b82f-04da4223d305 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:09.566813 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93f22bd2-471b-4f4c-b82f-04da4223d305 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:09.567274 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93f22bd2-471b-4f4c-b82f-04da4223d305 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:09.567998 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93f22bd2-471b-4f4c-b82f-04da4223d305 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:09.568457 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93f22bd2-471b-4f4c-b82f-04da4223d305 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:09.568881 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93f22bd2-471b-4f4c-b82f-04da4223d305 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:09.704433 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-93f22bd2-471b-4f4c-b82f-04da4223d305 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:09.719433 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-93f22bd2-471b-4f4c-b82f-04da4223d305 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 200 len: 1341 microversion: 2.1 time: 0.163162 Aug 07 01:55:09.719433 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2806/6074] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:09 2022] GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 1341 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:09.995085 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e6e29d6d-24d5-4976-9c74-1a19e4064c96 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:09.996012 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e6e29d6d-24d5-4976-9c74-1a19e4064c96 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:10.003729 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6e29d6d-24d5-4976-9c74-1a19e4064c96 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:10.004327 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6e29d6d-24d5-4976-9c74-1a19e4064c96 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:10.004781 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6e29d6d-24d5-4976-9c74-1a19e4064c96 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:10.005536 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6e29d6d-24d5-4976-9c74-1a19e4064c96 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:10.006038 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6e29d6d-24d5-4976-9c74-1a19e4064c96 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:10.006471 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6e29d6d-24d5-4976-9c74-1a19e4064c96 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:10.146904 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e6e29d6d-24d5-4976-9c74-1a19e4064c96 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:10.154884 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e6e29d6d-24d5-4976-9c74-1a19e4064c96 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1696 microversion: 2.1 time: 0.164155 Aug 07 01:55:10.155464 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3269/6075] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:09 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1696 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:10.737995 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bb77c1c8-e757-4810-9e65-83603ddecd3f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:10.738900 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bb77c1c8-e757-4810-9e65-83603ddecd3f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:10.747903 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bb77c1c8-e757-4810-9e65-83603ddecd3f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:10.748538 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bb77c1c8-e757-4810-9e65-83603ddecd3f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:10.749187 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bb77c1c8-e757-4810-9e65-83603ddecd3f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:10.750083 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bb77c1c8-e757-4810-9e65-83603ddecd3f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:10.750683 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bb77c1c8-e757-4810-9e65-83603ddecd3f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:10.751171 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bb77c1c8-e757-4810-9e65-83603ddecd3f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:10.903305 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bb77c1c8-e757-4810-9e65-83603ddecd3f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:10.910937 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bb77c1c8-e757-4810-9e65-83603ddecd3f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 200 len: 1341 microversion: 2.1 time: 0.177416 Aug 07 01:55:10.911599 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2807/6076] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:10 2022] GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 1341 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:11.177161 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c069aa9c-a563-475a-88e5-8d3f3db68181 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:11.177993 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c069aa9c-a563-475a-88e5-8d3f3db68181 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:11.185245 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c069aa9c-a563-475a-88e5-8d3f3db68181 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:11.185744 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c069aa9c-a563-475a-88e5-8d3f3db68181 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:11.186191 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c069aa9c-a563-475a-88e5-8d3f3db68181 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:11.186919 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c069aa9c-a563-475a-88e5-8d3f3db68181 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:11.187384 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c069aa9c-a563-475a-88e5-8d3f3db68181 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:11.187825 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c069aa9c-a563-475a-88e5-8d3f3db68181 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:11.353115 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c069aa9c-a563-475a-88e5-8d3f3db68181 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:11.361583 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c069aa9c-a563-475a-88e5-8d3f3db68181 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1696 microversion: 2.1 time: 0.188536 Aug 07 01:55:11.362822 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3270/6077] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:11 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1696 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:11.933506 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-46dfcfa8-fb53-4cb2-b199-88b0fb294ade tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:11.934148 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-46dfcfa8-fb53-4cb2-b199-88b0fb294ade tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:11.952529 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-46dfcfa8-fb53-4cb2-b199-88b0fb294ade tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:11.953074 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-46dfcfa8-fb53-4cb2-b199-88b0fb294ade tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:11.958439 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-46dfcfa8-fb53-4cb2-b199-88b0fb294ade tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:11.960371 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-46dfcfa8-fb53-4cb2-b199-88b0fb294ade tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:11.966527 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-46dfcfa8-fb53-4cb2-b199-88b0fb294ade tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:11.970274 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-46dfcfa8-fb53-4cb2-b199-88b0fb294ade tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:12.161690 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-46dfcfa8-fb53-4cb2-b199-88b0fb294ade tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:12.172030 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-46dfcfa8-fb53-4cb2-b199-88b0fb294ade tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 200 len: 1341 microversion: 2.1 time: 0.244061 Aug 07 01:55:12.184639 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2808/6078] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:11 2022] GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 1341 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:12.387509 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-85790a86-9446-4d2d-ab0d-37b11dc71829 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:12.389054 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-85790a86-9446-4d2d-ab0d-37b11dc71829 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:12.399464 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-85790a86-9446-4d2d-ab0d-37b11dc71829 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:12.400490 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-85790a86-9446-4d2d-ab0d-37b11dc71829 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:12.401218 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-85790a86-9446-4d2d-ab0d-37b11dc71829 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:12.402268 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-85790a86-9446-4d2d-ab0d-37b11dc71829 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:12.403166 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-85790a86-9446-4d2d-ab0d-37b11dc71829 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:12.404746 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-85790a86-9446-4d2d-ab0d-37b11dc71829 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:12.573880 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-85790a86-9446-4d2d-ab0d-37b11dc71829 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:12.584275 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-85790a86-9446-4d2d-ab0d-37b11dc71829 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1696 microversion: 2.1 time: 0.202075 Aug 07 01:55:12.597590 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3271/6079] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:12 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1696 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:13.194640 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bc3bc064-3f1e-4117-9d50-95effa199c4d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:13.196212 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bc3bc064-3f1e-4117-9d50-95effa199c4d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:13.203955 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc3bc064-3f1e-4117-9d50-95effa199c4d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:13.204579 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc3bc064-3f1e-4117-9d50-95effa199c4d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:13.205111 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc3bc064-3f1e-4117-9d50-95effa199c4d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:13.205971 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc3bc064-3f1e-4117-9d50-95effa199c4d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:13.206521 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc3bc064-3f1e-4117-9d50-95effa199c4d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:13.207041 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc3bc064-3f1e-4117-9d50-95effa199c4d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:13.386860 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bc3bc064-3f1e-4117-9d50-95effa199c4d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:13.394771 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bc3bc064-3f1e-4117-9d50-95effa199c4d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 200 len: 1341 microversion: 2.1 time: 0.204197 Aug 07 01:55:13.395429 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2809/6080] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:13 2022] GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 1341 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:13.609338 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a785aa75-1eb3-407c-aad4-b7bf9b34423c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:13.609970 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a785aa75-1eb3-407c-aad4-b7bf9b34423c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:13.617445 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a785aa75-1eb3-407c-aad4-b7bf9b34423c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:13.618276 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a785aa75-1eb3-407c-aad4-b7bf9b34423c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:13.618729 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a785aa75-1eb3-407c-aad4-b7bf9b34423c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:13.619482 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a785aa75-1eb3-407c-aad4-b7bf9b34423c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:13.619970 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a785aa75-1eb3-407c-aad4-b7bf9b34423c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:13.620425 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a785aa75-1eb3-407c-aad4-b7bf9b34423c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:13.769833 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a785aa75-1eb3-407c-aad4-b7bf9b34423c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:13.778159 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a785aa75-1eb3-407c-aad4-b7bf9b34423c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1696 microversion: 2.1 time: 0.173165 Aug 07 01:55:13.778799 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3272/6081] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:13 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1696 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:14.414522 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-98b916c3-6c54-47b2-8552-a2c850982b9a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:14.415668 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-98b916c3-6c54-47b2-8552-a2c850982b9a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:14.423618 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-98b916c3-6c54-47b2-8552-a2c850982b9a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:14.424801 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-98b916c3-6c54-47b2-8552-a2c850982b9a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:14.425413 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-98b916c3-6c54-47b2-8552-a2c850982b9a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:14.426321 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-98b916c3-6c54-47b2-8552-a2c850982b9a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:14.427063 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-98b916c3-6c54-47b2-8552-a2c850982b9a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:14.427641 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-98b916c3-6c54-47b2-8552-a2c850982b9a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:14.585681 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-98b916c3-6c54-47b2-8552-a2c850982b9a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:14.594767 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-98b916c3-6c54-47b2-8552-a2c850982b9a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 200 len: 1341 microversion: 2.1 time: 0.184194 Aug 07 01:55:14.609060 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2810/6082] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:14 2022] GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 1341 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:14.805980 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5bd64300-2217-434b-84b5-6cb19e3b4517 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:14.806756 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5bd64300-2217-434b-84b5-6cb19e3b4517 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:14.815828 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5bd64300-2217-434b-84b5-6cb19e3b4517 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:14.816515 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5bd64300-2217-434b-84b5-6cb19e3b4517 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:14.817003 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5bd64300-2217-434b-84b5-6cb19e3b4517 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:14.817945 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5bd64300-2217-434b-84b5-6cb19e3b4517 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:14.818528 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5bd64300-2217-434b-84b5-6cb19e3b4517 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:14.819006 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5bd64300-2217-434b-84b5-6cb19e3b4517 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:15.013440 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5bd64300-2217-434b-84b5-6cb19e3b4517 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:15.024439 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5bd64300-2217-434b-84b5-6cb19e3b4517 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1696 microversion: 2.1 time: 0.223315 Aug 07 01:55:15.025904 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3273/6083] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:14 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1696 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:15.619297 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0f41e3ba-4339-4c40-a8b8-55e7197e2437 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:15.620091 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0f41e3ba-4339-4c40-a8b8-55e7197e2437 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:15.627934 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0f41e3ba-4339-4c40-a8b8-55e7197e2437 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:15.628735 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0f41e3ba-4339-4c40-a8b8-55e7197e2437 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:15.629159 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0f41e3ba-4339-4c40-a8b8-55e7197e2437 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:15.629865 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0f41e3ba-4339-4c40-a8b8-55e7197e2437 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:15.630400 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0f41e3ba-4339-4c40-a8b8-55e7197e2437 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:15.630828 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0f41e3ba-4339-4c40-a8b8-55e7197e2437 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:15.783760 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0f41e3ba-4339-4c40-a8b8-55e7197e2437 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:15.791735 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0f41e3ba-4339-4c40-a8b8-55e7197e2437 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 200 len: 1341 microversion: 2.1 time: 0.177004 Aug 07 01:55:15.792387 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2811/6084] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:15 2022] GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 1341 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:16.050559 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9935d907-8221-46d2-9493-c7c71870dc9c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:16.051137 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9935d907-8221-46d2-9493-c7c71870dc9c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:16.058421 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9935d907-8221-46d2-9493-c7c71870dc9c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:16.058928 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9935d907-8221-46d2-9493-c7c71870dc9c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:16.059379 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9935d907-8221-46d2-9493-c7c71870dc9c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:16.060169 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9935d907-8221-46d2-9493-c7c71870dc9c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:16.060638 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9935d907-8221-46d2-9493-c7c71870dc9c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:16.061081 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9935d907-8221-46d2-9493-c7c71870dc9c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:16.208961 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9935d907-8221-46d2-9493-c7c71870dc9c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:16.217481 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9935d907-8221-46d2-9493-c7c71870dc9c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1696 microversion: 2.1 time: 0.171601 Aug 07 01:55:16.218072 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3274/6085] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:16 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1696 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:16.815515 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-606def2f-b195-4066-ba0c-b331ddf35ff5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:16.816100 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-606def2f-b195-4066-ba0c-b331ddf35ff5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:16.823496 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-606def2f-b195-4066-ba0c-b331ddf35ff5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:16.824039 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-606def2f-b195-4066-ba0c-b331ddf35ff5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:16.824535 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-606def2f-b195-4066-ba0c-b331ddf35ff5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:16.825277 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-606def2f-b195-4066-ba0c-b331ddf35ff5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:16.825742 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-606def2f-b195-4066-ba0c-b331ddf35ff5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:16.826178 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-606def2f-b195-4066-ba0c-b331ddf35ff5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:16.979969 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-606def2f-b195-4066-ba0c-b331ddf35ff5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:16.989546 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-606def2f-b195-4066-ba0c-b331ddf35ff5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 200 len: 1375 microversion: 2.1 time: 0.178688 Aug 07 01:55:16.991924 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2812/6086] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:16 2022] GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 1375 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:17.240836 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-35868d32-fbe0-4def-972d-69ef624bb27e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:17.241417 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-35868d32-fbe0-4def-972d-69ef624bb27e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:17.248725 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-35868d32-fbe0-4def-972d-69ef624bb27e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:17.249229 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-35868d32-fbe0-4def-972d-69ef624bb27e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:17.249720 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-35868d32-fbe0-4def-972d-69ef624bb27e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:17.250453 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-35868d32-fbe0-4def-972d-69ef624bb27e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:17.251240 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-35868d32-fbe0-4def-972d-69ef624bb27e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:17.251869 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-35868d32-fbe0-4def-972d-69ef624bb27e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:17.414706 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-35868d32-fbe0-4def-972d-69ef624bb27e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:17.423810 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-35868d32-fbe0-4def-972d-69ef624bb27e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1696 microversion: 2.1 time: 0.187371 Aug 07 01:55:17.438575 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3275/6087] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:17 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1696 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:18.010737 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-79e84118-be3e-45e5-bb62-df99991b0486 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:18.011578 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-79e84118-be3e-45e5-bb62-df99991b0486 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:18.018769 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-79e84118-be3e-45e5-bb62-df99991b0486 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:18.019263 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-79e84118-be3e-45e5-bb62-df99991b0486 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:18.019694 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-79e84118-be3e-45e5-bb62-df99991b0486 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:18.020441 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-79e84118-be3e-45e5-bb62-df99991b0486 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:18.020898 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-79e84118-be3e-45e5-bb62-df99991b0486 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:18.021341 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-79e84118-be3e-45e5-bb62-df99991b0486 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:18.436481 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-79e84118-be3e-45e5-bb62-df99991b0486 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:18.447972 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d455f3aa-7082-4817-a74c-20d750c57065 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:18.449129 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-79e84118-be3e-45e5-bb62-df99991b0486 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 200 len: 1375 microversion: 2.1 time: 0.441541 Aug 07 01:55:18.456488 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d455f3aa-7082-4817-a74c-20d750c57065 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:18.456598 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2813/6088] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:18 2022] GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 1375 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:18.461633 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d455f3aa-7082-4817-a74c-20d750c57065 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:18.462144 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d455f3aa-7082-4817-a74c-20d750c57065 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:18.462617 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d455f3aa-7082-4817-a74c-20d750c57065 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:18.463413 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d455f3aa-7082-4817-a74c-20d750c57065 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:18.464066 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d455f3aa-7082-4817-a74c-20d750c57065 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:18.464780 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d455f3aa-7082-4817-a74c-20d750c57065 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:18.636314 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d455f3aa-7082-4817-a74c-20d750c57065 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:18.645444 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d455f3aa-7082-4817-a74c-20d750c57065 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1696 microversion: 2.1 time: 0.201840 Aug 07 01:55:18.646053 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3276/6089] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:18 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1696 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:55:19.475609 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a99fe9ce-faba-4ba1-bda8-f0dbecefd88d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:19.476321 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a99fe9ce-faba-4ba1-bda8-f0dbecefd88d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:19.484842 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a99fe9ce-faba-4ba1-bda8-f0dbecefd88d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:19.485369 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a99fe9ce-faba-4ba1-bda8-f0dbecefd88d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:19.486199 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a99fe9ce-faba-4ba1-bda8-f0dbecefd88d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:19.487108 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a99fe9ce-faba-4ba1-bda8-f0dbecefd88d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:19.487859 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a99fe9ce-faba-4ba1-bda8-f0dbecefd88d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:19.488326 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a99fe9ce-faba-4ba1-bda8-f0dbecefd88d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:19.643429 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a99fe9ce-faba-4ba1-bda8-f0dbecefd88d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:19.653181 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a99fe9ce-faba-4ba1-bda8-f0dbecefd88d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 200 len: 1375 microversion: 2.1 time: 0.182358 Aug 07 01:55:19.654108 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2814/6090] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:19 2022] GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 1375 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:19.673001 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fdbdf4e7-4138-4bca-a6b8-f693304d16dc tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:19.673860 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fdbdf4e7-4138-4bca-a6b8-f693304d16dc tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:19.682100 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fdbdf4e7-4138-4bca-a6b8-f693304d16dc tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:19.682607 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fdbdf4e7-4138-4bca-a6b8-f693304d16dc tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:19.683210 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fdbdf4e7-4138-4bca-a6b8-f693304d16dc tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:19.683956 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fdbdf4e7-4138-4bca-a6b8-f693304d16dc tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:19.684489 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fdbdf4e7-4138-4bca-a6b8-f693304d16dc tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:19.685290 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fdbdf4e7-4138-4bca-a6b8-f693304d16dc tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:19.874566 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fdbdf4e7-4138-4bca-a6b8-f693304d16dc tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:19.883653 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fdbdf4e7-4138-4bca-a6b8-f693304d16dc tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1696 microversion: 2.1 time: 0.217473 Aug 07 01:55:19.885008 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3277/6091] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:19 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1696 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:20.679072 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1efe5f13-f133-4bea-ac79-69fb741508f0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:20.680456 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1efe5f13-f133-4bea-ac79-69fb741508f0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:20.688284 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1efe5f13-f133-4bea-ac79-69fb741508f0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:20.688785 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1efe5f13-f133-4bea-ac79-69fb741508f0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:20.689895 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1efe5f13-f133-4bea-ac79-69fb741508f0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:20.690696 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1efe5f13-f133-4bea-ac79-69fb741508f0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:20.691162 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1efe5f13-f133-4bea-ac79-69fb741508f0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:20.691592 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1efe5f13-f133-4bea-ac79-69fb741508f0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:20.909878 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f78ae123-5ff9-4fd4-a6bd-3f68db6f270d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:20.912367 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f78ae123-5ff9-4fd4-a6bd-3f68db6f270d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:20.925517 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f78ae123-5ff9-4fd4-a6bd-3f68db6f270d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:20.926405 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f78ae123-5ff9-4fd4-a6bd-3f68db6f270d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:20.927189 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f78ae123-5ff9-4fd4-a6bd-3f68db6f270d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:20.929836 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f78ae123-5ff9-4fd4-a6bd-3f68db6f270d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:20.930553 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f78ae123-5ff9-4fd4-a6bd-3f68db6f270d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:20.931156 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f78ae123-5ff9-4fd4-a6bd-3f68db6f270d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:20.984620 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1efe5f13-f133-4bea-ac79-69fb741508f0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:20.995826 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1efe5f13-f133-4bea-ac79-69fb741508f0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 200 len: 1375 microversion: 2.1 time: 0.323501 Aug 07 01:55:20.996818 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2815/6092] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:20 2022] GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 1375 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:21.117451 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f78ae123-5ff9-4fd4-a6bd-3f68db6f270d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:21.130568 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f78ae123-5ff9-4fd4-a6bd-3f68db6f270d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1695 microversion: 2.1 time: 0.225878 Aug 07 01:55:21.131476 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3278/6093] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:20 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1695 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:21.212690 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-0f7add30-7a2f-474e-b216-741ac8899c54 req-b187528b-0e2d-416d-9460-26bdddd04202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ba17885-27b3-4f21-8cfa-dd2662fb4383", "name": "network-vif-unplugged", "status": "completed", "tag": "29e9d8c4-0b0e-4323-a16e-2e544961b1ba"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:55:21.223362 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0f7add30-7a2f-474e-b216-741ac8899c54 req-b187528b-0e2d-416d-9460-26bdddd04202 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:21.223950 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0f7add30-7a2f-474e-b216-741ac8899c54 req-b187528b-0e2d-416d-9460-26bdddd04202 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:21.224326 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0f7add30-7a2f-474e-b216-741ac8899c54 req-b187528b-0e2d-416d-9460-26bdddd04202 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:21.239634 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-0f7add30-7a2f-474e-b216-741ac8899c54 req-b187528b-0e2d-416d-9460-26bdddd04202 service nova] Creating event network-vif-unplugged:29e9d8c4-0b0e-4323-a16e-2e544961b1ba for instance 3ba17885-27b3-4f21-8cfa-dd2662fb4383 on n-h2-master-1 Aug 07 01:55:21.250672 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [req-0f7add30-7a2f-474e-b216-741ac8899c54 req-b187528b-0e2d-416d-9460-26bdddd04202 service nova] Instance 3ba17885-27b3-4f21-8cfa-dd2662fb4383 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 01:55:21.267213 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-0f7add30-7a2f-474e-b216-741ac8899c54 req-b187528b-0e2d-416d-9460-26bdddd04202 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063523 Aug 07 01:55:21.268054 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2816/6094] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:55:22.020517 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8eb36bbb-e329-458a-80a8-9ae1059cced0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:22.021252 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8eb36bbb-e329-458a-80a8-9ae1059cced0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:22.029959 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8eb36bbb-e329-458a-80a8-9ae1059cced0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:22.030788 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8eb36bbb-e329-458a-80a8-9ae1059cced0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:22.031353 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8eb36bbb-e329-458a-80a8-9ae1059cced0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:22.032462 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8eb36bbb-e329-458a-80a8-9ae1059cced0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:22.033630 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8eb36bbb-e329-458a-80a8-9ae1059cced0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:22.034490 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8eb36bbb-e329-458a-80a8-9ae1059cced0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:22.156168 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0066d815-fecd-4cba-a7da-608f946bb93e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:22.158639 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0066d815-fecd-4cba-a7da-608f946bb93e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:22.165348 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0066d815-fecd-4cba-a7da-608f946bb93e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:22.166361 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0066d815-fecd-4cba-a7da-608f946bb93e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:22.167149 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0066d815-fecd-4cba-a7da-608f946bb93e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:22.168435 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0066d815-fecd-4cba-a7da-608f946bb93e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:22.169062 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0066d815-fecd-4cba-a7da-608f946bb93e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:22.169669 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0066d815-fecd-4cba-a7da-608f946bb93e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:22.230579 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8eb36bbb-e329-458a-80a8-9ae1059cced0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:22.239844 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8eb36bbb-e329-458a-80a8-9ae1059cced0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 200 len: 1375 microversion: 2.1 time: 0.223515 Aug 07 01:55:22.240664 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3279/6095] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:22 2022] GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 1375 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:22.400839 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0066d815-fecd-4cba-a7da-608f946bb93e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:22.410115 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0066d815-fecd-4cba-a7da-608f946bb93e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1695 microversion: 2.1 time: 0.259340 Aug 07 01:55:22.411197 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2817/6096] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:22 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1695 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:55:23.261476 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-559ee7fb-0544-47d2-a2bd-d712c6b88fa3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:23.262024 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-559ee7fb-0544-47d2-a2bd-d712c6b88fa3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:23.269540 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-559ee7fb-0544-47d2-a2bd-d712c6b88fa3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:23.270074 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-559ee7fb-0544-47d2-a2bd-d712c6b88fa3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:23.270502 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-559ee7fb-0544-47d2-a2bd-d712c6b88fa3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:23.271437 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-559ee7fb-0544-47d2-a2bd-d712c6b88fa3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:23.271932 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-559ee7fb-0544-47d2-a2bd-d712c6b88fa3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:23.272385 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-559ee7fb-0544-47d2-a2bd-d712c6b88fa3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:23.299767 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-bf4e14b8-0487-4f42-98b0-1d23cda14a95 req-dc7c8d3f-ec7c-4cfd-9f1c-ea9a1d3a89d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ba17885-27b3-4f21-8cfa-dd2662fb4383", "tag": "29e9d8c4-0b0e-4323-a16e-2e544961b1ba"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:55:23.311669 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-bf4e14b8-0487-4f42-98b0-1d23cda14a95 req-dc7c8d3f-ec7c-4cfd-9f1c-ea9a1d3a89d5 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:23.312432 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-bf4e14b8-0487-4f42-98b0-1d23cda14a95 req-dc7c8d3f-ec7c-4cfd-9f1c-ea9a1d3a89d5 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:23.313077 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-bf4e14b8-0487-4f42-98b0-1d23cda14a95 req-dc7c8d3f-ec7c-4cfd-9f1c-ea9a1d3a89d5 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:23.329150 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-bf4e14b8-0487-4f42-98b0-1d23cda14a95 req-dc7c8d3f-ec7c-4cfd-9f1c-ea9a1d3a89d5 service nova] Creating event network-changed:29e9d8c4-0b0e-4323-a16e-2e544961b1ba for instance 3ba17885-27b3-4f21-8cfa-dd2662fb4383 on n-h2-master-1 Aug 07 01:55:23.335816 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [req-bf4e14b8-0487-4f42-98b0-1d23cda14a95 req-dc7c8d3f-ec7c-4cfd-9f1c-ea9a1d3a89d5 service nova] Instance 3ba17885-27b3-4f21-8cfa-dd2662fb4383 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 01:55:23.350494 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-bf4e14b8-0487-4f42-98b0-1d23cda14a95 req-dc7c8d3f-ec7c-4cfd-9f1c-ea9a1d3a89d5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053955 Aug 07 01:55:23.351456 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2818/6097] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:55:23.435780 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4e2fa204-f2df-4d26-94fa-f38da8c51036 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:23.436348 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4e2fa204-f2df-4d26-94fa-f38da8c51036 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:23.444316 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4e2fa204-f2df-4d26-94fa-f38da8c51036 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:23.444879 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4e2fa204-f2df-4d26-94fa-f38da8c51036 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:23.445543 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4e2fa204-f2df-4d26-94fa-f38da8c51036 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:23.446570 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4e2fa204-f2df-4d26-94fa-f38da8c51036 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:23.448006 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4e2fa204-f2df-4d26-94fa-f38da8c51036 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:23.448671 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4e2fa204-f2df-4d26-94fa-f38da8c51036 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:23.454400 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:55:23.477092 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-559ee7fb-0544-47d2-a2bd-d712c6b88fa3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:23.486436 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-559ee7fb-0544-47d2-a2bd-d712c6b88fa3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 200 len: 1375 microversion: 2.1 time: 0.228897 Aug 07 01:55:23.487200 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3280/6098] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:23 2022] GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 1375 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:23.625907 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4e2fa204-f2df-4d26-94fa-f38da8c51036 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:23.635325 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4e2fa204-f2df-4d26-94fa-f38da8c51036 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1693 microversion: 2.1 time: 0.204555 Aug 07 01:55:23.636447 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2819/6099] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:23 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1693 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:24.509672 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-37a29d7b-20ad-4baf-9b68-22a0218727fc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:24.511061 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-37a29d7b-20ad-4baf-9b68-22a0218727fc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:24.525153 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-37a29d7b-20ad-4baf-9b68-22a0218727fc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:24.525665 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-37a29d7b-20ad-4baf-9b68-22a0218727fc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:24.526123 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-37a29d7b-20ad-4baf-9b68-22a0218727fc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:24.526866 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-37a29d7b-20ad-4baf-9b68-22a0218727fc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:24.527339 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-37a29d7b-20ad-4baf-9b68-22a0218727fc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:24.527784 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-37a29d7b-20ad-4baf-9b68-22a0218727fc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:24.658854 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8de4d1c4-4f7c-4691-ae88-7dd14c00960d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:24.660160 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8de4d1c4-4f7c-4691-ae88-7dd14c00960d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:24.670903 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8de4d1c4-4f7c-4691-ae88-7dd14c00960d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:24.673189 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8de4d1c4-4f7c-4691-ae88-7dd14c00960d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:24.676146 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8de4d1c4-4f7c-4691-ae88-7dd14c00960d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:24.677221 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8de4d1c4-4f7c-4691-ae88-7dd14c00960d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:24.682933 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8de4d1c4-4f7c-4691-ae88-7dd14c00960d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:24.683675 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8de4d1c4-4f7c-4691-ae88-7dd14c00960d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:24.759828 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-37a29d7b-20ad-4baf-9b68-22a0218727fc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:24.763622 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:55:24.770257 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-37a29d7b-20ad-4baf-9b68-22a0218727fc tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 200 len: 1375 microversion: 2.1 time: 0.265091 Aug 07 01:55:24.771187 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3281/6100] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:24 2022] GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 1375 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:24.998038 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-06a811b0-3996-4571-8d6e-3ede2a04cbd4 req-37ed9d16-d8c4-4b0a-ae37-506492627af1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5757297f-6c22-4e54-9a86-20cb632a3f7e", "name": "network-vif-plugged", "status": "completed", "tag": "f4733d4d-0e54-4bd8-80aa-3a724fc978dd"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:55:25.008380 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=58 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:55:25.014988 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-06a811b0-3996-4571-8d6e-3ede2a04cbd4 req-37ed9d16-d8c4-4b0a-ae37-506492627af1 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:25.016577 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-06a811b0-3996-4571-8d6e-3ede2a04cbd4 req-37ed9d16-d8c4-4b0a-ae37-506492627af1 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:25.017307 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-06a811b0-3996-4571-8d6e-3ede2a04cbd4 req-37ed9d16-d8c4-4b0a-ae37-506492627af1 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:25.034066 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-06a811b0-3996-4571-8d6e-3ede2a04cbd4 req-37ed9d16-d8c4-4b0a-ae37-506492627af1 service nova] Creating event network-vif-plugged:f4733d4d-0e54-4bd8-80aa-3a724fc978dd for instance 5757297f-6c22-4e54-9a86-20cb632a3f7e on n-h2-master-1 Aug 07 01:55:25.040754 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-06a811b0-3996-4571-8d6e-3ede2a04cbd4 req-37ed9d16-d8c4-4b0a-ae37-506492627af1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053888 Aug 07 01:55:25.043041 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3282/6101] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:55:25.355290 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8de4d1c4-4f7c-4691-ae88-7dd14c00960d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:25.366664 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8de4d1c4-4f7c-4691-ae88-7dd14c00960d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1690 microversion: 2.1 time: 0.712139 Aug 07 01:55:25.367744 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2820/6102] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:24 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1690 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:55:25.391751 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-369a6757-c538-4606-a751-4265996c3793 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:55:25.393333 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-369a6757-c538-4606-a751-4265996c3793 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:25.412461 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-369a6757-c538-4606-a751-4265996c3793 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:25.412953 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-369a6757-c538-4606-a751-4265996c3793 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:25.413408 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-369a6757-c538-4606-a751-4265996c3793 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:25.414146 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-369a6757-c538-4606-a751-4265996c3793 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:25.414622 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-369a6757-c538-4606-a751-4265996c3793 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:25.415070 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-369a6757-c538-4606-a751-4265996c3793 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:25.506373 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-369a6757-c538-4606-a751-4265996c3793 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "POST /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383/action" status: 204 len: 0 microversion: 2.1 time: 0.118008 Aug 07 01:55:25.507708 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3283/6103] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:55:25 2022] POST /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383/action => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 07 01:55:25.517368 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-afb709a7-6c29-4f37-b079-6ff64589d255 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:25.518422 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-afb709a7-6c29-4f37-b079-6ff64589d255 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:25.535569 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-afb709a7-6c29-4f37-b079-6ff64589d255 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:25.536274 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-afb709a7-6c29-4f37-b079-6ff64589d255 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:25.539230 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-afb709a7-6c29-4f37-b079-6ff64589d255 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:25.540376 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-afb709a7-6c29-4f37-b079-6ff64589d255 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:25.540969 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-afb709a7-6c29-4f37-b079-6ff64589d255 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:25.541916 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-afb709a7-6c29-4f37-b079-6ff64589d255 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:25.775485 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-afb709a7-6c29-4f37-b079-6ff64589d255 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:25.788823 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-afb709a7-6c29-4f37-b079-6ff64589d255 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1690 microversion: 2.1 time: 0.275037 Aug 07 01:55:25.789813 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2821/6104] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:25 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1690 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:25.795084 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8a1c5aeb-2e59-4e94-b456-1a67d1bab4d2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:25.795572 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8a1c5aeb-2e59-4e94-b456-1a67d1bab4d2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:25.803226 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a1c5aeb-2e59-4e94-b456-1a67d1bab4d2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:25.803737 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a1c5aeb-2e59-4e94-b456-1a67d1bab4d2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:25.804247 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a1c5aeb-2e59-4e94-b456-1a67d1bab4d2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:25.805466 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a1c5aeb-2e59-4e94-b456-1a67d1bab4d2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:25.805961 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a1c5aeb-2e59-4e94-b456-1a67d1bab4d2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:25.806514 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8a1c5aeb-2e59-4e94-b456-1a67d1bab4d2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:26.081549 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8a1c5aeb-2e59-4e94-b456-1a67d1bab4d2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:26.095867 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8a1c5aeb-2e59-4e94-b456-1a67d1bab4d2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 200 len: 1375 microversion: 2.1 time: 0.308893 Aug 07 01:55:26.096877 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3284/6105] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:25 2022] GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 1375 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:55:26.811464 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bc5071b2-f097-4d13-9edc-8915291f7ac5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:26.812218 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bc5071b2-f097-4d13-9edc-8915291f7ac5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:26.818533 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc5071b2-f097-4d13-9edc-8915291f7ac5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:26.819167 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc5071b2-f097-4d13-9edc-8915291f7ac5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:26.819791 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc5071b2-f097-4d13-9edc-8915291f7ac5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:26.820620 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc5071b2-f097-4d13-9edc-8915291f7ac5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:26.821181 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc5071b2-f097-4d13-9edc-8915291f7ac5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:26.821725 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc5071b2-f097-4d13-9edc-8915291f7ac5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:26.985456 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bc5071b2-f097-4d13-9edc-8915291f7ac5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:26.997821 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bc5071b2-f097-4d13-9edc-8915291f7ac5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1690 microversion: 2.1 time: 0.190989 Aug 07 01:55:26.998423 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2822/6106] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:26 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1690 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:27.057300 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-0ebf81c4-41fd-408d-be7f-355d3375385b req-d6cdf9b3-10b3-4da6-af61-4a9ea8caa621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ba17885-27b3-4f21-8cfa-dd2662fb4383", "name": "network-vif-plugged", "status": "completed", "tag": "29e9d8c4-0b0e-4323-a16e-2e544961b1ba"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:55:27.072836 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0ebf81c4-41fd-408d-be7f-355d3375385b req-d6cdf9b3-10b3-4da6-af61-4a9ea8caa621 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:27.073725 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0ebf81c4-41fd-408d-be7f-355d3375385b req-d6cdf9b3-10b3-4da6-af61-4a9ea8caa621 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:27.074189 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0ebf81c4-41fd-408d-be7f-355d3375385b req-d6cdf9b3-10b3-4da6-af61-4a9ea8caa621 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:27.088417 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-0ebf81c4-41fd-408d-be7f-355d3375385b req-d6cdf9b3-10b3-4da6-af61-4a9ea8caa621 service nova] Creating event network-vif-plugged:29e9d8c4-0b0e-4323-a16e-2e544961b1ba for instance 3ba17885-27b3-4f21-8cfa-dd2662fb4383 on n-h2-master-1 Aug 07 01:55:27.093969 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-0ebf81c4-41fd-408d-be7f-355d3375385b req-d6cdf9b3-10b3-4da6-af61-4a9ea8caa621 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040538 Aug 07 01:55:27.094888 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3285/6107] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:55:27.117732 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-67f33f51-1cbe-4a71-a2b1-a123d3600c91 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:27.118644 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-67f33f51-1cbe-4a71-a2b1-a123d3600c91 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:27.124832 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-67f33f51-1cbe-4a71-a2b1-a123d3600c91 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:27.125390 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-67f33f51-1cbe-4a71-a2b1-a123d3600c91 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:27.125893 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-67f33f51-1cbe-4a71-a2b1-a123d3600c91 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:27.127009 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-67f33f51-1cbe-4a71-a2b1-a123d3600c91 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:27.127391 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-67f33f51-1cbe-4a71-a2b1-a123d3600c91 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:27.127901 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-67f33f51-1cbe-4a71-a2b1-a123d3600c91 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:27.281576 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-67f33f51-1cbe-4a71-a2b1-a123d3600c91 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:27.291642 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-67f33f51-1cbe-4a71-a2b1-a123d3600c91 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 200 len: 1563 microversion: 2.1 time: 0.178117 Aug 07 01:55:27.292501 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2823/6108] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:27 2022] GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 1563 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:27.313442 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-792aa043-f742-4217-a0c0-9638aaed00c3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:27.314202 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-792aa043-f742-4217-a0c0-9638aaed00c3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:27.321091 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-792aa043-f742-4217-a0c0-9638aaed00c3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:27.321828 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-792aa043-f742-4217-a0c0-9638aaed00c3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:27.322048 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-792aa043-f742-4217-a0c0-9638aaed00c3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:27.322827 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-792aa043-f742-4217-a0c0-9638aaed00c3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:27.323397 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-792aa043-f742-4217-a0c0-9638aaed00c3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:27.323876 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-792aa043-f742-4217-a0c0-9638aaed00c3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:27.469097 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-792aa043-f742-4217-a0c0-9638aaed00c3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:27.477596 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-792aa043-f742-4217-a0c0-9638aaed00c3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 200 len: 1563 microversion: 2.1 time: 0.168464 Aug 07 01:55:27.478437 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3286/6109] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:27 2022] GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 1563 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:27.557118 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6a967018-a386-4a83-a2e5-388b06b38dad tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:27.557707 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6a967018-a386-4a83-a2e5-388b06b38dad tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:27.564058 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a967018-a386-4a83-a2e5-388b06b38dad tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:27.564729 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a967018-a386-4a83-a2e5-388b06b38dad tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:27.565366 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a967018-a386-4a83-a2e5-388b06b38dad tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:27.566008 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a967018-a386-4a83-a2e5-388b06b38dad tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:27.566465 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a967018-a386-4a83-a2e5-388b06b38dad tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:27.566893 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a967018-a386-4a83-a2e5-388b06b38dad tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:27.593903 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6a967018-a386-4a83-a2e5-388b06b38dad tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:55:27.671328 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6a967018-a386-4a83-a2e5-388b06b38dad tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 204 len: 0 microversion: 2.1 time: 0.117777 Aug 07 01:55:27.672068 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2824/6110] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:55:27 2022] DELETE /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:55:27.681596 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a8d88c1a-7da7-4f6a-82dd-b02cf5229cd6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:27.682348 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a8d88c1a-7da7-4f6a-82dd-b02cf5229cd6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:27.688722 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8d88c1a-7da7-4f6a-82dd-b02cf5229cd6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:27.689267 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8d88c1a-7da7-4f6a-82dd-b02cf5229cd6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:27.689730 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8d88c1a-7da7-4f6a-82dd-b02cf5229cd6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:27.690611 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8d88c1a-7da7-4f6a-82dd-b02cf5229cd6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:27.691396 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8d88c1a-7da7-4f6a-82dd-b02cf5229cd6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:27.691911 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8d88c1a-7da7-4f6a-82dd-b02cf5229cd6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:27.828141 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a8d88c1a-7da7-4f6a-82dd-b02cf5229cd6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:27.836759 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a8d88c1a-7da7-4f6a-82dd-b02cf5229cd6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 200 len: 1569 microversion: 2.1 time: 0.159765 Aug 07 01:55:27.837351 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3287/6111] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:27 2022] GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:28.019540 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5ec28a14-ee42-41f7-a1a0-4b73b3fcd0d9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:28.020250 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5ec28a14-ee42-41f7-a1a0-4b73b3fcd0d9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:28.026986 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5ec28a14-ee42-41f7-a1a0-4b73b3fcd0d9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:28.027475 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5ec28a14-ee42-41f7-a1a0-4b73b3fcd0d9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:28.027935 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5ec28a14-ee42-41f7-a1a0-4b73b3fcd0d9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:28.028651 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5ec28a14-ee42-41f7-a1a0-4b73b3fcd0d9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:28.029103 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5ec28a14-ee42-41f7-a1a0-4b73b3fcd0d9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:28.029528 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5ec28a14-ee42-41f7-a1a0-4b73b3fcd0d9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:28.174523 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5ec28a14-ee42-41f7-a1a0-4b73b3fcd0d9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:28.183030 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5ec28a14-ee42-41f7-a1a0-4b73b3fcd0d9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1682 microversion: 2.1 time: 0.167887 Aug 07 01:55:28.183359 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2825/6112] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:28 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:28.485386 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c75bd649-7650-4dec-bd9c-7c661a0569b0 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Action: 'create', calling method: .version_select at 0x7f9e16f42b80>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-868039291", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARD15RqPFMqNz7v+UNy9PsZ+HSiCBWU85CPn0CiLhknHH9yZtHT2my/rDBIN9CbsbsB5wFuRf+jBzTN6oeV7uRd4Vvzgps9k3gmjCweUViWC8zUfvMOix/X91d4S0Ro8A=="}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:55:28.502560 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-c75bd649-7650-4dec-bd9c-7c661a0569b0 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Getting quotas for project 0a860ae0e0f84931893591f9d4b7b7a1. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:55:28.508709 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-c75bd649-7650-4dec-bd9c-7c661a0569b0 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Getting quotas for user 8e40c219d69d4769b6a957ecce6103b9 and project 0a860ae0e0f84931893591f9d4b7b7a1. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:55:28.522081 n-d-master-1 devstack@n-api.service[119516]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c75bd649-7650-4dec-bd9c-7c661a0569b0 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [71b90ce8-18e5-4dde-886f-6e756e2768e0] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 07 01:55:28.858723 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-204e40cc-081d-4306-a3e7-3a0c47cd7d36 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:28.859336 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-204e40cc-081d-4306-a3e7-3a0c47cd7d36 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:28.865380 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-204e40cc-081d-4306-a3e7-3a0c47cd7d36 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:28.865869 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-204e40cc-081d-4306-a3e7-3a0c47cd7d36 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:28.866304 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-204e40cc-081d-4306-a3e7-3a0c47cd7d36 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:28.866999 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-204e40cc-081d-4306-a3e7-3a0c47cd7d36 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:28.867715 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-204e40cc-081d-4306-a3e7-3a0c47cd7d36 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:28.868174 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-204e40cc-081d-4306-a3e7-3a0c47cd7d36 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:29.008211 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-204e40cc-081d-4306-a3e7-3a0c47cd7d36 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:29.015895 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-204e40cc-081d-4306-a3e7-3a0c47cd7d36 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 200 len: 1569 microversion: 2.1 time: 0.161161 Aug 07 01:55:29.016489 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2826/6113] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:28 2022] GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:55:29.529491 n-d-master-1 devstack@n-api.service[119516]: INFO oslo.messaging._drivers.impl_rabbit [None req-c75bd649-7650-4dec-bd9c-7c661a0569b0 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [71b90ce8-18e5-4dde-886f-6e756e2768e0] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 58042. Aug 07 01:55:29.546246 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c75bd649-7650-4dec-bd9c-7c661a0569b0 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 1.239371 Aug 07 01:55:29.546916 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3288/6114] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:55:28 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:55:30.039960 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-be288630-4635-41bf-be3a-cecd749b1236 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:30.040609 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-be288630-4635-41bf-be3a-cecd749b1236 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:30.057354 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-be288630-4635-41bf-be3a-cecd749b1236 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:30.058052 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-be288630-4635-41bf-be3a-cecd749b1236 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:30.058504 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-be288630-4635-41bf-be3a-cecd749b1236 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:30.059237 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-be288630-4635-41bf-be3a-cecd749b1236 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:30.059701 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-be288630-4635-41bf-be3a-cecd749b1236 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:30.060171 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-be288630-4635-41bf-be3a-cecd749b1236 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:30.082405 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-e91b177a-c1ed-4f9f-bb1a-1e8969fe0b68 req-a9839125-487e-436f-9071-6d07dbbf1b17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5757297f-6c22-4e54-9a86-20cb632a3f7e", "name": "network-vif-deleted", "tag": "f4733d4d-0e54-4bd8-80aa-3a724fc978dd"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:55:30.109560 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e91b177a-c1ed-4f9f-bb1a-1e8969fe0b68 req-a9839125-487e-436f-9071-6d07dbbf1b17 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:30.110100 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e91b177a-c1ed-4f9f-bb1a-1e8969fe0b68 req-a9839125-487e-436f-9071-6d07dbbf1b17 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:30.110582 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e91b177a-c1ed-4f9f-bb1a-1e8969fe0b68 req-a9839125-487e-436f-9071-6d07dbbf1b17 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:30.134216 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-e91b177a-c1ed-4f9f-bb1a-1e8969fe0b68 req-a9839125-487e-436f-9071-6d07dbbf1b17 service nova] Creating event network-vif-deleted:f4733d4d-0e54-4bd8-80aa-3a724fc978dd for instance 5757297f-6c22-4e54-9a86-20cb632a3f7e on n-h2-master-1 Aug 07 01:55:30.151917 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-e91b177a-c1ed-4f9f-bb1a-1e8969fe0b68 req-a9839125-487e-436f-9071-6d07dbbf1b17 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074098 Aug 07 01:55:30.153315 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3289/6115] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:55:30.218781 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-be288630-4635-41bf-be3a-cecd749b1236 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:30.229486 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-be288630-4635-41bf-be3a-cecd749b1236 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 200 len: 1527 microversion: 2.1 time: 0.196366 Aug 07 01:55:30.230337 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2827/6116] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:30 2022] GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 1527 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:55:31.253926 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ce619e59-5569-44d2-a021-1c8aa02e11ad tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:31.254794 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ce619e59-5569-44d2-a021-1c8aa02e11ad tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:31.264036 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce619e59-5569-44d2-a021-1c8aa02e11ad tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:31.264841 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce619e59-5569-44d2-a021-1c8aa02e11ad tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:31.265578 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce619e59-5569-44d2-a021-1c8aa02e11ad tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:31.266620 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce619e59-5569-44d2-a021-1c8aa02e11ad tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:31.267327 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce619e59-5569-44d2-a021-1c8aa02e11ad tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:31.269031 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce619e59-5569-44d2-a021-1c8aa02e11ad tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:31.362873 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ce619e59-5569-44d2-a021-1c8aa02e11ad tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:31.373596 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ce619e59-5569-44d2-a021-1c8aa02e11ad tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 200 len: 1360 microversion: 2.1 time: 0.126424 Aug 07 01:55:31.389646 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3290/6117] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:31 2022] GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 1360 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:32.400565 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a9858848-fd50-4ec6-9caa-2409c72d7bf1 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:32.401446 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a9858848-fd50-4ec6-9caa-2409c72d7bf1 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:32.412522 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a9858848-fd50-4ec6-9caa-2409c72d7bf1 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:32.413366 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a9858848-fd50-4ec6-9caa-2409c72d7bf1 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:32.414222 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a9858848-fd50-4ec6-9caa-2409c72d7bf1 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:32.415202 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a9858848-fd50-4ec6-9caa-2409c72d7bf1 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:32.415708 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a9858848-fd50-4ec6-9caa-2409c72d7bf1 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:32.416535 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a9858848-fd50-4ec6-9caa-2409c72d7bf1 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:32.516016 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a9858848-fd50-4ec6-9caa-2409c72d7bf1 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:32.533006 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a9858848-fd50-4ec6-9caa-2409c72d7bf1 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 200 len: 1360 microversion: 2.1 time: 0.138999 Aug 07 01:55:32.533899 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2828/6118] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:32 2022] GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 1360 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:33.557340 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5e047812-0527-480b-93d6-6706c0032b70 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:33.558018 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5e047812-0527-480b-93d6-6706c0032b70 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:33.566461 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e047812-0527-480b-93d6-6706c0032b70 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:33.567705 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e047812-0527-480b-93d6-6706c0032b70 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:33.567907 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e047812-0527-480b-93d6-6706c0032b70 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:33.568708 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e047812-0527-480b-93d6-6706c0032b70 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:33.569195 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e047812-0527-480b-93d6-6706c0032b70 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:33.569660 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e047812-0527-480b-93d6-6706c0032b70 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:33.747122 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5e047812-0527-480b-93d6-6706c0032b70 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:33.760909 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5e047812-0527-480b-93d6-6706c0032b70 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 200 len: 1360 microversion: 2.1 time: 0.207599 Aug 07 01:55:33.775109 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3291/6119] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:33 2022] GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 1360 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:34.783270 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6475e800-7ed9-41ec-9895-7f9e51999195 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:34.784416 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6475e800-7ed9-41ec-9895-7f9e51999195 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:34.796903 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6475e800-7ed9-41ec-9895-7f9e51999195 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:34.797419 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6475e800-7ed9-41ec-9895-7f9e51999195 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:34.797873 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6475e800-7ed9-41ec-9895-7f9e51999195 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:34.799311 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6475e800-7ed9-41ec-9895-7f9e51999195 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:34.799756 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6475e800-7ed9-41ec-9895-7f9e51999195 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:34.800256 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6475e800-7ed9-41ec-9895-7f9e51999195 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:35.004549 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6475e800-7ed9-41ec-9895-7f9e51999195 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:35.024555 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6475e800-7ed9-41ec-9895-7f9e51999195 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 200 len: 1360 microversion: 2.1 time: 0.246029 Aug 07 01:55:35.026570 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2829/6120] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:34 2022] GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 1360 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:36.046890 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e54190bc-3b18-4e4f-8ea1-4e3cb5645e63 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:36.049082 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e54190bc-3b18-4e4f-8ea1-4e3cb5645e63 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:36.065192 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e54190bc-3b18-4e4f-8ea1-4e3cb5645e63 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:36.070289 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e54190bc-3b18-4e4f-8ea1-4e3cb5645e63 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:36.072364 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e54190bc-3b18-4e4f-8ea1-4e3cb5645e63 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:36.073883 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e54190bc-3b18-4e4f-8ea1-4e3cb5645e63 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:36.076481 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e54190bc-3b18-4e4f-8ea1-4e3cb5645e63 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:36.078577 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e54190bc-3b18-4e4f-8ea1-4e3cb5645e63 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:36.165209 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e54190bc-3b18-4e4f-8ea1-4e3cb5645e63 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:36.166144 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e54190bc-3b18-4e4f-8ea1-4e3cb5645e63 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:36.168066 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e54190bc-3b18-4e4f-8ea1-4e3cb5645e63 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:36.169478 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-e54190bc-3b18-4e4f-8ea1-4e3cb5645e63 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lazy-loading 'fault' on Instance uuid 5757297f-6c22-4e54-9a86-20cb632a3f7e {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:55:36.286411 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e54190bc-3b18-4e4f-8ea1-4e3cb5645e63 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:36.293750 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e54190bc-3b18-4e4f-8ea1-4e3cb5645e63 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 200 len: 1319 microversion: 2.1 time: 0.252942 Aug 07 01:55:36.295365 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3292/6121] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:36 2022] GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:36.416340 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f21fbd83-416a-4d29-be6d-fd7382d72912 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-453965901-access_point-1051262578", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "d787ae46-5644-433c-b2fa-2a77c7a40458"}], "key_name": "tempest-TestSecurityGroupsBasicOps-868039291", "security_groups": [{"name": "tempest-secgroup_access--665798501"}, {"name": "tempest-secgroup_general--1533029465"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:55:36.427228 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:55:36.609122 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-f21fbd83-416a-4d29-be6d-fd7382d72912 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] validate_networks() for [('d787ae46-5644-433c-b2fa-2a77c7a40458', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:55:37.065476 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-f21fbd83-416a-4d29-be6d-fd7382d72912 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:55:37.065898 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-f21fbd83-416a-4d29-be6d-fd7382d72912 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:55:37.066557 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-f21fbd83-416a-4d29-be6d-fd7382d72912 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:55:37.067605 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-f21fbd83-416a-4d29-be6d-fd7382d72912 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:55:37.068068 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-f21fbd83-416a-4d29-be6d-fd7382d72912 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:55:37.077280 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f21fbd83-416a-4d29-be6d-fd7382d72912 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:37.077771 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f21fbd83-416a-4d29-be6d-fd7382d72912 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:37.078207 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f21fbd83-416a-4d29-be6d-fd7382d72912 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:37.078982 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f21fbd83-416a-4d29-be6d-fd7382d72912 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:37.079726 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f21fbd83-416a-4d29-be6d-fd7382d72912 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:37.080187 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f21fbd83-416a-4d29-be6d-fd7382d72912 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:37.100085 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-f21fbd83-416a-4d29-be6d-fd7382d72912 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Getting quotas for project 0a860ae0e0f84931893591f9d4b7b7a1. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:55:37.106118 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-f21fbd83-416a-4d29-be6d-fd7382d72912 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Getting quotas for user 8e40c219d69d4769b6a957ecce6103b9 and project 0a860ae0e0f84931893591f9d4b7b7a1. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:55:37.120399 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f21fbd83-416a-4d29-be6d-fd7382d72912 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:55:37.122523 n-d-master-1 devstack@n-api.service[119517]: WARNING nova.utils [None req-f21fbd83-416a-4d29-be6d-fd7382d72912 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-453965901-access_point-1051262578 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-453965901-acc Aug 07 01:55:37.123367 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f21fbd83-416a-4d29-be6d-fd7382d72912 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [instance: 4d6bfe5d-cf98-4ff2-a10e-67692145944c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:55:37.178979 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f21fbd83-416a-4d29-be6d-fd7382d72912 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 0.766755 Aug 07 01:55:37.179967 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2830/6122] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:55:36 2022] POST /compute/v2.1/servers => generated 457 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:55:37.193672 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c9788298-4c42-4be6-b30c-5e1f189c1380 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:37.195651 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c9788298-4c42-4be6-b30c-5e1f189c1380 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [instance: 4d6bfe5d-cf98-4ff2-a10e-67692145944c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:37.302882 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c9788298-4c42-4be6-b30c-5e1f189c1380 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40c219d69d4769b6a957ecce6103b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a860ae0e0f84931893591f9d4b7b7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:37.311373 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c9788298-4c42-4be6-b30c-5e1f189c1380 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] 10.222.0.39 "GET /compute/v2.1/servers/4d6bfe5d-cf98-4ff2-a10e-67692145944c" status: 200 len: 1293 microversion: 2.1 time: 0.124248 Aug 07 01:55:37.320095 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3293/6123] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:37 2022] GET /compute/v2.1/servers/4d6bfe5d-cf98-4ff2-a10e-67692145944c => generated 1293 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:37.320263 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-55d1eed7-fed0-4b03-91b7-3512a6fa517c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:37.320263 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-55d1eed7-fed0-4b03-91b7-3512a6fa517c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:37.322341 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-55d1eed7-fed0-4b03-91b7-3512a6fa517c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:37.323028 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-55d1eed7-fed0-4b03-91b7-3512a6fa517c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:37.323719 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-55d1eed7-fed0-4b03-91b7-3512a6fa517c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:37.324685 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-55d1eed7-fed0-4b03-91b7-3512a6fa517c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:37.325301 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-55d1eed7-fed0-4b03-91b7-3512a6fa517c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:37.325894 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-55d1eed7-fed0-4b03-91b7-3512a6fa517c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:37.350606 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-55d1eed7-fed0-4b03-91b7-3512a6fa517c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] HTTP exception thrown: Instance 5757297f-6c22-4e54-9a86-20cb632a3f7e could not be found. Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-55d1eed7-fed0-4b03-91b7-3512a6fa517c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Request method failure captured: Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e HTTP/1.1 Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xp6rUdIsYnfs49nr8p-3tgit6VpNtF0E4NPSidukXDEQntBhlyx_gwU6AjnU2O7Q5BLuafO4z_ZO55y2txpq1OJeOibLbj_karsXsR0GpyTHp3BnitplkO9r1bHquRHPgg2Nq4jyNzT0obzTHzoVjdq8NdzVY4LztormmeY7retjUI Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: bf36f5153ba648008cdaceb9dc538e53 Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-TestVolumeBootPattern-121766107 Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bf36f5153ba648008cdaceb9dc538e53", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-TestVolumeBootPattern-121766107 Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: bf36f5153ba648008cdaceb9dc538e53 Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-TestVolumeBootPattern-121766107 Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-TestVolumeBootPattern-121766107-project Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 661f6c9aa7da4e348a9b0d91840078c2 Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-TestVolumeBootPattern-121766107-project Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 5757297f-6c22-4e54-9a86-20cb632a3f7e could not be found. Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '5757297f-6c22-4e54-9a86-20cb632a3f7e'} Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5757297f-6c22-4e54-9a86-20cb632a3f7e could not be found. Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5757297f-6c22-4e54-9a86-20cb632a3f7e could not be found. Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:55:37.353935 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:55:37.359517 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:55:37.359517 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:55:37.359517 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:55:37.359517 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:55:37.359517 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:55:37.359517 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5757297f-6c22-4e54-9a86-20cb632a3f7e could not be found. Aug 07 01:55:37.359517 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:55:37.359517 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-55d1eed7-fed0-4b03-91b7-3512a6fa517c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Returning 404 to user: Instance 5757297f-6c22-4e54-9a86-20cb632a3f7e could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:55:37.359517 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-55d1eed7-fed0-4b03-91b7-3512a6fa517c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 404 len: 111 microversion: 2.1 time: 0.044567 Aug 07 01:55:37.359517 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2831/6124] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:37 2022] GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:55:37.643972 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-06130b7d-0e31-4406-b4ea-0c3913c6f2d8 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:37.644911 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-06130b7d-0e31-4406-b4ea-0c3913c6f2d8 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] [instance: e5734d92-ca17-495b-b666-b569ea15ddc7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:37.652369 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-06130b7d-0e31-4406-b4ea-0c3913c6f2d8 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:37.653288 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-06130b7d-0e31-4406-b4ea-0c3913c6f2d8 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:37.653921 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-06130b7d-0e31-4406-b4ea-0c3913c6f2d8 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:37.655213 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-06130b7d-0e31-4406-b4ea-0c3913c6f2d8 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:37.655864 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-06130b7d-0e31-4406-b4ea-0c3913c6f2d8 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:37.656640 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-06130b7d-0e31-4406-b4ea-0c3913c6f2d8 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:37.698838 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-06130b7d-0e31-4406-b4ea-0c3913c6f2d8 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] 10.222.0.39 "GET /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.059031 Aug 07 01:55:37.699868 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3294/6125] 10.222.0.39 () {58 vars in 1293 bytes} [Sun Aug 7 01:55:37 2022] GET /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7/os-server-password => generated 116 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:55:38.339720 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ed82c23e-2de5-4a43-ab75-305557e0a609 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:38.340375 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ed82c23e-2de5-4a43-ab75-305557e0a609 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [instance: 4d6bfe5d-cf98-4ff2-a10e-67692145944c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:38.348847 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed82c23e-2de5-4a43-ab75-305557e0a609 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:38.349706 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed82c23e-2de5-4a43-ab75-305557e0a609 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:38.350309 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed82c23e-2de5-4a43-ab75-305557e0a609 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:38.351229 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed82c23e-2de5-4a43-ab75-305557e0a609 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:38.351849 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed82c23e-2de5-4a43-ab75-305557e0a609 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:38.352493 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ed82c23e-2de5-4a43-ab75-305557e0a609 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:38.437733 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ed82c23e-2de5-4a43-ab75-305557e0a609 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40c219d69d4769b6a957ecce6103b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a860ae0e0f84931893591f9d4b7b7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:38.446974 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ed82c23e-2de5-4a43-ab75-305557e0a609 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] 10.222.0.39 "GET /compute/v2.1/servers/4d6bfe5d-cf98-4ff2-a10e-67692145944c" status: 200 len: 1345 microversion: 2.1 time: 0.116631 Aug 07 01:55:38.448226 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2832/6126] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:38 2022] GET /compute/v2.1/servers/4d6bfe5d-cf98-4ff2-a10e-67692145944c => generated 1345 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:39.469456 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-04587811-162b-49f6-b9fc-63c9c8c7048f tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:39.471552 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-04587811-162b-49f6-b9fc-63c9c8c7048f tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [instance: 4d6bfe5d-cf98-4ff2-a10e-67692145944c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:39.481476 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-04587811-162b-49f6-b9fc-63c9c8c7048f tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:39.482456 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-04587811-162b-49f6-b9fc-63c9c8c7048f tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:39.483131 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-04587811-162b-49f6-b9fc-63c9c8c7048f tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:39.486663 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-04587811-162b-49f6-b9fc-63c9c8c7048f tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:39.490247 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-04587811-162b-49f6-b9fc-63c9c8c7048f tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:39.491101 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-04587811-162b-49f6-b9fc-63c9c8c7048f tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:39.736084 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-04587811-162b-49f6-b9fc-63c9c8c7048f tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40c219d69d4769b6a957ecce6103b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a860ae0e0f84931893591f9d4b7b7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:39.746110 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-04587811-162b-49f6-b9fc-63c9c8c7048f tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] 10.222.0.39 "GET /compute/v2.1/servers/4d6bfe5d-cf98-4ff2-a10e-67692145944c" status: 200 len: 1470 microversion: 2.1 time: 0.280696 Aug 07 01:55:39.761241 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3295/6127] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:39 2022] GET /compute/v2.1/servers/4d6bfe5d-cf98-4ff2-a10e-67692145944c => generated 1470 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:40.280433 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-253f0e46-9bcc-4b2f-9667-61b5e8a92018 req-4b82eeb6-f786-45e9-8340-366a38810442 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d6bfe5d-cf98-4ff2-a10e-67692145944c", "tag": "2ae6c402-8443-4c74-95ed-6cc326a4b91d"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:55:40.305117 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-253f0e46-9bcc-4b2f-9667-61b5e8a92018 req-4b82eeb6-f786-45e9-8340-366a38810442 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:40.305605 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-253f0e46-9bcc-4b2f-9667-61b5e8a92018 req-4b82eeb6-f786-45e9-8340-366a38810442 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:40.307566 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-253f0e46-9bcc-4b2f-9667-61b5e8a92018 req-4b82eeb6-f786-45e9-8340-366a38810442 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:40.336379 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-253f0e46-9bcc-4b2f-9667-61b5e8a92018 req-4b82eeb6-f786-45e9-8340-366a38810442 service nova] Creating event network-changed:2ae6c402-8443-4c74-95ed-6cc326a4b91d for instance 4d6bfe5d-cf98-4ff2-a10e-67692145944c on n-h2-master-1 Aug 07 01:55:40.348015 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-253f0e46-9bcc-4b2f-9667-61b5e8a92018 req-4b82eeb6-f786-45e9-8340-366a38810442 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072865 Aug 07 01:55:40.348640 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2833/6128] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:55:40.772911 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-75fd5e7d-28bf-41f1-b66c-cc078a4166ed tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:40.774154 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-75fd5e7d-28bf-41f1-b66c-cc078a4166ed tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [instance: 4d6bfe5d-cf98-4ff2-a10e-67692145944c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:40.781696 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75fd5e7d-28bf-41f1-b66c-cc078a4166ed tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:40.783001 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75fd5e7d-28bf-41f1-b66c-cc078a4166ed tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:40.783001 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75fd5e7d-28bf-41f1-b66c-cc078a4166ed tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:40.783656 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75fd5e7d-28bf-41f1-b66c-cc078a4166ed tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:40.784180 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75fd5e7d-28bf-41f1-b66c-cc078a4166ed tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:40.784636 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75fd5e7d-28bf-41f1-b66c-cc078a4166ed tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:40.954833 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-75fd5e7d-28bf-41f1-b66c-cc078a4166ed tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40c219d69d4769b6a957ecce6103b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a860ae0e0f84931893591f9d4b7b7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:40.968115 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-75fd5e7d-28bf-41f1-b66c-cc078a4166ed tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] 10.222.0.39 "GET /compute/v2.1/servers/4d6bfe5d-cf98-4ff2-a10e-67692145944c" status: 200 len: 1470 microversion: 2.1 time: 0.199314 Aug 07 01:55:40.970297 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3296/6129] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:40 2022] GET /compute/v2.1/servers/4d6bfe5d-cf98-4ff2-a10e-67692145944c => generated 1470 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:41.744964 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-be422435-b580-4986-9247-f0ccd92aef50 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:41.745557 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-be422435-b580-4986-9247-f0ccd92aef50 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 277f7152-8a1d-4143-bd17-7b5e290bbda3] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:41.751826 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-be422435-b580-4986-9247-f0ccd92aef50 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:41.752344 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-be422435-b580-4986-9247-f0ccd92aef50 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:41.752785 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-be422435-b580-4986-9247-f0ccd92aef50 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:41.753483 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-be422435-b580-4986-9247-f0ccd92aef50 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:41.753942 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-be422435-b580-4986-9247-f0ccd92aef50 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:41.754370 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-be422435-b580-4986-9247-f0ccd92aef50 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:41.778909 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-be422435-b580-4986-9247-f0ccd92aef50 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 277f7152-8a1d-4143-bd17-7b5e290bbda3] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:55:41.824066 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:55:41.857557 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-be422435-b580-4986-9247-f0ccd92aef50 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "DELETE /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3" status: 204 len: 0 microversion: 2.1 time: 0.117639 Aug 07 01:55:41.858143 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2834/6130] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:55:41 2022] DELETE /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:55:41.866302 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7cd06135-633e-41ca-b8ae-232c01830d8e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:41.866932 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7cd06135-633e-41ca-b8ae-232c01830d8e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 277f7152-8a1d-4143-bd17-7b5e290bbda3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:41.874224 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7cd06135-633e-41ca-b8ae-232c01830d8e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:41.874722 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7cd06135-633e-41ca-b8ae-232c01830d8e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:41.875183 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7cd06135-633e-41ca-b8ae-232c01830d8e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:41.875969 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7cd06135-633e-41ca-b8ae-232c01830d8e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:41.876439 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7cd06135-633e-41ca-b8ae-232c01830d8e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:41.876880 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7cd06135-633e-41ca-b8ae-232c01830d8e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:41.991491 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-34f81f8b-0ea6-4dc3-821a-55987912c2a8 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:41.992746 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-34f81f8b-0ea6-4dc3-821a-55987912c2a8 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [instance: 4d6bfe5d-cf98-4ff2-a10e-67692145944c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:41.998805 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-34f81f8b-0ea6-4dc3-821a-55987912c2a8 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:41.999518 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-34f81f8b-0ea6-4dc3-821a-55987912c2a8 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:42.000177 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-34f81f8b-0ea6-4dc3-821a-55987912c2a8 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:42.001096 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-34f81f8b-0ea6-4dc3-821a-55987912c2a8 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:42.001557 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-34f81f8b-0ea6-4dc3-821a-55987912c2a8 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:42.001991 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-34f81f8b-0ea6-4dc3-821a-55987912c2a8 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:42.022016 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7cd06135-633e-41ca-b8ae-232c01830d8e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:42.029889 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7cd06135-633e-41ca-b8ae-232c01830d8e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3" status: 200 len: 1408 microversion: 2.1 time: 0.167413 Aug 07 01:55:42.030466 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3297/6131] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:41 2022] GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3 => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:42.166919 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-34f81f8b-0ea6-4dc3-821a-55987912c2a8 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40c219d69d4769b6a957ecce6103b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a860ae0e0f84931893591f9d4b7b7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:42.174967 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-34f81f8b-0ea6-4dc3-821a-55987912c2a8 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] 10.222.0.39 "GET /compute/v2.1/servers/4d6bfe5d-cf98-4ff2-a10e-67692145944c" status: 200 len: 1470 microversion: 2.1 time: 0.187812 Aug 07 01:55:42.175929 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2835/6132] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:41 2022] GET /compute/v2.1/servers/4d6bfe5d-cf98-4ff2-a10e-67692145944c => generated 1470 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:55:43.051812 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f509fa70-feee-4bf4-b5b7-313cbcdb12b8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:43.052488 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f509fa70-feee-4bf4-b5b7-313cbcdb12b8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 277f7152-8a1d-4143-bd17-7b5e290bbda3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:43.059661 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f509fa70-feee-4bf4-b5b7-313cbcdb12b8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:43.060221 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f509fa70-feee-4bf4-b5b7-313cbcdb12b8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:43.060683 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f509fa70-feee-4bf4-b5b7-313cbcdb12b8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:43.061410 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f509fa70-feee-4bf4-b5b7-313cbcdb12b8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:43.061891 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f509fa70-feee-4bf4-b5b7-313cbcdb12b8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:43.062338 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f509fa70-feee-4bf4-b5b7-313cbcdb12b8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:43.196370 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1cf7ee7d-337d-4544-9a2f-bb6d9afe9e60 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:43.196994 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1cf7ee7d-337d-4544-9a2f-bb6d9afe9e60 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [instance: 4d6bfe5d-cf98-4ff2-a10e-67692145944c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:43.198117 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f509fa70-feee-4bf4-b5b7-313cbcdb12b8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:43.203976 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1cf7ee7d-337d-4544-9a2f-bb6d9afe9e60 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:43.204475 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1cf7ee7d-337d-4544-9a2f-bb6d9afe9e60 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:43.204912 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1cf7ee7d-337d-4544-9a2f-bb6d9afe9e60 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:43.205656 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1cf7ee7d-337d-4544-9a2f-bb6d9afe9e60 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:43.206119 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1cf7ee7d-337d-4544-9a2f-bb6d9afe9e60 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:43.206394 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f509fa70-feee-4bf4-b5b7-313cbcdb12b8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3" status: 200 len: 1408 microversion: 2.1 time: 0.158353 Aug 07 01:55:43.206554 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1cf7ee7d-337d-4544-9a2f-bb6d9afe9e60 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:43.207166 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3298/6133] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:43 2022] GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:43.427773 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1cf7ee7d-337d-4544-9a2f-bb6d9afe9e60 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40c219d69d4769b6a957ecce6103b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a860ae0e0f84931893591f9d4b7b7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:43.435444 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1cf7ee7d-337d-4544-9a2f-bb6d9afe9e60 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] 10.222.0.39 "GET /compute/v2.1/servers/4d6bfe5d-cf98-4ff2-a10e-67692145944c" status: 200 len: 1470 microversion: 2.1 time: 0.242951 Aug 07 01:55:43.436044 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2836/6134] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:43 2022] GET /compute/v2.1/servers/4d6bfe5d-cf98-4ff2-a10e-67692145944c => generated 1470 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:55:44.227410 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-34a788d9-aa0a-4f89-aaae-9c0446016a17 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:44.228271 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-34a788d9-aa0a-4f89-aaae-9c0446016a17 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 277f7152-8a1d-4143-bd17-7b5e290bbda3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:44.235775 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34a788d9-aa0a-4f89-aaae-9c0446016a17 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:44.236427 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34a788d9-aa0a-4f89-aaae-9c0446016a17 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:44.236881 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34a788d9-aa0a-4f89-aaae-9c0446016a17 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:44.237597 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34a788d9-aa0a-4f89-aaae-9c0446016a17 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:44.238064 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34a788d9-aa0a-4f89-aaae-9c0446016a17 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:44.238509 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34a788d9-aa0a-4f89-aaae-9c0446016a17 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:44.456803 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0f337287-d95c-4ff1-a052-ce3de31ec352 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:44.457540 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0f337287-d95c-4ff1-a052-ce3de31ec352 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [instance: 4d6bfe5d-cf98-4ff2-a10e-67692145944c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:44.464547 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0f337287-d95c-4ff1-a052-ce3de31ec352 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:44.465040 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0f337287-d95c-4ff1-a052-ce3de31ec352 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:44.465763 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0f337287-d95c-4ff1-a052-ce3de31ec352 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:44.466486 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0f337287-d95c-4ff1-a052-ce3de31ec352 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:44.466946 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0f337287-d95c-4ff1-a052-ce3de31ec352 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:44.467378 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0f337287-d95c-4ff1-a052-ce3de31ec352 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:44.497838 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-34a788d9-aa0a-4f89-aaae-9c0446016a17 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:44.510601 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-34a788d9-aa0a-4f89-aaae-9c0446016a17 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3" status: 200 len: 1408 microversion: 2.1 time: 0.286885 Aug 07 01:55:44.511453 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3299/6135] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:44 2022] GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3 => generated 1408 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:44.516774 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-16460269-6771-4519-97b1-b7480f33fad8 req-24fa775a-665c-46a5-b809-f6fed9ccd9ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "277f7152-8a1d-4143-bd17-7b5e290bbda3", "name": "network-vif-deleted", "tag": "fae9ac07-9030-4d87-b25a-d363647e4013"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:55:44.527828 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-16460269-6771-4519-97b1-b7480f33fad8 req-24fa775a-665c-46a5-b809-f6fed9ccd9ef service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:44.528348 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-16460269-6771-4519-97b1-b7480f33fad8 req-24fa775a-665c-46a5-b809-f6fed9ccd9ef service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:44.529143 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-16460269-6771-4519-97b1-b7480f33fad8 req-24fa775a-665c-46a5-b809-f6fed9ccd9ef service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:44.542823 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-16460269-6771-4519-97b1-b7480f33fad8 req-24fa775a-665c-46a5-b809-f6fed9ccd9ef service nova] Creating event network-vif-deleted:fae9ac07-9030-4d87-b25a-d363647e4013 for instance 277f7152-8a1d-4143-bd17-7b5e290bbda3 on n-h2-master-1 Aug 07 01:55:44.549897 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-16460269-6771-4519-97b1-b7480f33fad8 req-24fa775a-665c-46a5-b809-f6fed9ccd9ef service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036686 Aug 07 01:55:44.550518 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3300/6136] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:55:44.621342 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0f337287-d95c-4ff1-a052-ce3de31ec352 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40c219d69d4769b6a957ecce6103b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a860ae0e0f84931893591f9d4b7b7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:44.629791 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0f337287-d95c-4ff1-a052-ce3de31ec352 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] 10.222.0.39 "GET /compute/v2.1/servers/4d6bfe5d-cf98-4ff2-a10e-67692145944c" status: 200 len: 1470 microversion: 2.1 time: 0.176837 Aug 07 01:55:44.630581 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2837/6137] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:44 2022] GET /compute/v2.1/servers/4d6bfe5d-cf98-4ff2-a10e-67692145944c => generated 1470 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:55:45.535090 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ccca06b5-faca-4599-ba0f-f1b01423b051 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:45.535819 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ccca06b5-faca-4599-ba0f-f1b01423b051 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 277f7152-8a1d-4143-bd17-7b5e290bbda3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:45.545139 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ccca06b5-faca-4599-ba0f-f1b01423b051 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:45.545654 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ccca06b5-faca-4599-ba0f-f1b01423b051 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:45.546121 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ccca06b5-faca-4599-ba0f-f1b01423b051 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:45.546869 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ccca06b5-faca-4599-ba0f-f1b01423b051 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:45.547901 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ccca06b5-faca-4599-ba0f-f1b01423b051 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:45.548362 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ccca06b5-faca-4599-ba0f-f1b01423b051 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:45.616693 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ccca06b5-faca-4599-ba0f-f1b01423b051 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:45.625081 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ccca06b5-faca-4599-ba0f-f1b01423b051 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3" status: 200 len: 1200 microversion: 2.1 time: 0.095355 Aug 07 01:55:45.626333 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3301/6138] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:45 2022] GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3 => generated 1200 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:45.650577 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d07c1037-f885-4ccf-b8be-c8eaf1c30f50 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:45.651132 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d07c1037-f885-4ccf-b8be-c8eaf1c30f50 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [instance: 4d6bfe5d-cf98-4ff2-a10e-67692145944c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:45.658112 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d07c1037-f885-4ccf-b8be-c8eaf1c30f50 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:45.658600 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d07c1037-f885-4ccf-b8be-c8eaf1c30f50 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:45.659052 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d07c1037-f885-4ccf-b8be-c8eaf1c30f50 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:45.659766 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d07c1037-f885-4ccf-b8be-c8eaf1c30f50 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:45.660250 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d07c1037-f885-4ccf-b8be-c8eaf1c30f50 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:45.660679 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d07c1037-f885-4ccf-b8be-c8eaf1c30f50 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:45.804164 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d07c1037-f885-4ccf-b8be-c8eaf1c30f50 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40c219d69d4769b6a957ecce6103b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a860ae0e0f84931893591f9d4b7b7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:45.811989 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d07c1037-f885-4ccf-b8be-c8eaf1c30f50 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] 10.222.0.39 "GET /compute/v2.1/servers/4d6bfe5d-cf98-4ff2-a10e-67692145944c" status: 200 len: 1470 microversion: 2.1 time: 0.165362 Aug 07 01:55:45.812569 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2838/6139] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:45 2022] GET /compute/v2.1/servers/4d6bfe5d-cf98-4ff2-a10e-67692145944c => generated 1470 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:46.646329 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ddb601f6-d174-4552-b168-531f1d94566f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:46.647297 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ddb601f6-d174-4552-b168-531f1d94566f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 277f7152-8a1d-4143-bd17-7b5e290bbda3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:46.655122 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddb601f6-d174-4552-b168-531f1d94566f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:46.655789 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddb601f6-d174-4552-b168-531f1d94566f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:46.656411 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddb601f6-d174-4552-b168-531f1d94566f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:46.657944 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddb601f6-d174-4552-b168-531f1d94566f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:46.659550 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddb601f6-d174-4552-b168-531f1d94566f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:46.660150 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddb601f6-d174-4552-b168-531f1d94566f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:46.664960 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:55:46.733121 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ddb601f6-d174-4552-b168-531f1d94566f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:46.742440 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ddb601f6-d174-4552-b168-531f1d94566f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3" status: 200 len: 1200 microversion: 2.1 time: 0.099761 Aug 07 01:55:46.743022 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3302/6140] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:46 2022] GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3 => generated 1200 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:46.834862 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-48596693-03f9-4ae9-9b69-60cbdafadb7b tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:46.835605 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-48596693-03f9-4ae9-9b69-60cbdafadb7b tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [instance: 4d6bfe5d-cf98-4ff2-a10e-67692145944c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:46.843317 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-48596693-03f9-4ae9-9b69-60cbdafadb7b tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:46.843982 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-48596693-03f9-4ae9-9b69-60cbdafadb7b tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:46.845100 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-48596693-03f9-4ae9-9b69-60cbdafadb7b tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:46.846087 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-48596693-03f9-4ae9-9b69-60cbdafadb7b tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:46.846867 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-48596693-03f9-4ae9-9b69-60cbdafadb7b tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:46.847407 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-48596693-03f9-4ae9-9b69-60cbdafadb7b tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:46.877070 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-4f5eeaec-8a93-4c92-b1ea-4ee44c82f05a req-a38c7f9f-cbf3-4abb-a694-fdb8f303f7ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d6bfe5d-cf98-4ff2-a10e-67692145944c", "name": "network-vif-plugged", "status": "completed", "tag": "2ae6c402-8443-4c74-95ed-6cc326a4b91d"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:55:46.890126 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4f5eeaec-8a93-4c92-b1ea-4ee44c82f05a req-a38c7f9f-cbf3-4abb-a694-fdb8f303f7ce service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:46.890922 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4f5eeaec-8a93-4c92-b1ea-4ee44c82f05a req-a38c7f9f-cbf3-4abb-a694-fdb8f303f7ce service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:46.892146 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4f5eeaec-8a93-4c92-b1ea-4ee44c82f05a req-a38c7f9f-cbf3-4abb-a694-fdb8f303f7ce service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:46.909696 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-4f5eeaec-8a93-4c92-b1ea-4ee44c82f05a req-a38c7f9f-cbf3-4abb-a694-fdb8f303f7ce service nova] Creating event network-vif-plugged:2ae6c402-8443-4c74-95ed-6cc326a4b91d for instance 4d6bfe5d-cf98-4ff2-a10e-67692145944c on n-h2-master-1 Aug 07 01:55:46.916471 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-4f5eeaec-8a93-4c92-b1ea-4ee44c82f05a req-a38c7f9f-cbf3-4abb-a694-fdb8f303f7ce service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044047 Aug 07 01:55:46.917809 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3303/6141] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:55:47.045319 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-48596693-03f9-4ae9-9b69-60cbdafadb7b tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40c219d69d4769b6a957ecce6103b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a860ae0e0f84931893591f9d4b7b7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:47.053660 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-48596693-03f9-4ae9-9b69-60cbdafadb7b tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] 10.222.0.39 "GET /compute/v2.1/servers/4d6bfe5d-cf98-4ff2-a10e-67692145944c" status: 200 len: 1470 microversion: 2.1 time: 0.223920 Aug 07 01:55:47.054559 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2839/6142] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:46 2022] GET /compute/v2.1/servers/4d6bfe5d-cf98-4ff2-a10e-67692145944c => generated 1470 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:47.763589 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e32fc642-b5c1-4bf1-acf6-e7d4557eba97 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:47.764326 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e32fc642-b5c1-4bf1-acf6-e7d4557eba97 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 277f7152-8a1d-4143-bd17-7b5e290bbda3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:47.767494 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:55:47.773153 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e32fc642-b5c1-4bf1-acf6-e7d4557eba97 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:47.773651 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e32fc642-b5c1-4bf1-acf6-e7d4557eba97 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:47.774099 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e32fc642-b5c1-4bf1-acf6-e7d4557eba97 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:47.775118 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e32fc642-b5c1-4bf1-acf6-e7d4557eba97 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:47.775654 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e32fc642-b5c1-4bf1-acf6-e7d4557eba97 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:47.776193 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e32fc642-b5c1-4bf1-acf6-e7d4557eba97 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:47.841873 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e32fc642-b5c1-4bf1-acf6-e7d4557eba97 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:47.850122 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e32fc642-b5c1-4bf1-acf6-e7d4557eba97 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3" status: 200 len: 1200 microversion: 2.1 time: 0.090648 Aug 07 01:55:47.850829 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3304/6143] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:47 2022] GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3 => generated 1200 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:48.074789 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f1d6d6b4-d5a4-4b41-a6db-d09771c00d17 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:48.075393 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f1d6d6b4-d5a4-4b41-a6db-d09771c00d17 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [instance: 4d6bfe5d-cf98-4ff2-a10e-67692145944c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:48.077427 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:55:48.078260 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:55:48.085184 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1d6d6b4-d5a4-4b41-a6db-d09771c00d17 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:48.085745 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1d6d6b4-d5a4-4b41-a6db-d09771c00d17 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:48.086120 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1d6d6b4-d5a4-4b41-a6db-d09771c00d17 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:48.086835 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1d6d6b4-d5a4-4b41-a6db-d09771c00d17 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:48.087295 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1d6d6b4-d5a4-4b41-a6db-d09771c00d17 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:48.087726 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1d6d6b4-d5a4-4b41-a6db-d09771c00d17 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:48.250782 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f1d6d6b4-d5a4-4b41-a6db-d09771c00d17 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40c219d69d4769b6a957ecce6103b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a860ae0e0f84931893591f9d4b7b7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:48.258686 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f1d6d6b4-d5a4-4b41-a6db-d09771c00d17 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] 10.222.0.39 "GET /compute/v2.1/servers/4d6bfe5d-cf98-4ff2-a10e-67692145944c" status: 200 len: 1470 microversion: 2.1 time: 0.187687 Aug 07 01:55:48.259693 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2840/6144] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:48 2022] GET /compute/v2.1/servers/4d6bfe5d-cf98-4ff2-a10e-67692145944c => generated 1470 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:48.873364 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a2e4a99c-d406-43ec-ae42-4b2cc40564e9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:48.874160 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a2e4a99c-d406-43ec-ae42-4b2cc40564e9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 277f7152-8a1d-4143-bd17-7b5e290bbda3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:48.883964 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2e4a99c-d406-43ec-ae42-4b2cc40564e9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:48.884625 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2e4a99c-d406-43ec-ae42-4b2cc40564e9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:48.885184 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2e4a99c-d406-43ec-ae42-4b2cc40564e9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:48.886016 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2e4a99c-d406-43ec-ae42-4b2cc40564e9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:48.886570 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2e4a99c-d406-43ec-ae42-4b2cc40564e9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:48.887094 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2e4a99c-d406-43ec-ae42-4b2cc40564e9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:48.925514 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2e4a99c-d406-43ec-ae42-4b2cc40564e9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:48.926010 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2e4a99c-d406-43ec-ae42-4b2cc40564e9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:48.926592 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2e4a99c-d406-43ec-ae42-4b2cc40564e9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:48.927058 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-a2e4a99c-d406-43ec-ae42-4b2cc40564e9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lazy-loading 'fault' on Instance uuid 277f7152-8a1d-4143-bd17-7b5e290bbda3 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:55:48.987269 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a2e4a99c-d406-43ec-ae42-4b2cc40564e9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:48.995429 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a2e4a99c-d406-43ec-ae42-4b2cc40564e9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3" status: 200 len: 1205 microversion: 2.1 time: 0.127693 Aug 07 01:55:48.996032 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3305/6145] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:48 2022] GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3 => generated 1205 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:55:49.280265 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-39628ec9-2560-49b7-82cf-9a150b1d0794 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:49.280896 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-39628ec9-2560-49b7-82cf-9a150b1d0794 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [instance: 4d6bfe5d-cf98-4ff2-a10e-67692145944c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:49.288283 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39628ec9-2560-49b7-82cf-9a150b1d0794 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:49.288780 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39628ec9-2560-49b7-82cf-9a150b1d0794 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:49.289691 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39628ec9-2560-49b7-82cf-9a150b1d0794 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:49.290461 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39628ec9-2560-49b7-82cf-9a150b1d0794 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:49.290939 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39628ec9-2560-49b7-82cf-9a150b1d0794 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:49.291362 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39628ec9-2560-49b7-82cf-9a150b1d0794 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:49.445722 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-39628ec9-2560-49b7-82cf-9a150b1d0794 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40c219d69d4769b6a957ecce6103b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a860ae0e0f84931893591f9d4b7b7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:49.453535 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-39628ec9-2560-49b7-82cf-9a150b1d0794 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] 10.222.0.39 "GET /compute/v2.1/servers/4d6bfe5d-cf98-4ff2-a10e-67692145944c" status: 200 len: 1642 microversion: 2.1 time: 0.177133 Aug 07 01:55:49.454108 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2841/6146] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:49 2022] GET /compute/v2.1/servers/4d6bfe5d-cf98-4ff2-a10e-67692145944c => generated 1642 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:49.474101 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2128603e-0b8f-498f-b22d-84c329328a48 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:49.474803 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2128603e-0b8f-498f-b22d-84c329328a48 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [instance: 4d6bfe5d-cf98-4ff2-a10e-67692145944c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:49.481136 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2128603e-0b8f-498f-b22d-84c329328a48 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:49.481637 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2128603e-0b8f-498f-b22d-84c329328a48 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:49.482092 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2128603e-0b8f-498f-b22d-84c329328a48 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:49.482847 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2128603e-0b8f-498f-b22d-84c329328a48 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:49.483326 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2128603e-0b8f-498f-b22d-84c329328a48 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:49.483767 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2128603e-0b8f-498f-b22d-84c329328a48 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:49.630902 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2128603e-0b8f-498f-b22d-84c329328a48 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40c219d69d4769b6a957ecce6103b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a860ae0e0f84931893591f9d4b7b7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:55:49.639144 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2128603e-0b8f-498f-b22d-84c329328a48 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] 10.222.0.39 "GET /compute/v2.1/servers/4d6bfe5d-cf98-4ff2-a10e-67692145944c" status: 200 len: 1642 microversion: 2.1 time: 0.168984 Aug 07 01:55:49.639741 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3306/6147] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:49 2022] GET /compute/v2.1/servers/4d6bfe5d-cf98-4ff2-a10e-67692145944c => generated 1642 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:49.659750 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6a907dab-7ab4-4c8f-8447-e1e4907ace54 tempest-TestSecurityGroupsBasicOps-464022980 tempest-TestSecurityGroupsBasicOps-464022980-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:49.660430 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6a907dab-7ab4-4c8f-8447-e1e4907ace54 tempest-TestSecurityGroupsBasicOps-464022980 tempest-TestSecurityGroupsBasicOps-464022980-project-admin] [instance: 4d6bfe5d-cf98-4ff2-a10e-67692145944c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:49.666796 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a907dab-7ab4-4c8f-8447-e1e4907ace54 tempest-TestSecurityGroupsBasicOps-464022980 tempest-TestSecurityGroupsBasicOps-464022980-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:49.667293 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a907dab-7ab4-4c8f-8447-e1e4907ace54 tempest-TestSecurityGroupsBasicOps-464022980 tempest-TestSecurityGroupsBasicOps-464022980-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:49.667736 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a907dab-7ab4-4c8f-8447-e1e4907ace54 tempest-TestSecurityGroupsBasicOps-464022980 tempest-TestSecurityGroupsBasicOps-464022980-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:49.668543 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a907dab-7ab4-4c8f-8447-e1e4907ace54 tempest-TestSecurityGroupsBasicOps-464022980 tempest-TestSecurityGroupsBasicOps-464022980-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:49.669002 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a907dab-7ab4-4c8f-8447-e1e4907ace54 tempest-TestSecurityGroupsBasicOps-464022980 tempest-TestSecurityGroupsBasicOps-464022980-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:49.669471 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a907dab-7ab4-4c8f-8447-e1e4907ace54 tempest-TestSecurityGroupsBasicOps-464022980 tempest-TestSecurityGroupsBasicOps-464022980-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:49.937267 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6a907dab-7ab4-4c8f-8447-e1e4907ace54 tempest-TestSecurityGroupsBasicOps-464022980 tempest-TestSecurityGroupsBasicOps-464022980-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/4d6bfe5d-cf98-4ff2-a10e-67692145944c" status: 200 len: 1793 microversion: 2.1 time: 0.281647 Aug 07 01:55:49.938269 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2842/6148] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:49 2022] GET /compute/v2.1/servers/4d6bfe5d-cf98-4ff2-a10e-67692145944c => generated 1793 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:55:50.017729 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ce4cd8e6-a4b4-491f-9f48-d52ff3a90825 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:50.018405 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ce4cd8e6-a4b4-491f-9f48-d52ff3a90825 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 277f7152-8a1d-4143-bd17-7b5e290bbda3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:50.026831 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce4cd8e6-a4b4-491f-9f48-d52ff3a90825 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:50.027335 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce4cd8e6-a4b4-491f-9f48-d52ff3a90825 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:50.027791 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce4cd8e6-a4b4-491f-9f48-d52ff3a90825 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:50.028576 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce4cd8e6-a4b4-491f-9f48-d52ff3a90825 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:50.029051 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce4cd8e6-a4b4-491f-9f48-d52ff3a90825 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:50.029504 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ce4cd8e6-a4b4-491f-9f48-d52ff3a90825 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:50.049265 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-ce4cd8e6-a4b4-491f-9f48-d52ff3a90825 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] HTTP exception thrown: Instance 277f7152-8a1d-4143-bd17-7b5e290bbda3 could not be found. Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ce4cd8e6-a4b4-491f-9f48-d52ff3a90825 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Request method failure captured: Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3 HTTP/1.1 Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xp6rUdIsYnfs49nr8p-3tgit6VpNtF0E4NPSidukXDEQntBhlyx_gwU6AjnU2O7Q5BLuafO4z_ZO55y2txpq1OJeOibLbj_karsXsR0GpyTHp3BnitplkO9r1bHquRHPgg2Nq4jyNzT0obzTHzoVjdq8NdzVY4LztormmeY7retjUI Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: bf36f5153ba648008cdaceb9dc538e53 Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-TestVolumeBootPattern-121766107 Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bf36f5153ba648008cdaceb9dc538e53", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-TestVolumeBootPattern-121766107 Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: bf36f5153ba648008cdaceb9dc538e53 Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-TestVolumeBootPattern-121766107 Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-TestVolumeBootPattern-121766107-project Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 661f6c9aa7da4e348a9b0d91840078c2 Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-TestVolumeBootPattern-121766107-project Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 277f7152-8a1d-4143-bd17-7b5e290bbda3 could not be found. Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '277f7152-8a1d-4143-bd17-7b5e290bbda3'} Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 277f7152-8a1d-4143-bd17-7b5e290bbda3 could not be found. Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 277f7152-8a1d-4143-bd17-7b5e290bbda3 could not be found. Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:55:50.050969 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:55:50.056263 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:55:50.056263 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:55:50.056263 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:55:50.056263 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:55:50.056263 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:55:50.056263 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 277f7152-8a1d-4143-bd17-7b5e290bbda3 could not be found. Aug 07 01:55:50.056263 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:55:50.056263 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ce4cd8e6-a4b4-491f-9f48-d52ff3a90825 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Returning 404 to user: Instance 277f7152-8a1d-4143-bd17-7b5e290bbda3 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:55:50.056263 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ce4cd8e6-a4b4-491f-9f48-d52ff3a90825 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3" status: 404 len: 111 microversion: 2.1 time: 0.039572 Aug 07 01:55:50.056263 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3307/6149] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:50 2022] GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:55:51.642446 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-a1d0c988-82bb-4870-b5e5-d0e3a7e3b155 req-bef08d99-5f0b-4deb-84f6-2766ca609976 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d6bfe5d-cf98-4ff2-a10e-67692145944c", "tag": "2ae6c402-8443-4c74-95ed-6cc326a4b91d"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:55:51.663030 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a1d0c988-82bb-4870-b5e5-d0e3a7e3b155 req-bef08d99-5f0b-4deb-84f6-2766ca609976 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:51.672874 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a1d0c988-82bb-4870-b5e5-d0e3a7e3b155 req-bef08d99-5f0b-4deb-84f6-2766ca609976 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:51.674052 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a1d0c988-82bb-4870-b5e5-d0e3a7e3b155 req-bef08d99-5f0b-4deb-84f6-2766ca609976 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:51.686202 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-a1d0c988-82bb-4870-b5e5-d0e3a7e3b155 req-bef08d99-5f0b-4deb-84f6-2766ca609976 service nova] Creating event network-changed:2ae6c402-8443-4c74-95ed-6cc326a4b91d for instance 4d6bfe5d-cf98-4ff2-a10e-67692145944c on n-h2-master-1 Aug 07 01:55:51.691529 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-a1d0c988-82bb-4870-b5e5-d0e3a7e3b155 req-bef08d99-5f0b-4deb-84f6-2766ca609976 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055256 Aug 07 01:55:51.692669 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2843/6150] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:55:52.203262 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0adf7a22-1453-4bcf-a134-a02be88e0b14 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:52.204732 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0adf7a22-1453-4bcf-a134-a02be88e0b14 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:52.211769 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0adf7a22-1453-4bcf-a134-a02be88e0b14 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:52.212571 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0adf7a22-1453-4bcf-a134-a02be88e0b14 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:52.213031 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0adf7a22-1453-4bcf-a134-a02be88e0b14 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:52.213761 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0adf7a22-1453-4bcf-a134-a02be88e0b14 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:52.214232 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0adf7a22-1453-4bcf-a134-a02be88e0b14 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:52.214870 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0adf7a22-1453-4bcf-a134-a02be88e0b14 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:52.229728 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-0adf7a22-1453-4bcf-a134-a02be88e0b14 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] HTTP exception thrown: Instance 5757297f-6c22-4e54-9a86-20cb632a3f7e could not be found. Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0adf7a22-1453-4bcf-a134-a02be88e0b14 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Request method failure captured: Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e HTTP/1.1 Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xp6rUdIsYnfs49nr8p-3tgit6VpNtF0E4NPSidukXDEQntBhlyx_gwU6AjnU2O7Q5BLuafO4z_ZO55y2txpq1OJeOibLbj_karsXsR0GpyTHp3BnitplkO9r1bHquRHPgg2Nq4jyNzT0obzTHzoVjdq8NdzVY4LztormmeY7retjUI Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: bf36f5153ba648008cdaceb9dc538e53 Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-TestVolumeBootPattern-121766107 Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bf36f5153ba648008cdaceb9dc538e53", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-TestVolumeBootPattern-121766107 Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: bf36f5153ba648008cdaceb9dc538e53 Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-TestVolumeBootPattern-121766107 Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-TestVolumeBootPattern-121766107-project Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 661f6c9aa7da4e348a9b0d91840078c2 Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-TestVolumeBootPattern-121766107-project Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 5757297f-6c22-4e54-9a86-20cb632a3f7e could not be found. Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '5757297f-6c22-4e54-9a86-20cb632a3f7e'} Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5757297f-6c22-4e54-9a86-20cb632a3f7e could not be found. Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:55:52.231335 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:55:52.236456 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5757297f-6c22-4e54-9a86-20cb632a3f7e could not be found. Aug 07 01:55:52.236456 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:55:52.236456 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:55:52.236456 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:55:52.236456 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:55:52.236456 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:55:52.236456 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:55:52.236456 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:55:52.236456 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:55:52.236456 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5757297f-6c22-4e54-9a86-20cb632a3f7e could not be found. Aug 07 01:55:52.236456 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:55:52.236456 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0adf7a22-1453-4bcf-a134-a02be88e0b14 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Returning 404 to user: Instance 5757297f-6c22-4e54-9a86-20cb632a3f7e could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:55:52.236456 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0adf7a22-1453-4bcf-a134-a02be88e0b14 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 404 len: 111 microversion: 2.1 time: 0.034057 Aug 07 01:55:52.237496 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3308/6151] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:55:52 2022] DELETE /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:55:52.242984 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-00653110-7ffe-4156-af8e-ad1c70b9080f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:52.243688 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-00653110-7ffe-4156-af8e-ad1c70b9080f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 5757297f-6c22-4e54-9a86-20cb632a3f7e] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:52.250807 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00653110-7ffe-4156-af8e-ad1c70b9080f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:52.251438 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00653110-7ffe-4156-af8e-ad1c70b9080f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:52.252000 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00653110-7ffe-4156-af8e-ad1c70b9080f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:52.252657 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00653110-7ffe-4156-af8e-ad1c70b9080f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:52.253203 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00653110-7ffe-4156-af8e-ad1c70b9080f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:52.253626 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00653110-7ffe-4156-af8e-ad1c70b9080f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:52.271244 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-00653110-7ffe-4156-af8e-ad1c70b9080f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] HTTP exception thrown: Instance 5757297f-6c22-4e54-9a86-20cb632a3f7e could not be found. Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-00653110-7ffe-4156-af8e-ad1c70b9080f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Request method failure captured: Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e HTTP/1.1 Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xp6rUdIsYnfs49nr8p-3tgit6VpNtF0E4NPSidukXDEQntBhlyx_gwU6AjnU2O7Q5BLuafO4z_ZO55y2txpq1OJeOibLbj_karsXsR0GpyTHp3BnitplkO9r1bHquRHPgg2Nq4jyNzT0obzTHzoVjdq8NdzVY4LztormmeY7retjUI Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: bf36f5153ba648008cdaceb9dc538e53 Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-TestVolumeBootPattern-121766107 Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bf36f5153ba648008cdaceb9dc538e53", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-TestVolumeBootPattern-121766107 Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: bf36f5153ba648008cdaceb9dc538e53 Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-TestVolumeBootPattern-121766107 Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-TestVolumeBootPattern-121766107-project Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 661f6c9aa7da4e348a9b0d91840078c2 Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-TestVolumeBootPattern-121766107-project Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 5757297f-6c22-4e54-9a86-20cb632a3f7e could not be found. Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '5757297f-6c22-4e54-9a86-20cb632a3f7e'} Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5757297f-6c22-4e54-9a86-20cb632a3f7e could not be found. Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5757297f-6c22-4e54-9a86-20cb632a3f7e could not be found. Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:55:52.272973 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:55:52.277971 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:55:52.277971 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:55:52.277971 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:55:52.277971 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:55:52.277971 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:55:52.277971 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5757297f-6c22-4e54-9a86-20cb632a3f7e could not be found. Aug 07 01:55:52.277971 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:55:52.277971 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-00653110-7ffe-4156-af8e-ad1c70b9080f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Returning 404 to user: Instance 5757297f-6c22-4e54-9a86-20cb632a3f7e could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:55:52.277971 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-00653110-7ffe-4156-af8e-ad1c70b9080f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e" status: 404 len: 111 microversion: 2.1 time: 0.036032 Aug 07 01:55:52.277971 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2844/6152] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:52 2022] GET /compute/v2.1/servers/5757297f-6c22-4e54-9a86-20cb632a3f7e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:55:52.393970 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f182c290-7ef7-4864-a432-cdfd60ad481a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:55:52.397353 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f182c290-7ef7-4864-a432-cdfd60ad481a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:52.408079 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f182c290-7ef7-4864-a432-cdfd60ad481a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:52.408743 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f182c290-7ef7-4864-a432-cdfd60ad481a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:52.409325 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f182c290-7ef7-4864-a432-cdfd60ad481a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:52.410169 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f182c290-7ef7-4864-a432-cdfd60ad481a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:52.410755 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f182c290-7ef7-4864-a432-cdfd60ad481a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:52.411305 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f182c290-7ef7-4864-a432-cdfd60ad481a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:52.515420 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f182c290-7ef7-4864-a432-cdfd60ad481a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "POST /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383/action" status: 200 len: 24576 microversion: 2.1 time: 0.124223 Aug 07 01:55:52.517696 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3309/6153] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:55:52 2022] POST /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383/action => generated 24576 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:55:52.981595 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-99a8e102-45e9-41e0-8f86-56a442b7a6d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:52.982105 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-99a8e102-45e9-41e0-8f86-56a442b7a6d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 277f7152-8a1d-4143-bd17-7b5e290bbda3] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:52.989370 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-99a8e102-45e9-41e0-8f86-56a442b7a6d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:52.989869 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-99a8e102-45e9-41e0-8f86-56a442b7a6d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:52.990313 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-99a8e102-45e9-41e0-8f86-56a442b7a6d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:52.991039 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-99a8e102-45e9-41e0-8f86-56a442b7a6d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:52.991498 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-99a8e102-45e9-41e0-8f86-56a442b7a6d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:52.992214 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-99a8e102-45e9-41e0-8f86-56a442b7a6d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:53.007229 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-99a8e102-45e9-41e0-8f86-56a442b7a6d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] HTTP exception thrown: Instance 277f7152-8a1d-4143-bd17-7b5e290bbda3 could not be found. Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-99a8e102-45e9-41e0-8f86-56a442b7a6d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Request method failure captured: Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3 HTTP/1.1 Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xp6rUdIsYnfs49nr8p-3tgit6VpNtF0E4NPSidukXDEQntBhlyx_gwU6AjnU2O7Q5BLuafO4z_ZO55y2txpq1OJeOibLbj_karsXsR0GpyTHp3BnitplkO9r1bHquRHPgg2Nq4jyNzT0obzTHzoVjdq8NdzVY4LztormmeY7retjUI Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: bf36f5153ba648008cdaceb9dc538e53 Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-TestVolumeBootPattern-121766107 Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bf36f5153ba648008cdaceb9dc538e53", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-TestVolumeBootPattern-121766107 Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: bf36f5153ba648008cdaceb9dc538e53 Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-TestVolumeBootPattern-121766107 Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-TestVolumeBootPattern-121766107-project Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 661f6c9aa7da4e348a9b0d91840078c2 Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-TestVolumeBootPattern-121766107-project Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 277f7152-8a1d-4143-bd17-7b5e290bbda3 could not be found. Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '277f7152-8a1d-4143-bd17-7b5e290bbda3'} Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 277f7152-8a1d-4143-bd17-7b5e290bbda3 could not be found. Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:55:53.008870 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:55:53.014063 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 277f7152-8a1d-4143-bd17-7b5e290bbda3 could not be found. Aug 07 01:55:53.014063 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:55:53.014063 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:55:53.014063 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:55:53.014063 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:55:53.014063 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:55:53.014063 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:55:53.014063 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:55:53.014063 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:55:53.014063 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 277f7152-8a1d-4143-bd17-7b5e290bbda3 could not be found. Aug 07 01:55:53.014063 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:55:53.014063 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-99a8e102-45e9-41e0-8f86-56a442b7a6d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Returning 404 to user: Instance 277f7152-8a1d-4143-bd17-7b5e290bbda3 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:55:53.014063 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-99a8e102-45e9-41e0-8f86-56a442b7a6d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "DELETE /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3" status: 404 len: 111 microversion: 2.1 time: 0.032833 Aug 07 01:55:53.017329 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2845/6154] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:55:52 2022] DELETE /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:55:53.021028 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-38172384-75d0-453c-8ca4-5cda7272417f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:53.021757 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-38172384-75d0-453c-8ca4-5cda7272417f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 277f7152-8a1d-4143-bd17-7b5e290bbda3] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:53.029374 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38172384-75d0-453c-8ca4-5cda7272417f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:53.029868 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38172384-75d0-453c-8ca4-5cda7272417f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:53.030596 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38172384-75d0-453c-8ca4-5cda7272417f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:53.031078 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38172384-75d0-453c-8ca4-5cda7272417f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:53.032176 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38172384-75d0-453c-8ca4-5cda7272417f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:53.032631 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38172384-75d0-453c-8ca4-5cda7272417f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:53.049406 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-38172384-75d0-453c-8ca4-5cda7272417f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] HTTP exception thrown: Instance 277f7152-8a1d-4143-bd17-7b5e290bbda3 could not be found. Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-38172384-75d0-453c-8ca4-5cda7272417f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Request method failure captured: Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3 HTTP/1.1 Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xp6rUdIsYnfs49nr8p-3tgit6VpNtF0E4NPSidukXDEQntBhlyx_gwU6AjnU2O7Q5BLuafO4z_ZO55y2txpq1OJeOibLbj_karsXsR0GpyTHp3BnitplkO9r1bHquRHPgg2Nq4jyNzT0obzTHzoVjdq8NdzVY4LztormmeY7retjUI Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: bf36f5153ba648008cdaceb9dc538e53 Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-TestVolumeBootPattern-121766107 Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bf36f5153ba648008cdaceb9dc538e53", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-TestVolumeBootPattern-121766107 Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: bf36f5153ba648008cdaceb9dc538e53 Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-TestVolumeBootPattern-121766107 Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-TestVolumeBootPattern-121766107-project Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 661f6c9aa7da4e348a9b0d91840078c2 Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-TestVolumeBootPattern-121766107-project Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 277f7152-8a1d-4143-bd17-7b5e290bbda3 could not be found. Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '277f7152-8a1d-4143-bd17-7b5e290bbda3'} Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 277f7152-8a1d-4143-bd17-7b5e290bbda3 could not be found. Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 277f7152-8a1d-4143-bd17-7b5e290bbda3 could not be found. Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:55:53.051102 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:55:53.055802 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:55:53.055802 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:55:53.055802 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:55:53.055802 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:55:53.055802 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:55:53.055802 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 277f7152-8a1d-4143-bd17-7b5e290bbda3 could not be found. Aug 07 01:55:53.055802 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:55:53.055802 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-38172384-75d0-453c-8ca4-5cda7272417f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Returning 404 to user: Instance 277f7152-8a1d-4143-bd17-7b5e290bbda3 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:55:53.055802 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-38172384-75d0-453c-8ca4-5cda7272417f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3" status: 404 len: 111 microversion: 2.1 time: 0.035918 Aug 07 01:55:53.055802 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3310/6155] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:53 2022] GET /compute/v2.1/servers/277f7152-8a1d-4143-bd17-7b5e290bbda3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:55:53.128017 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d6b1d627-79d0-4900-a2b0-47817c38a58b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Action: 'create', calling method: .version_select at 0x7f9e29819d30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-55640696", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjH5PX9H6YgvVXuy2+qA7PDXEsdJJUMXBjPt/S53A+BbZ6eYvwoVCRHye+zHctWexhYtqYv1Am2oH62CrzcYZmowBOc5/VFPdxW/HUDSfz0cuKcJudYAUFGcjkzUWaCeQ=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:55:53.143916 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-d6b1d627-79d0-4900-a2b0-47817c38a58b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Getting quotas for project bf36f5153ba648008cdaceb9dc538e53. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:55:53.149036 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-d6b1d627-79d0-4900-a2b0-47817c38a58b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Getting quotas for user 661f6c9aa7da4e348a9b0d91840078c2 and project bf36f5153ba648008cdaceb9dc538e53. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:55:53.172706 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d6b1d627-79d0-4900-a2b0-47817c38a58b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.048788 Aug 07 01:55:53.173335 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2846/6156] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:55:53 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:55:58.948055 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2a0f6d3a-cacf-4599-b0a4-7cf168141775 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:55:58.948696 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2a0f6d3a-cacf-4599-b0a4-7cf168141775 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:55:58.952842 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:55:58.957933 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a0f6d3a-cacf-4599-b0a4-7cf168141775 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:58.958450 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a0f6d3a-cacf-4599-b0a4-7cf168141775 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:58.958900 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a0f6d3a-cacf-4599-b0a4-7cf168141775 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:58.959749 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a0f6d3a-cacf-4599-b0a4-7cf168141775 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:55:58.960271 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a0f6d3a-cacf-4599-b0a4-7cf168141775 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:55:58.960737 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a0f6d3a-cacf-4599-b0a4-7cf168141775 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:55:59.102549 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2a0f6d3a-cacf-4599-b0a4-7cf168141775 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1833 microversion: 2.1 time: 0.158953 Aug 07 01:55:59.103325 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3311/6157] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:55:58 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1833 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:00.261858 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-93ca8352-9513-47c3-9377-222585756019 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:00.262440 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-93ca8352-9513-47c3-9377-222585756019 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:00.274246 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-92741dac-dc22-430b-a7aa-9393565d5182 req-08989635-4384-4e7d-aaac-5bd1cf1e9c1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ba17885-27b3-4f21-8cfa-dd2662fb4383", "tag": "29e9d8c4-0b0e-4323-a16e-2e544961b1ba"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:56:00.287471 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-92741dac-dc22-430b-a7aa-9393565d5182 req-08989635-4384-4e7d-aaac-5bd1cf1e9c1f service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:00.289641 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93ca8352-9513-47c3-9377-222585756019 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:00.290338 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93ca8352-9513-47c3-9377-222585756019 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:00.290787 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93ca8352-9513-47c3-9377-222585756019 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:00.291510 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93ca8352-9513-47c3-9377-222585756019 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:00.292212 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93ca8352-9513-47c3-9377-222585756019 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:00.293121 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93ca8352-9513-47c3-9377-222585756019 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:00.293431 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-92741dac-dc22-430b-a7aa-9393565d5182 req-08989635-4384-4e7d-aaac-5bd1cf1e9c1f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:00.294621 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-92741dac-dc22-430b-a7aa-9393565d5182 req-08989635-4384-4e7d-aaac-5bd1cf1e9c1f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:00.317467 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-92741dac-dc22-430b-a7aa-9393565d5182 req-08989635-4384-4e7d-aaac-5bd1cf1e9c1f service nova] Creating event network-changed:29e9d8c4-0b0e-4323-a16e-2e544961b1ba for instance 3ba17885-27b3-4f21-8cfa-dd2662fb4383 on n-h2-master-1 Aug 07 01:56:00.324387 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-93ca8352-9513-47c3-9377-222585756019 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:56:00.327128 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-92741dac-dc22-430b-a7aa-9393565d5182 req-08989635-4384-4e7d-aaac-5bd1cf1e9c1f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056604 Aug 07 01:56:00.333230 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3312/6158] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:56:00.436104 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-93ca8352-9513-47c3-9377-222585756019 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 204 len: 0 microversion: 2.1 time: 0.178312 Aug 07 01:56:00.436696 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2847/6159] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:56:00 2022] DELETE /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:56:00.447566 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7f568c73-0554-4ea7-890b-0502b6982e49 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:00.448318 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7f568c73-0554-4ea7-890b-0502b6982e49 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:00.454937 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f568c73-0554-4ea7-890b-0502b6982e49 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:00.455588 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f568c73-0554-4ea7-890b-0502b6982e49 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:00.456086 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f568c73-0554-4ea7-890b-0502b6982e49 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:00.456820 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f568c73-0554-4ea7-890b-0502b6982e49 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:00.457284 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f568c73-0554-4ea7-890b-0502b6982e49 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:00.457927 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f568c73-0554-4ea7-890b-0502b6982e49 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:00.609095 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7f568c73-0554-4ea7-890b-0502b6982e49 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:00.622148 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7f568c73-0554-4ea7-890b-0502b6982e49 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1688 microversion: 2.1 time: 0.180028 Aug 07 01:56:00.622847 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3313/6160] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:00 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1688 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:56:01.648620 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-247c0716-0f40-4307-9815-29f47774757a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:01.649352 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-247c0716-0f40-4307-9815-29f47774757a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:01.656767 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-247c0716-0f40-4307-9815-29f47774757a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:01.657254 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-247c0716-0f40-4307-9815-29f47774757a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:01.657694 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-247c0716-0f40-4307-9815-29f47774757a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:01.658412 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-247c0716-0f40-4307-9815-29f47774757a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:01.658932 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-247c0716-0f40-4307-9815-29f47774757a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:01.659378 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-247c0716-0f40-4307-9815-29f47774757a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:01.801857 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-247c0716-0f40-4307-9815-29f47774757a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:01.812183 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-247c0716-0f40-4307-9815-29f47774757a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1688 microversion: 2.1 time: 0.167864 Aug 07 01:56:01.813709 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2848/6161] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:01 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:02.512288 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-d301362c-01ad-49b2-827a-4f9f58495a7b req-fb6aad47-7ef8-40a9-b196-121d686fa600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ba17885-27b3-4f21-8cfa-dd2662fb4383", "name": "network-vif-deleted", "tag": "29e9d8c4-0b0e-4323-a16e-2e544961b1ba"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:56:02.523976 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d301362c-01ad-49b2-827a-4f9f58495a7b req-fb6aad47-7ef8-40a9-b196-121d686fa600 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:02.524469 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d301362c-01ad-49b2-827a-4f9f58495a7b req-fb6aad47-7ef8-40a9-b196-121d686fa600 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:02.524919 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d301362c-01ad-49b2-827a-4f9f58495a7b req-fb6aad47-7ef8-40a9-b196-121d686fa600 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:02.539414 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-d301362c-01ad-49b2-827a-4f9f58495a7b req-fb6aad47-7ef8-40a9-b196-121d686fa600 service nova] Creating event network-vif-deleted:29e9d8c4-0b0e-4323-a16e-2e544961b1ba for instance 3ba17885-27b3-4f21-8cfa-dd2662fb4383 on n-h2-master-1 Aug 07 01:56:02.544608 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-d301362c-01ad-49b2-827a-4f9f58495a7b req-fb6aad47-7ef8-40a9-b196-121d686fa600 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036026 Aug 07 01:56:02.545211 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3314/6162] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:56:02.835065 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ee7d3e2b-277b-4338-bb26-c9f48fcab43d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:02.836021 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ee7d3e2b-277b-4338-bb26-c9f48fcab43d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:02.843873 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee7d3e2b-277b-4338-bb26-c9f48fcab43d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:02.844707 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee7d3e2b-277b-4338-bb26-c9f48fcab43d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:02.845554 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee7d3e2b-277b-4338-bb26-c9f48fcab43d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:02.846480 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee7d3e2b-277b-4338-bb26-c9f48fcab43d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:02.847116 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee7d3e2b-277b-4338-bb26-c9f48fcab43d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:02.848047 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee7d3e2b-277b-4338-bb26-c9f48fcab43d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:02.885193 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee7d3e2b-277b-4338-bb26-c9f48fcab43d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:02.885978 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee7d3e2b-277b-4338-bb26-c9f48fcab43d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:02.886477 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee7d3e2b-277b-4338-bb26-c9f48fcab43d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:02.886941 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-ee7d3e2b-277b-4338-bb26-c9f48fcab43d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lazy-loading 'fault' on Instance uuid 3ba17885-27b3-4f21-8cfa-dd2662fb4383 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:56:02.937752 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ee7d3e2b-277b-4338-bb26-c9f48fcab43d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:02.953962 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ee7d3e2b-277b-4338-bb26-c9f48fcab43d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 200 len: 1356 microversion: 2.1 time: 0.121145 Aug 07 01:56:02.969484 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2849/6163] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:02 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 1356 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:03.982718 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a7b9eea5-8b4f-46b9-b719-8d8d59e047ae tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:03.983330 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a7b9eea5-8b4f-46b9-b719-8d8d59e047ae tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 3ba17885-27b3-4f21-8cfa-dd2662fb4383] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:03.990741 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7b9eea5-8b4f-46b9-b719-8d8d59e047ae tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:03.991189 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7b9eea5-8b4f-46b9-b719-8d8d59e047ae tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:03.992186 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7b9eea5-8b4f-46b9-b719-8d8d59e047ae tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:03.993262 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7b9eea5-8b4f-46b9-b719-8d8d59e047ae tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:03.993262 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7b9eea5-8b4f-46b9-b719-8d8d59e047ae tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:03.993549 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7b9eea5-8b4f-46b9-b719-8d8d59e047ae tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:04.012183 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-a7b9eea5-8b4f-46b9-b719-8d8d59e047ae tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] HTTP exception thrown: Instance 3ba17885-27b3-4f21-8cfa-dd2662fb4383 could not be found. Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a7b9eea5-8b4f-46b9-b719-8d8d59e047ae tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Request method failure captured: Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 HTTP/1.1 Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xs7m9NZoR7QYJEs2LdGd8pBDTRyEi0z4J0cBXKascPq3zVViX-oKQvuaXwOhnW2JLOmnZwctSI6Ey4onVMpls1VeWoMFG_HIdnE2zQ7QFGrzRXTZiFvvZQlJ3VmarDoU9LqJmDS_SlWfy2oHktXR4wvHeXSLIROc6sY5luRoQUQZ5A Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: d37d8c916412400ba4b57ea10fceb39e Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1464135667 Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d37d8c916412400ba4b57ea10fceb39e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d37d8c916412400ba4b57ea10fceb39e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d37d8c916412400ba4b57ea10fceb39e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d37d8c916412400ba4b57ea10fceb39e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1464135667 Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: d37d8c916412400ba4b57ea10fceb39e Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1464135667 Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-TestNetworkAdvancedServerOps-1464135667-project Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 830639b9b39a43a7b714b74c26fdf52c Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1464135667-project Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 3ba17885-27b3-4f21-8cfa-dd2662fb4383 could not be found. Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '3ba17885-27b3-4f21-8cfa-dd2662fb4383'} Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ba17885-27b3-4f21-8cfa-dd2662fb4383 could not be found. Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ba17885-27b3-4f21-8cfa-dd2662fb4383 could not be found. Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:56:04.013885 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:56:04.019459 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:56:04.019459 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:56:04.019459 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:56:04.019459 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:56:04.019459 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:56:04.019459 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:56:04.019459 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ba17885-27b3-4f21-8cfa-dd2662fb4383 could not be found. Aug 07 01:56:04.019459 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:56:04.019459 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a7b9eea5-8b4f-46b9-b719-8d8d59e047ae tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Returning 404 to user: Instance 3ba17885-27b3-4f21-8cfa-dd2662fb4383 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:56:04.019459 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a7b9eea5-8b4f-46b9-b719-8d8d59e047ae tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383" status: 404 len: 111 microversion: 2.1 time: 0.043459 Aug 07 01:56:04.019459 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3315/6164] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:03 2022] GET /compute/v2.1/servers/3ba17885-27b3-4f21-8cfa-dd2662fb4383 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:56:07.657116 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-01cd335d-19aa-41a0-b57a-126c7a050e61 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '.version_select at 0x7f9e299b4280>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:07.662946 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=4 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:56:07.666496 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:56:07.683687 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-01cd335d-19aa-41a0-b57a-126c7a050e61 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1784247932" status: 202 len: 0 microversion: 2.1 time: 0.031494 Aug 07 01:56:07.689497 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2850/6165] 10.222.0.39 () {58 vars in 1284 bytes} [Sun Aug 7 01:56:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1784247932 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:56:07.713617 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f3a590d5-4c6a-457c-8314-8815c548267a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Action: 'create', calling method: .version_select at 0x7f9e2482ab80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-176657936", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAn66eElHv8JGCB8gseX7YUyCi+jQlhI7BtY+0ZZPpy6tNWn/JzTvlNFgguEuRMLeFuqaIXAfEobhHhrylDRW16+wd/hyFMEd+uy046VsZCrXlbtpOSzYoUfCanEXaVZkg=="}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:56:07.730941 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-f3a590d5-4c6a-457c-8314-8815c548267a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Getting quotas for project d37d8c916412400ba4b57ea10fceb39e. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:56:07.737192 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-f3a590d5-4c6a-457c-8314-8815c548267a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Getting quotas for user 830639b9b39a43a7b714b74c26fdf52c and project d37d8c916412400ba4b57ea10fceb39e. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:56:07.762646 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f3a590d5-4c6a-457c-8314-8815c548267a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.053164 Aug 07 01:56:07.764084 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3316/6166] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:56:07 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:56:08.055306 n-d-master-1 devstack@n-api.service[119516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 01:56:08.056017 n-d-master-1 devstack@n-api.service[119516]: Sun Aug 7 01:56:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 01:56:10.740483 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-38d12f60-101f-4fca-bdae-b62e42ca6f15 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-701350395", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-55640696", "security_groups": [{"name": "tempest-secgroup-smoke-2046667871"}], "block_device_mapping_v2": [{"uuid": "4a17fb95-6746-4257-9612-72f35c6b9751", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "620c0b3f-63f9-404f-acf4-ca02927e0de7"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:56:10.957491 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-38d12f60-101f-4fca-bdae-b62e42ca6f15 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] validate_networks() for [('620c0b3f-63f9-404f-acf4-ca02927e0de7', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:56:11.404842 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-38d12f60-101f-4fca-bdae-b62e42ca6f15 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:56:11.405811 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-38d12f60-101f-4fca-bdae-b62e42ca6f15 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:56:11.406640 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-38d12f60-101f-4fca-bdae-b62e42ca6f15 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:56:11.407313 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-38d12f60-101f-4fca-bdae-b62e42ca6f15 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:56:11.407969 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-38d12f60-101f-4fca-bdae-b62e42ca6f15 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:56:11.417905 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-38d12f60-101f-4fca-bdae-b62e42ca6f15 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:11.418387 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-38d12f60-101f-4fca-bdae-b62e42ca6f15 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:11.419031 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-38d12f60-101f-4fca-bdae-b62e42ca6f15 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:11.419769 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-38d12f60-101f-4fca-bdae-b62e42ca6f15 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:11.420435 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-38d12f60-101f-4fca-bdae-b62e42ca6f15 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:11.420931 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-38d12f60-101f-4fca-bdae-b62e42ca6f15 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:11.439652 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-38d12f60-101f-4fca-bdae-b62e42ca6f15 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Getting quotas for project bf36f5153ba648008cdaceb9dc538e53. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:56:11.445236 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-38d12f60-101f-4fca-bdae-b62e42ca6f15 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Getting quotas for user 661f6c9aa7da4e348a9b0d91840078c2 and project bf36f5153ba648008cdaceb9dc538e53. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:56:11.511544 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-38d12f60-101f-4fca-bdae-b62e42ca6f15 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:56:11.513694 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-38d12f60-101f-4fca-bdae-b62e42ca6f15 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 08886847-3d66-41ea-b13d-78bec27950a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4a17fb95-6746-4257-9612-72f35c6b9751',volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:56:11.696515 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-38d12f60-101f-4fca-bdae-b62e42ca6f15 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.960143 Aug 07 01:56:11.699489 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2851/6167] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:56:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 07 01:56:11.712110 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-67d844a7-d419-4d6a-9a0c-6e03a6c358f3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:11.712759 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-67d844a7-d419-4d6a-9a0c-6e03a6c358f3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 08886847-3d66-41ea-b13d-78bec27950a5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:11.946988 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-67d844a7-d419-4d6a-9a0c-6e03a6c358f3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:11.961321 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-67d844a7-d419-4d6a-9a0c-6e03a6c358f3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5" status: 200 len: 1092 microversion: 2.1 time: 0.253901 Aug 07 01:56:11.971921 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3317/6168] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:11 2022] GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5 => generated 1092 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:12.990564 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a79e1100-7ab7-44f0-8ed8-a65db60beb0a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:12.992351 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a79e1100-7ab7-44f0-8ed8-a65db60beb0a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 08886847-3d66-41ea-b13d-78bec27950a5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:13.009889 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a79e1100-7ab7-44f0-8ed8-a65db60beb0a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:13.019089 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a79e1100-7ab7-44f0-8ed8-a65db60beb0a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:13.020166 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a79e1100-7ab7-44f0-8ed8-a65db60beb0a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:13.021845 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a79e1100-7ab7-44f0-8ed8-a65db60beb0a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:13.022198 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a79e1100-7ab7-44f0-8ed8-a65db60beb0a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:13.022643 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a79e1100-7ab7-44f0-8ed8-a65db60beb0a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:13.029553 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:56:13.134168 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a79e1100-7ab7-44f0-8ed8-a65db60beb0a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:13.143172 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a79e1100-7ab7-44f0-8ed8-a65db60beb0a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5" status: 200 len: 1208 microversion: 2.1 time: 0.161732 Aug 07 01:56:13.146035 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2852/6169] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:12 2022] GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5 => generated 1208 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:14.169058 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5606c60a-ac2b-4719-9eef-a27f57149813 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:14.170503 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5606c60a-ac2b-4719-9eef-a27f57149813 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 08886847-3d66-41ea-b13d-78bec27950a5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:14.175167 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=55 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:56:14.190205 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5606c60a-ac2b-4719-9eef-a27f57149813 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:14.192016 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5606c60a-ac2b-4719-9eef-a27f57149813 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:14.192787 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5606c60a-ac2b-4719-9eef-a27f57149813 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:14.193760 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5606c60a-ac2b-4719-9eef-a27f57149813 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:14.194415 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5606c60a-ac2b-4719-9eef-a27f57149813 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:14.195063 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5606c60a-ac2b-4719-9eef-a27f57149813 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:14.301654 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5606c60a-ac2b-4719-9eef-a27f57149813 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:14.340313 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5606c60a-ac2b-4719-9eef-a27f57149813 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5" status: 200 len: 1208 microversion: 2.1 time: 0.174523 Aug 07 01:56:14.361580 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3318/6170] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:14 2022] GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5 => generated 1208 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:15.364493 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-66f9981f-c4fb-4906-ba7c-95237b13efba tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:15.365790 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-66f9981f-c4fb-4906-ba7c-95237b13efba tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 08886847-3d66-41ea-b13d-78bec27950a5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:15.387943 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-66f9981f-c4fb-4906-ba7c-95237b13efba tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:15.389062 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-66f9981f-c4fb-4906-ba7c-95237b13efba tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:15.390284 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-66f9981f-c4fb-4906-ba7c-95237b13efba tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:15.392074 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-66f9981f-c4fb-4906-ba7c-95237b13efba tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:15.396509 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-66f9981f-c4fb-4906-ba7c-95237b13efba tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:15.398368 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-66f9981f-c4fb-4906-ba7c-95237b13efba tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:15.521106 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1dbeb24f-4124-442e-b692-e14ae3c2ee2c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-416252066", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "cc0ffe73-623e-4dc5-a01a-2db8eb068025"}], "key_name": "tempest-TestNetworkAdvancedServerOps-176657936", "security_groups": [{"name": "tempest-secgroup-smoke-349135878"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:56:15.675827 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-66f9981f-c4fb-4906-ba7c-95237b13efba tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:15.689077 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-66f9981f-c4fb-4906-ba7c-95237b13efba tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5" status: 200 len: 1276 microversion: 2.1 time: 0.328120 Aug 07 01:56:15.690918 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2853/6171] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:15 2022] GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5 => generated 1276 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:15.699198 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-1dbeb24f-4124-442e-b692-e14ae3c2ee2c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] validate_networks() for [('cc0ffe73-623e-4dc5-a01a-2db8eb068025', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:56:16.324013 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-7d4a1e33-1a2e-40c7-9da0-dee4cdeafac4 req-2535cf3c-c146-4b6b-af00-363e9461f1c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08886847-3d66-41ea-b13d-78bec27950a5", "tag": "65a964ed-8a1b-4b88-b972-1095976406b9"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:56:16.378613 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-7d4a1e33-1a2e-40c7-9da0-dee4cdeafac4 req-2535cf3c-c146-4b6b-af00-363e9461f1c6 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:16.379828 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-7d4a1e33-1a2e-40c7-9da0-dee4cdeafac4 req-2535cf3c-c146-4b6b-af00-363e9461f1c6 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:16.381029 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-7d4a1e33-1a2e-40c7-9da0-dee4cdeafac4 req-2535cf3c-c146-4b6b-af00-363e9461f1c6 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:16.397712 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-7d4a1e33-1a2e-40c7-9da0-dee4cdeafac4 req-2535cf3c-c146-4b6b-af00-363e9461f1c6 service nova] Creating event network-changed:65a964ed-8a1b-4b88-b972-1095976406b9 for instance 08886847-3d66-41ea-b13d-78bec27950a5 on n-h1-master-1 Aug 07 01:56:16.416908 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-7d4a1e33-1a2e-40c7-9da0-dee4cdeafac4 req-2535cf3c-c146-4b6b-af00-363e9461f1c6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104485 Aug 07 01:56:16.420245 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2854/6172] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:56:16.605622 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-1dbeb24f-4124-442e-b692-e14ae3c2ee2c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:56:16.607134 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-1dbeb24f-4124-442e-b692-e14ae3c2ee2c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:56:16.608644 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-1dbeb24f-4124-442e-b692-e14ae3c2ee2c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:56:16.609283 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-1dbeb24f-4124-442e-b692-e14ae3c2ee2c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:56:16.610028 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-1dbeb24f-4124-442e-b692-e14ae3c2ee2c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:56:16.621890 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1dbeb24f-4124-442e-b692-e14ae3c2ee2c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:16.623009 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1dbeb24f-4124-442e-b692-e14ae3c2ee2c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:16.624195 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1dbeb24f-4124-442e-b692-e14ae3c2ee2c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:16.625314 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1dbeb24f-4124-442e-b692-e14ae3c2ee2c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:16.625787 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1dbeb24f-4124-442e-b692-e14ae3c2ee2c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:16.626232 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1dbeb24f-4124-442e-b692-e14ae3c2ee2c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:16.648521 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-1dbeb24f-4124-442e-b692-e14ae3c2ee2c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Getting quotas for project d37d8c916412400ba4b57ea10fceb39e. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:56:16.655117 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-1dbeb24f-4124-442e-b692-e14ae3c2ee2c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Getting quotas for user 830639b9b39a43a7b714b74c26fdf52c and project d37d8c916412400ba4b57ea10fceb39e. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:56:16.671800 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1dbeb24f-4124-442e-b692-e14ae3c2ee2c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:56:16.680984 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1dbeb24f-4124-442e-b692-e14ae3c2ee2c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:56:16.712870 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bcf5fcaf-b0b2-482f-8c27-1cca8a9bcbe5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:16.713498 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bcf5fcaf-b0b2-482f-8c27-1cca8a9bcbe5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 08886847-3d66-41ea-b13d-78bec27950a5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:16.730396 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bcf5fcaf-b0b2-482f-8c27-1cca8a9bcbe5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:16.732285 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bcf5fcaf-b0b2-482f-8c27-1cca8a9bcbe5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:16.734912 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bcf5fcaf-b0b2-482f-8c27-1cca8a9bcbe5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:16.735743 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bcf5fcaf-b0b2-482f-8c27-1cca8a9bcbe5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:16.736272 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bcf5fcaf-b0b2-482f-8c27-1cca8a9bcbe5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:16.736700 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bcf5fcaf-b0b2-482f-8c27-1cca8a9bcbe5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:16.764228 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1dbeb24f-4124-442e-b692-e14ae3c2ee2c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.247907 Aug 07 01:56:16.765625 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3319/6173] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:56:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 1250 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 07 01:56:16.776879 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9e63f57d-67d5-4638-9cc0-ecfdfb248048 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:16.779491 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9e63f57d-67d5-4638-9cc0-ecfdfb248048 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:16.960882 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9e63f57d-67d5-4638-9cc0-ecfdfb248048 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:16.977192 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9e63f57d-67d5-4638-9cc0-ecfdfb248048 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1265 microversion: 2.1 time: 0.202878 Aug 07 01:56:16.978301 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3320/6174] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:16 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:17.042588 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bcf5fcaf-b0b2-482f-8c27-1cca8a9bcbe5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:17.051055 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bcf5fcaf-b0b2-482f-8c27-1cca8a9bcbe5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5" status: 200 len: 1276 microversion: 2.1 time: 0.342263 Aug 07 01:56:17.054412 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2855/6175] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:16 2022] GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5 => generated 1276 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:18.005759 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e5b6b25a-60c6-40a4-8f9c-093a17240875 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:18.006761 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e5b6b25a-60c6-40a4-8f9c-093a17240875 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:18.029268 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5b6b25a-60c6-40a4-8f9c-093a17240875 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:18.030666 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5b6b25a-60c6-40a4-8f9c-093a17240875 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:18.031135 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5b6b25a-60c6-40a4-8f9c-093a17240875 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:18.032146 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5b6b25a-60c6-40a4-8f9c-093a17240875 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:18.032618 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5b6b25a-60c6-40a4-8f9c-093a17240875 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:18.033061 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5b6b25a-60c6-40a4-8f9c-093a17240875 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:18.073723 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a13b0887-bd5a-49ef-b345-86e1f44d68a0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:18.075043 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a13b0887-bd5a-49ef-b345-86e1f44d68a0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 08886847-3d66-41ea-b13d-78bec27950a5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:18.089102 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a13b0887-bd5a-49ef-b345-86e1f44d68a0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:18.090145 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a13b0887-bd5a-49ef-b345-86e1f44d68a0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:18.090897 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a13b0887-bd5a-49ef-b345-86e1f44d68a0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:18.095671 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a13b0887-bd5a-49ef-b345-86e1f44d68a0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:18.096690 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a13b0887-bd5a-49ef-b345-86e1f44d68a0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:18.097171 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a13b0887-bd5a-49ef-b345-86e1f44d68a0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:18.142561 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e5b6b25a-60c6-40a4-8f9c-093a17240875 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:18.163760 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e5b6b25a-60c6-40a4-8f9c-093a17240875 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1317 microversion: 2.1 time: 0.161666 Aug 07 01:56:18.165149 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3321/6176] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:18 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:18.417843 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a13b0887-bd5a-49ef-b345-86e1f44d68a0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:18.426294 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a13b0887-bd5a-49ef-b345-86e1f44d68a0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5" status: 200 len: 1276 microversion: 2.1 time: 0.356627 Aug 07 01:56:18.427230 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2856/6177] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:18 2022] GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5 => generated 1276 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:19.188612 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4808a108-3809-43f9-817e-01ec32a62360 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:19.189261 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4808a108-3809-43f9-817e-01ec32a62360 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:19.198054 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4808a108-3809-43f9-817e-01ec32a62360 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:19.198571 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4808a108-3809-43f9-817e-01ec32a62360 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:19.199034 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4808a108-3809-43f9-817e-01ec32a62360 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:19.199780 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4808a108-3809-43f9-817e-01ec32a62360 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:19.200296 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4808a108-3809-43f9-817e-01ec32a62360 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:19.200754 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4808a108-3809-43f9-817e-01ec32a62360 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:19.361243 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4808a108-3809-43f9-817e-01ec32a62360 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:19.374820 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4808a108-3809-43f9-817e-01ec32a62360 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1390 microversion: 2.1 time: 0.192197 Aug 07 01:56:19.375959 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3322/6178] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:19 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1390 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:19.449163 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-40bf7d2e-dbc4-4345-b6d9-c2da76d77b43 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:19.450389 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-40bf7d2e-dbc4-4345-b6d9-c2da76d77b43 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 08886847-3d66-41ea-b13d-78bec27950a5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:19.458759 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-40bf7d2e-dbc4-4345-b6d9-c2da76d77b43 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:19.459253 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-40bf7d2e-dbc4-4345-b6d9-c2da76d77b43 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:19.460062 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-40bf7d2e-dbc4-4345-b6d9-c2da76d77b43 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:19.460786 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-40bf7d2e-dbc4-4345-b6d9-c2da76d77b43 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:19.461435 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-40bf7d2e-dbc4-4345-b6d9-c2da76d77b43 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:19.461659 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-40bf7d2e-dbc4-4345-b6d9-c2da76d77b43 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:19.730565 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-40bf7d2e-dbc4-4345-b6d9-c2da76d77b43 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:19.738235 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-40bf7d2e-dbc4-4345-b6d9-c2da76d77b43 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5" status: 200 len: 1276 microversion: 2.1 time: 0.295014 Aug 07 01:56:19.738811 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2857/6179] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:19 2022] GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5 => generated 1276 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:19.853024 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-74af668b-a809-44d5-86d4-158dc8ea6b8c req-6193927e-9296-4218-8276-7dd2ddbdc3f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3830b32-dbd9-4a68-aa42-c1a65475f350", "tag": "f613fc8e-fa17-4341-89eb-ed1552b81ad5"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:56:19.866054 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-74af668b-a809-44d5-86d4-158dc8ea6b8c req-6193927e-9296-4218-8276-7dd2ddbdc3f4 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:19.867025 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-74af668b-a809-44d5-86d4-158dc8ea6b8c req-6193927e-9296-4218-8276-7dd2ddbdc3f4 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:19.867688 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-74af668b-a809-44d5-86d4-158dc8ea6b8c req-6193927e-9296-4218-8276-7dd2ddbdc3f4 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:19.890222 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-74af668b-a809-44d5-86d4-158dc8ea6b8c req-6193927e-9296-4218-8276-7dd2ddbdc3f4 service nova] Creating event network-changed:f613fc8e-fa17-4341-89eb-ed1552b81ad5 for instance f3830b32-dbd9-4a68-aa42-c1a65475f350 on n-h2-master-1 Aug 07 01:56:19.899183 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-74af668b-a809-44d5-86d4-158dc8ea6b8c req-6193927e-9296-4218-8276-7dd2ddbdc3f4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051657 Aug 07 01:56:19.900706 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3323/6180] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:56:20.397185 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ae1981c3-1a9b-441e-a769-85de3352f565 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:20.397804 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ae1981c3-1a9b-441e-a769-85de3352f565 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:20.403801 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ae1981c3-1a9b-441e-a769-85de3352f565 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:20.404402 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ae1981c3-1a9b-441e-a769-85de3352f565 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:20.405346 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ae1981c3-1a9b-441e-a769-85de3352f565 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:20.406049 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ae1981c3-1a9b-441e-a769-85de3352f565 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:20.406509 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ae1981c3-1a9b-441e-a769-85de3352f565 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:20.406947 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ae1981c3-1a9b-441e-a769-85de3352f565 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:20.536862 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ae1981c3-1a9b-441e-a769-85de3352f565 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:20.544378 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ae1981c3-1a9b-441e-a769-85de3352f565 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1390 microversion: 2.1 time: 0.151064 Aug 07 01:56:20.544942 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2858/6181] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:20 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1390 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:20.760765 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-813f9bd8-1259-4316-8ce4-3c7e9a307ae7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:20.761477 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-813f9bd8-1259-4316-8ce4-3c7e9a307ae7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 08886847-3d66-41ea-b13d-78bec27950a5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:20.769492 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-813f9bd8-1259-4316-8ce4-3c7e9a307ae7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:20.770080 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-813f9bd8-1259-4316-8ce4-3c7e9a307ae7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:20.770656 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-813f9bd8-1259-4316-8ce4-3c7e9a307ae7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:20.771914 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-813f9bd8-1259-4316-8ce4-3c7e9a307ae7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:20.772463 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-813f9bd8-1259-4316-8ce4-3c7e9a307ae7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:20.772916 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-813f9bd8-1259-4316-8ce4-3c7e9a307ae7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:20.908286 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-813f9bd8-1259-4316-8ce4-3c7e9a307ae7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:20.916134 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-813f9bd8-1259-4316-8ce4-3c7e9a307ae7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5" status: 200 len: 1264 microversion: 2.1 time: 0.160317 Aug 07 01:56:20.916734 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3324/6182] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:20 2022] GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:21.566470 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a67e7a3d-c995-4d41-8338-499faa7592b0 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:21.567005 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a67e7a3d-c995-4d41-8338-499faa7592b0 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:21.569049 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:56:21.569726 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:56:21.576568 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a67e7a3d-c995-4d41-8338-499faa7592b0 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:21.577061 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a67e7a3d-c995-4d41-8338-499faa7592b0 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:21.577497 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a67e7a3d-c995-4d41-8338-499faa7592b0 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:21.578210 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a67e7a3d-c995-4d41-8338-499faa7592b0 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:21.578665 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a67e7a3d-c995-4d41-8338-499faa7592b0 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:21.579781 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a67e7a3d-c995-4d41-8338-499faa7592b0 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:21.792940 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a67e7a3d-c995-4d41-8338-499faa7592b0 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:21.800740 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a67e7a3d-c995-4d41-8338-499faa7592b0 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1390 microversion: 2.1 time: 0.238217 Aug 07 01:56:21.801341 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2859/6183] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:21 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1390 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:21.937182 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a4f4ce78-da43-4fd8-9b43-f2c25379efd2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:21.937817 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a4f4ce78-da43-4fd8-9b43-f2c25379efd2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 08886847-3d66-41ea-b13d-78bec27950a5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:21.944549 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4f4ce78-da43-4fd8-9b43-f2c25379efd2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:21.945052 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4f4ce78-da43-4fd8-9b43-f2c25379efd2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:21.945510 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4f4ce78-da43-4fd8-9b43-f2c25379efd2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:21.946236 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4f4ce78-da43-4fd8-9b43-f2c25379efd2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:21.946714 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4f4ce78-da43-4fd8-9b43-f2c25379efd2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:21.947162 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4f4ce78-da43-4fd8-9b43-f2c25379efd2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:22.379478 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a4f4ce78-da43-4fd8-9b43-f2c25379efd2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:22.387124 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a4f4ce78-da43-4fd8-9b43-f2c25379efd2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5" status: 200 len: 1264 microversion: 2.1 time: 0.454383 Aug 07 01:56:22.388248 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3325/6184] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:21 2022] GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5 => generated 1264 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:22.822334 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c1058c30-899c-484d-a112-db80fda1c511 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:22.822951 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c1058c30-899c-484d-a112-db80fda1c511 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:22.830456 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c1058c30-899c-484d-a112-db80fda1c511 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:22.830936 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c1058c30-899c-484d-a112-db80fda1c511 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:22.831373 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c1058c30-899c-484d-a112-db80fda1c511 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:22.832098 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c1058c30-899c-484d-a112-db80fda1c511 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:22.832553 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c1058c30-899c-484d-a112-db80fda1c511 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:22.832975 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c1058c30-899c-484d-a112-db80fda1c511 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:22.967744 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c1058c30-899c-484d-a112-db80fda1c511 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:22.975614 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c1058c30-899c-484d-a112-db80fda1c511 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1390 microversion: 2.1 time: 0.157193 Aug 07 01:56:22.976220 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2860/6185] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:22 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:23.409321 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d6de4e81-77d2-4715-bdeb-afa977a3c491 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:23.409956 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d6de4e81-77d2-4715-bdeb-afa977a3c491 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 08886847-3d66-41ea-b13d-78bec27950a5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:23.416869 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6de4e81-77d2-4715-bdeb-afa977a3c491 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:23.417377 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6de4e81-77d2-4715-bdeb-afa977a3c491 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:23.417832 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6de4e81-77d2-4715-bdeb-afa977a3c491 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:23.418548 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6de4e81-77d2-4715-bdeb-afa977a3c491 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:23.419022 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6de4e81-77d2-4715-bdeb-afa977a3c491 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:23.419465 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6de4e81-77d2-4715-bdeb-afa977a3c491 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:23.552763 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d6de4e81-77d2-4715-bdeb-afa977a3c491 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:23.560397 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d6de4e81-77d2-4715-bdeb-afa977a3c491 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5" status: 200 len: 1264 microversion: 2.1 time: 0.155520 Aug 07 01:56:23.560908 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3326/6186] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:23 2022] GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:23.996703 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5c39f0bd-8280-480f-bdcc-aebfaeb39586 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:23.997328 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5c39f0bd-8280-480f-bdcc-aebfaeb39586 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:24.004862 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c39f0bd-8280-480f-bdcc-aebfaeb39586 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:24.005357 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c39f0bd-8280-480f-bdcc-aebfaeb39586 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:24.005815 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c39f0bd-8280-480f-bdcc-aebfaeb39586 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:24.006531 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c39f0bd-8280-480f-bdcc-aebfaeb39586 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:24.006993 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c39f0bd-8280-480f-bdcc-aebfaeb39586 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:24.007429 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c39f0bd-8280-480f-bdcc-aebfaeb39586 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:24.147591 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5c39f0bd-8280-480f-bdcc-aebfaeb39586 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:24.155618 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5c39f0bd-8280-480f-bdcc-aebfaeb39586 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1390 microversion: 2.1 time: 0.162758 Aug 07 01:56:24.156295 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2861/6187] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:23 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:24.581403 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1e69e44d-89f9-4131-bae0-7da940988616 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:24.582039 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1e69e44d-89f9-4131-bae0-7da940988616 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 08886847-3d66-41ea-b13d-78bec27950a5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:24.589154 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1e69e44d-89f9-4131-bae0-7da940988616 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:24.589651 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1e69e44d-89f9-4131-bae0-7da940988616 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:24.590105 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1e69e44d-89f9-4131-bae0-7da940988616 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:24.590824 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1e69e44d-89f9-4131-bae0-7da940988616 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:24.591298 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1e69e44d-89f9-4131-bae0-7da940988616 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:24.591742 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1e69e44d-89f9-4131-bae0-7da940988616 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:24.730053 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1e69e44d-89f9-4131-bae0-7da940988616 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:24.737726 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1e69e44d-89f9-4131-bae0-7da940988616 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5" status: 200 len: 1264 microversion: 2.1 time: 0.160284 Aug 07 01:56:24.738500 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3327/6188] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:24 2022] GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:25.177184 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fe0e8d5c-f705-4218-9bb2-c1de52df3aff tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:25.177915 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fe0e8d5c-f705-4218-9bb2-c1de52df3aff tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:25.185312 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fe0e8d5c-f705-4218-9bb2-c1de52df3aff tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:25.186056 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fe0e8d5c-f705-4218-9bb2-c1de52df3aff tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:25.186574 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fe0e8d5c-f705-4218-9bb2-c1de52df3aff tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:25.187363 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fe0e8d5c-f705-4218-9bb2-c1de52df3aff tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:25.187912 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fe0e8d5c-f705-4218-9bb2-c1de52df3aff tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:25.188475 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fe0e8d5c-f705-4218-9bb2-c1de52df3aff tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:25.758684 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c722590a-dfb1-481c-9d90-051abdfb2d18 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:25.759343 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c722590a-dfb1-481c-9d90-051abdfb2d18 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 08886847-3d66-41ea-b13d-78bec27950a5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:25.766912 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c722590a-dfb1-481c-9d90-051abdfb2d18 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:25.767413 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c722590a-dfb1-481c-9d90-051abdfb2d18 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:25.767859 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c722590a-dfb1-481c-9d90-051abdfb2d18 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:25.770929 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fe0e8d5c-f705-4218-9bb2-c1de52df3aff tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:25.774912 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c722590a-dfb1-481c-9d90-051abdfb2d18 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:25.775404 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c722590a-dfb1-481c-9d90-051abdfb2d18 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:25.775849 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c722590a-dfb1-481c-9d90-051abdfb2d18 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:25.778909 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fe0e8d5c-f705-4218-9bb2-c1de52df3aff tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1390 microversion: 2.1 time: 0.606682 Aug 07 01:56:25.779596 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2862/6189] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:25 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1390 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:25.915951 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c722590a-dfb1-481c-9d90-051abdfb2d18 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:25.924153 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c722590a-dfb1-481c-9d90-051abdfb2d18 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5" status: 200 len: 1264 microversion: 2.1 time: 0.169409 Aug 07 01:56:25.924732 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3328/6190] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:25 2022] GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:26.801511 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7263abb1-aff2-45be-8e82-c308a010e629 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:26.802350 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7263abb1-aff2-45be-8e82-c308a010e629 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:26.810711 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7263abb1-aff2-45be-8e82-c308a010e629 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:26.811313 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7263abb1-aff2-45be-8e82-c308a010e629 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:26.813010 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7263abb1-aff2-45be-8e82-c308a010e629 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:26.814429 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7263abb1-aff2-45be-8e82-c308a010e629 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:26.815486 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7263abb1-aff2-45be-8e82-c308a010e629 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:26.816067 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7263abb1-aff2-45be-8e82-c308a010e629 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:26.948008 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1ceec343-a498-40b1-9153-630111beded5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:26.948754 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1ceec343-a498-40b1-9153-630111beded5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 08886847-3d66-41ea-b13d-78bec27950a5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:26.951025 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:56:26.969826 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ceec343-a498-40b1-9153-630111beded5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:26.971087 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ceec343-a498-40b1-9153-630111beded5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:26.971747 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ceec343-a498-40b1-9153-630111beded5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:26.972534 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ceec343-a498-40b1-9153-630111beded5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:26.973014 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ceec343-a498-40b1-9153-630111beded5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:26.973457 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ceec343-a498-40b1-9153-630111beded5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:26.974234 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=14 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:56:27.028044 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7263abb1-aff2-45be-8e82-c308a010e629 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:27.038778 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7263abb1-aff2-45be-8e82-c308a010e629 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1390 microversion: 2.1 time: 0.242657 Aug 07 01:56:27.052775 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2863/6191] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:26 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1390 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:27.156624 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1ceec343-a498-40b1-9153-630111beded5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:27.166466 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1ceec343-a498-40b1-9153-630111beded5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5" status: 200 len: 1264 microversion: 2.1 time: 0.224288 Aug 07 01:56:27.181355 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3329/6192] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:26 2022] GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5 => generated 1264 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:56:27.887069 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-cee7df08-35be-4aee-a8ea-20d1ba78201f req-10072257-ead1-4f7d-856f-648705653f13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3830b32-dbd9-4a68-aa42-c1a65475f350", "name": "network-vif-plugged", "status": "completed", "tag": "f613fc8e-fa17-4341-89eb-ed1552b81ad5"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:56:27.898014 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-cee7df08-35be-4aee-a8ea-20d1ba78201f req-10072257-ead1-4f7d-856f-648705653f13 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:27.898425 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-cee7df08-35be-4aee-a8ea-20d1ba78201f req-10072257-ead1-4f7d-856f-648705653f13 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:27.898920 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-cee7df08-35be-4aee-a8ea-20d1ba78201f req-10072257-ead1-4f7d-856f-648705653f13 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:27.910324 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-cee7df08-35be-4aee-a8ea-20d1ba78201f req-10072257-ead1-4f7d-856f-648705653f13 service nova] Creating event network-vif-plugged:f613fc8e-fa17-4341-89eb-ed1552b81ad5 for instance f3830b32-dbd9-4a68-aa42-c1a65475f350 on n-h2-master-1 Aug 07 01:56:27.915418 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-cee7df08-35be-4aee-a8ea-20d1ba78201f req-10072257-ead1-4f7d-856f-648705653f13 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032503 Aug 07 01:56:27.916379 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2864/6193] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:56:28.063486 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a2618f45-06a4-4a1d-a84e-b0e17989d9ab tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:28.064339 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a2618f45-06a4-4a1d-a84e-b0e17989d9ab tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:28.072209 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2618f45-06a4-4a1d-a84e-b0e17989d9ab tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:28.072719 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2618f45-06a4-4a1d-a84e-b0e17989d9ab tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:28.073376 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2618f45-06a4-4a1d-a84e-b0e17989d9ab tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:28.074161 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2618f45-06a4-4a1d-a84e-b0e17989d9ab tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:28.074852 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2618f45-06a4-4a1d-a84e-b0e17989d9ab tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:28.075467 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a2618f45-06a4-4a1d-a84e-b0e17989d9ab tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:28.192846 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-11268864-2a29-4ac5-b38d-e220b77ea2c4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:28.193596 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-11268864-2a29-4ac5-b38d-e220b77ea2c4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 08886847-3d66-41ea-b13d-78bec27950a5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:28.201730 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-11268864-2a29-4ac5-b38d-e220b77ea2c4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:28.202273 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-11268864-2a29-4ac5-b38d-e220b77ea2c4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:28.202740 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-11268864-2a29-4ac5-b38d-e220b77ea2c4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:28.213809 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-11268864-2a29-4ac5-b38d-e220b77ea2c4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:28.214539 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-11268864-2a29-4ac5-b38d-e220b77ea2c4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:28.215167 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-11268864-2a29-4ac5-b38d-e220b77ea2c4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:28.225978 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a2618f45-06a4-4a1d-a84e-b0e17989d9ab tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:28.238066 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a2618f45-06a4-4a1d-a84e-b0e17989d9ab tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1390 microversion: 2.1 time: 0.178891 Aug 07 01:56:28.238906 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3330/6194] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:28 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1390 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:28.490142 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-11268864-2a29-4ac5-b38d-e220b77ea2c4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:28.504750 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-11268864-2a29-4ac5-b38d-e220b77ea2c4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5" status: 200 len: 1264 microversion: 2.1 time: 0.317628 Aug 07 01:56:28.508759 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2865/6195] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:28 2022] GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5 => generated 1264 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:29.263804 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dc62bfdf-5654-41bc-a8bc-7e3a54ff07a9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:29.264803 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-dc62bfdf-5654-41bc-a8bc-7e3a54ff07a9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:29.279516 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:56:29.284944 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc62bfdf-5654-41bc-a8bc-7e3a54ff07a9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:29.288932 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc62bfdf-5654-41bc-a8bc-7e3a54ff07a9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:29.291063 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc62bfdf-5654-41bc-a8bc-7e3a54ff07a9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:29.292615 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc62bfdf-5654-41bc-a8bc-7e3a54ff07a9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:29.295180 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc62bfdf-5654-41bc-a8bc-7e3a54ff07a9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:29.297291 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc62bfdf-5654-41bc-a8bc-7e3a54ff07a9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:29.463036 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-dc62bfdf-5654-41bc-a8bc-7e3a54ff07a9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:29.472098 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-dc62bfdf-5654-41bc-a8bc-7e3a54ff07a9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1562 microversion: 2.1 time: 0.214231 Aug 07 01:56:29.472963 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3331/6196] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:29 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1562 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:29.493821 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7851f371-0c18-45d3-b6b4-20803b2f84c7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:29.494526 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7851f371-0c18-45d3-b6b4-20803b2f84c7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:29.503462 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7851f371-0c18-45d3-b6b4-20803b2f84c7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:29.504137 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7851f371-0c18-45d3-b6b4-20803b2f84c7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:29.504797 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7851f371-0c18-45d3-b6b4-20803b2f84c7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:29.505625 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7851f371-0c18-45d3-b6b4-20803b2f84c7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:29.507292 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7851f371-0c18-45d3-b6b4-20803b2f84c7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:29.508054 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7851f371-0c18-45d3-b6b4-20803b2f84c7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:29.529679 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b7c0713d-530b-46ce-8df8-3fb961e482fa tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:29.530721 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b7c0713d-530b-46ce-8df8-3fb961e482fa tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 08886847-3d66-41ea-b13d-78bec27950a5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:29.537179 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7c0713d-530b-46ce-8df8-3fb961e482fa tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:29.538105 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7c0713d-530b-46ce-8df8-3fb961e482fa tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:29.538876 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7c0713d-530b-46ce-8df8-3fb961e482fa tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:29.539835 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7c0713d-530b-46ce-8df8-3fb961e482fa tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:29.540555 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7c0713d-530b-46ce-8df8-3fb961e482fa tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:29.541207 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7c0713d-530b-46ce-8df8-3fb961e482fa tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:29.691861 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b7c0713d-530b-46ce-8df8-3fb961e482fa tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:29.700163 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b7c0713d-530b-46ce-8df8-3fb961e482fa tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5" status: 200 len: 1264 microversion: 2.1 time: 0.174263 Aug 07 01:56:29.700759 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3332/6197] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:29 2022] GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:29.711536 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7851f371-0c18-45d3-b6b4-20803b2f84c7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:29.720191 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7851f371-0c18-45d3-b6b4-20803b2f84c7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1562 microversion: 2.1 time: 0.230566 Aug 07 01:56:29.720979 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2866/6198] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:29 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1562 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:29.894602 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-38f2bc95-18a8-45fa-ae05-de3b3655aab3 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1856886878", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "0f6c2b0a-bc50-4dfe-a0d7-4d4186294852"}], "key_name": "tempest-TestSecurityGroupsBasicOps-868039291", "security_groups": []}, "os:scheduler_hints": {"different_host": ["4d6bfe5d-cf98-4ff2-a10e-67692145944c"]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:56:29.953894 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-38f2bc95-18a8-45fa-ae05-de3b3655aab3 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] validate_networks() for [('0f6c2b0a-bc50-4dfe-a0d7-4d4186294852', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:56:29.961572 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-db879aeb-9aa2-4fa9-8fdb-5e6624bbc77c req-f287fb8d-9218-49d1-9848-634dde244bfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08886847-3d66-41ea-b13d-78bec27950a5", "name": "network-vif-plugged", "status": "completed", "tag": "65a964ed-8a1b-4b88-b972-1095976406b9"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:56:29.979014 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-db879aeb-9aa2-4fa9-8fdb-5e6624bbc77c req-f287fb8d-9218-49d1-9848-634dde244bfd service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:29.979955 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-db879aeb-9aa2-4fa9-8fdb-5e6624bbc77c req-f287fb8d-9218-49d1-9848-634dde244bfd service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:29.981458 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-db879aeb-9aa2-4fa9-8fdb-5e6624bbc77c req-f287fb8d-9218-49d1-9848-634dde244bfd service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:30.012940 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-db879aeb-9aa2-4fa9-8fdb-5e6624bbc77c req-f287fb8d-9218-49d1-9848-634dde244bfd service nova] Creating event network-vif-plugged:65a964ed-8a1b-4b88-b972-1095976406b9 for instance 08886847-3d66-41ea-b13d-78bec27950a5 on n-h1-master-1 Aug 07 01:56:30.020455 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-db879aeb-9aa2-4fa9-8fdb-5e6624bbc77c req-f287fb8d-9218-49d1-9848-634dde244bfd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063404 Aug 07 01:56:30.022743 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2867/6199] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:56:30.722271 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4da5d4a1-3a3b-4299-9dd9-2b360507ae70 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:30.722895 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4da5d4a1-3a3b-4299-9dd9-2b360507ae70 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 08886847-3d66-41ea-b13d-78bec27950a5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:30.744991 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4da5d4a1-3a3b-4299-9dd9-2b360507ae70 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:30.745513 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4da5d4a1-3a3b-4299-9dd9-2b360507ae70 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:30.745976 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4da5d4a1-3a3b-4299-9dd9-2b360507ae70 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:30.746722 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4da5d4a1-3a3b-4299-9dd9-2b360507ae70 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:30.747307 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4da5d4a1-3a3b-4299-9dd9-2b360507ae70 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:30.747740 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4da5d4a1-3a3b-4299-9dd9-2b360507ae70 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:30.830586 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-38f2bc95-18a8-45fa-ae05-de3b3655aab3 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:56:30.831868 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-38f2bc95-18a8-45fa-ae05-de3b3655aab3 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:56:30.832666 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-38f2bc95-18a8-45fa-ae05-de3b3655aab3 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:56:30.833322 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-38f2bc95-18a8-45fa-ae05-de3b3655aab3 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:56:30.833998 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-38f2bc95-18a8-45fa-ae05-de3b3655aab3 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:56:30.850116 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38f2bc95-18a8-45fa-ae05-de3b3655aab3 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:30.856355 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38f2bc95-18a8-45fa-ae05-de3b3655aab3 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:30.857074 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38f2bc95-18a8-45fa-ae05-de3b3655aab3 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:30.858156 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38f2bc95-18a8-45fa-ae05-de3b3655aab3 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:30.862760 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38f2bc95-18a8-45fa-ae05-de3b3655aab3 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:30.863589 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38f2bc95-18a8-45fa-ae05-de3b3655aab3 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:30.907844 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-38f2bc95-18a8-45fa-ae05-de3b3655aab3 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Getting quotas for project 0a860ae0e0f84931893591f9d4b7b7a1. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:56:30.914351 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-38f2bc95-18a8-45fa-ae05-de3b3655aab3 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Getting quotas for user 8e40c219d69d4769b6a957ecce6103b9 and project 0a860ae0e0f84931893591f9d4b7b7a1. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:56:30.931040 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-38f2bc95-18a8-45fa-ae05-de3b3655aab3 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:56:30.934852 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-38f2bc95-18a8-45fa-ae05-de3b3655aab3 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [instance: ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:56:31.020107 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-38f2bc95-18a8-45fa-ae05-de3b3655aab3 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.129211 Aug 07 01:56:31.023033 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3333/6200] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:56:29 2022] POST /compute/v2.1/servers => generated 361 bytes in 1133 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:56:31.041978 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-00132c67-9ccc-48ca-a341-48a6d70c7cfa tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:31.042628 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-00132c67-9ccc-48ca-a341-48a6d70c7cfa tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [instance: ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:31.169118 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-00132c67-9ccc-48ca-a341-48a6d70c7cfa tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40c219d69d4769b6a957ecce6103b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a860ae0e0f84931893591f9d4b7b7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:31.177681 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-00132c67-9ccc-48ca-a341-48a6d70c7cfa tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] 10.222.0.39 "GET /compute/v2.1/servers/ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8" status: 200 len: 1241 microversion: 2.1 time: 0.144736 Aug 07 01:56:31.177681 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3334/6201] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:31 2022] GET /compute/v2.1/servers/ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8 => generated 1241 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:31.651746 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4da5d4a1-3a3b-4299-9dd9-2b360507ae70 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:31.667822 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4da5d4a1-3a3b-4299-9dd9-2b360507ae70 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5" status: 200 len: 1264 microversion: 2.1 time: 0.949997 Aug 07 01:56:31.670226 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2868/6202] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:30 2022] GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5 => generated 1264 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:56:32.200416 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-30c99608-a8dd-4c89-b681-7d85ba67ff37 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:32.201210 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-30c99608-a8dd-4c89-b681-7d85ba67ff37 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [instance: ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:32.211039 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-30c99608-a8dd-4c89-b681-7d85ba67ff37 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:32.211991 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-30c99608-a8dd-4c89-b681-7d85ba67ff37 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:32.212705 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-30c99608-a8dd-4c89-b681-7d85ba67ff37 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:32.214280 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-30c99608-a8dd-4c89-b681-7d85ba67ff37 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:32.214889 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-30c99608-a8dd-4c89-b681-7d85ba67ff37 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:32.215566 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-30c99608-a8dd-4c89-b681-7d85ba67ff37 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:32.361069 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-30c99608-a8dd-4c89-b681-7d85ba67ff37 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40c219d69d4769b6a957ecce6103b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a860ae0e0f84931893591f9d4b7b7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:32.370103 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-30c99608-a8dd-4c89-b681-7d85ba67ff37 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] 10.222.0.39 "GET /compute/v2.1/servers/ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8" status: 200 len: 1293 microversion: 2.1 time: 0.175437 Aug 07 01:56:32.370939 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3335/6203] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:32 2022] GET /compute/v2.1/servers/ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8 => generated 1293 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:32.693614 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8cbea575-9b3b-4e3b-b8d8-1a9434a1592b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:32.694439 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8cbea575-9b3b-4e3b-b8d8-1a9434a1592b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 08886847-3d66-41ea-b13d-78bec27950a5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:32.713171 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8cbea575-9b3b-4e3b-b8d8-1a9434a1592b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:32.714034 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8cbea575-9b3b-4e3b-b8d8-1a9434a1592b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:32.714820 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8cbea575-9b3b-4e3b-b8d8-1a9434a1592b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:32.715741 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8cbea575-9b3b-4e3b-b8d8-1a9434a1592b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:32.716943 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8cbea575-9b3b-4e3b-b8d8-1a9434a1592b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:32.717637 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8cbea575-9b3b-4e3b-b8d8-1a9434a1592b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:32.747691 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6146deb1-6722-4e30-9875-80f9ac5664fd tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:32.748388 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6146deb1-6722-4e30-9875-80f9ac5664fd tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:32.759456 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6146deb1-6722-4e30-9875-80f9ac5664fd tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:32.760023 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6146deb1-6722-4e30-9875-80f9ac5664fd tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:32.760492 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6146deb1-6722-4e30-9875-80f9ac5664fd tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:32.761239 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6146deb1-6722-4e30-9875-80f9ac5664fd tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:32.761720 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6146deb1-6722-4e30-9875-80f9ac5664fd tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:32.762171 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6146deb1-6722-4e30-9875-80f9ac5664fd tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:32.929424 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8cbea575-9b3b-4e3b-b8d8-1a9434a1592b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:32.939050 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8cbea575-9b3b-4e3b-b8d8-1a9434a1592b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5" status: 200 len: 1451 microversion: 2.1 time: 0.249429 Aug 07 01:56:32.940002 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2869/6204] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:32 2022] GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5 => generated 1451 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:33.000368 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6146deb1-6722-4e30-9875-80f9ac5664fd tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:33.009620 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6146deb1-6722-4e30-9875-80f9ac5664fd tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1562 microversion: 2.1 time: 0.266010 Aug 07 01:56:33.010706 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3336/6205] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:32 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1562 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:33.016594 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7704eb7a-264e-41dd-b0e7-9ad65a23ed2c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:33.017572 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7704eb7a-264e-41dd-b0e7-9ad65a23ed2c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 08886847-3d66-41ea-b13d-78bec27950a5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:33.025979 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7704eb7a-264e-41dd-b0e7-9ad65a23ed2c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:33.026724 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7704eb7a-264e-41dd-b0e7-9ad65a23ed2c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:33.027349 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7704eb7a-264e-41dd-b0e7-9ad65a23ed2c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:33.028306 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7704eb7a-264e-41dd-b0e7-9ad65a23ed2c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:33.028951 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7704eb7a-264e-41dd-b0e7-9ad65a23ed2c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:33.029618 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7704eb7a-264e-41dd-b0e7-9ad65a23ed2c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:33.066759 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-dbbb247f-d58f-4376-8c8c-d5607637ac95 req-652e63f5-fc88-471f-b4ea-8461cc97a5c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3830b32-dbd9-4a68-aa42-c1a65475f350", "tag": "f613fc8e-fa17-4341-89eb-ed1552b81ad5"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:56:33.083792 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-dbbb247f-d58f-4376-8c8c-d5607637ac95 req-652e63f5-fc88-471f-b4ea-8461cc97a5c1 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:33.086815 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-dbbb247f-d58f-4376-8c8c-d5607637ac95 req-652e63f5-fc88-471f-b4ea-8461cc97a5c1 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:33.087271 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-dbbb247f-d58f-4376-8c8c-d5607637ac95 req-652e63f5-fc88-471f-b4ea-8461cc97a5c1 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:33.117580 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-dbbb247f-d58f-4376-8c8c-d5607637ac95 req-652e63f5-fc88-471f-b4ea-8461cc97a5c1 service nova] Creating event network-changed:f613fc8e-fa17-4341-89eb-ed1552b81ad5 for instance f3830b32-dbd9-4a68-aa42-c1a65475f350 on n-h2-master-1 Aug 07 01:56:33.129795 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-dbbb247f-d58f-4376-8c8c-d5607637ac95 req-652e63f5-fc88-471f-b4ea-8461cc97a5c1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188516 Aug 07 01:56:33.130684 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2870/6206] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:56:33.265681 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7704eb7a-264e-41dd-b0e7-9ad65a23ed2c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:33.273418 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7704eb7a-264e-41dd-b0e7-9ad65a23ed2c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5" status: 200 len: 1451 microversion: 2.1 time: 0.261291 Aug 07 01:56:33.274208 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3337/6207] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:33 2022] GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5 => generated 1451 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:33.396644 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d0f1d5c7-bbc1-4015-8e5f-04fbc4c19d1d tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:33.397335 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d0f1d5c7-bbc1-4015-8e5f-04fbc4c19d1d tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [instance: ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:33.412212 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d0f1d5c7-bbc1-4015-8e5f-04fbc4c19d1d tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:33.413133 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d0f1d5c7-bbc1-4015-8e5f-04fbc4c19d1d tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:33.413837 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d0f1d5c7-bbc1-4015-8e5f-04fbc4c19d1d tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:33.414995 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d0f1d5c7-bbc1-4015-8e5f-04fbc4c19d1d tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:33.415715 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d0f1d5c7-bbc1-4015-8e5f-04fbc4c19d1d tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:33.416437 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d0f1d5c7-bbc1-4015-8e5f-04fbc4c19d1d tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:33.435509 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:56:33.606459 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d0f1d5c7-bbc1-4015-8e5f-04fbc4c19d1d tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40c219d69d4769b6a957ecce6103b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a860ae0e0f84931893591f9d4b7b7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:33.618177 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d0f1d5c7-bbc1-4015-8e5f-04fbc4c19d1d tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] 10.222.0.39 "GET /compute/v2.1/servers/ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8" status: 200 len: 1299 microversion: 2.1 time: 0.226081 Aug 07 01:56:33.643775 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2871/6208] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:33 2022] GET /compute/v2.1/servers/ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8 => generated 1299 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:34.640319 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-490f8b2c-6951-4f37-94c4-256c5ceeb749 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:34.640955 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-490f8b2c-6951-4f37-94c4-256c5ceeb749 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [instance: ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:34.648061 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-490f8b2c-6951-4f37-94c4-256c5ceeb749 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:34.648643 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-490f8b2c-6951-4f37-94c4-256c5ceeb749 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:34.649167 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-490f8b2c-6951-4f37-94c4-256c5ceeb749 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:34.650056 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-490f8b2c-6951-4f37-94c4-256c5ceeb749 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:34.651534 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-490f8b2c-6951-4f37-94c4-256c5ceeb749 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:34.652820 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-490f8b2c-6951-4f37-94c4-256c5ceeb749 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:34.672918 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=100 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:56:34.817049 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-490f8b2c-6951-4f37-94c4-256c5ceeb749 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40c219d69d4769b6a957ecce6103b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a860ae0e0f84931893591f9d4b7b7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:34.824799 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-490f8b2c-6951-4f37-94c4-256c5ceeb749 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] 10.222.0.39 "GET /compute/v2.1/servers/ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8" status: 200 len: 1299 microversion: 2.1 time: 0.188491 Aug 07 01:56:34.825401 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3338/6209] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:34 2022] GET /compute/v2.1/servers/ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8 => generated 1299 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:35.305390 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-8b603789-ab72-4d1b-b4f2-1b3b6d3e0f61 req-b75cd071-915c-4efd-8d0f-936e627077aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8", "tag": "6a4ee3c2-cce9-43ae-baac-8724a88a7331"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:56:35.316011 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-8b603789-ab72-4d1b-b4f2-1b3b6d3e0f61 req-b75cd071-915c-4efd-8d0f-936e627077aa service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:35.316460 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-8b603789-ab72-4d1b-b4f2-1b3b6d3e0f61 req-b75cd071-915c-4efd-8d0f-936e627077aa service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:35.316890 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-8b603789-ab72-4d1b-b4f2-1b3b6d3e0f61 req-b75cd071-915c-4efd-8d0f-936e627077aa service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:35.330709 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-8b603789-ab72-4d1b-b4f2-1b3b6d3e0f61 req-b75cd071-915c-4efd-8d0f-936e627077aa service nova] Creating event network-changed:6a4ee3c2-cce9-43ae-baac-8724a88a7331 for instance ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8 on n-h1-master-1 Aug 07 01:56:35.336944 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-8b603789-ab72-4d1b-b4f2-1b3b6d3e0f61 req-b75cd071-915c-4efd-8d0f-936e627077aa service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119343 Aug 07 01:56:35.337564 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2872/6210] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:56:35.845871 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fac56661-b005-4ee0-bf8d-ebab74f26bce tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:35.846509 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fac56661-b005-4ee0-bf8d-ebab74f26bce tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [instance: ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:35.853117 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fac56661-b005-4ee0-bf8d-ebab74f26bce tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:35.853622 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fac56661-b005-4ee0-bf8d-ebab74f26bce tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:35.854077 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fac56661-b005-4ee0-bf8d-ebab74f26bce tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:35.854800 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fac56661-b005-4ee0-bf8d-ebab74f26bce tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:35.855272 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fac56661-b005-4ee0-bf8d-ebab74f26bce tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:35.855717 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fac56661-b005-4ee0-bf8d-ebab74f26bce tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:36.032587 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fac56661-b005-4ee0-bf8d-ebab74f26bce tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40c219d69d4769b6a957ecce6103b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a860ae0e0f84931893591f9d4b7b7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:36.040352 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fac56661-b005-4ee0-bf8d-ebab74f26bce tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] 10.222.0.39 "GET /compute/v2.1/servers/ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8" status: 200 len: 1299 microversion: 2.1 time: 0.198584 Aug 07 01:56:36.041339 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3339/6211] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:35 2022] GET /compute/v2.1/servers/ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8 => generated 1299 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:37.064189 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9ff8ad56-672e-4179-8aaf-26958e9dbb8a tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:37.064945 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9ff8ad56-672e-4179-8aaf-26958e9dbb8a tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [instance: ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:37.072889 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ff8ad56-672e-4179-8aaf-26958e9dbb8a tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:37.073409 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ff8ad56-672e-4179-8aaf-26958e9dbb8a tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:37.073874 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ff8ad56-672e-4179-8aaf-26958e9dbb8a tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:37.074596 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ff8ad56-672e-4179-8aaf-26958e9dbb8a tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:37.075054 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ff8ad56-672e-4179-8aaf-26958e9dbb8a tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:37.075507 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ff8ad56-672e-4179-8aaf-26958e9dbb8a tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:37.162899 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9ff8ad56-672e-4179-8aaf-26958e9dbb8a tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40c219d69d4769b6a957ecce6103b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a860ae0e0f84931893591f9d4b7b7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:37.170863 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9ff8ad56-672e-4179-8aaf-26958e9dbb8a tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] 10.222.0.39 "GET /compute/v2.1/servers/ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8" status: 200 len: 1299 microversion: 2.1 time: 0.111742 Aug 07 01:56:37.171477 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2873/6212] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:37 2022] GET /compute/v2.1/servers/ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8 => generated 1299 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:37.595481 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-c740b36c-f293-4505-9db4-d513657a53f5 req-9e51f2ef-fa2a-4ce4-8c05-dbd0671d999a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08886847-3d66-41ea-b13d-78bec27950a5", "tag": "65a964ed-8a1b-4b88-b972-1095976406b9"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:56:37.606168 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c740b36c-f293-4505-9db4-d513657a53f5 req-9e51f2ef-fa2a-4ce4-8c05-dbd0671d999a service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:37.606655 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c740b36c-f293-4505-9db4-d513657a53f5 req-9e51f2ef-fa2a-4ce4-8c05-dbd0671d999a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:37.607102 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c740b36c-f293-4505-9db4-d513657a53f5 req-9e51f2ef-fa2a-4ce4-8c05-dbd0671d999a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:37.620214 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-c740b36c-f293-4505-9db4-d513657a53f5 req-9e51f2ef-fa2a-4ce4-8c05-dbd0671d999a service nova] Creating event network-changed:65a964ed-8a1b-4b88-b972-1095976406b9 for instance 08886847-3d66-41ea-b13d-78bec27950a5 on n-h1-master-1 Aug 07 01:56:37.625881 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-c740b36c-f293-4505-9db4-d513657a53f5 req-9e51f2ef-fa2a-4ce4-8c05-dbd0671d999a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034699 Aug 07 01:56:37.626507 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3340/6213] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:56:38.192013 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cf0a0d11-5040-4071-b6d9-15f110660456 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:38.192640 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-cf0a0d11-5040-4071-b6d9-15f110660456 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [instance: ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:38.195409 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:56:38.200752 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cf0a0d11-5040-4071-b6d9-15f110660456 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:38.201184 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cf0a0d11-5040-4071-b6d9-15f110660456 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:38.202153 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cf0a0d11-5040-4071-b6d9-15f110660456 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:38.202870 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cf0a0d11-5040-4071-b6d9-15f110660456 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:38.203336 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cf0a0d11-5040-4071-b6d9-15f110660456 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:38.203772 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cf0a0d11-5040-4071-b6d9-15f110660456 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:38.288430 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-cf0a0d11-5040-4071-b6d9-15f110660456 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40c219d69d4769b6a957ecce6103b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a860ae0e0f84931893591f9d4b7b7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:38.296099 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cf0a0d11-5040-4071-b6d9-15f110660456 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] 10.222.0.39 "GET /compute/v2.1/servers/ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8" status: 200 len: 1299 microversion: 2.1 time: 0.107926 Aug 07 01:56:38.296674 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2874/6214] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:38 2022] GET /compute/v2.1/servers/ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8 => generated 1299 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:39.317737 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fd19fd66-96ac-494b-9e8a-df36c95b8fcb tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:39.318451 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fd19fd66-96ac-494b-9e8a-df36c95b8fcb tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [instance: ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:39.324669 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd19fd66-96ac-494b-9e8a-df36c95b8fcb tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:39.325171 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd19fd66-96ac-494b-9e8a-df36c95b8fcb tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:39.325622 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd19fd66-96ac-494b-9e8a-df36c95b8fcb tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:39.326350 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd19fd66-96ac-494b-9e8a-df36c95b8fcb tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:39.326852 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd19fd66-96ac-494b-9e8a-df36c95b8fcb tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:39.327293 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fd19fd66-96ac-494b-9e8a-df36c95b8fcb tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:39.413822 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fd19fd66-96ac-494b-9e8a-df36c95b8fcb tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40c219d69d4769b6a957ecce6103b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a860ae0e0f84931893591f9d4b7b7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:39.421449 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fd19fd66-96ac-494b-9e8a-df36c95b8fcb tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] 10.222.0.39 "GET /compute/v2.1/servers/ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8" status: 200 len: 1299 microversion: 2.1 time: 0.108907 Aug 07 01:56:39.422013 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3341/6215] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:39 2022] GET /compute/v2.1/servers/ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8 => generated 1299 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:40.443148 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1b9de9f0-c99c-4366-991a-37ecc540b2ac tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:40.443771 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1b9de9f0-c99c-4366-991a-37ecc540b2ac tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [instance: ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:40.450801 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b9de9f0-c99c-4366-991a-37ecc540b2ac tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:40.451286 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b9de9f0-c99c-4366-991a-37ecc540b2ac tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:40.451728 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b9de9f0-c99c-4366-991a-37ecc540b2ac tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:40.452457 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b9de9f0-c99c-4366-991a-37ecc540b2ac tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:40.452916 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b9de9f0-c99c-4366-991a-37ecc540b2ac tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:40.453376 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1b9de9f0-c99c-4366-991a-37ecc540b2ac tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:40.539569 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1b9de9f0-c99c-4366-991a-37ecc540b2ac tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40c219d69d4769b6a957ecce6103b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a860ae0e0f84931893591f9d4b7b7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:40.547652 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1b9de9f0-c99c-4366-991a-37ecc540b2ac tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] 10.222.0.39 "GET /compute/v2.1/servers/ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8" status: 200 len: 1299 microversion: 2.1 time: 0.108598 Aug 07 01:56:40.548268 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2875/6216] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:40 2022] GET /compute/v2.1/servers/ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8 => generated 1299 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:41.287500 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-7601eef2-df52-47c7-988c-30dfefc5504e req-7f65b275-d338-4964-914e-106188ba83d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8", "name": "network-vif-plugged", "status": "completed", "tag": "6a4ee3c2-cce9-43ae-baac-8724a88a7331"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:56:41.294398 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:56:41.295927 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=8 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:56:41.300160 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-7601eef2-df52-47c7-988c-30dfefc5504e req-7f65b275-d338-4964-914e-106188ba83d3 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:41.300707 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-7601eef2-df52-47c7-988c-30dfefc5504e req-7f65b275-d338-4964-914e-106188ba83d3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:41.301164 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-7601eef2-df52-47c7-988c-30dfefc5504e req-7f65b275-d338-4964-914e-106188ba83d3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:41.313404 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-7601eef2-df52-47c7-988c-30dfefc5504e req-7f65b275-d338-4964-914e-106188ba83d3 service nova] Creating event network-vif-plugged:6a4ee3c2-cce9-43ae-baac-8724a88a7331 for instance ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8 on n-h1-master-1 Aug 07 01:56:41.318157 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-7601eef2-df52-47c7-988c-30dfefc5504e req-7f65b275-d338-4964-914e-106188ba83d3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034355 Aug 07 01:56:41.318924 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3342/6217] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:56:41.569353 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-948438ee-bc12-4837-bba7-748d768aa577 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:41.569922 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-948438ee-bc12-4837-bba7-748d768aa577 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [instance: ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:41.577674 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-948438ee-bc12-4837-bba7-748d768aa577 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:41.578161 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-948438ee-bc12-4837-bba7-748d768aa577 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:41.578609 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-948438ee-bc12-4837-bba7-748d768aa577 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:41.579318 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-948438ee-bc12-4837-bba7-748d768aa577 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:41.579804 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-948438ee-bc12-4837-bba7-748d768aa577 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:41.580259 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-948438ee-bc12-4837-bba7-748d768aa577 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:41.665892 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-948438ee-bc12-4837-bba7-748d768aa577 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40c219d69d4769b6a957ecce6103b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a860ae0e0f84931893591f9d4b7b7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:41.674634 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-948438ee-bc12-4837-bba7-748d768aa577 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] 10.222.0.39 "GET /compute/v2.1/servers/ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8" status: 200 len: 1299 microversion: 2.1 time: 0.109683 Aug 07 01:56:41.675247 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2876/6218] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:41 2022] GET /compute/v2.1/servers/ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8 => generated 1299 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:42.697855 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6d2babb4-274f-411d-a0b1-54701c8b82b3 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:42.698570 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6d2babb4-274f-411d-a0b1-54701c8b82b3 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [instance: ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:42.705938 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6d2babb4-274f-411d-a0b1-54701c8b82b3 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:42.706451 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6d2babb4-274f-411d-a0b1-54701c8b82b3 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:42.706910 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6d2babb4-274f-411d-a0b1-54701c8b82b3 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:42.707627 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6d2babb4-274f-411d-a0b1-54701c8b82b3 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:42.708124 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6d2babb4-274f-411d-a0b1-54701c8b82b3 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:42.708571 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6d2babb4-274f-411d-a0b1-54701c8b82b3 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:42.803421 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6d2babb4-274f-411d-a0b1-54701c8b82b3 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40c219d69d4769b6a957ecce6103b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a860ae0e0f84931893591f9d4b7b7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:42.812800 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6d2babb4-274f-411d-a0b1-54701c8b82b3 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] 10.222.0.39 "GET /compute/v2.1/servers/ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8" status: 200 len: 1472 microversion: 2.1 time: 0.119234 Aug 07 01:56:42.813406 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3343/6219] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:42 2022] GET /compute/v2.1/servers/ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8 => generated 1472 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:42.835417 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-294ab54c-c383-46cb-97f0-6c4444b6973c tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:42.836119 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-294ab54c-c383-46cb-97f0-6c4444b6973c tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [instance: ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:42.843071 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-294ab54c-c383-46cb-97f0-6c4444b6973c tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:42.843564 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-294ab54c-c383-46cb-97f0-6c4444b6973c tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:42.844037 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-294ab54c-c383-46cb-97f0-6c4444b6973c tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:42.844777 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-294ab54c-c383-46cb-97f0-6c4444b6973c tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:42.845232 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-294ab54c-c383-46cb-97f0-6c4444b6973c tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:42.845662 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-294ab54c-c383-46cb-97f0-6c4444b6973c tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:42.929337 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-294ab54c-c383-46cb-97f0-6c4444b6973c tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40c219d69d4769b6a957ecce6103b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a860ae0e0f84931893591f9d4b7b7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:42.938579 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-294ab54c-c383-46cb-97f0-6c4444b6973c tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] 10.222.0.39 "GET /compute/v2.1/servers/ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8" status: 200 len: 1472 microversion: 2.1 time: 0.107010 Aug 07 01:56:42.939132 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2877/6220] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:42 2022] GET /compute/v2.1/servers/ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8 => generated 1472 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:42.960645 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e53bcd16-7372-4c7c-827f-b4057ae4ef03 tempest-TestSecurityGroupsBasicOps-464022980 tempest-TestSecurityGroupsBasicOps-464022980-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:42.961360 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e53bcd16-7372-4c7c-827f-b4057ae4ef03 tempest-TestSecurityGroupsBasicOps-464022980 tempest-TestSecurityGroupsBasicOps-464022980-project-admin] [instance: ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:42.968982 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e53bcd16-7372-4c7c-827f-b4057ae4ef03 tempest-TestSecurityGroupsBasicOps-464022980 tempest-TestSecurityGroupsBasicOps-464022980-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:42.969617 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e53bcd16-7372-4c7c-827f-b4057ae4ef03 tempest-TestSecurityGroupsBasicOps-464022980 tempest-TestSecurityGroupsBasicOps-464022980-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:42.970085 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e53bcd16-7372-4c7c-827f-b4057ae4ef03 tempest-TestSecurityGroupsBasicOps-464022980 tempest-TestSecurityGroupsBasicOps-464022980-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:42.970874 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e53bcd16-7372-4c7c-827f-b4057ae4ef03 tempest-TestSecurityGroupsBasicOps-464022980 tempest-TestSecurityGroupsBasicOps-464022980-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:42.971419 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e53bcd16-7372-4c7c-827f-b4057ae4ef03 tempest-TestSecurityGroupsBasicOps-464022980 tempest-TestSecurityGroupsBasicOps-464022980-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:42.971940 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e53bcd16-7372-4c7c-827f-b4057ae4ef03 tempest-TestSecurityGroupsBasicOps-464022980 tempest-TestSecurityGroupsBasicOps-464022980-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:43.058580 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e53bcd16-7372-4c7c-827f-b4057ae4ef03 tempest-TestSecurityGroupsBasicOps-464022980 tempest-TestSecurityGroupsBasicOps-464022980-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8" status: 200 len: 1623 microversion: 2.1 time: 0.102447 Aug 07 01:56:43.059156 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3344/6221] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:42 2022] GET /compute/v2.1/servers/ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8 => generated 1623 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:43.079899 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c46b283c-273b-4c90-a964-7ac6ddd58003 tempest-TestSecurityGroupsBasicOps-464022980 tempest-TestSecurityGroupsBasicOps-464022980-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:43.080533 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c46b283c-273b-4c90-a964-7ac6ddd58003 tempest-TestSecurityGroupsBasicOps-464022980 tempest-TestSecurityGroupsBasicOps-464022980-project-admin] [instance: 4d6bfe5d-cf98-4ff2-a10e-67692145944c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:43.087052 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c46b283c-273b-4c90-a964-7ac6ddd58003 tempest-TestSecurityGroupsBasicOps-464022980 tempest-TestSecurityGroupsBasicOps-464022980-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:43.087638 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c46b283c-273b-4c90-a964-7ac6ddd58003 tempest-TestSecurityGroupsBasicOps-464022980 tempest-TestSecurityGroupsBasicOps-464022980-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:43.088092 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c46b283c-273b-4c90-a964-7ac6ddd58003 tempest-TestSecurityGroupsBasicOps-464022980 tempest-TestSecurityGroupsBasicOps-464022980-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:43.088877 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c46b283c-273b-4c90-a964-7ac6ddd58003 tempest-TestSecurityGroupsBasicOps-464022980 tempest-TestSecurityGroupsBasicOps-464022980-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:43.089394 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c46b283c-273b-4c90-a964-7ac6ddd58003 tempest-TestSecurityGroupsBasicOps-464022980 tempest-TestSecurityGroupsBasicOps-464022980-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:43.089848 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c46b283c-273b-4c90-a964-7ac6ddd58003 tempest-TestSecurityGroupsBasicOps-464022980 tempest-TestSecurityGroupsBasicOps-464022980-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:43.241225 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c46b283c-273b-4c90-a964-7ac6ddd58003 tempest-TestSecurityGroupsBasicOps-464022980 tempest-TestSecurityGroupsBasicOps-464022980-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/4d6bfe5d-cf98-4ff2-a10e-67692145944c" status: 200 len: 1911 microversion: 2.1 time: 0.165361 Aug 07 01:56:43.241923 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2878/6222] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:43 2022] GET /compute/v2.1/servers/4d6bfe5d-cf98-4ff2-a10e-67692145944c => generated 1911 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:43.313061 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a89516fd-3b26-4168-b9b2-5b4a0f4bc910 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:43.313604 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a89516fd-3b26-4168-b9b2-5b4a0f4bc910 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [instance: ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:43.320445 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a89516fd-3b26-4168-b9b2-5b4a0f4bc910 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:43.321064 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a89516fd-3b26-4168-b9b2-5b4a0f4bc910 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:43.321519 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a89516fd-3b26-4168-b9b2-5b4a0f4bc910 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:43.322404 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a89516fd-3b26-4168-b9b2-5b4a0f4bc910 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:43.322920 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a89516fd-3b26-4168-b9b2-5b4a0f4bc910 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:43.323364 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a89516fd-3b26-4168-b9b2-5b4a0f4bc910 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:43.353103 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a89516fd-3b26-4168-b9b2-5b4a0f4bc910 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [instance: ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:56:43.440302 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a89516fd-3b26-4168-b9b2-5b4a0f4bc910 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8" status: 204 len: 0 microversion: 2.1 time: 0.131985 Aug 07 01:56:43.441354 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3345/6223] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:56:43 2022] DELETE /compute/v2.1/servers/ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:56:43.450400 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9bf3db61-76db-48ea-8c35-5b2eca983da5 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:43.451181 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9bf3db61-76db-48ea-8c35-5b2eca983da5 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [instance: ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:43.457413 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9bf3db61-76db-48ea-8c35-5b2eca983da5 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:43.457926 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9bf3db61-76db-48ea-8c35-5b2eca983da5 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:43.458347 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9bf3db61-76db-48ea-8c35-5b2eca983da5 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:43.459060 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9bf3db61-76db-48ea-8c35-5b2eca983da5 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:43.459987 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9bf3db61-76db-48ea-8c35-5b2eca983da5 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:43.459987 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9bf3db61-76db-48ea-8c35-5b2eca983da5 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:43.550420 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9bf3db61-76db-48ea-8c35-5b2eca983da5 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40c219d69d4769b6a957ecce6103b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a860ae0e0f84931893591f9d4b7b7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:43.558136 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9bf3db61-76db-48ea-8c35-5b2eca983da5 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] 10.222.0.39 "GET /compute/v2.1/servers/ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8" status: 200 len: 1478 microversion: 2.1 time: 0.112104 Aug 07 01:56:43.558707 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2879/6224] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:43 2022] GET /compute/v2.1/servers/ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8 => generated 1478 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:44.580330 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0c814aa7-6353-40dd-a0f9-60c7450526ef tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:44.581052 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0c814aa7-6353-40dd-a0f9-60c7450526ef tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [instance: ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:44.587877 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c814aa7-6353-40dd-a0f9-60c7450526ef tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:44.588406 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c814aa7-6353-40dd-a0f9-60c7450526ef tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:44.588855 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c814aa7-6353-40dd-a0f9-60c7450526ef tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:44.589569 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c814aa7-6353-40dd-a0f9-60c7450526ef tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:44.590043 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c814aa7-6353-40dd-a0f9-60c7450526ef tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:44.590482 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c814aa7-6353-40dd-a0f9-60c7450526ef tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:44.677221 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0c814aa7-6353-40dd-a0f9-60c7450526ef tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40c219d69d4769b6a957ecce6103b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a860ae0e0f84931893591f9d4b7b7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:44.685602 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0c814aa7-6353-40dd-a0f9-60c7450526ef tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] 10.222.0.39 "GET /compute/v2.1/servers/ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8" status: 200 len: 1478 microversion: 2.1 time: 0.110200 Aug 07 01:56:44.686273 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3346/6225] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:44 2022] GET /compute/v2.1/servers/ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8 => generated 1478 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:45.440036 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-004732e3-70d0-4b25-bd1c-213ed89eeea7 req-bdeca0f7-4d47-4f61-ba9c-85e604fbe106 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8", "name": "network-vif-deleted", "tag": "6a4ee3c2-cce9-43ae-baac-8724a88a7331"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:56:45.453002 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-004732e3-70d0-4b25-bd1c-213ed89eeea7 req-bdeca0f7-4d47-4f61-ba9c-85e604fbe106 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:45.453495 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-004732e3-70d0-4b25-bd1c-213ed89eeea7 req-bdeca0f7-4d47-4f61-ba9c-85e604fbe106 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:45.453934 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-004732e3-70d0-4b25-bd1c-213ed89eeea7 req-bdeca0f7-4d47-4f61-ba9c-85e604fbe106 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:45.466083 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-004732e3-70d0-4b25-bd1c-213ed89eeea7 req-bdeca0f7-4d47-4f61-ba9c-85e604fbe106 service nova] Creating event network-vif-deleted:6a4ee3c2-cce9-43ae-baac-8724a88a7331 for instance ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8 on n-h1-master-1 Aug 07 01:56:45.471387 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-004732e3-70d0-4b25-bd1c-213ed89eeea7 req-bdeca0f7-4d47-4f61-ba9c-85e604fbe106 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035726 Aug 07 01:56:45.472019 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2880/6226] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:56:45.707597 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-45f890f9-d3e3-4245-86f3-918848e71f16 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:45.708195 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-45f890f9-d3e3-4245-86f3-918848e71f16 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [instance: ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:45.714679 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-45f890f9-d3e3-4245-86f3-918848e71f16 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:45.715158 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-45f890f9-d3e3-4245-86f3-918848e71f16 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:45.715612 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-45f890f9-d3e3-4245-86f3-918848e71f16 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:45.716366 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-45f890f9-d3e3-4245-86f3-918848e71f16 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:45.716838 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-45f890f9-d3e3-4245-86f3-918848e71f16 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:45.717282 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-45f890f9-d3e3-4245-86f3-918848e71f16 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:45.749569 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-45f890f9-d3e3-4245-86f3-918848e71f16 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:45.750069 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-45f890f9-d3e3-4245-86f3-918848e71f16 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:45.750523 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-45f890f9-d3e3-4245-86f3-918848e71f16 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:45.750999 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-45f890f9-d3e3-4245-86f3-918848e71f16 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lazy-loading 'fault' on Instance uuid ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:56:45.797863 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-45f890f9-d3e3-4245-86f3-918848e71f16 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40c219d69d4769b6a957ecce6103b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a860ae0e0f84931893591f9d4b7b7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:45.805551 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-45f890f9-d3e3-4245-86f3-918848e71f16 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] 10.222.0.39 "GET /compute/v2.1/servers/ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8" status: 200 len: 1331 microversion: 2.1 time: 0.102123 Aug 07 01:56:45.806111 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3347/6227] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:45 2022] GET /compute/v2.1/servers/ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8 => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:46.828667 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a5a0372d-4596-4939-b34f-d45a7693b1ce tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:46.829371 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a5a0372d-4596-4939-b34f-d45a7693b1ce tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [instance: ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:46.835646 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a5a0372d-4596-4939-b34f-d45a7693b1ce tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:46.836172 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a5a0372d-4596-4939-b34f-d45a7693b1ce tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:46.836610 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a5a0372d-4596-4939-b34f-d45a7693b1ce tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:46.837309 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a5a0372d-4596-4939-b34f-d45a7693b1ce tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:46.837765 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a5a0372d-4596-4939-b34f-d45a7693b1ce tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:46.838194 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a5a0372d-4596-4939-b34f-d45a7693b1ce tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:46.851450 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-a5a0372d-4596-4939-b34f-d45a7693b1ce tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] HTTP exception thrown: Instance ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8 could not be found. Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a5a0372d-4596-4939-b34f-d45a7693b1ce tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Request method failure captured: Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8 HTTP/1.1 Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xuP0VXaU1IT4bYNMNCFd1byeu3dqzNeJMAz6bThuXAxGGUX4stq5vuIyWx7jsBsKvqdViC8c3mHQAkMCV2EvkaL5h76Vyn0lUXsIiTLbV41RvWq8mKLN9YHVDXofRA68lQadSPqScTHXeqlN02gk-c2Le68M-hUf3AuXLvlgQ9xwDA Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 0a860ae0e0f84931893591f9d4b7b7a1 Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-453965901 Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0a860ae0e0f84931893591f9d4b7b7a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0a860ae0e0f84931893591f9d4b7b7a1", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0a860ae0e0f84931893591f9d4b7b7a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0a860ae0e0f84931893591f9d4b7b7a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-TestSecurityGroupsBasicOps-453965901 Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 0a860ae0e0f84931893591f9d4b7b7a1 Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-453965901 Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-TestSecurityGroupsBasicOps-453965901-project Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 8e40c219d69d4769b6a957ecce6103b9 Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-TestSecurityGroupsBasicOps-453965901-project Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: exception: Instance ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8 could not be found. Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8'} Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8 could not be found. Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8 could not be found. Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:56:46.853098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:56:46.859479 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:56:46.859479 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:56:46.859479 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:56:46.859479 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:56:46.859479 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:56:46.859479 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8 could not be found. Aug 07 01:56:46.859479 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:56:46.859479 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a5a0372d-4596-4939-b34f-d45a7693b1ce tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Returning 404 to user: Instance ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:56:46.859479 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a5a0372d-4596-4939-b34f-d45a7693b1ce tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] 10.222.0.39 "GET /compute/v2.1/servers/ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8" status: 404 len: 111 microversion: 2.1 time: 0.031623 Aug 07 01:56:46.859479 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2881/6228] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:46 2022] GET /compute/v2.1/servers/ae9a8d77-cfe3-48f9-a723-4c2fc7b913a8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:56:50.630434 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2bbeef14-dec4-4bc5-b04d-1f04a6cad343 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:50.631072 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2bbeef14-dec4-4bc5-b04d-1f04a6cad343 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [instance: 4d6bfe5d-cf98-4ff2-a10e-67692145944c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:50.633319 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-3e53f10e-1dde-4f48-811b-b6522e651456 req-97364525-f3be-42ff-a66b-34b2db5c2854 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d6bfe5d-cf98-4ff2-a10e-67692145944c", "tag": "2ae6c402-8443-4c74-95ed-6cc326a4b91d"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:56:50.638510 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2bbeef14-dec4-4bc5-b04d-1f04a6cad343 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:50.639032 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2bbeef14-dec4-4bc5-b04d-1f04a6cad343 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:50.640018 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2bbeef14-dec4-4bc5-b04d-1f04a6cad343 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:50.640769 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2bbeef14-dec4-4bc5-b04d-1f04a6cad343 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:50.641245 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2bbeef14-dec4-4bc5-b04d-1f04a6cad343 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:50.641955 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2bbeef14-dec4-4bc5-b04d-1f04a6cad343 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:50.645857 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3e53f10e-1dde-4f48-811b-b6522e651456 req-97364525-f3be-42ff-a66b-34b2db5c2854 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:50.647925 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3e53f10e-1dde-4f48-811b-b6522e651456 req-97364525-f3be-42ff-a66b-34b2db5c2854 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:50.648372 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3e53f10e-1dde-4f48-811b-b6522e651456 req-97364525-f3be-42ff-a66b-34b2db5c2854 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:50.662714 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-3e53f10e-1dde-4f48-811b-b6522e651456 req-97364525-f3be-42ff-a66b-34b2db5c2854 service nova] Creating event network-changed:2ae6c402-8443-4c74-95ed-6cc326a4b91d for instance 4d6bfe5d-cf98-4ff2-a10e-67692145944c on n-h2-master-1 Aug 07 01:56:50.668060 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-3e53f10e-1dde-4f48-811b-b6522e651456 req-97364525-f3be-42ff-a66b-34b2db5c2854 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038860 Aug 07 01:56:50.668673 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2882/6229] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:56:50.671059 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2bbeef14-dec4-4bc5-b04d-1f04a6cad343 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [instance: 4d6bfe5d-cf98-4ff2-a10e-67692145944c] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:56:50.754053 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2bbeef14-dec4-4bc5-b04d-1f04a6cad343 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4d6bfe5d-cf98-4ff2-a10e-67692145944c" status: 204 len: 0 microversion: 2.1 time: 0.126986 Aug 07 01:56:50.754776 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3348/6230] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:56:50 2022] DELETE /compute/v2.1/servers/4d6bfe5d-cf98-4ff2-a10e-67692145944c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:56:50.767040 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f77cd855-0843-4f7a-ac6d-0de7546038b6 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:50.768859 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f77cd855-0843-4f7a-ac6d-0de7546038b6 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [instance: 4d6bfe5d-cf98-4ff2-a10e-67692145944c] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:50.781594 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f77cd855-0843-4f7a-ac6d-0de7546038b6 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:50.782090 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f77cd855-0843-4f7a-ac6d-0de7546038b6 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:50.782532 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f77cd855-0843-4f7a-ac6d-0de7546038b6 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:50.783430 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f77cd855-0843-4f7a-ac6d-0de7546038b6 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:50.784128 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f77cd855-0843-4f7a-ac6d-0de7546038b6 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:50.784564 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f77cd855-0843-4f7a-ac6d-0de7546038b6 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:51.295476 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f77cd855-0843-4f7a-ac6d-0de7546038b6 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40c219d69d4769b6a957ecce6103b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a860ae0e0f84931893591f9d4b7b7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:51.303660 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f77cd855-0843-4f7a-ac6d-0de7546038b6 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] 10.222.0.39 "GET /compute/v2.1/servers/4d6bfe5d-cf98-4ff2-a10e-67692145944c" status: 200 len: 1766 microversion: 2.1 time: 0.543843 Aug 07 01:56:51.304277 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2883/6231] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:50 2022] GET /compute/v2.1/servers/4d6bfe5d-cf98-4ff2-a10e-67692145944c => generated 1766 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:52.325997 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fa2dd4d4-5dde-43fa-a7ee-2f5b53c1d000 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:52.326848 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fa2dd4d4-5dde-43fa-a7ee-2f5b53c1d000 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [instance: 4d6bfe5d-cf98-4ff2-a10e-67692145944c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:52.334679 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa2dd4d4-5dde-43fa-a7ee-2f5b53c1d000 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:52.335189 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa2dd4d4-5dde-43fa-a7ee-2f5b53c1d000 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:52.335914 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa2dd4d4-5dde-43fa-a7ee-2f5b53c1d000 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:52.336713 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa2dd4d4-5dde-43fa-a7ee-2f5b53c1d000 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:52.337366 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa2dd4d4-5dde-43fa-a7ee-2f5b53c1d000 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:52.337964 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa2dd4d4-5dde-43fa-a7ee-2f5b53c1d000 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:52.617261 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fa2dd4d4-5dde-43fa-a7ee-2f5b53c1d000 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e40c219d69d4769b6a957ecce6103b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a860ae0e0f84931893591f9d4b7b7a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:56:52.625558 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fa2dd4d4-5dde-43fa-a7ee-2f5b53c1d000 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] 10.222.0.39 "GET /compute/v2.1/servers/4d6bfe5d-cf98-4ff2-a10e-67692145944c" status: 200 len: 1766 microversion: 2.1 time: 0.303674 Aug 07 01:56:52.626162 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3349/6232] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:52 2022] GET /compute/v2.1/servers/4d6bfe5d-cf98-4ff2-a10e-67692145944c => generated 1766 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:56:52.888955 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-d0d78667-25ed-4e29-a081-957cbf2a78bd req-64f15346-ce0d-4cd1-b2b4-5b6374a70315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d6bfe5d-cf98-4ff2-a10e-67692145944c", "name": "network-vif-deleted", "tag": "2ae6c402-8443-4c74-95ed-6cc326a4b91d"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:56:52.899967 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d0d78667-25ed-4e29-a081-957cbf2a78bd req-64f15346-ce0d-4cd1-b2b4-5b6374a70315 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:52.900513 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d0d78667-25ed-4e29-a081-957cbf2a78bd req-64f15346-ce0d-4cd1-b2b4-5b6374a70315 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:52.901027 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d0d78667-25ed-4e29-a081-957cbf2a78bd req-64f15346-ce0d-4cd1-b2b4-5b6374a70315 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:52.914568 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-d0d78667-25ed-4e29-a081-957cbf2a78bd req-64f15346-ce0d-4cd1-b2b4-5b6374a70315 service nova] Creating event network-vif-deleted:2ae6c402-8443-4c74-95ed-6cc326a4b91d for instance 4d6bfe5d-cf98-4ff2-a10e-67692145944c on n-h2-master-1 Aug 07 01:56:52.920995 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-d0d78667-25ed-4e29-a081-957cbf2a78bd req-64f15346-ce0d-4cd1-b2b4-5b6374a70315 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035605 Aug 07 01:56:52.921609 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2884/6233] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:56:53.646827 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d492ff62-0d5e-4ae6-b62b-84404516eee0 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:53.647594 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d492ff62-0d5e-4ae6-b62b-84404516eee0 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] [instance: 4d6bfe5d-cf98-4ff2-a10e-67692145944c] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:53.654804 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d492ff62-0d5e-4ae6-b62b-84404516eee0 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:53.655302 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d492ff62-0d5e-4ae6-b62b-84404516eee0 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:53.655749 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d492ff62-0d5e-4ae6-b62b-84404516eee0 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:53.656754 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d492ff62-0d5e-4ae6-b62b-84404516eee0 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:53.657385 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d492ff62-0d5e-4ae6-b62b-84404516eee0 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:53.658053 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d492ff62-0d5e-4ae6-b62b-84404516eee0 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:53.674200 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-d492ff62-0d5e-4ae6-b62b-84404516eee0 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] HTTP exception thrown: Instance 4d6bfe5d-cf98-4ff2-a10e-67692145944c could not be found. Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d492ff62-0d5e-4ae6-b62b-84404516eee0 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Request method failure captured: Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/4d6bfe5d-cf98-4ff2-a10e-67692145944c HTTP/1.1 Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xuP0VXaU1IT4bYNMNCFd1byeu3dqzNeJMAz6bThuXAxGGUX4stq5vuIyWx7jsBsKvqdViC8c3mHQAkMCV2EvkaL5h76Vyn0lUXsIiTLbV41RvWq8mKLN9YHVDXofRA68lQadSPqScTHXeqlN02gk-c2Le68M-hUf3AuXLvlgQ9xwDA Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 0a860ae0e0f84931893591f9d4b7b7a1 Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-453965901 Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0a860ae0e0f84931893591f9d4b7b7a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0a860ae0e0f84931893591f9d4b7b7a1", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0a860ae0e0f84931893591f9d4b7b7a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0a860ae0e0f84931893591f9d4b7b7a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-TestSecurityGroupsBasicOps-453965901 Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 0a860ae0e0f84931893591f9d4b7b7a1 Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-453965901 Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-TestSecurityGroupsBasicOps-453965901-project Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 8e40c219d69d4769b6a957ecce6103b9 Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-TestSecurityGroupsBasicOps-453965901-project Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 4d6bfe5d-cf98-4ff2-a10e-67692145944c could not be found. Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '4d6bfe5d-cf98-4ff2-a10e-67692145944c'} Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d6bfe5d-cf98-4ff2-a10e-67692145944c could not be found. Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d6bfe5d-cf98-4ff2-a10e-67692145944c could not be found. Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:56:53.675910 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:56:53.681321 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:56:53.681321 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:56:53.681321 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:56:53.681321 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:56:53.681321 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:56:53.681321 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d6bfe5d-cf98-4ff2-a10e-67692145944c could not be found. Aug 07 01:56:53.681321 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:56:53.681321 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d492ff62-0d5e-4ae6-b62b-84404516eee0 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Returning 404 to user: Instance 4d6bfe5d-cf98-4ff2-a10e-67692145944c could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:56:53.681321 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d492ff62-0d5e-4ae6-b62b-84404516eee0 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] 10.222.0.39 "GET /compute/v2.1/servers/4d6bfe5d-cf98-4ff2-a10e-67692145944c" status: 404 len: 111 microversion: 2.1 time: 0.034529 Aug 07 01:56:53.681321 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3350/6234] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:56:53 2022] GET /compute/v2.1/servers/4d6bfe5d-cf98-4ff2-a10e-67692145944c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:56:55.564604 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-32440868-447e-4bb6-a475-fd92e3925e01 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:56:55.570241 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-32440868-447e-4bb6-a475-fd92e3925e01 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:56:55.577289 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-32440868-447e-4bb6-a475-fd92e3925e01 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:55.577885 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-32440868-447e-4bb6-a475-fd92e3925e01 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:55.578545 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-32440868-447e-4bb6-a475-fd92e3925e01 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:55.579830 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-32440868-447e-4bb6-a475-fd92e3925e01 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:56:55.580500 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-32440868-447e-4bb6-a475-fd92e3925e01 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:56:55.580935 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-32440868-447e-4bb6-a475-fd92e3925e01 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:56:55.654239 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-32440868-447e-4bb6-a475-fd92e3925e01 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "POST /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350/action" status: 200 len: 24520 microversion: 2.1 time: 0.093949 Aug 07 01:56:55.655563 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2885/6235] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:56:55 2022] POST /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350/action => generated 24520 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:56:57.252402 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a57c9ddf-3fcd-496b-a3a3-69ad9e5b7115 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] Calling method '.version_select at 0x7f9e247d4af0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:56:57.279502 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a57c9ddf-3fcd-496b-a3a3-69ad9e5b7115 tempest-TestSecurityGroupsBasicOps-453965901 tempest-TestSecurityGroupsBasicOps-453965901-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-868039291" status: 202 len: 0 microversion: 2.1 time: 0.030890 Aug 07 01:56:57.280144 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3351/6236] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Aug 7 01:56:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-868039291 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:57:02.044197 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-126e63f4-7191-4768-8404-6ead88df39d5 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:02.045429 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-126e63f4-7191-4768-8404-6ead88df39d5 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:02.060095 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-126e63f4-7191-4768-8404-6ead88df39d5 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:02.060588 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-126e63f4-7191-4768-8404-6ead88df39d5 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:02.061285 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-126e63f4-7191-4768-8404-6ead88df39d5 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:02.062224 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-126e63f4-7191-4768-8404-6ead88df39d5 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:02.063066 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-126e63f4-7191-4768-8404-6ead88df39d5 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:02.064260 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-126e63f4-7191-4768-8404-6ead88df39d5 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:02.274124 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-126e63f4-7191-4768-8404-6ead88df39d5 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1831 microversion: 2.1 time: 0.237155 Aug 07 01:57:02.275297 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2886/6237] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:02 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1831 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:57:02.295779 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-62402c32-0448-4599-ac7c-e2326e7e296e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:02.296497 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-62402c32-0448-4599-ac7c-e2326e7e296e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:02.305538 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:57:02.307823 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62402c32-0448-4599-ac7c-e2326e7e296e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:02.308889 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62402c32-0448-4599-ac7c-e2326e7e296e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:02.309655 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62402c32-0448-4599-ac7c-e2326e7e296e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:02.310617 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62402c32-0448-4599-ac7c-e2326e7e296e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:02.311276 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62402c32-0448-4599-ac7c-e2326e7e296e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:02.312565 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62402c32-0448-4599-ac7c-e2326e7e296e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:02.611314 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-62402c32-0448-4599-ac7c-e2326e7e296e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:57:02.633721 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-62402c32-0448-4599-ac7c-e2326e7e296e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1680 microversion: 2.1 time: 0.341851 Aug 07 01:57:02.636421 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3352/6238] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:02 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1680 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:02.803764 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0edb9e1f-ae03-4147-ac30-f18fa59a1b66 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:57:02.806375 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0edb9e1f-ae03-4147-ac30-f18fa59a1b66 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:02.816636 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0edb9e1f-ae03-4147-ac30-f18fa59a1b66 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:02.817431 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0edb9e1f-ae03-4147-ac30-f18fa59a1b66 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:02.818060 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0edb9e1f-ae03-4147-ac30-f18fa59a1b66 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:02.818966 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0edb9e1f-ae03-4147-ac30-f18fa59a1b66 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:02.819664 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0edb9e1f-ae03-4147-ac30-f18fa59a1b66 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:02.820352 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0edb9e1f-ae03-4147-ac30-f18fa59a1b66 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:02.905476 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0edb9e1f-ae03-4147-ac30-f18fa59a1b66 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "POST /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350/action" status: 200 len: 32591 microversion: 2.1 time: 0.106224 Aug 07 01:57:02.912142 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2887/6239] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:57:02 2022] POST /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350/action => generated 32591 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:57:03.142929 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d29a73e4-aa52-4163-8efb-7162ba52ffd3 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:57:03.143536 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d29a73e4-aa52-4163-8efb-7162ba52ffd3 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:03.152225 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d29a73e4-aa52-4163-8efb-7162ba52ffd3 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:03.153838 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d29a73e4-aa52-4163-8efb-7162ba52ffd3 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:03.154688 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d29a73e4-aa52-4163-8efb-7162ba52ffd3 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:03.155532 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d29a73e4-aa52-4163-8efb-7162ba52ffd3 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:03.156134 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d29a73e4-aa52-4163-8efb-7162ba52ffd3 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:03.156688 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d29a73e4-aa52-4163-8efb-7162ba52ffd3 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:03.206295 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d29a73e4-aa52-4163-8efb-7162ba52ffd3 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2fde507388124f7e8d3449239f674c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2569e52ed8a440daa867d62aa63f95d5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:57:03.207484 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d29a73e4-aa52-4163-8efb-7162ba52ffd3 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] flavor_id is None. Assuming migration. {{(pid=119516) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 07 01:57:03.209606 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d29a73e4-aa52-4163-8efb-7162ba52ffd3 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119516) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 07 01:57:03.507373 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:57:03.544441 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d29a73e4-aa52-4163-8efb-7162ba52ffd3 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350/action" status: 202 len: 0 microversion: 2.1 time: 0.406423 Aug 07 01:57:03.545798 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3353/6240] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:57:03 2022] POST /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350/action => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:57:03.555451 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4d303b2f-b512-48f2-97ee-1e30fbc9b82c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:03.557659 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4d303b2f-b512-48f2-97ee-1e30fbc9b82c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:03.569114 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d303b2f-b512-48f2-97ee-1e30fbc9b82c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:03.569615 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d303b2f-b512-48f2-97ee-1e30fbc9b82c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:03.570059 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d303b2f-b512-48f2-97ee-1e30fbc9b82c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:03.570774 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d303b2f-b512-48f2-97ee-1e30fbc9b82c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:03.571234 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d303b2f-b512-48f2-97ee-1e30fbc9b82c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:03.571659 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d303b2f-b512-48f2-97ee-1e30fbc9b82c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:03.577824 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=76 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:57:03.748623 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4d303b2f-b512-48f2-97ee-1e30fbc9b82c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:57:03.757217 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4d303b2f-b512-48f2-97ee-1e30fbc9b82c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1689 microversion: 2.1 time: 0.206180 Aug 07 01:57:03.758072 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2888/6241] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:03 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1689 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:57:04.778948 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-64109323-ac63-446e-ab69-e3ab96cc0c0f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:04.780970 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-64109323-ac63-446e-ab69-e3ab96cc0c0f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:04.791049 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64109323-ac63-446e-ab69-e3ab96cc0c0f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:04.792119 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64109323-ac63-446e-ab69-e3ab96cc0c0f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:04.793644 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64109323-ac63-446e-ab69-e3ab96cc0c0f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:04.795520 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64109323-ac63-446e-ab69-e3ab96cc0c0f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:04.796781 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64109323-ac63-446e-ab69-e3ab96cc0c0f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:04.797058 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64109323-ac63-446e-ab69-e3ab96cc0c0f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:04.996416 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-64109323-ac63-446e-ab69-e3ab96cc0c0f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:57:05.007050 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-64109323-ac63-446e-ab69-e3ab96cc0c0f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1689 microversion: 2.1 time: 0.232141 Aug 07 01:57:05.008511 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3354/6242] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:04 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1689 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:06.032915 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4050e842-5210-484c-b5eb-86253d820c98 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:06.033983 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4050e842-5210-484c-b5eb-86253d820c98 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:06.049769 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4050e842-5210-484c-b5eb-86253d820c98 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:06.052461 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4050e842-5210-484c-b5eb-86253d820c98 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:06.053188 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4050e842-5210-484c-b5eb-86253d820c98 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:06.054725 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4050e842-5210-484c-b5eb-86253d820c98 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:06.057394 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4050e842-5210-484c-b5eb-86253d820c98 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:06.058037 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4050e842-5210-484c-b5eb-86253d820c98 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:06.437290 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4050e842-5210-484c-b5eb-86253d820c98 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:57:06.449949 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4050e842-5210-484c-b5eb-86253d820c98 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1689 microversion: 2.1 time: 0.423483 Aug 07 01:57:06.466986 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2889/6243] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:06 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1689 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:57:07.493982 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-08199b53-87c4-419f-a3cb-aaaa2589e4fb tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:07.494570 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-08199b53-87c4-419f-a3cb-aaaa2589e4fb tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:07.502283 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08199b53-87c4-419f-a3cb-aaaa2589e4fb tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:07.503865 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08199b53-87c4-419f-a3cb-aaaa2589e4fb tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:07.506286 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08199b53-87c4-419f-a3cb-aaaa2589e4fb tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:07.508282 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08199b53-87c4-419f-a3cb-aaaa2589e4fb tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:07.509024 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08199b53-87c4-419f-a3cb-aaaa2589e4fb tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:07.509726 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08199b53-87c4-419f-a3cb-aaaa2589e4fb tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:07.685991 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-08199b53-87c4-419f-a3cb-aaaa2589e4fb tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:57:07.696371 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-08199b53-87c4-419f-a3cb-aaaa2589e4fb tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1694 microversion: 2.1 time: 0.206960 Aug 07 01:57:07.697042 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3355/6244] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:07 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1694 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:08.721288 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d9f11ebf-7b0b-4175-b9f2-12364c521f9d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:08.724299 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d9f11ebf-7b0b-4175-b9f2-12364c521f9d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:08.730843 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=32 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:57:08.741455 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9f11ebf-7b0b-4175-b9f2-12364c521f9d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:08.743281 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9f11ebf-7b0b-4175-b9f2-12364c521f9d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:08.745967 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9f11ebf-7b0b-4175-b9f2-12364c521f9d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:08.747472 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9f11ebf-7b0b-4175-b9f2-12364c521f9d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:08.749167 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9f11ebf-7b0b-4175-b9f2-12364c521f9d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:08.752248 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9f11ebf-7b0b-4175-b9f2-12364c521f9d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:09.110181 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d9f11ebf-7b0b-4175-b9f2-12364c521f9d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:57:09.127069 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d9f11ebf-7b0b-4175-b9f2-12364c521f9d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1694 microversion: 2.1 time: 0.411948 Aug 07 01:57:09.129429 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2890/6245] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:08 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1694 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:10.153599 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b9d9ce78-e834-4ed5-b40e-ff6abed96ab6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:10.155328 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b9d9ce78-e834-4ed5-b40e-ff6abed96ab6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:10.164873 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9d9ce78-e834-4ed5-b40e-ff6abed96ab6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:10.165415 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9d9ce78-e834-4ed5-b40e-ff6abed96ab6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:10.166005 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9d9ce78-e834-4ed5-b40e-ff6abed96ab6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:10.166705 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9d9ce78-e834-4ed5-b40e-ff6abed96ab6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:10.167373 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9d9ce78-e834-4ed5-b40e-ff6abed96ab6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:10.168104 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9d9ce78-e834-4ed5-b40e-ff6abed96ab6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:10.227815 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-536a32fa-d8a6-4016-806b-66f4898a329d tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:10.228699 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:57:10.228699 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 01:57:10.229946 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-536a32fa-d8a6-4016-806b-66f4898a329d tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:10.230637 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-536a32fa-d8a6-4016-806b-66f4898a329d tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:10.231096 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-536a32fa-d8a6-4016-806b-66f4898a329d tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:10.232514 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-536a32fa-d8a6-4016-806b-66f4898a329d tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:10.238034 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-536a32fa-d8a6-4016-806b-66f4898a329d tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:10.238670 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-536a32fa-d8a6-4016-806b-66f4898a329d tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:10.268318 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-536a32fa-d8a6-4016-806b-66f4898a329d tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] 10.222.0.39 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.204241 Aug 07 01:57:10.269607 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3356/6246] 10.222.0.39 () {58 vars in 1185 bytes} [Sun Aug 7 01:57:10 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:57:10.453017 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b9d9ce78-e834-4ed5-b40e-ff6abed96ab6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:57:10.465627 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b9d9ce78-e834-4ed5-b40e-ff6abed96ab6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1694 microversion: 2.1 time: 0.316144 Aug 07 01:57:10.466851 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2891/6247] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:10 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1694 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:57:10.492255 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-eb415a19-91ef-4eb5-8940-b89582f3c8de tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-170433191", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "availability_zone": "nova:n-h1-master-1", "networks": [{"uuid": "62631dd5-e64f-40eb-8d92-dce068f63ce6"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:57:10.564693 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-eb415a19-91ef-4eb5-8940-b89582f3c8de tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] validate_networks() for [('62631dd5-e64f-40eb-8d92-dce068f63ce6', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:57:10.983665 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-eb415a19-91ef-4eb5-8940-b89582f3c8de tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:57:10.983872 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-eb415a19-91ef-4eb5-8940-b89582f3c8de tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:57:10.984400 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-eb415a19-91ef-4eb5-8940-b89582f3c8de tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:57:10.984858 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-eb415a19-91ef-4eb5-8940-b89582f3c8de tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:57:10.985287 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-eb415a19-91ef-4eb5-8940-b89582f3c8de tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:57:10.994476 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb415a19-91ef-4eb5-8940-b89582f3c8de tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:10.994972 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb415a19-91ef-4eb5-8940-b89582f3c8de tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:10.995423 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb415a19-91ef-4eb5-8940-b89582f3c8de tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:10.996212 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb415a19-91ef-4eb5-8940-b89582f3c8de tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:10.996682 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb415a19-91ef-4eb5-8940-b89582f3c8de tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:10.998155 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb415a19-91ef-4eb5-8940-b89582f3c8de tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:11.015259 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-eb415a19-91ef-4eb5-8940-b89582f3c8de tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Getting quotas for project 8c0975684af442a3ae7a012fa13b2645. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:57:11.021547 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-eb415a19-91ef-4eb5-8940-b89582f3c8de tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Getting quotas for user 86d384f3ab5949b0bddc35f6bdb7fac0 and project 8c0975684af442a3ae7a012fa13b2645. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:57:11.034625 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-eb415a19-91ef-4eb5-8940-b89582f3c8de tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:57:11.037067 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-eb415a19-91ef-4eb5-8940-b89582f3c8de tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] [instance: 7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:57:11.088203 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-eb415a19-91ef-4eb5-8940-b89582f3c8de tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.600220 Aug 07 01:57:11.094984 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3357/6248] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:57:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:57:11.100305 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-62d2b3b8-6c69-4ec2-b500-f8961caac401 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:11.100822 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-62d2b3b8-6c69-4ec2-b500-f8961caac401 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] [instance: 7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:11.165794 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-62d2b3b8-6c69-4ec2-b500-f8961caac401 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4" status: 200 len: 1328 microversion: 2.1 time: 0.069037 Aug 07 01:57:11.166491 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2892/6249] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:11 2022] GET /compute/v2.1/servers/7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4 => generated 1328 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:11.487049 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e4c10825-ef53-4d32-9be2-02cd3e740aed tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:11.488315 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e4c10825-ef53-4d32-9be2-02cd3e740aed tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:11.496358 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4c10825-ef53-4d32-9be2-02cd3e740aed tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:11.496862 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4c10825-ef53-4d32-9be2-02cd3e740aed tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:11.497517 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4c10825-ef53-4d32-9be2-02cd3e740aed tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:11.498240 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4c10825-ef53-4d32-9be2-02cd3e740aed tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:11.498904 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4c10825-ef53-4d32-9be2-02cd3e740aed tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:11.499340 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4c10825-ef53-4d32-9be2-02cd3e740aed tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:11.655680 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e4c10825-ef53-4d32-9be2-02cd3e740aed tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:57:11.663653 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e4c10825-ef53-4d32-9be2-02cd3e740aed tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1694 microversion: 2.1 time: 0.180843 Aug 07 01:57:11.664509 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3358/6250] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:11 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1694 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:12.186210 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7c3fb077-b8df-4cc7-b242-b22b46abd44a tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:12.186880 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7c3fb077-b8df-4cc7-b242-b22b46abd44a tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] [instance: 7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:12.195185 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7c3fb077-b8df-4cc7-b242-b22b46abd44a tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:12.195686 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7c3fb077-b8df-4cc7-b242-b22b46abd44a tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:12.196340 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7c3fb077-b8df-4cc7-b242-b22b46abd44a tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:12.197061 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7c3fb077-b8df-4cc7-b242-b22b46abd44a tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:12.197546 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7c3fb077-b8df-4cc7-b242-b22b46abd44a tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:12.197970 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7c3fb077-b8df-4cc7-b242-b22b46abd44a tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:12.275444 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7c3fb077-b8df-4cc7-b242-b22b46abd44a tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4" status: 200 len: 1415 microversion: 2.1 time: 0.092010 Aug 07 01:57:12.276084 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2893/6251] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:12 2022] GET /compute/v2.1/servers/7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4 => generated 1415 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:12.685183 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4a13f753-0b07-4dab-9e13-60a954d4f5f1 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:12.685977 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4a13f753-0b07-4dab-9e13-60a954d4f5f1 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:12.693373 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a13f753-0b07-4dab-9e13-60a954d4f5f1 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:12.693880 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a13f753-0b07-4dab-9e13-60a954d4f5f1 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:12.694339 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a13f753-0b07-4dab-9e13-60a954d4f5f1 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:12.695378 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a13f753-0b07-4dab-9e13-60a954d4f5f1 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:12.695858 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a13f753-0b07-4dab-9e13-60a954d4f5f1 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:12.696337 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a13f753-0b07-4dab-9e13-60a954d4f5f1 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:12.857856 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4a13f753-0b07-4dab-9e13-60a954d4f5f1 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:57:12.866757 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4a13f753-0b07-4dab-9e13-60a954d4f5f1 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1694 microversion: 2.1 time: 0.185476 Aug 07 01:57:12.867339 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3359/6252] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:12 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1694 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:13.302405 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9f70690b-216a-4e52-a73d-4c66ff8399e1 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:13.304435 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9f70690b-216a-4e52-a73d-4c66ff8399e1 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] [instance: 7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:13.312584 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9f70690b-216a-4e52-a73d-4c66ff8399e1 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:13.313381 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9f70690b-216a-4e52-a73d-4c66ff8399e1 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:13.313995 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9f70690b-216a-4e52-a73d-4c66ff8399e1 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:13.315430 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9f70690b-216a-4e52-a73d-4c66ff8399e1 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:13.316167 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9f70690b-216a-4e52-a73d-4c66ff8399e1 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:13.316846 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9f70690b-216a-4e52-a73d-4c66ff8399e1 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:13.553066 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9f70690b-216a-4e52-a73d-4c66ff8399e1 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4" status: 200 len: 1463 microversion: 2.1 time: 0.257589 Aug 07 01:57:13.554338 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2894/6253] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:13 2022] GET /compute/v2.1/servers/7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4 => generated 1463 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:13.886571 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-3516cf44-e04d-4cd5-aea8-a372cbf9c5c8 req-7aa20c94-408f-4d88-b383-b9949a6232ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4", "tag": "b7b304d9-4b20-4398-bc4c-98f5079b7b22"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:57:13.890942 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-097f4c20-1499-4ac3-ac66-54e43478763f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:13.891941 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-097f4c20-1499-4ac3-ac66-54e43478763f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:13.901882 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-097f4c20-1499-4ac3-ac66-54e43478763f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:13.902407 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-097f4c20-1499-4ac3-ac66-54e43478763f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:13.902853 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-097f4c20-1499-4ac3-ac66-54e43478763f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:13.903576 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-097f4c20-1499-4ac3-ac66-54e43478763f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:13.904633 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-097f4c20-1499-4ac3-ac66-54e43478763f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:13.905078 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-097f4c20-1499-4ac3-ac66-54e43478763f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:13.912108 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3516cf44-e04d-4cd5-aea8-a372cbf9c5c8 req-7aa20c94-408f-4d88-b383-b9949a6232ff service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:13.913278 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3516cf44-e04d-4cd5-aea8-a372cbf9c5c8 req-7aa20c94-408f-4d88-b383-b9949a6232ff service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:13.913984 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3516cf44-e04d-4cd5-aea8-a372cbf9c5c8 req-7aa20c94-408f-4d88-b383-b9949a6232ff service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:13.931231 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-3516cf44-e04d-4cd5-aea8-a372cbf9c5c8 req-7aa20c94-408f-4d88-b383-b9949a6232ff service nova] Creating event network-changed:b7b304d9-4b20-4398-bc4c-98f5079b7b22 for instance 7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4 on n-h1-master-1 Aug 07 01:57:13.936567 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-3516cf44-e04d-4cd5-aea8-a372cbf9c5c8 req-7aa20c94-408f-4d88-b383-b9949a6232ff service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055106 Aug 07 01:57:13.938747 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3360/6254] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:57:14.149782 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-097f4c20-1499-4ac3-ac66-54e43478763f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:57:14.167542 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-097f4c20-1499-4ac3-ac66-54e43478763f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1694 microversion: 2.1 time: 0.283826 Aug 07 01:57:14.169843 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2895/6255] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:13 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1694 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:57:14.576794 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-38e92784-4647-4f15-b289-01a949d94743 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:14.577549 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-38e92784-4647-4f15-b289-01a949d94743 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] [instance: 7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:14.585253 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38e92784-4647-4f15-b289-01a949d94743 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:14.585772 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38e92784-4647-4f15-b289-01a949d94743 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:14.586230 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38e92784-4647-4f15-b289-01a949d94743 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:14.587001 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38e92784-4647-4f15-b289-01a949d94743 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:14.587660 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38e92784-4647-4f15-b289-01a949d94743 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:14.588143 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38e92784-4647-4f15-b289-01a949d94743 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:14.731143 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-38e92784-4647-4f15-b289-01a949d94743 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4" status: 200 len: 1463 microversion: 2.1 time: 0.160051 Aug 07 01:57:14.731758 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3361/6256] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:14 2022] GET /compute/v2.1/servers/7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4 => generated 1463 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:15.191643 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-336cb2a6-c19a-4dae-99bb-a4e49ca3db25 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:15.192276 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-336cb2a6-c19a-4dae-99bb-a4e49ca3db25 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:15.199223 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-336cb2a6-c19a-4dae-99bb-a4e49ca3db25 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:15.199705 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-336cb2a6-c19a-4dae-99bb-a4e49ca3db25 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:15.200168 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-336cb2a6-c19a-4dae-99bb-a4e49ca3db25 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:15.200873 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-336cb2a6-c19a-4dae-99bb-a4e49ca3db25 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:15.201328 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-336cb2a6-c19a-4dae-99bb-a4e49ca3db25 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:15.201755 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-336cb2a6-c19a-4dae-99bb-a4e49ca3db25 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:15.414856 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-336cb2a6-c19a-4dae-99bb-a4e49ca3db25 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:57:15.423548 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-336cb2a6-c19a-4dae-99bb-a4e49ca3db25 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1694 microversion: 2.1 time: 0.236495 Aug 07 01:57:15.424292 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2896/6257] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:15 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1694 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:15.753315 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-422aae3d-40ac-481e-84b3-08923d7fc59b tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:15.753949 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-422aae3d-40ac-481e-84b3-08923d7fc59b tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] [instance: 7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:15.761320 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-422aae3d-40ac-481e-84b3-08923d7fc59b tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:15.761828 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-422aae3d-40ac-481e-84b3-08923d7fc59b tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:15.762294 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-422aae3d-40ac-481e-84b3-08923d7fc59b tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:15.763299 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-422aae3d-40ac-481e-84b3-08923d7fc59b tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:15.763763 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-422aae3d-40ac-481e-84b3-08923d7fc59b tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:15.764449 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-422aae3d-40ac-481e-84b3-08923d7fc59b tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:15.892752 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-422aae3d-40ac-481e-84b3-08923d7fc59b tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4" status: 200 len: 1463 microversion: 2.1 time: 0.143943 Aug 07 01:57:15.893370 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3362/6258] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:15 2022] GET /compute/v2.1/servers/7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4 => generated 1463 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:16.445761 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6da40309-250f-40d9-a0f3-9df0a367ddcb tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:16.446434 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6da40309-250f-40d9-a0f3-9df0a367ddcb tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:16.453389 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6da40309-250f-40d9-a0f3-9df0a367ddcb tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:16.453870 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6da40309-250f-40d9-a0f3-9df0a367ddcb tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:16.454311 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6da40309-250f-40d9-a0f3-9df0a367ddcb tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:16.455034 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6da40309-250f-40d9-a0f3-9df0a367ddcb tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:16.455503 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6da40309-250f-40d9-a0f3-9df0a367ddcb tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:16.455995 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6da40309-250f-40d9-a0f3-9df0a367ddcb tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:16.598861 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6da40309-250f-40d9-a0f3-9df0a367ddcb tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:57:16.606693 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6da40309-250f-40d9-a0f3-9df0a367ddcb tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1694 microversion: 2.1 time: 0.164813 Aug 07 01:57:16.607197 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2897/6259] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:16 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1694 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:16.913453 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-baef8959-4d15-4631-b151-64d6924d7ddc tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:16.914278 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-baef8959-4d15-4631-b151-64d6924d7ddc tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] [instance: 7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:16.921040 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-baef8959-4d15-4631-b151-64d6924d7ddc tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:16.922044 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-baef8959-4d15-4631-b151-64d6924d7ddc tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:16.922487 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-baef8959-4d15-4631-b151-64d6924d7ddc tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:16.923196 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-baef8959-4d15-4631-b151-64d6924d7ddc tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:16.923670 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-baef8959-4d15-4631-b151-64d6924d7ddc tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:16.924133 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-baef8959-4d15-4631-b151-64d6924d7ddc tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:17.055908 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-baef8959-4d15-4631-b151-64d6924d7ddc tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4" status: 200 len: 1463 microversion: 2.1 time: 0.146186 Aug 07 01:57:17.056498 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3363/6260] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:16 2022] GET /compute/v2.1/servers/7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4 => generated 1463 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:17.629627 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-00191233-416d-4f18-afb7-a75cc999f8fe tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:17.630255 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-00191233-416d-4f18-afb7-a75cc999f8fe tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:17.637201 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00191233-416d-4f18-afb7-a75cc999f8fe tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:17.637690 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00191233-416d-4f18-afb7-a75cc999f8fe tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:17.638138 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00191233-416d-4f18-afb7-a75cc999f8fe tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:17.638854 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00191233-416d-4f18-afb7-a75cc999f8fe tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:17.639323 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00191233-416d-4f18-afb7-a75cc999f8fe tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:17.639792 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00191233-416d-4f18-afb7-a75cc999f8fe tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:17.772513 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-00191233-416d-4f18-afb7-a75cc999f8fe tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:57:17.780206 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-00191233-416d-4f18-afb7-a75cc999f8fe tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1694 microversion: 2.1 time: 0.154532 Aug 07 01:57:17.781010 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2898/6261] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:17 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:18.077131 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5b03ed14-2b5b-4db5-b1f8-16d29c848bbb tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:18.077769 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5b03ed14-2b5b-4db5-b1f8-16d29c848bbb tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] [instance: 7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:18.084705 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5b03ed14-2b5b-4db5-b1f8-16d29c848bbb tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:18.085211 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5b03ed14-2b5b-4db5-b1f8-16d29c848bbb tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:18.085665 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5b03ed14-2b5b-4db5-b1f8-16d29c848bbb tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:18.086381 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5b03ed14-2b5b-4db5-b1f8-16d29c848bbb tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:18.086855 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5b03ed14-2b5b-4db5-b1f8-16d29c848bbb tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:18.087303 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5b03ed14-2b5b-4db5-b1f8-16d29c848bbb tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:18.214180 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5b03ed14-2b5b-4db5-b1f8-16d29c848bbb tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4" status: 200 len: 1463 microversion: 2.1 time: 0.140656 Aug 07 01:57:18.214748 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3364/6262] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:18 2022] GET /compute/v2.1/servers/7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4 => generated 1463 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:18.801536 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6f86c736-f9a1-44b8-8829-4d7bde5d2c59 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:18.802133 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6f86c736-f9a1-44b8-8829-4d7bde5d2c59 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:18.809149 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f86c736-f9a1-44b8-8829-4d7bde5d2c59 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:18.809633 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f86c736-f9a1-44b8-8829-4d7bde5d2c59 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:18.810074 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f86c736-f9a1-44b8-8829-4d7bde5d2c59 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:18.810772 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f86c736-f9a1-44b8-8829-4d7bde5d2c59 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:18.811227 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f86c736-f9a1-44b8-8829-4d7bde5d2c59 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:18.811655 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f86c736-f9a1-44b8-8829-4d7bde5d2c59 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:18.948782 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6f86c736-f9a1-44b8-8829-4d7bde5d2c59 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:57:18.956774 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6f86c736-f9a1-44b8-8829-4d7bde5d2c59 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1694 microversion: 2.1 time: 0.159164 Aug 07 01:57:18.957351 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2899/6263] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:18 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:19.235245 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f8e52bca-4e7b-45ec-b3d9-30a69486b2db tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:19.235813 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f8e52bca-4e7b-45ec-b3d9-30a69486b2db tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] [instance: 7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:19.243650 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f8e52bca-4e7b-45ec-b3d9-30a69486b2db tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:19.244215 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f8e52bca-4e7b-45ec-b3d9-30a69486b2db tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:19.244687 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f8e52bca-4e7b-45ec-b3d9-30a69486b2db tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:19.245412 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f8e52bca-4e7b-45ec-b3d9-30a69486b2db tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:19.246067 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f8e52bca-4e7b-45ec-b3d9-30a69486b2db tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:19.246564 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f8e52bca-4e7b-45ec-b3d9-30a69486b2db tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:19.385811 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f8e52bca-4e7b-45ec-b3d9-30a69486b2db tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4" status: 200 len: 1463 microversion: 2.1 time: 0.154525 Aug 07 01:57:19.386403 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3365/6264] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:19 2022] GET /compute/v2.1/servers/7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4 => generated 1463 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:19.498999 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-046cbbcf-b6e4-4a67-ad58-a64e89c5750a req-23e21218-9b22-4e5a-8c9c-b92a39fa6357 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4", "name": "network-vif-plugged", "status": "completed", "tag": "b7b304d9-4b20-4398-bc4c-98f5079b7b22"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:57:19.509339 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-046cbbcf-b6e4-4a67-ad58-a64e89c5750a req-23e21218-9b22-4e5a-8c9c-b92a39fa6357 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:19.509843 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-046cbbcf-b6e4-4a67-ad58-a64e89c5750a req-23e21218-9b22-4e5a-8c9c-b92a39fa6357 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:19.510323 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-046cbbcf-b6e4-4a67-ad58-a64e89c5750a req-23e21218-9b22-4e5a-8c9c-b92a39fa6357 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:19.522508 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-046cbbcf-b6e4-4a67-ad58-a64e89c5750a req-23e21218-9b22-4e5a-8c9c-b92a39fa6357 service nova] Creating event network-vif-plugged:b7b304d9-4b20-4398-bc4c-98f5079b7b22 for instance 7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4 on n-h1-master-1 Aug 07 01:57:19.527991 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-046cbbcf-b6e4-4a67-ad58-a64e89c5750a req-23e21218-9b22-4e5a-8c9c-b92a39fa6357 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032750 Aug 07 01:57:19.528607 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2900/6265] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:57:19.978695 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-78ab47d8-81b0-410e-93de-200570fae0d6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:19.979341 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-78ab47d8-81b0-410e-93de-200570fae0d6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:19.986309 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-78ab47d8-81b0-410e-93de-200570fae0d6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:19.986822 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-78ab47d8-81b0-410e-93de-200570fae0d6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:19.987307 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-78ab47d8-81b0-410e-93de-200570fae0d6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:19.988082 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-78ab47d8-81b0-410e-93de-200570fae0d6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:19.988622 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-78ab47d8-81b0-410e-93de-200570fae0d6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:19.989098 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-78ab47d8-81b0-410e-93de-200570fae0d6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:20.122484 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-78ab47d8-81b0-410e-93de-200570fae0d6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:57:20.131040 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-78ab47d8-81b0-410e-93de-200570fae0d6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1694 microversion: 2.1 time: 0.156286 Aug 07 01:57:20.131698 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3366/6266] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:19 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:20.408657 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-003f80cb-b822-42fb-bd45-bd279689357b tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:20.409359 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-003f80cb-b822-42fb-bd45-bd279689357b tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] [instance: 7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:20.415674 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-003f80cb-b822-42fb-bd45-bd279689357b tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:20.416190 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-003f80cb-b822-42fb-bd45-bd279689357b tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:20.416631 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-003f80cb-b822-42fb-bd45-bd279689357b tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:20.417334 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-003f80cb-b822-42fb-bd45-bd279689357b tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:20.417793 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-003f80cb-b822-42fb-bd45-bd279689357b tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:20.418218 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-003f80cb-b822-42fb-bd45-bd279689357b tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:20.547528 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-003f80cb-b822-42fb-bd45-bd279689357b tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4" status: 200 len: 1463 microversion: 2.1 time: 0.144210 Aug 07 01:57:20.548139 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2901/6267] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:20 2022] GET /compute/v2.1/servers/7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4 => generated 1463 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:21.152141 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d4f151f8-ac4e-475d-a181-007b31fbb8bf tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:21.152767 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d4f151f8-ac4e-475d-a181-007b31fbb8bf tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:21.155739 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=4 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:57:21.156467 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:57:21.162539 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d4f151f8-ac4e-475d-a181-007b31fbb8bf tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:21.163032 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d4f151f8-ac4e-475d-a181-007b31fbb8bf tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:21.163488 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d4f151f8-ac4e-475d-a181-007b31fbb8bf tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:21.164234 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d4f151f8-ac4e-475d-a181-007b31fbb8bf tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:21.164702 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d4f151f8-ac4e-475d-a181-007b31fbb8bf tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:21.165140 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d4f151f8-ac4e-475d-a181-007b31fbb8bf tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:21.301495 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d4f151f8-ac4e-475d-a181-007b31fbb8bf tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:57:21.309479 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d4f151f8-ac4e-475d-a181-007b31fbb8bf tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1694 microversion: 2.1 time: 0.161204 Aug 07 01:57:21.310059 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3367/6268] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:21 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:21.569628 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-db8ec0a8-aa41-432b-b0ad-f63ab6e3c06f tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:21.570242 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-db8ec0a8-aa41-432b-b0ad-f63ab6e3c06f tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] [instance: 7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:21.572300 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:57:21.578869 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db8ec0a8-aa41-432b-b0ad-f63ab6e3c06f tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:21.579364 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db8ec0a8-aa41-432b-b0ad-f63ab6e3c06f tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:21.579813 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db8ec0a8-aa41-432b-b0ad-f63ab6e3c06f tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:21.580558 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db8ec0a8-aa41-432b-b0ad-f63ab6e3c06f tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:21.581025 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db8ec0a8-aa41-432b-b0ad-f63ab6e3c06f tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:21.581540 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db8ec0a8-aa41-432b-b0ad-f63ab6e3c06f tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:21.721021 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-db8ec0a8-aa41-432b-b0ad-f63ab6e3c06f tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4" status: 200 len: 1648 microversion: 2.1 time: 0.154920 Aug 07 01:57:21.721480 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2902/6269] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:21 2022] GET /compute/v2.1/servers/7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4 => generated 1648 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:21.742244 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1145c07a-b43f-49aa-900f-fb607c72a1fc tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:21.742942 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1145c07a-b43f-49aa-900f-fb607c72a1fc tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] [instance: 7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:21.749068 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1145c07a-b43f-49aa-900f-fb607c72a1fc tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:21.750136 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1145c07a-b43f-49aa-900f-fb607c72a1fc tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:21.750584 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1145c07a-b43f-49aa-900f-fb607c72a1fc tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:21.751292 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1145c07a-b43f-49aa-900f-fb607c72a1fc tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:21.751759 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1145c07a-b43f-49aa-900f-fb607c72a1fc tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:21.752229 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1145c07a-b43f-49aa-900f-fb607c72a1fc tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:21.881651 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1145c07a-b43f-49aa-900f-fb607c72a1fc tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4" status: 200 len: 1648 microversion: 2.1 time: 0.143368 Aug 07 01:57:21.882221 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3368/6270] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:21 2022] GET /compute/v2.1/servers/7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4 => generated 1648 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:21.901662 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e4ef3679-d2db-4f96-881a-df6143466c25 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:21.902281 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e4ef3679-d2db-4f96-881a-df6143466c25 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] [instance: 7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:21.908408 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4ef3679-d2db-4f96-881a-df6143466c25 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:21.908891 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4ef3679-d2db-4f96-881a-df6143466c25 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:21.909337 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4ef3679-d2db-4f96-881a-df6143466c25 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:21.910040 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4ef3679-d2db-4f96-881a-df6143466c25 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:21.910497 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4ef3679-d2db-4f96-881a-df6143466c25 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:21.910928 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4ef3679-d2db-4f96-881a-df6143466c25 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:22.038957 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e4ef3679-d2db-4f96-881a-df6143466c25 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4" status: 200 len: 1648 microversion: 2.1 time: 0.140859 Aug 07 01:57:22.039606 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2903/6271] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:21 2022] GET /compute/v2.1/servers/7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4 => generated 1648 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:22.099897 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-eb1ef092-32a5-4f6c-aa44-18b843ee46df tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1030997434", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "availability_zone": "nova:n-h2-master-1", "networks": [{"uuid": "62631dd5-e64f-40eb-8d92-dce068f63ce6"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:57:22.157457 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-eb1ef092-32a5-4f6c-aa44-18b843ee46df tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] validate_networks() for [('62631dd5-e64f-40eb-8d92-dce068f63ce6', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:57:22.330752 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fe533840-6106-4438-ba8e-53547ab72df4 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:22.331453 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fe533840-6106-4438-ba8e-53547ab72df4 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:22.338158 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fe533840-6106-4438-ba8e-53547ab72df4 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:22.338575 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fe533840-6106-4438-ba8e-53547ab72df4 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:22.339017 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fe533840-6106-4438-ba8e-53547ab72df4 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:22.339692 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fe533840-6106-4438-ba8e-53547ab72df4 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:22.340175 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fe533840-6106-4438-ba8e-53547ab72df4 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:22.340603 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fe533840-6106-4438-ba8e-53547ab72df4 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:22.473109 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fe533840-6106-4438-ba8e-53547ab72df4 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:57:22.481416 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fe533840-6106-4438-ba8e-53547ab72df4 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1694 microversion: 2.1 time: 0.154769 Aug 07 01:57:22.482342 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2904/6272] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:22 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:57:22.517813 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-eb1ef092-32a5-4f6c-aa44-18b843ee46df tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:57:22.518258 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-eb1ef092-32a5-4f6c-aa44-18b843ee46df tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:57:22.518750 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-eb1ef092-32a5-4f6c-aa44-18b843ee46df tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:57:22.519252 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-eb1ef092-32a5-4f6c-aa44-18b843ee46df tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:57:22.519685 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-eb1ef092-32a5-4f6c-aa44-18b843ee46df tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:57:22.528669 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb1ef092-32a5-4f6c-aa44-18b843ee46df tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:22.529166 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb1ef092-32a5-4f6c-aa44-18b843ee46df tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:22.529618 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb1ef092-32a5-4f6c-aa44-18b843ee46df tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:22.530367 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb1ef092-32a5-4f6c-aa44-18b843ee46df tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:22.531340 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb1ef092-32a5-4f6c-aa44-18b843ee46df tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:22.531810 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb1ef092-32a5-4f6c-aa44-18b843ee46df tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:22.549549 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-eb1ef092-32a5-4f6c-aa44-18b843ee46df tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Getting quotas for project 8c0975684af442a3ae7a012fa13b2645. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:57:22.554843 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-eb1ef092-32a5-4f6c-aa44-18b843ee46df tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Getting quotas for user 86d384f3ab5949b0bddc35f6bdb7fac0 and project 8c0975684af442a3ae7a012fa13b2645. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:57:22.567606 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-eb1ef092-32a5-4f6c-aa44-18b843ee46df tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:57:22.569957 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-eb1ef092-32a5-4f6c-aa44-18b843ee46df tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] [instance: 554f5818-a67a-4f38-91a7-e7100c2bc0d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:57:22.616180 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-eb1ef092-32a5-4f6c-aa44-18b843ee46df tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519805 Aug 07 01:57:22.616846 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3369/6273] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:57:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:57:22.628503 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-087f56e1-bb39-450c-a438-912ecf7970bd tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:22.629196 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-087f56e1-bb39-450c-a438-912ecf7970bd tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] [instance: 554f5818-a67a-4f38-91a7-e7100c2bc0d0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:22.692684 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-087f56e1-bb39-450c-a438-912ecf7970bd tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/554f5818-a67a-4f38-91a7-e7100c2bc0d0" status: 200 len: 1329 microversion: 2.1 time: 0.068158 Aug 07 01:57:22.693260 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2905/6274] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:22 2022] GET /compute/v2.1/servers/554f5818-a67a-4f38-91a7-e7100c2bc0d0 => generated 1329 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:23.503619 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-86e50770-7847-473f-be3b-26d4f02519aa tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:23.504232 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-86e50770-7847-473f-be3b-26d4f02519aa tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:23.513003 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86e50770-7847-473f-be3b-26d4f02519aa tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:23.513505 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86e50770-7847-473f-be3b-26d4f02519aa tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:23.513959 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86e50770-7847-473f-be3b-26d4f02519aa tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:23.514682 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86e50770-7847-473f-be3b-26d4f02519aa tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:23.515670 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86e50770-7847-473f-be3b-26d4f02519aa tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:23.516144 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86e50770-7847-473f-be3b-26d4f02519aa tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:23.650414 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-86e50770-7847-473f-be3b-26d4f02519aa tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:57:23.660134 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-86e50770-7847-473f-be3b-26d4f02519aa tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1694 microversion: 2.1 time: 0.160566 Aug 07 01:57:23.660909 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3370/6275] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:23 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:57:23.713442 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-646c7186-53f5-4df6-a222-200f0a529512 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:23.714083 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-646c7186-53f5-4df6-a222-200f0a529512 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] [instance: 554f5818-a67a-4f38-91a7-e7100c2bc0d0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:23.723143 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-646c7186-53f5-4df6-a222-200f0a529512 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:23.723636 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-646c7186-53f5-4df6-a222-200f0a529512 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:23.724140 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-646c7186-53f5-4df6-a222-200f0a529512 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:23.724851 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-646c7186-53f5-4df6-a222-200f0a529512 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:23.725316 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-646c7186-53f5-4df6-a222-200f0a529512 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:23.725751 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-646c7186-53f5-4df6-a222-200f0a529512 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:23.794710 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-646c7186-53f5-4df6-a222-200f0a529512 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/554f5818-a67a-4f38-91a7-e7100c2bc0d0" status: 200 len: 1346 microversion: 2.1 time: 0.085138 Aug 07 01:57:23.795292 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2906/6276] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:23 2022] GET /compute/v2.1/servers/554f5818-a67a-4f38-91a7-e7100c2bc0d0 => generated 1346 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:24.642461 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-67273ebd-8530-4367-934d-9eb75ae7fe9e req-6eae2c94-6765-491b-bf84-56fb655683df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3830b32-dbd9-4a68-aa42-c1a65475f350", "name": "network-vif-unplugged", "status": "completed", "tag": "f613fc8e-fa17-4341-89eb-ed1552b81ad5"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:57:24.653953 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-67273ebd-8530-4367-934d-9eb75ae7fe9e req-6eae2c94-6765-491b-bf84-56fb655683df service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:24.654836 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-67273ebd-8530-4367-934d-9eb75ae7fe9e req-6eae2c94-6765-491b-bf84-56fb655683df service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:24.656061 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-67273ebd-8530-4367-934d-9eb75ae7fe9e req-6eae2c94-6765-491b-bf84-56fb655683df service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:24.669066 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-67273ebd-8530-4367-934d-9eb75ae7fe9e req-6eae2c94-6765-491b-bf84-56fb655683df service nova] Creating event network-vif-unplugged:f613fc8e-fa17-4341-89eb-ed1552b81ad5 for instance f3830b32-dbd9-4a68-aa42-c1a65475f350 on n-h1-master-1 Aug 07 01:57:24.675282 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [req-67273ebd-8530-4367-934d-9eb75ae7fe9e req-6eae2c94-6765-491b-bf84-56fb655683df service nova] Instance f3830b32-dbd9-4a68-aa42-c1a65475f350 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 01:57:24.682937 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c271eb1b-3c68-4c0f-8bb5-52200133c038 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:24.683721 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c271eb1b-3c68-4c0f-8bb5-52200133c038 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:24.693309 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c271eb1b-3c68-4c0f-8bb5-52200133c038 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:24.696755 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c271eb1b-3c68-4c0f-8bb5-52200133c038 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:24.697338 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c271eb1b-3c68-4c0f-8bb5-52200133c038 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:24.698185 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c271eb1b-3c68-4c0f-8bb5-52200133c038 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:24.701034 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c271eb1b-3c68-4c0f-8bb5-52200133c038 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:24.701779 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c271eb1b-3c68-4c0f-8bb5-52200133c038 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:24.703364 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-67273ebd-8530-4367-934d-9eb75ae7fe9e req-6eae2c94-6765-491b-bf84-56fb655683df service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065073 Aug 07 01:57:24.704416 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3371/6277] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:57:24.721321 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:57:24.817936 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-128d781b-115a-4216-a849-d627070ff53c tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:24.818927 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-128d781b-115a-4216-a849-d627070ff53c tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] [instance: 554f5818-a67a-4f38-91a7-e7100c2bc0d0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:24.826146 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-128d781b-115a-4216-a849-d627070ff53c tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:24.826742 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-128d781b-115a-4216-a849-d627070ff53c tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:24.827962 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-128d781b-115a-4216-a849-d627070ff53c tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:24.828950 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-128d781b-115a-4216-a849-d627070ff53c tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:24.829415 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-128d781b-115a-4216-a849-d627070ff53c tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:24.830042 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-128d781b-115a-4216-a849-d627070ff53c tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:24.848959 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:57:24.930329 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-128d781b-115a-4216-a849-d627070ff53c tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/554f5818-a67a-4f38-91a7-e7100c2bc0d0" status: 200 len: 1422 microversion: 2.1 time: 0.116786 Aug 07 01:57:24.932012 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3372/6278] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:24 2022] GET /compute/v2.1/servers/554f5818-a67a-4f38-91a7-e7100c2bc0d0 => generated 1422 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:24.961439 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c271eb1b-3c68-4c0f-8bb5-52200133c038 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:57:24.969902 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c271eb1b-3c68-4c0f-8bb5-52200133c038 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1693 microversion: 2.1 time: 0.290874 Aug 07 01:57:24.970488 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2907/6279] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:24 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1693 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:57:25.724261 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-a6d7e544-6cc1-416d-8929-38abdb2e0ea5 req-e6cca9dd-f598-4a01-9ad9-c60fabb36291 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "554f5818-a67a-4f38-91a7-e7100c2bc0d0", "tag": "c169c06a-0939-4828-a6fa-28f73acd425a"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:57:25.735586 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a6d7e544-6cc1-416d-8929-38abdb2e0ea5 req-e6cca9dd-f598-4a01-9ad9-c60fabb36291 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:25.736216 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a6d7e544-6cc1-416d-8929-38abdb2e0ea5 req-e6cca9dd-f598-4a01-9ad9-c60fabb36291 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:25.736962 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a6d7e544-6cc1-416d-8929-38abdb2e0ea5 req-e6cca9dd-f598-4a01-9ad9-c60fabb36291 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:25.749487 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-a6d7e544-6cc1-416d-8929-38abdb2e0ea5 req-e6cca9dd-f598-4a01-9ad9-c60fabb36291 service nova] Creating event network-changed:c169c06a-0939-4828-a6fa-28f73acd425a for instance 554f5818-a67a-4f38-91a7-e7100c2bc0d0 on n-h2-master-1 Aug 07 01:57:25.754490 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-a6d7e544-6cc1-416d-8929-38abdb2e0ea5 req-e6cca9dd-f598-4a01-9ad9-c60fabb36291 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034072 Aug 07 01:57:25.755476 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3373/6280] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:57:25.954019 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-50f5214a-9eec-490f-b80c-1a0fdb8f5c41 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:25.954604 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-50f5214a-9eec-490f-b80c-1a0fdb8f5c41 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] [instance: 554f5818-a67a-4f38-91a7-e7100c2bc0d0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:25.961988 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-50f5214a-9eec-490f-b80c-1a0fdb8f5c41 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:25.962507 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-50f5214a-9eec-490f-b80c-1a0fdb8f5c41 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:25.962937 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-50f5214a-9eec-490f-b80c-1a0fdb8f5c41 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:25.963657 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-50f5214a-9eec-490f-b80c-1a0fdb8f5c41 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:25.964185 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-50f5214a-9eec-490f-b80c-1a0fdb8f5c41 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:25.964620 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-50f5214a-9eec-490f-b80c-1a0fdb8f5c41 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:25.992074 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-32717248-c020-457b-a9ca-999b1308c230 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:25.992822 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-32717248-c020-457b-a9ca-999b1308c230 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:25.999946 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32717248-c020-457b-a9ca-999b1308c230 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:26.000485 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32717248-c020-457b-a9ca-999b1308c230 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:26.000942 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32717248-c020-457b-a9ca-999b1308c230 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:26.001692 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32717248-c020-457b-a9ca-999b1308c230 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:26.002202 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32717248-c020-457b-a9ca-999b1308c230 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:26.002653 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-32717248-c020-457b-a9ca-999b1308c230 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:26.094709 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-50f5214a-9eec-490f-b80c-1a0fdb8f5c41 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/554f5818-a67a-4f38-91a7-e7100c2bc0d0" status: 200 len: 1464 microversion: 2.1 time: 0.144904 Aug 07 01:57:26.095396 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2908/6281] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:25 2022] GET /compute/v2.1/servers/554f5818-a67a-4f38-91a7-e7100c2bc0d0 => generated 1464 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:26.219770 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-32717248-c020-457b-a9ca-999b1308c230 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:57:26.227498 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-32717248-c020-457b-a9ca-999b1308c230 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1691 microversion: 2.1 time: 0.240086 Aug 07 01:57:26.228170 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3374/6282] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:25 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1691 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:57:26.725071 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-9bace317-8909-4b0c-83d8-768c367b9137 req-15b66e04-661b-4ede-bae4-8c2ed3ecfe40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3830b32-dbd9-4a68-aa42-c1a65475f350", "tag": "f613fc8e-fa17-4341-89eb-ed1552b81ad5"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:57:26.734548 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-9bace317-8909-4b0c-83d8-768c367b9137 req-15b66e04-661b-4ede-bae4-8c2ed3ecfe40 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:26.735021 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-9bace317-8909-4b0c-83d8-768c367b9137 req-15b66e04-661b-4ede-bae4-8c2ed3ecfe40 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:26.735450 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-9bace317-8909-4b0c-83d8-768c367b9137 req-15b66e04-661b-4ede-bae4-8c2ed3ecfe40 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:26.747026 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-9bace317-8909-4b0c-83d8-768c367b9137 req-15b66e04-661b-4ede-bae4-8c2ed3ecfe40 service nova] Creating event network-changed:f613fc8e-fa17-4341-89eb-ed1552b81ad5 for instance f3830b32-dbd9-4a68-aa42-c1a65475f350 on n-h1-master-1 Aug 07 01:57:26.752350 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [req-9bace317-8909-4b0c-83d8-768c367b9137 req-15b66e04-661b-4ede-bae4-8c2ed3ecfe40 service nova] Instance f3830b32-dbd9-4a68-aa42-c1a65475f350 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 01:57:26.763214 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-9bace317-8909-4b0c-83d8-768c367b9137 req-15b66e04-661b-4ede-bae4-8c2ed3ecfe40 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041831 Aug 07 01:57:26.763807 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2909/6283] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:57:27.115365 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-71b8ca2c-53d8-4858-b607-d7b62e4370e4 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:27.116140 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-71b8ca2c-53d8-4858-b607-d7b62e4370e4 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] [instance: 554f5818-a67a-4f38-91a7-e7100c2bc0d0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:27.123147 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-71b8ca2c-53d8-4858-b607-d7b62e4370e4 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:27.123631 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-71b8ca2c-53d8-4858-b607-d7b62e4370e4 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:27.124748 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-71b8ca2c-53d8-4858-b607-d7b62e4370e4 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:27.127066 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-71b8ca2c-53d8-4858-b607-d7b62e4370e4 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:27.127561 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-71b8ca2c-53d8-4858-b607-d7b62e4370e4 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:27.128022 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-71b8ca2c-53d8-4858-b607-d7b62e4370e4 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:27.255654 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d3f42918-d3de-4672-9997-86a30141e787 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:27.256778 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d3f42918-d3de-4672-9997-86a30141e787 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:27.268106 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d3f42918-d3de-4672-9997-86a30141e787 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:27.269225 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d3f42918-d3de-4672-9997-86a30141e787 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:27.270131 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d3f42918-d3de-4672-9997-86a30141e787 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:27.271621 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d3f42918-d3de-4672-9997-86a30141e787 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:27.272498 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d3f42918-d3de-4672-9997-86a30141e787 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:27.273191 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d3f42918-d3de-4672-9997-86a30141e787 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:27.377948 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-71b8ca2c-53d8-4858-b607-d7b62e4370e4 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/554f5818-a67a-4f38-91a7-e7100c2bc0d0" status: 200 len: 1464 microversion: 2.1 time: 0.266877 Aug 07 01:57:27.378981 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3375/6284] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:27 2022] GET /compute/v2.1/servers/554f5818-a67a-4f38-91a7-e7100c2bc0d0 => generated 1464 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:27.998743 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d3f42918-d3de-4672-9997-86a30141e787 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:57:28.006571 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d3f42918-d3de-4672-9997-86a30141e787 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1691 microversion: 2.1 time: 0.759704 Aug 07 01:57:28.007251 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2910/6285] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:27 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1691 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:28.398602 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b07ba775-2622-48f7-89de-0b98efcf3f3e tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:28.399278 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b07ba775-2622-48f7-89de-0b98efcf3f3e tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] [instance: 554f5818-a67a-4f38-91a7-e7100c2bc0d0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:28.407440 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b07ba775-2622-48f7-89de-0b98efcf3f3e tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:28.407975 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b07ba775-2622-48f7-89de-0b98efcf3f3e tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:28.408429 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b07ba775-2622-48f7-89de-0b98efcf3f3e tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:28.409155 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b07ba775-2622-48f7-89de-0b98efcf3f3e tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:28.409622 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b07ba775-2622-48f7-89de-0b98efcf3f3e tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:28.410088 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b07ba775-2622-48f7-89de-0b98efcf3f3e tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:28.537658 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b07ba775-2622-48f7-89de-0b98efcf3f3e tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/554f5818-a67a-4f38-91a7-e7100c2bc0d0" status: 200 len: 1464 microversion: 2.1 time: 0.142835 Aug 07 01:57:28.538242 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3376/6286] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:28 2022] GET /compute/v2.1/servers/554f5818-a67a-4f38-91a7-e7100c2bc0d0 => generated 1464 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:29.028624 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-100245db-95df-408a-afcf-7a708819e03f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:29.029175 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-100245db-95df-408a-afcf-7a708819e03f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:29.036358 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-100245db-95df-408a-afcf-7a708819e03f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:29.036922 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-100245db-95df-408a-afcf-7a708819e03f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:29.037350 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-100245db-95df-408a-afcf-7a708819e03f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:29.038001 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-100245db-95df-408a-afcf-7a708819e03f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:29.038466 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-100245db-95df-408a-afcf-7a708819e03f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:29.038903 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-100245db-95df-408a-afcf-7a708819e03f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:29.179155 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-100245db-95df-408a-afcf-7a708819e03f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:57:29.187120 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-100245db-95df-408a-afcf-7a708819e03f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1688 microversion: 2.1 time: 0.162487 Aug 07 01:57:29.187815 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2911/6287] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:29 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:29.208767 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4776f0ff-c3d6-4064-9da9-048cd409a0b7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:57:29.209327 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4776f0ff-c3d6-4064-9da9-048cd409a0b7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:29.215336 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4776f0ff-c3d6-4064-9da9-048cd409a0b7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:29.216671 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4776f0ff-c3d6-4064-9da9-048cd409a0b7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:29.217164 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4776f0ff-c3d6-4064-9da9-048cd409a0b7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:29.218757 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4776f0ff-c3d6-4064-9da9-048cd409a0b7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:29.219247 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4776f0ff-c3d6-4064-9da9-048cd409a0b7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:29.219684 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4776f0ff-c3d6-4064-9da9-048cd409a0b7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:29.339476 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4776f0ff-c3d6-4064-9da9-048cd409a0b7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "POST /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350/action" status: 202 len: 0 microversion: 2.1 time: 0.134690 Aug 07 01:57:29.340258 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3377/6288] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:57:29 2022] POST /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:57:29.349005 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cfb5b11f-b849-4d41-88e9-369929994ade tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:29.349632 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-cfb5b11f-b849-4d41-88e9-369929994ade tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:29.356148 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cfb5b11f-b849-4d41-88e9-369929994ade tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:29.356602 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cfb5b11f-b849-4d41-88e9-369929994ade tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:29.357456 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cfb5b11f-b849-4d41-88e9-369929994ade tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:29.359118 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cfb5b11f-b849-4d41-88e9-369929994ade tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:29.359732 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cfb5b11f-b849-4d41-88e9-369929994ade tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:29.360412 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cfb5b11f-b849-4d41-88e9-369929994ade tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:29.560425 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6a0bc5c4-50cc-4c13-9880-2289abfe4d23 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:29.561064 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6a0bc5c4-50cc-4c13-9880-2289abfe4d23 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] [instance: 554f5818-a67a-4f38-91a7-e7100c2bc0d0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:29.570115 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a0bc5c4-50cc-4c13-9880-2289abfe4d23 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:29.570617 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a0bc5c4-50cc-4c13-9880-2289abfe4d23 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:29.571393 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a0bc5c4-50cc-4c13-9880-2289abfe4d23 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:29.572152 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a0bc5c4-50cc-4c13-9880-2289abfe4d23 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:29.572626 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a0bc5c4-50cc-4c13-9880-2289abfe4d23 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:29.573062 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a0bc5c4-50cc-4c13-9880-2289abfe4d23 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:29.628708 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-cfb5b11f-b849-4d41-88e9-369929994ade tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:57:29.637686 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cfb5b11f-b849-4d41-88e9-369929994ade tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1687 microversion: 2.1 time: 0.292595 Aug 07 01:57:29.646672 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2912/6289] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:29 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1687 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:29.741314 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6a0bc5c4-50cc-4c13-9880-2289abfe4d23 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/554f5818-a67a-4f38-91a7-e7100c2bc0d0" status: 200 len: 1464 microversion: 2.1 time: 0.186269 Aug 07 01:57:29.742219 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3378/6290] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:29 2022] GET /compute/v2.1/servers/554f5818-a67a-4f38-91a7-e7100c2bc0d0 => generated 1464 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:30.660201 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-816e955e-3b56-4d74-b972-bf95d37ce0f8 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:30.660854 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-816e955e-3b56-4d74-b972-bf95d37ce0f8 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:30.667848 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-816e955e-3b56-4d74-b972-bf95d37ce0f8 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:30.668365 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-816e955e-3b56-4d74-b972-bf95d37ce0f8 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:30.668808 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-816e955e-3b56-4d74-b972-bf95d37ce0f8 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:30.669520 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-816e955e-3b56-4d74-b972-bf95d37ce0f8 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:30.669977 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-816e955e-3b56-4d74-b972-bf95d37ce0f8 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:30.670411 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-816e955e-3b56-4d74-b972-bf95d37ce0f8 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:30.762585 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-69e30e13-97ab-4c85-a482-c735d6a69711 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:30.763227 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-69e30e13-97ab-4c85-a482-c735d6a69711 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] [instance: 554f5818-a67a-4f38-91a7-e7100c2bc0d0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:30.770646 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-69e30e13-97ab-4c85-a482-c735d6a69711 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:30.771421 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-69e30e13-97ab-4c85-a482-c735d6a69711 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:30.771894 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-69e30e13-97ab-4c85-a482-c735d6a69711 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:30.772654 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-69e30e13-97ab-4c85-a482-c735d6a69711 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:30.773131 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-69e30e13-97ab-4c85-a482-c735d6a69711 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:30.773590 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-69e30e13-97ab-4c85-a482-c735d6a69711 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:30.816531 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-816e955e-3b56-4d74-b972-bf95d37ce0f8 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:57:30.824870 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-816e955e-3b56-4d74-b972-bf95d37ce0f8 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1687 microversion: 2.1 time: 0.168349 Aug 07 01:57:30.825580 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2913/6291] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:30 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:30.906269 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-69e30e13-97ab-4c85-a482-c735d6a69711 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/554f5818-a67a-4f38-91a7-e7100c2bc0d0" status: 200 len: 1464 microversion: 2.1 time: 0.147404 Aug 07 01:57:30.906856 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3379/6292] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:30 2022] GET /compute/v2.1/servers/554f5818-a67a-4f38-91a7-e7100c2bc0d0 => generated 1464 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:57:31.303963 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-b29d3fad-97d1-40e3-8b8f-61df179ba9e2 req-6e220826-0242-4876-9eb7-cd7c9b446588 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "554f5818-a67a-4f38-91a7-e7100c2bc0d0", "name": "network-vif-plugged", "status": "completed", "tag": "c169c06a-0939-4828-a6fa-28f73acd425a"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:57:31.316752 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b29d3fad-97d1-40e3-8b8f-61df179ba9e2 req-6e220826-0242-4876-9eb7-cd7c9b446588 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:31.318417 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b29d3fad-97d1-40e3-8b8f-61df179ba9e2 req-6e220826-0242-4876-9eb7-cd7c9b446588 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:31.318417 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b29d3fad-97d1-40e3-8b8f-61df179ba9e2 req-6e220826-0242-4876-9eb7-cd7c9b446588 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:31.332664 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-b29d3fad-97d1-40e3-8b8f-61df179ba9e2 req-6e220826-0242-4876-9eb7-cd7c9b446588 service nova] Creating event network-vif-plugged:c169c06a-0939-4828-a6fa-28f73acd425a for instance 554f5818-a67a-4f38-91a7-e7100c2bc0d0 on n-h2-master-1 Aug 07 01:57:31.339303 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-b29d3fad-97d1-40e3-8b8f-61df179ba9e2 req-6e220826-0242-4876-9eb7-cd7c9b446588 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039900 Aug 07 01:57:31.340130 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2914/6293] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:57:31.846638 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-030e95ae-620a-4ad3-abf3-a89295472517 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:31.847261 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-030e95ae-620a-4ad3-abf3-a89295472517 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:31.854169 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-030e95ae-620a-4ad3-abf3-a89295472517 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:31.854711 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-030e95ae-620a-4ad3-abf3-a89295472517 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:31.855155 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-030e95ae-620a-4ad3-abf3-a89295472517 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:31.855860 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-030e95ae-620a-4ad3-abf3-a89295472517 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:31.856355 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-030e95ae-620a-4ad3-abf3-a89295472517 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:31.856791 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-030e95ae-620a-4ad3-abf3-a89295472517 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:31.928967 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b253e0af-8741-4c79-8862-4a208c762e0b tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:31.929671 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b253e0af-8741-4c79-8862-4a208c762e0b tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] [instance: 554f5818-a67a-4f38-91a7-e7100c2bc0d0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:31.937398 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b253e0af-8741-4c79-8862-4a208c762e0b tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:31.937881 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b253e0af-8741-4c79-8862-4a208c762e0b tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:31.938396 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b253e0af-8741-4c79-8862-4a208c762e0b tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:31.939205 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b253e0af-8741-4c79-8862-4a208c762e0b tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:31.939688 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b253e0af-8741-4c79-8862-4a208c762e0b tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:31.940142 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b253e0af-8741-4c79-8862-4a208c762e0b tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:32.002928 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-030e95ae-620a-4ad3-abf3-a89295472517 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:57:32.010522 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-030e95ae-620a-4ad3-abf3-a89295472517 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1687 microversion: 2.1 time: 0.167804 Aug 07 01:57:32.011089 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3380/6294] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:31 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:32.074130 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b253e0af-8741-4c79-8862-4a208c762e0b tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/554f5818-a67a-4f38-91a7-e7100c2bc0d0" status: 200 len: 1464 microversion: 2.1 time: 0.149705 Aug 07 01:57:32.075197 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2915/6295] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:31 2022] GET /compute/v2.1/servers/554f5818-a67a-4f38-91a7-e7100c2bc0d0 => generated 1464 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:57:33.032057 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-62a86918-d038-4339-9e07-efc760270c12 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:33.032768 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-62a86918-d038-4339-9e07-efc760270c12 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:33.034889 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:57:33.035799 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:57:33.037627 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:57:33.044998 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62a86918-d038-4339-9e07-efc760270c12 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:33.045901 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62a86918-d038-4339-9e07-efc760270c12 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:33.046426 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62a86918-d038-4339-9e07-efc760270c12 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:33.047230 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62a86918-d038-4339-9e07-efc760270c12 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:33.047753 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62a86918-d038-4339-9e07-efc760270c12 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:33.048288 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62a86918-d038-4339-9e07-efc760270c12 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:33.080556 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-0e725b95-2095-4551-b8a2-19da719565c4 req-acf965c2-3477-40a2-93cf-965628b550e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3830b32-dbd9-4a68-aa42-c1a65475f350", "name": "network-vif-unplugged", "status": "completed", "tag": "f613fc8e-fa17-4341-89eb-ed1552b81ad5"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:57:33.086910 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:57:33.095439 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0e725b95-2095-4551-b8a2-19da719565c4 req-acf965c2-3477-40a2-93cf-965628b550e1 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:33.095962 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0e725b95-2095-4551-b8a2-19da719565c4 req-acf965c2-3477-40a2-93cf-965628b550e1 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:33.096591 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0e725b95-2095-4551-b8a2-19da719565c4 req-acf965c2-3477-40a2-93cf-965628b550e1 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:33.109481 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-0e725b95-2095-4551-b8a2-19da719565c4 req-acf965c2-3477-40a2-93cf-965628b550e1 service nova] Creating event network-vif-unplugged:f613fc8e-fa17-4341-89eb-ed1552b81ad5 for instance f3830b32-dbd9-4a68-aa42-c1a65475f350 on n-h2-master-1 Aug 07 01:57:33.115322 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [req-0e725b95-2095-4551-b8a2-19da719565c4 req-acf965c2-3477-40a2-93cf-965628b550e1 service nova] Instance f3830b32-dbd9-4a68-aa42-c1a65475f350 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 01:57:33.128606 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-0e725b95-2095-4551-b8a2-19da719565c4 req-acf965c2-3477-40a2-93cf-965628b550e1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054404 Aug 07 01:57:33.129544 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2916/6296] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:57:33.134837 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-401b7533-5876-4ef8-b080-b270df460964 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:33.135563 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-401b7533-5876-4ef8-b080-b270df460964 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] [instance: 554f5818-a67a-4f38-91a7-e7100c2bc0d0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:33.142608 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-401b7533-5876-4ef8-b080-b270df460964 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:33.143326 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-401b7533-5876-4ef8-b080-b270df460964 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:33.143774 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-401b7533-5876-4ef8-b080-b270df460964 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:33.144523 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-401b7533-5876-4ef8-b080-b270df460964 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:33.144989 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-401b7533-5876-4ef8-b080-b270df460964 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:33.145427 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-401b7533-5876-4ef8-b080-b270df460964 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:33.201516 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-62a86918-d038-4339-9e07-efc760270c12 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:57:33.210330 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-62a86918-d038-4339-9e07-efc760270c12 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1687 microversion: 2.1 time: 0.182282 Aug 07 01:57:33.210925 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3381/6297] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:33 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1687 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:33.356776 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-d04ece2e-d59e-44d9-a78c-f734bd032e3e req-afcac6de-ef9e-49bb-85ef-6a49f29efc0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3830b32-dbd9-4a68-aa42-c1a65475f350", "name": "network-vif-plugged", "status": "completed", "tag": "f613fc8e-fa17-4341-89eb-ed1552b81ad5"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:57:33.367222 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d04ece2e-d59e-44d9-a78c-f734bd032e3e req-afcac6de-ef9e-49bb-85ef-6a49f29efc0c service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:33.367719 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d04ece2e-d59e-44d9-a78c-f734bd032e3e req-afcac6de-ef9e-49bb-85ef-6a49f29efc0c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:33.368391 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d04ece2e-d59e-44d9-a78c-f734bd032e3e req-afcac6de-ef9e-49bb-85ef-6a49f29efc0c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:33.381937 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-d04ece2e-d59e-44d9-a78c-f734bd032e3e req-afcac6de-ef9e-49bb-85ef-6a49f29efc0c service nova] Creating event network-vif-plugged:f613fc8e-fa17-4341-89eb-ed1552b81ad5 for instance f3830b32-dbd9-4a68-aa42-c1a65475f350 on n-h2-master-1 Aug 07 01:57:33.387385 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-401b7533-5876-4ef8-b080-b270df460964 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/554f5818-a67a-4f38-91a7-e7100c2bc0d0" status: 200 len: 1650 microversion: 2.1 time: 0.256411 Aug 07 01:57:33.388077 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2917/6298] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:33 2022] GET /compute/v2.1/servers/554f5818-a67a-4f38-91a7-e7100c2bc0d0 => generated 1650 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:33.400038 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [req-d04ece2e-d59e-44d9-a78c-f734bd032e3e req-afcac6de-ef9e-49bb-85ef-6a49f29efc0c service nova] Instance f3830b32-dbd9-4a68-aa42-c1a65475f350 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 01:57:33.400302 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-d04ece2e-d59e-44d9-a78c-f734bd032e3e req-afcac6de-ef9e-49bb-85ef-6a49f29efc0c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047373 Aug 07 01:57:33.400908 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3382/6299] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:57:33.407680 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-50ad7741-28f7-482b-bde8-d85cd3dff113 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:33.408330 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-50ad7741-28f7-482b-bde8-d85cd3dff113 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] [instance: 554f5818-a67a-4f38-91a7-e7100c2bc0d0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:33.415264 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-50ad7741-28f7-482b-bde8-d85cd3dff113 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:33.415748 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-50ad7741-28f7-482b-bde8-d85cd3dff113 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:33.416248 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-50ad7741-28f7-482b-bde8-d85cd3dff113 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:33.416957 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-50ad7741-28f7-482b-bde8-d85cd3dff113 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:33.417409 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-50ad7741-28f7-482b-bde8-d85cd3dff113 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:33.417852 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-50ad7741-28f7-482b-bde8-d85cd3dff113 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:33.668332 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-50ad7741-28f7-482b-bde8-d85cd3dff113 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/554f5818-a67a-4f38-91a7-e7100c2bc0d0" status: 200 len: 1650 microversion: 2.1 time: 0.264139 Aug 07 01:57:33.669151 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2918/6300] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:33 2022] GET /compute/v2.1/servers/554f5818-a67a-4f38-91a7-e7100c2bc0d0 => generated 1650 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:33.689447 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-65cb9aa5-9108-42f3-9048-b21de3431fb2 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:33.690170 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-65cb9aa5-9108-42f3-9048-b21de3431fb2 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] [instance: 554f5818-a67a-4f38-91a7-e7100c2bc0d0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:33.696676 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-65cb9aa5-9108-42f3-9048-b21de3431fb2 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:33.697184 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-65cb9aa5-9108-42f3-9048-b21de3431fb2 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:33.697631 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-65cb9aa5-9108-42f3-9048-b21de3431fb2 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:33.698389 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-65cb9aa5-9108-42f3-9048-b21de3431fb2 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:33.698865 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-65cb9aa5-9108-42f3-9048-b21de3431fb2 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:33.699302 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-65cb9aa5-9108-42f3-9048-b21de3431fb2 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:33.830493 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-65cb9aa5-9108-42f3-9048-b21de3431fb2 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/554f5818-a67a-4f38-91a7-e7100c2bc0d0" status: 200 len: 1650 microversion: 2.1 time: 0.145066 Aug 07 01:57:33.831088 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3383/6301] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:33 2022] GET /compute/v2.1/servers/554f5818-a67a-4f38-91a7-e7100c2bc0d0 => generated 1650 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:33.851129 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-586b9e89-29b5-48f1-9830-0c61d888e93a tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:33.851682 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-586b9e89-29b5-48f1-9830-0c61d888e93a tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] [instance: 554f5818-a67a-4f38-91a7-e7100c2bc0d0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:33.857874 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-586b9e89-29b5-48f1-9830-0c61d888e93a tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:33.858903 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-586b9e89-29b5-48f1-9830-0c61d888e93a tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:33.859339 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-586b9e89-29b5-48f1-9830-0c61d888e93a tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:33.860118 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-586b9e89-29b5-48f1-9830-0c61d888e93a tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:33.860572 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-586b9e89-29b5-48f1-9830-0c61d888e93a tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:33.860995 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-586b9e89-29b5-48f1-9830-0c61d888e93a tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:33.885738 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-586b9e89-29b5-48f1-9830-0c61d888e93a tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] [instance: 554f5818-a67a-4f38-91a7-e7100c2bc0d0] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:57:33.971064 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-586b9e89-29b5-48f1-9830-0c61d888e93a tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] 10.222.0.39 "DELETE /compute/v2.1/servers/554f5818-a67a-4f38-91a7-e7100c2bc0d0" status: 204 len: 0 microversion: 2.1 time: 0.123489 Aug 07 01:57:33.972145 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2919/6302] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:57:33 2022] DELETE /compute/v2.1/servers/554f5818-a67a-4f38-91a7-e7100c2bc0d0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:57:33.980642 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0b590129-97ad-4a11-9815-dc33c5e5fa01 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:33.981266 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0b590129-97ad-4a11-9815-dc33c5e5fa01 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] [instance: 554f5818-a67a-4f38-91a7-e7100c2bc0d0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:33.989222 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b590129-97ad-4a11-9815-dc33c5e5fa01 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:33.989994 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b590129-97ad-4a11-9815-dc33c5e5fa01 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:33.990446 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b590129-97ad-4a11-9815-dc33c5e5fa01 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:33.991174 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b590129-97ad-4a11-9815-dc33c5e5fa01 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:33.991638 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b590129-97ad-4a11-9815-dc33c5e5fa01 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:33.992115 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b590129-97ad-4a11-9815-dc33c5e5fa01 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:34.119196 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0b590129-97ad-4a11-9815-dc33c5e5fa01 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/554f5818-a67a-4f38-91a7-e7100c2bc0d0" status: 200 len: 1656 microversion: 2.1 time: 0.142533 Aug 07 01:57:34.119839 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3384/6303] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:33 2022] GET /compute/v2.1/servers/554f5818-a67a-4f38-91a7-e7100c2bc0d0 => generated 1656 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:34.231307 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f1469d8e-0d1d-44cd-9521-d38c7209f533 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:34.232062 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f1469d8e-0d1d-44cd-9521-d38c7209f533 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:34.238948 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1469d8e-0d1d-44cd-9521-d38c7209f533 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:34.239441 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1469d8e-0d1d-44cd-9521-d38c7209f533 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:34.240181 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1469d8e-0d1d-44cd-9521-d38c7209f533 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:34.240886 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1469d8e-0d1d-44cd-9521-d38c7209f533 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:34.241349 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1469d8e-0d1d-44cd-9521-d38c7209f533 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:34.241783 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1469d8e-0d1d-44cd-9521-d38c7209f533 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:34.383696 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f1469d8e-0d1d-44cd-9521-d38c7209f533 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:57:34.392299 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f1469d8e-0d1d-44cd-9521-d38c7209f533 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1687 microversion: 2.1 time: 0.165208 Aug 07 01:57:34.392895 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2920/6304] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:34 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:35.141766 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4697ddc9-3ba7-416f-8db2-984f1a76d52f tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:35.142553 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4697ddc9-3ba7-416f-8db2-984f1a76d52f tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] [instance: 554f5818-a67a-4f38-91a7-e7100c2bc0d0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:35.149590 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4697ddc9-3ba7-416f-8db2-984f1a76d52f tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:35.150092 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4697ddc9-3ba7-416f-8db2-984f1a76d52f tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:35.150549 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4697ddc9-3ba7-416f-8db2-984f1a76d52f tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:35.151269 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4697ddc9-3ba7-416f-8db2-984f1a76d52f tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:35.151741 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4697ddc9-3ba7-416f-8db2-984f1a76d52f tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:35.152227 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4697ddc9-3ba7-416f-8db2-984f1a76d52f tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:35.166764 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-a8c70ef7-1f4a-4d8b-9015-a32d70672202 req-f326f277-8a9e-4b77-acaa-403a7c453d49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3830b32-dbd9-4a68-aa42-c1a65475f350", "tag": "f613fc8e-fa17-4341-89eb-ed1552b81ad5"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:57:35.177202 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a8c70ef7-1f4a-4d8b-9015-a32d70672202 req-f326f277-8a9e-4b77-acaa-403a7c453d49 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:35.177690 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a8c70ef7-1f4a-4d8b-9015-a32d70672202 req-f326f277-8a9e-4b77-acaa-403a7c453d49 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:35.178133 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a8c70ef7-1f4a-4d8b-9015-a32d70672202 req-f326f277-8a9e-4b77-acaa-403a7c453d49 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:35.191168 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-a8c70ef7-1f4a-4d8b-9015-a32d70672202 req-f326f277-8a9e-4b77-acaa-403a7c453d49 service nova] Creating event network-changed:f613fc8e-fa17-4341-89eb-ed1552b81ad5 for instance f3830b32-dbd9-4a68-aa42-c1a65475f350 on n-h2-master-1 Aug 07 01:57:35.198472 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [req-a8c70ef7-1f4a-4d8b-9015-a32d70672202 req-f326f277-8a9e-4b77-acaa-403a7c453d49 service nova] Instance f3830b32-dbd9-4a68-aa42-c1a65475f350 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 01:57:35.209572 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-a8c70ef7-1f4a-4d8b-9015-a32d70672202 req-f326f277-8a9e-4b77-acaa-403a7c453d49 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046402 Aug 07 01:57:35.210284 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2921/6305] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:57:35.287046 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4697ddc9-3ba7-416f-8db2-984f1a76d52f tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/554f5818-a67a-4f38-91a7-e7100c2bc0d0" status: 200 len: 1656 microversion: 2.1 time: 0.149629 Aug 07 01:57:35.288067 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3385/6306] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:35 2022] GET /compute/v2.1/servers/554f5818-a67a-4f38-91a7-e7100c2bc0d0 => generated 1656 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:35.414674 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d53b8482-ac8b-47da-a83c-eb5791b1f311 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:35.418978 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d53b8482-ac8b-47da-a83c-eb5791b1f311 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:35.427158 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d53b8482-ac8b-47da-a83c-eb5791b1f311 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:35.427677 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d53b8482-ac8b-47da-a83c-eb5791b1f311 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:35.428140 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d53b8482-ac8b-47da-a83c-eb5791b1f311 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:35.428907 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d53b8482-ac8b-47da-a83c-eb5791b1f311 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:35.429300 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d53b8482-ac8b-47da-a83c-eb5791b1f311 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:35.429733 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d53b8482-ac8b-47da-a83c-eb5791b1f311 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:35.675635 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d53b8482-ac8b-47da-a83c-eb5791b1f311 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:57:35.683827 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d53b8482-ac8b-47da-a83c-eb5791b1f311 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1687 microversion: 2.1 time: 0.273437 Aug 07 01:57:35.684458 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2922/6307] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:35 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1687 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:36.309712 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2ff68b5e-6254-4e3b-ab2e-d9279b08c334 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:36.310451 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2ff68b5e-6254-4e3b-ab2e-d9279b08c334 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] [instance: 554f5818-a67a-4f38-91a7-e7100c2bc0d0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:36.317395 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2ff68b5e-6254-4e3b-ab2e-d9279b08c334 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:36.317895 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2ff68b5e-6254-4e3b-ab2e-d9279b08c334 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:36.318349 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2ff68b5e-6254-4e3b-ab2e-d9279b08c334 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:36.319072 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2ff68b5e-6254-4e3b-ab2e-d9279b08c334 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:36.319538 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2ff68b5e-6254-4e3b-ab2e-d9279b08c334 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:36.320018 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2ff68b5e-6254-4e3b-ab2e-d9279b08c334 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:36.488249 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2ff68b5e-6254-4e3b-ab2e-d9279b08c334 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/554f5818-a67a-4f38-91a7-e7100c2bc0d0" status: 200 len: 1656 microversion: 2.1 time: 0.182205 Aug 07 01:57:36.488856 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3386/6308] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:36 2022] GET /compute/v2.1/servers/554f5818-a67a-4f38-91a7-e7100c2bc0d0 => generated 1656 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:36.706968 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-116d8523-3b65-493f-9c18-e942a8a6a6ed tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:36.707646 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-116d8523-3b65-493f-9c18-e942a8a6a6ed tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:36.716177 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-116d8523-3b65-493f-9c18-e942a8a6a6ed tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:36.717211 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-116d8523-3b65-493f-9c18-e942a8a6a6ed tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:36.717660 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-116d8523-3b65-493f-9c18-e942a8a6a6ed tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:36.718381 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-116d8523-3b65-493f-9c18-e942a8a6a6ed tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:36.718838 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-116d8523-3b65-493f-9c18-e942a8a6a6ed tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:36.719267 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-116d8523-3b65-493f-9c18-e942a8a6a6ed tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:36.909970 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-93c2bee0-0790-4c15-ae62-9296371aef01 req-d2ae73fa-dede-4282-990d-ddf7164ce497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "554f5818-a67a-4f38-91a7-e7100c2bc0d0", "name": "network-vif-deleted", "tag": "c169c06a-0939-4828-a6fa-28f73acd425a"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:57:36.937773 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-93c2bee0-0790-4c15-ae62-9296371aef01 req-d2ae73fa-dede-4282-990d-ddf7164ce497 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:36.938648 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-93c2bee0-0790-4c15-ae62-9296371aef01 req-d2ae73fa-dede-4282-990d-ddf7164ce497 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:36.940530 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-93c2bee0-0790-4c15-ae62-9296371aef01 req-d2ae73fa-dede-4282-990d-ddf7164ce497 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:36.986224 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-93c2bee0-0790-4c15-ae62-9296371aef01 req-d2ae73fa-dede-4282-990d-ddf7164ce497 service nova] Creating event network-vif-deleted:c169c06a-0939-4828-a6fa-28f73acd425a for instance 554f5818-a67a-4f38-91a7-e7100c2bc0d0 on n-h2-master-1 Aug 07 01:57:37.000324 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-93c2bee0-0790-4c15-ae62-9296371aef01 req-d2ae73fa-dede-4282-990d-ddf7164ce497 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093983 Aug 07 01:57:37.002000 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3387/6309] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:57:37.042525 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-116d8523-3b65-493f-9c18-e942a8a6a6ed tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:57:37.064215 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-116d8523-3b65-493f-9c18-e942a8a6a6ed tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1687 microversion: 2.1 time: 0.362077 Aug 07 01:57:37.065876 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2923/6310] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:36 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1687 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:37.511684 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2cd7e201-b456-436c-876a-434dc213f66f tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:37.512488 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2cd7e201-b456-436c-876a-434dc213f66f tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] [instance: 554f5818-a67a-4f38-91a7-e7100c2bc0d0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:37.518786 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2cd7e201-b456-436c-876a-434dc213f66f tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:37.519285 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2cd7e201-b456-436c-876a-434dc213f66f tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:37.519743 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2cd7e201-b456-436c-876a-434dc213f66f tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:37.520489 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2cd7e201-b456-436c-876a-434dc213f66f tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:37.520966 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2cd7e201-b456-436c-876a-434dc213f66f tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:37.521414 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2cd7e201-b456-436c-876a-434dc213f66f tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:37.535088 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-2cd7e201-b456-436c-876a-434dc213f66f tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] HTTP exception thrown: Instance 554f5818-a67a-4f38-91a7-e7100c2bc0d0 could not be found. Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2cd7e201-b456-436c-876a-434dc213f66f tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Request method failure captured: Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/554f5818-a67a-4f38-91a7-e7100c2bc0d0 HTTP/1.1 Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xv12LekAU2p5cq3FVj7ociE3xnZ4KFxa0m8nNGMoicUilK4J_ymFa8oDNmsL9GgFsKAhToM_G40-ZcmdpUsCsU8hQFlV2bmGEZFoIgydOfB9TWyKAb1lRKNHCRmCDanxw3I9aMQ96N1Ye4mmg1cCQGobj4Gk0mxRUtZ4FY5NIaD0vU Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 8c0975684af442a3ae7a012fa13b2645 Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-TestServerMultinode-791725350 Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,admin,member Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,admin,member Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8c0975684af442a3ae7a012fa13b2645"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8c0975684af442a3ae7a012fa13b2645", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8c0975684af442a3ae7a012fa13b2645"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8c0975684af442a3ae7a012fa13b2645"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-TestServerMultinode-791725350 Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 8c0975684af442a3ae7a012fa13b2645 Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-TestServerMultinode-791725350 Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-TestServerMultinode-791725350-project-admin Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 86d384f3ab5949b0bddc35f6bdb7fac0 Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-TestServerMultinode-791725350-project-admin Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 554f5818-a67a-4f38-91a7-e7100c2bc0d0 could not be found. Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '554f5818-a67a-4f38-91a7-e7100c2bc0d0'} Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 554f5818-a67a-4f38-91a7-e7100c2bc0d0 could not be found. Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 554f5818-a67a-4f38-91a7-e7100c2bc0d0 could not be found. Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:57:37.536754 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:57:37.542231 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:57:37.542231 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:57:37.542231 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:57:37.542231 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:57:37.542231 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:57:37.542231 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 554f5818-a67a-4f38-91a7-e7100c2bc0d0 could not be found. Aug 07 01:57:37.542231 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:57:37.542231 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2cd7e201-b456-436c-876a-434dc213f66f tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Returning 404 to user: Instance 554f5818-a67a-4f38-91a7-e7100c2bc0d0 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:57:37.542231 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2cd7e201-b456-436c-876a-434dc213f66f tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/554f5818-a67a-4f38-91a7-e7100c2bc0d0" status: 404 len: 111 microversion: 2.1 time: 0.031530 Aug 07 01:57:37.542231 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3388/6311] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:37 2022] GET /compute/v2.1/servers/554f5818-a67a-4f38-91a7-e7100c2bc0d0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:57:37.547171 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b71b5228-47e3-4513-90c9-0e1f5ca7928d tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:37.547683 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b71b5228-47e3-4513-90c9-0e1f5ca7928d tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] [instance: 7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:37.554385 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b71b5228-47e3-4513-90c9-0e1f5ca7928d tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:37.554874 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b71b5228-47e3-4513-90c9-0e1f5ca7928d tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:37.555352 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b71b5228-47e3-4513-90c9-0e1f5ca7928d tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:37.556213 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b71b5228-47e3-4513-90c9-0e1f5ca7928d tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:37.556568 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b71b5228-47e3-4513-90c9-0e1f5ca7928d tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:37.556997 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b71b5228-47e3-4513-90c9-0e1f5ca7928d tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:37.559605 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:57:37.586047 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b71b5228-47e3-4513-90c9-0e1f5ca7928d tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] [instance: 7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:57:37.663679 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b71b5228-47e3-4513-90c9-0e1f5ca7928d tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] 10.222.0.39 "DELETE /compute/v2.1/servers/7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4" status: 204 len: 0 microversion: 2.1 time: 0.120105 Aug 07 01:57:37.664289 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2924/6312] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:57:37 2022] DELETE /compute/v2.1/servers/7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 07 01:57:37.673321 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8d39e168-edb2-482d-a72a-388d0ac5aa34 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:37.673955 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8d39e168-edb2-482d-a72a-388d0ac5aa34 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] [instance: 7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:37.680037 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d39e168-edb2-482d-a72a-388d0ac5aa34 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:37.680540 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d39e168-edb2-482d-a72a-388d0ac5aa34 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:37.681001 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d39e168-edb2-482d-a72a-388d0ac5aa34 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:37.681747 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d39e168-edb2-482d-a72a-388d0ac5aa34 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:37.682222 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d39e168-edb2-482d-a72a-388d0ac5aa34 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:37.682668 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8d39e168-edb2-482d-a72a-388d0ac5aa34 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:37.807093 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:57:37.814706 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8d39e168-edb2-482d-a72a-388d0ac5aa34 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4" status: 200 len: 1654 microversion: 2.1 time: 0.145872 Aug 07 01:57:37.815206 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3389/6313] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:37 2022] GET /compute/v2.1/servers/7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4 => generated 1654 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:38.088750 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-64aa942e-f9d9-4f20-a61e-44d279f8d33d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:38.089470 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-64aa942e-f9d9-4f20-a61e-44d279f8d33d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:38.096365 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64aa942e-f9d9-4f20-a61e-44d279f8d33d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:38.096868 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64aa942e-f9d9-4f20-a61e-44d279f8d33d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:38.097314 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64aa942e-f9d9-4f20-a61e-44d279f8d33d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:38.098012 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64aa942e-f9d9-4f20-a61e-44d279f8d33d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:38.098471 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64aa942e-f9d9-4f20-a61e-44d279f8d33d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:38.098908 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-64aa942e-f9d9-4f20-a61e-44d279f8d33d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:38.233770 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-64aa942e-f9d9-4f20-a61e-44d279f8d33d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:57:38.241735 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-64aa942e-f9d9-4f20-a61e-44d279f8d33d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1680 microversion: 2.1 time: 0.157272 Aug 07 01:57:38.242314 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2925/6314] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:38 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:38.837013 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8f43f6d6-6660-468f-9830-e71b51fd7488 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:38.837656 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8f43f6d6-6660-468f-9830-e71b51fd7488 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] [instance: 7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:38.847720 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8f43f6d6-6660-468f-9830-e71b51fd7488 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:38.848270 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8f43f6d6-6660-468f-9830-e71b51fd7488 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:38.848730 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8f43f6d6-6660-468f-9830-e71b51fd7488 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:38.849461 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8f43f6d6-6660-468f-9830-e71b51fd7488 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:38.849939 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8f43f6d6-6660-468f-9830-e71b51fd7488 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:38.850387 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8f43f6d6-6660-468f-9830-e71b51fd7488 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:38.978961 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8f43f6d6-6660-468f-9830-e71b51fd7488 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4" status: 200 len: 1654 microversion: 2.1 time: 0.146953 Aug 07 01:57:38.979865 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3390/6315] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:38 2022] GET /compute/v2.1/servers/7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4 => generated 1654 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:39.928260 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-0deb3f58-affa-40ad-92ec-afefda639a46 req-53e8aa9c-0044-4d9b-a4c8-246efe5f6eb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4", "name": "network-vif-deleted", "tag": "b7b304d9-4b20-4398-bc4c-98f5079b7b22"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:57:39.934726 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:57:39.941187 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0deb3f58-affa-40ad-92ec-afefda639a46 req-53e8aa9c-0044-4d9b-a4c8-246efe5f6eb6 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:39.941674 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0deb3f58-affa-40ad-92ec-afefda639a46 req-53e8aa9c-0044-4d9b-a4c8-246efe5f6eb6 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:39.942107 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0deb3f58-affa-40ad-92ec-afefda639a46 req-53e8aa9c-0044-4d9b-a4c8-246efe5f6eb6 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:39.954639 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-0deb3f58-affa-40ad-92ec-afefda639a46 req-53e8aa9c-0044-4d9b-a4c8-246efe5f6eb6 service nova] Creating event network-vif-deleted:b7b304d9-4b20-4398-bc4c-98f5079b7b22 for instance 7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4 on n-h1-master-1 Aug 07 01:57:39.959610 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-0deb3f58-affa-40ad-92ec-afefda639a46 req-53e8aa9c-0044-4d9b-a4c8-246efe5f6eb6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035078 Aug 07 01:57:39.964255 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2926/6316] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:57:40.001500 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b97efc05-0773-4f38-9296-47369347d873 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:40.002797 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b97efc05-0773-4f38-9296-47369347d873 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] [instance: 7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:40.016730 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b97efc05-0773-4f38-9296-47369347d873 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:40.017389 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b97efc05-0773-4f38-9296-47369347d873 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:40.017950 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b97efc05-0773-4f38-9296-47369347d873 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:40.018789 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b97efc05-0773-4f38-9296-47369347d873 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:40.019334 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b97efc05-0773-4f38-9296-47369347d873 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:40.019844 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b97efc05-0773-4f38-9296-47369347d873 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:40.107830 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b97efc05-0773-4f38-9296-47369347d873 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4" status: 200 len: 1448 microversion: 2.1 time: 0.110208 Aug 07 01:57:40.108600 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3391/6317] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:39 2022] GET /compute/v2.1/servers/7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4 => generated 1448 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:57:41.131151 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a44e7b7d-4675-46ee-bae1-24f80ed6ffe4 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:57:41.131857 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a44e7b7d-4675-46ee-bae1-24f80ed6ffe4 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] [instance: 7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:57:41.138176 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a44e7b7d-4675-46ee-bae1-24f80ed6ffe4 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:41.138656 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a44e7b7d-4675-46ee-bae1-24f80ed6ffe4 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:41.139092 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a44e7b7d-4675-46ee-bae1-24f80ed6ffe4 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:41.139805 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a44e7b7d-4675-46ee-bae1-24f80ed6ffe4 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:41.140427 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a44e7b7d-4675-46ee-bae1-24f80ed6ffe4 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:41.140853 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a44e7b7d-4675-46ee-bae1-24f80ed6ffe4 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:41.153821 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-a44e7b7d-4675-46ee-bae1-24f80ed6ffe4 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] HTTP exception thrown: Instance 7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4 could not be found. Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a44e7b7d-4675-46ee-bae1-24f80ed6ffe4 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Request method failure captured: Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4 HTTP/1.1 Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xv12LekAU2p5cq3FVj7ociE3xnZ4KFxa0m8nNGMoicUilK4J_ymFa8oDNmsL9GgFsKAhToM_G40-ZcmdpUsCsU8hQFlV2bmGEZFoIgydOfB9TWyKAb1lRKNHCRmCDanxw3I9aMQ96N1Ye4mmg1cCQGobj4Gk0mxRUtZ4FY5NIaD0vU Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 8c0975684af442a3ae7a012fa13b2645 Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-TestServerMultinode-791725350 Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,admin,member Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,admin,member Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8c0975684af442a3ae7a012fa13b2645"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8c0975684af442a3ae7a012fa13b2645", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8c0975684af442a3ae7a012fa13b2645"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8c0975684af442a3ae7a012fa13b2645"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-TestServerMultinode-791725350 Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 8c0975684af442a3ae7a012fa13b2645 Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-TestServerMultinode-791725350 Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-TestServerMultinode-791725350-project-admin Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 86d384f3ab5949b0bddc35f6bdb7fac0 Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-TestServerMultinode-791725350-project-admin Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4 could not be found. Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4'} Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4 could not be found. Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4 could not be found. Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:57:41.155438 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:57:41.161916 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:57:41.161916 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:57:41.161916 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:57:41.161916 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:57:41.161916 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:57:41.161916 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4 could not be found. Aug 07 01:57:41.161916 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:57:41.161916 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a44e7b7d-4675-46ee-bae1-24f80ed6ffe4 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] Returning 404 to user: Instance 7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:57:41.161916 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a44e7b7d-4675-46ee-bae1-24f80ed6ffe4 tempest-TestServerMultinode-791725350 tempest-TestServerMultinode-791725350-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4" status: 404 len: 111 microversion: 2.1 time: 0.031406 Aug 07 01:57:41.161916 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2927/6318] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:57:41 2022] GET /compute/v2.1/servers/7e8c96d6-f91e-4e8b-94cb-a2857b3bb1c4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:57:41.336927 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-b247b095-45d7-43c9-9265-99990f619ad1 req-1c0d6b7e-b03d-4e39-aa1d-49dc78277766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3830b32-dbd9-4a68-aa42-c1a65475f350", "name": "network-vif-plugged", "status": "completed", "tag": "f613fc8e-fa17-4341-89eb-ed1552b81ad5"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:57:41.348963 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b247b095-45d7-43c9-9265-99990f619ad1 req-1c0d6b7e-b03d-4e39-aa1d-49dc78277766 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:57:41.349715 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b247b095-45d7-43c9-9265-99990f619ad1 req-1c0d6b7e-b03d-4e39-aa1d-49dc78277766 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:57:41.350231 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b247b095-45d7-43c9-9265-99990f619ad1 req-1c0d6b7e-b03d-4e39-aa1d-49dc78277766 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:57:41.362333 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-b247b095-45d7-43c9-9265-99990f619ad1 req-1c0d6b7e-b03d-4e39-aa1d-49dc78277766 service nova] Creating event network-vif-plugged:f613fc8e-fa17-4341-89eb-ed1552b81ad5 for instance f3830b32-dbd9-4a68-aa42-c1a65475f350 on n-h2-master-1 Aug 07 01:57:41.367869 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-b247b095-45d7-43c9-9265-99990f619ad1 req-1c0d6b7e-b03d-4e39-aa1d-49dc78277766 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036175 Aug 07 01:57:41.368697 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3392/6319] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:58:02.442067 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f8cc3125-e538-4d89-bda7-00c2e177e529 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:58:02.444442 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f8cc3125-e538-4d89-bda7-00c2e177e529 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:02.447227 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:58:02.447970 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:58:02.454802 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f8cc3125-e538-4d89-bda7-00c2e177e529 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:02.455288 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f8cc3125-e538-4d89-bda7-00c2e177e529 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:02.455726 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f8cc3125-e538-4d89-bda7-00c2e177e529 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:02.456480 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f8cc3125-e538-4d89-bda7-00c2e177e529 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:02.456940 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f8cc3125-e538-4d89-bda7-00c2e177e529 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:02.457370 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f8cc3125-e538-4d89-bda7-00c2e177e529 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:02.528660 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f8cc3125-e538-4d89-bda7-00c2e177e529 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "POST /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350/action" status: 200 len: 63068 microversion: 2.1 time: 0.090565 Aug 07 01:58:02.529317 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2928/6320] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:58:02 2022] POST /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350/action => generated 63068 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:58:08.712591 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=23 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:58:08.713376 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=15 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:58:08.718120 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7cb74bb3-823c-4fed-84d0-2bb1ff0ccf83 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:08.718845 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7cb74bb3-823c-4fed-84d0-2bb1ff0ccf83 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:08.725901 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7cb74bb3-823c-4fed-84d0-2bb1ff0ccf83 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:08.726397 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7cb74bb3-823c-4fed-84d0-2bb1ff0ccf83 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:08.726848 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7cb74bb3-823c-4fed-84d0-2bb1ff0ccf83 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:08.727554 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7cb74bb3-823c-4fed-84d0-2bb1ff0ccf83 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:08.728060 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7cb74bb3-823c-4fed-84d0-2bb1ff0ccf83 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:08.728550 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7cb74bb3-823c-4fed-84d0-2bb1ff0ccf83 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:08.863038 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7cb74bb3-823c-4fed-84d0-2bb1ff0ccf83 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1831 microversion: 2.1 time: 0.152709 Aug 07 01:58:08.863610 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3393/6321] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:08 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1831 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:58:09.756355 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b329c842-e951-43cf-a594-da7971823e28 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:09.756949 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b329c842-e951-43cf-a594-da7971823e28 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:09.758732 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-5757fc3b-bb73-49c7-9528-847ebf94489d req-9eea8afe-4df9-4f0b-b825-76abfe7b2d25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3830b32-dbd9-4a68-aa42-c1a65475f350", "tag": "f613fc8e-fa17-4341-89eb-ed1552b81ad5"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:58:09.765117 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b329c842-e951-43cf-a594-da7971823e28 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:09.765609 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b329c842-e951-43cf-a594-da7971823e28 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:09.766054 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b329c842-e951-43cf-a594-da7971823e28 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:09.766845 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b329c842-e951-43cf-a594-da7971823e28 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:09.767309 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b329c842-e951-43cf-a594-da7971823e28 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:09.767740 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b329c842-e951-43cf-a594-da7971823e28 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:09.769950 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-5757fc3b-bb73-49c7-9528-847ebf94489d req-9eea8afe-4df9-4f0b-b825-76abfe7b2d25 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:09.770545 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-5757fc3b-bb73-49c7-9528-847ebf94489d req-9eea8afe-4df9-4f0b-b825-76abfe7b2d25 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:09.771094 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-5757fc3b-bb73-49c7-9528-847ebf94489d req-9eea8afe-4df9-4f0b-b825-76abfe7b2d25 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:09.783619 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-5757fc3b-bb73-49c7-9528-847ebf94489d req-9eea8afe-4df9-4f0b-b825-76abfe7b2d25 service nova] Creating event network-changed:f613fc8e-fa17-4341-89eb-ed1552b81ad5 for instance f3830b32-dbd9-4a68-aa42-c1a65475f350 on n-h2-master-1 Aug 07 01:58:09.789308 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-5757fc3b-bb73-49c7-9528-847ebf94489d req-9eea8afe-4df9-4f0b-b825-76abfe7b2d25 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034480 Aug 07 01:58:09.790060 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3394/6322] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:58:09.800371 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b329c842-e951-43cf-a594-da7971823e28 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:58:09.901469 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b329c842-e951-43cf-a594-da7971823e28 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 204 len: 0 microversion: 2.1 time: 0.148103 Aug 07 01:58:09.902072 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2929/6323] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:58:09 2022] DELETE /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:58:09.912536 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5082a072-f104-4ec9-9dc3-8d0da4b89629 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:09.913273 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5082a072-f104-4ec9-9dc3-8d0da4b89629 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:09.924462 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5082a072-f104-4ec9-9dc3-8d0da4b89629 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:09.924462 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5082a072-f104-4ec9-9dc3-8d0da4b89629 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:09.924462 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5082a072-f104-4ec9-9dc3-8d0da4b89629 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:09.924462 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5082a072-f104-4ec9-9dc3-8d0da4b89629 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:09.925029 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5082a072-f104-4ec9-9dc3-8d0da4b89629 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:09.925176 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5082a072-f104-4ec9-9dc3-8d0da4b89629 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:10.078118 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5082a072-f104-4ec9-9dc3-8d0da4b89629 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:10.089885 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5082a072-f104-4ec9-9dc3-8d0da4b89629 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1686 microversion: 2.1 time: 0.182400 Aug 07 01:58:10.090505 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3395/6324] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:09 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1686 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:58:11.115905 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6c3848ae-3e14-4358-9259-54ed6f4b9511 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:11.116805 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6c3848ae-3e14-4358-9259-54ed6f4b9511 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:11.125459 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c3848ae-3e14-4358-9259-54ed6f4b9511 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:11.125953 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c3848ae-3e14-4358-9259-54ed6f4b9511 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:11.126575 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c3848ae-3e14-4358-9259-54ed6f4b9511 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:11.127384 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c3848ae-3e14-4358-9259-54ed6f4b9511 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:11.127801 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c3848ae-3e14-4358-9259-54ed6f4b9511 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:11.128333 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c3848ae-3e14-4358-9259-54ed6f4b9511 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:11.359784 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6c3848ae-3e14-4358-9259-54ed6f4b9511 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:11.368524 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6c3848ae-3e14-4358-9259-54ed6f4b9511 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 200 len: 1686 microversion: 2.1 time: 0.258154 Aug 07 01:58:11.369243 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2930/6325] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:11 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 1686 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:58:11.869844 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-15d88f78-d063-4f87-bf18-8d2b69c95318 req-3eaa6543-7211-4079-82f4-452b01442a9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3830b32-dbd9-4a68-aa42-c1a65475f350", "name": "network-vif-deleted", "tag": "f613fc8e-fa17-4341-89eb-ed1552b81ad5"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:58:11.882182 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-15d88f78-d063-4f87-bf18-8d2b69c95318 req-3eaa6543-7211-4079-82f4-452b01442a9c service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:11.883608 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-15d88f78-d063-4f87-bf18-8d2b69c95318 req-3eaa6543-7211-4079-82f4-452b01442a9c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:11.884349 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-15d88f78-d063-4f87-bf18-8d2b69c95318 req-3eaa6543-7211-4079-82f4-452b01442a9c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:11.898383 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-15d88f78-d063-4f87-bf18-8d2b69c95318 req-3eaa6543-7211-4079-82f4-452b01442a9c service nova] Creating event network-vif-deleted:f613fc8e-fa17-4341-89eb-ed1552b81ad5 for instance f3830b32-dbd9-4a68-aa42-c1a65475f350 on n-h2-master-1 Aug 07 01:58:11.904076 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-15d88f78-d063-4f87-bf18-8d2b69c95318 req-3eaa6543-7211-4079-82f4-452b01442a9c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037596 Aug 07 01:58:11.904076 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3396/6326] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:58:12.393641 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5e68cc56-b175-4cb9-88fb-479299f40503 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:12.394443 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5e68cc56-b175-4cb9-88fb-479299f40503 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: f3830b32-dbd9-4a68-aa42-c1a65475f350] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:12.402339 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e68cc56-b175-4cb9-88fb-479299f40503 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:12.402844 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e68cc56-b175-4cb9-88fb-479299f40503 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:12.403278 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e68cc56-b175-4cb9-88fb-479299f40503 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:12.404224 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e68cc56-b175-4cb9-88fb-479299f40503 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:12.404682 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e68cc56-b175-4cb9-88fb-479299f40503 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:12.405113 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e68cc56-b175-4cb9-88fb-479299f40503 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:12.423840 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-5e68cc56-b175-4cb9-88fb-479299f40503 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] HTTP exception thrown: Instance f3830b32-dbd9-4a68-aa42-c1a65475f350 could not be found. Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5e68cc56-b175-4cb9-88fb-479299f40503 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Request method failure captured: Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 HTTP/1.1 Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xs7m9NZoR7QYJEs2LdGd8pBDTRyEi0z4J0cBXKascPq3zVViX-oKQvuaXwOhnW2JLOmnZwctSI6Ey4onVMpls1VeWoMFG_HIdnE2zQ7QFGrzRXTZiFvvZQlJ3VmarDoU9LqJmDS_SlWfy2oHktXR4wvHeXSLIROc6sY5luRoQUQZ5A Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: d37d8c916412400ba4b57ea10fceb39e Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1464135667 Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d37d8c916412400ba4b57ea10fceb39e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d37d8c916412400ba4b57ea10fceb39e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d37d8c916412400ba4b57ea10fceb39e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d37d8c916412400ba4b57ea10fceb39e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1464135667 Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: d37d8c916412400ba4b57ea10fceb39e Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1464135667 Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-TestNetworkAdvancedServerOps-1464135667-project Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 830639b9b39a43a7b714b74c26fdf52c Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1464135667-project Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: exception: Instance f3830b32-dbd9-4a68-aa42-c1a65475f350 could not be found. Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'f3830b32-dbd9-4a68-aa42-c1a65475f350'} Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3830b32-dbd9-4a68-aa42-c1a65475f350 could not be found. Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3830b32-dbd9-4a68-aa42-c1a65475f350 could not be found. Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:58:12.425558 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:58:12.431257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:58:12.431257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:58:12.431257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:58:12.431257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:58:12.431257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:58:12.431257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:58:12.431257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3830b32-dbd9-4a68-aa42-c1a65475f350 could not be found. Aug 07 01:58:12.431257 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:58:12.431257 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5e68cc56-b175-4cb9-88fb-479299f40503 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Returning 404 to user: Instance f3830b32-dbd9-4a68-aa42-c1a65475f350 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:58:12.431257 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5e68cc56-b175-4cb9-88fb-479299f40503 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350" status: 404 len: 111 microversion: 2.1 time: 0.038309 Aug 07 01:58:12.431257 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2931/6327] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:12 2022] GET /compute/v2.1/servers/f3830b32-dbd9-4a68-aa42-c1a65475f350 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:58:16.077514 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8b6232cd-daf2-4988-916f-05ba5d56c5a8 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '.version_select at 0x7f9e249b5280>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:16.103720 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8b6232cd-daf2-4988-916f-05ba5d56c5a8 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-176657936" status: 202 len: 0 microversion: 2.1 time: 0.031383 Aug 07 01:58:16.105085 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3397/6328] 10.222.0.39 () {58 vars in 1281 bytes} [Sun Aug 7 01:58:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-176657936 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:58:16.147597 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-69e37afd-9e53-4a77-b5a5-d2112f4c8799 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Action: 'create', calling method: .version_select at 0x7f9e242c84c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-934680293", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9aQzsLQ3xvC6yuOKgrlM447NDeyx39CVGGOihoLKMk1aQynWqsEVk48d9cBEK7oQSJhA5evdh0hXnvuGBL9BHeKMKxMcGDC41JMOgxkLsLQ4oDCHH7khBhl/9UMLSSRQ=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:58:16.164782 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-69e37afd-9e53-4a77-b5a5-d2112f4c8799 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Getting quotas for project d37d8c916412400ba4b57ea10fceb39e. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:58:16.177718 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-69e37afd-9e53-4a77-b5a5-d2112f4c8799 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Getting quotas for user 830639b9b39a43a7b714b74c26fdf52c and project d37d8c916412400ba4b57ea10fceb39e. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:58:16.208756 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-69e37afd-9e53-4a77-b5a5-d2112f4c8799 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.065078 Aug 07 01:58:16.209956 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2932/6329] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:58:16 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:58:21.988528 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=16 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:58:21.995134 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-04a318af-6d0d-4bff-98fb-5446cd9b7b61 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-105786722", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "79ffbccd-3641-448e-8492-f6aaec7d8b49"}], "key_name": "tempest-TestNetworkAdvancedServerOps-934680293", "security_groups": [{"name": "tempest-secgroup-smoke-912753510"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:58:22.127803 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-04a318af-6d0d-4bff-98fb-5446cd9b7b61 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] validate_networks() for [('79ffbccd-3641-448e-8492-f6aaec7d8b49', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:58:22.567509 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-04a318af-6d0d-4bff-98fb-5446cd9b7b61 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:58:22.568061 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-04a318af-6d0d-4bff-98fb-5446cd9b7b61 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:58:22.568690 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-04a318af-6d0d-4bff-98fb-5446cd9b7b61 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:58:22.569117 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-04a318af-6d0d-4bff-98fb-5446cd9b7b61 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:58:22.569553 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-04a318af-6d0d-4bff-98fb-5446cd9b7b61 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:58:22.579165 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-04a318af-6d0d-4bff-98fb-5446cd9b7b61 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:22.579665 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-04a318af-6d0d-4bff-98fb-5446cd9b7b61 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:22.580150 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-04a318af-6d0d-4bff-98fb-5446cd9b7b61 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:22.580910 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-04a318af-6d0d-4bff-98fb-5446cd9b7b61 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:22.581381 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-04a318af-6d0d-4bff-98fb-5446cd9b7b61 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:22.581825 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-04a318af-6d0d-4bff-98fb-5446cd9b7b61 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:22.599239 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-04a318af-6d0d-4bff-98fb-5446cd9b7b61 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Getting quotas for project d37d8c916412400ba4b57ea10fceb39e. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:58:22.604738 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-04a318af-6d0d-4bff-98fb-5446cd9b7b61 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Getting quotas for user 830639b9b39a43a7b714b74c26fdf52c and project d37d8c916412400ba4b57ea10fceb39e. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:58:22.617659 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-04a318af-6d0d-4bff-98fb-5446cd9b7b61 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:58:22.620085 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-04a318af-6d0d-4bff-98fb-5446cd9b7b61 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: e48957f5-1bac-403c-8071-99ec34e80b7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:58:22.668162 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-04a318af-6d0d-4bff-98fb-5446cd9b7b61 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.681352 Aug 07 01:58:22.675158 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3398/6330] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:58:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 07 01:58:22.678506 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:58:22.682958 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d208d052-735c-4c92-8a83-71304cb51b86 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:22.683605 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d208d052-735c-4c92-8a83-71304cb51b86 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: e48957f5-1bac-403c-8071-99ec34e80b7b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:22.742680 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d208d052-735c-4c92-8a83-71304cb51b86 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:22.751158 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d208d052-735c-4c92-8a83-71304cb51b86 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b" status: 200 len: 1265 microversion: 2.1 time: 0.073592 Aug 07 01:58:22.752160 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2933/6331] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:22 2022] GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b => generated 1265 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:58:23.774705 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-29f95c12-d634-49fc-a8a9-b824f7bb8081 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:23.776250 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-29f95c12-d634-49fc-a8a9-b824f7bb8081 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: e48957f5-1bac-403c-8071-99ec34e80b7b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:23.784789 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-29f95c12-d634-49fc-a8a9-b824f7bb8081 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:23.785638 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-29f95c12-d634-49fc-a8a9-b824f7bb8081 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:23.787959 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-29f95c12-d634-49fc-a8a9-b824f7bb8081 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:23.789147 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-29f95c12-d634-49fc-a8a9-b824f7bb8081 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:23.789844 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-29f95c12-d634-49fc-a8a9-b824f7bb8081 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:23.790505 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-29f95c12-d634-49fc-a8a9-b824f7bb8081 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:23.881870 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-29f95c12-d634-49fc-a8a9-b824f7bb8081 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:23.891400 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-29f95c12-d634-49fc-a8a9-b824f7bb8081 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b" status: 200 len: 1325 microversion: 2.1 time: 0.122285 Aug 07 01:58:23.892141 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3399/6332] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:23 2022] GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b => generated 1325 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:58:24.913191 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-486883be-cf2f-4c68-8c92-ff3a1bfb9e14 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:24.913911 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-486883be-cf2f-4c68-8c92-ff3a1bfb9e14 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: e48957f5-1bac-403c-8071-99ec34e80b7b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:24.927083 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-486883be-cf2f-4c68-8c92-ff3a1bfb9e14 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:24.927572 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-486883be-cf2f-4c68-8c92-ff3a1bfb9e14 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:24.928187 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-486883be-cf2f-4c68-8c92-ff3a1bfb9e14 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:24.928908 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-486883be-cf2f-4c68-8c92-ff3a1bfb9e14 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:24.929376 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-486883be-cf2f-4c68-8c92-ff3a1bfb9e14 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:24.929806 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-486883be-cf2f-4c68-8c92-ff3a1bfb9e14 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:25.092641 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-486883be-cf2f-4c68-8c92-ff3a1bfb9e14 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:25.106152 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-486883be-cf2f-4c68-8c92-ff3a1bfb9e14 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b" status: 200 len: 1390 microversion: 2.1 time: 0.196731 Aug 07 01:58:25.107082 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2934/6333] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:24 2022] GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b => generated 1390 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:58:25.327154 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-f2fa08b0-c504-499b-85db-d1f5fac68f40 req-70962147-a243-43bd-8e14-09a232f8b98b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e48957f5-1bac-403c-8071-99ec34e80b7b", "tag": "52898008-7083-46da-a8be-9b35eee5ba7d"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:58:25.340846 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f2fa08b0-c504-499b-85db-d1f5fac68f40 req-70962147-a243-43bd-8e14-09a232f8b98b service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:25.341674 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f2fa08b0-c504-499b-85db-d1f5fac68f40 req-70962147-a243-43bd-8e14-09a232f8b98b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:25.342270 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f2fa08b0-c504-499b-85db-d1f5fac68f40 req-70962147-a243-43bd-8e14-09a232f8b98b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:25.355142 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-f2fa08b0-c504-499b-85db-d1f5fac68f40 req-70962147-a243-43bd-8e14-09a232f8b98b service nova] Creating event network-changed:52898008-7083-46da-a8be-9b35eee5ba7d for instance e48957f5-1bac-403c-8071-99ec34e80b7b on n-h2-master-1 Aug 07 01:58:25.360284 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-f2fa08b0-c504-499b-85db-d1f5fac68f40 req-70962147-a243-43bd-8e14-09a232f8b98b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036890 Aug 07 01:58:25.361449 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3400/6334] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:58:26.128012 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-880f5f58-27d8-45fa-9516-bdf884107e38 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:26.128614 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-880f5f58-27d8-45fa-9516-bdf884107e38 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: e48957f5-1bac-403c-8071-99ec34e80b7b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:26.135755 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-880f5f58-27d8-45fa-9516-bdf884107e38 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:26.136280 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-880f5f58-27d8-45fa-9516-bdf884107e38 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:26.136719 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-880f5f58-27d8-45fa-9516-bdf884107e38 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:26.137430 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-880f5f58-27d8-45fa-9516-bdf884107e38 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:26.137889 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-880f5f58-27d8-45fa-9516-bdf884107e38 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:26.138320 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-880f5f58-27d8-45fa-9516-bdf884107e38 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:26.291016 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-880f5f58-27d8-45fa-9516-bdf884107e38 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:26.299337 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-880f5f58-27d8-45fa-9516-bdf884107e38 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b" status: 200 len: 1390 microversion: 2.1 time: 0.175225 Aug 07 01:58:26.299926 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2935/6335] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:26 2022] GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b => generated 1390 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:58:27.321865 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-67df69c2-c8e1-4f49-be71-57010ebabb03 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:27.322581 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-67df69c2-c8e1-4f49-be71-57010ebabb03 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: e48957f5-1bac-403c-8071-99ec34e80b7b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:27.329404 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67df69c2-c8e1-4f49-be71-57010ebabb03 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:27.329893 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67df69c2-c8e1-4f49-be71-57010ebabb03 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:27.330343 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67df69c2-c8e1-4f49-be71-57010ebabb03 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:27.331056 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67df69c2-c8e1-4f49-be71-57010ebabb03 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:27.331526 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67df69c2-c8e1-4f49-be71-57010ebabb03 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:27.332001 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-67df69c2-c8e1-4f49-be71-57010ebabb03 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:27.467231 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-67df69c2-c8e1-4f49-be71-57010ebabb03 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:27.475427 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-67df69c2-c8e1-4f49-be71-57010ebabb03 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b" status: 200 len: 1390 microversion: 2.1 time: 0.158741 Aug 07 01:58:27.476020 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3401/6336] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:27 2022] GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:58:28.497107 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e57638e9-e7f9-4457-b7d3-b14c710511be tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:28.497788 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e57638e9-e7f9-4457-b7d3-b14c710511be tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: e48957f5-1bac-403c-8071-99ec34e80b7b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:28.505857 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e57638e9-e7f9-4457-b7d3-b14c710511be tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:28.506343 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e57638e9-e7f9-4457-b7d3-b14c710511be tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:28.506782 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e57638e9-e7f9-4457-b7d3-b14c710511be tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:28.507514 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e57638e9-e7f9-4457-b7d3-b14c710511be tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:28.508002 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e57638e9-e7f9-4457-b7d3-b14c710511be tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:28.508429 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e57638e9-e7f9-4457-b7d3-b14c710511be tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:28.642370 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e57638e9-e7f9-4457-b7d3-b14c710511be tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:28.649882 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e57638e9-e7f9-4457-b7d3-b14c710511be tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b" status: 200 len: 1390 microversion: 2.1 time: 0.156773 Aug 07 01:58:28.650460 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2936/6337] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:28 2022] GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:58:29.670741 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-915c7b68-d21c-4b92-b68d-6bfcd260f990 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:29.671418 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-915c7b68-d21c-4b92-b68d-6bfcd260f990 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: e48957f5-1bac-403c-8071-99ec34e80b7b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:29.678334 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-915c7b68-d21c-4b92-b68d-6bfcd260f990 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:29.678817 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-915c7b68-d21c-4b92-b68d-6bfcd260f990 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:29.679264 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-915c7b68-d21c-4b92-b68d-6bfcd260f990 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:29.680106 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-915c7b68-d21c-4b92-b68d-6bfcd260f990 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:29.680808 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-915c7b68-d21c-4b92-b68d-6bfcd260f990 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:29.681000 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-915c7b68-d21c-4b92-b68d-6bfcd260f990 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:29.814713 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-915c7b68-d21c-4b92-b68d-6bfcd260f990 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:29.822655 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-915c7b68-d21c-4b92-b68d-6bfcd260f990 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b" status: 200 len: 1390 microversion: 2.1 time: 0.155674 Aug 07 01:58:29.823219 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3402/6338] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:29 2022] GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:58:30.845049 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-10050b68-5732-40f1-b992-301119152eb3 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:30.845841 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-10050b68-5732-40f1-b992-301119152eb3 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: e48957f5-1bac-403c-8071-99ec34e80b7b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:30.854021 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10050b68-5732-40f1-b992-301119152eb3 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:30.854524 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10050b68-5732-40f1-b992-301119152eb3 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:30.856088 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10050b68-5732-40f1-b992-301119152eb3 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:30.856822 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10050b68-5732-40f1-b992-301119152eb3 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:30.857757 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10050b68-5732-40f1-b992-301119152eb3 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:30.858197 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10050b68-5732-40f1-b992-301119152eb3 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:31.007796 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-10050b68-5732-40f1-b992-301119152eb3 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:31.015995 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-10050b68-5732-40f1-b992-301119152eb3 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b" status: 200 len: 1390 microversion: 2.1 time: 0.175595 Aug 07 01:58:31.016605 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2937/6339] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:30 2022] GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b => generated 1390 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:58:31.497936 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-a269a0bc-8c91-403b-845a-59afea686101 req-b4447d9c-491b-40a3-80e5-18344c07652a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e48957f5-1bac-403c-8071-99ec34e80b7b", "name": "network-vif-plugged", "status": "completed", "tag": "52898008-7083-46da-a8be-9b35eee5ba7d"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:58:31.509614 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a269a0bc-8c91-403b-845a-59afea686101 req-b4447d9c-491b-40a3-80e5-18344c07652a service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:31.510236 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a269a0bc-8c91-403b-845a-59afea686101 req-b4447d9c-491b-40a3-80e5-18344c07652a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:31.510946 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a269a0bc-8c91-403b-845a-59afea686101 req-b4447d9c-491b-40a3-80e5-18344c07652a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:31.530868 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-a269a0bc-8c91-403b-845a-59afea686101 req-b4447d9c-491b-40a3-80e5-18344c07652a service nova] Creating event network-vif-plugged:52898008-7083-46da-a8be-9b35eee5ba7d for instance e48957f5-1bac-403c-8071-99ec34e80b7b on n-h2-master-1 Aug 07 01:58:31.536349 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-a269a0bc-8c91-403b-845a-59afea686101 req-b4447d9c-491b-40a3-80e5-18344c07652a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042010 Aug 07 01:58:31.537368 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3403/6340] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:58:31.700246 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-27e7acf6-55ab-44e8-8cf2-acee04df79fb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:31.700837 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-27e7acf6-55ab-44e8-8cf2-acee04df79fb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 08886847-3d66-41ea-b13d-78bec27950a5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:31.707159 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27e7acf6-55ab-44e8-8cf2-acee04df79fb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:31.707664 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27e7acf6-55ab-44e8-8cf2-acee04df79fb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:31.708139 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27e7acf6-55ab-44e8-8cf2-acee04df79fb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:31.708861 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27e7acf6-55ab-44e8-8cf2-acee04df79fb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:31.709352 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27e7acf6-55ab-44e8-8cf2-acee04df79fb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:31.709786 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27e7acf6-55ab-44e8-8cf2-acee04df79fb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:31.736976 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-27e7acf6-55ab-44e8-8cf2-acee04df79fb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 08886847-3d66-41ea-b13d-78bec27950a5] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:58:31.816114 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-27e7acf6-55ab-44e8-8cf2-acee04df79fb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "DELETE /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5" status: 204 len: 0 microversion: 2.1 time: 0.119779 Aug 07 01:58:31.816852 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2938/6341] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:58:31 2022] DELETE /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:58:31.825668 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-324342b4-76c8-4e78-b89d-07337c70fce6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:31.826389 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-324342b4-76c8-4e78-b89d-07337c70fce6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 08886847-3d66-41ea-b13d-78bec27950a5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:31.834590 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-324342b4-76c8-4e78-b89d-07337c70fce6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:31.835342 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-324342b4-76c8-4e78-b89d-07337c70fce6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:31.835809 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-324342b4-76c8-4e78-b89d-07337c70fce6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:31.836670 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-324342b4-76c8-4e78-b89d-07337c70fce6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:31.837531 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-324342b4-76c8-4e78-b89d-07337c70fce6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:31.838251 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-324342b4-76c8-4e78-b89d-07337c70fce6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:31.976977 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-324342b4-76c8-4e78-b89d-07337c70fce6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:31.985765 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-324342b4-76c8-4e78-b89d-07337c70fce6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5" status: 200 len: 1576 microversion: 2.1 time: 0.164385 Aug 07 01:58:31.986353 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3404/6342] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:31 2022] GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:58:32.037742 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-aa147cf5-82de-4f05-bc9a-d88387565713 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:32.038455 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-aa147cf5-82de-4f05-bc9a-d88387565713 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: e48957f5-1bac-403c-8071-99ec34e80b7b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:32.045323 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa147cf5-82de-4f05-bc9a-d88387565713 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:32.045809 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa147cf5-82de-4f05-bc9a-d88387565713 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:32.046746 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa147cf5-82de-4f05-bc9a-d88387565713 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:32.047461 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa147cf5-82de-4f05-bc9a-d88387565713 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:32.047945 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa147cf5-82de-4f05-bc9a-d88387565713 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:32.048382 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa147cf5-82de-4f05-bc9a-d88387565713 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:32.185862 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-aa147cf5-82de-4f05-bc9a-d88387565713 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:32.193709 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-aa147cf5-82de-4f05-bc9a-d88387565713 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b" status: 200 len: 1390 microversion: 2.1 time: 0.160458 Aug 07 01:58:32.194285 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2939/6343] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:32 2022] GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:58:33.006571 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-23136255-8a82-467b-beb6-60683d22bc78 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:33.007199 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-23136255-8a82-467b-beb6-60683d22bc78 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 08886847-3d66-41ea-b13d-78bec27950a5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:33.010050 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:58:33.010726 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:58:33.017316 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-23136255-8a82-467b-beb6-60683d22bc78 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:33.017812 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-23136255-8a82-467b-beb6-60683d22bc78 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:33.018260 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-23136255-8a82-467b-beb6-60683d22bc78 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:33.018973 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-23136255-8a82-467b-beb6-60683d22bc78 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:33.019438 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-23136255-8a82-467b-beb6-60683d22bc78 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:33.019877 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-23136255-8a82-467b-beb6-60683d22bc78 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:33.160879 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-23136255-8a82-467b-beb6-60683d22bc78 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:33.168771 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-23136255-8a82-467b-beb6-60683d22bc78 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5" status: 200 len: 1576 microversion: 2.1 time: 0.166045 Aug 07 01:58:33.169345 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3405/6344] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:33 2022] GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:58:33.215016 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8fd0b289-9d07-49d6-b924-1bcae2c3f84e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:33.215771 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8fd0b289-9d07-49d6-b924-1bcae2c3f84e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: e48957f5-1bac-403c-8071-99ec34e80b7b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:33.217688 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:58:33.219911 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:58:33.226288 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8fd0b289-9d07-49d6-b924-1bcae2c3f84e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:33.226874 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8fd0b289-9d07-49d6-b924-1bcae2c3f84e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:33.227317 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8fd0b289-9d07-49d6-b924-1bcae2c3f84e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:33.229002 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8fd0b289-9d07-49d6-b924-1bcae2c3f84e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:33.229002 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8fd0b289-9d07-49d6-b924-1bcae2c3f84e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:33.229002 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8fd0b289-9d07-49d6-b924-1bcae2c3f84e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:33.373193 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8fd0b289-9d07-49d6-b924-1bcae2c3f84e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:33.381560 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8fd0b289-9d07-49d6-b924-1bcae2c3f84e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b" status: 200 len: 1560 microversion: 2.1 time: 0.170459 Aug 07 01:58:33.382137 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2940/6345] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:33 2022] GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:58:33.402582 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b458994d-dc0b-4564-b5ee-425469d96946 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:33.403243 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b458994d-dc0b-4564-b5ee-425469d96946 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: e48957f5-1bac-403c-8071-99ec34e80b7b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:33.410110 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b458994d-dc0b-4564-b5ee-425469d96946 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:33.410744 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b458994d-dc0b-4564-b5ee-425469d96946 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:33.411292 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b458994d-dc0b-4564-b5ee-425469d96946 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:33.412085 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b458994d-dc0b-4564-b5ee-425469d96946 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:33.412568 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b458994d-dc0b-4564-b5ee-425469d96946 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:33.413015 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b458994d-dc0b-4564-b5ee-425469d96946 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:33.546225 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b458994d-dc0b-4564-b5ee-425469d96946 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:33.554181 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b458994d-dc0b-4564-b5ee-425469d96946 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b" status: 200 len: 1560 microversion: 2.1 time: 0.155385 Aug 07 01:58:33.554805 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3406/6346] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:33 2022] GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:58:34.193460 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-36bd886d-1adf-4bcb-aebb-e3d4257d3b51 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:34.194107 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-36bd886d-1adf-4bcb-aebb-e3d4257d3b51 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 08886847-3d66-41ea-b13d-78bec27950a5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:34.204651 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36bd886d-1adf-4bcb-aebb-e3d4257d3b51 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:34.205127 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36bd886d-1adf-4bcb-aebb-e3d4257d3b51 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:34.206082 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36bd886d-1adf-4bcb-aebb-e3d4257d3b51 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:34.206832 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36bd886d-1adf-4bcb-aebb-e3d4257d3b51 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:34.207497 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36bd886d-1adf-4bcb-aebb-e3d4257d3b51 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:34.207956 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36bd886d-1adf-4bcb-aebb-e3d4257d3b51 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:34.282592 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-36bd886d-1adf-4bcb-aebb-e3d4257d3b51 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:34.291495 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-36bd886d-1adf-4bcb-aebb-e3d4257d3b51 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5" status: 200 len: 1508 microversion: 2.1 time: 0.101992 Aug 07 01:58:34.293194 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2941/6347] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:34 2022] GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5 => generated 1508 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:58:34.711482 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-68d9ac54-355d-4163-a62f-5fb88ff82ba1 req-ef65c6b7-617f-4c88-b785-3859e80626ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08886847-3d66-41ea-b13d-78bec27950a5", "name": "network-vif-deleted", "tag": "65a964ed-8a1b-4b88-b972-1095976406b9"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:58:34.723025 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-68d9ac54-355d-4163-a62f-5fb88ff82ba1 req-ef65c6b7-617f-4c88-b785-3859e80626ad service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:34.723678 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-68d9ac54-355d-4163-a62f-5fb88ff82ba1 req-ef65c6b7-617f-4c88-b785-3859e80626ad service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:34.724283 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-68d9ac54-355d-4163-a62f-5fb88ff82ba1 req-ef65c6b7-617f-4c88-b785-3859e80626ad service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:34.738802 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-68d9ac54-355d-4163-a62f-5fb88ff82ba1 req-ef65c6b7-617f-4c88-b785-3859e80626ad service nova] Creating event network-vif-deleted:65a964ed-8a1b-4b88-b972-1095976406b9 for instance 08886847-3d66-41ea-b13d-78bec27950a5 on n-h1-master-1 Aug 07 01:58:34.754571 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-68d9ac54-355d-4163-a62f-5fb88ff82ba1 req-ef65c6b7-617f-4c88-b785-3859e80626ad service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046315 Aug 07 01:58:34.755526 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3407/6348] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:58:35.317560 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f1085f2f-1410-405e-9511-27a09f22285d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:35.318207 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f1085f2f-1410-405e-9511-27a09f22285d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 08886847-3d66-41ea-b13d-78bec27950a5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:35.333531 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1085f2f-1410-405e-9511-27a09f22285d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:35.333531 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1085f2f-1410-405e-9511-27a09f22285d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:35.333531 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1085f2f-1410-405e-9511-27a09f22285d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:35.334502 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1085f2f-1410-405e-9511-27a09f22285d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:35.334954 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1085f2f-1410-405e-9511-27a09f22285d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:35.335600 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1085f2f-1410-405e-9511-27a09f22285d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:35.433084 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f1085f2f-1410-405e-9511-27a09f22285d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:35.442813 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f1085f2f-1410-405e-9511-27a09f22285d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5" status: 200 len: 1223 microversion: 2.1 time: 0.131701 Aug 07 01:58:35.443441 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2942/6349] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:35 2022] GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5 => generated 1223 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:58:35.810499 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0521d4c9-f6a0-45a2-82c8-17bde3e2bec2 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:35.812689 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0521d4c9-f6a0-45a2-82c8-17bde3e2bec2 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: e48957f5-1bac-403c-8071-99ec34e80b7b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:35.822326 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-c5933bad-2ff5-4a94-be31-8597b26574bf req-0eebccf4-6acf-4b91-b8f2-a5a05404d6e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e48957f5-1bac-403c-8071-99ec34e80b7b", "tag": "52898008-7083-46da-a8be-9b35eee5ba7d"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:58:35.827848 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0521d4c9-f6a0-45a2-82c8-17bde3e2bec2 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:35.829720 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0521d4c9-f6a0-45a2-82c8-17bde3e2bec2 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:35.834252 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0521d4c9-f6a0-45a2-82c8-17bde3e2bec2 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:35.836140 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0521d4c9-f6a0-45a2-82c8-17bde3e2bec2 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:35.837008 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0521d4c9-f6a0-45a2-82c8-17bde3e2bec2 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:35.839343 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0521d4c9-f6a0-45a2-82c8-17bde3e2bec2 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:35.857860 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c5933bad-2ff5-4a94-be31-8597b26574bf req-0eebccf4-6acf-4b91-b8f2-a5a05404d6e3 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:35.858725 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c5933bad-2ff5-4a94-be31-8597b26574bf req-0eebccf4-6acf-4b91-b8f2-a5a05404d6e3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:35.859388 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c5933bad-2ff5-4a94-be31-8597b26574bf req-0eebccf4-6acf-4b91-b8f2-a5a05404d6e3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:35.908424 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-c5933bad-2ff5-4a94-be31-8597b26574bf req-0eebccf4-6acf-4b91-b8f2-a5a05404d6e3 service nova] Creating event network-changed:52898008-7083-46da-a8be-9b35eee5ba7d for instance e48957f5-1bac-403c-8071-99ec34e80b7b on n-h2-master-1 Aug 07 01:58:35.915688 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-c5933bad-2ff5-4a94-be31-8597b26574bf req-0eebccf4-6acf-4b91-b8f2-a5a05404d6e3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099096 Aug 07 01:58:35.916894 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2943/6350] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:58:36.130756 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0521d4c9-f6a0-45a2-82c8-17bde3e2bec2 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:36.139449 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0521d4c9-f6a0-45a2-82c8-17bde3e2bec2 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b" status: 200 len: 1560 microversion: 2.1 time: 0.333414 Aug 07 01:58:36.140553 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3408/6351] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:35 2022] GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b => generated 1560 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:58:36.463871 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-25bb2118-de69-4309-89a1-331a152a6956 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:36.464628 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-25bb2118-de69-4309-89a1-331a152a6956 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 08886847-3d66-41ea-b13d-78bec27950a5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:36.472747 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-25bb2118-de69-4309-89a1-331a152a6956 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:36.473545 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-25bb2118-de69-4309-89a1-331a152a6956 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:36.473995 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-25bb2118-de69-4309-89a1-331a152a6956 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:36.474902 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-25bb2118-de69-4309-89a1-331a152a6956 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:36.475567 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-25bb2118-de69-4309-89a1-331a152a6956 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:36.476216 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-25bb2118-de69-4309-89a1-331a152a6956 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:36.559258 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-25bb2118-de69-4309-89a1-331a152a6956 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:36.569207 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-25bb2118-de69-4309-89a1-331a152a6956 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5" status: 200 len: 1223 microversion: 2.1 time: 0.109137 Aug 07 01:58:36.571798 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2944/6352] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:36 2022] GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5 => generated 1223 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:58:37.590630 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c3a69cad-3d08-406f-be2c-aed41aa7e512 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:37.591320 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c3a69cad-3d08-406f-be2c-aed41aa7e512 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 08886847-3d66-41ea-b13d-78bec27950a5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:37.598479 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3a69cad-3d08-406f-be2c-aed41aa7e512 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:37.598989 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3a69cad-3d08-406f-be2c-aed41aa7e512 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:37.599444 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3a69cad-3d08-406f-be2c-aed41aa7e512 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:37.600199 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3a69cad-3d08-406f-be2c-aed41aa7e512 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:37.600700 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3a69cad-3d08-406f-be2c-aed41aa7e512 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:37.601153 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3a69cad-3d08-406f-be2c-aed41aa7e512 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:37.665592 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c3a69cad-3d08-406f-be2c-aed41aa7e512 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:37.675092 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c3a69cad-3d08-406f-be2c-aed41aa7e512 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5" status: 200 len: 1223 microversion: 2.1 time: 0.088279 Aug 07 01:58:37.675688 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3409/6353] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:37 2022] GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5 => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:58:38.695577 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-620b5c8c-bd7f-4146-a79c-a3a06ff2533a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:38.696421 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-620b5c8c-bd7f-4146-a79c-a3a06ff2533a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 08886847-3d66-41ea-b13d-78bec27950a5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:38.703656 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-620b5c8c-bd7f-4146-a79c-a3a06ff2533a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:38.704359 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-620b5c8c-bd7f-4146-a79c-a3a06ff2533a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:38.704807 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-620b5c8c-bd7f-4146-a79c-a3a06ff2533a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:38.705531 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-620b5c8c-bd7f-4146-a79c-a3a06ff2533a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:38.705995 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-620b5c8c-bd7f-4146-a79c-a3a06ff2533a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:38.706438 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-620b5c8c-bd7f-4146-a79c-a3a06ff2533a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:38.776881 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-620b5c8c-bd7f-4146-a79c-a3a06ff2533a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:38.784801 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-620b5c8c-bd7f-4146-a79c-a3a06ff2533a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5" status: 200 len: 1223 microversion: 2.1 time: 0.093118 Aug 07 01:58:38.785508 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2945/6354] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:38 2022] GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5 => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:58:39.806397 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-83bec151-1a28-426d-8c42-1a7be0c6b384 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:39.807174 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-83bec151-1a28-426d-8c42-1a7be0c6b384 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 08886847-3d66-41ea-b13d-78bec27950a5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:39.810370 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:58:39.817771 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83bec151-1a28-426d-8c42-1a7be0c6b384 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:39.818341 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83bec151-1a28-426d-8c42-1a7be0c6b384 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:39.818876 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83bec151-1a28-426d-8c42-1a7be0c6b384 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:39.819702 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83bec151-1a28-426d-8c42-1a7be0c6b384 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:39.820215 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83bec151-1a28-426d-8c42-1a7be0c6b384 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:39.820663 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83bec151-1a28-426d-8c42-1a7be0c6b384 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:39.858160 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83bec151-1a28-426d-8c42-1a7be0c6b384 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:39.858659 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83bec151-1a28-426d-8c42-1a7be0c6b384 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:39.859125 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-83bec151-1a28-426d-8c42-1a7be0c6b384 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:39.859561 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-83bec151-1a28-426d-8c42-1a7be0c6b384 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lazy-loading 'fault' on Instance uuid 08886847-3d66-41ea-b13d-78bec27950a5 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:58:39.911685 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-83bec151-1a28-426d-8c42-1a7be0c6b384 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:39.918976 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-83bec151-1a28-426d-8c42-1a7be0c6b384 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5" status: 200 len: 1182 microversion: 2.1 time: 0.116595 Aug 07 01:58:39.919551 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3410/6355] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:39 2022] GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5 => generated 1182 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:58:40.940602 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9495e545-eb6b-4ffc-a0a1-edeaebfe0a7e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:40.941224 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9495e545-eb6b-4ffc-a0a1-edeaebfe0a7e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 08886847-3d66-41ea-b13d-78bec27950a5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:40.948147 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9495e545-eb6b-4ffc-a0a1-edeaebfe0a7e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:40.948641 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9495e545-eb6b-4ffc-a0a1-edeaebfe0a7e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:40.949079 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9495e545-eb6b-4ffc-a0a1-edeaebfe0a7e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:40.949775 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9495e545-eb6b-4ffc-a0a1-edeaebfe0a7e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:40.950227 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9495e545-eb6b-4ffc-a0a1-edeaebfe0a7e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:40.950681 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9495e545-eb6b-4ffc-a0a1-edeaebfe0a7e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:40.965128 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-9495e545-eb6b-4ffc-a0a1-edeaebfe0a7e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] HTTP exception thrown: Instance 08886847-3d66-41ea-b13d-78bec27950a5 could not be found. Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9495e545-eb6b-4ffc-a0a1-edeaebfe0a7e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Request method failure captured: Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5 HTTP/1.1 Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xp6rUdIsYnfs49nr8p-3tgit6VpNtF0E4NPSidukXDEQntBhlyx_gwU6AjnU2O7Q5BLuafO4z_ZO55y2txpq1OJeOibLbj_karsXsR0GpyTHp3BnitplkO9r1bHquRHPgg2Nq4jyNzT0obzTHzoVjdq8NdzVY4LztormmeY7retjUI Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: bf36f5153ba648008cdaceb9dc538e53 Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-TestVolumeBootPattern-121766107 Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bf36f5153ba648008cdaceb9dc538e53", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-TestVolumeBootPattern-121766107 Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: bf36f5153ba648008cdaceb9dc538e53 Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-TestVolumeBootPattern-121766107 Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-TestVolumeBootPattern-121766107-project Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 661f6c9aa7da4e348a9b0d91840078c2 Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-TestVolumeBootPattern-121766107-project Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 08886847-3d66-41ea-b13d-78bec27950a5 could not be found. Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '08886847-3d66-41ea-b13d-78bec27950a5'} Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08886847-3d66-41ea-b13d-78bec27950a5 could not be found. Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08886847-3d66-41ea-b13d-78bec27950a5 could not be found. Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:58:40.966749 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:58:40.976914 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:58:40.976914 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:58:40.976914 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:58:40.976914 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:58:40.976914 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:58:40.976914 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08886847-3d66-41ea-b13d-78bec27950a5 could not be found. Aug 07 01:58:40.976914 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:58:40.976914 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9495e545-eb6b-4ffc-a0a1-edeaebfe0a7e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Returning 404 to user: Instance 08886847-3d66-41ea-b13d-78bec27950a5 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:58:40.976914 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9495e545-eb6b-4ffc-a0a1-edeaebfe0a7e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5" status: 404 len: 111 microversion: 2.1 time: 0.032233 Aug 07 01:58:40.976914 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2946/6356] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:40 2022] GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:58:41.068450 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b360c97c-07f9-4179-81da-8bf2dc2bf1ee tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-903857890", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-55640696", "security_groups": [{"name": "tempest-secgroup-smoke-2046667871"}], "block_device_mapping_v2": [{"uuid": "4a17fb95-6746-4257-9612-72f35c6b9751", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "620c0b3f-63f9-404f-acf4-ca02927e0de7"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:58:41.185225 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-b360c97c-07f9-4179-81da-8bf2dc2bf1ee tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] validate_networks() for [('620c0b3f-63f9-404f-acf4-ca02927e0de7', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:58:41.561213 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-b360c97c-07f9-4179-81da-8bf2dc2bf1ee tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:58:41.561654 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-b360c97c-07f9-4179-81da-8bf2dc2bf1ee tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:58:41.562206 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-b360c97c-07f9-4179-81da-8bf2dc2bf1ee tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:58:41.562655 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-b360c97c-07f9-4179-81da-8bf2dc2bf1ee tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:58:41.563109 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-b360c97c-07f9-4179-81da-8bf2dc2bf1ee tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:58:41.572048 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b360c97c-07f9-4179-81da-8bf2dc2bf1ee tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:41.572556 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b360c97c-07f9-4179-81da-8bf2dc2bf1ee tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:41.573014 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b360c97c-07f9-4179-81da-8bf2dc2bf1ee tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:41.573769 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b360c97c-07f9-4179-81da-8bf2dc2bf1ee tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:41.574239 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b360c97c-07f9-4179-81da-8bf2dc2bf1ee tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:41.574685 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b360c97c-07f9-4179-81da-8bf2dc2bf1ee tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:41.593620 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-b360c97c-07f9-4179-81da-8bf2dc2bf1ee tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Getting quotas for project bf36f5153ba648008cdaceb9dc538e53. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:58:41.599622 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-b360c97c-07f9-4179-81da-8bf2dc2bf1ee tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Getting quotas for user 661f6c9aa7da4e348a9b0d91840078c2 and project bf36f5153ba648008cdaceb9dc538e53. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:58:41.664807 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b360c97c-07f9-4179-81da-8bf2dc2bf1ee tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:58:41.666993 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b360c97c-07f9-4179-81da-8bf2dc2bf1ee tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 48c2c3fe-f1f4-4b79-a2b2-811e9418a1be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4a17fb95-6746-4257-9612-72f35c6b9751',volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:58:41.803920 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b360c97c-07f9-4179-81da-8bf2dc2bf1ee tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.739525 Aug 07 01:58:41.804595 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3411/6357] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:58:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 07 01:58:41.816155 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bb23cc48-16f6-47e0-b381-ae8bbe30c141 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:41.816715 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bb23cc48-16f6-47e0-b381-ae8bbe30c141 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 48c2c3fe-f1f4-4b79-a2b2-811e9418a1be] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:41.880950 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bb23cc48-16f6-47e0-b381-ae8bbe30c141 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:41.888684 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bb23cc48-16f6-47e0-b381-ae8bbe30c141 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be" status: 200 len: 1092 microversion: 2.1 time: 0.077049 Aug 07 01:58:41.890498 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2947/6358] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:41 2022] GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be => generated 1092 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:58:42.911248 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1a471c5a-415b-48a5-a1e5-39e4aefc6b60 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:42.912574 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1a471c5a-415b-48a5-a1e5-39e4aefc6b60 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 48c2c3fe-f1f4-4b79-a2b2-811e9418a1be] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:42.920498 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1a471c5a-415b-48a5-a1e5-39e4aefc6b60 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:42.922081 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1a471c5a-415b-48a5-a1e5-39e4aefc6b60 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:42.922537 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1a471c5a-415b-48a5-a1e5-39e4aefc6b60 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:42.923281 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1a471c5a-415b-48a5-a1e5-39e4aefc6b60 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:42.923744 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1a471c5a-415b-48a5-a1e5-39e4aefc6b60 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:42.924533 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1a471c5a-415b-48a5-a1e5-39e4aefc6b60 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:42.988841 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1a471c5a-415b-48a5-a1e5-39e4aefc6b60 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:42.997950 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1a471c5a-415b-48a5-a1e5-39e4aefc6b60 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be" status: 200 len: 1208 microversion: 2.1 time: 0.091627 Aug 07 01:58:42.998540 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3412/6359] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:42 2022] GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be => generated 1208 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:58:44.019515 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-451977d5-64af-40e3-a7b8-25fa3a61e5a2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:44.020605 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-451977d5-64af-40e3-a7b8-25fa3a61e5a2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 48c2c3fe-f1f4-4b79-a2b2-811e9418a1be] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:44.028245 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-451977d5-64af-40e3-a7b8-25fa3a61e5a2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:44.028818 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-451977d5-64af-40e3-a7b8-25fa3a61e5a2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:44.029376 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-451977d5-64af-40e3-a7b8-25fa3a61e5a2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:44.031078 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-451977d5-64af-40e3-a7b8-25fa3a61e5a2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:44.031718 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-451977d5-64af-40e3-a7b8-25fa3a61e5a2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:44.032243 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-451977d5-64af-40e3-a7b8-25fa3a61e5a2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:44.305993 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-451977d5-64af-40e3-a7b8-25fa3a61e5a2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:44.322176 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-451977d5-64af-40e3-a7b8-25fa3a61e5a2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be" status: 200 len: 1276 microversion: 2.1 time: 0.306753 Aug 07 01:58:44.325116 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2948/6360] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:44 2022] GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be => generated 1276 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:58:44.424752 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-62c90156-936b-4002-a3aa-d8dd00381859 req-7c96b6ef-255b-48fb-bbe4-5e324e0b2ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48c2c3fe-f1f4-4b79-a2b2-811e9418a1be", "tag": "af787e6e-3ea9-4b26-9930-46ee9b38aa44"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:58:44.444387 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-62c90156-936b-4002-a3aa-d8dd00381859 req-7c96b6ef-255b-48fb-bbe4-5e324e0b2ee3 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:44.444891 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-62c90156-936b-4002-a3aa-d8dd00381859 req-7c96b6ef-255b-48fb-bbe4-5e324e0b2ee3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:44.445396 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-62c90156-936b-4002-a3aa-d8dd00381859 req-7c96b6ef-255b-48fb-bbe4-5e324e0b2ee3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:44.460824 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-62c90156-936b-4002-a3aa-d8dd00381859 req-7c96b6ef-255b-48fb-bbe4-5e324e0b2ee3 service nova] Creating event network-changed:af787e6e-3ea9-4b26-9930-46ee9b38aa44 for instance 48c2c3fe-f1f4-4b79-a2b2-811e9418a1be on n-h1-master-1 Aug 07 01:58:44.466110 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-62c90156-936b-4002-a3aa-d8dd00381859 req-7c96b6ef-255b-48fb-bbe4-5e324e0b2ee3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046160 Aug 07 01:58:44.466883 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3413/6361] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:58:45.354299 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e9805139-7b5d-409a-9b0f-69499a1b9435 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:45.355113 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e9805139-7b5d-409a-9b0f-69499a1b9435 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 48c2c3fe-f1f4-4b79-a2b2-811e9418a1be] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:45.363432 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9805139-7b5d-409a-9b0f-69499a1b9435 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:45.364309 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9805139-7b5d-409a-9b0f-69499a1b9435 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:45.364826 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9805139-7b5d-409a-9b0f-69499a1b9435 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:45.365705 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9805139-7b5d-409a-9b0f-69499a1b9435 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:45.366212 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9805139-7b5d-409a-9b0f-69499a1b9435 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:45.366660 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9805139-7b5d-409a-9b0f-69499a1b9435 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:45.559141 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e9805139-7b5d-409a-9b0f-69499a1b9435 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:45.568189 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e9805139-7b5d-409a-9b0f-69499a1b9435 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be" status: 200 len: 1276 microversion: 2.1 time: 0.219418 Aug 07 01:58:45.568922 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2949/6362] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:45 2022] GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be => generated 1276 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:58:46.590580 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5796b0ab-04b8-4af6-93b0-2ee6071db789 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:46.591302 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5796b0ab-04b8-4af6-93b0-2ee6071db789 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 48c2c3fe-f1f4-4b79-a2b2-811e9418a1be] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:46.597951 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5796b0ab-04b8-4af6-93b0-2ee6071db789 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:46.598454 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5796b0ab-04b8-4af6-93b0-2ee6071db789 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:46.598913 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5796b0ab-04b8-4af6-93b0-2ee6071db789 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:46.599637 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5796b0ab-04b8-4af6-93b0-2ee6071db789 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:46.600142 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5796b0ab-04b8-4af6-93b0-2ee6071db789 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:46.600624 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5796b0ab-04b8-4af6-93b0-2ee6071db789 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:46.742434 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5796b0ab-04b8-4af6-93b0-2ee6071db789 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:46.750800 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5796b0ab-04b8-4af6-93b0-2ee6071db789 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be" status: 200 len: 1276 microversion: 2.1 time: 0.165344 Aug 07 01:58:46.751378 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3414/6363] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:46 2022] GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be => generated 1276 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:58:47.772121 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e6579371-c3ff-424c-bd6d-6e4343d46efb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:47.772814 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e6579371-c3ff-424c-bd6d-6e4343d46efb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 48c2c3fe-f1f4-4b79-a2b2-811e9418a1be] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:47.780518 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e6579371-c3ff-424c-bd6d-6e4343d46efb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:47.781539 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e6579371-c3ff-424c-bd6d-6e4343d46efb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:47.781989 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e6579371-c3ff-424c-bd6d-6e4343d46efb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:47.782713 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e6579371-c3ff-424c-bd6d-6e4343d46efb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:47.783207 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e6579371-c3ff-424c-bd6d-6e4343d46efb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:47.783629 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e6579371-c3ff-424c-bd6d-6e4343d46efb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:47.930778 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e6579371-c3ff-424c-bd6d-6e4343d46efb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:47.940989 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e6579371-c3ff-424c-bd6d-6e4343d46efb tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be" status: 200 len: 1276 microversion: 2.1 time: 0.173026 Aug 07 01:58:47.941978 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2950/6364] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:47 2022] GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be => generated 1276 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:58:48.961848 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c7a81349-65f8-4b59-90cb-431eb92c72d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:48.962470 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c7a81349-65f8-4b59-90cb-431eb92c72d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 48c2c3fe-f1f4-4b79-a2b2-811e9418a1be] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:48.969756 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c7a81349-65f8-4b59-90cb-431eb92c72d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:48.970251 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c7a81349-65f8-4b59-90cb-431eb92c72d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:48.970708 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c7a81349-65f8-4b59-90cb-431eb92c72d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:48.971433 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c7a81349-65f8-4b59-90cb-431eb92c72d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:48.971923 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c7a81349-65f8-4b59-90cb-431eb92c72d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:48.972371 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c7a81349-65f8-4b59-90cb-431eb92c72d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:49.111232 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c7a81349-65f8-4b59-90cb-431eb92c72d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:49.119203 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c7a81349-65f8-4b59-90cb-431eb92c72d6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be" status: 200 len: 1264 microversion: 2.1 time: 0.161339 Aug 07 01:58:49.119913 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3415/6365] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:48 2022] GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:58:50.141560 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-12dda061-98f9-478e-b90e-aa02596aa6d5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:50.142174 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-12dda061-98f9-478e-b90e-aa02596aa6d5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 48c2c3fe-f1f4-4b79-a2b2-811e9418a1be] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:50.149086 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12dda061-98f9-478e-b90e-aa02596aa6d5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:50.149571 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12dda061-98f9-478e-b90e-aa02596aa6d5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:50.150012 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12dda061-98f9-478e-b90e-aa02596aa6d5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:50.150710 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12dda061-98f9-478e-b90e-aa02596aa6d5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:50.151170 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12dda061-98f9-478e-b90e-aa02596aa6d5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:50.151591 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-12dda061-98f9-478e-b90e-aa02596aa6d5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:50.155725 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:58:50.289006 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-12dda061-98f9-478e-b90e-aa02596aa6d5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:50.296884 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-12dda061-98f9-478e-b90e-aa02596aa6d5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be" status: 200 len: 1264 microversion: 2.1 time: 0.159855 Aug 07 01:58:50.297465 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2951/6366] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:50 2022] GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:58:51.317322 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c6775977-0f9f-40b0-9cb6-f22904bb3ad2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:51.317886 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c6775977-0f9f-40b0-9cb6-f22904bb3ad2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 48c2c3fe-f1f4-4b79-a2b2-811e9418a1be] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:51.324766 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c6775977-0f9f-40b0-9cb6-f22904bb3ad2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:51.325268 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c6775977-0f9f-40b0-9cb6-f22904bb3ad2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:51.325714 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c6775977-0f9f-40b0-9cb6-f22904bb3ad2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:51.326421 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c6775977-0f9f-40b0-9cb6-f22904bb3ad2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:51.326889 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c6775977-0f9f-40b0-9cb6-f22904bb3ad2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:51.327323 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c6775977-0f9f-40b0-9cb6-f22904bb3ad2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:51.462354 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c6775977-0f9f-40b0-9cb6-f22904bb3ad2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:51.470950 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c6775977-0f9f-40b0-9cb6-f22904bb3ad2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be" status: 200 len: 1264 microversion: 2.1 time: 0.157587 Aug 07 01:58:51.471532 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3416/6367] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:51 2022] GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:58:52.496503 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5d8ff983-03f9-491e-a321-727b3e86b8ab tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:52.497050 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5d8ff983-03f9-491e-a321-727b3e86b8ab tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 48c2c3fe-f1f4-4b79-a2b2-811e9418a1be] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:52.499700 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:58:52.505123 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d8ff983-03f9-491e-a321-727b3e86b8ab tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:52.505601 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d8ff983-03f9-491e-a321-727b3e86b8ab tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:52.506035 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d8ff983-03f9-491e-a321-727b3e86b8ab tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:52.506728 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d8ff983-03f9-491e-a321-727b3e86b8ab tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:52.507182 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d8ff983-03f9-491e-a321-727b3e86b8ab tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:52.507606 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d8ff983-03f9-491e-a321-727b3e86b8ab tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:52.641086 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5d8ff983-03f9-491e-a321-727b3e86b8ab tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:52.648848 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5d8ff983-03f9-491e-a321-727b3e86b8ab tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be" status: 200 len: 1264 microversion: 2.1 time: 0.156331 Aug 07 01:58:52.649432 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2952/6368] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:52 2022] GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:58:53.669694 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-44009c0e-1cab-4cc0-a0f3-5bfac03387ab tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:53.670308 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-44009c0e-1cab-4cc0-a0f3-5bfac03387ab tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 48c2c3fe-f1f4-4b79-a2b2-811e9418a1be] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:53.672353 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:58:53.673028 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:58:53.679746 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-44009c0e-1cab-4cc0-a0f3-5bfac03387ab tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:53.680264 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-44009c0e-1cab-4cc0-a0f3-5bfac03387ab tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:53.680712 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-44009c0e-1cab-4cc0-a0f3-5bfac03387ab tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:53.681419 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-44009c0e-1cab-4cc0-a0f3-5bfac03387ab tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:53.681894 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-44009c0e-1cab-4cc0-a0f3-5bfac03387ab tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:53.682329 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-44009c0e-1cab-4cc0-a0f3-5bfac03387ab tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:53.686279 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=93 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:58:53.818187 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-44009c0e-1cab-4cc0-a0f3-5bfac03387ab tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:53.825115 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-44009c0e-1cab-4cc0-a0f3-5bfac03387ab tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be" status: 200 len: 1264 microversion: 2.1 time: 0.159407 Aug 07 01:58:53.825691 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3417/6369] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:53 2022] GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:58:54.846815 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5c850acb-09ec-4977-9d8c-7936b15cbd6c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:54.847457 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5c850acb-09ec-4977-9d8c-7936b15cbd6c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 48c2c3fe-f1f4-4b79-a2b2-811e9418a1be] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:54.854282 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c850acb-09ec-4977-9d8c-7936b15cbd6c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:54.854762 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c850acb-09ec-4977-9d8c-7936b15cbd6c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:54.855196 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c850acb-09ec-4977-9d8c-7936b15cbd6c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:54.855899 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c850acb-09ec-4977-9d8c-7936b15cbd6c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:54.856364 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c850acb-09ec-4977-9d8c-7936b15cbd6c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:54.856785 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5c850acb-09ec-4977-9d8c-7936b15cbd6c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:54.987774 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5c850acb-09ec-4977-9d8c-7936b15cbd6c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:54.995603 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5c850acb-09ec-4977-9d8c-7936b15cbd6c tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be" status: 200 len: 1264 microversion: 2.1 time: 0.153317 Aug 07 01:58:54.996195 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2953/6370] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:54 2022] GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:58:56.016178 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-253a2d92-0cf0-4b47-bee6-465e046d78be tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:56.016819 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-253a2d92-0cf0-4b47-bee6-465e046d78be tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 48c2c3fe-f1f4-4b79-a2b2-811e9418a1be] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:56.023740 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-253a2d92-0cf0-4b47-bee6-465e046d78be tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:56.024284 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-253a2d92-0cf0-4b47-bee6-465e046d78be tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:56.024738 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-253a2d92-0cf0-4b47-bee6-465e046d78be tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:56.025469 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-253a2d92-0cf0-4b47-bee6-465e046d78be tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:56.025948 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-253a2d92-0cf0-4b47-bee6-465e046d78be tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:56.026396 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-253a2d92-0cf0-4b47-bee6-465e046d78be tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:56.173567 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-253a2d92-0cf0-4b47-bee6-465e046d78be tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:56.181314 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-253a2d92-0cf0-4b47-bee6-465e046d78be tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be" status: 200 len: 1264 microversion: 2.1 time: 0.169093 Aug 07 01:58:56.181914 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3418/6371] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:56 2022] GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:58:57.202204 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a20eec3a-0774-4f17-b594-09299e6f8660 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:57.202829 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a20eec3a-0774-4f17-b594-09299e6f8660 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 48c2c3fe-f1f4-4b79-a2b2-811e9418a1be] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:57.209919 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a20eec3a-0774-4f17-b594-09299e6f8660 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:57.210406 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a20eec3a-0774-4f17-b594-09299e6f8660 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:57.210852 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a20eec3a-0774-4f17-b594-09299e6f8660 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:57.211562 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a20eec3a-0774-4f17-b594-09299e6f8660 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:57.212052 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a20eec3a-0774-4f17-b594-09299e6f8660 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:57.212481 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a20eec3a-0774-4f17-b594-09299e6f8660 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:57.348132 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a20eec3a-0774-4f17-b594-09299e6f8660 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:57.355950 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a20eec3a-0774-4f17-b594-09299e6f8660 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be" status: 200 len: 1264 microversion: 2.1 time: 0.157727 Aug 07 01:58:57.356528 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2954/6372] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:57 2022] GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:58:57.410775 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b89a6fe9-0a1f-439f-bf7e-61551c72b3fb tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:58:57.413078 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b89a6fe9-0a1f-439f-bf7e-61551c72b3fb tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: e48957f5-1bac-403c-8071-99ec34e80b7b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:57.420019 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b89a6fe9-0a1f-439f-bf7e-61551c72b3fb tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:57.420522 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b89a6fe9-0a1f-439f-bf7e-61551c72b3fb tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:57.420979 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b89a6fe9-0a1f-439f-bf7e-61551c72b3fb tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:57.421694 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b89a6fe9-0a1f-439f-bf7e-61551c72b3fb tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:57.422165 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b89a6fe9-0a1f-439f-bf7e-61551c72b3fb tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:57.422609 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b89a6fe9-0a1f-439f-bf7e-61551c72b3fb tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:57.490933 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b89a6fe9-0a1f-439f-bf7e-61551c72b3fb tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "POST /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b/action" status: 200 len: 24569 microversion: 2.1 time: 0.084025 Aug 07 01:58:57.491570 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3419/6373] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:58:57 2022] POST /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b/action => generated 24569 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:58:58.063306 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-b1094da8-f651-4576-b918-ce5667f5a518 req-23962141-2eda-482b-897a-2ff1db1fa205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48c2c3fe-f1f4-4b79-a2b2-811e9418a1be", "name": "network-vif-plugged", "status": "completed", "tag": "af787e6e-3ea9-4b26-9930-46ee9b38aa44"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:58:58.072987 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b1094da8-f651-4576-b918-ce5667f5a518 req-23962141-2eda-482b-897a-2ff1db1fa205 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:58.073570 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b1094da8-f651-4576-b918-ce5667f5a518 req-23962141-2eda-482b-897a-2ff1db1fa205 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:58.073867 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b1094da8-f651-4576-b918-ce5667f5a518 req-23962141-2eda-482b-897a-2ff1db1fa205 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:58.086474 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-b1094da8-f651-4576-b918-ce5667f5a518 req-23962141-2eda-482b-897a-2ff1db1fa205 service nova] Creating event network-vif-plugged:af787e6e-3ea9-4b26-9930-46ee9b38aa44 for instance 48c2c3fe-f1f4-4b79-a2b2-811e9418a1be on n-h1-master-1 Aug 07 01:58:58.091821 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-b1094da8-f651-4576-b918-ce5667f5a518 req-23962141-2eda-482b-897a-2ff1db1fa205 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032582 Aug 07 01:58:58.092481 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2955/6374] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:58:58.378589 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-137b354a-4680-414e-ad50-2ee920f0a971 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:58.379482 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-137b354a-4680-414e-ad50-2ee920f0a971 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 48c2c3fe-f1f4-4b79-a2b2-811e9418a1be] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:58.386667 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-137b354a-4680-414e-ad50-2ee920f0a971 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:58.387161 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-137b354a-4680-414e-ad50-2ee920f0a971 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:58.387611 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-137b354a-4680-414e-ad50-2ee920f0a971 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:58.388431 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-137b354a-4680-414e-ad50-2ee920f0a971 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:58.388900 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-137b354a-4680-414e-ad50-2ee920f0a971 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:58.389337 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-137b354a-4680-414e-ad50-2ee920f0a971 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:58.613835 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-137b354a-4680-414e-ad50-2ee920f0a971 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:58.621548 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-137b354a-4680-414e-ad50-2ee920f0a971 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be" status: 200 len: 1264 microversion: 2.1 time: 0.247799 Aug 07 01:58:58.622130 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3420/6375] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:58 2022] GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be => generated 1264 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:58:59.644434 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-138c1beb-d5cd-41d8-9b28-d9ddb9ad416f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:59.645150 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-138c1beb-d5cd-41d8-9b28-d9ddb9ad416f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 48c2c3fe-f1f4-4b79-a2b2-811e9418a1be] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:59.652603 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-138c1beb-d5cd-41d8-9b28-d9ddb9ad416f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:59.653094 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-138c1beb-d5cd-41d8-9b28-d9ddb9ad416f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:59.653534 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-138c1beb-d5cd-41d8-9b28-d9ddb9ad416f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:59.654243 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-138c1beb-d5cd-41d8-9b28-d9ddb9ad416f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:59.654698 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-138c1beb-d5cd-41d8-9b28-d9ddb9ad416f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:59.655127 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-138c1beb-d5cd-41d8-9b28-d9ddb9ad416f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:59.793761 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-138c1beb-d5cd-41d8-9b28-d9ddb9ad416f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:59.801527 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-138c1beb-d5cd-41d8-9b28-d9ddb9ad416f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be" status: 200 len: 1451 microversion: 2.1 time: 0.162452 Aug 07 01:58:59.802096 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2956/6376] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:59 2022] GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:58:59.822478 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-eb79daf2-519f-4fbf-947b-9a345dc0b1a2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:58:59.823141 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-eb79daf2-519f-4fbf-947b-9a345dc0b1a2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 48c2c3fe-f1f4-4b79-a2b2-811e9418a1be] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:58:59.831909 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb79daf2-519f-4fbf-947b-9a345dc0b1a2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:59.832435 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb79daf2-519f-4fbf-947b-9a345dc0b1a2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:59.832896 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb79daf2-519f-4fbf-947b-9a345dc0b1a2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:59.833615 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb79daf2-519f-4fbf-947b-9a345dc0b1a2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:58:59.834089 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb79daf2-519f-4fbf-947b-9a345dc0b1a2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:58:59.834535 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb79daf2-519f-4fbf-947b-9a345dc0b1a2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:58:59.965010 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-eb79daf2-519f-4fbf-947b-9a345dc0b1a2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:58:59.972853 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-eb79daf2-519f-4fbf-947b-9a345dc0b1a2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be" status: 200 len: 1451 microversion: 2.1 time: 0.154334 Aug 07 01:58:59.973421 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3421/6377] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:58:59 2022] GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:59:01.838906 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-0a768d1a-3c25-4bd1-8790-d0084d470d6c req-5d6f5ed3-7de3-4aba-bdfa-223dc0d9b11b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48c2c3fe-f1f4-4b79-a2b2-811e9418a1be", "tag": "af787e6e-3ea9-4b26-9930-46ee9b38aa44"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:59:01.850985 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0a768d1a-3c25-4bd1-8790-d0084d470d6c req-5d6f5ed3-7de3-4aba-bdfa-223dc0d9b11b service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:01.851457 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0a768d1a-3c25-4bd1-8790-d0084d470d6c req-5d6f5ed3-7de3-4aba-bdfa-223dc0d9b11b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:01.851903 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0a768d1a-3c25-4bd1-8790-d0084d470d6c req-5d6f5ed3-7de3-4aba-bdfa-223dc0d9b11b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:01.865181 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-0a768d1a-3c25-4bd1-8790-d0084d470d6c req-5d6f5ed3-7de3-4aba-bdfa-223dc0d9b11b service nova] Creating event network-changed:af787e6e-3ea9-4b26-9930-46ee9b38aa44 for instance 48c2c3fe-f1f4-4b79-a2b2-811e9418a1be on n-h1-master-1 Aug 07 01:59:01.872407 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-0a768d1a-3c25-4bd1-8790-d0084d470d6c req-5d6f5ed3-7de3-4aba-bdfa-223dc0d9b11b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037006 Aug 07 01:59:01.873029 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2957/6378] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:59:08.672035 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-79ea3416-c962-4c00-b891-ee03bdf40c6e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:59:08.672705 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-79ea3416-c962-4c00-b891-ee03bdf40c6e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: e48957f5-1bac-403c-8071-99ec34e80b7b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:08.678971 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-79ea3416-c962-4c00-b891-ee03bdf40c6e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:08.679465 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-79ea3416-c962-4c00-b891-ee03bdf40c6e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:08.679948 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-79ea3416-c962-4c00-b891-ee03bdf40c6e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:08.680663 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-79ea3416-c962-4c00-b891-ee03bdf40c6e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:08.681133 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-79ea3416-c962-4c00-b891-ee03bdf40c6e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:08.681575 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-79ea3416-c962-4c00-b891-ee03bdf40c6e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:08.819480 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-79ea3416-c962-4c00-b891-ee03bdf40c6e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:59:08.827080 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-79ea3416-c962-4c00-b891-ee03bdf40c6e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b" status: 200 len: 1679 microversion: 2.1 time: 0.292920 Aug 07 01:59:08.827642 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3422/6379] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:59:08 2022] GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b => generated 1679 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:59:08.924649 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9d7b9a84-34cf-47de-8f6f-6c9d355f5fad tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:59:08.926976 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9d7b9a84-34cf-47de-8f6f-6c9d355f5fad tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: e48957f5-1bac-403c-8071-99ec34e80b7b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:08.928968 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=38 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:59:08.935032 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9d7b9a84-34cf-47de-8f6f-6c9d355f5fad tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:08.935526 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9d7b9a84-34cf-47de-8f6f-6c9d355f5fad tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:08.935998 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9d7b9a84-34cf-47de-8f6f-6c9d355f5fad tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:08.936709 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9d7b9a84-34cf-47de-8f6f-6c9d355f5fad tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:08.937171 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9d7b9a84-34cf-47de-8f6f-6c9d355f5fad tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:08.937605 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9d7b9a84-34cf-47de-8f6f-6c9d355f5fad tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:09.006715 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9d7b9a84-34cf-47de-8f6f-6c9d355f5fad tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "POST /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b/action" status: 200 len: 32644 microversion: 2.1 time: 0.087543 Aug 07 01:59:09.007411 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2958/6380] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:59:08 2022] POST /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b/action => generated 32644 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:59:09.219230 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-767d81aa-6538-427c-8f7c-e67348f440b0 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:59:09.219859 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-767d81aa-6538-427c-8f7c-e67348f440b0 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] [instance: e48957f5-1bac-403c-8071-99ec34e80b7b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:09.225828 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-767d81aa-6538-427c-8f7c-e67348f440b0 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:09.226320 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-767d81aa-6538-427c-8f7c-e67348f440b0 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:09.226794 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-767d81aa-6538-427c-8f7c-e67348f440b0 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:09.227504 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-767d81aa-6538-427c-8f7c-e67348f440b0 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:09.227984 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-767d81aa-6538-427c-8f7c-e67348f440b0 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:09.228421 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-767d81aa-6538-427c-8f7c-e67348f440b0 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:09.357534 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-767d81aa-6538-427c-8f7c-e67348f440b0 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b" status: 200 len: 1830 microversion: 2.1 time: 0.248744 Aug 07 01:59:09.358108 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3423/6381] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:59:09 2022] GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b => generated 1830 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:59:09.387216 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-23a1d93b-3dea-4fae-933f-20d3e60d0ee1 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:59:09.389766 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-23a1d93b-3dea-4fae-933f-20d3e60d0ee1 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] [instance: e48957f5-1bac-403c-8071-99ec34e80b7b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:09.396931 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23a1d93b-3dea-4fae-933f-20d3e60d0ee1 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:09.397417 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23a1d93b-3dea-4fae-933f-20d3e60d0ee1 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:09.397857 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23a1d93b-3dea-4fae-933f-20d3e60d0ee1 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:09.398554 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23a1d93b-3dea-4fae-933f-20d3e60d0ee1 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:09.399009 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23a1d93b-3dea-4fae-933f-20d3e60d0ee1 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:09.399437 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23a1d93b-3dea-4fae-933f-20d3e60d0ee1 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:09.429517 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-23a1d93b-3dea-4fae-933f-20d3e60d0ee1 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Lazy-loading 'flavor' on Instance uuid e48957f5-1bac-403c-8071-99ec34e80b7b {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 01:59:09.442472 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-23a1d93b-3dea-4fae-933f-20d3e60d0ee1 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] [instance: e48957f5-1bac-403c-8071-99ec34e80b7b] Going to try to live migrate instance to another host {{(pid=119517) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 07 01:59:09.506927 n-d-master-1 devstack@n-api.service[119517]: ERROR oslo.messaging._drivers.impl_rabbit [None req-23a1d93b-3dea-4fae-933f-20d3e60d0ee1 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] [6cc5ef9f-4fb2-4c71-93c6-303c7a5e778d] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 07 01:59:10.515948 n-d-master-1 devstack@n-api.service[119517]: INFO oslo.messaging._drivers.impl_rabbit [None req-23a1d93b-3dea-4fae-933f-20d3e60d0ee1 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] [6cc5ef9f-4fb2-4c71-93c6-303c7a5e778d] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 59464. Aug 07 01:59:11.833620 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-23a1d93b-3dea-4fae-933f-20d3e60d0ee1 tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b/action" status: 202 len: 0 microversion: 2.1 time: 2.450672 Aug 07 01:59:11.835074 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2959/6382] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:59:09 2022] POST /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b/action => generated 0 bytes in 2453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:59:11.844780 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d9a1a684-515a-497f-a66e-f0ad169e5a10 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:59:11.845420 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d9a1a684-515a-497f-a66e-f0ad169e5a10 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: e48957f5-1bac-403c-8071-99ec34e80b7b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:11.848292 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:59:11.855163 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d9a1a684-515a-497f-a66e-f0ad169e5a10 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:11.855807 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d9a1a684-515a-497f-a66e-f0ad169e5a10 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:11.856312 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d9a1a684-515a-497f-a66e-f0ad169e5a10 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:11.857264 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d9a1a684-515a-497f-a66e-f0ad169e5a10 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:11.857866 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d9a1a684-515a-497f-a66e-f0ad169e5a10 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:11.858323 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d9a1a684-515a-497f-a66e-f0ad169e5a10 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:12.016467 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d9a1a684-515a-497f-a66e-f0ad169e5a10 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:59:12.025159 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d9a1a684-515a-497f-a66e-f0ad169e5a10 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b" status: 200 len: 1689 microversion: 2.1 time: 0.184092 Aug 07 01:59:12.025750 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3424/6383] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:59:11 2022] GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b => generated 1689 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:59:13.048527 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c6f586de-0d6c-4d6c-9310-bfa31961b2b7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:59:13.049222 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c6f586de-0d6c-4d6c-9310-bfa31961b2b7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: e48957f5-1bac-403c-8071-99ec34e80b7b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:13.057177 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6f586de-0d6c-4d6c-9310-bfa31961b2b7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:13.057669 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6f586de-0d6c-4d6c-9310-bfa31961b2b7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:13.058118 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6f586de-0d6c-4d6c-9310-bfa31961b2b7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:13.058822 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6f586de-0d6c-4d6c-9310-bfa31961b2b7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:13.059287 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6f586de-0d6c-4d6c-9310-bfa31961b2b7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:13.059722 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6f586de-0d6c-4d6c-9310-bfa31961b2b7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:13.320681 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c6f586de-0d6c-4d6c-9310-bfa31961b2b7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:59:13.328770 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c6f586de-0d6c-4d6c-9310-bfa31961b2b7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b" status: 200 len: 1689 microversion: 2.1 time: 0.284652 Aug 07 01:59:13.329362 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2960/6384] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:59:13 2022] GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b => generated 1689 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:59:13.799573 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-d36602bb-530b-4f9a-bcfb-0712a83a5d39 req-fc147b39-dc7d-45f3-9c95-417b207f4160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e48957f5-1bac-403c-8071-99ec34e80b7b", "name": "network-vif-unplugged", "status": "completed", "tag": "52898008-7083-46da-a8be-9b35eee5ba7d"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:59:13.810750 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d36602bb-530b-4f9a-bcfb-0712a83a5d39 req-fc147b39-dc7d-45f3-9c95-417b207f4160 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:13.811249 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d36602bb-530b-4f9a-bcfb-0712a83a5d39 req-fc147b39-dc7d-45f3-9c95-417b207f4160 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:13.811704 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d36602bb-530b-4f9a-bcfb-0712a83a5d39 req-fc147b39-dc7d-45f3-9c95-417b207f4160 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:13.824189 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-d36602bb-530b-4f9a-bcfb-0712a83a5d39 req-fc147b39-dc7d-45f3-9c95-417b207f4160 service nova] Creating event network-vif-unplugged:52898008-7083-46da-a8be-9b35eee5ba7d for instance e48957f5-1bac-403c-8071-99ec34e80b7b on n-h2-master-1 Aug 07 01:59:13.829800 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-d36602bb-530b-4f9a-bcfb-0712a83a5d39 req-fc147b39-dc7d-45f3-9c95-417b207f4160 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034492 Aug 07 01:59:13.830829 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3425/6385] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:59:14.352898 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-29395f9f-6fb0-446f-b048-3608844cb356 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:59:14.353522 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-29395f9f-6fb0-446f-b048-3608844cb356 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: e48957f5-1bac-403c-8071-99ec34e80b7b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:14.361441 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-29395f9f-6fb0-446f-b048-3608844cb356 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:14.361938 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-29395f9f-6fb0-446f-b048-3608844cb356 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:14.362384 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-29395f9f-6fb0-446f-b048-3608844cb356 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:14.363355 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-29395f9f-6fb0-446f-b048-3608844cb356 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:14.363817 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-29395f9f-6fb0-446f-b048-3608844cb356 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:14.364320 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-29395f9f-6fb0-446f-b048-3608844cb356 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:14.503132 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-29395f9f-6fb0-446f-b048-3608844cb356 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:59:14.510814 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-29395f9f-6fb0-446f-b048-3608844cb356 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b" status: 200 len: 1689 microversion: 2.1 time: 0.163445 Aug 07 01:59:14.511377 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2961/6386] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:59:14 2022] GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:59:15.533926 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-800020ed-e511-49f5-b82d-fae8c5e3e07e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:59:15.534673 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-800020ed-e511-49f5-b82d-fae8c5e3e07e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: e48957f5-1bac-403c-8071-99ec34e80b7b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:15.541469 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-800020ed-e511-49f5-b82d-fae8c5e3e07e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:15.541971 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-800020ed-e511-49f5-b82d-fae8c5e3e07e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:15.542430 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-800020ed-e511-49f5-b82d-fae8c5e3e07e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:15.544566 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-800020ed-e511-49f5-b82d-fae8c5e3e07e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:15.545051 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-800020ed-e511-49f5-b82d-fae8c5e3e07e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:15.545501 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-800020ed-e511-49f5-b82d-fae8c5e3e07e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:15.689591 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-800020ed-e511-49f5-b82d-fae8c5e3e07e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:59:15.697199 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-800020ed-e511-49f5-b82d-fae8c5e3e07e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b" status: 200 len: 1689 microversion: 2.1 time: 0.168475 Aug 07 01:59:15.697773 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3426/6387] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:59:15 2022] GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:59:15.867373 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-5bf68dc3-3e3a-4529-a299-005ad6bdfa1c req-15053b63-9872-4f83-8d5c-7355a47e4c3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e48957f5-1bac-403c-8071-99ec34e80b7b", "tag": "52898008-7083-46da-a8be-9b35eee5ba7d"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:59:15.877716 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-5bf68dc3-3e3a-4529-a299-005ad6bdfa1c req-15053b63-9872-4f83-8d5c-7355a47e4c3b service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:15.878195 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-5bf68dc3-3e3a-4529-a299-005ad6bdfa1c req-15053b63-9872-4f83-8d5c-7355a47e4c3b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:15.878635 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-5bf68dc3-3e3a-4529-a299-005ad6bdfa1c req-15053b63-9872-4f83-8d5c-7355a47e4c3b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:15.890062 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-5bf68dc3-3e3a-4529-a299-005ad6bdfa1c req-15053b63-9872-4f83-8d5c-7355a47e4c3b service nova] Creating event network-changed:52898008-7083-46da-a8be-9b35eee5ba7d for instance e48957f5-1bac-403c-8071-99ec34e80b7b on n-h2-master-1 Aug 07 01:59:15.895442 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-5bf68dc3-3e3a-4529-a299-005ad6bdfa1c req-15053b63-9872-4f83-8d5c-7355a47e4c3b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031714 Aug 07 01:59:15.896113 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2962/6388] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:59:16.720065 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2aac5fa7-7676-4b44-b3c0-c8b36da7fb8f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:59:16.720702 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2aac5fa7-7676-4b44-b3c0-c8b36da7fb8f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: e48957f5-1bac-403c-8071-99ec34e80b7b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:16.728462 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2aac5fa7-7676-4b44-b3c0-c8b36da7fb8f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:16.728977 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2aac5fa7-7676-4b44-b3c0-c8b36da7fb8f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:16.729439 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2aac5fa7-7676-4b44-b3c0-c8b36da7fb8f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:16.730192 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2aac5fa7-7676-4b44-b3c0-c8b36da7fb8f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:16.730649 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2aac5fa7-7676-4b44-b3c0-c8b36da7fb8f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:16.731096 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2aac5fa7-7676-4b44-b3c0-c8b36da7fb8f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:16.870141 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2aac5fa7-7676-4b44-b3c0-c8b36da7fb8f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:59:16.878254 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2aac5fa7-7676-4b44-b3c0-c8b36da7fb8f tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b" status: 200 len: 1689 microversion: 2.1 time: 0.162298 Aug 07 01:59:16.879251 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3427/6389] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:59:16 2022] GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:59:17.911282 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-dc5160dd-3f9d-456f-a402-ec53b75ee5f7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:59:17.911955 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-dc5160dd-3f9d-456f-a402-ec53b75ee5f7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: e48957f5-1bac-403c-8071-99ec34e80b7b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:17.918997 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dc5160dd-3f9d-456f-a402-ec53b75ee5f7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:17.919493 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dc5160dd-3f9d-456f-a402-ec53b75ee5f7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:17.920000 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dc5160dd-3f9d-456f-a402-ec53b75ee5f7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:17.921103 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dc5160dd-3f9d-456f-a402-ec53b75ee5f7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:17.921358 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dc5160dd-3f9d-456f-a402-ec53b75ee5f7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:17.921795 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dc5160dd-3f9d-456f-a402-ec53b75ee5f7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:18.066715 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-dc5160dd-3f9d-456f-a402-ec53b75ee5f7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:59:18.074324 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-dc5160dd-3f9d-456f-a402-ec53b75ee5f7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b" status: 200 len: 1689 microversion: 2.1 time: 0.168927 Aug 07 01:59:18.074885 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2963/6390] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:59:17 2022] GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:59:19.095870 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0b2d7306-594c-409b-a207-a5d879dabc08 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:59:19.096628 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0b2d7306-594c-409b-a207-a5d879dabc08 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: e48957f5-1bac-403c-8071-99ec34e80b7b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:19.104133 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b2d7306-594c-409b-a207-a5d879dabc08 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:19.104629 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b2d7306-594c-409b-a207-a5d879dabc08 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:19.105314 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b2d7306-594c-409b-a207-a5d879dabc08 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:19.106041 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b2d7306-594c-409b-a207-a5d879dabc08 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:19.106509 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b2d7306-594c-409b-a207-a5d879dabc08 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:19.106949 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b2d7306-594c-409b-a207-a5d879dabc08 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:19.627862 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0b2d7306-594c-409b-a207-a5d879dabc08 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:59:19.635800 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0b2d7306-594c-409b-a207-a5d879dabc08 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b" status: 200 len: 1689 microversion: 2.1 time: 0.543772 Aug 07 01:59:19.636406 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3428/6391] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:59:19 2022] GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b => generated 1689 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:59:20.657148 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5668a264-592a-4db9-b6ce-a1a297c75fc8 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:59:20.657884 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5668a264-592a-4db9-b6ce-a1a297c75fc8 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: e48957f5-1bac-403c-8071-99ec34e80b7b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:20.664912 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5668a264-592a-4db9-b6ce-a1a297c75fc8 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:20.665403 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5668a264-592a-4db9-b6ce-a1a297c75fc8 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:20.665837 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5668a264-592a-4db9-b6ce-a1a297c75fc8 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:20.666537 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5668a264-592a-4db9-b6ce-a1a297c75fc8 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:20.666987 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5668a264-592a-4db9-b6ce-a1a297c75fc8 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:20.667411 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5668a264-592a-4db9-b6ce-a1a297c75fc8 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:20.670180 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:59:20.887841 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5668a264-592a-4db9-b6ce-a1a297c75fc8 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:59:20.895740 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5668a264-592a-4db9-b6ce-a1a297c75fc8 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b" status: 200 len: 1689 microversion: 2.1 time: 0.242496 Aug 07 01:59:20.896282 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2964/6392] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:59:20 2022] GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b => generated 1689 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:59:21.918283 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-da703975-4533-4b8d-968a-2113f00c0d42 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:59:21.918919 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-da703975-4533-4b8d-968a-2113f00c0d42 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: e48957f5-1bac-403c-8071-99ec34e80b7b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:21.926016 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da703975-4533-4b8d-968a-2113f00c0d42 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:21.927139 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da703975-4533-4b8d-968a-2113f00c0d42 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:21.927599 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da703975-4533-4b8d-968a-2113f00c0d42 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:21.928417 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da703975-4533-4b8d-968a-2113f00c0d42 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:21.928897 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da703975-4533-4b8d-968a-2113f00c0d42 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:21.929346 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da703975-4533-4b8d-968a-2113f00c0d42 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:22.071329 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-da703975-4533-4b8d-968a-2113f00c0d42 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:59:22.080893 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-da703975-4533-4b8d-968a-2113f00c0d42 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b" status: 200 len: 1679 microversion: 2.1 time: 0.166609 Aug 07 01:59:22.081481 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3429/6393] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:59:21 2022] GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:59:22.102939 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3c894d41-cf94-4d00-aa23-59d71121114d tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:59:22.103611 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3c894d41-cf94-4d00-aa23-59d71121114d tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] [instance: e48957f5-1bac-403c-8071-99ec34e80b7b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:22.110759 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c894d41-cf94-4d00-aa23-59d71121114d tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:22.111282 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c894d41-cf94-4d00-aa23-59d71121114d tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:22.111723 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c894d41-cf94-4d00-aa23-59d71121114d tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:22.112715 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c894d41-cf94-4d00-aa23-59d71121114d tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:22.113199 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c894d41-cf94-4d00-aa23-59d71121114d tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:22.113601 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c894d41-cf94-4d00-aa23-59d71121114d tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:22.255229 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3c894d41-cf94-4d00-aa23-59d71121114d tempest-TestNetworkAdvancedServerOps-1645316255 tempest-TestNetworkAdvancedServerOps-1645316255-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b" status: 200 len: 1830 microversion: 2.1 time: 0.156286 Aug 07 01:59:22.255798 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2965/6394] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:59:22 2022] GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b => generated 1830 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:59:22.283345 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-94313134-df17-42da-bda5-11c185cb3248 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:59:22.283869 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-94313134-df17-42da-bda5-11c185cb3248 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: e48957f5-1bac-403c-8071-99ec34e80b7b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:22.289922 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94313134-df17-42da-bda5-11c185cb3248 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:22.290413 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94313134-df17-42da-bda5-11c185cb3248 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:22.290934 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94313134-df17-42da-bda5-11c185cb3248 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:22.291728 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94313134-df17-42da-bda5-11c185cb3248 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:22.292290 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94313134-df17-42da-bda5-11c185cb3248 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:22.292725 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94313134-df17-42da-bda5-11c185cb3248 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:22.425699 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-94313134-df17-42da-bda5-11c185cb3248 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:59:22.434367 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-94313134-df17-42da-bda5-11c185cb3248 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b" status: 200 len: 1679 microversion: 2.1 time: 0.155252 Aug 07 01:59:22.434937 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3430/6395] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:59:22 2022] GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:59:22.532252 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4ca218eb-a43c-4071-8f52-2a99405f63d9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:59:22.534634 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4ca218eb-a43c-4071-8f52-2a99405f63d9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: e48957f5-1bac-403c-8071-99ec34e80b7b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:22.541292 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ca218eb-a43c-4071-8f52-2a99405f63d9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:22.542035 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ca218eb-a43c-4071-8f52-2a99405f63d9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:22.542701 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ca218eb-a43c-4071-8f52-2a99405f63d9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:22.543762 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ca218eb-a43c-4071-8f52-2a99405f63d9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:22.544666 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ca218eb-a43c-4071-8f52-2a99405f63d9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:22.545490 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4ca218eb-a43c-4071-8f52-2a99405f63d9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:22.612034 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4ca218eb-a43c-4071-8f52-2a99405f63d9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "POST /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b/action" status: 200 len: 38663 microversion: 2.1 time: 0.083712 Aug 07 01:59:22.612960 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2966/6396] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 01:59:22 2022] POST /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b/action => generated 38663 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 01:59:23.653209 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-94833e6f-8d6b-487b-b6c1-1c97b0ec1e3b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:59:23.654273 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-2241664b-2e0a-47be-8cfb-0d3f6704231a req-f9b21e8c-6e76-4768-bba7-5fece34da0ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e48957f5-1bac-403c-8071-99ec34e80b7b", "tag": "52898008-7083-46da-a8be-9b35eee5ba7d"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:59:23.655008 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-94833e6f-8d6b-487b-b6c1-1c97b0ec1e3b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: e48957f5-1bac-403c-8071-99ec34e80b7b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:23.665199 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94833e6f-8d6b-487b-b6c1-1c97b0ec1e3b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:23.665553 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-2241664b-2e0a-47be-8cfb-0d3f6704231a req-f9b21e8c-6e76-4768-bba7-5fece34da0ea service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:23.666037 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-2241664b-2e0a-47be-8cfb-0d3f6704231a req-f9b21e8c-6e76-4768-bba7-5fece34da0ea service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:23.666433 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-2241664b-2e0a-47be-8cfb-0d3f6704231a req-f9b21e8c-6e76-4768-bba7-5fece34da0ea service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:23.666666 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94833e6f-8d6b-487b-b6c1-1c97b0ec1e3b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:23.667521 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94833e6f-8d6b-487b-b6c1-1c97b0ec1e3b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:23.669247 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94833e6f-8d6b-487b-b6c1-1c97b0ec1e3b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:23.670396 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94833e6f-8d6b-487b-b6c1-1c97b0ec1e3b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:23.671303 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-94833e6f-8d6b-487b-b6c1-1c97b0ec1e3b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:23.680749 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-2241664b-2e0a-47be-8cfb-0d3f6704231a req-f9b21e8c-6e76-4768-bba7-5fece34da0ea service nova] Creating event network-changed:52898008-7083-46da-a8be-9b35eee5ba7d for instance e48957f5-1bac-403c-8071-99ec34e80b7b on n-h1-master-1 Aug 07 01:59:23.685721 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-2241664b-2e0a-47be-8cfb-0d3f6704231a req-f9b21e8c-6e76-4768-bba7-5fece34da0ea service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035899 Aug 07 01:59:23.686335 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2967/6397] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:59:23.706664 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-94833e6f-8d6b-487b-b6c1-1c97b0ec1e3b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: e48957f5-1bac-403c-8071-99ec34e80b7b] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:59:23.708786 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=82 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:59:23.801256 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-94833e6f-8d6b-487b-b6c1-1c97b0ec1e3b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b" status: 204 len: 0 microversion: 2.1 time: 0.152587 Aug 07 01:59:23.802035 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3431/6398] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:59:23 2022] DELETE /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:59:23.813144 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-77d0cd93-8c43-488e-a2e3-1e4bee900e99 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:59:23.814171 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-77d0cd93-8c43-488e-a2e3-1e4bee900e99 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: e48957f5-1bac-403c-8071-99ec34e80b7b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:23.822040 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-77d0cd93-8c43-488e-a2e3-1e4bee900e99 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:23.822761 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-77d0cd93-8c43-488e-a2e3-1e4bee900e99 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:23.823467 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-77d0cd93-8c43-488e-a2e3-1e4bee900e99 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:23.824384 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-77d0cd93-8c43-488e-a2e3-1e4bee900e99 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:23.825006 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-77d0cd93-8c43-488e-a2e3-1e4bee900e99 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:23.825790 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-77d0cd93-8c43-488e-a2e3-1e4bee900e99 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:24.014821 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-77d0cd93-8c43-488e-a2e3-1e4bee900e99 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:59:24.023163 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-77d0cd93-8c43-488e-a2e3-1e4bee900e99 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b" status: 200 len: 1685 microversion: 2.1 time: 0.215153 Aug 07 01:59:24.023762 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2968/6399] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:59:23 2022] GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b => generated 1685 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:59:25.008031 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-6a5e3a86-7efc-4e44-86ab-39d554c397bc req-b0f67b4c-3f98-4146-ad48-16212115726e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e48957f5-1bac-403c-8071-99ec34e80b7b", "name": "network-vif-deleted", "tag": "52898008-7083-46da-a8be-9b35eee5ba7d"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:59:25.019510 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6a5e3a86-7efc-4e44-86ab-39d554c397bc req-b0f67b4c-3f98-4146-ad48-16212115726e service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:25.020030 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6a5e3a86-7efc-4e44-86ab-39d554c397bc req-b0f67b4c-3f98-4146-ad48-16212115726e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:25.020474 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6a5e3a86-7efc-4e44-86ab-39d554c397bc req-b0f67b4c-3f98-4146-ad48-16212115726e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:25.031104 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-6a5e3a86-7efc-4e44-86ab-39d554c397bc req-b0f67b4c-3f98-4146-ad48-16212115726e service nova] Creating event network-vif-deleted:52898008-7083-46da-a8be-9b35eee5ba7d for instance e48957f5-1bac-403c-8071-99ec34e80b7b on n-h1-master-1 Aug 07 01:59:25.036985 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-6a5e3a86-7efc-4e44-86ab-39d554c397bc req-b0f67b4c-3f98-4146-ad48-16212115726e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033566 Aug 07 01:59:25.037580 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3432/6400] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:59:25.044856 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4a2cfea2-e3b0-4295-bcfe-6c374d7af9b9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:59:25.045476 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4a2cfea2-e3b0-4295-bcfe-6c374d7af9b9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: e48957f5-1bac-403c-8071-99ec34e80b7b] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:25.052364 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4a2cfea2-e3b0-4295-bcfe-6c374d7af9b9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:25.052853 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4a2cfea2-e3b0-4295-bcfe-6c374d7af9b9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:25.053294 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4a2cfea2-e3b0-4295-bcfe-6c374d7af9b9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:25.054612 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4a2cfea2-e3b0-4295-bcfe-6c374d7af9b9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:25.055073 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4a2cfea2-e3b0-4295-bcfe-6c374d7af9b9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:25.055504 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4a2cfea2-e3b0-4295-bcfe-6c374d7af9b9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:25.121829 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4a2cfea2-e3b0-4295-bcfe-6c374d7af9b9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:59:25.129548 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4a2cfea2-e3b0-4295-bcfe-6c374d7af9b9 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b" status: 200 len: 1350 microversion: 2.1 time: 0.088681 Aug 07 01:59:25.130122 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2969/6401] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:59:25 2022] GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b => generated 1350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:59:26.152827 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d3b47276-fb5f-4f56-9164-72d5c9a5b8c7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:59:26.153537 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d3b47276-fb5f-4f56-9164-72d5c9a5b8c7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: e48957f5-1bac-403c-8071-99ec34e80b7b] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:26.159687 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3b47276-fb5f-4f56-9164-72d5c9a5b8c7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:26.160217 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3b47276-fb5f-4f56-9164-72d5c9a5b8c7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:26.160666 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3b47276-fb5f-4f56-9164-72d5c9a5b8c7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:26.161371 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3b47276-fb5f-4f56-9164-72d5c9a5b8c7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:26.161841 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3b47276-fb5f-4f56-9164-72d5c9a5b8c7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:26.162279 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d3b47276-fb5f-4f56-9164-72d5c9a5b8c7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:26.176098 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-d3b47276-fb5f-4f56-9164-72d5c9a5b8c7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] HTTP exception thrown: Instance e48957f5-1bac-403c-8071-99ec34e80b7b could not be found. Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d3b47276-fb5f-4f56-9164-72d5c9a5b8c7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Request method failure captured: Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b HTTP/1.1 Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xs7m9NZoR7QYJEs2LdGd8pBDTRyEi0z4J0cBXKascPq3zVViX-oKQvuaXwOhnW2JLOmnZwctSI6Ey4onVMpls1VeWoMFG_HIdnE2zQ7QFGrzRXTZiFvvZQlJ3VmarDoU9LqJmDS_SlWfy2oHktXR4wvHeXSLIROc6sY5luRoQUQZ5A Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: d37d8c916412400ba4b57ea10fceb39e Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1464135667 Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d37d8c916412400ba4b57ea10fceb39e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d37d8c916412400ba4b57ea10fceb39e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d37d8c916412400ba4b57ea10fceb39e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d37d8c916412400ba4b57ea10fceb39e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1464135667 Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: d37d8c916412400ba4b57ea10fceb39e Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1464135667 Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-TestNetworkAdvancedServerOps-1464135667-project Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 830639b9b39a43a7b714b74c26fdf52c Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1464135667-project Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: exception: Instance e48957f5-1bac-403c-8071-99ec34e80b7b could not be found. Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'e48957f5-1bac-403c-8071-99ec34e80b7b'} Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e48957f5-1bac-403c-8071-99ec34e80b7b could not be found. Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e48957f5-1bac-403c-8071-99ec34e80b7b could not be found. Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:59:26.177760 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:59:26.185585 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:59:26.185585 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:59:26.185585 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:59:26.185585 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:59:26.185585 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:59:26.185585 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:59:26.185585 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e48957f5-1bac-403c-8071-99ec34e80b7b could not be found. Aug 07 01:59:26.185585 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:59:26.185585 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d3b47276-fb5f-4f56-9164-72d5c9a5b8c7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Returning 404 to user: Instance e48957f5-1bac-403c-8071-99ec34e80b7b could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:59:26.185585 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d3b47276-fb5f-4f56-9164-72d5c9a5b8c7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b" status: 404 len: 111 microversion: 2.1 time: 0.032766 Aug 07 01:59:26.185585 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3433/6402] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:59:26 2022] GET /compute/v2.1/servers/e48957f5-1bac-403c-8071-99ec34e80b7b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:59:29.445290 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3b34efd0-7f4d-4049-bfcf-a163384c1048 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '.version_select at 0x7f9e17ef8040>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:59:29.473141 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3b34efd0-7f4d-4049-bfcf-a163384c1048 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-934680293" status: 202 len: 0 microversion: 2.1 time: 0.031642 Aug 07 01:59:29.473926 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2970/6403] 10.222.0.39 () {58 vars in 1281 bytes} [Sun Aug 7 01:59:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-934680293 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:59:29.505042 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a4ef877e-510e-4894-9811-a19bd0ac6533 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Action: 'create', calling method: .version_select at 0x7f9e24a4c5e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-252350562", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKk+xue4XWr7vUAWO/75ERq539WWsrWEFTTJkA935O9HmaVuyHDfyDx8gcRxI5OXKXxoZXgDqOlT07MF/7v3vd8Zmy0SlE8tOeixcsXupP+uC1ETErN6TCVQ04aWSQsCxA=="}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:59:29.523699 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-a4ef877e-510e-4894-9811-a19bd0ac6533 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Getting quotas for project d37d8c916412400ba4b57ea10fceb39e. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:59:29.529100 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-a4ef877e-510e-4894-9811-a19bd0ac6533 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Getting quotas for user 830639b9b39a43a7b714b74c26fdf52c and project d37d8c916412400ba4b57ea10fceb39e. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:59:29.552532 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a4ef877e-510e-4894-9811-a19bd0ac6533 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.051363 Aug 07 01:59:29.553084 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3434/6404] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 01:59:29 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:59:35.502019 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=29 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:59:35.507818 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1452c67e-9314-4002-a182-9e0f19c89357 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-813158218", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "143fbf99-6f3d-4ee8-8d8d-86b75293b613"}], "key_name": "tempest-TestNetworkAdvancedServerOps-252350562", "security_groups": [{"name": "tempest-secgroup-smoke-1496346858"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:59:35.637933 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-1452c67e-9314-4002-a182-9e0f19c89357 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] validate_networks() for [('143fbf99-6f3d-4ee8-8d8d-86b75293b613', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 01:59:36.292265 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-1452c67e-9314-4002-a182-9e0f19c89357 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 01:59:36.292730 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-1452c67e-9314-4002-a182-9e0f19c89357 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 01:59:36.293216 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-1452c67e-9314-4002-a182-9e0f19c89357 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 01:59:36.294606 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-1452c67e-9314-4002-a182-9e0f19c89357 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 01:59:36.295519 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-1452c67e-9314-4002-a182-9e0f19c89357 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 01:59:36.317916 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1452c67e-9314-4002-a182-9e0f19c89357 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:36.318485 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1452c67e-9314-4002-a182-9e0f19c89357 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:36.318941 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1452c67e-9314-4002-a182-9e0f19c89357 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:36.319729 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1452c67e-9314-4002-a182-9e0f19c89357 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:36.320257 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1452c67e-9314-4002-a182-9e0f19c89357 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:36.320697 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1452c67e-9314-4002-a182-9e0f19c89357 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:36.346049 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-1452c67e-9314-4002-a182-9e0f19c89357 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Getting quotas for project d37d8c916412400ba4b57ea10fceb39e. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 01:59:36.354052 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-1452c67e-9314-4002-a182-9e0f19c89357 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Getting quotas for user 830639b9b39a43a7b714b74c26fdf52c and project d37d8c916412400ba4b57ea10fceb39e. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 01:59:36.370982 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1452c67e-9314-4002-a182-9e0f19c89357 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 01:59:36.374076 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1452c67e-9314-4002-a182-9e0f19c89357 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 01:59:36.429817 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1452c67e-9314-4002-a182-9e0f19c89357 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.929535 Aug 07 01:59:36.431359 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2971/6405] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:59:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 01:59:36.446282 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-aebce094-2459-45a7-9da4-2d8b466f5f55 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:59:36.447611 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-aebce094-2459-45a7-9da4-2d8b466f5f55 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:36.453974 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:59:36.548401 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-aebce094-2459-45a7-9da4-2d8b466f5f55 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:59:36.557883 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-aebce094-2459-45a7-9da4-2d8b466f5f55 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543" status: 200 len: 1265 microversion: 2.1 time: 0.118050 Aug 07 01:59:36.560215 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3435/6406] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:59:36 2022] GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543 => generated 1265 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:59:37.580317 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2635b4b5-90a8-455b-aba5-487d8ba4eda5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:59:37.581593 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2635b4b5-90a8-455b-aba5-487d8ba4eda5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:37.590113 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2635b4b5-90a8-455b-aba5-487d8ba4eda5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:37.590911 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2635b4b5-90a8-455b-aba5-487d8ba4eda5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:37.591742 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2635b4b5-90a8-455b-aba5-487d8ba4eda5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:37.592904 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2635b4b5-90a8-455b-aba5-487d8ba4eda5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:37.593598 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2635b4b5-90a8-455b-aba5-487d8ba4eda5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:37.594327 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2635b4b5-90a8-455b-aba5-487d8ba4eda5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:37.667571 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2635b4b5-90a8-455b-aba5-487d8ba4eda5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:59:37.679409 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2635b4b5-90a8-455b-aba5-487d8ba4eda5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543" status: 200 len: 1325 microversion: 2.1 time: 0.103304 Aug 07 01:59:37.680262 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2972/6407] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:59:37 2022] GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543 => generated 1325 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:59:38.700808 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f9e8b510-3add-4b76-89cf-a231735eca2a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:59:38.701442 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f9e8b510-3add-4b76-89cf-a231735eca2a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:38.709130 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f9e8b510-3add-4b76-89cf-a231735eca2a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:38.709630 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f9e8b510-3add-4b76-89cf-a231735eca2a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:38.710119 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f9e8b510-3add-4b76-89cf-a231735eca2a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:38.710844 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f9e8b510-3add-4b76-89cf-a231735eca2a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:38.711314 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f9e8b510-3add-4b76-89cf-a231735eca2a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:38.711756 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f9e8b510-3add-4b76-89cf-a231735eca2a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:38.945877 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f9e8b510-3add-4b76-89cf-a231735eca2a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:59:38.954066 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f9e8b510-3add-4b76-89cf-a231735eca2a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543" status: 200 len: 1391 microversion: 2.1 time: 0.257160 Aug 07 01:59:38.954743 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3436/6408] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:59:38 2022] GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543 => generated 1391 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:59:39.116063 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-1df19f7b-0deb-41fc-b2d6-0bbb2f0c9a48 req-5e5e2684-fbf3-4045-b153-4f1f0b30b61e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82dc88f9-e52e-4fc5-a7b8-4a9f95408543", "tag": "192657c1-f151-4c98-bb41-ffc463b7336c"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:59:39.127593 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:59:39.134351 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-1df19f7b-0deb-41fc-b2d6-0bbb2f0c9a48 req-5e5e2684-fbf3-4045-b153-4f1f0b30b61e service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:39.134925 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-1df19f7b-0deb-41fc-b2d6-0bbb2f0c9a48 req-5e5e2684-fbf3-4045-b153-4f1f0b30b61e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:39.135493 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-1df19f7b-0deb-41fc-b2d6-0bbb2f0c9a48 req-5e5e2684-fbf3-4045-b153-4f1f0b30b61e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:39.151005 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-1df19f7b-0deb-41fc-b2d6-0bbb2f0c9a48 req-5e5e2684-fbf3-4045-b153-4f1f0b30b61e service nova] Creating event network-changed:192657c1-f151-4c98-bb41-ffc463b7336c for instance 82dc88f9-e52e-4fc5-a7b8-4a9f95408543 on n-h2-master-1 Aug 07 01:59:39.156440 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-1df19f7b-0deb-41fc-b2d6-0bbb2f0c9a48 req-5e5e2684-fbf3-4045-b153-4f1f0b30b61e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044234 Aug 07 01:59:39.157629 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2973/6409] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:59:39.976665 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f180bdbe-4024-498d-bcc6-30d28f106573 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:59:39.977264 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f180bdbe-4024-498d-bcc6-30d28f106573 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:39.984302 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f180bdbe-4024-498d-bcc6-30d28f106573 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:39.984830 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f180bdbe-4024-498d-bcc6-30d28f106573 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:39.985439 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f180bdbe-4024-498d-bcc6-30d28f106573 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:39.986165 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f180bdbe-4024-498d-bcc6-30d28f106573 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:39.986627 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f180bdbe-4024-498d-bcc6-30d28f106573 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:39.987348 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f180bdbe-4024-498d-bcc6-30d28f106573 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:40.118486 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f180bdbe-4024-498d-bcc6-30d28f106573 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:59:40.126083 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f180bdbe-4024-498d-bcc6-30d28f106573 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543" status: 200 len: 1391 microversion: 2.1 time: 0.153436 Aug 07 01:59:40.126656 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3437/6410] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:59:39 2022] GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:59:41.118463 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1be04cab-a568-405c-8b9c-7b295a9a4ac2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:59:41.119018 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1be04cab-a568-405c-8b9c-7b295a9a4ac2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] [instance: e5734d92-ca17-495b-b666-b569ea15ddc7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:41.125184 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1be04cab-a568-405c-8b9c-7b295a9a4ac2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:41.125662 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1be04cab-a568-405c-8b9c-7b295a9a4ac2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:41.126098 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1be04cab-a568-405c-8b9c-7b295a9a4ac2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:41.126794 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1be04cab-a568-405c-8b9c-7b295a9a4ac2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:41.127244 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1be04cab-a568-405c-8b9c-7b295a9a4ac2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:41.127669 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1be04cab-a568-405c-8b9c-7b295a9a4ac2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:41.146740 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-787ac636-f56c-4b8c-a8b3-1db3f5a9dc81 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:59:41.147375 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-787ac636-f56c-4b8c-a8b3-1db3f5a9dc81 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:41.153914 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1be04cab-a568-405c-8b9c-7b295a9a4ac2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] [instance: e5734d92-ca17-495b-b666-b569ea15ddc7] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 01:59:41.154338 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-787ac636-f56c-4b8c-a8b3-1db3f5a9dc81 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:41.154843 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-787ac636-f56c-4b8c-a8b3-1db3f5a9dc81 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:41.155459 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-787ac636-f56c-4b8c-a8b3-1db3f5a9dc81 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:41.156079 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-787ac636-f56c-4b8c-a8b3-1db3f5a9dc81 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:41.156559 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-787ac636-f56c-4b8c-a8b3-1db3f5a9dc81 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:41.157004 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-787ac636-f56c-4b8c-a8b3-1db3f5a9dc81 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:41.233950 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1be04cab-a568-405c-8b9c-7b295a9a4ac2 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7" status: 204 len: 0 microversion: 2.1 time: 0.120794 Aug 07 01:59:41.234714 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2974/6411] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:59:41 2022] DELETE /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 01:59:41.244368 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4d8d7514-6a27-4aac-b12b-607f4e8ea35c tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:59:41.245231 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4d8d7514-6a27-4aac-b12b-607f4e8ea35c tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] [instance: e5734d92-ca17-495b-b666-b569ea15ddc7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:41.251410 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d8d7514-6a27-4aac-b12b-607f4e8ea35c tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:41.251908 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d8d7514-6a27-4aac-b12b-607f4e8ea35c tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:41.252448 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d8d7514-6a27-4aac-b12b-607f4e8ea35c tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:41.253157 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d8d7514-6a27-4aac-b12b-607f4e8ea35c tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:41.253615 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d8d7514-6a27-4aac-b12b-607f4e8ea35c tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:41.254043 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d8d7514-6a27-4aac-b12b-607f4e8ea35c tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:41.306473 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-787ac636-f56c-4b8c-a8b3-1db3f5a9dc81 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:59:41.314258 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-787ac636-f56c-4b8c-a8b3-1db3f5a9dc81 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543" status: 200 len: 1391 microversion: 2.1 time: 0.171555 Aug 07 01:59:41.314817 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3438/6412] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:59:41 2022] GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543 => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:59:41.391319 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4d8d7514-6a27-4aac-b12b-607f4e8ea35c tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea9eff758654d1e8b7d02e6b4153a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df97238e4904914ba19be69db5e228b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:59:41.399622 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4d8d7514-6a27-4aac-b12b-607f4e8ea35c tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] 10.222.0.39 "GET /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7" status: 200 len: 1732 microversion: 2.1 time: 0.160004 Aug 07 01:59:41.400517 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2975/6413] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:59:41 2022] GET /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:59:42.336600 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-25433883-4a01-4397-8cbb-92b356f752ad tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:59:42.337677 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-25433883-4a01-4397-8cbb-92b356f752ad tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:42.340981 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:59:42.347378 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-25433883-4a01-4397-8cbb-92b356f752ad tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:42.348015 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-25433883-4a01-4397-8cbb-92b356f752ad tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:42.348542 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-25433883-4a01-4397-8cbb-92b356f752ad tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:42.349396 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-25433883-4a01-4397-8cbb-92b356f752ad tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:42.349991 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-25433883-4a01-4397-8cbb-92b356f752ad tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:42.350542 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-25433883-4a01-4397-8cbb-92b356f752ad tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:42.421731 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fb89f1f7-89f5-4fcc-88ec-734f5d3b92b8 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:59:42.422492 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fb89f1f7-89f5-4fcc-88ec-734f5d3b92b8 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] [instance: e5734d92-ca17-495b-b666-b569ea15ddc7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:42.430975 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb89f1f7-89f5-4fcc-88ec-734f5d3b92b8 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:42.431564 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb89f1f7-89f5-4fcc-88ec-734f5d3b92b8 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:42.432252 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb89f1f7-89f5-4fcc-88ec-734f5d3b92b8 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:42.433066 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb89f1f7-89f5-4fcc-88ec-734f5d3b92b8 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:42.433984 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb89f1f7-89f5-4fcc-88ec-734f5d3b92b8 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:42.434502 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb89f1f7-89f5-4fcc-88ec-734f5d3b92b8 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:42.514142 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-25433883-4a01-4397-8cbb-92b356f752ad tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:59:42.524296 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-25433883-4a01-4397-8cbb-92b356f752ad tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543" status: 200 len: 1391 microversion: 2.1 time: 0.192215 Aug 07 01:59:42.525788 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3439/6414] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:59:42 2022] GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543 => generated 1391 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:59:42.589180 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fb89f1f7-89f5-4fcc-88ec-734f5d3b92b8 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea9eff758654d1e8b7d02e6b4153a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df97238e4904914ba19be69db5e228b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:59:42.597170 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fb89f1f7-89f5-4fcc-88ec-734f5d3b92b8 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] 10.222.0.39 "GET /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7" status: 200 len: 1732 microversion: 2.1 time: 0.179765 Aug 07 01:59:42.597800 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2976/6415] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:59:42 2022] GET /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7 => generated 1732 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:59:43.548774 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-61471701-8c2a-4bff-a00e-831742a88747 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:59:43.549405 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-61471701-8c2a-4bff-a00e-831742a88747 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:43.556496 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-61471701-8c2a-4bff-a00e-831742a88747 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:43.557090 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-61471701-8c2a-4bff-a00e-831742a88747 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:43.557531 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-61471701-8c2a-4bff-a00e-831742a88747 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:43.558300 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-61471701-8c2a-4bff-a00e-831742a88747 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:43.558780 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-61471701-8c2a-4bff-a00e-831742a88747 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:43.559229 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-61471701-8c2a-4bff-a00e-831742a88747 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:43.752202 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9ebe7759-5eb6-49bc-bff4-825046c26a05 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:59:43.753630 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9ebe7759-5eb6-49bc-bff4-825046c26a05 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] [instance: e5734d92-ca17-495b-b666-b569ea15ddc7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:43.766629 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ebe7759-5eb6-49bc-bff4-825046c26a05 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:43.767119 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ebe7759-5eb6-49bc-bff4-825046c26a05 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:43.767868 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ebe7759-5eb6-49bc-bff4-825046c26a05 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:43.768937 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ebe7759-5eb6-49bc-bff4-825046c26a05 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:43.770451 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ebe7759-5eb6-49bc-bff4-825046c26a05 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:43.771112 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ebe7759-5eb6-49bc-bff4-825046c26a05 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:43.837152 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-61471701-8c2a-4bff-a00e-831742a88747 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:59:43.849598 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-61471701-8c2a-4bff-a00e-831742a88747 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543" status: 200 len: 1391 microversion: 2.1 time: 0.304685 Aug 07 01:59:43.853436 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3440/6416] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:59:43 2022] GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543 => generated 1391 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:59:43.859877 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-38a9dfcd-2c31-47a1-8745-907199ce2526 req-03179d1b-1ac4-4654-b40f-89c303a92d60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5734d92-ca17-495b-b666-b569ea15ddc7", "name": "network-vif-deleted", "tag": "1ab783fd-84fe-49ff-a0f0-be6a02794aac"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:59:43.886844 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-38a9dfcd-2c31-47a1-8745-907199ce2526 req-03179d1b-1ac4-4654-b40f-89c303a92d60 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:43.887711 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-38a9dfcd-2c31-47a1-8745-907199ce2526 req-03179d1b-1ac4-4654-b40f-89c303a92d60 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:43.888347 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-38a9dfcd-2c31-47a1-8745-907199ce2526 req-03179d1b-1ac4-4654-b40f-89c303a92d60 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:43.888483 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9ebe7759-5eb6-49bc-bff4-825046c26a05 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea9eff758654d1e8b7d02e6b4153a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df97238e4904914ba19be69db5e228b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:59:43.900940 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9ebe7759-5eb6-49bc-bff4-825046c26a05 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] 10.222.0.39 "GET /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7" status: 200 len: 1665 microversion: 2.1 time: 0.278965 Aug 07 01:59:43.905032 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-38a9dfcd-2c31-47a1-8745-907199ce2526 req-03179d1b-1ac4-4654-b40f-89c303a92d60 service nova] Creating event network-vif-deleted:1ab783fd-84fe-49ff-a0f0-be6a02794aac for instance e5734d92-ca17-495b-b666-b569ea15ddc7 on n-h1-master-1 Aug 07 01:59:43.911801 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-38a9dfcd-2c31-47a1-8745-907199ce2526 req-03179d1b-1ac4-4654-b40f-89c303a92d60 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056308 Aug 07 01:59:43.912919 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3441/6417] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:59:43.913757 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2977/6418] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:59:43 2022] GET /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7 => generated 1665 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:59:44.876348 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5040d728-a08d-49a3-a043-0abb2a39a833 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:59:44.877023 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5040d728-a08d-49a3-a043-0abb2a39a833 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:44.884027 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5040d728-a08d-49a3-a043-0abb2a39a833 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:44.884513 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5040d728-a08d-49a3-a043-0abb2a39a833 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:44.884954 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5040d728-a08d-49a3-a043-0abb2a39a833 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:44.885669 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5040d728-a08d-49a3-a043-0abb2a39a833 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:44.886130 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5040d728-a08d-49a3-a043-0abb2a39a833 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:44.886564 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5040d728-a08d-49a3-a043-0abb2a39a833 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:44.926565 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8c4f2c9b-cdd7-4aa3-9004-b5c49423b07f tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:59:44.927625 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8c4f2c9b-cdd7-4aa3-9004-b5c49423b07f tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] [instance: e5734d92-ca17-495b-b666-b569ea15ddc7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:44.935131 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8c4f2c9b-cdd7-4aa3-9004-b5c49423b07f tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:44.935646 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8c4f2c9b-cdd7-4aa3-9004-b5c49423b07f tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:44.936137 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8c4f2c9b-cdd7-4aa3-9004-b5c49423b07f tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:44.936875 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8c4f2c9b-cdd7-4aa3-9004-b5c49423b07f tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:44.937373 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8c4f2c9b-cdd7-4aa3-9004-b5c49423b07f tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:44.938431 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8c4f2c9b-cdd7-4aa3-9004-b5c49423b07f tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:44.958485 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-8c4f2c9b-cdd7-4aa3-9004-b5c49423b07f tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] HTTP exception thrown: Instance e5734d92-ca17-495b-b666-b569ea15ddc7 could not be found. Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8c4f2c9b-cdd7-4aa3-9004-b5c49423b07f tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Request method failure captured: Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7 HTTP/1.1 Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xtb40h89zGdWeDfG2vHpcGpV3nJPOc0iYiPL0MeIlmiX37cg8Sg1aKwYyAeIxGWwObKXlxBXxC2kbcUHEK-sJHQU33lo0-ggBb2JUPL4tSKb8jSNno7_96McgFrvOy0E4wVpvNFcJsWDnfb7_czmT2zZ29T9fWnUq3MeAEN6a5HyOU Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 7df97238e4904914ba19be69db5e228b Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-TestServerBasicOps-1074917697 Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7df97238e4904914ba19be69db5e228b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7df97238e4904914ba19be69db5e228b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7df97238e4904914ba19be69db5e228b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7df97238e4904914ba19be69db5e228b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-TestServerBasicOps-1074917697 Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 7df97238e4904914ba19be69db5e228b Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-TestServerBasicOps-1074917697 Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-TestServerBasicOps-1074917697-project Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 2ea9eff758654d1e8b7d02e6b4153a73 Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-TestServerBasicOps-1074917697-project Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: exception: Instance e5734d92-ca17-495b-b666-b569ea15ddc7 could not be found. Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'e5734d92-ca17-495b-b666-b569ea15ddc7'} Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5734d92-ca17-495b-b666-b569ea15ddc7 could not be found. Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5734d92-ca17-495b-b666-b569ea15ddc7 could not be found. Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:59:44.961184 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:59:44.966081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:59:44.966081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:59:44.966081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:59:44.966081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:59:44.966081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:59:44.966081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5734d92-ca17-495b-b666-b569ea15ddc7 could not be found. Aug 07 01:59:44.966081 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:59:44.968058 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8c4f2c9b-cdd7-4aa3-9004-b5c49423b07f tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Returning 404 to user: Instance e5734d92-ca17-495b-b666-b569ea15ddc7 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:59:44.969204 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8c4f2c9b-cdd7-4aa3-9004-b5c49423b07f tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] 10.222.0.39 "GET /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7" status: 404 len: 111 microversion: 2.1 time: 0.048244 Aug 07 01:59:44.973461 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3442/6419] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:59:44 2022] GET /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 01:59:45.050722 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5040d728-a08d-49a3-a043-0abb2a39a833 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:59:45.059711 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5040d728-a08d-49a3-a043-0abb2a39a833 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543" status: 200 len: 1391 microversion: 2.1 time: 0.187276 Aug 07 01:59:45.060402 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2978/6420] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:59:44 2022] GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543 => generated 1391 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:59:45.464591 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-70de79a5-14ce-468f-b780-18f82d66c2de tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:59:45.465107 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-70de79a5-14ce-468f-b780-18f82d66c2de tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] [instance: e5734d92-ca17-495b-b666-b569ea15ddc7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:45.471207 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-70de79a5-14ce-468f-b780-18f82d66c2de tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:45.471710 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-70de79a5-14ce-468f-b780-18f82d66c2de tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:45.472187 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-70de79a5-14ce-468f-b780-18f82d66c2de tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:45.472911 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-70de79a5-14ce-468f-b780-18f82d66c2de tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:45.473379 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-70de79a5-14ce-468f-b780-18f82d66c2de tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:45.473826 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-70de79a5-14ce-468f-b780-18f82d66c2de tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:45.490972 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-70de79a5-14ce-468f-b780-18f82d66c2de tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] HTTP exception thrown: Instance e5734d92-ca17-495b-b666-b569ea15ddc7 could not be found. Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-70de79a5-14ce-468f-b780-18f82d66c2de tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Request method failure captured: Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7 HTTP/1.1 Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xtb40h89zGdWeDfG2vHpcGpV3nJPOc0iYiPL0MeIlmiX37cg8Sg1aKwYyAeIxGWwObKXlxBXxC2kbcUHEK-sJHQU33lo0-ggBb2JUPL4tSKb8jSNno7_96McgFrvOy0E4wVpvNFcJsWDnfb7_czmT2zZ29T9fWnUq3MeAEN6a5HyOU Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 7df97238e4904914ba19be69db5e228b Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-TestServerBasicOps-1074917697 Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7df97238e4904914ba19be69db5e228b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7df97238e4904914ba19be69db5e228b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7df97238e4904914ba19be69db5e228b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7df97238e4904914ba19be69db5e228b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-TestServerBasicOps-1074917697 Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 7df97238e4904914ba19be69db5e228b Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-TestServerBasicOps-1074917697 Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-TestServerBasicOps-1074917697-project Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 2ea9eff758654d1e8b7d02e6b4153a73 Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-TestServerBasicOps-1074917697-project Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: exception: Instance e5734d92-ca17-495b-b666-b569ea15ddc7 could not be found. Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'e5734d92-ca17-495b-b666-b569ea15ddc7'} Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5734d92-ca17-495b-b666-b569ea15ddc7 could not be found. Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:59:45.493221 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:59:45.499095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5734d92-ca17-495b-b666-b569ea15ddc7 could not be found. Aug 07 01:59:45.499095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:59:45.499095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:59:45.499095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:59:45.499095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:59:45.499095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:59:45.499095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:59:45.499095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:59:45.499095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:59:45.499095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5734d92-ca17-495b-b666-b569ea15ddc7 could not be found. Aug 07 01:59:45.499095 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 01:59:45.499095 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-70de79a5-14ce-468f-b780-18f82d66c2de tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Returning 404 to user: Instance e5734d92-ca17-495b-b666-b569ea15ddc7 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:59:45.499095 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-70de79a5-14ce-468f-b780-18f82d66c2de tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7" status: 404 len: 111 microversion: 2.1 time: 0.035841 Aug 07 01:59:45.499095 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3443/6421] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:59:45 2022] DELETE /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:59:45.508192 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7274a47d-f71d-4287-b784-ec630125b847 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:59:45.509149 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7274a47d-f71d-4287-b784-ec630125b847 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] [instance: e5734d92-ca17-495b-b666-b569ea15ddc7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:45.518092 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7274a47d-f71d-4287-b784-ec630125b847 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:45.518835 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7274a47d-f71d-4287-b784-ec630125b847 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:45.519505 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7274a47d-f71d-4287-b784-ec630125b847 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:45.520612 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7274a47d-f71d-4287-b784-ec630125b847 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:45.521333 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7274a47d-f71d-4287-b784-ec630125b847 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:45.522013 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7274a47d-f71d-4287-b784-ec630125b847 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:45.541379 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-7274a47d-f71d-4287-b784-ec630125b847 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] HTTP exception thrown: Instance e5734d92-ca17-495b-b666-b569ea15ddc7 could not be found. Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7274a47d-f71d-4287-b784-ec630125b847 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Request method failure captured: Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7 HTTP/1.1 Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xtb40h89zGdWeDfG2vHpcGpV3nJPOc0iYiPL0MeIlmiX37cg8Sg1aKwYyAeIxGWwObKXlxBXxC2kbcUHEK-sJHQU33lo0-ggBb2JUPL4tSKb8jSNno7_96McgFrvOy0E4wVpvNFcJsWDnfb7_czmT2zZ29T9fWnUq3MeAEN6a5HyOU Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 7df97238e4904914ba19be69db5e228b Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-TestServerBasicOps-1074917697 Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7df97238e4904914ba19be69db5e228b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7df97238e4904914ba19be69db5e228b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7df97238e4904914ba19be69db5e228b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7df97238e4904914ba19be69db5e228b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-TestServerBasicOps-1074917697 Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 7df97238e4904914ba19be69db5e228b Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-TestServerBasicOps-1074917697 Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-TestServerBasicOps-1074917697-project Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 2ea9eff758654d1e8b7d02e6b4153a73 Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-TestServerBasicOps-1074917697-project Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: exception: Instance e5734d92-ca17-495b-b666-b569ea15ddc7 could not be found. Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'e5734d92-ca17-495b-b666-b569ea15ddc7'} Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5734d92-ca17-495b-b666-b569ea15ddc7 could not be found. Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5734d92-ca17-495b-b666-b569ea15ddc7 could not be found. Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 01:59:45.543133 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:59:45.548938 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 01:59:45.548938 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 01:59:45.548938 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 01:59:45.548938 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 01:59:45.548938 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 01:59:45.548938 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5734d92-ca17-495b-b666-b569ea15ddc7 could not be found. Aug 07 01:59:45.548938 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 01:59:45.548938 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7274a47d-f71d-4287-b784-ec630125b847 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Returning 404 to user: Instance e5734d92-ca17-495b-b666-b569ea15ddc7 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 01:59:45.548938 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7274a47d-f71d-4287-b784-ec630125b847 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] 10.222.0.39 "GET /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7" status: 404 len: 111 microversion: 2.1 time: 0.043133 Aug 07 01:59:45.548938 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2979/6422] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:59:45 2022] GET /compute/v2.1/servers/e5734d92-ca17-495b-b666-b569ea15ddc7 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 01:59:45.707458 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-02afc8a4-8752-4477-8698-daaf8152ebe4 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] Calling method '.version_select at 0x7f9e24919940>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:59:45.730415 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-02afc8a4-8752-4477-8698-daaf8152ebe4 tempest-TestServerBasicOps-1074917697 tempest-TestServerBasicOps-1074917697-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-790114507" status: 202 len: 0 microversion: 2.1 time: 0.026849 Aug 07 01:59:45.731625 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3444/6423] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Aug 7 01:59:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-790114507 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 01:59:45.952488 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-989d8546-cac6-48aa-8916-bf9d6824fcbe req-c361c701-4d6a-4608-b32c-de9bb12cbbed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82dc88f9-e52e-4fc5-a7b8-4a9f95408543", "name": "network-vif-plugged", "status": "completed", "tag": "192657c1-f151-4c98-bb41-ffc463b7336c"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:59:45.963109 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-989d8546-cac6-48aa-8916-bf9d6824fcbe req-c361c701-4d6a-4608-b32c-de9bb12cbbed service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:45.963835 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-989d8546-cac6-48aa-8916-bf9d6824fcbe req-c361c701-4d6a-4608-b32c-de9bb12cbbed service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:45.964294 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-989d8546-cac6-48aa-8916-bf9d6824fcbe req-c361c701-4d6a-4608-b32c-de9bb12cbbed service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:45.977270 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-989d8546-cac6-48aa-8916-bf9d6824fcbe req-c361c701-4d6a-4608-b32c-de9bb12cbbed service nova] Creating event network-vif-plugged:192657c1-f151-4c98-bb41-ffc463b7336c for instance 82dc88f9-e52e-4fc5-a7b8-4a9f95408543 on n-h2-master-1 Aug 07 01:59:45.983034 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-989d8546-cac6-48aa-8916-bf9d6824fcbe req-c361c701-4d6a-4608-b32c-de9bb12cbbed service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128641 Aug 07 01:59:45.983637 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2980/6424] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 01:59:46.081537 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3393bf3d-7cea-4759-a836-0aa06371f499 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:59:46.082169 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3393bf3d-7cea-4759-a836-0aa06371f499 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:46.090429 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3393bf3d-7cea-4759-a836-0aa06371f499 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:46.090937 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3393bf3d-7cea-4759-a836-0aa06371f499 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:46.091386 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3393bf3d-7cea-4759-a836-0aa06371f499 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:46.092137 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3393bf3d-7cea-4759-a836-0aa06371f499 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:46.092985 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3393bf3d-7cea-4759-a836-0aa06371f499 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:46.093430 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3393bf3d-7cea-4759-a836-0aa06371f499 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:46.267743 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3393bf3d-7cea-4759-a836-0aa06371f499 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:59:46.275514 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3393bf3d-7cea-4759-a836-0aa06371f499 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543" status: 200 len: 1391 microversion: 2.1 time: 0.197990 Aug 07 01:59:46.276114 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3445/6425] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:59:46 2022] GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543 => generated 1391 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:59:47.298364 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2f27c67a-f8a2-44d6-b3b8-86cd497dd2d1 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:59:47.299820 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2f27c67a-f8a2-44d6-b3b8-86cd497dd2d1 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:47.316220 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:59:47.317127 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:59:47.320959 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f27c67a-f8a2-44d6-b3b8-86cd497dd2d1 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:47.322077 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f27c67a-f8a2-44d6-b3b8-86cd497dd2d1 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:47.323077 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f27c67a-f8a2-44d6-b3b8-86cd497dd2d1 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:47.324289 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f27c67a-f8a2-44d6-b3b8-86cd497dd2d1 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:47.325090 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f27c67a-f8a2-44d6-b3b8-86cd497dd2d1 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:47.326546 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f27c67a-f8a2-44d6-b3b8-86cd497dd2d1 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:47.724354 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2f27c67a-f8a2-44d6-b3b8-86cd497dd2d1 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:59:47.733417 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2f27c67a-f8a2-44d6-b3b8-86cd497dd2d1 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543" status: 200 len: 1562 microversion: 2.1 time: 0.439721 Aug 07 01:59:47.744644 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2981/6426] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:59:47 2022] GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543 => generated 1562 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 01:59:47.756112 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d0fd1066-8db5-4cfa-b0cb-fd581ead9cee tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:59:47.756753 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d0fd1066-8db5-4cfa-b0cb-fd581ead9cee tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:47.758829 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:59:47.765783 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0fd1066-8db5-4cfa-b0cb-fd581ead9cee tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:47.766292 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0fd1066-8db5-4cfa-b0cb-fd581ead9cee tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:47.766748 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0fd1066-8db5-4cfa-b0cb-fd581ead9cee tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:47.767482 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0fd1066-8db5-4cfa-b0cb-fd581ead9cee tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:47.767977 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0fd1066-8db5-4cfa-b0cb-fd581ead9cee tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:47.768424 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d0fd1066-8db5-4cfa-b0cb-fd581ead9cee tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:47.921571 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d0fd1066-8db5-4cfa-b0cb-fd581ead9cee tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:59:47.929823 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d0fd1066-8db5-4cfa-b0cb-fd581ead9cee tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543" status: 200 len: 1562 microversion: 2.1 time: 0.177876 Aug 07 01:59:47.930399 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3446/6427] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:59:47 2022] GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543 => generated 1562 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 01:59:50.037252 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-ac0b88fc-5b2e-4364-a2e5-b17a90528629 req-932113a5-29eb-4333-a504-b3fe64c7df5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82dc88f9-e52e-4fc5-a7b8-4a9f95408543", "tag": "192657c1-f151-4c98-bb41-ffc463b7336c"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 01:59:50.040067 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d9145846-787b-4c58-89dd-502eae393a9a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 01:59:50.043872 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d9145846-787b-4c58-89dd-502eae393a9a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 01:59:50.048364 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-ac0b88fc-5b2e-4364-a2e5-b17a90528629 req-932113a5-29eb-4333-a504-b3fe64c7df5f service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:50.048953 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-ac0b88fc-5b2e-4364-a2e5-b17a90528629 req-932113a5-29eb-4333-a504-b3fe64c7df5f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:50.049436 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-ac0b88fc-5b2e-4364-a2e5-b17a90528629 req-932113a5-29eb-4333-a504-b3fe64c7df5f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:50.059104 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9145846-787b-4c58-89dd-502eae393a9a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:50.060092 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9145846-787b-4c58-89dd-502eae393a9a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:50.060893 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9145846-787b-4c58-89dd-502eae393a9a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:50.062068 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-ac0b88fc-5b2e-4364-a2e5-b17a90528629 req-932113a5-29eb-4333-a504-b3fe64c7df5f service nova] Creating event network-changed:192657c1-f151-4c98-bb41-ffc463b7336c for instance 82dc88f9-e52e-4fc5-a7b8-4a9f95408543 on n-h2-master-1 Aug 07 01:59:50.062823 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9145846-787b-4c58-89dd-502eae393a9a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 01:59:50.063730 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9145846-787b-4c58-89dd-502eae393a9a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 01:59:50.064397 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9145846-787b-4c58-89dd-502eae393a9a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 01:59:50.067448 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-ac0b88fc-5b2e-4364-a2e5-b17a90528629 req-932113a5-29eb-4333-a504-b3fe64c7df5f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033634 Aug 07 01:59:50.071122 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3447/6428] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 01:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 01:59:50.333367 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d9145846-787b-4c58-89dd-502eae393a9a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 01:59:50.343496 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d9145846-787b-4c58-89dd-502eae393a9a tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543" status: 200 len: 1562 microversion: 2.1 time: 0.311414 Aug 07 01:59:50.344375 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2982/6429] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:59:50 2022] GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543 => generated 1562 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:00:11.655332 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:00:11.656200 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=50 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:00:11.661110 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bc3be1f5-2815-4458-9d5a-5063e4d01caf tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:00:11.663533 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bc3be1f5-2815-4458-9d5a-5063e4d01caf tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:00:11.671033 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bc3be1f5-2815-4458-9d5a-5063e4d01caf tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:11.671586 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bc3be1f5-2815-4458-9d5a-5063e4d01caf tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:11.672078 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bc3be1f5-2815-4458-9d5a-5063e4d01caf tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:11.672794 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bc3be1f5-2815-4458-9d5a-5063e4d01caf tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:11.673295 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bc3be1f5-2815-4458-9d5a-5063e4d01caf tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:11.673742 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bc3be1f5-2815-4458-9d5a-5063e4d01caf tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:11.744170 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bc3be1f5-2815-4458-9d5a-5063e4d01caf tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "POST /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543/action" status: 200 len: 24555 microversion: 2.1 time: 0.090887 Aug 07 02:00:11.744845 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3448/6430] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:00:11 2022] POST /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543/action => generated 24555 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 02:00:22.766237 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-753bff1c-9d4c-4fd3-b467-ea52f228e970 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:00:22.769076 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-753bff1c-9d4c-4fd3-b467-ea52f228e970 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:00:22.771182 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:00:22.771844 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:00:22.778129 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-753bff1c-9d4c-4fd3-b467-ea52f228e970 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:22.778614 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-753bff1c-9d4c-4fd3-b467-ea52f228e970 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:22.779059 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-753bff1c-9d4c-4fd3-b467-ea52f228e970 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:22.779762 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-753bff1c-9d4c-4fd3-b467-ea52f228e970 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:22.780252 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-753bff1c-9d4c-4fd3-b467-ea52f228e970 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:22.780682 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-753bff1c-9d4c-4fd3-b467-ea52f228e970 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:22.860125 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-753bff1c-9d4c-4fd3-b467-ea52f228e970 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 02:00:22.860577 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-753bff1c-9d4c-4fd3-b467-ea52f228e970 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 02:00:22.861303 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-753bff1c-9d4c-4fd3-b467-ea52f228e970 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 02:00:22.861748 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-753bff1c-9d4c-4fd3-b467-ea52f228e970 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 02:00:22.862158 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-753bff1c-9d4c-4fd3-b467-ea52f228e970 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 02:00:22.920825 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-753bff1c-9d4c-4fd3-b467-ea52f228e970 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:00:22.926757 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-753bff1c-9d4c-4fd3-b467-ea52f228e970 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:22.927252 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-753bff1c-9d4c-4fd3-b467-ea52f228e970 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:22.927699 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-753bff1c-9d4c-4fd3-b467-ea52f228e970 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:22.928450 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-753bff1c-9d4c-4fd3-b467-ea52f228e970 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:22.928916 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-753bff1c-9d4c-4fd3-b467-ea52f228e970 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:22.929399 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-753bff1c-9d4c-4fd3-b467-ea52f228e970 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:22.959791 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-753bff1c-9d4c-4fd3-b467-ea52f228e970 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "POST /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543/action" status: 202 len: 1136 microversion: 2.1 time: 0.197745 Aug 07 02:00:22.960488 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2983/6431] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:00:22 2022] POST /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543/action => generated 1136 bytes in 199 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 07 02:00:22.981037 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b7ac38f0-3916-467f-bdf5-766e60813432 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:00:22.981762 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b7ac38f0-3916-467f-bdf5-766e60813432 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:00:22.986379 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:00:22.987052 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=4 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:00:22.991427 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7ac38f0-3916-467f-bdf5-766e60813432 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:22.991976 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7ac38f0-3916-467f-bdf5-766e60813432 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:22.992437 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7ac38f0-3916-467f-bdf5-766e60813432 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:22.993170 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7ac38f0-3916-467f-bdf5-766e60813432 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:22.993650 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7ac38f0-3916-467f-bdf5-766e60813432 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:22.994085 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7ac38f0-3916-467f-bdf5-766e60813432 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:23.129446 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b7ac38f0-3916-467f-bdf5-766e60813432 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:00:23.137603 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b7ac38f0-3916-467f-bdf5-766e60813432 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543" status: 200 len: 1690 microversion: 2.1 time: 0.161479 Aug 07 02:00:23.138171 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3449/6432] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:00:22 2022] GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:00:24.159621 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-14827c5d-cd97-43ef-818f-2f9882553fb6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:00:24.160272 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-14827c5d-cd97-43ef-818f-2f9882553fb6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:00:24.167855 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-14827c5d-cd97-43ef-818f-2f9882553fb6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:24.168368 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-14827c5d-cd97-43ef-818f-2f9882553fb6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:24.168811 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-14827c5d-cd97-43ef-818f-2f9882553fb6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:24.169508 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-14827c5d-cd97-43ef-818f-2f9882553fb6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:24.169968 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-14827c5d-cd97-43ef-818f-2f9882553fb6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:24.170401 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-14827c5d-cd97-43ef-818f-2f9882553fb6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:24.304174 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-14827c5d-cd97-43ef-818f-2f9882553fb6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:00:24.311728 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-14827c5d-cd97-43ef-818f-2f9882553fb6 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543" status: 200 len: 1690 microversion: 2.1 time: 0.155991 Aug 07 02:00:24.312325 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2984/6433] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:00:24 2022] GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:00:25.332315 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-efe4f2ed-18fc-4b9c-9950-f5afedf3c3d7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:00:25.332945 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-efe4f2ed-18fc-4b9c-9950-f5afedf3c3d7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:00:25.339840 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-efe4f2ed-18fc-4b9c-9950-f5afedf3c3d7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:25.340360 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-efe4f2ed-18fc-4b9c-9950-f5afedf3c3d7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:25.340810 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-efe4f2ed-18fc-4b9c-9950-f5afedf3c3d7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:25.341519 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-efe4f2ed-18fc-4b9c-9950-f5afedf3c3d7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:25.341986 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-efe4f2ed-18fc-4b9c-9950-f5afedf3c3d7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:25.342433 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-efe4f2ed-18fc-4b9c-9950-f5afedf3c3d7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:25.478759 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-efe4f2ed-18fc-4b9c-9950-f5afedf3c3d7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:00:25.486877 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-efe4f2ed-18fc-4b9c-9950-f5afedf3c3d7 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543" status: 200 len: 1690 microversion: 2.1 time: 0.158534 Aug 07 02:00:25.487672 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3450/6434] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:00:25 2022] GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:00:26.510336 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-29e13eb5-9b5e-4a83-8f8e-b843b00e07f3 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:00:26.510968 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-29e13eb5-9b5e-4a83-8f8e-b843b00e07f3 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:00:26.517864 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-29e13eb5-9b5e-4a83-8f8e-b843b00e07f3 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:26.518350 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-29e13eb5-9b5e-4a83-8f8e-b843b00e07f3 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:26.518792 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-29e13eb5-9b5e-4a83-8f8e-b843b00e07f3 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:26.519490 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-29e13eb5-9b5e-4a83-8f8e-b843b00e07f3 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:26.519980 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-29e13eb5-9b5e-4a83-8f8e-b843b00e07f3 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:26.520412 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-29e13eb5-9b5e-4a83-8f8e-b843b00e07f3 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:26.658938 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-29e13eb5-9b5e-4a83-8f8e-b843b00e07f3 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:00:26.666511 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-29e13eb5-9b5e-4a83-8f8e-b843b00e07f3 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543" status: 200 len: 1690 microversion: 2.1 time: 0.160843 Aug 07 02:00:26.667079 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2985/6435] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:00:26 2022] GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543 => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:00:27.687829 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2d76d299-cda9-477a-b675-78e0b7c74410 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:00:27.688499 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2d76d299-cda9-477a-b675-78e0b7c74410 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:00:27.695547 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2d76d299-cda9-477a-b675-78e0b7c74410 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:27.696090 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2d76d299-cda9-477a-b675-78e0b7c74410 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:27.697041 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2d76d299-cda9-477a-b675-78e0b7c74410 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:27.697777 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2d76d299-cda9-477a-b675-78e0b7c74410 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:27.698248 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2d76d299-cda9-477a-b675-78e0b7c74410 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:27.698690 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2d76d299-cda9-477a-b675-78e0b7c74410 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:27.828305 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2d76d299-cda9-477a-b675-78e0b7c74410 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:00:27.838189 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2d76d299-cda9-477a-b675-78e0b7c74410 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543" status: 200 len: 1690 microversion: 2.1 time: 0.153404 Aug 07 02:00:27.839312 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3451/6436] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:00:27 2022] GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:00:28.868183 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-70f1ee2a-a390-42d9-a292-7b64cd5fe797 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:00:28.869290 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-70f1ee2a-a390-42d9-a292-7b64cd5fe797 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:00:28.876067 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-70f1ee2a-a390-42d9-a292-7b64cd5fe797 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:28.876553 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-70f1ee2a-a390-42d9-a292-7b64cd5fe797 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:28.876996 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-70f1ee2a-a390-42d9-a292-7b64cd5fe797 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:28.877691 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-70f1ee2a-a390-42d9-a292-7b64cd5fe797 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:28.878153 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-70f1ee2a-a390-42d9-a292-7b64cd5fe797 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:28.878582 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-70f1ee2a-a390-42d9-a292-7b64cd5fe797 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:29.008123 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-70f1ee2a-a390-42d9-a292-7b64cd5fe797 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:00:29.016327 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-70f1ee2a-a390-42d9-a292-7b64cd5fe797 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543" status: 200 len: 1690 microversion: 2.1 time: 0.152060 Aug 07 02:00:29.016892 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2986/6437] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:00:28 2022] GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543 => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:00:30.037769 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3e435063-6180-4ec8-b41e-3f757ee2028c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:00:30.038403 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3e435063-6180-4ec8-b41e-3f757ee2028c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:00:30.046071 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e435063-6180-4ec8-b41e-3f757ee2028c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:30.046570 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e435063-6180-4ec8-b41e-3f757ee2028c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:30.047019 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e435063-6180-4ec8-b41e-3f757ee2028c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:30.047729 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e435063-6180-4ec8-b41e-3f757ee2028c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:30.048226 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e435063-6180-4ec8-b41e-3f757ee2028c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:30.048667 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3e435063-6180-4ec8-b41e-3f757ee2028c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:30.181494 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3e435063-6180-4ec8-b41e-3f757ee2028c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:00:30.189053 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3e435063-6180-4ec8-b41e-3f757ee2028c tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543" status: 200 len: 1690 microversion: 2.1 time: 0.155404 Aug 07 02:00:30.189626 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3452/6438] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:00:30 2022] GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:00:31.209640 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-57d8a895-2cd0-4583-908c-ac8efeca1138 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:00:31.210252 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-57d8a895-2cd0-4583-908c-ac8efeca1138 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:00:31.217672 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-57d8a895-2cd0-4583-908c-ac8efeca1138 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:31.218152 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-57d8a895-2cd0-4583-908c-ac8efeca1138 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:31.218588 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-57d8a895-2cd0-4583-908c-ac8efeca1138 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:31.219277 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-57d8a895-2cd0-4583-908c-ac8efeca1138 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:31.219730 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-57d8a895-2cd0-4583-908c-ac8efeca1138 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:31.220181 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-57d8a895-2cd0-4583-908c-ac8efeca1138 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:31.355766 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-57d8a895-2cd0-4583-908c-ac8efeca1138 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:00:31.363631 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-57d8a895-2cd0-4583-908c-ac8efeca1138 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543" status: 200 len: 1690 microversion: 2.1 time: 0.157859 Aug 07 02:00:31.364225 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2987/6439] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:00:31 2022] GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543 => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:00:32.385071 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e4796f2e-97d0-4bb2-8512-b06794b4a49b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:00:32.385706 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e4796f2e-97d0-4bb2-8512-b06794b4a49b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:00:32.392716 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4796f2e-97d0-4bb2-8512-b06794b4a49b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:32.393213 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4796f2e-97d0-4bb2-8512-b06794b4a49b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:32.393671 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4796f2e-97d0-4bb2-8512-b06794b4a49b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:32.394385 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4796f2e-97d0-4bb2-8512-b06794b4a49b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:32.394885 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4796f2e-97d0-4bb2-8512-b06794b4a49b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:32.395331 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4796f2e-97d0-4bb2-8512-b06794b4a49b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:32.526704 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e4796f2e-97d0-4bb2-8512-b06794b4a49b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:00:32.534352 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e4796f2e-97d0-4bb2-8512-b06794b4a49b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543" status: 200 len: 1690 microversion: 2.1 time: 0.153754 Aug 07 02:00:32.534925 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3453/6440] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:00:32 2022] GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543 => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:00:33.555437 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e8af7240-3ba3-420f-acad-0324d9765265 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:00:33.556113 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e8af7240-3ba3-420f-acad-0324d9765265 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:00:33.563048 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e8af7240-3ba3-420f-acad-0324d9765265 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:33.563539 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e8af7240-3ba3-420f-acad-0324d9765265 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:33.564019 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e8af7240-3ba3-420f-acad-0324d9765265 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:33.564724 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e8af7240-3ba3-420f-acad-0324d9765265 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:33.565183 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e8af7240-3ba3-420f-acad-0324d9765265 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:33.565617 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e8af7240-3ba3-420f-acad-0324d9765265 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:33.695581 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e8af7240-3ba3-420f-acad-0324d9765265 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:00:33.703669 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e8af7240-3ba3-420f-acad-0324d9765265 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543" status: 200 len: 1690 microversion: 2.1 time: 0.152209 Aug 07 02:00:33.704270 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2988/6441] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:00:33 2022] GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543 => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:00:34.725477 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dc5668bf-830e-4d17-9ae5-38a70a04ab30 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:00:34.726114 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-dc5668bf-830e-4d17-9ae5-38a70a04ab30 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:00:34.733786 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc5668bf-830e-4d17-9ae5-38a70a04ab30 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:34.734286 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc5668bf-830e-4d17-9ae5-38a70a04ab30 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:34.734743 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc5668bf-830e-4d17-9ae5-38a70a04ab30 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:34.735459 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc5668bf-830e-4d17-9ae5-38a70a04ab30 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:34.736226 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc5668bf-830e-4d17-9ae5-38a70a04ab30 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:34.736676 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc5668bf-830e-4d17-9ae5-38a70a04ab30 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:34.867424 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-dc5668bf-830e-4d17-9ae5-38a70a04ab30 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:00:34.874977 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-dc5668bf-830e-4d17-9ae5-38a70a04ab30 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543" status: 200 len: 1690 microversion: 2.1 time: 0.153447 Aug 07 02:00:34.875565 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3454/6442] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:00:34 2022] GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543 => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:00:35.896047 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-91494e7b-2a40-4f4a-a1d0-818feb1a0f8b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:00:35.896680 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-91494e7b-2a40-4f4a-a1d0-818feb1a0f8b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:00:35.904224 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-91494e7b-2a40-4f4a-a1d0-818feb1a0f8b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:35.904717 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-91494e7b-2a40-4f4a-a1d0-818feb1a0f8b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:35.905158 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-91494e7b-2a40-4f4a-a1d0-818feb1a0f8b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:35.906171 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-91494e7b-2a40-4f4a-a1d0-818feb1a0f8b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:35.906633 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-91494e7b-2a40-4f4a-a1d0-818feb1a0f8b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:35.907063 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-91494e7b-2a40-4f4a-a1d0-818feb1a0f8b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:36.039795 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-91494e7b-2a40-4f4a-a1d0-818feb1a0f8b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:00:36.047337 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-91494e7b-2a40-4f4a-a1d0-818feb1a0f8b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543" status: 200 len: 1690 microversion: 2.1 time: 0.155252 Aug 07 02:00:36.048154 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2989/6443] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:00:35 2022] GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:00:37.068346 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5129862b-7b80-4bd2-95b0-1671544c8025 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:00:37.068983 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5129862b-7b80-4bd2-95b0-1671544c8025 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:00:37.075647 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5129862b-7b80-4bd2-95b0-1671544c8025 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:37.076170 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5129862b-7b80-4bd2-95b0-1671544c8025 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:37.076631 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5129862b-7b80-4bd2-95b0-1671544c8025 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:37.077348 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5129862b-7b80-4bd2-95b0-1671544c8025 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:37.077821 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5129862b-7b80-4bd2-95b0-1671544c8025 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:37.078269 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5129862b-7b80-4bd2-95b0-1671544c8025 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:37.210932 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5129862b-7b80-4bd2-95b0-1671544c8025 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:00:37.218944 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5129862b-7b80-4bd2-95b0-1671544c8025 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543" status: 200 len: 1690 microversion: 2.1 time: 0.154498 Aug 07 02:00:37.219540 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3455/6444] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:00:37 2022] GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:00:38.241133 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-138c9127-10a9-4f7c-8973-619020b37ac5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:00:38.241684 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-138c9127-10a9-4f7c-8973-619020b37ac5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:00:38.249115 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-138c9127-10a9-4f7c-8973-619020b37ac5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:38.249594 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-138c9127-10a9-4f7c-8973-619020b37ac5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:38.250031 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-138c9127-10a9-4f7c-8973-619020b37ac5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:38.250729 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-138c9127-10a9-4f7c-8973-619020b37ac5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:38.251179 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-138c9127-10a9-4f7c-8973-619020b37ac5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:38.251604 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-138c9127-10a9-4f7c-8973-619020b37ac5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:38.381992 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-138c9127-10a9-4f7c-8973-619020b37ac5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:00:38.390382 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-138c9127-10a9-4f7c-8973-619020b37ac5 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543" status: 200 len: 1690 microversion: 2.1 time: 0.153233 Aug 07 02:00:38.390953 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2990/6445] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:00:38 2022] GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543 => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:00:39.412319 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2a1db84a-b253-4775-8f4d-df18d3d5e74e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:00:39.412952 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2a1db84a-b253-4775-8f4d-df18d3d5e74e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:00:39.419987 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a1db84a-b253-4775-8f4d-df18d3d5e74e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:39.420486 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a1db84a-b253-4775-8f4d-df18d3d5e74e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:39.420940 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a1db84a-b253-4775-8f4d-df18d3d5e74e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:39.421655 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a1db84a-b253-4775-8f4d-df18d3d5e74e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:39.422128 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a1db84a-b253-4775-8f4d-df18d3d5e74e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:39.422574 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a1db84a-b253-4775-8f4d-df18d3d5e74e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:39.559400 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2a1db84a-b253-4775-8f4d-df18d3d5e74e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:00:39.567070 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2a1db84a-b253-4775-8f4d-df18d3d5e74e tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543" status: 200 len: 1690 microversion: 2.1 time: 0.158775 Aug 07 02:00:39.567645 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3456/6446] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:00:39 2022] GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:00:40.588728 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f22bde59-0e12-46fd-98c6-ca331b51671b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:00:40.589354 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f22bde59-0e12-46fd-98c6-ca331b51671b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:00:40.596211 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f22bde59-0e12-46fd-98c6-ca331b51671b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:40.596698 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f22bde59-0e12-46fd-98c6-ca331b51671b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:40.597140 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f22bde59-0e12-46fd-98c6-ca331b51671b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:40.597843 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f22bde59-0e12-46fd-98c6-ca331b51671b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:40.598304 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f22bde59-0e12-46fd-98c6-ca331b51671b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:40.598734 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f22bde59-0e12-46fd-98c6-ca331b51671b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:40.733263 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f22bde59-0e12-46fd-98c6-ca331b51671b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:00:40.741210 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f22bde59-0e12-46fd-98c6-ca331b51671b tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543" status: 200 len: 1696 microversion: 2.1 time: 0.157001 Aug 07 02:00:40.741787 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2991/6447] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:00:40 2022] GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543 => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:00:41.763583 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-48cc1cf3-bd2f-452a-aff0-f09e77e3ba17 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:00:41.764185 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-48cc1cf3-bd2f-452a-aff0-f09e77e3ba17 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:00:41.771237 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48cc1cf3-bd2f-452a-aff0-f09e77e3ba17 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:41.771734 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48cc1cf3-bd2f-452a-aff0-f09e77e3ba17 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:41.772219 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48cc1cf3-bd2f-452a-aff0-f09e77e3ba17 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:41.772943 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48cc1cf3-bd2f-452a-aff0-f09e77e3ba17 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:41.773418 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48cc1cf3-bd2f-452a-aff0-f09e77e3ba17 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:41.774367 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48cc1cf3-bd2f-452a-aff0-f09e77e3ba17 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:41.905797 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-48cc1cf3-bd2f-452a-aff0-f09e77e3ba17 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:00:41.916383 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-48cc1cf3-bd2f-452a-aff0-f09e77e3ba17 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543" status: 200 len: 1696 microversion: 2.1 time: 0.156718 Aug 07 02:00:41.917252 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3457/6448] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:00:41 2022] GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543 => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:00:42.938401 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-880deacc-1786-4074-8e63-0fa3f90b19f4 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:00:42.939048 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-880deacc-1786-4074-8e63-0fa3f90b19f4 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:00:42.945849 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-880deacc-1786-4074-8e63-0fa3f90b19f4 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:42.946333 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-880deacc-1786-4074-8e63-0fa3f90b19f4 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:42.946770 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-880deacc-1786-4074-8e63-0fa3f90b19f4 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:42.947494 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-880deacc-1786-4074-8e63-0fa3f90b19f4 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:42.947974 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-880deacc-1786-4074-8e63-0fa3f90b19f4 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:42.948401 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-880deacc-1786-4074-8e63-0fa3f90b19f4 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:43.085908 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-880deacc-1786-4074-8e63-0fa3f90b19f4 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:00:43.094020 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-880deacc-1786-4074-8e63-0fa3f90b19f4 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543" status: 200 len: 1681 microversion: 2.1 time: 0.159571 Aug 07 02:00:43.094588 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2992/6449] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:00:42 2022] GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:00:44.118563 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-907f495c-3f60-4569-ade3-8964d9cdd819 req-ba3eb2c0-d9fd-4a2b-bc13-58a9aec54f5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82dc88f9-e52e-4fc5-a7b8-4a9f95408543", "name": "network-vif-unplugged", "status": "completed", "tag": "192657c1-f151-4c98-bb41-ffc463b7336c"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:00:44.129514 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-907f495c-3f60-4569-ade3-8964d9cdd819 req-ba3eb2c0-d9fd-4a2b-bc13-58a9aec54f5e service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:44.130012 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-907f495c-3f60-4569-ade3-8964d9cdd819 req-ba3eb2c0-d9fd-4a2b-bc13-58a9aec54f5e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:44.130590 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-907f495c-3f60-4569-ade3-8964d9cdd819 req-ba3eb2c0-d9fd-4a2b-bc13-58a9aec54f5e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:44.142819 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-907f495c-3f60-4569-ade3-8964d9cdd819 req-ba3eb2c0-d9fd-4a2b-bc13-58a9aec54f5e service nova] Creating event network-vif-unplugged:192657c1-f151-4c98-bb41-ffc463b7336c for instance 82dc88f9-e52e-4fc5-a7b8-4a9f95408543 on n-h2-master-1 Aug 07 02:00:44.148931 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-907f495c-3f60-4569-ade3-8964d9cdd819 req-ba3eb2c0-d9fd-4a2b-bc13-58a9aec54f5e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035038 Aug 07 02:00:44.149847 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3458/6450] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:00:46.164845 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-88316337-f826-47b9-a468-fb306b5f4a95 req-83b60750-916a-4a28-95e3-1d5e33115333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82dc88f9-e52e-4fc5-a7b8-4a9f95408543", "name": "network-vif-plugged", "status": "completed", "tag": "192657c1-f151-4c98-bb41-ffc463b7336c"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:00:46.178481 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-88316337-f826-47b9-a468-fb306b5f4a95 req-83b60750-916a-4a28-95e3-1d5e33115333 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:46.179290 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-88316337-f826-47b9-a468-fb306b5f4a95 req-83b60750-916a-4a28-95e3-1d5e33115333 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:46.179716 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-88316337-f826-47b9-a468-fb306b5f4a95 req-83b60750-916a-4a28-95e3-1d5e33115333 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:46.197886 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-88316337-f826-47b9-a468-fb306b5f4a95 req-83b60750-916a-4a28-95e3-1d5e33115333 service nova] Creating event network-vif-plugged:192657c1-f151-4c98-bb41-ffc463b7336c for instance 82dc88f9-e52e-4fc5-a7b8-4a9f95408543 on n-h2-master-1 Aug 07 02:00:46.204058 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-88316337-f826-47b9-a468-fb306b5f4a95 req-83b60750-916a-4a28-95e3-1d5e33115333 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044129 Aug 07 02:00:46.204689 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2993/6451] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:00:49.979966 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-748aef83-4345-4906-bb2e-626202e9d40b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-29933408", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-55640696", "security_groups": [{"name": "tempest-secgroup-smoke-2046667871"}], "block_device_mapping_v2": [{"uuid": "ee1d9b8b-8916-413c-808d-91f95e9e2103", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "620c0b3f-63f9-404f-acf4-ca02927e0de7"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:00:50.095848 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-748aef83-4345-4906-bb2e-626202e9d40b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] validate_networks() for [('620c0b3f-63f9-404f-acf4-ca02927e0de7', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 02:00:50.464624 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-748aef83-4345-4906-bb2e-626202e9d40b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 02:00:50.465072 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-748aef83-4345-4906-bb2e-626202e9d40b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 02:00:50.465567 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-748aef83-4345-4906-bb2e-626202e9d40b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 02:00:50.465999 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-748aef83-4345-4906-bb2e-626202e9d40b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 02:00:50.466431 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-748aef83-4345-4906-bb2e-626202e9d40b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 02:00:50.475318 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-748aef83-4345-4906-bb2e-626202e9d40b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:50.475819 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-748aef83-4345-4906-bb2e-626202e9d40b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:50.476308 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-748aef83-4345-4906-bb2e-626202e9d40b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:50.477064 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-748aef83-4345-4906-bb2e-626202e9d40b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:50.477538 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-748aef83-4345-4906-bb2e-626202e9d40b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:50.477984 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-748aef83-4345-4906-bb2e-626202e9d40b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:50.495505 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-748aef83-4345-4906-bb2e-626202e9d40b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Getting quotas for project bf36f5153ba648008cdaceb9dc538e53. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:00:50.500827 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-748aef83-4345-4906-bb2e-626202e9d40b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Getting quotas for user 661f6c9aa7da4e348a9b0d91840078c2 and project bf36f5153ba648008cdaceb9dc538e53. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:00:50.557896 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-748aef83-4345-4906-bb2e-626202e9d40b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 02:00:50.560170 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-748aef83-4345-4906-bb2e-626202e9d40b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: d5fdc57f-9c35-40d6-baaf-055965d2d84a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ee1d9b8b-8916-413c-808d-91f95e9e2103',volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 02:00:50.685625 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-748aef83-4345-4906-bb2e-626202e9d40b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.711711 Aug 07 02:00:50.686279 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3459/6452] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 02:00:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 02:00:50.699072 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-de53a844-43cf-46d2-8b50-f40c1c273ab4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:00:50.699900 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-de53a844-43cf-46d2-8b50-f40c1c273ab4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: d5fdc57f-9c35-40d6-baaf-055965d2d84a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:00:50.755617 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-de53a844-43cf-46d2-8b50-f40c1c273ab4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:00:50.763103 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-de53a844-43cf-46d2-8b50-f40c1c273ab4 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a" status: 200 len: 1091 microversion: 2.1 time: 0.069707 Aug 07 02:00:50.763719 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2994/6453] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:00:50 2022] GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a => generated 1091 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:00:51.785935 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5f8ec4fa-e1ed-4e21-a4b9-e78a8872f5a6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:00:51.786575 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5f8ec4fa-e1ed-4e21-a4b9-e78a8872f5a6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: d5fdc57f-9c35-40d6-baaf-055965d2d84a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:00:51.793001 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f8ec4fa-e1ed-4e21-a4b9-e78a8872f5a6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:51.793500 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f8ec4fa-e1ed-4e21-a4b9-e78a8872f5a6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:51.793949 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f8ec4fa-e1ed-4e21-a4b9-e78a8872f5a6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:51.794661 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f8ec4fa-e1ed-4e21-a4b9-e78a8872f5a6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:51.795128 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f8ec4fa-e1ed-4e21-a4b9-e78a8872f5a6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:51.795565 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f8ec4fa-e1ed-4e21-a4b9-e78a8872f5a6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:51.872058 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5f8ec4fa-e1ed-4e21-a4b9-e78a8872f5a6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:00:51.879510 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5f8ec4fa-e1ed-4e21-a4b9-e78a8872f5a6 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a" status: 200 len: 1207 microversion: 2.1 time: 0.099723 Aug 07 02:00:51.880118 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3460/6454] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:00:51 2022] GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a => generated 1207 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:00:52.901699 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6aca9f48-90c4-4da5-a69d-5e8dc71e3def tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:00:52.903000 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6aca9f48-90c4-4da5-a69d-5e8dc71e3def tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: d5fdc57f-9c35-40d6-baaf-055965d2d84a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:00:52.906424 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=31 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:00:52.912358 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6aca9f48-90c4-4da5-a69d-5e8dc71e3def tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:52.912850 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6aca9f48-90c4-4da5-a69d-5e8dc71e3def tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:52.913281 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6aca9f48-90c4-4da5-a69d-5e8dc71e3def tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:52.914826 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6aca9f48-90c4-4da5-a69d-5e8dc71e3def tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:52.915283 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6aca9f48-90c4-4da5-a69d-5e8dc71e3def tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:52.915710 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6aca9f48-90c4-4da5-a69d-5e8dc71e3def tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:52.918945 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:00:53.066610 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6aca9f48-90c4-4da5-a69d-5e8dc71e3def tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:00:53.075037 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6aca9f48-90c4-4da5-a69d-5e8dc71e3def tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a" status: 200 len: 1275 microversion: 2.1 time: 0.177808 Aug 07 02:00:53.075918 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2995/6455] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:00:52 2022] GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a => generated 1275 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:00:53.122061 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-dcb65b95-a360-41de-84c7-ec2ded230871 req-5e2251a6-9929-4747-9cd4-f88470d024f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5fdc57f-9c35-40d6-baaf-055965d2d84a", "tag": "5ffd96b6-226c-42f2-875c-d739098669af"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:00:53.132971 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:00:53.139382 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-dcb65b95-a360-41de-84c7-ec2ded230871 req-5e2251a6-9929-4747-9cd4-f88470d024f8 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:53.139875 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-dcb65b95-a360-41de-84c7-ec2ded230871 req-5e2251a6-9929-4747-9cd4-f88470d024f8 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:53.140340 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-dcb65b95-a360-41de-84c7-ec2ded230871 req-5e2251a6-9929-4747-9cd4-f88470d024f8 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:53.149003 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=65 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:00:53.158056 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-dcb65b95-a360-41de-84c7-ec2ded230871 req-5e2251a6-9929-4747-9cd4-f88470d024f8 service nova] Creating event network-changed:5ffd96b6-226c-42f2-875c-d739098669af for instance d5fdc57f-9c35-40d6-baaf-055965d2d84a on n-h1-master-1 Aug 07 02:00:53.164212 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-dcb65b95-a360-41de-84c7-ec2ded230871 req-5e2251a6-9929-4747-9cd4-f88470d024f8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052091 Aug 07 02:00:53.165049 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3461/6456] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:00:54.095864 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8be5e91b-f183-4340-9b62-3ca24a994034 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:00:54.096673 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8be5e91b-f183-4340-9b62-3ca24a994034 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: d5fdc57f-9c35-40d6-baaf-055965d2d84a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:00:54.104274 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8be5e91b-f183-4340-9b62-3ca24a994034 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:54.104893 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8be5e91b-f183-4340-9b62-3ca24a994034 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:54.105464 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8be5e91b-f183-4340-9b62-3ca24a994034 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:54.106342 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8be5e91b-f183-4340-9b62-3ca24a994034 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:54.107132 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8be5e91b-f183-4340-9b62-3ca24a994034 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:54.107726 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8be5e91b-f183-4340-9b62-3ca24a994034 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:54.257430 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8be5e91b-f183-4340-9b62-3ca24a994034 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:00:54.266175 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8be5e91b-f183-4340-9b62-3ca24a994034 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a" status: 200 len: 1275 microversion: 2.1 time: 0.174195 Aug 07 02:00:54.268085 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2996/6457] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:00:54 2022] GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a => generated 1275 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:00:55.289515 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3b31d36b-3b21-4776-a68f-4d9d4ce366ad tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:00:55.290230 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3b31d36b-3b21-4776-a68f-4d9d4ce366ad tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: d5fdc57f-9c35-40d6-baaf-055965d2d84a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:00:55.296933 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b31d36b-3b21-4776-a68f-4d9d4ce366ad tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:55.297440 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b31d36b-3b21-4776-a68f-4d9d4ce366ad tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:55.297887 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b31d36b-3b21-4776-a68f-4d9d4ce366ad tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:55.298617 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b31d36b-3b21-4776-a68f-4d9d4ce366ad tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:55.299110 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b31d36b-3b21-4776-a68f-4d9d4ce366ad tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:55.299520 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b31d36b-3b21-4776-a68f-4d9d4ce366ad tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:55.462715 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3b31d36b-3b21-4776-a68f-4d9d4ce366ad tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:00:55.470411 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3b31d36b-3b21-4776-a68f-4d9d4ce366ad tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a" status: 200 len: 1275 microversion: 2.1 time: 0.186905 Aug 07 02:00:55.471380 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3462/6458] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:00:55 2022] GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a => generated 1275 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:00:56.494812 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fd15afbe-a162-44eb-a962-d0e789b0e51d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:00:56.495760 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fd15afbe-a162-44eb-a962-d0e789b0e51d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: d5fdc57f-9c35-40d6-baaf-055965d2d84a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:00:56.505258 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd15afbe-a162-44eb-a962-d0e789b0e51d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:56.505857 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd15afbe-a162-44eb-a962-d0e789b0e51d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:56.506368 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd15afbe-a162-44eb-a962-d0e789b0e51d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:56.507094 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd15afbe-a162-44eb-a962-d0e789b0e51d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:56.507561 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd15afbe-a162-44eb-a962-d0e789b0e51d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:56.508200 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd15afbe-a162-44eb-a962-d0e789b0e51d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:56.660444 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fd15afbe-a162-44eb-a962-d0e789b0e51d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:00:56.669814 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fd15afbe-a162-44eb-a962-d0e789b0e51d tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a" status: 200 len: 1275 microversion: 2.1 time: 0.180218 Aug 07 02:00:56.670665 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2997/6459] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:00:56 2022] GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a => generated 1275 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:00:57.691947 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3260cfe1-17d8-4ae8-93c8-d26ec741d770 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:00:57.692656 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3260cfe1-17d8-4ae8-93c8-d26ec741d770 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: d5fdc57f-9c35-40d6-baaf-055965d2d84a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:00:57.700382 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3260cfe1-17d8-4ae8-93c8-d26ec741d770 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:57.700948 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3260cfe1-17d8-4ae8-93c8-d26ec741d770 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:57.701446 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3260cfe1-17d8-4ae8-93c8-d26ec741d770 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:57.702242 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3260cfe1-17d8-4ae8-93c8-d26ec741d770 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:57.702746 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3260cfe1-17d8-4ae8-93c8-d26ec741d770 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:57.703269 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3260cfe1-17d8-4ae8-93c8-d26ec741d770 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:57.832786 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3260cfe1-17d8-4ae8-93c8-d26ec741d770 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:00:57.841043 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3260cfe1-17d8-4ae8-93c8-d26ec741d770 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a" status: 200 len: 1263 microversion: 2.1 time: 0.153169 Aug 07 02:00:57.841619 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3463/6460] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:00:57 2022] GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:00:58.861956 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-07519fae-43bf-40e6-8315-cd028a894f80 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:00:58.862571 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-07519fae-43bf-40e6-8315-cd028a894f80 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: d5fdc57f-9c35-40d6-baaf-055965d2d84a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:00:58.869933 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-07519fae-43bf-40e6-8315-cd028a894f80 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:58.870417 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-07519fae-43bf-40e6-8315-cd028a894f80 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:58.870858 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-07519fae-43bf-40e6-8315-cd028a894f80 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:58.871557 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-07519fae-43bf-40e6-8315-cd028a894f80 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:00:58.872046 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-07519fae-43bf-40e6-8315-cd028a894f80 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:00:58.872478 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-07519fae-43bf-40e6-8315-cd028a894f80 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:00:59.009872 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-07519fae-43bf-40e6-8315-cd028a894f80 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:00:59.017428 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-07519fae-43bf-40e6-8315-cd028a894f80 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a" status: 200 len: 1263 microversion: 2.1 time: 0.159648 Aug 07 02:00:59.018004 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2998/6461] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:00:58 2022] GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:01:00.037245 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-17cc9cf1-c8e5-4e70-9ea1-569907e0de2f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:01:00.037904 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-17cc9cf1-c8e5-4e70-9ea1-569907e0de2f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: d5fdc57f-9c35-40d6-baaf-055965d2d84a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:01:00.045324 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-17cc9cf1-c8e5-4e70-9ea1-569907e0de2f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:01:00.045826 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-17cc9cf1-c8e5-4e70-9ea1-569907e0de2f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:01:00.046282 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-17cc9cf1-c8e5-4e70-9ea1-569907e0de2f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:01:00.046997 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-17cc9cf1-c8e5-4e70-9ea1-569907e0de2f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:01:00.047469 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-17cc9cf1-c8e5-4e70-9ea1-569907e0de2f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:01:00.047937 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-17cc9cf1-c8e5-4e70-9ea1-569907e0de2f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:01:00.181317 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-17cc9cf1-c8e5-4e70-9ea1-569907e0de2f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:01:00.188991 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-17cc9cf1-c8e5-4e70-9ea1-569907e0de2f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a" status: 200 len: 1263 microversion: 2.1 time: 0.155728 Aug 07 02:01:00.189565 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3464/6462] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:01:00 2022] GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:01:01.209545 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-208256b6-efff-4a57-a7ba-04d0f2845a71 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:01:01.210648 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-208256b6-efff-4a57-a7ba-04d0f2845a71 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: d5fdc57f-9c35-40d6-baaf-055965d2d84a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:01:01.213363 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:01:01.219964 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-208256b6-efff-4a57-a7ba-04d0f2845a71 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:01:01.220457 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-208256b6-efff-4a57-a7ba-04d0f2845a71 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:01:01.220892 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-208256b6-efff-4a57-a7ba-04d0f2845a71 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:01:01.221593 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-208256b6-efff-4a57-a7ba-04d0f2845a71 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:01:01.222045 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-208256b6-efff-4a57-a7ba-04d0f2845a71 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:01:01.222474 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-208256b6-efff-4a57-a7ba-04d0f2845a71 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:01:01.362179 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-208256b6-efff-4a57-a7ba-04d0f2845a71 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:01:01.370078 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-208256b6-efff-4a57-a7ba-04d0f2845a71 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a" status: 200 len: 1263 microversion: 2.1 time: 0.164436 Aug 07 02:01:01.370659 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 2999/6463] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:01:01 2022] GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a => generated 1263 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:01:02.391419 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:01:02.392223 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:01:02.518039 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-116007a5-809b-410e-88ea-7b704f7894e7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:01:02.518677 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-116007a5-809b-410e-88ea-7b704f7894e7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: d5fdc57f-9c35-40d6-baaf-055965d2d84a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:01:02.525288 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-116007a5-809b-410e-88ea-7b704f7894e7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:01:02.525795 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-116007a5-809b-410e-88ea-7b704f7894e7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:01:02.526256 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-116007a5-809b-410e-88ea-7b704f7894e7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:01:02.526971 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-116007a5-809b-410e-88ea-7b704f7894e7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:01:02.527445 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-116007a5-809b-410e-88ea-7b704f7894e7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:01:02.527914 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-116007a5-809b-410e-88ea-7b704f7894e7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:01:02.659596 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-116007a5-809b-410e-88ea-7b704f7894e7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:01:02.667812 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-116007a5-809b-410e-88ea-7b704f7894e7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a" status: 200 len: 1263 microversion: 2.1 time: 0.280986 Aug 07 02:01:02.668426 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3465/6464] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:01:02 2022] GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a => generated 1263 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:01:03.688764 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e5c64579-ae72-4dda-ae7a-5dec24c52aa8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:01:03.689394 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e5c64579-ae72-4dda-ae7a-5dec24c52aa8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: d5fdc57f-9c35-40d6-baaf-055965d2d84a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:01:03.696252 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e5c64579-ae72-4dda-ae7a-5dec24c52aa8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:01:03.696743 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e5c64579-ae72-4dda-ae7a-5dec24c52aa8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:01:03.697190 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e5c64579-ae72-4dda-ae7a-5dec24c52aa8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:01:03.697897 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e5c64579-ae72-4dda-ae7a-5dec24c52aa8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:01:03.698356 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e5c64579-ae72-4dda-ae7a-5dec24c52aa8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:01:03.698791 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e5c64579-ae72-4dda-ae7a-5dec24c52aa8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:01:03.836544 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e5c64579-ae72-4dda-ae7a-5dec24c52aa8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:01:03.845248 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e5c64579-ae72-4dda-ae7a-5dec24c52aa8 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a" status: 200 len: 1263 microversion: 2.1 time: 0.160540 Aug 07 02:01:03.845928 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3000/6465] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:01:03 2022] GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a => generated 1263 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:01:04.866826 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9e1b2efa-c5a2-4f53-a5d4-06dcd2fe354e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:01:04.867489 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9e1b2efa-c5a2-4f53-a5d4-06dcd2fe354e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: d5fdc57f-9c35-40d6-baaf-055965d2d84a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:01:04.874290 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e1b2efa-c5a2-4f53-a5d4-06dcd2fe354e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:01:04.874781 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e1b2efa-c5a2-4f53-a5d4-06dcd2fe354e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:01:04.875225 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e1b2efa-c5a2-4f53-a5d4-06dcd2fe354e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:01:04.875961 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e1b2efa-c5a2-4f53-a5d4-06dcd2fe354e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:01:04.876429 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e1b2efa-c5a2-4f53-a5d4-06dcd2fe354e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:01:04.876865 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e1b2efa-c5a2-4f53-a5d4-06dcd2fe354e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:01:05.009006 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9e1b2efa-c5a2-4f53-a5d4-06dcd2fe354e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:01:05.016667 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9e1b2efa-c5a2-4f53-a5d4-06dcd2fe354e tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a" status: 200 len: 1263 microversion: 2.1 time: 0.153765 Aug 07 02:01:05.017244 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3466/6466] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:01:04 2022] GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:01:06.038018 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5140ecac-c4d3-4de8-ab9e-90f604056b41 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:01:06.038649 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5140ecac-c4d3-4de8-ab9e-90f604056b41 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: d5fdc57f-9c35-40d6-baaf-055965d2d84a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:01:06.045350 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5140ecac-c4d3-4de8-ab9e-90f604056b41 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:01:06.045844 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5140ecac-c4d3-4de8-ab9e-90f604056b41 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:01:06.046282 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5140ecac-c4d3-4de8-ab9e-90f604056b41 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:01:06.046978 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5140ecac-c4d3-4de8-ab9e-90f604056b41 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:01:06.047436 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5140ecac-c4d3-4de8-ab9e-90f604056b41 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:01:06.047866 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5140ecac-c4d3-4de8-ab9e-90f604056b41 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:01:06.179279 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5140ecac-c4d3-4de8-ab9e-90f604056b41 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:01:06.186748 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5140ecac-c4d3-4de8-ab9e-90f604056b41 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a" status: 200 len: 1263 microversion: 2.1 time: 0.152948 Aug 07 02:01:06.187316 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3001/6467] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:01:06 2022] GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:01:06.824707 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-b54f3356-c48d-483c-8257-83a7d5ed7340 req-33adcec8-4d87-4569-a5ae-e5516c6c653b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5fdc57f-9c35-40d6-baaf-055965d2d84a", "name": "network-vif-plugged", "status": "completed", "tag": "5ffd96b6-226c-42f2-875c-d739098669af"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:01:06.835161 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b54f3356-c48d-483c-8257-83a7d5ed7340 req-33adcec8-4d87-4569-a5ae-e5516c6c653b service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:01:06.835659 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b54f3356-c48d-483c-8257-83a7d5ed7340 req-33adcec8-4d87-4569-a5ae-e5516c6c653b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:01:06.836136 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b54f3356-c48d-483c-8257-83a7d5ed7340 req-33adcec8-4d87-4569-a5ae-e5516c6c653b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:01:06.847438 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-b54f3356-c48d-483c-8257-83a7d5ed7340 req-33adcec8-4d87-4569-a5ae-e5516c6c653b service nova] Creating event network-vif-plugged:5ffd96b6-226c-42f2-875c-d739098669af for instance d5fdc57f-9c35-40d6-baaf-055965d2d84a on n-h1-master-1 Aug 07 02:01:06.852857 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-b54f3356-c48d-483c-8257-83a7d5ed7340 req-33adcec8-4d87-4569-a5ae-e5516c6c653b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032043 Aug 07 02:01:06.853449 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3467/6468] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:01:07.206691 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3fba103c-6b34-4f43-9258-54d0b3bd3143 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:01:07.207302 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3fba103c-6b34-4f43-9258-54d0b3bd3143 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: d5fdc57f-9c35-40d6-baaf-055965d2d84a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:01:07.214725 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3fba103c-6b34-4f43-9258-54d0b3bd3143 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:01:07.215214 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3fba103c-6b34-4f43-9258-54d0b3bd3143 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:01:07.215651 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3fba103c-6b34-4f43-9258-54d0b3bd3143 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:01:07.216361 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3fba103c-6b34-4f43-9258-54d0b3bd3143 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:01:07.216816 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3fba103c-6b34-4f43-9258-54d0b3bd3143 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:01:07.217237 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3fba103c-6b34-4f43-9258-54d0b3bd3143 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:01:07.304875 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f65c07c7-37a3-4ff5-a19e-59ee61bc8051 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:01:07.307387 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f65c07c7-37a3-4ff5-a19e-59ee61bc8051 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:01:07.313975 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f65c07c7-37a3-4ff5-a19e-59ee61bc8051 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:01:07.314489 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f65c07c7-37a3-4ff5-a19e-59ee61bc8051 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:01:07.314949 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f65c07c7-37a3-4ff5-a19e-59ee61bc8051 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:01:07.316986 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f65c07c7-37a3-4ff5-a19e-59ee61bc8051 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:01:07.316986 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f65c07c7-37a3-4ff5-a19e-59ee61bc8051 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:01:07.316986 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f65c07c7-37a3-4ff5-a19e-59ee61bc8051 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:01:07.353600 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3fba103c-6b34-4f43-9258-54d0b3bd3143 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:01:07.361902 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3fba103c-6b34-4f43-9258-54d0b3bd3143 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a" status: 200 len: 1263 microversion: 2.1 time: 0.159219 Aug 07 02:01:07.362478 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3002/6469] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:01:07 2022] GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a => generated 1263 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:01:07.397164 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f65c07c7-37a3-4ff5-a19e-59ee61bc8051 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "POST /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543/action" status: 200 len: 24566 microversion: 2.1 time: 0.096325 Aug 07 02:01:07.398438 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3468/6470] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:01:07 2022] POST /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543/action => generated 24566 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 02:01:08.382813 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ac7c0b60-8d30-44ac-98f5-6255f1cd6d16 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:01:08.383519 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ac7c0b60-8d30-44ac-98f5-6255f1cd6d16 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: d5fdc57f-9c35-40d6-baaf-055965d2d84a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:01:08.390483 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ac7c0b60-8d30-44ac-98f5-6255f1cd6d16 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:01:08.390966 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ac7c0b60-8d30-44ac-98f5-6255f1cd6d16 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:01:08.391400 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ac7c0b60-8d30-44ac-98f5-6255f1cd6d16 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:01:08.392132 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ac7c0b60-8d30-44ac-98f5-6255f1cd6d16 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:01:08.392587 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ac7c0b60-8d30-44ac-98f5-6255f1cd6d16 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:01:08.393036 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ac7c0b60-8d30-44ac-98f5-6255f1cd6d16 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:01:08.530747 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ac7c0b60-8d30-44ac-98f5-6255f1cd6d16 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:01:08.538224 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ac7c0b60-8d30-44ac-98f5-6255f1cd6d16 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a" status: 200 len: 1450 microversion: 2.1 time: 0.159837 Aug 07 02:01:08.538792 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3003/6471] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:01:08 2022] GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a => generated 1450 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:01:08.558765 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bd660ba8-2c89-41df-a464-a170565435f1 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:01:08.559490 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bd660ba8-2c89-41df-a464-a170565435f1 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: d5fdc57f-9c35-40d6-baaf-055965d2d84a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:01:08.566910 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd660ba8-2c89-41df-a464-a170565435f1 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:01:08.567409 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd660ba8-2c89-41df-a464-a170565435f1 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:01:08.567860 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd660ba8-2c89-41df-a464-a170565435f1 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:01:08.568600 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd660ba8-2c89-41df-a464-a170565435f1 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:01:08.569071 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd660ba8-2c89-41df-a464-a170565435f1 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:01:08.570099 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd660ba8-2c89-41df-a464-a170565435f1 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:01:08.699572 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bd660ba8-2c89-41df-a464-a170565435f1 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:01:08.707890 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bd660ba8-2c89-41df-a464-a170565435f1 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a" status: 200 len: 1450 microversion: 2.1 time: 0.153372 Aug 07 02:01:08.708471 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3469/6472] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:01:08 2022] GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:01:10.269380 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-57237eac-6cd3-4079-ac5f-e9655f0c6b24 req-f681d8ad-729b-45b6-84ee-8b6b39f0b0d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5fdc57f-9c35-40d6-baaf-055965d2d84a", "tag": "5ffd96b6-226c-42f2-875c-d739098669af"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:01:10.279997 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-57237eac-6cd3-4079-ac5f-e9655f0c6b24 req-f681d8ad-729b-45b6-84ee-8b6b39f0b0d0 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:01:10.280489 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-57237eac-6cd3-4079-ac5f-e9655f0c6b24 req-f681d8ad-729b-45b6-84ee-8b6b39f0b0d0 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:01:10.280927 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-57237eac-6cd3-4079-ac5f-e9655f0c6b24 req-f681d8ad-729b-45b6-84ee-8b6b39f0b0d0 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:01:10.293660 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-57237eac-6cd3-4079-ac5f-e9655f0c6b24 req-f681d8ad-729b-45b6-84ee-8b6b39f0b0d0 service nova] Creating event network-changed:5ffd96b6-226c-42f2-875c-d739098669af for instance d5fdc57f-9c35-40d6-baaf-055965d2d84a on n-h1-master-1 Aug 07 02:01:10.299304 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-57237eac-6cd3-4079-ac5f-e9655f0c6b24 req-f681d8ad-729b-45b6-84ee-8b6b39f0b0d0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033488 Aug 07 02:01:10.299971 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3004/6473] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:01:19.337052 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c87aec0d-0d2a-4cb7-93ce-7aeeed547e03 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:01:19.338212 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c87aec0d-0d2a-4cb7-93ce-7aeeed547e03 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:01:19.341350 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-e4aa5df9-1c77-495b-90bb-2f640f480023 req-d030b912-427b-4f8a-b7a7-6451e9724bbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82dc88f9-e52e-4fc5-a7b8-4a9f95408543", "tag": "192657c1-f151-4c98-bb41-ffc463b7336c"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:01:19.343095 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=17 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:01:19.343978 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=43 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:01:19.347999 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c87aec0d-0d2a-4cb7-93ce-7aeeed547e03 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:01:19.348789 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c87aec0d-0d2a-4cb7-93ce-7aeeed547e03 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:01:19.349291 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c87aec0d-0d2a-4cb7-93ce-7aeeed547e03 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:01:19.350068 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c87aec0d-0d2a-4cb7-93ce-7aeeed547e03 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:01:19.350721 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c87aec0d-0d2a-4cb7-93ce-7aeeed547e03 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:01:19.351253 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c87aec0d-0d2a-4cb7-93ce-7aeeed547e03 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:01:19.352712 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-e4aa5df9-1c77-495b-90bb-2f640f480023 req-d030b912-427b-4f8a-b7a7-6451e9724bbc service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:01:19.353881 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-e4aa5df9-1c77-495b-90bb-2f640f480023 req-d030b912-427b-4f8a-b7a7-6451e9724bbc service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:01:19.355014 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-e4aa5df9-1c77-495b-90bb-2f640f480023 req-d030b912-427b-4f8a-b7a7-6451e9724bbc service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:01:19.373501 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-e4aa5df9-1c77-495b-90bb-2f640f480023 req-d030b912-427b-4f8a-b7a7-6451e9724bbc service nova] Creating event network-changed:192657c1-f151-4c98-bb41-ffc463b7336c for instance 82dc88f9-e52e-4fc5-a7b8-4a9f95408543 on n-h2-master-1 Aug 07 02:01:19.378898 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-e4aa5df9-1c77-495b-90bb-2f640f480023 req-d030b912-427b-4f8a-b7a7-6451e9724bbc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043723 Aug 07 02:01:19.379573 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3005/6474] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:01:19.381382 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c87aec0d-0d2a-4cb7-93ce-7aeeed547e03 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 02:01:19.466868 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c87aec0d-0d2a-4cb7-93ce-7aeeed547e03 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "DELETE /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543" status: 204 len: 0 microversion: 2.1 time: 0.133962 Aug 07 02:01:19.467401 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3470/6475] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 02:01:19 2022] DELETE /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 02:01:19.482538 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bbfaa478-ada8-47db-a887-ccebd01177ff tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:01:19.483364 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bbfaa478-ada8-47db-a887-ccebd01177ff tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:01:19.492100 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbfaa478-ada8-47db-a887-ccebd01177ff tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:01:19.492440 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbfaa478-ada8-47db-a887-ccebd01177ff tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:01:19.493246 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbfaa478-ada8-47db-a887-ccebd01177ff tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:01:19.494023 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbfaa478-ada8-47db-a887-ccebd01177ff tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:01:19.494518 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbfaa478-ada8-47db-a887-ccebd01177ff tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:01:19.495019 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbfaa478-ada8-47db-a887-ccebd01177ff tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:01:19.753571 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bbfaa478-ada8-47db-a887-ccebd01177ff tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:01:19.761834 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bbfaa478-ada8-47db-a887-ccebd01177ff tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543" status: 200 len: 1687 microversion: 2.1 time: 0.286408 Aug 07 02:01:19.762593 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3006/6476] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:01:19 2022] GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543 => generated 1687 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:01:20.785086 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b9d7adf7-137e-4ebc-9f2c-3aed3666a3ce tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:01:20.785812 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b9d7adf7-137e-4ebc-9f2c-3aed3666a3ce tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:01:20.793338 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b9d7adf7-137e-4ebc-9f2c-3aed3666a3ce tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:01:20.793850 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b9d7adf7-137e-4ebc-9f2c-3aed3666a3ce tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:01:20.794309 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b9d7adf7-137e-4ebc-9f2c-3aed3666a3ce tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:01:20.795037 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b9d7adf7-137e-4ebc-9f2c-3aed3666a3ce tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:01:20.795515 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b9d7adf7-137e-4ebc-9f2c-3aed3666a3ce tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:01:20.796001 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b9d7adf7-137e-4ebc-9f2c-3aed3666a3ce tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:01:21.099508 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b9d7adf7-137e-4ebc-9f2c-3aed3666a3ce tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830639b9b39a43a7b714b74c26fdf52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d8c916412400ba4b57ea10fceb39e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:01:21.110359 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b9d7adf7-137e-4ebc-9f2c-3aed3666a3ce tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543" status: 200 len: 1687 microversion: 2.1 time: 0.329164 Aug 07 02:01:21.111171 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3471/6477] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:01:20 2022] GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543 => generated 1687 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:01:21.419268 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-e77a7e2e-938e-4cdf-82d1-388efee63a3f req-d313a72d-0d07-4a9f-aa9c-9e95356a3282 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82dc88f9-e52e-4fc5-a7b8-4a9f95408543", "name": "network-vif-deleted", "tag": "192657c1-f151-4c98-bb41-ffc463b7336c"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:01:21.430117 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-e77a7e2e-938e-4cdf-82d1-388efee63a3f req-d313a72d-0d07-4a9f-aa9c-9e95356a3282 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:01:21.430598 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-e77a7e2e-938e-4cdf-82d1-388efee63a3f req-d313a72d-0d07-4a9f-aa9c-9e95356a3282 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:01:21.431022 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-e77a7e2e-938e-4cdf-82d1-388efee63a3f req-d313a72d-0d07-4a9f-aa9c-9e95356a3282 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:01:21.442176 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-e77a7e2e-938e-4cdf-82d1-388efee63a3f req-d313a72d-0d07-4a9f-aa9c-9e95356a3282 service nova] Creating event network-vif-deleted:192657c1-f151-4c98-bb41-ffc463b7336c for instance 82dc88f9-e52e-4fc5-a7b8-4a9f95408543 on n-h2-master-1 Aug 07 02:01:21.447528 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-e77a7e2e-938e-4cdf-82d1-388efee63a3f req-d313a72d-0d07-4a9f-aa9c-9e95356a3282 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032710 Aug 07 02:01:21.448173 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3007/6478] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:01:22.131966 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ced324d6-4df1-4f5a-a683-e048331cec0d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:01:22.132721 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ced324d6-4df1-4f5a-a683-e048331cec0d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] [instance: 82dc88f9-e52e-4fc5-a7b8-4a9f95408543] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:01:22.140250 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ced324d6-4df1-4f5a-a683-e048331cec0d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:01:22.140737 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ced324d6-4df1-4f5a-a683-e048331cec0d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:01:22.141182 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ced324d6-4df1-4f5a-a683-e048331cec0d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:01:22.141885 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ced324d6-4df1-4f5a-a683-e048331cec0d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:01:22.142346 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ced324d6-4df1-4f5a-a683-e048331cec0d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:01:22.142783 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ced324d6-4df1-4f5a-a683-e048331cec0d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:01:22.156157 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-ced324d6-4df1-4f5a-a683-e048331cec0d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] HTTP exception thrown: Instance 82dc88f9-e52e-4fc5-a7b8-4a9f95408543 could not be found. Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ced324d6-4df1-4f5a-a683-e048331cec0d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Request method failure captured: Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543 HTTP/1.1 Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xs7m9NZoR7QYJEs2LdGd8pBDTRyEi0z4J0cBXKascPq3zVViX-oKQvuaXwOhnW2JLOmnZwctSI6Ey4onVMpls1VeWoMFG_HIdnE2zQ7QFGrzRXTZiFvvZQlJ3VmarDoU9LqJmDS_SlWfy2oHktXR4wvHeXSLIROc6sY5luRoQUQZ5A Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: d37d8c916412400ba4b57ea10fceb39e Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1464135667 Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d37d8c916412400ba4b57ea10fceb39e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d37d8c916412400ba4b57ea10fceb39e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d37d8c916412400ba4b57ea10fceb39e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d37d8c916412400ba4b57ea10fceb39e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1464135667 Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: d37d8c916412400ba4b57ea10fceb39e Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1464135667 Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-TestNetworkAdvancedServerOps-1464135667-project Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 830639b9b39a43a7b714b74c26fdf52c Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1464135667-project Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 82dc88f9-e52e-4fc5-a7b8-4a9f95408543 could not be found. Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '82dc88f9-e52e-4fc5-a7b8-4a9f95408543'} Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82dc88f9-e52e-4fc5-a7b8-4a9f95408543 could not be found. Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82dc88f9-e52e-4fc5-a7b8-4a9f95408543 could not be found. Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:01:22.157785 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:01:22.162845 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:01:22.162845 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:01:22.162845 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:01:22.162845 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:01:22.162845 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:01:22.162845 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:01:22.162845 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82dc88f9-e52e-4fc5-a7b8-4a9f95408543 could not be found. Aug 07 02:01:22.162845 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:01:22.162845 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ced324d6-4df1-4f5a-a683-e048331cec0d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Returning 404 to user: Instance 82dc88f9-e52e-4fc5-a7b8-4a9f95408543 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:01:22.162845 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ced324d6-4df1-4f5a-a683-e048331cec0d tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543" status: 404 len: 111 microversion: 2.1 time: 0.031251 Aug 07 02:01:22.162845 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3472/6479] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:01:22 2022] GET /compute/v2.1/servers/82dc88f9-e52e-4fc5-a7b8-4a9f95408543 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:01:25.488899 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-74c482ae-b3a3-4bbf-a3cb-6d2cb172bfb2 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] Calling method '.version_select at 0x7f9e17e653a0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:01:25.506815 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=26 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:01:25.521344 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-74c482ae-b3a3-4bbf-a3cb-6d2cb172bfb2 tempest-TestNetworkAdvancedServerOps-1464135667 tempest-TestNetworkAdvancedServerOps-1464135667-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-252350562" status: 202 len: 0 microversion: 2.1 time: 0.038383 Aug 07 02:01:25.521956 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3008/6480] 10.222.0.39 () {58 vars in 1281 bytes} [Sun Aug 7 02:01:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-252350562 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:02:40.735331 n-d-master-1 devstack@n-api.service[119516]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9bbf4f32-4f7b-4fcf-a326-64eac47dae98] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 07 02:02:40.735984 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:02:40.736704 n-d-master-1 devstack@n-api.service[119517]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dde625b-e185-486e-885e-ba9f9bdf36ce] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 07 02:02:40.737575 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:02:40.742045 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=65 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:02:40.742350 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e6ac0c99-525b-488d-9fca-601731df00d3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:02:40.742998 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=2,nova_api:DELETE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:02:40.743220 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e6ac0c99-525b-488d-9fca-601731df00d3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: d5fdc57f-9c35-40d6-baaf-055965d2d84a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:02:40.754324 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6ac0c99-525b-488d-9fca-601731df00d3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:02:40.755228 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6ac0c99-525b-488d-9fca-601731df00d3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:02:40.755826 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6ac0c99-525b-488d-9fca-601731df00d3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:02:40.756586 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6ac0c99-525b-488d-9fca-601731df00d3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:02:40.757063 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6ac0c99-525b-488d-9fca-601731df00d3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:02:40.757512 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e6ac0c99-525b-488d-9fca-601731df00d3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:02:40.787451 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e6ac0c99-525b-488d-9fca-601731df00d3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: d5fdc57f-9c35-40d6-baaf-055965d2d84a] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 02:02:40.872122 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e6ac0c99-525b-488d-9fca-601731df00d3 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a" status: 204 len: 0 microversion: 2.1 time: 0.138123 Aug 07 02:02:40.873681 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3473/6481] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 02:02:40 2022] DELETE /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 02:02:40.883109 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-11e5598d-b2d7-4a23-8233-8dc4c14727e5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:02:40.884372 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-11e5598d-b2d7-4a23-8233-8dc4c14727e5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: d5fdc57f-9c35-40d6-baaf-055965d2d84a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:02:40.890579 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-11e5598d-b2d7-4a23-8233-8dc4c14727e5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:02:40.891101 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-11e5598d-b2d7-4a23-8233-8dc4c14727e5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:02:40.891564 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-11e5598d-b2d7-4a23-8233-8dc4c14727e5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:02:40.892296 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-11e5598d-b2d7-4a23-8233-8dc4c14727e5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:02:40.892758 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-11e5598d-b2d7-4a23-8233-8dc4c14727e5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:02:40.893375 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-11e5598d-b2d7-4a23-8233-8dc4c14727e5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:02:40.960243 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-a1b5c23b-e9ed-4283-ab53-05a9e4d19367 req-6f93ba05-b774-4b0e-916e-d34621b012f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5fdc57f-9c35-40d6-baaf-055965d2d84a", "tag": "5ffd96b6-226c-42f2-875c-d739098669af"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:02:40.982570 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a1b5c23b-e9ed-4283-ab53-05a9e4d19367 req-6f93ba05-b774-4b0e-916e-d34621b012f9 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:02:40.983322 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a1b5c23b-e9ed-4283-ab53-05a9e4d19367 req-6f93ba05-b774-4b0e-916e-d34621b012f9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:02:40.983875 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a1b5c23b-e9ed-4283-ab53-05a9e4d19367 req-6f93ba05-b774-4b0e-916e-d34621b012f9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:02:40.997565 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-a1b5c23b-e9ed-4283-ab53-05a9e4d19367 req-6f93ba05-b774-4b0e-916e-d34621b012f9 service nova] Creating event network-changed:5ffd96b6-226c-42f2-875c-d739098669af for instance d5fdc57f-9c35-40d6-baaf-055965d2d84a on n-h1-master-1 Aug 07 02:02:41.003166 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-a1b5c23b-e9ed-4283-ab53-05a9e4d19367 req-6f93ba05-b774-4b0e-916e-d34621b012f9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.268192 Aug 07 02:02:41.003802 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3009/6482] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:02:41.054967 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-11e5598d-b2d7-4a23-8233-8dc4c14727e5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:02:41.062951 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-11e5598d-b2d7-4a23-8233-8dc4c14727e5 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a" status: 200 len: 1575 microversion: 2.1 time: 0.184890 Aug 07 02:02:41.063595 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3474/6483] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:02:40 2022] GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a => generated 1575 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:02:42.085899 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5637f5ef-95cc-45fd-9b79-85184b2d506a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:02:42.087099 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5637f5ef-95cc-45fd-9b79-85184b2d506a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: d5fdc57f-9c35-40d6-baaf-055965d2d84a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:02:42.094708 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5637f5ef-95cc-45fd-9b79-85184b2d506a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:02:42.095195 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5637f5ef-95cc-45fd-9b79-85184b2d506a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:02:42.095648 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5637f5ef-95cc-45fd-9b79-85184b2d506a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:02:42.096411 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5637f5ef-95cc-45fd-9b79-85184b2d506a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:02:42.096867 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5637f5ef-95cc-45fd-9b79-85184b2d506a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:02:42.097294 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5637f5ef-95cc-45fd-9b79-85184b2d506a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:02:42.101013 n-d-master-1 devstack@n-api.service[119517]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dde625b-e185-486e-885e-ba9f9bdf36ce] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 60016. Aug 07 02:02:42.238975 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5637f5ef-95cc-45fd-9b79-85184b2d506a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:02:42.246739 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5637f5ef-95cc-45fd-9b79-85184b2d506a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a" status: 200 len: 1575 microversion: 2.1 time: 0.166763 Aug 07 02:02:42.247304 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3010/6484] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:02:42 2022] GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:02:43.010094 n-d-master-1 devstack@n-api.service[119516]: INFO oslo.messaging._drivers.impl_rabbit [-] [9bbf4f32-4f7b-4fcf-a326-64eac47dae98] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 60024. Aug 07 02:02:43.071224 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-1e58fed6-2707-4497-a2a9-3bf5cabf3a95 req-4afcdfdd-4a87-4213-be0f-fc6c2b912774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5fdc57f-9c35-40d6-baaf-055965d2d84a", "name": "network-vif-deleted", "tag": "5ffd96b6-226c-42f2-875c-d739098669af"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:02:43.082706 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-1e58fed6-2707-4497-a2a9-3bf5cabf3a95 req-4afcdfdd-4a87-4213-be0f-fc6c2b912774 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:02:43.083196 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-1e58fed6-2707-4497-a2a9-3bf5cabf3a95 req-4afcdfdd-4a87-4213-be0f-fc6c2b912774 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:02:43.083635 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-1e58fed6-2707-4497-a2a9-3bf5cabf3a95 req-4afcdfdd-4a87-4213-be0f-fc6c2b912774 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:02:43.095826 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-1e58fed6-2707-4497-a2a9-3bf5cabf3a95 req-4afcdfdd-4a87-4213-be0f-fc6c2b912774 service nova] Creating event network-vif-deleted:5ffd96b6-226c-42f2-875c-d739098669af for instance d5fdc57f-9c35-40d6-baaf-055965d2d84a on n-h1-master-1 Aug 07 02:02:43.100898 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-1e58fed6-2707-4497-a2a9-3bf5cabf3a95 req-4afcdfdd-4a87-4213-be0f-fc6c2b912774 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104987 Aug 07 02:02:43.101732 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3475/6485] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:02:43.268747 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-39d82e82-6fd1-4f23-a976-5fdbeafdc1c2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:02:43.269541 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-39d82e82-6fd1-4f23-a976-5fdbeafdc1c2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: d5fdc57f-9c35-40d6-baaf-055965d2d84a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:02:43.278074 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39d82e82-6fd1-4f23-a976-5fdbeafdc1c2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:02:43.278661 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39d82e82-6fd1-4f23-a976-5fdbeafdc1c2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:02:43.279205 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39d82e82-6fd1-4f23-a976-5fdbeafdc1c2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:02:43.280318 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39d82e82-6fd1-4f23-a976-5fdbeafdc1c2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:02:43.281040 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39d82e82-6fd1-4f23-a976-5fdbeafdc1c2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:02:43.281578 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39d82e82-6fd1-4f23-a976-5fdbeafdc1c2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:02:43.349471 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-39d82e82-6fd1-4f23-a976-5fdbeafdc1c2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:02:43.363961 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-39d82e82-6fd1-4f23-a976-5fdbeafdc1c2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a" status: 200 len: 1222 microversion: 2.1 time: 0.099004 Aug 07 02:02:43.372530 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3011/6486] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:02:43 2022] GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a => generated 1222 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:02:44.385865 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f223bb99-c612-491f-b6bb-fc72f4cc15e0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:02:44.386675 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f223bb99-c612-491f-b6bb-fc72f4cc15e0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: d5fdc57f-9c35-40d6-baaf-055965d2d84a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:02:44.394111 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f223bb99-c612-491f-b6bb-fc72f4cc15e0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:02:44.394619 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f223bb99-c612-491f-b6bb-fc72f4cc15e0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:02:44.395087 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f223bb99-c612-491f-b6bb-fc72f4cc15e0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:02:44.395813 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f223bb99-c612-491f-b6bb-fc72f4cc15e0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:02:44.396337 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f223bb99-c612-491f-b6bb-fc72f4cc15e0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:02:44.396788 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f223bb99-c612-491f-b6bb-fc72f4cc15e0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:02:44.463824 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f223bb99-c612-491f-b6bb-fc72f4cc15e0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:02:44.471738 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f223bb99-c612-491f-b6bb-fc72f4cc15e0 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a" status: 200 len: 1222 microversion: 2.1 time: 0.090105 Aug 07 02:02:44.472276 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3476/6487] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:02:44 2022] GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:02:45.493688 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fc1d152d-c7a3-4131-a313-da752820fd19 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:02:45.494341 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fc1d152d-c7a3-4131-a313-da752820fd19 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: d5fdc57f-9c35-40d6-baaf-055965d2d84a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:02:45.501039 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fc1d152d-c7a3-4131-a313-da752820fd19 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:02:45.501530 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fc1d152d-c7a3-4131-a313-da752820fd19 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:02:45.501959 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fc1d152d-c7a3-4131-a313-da752820fd19 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:02:45.502700 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fc1d152d-c7a3-4131-a313-da752820fd19 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:02:45.503158 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fc1d152d-c7a3-4131-a313-da752820fd19 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:02:45.503585 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fc1d152d-c7a3-4131-a313-da752820fd19 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:02:45.567252 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fc1d152d-c7a3-4131-a313-da752820fd19 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:02:45.575412 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fc1d152d-c7a3-4131-a313-da752820fd19 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a" status: 200 len: 1222 microversion: 2.1 time: 0.085838 Aug 07 02:02:45.576292 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3012/6488] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:02:45 2022] GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:02:46.596976 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-60a2a272-6210-4651-8ac0-331d7fbb4ed7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:02:46.597753 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-60a2a272-6210-4651-8ac0-331d7fbb4ed7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: d5fdc57f-9c35-40d6-baaf-055965d2d84a] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:02:46.604524 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60a2a272-6210-4651-8ac0-331d7fbb4ed7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:02:46.605019 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60a2a272-6210-4651-8ac0-331d7fbb4ed7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:02:46.605466 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60a2a272-6210-4651-8ac0-331d7fbb4ed7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:02:46.606172 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60a2a272-6210-4651-8ac0-331d7fbb4ed7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:02:46.606634 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60a2a272-6210-4651-8ac0-331d7fbb4ed7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:02:46.607069 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-60a2a272-6210-4651-8ac0-331d7fbb4ed7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:02:46.668461 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-60a2a272-6210-4651-8ac0-331d7fbb4ed7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:02:46.682304 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-60a2a272-6210-4651-8ac0-331d7fbb4ed7 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a" status: 200 len: 1222 microversion: 2.1 time: 0.089353 Aug 07 02:02:46.682872 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3477/6489] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:02:46 2022] GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a => generated 1222 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:02:47.703226 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-29ecb6ae-48f2-41ec-bbce-b4b8ff96de67 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:02:47.703844 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-29ecb6ae-48f2-41ec-bbce-b4b8ff96de67 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: d5fdc57f-9c35-40d6-baaf-055965d2d84a] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:02:47.710763 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-29ecb6ae-48f2-41ec-bbce-b4b8ff96de67 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:02:47.711250 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-29ecb6ae-48f2-41ec-bbce-b4b8ff96de67 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:02:47.711698 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-29ecb6ae-48f2-41ec-bbce-b4b8ff96de67 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:02:47.712428 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-29ecb6ae-48f2-41ec-bbce-b4b8ff96de67 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:02:47.712892 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-29ecb6ae-48f2-41ec-bbce-b4b8ff96de67 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:02:47.713325 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-29ecb6ae-48f2-41ec-bbce-b4b8ff96de67 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:02:47.727145 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-29ecb6ae-48f2-41ec-bbce-b4b8ff96de67 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] HTTP exception thrown: Instance d5fdc57f-9c35-40d6-baaf-055965d2d84a could not be found. Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-29ecb6ae-48f2-41ec-bbce-b4b8ff96de67 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Request method failure captured: Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a HTTP/1.1 Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xp6rUdIsYnfs49nr8p-3tgit6VpNtF0E4NPSidukXDEQntBhlyx_gwU6AjnU2O7Q5BLuafO4z_ZO55y2txpq1OJeOibLbj_karsXsR0GpyTHp3BnitplkO9r1bHquRHPgg2Nq4jyNzT0obzTHzoVjdq8NdzVY4LztormmeY7retjUI Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: bf36f5153ba648008cdaceb9dc538e53 Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-TestVolumeBootPattern-121766107 Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bf36f5153ba648008cdaceb9dc538e53", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-TestVolumeBootPattern-121766107 Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: bf36f5153ba648008cdaceb9dc538e53 Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-TestVolumeBootPattern-121766107 Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-TestVolumeBootPattern-121766107-project Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 661f6c9aa7da4e348a9b0d91840078c2 Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-TestVolumeBootPattern-121766107-project Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: exception: Instance d5fdc57f-9c35-40d6-baaf-055965d2d84a could not be found. Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'd5fdc57f-9c35-40d6-baaf-055965d2d84a'} Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5fdc57f-9c35-40d6-baaf-055965d2d84a could not be found. Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5fdc57f-9c35-40d6-baaf-055965d2d84a could not be found. Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:02:47.728810 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:02:47.734803 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:02:47.734803 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:02:47.734803 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:02:47.734803 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:02:47.734803 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:02:47.734803 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5fdc57f-9c35-40d6-baaf-055965d2d84a could not be found. Aug 07 02:02:47.734803 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:02:47.734803 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-29ecb6ae-48f2-41ec-bbce-b4b8ff96de67 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Returning 404 to user: Instance d5fdc57f-9c35-40d6-baaf-055965d2d84a could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:02:47.734803 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-29ecb6ae-48f2-41ec-bbce-b4b8ff96de67 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a" status: 404 len: 111 microversion: 2.1 time: 0.031018 Aug 07 02:02:47.734803 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3013/6490] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:02:47 2022] GET /compute/v2.1/servers/d5fdc57f-9c35-40d6-baaf-055965d2d84a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:02:48.058464 n-d-master-1 devstack@n-api.service[119516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 02:02:48.059015 n-d-master-1 devstack@n-api.service[119516]: Sun Aug 7 02:02:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 02:02:53.950886 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4cf1e98a-4deb-4551-a77e-16c56de9816a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:02:53.951524 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4cf1e98a-4deb-4551-a77e-16c56de9816a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 48c2c3fe-f1f4-4b79-a2b2-811e9418a1be] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:02:53.952735 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-55a87259-a13c-4bd8-b308-d6178eab201d req-076734cc-70d9-46df-a51b-26d74f21874e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48c2c3fe-f1f4-4b79-a2b2-811e9418a1be", "tag": "af787e6e-3ea9-4b26-9930-46ee9b38aa44"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:02:53.958997 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4cf1e98a-4deb-4551-a77e-16c56de9816a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:02:53.959572 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4cf1e98a-4deb-4551-a77e-16c56de9816a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:02:53.960301 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4cf1e98a-4deb-4551-a77e-16c56de9816a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:02:53.961662 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4cf1e98a-4deb-4551-a77e-16c56de9816a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:02:53.962372 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4cf1e98a-4deb-4551-a77e-16c56de9816a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:02:53.962821 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4cf1e98a-4deb-4551-a77e-16c56de9816a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:02:53.973453 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-55a87259-a13c-4bd8-b308-d6178eab201d req-076734cc-70d9-46df-a51b-26d74f21874e service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:02:53.974028 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-55a87259-a13c-4bd8-b308-d6178eab201d req-076734cc-70d9-46df-a51b-26d74f21874e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:02:53.974551 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-55a87259-a13c-4bd8-b308-d6178eab201d req-076734cc-70d9-46df-a51b-26d74f21874e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:02:53.991860 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-55a87259-a13c-4bd8-b308-d6178eab201d req-076734cc-70d9-46df-a51b-26d74f21874e service nova] Creating event network-changed:af787e6e-3ea9-4b26-9930-46ee9b38aa44 for instance 48c2c3fe-f1f4-4b79-a2b2-811e9418a1be on n-h1-master-1 Aug 07 02:02:53.994510 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4cf1e98a-4deb-4551-a77e-16c56de9816a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 48c2c3fe-f1f4-4b79-a2b2-811e9418a1be] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 02:02:53.997978 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-55a87259-a13c-4bd8-b308-d6178eab201d req-076734cc-70d9-46df-a51b-26d74f21874e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049551 Aug 07 02:02:53.999172 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3014/6491] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 02:02:54.081185 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4cf1e98a-4deb-4551-a77e-16c56de9816a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "DELETE /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be" status: 204 len: 0 microversion: 2.1 time: 0.134763 Aug 07 02:02:54.082028 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3478/6492] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 02:02:53 2022] DELETE /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 02:02:54.091228 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e9755fc4-04d9-4a49-8e4f-351bc42e530b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:02:54.092370 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e9755fc4-04d9-4a49-8e4f-351bc42e530b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 48c2c3fe-f1f4-4b79-a2b2-811e9418a1be] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:02:54.100226 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9755fc4-04d9-4a49-8e4f-351bc42e530b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:02:54.100793 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9755fc4-04d9-4a49-8e4f-351bc42e530b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:02:54.101307 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9755fc4-04d9-4a49-8e4f-351bc42e530b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:02:54.102228 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9755fc4-04d9-4a49-8e4f-351bc42e530b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:02:54.102696 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9755fc4-04d9-4a49-8e4f-351bc42e530b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:02:54.103131 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9755fc4-04d9-4a49-8e4f-351bc42e530b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:02:54.239524 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e9755fc4-04d9-4a49-8e4f-351bc42e530b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:02:54.247702 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e9755fc4-04d9-4a49-8e4f-351bc42e530b tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be" status: 200 len: 1576 microversion: 2.1 time: 0.160842 Aug 07 02:02:54.248314 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3015/6493] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:02:54 2022] GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:02:55.269138 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-aaca9a93-fe9d-4042-8666-5a2f1d1e4789 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:02:55.269855 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-aaca9a93-fe9d-4042-8666-5a2f1d1e4789 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 48c2c3fe-f1f4-4b79-a2b2-811e9418a1be] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:02:55.276634 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aaca9a93-fe9d-4042-8666-5a2f1d1e4789 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:02:55.277708 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aaca9a93-fe9d-4042-8666-5a2f1d1e4789 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:02:55.278164 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aaca9a93-fe9d-4042-8666-5a2f1d1e4789 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:02:55.278879 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aaca9a93-fe9d-4042-8666-5a2f1d1e4789 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:02:55.279348 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aaca9a93-fe9d-4042-8666-5a2f1d1e4789 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:02:55.279792 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aaca9a93-fe9d-4042-8666-5a2f1d1e4789 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:02:55.413264 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-aaca9a93-fe9d-4042-8666-5a2f1d1e4789 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:02:55.421923 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-aaca9a93-fe9d-4042-8666-5a2f1d1e4789 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be" status: 200 len: 1576 microversion: 2.1 time: 0.156976 Aug 07 02:02:55.422504 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3479/6494] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:02:55 2022] GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:02:56.134663 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-8e3a5af1-1597-443f-84b7-2f069e668185 req-a2f605c8-9d10-4689-9b55-586c2a53ead1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48c2c3fe-f1f4-4b79-a2b2-811e9418a1be", "name": "network-vif-deleted", "tag": "af787e6e-3ea9-4b26-9930-46ee9b38aa44"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:02:56.150200 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-8e3a5af1-1597-443f-84b7-2f069e668185 req-a2f605c8-9d10-4689-9b55-586c2a53ead1 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:02:56.151037 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-8e3a5af1-1597-443f-84b7-2f069e668185 req-a2f605c8-9d10-4689-9b55-586c2a53ead1 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:02:56.151486 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-8e3a5af1-1597-443f-84b7-2f069e668185 req-a2f605c8-9d10-4689-9b55-586c2a53ead1 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:02:56.166302 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-8e3a5af1-1597-443f-84b7-2f069e668185 req-a2f605c8-9d10-4689-9b55-586c2a53ead1 service nova] Creating event network-vif-deleted:af787e6e-3ea9-4b26-9930-46ee9b38aa44 for instance 48c2c3fe-f1f4-4b79-a2b2-811e9418a1be on n-h1-master-1 Aug 07 02:02:56.171682 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-8e3a5af1-1597-443f-84b7-2f069e668185 req-a2f605c8-9d10-4689-9b55-586c2a53ead1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040852 Aug 07 02:02:56.172311 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3016/6495] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:02:56.442758 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fdb57da6-cc76-419f-abba-cde2cad4eb30 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:02:56.444049 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fdb57da6-cc76-419f-abba-cde2cad4eb30 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 48c2c3fe-f1f4-4b79-a2b2-811e9418a1be] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:02:56.451018 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fdb57da6-cc76-419f-abba-cde2cad4eb30 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:02:56.451520 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fdb57da6-cc76-419f-abba-cde2cad4eb30 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:02:56.451997 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fdb57da6-cc76-419f-abba-cde2cad4eb30 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:02:56.452720 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fdb57da6-cc76-419f-abba-cde2cad4eb30 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:02:56.453181 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fdb57da6-cc76-419f-abba-cde2cad4eb30 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:02:56.453612 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fdb57da6-cc76-419f-abba-cde2cad4eb30 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:02:56.523396 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fdb57da6-cc76-419f-abba-cde2cad4eb30 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:02:56.532188 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fdb57da6-cc76-419f-abba-cde2cad4eb30 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be" status: 200 len: 1223 microversion: 2.1 time: 0.093048 Aug 07 02:02:56.532773 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3480/6496] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:02:56 2022] GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:02:57.553678 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-53d95d4e-939f-45b1-b35f-fd3b8303c2a9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:02:57.554380 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-53d95d4e-939f-45b1-b35f-fd3b8303c2a9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 48c2c3fe-f1f4-4b79-a2b2-811e9418a1be] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:02:57.561994 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53d95d4e-939f-45b1-b35f-fd3b8303c2a9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:02:57.562477 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53d95d4e-939f-45b1-b35f-fd3b8303c2a9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:02:57.562915 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53d95d4e-939f-45b1-b35f-fd3b8303c2a9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:02:57.563611 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53d95d4e-939f-45b1-b35f-fd3b8303c2a9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:02:57.564095 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53d95d4e-939f-45b1-b35f-fd3b8303c2a9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:02:57.564525 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53d95d4e-939f-45b1-b35f-fd3b8303c2a9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:02:57.627566 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-53d95d4e-939f-45b1-b35f-fd3b8303c2a9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:02:57.635171 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-53d95d4e-939f-45b1-b35f-fd3b8303c2a9 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be" status: 200 len: 1223 microversion: 2.1 time: 0.085699 Aug 07 02:02:57.635749 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3017/6497] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:02:57 2022] GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:02:58.656202 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-20f39739-23df-4385-8474-cd49c6b58e5a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:02:58.656825 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-20f39739-23df-4385-8474-cd49c6b58e5a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 48c2c3fe-f1f4-4b79-a2b2-811e9418a1be] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:02:58.663711 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20f39739-23df-4385-8474-cd49c6b58e5a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:02:58.664234 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20f39739-23df-4385-8474-cd49c6b58e5a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:02:58.664682 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20f39739-23df-4385-8474-cd49c6b58e5a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:02:58.665384 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20f39739-23df-4385-8474-cd49c6b58e5a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:02:58.665850 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20f39739-23df-4385-8474-cd49c6b58e5a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:02:58.666281 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20f39739-23df-4385-8474-cd49c6b58e5a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:02:58.727636 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-20f39739-23df-4385-8474-cd49c6b58e5a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:02:58.735663 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-20f39739-23df-4385-8474-cd49c6b58e5a tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be" status: 200 len: 1223 microversion: 2.1 time: 0.083422 Aug 07 02:02:58.736261 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3481/6498] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:02:58 2022] GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:02:59.756934 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-28c12268-e7ff-42e5-8ce6-17d78e83cd79 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:02:59.757494 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-28c12268-e7ff-42e5-8ce6-17d78e83cd79 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 48c2c3fe-f1f4-4b79-a2b2-811e9418a1be] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:02:59.764479 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28c12268-e7ff-42e5-8ce6-17d78e83cd79 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:02:59.764966 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28c12268-e7ff-42e5-8ce6-17d78e83cd79 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:02:59.765407 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28c12268-e7ff-42e5-8ce6-17d78e83cd79 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:02:59.766110 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28c12268-e7ff-42e5-8ce6-17d78e83cd79 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:02:59.766574 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28c12268-e7ff-42e5-8ce6-17d78e83cd79 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:02:59.767011 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-28c12268-e7ff-42e5-8ce6-17d78e83cd79 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:02:59.834401 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-28c12268-e7ff-42e5-8ce6-17d78e83cd79 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661f6c9aa7da4e348a9b0d91840078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f5153ba648008cdaceb9dc538e53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:02:59.842186 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-28c12268-e7ff-42e5-8ce6-17d78e83cd79 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be" status: 200 len: 1223 microversion: 2.1 time: 0.089254 Aug 07 02:02:59.842768 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3018/6499] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:02:59 2022] GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:03:00.863645 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b3a1c878-a90c-4623-8d19-a96bbc50bdb2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:00.864313 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b3a1c878-a90c-4623-8d19-a96bbc50bdb2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 48c2c3fe-f1f4-4b79-a2b2-811e9418a1be] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:03:00.871222 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b3a1c878-a90c-4623-8d19-a96bbc50bdb2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:00.871724 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b3a1c878-a90c-4623-8d19-a96bbc50bdb2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:00.872217 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b3a1c878-a90c-4623-8d19-a96bbc50bdb2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:00.873305 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b3a1c878-a90c-4623-8d19-a96bbc50bdb2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:00.873782 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b3a1c878-a90c-4623-8d19-a96bbc50bdb2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:00.874231 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b3a1c878-a90c-4623-8d19-a96bbc50bdb2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:00.888549 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-b3a1c878-a90c-4623-8d19-a96bbc50bdb2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] HTTP exception thrown: Instance 48c2c3fe-f1f4-4b79-a2b2-811e9418a1be could not be found. Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b3a1c878-a90c-4623-8d19-a96bbc50bdb2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Request method failure captured: Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be HTTP/1.1 Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xp6rUdIsYnfs49nr8p-3tgit6VpNtF0E4NPSidukXDEQntBhlyx_gwU6AjnU2O7Q5BLuafO4z_ZO55y2txpq1OJeOibLbj_karsXsR0GpyTHp3BnitplkO9r1bHquRHPgg2Nq4jyNzT0obzTHzoVjdq8NdzVY4LztormmeY7retjUI Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: bf36f5153ba648008cdaceb9dc538e53 Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-TestVolumeBootPattern-121766107 Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bf36f5153ba648008cdaceb9dc538e53", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-TestVolumeBootPattern-121766107 Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: bf36f5153ba648008cdaceb9dc538e53 Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-TestVolumeBootPattern-121766107 Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-TestVolumeBootPattern-121766107-project Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 661f6c9aa7da4e348a9b0d91840078c2 Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-TestVolumeBootPattern-121766107-project Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 48c2c3fe-f1f4-4b79-a2b2-811e9418a1be could not be found. Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '48c2c3fe-f1f4-4b79-a2b2-811e9418a1be'} Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48c2c3fe-f1f4-4b79-a2b2-811e9418a1be could not be found. Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48c2c3fe-f1f4-4b79-a2b2-811e9418a1be could not be found. Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:03:00.890240 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:03:00.895723 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:03:00.895723 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:03:00.895723 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:03:00.895723 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:03:00.895723 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:03:00.895723 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48c2c3fe-f1f4-4b79-a2b2-811e9418a1be could not be found. Aug 07 02:03:00.895723 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:03:00.895723 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b3a1c878-a90c-4623-8d19-a96bbc50bdb2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Returning 404 to user: Instance 48c2c3fe-f1f4-4b79-a2b2-811e9418a1be could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:03:00.895723 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b3a1c878-a90c-4623-8d19-a96bbc50bdb2 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be" status: 404 len: 111 microversion: 2.1 time: 0.031953 Aug 07 02:03:00.895723 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3482/6500] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:03:00 2022] GET /compute/v2.1/servers/48c2c3fe-f1f4-4b79-a2b2-811e9418a1be => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:03:01.333402 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-45a0ec67-79f4-4884-a9a9-5604f1533b65 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:01.333946 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-45a0ec67-79f4-4884-a9a9-5604f1533b65 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 08886847-3d66-41ea-b13d-78bec27950a5] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:03:01.341293 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-45a0ec67-79f4-4884-a9a9-5604f1533b65 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:01.341783 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-45a0ec67-79f4-4884-a9a9-5604f1533b65 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:01.342222 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-45a0ec67-79f4-4884-a9a9-5604f1533b65 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:01.342928 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-45a0ec67-79f4-4884-a9a9-5604f1533b65 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:01.343391 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-45a0ec67-79f4-4884-a9a9-5604f1533b65 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:01.343841 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-45a0ec67-79f4-4884-a9a9-5604f1533b65 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:01.357176 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-45a0ec67-79f4-4884-a9a9-5604f1533b65 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] HTTP exception thrown: Instance 08886847-3d66-41ea-b13d-78bec27950a5 could not be found. Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-45a0ec67-79f4-4884-a9a9-5604f1533b65 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Request method failure captured: Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5 HTTP/1.1 Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7xp6rUdIsYnfs49nr8p-3tgit6VpNtF0E4NPSidukXDEQntBhlyx_gwU6AjnU2O7Q5BLuafO4z_ZO55y2txpq1OJeOibLbj_karsXsR0GpyTHp3BnitplkO9r1bHquRHPgg2Nq4jyNzT0obzTHzoVjdq8NdzVY4LztormmeY7retjUI Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: bf36f5153ba648008cdaceb9dc538e53 Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-TestVolumeBootPattern-121766107 Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bf36f5153ba648008cdaceb9dc538e53", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-TestVolumeBootPattern-121766107 Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: bf36f5153ba648008cdaceb9dc538e53 Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-TestVolumeBootPattern-121766107 Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-TestVolumeBootPattern-121766107-project Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 661f6c9aa7da4e348a9b0d91840078c2 Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-TestVolumeBootPattern-121766107-project Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 08886847-3d66-41ea-b13d-78bec27950a5 could not be found. Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '08886847-3d66-41ea-b13d-78bec27950a5'} Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08886847-3d66-41ea-b13d-78bec27950a5 could not be found. Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:03:01.359091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:03:01.365715 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08886847-3d66-41ea-b13d-78bec27950a5 could not be found. Aug 07 02:03:01.365715 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:03:01.365715 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:03:01.365715 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:03:01.365715 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:03:01.365715 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:03:01.365715 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:03:01.365715 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:03:01.365715 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:03:01.365715 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08886847-3d66-41ea-b13d-78bec27950a5 could not be found. Aug 07 02:03:01.365715 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:03:01.365715 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-45a0ec67-79f4-4884-a9a9-5604f1533b65 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Returning 404 to user: Instance 08886847-3d66-41ea-b13d-78bec27950a5 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:03:01.365715 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-45a0ec67-79f4-4884-a9a9-5604f1533b65 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "DELETE /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5" status: 404 len: 111 microversion: 2.1 time: 0.031010 Aug 07 02:03:01.365715 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3019/6501] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 02:03:01 2022] DELETE /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:03:01.370455 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ea97ba61-c55f-4cae-99e1-3fcad0472733 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:01.371084 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ea97ba61-c55f-4cae-99e1-3fcad0472733 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] [instance: 08886847-3d66-41ea-b13d-78bec27950a5] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:03:01.377150 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea97ba61-c55f-4cae-99e1-3fcad0472733 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:01.377640 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea97ba61-c55f-4cae-99e1-3fcad0472733 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:01.378086 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea97ba61-c55f-4cae-99e1-3fcad0472733 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:01.378790 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea97ba61-c55f-4cae-99e1-3fcad0472733 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:01.379252 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea97ba61-c55f-4cae-99e1-3fcad0472733 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:01.379690 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea97ba61-c55f-4cae-99e1-3fcad0472733 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:01.394746 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-ea97ba61-c55f-4cae-99e1-3fcad0472733 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] HTTP exception thrown: Instance 08886847-3d66-41ea-b13d-78bec27950a5 could not be found. Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ea97ba61-c55f-4cae-99e1-3fcad0472733 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Request method failure captured: Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5 HTTP/1.1 Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7xp6rUdIsYnfs49nr8p-3tgit6VpNtF0E4NPSidukXDEQntBhlyx_gwU6AjnU2O7Q5BLuafO4z_ZO55y2txpq1OJeOibLbj_karsXsR0GpyTHp3BnitplkO9r1bHquRHPgg2Nq4jyNzT0obzTHzoVjdq8NdzVY4LztormmeY7retjUI Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: bf36f5153ba648008cdaceb9dc538e53 Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-TestVolumeBootPattern-121766107 Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_bf36f5153ba648008cdaceb9dc538e53", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/bf36f5153ba648008cdaceb9dc538e53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-TestVolumeBootPattern-121766107 Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: bf36f5153ba648008cdaceb9dc538e53 Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-TestVolumeBootPattern-121766107 Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-TestVolumeBootPattern-121766107-project Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 661f6c9aa7da4e348a9b0d91840078c2 Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-TestVolumeBootPattern-121766107-project Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 08886847-3d66-41ea-b13d-78bec27950a5 could not be found. Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '08886847-3d66-41ea-b13d-78bec27950a5'} Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08886847-3d66-41ea-b13d-78bec27950a5 could not be found. Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08886847-3d66-41ea-b13d-78bec27950a5 could not be found. Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:03:01.396300 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:03:01.402217 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:03:01.402217 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:03:01.402217 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:03:01.402217 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:03:01.402217 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:03:01.402217 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08886847-3d66-41ea-b13d-78bec27950a5 could not be found. Aug 07 02:03:01.402217 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:03:01.402217 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ea97ba61-c55f-4cae-99e1-3fcad0472733 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Returning 404 to user: Instance 08886847-3d66-41ea-b13d-78bec27950a5 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:03:01.402217 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ea97ba61-c55f-4cae-99e1-3fcad0472733 tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5" status: 404 len: 111 microversion: 2.1 time: 0.031201 Aug 07 02:03:01.402217 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3483/6502] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:03:01 2022] GET /compute/v2.1/servers/08886847-3d66-41ea-b13d-78bec27950a5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:03:04.803164 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c1333f8b-bf00-47a1-bc4f-36c684fba53f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] Calling method '.version_select at 0x7f9e240ff0d0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:04.825199 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c1333f8b-bf00-47a1-bc4f-36c684fba53f tempest-TestVolumeBootPattern-121766107 tempest-TestVolumeBootPattern-121766107-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-55640696" status: 202 len: 0 microversion: 2.1 time: 0.025954 Aug 07 02:03:04.825834 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3020/6503] 10.222.0.39 () {58 vars in 1257 bytes} [Sun Aug 7 02:03:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-55640696 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:03:22.986268 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:22.987099 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:23.099509 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-14f51b59-82c4-486e-9cc3-0c8dd06adca0 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-347558377", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:03:23.150638 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-14f51b59-82c4-486e-9cc3-0c8dd06adca0 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] validate_networks() for None {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 02:03:23.344968 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-14f51b59-82c4-486e-9cc3-0c8dd06adca0 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 02:03:23.345439 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-14f51b59-82c4-486e-9cc3-0c8dd06adca0 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 02:03:23.345929 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-14f51b59-82c4-486e-9cc3-0c8dd06adca0 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 02:03:23.346354 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-14f51b59-82c4-486e-9cc3-0c8dd06adca0 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 02:03:23.346785 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-14f51b59-82c4-486e-9cc3-0c8dd06adca0 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 02:03:23.356327 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-14f51b59-82c4-486e-9cc3-0c8dd06adca0 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:23.356824 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-14f51b59-82c4-486e-9cc3-0c8dd06adca0 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:23.357533 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-14f51b59-82c4-486e-9cc3-0c8dd06adca0 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:23.358280 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-14f51b59-82c4-486e-9cc3-0c8dd06adca0 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:23.358751 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-14f51b59-82c4-486e-9cc3-0c8dd06adca0 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:23.359197 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-14f51b59-82c4-486e-9cc3-0c8dd06adca0 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:23.376934 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-14f51b59-82c4-486e-9cc3-0c8dd06adca0 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Getting quotas for project 0ac14163d1ba44d08784c186c8006680. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:03:23.382230 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-14f51b59-82c4-486e-9cc3-0c8dd06adca0 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Getting quotas for user 5384b291c32042858c6a4ae404085dfd and project 0ac14163d1ba44d08784c186c8006680. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:03:23.394464 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-14f51b59-82c4-486e-9cc3-0c8dd06adca0 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 02:03:23.396697 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-14f51b59-82c4-486e-9cc3-0c8dd06adca0 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] [instance: 2369ef96-a948-470b-966e-d07fd378af72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 02:03:23.442207 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-14f51b59-82c4-486e-9cc3-0c8dd06adca0 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.461941 Aug 07 02:03:23.442857 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3484/6504] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 02:03:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 463 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 02:03:23.453906 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=46 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:23.454757 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:23.459018 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c5e8ae60-c52e-4fda-8d2e-945a0debc06a tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:23.459641 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c5e8ae60-c52e-4fda-8d2e-945a0debc06a tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] [instance: 2369ef96-a948-470b-966e-d07fd378af72] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:03:23.521336 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c5e8ae60-c52e-4fda-8d2e-945a0debc06a tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5384b291c32042858c6a4ae404085dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac14163d1ba44d08784c186c8006680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:03:23.528715 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c5e8ae60-c52e-4fda-8d2e-945a0debc06a tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] 10.222.0.39 "GET /compute/v2.1/servers/2369ef96-a948-470b-966e-d07fd378af72" status: 200 len: 1221 microversion: 2.1 time: 0.077511 Aug 07 02:03:23.529288 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3021/6505] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:03:23 2022] GET /compute/v2.1/servers/2369ef96-a948-470b-966e-d07fd378af72 => generated 1221 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:03:24.549617 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0f37b82a-edbc-463d-9cae-ef279d5b9740 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:24.550249 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0f37b82a-edbc-463d-9cae-ef279d5b9740 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] [instance: 2369ef96-a948-470b-966e-d07fd378af72] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:03:24.557234 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f37b82a-edbc-463d-9cae-ef279d5b9740 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:24.557735 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f37b82a-edbc-463d-9cae-ef279d5b9740 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:24.558193 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f37b82a-edbc-463d-9cae-ef279d5b9740 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:24.558900 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f37b82a-edbc-463d-9cae-ef279d5b9740 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:24.559388 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f37b82a-edbc-463d-9cae-ef279d5b9740 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:24.559818 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f37b82a-edbc-463d-9cae-ef279d5b9740 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:24.620961 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0f37b82a-edbc-463d-9cae-ef279d5b9740 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5384b291c32042858c6a4ae404085dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac14163d1ba44d08784c186c8006680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:03:24.628374 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0f37b82a-edbc-463d-9cae-ef279d5b9740 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] 10.222.0.39 "GET /compute/v2.1/servers/2369ef96-a948-470b-966e-d07fd378af72" status: 200 len: 1273 microversion: 2.1 time: 0.082677 Aug 07 02:03:24.628939 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3485/6506] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:03:24 2022] GET /compute/v2.1/servers/2369ef96-a948-470b-966e-d07fd378af72 => generated 1273 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:03:25.650893 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-31a5ca32-dc05-41f0-b485-65a6120d5988 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:25.652938 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-31a5ca32-dc05-41f0-b485-65a6120d5988 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] [instance: 2369ef96-a948-470b-966e-d07fd378af72] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:03:25.659822 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-31a5ca32-dc05-41f0-b485-65a6120d5988 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:25.660608 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-31a5ca32-dc05-41f0-b485-65a6120d5988 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:25.661246 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-31a5ca32-dc05-41f0-b485-65a6120d5988 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:25.661966 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-31a5ca32-dc05-41f0-b485-65a6120d5988 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:25.662427 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-31a5ca32-dc05-41f0-b485-65a6120d5988 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:25.662875 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-31a5ca32-dc05-41f0-b485-65a6120d5988 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:25.801187 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-31a5ca32-dc05-41f0-b485-65a6120d5988 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5384b291c32042858c6a4ae404085dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac14163d1ba44d08784c186c8006680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:03:25.808736 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-31a5ca32-dc05-41f0-b485-65a6120d5988 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] 10.222.0.39 "GET /compute/v2.1/servers/2369ef96-a948-470b-966e-d07fd378af72" status: 200 len: 1321 microversion: 2.1 time: 0.161956 Aug 07 02:03:25.809302 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3022/6507] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:03:25 2022] GET /compute/v2.1/servers/2369ef96-a948-470b-966e-d07fd378af72 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:03:26.192676 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-d0f28650-6025-4f15-9415-66f6d10ffa79 req-e0e1caed-fbf6-4c49-8b3b-080a9fb3fa6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2369ef96-a948-470b-966e-d07fd378af72", "tag": "52518f7b-d0f4-41aa-84ae-5f2e7277af93"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:03:26.204195 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d0f28650-6025-4f15-9415-66f6d10ffa79 req-e0e1caed-fbf6-4c49-8b3b-080a9fb3fa6b service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:26.204696 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d0f28650-6025-4f15-9415-66f6d10ffa79 req-e0e1caed-fbf6-4c49-8b3b-080a9fb3fa6b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:26.205151 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d0f28650-6025-4f15-9415-66f6d10ffa79 req-e0e1caed-fbf6-4c49-8b3b-080a9fb3fa6b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:26.216241 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-d0f28650-6025-4f15-9415-66f6d10ffa79 req-e0e1caed-fbf6-4c49-8b3b-080a9fb3fa6b service nova] Creating event network-changed:52518f7b-d0f4-41aa-84ae-5f2e7277af93 for instance 2369ef96-a948-470b-966e-d07fd378af72 on n-h1-master-1 Aug 07 02:03:26.221096 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-d0f28650-6025-4f15-9415-66f6d10ffa79 req-e0e1caed-fbf6-4c49-8b3b-080a9fb3fa6b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032383 Aug 07 02:03:26.221694 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3486/6508] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:03:26.829274 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6aca3c6e-322f-45ae-8616-f13a30080348 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:26.829894 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6aca3c6e-322f-45ae-8616-f13a30080348 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] [instance: 2369ef96-a948-470b-966e-d07fd378af72] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:03:26.836857 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6aca3c6e-322f-45ae-8616-f13a30080348 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:26.837355 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6aca3c6e-322f-45ae-8616-f13a30080348 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:26.837798 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6aca3c6e-322f-45ae-8616-f13a30080348 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:26.838506 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6aca3c6e-322f-45ae-8616-f13a30080348 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:26.838969 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6aca3c6e-322f-45ae-8616-f13a30080348 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:26.839405 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6aca3c6e-322f-45ae-8616-f13a30080348 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:26.969716 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6aca3c6e-322f-45ae-8616-f13a30080348 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5384b291c32042858c6a4ae404085dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac14163d1ba44d08784c186c8006680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:03:26.977341 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6aca3c6e-322f-45ae-8616-f13a30080348 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] 10.222.0.39 "GET /compute/v2.1/servers/2369ef96-a948-470b-966e-d07fd378af72" status: 200 len: 1321 microversion: 2.1 time: 0.151973 Aug 07 02:03:26.977929 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3023/6509] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:03:26 2022] GET /compute/v2.1/servers/2369ef96-a948-470b-966e-d07fd378af72 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:03:28.001503 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a559bc86-d3a0-4db0-a720-5b88b4c8ff8f tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:28.002229 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a559bc86-d3a0-4db0-a720-5b88b4c8ff8f tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] [instance: 2369ef96-a948-470b-966e-d07fd378af72] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:03:28.008495 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a559bc86-d3a0-4db0-a720-5b88b4c8ff8f tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:28.008994 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a559bc86-d3a0-4db0-a720-5b88b4c8ff8f tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:28.009469 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a559bc86-d3a0-4db0-a720-5b88b4c8ff8f tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:28.010165 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a559bc86-d3a0-4db0-a720-5b88b4c8ff8f tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:28.010645 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a559bc86-d3a0-4db0-a720-5b88b4c8ff8f tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:28.011100 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a559bc86-d3a0-4db0-a720-5b88b4c8ff8f tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:28.141595 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a559bc86-d3a0-4db0-a720-5b88b4c8ff8f tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5384b291c32042858c6a4ae404085dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac14163d1ba44d08784c186c8006680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:03:28.149128 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a559bc86-d3a0-4db0-a720-5b88b4c8ff8f tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] 10.222.0.39 "GET /compute/v2.1/servers/2369ef96-a948-470b-966e-d07fd378af72" status: 200 len: 1321 microversion: 2.1 time: 0.153307 Aug 07 02:03:28.149708 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3487/6510] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:03:27 2022] GET /compute/v2.1/servers/2369ef96-a948-470b-966e-d07fd378af72 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:03:29.169421 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bed7d7d5-875a-4d7b-bd83-8d5952cdeebd tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:29.170041 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bed7d7d5-875a-4d7b-bd83-8d5952cdeebd tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] [instance: 2369ef96-a948-470b-966e-d07fd378af72] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:03:29.176834 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bed7d7d5-875a-4d7b-bd83-8d5952cdeebd tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:29.177320 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bed7d7d5-875a-4d7b-bd83-8d5952cdeebd tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:29.177765 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bed7d7d5-875a-4d7b-bd83-8d5952cdeebd tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:29.178464 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bed7d7d5-875a-4d7b-bd83-8d5952cdeebd tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:29.178924 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bed7d7d5-875a-4d7b-bd83-8d5952cdeebd tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:29.179355 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bed7d7d5-875a-4d7b-bd83-8d5952cdeebd tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:29.312006 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bed7d7d5-875a-4d7b-bd83-8d5952cdeebd tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5384b291c32042858c6a4ae404085dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac14163d1ba44d08784c186c8006680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:03:29.319523 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bed7d7d5-875a-4d7b-bd83-8d5952cdeebd tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] 10.222.0.39 "GET /compute/v2.1/servers/2369ef96-a948-470b-966e-d07fd378af72" status: 200 len: 1321 microversion: 2.1 time: 0.154036 Aug 07 02:03:29.320136 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3024/6511] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:03:29 2022] GET /compute/v2.1/servers/2369ef96-a948-470b-966e-d07fd378af72 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:03:30.340291 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c1f65ee8-5f86-4ffd-b805-86cfd9508038 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:30.341466 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c1f65ee8-5f86-4ffd-b805-86cfd9508038 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] [instance: 2369ef96-a948-470b-966e-d07fd378af72] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:03:30.348476 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1f65ee8-5f86-4ffd-b805-86cfd9508038 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:30.348973 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1f65ee8-5f86-4ffd-b805-86cfd9508038 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:30.349431 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1f65ee8-5f86-4ffd-b805-86cfd9508038 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:30.350143 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1f65ee8-5f86-4ffd-b805-86cfd9508038 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:30.350617 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1f65ee8-5f86-4ffd-b805-86cfd9508038 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:30.351061 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1f65ee8-5f86-4ffd-b805-86cfd9508038 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:30.484699 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c1f65ee8-5f86-4ffd-b805-86cfd9508038 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5384b291c32042858c6a4ae404085dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac14163d1ba44d08784c186c8006680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:03:30.494628 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c1f65ee8-5f86-4ffd-b805-86cfd9508038 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] 10.222.0.39 "GET /compute/v2.1/servers/2369ef96-a948-470b-966e-d07fd378af72" status: 200 len: 1321 microversion: 2.1 time: 0.157822 Aug 07 02:03:30.495727 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3488/6512] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:03:30 2022] GET /compute/v2.1/servers/2369ef96-a948-470b-966e-d07fd378af72 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:03:31.515630 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-23f24e73-6ff9-4e9b-a823-d06ab142f1f1 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:31.516405 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-23f24e73-6ff9-4e9b-a823-d06ab142f1f1 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] [instance: 2369ef96-a948-470b-966e-d07fd378af72] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:03:31.523315 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23f24e73-6ff9-4e9b-a823-d06ab142f1f1 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:31.523924 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23f24e73-6ff9-4e9b-a823-d06ab142f1f1 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:31.524423 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23f24e73-6ff9-4e9b-a823-d06ab142f1f1 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:31.525326 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23f24e73-6ff9-4e9b-a823-d06ab142f1f1 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:31.525815 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23f24e73-6ff9-4e9b-a823-d06ab142f1f1 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:31.526270 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-23f24e73-6ff9-4e9b-a823-d06ab142f1f1 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:31.535933 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-5b825843-8837-4dba-ab8a-72241d0d0d23 req-4a4c4dcf-eea8-4323-8461-570ce0b93db1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2369ef96-a948-470b-966e-d07fd378af72", "name": "network-vif-plugged", "status": "completed", "tag": "52518f7b-d0f4-41aa-84ae-5f2e7277af93"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:03:31.554421 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-5b825843-8837-4dba-ab8a-72241d0d0d23 req-4a4c4dcf-eea8-4323-8461-570ce0b93db1 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:31.554922 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-5b825843-8837-4dba-ab8a-72241d0d0d23 req-4a4c4dcf-eea8-4323-8461-570ce0b93db1 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:31.555378 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-5b825843-8837-4dba-ab8a-72241d0d0d23 req-4a4c4dcf-eea8-4323-8461-570ce0b93db1 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:31.576542 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-5b825843-8837-4dba-ab8a-72241d0d0d23 req-4a4c4dcf-eea8-4323-8461-570ce0b93db1 service nova] Creating event network-vif-plugged:52518f7b-d0f4-41aa-84ae-5f2e7277af93 for instance 2369ef96-a948-470b-966e-d07fd378af72 on n-h1-master-1 Aug 07 02:03:31.582600 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-5b825843-8837-4dba-ab8a-72241d0d0d23 req-4a4c4dcf-eea8-4323-8461-570ce0b93db1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050614 Aug 07 02:03:31.583771 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3489/6513] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 02:03:31.682110 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-23f24e73-6ff9-4e9b-a823-d06ab142f1f1 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5384b291c32042858c6a4ae404085dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac14163d1ba44d08784c186c8006680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:03:31.692991 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-23f24e73-6ff9-4e9b-a823-d06ab142f1f1 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] 10.222.0.39 "GET /compute/v2.1/servers/2369ef96-a948-470b-966e-d07fd378af72" status: 200 len: 1321 microversion: 2.1 time: 0.181091 Aug 07 02:03:31.693775 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3025/6514] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:03:31 2022] GET /compute/v2.1/servers/2369ef96-a948-470b-966e-d07fd378af72 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:03:32.715206 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c507e2ac-6ebf-482d-b351-ba0ef0aa1aae tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:32.715846 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c507e2ac-6ebf-482d-b351-ba0ef0aa1aae tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] [instance: 2369ef96-a948-470b-966e-d07fd378af72] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:03:32.722129 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c507e2ac-6ebf-482d-b351-ba0ef0aa1aae tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:32.722632 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c507e2ac-6ebf-482d-b351-ba0ef0aa1aae tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:32.723089 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c507e2ac-6ebf-482d-b351-ba0ef0aa1aae tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:32.723810 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c507e2ac-6ebf-482d-b351-ba0ef0aa1aae tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:32.724312 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c507e2ac-6ebf-482d-b351-ba0ef0aa1aae tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:32.724767 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c507e2ac-6ebf-482d-b351-ba0ef0aa1aae tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:32.864633 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c507e2ac-6ebf-482d-b351-ba0ef0aa1aae tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5384b291c32042858c6a4ae404085dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac14163d1ba44d08784c186c8006680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:03:32.873050 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c507e2ac-6ebf-482d-b351-ba0ef0aa1aae tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] 10.222.0.39 "GET /compute/v2.1/servers/2369ef96-a948-470b-966e-d07fd378af72" status: 200 len: 1321 microversion: 2.1 time: 0.162961 Aug 07 02:03:32.873615 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3490/6515] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:03:32 2022] GET /compute/v2.1/servers/2369ef96-a948-470b-966e-d07fd378af72 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:03:33.899330 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a6358188-2fef-4910-bb91-2c511a6038e6 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:33.899908 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a6358188-2fef-4910-bb91-2c511a6038e6 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] [instance: 2369ef96-a948-470b-966e-d07fd378af72] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:03:33.902704 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:33.908144 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a6358188-2fef-4910-bb91-2c511a6038e6 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:33.908630 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a6358188-2fef-4910-bb91-2c511a6038e6 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:33.909076 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a6358188-2fef-4910-bb91-2c511a6038e6 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:33.909775 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a6358188-2fef-4910-bb91-2c511a6038e6 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:33.910234 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a6358188-2fef-4910-bb91-2c511a6038e6 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:33.910662 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a6358188-2fef-4910-bb91-2c511a6038e6 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:34.045889 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a6358188-2fef-4910-bb91-2c511a6038e6 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5384b291c32042858c6a4ae404085dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac14163d1ba44d08784c186c8006680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:03:34.053490 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a6358188-2fef-4910-bb91-2c511a6038e6 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] 10.222.0.39 "GET /compute/v2.1/servers/2369ef96-a948-470b-966e-d07fd378af72" status: 200 len: 1471 microversion: 2.1 time: 0.158154 Aug 07 02:03:34.054061 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3026/6516] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:03:33 2022] GET /compute/v2.1/servers/2369ef96-a948-470b-966e-d07fd378af72 => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:03:34.077364 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:34.078175 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:34.126890 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-84832ab8-aeb1-4349-9643-9ad214c989d5 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Calling method '.version_select at 0x7f9e24723310>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:34.191959 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-84832ab8-aeb1-4349-9643-9ad214c989d5 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/1e01ff8fff8c4201a8611847af0cb1d7" status: 200 len: 371 microversion: 2.1 time: 0.119137 Aug 07 02:03:34.192516 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3491/6517] 10.222.0.39 () {58 vars in 1242 bytes} [Sun Aug 7 02:03:34 2022] GET /compute/v2.1/os-quota-sets/1e01ff8fff8c4201a8611847af0cb1d7 => generated 371 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:03:34.203712 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6ede0e0d-8f37-49f3-abfa-fb02a9c4ab27 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-812719256", "id": 471240521, "os-flavor-access:is_public": "True"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:03:34.206818 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 02:03:34.206818 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 02:03:34.231419 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6ede0e0d-8f37-49f3-abfa-fb02a9c4ab27 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.031420 Aug 07 02:03:34.232328 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3027/6518] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 02:03:34 2022] POST /compute/v2.1/flavors => generated 434 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:03:34.243917 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bfd4db7f-6969-4f11-84d3-922cf6cbbb96 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "471240521"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:03:34.246804 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bfd4db7f-6969-4f11-84d3-922cf6cbbb96 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] [instance: 2369ef96-a948-470b-966e-d07fd378af72] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:03:34.253120 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bfd4db7f-6969-4f11-84d3-922cf6cbbb96 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:34.253626 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bfd4db7f-6969-4f11-84d3-922cf6cbbb96 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:34.254080 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bfd4db7f-6969-4f11-84d3-922cf6cbbb96 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:34.254805 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bfd4db7f-6969-4f11-84d3-922cf6cbbb96 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:34.255282 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bfd4db7f-6969-4f11-84d3-922cf6cbbb96 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:34.255730 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bfd4db7f-6969-4f11-84d3-922cf6cbbb96 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:34.435812 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bfd4db7f-6969-4f11-84d3-922cf6cbbb96 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b4d34308938a4d47abc305ba7865c246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e01ff8fff8c4201a8611847af0cb1d7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:03:34.442494 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bfd4db7f-6969-4f11-84d3-922cf6cbbb96 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] [instance: 2369ef96-a948-470b-966e-d07fd378af72] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-812719256 {{(pid=119516) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 07 02:03:34.448882 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bfd4db7f-6969-4f11-84d3-922cf6cbbb96 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:34.449381 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bfd4db7f-6969-4f11-84d3-922cf6cbbb96 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:34.449835 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bfd4db7f-6969-4f11-84d3-922cf6cbbb96 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:34.450590 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bfd4db7f-6969-4f11-84d3-922cf6cbbb96 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:34.451066 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bfd4db7f-6969-4f11-84d3-922cf6cbbb96 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:34.451509 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bfd4db7f-6969-4f11-84d3-922cf6cbbb96 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:34.473788 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-bfd4db7f-6969-4f11-84d3-922cf6cbbb96 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Getting quotas for project 0ac14163d1ba44d08784c186c8006680. Resources: {'ram', 'cores'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:03:34.478847 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-bfd4db7f-6969-4f11-84d3-922cf6cbbb96 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Getting quotas for user 5384b291c32042858c6a4ae404085dfd and project 0ac14163d1ba44d08784c186c8006680. Resources: {'ram', 'cores'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:03:34.493051 n-d-master-1 devstack@n-api.service[119516]: INFO nova.compute.api [None req-bfd4db7f-6969-4f11-84d3-922cf6cbbb96 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] ram quota exceeded for 1e01ff8fff8c4201a8611847af0cb1d7, tried to resize instance. Aug 07 02:03:34.493612 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-bfd4db7f-6969-4f11-84d3-922cf6cbbb96 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bfd4db7f-6969-4f11-84d3-922cf6cbbb96 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Request method failure captured: Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers/2369ef96-a948-470b-966e-d07fd378af72/action HTTP/1.1 Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 38 Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7x1qs23YjG1FYMwADWrqrWmAjE93dTilIImCu_cawZuqTYd39nbHevHXch2XMw8dm05K98r44TEkpfOeRpi-JGSmkOmEX2h5ssInx7p9vAsJHCUgMbKSW0CiXBRUcnI6e7-4LxnrPeJe2GGNzAmAm29gmhLe8VsqU5sKdyt74_WIyBQ Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 1e01ff8fff8c4201a8611847af0cb1d7 Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-288036669 Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,admin,member Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,admin,member Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1e01ff8fff8c4201a8611847af0cb1d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1e01ff8fff8c4201a8611847af0cb1d7", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1e01ff8fff8c4201a8611847af0cb1d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1e01ff8fff8c4201a8611847af0cb1d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersAdminNegativeTestJSON-288036669 Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 1e01ff8fff8c4201a8611847af0cb1d7 Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-288036669 Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersAdminNegativeTestJSON-288036669-project-admin Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: b4d34308938a4d47abc305ba7865c246 Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersAdminNegativeTestJSON-288036669-project-admin Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: {"resize": {"flavorRef": "471240521"}} Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '2369ef96-a948-470b-966e-d07fd378af72', 'body': {'resize': {'flavorRef': '471240521'}}} Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3823, in _check_quota_for_upsize Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 02:03:34.495734 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4192, in resize Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3841, in _check_quota_for_upsize Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bfd4db7f-6969-4f11-84d3-922cf6cbbb96 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bfd4db7f-6969-4f11-84d3-922cf6cbbb96 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/2369ef96-a948-470b-966e-d07fd378af72/action" status: 403 len: 118 microversion: 2.1 time: 0.257160 Aug 07 02:03:34.499013 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3492/6519] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:03:34 2022] POST /compute/v2.1/servers/2369ef96-a948-470b-966e-d07fd378af72/action => generated 118 bytes in 258 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:03:34.506012 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-19ad2116-cbcd-44a3-ae74-fb69341e78d9 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:34.506772 n-d-master-1 devstack@n-api.service[119517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 02:03:34.506772 n-d-master-1 devstack@n-api.service[119517]: warnings.warn(msg) Aug 07 02:03:34.522512 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-19ad2116-cbcd-44a3-ae74-fb69341e78d9 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/471240521" status: 202 len: 0 microversion: 2.1 time: 0.020186 Aug 07 02:03:34.523085 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3028/6520] 10.222.0.39 () {58 vars in 1158 bytes} [Sun Aug 7 02:03:34 2022] DELETE /compute/v2.1/flavors/471240521 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:03:34.531171 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d4da1771-6e22-4695-aa57-01e9696cb4b9 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:34.551858 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d4da1771-6e22-4695-aa57-01e9696cb4b9 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024800 Aug 07 02:03:34.552441 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3493/6521] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 02:03:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:03:34.571188 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-be9b8f24-aaaa-4f2a-8c03-2244bb593429 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Calling method '.version_select at 0x7f9e24018160>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:34.645077 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-be9b8f24-aaaa-4f2a-8c03-2244bb593429 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/1e01ff8fff8c4201a8611847af0cb1d7" status: 200 len: 371 microversion: 2.1 time: 0.077528 Aug 07 02:03:34.645651 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3029/6522] 10.222.0.39 () {58 vars in 1242 bytes} [Sun Aug 7 02:03:34 2022] GET /compute/v2.1/os-quota-sets/1e01ff8fff8c4201a8611847af0cb1d7 => generated 371 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:03:34.657340 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a0cdbed4-1e31-4fba-9bd6-01379e6bcdb5 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1073263192", "id": 1237479084, "os-flavor-access:is_public": "True"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:03:34.660296 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 02:03:34.660296 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 02:03:34.676172 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a0cdbed4-1e31-4fba-9bd6-01379e6bcdb5 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.022525 Aug 07 02:03:34.676716 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3494/6523] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 02:03:34 2022] POST /compute/v2.1/flavors => generated 437 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:03:34.688128 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-96bcad24-6a74-4c44-9f87-e795c914dcb4 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1237479084"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:03:34.690498 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-96bcad24-6a74-4c44-9f87-e795c914dcb4 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] [instance: 2369ef96-a948-470b-966e-d07fd378af72] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:03:34.696531 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-96bcad24-6a74-4c44-9f87-e795c914dcb4 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:34.697005 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-96bcad24-6a74-4c44-9f87-e795c914dcb4 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:34.697446 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-96bcad24-6a74-4c44-9f87-e795c914dcb4 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:34.698179 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-96bcad24-6a74-4c44-9f87-e795c914dcb4 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:34.698642 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-96bcad24-6a74-4c44-9f87-e795c914dcb4 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:34.699074 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-96bcad24-6a74-4c44-9f87-e795c914dcb4 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:34.787688 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-96bcad24-6a74-4c44-9f87-e795c914dcb4 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b4d34308938a4d47abc305ba7865c246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e01ff8fff8c4201a8611847af0cb1d7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:03:34.794511 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-96bcad24-6a74-4c44-9f87-e795c914dcb4 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] [instance: 2369ef96-a948-470b-966e-d07fd378af72] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1073263192 {{(pid=119517) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 07 02:03:34.800813 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-96bcad24-6a74-4c44-9f87-e795c914dcb4 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:34.801297 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-96bcad24-6a74-4c44-9f87-e795c914dcb4 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:34.801735 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-96bcad24-6a74-4c44-9f87-e795c914dcb4 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:34.802470 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-96bcad24-6a74-4c44-9f87-e795c914dcb4 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:34.802925 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-96bcad24-6a74-4c44-9f87-e795c914dcb4 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:34.803356 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-96bcad24-6a74-4c44-9f87-e795c914dcb4 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:34.823204 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-96bcad24-6a74-4c44-9f87-e795c914dcb4 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Getting quotas for project 0ac14163d1ba44d08784c186c8006680. Resources: {'ram', 'cores'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:03:34.828764 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-96bcad24-6a74-4c44-9f87-e795c914dcb4 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Getting quotas for user 5384b291c32042858c6a4ae404085dfd and project 0ac14163d1ba44d08784c186c8006680. Resources: {'ram', 'cores'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:03:34.841138 n-d-master-1 devstack@n-api.service[119517]: INFO nova.compute.api [None req-96bcad24-6a74-4c44-9f87-e795c914dcb4 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] cores quota exceeded for 1e01ff8fff8c4201a8611847af0cb1d7, tried to resize instance. Aug 07 02:03:34.841935 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-96bcad24-6a74-4c44-9f87-e795c914dcb4 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-96bcad24-6a74-4c44-9f87-e795c914dcb4 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Request method failure captured: Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/servers/2369ef96-a948-470b-966e-d07fd378af72/action HTTP/1.1 Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 39 Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7x1qs23YjG1FYMwADWrqrWmAjE93dTilIImCu_cawZuqTYd39nbHevHXch2XMw8dm05K98r44TEkpfOeRpi-JGSmkOmEX2h5ssInx7p9vAsJHCUgMbKSW0CiXBRUcnI6e7-4LxnrPeJe2GGNzAmAm29gmhLe8VsqU5sKdyt74_WIyBQ Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 1e01ff8fff8c4201a8611847af0cb1d7 Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-288036669 Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,admin,member Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,admin,member Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1e01ff8fff8c4201a8611847af0cb1d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1e01ff8fff8c4201a8611847af0cb1d7", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1e01ff8fff8c4201a8611847af0cb1d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1e01ff8fff8c4201a8611847af0cb1d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersAdminNegativeTestJSON-288036669 Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 1e01ff8fff8c4201a8611847af0cb1d7 Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-288036669 Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersAdminNegativeTestJSON-288036669-project-admin Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: b4d34308938a4d47abc305ba7865c246 Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersAdminNegativeTestJSON-288036669-project-admin Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: {"resize": {"flavorRef": "1237479084"}} Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '2369ef96-a948-470b-966e-d07fd378af72', 'body': {'resize': {'flavorRef': '1237479084'}}} Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3823, in _check_quota_for_upsize Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 02:03:34.861394 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4192, in resize Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3841, in _check_quota_for_upsize Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-96bcad24-6a74-4c44-9f87-e795c914dcb4 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-96bcad24-6a74-4c44-9f87-e795c914dcb4 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/2369ef96-a948-470b-966e-d07fd378af72/action" status: 403 len: 113 microversion: 2.1 time: 0.178592 Aug 07 02:03:34.864642 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3030/6524] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:03:34 2022] POST /compute/v2.1/servers/2369ef96-a948-470b-966e-d07fd378af72/action => generated 113 bytes in 180 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 07 02:03:34.871910 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-90d419f5-484a-446f-a5b6-f578ab0db31a tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:34.872682 n-d-master-1 devstack@n-api.service[119516]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 02:03:34.872682 n-d-master-1 devstack@n-api.service[119516]: warnings.warn(msg) Aug 07 02:03:34.889444 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-90d419f5-484a-446f-a5b6-f578ab0db31a tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1237479084" status: 202 len: 0 microversion: 2.1 time: 0.021240 Aug 07 02:03:34.889990 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3495/6525] 10.222.0.39 () {58 vars in 1161 bytes} [Sun Aug 7 02:03:34 2022] DELETE /compute/v2.1/flavors/1237479084 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:03:34.897765 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f860becf-2c1b-49b9-b698-3c13b85d9001 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:34.921950 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f860becf-2c1b-49b9-b698-3c13b85d9001 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027770 Aug 07 02:03:34.922537 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3031/6526] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 02:03:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:03:34.942096 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-73010981-b174-48d4-8702-4fd374f8a6c0 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:34.942541 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-73010981-b174-48d4-8702-4fd374f8a6c0 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] [instance: 2369ef96-a948-470b-966e-d07fd378af72] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:03:34.948446 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73010981-b174-48d4-8702-4fd374f8a6c0 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:34.949444 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73010981-b174-48d4-8702-4fd374f8a6c0 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:34.949885 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73010981-b174-48d4-8702-4fd374f8a6c0 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:34.950587 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73010981-b174-48d4-8702-4fd374f8a6c0 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:34.951054 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73010981-b174-48d4-8702-4fd374f8a6c0 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:34.951489 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-73010981-b174-48d4-8702-4fd374f8a6c0 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:34.980677 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-73010981-b174-48d4-8702-4fd374f8a6c0 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] [instance: 2369ef96-a948-470b-966e-d07fd378af72] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 02:03:35.055533 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-73010981-b174-48d4-8702-4fd374f8a6c0 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2369ef96-a948-470b-966e-d07fd378af72" status: 204 len: 0 microversion: 2.1 time: 0.117321 Aug 07 02:03:35.056545 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3496/6527] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 02:03:34 2022] DELETE /compute/v2.1/servers/2369ef96-a948-470b-966e-d07fd378af72 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 02:03:35.064649 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2f79ee14-c644-48c0-abf9-ea017615cfc8 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:35.065486 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2f79ee14-c644-48c0-abf9-ea017615cfc8 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] [instance: 2369ef96-a948-470b-966e-d07fd378af72] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:03:35.071417 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f79ee14-c644-48c0-abf9-ea017615cfc8 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:35.071914 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f79ee14-c644-48c0-abf9-ea017615cfc8 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:35.072362 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f79ee14-c644-48c0-abf9-ea017615cfc8 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:35.073051 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f79ee14-c644-48c0-abf9-ea017615cfc8 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:35.074020 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f79ee14-c644-48c0-abf9-ea017615cfc8 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:35.074448 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f79ee14-c644-48c0-abf9-ea017615cfc8 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:35.214151 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2f79ee14-c644-48c0-abf9-ea017615cfc8 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5384b291c32042858c6a4ae404085dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac14163d1ba44d08784c186c8006680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:03:35.221706 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2f79ee14-c644-48c0-abf9-ea017615cfc8 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] 10.222.0.39 "GET /compute/v2.1/servers/2369ef96-a948-470b-966e-d07fd378af72" status: 200 len: 1477 microversion: 2.1 time: 0.160952 Aug 07 02:03:35.222284 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3032/6528] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:03:35 2022] GET /compute/v2.1/servers/2369ef96-a948-470b-966e-d07fd378af72 => generated 1477 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:03:36.243445 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-75b8037f-c907-42b8-9e08-552f36d6a138 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:36.244108 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-75b8037f-c907-42b8-9e08-552f36d6a138 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] [instance: 2369ef96-a948-470b-966e-d07fd378af72] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:03:36.250900 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75b8037f-c907-42b8-9e08-552f36d6a138 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:36.251403 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75b8037f-c907-42b8-9e08-552f36d6a138 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:36.251856 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75b8037f-c907-42b8-9e08-552f36d6a138 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:36.252632 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75b8037f-c907-42b8-9e08-552f36d6a138 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:36.253100 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75b8037f-c907-42b8-9e08-552f36d6a138 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:36.253543 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75b8037f-c907-42b8-9e08-552f36d6a138 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:36.382455 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-75b8037f-c907-42b8-9e08-552f36d6a138 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5384b291c32042858c6a4ae404085dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac14163d1ba44d08784c186c8006680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:03:36.390443 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-75b8037f-c907-42b8-9e08-552f36d6a138 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] 10.222.0.39 "GET /compute/v2.1/servers/2369ef96-a948-470b-966e-d07fd378af72" status: 200 len: 1477 microversion: 2.1 time: 0.151404 Aug 07 02:03:36.391008 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3497/6529] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:03:36 2022] GET /compute/v2.1/servers/2369ef96-a948-470b-966e-d07fd378af72 => generated 1477 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:03:36.918858 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-f529ec5f-180a-477a-99bf-ae5770de7e0c req-6bd64b61-0742-4245-915b-9964fbafcf8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2369ef96-a948-470b-966e-d07fd378af72", "name": "network-vif-deleted", "tag": "52518f7b-d0f4-41aa-84ae-5f2e7277af93"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:03:36.930111 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f529ec5f-180a-477a-99bf-ae5770de7e0c req-6bd64b61-0742-4245-915b-9964fbafcf8c service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:36.930771 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f529ec5f-180a-477a-99bf-ae5770de7e0c req-6bd64b61-0742-4245-915b-9964fbafcf8c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:36.931348 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f529ec5f-180a-477a-99bf-ae5770de7e0c req-6bd64b61-0742-4245-915b-9964fbafcf8c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:36.945898 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-f529ec5f-180a-477a-99bf-ae5770de7e0c req-6bd64b61-0742-4245-915b-9964fbafcf8c service nova] Creating event network-vif-deleted:52518f7b-d0f4-41aa-84ae-5f2e7277af93 for instance 2369ef96-a948-470b-966e-d07fd378af72 on n-h1-master-1 Aug 07 02:03:36.952264 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-f529ec5f-180a-477a-99bf-ae5770de7e0c req-6bd64b61-0742-4245-915b-9964fbafcf8c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036987 Aug 07 02:03:36.952881 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3033/6530] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:03:37.411812 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-17106cac-dbbf-4333-810f-aa606cf279e1 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:37.412507 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-17106cac-dbbf-4333-810f-aa606cf279e1 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] [instance: 2369ef96-a948-470b-966e-d07fd378af72] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:03:37.421267 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-17106cac-dbbf-4333-810f-aa606cf279e1 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:37.421832 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-17106cac-dbbf-4333-810f-aa606cf279e1 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:37.422387 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-17106cac-dbbf-4333-810f-aa606cf279e1 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:37.423307 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-17106cac-dbbf-4333-810f-aa606cf279e1 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:37.423564 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-17106cac-dbbf-4333-810f-aa606cf279e1 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:37.426856 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-17106cac-dbbf-4333-810f-aa606cf279e1 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:37.460272 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-17106cac-dbbf-4333-810f-aa606cf279e1 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:37.460778 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-17106cac-dbbf-4333-810f-aa606cf279e1 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:37.461234 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-17106cac-dbbf-4333-810f-aa606cf279e1 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:37.461856 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-17106cac-dbbf-4333-810f-aa606cf279e1 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lazy-loading 'fault' on Instance uuid 2369ef96-a948-470b-966e-d07fd378af72 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 02:03:37.506804 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-17106cac-dbbf-4333-810f-aa606cf279e1 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5384b291c32042858c6a4ae404085dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac14163d1ba44d08784c186c8006680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:03:37.513706 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-17106cac-dbbf-4333-810f-aa606cf279e1 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] 10.222.0.39 "GET /compute/v2.1/servers/2369ef96-a948-470b-966e-d07fd378af72" status: 200 len: 1311 microversion: 2.1 time: 0.105791 Aug 07 02:03:37.514268 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3498/6531] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:03:37 2022] GET /compute/v2.1/servers/2369ef96-a948-470b-966e-d07fd378af72 => generated 1311 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:03:38.536173 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4dfc9fb7-a090-4024-af1e-f7068aae71a8 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:38.536893 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4dfc9fb7-a090-4024-af1e-f7068aae71a8 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] [instance: 2369ef96-a948-470b-966e-d07fd378af72] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:03:38.543570 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4dfc9fb7-a090-4024-af1e-f7068aae71a8 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:38.544080 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4dfc9fb7-a090-4024-af1e-f7068aae71a8 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:38.544520 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4dfc9fb7-a090-4024-af1e-f7068aae71a8 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:38.545205 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4dfc9fb7-a090-4024-af1e-f7068aae71a8 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:38.545657 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4dfc9fb7-a090-4024-af1e-f7068aae71a8 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:38.546080 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4dfc9fb7-a090-4024-af1e-f7068aae71a8 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:38.559684 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-4dfc9fb7-a090-4024-af1e-f7068aae71a8 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] HTTP exception thrown: Instance 2369ef96-a948-470b-966e-d07fd378af72 could not be found. Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4dfc9fb7-a090-4024-af1e-f7068aae71a8 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Request method failure captured: Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/2369ef96-a948-470b-966e-d07fd378af72 HTTP/1.1 Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7x1qzw4HO20MatWeoPW_XqE5dSrlvI6EyO6QQLVRhZswImPJ8fqURbVrVZZ1hBLPox8unD1SsMOARWWE7HPhZoRdywYTnBlYujUpMDJa4fjXuFyuZUaAeRM_aDJkmYGIlJLFxeNlGgbKqpmbcDnBFAel799ygRAt1-7wH-JqNx9P-YY Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 0ac14163d1ba44d08784c186c8006680 Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1437752988 Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0ac14163d1ba44d08784c186c8006680"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0ac14163d1ba44d08784c186c8006680", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0ac14163d1ba44d08784c186c8006680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0ac14163d1ba44d08784c186c8006680"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1437752988 Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 0ac14163d1ba44d08784c186c8006680 Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1437752988 Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersAdminNegativeTestJSON-1437752988-project Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 5384b291c32042858c6a4ae404085dfd Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1437752988-project Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 2369ef96-a948-470b-966e-d07fd378af72 could not be found. Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '2369ef96-a948-470b-966e-d07fd378af72'} Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2369ef96-a948-470b-966e-d07fd378af72 could not be found. Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2369ef96-a948-470b-966e-d07fd378af72 could not be found. Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:03:38.561337 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:03:38.565068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:03:38.565068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:03:38.565068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:03:38.565068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:03:38.565068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:03:38.565068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:03:38.565068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2369ef96-a948-470b-966e-d07fd378af72 could not be found. Aug 07 02:03:38.565068 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:03:38.565068 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4dfc9fb7-a090-4024-af1e-f7068aae71a8 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] Returning 404 to user: Instance 2369ef96-a948-470b-966e-d07fd378af72 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:03:38.565068 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4dfc9fb7-a090-4024-af1e-f7068aae71a8 tempest-ServersAdminNegativeTestJSON-1437752988 tempest-ServersAdminNegativeTestJSON-1437752988-project] 10.222.0.39 "GET /compute/v2.1/servers/2369ef96-a948-470b-966e-d07fd378af72" status: 404 len: 111 microversion: 2.1 time: 0.031731 Aug 07 02:03:38.565967 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3034/6532] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:03:38 2022] GET /compute/v2.1/servers/2369ef96-a948-470b-966e-d07fd378af72 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:03:44.643866 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:44.645084 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:44.775432 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7576f6a1-e0a7-49f5-9326-bae54abe8737 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1053484371", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "70acdea2-dbbf-473b-a7d0-337d80d1bce8"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:03:44.834398 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-7576f6a1-e0a7-49f5-9326-bae54abe8737 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] validate_networks() for [('70acdea2-dbbf-473b-a7d0-337d80d1bce8', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 02:03:45.215586 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-7576f6a1-e0a7-49f5-9326-bae54abe8737 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 02:03:45.216055 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-7576f6a1-e0a7-49f5-9326-bae54abe8737 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 02:03:45.216548 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-7576f6a1-e0a7-49f5-9326-bae54abe8737 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 02:03:45.216973 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-7576f6a1-e0a7-49f5-9326-bae54abe8737 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 02:03:45.217401 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-7576f6a1-e0a7-49f5-9326-bae54abe8737 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 02:03:45.226139 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7576f6a1-e0a7-49f5-9326-bae54abe8737 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:45.226687 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7576f6a1-e0a7-49f5-9326-bae54abe8737 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:45.227168 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7576f6a1-e0a7-49f5-9326-bae54abe8737 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:45.227823 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7576f6a1-e0a7-49f5-9326-bae54abe8737 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:45.228319 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7576f6a1-e0a7-49f5-9326-bae54abe8737 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:45.228760 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7576f6a1-e0a7-49f5-9326-bae54abe8737 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:45.253840 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-7576f6a1-e0a7-49f5-9326-bae54abe8737 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Getting quotas for project b0ca203fa389466e842ed965f1140524. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:03:45.259432 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-7576f6a1-e0a7-49f5-9326-bae54abe8737 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Getting quotas for user 19fc9bbd5d8045e5b558de2386d73d93 and project b0ca203fa389466e842ed965f1140524. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:03:45.272949 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7576f6a1-e0a7-49f5-9326-bae54abe8737 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 02:03:45.275238 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7576f6a1-e0a7-49f5-9326-bae54abe8737 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 02:03:45.320213 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7576f6a1-e0a7-49f5-9326-bae54abe8737 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.683848 Aug 07 02:03:45.320865 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3499/6533] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 02:03:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 02:03:45.333519 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-85704b39-6026-44dd-97b9-7e4559452ada tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:45.334267 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-85704b39-6026-44dd-97b9-7e4559452ada tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:03:45.336808 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:45.337681 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:45.398157 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-85704b39-6026-44dd-97b9-7e4559452ada tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:03:45.406410 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-85704b39-6026-44dd-97b9-7e4559452ada tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1215 microversion: 2.1 time: 0.077006 Aug 07 02:03:45.407699 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3035/6534] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:03:45 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1215 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:03:46.428584 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ea5a86d8-a9ce-4e05-b5c8-d1e70764aca6 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:46.429994 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ea5a86d8-a9ce-4e05-b5c8-d1e70764aca6 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:03:46.437297 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea5a86d8-a9ce-4e05-b5c8-d1e70764aca6 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:46.438155 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea5a86d8-a9ce-4e05-b5c8-d1e70764aca6 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:46.438771 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea5a86d8-a9ce-4e05-b5c8-d1e70764aca6 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:46.439781 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea5a86d8-a9ce-4e05-b5c8-d1e70764aca6 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:46.440407 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea5a86d8-a9ce-4e05-b5c8-d1e70764aca6 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:46.441003 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea5a86d8-a9ce-4e05-b5c8-d1e70764aca6 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:46.550998 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ea5a86d8-a9ce-4e05-b5c8-d1e70764aca6 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:03:46.566314 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ea5a86d8-a9ce-4e05-b5c8-d1e70764aca6 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1267 microversion: 2.1 time: 0.141632 Aug 07 02:03:46.576423 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3500/6535] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:03:46 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:03:47.589910 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ca82f729-6111-43a8-a72b-2f9fa463d5e2 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:47.591115 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ca82f729-6111-43a8-a72b-2f9fa463d5e2 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:03:47.600747 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca82f729-6111-43a8-a72b-2f9fa463d5e2 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:47.601239 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca82f729-6111-43a8-a72b-2f9fa463d5e2 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:47.601673 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca82f729-6111-43a8-a72b-2f9fa463d5e2 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:47.602387 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca82f729-6111-43a8-a72b-2f9fa463d5e2 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:47.602843 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca82f729-6111-43a8-a72b-2f9fa463d5e2 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:47.603269 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca82f729-6111-43a8-a72b-2f9fa463d5e2 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:47.771790 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ca82f729-6111-43a8-a72b-2f9fa463d5e2 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:03:47.780679 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ca82f729-6111-43a8-a72b-2f9fa463d5e2 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1315 microversion: 2.1 time: 0.194794 Aug 07 02:03:47.781425 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3036/6536] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:03:47 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:03:48.247447 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-9a41cba8-2322-441d-a213-e813cbf6fa1d req-adf14768-9d04-4b40-b7e5-bb2cb603728f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f622bbd5-faeb-4be7-a93c-a29439f2a992", "tag": "72ce8472-4e07-4222-956d-d256c138828a"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:03:48.259550 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-9a41cba8-2322-441d-a213-e813cbf6fa1d req-adf14768-9d04-4b40-b7e5-bb2cb603728f service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:48.260139 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-9a41cba8-2322-441d-a213-e813cbf6fa1d req-adf14768-9d04-4b40-b7e5-bb2cb603728f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:48.261152 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-9a41cba8-2322-441d-a213-e813cbf6fa1d req-adf14768-9d04-4b40-b7e5-bb2cb603728f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:48.272939 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-9a41cba8-2322-441d-a213-e813cbf6fa1d req-adf14768-9d04-4b40-b7e5-bb2cb603728f service nova] Creating event network-changed:72ce8472-4e07-4222-956d-d256c138828a for instance f622bbd5-faeb-4be7-a93c-a29439f2a992 on n-h1-master-1 Aug 07 02:03:48.278098 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-9a41cba8-2322-441d-a213-e813cbf6fa1d req-adf14768-9d04-4b40-b7e5-bb2cb603728f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035002 Aug 07 02:03:48.278849 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3501/6537] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:03:48.802454 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bf0a0dee-aea6-4d90-8b5e-4a4f7ce3aed6 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:48.802828 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bf0a0dee-aea6-4d90-8b5e-4a4f7ce3aed6 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:03:48.810397 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf0a0dee-aea6-4d90-8b5e-4a4f7ce3aed6 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:48.810943 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf0a0dee-aea6-4d90-8b5e-4a4f7ce3aed6 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:48.811413 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf0a0dee-aea6-4d90-8b5e-4a4f7ce3aed6 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:48.812231 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf0a0dee-aea6-4d90-8b5e-4a4f7ce3aed6 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:48.812697 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf0a0dee-aea6-4d90-8b5e-4a4f7ce3aed6 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:48.813131 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bf0a0dee-aea6-4d90-8b5e-4a4f7ce3aed6 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:48.951207 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bf0a0dee-aea6-4d90-8b5e-4a4f7ce3aed6 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:03:48.959348 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bf0a0dee-aea6-4d90-8b5e-4a4f7ce3aed6 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1315 microversion: 2.1 time: 0.161381 Aug 07 02:03:48.959943 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3037/6538] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:03:48 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:03:49.981514 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-085c485f-046e-4748-a856-48ddca66ae73 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:49.983034 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-085c485f-046e-4748-a856-48ddca66ae73 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:03:49.990636 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-085c485f-046e-4748-a856-48ddca66ae73 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:49.991129 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-085c485f-046e-4748-a856-48ddca66ae73 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:49.991581 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-085c485f-046e-4748-a856-48ddca66ae73 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:49.992323 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-085c485f-046e-4748-a856-48ddca66ae73 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:49.992790 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-085c485f-046e-4748-a856-48ddca66ae73 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:49.993223 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-085c485f-046e-4748-a856-48ddca66ae73 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:50.121732 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-085c485f-046e-4748-a856-48ddca66ae73 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:03:50.129270 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-085c485f-046e-4748-a856-48ddca66ae73 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1315 microversion: 2.1 time: 0.152925 Aug 07 02:03:50.129852 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3502/6539] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:03:49 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:03:51.150521 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-81200be8-12b0-4763-bfb8-b0b18613d6ea tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:51.151636 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-81200be8-12b0-4763-bfb8-b0b18613d6ea tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:03:51.158509 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-81200be8-12b0-4763-bfb8-b0b18613d6ea tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:51.158976 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-81200be8-12b0-4763-bfb8-b0b18613d6ea tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:51.159418 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-81200be8-12b0-4763-bfb8-b0b18613d6ea tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:51.160143 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-81200be8-12b0-4763-bfb8-b0b18613d6ea tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:51.160605 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-81200be8-12b0-4763-bfb8-b0b18613d6ea tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:51.161037 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-81200be8-12b0-4763-bfb8-b0b18613d6ea tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:51.286362 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-81200be8-12b0-4763-bfb8-b0b18613d6ea tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:03:51.294527 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-81200be8-12b0-4763-bfb8-b0b18613d6ea tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1315 microversion: 2.1 time: 0.147925 Aug 07 02:03:51.295098 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3038/6540] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:03:51 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:03:52.314955 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fc539a98-e858-4787-9859-3ad136e3a3e3 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:52.315524 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fc539a98-e858-4787-9859-3ad136e3a3e3 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:03:52.322580 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc539a98-e858-4787-9859-3ad136e3a3e3 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:52.323066 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc539a98-e858-4787-9859-3ad136e3a3e3 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:52.323511 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc539a98-e858-4787-9859-3ad136e3a3e3 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:52.324249 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc539a98-e858-4787-9859-3ad136e3a3e3 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:52.324805 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc539a98-e858-4787-9859-3ad136e3a3e3 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:52.325238 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc539a98-e858-4787-9859-3ad136e3a3e3 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:52.471010 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fc539a98-e858-4787-9859-3ad136e3a3e3 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:03:52.479775 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fc539a98-e858-4787-9859-3ad136e3a3e3 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1315 microversion: 2.1 time: 0.168303 Aug 07 02:03:52.480377 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3503/6541] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:03:52 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:03:53.503014 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f079c935-e80c-4967-9ed1-d491c0258e8f tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:53.504092 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f079c935-e80c-4967-9ed1-d491c0258e8f tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:03:53.506908 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:53.514296 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f079c935-e80c-4967-9ed1-d491c0258e8f tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:53.514931 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f079c935-e80c-4967-9ed1-d491c0258e8f tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:53.515673 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f079c935-e80c-4967-9ed1-d491c0258e8f tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:53.516646 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f079c935-e80c-4967-9ed1-d491c0258e8f tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:53.517202 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f079c935-e80c-4967-9ed1-d491c0258e8f tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:53.518072 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f079c935-e80c-4967-9ed1-d491c0258e8f tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:53.521375 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=72 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:53.626578 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-c81c9e87-6870-42c8-96f9-0a4ee08de7e9 req-5769f301-32e9-4452-85f4-58a06e20436a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f622bbd5-faeb-4be7-a93c-a29439f2a992", "name": "network-vif-plugged", "status": "completed", "tag": "72ce8472-4e07-4222-956d-d256c138828a"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:03:53.633777 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:53.640363 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c81c9e87-6870-42c8-96f9-0a4ee08de7e9 req-5769f301-32e9-4452-85f4-58a06e20436a service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:53.640773 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c81c9e87-6870-42c8-96f9-0a4ee08de7e9 req-5769f301-32e9-4452-85f4-58a06e20436a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:53.641321 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c81c9e87-6870-42c8-96f9-0a4ee08de7e9 req-5769f301-32e9-4452-85f4-58a06e20436a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:53.647334 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:53.656748 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f079c935-e80c-4967-9ed1-d491c0258e8f tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:03:53.658281 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-c81c9e87-6870-42c8-96f9-0a4ee08de7e9 req-5769f301-32e9-4452-85f4-58a06e20436a service nova] Creating event network-vif-plugged:72ce8472-4e07-4222-956d-d256c138828a for instance f622bbd5-faeb-4be7-a93c-a29439f2a992 on n-h1-master-1 Aug 07 02:03:53.664144 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-c81c9e87-6870-42c8-96f9-0a4ee08de7e9 req-5769f301-32e9-4452-85f4-58a06e20436a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042490 Aug 07 02:03:53.664927 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3504/6542] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 02:03:53.667177 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f079c935-e80c-4967-9ed1-d491c0258e8f tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1315 microversion: 2.1 time: 0.168570 Aug 07 02:03:53.667830 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3039/6543] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:03:53 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:03:54.688468 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b95d9e12-b931-43ca-8236-2ce9e736d6b4 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:54.689096 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b95d9e12-b931-43ca-8236-2ce9e736d6b4 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:03:54.700643 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b95d9e12-b931-43ca-8236-2ce9e736d6b4 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:54.701147 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b95d9e12-b931-43ca-8236-2ce9e736d6b4 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:54.701595 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b95d9e12-b931-43ca-8236-2ce9e736d6b4 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:54.702323 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b95d9e12-b931-43ca-8236-2ce9e736d6b4 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:54.702790 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b95d9e12-b931-43ca-8236-2ce9e736d6b4 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:54.703231 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b95d9e12-b931-43ca-8236-2ce9e736d6b4 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:54.841251 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b95d9e12-b931-43ca-8236-2ce9e736d6b4 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:03:54.848795 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b95d9e12-b931-43ca-8236-2ce9e736d6b4 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1315 microversion: 2.1 time: 0.164766 Aug 07 02:03:54.849371 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3505/6544] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:03:54 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:03:55.869784 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-475e5001-117f-44b7-bc9b-63421ef8c0a2 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:55.870406 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-475e5001-117f-44b7-bc9b-63421ef8c0a2 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:03:55.873329 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:55.878816 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-475e5001-117f-44b7-bc9b-63421ef8c0a2 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:55.879298 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-475e5001-117f-44b7-bc9b-63421ef8c0a2 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:55.879738 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-475e5001-117f-44b7-bc9b-63421ef8c0a2 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:55.880513 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-475e5001-117f-44b7-bc9b-63421ef8c0a2 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:55.881019 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-475e5001-117f-44b7-bc9b-63421ef8c0a2 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:55.881449 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-475e5001-117f-44b7-bc9b-63421ef8c0a2 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:56.019043 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-475e5001-117f-44b7-bc9b-63421ef8c0a2 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:03:56.027361 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-475e5001-117f-44b7-bc9b-63421ef8c0a2 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1502 microversion: 2.1 time: 0.161905 Aug 07 02:03:56.027948 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3040/6545] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:03:55 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:03:56.048458 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1dff7673-4c40-46cd-a918-492b5baa89cc tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:03:56.050684 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1dff7673-4c40-46cd-a918-492b5baa89cc tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:03:56.052704 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:56.053400 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:56.060743 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1dff7673-4c40-46cd-a918-492b5baa89cc tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:56.061248 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1dff7673-4c40-46cd-a918-492b5baa89cc tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:56.061707 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1dff7673-4c40-46cd-a918-492b5baa89cc tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:56.062420 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1dff7673-4c40-46cd-a918-492b5baa89cc tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:56.062901 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1dff7673-4c40-46cd-a918-492b5baa89cc tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:56.063350 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1dff7673-4c40-46cd-a918-492b5baa89cc tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:56.091215 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1dff7673-4c40-46cd-a918-492b5baa89cc tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:03:56.096898 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1dff7673-4c40-46cd-a918-492b5baa89cc tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Old instance type m1.heat2, new instance type m1.heat {{(pid=119516) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 07 02:03:56.103038 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-1dff7673-4c40-46cd-a918-492b5baa89cc tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 02:03:56.103481 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-1dff7673-4c40-46cd-a918-492b5baa89cc tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 02:03:56.104545 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-1dff7673-4c40-46cd-a918-492b5baa89cc tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 02:03:56.104973 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-1dff7673-4c40-46cd-a918-492b5baa89cc tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 02:03:56.105404 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-1dff7673-4c40-46cd-a918-492b5baa89cc tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 02:03:56.167295 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1dff7673-4c40-46cd-a918-492b5baa89cc tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "POST /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992/action" status: 202 len: 0 microversion: 2.1 time: 0.122149 Aug 07 02:03:56.168104 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3506/6546] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:03:56 2022] POST /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:03:56.175872 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6450655c-f934-4c3a-9cad-81349a77a101 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:56.176515 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6450655c-f934-4c3a-9cad-81349a77a101 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:03:56.182478 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6450655c-f934-4c3a-9cad-81349a77a101 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:56.182968 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6450655c-f934-4c3a-9cad-81349a77a101 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:56.183411 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6450655c-f934-4c3a-9cad-81349a77a101 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:56.184178 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6450655c-f934-4c3a-9cad-81349a77a101 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:56.184643 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6450655c-f934-4c3a-9cad-81349a77a101 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:56.185070 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6450655c-f934-4c3a-9cad-81349a77a101 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:56.353048 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6450655c-f934-4c3a-9cad-81349a77a101 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:03:56.361750 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6450655c-f934-4c3a-9cad-81349a77a101 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1511 microversion: 2.1 time: 0.189511 Aug 07 02:03:56.362497 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3041/6547] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:03:56 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1511 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:03:57.384834 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-43f1eb02-e3d5-4948-8f9a-0419b7042b13 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:57.385387 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-43f1eb02-e3d5-4948-8f9a-0419b7042b13 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:03:57.391994 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43f1eb02-e3d5-4948-8f9a-0419b7042b13 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:57.392495 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43f1eb02-e3d5-4948-8f9a-0419b7042b13 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:57.392955 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43f1eb02-e3d5-4948-8f9a-0419b7042b13 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:57.393667 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43f1eb02-e3d5-4948-8f9a-0419b7042b13 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:57.394169 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43f1eb02-e3d5-4948-8f9a-0419b7042b13 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:57.394644 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-43f1eb02-e3d5-4948-8f9a-0419b7042b13 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:57.525350 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-43f1eb02-e3d5-4948-8f9a-0419b7042b13 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:03:57.534454 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-43f1eb02-e3d5-4948-8f9a-0419b7042b13 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1511 microversion: 2.1 time: 0.154671 Aug 07 02:03:57.535033 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3507/6548] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:03:57 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:03:58.554677 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2d061fe7-5299-47e3-a575-614b83b57d2d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:58.555227 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2d061fe7-5299-47e3-a575-614b83b57d2d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:03:58.562148 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d061fe7-5299-47e3-a575-614b83b57d2d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:58.562634 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d061fe7-5299-47e3-a575-614b83b57d2d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:58.563082 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d061fe7-5299-47e3-a575-614b83b57d2d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:58.563804 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d061fe7-5299-47e3-a575-614b83b57d2d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:58.564292 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d061fe7-5299-47e3-a575-614b83b57d2d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:58.564722 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d061fe7-5299-47e3-a575-614b83b57d2d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:58.691129 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2d061fe7-5299-47e3-a575-614b83b57d2d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:03:58.698693 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2d061fe7-5299-47e3-a575-614b83b57d2d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1516 microversion: 2.1 time: 0.148022 Aug 07 02:03:58.699270 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3042/6549] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:03:58 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1516 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:03:59.720449 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d58b30c2-67cd-4792-a131-85430794fcff tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:03:59.721080 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d58b30c2-67cd-4792-a131-85430794fcff tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:03:59.728261 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d58b30c2-67cd-4792-a131-85430794fcff tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:59.728768 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d58b30c2-67cd-4792-a131-85430794fcff tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:59.729225 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d58b30c2-67cd-4792-a131-85430794fcff tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:59.729943 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d58b30c2-67cd-4792-a131-85430794fcff tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:03:59.730417 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d58b30c2-67cd-4792-a131-85430794fcff tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:03:59.730858 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d58b30c2-67cd-4792-a131-85430794fcff tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:03:59.859292 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d58b30c2-67cd-4792-a131-85430794fcff tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:03:59.866837 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d58b30c2-67cd-4792-a131-85430794fcff tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1516 microversion: 2.1 time: 0.150383 Aug 07 02:03:59.867406 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3508/6550] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:03:59 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:00.888330 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f97b35e8-510b-4992-9f0f-9f8aec84ba7b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:00.888957 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f97b35e8-510b-4992-9f0f-9f8aec84ba7b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:00.895804 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f97b35e8-510b-4992-9f0f-9f8aec84ba7b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:00.896328 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f97b35e8-510b-4992-9f0f-9f8aec84ba7b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:00.896802 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f97b35e8-510b-4992-9f0f-9f8aec84ba7b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:00.897501 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f97b35e8-510b-4992-9f0f-9f8aec84ba7b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:00.897963 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f97b35e8-510b-4992-9f0f-9f8aec84ba7b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:00.898395 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f97b35e8-510b-4992-9f0f-9f8aec84ba7b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:01.034938 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f97b35e8-510b-4992-9f0f-9f8aec84ba7b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:01.043047 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f97b35e8-510b-4992-9f0f-9f8aec84ba7b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1516 microversion: 2.1 time: 0.159250 Aug 07 02:04:01.043626 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3043/6551] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:00 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:02.064983 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e310517d-120e-44ee-9735-8e112c67d54a tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:02.065542 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e310517d-120e-44ee-9735-8e112c67d54a tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:02.072485 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e310517d-120e-44ee-9735-8e112c67d54a tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:02.073005 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e310517d-120e-44ee-9735-8e112c67d54a tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:02.073439 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e310517d-120e-44ee-9735-8e112c67d54a tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:02.074153 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e310517d-120e-44ee-9735-8e112c67d54a tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:02.074625 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e310517d-120e-44ee-9735-8e112c67d54a tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:02.075070 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e310517d-120e-44ee-9735-8e112c67d54a tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:02.210157 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e310517d-120e-44ee-9735-8e112c67d54a tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:02.218458 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e310517d-120e-44ee-9735-8e112c67d54a tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1516 microversion: 2.1 time: 0.157476 Aug 07 02:04:02.219045 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3509/6552] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:02 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:03.240205 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1980b6b9-7adf-4ace-955d-a3895ac13002 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:03.240758 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1980b6b9-7adf-4ace-955d-a3895ac13002 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:03.248279 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1980b6b9-7adf-4ace-955d-a3895ac13002 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:03.248761 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1980b6b9-7adf-4ace-955d-a3895ac13002 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:03.249200 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1980b6b9-7adf-4ace-955d-a3895ac13002 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:03.249893 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1980b6b9-7adf-4ace-955d-a3895ac13002 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:03.250350 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1980b6b9-7adf-4ace-955d-a3895ac13002 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:03.250784 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1980b6b9-7adf-4ace-955d-a3895ac13002 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:03.377957 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1980b6b9-7adf-4ace-955d-a3895ac13002 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:03.385454 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1980b6b9-7adf-4ace-955d-a3895ac13002 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1516 microversion: 2.1 time: 0.149272 Aug 07 02:04:03.386024 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3044/6553] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:03 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:04.406991 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-71808888-2f3e-40f7-ad5d-3cdc49970c32 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:04.407613 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-71808888-2f3e-40f7-ad5d-3cdc49970c32 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:04.414501 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-71808888-2f3e-40f7-ad5d-3cdc49970c32 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:04.414993 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-71808888-2f3e-40f7-ad5d-3cdc49970c32 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:04.415437 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-71808888-2f3e-40f7-ad5d-3cdc49970c32 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:04.416174 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-71808888-2f3e-40f7-ad5d-3cdc49970c32 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:04.416636 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-71808888-2f3e-40f7-ad5d-3cdc49970c32 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:04.417754 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-71808888-2f3e-40f7-ad5d-3cdc49970c32 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:04.545366 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-71808888-2f3e-40f7-ad5d-3cdc49970c32 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:04.553255 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-71808888-2f3e-40f7-ad5d-3cdc49970c32 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1516 microversion: 2.1 time: 0.150234 Aug 07 02:04:04.553899 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3510/6554] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:04 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:05.575255 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2b9f108f-a85a-4448-81ff-c8a523f8ddd3 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:05.575904 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2b9f108f-a85a-4448-81ff-c8a523f8ddd3 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:05.582752 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b9f108f-a85a-4448-81ff-c8a523f8ddd3 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:05.583353 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b9f108f-a85a-4448-81ff-c8a523f8ddd3 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:05.583839 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b9f108f-a85a-4448-81ff-c8a523f8ddd3 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:05.584593 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b9f108f-a85a-4448-81ff-c8a523f8ddd3 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:05.585187 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b9f108f-a85a-4448-81ff-c8a523f8ddd3 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:05.585678 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b9f108f-a85a-4448-81ff-c8a523f8ddd3 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:05.716320 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2b9f108f-a85a-4448-81ff-c8a523f8ddd3 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:05.723825 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2b9f108f-a85a-4448-81ff-c8a523f8ddd3 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1516 microversion: 2.1 time: 0.153112 Aug 07 02:04:05.724423 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3045/6555] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:05 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:06.745066 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b65560b9-d8a6-446b-84de-ce055ed88b34 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:06.745693 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b65560b9-d8a6-446b-84de-ce055ed88b34 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:06.752693 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b65560b9-d8a6-446b-84de-ce055ed88b34 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:06.753187 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b65560b9-d8a6-446b-84de-ce055ed88b34 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:06.753637 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b65560b9-d8a6-446b-84de-ce055ed88b34 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:06.754347 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b65560b9-d8a6-446b-84de-ce055ed88b34 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:06.754818 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b65560b9-d8a6-446b-84de-ce055ed88b34 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:06.755260 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b65560b9-d8a6-446b-84de-ce055ed88b34 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:06.887699 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b65560b9-d8a6-446b-84de-ce055ed88b34 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:06.895264 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b65560b9-d8a6-446b-84de-ce055ed88b34 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1516 microversion: 2.1 time: 0.154109 Aug 07 02:04:06.895825 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3511/6556] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:06 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:07.917220 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8fb12258-6a86-4660-abfe-10eecb44efb0 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:07.926987 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8fb12258-6a86-4660-abfe-10eecb44efb0 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:07.926987 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8fb12258-6a86-4660-abfe-10eecb44efb0 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:07.927193 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8fb12258-6a86-4660-abfe-10eecb44efb0 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:07.927566 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8fb12258-6a86-4660-abfe-10eecb44efb0 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:07.928302 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8fb12258-6a86-4660-abfe-10eecb44efb0 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:07.928756 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8fb12258-6a86-4660-abfe-10eecb44efb0 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:07.929187 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8fb12258-6a86-4660-abfe-10eecb44efb0 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:08.062859 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8fb12258-6a86-4660-abfe-10eecb44efb0 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:08.070400 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8fb12258-6a86-4660-abfe-10eecb44efb0 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1516 microversion: 2.1 time: 0.157794 Aug 07 02:04:08.070967 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3046/6557] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:07 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:09.091970 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5bc31733-c77c-444a-955a-280fb69fdf01 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:09.092615 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5bc31733-c77c-444a-955a-280fb69fdf01 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:09.099523 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5bc31733-c77c-444a-955a-280fb69fdf01 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:09.100052 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5bc31733-c77c-444a-955a-280fb69fdf01 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:09.100511 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5bc31733-c77c-444a-955a-280fb69fdf01 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:09.101221 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5bc31733-c77c-444a-955a-280fb69fdf01 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:09.101691 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5bc31733-c77c-444a-955a-280fb69fdf01 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:09.102134 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5bc31733-c77c-444a-955a-280fb69fdf01 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:09.228535 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5bc31733-c77c-444a-955a-280fb69fdf01 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:09.236961 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5bc31733-c77c-444a-955a-280fb69fdf01 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1516 microversion: 2.1 time: 0.149402 Aug 07 02:04:09.237539 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3512/6558] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:09 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:10.257287 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3bfb0639-caee-4d76-90c2-21a379efbf9f tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:10.257798 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3bfb0639-caee-4d76-90c2-21a379efbf9f tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:10.264699 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3bfb0639-caee-4d76-90c2-21a379efbf9f tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:10.265181 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3bfb0639-caee-4d76-90c2-21a379efbf9f tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:10.265614 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3bfb0639-caee-4d76-90c2-21a379efbf9f tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:10.266298 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3bfb0639-caee-4d76-90c2-21a379efbf9f tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:10.266748 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3bfb0639-caee-4d76-90c2-21a379efbf9f tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:10.267166 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3bfb0639-caee-4d76-90c2-21a379efbf9f tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:10.404832 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3bfb0639-caee-4d76-90c2-21a379efbf9f tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:10.412453 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3bfb0639-caee-4d76-90c2-21a379efbf9f tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1516 microversion: 2.1 time: 0.159167 Aug 07 02:04:10.413025 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3047/6559] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:10 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:11.434612 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6e1e0f9a-decb-4e9c-9528-f5a518d9f8ba tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:11.435371 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6e1e0f9a-decb-4e9c-9528-f5a518d9f8ba tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:11.442258 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e1e0f9a-decb-4e9c-9528-f5a518d9f8ba tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:11.442776 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e1e0f9a-decb-4e9c-9528-f5a518d9f8ba tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:11.443228 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e1e0f9a-decb-4e9c-9528-f5a518d9f8ba tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:11.443984 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e1e0f9a-decb-4e9c-9528-f5a518d9f8ba tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:11.444464 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e1e0f9a-decb-4e9c-9528-f5a518d9f8ba tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:11.444935 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e1e0f9a-decb-4e9c-9528-f5a518d9f8ba tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:11.644857 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6e1e0f9a-decb-4e9c-9528-f5a518d9f8ba tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:11.652595 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6e1e0f9a-decb-4e9c-9528-f5a518d9f8ba tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1516 microversion: 2.1 time: 0.222463 Aug 07 02:04:11.653171 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3513/6560] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:11 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1516 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:12.673796 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1a129fae-65e0-4a25-8497-9be9042bb1e0 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:12.674321 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1a129fae-65e0-4a25-8497-9be9042bb1e0 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:12.681022 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1a129fae-65e0-4a25-8497-9be9042bb1e0 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:12.681524 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1a129fae-65e0-4a25-8497-9be9042bb1e0 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:12.681958 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1a129fae-65e0-4a25-8497-9be9042bb1e0 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:12.683135 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1a129fae-65e0-4a25-8497-9be9042bb1e0 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:12.683584 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1a129fae-65e0-4a25-8497-9be9042bb1e0 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:12.684028 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1a129fae-65e0-4a25-8497-9be9042bb1e0 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:12.813429 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1a129fae-65e0-4a25-8497-9be9042bb1e0 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:12.820871 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1a129fae-65e0-4a25-8497-9be9042bb1e0 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1516 microversion: 2.1 time: 0.151175 Aug 07 02:04:12.821437 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3048/6561] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:12 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:13.842685 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-51bec87f-8cb3-45c6-a34e-498ba3be679d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:13.843320 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-51bec87f-8cb3-45c6-a34e-498ba3be679d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:13.849870 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51bec87f-8cb3-45c6-a34e-498ba3be679d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:13.850371 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51bec87f-8cb3-45c6-a34e-498ba3be679d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:13.850827 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51bec87f-8cb3-45c6-a34e-498ba3be679d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:13.851551 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51bec87f-8cb3-45c6-a34e-498ba3be679d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:13.852052 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51bec87f-8cb3-45c6-a34e-498ba3be679d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:13.852509 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51bec87f-8cb3-45c6-a34e-498ba3be679d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:13.984716 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-51bec87f-8cb3-45c6-a34e-498ba3be679d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:13.992382 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-51bec87f-8cb3-45c6-a34e-498ba3be679d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1516 microversion: 2.1 time: 0.154306 Aug 07 02:04:13.992955 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3514/6562] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:13 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:15.013289 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-518d01e9-d576-4f53-afb1-3c28f407024d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:15.013906 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-518d01e9-d576-4f53-afb1-3c28f407024d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:15.020468 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-518d01e9-d576-4f53-afb1-3c28f407024d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:15.020945 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-518d01e9-d576-4f53-afb1-3c28f407024d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:15.021376 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-518d01e9-d576-4f53-afb1-3c28f407024d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:15.022064 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-518d01e9-d576-4f53-afb1-3c28f407024d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:15.022513 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-518d01e9-d576-4f53-afb1-3c28f407024d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:15.022935 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-518d01e9-d576-4f53-afb1-3c28f407024d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:15.148995 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-518d01e9-d576-4f53-afb1-3c28f407024d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:15.156940 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-518d01e9-d576-4f53-afb1-3c28f407024d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1516 microversion: 2.1 time: 0.147727 Aug 07 02:04:15.157508 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3049/6563] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:15 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1516 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:16.177212 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f27c65b2-5c7c-4cf9-9c14-d1fe2d6ab39b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:16.177844 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f27c65b2-5c7c-4cf9-9c14-d1fe2d6ab39b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:16.184515 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f27c65b2-5c7c-4cf9-9c14-d1fe2d6ab39b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:16.185010 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f27c65b2-5c7c-4cf9-9c14-d1fe2d6ab39b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:16.185490 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f27c65b2-5c7c-4cf9-9c14-d1fe2d6ab39b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:16.186200 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f27c65b2-5c7c-4cf9-9c14-d1fe2d6ab39b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:16.186668 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f27c65b2-5c7c-4cf9-9c14-d1fe2d6ab39b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:16.187112 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f27c65b2-5c7c-4cf9-9c14-d1fe2d6ab39b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:16.321047 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f27c65b2-5c7c-4cf9-9c14-d1fe2d6ab39b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:16.329155 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f27c65b2-5c7c-4cf9-9c14-d1fe2d6ab39b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1516 microversion: 2.1 time: 0.155859 Aug 07 02:04:16.329722 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3515/6564] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:16 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:17.350583 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0c10677f-c643-4ae1-8c97-0aaae530e57e tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:17.351200 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0c10677f-c643-4ae1-8c97-0aaae530e57e tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:17.359005 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0c10677f-c643-4ae1-8c97-0aaae530e57e tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:17.359482 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0c10677f-c643-4ae1-8c97-0aaae530e57e tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:17.359940 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0c10677f-c643-4ae1-8c97-0aaae530e57e tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:17.360629 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0c10677f-c643-4ae1-8c97-0aaae530e57e tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:17.361079 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0c10677f-c643-4ae1-8c97-0aaae530e57e tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:17.361501 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0c10677f-c643-4ae1-8c97-0aaae530e57e tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:17.497899 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0c10677f-c643-4ae1-8c97-0aaae530e57e tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:17.504753 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0c10677f-c643-4ae1-8c97-0aaae530e57e tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1516 microversion: 2.1 time: 0.158030 Aug 07 02:04:17.505335 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3050/6565] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:17 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:18.527155 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-41f05d74-4990-4f88-a22f-e8b29bc414ff tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:18.527790 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-41f05d74-4990-4f88-a22f-e8b29bc414ff tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:18.535021 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-41f05d74-4990-4f88-a22f-e8b29bc414ff tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:18.535521 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-41f05d74-4990-4f88-a22f-e8b29bc414ff tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:18.536006 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-41f05d74-4990-4f88-a22f-e8b29bc414ff tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:18.536760 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-41f05d74-4990-4f88-a22f-e8b29bc414ff tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:18.537259 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-41f05d74-4990-4f88-a22f-e8b29bc414ff tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:18.537704 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-41f05d74-4990-4f88-a22f-e8b29bc414ff tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:18.671490 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-41f05d74-4990-4f88-a22f-e8b29bc414ff tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:18.679109 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-41f05d74-4990-4f88-a22f-e8b29bc414ff tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1516 microversion: 2.1 time: 0.155947 Aug 07 02:04:18.679683 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3516/6566] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:18 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:19.700703 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3ec20c7e-c11d-4e42-98b2-ae55f7934fd8 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:19.701312 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3ec20c7e-c11d-4e42-98b2-ae55f7934fd8 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:19.708371 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ec20c7e-c11d-4e42-98b2-ae55f7934fd8 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:19.708846 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ec20c7e-c11d-4e42-98b2-ae55f7934fd8 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:19.709279 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ec20c7e-c11d-4e42-98b2-ae55f7934fd8 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:19.709962 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ec20c7e-c11d-4e42-98b2-ae55f7934fd8 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:19.710413 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ec20c7e-c11d-4e42-98b2-ae55f7934fd8 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:19.710830 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ec20c7e-c11d-4e42-98b2-ae55f7934fd8 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:19.837906 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3ec20c7e-c11d-4e42-98b2-ae55f7934fd8 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:19.845352 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3ec20c7e-c11d-4e42-98b2-ae55f7934fd8 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1516 microversion: 2.1 time: 0.149206 Aug 07 02:04:19.845937 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3051/6567] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:19 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:20.867195 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9560102e-3a23-4e66-a85a-b46ab7ef493d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:20.867831 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9560102e-3a23-4e66-a85a-b46ab7ef493d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:20.875447 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9560102e-3a23-4e66-a85a-b46ab7ef493d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:20.875970 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9560102e-3a23-4e66-a85a-b46ab7ef493d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:20.876422 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9560102e-3a23-4e66-a85a-b46ab7ef493d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:20.877129 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9560102e-3a23-4e66-a85a-b46ab7ef493d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:20.877594 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9560102e-3a23-4e66-a85a-b46ab7ef493d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:20.878035 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9560102e-3a23-4e66-a85a-b46ab7ef493d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:21.006318 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9560102e-3a23-4e66-a85a-b46ab7ef493d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:21.014510 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9560102e-3a23-4e66-a85a-b46ab7ef493d tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1516 microversion: 2.1 time: 0.151317 Aug 07 02:04:21.015081 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3517/6568] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:20 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:22.035077 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9d19951c-ecfc-4aae-9daf-afa8d68b255b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:22.035683 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9d19951c-ecfc-4aae-9daf-afa8d68b255b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:22.042506 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9d19951c-ecfc-4aae-9daf-afa8d68b255b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:22.042983 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9d19951c-ecfc-4aae-9daf-afa8d68b255b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:22.043445 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9d19951c-ecfc-4aae-9daf-afa8d68b255b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:22.044155 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9d19951c-ecfc-4aae-9daf-afa8d68b255b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:22.044608 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9d19951c-ecfc-4aae-9daf-afa8d68b255b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:22.045029 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9d19951c-ecfc-4aae-9daf-afa8d68b255b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:22.173565 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9d19951c-ecfc-4aae-9daf-afa8d68b255b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:22.181026 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9d19951c-ecfc-4aae-9daf-afa8d68b255b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1516 microversion: 2.1 time: 0.149879 Aug 07 02:04:22.181585 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3052/6569] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:22 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:23.202163 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a1f66111-b7ad-4f86-9451-d6c188791593 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:23.202794 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a1f66111-b7ad-4f86-9451-d6c188791593 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:23.209708 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a1f66111-b7ad-4f86-9451-d6c188791593 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:23.210205 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a1f66111-b7ad-4f86-9451-d6c188791593 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:23.210657 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a1f66111-b7ad-4f86-9451-d6c188791593 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:23.211375 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a1f66111-b7ad-4f86-9451-d6c188791593 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:23.211842 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a1f66111-b7ad-4f86-9451-d6c188791593 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:23.212311 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a1f66111-b7ad-4f86-9451-d6c188791593 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:23.339266 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a1f66111-b7ad-4f86-9451-d6c188791593 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:23.347440 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a1f66111-b7ad-4f86-9451-d6c188791593 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1516 microversion: 2.1 time: 0.149511 Aug 07 02:04:23.348115 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3518/6570] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:23 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:24.369403 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2f036f61-5d3b-41ae-8462-1190209d8611 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:24.370133 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2f036f61-5d3b-41ae-8462-1190209d8611 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:24.373473 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=28 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:04:24.379215 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f036f61-5d3b-41ae-8462-1190209d8611 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:24.379710 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f036f61-5d3b-41ae-8462-1190209d8611 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:24.380206 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f036f61-5d3b-41ae-8462-1190209d8611 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:24.380979 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f036f61-5d3b-41ae-8462-1190209d8611 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:24.381484 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f036f61-5d3b-41ae-8462-1190209d8611 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:24.381978 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f036f61-5d3b-41ae-8462-1190209d8611 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:24.386136 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=84 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:04:24.793963 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2f036f61-5d3b-41ae-8462-1190209d8611 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:24.801632 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2f036f61-5d3b-41ae-8462-1190209d8611 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1516 microversion: 2.1 time: 0.436172 Aug 07 02:04:24.802216 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3053/6571] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:24 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1516 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:25.638168 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-de736c2f-89be-408c-afb3-2f2fa272db8b req-181035c5-7e6f-40d9-9720-2453d7aa081b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f622bbd5-faeb-4be7-a93c-a29439f2a992", "name": "network-vif-unplugged", "status": "completed", "tag": "72ce8472-4e07-4222-956d-d256c138828a"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:04:25.643249 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=34 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:04:25.649256 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-de736c2f-89be-408c-afb3-2f2fa272db8b req-181035c5-7e6f-40d9-9720-2453d7aa081b service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:25.649751 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-de736c2f-89be-408c-afb3-2f2fa272db8b req-181035c5-7e6f-40d9-9720-2453d7aa081b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:25.650199 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-de736c2f-89be-408c-afb3-2f2fa272db8b req-181035c5-7e6f-40d9-9720-2453d7aa081b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:25.654710 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:04:25.663376 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-de736c2f-89be-408c-afb3-2f2fa272db8b req-181035c5-7e6f-40d9-9720-2453d7aa081b service nova] Creating event network-vif-unplugged:72ce8472-4e07-4222-956d-d256c138828a for instance f622bbd5-faeb-4be7-a93c-a29439f2a992 on n-h2-master-1 Aug 07 02:04:25.670468 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [req-de736c2f-89be-408c-afb3-2f2fa272db8b req-181035c5-7e6f-40d9-9720-2453d7aa081b service nova] Instance f622bbd5-faeb-4be7-a93c-a29439f2a992 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 02:04:25.681419 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-de736c2f-89be-408c-afb3-2f2fa272db8b req-181035c5-7e6f-40d9-9720-2453d7aa081b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048026 Aug 07 02:04:25.682039 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3519/6572] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 02:04:25.822955 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-17fd6216-5f7f-4771-8811-6ac7c23190c8 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:25.823571 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-17fd6216-5f7f-4771-8811-6ac7c23190c8 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:25.831112 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-17fd6216-5f7f-4771-8811-6ac7c23190c8 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:25.831770 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-17fd6216-5f7f-4771-8811-6ac7c23190c8 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:25.832292 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-17fd6216-5f7f-4771-8811-6ac7c23190c8 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:25.833107 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-17fd6216-5f7f-4771-8811-6ac7c23190c8 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:25.833630 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-17fd6216-5f7f-4771-8811-6ac7c23190c8 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:25.834057 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-17fd6216-5f7f-4771-8811-6ac7c23190c8 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:26.064672 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-17fd6216-5f7f-4771-8811-6ac7c23190c8 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:26.073668 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-17fd6216-5f7f-4771-8811-6ac7c23190c8 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1515 microversion: 2.1 time: 0.254842 Aug 07 02:04:26.074451 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3054/6573] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:25 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1515 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:04:27.097874 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d1dd76ac-88bd-46d0-a447-8f864d00c4cb tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:27.098590 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d1dd76ac-88bd-46d0-a447-8f864d00c4cb tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:27.104969 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d1dd76ac-88bd-46d0-a447-8f864d00c4cb tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:27.105466 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d1dd76ac-88bd-46d0-a447-8f864d00c4cb tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:27.106653 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d1dd76ac-88bd-46d0-a447-8f864d00c4cb tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:27.107357 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d1dd76ac-88bd-46d0-a447-8f864d00c4cb tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:27.107824 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d1dd76ac-88bd-46d0-a447-8f864d00c4cb tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:27.108287 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d1dd76ac-88bd-46d0-a447-8f864d00c4cb tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:27.236655 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d1dd76ac-88bd-46d0-a447-8f864d00c4cb tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:27.244246 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d1dd76ac-88bd-46d0-a447-8f864d00c4cb tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1513 microversion: 2.1 time: 0.151904 Aug 07 02:04:27.244816 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3520/6574] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:27 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:27.706363 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-3bb4629a-3ebe-49dc-bbf7-78b291ad4d2a req-95f0900a-8ef1-45e6-a454-8607e9592c2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f622bbd5-faeb-4be7-a93c-a29439f2a992", "tag": "72ce8472-4e07-4222-956d-d256c138828a"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:04:27.717093 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3bb4629a-3ebe-49dc-bbf7-78b291ad4d2a req-95f0900a-8ef1-45e6-a454-8607e9592c2a service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:27.717567 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3bb4629a-3ebe-49dc-bbf7-78b291ad4d2a req-95f0900a-8ef1-45e6-a454-8607e9592c2a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:27.717996 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3bb4629a-3ebe-49dc-bbf7-78b291ad4d2a req-95f0900a-8ef1-45e6-a454-8607e9592c2a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:27.729348 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-3bb4629a-3ebe-49dc-bbf7-78b291ad4d2a req-95f0900a-8ef1-45e6-a454-8607e9592c2a service nova] Creating event network-changed:72ce8472-4e07-4222-956d-d256c138828a for instance f622bbd5-faeb-4be7-a93c-a29439f2a992 on n-h2-master-1 Aug 07 02:04:27.735025 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [req-3bb4629a-3ebe-49dc-bbf7-78b291ad4d2a req-95f0900a-8ef1-45e6-a454-8607e9592c2a service nova] Instance f622bbd5-faeb-4be7-a93c-a29439f2a992 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 02:04:27.745504 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-3bb4629a-3ebe-49dc-bbf7-78b291ad4d2a req-95f0900a-8ef1-45e6-a454-8607e9592c2a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042864 Aug 07 02:04:27.746080 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3055/6575] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:04:28.267005 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9cdbf754-7c1c-4f07-9e4a-6d48c6783208 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:28.267653 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9cdbf754-7c1c-4f07-9e4a-6d48c6783208 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:28.274716 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9cdbf754-7c1c-4f07-9e4a-6d48c6783208 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:28.275234 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9cdbf754-7c1c-4f07-9e4a-6d48c6783208 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:28.275728 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9cdbf754-7c1c-4f07-9e4a-6d48c6783208 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:28.276651 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9cdbf754-7c1c-4f07-9e4a-6d48c6783208 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:28.277125 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9cdbf754-7c1c-4f07-9e4a-6d48c6783208 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:28.277570 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9cdbf754-7c1c-4f07-9e4a-6d48c6783208 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:28.410436 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9cdbf754-7c1c-4f07-9e4a-6d48c6783208 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:28.417995 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9cdbf754-7c1c-4f07-9e4a-6d48c6783208 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1510 microversion: 2.1 time: 0.155048 Aug 07 02:04:28.418577 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3521/6576] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:28 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:28.439432 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-03ec951e-7908-4f2a-8f07-f28304b41f04 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:28.440090 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-03ec951e-7908-4f2a-8f07-f28304b41f04 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:28.446271 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-03ec951e-7908-4f2a-8f07-f28304b41f04 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:28.446759 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-03ec951e-7908-4f2a-8f07-f28304b41f04 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:28.447209 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-03ec951e-7908-4f2a-8f07-f28304b41f04 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:28.447939 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-03ec951e-7908-4f2a-8f07-f28304b41f04 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:28.448402 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-03ec951e-7908-4f2a-8f07-f28304b41f04 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:28.448841 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-03ec951e-7908-4f2a-8f07-f28304b41f04 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:28.474979 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-03ec951e-7908-4f2a-8f07-f28304b41f04 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 02:04:28.525907 n-d-master-1 devstack@n-api.service[119517]: INFO nova.compute.api [None req-03ec951e-7908-4f2a-8f07-f28304b41f04 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Found an unconfirmed migration during delete, id: 16, status: finished Aug 07 02:04:29.902929 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-03ec951e-7908-4f2a-8f07-f28304b41f04 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 204 len: 0 microversion: 2.1 time: 1.467242 Aug 07 02:04:29.903626 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3056/6577] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 02:04:28 2022] DELETE /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 0 bytes in 1470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 02:04:29.912744 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-da824a6d-4ac5-4ad6-ad9f-b4a535b692e3 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:29.913367 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-da824a6d-4ac5-4ad6-ad9f-b4a535b692e3 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:29.920048 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da824a6d-4ac5-4ad6-ad9f-b4a535b692e3 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:29.920476 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da824a6d-4ac5-4ad6-ad9f-b4a535b692e3 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:29.920920 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da824a6d-4ac5-4ad6-ad9f-b4a535b692e3 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:29.921622 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da824a6d-4ac5-4ad6-ad9f-b4a535b692e3 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:29.922083 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da824a6d-4ac5-4ad6-ad9f-b4a535b692e3 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:29.922518 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-da824a6d-4ac5-4ad6-ad9f-b4a535b692e3 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:30.052829 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-da824a6d-4ac5-4ad6-ad9f-b4a535b692e3 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:30.061111 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-da824a6d-4ac5-4ad6-ad9f-b4a535b692e3 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1502 microversion: 2.1 time: 0.153417 Aug 07 02:04:30.061684 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3522/6578] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:29 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:31.083627 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bbfd894e-b204-4b98-89bf-1d2f6899fced tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:31.084374 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bbfd894e-b204-4b98-89bf-1d2f6899fced tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:31.092587 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbfd894e-b204-4b98-89bf-1d2f6899fced tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:31.093086 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbfd894e-b204-4b98-89bf-1d2f6899fced tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:31.093872 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbfd894e-b204-4b98-89bf-1d2f6899fced tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:31.094455 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbfd894e-b204-4b98-89bf-1d2f6899fced tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:31.095546 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbfd894e-b204-4b98-89bf-1d2f6899fced tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:31.096038 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bbfd894e-b204-4b98-89bf-1d2f6899fced tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:31.185389 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-a5b142cc-e850-46f0-b326-1dc9207ce546 req-7d75622b-e928-49ae-95f0-d26a1b75d589 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f622bbd5-faeb-4be7-a93c-a29439f2a992", "name": "network-vif-plugged", "status": "completed", "tag": "72ce8472-4e07-4222-956d-d256c138828a"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:04:31.200111 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a5b142cc-e850-46f0-b326-1dc9207ce546 req-7d75622b-e928-49ae-95f0-d26a1b75d589 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:31.200842 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a5b142cc-e850-46f0-b326-1dc9207ce546 req-7d75622b-e928-49ae-95f0-d26a1b75d589 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:31.201506 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a5b142cc-e850-46f0-b326-1dc9207ce546 req-7d75622b-e928-49ae-95f0-d26a1b75d589 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:31.213672 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-a5b142cc-e850-46f0-b326-1dc9207ce546 req-7d75622b-e928-49ae-95f0-d26a1b75d589 service nova] Creating event network-vif-plugged:72ce8472-4e07-4222-956d-d256c138828a for instance f622bbd5-faeb-4be7-a93c-a29439f2a992 on n-h2-master-1 Aug 07 02:04:31.219730 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-a5b142cc-e850-46f0-b326-1dc9207ce546 req-7d75622b-e928-49ae-95f0-d26a1b75d589 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040830 Aug 07 02:04:31.220958 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3523/6579] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:04:31.267357 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bbfd894e-b204-4b98-89bf-1d2f6899fced tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fc9bbd5d8045e5b558de2386d73d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ca203fa389466e842ed965f1140524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:31.276416 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bbfd894e-b204-4b98-89bf-1d2f6899fced tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 200 len: 1502 microversion: 2.1 time: 0.197395 Aug 07 02:04:31.277085 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3057/6580] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:31 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 1502 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:31.869942 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-fb02dcda-006a-4bac-9a90-41fe1028f0d0 req-a63cb565-053e-43db-a323-b6dc730d3c0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f622bbd5-faeb-4be7-a93c-a29439f2a992", "name": "network-vif-deleted", "tag": "72ce8472-4e07-4222-956d-d256c138828a"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:04:31.881280 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-fb02dcda-006a-4bac-9a90-41fe1028f0d0 req-a63cb565-053e-43db-a323-b6dc730d3c0e service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:31.881773 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-fb02dcda-006a-4bac-9a90-41fe1028f0d0 req-a63cb565-053e-43db-a323-b6dc730d3c0e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:31.882243 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-fb02dcda-006a-4bac-9a90-41fe1028f0d0 req-a63cb565-053e-43db-a323-b6dc730d3c0e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:31.895366 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-fb02dcda-006a-4bac-9a90-41fe1028f0d0 req-a63cb565-053e-43db-a323-b6dc730d3c0e service nova] Creating event network-vif-deleted:72ce8472-4e07-4222-956d-d256c138828a for instance f622bbd5-faeb-4be7-a93c-a29439f2a992 on n-h2-master-1 Aug 07 02:04:31.901687 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-fb02dcda-006a-4bac-9a90-41fe1028f0d0 req-a63cb565-053e-43db-a323-b6dc730d3c0e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035897 Aug 07 02:04:31.902541 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3524/6581] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:04:32.299121 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e13065f8-5313-4aa0-ad9b-bbb03c81c11c tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:32.299801 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e13065f8-5313-4aa0-ad9b-bbb03c81c11c tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:32.306699 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e13065f8-5313-4aa0-ad9b-bbb03c81c11c tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:32.307176 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e13065f8-5313-4aa0-ad9b-bbb03c81c11c tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:32.307612 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e13065f8-5313-4aa0-ad9b-bbb03c81c11c tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:32.308330 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e13065f8-5313-4aa0-ad9b-bbb03c81c11c tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:32.308785 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e13065f8-5313-4aa0-ad9b-bbb03c81c11c tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:32.309210 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e13065f8-5313-4aa0-ad9b-bbb03c81c11c tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:32.322548 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-e13065f8-5313-4aa0-ad9b-bbb03c81c11c tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] HTTP exception thrown: Instance f622bbd5-faeb-4be7-a93c-a29439f2a992 could not be found. Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e13065f8-5313-4aa0-ad9b-bbb03c81c11c tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Request method failure captured: Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 HTTP/1.1 Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7x2AjS6pp_xsFSf4lWuQNSGTyguHagTAKQSnb5vhIDD5d753Gv4ECGXrE6tqyRylwHMowUwi1Qrx3TmUcrJXb3Z7IvN-DHNfkMyEjlx5LeN-aSWqvQU2WKVtVevCQ8sjq02tfN7G1CuVtqzN0ClWo4xEC2FbOQ4T0EMxczXpyLZTEdw Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: b0ca203fa389466e842ed965f1140524 Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-DeleteServersTestJSON-1605226725 Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0ca203fa389466e842ed965f1140524"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b0ca203fa389466e842ed965f1140524", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0ca203fa389466e842ed965f1140524"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b0ca203fa389466e842ed965f1140524"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-DeleteServersTestJSON-1605226725 Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: b0ca203fa389466e842ed965f1140524 Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-DeleteServersTestJSON-1605226725 Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-DeleteServersTestJSON-1605226725-project Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 19fc9bbd5d8045e5b558de2386d73d93 Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-DeleteServersTestJSON-1605226725-project Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: exception: Instance f622bbd5-faeb-4be7-a93c-a29439f2a992 could not be found. Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'f622bbd5-faeb-4be7-a93c-a29439f2a992'} Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f622bbd5-faeb-4be7-a93c-a29439f2a992 could not be found. Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f622bbd5-faeb-4be7-a93c-a29439f2a992 could not be found. Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:04:32.324216 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:04:32.327784 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:04:32.327784 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:04:32.327784 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:04:32.327784 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:04:32.327784 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:04:32.327784 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f622bbd5-faeb-4be7-a93c-a29439f2a992 could not be found. Aug 07 02:04:32.327784 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:04:32.327784 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e13065f8-5313-4aa0-ad9b-bbb03c81c11c tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Returning 404 to user: Instance f622bbd5-faeb-4be7-a93c-a29439f2a992 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:04:32.327784 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e13065f8-5313-4aa0-ad9b-bbb03c81c11c tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 404 len: 111 microversion: 2.1 time: 0.030399 Aug 07 02:04:32.327784 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3058/6582] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:32 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:04:32.342049 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-959017e5-d903-4918-bb8a-0ec23aab95d9 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:32.342643 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-959017e5-d903-4918-bb8a-0ec23aab95d9 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:32.349678 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-959017e5-d903-4918-bb8a-0ec23aab95d9 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:32.350172 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-959017e5-d903-4918-bb8a-0ec23aab95d9 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:32.350626 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-959017e5-d903-4918-bb8a-0ec23aab95d9 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:32.351333 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-959017e5-d903-4918-bb8a-0ec23aab95d9 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:32.351806 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-959017e5-d903-4918-bb8a-0ec23aab95d9 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:32.352317 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-959017e5-d903-4918-bb8a-0ec23aab95d9 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:32.366561 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-959017e5-d903-4918-bb8a-0ec23aab95d9 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] HTTP exception thrown: Instance f622bbd5-faeb-4be7-a93c-a29439f2a992 could not be found. Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-959017e5-d903-4918-bb8a-0ec23aab95d9 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Request method failure captured: Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 HTTP/1.1 Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7x2AjS6pp_xsFSf4lWuQNSGTyguHagTAKQSnb5vhIDD5d753Gv4ECGXrE6tqyRylwHMowUwi1Qrx3TmUcrJXb3Z7IvN-DHNfkMyEjlx5LeN-aSWqvQU2WKVtVevCQ8sjq02tfN7G1CuVtqzN0ClWo4xEC2FbOQ4T0EMxczXpyLZTEdw Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: b0ca203fa389466e842ed965f1140524 Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-DeleteServersTestJSON-1605226725 Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0ca203fa389466e842ed965f1140524"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b0ca203fa389466e842ed965f1140524", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0ca203fa389466e842ed965f1140524"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b0ca203fa389466e842ed965f1140524"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-DeleteServersTestJSON-1605226725 Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: b0ca203fa389466e842ed965f1140524 Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-DeleteServersTestJSON-1605226725 Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-DeleteServersTestJSON-1605226725-project Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 19fc9bbd5d8045e5b558de2386d73d93 Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-DeleteServersTestJSON-1605226725-project Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: exception: Instance f622bbd5-faeb-4be7-a93c-a29439f2a992 could not be found. Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'f622bbd5-faeb-4be7-a93c-a29439f2a992'} Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f622bbd5-faeb-4be7-a93c-a29439f2a992 could not be found. Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:04:32.368409 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:04:32.375408 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f622bbd5-faeb-4be7-a93c-a29439f2a992 could not be found. Aug 07 02:04:32.375408 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:04:32.375408 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:04:32.375408 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:04:32.375408 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:04:32.375408 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:04:32.375408 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:04:32.375408 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:04:32.375408 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:04:32.375408 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f622bbd5-faeb-4be7-a93c-a29439f2a992 could not be found. Aug 07 02:04:32.375408 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:04:32.375408 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-959017e5-d903-4918-bb8a-0ec23aab95d9 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Returning 404 to user: Instance f622bbd5-faeb-4be7-a93c-a29439f2a992 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:04:32.375408 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-959017e5-d903-4918-bb8a-0ec23aab95d9 tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 404 len: 111 microversion: 2.1 time: 0.032429 Aug 07 02:04:32.375408 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3525/6583] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 02:04:32 2022] DELETE /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:04:32.380832 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-75b3c9ce-3f52-49d3-b2e1-0b65f9133a3b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:32.381456 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-75b3c9ce-3f52-49d3-b2e1-0b65f9133a3b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] [instance: f622bbd5-faeb-4be7-a93c-a29439f2a992] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:32.388297 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75b3c9ce-3f52-49d3-b2e1-0b65f9133a3b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:32.388719 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75b3c9ce-3f52-49d3-b2e1-0b65f9133a3b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:32.389150 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75b3c9ce-3f52-49d3-b2e1-0b65f9133a3b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:32.389833 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75b3c9ce-3f52-49d3-b2e1-0b65f9133a3b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:32.390284 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75b3c9ce-3f52-49d3-b2e1-0b65f9133a3b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:32.390704 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75b3c9ce-3f52-49d3-b2e1-0b65f9133a3b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:32.404859 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-75b3c9ce-3f52-49d3-b2e1-0b65f9133a3b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] HTTP exception thrown: Instance f622bbd5-faeb-4be7-a93c-a29439f2a992 could not be found. Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-75b3c9ce-3f52-49d3-b2e1-0b65f9133a3b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Request method failure captured: Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 HTTP/1.1 Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7x2AjS6pp_xsFSf4lWuQNSGTyguHagTAKQSnb5vhIDD5d753Gv4ECGXrE6tqyRylwHMowUwi1Qrx3TmUcrJXb3Z7IvN-DHNfkMyEjlx5LeN-aSWqvQU2WKVtVevCQ8sjq02tfN7G1CuVtqzN0ClWo4xEC2FbOQ4T0EMxczXpyLZTEdw Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: b0ca203fa389466e842ed965f1140524 Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-DeleteServersTestJSON-1605226725 Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0ca203fa389466e842ed965f1140524"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b0ca203fa389466e842ed965f1140524", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b0ca203fa389466e842ed965f1140524"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b0ca203fa389466e842ed965f1140524"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-DeleteServersTestJSON-1605226725 Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: b0ca203fa389466e842ed965f1140524 Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-DeleteServersTestJSON-1605226725 Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-DeleteServersTestJSON-1605226725-project Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 19fc9bbd5d8045e5b558de2386d73d93 Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-DeleteServersTestJSON-1605226725-project Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: exception: Instance f622bbd5-faeb-4be7-a93c-a29439f2a992 could not be found. Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'f622bbd5-faeb-4be7-a93c-a29439f2a992'} Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f622bbd5-faeb-4be7-a93c-a29439f2a992 could not be found. Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f622bbd5-faeb-4be7-a93c-a29439f2a992 could not be found. Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:04:32.406331 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:04:32.410277 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:04:32.410277 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:04:32.410277 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:04:32.410277 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:04:32.410277 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:04:32.410277 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f622bbd5-faeb-4be7-a93c-a29439f2a992 could not be found. Aug 07 02:04:32.410277 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:04:32.410277 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-75b3c9ce-3f52-49d3-b2e1-0b65f9133a3b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] Returning 404 to user: Instance f622bbd5-faeb-4be7-a93c-a29439f2a992 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:04:32.410277 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-75b3c9ce-3f52-49d3-b2e1-0b65f9133a3b tempest-DeleteServersTestJSON-1605226725 tempest-DeleteServersTestJSON-1605226725-project] 10.222.0.39 "GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992" status: 404 len: 111 microversion: 2.1 time: 0.032277 Aug 07 02:04:32.410973 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3059/6584] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:32 2022] GET /compute/v2.1/servers/f622bbd5-faeb-4be7-a93c-a29439f2a992 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:04:41.052973 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-376c1e2b-b214-4ba7-92a6-26fd2ffffc53 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-746560088", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "c60c83c3-7d07-4112-bcea-7e4c3ed69f01"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:04:41.111619 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-376c1e2b-b214-4ba7-92a6-26fd2ffffc53 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] validate_networks() for [('c60c83c3-7d07-4112-bcea-7e4c3ed69f01', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 02:04:41.515387 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-376c1e2b-b214-4ba7-92a6-26fd2ffffc53 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 02:04:41.515830 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-376c1e2b-b214-4ba7-92a6-26fd2ffffc53 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 02:04:41.516347 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-376c1e2b-b214-4ba7-92a6-26fd2ffffc53 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 02:04:41.516773 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-376c1e2b-b214-4ba7-92a6-26fd2ffffc53 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 02:04:41.517201 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-376c1e2b-b214-4ba7-92a6-26fd2ffffc53 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 02:04:41.526788 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-376c1e2b-b214-4ba7-92a6-26fd2ffffc53 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:41.527289 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-376c1e2b-b214-4ba7-92a6-26fd2ffffc53 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:41.528307 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-376c1e2b-b214-4ba7-92a6-26fd2ffffc53 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:41.529104 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-376c1e2b-b214-4ba7-92a6-26fd2ffffc53 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:41.529579 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-376c1e2b-b214-4ba7-92a6-26fd2ffffc53 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:41.530019 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-376c1e2b-b214-4ba7-92a6-26fd2ffffc53 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:41.547637 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-376c1e2b-b214-4ba7-92a6-26fd2ffffc53 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Getting quotas for project b5313574dcf84819b58af883ac6cb768. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:04:41.553361 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-376c1e2b-b214-4ba7-92a6-26fd2ffffc53 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Getting quotas for user bbf878e8b08d4c85bb3fb925db315ac4 and project b5313574dcf84819b58af883ac6cb768. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:04:41.566558 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-376c1e2b-b214-4ba7-92a6-26fd2ffffc53 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 02:04:41.568899 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-376c1e2b-b214-4ba7-92a6-26fd2ffffc53 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 02:04:41.621821 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-376c1e2b-b214-4ba7-92a6-26fd2ffffc53 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.731007 Aug 07 02:04:41.622743 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3526/6585] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 02:04:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 02:04:41.633584 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1a3acdf2-7031-4194-bba6-c60ef50bc09f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:41.634203 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1a3acdf2-7031-4194-bba6-c60ef50bc09f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:41.698291 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1a3acdf2-7031-4194-bba6-c60ef50bc09f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:41.706477 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1a3acdf2-7031-4194-bba6-c60ef50bc09f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1217 microversion: 2.1 time: 0.076892 Aug 07 02:04:41.707057 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3060/6586] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:41 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1217 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:42.730263 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f3edc058-ed1d-4a95-be1e-0ec996b3aa6f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:42.732847 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f3edc058-ed1d-4a95-be1e-0ec996b3aa6f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:42.743954 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f3edc058-ed1d-4a95-be1e-0ec996b3aa6f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:42.744950 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f3edc058-ed1d-4a95-be1e-0ec996b3aa6f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:42.745655 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f3edc058-ed1d-4a95-be1e-0ec996b3aa6f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:42.746873 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f3edc058-ed1d-4a95-be1e-0ec996b3aa6f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:42.747597 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f3edc058-ed1d-4a95-be1e-0ec996b3aa6f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:42.748229 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f3edc058-ed1d-4a95-be1e-0ec996b3aa6f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:42.837320 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f3edc058-ed1d-4a95-be1e-0ec996b3aa6f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:42.846047 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f3edc058-ed1d-4a95-be1e-0ec996b3aa6f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1287 microversion: 2.1 time: 0.122674 Aug 07 02:04:42.846624 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3527/6587] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:42 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1287 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:43.867381 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-79b43d1b-99de-4dbe-80aa-2f75282b5781 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:43.867773 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-79b43d1b-99de-4dbe-80aa-2f75282b5781 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:43.870215 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:04:43.879076 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-79b43d1b-99de-4dbe-80aa-2f75282b5781 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:43.879571 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-79b43d1b-99de-4dbe-80aa-2f75282b5781 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:43.880050 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-79b43d1b-99de-4dbe-80aa-2f75282b5781 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:43.880798 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-79b43d1b-99de-4dbe-80aa-2f75282b5781 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:43.881258 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-79b43d1b-99de-4dbe-80aa-2f75282b5781 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:43.881859 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-79b43d1b-99de-4dbe-80aa-2f75282b5781 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:44.084339 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-79b43d1b-99de-4dbe-80aa-2f75282b5781 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:44.093635 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-79b43d1b-99de-4dbe-80aa-2f75282b5781 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1317 microversion: 2.1 time: 0.230506 Aug 07 02:04:44.095138 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3061/6588] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:43 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:44.112116 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-4bda1323-0647-45c1-821f-c3745ff32845 req-af91feb2-b184-4b25-b8b8-482fc63553be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fb23c99-88b5-40f9-b37a-06da106524c9", "tag": "fcc467ba-5d5a-4df6-997d-9a02ee24a52b"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:04:44.129783 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4bda1323-0647-45c1-821f-c3745ff32845 req-af91feb2-b184-4b25-b8b8-482fc63553be service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:44.130855 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4bda1323-0647-45c1-821f-c3745ff32845 req-af91feb2-b184-4b25-b8b8-482fc63553be service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:44.131560 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-4bda1323-0647-45c1-821f-c3745ff32845 req-af91feb2-b184-4b25-b8b8-482fc63553be service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:44.144951 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-4bda1323-0647-45c1-821f-c3745ff32845 req-af91feb2-b184-4b25-b8b8-482fc63553be service nova] Creating event network-changed:fcc467ba-5d5a-4df6-997d-9a02ee24a52b for instance 6fb23c99-88b5-40f9-b37a-06da106524c9 on n-h2-master-1 Aug 07 02:04:44.150304 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-4bda1323-0647-45c1-821f-c3745ff32845 req-af91feb2-b184-4b25-b8b8-482fc63553be service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042444 Aug 07 02:04:44.151530 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3528/6589] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:04:45.117345 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b12999bd-7a98-474d-9892-16fb79556b9a tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:45.117983 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b12999bd-7a98-474d-9892-16fb79556b9a tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:45.125521 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b12999bd-7a98-474d-9892-16fb79556b9a tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:45.126002 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b12999bd-7a98-474d-9892-16fb79556b9a tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:45.126441 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b12999bd-7a98-474d-9892-16fb79556b9a tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:45.127142 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b12999bd-7a98-474d-9892-16fb79556b9a tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:45.127595 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b12999bd-7a98-474d-9892-16fb79556b9a tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:45.128083 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b12999bd-7a98-474d-9892-16fb79556b9a tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:45.256819 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b12999bd-7a98-474d-9892-16fb79556b9a tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:45.264262 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b12999bd-7a98-474d-9892-16fb79556b9a tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1317 microversion: 2.1 time: 0.150872 Aug 07 02:04:45.264830 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3062/6590] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:45 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:46.286331 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-42659875-c6c6-4955-80af-3d72c61ddfa7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:46.287034 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-42659875-c6c6-4955-80af-3d72c61ddfa7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:46.293248 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42659875-c6c6-4955-80af-3d72c61ddfa7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:46.293742 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42659875-c6c6-4955-80af-3d72c61ddfa7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:46.294194 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42659875-c6c6-4955-80af-3d72c61ddfa7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:46.294911 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42659875-c6c6-4955-80af-3d72c61ddfa7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:46.295378 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42659875-c6c6-4955-80af-3d72c61ddfa7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:46.295817 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42659875-c6c6-4955-80af-3d72c61ddfa7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:46.425300 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-42659875-c6c6-4955-80af-3d72c61ddfa7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:46.433000 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-42659875-c6c6-4955-80af-3d72c61ddfa7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1317 microversion: 2.1 time: 0.151887 Aug 07 02:04:46.433582 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3529/6591] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:46 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:47.454824 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-493a6761-015d-4e75-8979-c5644073ed7b tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:47.455497 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-493a6761-015d-4e75-8979-c5644073ed7b tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:47.462334 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-493a6761-015d-4e75-8979-c5644073ed7b tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:47.462823 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-493a6761-015d-4e75-8979-c5644073ed7b tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:47.463264 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-493a6761-015d-4e75-8979-c5644073ed7b tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:47.463997 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-493a6761-015d-4e75-8979-c5644073ed7b tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:47.464461 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-493a6761-015d-4e75-8979-c5644073ed7b tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:47.465573 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-493a6761-015d-4e75-8979-c5644073ed7b tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:47.598132 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-493a6761-015d-4e75-8979-c5644073ed7b tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:47.606480 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-493a6761-015d-4e75-8979-c5644073ed7b tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1317 microversion: 2.1 time: 0.155529 Aug 07 02:04:47.607061 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3063/6592] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:47 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:48.627860 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5cfb1b58-df37-4719-b454-b4737baf0c74 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:48.628451 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5cfb1b58-df37-4719-b454-b4737baf0c74 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:48.635853 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cfb1b58-df37-4719-b454-b4737baf0c74 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:48.636398 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cfb1b58-df37-4719-b454-b4737baf0c74 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:48.637518 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cfb1b58-df37-4719-b454-b4737baf0c74 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:48.638240 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cfb1b58-df37-4719-b454-b4737baf0c74 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:48.638714 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cfb1b58-df37-4719-b454-b4737baf0c74 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:48.639157 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cfb1b58-df37-4719-b454-b4737baf0c74 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:48.776993 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5cfb1b58-df37-4719-b454-b4737baf0c74 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:48.784521 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5cfb1b58-df37-4719-b454-b4737baf0c74 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1317 microversion: 2.1 time: 0.160604 Aug 07 02:04:48.785097 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3530/6593] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:48 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:04:49.287346 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-b6fee7a3-0c67-4f0d-bc66-8491e73b8ac4 req-b2abfba1-00c0-4c15-bb81-f30336001e91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fb23c99-88b5-40f9-b37a-06da106524c9", "name": "network-vif-plugged", "status": "completed", "tag": "fcc467ba-5d5a-4df6-997d-9a02ee24a52b"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:04:49.297900 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b6fee7a3-0c67-4f0d-bc66-8491e73b8ac4 req-b2abfba1-00c0-4c15-bb81-f30336001e91 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:49.298378 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b6fee7a3-0c67-4f0d-bc66-8491e73b8ac4 req-b2abfba1-00c0-4c15-bb81-f30336001e91 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:49.298841 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b6fee7a3-0c67-4f0d-bc66-8491e73b8ac4 req-b2abfba1-00c0-4c15-bb81-f30336001e91 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:49.309905 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-b6fee7a3-0c67-4f0d-bc66-8491e73b8ac4 req-b2abfba1-00c0-4c15-bb81-f30336001e91 service nova] Creating event network-vif-plugged:fcc467ba-5d5a-4df6-997d-9a02ee24a52b for instance 6fb23c99-88b5-40f9-b37a-06da106524c9 on n-h2-master-1 Aug 07 02:04:49.314795 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-b6fee7a3-0c67-4f0d-bc66-8491e73b8ac4 req-b2abfba1-00c0-4c15-bb81-f30336001e91 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101031 Aug 07 02:04:49.315369 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3064/6594] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:04:49.805269 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e46ffb7a-9c1e-45f5-b87c-c77a9eca1cd6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:49.805852 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e46ffb7a-9c1e-45f5-b87c-c77a9eca1cd6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:49.812845 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e46ffb7a-9c1e-45f5-b87c-c77a9eca1cd6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:49.813338 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e46ffb7a-9c1e-45f5-b87c-c77a9eca1cd6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:49.813789 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e46ffb7a-9c1e-45f5-b87c-c77a9eca1cd6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:49.814498 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e46ffb7a-9c1e-45f5-b87c-c77a9eca1cd6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:49.814975 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e46ffb7a-9c1e-45f5-b87c-c77a9eca1cd6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:49.815412 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e46ffb7a-9c1e-45f5-b87c-c77a9eca1cd6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:49.942688 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e46ffb7a-9c1e-45f5-b87c-c77a9eca1cd6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:49.951054 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e46ffb7a-9c1e-45f5-b87c-c77a9eca1cd6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1317 microversion: 2.1 time: 0.149732 Aug 07 02:04:49.951635 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3531/6595] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:49 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:50.976072 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f620760d-ddff-45ba-b716-1c3cc22a0ffc tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:50.976806 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f620760d-ddff-45ba-b716-1c3cc22a0ffc tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:50.984084 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f620760d-ddff-45ba-b716-1c3cc22a0ffc tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:50.984739 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f620760d-ddff-45ba-b716-1c3cc22a0ffc tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:50.984996 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f620760d-ddff-45ba-b716-1c3cc22a0ffc tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:50.985699 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f620760d-ddff-45ba-b716-1c3cc22a0ffc tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:50.986152 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f620760d-ddff-45ba-b716-1c3cc22a0ffc tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:50.986579 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f620760d-ddff-45ba-b716-1c3cc22a0ffc tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:51.116774 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f620760d-ddff-45ba-b716-1c3cc22a0ffc tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:51.124752 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f620760d-ddff-45ba-b716-1c3cc22a0ffc tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1508 microversion: 2.1 time: 0.153594 Aug 07 02:04:51.125453 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3065/6596] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:50 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:51.145599 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e71169c4-7265-4821-8164-03f25734649a tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:51.146248 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e71169c4-7265-4821-8164-03f25734649a tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:51.153773 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e71169c4-7265-4821-8164-03f25734649a tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:51.154277 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e71169c4-7265-4821-8164-03f25734649a tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:51.154740 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e71169c4-7265-4821-8164-03f25734649a tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:51.155468 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e71169c4-7265-4821-8164-03f25734649a tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:51.156030 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e71169c4-7265-4821-8164-03f25734649a tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:51.156481 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e71169c4-7265-4821-8164-03f25734649a tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:51.284701 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e71169c4-7265-4821-8164-03f25734649a tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:51.292314 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e71169c4-7265-4821-8164-03f25734649a tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1508 microversion: 2.1 time: 0.150702 Aug 07 02:04:51.292881 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3532/6597] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:51 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:51.311849 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f7bf7781-e21a-4ce5-a1fc-a89cbf2e2287 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:04:51.314209 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f7bf7781-e21a-4ce5-a1fc-a89cbf2e2287 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:51.320124 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f7bf7781-e21a-4ce5-a1fc-a89cbf2e2287 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:51.320602 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f7bf7781-e21a-4ce5-a1fc-a89cbf2e2287 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:51.321032 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f7bf7781-e21a-4ce5-a1fc-a89cbf2e2287 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:51.321721 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f7bf7781-e21a-4ce5-a1fc-a89cbf2e2287 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:51.322173 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f7bf7781-e21a-4ce5-a1fc-a89cbf2e2287 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:51.322594 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f7bf7781-e21a-4ce5-a1fc-a89cbf2e2287 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:51.385634 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f7bf7781-e21a-4ce5-a1fc-a89cbf2e2287 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "PUT /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1080 microversion: 2.1 time: 0.077668 Aug 07 02:04:51.386257 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3066/6598] 10.222.0.39 () {60 vars in 1256 bytes} [Sun Aug 7 02:04:51 2022] PUT /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1080 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:51.404372 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-28bb36d4-0ba5-495e-a39d-0fe54ccef300 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:51.405427 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-28bb36d4-0ba5-495e-a39d-0fe54ccef300 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:51.413152 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-28bb36d4-0ba5-495e-a39d-0fe54ccef300 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:51.413651 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-28bb36d4-0ba5-495e-a39d-0fe54ccef300 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:51.414106 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-28bb36d4-0ba5-495e-a39d-0fe54ccef300 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:51.414824 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-28bb36d4-0ba5-495e-a39d-0fe54ccef300 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:51.415296 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-28bb36d4-0ba5-495e-a39d-0fe54ccef300 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:51.416009 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-28bb36d4-0ba5-495e-a39d-0fe54ccef300 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:51.538395 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:04:51.547795 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-28bb36d4-0ba5-495e-a39d-0fe54ccef300 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:51.555261 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-28bb36d4-0ba5-495e-a39d-0fe54ccef300 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1506 microversion: 2.1 time: 0.155829 Aug 07 02:04:51.555835 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3533/6599] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:51 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:51.575840 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-593c25b6-061d-4803-84d4-b597b68d4aaa tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:51.576499 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-593c25b6-061d-4803-84d4-b597b68d4aaa tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:51.582412 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-593c25b6-061d-4803-84d4-b597b68d4aaa tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:51.582889 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-593c25b6-061d-4803-84d4-b597b68d4aaa tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:51.583322 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-593c25b6-061d-4803-84d4-b597b68d4aaa tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:51.584045 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-593c25b6-061d-4803-84d4-b597b68d4aaa tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:51.584496 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-593c25b6-061d-4803-84d4-b597b68d4aaa tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:51.584948 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-593c25b6-061d-4803-84d4-b597b68d4aaa tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:51.703070 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:04:51.714896 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-593c25b6-061d-4803-84d4-b597b68d4aaa tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:51.722579 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-593c25b6-061d-4803-84d4-b597b68d4aaa tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1506 microversion: 2.1 time: 0.151301 Aug 07 02:04:51.724157 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3067/6600] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:51 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:51.742740 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-91b95276-15e9-4d18-9e1a-561f5ac80649 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:04:51.745075 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-91b95276-15e9-4d18-9e1a-561f5ac80649 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:51.747433 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:04:51.752823 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91b95276-15e9-4d18-9e1a-561f5ac80649 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:51.753323 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91b95276-15e9-4d18-9e1a-561f5ac80649 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:51.753781 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91b95276-15e9-4d18-9e1a-561f5ac80649 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:51.754497 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91b95276-15e9-4d18-9e1a-561f5ac80649 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:51.754969 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91b95276-15e9-4d18-9e1a-561f5ac80649 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:51.755413 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91b95276-15e9-4d18-9e1a-561f5ac80649 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:51.784182 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-91b95276-15e9-4d18-9e1a-561f5ac80649 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:51.789990 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-91b95276-15e9-4d18-9e1a-561f5ac80649 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Old instance type m1.heat2, new instance type m1.heat {{(pid=119516) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 07 02:04:51.796193 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-91b95276-15e9-4d18-9e1a-561f5ac80649 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 02:04:51.796640 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-91b95276-15e9-4d18-9e1a-561f5ac80649 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 02:04:51.797166 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-91b95276-15e9-4d18-9e1a-561f5ac80649 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 02:04:51.797612 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-91b95276-15e9-4d18-9e1a-561f5ac80649 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 02:04:51.798043 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-91b95276-15e9-4d18-9e1a-561f5ac80649 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 02:04:51.859944 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-91b95276-15e9-4d18-9e1a-561f5ac80649 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "POST /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9/action" status: 202 len: 0 microversion: 2.1 time: 0.121078 Aug 07 02:04:51.860477 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3534/6601] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:04:51 2022] POST /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:04:51.868592 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-666e11ca-5bb2-427c-92b3-749481d13149 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:51.869207 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-666e11ca-5bb2-427c-92b3-749481d13149 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:51.875767 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-666e11ca-5bb2-427c-92b3-749481d13149 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:51.876297 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-666e11ca-5bb2-427c-92b3-749481d13149 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:51.876737 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-666e11ca-5bb2-427c-92b3-749481d13149 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:51.877433 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-666e11ca-5bb2-427c-92b3-749481d13149 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:51.877891 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-666e11ca-5bb2-427c-92b3-749481d13149 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:51.878614 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-666e11ca-5bb2-427c-92b3-749481d13149 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:52.042028 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-666e11ca-5bb2-427c-92b3-749481d13149 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:52.051255 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-666e11ca-5bb2-427c-92b3-749481d13149 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1517 microversion: 2.1 time: 0.186556 Aug 07 02:04:52.052045 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3068/6602] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:51 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1517 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:53.075371 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e7ac6c0b-ba92-43dd-a187-9af5d504e481 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:53.076084 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e7ac6c0b-ba92-43dd-a187-9af5d504e481 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:53.082340 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7ac6c0b-ba92-43dd-a187-9af5d504e481 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:53.082830 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7ac6c0b-ba92-43dd-a187-9af5d504e481 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:53.083274 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7ac6c0b-ba92-43dd-a187-9af5d504e481 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:53.084084 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7ac6c0b-ba92-43dd-a187-9af5d504e481 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:53.084551 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7ac6c0b-ba92-43dd-a187-9af5d504e481 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:53.084986 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e7ac6c0b-ba92-43dd-a187-9af5d504e481 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:53.225254 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e7ac6c0b-ba92-43dd-a187-9af5d504e481 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:53.234014 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e7ac6c0b-ba92-43dd-a187-9af5d504e481 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1517 microversion: 2.1 time: 0.164099 Aug 07 02:04:53.234995 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3535/6603] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:53 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:54.258961 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5359fcb0-8cb7-42b7-97b0-8125fe2407eb tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:54.259543 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5359fcb0-8cb7-42b7-97b0-8125fe2407eb tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:54.267066 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5359fcb0-8cb7-42b7-97b0-8125fe2407eb tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:54.267550 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5359fcb0-8cb7-42b7-97b0-8125fe2407eb tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:54.268047 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5359fcb0-8cb7-42b7-97b0-8125fe2407eb tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:54.268752 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5359fcb0-8cb7-42b7-97b0-8125fe2407eb tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:54.269213 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5359fcb0-8cb7-42b7-97b0-8125fe2407eb tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:54.269646 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5359fcb0-8cb7-42b7-97b0-8125fe2407eb tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:54.400644 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5359fcb0-8cb7-42b7-97b0-8125fe2407eb tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:54.408822 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5359fcb0-8cb7-42b7-97b0-8125fe2407eb tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1522 microversion: 2.1 time: 0.153943 Aug 07 02:04:54.409391 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3069/6604] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:54 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:55.430232 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4842fc0c-2f57-498b-a5b6-529931b41215 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:55.431407 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4842fc0c-2f57-498b-a5b6-529931b41215 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:55.438630 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4842fc0c-2f57-498b-a5b6-529931b41215 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:55.439124 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4842fc0c-2f57-498b-a5b6-529931b41215 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:55.439573 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4842fc0c-2f57-498b-a5b6-529931b41215 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:55.440313 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4842fc0c-2f57-498b-a5b6-529931b41215 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:55.440781 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4842fc0c-2f57-498b-a5b6-529931b41215 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:55.441223 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4842fc0c-2f57-498b-a5b6-529931b41215 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:55.576390 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4842fc0c-2f57-498b-a5b6-529931b41215 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:55.583946 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4842fc0c-2f57-498b-a5b6-529931b41215 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1522 microversion: 2.1 time: 0.157883 Aug 07 02:04:55.584517 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3536/6605] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:55 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:56.606115 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c7da01df-a48d-44a5-9f46-b8f75ac1b9ca tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:56.606748 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c7da01df-a48d-44a5-9f46-b8f75ac1b9ca tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:56.609437 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:04:56.614842 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7da01df-a48d-44a5-9f46-b8f75ac1b9ca tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:56.615399 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7da01df-a48d-44a5-9f46-b8f75ac1b9ca tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:56.615836 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7da01df-a48d-44a5-9f46-b8f75ac1b9ca tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:56.616557 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7da01df-a48d-44a5-9f46-b8f75ac1b9ca tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:56.617005 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7da01df-a48d-44a5-9f46-b8f75ac1b9ca tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:56.617426 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7da01df-a48d-44a5-9f46-b8f75ac1b9ca tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:56.750066 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c7da01df-a48d-44a5-9f46-b8f75ac1b9ca tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:56.757576 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c7da01df-a48d-44a5-9f46-b8f75ac1b9ca tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1522 microversion: 2.1 time: 0.156107 Aug 07 02:04:56.758147 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3070/6606] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:56 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:57.778407 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-84651721-0742-4c40-88a9-61ca63b68690 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:57.779069 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-84651721-0742-4c40-88a9-61ca63b68690 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:57.781791 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:04:57.787072 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84651721-0742-4c40-88a9-61ca63b68690 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:57.787566 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84651721-0742-4c40-88a9-61ca63b68690 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:57.788035 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84651721-0742-4c40-88a9-61ca63b68690 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:57.788741 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84651721-0742-4c40-88a9-61ca63b68690 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:57.789207 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84651721-0742-4c40-88a9-61ca63b68690 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:57.789644 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-84651721-0742-4c40-88a9-61ca63b68690 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:57.794749 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:04:57.920756 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-84651721-0742-4c40-88a9-61ca63b68690 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:57.928177 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-84651721-0742-4c40-88a9-61ca63b68690 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1522 microversion: 2.1 time: 0.153708 Aug 07 02:04:57.928778 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3537/6607] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:57 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:04:58.950773 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-42961879-c48d-4ad0-8c11-982e3b5eeeb4 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:04:58.951390 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-42961879-c48d-4ad0-8c11-982e3b5eeeb4 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:04:58.958250 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-42961879-c48d-4ad0-8c11-982e3b5eeeb4 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:58.958729 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-42961879-c48d-4ad0-8c11-982e3b5eeeb4 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:58.959167 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-42961879-c48d-4ad0-8c11-982e3b5eeeb4 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:58.959859 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-42961879-c48d-4ad0-8c11-982e3b5eeeb4 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:04:58.960338 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-42961879-c48d-4ad0-8c11-982e3b5eeeb4 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:04:58.960771 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-42961879-c48d-4ad0-8c11-982e3b5eeeb4 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:04:59.095502 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-42961879-c48d-4ad0-8c11-982e3b5eeeb4 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:04:59.103006 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-42961879-c48d-4ad0-8c11-982e3b5eeeb4 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1522 microversion: 2.1 time: 0.156724 Aug 07 02:04:59.103577 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3071/6608] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:04:58 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:00.123694 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-643dd000-755f-4781-a5bb-e62343acfa6d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:00.124385 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-643dd000-755f-4781-a5bb-e62343acfa6d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:00.131308 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-643dd000-755f-4781-a5bb-e62343acfa6d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:00.131807 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-643dd000-755f-4781-a5bb-e62343acfa6d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:00.132288 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-643dd000-755f-4781-a5bb-e62343acfa6d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:00.133006 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-643dd000-755f-4781-a5bb-e62343acfa6d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:00.133478 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-643dd000-755f-4781-a5bb-e62343acfa6d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:00.133925 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-643dd000-755f-4781-a5bb-e62343acfa6d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:00.260331 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-643dd000-755f-4781-a5bb-e62343acfa6d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:00.268339 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-643dd000-755f-4781-a5bb-e62343acfa6d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1522 microversion: 2.1 time: 0.148544 Aug 07 02:05:00.268908 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3538/6609] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:00 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:01.289862 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6d3932c2-e830-43c6-8211-810325e5292c tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:01.290402 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6d3932c2-e830-43c6-8211-810325e5292c tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:01.297965 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6d3932c2-e830-43c6-8211-810325e5292c tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:01.298447 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6d3932c2-e830-43c6-8211-810325e5292c tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:01.298888 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6d3932c2-e830-43c6-8211-810325e5292c tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:01.299584 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6d3932c2-e830-43c6-8211-810325e5292c tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:01.300079 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6d3932c2-e830-43c6-8211-810325e5292c tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:01.300514 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6d3932c2-e830-43c6-8211-810325e5292c tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:01.437173 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6d3932c2-e830-43c6-8211-810325e5292c tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:01.444787 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6d3932c2-e830-43c6-8211-810325e5292c tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1522 microversion: 2.1 time: 0.158973 Aug 07 02:05:01.445341 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3072/6610] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:01 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:02.465440 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9692f4b1-2751-4187-af91-913947ac8a62 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:02.466069 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9692f4b1-2751-4187-af91-913947ac8a62 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:02.473066 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9692f4b1-2751-4187-af91-913947ac8a62 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:02.473562 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9692f4b1-2751-4187-af91-913947ac8a62 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:02.474014 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9692f4b1-2751-4187-af91-913947ac8a62 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:02.474728 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9692f4b1-2751-4187-af91-913947ac8a62 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:02.475197 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9692f4b1-2751-4187-af91-913947ac8a62 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:02.475639 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9692f4b1-2751-4187-af91-913947ac8a62 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:02.607147 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9692f4b1-2751-4187-af91-913947ac8a62 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:02.614578 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9692f4b1-2751-4187-af91-913947ac8a62 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1522 microversion: 2.1 time: 0.153016 Aug 07 02:05:02.615139 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3539/6611] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:02 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:03.635479 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f8b8ff57-705f-4485-8424-86b987bb2a5d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:03.636134 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f8b8ff57-705f-4485-8424-86b987bb2a5d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:03.643215 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f8b8ff57-705f-4485-8424-86b987bb2a5d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:03.643707 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f8b8ff57-705f-4485-8424-86b987bb2a5d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:03.644180 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f8b8ff57-705f-4485-8424-86b987bb2a5d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:03.645012 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f8b8ff57-705f-4485-8424-86b987bb2a5d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:03.645485 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f8b8ff57-705f-4485-8424-86b987bb2a5d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:03.645918 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f8b8ff57-705f-4485-8424-86b987bb2a5d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:03.776132 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f8b8ff57-705f-4485-8424-86b987bb2a5d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:03.784343 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f8b8ff57-705f-4485-8424-86b987bb2a5d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1522 microversion: 2.1 time: 0.152750 Aug 07 02:05:03.784924 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3073/6612] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:03 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:04.805950 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9930b3ea-1175-42aa-9481-1f881db81112 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:04.806525 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9930b3ea-1175-42aa-9481-1f881db81112 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:04.814117 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9930b3ea-1175-42aa-9481-1f881db81112 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:04.814615 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9930b3ea-1175-42aa-9481-1f881db81112 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:04.815073 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9930b3ea-1175-42aa-9481-1f881db81112 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:04.815781 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9930b3ea-1175-42aa-9481-1f881db81112 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:04.816272 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9930b3ea-1175-42aa-9481-1f881db81112 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:04.816716 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9930b3ea-1175-42aa-9481-1f881db81112 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:04.944374 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9930b3ea-1175-42aa-9481-1f881db81112 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:04.951951 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9930b3ea-1175-42aa-9481-1f881db81112 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1522 microversion: 2.1 time: 0.149991 Aug 07 02:05:04.952515 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3540/6613] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:04 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:05.977096 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-78b86f24-2761-448a-bc87-eb50536687b8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:05.977710 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-78b86f24-2761-448a-bc87-eb50536687b8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:05.984805 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78b86f24-2761-448a-bc87-eb50536687b8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:05.985287 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78b86f24-2761-448a-bc87-eb50536687b8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:05.985712 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78b86f24-2761-448a-bc87-eb50536687b8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:05.986429 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78b86f24-2761-448a-bc87-eb50536687b8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:05.986878 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78b86f24-2761-448a-bc87-eb50536687b8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:05.987296 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-78b86f24-2761-448a-bc87-eb50536687b8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:06.135566 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-78b86f24-2761-448a-bc87-eb50536687b8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:06.143263 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-78b86f24-2761-448a-bc87-eb50536687b8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1522 microversion: 2.1 time: 0.170115 Aug 07 02:05:06.143808 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3074/6614] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:05 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:05:07.164132 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7f14d0a1-e07b-47d8-ad7a-dc21ac3e9040 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:07.164768 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7f14d0a1-e07b-47d8-ad7a-dc21ac3e9040 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:07.171649 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f14d0a1-e07b-47d8-ad7a-dc21ac3e9040 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:07.172192 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f14d0a1-e07b-47d8-ad7a-dc21ac3e9040 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:07.172635 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f14d0a1-e07b-47d8-ad7a-dc21ac3e9040 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:07.173359 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f14d0a1-e07b-47d8-ad7a-dc21ac3e9040 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:07.173832 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f14d0a1-e07b-47d8-ad7a-dc21ac3e9040 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:07.174280 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f14d0a1-e07b-47d8-ad7a-dc21ac3e9040 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:07.304864 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7f14d0a1-e07b-47d8-ad7a-dc21ac3e9040 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:07.312812 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7f14d0a1-e07b-47d8-ad7a-dc21ac3e9040 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1522 microversion: 2.1 time: 0.152684 Aug 07 02:05:07.313381 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3541/6615] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:07 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:08.334377 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-132be13c-f335-4791-adea-a06350d9ce13 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:08.334999 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-132be13c-f335-4791-adea-a06350d9ce13 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:08.342507 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-132be13c-f335-4791-adea-a06350d9ce13 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:08.342982 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-132be13c-f335-4791-adea-a06350d9ce13 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:08.343415 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-132be13c-f335-4791-adea-a06350d9ce13 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:08.344128 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-132be13c-f335-4791-adea-a06350d9ce13 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:08.344580 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-132be13c-f335-4791-adea-a06350d9ce13 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:08.345002 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-132be13c-f335-4791-adea-a06350d9ce13 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:08.472526 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-132be13c-f335-4791-adea-a06350d9ce13 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:08.480311 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-132be13c-f335-4791-adea-a06350d9ce13 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1522 microversion: 2.1 time: 0.149503 Aug 07 02:05:08.480875 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3075/6616] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:08 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:09.501322 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3c796a83-ddac-4b72-9b74-eefeac60ad62 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:09.501951 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3c796a83-ddac-4b72-9b74-eefeac60ad62 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:09.508895 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c796a83-ddac-4b72-9b74-eefeac60ad62 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:09.509385 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c796a83-ddac-4b72-9b74-eefeac60ad62 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:09.509836 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c796a83-ddac-4b72-9b74-eefeac60ad62 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:09.510544 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c796a83-ddac-4b72-9b74-eefeac60ad62 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:09.511010 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c796a83-ddac-4b72-9b74-eefeac60ad62 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:09.511455 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c796a83-ddac-4b72-9b74-eefeac60ad62 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:09.642311 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3c796a83-ddac-4b72-9b74-eefeac60ad62 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:09.650138 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3c796a83-ddac-4b72-9b74-eefeac60ad62 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1522 microversion: 2.1 time: 0.152660 Aug 07 02:05:09.650734 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3542/6617] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:09 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:10.671754 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e4730fb0-0d86-4b7b-bc09-d74274bd46ff tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:10.672322 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e4730fb0-0d86-4b7b-bc09-d74274bd46ff tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:10.679237 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4730fb0-0d86-4b7b-bc09-d74274bd46ff tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:10.679717 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4730fb0-0d86-4b7b-bc09-d74274bd46ff tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:10.680195 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4730fb0-0d86-4b7b-bc09-d74274bd46ff tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:10.680891 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4730fb0-0d86-4b7b-bc09-d74274bd46ff tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:10.681347 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4730fb0-0d86-4b7b-bc09-d74274bd46ff tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:10.681781 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e4730fb0-0d86-4b7b-bc09-d74274bd46ff tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:10.814054 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e4730fb0-0d86-4b7b-bc09-d74274bd46ff tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:10.821420 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e4730fb0-0d86-4b7b-bc09-d74274bd46ff tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1522 microversion: 2.1 time: 0.154147 Aug 07 02:05:10.822234 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3076/6618] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:10 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:11.842090 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f7720f8e-ea30-4502-9113-e13428f0ac01 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:11.842712 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f7720f8e-ea30-4502-9113-e13428f0ac01 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:11.849555 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f7720f8e-ea30-4502-9113-e13428f0ac01 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:11.850048 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f7720f8e-ea30-4502-9113-e13428f0ac01 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:11.850491 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f7720f8e-ea30-4502-9113-e13428f0ac01 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:11.851226 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f7720f8e-ea30-4502-9113-e13428f0ac01 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:11.851691 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f7720f8e-ea30-4502-9113-e13428f0ac01 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:11.852149 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f7720f8e-ea30-4502-9113-e13428f0ac01 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:11.985835 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f7720f8e-ea30-4502-9113-e13428f0ac01 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:11.993858 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f7720f8e-ea30-4502-9113-e13428f0ac01 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1522 microversion: 2.1 time: 0.155704 Aug 07 02:05:11.994423 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3543/6619] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:11 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:13.016062 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-27cd2e5d-79de-45eb-b1e0-3540ea6a2674 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:13.016683 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-27cd2e5d-79de-45eb-b1e0-3540ea6a2674 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:13.023685 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27cd2e5d-79de-45eb-b1e0-3540ea6a2674 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:13.024202 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27cd2e5d-79de-45eb-b1e0-3540ea6a2674 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:13.024647 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27cd2e5d-79de-45eb-b1e0-3540ea6a2674 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:13.025348 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27cd2e5d-79de-45eb-b1e0-3540ea6a2674 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:13.025809 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27cd2e5d-79de-45eb-b1e0-3540ea6a2674 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:13.026240 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-27cd2e5d-79de-45eb-b1e0-3540ea6a2674 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:13.044551 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:05:13.159727 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-27cd2e5d-79de-45eb-b1e0-3540ea6a2674 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:13.167664 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-27cd2e5d-79de-45eb-b1e0-3540ea6a2674 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1522 microversion: 2.1 time: 0.156049 Aug 07 02:05:13.168273 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3077/6620] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:13 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:14.187838 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d45f7059-c25c-4084-8a0a-35d2487d6bfa tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:14.188447 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d45f7059-c25c-4084-8a0a-35d2487d6bfa tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:14.195287 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d45f7059-c25c-4084-8a0a-35d2487d6bfa tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:14.195791 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d45f7059-c25c-4084-8a0a-35d2487d6bfa tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:14.196275 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d45f7059-c25c-4084-8a0a-35d2487d6bfa tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:14.197000 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d45f7059-c25c-4084-8a0a-35d2487d6bfa tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:14.197478 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d45f7059-c25c-4084-8a0a-35d2487d6bfa tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:14.197914 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d45f7059-c25c-4084-8a0a-35d2487d6bfa tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:14.325386 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d45f7059-c25c-4084-8a0a-35d2487d6bfa tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:14.333150 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d45f7059-c25c-4084-8a0a-35d2487d6bfa tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1522 microversion: 2.1 time: 0.149215 Aug 07 02:05:14.333798 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3544/6621] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:14 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:15.354674 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-80ae07cf-009e-45b7-bd37-e827f750a3f0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:15.356084 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-80ae07cf-009e-45b7-bd37-e827f750a3f0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:15.363438 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-80ae07cf-009e-45b7-bd37-e827f750a3f0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:15.363940 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-80ae07cf-009e-45b7-bd37-e827f750a3f0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:15.364378 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-80ae07cf-009e-45b7-bd37-e827f750a3f0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:15.365078 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-80ae07cf-009e-45b7-bd37-e827f750a3f0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:15.365534 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-80ae07cf-009e-45b7-bd37-e827f750a3f0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:15.365963 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-80ae07cf-009e-45b7-bd37-e827f750a3f0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:15.498997 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-80ae07cf-009e-45b7-bd37-e827f750a3f0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:15.506619 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-80ae07cf-009e-45b7-bd37-e827f750a3f0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1522 microversion: 2.1 time: 0.155905 Aug 07 02:05:15.507188 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3078/6622] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:15 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:16.527568 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-48533760-9934-48aa-a1e4-22234a02394f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:16.528229 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-48533760-9934-48aa-a1e4-22234a02394f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:16.534855 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48533760-9934-48aa-a1e4-22234a02394f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:16.535355 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48533760-9934-48aa-a1e4-22234a02394f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:16.535807 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48533760-9934-48aa-a1e4-22234a02394f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:16.536550 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48533760-9934-48aa-a1e4-22234a02394f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:16.537023 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48533760-9934-48aa-a1e4-22234a02394f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:16.537482 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-48533760-9934-48aa-a1e4-22234a02394f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:16.663465 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-48533760-9934-48aa-a1e4-22234a02394f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:16.671508 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-48533760-9934-48aa-a1e4-22234a02394f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1522 microversion: 2.1 time: 0.148188 Aug 07 02:05:16.672101 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3545/6623] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:16 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:17.693083 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cd75cc40-1c43-4799-b800-43dccde947c2 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:17.693698 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-cd75cc40-1c43-4799-b800-43dccde947c2 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:17.701269 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cd75cc40-1c43-4799-b800-43dccde947c2 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:17.701752 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cd75cc40-1c43-4799-b800-43dccde947c2 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:17.702189 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cd75cc40-1c43-4799-b800-43dccde947c2 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:17.702885 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cd75cc40-1c43-4799-b800-43dccde947c2 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:17.703340 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cd75cc40-1c43-4799-b800-43dccde947c2 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:17.703767 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cd75cc40-1c43-4799-b800-43dccde947c2 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:17.833490 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-cd75cc40-1c43-4799-b800-43dccde947c2 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:17.841579 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cd75cc40-1c43-4799-b800-43dccde947c2 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1522 microversion: 2.1 time: 0.152416 Aug 07 02:05:17.842163 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3079/6624] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:17 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:18.862197 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6c436789-ce74-46e4-9676-5e7f7c207d49 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:18.862829 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6c436789-ce74-46e4-9676-5e7f7c207d49 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:18.869658 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c436789-ce74-46e4-9676-5e7f7c207d49 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:18.870152 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c436789-ce74-46e4-9676-5e7f7c207d49 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:18.870597 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c436789-ce74-46e4-9676-5e7f7c207d49 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:18.871972 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c436789-ce74-46e4-9676-5e7f7c207d49 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:18.872439 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c436789-ce74-46e4-9676-5e7f7c207d49 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:18.872877 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c436789-ce74-46e4-9676-5e7f7c207d49 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:19.006050 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6c436789-ce74-46e4-9676-5e7f7c207d49 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:19.013563 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6c436789-ce74-46e4-9676-5e7f7c207d49 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1522 microversion: 2.1 time: 0.155261 Aug 07 02:05:19.014125 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3546/6625] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:18 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:20.033888 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7d623ef8-25ca-4e99-83f4-d9e274dc87ce tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:20.034510 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7d623ef8-25ca-4e99-83f4-d9e274dc87ce tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:20.041356 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7d623ef8-25ca-4e99-83f4-d9e274dc87ce tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:20.041841 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7d623ef8-25ca-4e99-83f4-d9e274dc87ce tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:20.042286 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7d623ef8-25ca-4e99-83f4-d9e274dc87ce tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:20.043612 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7d623ef8-25ca-4e99-83f4-d9e274dc87ce tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:20.044106 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7d623ef8-25ca-4e99-83f4-d9e274dc87ce tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:20.044540 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7d623ef8-25ca-4e99-83f4-d9e274dc87ce tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:20.175008 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7d623ef8-25ca-4e99-83f4-d9e274dc87ce tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:20.182510 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7d623ef8-25ca-4e99-83f4-d9e274dc87ce tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1522 microversion: 2.1 time: 0.152588 Aug 07 02:05:20.183353 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3080/6626] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:20 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:21.202730 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a28ef929-89df-4957-a2d8-c1f8231ae00f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:21.203366 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a28ef929-89df-4957-a2d8-c1f8231ae00f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:21.210330 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a28ef929-89df-4957-a2d8-c1f8231ae00f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:21.210833 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a28ef929-89df-4957-a2d8-c1f8231ae00f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:21.211291 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a28ef929-89df-4957-a2d8-c1f8231ae00f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:21.212041 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a28ef929-89df-4957-a2d8-c1f8231ae00f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:21.212520 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a28ef929-89df-4957-a2d8-c1f8231ae00f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:21.212964 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a28ef929-89df-4957-a2d8-c1f8231ae00f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:21.429852 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a28ef929-89df-4957-a2d8-c1f8231ae00f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:21.437598 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a28ef929-89df-4957-a2d8-c1f8231ae00f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1521 microversion: 2.1 time: 0.238853 Aug 07 02:05:21.438176 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3547/6627] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:21 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:21.782156 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-b8f3e804-12d2-41f2-a086-7bb31cc021de req-106ad08c-6075-48fd-9698-43bbe6c5f421 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fb23c99-88b5-40f9-b37a-06da106524c9", "name": "network-vif-unplugged", "status": "completed", "tag": "fcc467ba-5d5a-4df6-997d-9a02ee24a52b"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:05:21.797422 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b8f3e804-12d2-41f2-a086-7bb31cc021de req-106ad08c-6075-48fd-9698-43bbe6c5f421 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:21.798222 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b8f3e804-12d2-41f2-a086-7bb31cc021de req-106ad08c-6075-48fd-9698-43bbe6c5f421 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:21.798658 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b8f3e804-12d2-41f2-a086-7bb31cc021de req-106ad08c-6075-48fd-9698-43bbe6c5f421 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:21.810893 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-b8f3e804-12d2-41f2-a086-7bb31cc021de req-106ad08c-6075-48fd-9698-43bbe6c5f421 service nova] Creating event network-vif-unplugged:fcc467ba-5d5a-4df6-997d-9a02ee24a52b for instance 6fb23c99-88b5-40f9-b37a-06da106524c9 on n-h1-master-1 Aug 07 02:05:21.816508 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [req-b8f3e804-12d2-41f2-a086-7bb31cc021de req-106ad08c-6075-48fd-9698-43bbe6c5f421 service nova] Instance 6fb23c99-88b5-40f9-b37a-06da106524c9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 02:05:21.828663 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-b8f3e804-12d2-41f2-a086-7bb31cc021de req-106ad08c-6075-48fd-9698-43bbe6c5f421 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050154 Aug 07 02:05:21.829816 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3081/6628] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:05:22.460292 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f87d4fe7-5e42-4e39-aa24-c201e9b10387 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:22.460926 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f87d4fe7-5e42-4e39-aa24-c201e9b10387 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:22.467761 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f87d4fe7-5e42-4e39-aa24-c201e9b10387 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:22.468287 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f87d4fe7-5e42-4e39-aa24-c201e9b10387 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:22.468739 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f87d4fe7-5e42-4e39-aa24-c201e9b10387 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:22.469457 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f87d4fe7-5e42-4e39-aa24-c201e9b10387 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:22.469956 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f87d4fe7-5e42-4e39-aa24-c201e9b10387 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:22.470397 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f87d4fe7-5e42-4e39-aa24-c201e9b10387 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:22.608067 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f87d4fe7-5e42-4e39-aa24-c201e9b10387 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:22.615701 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f87d4fe7-5e42-4e39-aa24-c201e9b10387 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1521 microversion: 2.1 time: 0.159277 Aug 07 02:05:22.616315 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3548/6629] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:22 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:23.639133 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c05321dc-571a-421e-a639-4119aad296f3 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:23.639833 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c05321dc-571a-421e-a639-4119aad296f3 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:23.646058 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c05321dc-571a-421e-a639-4119aad296f3 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:23.646535 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c05321dc-571a-421e-a639-4119aad296f3 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:23.646970 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c05321dc-571a-421e-a639-4119aad296f3 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:23.647659 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c05321dc-571a-421e-a639-4119aad296f3 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:23.648150 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c05321dc-571a-421e-a639-4119aad296f3 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:23.648577 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c05321dc-571a-421e-a639-4119aad296f3 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:23.783725 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c05321dc-571a-421e-a639-4119aad296f3 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:23.791438 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c05321dc-571a-421e-a639-4119aad296f3 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1519 microversion: 2.1 time: 0.157968 Aug 07 02:05:23.792074 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3082/6630] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:23 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:23.856612 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-17f8421d-e3c0-420b-ad4b-d8f102e7d553 req-556e2c48-bad7-4b34-a584-7e92ec59d75d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fb23c99-88b5-40f9-b37a-06da106524c9", "tag": "fcc467ba-5d5a-4df6-997d-9a02ee24a52b"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:05:23.866916 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-17f8421d-e3c0-420b-ad4b-d8f102e7d553 req-556e2c48-bad7-4b34-a584-7e92ec59d75d service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:23.867638 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-17f8421d-e3c0-420b-ad4b-d8f102e7d553 req-556e2c48-bad7-4b34-a584-7e92ec59d75d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:23.868113 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-17f8421d-e3c0-420b-ad4b-d8f102e7d553 req-556e2c48-bad7-4b34-a584-7e92ec59d75d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:23.880010 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-17f8421d-e3c0-420b-ad4b-d8f102e7d553 req-556e2c48-bad7-4b34-a584-7e92ec59d75d service nova] Creating event network-changed:fcc467ba-5d5a-4df6-997d-9a02ee24a52b for instance 6fb23c99-88b5-40f9-b37a-06da106524c9 on n-h1-master-1 Aug 07 02:05:23.885217 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [req-17f8421d-e3c0-420b-ad4b-d8f102e7d553 req-556e2c48-bad7-4b34-a584-7e92ec59d75d service nova] Instance 6fb23c99-88b5-40f9-b37a-06da106524c9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 02:05:23.896560 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-17f8421d-e3c0-420b-ad4b-d8f102e7d553 req-556e2c48-bad7-4b34-a584-7e92ec59d75d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043827 Aug 07 02:05:23.897137 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3549/6631] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:05:24.812356 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-40c4f219-1abd-46a2-8497-88afa467fb47 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:24.812968 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-40c4f219-1abd-46a2-8497-88afa467fb47 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:24.819701 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-40c4f219-1abd-46a2-8497-88afa467fb47 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:24.820212 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-40c4f219-1abd-46a2-8497-88afa467fb47 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:24.820645 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-40c4f219-1abd-46a2-8497-88afa467fb47 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:24.821329 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-40c4f219-1abd-46a2-8497-88afa467fb47 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:24.821775 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-40c4f219-1abd-46a2-8497-88afa467fb47 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:24.822196 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-40c4f219-1abd-46a2-8497-88afa467fb47 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:24.954117 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-40c4f219-1abd-46a2-8497-88afa467fb47 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:24.961793 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-40c4f219-1abd-46a2-8497-88afa467fb47 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1516 microversion: 2.1 time: 0.153216 Aug 07 02:05:24.962343 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3083/6632] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:24 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:24.984562 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6fcf8ae1-676c-47db-a398-51e52896200a tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:05:24.985193 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6fcf8ae1-676c-47db-a398-51e52896200a tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:24.991494 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6fcf8ae1-676c-47db-a398-51e52896200a tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:24.992029 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6fcf8ae1-676c-47db-a398-51e52896200a tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:24.992477 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6fcf8ae1-676c-47db-a398-51e52896200a tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:24.993186 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6fcf8ae1-676c-47db-a398-51e52896200a tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:24.993646 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6fcf8ae1-676c-47db-a398-51e52896200a tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:24.994082 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6fcf8ae1-676c-47db-a398-51e52896200a tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:25.051962 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6fcf8ae1-676c-47db-a398-51e52896200a tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "POST /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9/action" status: 204 len: 0 microversion: 2.1 time: 0.072163 Aug 07 02:05:25.052603 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3550/6633] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:05:24 2022] POST /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 02:05:25.060724 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2b356966-2e83-49d7-82b9-1dd59d38ddf1 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:25.061518 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2b356966-2e83-49d7-82b9-1dd59d38ddf1 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:25.068055 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b356966-2e83-49d7-82b9-1dd59d38ddf1 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:25.068677 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b356966-2e83-49d7-82b9-1dd59d38ddf1 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:25.069145 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b356966-2e83-49d7-82b9-1dd59d38ddf1 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:25.069838 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b356966-2e83-49d7-82b9-1dd59d38ddf1 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:25.070303 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b356966-2e83-49d7-82b9-1dd59d38ddf1 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:25.070732 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b356966-2e83-49d7-82b9-1dd59d38ddf1 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:25.283338 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2b356966-2e83-49d7-82b9-1dd59d38ddf1 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:25.292447 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2b356966-2e83-49d7-82b9-1dd59d38ddf1 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1516 microversion: 2.1 time: 0.235580 Aug 07 02:05:25.293048 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3084/6634] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:25 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1516 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:26.143838 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-c0bc1340-fae8-47a2-907b-19fac1c8c5eb req-52beccb2-b4fe-4652-b227-f25e559abd59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fb23c99-88b5-40f9-b37a-06da106524c9", "name": "network-vif-plugged", "status": "completed", "tag": "fcc467ba-5d5a-4df6-997d-9a02ee24a52b"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:05:26.156914 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c0bc1340-fae8-47a2-907b-19fac1c8c5eb req-52beccb2-b4fe-4652-b227-f25e559abd59 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:26.157418 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c0bc1340-fae8-47a2-907b-19fac1c8c5eb req-52beccb2-b4fe-4652-b227-f25e559abd59 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:26.157870 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c0bc1340-fae8-47a2-907b-19fac1c8c5eb req-52beccb2-b4fe-4652-b227-f25e559abd59 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:26.170507 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-c0bc1340-fae8-47a2-907b-19fac1c8c5eb req-52beccb2-b4fe-4652-b227-f25e559abd59 service nova] Creating event network-vif-plugged:fcc467ba-5d5a-4df6-997d-9a02ee24a52b for instance 6fb23c99-88b5-40f9-b37a-06da106524c9 on n-h1-master-1 Aug 07 02:05:26.176089 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [req-c0bc1340-fae8-47a2-907b-19fac1c8c5eb req-52beccb2-b4fe-4652-b227-f25e559abd59 service nova] Instance 6fb23c99-88b5-40f9-b37a-06da106524c9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 02:05:26.187737 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-c0bc1340-fae8-47a2-907b-19fac1c8c5eb req-52beccb2-b4fe-4652-b227-f25e559abd59 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047759 Aug 07 02:05:26.188528 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3551/6635] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:05:26.313865 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a7aa20f8-cab5-4755-9204-686d6a35d79d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:26.314485 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a7aa20f8-cab5-4755-9204-686d6a35d79d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:26.321417 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a7aa20f8-cab5-4755-9204-686d6a35d79d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:26.321901 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a7aa20f8-cab5-4755-9204-686d6a35d79d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:26.322339 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a7aa20f8-cab5-4755-9204-686d6a35d79d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:26.323039 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a7aa20f8-cab5-4755-9204-686d6a35d79d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:26.324015 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a7aa20f8-cab5-4755-9204-686d6a35d79d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:26.324442 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a7aa20f8-cab5-4755-9204-686d6a35d79d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:26.460193 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a7aa20f8-cab5-4755-9204-686d6a35d79d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:26.468735 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a7aa20f8-cab5-4755-9204-686d6a35d79d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1508 microversion: 2.1 time: 0.159191 Aug 07 02:05:26.469307 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3085/6636] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:26 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:26.492311 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ec06d10c-7090-46e1-8110-742cc0648f25 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:26.493031 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ec06d10c-7090-46e1-8110-742cc0648f25 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:26.499291 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec06d10c-7090-46e1-8110-742cc0648f25 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:26.499794 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec06d10c-7090-46e1-8110-742cc0648f25 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:26.500354 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec06d10c-7090-46e1-8110-742cc0648f25 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:26.501084 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec06d10c-7090-46e1-8110-742cc0648f25 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:26.501802 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec06d10c-7090-46e1-8110-742cc0648f25 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:26.502315 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ec06d10c-7090-46e1-8110-742cc0648f25 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:26.637389 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ec06d10c-7090-46e1-8110-742cc0648f25 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:26.645012 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ec06d10c-7090-46e1-8110-742cc0648f25 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1508 microversion: 2.1 time: 0.156972 Aug 07 02:05:26.645572 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3552/6637] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:26 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:26.668328 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-af2d168e-b6c0-4ae5-8f04-dbbdbf8119f9 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Action: 'create', calling method: .version_select at 0x7f9e24006550>, body: {"keypair": {"name": "tempest-keypair-467519583", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGEZgg+XNDWoNElN6bQZ5+GEcp/vaHUfh9tv2CjXUA3/l0jUn2fBU71oKgoXuvA2wnwh/XMCzVJGmOt6jM9a12twOfBN1x/D7d6c/XfWb6bGa/vOx+aMrmBzSitc02Y8w=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:05:26.673566 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=32 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:05:26.685659 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-af2d168e-b6c0-4ae5-8f04-dbbdbf8119f9 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Getting quotas for project b5313574dcf84819b58af883ac6cb768. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:05:26.690774 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-af2d168e-b6c0-4ae5-8f04-dbbdbf8119f9 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Getting quotas for user bbf878e8b08d4c85bb3fb925db315ac4 and project b5313574dcf84819b58af883ac6cb768. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:05:26.715390 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-af2d168e-b6c0-4ae5-8f04-dbbdbf8119f9 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050859 Aug 07 02:05:26.719515 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3086/6638] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 02:05:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:05:27.915522 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d783970b-2bba-48a4-a75d-5b010fb9e1a0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:27.916195 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d783970b-2bba-48a4-a75d-5b010fb9e1a0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:27.919550 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=32 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:05:27.924925 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d783970b-2bba-48a4-a75d-5b010fb9e1a0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:27.925427 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d783970b-2bba-48a4-a75d-5b010fb9e1a0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:27.925884 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d783970b-2bba-48a4-a75d-5b010fb9e1a0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:27.926601 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d783970b-2bba-48a4-a75d-5b010fb9e1a0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:27.927074 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d783970b-2bba-48a4-a75d-5b010fb9e1a0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:27.927520 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d783970b-2bba-48a4-a75d-5b010fb9e1a0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:27.930296 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:05:28.056363 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d783970b-2bba-48a4-a75d-5b010fb9e1a0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:28.064538 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d783970b-2bba-48a4-a75d-5b010fb9e1a0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 200 len: 1508 microversion: 2.1 time: 0.152892 Aug 07 02:05:28.065137 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3553/6639] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:27 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:28.085810 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9989831b-3871-4754-9f15-7d864bde7b52 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:28.086321 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9989831b-3871-4754-9f15-7d864bde7b52 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:28.092984 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9989831b-3871-4754-9f15-7d864bde7b52 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:28.093474 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9989831b-3871-4754-9f15-7d864bde7b52 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:28.093920 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9989831b-3871-4754-9f15-7d864bde7b52 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:28.094620 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9989831b-3871-4754-9f15-7d864bde7b52 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:28.095079 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9989831b-3871-4754-9f15-7d864bde7b52 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:28.095528 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9989831b-3871-4754-9f15-7d864bde7b52 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:28.120181 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9989831b-3871-4754-9f15-7d864bde7b52 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 02:05:28.193957 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9989831b-3871-4754-9f15-7d864bde7b52 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 204 len: 0 microversion: 2.1 time: 0.112897 Aug 07 02:05:28.194711 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3087/6640] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 02:05:28 2022] DELETE /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 02:05:28.253700 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9ed93b43-00e8-4398-b16c-77fbc0a8b3b8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-576539923", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "c60c83c3-7d07-4112-bcea-7e4c3ed69f01"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:05:28.305793 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-9ed93b43-00e8-4398-b16c-77fbc0a8b3b8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] validate_networks() for [('c60c83c3-7d07-4112-bcea-7e4c3ed69f01', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 02:05:28.675375 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-9ed93b43-00e8-4398-b16c-77fbc0a8b3b8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 02:05:28.675815 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-9ed93b43-00e8-4398-b16c-77fbc0a8b3b8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 02:05:28.676336 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-9ed93b43-00e8-4398-b16c-77fbc0a8b3b8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 02:05:28.676798 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-9ed93b43-00e8-4398-b16c-77fbc0a8b3b8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 02:05:28.677229 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-9ed93b43-00e8-4398-b16c-77fbc0a8b3b8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 02:05:28.686144 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9ed93b43-00e8-4398-b16c-77fbc0a8b3b8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:28.686645 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9ed93b43-00e8-4398-b16c-77fbc0a8b3b8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:28.687093 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9ed93b43-00e8-4398-b16c-77fbc0a8b3b8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:28.687833 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9ed93b43-00e8-4398-b16c-77fbc0a8b3b8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:28.688334 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9ed93b43-00e8-4398-b16c-77fbc0a8b3b8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:28.688771 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9ed93b43-00e8-4398-b16c-77fbc0a8b3b8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:28.705634 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-9ed93b43-00e8-4398-b16c-77fbc0a8b3b8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Getting quotas for project b5313574dcf84819b58af883ac6cb768. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:05:28.710841 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-9ed93b43-00e8-4398-b16c-77fbc0a8b3b8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Getting quotas for user bbf878e8b08d4c85bb3fb925db315ac4 and project b5313574dcf84819b58af883ac6cb768. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:05:28.723612 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9ed93b43-00e8-4398-b16c-77fbc0a8b3b8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 02:05:28.725889 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9ed93b43-00e8-4398-b16c-77fbc0a8b3b8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 02:05:28.770743 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9ed93b43-00e8-4398-b16c-77fbc0a8b3b8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.520941 Aug 07 02:05:28.771381 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3554/6641] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 02:05:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 02:05:28.783264 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1a7f5ad5-098f-4ff8-a9b2-8c1d65b883a0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:28.784121 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1a7f5ad5-098f-4ff8-a9b2-8c1d65b883a0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:28.837079 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1a7f5ad5-098f-4ff8-a9b2-8c1d65b883a0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:28.844735 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1a7f5ad5-098f-4ff8-a9b2-8c1d65b883a0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1217 microversion: 2.1 time: 0.065686 Aug 07 02:05:28.845320 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3088/6642] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:28 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1217 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:29.866231 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-31ac2c20-1cb7-43a1-9d77-a8842b5e6b4d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:29.866883 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-31ac2c20-1cb7-43a1-9d77-a8842b5e6b4d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:29.873743 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31ac2c20-1cb7-43a1-9d77-a8842b5e6b4d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:29.874235 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31ac2c20-1cb7-43a1-9d77-a8842b5e6b4d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:29.874681 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31ac2c20-1cb7-43a1-9d77-a8842b5e6b4d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:29.875379 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31ac2c20-1cb7-43a1-9d77-a8842b5e6b4d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:29.875871 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31ac2c20-1cb7-43a1-9d77-a8842b5e6b4d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:29.876328 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31ac2c20-1cb7-43a1-9d77-a8842b5e6b4d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:29.947506 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-31ac2c20-1cb7-43a1-9d77-a8842b5e6b4d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:29.955325 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-31ac2c20-1cb7-43a1-9d77-a8842b5e6b4d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1269 microversion: 2.1 time: 0.093781 Aug 07 02:05:29.956235 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3555/6643] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:29 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1269 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:30.333229 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-9ca7c931-b690-4d45-99c6-d3bb578e6d69 req-bed120e2-812d-4861-a090-b1f7a5142ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fb23c99-88b5-40f9-b37a-06da106524c9", "name": "network-vif-deleted", "tag": "fcc467ba-5d5a-4df6-997d-9a02ee24a52b"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:05:30.345433 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-9ca7c931-b690-4d45-99c6-d3bb578e6d69 req-bed120e2-812d-4861-a090-b1f7a5142ea1 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:30.345919 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-9ca7c931-b690-4d45-99c6-d3bb578e6d69 req-bed120e2-812d-4861-a090-b1f7a5142ea1 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:30.346357 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-9ca7c931-b690-4d45-99c6-d3bb578e6d69 req-bed120e2-812d-4861-a090-b1f7a5142ea1 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:30.359068 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-9ca7c931-b690-4d45-99c6-d3bb578e6d69 req-bed120e2-812d-4861-a090-b1f7a5142ea1 service nova] Creating event network-vif-deleted:fcc467ba-5d5a-4df6-997d-9a02ee24a52b for instance 6fb23c99-88b5-40f9-b37a-06da106524c9 on n-h1-master-1 Aug 07 02:05:30.364435 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-9ca7c931-b690-4d45-99c6-d3bb578e6d69 req-bed120e2-812d-4861-a090-b1f7a5142ea1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034747 Aug 07 02:05:30.368308 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3089/6644] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:05:30.977353 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-857bef42-a6b3-4b27-83e9-3cc0ad10b123 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:30.978721 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-857bef42-a6b3-4b27-83e9-3cc0ad10b123 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:30.987757 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-857bef42-a6b3-4b27-83e9-3cc0ad10b123 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:30.988484 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-857bef42-a6b3-4b27-83e9-3cc0ad10b123 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:30.989099 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-857bef42-a6b3-4b27-83e9-3cc0ad10b123 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:30.989982 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-857bef42-a6b3-4b27-83e9-3cc0ad10b123 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:30.990845 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-857bef42-a6b3-4b27-83e9-3cc0ad10b123 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:30.991447 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-857bef42-a6b3-4b27-83e9-3cc0ad10b123 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:31.136141 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-857bef42-a6b3-4b27-83e9-3cc0ad10b123 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:31.145117 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-857bef42-a6b3-4b27-83e9-3cc0ad10b123 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1317 microversion: 2.1 time: 0.171686 Aug 07 02:05:31.147932 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3556/6645] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:30 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:31.360555 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-2b5f572f-a50b-4667-b6c0-56d2eae37213 req-2d7b3bbd-e58c-4259-815f-1ca78d521400 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f728063f-29ec-4fe0-8eba-98f220493b5d", "tag": "a148fe34-e5a8-44da-b406-8a7337748866"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:05:31.379973 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-2b5f572f-a50b-4667-b6c0-56d2eae37213 req-2d7b3bbd-e58c-4259-815f-1ca78d521400 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:31.381167 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-2b5f572f-a50b-4667-b6c0-56d2eae37213 req-2d7b3bbd-e58c-4259-815f-1ca78d521400 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:31.381601 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-2b5f572f-a50b-4667-b6c0-56d2eae37213 req-2d7b3bbd-e58c-4259-815f-1ca78d521400 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:31.394097 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-2b5f572f-a50b-4667-b6c0-56d2eae37213 req-2d7b3bbd-e58c-4259-815f-1ca78d521400 service nova] Creating event network-changed:a148fe34-e5a8-44da-b406-8a7337748866 for instance f728063f-29ec-4fe0-8eba-98f220493b5d on n-h1-master-1 Aug 07 02:05:31.398624 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-2b5f572f-a50b-4667-b6c0-56d2eae37213 req-2d7b3bbd-e58c-4259-815f-1ca78d521400 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042982 Aug 07 02:05:31.399567 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3090/6646] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:05:32.168200 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6b92bb19-6b8b-44b6-a7fc-febd0302c9a6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:32.168770 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6b92bb19-6b8b-44b6-a7fc-febd0302c9a6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:32.175563 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b92bb19-6b8b-44b6-a7fc-febd0302c9a6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:32.176086 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b92bb19-6b8b-44b6-a7fc-febd0302c9a6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:32.176536 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b92bb19-6b8b-44b6-a7fc-febd0302c9a6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:32.177237 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b92bb19-6b8b-44b6-a7fc-febd0302c9a6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:32.177692 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b92bb19-6b8b-44b6-a7fc-febd0302c9a6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:32.178163 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6b92bb19-6b8b-44b6-a7fc-febd0302c9a6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:32.306385 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6b92bb19-6b8b-44b6-a7fc-febd0302c9a6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:32.313855 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6b92bb19-6b8b-44b6-a7fc-febd0302c9a6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1317 microversion: 2.1 time: 0.150347 Aug 07 02:05:32.314426 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3557/6647] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:32 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:33.336337 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0ec69707-c5f1-4960-bb63-cdfdd81e27e5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:33.337042 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0ec69707-c5f1-4960-bb63-cdfdd81e27e5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:33.343280 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ec69707-c5f1-4960-bb63-cdfdd81e27e5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:33.343758 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ec69707-c5f1-4960-bb63-cdfdd81e27e5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:33.344218 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ec69707-c5f1-4960-bb63-cdfdd81e27e5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:33.344910 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ec69707-c5f1-4960-bb63-cdfdd81e27e5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:33.345366 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ec69707-c5f1-4960-bb63-cdfdd81e27e5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:33.345793 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ec69707-c5f1-4960-bb63-cdfdd81e27e5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:33.478560 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0ec69707-c5f1-4960-bb63-cdfdd81e27e5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:33.486664 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0ec69707-c5f1-4960-bb63-cdfdd81e27e5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1317 microversion: 2.1 time: 0.155523 Aug 07 02:05:33.487229 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3091/6648] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:33 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:34.506620 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-103bcc52-b87a-43d7-8499-c143904a24e1 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:34.507204 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-103bcc52-b87a-43d7-8499-c143904a24e1 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:34.514764 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-103bcc52-b87a-43d7-8499-c143904a24e1 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:34.515253 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-103bcc52-b87a-43d7-8499-c143904a24e1 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:34.515698 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-103bcc52-b87a-43d7-8499-c143904a24e1 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:34.516428 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-103bcc52-b87a-43d7-8499-c143904a24e1 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:34.516893 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-103bcc52-b87a-43d7-8499-c143904a24e1 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:34.517331 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-103bcc52-b87a-43d7-8499-c143904a24e1 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:34.652353 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-103bcc52-b87a-43d7-8499-c143904a24e1 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:34.659952 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-103bcc52-b87a-43d7-8499-c143904a24e1 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1317 microversion: 2.1 time: 0.157276 Aug 07 02:05:34.660609 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3558/6649] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:34 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:35.681039 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-86977e2e-326c-4e2f-abe9-0295cf63c3c7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:35.681666 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-86977e2e-326c-4e2f-abe9-0295cf63c3c7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:35.689347 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-86977e2e-326c-4e2f-abe9-0295cf63c3c7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:35.689837 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-86977e2e-326c-4e2f-abe9-0295cf63c3c7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:35.690315 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-86977e2e-326c-4e2f-abe9-0295cf63c3c7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:35.691019 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-86977e2e-326c-4e2f-abe9-0295cf63c3c7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:35.691481 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-86977e2e-326c-4e2f-abe9-0295cf63c3c7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:35.691946 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-86977e2e-326c-4e2f-abe9-0295cf63c3c7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:35.822384 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-86977e2e-326c-4e2f-abe9-0295cf63c3c7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:35.830636 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-86977e2e-326c-4e2f-abe9-0295cf63c3c7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1317 microversion: 2.1 time: 0.153456 Aug 07 02:05:35.831288 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3092/6650] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:35 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:36.254336 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-563545a0-1a74-4d60-b9a6-7bc79910e557 req-03cf8cb5-8cd0-47c3-92c1-437ecd2744d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f728063f-29ec-4fe0-8eba-98f220493b5d", "name": "network-vif-plugged", "status": "completed", "tag": "a148fe34-e5a8-44da-b406-8a7337748866"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:05:36.265224 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-563545a0-1a74-4d60-b9a6-7bc79910e557 req-03cf8cb5-8cd0-47c3-92c1-437ecd2744d5 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:36.265729 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-563545a0-1a74-4d60-b9a6-7bc79910e557 req-03cf8cb5-8cd0-47c3-92c1-437ecd2744d5 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:36.266179 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-563545a0-1a74-4d60-b9a6-7bc79910e557 req-03cf8cb5-8cd0-47c3-92c1-437ecd2744d5 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:36.277356 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-563545a0-1a74-4d60-b9a6-7bc79910e557 req-03cf8cb5-8cd0-47c3-92c1-437ecd2744d5 service nova] Creating event network-vif-plugged:a148fe34-e5a8-44da-b406-8a7337748866 for instance f728063f-29ec-4fe0-8eba-98f220493b5d on n-h1-master-1 Aug 07 02:05:36.282418 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-563545a0-1a74-4d60-b9a6-7bc79910e557 req-03cf8cb5-8cd0-47c3-92c1-437ecd2744d5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031869 Aug 07 02:05:36.283012 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3559/6651] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:05:36.851834 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-93df8554-ba5c-448a-abe6-a04d65e30952 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:36.852559 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-93df8554-ba5c-448a-abe6-a04d65e30952 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:36.862461 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93df8554-ba5c-448a-abe6-a04d65e30952 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:36.862952 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93df8554-ba5c-448a-abe6-a04d65e30952 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:36.864497 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93df8554-ba5c-448a-abe6-a04d65e30952 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:36.865708 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93df8554-ba5c-448a-abe6-a04d65e30952 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:36.866186 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93df8554-ba5c-448a-abe6-a04d65e30952 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:36.866621 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-93df8554-ba5c-448a-abe6-a04d65e30952 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:37.004588 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-93df8554-ba5c-448a-abe6-a04d65e30952 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:37.012574 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-93df8554-ba5c-448a-abe6-a04d65e30952 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1317 microversion: 2.1 time: 0.164742 Aug 07 02:05:37.014133 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3093/6652] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:36 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:38.035073 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-19069f09-1e96-4f13-837d-67a1bb91a3e9 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:38.036521 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-19069f09-1e96-4f13-837d-67a1bb91a3e9 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:38.043054 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-19069f09-1e96-4f13-837d-67a1bb91a3e9 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:38.043547 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-19069f09-1e96-4f13-837d-67a1bb91a3e9 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:38.044024 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-19069f09-1e96-4f13-837d-67a1bb91a3e9 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:38.044729 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-19069f09-1e96-4f13-837d-67a1bb91a3e9 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:38.045195 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-19069f09-1e96-4f13-837d-67a1bb91a3e9 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:38.045635 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-19069f09-1e96-4f13-837d-67a1bb91a3e9 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:38.185015 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-19069f09-1e96-4f13-837d-67a1bb91a3e9 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:38.192624 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-19069f09-1e96-4f13-837d-67a1bb91a3e9 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1507 microversion: 2.1 time: 0.163041 Aug 07 02:05:38.193211 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3560/6653] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:38 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:38.213200 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-361e8296-32be-4038-a891-f724e89cdc85 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:38.213811 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-361e8296-32be-4038-a891-f724e89cdc85 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:38.221019 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-361e8296-32be-4038-a891-f724e89cdc85 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:38.221509 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-361e8296-32be-4038-a891-f724e89cdc85 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:38.221932 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-361e8296-32be-4038-a891-f724e89cdc85 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:38.222619 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-361e8296-32be-4038-a891-f724e89cdc85 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:38.223077 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-361e8296-32be-4038-a891-f724e89cdc85 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:38.223504 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-361e8296-32be-4038-a891-f724e89cdc85 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:38.352999 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-361e8296-32be-4038-a891-f724e89cdc85 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:38.361415 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-361e8296-32be-4038-a891-f724e89cdc85 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1507 microversion: 2.1 time: 0.152056 Aug 07 02:05:38.361978 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3094/6654] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:38 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:38.381979 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-304cb81f-9e5f-4b86-9d72-7b623687007f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:05:38.384420 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-304cb81f-9e5f-4b86-9d72-7b623687007f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:38.390501 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-304cb81f-9e5f-4b86-9d72-7b623687007f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:38.391025 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-304cb81f-9e5f-4b86-9d72-7b623687007f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:38.391484 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-304cb81f-9e5f-4b86-9d72-7b623687007f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:38.392235 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-304cb81f-9e5f-4b86-9d72-7b623687007f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:38.392710 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-304cb81f-9e5f-4b86-9d72-7b623687007f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:38.393186 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-304cb81f-9e5f-4b86-9d72-7b623687007f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:38.421219 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-304cb81f-9e5f-4b86-9d72-7b623687007f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:38.427090 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-304cb81f-9e5f-4b86-9d72-7b623687007f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Old instance type m1.heat2, new instance type m1.heat {{(pid=119516) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 07 02:05:38.434003 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-304cb81f-9e5f-4b86-9d72-7b623687007f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 02:05:38.434439 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-304cb81f-9e5f-4b86-9d72-7b623687007f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 02:05:38.434925 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-304cb81f-9e5f-4b86-9d72-7b623687007f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 02:05:38.435348 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-304cb81f-9e5f-4b86-9d72-7b623687007f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 02:05:38.435774 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-304cb81f-9e5f-4b86-9d72-7b623687007f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 02:05:38.496755 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-304cb81f-9e5f-4b86-9d72-7b623687007f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "POST /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d/action" status: 202 len: 0 microversion: 2.1 time: 0.118860 Aug 07 02:05:38.497369 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3561/6655] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:05:38 2022] POST /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:05:38.505567 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6a5d44a2-7081-4cea-b8d3-f87bbd689cbe tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:38.506193 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6a5d44a2-7081-4cea-b8d3-f87bbd689cbe tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:38.512818 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a5d44a2-7081-4cea-b8d3-f87bbd689cbe tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:38.513318 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a5d44a2-7081-4cea-b8d3-f87bbd689cbe tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:38.513760 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a5d44a2-7081-4cea-b8d3-f87bbd689cbe tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:38.514481 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a5d44a2-7081-4cea-b8d3-f87bbd689cbe tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:38.514947 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a5d44a2-7081-4cea-b8d3-f87bbd689cbe tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:38.515373 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a5d44a2-7081-4cea-b8d3-f87bbd689cbe tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:38.683156 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6a5d44a2-7081-4cea-b8d3-f87bbd689cbe tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:38.690866 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6a5d44a2-7081-4cea-b8d3-f87bbd689cbe tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1514 microversion: 2.1 time: 0.189205 Aug 07 02:05:38.691674 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3095/6656] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:38 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1514 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:39.709172 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:05:39.709965 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:05:39.715391 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9220c85c-17f3-44cf-94a1-a5e6d3838488 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:39.716055 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9220c85c-17f3-44cf-94a1-a5e6d3838488 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:39.726312 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9220c85c-17f3-44cf-94a1-a5e6d3838488 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:39.726808 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9220c85c-17f3-44cf-94a1-a5e6d3838488 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:39.727259 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9220c85c-17f3-44cf-94a1-a5e6d3838488 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:39.728008 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9220c85c-17f3-44cf-94a1-a5e6d3838488 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:39.728479 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9220c85c-17f3-44cf-94a1-a5e6d3838488 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:39.728920 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9220c85c-17f3-44cf-94a1-a5e6d3838488 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:39.871105 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9220c85c-17f3-44cf-94a1-a5e6d3838488 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:39.878710 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9220c85c-17f3-44cf-94a1-a5e6d3838488 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1514 microversion: 2.1 time: 0.170419 Aug 07 02:05:39.879275 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3562/6657] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:39 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:40.899983 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-285562e4-9684-42b5-9b08-cb59fd9db690 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:40.900740 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-285562e4-9684-42b5-9b08-cb59fd9db690 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:40.903203 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:05:40.909304 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-285562e4-9684-42b5-9b08-cb59fd9db690 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:40.909817 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-285562e4-9684-42b5-9b08-cb59fd9db690 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:40.910259 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-285562e4-9684-42b5-9b08-cb59fd9db690 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:40.910964 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-285562e4-9684-42b5-9b08-cb59fd9db690 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:40.911427 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-285562e4-9684-42b5-9b08-cb59fd9db690 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:40.911867 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-285562e4-9684-42b5-9b08-cb59fd9db690 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:40.915778 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:05:41.042663 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-285562e4-9684-42b5-9b08-cb59fd9db690 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:41.050275 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-285562e4-9684-42b5-9b08-cb59fd9db690 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1519 microversion: 2.1 time: 0.154215 Aug 07 02:05:41.050850 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3096/6658] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:40 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:42.071338 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d8a484bf-ef2f-46d0-8900-8ecef61a1ca6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:42.071980 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d8a484bf-ef2f-46d0-8900-8ecef61a1ca6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:42.079282 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d8a484bf-ef2f-46d0-8900-8ecef61a1ca6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:42.079770 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d8a484bf-ef2f-46d0-8900-8ecef61a1ca6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:42.080252 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d8a484bf-ef2f-46d0-8900-8ecef61a1ca6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:42.080957 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d8a484bf-ef2f-46d0-8900-8ecef61a1ca6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:42.081426 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d8a484bf-ef2f-46d0-8900-8ecef61a1ca6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:42.081860 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d8a484bf-ef2f-46d0-8900-8ecef61a1ca6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:42.219525 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d8a484bf-ef2f-46d0-8900-8ecef61a1ca6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:42.227606 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d8a484bf-ef2f-46d0-8900-8ecef61a1ca6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1519 microversion: 2.1 time: 0.160206 Aug 07 02:05:42.228209 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3563/6659] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:42 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:43.249036 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6ee653c9-39d1-4808-a271-55f0229f7384 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:43.249571 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6ee653c9-39d1-4808-a271-55f0229f7384 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:43.256153 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ee653c9-39d1-4808-a271-55f0229f7384 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:43.256632 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ee653c9-39d1-4808-a271-55f0229f7384 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:43.257066 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ee653c9-39d1-4808-a271-55f0229f7384 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:43.257758 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ee653c9-39d1-4808-a271-55f0229f7384 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:43.258211 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ee653c9-39d1-4808-a271-55f0229f7384 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:43.258643 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6ee653c9-39d1-4808-a271-55f0229f7384 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:43.389374 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6ee653c9-39d1-4808-a271-55f0229f7384 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:43.396963 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6ee653c9-39d1-4808-a271-55f0229f7384 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1519 microversion: 2.1 time: 0.152079 Aug 07 02:05:43.397539 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3097/6660] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:43 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:44.418508 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5c91c0cc-0534-4603-8539-4c6a128c5a33 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:44.419140 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5c91c0cc-0534-4603-8539-4c6a128c5a33 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:44.425666 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5c91c0cc-0534-4603-8539-4c6a128c5a33 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:44.426163 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5c91c0cc-0534-4603-8539-4c6a128c5a33 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:44.426615 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5c91c0cc-0534-4603-8539-4c6a128c5a33 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:44.427320 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5c91c0cc-0534-4603-8539-4c6a128c5a33 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:44.427793 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5c91c0cc-0534-4603-8539-4c6a128c5a33 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:44.428262 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5c91c0cc-0534-4603-8539-4c6a128c5a33 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:44.558349 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5c91c0cc-0534-4603-8539-4c6a128c5a33 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:44.565932 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5c91c0cc-0534-4603-8539-4c6a128c5a33 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1519 microversion: 2.1 time: 0.151509 Aug 07 02:05:44.566503 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3564/6661] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:44 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:45.587152 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5b35479e-7a9f-44bd-9a6f-498bcea7e0c5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:45.587776 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5b35479e-7a9f-44bd-9a6f-498bcea7e0c5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:45.594625 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5b35479e-7a9f-44bd-9a6f-498bcea7e0c5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:45.595102 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5b35479e-7a9f-44bd-9a6f-498bcea7e0c5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:45.595535 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5b35479e-7a9f-44bd-9a6f-498bcea7e0c5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:45.596244 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5b35479e-7a9f-44bd-9a6f-498bcea7e0c5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:45.596701 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5b35479e-7a9f-44bd-9a6f-498bcea7e0c5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:45.597121 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5b35479e-7a9f-44bd-9a6f-498bcea7e0c5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:45.722819 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5b35479e-7a9f-44bd-9a6f-498bcea7e0c5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:45.731076 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5b35479e-7a9f-44bd-9a6f-498bcea7e0c5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1519 microversion: 2.1 time: 0.147876 Aug 07 02:05:45.731835 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3098/6662] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:45 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:46.752092 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a7023f34-dfce-4671-985c-5f410d5b37b8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:46.752757 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a7023f34-dfce-4671-985c-5f410d5b37b8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:46.759452 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7023f34-dfce-4671-985c-5f410d5b37b8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:46.760481 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7023f34-dfce-4671-985c-5f410d5b37b8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:46.760938 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7023f34-dfce-4671-985c-5f410d5b37b8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:46.761653 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7023f34-dfce-4671-985c-5f410d5b37b8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:46.762122 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7023f34-dfce-4671-985c-5f410d5b37b8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:46.762562 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7023f34-dfce-4671-985c-5f410d5b37b8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:46.894114 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a7023f34-dfce-4671-985c-5f410d5b37b8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:46.902309 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a7023f34-dfce-4671-985c-5f410d5b37b8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1519 microversion: 2.1 time: 0.154180 Aug 07 02:05:46.902881 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3565/6663] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:46 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:47.923800 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e66119a9-6433-42b2-b29e-c3f79a876687 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:47.924400 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e66119a9-6433-42b2-b29e-c3f79a876687 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:47.931160 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e66119a9-6433-42b2-b29e-c3f79a876687 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:47.931691 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e66119a9-6433-42b2-b29e-c3f79a876687 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:47.932132 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e66119a9-6433-42b2-b29e-c3f79a876687 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:47.932845 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e66119a9-6433-42b2-b29e-c3f79a876687 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:47.933296 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e66119a9-6433-42b2-b29e-c3f79a876687 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:47.933717 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e66119a9-6433-42b2-b29e-c3f79a876687 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:48.068480 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e66119a9-6433-42b2-b29e-c3f79a876687 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:48.076082 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e66119a9-6433-42b2-b29e-c3f79a876687 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1519 microversion: 2.1 time: 0.156184 Aug 07 02:05:48.076655 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3099/6664] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:47 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:49.096962 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3c223093-b824-4089-90fc-f747841d3ee0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:49.097628 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3c223093-b824-4089-90fc-f747841d3ee0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:49.104777 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c223093-b824-4089-90fc-f747841d3ee0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:49.105272 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c223093-b824-4089-90fc-f747841d3ee0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:49.105724 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c223093-b824-4089-90fc-f747841d3ee0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:49.106430 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c223093-b824-4089-90fc-f747841d3ee0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:49.106896 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c223093-b824-4089-90fc-f747841d3ee0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:49.107336 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c223093-b824-4089-90fc-f747841d3ee0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:49.237998 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3c223093-b824-4089-90fc-f747841d3ee0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:49.246046 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3c223093-b824-4089-90fc-f747841d3ee0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1519 microversion: 2.1 time: 0.153039 Aug 07 02:05:49.246604 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3566/6665] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:49 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:50.268001 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ae7923e5-5aa5-48fb-a00a-7d4678254c65 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:50.268545 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ae7923e5-5aa5-48fb-a00a-7d4678254c65 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:50.275500 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ae7923e5-5aa5-48fb-a00a-7d4678254c65 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:50.276693 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ae7923e5-5aa5-48fb-a00a-7d4678254c65 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:50.277133 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ae7923e5-5aa5-48fb-a00a-7d4678254c65 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:50.277832 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ae7923e5-5aa5-48fb-a00a-7d4678254c65 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:50.278290 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ae7923e5-5aa5-48fb-a00a-7d4678254c65 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:50.278718 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ae7923e5-5aa5-48fb-a00a-7d4678254c65 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:50.407309 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ae7923e5-5aa5-48fb-a00a-7d4678254c65 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:50.415321 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ae7923e5-5aa5-48fb-a00a-7d4678254c65 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1519 microversion: 2.1 time: 0.151351 Aug 07 02:05:50.415917 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3100/6666] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:50 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:51.436326 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a4b9f0c9-0b92-4b13-9a04-e6386e928c21 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:51.436946 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a4b9f0c9-0b92-4b13-9a04-e6386e928c21 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:51.444355 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4b9f0c9-0b92-4b13-9a04-e6386e928c21 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:51.444883 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4b9f0c9-0b92-4b13-9a04-e6386e928c21 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:51.445341 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4b9f0c9-0b92-4b13-9a04-e6386e928c21 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:51.446059 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4b9f0c9-0b92-4b13-9a04-e6386e928c21 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:51.446531 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4b9f0c9-0b92-4b13-9a04-e6386e928c21 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:51.446977 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a4b9f0c9-0b92-4b13-9a04-e6386e928c21 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:51.584098 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a4b9f0c9-0b92-4b13-9a04-e6386e928c21 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:51.592421 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a4b9f0c9-0b92-4b13-9a04-e6386e928c21 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1519 microversion: 2.1 time: 0.160026 Aug 07 02:05:51.592983 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3567/6667] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:51 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:52.613793 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1be16fe4-a94d-4792-b03d-340b95f5ca84 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:52.614417 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1be16fe4-a94d-4792-b03d-340b95f5ca84 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:52.622062 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1be16fe4-a94d-4792-b03d-340b95f5ca84 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:52.622549 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1be16fe4-a94d-4792-b03d-340b95f5ca84 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:52.622993 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1be16fe4-a94d-4792-b03d-340b95f5ca84 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:52.623690 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1be16fe4-a94d-4792-b03d-340b95f5ca84 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:52.624181 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1be16fe4-a94d-4792-b03d-340b95f5ca84 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:52.624615 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1be16fe4-a94d-4792-b03d-340b95f5ca84 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:52.753714 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1be16fe4-a94d-4792-b03d-340b95f5ca84 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:52.761310 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1be16fe4-a94d-4792-b03d-340b95f5ca84 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1519 microversion: 2.1 time: 0.151403 Aug 07 02:05:52.761878 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3101/6668] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:52 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:53.782441 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cfda36f8-a9e8-402d-a7e5-c69592d2cf78 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:53.783082 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cfda36f8-a9e8-402d-a7e5-c69592d2cf78 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:53.789989 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfda36f8-a9e8-402d-a7e5-c69592d2cf78 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:53.790488 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfda36f8-a9e8-402d-a7e5-c69592d2cf78 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:53.790941 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfda36f8-a9e8-402d-a7e5-c69592d2cf78 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:53.791657 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfda36f8-a9e8-402d-a7e5-c69592d2cf78 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:53.792162 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfda36f8-a9e8-402d-a7e5-c69592d2cf78 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:53.792606 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cfda36f8-a9e8-402d-a7e5-c69592d2cf78 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:53.931303 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cfda36f8-a9e8-402d-a7e5-c69592d2cf78 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:53.939330 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cfda36f8-a9e8-402d-a7e5-c69592d2cf78 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1519 microversion: 2.1 time: 0.160863 Aug 07 02:05:53.939902 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3568/6669] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:53 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:54.960920 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-80e86441-5a25-4c53-8c76-815dadd00eb0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:54.961542 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-80e86441-5a25-4c53-8c76-815dadd00eb0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:54.970204 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-80e86441-5a25-4c53-8c76-815dadd00eb0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:54.970781 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-80e86441-5a25-4c53-8c76-815dadd00eb0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:54.971513 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-80e86441-5a25-4c53-8c76-815dadd00eb0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:54.972777 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-80e86441-5a25-4c53-8c76-815dadd00eb0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:54.973580 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-80e86441-5a25-4c53-8c76-815dadd00eb0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:54.974025 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-80e86441-5a25-4c53-8c76-815dadd00eb0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:55.112758 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-80e86441-5a25-4c53-8c76-815dadd00eb0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:55.120302 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-80e86441-5a25-4c53-8c76-815dadd00eb0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1519 microversion: 2.1 time: 0.163254 Aug 07 02:05:55.120879 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3102/6670] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:54 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:56.141196 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bb1d68c9-c82e-4d03-b24e-b850f82e5190 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:56.141829 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bb1d68c9-c82e-4d03-b24e-b850f82e5190 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:56.148769 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb1d68c9-c82e-4d03-b24e-b850f82e5190 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:56.149278 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb1d68c9-c82e-4d03-b24e-b850f82e5190 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:56.149752 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb1d68c9-c82e-4d03-b24e-b850f82e5190 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:56.150470 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb1d68c9-c82e-4d03-b24e-b850f82e5190 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:56.151437 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb1d68c9-c82e-4d03-b24e-b850f82e5190 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:56.151963 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb1d68c9-c82e-4d03-b24e-b850f82e5190 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:56.279977 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bb1d68c9-c82e-4d03-b24e-b850f82e5190 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:56.282213 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:05:56.288755 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bb1d68c9-c82e-4d03-b24e-b850f82e5190 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1519 microversion: 2.1 time: 0.151473 Aug 07 02:05:56.289327 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3569/6671] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:56 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:57.310693 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c6328f86-f2dd-43c0-b0a9-575472a2c251 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:57.311238 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c6328f86-f2dd-43c0-b0a9-575472a2c251 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:57.313936 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:05:57.319404 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6328f86-f2dd-43c0-b0a9-575472a2c251 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:57.319904 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6328f86-f2dd-43c0-b0a9-575472a2c251 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:57.320377 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6328f86-f2dd-43c0-b0a9-575472a2c251 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:57.321075 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6328f86-f2dd-43c0-b0a9-575472a2c251 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:57.321529 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6328f86-f2dd-43c0-b0a9-575472a2c251 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:57.321957 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6328f86-f2dd-43c0-b0a9-575472a2c251 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:57.448467 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c6328f86-f2dd-43c0-b0a9-575472a2c251 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:57.455863 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c6328f86-f2dd-43c0-b0a9-575472a2c251 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1519 microversion: 2.1 time: 0.149761 Aug 07 02:05:57.456577 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3103/6672] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:57 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:58.478181 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9b36158f-5054-4690-986e-c8ed65a394a7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:58.479494 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9b36158f-5054-4690-986e-c8ed65a394a7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:58.482109 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:05:58.487747 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b36158f-5054-4690-986e-c8ed65a394a7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:58.488260 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b36158f-5054-4690-986e-c8ed65a394a7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:58.488708 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b36158f-5054-4690-986e-c8ed65a394a7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:58.489410 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b36158f-5054-4690-986e-c8ed65a394a7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:58.489899 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b36158f-5054-4690-986e-c8ed65a394a7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:58.490357 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b36158f-5054-4690-986e-c8ed65a394a7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:58.623397 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9b36158f-5054-4690-986e-c8ed65a394a7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:58.630987 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9b36158f-5054-4690-986e-c8ed65a394a7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1519 microversion: 2.1 time: 0.157326 Aug 07 02:05:58.631566 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3570/6673] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:58 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:05:59.652941 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c92017e2-3b33-46d6-94a1-6f6a15bcc7d5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:05:59.653580 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c92017e2-3b33-46d6-94a1-6f6a15bcc7d5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:05:59.660574 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c92017e2-3b33-46d6-94a1-6f6a15bcc7d5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:59.661058 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c92017e2-3b33-46d6-94a1-6f6a15bcc7d5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:59.661552 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c92017e2-3b33-46d6-94a1-6f6a15bcc7d5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:59.662222 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c92017e2-3b33-46d6-94a1-6f6a15bcc7d5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:05:59.662668 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c92017e2-3b33-46d6-94a1-6f6a15bcc7d5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:05:59.663063 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c92017e2-3b33-46d6-94a1-6f6a15bcc7d5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:05:59.793536 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c92017e2-3b33-46d6-94a1-6f6a15bcc7d5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:05:59.801048 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c92017e2-3b33-46d6-94a1-6f6a15bcc7d5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1519 microversion: 2.1 time: 0.152492 Aug 07 02:05:59.801619 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3104/6674] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:05:59 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:06:00.821938 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7ad67b25-8053-4aca-bd5a-57d31161fc3f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:06:00.822475 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7ad67b25-8053-4aca-bd5a-57d31161fc3f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:06:00.829421 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ad67b25-8053-4aca-bd5a-57d31161fc3f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:00.829912 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ad67b25-8053-4aca-bd5a-57d31161fc3f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:00.830361 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ad67b25-8053-4aca-bd5a-57d31161fc3f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:00.831062 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ad67b25-8053-4aca-bd5a-57d31161fc3f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:00.831526 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ad67b25-8053-4aca-bd5a-57d31161fc3f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:00.831992 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ad67b25-8053-4aca-bd5a-57d31161fc3f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:00.960014 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7ad67b25-8053-4aca-bd5a-57d31161fc3f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:06:00.967726 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7ad67b25-8053-4aca-bd5a-57d31161fc3f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1519 microversion: 2.1 time: 0.149776 Aug 07 02:06:00.968322 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3571/6675] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:06:00 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:06:01.989983 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9ade6656-d4a1-4fd1-b128-9865f79168c3 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:06:01.990593 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9ade6656-d4a1-4fd1-b128-9865f79168c3 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:06:01.997411 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ade6656-d4a1-4fd1-b128-9865f79168c3 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:01.997892 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ade6656-d4a1-4fd1-b128-9865f79168c3 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:01.998326 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ade6656-d4a1-4fd1-b128-9865f79168c3 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:01.999058 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ade6656-d4a1-4fd1-b128-9865f79168c3 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:01.999515 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ade6656-d4a1-4fd1-b128-9865f79168c3 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:01.999983 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9ade6656-d4a1-4fd1-b128-9865f79168c3 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:02.131858 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9ade6656-d4a1-4fd1-b128-9865f79168c3 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:06:02.139494 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9ade6656-d4a1-4fd1-b128-9865f79168c3 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1519 microversion: 2.1 time: 0.153363 Aug 07 02:06:02.140102 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3105/6676] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:06:01 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:06:03.161077 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d43d242a-1dbc-4f25-ad82-6e3b0daaea88 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:06:03.161706 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d43d242a-1dbc-4f25-ad82-6e3b0daaea88 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:06:03.168749 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d43d242a-1dbc-4f25-ad82-6e3b0daaea88 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:03.169243 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d43d242a-1dbc-4f25-ad82-6e3b0daaea88 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:03.169691 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d43d242a-1dbc-4f25-ad82-6e3b0daaea88 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:03.170403 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d43d242a-1dbc-4f25-ad82-6e3b0daaea88 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:03.170872 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d43d242a-1dbc-4f25-ad82-6e3b0daaea88 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:03.171314 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d43d242a-1dbc-4f25-ad82-6e3b0daaea88 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:03.304082 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d43d242a-1dbc-4f25-ad82-6e3b0daaea88 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:06:03.312025 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d43d242a-1dbc-4f25-ad82-6e3b0daaea88 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1519 microversion: 2.1 time: 0.154841 Aug 07 02:06:03.312608 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3572/6677] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:06:03 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:06:04.334696 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9325233c-6863-41e1-8d72-42437a37a302 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:06:04.335765 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9325233c-6863-41e1-8d72-42437a37a302 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:06:04.343907 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9325233c-6863-41e1-8d72-42437a37a302 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:04.344407 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9325233c-6863-41e1-8d72-42437a37a302 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:04.344850 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9325233c-6863-41e1-8d72-42437a37a302 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:04.345554 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9325233c-6863-41e1-8d72-42437a37a302 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:04.346012 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9325233c-6863-41e1-8d72-42437a37a302 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:04.346442 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9325233c-6863-41e1-8d72-42437a37a302 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:04.479163 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9325233c-6863-41e1-8d72-42437a37a302 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:06:04.486706 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9325233c-6863-41e1-8d72-42437a37a302 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1519 microversion: 2.1 time: 0.157255 Aug 07 02:06:04.487286 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3106/6678] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:06:04 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:06:05.507222 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2838446b-7f5d-4c97-9d2c-a263329635ab tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:06:05.507855 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2838446b-7f5d-4c97-9d2c-a263329635ab tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:06:05.515221 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2838446b-7f5d-4c97-9d2c-a263329635ab tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:05.515716 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2838446b-7f5d-4c97-9d2c-a263329635ab tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:05.516199 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2838446b-7f5d-4c97-9d2c-a263329635ab tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:05.516913 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2838446b-7f5d-4c97-9d2c-a263329635ab tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:05.517380 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2838446b-7f5d-4c97-9d2c-a263329635ab tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:05.517822 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2838446b-7f5d-4c97-9d2c-a263329635ab tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:05.652828 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2838446b-7f5d-4c97-9d2c-a263329635ab tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:06:05.660683 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2838446b-7f5d-4c97-9d2c-a263329635ab tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1519 microversion: 2.1 time: 0.157431 Aug 07 02:06:05.661262 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3573/6679] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:06:05 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:06:06.681788 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b18aca60-b878-45d8-9d6b-32bd25a42dcf tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:06:06.682323 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b18aca60-b878-45d8-9d6b-32bd25a42dcf tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:06:06.689575 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b18aca60-b878-45d8-9d6b-32bd25a42dcf tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:06.690054 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b18aca60-b878-45d8-9d6b-32bd25a42dcf tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:06.690490 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b18aca60-b878-45d8-9d6b-32bd25a42dcf tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:06.691186 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b18aca60-b878-45d8-9d6b-32bd25a42dcf tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:06.691634 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b18aca60-b878-45d8-9d6b-32bd25a42dcf tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:06.692082 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b18aca60-b878-45d8-9d6b-32bd25a42dcf tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:06.818931 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b18aca60-b878-45d8-9d6b-32bd25a42dcf tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:06:06.826399 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b18aca60-b878-45d8-9d6b-32bd25a42dcf tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1519 microversion: 2.1 time: 0.148623 Aug 07 02:06:06.826960 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3107/6680] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:06:06 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:06:07.846724 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3defc7a0-0247-4255-b7b5-d2fe6b7ea930 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:06:07.847356 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3defc7a0-0247-4255-b7b5-d2fe6b7ea930 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:06:07.854775 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3defc7a0-0247-4255-b7b5-d2fe6b7ea930 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:07.855267 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3defc7a0-0247-4255-b7b5-d2fe6b7ea930 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:07.855716 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3defc7a0-0247-4255-b7b5-d2fe6b7ea930 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:07.856458 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3defc7a0-0247-4255-b7b5-d2fe6b7ea930 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:07.856924 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3defc7a0-0247-4255-b7b5-d2fe6b7ea930 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:07.857355 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3defc7a0-0247-4255-b7b5-d2fe6b7ea930 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:07.961107 n-d-master-1 devstack@n-api.service[119517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 02:06:07.961679 n-d-master-1 devstack@n-api.service[119517]: Sun Aug 7 02:06:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 02:06:08.005295 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3defc7a0-0247-4255-b7b5-d2fe6b7ea930 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:06:08.013655 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3defc7a0-0247-4255-b7b5-d2fe6b7ea930 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1518 microversion: 2.1 time: 0.170811 Aug 07 02:06:08.014234 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3574/6681] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:06:07 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:06:08.029420 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-c7ff1004-d880-4be1-b4c1-694faa96cf33 req-94fa6936-0996-4241-b72c-5213e91c0400 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f728063f-29ec-4fe0-8eba-98f220493b5d", "name": "network-vif-unplugged", "status": "completed", "tag": "a148fe34-e5a8-44da-b406-8a7337748866"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:06:08.040425 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c7ff1004-d880-4be1-b4c1-694faa96cf33 req-94fa6936-0996-4241-b72c-5213e91c0400 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:08.040908 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c7ff1004-d880-4be1-b4c1-694faa96cf33 req-94fa6936-0996-4241-b72c-5213e91c0400 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:08.041471 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c7ff1004-d880-4be1-b4c1-694faa96cf33 req-94fa6936-0996-4241-b72c-5213e91c0400 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:08.053383 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-c7ff1004-d880-4be1-b4c1-694faa96cf33 req-94fa6936-0996-4241-b72c-5213e91c0400 service nova] Creating event network-vif-unplugged:a148fe34-e5a8-44da-b406-8a7337748866 for instance f728063f-29ec-4fe0-8eba-98f220493b5d on n-h2-master-1 Aug 07 02:06:08.059220 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [req-c7ff1004-d880-4be1-b4c1-694faa96cf33 req-94fa6936-0996-4241-b72c-5213e91c0400 service nova] Instance f728063f-29ec-4fe0-8eba-98f220493b5d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 02:06:08.066345 n-d-master-1 devstack@n-api.service[119516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 02:06:08.066733 n-d-master-1 devstack@n-api.service[119516]: Sun Aug 7 02:06:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 02:06:08.075493 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-c7ff1004-d880-4be1-b4c1-694faa96cf33 req-94fa6936-0996-4241-b72c-5213e91c0400 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049792 Aug 07 02:06:08.076495 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3108/6682] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:06:09.034733 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-61851449-494a-4ee7-afb7-c72b51e5caa6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:06:09.035367 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-61851449-494a-4ee7-afb7-c72b51e5caa6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:06:09.042388 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-61851449-494a-4ee7-afb7-c72b51e5caa6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:09.042887 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-61851449-494a-4ee7-afb7-c72b51e5caa6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:09.043345 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-61851449-494a-4ee7-afb7-c72b51e5caa6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:09.044084 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-61851449-494a-4ee7-afb7-c72b51e5caa6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:09.044557 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-61851449-494a-4ee7-afb7-c72b51e5caa6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:09.045001 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-61851449-494a-4ee7-afb7-c72b51e5caa6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:09.173768 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-61851449-494a-4ee7-afb7-c72b51e5caa6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:06:09.181304 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-61851449-494a-4ee7-afb7-c72b51e5caa6 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1516 microversion: 2.1 time: 0.150602 Aug 07 02:06:09.181893 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3575/6683] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:06:09 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:06:10.094580 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-d54dd92c-d72a-4b1f-87d0-cba315b25e50 req-a509836c-923f-41d1-9f07-316a29a18984 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f728063f-29ec-4fe0-8eba-98f220493b5d", "tag": "a148fe34-e5a8-44da-b406-8a7337748866"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:06:10.105708 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d54dd92c-d72a-4b1f-87d0-cba315b25e50 req-a509836c-923f-41d1-9f07-316a29a18984 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:10.106184 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d54dd92c-d72a-4b1f-87d0-cba315b25e50 req-a509836c-923f-41d1-9f07-316a29a18984 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:10.106616 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d54dd92c-d72a-4b1f-87d0-cba315b25e50 req-a509836c-923f-41d1-9f07-316a29a18984 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:10.117754 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-d54dd92c-d72a-4b1f-87d0-cba315b25e50 req-a509836c-923f-41d1-9f07-316a29a18984 service nova] Creating event network-changed:a148fe34-e5a8-44da-b406-8a7337748866 for instance f728063f-29ec-4fe0-8eba-98f220493b5d on n-h2-master-1 Aug 07 02:06:10.123498 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [req-d54dd92c-d72a-4b1f-87d0-cba315b25e50 req-a509836c-923f-41d1-9f07-316a29a18984 service nova] Instance f728063f-29ec-4fe0-8eba-98f220493b5d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 02:06:10.133776 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-d54dd92c-d72a-4b1f-87d0-cba315b25e50 req-a509836c-923f-41d1-9f07-316a29a18984 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043223 Aug 07 02:06:10.134292 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3109/6684] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:06:10.208708 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a1234275-8257-477f-b223-c54e31687d31 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:06:10.209431 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a1234275-8257-477f-b223-c54e31687d31 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:06:10.216787 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a1234275-8257-477f-b223-c54e31687d31 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:10.217357 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a1234275-8257-477f-b223-c54e31687d31 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:10.217893 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a1234275-8257-477f-b223-c54e31687d31 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:10.218662 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a1234275-8257-477f-b223-c54e31687d31 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:10.219133 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a1234275-8257-477f-b223-c54e31687d31 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:10.219570 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a1234275-8257-477f-b223-c54e31687d31 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:10.358603 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a1234275-8257-477f-b223-c54e31687d31 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:06:10.367541 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a1234275-8257-477f-b223-c54e31687d31 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1516 microversion: 2.1 time: 0.162682 Aug 07 02:06:10.368465 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3576/6685] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:06:10 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:06:11.391092 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-16694705-3bf1-4dab-a55e-8526de857110 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:06:11.391818 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-16694705-3bf1-4dab-a55e-8526de857110 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:06:11.398024 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16694705-3bf1-4dab-a55e-8526de857110 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:11.398493 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16694705-3bf1-4dab-a55e-8526de857110 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:11.398923 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16694705-3bf1-4dab-a55e-8526de857110 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:11.399612 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16694705-3bf1-4dab-a55e-8526de857110 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:11.400093 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16694705-3bf1-4dab-a55e-8526de857110 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:11.400515 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-16694705-3bf1-4dab-a55e-8526de857110 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:11.405130 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=79 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:06:11.531284 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-16694705-3bf1-4dab-a55e-8526de857110 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:06:11.539123 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-16694705-3bf1-4dab-a55e-8526de857110 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1513 microversion: 2.1 time: 0.153672 Aug 07 02:06:11.539700 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3110/6686] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:06:11 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:06:11.559412 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-02dd4b9b-8dab-4c02-b6a1-1e46a900b5c7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:06:11.559981 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-02dd4b9b-8dab-4c02-b6a1-1e46a900b5c7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:06:11.566828 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-02dd4b9b-8dab-4c02-b6a1-1e46a900b5c7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:11.567333 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-02dd4b9b-8dab-4c02-b6a1-1e46a900b5c7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:11.567789 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-02dd4b9b-8dab-4c02-b6a1-1e46a900b5c7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:11.568535 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-02dd4b9b-8dab-4c02-b6a1-1e46a900b5c7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:11.569010 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-02dd4b9b-8dab-4c02-b6a1-1e46a900b5c7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:11.569463 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-02dd4b9b-8dab-4c02-b6a1-1e46a900b5c7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:11.629971 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-02dd4b9b-8dab-4c02-b6a1-1e46a900b5c7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "POST /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d/action" status: 204 len: 0 microversion: 2.1 time: 0.074258 Aug 07 02:06:11.630597 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3577/6687] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:06:11 2022] POST /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 02:06:11.640018 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5a6eddfd-0603-438b-8f6a-d9a900b708a0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:06:11.640633 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5a6eddfd-0603-438b-8f6a-d9a900b708a0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:06:11.647235 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a6eddfd-0603-438b-8f6a-d9a900b708a0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:11.647870 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a6eddfd-0603-438b-8f6a-d9a900b708a0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:11.648334 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a6eddfd-0603-438b-8f6a-d9a900b708a0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:11.649196 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a6eddfd-0603-438b-8f6a-d9a900b708a0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:11.649741 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a6eddfd-0603-438b-8f6a-d9a900b708a0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:11.650214 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a6eddfd-0603-438b-8f6a-d9a900b708a0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:11.871548 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5a6eddfd-0603-438b-8f6a-d9a900b708a0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:06:11.879244 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5a6eddfd-0603-438b-8f6a-d9a900b708a0 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1513 microversion: 2.1 time: 0.244297 Aug 07 02:06:11.879829 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3111/6688] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:06:11 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1513 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:06:12.905014 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f027493e-c72b-4f7d-87b6-82b8339b08b7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:06:12.906154 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f027493e-c72b-4f7d-87b6-82b8339b08b7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:06:12.913443 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f027493e-c72b-4f7d-87b6-82b8339b08b7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:12.913942 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f027493e-c72b-4f7d-87b6-82b8339b08b7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:12.914389 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f027493e-c72b-4f7d-87b6-82b8339b08b7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:12.915101 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f027493e-c72b-4f7d-87b6-82b8339b08b7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:12.915570 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f027493e-c72b-4f7d-87b6-82b8339b08b7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:12.916040 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f027493e-c72b-4f7d-87b6-82b8339b08b7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:13.055154 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f027493e-c72b-4f7d-87b6-82b8339b08b7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:06:13.064892 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f027493e-c72b-4f7d-87b6-82b8339b08b7 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1505 microversion: 2.1 time: 0.164678 Aug 07 02:06:13.065513 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3578/6689] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:06:12 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:06:13.085873 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f27263b3-2176-4dd8-a255-c4a3d10e5d0f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:06:13.086494 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f27263b3-2176-4dd8-a255-c4a3d10e5d0f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:06:13.093242 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f27263b3-2176-4dd8-a255-c4a3d10e5d0f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:13.093728 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f27263b3-2176-4dd8-a255-c4a3d10e5d0f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:13.094164 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f27263b3-2176-4dd8-a255-c4a3d10e5d0f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:13.094861 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f27263b3-2176-4dd8-a255-c4a3d10e5d0f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:13.095316 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f27263b3-2176-4dd8-a255-c4a3d10e5d0f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:13.095744 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f27263b3-2176-4dd8-a255-c4a3d10e5d0f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:13.233742 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f27263b3-2176-4dd8-a255-c4a3d10e5d0f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:06:13.241301 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f27263b3-2176-4dd8-a255-c4a3d10e5d0f tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1505 microversion: 2.1 time: 0.159520 Aug 07 02:06:13.241872 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3112/6690] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:06:13 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:06:13.261054 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d9cd3a21-a551-4c72-b88c-fd8a4d7182d9 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:06:13.261682 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d9cd3a21-a551-4c72-b88c-fd8a4d7182d9 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:06:13.267742 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d9cd3a21-a551-4c72-b88c-fd8a4d7182d9 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:13.268265 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d9cd3a21-a551-4c72-b88c-fd8a4d7182d9 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:13.268713 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d9cd3a21-a551-4c72-b88c-fd8a4d7182d9 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:13.269420 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d9cd3a21-a551-4c72-b88c-fd8a4d7182d9 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:13.269877 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d9cd3a21-a551-4c72-b88c-fd8a4d7182d9 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:13.270312 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d9cd3a21-a551-4c72-b88c-fd8a4d7182d9 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:13.398951 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d9cd3a21-a551-4c72-b88c-fd8a4d7182d9 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:06:13.406998 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d9cd3a21-a551-4c72-b88c-fd8a4d7182d9 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1505 microversion: 2.1 time: 0.149861 Aug 07 02:06:13.407554 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3579/6691] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:06:13 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:06:13.427084 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-584512f2-49bb-48b2-8a70-4badeb32e0e5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:06:13.427613 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-584512f2-49bb-48b2-8a70-4badeb32e0e5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:06:13.434217 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-584512f2-49bb-48b2-8a70-4badeb32e0e5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:13.434647 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-584512f2-49bb-48b2-8a70-4badeb32e0e5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:13.435115 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-584512f2-49bb-48b2-8a70-4badeb32e0e5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:13.435822 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-584512f2-49bb-48b2-8a70-4badeb32e0e5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:13.436306 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-584512f2-49bb-48b2-8a70-4badeb32e0e5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:13.436736 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-584512f2-49bb-48b2-8a70-4badeb32e0e5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:13.460883 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-584512f2-49bb-48b2-8a70-4badeb32e0e5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 02:06:13.562276 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-584512f2-49bb-48b2-8a70-4badeb32e0e5 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 204 len: 0 microversion: 2.1 time: 0.138628 Aug 07 02:06:13.563175 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3113/6692] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 02:06:13 2022] DELETE /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 02:06:13.578352 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-896356c7-7d37-4ba2-9d76-94cb26743ee8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:06:13.578897 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-896356c7-7d37-4ba2-9d76-94cb26743ee8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:06:13.585168 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-896356c7-7d37-4ba2-9d76-94cb26743ee8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:13.585668 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-896356c7-7d37-4ba2-9d76-94cb26743ee8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:13.586269 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-896356c7-7d37-4ba2-9d76-94cb26743ee8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:13.586994 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-896356c7-7d37-4ba2-9d76-94cb26743ee8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:13.587592 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-896356c7-7d37-4ba2-9d76-94cb26743ee8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:13.588095 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-896356c7-7d37-4ba2-9d76-94cb26743ee8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:13.614190 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-896356c7-7d37-4ba2-9d76-94cb26743ee8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 02:06:13.662284 n-d-master-1 devstack@n-api.service[119516]: INFO nova.compute.api [None req-896356c7-7d37-4ba2-9d76-94cb26743ee8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Instance is already in deleting state, ignoring this request Aug 07 02:06:13.663134 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-896356c7-7d37-4ba2-9d76-94cb26743ee8 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 204 len: 0 microversion: 2.1 time: 0.089300 Aug 07 02:06:13.663848 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3580/6693] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 02:06:13 2022] DELETE /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 07 02:06:13.665831 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-f889fb05-c143-42d3-9a81-af4c042d657c req-46634eff-a201-4b76-9cab-8c2eb801ac5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f728063f-29ec-4fe0-8eba-98f220493b5d", "name": "network-vif-plugged", "status": "completed", "tag": "a148fe34-e5a8-44da-b406-8a7337748866"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:06:13.671309 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ef7cd26a-1d47-4f7d-8a88-3b7fe09b71f2 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:06:13.671970 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ef7cd26a-1d47-4f7d-8a88-3b7fe09b71f2 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:06:13.676024 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f889fb05-c143-42d3-9a81-af4c042d657c req-46634eff-a201-4b76-9cab-8c2eb801ac5f service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:13.676617 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f889fb05-c143-42d3-9a81-af4c042d657c req-46634eff-a201-4b76-9cab-8c2eb801ac5f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:13.677462 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f889fb05-c143-42d3-9a81-af4c042d657c req-46634eff-a201-4b76-9cab-8c2eb801ac5f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:13.677880 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef7cd26a-1d47-4f7d-8a88-3b7fe09b71f2 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:13.678377 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef7cd26a-1d47-4f7d-8a88-3b7fe09b71f2 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:13.678831 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef7cd26a-1d47-4f7d-8a88-3b7fe09b71f2 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:13.679550 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef7cd26a-1d47-4f7d-8a88-3b7fe09b71f2 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:13.680050 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef7cd26a-1d47-4f7d-8a88-3b7fe09b71f2 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:13.680509 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef7cd26a-1d47-4f7d-8a88-3b7fe09b71f2 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:13.690643 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-f889fb05-c143-42d3-9a81-af4c042d657c req-46634eff-a201-4b76-9cab-8c2eb801ac5f service nova] Creating event network-vif-plugged:a148fe34-e5a8-44da-b406-8a7337748866 for instance f728063f-29ec-4fe0-8eba-98f220493b5d on n-h2-master-1 Aug 07 02:06:13.695872 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-f889fb05-c143-42d3-9a81-af4c042d657c req-46634eff-a201-4b76-9cab-8c2eb801ac5f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034064 Aug 07 02:06:13.696898 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3114/6694] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 02:06:13.814609 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ef7cd26a-1d47-4f7d-8a88-3b7fe09b71f2 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:06:13.822182 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ef7cd26a-1d47-4f7d-8a88-3b7fe09b71f2 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1511 microversion: 2.1 time: 0.154539 Aug 07 02:06:13.823264 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3581/6695] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:06:13 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:06:14.844556 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a205efba-abb7-4c9a-a069-85eb52fafa0e tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:06:14.845261 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a205efba-abb7-4c9a-a069-85eb52fafa0e tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:06:14.851416 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a205efba-abb7-4c9a-a069-85eb52fafa0e tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:14.851915 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a205efba-abb7-4c9a-a069-85eb52fafa0e tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:14.852357 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a205efba-abb7-4c9a-a069-85eb52fafa0e tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:14.853046 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a205efba-abb7-4c9a-a069-85eb52fafa0e tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:14.853757 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a205efba-abb7-4c9a-a069-85eb52fafa0e tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:14.854184 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a205efba-abb7-4c9a-a069-85eb52fafa0e tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:15.030983 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a205efba-abb7-4c9a-a069-85eb52fafa0e tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf878e8b08d4c85bb3fb925db315ac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313574dcf84819b58af883ac6cb768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:06:15.038856 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a205efba-abb7-4c9a-a069-85eb52fafa0e tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 200 len: 1511 microversion: 2.1 time: 0.200009 Aug 07 02:06:15.039429 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3115/6696] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:06:14 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 1511 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:06:15.442760 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-e99fd59c-0716-4d0a-8fbf-8a7ff22d4646 req-0ea13250-087f-4da1-9b50-ec8228ac41f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f728063f-29ec-4fe0-8eba-98f220493b5d", "name": "network-vif-deleted", "tag": "a148fe34-e5a8-44da-b406-8a7337748866"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:06:15.461442 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e99fd59c-0716-4d0a-8fbf-8a7ff22d4646 req-0ea13250-087f-4da1-9b50-ec8228ac41f4 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:15.462039 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e99fd59c-0716-4d0a-8fbf-8a7ff22d4646 req-0ea13250-087f-4da1-9b50-ec8228ac41f4 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:15.462503 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e99fd59c-0716-4d0a-8fbf-8a7ff22d4646 req-0ea13250-087f-4da1-9b50-ec8228ac41f4 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:15.480077 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-e99fd59c-0716-4d0a-8fbf-8a7ff22d4646 req-0ea13250-087f-4da1-9b50-ec8228ac41f4 service nova] Creating event network-vif-deleted:a148fe34-e5a8-44da-b406-8a7337748866 for instance f728063f-29ec-4fe0-8eba-98f220493b5d on n-h2-master-1 Aug 07 02:06:15.484906 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-e99fd59c-0716-4d0a-8fbf-8a7ff22d4646 req-0ea13250-087f-4da1-9b50-ec8228ac41f4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053435 Aug 07 02:06:15.485827 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3582/6697] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:06:16.060445 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b26f9982-e785-45b5-9460-817a9250c758 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:06:16.061061 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b26f9982-e785-45b5-9460-817a9250c758 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: f728063f-29ec-4fe0-8eba-98f220493b5d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:06:16.067954 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b26f9982-e785-45b5-9460-817a9250c758 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:16.068436 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b26f9982-e785-45b5-9460-817a9250c758 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:16.068874 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b26f9982-e785-45b5-9460-817a9250c758 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:16.069563 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b26f9982-e785-45b5-9460-817a9250c758 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:16.070018 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b26f9982-e785-45b5-9460-817a9250c758 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:16.070444 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b26f9982-e785-45b5-9460-817a9250c758 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:16.083703 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-b26f9982-e785-45b5-9460-817a9250c758 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] HTTP exception thrown: Instance f728063f-29ec-4fe0-8eba-98f220493b5d could not be found. Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b26f9982-e785-45b5-9460-817a9250c758 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Request method failure captured: Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d HTTP/1.1 Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7x24c17VAqbB1RPgV9M5muh9Mrutd22W3kymU2YVexF8Asm4Nhdbdh4AsAAZOmrI6NzLqzXSWWHdyESc9ZxaEJvGNL_UV7bqgWKvosBmiV75UWOIHuXPi9wYs2urm_rXDy-qgSApJPDpOeyrEJIbc0wpDH8VkHR3CCn69DIBloXF9kU Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: b5313574dcf84819b58af883ac6cb768 Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServerDiskConfigTestJSON-113106623 Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b5313574dcf84819b58af883ac6cb768"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b5313574dcf84819b58af883ac6cb768", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b5313574dcf84819b58af883ac6cb768"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b5313574dcf84819b58af883ac6cb768"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServerDiskConfigTestJSON-113106623 Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: b5313574dcf84819b58af883ac6cb768 Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-113106623 Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServerDiskConfigTestJSON-113106623-project Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: bbf878e8b08d4c85bb3fb925db315ac4 Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServerDiskConfigTestJSON-113106623-project Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: exception: Instance f728063f-29ec-4fe0-8eba-98f220493b5d could not be found. Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'f728063f-29ec-4fe0-8eba-98f220493b5d'} Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f728063f-29ec-4fe0-8eba-98f220493b5d could not be found. Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f728063f-29ec-4fe0-8eba-98f220493b5d could not be found. Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:06:16.085354 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:06:16.089697 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:06:16.089697 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:06:16.089697 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:06:16.089697 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:06:16.089697 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:06:16.089697 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f728063f-29ec-4fe0-8eba-98f220493b5d could not be found. Aug 07 02:06:16.089697 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:06:16.089697 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b26f9982-e785-45b5-9460-817a9250c758 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Returning 404 to user: Instance f728063f-29ec-4fe0-8eba-98f220493b5d could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:06:16.089697 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b26f9982-e785-45b5-9460-817a9250c758 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d" status: 404 len: 111 microversion: 2.1 time: 0.030861 Aug 07 02:06:16.089697 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3116/6698] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:06:16 2022] GET /compute/v2.1/servers/f728063f-29ec-4fe0-8eba-98f220493b5d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:06:16.096310 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b7cc54a0-fb83-40e8-8265-bcdeb6aa431d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '.version_select at 0x7f9e171784c0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:06:16.120517 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b7cc54a0-fb83-40e8-8265-bcdeb6aa431d tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-467519583" status: 202 len: 0 microversion: 2.1 time: 0.028399 Aug 07 02:06:16.121093 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3583/6699] 10.222.0.39 () {58 vars in 1218 bytes} [Sun Aug 7 02:06:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-467519583 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:06:16.711618 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8f045720-0275-4393-a9ca-683682532791 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:06:16.712146 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8f045720-0275-4393-a9ca-683682532791 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:06:16.718756 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f045720-0275-4393-a9ca-683682532791 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:16.719236 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f045720-0275-4393-a9ca-683682532791 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:16.719676 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f045720-0275-4393-a9ca-683682532791 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:16.720399 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f045720-0275-4393-a9ca-683682532791 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:16.720851 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f045720-0275-4393-a9ca-683682532791 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:16.721279 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f045720-0275-4393-a9ca-683682532791 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:16.734806 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-8f045720-0275-4393-a9ca-683682532791 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] HTTP exception thrown: Instance 6fb23c99-88b5-40f9-b37a-06da106524c9 could not be found. Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8f045720-0275-4393-a9ca-683682532791 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Request method failure captured: Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 HTTP/1.1 Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7x24c17VAqbB1RPgV9M5muh9Mrutd22W3kymU2YVexF8Asm4Nhdbdh4AsAAZOmrI6NzLqzXSWWHdyESc9ZxaEJvGNL_UV7bqgWKvosBmiV75UWOIHuXPi9wYs2urm_rXDy-qgSApJPDpOeyrEJIbc0wpDH8VkHR3CCn69DIBloXF9kU Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: b5313574dcf84819b58af883ac6cb768 Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServerDiskConfigTestJSON-113106623 Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b5313574dcf84819b58af883ac6cb768"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b5313574dcf84819b58af883ac6cb768", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b5313574dcf84819b58af883ac6cb768"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b5313574dcf84819b58af883ac6cb768"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServerDiskConfigTestJSON-113106623 Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: b5313574dcf84819b58af883ac6cb768 Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-113106623 Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServerDiskConfigTestJSON-113106623-project Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: bbf878e8b08d4c85bb3fb925db315ac4 Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServerDiskConfigTestJSON-113106623-project Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 6fb23c99-88b5-40f9-b37a-06da106524c9 could not be found. Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '6fb23c99-88b5-40f9-b37a-06da106524c9'} Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fb23c99-88b5-40f9-b37a-06da106524c9 could not be found. Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:06:16.736395 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:06:16.740448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fb23c99-88b5-40f9-b37a-06da106524c9 could not be found. Aug 07 02:06:16.740448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:06:16.740448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:06:16.740448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:06:16.740448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:06:16.740448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:06:16.740448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:06:16.740448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:06:16.740448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:06:16.740448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fb23c99-88b5-40f9-b37a-06da106524c9 could not be found. Aug 07 02:06:16.740448 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:06:16.740448 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8f045720-0275-4393-a9ca-683682532791 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Returning 404 to user: Instance 6fb23c99-88b5-40f9-b37a-06da106524c9 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:06:16.740448 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8f045720-0275-4393-a9ca-683682532791 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 404 len: 111 microversion: 2.1 time: 0.030052 Aug 07 02:06:16.740448 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3117/6700] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 02:06:16 2022] DELETE /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:06:16.749422 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3dff8298-abc9-4412-92fa-ba28925c3443 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:06:16.750176 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3dff8298-abc9-4412-92fa-ba28925c3443 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] [instance: 6fb23c99-88b5-40f9-b37a-06da106524c9] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:06:16.757749 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3dff8298-abc9-4412-92fa-ba28925c3443 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:16.758243 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3dff8298-abc9-4412-92fa-ba28925c3443 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:16.758699 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3dff8298-abc9-4412-92fa-ba28925c3443 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:16.759414 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3dff8298-abc9-4412-92fa-ba28925c3443 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:16.759994 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3dff8298-abc9-4412-92fa-ba28925c3443 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:16.760441 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3dff8298-abc9-4412-92fa-ba28925c3443 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:16.774560 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-3dff8298-abc9-4412-92fa-ba28925c3443 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] HTTP exception thrown: Instance 6fb23c99-88b5-40f9-b37a-06da106524c9 could not be found. Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3dff8298-abc9-4412-92fa-ba28925c3443 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Request method failure captured: Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 HTTP/1.1 Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7x24c17VAqbB1RPgV9M5muh9Mrutd22W3kymU2YVexF8Asm4Nhdbdh4AsAAZOmrI6NzLqzXSWWHdyESc9ZxaEJvGNL_UV7bqgWKvosBmiV75UWOIHuXPi9wYs2urm_rXDy-qgSApJPDpOeyrEJIbc0wpDH8VkHR3CCn69DIBloXF9kU Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: b5313574dcf84819b58af883ac6cb768 Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServerDiskConfigTestJSON-113106623 Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b5313574dcf84819b58af883ac6cb768"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b5313574dcf84819b58af883ac6cb768", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b5313574dcf84819b58af883ac6cb768"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b5313574dcf84819b58af883ac6cb768"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServerDiskConfigTestJSON-113106623 Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: b5313574dcf84819b58af883ac6cb768 Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-113106623 Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServerDiskConfigTestJSON-113106623-project Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: bbf878e8b08d4c85bb3fb925db315ac4 Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServerDiskConfigTestJSON-113106623-project Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 6fb23c99-88b5-40f9-b37a-06da106524c9 could not be found. Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '6fb23c99-88b5-40f9-b37a-06da106524c9'} Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fb23c99-88b5-40f9-b37a-06da106524c9 could not be found. Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fb23c99-88b5-40f9-b37a-06da106524c9 could not be found. Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:06:16.776259 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:06:16.781137 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:06:16.781137 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:06:16.781137 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:06:16.781137 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:06:16.781137 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:06:16.781137 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fb23c99-88b5-40f9-b37a-06da106524c9 could not be found. Aug 07 02:06:16.781137 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:06:16.781137 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3dff8298-abc9-4412-92fa-ba28925c3443 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] Returning 404 to user: Instance 6fb23c99-88b5-40f9-b37a-06da106524c9 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:06:16.781137 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3dff8298-abc9-4412-92fa-ba28925c3443 tempest-ServerDiskConfigTestJSON-113106623 tempest-ServerDiskConfigTestJSON-113106623-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9" status: 404 len: 111 microversion: 2.1 time: 0.032744 Aug 07 02:06:16.781137 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3584/6701] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:06:16 2022] GET /compute/v2.1/servers/6fb23c99-88b5-40f9-b37a-06da106524c9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:06:25.390428 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-065e350e-bb77-4493-8a22-f6cc5f57ac4f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Action: 'create', calling method: .version_select at 0x7f9e242dcf70>, body: {"keypair": {"name": "tempest-keypair-1891336762", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDu+rk2H+MCwjSDpcY/bLloARjeh064ox+RfBga9Ue/qzbkP25ej7sxc+R8JBTpg29ePw3RAyeW52Wr2yFAG242jIqCIbMwt/3RA/+Nlwjc3EaGshtuiUR/xkloY+33AyQ=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:06:25.407506 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-065e350e-bb77-4493-8a22-f6cc5f57ac4f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Getting quotas for project 435945eeab2f42d386f48f7374bbd488. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:06:25.412921 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-065e350e-bb77-4493-8a22-f6cc5f57ac4f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Getting quotas for user 09cb536a0a584f5f96bec5fca7afa3b4 and project 435945eeab2f42d386f48f7374bbd488. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:06:25.443737 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-065e350e-bb77-4493-8a22-f6cc5f57ac4f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.184398 Aug 07 02:06:25.444389 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3118/6702] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 02:06:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:06:26.705601 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0600826a-bdd1-4ca0-925d-698f0b9be03d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1343491667", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "da7de2ad-cced-4f5b-81a4-2f9d332f427b"}], "security_groups": [{"name": "tempest-securitygroup--1850202519"}], "key_name": "tempest-keypair-1891336762", "user_data": "}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:06:26.765927 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:06:27.011514 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-0600826a-bdd1-4ca0-925d-698f0b9be03d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] validate_networks() for [('da7de2ad-cced-4f5b-81a4-2f9d332f427b', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 02:06:27.402275 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-0600826a-bdd1-4ca0-925d-698f0b9be03d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 02:06:27.402726 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-0600826a-bdd1-4ca0-925d-698f0b9be03d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 02:06:27.403293 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-0600826a-bdd1-4ca0-925d-698f0b9be03d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 02:06:27.403727 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-0600826a-bdd1-4ca0-925d-698f0b9be03d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 02:06:27.404193 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-0600826a-bdd1-4ca0-925d-698f0b9be03d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 02:06:27.413097 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0600826a-bdd1-4ca0-925d-698f0b9be03d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:27.413598 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0600826a-bdd1-4ca0-925d-698f0b9be03d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:27.414054 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0600826a-bdd1-4ca0-925d-698f0b9be03d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:27.414803 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0600826a-bdd1-4ca0-925d-698f0b9be03d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:27.415277 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0600826a-bdd1-4ca0-925d-698f0b9be03d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:27.415722 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0600826a-bdd1-4ca0-925d-698f0b9be03d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:27.433434 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-0600826a-bdd1-4ca0-925d-698f0b9be03d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Getting quotas for project 435945eeab2f42d386f48f7374bbd488. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:06:27.438778 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-0600826a-bdd1-4ca0-925d-698f0b9be03d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Getting quotas for user 09cb536a0a584f5f96bec5fca7afa3b4 and project 435945eeab2f42d386f48f7374bbd488. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:06:27.451396 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0600826a-bdd1-4ca0-925d-698f0b9be03d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 02:06:27.453762 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0600826a-bdd1-4ca0-925d-698f0b9be03d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 02:06:27.500503 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0600826a-bdd1-4ca0-925d-698f0b9be03d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.799344 Aug 07 02:06:27.501262 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3585/6703] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 02:06:26 2022] POST /compute/v2.1/servers => generated 409 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 02:06:27.509686 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:06:27.514130 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-48842932-30d2-4e5b-827c-78fd77523313 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:06:27.514750 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-48842932-30d2-4e5b-827c-78fd77523313 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:06:27.517688 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:06:27.648120 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-48842932-30d2-4e5b-827c-78fd77523313 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:06:27.659332 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-48842932-30d2-4e5b-827c-78fd77523313 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 200 len: 1239 microversion: 2.1 time: 0.147752 Aug 07 02:06:27.673224 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3119/6704] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:06:27 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 1239 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:06:28.693094 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-043a493d-bc4a-492b-a2b1-c524756f6d3a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:06:28.693879 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-043a493d-bc4a-492b-a2b1-c524756f6d3a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:06:28.697477 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:06:28.708325 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-043a493d-bc4a-492b-a2b1-c524756f6d3a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:28.709155 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-043a493d-bc4a-492b-a2b1-c524756f6d3a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:28.709633 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-043a493d-bc4a-492b-a2b1-c524756f6d3a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:28.710579 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-043a493d-bc4a-492b-a2b1-c524756f6d3a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:28.712111 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-043a493d-bc4a-492b-a2b1-c524756f6d3a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:28.712731 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-043a493d-bc4a-492b-a2b1-c524756f6d3a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:28.819466 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-043a493d-bc4a-492b-a2b1-c524756f6d3a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:06:28.836898 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-043a493d-bc4a-492b-a2b1-c524756f6d3a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 200 len: 1309 microversion: 2.1 time: 0.156243 Aug 07 02:06:28.839376 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3586/6705] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:06:28 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 1309 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:06:29.858490 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-89e517e8-53c5-4c92-bb3d-e4b3f7611a5e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:06:29.859110 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-89e517e8-53c5-4c92-bb3d-e4b3f7611a5e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:06:29.865942 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-89e517e8-53c5-4c92-bb3d-e4b3f7611a5e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:29.866433 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-89e517e8-53c5-4c92-bb3d-e4b3f7611a5e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:29.866879 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-89e517e8-53c5-4c92-bb3d-e4b3f7611a5e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:29.867582 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-89e517e8-53c5-4c92-bb3d-e4b3f7611a5e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:29.868081 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-89e517e8-53c5-4c92-bb3d-e4b3f7611a5e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:29.868508 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-89e517e8-53c5-4c92-bb3d-e4b3f7611a5e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:30.058298 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-89e517e8-53c5-4c92-bb3d-e4b3f7611a5e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:06:30.066868 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-89e517e8-53c5-4c92-bb3d-e4b3f7611a5e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 200 len: 1365 microversion: 2.1 time: 0.212825 Aug 07 02:06:30.067665 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3120/6706] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:06:29 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:06:30.111195 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-aa5a1cc5-546d-4997-96b3-e578ac9f6012 req-b39343bb-b224-4eab-aa71-db125d43ea62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6829b067-c1af-48f2-9556-caacccfd8f34", "tag": "9358a728-9dd1-487c-9e7c-81bee45d0aa7"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:06:30.123982 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-aa5a1cc5-546d-4997-96b3-e578ac9f6012 req-b39343bb-b224-4eab-aa71-db125d43ea62 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:30.124585 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-aa5a1cc5-546d-4997-96b3-e578ac9f6012 req-b39343bb-b224-4eab-aa71-db125d43ea62 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:30.125097 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-aa5a1cc5-546d-4997-96b3-e578ac9f6012 req-b39343bb-b224-4eab-aa71-db125d43ea62 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:30.136887 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-aa5a1cc5-546d-4997-96b3-e578ac9f6012 req-b39343bb-b224-4eab-aa71-db125d43ea62 service nova] Creating event network-changed:9358a728-9dd1-487c-9e7c-81bee45d0aa7 for instance 6829b067-c1af-48f2-9556-caacccfd8f34 on n-h1-master-1 Aug 07 02:06:30.142161 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-aa5a1cc5-546d-4997-96b3-e578ac9f6012 req-b39343bb-b224-4eab-aa71-db125d43ea62 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034940 Aug 07 02:06:30.143038 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3587/6707] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:06:31.089209 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1e9fb61e-7ff4-45fa-a957-55e6a7e5f705 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:06:31.089834 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1e9fb61e-7ff4-45fa-a957-55e6a7e5f705 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:06:31.097260 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e9fb61e-7ff4-45fa-a957-55e6a7e5f705 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:31.097756 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e9fb61e-7ff4-45fa-a957-55e6a7e5f705 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:31.098199 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e9fb61e-7ff4-45fa-a957-55e6a7e5f705 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:31.098919 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e9fb61e-7ff4-45fa-a957-55e6a7e5f705 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:31.099382 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e9fb61e-7ff4-45fa-a957-55e6a7e5f705 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:31.099813 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e9fb61e-7ff4-45fa-a957-55e6a7e5f705 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:31.232401 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1e9fb61e-7ff4-45fa-a957-55e6a7e5f705 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:06:31.240216 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1e9fb61e-7ff4-45fa-a957-55e6a7e5f705 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 200 len: 1365 microversion: 2.1 time: 0.155384 Aug 07 02:06:31.240738 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3121/6708] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:06:31 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:06:32.263163 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-95b9fdf1-f17a-4312-ba32-c8b8891162fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:06:32.263791 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-95b9fdf1-f17a-4312-ba32-c8b8891162fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:06:32.270075 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-95b9fdf1-f17a-4312-ba32-c8b8891162fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:32.270625 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-95b9fdf1-f17a-4312-ba32-c8b8891162fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:32.271013 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-95b9fdf1-f17a-4312-ba32-c8b8891162fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:32.271718 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-95b9fdf1-f17a-4312-ba32-c8b8891162fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:32.272224 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-95b9fdf1-f17a-4312-ba32-c8b8891162fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:32.272669 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-95b9fdf1-f17a-4312-ba32-c8b8891162fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:32.408269 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-95b9fdf1-f17a-4312-ba32-c8b8891162fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:06:32.415750 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-95b9fdf1-f17a-4312-ba32-c8b8891162fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 200 len: 1365 microversion: 2.1 time: 0.158378 Aug 07 02:06:32.416360 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3588/6709] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:06:32 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:06:33.436352 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-06d06b80-3334-4d65-a1ad-97e0c99c5311 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:06:33.436868 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-06d06b80-3334-4d65-a1ad-97e0c99c5311 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:06:33.444055 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06d06b80-3334-4d65-a1ad-97e0c99c5311 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:33.444545 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06d06b80-3334-4d65-a1ad-97e0c99c5311 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:33.444984 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06d06b80-3334-4d65-a1ad-97e0c99c5311 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:33.445686 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06d06b80-3334-4d65-a1ad-97e0c99c5311 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:33.446143 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06d06b80-3334-4d65-a1ad-97e0c99c5311 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:33.446576 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06d06b80-3334-4d65-a1ad-97e0c99c5311 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:33.580614 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-06d06b80-3334-4d65-a1ad-97e0c99c5311 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:06:33.588655 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-06d06b80-3334-4d65-a1ad-97e0c99c5311 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 200 len: 1365 microversion: 2.1 time: 0.155636 Aug 07 02:06:33.589220 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3122/6710] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:06:33 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:06:34.609894 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a8954595-150b-4ff3-9c6e-72c559a21ba9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:06:34.610637 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a8954595-150b-4ff3-9c6e-72c559a21ba9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:06:34.617541 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8954595-150b-4ff3-9c6e-72c559a21ba9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:34.618119 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8954595-150b-4ff3-9c6e-72c559a21ba9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:34.619016 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8954595-150b-4ff3-9c6e-72c559a21ba9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:34.620188 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8954595-150b-4ff3-9c6e-72c559a21ba9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:34.620870 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8954595-150b-4ff3-9c6e-72c559a21ba9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:34.621277 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8954595-150b-4ff3-9c6e-72c559a21ba9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:34.738384 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-b2cdfc6c-4eb3-4b6d-89c3-50bf3295f555 req-98a76758-5830-42cc-b1e0-4f1b10a25df0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6829b067-c1af-48f2-9556-caacccfd8f34", "name": "network-vif-plugged", "status": "completed", "tag": "9358a728-9dd1-487c-9e7c-81bee45d0aa7"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:06:34.753172 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b2cdfc6c-4eb3-4b6d-89c3-50bf3295f555 req-98a76758-5830-42cc-b1e0-4f1b10a25df0 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:34.753656 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b2cdfc6c-4eb3-4b6d-89c3-50bf3295f555 req-98a76758-5830-42cc-b1e0-4f1b10a25df0 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:34.754317 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b2cdfc6c-4eb3-4b6d-89c3-50bf3295f555 req-98a76758-5830-42cc-b1e0-4f1b10a25df0 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:34.765934 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-b2cdfc6c-4eb3-4b6d-89c3-50bf3295f555 req-98a76758-5830-42cc-b1e0-4f1b10a25df0 service nova] Creating event network-vif-plugged:9358a728-9dd1-487c-9e7c-81bee45d0aa7 for instance 6829b067-c1af-48f2-9556-caacccfd8f34 on n-h1-master-1 Aug 07 02:06:34.768718 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a8954595-150b-4ff3-9c6e-72c559a21ba9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:06:34.771275 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-b2cdfc6c-4eb3-4b6d-89c3-50bf3295f555 req-98a76758-5830-42cc-b1e0-4f1b10a25df0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037202 Aug 07 02:06:34.772459 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3123/6711] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 02:06:34.778140 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a8954595-150b-4ff3-9c6e-72c559a21ba9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 200 len: 1365 microversion: 2.1 time: 0.172234 Aug 07 02:06:34.778712 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3589/6712] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:06:34 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:06:35.800097 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fa2e67ea-733a-4083-9452-fe9384087459 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:06:35.800792 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fa2e67ea-733a-4083-9452-fe9384087459 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:06:35.807467 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa2e67ea-733a-4083-9452-fe9384087459 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:35.807963 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa2e67ea-733a-4083-9452-fe9384087459 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:35.808396 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa2e67ea-733a-4083-9452-fe9384087459 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:35.809080 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa2e67ea-733a-4083-9452-fe9384087459 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:35.809528 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa2e67ea-733a-4083-9452-fe9384087459 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:35.809946 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa2e67ea-733a-4083-9452-fe9384087459 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:35.941476 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fa2e67ea-733a-4083-9452-fe9384087459 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:06:35.950667 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fa2e67ea-733a-4083-9452-fe9384087459 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 200 len: 1365 microversion: 2.1 time: 0.155746 Aug 07 02:06:35.951464 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3124/6713] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:06:35 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:06:36.971754 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b7665a07-211e-477b-a624-58c69273a724 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:06:36.972503 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b7665a07-211e-477b-a624-58c69273a724 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:06:36.979677 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7665a07-211e-477b-a624-58c69273a724 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:36.980271 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7665a07-211e-477b-a624-58c69273a724 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:36.980722 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7665a07-211e-477b-a624-58c69273a724 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:36.981432 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7665a07-211e-477b-a624-58c69273a724 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:36.981894 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7665a07-211e-477b-a624-58c69273a724 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:36.982330 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b7665a07-211e-477b-a624-58c69273a724 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:37.113510 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b7665a07-211e-477b-a624-58c69273a724 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:06:37.121552 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b7665a07-211e-477b-a624-58c69273a724 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 200 len: 1551 microversion: 2.1 time: 0.153908 Aug 07 02:06:37.122117 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3590/6714] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:06:36 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 1551 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:06:37.142359 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f6a91c32-51aa-4ba6-933c-acc4a0dd03b4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:06:37.142845 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f6a91c32-51aa-4ba6-933c-acc4a0dd03b4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:06:37.149568 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f6a91c32-51aa-4ba6-933c-acc4a0dd03b4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:37.150127 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f6a91c32-51aa-4ba6-933c-acc4a0dd03b4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:37.150590 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f6a91c32-51aa-4ba6-933c-acc4a0dd03b4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:37.151289 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f6a91c32-51aa-4ba6-933c-acc4a0dd03b4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:37.151747 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f6a91c32-51aa-4ba6-933c-acc4a0dd03b4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:37.152220 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f6a91c32-51aa-4ba6-933c-acc4a0dd03b4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:37.237053 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f6a91c32-51aa-4ba6-933c-acc4a0dd03b4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098547 Aug 07 02:06:37.237648 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3125/6715] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Aug 7 02:06:37 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:06:38.464426 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-d3bf4f23-8ccb-476b-b879-20cda26e5fa0 req-3e120e6a-0523-45e1-97ed-1e00b5ba02fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6829b067-c1af-48f2-9556-caacccfd8f34", "tag": "9358a728-9dd1-487c-9e7c-81bee45d0aa7"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:06:38.469407 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:06:38.470093 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:06:38.477606 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d3bf4f23-8ccb-476b-b879-20cda26e5fa0 req-3e120e6a-0523-45e1-97ed-1e00b5ba02fb service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:06:38.478350 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d3bf4f23-8ccb-476b-b879-20cda26e5fa0 req-3e120e6a-0523-45e1-97ed-1e00b5ba02fb service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:06:38.478819 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d3bf4f23-8ccb-476b-b879-20cda26e5fa0 req-3e120e6a-0523-45e1-97ed-1e00b5ba02fb service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:06:38.489831 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-d3bf4f23-8ccb-476b-b879-20cda26e5fa0 req-3e120e6a-0523-45e1-97ed-1e00b5ba02fb service nova] Creating event network-changed:9358a728-9dd1-487c-9e7c-81bee45d0aa7 for instance 6829b067-c1af-48f2-9556-caacccfd8f34 on n-h1-master-1 Aug 07 02:06:38.494995 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-d3bf4f23-8ccb-476b-b879-20cda26e5fa0 req-3e120e6a-0523-45e1-97ed-1e00b5ba02fb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034934 Aug 07 02:06:38.495692 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3591/6716] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:07:12.357757 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:07:12.360532 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=15 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:07:12.361178 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=30 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:07:12.365863 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-70409ad9-a6ab-48a4-97c7-cfbe0de3d199 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:12.366839 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-70409ad9-a6ab-48a4-97c7-cfbe0de3d199 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:12.374057 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-70409ad9-a6ab-48a4-97c7-cfbe0de3d199 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:12.374536 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-70409ad9-a6ab-48a4-97c7-cfbe0de3d199 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:12.374971 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-70409ad9-a6ab-48a4-97c7-cfbe0de3d199 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:12.376035 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-70409ad9-a6ab-48a4-97c7-cfbe0de3d199 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:12.376494 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-70409ad9-a6ab-48a4-97c7-cfbe0de3d199 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:12.376920 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-70409ad9-a6ab-48a4-97c7-cfbe0de3d199 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:12.596119 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-70409ad9-a6ab-48a4-97c7-cfbe0de3d199 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:07:12.603903 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-70409ad9-a6ab-48a4-97c7-cfbe0de3d199 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 200 len: 1670 microversion: 2.1 time: 0.246999 Aug 07 02:07:12.604705 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3126/6717] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:07:12 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 1670 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:07:12.622844 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=11 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:07:12.624340 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=30 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:07:12.628476 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6798ba66-b665-4fd8-ae8d-662e17718432 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:12.629193 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6798ba66-b665-4fd8-ae8d-662e17718432 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:12.636290 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6798ba66-b665-4fd8-ae8d-662e17718432 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:12.636794 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6798ba66-b665-4fd8-ae8d-662e17718432 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:12.637244 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6798ba66-b665-4fd8-ae8d-662e17718432 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:12.637956 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6798ba66-b665-4fd8-ae8d-662e17718432 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:12.638421 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6798ba66-b665-4fd8-ae8d-662e17718432 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:12.639550 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6798ba66-b665-4fd8-ae8d-662e17718432 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:12.774937 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6798ba66-b665-4fd8-ae8d-662e17718432 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:07:12.782591 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6798ba66-b665-4fd8-ae8d-662e17718432 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 200 len: 1670 microversion: 2.1 time: 0.161986 Aug 07 02:07:12.783155 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3592/6718] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:07:12 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 1670 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:07:12.802465 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8d0d8839-361e-41ed-a207-352433add358 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:12.803082 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8d0d8839-361e-41ed-a207-352433add358 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:12.808991 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8d0d8839-361e-41ed-a207-352433add358 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:12.809475 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8d0d8839-361e-41ed-a207-352433add358 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:12.809912 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8d0d8839-361e-41ed-a207-352433add358 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:12.811092 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8d0d8839-361e-41ed-a207-352433add358 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:12.811549 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8d0d8839-361e-41ed-a207-352433add358 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:12.812011 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8d0d8839-361e-41ed-a207-352433add358 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:12.942229 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8d0d8839-361e-41ed-a207-352433add358 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:07:12.949789 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8d0d8839-361e-41ed-a207-352433add358 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 200 len: 1670 microversion: 2.1 time: 0.151121 Aug 07 02:07:12.950394 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3127/6719] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:07:12 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 1670 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:07:12.970928 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-34bd8595-0dec-49db-b56c-826ac5060310 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:07:12.973109 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-34bd8595-0dec-49db-b56c-826ac5060310 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:12.979386 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34bd8595-0dec-49db-b56c-826ac5060310 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:12.979904 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34bd8595-0dec-49db-b56c-826ac5060310 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:12.980379 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34bd8595-0dec-49db-b56c-826ac5060310 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:12.981070 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34bd8595-0dec-49db-b56c-826ac5060310 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:12.981536 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34bd8595-0dec-49db-b56c-826ac5060310 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:12.981973 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-34bd8595-0dec-49db-b56c-826ac5060310 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:13.011442 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-34bd8595-0dec-49db-b56c-826ac5060310 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:07:13.017453 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-34bd8595-0dec-49db-b56c-826ac5060310 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Old instance type m1.heat2, new instance type m1.heat {{(pid=119516) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 07 02:07:13.023746 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-34bd8595-0dec-49db-b56c-826ac5060310 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 02:07:13.024211 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-34bd8595-0dec-49db-b56c-826ac5060310 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 02:07:13.024693 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-34bd8595-0dec-49db-b56c-826ac5060310 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 02:07:13.025112 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-34bd8595-0dec-49db-b56c-826ac5060310 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 02:07:13.025533 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-34bd8595-0dec-49db-b56c-826ac5060310 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 02:07:13.087042 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-34bd8595-0dec-49db-b56c-826ac5060310 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "POST /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34/action" status: 202 len: 0 microversion: 2.1 time: 0.120169 Aug 07 02:07:13.087646 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3593/6720] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:07:12 2022] POST /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:07:13.095790 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ac1ad9d6-f3c3-4c54-b8d5-af09d252f76e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:13.096409 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ac1ad9d6-f3c3-4c54-b8d5-af09d252f76e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:13.102797 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ac1ad9d6-f3c3-4c54-b8d5-af09d252f76e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:13.103184 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ac1ad9d6-f3c3-4c54-b8d5-af09d252f76e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:13.103619 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ac1ad9d6-f3c3-4c54-b8d5-af09d252f76e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:13.104343 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ac1ad9d6-f3c3-4c54-b8d5-af09d252f76e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:13.104800 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ac1ad9d6-f3c3-4c54-b8d5-af09d252f76e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:13.105227 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ac1ad9d6-f3c3-4c54-b8d5-af09d252f76e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:13.266207 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ac1ad9d6-f3c3-4c54-b8d5-af09d252f76e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:07:13.273799 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ac1ad9d6-f3c3-4c54-b8d5-af09d252f76e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 200 len: 1679 microversion: 2.1 time: 0.181897 Aug 07 02:07:13.274401 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3128/6721] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:07:13 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 1679 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:07:14.295706 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-20691b3c-3e73-40b6-9b20-b3ee8e8283f5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:14.296292 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-20691b3c-3e73-40b6-9b20-b3ee8e8283f5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:14.303146 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20691b3c-3e73-40b6-9b20-b3ee8e8283f5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:14.303641 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20691b3c-3e73-40b6-9b20-b3ee8e8283f5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:14.304116 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20691b3c-3e73-40b6-9b20-b3ee8e8283f5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:14.304822 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20691b3c-3e73-40b6-9b20-b3ee8e8283f5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:14.305286 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20691b3c-3e73-40b6-9b20-b3ee8e8283f5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:14.305720 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20691b3c-3e73-40b6-9b20-b3ee8e8283f5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:14.442559 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-20691b3c-3e73-40b6-9b20-b3ee8e8283f5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:07:14.452502 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-20691b3c-3e73-40b6-9b20-b3ee8e8283f5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 200 len: 1679 microversion: 2.1 time: 0.160561 Aug 07 02:07:14.453175 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3594/6722] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:07:14 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:07:15.474114 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6efc8c31-e3a4-4ff1-8b8e-1d8841920d97 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:15.474734 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6efc8c31-e3a4-4ff1-8b8e-1d8841920d97 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:15.481480 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6efc8c31-e3a4-4ff1-8b8e-1d8841920d97 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:15.481964 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6efc8c31-e3a4-4ff1-8b8e-1d8841920d97 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:15.482421 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6efc8c31-e3a4-4ff1-8b8e-1d8841920d97 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:15.483146 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6efc8c31-e3a4-4ff1-8b8e-1d8841920d97 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:15.483607 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6efc8c31-e3a4-4ff1-8b8e-1d8841920d97 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:15.484101 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6efc8c31-e3a4-4ff1-8b8e-1d8841920d97 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:15.612195 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6efc8c31-e3a4-4ff1-8b8e-1d8841920d97 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:07:15.619666 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6efc8c31-e3a4-4ff1-8b8e-1d8841920d97 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 200 len: 1684 microversion: 2.1 time: 0.149565 Aug 07 02:07:15.620274 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3129/6723] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:07:15 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:07:16.642082 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-857baeb4-13f0-40f3-ac5e-c3916a14c438 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:16.642715 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-857baeb4-13f0-40f3-ac5e-c3916a14c438 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:16.649359 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-857baeb4-13f0-40f3-ac5e-c3916a14c438 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:16.649858 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-857baeb4-13f0-40f3-ac5e-c3916a14c438 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:16.650315 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-857baeb4-13f0-40f3-ac5e-c3916a14c438 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:16.651029 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-857baeb4-13f0-40f3-ac5e-c3916a14c438 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:16.651504 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-857baeb4-13f0-40f3-ac5e-c3916a14c438 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:16.651979 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-857baeb4-13f0-40f3-ac5e-c3916a14c438 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:16.780210 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-857baeb4-13f0-40f3-ac5e-c3916a14c438 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:07:16.788014 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-857baeb4-13f0-40f3-ac5e-c3916a14c438 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 200 len: 1684 microversion: 2.1 time: 0.150368 Aug 07 02:07:16.788918 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3595/6724] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:07:16 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:07:17.809093 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-46fc70c5-42ba-4ef8-96db-d8f9c72c49b8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:17.809719 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-46fc70c5-42ba-4ef8-96db-d8f9c72c49b8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:17.817326 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-46fc70c5-42ba-4ef8-96db-d8f9c72c49b8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:17.817811 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-46fc70c5-42ba-4ef8-96db-d8f9c72c49b8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:17.818258 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-46fc70c5-42ba-4ef8-96db-d8f9c72c49b8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:17.818955 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-46fc70c5-42ba-4ef8-96db-d8f9c72c49b8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:17.819414 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-46fc70c5-42ba-4ef8-96db-d8f9c72c49b8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:17.819846 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-46fc70c5-42ba-4ef8-96db-d8f9c72c49b8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:17.945850 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-46fc70c5-42ba-4ef8-96db-d8f9c72c49b8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:07:17.953924 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-46fc70c5-42ba-4ef8-96db-d8f9c72c49b8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 200 len: 1684 microversion: 2.1 time: 0.148757 Aug 07 02:07:17.954498 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3130/6725] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:07:17 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 1684 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:07:18.974616 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a48b8001-485a-4cc8-9d21-e797fc696875 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:18.975247 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a48b8001-485a-4cc8-9d21-e797fc696875 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:18.982473 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a48b8001-485a-4cc8-9d21-e797fc696875 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:18.984155 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a48b8001-485a-4cc8-9d21-e797fc696875 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:18.984155 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a48b8001-485a-4cc8-9d21-e797fc696875 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:18.984893 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a48b8001-485a-4cc8-9d21-e797fc696875 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:18.985355 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a48b8001-485a-4cc8-9d21-e797fc696875 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:18.986409 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a48b8001-485a-4cc8-9d21-e797fc696875 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:19.113599 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a48b8001-485a-4cc8-9d21-e797fc696875 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:07:19.121095 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a48b8001-485a-4cc8-9d21-e797fc696875 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 200 len: 1684 microversion: 2.1 time: 0.150423 Aug 07 02:07:19.121665 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3596/6726] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:07:18 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:07:20.141958 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3ec47390-9ce2-40c1-b5cd-8f74b3a4e453 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:20.142579 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3ec47390-9ce2-40c1-b5cd-8f74b3a4e453 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:20.149472 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ec47390-9ce2-40c1-b5cd-8f74b3a4e453 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:20.149961 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ec47390-9ce2-40c1-b5cd-8f74b3a4e453 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:20.150400 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ec47390-9ce2-40c1-b5cd-8f74b3a4e453 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:20.151099 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ec47390-9ce2-40c1-b5cd-8f74b3a4e453 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:20.151556 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ec47390-9ce2-40c1-b5cd-8f74b3a4e453 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:20.152013 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ec47390-9ce2-40c1-b5cd-8f74b3a4e453 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:20.284992 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3ec47390-9ce2-40c1-b5cd-8f74b3a4e453 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:07:20.292555 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3ec47390-9ce2-40c1-b5cd-8f74b3a4e453 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 200 len: 1684 microversion: 2.1 time: 0.154473 Aug 07 02:07:20.293127 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3131/6727] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:07:20 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:07:21.315114 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-04b2e17f-90c6-45ab-b392-8c85ee5c1fbd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:21.315772 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-04b2e17f-90c6-45ab-b392-8c85ee5c1fbd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:21.322748 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-04b2e17f-90c6-45ab-b392-8c85ee5c1fbd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:21.323275 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-04b2e17f-90c6-45ab-b392-8c85ee5c1fbd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:21.323731 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-04b2e17f-90c6-45ab-b392-8c85ee5c1fbd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:21.324476 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-04b2e17f-90c6-45ab-b392-8c85ee5c1fbd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:21.324950 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-04b2e17f-90c6-45ab-b392-8c85ee5c1fbd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:21.325392 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-04b2e17f-90c6-45ab-b392-8c85ee5c1fbd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:21.460231 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-04b2e17f-90c6-45ab-b392-8c85ee5c1fbd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:07:21.468002 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-04b2e17f-90c6-45ab-b392-8c85ee5c1fbd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 200 len: 1684 microversion: 2.1 time: 0.157466 Aug 07 02:07:21.468568 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3597/6728] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:07:21 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:07:22.488373 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-44edd2cc-abf9-4d0f-ba2d-ffab61d79263 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:22.488989 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-44edd2cc-abf9-4d0f-ba2d-ffab61d79263 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:22.496017 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44edd2cc-abf9-4d0f-ba2d-ffab61d79263 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:22.496504 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44edd2cc-abf9-4d0f-ba2d-ffab61d79263 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:22.496944 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44edd2cc-abf9-4d0f-ba2d-ffab61d79263 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:22.497636 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44edd2cc-abf9-4d0f-ba2d-ffab61d79263 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:22.498091 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44edd2cc-abf9-4d0f-ba2d-ffab61d79263 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:22.498518 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-44edd2cc-abf9-4d0f-ba2d-ffab61d79263 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:22.625624 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-44edd2cc-abf9-4d0f-ba2d-ffab61d79263 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:07:22.633276 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-44edd2cc-abf9-4d0f-ba2d-ffab61d79263 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 200 len: 1684 microversion: 2.1 time: 0.148818 Aug 07 02:07:22.633849 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3132/6729] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:07:22 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 1684 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:07:23.654359 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9522e419-ab81-4f3b-9599-0195c5a930e2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:23.654957 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9522e419-ab81-4f3b-9599-0195c5a930e2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:23.662617 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9522e419-ab81-4f3b-9599-0195c5a930e2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:23.663113 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9522e419-ab81-4f3b-9599-0195c5a930e2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:23.663563 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9522e419-ab81-4f3b-9599-0195c5a930e2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:23.664297 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9522e419-ab81-4f3b-9599-0195c5a930e2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:23.664766 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9522e419-ab81-4f3b-9599-0195c5a930e2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:23.665207 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9522e419-ab81-4f3b-9599-0195c5a930e2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:23.794016 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9522e419-ab81-4f3b-9599-0195c5a930e2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:07:23.801640 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9522e419-ab81-4f3b-9599-0195c5a930e2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 200 len: 1684 microversion: 2.1 time: 0.151202 Aug 07 02:07:23.802216 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3598/6730] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:07:23 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:07:24.830050 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-39a90f5c-6470-470b-b01d-2e4a8c580a1b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:24.830665 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-39a90f5c-6470-470b-b01d-2e4a8c580a1b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:24.837550 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39a90f5c-6470-470b-b01d-2e4a8c580a1b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:24.838030 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39a90f5c-6470-470b-b01d-2e4a8c580a1b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:24.838469 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39a90f5c-6470-470b-b01d-2e4a8c580a1b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:24.839160 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39a90f5c-6470-470b-b01d-2e4a8c580a1b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:24.839613 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39a90f5c-6470-470b-b01d-2e4a8c580a1b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:24.840072 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-39a90f5c-6470-470b-b01d-2e4a8c580a1b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:24.968786 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-39a90f5c-6470-470b-b01d-2e4a8c580a1b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:07:24.976439 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-39a90f5c-6470-470b-b01d-2e4a8c580a1b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 200 len: 1684 microversion: 2.1 time: 0.150896 Aug 07 02:07:24.977013 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3133/6731] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:07:24 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:07:25.998332 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-819568a1-d195-41ec-b80b-fcdf380bc556 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:25.998962 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-819568a1-d195-41ec-b80b-fcdf380bc556 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:26.005984 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-819568a1-d195-41ec-b80b-fcdf380bc556 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:26.006477 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-819568a1-d195-41ec-b80b-fcdf380bc556 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:26.006926 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-819568a1-d195-41ec-b80b-fcdf380bc556 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:26.007632 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-819568a1-d195-41ec-b80b-fcdf380bc556 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:26.008127 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-819568a1-d195-41ec-b80b-fcdf380bc556 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:26.008566 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-819568a1-d195-41ec-b80b-fcdf380bc556 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:26.195017 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-819568a1-d195-41ec-b80b-fcdf380bc556 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:07:26.202850 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-819568a1-d195-41ec-b80b-fcdf380bc556 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 200 len: 1684 microversion: 2.1 time: 0.208410 Aug 07 02:07:26.203425 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3599/6732] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:07:25 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 1684 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:07:27.228115 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-167a2f69-ba9d-4362-828d-6bea7bcf60b8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:27.228640 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-167a2f69-ba9d-4362-828d-6bea7bcf60b8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:27.236106 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-167a2f69-ba9d-4362-828d-6bea7bcf60b8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:27.236595 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-167a2f69-ba9d-4362-828d-6bea7bcf60b8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:27.237036 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-167a2f69-ba9d-4362-828d-6bea7bcf60b8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:27.237740 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-167a2f69-ba9d-4362-828d-6bea7bcf60b8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:27.238201 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-167a2f69-ba9d-4362-828d-6bea7bcf60b8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:27.238639 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-167a2f69-ba9d-4362-828d-6bea7bcf60b8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:27.511040 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-167a2f69-ba9d-4362-828d-6bea7bcf60b8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:07:27.519187 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-167a2f69-ba9d-4362-828d-6bea7bcf60b8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 200 len: 1683 microversion: 2.1 time: 0.295160 Aug 07 02:07:27.519774 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3134/6733] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:07:27 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 1683 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:07:27.606640 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-51920134-0c95-420e-8f06-8caed821e84a req-37b9b028-507d-4738-b55b-af5b72e2bbf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6829b067-c1af-48f2-9556-caacccfd8f34", "name": "network-vif-unplugged", "status": "completed", "tag": "9358a728-9dd1-487c-9e7c-81bee45d0aa7"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:07:27.617484 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-51920134-0c95-420e-8f06-8caed821e84a req-37b9b028-507d-4738-b55b-af5b72e2bbf0 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:27.618013 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-51920134-0c95-420e-8f06-8caed821e84a req-37b9b028-507d-4738-b55b-af5b72e2bbf0 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:27.618465 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-51920134-0c95-420e-8f06-8caed821e84a req-37b9b028-507d-4738-b55b-af5b72e2bbf0 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:27.631445 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-51920134-0c95-420e-8f06-8caed821e84a req-37b9b028-507d-4738-b55b-af5b72e2bbf0 service nova] Creating event network-vif-unplugged:9358a728-9dd1-487c-9e7c-81bee45d0aa7 for instance 6829b067-c1af-48f2-9556-caacccfd8f34 on n-h2-master-1 Aug 07 02:07:27.637193 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [req-51920134-0c95-420e-8f06-8caed821e84a req-37b9b028-507d-4738-b55b-af5b72e2bbf0 service nova] Instance 6829b067-c1af-48f2-9556-caacccfd8f34 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 02:07:27.648838 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-51920134-0c95-420e-8f06-8caed821e84a req-37b9b028-507d-4738-b55b-af5b72e2bbf0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046211 Aug 07 02:07:27.649464 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3600/6734] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:07:28.541380 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d1b1f3d6-f26c-49d0-9b44-739b996558c7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:28.541996 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d1b1f3d6-f26c-49d0-9b44-739b996558c7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:28.550267 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1b1f3d6-f26c-49d0-9b44-739b996558c7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:28.551149 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1b1f3d6-f26c-49d0-9b44-739b996558c7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:28.551982 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1b1f3d6-f26c-49d0-9b44-739b996558c7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:28.553251 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1b1f3d6-f26c-49d0-9b44-739b996558c7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:28.554113 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1b1f3d6-f26c-49d0-9b44-739b996558c7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:28.554582 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1b1f3d6-f26c-49d0-9b44-739b996558c7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:28.756601 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d1b1f3d6-f26c-49d0-9b44-739b996558c7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:07:28.764105 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d1b1f3d6-f26c-49d0-9b44-739b996558c7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 200 len: 1683 microversion: 2.1 time: 0.226560 Aug 07 02:07:28.764683 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3135/6735] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:07:28 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 1683 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:07:29.665920 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-b409fffd-fd44-427b-98b3-557f4529a538 req-04c24c69-e4b4-45e9-9665-ca5c51f77b16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6829b067-c1af-48f2-9556-caacccfd8f34", "tag": "9358a728-9dd1-487c-9e7c-81bee45d0aa7"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:07:29.675991 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b409fffd-fd44-427b-98b3-557f4529a538 req-04c24c69-e4b4-45e9-9665-ca5c51f77b16 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:29.676483 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b409fffd-fd44-427b-98b3-557f4529a538 req-04c24c69-e4b4-45e9-9665-ca5c51f77b16 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:29.676934 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b409fffd-fd44-427b-98b3-557f4529a538 req-04c24c69-e4b4-45e9-9665-ca5c51f77b16 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:29.691709 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-b409fffd-fd44-427b-98b3-557f4529a538 req-04c24c69-e4b4-45e9-9665-ca5c51f77b16 service nova] Creating event network-changed:9358a728-9dd1-487c-9e7c-81bee45d0aa7 for instance 6829b067-c1af-48f2-9556-caacccfd8f34 on n-h2-master-1 Aug 07 02:07:29.697036 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [req-b409fffd-fd44-427b-98b3-557f4529a538 req-04c24c69-e4b4-45e9-9665-ca5c51f77b16 service nova] Instance 6829b067-c1af-48f2-9556-caacccfd8f34 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 02:07:29.707374 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-b409fffd-fd44-427b-98b3-557f4529a538 req-04c24c69-e4b4-45e9-9665-ca5c51f77b16 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046406 Aug 07 02:07:29.707979 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3601/6736] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:07:29.785012 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-edd4d20e-6ce2-4408-86dd-ad4d2ed78438 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:29.785701 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-edd4d20e-6ce2-4408-86dd-ad4d2ed78438 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:29.792577 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-edd4d20e-6ce2-4408-86dd-ad4d2ed78438 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:29.793069 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-edd4d20e-6ce2-4408-86dd-ad4d2ed78438 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:29.793509 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-edd4d20e-6ce2-4408-86dd-ad4d2ed78438 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:29.794216 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-edd4d20e-6ce2-4408-86dd-ad4d2ed78438 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:29.794679 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-edd4d20e-6ce2-4408-86dd-ad4d2ed78438 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:29.795109 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-edd4d20e-6ce2-4408-86dd-ad4d2ed78438 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:30.005273 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-edd4d20e-6ce2-4408-86dd-ad4d2ed78438 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:07:30.012961 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-edd4d20e-6ce2-4408-86dd-ad4d2ed78438 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 200 len: 1681 microversion: 2.1 time: 0.231863 Aug 07 02:07:30.013538 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3136/6737] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:07:29 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 1681 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:07:31.035782 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e50aba5c-27c0-4019-bafb-4fb5988181aa tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:31.036529 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e50aba5c-27c0-4019-bafb-4fb5988181aa tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:31.042781 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e50aba5c-27c0-4019-bafb-4fb5988181aa tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:31.043283 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e50aba5c-27c0-4019-bafb-4fb5988181aa tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:31.043745 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e50aba5c-27c0-4019-bafb-4fb5988181aa tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:31.044487 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e50aba5c-27c0-4019-bafb-4fb5988181aa tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:31.044966 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e50aba5c-27c0-4019-bafb-4fb5988181aa tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:31.045414 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e50aba5c-27c0-4019-bafb-4fb5988181aa tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:31.181473 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e50aba5c-27c0-4019-bafb-4fb5988181aa tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:07:31.189347 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e50aba5c-27c0-4019-bafb-4fb5988181aa tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 200 len: 1678 microversion: 2.1 time: 0.158686 Aug 07 02:07:31.190661 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3602/6738] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:07:31 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:07:31.210900 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-613b9cbc-43c5-4dc1-a15c-a408e610af82 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:07:31.211423 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-613b9cbc-43c5-4dc1-a15c-a408e610af82 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:31.218267 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-613b9cbc-43c5-4dc1-a15c-a408e610af82 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:31.218752 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-613b9cbc-43c5-4dc1-a15c-a408e610af82 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:31.219198 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-613b9cbc-43c5-4dc1-a15c-a408e610af82 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:31.219910 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-613b9cbc-43c5-4dc1-a15c-a408e610af82 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:31.220446 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-613b9cbc-43c5-4dc1-a15c-a408e610af82 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:31.221497 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-613b9cbc-43c5-4dc1-a15c-a408e610af82 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:31.279594 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-613b9cbc-43c5-4dc1-a15c-a408e610af82 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "POST /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34/action" status: 204 len: 0 microversion: 2.1 time: 0.072311 Aug 07 02:07:31.280337 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3137/6739] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:07:31 2022] POST /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 02:07:31.289449 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1c691172-d974-4440-8d5b-6abfd21806d2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:31.290424 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1c691172-d974-4440-8d5b-6abfd21806d2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:31.297451 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c691172-d974-4440-8d5b-6abfd21806d2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:31.298202 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c691172-d974-4440-8d5b-6abfd21806d2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:31.298918 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c691172-d974-4440-8d5b-6abfd21806d2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:31.300600 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c691172-d974-4440-8d5b-6abfd21806d2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:31.301181 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c691172-d974-4440-8d5b-6abfd21806d2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:31.301702 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c691172-d974-4440-8d5b-6abfd21806d2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:31.440111 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1c691172-d974-4440-8d5b-6abfd21806d2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:07:31.448179 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1c691172-d974-4440-8d5b-6abfd21806d2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 200 len: 1678 microversion: 2.1 time: 0.162783 Aug 07 02:07:31.448753 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3603/6740] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:07:31 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:07:32.470174 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7fbc2cb4-ccc5-42bd-b2cb-4902da41115a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:32.470880 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7fbc2cb4-ccc5-42bd-b2cb-4902da41115a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:32.478549 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7fbc2cb4-ccc5-42bd-b2cb-4902da41115a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:32.479261 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7fbc2cb4-ccc5-42bd-b2cb-4902da41115a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:32.479698 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7fbc2cb4-ccc5-42bd-b2cb-4902da41115a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:32.480442 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7fbc2cb4-ccc5-42bd-b2cb-4902da41115a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:32.480896 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7fbc2cb4-ccc5-42bd-b2cb-4902da41115a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:32.481321 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7fbc2cb4-ccc5-42bd-b2cb-4902da41115a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:32.705421 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7fbc2cb4-ccc5-42bd-b2cb-4902da41115a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:07:32.713211 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7fbc2cb4-ccc5-42bd-b2cb-4902da41115a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 200 len: 1670 microversion: 2.1 time: 0.247230 Aug 07 02:07:32.713787 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3138/6741] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:07:32 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 1670 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:07:32.733807 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fe86014c-fb66-4e39-a8e6-8eb338ef8aa3 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:32.734440 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fe86014c-fb66-4e39-a8e6-8eb338ef8aa3 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:32.741747 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe86014c-fb66-4e39-a8e6-8eb338ef8aa3 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:32.742244 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe86014c-fb66-4e39-a8e6-8eb338ef8aa3 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:32.742695 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe86014c-fb66-4e39-a8e6-8eb338ef8aa3 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:32.743432 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe86014c-fb66-4e39-a8e6-8eb338ef8aa3 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:32.743957 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe86014c-fb66-4e39-a8e6-8eb338ef8aa3 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:32.744363 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe86014c-fb66-4e39-a8e6-8eb338ef8aa3 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:32.954481 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fe86014c-fb66-4e39-a8e6-8eb338ef8aa3 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:07:32.962149 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fe86014c-fb66-4e39-a8e6-8eb338ef8aa3 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 200 len: 1670 microversion: 2.1 time: 0.232538 Aug 07 02:07:32.962659 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3604/6742] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:07:32 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 1670 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:07:32.983109 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-acc316a9-bfc8-43e8-a891-3db5d77229d8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:32.983753 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-acc316a9-bfc8-43e8-a891-3db5d77229d8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:32.990529 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-acc316a9-bfc8-43e8-a891-3db5d77229d8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:32.991019 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-acc316a9-bfc8-43e8-a891-3db5d77229d8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:32.991487 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-acc316a9-bfc8-43e8-a891-3db5d77229d8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:32.992215 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-acc316a9-bfc8-43e8-a891-3db5d77229d8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:32.992677 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-acc316a9-bfc8-43e8-a891-3db5d77229d8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:32.993111 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-acc316a9-bfc8-43e8-a891-3db5d77229d8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:33.119585 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-acc316a9-bfc8-43e8-a891-3db5d77229d8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:07:33.127097 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-acc316a9-bfc8-43e8-a891-3db5d77229d8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 200 len: 1670 microversion: 2.1 time: 0.148163 Aug 07 02:07:33.127684 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3139/6743] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:07:32 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 1670 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:07:33.147516 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3eb86d51-eae1-4ffe-84c1-9baca3383e2a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:33.148061 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3eb86d51-eae1-4ffe-84c1-9baca3383e2a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:33.154076 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3eb86d51-eae1-4ffe-84c1-9baca3383e2a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:33.154565 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3eb86d51-eae1-4ffe-84c1-9baca3383e2a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:33.155012 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3eb86d51-eae1-4ffe-84c1-9baca3383e2a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:33.155715 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3eb86d51-eae1-4ffe-84c1-9baca3383e2a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:33.156206 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3eb86d51-eae1-4ffe-84c1-9baca3383e2a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:33.156648 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3eb86d51-eae1-4ffe-84c1-9baca3383e2a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:33.181560 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3eb86d51-eae1-4ffe-84c1-9baca3383e2a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 02:07:33.255896 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3eb86d51-eae1-4ffe-84c1-9baca3383e2a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 204 len: 0 microversion: 2.1 time: 0.111798 Aug 07 02:07:33.256690 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3605/6744] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 02:07:33 2022] DELETE /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 02:07:33.264930 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bc947ec4-182e-4bad-862b-f9cba2b6690a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:33.265549 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bc947ec4-182e-4bad-862b-f9cba2b6690a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:33.272328 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc947ec4-182e-4bad-862b-f9cba2b6690a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:33.272816 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc947ec4-182e-4bad-862b-f9cba2b6690a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:33.273255 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc947ec4-182e-4bad-862b-f9cba2b6690a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:33.273960 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc947ec4-182e-4bad-862b-f9cba2b6690a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:33.274419 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc947ec4-182e-4bad-862b-f9cba2b6690a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:33.274849 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bc947ec4-182e-4bad-862b-f9cba2b6690a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:33.410221 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bc947ec4-182e-4bad-862b-f9cba2b6690a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:07:33.417737 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bc947ec4-182e-4bad-862b-f9cba2b6690a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 200 len: 1676 microversion: 2.1 time: 0.156689 Aug 07 02:07:33.418313 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3140/6745] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:07:33 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:07:34.069096 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-38bed4db-7b2e-49d9-8afb-051718d04da9 req-27e7c7f7-df6b-4a88-8109-f4d34dfed56f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6829b067-c1af-48f2-9556-caacccfd8f34", "name": "network-vif-plugged", "status": "completed", "tag": "9358a728-9dd1-487c-9e7c-81bee45d0aa7"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:07:34.080267 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-38bed4db-7b2e-49d9-8afb-051718d04da9 req-27e7c7f7-df6b-4a88-8109-f4d34dfed56f service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:34.080748 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-38bed4db-7b2e-49d9-8afb-051718d04da9 req-27e7c7f7-df6b-4a88-8109-f4d34dfed56f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:34.081682 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-38bed4db-7b2e-49d9-8afb-051718d04da9 req-27e7c7f7-df6b-4a88-8109-f4d34dfed56f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:34.085632 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:07:34.092750 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-38bed4db-7b2e-49d9-8afb-051718d04da9 req-27e7c7f7-df6b-4a88-8109-f4d34dfed56f service nova] Creating event network-vif-plugged:9358a728-9dd1-487c-9e7c-81bee45d0aa7 for instance 6829b067-c1af-48f2-9556-caacccfd8f34 on n-h2-master-1 Aug 07 02:07:34.098271 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-38bed4db-7b2e-49d9-8afb-051718d04da9 req-27e7c7f7-df6b-4a88-8109-f4d34dfed56f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033711 Aug 07 02:07:34.098878 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3606/6746] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:07:34.438775 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1c601b7d-7a62-48fb-8b71-5839b5b65c91 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:34.439400 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1c601b7d-7a62-48fb-8b71-5839b5b65c91 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:34.447270 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c601b7d-7a62-48fb-8b71-5839b5b65c91 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:34.447763 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c601b7d-7a62-48fb-8b71-5839b5b65c91 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:34.448252 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c601b7d-7a62-48fb-8b71-5839b5b65c91 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:34.448936 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c601b7d-7a62-48fb-8b71-5839b5b65c91 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:34.449398 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c601b7d-7a62-48fb-8b71-5839b5b65c91 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:34.449829 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1c601b7d-7a62-48fb-8b71-5839b5b65c91 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:34.466116 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:07:34.579966 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1c601b7d-7a62-48fb-8b71-5839b5b65c91 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:07:34.588365 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1c601b7d-7a62-48fb-8b71-5839b5b65c91 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 200 len: 1676 microversion: 2.1 time: 0.153568 Aug 07 02:07:34.588928 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3141/6747] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:07:34 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:07:35.508359 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-5e19a8a1-cdee-488b-bdb0-7c369c373184 req-f1fdfaf6-685d-4e44-b2ca-4a33be184d3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6829b067-c1af-48f2-9556-caacccfd8f34", "name": "network-vif-deleted", "tag": "9358a728-9dd1-487c-9e7c-81bee45d0aa7"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:07:35.522879 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-5e19a8a1-cdee-488b-bdb0-7c369c373184 req-f1fdfaf6-685d-4e44-b2ca-4a33be184d3c service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:35.523698 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-5e19a8a1-cdee-488b-bdb0-7c369c373184 req-f1fdfaf6-685d-4e44-b2ca-4a33be184d3c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:35.524300 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-5e19a8a1-cdee-488b-bdb0-7c369c373184 req-f1fdfaf6-685d-4e44-b2ca-4a33be184d3c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:35.538599 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-5e19a8a1-cdee-488b-bdb0-7c369c373184 req-f1fdfaf6-685d-4e44-b2ca-4a33be184d3c service nova] Creating event network-vif-deleted:9358a728-9dd1-487c-9e7c-81bee45d0aa7 for instance 6829b067-c1af-48f2-9556-caacccfd8f34 on n-h2-master-1 Aug 07 02:07:35.544011 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-5e19a8a1-cdee-488b-bdb0-7c369c373184 req-f1fdfaf6-685d-4e44-b2ca-4a33be184d3c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041856 Aug 07 02:07:35.544785 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3607/6748] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:07:35.609943 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1cf6eb47-8973-4020-810e-72e90b3eb64d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:35.610637 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1cf6eb47-8973-4020-810e-72e90b3eb64d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:35.619627 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1cf6eb47-8973-4020-810e-72e90b3eb64d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:35.620247 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1cf6eb47-8973-4020-810e-72e90b3eb64d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:35.620763 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1cf6eb47-8973-4020-810e-72e90b3eb64d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:35.621519 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1cf6eb47-8973-4020-810e-72e90b3eb64d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:35.622040 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1cf6eb47-8973-4020-810e-72e90b3eb64d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:35.622538 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1cf6eb47-8973-4020-810e-72e90b3eb64d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:35.655383 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1cf6eb47-8973-4020-810e-72e90b3eb64d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:35.656014 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1cf6eb47-8973-4020-810e-72e90b3eb64d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:35.656352 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1cf6eb47-8973-4020-810e-72e90b3eb64d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:35.656971 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-1cf6eb47-8973-4020-810e-72e90b3eb64d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lazy-loading 'fault' on Instance uuid 6829b067-c1af-48f2-9556-caacccfd8f34 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 02:07:35.706223 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1cf6eb47-8973-4020-810e-72e90b3eb64d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:07:35.715218 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1cf6eb47-8973-4020-810e-72e90b3eb64d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 200 len: 1329 microversion: 2.1 time: 0.109445 Aug 07 02:07:35.715806 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3142/6749] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:07:35 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 1329 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:07:36.737896 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-df12906f-7dd6-4719-9282-58d4f00e7e52 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:36.739535 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-df12906f-7dd6-4719-9282-58d4f00e7e52 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:36.746736 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df12906f-7dd6-4719-9282-58d4f00e7e52 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:36.747236 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df12906f-7dd6-4719-9282-58d4f00e7e52 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:36.747690 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df12906f-7dd6-4719-9282-58d4f00e7e52 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:36.748431 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df12906f-7dd6-4719-9282-58d4f00e7e52 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:36.748904 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df12906f-7dd6-4719-9282-58d4f00e7e52 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:36.749350 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-df12906f-7dd6-4719-9282-58d4f00e7e52 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:36.762564 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-df12906f-7dd6-4719-9282-58d4f00e7e52 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] HTTP exception thrown: Instance 6829b067-c1af-48f2-9556-caacccfd8f34 could not be found. Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-df12906f-7dd6-4719-9282-58d4f00e7e52 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Request method failure captured: Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 HTTP/1.1 Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7x4hybynvxArQPeqt6CwV9Zs1N98xbn7O53qD-I8GCKutNl3jQRH4SvGrtWmYp2NG3dElrq0t1Ij5yq_G1gf33oIjYTVPSXt-tZSpufSbtrWCtdgSWSFbRz6TTImh-9pnxWIZSiSH_u6yWkLly4eko2V8UgCYC1x-j0UNpE9qntkRl0 Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 435945eeab2f42d386f48f7374bbd488 Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_435945eeab2f42d386f48f7374bbd488", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 435945eeab2f42d386f48f7374bbd488 Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServerActionsTestJSON-1683144832-project Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 09cb536a0a584f5f96bec5fca7afa3b4 Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServerActionsTestJSON-1683144832-project Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 6829b067-c1af-48f2-9556-caacccfd8f34 could not be found. Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '6829b067-c1af-48f2-9556-caacccfd8f34'} Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6829b067-c1af-48f2-9556-caacccfd8f34 could not be found. Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6829b067-c1af-48f2-9556-caacccfd8f34 could not be found. Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:07:36.764209 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:07:36.768819 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:07:36.768819 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:07:36.768819 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:07:36.768819 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:07:36.768819 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:07:36.768819 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6829b067-c1af-48f2-9556-caacccfd8f34 could not be found. Aug 07 02:07:36.768819 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:07:36.768819 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-df12906f-7dd6-4719-9282-58d4f00e7e52 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Returning 404 to user: Instance 6829b067-c1af-48f2-9556-caacccfd8f34 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:07:36.768819 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-df12906f-7dd6-4719-9282-58d4f00e7e52 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 404 len: 111 microversion: 2.1 time: 0.032344 Aug 07 02:07:36.768819 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3608/6750] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:07:36 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:07:36.776774 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b7ef304c-8c38-4641-a0a2-b0a6fbb66f4c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:36.777390 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b7ef304c-8c38-4641-a0a2-b0a6fbb66f4c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:36.784162 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b7ef304c-8c38-4641-a0a2-b0a6fbb66f4c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:36.784637 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b7ef304c-8c38-4641-a0a2-b0a6fbb66f4c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:36.785565 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b7ef304c-8c38-4641-a0a2-b0a6fbb66f4c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:36.786247 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b7ef304c-8c38-4641-a0a2-b0a6fbb66f4c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:36.786696 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b7ef304c-8c38-4641-a0a2-b0a6fbb66f4c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:36.787118 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b7ef304c-8c38-4641-a0a2-b0a6fbb66f4c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:36.800324 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-b7ef304c-8c38-4641-a0a2-b0a6fbb66f4c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] HTTP exception thrown: Instance 6829b067-c1af-48f2-9556-caacccfd8f34 could not be found. Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b7ef304c-8c38-4641-a0a2-b0a6fbb66f4c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Request method failure captured: Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 HTTP/1.1 Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7x4hybynvxArQPeqt6CwV9Zs1N98xbn7O53qD-I8GCKutNl3jQRH4SvGrtWmYp2NG3dElrq0t1Ij5yq_G1gf33oIjYTVPSXt-tZSpufSbtrWCtdgSWSFbRz6TTImh-9pnxWIZSiSH_u6yWkLly4eko2V8UgCYC1x-j0UNpE9qntkRl0 Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 435945eeab2f42d386f48f7374bbd488 Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_435945eeab2f42d386f48f7374bbd488", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 435945eeab2f42d386f48f7374bbd488 Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServerActionsTestJSON-1683144832-project Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 09cb536a0a584f5f96bec5fca7afa3b4 Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServerActionsTestJSON-1683144832-project Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 6829b067-c1af-48f2-9556-caacccfd8f34 could not be found. Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '6829b067-c1af-48f2-9556-caacccfd8f34'} Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6829b067-c1af-48f2-9556-caacccfd8f34 could not be found. Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6829b067-c1af-48f2-9556-caacccfd8f34 could not be found. Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:07:36.802581 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:07:36.807132 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:07:36.807132 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:07:36.807132 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:07:36.807132 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:07:36.807132 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:07:36.807132 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6829b067-c1af-48f2-9556-caacccfd8f34 could not be found. Aug 07 02:07:36.807132 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:07:36.807132 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b7ef304c-8c38-4641-a0a2-b0a6fbb66f4c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Returning 404 to user: Instance 6829b067-c1af-48f2-9556-caacccfd8f34 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:07:36.807132 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b7ef304c-8c38-4641-a0a2-b0a6fbb66f4c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 404 len: 111 microversion: 2.1 time: 0.031050 Aug 07 02:07:36.807132 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3143/6751] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:07:36 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:07:36.851316 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a65ecd18-46a3-4e4f-b5e9-e960b9488977 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-484287333", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "da7de2ad-cced-4f5b-81a4-2f9d332f427b"}], "security_groups": [{"name": "tempest-securitygroup--1850202519"}], "key_name": "tempest-keypair-1891336762", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:07:36.966322 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-a65ecd18-46a3-4e4f-b5e9-e960b9488977 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] validate_networks() for [('da7de2ad-cced-4f5b-81a4-2f9d332f427b', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 02:07:37.335148 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-a65ecd18-46a3-4e4f-b5e9-e960b9488977 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 02:07:37.335588 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-a65ecd18-46a3-4e4f-b5e9-e960b9488977 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 02:07:37.336143 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-a65ecd18-46a3-4e4f-b5e9-e960b9488977 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 02:07:37.336696 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-a65ecd18-46a3-4e4f-b5e9-e960b9488977 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 02:07:37.337134 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-a65ecd18-46a3-4e4f-b5e9-e960b9488977 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 02:07:37.345989 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a65ecd18-46a3-4e4f-b5e9-e960b9488977 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:37.346524 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a65ecd18-46a3-4e4f-b5e9-e960b9488977 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:37.346981 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a65ecd18-46a3-4e4f-b5e9-e960b9488977 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:37.348387 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a65ecd18-46a3-4e4f-b5e9-e960b9488977 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:37.348865 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a65ecd18-46a3-4e4f-b5e9-e960b9488977 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:37.349312 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a65ecd18-46a3-4e4f-b5e9-e960b9488977 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:37.366039 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-a65ecd18-46a3-4e4f-b5e9-e960b9488977 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Getting quotas for project 435945eeab2f42d386f48f7374bbd488. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:07:37.371225 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-a65ecd18-46a3-4e4f-b5e9-e960b9488977 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Getting quotas for user 09cb536a0a584f5f96bec5fca7afa3b4 and project 435945eeab2f42d386f48f7374bbd488. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:07:37.384177 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a65ecd18-46a3-4e4f-b5e9-e960b9488977 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 02:07:37.386513 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a65ecd18-46a3-4e4f-b5e9-e960b9488977 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 02:07:37.431446 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a65ecd18-46a3-4e4f-b5e9-e960b9488977 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.584471 Aug 07 02:07:37.432144 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3609/6752] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 02:07:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 02:07:37.443504 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-35af5eeb-eb5d-48bc-a68f-6696793e9364 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:37.444167 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-35af5eeb-eb5d-48bc-a68f-6696793e9364 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:37.497339 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-35af5eeb-eb5d-48bc-a68f-6696793e9364 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:07:37.504851 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-35af5eeb-eb5d-48bc-a68f-6696793e9364 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 200 len: 1238 microversion: 2.1 time: 0.065049 Aug 07 02:07:37.505317 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3144/6753] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:07:37 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 1238 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:07:38.527130 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ad531170-3025-4c73-a5d6-d0671b898ddf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:38.527908 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ad531170-3025-4c73-a5d6-d0671b898ddf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:38.534975 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ad531170-3025-4c73-a5d6-d0671b898ddf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:38.536091 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ad531170-3025-4c73-a5d6-d0671b898ddf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:38.536553 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ad531170-3025-4c73-a5d6-d0671b898ddf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:38.537284 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ad531170-3025-4c73-a5d6-d0671b898ddf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:38.537767 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ad531170-3025-4c73-a5d6-d0671b898ddf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:38.538293 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ad531170-3025-4c73-a5d6-d0671b898ddf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:38.604036 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ad531170-3025-4c73-a5d6-d0671b898ddf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:07:38.613415 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ad531170-3025-4c73-a5d6-d0671b898ddf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 200 len: 1298 microversion: 2.1 time: 0.090779 Aug 07 02:07:38.614864 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3610/6754] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:07:38 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 1298 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:07:39.641318 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7c30a4e0-55a2-47ad-a690-095195af07d6 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:39.641917 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7c30a4e0-55a2-47ad-a690-095195af07d6 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:39.649638 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7c30a4e0-55a2-47ad-a690-095195af07d6 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:39.650128 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7c30a4e0-55a2-47ad-a690-095195af07d6 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:39.650563 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7c30a4e0-55a2-47ad-a690-095195af07d6 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:39.651264 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7c30a4e0-55a2-47ad-a690-095195af07d6 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:39.651720 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7c30a4e0-55a2-47ad-a690-095195af07d6 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:39.652167 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7c30a4e0-55a2-47ad-a690-095195af07d6 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:40.134844 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7c30a4e0-55a2-47ad-a690-095195af07d6 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:07:40.142840 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7c30a4e0-55a2-47ad-a690-095195af07d6 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 200 len: 1364 microversion: 2.1 time: 0.505380 Aug 07 02:07:40.143416 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3145/6755] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:07:39 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 1364 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:07:40.210763 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-a67af514-e360-4c78-ac46-884ec9d2487b req-cdcaef50-b343-42cb-ae95-a134b1713c1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "014e3168-a704-44d1-a867-3232988cfe15", "tag": "1d5b8fad-87fc-4026-bef2-671ed529d7af"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:07:40.221617 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a67af514-e360-4c78-ac46-884ec9d2487b req-cdcaef50-b343-42cb-ae95-a134b1713c1a service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:40.222146 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a67af514-e360-4c78-ac46-884ec9d2487b req-cdcaef50-b343-42cb-ae95-a134b1713c1a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:40.222603 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-a67af514-e360-4c78-ac46-884ec9d2487b req-cdcaef50-b343-42cb-ae95-a134b1713c1a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:40.238868 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-a67af514-e360-4c78-ac46-884ec9d2487b req-cdcaef50-b343-42cb-ae95-a134b1713c1a service nova] Creating event network-changed:1d5b8fad-87fc-4026-bef2-671ed529d7af for instance 014e3168-a704-44d1-a867-3232988cfe15 on n-h2-master-1 Aug 07 02:07:40.244875 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-a67af514-e360-4c78-ac46-884ec9d2487b req-cdcaef50-b343-42cb-ae95-a134b1713c1a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038373 Aug 07 02:07:40.245672 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3611/6756] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 02:07:41.165422 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7f262dde-a417-41ab-a52f-c85e2a07d9ef tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:41.166035 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7f262dde-a417-41ab-a52f-c85e2a07d9ef tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:41.173049 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7f262dde-a417-41ab-a52f-c85e2a07d9ef tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:41.173537 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7f262dde-a417-41ab-a52f-c85e2a07d9ef tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:41.173975 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7f262dde-a417-41ab-a52f-c85e2a07d9ef tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:41.174711 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7f262dde-a417-41ab-a52f-c85e2a07d9ef tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:41.175167 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7f262dde-a417-41ab-a52f-c85e2a07d9ef tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:41.175602 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7f262dde-a417-41ab-a52f-c85e2a07d9ef tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:41.313551 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7f262dde-a417-41ab-a52f-c85e2a07d9ef tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:07:41.321088 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7f262dde-a417-41ab-a52f-c85e2a07d9ef tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 200 len: 1364 microversion: 2.1 time: 0.160103 Aug 07 02:07:41.321657 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3146/6757] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:07:41 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:07:42.342611 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5f79a042-f2aa-489b-a693-faab0d38b9c9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:42.343329 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5f79a042-f2aa-489b-a693-faab0d38b9c9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:42.349583 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f79a042-f2aa-489b-a693-faab0d38b9c9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:42.350073 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f79a042-f2aa-489b-a693-faab0d38b9c9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:42.350518 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f79a042-f2aa-489b-a693-faab0d38b9c9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:42.351216 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f79a042-f2aa-489b-a693-faab0d38b9c9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:42.351680 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f79a042-f2aa-489b-a693-faab0d38b9c9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:42.352151 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f79a042-f2aa-489b-a693-faab0d38b9c9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:42.487962 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5f79a042-f2aa-489b-a693-faab0d38b9c9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:07:42.496081 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5f79a042-f2aa-489b-a693-faab0d38b9c9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 200 len: 1364 microversion: 2.1 time: 0.158455 Aug 07 02:07:42.496657 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3612/6758] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:07:42 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:07:43.518347 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0e4c3ba1-3864-4ee0-bbaf-52c8af7316be tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:43.518948 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0e4c3ba1-3864-4ee0-bbaf-52c8af7316be tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:43.521895 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=47 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:07:43.527051 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e4c3ba1-3864-4ee0-bbaf-52c8af7316be tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:43.527533 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e4c3ba1-3864-4ee0-bbaf-52c8af7316be tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:43.527996 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e4c3ba1-3864-4ee0-bbaf-52c8af7316be tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:43.528690 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e4c3ba1-3864-4ee0-bbaf-52c8af7316be tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:43.529144 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e4c3ba1-3864-4ee0-bbaf-52c8af7316be tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:43.529568 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0e4c3ba1-3864-4ee0-bbaf-52c8af7316be tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:43.657835 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0e4c3ba1-3864-4ee0-bbaf-52c8af7316be tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:07:43.665755 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0e4c3ba1-3864-4ee0-bbaf-52c8af7316be tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 200 len: 1364 microversion: 2.1 time: 0.151387 Aug 07 02:07:43.666330 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3147/6759] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:07:43 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:07:44.687534 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5eebe811-36d3-4d5b-b0f4-e9dc82345756 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:44.688202 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5eebe811-36d3-4d5b-b0f4-e9dc82345756 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:44.690894 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:07:44.696751 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5eebe811-36d3-4d5b-b0f4-e9dc82345756 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:44.697256 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5eebe811-36d3-4d5b-b0f4-e9dc82345756 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:44.697711 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5eebe811-36d3-4d5b-b0f4-e9dc82345756 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:44.698421 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5eebe811-36d3-4d5b-b0f4-e9dc82345756 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:44.698890 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5eebe811-36d3-4d5b-b0f4-e9dc82345756 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:44.699335 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5eebe811-36d3-4d5b-b0f4-e9dc82345756 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:44.825968 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5eebe811-36d3-4d5b-b0f4-e9dc82345756 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:07:44.833450 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5eebe811-36d3-4d5b-b0f4-e9dc82345756 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 200 len: 1364 microversion: 2.1 time: 0.149812 Aug 07 02:07:44.834025 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3613/6760] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:07:44 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:07:45.855866 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f558d297-fdac-4977-9436-edaf1ed6fc4c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:45.856529 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f558d297-fdac-4977-9436-edaf1ed6fc4c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:45.863714 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f558d297-fdac-4977-9436-edaf1ed6fc4c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:45.864240 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f558d297-fdac-4977-9436-edaf1ed6fc4c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:45.864681 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f558d297-fdac-4977-9436-edaf1ed6fc4c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:45.865385 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f558d297-fdac-4977-9436-edaf1ed6fc4c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:45.865839 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f558d297-fdac-4977-9436-edaf1ed6fc4c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:45.866263 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f558d297-fdac-4977-9436-edaf1ed6fc4c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:46.002862 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f558d297-fdac-4977-9436-edaf1ed6fc4c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:07:46.010828 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f558d297-fdac-4977-9436-edaf1ed6fc4c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 200 len: 1364 microversion: 2.1 time: 0.159593 Aug 07 02:07:46.011605 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3148/6761] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:07:45 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:07:46.123787 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-f7c0e102-b946-4147-8a2c-5c415420dc3a req-d0f7c3a1-9d25-4fd8-becf-274c34351f1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "014e3168-a704-44d1-a867-3232988cfe15", "name": "network-vif-plugged", "status": "completed", "tag": "1d5b8fad-87fc-4026-bef2-671ed529d7af"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:07:46.134746 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f7c0e102-b946-4147-8a2c-5c415420dc3a req-d0f7c3a1-9d25-4fd8-becf-274c34351f1f service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:46.135238 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f7c0e102-b946-4147-8a2c-5c415420dc3a req-d0f7c3a1-9d25-4fd8-becf-274c34351f1f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:46.135702 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f7c0e102-b946-4147-8a2c-5c415420dc3a req-d0f7c3a1-9d25-4fd8-becf-274c34351f1f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:46.147004 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-f7c0e102-b946-4147-8a2c-5c415420dc3a req-d0f7c3a1-9d25-4fd8-becf-274c34351f1f service nova] Creating event network-vif-plugged:1d5b8fad-87fc-4026-bef2-671ed529d7af for instance 014e3168-a704-44d1-a867-3232988cfe15 on n-h2-master-1 Aug 07 02:07:46.152395 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-f7c0e102-b946-4147-8a2c-5c415420dc3a req-d0f7c3a1-9d25-4fd8-becf-274c34351f1f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032302 Aug 07 02:07:46.153052 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3614/6762] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:07:47.031592 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e15aaa55-be75-4ef8-8589-4448532f87d2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:47.032247 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e15aaa55-be75-4ef8-8589-4448532f87d2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:47.039518 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e15aaa55-be75-4ef8-8589-4448532f87d2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:47.040041 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e15aaa55-be75-4ef8-8589-4448532f87d2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:47.040485 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e15aaa55-be75-4ef8-8589-4448532f87d2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:47.041185 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e15aaa55-be75-4ef8-8589-4448532f87d2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:47.041644 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e15aaa55-be75-4ef8-8589-4448532f87d2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:47.042075 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e15aaa55-be75-4ef8-8589-4448532f87d2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:47.173574 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e15aaa55-be75-4ef8-8589-4448532f87d2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:07:47.181089 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e15aaa55-be75-4ef8-8589-4448532f87d2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 200 len: 1364 microversion: 2.1 time: 0.153435 Aug 07 02:07:47.181661 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3149/6763] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:07:47 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:07:48.200643 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:07:48.201445 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:07:48.205460 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-198350f1-5c47-40f9-9dad-023a39222127 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:48.206207 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-198350f1-5c47-40f9-9dad-023a39222127 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:48.213282 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-198350f1-5c47-40f9-9dad-023a39222127 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:48.213775 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-198350f1-5c47-40f9-9dad-023a39222127 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:48.214225 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-198350f1-5c47-40f9-9dad-023a39222127 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:48.214930 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-198350f1-5c47-40f9-9dad-023a39222127 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:48.215399 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-198350f1-5c47-40f9-9dad-023a39222127 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:48.215841 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-198350f1-5c47-40f9-9dad-023a39222127 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:48.345714 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-198350f1-5c47-40f9-9dad-023a39222127 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:07:48.353814 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-198350f1-5c47-40f9-9dad-023a39222127 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 200 len: 1551 microversion: 2.1 time: 0.154976 Aug 07 02:07:48.354372 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3615/6764] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:07:48 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 1551 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:07:48.375090 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4dc8729a-a005-4e1e-bcbe-3137a12cffaf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:07:48.375603 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4dc8729a-a005-4e1e-bcbe-3137a12cffaf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:07:48.377461 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:07:48.383648 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4dc8729a-a005-4e1e-bcbe-3137a12cffaf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:48.384184 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4dc8729a-a005-4e1e-bcbe-3137a12cffaf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:48.384631 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4dc8729a-a005-4e1e-bcbe-3137a12cffaf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:48.385424 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4dc8729a-a005-4e1e-bcbe-3137a12cffaf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:48.386127 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4dc8729a-a005-4e1e-bcbe-3137a12cffaf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:48.386491 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4dc8729a-a005-4e1e-bcbe-3137a12cffaf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:48.462218 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4dc8729a-a005-4e1e-bcbe-3137a12cffaf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090946 Aug 07 02:07:48.462887 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3150/6765] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Aug 7 02:07:48 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:07:49.446983 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-c705c926-7463-446d-b97b-e73f1a3072c5 req-4150d026-4cbc-49ed-bfe1-61abc013b154 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "014e3168-a704-44d1-a867-3232988cfe15", "tag": "1d5b8fad-87fc-4026-bef2-671ed529d7af"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:07:49.456380 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c705c926-7463-446d-b97b-e73f1a3072c5 req-4150d026-4cbc-49ed-bfe1-61abc013b154 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:07:49.456866 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c705c926-7463-446d-b97b-e73f1a3072c5 req-4150d026-4cbc-49ed-bfe1-61abc013b154 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:07:49.457303 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c705c926-7463-446d-b97b-e73f1a3072c5 req-4150d026-4cbc-49ed-bfe1-61abc013b154 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:07:49.468243 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-c705c926-7463-446d-b97b-e73f1a3072c5 req-4150d026-4cbc-49ed-bfe1-61abc013b154 service nova] Creating event network-changed:1d5b8fad-87fc-4026-bef2-671ed529d7af for instance 014e3168-a704-44d1-a867-3232988cfe15 on n-h2-master-1 Aug 07 02:07:49.473062 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-c705c926-7463-446d-b97b-e73f1a3072c5 req-4150d026-4cbc-49ed-bfe1-61abc013b154 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092063 Aug 07 02:07:49.473835 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3616/6766] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 02:08:22.292965 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=7 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:08:22.293841 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=47 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:08:22.298579 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-be5ff2b0-6d61-4f9b-bb75-9c86213e139b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:08:22.305389 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-be5ff2b0-6d61-4f9b-bb75-9c86213e139b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:22.305875 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-be5ff2b0-6d61-4f9b-bb75-9c86213e139b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:22.306318 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-be5ff2b0-6d61-4f9b-bb75-9c86213e139b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:22.329111 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-be5ff2b0-6d61-4f9b-bb75-9c86213e139b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Going to try to stop instance {{(pid=119517) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 07 02:08:22.373866 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-be5ff2b0-6d61-4f9b-bb75-9c86213e139b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "POST /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15/action" status: 202 len: 0 microversion: 2.1 time: 0.082640 Aug 07 02:08:22.374484 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3151/6767] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:08:22 2022] POST /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:08:22.384523 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-57bd5698-89ff-4496-ad7d-f863cc2e147c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:22.385327 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-57bd5698-89ff-4496-ad7d-f863cc2e147c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:22.389082 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=7 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:08:22.389897 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=36 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:08:22.396644 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-57bd5698-89ff-4496-ad7d-f863cc2e147c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:22.397284 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-57bd5698-89ff-4496-ad7d-f863cc2e147c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:22.397809 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-57bd5698-89ff-4496-ad7d-f863cc2e147c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:22.398618 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-57bd5698-89ff-4496-ad7d-f863cc2e147c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:22.399103 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-57bd5698-89ff-4496-ad7d-f863cc2e147c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:22.399548 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-57bd5698-89ff-4496-ad7d-f863cc2e147c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:22.541873 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-57bd5698-89ff-4496-ad7d-f863cc2e147c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:08:22.549590 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-57bd5698-89ff-4496-ad7d-f863cc2e147c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 200 len: 1680 microversion: 2.1 time: 0.169635 Aug 07 02:08:22.550083 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3617/6768] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:08:22 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:08:23.571833 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-452a8651-e9c3-4d9f-b6b5-a2df8217d2be tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:23.572632 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-452a8651-e9c3-4d9f-b6b5-a2df8217d2be tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:23.578797 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-452a8651-e9c3-4d9f-b6b5-a2df8217d2be tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:23.579281 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-452a8651-e9c3-4d9f-b6b5-a2df8217d2be tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:23.580260 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-452a8651-e9c3-4d9f-b6b5-a2df8217d2be tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:23.580957 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-452a8651-e9c3-4d9f-b6b5-a2df8217d2be tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:23.581411 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-452a8651-e9c3-4d9f-b6b5-a2df8217d2be tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:23.581838 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-452a8651-e9c3-4d9f-b6b5-a2df8217d2be tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:23.712872 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-452a8651-e9c3-4d9f-b6b5-a2df8217d2be tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:08:23.720321 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-452a8651-e9c3-4d9f-b6b5-a2df8217d2be tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 200 len: 1680 microversion: 2.1 time: 0.153558 Aug 07 02:08:23.720883 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3152/6769] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:08:23 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:08:24.741994 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-13c1c138-24fb-4b26-88a2-79b063ef7386 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:24.742552 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-13c1c138-24fb-4b26-88a2-79b063ef7386 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:24.749776 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-13c1c138-24fb-4b26-88a2-79b063ef7386 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:24.750271 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-13c1c138-24fb-4b26-88a2-79b063ef7386 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:24.750720 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-13c1c138-24fb-4b26-88a2-79b063ef7386 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:24.751430 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-13c1c138-24fb-4b26-88a2-79b063ef7386 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:24.752012 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-13c1c138-24fb-4b26-88a2-79b063ef7386 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:24.752562 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-13c1c138-24fb-4b26-88a2-79b063ef7386 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:24.879005 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-13c1c138-24fb-4b26-88a2-79b063ef7386 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:08:24.886468 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-13c1c138-24fb-4b26-88a2-79b063ef7386 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 200 len: 1680 microversion: 2.1 time: 0.149091 Aug 07 02:08:24.887035 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3618/6770] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:08:24 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:08:25.908497 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b11d01c0-47b8-4c1b-bdd5-2aacf9d7c021 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:25.909136 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b11d01c0-47b8-4c1b-bdd5-2aacf9d7c021 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:25.915951 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b11d01c0-47b8-4c1b-bdd5-2aacf9d7c021 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:25.916430 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b11d01c0-47b8-4c1b-bdd5-2aacf9d7c021 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:25.916863 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b11d01c0-47b8-4c1b-bdd5-2aacf9d7c021 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:25.917547 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b11d01c0-47b8-4c1b-bdd5-2aacf9d7c021 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:25.917997 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b11d01c0-47b8-4c1b-bdd5-2aacf9d7c021 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:25.918415 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b11d01c0-47b8-4c1b-bdd5-2aacf9d7c021 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:26.051075 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b11d01c0-47b8-4c1b-bdd5-2aacf9d7c021 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:08:26.058500 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b11d01c0-47b8-4c1b-bdd5-2aacf9d7c021 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 200 len: 1680 microversion: 2.1 time: 0.153934 Aug 07 02:08:26.059067 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3153/6771] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:08:25 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:08:27.079915 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7e9e68cd-954c-4878-89cf-7563a8892c6a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:27.080601 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7e9e68cd-954c-4878-89cf-7563a8892c6a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:27.090082 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e9e68cd-954c-4878-89cf-7563a8892c6a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:27.090582 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e9e68cd-954c-4878-89cf-7563a8892c6a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:27.091033 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e9e68cd-954c-4878-89cf-7563a8892c6a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:27.091749 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e9e68cd-954c-4878-89cf-7563a8892c6a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:27.092251 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e9e68cd-954c-4878-89cf-7563a8892c6a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:27.092691 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7e9e68cd-954c-4878-89cf-7563a8892c6a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:27.230331 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7e9e68cd-954c-4878-89cf-7563a8892c6a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:08:27.238609 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7e9e68cd-954c-4878-89cf-7563a8892c6a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 200 len: 1680 microversion: 2.1 time: 0.162498 Aug 07 02:08:27.239117 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3619/6772] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:08:27 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:08:28.259842 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1ae99e0e-5930-46a6-bb6d-3a754e4f158e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:28.260485 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1ae99e0e-5930-46a6-bb6d-3a754e4f158e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:28.267360 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ae99e0e-5930-46a6-bb6d-3a754e4f158e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:28.267848 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ae99e0e-5930-46a6-bb6d-3a754e4f158e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:28.268328 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ae99e0e-5930-46a6-bb6d-3a754e4f158e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:28.269025 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ae99e0e-5930-46a6-bb6d-3a754e4f158e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:28.269980 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ae99e0e-5930-46a6-bb6d-3a754e4f158e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:28.270409 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ae99e0e-5930-46a6-bb6d-3a754e4f158e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:28.398608 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1ae99e0e-5930-46a6-bb6d-3a754e4f158e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:08:28.406155 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1ae99e0e-5930-46a6-bb6d-3a754e4f158e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 200 len: 1680 microversion: 2.1 time: 0.150320 Aug 07 02:08:28.406726 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3154/6773] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:08:28 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:08:29.427225 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c81178f5-3f26-4c03-a22a-553c56dbad57 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:29.427850 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c81178f5-3f26-4c03-a22a-553c56dbad57 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:29.434739 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c81178f5-3f26-4c03-a22a-553c56dbad57 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:29.435229 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c81178f5-3f26-4c03-a22a-553c56dbad57 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:29.435676 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c81178f5-3f26-4c03-a22a-553c56dbad57 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:29.436410 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c81178f5-3f26-4c03-a22a-553c56dbad57 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:29.436877 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c81178f5-3f26-4c03-a22a-553c56dbad57 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:29.437316 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c81178f5-3f26-4c03-a22a-553c56dbad57 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:29.566396 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c81178f5-3f26-4c03-a22a-553c56dbad57 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:08:29.573933 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c81178f5-3f26-4c03-a22a-553c56dbad57 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 200 len: 1680 microversion: 2.1 time: 0.151258 Aug 07 02:08:29.574509 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3620/6774] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:08:29 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:08:30.594639 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-dcea0471-acda-40cd-9e5a-df174ba03132 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:30.595254 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-dcea0471-acda-40cd-9e5a-df174ba03132 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:30.602718 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dcea0471-acda-40cd-9e5a-df174ba03132 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:30.603193 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dcea0471-acda-40cd-9e5a-df174ba03132 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:30.603622 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dcea0471-acda-40cd-9e5a-df174ba03132 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:30.604349 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dcea0471-acda-40cd-9e5a-df174ba03132 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:30.604801 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dcea0471-acda-40cd-9e5a-df174ba03132 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:30.605223 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dcea0471-acda-40cd-9e5a-df174ba03132 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:30.740073 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-dcea0471-acda-40cd-9e5a-df174ba03132 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:08:30.747921 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-dcea0471-acda-40cd-9e5a-df174ba03132 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 200 len: 1680 microversion: 2.1 time: 0.157238 Aug 07 02:08:30.748730 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3155/6775] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:08:30 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:08:31.769452 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ee5f569c-e6a2-499f-bfaa-e509145fc739 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:31.770117 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ee5f569c-e6a2-499f-bfaa-e509145fc739 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:31.777512 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee5f569c-e6a2-499f-bfaa-e509145fc739 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:31.778006 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee5f569c-e6a2-499f-bfaa-e509145fc739 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:31.778456 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee5f569c-e6a2-499f-bfaa-e509145fc739 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:31.779214 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee5f569c-e6a2-499f-bfaa-e509145fc739 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:31.779671 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee5f569c-e6a2-499f-bfaa-e509145fc739 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:31.780137 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ee5f569c-e6a2-499f-bfaa-e509145fc739 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:31.910272 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ee5f569c-e6a2-499f-bfaa-e509145fc739 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:08:31.917799 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ee5f569c-e6a2-499f-bfaa-e509145fc739 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 200 len: 1680 microversion: 2.1 time: 0.152226 Aug 07 02:08:31.918375 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3621/6776] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:08:31 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:08:32.938480 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-26ec903f-255e-4667-a26c-e1e2f57936a4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:32.939092 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-26ec903f-255e-4667-a26c-e1e2f57936a4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:32.946635 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-26ec903f-255e-4667-a26c-e1e2f57936a4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:32.947117 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-26ec903f-255e-4667-a26c-e1e2f57936a4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:32.947586 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-26ec903f-255e-4667-a26c-e1e2f57936a4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:32.948308 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-26ec903f-255e-4667-a26c-e1e2f57936a4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:32.948765 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-26ec903f-255e-4667-a26c-e1e2f57936a4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:32.949195 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-26ec903f-255e-4667-a26c-e1e2f57936a4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:33.077045 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-26ec903f-255e-4667-a26c-e1e2f57936a4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:08:33.085159 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-26ec903f-255e-4667-a26c-e1e2f57936a4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 200 len: 1657 microversion: 2.1 time: 0.150568 Aug 07 02:08:33.085734 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3156/6777] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:08:32 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 1657 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:08:33.105206 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6e0ee0da-6a39-4ce1-b8bc-2831eb7079a4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:08:33.107549 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6e0ee0da-6a39-4ce1-b8bc-2831eb7079a4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:33.114477 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e0ee0da-6a39-4ce1-b8bc-2831eb7079a4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:33.114969 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e0ee0da-6a39-4ce1-b8bc-2831eb7079a4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:33.115418 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e0ee0da-6a39-4ce1-b8bc-2831eb7079a4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:33.116244 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e0ee0da-6a39-4ce1-b8bc-2831eb7079a4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:33.116710 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e0ee0da-6a39-4ce1-b8bc-2831eb7079a4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:33.117146 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6e0ee0da-6a39-4ce1-b8bc-2831eb7079a4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:33.145389 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6e0ee0da-6a39-4ce1-b8bc-2831eb7079a4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:08:33.152038 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6e0ee0da-6a39-4ce1-b8bc-2831eb7079a4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Old instance type m1.heat2, new instance type m1.heat {{(pid=119516) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 07 02:08:33.160373 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-6e0ee0da-6a39-4ce1-b8bc-2831eb7079a4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 02:08:33.161101 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-6e0ee0da-6a39-4ce1-b8bc-2831eb7079a4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 02:08:33.161696 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-6e0ee0da-6a39-4ce1-b8bc-2831eb7079a4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 02:08:33.162128 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-6e0ee0da-6a39-4ce1-b8bc-2831eb7079a4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 02:08:33.162556 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-6e0ee0da-6a39-4ce1-b8bc-2831eb7079a4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 02:08:33.229348 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6e0ee0da-6a39-4ce1-b8bc-2831eb7079a4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "POST /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15/action" status: 202 len: 0 microversion: 2.1 time: 0.127950 Aug 07 02:08:33.230117 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3622/6778] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:08:33 2022] POST /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:08:33.237985 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0a373a8a-e0ea-4a8e-a12c-f2fb8244c303 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:33.238712 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0a373a8a-e0ea-4a8e-a12c-f2fb8244c303 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:33.245516 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a373a8a-e0ea-4a8e-a12c-f2fb8244c303 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:33.246005 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a373a8a-e0ea-4a8e-a12c-f2fb8244c303 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:33.246438 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a373a8a-e0ea-4a8e-a12c-f2fb8244c303 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:33.247132 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a373a8a-e0ea-4a8e-a12c-f2fb8244c303 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:33.247590 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a373a8a-e0ea-4a8e-a12c-f2fb8244c303 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:33.248053 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a373a8a-e0ea-4a8e-a12c-f2fb8244c303 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:33.741183 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0a373a8a-e0ea-4a8e-a12c-f2fb8244c303 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:08:33.749660 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0a373a8a-e0ea-4a8e-a12c-f2fb8244c303 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 200 len: 1680 microversion: 2.1 time: 0.515547 Aug 07 02:08:33.750231 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3157/6779] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:08:33 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 1680 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:08:34.772033 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-21189389-8b04-48b0-8faa-0d8e95650d4f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:34.772675 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-21189389-8b04-48b0-8faa-0d8e95650d4f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:34.779244 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21189389-8b04-48b0-8faa-0d8e95650d4f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:34.779747 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21189389-8b04-48b0-8faa-0d8e95650d4f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:34.780249 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21189389-8b04-48b0-8faa-0d8e95650d4f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:34.780987 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21189389-8b04-48b0-8faa-0d8e95650d4f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:34.781454 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21189389-8b04-48b0-8faa-0d8e95650d4f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:34.781985 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21189389-8b04-48b0-8faa-0d8e95650d4f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:34.911950 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-21189389-8b04-48b0-8faa-0d8e95650d4f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:08:34.919947 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-21189389-8b04-48b0-8faa-0d8e95650d4f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 200 len: 1680 microversion: 2.1 time: 0.152804 Aug 07 02:08:34.920736 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3623/6780] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:08:34 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:08:35.940888 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-db8fc6bb-13a2-4dad-8002-93a8363c308a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:35.941419 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-db8fc6bb-13a2-4dad-8002-93a8363c308a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:35.948258 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db8fc6bb-13a2-4dad-8002-93a8363c308a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:35.948736 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db8fc6bb-13a2-4dad-8002-93a8363c308a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:35.949176 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db8fc6bb-13a2-4dad-8002-93a8363c308a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:35.949872 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db8fc6bb-13a2-4dad-8002-93a8363c308a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:35.950324 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db8fc6bb-13a2-4dad-8002-93a8363c308a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:35.950754 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-db8fc6bb-13a2-4dad-8002-93a8363c308a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:36.081976 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-db8fc6bb-13a2-4dad-8002-93a8363c308a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:08:36.089686 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-db8fc6bb-13a2-4dad-8002-93a8363c308a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 200 len: 1685 microversion: 2.1 time: 0.152750 Aug 07 02:08:36.090261 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3158/6781] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:08:35 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:08:37.111313 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6406cc91-48e9-481f-9760-8673eaca01af tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:37.111999 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6406cc91-48e9-481f-9760-8673eaca01af tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:37.119338 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6406cc91-48e9-481f-9760-8673eaca01af tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:37.119839 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6406cc91-48e9-481f-9760-8673eaca01af tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:37.120319 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6406cc91-48e9-481f-9760-8673eaca01af tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:37.121033 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6406cc91-48e9-481f-9760-8673eaca01af tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:37.121507 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6406cc91-48e9-481f-9760-8673eaca01af tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:37.121954 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6406cc91-48e9-481f-9760-8673eaca01af tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:37.248375 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6406cc91-48e9-481f-9760-8673eaca01af tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:08:37.256587 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6406cc91-48e9-481f-9760-8673eaca01af tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 200 len: 1685 microversion: 2.1 time: 0.149151 Aug 07 02:08:37.257159 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3624/6782] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:08:37 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 1685 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:08:38.047460 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-b9416814-81e7-4400-bac8-321658796f6c req-707a2779-9f0c-436e-8da3-62ef2dd257db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "014e3168-a704-44d1-a867-3232988cfe15", "name": "network-vif-unplugged", "status": "completed", "tag": "1d5b8fad-87fc-4026-bef2-671ed529d7af"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:08:38.057797 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b9416814-81e7-4400-bac8-321658796f6c req-707a2779-9f0c-436e-8da3-62ef2dd257db service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:38.058375 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b9416814-81e7-4400-bac8-321658796f6c req-707a2779-9f0c-436e-8da3-62ef2dd257db service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:38.058976 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b9416814-81e7-4400-bac8-321658796f6c req-707a2779-9f0c-436e-8da3-62ef2dd257db service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:38.072148 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-b9416814-81e7-4400-bac8-321658796f6c req-707a2779-9f0c-436e-8da3-62ef2dd257db service nova] Creating event network-vif-unplugged:1d5b8fad-87fc-4026-bef2-671ed529d7af for instance 014e3168-a704-44d1-a867-3232988cfe15 on n-h1-master-1 Aug 07 02:08:38.077950 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [req-b9416814-81e7-4400-bac8-321658796f6c req-707a2779-9f0c-436e-8da3-62ef2dd257db service nova] Instance 014e3168-a704-44d1-a867-3232988cfe15 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 02:08:38.088766 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-b9416814-81e7-4400-bac8-321658796f6c req-707a2779-9f0c-436e-8da3-62ef2dd257db service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096143 Aug 07 02:08:38.089372 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3159/6783] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:08:38.278569 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7b072997-5e4f-406f-bd62-12924f509556 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:38.279275 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7b072997-5e4f-406f-bd62-12924f509556 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:38.286139 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b072997-5e4f-406f-bd62-12924f509556 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:38.286643 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b072997-5e4f-406f-bd62-12924f509556 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:38.287105 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b072997-5e4f-406f-bd62-12924f509556 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:38.288484 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b072997-5e4f-406f-bd62-12924f509556 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:38.288966 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b072997-5e4f-406f-bd62-12924f509556 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:38.289418 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7b072997-5e4f-406f-bd62-12924f509556 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:38.433612 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7b072997-5e4f-406f-bd62-12924f509556 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:08:38.441445 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7b072997-5e4f-406f-bd62-12924f509556 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 200 len: 1684 microversion: 2.1 time: 0.166768 Aug 07 02:08:38.442019 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3625/6784] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:08:38 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 1684 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:08:39.465263 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6c49b440-9a26-4858-9e79-e3f9bbd9886c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:39.465971 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6c49b440-9a26-4858-9e79-e3f9bbd9886c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:39.472276 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c49b440-9a26-4858-9e79-e3f9bbd9886c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:39.472764 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c49b440-9a26-4858-9e79-e3f9bbd9886c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:39.473208 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c49b440-9a26-4858-9e79-e3f9bbd9886c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:39.473906 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c49b440-9a26-4858-9e79-e3f9bbd9886c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:39.474364 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c49b440-9a26-4858-9e79-e3f9bbd9886c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:39.474794 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c49b440-9a26-4858-9e79-e3f9bbd9886c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:39.603067 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6c49b440-9a26-4858-9e79-e3f9bbd9886c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:08:39.611212 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6c49b440-9a26-4858-9e79-e3f9bbd9886c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 200 len: 1682 microversion: 2.1 time: 0.151149 Aug 07 02:08:39.611794 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3160/6785] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:08:39 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:08:40.111157 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-e4932015-f43e-4ddb-b282-bc01b5d7e03a req-16338f17-f523-467e-bdba-ed6eddcb34c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "014e3168-a704-44d1-a867-3232988cfe15", "tag": "1d5b8fad-87fc-4026-bef2-671ed529d7af"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:08:40.121438 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e4932015-f43e-4ddb-b282-bc01b5d7e03a req-16338f17-f523-467e-bdba-ed6eddcb34c2 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:40.121938 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e4932015-f43e-4ddb-b282-bc01b5d7e03a req-16338f17-f523-467e-bdba-ed6eddcb34c2 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:40.122388 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e4932015-f43e-4ddb-b282-bc01b5d7e03a req-16338f17-f523-467e-bdba-ed6eddcb34c2 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:40.137906 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-e4932015-f43e-4ddb-b282-bc01b5d7e03a req-16338f17-f523-467e-bdba-ed6eddcb34c2 service nova] Creating event network-changed:1d5b8fad-87fc-4026-bef2-671ed529d7af for instance 014e3168-a704-44d1-a867-3232988cfe15 on n-h1-master-1 Aug 07 02:08:40.143674 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [req-e4932015-f43e-4ddb-b282-bc01b5d7e03a req-16338f17-f523-467e-bdba-ed6eddcb34c2 service nova] Instance 014e3168-a704-44d1-a867-3232988cfe15 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 02:08:40.154773 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-e4932015-f43e-4ddb-b282-bc01b5d7e03a req-16338f17-f523-467e-bdba-ed6eddcb34c2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047626 Aug 07 02:08:40.155385 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3626/6786] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:08:40.633128 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b2f50f41-94c5-48c1-9d77-b85475e8371e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:40.633830 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b2f50f41-94c5-48c1-9d77-b85475e8371e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:40.643599 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2f50f41-94c5-48c1-9d77-b85475e8371e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:40.644242 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2f50f41-94c5-48c1-9d77-b85475e8371e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:40.644686 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2f50f41-94c5-48c1-9d77-b85475e8371e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:40.645405 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2f50f41-94c5-48c1-9d77-b85475e8371e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:40.645862 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2f50f41-94c5-48c1-9d77-b85475e8371e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:40.646293 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2f50f41-94c5-48c1-9d77-b85475e8371e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:40.945276 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b2f50f41-94c5-48c1-9d77-b85475e8371e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:08:40.953552 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b2f50f41-94c5-48c1-9d77-b85475e8371e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 200 len: 1678 microversion: 2.1 time: 0.324354 Aug 07 02:08:40.954133 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3161/6787] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:08:40 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 1678 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:08:40.974473 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-31f070c8-d5e2-4e99-a0cf-ccdac282bf7c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:08:40.975124 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-31f070c8-d5e2-4e99-a0cf-ccdac282bf7c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:40.984570 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31f070c8-d5e2-4e99-a0cf-ccdac282bf7c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:40.985081 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31f070c8-d5e2-4e99-a0cf-ccdac282bf7c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:40.985535 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31f070c8-d5e2-4e99-a0cf-ccdac282bf7c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:40.986263 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31f070c8-d5e2-4e99-a0cf-ccdac282bf7c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:40.986735 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31f070c8-d5e2-4e99-a0cf-ccdac282bf7c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:40.987178 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31f070c8-d5e2-4e99-a0cf-ccdac282bf7c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:41.047349 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-31f070c8-d5e2-4e99-a0cf-ccdac282bf7c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "POST /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15/action" status: 204 len: 0 microversion: 2.1 time: 0.076928 Aug 07 02:08:41.048220 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3627/6788] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:08:40 2022] POST /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 02:08:41.056418 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e8e9de5e-bca5-417a-8fbc-f85a47a43e7d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:41.057056 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e8e9de5e-bca5-417a-8fbc-f85a47a43e7d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:41.064371 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e8e9de5e-bca5-417a-8fbc-f85a47a43e7d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:41.064781 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e8e9de5e-bca5-417a-8fbc-f85a47a43e7d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:41.065215 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e8e9de5e-bca5-417a-8fbc-f85a47a43e7d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:41.066027 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e8e9de5e-bca5-417a-8fbc-f85a47a43e7d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:41.066407 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e8e9de5e-bca5-417a-8fbc-f85a47a43e7d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:41.066843 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e8e9de5e-bca5-417a-8fbc-f85a47a43e7d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:41.247364 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e8e9de5e-bca5-417a-8fbc-f85a47a43e7d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:08:41.257189 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e8e9de5e-bca5-417a-8fbc-f85a47a43e7d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 200 len: 1678 microversion: 2.1 time: 0.204572 Aug 07 02:08:41.258059 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3162/6789] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:08:41 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 1678 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:08:42.280063 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-55479ad5-b04f-4ff1-a724-21095ad7963d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:42.280789 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-55479ad5-b04f-4ff1-a724-21095ad7963d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:42.287538 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-55479ad5-b04f-4ff1-a724-21095ad7963d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:42.288142 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-55479ad5-b04f-4ff1-a724-21095ad7963d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:42.288657 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-55479ad5-b04f-4ff1-a724-21095ad7963d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:42.289442 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-55479ad5-b04f-4ff1-a724-21095ad7963d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:42.290070 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-55479ad5-b04f-4ff1-a724-21095ad7963d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:42.290657 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-55479ad5-b04f-4ff1-a724-21095ad7963d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:42.433527 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-55479ad5-b04f-4ff1-a724-21095ad7963d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:08:42.441337 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-55479ad5-b04f-4ff1-a724-21095ad7963d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 200 len: 1657 microversion: 2.1 time: 0.166463 Aug 07 02:08:42.441920 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3628/6790] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:08:42 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 1657 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:08:42.463403 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4c31e624-87d9-4243-a491-c937636cae04 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:42.464086 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4c31e624-87d9-4243-a491-c937636cae04 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:42.471497 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4c31e624-87d9-4243-a491-c937636cae04 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:42.472102 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4c31e624-87d9-4243-a491-c937636cae04 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:42.472640 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4c31e624-87d9-4243-a491-c937636cae04 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:42.473404 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4c31e624-87d9-4243-a491-c937636cae04 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:42.473871 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4c31e624-87d9-4243-a491-c937636cae04 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:42.474323 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4c31e624-87d9-4243-a491-c937636cae04 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:42.609242 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4c31e624-87d9-4243-a491-c937636cae04 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:08:42.616778 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4c31e624-87d9-4243-a491-c937636cae04 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 200 len: 1657 microversion: 2.1 time: 0.157890 Aug 07 02:08:42.617353 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3163/6791] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:08:42 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 1657 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:08:42.637603 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-acf6e6fd-04b8-4bb0-9710-eab0450ff9c5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:08:42.644420 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-acf6e6fd-04b8-4bb0-9710-eab0450ff9c5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:42.644925 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-acf6e6fd-04b8-4bb0-9710-eab0450ff9c5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:42.645377 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-acf6e6fd-04b8-4bb0-9710-eab0450ff9c5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:42.676645 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-acf6e6fd-04b8-4bb0-9710-eab0450ff9c5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Going to try to start instance {{(pid=119516) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 07 02:08:42.720171 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-acf6e6fd-04b8-4bb0-9710-eab0450ff9c5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "POST /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15/action" status: 202 len: 0 microversion: 2.1 time: 0.085893 Aug 07 02:08:42.721644 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3629/6792] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:08:42 2022] POST /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:08:42.730436 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9c1afb5a-b0e4-41c1-b1ef-41db4119cfab tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:42.731104 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9c1afb5a-b0e4-41c1-b1ef-41db4119cfab tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:42.737623 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9c1afb5a-b0e4-41c1-b1ef-41db4119cfab tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:42.738233 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9c1afb5a-b0e4-41c1-b1ef-41db4119cfab tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:42.740101 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9c1afb5a-b0e4-41c1-b1ef-41db4119cfab tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:42.740818 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9c1afb5a-b0e4-41c1-b1ef-41db4119cfab tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:42.743079 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9c1afb5a-b0e4-41c1-b1ef-41db4119cfab tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:42.743079 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9c1afb5a-b0e4-41c1-b1ef-41db4119cfab tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:42.911226 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9c1afb5a-b0e4-41c1-b1ef-41db4119cfab tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:08:42.919554 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9c1afb5a-b0e4-41c1-b1ef-41db4119cfab tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 200 len: 1666 microversion: 2.1 time: 0.193572 Aug 07 02:08:42.920165 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3164/6793] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:08:42 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 1666 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:08:43.342462 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-dccac699-770e-4919-9e7f-30276479b3dc req-555dc6b7-13a2-40aa-adb3-dc897fa98a69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "014e3168-a704-44d1-a867-3232988cfe15", "name": "network-vif-plugged", "status": "completed", "tag": "1d5b8fad-87fc-4026-bef2-671ed529d7af"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:08:43.353067 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-dccac699-770e-4919-9e7f-30276479b3dc req-555dc6b7-13a2-40aa-adb3-dc897fa98a69 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:43.353651 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-dccac699-770e-4919-9e7f-30276479b3dc req-555dc6b7-13a2-40aa-adb3-dc897fa98a69 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:43.354172 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-dccac699-770e-4919-9e7f-30276479b3dc req-555dc6b7-13a2-40aa-adb3-dc897fa98a69 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:43.365886 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-dccac699-770e-4919-9e7f-30276479b3dc req-555dc6b7-13a2-40aa-adb3-dc897fa98a69 service nova] Creating event network-vif-plugged:1d5b8fad-87fc-4026-bef2-671ed529d7af for instance 014e3168-a704-44d1-a867-3232988cfe15 on n-h1-master-1 Aug 07 02:08:43.370889 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-dccac699-770e-4919-9e7f-30276479b3dc req-555dc6b7-13a2-40aa-adb3-dc897fa98a69 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090549 Aug 07 02:08:43.371740 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3630/6794] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:08:43.940561 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fa50d68a-412e-4756-ab59-119517ae0fcd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:43.941188 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fa50d68a-412e-4756-ab59-119517ae0fcd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:43.948008 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa50d68a-412e-4756-ab59-119517ae0fcd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:43.948498 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa50d68a-412e-4756-ab59-119517ae0fcd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:43.949598 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa50d68a-412e-4756-ab59-119517ae0fcd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:43.950299 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa50d68a-412e-4756-ab59-119517ae0fcd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:43.950849 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa50d68a-412e-4756-ab59-119517ae0fcd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:43.951289 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa50d68a-412e-4756-ab59-119517ae0fcd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:44.080875 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fa50d68a-412e-4756-ab59-119517ae0fcd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:08:44.088518 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fa50d68a-412e-4756-ab59-119517ae0fcd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 200 len: 1666 microversion: 2.1 time: 0.151826 Aug 07 02:08:44.094465 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3165/6795] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:08:43 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 1666 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:08:45.110762 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bd9dc1c9-8da5-4f70-acad-b85e78f8a991 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:45.111482 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bd9dc1c9-8da5-4f70-acad-b85e78f8a991 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:45.118152 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd9dc1c9-8da5-4f70-acad-b85e78f8a991 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:45.118649 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd9dc1c9-8da5-4f70-acad-b85e78f8a991 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:45.119100 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd9dc1c9-8da5-4f70-acad-b85e78f8a991 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:45.119809 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd9dc1c9-8da5-4f70-acad-b85e78f8a991 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:45.120313 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd9dc1c9-8da5-4f70-acad-b85e78f8a991 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:45.120758 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd9dc1c9-8da5-4f70-acad-b85e78f8a991 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:45.125293 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:08:45.251199 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bd9dc1c9-8da5-4f70-acad-b85e78f8a991 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:08:45.258950 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bd9dc1c9-8da5-4f70-acad-b85e78f8a991 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 200 len: 1670 microversion: 2.1 time: 0.152583 Aug 07 02:08:45.259523 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3631/6796] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:08:45 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 1670 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:08:45.279420 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f1489b9e-c593-45eb-b9c8-7085491c5ee8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:45.279993 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f1489b9e-c593-45eb-b9c8-7085491c5ee8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:45.286679 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1489b9e-c593-45eb-b9c8-7085491c5ee8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:45.287169 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1489b9e-c593-45eb-b9c8-7085491c5ee8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:45.287609 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1489b9e-c593-45eb-b9c8-7085491c5ee8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:45.288334 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1489b9e-c593-45eb-b9c8-7085491c5ee8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:45.288797 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1489b9e-c593-45eb-b9c8-7085491c5ee8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:45.289230 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1489b9e-c593-45eb-b9c8-7085491c5ee8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:45.314421 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f1489b9e-c593-45eb-b9c8-7085491c5ee8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 02:08:45.317269 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:08:45.391648 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f1489b9e-c593-45eb-b9c8-7085491c5ee8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "DELETE /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 204 len: 0 microversion: 2.1 time: 0.115596 Aug 07 02:08:45.392669 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3166/6797] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 02:08:45 2022] DELETE /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 02:08:45.400964 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-20c47081-da0c-46e1-8dc3-36e267a83bb0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:45.401608 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-20c47081-da0c-46e1-8dc3-36e267a83bb0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:45.407642 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20c47081-da0c-46e1-8dc3-36e267a83bb0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:45.408169 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20c47081-da0c-46e1-8dc3-36e267a83bb0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:45.408619 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20c47081-da0c-46e1-8dc3-36e267a83bb0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:45.409325 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20c47081-da0c-46e1-8dc3-36e267a83bb0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:45.409793 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20c47081-da0c-46e1-8dc3-36e267a83bb0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:45.410233 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-20c47081-da0c-46e1-8dc3-36e267a83bb0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:45.540628 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-20c47081-da0c-46e1-8dc3-36e267a83bb0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:08:45.548775 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-20c47081-da0c-46e1-8dc3-36e267a83bb0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 200 len: 1676 microversion: 2.1 time: 0.151747 Aug 07 02:08:45.549346 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3632/6798] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:08:45 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:08:46.571144 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1d3caffd-535c-4dce-93be-d79c1f1deb62 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:46.571745 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1d3caffd-535c-4dce-93be-d79c1f1deb62 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:46.579279 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1d3caffd-535c-4dce-93be-d79c1f1deb62 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:46.579760 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1d3caffd-535c-4dce-93be-d79c1f1deb62 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:46.580226 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1d3caffd-535c-4dce-93be-d79c1f1deb62 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:46.580917 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1d3caffd-535c-4dce-93be-d79c1f1deb62 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:46.581370 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1d3caffd-535c-4dce-93be-d79c1f1deb62 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:46.581793 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1d3caffd-535c-4dce-93be-d79c1f1deb62 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:46.710993 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1d3caffd-535c-4dce-93be-d79c1f1deb62 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:08:46.718623 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1d3caffd-535c-4dce-93be-d79c1f1deb62 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 200 len: 1676 microversion: 2.1 time: 0.151851 Aug 07 02:08:46.719198 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3167/6799] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:08:46 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:08:47.695301 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-fdb5be40-2dc4-4c56-bb4c-60991105831e req-e97b9e6b-f5fa-49d2-881d-ba754ec73c93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "014e3168-a704-44d1-a867-3232988cfe15", "name": "network-vif-deleted", "tag": "1d5b8fad-87fc-4026-bef2-671ed529d7af"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:08:47.707077 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-fdb5be40-2dc4-4c56-bb4c-60991105831e req-e97b9e6b-f5fa-49d2-881d-ba754ec73c93 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:47.707558 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-fdb5be40-2dc4-4c56-bb4c-60991105831e req-e97b9e6b-f5fa-49d2-881d-ba754ec73c93 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:47.708033 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-fdb5be40-2dc4-4c56-bb4c-60991105831e req-e97b9e6b-f5fa-49d2-881d-ba754ec73c93 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:47.721140 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-fdb5be40-2dc4-4c56-bb4c-60991105831e req-e97b9e6b-f5fa-49d2-881d-ba754ec73c93 service nova] Creating event network-vif-deleted:1d5b8fad-87fc-4026-bef2-671ed529d7af for instance 014e3168-a704-44d1-a867-3232988cfe15 on n-h1-master-1 Aug 07 02:08:47.727089 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-fdb5be40-2dc4-4c56-bb4c-60991105831e req-e97b9e6b-f5fa-49d2-881d-ba754ec73c93 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035399 Aug 07 02:08:47.727935 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3633/6800] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:08:47.740544 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-26675cf1-1e0e-46de-89b4-595b357a6609 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:47.741228 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-26675cf1-1e0e-46de-89b4-595b357a6609 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:47.748406 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-26675cf1-1e0e-46de-89b4-595b357a6609 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:47.748899 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-26675cf1-1e0e-46de-89b4-595b357a6609 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:47.749902 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-26675cf1-1e0e-46de-89b4-595b357a6609 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:47.750612 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-26675cf1-1e0e-46de-89b4-595b357a6609 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:47.751072 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-26675cf1-1e0e-46de-89b4-595b357a6609 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:47.751503 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-26675cf1-1e0e-46de-89b4-595b357a6609 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:47.825296 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-26675cf1-1e0e-46de-89b4-595b357a6609 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:08:47.833045 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-26675cf1-1e0e-46de-89b4-595b357a6609 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 200 len: 1323 microversion: 2.1 time: 0.096491 Aug 07 02:08:47.833610 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3168/6801] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:08:47 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 1323 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:08:48.855527 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4422e285-2a19-48a2-84dd-48922081d26f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:48.856273 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4422e285-2a19-48a2-84dd-48922081d26f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:48.863112 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4422e285-2a19-48a2-84dd-48922081d26f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:48.863610 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4422e285-2a19-48a2-84dd-48922081d26f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:48.864094 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4422e285-2a19-48a2-84dd-48922081d26f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:48.864808 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4422e285-2a19-48a2-84dd-48922081d26f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:48.865281 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4422e285-2a19-48a2-84dd-48922081d26f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:48.865723 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4422e285-2a19-48a2-84dd-48922081d26f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:48.879061 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-4422e285-2a19-48a2-84dd-48922081d26f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] HTTP exception thrown: Instance 014e3168-a704-44d1-a867-3232988cfe15 could not be found. Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4422e285-2a19-48a2-84dd-48922081d26f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Request method failure captured: Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 HTTP/1.1 Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7x4hybynvxArQPeqt6CwV9Zs1N98xbn7O53qD-I8GCKutNl3jQRH4SvGrtWmYp2NG3dElrq0t1Ij5yq_G1gf33oIjYTVPSXt-tZSpufSbtrWCtdgSWSFbRz6TTImh-9pnxWIZSiSH_u6yWkLly4eko2V8UgCYC1x-j0UNpE9qntkRl0 Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 435945eeab2f42d386f48f7374bbd488 Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_435945eeab2f42d386f48f7374bbd488", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 435945eeab2f42d386f48f7374bbd488 Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServerActionsTestJSON-1683144832-project Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 09cb536a0a584f5f96bec5fca7afa3b4 Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServerActionsTestJSON-1683144832-project Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 014e3168-a704-44d1-a867-3232988cfe15 could not be found. Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '014e3168-a704-44d1-a867-3232988cfe15'} Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 014e3168-a704-44d1-a867-3232988cfe15 could not be found. Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 014e3168-a704-44d1-a867-3232988cfe15 could not be found. Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:08:48.880997 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:08:48.885377 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:08:48.885377 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:08:48.885377 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:08:48.885377 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:08:48.885377 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:08:48.885377 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 014e3168-a704-44d1-a867-3232988cfe15 could not be found. Aug 07 02:08:48.885377 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:08:48.885377 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4422e285-2a19-48a2-84dd-48922081d26f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Returning 404 to user: Instance 014e3168-a704-44d1-a867-3232988cfe15 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:08:48.885377 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4422e285-2a19-48a2-84dd-48922081d26f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 404 len: 111 microversion: 2.1 time: 0.031972 Aug 07 02:08:48.885377 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3634/6802] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:08:48 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:08:48.898655 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-36d1d9bb-4ca5-420b-a03e-54c699096115 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:48.899305 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-36d1d9bb-4ca5-420b-a03e-54c699096115 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:48.906893 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36d1d9bb-4ca5-420b-a03e-54c699096115 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:48.907367 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36d1d9bb-4ca5-420b-a03e-54c699096115 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:48.907798 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36d1d9bb-4ca5-420b-a03e-54c699096115 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:48.908561 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36d1d9bb-4ca5-420b-a03e-54c699096115 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:48.909016 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36d1d9bb-4ca5-420b-a03e-54c699096115 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:48.909444 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-36d1d9bb-4ca5-420b-a03e-54c699096115 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:48.923003 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-36d1d9bb-4ca5-420b-a03e-54c699096115 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] HTTP exception thrown: Instance 014e3168-a704-44d1-a867-3232988cfe15 could not be found. Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-36d1d9bb-4ca5-420b-a03e-54c699096115 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Request method failure captured: Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 HTTP/1.1 Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7x4hybynvxArQPeqt6CwV9Zs1N98xbn7O53qD-I8GCKutNl3jQRH4SvGrtWmYp2NG3dElrq0t1Ij5yq_G1gf33oIjYTVPSXt-tZSpufSbtrWCtdgSWSFbRz6TTImh-9pnxWIZSiSH_u6yWkLly4eko2V8UgCYC1x-j0UNpE9qntkRl0 Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 435945eeab2f42d386f48f7374bbd488 Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_435945eeab2f42d386f48f7374bbd488", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 435945eeab2f42d386f48f7374bbd488 Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServerActionsTestJSON-1683144832-project Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 09cb536a0a584f5f96bec5fca7afa3b4 Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServerActionsTestJSON-1683144832-project Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 014e3168-a704-44d1-a867-3232988cfe15 could not be found. Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '014e3168-a704-44d1-a867-3232988cfe15'} Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 014e3168-a704-44d1-a867-3232988cfe15 could not be found. Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 014e3168-a704-44d1-a867-3232988cfe15 could not be found. Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:08:48.924664 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:08:48.929151 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:08:48.929151 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:08:48.929151 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:08:48.929151 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:08:48.929151 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:08:48.929151 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 014e3168-a704-44d1-a867-3232988cfe15 could not be found. Aug 07 02:08:48.929151 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:08:48.929151 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-36d1d9bb-4ca5-420b-a03e-54c699096115 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Returning 404 to user: Instance 014e3168-a704-44d1-a867-3232988cfe15 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:08:48.929151 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-36d1d9bb-4ca5-420b-a03e-54c699096115 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 404 len: 111 microversion: 2.1 time: 0.031548 Aug 07 02:08:48.929151 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3169/6803] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:08:48 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:08:48.974622 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d775f451-c4bd-437a-a680-29c05b4e0e78 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1772948569", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "da7de2ad-cced-4f5b-81a4-2f9d332f427b"}], "security_groups": [{"name": "tempest-securitygroup--1850202519"}], "key_name": "tempest-keypair-1891336762", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:08:49.077676 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-d775f451-c4bd-437a-a680-29c05b4e0e78 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] validate_networks() for [('da7de2ad-cced-4f5b-81a4-2f9d332f427b', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 02:08:49.791719 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-d775f451-c4bd-437a-a680-29c05b4e0e78 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 02:08:49.792183 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-d775f451-c4bd-437a-a680-29c05b4e0e78 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 02:08:49.792671 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-d775f451-c4bd-437a-a680-29c05b4e0e78 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 02:08:49.793093 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-d775f451-c4bd-437a-a680-29c05b4e0e78 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 02:08:49.793517 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-d775f451-c4bd-437a-a680-29c05b4e0e78 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 02:08:49.805119 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d775f451-c4bd-437a-a680-29c05b4e0e78 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:49.805614 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d775f451-c4bd-437a-a680-29c05b4e0e78 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:49.806058 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d775f451-c4bd-437a-a680-29c05b4e0e78 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:49.806795 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d775f451-c4bd-437a-a680-29c05b4e0e78 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:49.807264 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d775f451-c4bd-437a-a680-29c05b4e0e78 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:49.807698 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d775f451-c4bd-437a-a680-29c05b4e0e78 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:49.826147 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-d775f451-c4bd-437a-a680-29c05b4e0e78 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Getting quotas for project 435945eeab2f42d386f48f7374bbd488. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:08:49.831267 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-d775f451-c4bd-437a-a680-29c05b4e0e78 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Getting quotas for user 09cb536a0a584f5f96bec5fca7afa3b4 and project 435945eeab2f42d386f48f7374bbd488. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:08:49.843756 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d775f451-c4bd-437a-a680-29c05b4e0e78 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 02:08:49.846130 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d775f451-c4bd-437a-a680-29c05b4e0e78 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 02:08:49.892836 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d775f451-c4bd-437a-a680-29c05b4e0e78 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.922062 Aug 07 02:08:49.895922 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3635/6804] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 02:08:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 02:08:49.904955 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6aa3c74c-2fd8-48e7-8e2d-1677197724c4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:49.905587 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6aa3c74c-2fd8-48e7-8e2d-1677197724c4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:49.961190 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6aa3c74c-2fd8-48e7-8e2d-1677197724c4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:08:49.972720 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6aa3c74c-2fd8-48e7-8e2d-1677197724c4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 200 len: 1239 microversion: 2.1 time: 0.071746 Aug 07 02:08:49.973287 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3170/6805] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:08:49 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 1239 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:08:50.994491 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ae5eb07f-193b-4a0c-ab5c-9287147e4f3e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:50.995161 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ae5eb07f-193b-4a0c-ab5c-9287147e4f3e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:51.003524 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ae5eb07f-193b-4a0c-ab5c-9287147e4f3e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:51.004477 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ae5eb07f-193b-4a0c-ab5c-9287147e4f3e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:51.005471 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ae5eb07f-193b-4a0c-ab5c-9287147e4f3e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:51.006439 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ae5eb07f-193b-4a0c-ab5c-9287147e4f3e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:51.007146 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ae5eb07f-193b-4a0c-ab5c-9287147e4f3e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:51.007953 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ae5eb07f-193b-4a0c-ab5c-9287147e4f3e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:51.081526 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ae5eb07f-193b-4a0c-ab5c-9287147e4f3e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:08:51.089219 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ae5eb07f-193b-4a0c-ab5c-9287147e4f3e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 200 len: 1309 microversion: 2.1 time: 0.098627 Aug 07 02:08:51.089793 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3636/6806] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:08:50 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 1309 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:08:52.112629 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-363c05ed-fb41-4989-9490-f268b9d4a879 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:52.113307 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-363c05ed-fb41-4989-9490-f268b9d4a879 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:52.119300 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-363c05ed-fb41-4989-9490-f268b9d4a879 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:52.119776 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-363c05ed-fb41-4989-9490-f268b9d4a879 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:52.120259 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-363c05ed-fb41-4989-9490-f268b9d4a879 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:52.120960 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-363c05ed-fb41-4989-9490-f268b9d4a879 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:52.121416 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-363c05ed-fb41-4989-9490-f268b9d4a879 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:52.121864 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-363c05ed-fb41-4989-9490-f268b9d4a879 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:52.315621 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-363c05ed-fb41-4989-9490-f268b9d4a879 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:08:52.323177 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-363c05ed-fb41-4989-9490-f268b9d4a879 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 200 len: 1365 microversion: 2.1 time: 0.216019 Aug 07 02:08:52.323763 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3171/6807] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:08:52 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:08:52.360049 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-3676a986-a106-4128-9b1b-604472d9c042 req-05b1ecb4-4bfb-41e6-8959-7f98eda74bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5ef4713-8e0d-4bc3-80e3-0d040f248c09", "tag": "950c66db-3499-4d9b-8778-8a8d57b15457"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:08:52.371093 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3676a986-a106-4128-9b1b-604472d9c042 req-05b1ecb4-4bfb-41e6-8959-7f98eda74bc7 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:52.371579 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3676a986-a106-4128-9b1b-604472d9c042 req-05b1ecb4-4bfb-41e6-8959-7f98eda74bc7 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:52.372167 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3676a986-a106-4128-9b1b-604472d9c042 req-05b1ecb4-4bfb-41e6-8959-7f98eda74bc7 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:52.383626 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-3676a986-a106-4128-9b1b-604472d9c042 req-05b1ecb4-4bfb-41e6-8959-7f98eda74bc7 service nova] Creating event network-changed:950c66db-3499-4d9b-8778-8a8d57b15457 for instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 on n-h1-master-1 Aug 07 02:08:52.388505 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-3676a986-a106-4128-9b1b-604472d9c042 req-05b1ecb4-4bfb-41e6-8959-7f98eda74bc7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032440 Aug 07 02:08:52.389104 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3637/6808] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:08:53.345750 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-75e513be-234c-4512-bdce-0cbc3038efd7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:53.346374 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-75e513be-234c-4512-bdce-0cbc3038efd7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:53.349189 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:08:53.355550 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75e513be-234c-4512-bdce-0cbc3038efd7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:53.356256 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75e513be-234c-4512-bdce-0cbc3038efd7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:53.356735 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75e513be-234c-4512-bdce-0cbc3038efd7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:53.357439 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75e513be-234c-4512-bdce-0cbc3038efd7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:53.357897 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75e513be-234c-4512-bdce-0cbc3038efd7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:53.358326 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75e513be-234c-4512-bdce-0cbc3038efd7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:53.485296 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-75e513be-234c-4512-bdce-0cbc3038efd7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:08:53.492860 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-75e513be-234c-4512-bdce-0cbc3038efd7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 200 len: 1365 microversion: 2.1 time: 0.151536 Aug 07 02:08:53.493426 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3172/6809] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:08:53 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:08:54.515495 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d2bc2276-450d-4e54-982c-256de8f17c29 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:54.516752 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d2bc2276-450d-4e54-982c-256de8f17c29 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:54.518724 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:08:54.524339 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2bc2276-450d-4e54-982c-256de8f17c29 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:54.524833 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2bc2276-450d-4e54-982c-256de8f17c29 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:54.525281 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2bc2276-450d-4e54-982c-256de8f17c29 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:54.525981 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2bc2276-450d-4e54-982c-256de8f17c29 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:54.526440 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2bc2276-450d-4e54-982c-256de8f17c29 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:54.526879 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d2bc2276-450d-4e54-982c-256de8f17c29 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:54.658643 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d2bc2276-450d-4e54-982c-256de8f17c29 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:08:54.666167 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d2bc2276-450d-4e54-982c-256de8f17c29 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 200 len: 1365 microversion: 2.1 time: 0.155727 Aug 07 02:08:54.666736 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3638/6810] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:08:54 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:08:55.687226 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-805f5d6f-4dac-4942-9a92-7b903c79feb3 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:55.687854 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-805f5d6f-4dac-4942-9a92-7b903c79feb3 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:55.700407 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-805f5d6f-4dac-4942-9a92-7b903c79feb3 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:55.700895 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-805f5d6f-4dac-4942-9a92-7b903c79feb3 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:55.701372 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-805f5d6f-4dac-4942-9a92-7b903c79feb3 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:55.702143 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-805f5d6f-4dac-4942-9a92-7b903c79feb3 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:55.702600 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-805f5d6f-4dac-4942-9a92-7b903c79feb3 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:55.703022 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-805f5d6f-4dac-4942-9a92-7b903c79feb3 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:55.834522 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-805f5d6f-4dac-4942-9a92-7b903c79feb3 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:08:55.841973 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-805f5d6f-4dac-4942-9a92-7b903c79feb3 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 200 len: 1365 microversion: 2.1 time: 0.158724 Aug 07 02:08:55.842535 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3173/6811] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:08:55 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:08:56.864013 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8550c3a5-d327-44e0-9a11-dbaf32a31604 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:56.864645 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8550c3a5-d327-44e0-9a11-dbaf32a31604 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:56.871480 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8550c3a5-d327-44e0-9a11-dbaf32a31604 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:56.871997 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8550c3a5-d327-44e0-9a11-dbaf32a31604 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:56.872445 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8550c3a5-d327-44e0-9a11-dbaf32a31604 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:56.873153 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8550c3a5-d327-44e0-9a11-dbaf32a31604 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:56.873613 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8550c3a5-d327-44e0-9a11-dbaf32a31604 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:56.874055 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8550c3a5-d327-44e0-9a11-dbaf32a31604 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:57.009755 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8550c3a5-d327-44e0-9a11-dbaf32a31604 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:08:57.017529 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8550c3a5-d327-44e0-9a11-dbaf32a31604 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 200 len: 1365 microversion: 2.1 time: 0.157900 Aug 07 02:08:57.018099 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3639/6812] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:08:56 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:08:57.293686 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-3b533ca0-1980-4948-a85f-ad04800d75b0 req-fc06ceea-5e98-4671-b96a-f94c11e9d15f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5ef4713-8e0d-4bc3-80e3-0d040f248c09", "name": "network-vif-plugged", "status": "completed", "tag": "950c66db-3499-4d9b-8778-8a8d57b15457"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:08:57.304337 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3b533ca0-1980-4948-a85f-ad04800d75b0 req-fc06ceea-5e98-4671-b96a-f94c11e9d15f service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:57.304826 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3b533ca0-1980-4948-a85f-ad04800d75b0 req-fc06ceea-5e98-4671-b96a-f94c11e9d15f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:57.305269 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3b533ca0-1980-4948-a85f-ad04800d75b0 req-fc06ceea-5e98-4671-b96a-f94c11e9d15f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:57.318216 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-3b533ca0-1980-4948-a85f-ad04800d75b0 req-fc06ceea-5e98-4671-b96a-f94c11e9d15f service nova] Creating event network-vif-plugged:950c66db-3499-4d9b-8778-8a8d57b15457 for instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 on n-h1-master-1 Aug 07 02:08:57.323207 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-3b533ca0-1980-4948-a85f-ad04800d75b0 req-fc06ceea-5e98-4671-b96a-f94c11e9d15f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033295 Aug 07 02:08:57.323969 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3174/6813] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:08:58.045498 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cd52f9b2-4f37-4b82-91c0-f6ed0164aa64 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:58.046253 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cd52f9b2-4f37-4b82-91c0-f6ed0164aa64 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:58.053830 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd52f9b2-4f37-4b82-91c0-f6ed0164aa64 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:58.054326 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd52f9b2-4f37-4b82-91c0-f6ed0164aa64 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:58.054779 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd52f9b2-4f37-4b82-91c0-f6ed0164aa64 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:58.055498 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd52f9b2-4f37-4b82-91c0-f6ed0164aa64 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:58.055999 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd52f9b2-4f37-4b82-91c0-f6ed0164aa64 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:58.056445 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd52f9b2-4f37-4b82-91c0-f6ed0164aa64 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:58.185024 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cd52f9b2-4f37-4b82-91c0-f6ed0164aa64 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:08:58.192492 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cd52f9b2-4f37-4b82-91c0-f6ed0164aa64 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 200 len: 1365 microversion: 2.1 time: 0.156857 Aug 07 02:08:58.193060 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3640/6814] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:08:58 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:08:59.217018 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-144e2475-74d9-4f55-93a3-3987d3205b5d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:59.217730 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-144e2475-74d9-4f55-93a3-3987d3205b5d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:59.224208 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-144e2475-74d9-4f55-93a3-3987d3205b5d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:59.224697 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-144e2475-74d9-4f55-93a3-3987d3205b5d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:59.225173 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-144e2475-74d9-4f55-93a3-3987d3205b5d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:59.225872 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-144e2475-74d9-4f55-93a3-3987d3205b5d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:59.226331 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-144e2475-74d9-4f55-93a3-3987d3205b5d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:59.226761 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-144e2475-74d9-4f55-93a3-3987d3205b5d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:59.365262 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-144e2475-74d9-4f55-93a3-3987d3205b5d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:08:59.373005 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-144e2475-74d9-4f55-93a3-3987d3205b5d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 200 len: 1552 microversion: 2.1 time: 0.163158 Aug 07 02:08:59.373641 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3175/6815] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:08:59 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 1552 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:08:59.394816 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bef5b554-eb6a-4a4f-9de8-f882f2163054 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:08:59.395364 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bef5b554-eb6a-4a4f-9de8-f882f2163054 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:08:59.402308 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bef5b554-eb6a-4a4f-9de8-f882f2163054 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:59.402807 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bef5b554-eb6a-4a4f-9de8-f882f2163054 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:59.403261 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bef5b554-eb6a-4a4f-9de8-f882f2163054 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:59.404006 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bef5b554-eb6a-4a4f-9de8-f882f2163054 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:08:59.404483 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bef5b554-eb6a-4a4f-9de8-f882f2163054 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:08:59.404925 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bef5b554-eb6a-4a4f-9de8-f882f2163054 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:08:59.490276 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bef5b554-eb6a-4a4f-9de8-f882f2163054 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099677 Aug 07 02:08:59.490876 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3641/6816] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Aug 7 02:08:59 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:09:00.472621 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:09:00.522627 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-25711924-79e7-467e-bbff-f77f48891058 req-78e0c3ab-9f4e-49fa-b3e9-29251c2ab138 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5ef4713-8e0d-4bc3-80e3-0d040f248c09", "tag": "950c66db-3499-4d9b-8778-8a8d57b15457"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:09:00.532758 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-25711924-79e7-467e-bbff-f77f48891058 req-78e0c3ab-9f4e-49fa-b3e9-29251c2ab138 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:00.533805 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-25711924-79e7-467e-bbff-f77f48891058 req-78e0c3ab-9f4e-49fa-b3e9-29251c2ab138 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:00.534237 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-25711924-79e7-467e-bbff-f77f48891058 req-78e0c3ab-9f4e-49fa-b3e9-29251c2ab138 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:00.545220 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-25711924-79e7-467e-bbff-f77f48891058 req-78e0c3ab-9f4e-49fa-b3e9-29251c2ab138 service nova] Creating event network-changed:950c66db-3499-4d9b-8778-8a8d57b15457 for instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 on n-h1-master-1 Aug 07 02:09:00.550250 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-25711924-79e7-467e-bbff-f77f48891058 req-78e0c3ab-9f4e-49fa-b3e9-29251c2ab138 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082961 Aug 07 02:09:00.551167 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3176/6817] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:09:27.858148 n-d-master-1 devstack@n-api.service[119517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 02:09:27.858856 n-d-master-1 devstack@n-api.service[119517]: Sun Aug 7 02:09:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 02:09:27.973505 n-d-master-1 devstack@n-api.service[119517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 02:09:27.973659 n-d-master-1 devstack@n-api.service[119517]: Sun Aug 7 02:09:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 02:09:28.074673 n-d-master-1 devstack@n-api.service[119516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 02:09:28.075256 n-d-master-1 devstack@n-api.service[119516]: Sun Aug 7 02:09:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 02:09:30.886503 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:09:30.887338 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:09:30.890295 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=7 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:09:30.891032 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=47 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:09:30.895657 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5e3f76c2-f666-4b45-afa5-9124d738dec0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:09:30.897958 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5e3f76c2-f666-4b45-afa5-9124d738dec0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:09:30.907853 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e3f76c2-f666-4b45-afa5-9124d738dec0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:30.908372 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e3f76c2-f666-4b45-afa5-9124d738dec0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:30.908817 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e3f76c2-f666-4b45-afa5-9124d738dec0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:30.909528 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e3f76c2-f666-4b45-afa5-9124d738dec0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:30.909993 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e3f76c2-f666-4b45-afa5-9124d738dec0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:30.910429 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e3f76c2-f666-4b45-afa5-9124d738dec0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:30.937359 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5e3f76c2-f666-4b45-afa5-9124d738dec0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:09:30.945494 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5e3f76c2-f666-4b45-afa5-9124d738dec0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Old instance type m1.heat2, new instance type m1.heat {{(pid=119516) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 07 02:09:30.952201 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-5e3f76c2-f666-4b45-afa5-9124d738dec0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 02:09:30.952636 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-5e3f76c2-f666-4b45-afa5-9124d738dec0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 02:09:30.953122 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-5e3f76c2-f666-4b45-afa5-9124d738dec0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 02:09:30.953538 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-5e3f76c2-f666-4b45-afa5-9124d738dec0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 02:09:30.953959 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-5e3f76c2-f666-4b45-afa5-9124d738dec0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 02:09:31.017875 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5e3f76c2-f666-4b45-afa5-9124d738dec0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "POST /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09/action" status: 202 len: 0 microversion: 2.1 time: 0.131984 Aug 07 02:09:31.018653 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3642/6818] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:09:30 2022] POST /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:09:31.025783 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=9 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:09:31.026599 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:09:31.031418 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4a105d92-3f94-4037-a366-615eb2616935 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:09:31.031656 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4a105d92-3f94-4037-a366-615eb2616935 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:09:31.039279 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4a105d92-3f94-4037-a366-615eb2616935 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:31.039912 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4a105d92-3f94-4037-a366-615eb2616935 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:31.040459 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4a105d92-3f94-4037-a366-615eb2616935 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:31.041333 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4a105d92-3f94-4037-a366-615eb2616935 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:31.041944 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4a105d92-3f94-4037-a366-615eb2616935 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:31.042286 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4a105d92-3f94-4037-a366-615eb2616935 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:31.218741 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4a105d92-3f94-4037-a366-615eb2616935 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:09:31.227227 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4a105d92-3f94-4037-a366-615eb2616935 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 200 len: 1680 microversion: 2.1 time: 0.204316 Aug 07 02:09:31.227930 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3177/6819] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:09:31 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 1680 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:09:32.249528 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6910322d-f3f6-4754-88a9-64becccee1bc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:09:32.250373 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6910322d-f3f6-4754-88a9-64becccee1bc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:09:32.256144 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6910322d-f3f6-4754-88a9-64becccee1bc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:32.256639 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6910322d-f3f6-4754-88a9-64becccee1bc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:32.257084 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6910322d-f3f6-4754-88a9-64becccee1bc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:32.257789 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6910322d-f3f6-4754-88a9-64becccee1bc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:32.258250 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6910322d-f3f6-4754-88a9-64becccee1bc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:32.258687 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6910322d-f3f6-4754-88a9-64becccee1bc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:32.396557 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6910322d-f3f6-4754-88a9-64becccee1bc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:09:32.404684 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6910322d-f3f6-4754-88a9-64becccee1bc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 200 len: 1680 microversion: 2.1 time: 0.160073 Aug 07 02:09:32.405258 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3643/6820] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:09:32 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:09:33.426019 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d7a10cf3-de9e-4003-96d8-2a4899dab0ff tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:09:33.426635 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d7a10cf3-de9e-4003-96d8-2a4899dab0ff tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:09:33.434237 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7a10cf3-de9e-4003-96d8-2a4899dab0ff tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:33.434716 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7a10cf3-de9e-4003-96d8-2a4899dab0ff tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:33.435152 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7a10cf3-de9e-4003-96d8-2a4899dab0ff tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:33.435843 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7a10cf3-de9e-4003-96d8-2a4899dab0ff tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:33.436330 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7a10cf3-de9e-4003-96d8-2a4899dab0ff tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:33.436755 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d7a10cf3-de9e-4003-96d8-2a4899dab0ff tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:33.566368 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d7a10cf3-de9e-4003-96d8-2a4899dab0ff tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:09:33.574494 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d7a10cf3-de9e-4003-96d8-2a4899dab0ff tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 200 len: 1685 microversion: 2.1 time: 0.152409 Aug 07 02:09:33.575062 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3178/6821] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:09:33 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:09:34.595854 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a8f8b2dc-6e92-4ec6-b7f9-8ec045c8325d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:09:34.596513 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a8f8b2dc-6e92-4ec6-b7f9-8ec045c8325d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:09:34.604084 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8f8b2dc-6e92-4ec6-b7f9-8ec045c8325d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:34.611492 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8f8b2dc-6e92-4ec6-b7f9-8ec045c8325d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:34.611989 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8f8b2dc-6e92-4ec6-b7f9-8ec045c8325d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:34.612750 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8f8b2dc-6e92-4ec6-b7f9-8ec045c8325d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:34.613230 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8f8b2dc-6e92-4ec6-b7f9-8ec045c8325d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:34.613678 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8f8b2dc-6e92-4ec6-b7f9-8ec045c8325d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:34.754004 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a8f8b2dc-6e92-4ec6-b7f9-8ec045c8325d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:09:34.761609 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a8f8b2dc-6e92-4ec6-b7f9-8ec045c8325d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 200 len: 1685 microversion: 2.1 time: 0.169724 Aug 07 02:09:34.762215 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3644/6822] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:09:34 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 1685 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:09:35.783540 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4870bf22-f766-4676-9798-d4a68d4fd629 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:09:35.784160 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4870bf22-f766-4676-9798-d4a68d4fd629 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:09:35.794038 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4870bf22-f766-4676-9798-d4a68d4fd629 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:35.794522 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4870bf22-f766-4676-9798-d4a68d4fd629 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:35.794962 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4870bf22-f766-4676-9798-d4a68d4fd629 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:35.795658 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4870bf22-f766-4676-9798-d4a68d4fd629 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:35.796147 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4870bf22-f766-4676-9798-d4a68d4fd629 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:35.796574 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4870bf22-f766-4676-9798-d4a68d4fd629 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:35.927495 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4870bf22-f766-4676-9798-d4a68d4fd629 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:09:35.934985 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4870bf22-f766-4676-9798-d4a68d4fd629 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 200 len: 1685 microversion: 2.1 time: 0.155399 Aug 07 02:09:35.935548 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3179/6823] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:09:35 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:09:36.956020 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5f95664f-25fb-43f0-93ce-ba69b656473e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:09:36.956682 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5f95664f-25fb-43f0-93ce-ba69b656473e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:09:36.964157 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f95664f-25fb-43f0-93ce-ba69b656473e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:36.964655 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f95664f-25fb-43f0-93ce-ba69b656473e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:36.965114 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f95664f-25fb-43f0-93ce-ba69b656473e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:36.965828 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f95664f-25fb-43f0-93ce-ba69b656473e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:36.966305 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f95664f-25fb-43f0-93ce-ba69b656473e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:36.966746 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5f95664f-25fb-43f0-93ce-ba69b656473e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:37.095028 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5f95664f-25fb-43f0-93ce-ba69b656473e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:09:37.102587 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5f95664f-25fb-43f0-93ce-ba69b656473e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 200 len: 1685 microversion: 2.1 time: 0.150469 Aug 07 02:09:37.103150 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3645/6824] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:09:36 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 1685 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:09:38.123865 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-25ac9ce2-135c-4034-9b8a-c59075b0fccd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:09:38.124506 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-25ac9ce2-135c-4034-9b8a-c59075b0fccd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:09:38.131265 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-25ac9ce2-135c-4034-9b8a-c59075b0fccd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:38.131759 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-25ac9ce2-135c-4034-9b8a-c59075b0fccd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:38.132219 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-25ac9ce2-135c-4034-9b8a-c59075b0fccd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:38.132918 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-25ac9ce2-135c-4034-9b8a-c59075b0fccd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:38.133377 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-25ac9ce2-135c-4034-9b8a-c59075b0fccd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:38.133803 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-25ac9ce2-135c-4034-9b8a-c59075b0fccd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:38.260501 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-25ac9ce2-135c-4034-9b8a-c59075b0fccd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:09:38.268277 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-25ac9ce2-135c-4034-9b8a-c59075b0fccd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 200 len: 1685 microversion: 2.1 time: 0.148298 Aug 07 02:09:38.268839 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3180/6825] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:09:38 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 1685 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:09:39.289799 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-00d9dd60-5817-4efb-b876-e265ae8078f8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:09:39.290367 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-00d9dd60-5817-4efb-b876-e265ae8078f8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:09:39.297152 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-00d9dd60-5817-4efb-b876-e265ae8078f8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:39.297645 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-00d9dd60-5817-4efb-b876-e265ae8078f8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:39.298095 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-00d9dd60-5817-4efb-b876-e265ae8078f8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:39.298810 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-00d9dd60-5817-4efb-b876-e265ae8078f8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:39.299278 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-00d9dd60-5817-4efb-b876-e265ae8078f8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:39.299720 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-00d9dd60-5817-4efb-b876-e265ae8078f8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:39.432752 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-00d9dd60-5817-4efb-b876-e265ae8078f8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:09:39.440351 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-00d9dd60-5817-4efb-b876-e265ae8078f8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 200 len: 1685 microversion: 2.1 time: 0.154494 Aug 07 02:09:39.440932 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3646/6826] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:09:39 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:09:40.461998 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4e8645b6-2ba5-4223-8395-743ce032b2cf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:09:40.462656 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4e8645b6-2ba5-4223-8395-743ce032b2cf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:09:40.469970 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4e8645b6-2ba5-4223-8395-743ce032b2cf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:40.470455 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4e8645b6-2ba5-4223-8395-743ce032b2cf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:40.471423 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4e8645b6-2ba5-4223-8395-743ce032b2cf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:40.472166 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4e8645b6-2ba5-4223-8395-743ce032b2cf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:40.472630 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4e8645b6-2ba5-4223-8395-743ce032b2cf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:40.473060 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4e8645b6-2ba5-4223-8395-743ce032b2cf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:40.606133 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4e8645b6-2ba5-4223-8395-743ce032b2cf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:09:40.613698 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4e8645b6-2ba5-4223-8395-743ce032b2cf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 200 len: 1685 microversion: 2.1 time: 0.155649 Aug 07 02:09:40.614270 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3181/6827] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:09:40 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:09:41.635372 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-18b086e2-d407-4191-8ac1-b082442aa1da tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:09:41.635984 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-18b086e2-d407-4191-8ac1-b082442aa1da tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:09:41.643253 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-18b086e2-d407-4191-8ac1-b082442aa1da tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:41.643750 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-18b086e2-d407-4191-8ac1-b082442aa1da tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:41.644227 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-18b086e2-d407-4191-8ac1-b082442aa1da tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:41.644942 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-18b086e2-d407-4191-8ac1-b082442aa1da tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:41.645415 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-18b086e2-d407-4191-8ac1-b082442aa1da tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:41.645860 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-18b086e2-d407-4191-8ac1-b082442aa1da tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:41.779140 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-18b086e2-d407-4191-8ac1-b082442aa1da tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:09:41.786758 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-18b086e2-d407-4191-8ac1-b082442aa1da tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 200 len: 1685 microversion: 2.1 time: 0.155396 Aug 07 02:09:41.787347 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3647/6828] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:09:41 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:09:42.809824 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c2e0e396-94af-4e83-8270-4c79f9e9cabc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:09:42.810642 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c2e0e396-94af-4e83-8270-4c79f9e9cabc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:09:42.817168 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2e0e396-94af-4e83-8270-4c79f9e9cabc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:42.817646 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2e0e396-94af-4e83-8270-4c79f9e9cabc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:42.818084 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2e0e396-94af-4e83-8270-4c79f9e9cabc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:42.818777 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2e0e396-94af-4e83-8270-4c79f9e9cabc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:42.819229 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2e0e396-94af-4e83-8270-4c79f9e9cabc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:42.819657 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2e0e396-94af-4e83-8270-4c79f9e9cabc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:42.962342 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c2e0e396-94af-4e83-8270-4c79f9e9cabc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:09:42.971073 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c2e0e396-94af-4e83-8270-4c79f9e9cabc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 200 len: 1685 microversion: 2.1 time: 0.166570 Aug 07 02:09:42.971661 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3182/6829] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:09:42 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 1685 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:09:43.994056 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-aa1d8eed-e96d-48ae-a105-dd4b8653e8ca tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:09:43.995654 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-aa1d8eed-e96d-48ae-a105-dd4b8653e8ca tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:09:44.004811 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa1d8eed-e96d-48ae-a105-dd4b8653e8ca tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:44.005313 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa1d8eed-e96d-48ae-a105-dd4b8653e8ca tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:44.005763 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa1d8eed-e96d-48ae-a105-dd4b8653e8ca tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:44.006478 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa1d8eed-e96d-48ae-a105-dd4b8653e8ca tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:44.006951 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa1d8eed-e96d-48ae-a105-dd4b8653e8ca tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:44.007394 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aa1d8eed-e96d-48ae-a105-dd4b8653e8ca tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:44.146486 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-aa1d8eed-e96d-48ae-a105-dd4b8653e8ca tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:09:44.153989 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-aa1d8eed-e96d-48ae-a105-dd4b8653e8ca tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 200 len: 1685 microversion: 2.1 time: 0.165162 Aug 07 02:09:44.154557 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3648/6830] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:09:43 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 1685 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:09:45.174901 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-309b914e-2162-4609-babf-ba9b8832050e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:09:45.175528 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-309b914e-2162-4609-babf-ba9b8832050e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:09:45.182205 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-309b914e-2162-4609-babf-ba9b8832050e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:45.182697 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-309b914e-2162-4609-babf-ba9b8832050e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:45.183744 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-309b914e-2162-4609-babf-ba9b8832050e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:45.184477 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-309b914e-2162-4609-babf-ba9b8832050e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:45.184938 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-309b914e-2162-4609-babf-ba9b8832050e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:45.185367 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-309b914e-2162-4609-babf-ba9b8832050e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:45.323445 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-309b914e-2162-4609-babf-ba9b8832050e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:09:45.331081 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-309b914e-2162-4609-babf-ba9b8832050e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 200 len: 1684 microversion: 2.1 time: 0.160328 Aug 07 02:09:45.332006 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3183/6831] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:09:45 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:09:45.491783 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-2751c698-0aad-4660-8136-afcc50006556 req-2c513a29-9f1d-4f9b-85c3-f603f2e20471 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5ef4713-8e0d-4bc3-80e3-0d040f248c09", "name": "network-vif-unplugged", "status": "completed", "tag": "950c66db-3499-4d9b-8778-8a8d57b15457"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:09:45.503598 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2751c698-0aad-4660-8136-afcc50006556 req-2c513a29-9f1d-4f9b-85c3-f603f2e20471 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:45.504169 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2751c698-0aad-4660-8136-afcc50006556 req-2c513a29-9f1d-4f9b-85c3-f603f2e20471 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:45.504676 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2751c698-0aad-4660-8136-afcc50006556 req-2c513a29-9f1d-4f9b-85c3-f603f2e20471 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:45.521467 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-2751c698-0aad-4660-8136-afcc50006556 req-2c513a29-9f1d-4f9b-85c3-f603f2e20471 service nova] Creating event network-vif-unplugged:950c66db-3499-4d9b-8778-8a8d57b15457 for instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 on n-h2-master-1 Aug 07 02:09:45.527586 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [req-2751c698-0aad-4660-8136-afcc50006556 req-2c513a29-9f1d-4f9b-85c3-f603f2e20471 service nova] Instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 02:09:45.538656 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-2751c698-0aad-4660-8136-afcc50006556 req-2c513a29-9f1d-4f9b-85c3-f603f2e20471 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050662 Aug 07 02:09:45.539487 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3649/6832] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:09:46.352511 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6479562d-ead3-4b4f-9828-5c3c05308b85 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:09:46.353127 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6479562d-ead3-4b4f-9828-5c3c05308b85 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:09:46.360877 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6479562d-ead3-4b4f-9828-5c3c05308b85 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:46.361432 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6479562d-ead3-4b4f-9828-5c3c05308b85 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:46.361888 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6479562d-ead3-4b4f-9828-5c3c05308b85 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:46.362704 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6479562d-ead3-4b4f-9828-5c3c05308b85 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:46.363049 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6479562d-ead3-4b4f-9828-5c3c05308b85 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:46.363478 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6479562d-ead3-4b4f-9828-5c3c05308b85 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:46.497922 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6479562d-ead3-4b4f-9828-5c3c05308b85 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:09:46.505773 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6479562d-ead3-4b4f-9828-5c3c05308b85 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 200 len: 1684 microversion: 2.1 time: 0.157152 Aug 07 02:09:46.506355 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3184/6833] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:09:46 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:09:47.529068 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-33d5af1d-8c96-4dbb-a826-0fdaa96afd0e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:09:47.530305 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-33d5af1d-8c96-4dbb-a826-0fdaa96afd0e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:09:47.536056 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33d5af1d-8c96-4dbb-a826-0fdaa96afd0e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:47.536546 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33d5af1d-8c96-4dbb-a826-0fdaa96afd0e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:47.536990 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33d5af1d-8c96-4dbb-a826-0fdaa96afd0e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:47.537689 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33d5af1d-8c96-4dbb-a826-0fdaa96afd0e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:47.538153 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33d5af1d-8c96-4dbb-a826-0fdaa96afd0e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:47.538590 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33d5af1d-8c96-4dbb-a826-0fdaa96afd0e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:47.558077 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-904e2efe-1309-4093-8f17-f461324c9ea6 req-eb96b04c-fd34-4b5b-a3e8-820cafc96cde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5ef4713-8e0d-4bc3-80e3-0d040f248c09", "tag": "950c66db-3499-4d9b-8778-8a8d57b15457"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:09:47.568750 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-904e2efe-1309-4093-8f17-f461324c9ea6 req-eb96b04c-fd34-4b5b-a3e8-820cafc96cde service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:47.569227 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-904e2efe-1309-4093-8f17-f461324c9ea6 req-eb96b04c-fd34-4b5b-a3e8-820cafc96cde service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:47.569660 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-904e2efe-1309-4093-8f17-f461324c9ea6 req-eb96b04c-fd34-4b5b-a3e8-820cafc96cde service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:47.581260 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-904e2efe-1309-4093-8f17-f461324c9ea6 req-eb96b04c-fd34-4b5b-a3e8-820cafc96cde service nova] Creating event network-changed:950c66db-3499-4d9b-8778-8a8d57b15457 for instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 on n-h2-master-1 Aug 07 02:09:47.586722 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [req-904e2efe-1309-4093-8f17-f461324c9ea6 req-eb96b04c-fd34-4b5b-a3e8-820cafc96cde service nova] Instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 02:09:47.597625 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-904e2efe-1309-4093-8f17-f461324c9ea6 req-eb96b04c-fd34-4b5b-a3e8-820cafc96cde service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043169 Aug 07 02:09:47.598229 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3185/6834] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 02:09:47.720476 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-33d5af1d-8c96-4dbb-a826-0fdaa96afd0e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:09:47.728152 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-33d5af1d-8c96-4dbb-a826-0fdaa96afd0e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 200 len: 1682 microversion: 2.1 time: 0.204201 Aug 07 02:09:47.728727 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3650/6835] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:09:47 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 1682 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:09:48.751691 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d4a71bb1-de82-4efb-9bd3-74791f318a14 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:09:48.752414 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d4a71bb1-de82-4efb-9bd3-74791f318a14 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:09:48.758540 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d4a71bb1-de82-4efb-9bd3-74791f318a14 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:48.759019 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d4a71bb1-de82-4efb-9bd3-74791f318a14 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:48.759450 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d4a71bb1-de82-4efb-9bd3-74791f318a14 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:48.760166 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d4a71bb1-de82-4efb-9bd3-74791f318a14 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:48.760616 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d4a71bb1-de82-4efb-9bd3-74791f318a14 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:48.761036 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d4a71bb1-de82-4efb-9bd3-74791f318a14 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:48.898123 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d4a71bb1-de82-4efb-9bd3-74791f318a14 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:09:48.905724 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d4a71bb1-de82-4efb-9bd3-74791f318a14 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 200 len: 1679 microversion: 2.1 time: 0.159189 Aug 07 02:09:48.906302 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3186/6836] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:09:48 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:09:48.926348 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f335644a-45dc-4e1e-90fc-f6c3baf1d1fe tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:09:48.926899 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f335644a-45dc-4e1e-90fc-f6c3baf1d1fe tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:09:48.934382 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f335644a-45dc-4e1e-90fc-f6c3baf1d1fe tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:48.934884 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f335644a-45dc-4e1e-90fc-f6c3baf1d1fe tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:48.935334 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f335644a-45dc-4e1e-90fc-f6c3baf1d1fe tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:48.936085 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f335644a-45dc-4e1e-90fc-f6c3baf1d1fe tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:48.936557 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f335644a-45dc-4e1e-90fc-f6c3baf1d1fe tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:48.936998 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f335644a-45dc-4e1e-90fc-f6c3baf1d1fe tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:48.973367 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f335644a-45dc-4e1e-90fc-f6c3baf1d1fe tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:48.973858 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f335644a-45dc-4e1e-90fc-f6c3baf1d1fe tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:48.974310 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f335644a-45dc-4e1e-90fc-f6c3baf1d1fe tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:48.975081 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f335644a-45dc-4e1e-90fc-f6c3baf1d1fe tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:48.975548 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f335644a-45dc-4e1e-90fc-f6c3baf1d1fe tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:48.976024 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f335644a-45dc-4e1e-90fc-f6c3baf1d1fe tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:48.997404 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-f335644a-45dc-4e1e-90fc-f6c3baf1d1fe tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Getting quotas for project 435945eeab2f42d386f48f7374bbd488. Resources: {'ram', 'cores'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:09:49.002729 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-f335644a-45dc-4e1e-90fc-f6c3baf1d1fe tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Getting quotas for user 09cb536a0a584f5f96bec5fca7afa3b4 and project 435945eeab2f42d386f48f7374bbd488. Resources: {'ram', 'cores'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:09:49.108677 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f335644a-45dc-4e1e-90fc-f6c3baf1d1fe tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "POST /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09/action" status: 202 len: 0 microversion: 2.1 time: 0.185989 Aug 07 02:09:49.109320 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3651/6837] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:09:48 2022] POST /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:09:49.118498 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b11054d3-2bbc-4882-8989-b75c407c4206 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:09:49.119493 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b11054d3-2bbc-4882-8989-b75c407c4206 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:09:49.126967 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b11054d3-2bbc-4882-8989-b75c407c4206 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:49.127498 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b11054d3-2bbc-4882-8989-b75c407c4206 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:49.128362 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b11054d3-2bbc-4882-8989-b75c407c4206 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:49.129615 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b11054d3-2bbc-4882-8989-b75c407c4206 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:49.130345 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b11054d3-2bbc-4882-8989-b75c407c4206 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:49.131453 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b11054d3-2bbc-4882-8989-b75c407c4206 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:49.269690 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b11054d3-2bbc-4882-8989-b75c407c4206 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:09:49.277816 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b11054d3-2bbc-4882-8989-b75c407c4206 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 200 len: 1678 microversion: 2.1 time: 0.163801 Aug 07 02:09:49.278392 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3187/6838] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:09:49 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:09:50.300512 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a8adc43c-0ca4-4b05-b266-0505a46622d9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:09:50.301175 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a8adc43c-0ca4-4b05-b266-0505a46622d9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:09:50.307317 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8adc43c-0ca4-4b05-b266-0505a46622d9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:50.307801 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8adc43c-0ca4-4b05-b266-0505a46622d9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:50.308277 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8adc43c-0ca4-4b05-b266-0505a46622d9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:50.309495 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8adc43c-0ca4-4b05-b266-0505a46622d9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:50.309961 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8adc43c-0ca4-4b05-b266-0505a46622d9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:50.310399 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a8adc43c-0ca4-4b05-b266-0505a46622d9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:50.738652 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-2d80d2e0-556d-429f-ab3d-66d5e6a6ad17 req-7c1bd33f-83cf-47ac-9728-34f7fba9239c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5ef4713-8e0d-4bc3-80e3-0d040f248c09", "name": "network-vif-plugged", "status": "completed", "tag": "950c66db-3499-4d9b-8778-8a8d57b15457"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:09:50.750217 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-2d80d2e0-556d-429f-ab3d-66d5e6a6ad17 req-7c1bd33f-83cf-47ac-9728-34f7fba9239c service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:50.750708 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-2d80d2e0-556d-429f-ab3d-66d5e6a6ad17 req-7c1bd33f-83cf-47ac-9728-34f7fba9239c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:50.751212 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-2d80d2e0-556d-429f-ab3d-66d5e6a6ad17 req-7c1bd33f-83cf-47ac-9728-34f7fba9239c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:50.751923 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a8adc43c-0ca4-4b05-b266-0505a46622d9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:09:50.759950 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a8adc43c-0ca4-4b05-b266-0505a46622d9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 200 len: 1678 microversion: 2.1 time: 0.464620 Aug 07 02:09:50.774544 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3652/6839] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:09:50 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 1678 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:09:50.774717 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-2d80d2e0-556d-429f-ab3d-66d5e6a6ad17 req-7c1bd33f-83cf-47ac-9728-34f7fba9239c service nova] Creating event network-vif-plugged:950c66db-3499-4d9b-8778-8a8d57b15457 for instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 on n-h2-master-1 Aug 07 02:09:50.774717 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [req-2d80d2e0-556d-429f-ab3d-66d5e6a6ad17 req-7c1bd33f-83cf-47ac-9728-34f7fba9239c service nova] Instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 02:09:50.781068 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-2d80d2e0-556d-429f-ab3d-66d5e6a6ad17 req-7c1bd33f-83cf-47ac-9728-34f7fba9239c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046452 Aug 07 02:09:50.781683 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3188/6840] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 02:09:51.782492 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c0a81aa1-4010-4c1e-a1ea-7c23e8d8601a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:09:51.783125 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c0a81aa1-4010-4c1e-a1ea-7c23e8d8601a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:09:51.789973 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c0a81aa1-4010-4c1e-a1ea-7c23e8d8601a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:51.790472 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c0a81aa1-4010-4c1e-a1ea-7c23e8d8601a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:51.790926 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c0a81aa1-4010-4c1e-a1ea-7c23e8d8601a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:51.791634 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c0a81aa1-4010-4c1e-a1ea-7c23e8d8601a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:51.792132 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c0a81aa1-4010-4c1e-a1ea-7c23e8d8601a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:51.792575 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c0a81aa1-4010-4c1e-a1ea-7c23e8d8601a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:51.929334 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c0a81aa1-4010-4c1e-a1ea-7c23e8d8601a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:09:51.937198 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c0a81aa1-4010-4c1e-a1ea-7c23e8d8601a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 200 len: 1678 microversion: 2.1 time: 0.159058 Aug 07 02:09:51.937779 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3653/6841] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:09:51 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:09:52.259729 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-c9c9b86b-11ad-430b-b24a-65de287ccca7 req-9489f523-359f-4660-8d15-fd2405eb1ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5ef4713-8e0d-4bc3-80e3-0d040f248c09", "name": "network-vif-unplugged", "status": "completed", "tag": "950c66db-3499-4d9b-8778-8a8d57b15457"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:09:52.271116 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c9c9b86b-11ad-430b-b24a-65de287ccca7 req-9489f523-359f-4660-8d15-fd2405eb1ba2 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:52.271504 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c9c9b86b-11ad-430b-b24a-65de287ccca7 req-9489f523-359f-4660-8d15-fd2405eb1ba2 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:52.271957 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c9c9b86b-11ad-430b-b24a-65de287ccca7 req-9489f523-359f-4660-8d15-fd2405eb1ba2 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:52.284214 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-c9c9b86b-11ad-430b-b24a-65de287ccca7 req-9489f523-359f-4660-8d15-fd2405eb1ba2 service nova] Creating event network-vif-unplugged:950c66db-3499-4d9b-8778-8a8d57b15457 for instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 on n-h1-master-1 Aug 07 02:09:52.289754 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [req-c9c9b86b-11ad-430b-b24a-65de287ccca7 req-9489f523-359f-4660-8d15-fd2405eb1ba2 service nova] Instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 02:09:52.301413 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-c9c9b86b-11ad-430b-b24a-65de287ccca7 req-9489f523-359f-4660-8d15-fd2405eb1ba2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045751 Aug 07 02:09:52.302690 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3189/6842] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:09:52.958595 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0a68d737-a6b5-4344-a714-effc4502cff0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:09:52.959233 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0a68d737-a6b5-4344-a714-effc4502cff0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:09:52.966154 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a68d737-a6b5-4344-a714-effc4502cff0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:52.966663 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a68d737-a6b5-4344-a714-effc4502cff0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:52.967115 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a68d737-a6b5-4344-a714-effc4502cff0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:52.967849 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a68d737-a6b5-4344-a714-effc4502cff0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:52.968351 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a68d737-a6b5-4344-a714-effc4502cff0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:52.968801 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0a68d737-a6b5-4344-a714-effc4502cff0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:52.987875 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:09:53.107944 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0a68d737-a6b5-4344-a714-effc4502cff0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:09:53.115537 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0a68d737-a6b5-4344-a714-effc4502cff0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 200 len: 1678 microversion: 2.1 time: 0.160833 Aug 07 02:09:53.116143 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3654/6843] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:09:52 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:09:54.138203 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5e64f740-ab6f-4f6e-8f92-9864df450bfd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:09:54.139400 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5e64f740-ab6f-4f6e-8f92-9864df450bfd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:09:54.146765 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e64f740-ab6f-4f6e-8f92-9864df450bfd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:54.147246 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e64f740-ab6f-4f6e-8f92-9864df450bfd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:54.147685 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e64f740-ab6f-4f6e-8f92-9864df450bfd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:54.148409 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e64f740-ab6f-4f6e-8f92-9864df450bfd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:54.148866 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e64f740-ab6f-4f6e-8f92-9864df450bfd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:54.149295 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5e64f740-ab6f-4f6e-8f92-9864df450bfd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:54.280749 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5e64f740-ab6f-4f6e-8f92-9864df450bfd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:09:54.288260 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5e64f740-ab6f-4f6e-8f92-9864df450bfd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 200 len: 1678 microversion: 2.1 time: 0.154264 Aug 07 02:09:54.288845 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3190/6844] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:09:54 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:09:54.337563 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-e58e9849-ff75-4164-909f-77f1be4fd463 req-3e582c49-0ceb-4115-9633-8c0636764906 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5ef4713-8e0d-4bc3-80e3-0d040f248c09", "tag": "950c66db-3499-4d9b-8778-8a8d57b15457"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:09:54.348327 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e58e9849-ff75-4164-909f-77f1be4fd463 req-3e582c49-0ceb-4115-9633-8c0636764906 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:54.349087 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e58e9849-ff75-4164-909f-77f1be4fd463 req-3e582c49-0ceb-4115-9633-8c0636764906 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:54.349541 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e58e9849-ff75-4164-909f-77f1be4fd463 req-3e582c49-0ceb-4115-9633-8c0636764906 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:54.363747 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-e58e9849-ff75-4164-909f-77f1be4fd463 req-3e582c49-0ceb-4115-9633-8c0636764906 service nova] Creating event network-changed:950c66db-3499-4d9b-8778-8a8d57b15457 for instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 on n-h1-master-1 Aug 07 02:09:54.369049 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [req-e58e9849-ff75-4164-909f-77f1be4fd463 req-3e582c49-0ceb-4115-9633-8c0636764906 service nova] Instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 02:09:54.380022 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-e58e9849-ff75-4164-909f-77f1be4fd463 req-3e582c49-0ceb-4115-9633-8c0636764906 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046024 Aug 07 02:09:54.380618 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3655/6845] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:09:55.308654 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-81196cca-3542-43a4-86f6-90b95f4923db tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:09:55.309268 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-81196cca-3542-43a4-86f6-90b95f4923db tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:09:55.316585 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-81196cca-3542-43a4-86f6-90b95f4923db tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:55.317074 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-81196cca-3542-43a4-86f6-90b95f4923db tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:55.317514 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-81196cca-3542-43a4-86f6-90b95f4923db tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:55.318211 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-81196cca-3542-43a4-86f6-90b95f4923db tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:55.318672 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-81196cca-3542-43a4-86f6-90b95f4923db tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:55.319101 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-81196cca-3542-43a4-86f6-90b95f4923db tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:55.449788 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-81196cca-3542-43a4-86f6-90b95f4923db tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:09:55.458189 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-81196cca-3542-43a4-86f6-90b95f4923db tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 200 len: 1671 microversion: 2.1 time: 0.153398 Aug 07 02:09:55.458760 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3191/6846] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:09:55 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:09:55.478985 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c470a255-ce11-4807-9621-6de39a3def53 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:09:55.480334 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c470a255-ce11-4807-9621-6de39a3def53 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:09:55.487235 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c470a255-ce11-4807-9621-6de39a3def53 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:55.487730 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c470a255-ce11-4807-9621-6de39a3def53 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:55.488208 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c470a255-ce11-4807-9621-6de39a3def53 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:55.488923 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c470a255-ce11-4807-9621-6de39a3def53 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:55.489392 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c470a255-ce11-4807-9621-6de39a3def53 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:55.489832 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c470a255-ce11-4807-9621-6de39a3def53 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:55.621585 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c470a255-ce11-4807-9621-6de39a3def53 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:09:55.630267 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c470a255-ce11-4807-9621-6de39a3def53 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 200 len: 1671 microversion: 2.1 time: 0.155540 Aug 07 02:09:55.630907 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3656/6847] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:09:55 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:09:55.650936 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ee99ea6d-1c0c-4896-897e-302ecce77b68 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:09:55.651534 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ee99ea6d-1c0c-4896-897e-302ecce77b68 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:09:55.657542 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee99ea6d-1c0c-4896-897e-302ecce77b68 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:55.658030 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee99ea6d-1c0c-4896-897e-302ecce77b68 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:55.658473 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee99ea6d-1c0c-4896-897e-302ecce77b68 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:55.659174 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee99ea6d-1c0c-4896-897e-302ecce77b68 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:55.659629 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee99ea6d-1c0c-4896-897e-302ecce77b68 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:55.660090 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ee99ea6d-1c0c-4896-897e-302ecce77b68 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:55.793689 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ee99ea6d-1c0c-4896-897e-302ecce77b68 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:09:55.801798 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ee99ea6d-1c0c-4896-897e-302ecce77b68 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 200 len: 1671 microversion: 2.1 time: 0.154939 Aug 07 02:09:55.802554 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3192/6848] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:09:55 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:09:55.822324 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7691acbb-c5c0-4b33-963c-fc416c840eb9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:09:55.822757 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7691acbb-c5c0-4b33-963c-fc416c840eb9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:09:55.828731 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7691acbb-c5c0-4b33-963c-fc416c840eb9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:55.829227 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7691acbb-c5c0-4b33-963c-fc416c840eb9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:55.829684 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7691acbb-c5c0-4b33-963c-fc416c840eb9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:55.830397 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7691acbb-c5c0-4b33-963c-fc416c840eb9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:55.830872 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7691acbb-c5c0-4b33-963c-fc416c840eb9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:55.831318 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7691acbb-c5c0-4b33-963c-fc416c840eb9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:55.855458 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7691acbb-c5c0-4b33-963c-fc416c840eb9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 02:09:55.938350 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7691acbb-c5c0-4b33-963c-fc416c840eb9 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 204 len: 0 microversion: 2.1 time: 0.119730 Aug 07 02:09:55.940440 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3657/6849] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 02:09:55 2022] DELETE /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 02:09:55.948668 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-74dab470-5aaf-4c54-8b61-ac490cd81504 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:09:55.949417 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-74dab470-5aaf-4c54-8b61-ac490cd81504 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:09:55.955519 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-74dab470-5aaf-4c54-8b61-ac490cd81504 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:55.956045 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-74dab470-5aaf-4c54-8b61-ac490cd81504 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:55.956486 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-74dab470-5aaf-4c54-8b61-ac490cd81504 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:55.957187 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-74dab470-5aaf-4c54-8b61-ac490cd81504 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:55.957655 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-74dab470-5aaf-4c54-8b61-ac490cd81504 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:55.958083 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-74dab470-5aaf-4c54-8b61-ac490cd81504 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:56.089936 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-74dab470-5aaf-4c54-8b61-ac490cd81504 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:09:56.097988 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-74dab470-5aaf-4c54-8b61-ac490cd81504 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 200 len: 1677 microversion: 2.1 time: 0.153321 Aug 07 02:09:56.098554 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3193/6850] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:09:55 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:09:57.119747 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1ac2522b-028e-49b4-8da0-6f91e3e043d5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:09:57.120487 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1ac2522b-028e-49b4-8da0-6f91e3e043d5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:09:57.127866 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ac2522b-028e-49b4-8da0-6f91e3e043d5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:57.128394 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ac2522b-028e-49b4-8da0-6f91e3e043d5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:57.128843 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ac2522b-028e-49b4-8da0-6f91e3e043d5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:57.129550 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ac2522b-028e-49b4-8da0-6f91e3e043d5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:57.130023 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ac2522b-028e-49b4-8da0-6f91e3e043d5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:57.130462 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1ac2522b-028e-49b4-8da0-6f91e3e043d5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:57.258974 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1ac2522b-028e-49b4-8da0-6f91e3e043d5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:09:57.266467 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1ac2522b-028e-49b4-8da0-6f91e3e043d5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 200 len: 1677 microversion: 2.1 time: 0.150950 Aug 07 02:09:57.267037 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3658/6851] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:09:57 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:09:57.723748 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-f58589f8-9602-49ba-9463-6cdaa501bd1d req-a831ffd9-bfb6-42c6-9a06-e05b6770db4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5ef4713-8e0d-4bc3-80e3-0d040f248c09", "name": "network-vif-plugged", "status": "completed", "tag": "950c66db-3499-4d9b-8778-8a8d57b15457"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:09:57.737437 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f58589f8-9602-49ba-9463-6cdaa501bd1d req-a831ffd9-bfb6-42c6-9a06-e05b6770db4e service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:57.738035 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f58589f8-9602-49ba-9463-6cdaa501bd1d req-a831ffd9-bfb6-42c6-9a06-e05b6770db4e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:57.738721 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f58589f8-9602-49ba-9463-6cdaa501bd1d req-a831ffd9-bfb6-42c6-9a06-e05b6770db4e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:57.750775 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-f58589f8-9602-49ba-9463-6cdaa501bd1d req-a831ffd9-bfb6-42c6-9a06-e05b6770db4e service nova] Creating event network-vif-plugged:950c66db-3499-4d9b-8778-8a8d57b15457 for instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 on n-h1-master-1 Aug 07 02:09:57.756157 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-f58589f8-9602-49ba-9463-6cdaa501bd1d req-a831ffd9-bfb6-42c6-9a06-e05b6770db4e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036167 Aug 07 02:09:57.757005 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3194/6852] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 02:09:58.288214 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ae91f0fe-f890-4a31-819a-b6db554dc415 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:09:58.288887 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ae91f0fe-f890-4a31-819a-b6db554dc415 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:09:58.296097 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ae91f0fe-f890-4a31-819a-b6db554dc415 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:58.296603 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ae91f0fe-f890-4a31-819a-b6db554dc415 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:58.297052 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ae91f0fe-f890-4a31-819a-b6db554dc415 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:58.297779 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ae91f0fe-f890-4a31-819a-b6db554dc415 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:58.298248 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ae91f0fe-f890-4a31-819a-b6db554dc415 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:58.298694 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ae91f0fe-f890-4a31-819a-b6db554dc415 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:58.371003 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ae91f0fe-f890-4a31-819a-b6db554dc415 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:09:58.379873 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ae91f0fe-f890-4a31-819a-b6db554dc415 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 200 len: 1609 microversion: 2.1 time: 0.095617 Aug 07 02:09:58.380474 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3659/6853] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:09:58 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 1609 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:09:58.525788 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-d66aa4ac-46e9-4b42-895d-e5ffbe7e9c36 req-7cdcaafb-3b9d-4d86-bfb4-871567f6f3b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5ef4713-8e0d-4bc3-80e3-0d040f248c09", "name": "network-vif-deleted", "tag": "950c66db-3499-4d9b-8778-8a8d57b15457"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:09:58.549070 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d66aa4ac-46e9-4b42-895d-e5ffbe7e9c36 req-7cdcaafb-3b9d-4d86-bfb4-871567f6f3b8 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:58.549701 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d66aa4ac-46e9-4b42-895d-e5ffbe7e9c36 req-7cdcaafb-3b9d-4d86-bfb4-871567f6f3b8 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:58.550301 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d66aa4ac-46e9-4b42-895d-e5ffbe7e9c36 req-7cdcaafb-3b9d-4d86-bfb4-871567f6f3b8 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:58.555857 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=100 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:09:58.564543 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-d66aa4ac-46e9-4b42-895d-e5ffbe7e9c36 req-7cdcaafb-3b9d-4d86-bfb4-871567f6f3b8 service nova] Creating event network-vif-deleted:950c66db-3499-4d9b-8778-8a8d57b15457 for instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 on n-h1-master-1 Aug 07 02:09:58.570197 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-d66aa4ac-46e9-4b42-895d-e5ffbe7e9c36 req-7cdcaafb-3b9d-4d86-bfb4-871567f6f3b8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048910 Aug 07 02:09:58.571428 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3195/6854] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:09:59.402340 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1c028a45-8dcb-4cdd-81b2-a5f44bd3ae6f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:09:59.402956 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1c028a45-8dcb-4cdd-81b2-a5f44bd3ae6f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:09:59.405249 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:09:59.411667 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c028a45-8dcb-4cdd-81b2-a5f44bd3ae6f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:59.412431 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c028a45-8dcb-4cdd-81b2-a5f44bd3ae6f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:59.412885 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c028a45-8dcb-4cdd-81b2-a5f44bd3ae6f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:59.413613 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c028a45-8dcb-4cdd-81b2-a5f44bd3ae6f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:59.414086 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c028a45-8dcb-4cdd-81b2-a5f44bd3ae6f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:59.414566 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c028a45-8dcb-4cdd-81b2-a5f44bd3ae6f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:59.429325 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-1c028a45-8dcb-4cdd-81b2-a5f44bd3ae6f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] HTTP exception thrown: Instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 could not be found. Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1c028a45-8dcb-4cdd-81b2-a5f44bd3ae6f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Request method failure captured: Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 HTTP/1.1 Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7x4hybynvxArQPeqt6CwV9Zs1N98xbn7O53qD-I8GCKutNl3jQRH4SvGrtWmYp2NG3dElrq0t1Ij5yq_G1gf33oIjYTVPSXt-tZSpufSbtrWCtdgSWSFbRz6TTImh-9pnxWIZSiSH_u6yWkLly4eko2V8UgCYC1x-j0UNpE9qntkRl0 Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 435945eeab2f42d386f48f7374bbd488 Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_435945eeab2f42d386f48f7374bbd488", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 435945eeab2f42d386f48f7374bbd488 Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServerActionsTestJSON-1683144832-project Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 09cb536a0a584f5f96bec5fca7afa3b4 Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServerActionsTestJSON-1683144832-project Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: exception: Instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 could not be found. Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'a5ef4713-8e0d-4bc3-80e3-0d040f248c09'} Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 could not be found. Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 could not be found. Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:09:59.431053 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:09:59.435635 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:09:59.435635 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:09:59.435635 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:09:59.435635 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:09:59.435635 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:09:59.435635 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 could not be found. Aug 07 02:09:59.435635 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:09:59.435635 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1c028a45-8dcb-4cdd-81b2-a5f44bd3ae6f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Returning 404 to user: Instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:09:59.435635 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1c028a45-8dcb-4cdd-81b2-a5f44bd3ae6f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 404 len: 111 microversion: 2.1 time: 0.034439 Aug 07 02:09:59.435635 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3660/6855] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:09:59 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:09:59.449432 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ac0730e6-f2c8-41fb-8d70-340d153a8b78 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:09:59.450142 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ac0730e6-f2c8-41fb-8d70-340d153a8b78 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:09:59.457053 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ac0730e6-f2c8-41fb-8d70-340d153a8b78 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:59.457530 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ac0730e6-f2c8-41fb-8d70-340d153a8b78 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:59.457960 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ac0730e6-f2c8-41fb-8d70-340d153a8b78 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:59.458654 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ac0730e6-f2c8-41fb-8d70-340d153a8b78 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:09:59.459109 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ac0730e6-f2c8-41fb-8d70-340d153a8b78 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:09:59.459530 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ac0730e6-f2c8-41fb-8d70-340d153a8b78 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:09:59.472684 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-ac0730e6-f2c8-41fb-8d70-340d153a8b78 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] HTTP exception thrown: Instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 could not be found. Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ac0730e6-f2c8-41fb-8d70-340d153a8b78 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Request method failure captured: Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 HTTP/1.1 Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7x4hybynvxArQPeqt6CwV9Zs1N98xbn7O53qD-I8GCKutNl3jQRH4SvGrtWmYp2NG3dElrq0t1Ij5yq_G1gf33oIjYTVPSXt-tZSpufSbtrWCtdgSWSFbRz6TTImh-9pnxWIZSiSH_u6yWkLly4eko2V8UgCYC1x-j0UNpE9qntkRl0 Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 435945eeab2f42d386f48f7374bbd488 Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_435945eeab2f42d386f48f7374bbd488", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 435945eeab2f42d386f48f7374bbd488 Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServerActionsTestJSON-1683144832-project Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 09cb536a0a584f5f96bec5fca7afa3b4 Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServerActionsTestJSON-1683144832-project Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: exception: Instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 could not be found. Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'a5ef4713-8e0d-4bc3-80e3-0d040f248c09'} Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 could not be found. Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 could not be found. Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:09:59.474313 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:09:59.478027 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:09:59.478027 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:09:59.478027 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:09:59.478027 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:09:59.478027 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:09:59.478027 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 could not be found. Aug 07 02:09:59.478027 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:09:59.478027 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ac0730e6-f2c8-41fb-8d70-340d153a8b78 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Returning 404 to user: Instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:09:59.478027 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ac0730e6-f2c8-41fb-8d70-340d153a8b78 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 404 len: 111 microversion: 2.1 time: 0.030443 Aug 07 02:09:59.479241 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3196/6856] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:09:59 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:09:59.526008 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7816d20c-6f8e-4a06-81c5-1c2d132b138b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1593431647", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "da7de2ad-cced-4f5b-81a4-2f9d332f427b"}], "security_groups": [{"name": "tempest-securitygroup--1850202519"}], "key_name": "tempest-keypair-1891336762", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:09:59.631464 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-7816d20c-6f8e-4a06-81c5-1c2d132b138b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] validate_networks() for [('da7de2ad-cced-4f5b-81a4-2f9d332f427b', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 02:10:00.099075 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-7816d20c-6f8e-4a06-81c5-1c2d132b138b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 02:10:00.099518 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-7816d20c-6f8e-4a06-81c5-1c2d132b138b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 02:10:00.100054 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-7816d20c-6f8e-4a06-81c5-1c2d132b138b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 02:10:00.100480 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-7816d20c-6f8e-4a06-81c5-1c2d132b138b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 02:10:00.100908 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-7816d20c-6f8e-4a06-81c5-1c2d132b138b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 02:10:00.109969 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7816d20c-6f8e-4a06-81c5-1c2d132b138b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:10:00.110464 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7816d20c-6f8e-4a06-81c5-1c2d132b138b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:10:00.110917 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7816d20c-6f8e-4a06-81c5-1c2d132b138b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:10:00.111694 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7816d20c-6f8e-4a06-81c5-1c2d132b138b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:10:00.112191 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7816d20c-6f8e-4a06-81c5-1c2d132b138b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:10:00.112632 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7816d20c-6f8e-4a06-81c5-1c2d132b138b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:10:00.129246 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-7816d20c-6f8e-4a06-81c5-1c2d132b138b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Getting quotas for project 435945eeab2f42d386f48f7374bbd488. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:10:00.134483 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-7816d20c-6f8e-4a06-81c5-1c2d132b138b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Getting quotas for user 09cb536a0a584f5f96bec5fca7afa3b4 and project 435945eeab2f42d386f48f7374bbd488. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:10:00.147487 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7816d20c-6f8e-4a06-81c5-1c2d132b138b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 02:10:00.149806 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7816d20c-6f8e-4a06-81c5-1c2d132b138b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 02:10:00.195422 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7816d20c-6f8e-4a06-81c5-1c2d132b138b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.673293 Aug 07 02:10:00.196089 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3661/6857] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 02:09:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 02:10:00.207257 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-17187354-8171-4afc-924e-3877f3fa752e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:10:00.208067 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-17187354-8171-4afc-924e-3877f3fa752e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:10:00.264260 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-17187354-8171-4afc-924e-3877f3fa752e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:10:00.271172 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-17187354-8171-4afc-924e-3877f3fa752e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1239 microversion: 2.1 time: 0.067554 Aug 07 02:10:00.272122 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3197/6858] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:10:00 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1239 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:10:01.294368 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-617a36d9-3f7b-495d-ba02-997f55e05c0a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:10:01.295580 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-617a36d9-3f7b-495d-ba02-997f55e05c0a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:10:01.298470 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:10:01.305026 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-617a36d9-3f7b-495d-ba02-997f55e05c0a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:10:01.305734 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-617a36d9-3f7b-495d-ba02-997f55e05c0a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:10:01.306646 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-617a36d9-3f7b-495d-ba02-997f55e05c0a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:10:01.307370 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-617a36d9-3f7b-495d-ba02-997f55e05c0a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:10:01.308028 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-617a36d9-3f7b-495d-ba02-997f55e05c0a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:10:01.308465 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-617a36d9-3f7b-495d-ba02-997f55e05c0a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:10:01.379998 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-617a36d9-3f7b-495d-ba02-997f55e05c0a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:10:01.387491 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-617a36d9-3f7b-495d-ba02-997f55e05c0a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1309 microversion: 2.1 time: 0.098282 Aug 07 02:10:01.388087 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3662/6859] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:10:01 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:10:02.411626 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6828cd13-a2af-4362-ba0e-fc7417d8286e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:10:02.412458 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6828cd13-a2af-4362-ba0e-fc7417d8286e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:10:02.415972 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=45 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:10:02.422371 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6828cd13-a2af-4362-ba0e-fc7417d8286e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:10:02.422866 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6828cd13-a2af-4362-ba0e-fc7417d8286e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:10:02.423309 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6828cd13-a2af-4362-ba0e-fc7417d8286e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:10:02.424253 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6828cd13-a2af-4362-ba0e-fc7417d8286e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:10:02.424716 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6828cd13-a2af-4362-ba0e-fc7417d8286e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:10:02.425152 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6828cd13-a2af-4362-ba0e-fc7417d8286e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:10:02.617340 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-8c7ef43a-0c0e-4b95-98c7-8cdeb17a7641 req-132caa7f-28d7-46b5-b713-a9d5ce4aa7bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a399f404-604c-431e-896d-edacded36702", "tag": "98b9f8fe-c5ed-4913-8c96-c307a6609495"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:10:02.619251 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6828cd13-a2af-4362-ba0e-fc7417d8286e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:10:02.629199 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6828cd13-a2af-4362-ba0e-fc7417d8286e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1365 microversion: 2.1 time: 0.222374 Aug 07 02:10:02.630438 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3198/6860] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:10:02 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:10:02.631975 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-8c7ef43a-0c0e-4b95-98c7-8cdeb17a7641 req-132caa7f-28d7-46b5-b713-a9d5ce4aa7bf service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:10:02.632640 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-8c7ef43a-0c0e-4b95-98c7-8cdeb17a7641 req-132caa7f-28d7-46b5-b713-a9d5ce4aa7bf service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:10:02.633249 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-8c7ef43a-0c0e-4b95-98c7-8cdeb17a7641 req-132caa7f-28d7-46b5-b713-a9d5ce4aa7bf service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:10:02.646741 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-8c7ef43a-0c0e-4b95-98c7-8cdeb17a7641 req-132caa7f-28d7-46b5-b713-a9d5ce4aa7bf service nova] Creating event network-changed:98b9f8fe-c5ed-4913-8c96-c307a6609495 for instance a399f404-604c-431e-896d-edacded36702 on n-h1-master-1 Aug 07 02:10:02.651698 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-8c7ef43a-0c0e-4b95-98c7-8cdeb17a7641 req-132caa7f-28d7-46b5-b713-a9d5ce4aa7bf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038478 Aug 07 02:10:02.652533 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3663/6861] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 02:10:03.651806 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-35f0594a-c8f0-4644-a16a-19a17d77c8b7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:10:03.652481 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-35f0594a-c8f0-4644-a16a-19a17d77c8b7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:10:03.659397 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-35f0594a-c8f0-4644-a16a-19a17d77c8b7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:10:03.659905 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-35f0594a-c8f0-4644-a16a-19a17d77c8b7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:10:03.660340 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-35f0594a-c8f0-4644-a16a-19a17d77c8b7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:10:03.661067 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-35f0594a-c8f0-4644-a16a-19a17d77c8b7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:10:03.661524 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-35f0594a-c8f0-4644-a16a-19a17d77c8b7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:10:03.661953 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-35f0594a-c8f0-4644-a16a-19a17d77c8b7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:10:03.793770 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-35f0594a-c8f0-4644-a16a-19a17d77c8b7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:10:03.801889 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-35f0594a-c8f0-4644-a16a-19a17d77c8b7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1365 microversion: 2.1 time: 0.153996 Aug 07 02:10:03.802458 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3199/6862] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:10:03 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:10:04.825514 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-01bc4b32-a73a-4f42-ba2e-2fb5eb01c05a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:10:04.826253 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-01bc4b32-a73a-4f42-ba2e-2fb5eb01c05a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:10:04.833213 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-01bc4b32-a73a-4f42-ba2e-2fb5eb01c05a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:10:04.833712 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-01bc4b32-a73a-4f42-ba2e-2fb5eb01c05a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:10:04.834161 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-01bc4b32-a73a-4f42-ba2e-2fb5eb01c05a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:10:04.834876 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-01bc4b32-a73a-4f42-ba2e-2fb5eb01c05a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:10:04.835344 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-01bc4b32-a73a-4f42-ba2e-2fb5eb01c05a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:10:04.835787 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-01bc4b32-a73a-4f42-ba2e-2fb5eb01c05a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:10:04.971525 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-01bc4b32-a73a-4f42-ba2e-2fb5eb01c05a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:10:04.979130 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-01bc4b32-a73a-4f42-ba2e-2fb5eb01c05a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1365 microversion: 2.1 time: 0.158742 Aug 07 02:10:04.979701 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3664/6863] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:10:04 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:10:06.001282 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9367cb79-b67d-4fbe-8476-357184140677 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:10:06.001906 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9367cb79-b67d-4fbe-8476-357184140677 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:10:06.008787 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9367cb79-b67d-4fbe-8476-357184140677 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:10:06.009273 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9367cb79-b67d-4fbe-8476-357184140677 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:10:06.009713 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9367cb79-b67d-4fbe-8476-357184140677 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:10:06.010415 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9367cb79-b67d-4fbe-8476-357184140677 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:10:06.010872 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9367cb79-b67d-4fbe-8476-357184140677 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:10:06.011307 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9367cb79-b67d-4fbe-8476-357184140677 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:10:06.140762 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9367cb79-b67d-4fbe-8476-357184140677 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:10:06.148506 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9367cb79-b67d-4fbe-8476-357184140677 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1365 microversion: 2.1 time: 0.151566 Aug 07 02:10:06.149083 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3200/6864] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:10:05 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:10:07.169112 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d6db477d-f753-4754-92b4-ab4d22c90d09 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:10:07.169746 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d6db477d-f753-4754-92b4-ab4d22c90d09 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:10:07.176682 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6db477d-f753-4754-92b4-ab4d22c90d09 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:10:07.177187 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6db477d-f753-4754-92b4-ab4d22c90d09 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:10:07.177642 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6db477d-f753-4754-92b4-ab4d22c90d09 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:10:07.178354 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6db477d-f753-4754-92b4-ab4d22c90d09 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:10:07.178826 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6db477d-f753-4754-92b4-ab4d22c90d09 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:10:07.179267 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d6db477d-f753-4754-92b4-ab4d22c90d09 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:10:07.306854 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d6db477d-f753-4754-92b4-ab4d22c90d09 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:10:07.314927 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d6db477d-f753-4754-92b4-ab4d22c90d09 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1365 microversion: 2.1 time: 0.149718 Aug 07 02:10:07.315525 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3665/6865] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:10:07 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:10:07.621311 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-8a538cb3-519e-4cae-817d-cfcee4e9aaba req-80c5802e-4bef-43e0-8600-7a3dcd167cb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a399f404-604c-431e-896d-edacded36702", "name": "network-vif-plugged", "status": "completed", "tag": "98b9f8fe-c5ed-4913-8c96-c307a6609495"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:10:07.631938 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-8a538cb3-519e-4cae-817d-cfcee4e9aaba req-80c5802e-4bef-43e0-8600-7a3dcd167cb2 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:10:07.632426 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-8a538cb3-519e-4cae-817d-cfcee4e9aaba req-80c5802e-4bef-43e0-8600-7a3dcd167cb2 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:10:07.632878 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-8a538cb3-519e-4cae-817d-cfcee4e9aaba req-80c5802e-4bef-43e0-8600-7a3dcd167cb2 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:10:07.648862 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-8a538cb3-519e-4cae-817d-cfcee4e9aaba req-80c5802e-4bef-43e0-8600-7a3dcd167cb2 service nova] Creating event network-vif-plugged:98b9f8fe-c5ed-4913-8c96-c307a6609495 for instance a399f404-604c-431e-896d-edacded36702 on n-h1-master-1 Aug 07 02:10:07.653842 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-8a538cb3-519e-4cae-817d-cfcee4e9aaba req-80c5802e-4bef-43e0-8600-7a3dcd167cb2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036416 Aug 07 02:10:07.654632 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3201/6866] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:10:08.336186 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9d23a577-09ea-4ae2-9ba3-bd33e54854f5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:10:08.336821 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9d23a577-09ea-4ae2-9ba3-bd33e54854f5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:10:08.343649 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d23a577-09ea-4ae2-9ba3-bd33e54854f5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:10:08.344184 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d23a577-09ea-4ae2-9ba3-bd33e54854f5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:10:08.344633 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d23a577-09ea-4ae2-9ba3-bd33e54854f5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:10:08.345338 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d23a577-09ea-4ae2-9ba3-bd33e54854f5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:10:08.345808 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d23a577-09ea-4ae2-9ba3-bd33e54854f5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:10:08.346249 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d23a577-09ea-4ae2-9ba3-bd33e54854f5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:10:08.473002 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9d23a577-09ea-4ae2-9ba3-bd33e54854f5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:10:08.480500 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9d23a577-09ea-4ae2-9ba3-bd33e54854f5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1365 microversion: 2.1 time: 0.148237 Aug 07 02:10:08.481067 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3666/6867] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:10:08 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:10:09.503956 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6519dd97-f982-4ac3-b751-381bb086e0cb tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:10:09.504656 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6519dd97-f982-4ac3-b751-381bb086e0cb tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:10:09.510827 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6519dd97-f982-4ac3-b751-381bb086e0cb tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:10:09.511305 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6519dd97-f982-4ac3-b751-381bb086e0cb tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:10:09.511743 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6519dd97-f982-4ac3-b751-381bb086e0cb tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:10:09.512457 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6519dd97-f982-4ac3-b751-381bb086e0cb tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:10:09.512914 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6519dd97-f982-4ac3-b751-381bb086e0cb tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:10:09.513339 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6519dd97-f982-4ac3-b751-381bb086e0cb tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:10:09.644775 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6519dd97-f982-4ac3-b751-381bb086e0cb tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:10:09.652644 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6519dd97-f982-4ac3-b751-381bb086e0cb tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1552 microversion: 2.1 time: 0.154415 Aug 07 02:10:09.653207 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3202/6868] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:10:09 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:10:09.674004 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b1390cd4-e607-4b5a-8e8f-643f20e6758c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:10:09.674515 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b1390cd4-e607-4b5a-8e8f-643f20e6758c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:10:09.681309 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b1390cd4-e607-4b5a-8e8f-643f20e6758c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:10:09.681799 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b1390cd4-e607-4b5a-8e8f-643f20e6758c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:10:09.682248 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b1390cd4-e607-4b5a-8e8f-643f20e6758c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:10:09.682953 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b1390cd4-e607-4b5a-8e8f-643f20e6758c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:10:09.683424 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b1390cd4-e607-4b5a-8e8f-643f20e6758c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:10:09.683860 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b1390cd4-e607-4b5a-8e8f-643f20e6758c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:10:09.763092 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b1390cd4-e607-4b5a-8e8f-643f20e6758c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092961 Aug 07 02:10:09.763705 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3667/6869] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Aug 7 02:10:09 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:10:10.687184 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-87ed9471-28b8-4db1-8138-fe5047935304 req-94a7a4ee-cf0f-4210-8b4b-5d690df48d9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a399f404-604c-431e-896d-edacded36702", "tag": "98b9f8fe-c5ed-4913-8c96-c307a6609495"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:10:10.692099 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:10:10.698878 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-87ed9471-28b8-4db1-8138-fe5047935304 req-94a7a4ee-cf0f-4210-8b4b-5d690df48d9c service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:10:10.699360 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-87ed9471-28b8-4db1-8138-fe5047935304 req-94a7a4ee-cf0f-4210-8b4b-5d690df48d9c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:10:10.699795 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-87ed9471-28b8-4db1-8138-fe5047935304 req-94a7a4ee-cf0f-4210-8b4b-5d690df48d9c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:10:10.711158 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-87ed9471-28b8-4db1-8138-fe5047935304 req-94a7a4ee-cf0f-4210-8b4b-5d690df48d9c service nova] Creating event network-changed:98b9f8fe-c5ed-4913-8c96-c307a6609495 for instance a399f404-604c-431e-896d-edacded36702 on n-h1-master-1 Aug 07 02:10:10.716356 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-87ed9471-28b8-4db1-8138-fe5047935304 req-94a7a4ee-cf0f-4210-8b4b-5d690df48d9c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032877 Aug 07 02:10:10.717411 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3203/6870] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:10:45.010082 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:10:45.010870 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:10:45.012883 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=11 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:10:45.013595 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:10:45.017535 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2a9f39e0-316b-4f96-bcb3-cdc7a79fddb5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:10:45.018114 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2a9f39e0-316b-4f96-bcb3-cdc7a79fddb5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:10:45.026304 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a9f39e0-316b-4f96-bcb3-cdc7a79fddb5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:10:45.026802 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a9f39e0-316b-4f96-bcb3-cdc7a79fddb5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:10:45.027251 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a9f39e0-316b-4f96-bcb3-cdc7a79fddb5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:10:45.028027 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a9f39e0-316b-4f96-bcb3-cdc7a79fddb5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:10:45.028497 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a9f39e0-316b-4f96-bcb3-cdc7a79fddb5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:10:45.029223 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a9f39e0-316b-4f96-bcb3-cdc7a79fddb5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:10:45.178263 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2a9f39e0-316b-4f96-bcb3-cdc7a79fddb5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:10:45.187322 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2a9f39e0-316b-4f96-bcb3-cdc7a79fddb5 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1671 microversion: 2.1 time: 0.178048 Aug 07 02:10:45.188556 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3668/6871] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:10:45 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1671 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:10:45.210880 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-eab22248-9cbd-445e-884f-37d77c7d7f43 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df7187cc-2000-4e7d-91e5-6626be9c9b71"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:10:45.213345 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-eab22248-9cbd-445e-884f-37d77c7d7f43 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:10:45.215430 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=11 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:10:45.216144 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=30 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:10:45.221172 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eab22248-9cbd-445e-884f-37d77c7d7f43 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:10:45.221726 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eab22248-9cbd-445e-884f-37d77c7d7f43 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:10:45.222247 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eab22248-9cbd-445e-884f-37d77c7d7f43 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:10:45.223032 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eab22248-9cbd-445e-884f-37d77c7d7f43 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:10:45.223521 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eab22248-9cbd-445e-884f-37d77c7d7f43 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:10:45.223980 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eab22248-9cbd-445e-884f-37d77c7d7f43 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:10:45.487408 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-eab22248-9cbd-445e-884f-37d77c7d7f43 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "POST /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281516 Aug 07 02:10:45.488299 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3204/6872] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Aug 7 02:10:45 2022] POST /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:10:56.180060 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1fd5cafe-c45e-43e0-8a7d-b3b179bc29a1 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:10:56.182372 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1fd5cafe-c45e-43e0-8a7d-b3b179bc29a1 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:10:56.185219 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:10:56.185884 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:10:56.191957 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1fd5cafe-c45e-43e0-8a7d-b3b179bc29a1 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:10:56.192457 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1fd5cafe-c45e-43e0-8a7d-b3b179bc29a1 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:10:56.192929 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1fd5cafe-c45e-43e0-8a7d-b3b179bc29a1 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:10:56.193670 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1fd5cafe-c45e-43e0-8a7d-b3b179bc29a1 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:10:56.194251 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1fd5cafe-c45e-43e0-8a7d-b3b179bc29a1 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:10:56.194696 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1fd5cafe-c45e-43e0-8a7d-b3b179bc29a1 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:10:56.225819 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1fd5cafe-c45e-43e0-8a7d-b3b179bc29a1 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:10:56.231401 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1fd5cafe-c45e-43e0-8a7d-b3b179bc29a1 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Old instance type m1.heat2, new instance type m1.heat {{(pid=119516) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 07 02:10:56.238027 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-1fd5cafe-c45e-43e0-8a7d-b3b179bc29a1 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 02:10:56.238404 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-1fd5cafe-c45e-43e0-8a7d-b3b179bc29a1 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 02:10:56.238894 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-1fd5cafe-c45e-43e0-8a7d-b3b179bc29a1 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 02:10:56.239324 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-1fd5cafe-c45e-43e0-8a7d-b3b179bc29a1 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 02:10:56.239754 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-1fd5cafe-c45e-43e0-8a7d-b3b179bc29a1 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 02:10:56.301714 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1fd5cafe-c45e-43e0-8a7d-b3b179bc29a1 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "POST /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702/action" status: 202 len: 0 microversion: 2.1 time: 0.125523 Aug 07 02:10:56.302324 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3669/6873] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:10:56 2022] POST /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:10:56.309130 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:10:56.310046 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:10:56.314408 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f55545e7-161e-43b9-8d14-ec8736a7de49 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:10:56.315136 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f55545e7-161e-43b9-8d14-ec8736a7de49 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:10:56.323115 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f55545e7-161e-43b9-8d14-ec8736a7de49 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:10:56.323600 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f55545e7-161e-43b9-8d14-ec8736a7de49 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:10:56.324063 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f55545e7-161e-43b9-8d14-ec8736a7de49 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:10:56.324763 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f55545e7-161e-43b9-8d14-ec8736a7de49 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:10:56.325217 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f55545e7-161e-43b9-8d14-ec8736a7de49 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:10:56.325632 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f55545e7-161e-43b9-8d14-ec8736a7de49 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:10:56.505971 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f55545e7-161e-43b9-8d14-ec8736a7de49 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:10:56.516057 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f55545e7-161e-43b9-8d14-ec8736a7de49 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1726 microversion: 2.1 time: 0.208384 Aug 07 02:10:56.516686 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3205/6874] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:10:56 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1726 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:10:57.545244 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a7991944-7532-4b80-8b57-6e2a0e0f9c53 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:10:57.545890 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a7991944-7532-4b80-8b57-6e2a0e0f9c53 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:10:57.551842 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7991944-7532-4b80-8b57-6e2a0e0f9c53 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:10:57.552364 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7991944-7532-4b80-8b57-6e2a0e0f9c53 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:10:57.552820 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7991944-7532-4b80-8b57-6e2a0e0f9c53 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:10:57.553526 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7991944-7532-4b80-8b57-6e2a0e0f9c53 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:10:57.553992 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7991944-7532-4b80-8b57-6e2a0e0f9c53 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:10:57.554431 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7991944-7532-4b80-8b57-6e2a0e0f9c53 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:10:57.683596 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a7991944-7532-4b80-8b57-6e2a0e0f9c53 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:10:57.691707 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a7991944-7532-4b80-8b57-6e2a0e0f9c53 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1726 microversion: 2.1 time: 0.151222 Aug 07 02:10:57.692313 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3670/6875] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:10:57 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:10:58.714411 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-404e4fac-966f-4f74-9f76-d07e30dd1b36 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:10:58.715027 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-404e4fac-966f-4f74-9f76-d07e30dd1b36 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:10:58.721777 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-404e4fac-966f-4f74-9f76-d07e30dd1b36 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:10:58.722260 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-404e4fac-966f-4f74-9f76-d07e30dd1b36 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:10:58.722697 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-404e4fac-966f-4f74-9f76-d07e30dd1b36 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:10:58.723386 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-404e4fac-966f-4f74-9f76-d07e30dd1b36 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:10:58.723838 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-404e4fac-966f-4f74-9f76-d07e30dd1b36 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:10:58.724287 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-404e4fac-966f-4f74-9f76-d07e30dd1b36 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:10:58.860746 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-404e4fac-966f-4f74-9f76-d07e30dd1b36 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:10:58.868909 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-404e4fac-966f-4f74-9f76-d07e30dd1b36 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1731 microversion: 2.1 time: 0.159003 Aug 07 02:10:58.869503 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3206/6876] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:10:58 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:10:59.890489 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c3ed2a89-17ef-4229-abf3-77415339b953 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:10:59.891117 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c3ed2a89-17ef-4229-abf3-77415339b953 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:10:59.898246 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3ed2a89-17ef-4229-abf3-77415339b953 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:10:59.898740 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3ed2a89-17ef-4229-abf3-77415339b953 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:10:59.899193 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3ed2a89-17ef-4229-abf3-77415339b953 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:10:59.899923 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3ed2a89-17ef-4229-abf3-77415339b953 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:10:59.900398 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3ed2a89-17ef-4229-abf3-77415339b953 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:10:59.900844 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3ed2a89-17ef-4229-abf3-77415339b953 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:00.034331 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c3ed2a89-17ef-4229-abf3-77415339b953 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:00.043031 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c3ed2a89-17ef-4229-abf3-77415339b953 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1731 microversion: 2.1 time: 0.156457 Aug 07 02:11:00.043614 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3671/6877] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:10:59 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:01.064332 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6944a196-574c-43e1-82f0-2809fb645157 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:01.065010 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6944a196-574c-43e1-82f0-2809fb645157 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:01.072570 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6944a196-574c-43e1-82f0-2809fb645157 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:01.073057 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6944a196-574c-43e1-82f0-2809fb645157 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:01.073500 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6944a196-574c-43e1-82f0-2809fb645157 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:01.074196 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6944a196-574c-43e1-82f0-2809fb645157 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:01.074652 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6944a196-574c-43e1-82f0-2809fb645157 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:01.075080 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6944a196-574c-43e1-82f0-2809fb645157 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:01.212145 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6944a196-574c-43e1-82f0-2809fb645157 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:01.220209 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6944a196-574c-43e1-82f0-2809fb645157 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1731 microversion: 2.1 time: 0.159709 Aug 07 02:11:01.220774 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3207/6878] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:01 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:02.241816 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7db51a17-56f4-4ff6-80ba-20902c59f1f2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:02.242357 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7db51a17-56f4-4ff6-80ba-20902c59f1f2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:02.249654 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7db51a17-56f4-4ff6-80ba-20902c59f1f2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:02.250151 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7db51a17-56f4-4ff6-80ba-20902c59f1f2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:02.250601 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7db51a17-56f4-4ff6-80ba-20902c59f1f2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:02.251311 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7db51a17-56f4-4ff6-80ba-20902c59f1f2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:02.251781 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7db51a17-56f4-4ff6-80ba-20902c59f1f2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:02.252246 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7db51a17-56f4-4ff6-80ba-20902c59f1f2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:02.388051 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7db51a17-56f4-4ff6-80ba-20902c59f1f2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:02.396207 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7db51a17-56f4-4ff6-80ba-20902c59f1f2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1731 microversion: 2.1 time: 0.158295 Aug 07 02:11:02.396785 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3672/6879] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:02 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:03.417645 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fa6c2b7e-a64a-46c7-83e8-539ceda95f1e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:03.418264 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fa6c2b7e-a64a-46c7-83e8-539ceda95f1e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:03.425048 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa6c2b7e-a64a-46c7-83e8-539ceda95f1e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:03.425535 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa6c2b7e-a64a-46c7-83e8-539ceda95f1e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:03.425974 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa6c2b7e-a64a-46c7-83e8-539ceda95f1e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:03.426674 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa6c2b7e-a64a-46c7-83e8-539ceda95f1e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:03.427131 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa6c2b7e-a64a-46c7-83e8-539ceda95f1e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:03.427562 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fa6c2b7e-a64a-46c7-83e8-539ceda95f1e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:03.554094 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fa6c2b7e-a64a-46c7-83e8-539ceda95f1e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:03.562274 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fa6c2b7e-a64a-46c7-83e8-539ceda95f1e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1731 microversion: 2.1 time: 0.148516 Aug 07 02:11:03.562856 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3208/6880] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:03 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:04.584367 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8db9cb1d-18b0-46ea-a5b5-df7c8ec0006b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:04.585001 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8db9cb1d-18b0-46ea-a5b5-df7c8ec0006b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:04.592402 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8db9cb1d-18b0-46ea-a5b5-df7c8ec0006b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:04.592897 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8db9cb1d-18b0-46ea-a5b5-df7c8ec0006b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:04.593346 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8db9cb1d-18b0-46ea-a5b5-df7c8ec0006b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:04.594051 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8db9cb1d-18b0-46ea-a5b5-df7c8ec0006b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:04.594519 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8db9cb1d-18b0-46ea-a5b5-df7c8ec0006b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:04.594957 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8db9cb1d-18b0-46ea-a5b5-df7c8ec0006b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:04.722281 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8db9cb1d-18b0-46ea-a5b5-df7c8ec0006b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:04.730863 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8db9cb1d-18b0-46ea-a5b5-df7c8ec0006b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1731 microversion: 2.1 time: 0.150358 Aug 07 02:11:04.731436 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3673/6881] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:04 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:05.751712 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c0c54c73-cf8b-4eeb-8f8a-77b3c3b846a3 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:05.752355 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c0c54c73-cf8b-4eeb-8f8a-77b3c3b846a3 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:05.759111 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c0c54c73-cf8b-4eeb-8f8a-77b3c3b846a3 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:05.759601 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c0c54c73-cf8b-4eeb-8f8a-77b3c3b846a3 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:05.760110 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c0c54c73-cf8b-4eeb-8f8a-77b3c3b846a3 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:05.760812 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c0c54c73-cf8b-4eeb-8f8a-77b3c3b846a3 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:05.761273 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c0c54c73-cf8b-4eeb-8f8a-77b3c3b846a3 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:05.761706 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c0c54c73-cf8b-4eeb-8f8a-77b3c3b846a3 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:05.908428 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c0c54c73-cf8b-4eeb-8f8a-77b3c3b846a3 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:05.916942 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c0c54c73-cf8b-4eeb-8f8a-77b3c3b846a3 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1731 microversion: 2.1 time: 0.168565 Aug 07 02:11:05.917509 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3209/6882] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:05 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:06.938562 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-24b05895-a534-4e71-8863-179da517c7cf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:06.939190 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-24b05895-a534-4e71-8863-179da517c7cf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:06.946048 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24b05895-a534-4e71-8863-179da517c7cf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:06.946543 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24b05895-a534-4e71-8863-179da517c7cf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:06.946988 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24b05895-a534-4e71-8863-179da517c7cf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:06.948365 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24b05895-a534-4e71-8863-179da517c7cf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:06.948832 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24b05895-a534-4e71-8863-179da517c7cf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:06.949269 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24b05895-a534-4e71-8863-179da517c7cf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:07.082551 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-24b05895-a534-4e71-8863-179da517c7cf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:07.090563 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-24b05895-a534-4e71-8863-179da517c7cf tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1731 microversion: 2.1 time: 0.155912 Aug 07 02:11:07.091125 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3674/6883] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:06 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:08.112250 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-681b74c4-c54e-43ce-b0f7-a163a297f9a8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:08.112900 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-681b74c4-c54e-43ce-b0f7-a163a297f9a8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:08.119740 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-681b74c4-c54e-43ce-b0f7-a163a297f9a8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:08.120263 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-681b74c4-c54e-43ce-b0f7-a163a297f9a8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:08.120701 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-681b74c4-c54e-43ce-b0f7-a163a297f9a8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:08.121394 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-681b74c4-c54e-43ce-b0f7-a163a297f9a8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:08.121851 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-681b74c4-c54e-43ce-b0f7-a163a297f9a8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:08.122288 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-681b74c4-c54e-43ce-b0f7-a163a297f9a8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:08.249520 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-681b74c4-c54e-43ce-b0f7-a163a297f9a8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:08.257498 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-681b74c4-c54e-43ce-b0f7-a163a297f9a8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1731 microversion: 2.1 time: 0.149079 Aug 07 02:11:08.258064 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3210/6884] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:08 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:09.279848 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8c272b43-cb99-42b8-a5be-6af5f91405ec tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:09.280416 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8c272b43-cb99-42b8-a5be-6af5f91405ec tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:09.287498 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8c272b43-cb99-42b8-a5be-6af5f91405ec tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:09.288035 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8c272b43-cb99-42b8-a5be-6af5f91405ec tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:09.288489 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8c272b43-cb99-42b8-a5be-6af5f91405ec tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:09.289200 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8c272b43-cb99-42b8-a5be-6af5f91405ec tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:09.289667 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8c272b43-cb99-42b8-a5be-6af5f91405ec tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:09.290109 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8c272b43-cb99-42b8-a5be-6af5f91405ec tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:09.422688 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8c272b43-cb99-42b8-a5be-6af5f91405ec tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:09.430703 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8c272b43-cb99-42b8-a5be-6af5f91405ec tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1731 microversion: 2.1 time: 0.155334 Aug 07 02:11:09.431275 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3675/6885] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:09 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:10.451707 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f96c1a8d-e60c-4a2a-abc5-e6079f8b8d15 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:10.452359 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f96c1a8d-e60c-4a2a-abc5-e6079f8b8d15 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:10.459693 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f96c1a8d-e60c-4a2a-abc5-e6079f8b8d15 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:10.460210 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f96c1a8d-e60c-4a2a-abc5-e6079f8b8d15 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:10.460645 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f96c1a8d-e60c-4a2a-abc5-e6079f8b8d15 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:10.461332 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f96c1a8d-e60c-4a2a-abc5-e6079f8b8d15 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:10.461784 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f96c1a8d-e60c-4a2a-abc5-e6079f8b8d15 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:10.462205 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f96c1a8d-e60c-4a2a-abc5-e6079f8b8d15 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:10.593722 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f96c1a8d-e60c-4a2a-abc5-e6079f8b8d15 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:10.601677 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f96c1a8d-e60c-4a2a-abc5-e6079f8b8d15 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1731 microversion: 2.1 time: 0.153790 Aug 07 02:11:10.602262 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3211/6886] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:10 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:11.623379 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0b9ba743-eb0d-46b1-8897-277dbd90b6fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:11.624034 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0b9ba743-eb0d-46b1-8897-277dbd90b6fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:11.630805 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b9ba743-eb0d-46b1-8897-277dbd90b6fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:11.631324 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b9ba743-eb0d-46b1-8897-277dbd90b6fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:11.631774 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b9ba743-eb0d-46b1-8897-277dbd90b6fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:11.632507 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b9ba743-eb0d-46b1-8897-277dbd90b6fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:11.632977 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b9ba743-eb0d-46b1-8897-277dbd90b6fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:11.633422 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b9ba743-eb0d-46b1-8897-277dbd90b6fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:11.765579 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0b9ba743-eb0d-46b1-8897-277dbd90b6fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:11.773621 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0b9ba743-eb0d-46b1-8897-277dbd90b6fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1731 microversion: 2.1 time: 0.154164 Aug 07 02:11:11.774189 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3676/6887] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:11 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:12.795551 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e31a15f8-a1f3-4656-abfb-4f8dce102d00 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:12.796193 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e31a15f8-a1f3-4656-abfb-4f8dce102d00 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:12.802668 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e31a15f8-a1f3-4656-abfb-4f8dce102d00 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:12.803128 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e31a15f8-a1f3-4656-abfb-4f8dce102d00 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:12.803561 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e31a15f8-a1f3-4656-abfb-4f8dce102d00 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:12.804273 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e31a15f8-a1f3-4656-abfb-4f8dce102d00 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:12.804725 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e31a15f8-a1f3-4656-abfb-4f8dce102d00 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:12.805149 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e31a15f8-a1f3-4656-abfb-4f8dce102d00 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:12.935220 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e31a15f8-a1f3-4656-abfb-4f8dce102d00 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:12.943198 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e31a15f8-a1f3-4656-abfb-4f8dce102d00 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1731 microversion: 2.1 time: 0.152151 Aug 07 02:11:12.943765 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3212/6888] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:12 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:13.964421 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c894371d-c5dc-4eef-b768-d1caf3ac7709 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:13.965057 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c894371d-c5dc-4eef-b768-d1caf3ac7709 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:13.971493 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c894371d-c5dc-4eef-b768-d1caf3ac7709 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:13.972084 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c894371d-c5dc-4eef-b768-d1caf3ac7709 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:13.972540 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c894371d-c5dc-4eef-b768-d1caf3ac7709 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:13.973250 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c894371d-c5dc-4eef-b768-d1caf3ac7709 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:13.973717 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c894371d-c5dc-4eef-b768-d1caf3ac7709 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:13.974156 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c894371d-c5dc-4eef-b768-d1caf3ac7709 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:14.103201 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c894371d-c5dc-4eef-b768-d1caf3ac7709 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:14.111739 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c894371d-c5dc-4eef-b768-d1caf3ac7709 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1731 microversion: 2.1 time: 0.151217 Aug 07 02:11:14.112347 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3677/6889] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:13 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:15.133764 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9e1e6e34-8968-448c-877e-4521277f5148 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:15.134395 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9e1e6e34-8968-448c-877e-4521277f5148 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:15.141706 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9e1e6e34-8968-448c-877e-4521277f5148 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:15.142183 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9e1e6e34-8968-448c-877e-4521277f5148 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:15.142614 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9e1e6e34-8968-448c-877e-4521277f5148 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:15.143300 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9e1e6e34-8968-448c-877e-4521277f5148 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:15.143745 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9e1e6e34-8968-448c-877e-4521277f5148 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:15.144190 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9e1e6e34-8968-448c-877e-4521277f5148 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:15.276292 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9e1e6e34-8968-448c-877e-4521277f5148 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:15.284541 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9e1e6e34-8968-448c-877e-4521277f5148 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1731 microversion: 2.1 time: 0.154722 Aug 07 02:11:15.285298 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3213/6890] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:15 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:16.306702 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-360fed10-bce6-45d5-8afa-76e71649e46d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:16.307339 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-360fed10-bce6-45d5-8afa-76e71649e46d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:16.315278 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-360fed10-bce6-45d5-8afa-76e71649e46d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:16.315783 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-360fed10-bce6-45d5-8afa-76e71649e46d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:16.316260 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-360fed10-bce6-45d5-8afa-76e71649e46d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:16.317097 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-360fed10-bce6-45d5-8afa-76e71649e46d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:16.317568 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-360fed10-bce6-45d5-8afa-76e71649e46d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:16.318006 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-360fed10-bce6-45d5-8afa-76e71649e46d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:16.489276 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-360fed10-bce6-45d5-8afa-76e71649e46d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:16.498327 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-360fed10-bce6-45d5-8afa-76e71649e46d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1731 microversion: 2.1 time: 0.196185 Aug 07 02:11:16.499104 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3678/6891] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:16 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1731 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:17.519773 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a5845681-d008-4a31-a1b7-bb740b0886cd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:17.520368 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a5845681-d008-4a31-a1b7-bb740b0886cd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:17.527244 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a5845681-d008-4a31-a1b7-bb740b0886cd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:17.527680 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a5845681-d008-4a31-a1b7-bb740b0886cd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:17.528142 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a5845681-d008-4a31-a1b7-bb740b0886cd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:17.528847 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a5845681-d008-4a31-a1b7-bb740b0886cd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:17.529310 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a5845681-d008-4a31-a1b7-bb740b0886cd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:17.529738 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a5845681-d008-4a31-a1b7-bb740b0886cd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:17.660989 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a5845681-d008-4a31-a1b7-bb740b0886cd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:17.669841 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a5845681-d008-4a31-a1b7-bb740b0886cd tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1730 microversion: 2.1 time: 0.154084 Aug 07 02:11:17.670405 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3214/6892] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:17 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:17.929003 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-21c02b9d-a617-4a9e-9fd0-9fc1f825ffd2 req-9b4f576c-aad2-4ef1-bbd9-8e4a3fe4096a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a399f404-604c-431e-896d-edacded36702", "name": "network-vif-unplugged", "status": "completed", "tag": "98b9f8fe-c5ed-4913-8c96-c307a6609495"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:11:17.940098 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-21c02b9d-a617-4a9e-9fd0-9fc1f825ffd2 req-9b4f576c-aad2-4ef1-bbd9-8e4a3fe4096a service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:17.940651 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-21c02b9d-a617-4a9e-9fd0-9fc1f825ffd2 req-9b4f576c-aad2-4ef1-bbd9-8e4a3fe4096a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:17.941097 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-21c02b9d-a617-4a9e-9fd0-9fc1f825ffd2 req-9b4f576c-aad2-4ef1-bbd9-8e4a3fe4096a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:17.953274 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-21c02b9d-a617-4a9e-9fd0-9fc1f825ffd2 req-9b4f576c-aad2-4ef1-bbd9-8e4a3fe4096a service nova] Creating event network-vif-unplugged:98b9f8fe-c5ed-4913-8c96-c307a6609495 for instance a399f404-604c-431e-896d-edacded36702 on n-h2-master-1 Aug 07 02:11:17.958705 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [req-21c02b9d-a617-4a9e-9fd0-9fc1f825ffd2 req-9b4f576c-aad2-4ef1-bbd9-8e4a3fe4096a service nova] Instance a399f404-604c-431e-896d-edacded36702 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 02:11:17.973798 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-21c02b9d-a617-4a9e-9fd0-9fc1f825ffd2 req-9b4f576c-aad2-4ef1-bbd9-8e4a3fe4096a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048621 Aug 07 02:11:17.974441 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3679/6893] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:11:18.692176 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-adfab6fc-8769-47ed-ba78-00906c2af774 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:18.692916 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-adfab6fc-8769-47ed-ba78-00906c2af774 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:18.700552 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-adfab6fc-8769-47ed-ba78-00906c2af774 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:18.701050 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-adfab6fc-8769-47ed-ba78-00906c2af774 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:18.701491 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-adfab6fc-8769-47ed-ba78-00906c2af774 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:18.702208 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-adfab6fc-8769-47ed-ba78-00906c2af774 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:18.702677 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-adfab6fc-8769-47ed-ba78-00906c2af774 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:18.703108 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-adfab6fc-8769-47ed-ba78-00906c2af774 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:18.841589 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-adfab6fc-8769-47ed-ba78-00906c2af774 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:18.850275 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-adfab6fc-8769-47ed-ba78-00906c2af774 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1730 microversion: 2.1 time: 0.161940 Aug 07 02:11:18.850866 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3215/6894] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:18 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:19.872039 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bc17c741-f246-427b-b1de-9e02f0cc5a30 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:19.872750 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bc17c741-f246-427b-b1de-9e02f0cc5a30 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:19.878935 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bc17c741-f246-427b-b1de-9e02f0cc5a30 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:19.879426 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bc17c741-f246-427b-b1de-9e02f0cc5a30 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:19.879873 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bc17c741-f246-427b-b1de-9e02f0cc5a30 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:19.880605 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bc17c741-f246-427b-b1de-9e02f0cc5a30 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:19.881067 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bc17c741-f246-427b-b1de-9e02f0cc5a30 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:19.881501 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bc17c741-f246-427b-b1de-9e02f0cc5a30 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:19.993306 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-da99d2e4-c74c-4a58-b067-5b04ca4c222a req-b0220a59-5b1a-46e2-9b99-f77c7d79c983 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a399f404-604c-431e-896d-edacded36702", "tag": "98b9f8fe-c5ed-4913-8c96-c307a6609495"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:11:20.003750 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-da99d2e4-c74c-4a58-b067-5b04ca4c222a req-b0220a59-5b1a-46e2-9b99-f77c7d79c983 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:20.004917 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-da99d2e4-c74c-4a58-b067-5b04ca4c222a req-b0220a59-5b1a-46e2-9b99-f77c7d79c983 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:20.005345 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-da99d2e4-c74c-4a58-b067-5b04ca4c222a req-b0220a59-5b1a-46e2-9b99-f77c7d79c983 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:20.017631 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-da99d2e4-c74c-4a58-b067-5b04ca4c222a req-b0220a59-5b1a-46e2-9b99-f77c7d79c983 service nova] Creating event network-changed:98b9f8fe-c5ed-4913-8c96-c307a6609495 for instance a399f404-604c-431e-896d-edacded36702 on n-h2-master-1 Aug 07 02:11:20.023055 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [req-da99d2e4-c74c-4a58-b067-5b04ca4c222a req-b0220a59-5b1a-46e2-9b99-f77c7d79c983 service nova] Instance a399f404-604c-431e-896d-edacded36702 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 02:11:20.026657 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bc17c741-f246-427b-b1de-9e02f0cc5a30 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:20.036298 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bc17c741-f246-427b-b1de-9e02f0cc5a30 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1728 microversion: 2.1 time: 0.169359 Aug 07 02:11:20.037446 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3680/6895] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:19 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:20.038388 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-da99d2e4-c74c-4a58-b067-5b04ca4c222a req-b0220a59-5b1a-46e2-9b99-f77c7d79c983 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048560 Aug 07 02:11:20.039103 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3216/6896] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 02:11:21.058305 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c1b230cd-cbfc-4004-869a-518bea2ca181 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:21.058992 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c1b230cd-cbfc-4004-869a-518bea2ca181 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:21.066971 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1b230cd-cbfc-4004-869a-518bea2ca181 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:21.067999 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1b230cd-cbfc-4004-869a-518bea2ca181 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:21.067999 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1b230cd-cbfc-4004-869a-518bea2ca181 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:21.068665 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1b230cd-cbfc-4004-869a-518bea2ca181 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:21.069130 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1b230cd-cbfc-4004-869a-518bea2ca181 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:21.069569 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1b230cd-cbfc-4004-869a-518bea2ca181 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:21.223282 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c1b230cd-cbfc-4004-869a-518bea2ca181 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:21.232115 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c1b230cd-cbfc-4004-869a-518bea2ca181 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1728 microversion: 2.1 time: 0.177727 Aug 07 02:11:21.232695 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3681/6897] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:21 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1728 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:22.254977 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5acbdc3b-7272-4569-b4cb-165288b24a02 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:22.255589 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5acbdc3b-7272-4569-b4cb-165288b24a02 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:22.261970 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5acbdc3b-7272-4569-b4cb-165288b24a02 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:22.262454 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5acbdc3b-7272-4569-b4cb-165288b24a02 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:22.262893 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5acbdc3b-7272-4569-b4cb-165288b24a02 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:22.263591 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5acbdc3b-7272-4569-b4cb-165288b24a02 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:22.264094 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5acbdc3b-7272-4569-b4cb-165288b24a02 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:22.264530 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5acbdc3b-7272-4569-b4cb-165288b24a02 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:22.695534 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5acbdc3b-7272-4569-b4cb-165288b24a02 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:22.705021 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5acbdc3b-7272-4569-b4cb-165288b24a02 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1728 microversion: 2.1 time: 0.455200 Aug 07 02:11:22.705613 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3217/6898] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:22 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1728 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:23.726850 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7fa97fc4-e3ca-4364-b17d-5303ab253ac0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:23.727395 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7fa97fc4-e3ca-4364-b17d-5303ab253ac0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:23.734708 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7fa97fc4-e3ca-4364-b17d-5303ab253ac0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:23.735205 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7fa97fc4-e3ca-4364-b17d-5303ab253ac0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:23.735652 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7fa97fc4-e3ca-4364-b17d-5303ab253ac0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:23.736398 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7fa97fc4-e3ca-4364-b17d-5303ab253ac0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:23.736865 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7fa97fc4-e3ca-4364-b17d-5303ab253ac0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:23.737307 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7fa97fc4-e3ca-4364-b17d-5303ab253ac0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:23.865953 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7fa97fc4-e3ca-4364-b17d-5303ab253ac0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:23.874595 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7fa97fc4-e3ca-4364-b17d-5303ab253ac0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1728 microversion: 2.1 time: 0.151662 Aug 07 02:11:23.875383 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3682/6899] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:23 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:24.897562 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c98ec613-785c-44cb-9042-3490727045cb tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:24.898240 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c98ec613-785c-44cb-9042-3490727045cb tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:24.905068 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c98ec613-785c-44cb-9042-3490727045cb tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:24.905554 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c98ec613-785c-44cb-9042-3490727045cb tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:24.905995 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c98ec613-785c-44cb-9042-3490727045cb tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:24.906699 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c98ec613-785c-44cb-9042-3490727045cb tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:24.907155 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c98ec613-785c-44cb-9042-3490727045cb tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:24.907585 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c98ec613-785c-44cb-9042-3490727045cb tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:25.036671 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c98ec613-785c-44cb-9042-3490727045cb tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:25.044731 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c98ec613-785c-44cb-9042-3490727045cb tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1728 microversion: 2.1 time: 0.151118 Aug 07 02:11:25.045301 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3218/6900] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:24 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:26.111241 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-198be7e3-cd41-4b2f-a8f4-21d18be4e40d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:26.111872 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-198be7e3-cd41-4b2f-a8f4-21d18be4e40d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:26.117836 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-198be7e3-cd41-4b2f-a8f4-21d18be4e40d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:26.118332 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-198be7e3-cd41-4b2f-a8f4-21d18be4e40d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:26.118782 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-198be7e3-cd41-4b2f-a8f4-21d18be4e40d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:26.119490 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-198be7e3-cd41-4b2f-a8f4-21d18be4e40d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:26.119982 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-198be7e3-cd41-4b2f-a8f4-21d18be4e40d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:26.120427 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-198be7e3-cd41-4b2f-a8f4-21d18be4e40d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:26.250507 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-198be7e3-cd41-4b2f-a8f4-21d18be4e40d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:26.252833 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:11:26.259874 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-198be7e3-cd41-4b2f-a8f4-21d18be4e40d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1728 microversion: 2.1 time: 0.197824 Aug 07 02:11:26.260474 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3683/6901] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:26 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1728 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:27.282532 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2d7df0fd-c011-4561-ad1f-209487113c68 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:27.283061 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2d7df0fd-c011-4561-ad1f-209487113c68 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:27.286157 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=29 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:11:27.291506 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d7df0fd-c011-4561-ad1f-209487113c68 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:27.292014 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d7df0fd-c011-4561-ad1f-209487113c68 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:27.292471 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d7df0fd-c011-4561-ad1f-209487113c68 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:27.293151 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d7df0fd-c011-4561-ad1f-209487113c68 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:27.293625 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d7df0fd-c011-4561-ad1f-209487113c68 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:27.294696 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d7df0fd-c011-4561-ad1f-209487113c68 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:27.297610 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=83 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:11:27.431620 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2d7df0fd-c011-4561-ad1f-209487113c68 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:27.439580 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2d7df0fd-c011-4561-ad1f-209487113c68 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1728 microversion: 2.1 time: 0.161510 Aug 07 02:11:27.440183 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3219/6902] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:27 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:28.461261 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bd65d2a1-7111-4e77-9e4c-9f36b7fdce9d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:28.461920 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bd65d2a1-7111-4e77-9e4c-9f36b7fdce9d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:28.465359 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=35 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:11:28.471756 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd65d2a1-7111-4e77-9e4c-9f36b7fdce9d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:28.472278 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd65d2a1-7111-4e77-9e4c-9f36b7fdce9d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:28.472730 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd65d2a1-7111-4e77-9e4c-9f36b7fdce9d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:28.473443 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd65d2a1-7111-4e77-9e4c-9f36b7fdce9d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:28.473914 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd65d2a1-7111-4e77-9e4c-9f36b7fdce9d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:28.474367 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bd65d2a1-7111-4e77-9e4c-9f36b7fdce9d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:28.605338 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bd65d2a1-7111-4e77-9e4c-9f36b7fdce9d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:28.613991 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bd65d2a1-7111-4e77-9e4c-9f36b7fdce9d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1728 microversion: 2.1 time: 0.156677 Aug 07 02:11:28.614793 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3684/6903] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:28 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:29.635580 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-18828675-3826-4357-834f-f891b95b332f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:29.636220 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-18828675-3826-4357-834f-f891b95b332f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:29.643793 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-18828675-3826-4357-834f-f891b95b332f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:29.644310 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-18828675-3826-4357-834f-f891b95b332f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:29.644753 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-18828675-3826-4357-834f-f891b95b332f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:29.645462 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-18828675-3826-4357-834f-f891b95b332f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:29.645918 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-18828675-3826-4357-834f-f891b95b332f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:29.646348 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-18828675-3826-4357-834f-f891b95b332f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:29.773197 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-18828675-3826-4357-834f-f891b95b332f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:29.781201 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-18828675-3826-4357-834f-f891b95b332f tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1728 microversion: 2.1 time: 0.149638 Aug 07 02:11:29.781766 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3220/6904] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:29 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:30.803015 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9ce1a657-a9d9-4161-b4df-06b930eef513 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:30.803569 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9ce1a657-a9d9-4161-b4df-06b930eef513 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:30.810996 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9ce1a657-a9d9-4161-b4df-06b930eef513 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:30.811489 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9ce1a657-a9d9-4161-b4df-06b930eef513 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:30.811970 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9ce1a657-a9d9-4161-b4df-06b930eef513 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:30.812681 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9ce1a657-a9d9-4161-b4df-06b930eef513 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:30.813149 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9ce1a657-a9d9-4161-b4df-06b930eef513 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:30.813588 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9ce1a657-a9d9-4161-b4df-06b930eef513 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:30.946765 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9ce1a657-a9d9-4161-b4df-06b930eef513 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:30.955497 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9ce1a657-a9d9-4161-b4df-06b930eef513 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1728 microversion: 2.1 time: 0.156522 Aug 07 02:11:30.956130 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3685/6905] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:30 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:31.976997 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-38e7433b-6aea-4f69-b212-2e27439b6463 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:31.977512 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-38e7433b-6aea-4f69-b212-2e27439b6463 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:31.987269 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-38e7433b-6aea-4f69-b212-2e27439b6463 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:31.988124 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-38e7433b-6aea-4f69-b212-2e27439b6463 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:31.988577 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-38e7433b-6aea-4f69-b212-2e27439b6463 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:31.989387 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-38e7433b-6aea-4f69-b212-2e27439b6463 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:31.989764 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-38e7433b-6aea-4f69-b212-2e27439b6463 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:31.990195 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-38e7433b-6aea-4f69-b212-2e27439b6463 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:32.124431 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-38e7433b-6aea-4f69-b212-2e27439b6463 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:32.132424 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-38e7433b-6aea-4f69-b212-2e27439b6463 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1725 microversion: 2.1 time: 0.159436 Aug 07 02:11:32.132997 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3221/6906] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:31 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:32.152992 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-141e85ad-6c4d-4e7e-ae36-b4dcd93657ca tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:11:32.154132 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-141e85ad-6c4d-4e7e-ae36-b4dcd93657ca tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:32.160925 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-141e85ad-6c4d-4e7e-ae36-b4dcd93657ca tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:32.161671 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-141e85ad-6c4d-4e7e-ae36-b4dcd93657ca tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:32.162115 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-141e85ad-6c4d-4e7e-ae36-b4dcd93657ca tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:32.162812 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-141e85ad-6c4d-4e7e-ae36-b4dcd93657ca tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:32.163273 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-141e85ad-6c4d-4e7e-ae36-b4dcd93657ca tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:32.163707 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-141e85ad-6c4d-4e7e-ae36-b4dcd93657ca tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:32.198536 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-141e85ad-6c4d-4e7e-ae36-b4dcd93657ca tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:32.199018 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-141e85ad-6c4d-4e7e-ae36-b4dcd93657ca tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:32.199463 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-141e85ad-6c4d-4e7e-ae36-b4dcd93657ca tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:32.200212 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-141e85ad-6c4d-4e7e-ae36-b4dcd93657ca tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:32.201180 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-141e85ad-6c4d-4e7e-ae36-b4dcd93657ca tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:32.201614 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-141e85ad-6c4d-4e7e-ae36-b4dcd93657ca tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:32.221636 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-141e85ad-6c4d-4e7e-ae36-b4dcd93657ca tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Getting quotas for project 435945eeab2f42d386f48f7374bbd488. Resources: {'ram', 'cores'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:11:32.226722 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-141e85ad-6c4d-4e7e-ae36-b4dcd93657ca tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Getting quotas for user 09cb536a0a584f5f96bec5fca7afa3b4 and project 435945eeab2f42d386f48f7374bbd488. Resources: {'ram', 'cores'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:11:32.324288 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-141e85ad-6c4d-4e7e-ae36-b4dcd93657ca tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "POST /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702/action" status: 202 len: 0 microversion: 2.1 time: 0.174834 Aug 07 02:11:32.324908 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3686/6907] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:11:32 2022] POST /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:11:32.333899 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f07b9cee-865a-4b39-a9e1-cd9b540d2db2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:32.334614 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f07b9cee-865a-4b39-a9e1-cd9b540d2db2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:32.340712 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f07b9cee-865a-4b39-a9e1-cd9b540d2db2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:32.341276 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f07b9cee-865a-4b39-a9e1-cd9b540d2db2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:32.341722 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f07b9cee-865a-4b39-a9e1-cd9b540d2db2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:32.342431 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f07b9cee-865a-4b39-a9e1-cd9b540d2db2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:32.342896 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f07b9cee-865a-4b39-a9e1-cd9b540d2db2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:32.343337 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f07b9cee-865a-4b39-a9e1-cd9b540d2db2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:32.477200 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f07b9cee-865a-4b39-a9e1-cd9b540d2db2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:32.485165 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f07b9cee-865a-4b39-a9e1-cd9b540d2db2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1724 microversion: 2.1 time: 0.155273 Aug 07 02:11:32.485732 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3222/6908] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:32 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:33.507284 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-95fd7e89-5bc7-4e30-8ebd-bef93ff1ee5d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:33.507950 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-95fd7e89-5bc7-4e30-8ebd-bef93ff1ee5d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:33.518617 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-95fd7e89-5bc7-4e30-8ebd-bef93ff1ee5d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:33.519118 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-95fd7e89-5bc7-4e30-8ebd-bef93ff1ee5d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:33.519574 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-95fd7e89-5bc7-4e30-8ebd-bef93ff1ee5d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:33.520315 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-95fd7e89-5bc7-4e30-8ebd-bef93ff1ee5d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:33.520795 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-95fd7e89-5bc7-4e30-8ebd-bef93ff1ee5d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:33.521239 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-95fd7e89-5bc7-4e30-8ebd-bef93ff1ee5d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:33.652011 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-95fd7e89-5bc7-4e30-8ebd-bef93ff1ee5d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:33.660138 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-95fd7e89-5bc7-4e30-8ebd-bef93ff1ee5d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1724 microversion: 2.1 time: 0.157240 Aug 07 02:11:33.660708 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3687/6909] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:33 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:34.681183 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-00a1c481-fd70-4f3a-ba24-c608619febf7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:34.681802 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-00a1c481-fd70-4f3a-ba24-c608619febf7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:34.688701 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00a1c481-fd70-4f3a-ba24-c608619febf7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:34.689129 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00a1c481-fd70-4f3a-ba24-c608619febf7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:34.689566 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00a1c481-fd70-4f3a-ba24-c608619febf7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:34.690260 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00a1c481-fd70-4f3a-ba24-c608619febf7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:34.690717 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00a1c481-fd70-4f3a-ba24-c608619febf7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:34.691148 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-00a1c481-fd70-4f3a-ba24-c608619febf7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:34.822150 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-00a1c481-fd70-4f3a-ba24-c608619febf7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:34.830200 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-00a1c481-fd70-4f3a-ba24-c608619febf7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1724 microversion: 2.1 time: 0.152924 Aug 07 02:11:34.830860 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3223/6910] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:34 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:35.852673 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4a6c3e5e-fce0-4871-ac74-0fc2228c2f98 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:35.853335 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4a6c3e5e-fce0-4871-ac74-0fc2228c2f98 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:35.860793 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a6c3e5e-fce0-4871-ac74-0fc2228c2f98 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:35.861299 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a6c3e5e-fce0-4871-ac74-0fc2228c2f98 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:35.861759 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a6c3e5e-fce0-4871-ac74-0fc2228c2f98 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:35.862478 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a6c3e5e-fce0-4871-ac74-0fc2228c2f98 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:35.862950 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a6c3e5e-fce0-4871-ac74-0fc2228c2f98 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:35.863396 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a6c3e5e-fce0-4871-ac74-0fc2228c2f98 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:35.998859 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4a6c3e5e-fce0-4871-ac74-0fc2228c2f98 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:36.007015 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4a6c3e5e-fce0-4871-ac74-0fc2228c2f98 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1724 microversion: 2.1 time: 0.158353 Aug 07 02:11:36.007835 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3688/6911] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:35 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:37.028054 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b9be61dc-a614-4466-89a5-b80c141ef316 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:37.028676 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b9be61dc-a614-4466-89a5-b80c141ef316 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:37.035942 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9be61dc-a614-4466-89a5-b80c141ef316 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:37.036446 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9be61dc-a614-4466-89a5-b80c141ef316 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:37.036892 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9be61dc-a614-4466-89a5-b80c141ef316 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:37.037894 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9be61dc-a614-4466-89a5-b80c141ef316 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:37.038351 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9be61dc-a614-4466-89a5-b80c141ef316 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:37.038780 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b9be61dc-a614-4466-89a5-b80c141ef316 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:37.219649 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b9be61dc-a614-4466-89a5-b80c141ef316 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:37.227741 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b9be61dc-a614-4466-89a5-b80c141ef316 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1724 microversion: 2.1 time: 0.203561 Aug 07 02:11:37.228361 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3224/6912] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:37 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:37.933688 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-2cc38f94-0c26-4452-9054-05d63ade125f req-ac2ef708-53dd-44e7-bf60-e0e845484c11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a399f404-604c-431e-896d-edacded36702", "tag": "98b9f8fe-c5ed-4913-8c96-c307a6609495"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:11:37.945065 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2cc38f94-0c26-4452-9054-05d63ade125f req-ac2ef708-53dd-44e7-bf60-e0e845484c11 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:37.945578 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2cc38f94-0c26-4452-9054-05d63ade125f req-ac2ef708-53dd-44e7-bf60-e0e845484c11 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:37.946032 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-2cc38f94-0c26-4452-9054-05d63ade125f req-ac2ef708-53dd-44e7-bf60-e0e845484c11 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:37.958673 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-2cc38f94-0c26-4452-9054-05d63ade125f req-ac2ef708-53dd-44e7-bf60-e0e845484c11 service nova] Creating event network-changed:98b9f8fe-c5ed-4913-8c96-c307a6609495 for instance a399f404-604c-431e-896d-edacded36702 on n-h1-master-1 Aug 07 02:11:37.964290 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [req-2cc38f94-0c26-4452-9054-05d63ade125f req-ac2ef708-53dd-44e7-bf60-e0e845484c11 service nova] Instance a399f404-604c-431e-896d-edacded36702 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 02:11:37.976435 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-2cc38f94-0c26-4452-9054-05d63ade125f req-ac2ef708-53dd-44e7-bf60-e0e845484c11 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046536 Aug 07 02:11:37.977299 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3689/6913] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:11:38.249951 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3315b684-bf24-4e5d-8d8b-63e66a912315 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:38.250545 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3315b684-bf24-4e5d-8d8b-63e66a912315 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:38.257332 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3315b684-bf24-4e5d-8d8b-63e66a912315 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:38.257810 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3315b684-bf24-4e5d-8d8b-63e66a912315 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:38.258242 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3315b684-bf24-4e5d-8d8b-63e66a912315 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:38.258945 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3315b684-bf24-4e5d-8d8b-63e66a912315 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:38.259395 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3315b684-bf24-4e5d-8d8b-63e66a912315 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:38.259813 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3315b684-bf24-4e5d-8d8b-63e66a912315 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:38.490480 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3315b684-bf24-4e5d-8d8b-63e66a912315 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:38.499047 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3315b684-bf24-4e5d-8d8b-63e66a912315 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1724 microversion: 2.1 time: 0.253409 Aug 07 02:11:38.499759 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3225/6914] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:38 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:39.522502 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b9244204-a9ca-4b84-95fe-a25b7eb7d24d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:39.523295 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b9244204-a9ca-4b84-95fe-a25b7eb7d24d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:39.530176 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b9244204-a9ca-4b84-95fe-a25b7eb7d24d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:39.530671 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b9244204-a9ca-4b84-95fe-a25b7eb7d24d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:39.531119 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b9244204-a9ca-4b84-95fe-a25b7eb7d24d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:39.531842 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b9244204-a9ca-4b84-95fe-a25b7eb7d24d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:39.532326 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b9244204-a9ca-4b84-95fe-a25b7eb7d24d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:39.532766 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b9244204-a9ca-4b84-95fe-a25b7eb7d24d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:39.664168 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b9244204-a9ca-4b84-95fe-a25b7eb7d24d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:39.672393 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b9244204-a9ca-4b84-95fe-a25b7eb7d24d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1724 microversion: 2.1 time: 0.155108 Aug 07 02:11:39.672965 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3690/6915] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:39 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:40.693524 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d1d18fd8-b5b2-4f4e-b2cd-3d792dfcc5d8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:40.694137 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d1d18fd8-b5b2-4f4e-b2cd-3d792dfcc5d8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:40.701101 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1d18fd8-b5b2-4f4e-b2cd-3d792dfcc5d8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:40.701582 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1d18fd8-b5b2-4f4e-b2cd-3d792dfcc5d8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:40.702037 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1d18fd8-b5b2-4f4e-b2cd-3d792dfcc5d8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:40.702715 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1d18fd8-b5b2-4f4e-b2cd-3d792dfcc5d8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:40.703168 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1d18fd8-b5b2-4f4e-b2cd-3d792dfcc5d8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:40.703595 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1d18fd8-b5b2-4f4e-b2cd-3d792dfcc5d8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:40.844183 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d1d18fd8-b5b2-4f4e-b2cd-3d792dfcc5d8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:40.852624 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d1d18fd8-b5b2-4f4e-b2cd-3d792dfcc5d8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1724 microversion: 2.1 time: 0.162873 Aug 07 02:11:40.853215 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3226/6916] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:40 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:41.875425 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-512e019e-9b7c-4781-b26f-4d05a1fd02d2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:41.876118 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-512e019e-9b7c-4781-b26f-4d05a1fd02d2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:41.882791 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-512e019e-9b7c-4781-b26f-4d05a1fd02d2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:41.883286 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-512e019e-9b7c-4781-b26f-4d05a1fd02d2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:41.883739 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-512e019e-9b7c-4781-b26f-4d05a1fd02d2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:41.884470 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-512e019e-9b7c-4781-b26f-4d05a1fd02d2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:41.884939 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-512e019e-9b7c-4781-b26f-4d05a1fd02d2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:41.885378 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-512e019e-9b7c-4781-b26f-4d05a1fd02d2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:42.027837 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-512e019e-9b7c-4781-b26f-4d05a1fd02d2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:42.036852 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-512e019e-9b7c-4781-b26f-4d05a1fd02d2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1724 microversion: 2.1 time: 0.166098 Aug 07 02:11:42.037423 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3691/6917] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:41 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:43.058777 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-046c1238-c289-4878-9efd-cb761d4a088a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:43.059298 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-046c1238-c289-4878-9efd-cb761d4a088a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:43.066019 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-046c1238-c289-4878-9efd-cb761d4a088a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:43.066510 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-046c1238-c289-4878-9efd-cb761d4a088a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:43.066952 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-046c1238-c289-4878-9efd-cb761d4a088a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:43.067654 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-046c1238-c289-4878-9efd-cb761d4a088a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:43.068140 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-046c1238-c289-4878-9efd-cb761d4a088a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:43.068574 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-046c1238-c289-4878-9efd-cb761d4a088a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:43.204152 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-046c1238-c289-4878-9efd-cb761d4a088a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:43.212699 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-046c1238-c289-4878-9efd-cb761d4a088a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1724 microversion: 2.1 time: 0.157926 Aug 07 02:11:43.213271 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3227/6918] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:43 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:44.235211 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c01f7908-0434-4787-a6ed-aaa3e3f8632a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:44.235749 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c01f7908-0434-4787-a6ed-aaa3e3f8632a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:44.237977 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:11:44.243858 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c01f7908-0434-4787-a6ed-aaa3e3f8632a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:44.244385 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c01f7908-0434-4787-a6ed-aaa3e3f8632a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:44.244839 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c01f7908-0434-4787-a6ed-aaa3e3f8632a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:44.245557 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c01f7908-0434-4787-a6ed-aaa3e3f8632a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:44.246028 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c01f7908-0434-4787-a6ed-aaa3e3f8632a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:44.246471 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c01f7908-0434-4787-a6ed-aaa3e3f8632a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:44.374428 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c01f7908-0434-4787-a6ed-aaa3e3f8632a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:44.382476 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c01f7908-0434-4787-a6ed-aaa3e3f8632a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1724 microversion: 2.1 time: 0.151871 Aug 07 02:11:44.383058 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3692/6919] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:44 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:45.403420 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d8ac734a-4cc2-4ead-8970-cdb766dd0d75 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:45.404064 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d8ac734a-4cc2-4ead-8970-cdb766dd0d75 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:45.410451 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d8ac734a-4cc2-4ead-8970-cdb766dd0d75 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:45.410934 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d8ac734a-4cc2-4ead-8970-cdb766dd0d75 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:45.411361 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d8ac734a-4cc2-4ead-8970-cdb766dd0d75 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:45.412112 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d8ac734a-4cc2-4ead-8970-cdb766dd0d75 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:45.412565 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d8ac734a-4cc2-4ead-8970-cdb766dd0d75 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:45.412986 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d8ac734a-4cc2-4ead-8970-cdb766dd0d75 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:45.540398 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d8ac734a-4cc2-4ead-8970-cdb766dd0d75 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:45.548769 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d8ac734a-4cc2-4ead-8970-cdb766dd0d75 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1724 microversion: 2.1 time: 0.149423 Aug 07 02:11:45.549341 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3228/6920] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:45 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:46.570674 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7a0e13c0-f28f-4c3a-b243-872039d349d8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:46.571229 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7a0e13c0-f28f-4c3a-b243-872039d349d8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:46.578426 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7a0e13c0-f28f-4c3a-b243-872039d349d8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:46.578923 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7a0e13c0-f28f-4c3a-b243-872039d349d8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:46.579376 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7a0e13c0-f28f-4c3a-b243-872039d349d8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:46.580132 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7a0e13c0-f28f-4c3a-b243-872039d349d8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:46.580603 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7a0e13c0-f28f-4c3a-b243-872039d349d8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:46.581048 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7a0e13c0-f28f-4c3a-b243-872039d349d8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:46.712143 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7a0e13c0-f28f-4c3a-b243-872039d349d8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:46.720170 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7a0e13c0-f28f-4c3a-b243-872039d349d8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1724 microversion: 2.1 time: 0.153616 Aug 07 02:11:46.720741 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3693/6921] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:46 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:47.741548 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9fb42e4c-7260-4de1-9486-b7708ffac82e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:47.742171 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9fb42e4c-7260-4de1-9486-b7708ffac82e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:47.749060 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9fb42e4c-7260-4de1-9486-b7708ffac82e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:47.749547 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9fb42e4c-7260-4de1-9486-b7708ffac82e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:47.749988 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9fb42e4c-7260-4de1-9486-b7708ffac82e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:47.750684 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9fb42e4c-7260-4de1-9486-b7708ffac82e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:47.751143 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9fb42e4c-7260-4de1-9486-b7708ffac82e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:47.751574 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9fb42e4c-7260-4de1-9486-b7708ffac82e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:47.884144 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9fb42e4c-7260-4de1-9486-b7708ffac82e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:47.892801 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9fb42e4c-7260-4de1-9486-b7708ffac82e tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1724 microversion: 2.1 time: 0.155205 Aug 07 02:11:47.893377 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3229/6922] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:47 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:48.915072 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cd8b7207-df5f-4bb9-818f-0f1b0a43dfae tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:48.915631 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cd8b7207-df5f-4bb9-818f-0f1b0a43dfae tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:48.923133 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd8b7207-df5f-4bb9-818f-0f1b0a43dfae tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:48.923631 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd8b7207-df5f-4bb9-818f-0f1b0a43dfae tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:48.924118 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd8b7207-df5f-4bb9-818f-0f1b0a43dfae tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:48.924832 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd8b7207-df5f-4bb9-818f-0f1b0a43dfae tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:48.925303 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd8b7207-df5f-4bb9-818f-0f1b0a43dfae tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:48.925750 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cd8b7207-df5f-4bb9-818f-0f1b0a43dfae tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:49.058717 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cd8b7207-df5f-4bb9-818f-0f1b0a43dfae tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:49.066837 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cd8b7207-df5f-4bb9-818f-0f1b0a43dfae tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1724 microversion: 2.1 time: 0.156071 Aug 07 02:11:49.067410 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3694/6923] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:48 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:50.088679 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0002a7fc-0cf2-40ff-a043-ba4b0eaae3be tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:50.089341 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0002a7fc-0cf2-40ff-a043-ba4b0eaae3be tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:50.096373 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0002a7fc-0cf2-40ff-a043-ba4b0eaae3be tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:50.096860 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0002a7fc-0cf2-40ff-a043-ba4b0eaae3be tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:50.097300 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0002a7fc-0cf2-40ff-a043-ba4b0eaae3be tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:50.098014 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0002a7fc-0cf2-40ff-a043-ba4b0eaae3be tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:50.098465 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0002a7fc-0cf2-40ff-a043-ba4b0eaae3be tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:50.098892 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0002a7fc-0cf2-40ff-a043-ba4b0eaae3be tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:50.235119 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0002a7fc-0cf2-40ff-a043-ba4b0eaae3be tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:50.243242 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0002a7fc-0cf2-40ff-a043-ba4b0eaae3be tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1724 microversion: 2.1 time: 0.158493 Aug 07 02:11:50.243814 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3230/6924] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:50 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:51.265264 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a9e17a05-5d03-42e9-a947-943ba6ab976c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:51.266490 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a9e17a05-5d03-42e9-a947-943ba6ab976c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:51.273445 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a9e17a05-5d03-42e9-a947-943ba6ab976c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:51.273945 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a9e17a05-5d03-42e9-a947-943ba6ab976c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:51.274400 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a9e17a05-5d03-42e9-a947-943ba6ab976c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:51.275116 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a9e17a05-5d03-42e9-a947-943ba6ab976c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:51.275590 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a9e17a05-5d03-42e9-a947-943ba6ab976c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:51.276076 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a9e17a05-5d03-42e9-a947-943ba6ab976c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:51.405102 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a9e17a05-5d03-42e9-a947-943ba6ab976c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:51.413192 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a9e17a05-5d03-42e9-a947-943ba6ab976c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1717 microversion: 2.1 time: 0.151982 Aug 07 02:11:51.413767 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3695/6925] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:51 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1717 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:51.434171 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-65b1feae-97fd-487d-8ac6-b00210c2ab7d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:51.434790 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-65b1feae-97fd-487d-8ac6-b00210c2ab7d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:51.442334 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-65b1feae-97fd-487d-8ac6-b00210c2ab7d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:51.442819 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-65b1feae-97fd-487d-8ac6-b00210c2ab7d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:51.443261 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-65b1feae-97fd-487d-8ac6-b00210c2ab7d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:51.443985 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-65b1feae-97fd-487d-8ac6-b00210c2ab7d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:51.444443 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-65b1feae-97fd-487d-8ac6-b00210c2ab7d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:51.444868 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-65b1feae-97fd-487d-8ac6-b00210c2ab7d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:51.577342 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-65b1feae-97fd-487d-8ac6-b00210c2ab7d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:51.585197 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-65b1feae-97fd-487d-8ac6-b00210c2ab7d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1717 microversion: 2.1 time: 0.154914 Aug 07 02:11:51.585765 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3231/6926] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:51 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1717 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:51.604990 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b09d61a5-51ff-4a8c-be77-4928c6619f37 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:51.605621 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b09d61a5-51ff-4a8c-be77-4928c6619f37 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:51.612090 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b09d61a5-51ff-4a8c-be77-4928c6619f37 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:51.612586 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b09d61a5-51ff-4a8c-be77-4928c6619f37 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:51.613043 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b09d61a5-51ff-4a8c-be77-4928c6619f37 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:51.613752 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b09d61a5-51ff-4a8c-be77-4928c6619f37 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:51.614224 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b09d61a5-51ff-4a8c-be77-4928c6619f37 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:51.614669 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b09d61a5-51ff-4a8c-be77-4928c6619f37 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:51.745383 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b09d61a5-51ff-4a8c-be77-4928c6619f37 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:51.754061 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b09d61a5-51ff-4a8c-be77-4928c6619f37 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1717 microversion: 2.1 time: 0.152894 Aug 07 02:11:51.754639 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3696/6927] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:51 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1717 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:51.774279 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-490bd8b5-469c-4b7d-a0a0-dedd1bb69a9c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:51.774715 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-490bd8b5-469c-4b7d-a0a0-dedd1bb69a9c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:51.780570 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-490bd8b5-469c-4b7d-a0a0-dedd1bb69a9c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:51.781530 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-490bd8b5-469c-4b7d-a0a0-dedd1bb69a9c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:51.781974 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-490bd8b5-469c-4b7d-a0a0-dedd1bb69a9c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:51.782664 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-490bd8b5-469c-4b7d-a0a0-dedd1bb69a9c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:51.783127 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-490bd8b5-469c-4b7d-a0a0-dedd1bb69a9c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:51.783555 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-490bd8b5-469c-4b7d-a0a0-dedd1bb69a9c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:51.808197 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-490bd8b5-469c-4b7d-a0a0-dedd1bb69a9c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 02:11:51.881749 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-490bd8b5-469c-4b7d-a0a0-dedd1bb69a9c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 204 len: 0 microversion: 2.1 time: 0.111079 Aug 07 02:11:51.882333 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3232/6928] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 02:11:51 2022] DELETE /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 02:11:51.891253 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1f59bcea-ce7a-4266-9c1a-9f49ddc04790 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:51.891932 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1f59bcea-ce7a-4266-9c1a-9f49ddc04790 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:51.897965 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f59bcea-ce7a-4266-9c1a-9f49ddc04790 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:51.898464 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f59bcea-ce7a-4266-9c1a-9f49ddc04790 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:51.898917 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f59bcea-ce7a-4266-9c1a-9f49ddc04790 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:51.899629 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f59bcea-ce7a-4266-9c1a-9f49ddc04790 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:51.900169 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f59bcea-ce7a-4266-9c1a-9f49ddc04790 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:51.900619 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1f59bcea-ce7a-4266-9c1a-9f49ddc04790 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:52.038629 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1f59bcea-ce7a-4266-9c1a-9f49ddc04790 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:52.041493 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:11:52.049063 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1f59bcea-ce7a-4266-9c1a-9f49ddc04790 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1723 microversion: 2.1 time: 0.161632 Aug 07 02:11:52.049874 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3697/6929] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:51 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:52.132615 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-4921ccc3-2ee3-4c36-ba59-adb0f1b83fab req-050f5911-fbd6-40be-adef-a4ca1d2ac99c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a399f404-604c-431e-896d-edacded36702", "name": "network-vif-plugged", "status": "completed", "tag": "98b9f8fe-c5ed-4913-8c96-c307a6609495"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:11:52.142710 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-4921ccc3-2ee3-4c36-ba59-adb0f1b83fab req-050f5911-fbd6-40be-adef-a4ca1d2ac99c service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:52.143189 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-4921ccc3-2ee3-4c36-ba59-adb0f1b83fab req-050f5911-fbd6-40be-adef-a4ca1d2ac99c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:52.143620 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-4921ccc3-2ee3-4c36-ba59-adb0f1b83fab req-050f5911-fbd6-40be-adef-a4ca1d2ac99c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:52.154809 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-4921ccc3-2ee3-4c36-ba59-adb0f1b83fab req-050f5911-fbd6-40be-adef-a4ca1d2ac99c service nova] Creating event network-vif-plugged:98b9f8fe-c5ed-4913-8c96-c307a6609495 for instance a399f404-604c-431e-896d-edacded36702 on n-h1-master-1 Aug 07 02:11:52.160221 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-4921ccc3-2ee3-4c36-ba59-adb0f1b83fab req-050f5911-fbd6-40be-adef-a4ca1d2ac99c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031689 Aug 07 02:11:52.160810 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3233/6930] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:11:53.070758 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-37d272e5-c2f0-46d8-b49d-53340418a4b7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:53.071388 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-37d272e5-c2f0-46d8-b49d-53340418a4b7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:53.078983 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-37d272e5-c2f0-46d8-b49d-53340418a4b7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:53.079479 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-37d272e5-c2f0-46d8-b49d-53340418a4b7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:53.079960 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-37d272e5-c2f0-46d8-b49d-53340418a4b7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:53.080674 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-37d272e5-c2f0-46d8-b49d-53340418a4b7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:53.081146 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-37d272e5-c2f0-46d8-b49d-53340418a4b7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:53.081589 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-37d272e5-c2f0-46d8-b49d-53340418a4b7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:53.210904 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-37d272e5-c2f0-46d8-b49d-53340418a4b7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:53.218982 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-37d272e5-c2f0-46d8-b49d-53340418a4b7 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1723 microversion: 2.1 time: 0.152508 Aug 07 02:11:53.219555 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3698/6931] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:53 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:54.242065 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8f39656d-f62d-4177-a0f1-45f14d5888fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:54.243062 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8f39656d-f62d-4177-a0f1-45f14d5888fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:54.250850 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f39656d-f62d-4177-a0f1-45f14d5888fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:54.251471 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f39656d-f62d-4177-a0f1-45f14d5888fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:54.251763 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f39656d-f62d-4177-a0f1-45f14d5888fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:54.252550 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f39656d-f62d-4177-a0f1-45f14d5888fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:54.253017 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f39656d-f62d-4177-a0f1-45f14d5888fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:54.253447 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8f39656d-f62d-4177-a0f1-45f14d5888fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:54.327511 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8f39656d-f62d-4177-a0f1-45f14d5888fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:54.329145 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:11:54.337103 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8f39656d-f62d-4177-a0f1-45f14d5888fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1655 microversion: 2.1 time: 0.100308 Aug 07 02:11:54.338013 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3234/6932] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:54 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1655 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:54.482484 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-77b9f849-412c-4668-a848-91301801cc77 req-aa567883-45f2-4572-93c8-024beb61a394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a399f404-604c-431e-896d-edacded36702", "name": "network-vif-deleted", "tag": "98b9f8fe-c5ed-4913-8c96-c307a6609495"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:11:54.493556 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-77b9f849-412c-4668-a848-91301801cc77 req-aa567883-45f2-4572-93c8-024beb61a394 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:54.494131 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-77b9f849-412c-4668-a848-91301801cc77 req-aa567883-45f2-4572-93c8-024beb61a394 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:54.494721 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-77b9f849-412c-4668-a848-91301801cc77 req-aa567883-45f2-4572-93c8-024beb61a394 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:54.507070 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-77b9f849-412c-4668-a848-91301801cc77 req-aa567883-45f2-4572-93c8-024beb61a394 service nova] Creating event network-vif-deleted:98b9f8fe-c5ed-4913-8c96-c307a6609495 for instance a399f404-604c-431e-896d-edacded36702 on n-h1-master-1 Aug 07 02:11:54.512633 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-77b9f849-412c-4668-a848-91301801cc77 req-aa567883-45f2-4572-93c8-024beb61a394 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034039 Aug 07 02:11:54.513462 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3699/6933] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:11:55.359184 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3d82cd30-f069-437f-a274-4c2b0d76f7e2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:55.360546 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3d82cd30-f069-437f-a274-4c2b0d76f7e2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:55.369734 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3d82cd30-f069-437f-a274-4c2b0d76f7e2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:55.370476 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3d82cd30-f069-437f-a274-4c2b0d76f7e2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:55.371283 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3d82cd30-f069-437f-a274-4c2b0d76f7e2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:55.372238 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3d82cd30-f069-437f-a274-4c2b0d76f7e2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:55.372701 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3d82cd30-f069-437f-a274-4c2b0d76f7e2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:55.374053 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3d82cd30-f069-437f-a274-4c2b0d76f7e2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:55.454704 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3d82cd30-f069-437f-a274-4c2b0d76f7e2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:55.465227 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3d82cd30-f069-437f-a274-4c2b0d76f7e2 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1370 microversion: 2.1 time: 0.110354 Aug 07 02:11:55.465900 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3235/6934] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:55 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1370 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:56.488853 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4efe525e-688d-44bb-b6ae-4ae52832524a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:56.489472 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4efe525e-688d-44bb-b6ae-4ae52832524a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:56.495618 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4efe525e-688d-44bb-b6ae-4ae52832524a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:56.496144 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4efe525e-688d-44bb-b6ae-4ae52832524a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:56.496602 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4efe525e-688d-44bb-b6ae-4ae52832524a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:56.497300 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4efe525e-688d-44bb-b6ae-4ae52832524a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:56.497762 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4efe525e-688d-44bb-b6ae-4ae52832524a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:56.498197 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4efe525e-688d-44bb-b6ae-4ae52832524a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:56.563605 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4efe525e-688d-44bb-b6ae-4ae52832524a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:56.571746 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4efe525e-688d-44bb-b6ae-4ae52832524a tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1370 microversion: 2.1 time: 0.088859 Aug 07 02:11:56.572332 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3700/6935] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:56 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1370 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:57.592732 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d300993a-e5c3-4f56-b0ff-0dc330adac70 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:57.593326 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d300993a-e5c3-4f56-b0ff-0dc330adac70 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:57.595975 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:11:57.601596 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d300993a-e5c3-4f56-b0ff-0dc330adac70 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:57.602074 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d300993a-e5c3-4f56-b0ff-0dc330adac70 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:57.602509 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d300993a-e5c3-4f56-b0ff-0dc330adac70 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:57.603197 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d300993a-e5c3-4f56-b0ff-0dc330adac70 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:57.603647 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d300993a-e5c3-4f56-b0ff-0dc330adac70 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:57.604107 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d300993a-e5c3-4f56-b0ff-0dc330adac70 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:57.666582 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d300993a-e5c3-4f56-b0ff-0dc330adac70 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:57.675385 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d300993a-e5c3-4f56-b0ff-0dc330adac70 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1370 microversion: 2.1 time: 0.086484 Aug 07 02:11:57.675994 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3236/6936] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:57 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1370 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:58.696283 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e55ac3cb-07ed-43c0-902d-1d3b98306225 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:58.697020 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e55ac3cb-07ed-43c0-902d-1d3b98306225 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:58.699866 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:11:58.706358 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e55ac3cb-07ed-43c0-902d-1d3b98306225 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:58.706866 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e55ac3cb-07ed-43c0-902d-1d3b98306225 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:58.707324 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e55ac3cb-07ed-43c0-902d-1d3b98306225 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:58.708076 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e55ac3cb-07ed-43c0-902d-1d3b98306225 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:58.708549 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e55ac3cb-07ed-43c0-902d-1d3b98306225 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:58.708995 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e55ac3cb-07ed-43c0-902d-1d3b98306225 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:58.743589 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e55ac3cb-07ed-43c0-902d-1d3b98306225 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:58.744116 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e55ac3cb-07ed-43c0-902d-1d3b98306225 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:58.744566 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e55ac3cb-07ed-43c0-902d-1d3b98306225 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:58.745177 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-e55ac3cb-07ed-43c0-902d-1d3b98306225 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lazy-loading 'fault' on Instance uuid a399f404-604c-431e-896d-edacded36702 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 02:11:58.787614 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e55ac3cb-07ed-43c0-902d-1d3b98306225 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09cb536a0a584f5f96bec5fca7afa3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '435945eeab2f42d386f48f7374bbd488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:11:58.794819 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e55ac3cb-07ed-43c0-902d-1d3b98306225 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 200 len: 1329 microversion: 2.1 time: 0.102593 Aug 07 02:11:58.795397 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3701/6937] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:58 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 1329 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:11:59.815662 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c5189a56-ef99-45c9-b41e-177dead1f20b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:59.816332 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c5189a56-ef99-45c9-b41e-177dead1f20b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:59.823227 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c5189a56-ef99-45c9-b41e-177dead1f20b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:59.823715 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c5189a56-ef99-45c9-b41e-177dead1f20b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:59.824183 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c5189a56-ef99-45c9-b41e-177dead1f20b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:59.824884 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c5189a56-ef99-45c9-b41e-177dead1f20b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:59.825344 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c5189a56-ef99-45c9-b41e-177dead1f20b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:59.825779 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c5189a56-ef99-45c9-b41e-177dead1f20b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:59.839294 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-c5189a56-ef99-45c9-b41e-177dead1f20b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] HTTP exception thrown: Instance a399f404-604c-431e-896d-edacded36702 could not be found. Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c5189a56-ef99-45c9-b41e-177dead1f20b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Request method failure captured: Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 HTTP/1.1 Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7x4hybynvxArQPeqt6CwV9Zs1N98xbn7O53qD-I8GCKutNl3jQRH4SvGrtWmYp2NG3dElrq0t1Ij5yq_G1gf33oIjYTVPSXt-tZSpufSbtrWCtdgSWSFbRz6TTImh-9pnxWIZSiSH_u6yWkLly4eko2V8UgCYC1x-j0UNpE9qntkRl0 Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 435945eeab2f42d386f48f7374bbd488 Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_435945eeab2f42d386f48f7374bbd488", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 435945eeab2f42d386f48f7374bbd488 Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServerActionsTestJSON-1683144832-project Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 09cb536a0a584f5f96bec5fca7afa3b4 Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServerActionsTestJSON-1683144832-project Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: exception: Instance a399f404-604c-431e-896d-edacded36702 could not be found. Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'a399f404-604c-431e-896d-edacded36702'} Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a399f404-604c-431e-896d-edacded36702 could not be found. Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a399f404-604c-431e-896d-edacded36702 could not be found. Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:11:59.840942 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:11:59.845053 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:11:59.845053 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:11:59.845053 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:11:59.845053 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:11:59.845053 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:11:59.845053 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a399f404-604c-431e-896d-edacded36702 could not be found. Aug 07 02:11:59.845053 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:11:59.845053 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c5189a56-ef99-45c9-b41e-177dead1f20b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Returning 404 to user: Instance a399f404-604c-431e-896d-edacded36702 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:11:59.845053 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c5189a56-ef99-45c9-b41e-177dead1f20b tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 404 len: 111 microversion: 2.1 time: 0.030603 Aug 07 02:11:59.845053 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3237/6938] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:11:59 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:11:59.901181 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6c5cb311-9a4e-4f05-a9c9-96a79f025077 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:11:59.903361 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6c5cb311-9a4e-4f05-a9c9-96a79f025077 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:11:59.910881 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c5cb311-9a4e-4f05-a9c9-96a79f025077 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:59.911387 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c5cb311-9a4e-4f05-a9c9-96a79f025077 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:59.911840 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c5cb311-9a4e-4f05-a9c9-96a79f025077 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:59.912587 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c5cb311-9a4e-4f05-a9c9-96a79f025077 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:11:59.913061 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c5cb311-9a4e-4f05-a9c9-96a79f025077 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:11:59.913509 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6c5cb311-9a4e-4f05-a9c9-96a79f025077 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:11:59.926233 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-6c5cb311-9a4e-4f05-a9c9-96a79f025077 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] HTTP exception thrown: Instance a399f404-604c-431e-896d-edacded36702 could not be found. Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6c5cb311-9a4e-4f05-a9c9-96a79f025077 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Request method failure captured: Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702/os-volume_attachments HTTP/1.1 Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7x4hybynvxArQPeqt6CwV9Zs1N98xbn7O53qD-I8GCKutNl3jQRH4SvGrtWmYp2NG3dElrq0t1Ij5yq_G1gf33oIjYTVPSXt-tZSpufSbtrWCtdgSWSFbRz6TTImh-9pnxWIZSiSH_u6yWkLly4eko2V8UgCYC1x-j0UNpE9qntkRl0 Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 435945eeab2f42d386f48f7374bbd488 Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_435945eeab2f42d386f48f7374bbd488", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 435945eeab2f42d386f48f7374bbd488 Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServerActionsTestJSON-1683144832-project Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 09cb536a0a584f5f96bec5fca7afa3b4 Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServerActionsTestJSON-1683144832-project Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: exception: Instance a399f404-604c-431e-896d-edacded36702 could not be found. Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: action_args: {'server_id': 'a399f404-604c-431e-896d-edacded36702'} Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a399f404-604c-431e-896d-edacded36702 could not be found. Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:11:59.927930 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:11:59.932104 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a399f404-604c-431e-896d-edacded36702 could not be found. Aug 07 02:11:59.932104 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:11:59.932104 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:11:59.932104 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:11:59.932104 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:11:59.932104 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:11:59.932104 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:11:59.932104 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:11:59.932104 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:11:59.932104 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a399f404-604c-431e-896d-edacded36702 could not be found. Aug 07 02:11:59.932104 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:11:59.932104 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6c5cb311-9a4e-4f05-a9c9-96a79f025077 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Returning 404 to user: Instance a399f404-604c-431e-896d-edacded36702 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:11:59.932104 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6c5cb311-9a4e-4f05-a9c9-96a79f025077 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032282 Aug 07 02:11:59.932104 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3702/6939] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 02:11:59 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:12:03.244657 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d9ce7f87-0679-4f75-8afd-9a20014c16fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:03.245162 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d9ce7f87-0679-4f75-8afd-9a20014c16fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:03.252250 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9ce7f87-0679-4f75-8afd-9a20014c16fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:03.252740 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9ce7f87-0679-4f75-8afd-9a20014c16fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:03.253184 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9ce7f87-0679-4f75-8afd-9a20014c16fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:03.253900 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9ce7f87-0679-4f75-8afd-9a20014c16fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:03.254359 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9ce7f87-0679-4f75-8afd-9a20014c16fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:03.254791 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9ce7f87-0679-4f75-8afd-9a20014c16fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:03.268259 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-d9ce7f87-0679-4f75-8afd-9a20014c16fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] HTTP exception thrown: Instance a399f404-604c-431e-896d-edacded36702 could not be found. Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d9ce7f87-0679-4f75-8afd-9a20014c16fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Request method failure captured: Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 HTTP/1.1 Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7x4hybynvxArQPeqt6CwV9Zs1N98xbn7O53qD-I8GCKutNl3jQRH4SvGrtWmYp2NG3dElrq0t1Ij5yq_G1gf33oIjYTVPSXt-tZSpufSbtrWCtdgSWSFbRz6TTImh-9pnxWIZSiSH_u6yWkLly4eko2V8UgCYC1x-j0UNpE9qntkRl0 Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 435945eeab2f42d386f48f7374bbd488 Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_435945eeab2f42d386f48f7374bbd488", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 435945eeab2f42d386f48f7374bbd488 Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServerActionsTestJSON-1683144832-project Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 09cb536a0a584f5f96bec5fca7afa3b4 Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServerActionsTestJSON-1683144832-project Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: exception: Instance a399f404-604c-431e-896d-edacded36702 could not be found. Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'a399f404-604c-431e-896d-edacded36702'} Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a399f404-604c-431e-896d-edacded36702 could not be found. Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:12:03.269804 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:12:03.275862 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a399f404-604c-431e-896d-edacded36702 could not be found. Aug 07 02:12:03.275862 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.275862 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:12:03.275862 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.275862 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:03.275862 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:12:03.275862 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:12:03.275862 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:12:03.275862 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:12:03.275862 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a399f404-604c-431e-896d-edacded36702 could not be found. Aug 07 02:12:03.275862 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.275862 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d9ce7f87-0679-4f75-8afd-9a20014c16fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Returning 404 to user: Instance a399f404-604c-431e-896d-edacded36702 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:12:03.275862 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d9ce7f87-0679-4f75-8afd-9a20014c16fc tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 404 len: 111 microversion: 2.1 time: 0.030482 Aug 07 02:12:03.275862 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3238/6940] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 02:12:03 2022] DELETE /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:12:03.279819 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c715a8e5-3de5-4a42-9168-d8b6b8af49d1 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:03.280623 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c715a8e5-3de5-4a42-9168-d8b6b8af49d1 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a399f404-604c-431e-896d-edacded36702] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:03.288086 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c715a8e5-3de5-4a42-9168-d8b6b8af49d1 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:03.288579 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c715a8e5-3de5-4a42-9168-d8b6b8af49d1 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:03.289030 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c715a8e5-3de5-4a42-9168-d8b6b8af49d1 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:03.289737 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c715a8e5-3de5-4a42-9168-d8b6b8af49d1 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:03.290234 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c715a8e5-3de5-4a42-9168-d8b6b8af49d1 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:03.290944 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c715a8e5-3de5-4a42-9168-d8b6b8af49d1 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:03.304964 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-c715a8e5-3de5-4a42-9168-d8b6b8af49d1 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] HTTP exception thrown: Instance a399f404-604c-431e-896d-edacded36702 could not be found. Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c715a8e5-3de5-4a42-9168-d8b6b8af49d1 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Request method failure captured: Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 HTTP/1.1 Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7x4hybynvxArQPeqt6CwV9Zs1N98xbn7O53qD-I8GCKutNl3jQRH4SvGrtWmYp2NG3dElrq0t1Ij5yq_G1gf33oIjYTVPSXt-tZSpufSbtrWCtdgSWSFbRz6TTImh-9pnxWIZSiSH_u6yWkLly4eko2V8UgCYC1x-j0UNpE9qntkRl0 Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 435945eeab2f42d386f48f7374bbd488 Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_435945eeab2f42d386f48f7374bbd488", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 435945eeab2f42d386f48f7374bbd488 Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServerActionsTestJSON-1683144832-project Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 09cb536a0a584f5f96bec5fca7afa3b4 Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServerActionsTestJSON-1683144832-project Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: exception: Instance a399f404-604c-431e-896d-edacded36702 could not be found. Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'a399f404-604c-431e-896d-edacded36702'} Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a399f404-604c-431e-896d-edacded36702 could not be found. Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a399f404-604c-431e-896d-edacded36702 could not be found. Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:12:03.306481 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.310222 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:03.310222 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:12:03.310222 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:12:03.310222 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:12:03.310222 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:12:03.310222 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a399f404-604c-431e-896d-edacded36702 could not be found. Aug 07 02:12:03.310222 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.310222 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c715a8e5-3de5-4a42-9168-d8b6b8af49d1 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Returning 404 to user: Instance a399f404-604c-431e-896d-edacded36702 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:12:03.310222 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c715a8e5-3de5-4a42-9168-d8b6b8af49d1 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702" status: 404 len: 111 microversion: 2.1 time: 0.031959 Aug 07 02:12:03.310222 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3703/6941] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:03 2022] GET /compute/v2.1/servers/a399f404-604c-431e-896d-edacded36702 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:12:03.316458 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-91c10959-db27-40dd-ae86-415ed3212226 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:03.316956 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-91c10959-db27-40dd-ae86-415ed3212226 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:03.322797 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-91c10959-db27-40dd-ae86-415ed3212226 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:03.323269 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-91c10959-db27-40dd-ae86-415ed3212226 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:03.323698 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-91c10959-db27-40dd-ae86-415ed3212226 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:03.324419 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-91c10959-db27-40dd-ae86-415ed3212226 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:03.324867 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-91c10959-db27-40dd-ae86-415ed3212226 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:03.325289 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-91c10959-db27-40dd-ae86-415ed3212226 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:03.341033 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-91c10959-db27-40dd-ae86-415ed3212226 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] HTTP exception thrown: Instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 could not be found. Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-91c10959-db27-40dd-ae86-415ed3212226 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Request method failure captured: Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 HTTP/1.1 Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7x4hybynvxArQPeqt6CwV9Zs1N98xbn7O53qD-I8GCKutNl3jQRH4SvGrtWmYp2NG3dElrq0t1Ij5yq_G1gf33oIjYTVPSXt-tZSpufSbtrWCtdgSWSFbRz6TTImh-9pnxWIZSiSH_u6yWkLly4eko2V8UgCYC1x-j0UNpE9qntkRl0 Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 435945eeab2f42d386f48f7374bbd488 Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_435945eeab2f42d386f48f7374bbd488", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 435945eeab2f42d386f48f7374bbd488 Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServerActionsTestJSON-1683144832-project Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 09cb536a0a584f5f96bec5fca7afa3b4 Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServerActionsTestJSON-1683144832-project Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: exception: Instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 could not be found. Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'a5ef4713-8e0d-4bc3-80e3-0d040f248c09'} Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 could not be found. Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:12:03.342567 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:12:03.350602 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 could not be found. Aug 07 02:12:03.350602 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.350602 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:12:03.350602 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.350602 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:03.350602 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:12:03.350602 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:12:03.350602 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:12:03.350602 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:12:03.350602 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 could not be found. Aug 07 02:12:03.350602 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.350602 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-91c10959-db27-40dd-ae86-415ed3212226 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Returning 404 to user: Instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:12:03.350602 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-91c10959-db27-40dd-ae86-415ed3212226 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 404 len: 111 microversion: 2.1 time: 0.031361 Aug 07 02:12:03.350602 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3239/6942] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 02:12:03 2022] DELETE /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:12:03.355933 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-afd57b71-76a6-459a-929a-e4843c85ad77 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:03.356585 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-afd57b71-76a6-459a-929a-e4843c85ad77 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: a5ef4713-8e0d-4bc3-80e3-0d040f248c09] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:03.363649 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-afd57b71-76a6-459a-929a-e4843c85ad77 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:03.364176 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-afd57b71-76a6-459a-929a-e4843c85ad77 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:03.364634 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-afd57b71-76a6-459a-929a-e4843c85ad77 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:03.365373 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-afd57b71-76a6-459a-929a-e4843c85ad77 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:03.365844 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-afd57b71-76a6-459a-929a-e4843c85ad77 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:03.366289 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-afd57b71-76a6-459a-929a-e4843c85ad77 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:03.382090 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-afd57b71-76a6-459a-929a-e4843c85ad77 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] HTTP exception thrown: Instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 could not be found. Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-afd57b71-76a6-459a-929a-e4843c85ad77 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Request method failure captured: Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 HTTP/1.1 Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7x4hybynvxArQPeqt6CwV9Zs1N98xbn7O53qD-I8GCKutNl3jQRH4SvGrtWmYp2NG3dElrq0t1Ij5yq_G1gf33oIjYTVPSXt-tZSpufSbtrWCtdgSWSFbRz6TTImh-9pnxWIZSiSH_u6yWkLly4eko2V8UgCYC1x-j0UNpE9qntkRl0 Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 435945eeab2f42d386f48f7374bbd488 Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_435945eeab2f42d386f48f7374bbd488", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 435945eeab2f42d386f48f7374bbd488 Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServerActionsTestJSON-1683144832-project Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 09cb536a0a584f5f96bec5fca7afa3b4 Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServerActionsTestJSON-1683144832-project Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: exception: Instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 could not be found. Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'a5ef4713-8e0d-4bc3-80e3-0d040f248c09'} Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 could not be found. Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 could not be found. Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:12:03.383680 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.387825 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:03.387825 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:12:03.387825 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:12:03.387825 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:12:03.387825 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:12:03.387825 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 could not be found. Aug 07 02:12:03.387825 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.387825 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-afd57b71-76a6-459a-929a-e4843c85ad77 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Returning 404 to user: Instance a5ef4713-8e0d-4bc3-80e3-0d040f248c09 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:12:03.387825 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-afd57b71-76a6-459a-929a-e4843c85ad77 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09" status: 404 len: 111 microversion: 2.1 time: 0.034599 Aug 07 02:12:03.387825 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3704/6943] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:03 2022] GET /compute/v2.1/servers/a5ef4713-8e0d-4bc3-80e3-0d040f248c09 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:12:03.394730 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c0a33bc4-5296-4b64-b326-6d4a9e152b8d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:03.395230 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c0a33bc4-5296-4b64-b326-6d4a9e152b8d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:03.401488 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c0a33bc4-5296-4b64-b326-6d4a9e152b8d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:03.401977 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c0a33bc4-5296-4b64-b326-6d4a9e152b8d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:03.402414 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c0a33bc4-5296-4b64-b326-6d4a9e152b8d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:03.403123 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c0a33bc4-5296-4b64-b326-6d4a9e152b8d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:03.403581 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c0a33bc4-5296-4b64-b326-6d4a9e152b8d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:03.404037 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c0a33bc4-5296-4b64-b326-6d4a9e152b8d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:03.419517 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-c0a33bc4-5296-4b64-b326-6d4a9e152b8d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] HTTP exception thrown: Instance 014e3168-a704-44d1-a867-3232988cfe15 could not be found. Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c0a33bc4-5296-4b64-b326-6d4a9e152b8d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Request method failure captured: Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 HTTP/1.1 Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7x4hybynvxArQPeqt6CwV9Zs1N98xbn7O53qD-I8GCKutNl3jQRH4SvGrtWmYp2NG3dElrq0t1Ij5yq_G1gf33oIjYTVPSXt-tZSpufSbtrWCtdgSWSFbRz6TTImh-9pnxWIZSiSH_u6yWkLly4eko2V8UgCYC1x-j0UNpE9qntkRl0 Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 435945eeab2f42d386f48f7374bbd488 Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_435945eeab2f42d386f48f7374bbd488", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 435945eeab2f42d386f48f7374bbd488 Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServerActionsTestJSON-1683144832-project Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 09cb536a0a584f5f96bec5fca7afa3b4 Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServerActionsTestJSON-1683144832-project Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 014e3168-a704-44d1-a867-3232988cfe15 could not be found. Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '014e3168-a704-44d1-a867-3232988cfe15'} Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 014e3168-a704-44d1-a867-3232988cfe15 could not be found. Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:12:03.421098 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:12:03.424614 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 014e3168-a704-44d1-a867-3232988cfe15 could not be found. Aug 07 02:12:03.424614 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.424614 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:12:03.424614 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.424614 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:03.424614 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:12:03.424614 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:12:03.424614 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:12:03.424614 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:12:03.424614 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 014e3168-a704-44d1-a867-3232988cfe15 could not be found. Aug 07 02:12:03.424614 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.424614 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c0a33bc4-5296-4b64-b326-6d4a9e152b8d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Returning 404 to user: Instance 014e3168-a704-44d1-a867-3232988cfe15 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:12:03.424614 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c0a33bc4-5296-4b64-b326-6d4a9e152b8d tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "DELETE /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 404 len: 111 microversion: 2.1 time: 0.032284 Aug 07 02:12:03.424614 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3240/6944] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 02:12:03 2022] DELETE /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:12:03.431170 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1c7782f4-5361-4173-9b0e-f4ea469cee8c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:03.431801 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1c7782f4-5361-4173-9b0e-f4ea469cee8c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 014e3168-a704-44d1-a867-3232988cfe15] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:03.438066 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c7782f4-5361-4173-9b0e-f4ea469cee8c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:03.438570 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c7782f4-5361-4173-9b0e-f4ea469cee8c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:03.439022 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c7782f4-5361-4173-9b0e-f4ea469cee8c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:03.439743 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c7782f4-5361-4173-9b0e-f4ea469cee8c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:03.440278 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c7782f4-5361-4173-9b0e-f4ea469cee8c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:03.440724 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c7782f4-5361-4173-9b0e-f4ea469cee8c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:03.455014 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-1c7782f4-5361-4173-9b0e-f4ea469cee8c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] HTTP exception thrown: Instance 014e3168-a704-44d1-a867-3232988cfe15 could not be found. Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1c7782f4-5361-4173-9b0e-f4ea469cee8c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Request method failure captured: Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 HTTP/1.1 Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7x4hybynvxArQPeqt6CwV9Zs1N98xbn7O53qD-I8GCKutNl3jQRH4SvGrtWmYp2NG3dElrq0t1Ij5yq_G1gf33oIjYTVPSXt-tZSpufSbtrWCtdgSWSFbRz6TTImh-9pnxWIZSiSH_u6yWkLly4eko2V8UgCYC1x-j0UNpE9qntkRl0 Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 435945eeab2f42d386f48f7374bbd488 Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_435945eeab2f42d386f48f7374bbd488", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 435945eeab2f42d386f48f7374bbd488 Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServerActionsTestJSON-1683144832-project Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 09cb536a0a584f5f96bec5fca7afa3b4 Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServerActionsTestJSON-1683144832-project Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 014e3168-a704-44d1-a867-3232988cfe15 could not be found. Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '014e3168-a704-44d1-a867-3232988cfe15'} Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 014e3168-a704-44d1-a867-3232988cfe15 could not be found. Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 014e3168-a704-44d1-a867-3232988cfe15 could not be found. Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:12:03.456589 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.460312 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:03.460312 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:12:03.460312 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:12:03.460312 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:12:03.460312 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:12:03.460312 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 014e3168-a704-44d1-a867-3232988cfe15 could not be found. Aug 07 02:12:03.460312 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.460312 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1c7782f4-5361-4173-9b0e-f4ea469cee8c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Returning 404 to user: Instance 014e3168-a704-44d1-a867-3232988cfe15 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:12:03.460312 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1c7782f4-5361-4173-9b0e-f4ea469cee8c tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15" status: 404 len: 111 microversion: 2.1 time: 0.030749 Aug 07 02:12:03.460312 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3705/6945] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:03 2022] GET /compute/v2.1/servers/014e3168-a704-44d1-a867-3232988cfe15 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:12:03.466594 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-10393664-63b1-4faf-9baf-46ded4fc01c8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:03.467162 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-10393664-63b1-4faf-9baf-46ded4fc01c8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:03.473901 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10393664-63b1-4faf-9baf-46ded4fc01c8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:03.474450 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10393664-63b1-4faf-9baf-46ded4fc01c8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:03.474963 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10393664-63b1-4faf-9baf-46ded4fc01c8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:03.475723 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10393664-63b1-4faf-9baf-46ded4fc01c8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:03.476271 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10393664-63b1-4faf-9baf-46ded4fc01c8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:03.476763 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-10393664-63b1-4faf-9baf-46ded4fc01c8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:03.490424 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-10393664-63b1-4faf-9baf-46ded4fc01c8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] HTTP exception thrown: Instance 6829b067-c1af-48f2-9556-caacccfd8f34 could not be found. Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-10393664-63b1-4faf-9baf-46ded4fc01c8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Request method failure captured: Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 HTTP/1.1 Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7x4hybynvxArQPeqt6CwV9Zs1N98xbn7O53qD-I8GCKutNl3jQRH4SvGrtWmYp2NG3dElrq0t1Ij5yq_G1gf33oIjYTVPSXt-tZSpufSbtrWCtdgSWSFbRz6TTImh-9pnxWIZSiSH_u6yWkLly4eko2V8UgCYC1x-j0UNpE9qntkRl0 Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 435945eeab2f42d386f48f7374bbd488 Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_435945eeab2f42d386f48f7374bbd488", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 435945eeab2f42d386f48f7374bbd488 Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServerActionsTestJSON-1683144832-project Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 09cb536a0a584f5f96bec5fca7afa3b4 Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServerActionsTestJSON-1683144832-project Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 6829b067-c1af-48f2-9556-caacccfd8f34 could not be found. Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '6829b067-c1af-48f2-9556-caacccfd8f34'} Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6829b067-c1af-48f2-9556-caacccfd8f34 could not be found. Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:12:03.491937 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:12:03.495712 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6829b067-c1af-48f2-9556-caacccfd8f34 could not be found. Aug 07 02:12:03.495712 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.495712 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:12:03.495712 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.495712 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:03.495712 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:12:03.495712 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:12:03.495712 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:12:03.495712 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:12:03.495712 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6829b067-c1af-48f2-9556-caacccfd8f34 could not be found. Aug 07 02:12:03.495712 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.495712 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-10393664-63b1-4faf-9baf-46ded4fc01c8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Returning 404 to user: Instance 6829b067-c1af-48f2-9556-caacccfd8f34 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:12:03.495712 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-10393664-63b1-4faf-9baf-46ded4fc01c8 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 404 len: 111 microversion: 2.1 time: 0.030603 Aug 07 02:12:03.495712 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3241/6946] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 02:12:03 2022] DELETE /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:12:03.501903 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4cabe085-1294-4846-a6b0-95dad6a6fab0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:03.502538 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4cabe085-1294-4846-a6b0-95dad6a6fab0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] [instance: 6829b067-c1af-48f2-9556-caacccfd8f34] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:03.508672 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4cabe085-1294-4846-a6b0-95dad6a6fab0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:03.509170 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4cabe085-1294-4846-a6b0-95dad6a6fab0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:03.509626 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4cabe085-1294-4846-a6b0-95dad6a6fab0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:03.510336 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4cabe085-1294-4846-a6b0-95dad6a6fab0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:03.510808 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4cabe085-1294-4846-a6b0-95dad6a6fab0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:03.511254 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4cabe085-1294-4846-a6b0-95dad6a6fab0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:03.525799 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-4cabe085-1294-4846-a6b0-95dad6a6fab0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] HTTP exception thrown: Instance 6829b067-c1af-48f2-9556-caacccfd8f34 could not be found. Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4cabe085-1294-4846-a6b0-95dad6a6fab0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Request method failure captured: Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 HTTP/1.1 Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7x4hybynvxArQPeqt6CwV9Zs1N98xbn7O53qD-I8GCKutNl3jQRH4SvGrtWmYp2NG3dElrq0t1Ij5yq_G1gf33oIjYTVPSXt-tZSpufSbtrWCtdgSWSFbRz6TTImh-9pnxWIZSiSH_u6yWkLly4eko2V8UgCYC1x-j0UNpE9qntkRl0 Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 435945eeab2f42d386f48f7374bbd488 Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_435945eeab2f42d386f48f7374bbd488", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/435945eeab2f42d386f48f7374bbd488"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 435945eeab2f42d386f48f7374bbd488 Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServerActionsTestJSON-1683144832 Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServerActionsTestJSON-1683144832-project Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 09cb536a0a584f5f96bec5fca7afa3b4 Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServerActionsTestJSON-1683144832-project Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 6829b067-c1af-48f2-9556-caacccfd8f34 could not be found. Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '6829b067-c1af-48f2-9556-caacccfd8f34'} Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6829b067-c1af-48f2-9556-caacccfd8f34 could not be found. Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6829b067-c1af-48f2-9556-caacccfd8f34 could not be found. Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:12:03.527333 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.531301 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:03.531301 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:12:03.531301 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:12:03.531301 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:12:03.531301 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:12:03.531301 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6829b067-c1af-48f2-9556-caacccfd8f34 could not be found. Aug 07 02:12:03.531301 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:12:03.531301 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4cabe085-1294-4846-a6b0-95dad6a6fab0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Returning 404 to user: Instance 6829b067-c1af-48f2-9556-caacccfd8f34 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:12:03.531301 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4cabe085-1294-4846-a6b0-95dad6a6fab0 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34" status: 404 len: 111 microversion: 2.1 time: 0.030832 Aug 07 02:12:03.531301 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3706/6947] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:03 2022] GET /compute/v2.1/servers/6829b067-c1af-48f2-9556-caacccfd8f34 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:12:03.538147 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e2fdc04c-e56a-4cab-8c1d-63ceb8c625f4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] Calling method '.version_select at 0x7f9e173c6ca0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:03.561825 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e2fdc04c-e56a-4cab-8c1d-63ceb8c625f4 tempest-ServerActionsTestJSON-1683144832 tempest-ServerActionsTestJSON-1683144832-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1891336762" status: 202 len: 0 microversion: 2.1 time: 0.027386 Aug 07 02:12:03.562599 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3242/6948] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Aug 7 02:12:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1891336762 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:12:12.806735 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9e3dbc80-3d39-4d7c-931d-ff5ff0b35bc8 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1268801778", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "c4164b33-3136-4887-bc05-5f1cd1b4fe10"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:12:12.871631 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-9e3dbc80-3d39-4d7c-931d-ff5ff0b35bc8 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] validate_networks() for [('c4164b33-3136-4887-bc05-5f1cd1b4fe10', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 02:12:13.282691 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-9e3dbc80-3d39-4d7c-931d-ff5ff0b35bc8 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 02:12:13.283199 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-9e3dbc80-3d39-4d7c-931d-ff5ff0b35bc8 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 02:12:13.283685 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-9e3dbc80-3d39-4d7c-931d-ff5ff0b35bc8 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 02:12:13.284182 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-9e3dbc80-3d39-4d7c-931d-ff5ff0b35bc8 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 02:12:13.284605 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-9e3dbc80-3d39-4d7c-931d-ff5ff0b35bc8 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 02:12:13.293975 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e3dbc80-3d39-4d7c-931d-ff5ff0b35bc8 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:13.294471 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e3dbc80-3d39-4d7c-931d-ff5ff0b35bc8 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:13.294916 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e3dbc80-3d39-4d7c-931d-ff5ff0b35bc8 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:13.295658 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e3dbc80-3d39-4d7c-931d-ff5ff0b35bc8 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:13.296145 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e3dbc80-3d39-4d7c-931d-ff5ff0b35bc8 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:13.296582 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e3dbc80-3d39-4d7c-931d-ff5ff0b35bc8 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:13.316293 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-9e3dbc80-3d39-4d7c-931d-ff5ff0b35bc8 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Getting quotas for project 1694bfebb9414fcd90bfdef30d061be0. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:12:13.321912 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-9e3dbc80-3d39-4d7c-931d-ff5ff0b35bc8 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Getting quotas for user 53d0dd0eddee4fd4b9f23b4a6c79ce07 and project 1694bfebb9414fcd90bfdef30d061be0. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:12:13.335134 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9e3dbc80-3d39-4d7c-931d-ff5ff0b35bc8 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 02:12:13.337624 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9e3dbc80-3d39-4d7c-931d-ff5ff0b35bc8 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: 11a2d425-8959-4a3c-ae10-ad8aa0364aff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 02:12:13.384218 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9e3dbc80-3d39-4d7c-931d-ff5ff0b35bc8 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.737279 Aug 07 02:12:13.384872 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3707/6949] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 02:12:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 02:12:13.397678 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e197a62e-0c84-48bc-874b-935d16e1667c tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:13.398475 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e197a62e-0c84-48bc-874b-935d16e1667c tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: 11a2d425-8959-4a3c-ae10-ad8aa0364aff] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:13.473748 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e197a62e-0c84-48bc-874b-935d16e1667c tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d0dd0eddee4fd4b9f23b4a6c79ce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1694bfebb9414fcd90bfdef30d061be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:12:13.485096 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=23 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:12:13.489195 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e197a62e-0c84-48bc-874b-935d16e1667c tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff" status: 200 len: 1217 microversion: 2.1 time: 0.097105 Aug 07 02:12:13.490178 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3243/6950] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:13 2022] GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:12:14.520054 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b5768013-6bd7-49ae-ae03-3ee9da9977a7 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:14.520609 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b5768013-6bd7-49ae-ae03-3ee9da9977a7 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: 11a2d425-8959-4a3c-ae10-ad8aa0364aff] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:14.581949 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b5768013-6bd7-49ae-ae03-3ee9da9977a7 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d0dd0eddee4fd4b9f23b4a6c79ce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1694bfebb9414fcd90bfdef30d061be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:12:14.591170 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b5768013-6bd7-49ae-ae03-3ee9da9977a7 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff" status: 200 len: 1217 microversion: 2.1 time: 0.076564 Aug 07 02:12:14.602232 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3708/6951] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:14 2022] GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff => generated 1217 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:12:15.612637 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-443ea738-0e43-4b82-943a-5eff1856c26a tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:15.613294 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-443ea738-0e43-4b82-943a-5eff1856c26a tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: 11a2d425-8959-4a3c-ae10-ad8aa0364aff] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:15.666516 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-443ea738-0e43-4b82-943a-5eff1856c26a tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d0dd0eddee4fd4b9f23b4a6c79ce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1694bfebb9414fcd90bfdef30d061be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:12:15.673740 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-443ea738-0e43-4b82-943a-5eff1856c26a tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff" status: 200 len: 1217 microversion: 2.1 time: 0.065490 Aug 07 02:12:15.674781 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3244/6952] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:15 2022] GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff => generated 1217 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:12:16.698886 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b0003221-5732-46e4-beb6-77af095173ef tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:16.699858 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b0003221-5732-46e4-beb6-77af095173ef tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: 11a2d425-8959-4a3c-ae10-ad8aa0364aff] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:16.707506 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b0003221-5732-46e4-beb6-77af095173ef tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:16.708329 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b0003221-5732-46e4-beb6-77af095173ef tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:16.708851 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b0003221-5732-46e4-beb6-77af095173ef tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:16.709939 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b0003221-5732-46e4-beb6-77af095173ef tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:16.710485 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b0003221-5732-46e4-beb6-77af095173ef tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:16.711131 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b0003221-5732-46e4-beb6-77af095173ef tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:16.788825 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b0003221-5732-46e4-beb6-77af095173ef tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d0dd0eddee4fd4b9f23b4a6c79ce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1694bfebb9414fcd90bfdef30d061be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:12:16.804299 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b0003221-5732-46e4-beb6-77af095173ef tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff" status: 200 len: 1275 microversion: 2.1 time: 0.109474 Aug 07 02:12:16.805140 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3709/6953] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:16 2022] GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff => generated 1275 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:12:17.826847 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cb6dddf4-ad48-48cc-9b52-daf9c6afa6be tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:17.827503 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-cb6dddf4-ad48-48cc-9b52-daf9c6afa6be tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: 11a2d425-8959-4a3c-ae10-ad8aa0364aff] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:17.851762 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cb6dddf4-ad48-48cc-9b52-daf9c6afa6be tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:17.852352 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cb6dddf4-ad48-48cc-9b52-daf9c6afa6be tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:17.853167 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cb6dddf4-ad48-48cc-9b52-daf9c6afa6be tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:17.853941 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cb6dddf4-ad48-48cc-9b52-daf9c6afa6be tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:17.856804 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-7cac3b18-969d-4d12-a5c5-0b3d20f736d9 req-a477b408-4e23-4b72-8104-a3f8becaa12e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11a2d425-8959-4a3c-ae10-ad8aa0364aff", "tag": "8d986fd0-0911-4b55-9ff5-fd6be9fcc5b3"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:12:17.863216 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cb6dddf4-ad48-48cc-9b52-daf9c6afa6be tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:17.866618 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cb6dddf4-ad48-48cc-9b52-daf9c6afa6be tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:17.868071 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-7cac3b18-969d-4d12-a5c5-0b3d20f736d9 req-a477b408-4e23-4b72-8104-a3f8becaa12e service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:17.868726 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-7cac3b18-969d-4d12-a5c5-0b3d20f736d9 req-a477b408-4e23-4b72-8104-a3f8becaa12e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:17.869334 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-7cac3b18-969d-4d12-a5c5-0b3d20f736d9 req-a477b408-4e23-4b72-8104-a3f8becaa12e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:17.881373 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-7cac3b18-969d-4d12-a5c5-0b3d20f736d9 req-a477b408-4e23-4b72-8104-a3f8becaa12e service nova] Creating event network-changed:8d986fd0-0911-4b55-9ff5-fd6be9fcc5b3 for instance 11a2d425-8959-4a3c-ae10-ad8aa0364aff on n-h2-master-1 Aug 07 02:12:17.886258 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-7cac3b18-969d-4d12-a5c5-0b3d20f736d9 req-a477b408-4e23-4b72-8104-a3f8becaa12e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033463 Aug 07 02:12:17.887093 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3710/6954] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 02:12:18.012002 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-cb6dddf4-ad48-48cc-9b52-daf9c6afa6be tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d0dd0eddee4fd4b9f23b4a6c79ce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1694bfebb9414fcd90bfdef30d061be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:12:18.020289 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cb6dddf4-ad48-48cc-9b52-daf9c6afa6be tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff" status: 200 len: 1317 microversion: 2.1 time: 0.197924 Aug 07 02:12:18.020866 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3245/6955] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:17 2022] GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:12:19.042936 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f775866a-27dc-495c-a869-4c5d63b53284 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:19.043991 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f775866a-27dc-495c-a869-4c5d63b53284 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: 11a2d425-8959-4a3c-ae10-ad8aa0364aff] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:19.051140 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f775866a-27dc-495c-a869-4c5d63b53284 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:19.051632 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f775866a-27dc-495c-a869-4c5d63b53284 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:19.052108 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f775866a-27dc-495c-a869-4c5d63b53284 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:19.052839 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f775866a-27dc-495c-a869-4c5d63b53284 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:19.053282 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f775866a-27dc-495c-a869-4c5d63b53284 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:19.053719 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f775866a-27dc-495c-a869-4c5d63b53284 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:19.231200 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f775866a-27dc-495c-a869-4c5d63b53284 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d0dd0eddee4fd4b9f23b4a6c79ce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1694bfebb9414fcd90bfdef30d061be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:12:19.238774 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f775866a-27dc-495c-a869-4c5d63b53284 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff" status: 200 len: 1317 microversion: 2.1 time: 0.201103 Aug 07 02:12:19.239285 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3711/6956] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:19 2022] GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff => generated 1317 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:12:20.259780 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-eb83fa33-aa4c-4649-98f5-64e5a6fd783f tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:20.260484 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-eb83fa33-aa4c-4649-98f5-64e5a6fd783f tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: 11a2d425-8959-4a3c-ae10-ad8aa0364aff] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:20.267344 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb83fa33-aa4c-4649-98f5-64e5a6fd783f tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:20.267836 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb83fa33-aa4c-4649-98f5-64e5a6fd783f tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:20.268312 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb83fa33-aa4c-4649-98f5-64e5a6fd783f tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:20.269015 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb83fa33-aa4c-4649-98f5-64e5a6fd783f tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:20.269475 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb83fa33-aa4c-4649-98f5-64e5a6fd783f tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:20.269906 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eb83fa33-aa4c-4649-98f5-64e5a6fd783f tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:20.398617 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-eb83fa33-aa4c-4649-98f5-64e5a6fd783f tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d0dd0eddee4fd4b9f23b4a6c79ce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1694bfebb9414fcd90bfdef30d061be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:12:20.406125 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-eb83fa33-aa4c-4649-98f5-64e5a6fd783f tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff" status: 200 len: 1317 microversion: 2.1 time: 0.150360 Aug 07 02:12:20.406689 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3246/6957] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:20 2022] GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:12:21.427201 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f01818b8-2b83-48b8-9f8b-236ec03def21 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:21.428217 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f01818b8-2b83-48b8-9f8b-236ec03def21 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: 11a2d425-8959-4a3c-ae10-ad8aa0364aff] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:21.435052 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f01818b8-2b83-48b8-9f8b-236ec03def21 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:21.435543 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f01818b8-2b83-48b8-9f8b-236ec03def21 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:21.436018 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f01818b8-2b83-48b8-9f8b-236ec03def21 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:21.436729 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f01818b8-2b83-48b8-9f8b-236ec03def21 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:21.437187 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f01818b8-2b83-48b8-9f8b-236ec03def21 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:21.437625 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f01818b8-2b83-48b8-9f8b-236ec03def21 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:21.570056 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f01818b8-2b83-48b8-9f8b-236ec03def21 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d0dd0eddee4fd4b9f23b4a6c79ce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1694bfebb9414fcd90bfdef30d061be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:12:21.577557 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f01818b8-2b83-48b8-9f8b-236ec03def21 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff" status: 200 len: 1317 microversion: 2.1 time: 0.154312 Aug 07 02:12:21.578130 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3712/6958] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:21 2022] GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:12:22.599089 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c01757d9-8c4c-4527-9f4a-9abccdbf3534 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:22.599711 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c01757d9-8c4c-4527-9f4a-9abccdbf3534 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: 11a2d425-8959-4a3c-ae10-ad8aa0364aff] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:22.606559 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c01757d9-8c4c-4527-9f4a-9abccdbf3534 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:22.607039 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c01757d9-8c4c-4527-9f4a-9abccdbf3534 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:22.607475 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c01757d9-8c4c-4527-9f4a-9abccdbf3534 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:22.608200 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c01757d9-8c4c-4527-9f4a-9abccdbf3534 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:22.608956 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c01757d9-8c4c-4527-9f4a-9abccdbf3534 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:22.609049 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c01757d9-8c4c-4527-9f4a-9abccdbf3534 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:22.736462 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c01757d9-8c4c-4527-9f4a-9abccdbf3534 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d0dd0eddee4fd4b9f23b4a6c79ce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1694bfebb9414fcd90bfdef30d061be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:12:22.744540 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c01757d9-8c4c-4527-9f4a-9abccdbf3534 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff" status: 200 len: 1317 microversion: 2.1 time: 0.149858 Aug 07 02:12:22.745109 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3247/6959] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:22 2022] GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:12:23.497125 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-d798caab-acc7-45f1-b54b-3eb188ee3522 req-b42db9ea-c17e-45a3-a81c-06ababf4392d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11a2d425-8959-4a3c-ae10-ad8aa0364aff", "name": "network-vif-plugged", "status": "completed", "tag": "8d986fd0-0911-4b55-9ff5-fd6be9fcc5b3"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:12:23.503483 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:12:23.510528 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d798caab-acc7-45f1-b54b-3eb188ee3522 req-b42db9ea-c17e-45a3-a81c-06ababf4392d service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:23.511679 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d798caab-acc7-45f1-b54b-3eb188ee3522 req-b42db9ea-c17e-45a3-a81c-06ababf4392d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:23.512188 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d798caab-acc7-45f1-b54b-3eb188ee3522 req-b42db9ea-c17e-45a3-a81c-06ababf4392d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:23.516674 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=56 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:12:23.525380 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-d798caab-acc7-45f1-b54b-3eb188ee3522 req-b42db9ea-c17e-45a3-a81c-06ababf4392d service nova] Creating event network-vif-plugged:8d986fd0-0911-4b55-9ff5-fd6be9fcc5b3 for instance 11a2d425-8959-4a3c-ae10-ad8aa0364aff on n-h2-master-1 Aug 07 02:12:23.530392 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-d798caab-acc7-45f1-b54b-3eb188ee3522 req-b42db9ea-c17e-45a3-a81c-06ababf4392d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037022 Aug 07 02:12:23.531001 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3713/6960] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:12:23.764959 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ca5ff05c-d922-4599-94ae-201fde3b023d tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:23.765583 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ca5ff05c-d922-4599-94ae-201fde3b023d tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: 11a2d425-8959-4a3c-ae10-ad8aa0364aff] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:23.772462 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca5ff05c-d922-4599-94ae-201fde3b023d tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:23.772957 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca5ff05c-d922-4599-94ae-201fde3b023d tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:23.773398 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca5ff05c-d922-4599-94ae-201fde3b023d tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:23.774147 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca5ff05c-d922-4599-94ae-201fde3b023d tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:23.774612 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca5ff05c-d922-4599-94ae-201fde3b023d tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:23.775054 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ca5ff05c-d922-4599-94ae-201fde3b023d tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:23.907310 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ca5ff05c-d922-4599-94ae-201fde3b023d tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d0dd0eddee4fd4b9f23b4a6c79ce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1694bfebb9414fcd90bfdef30d061be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:12:23.915041 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ca5ff05c-d922-4599-94ae-201fde3b023d tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff" status: 200 len: 1317 microversion: 2.1 time: 0.153997 Aug 07 02:12:23.915632 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3248/6961] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:23 2022] GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:12:24.937044 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6ea7d95c-cb26-4f50-876e-1522e32aa47e tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:24.937769 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6ea7d95c-cb26-4f50-876e-1522e32aa47e tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: 11a2d425-8959-4a3c-ae10-ad8aa0364aff] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:24.941289 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=8 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:12:24.947222 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ea7d95c-cb26-4f50-876e-1522e32aa47e tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:24.947717 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ea7d95c-cb26-4f50-876e-1522e32aa47e tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:24.948219 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ea7d95c-cb26-4f50-876e-1522e32aa47e tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:24.948926 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ea7d95c-cb26-4f50-876e-1522e32aa47e tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:24.949386 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ea7d95c-cb26-4f50-876e-1522e32aa47e tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:24.949822 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ea7d95c-cb26-4f50-876e-1522e32aa47e tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:25.080960 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6ea7d95c-cb26-4f50-876e-1522e32aa47e tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d0dd0eddee4fd4b9f23b4a6c79ce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1694bfebb9414fcd90bfdef30d061be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:12:25.089135 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6ea7d95c-cb26-4f50-876e-1522e32aa47e tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff" status: 200 len: 1507 microversion: 2.1 time: 0.156437 Aug 07 02:12:25.089723 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3714/6962] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:24 2022] GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:12:25.148256 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-67ce88b0-192e-41a4-bef0-b842a21ac3bc tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1919866787", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "c4164b33-3136-4887-bc05-5f1cd1b4fe10"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:12:25.203311 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-67ce88b0-192e-41a4-bef0-b842a21ac3bc tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] validate_networks() for [('c4164b33-3136-4887-bc05-5f1cd1b4fe10', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 02:12:25.658513 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-67ce88b0-192e-41a4-bef0-b842a21ac3bc tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 02:12:25.658948 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-67ce88b0-192e-41a4-bef0-b842a21ac3bc tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 02:12:25.659943 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-67ce88b0-192e-41a4-bef0-b842a21ac3bc tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 02:12:25.660391 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-67ce88b0-192e-41a4-bef0-b842a21ac3bc tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 02:12:25.660807 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-67ce88b0-192e-41a4-bef0-b842a21ac3bc tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 02:12:25.670451 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-67ce88b0-192e-41a4-bef0-b842a21ac3bc tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:25.670940 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-67ce88b0-192e-41a4-bef0-b842a21ac3bc tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:25.671399 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-67ce88b0-192e-41a4-bef0-b842a21ac3bc tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:25.672167 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-67ce88b0-192e-41a4-bef0-b842a21ac3bc tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:25.672626 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-67ce88b0-192e-41a4-bef0-b842a21ac3bc tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:25.673056 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-67ce88b0-192e-41a4-bef0-b842a21ac3bc tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:25.696181 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-67ce88b0-192e-41a4-bef0-b842a21ac3bc tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Getting quotas for project 1694bfebb9414fcd90bfdef30d061be0. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:12:25.701583 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-67ce88b0-192e-41a4-bef0-b842a21ac3bc tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Getting quotas for user 53d0dd0eddee4fd4b9f23b4a6c79ce07 and project 1694bfebb9414fcd90bfdef30d061be0. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:12:25.715488 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-67ce88b0-192e-41a4-bef0-b842a21ac3bc tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 02:12:25.717811 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-67ce88b0-192e-41a4-bef0-b842a21ac3bc tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: f5c5672f-fb78-4cbf-84ae-90d03cc0d64d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 02:12:25.764272 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-67ce88b0-192e-41a4-bef0-b842a21ac3bc tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.620460 Aug 07 02:12:25.765145 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3249/6963] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 02:12:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 02:12:25.776116 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d601ee8d-0aed-4c16-9ef8-a07ca3437698 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:25.776753 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d601ee8d-0aed-4c16-9ef8-a07ca3437698 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: f5c5672f-fb78-4cbf-84ae-90d03cc0d64d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:25.830105 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d601ee8d-0aed-4c16-9ef8-a07ca3437698 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d0dd0eddee4fd4b9f23b4a6c79ce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1694bfebb9414fcd90bfdef30d061be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:12:25.837592 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d601ee8d-0aed-4c16-9ef8-a07ca3437698 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "GET /compute/v2.1/servers/f5c5672f-fb78-4cbf-84ae-90d03cc0d64d" status: 200 len: 1217 microversion: 2.1 time: 0.065719 Aug 07 02:12:25.838165 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3715/6964] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:25 2022] GET /compute/v2.1/servers/f5c5672f-fb78-4cbf-84ae-90d03cc0d64d => generated 1217 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:12:26.860472 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3342da1e-6ff5-4a7b-8b9d-5a425ac4fa9a tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:26.860983 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3342da1e-6ff5-4a7b-8b9d-5a425ac4fa9a tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: f5c5672f-fb78-4cbf-84ae-90d03cc0d64d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:26.868990 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3342da1e-6ff5-4a7b-8b9d-5a425ac4fa9a tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:26.869475 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3342da1e-6ff5-4a7b-8b9d-5a425ac4fa9a tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:26.869915 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3342da1e-6ff5-4a7b-8b9d-5a425ac4fa9a tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:26.870615 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3342da1e-6ff5-4a7b-8b9d-5a425ac4fa9a tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:26.871070 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3342da1e-6ff5-4a7b-8b9d-5a425ac4fa9a tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:26.871500 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3342da1e-6ff5-4a7b-8b9d-5a425ac4fa9a tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:26.932680 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3342da1e-6ff5-4a7b-8b9d-5a425ac4fa9a tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d0dd0eddee4fd4b9f23b4a6c79ce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1694bfebb9414fcd90bfdef30d061be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:12:26.940086 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3342da1e-6ff5-4a7b-8b9d-5a425ac4fa9a tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "GET /compute/v2.1/servers/f5c5672f-fb78-4cbf-84ae-90d03cc0d64d" status: 200 len: 1275 microversion: 2.1 time: 0.085121 Aug 07 02:12:26.941516 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3250/6965] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:26 2022] GET /compute/v2.1/servers/f5c5672f-fb78-4cbf-84ae-90d03cc0d64d => generated 1275 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:12:27.961827 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0c704d1b-45dc-4b42-94d9-6d3d382f5f47 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:27.962377 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0c704d1b-45dc-4b42-94d9-6d3d382f5f47 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: f5c5672f-fb78-4cbf-84ae-90d03cc0d64d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:27.970520 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c704d1b-45dc-4b42-94d9-6d3d382f5f47 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:27.971125 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c704d1b-45dc-4b42-94d9-6d3d382f5f47 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:27.971590 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c704d1b-45dc-4b42-94d9-6d3d382f5f47 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:27.972858 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c704d1b-45dc-4b42-94d9-6d3d382f5f47 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:27.973334 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c704d1b-45dc-4b42-94d9-6d3d382f5f47 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:27.973868 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c704d1b-45dc-4b42-94d9-6d3d382f5f47 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:28.115372 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0c704d1b-45dc-4b42-94d9-6d3d382f5f47 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d0dd0eddee4fd4b9f23b4a6c79ce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1694bfebb9414fcd90bfdef30d061be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:12:28.124777 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0c704d1b-45dc-4b42-94d9-6d3d382f5f47 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "GET /compute/v2.1/servers/f5c5672f-fb78-4cbf-84ae-90d03cc0d64d" status: 200 len: 1317 microversion: 2.1 time: 0.166958 Aug 07 02:12:28.125369 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3716/6966] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:27 2022] GET /compute/v2.1/servers/f5c5672f-fb78-4cbf-84ae-90d03cc0d64d => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:12:28.374168 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-bd12a093-a091-47f1-8392-935aa167fc90 req-c6e881e4-906a-4bce-a68e-3c0bc8840eab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5c5672f-fb78-4cbf-84ae-90d03cc0d64d", "tag": "5a1ad5ed-f2ce-43fa-b459-df9d0ff36030"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:12:28.380056 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:12:28.387270 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-bd12a093-a091-47f1-8392-935aa167fc90 req-c6e881e4-906a-4bce-a68e-3c0bc8840eab service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:28.387839 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-bd12a093-a091-47f1-8392-935aa167fc90 req-c6e881e4-906a-4bce-a68e-3c0bc8840eab service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:28.388402 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-bd12a093-a091-47f1-8392-935aa167fc90 req-c6e881e4-906a-4bce-a68e-3c0bc8840eab service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:28.401193 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-bd12a093-a091-47f1-8392-935aa167fc90 req-c6e881e4-906a-4bce-a68e-3c0bc8840eab service nova] Creating event network-changed:5a1ad5ed-f2ce-43fa-b459-df9d0ff36030 for instance f5c5672f-fb78-4cbf-84ae-90d03cc0d64d on n-h1-master-1 Aug 07 02:12:28.414466 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-bd12a093-a091-47f1-8392-935aa167fc90 req-c6e881e4-906a-4bce-a68e-3c0bc8840eab service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043862 Aug 07 02:12:28.415410 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3251/6967] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:12:29.144801 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fb7c22b0-d4db-4106-8cbd-3f4c4a3d15d1 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:29.145438 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fb7c22b0-d4db-4106-8cbd-3f4c4a3d15d1 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: f5c5672f-fb78-4cbf-84ae-90d03cc0d64d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:29.148187 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:12:29.153849 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fb7c22b0-d4db-4106-8cbd-3f4c4a3d15d1 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:29.154347 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fb7c22b0-d4db-4106-8cbd-3f4c4a3d15d1 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:29.154801 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fb7c22b0-d4db-4106-8cbd-3f4c4a3d15d1 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:29.155512 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fb7c22b0-d4db-4106-8cbd-3f4c4a3d15d1 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:29.156020 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fb7c22b0-d4db-4106-8cbd-3f4c4a3d15d1 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:29.156466 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fb7c22b0-d4db-4106-8cbd-3f4c4a3d15d1 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:29.286579 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fb7c22b0-d4db-4106-8cbd-3f4c4a3d15d1 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d0dd0eddee4fd4b9f23b4a6c79ce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1694bfebb9414fcd90bfdef30d061be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:12:29.294283 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fb7c22b0-d4db-4106-8cbd-3f4c4a3d15d1 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "GET /compute/v2.1/servers/f5c5672f-fb78-4cbf-84ae-90d03cc0d64d" status: 200 len: 1317 microversion: 2.1 time: 0.153183 Aug 07 02:12:29.294866 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3717/6968] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:29 2022] GET /compute/v2.1/servers/f5c5672f-fb78-4cbf-84ae-90d03cc0d64d => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:12:30.317772 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a0b62b46-7e6a-4d3b-8f99-ece6fc5d0059 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:30.318393 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a0b62b46-7e6a-4d3b-8f99-ece6fc5d0059 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: f5c5672f-fb78-4cbf-84ae-90d03cc0d64d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:30.324741 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a0b62b46-7e6a-4d3b-8f99-ece6fc5d0059 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:30.325225 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a0b62b46-7e6a-4d3b-8f99-ece6fc5d0059 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:30.325666 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a0b62b46-7e6a-4d3b-8f99-ece6fc5d0059 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:30.326531 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a0b62b46-7e6a-4d3b-8f99-ece6fc5d0059 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:30.326832 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a0b62b46-7e6a-4d3b-8f99-ece6fc5d0059 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:30.327261 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a0b62b46-7e6a-4d3b-8f99-ece6fc5d0059 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:30.458336 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a0b62b46-7e6a-4d3b-8f99-ece6fc5d0059 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d0dd0eddee4fd4b9f23b4a6c79ce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1694bfebb9414fcd90bfdef30d061be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:12:30.466032 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a0b62b46-7e6a-4d3b-8f99-ece6fc5d0059 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "GET /compute/v2.1/servers/f5c5672f-fb78-4cbf-84ae-90d03cc0d64d" status: 200 len: 1317 microversion: 2.1 time: 0.154331 Aug 07 02:12:30.466605 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3252/6969] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:30 2022] GET /compute/v2.1/servers/f5c5672f-fb78-4cbf-84ae-90d03cc0d64d => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:12:31.486840 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2762cbcc-93b4-44f0-8d6b-693c7a6e311e tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:31.487645 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2762cbcc-93b4-44f0-8d6b-693c7a6e311e tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: f5c5672f-fb78-4cbf-84ae-90d03cc0d64d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:31.496804 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2762cbcc-93b4-44f0-8d6b-693c7a6e311e tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:31.497305 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2762cbcc-93b4-44f0-8d6b-693c7a6e311e tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:31.497795 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2762cbcc-93b4-44f0-8d6b-693c7a6e311e tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:31.498521 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2762cbcc-93b4-44f0-8d6b-693c7a6e311e tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:31.498999 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2762cbcc-93b4-44f0-8d6b-693c7a6e311e tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:31.499451 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2762cbcc-93b4-44f0-8d6b-693c7a6e311e tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:31.637267 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2762cbcc-93b4-44f0-8d6b-693c7a6e311e tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d0dd0eddee4fd4b9f23b4a6c79ce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1694bfebb9414fcd90bfdef30d061be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:12:31.645515 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2762cbcc-93b4-44f0-8d6b-693c7a6e311e tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "GET /compute/v2.1/servers/f5c5672f-fb78-4cbf-84ae-90d03cc0d64d" status: 200 len: 1317 microversion: 2.1 time: 0.162721 Aug 07 02:12:31.646205 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3718/6970] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:31 2022] GET /compute/v2.1/servers/f5c5672f-fb78-4cbf-84ae-90d03cc0d64d => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:12:32.666867 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cc0ff149-22b6-4105-a970-f7c215696d0f tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:32.667508 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-cc0ff149-22b6-4105-a970-f7c215696d0f tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: f5c5672f-fb78-4cbf-84ae-90d03cc0d64d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:32.674594 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc0ff149-22b6-4105-a970-f7c215696d0f tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:32.675072 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc0ff149-22b6-4105-a970-f7c215696d0f tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:32.675507 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc0ff149-22b6-4105-a970-f7c215696d0f tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:32.676228 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc0ff149-22b6-4105-a970-f7c215696d0f tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:32.676680 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc0ff149-22b6-4105-a970-f7c215696d0f tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:32.677100 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cc0ff149-22b6-4105-a970-f7c215696d0f tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:32.867709 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-cc0ff149-22b6-4105-a970-f7c215696d0f tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d0dd0eddee4fd4b9f23b4a6c79ce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1694bfebb9414fcd90bfdef30d061be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:12:32.875317 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cc0ff149-22b6-4105-a970-f7c215696d0f tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "GET /compute/v2.1/servers/f5c5672f-fb78-4cbf-84ae-90d03cc0d64d" status: 200 len: 1317 microversion: 2.1 time: 0.212329 Aug 07 02:12:32.875932 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3253/6971] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:32 2022] GET /compute/v2.1/servers/f5c5672f-fb78-4cbf-84ae-90d03cc0d64d => generated 1317 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:12:33.896117 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ba044815-4e3c-40d1-bc00-c7a41de76f18 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:33.896749 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ba044815-4e3c-40d1-bc00-c7a41de76f18 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: f5c5672f-fb78-4cbf-84ae-90d03cc0d64d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:33.903962 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ba044815-4e3c-40d1-bc00-c7a41de76f18 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:33.904513 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ba044815-4e3c-40d1-bc00-c7a41de76f18 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:33.905060 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ba044815-4e3c-40d1-bc00-c7a41de76f18 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:33.905770 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ba044815-4e3c-40d1-bc00-c7a41de76f18 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:33.906241 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ba044815-4e3c-40d1-bc00-c7a41de76f18 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:33.906927 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ba044815-4e3c-40d1-bc00-c7a41de76f18 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:34.089730 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ba044815-4e3c-40d1-bc00-c7a41de76f18 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d0dd0eddee4fd4b9f23b4a6c79ce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1694bfebb9414fcd90bfdef30d061be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:12:34.097225 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ba044815-4e3c-40d1-bc00-c7a41de76f18 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "GET /compute/v2.1/servers/f5c5672f-fb78-4cbf-84ae-90d03cc0d64d" status: 200 len: 1317 microversion: 2.1 time: 0.205052 Aug 07 02:12:34.098290 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3719/6972] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:33 2022] GET /compute/v2.1/servers/f5c5672f-fb78-4cbf-84ae-90d03cc0d64d => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:12:34.278324 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-b00ba621-2c94-49bb-a4bc-d3653b687b18 req-d5eb7c78-5a93-4132-8420-a807c5260092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5c5672f-fb78-4cbf-84ae-90d03cc0d64d", "name": "network-vif-plugged", "status": "completed", "tag": "5a1ad5ed-f2ce-43fa-b459-df9d0ff36030"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:12:34.291329 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b00ba621-2c94-49bb-a4bc-d3653b687b18 req-d5eb7c78-5a93-4132-8420-a807c5260092 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:34.291819 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b00ba621-2c94-49bb-a4bc-d3653b687b18 req-d5eb7c78-5a93-4132-8420-a807c5260092 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:34.292692 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-b00ba621-2c94-49bb-a4bc-d3653b687b18 req-d5eb7c78-5a93-4132-8420-a807c5260092 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:34.304476 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-b00ba621-2c94-49bb-a4bc-d3653b687b18 req-d5eb7c78-5a93-4132-8420-a807c5260092 service nova] Creating event network-vif-plugged:5a1ad5ed-f2ce-43fa-b459-df9d0ff36030 for instance f5c5672f-fb78-4cbf-84ae-90d03cc0d64d on n-h1-master-1 Aug 07 02:12:34.309645 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-b00ba621-2c94-49bb-a4bc-d3653b687b18 req-d5eb7c78-5a93-4132-8420-a807c5260092 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034965 Aug 07 02:12:34.310415 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3254/6973] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:12:35.118217 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e9b424d5-5b2d-4d58-9528-fe0e06eff1e2 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:35.118850 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e9b424d5-5b2d-4d58-9528-fe0e06eff1e2 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: f5c5672f-fb78-4cbf-84ae-90d03cc0d64d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:35.125679 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9b424d5-5b2d-4d58-9528-fe0e06eff1e2 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:35.126172 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9b424d5-5b2d-4d58-9528-fe0e06eff1e2 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:35.126621 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9b424d5-5b2d-4d58-9528-fe0e06eff1e2 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:35.127325 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9b424d5-5b2d-4d58-9528-fe0e06eff1e2 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:35.127792 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9b424d5-5b2d-4d58-9528-fe0e06eff1e2 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:35.128258 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9b424d5-5b2d-4d58-9528-fe0e06eff1e2 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:35.256603 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e9b424d5-5b2d-4d58-9528-fe0e06eff1e2 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d0dd0eddee4fd4b9f23b4a6c79ce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1694bfebb9414fcd90bfdef30d061be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:12:35.264018 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e9b424d5-5b2d-4d58-9528-fe0e06eff1e2 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "GET /compute/v2.1/servers/f5c5672f-fb78-4cbf-84ae-90d03cc0d64d" status: 200 len: 1317 microversion: 2.1 time: 0.149613 Aug 07 02:12:35.264606 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3720/6974] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:35 2022] GET /compute/v2.1/servers/f5c5672f-fb78-4cbf-84ae-90d03cc0d64d => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:12:36.286078 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2613d4a2-0bff-4de0-83f1-dde7e0b22699 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:36.286873 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2613d4a2-0bff-4de0-83f1-dde7e0b22699 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: f5c5672f-fb78-4cbf-84ae-90d03cc0d64d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:36.289680 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:12:36.290409 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=10 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:12:36.297573 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2613d4a2-0bff-4de0-83f1-dde7e0b22699 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:36.298058 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2613d4a2-0bff-4de0-83f1-dde7e0b22699 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:36.298494 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2613d4a2-0bff-4de0-83f1-dde7e0b22699 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:36.299193 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2613d4a2-0bff-4de0-83f1-dde7e0b22699 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:36.299648 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2613d4a2-0bff-4de0-83f1-dde7e0b22699 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:36.300114 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2613d4a2-0bff-4de0-83f1-dde7e0b22699 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:36.434177 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2613d4a2-0bff-4de0-83f1-dde7e0b22699 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d0dd0eddee4fd4b9f23b4a6c79ce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1694bfebb9414fcd90bfdef30d061be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:12:36.442351 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2613d4a2-0bff-4de0-83f1-dde7e0b22699 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "GET /compute/v2.1/servers/f5c5672f-fb78-4cbf-84ae-90d03cc0d64d" status: 200 len: 1506 microversion: 2.1 time: 0.159932 Aug 07 02:12:36.442914 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3255/6975] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:36 2022] GET /compute/v2.1/servers/f5c5672f-fb78-4cbf-84ae-90d03cc0d64d => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:12:36.461949 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b5f90562-f9f9-4bfb-8c3e-2f628f4fa244 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:36.462441 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b5f90562-f9f9-4bfb-8c3e-2f628f4fa244 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: f5c5672f-fb78-4cbf-84ae-90d03cc0d64d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:36.464323 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:12:36.470289 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b5f90562-f9f9-4bfb-8c3e-2f628f4fa244 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:36.470776 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b5f90562-f9f9-4bfb-8c3e-2f628f4fa244 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:36.471228 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b5f90562-f9f9-4bfb-8c3e-2f628f4fa244 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:36.471951 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b5f90562-f9f9-4bfb-8c3e-2f628f4fa244 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:36.472413 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b5f90562-f9f9-4bfb-8c3e-2f628f4fa244 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:36.472851 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b5f90562-f9f9-4bfb-8c3e-2f628f4fa244 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:36.497544 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b5f90562-f9f9-4bfb-8c3e-2f628f4fa244 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: f5c5672f-fb78-4cbf-84ae-90d03cc0d64d] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 02:12:36.571164 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b5f90562-f9f9-4bfb-8c3e-2f628f4fa244 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f5c5672f-fb78-4cbf-84ae-90d03cc0d64d" status: 204 len: 0 microversion: 2.1 time: 0.112314 Aug 07 02:12:36.572021 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3721/6976] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 02:12:36 2022] DELETE /compute/v2.1/servers/f5c5672f-fb78-4cbf-84ae-90d03cc0d64d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 02:12:36.580661 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b12d2207-df40-4358-8f70-0c30c9f81015 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:36.581277 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b12d2207-df40-4358-8f70-0c30c9f81015 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: f5c5672f-fb78-4cbf-84ae-90d03cc0d64d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:36.587153 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b12d2207-df40-4358-8f70-0c30c9f81015 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:36.587632 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b12d2207-df40-4358-8f70-0c30c9f81015 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:36.588116 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b12d2207-df40-4358-8f70-0c30c9f81015 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:36.588809 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b12d2207-df40-4358-8f70-0c30c9f81015 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:36.589263 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b12d2207-df40-4358-8f70-0c30c9f81015 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:36.589690 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b12d2207-df40-4358-8f70-0c30c9f81015 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:36.718034 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b12d2207-df40-4358-8f70-0c30c9f81015 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d0dd0eddee4fd4b9f23b4a6c79ce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1694bfebb9414fcd90bfdef30d061be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:12:36.725823 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b12d2207-df40-4358-8f70-0c30c9f81015 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "GET /compute/v2.1/servers/f5c5672f-fb78-4cbf-84ae-90d03cc0d64d" status: 200 len: 1512 microversion: 2.1 time: 0.149265 Aug 07 02:12:36.726395 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3256/6977] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:36 2022] GET /compute/v2.1/servers/f5c5672f-fb78-4cbf-84ae-90d03cc0d64d => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:12:37.751808 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-80b60fed-3036-435f-bfc9-76e41dc01560 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:37.752554 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-80b60fed-3036-435f-bfc9-76e41dc01560 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: f5c5672f-fb78-4cbf-84ae-90d03cc0d64d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:37.759870 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80b60fed-3036-435f-bfc9-76e41dc01560 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:37.760392 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80b60fed-3036-435f-bfc9-76e41dc01560 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:37.760843 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80b60fed-3036-435f-bfc9-76e41dc01560 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:37.761551 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80b60fed-3036-435f-bfc9-76e41dc01560 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:37.762012 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80b60fed-3036-435f-bfc9-76e41dc01560 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:37.762449 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-80b60fed-3036-435f-bfc9-76e41dc01560 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:37.899726 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-80b60fed-3036-435f-bfc9-76e41dc01560 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d0dd0eddee4fd4b9f23b4a6c79ce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1694bfebb9414fcd90bfdef30d061be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:12:37.907320 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-80b60fed-3036-435f-bfc9-76e41dc01560 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "GET /compute/v2.1/servers/f5c5672f-fb78-4cbf-84ae-90d03cc0d64d" status: 200 len: 1512 microversion: 2.1 time: 0.159791 Aug 07 02:12:37.907969 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3722/6978] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:37 2022] GET /compute/v2.1/servers/f5c5672f-fb78-4cbf-84ae-90d03cc0d64d => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:12:38.543865 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-ad193c34-63a2-44ef-bf5f-97fd2c02358a req-0fe2eb1a-31d6-4de6-86c8-8e375e806bb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5c5672f-fb78-4cbf-84ae-90d03cc0d64d", "name": "network-vif-deleted", "tag": "5a1ad5ed-f2ce-43fa-b459-df9d0ff36030"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:12:38.559820 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-ad193c34-63a2-44ef-bf5f-97fd2c02358a req-0fe2eb1a-31d6-4de6-86c8-8e375e806bb2 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:38.560368 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-ad193c34-63a2-44ef-bf5f-97fd2c02358a req-0fe2eb1a-31d6-4de6-86c8-8e375e806bb2 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:38.560802 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-ad193c34-63a2-44ef-bf5f-97fd2c02358a req-0fe2eb1a-31d6-4de6-86c8-8e375e806bb2 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:38.579556 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-ad193c34-63a2-44ef-bf5f-97fd2c02358a req-0fe2eb1a-31d6-4de6-86c8-8e375e806bb2 service nova] Creating event network-vif-deleted:5a1ad5ed-f2ce-43fa-b459-df9d0ff36030 for instance f5c5672f-fb78-4cbf-84ae-90d03cc0d64d on n-h1-master-1 Aug 07 02:12:38.585033 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-ad193c34-63a2-44ef-bf5f-97fd2c02358a req-0fe2eb1a-31d6-4de6-86c8-8e375e806bb2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047566 Aug 07 02:12:38.585968 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3257/6979] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:12:38.928875 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-eb698003-7e79-4cc4-876b-7896844dd9d8 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:38.929421 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-eb698003-7e79-4cc4-876b-7896844dd9d8 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: f5c5672f-fb78-4cbf-84ae-90d03cc0d64d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:38.936519 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb698003-7e79-4cc4-876b-7896844dd9d8 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:38.937040 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb698003-7e79-4cc4-876b-7896844dd9d8 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:38.937565 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb698003-7e79-4cc4-876b-7896844dd9d8 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:38.938182 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb698003-7e79-4cc4-876b-7896844dd9d8 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:38.938647 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb698003-7e79-4cc4-876b-7896844dd9d8 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:38.939083 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb698003-7e79-4cc4-876b-7896844dd9d8 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:38.972848 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb698003-7e79-4cc4-876b-7896844dd9d8 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:38.974004 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb698003-7e79-4cc4-876b-7896844dd9d8 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:38.974457 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-eb698003-7e79-4cc4-876b-7896844dd9d8 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:38.974921 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-eb698003-7e79-4cc4-876b-7896844dd9d8 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lazy-loading 'fault' on Instance uuid f5c5672f-fb78-4cbf-84ae-90d03cc0d64d {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 02:12:39.016814 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-eb698003-7e79-4cc4-876b-7896844dd9d8 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d0dd0eddee4fd4b9f23b4a6c79ce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1694bfebb9414fcd90bfdef30d061be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:12:39.025108 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-eb698003-7e79-4cc4-876b-7896844dd9d8 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "GET /compute/v2.1/servers/f5c5672f-fb78-4cbf-84ae-90d03cc0d64d" status: 200 len: 1307 microversion: 2.1 time: 0.100257 Aug 07 02:12:39.025942 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3723/6980] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:38 2022] GET /compute/v2.1/servers/f5c5672f-fb78-4cbf-84ae-90d03cc0d64d => generated 1307 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:12:40.047505 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-22917699-a5a0-4b7a-992f-b3a19c8f8714 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:40.048240 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-22917699-a5a0-4b7a-992f-b3a19c8f8714 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: f5c5672f-fb78-4cbf-84ae-90d03cc0d64d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:40.055978 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22917699-a5a0-4b7a-992f-b3a19c8f8714 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:40.056559 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22917699-a5a0-4b7a-992f-b3a19c8f8714 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:40.057007 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22917699-a5a0-4b7a-992f-b3a19c8f8714 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:40.057704 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22917699-a5a0-4b7a-992f-b3a19c8f8714 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:40.058160 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22917699-a5a0-4b7a-992f-b3a19c8f8714 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:40.058586 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22917699-a5a0-4b7a-992f-b3a19c8f8714 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:40.071707 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-22917699-a5a0-4b7a-992f-b3a19c8f8714 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] HTTP exception thrown: Instance f5c5672f-fb78-4cbf-84ae-90d03cc0d64d could not be found. Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-22917699-a5a0-4b7a-992f-b3a19c8f8714 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Request method failure captured: Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/f5c5672f-fb78-4cbf-84ae-90d03cc0d64d HTTP/1.1 Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7x98_-_-r9k8UB7cfPTLFyln7kDHZldgpukAYfIrF9TCcthfnMDRMVQ-k7tBF64U3glcZTJrE8As0XDNocacdyMQfG5SCzvVrVSwdVXoh47ZppXKA8xTy4uOzNKTEkKsA-t0uoZUmZlbl30YtKOGoNG-IR3R9kLItuThnmYPMXTo634 Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 1694bfebb9414fcd90bfdef30d061be0 Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersNegativeTestJSON-1340657378 Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1694bfebb9414fcd90bfdef30d061be0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1694bfebb9414fcd90bfdef30d061be0", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1694bfebb9414fcd90bfdef30d061be0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1694bfebb9414fcd90bfdef30d061be0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersNegativeTestJSON-1340657378 Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 1694bfebb9414fcd90bfdef30d061be0 Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1340657378 Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersNegativeTestJSON-1340657378-project Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 53d0dd0eddee4fd4b9f23b4a6c79ce07 Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersNegativeTestJSON-1340657378-project Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: exception: Instance f5c5672f-fb78-4cbf-84ae-90d03cc0d64d could not be found. Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'f5c5672f-fb78-4cbf-84ae-90d03cc0d64d'} Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5c5672f-fb78-4cbf-84ae-90d03cc0d64d could not be found. Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5c5672f-fb78-4cbf-84ae-90d03cc0d64d could not be found. Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:12:40.073343 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:40.078166 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:40.078166 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:12:40.078166 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:12:40.078166 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:12:40.078166 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:12:40.078166 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5c5672f-fb78-4cbf-84ae-90d03cc0d64d could not be found. Aug 07 02:12:40.078166 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:40.078166 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-22917699-a5a0-4b7a-992f-b3a19c8f8714 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Returning 404 to user: Instance f5c5672f-fb78-4cbf-84ae-90d03cc0d64d could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:12:40.078166 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-22917699-a5a0-4b7a-992f-b3a19c8f8714 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "GET /compute/v2.1/servers/f5c5672f-fb78-4cbf-84ae-90d03cc0d64d" status: 404 len: 111 microversion: 2.1 time: 0.031832 Aug 07 02:12:40.078166 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3258/6981] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:40 2022] GET /compute/v2.1/servers/f5c5672f-fb78-4cbf-84ae-90d03cc0d64d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:12:40.083971 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6ee07c5b-b22c-4446-9a0d-ee7743aec16b tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:40.084618 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6ee07c5b-b22c-4446-9a0d-ee7743aec16b tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: 11a2d425-8959-4a3c-ae10-ad8aa0364aff] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:40.096219 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ee07c5b-b22c-4446-9a0d-ee7743aec16b tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:40.096731 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ee07c5b-b22c-4446-9a0d-ee7743aec16b tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:40.097194 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ee07c5b-b22c-4446-9a0d-ee7743aec16b tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:40.099051 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ee07c5b-b22c-4446-9a0d-ee7743aec16b tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:40.099388 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ee07c5b-b22c-4446-9a0d-ee7743aec16b tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:40.099913 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ee07c5b-b22c-4446-9a0d-ee7743aec16b tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:40.233109 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6ee07c5b-b22c-4446-9a0d-ee7743aec16b tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d0dd0eddee4fd4b9f23b4a6c79ce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1694bfebb9414fcd90bfdef30d061be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:12:40.240541 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6ee07c5b-b22c-4446-9a0d-ee7743aec16b tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff" status: 200 len: 1507 microversion: 2.1 time: 0.160468 Aug 07 02:12:40.241115 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3724/6982] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:40 2022] GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:12:40.260434 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-dbdfce1f-cffb-4366-9444-1e1be4bf8786 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:12:40.262702 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-dbdfce1f-cffb-4366-9444-1e1be4bf8786 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: 444b59c7-8a18-4532-bfe6-92a1cc242670] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:40.268119 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-dbdfce1f-cffb-4366-9444-1e1be4bf8786 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] HTTP exception thrown: Instance 444b59c7-8a18-4532-bfe6-92a1cc242670 could not be found. Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-dbdfce1f-cffb-4366-9444-1e1be4bf8786 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Request method failure captured: Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/servers/444b59c7-8a18-4532-bfe6-92a1cc242670/action HTTP/1.1 Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 32 Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7x98_-_-r9k8UB7cfPTLFyln7kDHZldgpukAYfIrF9TCcthfnMDRMVQ-k7tBF64U3glcZTJrE8As0XDNocacdyMQfG5SCzvVrVSwdVXoh47ZppXKA8xTy4uOzNKTEkKsA-t0uoZUmZlbl30YtKOGoNG-IR3R9kLItuThnmYPMXTo634 Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 1694bfebb9414fcd90bfdef30d061be0 Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersNegativeTestJSON-1340657378 Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1694bfebb9414fcd90bfdef30d061be0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1694bfebb9414fcd90bfdef30d061be0", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1694bfebb9414fcd90bfdef30d061be0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1694bfebb9414fcd90bfdef30d061be0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersNegativeTestJSON-1340657378 Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 1694bfebb9414fcd90bfdef30d061be0 Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1340657378 Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersNegativeTestJSON-1340657378-project Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 53d0dd0eddee4fd4b9f23b4a6c79ce07 Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersNegativeTestJSON-1340657378-project Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: {"resize": {"flavorRef": "452"}} Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 444b59c7-8a18-4532-bfe6-92a1cc242670 could not be found. Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '444b59c7-8a18-4532-bfe6-92a1cc242670', 'body': {'resize': {'flavorRef': '452'}}} Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 444b59c7-8a18-4532-bfe6-92a1cc242670 could not be found. Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:12:40.269658 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:12:40.275001 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 444b59c7-8a18-4532-bfe6-92a1cc242670 could not be found. Aug 07 02:12:40.275001 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:40.275001 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:12:40.275001 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:40.275001 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:40.275001 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:12:40.275001 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:12:40.275001 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:12:40.275001 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:12:40.275001 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 444b59c7-8a18-4532-bfe6-92a1cc242670 could not be found. Aug 07 02:12:40.275001 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:40.275001 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-dbdfce1f-cffb-4366-9444-1e1be4bf8786 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Returning 404 to user: Instance 444b59c7-8a18-4532-bfe6-92a1cc242670 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:12:40.275001 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-dbdfce1f-cffb-4366-9444-1e1be4bf8786 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "POST /compute/v2.1/servers/444b59c7-8a18-4532-bfe6-92a1cc242670/action" status: 404 len: 111 microversion: 2.1 time: 0.015988 Aug 07 02:12:40.275001 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3259/6983] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:12:40 2022] POST /compute/v2.1/servers/444b59c7-8a18-4532-bfe6-92a1cc242670/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:12:40.280730 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0230f76a-9470-40df-8007-278cc3722857 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:40.281391 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0230f76a-9470-40df-8007-278cc3722857 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: 11a2d425-8959-4a3c-ae10-ad8aa0364aff] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:40.287873 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0230f76a-9470-40df-8007-278cc3722857 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:40.288399 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0230f76a-9470-40df-8007-278cc3722857 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:40.288849 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0230f76a-9470-40df-8007-278cc3722857 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:40.289555 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0230f76a-9470-40df-8007-278cc3722857 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:40.290037 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0230f76a-9470-40df-8007-278cc3722857 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:40.290458 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0230f76a-9470-40df-8007-278cc3722857 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:40.423650 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0230f76a-9470-40df-8007-278cc3722857 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d0dd0eddee4fd4b9f23b4a6c79ce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1694bfebb9414fcd90bfdef30d061be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:12:40.432323 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0230f76a-9470-40df-8007-278cc3722857 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff" status: 200 len: 1507 microversion: 2.1 time: 0.155235 Aug 07 02:12:40.432903 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3725/6984] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:40 2022] GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:12:40.453037 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2a5e76fd-ffd7-4be1-afe6-8578a6f219bd tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:40.453649 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2a5e76fd-ffd7-4be1-afe6-8578a6f219bd tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: 11a2d425-8959-4a3c-ae10-ad8aa0364aff] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:40.461015 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2a5e76fd-ffd7-4be1-afe6-8578a6f219bd tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:40.461494 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2a5e76fd-ffd7-4be1-afe6-8578a6f219bd tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:40.461934 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2a5e76fd-ffd7-4be1-afe6-8578a6f219bd tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:40.462628 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2a5e76fd-ffd7-4be1-afe6-8578a6f219bd tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:40.463086 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2a5e76fd-ffd7-4be1-afe6-8578a6f219bd tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:40.463516 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2a5e76fd-ffd7-4be1-afe6-8578a6f219bd tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:40.591602 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2a5e76fd-ffd7-4be1-afe6-8578a6f219bd tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d0dd0eddee4fd4b9f23b4a6c79ce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1694bfebb9414fcd90bfdef30d061be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:12:40.599104 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2a5e76fd-ffd7-4be1-afe6-8578a6f219bd tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff" status: 200 len: 1507 microversion: 2.1 time: 0.149824 Aug 07 02:12:40.599665 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3260/6985] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:40 2022] GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:12:40.619638 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6cb174c0-c0d8-4d76-a88a-79841b75b086 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "63f8a829-0f44-40b5-b16d-b3f97629967c"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:12:40.622098 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6cb174c0-c0d8-4d76-a88a-79841b75b086 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: 11a2d425-8959-4a3c-ae10-ad8aa0364aff] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:40.628136 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cb174c0-c0d8-4d76-a88a-79841b75b086 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:40.628681 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cb174c0-c0d8-4d76-a88a-79841b75b086 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:40.629139 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cb174c0-c0d8-4d76-a88a-79841b75b086 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:40.630351 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cb174c0-c0d8-4d76-a88a-79841b75b086 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:40.630821 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cb174c0-c0d8-4d76-a88a-79841b75b086 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:40.631267 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cb174c0-c0d8-4d76-a88a-79841b75b086 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:40.659241 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6cb174c0-c0d8-4d76-a88a-79841b75b086 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '53d0dd0eddee4fd4b9f23b4a6c79ce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1694bfebb9414fcd90bfdef30d061be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:12:40.664424 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-6cb174c0-c0d8-4d76-a88a-79841b75b086 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] HTTP exception thrown: Flavor 63f8a829-0f44-40b5-b16d-b3f97629967c could not be found. Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6cb174c0-c0d8-4d76-a88a-79841b75b086 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Request method failure captured: Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: request: POST /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff/action HTTP/1.1 Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 65 Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7x98_-_-r9k8UB7cfPTLFyln7kDHZldgpukAYfIrF9TCcthfnMDRMVQ-k7tBF64U3glcZTJrE8As0XDNocacdyMQfG5SCzvVrVSwdVXoh47ZppXKA8xTy4uOzNKTEkKsA-t0uoZUmZlbl30YtKOGoNG-IR3R9kLItuThnmYPMXTo634 Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 1694bfebb9414fcd90bfdef30d061be0 Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersNegativeTestJSON-1340657378 Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1694bfebb9414fcd90bfdef30d061be0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1694bfebb9414fcd90bfdef30d061be0", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1694bfebb9414fcd90bfdef30d061be0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1694bfebb9414fcd90bfdef30d061be0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersNegativeTestJSON-1340657378 Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 1694bfebb9414fcd90bfdef30d061be0 Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1340657378 Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersNegativeTestJSON-1340657378-project Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 53d0dd0eddee4fd4b9f23b4a6c79ce07 Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersNegativeTestJSON-1340657378-project Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: {"resize": {"flavorRef": "63f8a829-0f44-40b5-b16d-b3f97629967c"}} Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: exception: Flavor 63f8a829-0f44-40b5-b16d-b3f97629967c could not be found. Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '11a2d425-8959-4a3c-ae10-ad8aa0364aff', 'body': {'resize': {'flavorRef': '63f8a829-0f44-40b5-b16d-b3f97629967c'}}} Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4148, in resize Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 02:12:40.672844 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 02:12:40.677320 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:12:40.677320 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 02:12:40.677320 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 02:12:40.677320 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 63f8a829-0f44-40b5-b16d-b3f97629967c could not be found. Aug 07 02:12:40.677320 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:12:40.677320 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:12:40.677320 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:12:40.677320 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:40.677320 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:12:40.677320 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:12:40.677320 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:12:40.677320 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:12:40.677320 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:12:40.677320 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:12:40.677320 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 02:12:40.677320 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 02:12:40.677320 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 07 02:12:40.677320 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 07 02:12:40.677320 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Aug 07 02:12:40.677320 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 07 02:12:40.677320 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 63f8a829-0f44-40b5-b16d-b3f97629967c could not be found. Aug 07 02:12:40.677320 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:12:40.677320 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:12:40.677320 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:12:40.677320 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:40.677320 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:12:40.677320 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:12:40.677320 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:12:40.677320 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:12:40.677320 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 63f8a829-0f44-40b5-b16d-b3f97629967c could not be found. Aug 07 02:12:40.677320 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:12:40.677320 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6cb174c0-c0d8-4d76-a88a-79841b75b086 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Returning 400 to user: Flavor 63f8a829-0f44-40b5-b16d-b3f97629967c could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:12:40.677320 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6cb174c0-c0d8-4d76-a88a-79841b75b086 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "POST /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff/action" status: 400 len: 107 microversion: 2.1 time: 0.058633 Aug 07 02:12:40.677320 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3726/6986] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:12:40 2022] POST /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff/action => generated 107 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 02:12:40.682876 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-da39294d-292b-47f4-bcb2-a5103bb04f7d tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:40.683495 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-da39294d-292b-47f4-bcb2-a5103bb04f7d tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: 11a2d425-8959-4a3c-ae10-ad8aa0364aff] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:40.689392 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da39294d-292b-47f4-bcb2-a5103bb04f7d tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:40.689873 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da39294d-292b-47f4-bcb2-a5103bb04f7d tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:40.690312 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da39294d-292b-47f4-bcb2-a5103bb04f7d tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:40.691015 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da39294d-292b-47f4-bcb2-a5103bb04f7d tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:40.691472 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da39294d-292b-47f4-bcb2-a5103bb04f7d tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:40.691925 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da39294d-292b-47f4-bcb2-a5103bb04f7d tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:40.822362 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-da39294d-292b-47f4-bcb2-a5103bb04f7d tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d0dd0eddee4fd4b9f23b4a6c79ce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1694bfebb9414fcd90bfdef30d061be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:12:40.829913 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-da39294d-292b-47f4-bcb2-a5103bb04f7d tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff" status: 200 len: 1507 microversion: 2.1 time: 0.150815 Aug 07 02:12:40.830482 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3261/6987] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:40 2022] GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:12:40.851298 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8839bfa8-37b4-4554-b0ed-b399f1a5098e tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:40.851948 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8839bfa8-37b4-4554-b0ed-b399f1a5098e tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: 11a2d425-8959-4a3c-ae10-ad8aa0364aff] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:40.857900 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8839bfa8-37b4-4554-b0ed-b399f1a5098e tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:40.858392 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8839bfa8-37b4-4554-b0ed-b399f1a5098e tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:40.858850 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8839bfa8-37b4-4554-b0ed-b399f1a5098e tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:40.859557 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8839bfa8-37b4-4554-b0ed-b399f1a5098e tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:40.860052 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8839bfa8-37b4-4554-b0ed-b399f1a5098e tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:40.860491 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8839bfa8-37b4-4554-b0ed-b399f1a5098e tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:40.990204 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8839bfa8-37b4-4554-b0ed-b399f1a5098e tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d0dd0eddee4fd4b9f23b4a6c79ce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1694bfebb9414fcd90bfdef30d061be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:12:40.997725 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8839bfa8-37b4-4554-b0ed-b399f1a5098e tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff" status: 200 len: 1507 microversion: 2.1 time: 0.150354 Aug 07 02:12:40.998281 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3727/6988] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:40 2022] GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:12:41.018470 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6c05eb72-b0f4-427b-917a-f267620203ba tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6c05eb72-b0f4-427b-917a-f267620203ba tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Request method failure captured: Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: request: POST /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff/action HTTP/1.1 Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 29 Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7x98_-_-r9k8UB7cfPTLFyln7kDHZldgpukAYfIrF9TCcthfnMDRMVQ-k7tBF64U3glcZTJrE8As0XDNocacdyMQfG5SCzvVrVSwdVXoh47ZppXKA8xTy4uOzNKTEkKsA-t0uoZUmZlbl30YtKOGoNG-IR3R9kLItuThnmYPMXTo634 Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 1694bfebb9414fcd90bfdef30d061be0 Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersNegativeTestJSON-1340657378 Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1694bfebb9414fcd90bfdef30d061be0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1694bfebb9414fcd90bfdef30d061be0", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1694bfebb9414fcd90bfdef30d061be0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1694bfebb9414fcd90bfdef30d061be0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersNegativeTestJSON-1340657378 Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 1694bfebb9414fcd90bfdef30d061be0 Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1340657378 Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersNegativeTestJSON-1340657378-project Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 53d0dd0eddee4fd4b9f23b4a6c79ce07 Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersNegativeTestJSON-1340657378-project Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: {"resize": {"flavorRef": ""}} Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '11a2d425-8959-4a3c-ae10-ad8aa0364aff', 'body': {'resize': {'flavorRef': ''}}} Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise error Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi '' Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:41.022073 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:12:41.026687 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:41.026687 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:41.026687 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:12:41.026687 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:12:41.026687 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 02:12:41.026687 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 02:12:41.026687 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 07 02:12:41.026687 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:41.026687 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6c05eb72-b0f4-427b-917a-f267620203ba tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:12:41.026687 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6c05eb72-b0f4-427b-917a-f267620203ba tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "POST /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff/action" status: 400 len: 113 microversion: 2.1 time: 0.008937 Aug 07 02:12:41.026687 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3262/6989] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:12:41 2022] POST /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 02:12:41.031421 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e5205be8-5be0-410f-8017-0e42cef39350 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:41.032075 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e5205be8-5be0-410f-8017-0e42cef39350 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: 11a2d425-8959-4a3c-ae10-ad8aa0364aff] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:41.037960 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5205be8-5be0-410f-8017-0e42cef39350 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:41.038451 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5205be8-5be0-410f-8017-0e42cef39350 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:41.038900 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5205be8-5be0-410f-8017-0e42cef39350 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:41.039605 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5205be8-5be0-410f-8017-0e42cef39350 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:41.040116 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5205be8-5be0-410f-8017-0e42cef39350 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:41.040549 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e5205be8-5be0-410f-8017-0e42cef39350 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:41.171326 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e5205be8-5be0-410f-8017-0e42cef39350 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d0dd0eddee4fd4b9f23b4a6c79ce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1694bfebb9414fcd90bfdef30d061be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:12:41.179325 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e5205be8-5be0-410f-8017-0e42cef39350 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff" status: 200 len: 1507 microversion: 2.1 time: 0.151599 Aug 07 02:12:41.179904 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3728/6990] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:41 2022] GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:12:41.204134 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6f762e45-5d0b-42ae-ac11-cd73782ac3f3 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:41.204638 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6f762e45-5d0b-42ae-ac11-cd73782ac3f3 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: f5c5672f-fb78-4cbf-84ae-90d03cc0d64d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:41.211551 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f762e45-5d0b-42ae-ac11-cd73782ac3f3 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:41.212065 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f762e45-5d0b-42ae-ac11-cd73782ac3f3 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:41.212502 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f762e45-5d0b-42ae-ac11-cd73782ac3f3 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:41.213197 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f762e45-5d0b-42ae-ac11-cd73782ac3f3 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:41.213650 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f762e45-5d0b-42ae-ac11-cd73782ac3f3 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:41.214079 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6f762e45-5d0b-42ae-ac11-cd73782ac3f3 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:41.226855 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-6f762e45-5d0b-42ae-ac11-cd73782ac3f3 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] HTTP exception thrown: Instance f5c5672f-fb78-4cbf-84ae-90d03cc0d64d could not be found. Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6f762e45-5d0b-42ae-ac11-cd73782ac3f3 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Request method failure captured: Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/f5c5672f-fb78-4cbf-84ae-90d03cc0d64d HTTP/1.1 Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7x98_-_-r9k8UB7cfPTLFyln7kDHZldgpukAYfIrF9TCcthfnMDRMVQ-k7tBF64U3glcZTJrE8As0XDNocacdyMQfG5SCzvVrVSwdVXoh47ZppXKA8xTy4uOzNKTEkKsA-t0uoZUmZlbl30YtKOGoNG-IR3R9kLItuThnmYPMXTo634 Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 1694bfebb9414fcd90bfdef30d061be0 Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-ServersNegativeTestJSON-1340657378 Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1694bfebb9414fcd90bfdef30d061be0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1694bfebb9414fcd90bfdef30d061be0", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1694bfebb9414fcd90bfdef30d061be0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1694bfebb9414fcd90bfdef30d061be0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-ServersNegativeTestJSON-1340657378 Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 1694bfebb9414fcd90bfdef30d061be0 Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1340657378 Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-ServersNegativeTestJSON-1340657378-project Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 53d0dd0eddee4fd4b9f23b4a6c79ce07 Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-ServersNegativeTestJSON-1340657378-project Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: exception: Instance f5c5672f-fb78-4cbf-84ae-90d03cc0d64d could not be found. Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'f5c5672f-fb78-4cbf-84ae-90d03cc0d64d'} Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5c5672f-fb78-4cbf-84ae-90d03cc0d64d could not be found. Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:12:41.228413 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:12:41.232642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5c5672f-fb78-4cbf-84ae-90d03cc0d64d could not be found. Aug 07 02:12:41.232642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:41.232642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:12:41.232642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:41.232642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:41.232642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:12:41.232642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:12:41.232642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:12:41.232642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:12:41.232642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5c5672f-fb78-4cbf-84ae-90d03cc0d64d could not be found. Aug 07 02:12:41.232642 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:12:41.232642 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6f762e45-5d0b-42ae-ac11-cd73782ac3f3 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Returning 404 to user: Instance f5c5672f-fb78-4cbf-84ae-90d03cc0d64d could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:12:41.232642 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6f762e45-5d0b-42ae-ac11-cd73782ac3f3 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f5c5672f-fb78-4cbf-84ae-90d03cc0d64d" status: 404 len: 111 microversion: 2.1 time: 0.030332 Aug 07 02:12:41.232642 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3263/6991] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 02:12:41 2022] DELETE /compute/v2.1/servers/f5c5672f-fb78-4cbf-84ae-90d03cc0d64d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:12:41.238108 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1c1b788f-0ff5-4d57-92cf-80d681264170 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:41.238738 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1c1b788f-0ff5-4d57-92cf-80d681264170 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: f5c5672f-fb78-4cbf-84ae-90d03cc0d64d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:41.245118 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c1b788f-0ff5-4d57-92cf-80d681264170 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:41.245609 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c1b788f-0ff5-4d57-92cf-80d681264170 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:41.246061 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c1b788f-0ff5-4d57-92cf-80d681264170 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:41.246768 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c1b788f-0ff5-4d57-92cf-80d681264170 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:41.247245 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c1b788f-0ff5-4d57-92cf-80d681264170 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:41.247685 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c1b788f-0ff5-4d57-92cf-80d681264170 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:41.262017 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-1c1b788f-0ff5-4d57-92cf-80d681264170 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] HTTP exception thrown: Instance f5c5672f-fb78-4cbf-84ae-90d03cc0d64d could not be found. Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1c1b788f-0ff5-4d57-92cf-80d681264170 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Request method failure captured: Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/f5c5672f-fb78-4cbf-84ae-90d03cc0d64d HTTP/1.1 Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7x98_-_-r9k8UB7cfPTLFyln7kDHZldgpukAYfIrF9TCcthfnMDRMVQ-k7tBF64U3glcZTJrE8As0XDNocacdyMQfG5SCzvVrVSwdVXoh47ZppXKA8xTy4uOzNKTEkKsA-t0uoZUmZlbl30YtKOGoNG-IR3R9kLItuThnmYPMXTo634 Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 1694bfebb9414fcd90bfdef30d061be0 Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersNegativeTestJSON-1340657378 Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1694bfebb9414fcd90bfdef30d061be0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1694bfebb9414fcd90bfdef30d061be0", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1694bfebb9414fcd90bfdef30d061be0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1694bfebb9414fcd90bfdef30d061be0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersNegativeTestJSON-1340657378 Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 1694bfebb9414fcd90bfdef30d061be0 Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1340657378 Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersNegativeTestJSON-1340657378-project Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 53d0dd0eddee4fd4b9f23b4a6c79ce07 Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersNegativeTestJSON-1340657378-project Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: exception: Instance f5c5672f-fb78-4cbf-84ae-90d03cc0d64d could not be found. Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': 'f5c5672f-fb78-4cbf-84ae-90d03cc0d64d'} Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5c5672f-fb78-4cbf-84ae-90d03cc0d64d could not be found. Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5c5672f-fb78-4cbf-84ae-90d03cc0d64d could not be found. Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:12:41.263533 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:12:41.267759 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:41.267759 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:12:41.267759 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:12:41.267759 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:12:41.267759 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:12:41.267759 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5c5672f-fb78-4cbf-84ae-90d03cc0d64d could not be found. Aug 07 02:12:41.267759 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:12:41.267759 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1c1b788f-0ff5-4d57-92cf-80d681264170 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Returning 404 to user: Instance f5c5672f-fb78-4cbf-84ae-90d03cc0d64d could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:12:41.267759 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1c1b788f-0ff5-4d57-92cf-80d681264170 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "GET /compute/v2.1/servers/f5c5672f-fb78-4cbf-84ae-90d03cc0d64d" status: 404 len: 111 microversion: 2.1 time: 0.030625 Aug 07 02:12:41.267759 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3729/6992] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:41 2022] GET /compute/v2.1/servers/f5c5672f-fb78-4cbf-84ae-90d03cc0d64d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:12:41.273252 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d9fa6fca-827b-4591-a41c-cbc7e194712b tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:41.273751 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d9fa6fca-827b-4591-a41c-cbc7e194712b tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: 11a2d425-8959-4a3c-ae10-ad8aa0364aff] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:41.279593 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9fa6fca-827b-4591-a41c-cbc7e194712b tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:41.280112 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9fa6fca-827b-4591-a41c-cbc7e194712b tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:41.280550 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9fa6fca-827b-4591-a41c-cbc7e194712b tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:41.281244 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9fa6fca-827b-4591-a41c-cbc7e194712b tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:41.281700 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9fa6fca-827b-4591-a41c-cbc7e194712b tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:41.282127 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d9fa6fca-827b-4591-a41c-cbc7e194712b tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:41.307724 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d9fa6fca-827b-4591-a41c-cbc7e194712b tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: 11a2d425-8959-4a3c-ae10-ad8aa0364aff] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 02:12:41.381523 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d9fa6fca-827b-4591-a41c-cbc7e194712b tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "DELETE /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff" status: 204 len: 0 microversion: 2.1 time: 0.111705 Aug 07 02:12:41.382057 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3264/6993] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 02:12:41 2022] DELETE /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 07 02:12:41.390319 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1c819d00-5780-449e-9e1d-95ae2497f32a tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:41.390949 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1c819d00-5780-449e-9e1d-95ae2497f32a tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: 11a2d425-8959-4a3c-ae10-ad8aa0364aff] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:41.396935 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c819d00-5780-449e-9e1d-95ae2497f32a tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:41.397433 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c819d00-5780-449e-9e1d-95ae2497f32a tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:41.397882 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c819d00-5780-449e-9e1d-95ae2497f32a tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:41.398587 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c819d00-5780-449e-9e1d-95ae2497f32a tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:41.399057 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c819d00-5780-449e-9e1d-95ae2497f32a tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:41.399495 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c819d00-5780-449e-9e1d-95ae2497f32a tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:41.414765 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:12:41.533973 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1c819d00-5780-449e-9e1d-95ae2497f32a tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d0dd0eddee4fd4b9f23b4a6c79ce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1694bfebb9414fcd90bfdef30d061be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:12:41.541886 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1c819d00-5780-449e-9e1d-95ae2497f32a tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff" status: 200 len: 1513 microversion: 2.1 time: 0.155503 Aug 07 02:12:41.542446 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3730/6994] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:41 2022] GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:12:42.563908 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-226187eb-4bee-4ede-8465-431edcdd6e47 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:42.564626 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-226187eb-4bee-4ede-8465-431edcdd6e47 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: 11a2d425-8959-4a3c-ae10-ad8aa0364aff] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:42.571757 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-226187eb-4bee-4ede-8465-431edcdd6e47 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:42.572278 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-226187eb-4bee-4ede-8465-431edcdd6e47 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:42.572711 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-226187eb-4bee-4ede-8465-431edcdd6e47 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:42.573392 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-226187eb-4bee-4ede-8465-431edcdd6e47 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:42.573842 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-226187eb-4bee-4ede-8465-431edcdd6e47 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:42.574260 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-226187eb-4bee-4ede-8465-431edcdd6e47 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:42.703794 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-226187eb-4bee-4ede-8465-431edcdd6e47 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d0dd0eddee4fd4b9f23b4a6c79ce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1694bfebb9414fcd90bfdef30d061be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:12:42.707489 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:12:42.712466 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-226187eb-4bee-4ede-8465-431edcdd6e47 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff" status: 200 len: 1513 microversion: 2.1 time: 0.152843 Aug 07 02:12:42.713037 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3265/6995] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:42 2022] GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:12:43.409001 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-783d41ff-fd2d-4314-b6fa-a90d935ab492 req-e38f0201-6e71-496a-ae14-06b7e3727e5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11a2d425-8959-4a3c-ae10-ad8aa0364aff", "name": "network-vif-deleted", "tag": "8d986fd0-0911-4b55-9ff5-fd6be9fcc5b3"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:12:43.421159 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-783d41ff-fd2d-4314-b6fa-a90d935ab492 req-e38f0201-6e71-496a-ae14-06b7e3727e5b service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:43.421791 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-783d41ff-fd2d-4314-b6fa-a90d935ab492 req-e38f0201-6e71-496a-ae14-06b7e3727e5b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:43.422313 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-783d41ff-fd2d-4314-b6fa-a90d935ab492 req-e38f0201-6e71-496a-ae14-06b7e3727e5b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:43.438421 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-783d41ff-fd2d-4314-b6fa-a90d935ab492 req-e38f0201-6e71-496a-ae14-06b7e3727e5b service nova] Creating event network-vif-deleted:8d986fd0-0911-4b55-9ff5-fd6be9fcc5b3 for instance 11a2d425-8959-4a3c-ae10-ad8aa0364aff on n-h2-master-1 Aug 07 02:12:43.447934 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-783d41ff-fd2d-4314-b6fa-a90d935ab492 req-e38f0201-6e71-496a-ae14-06b7e3727e5b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039615 Aug 07 02:12:43.447934 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3731/6996] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:12:43.734269 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d55e045b-397a-4ffb-91cc-fe73aaae01c9 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:43.734820 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d55e045b-397a-4ffb-91cc-fe73aaae01c9 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: 11a2d425-8959-4a3c-ae10-ad8aa0364aff] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:43.741861 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d55e045b-397a-4ffb-91cc-fe73aaae01c9 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:43.742350 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d55e045b-397a-4ffb-91cc-fe73aaae01c9 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:43.742795 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d55e045b-397a-4ffb-91cc-fe73aaae01c9 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:43.743494 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d55e045b-397a-4ffb-91cc-fe73aaae01c9 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:43.743982 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d55e045b-397a-4ffb-91cc-fe73aaae01c9 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:43.744415 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d55e045b-397a-4ffb-91cc-fe73aaae01c9 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:43.777057 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d55e045b-397a-4ffb-91cc-fe73aaae01c9 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:43.777573 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d55e045b-397a-4ffb-91cc-fe73aaae01c9 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:43.778015 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d55e045b-397a-4ffb-91cc-fe73aaae01c9 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:43.778469 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-d55e045b-397a-4ffb-91cc-fe73aaae01c9 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lazy-loading 'fault' on Instance uuid 11a2d425-8959-4a3c-ae10-ad8aa0364aff {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 02:12:43.819467 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d55e045b-397a-4ffb-91cc-fe73aaae01c9 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d0dd0eddee4fd4b9f23b4a6c79ce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1694bfebb9414fcd90bfdef30d061be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:12:43.827039 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d55e045b-397a-4ffb-91cc-fe73aaae01c9 tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff" status: 200 len: 1307 microversion: 2.1 time: 0.097522 Aug 07 02:12:43.827596 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3266/6997] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:43 2022] GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff => generated 1307 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:12:44.850366 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0607a03c-a138-48af-90d6-447eb46030da tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:12:44.851085 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0607a03c-a138-48af-90d6-447eb46030da tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] [instance: 11a2d425-8959-4a3c-ae10-ad8aa0364aff] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:12:44.858205 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0607a03c-a138-48af-90d6-447eb46030da tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:44.858701 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0607a03c-a138-48af-90d6-447eb46030da tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:44.859155 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0607a03c-a138-48af-90d6-447eb46030da tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:44.859918 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0607a03c-a138-48af-90d6-447eb46030da tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:12:44.860387 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0607a03c-a138-48af-90d6-447eb46030da tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:12:44.860831 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0607a03c-a138-48af-90d6-447eb46030da tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:12:44.874290 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-0607a03c-a138-48af-90d6-447eb46030da tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] HTTP exception thrown: Instance 11a2d425-8959-4a3c-ae10-ad8aa0364aff could not be found. Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0607a03c-a138-48af-90d6-447eb46030da tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Request method failure captured: Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff HTTP/1.1 Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7x98_-_-r9k8UB7cfPTLFyln7kDHZldgpukAYfIrF9TCcthfnMDRMVQ-k7tBF64U3glcZTJrE8As0XDNocacdyMQfG5SCzvVrVSwdVXoh47ZppXKA8xTy4uOzNKTEkKsA-t0uoZUmZlbl30YtKOGoNG-IR3R9kLItuThnmYPMXTo634 Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 1694bfebb9414fcd90bfdef30d061be0 Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-ServersNegativeTestJSON-1340657378 Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1694bfebb9414fcd90bfdef30d061be0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1694bfebb9414fcd90bfdef30d061be0", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1694bfebb9414fcd90bfdef30d061be0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1694bfebb9414fcd90bfdef30d061be0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-ServersNegativeTestJSON-1340657378 Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 1694bfebb9414fcd90bfdef30d061be0 Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1340657378 Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-ServersNegativeTestJSON-1340657378-project Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 53d0dd0eddee4fd4b9f23b4a6c79ce07 Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-ServersNegativeTestJSON-1340657378-project Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 11a2d425-8959-4a3c-ae10-ad8aa0364aff could not be found. Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '11a2d425-8959-4a3c-ae10-ad8aa0364aff'} Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11a2d425-8959-4a3c-ae10-ad8aa0364aff could not be found. Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11a2d425-8959-4a3c-ae10-ad8aa0364aff could not be found. Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:12:44.875846 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:12:44.880208 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:12:44.880208 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:12:44.880208 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:12:44.880208 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:12:44.880208 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:12:44.880208 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11a2d425-8959-4a3c-ae10-ad8aa0364aff could not be found. Aug 07 02:12:44.880208 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:12:44.880208 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0607a03c-a138-48af-90d6-447eb46030da tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] Returning 404 to user: Instance 11a2d425-8959-4a3c-ae10-ad8aa0364aff could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:12:44.880208 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0607a03c-a138-48af-90d6-447eb46030da tempest-ServersNegativeTestJSON-1340657378 tempest-ServersNegativeTestJSON-1340657378-project] 10.222.0.39 "GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff" status: 404 len: 111 microversion: 2.1 time: 0.031823 Aug 07 02:12:44.880208 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3732/6998] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:12:44 2022] GET /compute/v2.1/servers/11a2d425-8959-4a3c-ae10-ad8aa0364aff => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:12:48.083001 n-d-master-1 devstack@n-api.service[119516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 02:12:48.083611 n-d-master-1 devstack@n-api.service[119516]: Sun Aug 7 02:12:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 02:13:17.766145 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:13:17.768135 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=8 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:13:17.938852 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-732676d9-af0a-47b9-9745-129cdfd519ea tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Action: 'create', calling method: .version_select at 0x7f9e17388e50>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-712086553", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPwxI1rHXbITTbS/M2563kXbqXVkjTwimNGMi9xjjzJtKbA73QLcQxZoqDFfXrZlA4VJVyckZQEtU09IOcdmXEmHVOjIIjtDZYVafLikUxnE1JKeDoJRr758mvwfFsnZQ=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:13:17.955017 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-732676d9-af0a-47b9-9745-129cdfd519ea tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Getting quotas for project c3c7f99169cd47ae9f3020313f4796df. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:13:17.960423 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-732676d9-af0a-47b9-9745-129cdfd519ea tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Getting quotas for user 047c577e2fcd44f88da514da4a3492ec and project c3c7f99169cd47ae9f3020313f4796df. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:13:17.995072 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-732676d9-af0a-47b9-9745-129cdfd519ea tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.234724 Aug 07 02:13:17.995667 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3267/6999] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 02:13:17 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:13:18.047921 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2f6397ef-44b5-4223-a894-e0f82aeb4e98 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1352804768", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-712086553", "networks": [{"uuid": "3a07eeac-d26b-4804-8b4a-c19fd278dfbd"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:13:18.056633 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:13:18.057334 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=7 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:13:18.102953 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-2f6397ef-44b5-4223-a894-e0f82aeb4e98 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] validate_networks() for [('3a07eeac-d26b-4804-8b4a-c19fd278dfbd', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 02:13:18.475527 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-2f6397ef-44b5-4223-a894-e0f82aeb4e98 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 02:13:18.476007 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-2f6397ef-44b5-4223-a894-e0f82aeb4e98 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 02:13:18.476497 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-2f6397ef-44b5-4223-a894-e0f82aeb4e98 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 02:13:18.476954 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-2f6397ef-44b5-4223-a894-e0f82aeb4e98 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 02:13:18.477382 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-2f6397ef-44b5-4223-a894-e0f82aeb4e98 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 02:13:18.487334 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f6397ef-44b5-4223-a894-e0f82aeb4e98 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:18.487827 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f6397ef-44b5-4223-a894-e0f82aeb4e98 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:18.488312 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f6397ef-44b5-4223-a894-e0f82aeb4e98 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:18.489055 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f6397ef-44b5-4223-a894-e0f82aeb4e98 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:18.489526 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f6397ef-44b5-4223-a894-e0f82aeb4e98 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:18.489963 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2f6397ef-44b5-4223-a894-e0f82aeb4e98 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:18.507117 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-2f6397ef-44b5-4223-a894-e0f82aeb4e98 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Getting quotas for project c3c7f99169cd47ae9f3020313f4796df. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:13:18.513205 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-2f6397ef-44b5-4223-a894-e0f82aeb4e98 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Getting quotas for user 047c577e2fcd44f88da514da4a3492ec and project c3c7f99169cd47ae9f3020313f4796df. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:13:18.526103 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2f6397ef-44b5-4223-a894-e0f82aeb4e98 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 02:13:18.528432 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2f6397ef-44b5-4223-a894-e0f82aeb4e98 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 75a49119-3af5-4b21-8ab6-7c0e0699754d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 02:13:18.578129 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2f6397ef-44b5-4223-a894-e0f82aeb4e98 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534306 Aug 07 02:13:18.578787 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3733/7000] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 02:13:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 02:13:18.589541 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e9445db0-c238-4873-890d-4f1bd16a5462 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:13:18.590167 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e9445db0-c238-4873-890d-4f1bd16a5462 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 75a49119-3af5-4b21-8ab6-7c0e0699754d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:13:18.646638 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e9445db0-c238-4873-890d-4f1bd16a5462 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:13:18.654724 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e9445db0-c238-4873-890d-4f1bd16a5462 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d" status: 200 len: 1262 microversion: 2.1 time: 0.069221 Aug 07 02:13:18.656329 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3268/7001] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:13:18 2022] GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d => generated 1262 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:13:19.678564 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6f6f9354-7591-45ab-acd1-8ac94ea19470 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:13:19.680425 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6f6f9354-7591-45ab-acd1-8ac94ea19470 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 75a49119-3af5-4b21-8ab6-7c0e0699754d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:13:19.693652 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f6f9354-7591-45ab-acd1-8ac94ea19470 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:19.694565 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f6f9354-7591-45ab-acd1-8ac94ea19470 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:19.695173 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f6f9354-7591-45ab-acd1-8ac94ea19470 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:19.696587 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f6f9354-7591-45ab-acd1-8ac94ea19470 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:19.697325 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f6f9354-7591-45ab-acd1-8ac94ea19470 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:19.698059 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6f6f9354-7591-45ab-acd1-8ac94ea19470 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:19.769859 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6f6f9354-7591-45ab-acd1-8ac94ea19470 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:13:19.779809 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6f6f9354-7591-45ab-acd1-8ac94ea19470 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d" status: 200 len: 1322 microversion: 2.1 time: 0.106969 Aug 07 02:13:19.793382 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3734/7002] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:13:19 2022] GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d => generated 1322 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:13:20.803069 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-830a4d39-e83e-4f6d-b37f-4ce5b8d11fef tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:13:20.803790 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-830a4d39-e83e-4f6d-b37f-4ce5b8d11fef tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 75a49119-3af5-4b21-8ab6-7c0e0699754d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:13:21.102651 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-830a4d39-e83e-4f6d-b37f-4ce5b8d11fef tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:21.110548 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-830a4d39-e83e-4f6d-b37f-4ce5b8d11fef tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:21.111454 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-830a4d39-e83e-4f6d-b37f-4ce5b8d11fef tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:21.113040 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-830a4d39-e83e-4f6d-b37f-4ce5b8d11fef tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:21.113824 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-830a4d39-e83e-4f6d-b37f-4ce5b8d11fef tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:21.114441 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-830a4d39-e83e-4f6d-b37f-4ce5b8d11fef tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:21.138850 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-3938bd75-b7e3-4512-89b9-9e0a7c8bc2f9 req-cc811705-c28d-444a-b4bf-4b429a900716 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75a49119-3af5-4b21-8ab6-7c0e0699754d", "tag": "c91377ec-3696-470d-ba27-979c5dd5e574"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:13:21.159783 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3938bd75-b7e3-4512-89b9-9e0a7c8bc2f9 req-cc811705-c28d-444a-b4bf-4b429a900716 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:21.164241 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3938bd75-b7e3-4512-89b9-9e0a7c8bc2f9 req-cc811705-c28d-444a-b4bf-4b429a900716 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:21.164762 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3938bd75-b7e3-4512-89b9-9e0a7c8bc2f9 req-cc811705-c28d-444a-b4bf-4b429a900716 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:21.178416 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-3938bd75-b7e3-4512-89b9-9e0a7c8bc2f9 req-cc811705-c28d-444a-b4bf-4b429a900716 service nova] Creating event network-changed:c91377ec-3696-470d-ba27-979c5dd5e574 for instance 75a49119-3af5-4b21-8ab6-7c0e0699754d on n-h1-master-1 Aug 07 02:13:21.184878 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-3938bd75-b7e3-4512-89b9-9e0a7c8bc2f9 req-cc811705-c28d-444a-b4bf-4b429a900716 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052549 Aug 07 02:13:21.186131 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3735/7003] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 02:13:21.412079 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-830a4d39-e83e-4f6d-b37f-4ce5b8d11fef tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:13:21.421014 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-830a4d39-e83e-4f6d-b37f-4ce5b8d11fef tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d" status: 200 len: 1362 microversion: 2.1 time: 0.623417 Aug 07 02:13:21.421909 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3269/7004] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:13:20 2022] GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d => generated 1362 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:13:22.444000 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5677869c-9f5e-478d-bfb6-19fbdbd7586f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:13:22.444717 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5677869c-9f5e-478d-bfb6-19fbdbd7586f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 75a49119-3af5-4b21-8ab6-7c0e0699754d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:13:22.450952 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5677869c-9f5e-478d-bfb6-19fbdbd7586f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:22.451448 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5677869c-9f5e-478d-bfb6-19fbdbd7586f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:22.451920 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5677869c-9f5e-478d-bfb6-19fbdbd7586f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:22.452858 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5677869c-9f5e-478d-bfb6-19fbdbd7586f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:22.453334 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5677869c-9f5e-478d-bfb6-19fbdbd7586f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:22.453782 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5677869c-9f5e-478d-bfb6-19fbdbd7586f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:22.592028 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5677869c-9f5e-478d-bfb6-19fbdbd7586f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:13:22.600104 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5677869c-9f5e-478d-bfb6-19fbdbd7586f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d" status: 200 len: 1362 microversion: 2.1 time: 0.161161 Aug 07 02:13:22.600673 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3736/7005] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:13:22 2022] GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:13:23.621788 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5125a621-0ea2-40cd-a80d-2d79136c39c3 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:13:23.622456 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5125a621-0ea2-40cd-a80d-2d79136c39c3 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 75a49119-3af5-4b21-8ab6-7c0e0699754d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:13:23.629908 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5125a621-0ea2-40cd-a80d-2d79136c39c3 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:23.630383 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5125a621-0ea2-40cd-a80d-2d79136c39c3 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:23.630814 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5125a621-0ea2-40cd-a80d-2d79136c39c3 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:23.631508 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5125a621-0ea2-40cd-a80d-2d79136c39c3 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:23.631992 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5125a621-0ea2-40cd-a80d-2d79136c39c3 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:23.632417 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5125a621-0ea2-40cd-a80d-2d79136c39c3 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:23.770016 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5125a621-0ea2-40cd-a80d-2d79136c39c3 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:13:23.778274 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5125a621-0ea2-40cd-a80d-2d79136c39c3 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d" status: 200 len: 1362 microversion: 2.1 time: 0.161198 Aug 07 02:13:23.778831 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3270/7006] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:13:23 2022] GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:13:24.799739 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-58e9d936-9f41-4251-a189-a530e434f75c tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:13:24.800574 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-58e9d936-9f41-4251-a189-a530e434f75c tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 75a49119-3af5-4b21-8ab6-7c0e0699754d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:13:24.808597 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-58e9d936-9f41-4251-a189-a530e434f75c tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:24.809095 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-58e9d936-9f41-4251-a189-a530e434f75c tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:24.809547 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-58e9d936-9f41-4251-a189-a530e434f75c tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:24.810260 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-58e9d936-9f41-4251-a189-a530e434f75c tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:24.810726 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-58e9d936-9f41-4251-a189-a530e434f75c tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:24.811171 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-58e9d936-9f41-4251-a189-a530e434f75c tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:24.950217 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-58e9d936-9f41-4251-a189-a530e434f75c tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:13:24.957681 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-58e9d936-9f41-4251-a189-a530e434f75c tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d" status: 200 len: 1362 microversion: 2.1 time: 0.161898 Aug 07 02:13:24.958253 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3737/7007] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:13:24 2022] GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:13:25.978610 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3b351dc5-8883-4b94-a534-88f9fea0116d tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:13:25.979208 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3b351dc5-8883-4b94-a534-88f9fea0116d tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 75a49119-3af5-4b21-8ab6-7c0e0699754d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:13:25.986093 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b351dc5-8883-4b94-a534-88f9fea0116d tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:25.986584 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b351dc5-8883-4b94-a534-88f9fea0116d tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:25.987028 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b351dc5-8883-4b94-a534-88f9fea0116d tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:25.987735 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b351dc5-8883-4b94-a534-88f9fea0116d tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:25.988228 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b351dc5-8883-4b94-a534-88f9fea0116d tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:25.988661 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b351dc5-8883-4b94-a534-88f9fea0116d tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:26.115794 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3b351dc5-8883-4b94-a534-88f9fea0116d tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:13:26.123752 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3b351dc5-8883-4b94-a534-88f9fea0116d tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d" status: 200 len: 1362 microversion: 2.1 time: 0.149245 Aug 07 02:13:26.124345 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3271/7008] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:13:25 2022] GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:13:26.470630 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-e020c60a-062a-4c63-9e9f-1310aa157fee req-7715c545-a712-4df9-af1a-81718f528c52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a49119-3af5-4b21-8ab6-7c0e0699754d", "name": "network-vif-plugged", "status": "completed", "tag": "c91377ec-3696-470d-ba27-979c5dd5e574"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:13:26.482477 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e020c60a-062a-4c63-9e9f-1310aa157fee req-7715c545-a712-4df9-af1a-81718f528c52 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:26.482977 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e020c60a-062a-4c63-9e9f-1310aa157fee req-7715c545-a712-4df9-af1a-81718f528c52 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:26.483664 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e020c60a-062a-4c63-9e9f-1310aa157fee req-7715c545-a712-4df9-af1a-81718f528c52 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:26.495462 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-e020c60a-062a-4c63-9e9f-1310aa157fee req-7715c545-a712-4df9-af1a-81718f528c52 service nova] Creating event network-vif-plugged:c91377ec-3696-470d-ba27-979c5dd5e574 for instance 75a49119-3af5-4b21-8ab6-7c0e0699754d on n-h1-master-1 Aug 07 02:13:26.500537 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-e020c60a-062a-4c63-9e9f-1310aa157fee req-7715c545-a712-4df9-af1a-81718f528c52 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033650 Aug 07 02:13:26.501126 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3738/7009] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:13:27.145008 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0a881826-eb83-428b-9dc2-ce2b96f2a7ed tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:13:27.145619 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0a881826-eb83-428b-9dc2-ce2b96f2a7ed tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 75a49119-3af5-4b21-8ab6-7c0e0699754d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:13:27.152513 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a881826-eb83-428b-9dc2-ce2b96f2a7ed tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:27.152993 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a881826-eb83-428b-9dc2-ce2b96f2a7ed tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:27.153425 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a881826-eb83-428b-9dc2-ce2b96f2a7ed tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:27.154118 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a881826-eb83-428b-9dc2-ce2b96f2a7ed tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:27.154571 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a881826-eb83-428b-9dc2-ce2b96f2a7ed tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:27.154992 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0a881826-eb83-428b-9dc2-ce2b96f2a7ed tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:27.281866 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0a881826-eb83-428b-9dc2-ce2b96f2a7ed tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:13:27.289366 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0a881826-eb83-428b-9dc2-ce2b96f2a7ed tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d" status: 200 len: 1362 microversion: 2.1 time: 0.148230 Aug 07 02:13:27.290471 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3272/7010] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:13:27 2022] GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:13:28.311793 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2b01d5cc-b917-431a-bc32-32c6c42de842 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:13:28.312527 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2b01d5cc-b917-431a-bc32-32c6c42de842 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 75a49119-3af5-4b21-8ab6-7c0e0699754d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:13:28.319437 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2b01d5cc-b917-431a-bc32-32c6c42de842 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:28.319954 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2b01d5cc-b917-431a-bc32-32c6c42de842 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:28.320409 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2b01d5cc-b917-431a-bc32-32c6c42de842 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:28.321121 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2b01d5cc-b917-431a-bc32-32c6c42de842 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:28.322124 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2b01d5cc-b917-431a-bc32-32c6c42de842 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:28.322557 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2b01d5cc-b917-431a-bc32-32c6c42de842 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:28.453367 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2b01d5cc-b917-431a-bc32-32c6c42de842 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:13:28.461092 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2b01d5cc-b917-431a-bc32-32c6c42de842 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d" status: 200 len: 1554 microversion: 2.1 time: 0.153624 Aug 07 02:13:28.461719 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3739/7011] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:13:28 2022] GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:13:28.483182 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f14c5685-478a-4f40-ac82-fa5e936b7d5f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:13:28.483813 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f14c5685-478a-4f40-ac82-fa5e936b7d5f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 75a49119-3af5-4b21-8ab6-7c0e0699754d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:13:28.490673 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f14c5685-478a-4f40-ac82-fa5e936b7d5f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:28.491165 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f14c5685-478a-4f40-ac82-fa5e936b7d5f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:28.491611 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f14c5685-478a-4f40-ac82-fa5e936b7d5f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:28.492350 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f14c5685-478a-4f40-ac82-fa5e936b7d5f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:28.492817 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f14c5685-478a-4f40-ac82-fa5e936b7d5f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:28.493885 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f14c5685-478a-4f40-ac82-fa5e936b7d5f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:28.619965 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f14c5685-478a-4f40-ac82-fa5e936b7d5f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:13:28.627530 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f14c5685-478a-4f40-ac82-fa5e936b7d5f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d" status: 200 len: 1554 microversion: 2.1 time: 0.148187 Aug 07 02:13:28.628192 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3273/7012] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:13:28 2022] GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:13:30.278606 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4f539479-6cfa-40d1-87d1-ac335f8a5fcb tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8aac25f4-6ebe-471a-8a90-dddbac338705"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:13:30.280920 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4f539479-6cfa-40d1-87d1-ac335f8a5fcb tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 75a49119-3af5-4b21-8ab6-7c0e0699754d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:13:30.282876 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:13:30.283687 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:13:30.289923 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f539479-6cfa-40d1-87d1-ac335f8a5fcb tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:30.290951 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f539479-6cfa-40d1-87d1-ac335f8a5fcb tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:30.291394 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f539479-6cfa-40d1-87d1-ac335f8a5fcb tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:30.292207 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f539479-6cfa-40d1-87d1-ac335f8a5fcb tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:30.292670 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f539479-6cfa-40d1-87d1-ac335f8a5fcb tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:30.293102 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4f539479-6cfa-40d1-87d1-ac335f8a5fcb tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:30.830031 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4f539479-6cfa-40d1-87d1-ac335f8a5fcb tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "POST /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.555153 Aug 07 02:13:30.830672 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3740/7013] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Aug 7 02:13:30 2022] POST /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d/os-volume_attachments => generated 194 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:13:41.527813 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-61d3fe53-5a45-4aa9-aa27-7e5f9859bcec tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:13:41.528340 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-61d3fe53-5a45-4aa9-aa27-7e5f9859bcec tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 75a49119-3af5-4b21-8ab6-7c0e0699754d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:13:41.530171 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:13:41.531954 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:13:41.532637 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=30 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:13:41.539294 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-61d3fe53-5a45-4aa9-aa27-7e5f9859bcec tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:41.539785 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-61d3fe53-5a45-4aa9-aa27-7e5f9859bcec tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:41.540257 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-61d3fe53-5a45-4aa9-aa27-7e5f9859bcec tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:41.541466 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-61d3fe53-5a45-4aa9-aa27-7e5f9859bcec tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:41.541934 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-61d3fe53-5a45-4aa9-aa27-7e5f9859bcec tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:41.542373 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-61d3fe53-5a45-4aa9-aa27-7e5f9859bcec tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:41.623106 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-61d3fe53-5a45-4aa9-aa27-7e5f9859bcec tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lazy-loading 'services' on Instance uuid 75a49119-3af5-4b21-8ab6-7c0e0699754d {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 02:13:41.695768 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-61d3fe53-5a45-4aa9-aa27-7e5f9859bcec tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "DELETE /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d/os-volume_attachments/8aac25f4-6ebe-471a-8a90-dddbac338705" status: 202 len: 0 microversion: 2.1 time: 0.171769 Aug 07 02:13:41.696411 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3274/7014] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Aug 7 02:13:41 2022] DELETE /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d/os-volume_attachments/8aac25f4-6ebe-471a-8a90-dddbac338705 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:13:41.702750 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:13:41.703731 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:13:41.708289 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0d6e5998-11be-4f14-92df-a76206cd0b63 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:13:41.710661 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0d6e5998-11be-4f14-92df-a76206cd0b63 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 75a49119-3af5-4b21-8ab6-7c0e0699754d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:13:41.720706 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0d6e5998-11be-4f14-92df-a76206cd0b63 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:41.721208 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0d6e5998-11be-4f14-92df-a76206cd0b63 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:41.721668 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0d6e5998-11be-4f14-92df-a76206cd0b63 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:41.722429 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0d6e5998-11be-4f14-92df-a76206cd0b63 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:41.722904 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0d6e5998-11be-4f14-92df-a76206cd0b63 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:41.723350 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0d6e5998-11be-4f14-92df-a76206cd0b63 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:41.758537 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0d6e5998-11be-4f14-92df-a76206cd0b63 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057529 Aug 07 02:13:41.759335 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3741/7015] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 02:13:41 2022] GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:13:42.772743 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-537ebcc5-09fc-479c-b1e6-d29a48239c9a tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:13:42.775118 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-537ebcc5-09fc-479c-b1e6-d29a48239c9a tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 75a49119-3af5-4b21-8ab6-7c0e0699754d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:13:42.782440 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-537ebcc5-09fc-479c-b1e6-d29a48239c9a tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:42.782925 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-537ebcc5-09fc-479c-b1e6-d29a48239c9a tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:42.783366 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-537ebcc5-09fc-479c-b1e6-d29a48239c9a tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:42.784104 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-537ebcc5-09fc-479c-b1e6-d29a48239c9a tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:42.784562 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-537ebcc5-09fc-479c-b1e6-d29a48239c9a tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:42.784995 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-537ebcc5-09fc-479c-b1e6-d29a48239c9a tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:42.814325 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-537ebcc5-09fc-479c-b1e6-d29a48239c9a tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046144 Aug 07 02:13:42.815084 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3275/7016] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 02:13:42 2022] GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:13:43.826830 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9b7ba421-d829-417f-b4c4-a2899787bce9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:13:43.829055 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9b7ba421-d829-417f-b4c4-a2899787bce9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 75a49119-3af5-4b21-8ab6-7c0e0699754d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:13:43.835972 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b7ba421-d829-417f-b4c4-a2899787bce9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:43.836473 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b7ba421-d829-417f-b4c4-a2899787bce9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:43.836927 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b7ba421-d829-417f-b4c4-a2899787bce9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:43.837646 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b7ba421-d829-417f-b4c4-a2899787bce9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:43.838154 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b7ba421-d829-417f-b4c4-a2899787bce9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:43.838603 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b7ba421-d829-417f-b4c4-a2899787bce9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:43.867949 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9b7ba421-d829-417f-b4c4-a2899787bce9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045128 Aug 07 02:13:43.868445 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3742/7017] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 02:13:43 2022] GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:13:44.880920 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c0f5a36b-2d49-40e8-878c-56003040612b tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:13:44.883161 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c0f5a36b-2d49-40e8-878c-56003040612b tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 75a49119-3af5-4b21-8ab6-7c0e0699754d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:13:44.890416 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c0f5a36b-2d49-40e8-878c-56003040612b tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:44.890898 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c0f5a36b-2d49-40e8-878c-56003040612b tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:44.891355 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c0f5a36b-2d49-40e8-878c-56003040612b tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:44.892087 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c0f5a36b-2d49-40e8-878c-56003040612b tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:44.892540 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c0f5a36b-2d49-40e8-878c-56003040612b tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:44.892966 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c0f5a36b-2d49-40e8-878c-56003040612b tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:44.921668 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c0f5a36b-2d49-40e8-878c-56003040612b tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044728 Aug 07 02:13:44.922327 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3276/7018] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 02:13:44 2022] GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:13:45.934282 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a70f6b90-2579-40ea-bc9b-724c8f670f35 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:13:45.936533 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a70f6b90-2579-40ea-bc9b-724c8f670f35 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 75a49119-3af5-4b21-8ab6-7c0e0699754d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:13:45.943433 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a70f6b90-2579-40ea-bc9b-724c8f670f35 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:45.943957 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a70f6b90-2579-40ea-bc9b-724c8f670f35 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:45.944415 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a70f6b90-2579-40ea-bc9b-724c8f670f35 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:45.945135 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a70f6b90-2579-40ea-bc9b-724c8f670f35 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:45.945603 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a70f6b90-2579-40ea-bc9b-724c8f670f35 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:45.946082 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a70f6b90-2579-40ea-bc9b-724c8f670f35 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:45.977109 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a70f6b90-2579-40ea-bc9b-724c8f670f35 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046791 Aug 07 02:13:45.978405 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3743/7019] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 02:13:45 2022] GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:13:46.989274 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5bdcedfb-1ea2-4745-b4eb-76c12c431b59 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:13:46.991428 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5bdcedfb-1ea2-4745-b4eb-76c12c431b59 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 75a49119-3af5-4b21-8ab6-7c0e0699754d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:13:46.998496 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5bdcedfb-1ea2-4745-b4eb-76c12c431b59 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:46.998980 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5bdcedfb-1ea2-4745-b4eb-76c12c431b59 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:46.999420 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5bdcedfb-1ea2-4745-b4eb-76c12c431b59 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:47.000157 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5bdcedfb-1ea2-4745-b4eb-76c12c431b59 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:47.000624 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5bdcedfb-1ea2-4745-b4eb-76c12c431b59 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:47.001059 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5bdcedfb-1ea2-4745-b4eb-76c12c431b59 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:47.030200 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5bdcedfb-1ea2-4745-b4eb-76c12c431b59 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044939 Aug 07 02:13:47.030748 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3277/7020] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 02:13:46 2022] GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 02:13:47.041898 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2976697d-5a40-443a-9868-ddf79ab44d53 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:13:47.042418 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2976697d-5a40-443a-9868-ddf79ab44d53 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 75a49119-3af5-4b21-8ab6-7c0e0699754d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:13:47.049180 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2976697d-5a40-443a-9868-ddf79ab44d53 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:47.049676 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2976697d-5a40-443a-9868-ddf79ab44d53 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:47.050134 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2976697d-5a40-443a-9868-ddf79ab44d53 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:47.050849 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2976697d-5a40-443a-9868-ddf79ab44d53 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:47.051322 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2976697d-5a40-443a-9868-ddf79ab44d53 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:47.051767 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2976697d-5a40-443a-9868-ddf79ab44d53 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:47.131301 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-2976697d-5a40-443a-9868-ddf79ab44d53 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] HTTP exception thrown: Instance 75a49119-3af5-4b21-8ab6-7c0e0699754d is not attached to volume 8aac25f4-6ebe-471a-8a90-dddbac338705 Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2976697d-5a40-443a-9868-ddf79ab44d53 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Request method failure captured: Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d/os-volume_attachments/8aac25f4-6ebe-471a-8a90-dddbac338705 HTTP/1.1 Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7x-4wcL586vSYx7p3aMxxrw3i6C31X_225XV6wYqLylt4VJjI-RsSp-ALzxeOKT3DH7avQ_L4quA00BHcWIngWB7vl0eulHN9O8trUJy4WLlA9_jnOl3vxbUzlVoD4_N7jJ5gHedkc77Baq_cvyvqWQT78EeWzH03kKImMdZwhkp5Wo Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: c3c7f99169cd47ae9f3020313f4796df Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-TestEncryptedCinderVolumes-809558453 Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c3c7f99169cd47ae9f3020313f4796df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c3c7f99169cd47ae9f3020313f4796df", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c3c7f99169cd47ae9f3020313f4796df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c3c7f99169cd47ae9f3020313f4796df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-TestEncryptedCinderVolumes-809558453 Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: c3c7f99169cd47ae9f3020313f4796df Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-809558453 Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-TestEncryptedCinderVolumes-809558453-project Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 047c577e2fcd44f88da514da4a3492ec Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-TestEncryptedCinderVolumes-809558453-project Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 75a49119-3af5-4b21-8ab6-7c0e0699754d is not attached to volume 8aac25f4-6ebe-471a-8a90-dddbac338705 Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: action_args: {'server_id': '75a49119-3af5-4b21-8ab6-7c0e0699754d', 'id': '8aac25f4-6ebe-471a-8a90-dddbac338705'} Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8aac25f4-6ebe-471a-8a90-dddbac338705. Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75a49119-3af5-4b21-8ab6-7c0e0699754d is not attached to volume 8aac25f4-6ebe-471a-8a90-dddbac338705 Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:13:47.138151 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:13:47.142613 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:13:47.142613 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:13:47.142613 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75a49119-3af5-4b21-8ab6-7c0e0699754d is not attached to volume 8aac25f4-6ebe-471a-8a90-dddbac338705 Aug 07 02:13:47.142613 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:13:47.142613 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2976697d-5a40-443a-9868-ddf79ab44d53 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Returning 404 to user: Instance 75a49119-3af5-4b21-8ab6-7c0e0699754d is not attached to volume 8aac25f4-6ebe-471a-8a90-dddbac338705 {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:13:47.142613 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2976697d-5a40-443a-9868-ddf79ab44d53 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "DELETE /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d/os-volume_attachments/8aac25f4-6ebe-471a-8a90-dddbac338705" status: 404 len: 154 microversion: 2.1 time: 0.102341 Aug 07 02:13:47.142613 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3744/7021] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Aug 7 02:13:47 2022] DELETE /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d/os-volume_attachments/8aac25f4-6ebe-471a-8a90-dddbac338705 => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:13:50.476930 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-74d24082-dacf-4e5b-bf7c-63313c1a68f7 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:13:50.477543 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-74d24082-dacf-4e5b-bf7c-63313c1a68f7 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 75a49119-3af5-4b21-8ab6-7c0e0699754d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:13:50.485187 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-74d24082-dacf-4e5b-bf7c-63313c1a68f7 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:50.485510 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-74d24082-dacf-4e5b-bf7c-63313c1a68f7 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:50.485943 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-74d24082-dacf-4e5b-bf7c-63313c1a68f7 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:50.486658 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-74d24082-dacf-4e5b-bf7c-63313c1a68f7 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:50.487156 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-74d24082-dacf-4e5b-bf7c-63313c1a68f7 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:50.487530 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-74d24082-dacf-4e5b-bf7c-63313c1a68f7 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:50.513932 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-74d24082-dacf-4e5b-bf7c-63313c1a68f7 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 75a49119-3af5-4b21-8ab6-7c0e0699754d] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 02:13:50.605815 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-74d24082-dacf-4e5b-bf7c-63313c1a68f7 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "DELETE /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d" status: 204 len: 0 microversion: 2.1 time: 0.132498 Aug 07 02:13:50.606402 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3278/7022] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 02:13:50 2022] DELETE /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 02:13:50.614665 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-530cb422-ea8b-4b0a-9fc7-09afb5bcb4bc tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:13:50.615280 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-530cb422-ea8b-4b0a-9fc7-09afb5bcb4bc tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 75a49119-3af5-4b21-8ab6-7c0e0699754d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:13:50.623713 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-530cb422-ea8b-4b0a-9fc7-09afb5bcb4bc tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:50.624244 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-530cb422-ea8b-4b0a-9fc7-09afb5bcb4bc tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:50.624707 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-530cb422-ea8b-4b0a-9fc7-09afb5bcb4bc tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:50.625431 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-530cb422-ea8b-4b0a-9fc7-09afb5bcb4bc tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:50.625906 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-530cb422-ea8b-4b0a-9fc7-09afb5bcb4bc tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:50.626355 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-530cb422-ea8b-4b0a-9fc7-09afb5bcb4bc tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:50.765807 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-530cb422-ea8b-4b0a-9fc7-09afb5bcb4bc tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:13:50.773615 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-530cb422-ea8b-4b0a-9fc7-09afb5bcb4bc tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d" status: 200 len: 1560 microversion: 2.1 time: 0.162995 Aug 07 02:13:50.774286 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3745/7023] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:13:50 2022] GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:13:51.796276 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8a94b3f9-2543-4490-9c79-0edd2e64a65f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:13:51.796993 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8a94b3f9-2543-4490-9c79-0edd2e64a65f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 75a49119-3af5-4b21-8ab6-7c0e0699754d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:13:51.804230 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a94b3f9-2543-4490-9c79-0edd2e64a65f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:51.804790 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a94b3f9-2543-4490-9c79-0edd2e64a65f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:51.805239 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a94b3f9-2543-4490-9c79-0edd2e64a65f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:51.805948 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a94b3f9-2543-4490-9c79-0edd2e64a65f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:51.806410 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a94b3f9-2543-4490-9c79-0edd2e64a65f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:51.806844 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a94b3f9-2543-4490-9c79-0edd2e64a65f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:51.938062 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8a94b3f9-2543-4490-9c79-0edd2e64a65f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:13:51.945637 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8a94b3f9-2543-4490-9c79-0edd2e64a65f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d" status: 200 len: 1560 microversion: 2.1 time: 0.154212 Aug 07 02:13:51.946215 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3279/7024] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:13:51 2022] GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:13:52.899456 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-782aa5c7-0751-40bd-852b-55ff5e27b34c req-c0acdb2b-c8e5-4df3-9fcf-56328daf1ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a49119-3af5-4b21-8ab6-7c0e0699754d", "name": "network-vif-deleted", "tag": "c91377ec-3696-470d-ba27-979c5dd5e574"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:13:52.908791 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-782aa5c7-0751-40bd-852b-55ff5e27b34c req-c0acdb2b-c8e5-4df3-9fcf-56328daf1ee6 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:52.909285 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-782aa5c7-0751-40bd-852b-55ff5e27b34c req-c0acdb2b-c8e5-4df3-9fcf-56328daf1ee6 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:52.909737 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-782aa5c7-0751-40bd-852b-55ff5e27b34c req-c0acdb2b-c8e5-4df3-9fcf-56328daf1ee6 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:52.921834 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-782aa5c7-0751-40bd-852b-55ff5e27b34c req-c0acdb2b-c8e5-4df3-9fcf-56328daf1ee6 service nova] Creating event network-vif-deleted:c91377ec-3696-470d-ba27-979c5dd5e574 for instance 75a49119-3af5-4b21-8ab6-7c0e0699754d on n-h1-master-1 Aug 07 02:13:52.927000 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-782aa5c7-0751-40bd-852b-55ff5e27b34c req-c0acdb2b-c8e5-4df3-9fcf-56328daf1ee6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094860 Aug 07 02:13:52.927600 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3746/7025] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:13:52.966691 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-38d46b68-e829-4581-aee8-a53c7ee53df3 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:13:52.967946 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-38d46b68-e829-4581-aee8-a53c7ee53df3 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 75a49119-3af5-4b21-8ab6-7c0e0699754d] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:13:52.975254 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-38d46b68-e829-4581-aee8-a53c7ee53df3 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:52.975799 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-38d46b68-e829-4581-aee8-a53c7ee53df3 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:52.976270 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-38d46b68-e829-4581-aee8-a53c7ee53df3 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:52.976997 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-38d46b68-e829-4581-aee8-a53c7ee53df3 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:52.977460 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-38d46b68-e829-4581-aee8-a53c7ee53df3 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:52.977893 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-38d46b68-e829-4581-aee8-a53c7ee53df3 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:53.012858 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-38d46b68-e829-4581-aee8-a53c7ee53df3 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:53.013269 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-38d46b68-e829-4581-aee8-a53c7ee53df3 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:53.013703 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-38d46b68-e829-4581-aee8-a53c7ee53df3 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:53.014152 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-38d46b68-e829-4581-aee8-a53c7ee53df3 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lazy-loading 'fault' on Instance uuid 75a49119-3af5-4b21-8ab6-7c0e0699754d {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 02:13:53.058022 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-38d46b68-e829-4581-aee8-a53c7ee53df3 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:13:53.065455 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-38d46b68-e829-4581-aee8-a53c7ee53df3 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d" status: 200 len: 1352 microversion: 2.1 time: 0.102750 Aug 07 02:13:53.066020 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3280/7026] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:13:52 2022] GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d => generated 1352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:13:54.088298 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3d8988f4-21a0-49cf-90bb-00cf76e5a088 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:13:54.089603 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3d8988f4-21a0-49cf-90bb-00cf76e5a088 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 75a49119-3af5-4b21-8ab6-7c0e0699754d] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:13:54.095759 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3d8988f4-21a0-49cf-90bb-00cf76e5a088 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:54.096291 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3d8988f4-21a0-49cf-90bb-00cf76e5a088 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:54.096741 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3d8988f4-21a0-49cf-90bb-00cf76e5a088 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:54.097450 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3d8988f4-21a0-49cf-90bb-00cf76e5a088 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:54.097923 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3d8988f4-21a0-49cf-90bb-00cf76e5a088 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:54.098364 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3d8988f4-21a0-49cf-90bb-00cf76e5a088 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:54.111492 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-3d8988f4-21a0-49cf-90bb-00cf76e5a088 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] HTTP exception thrown: Instance 75a49119-3af5-4b21-8ab6-7c0e0699754d could not be found. Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3d8988f4-21a0-49cf-90bb-00cf76e5a088 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Request method failure captured: Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d HTTP/1.1 Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7x-4wcL586vSYx7p3aMxxrw3i6C31X_225XV6wYqLylt4VJjI-RsSp-ALzxeOKT3DH7avQ_L4quA00BHcWIngWB7vl0eulHN9O8trUJy4WLlA9_jnOl3vxbUzlVoD4_N7jJ5gHedkc77Baq_cvyvqWQT78EeWzH03kKImMdZwhkp5Wo Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: c3c7f99169cd47ae9f3020313f4796df Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-TestEncryptedCinderVolumes-809558453 Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c3c7f99169cd47ae9f3020313f4796df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c3c7f99169cd47ae9f3020313f4796df", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c3c7f99169cd47ae9f3020313f4796df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c3c7f99169cd47ae9f3020313f4796df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-TestEncryptedCinderVolumes-809558453 Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: c3c7f99169cd47ae9f3020313f4796df Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-809558453 Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-TestEncryptedCinderVolumes-809558453-project Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 047c577e2fcd44f88da514da4a3492ec Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-TestEncryptedCinderVolumes-809558453-project Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 75a49119-3af5-4b21-8ab6-7c0e0699754d could not be found. Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '75a49119-3af5-4b21-8ab6-7c0e0699754d'} Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75a49119-3af5-4b21-8ab6-7c0e0699754d could not be found. Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75a49119-3af5-4b21-8ab6-7c0e0699754d could not be found. Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:13:54.113153 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:13:54.117580 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:13:54.117580 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:13:54.117580 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:13:54.117580 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:13:54.117580 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:13:54.117580 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75a49119-3af5-4b21-8ab6-7c0e0699754d could not be found. Aug 07 02:13:54.117580 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:13:54.117580 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3d8988f4-21a0-49cf-90bb-00cf76e5a088 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Returning 404 to user: Instance 75a49119-3af5-4b21-8ab6-7c0e0699754d could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:13:54.117580 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3d8988f4-21a0-49cf-90bb-00cf76e5a088 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d" status: 404 len: 111 microversion: 2.1 time: 0.031458 Aug 07 02:13:54.117580 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3747/7027] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:13:54 2022] GET /compute/v2.1/servers/75a49119-3af5-4b21-8ab6-7c0e0699754d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:13:54.123476 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ffaf8956-287a-4538-b232-5cf09128a568 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '.version_select at 0x7f9e17f4fee0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:13:54.143369 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ffaf8956-287a-4538-b232-5cf09128a568 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-712086553" status: 202 len: 0 microversion: 2.1 time: 0.023704 Aug 07 02:13:54.143960 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3281/7028] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Aug 7 02:13:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-712086553 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:13:54.161474 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0f67ad3f-da25-403c-a6ba-9c1d4ed7cc3c tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Action: 'create', calling method: .version_select at 0x7f9e16e84d30>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1835148802", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzw3E9LTrJ36X5JET5F3NhLkF7hGBqxcHxFFGkeLno71vshvRaFU15/f6jqRhYy+8k+2oScruaYV0oHZWw5cYsO9gME2z+EnzcpyW6f3drpP8XTRKmNt06HH2VMCxXUDg=="}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:13:54.176414 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-0f67ad3f-da25-403c-a6ba-9c1d4ed7cc3c tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Getting quotas for project c3c7f99169cd47ae9f3020313f4796df. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:13:54.181710 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-0f67ad3f-da25-403c-a6ba-9c1d4ed7cc3c tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Getting quotas for user 047c577e2fcd44f88da514da4a3492ec and project c3c7f99169cd47ae9f3020313f4796df. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:13:54.207389 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0f67ad3f-da25-403c-a6ba-9c1d4ed7cc3c tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.049897 Aug 07 02:13:54.208003 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3748/7029] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 02:13:54 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:13:54.265101 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-45019ba5-a420-4027-ba88-5b9c94ebf197 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1381072624", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1835148802", "networks": [{"uuid": "3a07eeac-d26b-4804-8b4a-c19fd278dfbd"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:13:54.317061 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-45019ba5-a420-4027-ba88-5b9c94ebf197 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] validate_networks() for [('3a07eeac-d26b-4804-8b4a-c19fd278dfbd', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 02:13:54.682076 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-45019ba5-a420-4027-ba88-5b9c94ebf197 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 02:13:54.683029 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-45019ba5-a420-4027-ba88-5b9c94ebf197 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 02:13:54.683509 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-45019ba5-a420-4027-ba88-5b9c94ebf197 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 02:13:54.683991 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-45019ba5-a420-4027-ba88-5b9c94ebf197 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 02:13:54.684412 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-45019ba5-a420-4027-ba88-5b9c94ebf197 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 02:13:54.693271 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-45019ba5-a420-4027-ba88-5b9c94ebf197 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:54.693853 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-45019ba5-a420-4027-ba88-5b9c94ebf197 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:54.694417 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-45019ba5-a420-4027-ba88-5b9c94ebf197 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:54.695265 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-45019ba5-a420-4027-ba88-5b9c94ebf197 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:54.695730 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-45019ba5-a420-4027-ba88-5b9c94ebf197 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:54.696188 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-45019ba5-a420-4027-ba88-5b9c94ebf197 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:54.713365 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-45019ba5-a420-4027-ba88-5b9c94ebf197 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Getting quotas for project c3c7f99169cd47ae9f3020313f4796df. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:13:54.720836 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-45019ba5-a420-4027-ba88-5b9c94ebf197 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Getting quotas for user 047c577e2fcd44f88da514da4a3492ec and project c3c7f99169cd47ae9f3020313f4796df. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:13:54.734075 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-45019ba5-a420-4027-ba88-5b9c94ebf197 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 02:13:54.736395 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-45019ba5-a420-4027-ba88-5b9c94ebf197 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 02:13:54.780868 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-45019ba5-a420-4027-ba88-5b9c94ebf197 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.520185 Aug 07 02:13:54.781442 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3282/7030] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 02:13:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 02:13:54.792650 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ba6f4b93-d2f7-4c8c-9ca6-6143f1fbe325 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:13:54.793284 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ba6f4b93-d2f7-4c8c-9ca6-6143f1fbe325 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:13:54.848002 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ba6f4b93-d2f7-4c8c-9ca6-6143f1fbe325 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:13:54.856193 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ba6f4b93-d2f7-4c8c-9ca6-6143f1fbe325 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0" status: 200 len: 1263 microversion: 2.1 time: 0.067936 Aug 07 02:13:54.856843 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3749/7031] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:13:54 2022] GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0 => generated 1263 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:13:55.879923 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-390b2198-214f-48c3-bece-1b73a9cefcd2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:13:55.881045 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-390b2198-214f-48c3-bece-1b73a9cefcd2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:13:55.895442 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-390b2198-214f-48c3-bece-1b73a9cefcd2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:55.896229 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-390b2198-214f-48c3-bece-1b73a9cefcd2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:55.896701 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-390b2198-214f-48c3-bece-1b73a9cefcd2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:55.897512 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-390b2198-214f-48c3-bece-1b73a9cefcd2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:55.898313 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-390b2198-214f-48c3-bece-1b73a9cefcd2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:55.898784 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-390b2198-214f-48c3-bece-1b73a9cefcd2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:55.977576 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-390b2198-214f-48c3-bece-1b73a9cefcd2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:13:55.987554 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-390b2198-214f-48c3-bece-1b73a9cefcd2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0" status: 200 len: 1323 microversion: 2.1 time: 0.114162 Aug 07 02:13:55.988804 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3283/7032] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:13:55 2022] GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0 => generated 1323 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:13:57.009462 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c70674be-88f5-4f66-a648-f652c602649d tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:13:57.010103 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c70674be-88f5-4f66-a648-f652c602649d tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:13:57.019259 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c70674be-88f5-4f66-a648-f652c602649d tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:57.019767 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c70674be-88f5-4f66-a648-f652c602649d tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:57.020249 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c70674be-88f5-4f66-a648-f652c602649d tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:57.020987 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c70674be-88f5-4f66-a648-f652c602649d tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:57.021462 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c70674be-88f5-4f66-a648-f652c602649d tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:57.021906 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c70674be-88f5-4f66-a648-f652c602649d tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:57.154282 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c70674be-88f5-4f66-a648-f652c602649d tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:13:57.162394 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c70674be-88f5-4f66-a648-f652c602649d tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0" status: 200 len: 1363 microversion: 2.1 time: 0.156745 Aug 07 02:13:57.162990 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3750/7033] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:13:57 2022] GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:13:57.335563 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-a2bc65d6-a58c-4ac8-8e0c-c0ab1f35473b req-6d99cb26-6734-470c-8c15-e066b6510496 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0", "tag": "6be4ac72-a913-4b25-916d-b0a7efdb148d"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:13:57.346851 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a2bc65d6-a58c-4ac8-8e0c-c0ab1f35473b req-6d99cb26-6734-470c-8c15-e066b6510496 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:57.347471 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a2bc65d6-a58c-4ac8-8e0c-c0ab1f35473b req-6d99cb26-6734-470c-8c15-e066b6510496 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:57.348010 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a2bc65d6-a58c-4ac8-8e0c-c0ab1f35473b req-6d99cb26-6734-470c-8c15-e066b6510496 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:57.359217 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-a2bc65d6-a58c-4ac8-8e0c-c0ab1f35473b req-6d99cb26-6734-470c-8c15-e066b6510496 service nova] Creating event network-changed:6be4ac72-a913-4b25-916d-b0a7efdb148d for instance 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0 on n-h1-master-1 Aug 07 02:13:57.364119 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-a2bc65d6-a58c-4ac8-8e0c-c0ab1f35473b req-6d99cb26-6734-470c-8c15-e066b6510496 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032312 Aug 07 02:13:57.364720 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3284/7034] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:13:58.183741 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-428ffb18-ce26-4821-af00-6c7132dc380c tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:13:58.184414 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-428ffb18-ce26-4821-af00-6c7132dc380c tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:13:58.191261 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-428ffb18-ce26-4821-af00-6c7132dc380c tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:58.191755 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-428ffb18-ce26-4821-af00-6c7132dc380c tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:58.192240 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-428ffb18-ce26-4821-af00-6c7132dc380c tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:58.192953 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-428ffb18-ce26-4821-af00-6c7132dc380c tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:58.193420 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-428ffb18-ce26-4821-af00-6c7132dc380c tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:58.193864 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-428ffb18-ce26-4821-af00-6c7132dc380c tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:58.325308 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-428ffb18-ce26-4821-af00-6c7132dc380c tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:13:58.332966 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-428ffb18-ce26-4821-af00-6c7132dc380c tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0" status: 200 len: 1363 microversion: 2.1 time: 0.153199 Aug 07 02:13:58.333542 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3751/7035] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:13:58 2022] GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:13:59.356032 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5187fe5d-dff1-4b0c-b030-f04ebd008cb6 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:13:59.356736 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5187fe5d-dff1-4b0c-b030-f04ebd008cb6 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:13:59.362845 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5187fe5d-dff1-4b0c-b030-f04ebd008cb6 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:59.363320 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5187fe5d-dff1-4b0c-b030-f04ebd008cb6 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:59.363752 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5187fe5d-dff1-4b0c-b030-f04ebd008cb6 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:59.364469 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5187fe5d-dff1-4b0c-b030-f04ebd008cb6 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:13:59.364922 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5187fe5d-dff1-4b0c-b030-f04ebd008cb6 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:13:59.365351 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5187fe5d-dff1-4b0c-b030-f04ebd008cb6 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:13:59.492318 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5187fe5d-dff1-4b0c-b030-f04ebd008cb6 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:13:59.500394 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5187fe5d-dff1-4b0c-b030-f04ebd008cb6 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0" status: 200 len: 1363 microversion: 2.1 time: 0.149919 Aug 07 02:13:59.500970 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3285/7036] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:13:59 2022] GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:14:00.520993 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-10c87a47-75c4-457d-a5e7-1cfce0dad4eb tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:14:00.521618 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-10c87a47-75c4-457d-a5e7-1cfce0dad4eb tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:00.528864 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10c87a47-75c4-457d-a5e7-1cfce0dad4eb tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:00.529357 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10c87a47-75c4-457d-a5e7-1cfce0dad4eb tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:00.529806 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10c87a47-75c4-457d-a5e7-1cfce0dad4eb tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:00.530519 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10c87a47-75c4-457d-a5e7-1cfce0dad4eb tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:00.530988 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10c87a47-75c4-457d-a5e7-1cfce0dad4eb tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:00.531428 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-10c87a47-75c4-457d-a5e7-1cfce0dad4eb tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:00.661103 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-10c87a47-75c4-457d-a5e7-1cfce0dad4eb tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:14:00.670039 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-10c87a47-75c4-457d-a5e7-1cfce0dad4eb tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0" status: 200 len: 1363 microversion: 2.1 time: 0.152922 Aug 07 02:14:00.670620 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3752/7037] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:14:00 2022] GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:14:01.690655 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9b213cdf-8e5f-4e65-8622-5ac99b876ad9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:14:01.691254 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9b213cdf-8e5f-4e65-8622-5ac99b876ad9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:01.698659 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9b213cdf-8e5f-4e65-8622-5ac99b876ad9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:01.699144 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9b213cdf-8e5f-4e65-8622-5ac99b876ad9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:01.699577 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9b213cdf-8e5f-4e65-8622-5ac99b876ad9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:01.700287 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9b213cdf-8e5f-4e65-8622-5ac99b876ad9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:01.700738 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9b213cdf-8e5f-4e65-8622-5ac99b876ad9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:01.701195 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9b213cdf-8e5f-4e65-8622-5ac99b876ad9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:01.836408 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9b213cdf-8e5f-4e65-8622-5ac99b876ad9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:14:01.844482 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9b213cdf-8e5f-4e65-8622-5ac99b876ad9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0" status: 200 len: 1363 microversion: 2.1 time: 0.157755 Aug 07 02:14:01.845260 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3286/7038] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:14:01 2022] GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:14:02.772860 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-bc8bcf07-1d60-417e-8e9a-7b35bc25bb32 req-72a99b04-32e7-47e5-a0b2-968409e22e92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0", "name": "network-vif-plugged", "status": "completed", "tag": "6be4ac72-a913-4b25-916d-b0a7efdb148d"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:14:02.782912 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-bc8bcf07-1d60-417e-8e9a-7b35bc25bb32 req-72a99b04-32e7-47e5-a0b2-968409e22e92 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:02.783348 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-bc8bcf07-1d60-417e-8e9a-7b35bc25bb32 req-72a99b04-32e7-47e5-a0b2-968409e22e92 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:02.783801 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-bc8bcf07-1d60-417e-8e9a-7b35bc25bb32 req-72a99b04-32e7-47e5-a0b2-968409e22e92 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:02.795288 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-bc8bcf07-1d60-417e-8e9a-7b35bc25bb32 req-72a99b04-32e7-47e5-a0b2-968409e22e92 service nova] Creating event network-vif-plugged:6be4ac72-a913-4b25-916d-b0a7efdb148d for instance 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0 on n-h1-master-1 Aug 07 02:14:02.800286 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-bc8bcf07-1d60-417e-8e9a-7b35bc25bb32 req-72a99b04-32e7-47e5-a0b2-968409e22e92 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100307 Aug 07 02:14:02.800856 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3753/7039] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:14:02.865527 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f964b5a7-804b-42d5-b084-c3bf73e80ab1 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:14:02.866139 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f964b5a7-804b-42d5-b084-c3bf73e80ab1 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:02.873286 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f964b5a7-804b-42d5-b084-c3bf73e80ab1 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:02.873770 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f964b5a7-804b-42d5-b084-c3bf73e80ab1 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:02.874369 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f964b5a7-804b-42d5-b084-c3bf73e80ab1 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:02.875089 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f964b5a7-804b-42d5-b084-c3bf73e80ab1 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:02.875543 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f964b5a7-804b-42d5-b084-c3bf73e80ab1 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:02.875993 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f964b5a7-804b-42d5-b084-c3bf73e80ab1 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:03.060518 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f964b5a7-804b-42d5-b084-c3bf73e80ab1 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:14:03.068010 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f964b5a7-804b-42d5-b084-c3bf73e80ab1 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0" status: 200 len: 1363 microversion: 2.1 time: 0.206442 Aug 07 02:14:03.068576 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3287/7040] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:14:02 2022] GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0 => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:14:04.091332 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ddb4683e-7694-43ec-8b8e-f929d03129af tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:14:04.092088 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ddb4683e-7694-43ec-8b8e-f929d03129af tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:04.098359 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddb4683e-7694-43ec-8b8e-f929d03129af tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:04.098864 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddb4683e-7694-43ec-8b8e-f929d03129af tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:04.099321 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddb4683e-7694-43ec-8b8e-f929d03129af tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:04.100073 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddb4683e-7694-43ec-8b8e-f929d03129af tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:04.100554 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddb4683e-7694-43ec-8b8e-f929d03129af tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:04.101000 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ddb4683e-7694-43ec-8b8e-f929d03129af tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:04.241396 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ddb4683e-7694-43ec-8b8e-f929d03129af tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:14:04.249217 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ddb4683e-7694-43ec-8b8e-f929d03129af tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0" status: 200 len: 1555 microversion: 2.1 time: 0.163158 Aug 07 02:14:04.249850 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3754/7041] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:14:04 2022] GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0 => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:14:04.270100 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8873f264-7425-4151-99dd-4d1e68e96467 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:14:04.270720 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8873f264-7425-4151-99dd-4d1e68e96467 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:04.278094 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8873f264-7425-4151-99dd-4d1e68e96467 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:04.278581 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8873f264-7425-4151-99dd-4d1e68e96467 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:04.279013 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8873f264-7425-4151-99dd-4d1e68e96467 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:04.279705 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8873f264-7425-4151-99dd-4d1e68e96467 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:04.280192 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8873f264-7425-4151-99dd-4d1e68e96467 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:04.280618 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8873f264-7425-4151-99dd-4d1e68e96467 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:04.410648 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8873f264-7425-4151-99dd-4d1e68e96467 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:14:04.418778 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8873f264-7425-4151-99dd-4d1e68e96467 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0" status: 200 len: 1555 microversion: 2.1 time: 0.152520 Aug 07 02:14:04.419361 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3288/7042] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:14:04 2022] GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:14:05.905703 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-39f4bd26-3ce5-45bd-b9a1-f34b89ed0af7 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09145427-a862-4dec-94c1-ac19938086dc"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:14:05.908219 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-39f4bd26-3ce5-45bd-b9a1-f34b89ed0af7 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:05.910258 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:14:05.916257 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-39f4bd26-3ce5-45bd-b9a1-f34b89ed0af7 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:05.916748 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-39f4bd26-3ce5-45bd-b9a1-f34b89ed0af7 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:05.917195 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-39f4bd26-3ce5-45bd-b9a1-f34b89ed0af7 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:05.918475 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-39f4bd26-3ce5-45bd-b9a1-f34b89ed0af7 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:05.918940 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-39f4bd26-3ce5-45bd-b9a1-f34b89ed0af7 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:05.919377 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-39f4bd26-3ce5-45bd-b9a1-f34b89ed0af7 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:06.195209 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-39f4bd26-3ce5-45bd-b9a1-f34b89ed0af7 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "POST /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294102 Aug 07 02:14:06.195853 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3755/7043] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Aug 7 02:14:05 2022] POST /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:14:16.882436 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-05f3aa27-4a03-47af-83c9-baf69675d1dd tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:14:16.882957 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-05f3aa27-4a03-47af-83c9-baf69675d1dd tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:16.885197 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:14:16.886030 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:14:16.887260 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:14:16.887981 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:14:16.894880 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05f3aa27-4a03-47af-83c9-baf69675d1dd tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:16.895367 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05f3aa27-4a03-47af-83c9-baf69675d1dd tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:16.895806 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05f3aa27-4a03-47af-83c9-baf69675d1dd tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:16.896537 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05f3aa27-4a03-47af-83c9-baf69675d1dd tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:16.897025 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05f3aa27-4a03-47af-83c9-baf69675d1dd tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:16.897456 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05f3aa27-4a03-47af-83c9-baf69675d1dd tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:16.979995 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-05f3aa27-4a03-47af-83c9-baf69675d1dd tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lazy-loading 'services' on Instance uuid 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 02:14:17.049494 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-05f3aa27-4a03-47af-83c9-baf69675d1dd tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0/os-volume_attachments/09145427-a862-4dec-94c1-ac19938086dc" status: 202 len: 0 microversion: 2.1 time: 0.170838 Aug 07 02:14:17.050186 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3289/7044] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Aug 7 02:14:16 2022] DELETE /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0/os-volume_attachments/09145427-a862-4dec-94c1-ac19938086dc => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:14:17.057591 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:14:17.058935 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:14:17.063938 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9fcbd67c-3f05-4c6f-ab02-52c2eac39e8b tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:14:17.066574 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9fcbd67c-3f05-4c6f-ab02-52c2eac39e8b tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:17.077207 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9fcbd67c-3f05-4c6f-ab02-52c2eac39e8b tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:17.077829 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9fcbd67c-3f05-4c6f-ab02-52c2eac39e8b tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:17.078295 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9fcbd67c-3f05-4c6f-ab02-52c2eac39e8b tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:17.079052 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9fcbd67c-3f05-4c6f-ab02-52c2eac39e8b tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:17.079537 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9fcbd67c-3f05-4c6f-ab02-52c2eac39e8b tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:17.080021 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9fcbd67c-3f05-4c6f-ab02-52c2eac39e8b tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:17.112903 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9fcbd67c-3f05-4c6f-ab02-52c2eac39e8b tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057609 Aug 07 02:14:17.113475 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3756/7045] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 02:14:17 2022] GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:14:18.127064 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-09e71566-d3b2-4750-8bf7-1e56c9529903 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:14:18.129443 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-09e71566-d3b2-4750-8bf7-1e56c9529903 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:18.135732 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-09e71566-d3b2-4750-8bf7-1e56c9529903 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:18.136263 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-09e71566-d3b2-4750-8bf7-1e56c9529903 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:18.137621 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-09e71566-d3b2-4750-8bf7-1e56c9529903 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:18.138339 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-09e71566-d3b2-4750-8bf7-1e56c9529903 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:18.138799 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-09e71566-d3b2-4750-8bf7-1e56c9529903 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:18.139230 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-09e71566-d3b2-4750-8bf7-1e56c9529903 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:18.169324 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-09e71566-d3b2-4750-8bf7-1e56c9529903 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047543 Aug 07 02:14:18.169889 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3290/7046] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 02:14:18 2022] GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:14:19.182205 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b77c4b00-3138-46a1-93e2-963a5316af74 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:14:19.184538 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b77c4b00-3138-46a1-93e2-963a5316af74 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:19.192801 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b77c4b00-3138-46a1-93e2-963a5316af74 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:19.193411 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b77c4b00-3138-46a1-93e2-963a5316af74 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:19.193871 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b77c4b00-3138-46a1-93e2-963a5316af74 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:19.194611 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b77c4b00-3138-46a1-93e2-963a5316af74 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:19.195087 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b77c4b00-3138-46a1-93e2-963a5316af74 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:19.195534 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b77c4b00-3138-46a1-93e2-963a5316af74 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:19.227444 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b77c4b00-3138-46a1-93e2-963a5316af74 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049643 Aug 07 02:14:19.228061 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3757/7047] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 02:14:19 2022] GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:14:20.240802 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-395c891e-15f4-49d7-a729-d4d8337045a4 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:14:20.243151 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-395c891e-15f4-49d7-a729-d4d8337045a4 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:20.251149 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-395c891e-15f4-49d7-a729-d4d8337045a4 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:20.252000 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-395c891e-15f4-49d7-a729-d4d8337045a4 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:20.252443 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-395c891e-15f4-49d7-a729-d4d8337045a4 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:20.253166 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-395c891e-15f4-49d7-a729-d4d8337045a4 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:20.253626 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-395c891e-15f4-49d7-a729-d4d8337045a4 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:20.254089 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-395c891e-15f4-49d7-a729-d4d8337045a4 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:20.285416 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-395c891e-15f4-49d7-a729-d4d8337045a4 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048673 Aug 07 02:14:20.286004 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3291/7048] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 02:14:20 2022] GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:14:21.297162 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cb4d8b13-fda9-406b-a2da-8a30894cb21f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:14:21.299360 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cb4d8b13-fda9-406b-a2da-8a30894cb21f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:21.306748 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb4d8b13-fda9-406b-a2da-8a30894cb21f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:21.307247 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb4d8b13-fda9-406b-a2da-8a30894cb21f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:21.307717 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb4d8b13-fda9-406b-a2da-8a30894cb21f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:21.308450 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb4d8b13-fda9-406b-a2da-8a30894cb21f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:21.308948 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb4d8b13-fda9-406b-a2da-8a30894cb21f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:21.309393 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cb4d8b13-fda9-406b-a2da-8a30894cb21f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:21.339123 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cb4d8b13-fda9-406b-a2da-8a30894cb21f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045961 Aug 07 02:14:21.339696 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3758/7049] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 02:14:21 2022] GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:14:22.351960 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0c4bd615-1e6d-4111-a859-8ab2d3104d2f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:14:22.354142 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0c4bd615-1e6d-4111-a859-8ab2d3104d2f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:22.361593 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0c4bd615-1e6d-4111-a859-8ab2d3104d2f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:22.362082 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0c4bd615-1e6d-4111-a859-8ab2d3104d2f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:22.362521 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0c4bd615-1e6d-4111-a859-8ab2d3104d2f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:22.363223 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0c4bd615-1e6d-4111-a859-8ab2d3104d2f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:22.363685 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0c4bd615-1e6d-4111-a859-8ab2d3104d2f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:22.364143 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0c4bd615-1e6d-4111-a859-8ab2d3104d2f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:22.392319 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0c4bd615-1e6d-4111-a859-8ab2d3104d2f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044348 Aug 07 02:14:22.392878 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3292/7050] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 02:14:22 2022] GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 02:14:22.403774 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f052e941-71cd-40fa-a48a-a80cadcf880f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:14:22.404336 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f052e941-71cd-40fa-a48a-a80cadcf880f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:22.411259 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f052e941-71cd-40fa-a48a-a80cadcf880f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:22.411761 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f052e941-71cd-40fa-a48a-a80cadcf880f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:22.412266 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f052e941-71cd-40fa-a48a-a80cadcf880f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:22.412985 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f052e941-71cd-40fa-a48a-a80cadcf880f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:22.413461 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f052e941-71cd-40fa-a48a-a80cadcf880f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:22.413911 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f052e941-71cd-40fa-a48a-a80cadcf880f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:22.490118 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-f052e941-71cd-40fa-a48a-a80cadcf880f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] HTTP exception thrown: Instance 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0 is not attached to volume 09145427-a862-4dec-94c1-ac19938086dc Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f052e941-71cd-40fa-a48a-a80cadcf880f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Request method failure captured: Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0/os-volume_attachments/09145427-a862-4dec-94c1-ac19938086dc HTTP/1.1 Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7x-4wcL586vSYx7p3aMxxrw3i6C31X_225XV6wYqLylt4VJjI-RsSp-ALzxeOKT3DH7avQ_L4quA00BHcWIngWB7vl0eulHN9O8trUJy4WLlA9_jnOl3vxbUzlVoD4_N7jJ5gHedkc77Baq_cvyvqWQT78EeWzH03kKImMdZwhkp5Wo Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: c3c7f99169cd47ae9f3020313f4796df Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-TestEncryptedCinderVolumes-809558453 Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c3c7f99169cd47ae9f3020313f4796df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c3c7f99169cd47ae9f3020313f4796df", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c3c7f99169cd47ae9f3020313f4796df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c3c7f99169cd47ae9f3020313f4796df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-TestEncryptedCinderVolumes-809558453 Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: c3c7f99169cd47ae9f3020313f4796df Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-809558453 Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-TestEncryptedCinderVolumes-809558453-project Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 047c577e2fcd44f88da514da4a3492ec Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-TestEncryptedCinderVolumes-809558453-project Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0 is not attached to volume 09145427-a862-4dec-94c1-ac19938086dc Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: action_args: {'server_id': '8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0', 'id': '09145427-a862-4dec-94c1-ac19938086dc'} Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 09145427-a862-4dec-94c1-ac19938086dc. Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0 is not attached to volume 09145427-a862-4dec-94c1-ac19938086dc Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:14:22.491765 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:14:22.495818 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:14:22.495818 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:14:22.495818 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0 is not attached to volume 09145427-a862-4dec-94c1-ac19938086dc Aug 07 02:14:22.495818 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:14:22.495818 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f052e941-71cd-40fa-a48a-a80cadcf880f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Returning 404 to user: Instance 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0 is not attached to volume 09145427-a862-4dec-94c1-ac19938086dc {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:14:22.495818 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f052e941-71cd-40fa-a48a-a80cadcf880f tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0/os-volume_attachments/09145427-a862-4dec-94c1-ac19938086dc" status: 404 len: 154 microversion: 2.1 time: 0.094046 Aug 07 02:14:22.495818 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3759/7051] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Aug 7 02:14:22 2022] DELETE /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0/os-volume_attachments/09145427-a862-4dec-94c1-ac19938086dc => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:14:25.835568 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3bde87a6-ccfe-4972-a370-03f6e3fd7230 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:14:25.836344 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3bde87a6-ccfe-4972-a370-03f6e3fd7230 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:25.844149 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3bde87a6-ccfe-4972-a370-03f6e3fd7230 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:25.844646 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3bde87a6-ccfe-4972-a370-03f6e3fd7230 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:25.845090 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3bde87a6-ccfe-4972-a370-03f6e3fd7230 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:25.845809 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3bde87a6-ccfe-4972-a370-03f6e3fd7230 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:25.846271 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3bde87a6-ccfe-4972-a370-03f6e3fd7230 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:25.846699 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3bde87a6-ccfe-4972-a370-03f6e3fd7230 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:25.873729 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3bde87a6-ccfe-4972-a370-03f6e3fd7230 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 02:14:25.952670 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3bde87a6-ccfe-4972-a370-03f6e3fd7230 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0" status: 204 len: 0 microversion: 2.1 time: 0.120585 Aug 07 02:14:25.957584 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3293/7052] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 02:14:25 2022] DELETE /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 02:14:25.964297 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-88fcc106-52f6-44bc-b221-6cdc4dbe654d tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:14:25.965740 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-88fcc106-52f6-44bc-b221-6cdc4dbe654d tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:25.976506 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-88fcc106-52f6-44bc-b221-6cdc4dbe654d tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:25.976946 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-88fcc106-52f6-44bc-b221-6cdc4dbe654d tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:25.977407 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-88fcc106-52f6-44bc-b221-6cdc4dbe654d tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:25.978159 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-88fcc106-52f6-44bc-b221-6cdc4dbe654d tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:25.978635 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-88fcc106-52f6-44bc-b221-6cdc4dbe654d tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:25.979073 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-88fcc106-52f6-44bc-b221-6cdc4dbe654d tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:26.110861 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-88fcc106-52f6-44bc-b221-6cdc4dbe654d tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:14:26.118686 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-88fcc106-52f6-44bc-b221-6cdc4dbe654d tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0" status: 200 len: 1561 microversion: 2.1 time: 0.159884 Aug 07 02:14:26.119272 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3760/7053] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:14:25 2022] GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:14:27.140516 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f6318685-cee3-413d-8c7d-1f8c6b3ec1cb tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:14:27.141230 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f6318685-cee3-413d-8c7d-1f8c6b3ec1cb tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:27.148173 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f6318685-cee3-413d-8c7d-1f8c6b3ec1cb tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:27.148661 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f6318685-cee3-413d-8c7d-1f8c6b3ec1cb tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:27.149102 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f6318685-cee3-413d-8c7d-1f8c6b3ec1cb tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:27.149806 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f6318685-cee3-413d-8c7d-1f8c6b3ec1cb tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:27.150267 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f6318685-cee3-413d-8c7d-1f8c6b3ec1cb tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:27.150702 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f6318685-cee3-413d-8c7d-1f8c6b3ec1cb tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:27.285369 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f6318685-cee3-413d-8c7d-1f8c6b3ec1cb tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:14:27.293043 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f6318685-cee3-413d-8c7d-1f8c6b3ec1cb tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0" status: 200 len: 1561 microversion: 2.1 time: 0.156834 Aug 07 02:14:27.294167 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3294/7054] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:14:27 2022] GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:14:28.284856 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-16231f16-a248-4033-9b7b-24878f30a44c req-ab8c18cc-4f19-46fd-8938-fad4f144267c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0", "name": "network-vif-deleted", "tag": "6be4ac72-a913-4b25-916d-b0a7efdb148d"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:14:28.297460 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-16231f16-a248-4033-9b7b-24878f30a44c req-ab8c18cc-4f19-46fd-8938-fad4f144267c service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:28.297999 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-16231f16-a248-4033-9b7b-24878f30a44c req-ab8c18cc-4f19-46fd-8938-fad4f144267c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:28.298456 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-16231f16-a248-4033-9b7b-24878f30a44c req-ab8c18cc-4f19-46fd-8938-fad4f144267c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:28.314812 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-16231f16-a248-4033-9b7b-24878f30a44c req-ab8c18cc-4f19-46fd-8938-fad4f144267c service nova] Creating event network-vif-deleted:6be4ac72-a913-4b25-916d-b0a7efdb148d for instance 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0 on n-h1-master-1 Aug 07 02:14:28.315814 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6c0b5862-9d67-4577-ac3b-501dc774f0f6 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:14:28.316469 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6c0b5862-9d67-4577-ac3b-501dc774f0f6 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:28.320808 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-16231f16-a248-4033-9b7b-24878f30a44c req-ab8c18cc-4f19-46fd-8938-fad4f144267c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043855 Aug 07 02:14:28.322101 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3761/7055] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:14:28.323963 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c0b5862-9d67-4577-ac3b-501dc774f0f6 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:28.324349 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c0b5862-9d67-4577-ac3b-501dc774f0f6 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:28.324883 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c0b5862-9d67-4577-ac3b-501dc774f0f6 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:28.325743 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c0b5862-9d67-4577-ac3b-501dc774f0f6 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:28.326209 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c0b5862-9d67-4577-ac3b-501dc774f0f6 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:28.326680 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c0b5862-9d67-4577-ac3b-501dc774f0f6 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:28.404319 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6c0b5862-9d67-4577-ac3b-501dc774f0f6 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:14:28.412892 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6c0b5862-9d67-4577-ac3b-501dc774f0f6 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0" status: 200 len: 1348 microversion: 2.1 time: 0.101186 Aug 07 02:14:28.420642 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3295/7056] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:14:28 2022] GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0 => generated 1348 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:14:29.436591 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b38f4808-81c5-430b-9cdf-b518a72c331a tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:14:29.437303 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b38f4808-81c5-430b-9cdf-b518a72c331a tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:29.443430 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b38f4808-81c5-430b-9cdf-b518a72c331a tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:29.443949 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b38f4808-81c5-430b-9cdf-b518a72c331a tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:29.444395 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b38f4808-81c5-430b-9cdf-b518a72c331a tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:29.445100 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b38f4808-81c5-430b-9cdf-b518a72c331a tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:29.445568 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b38f4808-81c5-430b-9cdf-b518a72c331a tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:29.446007 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b38f4808-81c5-430b-9cdf-b518a72c331a tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:29.459133 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-b38f4808-81c5-430b-9cdf-b518a72c331a tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] HTTP exception thrown: Instance 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0 could not be found. Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b38f4808-81c5-430b-9cdf-b518a72c331a tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Request method failure captured: Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0 HTTP/1.1 Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7x-4wcL586vSYx7p3aMxxrw3i6C31X_225XV6wYqLylt4VJjI-RsSp-ALzxeOKT3DH7avQ_L4quA00BHcWIngWB7vl0eulHN9O8trUJy4WLlA9_jnOl3vxbUzlVoD4_N7jJ5gHedkc77Baq_cvyvqWQT78EeWzH03kKImMdZwhkp5Wo Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: c3c7f99169cd47ae9f3020313f4796df Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-TestEncryptedCinderVolumes-809558453 Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c3c7f99169cd47ae9f3020313f4796df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c3c7f99169cd47ae9f3020313f4796df", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c3c7f99169cd47ae9f3020313f4796df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c3c7f99169cd47ae9f3020313f4796df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-TestEncryptedCinderVolumes-809558453 Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: c3c7f99169cd47ae9f3020313f4796df Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-809558453 Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-TestEncryptedCinderVolumes-809558453-project Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 047c577e2fcd44f88da514da4a3492ec Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-TestEncryptedCinderVolumes-809558453-project Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0 could not be found. Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0'} Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0 could not be found. Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0 could not be found. Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:14:29.460805 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:14:29.465773 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:14:29.465773 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:14:29.465773 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:14:29.465773 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:14:29.465773 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:14:29.465773 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0 could not be found. Aug 07 02:14:29.465773 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:14:29.465773 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b38f4808-81c5-430b-9cdf-b518a72c331a tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Returning 404 to user: Instance 8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:14:29.465773 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b38f4808-81c5-430b-9cdf-b518a72c331a tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0" status: 404 len: 111 microversion: 2.1 time: 0.031693 Aug 07 02:14:29.465773 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3762/7057] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:14:29 2022] GET /compute/v2.1/servers/8ad7601d-0e08-4c8a-ac1f-2a44bd1d8cd0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:14:29.470932 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ec134bf8-3717-4073-b758-33abade0580c tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '.version_select at 0x7f9e2439e310>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:14:29.490799 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ec134bf8-3717-4073-b758-33abade0580c tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1835148802" status: 202 len: 0 microversion: 2.1 time: 0.023648 Aug 07 02:14:29.491355 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3296/7058] 10.222.0.39 () {58 vars in 1278 bytes} [Sun Aug 7 02:14:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1835148802 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:14:29.509555 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9c52a131-1749-410f-9ff9-0e5048e5a8b5 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Action: 'create', calling method: .version_select at 0x7f9e170d0280>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-73990365", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrsHyHvqmeVRzXOdGUHIR5nchsOSLVA8yqGhSpkopkQKdj8JWntglRJf1yie2u0accyjvsKTUZUoRuH00pikPKbLuMDbS9G86zv3YzLji7/Z6G16faYq6DQzDrCqEvkog=="}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:14:29.525083 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-9c52a131-1749-410f-9ff9-0e5048e5a8b5 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Getting quotas for project c3c7f99169cd47ae9f3020313f4796df. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:14:29.530187 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-9c52a131-1749-410f-9ff9-0e5048e5a8b5 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Getting quotas for user 047c577e2fcd44f88da514da4a3492ec and project c3c7f99169cd47ae9f3020313f4796df. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:14:29.553053 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9c52a131-1749-410f-9ff9-0e5048e5a8b5 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.047475 Aug 07 02:14:29.553639 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3763/7059] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 02:14:29 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:14:29.620149 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5df45384-10ff-4ddb-ab89-3e4f0f4dd4b2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-2105808584", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-73990365", "networks": [{"uuid": "3a07eeac-d26b-4804-8b4a-c19fd278dfbd"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:14:29.672304 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-5df45384-10ff-4ddb-ab89-3e4f0f4dd4b2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] validate_networks() for [('3a07eeac-d26b-4804-8b4a-c19fd278dfbd', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 02:14:30.040945 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-5df45384-10ff-4ddb-ab89-3e4f0f4dd4b2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 02:14:30.041371 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-5df45384-10ff-4ddb-ab89-3e4f0f4dd4b2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 02:14:30.041848 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-5df45384-10ff-4ddb-ab89-3e4f0f4dd4b2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 02:14:30.042262 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-5df45384-10ff-4ddb-ab89-3e4f0f4dd4b2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 02:14:30.042705 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-5df45384-10ff-4ddb-ab89-3e4f0f4dd4b2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 02:14:30.051479 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5df45384-10ff-4ddb-ab89-3e4f0f4dd4b2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:30.051999 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5df45384-10ff-4ddb-ab89-3e4f0f4dd4b2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:30.052440 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5df45384-10ff-4ddb-ab89-3e4f0f4dd4b2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:30.053173 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5df45384-10ff-4ddb-ab89-3e4f0f4dd4b2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:30.053631 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5df45384-10ff-4ddb-ab89-3e4f0f4dd4b2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:30.054064 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5df45384-10ff-4ddb-ab89-3e4f0f4dd4b2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:30.070912 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-5df45384-10ff-4ddb-ab89-3e4f0f4dd4b2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Getting quotas for project c3c7f99169cd47ae9f3020313f4796df. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:14:30.076575 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-5df45384-10ff-4ddb-ab89-3e4f0f4dd4b2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Getting quotas for user 047c577e2fcd44f88da514da4a3492ec and project c3c7f99169cd47ae9f3020313f4796df. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:14:30.088523 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5df45384-10ff-4ddb-ab89-3e4f0f4dd4b2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 02:14:30.091386 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5df45384-10ff-4ddb-ab89-3e4f0f4dd4b2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 0a41ce07-b0db-45ca-89a2-13bb028a7cdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 02:14:30.135994 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5df45384-10ff-4ddb-ab89-3e4f0f4dd4b2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519821 Aug 07 02:14:30.136645 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3297/7060] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 02:14:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 02:14:30.148121 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f1a5c80b-3fcd-46aa-a29e-c7eea63a336d tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:14:30.148773 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f1a5c80b-3fcd-46aa-a29e-c7eea63a336d tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 0a41ce07-b0db-45ca-89a2-13bb028a7cdf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:30.204074 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f1a5c80b-3fcd-46aa-a29e-c7eea63a336d tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:14:30.212799 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f1a5c80b-3fcd-46aa-a29e-c7eea63a336d tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf" status: 200 len: 1261 microversion: 2.1 time: 0.068559 Aug 07 02:14:30.213776 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3764/7061] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:14:30 2022] GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf => generated 1261 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:14:31.236442 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a6580ed5-813a-4e8d-9a84-b45e9e9fd7f7 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:14:31.237008 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a6580ed5-813a-4e8d-9a84-b45e9e9fd7f7 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 0a41ce07-b0db-45ca-89a2-13bb028a7cdf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:31.243791 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a6580ed5-813a-4e8d-9a84-b45e9e9fd7f7 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:31.244305 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a6580ed5-813a-4e8d-9a84-b45e9e9fd7f7 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:31.244778 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a6580ed5-813a-4e8d-9a84-b45e9e9fd7f7 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:31.245469 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a6580ed5-813a-4e8d-9a84-b45e9e9fd7f7 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:31.245922 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a6580ed5-813a-4e8d-9a84-b45e9e9fd7f7 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:31.246379 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a6580ed5-813a-4e8d-9a84-b45e9e9fd7f7 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:31.354065 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a6580ed5-813a-4e8d-9a84-b45e9e9fd7f7 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:14:31.365356 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a6580ed5-813a-4e8d-9a84-b45e9e9fd7f7 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf" status: 200 len: 1321 microversion: 2.1 time: 0.134320 Aug 07 02:14:31.384587 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3298/7062] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:14:31 2022] GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:14:32.386955 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-31ee93ed-b1ac-4b88-8732-958b1bdce2ea tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:14:32.387657 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-31ee93ed-b1ac-4b88-8732-958b1bdce2ea tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 0a41ce07-b0db-45ca-89a2-13bb028a7cdf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:32.394542 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31ee93ed-b1ac-4b88-8732-958b1bdce2ea tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:32.395079 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31ee93ed-b1ac-4b88-8732-958b1bdce2ea tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:32.395741 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31ee93ed-b1ac-4b88-8732-958b1bdce2ea tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:32.396502 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31ee93ed-b1ac-4b88-8732-958b1bdce2ea tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:32.396984 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31ee93ed-b1ac-4b88-8732-958b1bdce2ea tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:32.397434 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31ee93ed-b1ac-4b88-8732-958b1bdce2ea tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:32.535328 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-31ee93ed-b1ac-4b88-8732-958b1bdce2ea tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:14:32.543114 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-31ee93ed-b1ac-4b88-8732-958b1bdce2ea tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf" status: 200 len: 1361 microversion: 2.1 time: 0.160065 Aug 07 02:14:32.557440 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3765/7063] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:14:32 2022] GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:14:32.623610 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-79b3ec1c-d8e0-4d27-a26c-4f1665d72773 req-c2fa9e7f-014f-47ef-8964-1971490f77e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a41ce07-b0db-45ca-89a2-13bb028a7cdf", "tag": "16c3c84f-898a-477e-a572-b1b9be9cc74c"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:14:32.635752 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-79b3ec1c-d8e0-4d27-a26c-4f1665d72773 req-c2fa9e7f-014f-47ef-8964-1971490f77e9 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:32.636312 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-79b3ec1c-d8e0-4d27-a26c-4f1665d72773 req-c2fa9e7f-014f-47ef-8964-1971490f77e9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:32.636811 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-79b3ec1c-d8e0-4d27-a26c-4f1665d72773 req-c2fa9e7f-014f-47ef-8964-1971490f77e9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:32.648055 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-79b3ec1c-d8e0-4d27-a26c-4f1665d72773 req-c2fa9e7f-014f-47ef-8964-1971490f77e9 service nova] Creating event network-changed:16c3c84f-898a-477e-a572-b1b9be9cc74c for instance 0a41ce07-b0db-45ca-89a2-13bb028a7cdf on n-h1-master-1 Aug 07 02:14:32.654823 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-79b3ec1c-d8e0-4d27-a26c-4f1665d72773 req-c2fa9e7f-014f-47ef-8964-1971490f77e9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036200 Aug 07 02:14:32.655612 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3299/7064] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 02:14:33.565644 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3074fce3-8397-42b0-8e07-f9a3310882d4 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:14:33.566270 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3074fce3-8397-42b0-8e07-f9a3310882d4 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 0a41ce07-b0db-45ca-89a2-13bb028a7cdf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:33.573127 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3074fce3-8397-42b0-8e07-f9a3310882d4 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:33.573621 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3074fce3-8397-42b0-8e07-f9a3310882d4 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:33.574070 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3074fce3-8397-42b0-8e07-f9a3310882d4 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:33.574775 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3074fce3-8397-42b0-8e07-f9a3310882d4 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:33.575852 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3074fce3-8397-42b0-8e07-f9a3310882d4 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:33.576310 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3074fce3-8397-42b0-8e07-f9a3310882d4 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:33.704672 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3074fce3-8397-42b0-8e07-f9a3310882d4 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:14:33.712078 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3074fce3-8397-42b0-8e07-f9a3310882d4 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf" status: 200 len: 1361 microversion: 2.1 time: 0.150325 Aug 07 02:14:33.712636 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3766/7065] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:14:33 2022] GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:14:34.733770 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f57fb12f-187e-424b-969c-e76f12e525f9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:14:34.734490 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f57fb12f-187e-424b-969c-e76f12e525f9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 0a41ce07-b0db-45ca-89a2-13bb028a7cdf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:34.741488 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f57fb12f-187e-424b-969c-e76f12e525f9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:34.741974 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f57fb12f-187e-424b-969c-e76f12e525f9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:34.742416 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f57fb12f-187e-424b-969c-e76f12e525f9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:34.743112 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f57fb12f-187e-424b-969c-e76f12e525f9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:34.743573 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f57fb12f-187e-424b-969c-e76f12e525f9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:34.744033 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f57fb12f-187e-424b-969c-e76f12e525f9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:34.876647 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f57fb12f-187e-424b-969c-e76f12e525f9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:14:34.884160 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f57fb12f-187e-424b-969c-e76f12e525f9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf" status: 200 len: 1361 microversion: 2.1 time: 0.154749 Aug 07 02:14:34.884736 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3300/7066] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:14:34 2022] GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:14:35.905628 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3bdefd7c-0e23-494c-9e4e-8f148f92732b tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:14:35.906263 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3bdefd7c-0e23-494c-9e4e-8f148f92732b tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 0a41ce07-b0db-45ca-89a2-13bb028a7cdf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:35.913074 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3bdefd7c-0e23-494c-9e4e-8f148f92732b tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:35.913567 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3bdefd7c-0e23-494c-9e4e-8f148f92732b tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:35.914015 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3bdefd7c-0e23-494c-9e4e-8f148f92732b tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:35.914726 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3bdefd7c-0e23-494c-9e4e-8f148f92732b tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:35.915192 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3bdefd7c-0e23-494c-9e4e-8f148f92732b tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:35.915632 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3bdefd7c-0e23-494c-9e4e-8f148f92732b tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:36.053816 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3bdefd7c-0e23-494c-9e4e-8f148f92732b tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:14:36.064738 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3bdefd7c-0e23-494c-9e4e-8f148f92732b tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf" status: 200 len: 1361 microversion: 2.1 time: 0.163001 Aug 07 02:14:36.065333 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3767/7067] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:14:35 2022] GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:14:37.084877 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-34b3bf7e-c470-4979-b0a1-cf0528d46ac9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:14:37.085493 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-34b3bf7e-c470-4979-b0a1-cf0528d46ac9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 0a41ce07-b0db-45ca-89a2-13bb028a7cdf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:37.093031 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-34b3bf7e-c470-4979-b0a1-cf0528d46ac9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:37.093513 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-34b3bf7e-c470-4979-b0a1-cf0528d46ac9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:37.093975 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-34b3bf7e-c470-4979-b0a1-cf0528d46ac9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:37.094663 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-34b3bf7e-c470-4979-b0a1-cf0528d46ac9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:37.095113 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-34b3bf7e-c470-4979-b0a1-cf0528d46ac9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:37.095536 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-34b3bf7e-c470-4979-b0a1-cf0528d46ac9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:37.226213 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-34b3bf7e-c470-4979-b0a1-cf0528d46ac9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:14:37.234110 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-34b3bf7e-c470-4979-b0a1-cf0528d46ac9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf" status: 200 len: 1361 microversion: 2.1 time: 0.153112 Aug 07 02:14:37.234708 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3301/7068] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:14:37 2022] GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:14:38.254960 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-98cca61d-6b81-4fb5-88b6-fb91ddabc8c9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:14:38.255499 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-98cca61d-6b81-4fb5-88b6-fb91ddabc8c9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 0a41ce07-b0db-45ca-89a2-13bb028a7cdf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:38.262393 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-98cca61d-6b81-4fb5-88b6-fb91ddabc8c9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:38.263378 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-98cca61d-6b81-4fb5-88b6-fb91ddabc8c9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:38.263833 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-98cca61d-6b81-4fb5-88b6-fb91ddabc8c9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:38.264567 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-98cca61d-6b81-4fb5-88b6-fb91ddabc8c9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:38.265039 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-98cca61d-6b81-4fb5-88b6-fb91ddabc8c9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:38.265484 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-98cca61d-6b81-4fb5-88b6-fb91ddabc8c9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:38.398079 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-98cca61d-6b81-4fb5-88b6-fb91ddabc8c9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:14:38.406610 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-98cca61d-6b81-4fb5-88b6-fb91ddabc8c9 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf" status: 200 len: 1361 microversion: 2.1 time: 0.155621 Aug 07 02:14:38.407221 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3768/7069] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:14:38 2022] GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:14:38.905890 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-6ff4232f-32eb-4952-b1dd-345f2ba43413 req-d708c090-a358-4201-a753-278dd7031300 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a41ce07-b0db-45ca-89a2-13bb028a7cdf", "name": "network-vif-plugged", "status": "completed", "tag": "16c3c84f-898a-477e-a572-b1b9be9cc74c"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:14:38.916527 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6ff4232f-32eb-4952-b1dd-345f2ba43413 req-d708c090-a358-4201-a753-278dd7031300 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:38.917016 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6ff4232f-32eb-4952-b1dd-345f2ba43413 req-d708c090-a358-4201-a753-278dd7031300 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:38.917456 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6ff4232f-32eb-4952-b1dd-345f2ba43413 req-d708c090-a358-4201-a753-278dd7031300 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:38.931248 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-6ff4232f-32eb-4952-b1dd-345f2ba43413 req-d708c090-a358-4201-a753-278dd7031300 service nova] Creating event network-vif-plugged:16c3c84f-898a-477e-a572-b1b9be9cc74c for instance 0a41ce07-b0db-45ca-89a2-13bb028a7cdf on n-h1-master-1 Aug 07 02:14:38.937197 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-6ff4232f-32eb-4952-b1dd-345f2ba43413 req-d708c090-a358-4201-a753-278dd7031300 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035029 Aug 07 02:14:38.937938 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3302/7070] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:14:39.427425 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1e1159f7-834e-4164-9cdc-99056e0fd87c tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:14:39.428087 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1e1159f7-834e-4164-9cdc-99056e0fd87c tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 0a41ce07-b0db-45ca-89a2-13bb028a7cdf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:39.435418 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1e1159f7-834e-4164-9cdc-99056e0fd87c tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:39.436067 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1e1159f7-834e-4164-9cdc-99056e0fd87c tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:39.436570 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1e1159f7-834e-4164-9cdc-99056e0fd87c tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:39.437284 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1e1159f7-834e-4164-9cdc-99056e0fd87c tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:39.437752 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1e1159f7-834e-4164-9cdc-99056e0fd87c tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:39.438187 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1e1159f7-834e-4164-9cdc-99056e0fd87c tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:39.565894 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1e1159f7-834e-4164-9cdc-99056e0fd87c tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:14:39.573455 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1e1159f7-834e-4164-9cdc-99056e0fd87c tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf" status: 200 len: 1361 microversion: 2.1 time: 0.149956 Aug 07 02:14:39.574032 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3769/7071] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:14:39 2022] GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:14:40.592646 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:14:40.593450 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:14:40.597704 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-106cc8d5-9315-4d98-819c-27bb429214c1 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:14:40.598408 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-106cc8d5-9315-4d98-819c-27bb429214c1 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 0a41ce07-b0db-45ca-89a2-13bb028a7cdf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:40.605783 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-106cc8d5-9315-4d98-819c-27bb429214c1 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:40.606276 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-106cc8d5-9315-4d98-819c-27bb429214c1 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:40.607230 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-106cc8d5-9315-4d98-819c-27bb429214c1 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:40.607966 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-106cc8d5-9315-4d98-819c-27bb429214c1 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:40.608417 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-106cc8d5-9315-4d98-819c-27bb429214c1 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:40.608854 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-106cc8d5-9315-4d98-819c-27bb429214c1 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:40.741977 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-106cc8d5-9315-4d98-819c-27bb429214c1 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:14:40.750054 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-106cc8d5-9315-4d98-819c-27bb429214c1 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf" status: 200 len: 1554 microversion: 2.1 time: 0.159198 Aug 07 02:14:40.750616 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3303/7072] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:14:40 2022] GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:14:40.769990 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f7625678-4019-4f9d-b6df-9e41af499173 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:14:40.770615 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f7625678-4019-4f9d-b6df-9e41af499173 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 0a41ce07-b0db-45ca-89a2-13bb028a7cdf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:40.772618 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:14:40.778755 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f7625678-4019-4f9d-b6df-9e41af499173 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:40.779251 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f7625678-4019-4f9d-b6df-9e41af499173 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:40.779696 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f7625678-4019-4f9d-b6df-9e41af499173 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:40.780422 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f7625678-4019-4f9d-b6df-9e41af499173 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:40.780888 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f7625678-4019-4f9d-b6df-9e41af499173 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:40.781385 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f7625678-4019-4f9d-b6df-9e41af499173 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:40.912823 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f7625678-4019-4f9d-b6df-9e41af499173 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:14:40.921002 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f7625678-4019-4f9d-b6df-9e41af499173 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf" status: 200 len: 1554 microversion: 2.1 time: 0.154871 Aug 07 02:14:40.921571 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3770/7073] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:14:40 2022] GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:14:42.395369 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f5a21201-981f-4f12-974d-4dfddb4343ce tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d2428f31-09f7-4723-83e9-84a1d898d669"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:14:42.397876 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f5a21201-981f-4f12-974d-4dfddb4343ce tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 0a41ce07-b0db-45ca-89a2-13bb028a7cdf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:42.404470 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f5a21201-981f-4f12-974d-4dfddb4343ce tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:42.404957 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f5a21201-981f-4f12-974d-4dfddb4343ce tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:42.405397 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f5a21201-981f-4f12-974d-4dfddb4343ce tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:42.406100 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f5a21201-981f-4f12-974d-4dfddb4343ce tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:42.406560 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f5a21201-981f-4f12-974d-4dfddb4343ce tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:42.406993 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f5a21201-981f-4f12-974d-4dfddb4343ce tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:42.652537 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:14:42.663279 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f5a21201-981f-4f12-974d-4dfddb4343ce tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "POST /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271877 Aug 07 02:14:42.663931 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3304/7074] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Aug 7 02:14:42 2022] POST /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:14:53.344377 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-44568237-c785-4f8a-b1cb-fa87fc5d3552 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:14:53.344892 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-44568237-c785-4f8a-b1cb-fa87fc5d3552 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 0a41ce07-b0db-45ca-89a2-13bb028a7cdf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:53.346946 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:14:53.347688 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=70 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:14:53.353841 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-44568237-c785-4f8a-b1cb-fa87fc5d3552 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:53.354358 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-44568237-c785-4f8a-b1cb-fa87fc5d3552 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:53.354815 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-44568237-c785-4f8a-b1cb-fa87fc5d3552 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:53.355525 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-44568237-c785-4f8a-b1cb-fa87fc5d3552 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:53.356028 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-44568237-c785-4f8a-b1cb-fa87fc5d3552 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:53.356476 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-44568237-c785-4f8a-b1cb-fa87fc5d3552 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:53.437950 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-44568237-c785-4f8a-b1cb-fa87fc5d3552 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lazy-loading 'services' on Instance uuid 0a41ce07-b0db-45ca-89a2-13bb028a7cdf {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 02:14:53.509272 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-44568237-c785-4f8a-b1cb-fa87fc5d3552 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf/os-volume_attachments/d2428f31-09f7-4723-83e9-84a1d898d669" status: 202 len: 0 microversion: 2.1 time: 0.168898 Aug 07 02:14:53.509909 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3771/7075] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Aug 7 02:14:53 2022] DELETE /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf/os-volume_attachments/d2428f31-09f7-4723-83e9-84a1d898d669 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:14:53.517119 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:14:53.521949 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-753e2315-2f4a-4ba1-a94e-62fe8e56e3ef tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:14:53.524352 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-753e2315-2f4a-4ba1-a94e-62fe8e56e3ef tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 0a41ce07-b0db-45ca-89a2-13bb028a7cdf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:53.533711 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-753e2315-2f4a-4ba1-a94e-62fe8e56e3ef tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:53.534202 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-753e2315-2f4a-4ba1-a94e-62fe8e56e3ef tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:53.534639 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-753e2315-2f4a-4ba1-a94e-62fe8e56e3ef tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:53.535351 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-753e2315-2f4a-4ba1-a94e-62fe8e56e3ef tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:53.535812 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-753e2315-2f4a-4ba1-a94e-62fe8e56e3ef tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:53.536285 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-753e2315-2f4a-4ba1-a94e-62fe8e56e3ef tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:53.569064 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-753e2315-2f4a-4ba1-a94e-62fe8e56e3ef tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054069 Aug 07 02:14:53.569895 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3305/7076] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 02:14:53 2022] GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:14:54.583507 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-741c2e68-0973-4259-8663-b53c52f19fbd tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:14:54.585933 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-741c2e68-0973-4259-8663-b53c52f19fbd tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 0a41ce07-b0db-45ca-89a2-13bb028a7cdf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:54.592274 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-741c2e68-0973-4259-8663-b53c52f19fbd tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:54.592771 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-741c2e68-0973-4259-8663-b53c52f19fbd tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:54.593216 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-741c2e68-0973-4259-8663-b53c52f19fbd tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:54.593915 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-741c2e68-0973-4259-8663-b53c52f19fbd tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:54.594378 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-741c2e68-0973-4259-8663-b53c52f19fbd tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:54.594817 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-741c2e68-0973-4259-8663-b53c52f19fbd tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:54.624451 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-741c2e68-0973-4259-8663-b53c52f19fbd tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046037 Aug 07 02:14:54.625016 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3772/7077] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 02:14:54 2022] GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:14:55.636595 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b7a830db-9bc9-4a92-9b87-3b15151061bc tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:14:55.639274 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b7a830db-9bc9-4a92-9b87-3b15151061bc tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 0a41ce07-b0db-45ca-89a2-13bb028a7cdf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:55.646310 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b7a830db-9bc9-4a92-9b87-3b15151061bc tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:55.646713 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b7a830db-9bc9-4a92-9b87-3b15151061bc tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:55.647146 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b7a830db-9bc9-4a92-9b87-3b15151061bc tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:55.647844 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b7a830db-9bc9-4a92-9b87-3b15151061bc tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:55.648325 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b7a830db-9bc9-4a92-9b87-3b15151061bc tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:55.648747 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b7a830db-9bc9-4a92-9b87-3b15151061bc tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:55.678492 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b7a830db-9bc9-4a92-9b87-3b15151061bc tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045887 Aug 07 02:14:55.679047 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3306/7078] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 02:14:55 2022] GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:14:56.691481 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e717ca05-4f38-49c7-8774-4dd80917a913 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:14:56.693591 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e717ca05-4f38-49c7-8774-4dd80917a913 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 0a41ce07-b0db-45ca-89a2-13bb028a7cdf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:56.700722 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e717ca05-4f38-49c7-8774-4dd80917a913 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:56.701861 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e717ca05-4f38-49c7-8774-4dd80917a913 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:56.702964 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e717ca05-4f38-49c7-8774-4dd80917a913 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:56.703091 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e717ca05-4f38-49c7-8774-4dd80917a913 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:56.703837 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e717ca05-4f38-49c7-8774-4dd80917a913 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:56.704005 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e717ca05-4f38-49c7-8774-4dd80917a913 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:56.733951 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e717ca05-4f38-49c7-8774-4dd80917a913 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047017 Aug 07 02:14:56.734517 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3773/7079] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 02:14:56 2022] GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:14:57.746151 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-18e62142-0642-4d34-915f-9e4d9c66af95 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:14:57.748468 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-18e62142-0642-4d34-915f-9e4d9c66af95 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 0a41ce07-b0db-45ca-89a2-13bb028a7cdf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:57.755548 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-18e62142-0642-4d34-915f-9e4d9c66af95 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:57.756075 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-18e62142-0642-4d34-915f-9e4d9c66af95 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:57.756523 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-18e62142-0642-4d34-915f-9e4d9c66af95 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:57.757238 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-18e62142-0642-4d34-915f-9e4d9c66af95 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:57.757704 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-18e62142-0642-4d34-915f-9e4d9c66af95 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:57.758140 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-18e62142-0642-4d34-915f-9e4d9c66af95 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:57.788610 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-18e62142-0642-4d34-915f-9e4d9c66af95 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046509 Aug 07 02:14:57.789175 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3307/7080] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 02:14:57 2022] GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:14:58.800923 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c2185480-6d5a-44b0-a66f-72a6902d9b6e tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:14:58.803176 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c2185480-6d5a-44b0-a66f-72a6902d9b6e tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 0a41ce07-b0db-45ca-89a2-13bb028a7cdf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:58.810309 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c2185480-6d5a-44b0-a66f-72a6902d9b6e tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:58.810864 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c2185480-6d5a-44b0-a66f-72a6902d9b6e tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:58.811317 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c2185480-6d5a-44b0-a66f-72a6902d9b6e tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:58.812061 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c2185480-6d5a-44b0-a66f-72a6902d9b6e tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:58.812531 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c2185480-6d5a-44b0-a66f-72a6902d9b6e tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:58.812976 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c2185480-6d5a-44b0-a66f-72a6902d9b6e tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:58.844411 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c2185480-6d5a-44b0-a66f-72a6902d9b6e tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047533 Aug 07 02:14:58.844959 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3774/7081] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 02:14:58 2022] GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 02:14:58.855213 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b3e92e05-82e0-4a30-bc68-95f01ef810b8 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:14:58.855701 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b3e92e05-82e0-4a30-bc68-95f01ef810b8 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 0a41ce07-b0db-45ca-89a2-13bb028a7cdf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:14:58.863068 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b3e92e05-82e0-4a30-bc68-95f01ef810b8 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:58.863745 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b3e92e05-82e0-4a30-bc68-95f01ef810b8 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:58.864017 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b3e92e05-82e0-4a30-bc68-95f01ef810b8 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:58.864795 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b3e92e05-82e0-4a30-bc68-95f01ef810b8 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:14:58.865452 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b3e92e05-82e0-4a30-bc68-95f01ef810b8 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:14:58.866016 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b3e92e05-82e0-4a30-bc68-95f01ef810b8 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:14:58.945467 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-b3e92e05-82e0-4a30-bc68-95f01ef810b8 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] HTTP exception thrown: Instance 0a41ce07-b0db-45ca-89a2-13bb028a7cdf is not attached to volume d2428f31-09f7-4723-83e9-84a1d898d669 Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b3e92e05-82e0-4a30-bc68-95f01ef810b8 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Request method failure captured: Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf/os-volume_attachments/d2428f31-09f7-4723-83e9-84a1d898d669 HTTP/1.1 Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7x-4wcL586vSYx7p3aMxxrw3i6C31X_225XV6wYqLylt4VJjI-RsSp-ALzxeOKT3DH7avQ_L4quA00BHcWIngWB7vl0eulHN9O8trUJy4WLlA9_jnOl3vxbUzlVoD4_N7jJ5gHedkc77Baq_cvyvqWQT78EeWzH03kKImMdZwhkp5Wo Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: c3c7f99169cd47ae9f3020313f4796df Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-TestEncryptedCinderVolumes-809558453 Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c3c7f99169cd47ae9f3020313f4796df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c3c7f99169cd47ae9f3020313f4796df", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c3c7f99169cd47ae9f3020313f4796df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c3c7f99169cd47ae9f3020313f4796df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-TestEncryptedCinderVolumes-809558453 Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: c3c7f99169cd47ae9f3020313f4796df Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-809558453 Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-TestEncryptedCinderVolumes-809558453-project Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 047c577e2fcd44f88da514da4a3492ec Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-TestEncryptedCinderVolumes-809558453-project Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 0a41ce07-b0db-45ca-89a2-13bb028a7cdf is not attached to volume d2428f31-09f7-4723-83e9-84a1d898d669 Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: action_args: {'server_id': '0a41ce07-b0db-45ca-89a2-13bb028a7cdf', 'id': 'd2428f31-09f7-4723-83e9-84a1d898d669'} Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d2428f31-09f7-4723-83e9-84a1d898d669. Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a41ce07-b0db-45ca-89a2-13bb028a7cdf is not attached to volume d2428f31-09f7-4723-83e9-84a1d898d669 Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:14:58.947461 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:14:58.952603 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:14:58.952603 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:14:58.952603 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a41ce07-b0db-45ca-89a2-13bb028a7cdf is not attached to volume d2428f31-09f7-4723-83e9-84a1d898d669 Aug 07 02:14:58.952603 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:14:58.952603 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b3e92e05-82e0-4a30-bc68-95f01ef810b8 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Returning 404 to user: Instance 0a41ce07-b0db-45ca-89a2-13bb028a7cdf is not attached to volume d2428f31-09f7-4723-83e9-84a1d898d669 {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:14:58.952603 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b3e92e05-82e0-4a30-bc68-95f01ef810b8 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf/os-volume_attachments/d2428f31-09f7-4723-83e9-84a1d898d669" status: 404 len: 154 microversion: 2.1 time: 0.097648 Aug 07 02:14:58.952603 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3308/7082] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Aug 7 02:14:58 2022] DELETE /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf/os-volume_attachments/d2428f31-09f7-4723-83e9-84a1d898d669 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:15:02.286570 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-09b4d538-de14-4fca-994e-f521a0bb6830 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:15:02.287132 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-09b4d538-de14-4fca-994e-f521a0bb6830 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 0a41ce07-b0db-45ca-89a2-13bb028a7cdf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:15:02.294174 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-09b4d538-de14-4fca-994e-f521a0bb6830 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:02.294764 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-09b4d538-de14-4fca-994e-f521a0bb6830 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:02.295123 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-09b4d538-de14-4fca-994e-f521a0bb6830 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:02.295848 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-09b4d538-de14-4fca-994e-f521a0bb6830 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:02.296351 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-09b4d538-de14-4fca-994e-f521a0bb6830 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:02.296832 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-09b4d538-de14-4fca-994e-f521a0bb6830 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:02.322840 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-09b4d538-de14-4fca-994e-f521a0bb6830 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 0a41ce07-b0db-45ca-89a2-13bb028a7cdf] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 02:15:02.400156 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-09b4d538-de14-4fca-994e-f521a0bb6830 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf" status: 204 len: 0 microversion: 2.1 time: 0.117212 Aug 07 02:15:02.401007 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3775/7083] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 02:15:02 2022] DELETE /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 02:15:02.409557 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d5a9526c-9c88-448d-8d8a-cae1d4399c10 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:15:02.410204 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d5a9526c-9c88-448d-8d8a-cae1d4399c10 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 0a41ce07-b0db-45ca-89a2-13bb028a7cdf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:15:02.417280 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d5a9526c-9c88-448d-8d8a-cae1d4399c10 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:02.417703 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d5a9526c-9c88-448d-8d8a-cae1d4399c10 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:02.418146 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d5a9526c-9c88-448d-8d8a-cae1d4399c10 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:02.418851 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d5a9526c-9c88-448d-8d8a-cae1d4399c10 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:02.419304 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d5a9526c-9c88-448d-8d8a-cae1d4399c10 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:02.419730 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d5a9526c-9c88-448d-8d8a-cae1d4399c10 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:02.555352 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d5a9526c-9c88-448d-8d8a-cae1d4399c10 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:15:02.563222 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d5a9526c-9c88-448d-8d8a-cae1d4399c10 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf" status: 200 len: 1560 microversion: 2.1 time: 0.158201 Aug 07 02:15:02.563776 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3309/7084] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:15:02 2022] GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:15:03.584843 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f4a228ed-1882-47f5-80d6-3c3bcf082990 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:15:03.585567 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f4a228ed-1882-47f5-80d6-3c3bcf082990 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 0a41ce07-b0db-45ca-89a2-13bb028a7cdf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:15:03.592562 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f4a228ed-1882-47f5-80d6-3c3bcf082990 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:03.593067 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f4a228ed-1882-47f5-80d6-3c3bcf082990 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:03.594055 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f4a228ed-1882-47f5-80d6-3c3bcf082990 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:03.595032 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f4a228ed-1882-47f5-80d6-3c3bcf082990 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:03.595685 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f4a228ed-1882-47f5-80d6-3c3bcf082990 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:03.596163 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f4a228ed-1882-47f5-80d6-3c3bcf082990 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:03.726831 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f4a228ed-1882-47f5-80d6-3c3bcf082990 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:15:03.734509 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f4a228ed-1882-47f5-80d6-3c3bcf082990 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf" status: 200 len: 1560 microversion: 2.1 time: 0.153967 Aug 07 02:15:03.735067 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3776/7085] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:15:03 2022] GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:15:04.574642 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-4d6c6db5-9855-40ec-9d70-90b1f5977395 req-bcdcd7d3-b235-40b5-96e2-dea6f753d113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a41ce07-b0db-45ca-89a2-13bb028a7cdf", "name": "network-vif-deleted", "tag": "16c3c84f-898a-477e-a572-b1b9be9cc74c"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:15:04.585901 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-4d6c6db5-9855-40ec-9d70-90b1f5977395 req-bcdcd7d3-b235-40b5-96e2-dea6f753d113 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:04.586376 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-4d6c6db5-9855-40ec-9d70-90b1f5977395 req-bcdcd7d3-b235-40b5-96e2-dea6f753d113 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:04.586807 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-4d6c6db5-9855-40ec-9d70-90b1f5977395 req-bcdcd7d3-b235-40b5-96e2-dea6f753d113 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:04.599512 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-4d6c6db5-9855-40ec-9d70-90b1f5977395 req-bcdcd7d3-b235-40b5-96e2-dea6f753d113 service nova] Creating event network-vif-deleted:16c3c84f-898a-477e-a572-b1b9be9cc74c for instance 0a41ce07-b0db-45ca-89a2-13bb028a7cdf on n-h1-master-1 Aug 07 02:15:04.604938 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-4d6c6db5-9855-40ec-9d70-90b1f5977395 req-bcdcd7d3-b235-40b5-96e2-dea6f753d113 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033954 Aug 07 02:15:04.605533 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3310/7086] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:15:04.755365 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-51afd419-b5c1-49bf-ba3e-8ce57f53e9d4 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:15:04.755985 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-51afd419-b5c1-49bf-ba3e-8ce57f53e9d4 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 0a41ce07-b0db-45ca-89a2-13bb028a7cdf] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:15:04.763029 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51afd419-b5c1-49bf-ba3e-8ce57f53e9d4 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:04.763527 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51afd419-b5c1-49bf-ba3e-8ce57f53e9d4 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:04.764008 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51afd419-b5c1-49bf-ba3e-8ce57f53e9d4 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:04.764730 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51afd419-b5c1-49bf-ba3e-8ce57f53e9d4 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:04.765200 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51afd419-b5c1-49bf-ba3e-8ce57f53e9d4 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:04.766152 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51afd419-b5c1-49bf-ba3e-8ce57f53e9d4 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:04.797933 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51afd419-b5c1-49bf-ba3e-8ce57f53e9d4 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:04.798358 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51afd419-b5c1-49bf-ba3e-8ce57f53e9d4 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:04.798819 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51afd419-b5c1-49bf-ba3e-8ce57f53e9d4 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:04.799288 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-51afd419-b5c1-49bf-ba3e-8ce57f53e9d4 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lazy-loading 'fault' on Instance uuid 0a41ce07-b0db-45ca-89a2-13bb028a7cdf {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 02:15:04.844434 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-51afd419-b5c1-49bf-ba3e-8ce57f53e9d4 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047c577e2fcd44f88da514da4a3492ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3c7f99169cd47ae9f3020313f4796df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:15:04.851918 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-51afd419-b5c1-49bf-ba3e-8ce57f53e9d4 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf" status: 200 len: 1351 microversion: 2.1 time: 0.100564 Aug 07 02:15:04.852486 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3777/7087] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:15:04 2022] GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf => generated 1351 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:15:05.874479 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-148a8b5a-9662-4128-b658-588f1497d6d2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:15:05.875224 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-148a8b5a-9662-4128-b658-588f1497d6d2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] [instance: 0a41ce07-b0db-45ca-89a2-13bb028a7cdf] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:15:05.881749 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-148a8b5a-9662-4128-b658-588f1497d6d2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:05.882261 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-148a8b5a-9662-4128-b658-588f1497d6d2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:05.882700 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-148a8b5a-9662-4128-b658-588f1497d6d2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:05.883394 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-148a8b5a-9662-4128-b658-588f1497d6d2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:05.883844 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-148a8b5a-9662-4128-b658-588f1497d6d2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:05.884290 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-148a8b5a-9662-4128-b658-588f1497d6d2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:05.897881 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-148a8b5a-9662-4128-b658-588f1497d6d2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] HTTP exception thrown: Instance 0a41ce07-b0db-45ca-89a2-13bb028a7cdf could not be found. Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-148a8b5a-9662-4128-b658-588f1497d6d2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Request method failure captured: Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf HTTP/1.1 Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7x-4wcL586vSYx7p3aMxxrw3i6C31X_225XV6wYqLylt4VJjI-RsSp-ALzxeOKT3DH7avQ_L4quA00BHcWIngWB7vl0eulHN9O8trUJy4WLlA9_jnOl3vxbUzlVoD4_N7jJ5gHedkc77Baq_cvyvqWQT78EeWzH03kKImMdZwhkp5Wo Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: c3c7f99169cd47ae9f3020313f4796df Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-TestEncryptedCinderVolumes-809558453 Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c3c7f99169cd47ae9f3020313f4796df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c3c7f99169cd47ae9f3020313f4796df", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c3c7f99169cd47ae9f3020313f4796df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c3c7f99169cd47ae9f3020313f4796df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-TestEncryptedCinderVolumes-809558453 Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: c3c7f99169cd47ae9f3020313f4796df Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-809558453 Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-TestEncryptedCinderVolumes-809558453-project Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 047c577e2fcd44f88da514da4a3492ec Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-TestEncryptedCinderVolumes-809558453-project Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 0a41ce07-b0db-45ca-89a2-13bb028a7cdf could not be found. Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '0a41ce07-b0db-45ca-89a2-13bb028a7cdf'} Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a41ce07-b0db-45ca-89a2-13bb028a7cdf could not be found. Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a41ce07-b0db-45ca-89a2-13bb028a7cdf could not be found. Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:15:05.899519 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:15:05.903855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:15:05.903855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:15:05.903855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:15:05.903855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:15:05.903855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:15:05.903855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a41ce07-b0db-45ca-89a2-13bb028a7cdf could not be found. Aug 07 02:15:05.903855 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:15:05.903855 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-148a8b5a-9662-4128-b658-588f1497d6d2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Returning 404 to user: Instance 0a41ce07-b0db-45ca-89a2-13bb028a7cdf could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:15:05.903855 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-148a8b5a-9662-4128-b658-588f1497d6d2 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf" status: 404 len: 111 microversion: 2.1 time: 0.031538 Aug 07 02:15:05.903855 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3311/7088] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:15:05 2022] GET /compute/v2.1/servers/0a41ce07-b0db-45ca-89a2-13bb028a7cdf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:15:05.910256 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5eff93bf-0180-4ab4-98ee-2e7e68e81448 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] Calling method '.version_select at 0x7f9e1715fee0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:15:05.930308 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5eff93bf-0180-4ab4-98ee-2e7e68e81448 tempest-TestEncryptedCinderVolumes-809558453 tempest-TestEncryptedCinderVolumes-809558453-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-73990365" status: 202 len: 0 microversion: 2.1 time: 0.024475 Aug 07 02:15:05.930869 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3778/7089] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 02:15:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-73990365 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:15:32.604941 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-89d812c0-092d-4d10-8bad-fe8a8971f0df tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Action: 'create', calling method: .version_select at 0x7f9e178959d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-865700933", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCn5Gjnbfe2IR2CN+jPhyufECR2Z8cDSEc2T3ywuetTHUkVlGuaYh771ct4OpX7MN9tfn9WDBVaiPrrByBr1UbAXhUZ5CMCI87oKTIuG8t++OUfF8pz2dYVp1vKT85QUxg=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:15:32.610725 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=14 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:15:32.611582 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=34 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:15:32.623201 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-89d812c0-092d-4d10-8bad-fe8a8971f0df tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Getting quotas for project 1416397f45dc4abf94bb539540b5b61f. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:15:32.628748 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-89d812c0-092d-4d10-8bad-fe8a8971f0df tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Getting quotas for user 965b3c62c5af4285a6d747d18274f18a and project 1416397f45dc4abf94bb539540b5b61f. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:15:32.651471 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-89d812c0-092d-4d10-8bad-fe8a8971f0df tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.050401 Aug 07 02:15:32.652095 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3312/7090] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 02:15:32 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:15:32.699026 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:15:32.699815 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:15:32.704866 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-91415d96-434a-4b3b-981b-d468ca8f774e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1910777182", "imageRef": "2a970bf2-48fa-47ba-baa7-b47b6bb8740d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-865700933", "networks": [{"uuid": "8e9d9930-eecb-4ad1-80a5-3b6ecda80e49"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:15:32.758001 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-91415d96-434a-4b3b-981b-d468ca8f774e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] validate_networks() for [('8e9d9930-eecb-4ad1-80a5-3b6ecda80e49', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 02:15:33.224959 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-91415d96-434a-4b3b-981b-d468ca8f774e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 02:15:33.225405 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-91415d96-434a-4b3b-981b-d468ca8f774e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 02:15:33.225931 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-91415d96-434a-4b3b-981b-d468ca8f774e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 02:15:33.226383 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-91415d96-434a-4b3b-981b-d468ca8f774e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 02:15:33.226811 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-91415d96-434a-4b3b-981b-d468ca8f774e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 02:15:33.237256 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91415d96-434a-4b3b-981b-d468ca8f774e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:33.237698 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91415d96-434a-4b3b-981b-d468ca8f774e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:33.238150 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91415d96-434a-4b3b-981b-d468ca8f774e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:33.238903 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91415d96-434a-4b3b-981b-d468ca8f774e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:33.239370 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91415d96-434a-4b3b-981b-d468ca8f774e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:33.239811 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91415d96-434a-4b3b-981b-d468ca8f774e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:33.258946 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-91415d96-434a-4b3b-981b-d468ca8f774e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Getting quotas for project 1416397f45dc4abf94bb539540b5b61f. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:15:33.264163 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-91415d96-434a-4b3b-981b-d468ca8f774e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Getting quotas for user 965b3c62c5af4285a6d747d18274f18a and project 1416397f45dc4abf94bb539540b5b61f. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:15:33.276305 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-91415d96-434a-4b3b-981b-d468ca8f774e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 02:15:33.278539 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-91415d96-434a-4b3b-981b-d468ca8f774e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2a970bf2-48fa-47ba-baa7-b47b6bb8740d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 02:15:33.323325 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-91415d96-434a-4b3b-981b-d468ca8f774e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.626648 Aug 07 02:15:33.323993 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3779/7091] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 02:15:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 07 02:15:33.334636 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-13803bb6-7405-4f1b-a722-7803b0b78785 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:15:33.335253 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-13803bb6-7405-4f1b-a722-7803b0b78785 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:15:33.391610 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-13803bb6-7405-4f1b-a722-7803b0b78785 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:15:33.399529 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-13803bb6-7405-4f1b-a722-7803b0b78785 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98" status: 200 len: 1258 microversion: 2.1 time: 0.068923 Aug 07 02:15:33.400114 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3313/7092] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:15:33 2022] GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98 => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:15:34.421771 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dc2dab27-b6d8-4d74-89ab-5b9013368106 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:15:34.422420 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-dc2dab27-b6d8-4d74-89ab-5b9013368106 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:15:34.430399 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc2dab27-b6d8-4d74-89ab-5b9013368106 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:34.430913 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc2dab27-b6d8-4d74-89ab-5b9013368106 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:34.431363 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc2dab27-b6d8-4d74-89ab-5b9013368106 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:34.432121 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc2dab27-b6d8-4d74-89ab-5b9013368106 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:34.432594 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc2dab27-b6d8-4d74-89ab-5b9013368106 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:34.433037 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc2dab27-b6d8-4d74-89ab-5b9013368106 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:34.496168 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-dc2dab27-b6d8-4d74-89ab-5b9013368106 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:15:34.504330 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-dc2dab27-b6d8-4d74-89ab-5b9013368106 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98" status: 200 len: 1316 microversion: 2.1 time: 0.087491 Aug 07 02:15:34.504901 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3780/7093] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:15:34 2022] GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98 => generated 1316 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:15:35.525502 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cdfa2726-9467-47a1-8da7-530a25126440 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:15:35.526125 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-cdfa2726-9467-47a1-8da7-530a25126440 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:15:35.533957 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cdfa2726-9467-47a1-8da7-530a25126440 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:35.534447 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cdfa2726-9467-47a1-8da7-530a25126440 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:35.534893 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cdfa2726-9467-47a1-8da7-530a25126440 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:35.535604 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cdfa2726-9467-47a1-8da7-530a25126440 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:35.536280 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cdfa2726-9467-47a1-8da7-530a25126440 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:35.536875 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cdfa2726-9467-47a1-8da7-530a25126440 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:35.680587 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-cdfa2726-9467-47a1-8da7-530a25126440 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:15:35.702298 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cdfa2726-9467-47a1-8da7-530a25126440 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98" status: 200 len: 1358 microversion: 2.1 time: 0.168284 Aug 07 02:15:35.703092 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3314/7094] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:15:35 2022] GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:15:36.725779 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9d7d1bd9-aaad-479c-b988-3ab6ea63a780 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:15:36.727013 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9d7d1bd9-aaad-479c-b988-3ab6ea63a780 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:15:36.734899 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d7d1bd9-aaad-479c-b988-3ab6ea63a780 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:36.735474 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d7d1bd9-aaad-479c-b988-3ab6ea63a780 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:36.736030 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d7d1bd9-aaad-479c-b988-3ab6ea63a780 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:36.736817 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d7d1bd9-aaad-479c-b988-3ab6ea63a780 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:36.737352 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d7d1bd9-aaad-479c-b988-3ab6ea63a780 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:36.737981 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d7d1bd9-aaad-479c-b988-3ab6ea63a780 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:36.879603 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9d7d1bd9-aaad-479c-b988-3ab6ea63a780 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:15:36.887767 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9d7d1bd9-aaad-479c-b988-3ab6ea63a780 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98" status: 200 len: 1358 microversion: 2.1 time: 0.166851 Aug 07 02:15:36.888928 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3781/7095] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:15:36 2022] GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:15:37.910348 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e76ebce3-a47c-41f1-9542-ddcb8b84f96f tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:15:37.911249 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e76ebce3-a47c-41f1-9542-ddcb8b84f96f tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:15:37.918556 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e76ebce3-a47c-41f1-9542-ddcb8b84f96f tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:37.919040 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e76ebce3-a47c-41f1-9542-ddcb8b84f96f tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:37.919479 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e76ebce3-a47c-41f1-9542-ddcb8b84f96f tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:37.920223 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e76ebce3-a47c-41f1-9542-ddcb8b84f96f tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:37.920684 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e76ebce3-a47c-41f1-9542-ddcb8b84f96f tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:37.921117 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e76ebce3-a47c-41f1-9542-ddcb8b84f96f tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:38.074574 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e76ebce3-a47c-41f1-9542-ddcb8b84f96f tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:15:38.086920 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e76ebce3-a47c-41f1-9542-ddcb8b84f96f tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98" status: 200 len: 1358 microversion: 2.1 time: 0.180927 Aug 07 02:15:38.095052 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3315/7096] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:15:37 2022] GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:15:39.109715 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bb8434ad-38d4-4a5c-ad74-9bb7e01cda60 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:15:39.110355 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bb8434ad-38d4-4a5c-ad74-9bb7e01cda60 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:15:39.118375 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb8434ad-38d4-4a5c-ad74-9bb7e01cda60 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:39.119122 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb8434ad-38d4-4a5c-ad74-9bb7e01cda60 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:39.119741 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb8434ad-38d4-4a5c-ad74-9bb7e01cda60 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:39.120928 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb8434ad-38d4-4a5c-ad74-9bb7e01cda60 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:39.121570 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb8434ad-38d4-4a5c-ad74-9bb7e01cda60 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:39.122215 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb8434ad-38d4-4a5c-ad74-9bb7e01cda60 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:39.271152 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bb8434ad-38d4-4a5c-ad74-9bb7e01cda60 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:15:39.278755 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bb8434ad-38d4-4a5c-ad74-9bb7e01cda60 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98" status: 200 len: 1358 microversion: 2.1 time: 0.173002 Aug 07 02:15:39.279326 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3782/7097] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:15:39 2022] GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:15:40.306382 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8eb732c8-8984-401a-8eb7-54a88a3e0d5b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:15:40.306382 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8eb732c8-8984-401a-8eb7-54a88a3e0d5b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:15:40.323659 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8eb732c8-8984-401a-8eb7-54a88a3e0d5b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:40.324201 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8eb732c8-8984-401a-8eb7-54a88a3e0d5b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:40.324658 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8eb732c8-8984-401a-8eb7-54a88a3e0d5b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:40.325515 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8eb732c8-8984-401a-8eb7-54a88a3e0d5b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:40.326118 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8eb732c8-8984-401a-8eb7-54a88a3e0d5b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:40.327383 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8eb732c8-8984-401a-8eb7-54a88a3e0d5b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:40.496284 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8eb732c8-8984-401a-8eb7-54a88a3e0d5b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:15:40.506152 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8eb732c8-8984-401a-8eb7-54a88a3e0d5b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98" status: 200 len: 1358 microversion: 2.1 time: 0.204724 Aug 07 02:15:40.519597 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3316/7098] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:15:40 2022] GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98 => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:15:41.528392 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-97caee4b-ccc2-4cde-80e9-246c76fd5203 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:15:41.529090 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-97caee4b-ccc2-4cde-80e9-246c76fd5203 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:15:41.537461 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-97caee4b-ccc2-4cde-80e9-246c76fd5203 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:41.538198 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-97caee4b-ccc2-4cde-80e9-246c76fd5203 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:41.538778 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-97caee4b-ccc2-4cde-80e9-246c76fd5203 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:41.539699 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-97caee4b-ccc2-4cde-80e9-246c76fd5203 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:41.540199 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-97caee4b-ccc2-4cde-80e9-246c76fd5203 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:41.540650 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-97caee4b-ccc2-4cde-80e9-246c76fd5203 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:41.677871 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-97caee4b-ccc2-4cde-80e9-246c76fd5203 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:15:41.685896 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-97caee4b-ccc2-4cde-80e9-246c76fd5203 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98" status: 200 len: 1358 microversion: 2.1 time: 0.161734 Aug 07 02:15:41.686684 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3783/7099] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:15:41 2022] GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:15:42.707109 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d63863ef-aedc-40ca-9c0d-90fc5b046c9a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:15:42.707760 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d63863ef-aedc-40ca-9c0d-90fc5b046c9a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:15:42.714270 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d63863ef-aedc-40ca-9c0d-90fc5b046c9a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:42.714752 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d63863ef-aedc-40ca-9c0d-90fc5b046c9a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:42.715189 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d63863ef-aedc-40ca-9c0d-90fc5b046c9a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:42.715900 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d63863ef-aedc-40ca-9c0d-90fc5b046c9a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:42.716349 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d63863ef-aedc-40ca-9c0d-90fc5b046c9a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:42.716776 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d63863ef-aedc-40ca-9c0d-90fc5b046c9a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:42.925595 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d63863ef-aedc-40ca-9c0d-90fc5b046c9a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:15:42.933367 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d63863ef-aedc-40ca-9c0d-90fc5b046c9a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98" status: 200 len: 1358 microversion: 2.1 time: 0.230906 Aug 07 02:15:42.933955 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3317/7100] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:15:42 2022] GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98 => generated 1358 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:15:43.368225 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-61622274-bfa2-40c6-bbec-a1e54aed361a req-7ef8f8bf-968e-4abe-a744-d45b0396db77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cae4e1cc-b500-4658-b8d9-2b9b047b8d98", "tag": "0a3d9ab8-7535-4e11-94a4-668e3483ddc8"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:15:43.374898 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:15:43.375925 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:15:43.383971 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-61622274-bfa2-40c6-bbec-a1e54aed361a req-7ef8f8bf-968e-4abe-a744-d45b0396db77 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:43.384498 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-61622274-bfa2-40c6-bbec-a1e54aed361a req-7ef8f8bf-968e-4abe-a744-d45b0396db77 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:43.385029 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-61622274-bfa2-40c6-bbec-a1e54aed361a req-7ef8f8bf-968e-4abe-a744-d45b0396db77 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:43.397752 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-61622274-bfa2-40c6-bbec-a1e54aed361a req-7ef8f8bf-968e-4abe-a744-d45b0396db77 service nova] Creating event network-changed:0a3d9ab8-7535-4e11-94a4-668e3483ddc8 for instance cae4e1cc-b500-4658-b8d9-2b9b047b8d98 on n-h1-master-1 Aug 07 02:15:43.402887 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-61622274-bfa2-40c6-bbec-a1e54aed361a req-7ef8f8bf-968e-4abe-a744-d45b0396db77 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038726 Aug 07 02:15:43.403498 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3784/7101] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 02:15:43.955114 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fe1f5fcf-a029-4b18-86fc-d4160d7ba2fb tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:15:43.955748 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fe1f5fcf-a029-4b18-86fc-d4160d7ba2fb tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:15:43.957650 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:15:43.963422 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fe1f5fcf-a029-4b18-86fc-d4160d7ba2fb tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:43.963971 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fe1f5fcf-a029-4b18-86fc-d4160d7ba2fb tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:43.964395 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fe1f5fcf-a029-4b18-86fc-d4160d7ba2fb tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:43.965090 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fe1f5fcf-a029-4b18-86fc-d4160d7ba2fb tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:43.965544 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fe1f5fcf-a029-4b18-86fc-d4160d7ba2fb tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:43.965964 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fe1f5fcf-a029-4b18-86fc-d4160d7ba2fb tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:44.097150 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fe1f5fcf-a029-4b18-86fc-d4160d7ba2fb tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:15:44.105085 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fe1f5fcf-a029-4b18-86fc-d4160d7ba2fb tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98" status: 200 len: 1358 microversion: 2.1 time: 0.154115 Aug 07 02:15:44.105653 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3318/7102] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:15:43 2022] GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:15:45.128545 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-08aa1583-08fb-4b9e-9c42-785d095e1bcf tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:15:45.129268 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-08aa1583-08fb-4b9e-9c42-785d095e1bcf tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:15:45.136006 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08aa1583-08fb-4b9e-9c42-785d095e1bcf tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:45.136508 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08aa1583-08fb-4b9e-9c42-785d095e1bcf tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:45.136961 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08aa1583-08fb-4b9e-9c42-785d095e1bcf tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:45.137672 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08aa1583-08fb-4b9e-9c42-785d095e1bcf tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:45.138143 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08aa1583-08fb-4b9e-9c42-785d095e1bcf tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:45.138587 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-08aa1583-08fb-4b9e-9c42-785d095e1bcf tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:45.276110 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-08aa1583-08fb-4b9e-9c42-785d095e1bcf tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:15:45.283758 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-08aa1583-08fb-4b9e-9c42-785d095e1bcf tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98" status: 200 len: 1358 microversion: 2.1 time: 0.160420 Aug 07 02:15:45.284377 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3785/7103] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:15:45 2022] GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:15:46.305058 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-20a46485-e210-4372-a2ed-6761d3dcb5aa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:15:46.305610 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-20a46485-e210-4372-a2ed-6761d3dcb5aa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:15:46.313085 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-20a46485-e210-4372-a2ed-6761d3dcb5aa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:46.313574 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-20a46485-e210-4372-a2ed-6761d3dcb5aa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:46.314512 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-20a46485-e210-4372-a2ed-6761d3dcb5aa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:46.315221 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-20a46485-e210-4372-a2ed-6761d3dcb5aa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:46.315673 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-20a46485-e210-4372-a2ed-6761d3dcb5aa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:46.316127 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-20a46485-e210-4372-a2ed-6761d3dcb5aa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:46.444504 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-20a46485-e210-4372-a2ed-6761d3dcb5aa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:15:46.452020 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-20a46485-e210-4372-a2ed-6761d3dcb5aa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98" status: 200 len: 1358 microversion: 2.1 time: 0.150907 Aug 07 02:15:46.452585 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3319/7104] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:15:46 2022] GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:15:47.473649 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4c44e35f-5bff-4c82-b5fb-6f0cb9ff253b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:15:47.474290 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4c44e35f-5bff-4c82-b5fb-6f0cb9ff253b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:15:47.481316 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c44e35f-5bff-4c82-b5fb-6f0cb9ff253b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:47.481809 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c44e35f-5bff-4c82-b5fb-6f0cb9ff253b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:47.482260 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c44e35f-5bff-4c82-b5fb-6f0cb9ff253b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:47.482985 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c44e35f-5bff-4c82-b5fb-6f0cb9ff253b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:47.483455 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c44e35f-5bff-4c82-b5fb-6f0cb9ff253b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:47.483919 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c44e35f-5bff-4c82-b5fb-6f0cb9ff253b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:47.612478 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4c44e35f-5bff-4c82-b5fb-6f0cb9ff253b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:15:47.619917 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4c44e35f-5bff-4c82-b5fb-6f0cb9ff253b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98" status: 200 len: 1358 microversion: 2.1 time: 0.150800 Aug 07 02:15:47.620506 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3786/7105] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:15:47 2022] GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:15:48.640108 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6964207a-65de-407d-97f8-bdf5fbf70bc8 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:15:48.640763 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6964207a-65de-407d-97f8-bdf5fbf70bc8 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:15:48.648166 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6964207a-65de-407d-97f8-bdf5fbf70bc8 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:48.648652 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6964207a-65de-407d-97f8-bdf5fbf70bc8 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:48.649090 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6964207a-65de-407d-97f8-bdf5fbf70bc8 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:48.649794 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6964207a-65de-407d-97f8-bdf5fbf70bc8 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:48.650249 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6964207a-65de-407d-97f8-bdf5fbf70bc8 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:48.650676 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6964207a-65de-407d-97f8-bdf5fbf70bc8 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:48.777272 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6964207a-65de-407d-97f8-bdf5fbf70bc8 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:15:48.784799 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6964207a-65de-407d-97f8-bdf5fbf70bc8 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98" status: 200 len: 1358 microversion: 2.1 time: 0.148639 Aug 07 02:15:48.785377 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3320/7106] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:15:48 2022] GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:15:49.245226 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-c85dd3fc-3bd7-4c44-93af-be58e783bdc7 req-a84c2e92-5aab-424b-85b4-dc100f33b4a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cae4e1cc-b500-4658-b8d9-2b9b047b8d98", "name": "network-vif-plugged", "status": "completed", "tag": "0a3d9ab8-7535-4e11-94a4-668e3483ddc8"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:15:49.257757 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c85dd3fc-3bd7-4c44-93af-be58e783bdc7 req-a84c2e92-5aab-424b-85b4-dc100f33b4a4 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:49.258261 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c85dd3fc-3bd7-4c44-93af-be58e783bdc7 req-a84c2e92-5aab-424b-85b4-dc100f33b4a4 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:49.258733 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c85dd3fc-3bd7-4c44-93af-be58e783bdc7 req-a84c2e92-5aab-424b-85b4-dc100f33b4a4 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:49.270357 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-c85dd3fc-3bd7-4c44-93af-be58e783bdc7 req-a84c2e92-5aab-424b-85b4-dc100f33b4a4 service nova] Creating event network-vif-plugged:0a3d9ab8-7535-4e11-94a4-668e3483ddc8 for instance cae4e1cc-b500-4658-b8d9-2b9b047b8d98 on n-h1-master-1 Aug 07 02:15:49.275878 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-c85dd3fc-3bd7-4c44-93af-be58e783bdc7 req-a84c2e92-5aab-424b-85b4-dc100f33b4a4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034361 Aug 07 02:15:49.276501 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3787/7107] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:15:49.804545 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4aa740b4-2cc9-4e0c-80b6-dfb1a489726a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:15:49.805144 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4aa740b4-2cc9-4e0c-80b6-dfb1a489726a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:15:49.812077 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4aa740b4-2cc9-4e0c-80b6-dfb1a489726a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:49.812816 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4aa740b4-2cc9-4e0c-80b6-dfb1a489726a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:49.813251 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4aa740b4-2cc9-4e0c-80b6-dfb1a489726a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:49.813944 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4aa740b4-2cc9-4e0c-80b6-dfb1a489726a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:49.814401 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4aa740b4-2cc9-4e0c-80b6-dfb1a489726a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:49.814825 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4aa740b4-2cc9-4e0c-80b6-dfb1a489726a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:49.942889 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4aa740b4-2cc9-4e0c-80b6-dfb1a489726a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:15:49.950378 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4aa740b4-2cc9-4e0c-80b6-dfb1a489726a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98" status: 200 len: 1358 microversion: 2.1 time: 0.149693 Aug 07 02:15:49.950946 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3321/7108] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:15:49 2022] GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:15:50.973058 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d5ca8cae-53b1-462d-bd16-13074983adcb tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:15:50.973892 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d5ca8cae-53b1-462d-bd16-13074983adcb tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:15:50.981142 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d5ca8cae-53b1-462d-bd16-13074983adcb tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:50.981570 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d5ca8cae-53b1-462d-bd16-13074983adcb tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:50.982016 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d5ca8cae-53b1-462d-bd16-13074983adcb tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:50.983254 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d5ca8cae-53b1-462d-bd16-13074983adcb tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:50.983254 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d5ca8cae-53b1-462d-bd16-13074983adcb tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:50.983613 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d5ca8cae-53b1-462d-bd16-13074983adcb tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:51.117190 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d5ca8cae-53b1-462d-bd16-13074983adcb tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:15:51.124809 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d5ca8cae-53b1-462d-bd16-13074983adcb tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98" status: 200 len: 1548 microversion: 2.1 time: 0.156670 Aug 07 02:15:51.125387 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3788/7109] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:15:50 2022] GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:15:51.145284 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-99adf4da-1511-4392-8b0b-7aa8280d6f6b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:15:51.145914 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-99adf4da-1511-4392-8b0b-7aa8280d6f6b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:15:51.152732 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-99adf4da-1511-4392-8b0b-7aa8280d6f6b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:51.153219 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-99adf4da-1511-4392-8b0b-7aa8280d6f6b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:51.153665 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-99adf4da-1511-4392-8b0b-7aa8280d6f6b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:51.154362 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-99adf4da-1511-4392-8b0b-7aa8280d6f6b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:51.154821 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-99adf4da-1511-4392-8b0b-7aa8280d6f6b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:51.155252 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-99adf4da-1511-4392-8b0b-7aa8280d6f6b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:51.286759 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-99adf4da-1511-4392-8b0b-7aa8280d6f6b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:15:51.294468 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-99adf4da-1511-4392-8b0b-7aa8280d6f6b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98" status: 200 len: 1548 microversion: 2.1 time: 0.153614 Aug 07 02:15:51.295040 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3322/7110] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:15:51 2022] GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:15:51.314276 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4c8e3bc7-c12e-490c-9121-a8c63300e970 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:15:51.318866 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4c8e3bc7-c12e-490c-9121-a8c63300e970 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:15:51.319652 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4c8e3bc7-c12e-490c-9121-a8c63300e970 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Searching by: {'deleted': False, 'project_id': '1416397f45dc4abf94bb539540b5b61f'} {{(pid=119516) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 02:15:51.325051 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c8e3bc7-c12e-490c-9121-a8c63300e970 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:51.325549 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c8e3bc7-c12e-490c-9121-a8c63300e970 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:51.326007 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c8e3bc7-c12e-490c-9121-a8c63300e970 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:51.326766 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c8e3bc7-c12e-490c-9121-a8c63300e970 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:51.327239 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c8e3bc7-c12e-490c-9121-a8c63300e970 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:51.327688 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4c8e3bc7-c12e-490c-9121-a8c63300e970 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:51.351875 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.multi_cell_list [None req-4c8e3bc7-c12e-490c-9121-a8c63300e970 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 02:15:51.378732 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4c8e3bc7-c12e-490c-9121-a8c63300e970 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.068511 Aug 07 02:15:51.379318 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3789/7111] 10.222.0.39 () {58 vars in 1125 bytes} [Sun Aug 7 02:15:51 2022] GET /compute/v2.1/servers => generated 343 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:15:51.390526 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fabea218-50d3-4efb-9bfd-0b6ab78ee09e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:15:51.391168 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fabea218-50d3-4efb-9bfd-0b6ab78ee09e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:15:51.397711 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fabea218-50d3-4efb-9bfd-0b6ab78ee09e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:51.398254 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fabea218-50d3-4efb-9bfd-0b6ab78ee09e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:51.398685 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fabea218-50d3-4efb-9bfd-0b6ab78ee09e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:51.399372 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fabea218-50d3-4efb-9bfd-0b6ab78ee09e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:51.399827 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fabea218-50d3-4efb-9bfd-0b6ab78ee09e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:51.400284 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fabea218-50d3-4efb-9bfd-0b6ab78ee09e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:51.526480 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fabea218-50d3-4efb-9bfd-0b6ab78ee09e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:15:51.534029 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fabea218-50d3-4efb-9bfd-0b6ab78ee09e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98" status: 200 len: 1548 microversion: 2.1 time: 0.147405 Aug 07 02:15:51.534603 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3323/7112] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:15:51 2022] GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98 => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:15:53.054744 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ef58156d-0a13-4a53-a6a9-7288932078d4 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45751f3a-89bc-4553-9a61-da44b91a1a60"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:15:53.057318 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ef58156d-0a13-4a53-a6a9-7288932078d4 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:15:53.065262 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef58156d-0a13-4a53-a6a9-7288932078d4 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:53.065768 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef58156d-0a13-4a53-a6a9-7288932078d4 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:53.066223 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef58156d-0a13-4a53-a6a9-7288932078d4 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:53.066951 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef58156d-0a13-4a53-a6a9-7288932078d4 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:15:53.067421 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef58156d-0a13-4a53-a6a9-7288932078d4 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:15:53.067907 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ef58156d-0a13-4a53-a6a9-7288932078d4 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:15:53.321952 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ef58156d-0a13-4a53-a6a9-7288932078d4 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "POST /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270993 Aug 07 02:15:53.328374 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3790/7113] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Aug 7 02:15:53 2022] POST /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:16:06.344917 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-29b04f98-c0e1-4cd5-bedb-9c9505481e16 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:16:06.345544 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-29b04f98-c0e1-4cd5-bedb-9c9505481e16 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:16:06.348463 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:16:06.349282 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=60 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:16:06.355200 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-29b04f98-c0e1-4cd5-bedb-9c9505481e16 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:16:06.355690 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-29b04f98-c0e1-4cd5-bedb-9c9505481e16 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:16:06.356171 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-29b04f98-c0e1-4cd5-bedb-9c9505481e16 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:16:06.356879 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-29b04f98-c0e1-4cd5-bedb-9c9505481e16 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:16:06.357343 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-29b04f98-c0e1-4cd5-bedb-9c9505481e16 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:16:06.357778 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-29b04f98-c0e1-4cd5-bedb-9c9505481e16 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:16:06.491249 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-29b04f98-c0e1-4cd5-bedb-9c9505481e16 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:16:06.499393 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-29b04f98-c0e1-4cd5-bedb-9c9505481e16 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98" status: 200 len: 1594 microversion: 2.1 time: 0.158334 Aug 07 02:16:06.500021 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3324/7114] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:16:06 2022] GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98 => generated 1594 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:16:08.435479 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-3dabdd49-36cf-4556-81ed-25c5db97594f req-cb6ff357-c6c7-4a2d-b574-dfc2ea1a0320 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cae4e1cc-b500-4658-b8d9-2b9b047b8d98", "tag": "0a3d9ab8-7535-4e11-94a4-668e3483ddc8"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:16:08.442226 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:16:08.443158 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:16:08.444099 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:16:08.451653 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3dabdd49-36cf-4556-81ed-25c5db97594f req-cb6ff357-c6c7-4a2d-b574-dfc2ea1a0320 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:16:08.452540 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3dabdd49-36cf-4556-81ed-25c5db97594f req-cb6ff357-c6c7-4a2d-b574-dfc2ea1a0320 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:16:08.453087 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3dabdd49-36cf-4556-81ed-25c5db97594f req-cb6ff357-c6c7-4a2d-b574-dfc2ea1a0320 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:16:08.467367 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-3dabdd49-36cf-4556-81ed-25c5db97594f req-cb6ff357-c6c7-4a2d-b574-dfc2ea1a0320 service nova] Creating event network-changed:0a3d9ab8-7535-4e11-94a4-668e3483ddc8 for instance cae4e1cc-b500-4658-b8d9-2b9b047b8d98 on n-h1-master-1 Aug 07 02:16:08.474228 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-3dabdd49-36cf-4556-81ed-25c5db97594f req-cb6ff357-c6c7-4a2d-b574-dfc2ea1a0320 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042899 Aug 07 02:16:08.475117 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3791/7115] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:16:09.561317 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d0715d44-0b2f-4b8f-ae24-385cea2b9ca5 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-866812721"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:16:09.561851 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d0715d44-0b2f-4b8f-ae24-385cea2b9ca5 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:16:09.569736 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d0715d44-0b2f-4b8f-ae24-385cea2b9ca5 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:16:09.570231 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d0715d44-0b2f-4b8f-ae24-385cea2b9ca5 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:16:09.570668 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d0715d44-0b2f-4b8f-ae24-385cea2b9ca5 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:16:09.571372 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d0715d44-0b2f-4b8f-ae24-385cea2b9ca5 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:16:09.571828 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d0715d44-0b2f-4b8f-ae24-385cea2b9ca5 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:16:09.572325 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d0715d44-0b2f-4b8f-ae24-385cea2b9ca5 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:16:09.704786 n-d-master-1 devstack@n-api.service[119517]: INFO nova.network.security_group_api [None req-d0715d44-0b2f-4b8f-ae24-385cea2b9ca5 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Adding security group 84da8e69-7fed-4a42-8997-920ae032c20a to port 0a3d9ab8-7535-4e11-94a4-668e3483ddc8 Aug 07 02:16:10.026790 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d0715d44-0b2f-4b8f-ae24-385cea2b9ca5 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "POST /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98/action" status: 202 len: 0 microversion: 2.1 time: 0.469486 Aug 07 02:16:10.027436 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3325/7116] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:16:09 2022] POST /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:16:10.037097 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-86918957-167a-4b20-8e27-01c3161959ba tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:16:10.037825 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-86918957-167a-4b20-8e27-01c3161959ba tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:16:10.048502 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86918957-167a-4b20-8e27-01c3161959ba tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:16:10.049022 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86918957-167a-4b20-8e27-01c3161959ba tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:16:10.049695 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86918957-167a-4b20-8e27-01c3161959ba tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:16:10.050982 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86918957-167a-4b20-8e27-01c3161959ba tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:16:10.051456 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86918957-167a-4b20-8e27-01c3161959ba tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:16:10.051948 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-86918957-167a-4b20-8e27-01c3161959ba tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:16:10.211933 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-86918957-167a-4b20-8e27-01c3161959ba tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:16:10.220201 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-86918957-167a-4b20-8e27-01c3161959ba tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98" status: 200 len: 1759 microversion: 2.1 time: 0.187885 Aug 07 02:16:10.220779 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3792/7117] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:16:10 2022] GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98 => generated 1759 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:16:10.489197 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-173851f4-249b-41a6-9f47-c2254a64a23c req-09979087-029e-4958-981b-81175f78a18f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cae4e1cc-b500-4658-b8d9-2b9b047b8d98", "tag": "0a3d9ab8-7535-4e11-94a4-668e3483ddc8"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:16:10.498564 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-173851f4-249b-41a6-9f47-c2254a64a23c req-09979087-029e-4958-981b-81175f78a18f service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:16:10.499049 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-173851f4-249b-41a6-9f47-c2254a64a23c req-09979087-029e-4958-981b-81175f78a18f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:16:10.499488 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-173851f4-249b-41a6-9f47-c2254a64a23c req-09979087-029e-4958-981b-81175f78a18f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:16:10.510544 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-173851f4-249b-41a6-9f47-c2254a64a23c req-09979087-029e-4958-981b-81175f78a18f service nova] Creating event network-changed:0a3d9ab8-7535-4e11-94a4-668e3483ddc8 for instance cae4e1cc-b500-4658-b8d9-2b9b047b8d98 on n-h1-master-1 Aug 07 02:16:10.516054 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-173851f4-249b-41a6-9f47-c2254a64a23c req-09979087-029e-4958-981b-81175f78a18f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030970 Aug 07 02:16:10.516653 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3326/7118] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 02:17:47.940461 n-d-master-1 devstack@n-api.service[119516]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9bbf4f32-4f7b-4fcf-a326-64eac47dae98] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 07 02:17:47.940980 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=4 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:17:47.941758 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=8 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:17:47.946507 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d48e6070-ee53-401e-9fb0-241bd5750f1a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:17:47.948769 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d48e6070-ee53-401e-9fb0-241bd5750f1a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:17:47.955618 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d48e6070-ee53-401e-9fb0-241bd5750f1a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:17:47.956151 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d48e6070-ee53-401e-9fb0-241bd5750f1a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:17:47.956610 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d48e6070-ee53-401e-9fb0-241bd5750f1a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:17:47.957328 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d48e6070-ee53-401e-9fb0-241bd5750f1a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:17:47.957803 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d48e6070-ee53-401e-9fb0-241bd5750f1a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:17:47.958250 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d48e6070-ee53-401e-9fb0-241bd5750f1a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:17:47.987471 n-d-master-1 devstack@n-api.service[119517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 02:17:47.987993 n-d-master-1 devstack@n-api.service[119517]: Sun Aug 7 02:17:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 02:17:48.036963 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d48e6070-ee53-401e-9fb0-241bd5750f1a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "POST /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98/action" status: 202 len: 0 microversion: 2.1 time: 0.098715 Aug 07 02:17:48.037607 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3793/7119] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:17:47 2022] POST /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:17:48.044799 n-d-master-1 devstack@n-api.service[119517]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cc2209bc-4fce-4284-bf5f-e0375e6343bd] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 07 02:17:48.046054 n-d-master-1 devstack@n-api.service[119517]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dde625b-e185-486e-885e-ba9f9bdf36ce] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 07 02:17:48.046754 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:17:48.047568 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=12 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:17:48.051903 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b5dac031-64fa-4310-9a4c-2eefc1a9df2e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:17:48.052669 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b5dac031-64fa-4310-9a4c-2eefc1a9df2e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:17:48.060133 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5dac031-64fa-4310-9a4c-2eefc1a9df2e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:17:48.060623 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5dac031-64fa-4310-9a4c-2eefc1a9df2e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:17:48.061070 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5dac031-64fa-4310-9a4c-2eefc1a9df2e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:17:48.061779 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5dac031-64fa-4310-9a4c-2eefc1a9df2e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:17:48.062247 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5dac031-64fa-4310-9a4c-2eefc1a9df2e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:17:48.062681 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5dac031-64fa-4310-9a4c-2eefc1a9df2e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:17:48.093365 n-d-master-1 devstack@n-api.service[119516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 02:17:48.093591 n-d-master-1 devstack@n-api.service[119516]: Sun Aug 7 02:17:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 02:17:48.427361 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b5dac031-64fa-4310-9a4c-2eefc1a9df2e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:17:48.436042 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b5dac031-64fa-4310-9a4c-2eefc1a9df2e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98" status: 200 len: 1761 microversion: 2.1 time: 0.393194 Aug 07 02:17:48.436616 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3327/7120] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:17:48 2022] GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98 => generated 1761 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:17:49.460300 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8b2506fd-8aee-4dc3-87d2-1ff4b3be5187 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:17:49.461045 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8b2506fd-8aee-4dc3-87d2-1ff4b3be5187 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:17:49.469130 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b2506fd-8aee-4dc3-87d2-1ff4b3be5187 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:17:49.469631 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b2506fd-8aee-4dc3-87d2-1ff4b3be5187 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:17:49.470087 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b2506fd-8aee-4dc3-87d2-1ff4b3be5187 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:17:49.470799 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b2506fd-8aee-4dc3-87d2-1ff4b3be5187 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:17:49.471272 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b2506fd-8aee-4dc3-87d2-1ff4b3be5187 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:17:49.471714 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8b2506fd-8aee-4dc3-87d2-1ff4b3be5187 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:17:49.475065 n-d-master-1 devstack@n-api.service[119516]: INFO oslo.messaging._drivers.impl_rabbit [-] [9bbf4f32-4f7b-4fcf-a326-64eac47dae98] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 34954. Aug 07 02:17:49.668349 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8b2506fd-8aee-4dc3-87d2-1ff4b3be5187 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:17:49.676499 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8b2506fd-8aee-4dc3-87d2-1ff4b3be5187 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98" status: 200 len: 1759 microversion: 2.1 time: 0.222027 Aug 07 02:17:49.677098 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3794/7121] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:17:49 2022] GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98 => generated 1759 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:19:02.316341 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:19:02.317121 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:19:02.321658 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-88bd09dd-0a60-460c-b4cf-5b27cdee28d7 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-866812721"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:19:02.322199 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-88bd09dd-0a60-460c-b4cf-5b27cdee28d7 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:19:02.332163 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-88bd09dd-0a60-460c-b4cf-5b27cdee28d7 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:02.332644 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-88bd09dd-0a60-460c-b4cf-5b27cdee28d7 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:02.333069 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-88bd09dd-0a60-460c-b4cf-5b27cdee28d7 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:02.333773 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-88bd09dd-0a60-460c-b4cf-5b27cdee28d7 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:02.334230 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-88bd09dd-0a60-460c-b4cf-5b27cdee28d7 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:02.334658 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-88bd09dd-0a60-460c-b4cf-5b27cdee28d7 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:02.338386 n-d-master-1 devstack@n-api.service[119517]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dde625b-e185-486e-885e-ba9f9bdf36ce] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 34986. Aug 07 02:19:02.339081 n-d-master-1 devstack@n-api.service[119517]: INFO oslo.messaging._drivers.impl_rabbit [-] [cc2209bc-4fce-4284-bf5f-e0375e6343bd] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 34984. Aug 07 02:19:02.753360 n-d-master-1 devstack@n-api.service[119517]: INFO nova.network.security_group_api [None req-88bd09dd-0a60-460c-b4cf-5b27cdee28d7 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Removing security group 84da8e69-7fed-4a42-8997-920ae032c20a from port 0a3d9ab8-7535-4e11-94a4-668e3483ddc8 Aug 07 02:19:03.051348 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-88bd09dd-0a60-460c-b4cf-5b27cdee28d7 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "POST /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98/action" status: 202 len: 0 microversion: 2.1 time: 0.737455 Aug 07 02:19:03.052011 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3328/7122] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:19:02 2022] POST /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98/action => generated 0 bytes in 739 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:19:03.057698 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=4 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:19:03.059482 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:19:03.153775 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-09d9a210-4b17-43fc-9eac-963b65b0e8b1 req-6cd34c95-3dd3-4c8b-9289-507342b2f1c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cae4e1cc-b500-4658-b8d9-2b9b047b8d98", "tag": "0a3d9ab8-7535-4e11-94a4-668e3483ddc8"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:19:03.163340 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-09d9a210-4b17-43fc-9eac-963b65b0e8b1 req-6cd34c95-3dd3-4c8b-9289-507342b2f1c8 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:03.164068 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-09d9a210-4b17-43fc-9eac-963b65b0e8b1 req-6cd34c95-3dd3-4c8b-9289-507342b2f1c8 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:03.164297 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-09d9a210-4b17-43fc-9eac-963b65b0e8b1 req-6cd34c95-3dd3-4c8b-9289-507342b2f1c8 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:03.175762 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-09d9a210-4b17-43fc-9eac-963b65b0e8b1 req-6cd34c95-3dd3-4c8b-9289-507342b2f1c8 service nova] Creating event network-changed:0a3d9ab8-7535-4e11-94a4-668e3483ddc8 for instance cae4e1cc-b500-4658-b8d9-2b9b047b8d98 on n-h1-master-1 Aug 07 02:19:03.180958 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-09d9a210-4b17-43fc-9eac-963b65b0e8b1 req-6cd34c95-3dd3-4c8b-9289-507342b2f1c8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124987 Aug 07 02:19:03.181558 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3795/7123] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 02:19:04.492280 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c8a48631-3739-4d43-a40a-5f36faea63c4 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:19:04.492857 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c8a48631-3739-4d43-a40a-5f36faea63c4 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:19:04.499455 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c8a48631-3739-4d43-a40a-5f36faea63c4 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:04.499971 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c8a48631-3739-4d43-a40a-5f36faea63c4 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:04.500409 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c8a48631-3739-4d43-a40a-5f36faea63c4 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:04.501112 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c8a48631-3739-4d43-a40a-5f36faea63c4 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:04.501568 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c8a48631-3739-4d43-a40a-5f36faea63c4 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:04.501994 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c8a48631-3739-4d43-a40a-5f36faea63c4 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:04.583326 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-c8a48631-3739-4d43-a40a-5f36faea63c4 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lazy-loading 'services' on Instance uuid cae4e1cc-b500-4658-b8d9-2b9b047b8d98 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 02:19:04.654871 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c8a48631-3739-4d43-a40a-5f36faea63c4 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "DELETE /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98/os-volume_attachments/45751f3a-89bc-4553-9a61-da44b91a1a60" status: 202 len: 0 microversion: 2.1 time: 0.167244 Aug 07 02:19:04.655504 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3329/7124] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Aug 7 02:19:04 2022] DELETE /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98/os-volume_attachments/45751f3a-89bc-4553-9a61-da44b91a1a60 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:19:04.667634 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-565b1393-1bda-45af-a3c8-b4a81db48e5a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:19:04.671526 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-565b1393-1bda-45af-a3c8-b4a81db48e5a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:19:04.679316 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-565b1393-1bda-45af-a3c8-b4a81db48e5a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:04.679743 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-565b1393-1bda-45af-a3c8-b4a81db48e5a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:04.680433 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-565b1393-1bda-45af-a3c8-b4a81db48e5a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:04.681158 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-565b1393-1bda-45af-a3c8-b4a81db48e5a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:04.681658 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-565b1393-1bda-45af-a3c8-b4a81db48e5a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:04.682096 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-565b1393-1bda-45af-a3c8-b4a81db48e5a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:04.712510 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-565b1393-1bda-45af-a3c8-b4a81db48e5a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051652 Aug 07 02:19:04.713067 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3796/7125] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 02:19:04 2022] GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 02:19:05.196885 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-efe3399a-dd11-471d-8412-c060cfbec547 req-b92903bd-4c37-4707-b446-2278b608f592 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cae4e1cc-b500-4658-b8d9-2b9b047b8d98", "tag": "0a3d9ab8-7535-4e11-94a4-668e3483ddc8"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:19:05.207638 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-efe3399a-dd11-471d-8412-c060cfbec547 req-b92903bd-4c37-4707-b446-2278b608f592 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:05.208162 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-efe3399a-dd11-471d-8412-c060cfbec547 req-b92903bd-4c37-4707-b446-2278b608f592 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:05.208589 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-efe3399a-dd11-471d-8412-c060cfbec547 req-b92903bd-4c37-4707-b446-2278b608f592 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:05.227670 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-efe3399a-dd11-471d-8412-c060cfbec547 req-b92903bd-4c37-4707-b446-2278b608f592 service nova] Creating event network-changed:0a3d9ab8-7535-4e11-94a4-668e3483ddc8 for instance cae4e1cc-b500-4658-b8d9-2b9b047b8d98 on n-h1-master-1 Aug 07 02:19:05.234976 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-efe3399a-dd11-471d-8412-c060cfbec547 req-b92903bd-4c37-4707-b446-2278b608f592 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042212 Aug 07 02:19:05.236089 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3330/7126] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:19:05.725918 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-09c94b0d-5e42-483c-aee6-e4016c6c67d1 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:19:05.728892 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-09c94b0d-5e42-483c-aee6-e4016c6c67d1 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:19:05.735986 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-09c94b0d-5e42-483c-aee6-e4016c6c67d1 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:05.736498 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-09c94b0d-5e42-483c-aee6-e4016c6c67d1 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:05.736964 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-09c94b0d-5e42-483c-aee6-e4016c6c67d1 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:05.737711 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-09c94b0d-5e42-483c-aee6-e4016c6c67d1 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:05.738219 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-09c94b0d-5e42-483c-aee6-e4016c6c67d1 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:05.738667 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-09c94b0d-5e42-483c-aee6-e4016c6c67d1 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:05.770275 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-09c94b0d-5e42-483c-aee6-e4016c6c67d1 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048320 Aug 07 02:19:05.770856 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3797/7127] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 02:19:05 2022] GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:19:06.783332 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c837106b-d7df-4ba4-add4-29b6d302b4ec tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:19:06.785753 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c837106b-d7df-4ba4-add4-29b6d302b4ec tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:19:06.793324 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c837106b-d7df-4ba4-add4-29b6d302b4ec tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:06.793810 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c837106b-d7df-4ba4-add4-29b6d302b4ec tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:06.794758 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c837106b-d7df-4ba4-add4-29b6d302b4ec tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:06.794950 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c837106b-d7df-4ba4-add4-29b6d302b4ec tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:06.795556 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c837106b-d7df-4ba4-add4-29b6d302b4ec tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:06.795818 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c837106b-d7df-4ba4-add4-29b6d302b4ec tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:06.828962 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c837106b-d7df-4ba4-add4-29b6d302b4ec tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049950 Aug 07 02:19:06.832285 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3331/7128] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 02:19:06 2022] GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:19:07.842035 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e3c41bbc-7050-4e36-ba1b-279c32fa69a7 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:19:07.844304 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e3c41bbc-7050-4e36-ba1b-279c32fa69a7 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:19:07.851274 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3c41bbc-7050-4e36-ba1b-279c32fa69a7 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:07.851781 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3c41bbc-7050-4e36-ba1b-279c32fa69a7 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:07.852264 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3c41bbc-7050-4e36-ba1b-279c32fa69a7 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:07.852991 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3c41bbc-7050-4e36-ba1b-279c32fa69a7 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:07.853470 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3c41bbc-7050-4e36-ba1b-279c32fa69a7 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:07.853919 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e3c41bbc-7050-4e36-ba1b-279c32fa69a7 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:07.882702 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e3c41bbc-7050-4e36-ba1b-279c32fa69a7 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045416 Aug 07 02:19:07.883263 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3798/7129] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 02:19:07 2022] GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:19:08.894787 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-34cfba90-697e-4983-833f-52342b5bb7eb tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:19:08.897145 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-34cfba90-697e-4983-833f-52342b5bb7eb tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:19:08.904519 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-34cfba90-697e-4983-833f-52342b5bb7eb tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:08.905009 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-34cfba90-697e-4983-833f-52342b5bb7eb tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:08.905453 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-34cfba90-697e-4983-833f-52342b5bb7eb tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:08.906169 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-34cfba90-697e-4983-833f-52342b5bb7eb tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:08.906668 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-34cfba90-697e-4983-833f-52342b5bb7eb tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:08.907091 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-34cfba90-697e-4983-833f-52342b5bb7eb tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:08.937474 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-34cfba90-697e-4983-833f-52342b5bb7eb tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046620 Aug 07 02:19:08.938038 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3332/7130] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 02:19:08 2022] GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:19:09.950734 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9397c151-2bf4-4e47-8ac6-1cb3fed8144c tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:19:09.952948 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9397c151-2bf4-4e47-8ac6-1cb3fed8144c tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:19:09.959854 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9397c151-2bf4-4e47-8ac6-1cb3fed8144c tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:09.960377 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9397c151-2bf4-4e47-8ac6-1cb3fed8144c tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:09.960828 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9397c151-2bf4-4e47-8ac6-1cb3fed8144c tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:09.961537 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9397c151-2bf4-4e47-8ac6-1cb3fed8144c tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:09.962004 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9397c151-2bf4-4e47-8ac6-1cb3fed8144c tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:09.962439 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9397c151-2bf4-4e47-8ac6-1cb3fed8144c tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:09.991822 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9397c151-2bf4-4e47-8ac6-1cb3fed8144c tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045874 Aug 07 02:19:09.992411 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3799/7131] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 02:19:09 2022] GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 02:19:10.003271 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9e95e9c9-0683-452a-821c-2ff73e4b28f6 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:19:10.003761 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9e95e9c9-0683-452a-821c-2ff73e4b28f6 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:19:10.010614 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9e95e9c9-0683-452a-821c-2ff73e4b28f6 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:10.011097 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9e95e9c9-0683-452a-821c-2ff73e4b28f6 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:10.011541 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9e95e9c9-0683-452a-821c-2ff73e4b28f6 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:10.012284 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9e95e9c9-0683-452a-821c-2ff73e4b28f6 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:10.012743 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9e95e9c9-0683-452a-821c-2ff73e4b28f6 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:10.013172 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9e95e9c9-0683-452a-821c-2ff73e4b28f6 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:10.086581 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-9e95e9c9-0683-452a-821c-2ff73e4b28f6 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] HTTP exception thrown: Instance cae4e1cc-b500-4658-b8d9-2b9b047b8d98 is not attached to volume 45751f3a-89bc-4553-9a61-da44b91a1a60 Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9e95e9c9-0683-452a-821c-2ff73e4b28f6 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Request method failure captured: Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: request: DELETE /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98/os-volume_attachments/45751f3a-89bc-4553-9a61-da44b91a1a60 HTTP/1.1 Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7yA22ObgCoLnCjuPTNeOG89H5ufONt4NEjukVDIpZ7u1N6fPl6AAkvyzX_MR2AW4f9B7JgpZc1-NxHLgvrZY9yPYiZJ4DrCd9QKAXuBYLT4SNsVOzfnlKShFdhLOYoVeBsPgkapPtiUzz677Z2XVxwR0C0FdgalU_DzRgHfa-0eceiw Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 1416397f45dc4abf94bb539540b5b61f Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-TestMinimumBasicScenario-1487476756 Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1416397f45dc4abf94bb539540b5b61f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1416397f45dc4abf94bb539540b5b61f", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1416397f45dc4abf94bb539540b5b61f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1416397f45dc4abf94bb539540b5b61f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-TestMinimumBasicScenario-1487476756 Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 1416397f45dc4abf94bb539540b5b61f Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1487476756 Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-TestMinimumBasicScenario-1487476756-project Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 965b3c62c5af4285a6d747d18274f18a Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-TestMinimumBasicScenario-1487476756-project Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: exception: Instance cae4e1cc-b500-4658-b8d9-2b9b047b8d98 is not attached to volume 45751f3a-89bc-4553-9a61-da44b91a1a60 Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: action_args: {'server_id': 'cae4e1cc-b500-4658-b8d9-2b9b047b8d98', 'id': '45751f3a-89bc-4553-9a61-da44b91a1a60'} Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 45751f3a-89bc-4553-9a61-da44b91a1a60. Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cae4e1cc-b500-4658-b8d9-2b9b047b8d98 is not attached to volume 45751f3a-89bc-4553-9a61-da44b91a1a60 Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:19:10.088444 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:19:10.092773 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:19:10.092773 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:19:10.092773 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cae4e1cc-b500-4658-b8d9-2b9b047b8d98 is not attached to volume 45751f3a-89bc-4553-9a61-da44b91a1a60 Aug 07 02:19:10.092773 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:19:10.092773 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9e95e9c9-0683-452a-821c-2ff73e4b28f6 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Returning 404 to user: Instance cae4e1cc-b500-4658-b8d9-2b9b047b8d98 is not attached to volume 45751f3a-89bc-4553-9a61-da44b91a1a60 {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:19:10.092773 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9e95e9c9-0683-452a-821c-2ff73e4b28f6 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "DELETE /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98/os-volume_attachments/45751f3a-89bc-4553-9a61-da44b91a1a60" status: 404 len: 154 microversion: 2.1 time: 0.090582 Aug 07 02:19:10.092773 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3333/7132] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Aug 7 02:19:09 2022] DELETE /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98/os-volume_attachments/45751f3a-89bc-4553-9a61-da44b91a1a60 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:19:13.333230 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3b15744c-68e4-4679-bb8f-6ceeb1799910 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:19:13.333751 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3b15744c-68e4-4679-bb8f-6ceeb1799910 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:19:13.341545 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b15744c-68e4-4679-bb8f-6ceeb1799910 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:13.342054 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b15744c-68e4-4679-bb8f-6ceeb1799910 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:13.342513 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b15744c-68e4-4679-bb8f-6ceeb1799910 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:13.343229 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b15744c-68e4-4679-bb8f-6ceeb1799910 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:13.343702 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b15744c-68e4-4679-bb8f-6ceeb1799910 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:13.344175 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3b15744c-68e4-4679-bb8f-6ceeb1799910 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:13.373317 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3b15744c-68e4-4679-bb8f-6ceeb1799910 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 02:19:13.467760 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3b15744c-68e4-4679-bb8f-6ceeb1799910 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "DELETE /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98" status: 204 len: 0 microversion: 2.1 time: 0.137587 Aug 07 02:19:13.469214 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3800/7133] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 02:19:13 2022] DELETE /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 02:19:13.478483 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b7dadd0e-997e-47c0-a403-4029d2cdd791 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:19:13.479119 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b7dadd0e-997e-47c0-a403-4029d2cdd791 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:19:13.486817 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b7dadd0e-997e-47c0-a403-4029d2cdd791 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:13.487247 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b7dadd0e-997e-47c0-a403-4029d2cdd791 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:13.487683 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b7dadd0e-997e-47c0-a403-4029d2cdd791 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:13.488408 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b7dadd0e-997e-47c0-a403-4029d2cdd791 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:13.488868 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b7dadd0e-997e-47c0-a403-4029d2cdd791 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:13.489298 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b7dadd0e-997e-47c0-a403-4029d2cdd791 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:13.621062 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b7dadd0e-997e-47c0-a403-4029d2cdd791 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:19:13.629255 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b7dadd0e-997e-47c0-a403-4029d2cdd791 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98" status: 200 len: 1554 microversion: 2.1 time: 0.155022 Aug 07 02:19:13.629820 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3334/7134] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:19:13 2022] GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:19:14.651183 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9530762f-8fef-4dea-a805-e1687b4004be tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:19:14.651929 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9530762f-8fef-4dea-a805-e1687b4004be tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:19:14.660286 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9530762f-8fef-4dea-a805-e1687b4004be tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:14.660736 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9530762f-8fef-4dea-a805-e1687b4004be tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:14.661194 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9530762f-8fef-4dea-a805-e1687b4004be tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:14.661920 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9530762f-8fef-4dea-a805-e1687b4004be tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:14.662397 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9530762f-8fef-4dea-a805-e1687b4004be tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:14.662845 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9530762f-8fef-4dea-a805-e1687b4004be tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:14.797297 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9530762f-8fef-4dea-a805-e1687b4004be tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:19:14.804975 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9530762f-8fef-4dea-a805-e1687b4004be tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98" status: 200 len: 1554 microversion: 2.1 time: 0.158079 Aug 07 02:19:14.805553 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3801/7135] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:19:14 2022] GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:19:15.616788 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-cbee6b3c-9151-4165-80cc-a287c0b1136b req-f9ed8e0c-c42a-460d-98e3-e4815f1b791d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cae4e1cc-b500-4658-b8d9-2b9b047b8d98", "name": "network-vif-deleted", "tag": "0a3d9ab8-7535-4e11-94a4-668e3483ddc8"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:19:15.627203 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-cbee6b3c-9151-4165-80cc-a287c0b1136b req-f9ed8e0c-c42a-460d-98e3-e4815f1b791d service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:15.627681 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-cbee6b3c-9151-4165-80cc-a287c0b1136b req-f9ed8e0c-c42a-460d-98e3-e4815f1b791d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:15.628135 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-cbee6b3c-9151-4165-80cc-a287c0b1136b req-f9ed8e0c-c42a-460d-98e3-e4815f1b791d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:15.642259 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-cbee6b3c-9151-4165-80cc-a287c0b1136b req-f9ed8e0c-c42a-460d-98e3-e4815f1b791d service nova] Creating event network-vif-deleted:0a3d9ab8-7535-4e11-94a4-668e3483ddc8 for instance cae4e1cc-b500-4658-b8d9-2b9b047b8d98 on n-h1-master-1 Aug 07 02:19:15.647189 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-cbee6b3c-9151-4165-80cc-a287c0b1136b req-f9ed8e0c-c42a-460d-98e3-e4815f1b791d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034143 Aug 07 02:19:15.647782 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3335/7136] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:19:15.827087 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9b58e710-1682-4280-b5f5-e63626b5bbfa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:19:15.827732 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9b58e710-1682-4280-b5f5-e63626b5bbfa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:19:15.834427 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b58e710-1682-4280-b5f5-e63626b5bbfa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:15.834873 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b58e710-1682-4280-b5f5-e63626b5bbfa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:15.835333 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b58e710-1682-4280-b5f5-e63626b5bbfa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:15.836092 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b58e710-1682-4280-b5f5-e63626b5bbfa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:15.836568 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b58e710-1682-4280-b5f5-e63626b5bbfa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:15.837019 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b58e710-1682-4280-b5f5-e63626b5bbfa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:15.867174 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b58e710-1682-4280-b5f5-e63626b5bbfa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:15.867669 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b58e710-1682-4280-b5f5-e63626b5bbfa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:15.868159 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9b58e710-1682-4280-b5f5-e63626b5bbfa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:15.868624 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-9b58e710-1682-4280-b5f5-e63626b5bbfa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lazy-loading 'fault' on Instance uuid cae4e1cc-b500-4658-b8d9-2b9b047b8d98 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 02:19:15.912699 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9b58e710-1682-4280-b5f5-e63626b5bbfa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:19:15.920657 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9b58e710-1682-4280-b5f5-e63626b5bbfa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98" status: 200 len: 1348 microversion: 2.1 time: 0.098527 Aug 07 02:19:15.921252 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3802/7137] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:19:15 2022] GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98 => generated 1348 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:19:16.942430 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fb10c475-b779-407b-9269-43f9eb64deda tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:19:16.943128 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fb10c475-b779-407b-9269-43f9eb64deda tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: cae4e1cc-b500-4658-b8d9-2b9b047b8d98] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:19:16.950178 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb10c475-b779-407b-9269-43f9eb64deda tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:16.950482 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb10c475-b779-407b-9269-43f9eb64deda tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:16.950947 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb10c475-b779-407b-9269-43f9eb64deda tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:16.951814 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb10c475-b779-407b-9269-43f9eb64deda tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:16.953325 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb10c475-b779-407b-9269-43f9eb64deda tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:16.953781 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fb10c475-b779-407b-9269-43f9eb64deda tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:16.969035 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-fb10c475-b779-407b-9269-43f9eb64deda tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] HTTP exception thrown: Instance cae4e1cc-b500-4658-b8d9-2b9b047b8d98 could not be found. Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fb10c475-b779-407b-9269-43f9eb64deda tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Request method failure captured: Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98 HTTP/1.1 Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7yA22ObgCoLnCjuPTNeOG89H5ufONt4NEjukVDIpZ7u1N6fPl6AAkvyzX_MR2AW4f9B7JgpZc1-NxHLgvrZY9yPYiZJ4DrCd9QKAXuBYLT4SNsVOzfnlKShFdhLOYoVeBsPgkapPtiUzz677Z2XVxwR0C0FdgalU_DzRgHfa-0eceiw Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 1416397f45dc4abf94bb539540b5b61f Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-TestMinimumBasicScenario-1487476756 Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1416397f45dc4abf94bb539540b5b61f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1416397f45dc4abf94bb539540b5b61f", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1416397f45dc4abf94bb539540b5b61f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1416397f45dc4abf94bb539540b5b61f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-TestMinimumBasicScenario-1487476756 Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 1416397f45dc4abf94bb539540b5b61f Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1487476756 Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-TestMinimumBasicScenario-1487476756-project Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 965b3c62c5af4285a6d747d18274f18a Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-TestMinimumBasicScenario-1487476756-project Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: exception: Instance cae4e1cc-b500-4658-b8d9-2b9b047b8d98 could not be found. Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': 'cae4e1cc-b500-4658-b8d9-2b9b047b8d98'} Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cae4e1cc-b500-4658-b8d9-2b9b047b8d98 could not be found. Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cae4e1cc-b500-4658-b8d9-2b9b047b8d98 could not be found. Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:19:16.970673 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:19:16.975175 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:19:16.975175 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:19:16.975175 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:19:16.975175 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:19:16.975175 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:19:16.975175 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cae4e1cc-b500-4658-b8d9-2b9b047b8d98 could not be found. Aug 07 02:19:16.975175 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:19:16.975175 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fb10c475-b779-407b-9269-43f9eb64deda tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Returning 404 to user: Instance cae4e1cc-b500-4658-b8d9-2b9b047b8d98 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:19:16.975175 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fb10c475-b779-407b-9269-43f9eb64deda tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98" status: 404 len: 111 microversion: 2.1 time: 0.034743 Aug 07 02:19:16.975175 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3336/7138] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:19:16 2022] GET /compute/v2.1/servers/cae4e1cc-b500-4658-b8d9-2b9b047b8d98 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:19:16.981038 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c202b04b-37da-4990-bde9-ce9f986298e0 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '.version_select at 0x7f9e24c13dc0>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:19:17.004716 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c202b04b-37da-4990-bde9-ce9f986298e0 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-865700933" status: 202 len: 0 microversion: 2.1 time: 0.027552 Aug 07 02:19:17.005307 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3803/7139] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Aug 7 02:19:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-865700933 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 02:19:25.854739 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cec8707d-12cd-46b2-bae6-0f5e2fff8ebe tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Action: 'create', calling method: .version_select at 0x7f9e24018310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1589225069", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBPScWTkGc8ylR+o2HwoE5WFfQ8jAh+B+5woenWLM1tqIXQ+bjC798ApnAOuH6wHH7lT2WwikgtUFZ7n57jU924J2m6Vuxy51Q8waE5MLl9tl5JJJjjlAEPuttYRMYrEw=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:19:25.871714 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-cec8707d-12cd-46b2-bae6-0f5e2fff8ebe tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Getting quotas for project 1416397f45dc4abf94bb539540b5b61f. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:19:25.877116 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-cec8707d-12cd-46b2-bae6-0f5e2fff8ebe tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Getting quotas for user 965b3c62c5af4285a6d747d18274f18a and project 1416397f45dc4abf94bb539540b5b61f. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:19:25.900538 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cec8707d-12cd-46b2-bae6-0f5e2fff8ebe tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.049796 Aug 07 02:19:25.901169 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3337/7140] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 02:19:25 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:19:25.947738 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:19:25.952825 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0eb91821-decb-478c-829f-7729f93d69a3 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-854589384", "imageRef": "775ee51d-a19f-4f6c-8737-fe4a2b291559", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1589225069", "networks": [{"uuid": "8e9d9930-eecb-4ad1-80a5-3b6ecda80e49"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:19:26.005092 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-0eb91821-decb-478c-829f-7729f93d69a3 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] validate_networks() for [('8e9d9930-eecb-4ad1-80a5-3b6ecda80e49', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 02:19:26.364039 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-0eb91821-decb-478c-829f-7729f93d69a3 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 02:19:26.364488 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-0eb91821-decb-478c-829f-7729f93d69a3 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 02:19:26.364988 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-0eb91821-decb-478c-829f-7729f93d69a3 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 02:19:26.365419 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-0eb91821-decb-478c-829f-7729f93d69a3 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 02:19:26.365852 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-0eb91821-decb-478c-829f-7729f93d69a3 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 02:19:26.375389 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0eb91821-decb-478c-829f-7729f93d69a3 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:26.375911 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0eb91821-decb-478c-829f-7729f93d69a3 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:26.376374 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0eb91821-decb-478c-829f-7729f93d69a3 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:26.377129 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0eb91821-decb-478c-829f-7729f93d69a3 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:26.377608 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0eb91821-decb-478c-829f-7729f93d69a3 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:26.378062 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0eb91821-decb-478c-829f-7729f93d69a3 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:26.395279 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-0eb91821-decb-478c-829f-7729f93d69a3 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Getting quotas for project 1416397f45dc4abf94bb539540b5b61f. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:19:26.400669 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-0eb91821-decb-478c-829f-7729f93d69a3 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Getting quotas for user 965b3c62c5af4285a6d747d18274f18a and project 1416397f45dc4abf94bb539540b5b61f. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:19:26.413112 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0eb91821-decb-478c-829f-7729f93d69a3 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 02:19:26.415309 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0eb91821-decb-478c-829f-7729f93d69a3 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='775ee51d-a19f-4f6c-8737-fe4a2b291559',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 02:19:26.460913 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0eb91821-decb-478c-829f-7729f93d69a3 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.515007 Aug 07 02:19:26.461598 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3804/7141] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 02:19:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 02:19:26.473424 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ea48ec7b-fbb1-4ae2-966f-c204611da598 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:19:26.474325 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ea48ec7b-fbb1-4ae2-966f-c204611da598 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:19:26.531865 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ea48ec7b-fbb1-4ae2-966f-c204611da598 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:19:26.538637 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ea48ec7b-fbb1-4ae2-966f-c204611da598 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 200 len: 1258 microversion: 2.1 time: 0.069997 Aug 07 02:19:26.539197 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3338/7142] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:19:26 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:19:27.559400 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bfadd137-2e01-42d1-9aca-f78a54c83f85 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:19:27.560699 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bfadd137-2e01-42d1-9aca-f78a54c83f85 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:19:27.613918 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bfadd137-2e01-42d1-9aca-f78a54c83f85 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:19:27.620711 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bfadd137-2e01-42d1-9aca-f78a54c83f85 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 200 len: 1258 microversion: 2.1 time: 0.065982 Aug 07 02:19:27.621274 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3805/7143] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:19:27 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:19:28.641965 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e75dfc85-a4c9-417c-b289-e77ca54f8d00 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:19:28.642477 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e75dfc85-a4c9-417c-b289-e77ca54f8d00 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:19:28.645256 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:19:28.698911 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e75dfc85-a4c9-417c-b289-e77ca54f8d00 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:19:28.706510 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e75dfc85-a4c9-417c-b289-e77ca54f8d00 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 200 len: 1258 microversion: 2.1 time: 0.069179 Aug 07 02:19:28.707065 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3339/7144] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:19:28 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:19:29.726717 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e1c54a2a-6385-4f75-88fb-57e7024dfc46 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:19:29.727349 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e1c54a2a-6385-4f75-88fb-57e7024dfc46 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:19:29.780424 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e1c54a2a-6385-4f75-88fb-57e7024dfc46 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:19:29.787832 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e1c54a2a-6385-4f75-88fb-57e7024dfc46 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 200 len: 1258 microversion: 2.1 time: 0.064955 Aug 07 02:19:29.788645 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3806/7145] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:19:29 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 1258 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:19:30.809714 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f1fcd0c6-4be2-4afc-ad11-1705edc2efe3 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:19:30.810295 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f1fcd0c6-4be2-4afc-ad11-1705edc2efe3 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:19:30.817234 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1fcd0c6-4be2-4afc-ad11-1705edc2efe3 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:30.817730 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1fcd0c6-4be2-4afc-ad11-1705edc2efe3 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:30.818173 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1fcd0c6-4be2-4afc-ad11-1705edc2efe3 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:30.818879 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1fcd0c6-4be2-4afc-ad11-1705edc2efe3 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:30.819339 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1fcd0c6-4be2-4afc-ad11-1705edc2efe3 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:30.819775 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f1fcd0c6-4be2-4afc-ad11-1705edc2efe3 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:30.881197 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f1fcd0c6-4be2-4afc-ad11-1705edc2efe3 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:19:30.888726 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f1fcd0c6-4be2-4afc-ad11-1705edc2efe3 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 200 len: 1262 microversion: 2.1 time: 0.083016 Aug 07 02:19:30.889513 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3340/7146] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:19:30 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:19:31.908812 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-399af5a2-d77e-44ef-b528-bf3a660268b0 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:19:31.909502 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-399af5a2-d77e-44ef-b528-bf3a660268b0 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:19:31.917409 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-399af5a2-d77e-44ef-b528-bf3a660268b0 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:31.917924 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-399af5a2-d77e-44ef-b528-bf3a660268b0 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:31.918383 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-399af5a2-d77e-44ef-b528-bf3a660268b0 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:31.919118 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-399af5a2-d77e-44ef-b528-bf3a660268b0 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:31.920147 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-399af5a2-d77e-44ef-b528-bf3a660268b0 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:31.920677 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-399af5a2-d77e-44ef-b528-bf3a660268b0 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:32.006326 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-399af5a2-d77e-44ef-b528-bf3a660268b0 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:19:32.016173 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-399af5a2-d77e-44ef-b528-bf3a660268b0 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 200 len: 1316 microversion: 2.1 time: 0.111310 Aug 07 02:19:32.017203 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3807/7147] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:19:31 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 1316 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:19:33.036592 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-47f216a9-a225-4f88-89c6-16a277e72a7c tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:19:33.037213 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-47f216a9-a225-4f88-89c6-16a277e72a7c tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:19:33.039401 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:19:33.045394 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-47f216a9-a225-4f88-89c6-16a277e72a7c tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:33.045879 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-47f216a9-a225-4f88-89c6-16a277e72a7c tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:33.046320 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-47f216a9-a225-4f88-89c6-16a277e72a7c tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:33.047021 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-47f216a9-a225-4f88-89c6-16a277e72a7c tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:33.047538 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-47f216a9-a225-4f88-89c6-16a277e72a7c tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:33.047928 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-47f216a9-a225-4f88-89c6-16a277e72a7c tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:33.201665 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-47f216a9-a225-4f88-89c6-16a277e72a7c tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:19:33.218397 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-47f216a9-a225-4f88-89c6-16a277e72a7c tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 200 len: 1358 microversion: 2.1 time: 0.185600 Aug 07 02:19:33.219296 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3341/7148] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:19:33 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:19:34.241860 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6eb3584c-c0bf-4236-8032-d0b8c5741e37 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:19:34.243171 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6eb3584c-c0bf-4236-8032-d0b8c5741e37 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:19:34.252933 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:19:34.255047 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6eb3584c-c0bf-4236-8032-d0b8c5741e37 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:34.256076 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6eb3584c-c0bf-4236-8032-d0b8c5741e37 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:34.256867 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6eb3584c-c0bf-4236-8032-d0b8c5741e37 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:34.257822 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6eb3584c-c0bf-4236-8032-d0b8c5741e37 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:34.258303 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6eb3584c-c0bf-4236-8032-d0b8c5741e37 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:34.258995 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6eb3584c-c0bf-4236-8032-d0b8c5741e37 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:34.408950 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6eb3584c-c0bf-4236-8032-d0b8c5741e37 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:19:34.416825 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6eb3584c-c0bf-4236-8032-d0b8c5741e37 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 200 len: 1358 microversion: 2.1 time: 0.181188 Aug 07 02:19:34.420152 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3808/7149] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:19:34 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:19:35.438836 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7cf29b31-2291-4c58-8e50-9fef44f5b665 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:19:35.439447 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7cf29b31-2291-4c58-8e50-9fef44f5b665 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:19:35.446606 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7cf29b31-2291-4c58-8e50-9fef44f5b665 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:35.447098 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7cf29b31-2291-4c58-8e50-9fef44f5b665 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:35.447540 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7cf29b31-2291-4c58-8e50-9fef44f5b665 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:35.448282 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7cf29b31-2291-4c58-8e50-9fef44f5b665 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:35.448741 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7cf29b31-2291-4c58-8e50-9fef44f5b665 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:35.449184 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7cf29b31-2291-4c58-8e50-9fef44f5b665 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:35.615841 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7cf29b31-2291-4c58-8e50-9fef44f5b665 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:19:35.624041 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7cf29b31-2291-4c58-8e50-9fef44f5b665 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 200 len: 1358 microversion: 2.1 time: 0.189601 Aug 07 02:19:35.624619 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3342/7150] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:19:35 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:19:36.646174 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8823476e-dae9-468d-ade3-abcc11fd7c1a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:19:36.646797 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8823476e-dae9-468d-ade3-abcc11fd7c1a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:19:36.653509 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:19:36.656617 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8823476e-dae9-468d-ade3-abcc11fd7c1a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:36.657157 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8823476e-dae9-468d-ade3-abcc11fd7c1a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:36.657639 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8823476e-dae9-468d-ade3-abcc11fd7c1a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:36.658412 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8823476e-dae9-468d-ade3-abcc11fd7c1a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:36.658913 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8823476e-dae9-468d-ade3-abcc11fd7c1a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:36.659363 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8823476e-dae9-468d-ade3-abcc11fd7c1a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:36.803801 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8823476e-dae9-468d-ade3-abcc11fd7c1a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:19:36.812265 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8823476e-dae9-468d-ade3-abcc11fd7c1a tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 200 len: 1358 microversion: 2.1 time: 0.171050 Aug 07 02:19:36.812855 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3809/7151] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:19:36 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:19:37.833149 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c486c77a-8c94-4dab-988a-70ec1988de70 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:19:37.833797 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c486c77a-8c94-4dab-988a-70ec1988de70 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:19:37.841054 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c486c77a-8c94-4dab-988a-70ec1988de70 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:37.841894 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c486c77a-8c94-4dab-988a-70ec1988de70 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:37.842337 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c486c77a-8c94-4dab-988a-70ec1988de70 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:37.843145 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c486c77a-8c94-4dab-988a-70ec1988de70 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:37.843638 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c486c77a-8c94-4dab-988a-70ec1988de70 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:37.844105 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c486c77a-8c94-4dab-988a-70ec1988de70 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:38.279967 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c486c77a-8c94-4dab-988a-70ec1988de70 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:19:38.288007 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c486c77a-8c94-4dab-988a-70ec1988de70 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 200 len: 1358 microversion: 2.1 time: 0.458728 Aug 07 02:19:38.289045 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3343/7152] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:19:37 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 1358 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:19:39.311142 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-510b4b8e-6311-4160-8f92-f3619bca7a2e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:19:39.311722 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-510b4b8e-6311-4160-8f92-f3619bca7a2e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:19:39.318668 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-510b4b8e-6311-4160-8f92-f3619bca7a2e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:39.319181 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-510b4b8e-6311-4160-8f92-f3619bca7a2e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:39.319645 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-510b4b8e-6311-4160-8f92-f3619bca7a2e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:39.320473 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-510b4b8e-6311-4160-8f92-f3619bca7a2e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:39.320954 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-510b4b8e-6311-4160-8f92-f3619bca7a2e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:39.321405 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-510b4b8e-6311-4160-8f92-f3619bca7a2e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:39.452906 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-510b4b8e-6311-4160-8f92-f3619bca7a2e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:19:39.461326 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-510b4b8e-6311-4160-8f92-f3619bca7a2e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 200 len: 1358 microversion: 2.1 time: 0.155212 Aug 07 02:19:39.461942 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3810/7153] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:19:39 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:19:40.482543 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a4f21a62-d7be-495e-9564-3e0062daaa19 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:19:40.483250 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a4f21a62-d7be-495e-9564-3e0062daaa19 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:19:40.485826 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=8 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:19:40.492285 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4f21a62-d7be-495e-9564-3e0062daaa19 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:40.492788 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4f21a62-d7be-495e-9564-3e0062daaa19 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:40.493229 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4f21a62-d7be-495e-9564-3e0062daaa19 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:40.493935 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4f21a62-d7be-495e-9564-3e0062daaa19 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:40.494395 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4f21a62-d7be-495e-9564-3e0062daaa19 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:40.494826 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a4f21a62-d7be-495e-9564-3e0062daaa19 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:40.635559 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-c282c537-d557-4323-89e1-db8b38a8f405 req-b533a533-4bc3-42ef-bab7-3a59c1b603d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10d52cd5-76ef-4aa1-b0da-0e17f616c2ad", "tag": "101f67d8-68ed-46b4-a048-56757e643fa8"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:19:40.642259 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=10 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:19:40.650369 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c282c537-d557-4323-89e1-db8b38a8f405 req-b533a533-4bc3-42ef-bab7-3a59c1b603d4 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:40.651141 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c282c537-d557-4323-89e1-db8b38a8f405 req-b533a533-4bc3-42ef-bab7-3a59c1b603d4 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:40.651605 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c282c537-d557-4323-89e1-db8b38a8f405 req-b533a533-4bc3-42ef-bab7-3a59c1b603d4 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:40.663377 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-c282c537-d557-4323-89e1-db8b38a8f405 req-b533a533-4bc3-42ef-bab7-3a59c1b603d4 service nova] Creating event network-changed:101f67d8-68ed-46b4-a048-56757e643fa8 for instance 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad on n-h1-master-1 Aug 07 02:19:40.668383 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-c282c537-d557-4323-89e1-db8b38a8f405 req-b533a533-4bc3-42ef-bab7-3a59c1b603d4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037501 Aug 07 02:19:40.668986 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3811/7154] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 02:19:40.701453 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a4f21a62-d7be-495e-9564-3e0062daaa19 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:19:40.709849 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a4f21a62-d7be-495e-9564-3e0062daaa19 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 200 len: 1358 microversion: 2.1 time: 0.231137 Aug 07 02:19:40.710639 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3344/7155] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:19:40 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 1358 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:19:41.731295 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1e0c7718-d4b8-4186-9d22-6ede63b17086 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:19:41.732067 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1e0c7718-d4b8-4186-9d22-6ede63b17086 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:19:41.739161 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1e0c7718-d4b8-4186-9d22-6ede63b17086 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:41.739665 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1e0c7718-d4b8-4186-9d22-6ede63b17086 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:41.740159 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1e0c7718-d4b8-4186-9d22-6ede63b17086 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:41.740880 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1e0c7718-d4b8-4186-9d22-6ede63b17086 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:41.741360 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1e0c7718-d4b8-4186-9d22-6ede63b17086 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:41.741804 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1e0c7718-d4b8-4186-9d22-6ede63b17086 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:41.870227 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1e0c7718-d4b8-4186-9d22-6ede63b17086 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:19:41.878158 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1e0c7718-d4b8-4186-9d22-6ede63b17086 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 200 len: 1358 microversion: 2.1 time: 0.151262 Aug 07 02:19:41.878730 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3812/7156] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:19:41 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:19:42.899640 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3b87fcdc-811e-47b8-88d1-78b8f564385f tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:19:42.900299 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3b87fcdc-811e-47b8-88d1-78b8f564385f tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:19:42.907279 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b87fcdc-811e-47b8-88d1-78b8f564385f tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:42.907680 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b87fcdc-811e-47b8-88d1-78b8f564385f tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:42.908148 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b87fcdc-811e-47b8-88d1-78b8f564385f tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:42.908887 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b87fcdc-811e-47b8-88d1-78b8f564385f tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:42.909528 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b87fcdc-811e-47b8-88d1-78b8f564385f tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:42.909963 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b87fcdc-811e-47b8-88d1-78b8f564385f tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:43.040618 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3b87fcdc-811e-47b8-88d1-78b8f564385f tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:19:43.049825 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3b87fcdc-811e-47b8-88d1-78b8f564385f tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 200 len: 1358 microversion: 2.1 time: 0.154119 Aug 07 02:19:43.050624 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3345/7157] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:19:42 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:19:44.071395 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fc154dbb-bcfc-4255-a788-fa0be3f0209b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:19:44.071981 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fc154dbb-bcfc-4255-a788-fa0be3f0209b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:19:44.079711 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc154dbb-bcfc-4255-a788-fa0be3f0209b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:44.080246 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc154dbb-bcfc-4255-a788-fa0be3f0209b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:44.080726 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc154dbb-bcfc-4255-a788-fa0be3f0209b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:44.081442 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc154dbb-bcfc-4255-a788-fa0be3f0209b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:44.081918 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc154dbb-bcfc-4255-a788-fa0be3f0209b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:44.082365 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fc154dbb-bcfc-4255-a788-fa0be3f0209b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:44.221404 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fc154dbb-bcfc-4255-a788-fa0be3f0209b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:19:44.229009 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fc154dbb-bcfc-4255-a788-fa0be3f0209b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 200 len: 1358 microversion: 2.1 time: 0.161602 Aug 07 02:19:44.229602 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3813/7158] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:19:44 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:19:45.249920 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1967d587-7c6f-4a81-bda7-5392dfab5bdc tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:19:45.250464 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1967d587-7c6f-4a81-bda7-5392dfab5bdc tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:19:45.257266 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1967d587-7c6f-4a81-bda7-5392dfab5bdc tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:45.257749 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1967d587-7c6f-4a81-bda7-5392dfab5bdc tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:45.258186 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1967d587-7c6f-4a81-bda7-5392dfab5bdc tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:45.258878 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1967d587-7c6f-4a81-bda7-5392dfab5bdc tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:45.259334 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1967d587-7c6f-4a81-bda7-5392dfab5bdc tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:45.259762 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1967d587-7c6f-4a81-bda7-5392dfab5bdc tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:45.391025 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1967d587-7c6f-4a81-bda7-5392dfab5bdc tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:19:45.398484 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1967d587-7c6f-4a81-bda7-5392dfab5bdc tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 200 len: 1358 microversion: 2.1 time: 0.152603 Aug 07 02:19:45.399050 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3346/7159] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:19:45 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:19:46.361387 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-9038be98-e31f-4567-bdc7-33ef9cdf3ad8 req-d66325d8-3a93-4eba-8e29-6005538e8504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10d52cd5-76ef-4aa1-b0da-0e17f616c2ad", "name": "network-vif-plugged", "status": "completed", "tag": "101f67d8-68ed-46b4-a048-56757e643fa8"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:19:46.372011 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-9038be98-e31f-4567-bdc7-33ef9cdf3ad8 req-d66325d8-3a93-4eba-8e29-6005538e8504 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:46.372512 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-9038be98-e31f-4567-bdc7-33ef9cdf3ad8 req-d66325d8-3a93-4eba-8e29-6005538e8504 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:46.373001 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-9038be98-e31f-4567-bdc7-33ef9cdf3ad8 req-d66325d8-3a93-4eba-8e29-6005538e8504 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:46.383985 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-9038be98-e31f-4567-bdc7-33ef9cdf3ad8 req-d66325d8-3a93-4eba-8e29-6005538e8504 service nova] Creating event network-vif-plugged:101f67d8-68ed-46b4-a048-56757e643fa8 for instance 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad on n-h1-master-1 Aug 07 02:19:46.389081 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-9038be98-e31f-4567-bdc7-33ef9cdf3ad8 req-d66325d8-3a93-4eba-8e29-6005538e8504 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103984 Aug 07 02:19:46.389599 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3814/7160] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:19:46.419563 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f421cf1c-5868-4ade-b3ab-7f0027487de0 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:19:46.420945 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f421cf1c-5868-4ade-b3ab-7f0027487de0 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:19:46.428433 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f421cf1c-5868-4ade-b3ab-7f0027487de0 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:46.428914 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f421cf1c-5868-4ade-b3ab-7f0027487de0 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:46.429355 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f421cf1c-5868-4ade-b3ab-7f0027487de0 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:46.430067 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f421cf1c-5868-4ade-b3ab-7f0027487de0 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:46.430520 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f421cf1c-5868-4ade-b3ab-7f0027487de0 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:46.430947 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f421cf1c-5868-4ade-b3ab-7f0027487de0 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:46.626251 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f421cf1c-5868-4ade-b3ab-7f0027487de0 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:19:46.633761 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f421cf1c-5868-4ade-b3ab-7f0027487de0 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 200 len: 1358 microversion: 2.1 time: 0.217993 Aug 07 02:19:46.634345 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3347/7161] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:19:46 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:19:47.655566 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-554a8471-18b4-4863-be6b-b7e7f58660ed tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:19:47.656225 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-554a8471-18b4-4863-be6b-b7e7f58660ed tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:19:47.662451 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-554a8471-18b4-4863-be6b-b7e7f58660ed tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:47.662946 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-554a8471-18b4-4863-be6b-b7e7f58660ed tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:47.663397 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-554a8471-18b4-4863-be6b-b7e7f58660ed tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:47.664140 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-554a8471-18b4-4863-be6b-b7e7f58660ed tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:47.664612 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-554a8471-18b4-4863-be6b-b7e7f58660ed tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:47.665054 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-554a8471-18b4-4863-be6b-b7e7f58660ed tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:47.802373 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-554a8471-18b4-4863-be6b-b7e7f58660ed tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:19:47.809942 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-554a8471-18b4-4863-be6b-b7e7f58660ed tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 200 len: 1548 microversion: 2.1 time: 0.159656 Aug 07 02:19:47.811158 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3815/7162] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:19:47 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:19:47.830786 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3c87c3e9-de9c-4c07-a099-e30e30450d45 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:19:47.831404 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3c87c3e9-de9c-4c07-a099-e30e30450d45 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:19:47.838354 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c87c3e9-de9c-4c07-a099-e30e30450d45 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:47.838834 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c87c3e9-de9c-4c07-a099-e30e30450d45 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:47.839271 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c87c3e9-de9c-4c07-a099-e30e30450d45 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:47.839992 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c87c3e9-de9c-4c07-a099-e30e30450d45 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:47.840448 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c87c3e9-de9c-4c07-a099-e30e30450d45 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:47.840878 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3c87c3e9-de9c-4c07-a099-e30e30450d45 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:47.972949 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3c87c3e9-de9c-4c07-a099-e30e30450d45 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:19:47.980727 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3c87c3e9-de9c-4c07-a099-e30e30450d45 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 200 len: 1548 microversion: 2.1 time: 0.153793 Aug 07 02:19:47.981303 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3348/7163] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:19:47 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:19:48.001022 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-476d78bd-ca8e-4ad8-a5c3-279ca66f6e51 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:19:48.005801 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-476d78bd-ca8e-4ad8-a5c3-279ca66f6e51 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:19:48.006599 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-476d78bd-ca8e-4ad8-a5c3-279ca66f6e51 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Searching by: {'deleted': False, 'project_id': '1416397f45dc4abf94bb539540b5b61f'} {{(pid=119516) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 02:19:48.012024 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-476d78bd-ca8e-4ad8-a5c3-279ca66f6e51 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:48.012526 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-476d78bd-ca8e-4ad8-a5c3-279ca66f6e51 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:48.012982 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-476d78bd-ca8e-4ad8-a5c3-279ca66f6e51 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:48.013733 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-476d78bd-ca8e-4ad8-a5c3-279ca66f6e51 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:48.014205 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-476d78bd-ca8e-4ad8-a5c3-279ca66f6e51 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:48.014653 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-476d78bd-ca8e-4ad8-a5c3-279ca66f6e51 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:48.038838 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.multi_cell_list [None req-476d78bd-ca8e-4ad8-a5c3-279ca66f6e51 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119516) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 02:19:48.065705 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-476d78bd-ca8e-4ad8-a5c3-279ca66f6e51 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.068527 Aug 07 02:19:48.066293 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3816/7164] 10.222.0.39 () {58 vars in 1125 bytes} [Sun Aug 7 02:19:47 2022] GET /compute/v2.1/servers => generated 342 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:19:48.077903 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2e47a038-e185-44e7-b559-3aaa0082b1ee tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:19:48.078539 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2e47a038-e185-44e7-b559-3aaa0082b1ee tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:19:48.084472 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2e47a038-e185-44e7-b559-3aaa0082b1ee tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:48.084948 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2e47a038-e185-44e7-b559-3aaa0082b1ee tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:48.085383 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2e47a038-e185-44e7-b559-3aaa0082b1ee tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:48.086076 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2e47a038-e185-44e7-b559-3aaa0082b1ee tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:48.086529 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2e47a038-e185-44e7-b559-3aaa0082b1ee tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:48.086948 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2e47a038-e185-44e7-b559-3aaa0082b1ee tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:48.213872 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2e47a038-e185-44e7-b559-3aaa0082b1ee tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:19:48.222164 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2e47a038-e185-44e7-b559-3aaa0082b1ee tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 200 len: 1548 microversion: 2.1 time: 0.148350 Aug 07 02:19:48.222742 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3349/7165] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:19:48 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:19:49.885833 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-869a03fa-adb2-4ce2-a406-2d02fac658a7 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81b8043e-2dd0-45fc-8c28-6a7d7402ec5a"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:19:49.888308 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-869a03fa-adb2-4ce2-a406-2d02fac658a7 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:19:49.894995 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-869a03fa-adb2-4ce2-a406-2d02fac658a7 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:49.895492 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-869a03fa-adb2-4ce2-a406-2d02fac658a7 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:49.895972 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-869a03fa-adb2-4ce2-a406-2d02fac658a7 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:49.896749 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-869a03fa-adb2-4ce2-a406-2d02fac658a7 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:19:49.897224 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-869a03fa-adb2-4ce2-a406-2d02fac658a7 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:19:49.897667 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-869a03fa-adb2-4ce2-a406-2d02fac658a7 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:19:50.152829 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-869a03fa-adb2-4ce2-a406-2d02fac658a7 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "POST /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270861 Aug 07 02:19:50.153466 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3817/7166] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Aug 7 02:19:49 2022] POST /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:20:00.895988 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5f6fd90d-4ddb-47fa-bb63-afe3b4f27ab9 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:20:00.896605 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5f6fd90d-4ddb-47fa-bb63-afe3b4f27ab9 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:20:00.899588 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=17 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:20:00.900327 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=60 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:20:00.907052 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f6fd90d-4ddb-47fa-bb63-afe3b4f27ab9 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:20:00.907539 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f6fd90d-4ddb-47fa-bb63-afe3b4f27ab9 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:20:00.908017 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f6fd90d-4ddb-47fa-bb63-afe3b4f27ab9 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:20:00.908724 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f6fd90d-4ddb-47fa-bb63-afe3b4f27ab9 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:20:00.909178 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f6fd90d-4ddb-47fa-bb63-afe3b4f27ab9 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:20:00.909609 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5f6fd90d-4ddb-47fa-bb63-afe3b4f27ab9 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:20:01.043021 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5f6fd90d-4ddb-47fa-bb63-afe3b4f27ab9 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:20:01.053017 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5f6fd90d-4ddb-47fa-bb63-afe3b4f27ab9 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 200 len: 1594 microversion: 2.1 time: 0.160663 Aug 07 02:20:01.054022 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3350/7167] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:20:00 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 1594 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:20:02.640767 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-b5ff5e52-c539-48b9-b26a-9f9271016da7 req-a0e02772-b47f-4ba0-98d3-1f1f231261bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10d52cd5-76ef-4aa1-b0da-0e17f616c2ad", "tag": "101f67d8-68ed-46b4-a048-56757e643fa8"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:20:02.648081 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:20:02.649298 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=19 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:20:02.650277 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:20:02.655802 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b5ff5e52-c539-48b9-b26a-9f9271016da7 req-a0e02772-b47f-4ba0-98d3-1f1f231261bd service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:20:02.656477 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b5ff5e52-c539-48b9-b26a-9f9271016da7 req-a0e02772-b47f-4ba0-98d3-1f1f231261bd service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:20:02.656975 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b5ff5e52-c539-48b9-b26a-9f9271016da7 req-a0e02772-b47f-4ba0-98d3-1f1f231261bd service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:20:02.672344 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-b5ff5e52-c539-48b9-b26a-9f9271016da7 req-a0e02772-b47f-4ba0-98d3-1f1f231261bd service nova] Creating event network-changed:101f67d8-68ed-46b4-a048-56757e643fa8 for instance 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad on n-h1-master-1 Aug 07 02:20:02.677740 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-b5ff5e52-c539-48b9-b26a-9f9271016da7 req-a0e02772-b47f-4ba0-98d3-1f1f231261bd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041046 Aug 07 02:20:02.678699 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3818/7168] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:20:03.776781 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8d6021e2-92af-45fd-bdbb-6767cbd874fa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-59367845"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:20:03.777473 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8d6021e2-92af-45fd-bdbb-6767cbd874fa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:20:03.783703 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8d6021e2-92af-45fd-bdbb-6767cbd874fa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:20:03.784222 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8d6021e2-92af-45fd-bdbb-6767cbd874fa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:20:03.784660 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8d6021e2-92af-45fd-bdbb-6767cbd874fa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:20:03.785381 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8d6021e2-92af-45fd-bdbb-6767cbd874fa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:20:03.785828 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8d6021e2-92af-45fd-bdbb-6767cbd874fa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:20:03.786252 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8d6021e2-92af-45fd-bdbb-6767cbd874fa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:20:03.913814 n-d-master-1 devstack@n-api.service[119517]: INFO nova.network.security_group_api [None req-8d6021e2-92af-45fd-bdbb-6767cbd874fa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Adding security group dad47baf-44e6-4949-a89d-80e50118ddf4 to port 101f67d8-68ed-46b4-a048-56757e643fa8 Aug 07 02:20:04.504458 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8d6021e2-92af-45fd-bdbb-6767cbd874fa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "POST /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad/action" status: 202 len: 0 microversion: 2.1 time: 0.732205 Aug 07 02:20:04.505100 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3351/7169] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:20:03 2022] POST /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad/action => generated 0 bytes in 734 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:20:04.515756 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2fef8157-7564-46ad-b3a9-2b9838cde55e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:20:04.516616 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2fef8157-7564-46ad-b3a9-2b9838cde55e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:20:04.523157 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2fef8157-7564-46ad-b3a9-2b9838cde55e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:20:04.523649 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2fef8157-7564-46ad-b3a9-2b9838cde55e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:20:04.524124 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2fef8157-7564-46ad-b3a9-2b9838cde55e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:20:04.524834 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2fef8157-7564-46ad-b3a9-2b9838cde55e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:20:04.526234 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2fef8157-7564-46ad-b3a9-2b9838cde55e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:20:04.526688 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2fef8157-7564-46ad-b3a9-2b9838cde55e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:20:04.674112 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2fef8157-7564-46ad-b3a9-2b9838cde55e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:20:04.682355 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2fef8157-7564-46ad-b3a9-2b9838cde55e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 200 len: 1757 microversion: 2.1 time: 0.172656 Aug 07 02:20:04.683519 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3819/7170] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:20:04 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:20:04.702125 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-d2b0e9bb-68a8-48ae-8c86-7c8c40884f02 req-03e6b05c-a555-4e90-96b0-4479eb096251 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10d52cd5-76ef-4aa1-b0da-0e17f616c2ad", "tag": "101f67d8-68ed-46b4-a048-56757e643fa8"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:20:04.714141 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d2b0e9bb-68a8-48ae-8c86-7c8c40884f02 req-03e6b05c-a555-4e90-96b0-4479eb096251 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:20:04.714667 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d2b0e9bb-68a8-48ae-8c86-7c8c40884f02 req-03e6b05c-a555-4e90-96b0-4479eb096251 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:20:04.715172 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d2b0e9bb-68a8-48ae-8c86-7c8c40884f02 req-03e6b05c-a555-4e90-96b0-4479eb096251 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:20:04.726724 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-d2b0e9bb-68a8-48ae-8c86-7c8c40884f02 req-03e6b05c-a555-4e90-96b0-4479eb096251 service nova] Creating event network-changed:101f67d8-68ed-46b4-a048-56757e643fa8 for instance 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad on n-h1-master-1 Aug 07 02:20:04.731933 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-d2b0e9bb-68a8-48ae-8c86-7c8c40884f02 req-03e6b05c-a555-4e90-96b0-4479eb096251 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041734 Aug 07 02:20:04.732535 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3352/7171] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:20:21.743335 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3eab30b9-b9f9-4e9a-b4a5-48dfb6d5689b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:20:21.745648 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3eab30b9-b9f9-4e9a-b4a5-48dfb6d5689b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:20:21.748227 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=4 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:20:21.749036 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=8 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:20:21.755078 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3eab30b9-b9f9-4e9a-b4a5-48dfb6d5689b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:20:21.755583 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3eab30b9-b9f9-4e9a-b4a5-48dfb6d5689b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:20:21.756076 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3eab30b9-b9f9-4e9a-b4a5-48dfb6d5689b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:20:21.756802 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3eab30b9-b9f9-4e9a-b4a5-48dfb6d5689b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:20:21.757276 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3eab30b9-b9f9-4e9a-b4a5-48dfb6d5689b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:20:21.757725 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3eab30b9-b9f9-4e9a-b4a5-48dfb6d5689b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:20:21.830243 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3eab30b9-b9f9-4e9a-b4a5-48dfb6d5689b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "POST /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad/action" status: 202 len: 0 microversion: 2.1 time: 0.090910 Aug 07 02:20:21.830879 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3820/7172] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:20:21 2022] POST /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:20:21.837548 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:20:21.838304 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=12 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:20:21.842383 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9905f408-cdaf-492e-859a-ff537af6e0aa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:20:21.843089 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9905f408-cdaf-492e-859a-ff537af6e0aa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:20:21.850675 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9905f408-cdaf-492e-859a-ff537af6e0aa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:20:21.851147 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9905f408-cdaf-492e-859a-ff537af6e0aa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:20:21.851670 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9905f408-cdaf-492e-859a-ff537af6e0aa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:20:21.852419 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9905f408-cdaf-492e-859a-ff537af6e0aa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:20:21.852876 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9905f408-cdaf-492e-859a-ff537af6e0aa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:20:21.853306 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9905f408-cdaf-492e-859a-ff537af6e0aa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:20:22.080304 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9905f408-cdaf-492e-859a-ff537af6e0aa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:20:22.088396 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9905f408-cdaf-492e-859a-ff537af6e0aa tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 200 len: 1749 microversion: 2.1 time: 0.253030 Aug 07 02:20:22.088966 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3353/7173] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:20:21 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 1749 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:20:23.157198 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-50170e04-2ef0-431a-89a5-71ada16bfd1c tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:20:23.157925 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-50170e04-2ef0-431a-89a5-71ada16bfd1c tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:20:23.164173 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-50170e04-2ef0-431a-89a5-71ada16bfd1c tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:20:23.164676 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-50170e04-2ef0-431a-89a5-71ada16bfd1c tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:20:23.165130 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-50170e04-2ef0-431a-89a5-71ada16bfd1c tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:20:23.165840 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-50170e04-2ef0-431a-89a5-71ada16bfd1c tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:20:23.166311 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-50170e04-2ef0-431a-89a5-71ada16bfd1c tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:20:23.166752 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-50170e04-2ef0-431a-89a5-71ada16bfd1c tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:20:23.316290 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-50170e04-2ef0-431a-89a5-71ada16bfd1c tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:20:23.324358 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-50170e04-2ef0-431a-89a5-71ada16bfd1c tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 200 len: 1754 microversion: 2.1 time: 0.217952 Aug 07 02:20:23.324927 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3821/7174] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:20:23 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 1754 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:20:24.345778 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d5580155-0d56-4f29-9f86-d8d20d379de8 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:20:24.346434 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d5580155-0d56-4f29-9f86-d8d20d379de8 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:20:24.353387 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d5580155-0d56-4f29-9f86-d8d20d379de8 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:20:24.353884 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d5580155-0d56-4f29-9f86-d8d20d379de8 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:20:24.354329 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d5580155-0d56-4f29-9f86-d8d20d379de8 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:20:24.355072 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d5580155-0d56-4f29-9f86-d8d20d379de8 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:20:24.355558 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d5580155-0d56-4f29-9f86-d8d20d379de8 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:20:24.356017 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d5580155-0d56-4f29-9f86-d8d20d379de8 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:20:24.583325 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d5580155-0d56-4f29-9f86-d8d20d379de8 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:20:24.591514 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d5580155-0d56-4f29-9f86-d8d20d379de8 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 200 len: 1754 microversion: 2.1 time: 0.249658 Aug 07 02:20:24.592140 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3354/7175] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:20:24 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 1754 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:20:25.613519 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cc4f807c-8c33-48b1-a8b6-46d389748a6e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:20:25.614270 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cc4f807c-8c33-48b1-a8b6-46d389748a6e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:20:25.621569 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc4f807c-8c33-48b1-a8b6-46d389748a6e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:20:25.622073 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc4f807c-8c33-48b1-a8b6-46d389748a6e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:20:25.622532 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc4f807c-8c33-48b1-a8b6-46d389748a6e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:20:25.623253 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc4f807c-8c33-48b1-a8b6-46d389748a6e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:20:25.623730 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc4f807c-8c33-48b1-a8b6-46d389748a6e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:20:25.624304 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cc4f807c-8c33-48b1-a8b6-46d389748a6e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:20:25.775543 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cc4f807c-8c33-48b1-a8b6-46d389748a6e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:20:25.783692 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cc4f807c-8c33-48b1-a8b6-46d389748a6e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 200 len: 1754 microversion: 2.1 time: 0.174178 Aug 07 02:20:25.784301 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3822/7176] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:20:25 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:20:26.804894 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b35f6bfa-f4d8-4f65-a147-6f08d156b9a8 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:20:26.805502 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b35f6bfa-f4d8-4f65-a147-6f08d156b9a8 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:20:26.812363 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b35f6bfa-f4d8-4f65-a147-6f08d156b9a8 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:20:26.812851 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b35f6bfa-f4d8-4f65-a147-6f08d156b9a8 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:20:26.813295 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b35f6bfa-f4d8-4f65-a147-6f08d156b9a8 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:20:26.813998 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b35f6bfa-f4d8-4f65-a147-6f08d156b9a8 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:20:26.814460 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b35f6bfa-f4d8-4f65-a147-6f08d156b9a8 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:20:26.814893 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b35f6bfa-f4d8-4f65-a147-6f08d156b9a8 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:20:26.958724 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b35f6bfa-f4d8-4f65-a147-6f08d156b9a8 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:20:26.966910 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b35f6bfa-f4d8-4f65-a147-6f08d156b9a8 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 200 len: 1754 microversion: 2.1 time: 0.165942 Aug 07 02:20:26.967487 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3355/7177] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:20:26 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:20:27.990039 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d161e114-03ee-4138-9a25-951ee49e72bf tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:20:27.990678 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d161e114-03ee-4138-9a25-951ee49e72bf tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:20:27.997612 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d161e114-03ee-4138-9a25-951ee49e72bf tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:20:27.998114 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d161e114-03ee-4138-9a25-951ee49e72bf tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:20:27.998571 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d161e114-03ee-4138-9a25-951ee49e72bf tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:20:27.999287 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d161e114-03ee-4138-9a25-951ee49e72bf tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:20:27.999765 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d161e114-03ee-4138-9a25-951ee49e72bf tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:20:28.000244 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d161e114-03ee-4138-9a25-951ee49e72bf tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:20:28.141707 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d161e114-03ee-4138-9a25-951ee49e72bf tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:20:28.149775 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d161e114-03ee-4138-9a25-951ee49e72bf tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 200 len: 1754 microversion: 2.1 time: 0.163843 Aug 07 02:20:28.150351 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3823/7178] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:20:27 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:20:29.170797 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4b19b137-0afa-425f-938e-600b1b706588 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:20:29.171335 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4b19b137-0afa-425f-938e-600b1b706588 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:20:29.178166 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b19b137-0afa-425f-938e-600b1b706588 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:20:29.178680 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b19b137-0afa-425f-938e-600b1b706588 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:20:29.179122 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b19b137-0afa-425f-938e-600b1b706588 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:20:29.179823 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b19b137-0afa-425f-938e-600b1b706588 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:20:29.180319 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b19b137-0afa-425f-938e-600b1b706588 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:20:29.180750 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4b19b137-0afa-425f-938e-600b1b706588 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:20:29.324448 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4b19b137-0afa-425f-938e-600b1b706588 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:20:29.333333 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4b19b137-0afa-425f-938e-600b1b706588 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 200 len: 1754 microversion: 2.1 time: 0.166536 Aug 07 02:20:29.333896 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3356/7179] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:20:29 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:20:30.353932 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-56c1acc9-bc46-44ae-a02e-69a019beb01d tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:20:30.354569 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-56c1acc9-bc46-44ae-a02e-69a019beb01d tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:20:30.361526 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-56c1acc9-bc46-44ae-a02e-69a019beb01d tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:20:30.362054 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-56c1acc9-bc46-44ae-a02e-69a019beb01d tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:20:30.362507 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-56c1acc9-bc46-44ae-a02e-69a019beb01d tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:20:30.363220 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-56c1acc9-bc46-44ae-a02e-69a019beb01d tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:20:30.363690 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-56c1acc9-bc46-44ae-a02e-69a019beb01d tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:20:30.364167 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-56c1acc9-bc46-44ae-a02e-69a019beb01d tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:20:30.510019 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-56c1acc9-bc46-44ae-a02e-69a019beb01d tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:20:30.518612 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-56c1acc9-bc46-44ae-a02e-69a019beb01d tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 200 len: 1754 microversion: 2.1 time: 0.168571 Aug 07 02:20:30.519172 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3824/7180] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:20:30 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:20:31.539791 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-993953b8-24a4-49a2-b06e-3f31e6eb6838 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:20:31.540431 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-993953b8-24a4-49a2-b06e-3f31e6eb6838 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:20:31.548035 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-993953b8-24a4-49a2-b06e-3f31e6eb6838 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:20:31.548532 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-993953b8-24a4-49a2-b06e-3f31e6eb6838 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:20:31.548977 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-993953b8-24a4-49a2-b06e-3f31e6eb6838 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:20:31.549683 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-993953b8-24a4-49a2-b06e-3f31e6eb6838 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:20:31.550141 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-993953b8-24a4-49a2-b06e-3f31e6eb6838 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:20:31.550574 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-993953b8-24a4-49a2-b06e-3f31e6eb6838 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:20:31.698512 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-993953b8-24a4-49a2-b06e-3f31e6eb6838 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:20:31.707661 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-993953b8-24a4-49a2-b06e-3f31e6eb6838 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 200 len: 1754 microversion: 2.1 time: 0.171903 Aug 07 02:20:31.708262 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3357/7181] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:20:31 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 1754 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:20:32.729523 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-49d7ba6a-12fd-496c-89c8-272bcb06e0f4 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:20:32.730161 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-49d7ba6a-12fd-496c-89c8-272bcb06e0f4 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:20:32.737320 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-49d7ba6a-12fd-496c-89c8-272bcb06e0f4 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:20:32.737815 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-49d7ba6a-12fd-496c-89c8-272bcb06e0f4 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:20:32.738270 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-49d7ba6a-12fd-496c-89c8-272bcb06e0f4 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:20:32.738981 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-49d7ba6a-12fd-496c-89c8-272bcb06e0f4 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:20:32.739451 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-49d7ba6a-12fd-496c-89c8-272bcb06e0f4 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:20:32.739907 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-49d7ba6a-12fd-496c-89c8-272bcb06e0f4 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:20:32.881578 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-49d7ba6a-12fd-496c-89c8-272bcb06e0f4 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:20:32.889802 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-49d7ba6a-12fd-496c-89c8-272bcb06e0f4 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 200 len: 1754 microversion: 2.1 time: 0.164704 Aug 07 02:20:32.890371 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3825/7182] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:20:32 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:20:33.910663 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8177569e-1927-40b3-9f34-3cc9aed91bbd tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:20:33.911575 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8177569e-1927-40b3-9f34-3cc9aed91bbd tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:20:33.918108 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8177569e-1927-40b3-9f34-3cc9aed91bbd tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:20:33.918586 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8177569e-1927-40b3-9f34-3cc9aed91bbd tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:20:33.919022 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8177569e-1927-40b3-9f34-3cc9aed91bbd tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:20:33.919708 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8177569e-1927-40b3-9f34-3cc9aed91bbd tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:20:33.920181 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8177569e-1927-40b3-9f34-3cc9aed91bbd tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:20:33.920612 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8177569e-1927-40b3-9f34-3cc9aed91bbd tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:20:34.068704 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8177569e-1927-40b3-9f34-3cc9aed91bbd tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:20:34.077972 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8177569e-1927-40b3-9f34-3cc9aed91bbd tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 200 len: 1757 microversion: 2.1 time: 0.171031 Aug 07 02:20:34.078584 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3358/7183] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:20:33 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:21:05.978861 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7f045318-95b2-4125-9ddf-490999d21e04 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-59367845"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:21:05.979443 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7f045318-95b2-4125-9ddf-490999d21e04 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:21:05.981967 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=12 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:21:05.983248 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:21:05.989267 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f045318-95b2-4125-9ddf-490999d21e04 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:05.989814 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f045318-95b2-4125-9ddf-490999d21e04 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:05.990266 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f045318-95b2-4125-9ddf-490999d21e04 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:05.990998 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f045318-95b2-4125-9ddf-490999d21e04 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:05.991470 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f045318-95b2-4125-9ddf-490999d21e04 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:05.991940 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f045318-95b2-4125-9ddf-490999d21e04 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:06.120747 n-d-master-1 devstack@n-api.service[119516]: INFO nova.network.security_group_api [None req-7f045318-95b2-4125-9ddf-490999d21e04 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Removing security group dad47baf-44e6-4949-a89d-80e50118ddf4 from port 101f67d8-68ed-46b4-a048-56757e643fa8 Aug 07 02:21:06.419258 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7f045318-95b2-4125-9ddf-490999d21e04 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "POST /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad/action" status: 202 len: 0 microversion: 2.1 time: 0.444390 Aug 07 02:21:06.419913 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3826/7184] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:21:05 2022] POST /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad/action => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:21:06.429385 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=12 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:21:06.430642 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=36 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:21:06.495646 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-804ccd64-5c90-4642-9d90-bc65b0f01d7b req-9c81c39d-2969-4dd0-8504-f068458a1f0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10d52cd5-76ef-4aa1-b0da-0e17f616c2ad", "tag": "101f67d8-68ed-46b4-a048-56757e643fa8"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:21:06.506969 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-804ccd64-5c90-4642-9d90-bc65b0f01d7b req-9c81c39d-2969-4dd0-8504-f068458a1f0b service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:06.507336 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-804ccd64-5c90-4642-9d90-bc65b0f01d7b req-9c81c39d-2969-4dd0-8504-f068458a1f0b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:06.508076 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-804ccd64-5c90-4642-9d90-bc65b0f01d7b req-9c81c39d-2969-4dd0-8504-f068458a1f0b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:06.520993 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-804ccd64-5c90-4642-9d90-bc65b0f01d7b req-9c81c39d-2969-4dd0-8504-f068458a1f0b service nova] Creating event network-changed:101f67d8-68ed-46b4-a048-56757e643fa8 for instance 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad on n-h1-master-1 Aug 07 02:21:06.526236 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-804ccd64-5c90-4642-9d90-bc65b0f01d7b req-9c81c39d-2969-4dd0-8504-f068458a1f0b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101552 Aug 07 02:21:06.527171 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3359/7185] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:21:07.756763 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-367f1b4e-15a7-44eb-9215-80844f09d13b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:21:07.757376 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-367f1b4e-15a7-44eb-9215-80844f09d13b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:21:07.763567 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-367f1b4e-15a7-44eb-9215-80844f09d13b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:07.764300 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-367f1b4e-15a7-44eb-9215-80844f09d13b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:07.764985 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-367f1b4e-15a7-44eb-9215-80844f09d13b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:07.765711 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-367f1b4e-15a7-44eb-9215-80844f09d13b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:07.766183 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-367f1b4e-15a7-44eb-9215-80844f09d13b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:07.766628 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-367f1b4e-15a7-44eb-9215-80844f09d13b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:07.851783 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-367f1b4e-15a7-44eb-9215-80844f09d13b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lazy-loading 'services' on Instance uuid 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 02:21:07.925390 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-367f1b4e-15a7-44eb-9215-80844f09d13b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "DELETE /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad/os-volume_attachments/81b8043e-2dd0-45fc-8c28-6a7d7402ec5a" status: 202 len: 0 microversion: 2.1 time: 0.173851 Aug 07 02:21:07.926164 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3827/7186] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Aug 7 02:21:07 2022] DELETE /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad/os-volume_attachments/81b8043e-2dd0-45fc-8c28-6a7d7402ec5a => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:21:07.936287 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-977451c7-0e7d-4377-9de5-db393f7fc00e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:21:07.938910 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-977451c7-0e7d-4377-9de5-db393f7fc00e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:21:07.946569 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-977451c7-0e7d-4377-9de5-db393f7fc00e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:07.947072 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-977451c7-0e7d-4377-9de5-db393f7fc00e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:07.947513 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-977451c7-0e7d-4377-9de5-db393f7fc00e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:07.948261 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-977451c7-0e7d-4377-9de5-db393f7fc00e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:07.948723 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-977451c7-0e7d-4377-9de5-db393f7fc00e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:07.949153 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-977451c7-0e7d-4377-9de5-db393f7fc00e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:07.985328 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-977451c7-0e7d-4377-9de5-db393f7fc00e tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054610 Aug 07 02:21:07.986363 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3360/7187] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 02:21:07 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:21:07.996774 n-d-master-1 devstack@n-api.service[119517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 02:21:07.996923 n-d-master-1 devstack@n-api.service[119517]: Sun Aug 7 02:21:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 02:21:08.542495 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-23f81f84-df19-4134-80c6-2503d9180a24 req-e429055e-e75d-4cfa-8441-a994dd012634 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10d52cd5-76ef-4aa1-b0da-0e17f616c2ad", "tag": "101f67d8-68ed-46b4-a048-56757e643fa8"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:21:08.553285 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-23f81f84-df19-4134-80c6-2503d9180a24 req-e429055e-e75d-4cfa-8441-a994dd012634 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:08.554002 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-23f81f84-df19-4134-80c6-2503d9180a24 req-e429055e-e75d-4cfa-8441-a994dd012634 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:08.554489 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-23f81f84-df19-4134-80c6-2503d9180a24 req-e429055e-e75d-4cfa-8441-a994dd012634 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:08.567060 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-23f81f84-df19-4134-80c6-2503d9180a24 req-e429055e-e75d-4cfa-8441-a994dd012634 service nova] Creating event network-changed:101f67d8-68ed-46b4-a048-56757e643fa8 for instance 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad on n-h1-master-1 Aug 07 02:21:08.572131 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-23f81f84-df19-4134-80c6-2503d9180a24 req-e429055e-e75d-4cfa-8441-a994dd012634 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033699 Aug 07 02:21:08.573061 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3828/7188] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:21:08.999093 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f85e266d-79ff-4c29-85ae-8de8e7e016d4 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:21:09.003204 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f85e266d-79ff-4c29-85ae-8de8e7e016d4 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:21:09.011252 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f85e266d-79ff-4c29-85ae-8de8e7e016d4 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:09.011754 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f85e266d-79ff-4c29-85ae-8de8e7e016d4 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:09.012416 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f85e266d-79ff-4c29-85ae-8de8e7e016d4 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:09.013141 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f85e266d-79ff-4c29-85ae-8de8e7e016d4 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:09.013607 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f85e266d-79ff-4c29-85ae-8de8e7e016d4 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:09.014040 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f85e266d-79ff-4c29-85ae-8de8e7e016d4 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:09.046370 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f85e266d-79ff-4c29-85ae-8de8e7e016d4 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051538 Aug 07 02:21:09.047141 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3361/7189] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 02:21:08 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:21:10.060237 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-041d6611-3dac-490a-bd68-1070d0d84b2b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:21:10.062588 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-041d6611-3dac-490a-bd68-1070d0d84b2b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:21:10.069269 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-041d6611-3dac-490a-bd68-1070d0d84b2b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:10.069778 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-041d6611-3dac-490a-bd68-1070d0d84b2b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:10.070240 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-041d6611-3dac-490a-bd68-1070d0d84b2b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:10.071003 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-041d6611-3dac-490a-bd68-1070d0d84b2b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:10.071452 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-041d6611-3dac-490a-bd68-1070d0d84b2b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:10.071965 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-041d6611-3dac-490a-bd68-1070d0d84b2b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:10.103868 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-041d6611-3dac-490a-bd68-1070d0d84b2b tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048795 Aug 07 02:21:10.104458 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3829/7190] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 02:21:10 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:21:11.117055 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-344cfe7e-1e90-4796-9575-200c3c3f6568 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:21:11.119244 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-344cfe7e-1e90-4796-9575-200c3c3f6568 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:21:11.126205 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-344cfe7e-1e90-4796-9575-200c3c3f6568 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:11.126689 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-344cfe7e-1e90-4796-9575-200c3c3f6568 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:11.127124 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-344cfe7e-1e90-4796-9575-200c3c3f6568 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:11.127824 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-344cfe7e-1e90-4796-9575-200c3c3f6568 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:11.128310 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-344cfe7e-1e90-4796-9575-200c3c3f6568 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:11.128735 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-344cfe7e-1e90-4796-9575-200c3c3f6568 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:11.160509 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-344cfe7e-1e90-4796-9575-200c3c3f6568 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047499 Aug 07 02:21:11.161070 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3362/7191] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 02:21:11 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:21:12.172397 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4878a050-9f58-42d5-97d8-9faaa0c94089 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:21:12.175247 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4878a050-9f58-42d5-97d8-9faaa0c94089 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:21:12.182420 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4878a050-9f58-42d5-97d8-9faaa0c94089 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:12.183000 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4878a050-9f58-42d5-97d8-9faaa0c94089 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:12.183527 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4878a050-9f58-42d5-97d8-9faaa0c94089 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:12.184355 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4878a050-9f58-42d5-97d8-9faaa0c94089 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:12.184832 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4878a050-9f58-42d5-97d8-9faaa0c94089 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:12.185281 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4878a050-9f58-42d5-97d8-9faaa0c94089 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:12.215279 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4878a050-9f58-42d5-97d8-9faaa0c94089 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046979 Aug 07 02:21:12.215851 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3830/7192] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 02:21:12 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 02:21:13.227730 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-20134b0d-d37f-4997-8a59-adf95c3fa370 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:21:13.229920 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-20134b0d-d37f-4997-8a59-adf95c3fa370 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:21:13.236764 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-20134b0d-d37f-4997-8a59-adf95c3fa370 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:13.237250 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-20134b0d-d37f-4997-8a59-adf95c3fa370 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:13.237691 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-20134b0d-d37f-4997-8a59-adf95c3fa370 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:13.238421 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-20134b0d-d37f-4997-8a59-adf95c3fa370 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:13.238880 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-20134b0d-d37f-4997-8a59-adf95c3fa370 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:13.239315 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-20134b0d-d37f-4997-8a59-adf95c3fa370 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:13.267857 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-20134b0d-d37f-4997-8a59-adf95c3fa370 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043547 Aug 07 02:21:13.268425 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3363/7193] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 02:21:13 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 02:21:13.278861 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1bcd9506-511a-4d87-bacc-0ab5a11c5317 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:21:13.279380 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1bcd9506-511a-4d87-bacc-0ab5a11c5317 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:21:13.286280 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1bcd9506-511a-4d87-bacc-0ab5a11c5317 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:13.286785 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1bcd9506-511a-4d87-bacc-0ab5a11c5317 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:13.287250 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1bcd9506-511a-4d87-bacc-0ab5a11c5317 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:13.288006 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1bcd9506-511a-4d87-bacc-0ab5a11c5317 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:13.288482 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1bcd9506-511a-4d87-bacc-0ab5a11c5317 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:13.288932 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1bcd9506-511a-4d87-bacc-0ab5a11c5317 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:13.364706 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-1bcd9506-511a-4d87-bacc-0ab5a11c5317 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] HTTP exception thrown: Instance 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad is not attached to volume 81b8043e-2dd0-45fc-8c28-6a7d7402ec5a Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1bcd9506-511a-4d87-bacc-0ab5a11c5317 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Request method failure captured: Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: request: DELETE /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad/os-volume_attachments/81b8043e-2dd0-45fc-8c28-6a7d7402ec5a HTTP/1.1 Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7yA22ObgCoLnCjuPTNeOG89H5ufONt4NEjukVDIpZ7u1N6fPl6AAkvyzX_MR2AW4f9B7JgpZc1-NxHLgvrZY9yPYiZJ4DrCd9QKAXuBYLT4SNsVOzfnlKShFdhLOYoVeBsPgkapPtiUzz677Z2XVxwR0C0FdgalU_DzRgHfa-0eceiw Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 1416397f45dc4abf94bb539540b5b61f Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-TestMinimumBasicScenario-1487476756 Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1416397f45dc4abf94bb539540b5b61f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1416397f45dc4abf94bb539540b5b61f", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1416397f45dc4abf94bb539540b5b61f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1416397f45dc4abf94bb539540b5b61f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-TestMinimumBasicScenario-1487476756 Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 1416397f45dc4abf94bb539540b5b61f Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1487476756 Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-TestMinimumBasicScenario-1487476756-project Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 965b3c62c5af4285a6d747d18274f18a Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-TestMinimumBasicScenario-1487476756-project Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad is not attached to volume 81b8043e-2dd0-45fc-8c28-6a7d7402ec5a Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: action_args: {'server_id': '10d52cd5-76ef-4aa1-b0da-0e17f616c2ad', 'id': '81b8043e-2dd0-45fc-8c28-6a7d7402ec5a'} Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 81b8043e-2dd0-45fc-8c28-6a7d7402ec5a. Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad is not attached to volume 81b8043e-2dd0-45fc-8c28-6a7d7402ec5a Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:21:13.366341 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:21:13.370614 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:21:13.370614 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:21:13.370614 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad is not attached to volume 81b8043e-2dd0-45fc-8c28-6a7d7402ec5a Aug 07 02:21:13.370614 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:21:13.370614 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1bcd9506-511a-4d87-bacc-0ab5a11c5317 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Returning 404 to user: Instance 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad is not attached to volume 81b8043e-2dd0-45fc-8c28-6a7d7402ec5a {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:21:13.370614 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1bcd9506-511a-4d87-bacc-0ab5a11c5317 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "DELETE /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad/os-volume_attachments/81b8043e-2dd0-45fc-8c28-6a7d7402ec5a" status: 404 len: 154 microversion: 2.1 time: 0.092984 Aug 07 02:21:13.370614 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3831/7194] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Aug 7 02:21:13 2022] DELETE /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad/os-volume_attachments/81b8043e-2dd0-45fc-8c28-6a7d7402ec5a => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:21:16.615820 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b8402a8c-e81c-4175-a630-b1452ee8ebf1 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:21:16.616353 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b8402a8c-e81c-4175-a630-b1452ee8ebf1 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:21:16.623174 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b8402a8c-e81c-4175-a630-b1452ee8ebf1 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:16.623659 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b8402a8c-e81c-4175-a630-b1452ee8ebf1 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:16.624147 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b8402a8c-e81c-4175-a630-b1452ee8ebf1 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:16.624847 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b8402a8c-e81c-4175-a630-b1452ee8ebf1 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:16.625307 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b8402a8c-e81c-4175-a630-b1452ee8ebf1 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:16.625740 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b8402a8c-e81c-4175-a630-b1452ee8ebf1 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:16.650564 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b8402a8c-e81c-4175-a630-b1452ee8ebf1 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 02:21:16.730041 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b8402a8c-e81c-4175-a630-b1452ee8ebf1 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "DELETE /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 204 len: 0 microversion: 2.1 time: 0.117771 Aug 07 02:21:16.730639 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3364/7195] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 02:21:16 2022] DELETE /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 02:21:16.741607 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bb3e4d6c-98be-4a0b-adc7-31bd7976f504 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:21:16.742490 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bb3e4d6c-98be-4a0b-adc7-31bd7976f504 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:21:16.750067 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb3e4d6c-98be-4a0b-adc7-31bd7976f504 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:16.750896 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb3e4d6c-98be-4a0b-adc7-31bd7976f504 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:16.752031 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb3e4d6c-98be-4a0b-adc7-31bd7976f504 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:16.753029 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb3e4d6c-98be-4a0b-adc7-31bd7976f504 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:16.753509 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb3e4d6c-98be-4a0b-adc7-31bd7976f504 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:16.753956 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb3e4d6c-98be-4a0b-adc7-31bd7976f504 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:16.886358 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bb3e4d6c-98be-4a0b-adc7-31bd7976f504 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:21:16.894148 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bb3e4d6c-98be-4a0b-adc7-31bd7976f504 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 200 len: 1554 microversion: 2.1 time: 0.158768 Aug 07 02:21:16.894729 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3832/7196] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:21:16 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:21:17.915183 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c382dea8-c586-46ef-9bb7-aad0b020e320 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:21:17.915830 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c382dea8-c586-46ef-9bb7-aad0b020e320 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:21:17.923391 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c382dea8-c586-46ef-9bb7-aad0b020e320 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:17.923897 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c382dea8-c586-46ef-9bb7-aad0b020e320 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:17.924352 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c382dea8-c586-46ef-9bb7-aad0b020e320 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:17.925053 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c382dea8-c586-46ef-9bb7-aad0b020e320 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:17.925517 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c382dea8-c586-46ef-9bb7-aad0b020e320 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:17.925956 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c382dea8-c586-46ef-9bb7-aad0b020e320 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:18.059792 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c382dea8-c586-46ef-9bb7-aad0b020e320 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:21:18.067824 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c382dea8-c586-46ef-9bb7-aad0b020e320 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 200 len: 1554 microversion: 2.1 time: 0.157001 Aug 07 02:21:18.068421 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3365/7197] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:21:17 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:21:18.966803 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-3d303c11-dc04-461c-9a92-66194398f3dc req-37934b5f-3ae8-4f48-9834-25ec9f6c661e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10d52cd5-76ef-4aa1-b0da-0e17f616c2ad", "name": "network-vif-deleted", "tag": "101f67d8-68ed-46b4-a048-56757e643fa8"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:21:18.979788 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3d303c11-dc04-461c-9a92-66194398f3dc req-37934b5f-3ae8-4f48-9834-25ec9f6c661e service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:18.980330 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3d303c11-dc04-461c-9a92-66194398f3dc req-37934b5f-3ae8-4f48-9834-25ec9f6c661e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:18.981203 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3d303c11-dc04-461c-9a92-66194398f3dc req-37934b5f-3ae8-4f48-9834-25ec9f6c661e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:18.995283 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-3d303c11-dc04-461c-9a92-66194398f3dc req-37934b5f-3ae8-4f48-9834-25ec9f6c661e service nova] Creating event network-vif-deleted:101f67d8-68ed-46b4-a048-56757e643fa8 for instance 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad on n-h1-master-1 Aug 07 02:21:19.002237 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-3d303c11-dc04-461c-9a92-66194398f3dc req-37934b5f-3ae8-4f48-9834-25ec9f6c661e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038749 Aug 07 02:21:19.002851 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3833/7198] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:21:19.089935 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-89eda4e7-c007-4d92-ae1c-e64a95edcf61 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:21:19.090541 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-89eda4e7-c007-4d92-ae1c-e64a95edcf61 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:21:19.098124 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-89eda4e7-c007-4d92-ae1c-e64a95edcf61 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:19.098607 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-89eda4e7-c007-4d92-ae1c-e64a95edcf61 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:19.099041 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-89eda4e7-c007-4d92-ae1c-e64a95edcf61 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:19.099736 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-89eda4e7-c007-4d92-ae1c-e64a95edcf61 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:19.100228 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-89eda4e7-c007-4d92-ae1c-e64a95edcf61 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:19.100657 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-89eda4e7-c007-4d92-ae1c-e64a95edcf61 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:19.132829 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-89eda4e7-c007-4d92-ae1c-e64a95edcf61 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:19.133314 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-89eda4e7-c007-4d92-ae1c-e64a95edcf61 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:19.133750 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-89eda4e7-c007-4d92-ae1c-e64a95edcf61 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:19.134204 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-89eda4e7-c007-4d92-ae1c-e64a95edcf61 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lazy-loading 'fault' on Instance uuid 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 02:21:19.176448 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-89eda4e7-c007-4d92-ae1c-e64a95edcf61 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965b3c62c5af4285a6d747d18274f18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1416397f45dc4abf94bb539540b5b61f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:21:19.184793 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-89eda4e7-c007-4d92-ae1c-e64a95edcf61 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 200 len: 1348 microversion: 2.1 time: 0.098776 Aug 07 02:21:19.185358 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3366/7199] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:21:19 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 1348 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:21:20.206841 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-adbcda26-7829-4b8d-a9e6-955b2f146647 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:21:20.207587 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-adbcda26-7829-4b8d-a9e6-955b2f146647 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] [instance: 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:21:20.214595 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-adbcda26-7829-4b8d-a9e6-955b2f146647 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:20.215096 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-adbcda26-7829-4b8d-a9e6-955b2f146647 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:20.215549 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-adbcda26-7829-4b8d-a9e6-955b2f146647 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:20.216293 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-adbcda26-7829-4b8d-a9e6-955b2f146647 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:20.216764 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-adbcda26-7829-4b8d-a9e6-955b2f146647 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:20.217208 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-adbcda26-7829-4b8d-a9e6-955b2f146647 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:20.230829 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-adbcda26-7829-4b8d-a9e6-955b2f146647 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] HTTP exception thrown: Instance 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad could not be found. Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-adbcda26-7829-4b8d-a9e6-955b2f146647 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Request method failure captured: Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad HTTP/1.1 Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7yA22ObgCoLnCjuPTNeOG89H5ufONt4NEjukVDIpZ7u1N6fPl6AAkvyzX_MR2AW4f9B7JgpZc1-NxHLgvrZY9yPYiZJ4DrCd9QKAXuBYLT4SNsVOzfnlKShFdhLOYoVeBsPgkapPtiUzz677Z2XVxwR0C0FdgalU_DzRgHfa-0eceiw Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 1416397f45dc4abf94bb539540b5b61f Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-TestMinimumBasicScenario-1487476756 Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1416397f45dc4abf94bb539540b5b61f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1416397f45dc4abf94bb539540b5b61f", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1416397f45dc4abf94bb539540b5b61f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1416397f45dc4abf94bb539540b5b61f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-TestMinimumBasicScenario-1487476756 Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 1416397f45dc4abf94bb539540b5b61f Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1487476756 Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-TestMinimumBasicScenario-1487476756-project Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 965b3c62c5af4285a6d747d18274f18a Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-TestMinimumBasicScenario-1487476756-project Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad could not be found. Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '10d52cd5-76ef-4aa1-b0da-0e17f616c2ad'} Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad could not be found. Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad could not be found. Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:21:20.232529 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:21:20.238330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:21:20.238330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:21:20.238330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:21:20.238330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:21:20.238330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:21:20.238330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad could not be found. Aug 07 02:21:20.238330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:21:20.238330 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-adbcda26-7829-4b8d-a9e6-955b2f146647 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Returning 404 to user: Instance 10d52cd5-76ef-4aa1-b0da-0e17f616c2ad could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:21:20.238330 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-adbcda26-7829-4b8d-a9e6-955b2f146647 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad" status: 404 len: 111 microversion: 2.1 time: 0.031765 Aug 07 02:21:20.238330 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3834/7200] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:21:20 2022] GET /compute/v2.1/servers/10d52cd5-76ef-4aa1-b0da-0e17f616c2ad => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:21:20.243163 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fdf58a33-fa3c-49e8-a693-6ad0c6a62bc1 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] Calling method '.version_select at 0x7f9e248c6940>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:21:20.262674 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fdf58a33-fa3c-49e8-a693-6ad0c6a62bc1 tempest-TestMinimumBasicScenario-1487476756 tempest-TestMinimumBasicScenario-1487476756-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1589225069" status: 202 len: 0 microversion: 2.1 time: 0.023346 Aug 07 02:21:20.263232 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3367/7201] 10.222.0.39 () {58 vars in 1272 bytes} [Sun Aug 7 02:21:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1589225069 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:21:29.332745 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7a88d60e-29fe-4e0a-9bef-41827dfc6e20 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Action: 'create', calling method: .version_select at 0x7f9e245b7c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1831788199", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1CYWCeAzcgwVBHkKx+z//SXac+ydVf7fKf3ZXbfalLCvhKySHbn8VWl3ONpvmY1ALgMUvFdRyws861kJ3ZsWSZrodGPhcsBkBs8llA0OgOPyNBkHjEHi876MYCZDIuUw=="}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:21:29.348906 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-7a88d60e-29fe-4e0a-9bef-41827dfc6e20 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Getting quotas for project a212f473f58c4fb680bdb8ad63bd56f1. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:21:29.354104 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-7a88d60e-29fe-4e0a-9bef-41827dfc6e20 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Getting quotas for user a2c21b7e0fa94a9eb7155caaf474b3b2 and project a212f473f58c4fb680bdb8ad63bd56f1. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:21:29.379522 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7a88d60e-29fe-4e0a-9bef-41827dfc6e20 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.209182 Aug 07 02:21:29.380155 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3835/7202] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 02:21:29 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:21:34.784997 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:21:34.786802 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:21:34.792131 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fd16c5a4-5252-4d49-ae06-34cb4f5369cb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2081042607", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "75291074-beed-4f91-aa98-0da7c2ae5e8f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1831788199", "security_groups": [{"name": "tempest-secgroup-smoke-257839502"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:21:34.930861 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-fd16c5a4-5252-4d49-ae06-34cb4f5369cb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] validate_networks() for [('75291074-beed-4f91-aa98-0da7c2ae5e8f', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 02:21:35.448585 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-fd16c5a4-5252-4d49-ae06-34cb4f5369cb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 02:21:35.449056 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-fd16c5a4-5252-4d49-ae06-34cb4f5369cb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 02:21:35.449536 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-fd16c5a4-5252-4d49-ae06-34cb4f5369cb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 02:21:35.449975 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-fd16c5a4-5252-4d49-ae06-34cb4f5369cb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 02:21:35.450388 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-fd16c5a4-5252-4d49-ae06-34cb4f5369cb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 02:21:35.459548 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd16c5a4-5252-4d49-ae06-34cb4f5369cb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:35.460076 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd16c5a4-5252-4d49-ae06-34cb4f5369cb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:35.460518 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd16c5a4-5252-4d49-ae06-34cb4f5369cb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:35.461262 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd16c5a4-5252-4d49-ae06-34cb4f5369cb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:35.461716 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd16c5a4-5252-4d49-ae06-34cb4f5369cb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:35.462145 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd16c5a4-5252-4d49-ae06-34cb4f5369cb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:35.489085 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-fd16c5a4-5252-4d49-ae06-34cb4f5369cb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Getting quotas for project a212f473f58c4fb680bdb8ad63bd56f1. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:21:35.495460 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-fd16c5a4-5252-4d49-ae06-34cb4f5369cb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Getting quotas for user a2c21b7e0fa94a9eb7155caaf474b3b2 and project a212f473f58c4fb680bdb8ad63bd56f1. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:21:35.508748 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fd16c5a4-5252-4d49-ae06-34cb4f5369cb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 02:21:35.511082 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fd16c5a4-5252-4d49-ae06-34cb4f5369cb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 557c3473-463a-4915-baac-25ba87e05c24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 02:21:35.559940 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fd16c5a4-5252-4d49-ae06-34cb4f5369cb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.777615 Aug 07 02:21:35.560800 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3368/7203] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 02:21:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 02:21:35.569784 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:21:35.574465 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f4fdfeda-1479-43bc-9cfa-f55801369ff8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:21:35.575100 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f4fdfeda-1479-43bc-9cfa-f55801369ff8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 557c3473-463a-4915-baac-25ba87e05c24] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:21:35.957910 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f4fdfeda-1479-43bc-9cfa-f55801369ff8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:21:35.965070 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f4fdfeda-1479-43bc-9cfa-f55801369ff8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24" status: 200 len: 1267 microversion: 2.1 time: 0.396927 Aug 07 02:21:35.979717 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3836/7204] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:21:35 2022] GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24 => generated 1267 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:21:36.989173 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-97442b04-d391-435e-849d-0aa47fa167e0 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:21:36.989805 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-97442b04-d391-435e-849d-0aa47fa167e0 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 557c3473-463a-4915-baac-25ba87e05c24] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:21:37.060297 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-97442b04-d391-435e-849d-0aa47fa167e0 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:21:37.068732 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-97442b04-d391-435e-849d-0aa47fa167e0 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24" status: 200 len: 1267 microversion: 2.1 time: 0.085787 Aug 07 02:21:37.076457 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3369/7205] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:21:36 2022] GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24 => generated 1267 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:21:38.093925 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d4f9587f-19e6-4238-bbf4-390710b9a972 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:21:38.094713 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d4f9587f-19e6-4238-bbf4-390710b9a972 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 557c3473-463a-4915-baac-25ba87e05c24] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:21:38.100452 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:21:38.105851 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d4f9587f-19e6-4238-bbf4-390710b9a972 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:38.106359 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d4f9587f-19e6-4238-bbf4-390710b9a972 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:38.106817 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d4f9587f-19e6-4238-bbf4-390710b9a972 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:38.107545 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d4f9587f-19e6-4238-bbf4-390710b9a972 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:38.108054 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d4f9587f-19e6-4238-bbf4-390710b9a972 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:38.108500 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d4f9587f-19e6-4238-bbf4-390710b9a972 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:38.172076 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d4f9587f-19e6-4238-bbf4-390710b9a972 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:21:38.179713 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d4f9587f-19e6-4238-bbf4-390710b9a972 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24" status: 200 len: 1325 microversion: 2.1 time: 0.089757 Aug 07 02:21:38.180338 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3837/7206] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:21:38 2022] GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24 => generated 1325 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:21:39.191827 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-6cfc7be9-7598-4fbb-86ee-4392ff1a64b1 req-729444c1-4ac4-47b2-b440-ced3d6316b5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "557c3473-463a-4915-baac-25ba87e05c24", "tag": "1dcd1f07-c612-4956-86ef-011882753d42"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:21:39.202857 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7ef47c14-4190-4e4c-8c9b-c6fd7ede4eb4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:21:39.203652 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7ef47c14-4190-4e4c-8c9b-c6fd7ede4eb4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 557c3473-463a-4915-baac-25ba87e05c24] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:21:39.203981 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6cfc7be9-7598-4fbb-86ee-4392ff1a64b1 req-729444c1-4ac4-47b2-b440-ced3d6316b5c service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:39.205331 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6cfc7be9-7598-4fbb-86ee-4392ff1a64b1 req-729444c1-4ac4-47b2-b440-ced3d6316b5c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:39.205769 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6cfc7be9-7598-4fbb-86ee-4392ff1a64b1 req-729444c1-4ac4-47b2-b440-ced3d6316b5c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:39.214608 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ef47c14-4190-4e4c-8c9b-c6fd7ede4eb4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:39.215112 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ef47c14-4190-4e4c-8c9b-c6fd7ede4eb4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:39.215565 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ef47c14-4190-4e4c-8c9b-c6fd7ede4eb4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:39.216517 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ef47c14-4190-4e4c-8c9b-c6fd7ede4eb4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:39.216992 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ef47c14-4190-4e4c-8c9b-c6fd7ede4eb4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:39.217442 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7ef47c14-4190-4e4c-8c9b-c6fd7ede4eb4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:39.223471 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-6cfc7be9-7598-4fbb-86ee-4392ff1a64b1 req-729444c1-4ac4-47b2-b440-ced3d6316b5c service nova] Creating event network-changed:1dcd1f07-c612-4956-86ef-011882753d42 for instance 557c3473-463a-4915-baac-25ba87e05c24 on n-h1-master-1 Aug 07 02:21:39.228917 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-6cfc7be9-7598-4fbb-86ee-4392ff1a64b1 req-729444c1-4ac4-47b2-b440-ced3d6316b5c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040781 Aug 07 02:21:39.229893 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3370/7207] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:21:39.353808 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7ef47c14-4190-4e4c-8c9b-c6fd7ede4eb4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:21:39.361750 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7ef47c14-4190-4e4c-8c9b-c6fd7ede4eb4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24" status: 200 len: 1392 microversion: 2.1 time: 0.164168 Aug 07 02:21:39.362378 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3838/7208] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:21:39 2022] GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:21:40.385865 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-21ea284e-a555-4212-a927-b54d3c565e4d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:21:40.386569 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-21ea284e-a555-4212-a927-b54d3c565e4d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 557c3473-463a-4915-baac-25ba87e05c24] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:21:40.393793 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21ea284e-a555-4212-a927-b54d3c565e4d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:40.394273 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21ea284e-a555-4212-a927-b54d3c565e4d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:40.394706 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21ea284e-a555-4212-a927-b54d3c565e4d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:40.395395 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21ea284e-a555-4212-a927-b54d3c565e4d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:40.395848 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21ea284e-a555-4212-a927-b54d3c565e4d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:40.396298 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-21ea284e-a555-4212-a927-b54d3c565e4d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:40.576472 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-21ea284e-a555-4212-a927-b54d3c565e4d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:21:40.584406 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-21ea284e-a555-4212-a927-b54d3c565e4d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24" status: 200 len: 1392 microversion: 2.1 time: 0.202779 Aug 07 02:21:40.584980 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3371/7209] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:21:40 2022] GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24 => generated 1392 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:21:41.605119 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f2dece71-d7af-4b91-a6ae-a12f74e1add8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:21:41.605785 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f2dece71-d7af-4b91-a6ae-a12f74e1add8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 557c3473-463a-4915-baac-25ba87e05c24] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:21:41.613350 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2dece71-d7af-4b91-a6ae-a12f74e1add8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:41.613849 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2dece71-d7af-4b91-a6ae-a12f74e1add8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:41.614302 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2dece71-d7af-4b91-a6ae-a12f74e1add8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:41.615015 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2dece71-d7af-4b91-a6ae-a12f74e1add8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:41.615485 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2dece71-d7af-4b91-a6ae-a12f74e1add8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:41.615950 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f2dece71-d7af-4b91-a6ae-a12f74e1add8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:41.754115 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f2dece71-d7af-4b91-a6ae-a12f74e1add8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:21:41.761827 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f2dece71-d7af-4b91-a6ae-a12f74e1add8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24" status: 200 len: 1392 microversion: 2.1 time: 0.160635 Aug 07 02:21:41.762407 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3839/7210] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:21:41 2022] GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:21:42.782691 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-154f32a0-1f2f-485a-8d64-e51f30fa2a95 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:21:42.783242 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-154f32a0-1f2f-485a-8d64-e51f30fa2a95 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 557c3473-463a-4915-baac-25ba87e05c24] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:21:42.790879 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-154f32a0-1f2f-485a-8d64-e51f30fa2a95 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:42.791363 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-154f32a0-1f2f-485a-8d64-e51f30fa2a95 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:42.791804 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-154f32a0-1f2f-485a-8d64-e51f30fa2a95 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:42.792530 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-154f32a0-1f2f-485a-8d64-e51f30fa2a95 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:42.792991 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-154f32a0-1f2f-485a-8d64-e51f30fa2a95 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:42.793421 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-154f32a0-1f2f-485a-8d64-e51f30fa2a95 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:42.928501 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-154f32a0-1f2f-485a-8d64-e51f30fa2a95 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:21:42.936080 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-154f32a0-1f2f-485a-8d64-e51f30fa2a95 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24" status: 200 len: 1392 microversion: 2.1 time: 0.157417 Aug 07 02:21:42.936653 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3372/7211] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:21:42 2022] GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:21:43.957923 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-33320ecc-e81b-4b07-8c4e-09fb15d20968 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:21:43.958563 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-33320ecc-e81b-4b07-8c4e-09fb15d20968 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 557c3473-463a-4915-baac-25ba87e05c24] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:21:43.965484 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33320ecc-e81b-4b07-8c4e-09fb15d20968 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:43.965985 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33320ecc-e81b-4b07-8c4e-09fb15d20968 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:43.966444 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33320ecc-e81b-4b07-8c4e-09fb15d20968 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:43.967170 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33320ecc-e81b-4b07-8c4e-09fb15d20968 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:43.967644 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33320ecc-e81b-4b07-8c4e-09fb15d20968 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:43.968212 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-33320ecc-e81b-4b07-8c4e-09fb15d20968 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:44.099578 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-33320ecc-e81b-4b07-8c4e-09fb15d20968 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:21:44.107203 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-33320ecc-e81b-4b07-8c4e-09fb15d20968 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24" status: 200 len: 1392 microversion: 2.1 time: 0.153977 Aug 07 02:21:44.107772 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3840/7212] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:21:43 2022] GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:21:44.968240 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-20733c84-8b36-4728-ac73-030430de13d6 req-2bd65d1a-6047-430a-88ab-376d2a18e25a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "557c3473-463a-4915-baac-25ba87e05c24", "name": "network-vif-plugged", "status": "completed", "tag": "1dcd1f07-c612-4956-86ef-011882753d42"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:21:44.980499 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-20733c84-8b36-4728-ac73-030430de13d6 req-2bd65d1a-6047-430a-88ab-376d2a18e25a service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:44.980926 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-20733c84-8b36-4728-ac73-030430de13d6 req-2bd65d1a-6047-430a-88ab-376d2a18e25a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:44.981363 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-20733c84-8b36-4728-ac73-030430de13d6 req-2bd65d1a-6047-430a-88ab-376d2a18e25a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:44.994200 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-20733c84-8b36-4728-ac73-030430de13d6 req-2bd65d1a-6047-430a-88ab-376d2a18e25a service nova] Creating event network-vif-plugged:1dcd1f07-c612-4956-86ef-011882753d42 for instance 557c3473-463a-4915-baac-25ba87e05c24 on n-h1-master-1 Aug 07 02:21:44.999179 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-20733c84-8b36-4728-ac73-030430de13d6 req-2bd65d1a-6047-430a-88ab-376d2a18e25a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035013 Aug 07 02:21:44.999790 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3373/7213] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 02:21:45.127959 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-268df930-03f4-41ff-a9f8-665312a06a33 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:21:45.128584 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-268df930-03f4-41ff-a9f8-665312a06a33 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 557c3473-463a-4915-baac-25ba87e05c24] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:21:45.135271 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-268df930-03f4-41ff-a9f8-665312a06a33 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:45.135804 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-268df930-03f4-41ff-a9f8-665312a06a33 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:45.136296 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-268df930-03f4-41ff-a9f8-665312a06a33 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:45.137015 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-268df930-03f4-41ff-a9f8-665312a06a33 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:45.137495 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-268df930-03f4-41ff-a9f8-665312a06a33 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:45.137968 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-268df930-03f4-41ff-a9f8-665312a06a33 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:45.272244 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-268df930-03f4-41ff-a9f8-665312a06a33 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:21:45.279665 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-268df930-03f4-41ff-a9f8-665312a06a33 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24" status: 200 len: 1392 microversion: 2.1 time: 0.155712 Aug 07 02:21:45.280258 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3841/7214] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:21:45 2022] GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:21:46.299866 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:21:46.305023 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d1a65844-41c7-42f2-b621-f0b3dc2d08b7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:21:46.305722 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d1a65844-41c7-42f2-b621-f0b3dc2d08b7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 557c3473-463a-4915-baac-25ba87e05c24] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:21:46.312223 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1a65844-41c7-42f2-b621-f0b3dc2d08b7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:46.312861 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1a65844-41c7-42f2-b621-f0b3dc2d08b7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:46.313301 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1a65844-41c7-42f2-b621-f0b3dc2d08b7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:46.314118 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1a65844-41c7-42f2-b621-f0b3dc2d08b7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:46.314590 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1a65844-41c7-42f2-b621-f0b3dc2d08b7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:46.315000 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1a65844-41c7-42f2-b621-f0b3dc2d08b7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:46.458241 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d1a65844-41c7-42f2-b621-f0b3dc2d08b7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:21:46.465794 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d1a65844-41c7-42f2-b621-f0b3dc2d08b7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24" status: 200 len: 1563 microversion: 2.1 time: 0.167601 Aug 07 02:21:46.466358 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3374/7215] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:21:46 2022] GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24 => generated 1563 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:21:46.486889 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b93e1c54-e02f-4bf5-ba48-7bf1e8eb5b15 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:21:46.487522 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b93e1c54-e02f-4bf5-ba48-7bf1e8eb5b15 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 557c3473-463a-4915-baac-25ba87e05c24] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:21:46.489453 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:21:46.495871 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b93e1c54-e02f-4bf5-ba48-7bf1e8eb5b15 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:46.496395 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b93e1c54-e02f-4bf5-ba48-7bf1e8eb5b15 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:46.496848 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b93e1c54-e02f-4bf5-ba48-7bf1e8eb5b15 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:46.497563 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b93e1c54-e02f-4bf5-ba48-7bf1e8eb5b15 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:46.498035 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b93e1c54-e02f-4bf5-ba48-7bf1e8eb5b15 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:46.498479 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b93e1c54-e02f-4bf5-ba48-7bf1e8eb5b15 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:46.628593 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b93e1c54-e02f-4bf5-ba48-7bf1e8eb5b15 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:21:46.636199 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b93e1c54-e02f-4bf5-ba48-7bf1e8eb5b15 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24" status: 200 len: 1563 microversion: 2.1 time: 0.153779 Aug 07 02:21:46.636767 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3842/7216] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:21:46 2022] GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:21:48.234110 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9a9b8eee-4d38-4512-a3d8-508785e2dc3e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:21:48.234662 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9a9b8eee-4d38-4512-a3d8-508785e2dc3e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 557c3473-463a-4915-baac-25ba87e05c24] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:21:48.236364 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-cb427bc7-85ef-4e17-9ebc-3c567bfcb78e req-fc011cef-53c6-45ca-8730-a2c04e4aee88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "557c3473-463a-4915-baac-25ba87e05c24", "tag": "1dcd1f07-c612-4956-86ef-011882753d42"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:21:48.236808 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=8 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:21:48.246690 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-cb427bc7-85ef-4e17-9ebc-3c567bfcb78e req-fc011cef-53c6-45ca-8730-a2c04e4aee88 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:48.247145 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a9b8eee-4d38-4512-a3d8-508785e2dc3e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:48.247443 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-cb427bc7-85ef-4e17-9ebc-3c567bfcb78e req-fc011cef-53c6-45ca-8730-a2c04e4aee88 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:48.247635 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a9b8eee-4d38-4512-a3d8-508785e2dc3e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:48.247914 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-cb427bc7-85ef-4e17-9ebc-3c567bfcb78e req-fc011cef-53c6-45ca-8730-a2c04e4aee88 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:48.248118 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a9b8eee-4d38-4512-a3d8-508785e2dc3e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:48.248834 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a9b8eee-4d38-4512-a3d8-508785e2dc3e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:21:48.249299 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a9b8eee-4d38-4512-a3d8-508785e2dc3e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:21:48.249732 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a9b8eee-4d38-4512-a3d8-508785e2dc3e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:21:48.262345 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-cb427bc7-85ef-4e17-9ebc-3c567bfcb78e req-fc011cef-53c6-45ca-8730-a2c04e4aee88 service nova] Creating event network-changed:1dcd1f07-c612-4956-86ef-011882753d42 for instance 557c3473-463a-4915-baac-25ba87e05c24 on n-h1-master-1 Aug 07 02:21:48.268202 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-cb427bc7-85ef-4e17-9ebc-3c567bfcb78e req-fc011cef-53c6-45ca-8730-a2c04e4aee88 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035466 Aug 07 02:21:48.269034 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3843/7217] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 02:21:48.464863 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9a9b8eee-4d38-4512-a3d8-508785e2dc3e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:21:48.475677 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9a9b8eee-4d38-4512-a3d8-508785e2dc3e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24" status: 200 len: 1563 microversion: 2.1 time: 0.245415 Aug 07 02:21:48.476395 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3375/7218] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:21:48 2022] GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24 => generated 1563 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:22:11.717669 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=13 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:22:11.718425 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=38 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:22:11.723037 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-21e95b4c-3450-49de-89d8-62c84b13fdf7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:22:11.725296 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-21e95b4c-3450-49de-89d8-62c84b13fdf7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 557c3473-463a-4915-baac-25ba87e05c24] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:22:11.732351 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21e95b4c-3450-49de-89d8-62c84b13fdf7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:11.732844 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21e95b4c-3450-49de-89d8-62c84b13fdf7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:11.733293 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21e95b4c-3450-49de-89d8-62c84b13fdf7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:11.733991 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21e95b4c-3450-49de-89d8-62c84b13fdf7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:11.734457 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21e95b4c-3450-49de-89d8-62c84b13fdf7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:11.734915 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-21e95b4c-3450-49de-89d8-62c84b13fdf7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:11.800985 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-21e95b4c-3450-49de-89d8-62c84b13fdf7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "POST /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24/action" status: 200 len: 24571 microversion: 2.1 time: 0.085255 Aug 07 02:22:11.801595 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3844/7219] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:22:11 2022] POST /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24/action => generated 24571 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 02:22:18.257771 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-307e8655-de10-45c9-9733-389903fa3813 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:22:18.258394 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-307e8655-de10-45c9-9733-389903fa3813 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 557c3473-463a-4915-baac-25ba87e05c24] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:22:18.260439 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:22:18.261150 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=30 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:22:18.267537 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-307e8655-de10-45c9-9733-389903fa3813 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:18.268050 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-307e8655-de10-45c9-9733-389903fa3813 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:18.268489 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-307e8655-de10-45c9-9733-389903fa3813 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:18.269190 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-307e8655-de10-45c9-9733-389903fa3813 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:18.269644 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-307e8655-de10-45c9-9733-389903fa3813 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:18.270068 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-307e8655-de10-45c9-9733-389903fa3813 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:18.336651 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-307e8655-de10-45c9-9733-389903fa3813 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "POST /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24/action" status: 202 len: 0 microversion: 2.1 time: 0.083364 Aug 07 02:22:18.337299 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3376/7220] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:22:18 2022] POST /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:22:18.346254 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-75dcce26-d5c8-49c8-a384-0b99ea82fb51 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:22:18.346983 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-75dcce26-d5c8-49c8-a384-0b99ea82fb51 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 557c3473-463a-4915-baac-25ba87e05c24] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:22:18.354812 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75dcce26-d5c8-49c8-a384-0b99ea82fb51 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:18.355329 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75dcce26-d5c8-49c8-a384-0b99ea82fb51 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:18.355775 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75dcce26-d5c8-49c8-a384-0b99ea82fb51 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:18.356532 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75dcce26-d5c8-49c8-a384-0b99ea82fb51 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:18.357005 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75dcce26-d5c8-49c8-a384-0b99ea82fb51 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:18.357447 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-75dcce26-d5c8-49c8-a384-0b99ea82fb51 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:18.492287 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-75dcce26-d5c8-49c8-a384-0b99ea82fb51 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:22:18.499836 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-75dcce26-d5c8-49c8-a384-0b99ea82fb51 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24" status: 200 len: 1686 microversion: 2.1 time: 0.157818 Aug 07 02:22:18.500425 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3845/7221] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:22:18 2022] GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24 => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:22:19.522557 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-105294ee-2805-42a7-8dde-1bfdaa6601f7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:22:19.523262 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-105294ee-2805-42a7-8dde-1bfdaa6601f7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 557c3473-463a-4915-baac-25ba87e05c24] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:22:19.529557 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-105294ee-2805-42a7-8dde-1bfdaa6601f7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:19.530035 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-105294ee-2805-42a7-8dde-1bfdaa6601f7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:19.530474 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-105294ee-2805-42a7-8dde-1bfdaa6601f7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:19.531165 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-105294ee-2805-42a7-8dde-1bfdaa6601f7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:19.531626 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-105294ee-2805-42a7-8dde-1bfdaa6601f7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:19.532087 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-105294ee-2805-42a7-8dde-1bfdaa6601f7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:19.673826 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-105294ee-2805-42a7-8dde-1bfdaa6601f7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:22:19.681295 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-105294ee-2805-42a7-8dde-1bfdaa6601f7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24" status: 200 len: 1666 microversion: 2.1 time: 0.163871 Aug 07 02:22:19.681856 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3377/7222] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:22:19 2022] GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24 => generated 1666 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:22:20.777043 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0b3c994a-9a5c-4083-a9e5-a6f3d978350d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:22:20.779205 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0b3c994a-9a5c-4083-a9e5-a6f3d978350d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 557c3473-463a-4915-baac-25ba87e05c24] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:22:20.786267 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b3c994a-9a5c-4083-a9e5-a6f3d978350d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:20.786776 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b3c994a-9a5c-4083-a9e5-a6f3d978350d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:20.787239 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b3c994a-9a5c-4083-a9e5-a6f3d978350d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:20.788012 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b3c994a-9a5c-4083-a9e5-a6f3d978350d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:20.788490 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b3c994a-9a5c-4083-a9e5-a6f3d978350d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:20.788941 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0b3c994a-9a5c-4083-a9e5-a6f3d978350d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:20.856461 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0b3c994a-9a5c-4083-a9e5-a6f3d978350d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "POST /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24/action" status: 200 len: 32650 microversion: 2.1 time: 0.083417 Aug 07 02:22:20.857132 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3846/7223] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:22:20 2022] POST /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24/action => generated 32650 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 02:22:20.869046 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7f16b905-cab3-4ac1-a26f-d350ae62985c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:22:20.869592 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7f16b905-cab3-4ac1-a26f-d350ae62985c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 557c3473-463a-4915-baac-25ba87e05c24] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:22:20.876509 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7f16b905-cab3-4ac1-a26f-d350ae62985c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:20.876996 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7f16b905-cab3-4ac1-a26f-d350ae62985c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:20.877439 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7f16b905-cab3-4ac1-a26f-d350ae62985c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:20.878144 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7f16b905-cab3-4ac1-a26f-d350ae62985c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:20.878601 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7f16b905-cab3-4ac1-a26f-d350ae62985c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:20.879035 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7f16b905-cab3-4ac1-a26f-d350ae62985c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:20.943395 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7f16b905-cab3-4ac1-a26f-d350ae62985c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "POST /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24/action" status: 202 len: 0 microversion: 2.1 time: 0.078092 Aug 07 02:22:20.944114 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3378/7224] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:22:20 2022] POST /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:22:20.953805 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-848b1e16-50b8-48f6-9bfc-edc5d54453fe tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:22:20.954540 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-848b1e16-50b8-48f6-9bfc-edc5d54453fe tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 557c3473-463a-4915-baac-25ba87e05c24] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:22:20.962210 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-848b1e16-50b8-48f6-9bfc-edc5d54453fe tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:20.962819 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-848b1e16-50b8-48f6-9bfc-edc5d54453fe tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:20.963390 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-848b1e16-50b8-48f6-9bfc-edc5d54453fe tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:20.964386 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-848b1e16-50b8-48f6-9bfc-edc5d54453fe tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:20.964868 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-848b1e16-50b8-48f6-9bfc-edc5d54453fe tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:20.965422 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-848b1e16-50b8-48f6-9bfc-edc5d54453fe tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:21.112825 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-848b1e16-50b8-48f6-9bfc-edc5d54453fe tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:22:21.121608 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-848b1e16-50b8-48f6-9bfc-edc5d54453fe tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24" status: 200 len: 1673 microversion: 2.1 time: 0.172017 Aug 07 02:22:21.122679 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3847/7225] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:22:20 2022] GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24 => generated 1673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:22:22.144916 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5bd64a9c-01dc-409b-82af-ed82eec25ddd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:22:22.145627 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5bd64a9c-01dc-409b-82af-ed82eec25ddd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 557c3473-463a-4915-baac-25ba87e05c24] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:22:22.151826 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5bd64a9c-01dc-409b-82af-ed82eec25ddd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:22.152345 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5bd64a9c-01dc-409b-82af-ed82eec25ddd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:22.152793 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5bd64a9c-01dc-409b-82af-ed82eec25ddd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:22.153495 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5bd64a9c-01dc-409b-82af-ed82eec25ddd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:22.153986 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5bd64a9c-01dc-409b-82af-ed82eec25ddd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:22.154419 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5bd64a9c-01dc-409b-82af-ed82eec25ddd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:22.284890 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5bd64a9c-01dc-409b-82af-ed82eec25ddd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:22:22.292459 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5bd64a9c-01dc-409b-82af-ed82eec25ddd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24" status: 200 len: 1681 microversion: 2.1 time: 0.152679 Aug 07 02:22:22.293029 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3379/7226] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:22:22 2022] GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:22:22.398212 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bae17bed-4905-46a1-b57e-cafc20a3a403 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:22:22.400584 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bae17bed-4905-46a1-b57e-cafc20a3a403 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 557c3473-463a-4915-baac-25ba87e05c24] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:22:22.408341 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bae17bed-4905-46a1-b57e-cafc20a3a403 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:22.408843 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bae17bed-4905-46a1-b57e-cafc20a3a403 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:22.410101 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bae17bed-4905-46a1-b57e-cafc20a3a403 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:22.411216 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bae17bed-4905-46a1-b57e-cafc20a3a403 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:22.411991 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bae17bed-4905-46a1-b57e-cafc20a3a403 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:22.412445 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bae17bed-4905-46a1-b57e-cafc20a3a403 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:22.473516 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bae17bed-4905-46a1-b57e-cafc20a3a403 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "POST /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24/action" status: 200 len: 35150 microversion: 2.1 time: 0.079278 Aug 07 02:22:22.474384 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3848/7227] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:22:22 2022] POST /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24/action => generated 35150 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 02:22:23.481709 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-aa4ac6e7-fe0f-44b4-92a2-f85cfe0d6ea6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:22:23.482219 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-aa4ac6e7-fe0f-44b4-92a2-f85cfe0d6ea6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 557c3473-463a-4915-baac-25ba87e05c24] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:22:23.484743 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-64fa66b4-706b-46b2-8b63-38759c96ec7e req-5f20923b-b82a-4d82-980d-a85b13b59703 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "557c3473-463a-4915-baac-25ba87e05c24", "tag": "1dcd1f07-c612-4956-86ef-011882753d42"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:22:23.489773 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa4ac6e7-fe0f-44b4-92a2-f85cfe0d6ea6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:23.490359 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa4ac6e7-fe0f-44b4-92a2-f85cfe0d6ea6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:23.490896 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa4ac6e7-fe0f-44b4-92a2-f85cfe0d6ea6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:23.491681 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa4ac6e7-fe0f-44b4-92a2-f85cfe0d6ea6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:23.492382 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa4ac6e7-fe0f-44b4-92a2-f85cfe0d6ea6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:23.493153 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-aa4ac6e7-fe0f-44b4-92a2-f85cfe0d6ea6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:23.495743 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-64fa66b4-706b-46b2-8b63-38759c96ec7e req-5f20923b-b82a-4d82-980d-a85b13b59703 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:23.496220 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-64fa66b4-706b-46b2-8b63-38759c96ec7e req-5f20923b-b82a-4d82-980d-a85b13b59703 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:23.496667 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-64fa66b4-706b-46b2-8b63-38759c96ec7e req-5f20923b-b82a-4d82-980d-a85b13b59703 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:23.507954 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-64fa66b4-706b-46b2-8b63-38759c96ec7e req-5f20923b-b82a-4d82-980d-a85b13b59703 service nova] Creating event network-changed:1dcd1f07-c612-4956-86ef-011882753d42 for instance 557c3473-463a-4915-baac-25ba87e05c24 on n-h1-master-1 Aug 07 02:22:23.512981 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-64fa66b4-706b-46b2-8b63-38759c96ec7e req-5f20923b-b82a-4d82-980d-a85b13b59703 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032227 Aug 07 02:22:23.514153 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3849/7228] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:22:23.521268 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-aa4ac6e7-fe0f-44b4-92a2-f85cfe0d6ea6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 557c3473-463a-4915-baac-25ba87e05c24] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 02:22:23.607527 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-aa4ac6e7-fe0f-44b4-92a2-f85cfe0d6ea6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "DELETE /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24" status: 204 len: 0 microversion: 2.1 time: 0.129472 Aug 07 02:22:23.608384 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3380/7229] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 02:22:23 2022] DELETE /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 07 02:22:23.621621 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8f742a67-fbde-4e07-bc7c-07bfd407874d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:22:23.622252 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8f742a67-fbde-4e07-bc7c-07bfd407874d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 557c3473-463a-4915-baac-25ba87e05c24] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:22:23.629170 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8f742a67-fbde-4e07-bc7c-07bfd407874d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:23.629661 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8f742a67-fbde-4e07-bc7c-07bfd407874d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:23.630121 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8f742a67-fbde-4e07-bc7c-07bfd407874d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:23.631002 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8f742a67-fbde-4e07-bc7c-07bfd407874d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:23.631745 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8f742a67-fbde-4e07-bc7c-07bfd407874d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:23.632216 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8f742a67-fbde-4e07-bc7c-07bfd407874d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:23.771630 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8f742a67-fbde-4e07-bc7c-07bfd407874d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:22:23.779664 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8f742a67-fbde-4e07-bc7c-07bfd407874d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24" status: 200 len: 1687 microversion: 2.1 time: 0.166028 Aug 07 02:22:23.780604 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3850/7230] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:22:23 2022] GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24 => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:22:24.802250 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6c7f3e16-b92c-4b36-a0e3-08ba857beebf tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:22:24.802912 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6c7f3e16-b92c-4b36-a0e3-08ba857beebf tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 557c3473-463a-4915-baac-25ba87e05c24] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:22:24.809812 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c7f3e16-b92c-4b36-a0e3-08ba857beebf tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:24.810301 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c7f3e16-b92c-4b36-a0e3-08ba857beebf tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:24.810745 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c7f3e16-b92c-4b36-a0e3-08ba857beebf tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:24.811446 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c7f3e16-b92c-4b36-a0e3-08ba857beebf tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:24.811933 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c7f3e16-b92c-4b36-a0e3-08ba857beebf tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:24.812372 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c7f3e16-b92c-4b36-a0e3-08ba857beebf tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:24.947391 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6c7f3e16-b92c-4b36-a0e3-08ba857beebf tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:22:24.954921 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6c7f3e16-b92c-4b36-a0e3-08ba857beebf tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24" status: 200 len: 1687 microversion: 2.1 time: 0.157058 Aug 07 02:22:24.955495 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3381/7231] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:22:24 2022] GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24 => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:22:25.975636 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-698061d3-399a-4a85-9947-b7144d3c0f11 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:22:25.981113 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-698061d3-399a-4a85-9947-b7144d3c0f11 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 557c3473-463a-4915-baac-25ba87e05c24] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:22:25.983757 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-698061d3-399a-4a85-9947-b7144d3c0f11 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:25.984139 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-698061d3-399a-4a85-9947-b7144d3c0f11 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:25.984648 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-698061d3-399a-4a85-9947-b7144d3c0f11 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:25.985391 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-698061d3-399a-4a85-9947-b7144d3c0f11 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:25.985925 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-698061d3-399a-4a85-9947-b7144d3c0f11 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:25.986373 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-698061d3-399a-4a85-9947-b7144d3c0f11 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:26.049431 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-6698ccef-00c2-4e0a-928c-5293b2a819dc req-cad5e6f1-b049-4f1e-965e-4bf7158502e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "557c3473-463a-4915-baac-25ba87e05c24", "name": "network-vif-deleted", "tag": "1dcd1f07-c612-4956-86ef-011882753d42"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:22:26.060752 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6698ccef-00c2-4e0a-928c-5293b2a819dc req-cad5e6f1-b049-4f1e-965e-4bf7158502e1 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:26.061166 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6698ccef-00c2-4e0a-928c-5293b2a819dc req-cad5e6f1-b049-4f1e-965e-4bf7158502e1 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:26.061512 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-6698ccef-00c2-4e0a-928c-5293b2a819dc req-cad5e6f1-b049-4f1e-965e-4bf7158502e1 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:26.063267 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-698061d3-399a-4a85-9947-b7144d3c0f11 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:22:26.072393 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-698061d3-399a-4a85-9947-b7144d3c0f11 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24" status: 200 len: 1502 microversion: 2.1 time: 0.100604 Aug 07 02:22:26.072990 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3851/7232] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:22:25 2022] GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24 => generated 1502 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:22:26.074029 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-6698ccef-00c2-4e0a-928c-5293b2a819dc req-cad5e6f1-b049-4f1e-965e-4bf7158502e1 service nova] Creating event network-vif-deleted:1dcd1f07-c612-4956-86ef-011882753d42 for instance 557c3473-463a-4915-baac-25ba87e05c24 on n-h1-master-1 Aug 07 02:22:26.084257 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-6698ccef-00c2-4e0a-928c-5293b2a819dc req-cad5e6f1-b049-4f1e-965e-4bf7158502e1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038565 Aug 07 02:22:26.085146 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3382/7233] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 02:22:27.097803 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fe1b1639-1719-470d-bab0-660bfa597097 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:22:27.098460 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fe1b1639-1719-470d-bab0-660bfa597097 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 557c3473-463a-4915-baac-25ba87e05c24] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:22:27.105711 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe1b1639-1719-470d-bab0-660bfa597097 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:27.106216 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe1b1639-1719-470d-bab0-660bfa597097 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:27.106680 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe1b1639-1719-470d-bab0-660bfa597097 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:27.107406 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe1b1639-1719-470d-bab0-660bfa597097 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:27.107889 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe1b1639-1719-470d-bab0-660bfa597097 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:27.108359 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fe1b1639-1719-470d-bab0-660bfa597097 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:27.123232 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-fe1b1639-1719-470d-bab0-660bfa597097 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] HTTP exception thrown: Instance 557c3473-463a-4915-baac-25ba87e05c24 could not be found. Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fe1b1639-1719-470d-bab0-660bfa597097 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Request method failure captured: Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24 HTTP/1.1 Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7yGo9nIX3qEj-GC52soqmMO003_AnhUEQWlYbBwmW48wYR9nonaaOBu70bfnR99EdmKWQxyfmPxnw6Fuy_0Yxw_ls14vmifAlaktPi3AkkIP7eQ_67sXUgaJsj9yijh1N8Op5mAQ_f2RZq8U6BV7sFxsqws-1fZBV3RlW1_agp8hmLM Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: a212f473f58c4fb680bdb8ad63bd56f1 Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-277973988 Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a212f473f58c4fb680bdb8ad63bd56f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a212f473f58c4fb680bdb8ad63bd56f1", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a212f473f58c4fb680bdb8ad63bd56f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a212f473f58c4fb680bdb8ad63bd56f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-TestNetworkAdvancedServerOps-277973988 Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: a212f473f58c4fb680bdb8ad63bd56f1 Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-277973988 Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-TestNetworkAdvancedServerOps-277973988-project Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: a2c21b7e0fa94a9eb7155caaf474b3b2 Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-TestNetworkAdvancedServerOps-277973988-project Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 557c3473-463a-4915-baac-25ba87e05c24 could not be found. Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '557c3473-463a-4915-baac-25ba87e05c24'} Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 557c3473-463a-4915-baac-25ba87e05c24 could not be found. Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 557c3473-463a-4915-baac-25ba87e05c24 could not be found. Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:22:27.126474 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:22:27.133771 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:22:27.133771 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:22:27.133771 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:22:27.133771 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:22:27.133771 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:22:27.133771 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:22:27.133771 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 557c3473-463a-4915-baac-25ba87e05c24 could not be found. Aug 07 02:22:27.133771 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:22:27.133771 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fe1b1639-1719-470d-bab0-660bfa597097 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Returning 404 to user: Instance 557c3473-463a-4915-baac-25ba87e05c24 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:22:27.133771 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fe1b1639-1719-470d-bab0-660bfa597097 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24" status: 404 len: 111 microversion: 2.1 time: 0.033531 Aug 07 02:22:27.135598 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3852/7234] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:22:27 2022] GET /compute/v2.1/servers/557c3473-463a-4915-baac-25ba87e05c24 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:22:30.347542 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ae8d8238-0182-46de-b35a-a18ab9b9abcf tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '.version_select at 0x7f9e246429d0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:22:30.369376 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ae8d8238-0182-46de-b35a-a18ab9b9abcf tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1831788199" status: 202 len: 0 microversion: 2.1 time: 0.027631 Aug 07 02:22:30.369982 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3383/7235] 10.222.0.39 () {58 vars in 1284 bytes} [Sun Aug 7 02:22:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1831788199 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:22:30.394000 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5ac02484-eeac-4cd6-b81a-b4b900e051e2 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Action: 'create', calling method: .version_select at 0x7f9e29969700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-697801649", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsNx6D0r9qno3RCiGKzqL5taMy8Kvxrw3529qZ1AO/uhalPm6D8kKL7MRBcM+1rZcoOrAqqasETPv41/NM60RFdTrHhm+b/Dl/f835cyBLLAvVeAnnQwuUXFqAQRgRnyQ=="}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:22:30.411511 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-5ac02484-eeac-4cd6-b81a-b4b900e051e2 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Getting quotas for project a212f473f58c4fb680bdb8ad63bd56f1. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:22:30.417623 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-5ac02484-eeac-4cd6-b81a-b4b900e051e2 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Getting quotas for user a2c21b7e0fa94a9eb7155caaf474b3b2 and project a212f473f58c4fb680bdb8ad63bd56f1. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:22:30.441094 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5ac02484-eeac-4cd6-b81a-b4b900e051e2 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.050995 Aug 07 02:22:30.441693 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3853/7236] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 02:22:30 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:22:36.137008 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f610e9a3-fc68-49e7-a83d-f6a5af67a380 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-914926985", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "0fd849ef-780e-400a-bbd3-590cd4b4ddfa"}], "key_name": "tempest-TestNetworkAdvancedServerOps-697801649", "security_groups": [{"name": "tempest-secgroup-smoke-1873687678"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:22:36.149426 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:22:36.249868 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-f610e9a3-fc68-49e7-a83d-f6a5af67a380 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] validate_networks() for [('0fd849ef-780e-400a-bbd3-590cd4b4ddfa', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 02:22:36.703413 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-f610e9a3-fc68-49e7-a83d-f6a5af67a380 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 02:22:36.705322 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-f610e9a3-fc68-49e7-a83d-f6a5af67a380 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 02:22:36.706368 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-f610e9a3-fc68-49e7-a83d-f6a5af67a380 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 02:22:36.707217 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-f610e9a3-fc68-49e7-a83d-f6a5af67a380 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 02:22:36.707541 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-f610e9a3-fc68-49e7-a83d-f6a5af67a380 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 02:22:36.738148 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f610e9a3-fc68-49e7-a83d-f6a5af67a380 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:36.739147 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f610e9a3-fc68-49e7-a83d-f6a5af67a380 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:36.739819 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f610e9a3-fc68-49e7-a83d-f6a5af67a380 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:36.740949 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f610e9a3-fc68-49e7-a83d-f6a5af67a380 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:36.741617 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f610e9a3-fc68-49e7-a83d-f6a5af67a380 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:36.742252 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f610e9a3-fc68-49e7-a83d-f6a5af67a380 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:36.767176 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-f610e9a3-fc68-49e7-a83d-f6a5af67a380 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Getting quotas for project a212f473f58c4fb680bdb8ad63bd56f1. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:22:36.773183 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-f610e9a3-fc68-49e7-a83d-f6a5af67a380 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Getting quotas for user a2c21b7e0fa94a9eb7155caaf474b3b2 and project a212f473f58c4fb680bdb8ad63bd56f1. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:22:36.787276 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f610e9a3-fc68-49e7-a83d-f6a5af67a380 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 02:22:36.789732 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f610e9a3-fc68-49e7-a83d-f6a5af67a380 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 02:22:36.841960 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f610e9a3-fc68-49e7-a83d-f6a5af67a380 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.708778 Aug 07 02:22:36.842837 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3384/7237] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 02:22:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 02:22:36.854742 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-83690971-ad0d-43cf-9793-aa75f003e967 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:22:36.856672 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-83690971-ad0d-43cf-9793-aa75f003e967 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:22:36.938538 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-83690971-ad0d-43cf-9793-aa75f003e967 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:22:36.957729 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-83690971-ad0d-43cf-9793-aa75f003e967 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63" status: 200 len: 1265 microversion: 2.1 time: 0.107004 Aug 07 02:22:36.983443 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3854/7238] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:22:36 2022] GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 => generated 1265 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:22:37.988432 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6dd2cd7a-1f7b-473f-8a03-dad6e45396d1 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:22:37.989058 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6dd2cd7a-1f7b-473f-8a03-dad6e45396d1 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:22:37.996879 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6dd2cd7a-1f7b-473f-8a03-dad6e45396d1 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:37.997690 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6dd2cd7a-1f7b-473f-8a03-dad6e45396d1 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:37.998443 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6dd2cd7a-1f7b-473f-8a03-dad6e45396d1 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:37.999176 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6dd2cd7a-1f7b-473f-8a03-dad6e45396d1 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:37.999650 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6dd2cd7a-1f7b-473f-8a03-dad6e45396d1 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:38.000234 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6dd2cd7a-1f7b-473f-8a03-dad6e45396d1 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:38.071113 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6dd2cd7a-1f7b-473f-8a03-dad6e45396d1 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:22:38.082938 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6dd2cd7a-1f7b-473f-8a03-dad6e45396d1 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63" status: 200 len: 1317 microversion: 2.1 time: 0.100726 Aug 07 02:22:38.083552 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3385/7239] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:22:37 2022] GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 => generated 1317 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:22:39.104914 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b040f645-458b-4897-b5b3-cb70b1d70c7e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:22:39.106990 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b040f645-458b-4897-b5b3-cb70b1d70c7e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:22:39.111266 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=40 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:22:39.118419 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b040f645-458b-4897-b5b3-cb70b1d70c7e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:39.119209 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b040f645-458b-4897-b5b3-cb70b1d70c7e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:39.119877 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b040f645-458b-4897-b5b3-cb70b1d70c7e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:39.120865 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b040f645-458b-4897-b5b3-cb70b1d70c7e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:39.121350 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b040f645-458b-4897-b5b3-cb70b1d70c7e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:39.121806 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b040f645-458b-4897-b5b3-cb70b1d70c7e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:39.326434 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b040f645-458b-4897-b5b3-cb70b1d70c7e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:22:39.345817 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b040f645-458b-4897-b5b3-cb70b1d70c7e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63" status: 200 len: 1391 microversion: 2.1 time: 0.244649 Aug 07 02:22:39.357231 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3855/7240] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:22:39 2022] GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 => generated 1391 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:22:40.329003 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-2a8c8569-c63f-4963-91c1-0a0337cabcbe req-8da32589-6c4f-403f-a772-35e7a4caa44b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41a1474d-a08c-41ce-8dc4-0d4b5daa1f63", "tag": "96584f85-2d02-4b90-8bee-8a88a9e4573d"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:22:40.342247 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-2a8c8569-c63f-4963-91c1-0a0337cabcbe req-8da32589-6c4f-403f-a772-35e7a4caa44b service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:40.343147 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-2a8c8569-c63f-4963-91c1-0a0337cabcbe req-8da32589-6c4f-403f-a772-35e7a4caa44b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:40.343693 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-2a8c8569-c63f-4963-91c1-0a0337cabcbe req-8da32589-6c4f-403f-a772-35e7a4caa44b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:40.357266 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-2a8c8569-c63f-4963-91c1-0a0337cabcbe req-8da32589-6c4f-403f-a772-35e7a4caa44b service nova] Creating event network-changed:96584f85-2d02-4b90-8bee-8a88a9e4573d for instance 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 on n-h1-master-1 Aug 07 02:22:40.362906 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-2a8c8569-c63f-4963-91c1-0a0337cabcbe req-8da32589-6c4f-403f-a772-35e7a4caa44b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037154 Aug 07 02:22:40.364212 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3386/7241] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:22:40.370060 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6edd10ab-899e-43f6-952c-7a831fd37ad9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:22:40.370709 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6edd10ab-899e-43f6-952c-7a831fd37ad9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:22:40.378997 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6edd10ab-899e-43f6-952c-7a831fd37ad9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:40.379510 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6edd10ab-899e-43f6-952c-7a831fd37ad9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:40.380001 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6edd10ab-899e-43f6-952c-7a831fd37ad9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:40.380739 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6edd10ab-899e-43f6-952c-7a831fd37ad9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:40.381215 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6edd10ab-899e-43f6-952c-7a831fd37ad9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:40.381660 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6edd10ab-899e-43f6-952c-7a831fd37ad9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:40.519319 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6edd10ab-899e-43f6-952c-7a831fd37ad9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:22:40.527170 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6edd10ab-899e-43f6-952c-7a831fd37ad9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63" status: 200 len: 1391 microversion: 2.1 time: 0.161454 Aug 07 02:22:40.527753 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3856/7242] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:22:40 2022] GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:22:41.550209 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-564bb7df-e08f-4926-8051-c059a150e0cc tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:22:41.550919 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-564bb7df-e08f-4926-8051-c059a150e0cc tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:22:41.557200 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-564bb7df-e08f-4926-8051-c059a150e0cc tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:41.557690 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-564bb7df-e08f-4926-8051-c059a150e0cc tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:41.558137 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-564bb7df-e08f-4926-8051-c059a150e0cc tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:41.558842 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-564bb7df-e08f-4926-8051-c059a150e0cc tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:41.559307 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-564bb7df-e08f-4926-8051-c059a150e0cc tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:41.559740 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-564bb7df-e08f-4926-8051-c059a150e0cc tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:41.749316 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-564bb7df-e08f-4926-8051-c059a150e0cc tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:22:41.756830 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-564bb7df-e08f-4926-8051-c059a150e0cc tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63" status: 200 len: 1391 microversion: 2.1 time: 0.212256 Aug 07 02:22:41.757398 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3387/7243] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:22:41 2022] GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 => generated 1391 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:22:42.777647 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5cf8f9cf-4c88-45c7-b4c0-01855a448152 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:22:42.778285 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5cf8f9cf-4c88-45c7-b4c0-01855a448152 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:22:42.781010 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:22:42.786444 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cf8f9cf-4c88-45c7-b4c0-01855a448152 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:42.786947 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cf8f9cf-4c88-45c7-b4c0-01855a448152 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:42.787409 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cf8f9cf-4c88-45c7-b4c0-01855a448152 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:42.788161 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cf8f9cf-4c88-45c7-b4c0-01855a448152 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:42.788642 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cf8f9cf-4c88-45c7-b4c0-01855a448152 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:42.789092 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5cf8f9cf-4c88-45c7-b4c0-01855a448152 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:42.922275 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5cf8f9cf-4c88-45c7-b4c0-01855a448152 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:22:42.930324 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5cf8f9cf-4c88-45c7-b4c0-01855a448152 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63" status: 200 len: 1391 microversion: 2.1 time: 0.156615 Aug 07 02:22:42.930899 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3857/7244] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:22:42 2022] GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:22:43.951735 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cae931d9-c8b3-46bc-a1c8-91de6f064b20 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:22:43.952415 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-cae931d9-c8b3-46bc-a1c8-91de6f064b20 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:22:43.960277 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cae931d9-c8b3-46bc-a1c8-91de6f064b20 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:43.960764 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cae931d9-c8b3-46bc-a1c8-91de6f064b20 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:43.961209 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cae931d9-c8b3-46bc-a1c8-91de6f064b20 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:43.961918 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cae931d9-c8b3-46bc-a1c8-91de6f064b20 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:43.962381 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cae931d9-c8b3-46bc-a1c8-91de6f064b20 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:43.962815 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cae931d9-c8b3-46bc-a1c8-91de6f064b20 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:44.100669 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-cae931d9-c8b3-46bc-a1c8-91de6f064b20 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:22:44.108122 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cae931d9-c8b3-46bc-a1c8-91de6f064b20 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63" status: 200 len: 1391 microversion: 2.1 time: 0.160315 Aug 07 02:22:44.108685 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3388/7245] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:22:43 2022] GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:22:45.130508 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ae547774-0a8b-480e-ab11-469745b09cc4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:22:45.131367 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ae547774-0a8b-480e-ab11-469745b09cc4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:22:45.138197 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ae547774-0a8b-480e-ab11-469745b09cc4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:45.138711 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ae547774-0a8b-480e-ab11-469745b09cc4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:45.139152 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ae547774-0a8b-480e-ab11-469745b09cc4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:45.139870 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ae547774-0a8b-480e-ab11-469745b09cc4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:45.140359 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ae547774-0a8b-480e-ab11-469745b09cc4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:45.140802 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ae547774-0a8b-480e-ab11-469745b09cc4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:45.244090 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-3197736a-3404-4ae8-b046-a8b48dd8203b req-4f866ea9-f71d-4108-8413-c75b9b495333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41a1474d-a08c-41ce-8dc4-0d4b5daa1f63", "name": "network-vif-plugged", "status": "completed", "tag": "96584f85-2d02-4b90-8bee-8a88a9e4573d"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:22:45.258591 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3197736a-3404-4ae8-b046-a8b48dd8203b req-4f866ea9-f71d-4108-8413-c75b9b495333 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:45.259081 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3197736a-3404-4ae8-b046-a8b48dd8203b req-4f866ea9-f71d-4108-8413-c75b9b495333 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:45.259777 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3197736a-3404-4ae8-b046-a8b48dd8203b req-4f866ea9-f71d-4108-8413-c75b9b495333 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:45.271655 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-3197736a-3404-4ae8-b046-a8b48dd8203b req-4f866ea9-f71d-4108-8413-c75b9b495333 service nova] Creating event network-vif-plugged:96584f85-2d02-4b90-8bee-8a88a9e4573d for instance 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 on n-h1-master-1 Aug 07 02:22:45.276716 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-3197736a-3404-4ae8-b046-a8b48dd8203b req-4f866ea9-f71d-4108-8413-c75b9b495333 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037039 Aug 07 02:22:45.277317 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3389/7246] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:22:45.286389 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ae547774-0a8b-480e-ab11-469745b09cc4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:22:45.294404 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ae547774-0a8b-480e-ab11-469745b09cc4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63" status: 200 len: 1391 microversion: 2.1 time: 0.169497 Aug 07 02:22:45.295367 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3858/7247] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:22:45 2022] GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:22:46.317068 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-105466e8-bb66-4223-8fdf-b164f384b3b7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:22:46.317805 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-105466e8-bb66-4223-8fdf-b164f384b3b7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:22:46.324093 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-105466e8-bb66-4223-8fdf-b164f384b3b7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:46.324578 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-105466e8-bb66-4223-8fdf-b164f384b3b7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:46.325028 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-105466e8-bb66-4223-8fdf-b164f384b3b7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:46.325722 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-105466e8-bb66-4223-8fdf-b164f384b3b7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:46.326183 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-105466e8-bb66-4223-8fdf-b164f384b3b7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:46.326616 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-105466e8-bb66-4223-8fdf-b164f384b3b7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:46.465941 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-105466e8-bb66-4223-8fdf-b164f384b3b7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:22:46.473990 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-105466e8-bb66-4223-8fdf-b164f384b3b7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63" status: 200 len: 1391 microversion: 2.1 time: 0.162088 Aug 07 02:22:46.474648 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3390/7248] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:22:46 2022] GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:22:47.496263 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-90cb89ba-9f0e-4a25-9f6b-9af07c3b8b30 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:22:47.496899 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-90cb89ba-9f0e-4a25-9f6b-9af07c3b8b30 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:22:47.499636 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:22:47.506830 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90cb89ba-9f0e-4a25-9f6b-9af07c3b8b30 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:47.507335 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90cb89ba-9f0e-4a25-9f6b-9af07c3b8b30 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:47.507786 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90cb89ba-9f0e-4a25-9f6b-9af07c3b8b30 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:47.508583 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90cb89ba-9f0e-4a25-9f6b-9af07c3b8b30 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:47.509060 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90cb89ba-9f0e-4a25-9f6b-9af07c3b8b30 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:47.509504 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-90cb89ba-9f0e-4a25-9f6b-9af07c3b8b30 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:47.642323 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-90cb89ba-9f0e-4a25-9f6b-9af07c3b8b30 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:22:47.650167 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-90cb89ba-9f0e-4a25-9f6b-9af07c3b8b30 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63" status: 200 len: 1564 microversion: 2.1 time: 0.157909 Aug 07 02:22:47.650736 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3859/7249] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:22:47 2022] GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:22:47.670073 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-968840ef-ed87-4d9d-ba27-58463e58489f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:22:47.670669 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-968840ef-ed87-4d9d-ba27-58463e58489f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:22:47.672641 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:22:47.673305 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:22:47.680335 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-968840ef-ed87-4d9d-ba27-58463e58489f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:47.680813 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-968840ef-ed87-4d9d-ba27-58463e58489f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:47.681246 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-968840ef-ed87-4d9d-ba27-58463e58489f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:47.681940 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-968840ef-ed87-4d9d-ba27-58463e58489f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:47.682394 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-968840ef-ed87-4d9d-ba27-58463e58489f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:47.682816 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-968840ef-ed87-4d9d-ba27-58463e58489f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:47.824264 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-968840ef-ed87-4d9d-ba27-58463e58489f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:22:47.831917 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-968840ef-ed87-4d9d-ba27-58463e58489f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63" status: 200 len: 1564 microversion: 2.1 time: 0.165685 Aug 07 02:22:47.832696 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3391/7250] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:22:47 2022] GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 => generated 1564 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:22:49.712450 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9e1c20a8-0050-4867-b5db-563abeb985fb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:22:49.713179 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9e1c20a8-0050-4867-b5db-563abeb985fb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:22:49.714409 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-0c8759c1-7c60-49b0-924f-63b92fdf7efc req-ed2e1feb-961a-4179-8c2f-26bb6f08efac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41a1474d-a08c-41ce-8dc4-0d4b5daa1f63", "tag": "96584f85-2d02-4b90-8bee-8a88a9e4573d"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:22:49.719509 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e1c20a8-0050-4867-b5db-563abeb985fb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:49.720115 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e1c20a8-0050-4867-b5db-563abeb985fb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:49.720795 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e1c20a8-0050-4867-b5db-563abeb985fb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:49.721747 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e1c20a8-0050-4867-b5db-563abeb985fb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:49.721997 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:22:49.722711 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e1c20a8-0050-4867-b5db-563abeb985fb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:49.723477 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9e1c20a8-0050-4867-b5db-563abeb985fb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:49.725875 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0c8759c1-7c60-49b0-924f-63b92fdf7efc req-ed2e1feb-961a-4179-8c2f-26bb6f08efac service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:22:49.726350 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0c8759c1-7c60-49b0-924f-63b92fdf7efc req-ed2e1feb-961a-4179-8c2f-26bb6f08efac service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:22:49.726778 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0c8759c1-7c60-49b0-924f-63b92fdf7efc req-ed2e1feb-961a-4179-8c2f-26bb6f08efac service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:22:49.739429 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-0c8759c1-7c60-49b0-924f-63b92fdf7efc req-ed2e1feb-961a-4179-8c2f-26bb6f08efac service nova] Creating event network-changed:96584f85-2d02-4b90-8bee-8a88a9e4573d for instance 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 on n-h1-master-1 Aug 07 02:22:49.748465 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-0c8759c1-7c60-49b0-924f-63b92fdf7efc req-ed2e1feb-961a-4179-8c2f-26bb6f08efac service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037560 Aug 07 02:22:49.749066 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3392/7251] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 02:22:49.944365 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9e1c20a8-0050-4867-b5db-563abeb985fb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:22:49.954435 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9e1c20a8-0050-4867-b5db-563abeb985fb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63" status: 200 len: 1564 microversion: 2.1 time: 0.246619 Aug 07 02:22:49.955354 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3860/7252] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:22:49 2022] GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 => generated 1564 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:23:11.245421 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=38 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:23:11.250549 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6c32191b-ef4d-44b4-a01a-d0ed0cf87371 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:23:11.252838 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6c32191b-ef4d-44b4-a01a-d0ed0cf87371 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:23:11.260884 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c32191b-ef4d-44b4-a01a-d0ed0cf87371 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:23:11.261369 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c32191b-ef4d-44b4-a01a-d0ed0cf87371 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:23:11.261808 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c32191b-ef4d-44b4-a01a-d0ed0cf87371 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:23:11.262502 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c32191b-ef4d-44b4-a01a-d0ed0cf87371 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:23:11.262963 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c32191b-ef4d-44b4-a01a-d0ed0cf87371 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:23:11.263389 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6c32191b-ef4d-44b4-a01a-d0ed0cf87371 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:23:11.333612 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6c32191b-ef4d-44b4-a01a-d0ed0cf87371 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "POST /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63/action" status: 200 len: 24532 microversion: 2.1 time: 0.090127 Aug 07 02:23:11.334253 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3393/7253] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:23:11 2022] POST /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63/action => generated 24532 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 02:23:17.680874 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-51a94e0f-d9eb-4243-bd7c-594614e60870 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:23:17.683087 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-51a94e0f-d9eb-4243-bd7c-594614e60870 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:23:17.685757 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=7 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:23:17.686422 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=36 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:23:17.691995 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51a94e0f-d9eb-4243-bd7c-594614e60870 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:23:17.692489 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51a94e0f-d9eb-4243-bd7c-594614e60870 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:23:17.692940 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51a94e0f-d9eb-4243-bd7c-594614e60870 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:23:17.693639 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51a94e0f-d9eb-4243-bd7c-594614e60870 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:23:17.694105 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51a94e0f-d9eb-4243-bd7c-594614e60870 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:23:17.694543 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-51a94e0f-d9eb-4243-bd7c-594614e60870 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:23:17.767600 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-51a94e0f-d9eb-4243-bd7c-594614e60870 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "POST /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63/action" status: 202 len: 0 microversion: 2.1 time: 0.091098 Aug 07 02:23:17.768306 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3861/7254] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:23:17 2022] POST /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:23:17.777020 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-52f154f8-5a6e-473f-b4d1-e912d328ed7a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:23:17.778299 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-52f154f8-5a6e-473f-b4d1-e912d328ed7a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:23:17.785752 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52f154f8-5a6e-473f-b4d1-e912d328ed7a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:23:17.786236 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52f154f8-5a6e-473f-b4d1-e912d328ed7a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:23:17.786678 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52f154f8-5a6e-473f-b4d1-e912d328ed7a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:23:17.787392 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52f154f8-5a6e-473f-b4d1-e912d328ed7a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:23:17.788426 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52f154f8-5a6e-473f-b4d1-e912d328ed7a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:23:17.788847 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-52f154f8-5a6e-473f-b4d1-e912d328ed7a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:23:18.051060 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-52f154f8-5a6e-473f-b4d1-e912d328ed7a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:23:18.059085 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-52f154f8-5a6e-473f-b4d1-e912d328ed7a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63" status: 200 len: 1674 microversion: 2.1 time: 0.286242 Aug 07 02:23:18.059669 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3394/7255] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:23:17 2022] GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 => generated 1674 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:23:19.081312 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-249dffe9-27d5-416f-9f38-c0f4972cc28a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:23:19.082041 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-249dffe9-27d5-416f-9f38-c0f4972cc28a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:23:19.089713 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-249dffe9-27d5-416f-9f38-c0f4972cc28a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:23:19.090240 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-249dffe9-27d5-416f-9f38-c0f4972cc28a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:23:19.090672 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-249dffe9-27d5-416f-9f38-c0f4972cc28a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:23:19.091392 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-249dffe9-27d5-416f-9f38-c0f4972cc28a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:23:19.091868 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-249dffe9-27d5-416f-9f38-c0f4972cc28a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:23:19.092341 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-249dffe9-27d5-416f-9f38-c0f4972cc28a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:23:19.225939 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-249dffe9-27d5-416f-9f38-c0f4972cc28a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:23:19.234596 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-249dffe9-27d5-416f-9f38-c0f4972cc28a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63" status: 200 len: 1679 microversion: 2.1 time: 0.157773 Aug 07 02:23:19.235184 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3862/7256] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:23:19 2022] GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:23:20.258123 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-195277df-2389-4e6b-8587-27ae66c90366 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:23:20.258687 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-195277df-2389-4e6b-8587-27ae66c90366 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:23:20.266539 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-195277df-2389-4e6b-8587-27ae66c90366 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:23:20.267031 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-195277df-2389-4e6b-8587-27ae66c90366 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:23:20.267477 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-195277df-2389-4e6b-8587-27ae66c90366 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:23:20.268215 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-195277df-2389-4e6b-8587-27ae66c90366 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:23:20.268677 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-195277df-2389-4e6b-8587-27ae66c90366 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:23:20.269139 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-195277df-2389-4e6b-8587-27ae66c90366 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:23:20.401588 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-195277df-2389-4e6b-8587-27ae66c90366 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:23:20.409486 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-195277df-2389-4e6b-8587-27ae66c90366 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63" status: 200 len: 1679 microversion: 2.1 time: 0.156011 Aug 07 02:23:20.410065 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3395/7257] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:23:20 2022] GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:23:21.430576 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-42ae7502-bd09-433f-919e-ba79dba0a224 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:23:21.431239 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-42ae7502-bd09-433f-919e-ba79dba0a224 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:23:21.437935 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42ae7502-bd09-433f-919e-ba79dba0a224 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:23:21.438470 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42ae7502-bd09-433f-919e-ba79dba0a224 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:23:21.438927 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42ae7502-bd09-433f-919e-ba79dba0a224 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:23:21.439672 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42ae7502-bd09-433f-919e-ba79dba0a224 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:23:21.440174 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42ae7502-bd09-433f-919e-ba79dba0a224 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:23:21.440620 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-42ae7502-bd09-433f-919e-ba79dba0a224 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:23:21.575007 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-42ae7502-bd09-433f-919e-ba79dba0a224 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:23:21.582606 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-42ae7502-bd09-433f-919e-ba79dba0a224 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63" status: 200 len: 1679 microversion: 2.1 time: 0.156040 Aug 07 02:23:21.583172 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3863/7258] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:23:21 2022] GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:23:22.605179 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2925b3b3-8a3b-4980-885a-893337a16928 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:23:22.605793 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2925b3b3-8a3b-4980-885a-893337a16928 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:23:22.612925 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2925b3b3-8a3b-4980-885a-893337a16928 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:23:22.613415 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2925b3b3-8a3b-4980-885a-893337a16928 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:23:22.613861 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2925b3b3-8a3b-4980-885a-893337a16928 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:23:22.614575 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2925b3b3-8a3b-4980-885a-893337a16928 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:23:22.615037 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2925b3b3-8a3b-4980-885a-893337a16928 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:23:22.615472 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2925b3b3-8a3b-4980-885a-893337a16928 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:23:22.745122 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2925b3b3-8a3b-4980-885a-893337a16928 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:23:22.755593 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2925b3b3-8a3b-4980-885a-893337a16928 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63" status: 200 len: 1679 microversion: 2.1 time: 0.154908 Aug 07 02:23:22.756200 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3396/7259] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:23:22 2022] GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:23:23.777580 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b0a1b6a0-1b22-48b8-b229-d6491986219c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:23:23.778217 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b0a1b6a0-1b22-48b8-b229-d6491986219c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:23:23.785270 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b0a1b6a0-1b22-48b8-b229-d6491986219c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:23:23.785770 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b0a1b6a0-1b22-48b8-b229-d6491986219c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:23:23.786224 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b0a1b6a0-1b22-48b8-b229-d6491986219c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:23:23.786943 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b0a1b6a0-1b22-48b8-b229-d6491986219c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:23:23.787419 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b0a1b6a0-1b22-48b8-b229-d6491986219c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:23:23.788457 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b0a1b6a0-1b22-48b8-b229-d6491986219c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:23:23.922533 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b0a1b6a0-1b22-48b8-b229-d6491986219c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:23:23.930692 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b0a1b6a0-1b22-48b8-b229-d6491986219c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63" status: 200 len: 1679 microversion: 2.1 time: 0.157129 Aug 07 02:23:23.931256 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3864/7260] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:23:23 2022] GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:23:24.951729 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c11d9faf-9ecd-4129-9610-4b9f0bc3c2c5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:23:24.952376 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c11d9faf-9ecd-4129-9610-4b9f0bc3c2c5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:23:24.959386 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c11d9faf-9ecd-4129-9610-4b9f0bc3c2c5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:23:24.959873 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c11d9faf-9ecd-4129-9610-4b9f0bc3c2c5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:23:24.960339 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c11d9faf-9ecd-4129-9610-4b9f0bc3c2c5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:23:24.961036 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c11d9faf-9ecd-4129-9610-4b9f0bc3c2c5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:23:24.961504 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c11d9faf-9ecd-4129-9610-4b9f0bc3c2c5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:23:24.961940 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c11d9faf-9ecd-4129-9610-4b9f0bc3c2c5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:23:25.096205 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c11d9faf-9ecd-4129-9610-4b9f0bc3c2c5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:23:25.104217 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c11d9faf-9ecd-4129-9610-4b9f0bc3c2c5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63" status: 200 len: 1679 microversion: 2.1 time: 0.156421 Aug 07 02:23:25.104785 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3397/7261] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:23:24 2022] GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:23:26.126095 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-cf4849a5-cced-45e7-af0b-3a0bc79028ef tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:23:26.126672 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-cf4849a5-cced-45e7-af0b-3a0bc79028ef tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:23:26.134171 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cf4849a5-cced-45e7-af0b-3a0bc79028ef tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:23:26.134671 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cf4849a5-cced-45e7-af0b-3a0bc79028ef tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:23:26.135131 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cf4849a5-cced-45e7-af0b-3a0bc79028ef tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:23:26.135849 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cf4849a5-cced-45e7-af0b-3a0bc79028ef tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:23:26.136346 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cf4849a5-cced-45e7-af0b-3a0bc79028ef tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:23:26.136794 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-cf4849a5-cced-45e7-af0b-3a0bc79028ef tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:23:26.266563 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-cf4849a5-cced-45e7-af0b-3a0bc79028ef tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:23:26.274038 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-cf4849a5-cced-45e7-af0b-3a0bc79028ef tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63" status: 200 len: 1679 microversion: 2.1 time: 0.152024 Aug 07 02:23:26.274606 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3865/7262] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:23:26 2022] GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:23:27.294649 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1acd997b-6c52-4a97-8fba-e7d87f855987 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:23:27.295187 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1acd997b-6c52-4a97-8fba-e7d87f855987 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:23:27.301913 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1acd997b-6c52-4a97-8fba-e7d87f855987 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:23:27.302391 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1acd997b-6c52-4a97-8fba-e7d87f855987 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:23:27.302826 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1acd997b-6c52-4a97-8fba-e7d87f855987 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:23:27.303512 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1acd997b-6c52-4a97-8fba-e7d87f855987 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:23:27.303993 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1acd997b-6c52-4a97-8fba-e7d87f855987 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:23:27.304418 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1acd997b-6c52-4a97-8fba-e7d87f855987 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:23:27.438513 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1acd997b-6c52-4a97-8fba-e7d87f855987 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:23:27.446618 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1acd997b-6c52-4a97-8fba-e7d87f855987 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63" status: 200 len: 1679 microversion: 2.1 time: 0.155931 Aug 07 02:23:27.447327 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3398/7263] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:23:27 2022] GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:23:28.470680 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9a36e1f1-8463-4211-a929-ddd052a3f9c3 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:23:28.471222 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9a36e1f1-8463-4211-a929-ddd052a3f9c3 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:23:28.478984 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9a36e1f1-8463-4211-a929-ddd052a3f9c3 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:23:28.479634 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9a36e1f1-8463-4211-a929-ddd052a3f9c3 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:23:28.479945 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9a36e1f1-8463-4211-a929-ddd052a3f9c3 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:23:28.480673 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9a36e1f1-8463-4211-a929-ddd052a3f9c3 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:23:28.481141 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9a36e1f1-8463-4211-a929-ddd052a3f9c3 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:23:28.481674 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9a36e1f1-8463-4211-a929-ddd052a3f9c3 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:23:28.618591 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9a36e1f1-8463-4211-a929-ddd052a3f9c3 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:23:28.626544 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9a36e1f1-8463-4211-a929-ddd052a3f9c3 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63" status: 200 len: 1679 microversion: 2.1 time: 0.159904 Aug 07 02:23:28.627119 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3866/7264] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:23:28 2022] GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:23:29.647465 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7e4d1cdd-98b2-445c-992e-6955bfba373f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:23:29.648112 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7e4d1cdd-98b2-445c-992e-6955bfba373f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:23:29.654870 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e4d1cdd-98b2-445c-992e-6955bfba373f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:23:29.655348 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e4d1cdd-98b2-445c-992e-6955bfba373f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:23:29.655786 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e4d1cdd-98b2-445c-992e-6955bfba373f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:23:29.656496 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e4d1cdd-98b2-445c-992e-6955bfba373f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:23:29.656954 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e4d1cdd-98b2-445c-992e-6955bfba373f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:23:29.657376 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7e4d1cdd-98b2-445c-992e-6955bfba373f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:23:29.785661 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7e4d1cdd-98b2-445c-992e-6955bfba373f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:23:29.793724 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7e4d1cdd-98b2-445c-992e-6955bfba373f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63" status: 200 len: 1682 microversion: 2.1 time: 0.150158 Aug 07 02:23:29.794292 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3399/7265] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:23:29 2022] GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:23:53.995948 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-01aceb8d-2392-4956-8fab-013bacf9e931 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:23:53.998163 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-01aceb8d-2392-4956-8fab-013bacf9e931 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:23:54.000378 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=12 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:23:54.001083 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:23:54.007363 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-01aceb8d-2392-4956-8fab-013bacf9e931 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:23:54.007870 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-01aceb8d-2392-4956-8fab-013bacf9e931 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:23:54.008348 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-01aceb8d-2392-4956-8fab-013bacf9e931 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:23:54.009075 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-01aceb8d-2392-4956-8fab-013bacf9e931 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:23:54.009547 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-01aceb8d-2392-4956-8fab-013bacf9e931 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:23:54.010044 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-01aceb8d-2392-4956-8fab-013bacf9e931 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:23:54.086901 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-01aceb8d-2392-4956-8fab-013bacf9e931 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "POST /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63/action" status: 200 len: 69105 microversion: 2.1 time: 0.094982 Aug 07 02:23:54.087595 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3867/7266] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:23:53 2022] POST /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63/action => generated 69105 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 02:24:01.160614 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5a8b5266-5ba3-48d1-9518-137a74c7e558 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:24:01.161119 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5a8b5266-5ba3-48d1-9518-137a74c7e558 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:24:01.169385 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-46a54925-0266-43c1-a442-e89ed28c1d87 req-12cc3a97-7c87-44ca-9fed-4d73eca47f27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41a1474d-a08c-41ce-8dc4-0d4b5daa1f63", "tag": "96584f85-2d02-4b90-8bee-8a88a9e4573d"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:24:01.174941 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=15 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:24:01.175943 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=40 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:24:01.181596 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-46a54925-0266-43c1-a442-e89ed28c1d87 req-12cc3a97-7c87-44ca-9fed-4d73eca47f27 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:01.182107 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-46a54925-0266-43c1-a442-e89ed28c1d87 req-12cc3a97-7c87-44ca-9fed-4d73eca47f27 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:01.182550 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-46a54925-0266-43c1-a442-e89ed28c1d87 req-12cc3a97-7c87-44ca-9fed-4d73eca47f27 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:01.184699 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a8b5266-5ba3-48d1-9518-137a74c7e558 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:01.185201 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a8b5266-5ba3-48d1-9518-137a74c7e558 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:01.185662 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a8b5266-5ba3-48d1-9518-137a74c7e558 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:01.186379 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a8b5266-5ba3-48d1-9518-137a74c7e558 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:01.186845 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a8b5266-5ba3-48d1-9518-137a74c7e558 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:01.187284 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5a8b5266-5ba3-48d1-9518-137a74c7e558 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:01.194710 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-46a54925-0266-43c1-a442-e89ed28c1d87 req-12cc3a97-7c87-44ca-9fed-4d73eca47f27 service nova] Creating event network-changed:96584f85-2d02-4b90-8bee-8a88a9e4573d for instance 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 on n-h1-master-1 Aug 07 02:24:01.200003 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-46a54925-0266-43c1-a442-e89ed28c1d87 req-12cc3a97-7c87-44ca-9fed-4d73eca47f27 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034441 Aug 07 02:24:01.200819 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3868/7267] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:24:01.215228 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5a8b5266-5ba3-48d1-9518-137a74c7e558 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 02:24:01.296218 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5a8b5266-5ba3-48d1-9518-137a74c7e558 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "DELETE /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63" status: 204 len: 0 microversion: 2.1 time: 0.139322 Aug 07 02:24:01.297237 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3400/7268] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 02:24:01 2022] DELETE /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 02:24:01.307301 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8863f3b5-4940-4747-bd5d-16b110e61224 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:24:01.308071 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8863f3b5-4940-4747-bd5d-16b110e61224 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:24:01.315539 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8863f3b5-4940-4747-bd5d-16b110e61224 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:01.316255 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8863f3b5-4940-4747-bd5d-16b110e61224 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:01.316809 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8863f3b5-4940-4747-bd5d-16b110e61224 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:01.317648 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8863f3b5-4940-4747-bd5d-16b110e61224 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:01.318265 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8863f3b5-4940-4747-bd5d-16b110e61224 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:01.318796 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8863f3b5-4940-4747-bd5d-16b110e61224 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:01.463601 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8863f3b5-4940-4747-bd5d-16b110e61224 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:24:01.471965 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8863f3b5-4940-4747-bd5d-16b110e61224 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63" status: 200 len: 1688 microversion: 2.1 time: 0.170220 Aug 07 02:24:01.472716 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3869/7269] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:24:01 2022] GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:24:02.496190 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-812de9e0-1981-4b2e-82a7-73d87c691768 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:24:02.496810 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-812de9e0-1981-4b2e-82a7-73d87c691768 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:24:02.502731 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-812de9e0-1981-4b2e-82a7-73d87c691768 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:02.503206 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-812de9e0-1981-4b2e-82a7-73d87c691768 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:02.503642 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-812de9e0-1981-4b2e-82a7-73d87c691768 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:02.504348 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-812de9e0-1981-4b2e-82a7-73d87c691768 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:02.504803 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-812de9e0-1981-4b2e-82a7-73d87c691768 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:02.505255 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-812de9e0-1981-4b2e-82a7-73d87c691768 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:02.698547 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-812de9e0-1981-4b2e-82a7-73d87c691768 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:24:02.706112 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-812de9e0-1981-4b2e-82a7-73d87c691768 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63" status: 200 len: 1688 microversion: 2.1 time: 0.215252 Aug 07 02:24:02.706688 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3401/7270] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:24:02 2022] GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 => generated 1688 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:24:03.551845 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-33f82d07-2a6b-4500-816b-4e17301ee6e8 req-5c05fb1a-d0c1-488a-8266-5769c0e3d84b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41a1474d-a08c-41ce-8dc4-0d4b5daa1f63", "name": "network-vif-deleted", "tag": "96584f85-2d02-4b90-8bee-8a88a9e4573d"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:24:03.562889 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-33f82d07-2a6b-4500-816b-4e17301ee6e8 req-5c05fb1a-d0c1-488a-8266-5769c0e3d84b service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:03.563384 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-33f82d07-2a6b-4500-816b-4e17301ee6e8 req-5c05fb1a-d0c1-488a-8266-5769c0e3d84b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:03.563835 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-33f82d07-2a6b-4500-816b-4e17301ee6e8 req-5c05fb1a-d0c1-488a-8266-5769c0e3d84b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:03.575166 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-33f82d07-2a6b-4500-816b-4e17301ee6e8 req-5c05fb1a-d0c1-488a-8266-5769c0e3d84b service nova] Creating event network-vif-deleted:96584f85-2d02-4b90-8bee-8a88a9e4573d for instance 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 on n-h1-master-1 Aug 07 02:24:03.580017 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-33f82d07-2a6b-4500-816b-4e17301ee6e8 req-5c05fb1a-d0c1-488a-8266-5769c0e3d84b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098555 Aug 07 02:24:03.580611 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3870/7271] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 02:24:03.727670 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9257f7c4-6f1d-4f83-8b08-cd91ab518f3b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:24:03.728239 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9257f7c4-6f1d-4f83-8b08-cd91ab518f3b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:24:03.735026 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9257f7c4-6f1d-4f83-8b08-cd91ab518f3b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:03.735508 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9257f7c4-6f1d-4f83-8b08-cd91ab518f3b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:03.735973 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9257f7c4-6f1d-4f83-8b08-cd91ab518f3b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:03.736679 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9257f7c4-6f1d-4f83-8b08-cd91ab518f3b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:03.737144 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9257f7c4-6f1d-4f83-8b08-cd91ab518f3b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:03.737574 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9257f7c4-6f1d-4f83-8b08-cd91ab518f3b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:03.771150 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9257f7c4-6f1d-4f83-8b08-cd91ab518f3b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:03.771640 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9257f7c4-6f1d-4f83-8b08-cd91ab518f3b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:03.772111 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9257f7c4-6f1d-4f83-8b08-cd91ab518f3b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:03.772569 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-9257f7c4-6f1d-4f83-8b08-cd91ab518f3b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lazy-loading 'fault' on Instance uuid 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 02:24:03.814865 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9257f7c4-6f1d-4f83-8b08-cd91ab518f3b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:24:03.830880 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9257f7c4-6f1d-4f83-8b08-cd91ab518f3b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63" status: 200 len: 1355 microversion: 2.1 time: 0.107121 Aug 07 02:24:03.831961 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3402/7272] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:24:03 2022] GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 => generated 1355 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:24:04.854371 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-74f2bb2d-d013-472b-b865-8ef2ffdcb0c8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:24:04.855091 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-74f2bb2d-d013-472b-b865-8ef2ffdcb0c8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:24:04.861354 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-74f2bb2d-d013-472b-b865-8ef2ffdcb0c8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:04.861851 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-74f2bb2d-d013-472b-b865-8ef2ffdcb0c8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:04.862305 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-74f2bb2d-d013-472b-b865-8ef2ffdcb0c8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:04.863017 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-74f2bb2d-d013-472b-b865-8ef2ffdcb0c8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:04.863490 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-74f2bb2d-d013-472b-b865-8ef2ffdcb0c8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:04.863959 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-74f2bb2d-d013-472b-b865-8ef2ffdcb0c8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:04.877199 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-74f2bb2d-d013-472b-b865-8ef2ffdcb0c8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] HTTP exception thrown: Instance 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 could not be found. Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-74f2bb2d-d013-472b-b865-8ef2ffdcb0c8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Request method failure captured: Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 HTTP/1.1 Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7yGo9nIX3qEj-GC52soqmMO003_AnhUEQWlYbBwmW48wYR9nonaaOBu70bfnR99EdmKWQxyfmPxnw6Fuy_0Yxw_ls14vmifAlaktPi3AkkIP7eQ_67sXUgaJsj9yijh1N8Op5mAQ_f2RZq8U6BV7sFxsqws-1fZBV3RlW1_agp8hmLM Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: a212f473f58c4fb680bdb8ad63bd56f1 Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-277973988 Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a212f473f58c4fb680bdb8ad63bd56f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a212f473f58c4fb680bdb8ad63bd56f1", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a212f473f58c4fb680bdb8ad63bd56f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a212f473f58c4fb680bdb8ad63bd56f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-TestNetworkAdvancedServerOps-277973988 Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: a212f473f58c4fb680bdb8ad63bd56f1 Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-277973988 Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-TestNetworkAdvancedServerOps-277973988-project Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: a2c21b7e0fa94a9eb7155caaf474b3b2 Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-TestNetworkAdvancedServerOps-277973988-project Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 could not be found. Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '41a1474d-a08c-41ce-8dc4-0d4b5daa1f63'} Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 could not be found. Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 could not be found. Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:24:04.878822 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:24:04.883670 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:24:04.883670 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:24:04.883670 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:24:04.883670 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:24:04.883670 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:24:04.883670 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:24:04.883670 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 could not be found. Aug 07 02:24:04.883670 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:24:04.883670 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-74f2bb2d-d013-472b-b865-8ef2ffdcb0c8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Returning 404 to user: Instance 41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:24:04.883670 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-74f2bb2d-d013-472b-b865-8ef2ffdcb0c8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63" status: 404 len: 111 microversion: 2.1 time: 0.031158 Aug 07 02:24:04.883670 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3871/7273] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:24:04 2022] GET /compute/v2.1/servers/41a1474d-a08c-41ce-8dc4-0d4b5daa1f63 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:24:08.123538 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-de4b6029-cc13-4e26-93ce-4d611052dfc7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '.version_select at 0x7f9e24006160>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:24:08.146937 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-de4b6029-cc13-4e26-93ce-4d611052dfc7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-697801649" status: 202 len: 0 microversion: 2.1 time: 0.027208 Aug 07 02:24:08.147529 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3403/7274] 10.222.0.39 () {58 vars in 1281 bytes} [Sun Aug 7 02:24:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-697801649 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:24:08.173535 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7fa348a6-579c-4760-86bf-21b3a8e0c2b9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Action: 'create', calling method: .version_select at 0x7f9e298ee700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1469379561", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUKBbYZb0RhcozQo3pHjuG/Tddl3LvSa1fIopdX4x3l9xjOCZJpGCU+qZRRAy5KuN5HoRP22az/qoaMmbfnSYQGCb3JgWvoam7lSe1nOCo3H9HZMMtoaUvOIS1iiqUNgg=="}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:24:08.193932 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-7fa348a6-579c-4760-86bf-21b3a8e0c2b9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Getting quotas for project a212f473f58c4fb680bdb8ad63bd56f1. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:24:08.199169 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-7fa348a6-579c-4760-86bf-21b3a8e0c2b9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Getting quotas for user a2c21b7e0fa94a9eb7155caaf474b3b2 and project a212f473f58c4fb680bdb8ad63bd56f1. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:24:08.223419 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7fa348a6-579c-4760-86bf-21b3a8e0c2b9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053918 Aug 07 02:24:08.224084 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3872/7275] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 02:24:08 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:24:13.692191 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e08051fb-49bd-4165-9135-ff0fcf1afaa8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1027223721", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "3514041a-f5a3-40bf-8710-9cd1f041548d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1469379561", "security_groups": [{"name": "tempest-secgroup-smoke-1529303671"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:24:13.820606 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-e08051fb-49bd-4165-9135-ff0fcf1afaa8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] validate_networks() for [('3514041a-f5a3-40bf-8710-9cd1f041548d', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 02:24:13.825147 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:24:14.249920 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-e08051fb-49bd-4165-9135-ff0fcf1afaa8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 02:24:14.250444 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-e08051fb-49bd-4165-9135-ff0fcf1afaa8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 02:24:14.250998 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-e08051fb-49bd-4165-9135-ff0fcf1afaa8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 02:24:14.251484 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-e08051fb-49bd-4165-9135-ff0fcf1afaa8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 02:24:14.251998 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-e08051fb-49bd-4165-9135-ff0fcf1afaa8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 02:24:14.261611 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e08051fb-49bd-4165-9135-ff0fcf1afaa8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:14.262201 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e08051fb-49bd-4165-9135-ff0fcf1afaa8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:14.262720 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e08051fb-49bd-4165-9135-ff0fcf1afaa8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:14.263537 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e08051fb-49bd-4165-9135-ff0fcf1afaa8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:14.264119 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e08051fb-49bd-4165-9135-ff0fcf1afaa8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:14.264625 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e08051fb-49bd-4165-9135-ff0fcf1afaa8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:14.283851 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-e08051fb-49bd-4165-9135-ff0fcf1afaa8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Getting quotas for project a212f473f58c4fb680bdb8ad63bd56f1. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:24:14.290351 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-e08051fb-49bd-4165-9135-ff0fcf1afaa8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Getting quotas for user a2c21b7e0fa94a9eb7155caaf474b3b2 and project a212f473f58c4fb680bdb8ad63bd56f1. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:24:14.303865 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e08051fb-49bd-4165-9135-ff0fcf1afaa8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 02:24:14.306150 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e08051fb-49bd-4165-9135-ff0fcf1afaa8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 02:24:14.354928 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e08051fb-49bd-4165-9135-ff0fcf1afaa8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.668396 Aug 07 02:24:14.355793 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3404/7276] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 02:24:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 02:24:14.367444 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-80541110-5be7-4e41-99c5-5b0a92d81c58 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:24:14.368213 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-80541110-5be7-4e41-99c5-5b0a92d81c58 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:24:14.427849 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-80541110-5be7-4e41-99c5-5b0a92d81c58 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:24:14.434845 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-80541110-5be7-4e41-99c5-5b0a92d81c58 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6" status: 200 len: 1267 microversion: 2.1 time: 0.072202 Aug 07 02:24:14.435595 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3873/7277] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:24:14 2022] GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 => generated 1267 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:24:15.458837 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1cde6ff5-2ad2-4e95-9ea2-2135e2705a56 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:24:15.460849 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1cde6ff5-2ad2-4e95-9ea2-2135e2705a56 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:24:15.572004 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1cde6ff5-2ad2-4e95-9ea2-2135e2705a56 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:24:15.580306 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1cde6ff5-2ad2-4e95-9ea2-2135e2705a56 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6" status: 200 len: 1267 microversion: 2.1 time: 0.128258 Aug 07 02:24:15.580897 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3405/7278] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:24:15 2022] GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 => generated 1267 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:24:16.601543 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-26d4b227-ba0d-4be2-b9ac-febe8548f8d5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:24:16.602186 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-26d4b227-ba0d-4be2-b9ac-febe8548f8d5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:24:16.604277 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=16 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:24:16.657262 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-26d4b227-ba0d-4be2-b9ac-febe8548f8d5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:24:16.664044 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-26d4b227-ba0d-4be2-b9ac-febe8548f8d5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6" status: 200 len: 1267 microversion: 2.1 time: 0.066437 Aug 07 02:24:16.664621 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3874/7279] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:24:16 2022] GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 => generated 1267 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:24:17.684914 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-da2780cd-523d-4120-8e47-82753f49e389 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:24:17.685537 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-da2780cd-523d-4120-8e47-82753f49e389 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:24:17.692474 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da2780cd-523d-4120-8e47-82753f49e389 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:17.692970 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da2780cd-523d-4120-8e47-82753f49e389 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:17.693414 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da2780cd-523d-4120-8e47-82753f49e389 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:17.694115 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da2780cd-523d-4120-8e47-82753f49e389 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:17.694577 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da2780cd-523d-4120-8e47-82753f49e389 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:17.695502 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-da2780cd-523d-4120-8e47-82753f49e389 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:17.759199 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-da2780cd-523d-4120-8e47-82753f49e389 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:24:17.766802 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-da2780cd-523d-4120-8e47-82753f49e389 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6" status: 200 len: 1271 microversion: 2.1 time: 0.085849 Aug 07 02:24:17.767490 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3406/7280] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:24:17 2022] GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:24:18.787634 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5b54afb2-97a9-4dfb-86ca-bd6ea53d70ab tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:24:18.789499 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5b54afb2-97a9-4dfb-86ca-bd6ea53d70ab tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:24:18.796461 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5b54afb2-97a9-4dfb-86ca-bd6ea53d70ab tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:18.796972 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5b54afb2-97a9-4dfb-86ca-bd6ea53d70ab tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:18.797438 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5b54afb2-97a9-4dfb-86ca-bd6ea53d70ab tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:18.798168 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5b54afb2-97a9-4dfb-86ca-bd6ea53d70ab tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:18.798644 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5b54afb2-97a9-4dfb-86ca-bd6ea53d70ab tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:18.799095 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5b54afb2-97a9-4dfb-86ca-bd6ea53d70ab tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:18.868709 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5b54afb2-97a9-4dfb-86ca-bd6ea53d70ab tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:24:18.876435 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5b54afb2-97a9-4dfb-86ca-bd6ea53d70ab tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6" status: 200 len: 1325 microversion: 2.1 time: 0.092574 Aug 07 02:24:18.877018 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3875/7281] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:24:18 2022] GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 => generated 1325 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:24:19.898399 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-babdf94d-d6c6-4b04-bebb-a66a51f336fd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:24:19.899002 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-babdf94d-d6c6-4b04-bebb-a66a51f336fd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:24:19.907313 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-babdf94d-d6c6-4b04-bebb-a66a51f336fd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:19.907812 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-babdf94d-d6c6-4b04-bebb-a66a51f336fd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:19.908285 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-babdf94d-d6c6-4b04-bebb-a66a51f336fd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:19.909000 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-babdf94d-d6c6-4b04-bebb-a66a51f336fd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:19.909465 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-babdf94d-d6c6-4b04-bebb-a66a51f336fd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:19.909900 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-babdf94d-d6c6-4b04-bebb-a66a51f336fd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:20.050985 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-babdf94d-d6c6-4b04-bebb-a66a51f336fd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:24:20.059206 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-babdf94d-d6c6-4b04-bebb-a66a51f336fd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6" status: 200 len: 1393 microversion: 2.1 time: 0.165810 Aug 07 02:24:20.059782 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3407/7282] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:24:19 2022] GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 => generated 1393 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:24:20.320770 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-f33f6264-a6db-456e-95aa-2073fbd5d733 req-5be6db1b-1cf2-448e-9ee2-b302b4d0347d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d8a0767-04e7-412c-a518-a87fc43fadc6", "tag": "63adb754-88bd-4a9d-b866-ec77d1ee0550"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:24:20.332343 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f33f6264-a6db-456e-95aa-2073fbd5d733 req-5be6db1b-1cf2-448e-9ee2-b302b4d0347d service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:20.332999 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f33f6264-a6db-456e-95aa-2073fbd5d733 req-5be6db1b-1cf2-448e-9ee2-b302b4d0347d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:20.333450 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f33f6264-a6db-456e-95aa-2073fbd5d733 req-5be6db1b-1cf2-448e-9ee2-b302b4d0347d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:20.345747 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-f33f6264-a6db-456e-95aa-2073fbd5d733 req-5be6db1b-1cf2-448e-9ee2-b302b4d0347d service nova] Creating event network-changed:63adb754-88bd-4a9d-b866-ec77d1ee0550 for instance 8d8a0767-04e7-412c-a518-a87fc43fadc6 on n-h2-master-1 Aug 07 02:24:20.350849 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-f33f6264-a6db-456e-95aa-2073fbd5d733 req-5be6db1b-1cf2-448e-9ee2-b302b4d0347d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035328 Aug 07 02:24:20.352131 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3876/7283] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 02:24:21.080369 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5fa7d9cb-082f-4adf-bfbd-37440a5883d4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:24:21.081021 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5fa7d9cb-082f-4adf-bfbd-37440a5883d4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:24:21.088156 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5fa7d9cb-082f-4adf-bfbd-37440a5883d4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:21.088642 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5fa7d9cb-082f-4adf-bfbd-37440a5883d4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:21.089084 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5fa7d9cb-082f-4adf-bfbd-37440a5883d4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:21.089779 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5fa7d9cb-082f-4adf-bfbd-37440a5883d4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:21.090236 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5fa7d9cb-082f-4adf-bfbd-37440a5883d4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:21.090668 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5fa7d9cb-082f-4adf-bfbd-37440a5883d4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:21.228205 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5fa7d9cb-082f-4adf-bfbd-37440a5883d4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:24:21.235938 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5fa7d9cb-082f-4adf-bfbd-37440a5883d4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6" status: 200 len: 1393 microversion: 2.1 time: 0.159372 Aug 07 02:24:21.236547 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3408/7284] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:24:21 2022] GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:24:22.258296 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7dd682ae-1829-4537-af12-e9110c75dc4d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:24:22.258972 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7dd682ae-1829-4537-af12-e9110c75dc4d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:24:22.266061 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7dd682ae-1829-4537-af12-e9110c75dc4d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:22.266556 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7dd682ae-1829-4537-af12-e9110c75dc4d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:22.267006 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7dd682ae-1829-4537-af12-e9110c75dc4d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:22.267717 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7dd682ae-1829-4537-af12-e9110c75dc4d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:22.268212 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7dd682ae-1829-4537-af12-e9110c75dc4d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:22.268648 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7dd682ae-1829-4537-af12-e9110c75dc4d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:22.506878 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7dd682ae-1829-4537-af12-e9110c75dc4d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:24:22.515143 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7dd682ae-1829-4537-af12-e9110c75dc4d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6" status: 200 len: 1393 microversion: 2.1 time: 0.261614 Aug 07 02:24:22.515647 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3877/7285] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:24:22 2022] GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 => generated 1393 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:24:23.536112 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-862409e2-ac42-4fbc-ad7d-22a94bd0c808 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:24:23.536674 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-862409e2-ac42-4fbc-ad7d-22a94bd0c808 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:24:23.543561 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-862409e2-ac42-4fbc-ad7d-22a94bd0c808 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:23.544091 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-862409e2-ac42-4fbc-ad7d-22a94bd0c808 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:23.544537 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-862409e2-ac42-4fbc-ad7d-22a94bd0c808 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:23.545239 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-862409e2-ac42-4fbc-ad7d-22a94bd0c808 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:23.545701 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-862409e2-ac42-4fbc-ad7d-22a94bd0c808 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:23.546135 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-862409e2-ac42-4fbc-ad7d-22a94bd0c808 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:23.680055 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-862409e2-ac42-4fbc-ad7d-22a94bd0c808 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:24:23.688108 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-862409e2-ac42-4fbc-ad7d-22a94bd0c808 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6" status: 200 len: 1393 microversion: 2.1 time: 0.156050 Aug 07 02:24:23.688685 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3409/7286] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:24:23 2022] GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:24:24.709063 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a7a3dce2-7e6e-49a5-9ced-a3e64c7bcf08 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:24:24.709697 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a7a3dce2-7e6e-49a5-9ced-a3e64c7bcf08 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:24:24.713172 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:24:24.718935 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7a3dce2-7e6e-49a5-9ced-a3e64c7bcf08 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:24.719442 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7a3dce2-7e6e-49a5-9ced-a3e64c7bcf08 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:24.719942 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7a3dce2-7e6e-49a5-9ced-a3e64c7bcf08 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:24.720669 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7a3dce2-7e6e-49a5-9ced-a3e64c7bcf08 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:24.721174 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7a3dce2-7e6e-49a5-9ced-a3e64c7bcf08 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:24.721620 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a7a3dce2-7e6e-49a5-9ced-a3e64c7bcf08 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:24.874973 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a7a3dce2-7e6e-49a5-9ced-a3e64c7bcf08 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:24:24.883829 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a7a3dce2-7e6e-49a5-9ced-a3e64c7bcf08 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6" status: 200 len: 1393 microversion: 2.1 time: 0.178609 Aug 07 02:24:24.884459 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3878/7287] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:24:24 2022] GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 => generated 1393 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:24:24.967739 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-3eef1406-4eac-4f07-b948-f6bf636f293c req-f37f2ba4-dc56-44c3-a8e2-4c650fafa2e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d8a0767-04e7-412c-a518-a87fc43fadc6", "name": "network-vif-plugged", "status": "completed", "tag": "63adb754-88bd-4a9d-b866-ec77d1ee0550"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:24:24.972861 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:24:24.979919 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3eef1406-4eac-4f07-b948-f6bf636f293c req-f37f2ba4-dc56-44c3-a8e2-4c650fafa2e5 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:24.980653 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3eef1406-4eac-4f07-b948-f6bf636f293c req-f37f2ba4-dc56-44c3-a8e2-4c650fafa2e5 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:24.981090 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3eef1406-4eac-4f07-b948-f6bf636f293c req-f37f2ba4-dc56-44c3-a8e2-4c650fafa2e5 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:24.993694 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-3eef1406-4eac-4f07-b948-f6bf636f293c req-f37f2ba4-dc56-44c3-a8e2-4c650fafa2e5 service nova] Creating event network-vif-plugged:63adb754-88bd-4a9d-b866-ec77d1ee0550 for instance 8d8a0767-04e7-412c-a518-a87fc43fadc6 on n-h2-master-1 Aug 07 02:24:24.998702 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-3eef1406-4eac-4f07-b948-f6bf636f293c req-f37f2ba4-dc56-44c3-a8e2-4c650fafa2e5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034848 Aug 07 02:24:24.999945 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3410/7288] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:24:25.905307 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5624abe0-acc5-4c4c-88ea-328246d2831e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:24:25.905969 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5624abe0-acc5-4c4c-88ea-328246d2831e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:24:25.912878 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5624abe0-acc5-4c4c-88ea-328246d2831e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:25.913376 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5624abe0-acc5-4c4c-88ea-328246d2831e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:25.913833 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5624abe0-acc5-4c4c-88ea-328246d2831e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:25.914544 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5624abe0-acc5-4c4c-88ea-328246d2831e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:25.915019 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5624abe0-acc5-4c4c-88ea-328246d2831e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:25.915462 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5624abe0-acc5-4c4c-88ea-328246d2831e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:26.050926 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5624abe0-acc5-4c4c-88ea-328246d2831e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:24:26.058472 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5624abe0-acc5-4c4c-88ea-328246d2831e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6" status: 200 len: 1393 microversion: 2.1 time: 0.157155 Aug 07 02:24:26.059052 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3879/7289] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:24:25 2022] GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:24:27.078394 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=8 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:24:27.083625 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d1ce2266-cf14-4fe5-b016-14918c71ffa6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:24:27.084353 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d1ce2266-cf14-4fe5-b016-14918c71ffa6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:24:27.091492 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1ce2266-cf14-4fe5-b016-14918c71ffa6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:27.092058 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1ce2266-cf14-4fe5-b016-14918c71ffa6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:27.092493 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1ce2266-cf14-4fe5-b016-14918c71ffa6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:27.093185 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1ce2266-cf14-4fe5-b016-14918c71ffa6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:27.093643 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1ce2266-cf14-4fe5-b016-14918c71ffa6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:27.094069 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d1ce2266-cf14-4fe5-b016-14918c71ffa6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:27.225358 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d1ce2266-cf14-4fe5-b016-14918c71ffa6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:24:27.233539 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d1ce2266-cf14-4fe5-b016-14918c71ffa6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6" status: 200 len: 1566 microversion: 2.1 time: 0.157037 Aug 07 02:24:27.234106 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3411/7290] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:24:27 2022] GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:24:27.253567 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2a786984-d804-41c9-a723-5c7984bd8b24 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:24:27.254211 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2a786984-d804-41c9-a723-5c7984bd8b24 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:24:27.256243 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=8 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:24:27.262734 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a786984-d804-41c9-a723-5c7984bd8b24 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:27.263231 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a786984-d804-41c9-a723-5c7984bd8b24 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:27.263690 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a786984-d804-41c9-a723-5c7984bd8b24 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:27.264436 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a786984-d804-41c9-a723-5c7984bd8b24 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:27.264915 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a786984-d804-41c9-a723-5c7984bd8b24 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:27.265366 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2a786984-d804-41c9-a723-5c7984bd8b24 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:27.399564 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2a786984-d804-41c9-a723-5c7984bd8b24 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:24:27.407208 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2a786984-d804-41c9-a723-5c7984bd8b24 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6" status: 200 len: 1566 microversion: 2.1 time: 0.157556 Aug 07 02:24:27.407792 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3880/7291] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:24:27 2022] GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:24:28.093462 n-d-master-1 devstack@n-api.service[119516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 02:24:28.093774 n-d-master-1 devstack@n-api.service[119516]: Sun Aug 7 02:24:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 02:24:28.982486 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9f500cc5-a885-4ff9-9441-9fa16c6a5dbd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:24:28.983124 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9f500cc5-a885-4ff9-9441-9fa16c6a5dbd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:24:28.985338 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-ad2b4612-8dd5-4480-ad59-067afe03f592 req-d7f9e1fc-5837-42ba-bcec-184ec67bdc0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d8a0767-04e7-412c-a518-a87fc43fadc6", "tag": "63adb754-88bd-4a9d-b866-ec77d1ee0550"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:24:28.990626 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9f500cc5-a885-4ff9-9441-9fa16c6a5dbd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:28.991078 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9f500cc5-a885-4ff9-9441-9fa16c6a5dbd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:28.991554 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9f500cc5-a885-4ff9-9441-9fa16c6a5dbd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:28.992956 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9f500cc5-a885-4ff9-9441-9fa16c6a5dbd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:28.993741 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9f500cc5-a885-4ff9-9441-9fa16c6a5dbd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:28.994202 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9f500cc5-a885-4ff9-9441-9fa16c6a5dbd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:28.996570 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-ad2b4612-8dd5-4480-ad59-067afe03f592 req-d7f9e1fc-5837-42ba-bcec-184ec67bdc0b service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:28.997252 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-ad2b4612-8dd5-4480-ad59-067afe03f592 req-d7f9e1fc-5837-42ba-bcec-184ec67bdc0b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:28.997704 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-ad2b4612-8dd5-4480-ad59-067afe03f592 req-d7f9e1fc-5837-42ba-bcec-184ec67bdc0b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:29.011051 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-ad2b4612-8dd5-4480-ad59-067afe03f592 req-d7f9e1fc-5837-42ba-bcec-184ec67bdc0b service nova] Creating event network-changed:63adb754-88bd-4a9d-b866-ec77d1ee0550 for instance 8d8a0767-04e7-412c-a518-a87fc43fadc6 on n-h2-master-1 Aug 07 02:24:29.016348 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-ad2b4612-8dd5-4480-ad59-067afe03f592 req-d7f9e1fc-5837-42ba-bcec-184ec67bdc0b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035161 Aug 07 02:24:29.016971 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3881/7292] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:24:29.143602 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9f500cc5-a885-4ff9-9441-9fa16c6a5dbd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:24:29.152719 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9f500cc5-a885-4ff9-9441-9fa16c6a5dbd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6" status: 200 len: 1566 microversion: 2.1 time: 0.174147 Aug 07 02:24:29.153688 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3412/7293] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:24:28 2022] GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:24:52.392731 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=7 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:24:52.393498 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=34 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:24:52.398587 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-add05f8e-f032-484c-9c9e-711584d563b9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:24:52.400890 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-add05f8e-f032-484c-9c9e-711584d563b9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:24:52.408046 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-add05f8e-f032-484c-9c9e-711584d563b9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:52.408553 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-add05f8e-f032-484c-9c9e-711584d563b9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:52.409025 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-add05f8e-f032-484c-9c9e-711584d563b9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:52.409726 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-add05f8e-f032-484c-9c9e-711584d563b9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:52.410202 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-add05f8e-f032-484c-9c9e-711584d563b9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:52.410651 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-add05f8e-f032-484c-9c9e-711584d563b9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:52.476517 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-add05f8e-f032-484c-9c9e-711584d563b9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "POST /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6/action" status: 200 len: 24538 microversion: 2.1 time: 0.085598 Aug 07 02:24:52.477167 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3882/7294] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:24:52 2022] POST /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6/action => generated 24538 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 02:24:58.920359 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e2b48f4e-b26b-4dd9-923c-0f54e60d70c6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:24:58.922970 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e2b48f4e-b26b-4dd9-923c-0f54e60d70c6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:24:58.925233 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:24:58.926242 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=40 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:24:58.932397 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e2b48f4e-b26b-4dd9-923c-0f54e60d70c6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:58.932890 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e2b48f4e-b26b-4dd9-923c-0f54e60d70c6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:58.933334 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e2b48f4e-b26b-4dd9-923c-0f54e60d70c6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:58.934045 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e2b48f4e-b26b-4dd9-923c-0f54e60d70c6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:58.934509 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e2b48f4e-b26b-4dd9-923c-0f54e60d70c6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:58.934942 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e2b48f4e-b26b-4dd9-923c-0f54e60d70c6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:58.977023 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e2b48f4e-b26b-4dd9-923c-0f54e60d70c6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:24:58.983517 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e2b48f4e-b26b-4dd9-923c-0f54e60d70c6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Old instance type m1.heat2, new instance type m1.heat {{(pid=119517) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 07 02:24:58.989833 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-e2b48f4e-b26b-4dd9-923c-0f54e60d70c6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 02:24:58.990260 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-e2b48f4e-b26b-4dd9-923c-0f54e60d70c6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 02:24:58.990739 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-e2b48f4e-b26b-4dd9-923c-0f54e60d70c6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 02:24:58.991156 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-e2b48f4e-b26b-4dd9-923c-0f54e60d70c6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 02:24:58.991612 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-e2b48f4e-b26b-4dd9-923c-0f54e60d70c6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 02:24:59.053335 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e2b48f4e-b26b-4dd9-923c-0f54e60d70c6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "POST /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6/action" status: 202 len: 0 microversion: 2.1 time: 0.137282 Aug 07 02:24:59.054178 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3413/7295] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:24:58 2022] POST /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:24:59.062604 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-959c2a8b-6d22-4365-9f86-619bc7314c41 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:24:59.063313 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-959c2a8b-6d22-4365-9f86-619bc7314c41 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:24:59.071411 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-959c2a8b-6d22-4365-9f86-619bc7314c41 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:59.071930 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-959c2a8b-6d22-4365-9f86-619bc7314c41 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:59.072391 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-959c2a8b-6d22-4365-9f86-619bc7314c41 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:59.073102 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-959c2a8b-6d22-4365-9f86-619bc7314c41 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:24:59.073572 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-959c2a8b-6d22-4365-9f86-619bc7314c41 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:24:59.074010 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-959c2a8b-6d22-4365-9f86-619bc7314c41 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:24:59.217789 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-959c2a8b-6d22-4365-9f86-619bc7314c41 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:24:59.225641 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-959c2a8b-6d22-4365-9f86-619bc7314c41 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6" status: 200 len: 1694 microversion: 2.1 time: 0.167248 Aug 07 02:24:59.226469 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3883/7296] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:24:59 2022] GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 => generated 1694 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:25:00.249169 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9a2009b1-e059-44dc-b9a2-57a28837dd3f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:25:00.249701 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9a2009b1-e059-44dc-b9a2-57a28837dd3f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:25:00.255716 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a2009b1-e059-44dc-b9a2-57a28837dd3f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:00.256241 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a2009b1-e059-44dc-b9a2-57a28837dd3f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:00.256687 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a2009b1-e059-44dc-b9a2-57a28837dd3f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:00.257391 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a2009b1-e059-44dc-b9a2-57a28837dd3f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:00.257854 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a2009b1-e059-44dc-b9a2-57a28837dd3f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:00.258291 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9a2009b1-e059-44dc-b9a2-57a28837dd3f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:00.395937 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9a2009b1-e059-44dc-b9a2-57a28837dd3f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:25:00.404312 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9a2009b1-e059-44dc-b9a2-57a28837dd3f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6" status: 200 len: 1694 microversion: 2.1 time: 0.160067 Aug 07 02:25:00.404918 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3414/7297] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:25:00 2022] GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 => generated 1694 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:25:01.424956 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a14cbcf7-b581-4296-b076-347efeb1112b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:25:01.425599 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a14cbcf7-b581-4296-b076-347efeb1112b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:25:01.434197 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a14cbcf7-b581-4296-b076-347efeb1112b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:01.434696 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a14cbcf7-b581-4296-b076-347efeb1112b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:01.435149 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a14cbcf7-b581-4296-b076-347efeb1112b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:01.435862 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a14cbcf7-b581-4296-b076-347efeb1112b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:01.436355 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a14cbcf7-b581-4296-b076-347efeb1112b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:01.436797 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a14cbcf7-b581-4296-b076-347efeb1112b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:01.572635 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a14cbcf7-b581-4296-b076-347efeb1112b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:25:01.580229 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a14cbcf7-b581-4296-b076-347efeb1112b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6" status: 200 len: 1699 microversion: 2.1 time: 0.159229 Aug 07 02:25:01.580799 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3884/7298] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:25:01 2022] GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 => generated 1699 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:25:02.603045 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fd7b4389-de35-4d97-9df0-ff5f5b5ae95f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:25:02.603663 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fd7b4389-de35-4d97-9df0-ff5f5b5ae95f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:25:02.609863 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd7b4389-de35-4d97-9df0-ff5f5b5ae95f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:02.610344 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd7b4389-de35-4d97-9df0-ff5f5b5ae95f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:02.610782 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd7b4389-de35-4d97-9df0-ff5f5b5ae95f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:02.611479 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd7b4389-de35-4d97-9df0-ff5f5b5ae95f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:02.611967 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd7b4389-de35-4d97-9df0-ff5f5b5ae95f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:02.612393 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fd7b4389-de35-4d97-9df0-ff5f5b5ae95f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:02.741214 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-fd7b4389-de35-4d97-9df0-ff5f5b5ae95f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:25:02.749313 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fd7b4389-de35-4d97-9df0-ff5f5b5ae95f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6" status: 200 len: 1699 microversion: 2.1 time: 0.150962 Aug 07 02:25:02.749882 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3415/7299] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:25:02 2022] GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 => generated 1699 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:25:03.770322 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0c26ecf7-aa79-49e5-9dd2-a4c236f6ac4f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:25:03.770958 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0c26ecf7-aa79-49e5-9dd2-a4c236f6ac4f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:25:03.778257 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c26ecf7-aa79-49e5-9dd2-a4c236f6ac4f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:03.778758 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c26ecf7-aa79-49e5-9dd2-a4c236f6ac4f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:03.779217 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c26ecf7-aa79-49e5-9dd2-a4c236f6ac4f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:03.779976 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c26ecf7-aa79-49e5-9dd2-a4c236f6ac4f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:03.780452 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c26ecf7-aa79-49e5-9dd2-a4c236f6ac4f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:03.780902 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0c26ecf7-aa79-49e5-9dd2-a4c236f6ac4f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:03.912113 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0c26ecf7-aa79-49e5-9dd2-a4c236f6ac4f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:25:03.919646 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0c26ecf7-aa79-49e5-9dd2-a4c236f6ac4f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6" status: 200 len: 1699 microversion: 2.1 time: 0.153290 Aug 07 02:25:03.920237 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3885/7300] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:25:03 2022] GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 => generated 1699 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:25:04.940917 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-884e9132-4851-458b-bc4d-deddbb67a423 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:25:04.941543 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-884e9132-4851-458b-bc4d-deddbb67a423 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:25:04.948905 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-884e9132-4851-458b-bc4d-deddbb67a423 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:04.949394 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-884e9132-4851-458b-bc4d-deddbb67a423 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:04.949841 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-884e9132-4851-458b-bc4d-deddbb67a423 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:04.950541 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-884e9132-4851-458b-bc4d-deddbb67a423 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:04.951001 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-884e9132-4851-458b-bc4d-deddbb67a423 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:04.951437 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-884e9132-4851-458b-bc4d-deddbb67a423 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:05.084443 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-884e9132-4851-458b-bc4d-deddbb67a423 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:25:05.092841 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-884e9132-4851-458b-bc4d-deddbb67a423 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6" status: 200 len: 1699 microversion: 2.1 time: 0.155893 Aug 07 02:25:05.093412 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3416/7301] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:25:04 2022] GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 => generated 1699 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:25:06.113408 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c06befd5-fa8f-407d-92a7-1fe458f011ff tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:25:06.114043 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c06befd5-fa8f-407d-92a7-1fe458f011ff tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:25:06.120983 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c06befd5-fa8f-407d-92a7-1fe458f011ff tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:06.121485 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c06befd5-fa8f-407d-92a7-1fe458f011ff tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:06.121942 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c06befd5-fa8f-407d-92a7-1fe458f011ff tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:06.122661 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c06befd5-fa8f-407d-92a7-1fe458f011ff tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:06.123136 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c06befd5-fa8f-407d-92a7-1fe458f011ff tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:06.123584 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c06befd5-fa8f-407d-92a7-1fe458f011ff tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:06.261352 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c06befd5-fa8f-407d-92a7-1fe458f011ff tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:25:06.268911 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c06befd5-fa8f-407d-92a7-1fe458f011ff tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6" status: 200 len: 1699 microversion: 2.1 time: 0.159390 Aug 07 02:25:06.269475 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3886/7302] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:25:06 2022] GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 => generated 1699 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:25:07.291181 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3b48cb63-dfa1-4e3a-96c0-0a6dc7d6affe tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:25:07.291720 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3b48cb63-dfa1-4e3a-96c0-0a6dc7d6affe tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:25:07.298642 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b48cb63-dfa1-4e3a-96c0-0a6dc7d6affe tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:07.299131 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b48cb63-dfa1-4e3a-96c0-0a6dc7d6affe tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:07.299581 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b48cb63-dfa1-4e3a-96c0-0a6dc7d6affe tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:07.300311 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b48cb63-dfa1-4e3a-96c0-0a6dc7d6affe tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:07.300776 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b48cb63-dfa1-4e3a-96c0-0a6dc7d6affe tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:07.301208 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b48cb63-dfa1-4e3a-96c0-0a6dc7d6affe tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:07.430544 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3b48cb63-dfa1-4e3a-96c0-0a6dc7d6affe tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:25:07.438139 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3b48cb63-dfa1-4e3a-96c0-0a6dc7d6affe tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6" status: 200 len: 1699 microversion: 2.1 time: 0.151512 Aug 07 02:25:07.438712 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3417/7303] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:25:07 2022] GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 => generated 1699 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:25:08.458789 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-44fd9b94-2f26-40eb-919f-cd01c9912caa tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:25:08.459517 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-44fd9b94-2f26-40eb-919f-cd01c9912caa tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:25:08.466747 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-44fd9b94-2f26-40eb-919f-cd01c9912caa tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:08.467238 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-44fd9b94-2f26-40eb-919f-cd01c9912caa tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:08.467687 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-44fd9b94-2f26-40eb-919f-cd01c9912caa tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:08.468441 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-44fd9b94-2f26-40eb-919f-cd01c9912caa tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:08.468913 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-44fd9b94-2f26-40eb-919f-cd01c9912caa tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:08.469350 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-44fd9b94-2f26-40eb-919f-cd01c9912caa tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:08.606431 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-44fd9b94-2f26-40eb-919f-cd01c9912caa tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:25:08.614029 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-44fd9b94-2f26-40eb-919f-cd01c9912caa tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6" status: 200 len: 1699 microversion: 2.1 time: 0.159174 Aug 07 02:25:08.614613 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3887/7304] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:25:08 2022] GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 => generated 1699 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:25:09.636573 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e3b34e7e-266d-4743-9d20-338e37bfb99c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:25:09.637194 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e3b34e7e-266d-4743-9d20-338e37bfb99c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:25:09.644315 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3b34e7e-266d-4743-9d20-338e37bfb99c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:09.644801 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3b34e7e-266d-4743-9d20-338e37bfb99c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:09.645251 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3b34e7e-266d-4743-9d20-338e37bfb99c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:09.645954 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3b34e7e-266d-4743-9d20-338e37bfb99c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:09.646421 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3b34e7e-266d-4743-9d20-338e37bfb99c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:09.646853 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3b34e7e-266d-4743-9d20-338e37bfb99c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:09.783748 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e3b34e7e-266d-4743-9d20-338e37bfb99c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:25:09.791351 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e3b34e7e-266d-4743-9d20-338e37bfb99c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6" status: 200 len: 1699 microversion: 2.1 time: 0.159224 Aug 07 02:25:09.791939 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3418/7305] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:25:09 2022] GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 => generated 1699 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:25:10.812889 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-715182cf-44ab-45fb-b31f-2be2b73dceff tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:25:10.813537 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-715182cf-44ab-45fb-b31f-2be2b73dceff tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:25:10.820936 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-715182cf-44ab-45fb-b31f-2be2b73dceff tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:10.821438 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-715182cf-44ab-45fb-b31f-2be2b73dceff tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:10.821893 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-715182cf-44ab-45fb-b31f-2be2b73dceff tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:10.822614 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-715182cf-44ab-45fb-b31f-2be2b73dceff tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:10.823088 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-715182cf-44ab-45fb-b31f-2be2b73dceff tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:10.823535 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-715182cf-44ab-45fb-b31f-2be2b73dceff tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:10.955287 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-715182cf-44ab-45fb-b31f-2be2b73dceff tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:25:10.966643 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-715182cf-44ab-45fb-b31f-2be2b73dceff tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6" status: 200 len: 1699 microversion: 2.1 time: 0.157403 Aug 07 02:25:10.967515 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3888/7306] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:25:10 2022] GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 => generated 1699 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:25:11.992785 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c46e8f66-e6cc-4ddc-a2cf-ef5638fdf17a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:25:11.993401 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c46e8f66-e6cc-4ddc-a2cf-ef5638fdf17a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:25:12.000371 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c46e8f66-e6cc-4ddc-a2cf-ef5638fdf17a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:12.000855 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c46e8f66-e6cc-4ddc-a2cf-ef5638fdf17a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:12.001299 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c46e8f66-e6cc-4ddc-a2cf-ef5638fdf17a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:12.001996 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c46e8f66-e6cc-4ddc-a2cf-ef5638fdf17a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:12.002447 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c46e8f66-e6cc-4ddc-a2cf-ef5638fdf17a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:12.002873 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c46e8f66-e6cc-4ddc-a2cf-ef5638fdf17a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:12.136001 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c46e8f66-e6cc-4ddc-a2cf-ef5638fdf17a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:25:12.143437 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c46e8f66-e6cc-4ddc-a2cf-ef5638fdf17a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6" status: 200 len: 1699 microversion: 2.1 time: 0.154593 Aug 07 02:25:12.144023 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3419/7307] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:25:11 2022] GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 => generated 1699 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:25:13.165628 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c3942e1c-1f4a-4637-9814-b55c11c234aa tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:25:13.166261 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c3942e1c-1f4a-4637-9814-b55c11c234aa tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:25:13.173918 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3942e1c-1f4a-4637-9814-b55c11c234aa tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:13.174431 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3942e1c-1f4a-4637-9814-b55c11c234aa tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:13.174892 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3942e1c-1f4a-4637-9814-b55c11c234aa tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:13.176385 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3942e1c-1f4a-4637-9814-b55c11c234aa tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:13.176866 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3942e1c-1f4a-4637-9814-b55c11c234aa tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:13.177320 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c3942e1c-1f4a-4637-9814-b55c11c234aa tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:13.318065 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c3942e1c-1f4a-4637-9814-b55c11c234aa tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:25:13.325863 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c3942e1c-1f4a-4637-9814-b55c11c234aa tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6" status: 200 len: 1698 microversion: 2.1 time: 0.164725 Aug 07 02:25:13.326440 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3889/7308] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:25:13 2022] GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 => generated 1698 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:25:13.953037 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-9cd6bd0d-b574-4490-935a-8df0e63238a2 req-ebf72663-a764-42ee-ad9e-2376014dcdf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d8a0767-04e7-412c-a518-a87fc43fadc6", "name": "network-vif-unplugged", "status": "completed", "tag": "63adb754-88bd-4a9d-b866-ec77d1ee0550"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:25:13.964371 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-9cd6bd0d-b574-4490-935a-8df0e63238a2 req-ebf72663-a764-42ee-ad9e-2376014dcdf2 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:13.964853 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-9cd6bd0d-b574-4490-935a-8df0e63238a2 req-ebf72663-a764-42ee-ad9e-2376014dcdf2 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:13.965286 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-9cd6bd0d-b574-4490-935a-8df0e63238a2 req-ebf72663-a764-42ee-ad9e-2376014dcdf2 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:13.978019 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-9cd6bd0d-b574-4490-935a-8df0e63238a2 req-ebf72663-a764-42ee-ad9e-2376014dcdf2 service nova] Creating event network-vif-unplugged:63adb754-88bd-4a9d-b866-ec77d1ee0550 for instance 8d8a0767-04e7-412c-a518-a87fc43fadc6 on n-h1-master-1 Aug 07 02:25:13.983614 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [req-9cd6bd0d-b574-4490-935a-8df0e63238a2 req-ebf72663-a764-42ee-ad9e-2376014dcdf2 service nova] Instance 8d8a0767-04e7-412c-a518-a87fc43fadc6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 02:25:13.994713 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-9cd6bd0d-b574-4490-935a-8df0e63238a2 req-ebf72663-a764-42ee-ad9e-2376014dcdf2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045319 Aug 07 02:25:13.995320 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3420/7309] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:25:14.346779 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5740f894-8861-4667-8f41-32e64dacbf5c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:25:14.347408 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5740f894-8861-4667-8f41-32e64dacbf5c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:25:14.355024 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5740f894-8861-4667-8f41-32e64dacbf5c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:14.355530 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5740f894-8861-4667-8f41-32e64dacbf5c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:14.356002 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5740f894-8861-4667-8f41-32e64dacbf5c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:14.356929 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5740f894-8861-4667-8f41-32e64dacbf5c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:14.357395 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5740f894-8861-4667-8f41-32e64dacbf5c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:14.357839 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5740f894-8861-4667-8f41-32e64dacbf5c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:14.500356 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5740f894-8861-4667-8f41-32e64dacbf5c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:25:14.508697 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5740f894-8861-4667-8f41-32e64dacbf5c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6" status: 200 len: 1698 microversion: 2.1 time: 0.165258 Aug 07 02:25:14.509513 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3890/7310] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:25:14 2022] GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 => generated 1698 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:25:15.531778 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2c988dd3-9557-40dc-b21a-ca0e1d4ecff2 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:25:15.532548 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2c988dd3-9557-40dc-b21a-ca0e1d4ecff2 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:25:15.539126 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c988dd3-9557-40dc-b21a-ca0e1d4ecff2 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:15.539619 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c988dd3-9557-40dc-b21a-ca0e1d4ecff2 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:15.540173 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c988dd3-9557-40dc-b21a-ca0e1d4ecff2 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:15.541079 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c988dd3-9557-40dc-b21a-ca0e1d4ecff2 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:15.541545 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c988dd3-9557-40dc-b21a-ca0e1d4ecff2 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:15.541980 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2c988dd3-9557-40dc-b21a-ca0e1d4ecff2 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:15.673905 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2c988dd3-9557-40dc-b21a-ca0e1d4ecff2 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:25:15.681942 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2c988dd3-9557-40dc-b21a-ca0e1d4ecff2 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6" status: 200 len: 1696 microversion: 2.1 time: 0.155211 Aug 07 02:25:15.682509 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3421/7311] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:25:15 2022] GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:25:16.039226 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-5a08daad-8ff7-4a26-8b3c-0aa5c529ae56 req-6a39d5d0-a050-40ed-b078-4d7af5aac488 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d8a0767-04e7-412c-a518-a87fc43fadc6", "tag": "63adb754-88bd-4a9d-b866-ec77d1ee0550"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:25:16.049764 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-5a08daad-8ff7-4a26-8b3c-0aa5c529ae56 req-6a39d5d0-a050-40ed-b078-4d7af5aac488 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:16.050250 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-5a08daad-8ff7-4a26-8b3c-0aa5c529ae56 req-6a39d5d0-a050-40ed-b078-4d7af5aac488 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:16.050695 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-5a08daad-8ff7-4a26-8b3c-0aa5c529ae56 req-6a39d5d0-a050-40ed-b078-4d7af5aac488 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:16.063022 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-5a08daad-8ff7-4a26-8b3c-0aa5c529ae56 req-6a39d5d0-a050-40ed-b078-4d7af5aac488 service nova] Creating event network-changed:63adb754-88bd-4a9d-b866-ec77d1ee0550 for instance 8d8a0767-04e7-412c-a518-a87fc43fadc6 on n-h1-master-1 Aug 07 02:25:16.068191 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [req-5a08daad-8ff7-4a26-8b3c-0aa5c529ae56 req-6a39d5d0-a050-40ed-b078-4d7af5aac488 service nova] Instance 8d8a0767-04e7-412c-a518-a87fc43fadc6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=119516) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 07 02:25:16.078541 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-5a08daad-8ff7-4a26-8b3c-0aa5c529ae56 req-6a39d5d0-a050-40ed-b078-4d7af5aac488 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043146 Aug 07 02:25:16.079115 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3891/7312] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:25:16.702840 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-05512634-af2c-4327-9b23-d59cd8841cf5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:25:16.703467 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-05512634-af2c-4327-9b23-d59cd8841cf5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:25:16.710212 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05512634-af2c-4327-9b23-d59cd8841cf5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:16.710702 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05512634-af2c-4327-9b23-d59cd8841cf5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:16.711140 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05512634-af2c-4327-9b23-d59cd8841cf5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:16.711843 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05512634-af2c-4327-9b23-d59cd8841cf5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:16.713182 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05512634-af2c-4327-9b23-d59cd8841cf5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:16.713613 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-05512634-af2c-4327-9b23-d59cd8841cf5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:16.920017 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-05512634-af2c-4327-9b23-d59cd8841cf5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:25:16.927704 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-05512634-af2c-4327-9b23-d59cd8841cf5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6" status: 200 len: 1693 microversion: 2.1 time: 0.228876 Aug 07 02:25:16.928313 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3422/7313] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:25:16 2022] GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 => generated 1693 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:25:16.949381 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d9ff2801-8637-447e-8dc1-d7fa2f5ec5db tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:25:16.950097 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d9ff2801-8637-447e-8dc1-d7fa2f5ec5db tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:25:16.956275 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d9ff2801-8637-447e-8dc1-d7fa2f5ec5db tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:16.956768 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d9ff2801-8637-447e-8dc1-d7fa2f5ec5db tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:16.957217 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d9ff2801-8637-447e-8dc1-d7fa2f5ec5db tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:16.957920 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d9ff2801-8637-447e-8dc1-d7fa2f5ec5db tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:16.958385 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d9ff2801-8637-447e-8dc1-d7fa2f5ec5db tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:16.958825 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d9ff2801-8637-447e-8dc1-d7fa2f5ec5db tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:17.016678 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d9ff2801-8637-447e-8dc1-d7fa2f5ec5db tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "POST /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6/action" status: 204 len: 0 microversion: 2.1 time: 0.072129 Aug 07 02:25:17.017319 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3892/7314] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:25:16 2022] POST /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 02:25:17.025953 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-53190f0a-c41a-4cf6-8275-819865ee80e6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:25:17.026575 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-53190f0a-c41a-4cf6-8275-819865ee80e6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:25:17.033913 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53190f0a-c41a-4cf6-8275-819865ee80e6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:17.034521 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53190f0a-c41a-4cf6-8275-819865ee80e6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:17.035099 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53190f0a-c41a-4cf6-8275-819865ee80e6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:17.035974 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53190f0a-c41a-4cf6-8275-819865ee80e6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:17.036555 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53190f0a-c41a-4cf6-8275-819865ee80e6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:17.036991 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53190f0a-c41a-4cf6-8275-819865ee80e6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:17.183802 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-53190f0a-c41a-4cf6-8275-819865ee80e6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:25:17.192849 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-53190f0a-c41a-4cf6-8275-819865ee80e6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6" status: 200 len: 1693 microversion: 2.1 time: 0.171196 Aug 07 02:25:17.193603 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3423/7315] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:25:17 2022] GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 => generated 1693 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:25:17.216269 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6cd99524-6958-40ea-b281-963ce5f742a9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:25:17.217006 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6cd99524-6958-40ea-b281-963ce5f742a9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:25:17.223703 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cd99524-6958-40ea-b281-963ce5f742a9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:17.224251 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cd99524-6958-40ea-b281-963ce5f742a9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:17.224920 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cd99524-6958-40ea-b281-963ce5f742a9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:17.225694 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cd99524-6958-40ea-b281-963ce5f742a9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:17.226129 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cd99524-6958-40ea-b281-963ce5f742a9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:17.226697 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6cd99524-6958-40ea-b281-963ce5f742a9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:17.456916 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6cd99524-6958-40ea-b281-963ce5f742a9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:25:17.466806 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6cd99524-6958-40ea-b281-963ce5f742a9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6" status: 200 len: 1693 microversion: 2.1 time: 0.256001 Aug 07 02:25:17.467394 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3893/7316] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:25:17 2022] GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 => generated 1693 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:25:18.487708 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2b92002b-e402-4b8f-8fb2-9624eea35de8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:25:18.488376 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2b92002b-e402-4b8f-8fb2-9624eea35de8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:25:18.496117 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b92002b-e402-4b8f-8fb2-9624eea35de8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:18.496611 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b92002b-e402-4b8f-8fb2-9624eea35de8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:18.497048 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b92002b-e402-4b8f-8fb2-9624eea35de8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:18.497746 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b92002b-e402-4b8f-8fb2-9624eea35de8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:18.498204 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b92002b-e402-4b8f-8fb2-9624eea35de8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:18.498634 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2b92002b-e402-4b8f-8fb2-9624eea35de8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:18.634877 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2b92002b-e402-4b8f-8fb2-9624eea35de8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:25:18.642458 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2b92002b-e402-4b8f-8fb2-9624eea35de8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6" status: 200 len: 1685 microversion: 2.1 time: 0.158751 Aug 07 02:25:18.643029 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3424/7317] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:25:18 2022] GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:25:19.997343 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-ced908c4-436b-4528-9090-81c2d5376930 req-2ad57abf-0e3a-4a2b-934c-17f123377c71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d8a0767-04e7-412c-a518-a87fc43fadc6", "name": "network-vif-plugged", "status": "completed", "tag": "63adb754-88bd-4a9d-b866-ec77d1ee0550"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:25:20.006928 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-ced908c4-436b-4528-9090-81c2d5376930 req-2ad57abf-0e3a-4a2b-934c-17f123377c71 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:20.007422 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-ced908c4-436b-4528-9090-81c2d5376930 req-2ad57abf-0e3a-4a2b-934c-17f123377c71 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:20.007875 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-ced908c4-436b-4528-9090-81c2d5376930 req-2ad57abf-0e3a-4a2b-934c-17f123377c71 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:20.022119 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-ced908c4-436b-4528-9090-81c2d5376930 req-2ad57abf-0e3a-4a2b-934c-17f123377c71 service nova] Creating event network-vif-plugged:63adb754-88bd-4a9d-b866-ec77d1ee0550 for instance 8d8a0767-04e7-412c-a518-a87fc43fadc6 on n-h1-master-1 Aug 07 02:25:20.027657 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-ced908c4-436b-4528-9090-81c2d5376930 req-2ad57abf-0e3a-4a2b-934c-17f123377c71 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091412 Aug 07 02:25:20.028267 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3894/7318] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:25:42.830444 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e7d6ea0f-fc41-4e43-9e9f-a4b19bf5b8ba tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:25:42.832772 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e7d6ea0f-fc41-4e43-9e9f-a4b19bf5b8ba tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:25:42.835576 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=28 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:25:42.836293 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:25:42.842645 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7d6ea0f-fc41-4e43-9e9f-a4b19bf5b8ba tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:42.843142 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7d6ea0f-fc41-4e43-9e9f-a4b19bf5b8ba tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:42.843594 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7d6ea0f-fc41-4e43-9e9f-a4b19bf5b8ba tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:42.844341 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7d6ea0f-fc41-4e43-9e9f-a4b19bf5b8ba tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:42.844806 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7d6ea0f-fc41-4e43-9e9f-a4b19bf5b8ba tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:42.845393 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7d6ea0f-fc41-4e43-9e9f-a4b19bf5b8ba tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:42.919500 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e7d6ea0f-fc41-4e43-9e9f-a4b19bf5b8ba tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "POST /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6/action" status: 200 len: 24578 microversion: 2.1 time: 0.093272 Aug 07 02:25:42.920239 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3425/7319] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:25:42 2022] POST /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6/action => generated 24578 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 02:25:49.910951 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=26 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:25:49.911717 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:25:49.917839 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-a9d26c4c-4d25-4f91-81c0-6093ca657759 req-3fb82d21-c9f9-4e1f-9da5-ca6febd76269 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d8a0767-04e7-412c-a518-a87fc43fadc6", "tag": "63adb754-88bd-4a9d-b866-ec77d1ee0550"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:25:49.928392 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6ae12a69-77d7-4ea2-826c-fb80173b7867 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:25:49.928991 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6ae12a69-77d7-4ea2-826c-fb80173b7867 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:25:49.940587 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a9d26c4c-4d25-4f91-81c0-6093ca657759 req-3fb82d21-c9f9-4e1f-9da5-ca6febd76269 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:49.941065 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a9d26c4c-4d25-4f91-81c0-6093ca657759 req-3fb82d21-c9f9-4e1f-9da5-ca6febd76269 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:49.941496 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a9d26c4c-4d25-4f91-81c0-6093ca657759 req-3fb82d21-c9f9-4e1f-9da5-ca6febd76269 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:49.947142 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ae12a69-77d7-4ea2-826c-fb80173b7867 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:49.947691 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ae12a69-77d7-4ea2-826c-fb80173b7867 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:49.948673 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ae12a69-77d7-4ea2-826c-fb80173b7867 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:49.949417 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ae12a69-77d7-4ea2-826c-fb80173b7867 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:49.949882 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ae12a69-77d7-4ea2-826c-fb80173b7867 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:49.950321 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6ae12a69-77d7-4ea2-826c-fb80173b7867 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:49.960034 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-a9d26c4c-4d25-4f91-81c0-6093ca657759 req-3fb82d21-c9f9-4e1f-9da5-ca6febd76269 service nova] Creating event network-changed:63adb754-88bd-4a9d-b866-ec77d1ee0550 for instance 8d8a0767-04e7-412c-a518-a87fc43fadc6 on n-h1-master-1 Aug 07 02:25:49.971110 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-a9d26c4c-4d25-4f91-81c0-6093ca657759 req-3fb82d21-c9f9-4e1f-9da5-ca6febd76269 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057297 Aug 07 02:25:49.972260 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3426/7320] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:25:49.979760 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6ae12a69-77d7-4ea2-826c-fb80173b7867 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 02:25:50.069621 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6ae12a69-77d7-4ea2-826c-fb80173b7867 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6" status: 204 len: 0 microversion: 2.1 time: 0.160436 Aug 07 02:25:50.074286 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3895/7321] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 02:25:49 2022] DELETE /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 02:25:50.080149 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-22d9d0a4-0d80-4a8b-b290-b644d725b737 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:25:50.080858 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-22d9d0a4-0d80-4a8b-b290-b644d725b737 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:25:50.087826 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22d9d0a4-0d80-4a8b-b290-b644d725b737 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:50.088640 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22d9d0a4-0d80-4a8b-b290-b644d725b737 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:50.089609 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22d9d0a4-0d80-4a8b-b290-b644d725b737 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:50.090320 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22d9d0a4-0d80-4a8b-b290-b644d725b737 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:50.090785 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22d9d0a4-0d80-4a8b-b290-b644d725b737 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:50.091220 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-22d9d0a4-0d80-4a8b-b290-b644d725b737 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:50.228627 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-22d9d0a4-0d80-4a8b-b290-b644d725b737 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:25:50.236372 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-22d9d0a4-0d80-4a8b-b290-b644d725b737 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6" status: 200 len: 1691 microversion: 2.1 time: 0.160587 Aug 07 02:25:50.237036 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3427/7322] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:25:50 2022] GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:25:51.259012 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-06e481fc-3898-42a7-b788-f30cbb3ead76 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:25:51.259729 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-06e481fc-3898-42a7-b788-f30cbb3ead76 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:25:51.267073 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-06e481fc-3898-42a7-b788-f30cbb3ead76 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:51.267572 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-06e481fc-3898-42a7-b788-f30cbb3ead76 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:51.268070 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-06e481fc-3898-42a7-b788-f30cbb3ead76 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:51.268784 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-06e481fc-3898-42a7-b788-f30cbb3ead76 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:51.269257 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-06e481fc-3898-42a7-b788-f30cbb3ead76 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:51.269702 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-06e481fc-3898-42a7-b788-f30cbb3ead76 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:51.411026 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-06e481fc-3898-42a7-b788-f30cbb3ead76 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:25:51.419453 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-06e481fc-3898-42a7-b788-f30cbb3ead76 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6" status: 200 len: 1691 microversion: 2.1 time: 0.164536 Aug 07 02:25:51.420723 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3896/7323] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:25:51 2022] GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 => generated 1691 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:25:52.161701 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-fc8accc5-4f40-4e27-abde-784fe7f2616d req-49a0238c-71a7-485f-b74a-4163b57c1176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d8a0767-04e7-412c-a518-a87fc43fadc6", "name": "network-vif-deleted", "tag": "63adb754-88bd-4a9d-b866-ec77d1ee0550"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:25:52.173453 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-fc8accc5-4f40-4e27-abde-784fe7f2616d req-49a0238c-71a7-485f-b74a-4163b57c1176 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:52.174006 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-fc8accc5-4f40-4e27-abde-784fe7f2616d req-49a0238c-71a7-485f-b74a-4163b57c1176 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:52.174442 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-fc8accc5-4f40-4e27-abde-784fe7f2616d req-49a0238c-71a7-485f-b74a-4163b57c1176 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:52.187237 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-fc8accc5-4f40-4e27-abde-784fe7f2616d req-49a0238c-71a7-485f-b74a-4163b57c1176 service nova] Creating event network-vif-deleted:63adb754-88bd-4a9d-b866-ec77d1ee0550 for instance 8d8a0767-04e7-412c-a518-a87fc43fadc6 on n-h1-master-1 Aug 07 02:25:52.192173 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-fc8accc5-4f40-4e27-abde-784fe7f2616d req-49a0238c-71a7-485f-b74a-4163b57c1176 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034384 Aug 07 02:25:52.192758 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3428/7324] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:25:52.442242 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b4e15e3f-9660-4e4e-8690-669988a3361b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:25:52.442891 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b4e15e3f-9660-4e4e-8690-669988a3361b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:25:52.450480 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4e15e3f-9660-4e4e-8690-669988a3361b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:52.450995 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4e15e3f-9660-4e4e-8690-669988a3361b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:52.451474 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4e15e3f-9660-4e4e-8690-669988a3361b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:52.452251 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4e15e3f-9660-4e4e-8690-669988a3361b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:52.452754 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4e15e3f-9660-4e4e-8690-669988a3361b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:52.453203 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4e15e3f-9660-4e4e-8690-669988a3361b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:52.494096 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4e15e3f-9660-4e4e-8690-669988a3361b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:52.494699 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4e15e3f-9660-4e4e-8690-669988a3361b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:52.495384 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4e15e3f-9660-4e4e-8690-669988a3361b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:52.495639 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-b4e15e3f-9660-4e4e-8690-669988a3361b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lazy-loading 'fault' on Instance uuid 8d8a0767-04e7-412c-a518-a87fc43fadc6 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 02:25:52.545341 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b4e15e3f-9660-4e4e-8690-669988a3361b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:25:52.553351 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b4e15e3f-9660-4e4e-8690-669988a3361b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6" status: 200 len: 1357 microversion: 2.1 time: 0.115064 Aug 07 02:25:52.555770 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3897/7325] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:25:52 2022] GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 => generated 1357 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:25:53.580794 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c2b22621-ce83-4077-881e-932df7da1652 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:25:53.581498 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c2b22621-ce83-4077-881e-932df7da1652 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d8a0767-04e7-412c-a518-a87fc43fadc6] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:25:53.587735 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2b22621-ce83-4077-881e-932df7da1652 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:53.588500 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2b22621-ce83-4077-881e-932df7da1652 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:53.588944 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2b22621-ce83-4077-881e-932df7da1652 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:53.589640 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2b22621-ce83-4077-881e-932df7da1652 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:25:53.590099 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2b22621-ce83-4077-881e-932df7da1652 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:25:53.590529 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c2b22621-ce83-4077-881e-932df7da1652 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:25:53.603678 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-c2b22621-ce83-4077-881e-932df7da1652 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] HTTP exception thrown: Instance 8d8a0767-04e7-412c-a518-a87fc43fadc6 could not be found. Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c2b22621-ce83-4077-881e-932df7da1652 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Request method failure captured: Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 HTTP/1.1 Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7yGo9nIX3qEj-GC52soqmMO003_AnhUEQWlYbBwmW48wYR9nonaaOBu70bfnR99EdmKWQxyfmPxnw6Fuy_0Yxw_ls14vmifAlaktPi3AkkIP7eQ_67sXUgaJsj9yijh1N8Op5mAQ_f2RZq8U6BV7sFxsqws-1fZBV3RlW1_agp8hmLM Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: a212f473f58c4fb680bdb8ad63bd56f1 Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-277973988 Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a212f473f58c4fb680bdb8ad63bd56f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a212f473f58c4fb680bdb8ad63bd56f1", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a212f473f58c4fb680bdb8ad63bd56f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a212f473f58c4fb680bdb8ad63bd56f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-TestNetworkAdvancedServerOps-277973988 Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: a212f473f58c4fb680bdb8ad63bd56f1 Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-277973988 Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-TestNetworkAdvancedServerOps-277973988-project Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: a2c21b7e0fa94a9eb7155caaf474b3b2 Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-TestNetworkAdvancedServerOps-277973988-project Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 8d8a0767-04e7-412c-a518-a87fc43fadc6 could not be found. Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '8d8a0767-04e7-412c-a518-a87fc43fadc6'} Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d8a0767-04e7-412c-a518-a87fc43fadc6 could not be found. Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d8a0767-04e7-412c-a518-a87fc43fadc6 could not be found. Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:25:53.605803 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:25:53.610181 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:25:53.610181 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:25:53.610181 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:25:53.610181 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:25:53.610181 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:25:53.610181 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:25:53.610181 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d8a0767-04e7-412c-a518-a87fc43fadc6 could not be found. Aug 07 02:25:53.610181 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:25:53.610181 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c2b22621-ce83-4077-881e-932df7da1652 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Returning 404 to user: Instance 8d8a0767-04e7-412c-a518-a87fc43fadc6 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:25:53.610181 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c2b22621-ce83-4077-881e-932df7da1652 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6" status: 404 len: 111 microversion: 2.1 time: 0.031618 Aug 07 02:25:53.610181 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3429/7326] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:25:53 2022] GET /compute/v2.1/servers/8d8a0767-04e7-412c-a518-a87fc43fadc6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:25:57.147161 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-81c340eb-0e58-4a5b-93b2-e2e9864fcde9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '.version_select at 0x7f9e177dc430>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:25:57.172070 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-81c340eb-0e58-4a5b-93b2-e2e9864fcde9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1469379561" status: 202 len: 0 microversion: 2.1 time: 0.029544 Aug 07 02:25:57.172696 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3898/7327] 10.222.0.39 () {58 vars in 1284 bytes} [Sun Aug 7 02:25:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1469379561 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:25:57.196461 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a1c4a12d-1b85-49b3-86c4-f8852a7e572a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Action: 'create', calling method: .version_select at 0x7f9e17fc5700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1157170804", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIGST1mhEkx9yKZv9tm8fI+ZMjvHPZr9Glrmht0lfb59fCXJH9Ieym4VwoFfjU5sBV9KSj/LzmkzjQ1ryYXFcBQBsudVJ5SeRjXzk/uvNbFap994kbPSx/T/vYh/yhOWw=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:25:57.220526 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-a1c4a12d-1b85-49b3-86c4-f8852a7e572a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Getting quotas for project a212f473f58c4fb680bdb8ad63bd56f1. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:25:57.225823 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-a1c4a12d-1b85-49b3-86c4-f8852a7e572a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Getting quotas for user a2c21b7e0fa94a9eb7155caaf474b3b2 and project a212f473f58c4fb680bdb8ad63bd56f1. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:25:57.251158 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a1c4a12d-1b85-49b3-86c4-f8852a7e572a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.060228 Aug 07 02:25:57.251758 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3430/7328] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 02:25:57 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 02:26:02.871610 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3971215b-535f-4b44-be45-8d7e7e0bcbad tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1507504957", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "75efb4b7-8c74-481c-ae91-a671ce509d55"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1157170804", "security_groups": [{"name": "tempest-secgroup-smoke-1786063619"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:26:02.887048 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:26:03.001077 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-3971215b-535f-4b44-be45-8d7e7e0bcbad tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] validate_networks() for [('75efb4b7-8c74-481c-ae91-a671ce509d55', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 02:26:03.580847 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-3971215b-535f-4b44-be45-8d7e7e0bcbad tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 02:26:03.581433 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-3971215b-535f-4b44-be45-8d7e7e0bcbad tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 02:26:03.581826 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-3971215b-535f-4b44-be45-8d7e7e0bcbad tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 02:26:03.583050 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-3971215b-535f-4b44-be45-8d7e7e0bcbad tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 02:26:03.583651 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-3971215b-535f-4b44-be45-8d7e7e0bcbad tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 02:26:03.595114 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3971215b-535f-4b44-be45-8d7e7e0bcbad tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:03.595622 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3971215b-535f-4b44-be45-8d7e7e0bcbad tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:03.596293 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3971215b-535f-4b44-be45-8d7e7e0bcbad tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:03.597048 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3971215b-535f-4b44-be45-8d7e7e0bcbad tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:03.597523 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3971215b-535f-4b44-be45-8d7e7e0bcbad tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:03.598150 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3971215b-535f-4b44-be45-8d7e7e0bcbad tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:03.617213 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-3971215b-535f-4b44-be45-8d7e7e0bcbad tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Getting quotas for project a212f473f58c4fb680bdb8ad63bd56f1. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:26:03.623530 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-3971215b-535f-4b44-be45-8d7e7e0bcbad tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Getting quotas for user a2c21b7e0fa94a9eb7155caaf474b3b2 and project a212f473f58c4fb680bdb8ad63bd56f1. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:26:03.636617 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3971215b-535f-4b44-be45-8d7e7e0bcbad tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 02:26:03.638957 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3971215b-535f-4b44-be45-8d7e7e0bcbad tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 02:26:03.688443 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3971215b-535f-4b44-be45-8d7e7e0bcbad tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.821356 Aug 07 02:26:03.689411 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3899/7329] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 02:26:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 02:26:03.700336 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-db90ab66-a496-456c-aced-d77cdb136b43 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:26:03.700958 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-db90ab66-a496-456c-aced-d77cdb136b43 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:26:03.703643 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=16 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:26:03.781448 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-db90ab66-a496-456c-aced-d77cdb136b43 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:26:03.789423 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-db90ab66-a496-456c-aced-d77cdb136b43 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0" status: 200 len: 1267 microversion: 2.1 time: 0.093196 Aug 07 02:26:03.790004 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3431/7330] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:26:03 2022] GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0 => generated 1267 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:26:04.812454 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c6e03b93-5db3-4551-a7fb-3e0146b179c8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:26:04.814366 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c6e03b93-5db3-4551-a7fb-3e0146b179c8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:26:04.822641 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c6e03b93-5db3-4551-a7fb-3e0146b179c8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:04.823673 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c6e03b93-5db3-4551-a7fb-3e0146b179c8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:04.824221 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c6e03b93-5db3-4551-a7fb-3e0146b179c8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:04.824966 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c6e03b93-5db3-4551-a7fb-3e0146b179c8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:04.825470 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c6e03b93-5db3-4551-a7fb-3e0146b179c8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:04.826095 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c6e03b93-5db3-4551-a7fb-3e0146b179c8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:04.900742 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c6e03b93-5db3-4551-a7fb-3e0146b179c8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:26:04.911467 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c6e03b93-5db3-4551-a7fb-3e0146b179c8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0" status: 200 len: 1337 microversion: 2.1 time: 0.104575 Aug 07 02:26:04.912104 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3900/7331] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:26:04 2022] GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0 => generated 1337 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:26:05.933911 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1976072b-30c4-4ca1-be7f-d2e9137582c6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:26:05.934586 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1976072b-30c4-4ca1-be7f-d2e9137582c6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:26:05.942068 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1976072b-30c4-4ca1-be7f-d2e9137582c6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:05.942567 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1976072b-30c4-4ca1-be7f-d2e9137582c6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:05.943014 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1976072b-30c4-4ca1-be7f-d2e9137582c6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:05.943724 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1976072b-30c4-4ca1-be7f-d2e9137582c6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:05.944218 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1976072b-30c4-4ca1-be7f-d2e9137582c6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:05.944652 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1976072b-30c4-4ca1-be7f-d2e9137582c6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:06.189477 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1976072b-30c4-4ca1-be7f-d2e9137582c6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:26:06.197560 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1976072b-30c4-4ca1-be7f-d2e9137582c6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0" status: 200 len: 1393 microversion: 2.1 time: 0.268114 Aug 07 02:26:06.211469 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3432/7332] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:26:05 2022] GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0 => generated 1393 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:26:06.325558 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-868da507-00ea-468f-89ce-77dbbf036699 req-47b47d82-dc10-440c-b3a1-bc434b7dddf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "600a738b-aa1e-46a9-b2c2-df740e4fd1a0", "tag": "87ccb0b3-772a-42c5-ace9-854f94f010aa"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:26:06.337280 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-868da507-00ea-468f-89ce-77dbbf036699 req-47b47d82-dc10-440c-b3a1-bc434b7dddf6 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:06.337977 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-868da507-00ea-468f-89ce-77dbbf036699 req-47b47d82-dc10-440c-b3a1-bc434b7dddf6 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:06.338442 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-868da507-00ea-468f-89ce-77dbbf036699 req-47b47d82-dc10-440c-b3a1-bc434b7dddf6 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:06.353803 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-868da507-00ea-468f-89ce-77dbbf036699 req-47b47d82-dc10-440c-b3a1-bc434b7dddf6 service nova] Creating event network-changed:87ccb0b3-772a-42c5-ace9-854f94f010aa for instance 600a738b-aa1e-46a9-b2c2-df740e4fd1a0 on n-h1-master-1 Aug 07 02:26:06.359207 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-868da507-00ea-468f-89ce-77dbbf036699 req-47b47d82-dc10-440c-b3a1-bc434b7dddf6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038088 Aug 07 02:26:06.359833 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3901/7333] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:26:07.219581 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7251fc5c-3fb4-4681-b07b-f1ea6030bc97 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:26:07.220351 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7251fc5c-3fb4-4681-b07b-f1ea6030bc97 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:26:07.227199 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7251fc5c-3fb4-4681-b07b-f1ea6030bc97 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:07.227692 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7251fc5c-3fb4-4681-b07b-f1ea6030bc97 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:07.228192 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7251fc5c-3fb4-4681-b07b-f1ea6030bc97 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:07.228906 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7251fc5c-3fb4-4681-b07b-f1ea6030bc97 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:07.229398 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7251fc5c-3fb4-4681-b07b-f1ea6030bc97 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:07.229841 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7251fc5c-3fb4-4681-b07b-f1ea6030bc97 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:07.361956 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7251fc5c-3fb4-4681-b07b-f1ea6030bc97 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:26:07.369382 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7251fc5c-3fb4-4681-b07b-f1ea6030bc97 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0" status: 200 len: 1393 microversion: 2.1 time: 0.153797 Aug 07 02:26:07.370452 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3433/7334] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:26:07 2022] GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0 => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:26:08.392186 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fca8ea1a-c012-4ad6-85cc-a185b36bc583 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:26:08.392912 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fca8ea1a-c012-4ad6-85cc-a185b36bc583 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:26:08.399100 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fca8ea1a-c012-4ad6-85cc-a185b36bc583 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:08.399613 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fca8ea1a-c012-4ad6-85cc-a185b36bc583 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:08.400101 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fca8ea1a-c012-4ad6-85cc-a185b36bc583 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:08.400807 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fca8ea1a-c012-4ad6-85cc-a185b36bc583 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:08.401770 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fca8ea1a-c012-4ad6-85cc-a185b36bc583 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:08.402207 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fca8ea1a-c012-4ad6-85cc-a185b36bc583 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:08.541548 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fca8ea1a-c012-4ad6-85cc-a185b36bc583 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:26:08.549014 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fca8ea1a-c012-4ad6-85cc-a185b36bc583 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0" status: 200 len: 1393 microversion: 2.1 time: 0.162084 Aug 07 02:26:08.549580 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3902/7335] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:26:08 2022] GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0 => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:26:09.569724 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1e5eca66-ddac-4cfd-8006-b71ef7c312c4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:26:09.570343 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1e5eca66-ddac-4cfd-8006-b71ef7c312c4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:26:09.577199 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e5eca66-ddac-4cfd-8006-b71ef7c312c4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:09.577685 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e5eca66-ddac-4cfd-8006-b71ef7c312c4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:09.578127 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e5eca66-ddac-4cfd-8006-b71ef7c312c4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:09.578825 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e5eca66-ddac-4cfd-8006-b71ef7c312c4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:09.579281 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e5eca66-ddac-4cfd-8006-b71ef7c312c4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:09.579708 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1e5eca66-ddac-4cfd-8006-b71ef7c312c4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:09.715116 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1e5eca66-ddac-4cfd-8006-b71ef7c312c4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:26:09.722763 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1e5eca66-ddac-4cfd-8006-b71ef7c312c4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0" status: 200 len: 1393 microversion: 2.1 time: 0.156989 Aug 07 02:26:09.723346 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3434/7336] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:26:09 2022] GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0 => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:26:10.744503 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3c16aed9-1dfa-42c6-b03a-e0ed83b1bdac tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:26:10.745773 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3c16aed9-1dfa-42c6-b03a-e0ed83b1bdac tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:26:10.752393 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c16aed9-1dfa-42c6-b03a-e0ed83b1bdac tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:10.752890 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c16aed9-1dfa-42c6-b03a-e0ed83b1bdac tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:10.753362 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c16aed9-1dfa-42c6-b03a-e0ed83b1bdac tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:10.754077 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c16aed9-1dfa-42c6-b03a-e0ed83b1bdac tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:10.754549 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c16aed9-1dfa-42c6-b03a-e0ed83b1bdac tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:10.754987 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c16aed9-1dfa-42c6-b03a-e0ed83b1bdac tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:10.887198 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3c16aed9-1dfa-42c6-b03a-e0ed83b1bdac tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:26:10.894863 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3c16aed9-1dfa-42c6-b03a-e0ed83b1bdac tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0" status: 200 len: 1393 microversion: 2.1 time: 0.154368 Aug 07 02:26:10.895447 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3903/7337] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:26:10 2022] GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0 => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:26:11.914597 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-30b9bfef-bda5-4241-b555-aa4f4d1f02dc tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:26:11.915216 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-30b9bfef-bda5-4241-b555-aa4f4d1f02dc tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:26:11.922262 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-30b9bfef-bda5-4241-b555-aa4f4d1f02dc tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:11.922751 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-30b9bfef-bda5-4241-b555-aa4f4d1f02dc tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:11.923208 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-30b9bfef-bda5-4241-b555-aa4f4d1f02dc tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:11.923909 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-30b9bfef-bda5-4241-b555-aa4f4d1f02dc tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:11.924371 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-30b9bfef-bda5-4241-b555-aa4f4d1f02dc tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:11.924832 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-30b9bfef-bda5-4241-b555-aa4f4d1f02dc tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:12.059047 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-30b9bfef-bda5-4241-b555-aa4f4d1f02dc tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:26:12.066866 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-30b9bfef-bda5-4241-b555-aa4f4d1f02dc tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0" status: 200 len: 1393 microversion: 2.1 time: 0.156172 Aug 07 02:26:12.067453 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3435/7338] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:26:11 2022] GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0 => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:26:12.195507 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-07deee9e-92c4-49f9-89bc-38c181696151 req-39fc71c4-949d-4838-a876-c78b7e076731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "600a738b-aa1e-46a9-b2c2-df740e4fd1a0", "name": "network-vif-plugged", "status": "completed", "tag": "87ccb0b3-772a-42c5-ace9-854f94f010aa"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:26:12.206799 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-07deee9e-92c4-49f9-89bc-38c181696151 req-39fc71c4-949d-4838-a876-c78b7e076731 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:12.207292 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-07deee9e-92c4-49f9-89bc-38c181696151 req-39fc71c4-949d-4838-a876-c78b7e076731 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:12.207735 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-07deee9e-92c4-49f9-89bc-38c181696151 req-39fc71c4-949d-4838-a876-c78b7e076731 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:12.219152 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-07deee9e-92c4-49f9-89bc-38c181696151 req-39fc71c4-949d-4838-a876-c78b7e076731 service nova] Creating event network-vif-plugged:87ccb0b3-772a-42c5-ace9-854f94f010aa for instance 600a738b-aa1e-46a9-b2c2-df740e4fd1a0 on n-h1-master-1 Aug 07 02:26:12.224026 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-07deee9e-92c4-49f9-89bc-38c181696151 req-39fc71c4-949d-4838-a876-c78b7e076731 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032542 Aug 07 02:26:12.224616 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3904/7339] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:26:13.088273 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3b8bc47f-7153-4f71-96e8-fd240212667e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:26:13.089522 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3b8bc47f-7153-4f71-96e8-fd240212667e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:26:13.092344 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:26:13.098643 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b8bc47f-7153-4f71-96e8-fd240212667e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:13.099074 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b8bc47f-7153-4f71-96e8-fd240212667e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:13.099511 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b8bc47f-7153-4f71-96e8-fd240212667e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:13.100245 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b8bc47f-7153-4f71-96e8-fd240212667e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:13.100707 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b8bc47f-7153-4f71-96e8-fd240212667e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:13.101137 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3b8bc47f-7153-4f71-96e8-fd240212667e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:13.235120 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3b8bc47f-7153-4f71-96e8-fd240212667e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:26:13.242706 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3b8bc47f-7153-4f71-96e8-fd240212667e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0" status: 200 len: 1393 microversion: 2.1 time: 0.158520 Aug 07 02:26:13.243278 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3436/7340] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:26:13 2022] GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:26:14.263554 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:26:14.264715 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:26:14.271068 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-739548b7-5118-4590-83fd-ff2a9acb77a5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:26:14.272235 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-739548b7-5118-4590-83fd-ff2a9acb77a5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:26:14.280014 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-739548b7-5118-4590-83fd-ff2a9acb77a5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:14.280521 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-739548b7-5118-4590-83fd-ff2a9acb77a5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:14.280981 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-739548b7-5118-4590-83fd-ff2a9acb77a5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:14.281698 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-739548b7-5118-4590-83fd-ff2a9acb77a5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:14.282178 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-739548b7-5118-4590-83fd-ff2a9acb77a5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:14.282625 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-739548b7-5118-4590-83fd-ff2a9acb77a5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:14.422349 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-739548b7-5118-4590-83fd-ff2a9acb77a5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:26:14.430028 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-739548b7-5118-4590-83fd-ff2a9acb77a5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0" status: 200 len: 1565 microversion: 2.1 time: 0.169258 Aug 07 02:26:14.430505 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3905/7341] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:26:14 2022] GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0 => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:26:14.451329 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4dae4c32-31a9-4394-8117-1a2eab6ae366 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:26:14.451966 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4dae4c32-31a9-4394-8117-1a2eab6ae366 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:26:14.453913 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:26:14.460217 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4dae4c32-31a9-4394-8117-1a2eab6ae366 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:14.460710 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4dae4c32-31a9-4394-8117-1a2eab6ae366 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:14.461151 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4dae4c32-31a9-4394-8117-1a2eab6ae366 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:14.461851 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4dae4c32-31a9-4394-8117-1a2eab6ae366 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:14.462311 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4dae4c32-31a9-4394-8117-1a2eab6ae366 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:14.462748 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4dae4c32-31a9-4394-8117-1a2eab6ae366 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:14.597330 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4dae4c32-31a9-4394-8117-1a2eab6ae366 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:26:14.604996 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4dae4c32-31a9-4394-8117-1a2eab6ae366 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0" status: 200 len: 1565 microversion: 2.1 time: 0.157523 Aug 07 02:26:14.605501 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3437/7342] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:26:14 2022] GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:26:16.199654 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c043c858-a544-4380-826d-1f018262a75b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:26:16.200394 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c043c858-a544-4380-826d-1f018262a75b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:26:16.202816 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-014c2baf-37cc-403a-a64e-a68193cded8b req-3398e04d-4077-416d-a6c0-d7e3da89a2e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "600a738b-aa1e-46a9-b2c2-df740e4fd1a0", "tag": "87ccb0b3-772a-42c5-ace9-854f94f010aa"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:26:16.211420 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c043c858-a544-4380-826d-1f018262a75b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:16.212032 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c043c858-a544-4380-826d-1f018262a75b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:16.212487 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c043c858-a544-4380-826d-1f018262a75b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:16.213395 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c043c858-a544-4380-826d-1f018262a75b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:16.214620 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-014c2baf-37cc-403a-a64e-a68193cded8b req-3398e04d-4077-416d-a6c0-d7e3da89a2e4 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:16.214823 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c043c858-a544-4380-826d-1f018262a75b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:16.215108 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-014c2baf-37cc-403a-a64e-a68193cded8b req-3398e04d-4077-416d-a6c0-d7e3da89a2e4 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:16.215277 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c043c858-a544-4380-826d-1f018262a75b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:16.215548 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-014c2baf-37cc-403a-a64e-a68193cded8b req-3398e04d-4077-416d-a6c0-d7e3da89a2e4 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:16.227212 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-014c2baf-37cc-403a-a64e-a68193cded8b req-3398e04d-4077-416d-a6c0-d7e3da89a2e4 service nova] Creating event network-changed:87ccb0b3-772a-42c5-ace9-854f94f010aa for instance 600a738b-aa1e-46a9-b2c2-df740e4fd1a0 on n-h1-master-1 Aug 07 02:26:16.232995 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-014c2baf-37cc-403a-a64e-a68193cded8b req-3398e04d-4077-416d-a6c0-d7e3da89a2e4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035952 Aug 07 02:26:16.234045 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3438/7343] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 02:26:16.353155 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c043c858-a544-4380-826d-1f018262a75b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:26:16.361995 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c043c858-a544-4380-826d-1f018262a75b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0" status: 200 len: 1565 microversion: 2.1 time: 0.167511 Aug 07 02:26:16.362715 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3906/7344] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:26:16 2022] GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0 => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:26:37.620131 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=5 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:26:37.620888 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=38 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:26:37.675902 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-94fb694c-7175-46bd-bfa7-63780ab889fa tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:26:37.678317 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-94fb694c-7175-46bd-bfa7-63780ab889fa tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:26:37.685067 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94fb694c-7175-46bd-bfa7-63780ab889fa tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:37.685544 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94fb694c-7175-46bd-bfa7-63780ab889fa tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:37.685980 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94fb694c-7175-46bd-bfa7-63780ab889fa tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:37.686667 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94fb694c-7175-46bd-bfa7-63780ab889fa tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:37.687119 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94fb694c-7175-46bd-bfa7-63780ab889fa tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:37.687540 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-94fb694c-7175-46bd-bfa7-63780ab889fa tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:37.753446 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-94fb694c-7175-46bd-bfa7-63780ab889fa tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "POST /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0/action" status: 200 len: 24569 microversion: 2.1 time: 0.135189 Aug 07 02:26:37.754042 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3439/7345] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:26:37 2022] POST /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0/action => generated 24569 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 02:26:48.812854 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3c0675dd-9535-4838-a3ae-926934d45520 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:26:48.815132 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:26:48.815963 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=36 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:26:48.822279 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c0675dd-9535-4838-a3ae-926934d45520 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:48.822788 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c0675dd-9535-4838-a3ae-926934d45520 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:48.823246 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3c0675dd-9535-4838-a3ae-926934d45520 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:48.847900 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3c0675dd-9535-4838-a3ae-926934d45520 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Going to try to stop instance {{(pid=119516) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 07 02:26:48.889238 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3c0675dd-9535-4838-a3ae-926934d45520 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "POST /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0/action" status: 202 len: 0 microversion: 2.1 time: 0.080904 Aug 07 02:26:48.889871 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3907/7346] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:26:48 2022] POST /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:26:48.898599 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-24a93f6f-4ddd-415a-8d3b-a22e4749def6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:26:48.899394 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-24a93f6f-4ddd-415a-8d3b-a22e4749def6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:26:48.902382 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:26:48.903120 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=4 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:26:48.909851 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-24a93f6f-4ddd-415a-8d3b-a22e4749def6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:48.910341 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-24a93f6f-4ddd-415a-8d3b-a22e4749def6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:48.910779 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-24a93f6f-4ddd-415a-8d3b-a22e4749def6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:48.911488 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-24a93f6f-4ddd-415a-8d3b-a22e4749def6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:48.911975 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-24a93f6f-4ddd-415a-8d3b-a22e4749def6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:48.912407 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-24a93f6f-4ddd-415a-8d3b-a22e4749def6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:49.054057 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-24a93f6f-4ddd-415a-8d3b-a22e4749def6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:26:49.062091 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-24a93f6f-4ddd-415a-8d3b-a22e4749def6 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0" status: 200 len: 1692 microversion: 2.1 time: 0.167766 Aug 07 02:26:49.062657 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3440/7347] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:26:48 2022] GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0 => generated 1692 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:26:50.085425 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6604ad86-0a2a-4898-8f93-0831cfeabc70 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:26:50.086148 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6604ad86-0a2a-4898-8f93-0831cfeabc70 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:26:50.092687 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6604ad86-0a2a-4898-8f93-0831cfeabc70 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:50.093196 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6604ad86-0a2a-4898-8f93-0831cfeabc70 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:50.093652 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6604ad86-0a2a-4898-8f93-0831cfeabc70 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:50.094370 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6604ad86-0a2a-4898-8f93-0831cfeabc70 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:50.094842 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6604ad86-0a2a-4898-8f93-0831cfeabc70 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:50.095293 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6604ad86-0a2a-4898-8f93-0831cfeabc70 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:50.228949 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6604ad86-0a2a-4898-8f93-0831cfeabc70 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:26:50.236568 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6604ad86-0a2a-4898-8f93-0831cfeabc70 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0" status: 200 len: 1692 microversion: 2.1 time: 0.156286 Aug 07 02:26:50.237082 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3908/7348] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:26:50 2022] GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:26:51.258354 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9dbdfa0b-6c42-4a9f-9e3d-f800cae73a6f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:26:51.258989 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9dbdfa0b-6c42-4a9f-9e3d-f800cae73a6f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:26:51.266269 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9dbdfa0b-6c42-4a9f-9e3d-f800cae73a6f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:51.266752 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9dbdfa0b-6c42-4a9f-9e3d-f800cae73a6f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:51.267191 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9dbdfa0b-6c42-4a9f-9e3d-f800cae73a6f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:51.267906 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9dbdfa0b-6c42-4a9f-9e3d-f800cae73a6f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:51.268374 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9dbdfa0b-6c42-4a9f-9e3d-f800cae73a6f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:51.268802 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9dbdfa0b-6c42-4a9f-9e3d-f800cae73a6f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:51.685226 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9dbdfa0b-6c42-4a9f-9e3d-f800cae73a6f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:26:51.692742 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9dbdfa0b-6c42-4a9f-9e3d-f800cae73a6f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0" status: 200 len: 1692 microversion: 2.1 time: 0.438405 Aug 07 02:26:51.693309 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3441/7349] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:26:51 2022] GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0 => generated 1692 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:26:52.713737 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dc96b57f-061e-44a0-adb8-d53443d80a12 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:26:52.714287 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-dc96b57f-061e-44a0-adb8-d53443d80a12 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:26:52.721990 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc96b57f-061e-44a0-adb8-d53443d80a12 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:52.722479 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc96b57f-061e-44a0-adb8-d53443d80a12 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:52.722952 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc96b57f-061e-44a0-adb8-d53443d80a12 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:52.723654 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc96b57f-061e-44a0-adb8-d53443d80a12 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:52.724213 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc96b57f-061e-44a0-adb8-d53443d80a12 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:52.724657 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dc96b57f-061e-44a0-adb8-d53443d80a12 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:52.857918 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-dc96b57f-061e-44a0-adb8-d53443d80a12 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:26:52.865483 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-dc96b57f-061e-44a0-adb8-d53443d80a12 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0" status: 200 len: 1692 microversion: 2.1 time: 0.155735 Aug 07 02:26:52.866043 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3909/7350] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:26:52 2022] GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:26:53.886537 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-01bf57ae-f7fb-49ac-9671-f3f4d05bd78d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:26:53.887140 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-01bf57ae-f7fb-49ac-9671-f3f4d05bd78d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:26:53.893946 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-01bf57ae-f7fb-49ac-9671-f3f4d05bd78d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:53.894436 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-01bf57ae-f7fb-49ac-9671-f3f4d05bd78d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:53.894881 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-01bf57ae-f7fb-49ac-9671-f3f4d05bd78d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:53.895584 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-01bf57ae-f7fb-49ac-9671-f3f4d05bd78d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:53.896077 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-01bf57ae-f7fb-49ac-9671-f3f4d05bd78d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:53.896509 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-01bf57ae-f7fb-49ac-9671-f3f4d05bd78d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:54.026287 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-01bf57ae-f7fb-49ac-9671-f3f4d05bd78d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:26:54.034368 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-01bf57ae-f7fb-49ac-9671-f3f4d05bd78d tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0" status: 200 len: 1692 microversion: 2.1 time: 0.151765 Aug 07 02:26:54.034936 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3442/7351] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:26:53 2022] GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0 => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:26:55.055941 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ac6d879b-7cdd-430b-b6af-7ce531a017cb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:26:55.056578 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ac6d879b-7cdd-430b-b6af-7ce531a017cb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:26:55.064148 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac6d879b-7cdd-430b-b6af-7ce531a017cb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:55.064647 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac6d879b-7cdd-430b-b6af-7ce531a017cb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:55.065102 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac6d879b-7cdd-430b-b6af-7ce531a017cb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:55.065815 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac6d879b-7cdd-430b-b6af-7ce531a017cb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:55.066287 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac6d879b-7cdd-430b-b6af-7ce531a017cb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:55.066731 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ac6d879b-7cdd-430b-b6af-7ce531a017cb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:55.197222 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ac6d879b-7cdd-430b-b6af-7ce531a017cb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:26:55.204846 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ac6d879b-7cdd-430b-b6af-7ce531a017cb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0" status: 200 len: 1692 microversion: 2.1 time: 0.152904 Aug 07 02:26:55.205415 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3910/7352] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:26:55 2022] GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0 => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:26:56.226246 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7fbd0ad5-695e-40c5-9bec-ce1cb17727d9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:26:56.226760 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7fbd0ad5-695e-40c5-9bec-ce1cb17727d9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:26:56.233578 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7fbd0ad5-695e-40c5-9bec-ce1cb17727d9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:56.234056 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7fbd0ad5-695e-40c5-9bec-ce1cb17727d9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:56.234492 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7fbd0ad5-695e-40c5-9bec-ce1cb17727d9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:56.235179 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7fbd0ad5-695e-40c5-9bec-ce1cb17727d9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:56.235634 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7fbd0ad5-695e-40c5-9bec-ce1cb17727d9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:56.236092 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7fbd0ad5-695e-40c5-9bec-ce1cb17727d9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:56.368100 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7fbd0ad5-695e-40c5-9bec-ce1cb17727d9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:26:56.376175 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7fbd0ad5-695e-40c5-9bec-ce1cb17727d9 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0" status: 200 len: 1692 microversion: 2.1 time: 0.153974 Aug 07 02:26:56.376742 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3443/7353] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:26:56 2022] GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0 => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:26:57.397585 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fa83f2c9-fd75-454b-add2-ecdb445f82f5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:26:57.398221 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fa83f2c9-fd75-454b-add2-ecdb445f82f5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:26:57.405926 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa83f2c9-fd75-454b-add2-ecdb445f82f5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:57.406425 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa83f2c9-fd75-454b-add2-ecdb445f82f5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:57.406882 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa83f2c9-fd75-454b-add2-ecdb445f82f5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:57.407598 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa83f2c9-fd75-454b-add2-ecdb445f82f5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:57.408101 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa83f2c9-fd75-454b-add2-ecdb445f82f5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:57.408546 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fa83f2c9-fd75-454b-add2-ecdb445f82f5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:57.543475 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fa83f2c9-fd75-454b-add2-ecdb445f82f5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:26:57.551153 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fa83f2c9-fd75-454b-add2-ecdb445f82f5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0" status: 200 len: 1692 microversion: 2.1 time: 0.157540 Aug 07 02:26:57.551726 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3911/7354] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:26:57 2022] GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:26:58.572794 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b2c639fc-c27d-4a67-889f-1edd0a700466 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:26:58.573422 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b2c639fc-c27d-4a67-889f-1edd0a700466 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:26:58.580255 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2c639fc-c27d-4a67-889f-1edd0a700466 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:58.580746 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2c639fc-c27d-4a67-889f-1edd0a700466 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:58.581190 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2c639fc-c27d-4a67-889f-1edd0a700466 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:58.581893 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2c639fc-c27d-4a67-889f-1edd0a700466 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:58.582357 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2c639fc-c27d-4a67-889f-1edd0a700466 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:58.582792 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b2c639fc-c27d-4a67-889f-1edd0a700466 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:58.730330 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b2c639fc-c27d-4a67-889f-1edd0a700466 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:26:58.738216 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b2c639fc-c27d-4a67-889f-1edd0a700466 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0" status: 200 len: 1692 microversion: 2.1 time: 0.169244 Aug 07 02:26:58.738802 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3444/7355] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:26:58 2022] GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0 => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:26:59.761233 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ae700515-d3b0-4ea6-a1fb-9d505e74a6f8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:26:59.761875 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ae700515-d3b0-4ea6-a1fb-9d505e74a6f8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:26:59.769065 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ae700515-d3b0-4ea6-a1fb-9d505e74a6f8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:59.769568 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ae700515-d3b0-4ea6-a1fb-9d505e74a6f8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:59.770026 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ae700515-d3b0-4ea6-a1fb-9d505e74a6f8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:59.770746 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ae700515-d3b0-4ea6-a1fb-9d505e74a6f8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:26:59.771246 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ae700515-d3b0-4ea6-a1fb-9d505e74a6f8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:26:59.771698 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ae700515-d3b0-4ea6-a1fb-9d505e74a6f8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:26:59.902439 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ae700515-d3b0-4ea6-a1fb-9d505e74a6f8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:26:59.910566 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ae700515-d3b0-4ea6-a1fb-9d505e74a6f8 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0" status: 200 len: 1692 microversion: 2.1 time: 0.153280 Aug 07 02:26:59.911139 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3912/7356] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:26:59 2022] GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0 => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:27:00.932336 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-89d01bf4-ae85-4e8e-b97f-db6ee0810a9f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:27:00.932965 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-89d01bf4-ae85-4e8e-b97f-db6ee0810a9f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:27:00.941315 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-89d01bf4-ae85-4e8e-b97f-db6ee0810a9f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:27:00.941897 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-89d01bf4-ae85-4e8e-b97f-db6ee0810a9f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:27:00.942344 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-89d01bf4-ae85-4e8e-b97f-db6ee0810a9f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:27:00.943166 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-89d01bf4-ae85-4e8e-b97f-db6ee0810a9f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:27:00.943760 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-89d01bf4-ae85-4e8e-b97f-db6ee0810a9f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:27:00.944337 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-89d01bf4-ae85-4e8e-b97f-db6ee0810a9f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:27:01.078788 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-89d01bf4-ae85-4e8e-b97f-db6ee0810a9f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:27:01.086513 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-89d01bf4-ae85-4e8e-b97f-db6ee0810a9f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0" status: 200 len: 1692 microversion: 2.1 time: 0.158059 Aug 07 02:27:01.087089 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3445/7357] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:27:00 2022] GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:27:02.107588 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-8faf9eed-1770-4a26-bbac-a19e69158b01 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:27:02.108262 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-8faf9eed-1770-4a26-bbac-a19e69158b01 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:27:02.115112 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8faf9eed-1770-4a26-bbac-a19e69158b01 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:27:02.115614 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8faf9eed-1770-4a26-bbac-a19e69158b01 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:27:02.116128 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8faf9eed-1770-4a26-bbac-a19e69158b01 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:27:02.116846 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8faf9eed-1770-4a26-bbac-a19e69158b01 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:27:02.117323 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8faf9eed-1770-4a26-bbac-a19e69158b01 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:27:02.117767 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-8faf9eed-1770-4a26-bbac-a19e69158b01 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:27:02.256573 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-8faf9eed-1770-4a26-bbac-a19e69158b01 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:27:02.264763 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-8faf9eed-1770-4a26-bbac-a19e69158b01 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0" status: 200 len: 1692 microversion: 2.1 time: 0.161114 Aug 07 02:27:02.265334 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3913/7358] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:27:02 2022] GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:27:03.286086 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7cdbab85-139a-420a-9bd7-65708729e1c7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:27:03.286639 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7cdbab85-139a-420a-9bd7-65708729e1c7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:27:03.293290 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7cdbab85-139a-420a-9bd7-65708729e1c7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:27:03.293773 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7cdbab85-139a-420a-9bd7-65708729e1c7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:27:03.294294 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7cdbab85-139a-420a-9bd7-65708729e1c7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:27:03.295040 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7cdbab85-139a-420a-9bd7-65708729e1c7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:27:03.295499 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7cdbab85-139a-420a-9bd7-65708729e1c7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:27:03.295946 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7cdbab85-139a-420a-9bd7-65708729e1c7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:27:03.427730 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7cdbab85-139a-420a-9bd7-65708729e1c7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:27:03.435369 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7cdbab85-139a-420a-9bd7-65708729e1c7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0" status: 200 len: 1692 microversion: 2.1 time: 0.153326 Aug 07 02:27:03.435965 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3446/7359] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:27:03 2022] GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0 => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:27:04.456627 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-683c2fb3-0371-4bf5-8103-560cadb7d410 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:27:04.457266 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-683c2fb3-0371-4bf5-8103-560cadb7d410 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:27:04.464665 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-683c2fb3-0371-4bf5-8103-560cadb7d410 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:27:04.465169 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-683c2fb3-0371-4bf5-8103-560cadb7d410 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:27:04.466396 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-683c2fb3-0371-4bf5-8103-560cadb7d410 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:27:04.467118 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-683c2fb3-0371-4bf5-8103-560cadb7d410 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:27:04.467591 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-683c2fb3-0371-4bf5-8103-560cadb7d410 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:27:04.468110 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-683c2fb3-0371-4bf5-8103-560cadb7d410 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:27:04.600998 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-683c2fb3-0371-4bf5-8103-560cadb7d410 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:27:04.609144 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-683c2fb3-0371-4bf5-8103-560cadb7d410 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0" status: 200 len: 1669 microversion: 2.1 time: 0.156546 Aug 07 02:27:04.609719 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3914/7360] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:27:04 2022] GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0 => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:27:05.698581 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b1b971f5-fb69-42c8-8be2-710475cbfd07 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:27:05.700914 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b1b971f5-fb69-42c8-8be2-710475cbfd07 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:27:05.707762 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b1b971f5-fb69-42c8-8be2-710475cbfd07 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:27:05.708293 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b1b971f5-fb69-42c8-8be2-710475cbfd07 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:27:05.708738 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b1b971f5-fb69-42c8-8be2-710475cbfd07 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:27:05.709440 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b1b971f5-fb69-42c8-8be2-710475cbfd07 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:27:05.709936 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b1b971f5-fb69-42c8-8be2-710475cbfd07 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:27:05.710371 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b1b971f5-fb69-42c8-8be2-710475cbfd07 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:27:05.770967 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b1b971f5-fb69-42c8-8be2-710475cbfd07 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "POST /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0/action" status: 200 len: 38423 microversion: 2.1 time: 0.076256 Aug 07 02:27:05.771598 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3447/7361] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:27:05 2022] POST /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0/action => generated 38423 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 02:27:05.783538 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0922a731-b9a2-4439-81c3-7b1377a754c1 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:27:05.790467 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0922a731-b9a2-4439-81c3-7b1377a754c1 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:27:05.790956 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0922a731-b9a2-4439-81c3-7b1377a754c1 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:27:05.791403 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0922a731-b9a2-4439-81c3-7b1377a754c1 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:27:05.814029 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0922a731-b9a2-4439-81c3-7b1377a754c1 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Going to try to start instance {{(pid=119516) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 07 02:27:05.855394 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0922a731-b9a2-4439-81c3-7b1377a754c1 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "POST /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0/action" status: 202 len: 0 microversion: 2.1 time: 0.075637 Aug 07 02:27:05.856027 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3915/7362] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:27:05 2022] POST /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:27:05.865481 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2d799231-db78-4cc7-ba72-abbde7ad4d3e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:27:05.866187 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2d799231-db78-4cc7-ba72-abbde7ad4d3e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:27:05.873714 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d799231-db78-4cc7-ba72-abbde7ad4d3e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:27:05.874212 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d799231-db78-4cc7-ba72-abbde7ad4d3e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:27:05.874725 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d799231-db78-4cc7-ba72-abbde7ad4d3e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:27:05.875443 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d799231-db78-4cc7-ba72-abbde7ad4d3e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:27:05.875930 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d799231-db78-4cc7-ba72-abbde7ad4d3e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:27:05.876414 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2d799231-db78-4cc7-ba72-abbde7ad4d3e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:27:06.087922 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2d799231-db78-4cc7-ba72-abbde7ad4d3e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:27:06.096367 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2d799231-db78-4cc7-ba72-abbde7ad4d3e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0" status: 200 len: 1678 microversion: 2.1 time: 0.235095 Aug 07 02:27:06.097158 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3448/7363] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:27:05 2022] GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0 => generated 1678 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:27:07.119906 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d7f08e57-c3cd-46d6-96aa-36a606cf916c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:27:07.120638 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d7f08e57-c3cd-46d6-96aa-36a606cf916c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:27:07.126954 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d7f08e57-c3cd-46d6-96aa-36a606cf916c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:27:07.127454 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d7f08e57-c3cd-46d6-96aa-36a606cf916c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:27:07.127939 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d7f08e57-c3cd-46d6-96aa-36a606cf916c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:27:07.128656 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d7f08e57-c3cd-46d6-96aa-36a606cf916c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:27:07.129133 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d7f08e57-c3cd-46d6-96aa-36a606cf916c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:27:07.129581 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d7f08e57-c3cd-46d6-96aa-36a606cf916c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:27:07.264797 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d7f08e57-c3cd-46d6-96aa-36a606cf916c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:27:07.272449 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d7f08e57-c3cd-46d6-96aa-36a606cf916c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0" status: 200 len: 1682 microversion: 2.1 time: 0.157704 Aug 07 02:27:07.273020 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3916/7364] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:27:07 2022] GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:27:31.461717 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1ac01851-36f2-496c-bd5e-4cdaf0776557 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:27:31.464577 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1ac01851-36f2-496c-bd5e-4cdaf0776557 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:27:31.469281 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=18 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:27:31.470302 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=52 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:27:31.476792 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ac01851-36f2-496c-bd5e-4cdaf0776557 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:27:31.477289 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ac01851-36f2-496c-bd5e-4cdaf0776557 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:27:31.477733 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ac01851-36f2-496c-bd5e-4cdaf0776557 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:27:31.478449 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ac01851-36f2-496c-bd5e-4cdaf0776557 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:27:31.478913 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ac01851-36f2-496c-bd5e-4cdaf0776557 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:27:31.479346 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1ac01851-36f2-496c-bd5e-4cdaf0776557 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:27:31.551179 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1ac01851-36f2-496c-bd5e-4cdaf0776557 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "POST /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0/action" status: 200 len: 62987 microversion: 2.1 time: 0.093411 Aug 07 02:27:31.551923 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3449/7365] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:27:31 2022] POST /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0/action => generated 62987 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 02:27:38.709743 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-138b881f-a6b7-41db-adc1-e2ed71dc23ec tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:27:38.710275 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-138b881f-a6b7-41db-adc1-e2ed71dc23ec tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:27:38.712893 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=20 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:27:38.713584 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:27:38.720937 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-138b881f-a6b7-41db-adc1-e2ed71dc23ec tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:27:38.721454 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-138b881f-a6b7-41db-adc1-e2ed71dc23ec tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:27:38.721917 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-138b881f-a6b7-41db-adc1-e2ed71dc23ec tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:27:38.722650 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-138b881f-a6b7-41db-adc1-e2ed71dc23ec tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:27:38.723123 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-138b881f-a6b7-41db-adc1-e2ed71dc23ec tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:27:38.723570 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-138b881f-a6b7-41db-adc1-e2ed71dc23ec tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:27:38.753116 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-138b881f-a6b7-41db-adc1-e2ed71dc23ec tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 02:27:38.772337 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-2a27a0f4-ebcc-4e2b-b04d-67e43923addd req-77fd8919-727b-4d99-918a-1bc976f40a17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "600a738b-aa1e-46a9-b2c2-df740e4fd1a0", "tag": "87ccb0b3-772a-42c5-ace9-854f94f010aa"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:27:38.784853 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-2a27a0f4-ebcc-4e2b-b04d-67e43923addd req-77fd8919-727b-4d99-918a-1bc976f40a17 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:27:38.785881 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-2a27a0f4-ebcc-4e2b-b04d-67e43923addd req-77fd8919-727b-4d99-918a-1bc976f40a17 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:27:38.786520 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-2a27a0f4-ebcc-4e2b-b04d-67e43923addd req-77fd8919-727b-4d99-918a-1bc976f40a17 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:27:38.803739 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-2a27a0f4-ebcc-4e2b-b04d-67e43923addd req-77fd8919-727b-4d99-918a-1bc976f40a17 service nova] Creating event network-changed:87ccb0b3-772a-42c5-ace9-854f94f010aa for instance 600a738b-aa1e-46a9-b2c2-df740e4fd1a0 on n-h1-master-1 Aug 07 02:27:38.810140 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-2a27a0f4-ebcc-4e2b-b04d-67e43923addd req-77fd8919-727b-4d99-918a-1bc976f40a17 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100876 Aug 07 02:27:38.810780 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3450/7366] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:27:38.835022 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-138b881f-a6b7-41db-adc1-e2ed71dc23ec tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "DELETE /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0" status: 204 len: 0 microversion: 2.1 time: 0.128993 Aug 07 02:27:38.835618 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3917/7367] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 02:27:38 2022] DELETE /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 02:27:38.847971 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b51d4e99-18b7-493b-8d79-c12552aa9523 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:27:38.849345 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b51d4e99-18b7-493b-8d79-c12552aa9523 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:27:38.857205 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b51d4e99-18b7-493b-8d79-c12552aa9523 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:27:38.857688 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b51d4e99-18b7-493b-8d79-c12552aa9523 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:27:38.858128 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b51d4e99-18b7-493b-8d79-c12552aa9523 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:27:38.858832 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b51d4e99-18b7-493b-8d79-c12552aa9523 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:27:38.859296 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b51d4e99-18b7-493b-8d79-c12552aa9523 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:27:38.859718 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b51d4e99-18b7-493b-8d79-c12552aa9523 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:27:39.012831 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b51d4e99-18b7-493b-8d79-c12552aa9523 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:27:39.020612 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b51d4e99-18b7-493b-8d79-c12552aa9523 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0" status: 200 len: 1688 microversion: 2.1 time: 0.180488 Aug 07 02:27:39.021170 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3451/7368] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:27:38 2022] GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0 => generated 1688 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:27:40.042343 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c73fa43c-d253-45d9-981f-22b1be81ac23 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:27:40.042989 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c73fa43c-d253-45d9-981f-22b1be81ac23 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:27:40.049896 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c73fa43c-d253-45d9-981f-22b1be81ac23 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:27:40.050386 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c73fa43c-d253-45d9-981f-22b1be81ac23 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:27:40.050833 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c73fa43c-d253-45d9-981f-22b1be81ac23 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:27:40.051533 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c73fa43c-d253-45d9-981f-22b1be81ac23 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:27:40.052024 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c73fa43c-d253-45d9-981f-22b1be81ac23 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:27:40.052463 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c73fa43c-d253-45d9-981f-22b1be81ac23 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:27:40.188957 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c73fa43c-d253-45d9-981f-22b1be81ac23 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:27:40.196529 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c73fa43c-d253-45d9-981f-22b1be81ac23 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0" status: 200 len: 1688 microversion: 2.1 time: 0.158497 Aug 07 02:27:40.197106 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3918/7369] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:27:40 2022] GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0 => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:27:41.223328 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-82d0eee6-1388-4e23-a462-34147976f6d7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:27:41.223973 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-82d0eee6-1388-4e23-a462-34147976f6d7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:27:41.234386 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-f1804214-54f5-4ebd-ad60-ca284d58d08b req-c42a1caa-cce5-4744-b2d3-27790ddb4e39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "600a738b-aa1e-46a9-b2c2-df740e4fd1a0", "name": "network-vif-deleted", "tag": "87ccb0b3-772a-42c5-ace9-854f94f010aa"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:27:41.234926 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-82d0eee6-1388-4e23-a462-34147976f6d7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:27:41.235539 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-82d0eee6-1388-4e23-a462-34147976f6d7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:27:41.236032 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-82d0eee6-1388-4e23-a462-34147976f6d7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:27:41.236784 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-82d0eee6-1388-4e23-a462-34147976f6d7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:27:41.237387 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-82d0eee6-1388-4e23-a462-34147976f6d7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:27:41.237821 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-82d0eee6-1388-4e23-a462-34147976f6d7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:27:41.247200 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f1804214-54f5-4ebd-ad60-ca284d58d08b req-c42a1caa-cce5-4744-b2d3-27790ddb4e39 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:27:41.248271 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f1804214-54f5-4ebd-ad60-ca284d58d08b req-c42a1caa-cce5-4744-b2d3-27790ddb4e39 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:27:41.248905 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-f1804214-54f5-4ebd-ad60-ca284d58d08b req-c42a1caa-cce5-4744-b2d3-27790ddb4e39 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:27:41.262042 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-f1804214-54f5-4ebd-ad60-ca284d58d08b req-c42a1caa-cce5-4744-b2d3-27790ddb4e39 service nova] Creating event network-vif-deleted:87ccb0b3-772a-42c5-ace9-854f94f010aa for instance 600a738b-aa1e-46a9-b2c2-df740e4fd1a0 on n-h1-master-1 Aug 07 02:27:41.268242 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-f1804214-54f5-4ebd-ad60-ca284d58d08b req-c42a1caa-cce5-4744-b2d3-27790ddb4e39 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038195 Aug 07 02:27:41.268857 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3919/7370] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:27:41.304989 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-82d0eee6-1388-4e23-a462-34147976f6d7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:27:41.314891 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-82d0eee6-1388-4e23-a462-34147976f6d7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0" status: 200 len: 1503 microversion: 2.1 time: 0.096488 Aug 07 02:27:41.315494 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3452/7371] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:27:41 2022] GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0 => generated 1503 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:27:42.337800 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-504a6e80-027f-4d06-8b74-746cfd53ed58 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:27:42.338545 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-504a6e80-027f-4d06-8b74-746cfd53ed58 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 600a738b-aa1e-46a9-b2c2-df740e4fd1a0] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:27:42.346657 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-504a6e80-027f-4d06-8b74-746cfd53ed58 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:27:42.347153 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-504a6e80-027f-4d06-8b74-746cfd53ed58 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:27:42.347611 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-504a6e80-027f-4d06-8b74-746cfd53ed58 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:27:42.348361 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-504a6e80-027f-4d06-8b74-746cfd53ed58 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:27:42.348835 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-504a6e80-027f-4d06-8b74-746cfd53ed58 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:27:42.350016 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-504a6e80-027f-4d06-8b74-746cfd53ed58 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:27:42.364429 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-504a6e80-027f-4d06-8b74-746cfd53ed58 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] HTTP exception thrown: Instance 600a738b-aa1e-46a9-b2c2-df740e4fd1a0 could not be found. Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-504a6e80-027f-4d06-8b74-746cfd53ed58 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Request method failure captured: Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0 HTTP/1.1 Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7yGo9nIX3qEj-GC52soqmMO003_AnhUEQWlYbBwmW48wYR9nonaaOBu70bfnR99EdmKWQxyfmPxnw6Fuy_0Yxw_ls14vmifAlaktPi3AkkIP7eQ_67sXUgaJsj9yijh1N8Op5mAQ_f2RZq8U6BV7sFxsqws-1fZBV3RlW1_agp8hmLM Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: a212f473f58c4fb680bdb8ad63bd56f1 Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-277973988 Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a212f473f58c4fb680bdb8ad63bd56f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a212f473f58c4fb680bdb8ad63bd56f1", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a212f473f58c4fb680bdb8ad63bd56f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a212f473f58c4fb680bdb8ad63bd56f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-TestNetworkAdvancedServerOps-277973988 Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: a212f473f58c4fb680bdb8ad63bd56f1 Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-277973988 Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-TestNetworkAdvancedServerOps-277973988-project Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: a2c21b7e0fa94a9eb7155caaf474b3b2 Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-TestNetworkAdvancedServerOps-277973988-project Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 600a738b-aa1e-46a9-b2c2-df740e4fd1a0 could not be found. Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '600a738b-aa1e-46a9-b2c2-df740e4fd1a0'} Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 600a738b-aa1e-46a9-b2c2-df740e4fd1a0 could not be found. Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 600a738b-aa1e-46a9-b2c2-df740e4fd1a0 could not be found. Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:27:42.366124 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:27:42.370330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:27:42.370330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:27:42.370330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:27:42.370330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:27:42.370330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:27:42.370330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:27:42.370330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 600a738b-aa1e-46a9-b2c2-df740e4fd1a0 could not be found. Aug 07 02:27:42.370330 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:27:42.370330 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-504a6e80-027f-4d06-8b74-746cfd53ed58 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Returning 404 to user: Instance 600a738b-aa1e-46a9-b2c2-df740e4fd1a0 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:27:42.370330 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-504a6e80-027f-4d06-8b74-746cfd53ed58 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0" status: 404 len: 111 microversion: 2.1 time: 0.034163 Aug 07 02:27:42.370330 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3920/7372] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:27:42 2022] GET /compute/v2.1/servers/600a738b-aa1e-46a9-b2c2-df740e4fd1a0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:27:45.696635 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5cd4aea0-b177-44d0-8e70-8c626fc8592c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '.version_select at 0x7f9e242c8160>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:27:45.718356 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5cd4aea0-b177-44d0-8e70-8c626fc8592c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1157170804" status: 202 len: 0 microversion: 2.1 time: 0.025475 Aug 07 02:27:45.718952 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3453/7373] 10.222.0.39 () {58 vars in 1284 bytes} [Sun Aug 7 02:27:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1157170804 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:27:45.752014 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1d1cdaaf-d01c-41bc-b71d-89bacacfac51 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Action: 'create', calling method: .version_select at 0x7f9e248fff70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-386232646", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbO4BmzObbkyMDetvIntYwf45E4W28Mc2F9QKLFMrjdca43Eudr3934SgYJwpnxtYKZDfM0j7wxHzh/meDFRzRwTDeaqU9E0vhgLjNifmpJeXGkDfOo4kBWcYSZisNsrw=="}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:27:45.772231 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-1d1cdaaf-d01c-41bc-b71d-89bacacfac51 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Getting quotas for project a212f473f58c4fb680bdb8ad63bd56f1. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:27:45.777488 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-1d1cdaaf-d01c-41bc-b71d-89bacacfac51 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Getting quotas for user a2c21b7e0fa94a9eb7155caaf474b3b2 and project a212f473f58c4fb680bdb8ad63bd56f1. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:27:45.801371 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1d1cdaaf-d01c-41bc-b71d-89bacacfac51 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.056283 Aug 07 02:27:45.801965 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3921/7374] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 02:27:45 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:27:48.011924 n-d-master-1 devstack@n-api.service[119517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 02:27:48.013003 n-d-master-1 devstack@n-api.service[119517]: Sun Aug 7 02:27:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 02:27:51.328056 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0f26cde7-672d-46ca-9d62-c0c1d90745c5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-474158269", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "networks": [{"uuid": "aa5e607f-a5eb-4e99-85d8-88143256d1d0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-386232646", "security_groups": [{"name": "tempest-secgroup-smoke-1072092769"}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:27:51.338438 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=18 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:27:51.781928 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-0f26cde7-672d-46ca-9d62-c0c1d90745c5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] validate_networks() for [('aa5e607f-a5eb-4e99-85d8-88143256d1d0', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 02:27:52.207670 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-0f26cde7-672d-46ca-9d62-c0c1d90745c5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 02:27:52.208156 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-0f26cde7-672d-46ca-9d62-c0c1d90745c5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 02:27:52.208632 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-0f26cde7-672d-46ca-9d62-c0c1d90745c5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 02:27:52.209252 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-0f26cde7-672d-46ca-9d62-c0c1d90745c5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 02:27:52.209703 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-0f26cde7-672d-46ca-9d62-c0c1d90745c5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 02:27:52.218874 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0f26cde7-672d-46ca-9d62-c0c1d90745c5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:27:52.219375 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0f26cde7-672d-46ca-9d62-c0c1d90745c5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:27:52.219799 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0f26cde7-672d-46ca-9d62-c0c1d90745c5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:27:52.220563 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0f26cde7-672d-46ca-9d62-c0c1d90745c5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:27:52.221016 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0f26cde7-672d-46ca-9d62-c0c1d90745c5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:27:52.221441 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0f26cde7-672d-46ca-9d62-c0c1d90745c5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:27:52.242274 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-0f26cde7-672d-46ca-9d62-c0c1d90745c5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Getting quotas for project a212f473f58c4fb680bdb8ad63bd56f1. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:27:52.248165 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-0f26cde7-672d-46ca-9d62-c0c1d90745c5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Getting quotas for user a2c21b7e0fa94a9eb7155caaf474b3b2 and project a212f473f58c4fb680bdb8ad63bd56f1. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:27:52.261081 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0f26cde7-672d-46ca-9d62-c0c1d90745c5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 02:27:52.263402 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0f26cde7-672d-46ca-9d62-c0c1d90745c5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 02:27:52.310561 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0f26cde7-672d-46ca-9d62-c0c1d90745c5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.987031 Aug 07 02:27:52.316930 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3454/7375] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 02:27:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 02:27:52.323671 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7384e3bc-8fa5-409f-846e-9264cc0ed493 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:27:52.324326 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7384e3bc-8fa5-409f-846e-9264cc0ed493 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:27:52.355274 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:27:52.435437 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7384e3bc-8fa5-409f-846e-9264cc0ed493 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:27:52.442262 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7384e3bc-8fa5-409f-846e-9264cc0ed493 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd" status: 200 len: 1265 microversion: 2.1 time: 0.123757 Aug 07 02:27:52.442834 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3922/7376] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:27:52 2022] GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd => generated 1265 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:27:53.468706 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c3fe039c-4fd7-4495-ac7d-260a3ab84009 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:27:53.469220 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c3fe039c-4fd7-4495-ac7d-260a3ab84009 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:27:53.533703 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c3fe039c-4fd7-4495-ac7d-260a3ab84009 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:27:53.541360 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c3fe039c-4fd7-4495-ac7d-260a3ab84009 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd" status: 200 len: 1265 microversion: 2.1 time: 0.078821 Aug 07 02:27:53.542147 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3455/7377] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:27:53 2022] GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd => generated 1265 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:27:54.562958 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5bf633d4-291e-42de-86e4-83147d818ffb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:27:54.563827 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5bf633d4-291e-42de-86e4-83147d818ffb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:27:54.623498 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5bf633d4-291e-42de-86e4-83147d818ffb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:27:54.631505 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5bf633d4-291e-42de-86e4-83147d818ffb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd" status: 200 len: 1265 microversion: 2.1 time: 0.072890 Aug 07 02:27:54.632155 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3923/7378] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:27:54 2022] GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd => generated 1265 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:27:55.653801 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c5c584aa-0f95-4ced-9f54-01df283eb98f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:27:55.654612 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c5c584aa-0f95-4ced-9f54-01df283eb98f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:27:55.714498 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c5c584aa-0f95-4ced-9f54-01df283eb98f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:27:55.723454 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c5c584aa-0f95-4ced-9f54-01df283eb98f tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd" status: 200 len: 1265 microversion: 2.1 time: 0.074527 Aug 07 02:27:55.724116 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3456/7379] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:27:55 2022] GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd => generated 1265 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:27:56.744605 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0efb01b5-bf9a-465b-8fbc-eba74002887b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:27:56.745258 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0efb01b5-bf9a-465b-8fbc-eba74002887b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:27:56.752760 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0efb01b5-bf9a-465b-8fbc-eba74002887b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:27:56.753259 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0efb01b5-bf9a-465b-8fbc-eba74002887b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:27:56.753715 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0efb01b5-bf9a-465b-8fbc-eba74002887b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:27:56.754424 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0efb01b5-bf9a-465b-8fbc-eba74002887b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:27:56.754893 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0efb01b5-bf9a-465b-8fbc-eba74002887b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:27:56.755335 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0efb01b5-bf9a-465b-8fbc-eba74002887b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:27:56.816679 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0efb01b5-bf9a-465b-8fbc-eba74002887b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:27:56.824221 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0efb01b5-bf9a-465b-8fbc-eba74002887b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd" status: 200 len: 1269 microversion: 2.1 time: 0.083561 Aug 07 02:27:56.824779 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3924/7380] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:27:56 2022] GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd => generated 1269 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:27:57.844675 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-83692447-c3b0-458d-bacf-2882a0601b8e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:27:57.845320 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-83692447-c3b0-458d-bacf-2882a0601b8e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:27:57.852122 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-83692447-c3b0-458d-bacf-2882a0601b8e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:27:57.852609 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-83692447-c3b0-458d-bacf-2882a0601b8e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:27:57.853069 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-83692447-c3b0-458d-bacf-2882a0601b8e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:27:57.853763 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-83692447-c3b0-458d-bacf-2882a0601b8e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:27:57.854216 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-83692447-c3b0-458d-bacf-2882a0601b8e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:27:57.854641 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-83692447-c3b0-458d-bacf-2882a0601b8e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:27:57.924389 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-83692447-c3b0-458d-bacf-2882a0601b8e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:27:57.931813 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-83692447-c3b0-458d-bacf-2882a0601b8e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd" status: 200 len: 1323 microversion: 2.1 time: 0.091561 Aug 07 02:27:57.932445 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3457/7381] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:27:57 2022] GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd => generated 1323 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:27:58.861083 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-fe543ed6-3b14-4e33-a4af-04ef39eb618b req-8016c28e-10ee-4ec3-97b6-673557f30ece service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d2686cd-ca8f-4a7e-b6fa-86aa015437cd", "tag": "42687c3b-82c1-4941-a6a8-606150a76763"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:27:58.874195 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-fe543ed6-3b14-4e33-a4af-04ef39eb618b req-8016c28e-10ee-4ec3-97b6-673557f30ece service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:27:58.874781 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-fe543ed6-3b14-4e33-a4af-04ef39eb618b req-8016c28e-10ee-4ec3-97b6-673557f30ece service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:27:58.875416 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-fe543ed6-3b14-4e33-a4af-04ef39eb618b req-8016c28e-10ee-4ec3-97b6-673557f30ece service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:27:58.886515 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-fe543ed6-3b14-4e33-a4af-04ef39eb618b req-8016c28e-10ee-4ec3-97b6-673557f30ece service nova] Creating event network-changed:42687c3b-82c1-4941-a6a8-606150a76763 for instance 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd on n-h1-master-1 Aug 07 02:27:58.892861 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-fe543ed6-3b14-4e33-a4af-04ef39eb618b req-8016c28e-10ee-4ec3-97b6-673557f30ece service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036386 Aug 07 02:27:58.893466 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3925/7382] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:27:58.956641 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8a91ea99-0e53-4c03-9816-5f84172ff174 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:27:58.957606 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8a91ea99-0e53-4c03-9816-5f84172ff174 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:27:58.968768 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a91ea99-0e53-4c03-9816-5f84172ff174 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:27:58.969263 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a91ea99-0e53-4c03-9816-5f84172ff174 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:27:58.969704 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a91ea99-0e53-4c03-9816-5f84172ff174 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:27:58.970471 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a91ea99-0e53-4c03-9816-5f84172ff174 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:27:58.970929 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a91ea99-0e53-4c03-9816-5f84172ff174 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:27:58.971357 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a91ea99-0e53-4c03-9816-5f84172ff174 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:27:59.201553 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8a91ea99-0e53-4c03-9816-5f84172ff174 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:27:59.209117 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8a91ea99-0e53-4c03-9816-5f84172ff174 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd" status: 200 len: 1391 microversion: 2.1 time: 0.259361 Aug 07 02:27:59.209685 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3458/7383] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:27:58 2022] GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd => generated 1391 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:28:00.231021 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-480c8d28-86a2-4b2b-83b6-45895ed17690 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:28:00.231925 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-480c8d28-86a2-4b2b-83b6-45895ed17690 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:28:00.239571 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-480c8d28-86a2-4b2b-83b6-45895ed17690 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:00.240043 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-480c8d28-86a2-4b2b-83b6-45895ed17690 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:00.240505 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-480c8d28-86a2-4b2b-83b6-45895ed17690 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:00.241237 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-480c8d28-86a2-4b2b-83b6-45895ed17690 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:00.241773 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-480c8d28-86a2-4b2b-83b6-45895ed17690 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:00.242147 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-480c8d28-86a2-4b2b-83b6-45895ed17690 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:00.376586 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-480c8d28-86a2-4b2b-83b6-45895ed17690 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:28:00.384246 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-480c8d28-86a2-4b2b-83b6-45895ed17690 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd" status: 200 len: 1391 microversion: 2.1 time: 0.157746 Aug 07 02:28:00.384830 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3926/7384] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:28:00 2022] GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:28:01.405362 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3418ca0c-54ae-4ab7-816b-3134869dbc0e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:28:01.406014 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3418ca0c-54ae-4ab7-816b-3134869dbc0e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:28:01.412903 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3418ca0c-54ae-4ab7-816b-3134869dbc0e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:01.413386 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3418ca0c-54ae-4ab7-816b-3134869dbc0e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:01.413830 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3418ca0c-54ae-4ab7-816b-3134869dbc0e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:01.414528 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3418ca0c-54ae-4ab7-816b-3134869dbc0e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:01.414986 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3418ca0c-54ae-4ab7-816b-3134869dbc0e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:01.415418 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3418ca0c-54ae-4ab7-816b-3134869dbc0e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:01.548005 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3418ca0c-54ae-4ab7-816b-3134869dbc0e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:28:01.555488 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3418ca0c-54ae-4ab7-816b-3134869dbc0e tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd" status: 200 len: 1391 microversion: 2.1 time: 0.154582 Aug 07 02:28:01.556095 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3459/7385] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:28:01 2022] GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:28:02.576437 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9d37753d-b107-4b14-a9bc-7b5bdea308e7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:28:02.577062 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9d37753d-b107-4b14-a9bc-7b5bdea308e7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:28:02.584062 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d37753d-b107-4b14-a9bc-7b5bdea308e7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:02.584553 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d37753d-b107-4b14-a9bc-7b5bdea308e7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:02.585003 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d37753d-b107-4b14-a9bc-7b5bdea308e7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:02.585705 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d37753d-b107-4b14-a9bc-7b5bdea308e7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:02.586169 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d37753d-b107-4b14-a9bc-7b5bdea308e7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:02.586606 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d37753d-b107-4b14-a9bc-7b5bdea308e7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:02.722271 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9d37753d-b107-4b14-a9bc-7b5bdea308e7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:28:02.729717 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9d37753d-b107-4b14-a9bc-7b5bdea308e7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd" status: 200 len: 1391 microversion: 2.1 time: 0.157149 Aug 07 02:28:02.730282 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3927/7386] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:28:02 2022] GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:28:03.751423 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c4b90adc-6733-446a-86b2-f3c0c56352d7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:28:03.752075 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c4b90adc-6733-446a-86b2-f3c0c56352d7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:28:03.754070 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:28:03.754789 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:28:03.760727 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c4b90adc-6733-446a-86b2-f3c0c56352d7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:03.761216 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c4b90adc-6733-446a-86b2-f3c0c56352d7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:03.761658 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c4b90adc-6733-446a-86b2-f3c0c56352d7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:03.763048 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c4b90adc-6733-446a-86b2-f3c0c56352d7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:03.763532 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c4b90adc-6733-446a-86b2-f3c0c56352d7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:03.764169 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c4b90adc-6733-446a-86b2-f3c0c56352d7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:03.904152 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c4b90adc-6733-446a-86b2-f3c0c56352d7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:28:03.911748 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c4b90adc-6733-446a-86b2-f3c0c56352d7 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd" status: 200 len: 1391 microversion: 2.1 time: 0.164951 Aug 07 02:28:03.912338 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3460/7387] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:28:03 2022] GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:28:04.919606 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-179c5e21-1bcc-4772-a925-12e548aaabfd req-f95b2fdd-a0c3-4817-ab8a-842b6cbddce3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d2686cd-ca8f-4a7e-b6fa-86aa015437cd", "name": "network-vif-plugged", "status": "completed", "tag": "42687c3b-82c1-4941-a6a8-606150a76763"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:28:04.925426 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=8 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:28:04.933012 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-179c5e21-1bcc-4772-a925-12e548aaabfd req-f95b2fdd-a0c3-4817-ab8a-842b6cbddce3 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:04.933207 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-73376b66-3c56-47a4-998c-42bdbb74f9b4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:28:04.933653 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-179c5e21-1bcc-4772-a925-12e548aaabfd req-f95b2fdd-a0c3-4817-ab8a-842b6cbddce3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:04.933772 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-73376b66-3c56-47a4-998c-42bdbb74f9b4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:28:04.933965 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-179c5e21-1bcc-4772-a925-12e548aaabfd req-f95b2fdd-a0c3-4817-ab8a-842b6cbddce3 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:04.941436 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-73376b66-3c56-47a4-998c-42bdbb74f9b4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:04.941928 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-73376b66-3c56-47a4-998c-42bdbb74f9b4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:04.942373 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-73376b66-3c56-47a4-998c-42bdbb74f9b4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:04.943088 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-73376b66-3c56-47a4-998c-42bdbb74f9b4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:04.943550 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-73376b66-3c56-47a4-998c-42bdbb74f9b4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:04.944035 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-73376b66-3c56-47a4-998c-42bdbb74f9b4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:04.945630 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-179c5e21-1bcc-4772-a925-12e548aaabfd req-f95b2fdd-a0c3-4817-ab8a-842b6cbddce3 service nova] Creating event network-vif-plugged:42687c3b-82c1-4941-a6a8-606150a76763 for instance 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd on n-h1-master-1 Aug 07 02:28:04.951427 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-179c5e21-1bcc-4772-a925-12e548aaabfd req-f95b2fdd-a0c3-4817-ab8a-842b6cbddce3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035637 Aug 07 02:28:04.952274 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3928/7388] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:28:05.132436 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-73376b66-3c56-47a4-998c-42bdbb74f9b4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:28:05.140502 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-73376b66-3c56-47a4-998c-42bdbb74f9b4 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd" status: 200 len: 1391 microversion: 2.1 time: 0.211388 Aug 07 02:28:05.141091 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3461/7389] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:28:04 2022] GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd => generated 1391 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:28:06.161941 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-31f365ac-9f01-4d90-a1db-c8454329818a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:28:06.162755 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-31f365ac-9f01-4d90-a1db-c8454329818a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:28:06.170587 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31f365ac-9f01-4d90-a1db-c8454329818a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:06.171083 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31f365ac-9f01-4d90-a1db-c8454329818a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:06.171529 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31f365ac-9f01-4d90-a1db-c8454329818a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:06.172266 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31f365ac-9f01-4d90-a1db-c8454329818a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:06.172732 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31f365ac-9f01-4d90-a1db-c8454329818a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:06.173165 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-31f365ac-9f01-4d90-a1db-c8454329818a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:06.306528 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-31f365ac-9f01-4d90-a1db-c8454329818a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:28:06.314218 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-31f365ac-9f01-4d90-a1db-c8454329818a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd" status: 200 len: 1391 microversion: 2.1 time: 0.156534 Aug 07 02:28:06.314789 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3929/7390] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:28:06 2022] GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:28:07.335702 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2832d68b-8c74-4326-84d2-249b4f445fc2 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:28:07.336359 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2832d68b-8c74-4326-84d2-249b4f445fc2 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:28:07.338263 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=10 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:28:07.344702 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2832d68b-8c74-4326-84d2-249b4f445fc2 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:07.345189 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2832d68b-8c74-4326-84d2-249b4f445fc2 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:07.345635 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2832d68b-8c74-4326-84d2-249b4f445fc2 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:07.346327 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2832d68b-8c74-4326-84d2-249b4f445fc2 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:07.346784 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2832d68b-8c74-4326-84d2-249b4f445fc2 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:07.347213 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2832d68b-8c74-4326-84d2-249b4f445fc2 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:07.484004 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2832d68b-8c74-4326-84d2-249b4f445fc2 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:28:07.491444 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2832d68b-8c74-4326-84d2-249b4f445fc2 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd" status: 200 len: 1563 microversion: 2.1 time: 0.159684 Aug 07 02:28:07.492054 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3462/7391] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:28:07 2022] GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:28:07.512049 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d27b6eb7-dd24-4e2c-946b-b9b2b80abd6a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:28:07.513235 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d27b6eb7-dd24-4e2c-946b-b9b2b80abd6a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:28:07.520061 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d27b6eb7-dd24-4e2c-946b-b9b2b80abd6a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:07.520551 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d27b6eb7-dd24-4e2c-946b-b9b2b80abd6a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:07.521000 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d27b6eb7-dd24-4e2c-946b-b9b2b80abd6a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:07.521698 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d27b6eb7-dd24-4e2c-946b-b9b2b80abd6a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:07.522161 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d27b6eb7-dd24-4e2c-946b-b9b2b80abd6a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:07.522598 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d27b6eb7-dd24-4e2c-946b-b9b2b80abd6a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:07.657989 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d27b6eb7-dd24-4e2c-946b-b9b2b80abd6a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:28:07.666251 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d27b6eb7-dd24-4e2c-946b-b9b2b80abd6a tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd" status: 200 len: 1563 microversion: 2.1 time: 0.158234 Aug 07 02:28:07.666843 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3930/7392] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:28:07 2022] GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:28:09.513247 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d45d7001-29fa-4897-bfc3-29c9b44710c5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:28:09.514054 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d45d7001-29fa-4897-bfc3-29c9b44710c5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:28:09.514232 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-3fdbec64-e87b-4716-87dd-9bbec1270e15 req-3f1e8a5b-c9ca-4b80-8c3c-5a5089dd3177 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d2686cd-ca8f-4a7e-b6fa-86aa015437cd", "tag": "42687c3b-82c1-4941-a6a8-606150a76763"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:28:09.520472 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:28:09.522957 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d45d7001-29fa-4897-bfc3-29c9b44710c5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:09.523614 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d45d7001-29fa-4897-bfc3-29c9b44710c5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:09.524947 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d45d7001-29fa-4897-bfc3-29c9b44710c5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:09.525906 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d45d7001-29fa-4897-bfc3-29c9b44710c5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:09.526589 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d45d7001-29fa-4897-bfc3-29c9b44710c5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:09.526709 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3fdbec64-e87b-4716-87dd-9bbec1270e15 req-3f1e8a5b-c9ca-4b80-8c3c-5a5089dd3177 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:09.527165 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3fdbec64-e87b-4716-87dd-9bbec1270e15 req-3f1e8a5b-c9ca-4b80-8c3c-5a5089dd3177 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:09.527556 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d45d7001-29fa-4897-bfc3-29c9b44710c5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:09.527685 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-3fdbec64-e87b-4716-87dd-9bbec1270e15 req-3f1e8a5b-c9ca-4b80-8c3c-5a5089dd3177 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:09.540853 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-3fdbec64-e87b-4716-87dd-9bbec1270e15 req-3f1e8a5b-c9ca-4b80-8c3c-5a5089dd3177 service nova] Creating event network-changed:42687c3b-82c1-4941-a6a8-606150a76763 for instance 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd on n-h1-master-1 Aug 07 02:28:09.545979 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-3fdbec64-e87b-4716-87dd-9bbec1270e15 req-3f1e8a5b-c9ca-4b80-8c3c-5a5089dd3177 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036780 Aug 07 02:28:09.546765 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3931/7393] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:28:09.741858 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d45d7001-29fa-4897-bfc3-29c9b44710c5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:28:09.750067 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d45d7001-29fa-4897-bfc3-29c9b44710c5 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd" status: 200 len: 1563 microversion: 2.1 time: 0.242786 Aug 07 02:28:09.750658 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3463/7394] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:28:09 2022] GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd => generated 1563 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:28:30.986017 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1c02b207-8a7f-4cfc-88ae-d1119669f6ce tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:28:30.988348 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1c02b207-8a7f-4cfc-88ae-d1119669f6ce tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:28:30.990794 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=36 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:28:30.997155 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c02b207-8a7f-4cfc-88ae-d1119669f6ce tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:30.997651 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c02b207-8a7f-4cfc-88ae-d1119669f6ce tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:30.998108 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c02b207-8a7f-4cfc-88ae-d1119669f6ce tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:30.998822 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c02b207-8a7f-4cfc-88ae-d1119669f6ce tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:30.999291 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c02b207-8a7f-4cfc-88ae-d1119669f6ce tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:30.999730 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1c02b207-8a7f-4cfc-88ae-d1119669f6ce tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:31.068136 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1c02b207-8a7f-4cfc-88ae-d1119669f6ce tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "POST /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd/action" status: 200 len: 24569 microversion: 2.1 time: 0.086540 Aug 07 02:28:31.068805 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3932/7395] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:28:30 2022] POST /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd/action => generated 24569 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 02:28:42.124211 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6bd2fe8c-e377-495b-a7ff-1e2d9ba9cefd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:28:42.124798 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6bd2fe8c-e377-495b-a7ff-1e2d9ba9cefd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:28:42.126754 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=7 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:28:42.127518 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=44 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:28:42.133397 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6bd2fe8c-e377-495b-a7ff-1e2d9ba9cefd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:42.133886 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6bd2fe8c-e377-495b-a7ff-1e2d9ba9cefd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:42.134328 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6bd2fe8c-e377-495b-a7ff-1e2d9ba9cefd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:42.135050 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6bd2fe8c-e377-495b-a7ff-1e2d9ba9cefd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:42.135512 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6bd2fe8c-e377-495b-a7ff-1e2d9ba9cefd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:42.135972 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6bd2fe8c-e377-495b-a7ff-1e2d9ba9cefd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:42.159950 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-6bd2fe8c-e377-495b-a7ff-1e2d9ba9cefd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lazy-loading 'flavor' on Instance uuid 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 02:28:42.224471 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6bd2fe8c-e377-495b-a7ff-1e2d9ba9cefd tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "POST /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd/action" status: 202 len: 0 microversion: 2.1 time: 0.104513 Aug 07 02:28:42.225130 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3464/7396] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:28:42 2022] POST /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:28:42.233903 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-540ad38b-1584-431a-9202-8dc7a7bb94cc tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:28:42.234553 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-540ad38b-1584-431a-9202-8dc7a7bb94cc tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:28:42.237596 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:28:42.238273 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=4 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:28:42.244662 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-540ad38b-1584-431a-9202-8dc7a7bb94cc tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:42.245168 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-540ad38b-1584-431a-9202-8dc7a7bb94cc tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:42.245627 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-540ad38b-1584-431a-9202-8dc7a7bb94cc tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:42.246349 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-540ad38b-1584-431a-9202-8dc7a7bb94cc tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:42.246828 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-540ad38b-1584-431a-9202-8dc7a7bb94cc tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:42.247280 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-540ad38b-1584-431a-9202-8dc7a7bb94cc tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:42.383055 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-540ad38b-1584-431a-9202-8dc7a7bb94cc tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:28:42.392893 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-540ad38b-1584-431a-9202-8dc7a7bb94cc tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd" status: 200 len: 1690 microversion: 2.1 time: 0.163355 Aug 07 02:28:42.393476 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3933/7397] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:28:42 2022] GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:28:43.416673 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-367ef3f0-793f-4f25-9b8e-b7eed52a69cb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:28:43.417687 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-367ef3f0-793f-4f25-9b8e-b7eed52a69cb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:28:43.425963 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-367ef3f0-793f-4f25-9b8e-b7eed52a69cb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:43.427490 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-367ef3f0-793f-4f25-9b8e-b7eed52a69cb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:43.427958 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-367ef3f0-793f-4f25-9b8e-b7eed52a69cb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:43.428674 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-367ef3f0-793f-4f25-9b8e-b7eed52a69cb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:43.429130 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-367ef3f0-793f-4f25-9b8e-b7eed52a69cb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:43.429555 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-367ef3f0-793f-4f25-9b8e-b7eed52a69cb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:43.620269 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-367ef3f0-793f-4f25-9b8e-b7eed52a69cb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:28:43.628179 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-367ef3f0-793f-4f25-9b8e-b7eed52a69cb tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd" status: 200 len: 1673 microversion: 2.1 time: 0.217035 Aug 07 02:28:43.628753 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3465/7398] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:28:43 2022] GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd => generated 1673 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:28:44.723923 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4006cab6-6cbe-46d5-9914-3d7c5fddb82b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:28:44.726136 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4006cab6-6cbe-46d5-9914-3d7c5fddb82b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:28:44.734299 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4006cab6-6cbe-46d5-9914-3d7c5fddb82b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:44.734791 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4006cab6-6cbe-46d5-9914-3d7c5fddb82b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:44.735240 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4006cab6-6cbe-46d5-9914-3d7c5fddb82b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:44.735967 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4006cab6-6cbe-46d5-9914-3d7c5fddb82b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:44.736437 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4006cab6-6cbe-46d5-9914-3d7c5fddb82b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:44.736878 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4006cab6-6cbe-46d5-9914-3d7c5fddb82b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:44.797898 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4006cab6-6cbe-46d5-9914-3d7c5fddb82b tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "POST /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd/action" status: 200 len: 38396 microversion: 2.1 time: 0.078058 Aug 07 02:28:44.798536 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3934/7399] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:28:44 2022] POST /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd/action => generated 38396 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 02:28:44.810326 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4d10ac07-a33a-4919-ba09-5f80eff74152 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:28:44.810866 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4d10ac07-a33a-4919-ba09-5f80eff74152 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:28:44.817692 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d10ac07-a33a-4919-ba09-5f80eff74152 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:44.818179 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d10ac07-a33a-4919-ba09-5f80eff74152 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:44.818619 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d10ac07-a33a-4919-ba09-5f80eff74152 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:44.819319 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d10ac07-a33a-4919-ba09-5f80eff74152 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:44.819774 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d10ac07-a33a-4919-ba09-5f80eff74152 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:44.820231 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4d10ac07-a33a-4919-ba09-5f80eff74152 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:44.886453 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4d10ac07-a33a-4919-ba09-5f80eff74152 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "POST /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd/action" status: 202 len: 0 microversion: 2.1 time: 0.079849 Aug 07 02:28:44.887154 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3466/7400] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:28:44 2022] POST /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:28:44.895954 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-705100ff-c7c8-4780-b651-18418d9ebba2 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:28:44.897025 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-705100ff-c7c8-4780-b651-18418d9ebba2 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:28:44.905490 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-705100ff-c7c8-4780-b651-18418d9ebba2 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:44.906144 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-705100ff-c7c8-4780-b651-18418d9ebba2 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:44.906571 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-705100ff-c7c8-4780-b651-18418d9ebba2 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:44.907299 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-705100ff-c7c8-4780-b651-18418d9ebba2 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:44.907821 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-705100ff-c7c8-4780-b651-18418d9ebba2 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:44.908294 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-705100ff-c7c8-4780-b651-18418d9ebba2 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:45.053168 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-705100ff-c7c8-4780-b651-18418d9ebba2 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:28:45.060940 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-705100ff-c7c8-4780-b651-18418d9ebba2 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd" status: 200 len: 1679 microversion: 2.1 time: 0.169194 Aug 07 02:28:45.061543 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3935/7401] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:28:44 2022] GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:28:46.084717 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-31759725-be6a-4d35-8f11-8cd78c3a3f8c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:28:46.085429 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-31759725-be6a-4d35-8f11-8cd78c3a3f8c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:28:46.091841 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-31759725-be6a-4d35-8f11-8cd78c3a3f8c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:46.092965 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-31759725-be6a-4d35-8f11-8cd78c3a3f8c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:46.093695 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-31759725-be6a-4d35-8f11-8cd78c3a3f8c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:46.094440 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-31759725-be6a-4d35-8f11-8cd78c3a3f8c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:46.094896 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-31759725-be6a-4d35-8f11-8cd78c3a3f8c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:46.095321 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-31759725-be6a-4d35-8f11-8cd78c3a3f8c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:46.227042 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-31759725-be6a-4d35-8f11-8cd78c3a3f8c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:28:46.234730 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-31759725-be6a-4d35-8f11-8cd78c3a3f8c tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd" status: 200 len: 1679 microversion: 2.1 time: 0.155287 Aug 07 02:28:46.235304 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3467/7402] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:28:46 2022] GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:28:47.255398 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-52ac08a4-6f3d-4aeb-b024-9d52dd30f1cf tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:28:47.255982 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-52ac08a4-6f3d-4aeb-b024-9d52dd30f1cf tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:28:47.263545 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52ac08a4-6f3d-4aeb-b024-9d52dd30f1cf tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:47.264082 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52ac08a4-6f3d-4aeb-b024-9d52dd30f1cf tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:47.264545 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52ac08a4-6f3d-4aeb-b024-9d52dd30f1cf tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:47.265262 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52ac08a4-6f3d-4aeb-b024-9d52dd30f1cf tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:47.265739 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52ac08a4-6f3d-4aeb-b024-9d52dd30f1cf tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:47.266187 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-52ac08a4-6f3d-4aeb-b024-9d52dd30f1cf tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:47.402301 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-52ac08a4-6f3d-4aeb-b024-9d52dd30f1cf tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:28:47.410876 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-52ac08a4-6f3d-4aeb-b024-9d52dd30f1cf tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd" status: 200 len: 1682 microversion: 2.1 time: 0.159390 Aug 07 02:28:47.411469 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3936/7403] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:28:47 2022] GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:28:47.509344 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b961afc4-01f0-4b93-a7a6-1c22c36c6c75 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:28:47.511560 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b961afc4-01f0-4b93-a7a6-1c22c36c6c75 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:28:47.519000 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b961afc4-01f0-4b93-a7a6-1c22c36c6c75 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:47.519482 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b961afc4-01f0-4b93-a7a6-1c22c36c6c75 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:47.519945 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b961afc4-01f0-4b93-a7a6-1c22c36c6c75 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:47.520654 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b961afc4-01f0-4b93-a7a6-1c22c36c6c75 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:47.521108 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b961afc4-01f0-4b93-a7a6-1c22c36c6c75 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:47.521535 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b961afc4-01f0-4b93-a7a6-1c22c36c6c75 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:47.584610 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b961afc4-01f0-4b93-a7a6-1c22c36c6c75 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "POST /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd/action" status: 200 len: 38396 microversion: 2.1 time: 0.079830 Aug 07 02:28:47.585248 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3468/7404] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:28:47 2022] POST /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd/action => generated 38396 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 02:28:48.564405 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-201abe98-2c86-4b9f-abec-3cbafa9f0176 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:28:48.564916 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-201abe98-2c86-4b9f-abec-3cbafa9f0176 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:28:48.573334 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-fca4db80-0cd4-4750-8d85-dc5b4f02ddeb req-438addd9-1303-45ba-ab26-7717cb758f65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d2686cd-ca8f-4a7e-b6fa-86aa015437cd", "tag": "42687c3b-82c1-4941-a6a8-606150a76763"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:28:48.584320 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-201abe98-2c86-4b9f-abec-3cbafa9f0176 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:48.584954 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-201abe98-2c86-4b9f-abec-3cbafa9f0176 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:48.585181 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-fca4db80-0cd4-4750-8d85-dc5b4f02ddeb req-438addd9-1303-45ba-ab26-7717cb758f65 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:48.585594 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-201abe98-2c86-4b9f-abec-3cbafa9f0176 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:48.585709 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-fca4db80-0cd4-4750-8d85-dc5b4f02ddeb req-438addd9-1303-45ba-ab26-7717cb758f65 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:48.586080 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-fca4db80-0cd4-4750-8d85-dc5b4f02ddeb req-438addd9-1303-45ba-ab26-7717cb758f65 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:48.586612 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-201abe98-2c86-4b9f-abec-3cbafa9f0176 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:48.587189 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-201abe98-2c86-4b9f-abec-3cbafa9f0176 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:48.587726 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-201abe98-2c86-4b9f-abec-3cbafa9f0176 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:48.597545 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-fca4db80-0cd4-4750-8d85-dc5b4f02ddeb req-438addd9-1303-45ba-ab26-7717cb758f65 service nova] Creating event network-changed:42687c3b-82c1-4941-a6a8-606150a76763 for instance 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd on n-h1-master-1 Aug 07 02:28:48.602504 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-fca4db80-0cd4-4750-8d85-dc5b4f02ddeb req-438addd9-1303-45ba-ab26-7717cb758f65 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033154 Aug 07 02:28:48.603175 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3469/7405] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:28:48.618119 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-201abe98-2c86-4b9f-abec-3cbafa9f0176 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 02:28:48.701382 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-201abe98-2c86-4b9f-abec-3cbafa9f0176 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd" status: 204 len: 0 microversion: 2.1 time: 0.141037 Aug 07 02:28:48.708329 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3937/7406] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 02:28:48 2022] DELETE /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 02:28:48.714970 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5d096fe2-d280-4a8d-88bd-0cac9ad2c794 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:28:48.715675 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5d096fe2-d280-4a8d-88bd-0cac9ad2c794 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:28:48.722668 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d096fe2-d280-4a8d-88bd-0cac9ad2c794 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:48.723154 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d096fe2-d280-4a8d-88bd-0cac9ad2c794 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:48.723790 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d096fe2-d280-4a8d-88bd-0cac9ad2c794 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:48.724516 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d096fe2-d280-4a8d-88bd-0cac9ad2c794 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:48.724976 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d096fe2-d280-4a8d-88bd-0cac9ad2c794 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:48.725428 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5d096fe2-d280-4a8d-88bd-0cac9ad2c794 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:48.863069 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5d096fe2-d280-4a8d-88bd-0cac9ad2c794 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:28:48.870806 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5d096fe2-d280-4a8d-88bd-0cac9ad2c794 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd" status: 200 len: 1688 microversion: 2.1 time: 0.160130 Aug 07 02:28:48.871377 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3470/7407] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:28:48 2022] GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:28:49.893005 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-322bc499-3f70-40f2-9020-f1e9088c39cf tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:28:49.893712 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-322bc499-3f70-40f2-9020-f1e9088c39cf tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:28:49.900283 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-322bc499-3f70-40f2-9020-f1e9088c39cf tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:49.900774 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-322bc499-3f70-40f2-9020-f1e9088c39cf tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:49.901225 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-322bc499-3f70-40f2-9020-f1e9088c39cf tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:49.901927 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-322bc499-3f70-40f2-9020-f1e9088c39cf tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:49.902389 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-322bc499-3f70-40f2-9020-f1e9088c39cf tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:49.902830 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-322bc499-3f70-40f2-9020-f1e9088c39cf tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:50.039528 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-322bc499-3f70-40f2-9020-f1e9088c39cf tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:28:50.048026 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-322bc499-3f70-40f2-9020-f1e9088c39cf tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd" status: 200 len: 1688 microversion: 2.1 time: 0.159233 Aug 07 02:28:50.048606 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3938/7408] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:28:49 2022] GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:28:50.982584 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-c289007d-f6c3-4048-877e-a3d83de50863 req-44285ced-7824-4a7a-b1ee-2d020019f028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d2686cd-ca8f-4a7e-b6fa-86aa015437cd", "name": "network-vif-deleted", "tag": "42687c3b-82c1-4941-a6a8-606150a76763"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:28:50.995362 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c289007d-f6c3-4048-877e-a3d83de50863 req-44285ced-7824-4a7a-b1ee-2d020019f028 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:50.995850 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c289007d-f6c3-4048-877e-a3d83de50863 req-44285ced-7824-4a7a-b1ee-2d020019f028 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:50.996346 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-c289007d-f6c3-4048-877e-a3d83de50863 req-44285ced-7824-4a7a-b1ee-2d020019f028 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:51.007939 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-c289007d-f6c3-4048-877e-a3d83de50863 req-44285ced-7824-4a7a-b1ee-2d020019f028 service nova] Creating event network-vif-deleted:42687c3b-82c1-4941-a6a8-606150a76763 for instance 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd on n-h1-master-1 Aug 07 02:28:51.012661 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-c289007d-f6c3-4048-877e-a3d83de50863 req-44285ced-7824-4a7a-b1ee-2d020019f028 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034811 Aug 07 02:28:51.013246 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3471/7409] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 02:28:51.069522 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9d0e151c-42e5-45cb-8aef-a4b986108bbe tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:28:51.070157 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9d0e151c-42e5-45cb-8aef-a4b986108bbe tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:28:51.077863 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d0e151c-42e5-45cb-8aef-a4b986108bbe tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:51.078375 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d0e151c-42e5-45cb-8aef-a4b986108bbe tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:51.078835 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d0e151c-42e5-45cb-8aef-a4b986108bbe tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:51.079562 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d0e151c-42e5-45cb-8aef-a4b986108bbe tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:51.080079 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d0e151c-42e5-45cb-8aef-a4b986108bbe tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:51.080526 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d0e151c-42e5-45cb-8aef-a4b986108bbe tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:51.113954 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d0e151c-42e5-45cb-8aef-a4b986108bbe tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:51.114587 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d0e151c-42e5-45cb-8aef-a4b986108bbe tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:51.115406 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9d0e151c-42e5-45cb-8aef-a4b986108bbe tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:51.116348 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-9d0e151c-42e5-45cb-8aef-a4b986108bbe tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lazy-loading 'fault' on Instance uuid 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 02:28:51.162137 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-9d0e151c-42e5-45cb-8aef-a4b986108bbe tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c21b7e0fa94a9eb7155caaf474b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a212f473f58c4fb680bdb8ad63bd56f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:28:51.169733 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9d0e151c-42e5-45cb-8aef-a4b986108bbe tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd" status: 200 len: 1355 microversion: 2.1 time: 0.104131 Aug 07 02:28:51.170300 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3939/7410] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:28:51 2022] GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd => generated 1355 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:28:52.192510 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4186616d-1d43-4498-b0b5-15364db43eff tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:28:52.193206 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4186616d-1d43-4498-b0b5-15364db43eff tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] [instance: 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:28:52.199301 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4186616d-1d43-4498-b0b5-15364db43eff tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:52.199779 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4186616d-1d43-4498-b0b5-15364db43eff tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:52.200240 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4186616d-1d43-4498-b0b5-15364db43eff tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:52.200929 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4186616d-1d43-4498-b0b5-15364db43eff tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:28:52.201382 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4186616d-1d43-4498-b0b5-15364db43eff tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:28:52.202310 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4186616d-1d43-4498-b0b5-15364db43eff tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:28:52.215468 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-4186616d-1d43-4498-b0b5-15364db43eff tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] HTTP exception thrown: Instance 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd could not be found. Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4186616d-1d43-4498-b0b5-15364db43eff tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Request method failure captured: Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd HTTP/1.1 Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7yGo9nIX3qEj-GC52soqmMO003_AnhUEQWlYbBwmW48wYR9nonaaOBu70bfnR99EdmKWQxyfmPxnw6Fuy_0Yxw_ls14vmifAlaktPi3AkkIP7eQ_67sXUgaJsj9yijh1N8Op5mAQ_f2RZq8U6BV7sFxsqws-1fZBV3RlW1_agp8hmLM Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: a212f473f58c4fb680bdb8ad63bd56f1 Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-277973988 Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a212f473f58c4fb680bdb8ad63bd56f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a212f473f58c4fb680bdb8ad63bd56f1", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a212f473f58c4fb680bdb8ad63bd56f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a212f473f58c4fb680bdb8ad63bd56f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-TestNetworkAdvancedServerOps-277973988 Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: a212f473f58c4fb680bdb8ad63bd56f1 Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-277973988 Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-TestNetworkAdvancedServerOps-277973988-project Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: a2c21b7e0fa94a9eb7155caaf474b3b2 Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-TestNetworkAdvancedServerOps-277973988-project Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd could not be found. Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '8d2686cd-ca8f-4a7e-b6fa-86aa015437cd'} Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd could not be found. Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd could not be found. Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:28:52.217091 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:28:52.222779 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:28:52.222779 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:28:52.222779 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:28:52.222779 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:28:52.222779 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:28:52.222779 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:28:52.222779 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd could not be found. Aug 07 02:28:52.222779 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:28:52.222779 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4186616d-1d43-4498-b0b5-15364db43eff tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Returning 404 to user: Instance 8d2686cd-ca8f-4a7e-b6fa-86aa015437cd could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:28:52.222779 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4186616d-1d43-4498-b0b5-15364db43eff tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd" status: 404 len: 111 microversion: 2.1 time: 0.032077 Aug 07 02:28:52.222779 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3472/7411] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:28:52 2022] GET /compute/v2.1/servers/8d2686cd-ca8f-4a7e-b6fa-86aa015437cd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:28:55.463475 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0c160b0a-28d7-464a-b443-6388bf5b1301 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] Calling method '.version_select at 0x7f9e17aaec10>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:28:55.486892 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0c160b0a-28d7-464a-b443-6388bf5b1301 tempest-TestNetworkAdvancedServerOps-277973988 tempest-TestNetworkAdvancedServerOps-277973988-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-386232646" status: 202 len: 0 microversion: 2.1 time: 0.026677 Aug 07 02:28:55.487532 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3940/7412] 10.222.0.39 () {58 vars in 1281 bytes} [Sun Aug 7 02:28:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-386232646 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:29:06.435508 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=18 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:29:06.436924 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:29:06.600925 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3a949fca-fae4-48f9-b784-10aff5aee024 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Action: 'create', calling method: .version_select at 0x7f9e24a95c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-1184277479", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCokKvNf/UlmMd7m+aO0htHs/eId4001dowG9GiyG9CMQZ/u3qh6N7sptixWSsxN2JKesamioiF2IOkxtj2djAMT2yZ10ll50ZcOgUxjj7c6n0OU3K16L5trS/r0Lk/3g=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:29:06.617236 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-3a949fca-fae4-48f9-b784-10aff5aee024 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Getting quotas for project 3bf88ea13f914730a38cef575bd4982d. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:29:06.622418 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-3a949fca-fae4-48f9-b784-10aff5aee024 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Getting quotas for user 6377b5c6f4bc4645a62697b66316fb39 and project 3bf88ea13f914730a38cef575bd4982d. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:29:06.648782 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3a949fca-fae4-48f9-b784-10aff5aee024 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.218593 Aug 07 02:29:06.649571 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3473/7413] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 02:29:06 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:29:07.745400 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:29:07.747324 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:29:07.751876 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e4ddad4a-eb9c-4f9c-ac47-9e01987c00e1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-607923153", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1184277479", "security_groups": [{"name": "tempest-secgroup-smoke-245590614"}], "networks": [{"uuid": "7c84ec7a-7d78-4fc7-8129-b82697275dab"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:29:07.872755 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-e4ddad4a-eb9c-4f9c-ac47-9e01987c00e1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] validate_networks() for [('7c84ec7a-7d78-4fc7-8129-b82697275dab', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 02:29:08.579423 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e4ddad4a-eb9c-4f9c-ac47-9e01987c00e1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 02:29:08.579865 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e4ddad4a-eb9c-4f9c-ac47-9e01987c00e1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 02:29:08.580396 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e4ddad4a-eb9c-4f9c-ac47-9e01987c00e1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 02:29:08.580821 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e4ddad4a-eb9c-4f9c-ac47-9e01987c00e1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 02:29:08.581252 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-e4ddad4a-eb9c-4f9c-ac47-9e01987c00e1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 02:29:08.590035 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4ddad4a-eb9c-4f9c-ac47-9e01987c00e1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:29:08.590535 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4ddad4a-eb9c-4f9c-ac47-9e01987c00e1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:29:08.591007 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4ddad4a-eb9c-4f9c-ac47-9e01987c00e1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:29:08.591761 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4ddad4a-eb9c-4f9c-ac47-9e01987c00e1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:29:08.592254 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4ddad4a-eb9c-4f9c-ac47-9e01987c00e1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:29:08.592705 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e4ddad4a-eb9c-4f9c-ac47-9e01987c00e1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:29:08.609956 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-e4ddad4a-eb9c-4f9c-ac47-9e01987c00e1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Getting quotas for project 3bf88ea13f914730a38cef575bd4982d. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:29:08.615713 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-e4ddad4a-eb9c-4f9c-ac47-9e01987c00e1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Getting quotas for user 6377b5c6f4bc4645a62697b66316fb39 and project 3bf88ea13f914730a38cef575bd4982d. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:29:08.629441 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e4ddad4a-eb9c-4f9c-ac47-9e01987c00e1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 02:29:08.631761 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e4ddad4a-eb9c-4f9c-ac47-9e01987c00e1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 02:29:08.679983 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e4ddad4a-eb9c-4f9c-ac47-9e01987c00e1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.936231 Aug 07 02:29:08.680648 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3941/7414] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 02:29:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 02:29:08.693789 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-75b29a7c-4069-4fc8-9c1b-070b50f41cc2 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:29:08.694740 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-75b29a7c-4069-4fc8-9c1b-070b50f41cc2 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:29:08.755191 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-75b29a7c-4069-4fc8-9c1b-070b50f41cc2 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:29:08.761928 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-75b29a7c-4069-4fc8-9c1b-070b50f41cc2 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1246 microversion: 2.1 time: 0.073556 Aug 07 02:29:08.762502 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3474/7415] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:29:08 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1246 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:29:09.784048 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-26452a87-11c7-439e-8f25-08417622200b tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:29:09.784918 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-26452a87-11c7-439e-8f25-08417622200b tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:29:09.792136 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-26452a87-11c7-439e-8f25-08417622200b tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:29:09.792727 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-26452a87-11c7-439e-8f25-08417622200b tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:29:09.793257 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-26452a87-11c7-439e-8f25-08417622200b tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:29:09.793973 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-26452a87-11c7-439e-8f25-08417622200b tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:29:09.794526 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-26452a87-11c7-439e-8f25-08417622200b tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:29:09.795035 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-26452a87-11c7-439e-8f25-08417622200b tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:29:09.882303 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-26452a87-11c7-439e-8f25-08417622200b tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:29:09.893782 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-26452a87-11c7-439e-8f25-08417622200b tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1298 microversion: 2.1 time: 0.114915 Aug 07 02:29:09.894829 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3942/7416] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:29:09 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1298 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:29:10.915618 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4c081158-1ea7-4347-825b-41306ff94187 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:29:10.916685 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4c081158-1ea7-4347-825b-41306ff94187 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:29:10.924940 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4c081158-1ea7-4347-825b-41306ff94187 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:29:10.925570 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4c081158-1ea7-4347-825b-41306ff94187 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:29:10.926150 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4c081158-1ea7-4347-825b-41306ff94187 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:29:10.927079 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4c081158-1ea7-4347-825b-41306ff94187 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:29:10.927545 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4c081158-1ea7-4347-825b-41306ff94187 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:29:10.928011 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4c081158-1ea7-4347-825b-41306ff94187 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:29:11.091066 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4c081158-1ea7-4347-825b-41306ff94187 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:29:11.099211 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4c081158-1ea7-4347-825b-41306ff94187 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1371 microversion: 2.1 time: 0.187626 Aug 07 02:29:11.099789 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3475/7417] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:29:10 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1371 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:29:11.373192 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-b40345ff-09b8-4baf-94b2-05eab6eaf9f0 req-21b240e6-39fb-407f-a36f-3508f099f26a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eb52a76-13cd-4714-8996-e66f0b297c69", "tag": "f88bed67-6714-4164-9bb4-b0f8dd117c58"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:29:11.395844 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b40345ff-09b8-4baf-94b2-05eab6eaf9f0 req-21b240e6-39fb-407f-a36f-3508f099f26a service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:29:11.396403 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b40345ff-09b8-4baf-94b2-05eab6eaf9f0 req-21b240e6-39fb-407f-a36f-3508f099f26a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:29:11.397516 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b40345ff-09b8-4baf-94b2-05eab6eaf9f0 req-21b240e6-39fb-407f-a36f-3508f099f26a service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:29:11.411430 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-b40345ff-09b8-4baf-94b2-05eab6eaf9f0 req-21b240e6-39fb-407f-a36f-3508f099f26a service nova] Creating event network-changed:f88bed67-6714-4164-9bb4-b0f8dd117c58 for instance 0eb52a76-13cd-4714-8996-e66f0b297c69 on n-h2-master-1 Aug 07 02:29:11.416978 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-b40345ff-09b8-4baf-94b2-05eab6eaf9f0 req-21b240e6-39fb-407f-a36f-3508f099f26a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052544 Aug 07 02:29:11.418226 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3943/7418] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:29:12.120478 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-dc7d999c-46ec-49f6-9a20-945c93adad5d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:29:12.121098 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-dc7d999c-46ec-49f6-9a20-945c93adad5d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:29:12.128608 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dc7d999c-46ec-49f6-9a20-945c93adad5d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:29:12.129086 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dc7d999c-46ec-49f6-9a20-945c93adad5d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:29:12.129523 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dc7d999c-46ec-49f6-9a20-945c93adad5d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:29:12.130215 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dc7d999c-46ec-49f6-9a20-945c93adad5d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:29:12.130674 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dc7d999c-46ec-49f6-9a20-945c93adad5d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:29:12.131102 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dc7d999c-46ec-49f6-9a20-945c93adad5d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:29:12.261159 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-dc7d999c-46ec-49f6-9a20-945c93adad5d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:29:12.268726 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-dc7d999c-46ec-49f6-9a20-945c93adad5d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1371 microversion: 2.1 time: 0.152161 Aug 07 02:29:12.269299 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3476/7419] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:29:12 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:29:13.291935 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-588f26f9-fa19-4d39-9232-058def9756a1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:29:13.292675 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-588f26f9-fa19-4d39-9232-058def9756a1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:29:13.298969 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-588f26f9-fa19-4d39-9232-058def9756a1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:29:13.299475 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-588f26f9-fa19-4d39-9232-058def9756a1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:29:13.299958 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-588f26f9-fa19-4d39-9232-058def9756a1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:29:13.300688 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-588f26f9-fa19-4d39-9232-058def9756a1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:29:13.301191 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-588f26f9-fa19-4d39-9232-058def9756a1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:29:13.301640 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-588f26f9-fa19-4d39-9232-058def9756a1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:29:13.438239 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-588f26f9-fa19-4d39-9232-058def9756a1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:29:13.445796 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-588f26f9-fa19-4d39-9232-058def9756a1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1371 microversion: 2.1 time: 0.159176 Aug 07 02:29:13.446379 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3944/7420] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:29:13 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:29:14.466064 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c54d7a43-014e-486d-9b3e-d5bf2ecf714d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:29:14.466689 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c54d7a43-014e-486d-9b3e-d5bf2ecf714d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:29:14.474569 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c54d7a43-014e-486d-9b3e-d5bf2ecf714d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:29:14.475062 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c54d7a43-014e-486d-9b3e-d5bf2ecf714d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:29:14.475548 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c54d7a43-014e-486d-9b3e-d5bf2ecf714d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:29:14.476254 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c54d7a43-014e-486d-9b3e-d5bf2ecf714d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:29:14.476788 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c54d7a43-014e-486d-9b3e-d5bf2ecf714d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:29:14.477149 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c54d7a43-014e-486d-9b3e-d5bf2ecf714d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:29:14.618409 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c54d7a43-014e-486d-9b3e-d5bf2ecf714d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:29:14.625909 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c54d7a43-014e-486d-9b3e-d5bf2ecf714d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1371 microversion: 2.1 time: 0.163713 Aug 07 02:29:14.626502 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3477/7421] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:29:14 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:29:15.646620 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1d8f9d67-7268-4c3f-8c15-9d091093a8b9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:29:15.647252 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1d8f9d67-7268-4c3f-8c15-9d091093a8b9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:29:15.653949 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d8f9d67-7268-4c3f-8c15-9d091093a8b9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:29:15.654447 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d8f9d67-7268-4c3f-8c15-9d091093a8b9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:29:15.655419 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d8f9d67-7268-4c3f-8c15-9d091093a8b9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:29:15.656150 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d8f9d67-7268-4c3f-8c15-9d091093a8b9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:29:15.656620 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d8f9d67-7268-4c3f-8c15-9d091093a8b9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:29:15.657058 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d8f9d67-7268-4c3f-8c15-9d091093a8b9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:29:15.792806 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1d8f9d67-7268-4c3f-8c15-9d091093a8b9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:29:15.800973 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1d8f9d67-7268-4c3f-8c15-9d091093a8b9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1371 microversion: 2.1 time: 0.158300 Aug 07 02:29:15.801547 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3945/7422] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:29:15 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:29:16.268241 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-ca2ff644-ff9d-4d4d-9622-3cf1405df50f req-9a5b55da-4998-424a-bf6b-40f52cfd3f34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb52a76-13cd-4714-8996-e66f0b297c69", "name": "network-vif-plugged", "status": "completed", "tag": "f88bed67-6714-4164-9bb4-b0f8dd117c58"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:29:16.279150 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-ca2ff644-ff9d-4d4d-9622-3cf1405df50f req-9a5b55da-4998-424a-bf6b-40f52cfd3f34 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:29:16.279637 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-ca2ff644-ff9d-4d4d-9622-3cf1405df50f req-9a5b55da-4998-424a-bf6b-40f52cfd3f34 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:29:16.280101 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-ca2ff644-ff9d-4d4d-9622-3cf1405df50f req-9a5b55da-4998-424a-bf6b-40f52cfd3f34 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:29:16.291544 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-ca2ff644-ff9d-4d4d-9622-3cf1405df50f req-9a5b55da-4998-424a-bf6b-40f52cfd3f34 service nova] Creating event network-vif-plugged:f88bed67-6714-4164-9bb4-b0f8dd117c58 for instance 0eb52a76-13cd-4714-8996-e66f0b297c69 on n-h2-master-1 Aug 07 02:29:16.296516 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-ca2ff644-ff9d-4d4d-9622-3cf1405df50f req-9a5b55da-4998-424a-bf6b-40f52cfd3f34 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032593 Aug 07 02:29:16.297114 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3478/7423] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:29:16.821758 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-746932c2-fe7c-4afa-9a85-67e525a4c63b tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:29:16.822396 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-746932c2-fe7c-4afa-9a85-67e525a4c63b tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:29:16.829429 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-746932c2-fe7c-4afa-9a85-67e525a4c63b tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:29:16.829927 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-746932c2-fe7c-4afa-9a85-67e525a4c63b tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:29:16.830382 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-746932c2-fe7c-4afa-9a85-67e525a4c63b tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:29:16.831097 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-746932c2-fe7c-4afa-9a85-67e525a4c63b tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:29:16.831585 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-746932c2-fe7c-4afa-9a85-67e525a4c63b tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:29:16.832050 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-746932c2-fe7c-4afa-9a85-67e525a4c63b tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:29:16.965744 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-746932c2-fe7c-4afa-9a85-67e525a4c63b tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:29:16.973576 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-746932c2-fe7c-4afa-9a85-67e525a4c63b tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1371 microversion: 2.1 time: 0.155728 Aug 07 02:29:16.974149 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3946/7424] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:29:16 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:29:17.996234 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-75cb3a2b-6100-4b2e-bc8c-a90832b22b3a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:29:17.996937 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-75cb3a2b-6100-4b2e-bc8c-a90832b22b3a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:29:18.003597 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75cb3a2b-6100-4b2e-bc8c-a90832b22b3a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:29:18.004107 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75cb3a2b-6100-4b2e-bc8c-a90832b22b3a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:29:18.004544 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75cb3a2b-6100-4b2e-bc8c-a90832b22b3a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:29:18.005230 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75cb3a2b-6100-4b2e-bc8c-a90832b22b3a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:29:18.005688 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75cb3a2b-6100-4b2e-bc8c-a90832b22b3a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:29:18.006110 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-75cb3a2b-6100-4b2e-bc8c-a90832b22b3a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:29:18.142597 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-75cb3a2b-6100-4b2e-bc8c-a90832b22b3a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:29:18.150428 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-75cb3a2b-6100-4b2e-bc8c-a90832b22b3a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1555 microversion: 2.1 time: 0.159512 Aug 07 02:29:18.151008 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3479/7425] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:29:17 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:29:18.171161 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fcc32233-46ac-4eaa-9334-09fa5f0768b3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:29:18.171792 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fcc32233-46ac-4eaa-9334-09fa5f0768b3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:29:18.191945 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fcc32233-46ac-4eaa-9334-09fa5f0768b3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:29:18.192571 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fcc32233-46ac-4eaa-9334-09fa5f0768b3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:29:18.193051 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fcc32233-46ac-4eaa-9334-09fa5f0768b3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:29:18.193804 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fcc32233-46ac-4eaa-9334-09fa5f0768b3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:29:18.194285 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fcc32233-46ac-4eaa-9334-09fa5f0768b3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:29:18.194735 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fcc32233-46ac-4eaa-9334-09fa5f0768b3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:29:18.335930 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fcc32233-46ac-4eaa-9334-09fa5f0768b3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:29:18.343579 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fcc32233-46ac-4eaa-9334-09fa5f0768b3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1555 microversion: 2.1 time: 0.176885 Aug 07 02:29:18.344441 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3947/7426] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:29:18 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1555 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:29:20.017556 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-e4da5882-2cd9-4a34-8a39-183a23f1b723 req-82d7b380-c2c8-4b3f-bcac-20a1914de112 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eb52a76-13cd-4714-8996-e66f0b297c69", "tag": "f88bed67-6714-4164-9bb4-b0f8dd117c58"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:29:20.022626 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:29:20.030316 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-e4da5882-2cd9-4a34-8a39-183a23f1b723 req-82d7b380-c2c8-4b3f-bcac-20a1914de112 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:29:20.030847 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-e4da5882-2cd9-4a34-8a39-183a23f1b723 req-82d7b380-c2c8-4b3f-bcac-20a1914de112 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:29:20.031314 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-e4da5882-2cd9-4a34-8a39-183a23f1b723 req-82d7b380-c2c8-4b3f-bcac-20a1914de112 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:29:20.042834 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-e4da5882-2cd9-4a34-8a39-183a23f1b723 req-82d7b380-c2c8-4b3f-bcac-20a1914de112 service nova] Creating event network-changed:f88bed67-6714-4164-9bb4-b0f8dd117c58 for instance 0eb52a76-13cd-4714-8996-e66f0b297c69 on n-h2-master-1 Aug 07 02:29:20.048076 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-e4da5882-2cd9-4a34-8a39-183a23f1b723 req-82d7b380-c2c8-4b3f-bcac-20a1914de112 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035134 Aug 07 02:29:20.048945 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3480/7427] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 02:31:08.021153 n-d-master-1 devstack@n-api.service[119517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 02:31:08.021730 n-d-master-1 devstack@n-api.service[119517]: Sun Aug 7 02:31:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 02:31:16.078982 n-d-master-1 devstack@n-api.service[119516]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9bbf4f32-4f7b-4fcf-a326-64eac47dae98] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 07 02:31:16.079902 n-d-master-1 devstack@n-api.service[119516]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e144fce3-2ef9-4f1b-815a-36f44ddcd578] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 07 02:31:16.080276 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:31:16.081057 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:31:16.082264 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:31:16.082992 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=34 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:31:16.087210 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7f19a8c3-0a6b-495f-b0c1-d8f95cfc4cd7 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:31:16.087814 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7f19a8c3-0a6b-495f-b0c1-d8f95cfc4cd7 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:16.096900 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f19a8c3-0a6b-495f-b0c1-d8f95cfc4cd7 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:16.097716 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f19a8c3-0a6b-495f-b0c1-d8f95cfc4cd7 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:16.098170 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f19a8c3-0a6b-495f-b0c1-d8f95cfc4cd7 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:16.098870 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f19a8c3-0a6b-495f-b0c1-d8f95cfc4cd7 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:16.099337 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f19a8c3-0a6b-495f-b0c1-d8f95cfc4cd7 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:16.099770 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f19a8c3-0a6b-495f-b0c1-d8f95cfc4cd7 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:16.122351 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-7f19a8c3-0a6b-495f-b0c1-d8f95cfc4cd7 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lazy-loading 'flavor' on Instance uuid 0eb52a76-13cd-4714-8996-e66f0b297c69 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 02:31:16.302483 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7f19a8c3-0a6b-495f-b0c1-d8f95cfc4cd7 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "POST /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69/action" status: 202 len: 0 microversion: 2.1 time: 0.225912 Aug 07 02:31:16.303074 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3948/7428] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:31:16 2022] POST /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:31:16.309728 n-d-master-1 devstack@n-api.service[119517]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dde625b-e185-486e-885e-ba9f9bdf36ce] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 07 02:31:16.311184 n-d-master-1 devstack@n-api.service[119517]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cc2209bc-4fce-4284-bf5f-e0375e6343bd] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 07 02:31:16.315745 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b5d39829-8f5d-4340-9b78-bfb763ca6a82 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:31:16.316478 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b5d39829-8f5d-4340-9b78-bfb763ca6a82 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:16.318526 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:31:16.319238 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=28 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:31:16.325170 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5d39829-8f5d-4340-9b78-bfb763ca6a82 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:16.325653 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5d39829-8f5d-4340-9b78-bfb763ca6a82 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:16.326102 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5d39829-8f5d-4340-9b78-bfb763ca6a82 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:16.326807 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5d39829-8f5d-4340-9b78-bfb763ca6a82 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:16.327261 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5d39829-8f5d-4340-9b78-bfb763ca6a82 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:16.327689 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b5d39829-8f5d-4340-9b78-bfb763ca6a82 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:16.463345 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b5d39829-8f5d-4340-9b78-bfb763ca6a82 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:31:16.470991 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b5d39829-8f5d-4340-9b78-bfb763ca6a82 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1679 microversion: 2.1 time: 0.163284 Aug 07 02:31:16.471566 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3481/7429] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:31:16 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:31:17.496967 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e84b8496-0fd7-49f9-8340-3973735300ff tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:31:17.497608 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e84b8496-0fd7-49f9-8340-3973735300ff tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:17.511652 n-d-master-1 devstack@n-api.service[119516]: INFO oslo.messaging._drivers.impl_rabbit [-] [9bbf4f32-4f7b-4fcf-a326-64eac47dae98] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 36762. Aug 07 02:31:17.513861 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e84b8496-0fd7-49f9-8340-3973735300ff tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:17.514359 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e84b8496-0fd7-49f9-8340-3973735300ff tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:17.514803 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e84b8496-0fd7-49f9-8340-3973735300ff tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:17.515508 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e84b8496-0fd7-49f9-8340-3973735300ff tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:17.515995 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e84b8496-0fd7-49f9-8340-3973735300ff tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:17.516433 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e84b8496-0fd7-49f9-8340-3973735300ff tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:17.521894 n-d-master-1 devstack@n-api.service[119516]: INFO oslo.messaging._drivers.impl_rabbit [-] [e144fce3-2ef9-4f1b-815a-36f44ddcd578] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 36764. Aug 07 02:31:17.651338 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e84b8496-0fd7-49f9-8340-3973735300ff tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:31:17.661064 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e84b8496-0fd7-49f9-8340-3973735300ff tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1679 microversion: 2.1 time: 0.172485 Aug 07 02:31:17.661980 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3949/7430] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:31:17 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:31:18.682737 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8a7bba69-4ba2-4166-bb64-2d2d66d26f25 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:31:18.683354 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8a7bba69-4ba2-4166-bb64-2d2d66d26f25 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:18.695114 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a7bba69-4ba2-4166-bb64-2d2d66d26f25 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:18.695603 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a7bba69-4ba2-4166-bb64-2d2d66d26f25 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:18.696081 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a7bba69-4ba2-4166-bb64-2d2d66d26f25 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:18.696782 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a7bba69-4ba2-4166-bb64-2d2d66d26f25 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:18.697236 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a7bba69-4ba2-4166-bb64-2d2d66d26f25 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:18.697663 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a7bba69-4ba2-4166-bb64-2d2d66d26f25 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:18.703334 n-d-master-1 devstack@n-api.service[119517]: INFO oslo.messaging._drivers.impl_rabbit [-] [cc2209bc-4fce-4284-bf5f-e0375e6343bd] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 36770. Aug 07 02:31:18.708932 n-d-master-1 devstack@n-api.service[119517]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dde625b-e185-486e-885e-ba9f9bdf36ce] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 36768. Aug 07 02:31:18.838956 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8a7bba69-4ba2-4166-bb64-2d2d66d26f25 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:31:18.847109 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8a7bba69-4ba2-4166-bb64-2d2d66d26f25 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1679 microversion: 2.1 time: 0.168314 Aug 07 02:31:18.847952 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3482/7431] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:31:18 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:31:19.867780 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c1f11ae1-d722-4596-8235-4617c38fdba2 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:31:19.868433 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c1f11ae1-d722-4596-8235-4617c38fdba2 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:19.875159 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1f11ae1-d722-4596-8235-4617c38fdba2 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:19.876270 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1f11ae1-d722-4596-8235-4617c38fdba2 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:19.876719 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1f11ae1-d722-4596-8235-4617c38fdba2 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:19.877429 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1f11ae1-d722-4596-8235-4617c38fdba2 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:19.877892 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1f11ae1-d722-4596-8235-4617c38fdba2 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:19.878329 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c1f11ae1-d722-4596-8235-4617c38fdba2 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:20.019475 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c1f11ae1-d722-4596-8235-4617c38fdba2 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:31:20.027054 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c1f11ae1-d722-4596-8235-4617c38fdba2 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1679 microversion: 2.1 time: 0.163247 Aug 07 02:31:20.027617 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3950/7432] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:31:19 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:31:21.048626 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-61c3c898-d228-472c-b7c5-4d63a5025d94 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:31:21.049248 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-61c3c898-d228-472c-b7c5-4d63a5025d94 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:21.056139 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-61c3c898-d228-472c-b7c5-4d63a5025d94 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:21.056629 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-61c3c898-d228-472c-b7c5-4d63a5025d94 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:21.057074 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-61c3c898-d228-472c-b7c5-4d63a5025d94 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:21.057776 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-61c3c898-d228-472c-b7c5-4d63a5025d94 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:21.058243 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-61c3c898-d228-472c-b7c5-4d63a5025d94 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:21.058677 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-61c3c898-d228-472c-b7c5-4d63a5025d94 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:21.189775 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-61c3c898-d228-472c-b7c5-4d63a5025d94 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:31:21.197497 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-61c3c898-d228-472c-b7c5-4d63a5025d94 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1679 microversion: 2.1 time: 0.153316 Aug 07 02:31:21.198073 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3483/7433] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:31:21 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:31:22.225463 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-24beeed5-425c-4fcf-9f9b-3cb2136cebd5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:31:22.226097 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-24beeed5-425c-4fcf-9f9b-3cb2136cebd5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:22.233002 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24beeed5-425c-4fcf-9f9b-3cb2136cebd5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:22.233442 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24beeed5-425c-4fcf-9f9b-3cb2136cebd5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:22.233896 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24beeed5-425c-4fcf-9f9b-3cb2136cebd5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:22.234604 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24beeed5-425c-4fcf-9f9b-3cb2136cebd5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:22.235076 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24beeed5-425c-4fcf-9f9b-3cb2136cebd5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:22.235516 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24beeed5-425c-4fcf-9f9b-3cb2136cebd5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:22.364853 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-24beeed5-425c-4fcf-9f9b-3cb2136cebd5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:31:22.372326 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-24beeed5-425c-4fcf-9f9b-3cb2136cebd5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1679 microversion: 2.1 time: 0.151116 Aug 07 02:31:22.372901 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3951/7434] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:31:22 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:31:23.394726 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-877cffe5-3a58-4d88-bd57-c20ec1703dfc tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:31:23.395337 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-877cffe5-3a58-4d88-bd57-c20ec1703dfc tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:23.402203 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-877cffe5-3a58-4d88-bd57-c20ec1703dfc tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:23.402963 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-877cffe5-3a58-4d88-bd57-c20ec1703dfc tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:23.403401 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-877cffe5-3a58-4d88-bd57-c20ec1703dfc tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:23.404110 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-877cffe5-3a58-4d88-bd57-c20ec1703dfc tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:23.404567 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-877cffe5-3a58-4d88-bd57-c20ec1703dfc tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:23.404986 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-877cffe5-3a58-4d88-bd57-c20ec1703dfc tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:23.551915 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-877cffe5-3a58-4d88-bd57-c20ec1703dfc tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:31:23.559354 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-877cffe5-3a58-4d88-bd57-c20ec1703dfc tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1679 microversion: 2.1 time: 0.168972 Aug 07 02:31:23.559933 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3484/7435] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:31:23 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:31:24.581170 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-02ccf378-87c5-4c59-9d62-6cc0c3c6c56a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:31:24.581888 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-02ccf378-87c5-4c59-9d62-6cc0c3c6c56a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:24.588834 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-02ccf378-87c5-4c59-9d62-6cc0c3c6c56a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:24.589331 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-02ccf378-87c5-4c59-9d62-6cc0c3c6c56a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:24.589783 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-02ccf378-87c5-4c59-9d62-6cc0c3c6c56a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:24.590491 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-02ccf378-87c5-4c59-9d62-6cc0c3c6c56a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:24.590963 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-02ccf378-87c5-4c59-9d62-6cc0c3c6c56a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:24.591405 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-02ccf378-87c5-4c59-9d62-6cc0c3c6c56a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:25.026927 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-02ccf378-87c5-4c59-9d62-6cc0c3c6c56a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:31:25.034496 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-02ccf378-87c5-4c59-9d62-6cc0c3c6c56a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1679 microversion: 2.1 time: 0.457908 Aug 07 02:31:25.035068 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3952/7436] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:31:24 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1679 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:31:26.056321 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-463cb538-e2ef-4510-ab1c-d96addb3031a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:31:26.056963 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-463cb538-e2ef-4510-ab1c-d96addb3031a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:26.064332 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-463cb538-e2ef-4510-ab1c-d96addb3031a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:26.064816 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-463cb538-e2ef-4510-ab1c-d96addb3031a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:26.065257 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-463cb538-e2ef-4510-ab1c-d96addb3031a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:26.065951 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-463cb538-e2ef-4510-ab1c-d96addb3031a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:26.066407 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-463cb538-e2ef-4510-ab1c-d96addb3031a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:26.066834 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-463cb538-e2ef-4510-ab1c-d96addb3031a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:26.196194 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-463cb538-e2ef-4510-ab1c-d96addb3031a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:31:26.204435 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-463cb538-e2ef-4510-ab1c-d96addb3031a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1679 microversion: 2.1 time: 0.151480 Aug 07 02:31:26.205346 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3485/7437] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:31:26 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:31:27.226795 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-91941fc0-ac01-41a9-bdf7-c117bb3e5626 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:31:27.227432 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-91941fc0-ac01-41a9-bdf7-c117bb3e5626 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:27.234511 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91941fc0-ac01-41a9-bdf7-c117bb3e5626 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:27.235008 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91941fc0-ac01-41a9-bdf7-c117bb3e5626 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:27.235461 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91941fc0-ac01-41a9-bdf7-c117bb3e5626 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:27.236210 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91941fc0-ac01-41a9-bdf7-c117bb3e5626 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:27.236684 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91941fc0-ac01-41a9-bdf7-c117bb3e5626 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:27.237128 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-91941fc0-ac01-41a9-bdf7-c117bb3e5626 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:27.370089 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-91941fc0-ac01-41a9-bdf7-c117bb3e5626 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:31:27.378522 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-91941fc0-ac01-41a9-bdf7-c117bb3e5626 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1700 microversion: 2.1 time: 0.155687 Aug 07 02:31:27.379131 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3953/7438] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:31:27 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1700 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:31:28.400655 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f30d96c4-92ef-475a-b752-744e0577aa08 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:31:28.401277 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f30d96c4-92ef-475a-b752-744e0577aa08 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:28.408278 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f30d96c4-92ef-475a-b752-744e0577aa08 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:28.408768 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f30d96c4-92ef-475a-b752-744e0577aa08 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:28.409207 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f30d96c4-92ef-475a-b752-744e0577aa08 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:28.409906 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f30d96c4-92ef-475a-b752-744e0577aa08 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:28.410362 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f30d96c4-92ef-475a-b752-744e0577aa08 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:28.410787 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f30d96c4-92ef-475a-b752-744e0577aa08 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:28.541016 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f30d96c4-92ef-475a-b752-744e0577aa08 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:31:28.548958 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f30d96c4-92ef-475a-b752-744e0577aa08 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1700 microversion: 2.1 time: 0.152222 Aug 07 02:31:28.549529 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3486/7439] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:31:28 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1700 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:31:29.569428 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4631c126-354f-47f8-b2a2-9279086f326a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:31:29.570098 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4631c126-354f-47f8-b2a2-9279086f326a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:29.577046 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4631c126-354f-47f8-b2a2-9279086f326a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:29.577545 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4631c126-354f-47f8-b2a2-9279086f326a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:29.578005 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4631c126-354f-47f8-b2a2-9279086f326a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:29.579209 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4631c126-354f-47f8-b2a2-9279086f326a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:29.579977 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4631c126-354f-47f8-b2a2-9279086f326a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:29.580443 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4631c126-354f-47f8-b2a2-9279086f326a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:29.724791 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4631c126-354f-47f8-b2a2-9279086f326a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:31:29.732439 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4631c126-354f-47f8-b2a2-9279086f326a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1695 microversion: 2.1 time: 0.166915 Aug 07 02:31:29.733016 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3954/7440] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:31:29 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1695 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:31:30.755243 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-969f2adc-08ba-4694-a444-1d028b2a78be tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:31:30.756138 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-969f2adc-08ba-4694-a444-1d028b2a78be tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:30.763412 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-969f2adc-08ba-4694-a444-1d028b2a78be tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:30.764406 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-969f2adc-08ba-4694-a444-1d028b2a78be tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:30.765085 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-969f2adc-08ba-4694-a444-1d028b2a78be tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:30.766346 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-969f2adc-08ba-4694-a444-1d028b2a78be tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:30.767051 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-969f2adc-08ba-4694-a444-1d028b2a78be tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:30.768234 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-969f2adc-08ba-4694-a444-1d028b2a78be tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:30.960997 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-969f2adc-08ba-4694-a444-1d028b2a78be tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:31:30.988527 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-969f2adc-08ba-4694-a444-1d028b2a78be tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1695 microversion: 2.1 time: 0.237782 Aug 07 02:31:31.003743 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3487/7441] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:31:30 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1695 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:31:31.148528 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-6edb0577-da83-437f-8420-e19143661355 req-91436aa7-0353-4bbb-9ecf-07c4beb2dd94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb52a76-13cd-4714-8996-e66f0b297c69", "name": "network-vif-plugged", "status": "completed", "tag": "f88bed67-6714-4164-9bb4-b0f8dd117c58"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:31:31.164899 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6edb0577-da83-437f-8420-e19143661355 req-91436aa7-0353-4bbb-9ecf-07c4beb2dd94 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:31.165407 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6edb0577-da83-437f-8420-e19143661355 req-91436aa7-0353-4bbb-9ecf-07c4beb2dd94 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:31.165969 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6edb0577-da83-437f-8420-e19143661355 req-91436aa7-0353-4bbb-9ecf-07c4beb2dd94 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:31.181754 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-6edb0577-da83-437f-8420-e19143661355 req-91436aa7-0353-4bbb-9ecf-07c4beb2dd94 service nova] Creating event network-vif-plugged:f88bed67-6714-4164-9bb4-b0f8dd117c58 for instance 0eb52a76-13cd-4714-8996-e66f0b297c69 on n-h2-master-1 Aug 07 02:31:31.187325 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-6edb0577-da83-437f-8420-e19143661355 req-91436aa7-0353-4bbb-9ecf-07c4beb2dd94 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149835 Aug 07 02:31:31.188267 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3955/7442] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:31:32.011193 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a8ae9960-4bcd-4f13-bc94-3fe305dc7e68 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:31:32.012526 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a8ae9960-4bcd-4f13-bc94-3fe305dc7e68 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:32.023676 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a8ae9960-4bcd-4f13-bc94-3fe305dc7e68 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:32.024525 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a8ae9960-4bcd-4f13-bc94-3fe305dc7e68 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:32.025151 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a8ae9960-4bcd-4f13-bc94-3fe305dc7e68 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:32.026225 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a8ae9960-4bcd-4f13-bc94-3fe305dc7e68 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:32.026869 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a8ae9960-4bcd-4f13-bc94-3fe305dc7e68 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:32.027465 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a8ae9960-4bcd-4f13-bc94-3fe305dc7e68 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:32.180224 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a8ae9960-4bcd-4f13-bc94-3fe305dc7e68 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:31:32.189253 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a8ae9960-4bcd-4f13-bc94-3fe305dc7e68 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1695 microversion: 2.1 time: 0.182330 Aug 07 02:31:32.190018 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3488/7443] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:31:32 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1695 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:31:33.211464 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-53c5d84b-4c94-408b-8d95-91a998cc140a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:31:33.212854 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-53c5d84b-4c94-408b-8d95-91a998cc140a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:33.221156 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-53c5d84b-4c94-408b-8d95-91a998cc140a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:33.221983 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-53c5d84b-4c94-408b-8d95-91a998cc140a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:33.222521 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-53c5d84b-4c94-408b-8d95-91a998cc140a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:33.223563 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-53c5d84b-4c94-408b-8d95-91a998cc140a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:33.224287 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-53c5d84b-4c94-408b-8d95-91a998cc140a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:33.224953 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-53c5d84b-4c94-408b-8d95-91a998cc140a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:33.372601 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-53c5d84b-4c94-408b-8d95-91a998cc140a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:31:33.381247 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-53c5d84b-4c94-408b-8d95-91a998cc140a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1695 microversion: 2.1 time: 0.174093 Aug 07 02:31:33.391930 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3956/7444] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:31:33 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1695 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:31:34.402766 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-95d94710-f2af-4dcb-bc04-b4f26cad0ae9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:31:34.403522 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-95d94710-f2af-4dcb-bc04-b4f26cad0ae9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:34.410821 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-95d94710-f2af-4dcb-bc04-b4f26cad0ae9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:34.411311 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-95d94710-f2af-4dcb-bc04-b4f26cad0ae9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:34.412036 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-95d94710-f2af-4dcb-bc04-b4f26cad0ae9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:34.412975 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-95d94710-f2af-4dcb-bc04-b4f26cad0ae9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:34.413442 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-95d94710-f2af-4dcb-bc04-b4f26cad0ae9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:34.413878 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-95d94710-f2af-4dcb-bc04-b4f26cad0ae9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:34.564429 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-95d94710-f2af-4dcb-bc04-b4f26cad0ae9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:31:34.574429 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-95d94710-f2af-4dcb-bc04-b4f26cad0ae9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1695 microversion: 2.1 time: 0.175582 Aug 07 02:31:34.575617 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3489/7445] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:31:34 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1695 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:31:35.598518 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1b5946f9-1b25-483a-bb33-26ee70ef8ac3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:31:35.599969 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1b5946f9-1b25-483a-bb33-26ee70ef8ac3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:35.608793 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b5946f9-1b25-483a-bb33-26ee70ef8ac3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:35.610102 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b5946f9-1b25-483a-bb33-26ee70ef8ac3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:35.610808 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b5946f9-1b25-483a-bb33-26ee70ef8ac3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:35.611783 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b5946f9-1b25-483a-bb33-26ee70ef8ac3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:35.612348 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b5946f9-1b25-483a-bb33-26ee70ef8ac3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:35.612866 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1b5946f9-1b25-483a-bb33-26ee70ef8ac3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:35.774205 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1b5946f9-1b25-483a-bb33-26ee70ef8ac3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:31:35.784825 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1b5946f9-1b25-483a-bb33-26ee70ef8ac3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1695 microversion: 2.1 time: 0.190665 Aug 07 02:31:35.796219 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3957/7446] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:31:35 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1695 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:31:36.808265 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-90e01869-2731-40d9-98d7-d8434d916da3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:31:36.809730 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-90e01869-2731-40d9-98d7-d8434d916da3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:36.817316 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90e01869-2731-40d9-98d7-d8434d916da3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:36.817757 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90e01869-2731-40d9-98d7-d8434d916da3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:36.818110 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90e01869-2731-40d9-98d7-d8434d916da3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:36.818835 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90e01869-2731-40d9-98d7-d8434d916da3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:36.819334 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90e01869-2731-40d9-98d7-d8434d916da3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:36.819772 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-90e01869-2731-40d9-98d7-d8434d916da3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:36.980185 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-90e01869-2731-40d9-98d7-d8434d916da3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:31:36.997021 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-90e01869-2731-40d9-98d7-d8434d916da3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1695 microversion: 2.1 time: 0.192697 Aug 07 02:31:36.998541 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3490/7447] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:31:36 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1695 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:31:38.022030 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5fcd2b70-63e6-4bbd-b967-2c1d7e138eaa tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:31:38.022796 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5fcd2b70-63e6-4bbd-b967-2c1d7e138eaa tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:38.029681 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5fcd2b70-63e6-4bbd-b967-2c1d7e138eaa tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:38.030182 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5fcd2b70-63e6-4bbd-b967-2c1d7e138eaa tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:38.030687 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5fcd2b70-63e6-4bbd-b967-2c1d7e138eaa tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:38.032942 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5fcd2b70-63e6-4bbd-b967-2c1d7e138eaa tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:38.033634 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5fcd2b70-63e6-4bbd-b967-2c1d7e138eaa tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:38.034416 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5fcd2b70-63e6-4bbd-b967-2c1d7e138eaa tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:38.193975 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5fcd2b70-63e6-4bbd-b967-2c1d7e138eaa tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:31:38.205907 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5fcd2b70-63e6-4bbd-b967-2c1d7e138eaa tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1695 microversion: 2.1 time: 0.187630 Aug 07 02:31:38.206798 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3958/7448] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:31:38 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1695 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:31:39.227356 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9be046e3-e115-455b-800c-1afa4a1fa9d9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:31:39.228008 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9be046e3-e115-455b-800c-1afa4a1fa9d9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:39.235461 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9be046e3-e115-455b-800c-1afa4a1fa9d9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:39.235973 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9be046e3-e115-455b-800c-1afa4a1fa9d9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:39.236415 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9be046e3-e115-455b-800c-1afa4a1fa9d9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:39.237121 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9be046e3-e115-455b-800c-1afa4a1fa9d9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:39.237579 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9be046e3-e115-455b-800c-1afa4a1fa9d9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:39.238006 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9be046e3-e115-455b-800c-1afa4a1fa9d9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:39.371481 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9be046e3-e115-455b-800c-1afa4a1fa9d9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:31:39.379069 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9be046e3-e115-455b-800c-1afa4a1fa9d9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1677 microversion: 2.1 time: 0.155914 Aug 07 02:31:39.379678 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3491/7449] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:31:39 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:31:40.401500 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2c8de052-2398-45f1-bb62-010ae614b0ac tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:31:40.402141 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2c8de052-2398-45f1-bb62-010ae614b0ac tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:40.409806 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c8de052-2398-45f1-bb62-010ae614b0ac tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:40.410306 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c8de052-2398-45f1-bb62-010ae614b0ac tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:40.410789 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c8de052-2398-45f1-bb62-010ae614b0ac tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:40.411509 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c8de052-2398-45f1-bb62-010ae614b0ac tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:40.412022 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c8de052-2398-45f1-bb62-010ae614b0ac tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:40.412473 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2c8de052-2398-45f1-bb62-010ae614b0ac tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:40.544476 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2c8de052-2398-45f1-bb62-010ae614b0ac tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:31:40.552051 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2c8de052-2398-45f1-bb62-010ae614b0ac tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1677 microversion: 2.1 time: 0.154479 Aug 07 02:31:40.552651 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3959/7450] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:31:40 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:31:41.573587 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b7c0f4a3-31b7-4994-b2ec-6cd3f82118b3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:31:41.574242 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-b7c0f4a3-31b7-4994-b2ec-6cd3f82118b3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:41.581121 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b7c0f4a3-31b7-4994-b2ec-6cd3f82118b3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:41.581605 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b7c0f4a3-31b7-4994-b2ec-6cd3f82118b3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:41.582042 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b7c0f4a3-31b7-4994-b2ec-6cd3f82118b3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:41.582744 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b7c0f4a3-31b7-4994-b2ec-6cd3f82118b3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:41.583199 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b7c0f4a3-31b7-4994-b2ec-6cd3f82118b3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:41.583626 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-b7c0f4a3-31b7-4994-b2ec-6cd3f82118b3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:41.723860 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-b7c0f4a3-31b7-4994-b2ec-6cd3f82118b3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:31:41.731473 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b7c0f4a3-31b7-4994-b2ec-6cd3f82118b3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1680 microversion: 2.1 time: 0.161843 Aug 07 02:31:41.732093 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3492/7451] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:31:41 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:31:41.755159 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-62691761-4c8b-40df-8b62-18b4ce4c3163 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:31:41.755773 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-62691761-4c8b-40df-8b62-18b4ce4c3163 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:41.762629 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62691761-4c8b-40df-8b62-18b4ce4c3163 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:41.763121 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62691761-4c8b-40df-8b62-18b4ce4c3163 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:41.763567 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62691761-4c8b-40df-8b62-18b4ce4c3163 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:41.764311 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62691761-4c8b-40df-8b62-18b4ce4c3163 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:41.764776 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62691761-4c8b-40df-8b62-18b4ce4c3163 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:41.765213 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62691761-4c8b-40df-8b62-18b4ce4c3163 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:41.847369 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-62691761-4c8b-40df-8b62-18b4ce4c3163 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119516) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 07 02:31:41.912161 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-62691761-4c8b-40df-8b62-18b4ce4c3163 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "POST /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69/action" status: 202 len: 0 microversion: 2.1 time: 0.160856 Aug 07 02:31:41.912772 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3960/7452] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:31:41 2022] POST /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:31:41.920908 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-45ac0c8f-410e-4867-8768-8760fda57083 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:31:41.921527 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-45ac0c8f-410e-4867-8768-8760fda57083 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:41.928185 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-45ac0c8f-410e-4867-8768-8760fda57083 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:41.928669 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-45ac0c8f-410e-4867-8768-8760fda57083 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:41.929105 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-45ac0c8f-410e-4867-8768-8760fda57083 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:41.929804 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-45ac0c8f-410e-4867-8768-8760fda57083 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:41.930266 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-45ac0c8f-410e-4867-8768-8760fda57083 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:41.931369 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-45ac0c8f-410e-4867-8768-8760fda57083 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:42.074915 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-45ac0c8f-410e-4867-8768-8760fda57083 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:31:42.082941 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-45ac0c8f-410e-4867-8768-8760fda57083 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1628 microversion: 2.1 time: 0.165959 Aug 07 02:31:42.083586 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3493/7453] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:31:41 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1628 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:31:42.977511 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-6931ce27-058f-4108-b31b-61eb3bcdefac req-27a61c5b-e3b8-4f00-8b93-4748cd817d78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb52a76-13cd-4714-8996-e66f0b297c69", "name": "network-vif-unplugged", "status": "completed", "tag": "f88bed67-6714-4164-9bb4-b0f8dd117c58"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:31:42.990039 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6931ce27-058f-4108-b31b-61eb3bcdefac req-27a61c5b-e3b8-4f00-8b93-4748cd817d78 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:42.990614 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6931ce27-058f-4108-b31b-61eb3bcdefac req-27a61c5b-e3b8-4f00-8b93-4748cd817d78 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:42.991133 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6931ce27-058f-4108-b31b-61eb3bcdefac req-27a61c5b-e3b8-4f00-8b93-4748cd817d78 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:43.002299 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-6931ce27-058f-4108-b31b-61eb3bcdefac req-27a61c5b-e3b8-4f00-8b93-4748cd817d78 service nova] Creating event network-vif-unplugged:f88bed67-6714-4164-9bb4-b0f8dd117c58 for instance 0eb52a76-13cd-4714-8996-e66f0b297c69 on n-h1-master-1 Aug 07 02:31:43.007289 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-6931ce27-058f-4108-b31b-61eb3bcdefac req-27a61c5b-e3b8-4f00-8b93-4748cd817d78 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035012 Aug 07 02:31:43.008069 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3961/7454] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:31:43.105148 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-921cccd7-c296-40c1-9cf5-d22f2f0e896e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:31:43.105780 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-921cccd7-c296-40c1-9cf5-d22f2f0e896e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:43.113108 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-921cccd7-c296-40c1-9cf5-d22f2f0e896e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:43.113586 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-921cccd7-c296-40c1-9cf5-d22f2f0e896e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:43.114050 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-921cccd7-c296-40c1-9cf5-d22f2f0e896e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:43.114813 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-921cccd7-c296-40c1-9cf5-d22f2f0e896e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:43.115450 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-921cccd7-c296-40c1-9cf5-d22f2f0e896e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:43.116293 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-921cccd7-c296-40c1-9cf5-d22f2f0e896e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:43.293694 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-921cccd7-c296-40c1-9cf5-d22f2f0e896e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:31:43.302223 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-921cccd7-c296-40c1-9cf5-d22f2f0e896e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1686 microversion: 2.1 time: 0.200953 Aug 07 02:31:43.303104 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3494/7455] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:31:43 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1686 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:31:44.065139 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-e367253c-4cd8-45d2-a2ef-e29020b85fb3 req-9a098a72-1d66-40fb-bfa8-56238084868f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eb52a76-13cd-4714-8996-e66f0b297c69", "tag": "f88bed67-6714-4164-9bb4-b0f8dd117c58"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:31:44.074962 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e367253c-4cd8-45d2-a2ef-e29020b85fb3 req-9a098a72-1d66-40fb-bfa8-56238084868f service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:44.075465 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e367253c-4cd8-45d2-a2ef-e29020b85fb3 req-9a098a72-1d66-40fb-bfa8-56238084868f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:44.075949 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-e367253c-4cd8-45d2-a2ef-e29020b85fb3 req-9a098a72-1d66-40fb-bfa8-56238084868f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:44.087952 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-e367253c-4cd8-45d2-a2ef-e29020b85fb3 req-9a098a72-1d66-40fb-bfa8-56238084868f service nova] Creating event network-changed:f88bed67-6714-4164-9bb4-b0f8dd117c58 for instance 0eb52a76-13cd-4714-8996-e66f0b297c69 on n-h1-master-1 Aug 07 02:31:44.092855 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-e367253c-4cd8-45d2-a2ef-e29020b85fb3 req-9a098a72-1d66-40fb-bfa8-56238084868f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090544 Aug 07 02:31:44.093461 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3962/7456] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 02:31:44.324537 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1a416082-92f7-46ad-8b07-b8d8c509a264 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:31:44.325505 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1a416082-92f7-46ad-8b07-b8d8c509a264 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:44.332668 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1a416082-92f7-46ad-8b07-b8d8c509a264 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:44.333156 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1a416082-92f7-46ad-8b07-b8d8c509a264 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:44.333597 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1a416082-92f7-46ad-8b07-b8d8c509a264 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:44.334303 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1a416082-92f7-46ad-8b07-b8d8c509a264 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:44.334762 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1a416082-92f7-46ad-8b07-b8d8c509a264 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:44.335192 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1a416082-92f7-46ad-8b07-b8d8c509a264 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:44.572929 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1a416082-92f7-46ad-8b07-b8d8c509a264 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:31:44.580652 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1a416082-92f7-46ad-8b07-b8d8c509a264 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1686 microversion: 2.1 time: 0.260464 Aug 07 02:31:44.581234 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3495/7457] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:31:44 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1686 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:31:45.603803 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f3c3ce69-6f2a-4a1f-9b9a-3d184734ee26 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:31:45.604729 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f3c3ce69-6f2a-4a1f-9b9a-3d184734ee26 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:45.611903 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f3c3ce69-6f2a-4a1f-9b9a-3d184734ee26 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:45.612699 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f3c3ce69-6f2a-4a1f-9b9a-3d184734ee26 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:45.613221 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f3c3ce69-6f2a-4a1f-9b9a-3d184734ee26 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:45.614074 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f3c3ce69-6f2a-4a1f-9b9a-3d184734ee26 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:45.614569 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f3c3ce69-6f2a-4a1f-9b9a-3d184734ee26 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:45.615233 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f3c3ce69-6f2a-4a1f-9b9a-3d184734ee26 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:45.634879 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:31:45.780904 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f3c3ce69-6f2a-4a1f-9b9a-3d184734ee26 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:31:45.788718 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f3c3ce69-6f2a-4a1f-9b9a-3d184734ee26 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1686 microversion: 2.1 time: 0.190216 Aug 07 02:31:45.789296 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3963/7458] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:31:45 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1686 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:31:46.810773 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3845822d-b092-4c18-80d9-810f072e72c6 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:31:46.811464 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3845822d-b092-4c18-80d9-810f072e72c6 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:46.814255 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=31 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:31:46.819628 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3845822d-b092-4c18-80d9-810f072e72c6 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:46.820175 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3845822d-b092-4c18-80d9-810f072e72c6 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:46.820622 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3845822d-b092-4c18-80d9-810f072e72c6 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:46.821333 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3845822d-b092-4c18-80d9-810f072e72c6 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:46.821791 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3845822d-b092-4c18-80d9-810f072e72c6 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:46.822217 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3845822d-b092-4c18-80d9-810f072e72c6 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:46.824991 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=91 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:31:46.965150 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3845822d-b092-4c18-80d9-810f072e72c6 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:31:46.973065 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3845822d-b092-4c18-80d9-810f072e72c6 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1686 microversion: 2.1 time: 0.166271 Aug 07 02:31:46.973887 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3496/7459] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:31:46 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1686 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:31:47.996862 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-71e680c6-f085-4b51-b93c-786900f323a9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:31:47.999295 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-71e680c6-f085-4b51-b93c-786900f323a9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:48.002458 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:31:48.010146 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-71e680c6-f085-4b51-b93c-786900f323a9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:48.010761 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-71e680c6-f085-4b51-b93c-786900f323a9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:48.011323 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-71e680c6-f085-4b51-b93c-786900f323a9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:48.012227 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-71e680c6-f085-4b51-b93c-786900f323a9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:48.012679 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-71e680c6-f085-4b51-b93c-786900f323a9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:48.013134 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-71e680c6-f085-4b51-b93c-786900f323a9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:48.161807 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-71e680c6-f085-4b51-b93c-786900f323a9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:31:48.170593 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-71e680c6-f085-4b51-b93c-786900f323a9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1686 microversion: 2.1 time: 0.178698 Aug 07 02:31:48.171199 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3964/7460] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:31:47 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1686 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:31:49.191950 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7bf81b97-0ed3-4f79-aee3-0c2f9d483f4a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:31:49.192579 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7bf81b97-0ed3-4f79-aee3-0c2f9d483f4a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:49.199033 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7bf81b97-0ed3-4f79-aee3-0c2f9d483f4a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:49.199526 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7bf81b97-0ed3-4f79-aee3-0c2f9d483f4a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:49.199992 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7bf81b97-0ed3-4f79-aee3-0c2f9d483f4a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:49.200707 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7bf81b97-0ed3-4f79-aee3-0c2f9d483f4a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:49.201169 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7bf81b97-0ed3-4f79-aee3-0c2f9d483f4a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:49.201603 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7bf81b97-0ed3-4f79-aee3-0c2f9d483f4a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:49.361688 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7bf81b97-0ed3-4f79-aee3-0c2f9d483f4a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:31:49.369803 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7bf81b97-0ed3-4f79-aee3-0c2f9d483f4a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1686 microversion: 2.1 time: 0.181849 Aug 07 02:31:49.370662 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3497/7461] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:31:49 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1686 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:31:50.390674 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-56092529-019d-4729-a376-736b2eb714d9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:31:50.391399 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-56092529-019d-4729-a376-736b2eb714d9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:50.398178 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-56092529-019d-4729-a376-736b2eb714d9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:50.398673 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-56092529-019d-4729-a376-736b2eb714d9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:50.399121 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-56092529-019d-4729-a376-736b2eb714d9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:50.399823 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-56092529-019d-4729-a376-736b2eb714d9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:50.400319 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-56092529-019d-4729-a376-736b2eb714d9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:50.400758 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-56092529-019d-4729-a376-736b2eb714d9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:50.547347 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-56092529-019d-4729-a376-736b2eb714d9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:31:50.555929 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-56092529-019d-4729-a376-736b2eb714d9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1686 microversion: 2.1 time: 0.169140 Aug 07 02:31:50.556603 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3965/7462] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:31:50 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1686 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:31:51.580060 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-999c4199-ff42-4e53-bda4-346f0fb5b83a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:31:51.581550 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-999c4199-ff42-4e53-bda4-346f0fb5b83a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:51.589907 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-999c4199-ff42-4e53-bda4-346f0fb5b83a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:51.590669 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-999c4199-ff42-4e53-bda4-346f0fb5b83a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:51.591283 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-999c4199-ff42-4e53-bda4-346f0fb5b83a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:51.592201 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-999c4199-ff42-4e53-bda4-346f0fb5b83a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:51.592820 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-999c4199-ff42-4e53-bda4-346f0fb5b83a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:51.593430 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-999c4199-ff42-4e53-bda4-346f0fb5b83a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:51.756355 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-999c4199-ff42-4e53-bda4-346f0fb5b83a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:31:51.763989 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-999c4199-ff42-4e53-bda4-346f0fb5b83a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1686 microversion: 2.1 time: 0.189041 Aug 07 02:31:51.764605 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3498/7463] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:31:51 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1686 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:31:52.789921 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7f3f1f20-86f1-4d68-8c4c-b711e96f8d3d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:31:52.790585 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7f3f1f20-86f1-4d68-8c4c-b711e96f8d3d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:52.797497 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f3f1f20-86f1-4d68-8c4c-b711e96f8d3d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:52.798060 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f3f1f20-86f1-4d68-8c4c-b711e96f8d3d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:52.798526 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f3f1f20-86f1-4d68-8c4c-b711e96f8d3d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:52.799234 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f3f1f20-86f1-4d68-8c4c-b711e96f8d3d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:52.799712 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f3f1f20-86f1-4d68-8c4c-b711e96f8d3d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:52.800322 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7f3f1f20-86f1-4d68-8c4c-b711e96f8d3d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:52.941083 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7f3f1f20-86f1-4d68-8c4c-b711e96f8d3d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:31:52.948881 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7f3f1f20-86f1-4d68-8c4c-b711e96f8d3d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1686 microversion: 2.1 time: 0.162931 Aug 07 02:31:52.949453 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3966/7464] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:31:52 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1686 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:31:53.971234 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a43cf26a-aa9a-412a-8f61-99732420852f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:31:53.971868 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a43cf26a-aa9a-412a-8f61-99732420852f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:53.979319 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a43cf26a-aa9a-412a-8f61-99732420852f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:53.979808 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a43cf26a-aa9a-412a-8f61-99732420852f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:53.980278 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a43cf26a-aa9a-412a-8f61-99732420852f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:53.981001 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a43cf26a-aa9a-412a-8f61-99732420852f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:53.981481 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a43cf26a-aa9a-412a-8f61-99732420852f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:53.981941 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a43cf26a-aa9a-412a-8f61-99732420852f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:54.118106 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a43cf26a-aa9a-412a-8f61-99732420852f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:31:54.125662 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a43cf26a-aa9a-412a-8f61-99732420852f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1686 microversion: 2.1 time: 0.158868 Aug 07 02:31:54.126254 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3499/7465] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:31:53 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1686 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:31:55.146854 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-77640a25-ba8f-4bae-8803-db2d74fbc92c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:31:55.147400 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-77640a25-ba8f-4bae-8803-db2d74fbc92c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:55.154319 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77640a25-ba8f-4bae-8803-db2d74fbc92c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:55.154817 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77640a25-ba8f-4bae-8803-db2d74fbc92c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:55.155267 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77640a25-ba8f-4bae-8803-db2d74fbc92c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:55.156007 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77640a25-ba8f-4bae-8803-db2d74fbc92c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:55.156477 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77640a25-ba8f-4bae-8803-db2d74fbc92c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:55.156923 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77640a25-ba8f-4bae-8803-db2d74fbc92c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:55.287620 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-77640a25-ba8f-4bae-8803-db2d74fbc92c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:31:55.295194 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-77640a25-ba8f-4bae-8803-db2d74fbc92c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1686 microversion: 2.1 time: 0.152315 Aug 07 02:31:55.295757 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3967/7466] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:31:55 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1686 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:31:56.317702 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8dedb967-ff6d-4f25-876e-a027161cf05a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:31:56.318238 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8dedb967-ff6d-4f25-876e-a027161cf05a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:56.325091 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8dedb967-ff6d-4f25-876e-a027161cf05a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:56.325584 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8dedb967-ff6d-4f25-876e-a027161cf05a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:56.326039 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8dedb967-ff6d-4f25-876e-a027161cf05a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:56.326744 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8dedb967-ff6d-4f25-876e-a027161cf05a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:56.327207 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8dedb967-ff6d-4f25-876e-a027161cf05a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:56.327641 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8dedb967-ff6d-4f25-876e-a027161cf05a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:56.459143 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8dedb967-ff6d-4f25-876e-a027161cf05a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:31:56.466756 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8dedb967-ff6d-4f25-876e-a027161cf05a tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1686 microversion: 2.1 time: 0.153664 Aug 07 02:31:56.467335 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3500/7467] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:31:56 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:31:57.487866 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-24f9a4e0-30da-47ca-9e93-d15c9c243832 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:31:57.488541 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-24f9a4e0-30da-47ca-9e93-d15c9c243832 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:57.495524 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24f9a4e0-30da-47ca-9e93-d15c9c243832 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:57.495990 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24f9a4e0-30da-47ca-9e93-d15c9c243832 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:57.496442 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24f9a4e0-30da-47ca-9e93-d15c9c243832 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:57.497155 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24f9a4e0-30da-47ca-9e93-d15c9c243832 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:57.497625 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24f9a4e0-30da-47ca-9e93-d15c9c243832 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:57.498063 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-24f9a4e0-30da-47ca-9e93-d15c9c243832 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:57.632249 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-24f9a4e0-30da-47ca-9e93-d15c9c243832 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:31:57.639797 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-24f9a4e0-30da-47ca-9e93-d15c9c243832 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1686 microversion: 2.1 time: 0.155881 Aug 07 02:31:57.640586 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3968/7468] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:31:57 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:31:58.162080 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-0820dd5a-8496-4de5-8be0-7fa308d5017f req-4459b5fd-28db-4f3b-8ab7-2ca7dccc4485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb52a76-13cd-4714-8996-e66f0b297c69", "name": "network-vif-plugged", "status": "completed", "tag": "f88bed67-6714-4164-9bb4-b0f8dd117c58"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:31:58.175103 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0820dd5a-8496-4de5-8be0-7fa308d5017f req-4459b5fd-28db-4f3b-8ab7-2ca7dccc4485 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:58.175594 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0820dd5a-8496-4de5-8be0-7fa308d5017f req-4459b5fd-28db-4f3b-8ab7-2ca7dccc4485 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:58.176067 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-0820dd5a-8496-4de5-8be0-7fa308d5017f req-4459b5fd-28db-4f3b-8ab7-2ca7dccc4485 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:58.187516 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-0820dd5a-8496-4de5-8be0-7fa308d5017f req-4459b5fd-28db-4f3b-8ab7-2ca7dccc4485 service nova] Creating event network-vif-plugged:f88bed67-6714-4164-9bb4-b0f8dd117c58 for instance 0eb52a76-13cd-4714-8996-e66f0b297c69 on n-h1-master-1 Aug 07 02:31:58.192955 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-0820dd5a-8496-4de5-8be0-7fa308d5017f req-4459b5fd-28db-4f3b-8ab7-2ca7dccc4485 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034638 Aug 07 02:31:58.193971 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3501/7469] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:31:58.661337 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-78162879-3393-4b55-bdfd-95d6bfd7ee1c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:31:58.661880 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-78162879-3393-4b55-bdfd-95d6bfd7ee1c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:58.669167 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-78162879-3393-4b55-bdfd-95d6bfd7ee1c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:58.669676 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-78162879-3393-4b55-bdfd-95d6bfd7ee1c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:58.670135 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-78162879-3393-4b55-bdfd-95d6bfd7ee1c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:58.670863 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-78162879-3393-4b55-bdfd-95d6bfd7ee1c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:58.671364 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-78162879-3393-4b55-bdfd-95d6bfd7ee1c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:58.671812 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-78162879-3393-4b55-bdfd-95d6bfd7ee1c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:58.801514 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-78162879-3393-4b55-bdfd-95d6bfd7ee1c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:31:58.809083 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-78162879-3393-4b55-bdfd-95d6bfd7ee1c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1686 microversion: 2.1 time: 0.152364 Aug 07 02:31:58.809661 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3969/7470] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:31:58 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:31:59.831331 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-dff290c4-c14b-424f-96ef-0ee5680f6e44 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:31:59.832099 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-dff290c4-c14b-424f-96ef-0ee5680f6e44 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:31:59.839683 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dff290c4-c14b-424f-96ef-0ee5680f6e44 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:59.840199 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dff290c4-c14b-424f-96ef-0ee5680f6e44 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:59.840644 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dff290c4-c14b-424f-96ef-0ee5680f6e44 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:59.841351 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dff290c4-c14b-424f-96ef-0ee5680f6e44 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:31:59.841814 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dff290c4-c14b-424f-96ef-0ee5680f6e44 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:31:59.842245 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-dff290c4-c14b-424f-96ef-0ee5680f6e44 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:31:59.976528 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-dff290c4-c14b-424f-96ef-0ee5680f6e44 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:31:59.984393 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-dff290c4-c14b-424f-96ef-0ee5680f6e44 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1686 microversion: 2.1 time: 0.157389 Aug 07 02:31:59.984971 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3502/7471] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:31:59 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:32:01.006219 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bb6341a1-99f2-4834-a486-8ca0a4f709c1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:32:01.006859 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-bb6341a1-99f2-4834-a486-8ca0a4f709c1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:32:01.013935 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb6341a1-99f2-4834-a486-8ca0a4f709c1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:32:01.014429 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb6341a1-99f2-4834-a486-8ca0a4f709c1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:32:01.014878 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb6341a1-99f2-4834-a486-8ca0a4f709c1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:32:01.015588 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb6341a1-99f2-4834-a486-8ca0a4f709c1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:32:01.016104 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb6341a1-99f2-4834-a486-8ca0a4f709c1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:32:01.017051 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-bb6341a1-99f2-4834-a486-8ca0a4f709c1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:32:01.153906 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-bb6341a1-99f2-4834-a486-8ca0a4f709c1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:32:01.161454 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bb6341a1-99f2-4834-a486-8ca0a4f709c1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1673 microversion: 2.1 time: 0.159251 Aug 07 02:32:01.162037 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3970/7472] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:32:01 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:33:12.630453 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=13 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:33:12.631285 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=37 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:33:12.635640 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-fbc7fc9e-737c-4c1d-b8d2-34c0beb1e0ea tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:33:12.636138 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-b6c97945-7dfc-4cb5-a943-53aba1cd05e0 req-8c688456-c01d-4a2c-8875-50012a17acf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eb52a76-13cd-4714-8996-e66f0b297c69", "tag": "f88bed67-6714-4164-9bb4-b0f8dd117c58"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:33:12.636600 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fbc7fc9e-737c-4c1d-b8d2-34c0beb1e0ea tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:33:12.643998 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fbc7fc9e-737c-4c1d-b8d2-34c0beb1e0ea tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:12.644493 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fbc7fc9e-737c-4c1d-b8d2-34c0beb1e0ea tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:12.644933 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fbc7fc9e-737c-4c1d-b8d2-34c0beb1e0ea tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:12.645651 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fbc7fc9e-737c-4c1d-b8d2-34c0beb1e0ea tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:12.646109 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fbc7fc9e-737c-4c1d-b8d2-34c0beb1e0ea tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:12.646941 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-fbc7fc9e-737c-4c1d-b8d2-34c0beb1e0ea tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:12.647276 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=13 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:33:12.648099 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=44 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:33:12.651022 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b6c97945-7dfc-4cb5-a943-53aba1cd05e0 req-8c688456-c01d-4a2c-8875-50012a17acf2 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:12.651402 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b6c97945-7dfc-4cb5-a943-53aba1cd05e0 req-8c688456-c01d-4a2c-8875-50012a17acf2 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:12.651837 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-b6c97945-7dfc-4cb5-a943-53aba1cd05e0 req-8c688456-c01d-4a2c-8875-50012a17acf2 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:12.665357 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-b6c97945-7dfc-4cb5-a943-53aba1cd05e0 req-8c688456-c01d-4a2c-8875-50012a17acf2 service nova] Creating event network-changed:f88bed67-6714-4164-9bb4-b0f8dd117c58 for instance 0eb52a76-13cd-4714-8996-e66f0b297c69 on n-h1-master-1 Aug 07 02:33:12.671008 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-b6c97945-7dfc-4cb5-a943-53aba1cd05e0 req-8c688456-c01d-4a2c-8875-50012a17acf2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040686 Aug 07 02:33:12.671989 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3971/7473] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 02:33:12.678039 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-fbc7fc9e-737c-4c1d-b8d2-34c0beb1e0ea tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 02:33:12.773842 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-fbc7fc9e-737c-4c1d-b8d2-34c0beb1e0ea tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 204 len: 0 microversion: 2.1 time: 0.145858 Aug 07 02:33:12.774453 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3503/7474] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 02:33:12 2022] DELETE /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 02:33:12.783751 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4ad3439b-627c-49ea-9b04-9211538af8f9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:33:12.784624 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4ad3439b-627c-49ea-9b04-9211538af8f9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:33:12.791500 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4ad3439b-627c-49ea-9b04-9211538af8f9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:12.792176 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4ad3439b-627c-49ea-9b04-9211538af8f9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:12.792700 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4ad3439b-627c-49ea-9b04-9211538af8f9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:12.793595 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4ad3439b-627c-49ea-9b04-9211538af8f9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:12.794048 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4ad3439b-627c-49ea-9b04-9211538af8f9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:12.794562 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4ad3439b-627c-49ea-9b04-9211538af8f9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:12.991935 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4ad3439b-627c-49ea-9b04-9211538af8f9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:33:12.999585 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4ad3439b-627c-49ea-9b04-9211538af8f9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1679 microversion: 2.1 time: 0.220489 Aug 07 02:33:13.000201 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3972/7475] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:33:12 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1679 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:33:14.023139 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ce47af4d-0fed-4573-b07a-02c08a2c04aa tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:33:14.023846 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ce47af4d-0fed-4573-b07a-02c08a2c04aa tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:33:14.030887 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce47af4d-0fed-4573-b07a-02c08a2c04aa tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:14.031371 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce47af4d-0fed-4573-b07a-02c08a2c04aa tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:14.031842 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce47af4d-0fed-4573-b07a-02c08a2c04aa tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:14.032564 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce47af4d-0fed-4573-b07a-02c08a2c04aa tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:14.033026 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce47af4d-0fed-4573-b07a-02c08a2c04aa tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:14.033459 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-ce47af4d-0fed-4573-b07a-02c08a2c04aa tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:14.184292 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ce47af4d-0fed-4573-b07a-02c08a2c04aa tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:33:14.192680 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ce47af4d-0fed-4573-b07a-02c08a2c04aa tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1679 microversion: 2.1 time: 0.174515 Aug 07 02:33:14.193262 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3504/7476] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:33:14 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:33:15.082867 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-d5aa961d-6870-463d-bcfd-1965249a7d73 req-b30db095-ee97-4ec6-8706-f067fea2c10e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb52a76-13cd-4714-8996-e66f0b297c69", "name": "network-vif-deleted", "tag": "f88bed67-6714-4164-9bb4-b0f8dd117c58"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:33:15.095731 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d5aa961d-6870-463d-bcfd-1965249a7d73 req-b30db095-ee97-4ec6-8706-f067fea2c10e service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:15.096277 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d5aa961d-6870-463d-bcfd-1965249a7d73 req-b30db095-ee97-4ec6-8706-f067fea2c10e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:15.096719 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d5aa961d-6870-463d-bcfd-1965249a7d73 req-b30db095-ee97-4ec6-8706-f067fea2c10e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:15.109883 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-d5aa961d-6870-463d-bcfd-1965249a7d73 req-b30db095-ee97-4ec6-8706-f067fea2c10e service nova] Creating event network-vif-deleted:f88bed67-6714-4164-9bb4-b0f8dd117c58 for instance 0eb52a76-13cd-4714-8996-e66f0b297c69 on n-h1-master-1 Aug 07 02:33:15.116643 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-d5aa961d-6870-463d-bcfd-1965249a7d73 req-b30db095-ee97-4ec6-8706-f067fea2c10e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037538 Aug 07 02:33:15.117237 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3973/7477] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 02:33:15.215044 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a38955b4-d548-479f-b1ea-e7e25ba350f8 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:33:15.215681 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a38955b4-d548-479f-b1ea-e7e25ba350f8 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:33:15.223492 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a38955b4-d548-479f-b1ea-e7e25ba350f8 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:15.224056 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a38955b4-d548-479f-b1ea-e7e25ba350f8 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:15.224928 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a38955b4-d548-479f-b1ea-e7e25ba350f8 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:15.225912 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a38955b4-d548-479f-b1ea-e7e25ba350f8 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:15.226371 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a38955b4-d548-479f-b1ea-e7e25ba350f8 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:15.226794 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a38955b4-d548-479f-b1ea-e7e25ba350f8 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:15.260590 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a38955b4-d548-479f-b1ea-e7e25ba350f8 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:15.260987 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a38955b4-d548-479f-b1ea-e7e25ba350f8 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:15.261416 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a38955b4-d548-479f-b1ea-e7e25ba350f8 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:15.261857 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.objects.instance [None req-a38955b4-d548-479f-b1ea-e7e25ba350f8 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lazy-loading 'fault' on Instance uuid 0eb52a76-13cd-4714-8996-e66f0b297c69 {{(pid=119517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 02:33:15.302987 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a38955b4-d548-479f-b1ea-e7e25ba350f8 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:33:15.310594 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a38955b4-d548-479f-b1ea-e7e25ba350f8 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 200 len: 1336 microversion: 2.1 time: 0.100118 Aug 07 02:33:15.311202 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3505/7478] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:33:15 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 1336 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:33:16.333635 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d68d0df1-6981-4eab-934b-a1e9b5135ebf tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:33:16.334348 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d68d0df1-6981-4eab-934b-a1e9b5135ebf tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 0eb52a76-13cd-4714-8996-e66f0b297c69] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:33:16.341348 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d68d0df1-6981-4eab-934b-a1e9b5135ebf tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:16.341849 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d68d0df1-6981-4eab-934b-a1e9b5135ebf tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:16.342300 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d68d0df1-6981-4eab-934b-a1e9b5135ebf tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:16.343009 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d68d0df1-6981-4eab-934b-a1e9b5135ebf tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:16.343478 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d68d0df1-6981-4eab-934b-a1e9b5135ebf tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:16.343948 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d68d0df1-6981-4eab-934b-a1e9b5135ebf tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:16.357386 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-d68d0df1-6981-4eab-934b-a1e9b5135ebf tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] HTTP exception thrown: Instance 0eb52a76-13cd-4714-8996-e66f0b297c69 could not be found. Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d68d0df1-6981-4eab-934b-a1e9b5135ebf tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Request method failure captured: Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 HTTP/1.1 Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7yNtb3g48EXYT5BQ7pZkQK_hfCXUdH6nRRki9OlttQD4iG_xQgeG7-8Q7dIZmBAhGDNnggjEL8EQGpmGVXycbkx_A_v_b8lrCZyC37hwuGhlPUx_wD6GFEIkg0NBp3_aZgANmLuY6P1gNWLntSbnJuTAbssBj_6-paHdOOY1PJ4hp9o Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: 3bf88ea13f914730a38cef575bd4982d Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-TestShelveInstance-1993452281 Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3bf88ea13f914730a38cef575bd4982d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3bf88ea13f914730a38cef575bd4982d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3bf88ea13f914730a38cef575bd4982d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3bf88ea13f914730a38cef575bd4982d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-TestShelveInstance-1993452281 Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: 3bf88ea13f914730a38cef575bd4982d Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-TestShelveInstance-1993452281 Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-TestShelveInstance-1993452281-project Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 6377b5c6f4bc4645a62697b66316fb39 Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-TestShelveInstance-1993452281-project Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 0eb52a76-13cd-4714-8996-e66f0b297c69 could not be found. Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '0eb52a76-13cd-4714-8996-e66f0b297c69'} Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eb52a76-13cd-4714-8996-e66f0b297c69 could not be found. Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eb52a76-13cd-4714-8996-e66f0b297c69 could not be found. Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:33:16.359011 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:33:16.364247 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:33:16.364247 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:33:16.364247 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:33:16.364247 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:33:16.364247 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:33:16.364247 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eb52a76-13cd-4714-8996-e66f0b297c69 could not be found. Aug 07 02:33:16.364247 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:33:16.364247 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d68d0df1-6981-4eab-934b-a1e9b5135ebf tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Returning 404 to user: Instance 0eb52a76-13cd-4714-8996-e66f0b297c69 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:33:16.364247 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d68d0df1-6981-4eab-934b-a1e9b5135ebf tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69" status: 404 len: 111 microversion: 2.1 time: 0.031810 Aug 07 02:33:16.364247 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3974/7479] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:33:16 2022] GET /compute/v2.1/servers/0eb52a76-13cd-4714-8996-e66f0b297c69 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:33:16.524531 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-b65f7f04-3b01-4abc-859f-bb1891ec48bf tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '.version_select at 0x7f9e240ff0d0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:33:16.545199 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-b65f7f04-3b01-4abc-859f-bb1891ec48bf tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1184277479" status: 202 len: 0 microversion: 2.1 time: 0.025478 Aug 07 02:33:16.545799 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3506/7480] 10.222.0.39 () {58 vars in 1254 bytes} [Sun Aug 7 02:33:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1184277479 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:33:16.563898 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-81a999d7-7eab-4724-b4a7-c7a400adf845 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Action: 'create', calling method: .version_select at 0x7f9e24481670>, body: {"keypair": {"name": "tempest-TestShelveInstance-810595272", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAaFQW+BEnPvbFumergsxtwxknHVhXMP742H7MOG+YWYsKshhA92hhMQisMdmjlFgapjrHepn1B3ghr/s4ZaYizXxhDNY/IcrkpsPH3konBUJDud5jE4a6ZiBolC2unv8g=="}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:33:16.579752 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-81a999d7-7eab-4724-b4a7-c7a400adf845 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Getting quotas for project 3bf88ea13f914730a38cef575bd4982d. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:33:16.584932 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-81a999d7-7eab-4724-b4a7-c7a400adf845 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Getting quotas for user 6377b5c6f4bc4645a62697b66316fb39 and project 3bf88ea13f914730a38cef575bd4982d. Resources: {'key_pairs'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:33:16.608128 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-81a999d7-7eab-4724-b4a7-c7a400adf845 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.048127 Aug 07 02:33:16.608727 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3975/7481] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 02:33:16 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:33:32.743397 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:33:32.744187 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:33:32.748361 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e9bed99f-6d13-4439-8d24-a27b97e067d1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-721879259", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-810595272", "security_groups": [{"name": "tempest-secgroup-smoke-444307384"}], "networks": [{"uuid": "7c84ec7a-7d78-4fc7-8129-b82697275dab"}], "block_device_mapping_v2": [{"uuid": "18be6724-bd35-4f47-b74d-5c108cc71e26", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:33:32.860275 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.network.neutron [None req-e9bed99f-6d13-4439-8d24-a27b97e067d1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] validate_networks() for [('7c84ec7a-7d78-4fc7-8129-b82697275dab', None, None, None, None, None)] {{(pid=119517) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 02:33:33.275243 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-e9bed99f-6d13-4439-8d24-a27b97e067d1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Flavor limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 02:33:33.275671 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-e9bed99f-6d13-4439-8d24-a27b97e067d1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Image limits 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 02:33:33.276179 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-e9bed99f-6d13-4439-8d24-a27b97e067d1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Flavor pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 02:33:33.276596 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-e9bed99f-6d13-4439-8d24-a27b97e067d1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Image pref 0:0:0 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 02:33:33.277017 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.virt.hardware [None req-e9bed99f-6d13-4439-8d24-a27b97e067d1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 02:33:33.286388 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9bed99f-6d13-4439-8d24-a27b97e067d1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:33.286873 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9bed99f-6d13-4439-8d24-a27b97e067d1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:33.287373 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9bed99f-6d13-4439-8d24-a27b97e067d1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:33.288076 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9bed99f-6d13-4439-8d24-a27b97e067d1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:33.288535 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9bed99f-6d13-4439-8d24-a27b97e067d1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:33.288966 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e9bed99f-6d13-4439-8d24-a27b97e067d1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:33.306347 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-e9bed99f-6d13-4439-8d24-a27b97e067d1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Getting quotas for project 3bf88ea13f914730a38cef575bd4982d. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:33:33.311725 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-e9bed99f-6d13-4439-8d24-a27b97e067d1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Getting quotas for user 6377b5c6f4bc4645a62697b66316fb39 and project 3bf88ea13f914730a38cef575bd4982d. Resources: {'ram', 'cores', 'instances'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:33:33.369637 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e9bed99f-6d13-4439-8d24-a27b97e067d1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Going to run 1 instances... {{(pid=119517) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 02:33:33.371734 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e9bed99f-6d13-4439-8d24-a27b97e067d1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='18be6724-bd35-4f47-b74d-5c108cc71e26',volume_size=None,volume_type=None)] {{(pid=119517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 02:33:33.495487 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e9bed99f-6d13-4439-8d24-a27b97e067d1 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.753881 Aug 07 02:33:33.496161 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3507/7482] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 02:33:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 02:33:33.507501 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-70579b92-31c7-4719-b207-d962a204f20d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:33:33.508167 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-70579b92-31c7-4719-b207-d962a204f20d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:33:33.510561 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=12 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:33:33.511366 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=4 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:33:33.512233 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:33:33.574807 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-70579b92-31c7-4719-b207-d962a204f20d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:33:33.582255 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-70579b92-31c7-4719-b207-d962a204f20d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1087 microversion: 2.1 time: 0.078782 Aug 07 02:33:33.582819 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3976/7483] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:33:33 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1087 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:33:34.604485 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ad3a040a-72ff-454b-99ff-cf68217d7360 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:33:34.605140 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ad3a040a-72ff-454b-99ff-cf68217d7360 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:33:34.660000 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ad3a040a-72ff-454b-99ff-cf68217d7360 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:33:34.666986 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ad3a040a-72ff-454b-99ff-cf68217d7360 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1087 microversion: 2.1 time: 0.067750 Aug 07 02:33:34.667633 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3508/7484] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:33:34 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1087 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:33:35.687678 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a62efeb4-4eef-4158-8b8b-4d67043e4ac2 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:33:35.688338 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a62efeb4-4eef-4158-8b8b-4d67043e4ac2 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:33:35.741953 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a62efeb4-4eef-4158-8b8b-4d67043e4ac2 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:33:35.748727 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a62efeb4-4eef-4158-8b8b-4d67043e4ac2 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1087 microversion: 2.1 time: 0.064937 Aug 07 02:33:35.749298 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3977/7485] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:33:35 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1087 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:33:36.772362 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3ca01e47-801e-4367-b43a-eb1e29864fde tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:33:36.773011 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3ca01e47-801e-4367-b43a-eb1e29864fde tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:33:36.779990 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ca01e47-801e-4367-b43a-eb1e29864fde tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:36.780473 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ca01e47-801e-4367-b43a-eb1e29864fde tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:36.780911 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ca01e47-801e-4367-b43a-eb1e29864fde tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:36.781604 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ca01e47-801e-4367-b43a-eb1e29864fde tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:36.782060 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ca01e47-801e-4367-b43a-eb1e29864fde tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:36.782489 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3ca01e47-801e-4367-b43a-eb1e29864fde tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:36.850125 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3ca01e47-801e-4367-b43a-eb1e29864fde tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:33:36.858071 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3ca01e47-801e-4367-b43a-eb1e29864fde tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1137 microversion: 2.1 time: 0.089558 Aug 07 02:33:36.858636 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3509/7486] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:33:36 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1137 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:33:37.879335 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-967f8253-2acf-4d2b-a15f-428d512f601f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:33:37.879866 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-967f8253-2acf-4d2b-a15f-428d512f601f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:33:37.887356 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-967f8253-2acf-4d2b-a15f-428d512f601f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:37.887862 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-967f8253-2acf-4d2b-a15f-428d512f601f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:37.888347 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-967f8253-2acf-4d2b-a15f-428d512f601f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:37.889072 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-967f8253-2acf-4d2b-a15f-428d512f601f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:37.889547 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-967f8253-2acf-4d2b-a15f-428d512f601f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:37.889992 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-967f8253-2acf-4d2b-a15f-428d512f601f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:37.962065 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-967f8253-2acf-4d2b-a15f-428d512f601f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:33:37.972003 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-967f8253-2acf-4d2b-a15f-428d512f601f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1203 microversion: 2.1 time: 0.097092 Aug 07 02:33:37.972587 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3978/7487] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:33:37 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1203 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:33:38.965314 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-bcfa21fb-2068-40bf-90e7-81e0aa96bb20 req-45f5035a-9cdf-43f4-9464-097930383e3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c3eb949-f7ec-43ff-9328-02a19b47a4d7", "tag": "891e45e6-3b39-48ea-9fd6-d0c85693b222"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:33:38.979108 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-bcfa21fb-2068-40bf-90e7-81e0aa96bb20 req-45f5035a-9cdf-43f4-9464-097930383e3b service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:38.980014 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-bcfa21fb-2068-40bf-90e7-81e0aa96bb20 req-45f5035a-9cdf-43f4-9464-097930383e3b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:38.980696 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-bcfa21fb-2068-40bf-90e7-81e0aa96bb20 req-45f5035a-9cdf-43f4-9464-097930383e3b service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:38.993380 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4fbff6cf-d48e-42be-ae40-84cc1f4512e7 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:33:38.994023 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4fbff6cf-d48e-42be-ae40-84cc1f4512e7 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:33:38.998221 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-bcfa21fb-2068-40bf-90e7-81e0aa96bb20 req-45f5035a-9cdf-43f4-9464-097930383e3b service nova] Creating event network-changed:891e45e6-3b39-48ea-9fd6-d0c85693b222 for instance 9c3eb949-f7ec-43ff-9328-02a19b47a4d7 on n-h2-master-1 Aug 07 02:33:39.001179 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4fbff6cf-d48e-42be-ae40-84cc1f4512e7 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:39.001762 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4fbff6cf-d48e-42be-ae40-84cc1f4512e7 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:39.002266 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4fbff6cf-d48e-42be-ae40-84cc1f4512e7 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:39.003406 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4fbff6cf-d48e-42be-ae40-84cc1f4512e7 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:39.004075 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4fbff6cf-d48e-42be-ae40-84cc1f4512e7 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:39.004454 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-bcfa21fb-2068-40bf-90e7-81e0aa96bb20 req-45f5035a-9cdf-43f4-9464-097930383e3b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118635 Aug 07 02:33:39.005079 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4fbff6cf-d48e-42be-ae40-84cc1f4512e7 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:39.005656 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3510/7488] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:33:39.250588 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4fbff6cf-d48e-42be-ae40-84cc1f4512e7 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:33:39.258376 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4fbff6cf-d48e-42be-ae40-84cc1f4512e7 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1270 microversion: 2.1 time: 0.269281 Aug 07 02:33:39.258951 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3979/7489] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:33:38 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1270 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:33:40.280228 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-253d4a6e-0760-4f30-8099-1dfd1f8eb01c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:33:40.280952 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-253d4a6e-0760-4f30-8099-1dfd1f8eb01c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:33:40.287686 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-253d4a6e-0760-4f30-8099-1dfd1f8eb01c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:40.288199 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-253d4a6e-0760-4f30-8099-1dfd1f8eb01c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:40.288634 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-253d4a6e-0760-4f30-8099-1dfd1f8eb01c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:40.289328 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-253d4a6e-0760-4f30-8099-1dfd1f8eb01c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:40.289784 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-253d4a6e-0760-4f30-8099-1dfd1f8eb01c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:40.290211 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-253d4a6e-0760-4f30-8099-1dfd1f8eb01c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:40.425930 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-253d4a6e-0760-4f30-8099-1dfd1f8eb01c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:33:40.434347 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-253d4a6e-0760-4f30-8099-1dfd1f8eb01c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1270 microversion: 2.1 time: 0.159337 Aug 07 02:33:40.435057 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3511/7490] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:33:40 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:33:41.454975 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-38053b15-e79c-4f31-92e1-75feb47b25a5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:33:41.455613 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-38053b15-e79c-4f31-92e1-75feb47b25a5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:33:41.462862 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38053b15-e79c-4f31-92e1-75feb47b25a5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:41.463366 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38053b15-e79c-4f31-92e1-75feb47b25a5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:41.463821 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38053b15-e79c-4f31-92e1-75feb47b25a5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:41.464577 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38053b15-e79c-4f31-92e1-75feb47b25a5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:41.465053 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38053b15-e79c-4f31-92e1-75feb47b25a5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:41.465495 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-38053b15-e79c-4f31-92e1-75feb47b25a5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:41.606260 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-38053b15-e79c-4f31-92e1-75feb47b25a5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:33:41.614767 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-38053b15-e79c-4f31-92e1-75feb47b25a5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1270 microversion: 2.1 time: 0.163856 Aug 07 02:33:41.615363 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3980/7491] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:33:41 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1270 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:33:42.635365 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7f925430-26c4-431e-929c-e1130da9c504 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:33:42.635987 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7f925430-26c4-431e-929c-e1130da9c504 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:33:42.643535 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7f925430-26c4-431e-929c-e1130da9c504 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:42.644050 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7f925430-26c4-431e-929c-e1130da9c504 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:42.644491 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7f925430-26c4-431e-929c-e1130da9c504 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:42.645227 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7f925430-26c4-431e-929c-e1130da9c504 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:42.645686 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7f925430-26c4-431e-929c-e1130da9c504 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:42.646116 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7f925430-26c4-431e-929c-e1130da9c504 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:42.776899 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7f925430-26c4-431e-929c-e1130da9c504 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:33:42.784460 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7f925430-26c4-431e-929c-e1130da9c504 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1258 microversion: 2.1 time: 0.153171 Aug 07 02:33:42.785024 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3512/7492] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:33:42 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:33:43.805303 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-def8094e-b4ee-481b-9342-87d12e271496 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:33:43.805940 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-def8094e-b4ee-481b-9342-87d12e271496 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:33:43.812990 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-def8094e-b4ee-481b-9342-87d12e271496 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:43.813524 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-def8094e-b4ee-481b-9342-87d12e271496 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:43.814044 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-def8094e-b4ee-481b-9342-87d12e271496 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:43.815332 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-def8094e-b4ee-481b-9342-87d12e271496 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:43.815955 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-def8094e-b4ee-481b-9342-87d12e271496 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:43.816428 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-def8094e-b4ee-481b-9342-87d12e271496 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:43.945720 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-def8094e-b4ee-481b-9342-87d12e271496 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:33:43.953389 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-def8094e-b4ee-481b-9342-87d12e271496 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1258 microversion: 2.1 time: 0.151977 Aug 07 02:33:43.953960 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3981/7493] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:33:43 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:33:44.975147 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-4a6e22c8-454c-4f58-87dd-2cd1d20d7d0c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:33:44.975678 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-4a6e22c8-454c-4f58-87dd-2cd1d20d7d0c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:33:44.977988 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:33:44.979578 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=8 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:33:44.985541 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4a6e22c8-454c-4f58-87dd-2cd1d20d7d0c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:44.986030 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4a6e22c8-454c-4f58-87dd-2cd1d20d7d0c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:44.986482 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4a6e22c8-454c-4f58-87dd-2cd1d20d7d0c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:44.987187 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4a6e22c8-454c-4f58-87dd-2cd1d20d7d0c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:44.987642 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4a6e22c8-454c-4f58-87dd-2cd1d20d7d0c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:44.988091 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-4a6e22c8-454c-4f58-87dd-2cd1d20d7d0c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:45.174637 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-4a6e22c8-454c-4f58-87dd-2cd1d20d7d0c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:33:45.182340 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-4a6e22c8-454c-4f58-87dd-2cd1d20d7d0c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1258 microversion: 2.1 time: 0.211844 Aug 07 02:33:45.182918 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3513/7494] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:33:44 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1258 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:33:46.202917 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d08047b1-8570-4a66-b58e-b5c9effbb9d3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:33:46.203462 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d08047b1-8570-4a66-b58e-b5c9effbb9d3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:33:46.206145 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=4 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:33:46.211536 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d08047b1-8570-4a66-b58e-b5c9effbb9d3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:46.212052 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d08047b1-8570-4a66-b58e-b5c9effbb9d3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:46.212501 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d08047b1-8570-4a66-b58e-b5c9effbb9d3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:46.213201 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d08047b1-8570-4a66-b58e-b5c9effbb9d3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:46.213664 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d08047b1-8570-4a66-b58e-b5c9effbb9d3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:46.214098 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d08047b1-8570-4a66-b58e-b5c9effbb9d3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:46.345753 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-d08047b1-8570-4a66-b58e-b5c9effbb9d3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:33:46.353997 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d08047b1-8570-4a66-b58e-b5c9effbb9d3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1258 microversion: 2.1 time: 0.155174 Aug 07 02:33:46.354557 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3982/7495] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:33:46 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:33:47.374487 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-3f35d60f-5445-430a-b4d5-807a80a18e52 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:33:47.375102 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-3f35d60f-5445-430a-b4d5-807a80a18e52 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:33:47.382666 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3f35d60f-5445-430a-b4d5-807a80a18e52 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:47.383146 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3f35d60f-5445-430a-b4d5-807a80a18e52 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:47.383577 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3f35d60f-5445-430a-b4d5-807a80a18e52 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:47.384286 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3f35d60f-5445-430a-b4d5-807a80a18e52 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:47.384738 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3f35d60f-5445-430a-b4d5-807a80a18e52 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:47.385162 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-3f35d60f-5445-430a-b4d5-807a80a18e52 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:47.516694 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-3f35d60f-5445-430a-b4d5-807a80a18e52 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:33:47.524205 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-3f35d60f-5445-430a-b4d5-807a80a18e52 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1258 microversion: 2.1 time: 0.153559 Aug 07 02:33:47.524767 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3514/7496] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:33:47 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:33:48.546147 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e9a6d56e-f5f1-4239-9eb0-1c48577e378d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:33:48.546768 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e9a6d56e-f5f1-4239-9eb0-1c48577e378d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:33:48.552932 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9a6d56e-f5f1-4239-9eb0-1c48577e378d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:48.553436 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9a6d56e-f5f1-4239-9eb0-1c48577e378d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:48.553892 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9a6d56e-f5f1-4239-9eb0-1c48577e378d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:48.554611 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9a6d56e-f5f1-4239-9eb0-1c48577e378d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:48.555094 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9a6d56e-f5f1-4239-9eb0-1c48577e378d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:48.555542 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e9a6d56e-f5f1-4239-9eb0-1c48577e378d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:48.684499 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-e9a6d56e-f5f1-4239-9eb0-1c48577e378d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:33:48.692513 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e9a6d56e-f5f1-4239-9eb0-1c48577e378d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1258 microversion: 2.1 time: 0.150641 Aug 07 02:33:48.693083 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3983/7497] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:33:48 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:33:49.713560 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6a8a3b23-6385-4d6d-9595-f9d3d6b2a989 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:33:49.714169 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6a8a3b23-6385-4d6d-9595-f9d3d6b2a989 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:33:49.720332 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a8a3b23-6385-4d6d-9595-f9d3d6b2a989 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:49.720812 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a8a3b23-6385-4d6d-9595-f9d3d6b2a989 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:49.721850 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a8a3b23-6385-4d6d-9595-f9d3d6b2a989 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:49.722538 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a8a3b23-6385-4d6d-9595-f9d3d6b2a989 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:49.722987 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a8a3b23-6385-4d6d-9595-f9d3d6b2a989 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:49.723415 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6a8a3b23-6385-4d6d-9595-f9d3d6b2a989 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:49.854248 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6a8a3b23-6385-4d6d-9595-f9d3d6b2a989 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:33:49.861706 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6a8a3b23-6385-4d6d-9595-f9d3d6b2a989 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1258 microversion: 2.1 time: 0.152194 Aug 07 02:33:49.862272 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3515/7498] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:33:49 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:33:50.882271 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b4ed57ab-4810-4403-a4ff-0efeb3b973c9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:33:50.882893 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b4ed57ab-4810-4403-a4ff-0efeb3b973c9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:33:50.889791 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4ed57ab-4810-4403-a4ff-0efeb3b973c9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:50.890281 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4ed57ab-4810-4403-a4ff-0efeb3b973c9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:50.890726 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4ed57ab-4810-4403-a4ff-0efeb3b973c9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:50.891423 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4ed57ab-4810-4403-a4ff-0efeb3b973c9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:50.891936 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4ed57ab-4810-4403-a4ff-0efeb3b973c9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:50.892378 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b4ed57ab-4810-4403-a4ff-0efeb3b973c9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:51.032977 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b4ed57ab-4810-4403-a4ff-0efeb3b973c9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:33:51.041307 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b4ed57ab-4810-4403-a4ff-0efeb3b973c9 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1258 microversion: 2.1 time: 0.162894 Aug 07 02:33:51.041878 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3984/7499] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:33:50 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:33:52.061986 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e3ac3031-5f28-4688-9f03-f21ac1d7c8a2 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:33:52.062603 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e3ac3031-5f28-4688-9f03-f21ac1d7c8a2 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:33:52.070194 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3ac3031-5f28-4688-9f03-f21ac1d7c8a2 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:52.070689 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3ac3031-5f28-4688-9f03-f21ac1d7c8a2 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:52.071128 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3ac3031-5f28-4688-9f03-f21ac1d7c8a2 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:52.071848 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3ac3031-5f28-4688-9f03-f21ac1d7c8a2 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:52.072330 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3ac3031-5f28-4688-9f03-f21ac1d7c8a2 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:52.072761 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e3ac3031-5f28-4688-9f03-f21ac1d7c8a2 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:52.218734 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e3ac3031-5f28-4688-9f03-f21ac1d7c8a2 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:33:52.227258 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e3ac3031-5f28-4688-9f03-f21ac1d7c8a2 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1258 microversion: 2.1 time: 0.169231 Aug 07 02:33:52.227835 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3516/7500] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:33:52 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1258 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:33:53.251843 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dfb876ef-26a7-4028-ab7f-c30186893223 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:33:53.253023 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-dfb876ef-26a7-4028-ab7f-c30186893223 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:33:53.259826 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dfb876ef-26a7-4028-ab7f-c30186893223 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:53.260346 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dfb876ef-26a7-4028-ab7f-c30186893223 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:53.260791 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dfb876ef-26a7-4028-ab7f-c30186893223 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:53.261494 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dfb876ef-26a7-4028-ab7f-c30186893223 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:53.261956 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dfb876ef-26a7-4028-ab7f-c30186893223 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:53.262391 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dfb876ef-26a7-4028-ab7f-c30186893223 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:53.391013 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-dfb876ef-26a7-4028-ab7f-c30186893223 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:33:53.398506 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-dfb876ef-26a7-4028-ab7f-c30186893223 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1258 microversion: 2.1 time: 0.150680 Aug 07 02:33:53.399074 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3985/7501] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:33:53 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:33:53.581653 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-3140614b-0f16-494d-ab67-cb0ca55e6626 req-a886c378-0a87-43c0-9f48-8e6371557f13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c3eb949-f7ec-43ff-9328-02a19b47a4d7", "name": "network-vif-plugged", "status": "completed", "tag": "891e45e6-3b39-48ea-9fd6-d0c85693b222"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:33:53.592232 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3140614b-0f16-494d-ab67-cb0ca55e6626 req-a886c378-0a87-43c0-9f48-8e6371557f13 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:53.592722 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3140614b-0f16-494d-ab67-cb0ca55e6626 req-a886c378-0a87-43c0-9f48-8e6371557f13 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:53.593165 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-3140614b-0f16-494d-ab67-cb0ca55e6626 req-a886c378-0a87-43c0-9f48-8e6371557f13 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:53.605088 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-3140614b-0f16-494d-ab67-cb0ca55e6626 req-a886c378-0a87-43c0-9f48-8e6371557f13 service nova] Creating event network-vif-plugged:891e45e6-3b39-48ea-9fd6-d0c85693b222 for instance 9c3eb949-f7ec-43ff-9328-02a19b47a4d7 on n-h2-master-1 Aug 07 02:33:53.609994 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-3140614b-0f16-494d-ab67-cb0ca55e6626 req-a886c378-0a87-43c0-9f48-8e6371557f13 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032115 Aug 07 02:33:53.610747 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3517/7502] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:33:54.418666 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-63316357-063f-4e91-b579-1f56e58fbffc tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:33:54.419300 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-63316357-063f-4e91-b579-1f56e58fbffc tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:33:54.426349 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-63316357-063f-4e91-b579-1f56e58fbffc tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:54.426847 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-63316357-063f-4e91-b579-1f56e58fbffc tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:54.427300 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-63316357-063f-4e91-b579-1f56e58fbffc tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:54.428039 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-63316357-063f-4e91-b579-1f56e58fbffc tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:54.428510 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-63316357-063f-4e91-b579-1f56e58fbffc tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:54.428954 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-63316357-063f-4e91-b579-1f56e58fbffc tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:54.560518 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-63316357-063f-4e91-b579-1f56e58fbffc tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:33:54.568696 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-63316357-063f-4e91-b579-1f56e58fbffc tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1258 microversion: 2.1 time: 0.153997 Aug 07 02:33:54.569270 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3986/7503] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:33:54 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:33:55.592127 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-92a7765f-99f9-4f73-9d69-e9b5465a1f7f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:33:55.592833 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-92a7765f-99f9-4f73-9d69-e9b5465a1f7f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:33:55.599875 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-92a7765f-99f9-4f73-9d69-e9b5465a1f7f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:55.600397 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-92a7765f-99f9-4f73-9d69-e9b5465a1f7f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:55.600839 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-92a7765f-99f9-4f73-9d69-e9b5465a1f7f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:55.601823 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-92a7765f-99f9-4f73-9d69-e9b5465a1f7f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:55.602287 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-92a7765f-99f9-4f73-9d69-e9b5465a1f7f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:55.602719 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-92a7765f-99f9-4f73-9d69-e9b5465a1f7f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:55.737713 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-92a7765f-99f9-4f73-9d69-e9b5465a1f7f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:33:55.745671 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-92a7765f-99f9-4f73-9d69-e9b5465a1f7f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1442 microversion: 2.1 time: 0.158813 Aug 07 02:33:55.746255 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3518/7504] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:33:55 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1442 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:33:55.765662 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ca3cf099-83a4-44e1-a925-e7c37bb17069 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:33:55.766295 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ca3cf099-83a4-44e1-a925-e7c37bb17069 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:33:55.773624 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca3cf099-83a4-44e1-a925-e7c37bb17069 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:55.774120 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca3cf099-83a4-44e1-a925-e7c37bb17069 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:55.774573 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca3cf099-83a4-44e1-a925-e7c37bb17069 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:55.775286 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca3cf099-83a4-44e1-a925-e7c37bb17069 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:55.775758 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca3cf099-83a4-44e1-a925-e7c37bb17069 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:55.776227 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ca3cf099-83a4-44e1-a925-e7c37bb17069 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:55.916579 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ca3cf099-83a4-44e1-a925-e7c37bb17069 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:33:55.924795 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ca3cf099-83a4-44e1-a925-e7c37bb17069 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1442 microversion: 2.1 time: 0.163179 Aug 07 02:33:55.925471 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3987/7505] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:33:55 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1442 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:33:57.791334 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-7a996127-2cf9-4972-8f0c-aa72a668bc6c req-ae642a7d-b834-42e3-9356-6f24e61774ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c3eb949-f7ec-43ff-9328-02a19b47a4d7", "tag": "891e45e6-3b39-48ea-9fd6-d0c85693b222"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:33:57.802510 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-7a996127-2cf9-4972-8f0c-aa72a668bc6c req-ae642a7d-b834-42e3-9356-6f24e61774ce service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:33:57.803078 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-7a996127-2cf9-4972-8f0c-aa72a668bc6c req-ae642a7d-b834-42e3-9356-6f24e61774ce service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:33:57.803571 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-7a996127-2cf9-4972-8f0c-aa72a668bc6c req-ae642a7d-b834-42e3-9356-6f24e61774ce service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:33:57.815221 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-7a996127-2cf9-4972-8f0c-aa72a668bc6c req-ae642a7d-b834-42e3-9356-6f24e61774ce service nova] Creating event network-changed:891e45e6-3b39-48ea-9fd6-d0c85693b222 for instance 9c3eb949-f7ec-43ff-9328-02a19b47a4d7 on n-h2-master-1 Aug 07 02:33:57.820532 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-7a996127-2cf9-4972-8f0c-aa72a668bc6c req-ae642a7d-b834-42e3-9356-6f24e61774ce service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033074 Aug 07 02:33:57.821218 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3519/7506] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:34:28.109704 n-d-master-1 devstack@n-api.service[119516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 02:34:28.110237 n-d-master-1 devstack@n-api.service[119516]: Sun Aug 7 02:34:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 02:35:52.944759 n-d-master-1 devstack@n-api.service[119516]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e144fce3-2ef9-4f1b-815a-36f44ddcd578] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 07 02:35:52.945650 n-d-master-1 devstack@n-api.service[119516]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9bbf4f32-4f7b-4fcf-a326-64eac47dae98] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 07 02:35:52.946230 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=28 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:35:52.946993 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=60 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:35:53.008183 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-052c1494-4d7c-4083-8c77-07b0bfd0b93e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:35:53.008742 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-052c1494-4d7c-4083-8c77-07b0bfd0b93e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:35:53.014814 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-052c1494-4d7c-4083-8c77-07b0bfd0b93e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:35:53.015313 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-052c1494-4d7c-4083-8c77-07b0bfd0b93e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:35:53.015764 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-052c1494-4d7c-4083-8c77-07b0bfd0b93e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:35:53.016504 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-052c1494-4d7c-4083-8c77-07b0bfd0b93e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:35:53.017662 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-052c1494-4d7c-4083-8c77-07b0bfd0b93e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:35:53.018109 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-052c1494-4d7c-4083-8c77-07b0bfd0b93e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:35:53.041402 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-052c1494-4d7c-4083-8c77-07b0bfd0b93e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lazy-loading 'flavor' on Instance uuid 9c3eb949-f7ec-43ff-9328-02a19b47a4d7 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 02:35:53.112583 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-052c1494-4d7c-4083-8c77-07b0bfd0b93e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "POST /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7/action" status: 202 len: 0 microversion: 2.1 time: 0.169566 Aug 07 02:35:53.113205 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3988/7507] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:35:52 2022] POST /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:35:53.119472 n-d-master-1 devstack@n-api.service[119517]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dde625b-e185-486e-885e-ba9f9bdf36ce] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 07 02:35:53.120319 n-d-master-1 devstack@n-api.service[119517]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cc2209bc-4fce-4284-bf5f-e0375e6343bd] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 07 02:35:53.120918 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:35:53.121657 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=56 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:35:53.126654 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-92b53cb1-ad0d-4d8f-9de7-dffde470a253 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:35:53.127414 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-92b53cb1-ad0d-4d8f-9de7-dffde470a253 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:35:53.135115 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-92b53cb1-ad0d-4d8f-9de7-dffde470a253 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:35:53.135684 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-92b53cb1-ad0d-4d8f-9de7-dffde470a253 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:35:53.136152 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-92b53cb1-ad0d-4d8f-9de7-dffde470a253 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:35:53.136856 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-92b53cb1-ad0d-4d8f-9de7-dffde470a253 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:35:53.137313 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-92b53cb1-ad0d-4d8f-9de7-dffde470a253 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:35:53.137741 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-92b53cb1-ad0d-4d8f-9de7-dffde470a253 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:35:53.278480 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-92b53cb1-ad0d-4d8f-9de7-dffde470a253 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:35:53.286216 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-92b53cb1-ad0d-4d8f-9de7-dffde470a253 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1566 microversion: 2.1 time: 0.168562 Aug 07 02:35:53.286793 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3520/7508] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:35:53 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:35:54.310424 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-a1e1baf2-3f01-4667-a1f5-3775886e551d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:35:54.311101 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-a1e1baf2-3f01-4667-a1f5-3775886e551d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:35:54.320081 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a1e1baf2-3f01-4667-a1f5-3775886e551d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:35:54.320584 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a1e1baf2-3f01-4667-a1f5-3775886e551d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:35:54.321040 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a1e1baf2-3f01-4667-a1f5-3775886e551d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:35:54.321764 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a1e1baf2-3f01-4667-a1f5-3775886e551d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:35:54.322236 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a1e1baf2-3f01-4667-a1f5-3775886e551d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:35:54.322679 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-a1e1baf2-3f01-4667-a1f5-3775886e551d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:35:54.330408 n-d-master-1 devstack@n-api.service[119516]: INFO oslo.messaging._drivers.impl_rabbit [-] [e144fce3-2ef9-4f1b-815a-36f44ddcd578] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 37318. Aug 07 02:35:54.341525 n-d-master-1 devstack@n-api.service[119516]: INFO oslo.messaging._drivers.impl_rabbit [-] [9bbf4f32-4f7b-4fcf-a326-64eac47dae98] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 37320. Aug 07 02:35:54.461560 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-a1e1baf2-3f01-4667-a1f5-3775886e551d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:35:54.469342 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-a1e1baf2-3f01-4667-a1f5-3775886e551d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1566 microversion: 2.1 time: 0.164637 Aug 07 02:35:54.469923 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3989/7509] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:35:54 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:35:55.490883 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f487fac0-17ab-48c8-a024-a3db193d2bdc tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:35:55.491499 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f487fac0-17ab-48c8-a024-a3db193d2bdc tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:35:55.500421 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f487fac0-17ab-48c8-a024-a3db193d2bdc tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:35:55.500921 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f487fac0-17ab-48c8-a024-a3db193d2bdc tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:35:55.501382 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f487fac0-17ab-48c8-a024-a3db193d2bdc tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:35:55.502098 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f487fac0-17ab-48c8-a024-a3db193d2bdc tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:35:55.502583 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f487fac0-17ab-48c8-a024-a3db193d2bdc tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:35:55.503020 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f487fac0-17ab-48c8-a024-a3db193d2bdc tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:35:55.512163 n-d-master-1 devstack@n-api.service[119517]: INFO oslo.messaging._drivers.impl_rabbit [-] [cc2209bc-4fce-4284-bf5f-e0375e6343bd] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 37326. Aug 07 02:35:55.518462 n-d-master-1 devstack@n-api.service[119517]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dde625b-e185-486e-885e-ba9f9bdf36ce] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 37324. Aug 07 02:35:55.649554 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f487fac0-17ab-48c8-a024-a3db193d2bdc tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:35:55.657194 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f487fac0-17ab-48c8-a024-a3db193d2bdc tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1566 microversion: 2.1 time: 0.170206 Aug 07 02:35:55.658321 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3521/7510] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:35:55 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:35:56.679561 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3f9f8650-c29e-407f-bd9c-a71dfc9c27de tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:35:56.680220 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3f9f8650-c29e-407f-bd9c-a71dfc9c27de tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:35:56.687046 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f9f8650-c29e-407f-bd9c-a71dfc9c27de tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:35:56.687547 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f9f8650-c29e-407f-bd9c-a71dfc9c27de tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:35:56.688028 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f9f8650-c29e-407f-bd9c-a71dfc9c27de tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:35:56.688767 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f9f8650-c29e-407f-bd9c-a71dfc9c27de tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:35:56.689236 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f9f8650-c29e-407f-bd9c-a71dfc9c27de tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:35:56.689675 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f9f8650-c29e-407f-bd9c-a71dfc9c27de tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:35:56.818276 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3f9f8650-c29e-407f-bd9c-a71dfc9c27de tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:35:56.825823 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3f9f8650-c29e-407f-bd9c-a71dfc9c27de tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1566 microversion: 2.1 time: 0.150260 Aug 07 02:35:56.826386 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3990/7511] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:35:56 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:35:57.846787 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-cec21a97-0c8b-4ecc-a687-c82e5e183af4 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:35:57.847403 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-cec21a97-0c8b-4ecc-a687-c82e5e183af4 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:35:57.854317 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cec21a97-0c8b-4ecc-a687-c82e5e183af4 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:35:57.855052 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cec21a97-0c8b-4ecc-a687-c82e5e183af4 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:35:57.855492 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cec21a97-0c8b-4ecc-a687-c82e5e183af4 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:35:57.856500 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cec21a97-0c8b-4ecc-a687-c82e5e183af4 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:35:57.856955 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cec21a97-0c8b-4ecc-a687-c82e5e183af4 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:35:57.857381 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-cec21a97-0c8b-4ecc-a687-c82e5e183af4 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:35:57.991186 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-cec21a97-0c8b-4ecc-a687-c82e5e183af4 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:35:57.998774 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-cec21a97-0c8b-4ecc-a687-c82e5e183af4 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1566 microversion: 2.1 time: 0.155960 Aug 07 02:35:57.999347 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3522/7512] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:35:57 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:35:59.021394 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5a331d9e-9aea-4605-b9cd-3a0f0a2e5ffb tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:35:59.022023 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5a331d9e-9aea-4605-b9cd-3a0f0a2e5ffb tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:35:59.028913 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a331d9e-9aea-4605-b9cd-3a0f0a2e5ffb tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:35:59.029408 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a331d9e-9aea-4605-b9cd-3a0f0a2e5ffb tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:35:59.029858 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a331d9e-9aea-4605-b9cd-3a0f0a2e5ffb tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:35:59.030566 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a331d9e-9aea-4605-b9cd-3a0f0a2e5ffb tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:35:59.031035 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a331d9e-9aea-4605-b9cd-3a0f0a2e5ffb tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:35:59.031478 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5a331d9e-9aea-4605-b9cd-3a0f0a2e5ffb tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:35:59.178111 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5a331d9e-9aea-4605-b9cd-3a0f0a2e5ffb tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:35:59.185652 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5a331d9e-9aea-4605-b9cd-3a0f0a2e5ffb tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1566 microversion: 2.1 time: 0.169096 Aug 07 02:35:59.186237 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3991/7513] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:35:59 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:36:00.207631 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-95925888-9b08-49a2-9f67-783d65cac080 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:36:00.208228 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-95925888-9b08-49a2-9f67-783d65cac080 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:36:00.215187 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-95925888-9b08-49a2-9f67-783d65cac080 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:00.215678 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-95925888-9b08-49a2-9f67-783d65cac080 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:00.216176 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-95925888-9b08-49a2-9f67-783d65cac080 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:00.216909 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-95925888-9b08-49a2-9f67-783d65cac080 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:00.217370 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-95925888-9b08-49a2-9f67-783d65cac080 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:00.217836 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-95925888-9b08-49a2-9f67-783d65cac080 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:00.347338 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-95925888-9b08-49a2-9f67-783d65cac080 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:36:00.355197 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-95925888-9b08-49a2-9f67-783d65cac080 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1566 microversion: 2.1 time: 0.151803 Aug 07 02:36:00.355950 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3523/7514] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:36:00 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:36:01.377614 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-c51f361d-603e-405a-bc8a-e56623273a9e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:36:01.378250 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-c51f361d-603e-405a-bc8a-e56623273a9e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:36:01.385166 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c51f361d-603e-405a-bc8a-e56623273a9e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:01.385663 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c51f361d-603e-405a-bc8a-e56623273a9e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:01.386117 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c51f361d-603e-405a-bc8a-e56623273a9e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:01.386830 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c51f361d-603e-405a-bc8a-e56623273a9e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:01.387304 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c51f361d-603e-405a-bc8a-e56623273a9e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:01.387751 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-c51f361d-603e-405a-bc8a-e56623273a9e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:01.518805 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-c51f361d-603e-405a-bc8a-e56623273a9e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:36:01.526414 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-c51f361d-603e-405a-bc8a-e56623273a9e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1566 microversion: 2.1 time: 0.152759 Aug 07 02:36:01.526988 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3992/7515] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:36:01 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:36:02.550108 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-d5be8b7b-9343-40b3-95d3-810c95d04799 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:36:02.550720 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-d5be8b7b-9343-40b3-95d3-810c95d04799 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:36:02.557589 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d5be8b7b-9343-40b3-95d3-810c95d04799 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:02.558055 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d5be8b7b-9343-40b3-95d3-810c95d04799 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:02.558493 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d5be8b7b-9343-40b3-95d3-810c95d04799 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:02.559234 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d5be8b7b-9343-40b3-95d3-810c95d04799 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:02.559691 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d5be8b7b-9343-40b3-95d3-810c95d04799 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:02.560140 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-d5be8b7b-9343-40b3-95d3-810c95d04799 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:02.699300 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-d5be8b7b-9343-40b3-95d3-810c95d04799 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:36:02.706926 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-d5be8b7b-9343-40b3-95d3-810c95d04799 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1566 microversion: 2.1 time: 0.161328 Aug 07 02:36:02.707505 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3524/7516] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:36:02 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:36:03.727839 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-6a88179d-aa3c-45c0-bf92-1724a0ca0c2d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:36:03.728479 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-6a88179d-aa3c-45c0-bf92-1724a0ca0c2d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:36:03.735679 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a88179d-aa3c-45c0-bf92-1724a0ca0c2d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:03.736218 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a88179d-aa3c-45c0-bf92-1724a0ca0c2d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:03.737138 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a88179d-aa3c-45c0-bf92-1724a0ca0c2d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:03.737847 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a88179d-aa3c-45c0-bf92-1724a0ca0c2d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:03.738310 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a88179d-aa3c-45c0-bf92-1724a0ca0c2d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:03.738744 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-6a88179d-aa3c-45c0-bf92-1724a0ca0c2d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:03.935622 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-6a88179d-aa3c-45c0-bf92-1724a0ca0c2d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:36:03.944551 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-6a88179d-aa3c-45c0-bf92-1724a0ca0c2d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1566 microversion: 2.1 time: 0.220562 Aug 07 02:36:03.945188 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3993/7517] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:36:03 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1566 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:36:04.965505 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c6f87e91-352a-4aca-92c6-3455b7a0b48f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:36:04.966125 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c6f87e91-352a-4aca-92c6-3455b7a0b48f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:36:04.973133 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6f87e91-352a-4aca-92c6-3455b7a0b48f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:04.973617 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6f87e91-352a-4aca-92c6-3455b7a0b48f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:04.974061 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6f87e91-352a-4aca-92c6-3455b7a0b48f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:04.974765 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6f87e91-352a-4aca-92c6-3455b7a0b48f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:04.975227 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6f87e91-352a-4aca-92c6-3455b7a0b48f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:04.975657 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c6f87e91-352a-4aca-92c6-3455b7a0b48f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:05.106131 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c6f87e91-352a-4aca-92c6-3455b7a0b48f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:36:05.113796 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c6f87e91-352a-4aca-92c6-3455b7a0b48f tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1566 microversion: 2.1 time: 0.152172 Aug 07 02:36:05.114372 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3525/7518] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:36:04 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:36:06.134690 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-88dbc4e6-6c11-472d-bb45-49a203eea543 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:36:06.135442 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-88dbc4e6-6c11-472d-bb45-49a203eea543 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:36:06.142455 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-88dbc4e6-6c11-472d-bb45-49a203eea543 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:06.143440 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-88dbc4e6-6c11-472d-bb45-49a203eea543 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:06.143909 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-88dbc4e6-6c11-472d-bb45-49a203eea543 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:06.144623 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-88dbc4e6-6c11-472d-bb45-49a203eea543 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:06.145095 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-88dbc4e6-6c11-472d-bb45-49a203eea543 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:06.145534 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-88dbc4e6-6c11-472d-bb45-49a203eea543 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:06.283077 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-88dbc4e6-6c11-472d-bb45-49a203eea543 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:36:06.291966 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-88dbc4e6-6c11-472d-bb45-49a203eea543 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1566 microversion: 2.1 time: 0.161041 Aug 07 02:36:06.292585 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3994/7519] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:36:06 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:36:07.313824 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-387ec784-6874-4f55-b885-627a2bcc3e8c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:36:07.314394 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-387ec784-6874-4f55-b885-627a2bcc3e8c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:36:07.321897 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-387ec784-6874-4f55-b885-627a2bcc3e8c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:07.322395 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-387ec784-6874-4f55-b885-627a2bcc3e8c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:07.322843 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-387ec784-6874-4f55-b885-627a2bcc3e8c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:07.323549 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-387ec784-6874-4f55-b885-627a2bcc3e8c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:07.324040 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-387ec784-6874-4f55-b885-627a2bcc3e8c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:07.324492 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-387ec784-6874-4f55-b885-627a2bcc3e8c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:07.457830 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-387ec784-6874-4f55-b885-627a2bcc3e8c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:36:07.465436 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-387ec784-6874-4f55-b885-627a2bcc3e8c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1567 microversion: 2.1 time: 0.155609 Aug 07 02:36:07.466009 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3526/7520] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:36:07 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:36:07.486697 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-53ac312a-0358-4b7f-93fa-a72e7631170d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:36:07.487303 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-53ac312a-0358-4b7f-93fa-a72e7631170d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:36:07.494093 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-53ac312a-0358-4b7f-93fa-a72e7631170d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:07.494578 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-53ac312a-0358-4b7f-93fa-a72e7631170d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:07.495024 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-53ac312a-0358-4b7f-93fa-a72e7631170d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:07.495724 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-53ac312a-0358-4b7f-93fa-a72e7631170d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:07.496213 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-53ac312a-0358-4b7f-93fa-a72e7631170d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:07.496648 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-53ac312a-0358-4b7f-93fa-a72e7631170d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:07.524564 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-53ac312a-0358-4b7f-93fa-a72e7631170d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119516) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 07 02:36:07.590562 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-53ac312a-0358-4b7f-93fa-a72e7631170d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "POST /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7/action" status: 202 len: 0 microversion: 2.1 time: 0.107804 Aug 07 02:36:07.591528 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3995/7521] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:36:07 2022] POST /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:36:07.601057 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-1de758ea-8db8-450c-ad9e-b535607aa10c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:36:07.612534 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-1de758ea-8db8-450c-ad9e-b535607aa10c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:36:07.618738 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1de758ea-8db8-450c-ad9e-b535607aa10c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:07.619235 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1de758ea-8db8-450c-ad9e-b535607aa10c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:07.619678 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1de758ea-8db8-450c-ad9e-b535607aa10c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:07.620679 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1de758ea-8db8-450c-ad9e-b535607aa10c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:07.620874 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1de758ea-8db8-450c-ad9e-b535607aa10c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:07.621496 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-1de758ea-8db8-450c-ad9e-b535607aa10c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:07.822785 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-1de758ea-8db8-450c-ad9e-b535607aa10c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:36:07.831551 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-1de758ea-8db8-450c-ad9e-b535607aa10c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1515 microversion: 2.1 time: 0.235567 Aug 07 02:36:07.832156 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3527/7522] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:36:07 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1515 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:36:07.889647 n-d-master-1 devstack@n-api.service[119517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 02:36:07.889808 n-d-master-1 devstack@n-api.service[119517]: Sun Aug 7 02:36:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 02:36:08.031834 n-d-master-1 devstack@n-api.service[119517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 07 02:36:08.032063 n-d-master-1 devstack@n-api.service[119517]: Sun Aug 7 02:36:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 02:36:08.115488 n-d-master-1 devstack@n-api.service[119516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 02:36:08.115658 n-d-master-1 devstack@n-api.service[119516]: Sun Aug 7 02:36:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 02:36:08.853829 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-def910e5-8a2c-47f7-ab13-4dfce03dc806 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:36:08.854489 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-def910e5-8a2c-47f7-ab13-4dfce03dc806 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:36:08.863465 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-def910e5-8a2c-47f7-ab13-4dfce03dc806 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:08.864275 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-def910e5-8a2c-47f7-ab13-4dfce03dc806 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:08.864965 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-def910e5-8a2c-47f7-ab13-4dfce03dc806 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:08.866068 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-def910e5-8a2c-47f7-ab13-4dfce03dc806 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:08.866789 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-def910e5-8a2c-47f7-ab13-4dfce03dc806 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:08.867461 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-def910e5-8a2c-47f7-ab13-4dfce03dc806 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:09.021892 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-def910e5-8a2c-47f7-ab13-4dfce03dc806 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:36:09.029662 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-def910e5-8a2c-47f7-ab13-4dfce03dc806 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1517 microversion: 2.1 time: 0.180629 Aug 07 02:36:09.030234 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3996/7523] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:36:08 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1517 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:36:10.053182 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f9f55f39-50fd-45c3-ad34-3928c73ffb7b tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:36:10.053743 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f9f55f39-50fd-45c3-ad34-3928c73ffb7b tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:36:10.061552 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f9f55f39-50fd-45c3-ad34-3928c73ffb7b tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:10.061987 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f9f55f39-50fd-45c3-ad34-3928c73ffb7b tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:10.062427 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f9f55f39-50fd-45c3-ad34-3928c73ffb7b tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:10.063124 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f9f55f39-50fd-45c3-ad34-3928c73ffb7b tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:10.063582 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f9f55f39-50fd-45c3-ad34-3928c73ffb7b tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:10.064037 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f9f55f39-50fd-45c3-ad34-3928c73ffb7b tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:10.188395 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-d732595a-1099-49c0-8334-8a66e1fbc523 req-30624205-654a-4a55-a6c1-ec803a8de3f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c3eb949-f7ec-43ff-9328-02a19b47a4d7", "name": "network-vif-unplugged", "status": "completed", "tag": "891e45e6-3b39-48ea-9fd6-d0c85693b222"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:36:10.202089 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d732595a-1099-49c0-8334-8a66e1fbc523 req-30624205-654a-4a55-a6c1-ec803a8de3f2 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:10.202927 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d732595a-1099-49c0-8334-8a66e1fbc523 req-30624205-654a-4a55-a6c1-ec803a8de3f2 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:10.203762 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d732595a-1099-49c0-8334-8a66e1fbc523 req-30624205-654a-4a55-a6c1-ec803a8de3f2 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:10.207896 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f9f55f39-50fd-45c3-ad34-3928c73ffb7b tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:36:10.217162 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f9f55f39-50fd-45c3-ad34-3928c73ffb7b tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1517 microversion: 2.1 time: 0.168650 Aug 07 02:36:10.217972 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.compute.server_external_events [req-d732595a-1099-49c0-8334-8a66e1fbc523 req-30624205-654a-4a55-a6c1-ec803a8de3f2 service nova] Unable to find a host for instance 9c3eb949-f7ec-43ff-9328-02a19b47a4d7. Dropping event network-vif-unplugged {{(pid=119516) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 07 02:36:10.219194 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-d732595a-1099-49c0-8334-8a66e1fbc523 req-30624205-654a-4a55-a6c1-ec803a8de3f2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034659 Aug 07 02:36:10.220584 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3997/7525] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 07 02:36:10.220870 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3528/7525] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:36:10 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1517 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:36:11.238763 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-6063d9cf-b406-43bb-9e45-76aca07107c3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:36:11.239376 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-6063d9cf-b406-43bb-9e45-76aca07107c3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:36:11.246405 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6063d9cf-b406-43bb-9e45-76aca07107c3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:11.246896 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6063d9cf-b406-43bb-9e45-76aca07107c3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:11.247339 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6063d9cf-b406-43bb-9e45-76aca07107c3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:11.248119 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6063d9cf-b406-43bb-9e45-76aca07107c3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:11.248582 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6063d9cf-b406-43bb-9e45-76aca07107c3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:11.249015 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-6063d9cf-b406-43bb-9e45-76aca07107c3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:11.391482 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-6063d9cf-b406-43bb-9e45-76aca07107c3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:36:11.400205 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-6063d9cf-b406-43bb-9e45-76aca07107c3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1517 microversion: 2.1 time: 0.165365 Aug 07 02:36:11.400785 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3529/7526] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:36:11 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:36:12.421482 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-063f62f0-ad5b-49e4-8c8c-aa7792dfec68 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:36:12.422035 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-063f62f0-ad5b-49e4-8c8c-aa7792dfec68 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:36:12.429375 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-063f62f0-ad5b-49e4-8c8c-aa7792dfec68 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:12.429874 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-063f62f0-ad5b-49e4-8c8c-aa7792dfec68 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:12.430334 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-063f62f0-ad5b-49e4-8c8c-aa7792dfec68 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:12.431053 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-063f62f0-ad5b-49e4-8c8c-aa7792dfec68 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:12.431526 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-063f62f0-ad5b-49e4-8c8c-aa7792dfec68 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:12.431998 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-063f62f0-ad5b-49e4-8c8c-aa7792dfec68 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:12.572666 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-063f62f0-ad5b-49e4-8c8c-aa7792dfec68 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:36:12.580835 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-063f62f0-ad5b-49e4-8c8c-aa7792dfec68 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1517 microversion: 2.1 time: 0.162888 Aug 07 02:36:12.581404 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3998/7527] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:36:12 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:36:13.602553 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-eeb0896c-bd78-416f-8f10-e24fa7a9debe tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:36:13.603169 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-eeb0896c-bd78-416f-8f10-e24fa7a9debe tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:36:13.610324 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eeb0896c-bd78-416f-8f10-e24fa7a9debe tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:13.610819 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eeb0896c-bd78-416f-8f10-e24fa7a9debe tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:13.611257 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eeb0896c-bd78-416f-8f10-e24fa7a9debe tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:13.612820 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eeb0896c-bd78-416f-8f10-e24fa7a9debe tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:13.613337 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eeb0896c-bd78-416f-8f10-e24fa7a9debe tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:13.613772 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eeb0896c-bd78-416f-8f10-e24fa7a9debe tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:13.842497 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-eeb0896c-bd78-416f-8f10-e24fa7a9debe tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:36:13.852293 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-eeb0896c-bd78-416f-8f10-e24fa7a9debe tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1573 microversion: 2.1 time: 0.253549 Aug 07 02:36:13.852894 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3530/7528] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:36:13 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1573 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:36:14.381099 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-d47f1b5d-cc5c-4972-8ec9-4590a468bc0a req-7c51ef9f-e71d-4975-a579-d7a71f81f983 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c3eb949-f7ec-43ff-9328-02a19b47a4d7", "tag": "891e45e6-3b39-48ea-9fd6-d0c85693b222"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:36:14.392055 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d47f1b5d-cc5c-4972-8ec9-4590a468bc0a req-7c51ef9f-e71d-4975-a579-d7a71f81f983 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:14.393183 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d47f1b5d-cc5c-4972-8ec9-4590a468bc0a req-7c51ef9f-e71d-4975-a579-d7a71f81f983 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:14.393609 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-d47f1b5d-cc5c-4972-8ec9-4590a468bc0a req-7c51ef9f-e71d-4975-a579-d7a71f81f983 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:14.405863 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-d47f1b5d-cc5c-4972-8ec9-4590a468bc0a req-7c51ef9f-e71d-4975-a579-d7a71f81f983 service nova] Creating event network-changed:891e45e6-3b39-48ea-9fd6-d0c85693b222 for instance 9c3eb949-f7ec-43ff-9328-02a19b47a4d7 on n-h1-master-1 Aug 07 02:36:14.411052 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-d47f1b5d-cc5c-4972-8ec9-4590a468bc0a req-7c51ef9f-e71d-4975-a579-d7a71f81f983 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034071 Aug 07 02:36:14.411658 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 3999/7529] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:36:14.874179 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-493d9f5e-3535-4704-a603-dcc6e44ddd34 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:36:14.874832 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-493d9f5e-3535-4704-a603-dcc6e44ddd34 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:36:14.882265 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-493d9f5e-3535-4704-a603-dcc6e44ddd34 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:14.882818 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-493d9f5e-3535-4704-a603-dcc6e44ddd34 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:14.883264 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-493d9f5e-3535-4704-a603-dcc6e44ddd34 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:14.883996 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-493d9f5e-3535-4704-a603-dcc6e44ddd34 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:14.884878 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-493d9f5e-3535-4704-a603-dcc6e44ddd34 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:14.884878 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-493d9f5e-3535-4704-a603-dcc6e44ddd34 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:15.027425 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-493d9f5e-3535-4704-a603-dcc6e44ddd34 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:36:15.035806 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-493d9f5e-3535-4704-a603-dcc6e44ddd34 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1573 microversion: 2.1 time: 0.165571 Aug 07 02:36:15.036444 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3531/7530] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:36:14 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:36:16.058876 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-7efa32b6-f31a-490a-97af-f46c47989dd5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:36:16.059589 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-7efa32b6-f31a-490a-97af-f46c47989dd5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:36:16.066510 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7efa32b6-f31a-490a-97af-f46c47989dd5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:16.067007 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7efa32b6-f31a-490a-97af-f46c47989dd5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:16.067462 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7efa32b6-f31a-490a-97af-f46c47989dd5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:16.068192 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7efa32b6-f31a-490a-97af-f46c47989dd5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:16.068667 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7efa32b6-f31a-490a-97af-f46c47989dd5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:16.069106 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-7efa32b6-f31a-490a-97af-f46c47989dd5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:16.201889 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-7efa32b6-f31a-490a-97af-f46c47989dd5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:36:16.209479 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-7efa32b6-f31a-490a-97af-f46c47989dd5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1573 microversion: 2.1 time: 0.155715 Aug 07 02:36:16.210058 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4000/7531] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:36:16 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:36:17.230886 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bd68d85f-01e2-4b68-9f35-17f4d762f8e5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:36:17.231499 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bd68d85f-01e2-4b68-9f35-17f4d762f8e5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:36:17.238436 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bd68d85f-01e2-4b68-9f35-17f4d762f8e5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:17.238862 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bd68d85f-01e2-4b68-9f35-17f4d762f8e5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:17.239300 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bd68d85f-01e2-4b68-9f35-17f4d762f8e5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:17.240031 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bd68d85f-01e2-4b68-9f35-17f4d762f8e5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:17.240491 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bd68d85f-01e2-4b68-9f35-17f4d762f8e5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:17.240922 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bd68d85f-01e2-4b68-9f35-17f4d762f8e5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:17.370302 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-bd68d85f-01e2-4b68-9f35-17f4d762f8e5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:36:17.378310 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bd68d85f-01e2-4b68-9f35-17f4d762f8e5 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1573 microversion: 2.1 time: 0.151668 Aug 07 02:36:17.378873 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3532/7532] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:36:17 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:36:18.399038 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2bf487f5-72b0-4c0b-8dca-039f9fdff104 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:36:18.399689 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2bf487f5-72b0-4c0b-8dca-039f9fdff104 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:36:18.406583 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2bf487f5-72b0-4c0b-8dca-039f9fdff104 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:18.407074 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2bf487f5-72b0-4c0b-8dca-039f9fdff104 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:18.407517 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2bf487f5-72b0-4c0b-8dca-039f9fdff104 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:18.408893 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2bf487f5-72b0-4c0b-8dca-039f9fdff104 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:18.409357 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2bf487f5-72b0-4c0b-8dca-039f9fdff104 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:18.409794 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2bf487f5-72b0-4c0b-8dca-039f9fdff104 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:18.543568 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2bf487f5-72b0-4c0b-8dca-039f9fdff104 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:36:18.551138 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2bf487f5-72b0-4c0b-8dca-039f9fdff104 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1573 microversion: 2.1 time: 0.155988 Aug 07 02:36:18.551695 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4001/7533] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:36:18 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:36:19.572415 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8a9c43fd-2d15-4921-ba26-0fa244c5f87e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:36:19.573040 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8a9c43fd-2d15-4921-ba26-0fa244c5f87e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:36:19.579954 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a9c43fd-2d15-4921-ba26-0fa244c5f87e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:19.580443 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a9c43fd-2d15-4921-ba26-0fa244c5f87e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:19.580883 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a9c43fd-2d15-4921-ba26-0fa244c5f87e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:19.581585 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a9c43fd-2d15-4921-ba26-0fa244c5f87e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:19.582043 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a9c43fd-2d15-4921-ba26-0fa244c5f87e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:19.582473 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-8a9c43fd-2d15-4921-ba26-0fa244c5f87e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:19.717069 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8a9c43fd-2d15-4921-ba26-0fa244c5f87e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:36:19.725115 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8a9c43fd-2d15-4921-ba26-0fa244c5f87e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1573 microversion: 2.1 time: 0.156646 Aug 07 02:36:19.725691 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3533/7534] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:36:19 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:36:20.747022 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-62829b53-7c1a-4945-9c9b-bbec0dca0029 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:36:20.747656 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-62829b53-7c1a-4945-9c9b-bbec0dca0029 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:36:20.754743 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62829b53-7c1a-4945-9c9b-bbec0dca0029 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:20.755240 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62829b53-7c1a-4945-9c9b-bbec0dca0029 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:20.755695 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62829b53-7c1a-4945-9c9b-bbec0dca0029 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:20.756438 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62829b53-7c1a-4945-9c9b-bbec0dca0029 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:20.756916 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62829b53-7c1a-4945-9c9b-bbec0dca0029 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:20.757360 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62829b53-7c1a-4945-9c9b-bbec0dca0029 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:20.886687 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-62829b53-7c1a-4945-9c9b-bbec0dca0029 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:36:20.890275 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:36:20.895590 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-62829b53-7c1a-4945-9c9b-bbec0dca0029 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1573 microversion: 2.1 time: 0.152575 Aug 07 02:36:20.896195 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4002/7535] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:36:20 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:36:21.916249 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-06889663-e531-4900-b8f3-4ab3f4b01233 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:36:21.916861 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-06889663-e531-4900-b8f3-4ab3f4b01233 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:36:21.923647 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06889663-e531-4900-b8f3-4ab3f4b01233 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:21.924739 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06889663-e531-4900-b8f3-4ab3f4b01233 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:21.925169 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06889663-e531-4900-b8f3-4ab3f4b01233 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:21.925851 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06889663-e531-4900-b8f3-4ab3f4b01233 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:21.926327 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06889663-e531-4900-b8f3-4ab3f4b01233 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:21.926746 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-06889663-e531-4900-b8f3-4ab3f4b01233 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:22.055477 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-06889663-e531-4900-b8f3-4ab3f4b01233 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:36:22.063065 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-06889663-e531-4900-b8f3-4ab3f4b01233 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1573 microversion: 2.1 time: 0.150702 Aug 07 02:36:22.063638 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3534/7536] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:36:21 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:36:23.084786 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-1d4975c3-ebef-469e-bd3e-cf844a647e4d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:36:23.085410 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-1d4975c3-ebef-469e-bd3e-cf844a647e4d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:36:23.088050 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:36:23.095069 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d4975c3-ebef-469e-bd3e-cf844a647e4d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:23.095592 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d4975c3-ebef-469e-bd3e-cf844a647e4d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:23.096102 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d4975c3-ebef-469e-bd3e-cf844a647e4d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:23.096855 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d4975c3-ebef-469e-bd3e-cf844a647e4d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:23.097331 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d4975c3-ebef-469e-bd3e-cf844a647e4d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:23.097775 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-1d4975c3-ebef-469e-bd3e-cf844a647e4d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:23.231842 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-1d4975c3-ebef-469e-bd3e-cf844a647e4d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:36:23.240390 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-1d4975c3-ebef-469e-bd3e-cf844a647e4d tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1573 microversion: 2.1 time: 0.160170 Aug 07 02:36:23.240965 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4003/7537] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:36:23 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1573 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:36:24.261760 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2f6e3522-11f1-496e-a223-e52ada2c92a3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:36:24.262315 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2f6e3522-11f1-496e-a223-e52ada2c92a3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:36:24.264986 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=31 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:36:24.270874 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f6e3522-11f1-496e-a223-e52ada2c92a3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:24.271359 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f6e3522-11f1-496e-a223-e52ada2c92a3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:24.271803 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f6e3522-11f1-496e-a223-e52ada2c92a3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:24.272538 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f6e3522-11f1-496e-a223-e52ada2c92a3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:24.273003 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f6e3522-11f1-496e-a223-e52ada2c92a3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:24.273435 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2f6e3522-11f1-496e-a223-e52ada2c92a3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:24.276214 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=91 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:36:24.406016 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2f6e3522-11f1-496e-a223-e52ada2c92a3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:36:24.413627 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2f6e3522-11f1-496e-a223-e52ada2c92a3 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1573 microversion: 2.1 time: 0.155904 Aug 07 02:36:24.414205 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3535/7538] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:36:24 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:36:25.395729 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-40ce6303-9ae7-4700-95c4-733403c28273 req-75a3b014-24a5-4293-a67f-029dd045e976 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c3eb949-f7ec-43ff-9328-02a19b47a4d7", "name": "network-vif-plugged", "status": "completed", "tag": "891e45e6-3b39-48ea-9fd6-d0c85693b222"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:36:25.406905 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-40ce6303-9ae7-4700-95c4-733403c28273 req-75a3b014-24a5-4293-a67f-029dd045e976 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:25.407403 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-40ce6303-9ae7-4700-95c4-733403c28273 req-75a3b014-24a5-4293-a67f-029dd045e976 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:25.407852 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-40ce6303-9ae7-4700-95c4-733403c28273 req-75a3b014-24a5-4293-a67f-029dd045e976 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:25.419534 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-40ce6303-9ae7-4700-95c4-733403c28273 req-75a3b014-24a5-4293-a67f-029dd045e976 service nova] Creating event network-vif-plugged:891e45e6-3b39-48ea-9fd6-d0c85693b222 for instance 9c3eb949-f7ec-43ff-9328-02a19b47a4d7 on n-h1-master-1 Aug 07 02:36:25.424632 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-40ce6303-9ae7-4700-95c4-733403c28273 req-75a3b014-24a5-4293-a67f-029dd045e976 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033308 Aug 07 02:36:25.425228 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4004/7539] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:36:25.435180 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7606b193-aeae-4587-9c87-06118de29080 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:36:25.435809 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7606b193-aeae-4587-9c87-06118de29080 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:36:25.443424 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7606b193-aeae-4587-9c87-06118de29080 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:25.444062 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7606b193-aeae-4587-9c87-06118de29080 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:25.444386 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7606b193-aeae-4587-9c87-06118de29080 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:25.445088 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7606b193-aeae-4587-9c87-06118de29080 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:25.445547 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7606b193-aeae-4587-9c87-06118de29080 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:25.446003 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7606b193-aeae-4587-9c87-06118de29080 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:25.588238 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7606b193-aeae-4587-9c87-06118de29080 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:36:25.595988 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7606b193-aeae-4587-9c87-06118de29080 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1573 microversion: 2.1 time: 0.165330 Aug 07 02:36:25.596825 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3536/7540] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:36:25 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:36:26.618025 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-db6ab245-9e83-4e8f-8931-654bcd5b7321 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:36:26.618745 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-db6ab245-9e83-4e8f-8931-654bcd5b7321 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:36:26.625863 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-db6ab245-9e83-4e8f-8931-654bcd5b7321 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:26.626366 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-db6ab245-9e83-4e8f-8931-654bcd5b7321 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:26.626822 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-db6ab245-9e83-4e8f-8931-654bcd5b7321 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:26.627534 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-db6ab245-9e83-4e8f-8931-654bcd5b7321 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:26.628029 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-db6ab245-9e83-4e8f-8931-654bcd5b7321 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:26.628473 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-db6ab245-9e83-4e8f-8931-654bcd5b7321 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:26.770254 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-db6ab245-9e83-4e8f-8931-654bcd5b7321 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:36:26.777885 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-db6ab245-9e83-4e8f-8931-654bcd5b7321 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1573 microversion: 2.1 time: 0.164178 Aug 07 02:36:26.778456 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4005/7541] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:36:26 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1573 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:36:27.799288 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-c7696809-9a84-4aa1-9bff-ae0d0d837cd4 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:36:27.799833 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-c7696809-9a84-4aa1-9bff-ae0d0d837cd4 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:36:27.806748 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7696809-9a84-4aa1-9bff-ae0d0d837cd4 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:27.807231 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7696809-9a84-4aa1-9bff-ae0d0d837cd4 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:27.807671 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7696809-9a84-4aa1-9bff-ae0d0d837cd4 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:27.808405 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7696809-9a84-4aa1-9bff-ae0d0d837cd4 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:36:27.808866 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7696809-9a84-4aa1-9bff-ae0d0d837cd4 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:36:27.809298 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-c7696809-9a84-4aa1-9bff-ae0d0d837cd4 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:36:28.251467 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-c7696809-9a84-4aa1-9bff-ae0d0d837cd4 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:36:28.259105 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-c7696809-9a84-4aa1-9bff-ae0d0d837cd4 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1560 microversion: 2.1 time: 0.464482 Aug 07 02:36:28.259684 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3537/7542] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:36:27 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1560 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:37:38.835400 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=5 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:37:38.836662 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=14 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:37:38.840809 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=5 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:37:38.841269 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-e65aa212-8741-412b-b4a0-26049feb64ab tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:37:38.841517 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e65aa212-8741-412b-b4a0-26049feb64ab tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:37:38.842038 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=17 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:37:38.850432 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e65aa212-8741-412b-b4a0-26049feb64ab tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:37:38.851225 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e65aa212-8741-412b-b4a0-26049feb64ab tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:37:38.851695 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e65aa212-8741-412b-b4a0-26049feb64ab tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:37:38.852450 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e65aa212-8741-412b-b4a0-26049feb64ab tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:37:38.853092 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e65aa212-8741-412b-b4a0-26049feb64ab tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:37:38.853715 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-e65aa212-8741-412b-b4a0-26049feb64ab tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:37:38.880213 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-e65aa212-8741-412b-b4a0-26049feb64ab tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 02:37:38.896830 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-7ec8e380-ecdb-4458-b9d9-4656b49843aa req-f33a6b94-57e8-4733-80fe-56dc7e4516d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c3eb949-f7ec-43ff-9328-02a19b47a4d7", "tag": "891e45e6-3b39-48ea-9fd6-d0c85693b222"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:37:38.908205 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-7ec8e380-ecdb-4458-b9d9-4656b49843aa req-f33a6b94-57e8-4733-80fe-56dc7e4516d9 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:37:38.908205 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-7ec8e380-ecdb-4458-b9d9-4656b49843aa req-f33a6b94-57e8-4733-80fe-56dc7e4516d9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:37:38.908205 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-7ec8e380-ecdb-4458-b9d9-4656b49843aa req-f33a6b94-57e8-4733-80fe-56dc7e4516d9 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:37:38.919187 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-7ec8e380-ecdb-4458-b9d9-4656b49843aa req-f33a6b94-57e8-4733-80fe-56dc7e4516d9 service nova] Creating event network-changed:891e45e6-3b39-48ea-9fd6-d0c85693b222 for instance 9c3eb949-f7ec-43ff-9328-02a19b47a4d7 on n-h1-master-1 Aug 07 02:37:38.924969 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-7ec8e380-ecdb-4458-b9d9-4656b49843aa req-f33a6b94-57e8-4733-80fe-56dc7e4516d9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089846 Aug 07 02:37:38.925573 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3538/7543] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 02:37:38.969444 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-e65aa212-8741-412b-b4a0-26049feb64ab tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 204 len: 0 microversion: 2.1 time: 0.136099 Aug 07 02:37:38.970559 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4006/7544] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 02:37:38 2022] DELETE /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 02:37:38.979914 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e802bdbb-8ac9-4217-9d8d-f9cbd7542676 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:37:38.980982 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e802bdbb-8ac9-4217-9d8d-f9cbd7542676 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:37:38.989010 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e802bdbb-8ac9-4217-9d8d-f9cbd7542676 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:37:38.989497 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e802bdbb-8ac9-4217-9d8d-f9cbd7542676 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:37:38.989941 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e802bdbb-8ac9-4217-9d8d-f9cbd7542676 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:37:38.990763 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e802bdbb-8ac9-4217-9d8d-f9cbd7542676 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:37:38.991223 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e802bdbb-8ac9-4217-9d8d-f9cbd7542676 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:37:38.991645 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e802bdbb-8ac9-4217-9d8d-f9cbd7542676 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:37:39.174212 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e802bdbb-8ac9-4217-9d8d-f9cbd7542676 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:37:39.182073 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e802bdbb-8ac9-4217-9d8d-f9cbd7542676 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1566 microversion: 2.1 time: 0.207063 Aug 07 02:37:39.182651 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3539/7545] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:37:38 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1566 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:37:40.204483 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-f8a5bd04-0faf-496a-9c2b-915185a34832 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:37:40.205194 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-f8a5bd04-0faf-496a-9c2b-915185a34832 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:37:40.212071 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f8a5bd04-0faf-496a-9c2b-915185a34832 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:37:40.212563 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f8a5bd04-0faf-496a-9c2b-915185a34832 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:37:40.213009 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f8a5bd04-0faf-496a-9c2b-915185a34832 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:37:40.213764 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f8a5bd04-0faf-496a-9c2b-915185a34832 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:37:40.214235 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f8a5bd04-0faf-496a-9c2b-915185a34832 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:37:40.214672 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-f8a5bd04-0faf-496a-9c2b-915185a34832 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:37:40.356608 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-f8a5bd04-0faf-496a-9c2b-915185a34832 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:37:40.364591 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-f8a5bd04-0faf-496a-9c2b-915185a34832 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1566 microversion: 2.1 time: 0.164989 Aug 07 02:37:40.365163 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4007/7546] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:37:40 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:37:41.219413 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-eecec12d-0297-4b6e-ba81-bd1f3ab257a0 req-8f786875-28a4-4303-9887-a9d487750c63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c3eb949-f7ec-43ff-9328-02a19b47a4d7", "name": "network-vif-deleted", "tag": "891e45e6-3b39-48ea-9fd6-d0c85693b222"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:37:41.230016 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-eecec12d-0297-4b6e-ba81-bd1f3ab257a0 req-8f786875-28a4-4303-9887-a9d487750c63 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:37:41.230501 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-eecec12d-0297-4b6e-ba81-bd1f3ab257a0 req-8f786875-28a4-4303-9887-a9d487750c63 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:37:41.230939 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-eecec12d-0297-4b6e-ba81-bd1f3ab257a0 req-8f786875-28a4-4303-9887-a9d487750c63 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:37:41.243040 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-eecec12d-0297-4b6e-ba81-bd1f3ab257a0 req-8f786875-28a4-4303-9887-a9d487750c63 service nova] Creating event network-vif-deleted:891e45e6-3b39-48ea-9fd6-d0c85693b222 for instance 9c3eb949-f7ec-43ff-9328-02a19b47a4d7 on n-h1-master-1 Aug 07 02:37:41.248348 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-eecec12d-0297-4b6e-ba81-bd1f3ab257a0 req-8f786875-28a4-4303-9887-a9d487750c63 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033107 Aug 07 02:37:41.248991 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3540/7547] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:37:41.388242 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ae390701-9676-45b4-938c-1abb0f32ba51 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:37:41.388901 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ae390701-9676-45b4-938c-1abb0f32ba51 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:37:41.396447 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ae390701-9676-45b4-938c-1abb0f32ba51 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:37:41.396949 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ae390701-9676-45b4-938c-1abb0f32ba51 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:37:41.397400 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ae390701-9676-45b4-938c-1abb0f32ba51 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:37:41.398119 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ae390701-9676-45b4-938c-1abb0f32ba51 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:37:41.398590 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ae390701-9676-45b4-938c-1abb0f32ba51 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:37:41.399038 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ae390701-9676-45b4-938c-1abb0f32ba51 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:37:41.463405 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ae390701-9676-45b4-938c-1abb0f32ba51 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:37:41.471852 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ae390701-9676-45b4-938c-1abb0f32ba51 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1218 microversion: 2.1 time: 0.087470 Aug 07 02:37:41.472441 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4008/7548] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:37:41 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:37:42.495078 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e72009f3-c8b1-4498-8de5-88e1cb5464ba tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:37:42.495705 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e72009f3-c8b1-4498-8de5-88e1cb5464ba tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:37:42.501998 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e72009f3-c8b1-4498-8de5-88e1cb5464ba tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:37:42.502490 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e72009f3-c8b1-4498-8de5-88e1cb5464ba tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:37:42.502932 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e72009f3-c8b1-4498-8de5-88e1cb5464ba tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:37:42.503635 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e72009f3-c8b1-4498-8de5-88e1cb5464ba tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:37:42.504126 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e72009f3-c8b1-4498-8de5-88e1cb5464ba tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:37:42.504560 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e72009f3-c8b1-4498-8de5-88e1cb5464ba tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:37:42.568397 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e72009f3-c8b1-4498-8de5-88e1cb5464ba tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:37:42.576198 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e72009f3-c8b1-4498-8de5-88e1cb5464ba tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1218 microversion: 2.1 time: 0.086746 Aug 07 02:37:42.576993 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3541/7549] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:37:42 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:37:43.597016 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-17125566-5d88-4f81-be51-6048c9532794 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:37:43.597656 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-17125566-5d88-4f81-be51-6048c9532794 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:37:43.604650 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-17125566-5d88-4f81-be51-6048c9532794 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:37:43.605147 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-17125566-5d88-4f81-be51-6048c9532794 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:37:43.605597 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-17125566-5d88-4f81-be51-6048c9532794 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:37:43.606317 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-17125566-5d88-4f81-be51-6048c9532794 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:37:43.606788 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-17125566-5d88-4f81-be51-6048c9532794 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:37:43.607231 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-17125566-5d88-4f81-be51-6048c9532794 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:37:43.674000 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-17125566-5d88-4f81-be51-6048c9532794 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:37:43.682651 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-17125566-5d88-4f81-be51-6048c9532794 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1218 microversion: 2.1 time: 0.089546 Aug 07 02:37:43.683246 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4009/7550] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:37:43 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:37:44.704511 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-53a0603e-19a0-438b-824a-78bc16ff8d3c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:37:44.705136 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-53a0603e-19a0-438b-824a-78bc16ff8d3c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:37:44.712218 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53a0603e-19a0-438b-824a-78bc16ff8d3c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:37:44.712705 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53a0603e-19a0-438b-824a-78bc16ff8d3c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:37:44.713151 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53a0603e-19a0-438b-824a-78bc16ff8d3c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:37:44.713856 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53a0603e-19a0-438b-824a-78bc16ff8d3c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:37:44.714315 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53a0603e-19a0-438b-824a-78bc16ff8d3c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:37:44.714747 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-53a0603e-19a0-438b-824a-78bc16ff8d3c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:37:44.780277 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-53a0603e-19a0-438b-824a-78bc16ff8d3c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:37:44.788481 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-53a0603e-19a0-438b-824a-78bc16ff8d3c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1218 microversion: 2.1 time: 0.087896 Aug 07 02:37:44.789270 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3542/7551] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:37:44 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:37:45.811189 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4a5ad6ae-c64e-485e-bad0-92d5c7a3c57e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:37:45.812563 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4a5ad6ae-c64e-485e-bad0-92d5c7a3c57e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:37:45.820503 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a5ad6ae-c64e-485e-bad0-92d5c7a3c57e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:37:45.821349 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a5ad6ae-c64e-485e-bad0-92d5c7a3c57e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:37:45.822013 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a5ad6ae-c64e-485e-bad0-92d5c7a3c57e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:37:45.822956 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a5ad6ae-c64e-485e-bad0-92d5c7a3c57e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:37:45.823756 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a5ad6ae-c64e-485e-bad0-92d5c7a3c57e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:37:45.824481 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a5ad6ae-c64e-485e-bad0-92d5c7a3c57e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:37:45.865465 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a5ad6ae-c64e-485e-bad0-92d5c7a3c57e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:37:45.866102 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a5ad6ae-c64e-485e-bad0-92d5c7a3c57e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:37:45.866821 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a5ad6ae-c64e-485e-bad0-92d5c7a3c57e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:37:45.867449 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.objects.instance [None req-4a5ad6ae-c64e-485e-bad0-92d5c7a3c57e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lazy-loading 'fault' on Instance uuid 9c3eb949-f7ec-43ff-9328-02a19b47a4d7 {{(pid=119516) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 02:37:45.910907 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-4a5ad6ae-c64e-485e-bad0-92d5c7a3c57e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6377b5c6f4bc4645a62697b66316fb39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf88ea13f914730a38cef575bd4982d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:37:45.918089 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4a5ad6ae-c64e-485e-bad0-92d5c7a3c57e tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 200 len: 1177 microversion: 2.1 time: 0.111121 Aug 07 02:37:45.918692 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4010/7552] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:37:45 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 1177 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:37:46.938637 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0b11334f-73b4-477d-ac8d-cb72d4d29f4c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:37:46.939263 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0b11334f-73b4-477d-ac8d-cb72d4d29f4c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] [instance: 9c3eb949-f7ec-43ff-9328-02a19b47a4d7] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:37:46.946149 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b11334f-73b4-477d-ac8d-cb72d4d29f4c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:37:46.946638 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b11334f-73b4-477d-ac8d-cb72d4d29f4c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:37:46.947082 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b11334f-73b4-477d-ac8d-cb72d4d29f4c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:37:46.947785 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b11334f-73b4-477d-ac8d-cb72d4d29f4c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:37:46.948266 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b11334f-73b4-477d-ac8d-cb72d4d29f4c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:37:46.948697 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0b11334f-73b4-477d-ac8d-cb72d4d29f4c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:37:46.966347 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.wsgi [None req-0b11334f-73b4-477d-ac8d-cb72d4d29f4c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] HTTP exception thrown: Instance 9c3eb949-f7ec-43ff-9328-02a19b47a4d7 could not be found. Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0b11334f-73b4-477d-ac8d-cb72d4d29f4c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Request method failure captured: Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: request: GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 HTTP/1.1 Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: Accept: application/json Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: Accept-Encoding: identity Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: Connection: close Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: Content-Length: 0 Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: Content-Type: application/json Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: Host: 10.222.0.39 Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: Openstack-System-Scope: None Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: User-Agent: python-urllib3/1.26.11 Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: X-Auth-Token: gAAAAABi7yNtb3g48EXYT5BQ7pZkQK_hfCXUdH6nRRki9OlttQD4iG_xQgeG7-8Q7dIZmBAhGDNnggjEL8EQGpmGVXycbkx_A_v_b8lrCZyC37hwuGhlPUx_wD6GFEIkg0NBp3_aZgANmLuY6P1gNWLntSbnJuTAbssBj_6-paHdOOY1PJ4hp9o Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Id: None Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: X-Domain-Name: None Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: X-Identity-Status: Confirmed Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: X-Is-Admin-Project: True Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Id: default Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: X-Project-Domain-Name: Default Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: X-Project-Id: 3bf88ea13f914730a38cef575bd4982d Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: X-Project-Name: tempest-TestShelveInstance-1993452281 Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: X-Role: reader,member Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: X-Roles: reader,member Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3bf88ea13f914730a38cef575bd4982d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3bf88ea13f914730a38cef575bd4982d", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3bf88ea13f914730a38cef575bd4982d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3bf88ea13f914730a38cef575bd4982d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: X-Tenant: tempest-TestShelveInstance-1993452281 Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Id: 3bf88ea13f914730a38cef575bd4982d Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: X-Tenant-Name: tempest-TestShelveInstance-1993452281 Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: X-User: tempest-TestShelveInstance-1993452281-project Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Id: default Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: X-User-Domain-Name: Default Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: X-User-Id: 6377b5c6f4bc4645a62697b66316fb39 Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: X-User-Name: tempest-TestShelveInstance-1993452281-project Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: method: > Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: exception: Instance 9c3eb949-f7ec-43ff-9328-02a19b47a4d7 could not be found. Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: action_args: {'id': '9c3eb949-f7ec-43ff-9328-02a19b47a4d7'} Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c3eb949-f7ec-43ff-9328-02a19b47a4d7 could not be found. Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c3eb949-f7ec-43ff-9328-02a19b47a4d7 could not be found. Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:37:46.968075 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:37:46.973865 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:37:46.973865 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:37:46.973865 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:37:46.973865 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:37:46.973865 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:37:46.973865 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c3eb949-f7ec-43ff-9328-02a19b47a4d7 could not be found. Aug 07 02:37:46.973865 n-d-master-1 devstack@n-api.service[119517]: ERROR nova.api.openstack.wsgi Aug 07 02:37:46.973865 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0b11334f-73b4-477d-ac8d-cb72d4d29f4c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Returning 404 to user: Instance 9c3eb949-f7ec-43ff-9328-02a19b47a4d7 could not be found. {{(pid=119517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:37:46.973865 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0b11334f-73b4-477d-ac8d-cb72d4d29f4c tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7" status: 404 len: 111 microversion: 2.1 time: 0.034814 Aug 07 02:37:46.973865 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3543/7553] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:37:46 2022] GET /compute/v2.1/servers/9c3eb949-f7ec-43ff-9328-02a19b47a4d7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:37:47.142357 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-bf15fe42-599a-4481-a0d6-ec866fc63853 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] Calling method '.version_select at 0x7f9e298eed30>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:37:47.169975 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-bf15fe42-599a-4481-a0d6-ec866fc63853 tempest-TestShelveInstance-1993452281 tempest-TestShelveInstance-1993452281-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-810595272" status: 202 len: 0 microversion: 2.1 time: 0.033213 Aug 07 02:37:47.170606 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4011/7554] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Aug 7 02:37:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-810595272 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:38:04.145416 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=12 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:38:04.146229 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=24 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:38:04.377793 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-79e473ef-3148-4e3c-8b51-5f83ca8cea8c tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Action: 'create', calling method: .version_select at 0x7f9e29843700>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-236322405", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYh/zJ51prvFTmNxw7mNa2Q9i6Fz/BBIeP4ZCFfG4O72fUsHqrRqaaC7TOkVtfU8ymezzoKqeumrXa2uZzfmkcvF2kGUm/5hIqVpsErh4ujx815ETqetHYPEhj29bj5Qg=="}} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:38:04.401804 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-79e473ef-3148-4e3c-8b51-5f83ca8cea8c tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Getting quotas for project a1518999779440e38b3796e5bf91c262. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:38:04.409585 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.quota [None req-79e473ef-3148-4e3c-8b51-5f83ca8cea8c tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Getting quotas for user 1755f644c416482c955baa17a4b21f43 and project a1518999779440e38b3796e5bf91c262. Resources: {'key_pairs'} {{(pid=119517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:38:04.448413 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-79e473ef-3148-4e3c-8b51-5f83ca8cea8c tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.309054 Aug 07 02:38:04.452046 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3544/7555] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Aug 7 02:38:04 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:38:05.422829 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:38:05.423731 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:38:05.428665 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fb3fcc7d-9d69-4fcf-9551-728e7a9046e1 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1871711477", "imageRef": "e825bd61-bf05-4bd4-aa72-78daf2231731", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-236322405", "security_groups": [{"name": "tempest-secgroup-smoke-243592931"}], "networks": [{"uuid": "66411885-1693-4deb-9082-7541340fc047"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:38:05.541280 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-fb3fcc7d-9d69-4fcf-9551-728e7a9046e1 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] validate_networks() for [('66411885-1693-4deb-9082-7541340fc047', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 02:38:06.051625 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-fb3fcc7d-9d69-4fcf-9551-728e7a9046e1 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 02:38:06.052143 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-fb3fcc7d-9d69-4fcf-9551-728e7a9046e1 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 02:38:06.052610 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-fb3fcc7d-9d69-4fcf-9551-728e7a9046e1 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 02:38:06.053095 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-fb3fcc7d-9d69-4fcf-9551-728e7a9046e1 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 02:38:06.053720 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-fb3fcc7d-9d69-4fcf-9551-728e7a9046e1 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 02:38:06.064022 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fb3fcc7d-9d69-4fcf-9551-728e7a9046e1 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:38:06.064815 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fb3fcc7d-9d69-4fcf-9551-728e7a9046e1 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:38:06.065273 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fb3fcc7d-9d69-4fcf-9551-728e7a9046e1 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:38:06.066038 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fb3fcc7d-9d69-4fcf-9551-728e7a9046e1 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:38:06.066516 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fb3fcc7d-9d69-4fcf-9551-728e7a9046e1 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:38:06.066972 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fb3fcc7d-9d69-4fcf-9551-728e7a9046e1 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:38:06.085441 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-fb3fcc7d-9d69-4fcf-9551-728e7a9046e1 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Getting quotas for project a1518999779440e38b3796e5bf91c262. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:38:06.091120 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-fb3fcc7d-9d69-4fcf-9551-728e7a9046e1 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Getting quotas for user 1755f644c416482c955baa17a4b21f43 and project a1518999779440e38b3796e5bf91c262. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:38:06.104077 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fb3fcc7d-9d69-4fcf-9551-728e7a9046e1 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 02:38:06.106393 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fb3fcc7d-9d69-4fcf-9551-728e7a9046e1 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 59248039-324a-42af-8958-09f5c762afbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e825bd61-bf05-4bd4-aa72-78daf2231731',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 02:38:06.155528 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fb3fcc7d-9d69-4fcf-9551-728e7a9046e1 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.734946 Aug 07 02:38:06.156404 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4012/7556] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 02:38:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 02:38:06.167342 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-ba8d2958-b544-45cf-b542-1abdfb8b54e8 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:38:06.168000 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-ba8d2958-b544-45cf-b542-1abdfb8b54e8 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 59248039-324a-42af-8958-09f5c762afbd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:38:06.231568 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-ba8d2958-b544-45cf-b542-1abdfb8b54e8 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1755f644c416482c955baa17a4b21f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1518999779440e38b3796e5bf91c262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:38:06.239666 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-ba8d2958-b544-45cf-b542-1abdfb8b54e8 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "GET /compute/v2.1/servers/59248039-324a-42af-8958-09f5c762afbd" status: 200 len: 1248 microversion: 2.1 time: 0.076269 Aug 07 02:38:06.240278 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3545/7557] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:38:06 2022] GET /compute/v2.1/servers/59248039-324a-42af-8958-09f5c762afbd => generated 1248 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:38:07.261523 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-dd80603b-1697-40e0-9631-63a91cbb70ae tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:38:07.262066 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-dd80603b-1697-40e0-9631-63a91cbb70ae tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 59248039-324a-42af-8958-09f5c762afbd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:38:07.271905 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd80603b-1697-40e0-9631-63a91cbb70ae tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:38:07.272487 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd80603b-1697-40e0-9631-63a91cbb70ae tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:38:07.272937 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd80603b-1697-40e0-9631-63a91cbb70ae tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:38:07.273865 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd80603b-1697-40e0-9631-63a91cbb70ae tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:38:07.274484 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd80603b-1697-40e0-9631-63a91cbb70ae tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:38:07.274985 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-dd80603b-1697-40e0-9631-63a91cbb70ae tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:38:07.338199 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-dd80603b-1697-40e0-9631-63a91cbb70ae tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1755f644c416482c955baa17a4b21f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1518999779440e38b3796e5bf91c262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:38:07.346201 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-dd80603b-1697-40e0-9631-63a91cbb70ae tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "GET /compute/v2.1/servers/59248039-324a-42af-8958-09f5c762afbd" status: 200 len: 1300 microversion: 2.1 time: 0.089461 Aug 07 02:38:07.347133 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4013/7558] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:38:07 2022] GET /compute/v2.1/servers/59248039-324a-42af-8958-09f5c762afbd => generated 1300 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:38:08.370770 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-eac9b1c6-7dbc-4cfe-b5c4-bd9a561fe5e7 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:38:08.372770 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-eac9b1c6-7dbc-4cfe-b5c4-bd9a561fe5e7 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 59248039-324a-42af-8958-09f5c762afbd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:38:08.383194 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eac9b1c6-7dbc-4cfe-b5c4-bd9a561fe5e7 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:38:08.384463 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eac9b1c6-7dbc-4cfe-b5c4-bd9a561fe5e7 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:38:08.385082 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eac9b1c6-7dbc-4cfe-b5c4-bd9a561fe5e7 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:38:08.385973 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eac9b1c6-7dbc-4cfe-b5c4-bd9a561fe5e7 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:38:08.387281 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eac9b1c6-7dbc-4cfe-b5c4-bd9a561fe5e7 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:38:08.387973 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-eac9b1c6-7dbc-4cfe-b5c4-bd9a561fe5e7 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:38:08.896890 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-eac9b1c6-7dbc-4cfe-b5c4-bd9a561fe5e7 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1755f644c416482c955baa17a4b21f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1518999779440e38b3796e5bf91c262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:38:08.904724 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-eac9b1c6-7dbc-4cfe-b5c4-bd9a561fe5e7 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "GET /compute/v2.1/servers/59248039-324a-42af-8958-09f5c762afbd" status: 200 len: 1373 microversion: 2.1 time: 0.538686 Aug 07 02:38:08.905307 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3546/7559] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:38:08 2022] GET /compute/v2.1/servers/59248039-324a-42af-8958-09f5c762afbd => generated 1373 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:38:09.226832 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-50972f48-c2c6-4994-8f6f-badcc78d81fc req-4808db51-e547-4cd9-9567-ea57a3193241 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59248039-324a-42af-8958-09f5c762afbd", "tag": "df88941e-b49b-4ae5-97f5-50d885da0f51"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:38:09.239790 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-50972f48-c2c6-4994-8f6f-badcc78d81fc req-4808db51-e547-4cd9-9567-ea57a3193241 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:38:09.240335 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-50972f48-c2c6-4994-8f6f-badcc78d81fc req-4808db51-e547-4cd9-9567-ea57a3193241 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:38:09.241091 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-50972f48-c2c6-4994-8f6f-badcc78d81fc req-4808db51-e547-4cd9-9567-ea57a3193241 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:38:09.255734 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-50972f48-c2c6-4994-8f6f-badcc78d81fc req-4808db51-e547-4cd9-9567-ea57a3193241 service nova] Creating event network-changed:df88941e-b49b-4ae5-97f5-50d885da0f51 for instance 59248039-324a-42af-8958-09f5c762afbd on n-h1-master-1 Aug 07 02:38:09.261374 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-50972f48-c2c6-4994-8f6f-badcc78d81fc req-4808db51-e547-4cd9-9567-ea57a3193241 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038329 Aug 07 02:38:09.262291 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4014/7560] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:38:09.925780 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-37ec723c-ef94-47f0-9a9f-915247c202fa tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:38:09.926355 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-37ec723c-ef94-47f0-9a9f-915247c202fa tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 59248039-324a-42af-8958-09f5c762afbd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:38:09.933309 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37ec723c-ef94-47f0-9a9f-915247c202fa tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:38:09.933819 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37ec723c-ef94-47f0-9a9f-915247c202fa tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:38:09.934238 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37ec723c-ef94-47f0-9a9f-915247c202fa tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:38:09.934936 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37ec723c-ef94-47f0-9a9f-915247c202fa tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:38:09.935395 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37ec723c-ef94-47f0-9a9f-915247c202fa tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:38:09.935826 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-37ec723c-ef94-47f0-9a9f-915247c202fa tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:38:10.072501 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-37ec723c-ef94-47f0-9a9f-915247c202fa tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1755f644c416482c955baa17a4b21f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1518999779440e38b3796e5bf91c262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:38:10.079971 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-37ec723c-ef94-47f0-9a9f-915247c202fa tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "GET /compute/v2.1/servers/59248039-324a-42af-8958-09f5c762afbd" status: 200 len: 1373 microversion: 2.1 time: 0.158173 Aug 07 02:38:10.080546 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3547/7561] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:38:09 2022] GET /compute/v2.1/servers/59248039-324a-42af-8958-09f5c762afbd => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:38:11.102940 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-3f4f2d30-4d61-4f08-9d60-ce9ea2020750 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:38:11.103588 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-3f4f2d30-4d61-4f08-9d60-ce9ea2020750 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 59248039-324a-42af-8958-09f5c762afbd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:38:11.110041 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f4f2d30-4d61-4f08-9d60-ce9ea2020750 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:38:11.110528 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f4f2d30-4d61-4f08-9d60-ce9ea2020750 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:38:11.110973 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f4f2d30-4d61-4f08-9d60-ce9ea2020750 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:38:11.111672 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f4f2d30-4d61-4f08-9d60-ce9ea2020750 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:38:11.112160 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f4f2d30-4d61-4f08-9d60-ce9ea2020750 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:38:11.113241 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-3f4f2d30-4d61-4f08-9d60-ce9ea2020750 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:38:11.246231 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-3f4f2d30-4d61-4f08-9d60-ce9ea2020750 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1755f644c416482c955baa17a4b21f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1518999779440e38b3796e5bf91c262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:38:11.253790 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-3f4f2d30-4d61-4f08-9d60-ce9ea2020750 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "GET /compute/v2.1/servers/59248039-324a-42af-8958-09f5c762afbd" status: 200 len: 1373 microversion: 2.1 time: 0.155972 Aug 07 02:38:11.254352 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4015/7562] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:38:11 2022] GET /compute/v2.1/servers/59248039-324a-42af-8958-09f5c762afbd => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:38:12.274598 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-51b82221-8c8c-42dd-a0d1-0bdd9792ef6e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:38:12.275349 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-51b82221-8c8c-42dd-a0d1-0bdd9792ef6e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 59248039-324a-42af-8958-09f5c762afbd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:38:12.282643 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-51b82221-8c8c-42dd-a0d1-0bdd9792ef6e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:38:12.283131 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-51b82221-8c8c-42dd-a0d1-0bdd9792ef6e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:38:12.283571 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-51b82221-8c8c-42dd-a0d1-0bdd9792ef6e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:38:12.284900 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-51b82221-8c8c-42dd-a0d1-0bdd9792ef6e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:38:12.285425 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-51b82221-8c8c-42dd-a0d1-0bdd9792ef6e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:38:12.285867 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-51b82221-8c8c-42dd-a0d1-0bdd9792ef6e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:38:12.420358 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-51b82221-8c8c-42dd-a0d1-0bdd9792ef6e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1755f644c416482c955baa17a4b21f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1518999779440e38b3796e5bf91c262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:38:12.428647 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-51b82221-8c8c-42dd-a0d1-0bdd9792ef6e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "GET /compute/v2.1/servers/59248039-324a-42af-8958-09f5c762afbd" status: 200 len: 1373 microversion: 2.1 time: 0.157988 Aug 07 02:38:12.429219 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3548/7563] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:38:12 2022] GET /compute/v2.1/servers/59248039-324a-42af-8958-09f5c762afbd => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:38:13.448521 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-09bbec7c-96de-465f-bb98-b106d9dd7793 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:38:13.449154 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-09bbec7c-96de-465f-bb98-b106d9dd7793 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 59248039-324a-42af-8958-09f5c762afbd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:38:13.456136 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-09bbec7c-96de-465f-bb98-b106d9dd7793 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:38:13.456682 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-09bbec7c-96de-465f-bb98-b106d9dd7793 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:38:13.457134 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-09bbec7c-96de-465f-bb98-b106d9dd7793 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:38:13.457843 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-09bbec7c-96de-465f-bb98-b106d9dd7793 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:38:13.458313 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-09bbec7c-96de-465f-bb98-b106d9dd7793 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:38:13.458756 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-09bbec7c-96de-465f-bb98-b106d9dd7793 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:38:13.639305 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-09bbec7c-96de-465f-bb98-b106d9dd7793 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1755f644c416482c955baa17a4b21f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1518999779440e38b3796e5bf91c262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:38:13.647891 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-09bbec7c-96de-465f-bb98-b106d9dd7793 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "GET /compute/v2.1/servers/59248039-324a-42af-8958-09f5c762afbd" status: 200 len: 1373 microversion: 2.1 time: 0.203027 Aug 07 02:38:13.648775 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4016/7564] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:38:13 2022] GET /compute/v2.1/servers/59248039-324a-42af-8958-09f5c762afbd => generated 1373 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:38:14.037164 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-f6cf25ce-9a8f-4f18-896b-64cd26796ea0 req-518a0ec0-a305-4a71-a53a-3722a447a934 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59248039-324a-42af-8958-09f5c762afbd", "name": "network-vif-plugged", "status": "completed", "tag": "df88941e-b49b-4ae5-97f5-50d885da0f51"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:38:14.048804 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f6cf25ce-9a8f-4f18-896b-64cd26796ea0 req-518a0ec0-a305-4a71-a53a-3722a447a934 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:38:14.049280 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f6cf25ce-9a8f-4f18-896b-64cd26796ea0 req-518a0ec0-a305-4a71-a53a-3722a447a934 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:38:14.049751 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f6cf25ce-9a8f-4f18-896b-64cd26796ea0 req-518a0ec0-a305-4a71-a53a-3722a447a934 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:38:14.062448 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-f6cf25ce-9a8f-4f18-896b-64cd26796ea0 req-518a0ec0-a305-4a71-a53a-3722a447a934 service nova] Creating event network-vif-plugged:df88941e-b49b-4ae5-97f5-50d885da0f51 for instance 59248039-324a-42af-8958-09f5c762afbd on n-h1-master-1 Aug 07 02:38:14.067468 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-f6cf25ce-9a8f-4f18-896b-64cd26796ea0 req-518a0ec0-a305-4a71-a53a-3722a447a934 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093125 Aug 07 02:38:14.068153 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3549/7565] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:38:14.672406 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-0f547008-c734-4967-8c2c-8c206c220f09 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:38:14.672949 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-0f547008-c734-4967-8c2c-8c206c220f09 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 59248039-324a-42af-8958-09f5c762afbd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:38:14.679828 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f547008-c734-4967-8c2c-8c206c220f09 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:38:14.680358 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f547008-c734-4967-8c2c-8c206c220f09 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:38:14.680811 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f547008-c734-4967-8c2c-8c206c220f09 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:38:14.681524 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f547008-c734-4967-8c2c-8c206c220f09 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:38:14.681999 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f547008-c734-4967-8c2c-8c206c220f09 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:38:14.682475 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-0f547008-c734-4967-8c2c-8c206c220f09 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:38:14.814437 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-0f547008-c734-4967-8c2c-8c206c220f09 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1755f644c416482c955baa17a4b21f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1518999779440e38b3796e5bf91c262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:38:14.822553 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-0f547008-c734-4967-8c2c-8c206c220f09 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "GET /compute/v2.1/servers/59248039-324a-42af-8958-09f5c762afbd" status: 200 len: 1373 microversion: 2.1 time: 0.154130 Aug 07 02:38:14.823135 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4017/7566] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:38:14 2022] GET /compute/v2.1/servers/59248039-324a-42af-8958-09f5c762afbd => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:38:15.845652 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-f683600f-3720-4676-a628-71713e27db99 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:38:15.846423 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-f683600f-3720-4676-a628-71713e27db99 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 59248039-324a-42af-8958-09f5c762afbd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:38:15.853261 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f683600f-3720-4676-a628-71713e27db99 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:38:15.853742 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f683600f-3720-4676-a628-71713e27db99 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:38:15.854183 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f683600f-3720-4676-a628-71713e27db99 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:38:15.854874 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f683600f-3720-4676-a628-71713e27db99 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:38:15.855328 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f683600f-3720-4676-a628-71713e27db99 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:38:15.855753 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-f683600f-3720-4676-a628-71713e27db99 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:38:15.986942 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-f683600f-3720-4676-a628-71713e27db99 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1755f644c416482c955baa17a4b21f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1518999779440e38b3796e5bf91c262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:38:15.994833 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-f683600f-3720-4676-a628-71713e27db99 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "GET /compute/v2.1/servers/59248039-324a-42af-8958-09f5c762afbd" status: 200 len: 1557 microversion: 2.1 time: 0.154329 Aug 07 02:38:15.995418 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3550/7567] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:38:15 2022] GET /compute/v2.1/servers/59248039-324a-42af-8958-09f5c762afbd => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:38:16.015124 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-64fef14c-bc17-4b56-8cd6-22cf684f7e87 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:38:16.015755 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-64fef14c-bc17-4b56-8cd6-22cf684f7e87 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 59248039-324a-42af-8958-09f5c762afbd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:38:16.023157 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64fef14c-bc17-4b56-8cd6-22cf684f7e87 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:38:16.023649 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64fef14c-bc17-4b56-8cd6-22cf684f7e87 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:38:16.024163 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64fef14c-bc17-4b56-8cd6-22cf684f7e87 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:38:16.024873 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64fef14c-bc17-4b56-8cd6-22cf684f7e87 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:38:16.025344 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64fef14c-bc17-4b56-8cd6-22cf684f7e87 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:38:16.025784 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-64fef14c-bc17-4b56-8cd6-22cf684f7e87 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:38:16.074782 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:38:16.097806 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:38:16.156407 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-64fef14c-bc17-4b56-8cd6-22cf684f7e87 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1755f644c416482c955baa17a4b21f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1518999779440e38b3796e5bf91c262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:38:16.164005 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-64fef14c-bc17-4b56-8cd6-22cf684f7e87 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "GET /compute/v2.1/servers/59248039-324a-42af-8958-09f5c762afbd" status: 200 len: 1557 microversion: 2.1 time: 0.152675 Aug 07 02:38:16.164610 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4018/7568] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:38:16 2022] GET /compute/v2.1/servers/59248039-324a-42af-8958-09f5c762afbd => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:38:18.089921 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-7d12889e-7255-4884-87a6-61ae76c0cbb6 req-f248afd5-0e31-4793-84b1-f467e04326d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59248039-324a-42af-8958-09f5c762afbd", "tag": "df88941e-b49b-4ae5-97f5-50d885da0f51"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:38:18.095016 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=6 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:38:18.101544 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-7d12889e-7255-4884-87a6-61ae76c0cbb6 req-f248afd5-0e31-4793-84b1-f467e04326d0 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:38:18.102107 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-7d12889e-7255-4884-87a6-61ae76c0cbb6 req-f248afd5-0e31-4793-84b1-f467e04326d0 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:38:18.102536 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-7d12889e-7255-4884-87a6-61ae76c0cbb6 req-f248afd5-0e31-4793-84b1-f467e04326d0 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:38:18.115034 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-7d12889e-7255-4884-87a6-61ae76c0cbb6 req-f248afd5-0e31-4793-84b1-f467e04326d0 service nova] Creating event network-changed:df88941e-b49b-4ae5-97f5-50d885da0f51 for instance 59248039-324a-42af-8958-09f5c762afbd on n-h1-master-1 Aug 07 02:38:18.120228 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-7d12889e-7255-4884-87a6-61ae76c0cbb6 req-f248afd5-0e31-4793-84b1-f467e04326d0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034089 Aug 07 02:38:18.120846 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3551/7569] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:39:28.040318 n-d-master-1 devstack@n-api.service[119517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 02:39:28.040920 n-d-master-1 devstack@n-api.service[119517]: Sun Aug 7 02:39:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 02:40:13.468506 n-d-master-1 devstack@n-api.service[119516]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e144fce3-2ef9-4f1b-815a-36f44ddcd578] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 07 02:40:13.469458 n-d-master-1 devstack@n-api.service[119516]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9bbf4f32-4f7b-4fcf-a326-64eac47dae98] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 07 02:40:13.469912 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:40:13.470946 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=34 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:40:13.475452 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ecdef824-9c5d-4621-9aa1-1f4e258926a9 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-838181220"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:40:13.477851 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ecdef824-9c5d-4621-9aa1-1f4e258926a9 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 59248039-324a-42af-8958-09f5c762afbd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:40:13.484911 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecdef824-9c5d-4621-9aa1-1f4e258926a9 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:13.485405 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecdef824-9c5d-4621-9aa1-1f4e258926a9 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:13.485852 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecdef824-9c5d-4621-9aa1-1f4e258926a9 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:13.486820 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecdef824-9c5d-4621-9aa1-1f4e258926a9 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:13.487283 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecdef824-9c5d-4621-9aa1-1f4e258926a9 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:13.487720 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ecdef824-9c5d-4621-9aa1-1f4e258926a9 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:13.682130 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ecdef824-9c5d-4621-9aa1-1f4e258926a9 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "POST /compute/v2.1/servers/59248039-324a-42af-8958-09f5c762afbd/action" status: 202 len: 0 microversion: 2.1 time: 0.215508 Aug 07 02:40:13.682766 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4019/7570] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:40:13 2022] POST /compute/v2.1/servers/59248039-324a-42af-8958-09f5c762afbd/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 07 02:40:20.585445 n-d-master-1 devstack@n-api.service[119517]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cc2209bc-4fce-4284-bf5f-e0375e6343bd] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 07 02:40:20.586867 n-d-master-1 devstack@n-api.service[119517]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dde625b-e185-486e-885e-ba9f9bdf36ce] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 07 02:40:20.587575 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:40:20.588338 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=28 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:40:20.593146 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-5039f2f6-bb62-430c-bf31-3b62992a78a3 req-398922cb-6f2b-4324-a4ec-840eeb22fec1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59248039-324a-42af-8958-09f5c762afbd", "name": "network-vif-plugged", "status": "completed", "tag": "df88941e-b49b-4ae5-97f5-50d885da0f51"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:40:20.605502 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-5039f2f6-bb62-430c-bf31-3b62992a78a3 req-398922cb-6f2b-4324-a4ec-840eeb22fec1 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:20.606050 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-5039f2f6-bb62-430c-bf31-3b62992a78a3 req-398922cb-6f2b-4324-a4ec-840eeb22fec1 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:20.606545 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-5039f2f6-bb62-430c-bf31-3b62992a78a3 req-398922cb-6f2b-4324-a4ec-840eeb22fec1 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:20.618484 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-5039f2f6-bb62-430c-bf31-3b62992a78a3 req-398922cb-6f2b-4324-a4ec-840eeb22fec1 service nova] Creating event network-vif-plugged:df88941e-b49b-4ae5-97f5-50d885da0f51 for instance 59248039-324a-42af-8958-09f5c762afbd on n-h1-master-1 Aug 07 02:40:20.624046 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-5039f2f6-bb62-430c-bf31-3b62992a78a3 req-398922cb-6f2b-4324-a4ec-840eeb22fec1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040250 Aug 07 02:40:20.624851 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3552/7571] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:40:27.232488 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:40:27.233558 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:40:27.238405 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-475dde02-4381-439c-b935-d8efea50be93 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-458049347", "imageRef": "8c753f95-e492-4eed-b1d0-a3e7fbe00849", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-236322405", "security_groups": [{"name": "tempest-secgroup-smoke-243592931"}], "networks": [{"uuid": "66411885-1693-4deb-9082-7541340fc047"}]}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:40:27.265558 n-d-master-1 devstack@n-api.service[119516]: INFO oslo.messaging._drivers.impl_rabbit [-] [e144fce3-2ef9-4f1b-815a-36f44ddcd578] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 37814. Aug 07 02:40:27.268674 n-d-master-1 devstack@n-api.service[119516]: INFO oslo.messaging._drivers.impl_rabbit [-] [9bbf4f32-4f7b-4fcf-a326-64eac47dae98] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 37816. Aug 07 02:40:27.353893 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.network.neutron [None req-475dde02-4381-439c-b935-d8efea50be93 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] validate_networks() for [('66411885-1693-4deb-9082-7541340fc047', None, None, None, None, None)] {{(pid=119516) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 02:40:27.730858 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-475dde02-4381-439c-b935-d8efea50be93 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Flavor limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 02:40:27.731301 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-475dde02-4381-439c-b935-d8efea50be93 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Image limits 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 02:40:27.731821 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-475dde02-4381-439c-b935-d8efea50be93 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Flavor pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 02:40:27.732283 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-475dde02-4381-439c-b935-d8efea50be93 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Image pref 0:0:0 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 02:40:27.732714 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.virt.hardware [None req-475dde02-4381-439c-b935-d8efea50be93 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119516) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 02:40:27.742568 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-475dde02-4381-439c-b935-d8efea50be93 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:27.743005 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-475dde02-4381-439c-b935-d8efea50be93 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:27.743460 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-475dde02-4381-439c-b935-d8efea50be93 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:27.744245 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-475dde02-4381-439c-b935-d8efea50be93 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:27.744719 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-475dde02-4381-439c-b935-d8efea50be93 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:27.745160 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-475dde02-4381-439c-b935-d8efea50be93 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:27.761718 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-475dde02-4381-439c-b935-d8efea50be93 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Getting quotas for project a1518999779440e38b3796e5bf91c262. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 02:40:27.767092 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.quota [None req-475dde02-4381-439c-b935-d8efea50be93 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Getting quotas for user 1755f644c416482c955baa17a4b21f43 and project a1518999779440e38b3796e5bf91c262. Resources: {'ram', 'cores', 'instances'} {{(pid=119516) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 02:40:27.779444 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-475dde02-4381-439c-b935-d8efea50be93 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Going to run 1 instances... {{(pid=119516) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 02:40:27.781934 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-475dde02-4381-439c-b935-d8efea50be93 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 749bd06e-31c3-4477-acfb-ce838a132985] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c753f95-e492-4eed-b1d0-a3e7fbe00849',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119516) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 02:40:27.827494 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-475dde02-4381-439c-b935-d8efea50be93 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.597494 Aug 07 02:40:27.828253 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4020/7572] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 02:40:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 02:40:27.846976 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-8c4b2862-29aa-436a-8f82-99bd63c1ba87 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:40:27.847692 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-8c4b2862-29aa-436a-8f82-99bd63c1ba87 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 749bd06e-31c3-4477-acfb-ce838a132985] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:40:27.854753 n-d-master-1 devstack@n-api.service[119517]: INFO oslo.messaging._drivers.impl_rabbit [-] [cc2209bc-4fce-4284-bf5f-e0375e6343bd] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 37830. Aug 07 02:40:27.874765 n-d-master-1 devstack@n-api.service[119517]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dde625b-e185-486e-885e-ba9f9bdf36ce] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 37832. Aug 07 02:40:27.960049 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-8c4b2862-29aa-436a-8f82-99bd63c1ba87 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1755f644c416482c955baa17a4b21f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1518999779440e38b3796e5bf91c262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:40:27.967521 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-8c4b2862-29aa-436a-8f82-99bd63c1ba87 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985" status: 200 len: 1247 microversion: 2.1 time: 0.131913 Aug 07 02:40:27.968108 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3553/7573] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:40:27 2022] GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985 => generated 1247 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:40:28.989230 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-fbd9dd60-e1ae-4225-a357-bce304767413 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:40:28.989853 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-fbd9dd60-e1ae-4225-a357-bce304767413 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 749bd06e-31c3-4477-acfb-ce838a132985] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:40:28.997294 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fbd9dd60-e1ae-4225-a357-bce304767413 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:28.997787 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fbd9dd60-e1ae-4225-a357-bce304767413 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:28.998233 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fbd9dd60-e1ae-4225-a357-bce304767413 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:28.998940 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fbd9dd60-e1ae-4225-a357-bce304767413 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:28.999404 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fbd9dd60-e1ae-4225-a357-bce304767413 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:28.999840 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-fbd9dd60-e1ae-4225-a357-bce304767413 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:29.073610 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-fbd9dd60-e1ae-4225-a357-bce304767413 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1755f644c416482c955baa17a4b21f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1518999779440e38b3796e5bf91c262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:40:29.081858 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-fbd9dd60-e1ae-4225-a357-bce304767413 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985" status: 200 len: 1305 microversion: 2.1 time: 0.097655 Aug 07 02:40:29.083658 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4021/7574] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:40:28 2022] GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985 => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:40:30.104427 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9884e72a-50ae-4f8a-813e-853b8335e4c3 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:40:30.106528 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9884e72a-50ae-4f8a-813e-853b8335e4c3 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 749bd06e-31c3-4477-acfb-ce838a132985] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:40:30.115841 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9884e72a-50ae-4f8a-813e-853b8335e4c3 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:30.116735 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9884e72a-50ae-4f8a-813e-853b8335e4c3 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:30.117614 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9884e72a-50ae-4f8a-813e-853b8335e4c3 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:30.118387 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9884e72a-50ae-4f8a-813e-853b8335e4c3 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:30.119044 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9884e72a-50ae-4f8a-813e-853b8335e4c3 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:30.119674 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9884e72a-50ae-4f8a-813e-853b8335e4c3 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:30.275743 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9884e72a-50ae-4f8a-813e-853b8335e4c3 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1755f644c416482c955baa17a4b21f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1518999779440e38b3796e5bf91c262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:40:30.283937 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9884e72a-50ae-4f8a-813e-853b8335e4c3 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985" status: 200 len: 1372 microversion: 2.1 time: 0.183902 Aug 07 02:40:30.296474 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3554/7575] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:40:30 2022] GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985 => generated 1372 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:40:30.613438 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-6634b1db-e735-458c-add8-929a32b3dec7 req-181923f0-1c3a-4925-9406-0aa99614d25e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59248039-324a-42af-8958-09f5c762afbd", "name": "network-vif-unplugged", "status": "completed", "tag": "df88941e-b49b-4ae5-97f5-50d885da0f51"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:40:30.632318 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6634b1db-e735-458c-add8-929a32b3dec7 req-181923f0-1c3a-4925-9406-0aa99614d25e service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:30.633093 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6634b1db-e735-458c-add8-929a32b3dec7 req-181923f0-1c3a-4925-9406-0aa99614d25e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:30.633959 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-6634b1db-e735-458c-add8-929a32b3dec7 req-181923f0-1c3a-4925-9406-0aa99614d25e service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:30.666999 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-6634b1db-e735-458c-add8-929a32b3dec7 req-181923f0-1c3a-4925-9406-0aa99614d25e service nova] Creating event network-vif-unplugged:df88941e-b49b-4ae5-97f5-50d885da0f51 for instance 59248039-324a-42af-8958-09f5c762afbd on n-h1-master-1 Aug 07 02:40:30.683963 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-6634b1db-e735-458c-add8-929a32b3dec7 req-181923f0-1c3a-4925-9406-0aa99614d25e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075691 Aug 07 02:40:30.685338 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4022/7576] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:40:31.306367 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e7e15cd3-ca33-48a2-8aa2-faadbff7fd2d tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:40:31.307995 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e7e15cd3-ca33-48a2-8aa2-faadbff7fd2d tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 749bd06e-31c3-4477-acfb-ce838a132985] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:40:31.316165 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7e15cd3-ca33-48a2-8aa2-faadbff7fd2d tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:31.317854 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7e15cd3-ca33-48a2-8aa2-faadbff7fd2d tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:31.318519 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7e15cd3-ca33-48a2-8aa2-faadbff7fd2d tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:31.319835 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7e15cd3-ca33-48a2-8aa2-faadbff7fd2d tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:31.320525 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7e15cd3-ca33-48a2-8aa2-faadbff7fd2d tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:31.321196 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e7e15cd3-ca33-48a2-8aa2-faadbff7fd2d tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:31.475875 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e7e15cd3-ca33-48a2-8aa2-faadbff7fd2d tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1755f644c416482c955baa17a4b21f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1518999779440e38b3796e5bf91c262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:40:31.489507 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e7e15cd3-ca33-48a2-8aa2-faadbff7fd2d tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985" status: 200 len: 1372 microversion: 2.1 time: 0.187105 Aug 07 02:40:31.492424 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3555/7577] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:40:31 2022] GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985 => generated 1372 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:40:32.518352 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2fb06f2f-dbbc-46ab-a444-fd85f9409492 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:40:32.519409 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2fb06f2f-dbbc-46ab-a444-fd85f9409492 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 749bd06e-31c3-4477-acfb-ce838a132985] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:40:32.527610 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2fb06f2f-dbbc-46ab-a444-fd85f9409492 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:32.528139 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2fb06f2f-dbbc-46ab-a444-fd85f9409492 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:32.528596 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2fb06f2f-dbbc-46ab-a444-fd85f9409492 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:32.529348 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2fb06f2f-dbbc-46ab-a444-fd85f9409492 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:32.529824 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2fb06f2f-dbbc-46ab-a444-fd85f9409492 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:32.530268 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2fb06f2f-dbbc-46ab-a444-fd85f9409492 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:32.683476 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2fb06f2f-dbbc-46ab-a444-fd85f9409492 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1755f644c416482c955baa17a4b21f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1518999779440e38b3796e5bf91c262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:40:32.691188 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2fb06f2f-dbbc-46ab-a444-fd85f9409492 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985" status: 200 len: 1372 microversion: 2.1 time: 0.177703 Aug 07 02:40:32.692413 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4023/7578] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:40:32 2022] GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985 => generated 1372 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:40:33.722249 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-9e218f14-b88b-419c-8087-6a36298c7ee9 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:40:33.724626 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-9e218f14-b88b-419c-8087-6a36298c7ee9 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 749bd06e-31c3-4477-acfb-ce838a132985] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:40:33.733219 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9e218f14-b88b-419c-8087-6a36298c7ee9 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:33.734024 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9e218f14-b88b-419c-8087-6a36298c7ee9 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:33.734845 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9e218f14-b88b-419c-8087-6a36298c7ee9 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:33.735905 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9e218f14-b88b-419c-8087-6a36298c7ee9 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:33.736524 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9e218f14-b88b-419c-8087-6a36298c7ee9 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:33.737432 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-9e218f14-b88b-419c-8087-6a36298c7ee9 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:33.918224 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-9e218f14-b88b-419c-8087-6a36298c7ee9 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1755f644c416482c955baa17a4b21f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1518999779440e38b3796e5bf91c262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:40:33.927837 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-9e218f14-b88b-419c-8087-6a36298c7ee9 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985" status: 200 len: 1372 microversion: 2.1 time: 0.217792 Aug 07 02:40:33.934047 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3556/7579] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:40:33 2022] GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985 => generated 1372 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:40:34.950386 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-2237d6d6-6c2d-48b1-8649-34c60871191e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:40:34.951064 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-2237d6d6-6c2d-48b1-8649-34c60871191e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 749bd06e-31c3-4477-acfb-ce838a132985] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:40:34.958312 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2237d6d6-6c2d-48b1-8649-34c60871191e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:34.959186 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2237d6d6-6c2d-48b1-8649-34c60871191e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:34.960026 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2237d6d6-6c2d-48b1-8649-34c60871191e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:34.961064 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2237d6d6-6c2d-48b1-8649-34c60871191e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:34.961780 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2237d6d6-6c2d-48b1-8649-34c60871191e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:34.962227 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-2237d6d6-6c2d-48b1-8649-34c60871191e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:35.125743 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-2237d6d6-6c2d-48b1-8649-34c60871191e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1755f644c416482c955baa17a4b21f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1518999779440e38b3796e5bf91c262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:40:35.134019 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-2237d6d6-6c2d-48b1-8649-34c60871191e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985" status: 200 len: 1372 microversion: 2.1 time: 0.187501 Aug 07 02:40:35.134580 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4024/7580] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:40:34 2022] GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985 => generated 1372 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:40:36.154689 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-15c14429-2076-43f0-943b-eb68fff0a370 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:40:36.155299 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-15c14429-2076-43f0-943b-eb68fff0a370 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 749bd06e-31c3-4477-acfb-ce838a132985] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:40:36.162430 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15c14429-2076-43f0-943b-eb68fff0a370 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:36.162926 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15c14429-2076-43f0-943b-eb68fff0a370 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:36.163370 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15c14429-2076-43f0-943b-eb68fff0a370 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:36.164118 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15c14429-2076-43f0-943b-eb68fff0a370 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:36.164580 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15c14429-2076-43f0-943b-eb68fff0a370 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:36.165010 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-15c14429-2076-43f0-943b-eb68fff0a370 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:36.300106 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-15c14429-2076-43f0-943b-eb68fff0a370 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1755f644c416482c955baa17a4b21f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1518999779440e38b3796e5bf91c262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:40:36.308257 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-15c14429-2076-43f0-943b-eb68fff0a370 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985" status: 200 len: 1372 microversion: 2.1 time: 0.157467 Aug 07 02:40:36.308836 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3557/7581] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:40:36 2022] GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:40:37.329710 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-ea1abc45-eb30-4856-a062-5400ceebba80 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:40:37.331022 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-ea1abc45-eb30-4856-a062-5400ceebba80 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 749bd06e-31c3-4477-acfb-ce838a132985] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:40:37.338555 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea1abc45-eb30-4856-a062-5400ceebba80 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:37.339056 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea1abc45-eb30-4856-a062-5400ceebba80 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:37.339567 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea1abc45-eb30-4856-a062-5400ceebba80 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:37.340338 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea1abc45-eb30-4856-a062-5400ceebba80 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:37.340810 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea1abc45-eb30-4856-a062-5400ceebba80 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:37.341252 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-ea1abc45-eb30-4856-a062-5400ceebba80 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:37.596098 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-ea1abc45-eb30-4856-a062-5400ceebba80 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1755f644c416482c955baa17a4b21f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1518999779440e38b3796e5bf91c262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:40:37.603641 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-ea1abc45-eb30-4856-a062-5400ceebba80 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985" status: 200 len: 1372 microversion: 2.1 time: 0.277879 Aug 07 02:40:37.604241 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4025/7582] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:40:37 2022] GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985 => generated 1372 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:40:37.775695 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-5dac5878-f185-4ccf-adb1-43a8fe647c5c req-d8864d95-1522-4489-b798-6c362dbcb254 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "749bd06e-31c3-4477-acfb-ce838a132985", "tag": "f7268878-60fd-4ab2-9c26-b80b18ed7796"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:40:37.785503 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-5dac5878-f185-4ccf-adb1-43a8fe647c5c req-d8864d95-1522-4489-b798-6c362dbcb254 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:37.786076 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-5dac5878-f185-4ccf-adb1-43a8fe647c5c req-d8864d95-1522-4489-b798-6c362dbcb254 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:37.786602 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-5dac5878-f185-4ccf-adb1-43a8fe647c5c req-d8864d95-1522-4489-b798-6c362dbcb254 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:37.797693 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-5dac5878-f185-4ccf-adb1-43a8fe647c5c req-d8864d95-1522-4489-b798-6c362dbcb254 service nova] Creating event network-changed:f7268878-60fd-4ab2-9c26-b80b18ed7796 for instance 749bd06e-31c3-4477-acfb-ce838a132985 on n-h2-master-1 Aug 07 02:40:37.803203 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-5dac5878-f185-4ccf-adb1-43a8fe647c5c req-d8864d95-1522-4489-b798-6c362dbcb254 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089282 Aug 07 02:40:37.804072 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3558/7583] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:40:38.625051 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-5e07928d-7fcd-4e55-8ce4-a8f5ea0a256e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:40:38.625686 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-5e07928d-7fcd-4e55-8ce4-a8f5ea0a256e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 749bd06e-31c3-4477-acfb-ce838a132985] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:40:38.627710 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:40:38.628399 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell0:SELECT=6 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:40:38.635731 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e07928d-7fcd-4e55-8ce4-a8f5ea0a256e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:38.636250 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e07928d-7fcd-4e55-8ce4-a8f5ea0a256e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:38.636705 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e07928d-7fcd-4e55-8ce4-a8f5ea0a256e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:38.637418 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e07928d-7fcd-4e55-8ce4-a8f5ea0a256e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:38.637886 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e07928d-7fcd-4e55-8ce4-a8f5ea0a256e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:38.638330 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-5e07928d-7fcd-4e55-8ce4-a8f5ea0a256e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:38.772670 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-5e07928d-7fcd-4e55-8ce4-a8f5ea0a256e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1755f644c416482c955baa17a4b21f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1518999779440e38b3796e5bf91c262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:40:38.780144 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-5e07928d-7fcd-4e55-8ce4-a8f5ea0a256e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985" status: 200 len: 1372 microversion: 2.1 time: 0.159272 Aug 07 02:40:38.780712 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4026/7584] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:40:38 2022] GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:40:39.799007 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell0:SELECT=2 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:40:39.804348 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-e13b7c4d-28f5-4a9a-981f-45d02204602e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:40:39.805055 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-e13b7c4d-28f5-4a9a-981f-45d02204602e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 749bd06e-31c3-4477-acfb-ce838a132985] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:40:39.811264 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e13b7c4d-28f5-4a9a-981f-45d02204602e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:39.811746 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e13b7c4d-28f5-4a9a-981f-45d02204602e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:39.812224 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e13b7c4d-28f5-4a9a-981f-45d02204602e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:39.812925 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e13b7c4d-28f5-4a9a-981f-45d02204602e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:39.813376 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e13b7c4d-28f5-4a9a-981f-45d02204602e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:39.813804 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-e13b7c4d-28f5-4a9a-981f-45d02204602e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:39.952740 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-e13b7c4d-28f5-4a9a-981f-45d02204602e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1755f644c416482c955baa17a4b21f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1518999779440e38b3796e5bf91c262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:40:39.960377 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-e13b7c4d-28f5-4a9a-981f-45d02204602e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985" status: 200 len: 1372 microversion: 2.1 time: 0.162680 Aug 07 02:40:39.960954 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3559/7585] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:40:39 2022] GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:40:40.981678 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-b3439428-7efb-4974-9d10-0fc3734dc3a0 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:40:40.982301 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-b3439428-7efb-4974-9d10-0fc3734dc3a0 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 749bd06e-31c3-4477-acfb-ce838a132985] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:40:40.989469 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b3439428-7efb-4974-9d10-0fc3734dc3a0 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:40.989988 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b3439428-7efb-4974-9d10-0fc3734dc3a0 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:40.990437 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b3439428-7efb-4974-9d10-0fc3734dc3a0 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:40.991141 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b3439428-7efb-4974-9d10-0fc3734dc3a0 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:40.991604 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b3439428-7efb-4974-9d10-0fc3734dc3a0 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:40.992070 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-b3439428-7efb-4974-9d10-0fc3734dc3a0 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:41.124879 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-b3439428-7efb-4974-9d10-0fc3734dc3a0 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1755f644c416482c955baa17a4b21f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1518999779440e38b3796e5bf91c262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:40:41.132418 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-b3439428-7efb-4974-9d10-0fc3734dc3a0 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985" status: 200 len: 1372 microversion: 2.1 time: 0.154639 Aug 07 02:40:41.132998 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4027/7586] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:40:40 2022] GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:40:42.153522 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-7540b357-4177-4832-b7ab-bcdd547ace92 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:40:42.154148 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-7540b357-4177-4832-b7ab-bcdd547ace92 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 749bd06e-31c3-4477-acfb-ce838a132985] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:40:42.161582 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7540b357-4177-4832-b7ab-bcdd547ace92 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:42.162065 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7540b357-4177-4832-b7ab-bcdd547ace92 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:42.162501 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7540b357-4177-4832-b7ab-bcdd547ace92 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:42.163202 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7540b357-4177-4832-b7ab-bcdd547ace92 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:42.163685 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7540b357-4177-4832-b7ab-bcdd547ace92 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:42.164140 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-7540b357-4177-4832-b7ab-bcdd547ace92 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:42.294015 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-7540b357-4177-4832-b7ab-bcdd547ace92 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1755f644c416482c955baa17a4b21f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1518999779440e38b3796e5bf91c262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:40:42.302170 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-7540b357-4177-4832-b7ab-bcdd547ace92 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985" status: 200 len: 1372 microversion: 2.1 time: 0.152508 Aug 07 02:40:42.302784 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3560/7587] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:40:42 2022] GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:40:43.323328 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-aedd839e-6b1c-42d0-8eeb-dd8678ce09cb tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:40:43.323999 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-aedd839e-6b1c-42d0-8eeb-dd8678ce09cb tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 749bd06e-31c3-4477-acfb-ce838a132985] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:40:43.330909 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aedd839e-6b1c-42d0-8eeb-dd8678ce09cb tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:43.331407 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aedd839e-6b1c-42d0-8eeb-dd8678ce09cb tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:43.331906 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aedd839e-6b1c-42d0-8eeb-dd8678ce09cb tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:43.332625 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aedd839e-6b1c-42d0-8eeb-dd8678ce09cb tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:43.333091 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aedd839e-6b1c-42d0-8eeb-dd8678ce09cb tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:43.333529 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-aedd839e-6b1c-42d0-8eeb-dd8678ce09cb tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:43.468636 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-04a5c179-668c-4acc-9700-f1357ea11c5a req-f710161a-c9bd-45f2-bf21-c3f653f74016 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "749bd06e-31c3-4477-acfb-ce838a132985", "name": "network-vif-plugged", "status": "completed", "tag": "f7268878-60fd-4ab2-9c26-b80b18ed7796"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:40:43.471312 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-aedd839e-6b1c-42d0-8eeb-dd8678ce09cb tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1755f644c416482c955baa17a4b21f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1518999779440e38b3796e5bf91c262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:40:43.479833 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-04a5c179-668c-4acc-9700-f1357ea11c5a req-f710161a-c9bd-45f2-bf21-c3f653f74016 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:43.480703 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-04a5c179-668c-4acc-9700-f1357ea11c5a req-f710161a-c9bd-45f2-bf21-c3f653f74016 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:43.480942 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-aedd839e-6b1c-42d0-8eeb-dd8678ce09cb tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985" status: 200 len: 1372 microversion: 2.1 time: 0.161590 Aug 07 02:40:43.481457 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-04a5c179-668c-4acc-9700-f1357ea11c5a req-f710161a-c9bd-45f2-bf21-c3f653f74016 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:43.481600 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4028/7588] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:40:43 2022] GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:40:43.500135 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-04a5c179-668c-4acc-9700-f1357ea11c5a req-f710161a-c9bd-45f2-bf21-c3f653f74016 service nova] Creating event network-vif-plugged:f7268878-60fd-4ab2-9c26-b80b18ed7796 for instance 749bd06e-31c3-4477-acfb-ce838a132985 on n-h2-master-1 Aug 07 02:40:43.505743 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-04a5c179-668c-4acc-9700-f1357ea11c5a req-f710161a-c9bd-45f2-bf21-c3f653f74016 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041264 Aug 07 02:40:43.506441 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3561/7589] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:40:44.502581 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-398a1ca3-f3b8-47cc-8423-69378a77f09d tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:40:44.503226 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-398a1ca3-f3b8-47cc-8423-69378a77f09d tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 749bd06e-31c3-4477-acfb-ce838a132985] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:40:44.510781 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-398a1ca3-f3b8-47cc-8423-69378a77f09d tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:44.511280 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-398a1ca3-f3b8-47cc-8423-69378a77f09d tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:44.511764 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-398a1ca3-f3b8-47cc-8423-69378a77f09d tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:44.512512 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-398a1ca3-f3b8-47cc-8423-69378a77f09d tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:44.513035 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-398a1ca3-f3b8-47cc-8423-69378a77f09d tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:44.513491 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-398a1ca3-f3b8-47cc-8423-69378a77f09d tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:44.650610 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-398a1ca3-f3b8-47cc-8423-69378a77f09d tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1755f644c416482c955baa17a4b21f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1518999779440e38b3796e5bf91c262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:40:44.658305 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-398a1ca3-f3b8-47cc-8423-69378a77f09d tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985" status: 200 len: 1372 microversion: 2.1 time: 0.159607 Aug 07 02:40:44.658883 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4029/7590] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:40:44 2022] GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:40:45.680597 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-a3da9948-1126-4ced-8353-494403b71c43 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:40:45.681329 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-a3da9948-1126-4ced-8353-494403b71c43 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 749bd06e-31c3-4477-acfb-ce838a132985] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:40:45.687536 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3da9948-1126-4ced-8353-494403b71c43 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:45.688060 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3da9948-1126-4ced-8353-494403b71c43 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:45.688500 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3da9948-1126-4ced-8353-494403b71c43 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:45.689191 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3da9948-1126-4ced-8353-494403b71c43 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:45.689650 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3da9948-1126-4ced-8353-494403b71c43 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:45.690075 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-a3da9948-1126-4ced-8353-494403b71c43 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:45.826479 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-a3da9948-1126-4ced-8353-494403b71c43 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1755f644c416482c955baa17a4b21f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1518999779440e38b3796e5bf91c262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:40:45.834680 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-a3da9948-1126-4ced-8353-494403b71c43 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985" status: 200 len: 1557 microversion: 2.1 time: 0.159240 Aug 07 02:40:45.835245 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3562/7591] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:40:45 2022] GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985 => generated 1557 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:40:45.854625 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-de22216a-1e01-4a0a-a32c-2c283e110bcf tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:40:45.855264 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-de22216a-1e01-4a0a-a32c-2c283e110bcf tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 749bd06e-31c3-4477-acfb-ce838a132985] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:40:45.862516 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-de22216a-1e01-4a0a-a32c-2c283e110bcf tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:45.863021 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-de22216a-1e01-4a0a-a32c-2c283e110bcf tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:45.863476 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-de22216a-1e01-4a0a-a32c-2c283e110bcf tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:45.864222 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-de22216a-1e01-4a0a-a32c-2c283e110bcf tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:45.864700 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-de22216a-1e01-4a0a-a32c-2c283e110bcf tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:45.865161 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-de22216a-1e01-4a0a-a32c-2c283e110bcf tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:45.997242 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-de22216a-1e01-4a0a-a32c-2c283e110bcf tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1755f644c416482c955baa17a4b21f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1518999779440e38b3796e5bf91c262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:40:46.005222 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-de22216a-1e01-4a0a-a32c-2c283e110bcf tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985" status: 200 len: 1557 microversion: 2.1 time: 0.154509 Aug 07 02:40:46.005979 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4030/7592] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:40:45 2022] GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:40:47.904664 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-a9fe0bc3-2424-4fa2-b081-e82ae12082e2 req-48110c70-0c85-4bfe-a7d3-778318ef3fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "749bd06e-31c3-4477-acfb-ce838a132985", "tag": "f7268878-60fd-4ab2-9c26-b80b18ed7796"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:40:47.915859 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a9fe0bc3-2424-4fa2-b081-e82ae12082e2 req-48110c70-0c85-4bfe-a7d3-778318ef3fa5 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:40:47.916363 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a9fe0bc3-2424-4fa2-b081-e82ae12082e2 req-48110c70-0c85-4bfe-a7d3-778318ef3fa5 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:40:47.916799 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-a9fe0bc3-2424-4fa2-b081-e82ae12082e2 req-48110c70-0c85-4bfe-a7d3-778318ef3fa5 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:40:47.928584 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-a9fe0bc3-2424-4fa2-b081-e82ae12082e2 req-48110c70-0c85-4bfe-a7d3-778318ef3fa5 service nova] Creating event network-changed:f7268878-60fd-4ab2-9c26-b80b18ed7796 for instance 749bd06e-31c3-4477-acfb-ce838a132985 on n-h2-master-1 Aug 07 02:40:47.933896 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-a9fe0bc3-2424-4fa2-b081-e82ae12082e2 req-48110c70-0c85-4bfe-a7d3-778318ef3fa5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033068 Aug 07 02:40:47.934490 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3563/7593] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 02:41:07.902105 n-d-master-1 devstack@n-api.service[119517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 02:41:07.902904 n-d-master-1 devstack@n-api.service[119517]: Sun Aug 7 02:41:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 02:42:26.578038 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:42:26.578811 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=58 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:42:26.584979 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-9229116b-8f44-41ef-96b3-760d8ed2c467 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-56973259"}} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:42:26.587323 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-9229116b-8f44-41ef-96b3-760d8ed2c467 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 749bd06e-31c3-4477-acfb-ce838a132985] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:42:26.594426 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9229116b-8f44-41ef-96b3-760d8ed2c467 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:42:26.594922 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9229116b-8f44-41ef-96b3-760d8ed2c467 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:42:26.595368 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9229116b-8f44-41ef-96b3-760d8ed2c467 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:42:26.596100 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9229116b-8f44-41ef-96b3-760d8ed2c467 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:42:26.596563 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9229116b-8f44-41ef-96b3-760d8ed2c467 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:42:26.596995 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-9229116b-8f44-41ef-96b3-760d8ed2c467 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:42:26.784227 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-9229116b-8f44-41ef-96b3-760d8ed2c467 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "POST /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985/action" status: 202 len: 0 microversion: 2.1 time: 0.208004 Aug 07 02:42:26.784865 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4031/7594] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Aug 7 02:42:26 2022] POST /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 07 02:42:32.123466 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-ee174dd4-1808-436c-ab7b-24d5a33bafd4 req-19601887-623b-48b5-a7c7-87b76ede883c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "749bd06e-31c3-4477-acfb-ce838a132985", "name": "network-vif-plugged", "status": "completed", "tag": "f7268878-60fd-4ab2-9c26-b80b18ed7796"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:42:32.132092 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_api:SELECT=26 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:42:32.132833 n-d-master-1 devstack@n-api.service[119517]: DEBUG dbcounter [-] [119517] Writing DB stats nova_cell1:SELECT=50 {{(pid=119517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:42:32.138967 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-ee174dd4-1808-436c-ab7b-24d5a33bafd4 req-19601887-623b-48b5-a7c7-87b76ede883c service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:42:32.139787 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-ee174dd4-1808-436c-ab7b-24d5a33bafd4 req-19601887-623b-48b5-a7c7-87b76ede883c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:42:32.140320 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-ee174dd4-1808-436c-ab7b-24d5a33bafd4 req-19601887-623b-48b5-a7c7-87b76ede883c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:42:32.160410 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-ee174dd4-1808-436c-ab7b-24d5a33bafd4 req-19601887-623b-48b5-a7c7-87b76ede883c service nova] Creating event network-vif-plugged:f7268878-60fd-4ab2-9c26-b80b18ed7796 for instance 749bd06e-31c3-4477-acfb-ce838a132985 on n-h2-master-1 Aug 07 02:42:32.168074 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-ee174dd4-1808-436c-ab7b-24d5a33bafd4 req-19601887-623b-48b5-a7c7-87b76ede883c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048902 Aug 07 02:42:32.169056 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3564/7595] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:42:40.422972 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-4a26e0fd-8a1b-42a8-b251-5e7544e2645a tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:42:40.424302 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4a26e0fd-8a1b-42a8-b251-5e7544e2645a tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 749bd06e-31c3-4477-acfb-ce838a132985] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:42:40.430165 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_api:SELECT=2 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:42:40.431105 n-d-master-1 devstack@n-api.service[119516]: DEBUG dbcounter [-] [119516] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:42:40.450435 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a26e0fd-8a1b-42a8-b251-5e7544e2645a tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:42:40.451151 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a26e0fd-8a1b-42a8-b251-5e7544e2645a tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:42:40.451604 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a26e0fd-8a1b-42a8-b251-5e7544e2645a tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:42:40.452355 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a26e0fd-8a1b-42a8-b251-5e7544e2645a tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:42:40.452820 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a26e0fd-8a1b-42a8-b251-5e7544e2645a tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:42:40.453255 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-4a26e0fd-8a1b-42a8-b251-5e7544e2645a tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:42:40.497717 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-4a26e0fd-8a1b-42a8-b251-5e7544e2645a tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 749bd06e-31c3-4477-acfb-ce838a132985] Going to try to terminate instance {{(pid=119516) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 02:42:40.516107 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-d3c3bb43-317c-4be8-9d9a-14819a64be36 req-82f456bd-c3f5-4bbe-a135-379db59f0304 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "749bd06e-31c3-4477-acfb-ce838a132985", "tag": "f7268878-60fd-4ab2-9c26-b80b18ed7796"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:42:40.526882 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d3c3bb43-317c-4be8-9d9a-14819a64be36 req-82f456bd-c3f5-4bbe-a135-379db59f0304 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:42:40.527613 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d3c3bb43-317c-4be8-9d9a-14819a64be36 req-82f456bd-c3f5-4bbe-a135-379db59f0304 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:42:40.528248 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-d3c3bb43-317c-4be8-9d9a-14819a64be36 req-82f456bd-c3f5-4bbe-a135-379db59f0304 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:42:40.539998 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-d3c3bb43-317c-4be8-9d9a-14819a64be36 req-82f456bd-c3f5-4bbe-a135-379db59f0304 service nova] Creating event network-changed:f7268878-60fd-4ab2-9c26-b80b18ed7796 for instance 749bd06e-31c3-4477-acfb-ce838a132985 on n-h2-master-1 Aug 07 02:42:40.547118 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-d3c3bb43-317c-4be8-9d9a-14819a64be36 req-82f456bd-c3f5-4bbe-a135-379db59f0304 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126573 Aug 07 02:42:40.548007 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3565/7596] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:42:40.590697 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-4a26e0fd-8a1b-42a8-b251-5e7544e2645a tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "DELETE /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985" status: 204 len: 0 microversion: 2.1 time: 0.172235 Aug 07 02:42:40.595083 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4032/7597] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 02:42:40 2022] DELETE /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 02:42:40.601214 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-0ebc3ff6-97aa-4957-8614-ef5cbfc01dee tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:42:40.602527 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-0ebc3ff6-97aa-4957-8614-ef5cbfc01dee tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 749bd06e-31c3-4477-acfb-ce838a132985] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:42:40.609139 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ebc3ff6-97aa-4957-8614-ef5cbfc01dee tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:42:40.609851 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ebc3ff6-97aa-4957-8614-ef5cbfc01dee tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:42:40.610507 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ebc3ff6-97aa-4957-8614-ef5cbfc01dee tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:42:40.611368 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ebc3ff6-97aa-4957-8614-ef5cbfc01dee tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:42:40.612003 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ebc3ff6-97aa-4957-8614-ef5cbfc01dee tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:42:40.612599 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-0ebc3ff6-97aa-4957-8614-ef5cbfc01dee tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:42:40.756919 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-0ebc3ff6-97aa-4957-8614-ef5cbfc01dee tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1755f644c416482c955baa17a4b21f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1518999779440e38b3796e5bf91c262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:42:40.769650 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-0ebc3ff6-97aa-4957-8614-ef5cbfc01dee tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985" status: 200 len: 1681 microversion: 2.1 time: 0.173072 Aug 07 02:42:40.770238 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3566/7598] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:42:40 2022] GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985 => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:42:41.794055 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-09a83a2d-2f67-42aa-b8e6-27cb625a9965 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:42:41.794767 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-09a83a2d-2f67-42aa-b8e6-27cb625a9965 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 749bd06e-31c3-4477-acfb-ce838a132985] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:42:41.801610 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-09a83a2d-2f67-42aa-b8e6-27cb625a9965 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:42:41.802106 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-09a83a2d-2f67-42aa-b8e6-27cb625a9965 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:42:41.802562 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-09a83a2d-2f67-42aa-b8e6-27cb625a9965 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:42:41.803272 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-09a83a2d-2f67-42aa-b8e6-27cb625a9965 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:42:41.803739 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-09a83a2d-2f67-42aa-b8e6-27cb625a9965 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:42:41.804209 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-09a83a2d-2f67-42aa-b8e6-27cb625a9965 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:42:42.011603 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-09a83a2d-2f67-42aa-b8e6-27cb625a9965 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1755f644c416482c955baa17a4b21f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1518999779440e38b3796e5bf91c262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:42:42.019224 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-09a83a2d-2f67-42aa-b8e6-27cb625a9965 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985" status: 200 len: 1681 microversion: 2.1 time: 0.229427 Aug 07 02:42:42.019795 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4033/7599] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:42:41 2022] GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985 => generated 1681 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:42:42.080183 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-302cec42-f23f-4b42-8c0d-0ee8c08d9d47 req-687e079f-af16-487f-bd4e-c8474d180736 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "749bd06e-31c3-4477-acfb-ce838a132985", "name": "network-vif-unplugged", "status": "completed", "tag": "f7268878-60fd-4ab2-9c26-b80b18ed7796"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:42:42.098374 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-302cec42-f23f-4b42-8c0d-0ee8c08d9d47 req-687e079f-af16-487f-bd4e-c8474d180736 service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:42:42.099111 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-302cec42-f23f-4b42-8c0d-0ee8c08d9d47 req-687e079f-af16-487f-bd4e-c8474d180736 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:42:42.099609 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-302cec42-f23f-4b42-8c0d-0ee8c08d9d47 req-687e079f-af16-487f-bd4e-c8474d180736 service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:42:42.121781 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-302cec42-f23f-4b42-8c0d-0ee8c08d9d47 req-687e079f-af16-487f-bd4e-c8474d180736 service nova] Creating event network-vif-unplugged:f7268878-60fd-4ab2-9c26-b80b18ed7796 for instance 749bd06e-31c3-4477-acfb-ce838a132985 on n-h2-master-1 Aug 07 02:42:42.128795 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-302cec42-f23f-4b42-8c0d-0ee8c08d9d47 req-687e079f-af16-487f-bd4e-c8474d180736 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053352 Aug 07 02:42:42.129503 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3567/7600] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:42:42.770983 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-0e7fd219-1a0c-496a-9ac6-2106924cee11 req-e410d4d3-7c26-489b-8bc0-61ed89019a3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "749bd06e-31c3-4477-acfb-ce838a132985", "name": "network-vif-deleted", "tag": "f7268878-60fd-4ab2-9c26-b80b18ed7796"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:42:42.781610 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0e7fd219-1a0c-496a-9ac6-2106924cee11 req-e410d4d3-7c26-489b-8bc0-61ed89019a3f service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:42:42.782103 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0e7fd219-1a0c-496a-9ac6-2106924cee11 req-e410d4d3-7c26-489b-8bc0-61ed89019a3f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:42:42.782783 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-0e7fd219-1a0c-496a-9ac6-2106924cee11 req-e410d4d3-7c26-489b-8bc0-61ed89019a3f service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:42:42.794517 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-0e7fd219-1a0c-496a-9ac6-2106924cee11 req-e410d4d3-7c26-489b-8bc0-61ed89019a3f service nova] Creating event network-vif-deleted:f7268878-60fd-4ab2-9c26-b80b18ed7796 for instance 749bd06e-31c3-4477-acfb-ce838a132985 on n-h2-master-1 Aug 07 02:42:42.799665 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-0e7fd219-1a0c-496a-9ac6-2106924cee11 req-e410d4d3-7c26-489b-8bc0-61ed89019a3f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032929 Aug 07 02:42:42.800265 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4034/7601] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:42:43.042089 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5842b90e-096b-45d3-9d12-903b25c53a27 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:42:43.043084 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-5842b90e-096b-45d3-9d12-903b25c53a27 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 749bd06e-31c3-4477-acfb-ce838a132985] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:42:43.049977 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5842b90e-096b-45d3-9d12-903b25c53a27 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:42:43.050469 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5842b90e-096b-45d3-9d12-903b25c53a27 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:42:43.052032 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5842b90e-096b-45d3-9d12-903b25c53a27 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:42:43.052032 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5842b90e-096b-45d3-9d12-903b25c53a27 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:42:43.052253 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5842b90e-096b-45d3-9d12-903b25c53a27 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:42:43.052531 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-5842b90e-096b-45d3-9d12-903b25c53a27 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:42:43.142218 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-5842b90e-096b-45d3-9d12-903b25c53a27 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1755f644c416482c955baa17a4b21f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1518999779440e38b3796e5bf91c262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:42:43.151689 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5842b90e-096b-45d3-9d12-903b25c53a27 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985" status: 200 len: 1332 microversion: 2.1 time: 0.114693 Aug 07 02:42:43.152304 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3568/7602] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:42:43 2022] GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985 => generated 1332 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:42:44.174915 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d4a65793-acbb-4f89-92cb-5c666fd61b96 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:42:44.175619 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-d4a65793-acbb-4f89-92cb-5c666fd61b96 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 749bd06e-31c3-4477-acfb-ce838a132985] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:42:44.183396 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d4a65793-acbb-4f89-92cb-5c666fd61b96 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:42:44.183907 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d4a65793-acbb-4f89-92cb-5c666fd61b96 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:42:44.184350 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d4a65793-acbb-4f89-92cb-5c666fd61b96 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:42:44.185053 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d4a65793-acbb-4f89-92cb-5c666fd61b96 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:42:44.185516 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d4a65793-acbb-4f89-92cb-5c666fd61b96 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:42:44.185948 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-d4a65793-acbb-4f89-92cb-5c666fd61b96 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:42:44.199797 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-d4a65793-acbb-4f89-92cb-5c666fd61b96 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] HTTP exception thrown: Instance 749bd06e-31c3-4477-acfb-ce838a132985 could not be found. Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d4a65793-acbb-4f89-92cb-5c666fd61b96 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Request method failure captured: Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985 HTTP/1.1 Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7yWHQRaccwxkj-uzwj04DPWbQ0IEpDxwqRYhjcwP0XgCNFTxOBBhWpeHP1ZKG-EnBlQXCdQzG9HQtlr3DwAOyKbnNGWi3iUigCP3TYFmr1SO4dF6TJFl3KevN_N-9bt_QWThxw85e8p6aO1cLOkQvySboA5Av0xA8alWkEQwP-ZgV84 Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: a1518999779440e38b3796e5bf91c262 Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-TestSnapshotPattern-175105621 Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a1518999779440e38b3796e5bf91c262"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a1518999779440e38b3796e5bf91c262", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a1518999779440e38b3796e5bf91c262"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a1518999779440e38b3796e5bf91c262"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-TestSnapshotPattern-175105621 Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: a1518999779440e38b3796e5bf91c262 Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-TestSnapshotPattern-175105621 Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-TestSnapshotPattern-175105621-project Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 1755f644c416482c955baa17a4b21f43 Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-TestSnapshotPattern-175105621-project Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 749bd06e-31c3-4477-acfb-ce838a132985 could not be found. Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '749bd06e-31c3-4477-acfb-ce838a132985'} Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 749bd06e-31c3-4477-acfb-ce838a132985 could not be found. Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 749bd06e-31c3-4477-acfb-ce838a132985 could not be found. Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:42:44.201429 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:42:44.206216 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:42:44.206216 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:42:44.206216 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:42:44.206216 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:42:44.206216 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:42:44.206216 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 749bd06e-31c3-4477-acfb-ce838a132985 could not be found. Aug 07 02:42:44.206216 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:42:44.206216 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-d4a65793-acbb-4f89-92cb-5c666fd61b96 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Returning 404 to user: Instance 749bd06e-31c3-4477-acfb-ce838a132985 could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:42:44.206216 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-d4a65793-acbb-4f89-92cb-5c666fd61b96 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985" status: 404 len: 111 microversion: 2.1 time: 0.033312 Aug 07 02:42:44.206216 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4035/7603] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:42:44 2022] GET /compute/v2.1/servers/749bd06e-31c3-4477-acfb-ce838a132985 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:42:45.510045 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-bacbe6d1-fe39-44a5-a51b-4b1de4690b7d tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:42:45.510667 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bacbe6d1-fe39-44a5-a51b-4b1de4690b7d tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 59248039-324a-42af-8958-09f5c762afbd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:42:45.512888 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [req-c68eb395-3cb7-49ee-922a-9a5ef5c91427 req-578e51da-712e-43eb-bd8e-6a7c3752ae5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59248039-324a-42af-8958-09f5c762afbd", "tag": "df88941e-b49b-4ae5-97f5-50d885da0f51"}]} {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:42:45.517680 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bacbe6d1-fe39-44a5-a51b-4b1de4690b7d tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:42:45.518560 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bacbe6d1-fe39-44a5-a51b-4b1de4690b7d tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:42:45.519238 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bacbe6d1-fe39-44a5-a51b-4b1de4690b7d tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:42:45.520190 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bacbe6d1-fe39-44a5-a51b-4b1de4690b7d tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:42:45.520751 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bacbe6d1-fe39-44a5-a51b-4b1de4690b7d tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:42:45.521270 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-bacbe6d1-fe39-44a5-a51b-4b1de4690b7d tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:42:45.522815 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c68eb395-3cb7-49ee-922a-9a5ef5c91427 req-578e51da-712e-43eb-bd8e-6a7c3752ae5d service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:42:45.523308 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c68eb395-3cb7-49ee-922a-9a5ef5c91427 req-578e51da-712e-43eb-bd8e-6a7c3752ae5d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:42:45.523760 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [req-c68eb395-3cb7-49ee-922a-9a5ef5c91427 req-578e51da-712e-43eb-bd8e-6a7c3752ae5d service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:42:45.535394 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.compute.server_external_events [req-c68eb395-3cb7-49ee-922a-9a5ef5c91427 req-578e51da-712e-43eb-bd8e-6a7c3752ae5d service nova] Creating event network-changed:df88941e-b49b-4ae5-97f5-50d885da0f51 for instance 59248039-324a-42af-8958-09f5c762afbd on n-h1-master-1 Aug 07 02:42:45.541589 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [req-c68eb395-3cb7-49ee-922a-9a5ef5c91427 req-578e51da-712e-43eb-bd8e-6a7c3752ae5d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032043 Aug 07 02:42:45.542245 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4036/7604] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:42:45.551610 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-bacbe6d1-fe39-44a5-a51b-4b1de4690b7d tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 59248039-324a-42af-8958-09f5c762afbd] Going to try to terminate instance {{(pid=119517) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 02:42:45.643330 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-bacbe6d1-fe39-44a5-a51b-4b1de4690b7d tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "DELETE /compute/v2.1/servers/59248039-324a-42af-8958-09f5c762afbd" status: 204 len: 0 microversion: 2.1 time: 0.138020 Aug 07 02:42:45.644296 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3569/7605] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 02:42:45 2022] DELETE /compute/v2.1/servers/59248039-324a-42af-8958-09f5c762afbd => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 02:42:45.653751 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-77245835-3f41-40c9-8fdf-615a1cf0f83e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:42:45.654605 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-77245835-3f41-40c9-8fdf-615a1cf0f83e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 59248039-324a-42af-8958-09f5c762afbd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:42:45.661185 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77245835-3f41-40c9-8fdf-615a1cf0f83e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:42:45.661787 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77245835-3f41-40c9-8fdf-615a1cf0f83e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:42:45.663167 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77245835-3f41-40c9-8fdf-615a1cf0f83e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:42:45.664011 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77245835-3f41-40c9-8fdf-615a1cf0f83e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:42:45.665338 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77245835-3f41-40c9-8fdf-615a1cf0f83e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:42:45.666018 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-77245835-3f41-40c9-8fdf-615a1cf0f83e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:42:45.807387 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-77245835-3f41-40c9-8fdf-615a1cf0f83e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1755f644c416482c955baa17a4b21f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1518999779440e38b3796e5bf91c262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:42:45.815023 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-77245835-3f41-40c9-8fdf-615a1cf0f83e tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "GET /compute/v2.1/servers/59248039-324a-42af-8958-09f5c762afbd" status: 200 len: 1682 microversion: 2.1 time: 0.165972 Aug 07 02:42:45.815600 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4037/7606] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:42:45 2022] GET /compute/v2.1/servers/59248039-324a-42af-8958-09f5c762afbd => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 02:42:46.837683 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-2727deeb-dcb3-4166-aa17-d579705b6439 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Calling method '>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:42:46.838391 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.compute.api [None req-2727deeb-dcb3-4166-aa17-d579705b6439 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 59248039-324a-42af-8958-09f5c762afbd] Fetching instance by UUID {{(pid=119517) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:42:46.845300 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2727deeb-dcb3-4166-aa17-d579705b6439 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:42:46.845786 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2727deeb-dcb3-4166-aa17-d579705b6439 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:42:46.846428 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2727deeb-dcb3-4166-aa17-d579705b6439 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:42:46.847128 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2727deeb-dcb3-4166-aa17-d579705b6439 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:42:46.847680 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2727deeb-dcb3-4166-aa17-d579705b6439 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:42:46.848348 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [None req-2727deeb-dcb3-4166-aa17-d579705b6439 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:42:47.040548 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.policy [None req-2727deeb-dcb3-4166-aa17-d579705b6439 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1755f644c416482c955baa17a4b21f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1518999779440e38b3796e5bf91c262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119517) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:42:47.048905 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-2727deeb-dcb3-4166-aa17-d579705b6439 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "GET /compute/v2.1/servers/59248039-324a-42af-8958-09f5c762afbd" status: 200 len: 1682 microversion: 2.1 time: 0.215548 Aug 07 02:42:47.049697 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3570/7607] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:42:46 2022] GET /compute/v2.1/servers/59248039-324a-42af-8958-09f5c762afbd => generated 1682 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:42:48.049004 n-d-master-1 devstack@n-api.service[119517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 02:42:48.049809 n-d-master-1 devstack@n-api.service[119517]: Sun Aug 7 02:42:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 02:42:48.071712 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-62adee67-db4b-497b-b187-3f94048ad00a tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:42:48.073094 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-62adee67-db4b-497b-b187-3f94048ad00a tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 59248039-324a-42af-8958-09f5c762afbd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:42:48.080247 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62adee67-db4b-497b-b187-3f94048ad00a tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:42:48.080943 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62adee67-db4b-497b-b187-3f94048ad00a tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:42:48.081397 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62adee67-db4b-497b-b187-3f94048ad00a tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:42:48.082119 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62adee67-db4b-497b-b187-3f94048ad00a tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:42:48.082585 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62adee67-db4b-497b-b187-3f94048ad00a tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:42:48.083196 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-62adee67-db4b-497b-b187-3f94048ad00a tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:42:48.125449 n-d-master-1 devstack@n-api.service[119516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 02:42:48.125618 n-d-master-1 devstack@n-api.service[119516]: Sun Aug 7 02:42:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/59248039-324a-42af-8958-09f5c762afbd (ip 10.222.0.39) !!! Aug 07 02:42:48.128626 n-d-master-1 devstack@n-api.service[119516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 02:42:48.129834 n-d-master-1 devstack@n-api.service[119516]: Sun Aug 7 02:42:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/59248039-324a-42af-8958-09f5c762afbd (ip 10.222.0.39) !!! Aug 07 02:42:48.152875 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.policy [None req-62adee67-db4b-497b-b187-3f94048ad00a tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1755f644c416482c955baa17a4b21f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1518999779440e38b3796e5bf91c262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119516) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 02:42:48.164265 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-62adee67-db4b-497b-b187-3f94048ad00a tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "GET /compute/v2.1/servers/59248039-324a-42af-8958-09f5c762afbd" status: 200 len: 1496 microversion: 2.1 time: 0.096933 Aug 07 02:42:48.164965 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4038/7608] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:42:48 2022] GET /compute/v2.1/servers/59248039-324a-42af-8958-09f5c762afbd => generated 1496 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 02:42:48.221003 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [req-f55eb290-c3ac-4b8a-a081-141b25cd472d req-65d5c11a-b580-4f1f-b7c6-5f7f8e8ba86c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59248039-324a-42af-8958-09f5c762afbd", "name": "network-vif-deleted", "tag": "df88941e-b49b-4ae5-97f5-50d885da0f51"}]} {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 02:42:48.231875 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f55eb290-c3ac-4b8a-a081-141b25cd472d req-65d5c11a-b580-4f1f-b7c6-5f7f8e8ba86c service nova] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:42:48.232375 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f55eb290-c3ac-4b8a-a081-141b25cd472d req-65d5c11a-b580-4f1f-b7c6-5f7f8e8ba86c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:42:48.232800 n-d-master-1 devstack@n-api.service[119517]: DEBUG oslo_concurrency.lockutils [req-f55eb290-c3ac-4b8a-a081-141b25cd472d req-65d5c11a-b580-4f1f-b7c6-5f7f8e8ba86c service nova] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:42:48.244812 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.compute.server_external_events [req-f55eb290-c3ac-4b8a-a081-141b25cd472d req-65d5c11a-b580-4f1f-b7c6-5f7f8e8ba86c service nova] Creating event network-vif-deleted:df88941e-b49b-4ae5-97f5-50d885da0f51 for instance 59248039-324a-42af-8958-09f5c762afbd on n-h1-master-1 Aug 07 02:42:48.250038 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [req-f55eb290-c3ac-4b8a-a081-141b25cd472d req-65d5c11a-b580-4f1f-b7c6-5f7f8e8ba86c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032734 Aug 07 02:42:48.250630 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3571/7609] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Aug 7 02:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 02:42:49.185695 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-66564b8e-e327-4bd5-852b-3e2ef4d7b3cd tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Calling method '>' {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:42:49.186325 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.compute.api [None req-66564b8e-e327-4bd5-852b-3e2ef4d7b3cd tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] [instance: 59248039-324a-42af-8958-09f5c762afbd] Fetching instance by UUID {{(pid=119516) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 02:42:49.193154 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-66564b8e-e327-4bd5-852b-3e2ef4d7b3cd tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:42:49.193642 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-66564b8e-e327-4bd5-852b-3e2ef4d7b3cd tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:42:49.194086 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-66564b8e-e327-4bd5-852b-3e2ef4d7b3cd tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:42:49.194782 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-66564b8e-e327-4bd5-852b-3e2ef4d7b3cd tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Acquiring lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 02:42:49.195241 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-66564b8e-e327-4bd5-852b-3e2ef4d7b3cd tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 02:42:49.195704 n-d-master-1 devstack@n-api.service[119516]: DEBUG oslo_concurrency.lockutils [None req-66564b8e-e327-4bd5-852b-3e2ef4d7b3cd tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Lock "946acc3b-7b72-45d6-9151-44f3ad85fe4f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119516) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 02:42:49.208762 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.wsgi [None req-66564b8e-e327-4bd5-852b-3e2ef4d7b3cd tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] HTTP exception thrown: Instance 59248039-324a-42af-8958-09f5c762afbd could not be found. Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-66564b8e-e327-4bd5-852b-3e2ef4d7b3cd tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Request method failure captured: Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: request: GET /compute/v2.1/servers/59248039-324a-42af-8958-09f5c762afbd HTTP/1.1 Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: Accept: application/json Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: Accept-Encoding: identity Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: Connection: close Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: Content-Length: 0 Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: Content-Type: application/json Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: Host: 10.222.0.39 Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: Openstack-System-Scope: None Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: User-Agent: python-urllib3/1.26.11 Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: X-Auth-Token: gAAAAABi7yWHQRaccwxkj-uzwj04DPWbQ0IEpDxwqRYhjcwP0XgCNFTxOBBhWpeHP1ZKG-EnBlQXCdQzG9HQtlr3DwAOyKbnNGWi3iUigCP3TYFmr1SO4dF6TJFl3KevN_N-9bt_QWThxw85e8p6aO1cLOkQvySboA5Av0xA8alWkEQwP-ZgV84 Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Id: None Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: X-Domain-Name: None Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: X-Identity-Status: Confirmed Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: X-Is-Admin-Project: True Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Id: default Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: X-Project-Domain-Name: Default Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: X-Project-Id: a1518999779440e38b3796e5bf91c262 Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: X-Project-Name: tempest-TestSnapshotPattern-175105621 Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: X-Role: reader,member Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: X-Roles: reader,member Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a1518999779440e38b3796e5bf91c262"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a1518999779440e38b3796e5bf91c262", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a1518999779440e38b3796e5bf91c262"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a1518999779440e38b3796e5bf91c262"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}] Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: X-Tenant: tempest-TestSnapshotPattern-175105621 Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Id: a1518999779440e38b3796e5bf91c262 Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: X-Tenant-Name: tempest-TestSnapshotPattern-175105621 Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: X-User: tempest-TestSnapshotPattern-175105621-project Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Id: default Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: X-User-Domain-Name: Default Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: X-User-Id: 1755f644c416482c955baa17a4b21f43 Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: X-User-Name: tempest-TestSnapshotPattern-175105621-project Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: method: > Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: exception: Instance 59248039-324a-42af-8958-09f5c762afbd could not be found. Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: action_args: {'id': '59248039-324a-42af-8958-09f5c762afbd'} Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: {{(pid=119516) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59248039-324a-42af-8958-09f5c762afbd could not be found. Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59248039-324a-42af-8958-09f5c762afbd could not be found. Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 02:42:49.210918 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:42:49.215650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 02:42:49.215650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 02:42:49.215650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 02:42:49.215650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 02:42:49.215650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 02:42:49.215650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59248039-324a-42af-8958-09f5c762afbd could not be found. Aug 07 02:42:49.215650 n-d-master-1 devstack@n-api.service[119516]: ERROR nova.api.openstack.wsgi Aug 07 02:42:49.215650 n-d-master-1 devstack@n-api.service[119516]: DEBUG nova.api.openstack.wsgi [None req-66564b8e-e327-4bd5-852b-3e2ef4d7b3cd tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Returning 404 to user: Instance 59248039-324a-42af-8958-09f5c762afbd could not be found. {{(pid=119516) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 02:42:49.215650 n-d-master-1 devstack@n-api.service[119516]: INFO nova.api.openstack.requestlog [None req-66564b8e-e327-4bd5-852b-3e2ef4d7b3cd tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "GET /compute/v2.1/servers/59248039-324a-42af-8958-09f5c762afbd" status: 404 len: 111 microversion: 2.1 time: 0.030569 Aug 07 02:42:49.215650 n-d-master-1 devstack@n-api.service[119516]: [pid: 119516|app: 0|req: 4039/7610] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 02:42:49 2022] GET /compute/v2.1/servers/59248039-324a-42af-8958-09f5c762afbd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 02:42:49.374305 n-d-master-1 devstack@n-api.service[119517]: DEBUG nova.api.openstack.wsgi [None req-5b283e90-a914-4590-949b-7dfcddcf0aa8 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] Calling method '.version_select at 0x7f9e2401bca0>' {{(pid=119517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 02:42:49.398844 n-d-master-1 devstack@n-api.service[119517]: INFO nova.api.openstack.requestlog [None req-5b283e90-a914-4590-949b-7dfcddcf0aa8 tempest-TestSnapshotPattern-175105621 tempest-TestSnapshotPattern-175105621-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-236322405" status: 202 len: 0 microversion: 2.1 time: 0.028580 Aug 07 02:42:49.399389 n-d-master-1 devstack@n-api.service[119517]: [pid: 119517|app: 0|req: 3572/7611] 10.222.0.39 () {58 vars in 1254 bytes} [Sun Aug 7 02:42:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-236322405 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 02:44:49.711518 n-d-master-1 devstack@n-api.service[119517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 02:44:49.712164 n-d-master-1 devstack@n-api.service[119517]: Sun Aug 7 02:44:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 02:46:07.912367 n-d-master-1 devstack@n-api.service[119517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 02:46:07.913104 n-d-master-1 devstack@n-api.service[119517]: Sun Aug 7 02:46:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 02:46:08.057606 n-d-master-1 devstack@n-api.service[119517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 02:46:08.057748 n-d-master-1 devstack@n-api.service[119517]: Sun Aug 7 02:46:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 02:46:08.138223 n-d-master-1 devstack@n-api.service[119516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 02:46:08.138709 n-d-master-1 devstack@n-api.service[119516]: Sun Aug 7 02:46:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 02:46:08.140642 n-d-master-1 devstack@n-api.service[119516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 02:46:08.141210 n-d-master-1 devstack@n-api.service[119516]: Sun Aug 7 02:46:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 02:48:09.719674 n-d-master-1 devstack@n-api.service[119517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 02:48:09.720171 n-d-master-1 devstack@n-api.service[119517]: Sun Aug 7 02:48:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 02:48:32.097681 n-d-master-1 devstack@n-api.service[119516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 02:48:32.098227 n-d-master-1 devstack@n-api.service[119516]: Sun Aug 7 02:48:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 02:49:27.919900 n-d-master-1 devstack@n-api.service[119517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 02:49:27.920432 n-d-master-1 devstack@n-api.service[119517]: Sun Aug 7 02:49:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 02:49:28.066247 n-d-master-1 devstack@n-api.service[119517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 02:49:28.066438 n-d-master-1 devstack@n-api.service[119517]: Sun Aug 7 02:49:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 02:49:28.147302 n-d-master-1 devstack@n-api.service[119516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 02:49:28.147810 n-d-master-1 devstack@n-api.service[119516]: Sun Aug 7 02:49:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 02:49:28.153280 n-d-master-1 devstack@n-api.service[119516]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 02:49:28.153645 n-d-master-1 devstack@n-api.service[119516]: Sun Aug 7 02:49:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 02:51:29.728601 n-d-master-1 devstack@n-api.service[119517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 02:51:29.729404 n-d-master-1 devstack@n-api.service[119517]: Sun Aug 7 02:51:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!